-- Logs begin at Tue 2022-10-18 14:42:25 UTC, end at Tue 2022-10-18 17:19:58 UTC. -- Oct 18 15:13:38.112609 n-d-853682-5 systemd[1]: Starting Devstack devstack@n-api.service... Oct 18 15:13:38.120116 n-d-853682-5 devstack@n-api.service[104511]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 18 15:13:38.124125 n-d-853682-5 devstack@n-api.service[104511]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 18 15:13:38 2022] *** Oct 18 15:13:38.124125 n-d-853682-5 devstack@n-api.service[104511]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 18 15:13:38.124125 n-d-853682-5 devstack@n-api.service[104511]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 18 15:13:38.124125 n-d-853682-5 devstack@n-api.service[104511]: nodename: n-d-853682-5 Oct 18 15:13:38.124125 n-d-853682-5 devstack@n-api.service[104511]: machine: x86_64 Oct 18 15:13:38.124125 n-d-853682-5 devstack@n-api.service[104511]: clock source: unix Oct 18 15:13:38.124125 n-d-853682-5 devstack@n-api.service[104511]: pcre jit disabled Oct 18 15:13:38.124125 n-d-853682-5 devstack@n-api.service[104511]: detected number of CPU cores: 4 Oct 18 15:13:38.124125 n-d-853682-5 devstack@n-api.service[104511]: current working directory: / Oct 18 15:13:38.124125 n-d-853682-5 devstack@n-api.service[104511]: detected binary path: /usr/bin/uwsgi-core Oct 18 15:13:38.124125 n-d-853682-5 devstack@n-api.service[104511]: your processes number limit is 47680 Oct 18 15:13:38.124125 n-d-853682-5 devstack@n-api.service[104511]: your memory page size is 4096 bytes Oct 18 15:13:38.124125 n-d-853682-5 devstack@n-api.service[104511]: detected max file descriptor number: 2048 Oct 18 15:13:38.124125 n-d-853682-5 devstack@n-api.service[104511]: lock engine: pthread robust mutexes Oct 18 15:13:38.124125 n-d-853682-5 devstack@n-api.service[104511]: thunder lock: enabled Oct 18 15:13:38.124125 n-d-853682-5 devstack@n-api.service[104511]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 18 15:13:38.124125 n-d-853682-5 devstack@n-api.service[104511]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 18 15:13:38.162892 n-d-853682-5 devstack@n-api.service[104511]: Python main interpreter initialized at 0x56193197c9c0 Oct 18 15:13:38.162892 n-d-853682-5 devstack@n-api.service[104511]: python threads support enabled Oct 18 15:13:38.162892 n-d-853682-5 devstack@n-api.service[104511]: your server socket listen backlog is limited to 100 connections Oct 18 15:13:38.162892 n-d-853682-5 devstack@n-api.service[104511]: your mercy for graceful operations on workers is 90 seconds Oct 18 15:13:38.163277 n-d-853682-5 devstack@n-api.service[104511]: mapped 403077 bytes (393 KB) for 2 cores Oct 18 15:13:38.163355 n-d-853682-5 devstack@n-api.service[104511]: *** Operational MODE: preforking *** Oct 18 15:13:38.163567 n-d-853682-5 devstack@n-api.service[104511]: *** uWSGI is running in multiple interpreter mode *** Oct 18 15:13:38.163567 n-d-853682-5 devstack@n-api.service[104511]: spawned uWSGI master process (pid: 104511) Oct 18 15:13:38.163767 n-d-853682-5 systemd[1]: Started Devstack devstack@n-api.service. Oct 18 15:13:38.167566 n-d-853682-5 devstack@n-api.service[104511]: spawned uWSGI worker 1 (pid: 104514, cores: 1) Oct 18 15:13:38.167566 n-d-853682-5 devstack@n-api.service[104511]: spawned uWSGI worker 2 (pid: 104515, cores: 1) Oct 18 15:13:38.167566 n-d-853682-5 devstack@n-api.service[104511]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 18 15:13:38.842826 n-d-853682-5 devstack@n-api.service[104515]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 18 15:13:38.865367 n-d-853682-5 devstack@n-api.service[104514]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 18 15:13:39.942161 n-d-853682-5 devstack@n-api.service[104515]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 18 15:13:39.942161 n-d-853682-5 devstack@n-api.service[104515]: from cryptography.utils import int_from_bytes Oct 18 15:13:39.942734 n-d-853682-5 devstack@n-api.service[104515]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 18 15:13:39.942734 n-d-853682-5 devstack@n-api.service[104515]: from cryptography.utils import int_from_bytes Oct 18 15:13:39.982138 n-d-853682-5 devstack@n-api.service[104514]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 18 15:13:39.982138 n-d-853682-5 devstack@n-api.service[104514]: from cryptography.utils import int_from_bytes Oct 18 15:13:39.982711 n-d-853682-5 devstack@n-api.service[104514]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 18 15:13:39.982711 n-d-853682-5 devstack@n-api.service[104514]: from cryptography.utils import int_from_bytes Oct 18 15:13:42.460976 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 18 15:13:42.461603 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 18 15:13:42.461793 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 18 15:13:42.461954 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 18 15:13:42.462374 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 18 15:13:42.462464 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 18 15:13:42.462545 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 18 15:13:42.462705 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.462807 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 18 15:13:42.463031 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.463117 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 18 15:13:42.463309 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 18 15:13:42.463393 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.463655 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.463740 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.463985 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.464085 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.464297 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.464406 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.464613 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.464703 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.464959 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.465047 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.465274 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.465382 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.465532 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.465615 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.465845 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.465927 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.466167 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-853682-5 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.466259 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.466463 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.466557 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.466777 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.466871 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.467081 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.467165 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-853682-5 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.467395 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.467478 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.467696 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.467778 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.468005 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.468088 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.468307 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.468389 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.468621 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.468830 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.468957 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.469262 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.469373 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.469567 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.469765 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.469897 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.470235 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.470385 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.470468 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.470545 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.470667 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.470785 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.471003 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.471093 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.471318 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.471402 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.471630 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.472203 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.472475 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.472561 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.472801 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.472957 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-853682-5 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.473136 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.473221 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.473449 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.473547 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.473809 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.473890 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-853682-5 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.474143 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.474225 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.474460 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.474554 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.475022 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.475119 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.475367 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.475449 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.475688 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.475780 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.475995 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.476136 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.476318 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.476405 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.476640 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.476744 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.476975 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.477074 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.477291 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.477374 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.477591 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.477686 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.477901 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.477994 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.478206 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.478297 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.478515 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.478597 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.478820 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.478936 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.479123 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.479222 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.479371 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.479476 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.479684 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.479781 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.480004 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.480099 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.480257 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.480352 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.480569 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.480671 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.480885 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.480993 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.481135 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.481240 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.481452 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.481547 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.481769 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.481874 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.482020 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.482119 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.482342 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.482426 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.482657 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.482739 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.482964 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.483058 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.483269 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.483359 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.483575 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.483658 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.483878 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.483964 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.484181 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.484272 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.484487 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.484578 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.484795 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.484911 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.485125 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.485211 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.485433 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.485525 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.485749 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.485832 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.486075 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.486160 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.486379 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.486470 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.486687 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.486783 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.487020 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.487105 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.487337 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.488049 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.488199 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.488282 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.488518 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.488617 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.488908 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.489019 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.489167 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.489254 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.489471 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.489555 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.489783 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.489875 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.490093 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.490184 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.490402 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.490494 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.490711 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.490794 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.490960 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.491052 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.491259 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.491344 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.491563 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.491655 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.491869 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.491952 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.492174 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.492256 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.492481 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.492578 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.492784 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.492941 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.493104 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.493202 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.493413 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.493498 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.493718 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.493801 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.494023 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.494115 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.494328 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.494412 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.494633 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.494725 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.494937 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.495029 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.495237 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.495323 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.495540 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.495624 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.495841 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.495939 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.496141 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.496232 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.496448 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.496544 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.496759 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.496898 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.497091 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.497189 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.497392 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.497487 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.497695 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.497788 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.497997 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.498081 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.498312 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.498404 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.498613 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.498705 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.498916 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.499067 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.499233 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.499323 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.499537 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.499632 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.499837 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.499921 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.500149 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.500233 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.500453 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.500536 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.500754 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.500891 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.501092 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.501312 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.501785 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.501877 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.501963 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.502042 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.502119 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.502196 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.502281 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.502360 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.502560 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.502644 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.502859 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.502944 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.503185 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.503270 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.503486 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.503569 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.503787 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.503880 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.504086 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.504171 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.504386 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.504477 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.504683 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.504780 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.505011 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.505098 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.505320 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.505406 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.505622 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.505719 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.505941 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.506025 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.506264 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.506349 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.506573 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.506666 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.506886 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.506999 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.507193 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.507292 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.507516 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:13:42.507610 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.507846 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.507930 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.508179 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.508265 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.508508 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.508593 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.508859 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.508960 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.509155 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.509240 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.509471 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.509556 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.509797 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.509880 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.510106 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.510202 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.510414 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.510507 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.510721 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.510812 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.511038 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.511205 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.511355 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.511446 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.511683 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.511776 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.511994 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.512088 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.512307 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.512394 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.512622 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.512707 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.512953 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.513059 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.513274 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.513370 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.513590 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.513674 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.513903 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.513996 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.514210 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.514293 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.514540 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.514623 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.514861 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.514953 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.515173 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.515268 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.515492 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.515585 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.515809 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.515906 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.516117 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.516269 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.516426 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.516512 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.516733 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.516853 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.517088 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.517184 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.517398 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.517491 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.517704 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.517789 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.518017 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.518100 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.518327 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.518418 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.519174 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.519314 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.519486 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.519573 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.519793 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.519877 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.520108 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.520193 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.520416 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.520499 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.520724 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.520837 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.521066 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.521151 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.521375 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.521468 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.521686 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.521778 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.521995 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.522078 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.522305 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.522388 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.522618 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.522711 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.522930 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.523013 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.523240 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.523321 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.523552 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.523645 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.523855 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.523939 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.524156 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.524239 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.524458 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.524551 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.524763 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.524883 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.525089 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.525173 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.525407 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.525493 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.525727 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.525811 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.526031 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.526123 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.526351 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.526434 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.526653 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.526735 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.526962 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.527064 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.527270 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.527358 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.527576 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.527662 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.527876 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.527960 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.528184 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.528275 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.528489 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.528571 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.528793 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.528909 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.529131 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.529213 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.529437 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.529520 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.529741 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.529834 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.530063 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.530160 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.530366 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.530448 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.530672 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.530767 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.530984 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.531066 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.531292 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.531376 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.531598 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.531691 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.531910 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.531992 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.532219 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.532310 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.532531 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.532614 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.532872 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.532960 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.533186 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.533271 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.533508 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.533592 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.533827 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.533917 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.534130 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.534218 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.535084 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.535176 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.535415 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.535501 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.535734 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.535820 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.536038 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.536123 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.536350 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.536442 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.536655 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.536751 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.536981 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.537068 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.537287 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.537374 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.537596 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.537687 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.537896 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.537978 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.538198 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.538287 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.538499 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.538590 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.538802 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.538886 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.539104 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.539197 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.539408 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.539547 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.539714 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.539807 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.540013 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.540096 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.540319 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.540404 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.540621 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.540706 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.540949 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.541036 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.541258 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.541344 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.541564 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.541648 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.541908 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.541999 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.542214 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.542299 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.542533 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.542622 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.542847 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.542931 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.543161 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.543246 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.543470 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.543561 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.543784 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.543887 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.544096 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.544218 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.544405 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.544489 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.544722 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.544853 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.545056 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.545139 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.545371 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.545453 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.545678 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.545783 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.545997 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.546089 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.546305 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.546387 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.546619 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.546710 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.546922 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.547005 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.547235 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.547318 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.547554 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.547681 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.547862 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.547947 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.548178 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.548270 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.548501 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.548584 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.548826 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.548913 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.549145 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.549238 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.549455 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.549576 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.549767 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.549859 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.550112 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.550195 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.550421 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.550504 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.550737 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.550820 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.551045 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.551134 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.551357 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.551440 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.551663 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.551744 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.551980 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.552073 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.552287 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.552369 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.552599 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.552680 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.552927 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.553026 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.553243 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.553326 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.553561 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.553650 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.553869 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.553962 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.554186 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.554314 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.554497 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.554579 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.554816 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.554908 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.555126 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.555221 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.555435 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.555519 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.555745 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.555836 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.556052 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.556142 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.556359 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.556443 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.556667 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.556752 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.557006 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.557093 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.557317 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.557402 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.557627 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.557711 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.557930 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.558012 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.558241 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.558323 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.558545 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.558636 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.558847 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.558944 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.559150 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.559233 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.559457 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.559541 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.559764 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.559847 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.560068 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.560165 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.560383 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.560467 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.560701 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.560783 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.561029 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.561126 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.561333 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.561417 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.561653 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.561737 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.561957 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.562048 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.562259 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.562340 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.562563 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.562654 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.562866 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.562958 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.563170 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.563253 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.563476 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.563560 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.563784 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.563871 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.564095 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.564189 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.564415 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.564499 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.564719 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.564822 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.565120 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.565214 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.565432 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.565528 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.565764 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.565850 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.566080 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.566161 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.566392 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.566481 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.566700 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.566784 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.567009 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.567092 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.567320 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.567412 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.567629 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.567712 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.567937 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.568019 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.568248 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.568338 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.568552 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.568640 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.568893 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.569010 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.569207 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.569311 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.569512 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.569605 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.569823 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.569908 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.570135 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.570227 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.570449 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.570699 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.570833 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.571034 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.571153 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.571353 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.571672 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.571754 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.572014 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.572114 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.572335 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.572435 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.572668 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.572752 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.573023 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.573108 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.573338 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.573436 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.573645 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.573738 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.573952 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.574045 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.574256 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.574341 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.574560 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.574645 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.574871 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.574955 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.575175 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.575260 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.575478 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.575573 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.575781 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.575866 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.576091 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.576176 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.576393 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.576478 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.576695 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.576780 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.577019 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.577104 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.577325 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.577410 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.577632 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.577724 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.577934 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.578077 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.578239 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.578323 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.578540 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.578622 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.578854 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.578945 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.579158 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.579240 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.579459 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.579543 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.579761 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.579857 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.580069 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.580154 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.580374 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.580456 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.580681 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.580774 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.581028 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.581627 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.581877 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.581966 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.582188 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.582278 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.582508 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.582598 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.582813 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.582897 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.583134 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.583226 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.583436 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.583520 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.583739 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.583823 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.584042 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.584127 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.584350 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.584433 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.584659 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.584750 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.584983 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.585068 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.585295 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.585378 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.585602 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.585698 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.585906 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.585996 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.586289 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.586387 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.586509 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.586604 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.586814 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.586899 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.587117 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.587215 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.587429 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.587523 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.587735 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.587868 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.588037 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.588116 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.588338 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.588500 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.588647 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.588732 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.588993 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.589080 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.589298 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.589384 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.589606 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.589690 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.589908 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.590031 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.590213 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.590304 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.590519 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.590609 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.590822 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.590905 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.591120 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.591206 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.591428 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.591519 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.591734 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.591824 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.592035 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.592119 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.592345 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.592428 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.592656 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.592752 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.592984 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.593084 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.593290 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.593375 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.593600 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.593693 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.593905 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.593989 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.594207 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.594307 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.594516 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.594618 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.594822 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.594908 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.595129 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.595215 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.595429 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.595524 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.595738 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.595823 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.596042 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.596126 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.596344 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.596429 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.596646 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.596769 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.597525 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.597622 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.597837 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.597967 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.598143 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.598228 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.598456 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.598548 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.598764 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.598850 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.599070 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.599154 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.599381 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.599465 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.599944 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.600036 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.600247 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.600331 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.600560 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.600658 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.600890 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.600989 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.601198 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.601282 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.601506 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.601603 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.601871 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.601973 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.602176 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.602261 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.602492 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.602587 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.602811 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.602896 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.603125 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.603209 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.603438 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.603531 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.603751 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.603836 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.604056 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.604140 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.604369 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.604454 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.604678 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.604802 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.605011 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.605097 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.605320 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.605412 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.605623 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.605708 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.605936 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.606018 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.606244 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.606329 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.606552 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.606643 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.606869 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.606952 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.607183 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.607266 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.607499 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.607583 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.607800 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.607894 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.608108 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.608196 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.608420 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.608507 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.608727 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.608848 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.609061 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.609144 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.609376 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.609459 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.609686 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.609779 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.609998 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.610082 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.610307 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.610389 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.610622 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.610713 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.610956 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.611092 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.611233 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.611318 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.611545 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.611640 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.611852 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.611938 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.612155 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.612248 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.612489 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.612577 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.612799 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.612930 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.613122 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.613207 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.613431 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.613517 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.613734 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.613820 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.614038 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.614129 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.614337 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.614421 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.614640 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.614761 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.614953 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.615074 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.615259 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.615384 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.615685 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.615770 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.615996 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.616088 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.616307 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.616392 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.616612 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.616703 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.616949 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.617056 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.617256 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.617349 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.617653 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.617747 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.617968 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.618129 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.618273 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.618358 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.618582 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.618694 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.618884 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.619010 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.619187 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.619331 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.619496 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.619645 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.619817 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.619953 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.620119 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.620258 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.620422 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.620572 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.620728 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.620922 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.621073 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.621229 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.621374 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.621535 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.621691 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.621841 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.622104 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.622188 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.622415 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.622510 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.622719 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.622803 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.623130 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.623221 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.623442 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.623540 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.623751 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.623836 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.624071 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.624155 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.624389 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.624484 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.624714 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.624831 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.625041 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.625137 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.625353 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.625438 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.625661 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.625758 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.625981 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.626072 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.626301 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.626385 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.626610 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.626702 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.626921 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.627004 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.627223 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.627309 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.627541 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.627635 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.627857 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.627942 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.628188 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.628274 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.628507 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.628680 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.628972 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.629299 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.629383 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.629636 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.629942 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.630038 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.630288 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.630372 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.630601 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.630764 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.630906 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.631098 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.631217 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.631419 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.631524 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.631748 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.631834 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.632079 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.632164 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.632392 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.632477 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.632704 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.632790 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.633050 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.633134 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.633358 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.633453 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.633662 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.633748 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.633965 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.634050 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.634287 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.634380 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.634589 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.634675 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.634910 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.634995 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.635223 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.635317 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.635539 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.635629 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.635849 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.635934 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.636151 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.636243 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.636467 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.636550 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.636774 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.636876 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.637099 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.637198 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.637403 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.637488 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.637705 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.637790 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.638036 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.638128 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.638337 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.638420 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.638656 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.638741 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.638963 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.639047 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.639276 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.639370 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.639583 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.639675 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.639914 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.639999 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.640222 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.640305 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.640544 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.640629 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.640876 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.640963 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.641193 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.641278 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.641514 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.641600 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.641817 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.641903 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.642119 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.642212 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.642427 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.642522 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.642730 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.642822 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.643033 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.643124 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.643336 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.643434 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.644172 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.644270 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.644472 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.644558 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.644774 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.644907 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.645099 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.645192 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.645419 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.645509 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.645719 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.645811 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.646028 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.646112 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.646334 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.646419 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.646634 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.646719 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.646936 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.647019 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.647235 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.647319 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.647552 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.647638 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.647865 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.647949 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.648173 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.648257 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.648480 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.648565 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.648979 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.649220 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.649306 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.649381 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.649457 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.649536 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.649974 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.650081 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.650168 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.650245 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.650366 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.650461 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.650682 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.650863 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.650997 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.651130 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.651307 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.651453 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.651621 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.651774 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.651936 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.652096 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.652250 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.652416 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.652738 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.652849 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.653085 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.653185 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.653400 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.653485 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.653709 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.653801 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.654021 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.654108 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.654334 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.654419 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.654649 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.654858 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.654953 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.655195 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.655281 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.655515 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.655601 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.655830 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.655924 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.656144 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.656230 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.656461 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.656544 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.656776 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.656895 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.657115 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.657202 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.657429 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.657515 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.657740 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.657832 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.658051 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.658135 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.658362 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.658445 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.658691 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.658781 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.659013 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.659101 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.659888 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.659997 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.660204 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.660325 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.660520 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.660611 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.660863 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.660965 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.661170 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.661254 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.661480 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.661573 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.661793 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.661886 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.662105 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.662190 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.662414 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.662508 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.662723 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.662816 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.663032 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.663117 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.663344 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.663429 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.663658 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.663787 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.663975 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.664060 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.664291 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.664386 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.664603 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.664685 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.664939 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.665026 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.665486 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.665609 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.665609 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.665779 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.665945 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.666093 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.666283 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.666423 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.666608 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.666749 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.666927 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.667074 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.667246 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.667390 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.667566 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.667707 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.668032 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.668115 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.668339 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.668425 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.668646 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.668730 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.668981 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.669069 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.669292 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.669379 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.669597 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.669689 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.669917 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.670003 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.670225 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.670311 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.670529 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.670617 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.670845 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.670939 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.671158 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.671243 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.671506 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.671688 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.671817 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.672032 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.672125 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.672348 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.672433 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.672672 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.672757 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.673021 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.673109 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.673341 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.673426 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.673649 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.673897 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.673996 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.674245 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.674330 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.674556 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.674640 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.674894 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.674984 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.675205 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.675290 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.675509 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.675594 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.675816 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.675903 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.676126 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.676211 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.676433 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.676518 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.676737 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.676841 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.677069 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.677157 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.677371 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.677456 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.677688 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.677772 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.677995 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.678079 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.678301 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.678394 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.678604 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.678689 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.678916 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.679045 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.679215 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.679340 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.679526 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.679789 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.679885 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.680101 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.680194 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.680414 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.680522 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.680736 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.680847 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.681071 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.681158 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.681385 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.681475 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.681695 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.681785 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.682009 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.682111 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.682349 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.682439 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.682663 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.682754 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.682968 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.683066 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.683283 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.683374 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.683589 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.683687 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.683895 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.683993 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.684213 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.684304 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.684525 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.684617 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.684859 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.684969 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.685175 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.685265 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.685490 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.685579 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.685799 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.685890 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.686121 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.686241 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.686434 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.686668 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.686770 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.687009 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.687097 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.687335 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.687422 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.687672 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.687811 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.690326 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.690496 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.690496 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.690707 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.690812 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.690996 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.691104 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.691206 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.691309 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.691411 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.691522 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.691522 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.691715 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.691824 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.691943 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.692052 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.692431 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.692518 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.692597 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.692676 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.692754 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.692872 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.692962 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.693043 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.693145 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.693271 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.693358 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.693447 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.693528 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.693606 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.693684 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.693761 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.693848 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.693934 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.694002 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.694087 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.694222 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.694303 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.694394 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.694474 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.694552 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.694629 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.694707 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.694785 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.694871 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.694951 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.695028 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.695264 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.695361 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.695576 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.695663 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.695888 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.695974 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.696198 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.696284 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.696508 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.696595 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.696853 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.696943 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.697166 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.697251 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.697478 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.697562 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.697783 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.697870 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.698093 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.698406 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.698498 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.698728 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.698814 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.699061 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.699154 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.699378 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.699471 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.699687 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.699781 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.700008 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.700332 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.700425 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.700647 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.700733 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.700993 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.701079 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.701313 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.701400 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.701639 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.701722 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.701967 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.702052 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.702293 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.702386 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.702619 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.702759 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.702911 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.702996 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.703218 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.703312 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.703523 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.703608 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.703832 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.703926 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.704151 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.704245 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.704460 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.704545 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.704766 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.704926 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.705092 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.705178 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.705402 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.705487 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.705704 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.705798 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.706008 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.706618 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.706847 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.706936 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.707152 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.707244 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.707457 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.707542 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.707759 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.707844 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.708064 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.708148 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.708365 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.708448 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.708667 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.708752 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.708994 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.709119 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.709298 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.709384 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.709599 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.709682 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.709900 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.709984 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.710202 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.710285 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.710500 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.710583 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.710803 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.710887 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.711160 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.711284 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.711438 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.711604 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.711777 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.711918 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.712078 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.712164 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.712383 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.712484 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.712690 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.712775 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.713022 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.713110 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.713332 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.713426 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.713656 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.713742 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.713978 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.714070 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.714299 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.714424 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.714609 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.714699 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.714933 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.715018 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.715238 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.715323 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.715552 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.715639 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.715864 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.715949 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.716174 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.716261 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.716480 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.716572 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.716789 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.716943 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.717135 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.717223 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.717451 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.717602 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.717755 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.717917 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.718068 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.718152 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.718380 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.718469 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.718693 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.718793 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.719005 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.719098 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.719316 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.719405 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.719631 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.719724 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.719945 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.720037 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.720257 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.720349 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.720567 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.720653 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.720902 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.720993 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.721214 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.721300 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.721530 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.721617 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.722416 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.722523 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.722705 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.722793 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.723018 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.723114 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.723334 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.723420 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.723649 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.723742 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.723968 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.724101 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.724282 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.724367 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.724596 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.724996 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.725187 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.725272 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.725505 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.725591 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.725834 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.725929 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.726164 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.726249 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.726477 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.726562 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.726794 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.726892 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.727111 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.727203 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.727418 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.727542 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.727662 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 18 15:13:42.727860 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.728207 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.728539 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.728878 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.729199 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.729507 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:13:42.729752 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 18 15:13:42.880980 n-d-853682-5 devstack@n-api.service[104515]: INFO dbcounter [None req-83ed1409-8ece-4c1e-9fe4-ab0bdacfd556 None None] Registered counter for database nova_api Oct 18 15:13:42.883042 n-d-853682-5 devstack@n-api.service[104514]: INFO dbcounter [None req-3d8f6032-f523-4080-86dd-ac5577c008e1 None None] Registered counter for database nova_api Oct 18 15:13:42.902984 n-d-853682-5 devstack@n-api.service[104515]: DEBUG oslo_db.sqlalchemy.engines [None req-83ed1409-8ece-4c1e-9fe4-ab0bdacfd556 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104515) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 15:13:42.904720 n-d-853682-5 devstack@n-api.service[104514]: DEBUG oslo_db.sqlalchemy.engines [None req-3d8f6032-f523-4080-86dd-ac5577c008e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104514) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 15:13:42.909774 n-d-853682-5 devstack@n-api.service[104515]: DEBUG dbcounter [-] [104515] Writer thread running {{(pid=104515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 15:13:42.911343 n-d-853682-5 devstack@n-api.service[104514]: DEBUG dbcounter [-] [104514] Writer thread running {{(pid=104514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 15:13:42.967401 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.context [None req-83ed1409-8ece-4c1e-9fe4-ab0bdacfd556 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8ab54c98-adc3-429d-89a9-d68fdb0f782a(cell1) {{(pid=104515) load_cells /opt/stack/nova/nova/context.py:464}} Oct 18 15:13:42.968374 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.context [None req-3d8f6032-f523-4080-86dd-ac5577c008e1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8ab54c98-adc3-429d-89a9-d68fdb0f782a(cell1) {{(pid=104514) load_cells /opt/stack/nova/nova/context.py:464}} Oct 18 15:13:42.971194 n-d-853682-5 devstack@n-api.service[104515]: DEBUG oslo_concurrency.lockutils [None req-83ed1409-8ece-4c1e-9fe4-ab0bdacfd556 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:13:42.971667 n-d-853682-5 devstack@n-api.service[104515]: DEBUG oslo_concurrency.lockutils [None req-83ed1409-8ece-4c1e-9fe4-ab0bdacfd556 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:13:42.972202 n-d-853682-5 devstack@n-api.service[104514]: DEBUG oslo_concurrency.lockutils [None req-3d8f6032-f523-4080-86dd-ac5577c008e1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:13:42.972682 n-d-853682-5 devstack@n-api.service[104514]: DEBUG oslo_concurrency.lockutils [None req-3d8f6032-f523-4080-86dd-ac5577c008e1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:13:42.973306 n-d-853682-5 devstack@n-api.service[104515]: DEBUG oslo_concurrency.lockutils [None req-83ed1409-8ece-4c1e-9fe4-ab0bdacfd556 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:13:42.974032 n-d-853682-5 devstack@n-api.service[104515]: DEBUG oslo_concurrency.lockutils [None req-83ed1409-8ece-4c1e-9fe4-ab0bdacfd556 None None] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:13:42.974270 n-d-853682-5 devstack@n-api.service[104514]: DEBUG oslo_concurrency.lockutils [None req-3d8f6032-f523-4080-86dd-ac5577c008e1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:13:42.974473 n-d-853682-5 devstack@n-api.service[104515]: DEBUG oslo_concurrency.lockutils [None req-83ed1409-8ece-4c1e-9fe4-ab0bdacfd556 None None] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:13:42.975266 n-d-853682-5 devstack@n-api.service[104514]: DEBUG oslo_concurrency.lockutils [None req-3d8f6032-f523-4080-86dd-ac5577c008e1 None None] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:13:42.975705 n-d-853682-5 devstack@n-api.service[104514]: DEBUG oslo_concurrency.lockutils [None req-3d8f6032-f523-4080-86dd-ac5577c008e1 None None] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:13:42.976797 n-d-853682-5 devstack@n-api.service[104515]: DEBUG oslo_concurrency.lockutils [None req-83ed1409-8ece-4c1e-9fe4-ab0bdacfd556 None None] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:13:42.977690 n-d-853682-5 devstack@n-api.service[104514]: DEBUG oslo_concurrency.lockutils [None req-3d8f6032-f523-4080-86dd-ac5577c008e1 None None] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:13:42.978835 n-d-853682-5 devstack@n-api.service[104515]: INFO dbcounter [None req-83ed1409-8ece-4c1e-9fe4-ab0bdacfd556 None None] Registered counter for database nova_cell0 Oct 18 15:13:42.979666 n-d-853682-5 devstack@n-api.service[104514]: INFO dbcounter [None req-3d8f6032-f523-4080-86dd-ac5577c008e1 None None] Registered counter for database nova_cell0 Oct 18 15:13:42.982871 n-d-853682-5 devstack@n-api.service[104515]: INFO dbcounter [None req-83ed1409-8ece-4c1e-9fe4-ab0bdacfd556 None None] Registered counter for database nova_cell1 Oct 18 15:13:42.983738 n-d-853682-5 devstack@n-api.service[104514]: INFO dbcounter [None req-3d8f6032-f523-4080-86dd-ac5577c008e1 None None] Registered counter for database nova_cell1 Oct 18 15:13:42.990269 n-d-853682-5 devstack@n-api.service[104515]: DEBUG oslo_db.sqlalchemy.engines [None req-83ed1409-8ece-4c1e-9fe4-ab0bdacfd556 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104515) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 15:13:42.993627 n-d-853682-5 devstack@n-api.service[104514]: DEBUG oslo_db.sqlalchemy.engines [None req-3d8f6032-f523-4080-86dd-ac5577c008e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104514) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 15:13:42.994013 n-d-853682-5 devstack@n-api.service[104515]: DEBUG oslo_db.sqlalchemy.engines [None req-83ed1409-8ece-4c1e-9fe4-ab0bdacfd556 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104515) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 15:13:42.995049 n-d-853682-5 devstack@n-api.service[104514]: DEBUG oslo_db.sqlalchemy.engines [None req-3d8f6032-f523-4080-86dd-ac5577c008e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104514) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 15:13:42.996560 n-d-853682-5 devstack@n-api.service[104515]: DEBUG dbcounter [-] [104515] Writer thread running {{(pid=104515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 15:13:43.001503 n-d-853682-5 devstack@n-api.service[104514]: DEBUG dbcounter [-] [104514] Writer thread running {{(pid=104514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 15:13:43.004231 n-d-853682-5 devstack@n-api.service[104514]: DEBUG dbcounter [-] [104514] Writer thread running {{(pid=104514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 15:13:43.137819 n-d-853682-5 devstack@n-api.service[104515]: DEBUG dbcounter [-] [104515] Writer thread running {{(pid=104515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 15:13:43.148306 n-d-853682-5 devstack@n-api.service[104515]: INFO dbcounter [None req-83ed1409-8ece-4c1e-9fe4-ab0bdacfd556 None None] Registered counter for database nova_cell0 Oct 18 15:13:43.148454 n-d-853682-5 devstack@n-api.service[104514]: INFO dbcounter [None req-3d8f6032-f523-4080-86dd-ac5577c008e1 None None] Registered counter for database nova_cell0 Oct 18 15:13:43.157289 n-d-853682-5 devstack@n-api.service[104515]: DEBUG oslo_db.sqlalchemy.engines [None req-83ed1409-8ece-4c1e-9fe4-ab0bdacfd556 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104515) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 15:13:43.160819 n-d-853682-5 devstack@n-api.service[104514]: DEBUG oslo_db.sqlalchemy.engines [None req-3d8f6032-f523-4080-86dd-ac5577c008e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104514) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 15:13:43.161792 n-d-853682-5 devstack@n-api.service[104515]: DEBUG dbcounter [-] [104515] Writer thread running {{(pid=104515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 15:13:43.165473 n-d-853682-5 devstack@n-api.service[104514]: DEBUG dbcounter [-] [104514] Writer thread running {{(pid=104514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 15:13:43.506597 n-d-853682-5 devstack@n-api.service[104514]: WARNING keystonemiddleware.auth_token [None req-3d8f6032-f523-4080-86dd-ac5577c008e1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 18 15:13:43.509677 n-d-853682-5 devstack@n-api.service[104515]: WARNING keystonemiddleware.auth_token [None req-83ed1409-8ece-4c1e-9fe4-ab0bdacfd556 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 18 15:13:43.513850 n-d-853682-5 devstack@n-api.service[104514]: WARNING keystonemiddleware.auth_token [None req-3d8f6032-f523-4080-86dd-ac5577c008e1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 18 15:13:43.516921 n-d-853682-5 devstack@n-api.service[104515]: WARNING keystonemiddleware.auth_token [None req-83ed1409-8ece-4c1e-9fe4-ab0bdacfd556 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 18 15:13:43.852052 n-d-853682-5 devstack@n-api.service[104514]: WARNING keystonemiddleware.auth_token [None req-3d8f6032-f523-4080-86dd-ac5577c008e1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 18 15:13:43.858016 n-d-853682-5 devstack@n-api.service[104514]: WARNING keystonemiddleware.auth_token [None req-3d8f6032-f523-4080-86dd-ac5577c008e1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 18 15:13:43.859685 n-d-853682-5 devstack@n-api.service[104515]: WARNING keystonemiddleware.auth_token [None req-83ed1409-8ece-4c1e-9fe4-ab0bdacfd556 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 18 15:13:43.863848 n-d-853682-5 devstack@n-api.service[104514]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56193197c9c0 pid: 104514 (default app) Oct 18 15:13:43.865950 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi [None req-3d8f6032-f523-4080-86dd-ac5577c008e1 None None] Calling method '>' {{(pid=104514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:13:43.866219 n-d-853682-5 devstack@n-api.service[104515]: WARNING keystonemiddleware.auth_token [None req-83ed1409-8ece-4c1e-9fe4-ab0bdacfd556 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 18 15:13:43.867113 n-d-853682-5 devstack@n-api.service[104514]: INFO nova.api.openstack.requestlog [None req-3d8f6032-f523-4080-86dd-ac5577c008e1 None None] 10.222.0.60 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001741 Oct 18 15:13:43.867518 n-d-853682-5 devstack@n-api.service[104514]: [pid: 104514|app: 0|req: 1/1] 10.222.0.60 () {50 vars in 788 bytes} [Tue Oct 18 15:13:43 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:13:43.871618 n-d-853682-5 devstack@n-api.service[104515]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56193197c9c0 pid: 104515 (default app) Oct 18 15:15:04.763849 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi [None req-3d8f6032-f523-4080-86dd-ac5577c008e1 None None] Calling method '>' {{(pid=104514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:15:04.764901 n-d-853682-5 devstack@n-api.service[104514]: INFO nova.api.openstack.requestlog [None req-3d8f6032-f523-4080-86dd-ac5577c008e1 None None] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Oct 18 15:15:04.765290 n-d-853682-5 devstack@n-api.service[104514]: [pid: 104514|app: 0|req: 2/2] 10.222.0.60 () {54 vars in 931 bytes} [Tue Oct 18 15:15:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:15:04.777192 n-d-853682-5 devstack@n-api.service[104515]: DEBUG dbcounter [-] [104515] Writing DB stats nova_api:SELECT=3 {{(pid=104515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:15:04.778133 n-d-853682-5 devstack@n-api.service[104515]: DEBUG dbcounter [-] [104515] Writing DB stats nova_cell0:SELECT=3 {{(pid=104515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:15:04.778935 n-d-853682-5 devstack@n-api.service[104515]: DEBUG dbcounter [-] [104515] Writing DB stats nova_cell1:SELECT=3 {{(pid=104515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:15:04.779668 n-d-853682-5 devstack@n-api.service[104515]: DEBUG dbcounter [-] [104515] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:15:05.660399 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi [None req-148ecc0c-8e7e-4247-86f5-092ae884ed99 admin admin] Calling method '>' {{(pid=104515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:15:05.695324 n-d-853682-5 devstack@n-api.service[104515]: INFO nova.api.openstack.requestlog [None req-148ecc0c-8e7e-4247-86f5-092ae884ed99 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.922822 Oct 18 15:15:05.696942 n-d-853682-5 devstack@n-api.service[104515]: [pid: 104515|app: 0|req: 1/3] 10.222.0.60 () {60 vars in 1292 bytes} [Tue Oct 18 15:15:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:15:08.323154 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi [None req-3d8f6032-f523-4080-86dd-ac5577c008e1 None None] Calling method '>' {{(pid=104514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:15:08.324190 n-d-853682-5 devstack@n-api.service[104514]: INFO nova.api.openstack.requestlog [None req-3d8f6032-f523-4080-86dd-ac5577c008e1 None None] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 Oct 18 15:15:08.330091 n-d-853682-5 devstack@n-api.service[104514]: [pid: 104514|app: 0|req: 3/4] 10.222.0.60 () {54 vars in 931 bytes} [Tue Oct 18 15:15:08 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:15:08.775497 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi [None req-c27f246e-4326-4efe-aae8-85ef9a88192f admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 256, "disk": 1, "swap": 0, "os-flavor-access:is_public": true, "name": "cirros256", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1"}} {{(pid=104515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:15:08.823726 n-d-853682-5 devstack@n-api.service[104515]: INFO nova.api.openstack.requestlog [None req-c27f246e-4326-4efe-aae8-85ef9a88192f admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.492013 Oct 18 15:15:08.824294 n-d-853682-5 devstack@n-api.service[104515]: [pid: 104515|app: 0|req: 2/5] 10.222.0.60 () {64 vars in 1283 bytes} [Tue Oct 18 15:15:08 2022] POST /compute/v2.1/flavors => generated 407 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:15:08.838182 n-d-853682-5 devstack@n-api.service[104514]: DEBUG dbcounter [-] [104514] Writing DB stats nova_api:SELECT=3 {{(pid=104514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:15:08.839396 n-d-853682-5 devstack@n-api.service[104514]: DEBUG dbcounter [-] [104514] Writing DB stats nova_cell0:SELECT=3 {{(pid=104514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:15:08.840115 n-d-853682-5 devstack@n-api.service[104514]: DEBUG dbcounter [-] [104514] Writing DB stats nova_cell1:SELECT=3 {{(pid=104514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:15:08.841274 n-d-853682-5 devstack@n-api.service[104514]: DEBUG dbcounter [-] [104514] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:15:09.048470 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi [None req-0ee63531-aabb-4e4f-84e4-1abb79147146 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:15:09.118225 n-d-853682-5 devstack@n-api.service[104514]: INFO nova.api.openstack.requestlog [None req-0ee63531-aabb-4e4f-84e4-1abb79147146 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.285167 Oct 18 15:15:09.118805 n-d-853682-5 devstack@n-api.service[104514]: [pid: 104514|app: 0|req: 4/6] 10.222.0.60 () {64 vars in 1336 bytes} [Tue Oct 18 15:15:08 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:15:11.998226 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi [None req-c27f246e-4326-4efe-aae8-85ef9a88192f admin admin] Calling method '>' {{(pid=104515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:15:11.999163 n-d-853682-5 devstack@n-api.service[104515]: INFO nova.api.openstack.requestlog [None req-c27f246e-4326-4efe-aae8-85ef9a88192f admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Oct 18 15:15:11.999556 n-d-853682-5 devstack@n-api.service[104515]: [pid: 104515|app: 0|req: 3/7] 10.222.0.60 () {54 vars in 931 bytes} [Tue Oct 18 15:15:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:15:12.806891 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi [None req-5f5d70fa-402e-4df3-ba7c-3b5c0bddd702 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "rxtx_factor": 1.0, "disk": 5, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "ram": 512, "id": "d1"}} {{(pid=104514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:15:12.865815 n-d-853682-5 devstack@n-api.service[104514]: INFO nova.api.openstack.requestlog [None req-5f5d70fa-402e-4df3-ba7c-3b5c0bddd702 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.859278 Oct 18 15:15:12.866918 n-d-853682-5 devstack@n-api.service[104514]: [pid: 104514|app: 0|req: 5/8] 10.222.0.60 () {64 vars in 1283 bytes} [Tue Oct 18 15:15:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:15:12.885590 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi [None req-455aa2c6-7352-4ce0-9708-1b4918066de5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:15:12.940469 n-d-853682-5 devstack@n-api.service[104515]: INFO nova.api.openstack.requestlog [None req-455aa2c6-7352-4ce0-9708-1b4918066de5 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.064566 Oct 18 15:15:12.941931 n-d-853682-5 devstack@n-api.service[104515]: [pid: 104515|app: 0|req: 4/9] 10.222.0.60 () {64 vars in 1336 bytes} [Tue Oct 18 15:15:12 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:15:15.852979 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi [None req-5f5d70fa-402e-4df3-ba7c-3b5c0bddd702 admin admin] Calling method '>' {{(pid=104514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:15:15.855367 n-d-853682-5 devstack@n-api.service[104514]: INFO nova.api.openstack.requestlog [None req-5f5d70fa-402e-4df3-ba7c-3b5c0bddd702 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002550 Oct 18 15:15:15.867500 n-d-853682-5 devstack@n-api.service[104514]: [pid: 104514|app: 0|req: 6/10] 10.222.0.60 () {54 vars in 931 bytes} [Tue Oct 18 15:15:15 2022] GET /compute/v2.1 => generated 388 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:15:16.459389 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi [None req-a1fbfb82-5f3a-414f-9c16-56fde01ddd2d admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "ram": 1024, "name": "ds1G", "swap": 0, "id": "d2", "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:15:16.479340 n-d-853682-5 devstack@n-api.service[104515]: INFO nova.api.openstack.requestlog [None req-a1fbfb82-5f3a-414f-9c16-56fde01ddd2d admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.615412 Oct 18 15:15:16.481370 n-d-853682-5 devstack@n-api.service[104515]: [pid: 104515|app: 0|req: 5/11] 10.222.0.60 () {64 vars in 1283 bytes} [Tue Oct 18 15:15:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:15:16.492354 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi [None req-05b86d18-8451-4db9-bdfe-4efff26f172f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:15:16.520326 n-d-853682-5 devstack@n-api.service[104514]: INFO nova.api.openstack.requestlog [None req-05b86d18-8451-4db9-bdfe-4efff26f172f admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031555 Oct 18 15:15:16.521231 n-d-853682-5 devstack@n-api.service[104514]: [pid: 104514|app: 0|req: 7/12] 10.222.0.60 () {64 vars in 1336 bytes} [Tue Oct 18 15:15:16 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:15:19.157955 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi [None req-a1fbfb82-5f3a-414f-9c16-56fde01ddd2d admin admin] Calling method '>' {{(pid=104515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:15:19.158989 n-d-853682-5 devstack@n-api.service[104515]: INFO nova.api.openstack.requestlog [None req-a1fbfb82-5f3a-414f-9c16-56fde01ddd2d admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Oct 18 15:15:19.159402 n-d-853682-5 devstack@n-api.service[104515]: [pid: 104515|app: 0|req: 6/13] 10.222.0.60 () {54 vars in 931 bytes} [Tue Oct 18 15:15:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:15:19.624120 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi [None req-95c984f3-4455-4bc3-ab30-49652639488f admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "name": "ds2G", "rxtx_factor": 1.0, "disk": 10, "id": "d3", "vcpus": 2, "ram": 2048}} {{(pid=104514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:15:19.647779 n-d-853682-5 devstack@n-api.service[104514]: INFO nova.api.openstack.requestlog [None req-95c984f3-4455-4bc3-ab30-49652639488f admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.481614 Oct 18 15:15:19.656560 n-d-853682-5 devstack@n-api.service[104514]: [pid: 104514|app: 0|req: 8/14] 10.222.0.60 () {64 vars in 1283 bytes} [Tue Oct 18 15:15:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:15:19.662002 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi [None req-3972c875-c806-498b-86fc-00ebef6b9f65 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:15:19.698618 n-d-853682-5 devstack@n-api.service[104515]: INFO nova.api.openstack.requestlog [None req-3972c875-c806-498b-86fc-00ebef6b9f65 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040871 Oct 18 15:15:19.699222 n-d-853682-5 devstack@n-api.service[104515]: [pid: 104515|app: 0|req: 7/15] 10.222.0.60 () {64 vars in 1336 bytes} [Tue Oct 18 15:15:19 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:15:22.571550 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi [None req-95c984f3-4455-4bc3-ab30-49652639488f admin admin] Calling method '>' {{(pid=104514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:15:22.573174 n-d-853682-5 devstack@n-api.service[104514]: INFO nova.api.openstack.requestlog [None req-95c984f3-4455-4bc3-ab30-49652639488f admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002092 Oct 18 15:15:22.578962 n-d-853682-5 devstack@n-api.service[104514]: [pid: 104514|app: 0|req: 9/16] 10.222.0.60 () {54 vars in 931 bytes} [Tue Oct 18 15:15:22 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:15:23.072316 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi [None req-69ceafba-97f1-4776-b84c-3e8a7a6ba0a8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds4G", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "disk": 20, "id": "d4", "vcpus": 4}} {{(pid=104515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:15:23.098841 n-d-853682-5 devstack@n-api.service[104515]: INFO nova.api.openstack.requestlog [None req-69ceafba-97f1-4776-b84c-3e8a7a6ba0a8 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.518684 Oct 18 15:15:23.100069 n-d-853682-5 devstack@n-api.service[104515]: [pid: 104515|app: 0|req: 8/17] 10.222.0.60 () {64 vars in 1283 bytes} [Tue Oct 18 15:15:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 15:15:23.112587 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi [None req-b1e4d36a-20fb-49df-9a40-a3e1f1cb8043 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:15:23.142082 n-d-853682-5 devstack@n-api.service[104514]: INFO nova.api.openstack.requestlog [None req-b1e4d36a-20fb-49df-9a40-a3e1f1cb8043 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033407 Oct 18 15:15:23.144303 n-d-853682-5 devstack@n-api.service[104514]: [pid: 104514|app: 0|req: 10/18] 10.222.0.60 () {64 vars in 1336 bytes} [Tue Oct 18 15:15:23 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:15:25.834361 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi [None req-69ceafba-97f1-4776-b84c-3e8a7a6ba0a8 admin admin] Calling method '>' {{(pid=104515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:15:25.835418 n-d-853682-5 devstack@n-api.service[104515]: INFO nova.api.openstack.requestlog [None req-69ceafba-97f1-4776-b84c-3e8a7a6ba0a8 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Oct 18 15:15:25.835829 n-d-853682-5 devstack@n-api.service[104515]: [pid: 104515|app: 0|req: 9/19] 10.222.0.60 () {54 vars in 931 bytes} [Tue Oct 18 15:15:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:15:26.259113 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi [None req-3b968c86-10f0-48fa-a86a-c2c76495345c admin admin] Calling method '>' {{(pid=104514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:15:26.285993 n-d-853682-5 devstack@n-api.service[104514]: INFO nova.api.openstack.requestlog [None req-3b968c86-10f0-48fa-a86a-c2c76495345c admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.444025 Oct 18 15:15:26.286577 n-d-853682-5 devstack@n-api.service[104514]: [pid: 104514|app: 0|req: 11/20] 10.222.0.60 () {60 vars in 1292 bytes} [Tue Oct 18 15:15:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:15:29.051203 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi [None req-69ceafba-97f1-4776-b84c-3e8a7a6ba0a8 admin admin] Calling method '>' {{(pid=104515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:15:29.052432 n-d-853682-5 devstack@n-api.service[104515]: INFO nova.api.openstack.requestlog [None req-69ceafba-97f1-4776-b84c-3e8a7a6ba0a8 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001851 Oct 18 15:15:29.053312 n-d-853682-5 devstack@n-api.service[104515]: [pid: 104515|app: 0|req: 10/21] 10.222.0.60 () {54 vars in 931 bytes} [Tue Oct 18 15:15:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:15:29.486752 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi [None req-8f0cdd25-98c1-4360-add6-399a5578d542 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 512, "swap": 0, "id": "1", "rxtx_factor": 1.0, "name": "m1.tiny", "vcpus": 1, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:15:29.506926 n-d-853682-5 devstack@n-api.service[104514]: INFO nova.api.openstack.requestlog [None req-8f0cdd25-98c1-4360-add6-399a5578d542 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.447427 Oct 18 15:15:29.507475 n-d-853682-5 devstack@n-api.service[104514]: [pid: 104514|app: 0|req: 12/22] 10.222.0.60 () {64 vars in 1283 bytes} [Tue Oct 18 15:15:29 2022] POST /compute/v2.1/flavors => generated 402 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:15:29.521696 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi [None req-9a46e71d-1acc-4776-a4df-10b81f8ecf78 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:15:29.552265 n-d-853682-5 devstack@n-api.service[104515]: INFO nova.api.openstack.requestlog [None req-9a46e71d-1acc-4776-a4df-10b81f8ecf78 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035422 Oct 18 15:15:29.552983 n-d-853682-5 devstack@n-api.service[104515]: [pid: 104515|app: 0|req: 11/23] 10.222.0.60 () {64 vars in 1333 bytes} [Tue Oct 18 15:15:29 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:15:32.334283 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi [None req-8f0cdd25-98c1-4360-add6-399a5578d542 admin admin] Calling method '>' {{(pid=104514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:15:32.335325 n-d-853682-5 devstack@n-api.service[104514]: INFO nova.api.openstack.requestlog [None req-8f0cdd25-98c1-4360-add6-399a5578d542 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Oct 18 15:15:32.335730 n-d-853682-5 devstack@n-api.service[104514]: [pid: 104514|app: 0|req: 13/24] 10.222.0.60 () {54 vars in 931 bytes} [Tue Oct 18 15:15:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:15:32.743158 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi [None req-b752914d-342e-45da-80ca-592c294958fe admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.small", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 20, "id": "2", "ram": 2048, "os-flavor-access:is_public": true}} {{(pid=104515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:15:32.763681 n-d-853682-5 devstack@n-api.service[104515]: INFO nova.api.openstack.requestlog [None req-b752914d-342e-45da-80ca-592c294958fe admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.421848 Oct 18 15:15:32.764574 n-d-853682-5 devstack@n-api.service[104515]: [pid: 104515|app: 0|req: 12/25] 10.222.0.60 () {64 vars in 1283 bytes} [Tue Oct 18 15:15:32 2022] POST /compute/v2.1/flavors => generated 405 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:15:32.776687 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi [None req-f37c5f37-ed8f-4acf-a215-cbd5b14f87ff admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:15:32.800102 n-d-853682-5 devstack@n-api.service[104514]: INFO nova.api.openstack.requestlog [None req-f37c5f37-ed8f-4acf-a215-cbd5b14f87ff admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027075 Oct 18 15:15:32.800655 n-d-853682-5 devstack@n-api.service[104514]: [pid: 104514|app: 0|req: 14/26] 10.222.0.60 () {64 vars in 1333 bytes} [Tue Oct 18 15:15:32 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:15:35.416815 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi [None req-b752914d-342e-45da-80ca-592c294958fe admin admin] Calling method '>' {{(pid=104515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:15:35.418281 n-d-853682-5 devstack@n-api.service[104515]: INFO nova.api.openstack.requestlog [None req-b752914d-342e-45da-80ca-592c294958fe admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001799 Oct 18 15:15:35.418776 n-d-853682-5 devstack@n-api.service[104515]: [pid: 104515|app: 0|req: 13/27] 10.222.0.60 () {54 vars in 931 bytes} [Tue Oct 18 15:15:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:15:35.802161 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi [None req-ee955b89-2bfe-409f-a986-52b9ae4cbe27 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "id": "3", "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "rxtx_factor": 1.0, "vcpus": 2, "ram": 4096}} {{(pid=104514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:15:35.824647 n-d-853682-5 devstack@n-api.service[104514]: INFO nova.api.openstack.requestlog [None req-ee955b89-2bfe-409f-a986-52b9ae4cbe27 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.398580 Oct 18 15:15:35.825238 n-d-853682-5 devstack@n-api.service[104514]: [pid: 104514|app: 0|req: 15/28] 10.222.0.60 () {64 vars in 1283 bytes} [Tue Oct 18 15:15:35 2022] POST /compute/v2.1/flavors => generated 406 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:15:35.837743 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi [None req-218eb44f-a224-4148-a343-f3d89703a1f2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:15:35.842466 n-d-853682-5 devstack@n-api.service[104515]: DEBUG dbcounter [-] [104515] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=104515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:15:35.866641 n-d-853682-5 devstack@n-api.service[104515]: INFO nova.api.openstack.requestlog [None req-218eb44f-a224-4148-a343-f3d89703a1f2 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032533 Oct 18 15:15:35.867221 n-d-853682-5 devstack@n-api.service[104515]: [pid: 104515|app: 0|req: 14/29] 10.222.0.60 () {64 vars in 1333 bytes} [Tue Oct 18 15:15:35 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:15:38.493039 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi [None req-ee955b89-2bfe-409f-a986-52b9ae4cbe27 admin admin] Calling method '>' {{(pid=104514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:15:38.494758 n-d-853682-5 devstack@n-api.service[104514]: INFO nova.api.openstack.requestlog [None req-ee955b89-2bfe-409f-a986-52b9ae4cbe27 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002176 Oct 18 15:15:38.495268 n-d-853682-5 devstack@n-api.service[104514]: [pid: 104514|app: 0|req: 16/30] 10.222.0.60 () {54 vars in 931 bytes} [Tue Oct 18 15:15:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:15:38.949672 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi [None req-a056607c-90ac-4a8d-85eb-2e637a7bafd6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "swap": 0, "disk": 80, "os-flavor-access:is_public": true, "vcpus": 4, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.large"}} {{(pid=104515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:15:38.970307 n-d-853682-5 devstack@n-api.service[104515]: INFO nova.api.openstack.requestlog [None req-a056607c-90ac-4a8d-85eb-2e637a7bafd6 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.468482 Oct 18 15:15:38.971078 n-d-853682-5 devstack@n-api.service[104515]: [pid: 104515|app: 0|req: 15/31] 10.222.0.60 () {64 vars in 1283 bytes} [Tue Oct 18 15:15:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 15:15:38.983341 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi [None req-bf41ab4d-4017-40c5-b4e1-0c6fb7810160 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:15:39.008687 n-d-853682-5 devstack@n-api.service[104514]: INFO nova.api.openstack.requestlog [None req-bf41ab4d-4017-40c5-b4e1-0c6fb7810160 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029003 Oct 18 15:15:39.009377 n-d-853682-5 devstack@n-api.service[104514]: [pid: 104514|app: 0|req: 17/32] 10.222.0.60 () {64 vars in 1333 bytes} [Tue Oct 18 15:15:38 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:15:41.643528 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi [None req-a056607c-90ac-4a8d-85eb-2e637a7bafd6 admin admin] Calling method '>' {{(pid=104515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:15:41.644545 n-d-853682-5 devstack@n-api.service[104515]: INFO nova.api.openstack.requestlog [None req-a056607c-90ac-4a8d-85eb-2e637a7bafd6 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Oct 18 15:15:41.645174 n-d-853682-5 devstack@n-api.service[104515]: [pid: 104515|app: 0|req: 16/33] 10.222.0.60 () {54 vars in 931 bytes} [Tue Oct 18 15:15:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:15:42.142209 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi [None req-5c3e2dee-488d-427b-87c6-722c2e5bc8e8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 16384, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "id": "5", "swap": 0, "vcpus": 8}} {{(pid=104514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:15:42.151884 n-d-853682-5 devstack@n-api.service[104514]: DEBUG dbcounter [-] [104514] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=104514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:15:42.166879 n-d-853682-5 devstack@n-api.service[104514]: INFO nova.api.openstack.requestlog [None req-5c3e2dee-488d-427b-87c6-722c2e5bc8e8 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.511505 Oct 18 15:15:42.167727 n-d-853682-5 devstack@n-api.service[104514]: [pid: 104514|app: 0|req: 18/34] 10.222.0.60 () {64 vars in 1283 bytes} [Tue Oct 18 15:15:41 2022] POST /compute/v2.1/flavors => generated 408 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 15:15:42.179858 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi [None req-cd0a1ea8-ad4e-4b8c-9e0b-2bd20b39b8ed admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:15:42.207818 n-d-853682-5 devstack@n-api.service[104515]: INFO nova.api.openstack.requestlog [None req-cd0a1ea8-ad4e-4b8c-9e0b-2bd20b39b8ed admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031695 Oct 18 15:15:42.208530 n-d-853682-5 devstack@n-api.service[104515]: [pid: 104515|app: 0|req: 17/35] 10.222.0.60 () {64 vars in 1333 bytes} [Tue Oct 18 15:15:42 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:16:03.041924 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi [None req-5c3e2dee-488d-427b-87c6-722c2e5bc8e8 admin admin] Calling method '>' {{(pid=104514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:16:03.042992 n-d-853682-5 devstack@n-api.service[104514]: INFO nova.api.openstack.requestlog [None req-5c3e2dee-488d-427b-87c6-722c2e5bc8e8 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Oct 18 15:16:03.043394 n-d-853682-5 devstack@n-api.service[104514]: [pid: 104514|app: 0|req: 19/36] 10.222.0.60 () {54 vars in 931 bytes} [Tue Oct 18 15:16:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:16:03.053996 n-d-853682-5 devstack@n-api.service[104515]: DEBUG dbcounter [-] [104515] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=104515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:16:03.432257 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi [None req-0ec43a5e-8f98-481c-923c-eaaf1a6a2836 admin admin] Calling method '>' {{(pid=104515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:16:03.450171 n-d-853682-5 devstack@n-api.service[104515]: INFO nova.api.openstack.requestlog [None req-0ec43a5e-8f98-481c-923c-eaaf1a6a2836 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.400609 Oct 18 15:16:03.450716 n-d-853682-5 devstack@n-api.service[104515]: [pid: 104515|app: 0|req: 18/37] 10.222.0.60 () {60 vars in 1292 bytes} [Tue Oct 18 15:16:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:16:04.754309 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi [None req-5c3e2dee-488d-427b-87c6-722c2e5bc8e8 admin admin] Calling method '>' {{(pid=104514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:16:04.755316 n-d-853682-5 devstack@n-api.service[104514]: INFO nova.api.openstack.requestlog [None req-5c3e2dee-488d-427b-87c6-722c2e5bc8e8 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Oct 18 15:16:04.755707 n-d-853682-5 devstack@n-api.service[104514]: [pid: 104514|app: 0|req: 20/38] 10.222.0.60 () {56 vars in 1074 bytes} [Tue Oct 18 15:16:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:16:05.306571 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi [None req-aaa8304b-71b1-4e95-a579-807625895c07 admin admin] Calling method '>' {{(pid=104515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:16:05.311950 n-d-853682-5 devstack@n-api.service[104515]: INFO nova.api.openstack.wsgi [None req-aaa8304b-71b1-4e95-a579-807625895c07 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 18 15:16:05.315201 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi [None req-aaa8304b-71b1-4e95-a579-807625895c07 admin admin] Request method failure captured: Oct 18 15:16:05.315201 n-d-853682-5 devstack@n-api.service[104515]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 18 15:16:05.315201 n-d-853682-5 devstack@n-api.service[104515]: Accept: application/json Oct 18 15:16:05.315201 n-d-853682-5 devstack@n-api.service[104515]: Accept-Encoding: gzip, deflate Oct 18 15:16:05.315201 n-d-853682-5 devstack@n-api.service[104515]: Connection: keep-alive Oct 18 15:16:05.315201 n-d-853682-5 devstack@n-api.service[104515]: Content-Length: 0 Oct 18 15:16:05.315201 n-d-853682-5 devstack@n-api.service[104515]: Host: 10.222.0.60 Oct 18 15:16:05.315201 n-d-853682-5 devstack@n-api.service[104515]: Openstack-Api-Version: compute 2.92 Oct 18 15:16:05.315201 n-d-853682-5 devstack@n-api.service[104515]: Openstack-System-Scope: None Oct 18 15:16:05.315201 n-d-853682-5 devstack@n-api.service[104515]: User-Agent: python-novaclient Oct 18 15:16:05.315201 n-d-853682-5 devstack@n-api.service[104515]: X-Auth-Token: gAAAAABjTsM0T9bwijBr2YBqeuE090eNVrntRbr19PpcSrKmBbHT2LipwZ0KHDf9k8GPWXE4_QE7ks-LE2SXR1lYnCAdWw0atKMTsaKXCleFx6gxqJlAsnxW-Rfzb_KpQ-k7vvOST-DtHwQ1qbeYESv18iVLgasrBljW1xWvev2Wdw9HUwUGzqE Oct 18 15:16:05.315201 n-d-853682-5 devstack@n-api.service[104515]: X-Domain-Id: None Oct 18 15:16:05.315201 n-d-853682-5 devstack@n-api.service[104515]: X-Domain-Name: None Oct 18 15:16:05.315201 n-d-853682-5 devstack@n-api.service[104515]: X-Identity-Status: Confirmed Oct 18 15:16:05.315201 n-d-853682-5 devstack@n-api.service[104515]: X-Is-Admin-Project: True Oct 18 15:16:05.315201 n-d-853682-5 devstack@n-api.service[104515]: X-Openstack-Nova-Api-Version: 2.92 Oct 18 15:16:05.315201 n-d-853682-5 devstack@n-api.service[104515]: X-Project-Domain-Id: default Oct 18 15:16:05.315201 n-d-853682-5 devstack@n-api.service[104515]: X-Project-Domain-Name: Default Oct 18 15:16:05.315201 n-d-853682-5 devstack@n-api.service[104515]: X-Project-Id: 209fa4bba55843e387557dcc81729d81 Oct 18 15:16:05.315201 n-d-853682-5 devstack@n-api.service[104515]: X-Project-Name: admin Oct 18 15:16:05.315201 n-d-853682-5 devstack@n-api.service[104515]: X-Role: member,admin,reader Oct 18 15:16:05.315201 n-d-853682-5 devstack@n-api.service[104515]: X-Roles: member,admin,reader Oct 18 15:16:05.316909 n-d-853682-5 devstack@n-api.service[104515]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/209fa4bba55843e387557dcc81729d81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/209fa4bba55843e387557dcc81729d81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/209fa4bba55843e387557dcc81729d81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_209fa4bba55843e387557dcc81729d81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:16:05.316909 n-d-853682-5 devstack@n-api.service[104515]: X-Tenant: admin Oct 18 15:16:05.316909 n-d-853682-5 devstack@n-api.service[104515]: X-Tenant-Id: 209fa4bba55843e387557dcc81729d81 Oct 18 15:16:05.316909 n-d-853682-5 devstack@n-api.service[104515]: X-Tenant-Name: admin Oct 18 15:16:05.316909 n-d-853682-5 devstack@n-api.service[104515]: X-User: admin Oct 18 15:16:05.316909 n-d-853682-5 devstack@n-api.service[104515]: X-User-Domain-Id: default Oct 18 15:16:05.316909 n-d-853682-5 devstack@n-api.service[104515]: X-User-Domain-Name: Default Oct 18 15:16:05.316909 n-d-853682-5 devstack@n-api.service[104515]: X-User-Id: 8df0181545454ec9bc9bdd6e27804f0b Oct 18 15:16:05.316909 n-d-853682-5 devstack@n-api.service[104515]: X-User-Name: admin Oct 18 15:16:05.316909 n-d-853682-5 devstack@n-api.service[104515]: method: > Oct 18 15:16:05.316909 n-d-853682-5 devstack@n-api.service[104515]: exception: Flavor 42 could not be found. Oct 18 15:16:05.316909 n-d-853682-5 devstack@n-api.service[104515]: action_args: {'id': '42'} Oct 18 15:16:05.316909 n-d-853682-5 devstack@n-api.service[104515]: {{(pid=104515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:16:05.316909 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:16:05.317782 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 18 15:16:05.317782 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 18 15:16:05.317782 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 18 15:16:05.317782 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 18 15:16:05.317782 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 15:16:05.317782 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 15:16:05.317782 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 18 15:16:05.317782 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 18 15:16:05.317782 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 18 15:16:05.317782 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:16:05.317782 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 18 15:16:05.317782 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 18 15:16:05.317782 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 18 15:16:05.317782 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi Oct 18 15:16:05.317782 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:16:05.317782 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi Oct 18 15:16:05.317782 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:16:05.317782 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:16:05.317782 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:16:05.318950 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:16:05.318950 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:16:05.318950 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:16:05.318950 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:16:05.318950 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 18 15:16:05.318950 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:16:05.318950 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 18 15:16:05.318950 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi Oct 18 15:16:05.318950 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:16:05.318950 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi Oct 18 15:16:05.318950 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:16:05.318950 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:16:05.318950 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:16:05.318950 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:16:05.318950 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:16:05.318950 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 18 15:16:05.318950 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi Oct 18 15:16:05.318950 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi [None req-aaa8304b-71b1-4e95-a579-807625895c07 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:16:05.320092 n-d-853682-5 devstack@n-api.service[104515]: INFO nova.api.openstack.requestlog [None req-aaa8304b-71b1-4e95-a579-807625895c07 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.394026 Oct 18 15:16:05.320092 n-d-853682-5 devstack@n-api.service[104515]: [pid: 104515|app: 0|req: 19/39] 10.222.0.60 () {60 vars in 1190 bytes} [Tue Oct 18 15:16:04 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 18 15:16:05.327237 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi [None req-e89afb97-a160-458b-b8ea-9133b59d45c9 admin admin] Calling method '>' {{(pid=104514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:16:05.351900 n-d-853682-5 devstack@n-api.service[104514]: INFO nova.api.openstack.requestlog [None req-e89afb97-a160-458b-b8ea-9133b59d45c9 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.029071 Oct 18 15:16:05.352451 n-d-853682-5 devstack@n-api.service[104514]: [pid: 104514|app: 0|req: 21/40] 10.222.0.60 () {60 vars in 1210 bytes} [Tue Oct 18 15:16:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:16:05.369822 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi [None req-c85ea547-f117-49c9-a3ac-1bc4b8658f54 admin admin] Calling method '>' {{(pid=104515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:16:05.392709 n-d-853682-5 devstack@n-api.service[104515]: INFO nova.api.openstack.requestlog [None req-c85ea547-f117-49c9-a3ac-1bc4b8658f54 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027539 Oct 18 15:16:05.393279 n-d-853682-5 devstack@n-api.service[104515]: [pid: 104515|app: 0|req: 20/41] 10.222.0.60 () {60 vars in 1210 bytes} [Tue Oct 18 15:16:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:16:05.403002 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi [None req-0e4bd0ca-853b-4d68-bb57-f3e2c1ae254d admin admin] Calling method '>' {{(pid=104514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:16:05.408295 n-d-853682-5 devstack@n-api.service[104514]: INFO nova.api.openstack.wsgi [None req-0e4bd0ca-853b-4d68-bb57-f3e2c1ae254d admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 18 15:16:05.411570 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi [None req-0e4bd0ca-853b-4d68-bb57-f3e2c1ae254d admin admin] Request method failure captured: Oct 18 15:16:05.411570 n-d-853682-5 devstack@n-api.service[104514]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 18 15:16:05.411570 n-d-853682-5 devstack@n-api.service[104514]: Accept: application/json Oct 18 15:16:05.411570 n-d-853682-5 devstack@n-api.service[104514]: Accept-Encoding: gzip, deflate Oct 18 15:16:05.411570 n-d-853682-5 devstack@n-api.service[104514]: Connection: keep-alive Oct 18 15:16:05.411570 n-d-853682-5 devstack@n-api.service[104514]: Content-Length: 0 Oct 18 15:16:05.411570 n-d-853682-5 devstack@n-api.service[104514]: Host: 10.222.0.60 Oct 18 15:16:05.411570 n-d-853682-5 devstack@n-api.service[104514]: Openstack-Api-Version: compute 2.92 Oct 18 15:16:05.411570 n-d-853682-5 devstack@n-api.service[104514]: Openstack-System-Scope: None Oct 18 15:16:05.411570 n-d-853682-5 devstack@n-api.service[104514]: User-Agent: python-novaclient Oct 18 15:16:05.411570 n-d-853682-5 devstack@n-api.service[104514]: X-Auth-Token: gAAAAABjTsM0T9bwijBr2YBqeuE090eNVrntRbr19PpcSrKmBbHT2LipwZ0KHDf9k8GPWXE4_QE7ks-LE2SXR1lYnCAdWw0atKMTsaKXCleFx6gxqJlAsnxW-Rfzb_KpQ-k7vvOST-DtHwQ1qbeYESv18iVLgasrBljW1xWvev2Wdw9HUwUGzqE Oct 18 15:16:05.411570 n-d-853682-5 devstack@n-api.service[104514]: X-Domain-Id: None Oct 18 15:16:05.411570 n-d-853682-5 devstack@n-api.service[104514]: X-Domain-Name: None Oct 18 15:16:05.411570 n-d-853682-5 devstack@n-api.service[104514]: X-Identity-Status: Confirmed Oct 18 15:16:05.411570 n-d-853682-5 devstack@n-api.service[104514]: X-Is-Admin-Project: True Oct 18 15:16:05.411570 n-d-853682-5 devstack@n-api.service[104514]: X-Openstack-Nova-Api-Version: 2.92 Oct 18 15:16:05.411570 n-d-853682-5 devstack@n-api.service[104514]: X-Project-Domain-Id: default Oct 18 15:16:05.411570 n-d-853682-5 devstack@n-api.service[104514]: X-Project-Domain-Name: Default Oct 18 15:16:05.411570 n-d-853682-5 devstack@n-api.service[104514]: X-Project-Id: 209fa4bba55843e387557dcc81729d81 Oct 18 15:16:05.411570 n-d-853682-5 devstack@n-api.service[104514]: X-Project-Name: admin Oct 18 15:16:05.411570 n-d-853682-5 devstack@n-api.service[104514]: X-Role: member,admin,reader Oct 18 15:16:05.411570 n-d-853682-5 devstack@n-api.service[104514]: X-Roles: member,admin,reader Oct 18 15:16:05.413000 n-d-853682-5 devstack@n-api.service[104514]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/209fa4bba55843e387557dcc81729d81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/209fa4bba55843e387557dcc81729d81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/209fa4bba55843e387557dcc81729d81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_209fa4bba55843e387557dcc81729d81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:16:05.413000 n-d-853682-5 devstack@n-api.service[104514]: X-Tenant: admin Oct 18 15:16:05.413000 n-d-853682-5 devstack@n-api.service[104514]: X-Tenant-Id: 209fa4bba55843e387557dcc81729d81 Oct 18 15:16:05.413000 n-d-853682-5 devstack@n-api.service[104514]: X-Tenant-Name: admin Oct 18 15:16:05.413000 n-d-853682-5 devstack@n-api.service[104514]: X-User: admin Oct 18 15:16:05.413000 n-d-853682-5 devstack@n-api.service[104514]: X-User-Domain-Id: default Oct 18 15:16:05.413000 n-d-853682-5 devstack@n-api.service[104514]: X-User-Domain-Name: Default Oct 18 15:16:05.413000 n-d-853682-5 devstack@n-api.service[104514]: X-User-Id: 8df0181545454ec9bc9bdd6e27804f0b Oct 18 15:16:05.413000 n-d-853682-5 devstack@n-api.service[104514]: X-User-Name: admin Oct 18 15:16:05.413000 n-d-853682-5 devstack@n-api.service[104514]: method: > Oct 18 15:16:05.413000 n-d-853682-5 devstack@n-api.service[104514]: exception: Flavor 42 could not be found. Oct 18 15:16:05.413000 n-d-853682-5 devstack@n-api.service[104514]: action_args: {'id': '42'} Oct 18 15:16:05.413000 n-d-853682-5 devstack@n-api.service[104514]: {{(pid=104514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:16:05.413000 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:16:05.413841 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 18 15:16:05.413841 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 18 15:16:05.413841 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 18 15:16:05.413841 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 18 15:16:05.413841 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 15:16:05.413841 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 15:16:05.413841 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 18 15:16:05.413841 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 18 15:16:05.413841 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 18 15:16:05.413841 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:16:05.413841 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 18 15:16:05.413841 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 18 15:16:05.413841 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 18 15:16:05.413841 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi Oct 18 15:16:05.413841 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:16:05.413841 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi Oct 18 15:16:05.413841 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:16:05.413841 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:16:05.413841 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:16:05.415128 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:16:05.415128 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:16:05.415128 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:16:05.415128 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:16:05.415128 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 18 15:16:05.415128 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:16:05.415128 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 18 15:16:05.415128 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi Oct 18 15:16:05.415128 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:16:05.415128 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi Oct 18 15:16:05.415128 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:16:05.415128 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:16:05.415128 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:16:05.415128 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:16:05.415128 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:16:05.415128 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 18 15:16:05.415128 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi Oct 18 15:16:05.415128 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi [None req-0e4bd0ca-853b-4d68-bb57-f3e2c1ae254d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:16:05.416337 n-d-853682-5 devstack@n-api.service[104514]: INFO nova.api.openstack.requestlog [None req-0e4bd0ca-853b-4d68-bb57-f3e2c1ae254d admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013760 Oct 18 15:16:05.416337 n-d-853682-5 devstack@n-api.service[104514]: [pid: 104514|app: 0|req: 22/42] 10.222.0.60 () {60 vars in 1190 bytes} [Tue Oct 18 15:16:05 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 18 15:16:06.630253 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi [None req-c85ea547-f117-49c9-a3ac-1bc4b8658f54 admin admin] Calling method '>' {{(pid=104515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:16:06.631269 n-d-853682-5 devstack@n-api.service[104515]: INFO nova.api.openstack.requestlog [None req-c85ea547-f117-49c9-a3ac-1bc4b8658f54 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Oct 18 15:16:06.631691 n-d-853682-5 devstack@n-api.service[104515]: [pid: 104515|app: 0|req: 21/43] 10.222.0.60 () {56 vars in 1074 bytes} [Tue Oct 18 15:16:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:16:07.152192 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi [None req-bbe17f2b-8a84-428a-9a8d-0279cf604287 admin admin] Calling method '>' {{(pid=104514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:16:07.157776 n-d-853682-5 devstack@n-api.service[104514]: INFO nova.api.openstack.wsgi [None req-bbe17f2b-8a84-428a-9a8d-0279cf604287 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 18 15:16:07.159256 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi [None req-bbe17f2b-8a84-428a-9a8d-0279cf604287 admin admin] Request method failure captured: Oct 18 15:16:07.159256 n-d-853682-5 devstack@n-api.service[104514]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 18 15:16:07.159256 n-d-853682-5 devstack@n-api.service[104514]: Accept: application/json Oct 18 15:16:07.159256 n-d-853682-5 devstack@n-api.service[104514]: Accept-Encoding: gzip, deflate Oct 18 15:16:07.159256 n-d-853682-5 devstack@n-api.service[104514]: Connection: keep-alive Oct 18 15:16:07.159256 n-d-853682-5 devstack@n-api.service[104514]: Content-Length: 0 Oct 18 15:16:07.159256 n-d-853682-5 devstack@n-api.service[104514]: Host: 10.222.0.60 Oct 18 15:16:07.159256 n-d-853682-5 devstack@n-api.service[104514]: Openstack-Api-Version: compute 2.92 Oct 18 15:16:07.159256 n-d-853682-5 devstack@n-api.service[104514]: Openstack-System-Scope: None Oct 18 15:16:07.159256 n-d-853682-5 devstack@n-api.service[104514]: User-Agent: python-novaclient Oct 18 15:16:07.159256 n-d-853682-5 devstack@n-api.service[104514]: X-Auth-Token: gAAAAABjTsM2Xe7sURAI1lN-cuMhcah_AMUxJwSEC4FbEYiY6-1IG4TPT6MkWEwg5BX-3FTpOnzRxqVnd2_k5CdhRCCNA273bQFaUiMqHJns842o3yZlq8A5OoN0kkM6IxVoJfxmJ_WuNhhrFyMiVpMMstcym_uRvi3zXPPJbLd0_yzJWbybtbw Oct 18 15:16:07.159256 n-d-853682-5 devstack@n-api.service[104514]: X-Domain-Id: None Oct 18 15:16:07.159256 n-d-853682-5 devstack@n-api.service[104514]: X-Domain-Name: None Oct 18 15:16:07.159256 n-d-853682-5 devstack@n-api.service[104514]: X-Identity-Status: Confirmed Oct 18 15:16:07.159256 n-d-853682-5 devstack@n-api.service[104514]: X-Is-Admin-Project: True Oct 18 15:16:07.159256 n-d-853682-5 devstack@n-api.service[104514]: X-Openstack-Nova-Api-Version: 2.92 Oct 18 15:16:07.159256 n-d-853682-5 devstack@n-api.service[104514]: X-Project-Domain-Id: default Oct 18 15:16:07.159256 n-d-853682-5 devstack@n-api.service[104514]: X-Project-Domain-Name: Default Oct 18 15:16:07.159256 n-d-853682-5 devstack@n-api.service[104514]: X-Project-Id: 209fa4bba55843e387557dcc81729d81 Oct 18 15:16:07.159256 n-d-853682-5 devstack@n-api.service[104514]: X-Project-Name: admin Oct 18 15:16:07.159256 n-d-853682-5 devstack@n-api.service[104514]: X-Role: member,admin,reader Oct 18 15:16:07.159256 n-d-853682-5 devstack@n-api.service[104514]: X-Roles: member,admin,reader Oct 18 15:16:07.160996 n-d-853682-5 devstack@n-api.service[104514]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/209fa4bba55843e387557dcc81729d81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/209fa4bba55843e387557dcc81729d81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/209fa4bba55843e387557dcc81729d81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_209fa4bba55843e387557dcc81729d81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:16:07.160996 n-d-853682-5 devstack@n-api.service[104514]: X-Tenant: admin Oct 18 15:16:07.160996 n-d-853682-5 devstack@n-api.service[104514]: X-Tenant-Id: 209fa4bba55843e387557dcc81729d81 Oct 18 15:16:07.160996 n-d-853682-5 devstack@n-api.service[104514]: X-Tenant-Name: admin Oct 18 15:16:07.160996 n-d-853682-5 devstack@n-api.service[104514]: X-User: admin Oct 18 15:16:07.160996 n-d-853682-5 devstack@n-api.service[104514]: X-User-Domain-Id: default Oct 18 15:16:07.160996 n-d-853682-5 devstack@n-api.service[104514]: X-User-Domain-Name: Default Oct 18 15:16:07.160996 n-d-853682-5 devstack@n-api.service[104514]: X-User-Id: 8df0181545454ec9bc9bdd6e27804f0b Oct 18 15:16:07.160996 n-d-853682-5 devstack@n-api.service[104514]: X-User-Name: admin Oct 18 15:16:07.160996 n-d-853682-5 devstack@n-api.service[104514]: method: > Oct 18 15:16:07.160996 n-d-853682-5 devstack@n-api.service[104514]: exception: Flavor 84 could not be found. Oct 18 15:16:07.160996 n-d-853682-5 devstack@n-api.service[104514]: action_args: {'id': '84'} Oct 18 15:16:07.160996 n-d-853682-5 devstack@n-api.service[104514]: {{(pid=104514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:16:07.160996 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:16:07.162021 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 18 15:16:07.162021 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 18 15:16:07.162021 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 18 15:16:07.162021 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 18 15:16:07.162021 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 15:16:07.162021 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 15:16:07.162021 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 18 15:16:07.162021 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 18 15:16:07.162021 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 18 15:16:07.162021 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:16:07.162021 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 18 15:16:07.162021 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 18 15:16:07.162021 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 18 15:16:07.162021 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi Oct 18 15:16:07.162021 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:16:07.162021 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi Oct 18 15:16:07.162021 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:16:07.162021 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:16:07.162021 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:16:07.163349 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:16:07.163349 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:16:07.163349 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:16:07.163349 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:16:07.163349 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 18 15:16:07.163349 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:16:07.163349 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 18 15:16:07.163349 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi Oct 18 15:16:07.163349 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:16:07.163349 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi Oct 18 15:16:07.163349 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:16:07.163349 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:16:07.163349 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:16:07.163349 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:16:07.163349 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:16:07.163349 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 18 15:16:07.163349 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi Oct 18 15:16:07.163349 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi [None req-bbe17f2b-8a84-428a-9a8d-0279cf604287 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:16:07.164609 n-d-853682-5 devstack@n-api.service[104514]: INFO nova.api.openstack.requestlog [None req-bbe17f2b-8a84-428a-9a8d-0279cf604287 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.391629 Oct 18 15:16:07.164609 n-d-853682-5 devstack@n-api.service[104514]: [pid: 104514|app: 0|req: 23/44] 10.222.0.60 () {60 vars in 1190 bytes} [Tue Oct 18 15:16:06 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 18 15:16:07.171093 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi [None req-4f66971b-3b0e-4666-b39d-cbc7bb93d21b admin admin] Calling method '>' {{(pid=104515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:16:07.186827 n-d-853682-5 devstack@n-api.service[104515]: INFO nova.api.openstack.requestlog [None req-4f66971b-3b0e-4666-b39d-cbc7bb93d21b admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019971 Oct 18 15:16:07.187363 n-d-853682-5 devstack@n-api.service[104515]: [pid: 104515|app: 0|req: 22/45] 10.222.0.60 () {60 vars in 1210 bytes} [Tue Oct 18 15:16:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:16:07.196786 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi [None req-cfa74c81-0035-44fc-9a57-e34b56a99679 admin admin] Calling method '>' {{(pid=104514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:16:07.212562 n-d-853682-5 devstack@n-api.service[104514]: INFO nova.api.openstack.requestlog [None req-cfa74c81-0035-44fc-9a57-e34b56a99679 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019325 Oct 18 15:16:07.213111 n-d-853682-5 devstack@n-api.service[104514]: [pid: 104514|app: 0|req: 24/46] 10.222.0.60 () {60 vars in 1210 bytes} [Tue Oct 18 15:16:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:16:07.222941 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi [None req-c843b432-e0f4-4fc7-8aa8-9d8a4b1b809c admin admin] Calling method '>' {{(pid=104515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:16:07.227877 n-d-853682-5 devstack@n-api.service[104515]: INFO nova.api.openstack.wsgi [None req-c843b432-e0f4-4fc7-8aa8-9d8a4b1b809c admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 18 15:16:07.229409 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi [None req-c843b432-e0f4-4fc7-8aa8-9d8a4b1b809c admin admin] Request method failure captured: Oct 18 15:16:07.229409 n-d-853682-5 devstack@n-api.service[104515]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 18 15:16:07.229409 n-d-853682-5 devstack@n-api.service[104515]: Accept: application/json Oct 18 15:16:07.229409 n-d-853682-5 devstack@n-api.service[104515]: Accept-Encoding: gzip, deflate Oct 18 15:16:07.229409 n-d-853682-5 devstack@n-api.service[104515]: Connection: keep-alive Oct 18 15:16:07.229409 n-d-853682-5 devstack@n-api.service[104515]: Content-Length: 0 Oct 18 15:16:07.229409 n-d-853682-5 devstack@n-api.service[104515]: Host: 10.222.0.60 Oct 18 15:16:07.229409 n-d-853682-5 devstack@n-api.service[104515]: Openstack-Api-Version: compute 2.92 Oct 18 15:16:07.229409 n-d-853682-5 devstack@n-api.service[104515]: Openstack-System-Scope: None Oct 18 15:16:07.229409 n-d-853682-5 devstack@n-api.service[104515]: User-Agent: python-novaclient Oct 18 15:16:07.229409 n-d-853682-5 devstack@n-api.service[104515]: X-Auth-Token: gAAAAABjTsM2Xe7sURAI1lN-cuMhcah_AMUxJwSEC4FbEYiY6-1IG4TPT6MkWEwg5BX-3FTpOnzRxqVnd2_k5CdhRCCNA273bQFaUiMqHJns842o3yZlq8A5OoN0kkM6IxVoJfxmJ_WuNhhrFyMiVpMMstcym_uRvi3zXPPJbLd0_yzJWbybtbw Oct 18 15:16:07.229409 n-d-853682-5 devstack@n-api.service[104515]: X-Domain-Id: None Oct 18 15:16:07.229409 n-d-853682-5 devstack@n-api.service[104515]: X-Domain-Name: None Oct 18 15:16:07.229409 n-d-853682-5 devstack@n-api.service[104515]: X-Identity-Status: Confirmed Oct 18 15:16:07.229409 n-d-853682-5 devstack@n-api.service[104515]: X-Is-Admin-Project: True Oct 18 15:16:07.229409 n-d-853682-5 devstack@n-api.service[104515]: X-Openstack-Nova-Api-Version: 2.92 Oct 18 15:16:07.229409 n-d-853682-5 devstack@n-api.service[104515]: X-Project-Domain-Id: default Oct 18 15:16:07.229409 n-d-853682-5 devstack@n-api.service[104515]: X-Project-Domain-Name: Default Oct 18 15:16:07.229409 n-d-853682-5 devstack@n-api.service[104515]: X-Project-Id: 209fa4bba55843e387557dcc81729d81 Oct 18 15:16:07.229409 n-d-853682-5 devstack@n-api.service[104515]: X-Project-Name: admin Oct 18 15:16:07.229409 n-d-853682-5 devstack@n-api.service[104515]: X-Role: member,admin,reader Oct 18 15:16:07.229409 n-d-853682-5 devstack@n-api.service[104515]: X-Roles: member,admin,reader Oct 18 15:16:07.230947 n-d-853682-5 devstack@n-api.service[104515]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/209fa4bba55843e387557dcc81729d81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/209fa4bba55843e387557dcc81729d81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/209fa4bba55843e387557dcc81729d81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_209fa4bba55843e387557dcc81729d81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:16:07.230947 n-d-853682-5 devstack@n-api.service[104515]: X-Tenant: admin Oct 18 15:16:07.230947 n-d-853682-5 devstack@n-api.service[104515]: X-Tenant-Id: 209fa4bba55843e387557dcc81729d81 Oct 18 15:16:07.230947 n-d-853682-5 devstack@n-api.service[104515]: X-Tenant-Name: admin Oct 18 15:16:07.230947 n-d-853682-5 devstack@n-api.service[104515]: X-User: admin Oct 18 15:16:07.230947 n-d-853682-5 devstack@n-api.service[104515]: X-User-Domain-Id: default Oct 18 15:16:07.230947 n-d-853682-5 devstack@n-api.service[104515]: X-User-Domain-Name: Default Oct 18 15:16:07.230947 n-d-853682-5 devstack@n-api.service[104515]: X-User-Id: 8df0181545454ec9bc9bdd6e27804f0b Oct 18 15:16:07.230947 n-d-853682-5 devstack@n-api.service[104515]: X-User-Name: admin Oct 18 15:16:07.230947 n-d-853682-5 devstack@n-api.service[104515]: method: > Oct 18 15:16:07.230947 n-d-853682-5 devstack@n-api.service[104515]: exception: Flavor 84 could not be found. Oct 18 15:16:07.230947 n-d-853682-5 devstack@n-api.service[104515]: action_args: {'id': '84'} Oct 18 15:16:07.230947 n-d-853682-5 devstack@n-api.service[104515]: {{(pid=104515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:16:07.230947 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:16:07.231786 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 18 15:16:07.231786 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 18 15:16:07.231786 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 18 15:16:07.231786 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 18 15:16:07.231786 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 15:16:07.231786 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 15:16:07.231786 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 18 15:16:07.231786 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 18 15:16:07.231786 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 18 15:16:07.231786 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:16:07.231786 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 18 15:16:07.231786 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 18 15:16:07.231786 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 18 15:16:07.231786 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi Oct 18 15:16:07.231786 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:16:07.231786 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi Oct 18 15:16:07.231786 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:16:07.231786 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:16:07.231786 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:16:07.232940 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:16:07.232940 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:16:07.232940 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:16:07.232940 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:16:07.232940 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 18 15:16:07.232940 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:16:07.232940 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 18 15:16:07.232940 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi Oct 18 15:16:07.232940 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:16:07.232940 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi Oct 18 15:16:07.232940 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:16:07.232940 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:16:07.232940 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:16:07.232940 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:16:07.232940 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:16:07.232940 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 18 15:16:07.232940 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi Oct 18 15:16:07.232940 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi [None req-c843b432-e0f4-4fc7-8aa8-9d8a4b1b809c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:16:07.234241 n-d-853682-5 devstack@n-api.service[104515]: INFO nova.api.openstack.requestlog [None req-c843b432-e0f4-4fc7-8aa8-9d8a4b1b809c admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011565 Oct 18 15:16:07.234241 n-d-853682-5 devstack@n-api.service[104515]: [pid: 104515|app: 0|req: 23/47] 10.222.0.60 () {60 vars in 1190 bytes} [Tue Oct 18 15:16:07 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 18 15:16:08.447191 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi [None req-cfa74c81-0035-44fc-9a57-e34b56a99679 admin admin] Calling method '>' {{(pid=104514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:16:08.448198 n-d-853682-5 devstack@n-api.service[104514]: INFO nova.api.openstack.requestlog [None req-cfa74c81-0035-44fc-9a57-e34b56a99679 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Oct 18 15:16:08.448590 n-d-853682-5 devstack@n-api.service[104514]: [pid: 104514|app: 0|req: 25/48] 10.222.0.60 () {56 vars in 1074 bytes} [Tue Oct 18 15:16:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:16:08.962618 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi [None req-62b4b2d3-491a-4fcf-a6e2-43b168cbf725 admin admin] Calling method '>' {{(pid=104515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:16:08.968493 n-d-853682-5 devstack@n-api.service[104515]: INFO nova.api.openstack.wsgi [None req-62b4b2d3-491a-4fcf-a6e2-43b168cbf725 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 18 15:16:08.970058 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi [None req-62b4b2d3-491a-4fcf-a6e2-43b168cbf725 admin admin] Request method failure captured: Oct 18 15:16:08.970058 n-d-853682-5 devstack@n-api.service[104515]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 18 15:16:08.970058 n-d-853682-5 devstack@n-api.service[104515]: Accept: application/json Oct 18 15:16:08.970058 n-d-853682-5 devstack@n-api.service[104515]: Accept-Encoding: gzip, deflate Oct 18 15:16:08.970058 n-d-853682-5 devstack@n-api.service[104515]: Connection: keep-alive Oct 18 15:16:08.970058 n-d-853682-5 devstack@n-api.service[104515]: Content-Length: 0 Oct 18 15:16:08.970058 n-d-853682-5 devstack@n-api.service[104515]: Host: 10.222.0.60 Oct 18 15:16:08.970058 n-d-853682-5 devstack@n-api.service[104515]: Openstack-Api-Version: compute 2.92 Oct 18 15:16:08.970058 n-d-853682-5 devstack@n-api.service[104515]: Openstack-System-Scope: None Oct 18 15:16:08.970058 n-d-853682-5 devstack@n-api.service[104515]: User-Agent: python-novaclient Oct 18 15:16:08.970058 n-d-853682-5 devstack@n-api.service[104515]: X-Auth-Token: gAAAAABjTsM4auCNcJ0PdcIzxH1h1OxmpldCaONZqLmlg1xYKV2IEE08bdX7rMie0AkHmhO6JvhPJMAiijk4VAPGwSmmrMHCa8xjmvY5Kk76eylNqBEkX8UlJh-vi0JHwrkPSeTBEsNxtnM-a0q0dCs7nNnXHrQs5Wegg75CM0tH0dqoy3YaQxs Oct 18 15:16:08.970058 n-d-853682-5 devstack@n-api.service[104515]: X-Domain-Id: None Oct 18 15:16:08.970058 n-d-853682-5 devstack@n-api.service[104515]: X-Domain-Name: None Oct 18 15:16:08.970058 n-d-853682-5 devstack@n-api.service[104515]: X-Identity-Status: Confirmed Oct 18 15:16:08.970058 n-d-853682-5 devstack@n-api.service[104515]: X-Is-Admin-Project: True Oct 18 15:16:08.970058 n-d-853682-5 devstack@n-api.service[104515]: X-Openstack-Nova-Api-Version: 2.92 Oct 18 15:16:08.970058 n-d-853682-5 devstack@n-api.service[104515]: X-Project-Domain-Id: default Oct 18 15:16:08.970058 n-d-853682-5 devstack@n-api.service[104515]: X-Project-Domain-Name: Default Oct 18 15:16:08.970058 n-d-853682-5 devstack@n-api.service[104515]: X-Project-Id: 209fa4bba55843e387557dcc81729d81 Oct 18 15:16:08.970058 n-d-853682-5 devstack@n-api.service[104515]: X-Project-Name: admin Oct 18 15:16:08.970058 n-d-853682-5 devstack@n-api.service[104515]: X-Role: member,admin,reader Oct 18 15:16:08.970058 n-d-853682-5 devstack@n-api.service[104515]: X-Roles: member,admin,reader Oct 18 15:16:08.971910 n-d-853682-5 devstack@n-api.service[104515]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/209fa4bba55843e387557dcc81729d81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/209fa4bba55843e387557dcc81729d81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/209fa4bba55843e387557dcc81729d81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_209fa4bba55843e387557dcc81729d81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:16:08.971910 n-d-853682-5 devstack@n-api.service[104515]: X-Tenant: admin Oct 18 15:16:08.971910 n-d-853682-5 devstack@n-api.service[104515]: X-Tenant-Id: 209fa4bba55843e387557dcc81729d81 Oct 18 15:16:08.971910 n-d-853682-5 devstack@n-api.service[104515]: X-Tenant-Name: admin Oct 18 15:16:08.971910 n-d-853682-5 devstack@n-api.service[104515]: X-User: admin Oct 18 15:16:08.971910 n-d-853682-5 devstack@n-api.service[104515]: X-User-Domain-Id: default Oct 18 15:16:08.971910 n-d-853682-5 devstack@n-api.service[104515]: X-User-Domain-Name: Default Oct 18 15:16:08.971910 n-d-853682-5 devstack@n-api.service[104515]: X-User-Id: 8df0181545454ec9bc9bdd6e27804f0b Oct 18 15:16:08.971910 n-d-853682-5 devstack@n-api.service[104515]: X-User-Name: admin Oct 18 15:16:08.971910 n-d-853682-5 devstack@n-api.service[104515]: method: > Oct 18 15:16:08.971910 n-d-853682-5 devstack@n-api.service[104515]: exception: Flavor 451 could not be found. Oct 18 15:16:08.971910 n-d-853682-5 devstack@n-api.service[104515]: action_args: {'id': '451'} Oct 18 15:16:08.971910 n-d-853682-5 devstack@n-api.service[104515]: {{(pid=104515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:16:08.971910 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:16:08.972740 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 18 15:16:08.972740 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 18 15:16:08.972740 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 18 15:16:08.972740 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 18 15:16:08.972740 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 15:16:08.972740 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 15:16:08.972740 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 18 15:16:08.972740 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 18 15:16:08.972740 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 18 15:16:08.972740 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:16:08.972740 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 18 15:16:08.972740 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 18 15:16:08.972740 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 18 15:16:08.972740 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi Oct 18 15:16:08.972740 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:16:08.972740 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi Oct 18 15:16:08.972740 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:16:08.972740 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:16:08.972740 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:16:08.974000 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:16:08.974000 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:16:08.974000 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:16:08.974000 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:16:08.974000 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 18 15:16:08.974000 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:16:08.974000 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 18 15:16:08.974000 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi Oct 18 15:16:08.974000 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:16:08.974000 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi Oct 18 15:16:08.974000 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:16:08.974000 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:16:08.974000 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:16:08.974000 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:16:08.974000 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:16:08.974000 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 18 15:16:08.974000 n-d-853682-5 devstack@n-api.service[104515]: ERROR nova.api.openstack.wsgi Oct 18 15:16:08.974000 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi [None req-62b4b2d3-491a-4fcf-a6e2-43b168cbf725 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:16:08.975248 n-d-853682-5 devstack@n-api.service[104515]: INFO nova.api.openstack.requestlog [None req-62b4b2d3-491a-4fcf-a6e2-43b168cbf725 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.388017 Oct 18 15:16:08.975248 n-d-853682-5 devstack@n-api.service[104515]: [pid: 104515|app: 0|req: 24/49] 10.222.0.60 () {60 vars in 1193 bytes} [Tue Oct 18 15:16:08 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 18 15:16:08.981599 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi [None req-9217a242-316a-4c04-9a47-8f7e04a1f626 admin admin] Calling method '>' {{(pid=104514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:16:08.996927 n-d-853682-5 devstack@n-api.service[104514]: INFO nova.api.openstack.requestlog [None req-9217a242-316a-4c04-9a47-8f7e04a1f626 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018871 Oct 18 15:16:08.997441 n-d-853682-5 devstack@n-api.service[104514]: [pid: 104514|app: 0|req: 26/50] 10.222.0.60 () {60 vars in 1210 bytes} [Tue Oct 18 15:16:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:16:09.007187 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi [None req-9ddc2e74-f6f0-4d5b-8dbe-1972579eb0cf admin admin] Calling method '>' {{(pid=104515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:16:09.021593 n-d-853682-5 devstack@n-api.service[104515]: INFO nova.api.openstack.requestlog [None req-9ddc2e74-f6f0-4d5b-8dbe-1972579eb0cf admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.017883 Oct 18 15:16:09.022105 n-d-853682-5 devstack@n-api.service[104515]: [pid: 104515|app: 0|req: 25/51] 10.222.0.60 () {60 vars in 1210 bytes} [Tue Oct 18 15:16:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:16:09.031003 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi [None req-6da768b2-fee7-42ab-b0d1-cbc1e18c54f3 admin admin] Calling method '>' {{(pid=104514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:16:09.035961 n-d-853682-5 devstack@n-api.service[104514]: INFO nova.api.openstack.wsgi [None req-6da768b2-fee7-42ab-b0d1-cbc1e18c54f3 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 18 15:16:09.037485 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi [None req-6da768b2-fee7-42ab-b0d1-cbc1e18c54f3 admin admin] Request method failure captured: Oct 18 15:16:09.037485 n-d-853682-5 devstack@n-api.service[104514]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 18 15:16:09.037485 n-d-853682-5 devstack@n-api.service[104514]: Accept: application/json Oct 18 15:16:09.037485 n-d-853682-5 devstack@n-api.service[104514]: Accept-Encoding: gzip, deflate Oct 18 15:16:09.037485 n-d-853682-5 devstack@n-api.service[104514]: Connection: keep-alive Oct 18 15:16:09.037485 n-d-853682-5 devstack@n-api.service[104514]: Content-Length: 0 Oct 18 15:16:09.037485 n-d-853682-5 devstack@n-api.service[104514]: Host: 10.222.0.60 Oct 18 15:16:09.037485 n-d-853682-5 devstack@n-api.service[104514]: Openstack-Api-Version: compute 2.92 Oct 18 15:16:09.037485 n-d-853682-5 devstack@n-api.service[104514]: Openstack-System-Scope: None Oct 18 15:16:09.037485 n-d-853682-5 devstack@n-api.service[104514]: User-Agent: python-novaclient Oct 18 15:16:09.037485 n-d-853682-5 devstack@n-api.service[104514]: X-Auth-Token: gAAAAABjTsM4auCNcJ0PdcIzxH1h1OxmpldCaONZqLmlg1xYKV2IEE08bdX7rMie0AkHmhO6JvhPJMAiijk4VAPGwSmmrMHCa8xjmvY5Kk76eylNqBEkX8UlJh-vi0JHwrkPSeTBEsNxtnM-a0q0dCs7nNnXHrQs5Wegg75CM0tH0dqoy3YaQxs Oct 18 15:16:09.037485 n-d-853682-5 devstack@n-api.service[104514]: X-Domain-Id: None Oct 18 15:16:09.037485 n-d-853682-5 devstack@n-api.service[104514]: X-Domain-Name: None Oct 18 15:16:09.037485 n-d-853682-5 devstack@n-api.service[104514]: X-Identity-Status: Confirmed Oct 18 15:16:09.037485 n-d-853682-5 devstack@n-api.service[104514]: X-Is-Admin-Project: True Oct 18 15:16:09.037485 n-d-853682-5 devstack@n-api.service[104514]: X-Openstack-Nova-Api-Version: 2.92 Oct 18 15:16:09.037485 n-d-853682-5 devstack@n-api.service[104514]: X-Project-Domain-Id: default Oct 18 15:16:09.037485 n-d-853682-5 devstack@n-api.service[104514]: X-Project-Domain-Name: Default Oct 18 15:16:09.037485 n-d-853682-5 devstack@n-api.service[104514]: X-Project-Id: 209fa4bba55843e387557dcc81729d81 Oct 18 15:16:09.037485 n-d-853682-5 devstack@n-api.service[104514]: X-Project-Name: admin Oct 18 15:16:09.037485 n-d-853682-5 devstack@n-api.service[104514]: X-Role: member,admin,reader Oct 18 15:16:09.037485 n-d-853682-5 devstack@n-api.service[104514]: X-Roles: member,admin,reader Oct 18 15:16:09.039054 n-d-853682-5 devstack@n-api.service[104514]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/209fa4bba55843e387557dcc81729d81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/209fa4bba55843e387557dcc81729d81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/209fa4bba55843e387557dcc81729d81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_209fa4bba55843e387557dcc81729d81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:16:09.039054 n-d-853682-5 devstack@n-api.service[104514]: X-Tenant: admin Oct 18 15:16:09.039054 n-d-853682-5 devstack@n-api.service[104514]: X-Tenant-Id: 209fa4bba55843e387557dcc81729d81 Oct 18 15:16:09.039054 n-d-853682-5 devstack@n-api.service[104514]: X-Tenant-Name: admin Oct 18 15:16:09.039054 n-d-853682-5 devstack@n-api.service[104514]: X-User: admin Oct 18 15:16:09.039054 n-d-853682-5 devstack@n-api.service[104514]: X-User-Domain-Id: default Oct 18 15:16:09.039054 n-d-853682-5 devstack@n-api.service[104514]: X-User-Domain-Name: Default Oct 18 15:16:09.039054 n-d-853682-5 devstack@n-api.service[104514]: X-User-Id: 8df0181545454ec9bc9bdd6e27804f0b Oct 18 15:16:09.039054 n-d-853682-5 devstack@n-api.service[104514]: X-User-Name: admin Oct 18 15:16:09.039054 n-d-853682-5 devstack@n-api.service[104514]: method: > Oct 18 15:16:09.039054 n-d-853682-5 devstack@n-api.service[104514]: exception: Flavor 451 could not be found. Oct 18 15:16:09.039054 n-d-853682-5 devstack@n-api.service[104514]: action_args: {'id': '451'} Oct 18 15:16:09.039054 n-d-853682-5 devstack@n-api.service[104514]: {{(pid=104514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:16:09.039054 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:16:09.039898 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 18 15:16:09.039898 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 18 15:16:09.039898 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 18 15:16:09.039898 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 18 15:16:09.039898 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 15:16:09.039898 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 15:16:09.039898 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 18 15:16:09.039898 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 18 15:16:09.039898 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 18 15:16:09.039898 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:16:09.039898 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 18 15:16:09.039898 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 18 15:16:09.039898 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 18 15:16:09.039898 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi Oct 18 15:16:09.039898 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:16:09.039898 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi Oct 18 15:16:09.039898 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:16:09.039898 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:16:09.039898 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:16:09.041180 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:16:09.041180 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:16:09.041180 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:16:09.041180 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:16:09.041180 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 18 15:16:09.041180 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:16:09.041180 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 18 15:16:09.041180 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi Oct 18 15:16:09.041180 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:16:09.041180 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi Oct 18 15:16:09.041180 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:16:09.041180 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:16:09.041180 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:16:09.041180 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:16:09.041180 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:16:09.041180 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 18 15:16:09.041180 n-d-853682-5 devstack@n-api.service[104514]: ERROR nova.api.openstack.wsgi Oct 18 15:16:09.041180 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi [None req-6da768b2-fee7-42ab-b0d1-cbc1e18c54f3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:16:09.042400 n-d-853682-5 devstack@n-api.service[104514]: INFO nova.api.openstack.requestlog [None req-6da768b2-fee7-42ab-b0d1-cbc1e18c54f3 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011363 Oct 18 15:16:09.042400 n-d-853682-5 devstack@n-api.service[104514]: [pid: 104514|app: 0|req: 27/52] 10.222.0.60 () {60 vars in 1193 bytes} [Tue Oct 18 15:16:09 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 18 15:16:10.253211 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi [None req-9ddc2e74-f6f0-4d5b-8dbe-1972579eb0cf admin admin] Calling method '>' {{(pid=104515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:16:10.254218 n-d-853682-5 devstack@n-api.service[104515]: INFO nova.api.openstack.requestlog [None req-9ddc2e74-f6f0-4d5b-8dbe-1972579eb0cf admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Oct 18 15:16:10.254607 n-d-853682-5 devstack@n-api.service[104515]: [pid: 104515|app: 0|req: 26/53] 10.222.0.60 () {56 vars in 1074 bytes} [Tue Oct 18 15:16:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:16:10.779652 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi [None req-e776b3c6-ff20-40c6-acf5-09b70985b8ab admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:16:10.799192 n-d-853682-5 devstack@n-api.service[104514]: INFO nova.api.openstack.requestlog [None req-e776b3c6-ff20-40c6-acf5-09b70985b8ab admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.406627 Oct 18 15:16:10.799722 n-d-853682-5 devstack@n-api.service[104514]: [pid: 104514|app: 0|req: 28/54] 10.222.0.60 () {64 vars in 1235 bytes} [Tue Oct 18 15:16:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:16:12.014403 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi [None req-9ddc2e74-f6f0-4d5b-8dbe-1972579eb0cf admin admin] Calling method '>' {{(pid=104515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:16:12.015443 n-d-853682-5 devstack@n-api.service[104515]: INFO nova.api.openstack.requestlog [None req-9ddc2e74-f6f0-4d5b-8dbe-1972579eb0cf admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Oct 18 15:16:12.015829 n-d-853682-5 devstack@n-api.service[104515]: [pid: 104515|app: 0|req: 27/55] 10.222.0.60 () {56 vars in 1074 bytes} [Tue Oct 18 15:16:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:16:12.529223 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi [None req-0c4d5976-2b61-439d-afb3-ee7dde7a57e6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:16:12.548188 n-d-853682-5 devstack@n-api.service[104514]: INFO nova.api.openstack.requestlog [None req-0c4d5976-2b61-439d-afb3-ee7dde7a57e6 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.395126 Oct 18 15:16:12.548737 n-d-853682-5 devstack@n-api.service[104514]: [pid: 104514|app: 0|req: 29/56] 10.222.0.60 () {64 vars in 1235 bytes} [Tue Oct 18 15:16:12 2022] POST /compute/v2.1/flavors => generated 405 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:16:13.763055 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi [None req-9ddc2e74-f6f0-4d5b-8dbe-1972579eb0cf admin admin] Calling method '>' {{(pid=104515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:16:13.764097 n-d-853682-5 devstack@n-api.service[104515]: INFO nova.api.openstack.requestlog [None req-9ddc2e74-f6f0-4d5b-8dbe-1972579eb0cf admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Oct 18 15:16:13.764484 n-d-853682-5 devstack@n-api.service[104515]: [pid: 104515|app: 0|req: 28/57] 10.222.0.60 () {56 vars in 1074 bytes} [Tue Oct 18 15:16:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:16:14.287613 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi [None req-cbc0bfb8-139c-4fce-ab7b-19f674a1e371 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:16:14.306520 n-d-853682-5 devstack@n-api.service[104514]: INFO nova.api.openstack.requestlog [None req-cbc0bfb8-139c-4fce-ab7b-19f674a1e371 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.407156 Oct 18 15:16:14.307141 n-d-853682-5 devstack@n-api.service[104514]: [pid: 104514|app: 0|req: 30/58] 10.222.0.60 () {64 vars in 1235 bytes} [Tue Oct 18 15:16:13 2022] POST /compute/v2.1/flavors => generated 407 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:16:15.516495 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi [None req-9ddc2e74-f6f0-4d5b-8dbe-1972579eb0cf admin admin] Calling method '>' {{(pid=104515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:16:15.517568 n-d-853682-5 devstack@n-api.service[104515]: INFO nova.api.openstack.requestlog [None req-9ddc2e74-f6f0-4d5b-8dbe-1972579eb0cf admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Oct 18 15:16:15.517996 n-d-853682-5 devstack@n-api.service[104515]: [pid: 104515|app: 0|req: 29/59] 10.222.0.60 () {56 vars in 1074 bytes} [Tue Oct 18 15:16:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:16:16.041459 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi [None req-d9d78a27-ab21-40ac-b938-ead136d3375d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:16:16.059716 n-d-853682-5 devstack@n-api.service[104514]: INFO nova.api.openstack.requestlog [None req-d9d78a27-ab21-40ac-b938-ead136d3375d admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.402964 Oct 18 15:16:16.060696 n-d-853682-5 devstack@n-api.service[104514]: [pid: 104514|app: 0|req: 31/60] 10.222.0.60 () {64 vars in 1235 bytes} [Tue Oct 18 15:16:15 2022] POST /compute/v2.1/flavors => generated 409 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:16:17.270809 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi [None req-9ddc2e74-f6f0-4d5b-8dbe-1972579eb0cf admin admin] Calling method '>' {{(pid=104515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:16:17.271818 n-d-853682-5 devstack@n-api.service[104515]: INFO nova.api.openstack.requestlog [None req-9ddc2e74-f6f0-4d5b-8dbe-1972579eb0cf admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Oct 18 15:16:17.272221 n-d-853682-5 devstack@n-api.service[104515]: [pid: 104515|app: 0|req: 30/61] 10.222.0.60 () {56 vars in 1074 bytes} [Tue Oct 18 15:16:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:16:17.794125 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi [None req-895eab96-47bb-4416-a1b0-0383a745cb9f admin admin] Calling method '>' {{(pid=104514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:16:17.814203 n-d-853682-5 devstack@n-api.service[104514]: INFO nova.api.openstack.requestlog [None req-895eab96-47bb-4416-a1b0-0383a745cb9f admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.406221 Oct 18 15:16:17.814756 n-d-853682-5 devstack@n-api.service[104514]: [pid: 104514|app: 0|req: 32/62] 10.222.0.60 () {60 vars in 1202 bytes} [Tue Oct 18 15:16:17 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:17:15.269174 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi [None req-9ddc2e74-f6f0-4d5b-8dbe-1972579eb0cf admin admin] Calling method '>' {{(pid=104515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:17:15.270120 n-d-853682-5 devstack@n-api.service[104515]: INFO nova.api.openstack.requestlog [None req-9ddc2e74-f6f0-4d5b-8dbe-1972579eb0cf admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Oct 18 15:17:15.270531 n-d-853682-5 devstack@n-api.service[104515]: [pid: 104515|app: 0|req: 31/63] 10.222.0.60 () {54 vars in 931 bytes} [Tue Oct 18 15:17:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:17:15.281055 n-d-853682-5 devstack@n-api.service[104514]: DEBUG dbcounter [-] [104514] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=104514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:17:15.666831 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi [None req-d994c3f1-e786-41a7-b34d-60c2b31fa7c9 admin admin] Calling method '>' {{(pid=104514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:17:15.688970 n-d-853682-5 devstack@n-api.service[104514]: INFO nova.api.openstack.requestlog [None req-d994c3f1-e786-41a7-b34d-60c2b31fa7c9 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.412261 Oct 18 15:17:15.689739 n-d-853682-5 devstack@n-api.service[104514]: [pid: 104514|app: 0|req: 33/64] 10.222.0.60 () {60 vars in 1292 bytes} [Tue Oct 18 15:17:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:17:15.711883 n-d-853682-5 devstack@n-api.service[104515]: DEBUG dbcounter [-] [104515] Writing DB stats nova_api:SELECT=14 {{(pid=104515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:17:15.715768 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi [None req-6e3d3e1c-b544-48ad-8e05-2e613cdf7257 admin admin] Calling method '>' {{(pid=104515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:17:15.724448 n-d-853682-5 devstack@n-api.service[104515]: INFO nova.api.openstack.requestlog [None req-6e3d3e1c-b544-48ad-8e05-2e613cdf7257 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014158 Oct 18 15:17:15.725104 n-d-853682-5 devstack@n-api.service[104515]: [pid: 104515|app: 0|req: 32/65] 10.222.0.60 () {60 vars in 1283 bytes} [Tue Oct 18 15:17:15 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:17:15.737810 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi [None req-e8c27a87-9161-4e17-af28-c663aac77b8d admin admin] Calling method '>' {{(pid=104514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:17:15.745420 n-d-853682-5 devstack@n-api.service[104514]: INFO nova.api.openstack.requestlog [None req-e8c27a87-9161-4e17-af28-c663aac77b8d admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011960 Oct 18 15:17:15.745953 n-d-853682-5 devstack@n-api.service[104514]: [pid: 104514|app: 0|req: 34/66] 10.222.0.60 () {60 vars in 1286 bytes} [Tue Oct 18 15:17:15 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:17:15.757768 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi [None req-cb7270e4-1f5d-4732-9082-a5d40394a2dd admin admin] Calling method '>' {{(pid=104515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:17:15.765682 n-d-853682-5 devstack@n-api.service[104515]: INFO nova.api.openstack.requestlog [None req-cb7270e4-1f5d-4732-9082-a5d40394a2dd admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011566 Oct 18 15:17:15.766218 n-d-853682-5 devstack@n-api.service[104515]: [pid: 104515|app: 0|req: 33/67] 10.222.0.60 () {60 vars in 1286 bytes} [Tue Oct 18 15:17:15 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:17:15.777803 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi [None req-39f80954-7dd6-4d13-bf6c-4e1ff7ca551b admin admin] Calling method '>' {{(pid=104514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:17:15.785658 n-d-853682-5 devstack@n-api.service[104514]: INFO nova.api.openstack.requestlog [None req-39f80954-7dd6-4d13-bf6c-4e1ff7ca551b admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011489 Oct 18 15:17:15.786170 n-d-853682-5 devstack@n-api.service[104514]: [pid: 104514|app: 0|req: 35/68] 10.222.0.60 () {60 vars in 1283 bytes} [Tue Oct 18 15:17:15 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:22:41.370943 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi [None req-cb7270e4-1f5d-4732-9082-a5d40394a2dd admin admin] Calling method '>' {{(pid=104515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:22:41.371982 n-d-853682-5 devstack@n-api.service[104515]: INFO nova.api.openstack.requestlog [None req-cb7270e4-1f5d-4732-9082-a5d40394a2dd admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Oct 18 15:22:41.372377 n-d-853682-5 devstack@n-api.service[104515]: [pid: 104515|app: 0|req: 34/69] 10.222.0.60 () {56 vars in 1074 bytes} [Tue Oct 18 15:22:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:22:41.514228 n-d-853682-5 devstack@n-api.service[104514]: DEBUG dbcounter [-] [104514] Writing DB stats nova_api:SELECT=6 {{(pid=104514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:22:41.657485 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi [None req-eb62f912-efc5-4d5a-84bd-d6b58c0734f6 admin admin] Calling method '>' {{(pid=104514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:22:41.662284 n-d-853682-5 devstack@n-api.service[104514]: DEBUG oslo_concurrency.lockutils [None req-eb62f912-efc5-4d5a-84bd-d6b58c0734f6 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:22:41.662750 n-d-853682-5 devstack@n-api.service[104514]: DEBUG oslo_concurrency.lockutils [None req-eb62f912-efc5-4d5a-84bd-d6b58c0734f6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:22:41.663167 n-d-853682-5 devstack@n-api.service[104514]: DEBUG oslo_concurrency.lockutils [None req-eb62f912-efc5-4d5a-84bd-d6b58c0734f6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:22:41.663869 n-d-853682-5 devstack@n-api.service[104514]: DEBUG oslo_concurrency.lockutils [None req-eb62f912-efc5-4d5a-84bd-d6b58c0734f6 admin admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:22:41.664309 n-d-853682-5 devstack@n-api.service[104514]: DEBUG oslo_concurrency.lockutils [None req-eb62f912-efc5-4d5a-84bd-d6b58c0734f6 admin admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:22:41.664725 n-d-853682-5 devstack@n-api.service[104514]: DEBUG oslo_concurrency.lockutils [None req-eb62f912-efc5-4d5a-84bd-d6b58c0734f6 admin admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:22:41.703939 n-d-853682-5 devstack@n-api.service[104514]: INFO nova.api.openstack.requestlog [None req-eb62f912-efc5-4d5a-84bd-d6b58c0734f6 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.191021 Oct 18 15:22:41.704501 n-d-853682-5 devstack@n-api.service[104514]: [pid: 104514|app: 0|req: 36/70] 10.222.0.60 () {60 vars in 1193 bytes} [Tue Oct 18 15:22:41 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:22:42.766840 n-d-853682-5 devstack@n-api.service[104515]: DEBUG nova.api.openstack.wsgi [None req-cb7270e4-1f5d-4732-9082-a5d40394a2dd admin admin] Calling method '>' {{(pid=104515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:22:42.767864 n-d-853682-5 devstack@n-api.service[104515]: INFO nova.api.openstack.requestlog [None req-cb7270e4-1f5d-4732-9082-a5d40394a2dd admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Oct 18 15:22:42.768275 n-d-853682-5 devstack@n-api.service[104515]: [pid: 104515|app: 0|req: 35/71] 10.222.0.60 () {56 vars in 1074 bytes} [Tue Oct 18 15:22:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:22:42.959594 n-d-853682-5 devstack@n-api.service[104514]: DEBUG nova.api.openstack.wsgi [None req-fc8db7d5-704e-4145-8336-00aa50b7f35a admin admin] Calling method '>' {{(pid=104514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:22:42.963026 n-d-853682-5 devstack@n-api.service[104514]: DEBUG oslo_concurrency.lockutils [None req-fc8db7d5-704e-4145-8336-00aa50b7f35a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:22:42.963500 n-d-853682-5 devstack@n-api.service[104514]: DEBUG oslo_concurrency.lockutils [None req-fc8db7d5-704e-4145-8336-00aa50b7f35a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:22:42.963927 n-d-853682-5 devstack@n-api.service[104514]: DEBUG oslo_concurrency.lockutils [None req-fc8db7d5-704e-4145-8336-00aa50b7f35a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:22:42.964668 n-d-853682-5 devstack@n-api.service[104514]: DEBUG oslo_concurrency.lockutils [None req-fc8db7d5-704e-4145-8336-00aa50b7f35a admin admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:22:42.965140 n-d-853682-5 devstack@n-api.service[104514]: DEBUG oslo_concurrency.lockutils [None req-fc8db7d5-704e-4145-8336-00aa50b7f35a admin admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:22:42.965550 n-d-853682-5 devstack@n-api.service[104514]: DEBUG oslo_concurrency.lockutils [None req-fc8db7d5-704e-4145-8336-00aa50b7f35a admin admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:22:42.988400 n-d-853682-5 devstack@n-api.service[104514]: INFO nova.api.openstack.requestlog [None req-fc8db7d5-704e-4145-8336-00aa50b7f35a admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.081168 Oct 18 15:22:42.988987 n-d-853682-5 devstack@n-api.service[104514]: [pid: 104514|app: 0|req: 37/72] 10.222.0.60 () {60 vars in 1193 bytes} [Tue Oct 18 15:22:42 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:23:28.047903 n-d-853682-5 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 18 15:23:28.048444 n-d-853682-5 devstack@n-api.service[104511]: Tue Oct 18 15:23:28 2022 - graceful shutdown triggered... Oct 18 15:23:28.048964 n-d-853682-5 devstack@n-api.service[104514]: Gracefully killing worker 1 (pid: 104514)... Oct 18 15:23:28.049342 n-d-853682-5 devstack@n-api.service[104515]: Gracefully killing worker 2 (pid: 104515)... Oct 18 15:23:28.180405 n-d-853682-5 devstack@n-api.service[104515]: DEBUG dbcounter [-] [104515] Writing DB stats nova_api:SELECT=4 {{(pid=104515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:23:29.049556 n-d-853682-5 devstack@n-api.service[104511]: worker 1 buried after 1 seconds Oct 18 15:23:29.049556 n-d-853682-5 devstack@n-api.service[104511]: worker 2 buried after 1 seconds Oct 18 15:23:29.050747 n-d-853682-5 devstack@n-api.service[104511]: goodbye to uWSGI. Oct 18 15:23:29.051683 n-d-853682-5 systemd[1]: devstack@n-api.service: Succeeded. Oct 18 15:23:29.052254 n-d-853682-5 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 18 15:23:29.055064 n-d-853682-5 systemd[1]: Starting Devstack devstack@n-api.service... Oct 18 15:23:29.066883 n-d-853682-5 devstack@n-api.service[120393]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 18 15:23:29.077780 n-d-853682-5 devstack@n-api.service[120393]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 18 15:23:29 2022] *** Oct 18 15:23:29.077780 n-d-853682-5 devstack@n-api.service[120393]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 18 15:23:29.077780 n-d-853682-5 devstack@n-api.service[120393]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 18 15:23:29.077780 n-d-853682-5 devstack@n-api.service[120393]: nodename: n-d-853682-5 Oct 18 15:23:29.077780 n-d-853682-5 devstack@n-api.service[120393]: machine: x86_64 Oct 18 15:23:29.077780 n-d-853682-5 devstack@n-api.service[120393]: clock source: unix Oct 18 15:23:29.077780 n-d-853682-5 devstack@n-api.service[120393]: pcre jit disabled Oct 18 15:23:29.077780 n-d-853682-5 devstack@n-api.service[120393]: detected number of CPU cores: 4 Oct 18 15:23:29.077780 n-d-853682-5 devstack@n-api.service[120393]: current working directory: / Oct 18 15:23:29.078633 n-d-853682-5 devstack@n-api.service[120393]: detected binary path: /usr/bin/uwsgi-core Oct 18 15:23:29.078633 n-d-853682-5 devstack@n-api.service[120393]: your processes number limit is 47680 Oct 18 15:23:29.078633 n-d-853682-5 devstack@n-api.service[120393]: your memory page size is 4096 bytes Oct 18 15:23:29.078633 n-d-853682-5 devstack@n-api.service[120393]: detected max file descriptor number: 2048 Oct 18 15:23:29.078633 n-d-853682-5 devstack@n-api.service[120393]: lock engine: pthread robust mutexes Oct 18 15:23:29.078633 n-d-853682-5 devstack@n-api.service[120393]: thunder lock: enabled Oct 18 15:23:29.078633 n-d-853682-5 devstack@n-api.service[120393]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 18 15:23:29.078633 n-d-853682-5 devstack@n-api.service[120393]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 18 15:23:29.119410 n-d-853682-5 devstack@n-api.service[120393]: Python main interpreter initialized at 0x559f0f3a19c0 Oct 18 15:23:29.119410 n-d-853682-5 devstack@n-api.service[120393]: python threads support enabled Oct 18 15:23:29.119410 n-d-853682-5 devstack@n-api.service[120393]: your server socket listen backlog is limited to 100 connections Oct 18 15:23:29.119410 n-d-853682-5 devstack@n-api.service[120393]: your mercy for graceful operations on workers is 90 seconds Oct 18 15:23:29.119856 n-d-853682-5 devstack@n-api.service[120393]: mapped 403077 bytes (393 KB) for 2 cores Oct 18 15:23:29.119856 n-d-853682-5 devstack@n-api.service[120393]: *** Operational MODE: preforking *** Oct 18 15:23:29.120114 n-d-853682-5 devstack@n-api.service[120393]: *** uWSGI is running in multiple interpreter mode *** Oct 18 15:23:29.120114 n-d-853682-5 devstack@n-api.service[120393]: spawned uWSGI master process (pid: 120393) Oct 18 15:23:29.120326 n-d-853682-5 systemd[1]: Started Devstack devstack@n-api.service. Oct 18 15:23:29.121029 n-d-853682-5 devstack@n-api.service[120393]: spawned uWSGI worker 1 (pid: 120405, cores: 1) Oct 18 15:23:29.121321 n-d-853682-5 devstack@n-api.service[120393]: spawned uWSGI worker 2 (pid: 120406, cores: 1) Oct 18 15:23:29.121586 n-d-853682-5 devstack@n-api.service[120393]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 18 15:23:29.788087 n-d-853682-5 devstack@n-api.service[120406]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 18 15:23:29.790251 n-d-853682-5 devstack@n-api.service[120405]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 18 15:23:30.948464 n-d-853682-5 devstack@n-api.service[120406]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 18 15:23:30.948464 n-d-853682-5 devstack@n-api.service[120406]: from cryptography.utils import int_from_bytes Oct 18 15:23:30.949065 n-d-853682-5 devstack@n-api.service[120406]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 18 15:23:30.949065 n-d-853682-5 devstack@n-api.service[120406]: from cryptography.utils import int_from_bytes Oct 18 15:23:30.955663 n-d-853682-5 devstack@n-api.service[120405]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 18 15:23:30.955663 n-d-853682-5 devstack@n-api.service[120405]: from cryptography.utils import int_from_bytes Oct 18 15:23:30.956169 n-d-853682-5 devstack@n-api.service[120405]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 18 15:23:30.956169 n-d-853682-5 devstack@n-api.service[120405]: from cryptography.utils import int_from_bytes Oct 18 15:23:33.344483 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 18 15:23:33.345129 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 18 15:23:33.345307 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 18 15:23:33.345672 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 18 15:23:33.345926 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 18 15:23:33.346318 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.346747 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.347069 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.347558 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.347889 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.348208 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.348536 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.348896 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.349218 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.349481 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.349799 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.350123 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-853682-5 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.350445 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.350754 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.351065 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.351386 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.351690 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.352011 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.352315 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.352870 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.353303 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.353616 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.353930 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.354265 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.354579 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.354886 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.355207 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.355512 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.355841 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.356149 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.356560 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-853682-5 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.356900 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.357219 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.357536 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.357973 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.358277 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.358590 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.358910 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.359232 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.359539 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.359867 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.360185 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.360503 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.360839 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.361147 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.361456 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.361765 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.362115 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.362421 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.362828 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.363081 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.363393 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.363717 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.364039 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.364363 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.364684 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.364883 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.365204 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.365525 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.365833 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.366144 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.366456 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.366765 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.367077 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.367380 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.367691 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.367998 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.368320 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.368637 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.368990 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.369302 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.369619 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.370022 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.370271 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.370579 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.370918 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.371236 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.371543 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.371861 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.372181 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.372488 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.372793 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.373124 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.373442 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.373790 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.374080 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.374328 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.374630 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.374937 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.375250 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.375558 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.375866 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.376169 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.376468 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.376773 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.377105 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.377413 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.378267 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.378571 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.378879 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.379180 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.379487 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.379792 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.380095 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.380411 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.380729 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.380915 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 18 15:23:33.381351 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.381448 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 18 15:23:33.381544 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.381638 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.381734 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 18 15:23:33.381944 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.382040 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 18 15:23:33.382260 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.382362 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 18 15:23:33.382568 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.382668 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.382872 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.382975 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.383191 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.383285 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.383496 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.383731 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.383825 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.384067 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.384167 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.384385 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.384485 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.384688 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.384787 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.385029 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.385127 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.385327 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.385426 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.385615 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.385717 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.385932 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.386028 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.386237 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.386341 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-853682-5 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.386539 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.386640 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.386856 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.386956 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.387128 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.387229 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.387429 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.387532 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.387730 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.387828 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.388030 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.388124 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.388382 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.388505 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.388630 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.388862 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.388988 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.389183 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.389284 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.389489 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.389597 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.389802 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.389902 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.390140 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.390247 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.390454 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.390557 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.390765 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.390864 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.391086 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.391192 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.391395 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.391487 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.391720 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.391818 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.392032 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.392135 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.392359 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.392455 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-853682-5 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.392676 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.392776 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.393015 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.393119 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.393904 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.394009 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.394206 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.394389 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.394518 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.394620 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.394827 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.394920 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.395137 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.395244 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.395455 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.395555 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.395774 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.395882 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.396103 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.396210 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.396419 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.396551 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.396732 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.397279 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.397695 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.397821 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.397961 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.398118 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.398205 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.398289 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.398289 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.398462 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.398545 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.398675 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.398769 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.398926 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.398926 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.399385 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.399477 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.399617 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.399758 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.399907 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.400112 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.400239 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.400342 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.400611 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.400786 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.400981 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.400981 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.401286 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.401454 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.401616 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.401712 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.401948 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.402028 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.402100 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.402185 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.402296 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.402420 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.402634 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.402870 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.403017 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.403167 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.403356 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.403508 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.403659 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.403873 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.404040 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.404119 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.404198 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.404354 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.404489 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.404629 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.404879 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.405032 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.405197 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.405338 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.405465 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.405702 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.405796 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.405909 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.406054 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.406054 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.406340 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.406340 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.406748 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.406885 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.407081 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.407081 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.407404 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.407532 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.407611 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.407884 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.408042 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.408235 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.408377 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.408506 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.408746 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.408840 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.408991 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.409075 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.409380 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.409504 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.409688 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.409829 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.410013 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.410143 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.410380 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.410518 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.410659 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.410838 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.411041 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.411147 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.411223 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.411640 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.411794 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.412021 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.412187 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.412321 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.412451 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.412680 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.412866 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.413101 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.413285 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.413569 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.413688 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.413848 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.414085 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.414361 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.414544 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.414687 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.414844 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.414844 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.415147 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.415147 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.415497 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.415626 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.415726 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.415960 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.416150 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.416150 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.416451 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.416548 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.416642 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.416728 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.416841 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.416841 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.417036 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.417122 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.417216 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.417350 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.417451 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.417451 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.417629 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.417721 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.417861 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.417962 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.418095 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.418191 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.418277 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.418370 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.418464 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.418558 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.418644 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.418729 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.418820 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.418905 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.419003 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.419095 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.419187 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.419281 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.419438 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.419648 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.419741 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.419741 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.419945 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.420046 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.420177 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.420280 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.420368 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.420540 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.420634 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.420864 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.420976 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.421170 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.421268 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.421471 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.421564 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.421772 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.421863 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.422079 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.422171 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.422377 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.422475 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.422679 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.422772 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.422979 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.423071 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.423286 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.423377 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.423589 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.423692 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.423908 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.424009 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.424231 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.424323 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.424578 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.424687 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.424923 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.425019 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.425241 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.425345 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.425558 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.425661 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:23:33.425868 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.425969 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.426181 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.426274 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.426493 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.426605 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.426805 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.426907 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.427126 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.427219 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.427436 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.427530 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.427756 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.427850 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.428064 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.428208 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.428390 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.428493 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.428700 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.428801 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.429046 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.429151 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.429584 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.429707 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.429707 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.429867 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.429955 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.430104 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.430282 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.430386 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.430608 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.430700 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.430925 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.431026 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.431234 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.431325 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.431548 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.431641 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.431859 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.431967 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.432170 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.432262 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.432480 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.432573 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.432791 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.432924 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.433132 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.433274 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.433442 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.433536 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.433760 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.433869 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.434070 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.434172 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.434390 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.434483 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.434698 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.434792 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.435015 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.435117 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.435316 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.435457 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.435626 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.435729 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.435952 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.436056 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.436276 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.436369 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.436581 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.436673 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.436915 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.437027 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.437235 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.437329 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.437542 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.437645 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.437849 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.437943 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.438159 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.438305 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.438462 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.438556 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.438766 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.438867 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.439072 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.439176 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.439369 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.439465 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.439679 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.439781 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.439986 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.440094 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.440822 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.440935 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.441143 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.441244 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.441451 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.441555 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.441755 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.441849 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.442058 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.442160 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.442370 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.442464 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.442689 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.442780 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.442998 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.443098 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.443306 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.443403 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.443619 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.443721 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.443919 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.444018 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.444221 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.444315 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.444541 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.444644 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.444871 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.444987 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.445214 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.445321 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.445521 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.445661 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.445852 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.446021 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.446170 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.446382 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.446476 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.446697 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.446792 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.447003 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.447106 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.447322 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.447424 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.447643 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.447744 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.447953 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.448047 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.448273 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.448408 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.448584 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.448676 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.448914 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.449009 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.449235 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.449328 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.449545 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.449647 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.449855 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.449958 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.450163 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.450265 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.450475 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.450578 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.450785 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.450888 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.451095 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.451196 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.451414 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.451520 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.451721 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.451842 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.452034 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.452143 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.452345 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.452454 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.452650 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.452743 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.452988 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.453084 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.453306 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.453400 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.453633 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.453883 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.453975 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.454219 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.454323 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.454539 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.454639 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.454843 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.454942 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.455151 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.455257 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.455458 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.455565 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.455793 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.456419 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.456619 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.456724 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.456952 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.457049 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.457262 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.457368 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.457569 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.457668 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.457877 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.457973 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.458184 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.458331 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.458496 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.458590 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.458801 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.458909 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.459103 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.459204 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.459407 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.459508 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.459716 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.459808 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.460019 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.460121 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.460320 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.460421 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.460619 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.460721 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.460946 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.461055 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.461260 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.461356 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.461563 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.461666 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.461874 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.461975 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.462175 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.462278 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.462494 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.462604 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.462800 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.462894 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.463101 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.463205 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.463403 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.463507 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.463705 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.463798 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.464043 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.464147 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.464345 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.464439 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.464678 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.464771 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.465025 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.465168 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.465352 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.465454 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.465660 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.465797 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.465965 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.466086 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.466287 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.466417 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.466601 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.466737 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.466890 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.467021 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.467193 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.467297 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.467502 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.467603 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.467812 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.467920 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.468373 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.468480 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.468685 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.468792 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.469023 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.469137 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.469331 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.469432 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.469639 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.469740 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.469941 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.470044 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.470249 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.470353 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.470550 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.470651 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.470864 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.470967 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.471258 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.471421 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.471609 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.471735 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.471919 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.472043 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.472237 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.472354 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.472569 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.472732 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.472932 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.473037 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.473247 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.473340 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.473566 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.473658 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.473879 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.473973 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.474185 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.474280 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.474491 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.474599 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.474794 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.474896 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.475102 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.475194 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.475409 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.475514 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.475714 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.475814 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.476031 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.476176 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.476340 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.476446 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.476644 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.476752 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.476973 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.477080 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.477282 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.477388 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.477584 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.477688 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.477885 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.478022 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.478190 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.478285 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.478517 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.478617 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.478834 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.478938 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.479139 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.479234 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.479448 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.479550 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.479752 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.479846 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.480058 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.480154 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.480360 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.480464 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.480666 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.480761 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.480996 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.481093 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.481299 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.481401 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.481600 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.481708 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.481900 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.481994 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.482201 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.482300 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.482522 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.482631 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.482828 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.482930 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.483133 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.483235 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.483437 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.483542 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.483740 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.483842 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.484059 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.484151 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.484369 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.484472 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.484680 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.484772 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.485032 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.485127 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.485348 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.485441 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.485660 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.485762 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.485970 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.486062 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.486284 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.486376 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.486596 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.486690 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.486901 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.487022 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.487256 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.487395 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.487573 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.487927 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.488033 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.488247 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.488410 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.488556 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.488896 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.489005 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.489230 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.489373 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.489815 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.489941 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.490153 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.490248 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.490471 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.490576 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.490793 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.490894 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.491223 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.491337 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.491487 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.491599 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.491793 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.491892 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.492104 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.492206 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.492417 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.492519 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.492727 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.492875 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.493066 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.493160 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.493377 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.493469 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.493685 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.493787 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.493997 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.494097 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.494306 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.494405 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.494615 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.494708 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.494924 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.495024 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.495230 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.495329 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.495535 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.495636 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.495841 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.495933 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.496146 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.496245 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.496455 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.496558 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.496762 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.496884 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.497094 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.497194 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.497401 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.497513 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.497707 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.497805 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.498016 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.498155 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.498324 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.498431 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.498630 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.498767 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.498939 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.499060 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.499252 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.499376 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.499596 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.499690 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.499906 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.499997 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.500248 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.500342 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.500580 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.500681 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.500920 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.501018 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.501229 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.501333 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.501538 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.501631 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.501865 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.501958 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.502172 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.502266 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.502480 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.502573 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.503317 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.503412 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.503633 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.503727 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.503945 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.504043 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.504249 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.504354 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.504561 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.504661 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.504888 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.504984 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.505196 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.505425 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.505604 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.505703 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.505799 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.505885 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.506098 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.506203 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.506404 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.506505 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.506722 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.506824 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.507037 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.507131 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.507350 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.507505 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.507742 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.507912 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.508065 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.508209 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.508346 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.508522 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.508647 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.508758 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.508990 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.509142 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.509302 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.509397 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.509624 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.509729 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.509932 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.510032 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.510240 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.510335 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.510547 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.510651 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.510859 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.510992 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.511172 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.511268 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.511474 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.511576 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.511798 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.511898 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.512112 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.512205 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.512419 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.512524 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.512726 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.512851 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.513061 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.513156 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.513366 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.513469 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.513722 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.513825 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.513985 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.514080 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.514309 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.514403 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.514629 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.514721 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.514936 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.515029 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.515248 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.515351 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.515553 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.515657 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.515862 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.515971 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.516166 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.516258 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.516477 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.516580 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.516784 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.516956 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.517111 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.517217 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.517416 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.517510 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.517719 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.517826 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.518024 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.518118 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.518885 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.519030 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.519199 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.519305 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.519512 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.519604 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.519821 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.519915 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.520130 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.520227 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.520451 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.520554 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.520760 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.520904 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.521109 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.521215 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.521420 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.521525 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.521727 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.521820 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.522033 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.522135 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.522338 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.522439 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.522673 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.522819 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.522979 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.523072 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.523304 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.523412 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.523631 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.523741 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.523961 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.524056 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.524276 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.524412 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.524586 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.524706 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.524919 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.525017 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.525248 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.525352 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.525557 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.525660 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.525870 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.525973 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.526193 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.526301 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.526498 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.526600 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.526802 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.526905 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.527112 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.527225 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.527418 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.527520 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.527723 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.527825 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.528026 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.528129 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.528338 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.528430 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.528637 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.528733 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.528973 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.529087 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.529277 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.529414 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.529594 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.529685 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.529895 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.529996 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.530213 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.530315 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.530518 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.530648 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.530821 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.530916 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.531125 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.531226 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.531427 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.531530 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.531751 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.531874 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.532060 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.532154 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.532366 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.532471 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.532679 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.532774 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.533013 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.533107 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.533327 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.533434 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.533641 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.533759 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.533978 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.534089 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.534298 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.534427 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.534614 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.534708 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.534930 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.535025 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.535246 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.535356 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.535554 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.535701 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.535872 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.535975 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.536187 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.536292 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.536503 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.536599 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.536947 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.537078 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.537269 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.537409 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.537587 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.537721 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.537905 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.538032 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.538214 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.538350 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.538522 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.538663 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.538921 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.539024 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.539327 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.539485 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.539578 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.539671 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.539861 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.539969 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.540167 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.540333 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.540520 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.540622 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.540847 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.541006 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.541175 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.541278 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.541509 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.541612 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.541828 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.542016 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.542143 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.542245 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.542456 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.542599 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.542770 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.542920 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.543125 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.543229 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.543440 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.543555 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.543747 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.543883 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.544062 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.544214 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.544377 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.544526 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.544691 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.544868 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.545031 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.545186 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.545344 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.545514 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.545658 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.545843 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.545971 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.546160 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.546285 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.546483 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.546578 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.546795 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.546896 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.547125 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.547219 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.547453 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.547556 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.547772 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.547866 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.548099 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.548212 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.548427 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.548529 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.548739 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.548916 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.549084 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.549194 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.549480 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.550130 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.550336 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.550451 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.550649 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.550755 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.550960 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.551081 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.551275 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.551405 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.551588 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.551724 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.551900 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.552030 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.552232 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.552440 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.552546 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.552749 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.552881 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.553085 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.553169 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.553398 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.553491 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.553710 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.553807 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.554018 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.554112 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.554341 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.554498 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.554652 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.554776 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.554943 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.555107 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.555263 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.555428 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.555572 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.555757 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.556087 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.556224 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.556401 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.556505 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.556730 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.556856 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.557071 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.557174 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.557385 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.557479 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.557697 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.557800 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.558009 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.558147 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.558336 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.558431 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.558645 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.558747 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.558958 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.559052 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.559273 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.559376 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.559586 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.559705 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.559888 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.559999 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.560191 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.560296 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.560503 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.560640 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.560889 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.561008 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.561140 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.561281 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.561451 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.561546 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.561755 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.561865 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.562084 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.562179 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.562389 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.562495 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.562692 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.562801 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.562996 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.563096 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.563307 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.563398 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.563608 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.563709 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.563911 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.564006 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.564215 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.564307 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.564513 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.564622 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.564833 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.564967 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.565222 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.565823 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.566019 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.566135 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.566323 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.566417 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.566635 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.566737 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.566942 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.567037 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.567253 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.567348 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.567562 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.567665 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.567882 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.567975 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.568185 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.568279 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.568488 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.568596 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.568825 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.568935 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.569137 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.569239 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.569460 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.569569 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.569775 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.569881 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.570084 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.570178 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.570428 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.570539 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.570746 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.570840 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.571097 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.571272 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.571424 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.571605 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.571722 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.571922 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.572046 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.572253 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.572437 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.572583 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.572685 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.572912 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.573219 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.573320 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.573520 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.573616 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.573841 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.573935 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.574151 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.574249 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.574459 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.574557 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.574767 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.574906 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.575073 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.575178 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.575378 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.575481 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.575684 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.575779 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.575990 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.576102 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.576296 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.576398 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.576601 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.576696 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.576930 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.577053 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.577238 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.577346 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.577544 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.577639 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.577849 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.577945 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.578154 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.578258 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.578465 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.578560 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.578805 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.578901 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.579121 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.579263 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.579436 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.579544 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.579749 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.579854 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.580063 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.580178 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.580370 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.580473 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.580677 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.580800 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.581046 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.581191 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.581354 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.581453 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.581670 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.581765 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.581986 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.582079 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.582294 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.582401 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.582598 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.582700 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.582914 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.583006 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.583235 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.583385 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.583566 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.583672 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.583904 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.583999 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.584216 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.584318 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.584535 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.584629 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.584875 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.585034 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.585187 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.585281 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.585509 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.585803 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.585932 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.586118 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.586253 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.586455 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.586552 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.586779 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.586879 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.587101 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.587197 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.587406 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.587500 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.587708 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.587802 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.588010 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.588113 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.588319 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.588473 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.588633 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.588738 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.588975 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.589071 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.589284 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.589426 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.589587 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.589725 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.589898 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.590022 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.590202 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.590300 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.590507 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.590613 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.590810 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.590913 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.591113 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.591215 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.591422 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.591699 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.591795 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.592048 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.592146 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.592349 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.592454 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.592651 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.592754 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.592983 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.593341 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.593544 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.593657 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.593854 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.593956 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.594159 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.594255 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.594463 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.594573 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.594765 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.594868 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.595068 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.595217 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.595370 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.595478 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.595698 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.595801 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.596030 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.596130 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.596344 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.596457 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.596680 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.596773 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.597012 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.597117 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.597328 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.597430 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.597635 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.597736 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.597953 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.598048 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.598259 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.598360 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.598569 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.598664 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.598876 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.598978 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.599193 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.599288 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.599500 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.599593 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.599805 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.599908 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.600114 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.600211 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.600422 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.600516 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.600732 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.600856 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.601062 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.601166 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.601387 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.601487 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.601714 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.601890 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.602018 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.602114 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.602339 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.602443 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.602655 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.602754 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.602974 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.603071 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.603287 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.603381 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.603598 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.603699 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.603908 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.604009 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.604218 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.604319 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.604528 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.604632 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.604865 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.604966 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.605166 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.605300 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.605476 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.605571 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.605792 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.605885 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.606100 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.606203 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.606407 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.606654 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.606747 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.606992 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.607085 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.607316 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.607410 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.607639 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.607731 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.607946 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.608049 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.608268 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.608372 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.608574 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.608666 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.608912 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.609028 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.609244 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.609340 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.609565 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.609659 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.609880 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.609988 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.610194 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.610339 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.610504 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.610605 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.610806 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.610915 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.611043 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 18 15:23:33.611138 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.611412 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.611723 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.612558 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.612893 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.613209 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.613521 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.613832 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.614143 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.614459 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.614800 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.615122 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.615444 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.615761 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.616079 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.616394 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.616710 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.617126 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.617442 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.617762 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.618091 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.618403 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.618712 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.619133 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.619450 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.619774 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.620107 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.620451 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.620742 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.621096 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.621414 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.621741 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.622053 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.622385 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.622726 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.623058 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.623386 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.623696 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.624005 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.624313 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.624627 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.624978 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.625296 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.625604 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.625912 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.626228 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.626537 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.626846 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.627155 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.627463 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.627830 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.628640 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.628977 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.629288 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.629594 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.629905 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.630215 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.630557 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.630831 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.631140 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.631447 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.631753 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.632060 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.632453 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.632873 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.633153 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.633482 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.633798 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.634122 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.634436 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.634762 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.635087 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.635407 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.635720 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.636056 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.636368 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.636683 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.637028 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.637341 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.637655 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.637968 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.638298 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.638626 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.638934 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.639258 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.639578 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.639906 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.640223 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.640538 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.640894 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.641217 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.641534 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.641848 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.642164 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.642476 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.642796 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.643107 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.643465 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.643790 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.644109 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.644437 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.644764 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.645101 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.645427 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.645769 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.646100 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.646419 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.646764 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.647100 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.647413 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.647729 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.648107 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:23:33.648361 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 18 15:23:33.672402 n-d-853682-5 devstack@n-api.service[120406]: INFO dbcounter [None req-6a0a7593-a92a-46dc-ba1e-7b338eebf6ba None None] Registered counter for database nova_api Oct 18 15:23:33.694787 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_db.sqlalchemy.engines [None req-6a0a7593-a92a-46dc-ba1e-7b338eebf6ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120406) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 15:23:33.701183 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writer thread running {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 15:23:33.710906 n-d-853682-5 devstack@n-api.service[120405]: INFO dbcounter [None req-3d342f84-b580-4576-9b6e-232c4b5940a9 None None] Registered counter for database nova_api Oct 18 15:23:33.734687 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_db.sqlalchemy.engines [None req-3d342f84-b580-4576-9b6e-232c4b5940a9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120405) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 15:23:33.742502 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writer thread running {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 15:23:33.761002 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.context [None req-6a0a7593-a92a-46dc-ba1e-7b338eebf6ba None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8ab54c98-adc3-429d-89a9-d68fdb0f782a(cell1) {{(pid=120406) load_cells /opt/stack/nova/nova/context.py:464}} Oct 18 15:23:33.765128 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a0a7593-a92a-46dc-ba1e-7b338eebf6ba None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:23:33.765548 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a0a7593-a92a-46dc-ba1e-7b338eebf6ba None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:23:33.767113 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a0a7593-a92a-46dc-ba1e-7b338eebf6ba None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:23:33.767832 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a0a7593-a92a-46dc-ba1e-7b338eebf6ba None None] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:23:33.768313 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a0a7593-a92a-46dc-ba1e-7b338eebf6ba None None] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:23:33.770313 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a0a7593-a92a-46dc-ba1e-7b338eebf6ba None None] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:23:33.772268 n-d-853682-5 devstack@n-api.service[120406]: INFO dbcounter [None req-6a0a7593-a92a-46dc-ba1e-7b338eebf6ba None None] Registered counter for database nova_cell0 Oct 18 15:23:33.776252 n-d-853682-5 devstack@n-api.service[120406]: INFO dbcounter [None req-6a0a7593-a92a-46dc-ba1e-7b338eebf6ba None None] Registered counter for database nova_cell1 Oct 18 15:23:33.784498 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_db.sqlalchemy.engines [None req-6a0a7593-a92a-46dc-ba1e-7b338eebf6ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120406) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 15:23:33.785897 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_db.sqlalchemy.engines [None req-6a0a7593-a92a-46dc-ba1e-7b338eebf6ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120406) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 15:23:33.790922 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writer thread running {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 15:23:33.796160 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writer thread running {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 15:23:33.798836 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.context [None req-3d342f84-b580-4576-9b6e-232c4b5940a9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8ab54c98-adc3-429d-89a9-d68fdb0f782a(cell1) {{(pid=120405) load_cells /opt/stack/nova/nova/context.py:464}} Oct 18 15:23:33.803457 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3d342f84-b580-4576-9b6e-232c4b5940a9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:23:33.803939 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3d342f84-b580-4576-9b6e-232c4b5940a9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:23:33.805575 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3d342f84-b580-4576-9b6e-232c4b5940a9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:23:33.806317 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3d342f84-b580-4576-9b6e-232c4b5940a9 None None] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:23:33.806771 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3d342f84-b580-4576-9b6e-232c4b5940a9 None None] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:23:33.808783 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3d342f84-b580-4576-9b6e-232c4b5940a9 None None] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:23:33.810782 n-d-853682-5 devstack@n-api.service[120405]: INFO dbcounter [None req-3d342f84-b580-4576-9b6e-232c4b5940a9 None None] Registered counter for database nova_cell0 Oct 18 15:23:33.815073 n-d-853682-5 devstack@n-api.service[120405]: INFO dbcounter [None req-3d342f84-b580-4576-9b6e-232c4b5940a9 None None] Registered counter for database nova_cell1 Oct 18 15:23:33.822711 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_db.sqlalchemy.engines [None req-3d342f84-b580-4576-9b6e-232c4b5940a9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120405) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 15:23:33.827825 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writer thread running {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 15:23:33.828513 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_db.sqlalchemy.engines [None req-3d342f84-b580-4576-9b6e-232c4b5940a9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120405) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 15:23:33.940116 n-d-853682-5 devstack@n-api.service[120406]: INFO dbcounter [None req-6a0a7593-a92a-46dc-ba1e-7b338eebf6ba None None] Registered counter for database nova_cell0 Oct 18 15:23:33.947295 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_db.sqlalchemy.engines [None req-6a0a7593-a92a-46dc-ba1e-7b338eebf6ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120406) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 15:23:33.951873 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writer thread running {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 15:23:33.976579 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writer thread running {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 15:23:33.985397 n-d-853682-5 devstack@n-api.service[120405]: INFO dbcounter [None req-3d342f84-b580-4576-9b6e-232c4b5940a9 None None] Registered counter for database nova_cell0 Oct 18 15:23:33.993500 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_db.sqlalchemy.engines [None req-3d342f84-b580-4576-9b6e-232c4b5940a9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120405) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 15:23:33.998155 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writer thread running {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 15:23:34.268473 n-d-853682-5 devstack@n-api.service[120406]: WARNING keystonemiddleware.auth_token [None req-6a0a7593-a92a-46dc-ba1e-7b338eebf6ba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 18 15:23:34.275848 n-d-853682-5 devstack@n-api.service[120406]: WARNING keystonemiddleware.auth_token [None req-6a0a7593-a92a-46dc-ba1e-7b338eebf6ba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 18 15:23:34.327665 n-d-853682-5 devstack@n-api.service[120405]: WARNING keystonemiddleware.auth_token [None req-3d342f84-b580-4576-9b6e-232c4b5940a9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 18 15:23:34.335632 n-d-853682-5 devstack@n-api.service[120405]: WARNING keystonemiddleware.auth_token [None req-3d342f84-b580-4576-9b6e-232c4b5940a9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 18 15:23:34.620162 n-d-853682-5 devstack@n-api.service[120406]: WARNING keystonemiddleware.auth_token [None req-6a0a7593-a92a-46dc-ba1e-7b338eebf6ba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 18 15:23:34.626173 n-d-853682-5 devstack@n-api.service[120406]: WARNING keystonemiddleware.auth_token [None req-6a0a7593-a92a-46dc-ba1e-7b338eebf6ba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 18 15:23:34.632011 n-d-853682-5 devstack@n-api.service[120406]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559f0f3a19c0 pid: 120406 (default app) Oct 18 15:23:34.684544 n-d-853682-5 devstack@n-api.service[120405]: WARNING keystonemiddleware.auth_token [None req-3d342f84-b580-4576-9b6e-232c4b5940a9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 18 15:23:34.690735 n-d-853682-5 devstack@n-api.service[120405]: WARNING keystonemiddleware.auth_token [None req-3d342f84-b580-4576-9b6e-232c4b5940a9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 18 15:23:34.696036 n-d-853682-5 devstack@n-api.service[120405]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559f0f3a19c0 pid: 120405 (default app) Oct 18 15:24:14.768912 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:24:14.770529 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:24:14.773011 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:24:14.774032 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:24:16.289890 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-87cfeef7-d8bc-4aae-9af6-6563cb27ce71 tempest-AZAdminV2TestJSON-626912466 tempest-AZAdminV2TestJSON-626912466-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:16.293026 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87cfeef7-d8bc-4aae-9af6-6563cb27ce71 tempest-AZAdminV2TestJSON-626912466 tempest-AZAdminV2TestJSON-626912466-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:16.293704 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87cfeef7-d8bc-4aae-9af6-6563cb27ce71 tempest-AZAdminV2TestJSON-626912466 tempest-AZAdminV2TestJSON-626912466-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:16.294355 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87cfeef7-d8bc-4aae-9af6-6563cb27ce71 tempest-AZAdminV2TestJSON-626912466 tempest-AZAdminV2TestJSON-626912466-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:16.295274 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87cfeef7-d8bc-4aae-9af6-6563cb27ce71 tempest-AZAdminV2TestJSON-626912466 tempest-AZAdminV2TestJSON-626912466-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:16.295911 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87cfeef7-d8bc-4aae-9af6-6563cb27ce71 tempest-AZAdminV2TestJSON-626912466 tempest-AZAdminV2TestJSON-626912466-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:16.296662 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87cfeef7-d8bc-4aae-9af6-6563cb27ce71 tempest-AZAdminV2TestJSON-626912466 tempest-AZAdminV2TestJSON-626912466-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:16.366780 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-87cfeef7-d8bc-4aae-9af6-6563cb27ce71 tempest-AZAdminV2TestJSON-626912466 tempest-AZAdminV2TestJSON-626912466-project-admin] 10.222.0.60 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 1.618457 Oct 18 15:24:16.371513 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1/1] 10.222.0.60 () {58 vars in 1164 bytes} [Tue Oct 18 15:24:14 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 1622 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:24:16.812058 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d3149972-f7e2-41a9-91dc-efa5dd96d80b tempest-AZAdminV2TestJSON-626912466 tempest-AZAdminV2TestJSON-626912466-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:16.818398 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d3149972-f7e2-41a9-91dc-efa5dd96d80b tempest-AZAdminV2TestJSON-626912466 tempest-AZAdminV2TestJSON-626912466-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:16.820496 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d3149972-f7e2-41a9-91dc-efa5dd96d80b tempest-AZAdminV2TestJSON-626912466 tempest-AZAdminV2TestJSON-626912466-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:16.821090 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d3149972-f7e2-41a9-91dc-efa5dd96d80b tempest-AZAdminV2TestJSON-626912466 tempest-AZAdminV2TestJSON-626912466-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:16.821994 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d3149972-f7e2-41a9-91dc-efa5dd96d80b tempest-AZAdminV2TestJSON-626912466 tempest-AZAdminV2TestJSON-626912466-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:16.826250 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d3149972-f7e2-41a9-91dc-efa5dd96d80b tempest-AZAdminV2TestJSON-626912466 tempest-AZAdminV2TestJSON-626912466-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:16.826975 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d3149972-f7e2-41a9-91dc-efa5dd96d80b tempest-AZAdminV2TestJSON-626912466 tempest-AZAdminV2TestJSON-626912466-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:16.827672 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=3 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:24:16.828975 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=3 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:24:16.862974 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=3 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:24:16.862974 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=3 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:24:16.974337 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d3149972-f7e2-41a9-91dc-efa5dd96d80b tempest-AZAdminV2TestJSON-626912466 tempest-AZAdminV2TestJSON-626912466-project-admin] 10.222.0.60 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.596726 Oct 18 15:24:16.975119 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1/2] 10.222.0.60 () {58 vars in 1185 bytes} [Tue Oct 18 15:24:16 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:24:17.284873 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-62414e48-5274-40bd-8e4a-142b36cdb9c0 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Calling method '.version_select at 0x7f7c3ed25550>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:17.301448 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-62414e48-5274-40bd-8e4a-142b36cdb9c0 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8ab54c98-adc3-429d-89a9-d68fdb0f782a(cell1) {{(pid=120406) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 18 15:24:17.302380 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62414e48-5274-40bd-8e4a-142b36cdb9c0 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:17.304244 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62414e48-5274-40bd-8e4a-142b36cdb9c0 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:17.304689 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62414e48-5274-40bd-8e4a-142b36cdb9c0 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:17.379040 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62414e48-5274-40bd-8e4a-142b36cdb9c0 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:17.380298 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62414e48-5274-40bd-8e4a-142b36cdb9c0 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:17.382159 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62414e48-5274-40bd-8e4a-142b36cdb9c0 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:17.417610 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62414e48-5274-40bd-8e4a-142b36cdb9c0 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:17.420182 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62414e48-5274-40bd-8e4a-142b36cdb9c0 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:17.420665 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62414e48-5274-40bd-8e4a-142b36cdb9c0 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:17.436588 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-62414e48-5274-40bd-8e4a-142b36cdb9c0 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.833029 Oct 18 15:24:17.440532 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2/3] 10.222.0.60 () {58 vars in 1167 bytes} [Tue Oct 18 15:24:16 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:17.946016 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9fff6ed3-c5db-411c-b5cc-5ded5362b046 tempest-FlavorsV255TestJSON-1009340931 tempest-FlavorsV255TestJSON-1009340931-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1764633622", "id": 227039185, "os-flavor-access:is_public": "True"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:24:18.016663 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9fff6ed3-c5db-411c-b5cc-5ded5362b046 tempest-FlavorsV255TestJSON-1009340931 tempest-FlavorsV255TestJSON-1009340931-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 446 microversion: 2.55 time: 0.574926 Oct 18 15:24:18.018297 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3/4] 10.222.0.60 () {62 vars in 1188 bytes} [Tue Oct 18 15:24:17 2022] POST /compute/v2.1/flavors => generated 446 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:24:18.148342 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d3eb1164-6fa0-42bd-9b30-9a6b26ef312a tempest-AggregatesAdminTestV241-1233066459 tempest-AggregatesAdminTestV241-1233066459-project-admin] Calling method '.version_select at 0x7f7c3eebbee0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:18.176049 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d3eb1164-6fa0-42bd-9b30-9a6b26ef312a tempest-AggregatesAdminTestV241-1233066459 tempest-AggregatesAdminTestV241-1233066459-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8ab54c98-adc3-429d-89a9-d68fdb0f782a(cell1) {{(pid=120405) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 18 15:24:18.177004 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d3eb1164-6fa0-42bd-9b30-9a6b26ef312a tempest-AggregatesAdminTestV241-1233066459 tempest-AggregatesAdminTestV241-1233066459-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:18.177646 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d3eb1164-6fa0-42bd-9b30-9a6b26ef312a tempest-AggregatesAdminTestV241-1233066459 tempest-AggregatesAdminTestV241-1233066459-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:18.178718 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d3eb1164-6fa0-42bd-9b30-9a6b26ef312a tempest-AggregatesAdminTestV241-1233066459 tempest-AggregatesAdminTestV241-1233066459-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:18.226888 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d3eb1164-6fa0-42bd-9b30-9a6b26ef312a tempest-AggregatesAdminTestV241-1233066459 tempest-AggregatesAdminTestV241-1233066459-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:18.228229 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d3eb1164-6fa0-42bd-9b30-9a6b26ef312a tempest-AggregatesAdminTestV241-1233066459 tempest-AggregatesAdminTestV241-1233066459-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:18.228914 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d3eb1164-6fa0-42bd-9b30-9a6b26ef312a tempest-AggregatesAdminTestV241-1233066459 tempest-AggregatesAdminTestV241-1233066459-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:18.249739 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d3eb1164-6fa0-42bd-9b30-9a6b26ef312a tempest-AggregatesAdminTestV241-1233066459 tempest-AggregatesAdminTestV241-1233066459-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:18.253180 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d3eb1164-6fa0-42bd-9b30-9a6b26ef312a tempest-AggregatesAdminTestV241-1233066459 tempest-AggregatesAdminTestV241-1233066459-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:18.254281 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d3eb1164-6fa0-42bd-9b30-9a6b26ef312a tempest-AggregatesAdminTestV241-1233066459 tempest-AggregatesAdminTestV241-1233066459-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:18.263577 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d3eb1164-6fa0-42bd-9b30-9a6b26ef312a tempest-AggregatesAdminTestV241-1233066459 tempest-AggregatesAdminTestV241-1233066459-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 1.287193 Oct 18 15:24:18.264981 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2/5] 10.222.0.60 () {60 vars in 1208 bytes} [Tue Oct 18 15:24:16 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:24:18.270827 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f5bd9dbf-0a6d-4fd3-b354-7fea57e2b044 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1404653941", "name": "tempest-test_aggregate-1803996505"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:24:18.312237 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.aggregate [None req-f5bd9dbf-0a6d-4fd3-b354-7fea57e2b044 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Generated uuid c7a3fff2-a94d-496e-add7-cb9e340cdc26 for aggregate {{(pid=120405) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 15:24:18.447290 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f5bd9dbf-0a6d-4fd3-b354-7fea57e2b044 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.181247 Oct 18 15:24:18.447889 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3/6] 10.222.0.60 () {60 vars in 1165 bytes} [Tue Oct 18 15:24:18 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:24:18.599851 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7b82320e-f8fb-43bd-8233-140b1420c85b tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:18.607388 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b82320e-f8fb-43bd-8233-140b1420c85b tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:18.607938 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b82320e-f8fb-43bd-8233-140b1420c85b tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:18.608314 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b82320e-f8fb-43bd-8233-140b1420c85b tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:18.609085 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b82320e-f8fb-43bd-8233-140b1420c85b tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:18.609529 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b82320e-f8fb-43bd-8233-140b1420c85b tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:18.609939 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b82320e-f8fb-43bd-8233-140b1420c85b tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:18.672878 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7b82320e-f8fb-43bd-8233-140b1420c85b tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.652571 Oct 18 15:24:18.675691 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4/7] 10.222.0.60 () {58 vars in 1176 bytes} [Tue Oct 18 15:24:18 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:24:18.702008 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9a37510c-d454-49f1-819c-8fa3f1bb557f tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:18.722194 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9a37510c-d454-49f1-819c-8fa3f1bb557f tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates" status: 200 len: 303 microversion: 2.1 time: 0.041467 Oct 18 15:24:18.727758 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 5/8] 10.222.0.60 () {58 vars in 1143 bytes} [Tue Oct 18 15:24:18 2022] GET /compute/v2.1/os-aggregates => generated 303 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:24:18.740191 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3ddd1126-80ae-43d5-bece-b3920d9fb71a tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-853682-5"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:24:18.774385 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ddd1126-80ae-43d5-bece-b3920d9fb71a tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:18.775175 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ddd1126-80ae-43d5-bece-b3920d9fb71a tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:18.775783 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ddd1126-80ae-43d5-bece-b3920d9fb71a tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:18.975114 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-27f5a0da-9ad3-4391-a810-d1efa585490a tempest-FlavorsV255TestJSON-1566985915 tempest-FlavorsV255TestJSON-1566985915-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:19.031764 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-27f5a0da-9ad3-4391-a810-d1efa585490a tempest-FlavorsV255TestJSON-1566985915 tempest-FlavorsV255TestJSON-1566985915-project] 10.222.0.60 "GET /compute/v2.1/flavors/227039185" status: 200 len: 446 microversion: 2.55 time: 0.575421 Oct 18 15:24:19.034927 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 4/9] 10.222.0.60 () {60 vars in 1196 bytes} [Tue Oct 18 15:24:18 2022] GET /compute/v2.1/flavors/227039185 => generated 446 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:24:19.055284 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-51200e35-3de6-4922-9e6e-14c945344202 tempest-FlavorsV255TestJSON-1009340931 tempest-FlavorsV255TestJSON-1009340931-project-admin] Action: 'update', calling method: .version_select at 0x7f7c3f1c8b80>, body: {"flavor": {"description": "new"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:24:19.198386 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-51200e35-3de6-4922-9e6e-14c945344202 tempest-FlavorsV255TestJSON-1009340931 tempest-FlavorsV255TestJSON-1009340931-project-admin] 10.222.0.60 "PUT /compute/v2.1/flavors/227039185" status: 200 len: 447 microversion: 2.55 time: 0.150478 Oct 18 15:24:19.199901 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 5/10] 10.222.0.60 () {62 vars in 1216 bytes} [Tue Oct 18 15:24:19 2022] PUT /compute/v2.1/flavors/227039185 => generated 447 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:24:19.665155 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-19ce0116-77d8-4c90-b6ed-4fd2d00f82c0 tempest-FlavorsAccessNegativeTestJSON-573528365 tempest-FlavorsAccessNegativeTestJSON-573528365-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1048846541", "id": 118689124, "os-flavor-access:is_public": "False"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:24:19.715181 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-19ce0116-77d8-4c90-b6ed-4fd2d00f82c0 tempest-FlavorsAccessNegativeTestJSON-573528365 tempest-FlavorsAccessNegativeTestJSON-573528365-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.509105 Oct 18 15:24:19.727671 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 6/11] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:24:19 2022] POST /compute/v2.1/flavors => generated 436 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:24:19.740303 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c1d6726e-51c5-4b9c-9778-19bbde316347 tempest-FlavorsV255TestJSON-1566985915 tempest-FlavorsV255TestJSON-1566985915-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:19.823809 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c1d6726e-51c5-4b9c-9778-19bbde316347 tempest-FlavorsV255TestJSON-1566985915 tempest-FlavorsV255TestJSON-1566985915-project] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5722 microversion: 2.55 time: 0.092772 Oct 18 15:24:19.826848 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 7/12] 10.222.0.60 () {60 vars in 1187 bytes} [Tue Oct 18 15:24:19 2022] GET /compute/v2.1/flavors/detail => generated 5722 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:24:19.840171 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-206960b3-ac79-4063-a8b0-dac85034b8a9 tempest-FlavorsAccessNegativeTestJSON-573528365 tempest-FlavorsAccessNegativeTestJSON-573528365-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "aaa4d0dcf9bf45e19b9aa53cc92ddc5e"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:24:20.116211 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3ddd1126-80ae-43d5-bece-b3920d9fb71a tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 315 microversion: 2.1 time: 1.379203 Oct 18 15:24:20.117519 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 6/13] 10.222.0.60 () {60 vars in 1191 bytes} [Tue Oct 18 15:24:18 2022] POST /compute/v2.1/os-aggregates/1/action => generated 315 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:24:20.124051 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5b28d7cc-20b6-4003-b604-35680578070d tempest-FlavorsV255TestJSON-1566985915 tempest-FlavorsV255TestJSON-1566985915-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:20.201112 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5b28d7cc-20b6-4003-b604-35680578070d tempest-FlavorsV255TestJSON-1566985915 tempest-FlavorsV255TestJSON-1566985915-project] 10.222.0.60 "GET /compute/v2.1/flavors" status: 200 len: 3154 microversion: 2.55 time: 0.081929 Oct 18 15:24:20.201956 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 7/14] 10.222.0.60 () {60 vars in 1166 bytes} [Tue Oct 18 15:24:20 2022] GET /compute/v2.1/flavors => generated 3154 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:24:20.227438 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b34be6ac-e088-42d9-853a-ae6f02f0c4fd tempest-FlavorsV255TestJSON-1009340931 tempest-FlavorsV255TestJSON-1009340931-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:20.261007 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b34be6ac-e088-42d9-853a-ae6f02f0c4fd tempest-FlavorsV255TestJSON-1009340931 tempest-FlavorsV255TestJSON-1009340931-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/227039185" status: 202 len: 0 microversion: 2.55 time: 0.043471 Oct 18 15:24:20.265252 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 8/15] 10.222.0.60 () {60 vars in 1199 bytes} [Tue Oct 18 15:24:20 2022] DELETE /compute/v2.1/flavors/227039185 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 18 15:24:20.281741 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-57d0b8d1-1996-4f06-bc2c-d00904aaad94 tempest-FlavorsV255TestJSON-1009340931 tempest-FlavorsV255TestJSON-1009340931-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:20.322300 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-57d0b8d1-1996-4f06-bc2c-d00904aaad94 tempest-FlavorsV255TestJSON-1009340931 tempest-FlavorsV255TestJSON-1009340931-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.055858 Oct 18 15:24:20.322945 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 9/16] 10.222.0.60 () {60 vars in 1187 bytes} [Tue Oct 18 15:24:20 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:24:20.386686 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-206960b3-ac79-4063-a8b0-dac85034b8a9 tempest-FlavorsAccessNegativeTestJSON-573528365 tempest-FlavorsAccessNegativeTestJSON-573528365-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/118689124/action" status: 200 len: 96 microversion: 2.1 time: 0.554674 Oct 18 15:24:20.394159 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 8/17] 10.222.0.60 () {60 vars in 1197 bytes} [Tue Oct 18 15:24:19 2022] POST /compute/v2.1/flavors/118689124/action => generated 96 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:24:20.399671 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5331488d-f7c1-484a-8822-109c19f70674 tempest-FlavorsAccessNegativeTestJSON-573528365 tempest-FlavorsAccessNegativeTestJSON-573528365-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "aaa4d0dcf9bf45e19b9aa53cc92ddc5e"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:24:20.709820 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fb9599ca-b8cd-4e20-a97c-4c34ca9622ef tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1266282025", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "availability_zone": "tempest-test_az-1404653941"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:24:20.739536 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb9599ca-b8cd-4e20-a97c-4c34ca9622ef tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:20.740032 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb9599ca-b8cd-4e20-a97c-4c34ca9622ef tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:20.740473 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb9599ca-b8cd-4e20-a97c-4c34ca9622ef tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:20.741302 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb9599ca-b8cd-4e20-a97c-4c34ca9622ef tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:20.741764 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb9599ca-b8cd-4e20-a97c-4c34ca9622ef tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:20.742191 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb9599ca-b8cd-4e20-a97c-4c34ca9622ef tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:21.114748 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-5331488d-f7c1-484a-8822-109c19f70674 tempest-FlavorsAccessNegativeTestJSON-573528365 tempest-FlavorsAccessNegativeTestJSON-573528365-project-admin] HTTP exception thrown: Flavor access already exists for flavor 16 and project aaa4d0dcf9bf45e19b9aa53cc92ddc5e combination. Oct 18 15:24:21.128540 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5331488d-f7c1-484a-8822-109c19f70674 tempest-FlavorsAccessNegativeTestJSON-573528365 tempest-FlavorsAccessNegativeTestJSON-573528365-project-admin] Request method failure captured: Oct 18 15:24:21.128540 n-d-853682-5 devstack@n-api.service[120405]: request: POST /compute/v2.1/flavors/118689124/action HTTP/1.1 Oct 18 15:24:21.128540 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:24:21.128540 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:24:21.128540 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:24:21.128540 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 67 Oct 18 15:24:21.128540 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:24:21.128540 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:24:21.128540 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:24:21.128540 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:24:21.128540 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsUgaKiimoa7YME-1WhFHZik_e_7wwvmnTLxd9pQT7XTmQ3udem9yKH5pvo8IbU6nEr5RYQkUh6x8AWLPfbdV8nfP_EjDFDXVyaIyfM0zyIvC04RPZRFQ2QQQfi4-MJR0htgIsnDU55DAlOGSyj0dty-jZEG84F6OnXB93McgKKPLpo Oct 18 15:24:21.128540 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:24:21.128540 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:24:21.128540 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:24:21.128540 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:24:21.128540 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:24:21.128540 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:24:21.128540 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 8103c58c8f324716910695d1c047e07b Oct 18 15:24:21.128540 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-573528365 Oct 18 15:24:21.128540 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,admin,reader Oct 18 15:24:21.128540 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,admin,reader Oct 18 15:24:21.129627 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8103c58c8f324716910695d1c047e07b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8103c58c8f324716910695d1c047e07b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8103c58c8f324716910695d1c047e07b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8103c58c8f324716910695d1c047e07b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:24:21.129627 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-573528365 Oct 18 15:24:21.129627 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 8103c58c8f324716910695d1c047e07b Oct 18 15:24:21.129627 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-573528365 Oct 18 15:24:21.129627 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-FlavorsAccessNegativeTestJSON-573528365-project-admin Oct 18 15:24:21.129627 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:24:21.129627 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:24:21.129627 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 97d56a0c6142489182e6f2d07865e4af Oct 18 15:24:21.129627 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-573528365-project-admin Oct 18 15:24:21.129627 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:24:21.129627 n-d-853682-5 devstack@n-api.service[120405]: {"addTenantAccess": {"tenant": "aaa4d0dcf9bf45e19b9aa53cc92ddc5e"}} Oct 18 15:24:21.129627 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:24:21.130229 n-d-853682-5 devstack@n-api.service[120405]: exception: Flavor access already exists for flavor 16 and project aaa4d0dcf9bf45e19b9aa53cc92ddc5e combination. Oct 18 15:24:21.130229 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '118689124', 'body': {'addTenantAccess': {'tenant': 'aaa4d0dcf9bf45e19b9aa53cc92ddc5e'}}} Oct 18 15:24:21.130229 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:24:21.130229 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:21.130229 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 15:24:21.130229 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 18 15:24:21.130229 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 15:24:21.130229 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 18 15:24:21.130229 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 15:24:21.130229 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 18 15:24:21.130229 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 15:24:21.130229 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 18 15:24:21.130229 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 15:24:21.130229 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 15:24:21.130229 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 15:24:21.130229 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi result.read() Oct 18 15:24:21.130229 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 15:24:21.130229 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 18 15:24:21.131104 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 15:24:21.131104 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 18 15:24:21.131104 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 15:24:21.131104 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 18 15:24:21.131104 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 15:24:21.131104 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 18 15:24:21.131104 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '16-aaa4d0dcf9bf45e19b9aa53cc92ddc5e' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 18 15:24:21.131104 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:24:21.131104 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 18 15:24:21.131104 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:24:21.131104 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:21.131104 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 18 15:24:21.131104 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 18 15:24:21.131104 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 18 15:24:21.131104 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi session.flush() Oct 18 15:24:21.131104 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 18 15:24:21.131104 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 18 15:24:21.131104 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 18 15:24:21.131104 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 18 15:24:21.131979 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 18 15:24:21.131979 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 18 15:24:21.131979 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 15:24:21.131979 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception Oct 18 15:24:21.131979 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 18 15:24:21.131979 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 18 15:24:21.131979 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 18 15:24:21.131979 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 18 15:24:21.131979 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 18 15:24:21.131979 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 18 15:24:21.131979 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 18 15:24:21.131979 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 18 15:24:21.131979 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 18 15:24:21.131979 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 18 15:24:21.131979 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 18 15:24:21.131979 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 18 15:24:21.131979 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 18 15:24:21.131979 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 18 15:24:21.132851 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 18 15:24:21.132851 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 18 15:24:21.132851 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 18 15:24:21.132851 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 18 15:24:21.132851 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 18 15:24:21.132851 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 18 15:24:21.132851 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 15:24:21.132851 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception Oct 18 15:24:21.132851 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 15:24:21.132851 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 18 15:24:21.132851 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 15:24:21.132851 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 18 15:24:21.132851 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 15:24:21.132851 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 18 15:24:21.132851 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 15:24:21.132851 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 18 15:24:21.132851 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 15:24:21.132851 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 15:24:21.133752 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 15:24:21.133752 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi result.read() Oct 18 15:24:21.133752 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 15:24:21.133752 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 18 15:24:21.133752 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 15:24:21.133752 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 18 15:24:21.133752 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 15:24:21.133752 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 18 15:24:21.133752 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 15:24:21.133752 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 18 15:24:21.133752 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '16-aaa4d0dcf9bf45e19b9aa53cc92ddc5e' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 18 15:24:21.133752 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 18 15:24:21.133752 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 18, 15, 24, 21, 108672), 'updated_at': None, 'flavor_id': 16, 'project_id': 'aaa4d0dcf9bf45e19b9aa53cc92ddc5e'}] Oct 18 15:24:21.133752 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 18 15:24:21.133752 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:24:21.133752 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:21.133752 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:24:21.134514 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:21.134514 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 18 15:24:21.134514 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 18 15:24:21.134514 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 18 15:24:21.134514 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 18 15:24:21.134514 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 18 15:24:21.134514 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 18 15:24:21.134514 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 18 15:24:21.134514 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 18 15:24:21.134514 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 18 15:24:21.134514 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 18 15:24:21.134514 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 15:24:21.134514 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 15:24:21.134514 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 18 15:24:21.134514 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 18 15:24:21.134514 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 16 and project aaa4d0dcf9bf45e19b9aa53cc92ddc5e combination. Oct 18 15:24:21.134514 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:24:21.134514 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:21.134514 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:24:21.135510 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:21.135510 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:21.135510 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:21.135510 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:24:21.135510 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:24:21.135510 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:24:21.135510 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:24:21.135510 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:24:21.135510 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:24:21.135510 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 18 15:24:21.135510 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 18 15:24:21.135510 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 16 and project aaa4d0dcf9bf45e19b9aa53cc92ddc5e combination. Oct 18 15:24:21.135510 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:24:21.135510 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:21.135510 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:24:21.135510 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:21.135510 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:21.135510 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:21.135510 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:24:21.135510 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:24:21.136521 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 16 and project aaa4d0dcf9bf45e19b9aa53cc92ddc5e combination. Oct 18 15:24:21.136521 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:24:21.144398 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5331488d-f7c1-484a-8822-109c19f70674 tempest-FlavorsAccessNegativeTestJSON-573528365 tempest-FlavorsAccessNegativeTestJSON-573528365-project-admin] Returning 409 to user: Flavor access already exists for flavor 16 and project aaa4d0dcf9bf45e19b9aa53cc92ddc5e combination. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:24:21.145592 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5331488d-f7c1-484a-8822-109c19f70674 tempest-FlavorsAccessNegativeTestJSON-573528365 tempest-FlavorsAccessNegativeTestJSON-573528365-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/118689124/action" status: 409 len: 152 microversion: 2.1 time: 0.750216 Oct 18 15:24:21.150400 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 9/18] 10.222.0.60 () {60 vars in 1197 bytes} [Tue Oct 18 15:24:20 2022] POST /compute/v2.1/flavors/118689124/action => generated 152 bytes in 756 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 15:24:21.499356 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-fb9599ca-b8cd-4e20-a97c-4c34ca9622ef tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] validate_networks() for None {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:24:21.532181 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ee0c2059-1e78-4770-bd5c-10d2d7395a82 tempest-FlavorsExtraSpecsNegativeTestJSON-276610838 tempest-FlavorsExtraSpecsNegativeTestJSON-276610838-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-400039936", "ram": 512, "vcpus": 1, "disk": 10, "id": 2098677090, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:24:21.562499 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ee0c2059-1e78-4770-bd5c-10d2d7395a82 tempest-FlavorsExtraSpecsNegativeTestJSON-276610838 tempest-FlavorsExtraSpecsNegativeTestJSON-276610838-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.410887 Oct 18 15:24:21.572438 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 10/19] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:24:21 2022] POST /compute/v2.1/flavors => generated 415 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:24:21.577550 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-20890e26-0929-435e-bed4-f26342a730d0 tempest-FlavorsAccessNegativeTestJSON-573528365 tempest-FlavorsAccessNegativeTestJSON-573528365-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "aaa4d0dcf9bf45e19b9aa53cc92ddc5e"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:24:21.900026 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-fb9599ca-b8cd-4e20-a97c-4c34ca9622ef tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:24:21.900663 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-fb9599ca-b8cd-4e20-a97c-4c34ca9622ef tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:24:21.901314 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-fb9599ca-b8cd-4e20-a97c-4c34ca9622ef tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:24:21.901949 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-fb9599ca-b8cd-4e20-a97c-4c34ca9622ef tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:24:21.903013 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-fb9599ca-b8cd-4e20-a97c-4c34ca9622ef tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:24:21.919294 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb9599ca-b8cd-4e20-a97c-4c34ca9622ef tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:21.920264 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb9599ca-b8cd-4e20-a97c-4c34ca9622ef tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:21.920930 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb9599ca-b8cd-4e20-a97c-4c34ca9622ef tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:21.921842 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb9599ca-b8cd-4e20-a97c-4c34ca9622ef tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:21.922479 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb9599ca-b8cd-4e20-a97c-4c34ca9622ef tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:21.923341 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb9599ca-b8cd-4e20-a97c-4c34ca9622ef tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:21.960136 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-fb9599ca-b8cd-4e20-a97c-4c34ca9622ef tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Getting quotas for project 5e72a93e9d51401c991e34b7e0f62ed4. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:24:21.968282 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-fb9599ca-b8cd-4e20-a97c-4c34ca9622ef tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Getting quotas for user a72c1406934749cdaf643c4370dbd306 and project 5e72a93e9d51401c991e34b7e0f62ed4. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:24:21.983178 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fb9599ca-b8cd-4e20-a97c-4c34ca9622ef tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:24:21.986736 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fb9599ca-b8cd-4e20-a97c-4c34ca9622ef tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] [instance: 3f5d6640-30f6-490b-984f-d1169918133f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:24:22.060783 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fb9599ca-b8cd-4e20-a97c-4c34ca9622ef tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.702685 Oct 18 15:24:22.062226 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 10/20] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:24:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:24:22.140525 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-20890e26-0929-435e-bed4-f26342a730d0 tempest-FlavorsAccessNegativeTestJSON-573528365 tempest-FlavorsAccessNegativeTestJSON-573528365-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/118689124/action" status: 200 len: 21 microversion: 2.1 time: 0.566523 Oct 18 15:24:22.147217 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 11/21] 10.222.0.60 () {60 vars in 1197 bytes} [Tue Oct 18 15:24:21 2022] POST /compute/v2.1/flavors/118689124/action => generated 21 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:24:22.153178 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-79888f9c-5018-49d0-8944-eb7c0eb2ddc9 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:22.155356 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-79888f9c-5018-49d0-8944-eb7c0eb2ddc9 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] [instance: 3f5d6640-30f6-490b-984f-d1169918133f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:24:22.603667 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9d2dbca8-1baf-4da7-80ba-0f9d701d5d93 tempest-FlavorsExtraSpecsNegativeTestJSON-612754089 tempest-FlavorsExtraSpecsNegativeTestJSON-612754089-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:22.628504 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-9d2dbca8-1baf-4da7-80ba-0f9d701d5d93 tempest-FlavorsExtraSpecsNegativeTestJSON-612754089 tempest-FlavorsExtraSpecsNegativeTestJSON-612754089-project] HTTP exception thrown: Flavor 2098677090 has no extra specs with key hw:cpu_thread_policy. Oct 18 15:24:22.636831 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9d2dbca8-1baf-4da7-80ba-0f9d701d5d93 tempest-FlavorsExtraSpecsNegativeTestJSON-612754089 tempest-FlavorsExtraSpecsNegativeTestJSON-612754089-project] Request method failure captured: Oct 18 15:24:22.636831 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/flavors/2098677090/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 18 15:24:22.636831 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:24:22.636831 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:24:22.636831 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:24:22.636831 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:24:22.636831 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:24:22.636831 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:24:22.636831 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:24:22.636831 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:24:22.636831 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsUj8KBU3FmmeVRcjKoqEqFcPbVusew-KgBRX4QzudO0uSgoIKCwohIDSF2z3kfdo3opqVtYTF3gsngbEMiMFQCthrQCchJTfL5TkZFBlfeJ24yytM4OowhNvwYYNoNcD0G0qPcYR0nePhK4fi2b4NebF7PrcBaHEpzDrGyR0_vGseA Oct 18 15:24:22.636831 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:24:22.636831 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:24:22.636831 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:24:22.636831 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:24:22.636831 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:24:22.636831 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:24:22.636831 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: a7190c49c2964f34a249fee57ddbe82f Oct 18 15:24:22.636831 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-612754089 Oct 18 15:24:22.636831 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:24:22.636831 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:24:22.637906 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a7190c49c2964f34a249fee57ddbe82f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a7190c49c2964f34a249fee57ddbe82f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a7190c49c2964f34a249fee57ddbe82f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a7190c49c2964f34a249fee57ddbe82f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:24:22.637906 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-612754089 Oct 18 15:24:22.637906 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: a7190c49c2964f34a249fee57ddbe82f Oct 18 15:24:22.637906 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-612754089 Oct 18 15:24:22.637906 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-612754089-project Oct 18 15:24:22.637906 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:24:22.637906 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:24:22.637906 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 0ab3d537e7404751aac9090599a7d00e Oct 18 15:24:22.637906 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-612754089-project Oct 18 15:24:22.637906 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:24:22.637906 n-d-853682-5 devstack@n-api.service[120406]: exception: Flavor 2098677090 has no extra specs with key hw:cpu_thread_policy. Oct 18 15:24:22.638453 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'flavor_id': '2098677090', 'id': 'hw:cpu_thread_policy'} Oct 18 15:24:22.638453 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:24:22.638453 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:22.638453 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 18 15:24:22.638453 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 18 15:24:22.638453 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 18 15:24:22.638453 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:22.638453 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:22.638453 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:22.638453 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:22.638453 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:22.638453 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:22.638453 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:24:22.638453 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:24:22.638453 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:24:22.638453 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:24:22.638453 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 18 15:24:22.638453 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 18 15:24:22.638453 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 2098677090 has no extra specs with key hw:cpu_thread_policy. Oct 18 15:24:22.638453 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:22.638453 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:22.638453 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:22.639510 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:22.639510 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:22.639510 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:22.639510 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:24:22.639510 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:24:22.639510 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 2098677090 has no extra specs with key hw:cpu_thread_policy. Oct 18 15:24:22.639510 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:22.639510 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9d2dbca8-1baf-4da7-80ba-0f9d701d5d93 tempest-FlavorsExtraSpecsNegativeTestJSON-612754089 tempest-FlavorsExtraSpecsNegativeTestJSON-612754089-project] Returning 404 to user: Flavor 2098677090 has no extra specs with key hw:cpu_thread_policy. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:24:22.639893 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9d2dbca8-1baf-4da7-80ba-0f9d701d5d93 tempest-FlavorsExtraSpecsNegativeTestJSON-612754089 tempest-FlavorsExtraSpecsNegativeTestJSON-612754089-project] 10.222.0.60 "GET /compute/v2.1/flavors/2098677090/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.575801 Oct 18 15:24:22.640592 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 11/22] 10.222.0.60 () {58 vars in 1266 bytes} [Tue Oct 18 15:24:22 2022] GET /compute/v2.1/flavors/2098677090/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 577 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:24:22.660413 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b4d60bdc-6137-4ae2-9df1-be098ab84b02 tempest-FlavorsAccessNegativeTestJSON-573528365 tempest-FlavorsAccessNegativeTestJSON-573528365-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:22.701429 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b4d60bdc-6137-4ae2-9df1-be098ab84b02 tempest-FlavorsAccessNegativeTestJSON-573528365 tempest-FlavorsAccessNegativeTestJSON-573528365-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/118689124" status: 202 len: 0 microversion: 2.1 time: 0.058274 Oct 18 15:24:22.702955 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 12/23] 10.222.0.60 () {58 vars in 1158 bytes} [Tue Oct 18 15:24:22 2022] DELETE /compute/v2.1/flavors/118689124 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:24:22.718122 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-603c6ca2-84c7-442c-b04e-dd332ca1d1f9 tempest-FlavorsExtraSpecsNegativeTestJSON-612754089 tempest-FlavorsExtraSpecsNegativeTestJSON-612754089-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:24:22.726980 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-603c6ca2-84c7-442c-b04e-dd332ca1d1f9 tempest-FlavorsExtraSpecsNegativeTestJSON-612754089 tempest-FlavorsExtraSpecsNegativeTestJSON-612754089-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '0ab3d537e7404751aac9090599a7d00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7190c49c2964f34a249fee57ddbe82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:24:22.734887 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-603c6ca2-84c7-442c-b04e-dd332ca1d1f9 tempest-FlavorsExtraSpecsNegativeTestJSON-612754089 tempest-FlavorsExtraSpecsNegativeTestJSON-612754089-project] Request method failure captured: Oct 18 15:24:22.734887 n-d-853682-5 devstack@n-api.service[120406]: request: POST /compute/v2.1/flavors/2098677090/os-extra_specs HTTP/1.1 Oct 18 15:24:22.734887 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:24:22.734887 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:24:22.734887 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:24:22.734887 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 66 Oct 18 15:24:22.734887 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:24:22.734887 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:24:22.734887 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:24:22.734887 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:24:22.734887 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsUj8KBU3FmmeVRcjKoqEqFcPbVusew-KgBRX4QzudO0uSgoIKCwohIDSF2z3kfdo3opqVtYTF3gsngbEMiMFQCthrQCchJTfL5TkZFBlfeJ24yytM4OowhNvwYYNoNcD0G0qPcYR0nePhK4fi2b4NebF7PrcBaHEpzDrGyR0_vGseA Oct 18 15:24:22.734887 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:24:22.734887 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:24:22.734887 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:24:22.734887 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:24:22.734887 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:24:22.734887 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:24:22.734887 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: a7190c49c2964f34a249fee57ddbe82f Oct 18 15:24:22.734887 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-612754089 Oct 18 15:24:22.734887 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:24:22.734887 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:24:22.736054 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a7190c49c2964f34a249fee57ddbe82f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a7190c49c2964f34a249fee57ddbe82f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a7190c49c2964f34a249fee57ddbe82f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a7190c49c2964f34a249fee57ddbe82f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:24:22.736054 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-612754089 Oct 18 15:24:22.736054 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: a7190c49c2964f34a249fee57ddbe82f Oct 18 15:24:22.736054 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-612754089 Oct 18 15:24:22.736054 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-612754089-project Oct 18 15:24:22.736054 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:24:22.736054 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:24:22.736054 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 0ab3d537e7404751aac9090599a7d00e Oct 18 15:24:22.736054 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-612754089-project Oct 18 15:24:22.736054 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:24:22.736054 n-d-853682-5 devstack@n-api.service[120406]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 18 15:24:22.736054 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:24:22.736694 n-d-853682-5 devstack@n-api.service[120406]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 18 15:24:22.736694 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'flavor_id': '2098677090', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 18 15:24:22.736694 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:24:22.736694 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:22.736694 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:22.736694 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:22.736694 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:24:22.736694 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:24:22.736694 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:24:22.736694 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:24:22.736694 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:24:22.736694 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:24:22.736694 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 18 15:24:22.736694 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 18 15:24:22.736694 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 15:24:22.736694 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 15:24:22.736694 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 15:24:22.736694 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 15:24:22.736694 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 15:24:22.737717 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 15:24:22.737717 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 15:24:22.737717 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 15:24:22.737717 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 15:24:22.737717 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 15:24:22.737717 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 15:24:22.737717 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 15:24:22.737717 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 15:24:22.737717 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 15:24:22.737717 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 18 15:24:22.737717 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:22.737717 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:22.737717 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:22.737717 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:22.737717 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:22.737717 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:22.737717 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 15:24:22.737717 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 15:24:22.737717 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 18 15:24:22.737717 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:22.742379 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-603c6ca2-84c7-442c-b04e-dd332ca1d1f9 tempest-FlavorsExtraSpecsNegativeTestJSON-612754089 tempest-FlavorsExtraSpecsNegativeTestJSON-612754089-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:24:22.745990 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-603c6ca2-84c7-442c-b04e-dd332ca1d1f9 tempest-FlavorsExtraSpecsNegativeTestJSON-612754089 tempest-FlavorsExtraSpecsNegativeTestJSON-612754089-project] 10.222.0.60 "POST /compute/v2.1/flavors/2098677090/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.040275 Oct 18 15:24:22.749084 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 13/24] 10.222.0.60 () {60 vars in 1224 bytes} [Tue Oct 18 15:24:22 2022] POST /compute/v2.1/flavors/2098677090/os-extra_specs => generated 124 bytes in 45 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:24:22.760478 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3a695bdd-348b-454f-8303-9ad15bf40ed3 tempest-FlavorsAccessNegativeTestJSON-573528365 tempest-FlavorsAccessNegativeTestJSON-573528365-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:22.816494 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3a695bdd-348b-454f-8303-9ad15bf40ed3 tempest-FlavorsAccessNegativeTestJSON-573528365 tempest-FlavorsAccessNegativeTestJSON-573528365-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5396 microversion: 2.1 time: 0.066067 Oct 18 15:24:22.819675 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 14/25] 10.222.0.60 () {58 vars in 1146 bytes} [Tue Oct 18 15:24:22 2022] GET /compute/v2.1/flavors/detail => generated 5396 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:22.831009 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0f683fa5-8562-4b0f-ae94-fe6362261a2e tempest-FlavorsExtraSpecsNegativeTestJSON-276610838 tempest-FlavorsExtraSpecsNegativeTestJSON-276610838-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:24:22.918548 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0f683fa5-8562-4b0f-ae94-fe6362261a2e tempest-FlavorsExtraSpecsNegativeTestJSON-276610838 tempest-FlavorsExtraSpecsNegativeTestJSON-276610838-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/2098677090/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.096249 Oct 18 15:24:22.922541 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 15/26] 10.222.0.60 () {60 vars in 1224 bytes} [Tue Oct 18 15:24:22 2022] POST /compute/v2.1/flavors/2098677090/os-extra_specs => generated 66 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:24:22.931466 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e2d9003b-d848-4013-bf6c-8b2199867295 tempest-FlavorsAccessNegativeTestJSON-573528365 tempest-FlavorsAccessNegativeTestJSON-573528365-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1894826407", "id": 1505176408, "os-flavor-access:is_public": "True"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:24:22.977841 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e2d9003b-d848-4013-bf6c-8b2199867295 tempest-FlavorsAccessNegativeTestJSON-573528365 tempest-FlavorsAccessNegativeTestJSON-573528365-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.052813 Oct 18 15:24:22.978610 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 16/27] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:24:22 2022] POST /compute/v2.1/flavors => generated 438 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:24:22.994549 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f15ceaab-b408-4214-8e79-4226c5d7a555 tempest-FlavorsExtraSpecsNegativeTestJSON-612754089 tempest-FlavorsExtraSpecsNegativeTestJSON-612754089-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:22.997077 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f15ceaab-b408-4214-8e79-4226c5d7a555 tempest-FlavorsExtraSpecsNegativeTestJSON-612754089 tempest-FlavorsExtraSpecsNegativeTestJSON-612754089-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '0ab3d537e7404751aac9090599a7d00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7190c49c2964f34a249fee57ddbe82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:24:23.001809 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f15ceaab-b408-4214-8e79-4226c5d7a555 tempest-FlavorsExtraSpecsNegativeTestJSON-612754089 tempest-FlavorsExtraSpecsNegativeTestJSON-612754089-project] Request method failure captured: Oct 18 15:24:23.001809 n-d-853682-5 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/flavors/2098677090/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 18 15:24:23.001809 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:24:23.001809 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:24:23.001809 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:24:23.001809 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:24:23.001809 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:24:23.001809 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:24:23.001809 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:24:23.001809 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:24:23.001809 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsUj8KBU3FmmeVRcjKoqEqFcPbVusew-KgBRX4QzudO0uSgoIKCwohIDSF2z3kfdo3opqVtYTF3gsngbEMiMFQCthrQCchJTfL5TkZFBlfeJ24yytM4OowhNvwYYNoNcD0G0qPcYR0nePhK4fi2b4NebF7PrcBaHEpzDrGyR0_vGseA Oct 18 15:24:23.001809 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:24:23.001809 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:24:23.001809 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:24:23.001809 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:24:23.001809 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:24:23.001809 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:24:23.001809 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: a7190c49c2964f34a249fee57ddbe82f Oct 18 15:24:23.001809 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-612754089 Oct 18 15:24:23.001809 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:24:23.001809 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:24:23.002887 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a7190c49c2964f34a249fee57ddbe82f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a7190c49c2964f34a249fee57ddbe82f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a7190c49c2964f34a249fee57ddbe82f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a7190c49c2964f34a249fee57ddbe82f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:24:23.002887 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-612754089 Oct 18 15:24:23.002887 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: a7190c49c2964f34a249fee57ddbe82f Oct 18 15:24:23.002887 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-612754089 Oct 18 15:24:23.002887 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-612754089-project Oct 18 15:24:23.002887 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:24:23.002887 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:24:23.002887 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 0ab3d537e7404751aac9090599a7d00e Oct 18 15:24:23.002887 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-612754089-project Oct 18 15:24:23.002887 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:24:23.002887 n-d-853682-5 devstack@n-api.service[120406]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 18 15:24:23.003423 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'flavor_id': '2098677090', 'id': 'hw:numa_nodes'} Oct 18 15:24:23.003423 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:24:23.003423 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:23.003423 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:23.003423 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:23.003423 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:24:23.003423 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:24:23.003423 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:24:23.003423 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:24:23.003423 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 18 15:24:23.003423 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 18 15:24:23.003423 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 15:24:23.003423 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 15:24:23.003423 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 15:24:23.003423 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 15:24:23.003423 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 15:24:23.003423 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 15:24:23.003423 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 15:24:23.003423 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 15:24:23.003423 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 15:24:23.010279 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 15:24:23.010279 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 15:24:23.010279 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 15:24:23.010279 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 15:24:23.010279 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 15:24:23.010279 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 18 15:24:23.010279 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:23.010279 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:23.010279 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:23.010279 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:23.010279 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:23.010279 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:23.010279 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 15:24:23.010279 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 15:24:23.010279 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 18 15:24:23.010279 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:23.010279 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f15ceaab-b408-4214-8e79-4226c5d7a555 tempest-FlavorsExtraSpecsNegativeTestJSON-612754089 tempest-FlavorsExtraSpecsNegativeTestJSON-612754089-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:24:23.011368 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f15ceaab-b408-4214-8e79-4226c5d7a555 tempest-FlavorsExtraSpecsNegativeTestJSON-612754089 tempest-FlavorsExtraSpecsNegativeTestJSON-612754089-project] 10.222.0.60 "DELETE /compute/v2.1/flavors/2098677090/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.023096 Oct 18 15:24:23.011368 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 17/28] 10.222.0.60 () {58 vars in 1248 bytes} [Tue Oct 18 15:24:22 2022] DELETE /compute/v2.1/flavors/2098677090/os-extra_specs/hw:numa_nodes => generated 124 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:24:23.015025 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1a9d81b4-2561-47c7-939c-207ba6034cf0 tempest-FlavorsAccessNegativeTestJSON-573528365 tempest-FlavorsAccessNegativeTestJSON-573528365-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:23.032745 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-1a9d81b4-2561-47c7-939c-207ba6034cf0 tempest-FlavorsAccessNegativeTestJSON-573528365 tempest-FlavorsAccessNegativeTestJSON-573528365-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 18 15:24:23.035864 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1a9d81b4-2561-47c7-939c-207ba6034cf0 tempest-FlavorsAccessNegativeTestJSON-573528365 tempest-FlavorsAccessNegativeTestJSON-573528365-project-admin] Request method failure captured: Oct 18 15:24:23.035864 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/flavors/1505176408/os-flavor-access HTTP/1.1 Oct 18 15:24:23.035864 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:24:23.035864 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:24:23.035864 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:24:23.035864 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:24:23.035864 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:24:23.035864 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:24:23.035864 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:24:23.035864 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:24:23.035864 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsUgaKiimoa7YME-1WhFHZik_e_7wwvmnTLxd9pQT7XTmQ3udem9yKH5pvo8IbU6nEr5RYQkUh6x8AWLPfbdV8nfP_EjDFDXVyaIyfM0zyIvC04RPZRFQ2QQQfi4-MJR0htgIsnDU55DAlOGSyj0dty-jZEG84F6OnXB93McgKKPLpo Oct 18 15:24:23.035864 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:24:23.035864 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:24:23.035864 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:24:23.035864 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:24:23.035864 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:24:23.035864 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:24:23.035864 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 8103c58c8f324716910695d1c047e07b Oct 18 15:24:23.035864 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-573528365 Oct 18 15:24:23.035864 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,admin,reader Oct 18 15:24:23.035864 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,admin,reader Oct 18 15:24:23.037127 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8103c58c8f324716910695d1c047e07b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8103c58c8f324716910695d1c047e07b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8103c58c8f324716910695d1c047e07b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8103c58c8f324716910695d1c047e07b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:24:23.037127 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-573528365 Oct 18 15:24:23.037127 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 8103c58c8f324716910695d1c047e07b Oct 18 15:24:23.037127 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-573528365 Oct 18 15:24:23.037127 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-FlavorsAccessNegativeTestJSON-573528365-project-admin Oct 18 15:24:23.037127 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:24:23.037127 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:24:23.037127 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 97d56a0c6142489182e6f2d07865e4af Oct 18 15:24:23.037127 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-573528365-project-admin Oct 18 15:24:23.037127 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:24:23.037127 n-d-853682-5 devstack@n-api.service[120406]: exception: Access list not available for public flavors. Oct 18 15:24:23.037127 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'flavor_id': '1505176408'} Oct 18 15:24:23.038065 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:24:23.038065 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:23.038065 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:23.038065 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:23.038065 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:24:23.038065 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:24:23.038065 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:24:23.038065 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:24:23.038065 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 18 15:24:23.038065 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 15:24:23.038065 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 18 15:24:23.038065 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:23.038065 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:23.038065 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:23.038065 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:23.038065 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:23.038065 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:23.038065 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:24:23.038065 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:24:23.038065 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 18 15:24:23.038065 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:23.039214 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1a9d81b4-2561-47c7-939c-207ba6034cf0 tempest-FlavorsAccessNegativeTestJSON-573528365 tempest-FlavorsAccessNegativeTestJSON-573528365-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:24:23.039214 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1a9d81b4-2561-47c7-939c-207ba6034cf0 tempest-FlavorsAccessNegativeTestJSON-573528365 tempest-FlavorsAccessNegativeTestJSON-573528365-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/1505176408/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.027856 Oct 18 15:24:23.040635 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 18/29] 10.222.0.60 () {58 vars in 1209 bytes} [Tue Oct 18 15:24:23 2022] GET /compute/v2.1/flavors/1505176408/os-flavor-access => generated 91 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 15:24:23.060499 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8b7ae70e-f94c-42e4-ac0a-3d0d0fc9a244 tempest-FlavorsExtraSpecsNegativeTestJSON-276610838 tempest-FlavorsExtraSpecsNegativeTestJSON-276610838-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:24:23.131386 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=8,nova_api:DELETE=6,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:24:23.133105 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8b7ae70e-f94c-42e4-ac0a-3d0d0fc9a244 tempest-FlavorsExtraSpecsNegativeTestJSON-276610838 tempest-FlavorsExtraSpecsNegativeTestJSON-276610838-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/2098677090/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.091416 Oct 18 15:24:23.133795 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 19/30] 10.222.0.60 () {60 vars in 1224 bytes} [Tue Oct 18 15:24:23 2022] POST /compute/v2.1/flavors/2098677090/os-extra_specs => generated 66 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:24:23.145620 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-77c1c9f4-2cce-4a46-b109-efdbf6a50c91 tempest-FlavorsAccessNegativeTestJSON-573528365 tempest-FlavorsAccessNegativeTestJSON-573528365-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:23.188797 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-77c1c9f4-2cce-4a46-b109-efdbf6a50c91 tempest-FlavorsAccessNegativeTestJSON-573528365 tempest-FlavorsAccessNegativeTestJSON-573528365-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/1505176408" status: 202 len: 0 microversion: 2.1 time: 0.049892 Oct 18 15:24:23.191956 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 20/31] 10.222.0.60 () {58 vars in 1161 bytes} [Tue Oct 18 15:24:23 2022] DELETE /compute/v2.1/flavors/1505176408 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:24:23.199056 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1c0fdd92-f850-41c1-ae7a-c986dde1b23b tempest-FlavorsExtraSpecsNegativeTestJSON-612754089 tempest-FlavorsExtraSpecsNegativeTestJSON-612754089-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:24:23.202475 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1c0fdd92-f850-41c1-ae7a-c986dde1b23b tempest-FlavorsExtraSpecsNegativeTestJSON-612754089 tempest-FlavorsExtraSpecsNegativeTestJSON-612754089-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '0ab3d537e7404751aac9090599a7d00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7190c49c2964f34a249fee57ddbe82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:24:23.204606 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1c0fdd92-f850-41c1-ae7a-c986dde1b23b tempest-FlavorsExtraSpecsNegativeTestJSON-612754089 tempest-FlavorsExtraSpecsNegativeTestJSON-612754089-project] Request method failure captured: Oct 18 15:24:23.204606 n-d-853682-5 devstack@n-api.service[120406]: request: PUT /compute/v2.1/flavors/2098677090/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 18 15:24:23.204606 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:24:23.204606 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:24:23.204606 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:24:23.204606 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 22 Oct 18 15:24:23.204606 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:24:23.204606 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:24:23.204606 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:24:23.204606 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:24:23.204606 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsUj8KBU3FmmeVRcjKoqEqFcPbVusew-KgBRX4QzudO0uSgoIKCwohIDSF2z3kfdo3opqVtYTF3gsngbEMiMFQCthrQCchJTfL5TkZFBlfeJ24yytM4OowhNvwYYNoNcD0G0qPcYR0nePhK4fi2b4NebF7PrcBaHEpzDrGyR0_vGseA Oct 18 15:24:23.204606 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:24:23.204606 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:24:23.204606 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:24:23.204606 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:24:23.204606 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:24:23.204606 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:24:23.204606 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: a7190c49c2964f34a249fee57ddbe82f Oct 18 15:24:23.204606 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-612754089 Oct 18 15:24:23.204606 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:24:23.204606 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:24:23.206044 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a7190c49c2964f34a249fee57ddbe82f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a7190c49c2964f34a249fee57ddbe82f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a7190c49c2964f34a249fee57ddbe82f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a7190c49c2964f34a249fee57ddbe82f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:24:23.206044 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-612754089 Oct 18 15:24:23.206044 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: a7190c49c2964f34a249fee57ddbe82f Oct 18 15:24:23.206044 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-612754089 Oct 18 15:24:23.206044 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-612754089-project Oct 18 15:24:23.206044 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:24:23.206044 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:24:23.206044 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 0ab3d537e7404751aac9090599a7d00e Oct 18 15:24:23.206044 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-612754089-project Oct 18 15:24:23.206044 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:24:23.206044 n-d-853682-5 devstack@n-api.service[120406]: {"hw:numa_nodes": "1"} Oct 18 15:24:23.206044 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:24:23.206044 n-d-853682-5 devstack@n-api.service[120406]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 18 15:24:23.206854 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'flavor_id': '2098677090', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 18 15:24:23.206854 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:24:23.206854 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:23.206854 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:23.206854 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:23.206854 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:24:23.206854 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:24:23.206854 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:24:23.206854 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:24:23.206854 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:24:23.206854 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:24:23.206854 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 18 15:24:23.206854 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 18 15:24:23.206854 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 15:24:23.206854 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 15:24:23.206854 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 15:24:23.206854 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 15:24:23.206854 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 15:24:23.206854 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 15:24:23.207979 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 15:24:23.207979 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 15:24:23.207979 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 15:24:23.207979 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 15:24:23.207979 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 15:24:23.207979 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 15:24:23.207979 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 15:24:23.207979 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 15:24:23.207979 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 18 15:24:23.207979 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:23.207979 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:23.207979 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:23.207979 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:23.207979 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:23.207979 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:23.207979 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 15:24:23.207979 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 15:24:23.207979 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 18 15:24:23.207979 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:23.209143 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1c0fdd92-f850-41c1-ae7a-c986dde1b23b tempest-FlavorsExtraSpecsNegativeTestJSON-612754089 tempest-FlavorsExtraSpecsNegativeTestJSON-612754089-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:24:23.209143 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1c0fdd92-f850-41c1-ae7a-c986dde1b23b tempest-FlavorsExtraSpecsNegativeTestJSON-612754089 tempest-FlavorsExtraSpecsNegativeTestJSON-612754089-project] 10.222.0.60 "PUT /compute/v2.1/flavors/2098677090/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.013873 Oct 18 15:24:23.209143 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 21/32] 10.222.0.60 () {60 vars in 1265 bytes} [Tue Oct 18 15:24:23 2022] PUT /compute/v2.1/flavors/2098677090/os-extra_specs/hw:numa_nodes => generated 124 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:24:23.218367 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ff2758de-ed28-40cb-bd0f-a40282c702ee tempest-FlavorsAccessNegativeTestJSON-573528365 tempest-FlavorsAccessNegativeTestJSON-573528365-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:23.256371 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ff2758de-ed28-40cb-bd0f-a40282c702ee tempest-FlavorsAccessNegativeTestJSON-573528365 tempest-FlavorsAccessNegativeTestJSON-573528365-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5396 microversion: 2.1 time: 0.047204 Oct 18 15:24:23.257523 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 22/33] 10.222.0.60 () {58 vars in 1146 bytes} [Tue Oct 18 15:24:23 2022] GET /compute/v2.1/flavors/detail => generated 5396 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:23.263308 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8967f765-21bf-4e4b-bdd6-6465f9d7cfd7 tempest-FlavorsExtraSpecsNegativeTestJSON-276610838 tempest-FlavorsExtraSpecsNegativeTestJSON-276610838-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:23.273205 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-8967f765-21bf-4e4b-bdd6-6465f9d7cfd7 tempest-FlavorsExtraSpecsNegativeTestJSON-276610838 tempest-FlavorsExtraSpecsNegativeTestJSON-276610838-project-admin] HTTP exception thrown: Flavor 2098677090 has no extra specs with key hw:cpu_thread_policy. Oct 18 15:24:23.276122 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8967f765-21bf-4e4b-bdd6-6465f9d7cfd7 tempest-FlavorsExtraSpecsNegativeTestJSON-276610838 tempest-FlavorsExtraSpecsNegativeTestJSON-276610838-project-admin] Request method failure captured: Oct 18 15:24:23.276122 n-d-853682-5 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/flavors/2098677090/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 18 15:24:23.276122 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:24:23.276122 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:24:23.276122 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:24:23.276122 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:24:23.276122 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:24:23.276122 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:24:23.276122 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:24:23.276122 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:24:23.276122 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsUkoC4kdzQ_6Wo4pXZ_PK8_Mfs49QPLH9djzOHh8-4wW3AU0NOkGOaIZOLQyrfoecIiDMljkCsStouv5cbuAiFSlS-1IZXK6JQSz0qEMz_eavKQRIY7WuZgSUoVsEMkvIakGP2KU0AkPZU26tPaFhmE3Alt0p0dIuHky-WMkhtqb8o Oct 18 15:24:23.276122 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:24:23.276122 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:24:23.276122 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:24:23.276122 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:24:23.276122 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:24:23.276122 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:24:23.276122 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: f4156d2790604b1c8749eda4d217a7ac Oct 18 15:24:23.276122 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-276610838 Oct 18 15:24:23.276122 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,admin,reader Oct 18 15:24:23.276122 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,admin,reader Oct 18 15:24:23.277505 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f4156d2790604b1c8749eda4d217a7ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f4156d2790604b1c8749eda4d217a7ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f4156d2790604b1c8749eda4d217a7ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f4156d2790604b1c8749eda4d217a7ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:24:23.277505 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-276610838 Oct 18 15:24:23.277505 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: f4156d2790604b1c8749eda4d217a7ac Oct 18 15:24:23.277505 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-276610838 Oct 18 15:24:23.277505 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-276610838-project-admin Oct 18 15:24:23.277505 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:24:23.277505 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:24:23.277505 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 65f93d6f4cd3466eb57ef6bb8ecc995a Oct 18 15:24:23.277505 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-276610838-project-admin Oct 18 15:24:23.277505 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:24:23.277505 n-d-853682-5 devstack@n-api.service[120406]: exception: Flavor 2098677090 has no extra specs with key hw:cpu_thread_policy. Oct 18 15:24:23.278205 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'flavor_id': '2098677090', 'id': 'hw:cpu_thread_policy'} Oct 18 15:24:23.278205 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:24:23.278205 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:23.278205 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 18 15:24:23.278205 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 18 15:24:23.278205 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 18 15:24:23.278205 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:23.278205 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:23.278205 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:23.278205 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:23.278205 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:23.278205 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:23.278205 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:24:23.278205 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:24:23.278205 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:24:23.278205 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:24:23.278205 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 18 15:24:23.278205 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 18 15:24:23.278205 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 2098677090 has no extra specs with key hw:cpu_thread_policy. Oct 18 15:24:23.278205 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:23.278205 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:23.278205 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:23.279506 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:23.279506 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:23.279506 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:23.279506 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:24:23.279506 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:24:23.279506 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 2098677090 has no extra specs with key hw:cpu_thread_policy. Oct 18 15:24:23.279506 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:23.281422 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8967f765-21bf-4e4b-bdd6-6465f9d7cfd7 tempest-FlavorsExtraSpecsNegativeTestJSON-276610838 tempest-FlavorsExtraSpecsNegativeTestJSON-276610838-project-admin] Returning 404 to user: Flavor 2098677090 has no extra specs with key hw:cpu_thread_policy. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:24:23.283832 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8967f765-21bf-4e4b-bdd6-6465f9d7cfd7 tempest-FlavorsExtraSpecsNegativeTestJSON-276610838 tempest-FlavorsExtraSpecsNegativeTestJSON-276610838-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/2098677090/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.023345 Oct 18 15:24:23.289959 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 23/34] 10.222.0.60 () {58 vars in 1269 bytes} [Tue Oct 18 15:24:23 2022] DELETE /compute/v2.1/flavors/2098677090/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:24:23.295708 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-61ed851a-cd37-4e15-8927-88315490c472 tempest-FlavorsAccessNegativeTestJSON-573528365 tempest-FlavorsAccessNegativeTestJSON-573528365-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-335948318", "id": 1718290851, "os-flavor-access:is_public": "False"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:24:23.321228 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-61ed851a-cd37-4e15-8927-88315490c472 tempest-FlavorsAccessNegativeTestJSON-573528365 tempest-FlavorsAccessNegativeTestJSON-573528365-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.029950 Oct 18 15:24:23.322770 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 24/35] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:24:23 2022] POST /compute/v2.1/flavors => generated 438 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:24:23.327897 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0ff611c5-c452-46d6-b9de-a6e54a072dc5 tempest-FlavorsExtraSpecsNegativeTestJSON-276610838 tempest-FlavorsExtraSpecsNegativeTestJSON-276610838-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:24:23.333546 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-0ff611c5-c452-46d6-b9de-a6e54a072dc5 tempest-FlavorsExtraSpecsNegativeTestJSON-276610838 tempest-FlavorsExtraSpecsNegativeTestJSON-276610838-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 18 15:24:23.335294 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0ff611c5-c452-46d6-b9de-a6e54a072dc5 tempest-FlavorsExtraSpecsNegativeTestJSON-276610838 tempest-FlavorsExtraSpecsNegativeTestJSON-276610838-project-admin] Request method failure captured: Oct 18 15:24:23.335294 n-d-853682-5 devstack@n-api.service[120406]: request: PUT /compute/v2.1/flavors/2098677090/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 18 15:24:23.335294 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:24:23.335294 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:24:23.335294 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:24:23.335294 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 27 Oct 18 15:24:23.335294 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:24:23.335294 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:24:23.335294 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:24:23.335294 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:24:23.335294 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsUkoC4kdzQ_6Wo4pXZ_PK8_Mfs49QPLH9djzOHh8-4wW3AU0NOkGOaIZOLQyrfoecIiDMljkCsStouv5cbuAiFSlS-1IZXK6JQSz0qEMz_eavKQRIY7WuZgSUoVsEMkvIakGP2KU0AkPZU26tPaFhmE3Alt0p0dIuHky-WMkhtqb8o Oct 18 15:24:23.335294 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:24:23.335294 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:24:23.335294 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:24:23.335294 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:24:23.335294 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:24:23.335294 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:24:23.335294 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: f4156d2790604b1c8749eda4d217a7ac Oct 18 15:24:23.335294 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-276610838 Oct 18 15:24:23.335294 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,admin,reader Oct 18 15:24:23.335294 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,admin,reader Oct 18 15:24:23.336651 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f4156d2790604b1c8749eda4d217a7ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f4156d2790604b1c8749eda4d217a7ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f4156d2790604b1c8749eda4d217a7ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f4156d2790604b1c8749eda4d217a7ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:24:23.336651 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-276610838 Oct 18 15:24:23.336651 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: f4156d2790604b1c8749eda4d217a7ac Oct 18 15:24:23.336651 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-276610838 Oct 18 15:24:23.336651 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-276610838-project-admin Oct 18 15:24:23.336651 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:24:23.336651 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:24:23.336651 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 65f93d6f4cd3466eb57ef6bb8ecc995a Oct 18 15:24:23.336651 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-276610838-project-admin Oct 18 15:24:23.336651 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:24:23.336651 n-d-853682-5 devstack@n-api.service[120406]: {"hw:cpu_policy": "shared"} Oct 18 15:24:23.336651 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:24:23.336651 n-d-853682-5 devstack@n-api.service[120406]: exception: Request body and URI mismatch Oct 18 15:24:23.337498 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'flavor_id': '2098677090', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 18 15:24:23.337498 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:24:23.337498 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:23.337498 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:23.337498 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:23.337498 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:24:23.337498 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:24:23.337498 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:24:23.337498 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:24:23.337498 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:24:23.337498 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:24:23.337498 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 18 15:24:23.337498 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 18 15:24:23.337498 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 18 15:24:23.337498 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:23.337498 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:23.337498 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:23.337498 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:23.337498 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:23.337498 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:23.338654 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:24:23.338654 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:24:23.338654 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 18 15:24:23.338654 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:23.338654 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0ff611c5-c452-46d6-b9de-a6e54a072dc5 tempest-FlavorsExtraSpecsNegativeTestJSON-276610838 tempest-FlavorsExtraSpecsNegativeTestJSON-276610838-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:24:23.339583 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0ff611c5-c452-46d6-b9de-a6e54a072dc5 tempest-FlavorsExtraSpecsNegativeTestJSON-276610838 tempest-FlavorsExtraSpecsNegativeTestJSON-276610838-project-admin] 10.222.0.60 "PUT /compute/v2.1/flavors/2098677090/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.015666 Oct 18 15:24:23.346791 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 25/36] 10.222.0.60 () {60 vars in 1265 bytes} [Tue Oct 18 15:24:23 2022] PUT /compute/v2.1/flavors/2098677090/os-extra_specs/hw:numa_nodes => generated 73 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 18 15:24:23.494588 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-79888f9c-5018-49d0-8944-eb7c0eb2ddc9 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72c1406934749cdaf643c4370dbd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e72a93e9d51401c991e34b7e0f62ed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:24:23.527797 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-79888f9c-5018-49d0-8944-eb7c0eb2ddc9 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] 10.222.0.60 "GET /compute/v2.1/servers/3f5d6640-30f6-490b-984f-d1169918133f" status: 200 len: 1243 microversion: 2.1 time: 1.376661 Oct 18 15:24:23.531076 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 12/37] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:24:22 2022] GET /compute/v2.1/servers/3f5d6640-30f6-490b-984f-d1169918133f => generated 1243 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:23.550028 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9a37420d-256d-4032-b0b6-e497d4803bfc tempest-FlavorsExtraSpecsNegativeTestJSON-276610838 tempest-FlavorsExtraSpecsNegativeTestJSON-276610838-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:24:23.557975 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9a37420d-256d-4032-b0b6-e497d4803bfc tempest-FlavorsExtraSpecsNegativeTestJSON-276610838 tempest-FlavorsExtraSpecsNegativeTestJSON-276610838-project-admin] Request method failure captured: Oct 18 15:24:23.557975 n-d-853682-5 devstack@n-api.service[120405]: request: PUT /compute/v2.1/flavors/2098677090/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 18 15:24:23.557975 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:24:23.557975 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:24:23.557975 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:24:23.557975 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 49 Oct 18 15:24:23.557975 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:24:23.557975 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:24:23.557975 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:24:23.557975 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:24:23.557975 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsUkoC4kdzQ_6Wo4pXZ_PK8_Mfs49QPLH9djzOHh8-4wW3AU0NOkGOaIZOLQyrfoecIiDMljkCsStouv5cbuAiFSlS-1IZXK6JQSz0qEMz_eavKQRIY7WuZgSUoVsEMkvIakGP2KU0AkPZU26tPaFhmE3Alt0p0dIuHky-WMkhtqb8o Oct 18 15:24:23.557975 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:24:23.557975 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:24:23.557975 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:24:23.557975 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:24:23.557975 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:24:23.557975 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:24:23.557975 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: f4156d2790604b1c8749eda4d217a7ac Oct 18 15:24:23.557975 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-276610838 Oct 18 15:24:23.557975 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,admin,reader Oct 18 15:24:23.557975 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,admin,reader Oct 18 15:24:23.559060 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f4156d2790604b1c8749eda4d217a7ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f4156d2790604b1c8749eda4d217a7ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f4156d2790604b1c8749eda4d217a7ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f4156d2790604b1c8749eda4d217a7ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:24:23.559060 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-276610838 Oct 18 15:24:23.559060 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: f4156d2790604b1c8749eda4d217a7ac Oct 18 15:24:23.559060 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-276610838 Oct 18 15:24:23.559060 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-276610838-project-admin Oct 18 15:24:23.559060 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:24:23.559060 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:24:23.559060 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 65f93d6f4cd3466eb57ef6bb8ecc995a Oct 18 15:24:23.559060 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-276610838-project-admin Oct 18 15:24:23.559060 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:24:23.559060 n-d-853682-5 devstack@n-api.service[120405]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 18 15:24:23.559060 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:24:23.559641 n-d-853682-5 devstack@n-api.service[120405]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 18 15:24:23.559641 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'flavor_id': '2098677090', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 18 15:24:23.559641 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:24:23.559641 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:23.559641 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 15:24:23.559641 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 15:24:23.559641 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 15:24:23.559641 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise error Oct 18 15:24:23.559641 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 18 15:24:23.559641 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:24:23.559641 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 18 15:24:23.559641 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 18 15:24:23.559641 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 18 15:24:23.559641 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 18 15:24:23.559641 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 18 15:24:23.559641 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 18 15:24:23.559641 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 18 15:24:23.559641 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 18 15:24:23.559641 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:24:23.559641 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi On instance: Oct 18 15:24:23.559641 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 18 15:24:23.559641 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:24:23.560692 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:23.560692 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:24:23.560692 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:23.560692 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:23.560692 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:23.560692 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:24:23.560692 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:24:23.560692 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:24:23.560692 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:24:23.560692 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 15:24:23.560692 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 15:24:23.560692 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 15:24:23.560692 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 15:24:23.560692 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 15:24:23.560692 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 15:24:23.560692 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 18 15:24:23.560692 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:24:23.560692 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:23.560692 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:24:23.560692 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:23.561766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:23.561766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:23.561766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 15:24:23.561766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 15:24:23.561766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 18 15:24:23.561766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:24:23.567361 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9a37420d-256d-4032-b0b6-e497d4803bfc tempest-FlavorsExtraSpecsNegativeTestJSON-276610838 tempest-FlavorsExtraSpecsNegativeTestJSON-276610838-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:24:23.570689 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9a37420d-256d-4032-b0b6-e497d4803bfc tempest-FlavorsExtraSpecsNegativeTestJSON-276610838 tempest-FlavorsExtraSpecsNegativeTestJSON-276610838-project-admin] 10.222.0.60 "PUT /compute/v2.1/flavors/2098677090/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.034667 Oct 18 15:24:23.571718 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 13/38] 10.222.0.60 () {60 vars in 1265 bytes} [Tue Oct 18 15:24:23 2022] PUT /compute/v2.1/flavors/2098677090/os-extra_specs/hw:numa_nodes => generated 117 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:24:23.586870 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e07b8374-11e1-4784-ad04-a6b3b64ad79e tempest-FlavorsExtraSpecsNegativeTestJSON-276610838 tempest-FlavorsExtraSpecsNegativeTestJSON-276610838-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:23.643932 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e07b8374-11e1-4784-ad04-a6b3b64ad79e tempest-FlavorsExtraSpecsNegativeTestJSON-276610838 tempest-FlavorsExtraSpecsNegativeTestJSON-276610838-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/2098677090" status: 202 len: 0 microversion: 2.1 time: 0.066800 Oct 18 15:24:23.646379 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 14/39] 10.222.0.60 () {58 vars in 1161 bytes} [Tue Oct 18 15:24:23 2022] DELETE /compute/v2.1/flavors/2098677090 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:24:23.654764 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4ff75f84-1525-4c73-b809-51b467276148 tempest-FlavorsExtraSpecsNegativeTestJSON-276610838 tempest-FlavorsExtraSpecsNegativeTestJSON-276610838-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:23.734348 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4ff75f84-1525-4c73-b809-51b467276148 tempest-FlavorsExtraSpecsNegativeTestJSON-276610838 tempest-FlavorsExtraSpecsNegativeTestJSON-276610838-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.081533 Oct 18 15:24:23.735199 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 15/40] 10.222.0.60 () {58 vars in 1146 bytes} [Tue Oct 18 15:24:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:24.138072 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-236bced3-1e7a-4037-85a8-af4f80a755de tempest-FlavorsAccessNegativeTestJSON-1297149693 tempest-FlavorsAccessNegativeTestJSON-1297149693-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "aaa4d0dcf9bf45e19b9aa53cc92ddc5e"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:24:24.142174 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-236bced3-1e7a-4037-85a8-af4f80a755de tempest-FlavorsAccessNegativeTestJSON-1297149693 tempest-FlavorsAccessNegativeTestJSON-1297149693-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '894d4bd0b488408eae3199dc344b030a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa4d0dcf9bf45e19b9aa53cc92ddc5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:24:24.148473 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-236bced3-1e7a-4037-85a8-af4f80a755de tempest-FlavorsAccessNegativeTestJSON-1297149693 tempest-FlavorsAccessNegativeTestJSON-1297149693-project] Request method failure captured: Oct 18 15:24:24.148473 n-d-853682-5 devstack@n-api.service[120406]: request: POST /compute/v2.1/flavors/1718290851/action HTTP/1.1 Oct 18 15:24:24.148473 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:24:24.148473 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:24:24.148473 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:24:24.148473 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 67 Oct 18 15:24:24.148473 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:24:24.148473 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:24:24.148473 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:24:24.148473 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:24:24.148473 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsUdVjQaHTrYEf02W-E5Vun6VG-NxhpA_tqwoEm3WdlQh6zkuXv2h4qDYbEnCWkJ0YJWoeHZbBQ81DtaFrCnDrd-RVkMPG6_rk11tdJiBImadjNcdko2ccoM7YEx9SFxQ09h3_wOU8dGfS0wpxfiStxAaZBLIahpPioL23M3ftqKLqM Oct 18 15:24:24.148473 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:24:24.148473 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:24:24.148473 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:24:24.148473 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:24:24.148473 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:24:24.148473 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:24:24.148473 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: aaa4d0dcf9bf45e19b9aa53cc92ddc5e Oct 18 15:24:24.148473 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1297149693 Oct 18 15:24:24.148473 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:24:24.148473 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:24:24.149818 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/aaa4d0dcf9bf45e19b9aa53cc92ddc5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/aaa4d0dcf9bf45e19b9aa53cc92ddc5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/aaa4d0dcf9bf45e19b9aa53cc92ddc5e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_aaa4d0dcf9bf45e19b9aa53cc92ddc5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:24:24.149818 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1297149693 Oct 18 15:24:24.149818 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: aaa4d0dcf9bf45e19b9aa53cc92ddc5e Oct 18 15:24:24.149818 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1297149693 Oct 18 15:24:24.149818 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-FlavorsAccessNegativeTestJSON-1297149693-project Oct 18 15:24:24.149818 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:24:24.149818 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:24:24.149818 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 894d4bd0b488408eae3199dc344b030a Oct 18 15:24:24.149818 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1297149693-project Oct 18 15:24:24.149818 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:24:24.149818 n-d-853682-5 devstack@n-api.service[120406]: {"addTenantAccess": {"tenant": "aaa4d0dcf9bf45e19b9aa53cc92ddc5e"}} Oct 18 15:24:24.149818 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:24:24.150425 n-d-853682-5 devstack@n-api.service[120406]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 18 15:24:24.150425 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '1718290851', 'body': {'addTenantAccess': {'tenant': 'aaa4d0dcf9bf45e19b9aa53cc92ddc5e'}}} Oct 18 15:24:24.150425 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:24:24.150425 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:24.150425 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:24.150425 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:24.150425 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:24:24.150425 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:24:24.150425 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:24:24.150425 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:24:24.150425 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:24:24.150425 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:24:24.150425 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 18 15:24:24.150425 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 18 15:24:24.150425 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 15:24:24.150425 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 15:24:24.150425 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 15:24:24.150425 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 15:24:24.150425 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 15:24:24.151344 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 15:24:24.151344 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 15:24:24.151344 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 15:24:24.151344 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 15:24:24.151344 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 15:24:24.151344 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 15:24:24.151344 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 15:24:24.151344 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 15:24:24.151344 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 15:24:24.151344 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 18 15:24:24.151344 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:24.151344 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:24.151344 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:24.151344 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:24.151344 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:24.151344 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:24.151344 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 15:24:24.151344 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 15:24:24.151344 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 18 15:24:24.151344 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:24.153440 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-236bced3-1e7a-4037-85a8-af4f80a755de tempest-FlavorsAccessNegativeTestJSON-1297149693 tempest-FlavorsAccessNegativeTestJSON-1297149693-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:24:24.153440 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-236bced3-1e7a-4037-85a8-af4f80a755de tempest-FlavorsAccessNegativeTestJSON-1297149693 tempest-FlavorsAccessNegativeTestJSON-1297149693-project] 10.222.0.60 "POST /compute/v2.1/flavors/1718290851/action" status: 403 len: 130 microversion: 2.1 time: 0.802730 Oct 18 15:24:24.153440 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 26/41] 10.222.0.60 () {60 vars in 1200 bytes} [Tue Oct 18 15:24:23 2022] POST /compute/v2.1/flavors/1718290851/action => generated 130 bytes in 805 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:24:24.162890 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c95413ce-c13d-4724-ad40-bbfeac12f8bd tempest-FlavorsAccessNegativeTestJSON-573528365 tempest-FlavorsAccessNegativeTestJSON-573528365-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:24.204488 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c95413ce-c13d-4724-ad40-bbfeac12f8bd tempest-FlavorsAccessNegativeTestJSON-573528365 tempest-FlavorsAccessNegativeTestJSON-573528365-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/1718290851" status: 202 len: 0 microversion: 2.1 time: 0.047455 Oct 18 15:24:24.209433 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 16/42] 10.222.0.60 () {58 vars in 1161 bytes} [Tue Oct 18 15:24:24 2022] DELETE /compute/v2.1/flavors/1718290851 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:24:24.218818 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1d7503d2-b739-403e-b1d1-1a89a8442cab tempest-FlavorsAccessNegativeTestJSON-573528365 tempest-FlavorsAccessNegativeTestJSON-573528365-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:24.292846 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1d7503d2-b739-403e-b1d1-1a89a8442cab tempest-FlavorsAccessNegativeTestJSON-573528365 tempest-FlavorsAccessNegativeTestJSON-573528365-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.079013 Oct 18 15:24:24.295952 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 27/43] 10.222.0.60 () {58 vars in 1146 bytes} [Tue Oct 18 15:24:24 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:24.320833 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-dfe2a34e-c2ac-42b8-8ae0-89e61c8c0d96 tempest-FlavorsAccessNegativeTestJSON-573528365 tempest-FlavorsAccessNegativeTestJSON-573528365-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1081862709", "id": 983743560, "os-flavor-access:is_public": "False"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:24:24.392079 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-dfe2a34e-c2ac-42b8-8ae0-89e61c8c0d96 tempest-FlavorsAccessNegativeTestJSON-573528365 tempest-FlavorsAccessNegativeTestJSON-573528365-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.073801 Oct 18 15:24:24.405250 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 17/44] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:24:24 2022] POST /compute/v2.1/flavors => generated 436 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:24:24.413137 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6cfae0c4-504f-4461-bc7c-81ab46f9b854 tempest-FlavorsAccessNegativeTestJSON-573528365 tempest-FlavorsAccessNegativeTestJSON-573528365-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "aaa4d0dcf9bf45e19b9aa53cc92ddc5e"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:24:24.562688 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2d81a0a7-d479-48b7-96c4-184fd36cbce2 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:24.563572 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2d81a0a7-d479-48b7-96c4-184fd36cbce2 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] [instance: 3f5d6640-30f6-490b-984f-d1169918133f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:24:24.584890 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d81a0a7-d479-48b7-96c4-184fd36cbce2 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:24.587121 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d81a0a7-d479-48b7-96c4-184fd36cbce2 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:24.589167 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d81a0a7-d479-48b7-96c4-184fd36cbce2 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:24.591421 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d81a0a7-d479-48b7-96c4-184fd36cbce2 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:24.595890 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d81a0a7-d479-48b7-96c4-184fd36cbce2 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:24.599734 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d81a0a7-d479-48b7-96c4-184fd36cbce2 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:24.930008 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2d81a0a7-d479-48b7-96c4-184fd36cbce2 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72c1406934749cdaf643c4370dbd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e72a93e9d51401c991e34b7e0f62ed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:24:24.958042 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2d81a0a7-d479-48b7-96c4-184fd36cbce2 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] 10.222.0.60 "GET /compute/v2.1/servers/3f5d6640-30f6-490b-984f-d1169918133f" status: 200 len: 1235 microversion: 2.1 time: 0.403691 Oct 18 15:24:24.962012 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 18/45] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:24:24 2022] GET /compute/v2.1/servers/3f5d6640-30f6-490b-984f-d1169918133f => generated 1235 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:25.328424 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6cfae0c4-504f-4461-bc7c-81ab46f9b854 tempest-FlavorsAccessNegativeTestJSON-573528365 tempest-FlavorsAccessNegativeTestJSON-573528365-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/983743560/action" status: 200 len: 96 microversion: 2.1 time: 0.922625 Oct 18 15:24:25.333315 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 28/46] 10.222.0.60 () {60 vars in 1197 bytes} [Tue Oct 18 15:24:24 2022] POST /compute/v2.1/flavors/983743560/action => generated 96 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:24:25.343540 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-07f3cb65-4113-4ca3-9627-c70ea133d980 tempest-FlavorsAccessNegativeTestJSON-1297149693 tempest-FlavorsAccessNegativeTestJSON-1297149693-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "aaa4d0dcf9bf45e19b9aa53cc92ddc5e"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:24:25.356722 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-07f3cb65-4113-4ca3-9627-c70ea133d980 tempest-FlavorsAccessNegativeTestJSON-1297149693 tempest-FlavorsAccessNegativeTestJSON-1297149693-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '894d4bd0b488408eae3199dc344b030a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa4d0dcf9bf45e19b9aa53cc92ddc5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:24:25.359808 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-07f3cb65-4113-4ca3-9627-c70ea133d980 tempest-FlavorsAccessNegativeTestJSON-1297149693 tempest-FlavorsAccessNegativeTestJSON-1297149693-project] Request method failure captured: Oct 18 15:24:25.359808 n-d-853682-5 devstack@n-api.service[120405]: request: POST /compute/v2.1/flavors/983743560/action HTTP/1.1 Oct 18 15:24:25.359808 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:24:25.359808 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:24:25.359808 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:24:25.359808 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 70 Oct 18 15:24:25.359808 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:24:25.359808 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:24:25.359808 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:24:25.359808 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:24:25.359808 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsUdVjQaHTrYEf02W-E5Vun6VG-NxhpA_tqwoEm3WdlQh6zkuXv2h4qDYbEnCWkJ0YJWoeHZbBQ81DtaFrCnDrd-RVkMPG6_rk11tdJiBImadjNcdko2ccoM7YEx9SFxQ09h3_wOU8dGfS0wpxfiStxAaZBLIahpPioL23M3ftqKLqM Oct 18 15:24:25.359808 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:24:25.359808 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:24:25.359808 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:24:25.359808 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:24:25.359808 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:24:25.359808 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:24:25.359808 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: aaa4d0dcf9bf45e19b9aa53cc92ddc5e Oct 18 15:24:25.359808 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1297149693 Oct 18 15:24:25.359808 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:24:25.359808 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:24:25.360937 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/aaa4d0dcf9bf45e19b9aa53cc92ddc5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/aaa4d0dcf9bf45e19b9aa53cc92ddc5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/aaa4d0dcf9bf45e19b9aa53cc92ddc5e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_aaa4d0dcf9bf45e19b9aa53cc92ddc5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:24:25.360937 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1297149693 Oct 18 15:24:25.360937 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: aaa4d0dcf9bf45e19b9aa53cc92ddc5e Oct 18 15:24:25.360937 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1297149693 Oct 18 15:24:25.360937 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-FlavorsAccessNegativeTestJSON-1297149693-project Oct 18 15:24:25.360937 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:24:25.360937 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:24:25.360937 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 894d4bd0b488408eae3199dc344b030a Oct 18 15:24:25.360937 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1297149693-project Oct 18 15:24:25.360937 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:24:25.360937 n-d-853682-5 devstack@n-api.service[120405]: {"removeTenantAccess": {"tenant": "aaa4d0dcf9bf45e19b9aa53cc92ddc5e"}} Oct 18 15:24:25.360937 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:24:25.361545 n-d-853682-5 devstack@n-api.service[120405]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 18 15:24:25.361545 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '983743560', 'body': {'removeTenantAccess': {'tenant': 'aaa4d0dcf9bf45e19b9aa53cc92ddc5e'}}} Oct 18 15:24:25.361545 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:24:25.361545 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:25.361545 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:25.361545 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:25.361545 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:24:25.361545 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:24:25.361545 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:24:25.361545 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:24:25.361545 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:24:25.361545 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:24:25.361545 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 18 15:24:25.361545 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi context.can( Oct 18 15:24:25.361545 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 15:24:25.361545 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 15:24:25.361545 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 15:24:25.361545 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 15:24:25.361545 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 15:24:25.361545 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 15:24:25.362579 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 15:24:25.362579 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 15:24:25.362579 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 15:24:25.362579 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 15:24:25.362579 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 15:24:25.362579 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 15:24:25.362579 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 15:24:25.362579 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 15:24:25.362579 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 18 15:24:25.362579 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:24:25.362579 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:25.362579 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:24:25.362579 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:25.362579 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:25.362579 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:25.362579 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 15:24:25.362579 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 15:24:25.362579 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 18 15:24:25.362579 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:24:25.365068 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-07f3cb65-4113-4ca3-9627-c70ea133d980 tempest-FlavorsAccessNegativeTestJSON-1297149693 tempest-FlavorsAccessNegativeTestJSON-1297149693-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:24:25.366285 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-07f3cb65-4113-4ca3-9627-c70ea133d980 tempest-FlavorsAccessNegativeTestJSON-1297149693 tempest-FlavorsAccessNegativeTestJSON-1297149693-project] 10.222.0.60 "POST /compute/v2.1/flavors/983743560/action" status: 403 len: 133 microversion: 2.1 time: 0.026977 Oct 18 15:24:25.372516 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 19/47] 10.222.0.60 () {60 vars in 1197 bytes} [Tue Oct 18 15:24:25 2022] POST /compute/v2.1/flavors/983743560/action => generated 133 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:24:25.380612 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3e0d7977-2238-49f8-bcfd-8dfa4e035cf4 tempest-FlavorsAccessNegativeTestJSON-573528365 tempest-FlavorsAccessNegativeTestJSON-573528365-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "aaa4d0dcf9bf45e19b9aa53cc92ddc5e"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:24:25.926015 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3e0d7977-2238-49f8-bcfd-8dfa4e035cf4 tempest-FlavorsAccessNegativeTestJSON-573528365 tempest-FlavorsAccessNegativeTestJSON-573528365-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/983743560/action" status: 200 len: 21 microversion: 2.1 time: 0.553625 Oct 18 15:24:25.928151 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 29/48] 10.222.0.60 () {60 vars in 1197 bytes} [Tue Oct 18 15:24:25 2022] POST /compute/v2.1/flavors/983743560/action => generated 21 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:24:25.946642 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-539d084a-6774-4398-b7e9-c12b46c84c81 tempest-FlavorsAccessNegativeTestJSON-573528365 tempest-FlavorsAccessNegativeTestJSON-573528365-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:26.010617 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-539d084a-6774-4398-b7e9-c12b46c84c81 tempest-FlavorsAccessNegativeTestJSON-573528365 tempest-FlavorsAccessNegativeTestJSON-573528365-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/983743560" status: 202 len: 0 microversion: 2.1 time: 0.072208 Oct 18 15:24:26.016851 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 30/49] 10.222.0.60 () {58 vars in 1158 bytes} [Tue Oct 18 15:24:25 2022] DELETE /compute/v2.1/flavors/983743560 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:24:26.030869 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-777c29d6-10da-47ce-8800-927e8ad94281 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:26.031758 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-777c29d6-10da-47ce-8800-927e8ad94281 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] [instance: 3f5d6640-30f6-490b-984f-d1169918133f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:24:26.061856 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-777c29d6-10da-47ce-8800-927e8ad94281 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:26.064212 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-777c29d6-10da-47ce-8800-927e8ad94281 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:26.065754 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-777c29d6-10da-47ce-8800-927e8ad94281 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:26.067153 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-777c29d6-10da-47ce-8800-927e8ad94281 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:26.073572 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-777c29d6-10da-47ce-8800-927e8ad94281 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:26.077095 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-777c29d6-10da-47ce-8800-927e8ad94281 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:26.169773 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fc0e50ac-8309-428d-bd09-4ecac3aeed6f tempest-AZAdminNegativeTestJSON-1984474543 tempest-AZAdminNegativeTestJSON-1984474543-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:26.169773 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-fc0e50ac-8309-428d-bd09-4ecac3aeed6f tempest-AZAdminNegativeTestJSON-1984474543 tempest-AZAdminNegativeTestJSON-1984474543-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '037c47b09c2a4301afd3277ab30564b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91458db09db9454ea4f4e96fd480b081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:24:26.171638 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fc0e50ac-8309-428d-bd09-4ecac3aeed6f tempest-AZAdminNegativeTestJSON-1984474543 tempest-AZAdminNegativeTestJSON-1984474543-project] Request method failure captured: Oct 18 15:24:26.171638 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 18 15:24:26.171638 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:24:26.171638 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:24:26.171638 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:24:26.171638 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:24:26.171638 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:24:26.171638 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:24:26.171638 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:24:26.171638 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:24:26.171638 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsUnrTuPwIsVjJHi-S2_x9iOLwUHsrZZZJYg10_X8FcX6W6Wbfy8fjxLC_vHcv78oIsIVOUZJBv8aOoOViyBqo66jcn9-28Z0Uc4JTpUxt9-zAVbxHR3H1axGzj7Fx8QKVVEMWLaFJ7FqPnhsczNQtDHBKYAeaJRFXcjd6z3NV38zNM Oct 18 15:24:26.171638 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:24:26.171638 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:24:26.171638 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:24:26.171638 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:24:26.171638 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:24:26.171638 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:24:26.171638 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 91458db09db9454ea4f4e96fd480b081 Oct 18 15:24:26.171638 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1984474543 Oct 18 15:24:26.171638 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:24:26.171638 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:24:26.172761 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/91458db09db9454ea4f4e96fd480b081"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/91458db09db9454ea4f4e96fd480b081"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/91458db09db9454ea4f4e96fd480b081"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_91458db09db9454ea4f4e96fd480b081"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:24:26.172761 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-AZAdminNegativeTestJSON-1984474543 Oct 18 15:24:26.172761 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 91458db09db9454ea4f4e96fd480b081 Oct 18 15:24:26.172761 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1984474543 Oct 18 15:24:26.172761 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-AZAdminNegativeTestJSON-1984474543-project Oct 18 15:24:26.172761 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:24:26.172761 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:24:26.172761 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 037c47b09c2a4301afd3277ab30564b8 Oct 18 15:24:26.172761 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-AZAdminNegativeTestJSON-1984474543-project Oct 18 15:24:26.172761 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:24:26.172761 n-d-853682-5 devstack@n-api.service[120405]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 18 15:24:26.172761 n-d-853682-5 devstack@n-api.service[120405]: action_args: {} Oct 18 15:24:26.173415 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:24:26.173415 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:26.173415 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:26.173415 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:26.173415 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:24:26.173415 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:24:26.173415 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:24:26.173415 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:24:26.173415 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 18 15:24:26.173415 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 18 15:24:26.173415 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 15:24:26.173415 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 15:24:26.173415 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 15:24:26.173415 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 15:24:26.173415 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 15:24:26.173415 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 15:24:26.173415 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 15:24:26.173415 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 15:24:26.173415 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 15:24:26.175563 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 15:24:26.175563 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 15:24:26.175563 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 15:24:26.175563 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 15:24:26.175563 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 15:24:26.175563 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 18 15:24:26.175563 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:24:26.175563 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:26.175563 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:24:26.175563 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:26.175563 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:26.175563 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:26.175563 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 15:24:26.175563 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 15:24:26.175563 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 18 15:24:26.175563 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:24:26.175563 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fc0e50ac-8309-428d-bd09-4ecac3aeed6f tempest-AZAdminNegativeTestJSON-1984474543 tempest-AZAdminNegativeTestJSON-1984474543-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:24:26.176641 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fc0e50ac-8309-428d-bd09-4ecac3aeed6f tempest-AZAdminNegativeTestJSON-1984474543 tempest-AZAdminNegativeTestJSON-1984474543-project] 10.222.0.60 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.531946 Oct 18 15:24:26.177418 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 20/50] 10.222.0.60 () {58 vars in 1185 bytes} [Tue Oct 18 15:24:25 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 537 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:24:26.184575 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4ffefd45-e913-4b4b-a50d-ebc5e09d9517 tempest-FlavorsAccessNegativeTestJSON-573528365 tempest-FlavorsAccessNegativeTestJSON-573528365-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:26.254866 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4ffefd45-e913-4b4b-a50d-ebc5e09d9517 tempest-FlavorsAccessNegativeTestJSON-573528365 tempest-FlavorsAccessNegativeTestJSON-573528365-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.076299 Oct 18 15:24:26.255459 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 21/51] 10.222.0.60 () {58 vars in 1146 bytes} [Tue Oct 18 15:24:26 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:26.278362 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-306d9d5f-f2c5-4d2f-b6bf-02a04c5f9d05 tempest-FlavorsAccessNegativeTestJSON-573528365 tempest-FlavorsAccessNegativeTestJSON-573528365-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1561918016", "id": 763753453, "os-flavor-access:is_public": "False"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:24:26.321855 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-306d9d5f-f2c5-4d2f-b6bf-02a04c5f9d05 tempest-FlavorsAccessNegativeTestJSON-573528365 tempest-FlavorsAccessNegativeTestJSON-573528365-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.042304 Oct 18 15:24:26.333253 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 22/52] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:24:26 2022] POST /compute/v2.1/flavors => generated 436 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:24:26.342959 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5f37ea44-697a-421a-af3b-1351e5a67e24 tempest-FlavorsAccessNegativeTestJSON-573528365 tempest-FlavorsAccessNegativeTestJSON-573528365-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "c00daf5e13c54c609ab4e52c29cd2556"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:24:26.393200 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-777c29d6-10da-47ce-8800-927e8ad94281 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72c1406934749cdaf643c4370dbd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e72a93e9d51401c991e34b7e0f62ed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:24:26.463154 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-777c29d6-10da-47ce-8800-927e8ad94281 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] 10.222.0.60 "GET /compute/v2.1/servers/3f5d6640-30f6-490b-984f-d1169918133f" status: 200 len: 1297 microversion: 2.1 time: 0.440812 Oct 18 15:24:26.478894 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 31/53] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:24:26 2022] GET /compute/v2.1/servers/3f5d6640-30f6-490b-984f-d1169918133f => generated 1297 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:26.934557 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:24:27.278045 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-5f37ea44-697a-421a-af3b-1351e5a67e24 tempest-FlavorsAccessNegativeTestJSON-573528365 tempest-FlavorsAccessNegativeTestJSON-573528365-project-admin] HTTP exception thrown: Flavor access not found for 21 / c00daf5e13c54c609ab4e52c29cd2556 combination. Oct 18 15:24:27.280802 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5f37ea44-697a-421a-af3b-1351e5a67e24 tempest-FlavorsAccessNegativeTestJSON-573528365 tempest-FlavorsAccessNegativeTestJSON-573528365-project-admin] Request method failure captured: Oct 18 15:24:27.280802 n-d-853682-5 devstack@n-api.service[120405]: request: POST /compute/v2.1/flavors/763753453/action HTTP/1.1 Oct 18 15:24:27.280802 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:24:27.280802 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:24:27.280802 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:24:27.280802 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 70 Oct 18 15:24:27.280802 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:24:27.280802 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:24:27.280802 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:24:27.280802 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:24:27.280802 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsUgaKiimoa7YME-1WhFHZik_e_7wwvmnTLxd9pQT7XTmQ3udem9yKH5pvo8IbU6nEr5RYQkUh6x8AWLPfbdV8nfP_EjDFDXVyaIyfM0zyIvC04RPZRFQ2QQQfi4-MJR0htgIsnDU55DAlOGSyj0dty-jZEG84F6OnXB93McgKKPLpo Oct 18 15:24:27.280802 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:24:27.280802 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:24:27.280802 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:24:27.280802 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:24:27.280802 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:24:27.280802 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:24:27.280802 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 8103c58c8f324716910695d1c047e07b Oct 18 15:24:27.280802 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-573528365 Oct 18 15:24:27.280802 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,admin,reader Oct 18 15:24:27.280802 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,admin,reader Oct 18 15:24:27.282121 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8103c58c8f324716910695d1c047e07b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8103c58c8f324716910695d1c047e07b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8103c58c8f324716910695d1c047e07b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8103c58c8f324716910695d1c047e07b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:24:27.282121 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-573528365 Oct 18 15:24:27.282121 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 8103c58c8f324716910695d1c047e07b Oct 18 15:24:27.282121 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-573528365 Oct 18 15:24:27.282121 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-FlavorsAccessNegativeTestJSON-573528365-project-admin Oct 18 15:24:27.282121 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:24:27.282121 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:24:27.282121 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 97d56a0c6142489182e6f2d07865e4af Oct 18 15:24:27.282121 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-573528365-project-admin Oct 18 15:24:27.282121 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:24:27.282121 n-d-853682-5 devstack@n-api.service[120405]: {"removeTenantAccess": {"tenant": "c00daf5e13c54c609ab4e52c29cd2556"}} Oct 18 15:24:27.282121 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:24:27.282738 n-d-853682-5 devstack@n-api.service[120405]: exception: Flavor access not found for 21 / c00daf5e13c54c609ab4e52c29cd2556 combination. Oct 18 15:24:27.282738 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '763753453', 'body': {'removeTenantAccess': {'tenant': 'c00daf5e13c54c609ab4e52c29cd2556'}}} Oct 18 15:24:27.282738 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:24:27.282738 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:27.282738 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 18 15:24:27.282738 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 18 15:24:27.282738 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 18 15:24:27.282738 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 18 15:24:27.282738 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 18 15:24:27.282738 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 18 15:24:27.282738 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 18 15:24:27.282738 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 18 15:24:27.282738 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 18 15:24:27.282738 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 18 15:24:27.282738 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 15:24:27.282738 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 15:24:27.282738 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 18 15:24:27.282738 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 18 15:24:27.283629 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 21 / c00daf5e13c54c609ab4e52c29cd2556 combination. Oct 18 15:24:27.283629 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:24:27.283629 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:27.283629 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:24:27.283629 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:27.283629 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:27.283629 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:27.283629 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:24:27.283629 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:24:27.283629 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:24:27.283629 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:24:27.283629 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:24:27.283629 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:24:27.283629 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 18 15:24:27.283629 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:24:27.283629 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 21 / c00daf5e13c54c609ab4e52c29cd2556 combination. Oct 18 15:24:27.283629 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:24:27.283629 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:27.283629 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:24:27.283629 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:27.285243 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:27.285243 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:27.285243 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:24:27.285243 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:24:27.285243 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 21 / c00daf5e13c54c609ab4e52c29cd2556 combination. Oct 18 15:24:27.285243 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:24:27.285243 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5f37ea44-697a-421a-af3b-1351e5a67e24 tempest-FlavorsAccessNegativeTestJSON-573528365 tempest-FlavorsAccessNegativeTestJSON-573528365-project-admin] Returning 404 to user: Flavor access not found for 21 / c00daf5e13c54c609ab4e52c29cd2556 combination. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:24:27.285243 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5f37ea44-697a-421a-af3b-1351e5a67e24 tempest-FlavorsAccessNegativeTestJSON-573528365 tempest-FlavorsAccessNegativeTestJSON-573528365-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/763753453/action" status: 404 len: 124 microversion: 2.1 time: 0.949564 Oct 18 15:24:27.286230 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 23/54] 10.222.0.60 () {60 vars in 1197 bytes} [Tue Oct 18 15:24:26 2022] POST /compute/v2.1/flavors/763753453/action => generated 124 bytes in 952 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:24:27.302131 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-67ea26de-b76e-4b87-83ee-dc6617bbc5bf tempest-FlavorsAccessNegativeTestJSON-573528365 tempest-FlavorsAccessNegativeTestJSON-573528365-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:27.340166 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-67ea26de-b76e-4b87-83ee-dc6617bbc5bf tempest-FlavorsAccessNegativeTestJSON-573528365 tempest-FlavorsAccessNegativeTestJSON-573528365-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/763753453" status: 202 len: 0 microversion: 2.1 time: 0.047393 Oct 18 15:24:27.360342 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 32/55] 10.222.0.60 () {58 vars in 1158 bytes} [Tue Oct 18 15:24:27 2022] DELETE /compute/v2.1/flavors/763753453 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:24:27.364608 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-22e64f27-bba7-4d0b-bf91-3d57d517eef1 tempest-FlavorsAccessNegativeTestJSON-573528365 tempest-FlavorsAccessNegativeTestJSON-573528365-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:27.433695 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-22e64f27-bba7-4d0b-bf91-3d57d517eef1 tempest-FlavorsAccessNegativeTestJSON-573528365 tempest-FlavorsAccessNegativeTestJSON-573528365-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.071703 Oct 18 15:24:27.434882 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 24/56] 10.222.0.60 () {58 vars in 1146 bytes} [Tue Oct 18 15:24:27 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:24:27.492514 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-59b9ca6d-286c-40ca-8539-2cf2189ca522 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:27.493751 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-59b9ca6d-286c-40ca-8539-2cf2189ca522 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] [instance: 3f5d6640-30f6-490b-984f-d1169918133f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:24:27.513661 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-59b9ca6d-286c-40ca-8539-2cf2189ca522 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:27.514595 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-59b9ca6d-286c-40ca-8539-2cf2189ca522 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:27.515034 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-59b9ca6d-286c-40ca-8539-2cf2189ca522 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:27.515758 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-59b9ca6d-286c-40ca-8539-2cf2189ca522 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:27.516286 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-59b9ca6d-286c-40ca-8539-2cf2189ca522 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:27.520452 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-59b9ca6d-286c-40ca-8539-2cf2189ca522 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:27.682657 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-59b9ca6d-286c-40ca-8539-2cf2189ca522 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72c1406934749cdaf643c4370dbd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e72a93e9d51401c991e34b7e0f62ed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:24:27.702387 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-59b9ca6d-286c-40ca-8539-2cf2189ca522 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] 10.222.0.60 "GET /compute/v2.1/servers/3f5d6640-30f6-490b-984f-d1169918133f" status: 200 len: 1297 microversion: 2.1 time: 0.216407 Oct 18 15:24:27.721862 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 33/57] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:24:27 2022] GET /compute/v2.1/servers/3f5d6640-30f6-490b-984f-d1169918133f => generated 1297 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:28.730811 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-13d0ae34-a4ce-4598-ae4b-fb5dcdd1f85b tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:28.731543 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-13d0ae34-a4ce-4598-ae4b-fb5dcdd1f85b tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] [instance: 3f5d6640-30f6-490b-984f-d1169918133f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:24:28.756137 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-13d0ae34-a4ce-4598-ae4b-fb5dcdd1f85b tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:28.756920 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-13d0ae34-a4ce-4598-ae4b-fb5dcdd1f85b tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:28.759938 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-13d0ae34-a4ce-4598-ae4b-fb5dcdd1f85b tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:28.762289 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-13d0ae34-a4ce-4598-ae4b-fb5dcdd1f85b tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:28.765267 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-13d0ae34-a4ce-4598-ae4b-fb5dcdd1f85b tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:28.766548 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-13d0ae34-a4ce-4598-ae4b-fb5dcdd1f85b tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:29.042640 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-13d0ae34-a4ce-4598-ae4b-fb5dcdd1f85b tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72c1406934749cdaf643c4370dbd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e72a93e9d51401c991e34b7e0f62ed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:24:29.062449 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-13d0ae34-a4ce-4598-ae4b-fb5dcdd1f85b tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] 10.222.0.60 "GET /compute/v2.1/servers/3f5d6640-30f6-490b-984f-d1169918133f" status: 200 len: 1297 microversion: 2.1 time: 0.334463 Oct 18 15:24:29.081640 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 25/58] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:24:28 2022] GET /compute/v2.1/servers/3f5d6640-30f6-490b-984f-d1169918133f => generated 1297 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:29.686035 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f31123e8-9370-438e-869d-9ffb86db249e tempest-FlavorsV261TestJSON-1257686849 tempest-FlavorsV261TestJSON-1257686849-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-615351997", "id": 150902345, "os-flavor-access:is_public": "True"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:24:29.748709 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f31123e8-9370-438e-869d-9ffb86db249e tempest-FlavorsV261TestJSON-1257686849 tempest-FlavorsV261TestJSON-1257686849-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 464 microversion: 2.61 time: 0.681545 Oct 18 15:24:29.749822 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 34/59] 10.222.0.60 () {62 vars in 1188 bytes} [Tue Oct 18 15:24:29 2022] POST /compute/v2.1/flavors => generated 464 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:24:30.093142 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-52e06083-ad16-4e83-8b0e-68ff4279e39a tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:30.094031 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-52e06083-ad16-4e83-8b0e-68ff4279e39a tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] [instance: 3f5d6640-30f6-490b-984f-d1169918133f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:24:30.109211 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52e06083-ad16-4e83-8b0e-68ff4279e39a tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:30.110181 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52e06083-ad16-4e83-8b0e-68ff4279e39a tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:30.110812 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52e06083-ad16-4e83-8b0e-68ff4279e39a tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:30.111898 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52e06083-ad16-4e83-8b0e-68ff4279e39a tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:30.112610 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52e06083-ad16-4e83-8b0e-68ff4279e39a tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:30.115690 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52e06083-ad16-4e83-8b0e-68ff4279e39a tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:30.236217 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0836999b-c65d-4fc4-9600-1669d22674b5 tempest-FlavorsV261TestJSON-1195363194 tempest-FlavorsV261TestJSON-1195363194-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:30.258937 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0836999b-c65d-4fc4-9600-1669d22674b5 tempest-FlavorsV261TestJSON-1195363194 tempest-FlavorsV261TestJSON-1195363194-project] 10.222.0.60 "GET /compute/v2.1/flavors/150902345" status: 200 len: 464 microversion: 2.61 time: 0.499081 Oct 18 15:24:30.262376 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 26/60] 10.222.0.60 () {60 vars in 1196 bytes} [Tue Oct 18 15:24:29 2022] GET /compute/v2.1/flavors/150902345 => generated 464 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:24:30.280082 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-94daffda-ad72-49d1-8efe-2e91bdaeaecf tempest-FlavorsV261TestJSON-1257686849 tempest-FlavorsV261TestJSON-1257686849-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:24:30.338428 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=8,nova_api:UPDATE=2,nova_api:DELETE=8 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:24:30.399001 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-94daffda-ad72-49d1-8efe-2e91bdaeaecf tempest-FlavorsV261TestJSON-1257686849 tempest-FlavorsV261TestJSON-1257686849-project-admin] 10.222.0.60 "PUT /compute/v2.1/flavors/150902345" status: 200 len: 465 microversion: 2.61 time: 0.125726 Oct 18 15:24:30.402709 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 27/61] 10.222.0.60 () {62 vars in 1216 bytes} [Tue Oct 18 15:24:30 2022] PUT /compute/v2.1/flavors/150902345 => generated 465 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:24:30.430549 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-79f6fea9-d945-4483-8355-27b7f84a2867 tempest-FlavorsV261TestJSON-1195363194 tempest-FlavorsV261TestJSON-1195363194-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:30.538449 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-79f6fea9-d945-4483-8355-27b7f84a2867 tempest-FlavorsV261TestJSON-1195363194 tempest-FlavorsV261TestJSON-1195363194-project] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 6246 microversion: 2.61 time: 0.123584 Oct 18 15:24:30.544543 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 28/62] 10.222.0.60 () {60 vars in 1187 bytes} [Tue Oct 18 15:24:30 2022] GET /compute/v2.1/flavors/detail => generated 6246 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:24:30.566815 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-22f9907b-2d01-4527-ab8e-8b5d7b2009fc tempest-FlavorsV261TestJSON-1195363194 tempest-FlavorsV261TestJSON-1195363194-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:30.655300 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-22f9907b-2d01-4527-ab8e-8b5d7b2009fc tempest-FlavorsV261TestJSON-1195363194 tempest-FlavorsV261TestJSON-1195363194-project] 10.222.0.60 "GET /compute/v2.1/flavors" status: 200 len: 3153 microversion: 2.61 time: 0.089444 Oct 18 15:24:30.655949 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 29/63] 10.222.0.60 () {60 vars in 1166 bytes} [Tue Oct 18 15:24:30 2022] GET /compute/v2.1/flavors => generated 3153 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:24:30.667955 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-52e06083-ad16-4e83-8b0e-68ff4279e39a tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72c1406934749cdaf643c4370dbd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e72a93e9d51401c991e34b7e0f62ed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:24:30.677570 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-162c8dcd-988a-4f29-8134-abaf46c2cd98 tempest-FlavorsV261TestJSON-1257686849 tempest-FlavorsV261TestJSON-1257686849-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:30.679927 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-52e06083-ad16-4e83-8b0e-68ff4279e39a tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] 10.222.0.60 "GET /compute/v2.1/servers/3f5d6640-30f6-490b-984f-d1169918133f" status: 200 len: 1339 microversion: 2.1 time: 0.588758 Oct 18 15:24:30.681597 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 35/64] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:24:30 2022] GET /compute/v2.1/servers/3f5d6640-30f6-490b-984f-d1169918133f => generated 1339 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:30.749611 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-162c8dcd-988a-4f29-8134-abaf46c2cd98 tempest-FlavorsV261TestJSON-1257686849 tempest-FlavorsV261TestJSON-1257686849-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/150902345" status: 202 len: 0 microversion: 2.61 time: 0.076654 Oct 18 15:24:30.754667 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 30/65] 10.222.0.60 () {60 vars in 1199 bytes} [Tue Oct 18 15:24:30 2022] DELETE /compute/v2.1/flavors/150902345 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:24:30.760235 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-650eb64b-d88a-4411-864c-771c4b37921b tempest-FlavorsV261TestJSON-1257686849 tempest-FlavorsV261TestJSON-1257686849-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:30.878298 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-650eb64b-d88a-4411-864c-771c4b37921b tempest-FlavorsV261TestJSON-1257686849 tempest-FlavorsV261TestJSON-1257686849-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.122396 Oct 18 15:24:30.899021 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 36/66] 10.222.0.60 () {60 vars in 1187 bytes} [Tue Oct 18 15:24:30 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:24:31.709893 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-74f687cc-d6b9-4a7b-8252-e939bc32ecff tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:31.711220 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-74f687cc-d6b9-4a7b-8252-e939bc32ecff tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] [instance: 3f5d6640-30f6-490b-984f-d1169918133f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:24:31.728874 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-74f687cc-d6b9-4a7b-8252-e939bc32ecff tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:31.731127 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-74f687cc-d6b9-4a7b-8252-e939bc32ecff tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:31.732904 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-74f687cc-d6b9-4a7b-8252-e939bc32ecff tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:31.740717 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-74f687cc-d6b9-4a7b-8252-e939bc32ecff tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:31.741543 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-74f687cc-d6b9-4a7b-8252-e939bc32ecff tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:31.742829 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-74f687cc-d6b9-4a7b-8252-e939bc32ecff tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:32.129136 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-74f687cc-d6b9-4a7b-8252-e939bc32ecff tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72c1406934749cdaf643c4370dbd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e72a93e9d51401c991e34b7e0f62ed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:24:32.144938 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-74f687cc-d6b9-4a7b-8252-e939bc32ecff tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] 10.222.0.60 "GET /compute/v2.1/servers/3f5d6640-30f6-490b-984f-d1169918133f" status: 200 len: 1339 microversion: 2.1 time: 0.439715 Oct 18 15:24:32.153854 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 31/67] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:24:31 2022] GET /compute/v2.1/servers/3f5d6640-30f6-490b-984f-d1169918133f => generated 1339 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:33.175926 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-716f2847-ec8f-4b05-b801-0bd721f325b8 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:33.176877 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-716f2847-ec8f-4b05-b801-0bd721f325b8 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] [instance: 3f5d6640-30f6-490b-984f-d1169918133f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:24:33.182384 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=8 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:24:33.185157 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:24:33.207312 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-716f2847-ec8f-4b05-b801-0bd721f325b8 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:33.214797 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-716f2847-ec8f-4b05-b801-0bd721f325b8 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:33.216064 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-716f2847-ec8f-4b05-b801-0bd721f325b8 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:33.219060 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-716f2847-ec8f-4b05-b801-0bd721f325b8 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:33.221506 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-716f2847-ec8f-4b05-b801-0bd721f325b8 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:33.223796 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-716f2847-ec8f-4b05-b801-0bd721f325b8 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:33.651490 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-716f2847-ec8f-4b05-b801-0bd721f325b8 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72c1406934749cdaf643c4370dbd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e72a93e9d51401c991e34b7e0f62ed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:24:33.693186 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-716f2847-ec8f-4b05-b801-0bd721f325b8 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] 10.222.0.60 "GET /compute/v2.1/servers/3f5d6640-30f6-490b-984f-d1169918133f" status: 200 len: 1339 microversion: 2.1 time: 0.517966 Oct 18 15:24:33.694704 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 37/68] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:24:33 2022] GET /compute/v2.1/servers/3f5d6640-30f6-490b-984f-d1169918133f => generated 1339 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:34.716034 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:24:34.721690 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2eb7f12b-e9bc-4df0-a248-3f4ca8cd34a2 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:34.722314 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2eb7f12b-e9bc-4df0-a248-3f4ca8cd34a2 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] [instance: 3f5d6640-30f6-490b-984f-d1169918133f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:24:34.739783 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2eb7f12b-e9bc-4df0-a248-3f4ca8cd34a2 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:34.740378 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2eb7f12b-e9bc-4df0-a248-3f4ca8cd34a2 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:34.744385 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2eb7f12b-e9bc-4df0-a248-3f4ca8cd34a2 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:34.745473 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2eb7f12b-e9bc-4df0-a248-3f4ca8cd34a2 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:34.746114 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2eb7f12b-e9bc-4df0-a248-3f4ca8cd34a2 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:34.760250 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2eb7f12b-e9bc-4df0-a248-3f4ca8cd34a2 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:35.160237 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2eb7f12b-e9bc-4df0-a248-3f4ca8cd34a2 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72c1406934749cdaf643c4370dbd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e72a93e9d51401c991e34b7e0f62ed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:24:35.182159 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2eb7f12b-e9bc-4df0-a248-3f4ca8cd34a2 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] 10.222.0.60 "GET /compute/v2.1/servers/3f5d6640-30f6-490b-984f-d1169918133f" status: 200 len: 1339 microversion: 2.1 time: 0.466699 Oct 18 15:24:35.196667 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 32/69] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:24:34 2022] GET /compute/v2.1/servers/3f5d6640-30f6-490b-984f-d1169918133f => generated 1339 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:36.222247 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-71a9046d-700c-41b6-9deb-e53824be19aa tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:36.229669 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-71a9046d-700c-41b6-9deb-e53824be19aa tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] [instance: 3f5d6640-30f6-490b-984f-d1169918133f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:24:36.273200 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-8ce07c96-8a4c-422e-bbb4-465edeb65701 req-86d7345e-62e0-46c8-97a6-6f067eea6677 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f5d6640-30f6-490b-984f-d1169918133f", "tag": "50f1c833-7623-4007-aa9f-c33e88ab237f"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:24:36.296040 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-71a9046d-700c-41b6-9deb-e53824be19aa tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:36.297465 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-71a9046d-700c-41b6-9deb-e53824be19aa tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:36.303392 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-71a9046d-700c-41b6-9deb-e53824be19aa tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:36.310350 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-71a9046d-700c-41b6-9deb-e53824be19aa tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:36.311173 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-71a9046d-700c-41b6-9deb-e53824be19aa tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:36.312076 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-71a9046d-700c-41b6-9deb-e53824be19aa tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:36.344622 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8ce07c96-8a4c-422e-bbb4-465edeb65701 req-86d7345e-62e0-46c8-97a6-6f067eea6677 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:36.350787 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8ce07c96-8a4c-422e-bbb4-465edeb65701 req-86d7345e-62e0-46c8-97a6-6f067eea6677 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:36.351882 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8ce07c96-8a4c-422e-bbb4-465edeb65701 req-86d7345e-62e0-46c8-97a6-6f067eea6677 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:36.422195 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-8ce07c96-8a4c-422e-bbb4-465edeb65701 req-86d7345e-62e0-46c8-97a6-6f067eea6677 service nova] Creating event network-changed:50f1c833-7623-4007-aa9f-c33e88ab237f for instance 3f5d6640-30f6-490b-984f-d1169918133f on n-h2-853682-5 Oct 18 15:24:36.423281 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8ce07c96-8a4c-422e-bbb4-465edeb65701 req-86d7345e-62e0-46c8-97a6-6f067eea6677 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120406) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 18 15:24:36.423744 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8ce07c96-8a4c-422e-bbb4-465edeb65701 req-86d7345e-62e0-46c8-97a6-6f067eea6677 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120406) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 18 15:24:36.424926 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3f06c3f9-00af-4ede-a136-d963c89c4fd5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:36.425556 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3f06c3f9-00af-4ede-a136-d963c89c4fd5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:36.425988 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3f06c3f9-00af-4ede-a136-d963c89c4fd5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:36.427639 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3f06c3f9-00af-4ede-a136-d963c89c4fd5 None None] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:36.428465 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3f06c3f9-00af-4ede-a136-d963c89c4fd5 None None] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:36.429146 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3f06c3f9-00af-4ede-a136-d963c89c4fd5 None None] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:36.442246 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.compute.rpcapi [None req-3f06c3f9-00af-4ede-a136-d963c89c4fd5 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 18 15:24:36.444311 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3f06c3f9-00af-4ede-a136-d963c89c4fd5 None None] Releasing lock "compute-rpcapi-router" {{(pid=120406) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 18 15:24:36.466848 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3f06c3f9-00af-4ede-a136-d963c89c4fd5 None None] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.721801 Oct 18 15:24:36.468047 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 38/70] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:24:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:24:36.573765 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-71a9046d-700c-41b6-9deb-e53824be19aa tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72c1406934749cdaf643c4370dbd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e72a93e9d51401c991e34b7e0f62ed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:24:36.585328 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-71a9046d-700c-41b6-9deb-e53824be19aa tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] 10.222.0.60 "GET /compute/v2.1/servers/3f5d6640-30f6-490b-984f-d1169918133f" status: 200 len: 1339 microversion: 2.1 time: 0.373188 Oct 18 15:24:36.586975 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 33/71] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:24:36 2022] GET /compute/v2.1/servers/3f5d6640-30f6-490b-984f-d1169918133f => generated 1339 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:37.358225 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f9178d97-85d8-4b3e-965d-06be062e83e7 tempest-HypervisorAdminNegativeTestJSON-1229831714 tempest-HypervisorAdminNegativeTestJSON-1229831714-project] Calling method '.version_select at 0x7f7c3e1358b0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:37.365579 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f9178d97-85d8-4b3e-965d-06be062e83e7 tempest-HypervisorAdminNegativeTestJSON-1229831714 tempest-HypervisorAdminNegativeTestJSON-1229831714-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'c075992fc21b4a799cd28ee40a7bd1e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c546c651e6474a81c313ad21685fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:24:37.367777 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f9178d97-85d8-4b3e-965d-06be062e83e7 tempest-HypervisorAdminNegativeTestJSON-1229831714 tempest-HypervisorAdminNegativeTestJSON-1229831714-project] Request method failure captured: Oct 18 15:24:37.367777 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 18 15:24:37.367777 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:24:37.367777 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:24:37.367777 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:24:37.367777 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:24:37.367777 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:24:37.367777 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:24:37.367777 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:24:37.367777 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:24:37.367777 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsUxIEVB8dLTVPpZBYV1BEFNli-fkgMueK5_tG5BgvyVkJ_iYRmZXpIwnEqgriqUweeRcoAenlGLUscoE0vsNtCvIFovXutsuKQ0qTt4My1QpwD9rGX4c5NJngRBBpGx__DLqVkYuxslaGzkgYRGiW9aQFdesYbZtES4SBEHKC46v7o Oct 18 15:24:37.367777 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:24:37.367777 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:24:37.367777 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:24:37.367777 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:24:37.367777 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:24:37.367777 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:24:37.367777 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 29c546c651e6474a81c313ad21685fff Oct 18 15:24:37.367777 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1229831714 Oct 18 15:24:37.367777 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:24:37.367777 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:24:37.369251 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/29c546c651e6474a81c313ad21685fff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/29c546c651e6474a81c313ad21685fff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/29c546c651e6474a81c313ad21685fff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_29c546c651e6474a81c313ad21685fff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:24:37.369251 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1229831714 Oct 18 15:24:37.369251 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 29c546c651e6474a81c313ad21685fff Oct 18 15:24:37.369251 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1229831714 Oct 18 15:24:37.369251 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-HypervisorAdminNegativeTestJSON-1229831714-project Oct 18 15:24:37.369251 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:24:37.369251 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:24:37.369251 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: c075992fc21b4a799cd28ee40a7bd1e1 Oct 18 15:24:37.369251 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1229831714-project Oct 18 15:24:37.369251 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:24:37.369251 n-d-853682-5 devstack@n-api.service[120406]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 18 15:24:37.369251 n-d-853682-5 devstack@n-api.service[120406]: action_args: {} Oct 18 15:24:37.369251 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:24:37.369973 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:37.369973 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:37.369973 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:37.369973 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:24:37.369973 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:24:37.369973 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:24:37.369973 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:24:37.369973 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:24:37.369973 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:24:37.369973 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 18 15:24:37.369973 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 18 15:24:37.369973 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 18 15:24:37.369973 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 18 15:24:37.369973 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 15:24:37.369973 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 15:24:37.369973 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 15:24:37.369973 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 15:24:37.369973 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 15:24:37.369973 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 15:24:37.371188 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 15:24:37.371188 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 15:24:37.371188 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 15:24:37.371188 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 15:24:37.371188 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 15:24:37.371188 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 15:24:37.371188 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 15:24:37.371188 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 15:24:37.371188 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 18 15:24:37.371188 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:37.371188 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:37.371188 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:37.371188 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:37.371188 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:37.371188 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:37.371188 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 15:24:37.371188 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 15:24:37.371188 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 18 15:24:37.371188 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:37.372377 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f9178d97-85d8-4b3e-965d-06be062e83e7 tempest-HypervisorAdminNegativeTestJSON-1229831714 tempest-HypervisorAdminNegativeTestJSON-1229831714-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:24:37.374149 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f9178d97-85d8-4b3e-965d-06be062e83e7 tempest-HypervisorAdminNegativeTestJSON-1229831714 tempest-HypervisorAdminNegativeTestJSON-1229831714-project] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.672023 Oct 18 15:24:37.374752 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 39/72] 10.222.0.60 () {58 vars in 1167 bytes} [Tue Oct 18 15:24:36 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 678 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:24:37.396355 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d99afb6f-59c9-45b8-81a1-5ebb8bd5702e tempest-HypervisorAdminNegativeTestJSON-1229831714 tempest-HypervisorAdminNegativeTestJSON-1229831714-project] Calling method '.version_select at 0x7f7c3e2e0160>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:37.398335 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d99afb6f-59c9-45b8-81a1-5ebb8bd5702e tempest-HypervisorAdminNegativeTestJSON-1229831714 tempest-HypervisorAdminNegativeTestJSON-1229831714-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'c075992fc21b4a799cd28ee40a7bd1e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c546c651e6474a81c313ad21685fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:24:37.410156 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d99afb6f-59c9-45b8-81a1-5ebb8bd5702e tempest-HypervisorAdminNegativeTestJSON-1229831714 tempest-HypervisorAdminNegativeTestJSON-1229831714-project] Request method failure captured: Oct 18 15:24:37.410156 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 18 15:24:37.410156 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:24:37.410156 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:24:37.410156 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:24:37.410156 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:24:37.410156 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:24:37.410156 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:24:37.410156 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:24:37.410156 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:24:37.410156 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsUxIEVB8dLTVPpZBYV1BEFNli-fkgMueK5_tG5BgvyVkJ_iYRmZXpIwnEqgriqUweeRcoAenlGLUscoE0vsNtCvIFovXutsuKQ0qTt4My1QpwD9rGX4c5NJngRBBpGx__DLqVkYuxslaGzkgYRGiW9aQFdesYbZtES4SBEHKC46v7o Oct 18 15:24:37.410156 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:24:37.410156 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:24:37.410156 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:24:37.410156 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:24:37.410156 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:24:37.410156 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:24:37.410156 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 29c546c651e6474a81c313ad21685fff Oct 18 15:24:37.410156 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1229831714 Oct 18 15:24:37.410156 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:24:37.410156 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:24:37.411779 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/29c546c651e6474a81c313ad21685fff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/29c546c651e6474a81c313ad21685fff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/29c546c651e6474a81c313ad21685fff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_29c546c651e6474a81c313ad21685fff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:24:37.411779 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1229831714 Oct 18 15:24:37.411779 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 29c546c651e6474a81c313ad21685fff Oct 18 15:24:37.411779 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1229831714 Oct 18 15:24:37.411779 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-HypervisorAdminNegativeTestJSON-1229831714-project Oct 18 15:24:37.411779 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:24:37.411779 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:24:37.411779 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: c075992fc21b4a799cd28ee40a7bd1e1 Oct 18 15:24:37.411779 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1229831714-project Oct 18 15:24:37.411779 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:24:37.411779 n-d-853682-5 devstack@n-api.service[120406]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 18 15:24:37.411779 n-d-853682-5 devstack@n-api.service[120406]: action_args: {} Oct 18 15:24:37.411779 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:24:37.412471 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:37.412471 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:37.412471 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:37.412471 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:24:37.412471 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:24:37.412471 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:24:37.412471 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:24:37.412471 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:24:37.412471 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:24:37.412471 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 18 15:24:37.412471 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 18 15:24:37.412471 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 18 15:24:37.412471 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 18 15:24:37.412471 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 15:24:37.412471 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 15:24:37.412471 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 15:24:37.412471 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 15:24:37.412471 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 15:24:37.412471 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 15:24:37.413620 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 15:24:37.413620 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 15:24:37.413620 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 15:24:37.413620 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 15:24:37.413620 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 15:24:37.413620 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 15:24:37.413620 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 15:24:37.413620 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 15:24:37.413620 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 18 15:24:37.413620 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:37.413620 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:37.413620 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:37.413620 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:37.413620 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:37.413620 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:37.413620 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 15:24:37.413620 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 15:24:37.413620 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 18 15:24:37.413620 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:37.416207 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d99afb6f-59c9-45b8-81a1-5ebb8bd5702e tempest-HypervisorAdminNegativeTestJSON-1229831714 tempest-HypervisorAdminNegativeTestJSON-1229831714-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:24:37.416207 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d99afb6f-59c9-45b8-81a1-5ebb8bd5702e tempest-HypervisorAdminNegativeTestJSON-1229831714 tempest-HypervisorAdminNegativeTestJSON-1229831714-project] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.028302 Oct 18 15:24:37.421052 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 40/73] 10.222.0.60 () {58 vars in 1146 bytes} [Tue Oct 18 15:24:37 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 41 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 18 15:24:37.437234 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f28fdaf2-9469-42cf-bb8c-5a6d54f14c8a tempest-HypervisorAdminNegativeTestJSON-1229831714 tempest-HypervisorAdminNegativeTestJSON-1229831714-project] Calling method '.version_select at 0x7f7c3e242430>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:37.441762 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f28fdaf2-9469-42cf-bb8c-5a6d54f14c8a tempest-HypervisorAdminNegativeTestJSON-1229831714 tempest-HypervisorAdminNegativeTestJSON-1229831714-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'c075992fc21b4a799cd28ee40a7bd1e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c546c651e6474a81c313ad21685fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:24:37.443340 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f28fdaf2-9469-42cf-bb8c-5a6d54f14c8a tempest-HypervisorAdminNegativeTestJSON-1229831714 tempest-HypervisorAdminNegativeTestJSON-1229831714-project] Request method failure captured: Oct 18 15:24:37.443340 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 18 15:24:37.443340 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:24:37.443340 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:24:37.443340 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:24:37.443340 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:24:37.443340 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:24:37.443340 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:24:37.443340 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:24:37.443340 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:24:37.443340 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsUxIEVB8dLTVPpZBYV1BEFNli-fkgMueK5_tG5BgvyVkJ_iYRmZXpIwnEqgriqUweeRcoAenlGLUscoE0vsNtCvIFovXutsuKQ0qTt4My1QpwD9rGX4c5NJngRBBpGx__DLqVkYuxslaGzkgYRGiW9aQFdesYbZtES4SBEHKC46v7o Oct 18 15:24:37.443340 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:24:37.443340 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:24:37.443340 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:24:37.443340 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:24:37.443340 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:24:37.443340 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:24:37.443340 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 29c546c651e6474a81c313ad21685fff Oct 18 15:24:37.443340 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1229831714 Oct 18 15:24:37.443340 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:24:37.443340 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:24:37.444573 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/29c546c651e6474a81c313ad21685fff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/29c546c651e6474a81c313ad21685fff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/29c546c651e6474a81c313ad21685fff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_29c546c651e6474a81c313ad21685fff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:24:37.444573 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1229831714 Oct 18 15:24:37.444573 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 29c546c651e6474a81c313ad21685fff Oct 18 15:24:37.444573 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1229831714 Oct 18 15:24:37.444573 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-HypervisorAdminNegativeTestJSON-1229831714-project Oct 18 15:24:37.444573 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:24:37.444573 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:24:37.444573 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: c075992fc21b4a799cd28ee40a7bd1e1 Oct 18 15:24:37.444573 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1229831714-project Oct 18 15:24:37.444573 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:24:37.444573 n-d-853682-5 devstack@n-api.service[120406]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 18 15:24:37.444573 n-d-853682-5 devstack@n-api.service[120406]: action_args: {} Oct 18 15:24:37.444573 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:24:37.445436 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:37.445436 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:37.445436 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:37.445436 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:24:37.445436 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:24:37.445436 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:24:37.445436 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:24:37.445436 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:24:37.445436 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:24:37.445436 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 18 15:24:37.445436 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 18 15:24:37.445436 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 15:24:37.445436 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 15:24:37.445436 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 15:24:37.445436 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 15:24:37.445436 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 15:24:37.445436 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 15:24:37.445436 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 15:24:37.445436 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 15:24:37.446473 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 15:24:37.446473 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 15:24:37.446473 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 15:24:37.446473 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 15:24:37.446473 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 15:24:37.446473 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 15:24:37.446473 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 18 15:24:37.446473 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:37.446473 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:37.446473 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:37.446473 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:37.446473 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:37.446473 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:37.446473 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 15:24:37.446473 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 15:24:37.446473 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 18 15:24:37.446473 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:37.447353 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f28fdaf2-9469-42cf-bb8c-5a6d54f14c8a tempest-HypervisorAdminNegativeTestJSON-1229831714 tempest-HypervisorAdminNegativeTestJSON-1229831714-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:24:37.447353 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f28fdaf2-9469-42cf-bb8c-5a6d54f14c8a tempest-HypervisorAdminNegativeTestJSON-1229831714 tempest-HypervisorAdminNegativeTestJSON-1229831714-project] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.022627 Oct 18 15:24:37.454092 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 41/74] 10.222.0.60 () {58 vars in 1179 bytes} [Tue Oct 18 15:24:37 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:24:37.855240 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-75c09965-3f4e-4e1d-9c61-64014c513a85 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1011953454", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "010df557-27fc-4c93-a23e-d2c3321314f6"}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:24:38.026793 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-75c09965-3f4e-4e1d-9c61-64014c513a85 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] validate_networks() for [('010df557-27fc-4c93-a23e-d2c3321314f6', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:24:38.160663 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-58bf104e-51b4-437c-a79b-72bbb3047a5e tempest-HypervisorAdminNegativeTestJSON-974858240 tempest-HypervisorAdminNegativeTestJSON-974858240-project-admin] Calling method '.version_select at 0x7f7c3e0f0670>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:38.163970 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58bf104e-51b4-437c-a79b-72bbb3047a5e tempest-HypervisorAdminNegativeTestJSON-974858240 tempest-HypervisorAdminNegativeTestJSON-974858240-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:38.164594 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58bf104e-51b4-437c-a79b-72bbb3047a5e tempest-HypervisorAdminNegativeTestJSON-974858240 tempest-HypervisorAdminNegativeTestJSON-974858240-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:38.169047 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58bf104e-51b4-437c-a79b-72bbb3047a5e tempest-HypervisorAdminNegativeTestJSON-974858240 tempest-HypervisorAdminNegativeTestJSON-974858240-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:38.200354 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58bf104e-51b4-437c-a79b-72bbb3047a5e tempest-HypervisorAdminNegativeTestJSON-974858240 tempest-HypervisorAdminNegativeTestJSON-974858240-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:38.200861 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58bf104e-51b4-437c-a79b-72bbb3047a5e tempest-HypervisorAdminNegativeTestJSON-974858240 tempest-HypervisorAdminNegativeTestJSON-974858240-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:38.201302 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58bf104e-51b4-437c-a79b-72bbb3047a5e tempest-HypervisorAdminNegativeTestJSON-974858240 tempest-HypervisorAdminNegativeTestJSON-974858240-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:38.217792 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58bf104e-51b4-437c-a79b-72bbb3047a5e tempest-HypervisorAdminNegativeTestJSON-974858240 tempest-HypervisorAdminNegativeTestJSON-974858240-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:38.218894 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58bf104e-51b4-437c-a79b-72bbb3047a5e tempest-HypervisorAdminNegativeTestJSON-974858240 tempest-HypervisorAdminNegativeTestJSON-974858240-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:38.220119 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58bf104e-51b4-437c-a79b-72bbb3047a5e tempest-HypervisorAdminNegativeTestJSON-974858240 tempest-HypervisorAdminNegativeTestJSON-974858240-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:38.228990 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-58bf104e-51b4-437c-a79b-72bbb3047a5e tempest-HypervisorAdminNegativeTestJSON-974858240 tempest-HypervisorAdminNegativeTestJSON-974858240-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.773758 Oct 18 15:24:38.229998 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 42/75] 10.222.0.60 () {58 vars in 1146 bytes} [Tue Oct 18 15:24:37 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:24:38.240382 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5e980b1b-e004-4174-bb8a-260b5197e3ad tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:38.242971 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5e980b1b-e004-4174-bb8a-260b5197e3ad tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] [instance: 3f5d6640-30f6-490b-984f-d1169918133f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:24:38.258677 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e980b1b-e004-4174-bb8a-260b5197e3ad tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:38.259270 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e980b1b-e004-4174-bb8a-260b5197e3ad tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:38.260074 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e980b1b-e004-4174-bb8a-260b5197e3ad tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:38.260984 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e980b1b-e004-4174-bb8a-260b5197e3ad tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:38.261781 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e980b1b-e004-4174-bb8a-260b5197e3ad tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:38.262351 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e980b1b-e004-4174-bb8a-260b5197e3ad tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:38.552498 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5e980b1b-e004-4174-bb8a-260b5197e3ad tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72c1406934749cdaf643c4370dbd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e72a93e9d51401c991e34b7e0f62ed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:24:38.561506 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5e980b1b-e004-4174-bb8a-260b5197e3ad tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] 10.222.0.60 "GET /compute/v2.1/servers/3f5d6640-30f6-490b-984f-d1169918133f" status: 200 len: 1339 microversion: 2.1 time: 0.330313 Oct 18 15:24:38.562520 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 43/76] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:24:38 2022] GET /compute/v2.1/servers/3f5d6640-30f6-490b-984f-d1169918133f => generated 1339 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:38.982921 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8f6aa146-85b0-40b0-b0eb-4b41c1ec9bdf tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1608244523", "id": 1978182542, "os-flavor-access:is_public": "True"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:24:39.012589 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8f6aa146-85b0-40b0-b0eb-4b41c1ec9bdf tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.448284 Oct 18 15:24:39.021899 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 44/77] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:24:38 2022] POST /compute/v2.1/flavors => generated 430 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:24:39.032355 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4aa5ed18-5df0-43e9-b9e0-448775a0607b tempest-HypervisorAdminNegativeTestJSON-1229831714 tempest-HypervisorAdminNegativeTestJSON-1229831714-project] Calling method '.version_select at 0x7f7c3e135940>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:39.034668 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4aa5ed18-5df0-43e9-b9e0-448775a0607b tempest-HypervisorAdminNegativeTestJSON-1229831714 tempest-HypervisorAdminNegativeTestJSON-1229831714-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'c075992fc21b4a799cd28ee40a7bd1e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c546c651e6474a81c313ad21685fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:24:39.040215 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4aa5ed18-5df0-43e9-b9e0-448775a0607b tempest-HypervisorAdminNegativeTestJSON-1229831714 tempest-HypervisorAdminNegativeTestJSON-1229831714-project] Request method failure captured: Oct 18 15:24:39.040215 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 18 15:24:39.040215 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:24:39.040215 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:24:39.040215 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:24:39.040215 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:24:39.040215 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:24:39.040215 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:24:39.040215 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:24:39.040215 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:24:39.040215 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsUxIEVB8dLTVPpZBYV1BEFNli-fkgMueK5_tG5BgvyVkJ_iYRmZXpIwnEqgriqUweeRcoAenlGLUscoE0vsNtCvIFovXutsuKQ0qTt4My1QpwD9rGX4c5NJngRBBpGx__DLqVkYuxslaGzkgYRGiW9aQFdesYbZtES4SBEHKC46v7o Oct 18 15:24:39.040215 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:24:39.040215 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:24:39.040215 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:24:39.040215 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:24:39.040215 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:24:39.040215 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:24:39.040215 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 29c546c651e6474a81c313ad21685fff Oct 18 15:24:39.040215 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1229831714 Oct 18 15:24:39.040215 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:24:39.040215 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:24:39.041797 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/29c546c651e6474a81c313ad21685fff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/29c546c651e6474a81c313ad21685fff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/29c546c651e6474a81c313ad21685fff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_29c546c651e6474a81c313ad21685fff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:24:39.041797 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1229831714 Oct 18 15:24:39.041797 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 29c546c651e6474a81c313ad21685fff Oct 18 15:24:39.041797 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1229831714 Oct 18 15:24:39.041797 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-HypervisorAdminNegativeTestJSON-1229831714-project Oct 18 15:24:39.041797 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:24:39.041797 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:24:39.041797 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: c075992fc21b4a799cd28ee40a7bd1e1 Oct 18 15:24:39.041797 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1229831714-project Oct 18 15:24:39.041797 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:24:39.041797 n-d-853682-5 devstack@n-api.service[120406]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 18 15:24:39.041797 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '1'} Oct 18 15:24:39.041797 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:24:39.042767 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:39.042767 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:39.042767 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:39.042767 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:24:39.042767 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:24:39.042767 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:24:39.042767 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:24:39.042767 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:24:39.042767 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:24:39.042767 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 18 15:24:39.042767 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 18 15:24:39.042767 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 15:24:39.042767 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 15:24:39.042767 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 15:24:39.042767 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 15:24:39.042767 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 15:24:39.042767 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 15:24:39.042767 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 15:24:39.042767 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 15:24:39.043999 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 15:24:39.043999 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 15:24:39.043999 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 15:24:39.043999 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 15:24:39.043999 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 15:24:39.043999 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 15:24:39.043999 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 18 15:24:39.043999 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:39.043999 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:39.043999 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:39.043999 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:39.043999 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:39.043999 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:39.043999 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 15:24:39.043999 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 15:24:39.043999 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 18 15:24:39.043999 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:39.047044 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4aa5ed18-5df0-43e9-b9e0-448775a0607b tempest-HypervisorAdminNegativeTestJSON-1229831714 tempest-HypervisorAdminNegativeTestJSON-1229831714-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:24:39.048716 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4aa5ed18-5df0-43e9-b9e0-448775a0607b tempest-HypervisorAdminNegativeTestJSON-1229831714 tempest-HypervisorAdminNegativeTestJSON-1229831714-project] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.025866 Oct 18 15:24:39.049360 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 45/78] 10.222.0.60 () {58 vars in 1173 bytes} [Tue Oct 18 15:24:39 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:24:39.056064 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-92f1a2d7-48b7-4e14-8b73-66f442002da5 tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:39.077589 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-92f1a2d7-48b7-4e14-8b73-66f442002da5 tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/1978182542" status: 202 len: 0 microversion: 2.1 time: 0.026926 Oct 18 15:24:39.082168 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 46/79] 10.222.0.60 () {58 vars in 1161 bytes} [Tue Oct 18 15:24:39 2022] DELETE /compute/v2.1/flavors/1978182542 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:24:39.088371 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6a2535e6-abd7-497e-b566-d960d883cdcf tempest-HypervisorAdminNegativeTestJSON-974858240 tempest-HypervisorAdminNegativeTestJSON-974858240-project-admin] Calling method '.version_select at 0x7f7c3e0f04c0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:39.090435 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-6a2535e6-abd7-497e-b566-d960d883cdcf tempest-HypervisorAdminNegativeTestJSON-974858240 tempest-HypervisorAdminNegativeTestJSON-974858240-project-admin] HTTP exception thrown: Hypervisor with ID '0f8b75fc-1a43-4e57-8f1f-7e958ac1feb8' could not be found. Oct 18 15:24:39.102505 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6a2535e6-abd7-497e-b566-d960d883cdcf tempest-HypervisorAdminNegativeTestJSON-974858240 tempest-HypervisorAdminNegativeTestJSON-974858240-project-admin] Request method failure captured: Oct 18 15:24:39.102505 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/os-hypervisors/0f8b75fc-1a43-4e57-8f1f-7e958ac1feb8/uptime HTTP/1.1 Oct 18 15:24:39.102505 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:24:39.102505 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:24:39.102505 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:24:39.102505 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:24:39.102505 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:24:39.102505 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:24:39.102505 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:24:39.102505 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:24:39.102505 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsU0N7T_NYnz0vmMFEAXlI848x8MjE5dlGbLmwI2GjUu2CX2lxb7zDakB0oS4t1ljCkfreJYEhd077PRVehPZEvK72ULW97V7-bL8c9pHqdxaW66B2fLXBTrT08dXADx3ldUwmz28G-B5DbMLfVGR0YWthJWKyTLCCeD-P3M3nhGQcU Oct 18 15:24:39.102505 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:24:39.102505 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:24:39.102505 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:24:39.102505 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:24:39.102505 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:24:39.102505 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:24:39.102505 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: fdde85a717794d36a7b1277ab59a493b Oct 18 15:24:39.102505 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-974858240 Oct 18 15:24:39.102505 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,admin,reader Oct 18 15:24:39.102505 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,admin,reader Oct 18 15:24:39.103974 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fdde85a717794d36a7b1277ab59a493b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fdde85a717794d36a7b1277ab59a493b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/fdde85a717794d36a7b1277ab59a493b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_fdde85a717794d36a7b1277ab59a493b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:24:39.103974 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-974858240 Oct 18 15:24:39.103974 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: fdde85a717794d36a7b1277ab59a493b Oct 18 15:24:39.103974 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-974858240 Oct 18 15:24:39.103974 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-HypervisorAdminNegativeTestJSON-974858240-project-admin Oct 18 15:24:39.103974 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:24:39.103974 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:24:39.103974 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: a75f8f81e6d14b67817449ea5f0d4a20 Oct 18 15:24:39.103974 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-974858240-project-admin Oct 18 15:24:39.103974 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:24:39.103974 n-d-853682-5 devstack@n-api.service[120406]: exception: Hypervisor with ID '0f8b75fc-1a43-4e57-8f1f-7e958ac1feb8' could not be found. Oct 18 15:24:39.103974 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '0f8b75fc-1a43-4e57-8f1f-7e958ac1feb8'} Oct 18 15:24:39.104790 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:24:39.104790 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:39.104790 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 18 15:24:39.104790 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 18 15:24:39.104790 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '0f8b75fc-1a43-4e57-8f1f-7e958ac1feb8' Oct 18 15:24:39.104790 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:39.104790 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:39.104790 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:39.104790 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:39.104790 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 18 15:24:39.104790 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 18 15:24:39.104790 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 18 15:24:39.104790 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 18 15:24:39.104790 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 18 15:24:39.104790 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:39.104790 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:39.104790 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:39.104790 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:39.104790 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 18 15:24:39.104790 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 18 15:24:39.104790 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 18 15:24:39.104790 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 18 15:24:39.106234 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 18 15:24:39.106234 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:39.106234 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:39.106234 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:39.106234 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:39.106234 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:39.106234 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:39.106234 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:24:39.106234 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:24:39.106234 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:24:39.106234 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:24:39.106234 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:24:39.106234 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:24:39.106234 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 18 15:24:39.106234 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 18 15:24:39.106234 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 18 15:24:39.106234 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 18 15:24:39.106234 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '0f8b75fc-1a43-4e57-8f1f-7e958ac1feb8' could not be found. Oct 18 15:24:39.106234 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:39.106234 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:39.106234 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:39.107570 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:39.107570 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:39.107570 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:39.107570 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:24:39.107570 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:24:39.107570 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '0f8b75fc-1a43-4e57-8f1f-7e958ac1feb8' could not be found. Oct 18 15:24:39.107570 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:39.112862 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6a2535e6-abd7-497e-b566-d960d883cdcf tempest-HypervisorAdminNegativeTestJSON-974858240 tempest-HypervisorAdminNegativeTestJSON-974858240-project-admin] Returning 404 to user: Hypervisor with ID '0f8b75fc-1a43-4e57-8f1f-7e958ac1feb8' could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:24:39.116456 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6a2535e6-abd7-497e-b566-d960d883cdcf tempest-HypervisorAdminNegativeTestJSON-974858240 tempest-HypervisorAdminNegativeTestJSON-974858240-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/0f8b75fc-1a43-4e57-8f1f-7e958ac1feb8/uptime" status: 404 len: 123 microversion: 2.1 time: 0.033224 Oct 18 15:24:39.118154 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 47/80] 10.222.0.60 () {58 vars in 1278 bytes} [Tue Oct 18 15:24:39 2022] GET /compute/v2.1/os-hypervisors/0f8b75fc-1a43-4e57-8f1f-7e958ac1feb8/uptime => generated 123 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:24:39.125113 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7386a6ba-0f42-408f-9656-1e614116e683 tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:39.156093 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7386a6ba-0f42-408f-9656-1e614116e683 tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036537 Oct 18 15:24:39.157288 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 48/81] 10.222.0.60 () {58 vars in 1146 bytes} [Tue Oct 18 15:24:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:39.182032 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e5fd0143-ff3b-4416-8404-0dfe39ba5d60 tempest-HypervisorAdminNegativeTestJSON-974858240 tempest-HypervisorAdminNegativeTestJSON-974858240-project-admin] Calling method '.version_select at 0x7f7c3ec050d0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:39.184265 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e5fd0143-ff3b-4416-8404-0dfe39ba5d60 tempest-HypervisorAdminNegativeTestJSON-974858240 tempest-HypervisorAdminNegativeTestJSON-974858240-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:39.185035 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e5fd0143-ff3b-4416-8404-0dfe39ba5d60 tempest-HypervisorAdminNegativeTestJSON-974858240 tempest-HypervisorAdminNegativeTestJSON-974858240-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:39.185690 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e5fd0143-ff3b-4416-8404-0dfe39ba5d60 tempest-HypervisorAdminNegativeTestJSON-974858240 tempest-HypervisorAdminNegativeTestJSON-974858240-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:39.202654 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-75c09965-3f4e-4e1d-9c61-64014c513a85 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:24:39.203155 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-75c09965-3f4e-4e1d-9c61-64014c513a85 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:24:39.203602 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-75c09965-3f4e-4e1d-9c61-64014c513a85 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:24:39.203981 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e5fd0143-ff3b-4416-8404-0dfe39ba5d60 tempest-HypervisorAdminNegativeTestJSON-974858240 tempest-HypervisorAdminNegativeTestJSON-974858240-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:39.204106 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-75c09965-3f4e-4e1d-9c61-64014c513a85 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:24:39.204454 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-75c09965-3f4e-4e1d-9c61-64014c513a85 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:24:39.205481 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e5fd0143-ff3b-4416-8404-0dfe39ba5d60 tempest-HypervisorAdminNegativeTestJSON-974858240 tempest-HypervisorAdminNegativeTestJSON-974858240-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:39.205925 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e5fd0143-ff3b-4416-8404-0dfe39ba5d60 tempest-HypervisorAdminNegativeTestJSON-974858240 tempest-HypervisorAdminNegativeTestJSON-974858240-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:39.226391 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e5fd0143-ff3b-4416-8404-0dfe39ba5d60 tempest-HypervisorAdminNegativeTestJSON-974858240 tempest-HypervisorAdminNegativeTestJSON-974858240-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:39.226832 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e5fd0143-ff3b-4416-8404-0dfe39ba5d60 tempest-HypervisorAdminNegativeTestJSON-974858240 tempest-HypervisorAdminNegativeTestJSON-974858240-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:39.227270 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e5fd0143-ff3b-4416-8404-0dfe39ba5d60 tempest-HypervisorAdminNegativeTestJSON-974858240 tempest-HypervisorAdminNegativeTestJSON-974858240-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:39.228786 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-75c09965-3f4e-4e1d-9c61-64014c513a85 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:39.229446 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-75c09965-3f4e-4e1d-9c61-64014c513a85 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:39.230152 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-75c09965-3f4e-4e1d-9c61-64014c513a85 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:39.233784 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e5fd0143-ff3b-4416-8404-0dfe39ba5d60 tempest-HypervisorAdminNegativeTestJSON-974858240 tempest-HypervisorAdminNegativeTestJSON-974858240-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.071105 Oct 18 15:24:39.234822 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 49/82] 10.222.0.60 () {58 vars in 1146 bytes} [Tue Oct 18 15:24:39 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:24:39.239760 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4923631d-d59b-4a61-8c8d-f3cebb56d1a6 tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1689218615", "id": 1176456672, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:24:39.244219 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-75c09965-3f4e-4e1d-9c61-64014c513a85 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:39.244771 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-75c09965-3f4e-4e1d-9c61-64014c513a85 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:39.245444 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-75c09965-3f4e-4e1d-9c61-64014c513a85 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:39.279352 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4923631d-d59b-4a61-8c8d-f3cebb56d1a6 tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 417 microversion: 2.1 time: 0.042262 Oct 18 15:24:39.280465 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 50/83] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:24:39 2022] POST /compute/v2.1/flavors => generated 417 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:24:39.290733 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-75c09965-3f4e-4e1d-9c61-64014c513a85 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Getting quotas for project a6565f6ef56e4ed3b530d009055cd619. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:24:39.295665 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2a4e8231-d72f-4595-b0ff-f8ca3bd09280 tempest-HypervisorAdminNegativeTestJSON-1229831714 tempest-HypervisorAdminNegativeTestJSON-1229831714-project] Calling method '.version_select at 0x7f7c3e135dc0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:39.298855 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2a4e8231-d72f-4595-b0ff-f8ca3bd09280 tempest-HypervisorAdminNegativeTestJSON-1229831714 tempest-HypervisorAdminNegativeTestJSON-1229831714-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'c075992fc21b4a799cd28ee40a7bd1e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c546c651e6474a81c313ad21685fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:24:39.301278 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2a4e8231-d72f-4595-b0ff-f8ca3bd09280 tempest-HypervisorAdminNegativeTestJSON-1229831714 tempest-HypervisorAdminNegativeTestJSON-1229831714-project] Request method failure captured: Oct 18 15:24:39.301278 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 18 15:24:39.301278 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:24:39.301278 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:24:39.301278 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:24:39.301278 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:24:39.301278 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:24:39.301278 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:24:39.301278 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:24:39.301278 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:24:39.301278 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsUxIEVB8dLTVPpZBYV1BEFNli-fkgMueK5_tG5BgvyVkJ_iYRmZXpIwnEqgriqUweeRcoAenlGLUscoE0vsNtCvIFovXutsuKQ0qTt4My1QpwD9rGX4c5NJngRBBpGx__DLqVkYuxslaGzkgYRGiW9aQFdesYbZtES4SBEHKC46v7o Oct 18 15:24:39.301278 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:24:39.301278 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:24:39.301278 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:24:39.301278 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:24:39.301278 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:24:39.301278 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:24:39.301278 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 29c546c651e6474a81c313ad21685fff Oct 18 15:24:39.301278 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1229831714 Oct 18 15:24:39.301278 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:24:39.301278 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:24:39.302579 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/29c546c651e6474a81c313ad21685fff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/29c546c651e6474a81c313ad21685fff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/29c546c651e6474a81c313ad21685fff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_29c546c651e6474a81c313ad21685fff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:24:39.302579 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1229831714 Oct 18 15:24:39.302579 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 29c546c651e6474a81c313ad21685fff Oct 18 15:24:39.302579 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1229831714 Oct 18 15:24:39.302579 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-HypervisorAdminNegativeTestJSON-1229831714-project Oct 18 15:24:39.302579 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:24:39.302579 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:24:39.302579 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: c075992fc21b4a799cd28ee40a7bd1e1 Oct 18 15:24:39.302579 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1229831714-project Oct 18 15:24:39.302579 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:24:39.302579 n-d-853682-5 devstack@n-api.service[120406]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 18 15:24:39.302579 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '1'} Oct 18 15:24:39.302579 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:24:39.303396 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:39.303396 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:39.303396 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:39.303396 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:24:39.303396 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:24:39.303396 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:24:39.303396 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:24:39.303396 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:24:39.303396 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:24:39.303396 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 18 15:24:39.303396 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 18 15:24:39.303396 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 18 15:24:39.303396 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 18 15:24:39.303396 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 15:24:39.303396 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 15:24:39.303396 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 15:24:39.303396 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 15:24:39.303396 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 15:24:39.303396 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 15:24:39.304509 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 15:24:39.304509 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 15:24:39.304509 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 15:24:39.304509 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 15:24:39.304509 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 15:24:39.304509 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 15:24:39.304509 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 15:24:39.304509 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 15:24:39.304509 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 18 15:24:39.304509 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:39.304509 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:39.304509 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:39.304509 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:39.304509 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:39.304509 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:39.304509 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 15:24:39.304509 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 15:24:39.304509 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 18 15:24:39.304509 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:39.305723 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2a4e8231-d72f-4595-b0ff-f8ca3bd09280 tempest-HypervisorAdminNegativeTestJSON-1229831714 tempest-HypervisorAdminNegativeTestJSON-1229831714-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:24:39.305815 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-75c09965-3f4e-4e1d-9c61-64014c513a85 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Getting quotas for user c747aec412924b52b99dbf75d0c77fa4 and project a6565f6ef56e4ed3b530d009055cd619. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:24:39.305899 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2a4e8231-d72f-4595-b0ff-f8ca3bd09280 tempest-HypervisorAdminNegativeTestJSON-1229831714 tempest-HypervisorAdminNegativeTestJSON-1229831714-project] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.015360 Oct 18 15:24:39.305978 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 51/84] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Oct 18 15:24:39 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:24:39.312346 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-baa4f28d-2f6d-4d14-8b4b-d712010d65d8 tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:39.334388 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-baa4f28d-2f6d-4d14-8b4b-d712010d65d8 tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5398 microversion: 2.1 time: 0.027400 Oct 18 15:24:39.335514 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 52/85] 10.222.0.60 () {58 vars in 1146 bytes} [Tue Oct 18 15:24:39 2022] GET /compute/v2.1/flavors/detail => generated 5398 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:39.347062 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-75c09965-3f4e-4e1d-9c61-64014c513a85 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:24:39.352349 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-75c09965-3f4e-4e1d-9c61-64014c513a85 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: 2dea609b-60cd-4634-b6d6-f5e3e085c1a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:24:39.354144 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1d6959db-21de-486c-a731-5af68416d34e tempest-HypervisorAdminNegativeTestJSON-974858240 tempest-HypervisorAdminNegativeTestJSON-974858240-project-admin] Calling method '.version_select at 0x7f7c3e1e1b80>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:39.361755 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-1d6959db-21de-486c-a731-5af68416d34e tempest-HypervisorAdminNegativeTestJSON-974858240 tempest-HypervisorAdminNegativeTestJSON-974858240-project-admin] HTTP exception thrown: Hypervisor with ID '0ba54d53-fcbf-418b-96cc-0f79114e68d7' could not be found. Oct 18 15:24:39.363773 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1d6959db-21de-486c-a731-5af68416d34e tempest-HypervisorAdminNegativeTestJSON-974858240 tempest-HypervisorAdminNegativeTestJSON-974858240-project-admin] Request method failure captured: Oct 18 15:24:39.363773 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/os-hypervisors/0ba54d53-fcbf-418b-96cc-0f79114e68d7 HTTP/1.1 Oct 18 15:24:39.363773 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:24:39.363773 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:24:39.363773 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:24:39.363773 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:24:39.363773 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:24:39.363773 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:24:39.363773 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:24:39.363773 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:24:39.363773 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsU0N7T_NYnz0vmMFEAXlI848x8MjE5dlGbLmwI2GjUu2CX2lxb7zDakB0oS4t1ljCkfreJYEhd077PRVehPZEvK72ULW97V7-bL8c9pHqdxaW66B2fLXBTrT08dXADx3ldUwmz28G-B5DbMLfVGR0YWthJWKyTLCCeD-P3M3nhGQcU Oct 18 15:24:39.363773 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:24:39.363773 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:24:39.363773 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:24:39.363773 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:24:39.363773 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:24:39.363773 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:24:39.363773 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: fdde85a717794d36a7b1277ab59a493b Oct 18 15:24:39.363773 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-974858240 Oct 18 15:24:39.363773 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,admin,reader Oct 18 15:24:39.363773 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,admin,reader Oct 18 15:24:39.364905 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fdde85a717794d36a7b1277ab59a493b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fdde85a717794d36a7b1277ab59a493b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/fdde85a717794d36a7b1277ab59a493b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_fdde85a717794d36a7b1277ab59a493b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:24:39.364905 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-974858240 Oct 18 15:24:39.364905 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: fdde85a717794d36a7b1277ab59a493b Oct 18 15:24:39.364905 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-974858240 Oct 18 15:24:39.364905 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-HypervisorAdminNegativeTestJSON-974858240-project-admin Oct 18 15:24:39.364905 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:24:39.364905 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:24:39.364905 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: a75f8f81e6d14b67817449ea5f0d4a20 Oct 18 15:24:39.364905 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-974858240-project-admin Oct 18 15:24:39.364905 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:24:39.364905 n-d-853682-5 devstack@n-api.service[120406]: exception: Hypervisor with ID '0ba54d53-fcbf-418b-96cc-0f79114e68d7' could not be found. Oct 18 15:24:39.364905 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '0ba54d53-fcbf-418b-96cc-0f79114e68d7'} Oct 18 15:24:39.365546 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:24:39.365546 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:39.365546 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 18 15:24:39.365546 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 18 15:24:39.365546 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '0ba54d53-fcbf-418b-96cc-0f79114e68d7' Oct 18 15:24:39.365546 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:39.365546 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:39.365546 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:39.365546 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:39.365546 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 18 15:24:39.365546 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 18 15:24:39.365546 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 18 15:24:39.365546 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 18 15:24:39.365546 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 18 15:24:39.365546 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:39.365546 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:39.365546 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:39.365546 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:39.365546 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 18 15:24:39.365546 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 18 15:24:39.365546 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 18 15:24:39.365546 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 18 15:24:39.366613 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 18 15:24:39.366613 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:39.366613 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:39.366613 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:39.366613 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:39.366613 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:39.366613 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:39.366613 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:24:39.366613 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:24:39.366613 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:24:39.366613 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:24:39.366613 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:24:39.366613 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:24:39.366613 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 18 15:24:39.366613 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 18 15:24:39.366613 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 18 15:24:39.366613 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 18 15:24:39.366613 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 18 15:24:39.366613 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 18 15:24:39.366613 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '0ba54d53-fcbf-418b-96cc-0f79114e68d7' could not be found. Oct 18 15:24:39.367658 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:39.367658 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:39.367658 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:39.367658 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:39.367658 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:39.367658 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:39.367658 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:24:39.367658 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:24:39.367658 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '0ba54d53-fcbf-418b-96cc-0f79114e68d7' could not be found. Oct 18 15:24:39.367658 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:39.367658 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1d6959db-21de-486c-a731-5af68416d34e tempest-HypervisorAdminNegativeTestJSON-974858240 tempest-HypervisorAdminNegativeTestJSON-974858240-project-admin] Returning 404 to user: Hypervisor with ID '0ba54d53-fcbf-418b-96cc-0f79114e68d7' could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:24:39.367658 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1d6959db-21de-486c-a731-5af68416d34e tempest-HypervisorAdminNegativeTestJSON-974858240 tempest-HypervisorAdminNegativeTestJSON-974858240-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/0ba54d53-fcbf-418b-96cc-0f79114e68d7" status: 404 len: 123 microversion: 2.1 time: 0.020929 Oct 18 15:24:39.367658 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 53/86] 10.222.0.60 () {58 vars in 1257 bytes} [Tue Oct 18 15:24:39 2022] GET /compute/v2.1/os-hypervisors/0ba54d53-fcbf-418b-96cc-0f79114e68d7 => generated 123 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:24:39.380596 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c6838307-e287-4ae3-925d-c1e743786e4a tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:39.408345 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c6838307-e287-4ae3-925d-c1e743786e4a tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/1176456672" status: 202 len: 0 microversion: 2.1 time: 0.034672 Oct 18 15:24:39.409321 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 54/87] 10.222.0.60 () {58 vars in 1161 bytes} [Tue Oct 18 15:24:39 2022] DELETE /compute/v2.1/flavors/1176456672 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:24:39.421301 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c4156f00-c260-4e71-b6ab-ceebef0f650f tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:39.455678 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c4156f00-c260-4e71-b6ab-ceebef0f650f tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034792 Oct 18 15:24:39.456552 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 55/88] 10.222.0.60 () {58 vars in 1146 bytes} [Tue Oct 18 15:24:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:39.460987 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-75c09965-3f4e-4e1d-9c61-64014c513a85 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.090018 Oct 18 15:24:39.468857 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 34/89] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:24:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2095 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:24:39.481004 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-20507594-8a94-4f79-802d-a93352fd29ec tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:39.482064 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-20507594-8a94-4f79-802d-a93352fd29ec tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: 2dea609b-60cd-4634-b6d6-f5e3e085c1a3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:24:39.564217 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-20507594-8a94-4f79-802d-a93352fd29ec tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:24:39.577004 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-20507594-8a94-4f79-802d-a93352fd29ec tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3" status: 200 len: 1211 microversion: 2.1 time: 0.101902 Oct 18 15:24:39.578289 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 35/90] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:24:39 2022] GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3 => generated 1211 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:39.589278 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-57d0b695-71b7-4a19-b50b-f0512300034a tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-894451016", "id": 1433095354, "os-flavor-access:is_public": "True"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:24:39.617440 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-57d0b695-71b7-4a19-b50b-f0512300034a tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.033609 Oct 18 15:24:39.627648 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 36/91] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:24:39 2022] POST /compute/v2.1/flavors => generated 428 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:24:39.637813 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-37b96f4a-daf1-40bc-a6f0-d2f1747d1a6e tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:39.639281 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-37b96f4a-daf1-40bc-a6f0-d2f1747d1a6e tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] [instance: 3f5d6640-30f6-490b-984f-d1169918133f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:24:39.649167 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37b96f4a-daf1-40bc-a6f0-d2f1747d1a6e tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:39.649938 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37b96f4a-daf1-40bc-a6f0-d2f1747d1a6e tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:39.650867 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37b96f4a-daf1-40bc-a6f0-d2f1747d1a6e tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:39.651927 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37b96f4a-daf1-40bc-a6f0-d2f1747d1a6e tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:39.652695 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37b96f4a-daf1-40bc-a6f0-d2f1747d1a6e tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:39.653398 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37b96f4a-daf1-40bc-a6f0-d2f1747d1a6e tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:39.839063 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-37b96f4a-daf1-40bc-a6f0-d2f1747d1a6e tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72c1406934749cdaf643c4370dbd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e72a93e9d51401c991e34b7e0f62ed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:24:39.857368 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-37b96f4a-daf1-40bc-a6f0-d2f1747d1a6e tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] 10.222.0.60 "GET /compute/v2.1/servers/3f5d6640-30f6-490b-984f-d1169918133f" status: 200 len: 1339 microversion: 2.1 time: 0.227342 Oct 18 15:24:39.859295 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 37/92] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:24:39 2022] GET /compute/v2.1/servers/3f5d6640-30f6-490b-984f-d1169918133f => generated 1339 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:39.879696 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f89a4173-4877-41f8-b567-c8b241225985 tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:39.907803 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f89a4173-4877-41f8-b567-c8b241225985 tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/1433095354" status: 202 len: 0 microversion: 2.1 time: 0.045763 Oct 18 15:24:39.909110 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 38/93] 10.222.0.60 () {58 vars in 1161 bytes} [Tue Oct 18 15:24:39 2022] DELETE /compute/v2.1/flavors/1433095354 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:24:39.919183 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c7b0eed8-abd0-4a1e-8d38-669b1188f612 tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:39.978691 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c7b0eed8-abd0-4a1e-8d38-669b1188f612 tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.064219 Oct 18 15:24:39.981197 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 39/94] 10.222.0.60 () {58 vars in 1146 bytes} [Tue Oct 18 15:24:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:24:39.982113 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cfa5d6fb-27f1-4675-aca4-edf889938a31 tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Action: 'update', calling method: .version_select at 0x7f7c3e1e1f70>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:24:39.987183 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cfa5d6fb-27f1-4675-aca4-edf889938a31 tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:39.987663 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cfa5d6fb-27f1-4675-aca4-edf889938a31 tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:39.989478 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cfa5d6fb-27f1-4675-aca4-edf889938a31 tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:39.999550 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cfa5d6fb-27f1-4675-aca4-edf889938a31 tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:40.000043 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cfa5d6fb-27f1-4675-aca4-edf889938a31 tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:40.001054 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cfa5d6fb-27f1-4675-aca4-edf889938a31 tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:40.011265 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-cfa5d6fb-27f1-4675-aca4-edf889938a31 tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] HTTP exception thrown: Service 2429145c-95d1-4206-bcc2-9a634c4aa2f7 could not be found. Oct 18 15:24:40.017047 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cfa5d6fb-27f1-4675-aca4-edf889938a31 tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Request method failure captured: Oct 18 15:24:40.017047 n-d-853682-5 devstack@n-api.service[120406]: request: PUT /compute/v2.1/os-services/2429145c-95d1-4206-bcc2-9a634c4aa2f7 HTTP/1.1 Oct 18 15:24:40.017047 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:24:40.017047 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:24:40.017047 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:24:40.017047 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 56 Oct 18 15:24:40.017047 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:24:40.017047 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:24:40.017047 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:24:40.017047 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:24:40.017047 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsU3ZZuVXmHcdmQ7aQF36-BZKEIC_Coe0JuBoITTUb21vQl04DlrpuSWlV98gX30qV0q22szPd-3H6ew6u026a4AW5atahg4eZOPdAb1n0UF3D5Q6bZ9rkyCciSZ-c0kZRnTH540z8r_Rex5fCNpee3uWMKBzOVXyFrE96osu09Aa48 Oct 18 15:24:40.017047 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:24:40.017047 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:24:40.017047 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:24:40.017047 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:24:40.017047 n-d-853682-5 devstack@n-api.service[120406]: X-Openstack-Nova-Api-Version: 2.53 Oct 18 15:24:40.017047 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:24:40.017047 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:24:40.017047 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 2924f70e78c44bbc985d06884278e0ba Oct 18 15:24:40.017047 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-2120848736 Oct 18 15:24:40.017047 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,admin,reader Oct 18 15:24:40.017047 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,admin,reader Oct 18 15:24:40.018438 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2924f70e78c44bbc985d06884278e0ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2924f70e78c44bbc985d06884278e0ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2924f70e78c44bbc985d06884278e0ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2924f70e78c44bbc985d06884278e0ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:24:40.018438 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-2120848736 Oct 18 15:24:40.018438 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 2924f70e78c44bbc985d06884278e0ba Oct 18 15:24:40.018438 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-2120848736 Oct 18 15:24:40.018438 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin Oct 18 15:24:40.018438 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:24:40.018438 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:24:40.018438 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 39b1790db49f45f7aace512de98d3d87 Oct 18 15:24:40.018438 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin Oct 18 15:24:40.018438 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:24:40.018438 n-d-853682-5 devstack@n-api.service[120406]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 18 15:24:40.018438 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:24:40.018438 n-d-853682-5 devstack@n-api.service[120406]: exception: Service 2429145c-95d1-4206-bcc2-9a634c4aa2f7 could not be found. Oct 18 15:24:40.019309 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '2429145c-95d1-4206-bcc2-9a634c4aa2f7', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 18 15:24:40.019309 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:24:40.019309 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:40.019309 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 18 15:24:40.019309 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 18 15:24:40.019309 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 18 15:24:40.019309 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 18 15:24:40.019309 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 18 15:24:40.019309 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:40.019309 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:40.019309 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:40.019309 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:40.019309 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 18 15:24:40.019309 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 18 15:24:40.019309 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 18 15:24:40.019309 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 18 15:24:40.019309 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 2429145c-95d1-4206-bcc2-9a634c4aa2f7 could not be found. Oct 18 15:24:40.019309 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:40.019309 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:40.019309 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:40.019309 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:40.020649 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:40.020649 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:40.020649 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:24:40.020649 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:24:40.020649 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:24:40.020649 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:24:40.020649 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:24:40.020649 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:24:40.020649 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:24:40.020649 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:24:40.020649 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 18 15:24:40.020649 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:24:40.020649 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 2429145c-95d1-4206-bcc2-9a634c4aa2f7 could not be found. Oct 18 15:24:40.020649 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:40.020649 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:40.020649 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:40.020649 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:40.020649 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:40.020649 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:40.020649 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:24:40.021924 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:24:40.021924 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 2429145c-95d1-4206-bcc2-9a634c4aa2f7 could not be found. Oct 18 15:24:40.021924 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:40.023085 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cfa5d6fb-27f1-4675-aca4-edf889938a31 tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Returning 404 to user: Service 2429145c-95d1-4206-bcc2-9a634c4aa2f7 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:24:40.024185 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cfa5d6fb-27f1-4675-aca4-edf889938a31 tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-services/2429145c-95d1-4206-bcc2-9a634c4aa2f7" status: 404 len: 110 microversion: 2.53 time: 0.566669 Oct 18 15:24:40.026834 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-555a0da7-a054-417c-8c30-69fab1bae349 tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1174350484", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:24:40.029736 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 56/95] 10.222.0.60 () {62 vars in 1309 bytes} [Tue Oct 18 15:24:39 2022] PUT /compute/v2.1/os-services/2429145c-95d1-4206-bcc2-9a634c4aa2f7 => generated 110 bytes in 572 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:24:40.035147 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-45ac59e4-75c3-44ed-b855-d892fbf43ebb tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Action: 'update', calling method: .version_select at 0x7f7c3dffd8b0>, body: {"status": "disabled"} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:24:40.038986 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45ac59e4-75c3-44ed-b855-d892fbf43ebb tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:40.040023 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45ac59e4-75c3-44ed-b855-d892fbf43ebb tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:40.040697 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45ac59e4-75c3-44ed-b855-d892fbf43ebb tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:40.052153 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45ac59e4-75c3-44ed-b855-d892fbf43ebb tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:40.053110 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45ac59e4-75c3-44ed-b855-d892fbf43ebb tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:40.053855 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45ac59e4-75c3-44ed-b855-d892fbf43ebb tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:40.061179 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-45ac59e4-75c3-44ed-b855-d892fbf43ebb tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] HTTP exception thrown: Service 2429145c-95d1-4206-bcc2-9a634c4aa2f7 could not be found. Oct 18 15:24:40.063741 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-45ac59e4-75c3-44ed-b855-d892fbf43ebb tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Request method failure captured: Oct 18 15:24:40.063741 n-d-853682-5 devstack@n-api.service[120406]: request: PUT /compute/v2.1/os-services/2429145c-95d1-4206-bcc2-9a634c4aa2f7 HTTP/1.1 Oct 18 15:24:40.063741 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:24:40.063741 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:24:40.063741 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:24:40.063741 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 22 Oct 18 15:24:40.063741 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:24:40.063741 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:24:40.063741 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:24:40.063741 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:24:40.063741 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsU3ZZuVXmHcdmQ7aQF36-BZKEIC_Coe0JuBoITTUb21vQl04DlrpuSWlV98gX30qV0q22szPd-3H6ew6u026a4AW5atahg4eZOPdAb1n0UF3D5Q6bZ9rkyCciSZ-c0kZRnTH540z8r_Rex5fCNpee3uWMKBzOVXyFrE96osu09Aa48 Oct 18 15:24:40.063741 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:24:40.063741 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:24:40.063741 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:24:40.063741 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:24:40.063741 n-d-853682-5 devstack@n-api.service[120406]: X-Openstack-Nova-Api-Version: 2.53 Oct 18 15:24:40.063741 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:24:40.063741 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:24:40.063741 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 2924f70e78c44bbc985d06884278e0ba Oct 18 15:24:40.063741 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-2120848736 Oct 18 15:24:40.063741 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,admin,reader Oct 18 15:24:40.063741 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,admin,reader Oct 18 15:24:40.065138 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2924f70e78c44bbc985d06884278e0ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2924f70e78c44bbc985d06884278e0ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2924f70e78c44bbc985d06884278e0ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2924f70e78c44bbc985d06884278e0ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:24:40.065138 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-2120848736 Oct 18 15:24:40.065138 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 2924f70e78c44bbc985d06884278e0ba Oct 18 15:24:40.065138 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-2120848736 Oct 18 15:24:40.065138 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin Oct 18 15:24:40.065138 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:24:40.065138 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:24:40.065138 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 39b1790db49f45f7aace512de98d3d87 Oct 18 15:24:40.065138 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin Oct 18 15:24:40.065138 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:24:40.065138 n-d-853682-5 devstack@n-api.service[120406]: {"status": "disabled"} Oct 18 15:24:40.065138 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:24:40.065138 n-d-853682-5 devstack@n-api.service[120406]: exception: Service 2429145c-95d1-4206-bcc2-9a634c4aa2f7 could not be found. Oct 18 15:24:40.065138 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '2429145c-95d1-4206-bcc2-9a634c4aa2f7', 'body': {'status': 'disabled'}} Oct 18 15:24:40.066031 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:24:40.066031 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:40.066031 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 18 15:24:40.066031 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 18 15:24:40.066031 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 18 15:24:40.066031 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 18 15:24:40.066031 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 18 15:24:40.066031 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:40.066031 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:40.066031 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:40.066031 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:40.066031 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 18 15:24:40.066031 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 18 15:24:40.066031 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 18 15:24:40.066031 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 18 15:24:40.066031 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 2429145c-95d1-4206-bcc2-9a634c4aa2f7 could not be found. Oct 18 15:24:40.066031 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:40.066031 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:40.066031 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:40.066031 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:40.066031 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:40.067387 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:40.067387 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:24:40.067387 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:24:40.067387 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:24:40.067387 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:24:40.067387 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:24:40.067387 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:24:40.067387 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:24:40.067387 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:24:40.067387 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 18 15:24:40.067387 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:24:40.067387 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 2429145c-95d1-4206-bcc2-9a634c4aa2f7 could not be found. Oct 18 15:24:40.067387 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:40.067387 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:40.067387 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:40.067387 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:40.067387 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:40.067387 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:40.067387 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:24:40.067387 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:24:40.068568 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 2429145c-95d1-4206-bcc2-9a634c4aa2f7 could not be found. Oct 18 15:24:40.068568 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:40.069639 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-45ac59e4-75c3-44ed-b855-d892fbf43ebb tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Returning 404 to user: Service 2429145c-95d1-4206-bcc2-9a634c4aa2f7 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:24:40.070888 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-45ac59e4-75c3-44ed-b855-d892fbf43ebb tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-services/2429145c-95d1-4206-bcc2-9a634c4aa2f7" status: 404 len: 110 microversion: 2.53 time: 0.039914 Oct 18 15:24:40.076526 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 57/96] 10.222.0.60 () {62 vars in 1309 bytes} [Tue Oct 18 15:24:40 2022] PUT /compute/v2.1/os-services/2429145c-95d1-4206-bcc2-9a634c4aa2f7 => generated 110 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:24:40.080851 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-555a0da7-a054-417c-8c30-69fab1bae349 tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.057893 Oct 18 15:24:40.083068 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 40/97] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:24:40 2022] POST /compute/v2.1/flavors => generated 507 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:24:40.083541 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e67a4edb-3400-4c4f-8289-2757ed8ba1b4 tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Action: 'update', calling method: .version_select at 0x7f7c3e0c4ca0>, body: {"status": "enabled"} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:24:40.088130 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e67a4edb-3400-4c4f-8289-2757ed8ba1b4 tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:40.089006 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e67a4edb-3400-4c4f-8289-2757ed8ba1b4 tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:40.089741 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e67a4edb-3400-4c4f-8289-2757ed8ba1b4 tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:40.102439 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1fc1b1b0-39b0-433c-8d4a-d5c929ef7366 tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:40.104024 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e67a4edb-3400-4c4f-8289-2757ed8ba1b4 tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:40.105651 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e67a4edb-3400-4c4f-8289-2757ed8ba1b4 tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:40.106733 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e67a4edb-3400-4c4f-8289-2757ed8ba1b4 tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:40.118133 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-e67a4edb-3400-4c4f-8289-2757ed8ba1b4 tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] HTTP exception thrown: Service 2429145c-95d1-4206-bcc2-9a634c4aa2f7 could not be found. Oct 18 15:24:40.122167 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e67a4edb-3400-4c4f-8289-2757ed8ba1b4 tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Request method failure captured: Oct 18 15:24:40.122167 n-d-853682-5 devstack@n-api.service[120406]: request: PUT /compute/v2.1/os-services/2429145c-95d1-4206-bcc2-9a634c4aa2f7 HTTP/1.1 Oct 18 15:24:40.122167 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:24:40.122167 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:24:40.122167 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:24:40.122167 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 21 Oct 18 15:24:40.122167 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:24:40.122167 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:24:40.122167 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:24:40.122167 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:24:40.122167 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsU3ZZuVXmHcdmQ7aQF36-BZKEIC_Coe0JuBoITTUb21vQl04DlrpuSWlV98gX30qV0q22szPd-3H6ew6u026a4AW5atahg4eZOPdAb1n0UF3D5Q6bZ9rkyCciSZ-c0kZRnTH540z8r_Rex5fCNpee3uWMKBzOVXyFrE96osu09Aa48 Oct 18 15:24:40.122167 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:24:40.122167 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:24:40.122167 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:24:40.122167 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:24:40.122167 n-d-853682-5 devstack@n-api.service[120406]: X-Openstack-Nova-Api-Version: 2.53 Oct 18 15:24:40.122167 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:24:40.122167 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:24:40.122167 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 2924f70e78c44bbc985d06884278e0ba Oct 18 15:24:40.122167 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-2120848736 Oct 18 15:24:40.122167 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,admin,reader Oct 18 15:24:40.122167 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,admin,reader Oct 18 15:24:40.123396 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2924f70e78c44bbc985d06884278e0ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2924f70e78c44bbc985d06884278e0ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2924f70e78c44bbc985d06884278e0ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2924f70e78c44bbc985d06884278e0ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:24:40.123396 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-2120848736 Oct 18 15:24:40.123396 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 2924f70e78c44bbc985d06884278e0ba Oct 18 15:24:40.123396 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-2120848736 Oct 18 15:24:40.123396 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin Oct 18 15:24:40.123396 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:24:40.123396 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:24:40.123396 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 39b1790db49f45f7aace512de98d3d87 Oct 18 15:24:40.123396 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin Oct 18 15:24:40.123396 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:24:40.123396 n-d-853682-5 devstack@n-api.service[120406]: {"status": "enabled"} Oct 18 15:24:40.123396 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:24:40.123396 n-d-853682-5 devstack@n-api.service[120406]: exception: Service 2429145c-95d1-4206-bcc2-9a634c4aa2f7 could not be found. Oct 18 15:24:40.123396 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '2429145c-95d1-4206-bcc2-9a634c4aa2f7', 'body': {'status': 'enabled'}} Oct 18 15:24:40.124242 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:24:40.124242 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:40.124242 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 18 15:24:40.124242 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 18 15:24:40.124242 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 18 15:24:40.124242 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 18 15:24:40.124242 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 18 15:24:40.124242 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:40.124242 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:40.124242 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:40.124242 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:40.124242 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 18 15:24:40.124242 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 18 15:24:40.124242 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 18 15:24:40.124242 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 18 15:24:40.124242 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 2429145c-95d1-4206-bcc2-9a634c4aa2f7 could not be found. Oct 18 15:24:40.124242 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:40.124242 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:40.124242 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:40.124242 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:40.124242 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:40.126019 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:40.126019 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:24:40.126019 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:24:40.126019 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:24:40.126019 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:24:40.126019 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:24:40.126019 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:24:40.126019 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:24:40.126019 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:24:40.126019 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 18 15:24:40.126019 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:24:40.126019 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 2429145c-95d1-4206-bcc2-9a634c4aa2f7 could not be found. Oct 18 15:24:40.126019 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:40.126019 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:40.126019 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:40.126019 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:40.126019 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:40.126019 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:40.126019 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:24:40.126019 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:24:40.127327 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 2429145c-95d1-4206-bcc2-9a634c4aa2f7 could not be found. Oct 18 15:24:40.127327 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:40.128580 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e67a4edb-3400-4c4f-8289-2757ed8ba1b4 tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Returning 404 to user: Service 2429145c-95d1-4206-bcc2-9a634c4aa2f7 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:24:40.130272 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e67a4edb-3400-4c4f-8289-2757ed8ba1b4 tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-services/2429145c-95d1-4206-bcc2-9a634c4aa2f7" status: 404 len: 110 microversion: 2.53 time: 0.052393 Oct 18 15:24:40.136005 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 58/98] 10.222.0.60 () {62 vars in 1309 bytes} [Tue Oct 18 15:24:40 2022] PUT /compute/v2.1/os-services/2429145c-95d1-4206-bcc2-9a634c4aa2f7 => generated 110 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:24:40.142405 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9dd2c362-babe-4dbc-97dd-37e7960aa14e tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:40.144951 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1fc1b1b0-39b0-433c-8d4a-d5c929ef7366 tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/64a9b2a5-58ac-448b-9171-5b5085f5491d" status: 202 len: 0 microversion: 2.1 time: 0.053257 Oct 18 15:24:40.147602 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9dd2c362-babe-4dbc-97dd-37e7960aa14e tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:40.148270 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9dd2c362-babe-4dbc-97dd-37e7960aa14e tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:40.148990 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9dd2c362-babe-4dbc-97dd-37e7960aa14e tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:40.149578 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 41/99] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:24:40 2022] DELETE /compute/v2.1/flavors/64a9b2a5-58ac-448b-9171-5b5085f5491d => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:24:40.150043 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9dd2c362-babe-4dbc-97dd-37e7960aa14e tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:40.150759 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9dd2c362-babe-4dbc-97dd-37e7960aa14e tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:40.151456 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9dd2c362-babe-4dbc-97dd-37e7960aa14e tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:40.155297 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7e9c19ae-7551-4d5f-a494-0b469812fb49 tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:40.187224 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=16,nova_api:INSERT=5 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:24:40.192840 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7e9c19ae-7551-4d5f-a494-0b469812fb49 tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041692 Oct 18 15:24:40.194117 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 42/100] 10.222.0.60 () {58 vars in 1146 bytes} [Tue Oct 18 15:24:40 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:40.199597 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9dd2c362-babe-4dbc-97dd-37e7960aa14e tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1261 microversion: 2.53 time: 0.062110 Oct 18 15:24:40.209756 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 59/101] 10.222.0.60 () {60 vars in 1178 bytes} [Tue Oct 18 15:24:40 2022] GET /compute/v2.1/os-services => generated 1261 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:24:40.219529 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3671d554-737e-4b92-80a9-8a3d9fe572e2 tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:40.223324 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3671d554-737e-4b92-80a9-8a3d9fe572e2 tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:40.223907 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3671d554-737e-4b92-80a9-8a3d9fe572e2 tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:40.224240 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3671d554-737e-4b92-80a9-8a3d9fe572e2 tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:40.225019 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3671d554-737e-4b92-80a9-8a3d9fe572e2 tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:40.225469 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3671d554-737e-4b92-80a9-8a3d9fe572e2 tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:40.225891 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3671d554-737e-4b92-80a9-8a3d9fe572e2 tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:40.240352 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5a53a21e-d3ca-4f13-a2c1-b9c19b672e2e tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1005165786", "id": "9cab298a-e862-43dc-b95e-73350ab7005c", "os-flavor-access:is_public": "True"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:24:40.287522 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3671d554-737e-4b92-80a9-8a3d9fe572e2 tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1261 microversion: 2.53 time: 0.073592 Oct 18 15:24:40.287522 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 43/102] 10.222.0.60 () {60 vars in 1211 bytes} [Tue Oct 18 15:24:40 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1261 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:24:40.296204 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5a53a21e-d3ca-4f13-a2c1-b9c19b672e2e tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.080787 Oct 18 15:24:40.300615 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 60/103] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:24:40 2022] POST /compute/v2.1/flavors => generated 507 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:24:40.316520 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-769c7afb-cd1b-44b3-8d99-4cb7f0f8b21c tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:40.327630 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-769c7afb-cd1b-44b3-8d99-4cb7f0f8b21c tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:40.328357 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-769c7afb-cd1b-44b3-8d99-4cb7f0f8b21c tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:40.328960 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-769c7afb-cd1b-44b3-8d99-4cb7f0f8b21c tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:40.331992 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-769c7afb-cd1b-44b3-8d99-4cb7f0f8b21c tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:40.332556 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-769c7afb-cd1b-44b3-8d99-4cb7f0f8b21c tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:40.333099 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-769c7afb-cd1b-44b3-8d99-4cb7f0f8b21c tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:40.407270 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-769c7afb-cd1b-44b3-8d99-4cb7f0f8b21c tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1261 microversion: 2.53 time: 0.101600 Oct 18 15:24:40.418017 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 61/104] 10.222.0.60 () {60 vars in 1178 bytes} [Tue Oct 18 15:24:40 2022] GET /compute/v2.1/os-services => generated 1261 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:24:40.428451 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-be1a1792-96db-4211-8c34-10a87e1d4de5 tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:40.487302 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-be1a1792-96db-4211-8c34-10a87e1d4de5 tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/9cab298a-e862-43dc-b95e-73350ab7005c" status: 202 len: 0 microversion: 2.1 time: 0.067721 Oct 18 15:24:40.489706 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 62/105] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:24:40 2022] DELETE /compute/v2.1/flavors/9cab298a-e862-43dc-b95e-73350ab7005c => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:24:40.511710 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-68419b59-9319-4544-89d8-1851e04f0cce tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:40.528252 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68419b59-9319-4544-89d8-1851e04f0cce tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:40.529853 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68419b59-9319-4544-89d8-1851e04f0cce tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:40.530999 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68419b59-9319-4544-89d8-1851e04f0cce tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:40.532649 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68419b59-9319-4544-89d8-1851e04f0cce tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:40.533748 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68419b59-9319-4544-89d8-1851e04f0cce tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:40.534191 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68419b59-9319-4544-89d8-1851e04f0cce tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:40.600990 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-68419b59-9319-4544-89d8-1851e04f0cce tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?host=n-d-853682-5&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.108162 Oct 18 15:24:40.601629 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 63/106] 10.222.0.60 () {60 vars in 1235 bytes} [Tue Oct 18 15:24:40 2022] GET /compute/v2.1/os-services?host=n-d-853682-5&binary=xxx => generated 16 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:40.608942 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b96cebd5-a433-49e9-ba16-e49944a37f94 tempest-HostsAdminNegativeTestJSON-74774385 tempest-HostsAdminNegativeTestJSON-74774385-project-admin] Calling method '.version_select at 0x7f7c3df55430>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:40.609135 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b96cebd5-a433-49e9-ba16-e49944a37f94 tempest-HostsAdminNegativeTestJSON-74774385 tempest-HostsAdminNegativeTestJSON-74774385-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:40.612213 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b96cebd5-a433-49e9-ba16-e49944a37f94 tempest-HostsAdminNegativeTestJSON-74774385 tempest-HostsAdminNegativeTestJSON-74774385-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:40.612677 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b96cebd5-a433-49e9-ba16-e49944a37f94 tempest-HostsAdminNegativeTestJSON-74774385 tempest-HostsAdminNegativeTestJSON-74774385-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:40.615086 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b96cebd5-a433-49e9-ba16-e49944a37f94 tempest-HostsAdminNegativeTestJSON-74774385 tempest-HostsAdminNegativeTestJSON-74774385-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:40.615227 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-64708f77-a8d8-48c3-a866-e0b4b3540cd0 tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:40.615565 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b96cebd5-a433-49e9-ba16-e49944a37f94 tempest-HostsAdminNegativeTestJSON-74774385 tempest-HostsAdminNegativeTestJSON-74774385-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:40.620525 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b96cebd5-a433-49e9-ba16-e49944a37f94 tempest-HostsAdminNegativeTestJSON-74774385 tempest-HostsAdminNegativeTestJSON-74774385-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:40.635489 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-64708f77-a8d8-48c3-a866-e0b4b3540cd0 tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024330 Oct 18 15:24:40.649325 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 64/107] 10.222.0.60 () {58 vars in 1146 bytes} [Tue Oct 18 15:24:40 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:40.657209 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-140c03e0-603b-4fae-8afe-87a26086f2fe tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:40.657837 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-140c03e0-603b-4fae-8afe-87a26086f2fe tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: 2dea609b-60cd-4634-b6d6-f5e3e085c1a3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:24:40.710201 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b96cebd5-a433-49e9-ba16-e49944a37f94 tempest-HostsAdminNegativeTestJSON-74774385 tempest-HostsAdminNegativeTestJSON-74774385-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts" status: 200 len: 398 microversion: 2.1 time: 0.421767 Oct 18 15:24:40.711067 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 44/108] 10.222.0.60 () {58 vars in 1128 bytes} [Tue Oct 18 15:24:40 2022] GET /compute/v2.1/os-hosts => generated 398 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:24:40.718035 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6021b5c4-de53-4da3-8b5d-e9c780f0ecf8 tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:40.728569 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6021b5c4-de53-4da3-8b5d-e9c780f0ecf8 tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:40.728569 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6021b5c4-de53-4da3-8b5d-e9c780f0ecf8 tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:40.728569 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6021b5c4-de53-4da3-8b5d-e9c780f0ecf8 tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:40.728858 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6021b5c4-de53-4da3-8b5d-e9c780f0ecf8 tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:40.728858 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6021b5c4-de53-4da3-8b5d-e9c780f0ecf8 tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:40.729168 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6021b5c4-de53-4da3-8b5d-e9c780f0ecf8 tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:40.764166 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6021b5c4-de53-4da3-8b5d-e9c780f0ecf8 tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1261 microversion: 2.53 time: 0.051872 Oct 18 15:24:40.764787 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 45/109] 10.222.0.60 () {60 vars in 1178 bytes} [Tue Oct 18 15:24:40 2022] GET /compute/v2.1/os-services => generated 1261 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:24:40.776633 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-39cf4db0-dcce-41ea-8024-4abd069311ee tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1759309023", "id": 1005795867, "os-flavor-access:is_public": "True"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:24:40.784676 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-140c03e0-603b-4fae-8afe-87a26086f2fe tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:24:40.800799 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-140c03e0-603b-4fae-8afe-87a26086f2fe tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3" status: 200 len: 1211 microversion: 2.1 time: 0.150121 Oct 18 15:24:40.801951 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 65/110] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:24:40 2022] GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3 => generated 1211 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:40.814046 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-39cf4db0-dcce-41ea-8024-4abd069311ee tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.048130 Oct 18 15:24:40.816849 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 46/111] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:24:40 2022] POST /compute/v2.1/flavors => generated 414 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:24:40.822437 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-37617a7d-1f70-4fca-978b-f15dd95b5299 tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:40.828335 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37617a7d-1f70-4fca-978b-f15dd95b5299 tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:40.829124 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37617a7d-1f70-4fca-978b-f15dd95b5299 tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:40.829713 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37617a7d-1f70-4fca-978b-f15dd95b5299 tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:40.846897 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37617a7d-1f70-4fca-978b-f15dd95b5299 tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:40.847452 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37617a7d-1f70-4fca-978b-f15dd95b5299 tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:40.847901 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37617a7d-1f70-4fca-978b-f15dd95b5299 tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:40.875656 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-37617a7d-1f70-4fca-978b-f15dd95b5299 tempest-ServicesAdminNegativeV253TestJSON-2120848736 tempest-ServicesAdminNegativeV253TestJSON-2120848736-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.057393 Oct 18 15:24:40.876976 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 47/112] 10.222.0.60 () {60 vars in 1239 bytes} [Tue Oct 18 15:24:40 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:40.881704 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bcded7b0-ed5c-408a-a882-027071caed9d tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:40.889436 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-bcded7b0-ed5c-408a-a882-027071caed9d tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/1005795867" status: 200 len: 414 microversion: 2.1 time: 0.011299 Oct 18 15:24:40.890013 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 48/113] 10.222.0.60 () {58 vars in 1158 bytes} [Tue Oct 18 15:24:40 2022] GET /compute/v2.1/flavors/1005795867 => generated 414 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:24:40.901160 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e43b4e1c-4026-45d1-9817-df7b320e5afe tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:40.901990 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e43b4e1c-4026-45d1-9817-df7b320e5afe tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] [instance: 3f5d6640-30f6-490b-984f-d1169918133f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:24:40.909871 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e43b4e1c-4026-45d1-9817-df7b320e5afe tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:40.910383 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e43b4e1c-4026-45d1-9817-df7b320e5afe tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:40.910908 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e43b4e1c-4026-45d1-9817-df7b320e5afe tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:40.911812 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e43b4e1c-4026-45d1-9817-df7b320e5afe tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:40.912451 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e43b4e1c-4026-45d1-9817-df7b320e5afe tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:40.913091 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e43b4e1c-4026-45d1-9817-df7b320e5afe tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:41.026880 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e834b60b-3e76-4365-b9c4-9463f41e0834 tempest-HostsAdminNegativeTestJSON-719009267 tempest-HostsAdminNegativeTestJSON-719009267-project] Calling method '.version_select at 0x7f7c3dffd670>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:41.030818 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e834b60b-3e76-4365-b9c4-9463f41e0834 tempest-HostsAdminNegativeTestJSON-719009267 tempest-HostsAdminNegativeTestJSON-719009267-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'd67e6b6c2fb84e10a9c0a72c1426ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b762e808e9b04a15b7d875ee384600da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:24:41.033625 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e834b60b-3e76-4365-b9c4-9463f41e0834 tempest-HostsAdminNegativeTestJSON-719009267 tempest-HostsAdminNegativeTestJSON-719009267-project] Request method failure captured: Oct 18 15:24:41.033625 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 18 15:24:41.033625 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:24:41.033625 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:24:41.033625 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:24:41.033625 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:24:41.033625 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:24:41.033625 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:24:41.033625 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:24:41.033625 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:24:41.033625 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsU2c7JxZNSYKWf5YHWWEt3OfMY59K0_9BgjS_sn9epDNaVQO-Wm4O7-uclrk-c51HiUaLU6PS4o8bW2sJ25V8r8y8vnrvbwrMhLES9paFBZREYKPCIzsN5cABsHrjkysRIDzBMqHN4-Hcz11OsmkOoivhUhssCP4bJn7npIJIu2f0I Oct 18 15:24:41.033625 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:24:41.033625 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:24:41.033625 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:24:41.033625 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:24:41.033625 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:24:41.033625 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:24:41.033625 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: b762e808e9b04a15b7d875ee384600da Oct 18 15:24:41.033625 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-719009267 Oct 18 15:24:41.033625 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:24:41.033625 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:24:41.034800 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b762e808e9b04a15b7d875ee384600da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b762e808e9b04a15b7d875ee384600da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b762e808e9b04a15b7d875ee384600da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b762e808e9b04a15b7d875ee384600da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:24:41.034800 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-HostsAdminNegativeTestJSON-719009267 Oct 18 15:24:41.034800 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: b762e808e9b04a15b7d875ee384600da Oct 18 15:24:41.034800 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-719009267 Oct 18 15:24:41.034800 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-HostsAdminNegativeTestJSON-719009267-project Oct 18 15:24:41.034800 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:24:41.034800 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:24:41.034800 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: d67e6b6c2fb84e10a9c0a72c1426ff1f Oct 18 15:24:41.034800 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-HostsAdminNegativeTestJSON-719009267-project Oct 18 15:24:41.034800 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:24:41.034800 n-d-853682-5 devstack@n-api.service[120406]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 18 15:24:41.034800 n-d-853682-5 devstack@n-api.service[120406]: action_args: {} Oct 18 15:24:41.034800 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:24:41.035531 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:41.035531 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:41.035531 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:41.035531 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:24:41.035531 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:24:41.035531 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:24:41.035531 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:24:41.035531 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 15:24:41.035531 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:24:41.035531 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:24:41.035531 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:24:41.035531 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 18 15:24:41.035531 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 18 15:24:41.035531 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 15:24:41.035531 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 15:24:41.035531 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 15:24:41.035531 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 15:24:41.035531 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 15:24:41.035531 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 15:24:41.036465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 15:24:41.036465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 15:24:41.036465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 15:24:41.036465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 15:24:41.036465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 15:24:41.036465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 15:24:41.036465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 15:24:41.036465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 15:24:41.036465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 18 15:24:41.036465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.036465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:41.036465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.036465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:41.036465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:41.036465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:41.036465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 15:24:41.036465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 15:24:41.036465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 18 15:24:41.036465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.039179 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e834b60b-3e76-4365-b9c4-9463f41e0834 tempest-HostsAdminNegativeTestJSON-719009267 tempest-HostsAdminNegativeTestJSON-719009267-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:24:41.039179 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e834b60b-3e76-4365-b9c4-9463f41e0834 tempest-HostsAdminNegativeTestJSON-719009267 tempest-HostsAdminNegativeTestJSON-719009267-project] 10.222.0.60 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.221957 Oct 18 15:24:41.039179 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 66/114] 10.222.0.60 () {58 vars in 1128 bytes} [Tue Oct 18 15:24:40 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 224 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:24:41.106648 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e43b4e1c-4026-45d1-9817-df7b320e5afe tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72c1406934749cdaf643c4370dbd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e72a93e9d51401c991e34b7e0f62ed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:24:41.114784 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e43b4e1c-4026-45d1-9817-df7b320e5afe tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] 10.222.0.60 "GET /compute/v2.1/servers/3f5d6640-30f6-490b-984f-d1169918133f" status: 200 len: 1339 microversion: 2.1 time: 0.223537 Oct 18 15:24:41.115845 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 49/115] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:24:40 2022] GET /compute/v2.1/servers/3f5d6640-30f6-490b-984f-d1169918133f => generated 1339 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:41.245730 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1a9c1c38-7b7a-486e-9eea-906fcae7d38b tempest-ServicesAdminNegativeV253TestJSON-2131678157 tempest-ServicesAdminNegativeV253TestJSON-2131678157-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:41.249328 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1a9c1c38-7b7a-486e-9eea-906fcae7d38b tempest-ServicesAdminNegativeV253TestJSON-2131678157 tempest-ServicesAdminNegativeV253TestJSON-2131678157-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'a0e7873680a24d1498b5a0312e1f7dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac1a6852b424e749f7117e06eaef3cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:24:41.252136 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1a9c1c38-7b7a-486e-9eea-906fcae7d38b tempest-ServicesAdminNegativeV253TestJSON-2131678157 tempest-ServicesAdminNegativeV253TestJSON-2131678157-project] Request method failure captured: Oct 18 15:24:41.252136 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 18 15:24:41.252136 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:24:41.252136 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:24:41.252136 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:24:41.252136 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:24:41.252136 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:24:41.252136 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:24:41.252136 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:24:41.252136 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:24:41.252136 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsU2Es9dVqEjcv-mYJWqXUx8xR34dFvJ_2SSAYPKEXFyecpEt9pxUCO2yvyMq8ABvu9jelyXrvTbV6uNsdTIaYvF9LknYyaS5ETg3-rQsrevgnZceVaXu_Y-gUXNRBBWabYmr7JnPeFv6L3PFdDaFd4-PkZI_Svo-jeGwZMJznxARKg Oct 18 15:24:41.252136 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:24:41.252136 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:24:41.252136 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:24:41.252136 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:24:41.252136 n-d-853682-5 devstack@n-api.service[120406]: X-Openstack-Nova-Api-Version: 2.53 Oct 18 15:24:41.252136 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:24:41.252136 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:24:41.252136 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: bac1a6852b424e749f7117e06eaef3cc Oct 18 15:24:41.252136 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-2131678157 Oct 18 15:24:41.252136 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:24:41.252136 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:24:41.254020 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bac1a6852b424e749f7117e06eaef3cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bac1a6852b424e749f7117e06eaef3cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/bac1a6852b424e749f7117e06eaef3cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_bac1a6852b424e749f7117e06eaef3cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:24:41.254020 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-2131678157 Oct 18 15:24:41.254020 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: bac1a6852b424e749f7117e06eaef3cc Oct 18 15:24:41.254020 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-2131678157 Oct 18 15:24:41.254020 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServicesAdminNegativeV253TestJSON-2131678157-project Oct 18 15:24:41.254020 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:24:41.254020 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:24:41.254020 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: a0e7873680a24d1498b5a0312e1f7dea Oct 18 15:24:41.254020 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-2131678157-project Oct 18 15:24:41.254020 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:24:41.254020 n-d-853682-5 devstack@n-api.service[120406]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 18 15:24:41.254020 n-d-853682-5 devstack@n-api.service[120406]: action_args: {} Oct 18 15:24:41.258930 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:24:41.258930 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:41.258930 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:41.258930 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:41.258930 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:24:41.258930 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:24:41.258930 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 15:24:41.258930 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:24:41.258930 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 15:24:41.258930 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:24:41.258930 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:24:41.258930 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:24:41.258930 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 18 15:24:41.258930 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 18 15:24:41.258930 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 15:24:41.258930 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 15:24:41.258930 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 15:24:41.258930 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 15:24:41.258930 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 15:24:41.260301 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 15:24:41.260301 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 15:24:41.260301 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 15:24:41.260301 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 15:24:41.260301 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 15:24:41.260301 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 15:24:41.260301 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 15:24:41.260301 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 15:24:41.260301 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 15:24:41.260301 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 18 15:24:41.260301 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.260301 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:41.260301 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.260301 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:41.260301 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:41.260301 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:41.260301 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 15:24:41.260301 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 15:24:41.260301 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 18 15:24:41.260301 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.261370 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1a9c1c38-7b7a-486e-9eea-906fcae7d38b tempest-ServicesAdminNegativeV253TestJSON-2131678157 tempest-ServicesAdminNegativeV253TestJSON-2131678157-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:24:41.261370 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1a9c1c38-7b7a-486e-9eea-906fcae7d38b tempest-ServicesAdminNegativeV253TestJSON-2131678157 tempest-ServicesAdminNegativeV253TestJSON-2131678157-project] 10.222.0.60 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.216803 Oct 18 15:24:41.261370 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 67/116] 10.222.0.60 () {60 vars in 1178 bytes} [Tue Oct 18 15:24:41 2022] GET /compute/v2.1/os-services => generated 112 bytes in 218 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:24:41.261370 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5427b6e8-9040-47cc-b039-3cc5fe804d6a tempest-HostsAdminNegativeTestJSON-719009267 tempest-HostsAdminNegativeTestJSON-719009267-project] Calling method '.version_select at 0x7f7c3e0248b0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:41.261609 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5427b6e8-9040-47cc-b039-3cc5fe804d6a tempest-HostsAdminNegativeTestJSON-719009267 tempest-HostsAdminNegativeTestJSON-719009267-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'd67e6b6c2fb84e10a9c0a72c1426ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b762e808e9b04a15b7d875ee384600da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:24:41.261804 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5427b6e8-9040-47cc-b039-3cc5fe804d6a tempest-HostsAdminNegativeTestJSON-719009267 tempest-HostsAdminNegativeTestJSON-719009267-project] Request method failure captured: Oct 18 15:24:41.261804 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/os-hosts/n-d-853682-5/reboot HTTP/1.1 Oct 18 15:24:41.261804 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:24:41.261804 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:24:41.261804 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:24:41.261804 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:24:41.261804 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:24:41.261804 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:24:41.261804 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:24:41.261804 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:24:41.261804 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsU2c7JxZNSYKWf5YHWWEt3OfMY59K0_9BgjS_sn9epDNaVQO-Wm4O7-uclrk-c51HiUaLU6PS4o8bW2sJ25V8r8y8vnrvbwrMhLES9paFBZREYKPCIzsN5cABsHrjkysRIDzBMqHN4-Hcz11OsmkOoivhUhssCP4bJn7npIJIu2f0I Oct 18 15:24:41.261804 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:24:41.261804 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:24:41.261804 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:24:41.261804 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:24:41.261804 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:24:41.261804 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:24:41.261804 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: b762e808e9b04a15b7d875ee384600da Oct 18 15:24:41.261804 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-719009267 Oct 18 15:24:41.261804 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:24:41.261804 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:24:41.262930 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b762e808e9b04a15b7d875ee384600da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b762e808e9b04a15b7d875ee384600da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b762e808e9b04a15b7d875ee384600da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b762e808e9b04a15b7d875ee384600da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:24:41.262930 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-HostsAdminNegativeTestJSON-719009267 Oct 18 15:24:41.262930 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: b762e808e9b04a15b7d875ee384600da Oct 18 15:24:41.262930 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-719009267 Oct 18 15:24:41.262930 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-HostsAdminNegativeTestJSON-719009267-project Oct 18 15:24:41.262930 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:24:41.262930 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:24:41.262930 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: d67e6b6c2fb84e10a9c0a72c1426ff1f Oct 18 15:24:41.262930 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-HostsAdminNegativeTestJSON-719009267-project Oct 18 15:24:41.262930 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:24:41.262930 n-d-853682-5 devstack@n-api.service[120406]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 18 15:24:41.262930 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'n-d-853682-5'} Oct 18 15:24:41.262930 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:24:41.263631 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:41.263631 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:41.263631 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:41.263631 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:24:41.263631 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:24:41.263631 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:24:41.263631 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:24:41.263631 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:24:41.263631 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:24:41.263631 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 18 15:24:41.263631 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 18 15:24:41.263631 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 15:24:41.263631 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 15:24:41.263631 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 15:24:41.263631 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 15:24:41.263631 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 15:24:41.263631 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 15:24:41.263631 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 15:24:41.263631 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 15:24:41.264554 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 15:24:41.264554 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 15:24:41.264554 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 15:24:41.264554 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 15:24:41.264554 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 15:24:41.264554 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 15:24:41.264554 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 18 15:24:41.264554 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.264554 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:41.264554 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.264554 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:41.264554 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:41.264554 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:41.264554 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 15:24:41.264554 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 15:24:41.264554 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 18 15:24:41.264554 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.266731 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5427b6e8-9040-47cc-b039-3cc5fe804d6a tempest-HostsAdminNegativeTestJSON-719009267 tempest-HostsAdminNegativeTestJSON-719009267-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:24:41.267677 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5427b6e8-9040-47cc-b039-3cc5fe804d6a tempest-HostsAdminNegativeTestJSON-719009267 tempest-HostsAdminNegativeTestJSON-719009267-project] 10.222.0.60 "GET /compute/v2.1/os-hosts/n-d-853682-5/reboot" status: 403 len: 111 microversion: 2.1 time: 0.012619 Oct 18 15:24:41.268146 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 68/117] 10.222.0.60 () {58 vars in 1188 bytes} [Tue Oct 18 15:24:41 2022] GET /compute/v2.1/os-hosts/n-d-853682-5/reboot => generated 111 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:24:41.278406 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a154706c-c9c8-4ed5-b45d-9e344e5546b9 tempest-HostsAdminNegativeTestJSON-74774385 tempest-HostsAdminNegativeTestJSON-74774385-project-admin] Calling method '.version_select at 0x7f7c3e017040>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:41.294000 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-a154706c-c9c8-4ed5-b45d-9e344e5546b9 tempest-HostsAdminNegativeTestJSON-74774385 tempest-HostsAdminNegativeTestJSON-74774385-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 15:24:41.297098 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a154706c-c9c8-4ed5-b45d-9e344e5546b9 tempest-HostsAdminNegativeTestJSON-74774385 tempest-HostsAdminNegativeTestJSON-74774385-project-admin] Request method failure captured: Oct 18 15:24:41.297098 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 18 15:24:41.297098 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:24:41.297098 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:24:41.297098 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:24:41.297098 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:24:41.297098 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:24:41.297098 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:24:41.297098 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:24:41.297098 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:24:41.297098 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsU4_ZElgylfPqGWgcHdYsgWNgBn47mS3BNhswjY0Gxu4ftvEnMbQDgvlH1_S55pG_ShnH4SghCTgDl43itGNUxyNNIT1ZusBRq5QCakPlJUo_-aCuEfJt7sri7Zk68pfEu-_RDXFDUgQa2jdz-mCQ5MtfPz2G-q5V79H197QxdzEGA Oct 18 15:24:41.297098 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:24:41.297098 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:24:41.297098 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:24:41.297098 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:24:41.297098 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:24:41.297098 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:24:41.297098 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 01f0115a589240168934d17b39e40ebb Oct 18 15:24:41.297098 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-74774385 Oct 18 15:24:41.297098 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,admin,reader Oct 18 15:24:41.297098 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,admin,reader Oct 18 15:24:41.298675 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/01f0115a589240168934d17b39e40ebb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/01f0115a589240168934d17b39e40ebb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/01f0115a589240168934d17b39e40ebb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_01f0115a589240168934d17b39e40ebb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:24:41.298675 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-HostsAdminNegativeTestJSON-74774385 Oct 18 15:24:41.298675 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 01f0115a589240168934d17b39e40ebb Oct 18 15:24:41.298675 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-74774385 Oct 18 15:24:41.298675 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-HostsAdminNegativeTestJSON-74774385-project-admin Oct 18 15:24:41.298675 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:24:41.298675 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:24:41.298675 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 7aca8397c08d4b8692c03782b9b3fa3b Oct 18 15:24:41.298675 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-HostsAdminNegativeTestJSON-74774385-project-admin Oct 18 15:24:41.298675 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:24:41.298675 n-d-853682-5 devstack@n-api.service[120406]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 15:24:41.298675 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'nonexistent_hostname'} Oct 18 15:24:41.298675 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:24:41.299376 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:41.299376 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 18 15:24:41.299376 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 18 15:24:41.299376 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 15:24:41.299376 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 15:24:41.299376 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 15:24:41.299376 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 15:24:41.299376 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 15:24:41.299376 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 15:24:41.299376 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 15:24:41.299376 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 15:24:41.299376 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 18 15:24:41.299376 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 18 15:24:41.299376 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 15:24:41.299376 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 15:24:41.299376 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 18 15:24:41.299376 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 18 15:24:41.299376 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 15:24:41.299376 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 15:24:41.300361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 18 15:24:41.300361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 18 15:24:41.300361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 15:24:41.300361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.300361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:41.300361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.300361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:41.300361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:41.300361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:41.300361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:24:41.300361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:24:41.300361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:24:41.300361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:24:41.300361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:24:41.300361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:24:41.300361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 18 15:24:41.300361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 18 15:24:41.300361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 18 15:24:41.300361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:24:41.301414 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 15:24:41.301414 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.301414 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:41.301414 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.301414 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:41.301414 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:41.301414 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:41.301414 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:24:41.301414 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:24:41.301414 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 15:24:41.301414 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.301414 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a154706c-c9c8-4ed5-b45d-9e344e5546b9 tempest-HostsAdminNegativeTestJSON-74774385 tempest-HostsAdminNegativeTestJSON-74774385-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:24:41.301414 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a154706c-c9c8-4ed5-b45d-9e344e5546b9 tempest-HostsAdminNegativeTestJSON-74774385 tempest-HostsAdminNegativeTestJSON-74774385-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.024083 Oct 18 15:24:41.303843 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 69/118] 10.222.0.60 () {58 vars in 1212 bytes} [Tue Oct 18 15:24:41 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 15:24:41.309011 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8c46d8c4-c6aa-4084-baee-0f1ae7fd08bb tempest-HostsAdminNegativeTestJSON-719009267 tempest-HostsAdminNegativeTestJSON-719009267-project] Calling method '.version_select at 0x7f7c3e017160>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:41.310756 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8c46d8c4-c6aa-4084-baee-0f1ae7fd08bb tempest-HostsAdminNegativeTestJSON-719009267 tempest-HostsAdminNegativeTestJSON-719009267-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'd67e6b6c2fb84e10a9c0a72c1426ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b762e808e9b04a15b7d875ee384600da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:24:41.312609 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8c46d8c4-c6aa-4084-baee-0f1ae7fd08bb tempest-HostsAdminNegativeTestJSON-719009267 tempest-HostsAdminNegativeTestJSON-719009267-project] Request method failure captured: Oct 18 15:24:41.312609 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/os-hosts/n-d-853682-5 HTTP/1.1 Oct 18 15:24:41.312609 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:24:41.312609 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:24:41.312609 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:24:41.312609 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:24:41.312609 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:24:41.312609 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:24:41.312609 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:24:41.312609 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:24:41.312609 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsU2c7JxZNSYKWf5YHWWEt3OfMY59K0_9BgjS_sn9epDNaVQO-Wm4O7-uclrk-c51HiUaLU6PS4o8bW2sJ25V8r8y8vnrvbwrMhLES9paFBZREYKPCIzsN5cABsHrjkysRIDzBMqHN4-Hcz11OsmkOoivhUhssCP4bJn7npIJIu2f0I Oct 18 15:24:41.312609 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:24:41.312609 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:24:41.312609 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:24:41.312609 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:24:41.312609 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:24:41.312609 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:24:41.312609 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: b762e808e9b04a15b7d875ee384600da Oct 18 15:24:41.312609 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-719009267 Oct 18 15:24:41.312609 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:24:41.312609 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:24:41.313812 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b762e808e9b04a15b7d875ee384600da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b762e808e9b04a15b7d875ee384600da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b762e808e9b04a15b7d875ee384600da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b762e808e9b04a15b7d875ee384600da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:24:41.313812 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-HostsAdminNegativeTestJSON-719009267 Oct 18 15:24:41.313812 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: b762e808e9b04a15b7d875ee384600da Oct 18 15:24:41.313812 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-719009267 Oct 18 15:24:41.313812 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-HostsAdminNegativeTestJSON-719009267-project Oct 18 15:24:41.313812 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:24:41.313812 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:24:41.313812 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: d67e6b6c2fb84e10a9c0a72c1426ff1f Oct 18 15:24:41.313812 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-HostsAdminNegativeTestJSON-719009267-project Oct 18 15:24:41.313812 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:24:41.313812 n-d-853682-5 devstack@n-api.service[120406]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 18 15:24:41.313812 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'n-d-853682-5'} Oct 18 15:24:41.313812 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:24:41.314625 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:41.314625 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:41.314625 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:41.314625 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:24:41.314625 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:24:41.314625 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:24:41.314625 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:24:41.314625 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:24:41.314625 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:24:41.314625 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 18 15:24:41.314625 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 18 15:24:41.314625 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 15:24:41.314625 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 15:24:41.314625 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 15:24:41.314625 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 15:24:41.314625 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 15:24:41.314625 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 15:24:41.314625 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 15:24:41.314625 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 15:24:41.315595 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 15:24:41.315595 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 15:24:41.315595 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 15:24:41.315595 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 15:24:41.315595 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 15:24:41.315595 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 15:24:41.315595 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 18 15:24:41.315595 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.315595 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:41.315595 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.315595 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:41.315595 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:41.315595 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:41.315595 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 15:24:41.315595 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 15:24:41.315595 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 18 15:24:41.315595 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.316434 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8c46d8c4-c6aa-4084-baee-0f1ae7fd08bb tempest-HostsAdminNegativeTestJSON-719009267 tempest-HostsAdminNegativeTestJSON-719009267-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:24:41.316434 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8c46d8c4-c6aa-4084-baee-0f1ae7fd08bb tempest-HostsAdminNegativeTestJSON-719009267 tempest-HostsAdminNegativeTestJSON-719009267-project] 10.222.0.60 "GET /compute/v2.1/os-hosts/n-d-853682-5" status: 403 len: 109 microversion: 2.1 time: 0.009209 Oct 18 15:24:41.316434 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 70/119] 10.222.0.60 () {58 vars in 1167 bytes} [Tue Oct 18 15:24:41 2022] GET /compute/v2.1/os-hosts/n-d-853682-5 => generated 109 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:24:41.323103 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fb7a2e4a-3f58-49e7-b4dd-17fe9676872d tempest-HostsAdminNegativeTestJSON-74774385 tempest-HostsAdminNegativeTestJSON-74774385-project-admin] Calling method '.version_select at 0x7f7c3dffd5e0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:41.330970 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-fb7a2e4a-3f58-49e7-b4dd-17fe9676872d tempest-HostsAdminNegativeTestJSON-74774385 tempest-HostsAdminNegativeTestJSON-74774385-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 15:24:41.332588 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fb7a2e4a-3f58-49e7-b4dd-17fe9676872d tempest-HostsAdminNegativeTestJSON-74774385 tempest-HostsAdminNegativeTestJSON-74774385-project-admin] Request method failure captured: Oct 18 15:24:41.332588 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 18 15:24:41.332588 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:24:41.332588 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:24:41.332588 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:24:41.332588 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:24:41.332588 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:24:41.332588 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:24:41.332588 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:24:41.332588 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:24:41.332588 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsU4_ZElgylfPqGWgcHdYsgWNgBn47mS3BNhswjY0Gxu4ftvEnMbQDgvlH1_S55pG_ShnH4SghCTgDl43itGNUxyNNIT1ZusBRq5QCakPlJUo_-aCuEfJt7sri7Zk68pfEu-_RDXFDUgQa2jdz-mCQ5MtfPz2G-q5V79H197QxdzEGA Oct 18 15:24:41.332588 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:24:41.332588 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:24:41.332588 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:24:41.332588 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:24:41.332588 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:24:41.332588 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:24:41.332588 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 01f0115a589240168934d17b39e40ebb Oct 18 15:24:41.332588 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-74774385 Oct 18 15:24:41.332588 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,admin,reader Oct 18 15:24:41.332588 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,admin,reader Oct 18 15:24:41.333755 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/01f0115a589240168934d17b39e40ebb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/01f0115a589240168934d17b39e40ebb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/01f0115a589240168934d17b39e40ebb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_01f0115a589240168934d17b39e40ebb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:24:41.333755 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-HostsAdminNegativeTestJSON-74774385 Oct 18 15:24:41.333755 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 01f0115a589240168934d17b39e40ebb Oct 18 15:24:41.333755 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-74774385 Oct 18 15:24:41.333755 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-HostsAdminNegativeTestJSON-74774385-project-admin Oct 18 15:24:41.333755 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:24:41.333755 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:24:41.333755 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 7aca8397c08d4b8692c03782b9b3fa3b Oct 18 15:24:41.333755 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-HostsAdminNegativeTestJSON-74774385-project-admin Oct 18 15:24:41.333755 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:24:41.333755 n-d-853682-5 devstack@n-api.service[120406]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 15:24:41.333755 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'nonexistent_hostname'} Oct 18 15:24:41.333755 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:24:41.334673 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:41.334673 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 18 15:24:41.334673 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 18 15:24:41.334673 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 15:24:41.334673 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 15:24:41.334673 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 18 15:24:41.334673 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 18 15:24:41.334673 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 15:24:41.334673 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 15:24:41.334673 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 18 15:24:41.334673 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 18 15:24:41.334673 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 15:24:41.334673 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.334673 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:41.334673 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.334673 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:41.334673 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:41.334673 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:41.334673 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:24:41.335647 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:24:41.335647 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:24:41.335647 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:24:41.335647 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:24:41.335647 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:24:41.335647 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 18 15:24:41.335647 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:24:41.335647 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 15:24:41.335647 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.335647 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:41.335647 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.335647 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:41.335647 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:41.335647 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:41.335647 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:24:41.335647 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:24:41.335647 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 15:24:41.335647 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.336537 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fb7a2e4a-3f58-49e7-b4dd-17fe9676872d tempest-HostsAdminNegativeTestJSON-74774385 tempest-HostsAdminNegativeTestJSON-74774385-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:24:41.337141 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fb7a2e4a-3f58-49e7-b4dd-17fe9676872d tempest-HostsAdminNegativeTestJSON-74774385 tempest-HostsAdminNegativeTestJSON-74774385-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.017485 Oct 18 15:24:41.338733 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 71/120] 10.222.0.60 () {58 vars in 1191 bytes} [Tue Oct 18 15:24:41 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 18 15:24:41.349131 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0885d6e0-084d-425b-8ba7-8a6643e792d8 tempest-HostsAdminNegativeTestJSON-719009267 tempest-HostsAdminNegativeTestJSON-719009267-project] Calling method '.version_select at 0x7f7c3e181430>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:41.351120 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0885d6e0-084d-425b-8ba7-8a6643e792d8 tempest-HostsAdminNegativeTestJSON-719009267 tempest-HostsAdminNegativeTestJSON-719009267-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'd67e6b6c2fb84e10a9c0a72c1426ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b762e808e9b04a15b7d875ee384600da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:24:41.352651 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0885d6e0-084d-425b-8ba7-8a6643e792d8 tempest-HostsAdminNegativeTestJSON-719009267 tempest-HostsAdminNegativeTestJSON-719009267-project] Request method failure captured: Oct 18 15:24:41.352651 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/os-hosts/n-d-853682-5/shutdown HTTP/1.1 Oct 18 15:24:41.352651 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:24:41.352651 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:24:41.352651 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:24:41.352651 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:24:41.352651 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:24:41.352651 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:24:41.352651 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:24:41.352651 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:24:41.352651 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsU2c7JxZNSYKWf5YHWWEt3OfMY59K0_9BgjS_sn9epDNaVQO-Wm4O7-uclrk-c51HiUaLU6PS4o8bW2sJ25V8r8y8vnrvbwrMhLES9paFBZREYKPCIzsN5cABsHrjkysRIDzBMqHN4-Hcz11OsmkOoivhUhssCP4bJn7npIJIu2f0I Oct 18 15:24:41.352651 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:24:41.352651 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:24:41.352651 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:24:41.352651 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:24:41.352651 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:24:41.352651 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:24:41.352651 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: b762e808e9b04a15b7d875ee384600da Oct 18 15:24:41.352651 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-719009267 Oct 18 15:24:41.352651 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:24:41.352651 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:24:41.354100 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b762e808e9b04a15b7d875ee384600da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b762e808e9b04a15b7d875ee384600da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b762e808e9b04a15b7d875ee384600da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b762e808e9b04a15b7d875ee384600da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:24:41.354100 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-HostsAdminNegativeTestJSON-719009267 Oct 18 15:24:41.354100 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: b762e808e9b04a15b7d875ee384600da Oct 18 15:24:41.354100 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-719009267 Oct 18 15:24:41.354100 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-HostsAdminNegativeTestJSON-719009267-project Oct 18 15:24:41.354100 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:24:41.354100 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:24:41.354100 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: d67e6b6c2fb84e10a9c0a72c1426ff1f Oct 18 15:24:41.354100 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-HostsAdminNegativeTestJSON-719009267-project Oct 18 15:24:41.354100 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:24:41.354100 n-d-853682-5 devstack@n-api.service[120406]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 18 15:24:41.354100 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'n-d-853682-5'} Oct 18 15:24:41.354100 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:24:41.359449 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:41.359449 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:41.359449 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:41.359449 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:24:41.359449 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:24:41.359449 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:24:41.359449 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:24:41.359449 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:24:41.359449 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:24:41.359449 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 18 15:24:41.359449 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 18 15:24:41.359449 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 15:24:41.359449 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 15:24:41.359449 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 15:24:41.359449 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 15:24:41.359449 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 15:24:41.359449 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 15:24:41.359449 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 15:24:41.359449 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 15:24:41.360556 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 15:24:41.360556 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 15:24:41.360556 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 15:24:41.360556 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 15:24:41.360556 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 15:24:41.360556 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 15:24:41.360556 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 18 15:24:41.360556 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.360556 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:41.360556 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.360556 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:41.360556 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:41.360556 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:41.360556 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 15:24:41.360556 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 15:24:41.360556 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 18 15:24:41.360556 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.361941 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0885d6e0-084d-425b-8ba7-8a6643e792d8 tempest-HostsAdminNegativeTestJSON-719009267 tempest-HostsAdminNegativeTestJSON-719009267-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:24:41.361941 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0885d6e0-084d-425b-8ba7-8a6643e792d8 tempest-HostsAdminNegativeTestJSON-719009267 tempest-HostsAdminNegativeTestJSON-719009267-project] 10.222.0.60 "GET /compute/v2.1/os-hosts/n-d-853682-5/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.009745 Oct 18 15:24:41.361941 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 72/121] 10.222.0.60 () {58 vars in 1194 bytes} [Tue Oct 18 15:24:41 2022] GET /compute/v2.1/os-hosts/n-d-853682-5/shutdown => generated 113 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 18 15:24:41.364534 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1bfeac6f-74c8-4df6-ab98-ed1dc20b6ae4 tempest-HostsAdminNegativeTestJSON-74774385 tempest-HostsAdminNegativeTestJSON-74774385-project-admin] Calling method '.version_select at 0x7f7c3e024d30>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:41.373893 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-1bfeac6f-74c8-4df6-ab98-ed1dc20b6ae4 tempest-HostsAdminNegativeTestJSON-74774385 tempest-HostsAdminNegativeTestJSON-74774385-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 15:24:41.375784 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1bfeac6f-74c8-4df6-ab98-ed1dc20b6ae4 tempest-HostsAdminNegativeTestJSON-74774385 tempest-HostsAdminNegativeTestJSON-74774385-project-admin] Request method failure captured: Oct 18 15:24:41.375784 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 18 15:24:41.375784 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:24:41.375784 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:24:41.375784 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:24:41.375784 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:24:41.375784 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:24:41.375784 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:24:41.375784 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:24:41.375784 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:24:41.375784 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsU4_ZElgylfPqGWgcHdYsgWNgBn47mS3BNhswjY0Gxu4ftvEnMbQDgvlH1_S55pG_ShnH4SghCTgDl43itGNUxyNNIT1ZusBRq5QCakPlJUo_-aCuEfJt7sri7Zk68pfEu-_RDXFDUgQa2jdz-mCQ5MtfPz2G-q5V79H197QxdzEGA Oct 18 15:24:41.375784 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:24:41.375784 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:24:41.375784 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:24:41.375784 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:24:41.375784 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:24:41.375784 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:24:41.375784 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 01f0115a589240168934d17b39e40ebb Oct 18 15:24:41.375784 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-74774385 Oct 18 15:24:41.375784 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,admin,reader Oct 18 15:24:41.375784 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,admin,reader Oct 18 15:24:41.376912 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/01f0115a589240168934d17b39e40ebb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/01f0115a589240168934d17b39e40ebb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/01f0115a589240168934d17b39e40ebb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_01f0115a589240168934d17b39e40ebb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:24:41.376912 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-HostsAdminNegativeTestJSON-74774385 Oct 18 15:24:41.376912 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 01f0115a589240168934d17b39e40ebb Oct 18 15:24:41.376912 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-74774385 Oct 18 15:24:41.376912 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-HostsAdminNegativeTestJSON-74774385-project-admin Oct 18 15:24:41.376912 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:24:41.376912 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:24:41.376912 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 7aca8397c08d4b8692c03782b9b3fa3b Oct 18 15:24:41.376912 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-HostsAdminNegativeTestJSON-74774385-project-admin Oct 18 15:24:41.376912 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:24:41.376912 n-d-853682-5 devstack@n-api.service[120406]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 15:24:41.376912 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'nonexistent_hostname'} Oct 18 15:24:41.376912 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:24:41.377580 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:41.377580 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 18 15:24:41.377580 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 18 15:24:41.377580 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 15:24:41.377580 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 15:24:41.377580 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 15:24:41.377580 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 15:24:41.377580 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 15:24:41.377580 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 15:24:41.377580 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 15:24:41.377580 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 15:24:41.377580 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 18 15:24:41.377580 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 18 15:24:41.377580 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 15:24:41.377580 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 15:24:41.377580 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 18 15:24:41.377580 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 18 15:24:41.377580 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 15:24:41.377580 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 15:24:41.378541 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 18 15:24:41.378541 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 18 15:24:41.378541 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 15:24:41.378541 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.378541 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:41.378541 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.378541 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:41.378541 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:41.378541 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:41.378541 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:24:41.378541 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:24:41.378541 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:24:41.378541 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:24:41.378541 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:24:41.378541 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:24:41.378541 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 18 15:24:41.378541 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 18 15:24:41.378541 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 18 15:24:41.378541 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:24:41.379534 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 15:24:41.379534 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.379534 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:41.379534 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.379534 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:41.379534 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:41.379534 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:41.379534 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:24:41.379534 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:24:41.379534 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 15:24:41.379534 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.379534 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1bfeac6f-74c8-4df6-ab98-ed1dc20b6ae4 tempest-HostsAdminNegativeTestJSON-74774385 tempest-HostsAdminNegativeTestJSON-74774385-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:24:41.379534 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1bfeac6f-74c8-4df6-ab98-ed1dc20b6ae4 tempest-HostsAdminNegativeTestJSON-74774385 tempest-HostsAdminNegativeTestJSON-74774385-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.017310 Oct 18 15:24:41.379534 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 73/122] 10.222.0.60 () {58 vars in 1218 bytes} [Tue Oct 18 15:24:41 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 15:24:41.391755 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e3587083-21fd-4477-ac22-ff71f4869790 tempest-HostsAdminNegativeTestJSON-719009267 tempest-HostsAdminNegativeTestJSON-719009267-project] Calling method '.version_select at 0x7f7c3e1e9d30>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:41.393685 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e3587083-21fd-4477-ac22-ff71f4869790 tempest-HostsAdminNegativeTestJSON-719009267 tempest-HostsAdminNegativeTestJSON-719009267-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'd67e6b6c2fb84e10a9c0a72c1426ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b762e808e9b04a15b7d875ee384600da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:24:41.395206 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e3587083-21fd-4477-ac22-ff71f4869790 tempest-HostsAdminNegativeTestJSON-719009267 tempest-HostsAdminNegativeTestJSON-719009267-project] Request method failure captured: Oct 18 15:24:41.395206 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/os-hosts/n-d-853682-5/startup HTTP/1.1 Oct 18 15:24:41.395206 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:24:41.395206 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:24:41.395206 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:24:41.395206 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:24:41.395206 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:24:41.395206 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:24:41.395206 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:24:41.395206 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:24:41.395206 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsU2c7JxZNSYKWf5YHWWEt3OfMY59K0_9BgjS_sn9epDNaVQO-Wm4O7-uclrk-c51HiUaLU6PS4o8bW2sJ25V8r8y8vnrvbwrMhLES9paFBZREYKPCIzsN5cABsHrjkysRIDzBMqHN4-Hcz11OsmkOoivhUhssCP4bJn7npIJIu2f0I Oct 18 15:24:41.395206 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:24:41.395206 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:24:41.395206 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:24:41.395206 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:24:41.395206 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:24:41.395206 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:24:41.395206 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: b762e808e9b04a15b7d875ee384600da Oct 18 15:24:41.395206 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-719009267 Oct 18 15:24:41.395206 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:24:41.395206 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:24:41.396353 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b762e808e9b04a15b7d875ee384600da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b762e808e9b04a15b7d875ee384600da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b762e808e9b04a15b7d875ee384600da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b762e808e9b04a15b7d875ee384600da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:24:41.396353 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-HostsAdminNegativeTestJSON-719009267 Oct 18 15:24:41.396353 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: b762e808e9b04a15b7d875ee384600da Oct 18 15:24:41.396353 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-719009267 Oct 18 15:24:41.396353 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-HostsAdminNegativeTestJSON-719009267-project Oct 18 15:24:41.396353 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:24:41.396353 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:24:41.396353 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: d67e6b6c2fb84e10a9c0a72c1426ff1f Oct 18 15:24:41.396353 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-HostsAdminNegativeTestJSON-719009267-project Oct 18 15:24:41.396353 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:24:41.396353 n-d-853682-5 devstack@n-api.service[120406]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 18 15:24:41.396353 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'n-d-853682-5'} Oct 18 15:24:41.396353 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:24:41.397267 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:41.397267 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:41.397267 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:41.397267 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:24:41.397267 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:24:41.397267 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:24:41.397267 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:24:41.397267 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:24:41.397267 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:24:41.397267 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 18 15:24:41.397267 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 18 15:24:41.397267 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 15:24:41.397267 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 15:24:41.397267 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 15:24:41.397267 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 15:24:41.397267 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 15:24:41.397267 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 15:24:41.397267 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 15:24:41.397267 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 15:24:41.398252 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 15:24:41.398252 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 15:24:41.398252 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 15:24:41.398252 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 15:24:41.398252 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 15:24:41.398252 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 15:24:41.398252 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 18 15:24:41.398252 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.398252 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:41.398252 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.398252 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:41.398252 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:41.398252 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:41.398252 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 15:24:41.398252 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 15:24:41.398252 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 18 15:24:41.398252 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.399247 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e3587083-21fd-4477-ac22-ff71f4869790 tempest-HostsAdminNegativeTestJSON-719009267 tempest-HostsAdminNegativeTestJSON-719009267-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:24:41.399247 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e3587083-21fd-4477-ac22-ff71f4869790 tempest-HostsAdminNegativeTestJSON-719009267 tempest-HostsAdminNegativeTestJSON-719009267-project] 10.222.0.60 "GET /compute/v2.1/os-hosts/n-d-853682-5/startup" status: 403 len: 110 microversion: 2.1 time: 0.010017 Oct 18 15:24:41.401340 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 74/123] 10.222.0.60 () {58 vars in 1191 bytes} [Tue Oct 18 15:24:41 2022] GET /compute/v2.1/os-hosts/n-d-853682-5/startup => generated 110 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 18 15:24:41.407345 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-edb40cf6-6510-4908-89c4-d96a92a9019c tempest-HostsAdminNegativeTestJSON-74774385 tempest-HostsAdminNegativeTestJSON-74774385-project-admin] Calling method '.version_select at 0x7f7c3dffdaf0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:41.414843 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-66a5972d-766f-47ec-8090-f3a2e0edda1e tempest-FlavorsAdminTestJSON-947563703 tempest-FlavorsAdminTestJSON-947563703-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:41.432356 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-edb40cf6-6510-4908-89c4-d96a92a9019c tempest-HostsAdminNegativeTestJSON-74774385 tempest-HostsAdminNegativeTestJSON-74774385-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 15:24:41.438314 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-edb40cf6-6510-4908-89c4-d96a92a9019c tempest-HostsAdminNegativeTestJSON-74774385 tempest-HostsAdminNegativeTestJSON-74774385-project-admin] Request method failure captured: Oct 18 15:24:41.438314 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 18 15:24:41.438314 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:24:41.438314 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:24:41.438314 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:24:41.438314 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:24:41.438314 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:24:41.438314 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:24:41.438314 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:24:41.438314 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:24:41.438314 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsU4_ZElgylfPqGWgcHdYsgWNgBn47mS3BNhswjY0Gxu4ftvEnMbQDgvlH1_S55pG_ShnH4SghCTgDl43itGNUxyNNIT1ZusBRq5QCakPlJUo_-aCuEfJt7sri7Zk68pfEu-_RDXFDUgQa2jdz-mCQ5MtfPz2G-q5V79H197QxdzEGA Oct 18 15:24:41.438314 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:24:41.438314 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:24:41.438314 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:24:41.438314 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:24:41.438314 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:24:41.438314 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:24:41.438314 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 01f0115a589240168934d17b39e40ebb Oct 18 15:24:41.438314 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-74774385 Oct 18 15:24:41.438314 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,admin,reader Oct 18 15:24:41.438314 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,admin,reader Oct 18 15:24:41.439552 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/01f0115a589240168934d17b39e40ebb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/01f0115a589240168934d17b39e40ebb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/01f0115a589240168934d17b39e40ebb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_01f0115a589240168934d17b39e40ebb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:24:41.439552 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-HostsAdminNegativeTestJSON-74774385 Oct 18 15:24:41.439552 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 01f0115a589240168934d17b39e40ebb Oct 18 15:24:41.439552 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-74774385 Oct 18 15:24:41.439552 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-HostsAdminNegativeTestJSON-74774385-project-admin Oct 18 15:24:41.439552 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:24:41.439552 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:24:41.439552 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 7aca8397c08d4b8692c03782b9b3fa3b Oct 18 15:24:41.439552 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-HostsAdminNegativeTestJSON-74774385-project-admin Oct 18 15:24:41.439552 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:24:41.439552 n-d-853682-5 devstack@n-api.service[120406]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 15:24:41.439552 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'nonexistent_hostname'} Oct 18 15:24:41.439552 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:24:41.440227 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:41.440227 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 18 15:24:41.440227 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 18 15:24:41.440227 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 15:24:41.440227 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 15:24:41.440227 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 15:24:41.440227 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 15:24:41.440227 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 15:24:41.440227 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 15:24:41.440227 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 15:24:41.440227 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 15:24:41.440227 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 18 15:24:41.440227 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 18 15:24:41.440227 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 15:24:41.440227 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 15:24:41.440227 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 18 15:24:41.440227 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 18 15:24:41.440227 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 15:24:41.440227 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 15:24:41.441215 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 18 15:24:41.441215 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 18 15:24:41.441215 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 15:24:41.441215 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.441215 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:41.441215 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.441215 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:41.441215 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:41.441215 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:41.441215 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:24:41.441215 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:24:41.441215 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:24:41.441215 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:24:41.441215 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:24:41.441215 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:24:41.441215 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 18 15:24:41.441215 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 18 15:24:41.441215 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 18 15:24:41.441215 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:24:41.442265 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 15:24:41.442265 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.442265 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:41.442265 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.442265 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:41.442265 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:41.442265 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:41.442265 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:24:41.442265 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:24:41.442265 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 15:24:41.442265 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.442265 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-edb40cf6-6510-4908-89c4-d96a92a9019c tempest-HostsAdminNegativeTestJSON-74774385 tempest-HostsAdminNegativeTestJSON-74774385-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:24:41.442265 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-edb40cf6-6510-4908-89c4-d96a92a9019c tempest-HostsAdminNegativeTestJSON-74774385 tempest-HostsAdminNegativeTestJSON-74774385-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.037653 Oct 18 15:24:41.442265 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 75/124] 10.222.0.60 () {58 vars in 1215 bytes} [Tue Oct 18 15:24:41 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 15:24:41.452176 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-66a5972d-766f-47ec-8090-f3a2e0edda1e tempest-FlavorsAdminTestJSON-947563703 tempest-FlavorsAdminTestJSON-947563703-project] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.334997 Oct 18 15:24:41.457547 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-641cd7f4-f968-4d35-b766-c46195bc3d97 tempest-HostsAdminNegativeTestJSON-74774385 tempest-HostsAdminNegativeTestJSON-74774385-project-admin] Action: 'update', calling method: .version_select at 0x7f7c3e1e1ca0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:24:41.458019 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 50/125] 10.222.0.60 () {58 vars in 1146 bytes} [Tue Oct 18 15:24:41 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:41.478964 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-25c0f902-c48c-447f-bba1-fc2c8726fa02 tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:41.481618 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-641cd7f4-f968-4d35-b766-c46195bc3d97 tempest-HostsAdminNegativeTestJSON-74774385 tempest-HostsAdminNegativeTestJSON-74774385-project-admin] Request method failure captured: Oct 18 15:24:41.481618 n-d-853682-5 devstack@n-api.service[120406]: request: PUT /compute/v2.1/os-hosts/n-d-853682-5 HTTP/1.1 Oct 18 15:24:41.481618 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:24:41.481618 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:24:41.481618 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:24:41.481618 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 51 Oct 18 15:24:41.481618 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:24:41.481618 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:24:41.481618 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:24:41.481618 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:24:41.481618 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsU4_ZElgylfPqGWgcHdYsgWNgBn47mS3BNhswjY0Gxu4ftvEnMbQDgvlH1_S55pG_ShnH4SghCTgDl43itGNUxyNNIT1ZusBRq5QCakPlJUo_-aCuEfJt7sri7Zk68pfEu-_RDXFDUgQa2jdz-mCQ5MtfPz2G-q5V79H197QxdzEGA Oct 18 15:24:41.481618 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:24:41.481618 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:24:41.481618 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:24:41.481618 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:24:41.481618 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:24:41.481618 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:24:41.481618 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 01f0115a589240168934d17b39e40ebb Oct 18 15:24:41.481618 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-74774385 Oct 18 15:24:41.481618 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,admin,reader Oct 18 15:24:41.481618 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,admin,reader Oct 18 15:24:41.482897 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/01f0115a589240168934d17b39e40ebb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/01f0115a589240168934d17b39e40ebb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/01f0115a589240168934d17b39e40ebb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_01f0115a589240168934d17b39e40ebb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:24:41.482897 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-HostsAdminNegativeTestJSON-74774385 Oct 18 15:24:41.482897 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 01f0115a589240168934d17b39e40ebb Oct 18 15:24:41.482897 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-74774385 Oct 18 15:24:41.482897 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-HostsAdminNegativeTestJSON-74774385-project-admin Oct 18 15:24:41.482897 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:24:41.482897 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:24:41.482897 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 7aca8397c08d4b8692c03782b9b3fa3b Oct 18 15:24:41.482897 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-HostsAdminNegativeTestJSON-74774385-project-admin Oct 18 15:24:41.482897 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:24:41.482897 n-d-853682-5 devstack@n-api.service[120406]: {"status": "enable", "maintenance_mode": "invalid"} Oct 18 15:24:41.482897 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:24:41.482897 n-d-853682-5 devstack@n-api.service[120406]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 18 15:24:41.484049 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'n-d-853682-5', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 18 15:24:41.484049 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:24:41.484049 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:41.484049 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 15:24:41.484049 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 15:24:41.484049 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 15:24:41.484049 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise error Oct 18 15:24:41.484049 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 18 15:24:41.484049 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.484049 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 18 15:24:41.484049 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 18 15:24:41.484049 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'disable', Oct 18 15:24:41.484049 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'Enable', Oct 18 15:24:41.484049 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'Disable', Oct 18 15:24:41.484049 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 18 15:24:41.484049 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 18 15:24:41.484049 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 18 15:24:41.484049 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.484049 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi On instance: Oct 18 15:24:41.484049 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'invalid' Oct 18 15:24:41.484049 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.484049 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:41.484049 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.484049 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:41.484049 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:41.485714 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:41.485714 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:24:41.485714 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:24:41.485714 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:24:41.485714 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:24:41.485714 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:24:41.485714 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:24:41.485714 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 15:24:41.485714 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 15:24:41.485714 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 15:24:41.485714 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 15:24:41.485714 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 15:24:41.485714 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 15:24:41.485714 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 18 15:24:41.485714 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.485714 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:41.485714 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.485714 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:41.485714 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:41.486904 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:41.486904 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 15:24:41.486904 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 15:24:41.486904 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 18 15:24:41.486904 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.488295 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-641cd7f4-f968-4d35-b766-c46195bc3d97 tempest-HostsAdminNegativeTestJSON-74774385 tempest-HostsAdminNegativeTestJSON-74774385-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:24:41.489402 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-641cd7f4-f968-4d35-b766-c46195bc3d97 tempest-HostsAdminNegativeTestJSON-74774385 tempest-HostsAdminNegativeTestJSON-74774385-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-hosts/n-d-853682-5" status: 400 len: 199 microversion: 2.1 time: 0.036203 Oct 18 15:24:41.490487 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 76/126] 10.222.0.60 () {60 vars in 1187 bytes} [Tue Oct 18 15:24:41 2022] PUT /compute/v2.1/os-hosts/n-d-853682-5 => generated 199 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:24:41.498726 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=12,nova_api:INSERT=6 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:24:41.501596 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-99306d0d-ff93-4ceb-8912-7ddf4076a144 tempest-HostsAdminNegativeTestJSON-74774385 tempest-HostsAdminNegativeTestJSON-74774385-project-admin] Action: 'update', calling method: .version_select at 0x7f7c3dfe9820>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:24:41.507593 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-99306d0d-ff93-4ceb-8912-7ddf4076a144 tempest-HostsAdminNegativeTestJSON-74774385 tempest-HostsAdminNegativeTestJSON-74774385-project-admin] Request method failure captured: Oct 18 15:24:41.507593 n-d-853682-5 devstack@n-api.service[120406]: request: PUT /compute/v2.1/os-hosts/n-d-853682-5 HTTP/1.1 Oct 18 15:24:41.507593 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:24:41.507593 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:24:41.507593 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:24:41.507593 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 51 Oct 18 15:24:41.507593 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:24:41.507593 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:24:41.507593 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:24:41.507593 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:24:41.507593 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsU4_ZElgylfPqGWgcHdYsgWNgBn47mS3BNhswjY0Gxu4ftvEnMbQDgvlH1_S55pG_ShnH4SghCTgDl43itGNUxyNNIT1ZusBRq5QCakPlJUo_-aCuEfJt7sri7Zk68pfEu-_RDXFDUgQa2jdz-mCQ5MtfPz2G-q5V79H197QxdzEGA Oct 18 15:24:41.507593 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:24:41.507593 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:24:41.507593 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:24:41.507593 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:24:41.507593 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:24:41.507593 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:24:41.507593 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 01f0115a589240168934d17b39e40ebb Oct 18 15:24:41.507593 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-74774385 Oct 18 15:24:41.507593 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,admin,reader Oct 18 15:24:41.507593 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,admin,reader Oct 18 15:24:41.509023 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/01f0115a589240168934d17b39e40ebb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/01f0115a589240168934d17b39e40ebb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/01f0115a589240168934d17b39e40ebb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_01f0115a589240168934d17b39e40ebb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:24:41.509023 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-HostsAdminNegativeTestJSON-74774385 Oct 18 15:24:41.509023 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 01f0115a589240168934d17b39e40ebb Oct 18 15:24:41.509023 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-74774385 Oct 18 15:24:41.509023 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-HostsAdminNegativeTestJSON-74774385-project-admin Oct 18 15:24:41.509023 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:24:41.509023 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:24:41.509023 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 7aca8397c08d4b8692c03782b9b3fa3b Oct 18 15:24:41.509023 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-HostsAdminNegativeTestJSON-74774385-project-admin Oct 18 15:24:41.509023 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:24:41.509023 n-d-853682-5 devstack@n-api.service[120406]: {"status": "invalid", "maintenance_mode": "enable"} Oct 18 15:24:41.509023 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:24:41.509023 n-d-853682-5 devstack@n-api.service[120406]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 18 15:24:41.510059 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'n-d-853682-5', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 18 15:24:41.510059 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:24:41.510059 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:41.510059 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 15:24:41.510059 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 15:24:41.510059 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 15:24:41.510059 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise error Oct 18 15:24:41.510059 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 18 15:24:41.510059 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.510059 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 18 15:24:41.510059 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 18 15:24:41.510059 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'disable', Oct 18 15:24:41.510059 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'Enable', Oct 18 15:24:41.510059 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'Disable', Oct 18 15:24:41.510059 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 18 15:24:41.510059 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 18 15:24:41.510059 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 18 15:24:41.510059 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.510059 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi On instance: Oct 18 15:24:41.510059 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'invalid' Oct 18 15:24:41.510059 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.510059 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:41.510059 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.510059 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:41.510059 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:41.511597 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:41.511597 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:24:41.511597 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:24:41.511597 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:24:41.511597 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:24:41.511597 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:24:41.511597 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:24:41.511597 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 15:24:41.511597 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 15:24:41.511597 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 15:24:41.511597 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 15:24:41.511597 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 15:24:41.511597 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 15:24:41.511597 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 18 15:24:41.511597 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.511597 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:41.511597 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.511597 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:41.511597 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:41.512776 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:41.512776 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 15:24:41.512776 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 15:24:41.512776 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 18 15:24:41.512776 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.512776 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-99306d0d-ff93-4ceb-8912-7ddf4076a144 tempest-HostsAdminNegativeTestJSON-74774385 tempest-HostsAdminNegativeTestJSON-74774385-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:24:41.512776 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-99306d0d-ff93-4ceb-8912-7ddf4076a144 tempest-HostsAdminNegativeTestJSON-74774385 tempest-HostsAdminNegativeTestJSON-74774385-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-hosts/n-d-853682-5" status: 400 len: 189 microversion: 2.1 time: 0.014787 Oct 18 15:24:41.513280 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-25c0f902-c48c-447f-bba1-fc2c8726fa02 tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/1005795867" status: 202 len: 0 microversion: 2.1 time: 0.037066 Oct 18 15:24:41.513679 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 77/127] 10.222.0.60 () {60 vars in 1187 bytes} [Tue Oct 18 15:24:41 2022] PUT /compute/v2.1/os-hosts/n-d-853682-5 => generated 189 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 18 15:24:41.515128 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 51/128] 10.222.0.60 () {58 vars in 1161 bytes} [Tue Oct 18 15:24:41 2022] DELETE /compute/v2.1/flavors/1005795867 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:24:41.527047 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5a19b404-9969-4a9b-85b6-e0a31f999ffd tempest-HostsAdminNegativeTestJSON-719009267 tempest-HostsAdminNegativeTestJSON-719009267-project] Action: 'update', calling method: .version_select at 0x7f7c3e017ca0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:24:41.530967 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5a19b404-9969-4a9b-85b6-e0a31f999ffd tempest-HostsAdminNegativeTestJSON-719009267 tempest-HostsAdminNegativeTestJSON-719009267-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'd67e6b6c2fb84e10a9c0a72c1426ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b762e808e9b04a15b7d875ee384600da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:24:41.532820 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bffd4879-7a37-47b5-8cd8-963d3ce129c5 tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:41.534661 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5a19b404-9969-4a9b-85b6-e0a31f999ffd tempest-HostsAdminNegativeTestJSON-719009267 tempest-HostsAdminNegativeTestJSON-719009267-project] Request method failure captured: Oct 18 15:24:41.534661 n-d-853682-5 devstack@n-api.service[120406]: request: PUT /compute/v2.1/os-hosts/n-d-853682-5 HTTP/1.1 Oct 18 15:24:41.534661 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:24:41.534661 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:24:41.534661 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:24:41.534661 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 50 Oct 18 15:24:41.534661 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:24:41.534661 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:24:41.534661 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:24:41.534661 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:24:41.534661 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsU2c7JxZNSYKWf5YHWWEt3OfMY59K0_9BgjS_sn9epDNaVQO-Wm4O7-uclrk-c51HiUaLU6PS4o8bW2sJ25V8r8y8vnrvbwrMhLES9paFBZREYKPCIzsN5cABsHrjkysRIDzBMqHN4-Hcz11OsmkOoivhUhssCP4bJn7npIJIu2f0I Oct 18 15:24:41.534661 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:24:41.534661 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:24:41.534661 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:24:41.534661 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:24:41.534661 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:24:41.534661 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:24:41.534661 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: b762e808e9b04a15b7d875ee384600da Oct 18 15:24:41.534661 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-719009267 Oct 18 15:24:41.534661 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:24:41.534661 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:24:41.535836 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b762e808e9b04a15b7d875ee384600da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b762e808e9b04a15b7d875ee384600da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b762e808e9b04a15b7d875ee384600da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b762e808e9b04a15b7d875ee384600da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:24:41.535836 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-HostsAdminNegativeTestJSON-719009267 Oct 18 15:24:41.535836 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: b762e808e9b04a15b7d875ee384600da Oct 18 15:24:41.535836 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-719009267 Oct 18 15:24:41.535836 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-HostsAdminNegativeTestJSON-719009267-project Oct 18 15:24:41.535836 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:24:41.535836 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:24:41.535836 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: d67e6b6c2fb84e10a9c0a72c1426ff1f Oct 18 15:24:41.535836 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-HostsAdminNegativeTestJSON-719009267-project Oct 18 15:24:41.535836 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:24:41.535836 n-d-853682-5 devstack@n-api.service[120406]: {"status": "enable", "maintenance_mode": "enable"} Oct 18 15:24:41.535836 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:24:41.535836 n-d-853682-5 devstack@n-api.service[120406]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 18 15:24:41.535836 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'n-d-853682-5', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 18 15:24:41.536567 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:24:41.536567 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:41.536567 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:41.536567 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:41.536567 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:24:41.536567 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:24:41.536567 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:24:41.536567 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:24:41.536567 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:24:41.536567 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:24:41.536567 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:24:41.536567 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:24:41.536567 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 18 15:24:41.536567 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 18 15:24:41.536567 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 15:24:41.536567 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 15:24:41.536567 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 15:24:41.536567 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 15:24:41.536567 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 15:24:41.536567 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 15:24:41.537967 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 15:24:41.537967 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 15:24:41.537967 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 15:24:41.537967 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 15:24:41.537967 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 15:24:41.537967 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 15:24:41.537967 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 15:24:41.537967 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 15:24:41.537967 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 18 15:24:41.537967 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.537967 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:41.537967 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.537967 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:41.537967 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:41.537967 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:41.537967 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 15:24:41.537967 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 15:24:41.537967 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 18 15:24:41.537967 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.538924 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5a19b404-9969-4a9b-85b6-e0a31f999ffd tempest-HostsAdminNegativeTestJSON-719009267 tempest-HostsAdminNegativeTestJSON-719009267-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:24:41.538924 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5a19b404-9969-4a9b-85b6-e0a31f999ffd tempest-HostsAdminNegativeTestJSON-719009267 tempest-HostsAdminNegativeTestJSON-719009267-project] 10.222.0.60 "PUT /compute/v2.1/os-hosts/n-d-853682-5" status: 403 len: 111 microversion: 2.1 time: 0.013653 Oct 18 15:24:41.541180 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 78/129] 10.222.0.60 () {60 vars in 1187 bytes} [Tue Oct 18 15:24:41 2022] PUT /compute/v2.1/os-hosts/n-d-853682-5 => generated 111 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:24:41.548933 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-63004b69-8907-475d-8931-083306999772 tempest-HostsAdminNegativeTestJSON-74774385 tempest-HostsAdminNegativeTestJSON-74774385-project-admin] Action: 'update', calling method: .version_select at 0x7f7c3df93820>, body: {"status": null, "maintenance_mode": null} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:24:41.553808 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-63004b69-8907-475d-8931-083306999772 tempest-HostsAdminNegativeTestJSON-74774385 tempest-HostsAdminNegativeTestJSON-74774385-project-admin] Request method failure captured: Oct 18 15:24:41.553808 n-d-853682-5 devstack@n-api.service[120406]: request: PUT /compute/v2.1/os-hosts/n-d-853682-5 HTTP/1.1 Oct 18 15:24:41.553808 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:24:41.553808 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:24:41.553808 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:24:41.553808 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 42 Oct 18 15:24:41.553808 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:24:41.553808 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:24:41.553808 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:24:41.553808 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:24:41.553808 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsU4_ZElgylfPqGWgcHdYsgWNgBn47mS3BNhswjY0Gxu4ftvEnMbQDgvlH1_S55pG_ShnH4SghCTgDl43itGNUxyNNIT1ZusBRq5QCakPlJUo_-aCuEfJt7sri7Zk68pfEu-_RDXFDUgQa2jdz-mCQ5MtfPz2G-q5V79H197QxdzEGA Oct 18 15:24:41.553808 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:24:41.553808 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:24:41.553808 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:24:41.553808 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:24:41.553808 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:24:41.553808 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:24:41.553808 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 01f0115a589240168934d17b39e40ebb Oct 18 15:24:41.553808 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-74774385 Oct 18 15:24:41.553808 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,admin,reader Oct 18 15:24:41.553808 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,admin,reader Oct 18 15:24:41.555083 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/01f0115a589240168934d17b39e40ebb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/01f0115a589240168934d17b39e40ebb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/01f0115a589240168934d17b39e40ebb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_01f0115a589240168934d17b39e40ebb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:24:41.555083 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-HostsAdminNegativeTestJSON-74774385 Oct 18 15:24:41.555083 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 01f0115a589240168934d17b39e40ebb Oct 18 15:24:41.555083 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-74774385 Oct 18 15:24:41.555083 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-HostsAdminNegativeTestJSON-74774385-project-admin Oct 18 15:24:41.555083 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:24:41.555083 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:24:41.555083 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 7aca8397c08d4b8692c03782b9b3fa3b Oct 18 15:24:41.555083 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-HostsAdminNegativeTestJSON-74774385-project-admin Oct 18 15:24:41.555083 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:24:41.555083 n-d-853682-5 devstack@n-api.service[120406]: {"status": null, "maintenance_mode": null} Oct 18 15:24:41.555083 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:24:41.555083 n-d-853682-5 devstack@n-api.service[120406]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 18 15:24:41.555083 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'n-d-853682-5', 'body': {'status': None, 'maintenance_mode': None}} Oct 18 15:24:41.555810 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:24:41.555810 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:41.555810 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 15:24:41.555810 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 15:24:41.555810 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 15:24:41.555810 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise error Oct 18 15:24:41.555810 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 18 15:24:41.555810 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.555810 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 18 15:24:41.555810 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 18 15:24:41.555810 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'disable', Oct 18 15:24:41.555810 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'Enable', Oct 18 15:24:41.555810 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'Disable', Oct 18 15:24:41.555810 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 18 15:24:41.555810 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 18 15:24:41.555810 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 18 15:24:41.555810 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.555810 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi On instance: Oct 18 15:24:41.555810 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi None Oct 18 15:24:41.555810 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.555810 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:41.555810 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.555810 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:41.555810 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:41.555810 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:41.557293 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:24:41.557293 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:24:41.557293 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:24:41.557293 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:24:41.557293 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:24:41.557293 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:24:41.557293 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 15:24:41.557293 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 15:24:41.557293 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 15:24:41.557293 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 15:24:41.557293 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 15:24:41.557293 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 15:24:41.557293 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 18 15:24:41.557293 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.557293 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:41.557293 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.557293 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:41.557293 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:41.557293 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:41.558416 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 15:24:41.558416 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 15:24:41.558416 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 18 15:24:41.558416 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.558416 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-63004b69-8907-475d-8931-083306999772 tempest-HostsAdminNegativeTestJSON-74774385 tempest-HostsAdminNegativeTestJSON-74774385-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:24:41.558416 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-63004b69-8907-475d-8931-083306999772 tempest-HostsAdminNegativeTestJSON-74774385 tempest-HostsAdminNegativeTestJSON-74774385-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-hosts/n-d-853682-5" status: 400 len: 127 microversion: 2.1 time: 0.012748 Oct 18 15:24:41.561562 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 79/130] 10.222.0.60 () {60 vars in 1187 bytes} [Tue Oct 18 15:24:41 2022] PUT /compute/v2.1/os-hosts/n-d-853682-5 => generated 127 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:24:41.567376 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-395dea1d-5ffd-49f4-ba29-a648ab8ed6da tempest-HostsAdminNegativeTestJSON-74774385 tempest-HostsAdminNegativeTestJSON-74774385-project-admin] Action: 'update', calling method: .version_select at 0x7f7c3df93f70>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:24:41.570613 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.hosts [None req-395dea1d-5ffd-49f4-ba29-a648ab8ed6da tempest-HostsAdminNegativeTestJSON-74774385 tempest-HostsAdminNegativeTestJSON-74774385-project-admin] Enabling host nonexistent_hostname. Oct 18 15:24:41.572447 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-bffd4879-7a37-47b5-8cd8-963d3ce129c5 tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.048265 Oct 18 15:24:41.572936 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 52/131] 10.222.0.60 () {58 vars in 1146 bytes} [Tue Oct 18 15:24:41 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:41.597183 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-966fd41b-3a72-49c8-95bf-9774ba03473e tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1490126684", "id": 696380772, "os-flavor-access:is_public": "False"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:24:41.601948 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-395dea1d-5ffd-49f4-ba29-a648ab8ed6da tempest-HostsAdminNegativeTestJSON-74774385 tempest-HostsAdminNegativeTestJSON-74774385-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 15:24:41.605372 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-395dea1d-5ffd-49f4-ba29-a648ab8ed6da tempest-HostsAdminNegativeTestJSON-74774385 tempest-HostsAdminNegativeTestJSON-74774385-project-admin] Request method failure captured: Oct 18 15:24:41.605372 n-d-853682-5 devstack@n-api.service[120406]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 18 15:24:41.605372 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:24:41.605372 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:24:41.605372 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:24:41.605372 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 50 Oct 18 15:24:41.605372 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:24:41.605372 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:24:41.605372 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:24:41.605372 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:24:41.605372 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsU4_ZElgylfPqGWgcHdYsgWNgBn47mS3BNhswjY0Gxu4ftvEnMbQDgvlH1_S55pG_ShnH4SghCTgDl43itGNUxyNNIT1ZusBRq5QCakPlJUo_-aCuEfJt7sri7Zk68pfEu-_RDXFDUgQa2jdz-mCQ5MtfPz2G-q5V79H197QxdzEGA Oct 18 15:24:41.605372 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:24:41.605372 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:24:41.605372 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:24:41.605372 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:24:41.605372 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:24:41.605372 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:24:41.605372 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 01f0115a589240168934d17b39e40ebb Oct 18 15:24:41.605372 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-74774385 Oct 18 15:24:41.605372 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,admin,reader Oct 18 15:24:41.605372 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,admin,reader Oct 18 15:24:41.606735 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/01f0115a589240168934d17b39e40ebb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/01f0115a589240168934d17b39e40ebb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/01f0115a589240168934d17b39e40ebb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_01f0115a589240168934d17b39e40ebb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:24:41.606735 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-HostsAdminNegativeTestJSON-74774385 Oct 18 15:24:41.606735 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 01f0115a589240168934d17b39e40ebb Oct 18 15:24:41.606735 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-74774385 Oct 18 15:24:41.606735 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-HostsAdminNegativeTestJSON-74774385-project-admin Oct 18 15:24:41.606735 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:24:41.606735 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:24:41.606735 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 7aca8397c08d4b8692c03782b9b3fa3b Oct 18 15:24:41.606735 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-HostsAdminNegativeTestJSON-74774385-project-admin Oct 18 15:24:41.606735 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:24:41.606735 n-d-853682-5 devstack@n-api.service[120406]: {"status": "enable", "maintenance_mode": "enable"} Oct 18 15:24:41.606735 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:24:41.606735 n-d-853682-5 devstack@n-api.service[120406]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 15:24:41.606735 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 18 15:24:41.607583 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:24:41.607583 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:41.607583 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 18 15:24:41.607583 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 18 15:24:41.607583 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 15:24:41.607583 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 15:24:41.607583 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 15:24:41.607583 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 15:24:41.607583 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 15:24:41.607583 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 15:24:41.607583 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 15:24:41.607583 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 15:24:41.607583 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 18 15:24:41.607583 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 18 15:24:41.607583 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 15:24:41.607583 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 15:24:41.607583 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 18 15:24:41.607583 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 18 15:24:41.608635 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 15:24:41.608635 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 15:24:41.608635 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 18 15:24:41.608635 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 18 15:24:41.608635 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 15:24:41.608635 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.608635 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:41.608635 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.608635 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:41.608635 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:41.608635 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:41.608635 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:24:41.608635 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:24:41.608635 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:24:41.608635 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:24:41.608635 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:24:41.608635 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:24:41.608635 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:24:41.608635 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:24:41.608635 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 18 15:24:41.610987 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 18 15:24:41.610987 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 18 15:24:41.610987 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:24:41.610987 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 15:24:41.610987 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.610987 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:41.610987 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.610987 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:41.610987 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:41.610987 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:41.610987 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:24:41.610987 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:24:41.610987 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 15:24:41.610987 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.614300 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-395dea1d-5ffd-49f4-ba29-a648ab8ed6da tempest-HostsAdminNegativeTestJSON-74774385 tempest-HostsAdminNegativeTestJSON-74774385-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:24:41.615216 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-395dea1d-5ffd-49f4-ba29-a648ab8ed6da tempest-HostsAdminNegativeTestJSON-74774385 tempest-HostsAdminNegativeTestJSON-74774385-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.051614 Oct 18 15:24:41.615970 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 80/132] 10.222.0.60 () {60 vars in 1211 bytes} [Tue Oct 18 15:24:41 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 15:24:41.633558 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-966fd41b-3a72-49c8-95bf-9774ba03473e tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.045075 Oct 18 15:24:41.634564 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 53/133] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:24:41 2022] POST /compute/v2.1/flavors => generated 427 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:24:41.647278 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ea0d7e53-0446-44ff-b254-ff8daa2581d3 tempest-FlavorsAdminTestJSON-947563703 tempest-FlavorsAdminTestJSON-947563703-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "696380772"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:24:41.661165 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-ea0d7e53-0446-44ff-b254-ff8daa2581d3 tempest-FlavorsAdminTestJSON-947563703 tempest-FlavorsAdminTestJSON-947563703-project] HTTP exception thrown: Flavor 696380772 could not be found. Oct 18 15:24:41.667366 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ea0d7e53-0446-44ff-b254-ff8daa2581d3 tempest-FlavorsAdminTestJSON-947563703 tempest-FlavorsAdminTestJSON-947563703-project] Request method failure captured: Oct 18 15:24:41.667366 n-d-853682-5 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 15:24:41.667366 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:24:41.667366 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:24:41.667366 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:24:41.667366 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 106 Oct 18 15:24:41.667366 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:24:41.667366 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:24:41.667366 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:24:41.667366 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:24:41.667366 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsUyh5MrU4g_RDj4n4-OthbSWVUuiNvSgsjhE5zVPkiwokw79Trr4vVPuLOjEc-EM8s0ljh_ndGylbpXLfk8iBA0a2aOU2CMGopyoKSf8EOVnrTGzLtVHTwrsu-THIT9Gcuo9hApx4KUrkXNtnb8ceRoSaGNIn2wkDUo7JGxkMYH4mQ Oct 18 15:24:41.667366 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:24:41.667366 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:24:41.667366 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:24:41.667366 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:24:41.667366 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:24:41.667366 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:24:41.667366 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 93e30d545fef4820b42775c6c361cc3c Oct 18 15:24:41.667366 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-FlavorsAdminTestJSON-947563703 Oct 18 15:24:41.667366 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:24:41.667366 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:24:41.668633 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/93e30d545fef4820b42775c6c361cc3c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/93e30d545fef4820b42775c6c361cc3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/93e30d545fef4820b42775c6c361cc3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_93e30d545fef4820b42775c6c361cc3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:24:41.668633 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-FlavorsAdminTestJSON-947563703 Oct 18 15:24:41.668633 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 93e30d545fef4820b42775c6c361cc3c Oct 18 15:24:41.668633 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-947563703 Oct 18 15:24:41.668633 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-FlavorsAdminTestJSON-947563703-project Oct 18 15:24:41.668633 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:24:41.668633 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:24:41.668633 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: e7997f0aaa3446c2b78f91feff99d6c2 Oct 18 15:24:41.668633 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-FlavorsAdminTestJSON-947563703-project Oct 18 15:24:41.668633 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:24:41.668633 n-d-853682-5 devstack@n-api.service[120406]: {"server": {"name": "test", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "696380772"}} Oct 18 15:24:41.668633 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:24:41.668633 n-d-853682-5 devstack@n-api.service[120406]: exception: Flavor 696380772 could not be found. Oct 18 15:24:41.669454 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '8f4db252-bff6-4685-9c8d-4c5d6bd9f78b', 'flavorRef': '696380772'}}} Oct 18 15:24:41.669454 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:24:41.669454 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:41.669454 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 18 15:24:41.669454 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 18 15:24:41.669454 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 18 15:24:41.669454 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 18 15:24:41.669454 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 15:24:41.669454 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 15:24:41.669454 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 18 15:24:41.669454 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 18 15:24:41.669454 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 18 15:24:41.669454 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:24:41.669454 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 18 15:24:41.669454 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 18 15:24:41.669454 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 696380772 could not be found. Oct 18 15:24:41.669454 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.669454 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:41.669454 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.669454 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:41.670465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:41.670465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:41.670465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:24:41.670465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:24:41.670465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:24:41.670465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:24:41.670465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:24:41.670465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:24:41.670465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:24:41.670465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:24:41.670465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:24:41.670465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:24:41.670465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 18 15:24:41.670465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 18 15:24:41.670465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 18 15:24:41.670465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 696380772 could not be found. Oct 18 15:24:41.670465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.670465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:41.670465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.670465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:41.670465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:41.671500 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:41.671500 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:24:41.671500 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:24:41.671500 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 696380772 could not be found. Oct 18 15:24:41.671500 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:24:41.675015 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ea0d7e53-0446-44ff-b254-ff8daa2581d3 tempest-FlavorsAdminTestJSON-947563703 tempest-FlavorsAdminTestJSON-947563703-project] Returning 400 to user: Flavor 696380772 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:24:41.676051 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ea0d7e53-0446-44ff-b254-ff8daa2581d3 tempest-FlavorsAdminTestJSON-947563703 tempest-FlavorsAdminTestJSON-947563703-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.033095 Oct 18 15:24:41.676800 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 81/134] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:24:41 2022] POST /compute/v2.1/servers => generated 80 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 18 15:24:41.695971 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-98969d7f-0cf0-49a3-b45c-6c963112b7cb tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:41.718500 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-98969d7f-0cf0-49a3-b45c-6c963112b7cb tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/696380772" status: 202 len: 0 microversion: 2.1 time: 0.036949 Oct 18 15:24:41.728923 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f33fdb37-32ec-4686-9154-f7f157ea4888 tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:41.730721 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 54/135] 10.222.0.60 () {58 vars in 1158 bytes} [Tue Oct 18 15:24:41 2022] DELETE /compute/v2.1/flavors/696380772 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:24:41.764234 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f33fdb37-32ec-4686-9154-f7f157ea4888 tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038988 Oct 18 15:24:41.770421 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 82/136] 10.222.0.60 () {58 vars in 1146 bytes} [Tue Oct 18 15:24:41 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:24:41.790045 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-18c733b2-ddf0-487b-a052-a46749a03fab tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-904050785", "id": 1946989742, "os-flavor-access:is_public": "False"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:24:41.836080 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2ea0f040-d7a3-4cd7-b83e-1fb8b01c3532 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:41.837134 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2ea0f040-d7a3-4cd7-b83e-1fb8b01c3532 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: 2dea609b-60cd-4634-b6d6-f5e3e085c1a3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:24:41.852180 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2ea0f040-d7a3-4cd7-b83e-1fb8b01c3532 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:41.852711 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2ea0f040-d7a3-4cd7-b83e-1fb8b01c3532 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:41.855742 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-18c733b2-ddf0-487b-a052-a46749a03fab tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.069885 Oct 18 15:24:41.858322 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 55/137] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:24:41 2022] POST /compute/v2.1/flavors => generated 414 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:24:41.858920 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2ea0f040-d7a3-4cd7-b83e-1fb8b01c3532 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:41.864702 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2ea0f040-d7a3-4cd7-b83e-1fb8b01c3532 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:41.866322 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2ea0f040-d7a3-4cd7-b83e-1fb8b01c3532 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:41.866831 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2ea0f040-d7a3-4cd7-b83e-1fb8b01c3532 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:41.877938 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f66ef3e5-4997-4467-bc25-e3c2b6e09a84 tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-598367445", "id": 244701322, "os-flavor-access:is_public": "True"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:24:41.932181 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f66ef3e5-4997-4467-bc25-e3c2b6e09a84 tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.064888 Oct 18 15:24:41.934165 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 56/138] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:24:41 2022] POST /compute/v2.1/flavors => generated 410 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:24:41.952417 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1ffcee86-f9b1-4114-9c01-49e3860483b7 tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:41.990687 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1ffcee86-f9b1-4114-9c01-49e3860483b7 tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 417 microversion: 2.1 time: 0.043798 Oct 18 15:24:41.991362 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 57/139] 10.222.0.60 () {58 vars in 1169 bytes} [Tue Oct 18 15:24:41 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 417 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:24:42.007336 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-48eb66c0-3ab4-4187-9097-a9bd8ac5647a tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:42.023661 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-48eb66c0-3ab4-4187-9097-a9bd8ac5647a tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 417 microversion: 2.1 time: 0.023100 Oct 18 15:24:42.026468 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 58/140] 10.222.0.60 () {58 vars in 1177 bytes} [Tue Oct 18 15:24:41 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 417 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:24:42.043016 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2ea0f040-d7a3-4cd7-b83e-1fb8b01c3532 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:24:42.044045 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6e9c9374-6d78-453f-9711-ad9b7ef477dc tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:42.051655 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2ea0f040-d7a3-4cd7-b83e-1fb8b01c3532 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3" status: 200 len: 1281 microversion: 2.1 time: 0.219614 Oct 18 15:24:42.053468 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 83/141] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:24:41 2022] GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3 => generated 1281 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:42.067031 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6e9c9374-6d78-453f-9711-ad9b7ef477dc tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 417 microversion: 2.1 time: 0.033284 Oct 18 15:24:42.069165 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 59/142] 10.222.0.60 () {58 vars in 1171 bytes} [Tue Oct 18 15:24:42 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 417 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:24:42.081224 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-780603a8-28d7-4e5f-afa4-b2ad94613e78 tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:42.107816 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-780603a8-28d7-4e5f-afa4-b2ad94613e78 tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 417 microversion: 2.1 time: 0.030098 Oct 18 15:24:42.110786 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 84/143] 10.222.0.60 () {58 vars in 1169 bytes} [Tue Oct 18 15:24:42 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 417 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:24:42.122090 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a7533f28-1887-465b-b90c-32a8d6d93cac tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:42.139272 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-da160eba-bbc7-4258-8163-9d5332dc401c tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:42.140134 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-da160eba-bbc7-4258-8163-9d5332dc401c tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] [instance: 3f5d6640-30f6-490b-984f-d1169918133f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:24:42.152331 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da160eba-bbc7-4258-8163-9d5332dc401c tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:42.152701 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da160eba-bbc7-4258-8163-9d5332dc401c tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:42.155402 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da160eba-bbc7-4258-8163-9d5332dc401c tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:42.157374 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da160eba-bbc7-4258-8163-9d5332dc401c tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:42.157873 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da160eba-bbc7-4258-8163-9d5332dc401c tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:42.159298 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da160eba-bbc7-4258-8163-9d5332dc401c tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:42.172246 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a7533f28-1887-465b-b90c-32a8d6d93cac tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5391 microversion: 2.1 time: 0.053532 Oct 18 15:24:42.178285 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 60/144] 10.222.0.60 () {58 vars in 1169 bytes} [Tue Oct 18 15:24:42 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5391 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:42.201143 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-dceecfdc-bd93-4ed0-8aaa-a7f8ab5a3659 tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:42.239470 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-dceecfdc-bd93-4ed0-8aaa-a7f8ab5a3659 tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5391 microversion: 2.1 time: 0.044107 Oct 18 15:24:42.240966 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 61/145] 10.222.0.60 () {58 vars in 1175 bytes} [Tue Oct 18 15:24:42 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5391 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:24:42.268110 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c749d554-0f46-4977-9fe4-00bcdeb6f01a tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:42.312515 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c749d554-0f46-4977-9fe4-00bcdeb6f01a tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5391 microversion: 2.1 time: 0.051389 Oct 18 15:24:42.313778 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 62/146] 10.222.0.60 () {58 vars in 1173 bytes} [Tue Oct 18 15:24:42 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5391 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:42.334364 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1adf77c2-a804-4855-86c3-f2afbe1f41ea tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:42.365621 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1adf77c2-a804-4855-86c3-f2afbe1f41ea tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5391 microversion: 2.1 time: 0.036418 Oct 18 15:24:42.366634 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 63/147] 10.222.0.60 () {58 vars in 1169 bytes} [Tue Oct 18 15:24:42 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5391 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:42.386662 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fe8626c2-a97a-44be-b759-eef55a5f441d tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:42.412652 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fe8626c2-a97a-44be-b759-eef55a5f441d tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/244701322" status: 202 len: 0 microversion: 2.1 time: 0.029966 Oct 18 15:24:42.414063 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 64/148] 10.222.0.60 () {58 vars in 1158 bytes} [Tue Oct 18 15:24:42 2022] DELETE /compute/v2.1/flavors/244701322 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 15:24:42.423975 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6ce0d938-699e-4239-9a33-054c2214e1ad tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:42.461303 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6ce0d938-699e-4239-9a33-054c2214e1ad tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.042768 Oct 18 15:24:42.463008 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 65/149] 10.222.0.60 () {58 vars in 1146 bytes} [Tue Oct 18 15:24:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:24:42.493281 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b9e8d092-fc86-4a41-adc3-bce28accdfc5 tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:42.548082 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b9e8d092-fc86-4a41-adc3-bce28accdfc5 tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/1946989742" status: 202 len: 0 microversion: 2.1 time: 0.052945 Oct 18 15:24:42.552929 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 66/150] 10.222.0.60 () {58 vars in 1161 bytes} [Tue Oct 18 15:24:42 2022] DELETE /compute/v2.1/flavors/1946989742 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:24:42.564683 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7e6d1369-2d97-4b60-8f82-d7493c9981c6 tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:42.605160 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-da160eba-bbc7-4258-8163-9d5332dc401c tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72c1406934749cdaf643c4370dbd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e72a93e9d51401c991e34b7e0f62ed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:24:42.608049 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7e6d1369-2d97-4b60-8f82-d7493c9981c6 tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.048288 Oct 18 15:24:42.608049 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 67/151] 10.222.0.60 () {58 vars in 1146 bytes} [Tue Oct 18 15:24:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:42.631833 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-da160eba-bbc7-4258-8163-9d5332dc401c tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] 10.222.0.60 "GET /compute/v2.1/servers/3f5d6640-30f6-490b-984f-d1169918133f" status: 200 len: 1339 microversion: 2.1 time: 0.497019 Oct 18 15:24:42.633216 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 85/152] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:24:42 2022] GET /compute/v2.1/servers/3f5d6640-30f6-490b-984f-d1169918133f => generated 1339 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:42.637696 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a416be08-9c91-4619-bda4-a25416304b4c tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-463921903", "id": 1431271946, "os-flavor-access:is_public": "False"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:24:42.681140 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a416be08-9c91-4619-bda4-a25416304b4c tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.053045 Oct 18 15:24:42.682622 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 68/153] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:24:42 2022] POST /compute/v2.1/flavors => generated 414 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:24:42.701407 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ef96d35a-569c-4f03-9b5a-ddd595421af8 tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:42.746225 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ef96d35a-569c-4f03-9b5a-ddd595421af8 tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.054988 Oct 18 15:24:42.747177 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 86/154] 10.222.0.60 () {58 vars in 1146 bytes} [Tue Oct 18 15:24:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:42.767650 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9e1eae6f-bdf2-4e56-8d41-60b8fd390105 tempest-FlavorsAdminTestJSON-947563703 tempest-FlavorsAdminTestJSON-947563703-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:42.795019 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9e1eae6f-bdf2-4e56-8d41-60b8fd390105 tempest-FlavorsAdminTestJSON-947563703 tempest-FlavorsAdminTestJSON-947563703-project] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033604 Oct 18 15:24:42.796199 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 69/155] 10.222.0.60 () {58 vars in 1146 bytes} [Tue Oct 18 15:24:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:42.821380 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-85f262d4-10e8-4d07-97b8-829faa68fed4 tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:42.848911 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-85f262d4-10e8-4d07-97b8-829faa68fed4 tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/1431271946" status: 202 len: 0 microversion: 2.1 time: 0.031097 Oct 18 15:24:42.853796 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 87/156] 10.222.0.60 () {58 vars in 1161 bytes} [Tue Oct 18 15:24:42 2022] DELETE /compute/v2.1/flavors/1431271946 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:24:42.858769 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f0844658-7c42-4f39-bf76-3ec443418cff tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:42.879604 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f0844658-7c42-4f39-bf76-3ec443418cff tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024895 Oct 18 15:24:42.880717 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 70/157] 10.222.0.60 () {58 vars in 1146 bytes} [Tue Oct 18 15:24:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:42.902783 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ff1a1348-37b9-4377-919c-c313f19f8abd tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1838191348", "id": 2105870012, "os-flavor-access:is_public": "True"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:24:42.931655 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ff1a1348-37b9-4377-919c-c313f19f8abd tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.032503 Oct 18 15:24:42.941019 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 88/158] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:24:42 2022] POST /compute/v2.1/flavors => generated 414 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:24:42.952890 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-931e4c9c-1a27-4302-be03-14bad5d94094 tempest-FlavorsAdminTestJSON-947563703 tempest-FlavorsAdminTestJSON-947563703-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:42.992362 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-931e4c9c-1a27-4302-be03-14bad5d94094 tempest-FlavorsAdminTestJSON-947563703 tempest-FlavorsAdminTestJSON-947563703-project] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.050851 Oct 18 15:24:42.993318 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 71/159] 10.222.0.60 () {58 vars in 1146 bytes} [Tue Oct 18 15:24:42 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:43.018021 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bfbee65d-8dca-4fa2-ba8e-2d657638ce85 tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:43.076578 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2b7f1954-80bb-408f-899e-d1d0a603e10b tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:43.077314 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2b7f1954-80bb-408f-899e-d1d0a603e10b tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: 2dea609b-60cd-4634-b6d6-f5e3e085c1a3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:24:43.090120 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2b7f1954-80bb-408f-899e-d1d0a603e10b tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:43.099431 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2b7f1954-80bb-408f-899e-d1d0a603e10b tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:43.099876 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bfbee65d-8dca-4fa2-ba8e-2d657638ce85 tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/2105870012" status: 202 len: 0 microversion: 2.1 time: 0.086141 Oct 18 15:24:43.102306 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2b7f1954-80bb-408f-899e-d1d0a603e10b tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:43.103263 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2b7f1954-80bb-408f-899e-d1d0a603e10b tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:43.105415 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2b7f1954-80bb-408f-899e-d1d0a603e10b tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:43.105611 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 89/160] 10.222.0.60 () {58 vars in 1161 bytes} [Tue Oct 18 15:24:43 2022] DELETE /compute/v2.1/flavors/2105870012 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:24:43.105867 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2b7f1954-80bb-408f-899e-d1d0a603e10b tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:43.127996 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-25a1e8e8-d2cd-4fb7-99a0-fc5b11152013 tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:43.163125 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-25a1e8e8-d2cd-4fb7-99a0-fc5b11152013 tempest-FlavorsAdminTestJSON-245196570 tempest-FlavorsAdminTestJSON-245196570-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.055369 Oct 18 15:24:43.204999 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 90/161] 10.222.0.60 () {58 vars in 1146 bytes} [Tue Oct 18 15:24:43 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:43.315403 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2b7f1954-80bb-408f-899e-d1d0a603e10b tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:24:43.329159 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2b7f1954-80bb-408f-899e-d1d0a603e10b tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3" status: 200 len: 1269 microversion: 2.1 time: 0.256966 Oct 18 15:24:43.349846 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 72/162] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:24:43 2022] GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3 => generated 1269 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:24:43.664994 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-986dcce9-d39e-4990-8b68-223de12f4d2e tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:43.665861 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-986dcce9-d39e-4990-8b68-223de12f4d2e tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] [instance: 3f5d6640-30f6-490b-984f-d1169918133f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:24:43.673091 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-986dcce9-d39e-4990-8b68-223de12f4d2e tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:43.673583 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-986dcce9-d39e-4990-8b68-223de12f4d2e tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:43.674181 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-986dcce9-d39e-4990-8b68-223de12f4d2e tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:43.675069 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-986dcce9-d39e-4990-8b68-223de12f4d2e tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:43.675678 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-986dcce9-d39e-4990-8b68-223de12f4d2e tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:43.676517 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-986dcce9-d39e-4990-8b68-223de12f4d2e tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:43.912659 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-986dcce9-d39e-4990-8b68-223de12f4d2e tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72c1406934749cdaf643c4370dbd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e72a93e9d51401c991e34b7e0f62ed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:24:43.929490 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-986dcce9-d39e-4990-8b68-223de12f4d2e tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] 10.222.0.60 "GET /compute/v2.1/servers/3f5d6640-30f6-490b-984f-d1169918133f" status: 200 len: 1339 microversion: 2.1 time: 0.269380 Oct 18 15:24:43.934740 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 91/163] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:24:43 2022] GET /compute/v2.1/servers/3f5d6640-30f6-490b-984f-d1169918133f => generated 1339 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:44.355229 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e1c06c39-31bf-4e61-89d0-53d7178413c4 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:44.355229 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e1c06c39-31bf-4e61-89d0-53d7178413c4 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: 2dea609b-60cd-4634-b6d6-f5e3e085c1a3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:24:44.362783 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e1c06c39-31bf-4e61-89d0-53d7178413c4 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:44.363405 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e1c06c39-31bf-4e61-89d0-53d7178413c4 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:44.363954 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e1c06c39-31bf-4e61-89d0-53d7178413c4 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:44.364871 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e1c06c39-31bf-4e61-89d0-53d7178413c4 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:44.365497 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e1c06c39-31bf-4e61-89d0-53d7178413c4 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:44.366368 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e1c06c39-31bf-4e61-89d0-53d7178413c4 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:44.565849 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e1c06c39-31bf-4e61-89d0-53d7178413c4 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:24:44.588610 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e1c06c39-31bf-4e61-89d0-53d7178413c4 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3" status: 200 len: 1311 microversion: 2.1 time: 0.225358 Oct 18 15:24:44.589631 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 73/164] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:24:44 2022] GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3 => generated 1311 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:44.952278 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7dd72baf-79c8-4efe-965b-154da380976a tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:44.952948 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7dd72baf-79c8-4efe-965b-154da380976a tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] [instance: 3f5d6640-30f6-490b-984f-d1169918133f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:24:44.973474 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7dd72baf-79c8-4efe-965b-154da380976a tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:44.974018 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7dd72baf-79c8-4efe-965b-154da380976a tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:44.974480 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7dd72baf-79c8-4efe-965b-154da380976a tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:44.975232 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7dd72baf-79c8-4efe-965b-154da380976a tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:44.975699 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7dd72baf-79c8-4efe-965b-154da380976a tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:44.976124 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7dd72baf-79c8-4efe-965b-154da380976a tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:44.980938 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=95 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:24:45.308595 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7dd72baf-79c8-4efe-965b-154da380976a tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72c1406934749cdaf643c4370dbd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e72a93e9d51401c991e34b7e0f62ed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:24:45.323817 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7dd72baf-79c8-4efe-965b-154da380976a tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] 10.222.0.60 "GET /compute/v2.1/servers/3f5d6640-30f6-490b-984f-d1169918133f" status: 200 len: 1339 microversion: 2.1 time: 0.373549 Oct 18 15:24:45.334708 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 92/165] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:24:44 2022] GET /compute/v2.1/servers/3f5d6640-30f6-490b-984f-d1169918133f => generated 1339 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:45.617166 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-19b955b1-a78e-4007-9bc4-e510cea9f524 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:45.618284 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-19b955b1-a78e-4007-9bc4-e510cea9f524 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: 2dea609b-60cd-4634-b6d6-f5e3e085c1a3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:24:45.642227 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-19b955b1-a78e-4007-9bc4-e510cea9f524 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:45.642758 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-19b955b1-a78e-4007-9bc4-e510cea9f524 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:45.646865 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-19b955b1-a78e-4007-9bc4-e510cea9f524 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:45.648621 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-19b955b1-a78e-4007-9bc4-e510cea9f524 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:45.650192 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-19b955b1-a78e-4007-9bc4-e510cea9f524 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:45.650801 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-19b955b1-a78e-4007-9bc4-e510cea9f524 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:45.892512 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-19b955b1-a78e-4007-9bc4-e510cea9f524 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:24:45.901349 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-19b955b1-a78e-4007-9bc4-e510cea9f524 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3" status: 200 len: 1311 microversion: 2.1 time: 0.293530 Oct 18 15:24:45.902263 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 74/166] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:24:45 2022] GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3 => generated 1311 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:46.017322 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-b6ba8a47-f7cd-4c41-8bfc-c4f6c5cfa72b req-4a9caa7c-86d5-42bc-b67c-50401a6f6fc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f5d6640-30f6-490b-984f-d1169918133f", "name": "network-vif-plugged", "status": "completed", "tag": "50f1c833-7623-4007-aa9f-c33e88ab237f"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:24:46.038803 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b6ba8a47-f7cd-4c41-8bfc-c4f6c5cfa72b req-4a9caa7c-86d5-42bc-b67c-50401a6f6fc4 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:46.039663 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b6ba8a47-f7cd-4c41-8bfc-c4f6c5cfa72b req-4a9caa7c-86d5-42bc-b67c-50401a6f6fc4 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:46.040398 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b6ba8a47-f7cd-4c41-8bfc-c4f6c5cfa72b req-4a9caa7c-86d5-42bc-b67c-50401a6f6fc4 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:46.067635 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-b6ba8a47-f7cd-4c41-8bfc-c4f6c5cfa72b req-4a9caa7c-86d5-42bc-b67c-50401a6f6fc4 service nova] Creating event network-vif-plugged:50f1c833-7623-4007-aa9f-c33e88ab237f for instance 3f5d6640-30f6-490b-984f-d1169918133f on n-h2-853682-5 Oct 18 15:24:46.074770 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-b6ba8a47-f7cd-4c41-8bfc-c4f6c5cfa72b req-4a9caa7c-86d5-42bc-b67c-50401a6f6fc4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161161 Oct 18 15:24:46.077059 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 93/167] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:24:46.351663 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d4e0caab-87b7-4253-94c7-71ea58a6c87e tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:46.352482 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d4e0caab-87b7-4253-94c7-71ea58a6c87e tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] [instance: 3f5d6640-30f6-490b-984f-d1169918133f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:24:46.368365 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4e0caab-87b7-4253-94c7-71ea58a6c87e tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:46.370399 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4e0caab-87b7-4253-94c7-71ea58a6c87e tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:46.370932 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4e0caab-87b7-4253-94c7-71ea58a6c87e tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:46.372551 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4e0caab-87b7-4253-94c7-71ea58a6c87e tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:46.373652 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4e0caab-87b7-4253-94c7-71ea58a6c87e tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:46.375240 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4e0caab-87b7-4253-94c7-71ea58a6c87e tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:46.931842 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6b4eab4f-d044-4eb1-af73-373c96299a8e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:46.932617 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6b4eab4f-d044-4eb1-af73-373c96299a8e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: 2dea609b-60cd-4634-b6d6-f5e3e085c1a3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:24:46.945741 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b4eab4f-d044-4eb1-af73-373c96299a8e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:46.946248 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b4eab4f-d044-4eb1-af73-373c96299a8e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:46.946683 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b4eab4f-d044-4eb1-af73-373c96299a8e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:46.948003 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b4eab4f-d044-4eb1-af73-373c96299a8e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:46.950660 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b4eab4f-d044-4eb1-af73-373c96299a8e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:46.951654 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b4eab4f-d044-4eb1-af73-373c96299a8e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:47.100945 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d4e0caab-87b7-4253-94c7-71ea58a6c87e tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72c1406934749cdaf643c4370dbd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e72a93e9d51401c991e34b7e0f62ed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:24:47.107026 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=83 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:24:47.110274 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d4e0caab-87b7-4253-94c7-71ea58a6c87e tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] 10.222.0.60 "GET /compute/v2.1/servers/3f5d6640-30f6-490b-984f-d1169918133f" status: 200 len: 1339 microversion: 2.1 time: 0.765446 Oct 18 15:24:47.111202 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 75/168] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:24:46 2022] GET /compute/v2.1/servers/3f5d6640-30f6-490b-984f-d1169918133f => generated 1339 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:47.211406 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6b4eab4f-d044-4eb1-af73-373c96299a8e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:24:47.231854 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6b4eab4f-d044-4eb1-af73-373c96299a8e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3" status: 200 len: 1311 microversion: 2.1 time: 0.307200 Oct 18 15:24:47.232442 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 94/169] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:24:46 2022] GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3 => generated 1311 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:47.294184 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-12422d38-4c63-4957-83fb-bb4c43f9a8c0 tempest-FlavorsV2TestJSON-1379604053 tempest-FlavorsV2TestJSON-1379604053-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:47.302501 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-12422d38-4c63-4957-83fb-bb4c43f9a8c0 tempest-FlavorsV2TestJSON-1379604053 tempest-FlavorsV2TestJSON-1379604053-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.189832 Oct 18 15:24:47.303254 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 76/170] 10.222.0.60 () {58 vars in 1137 bytes} [Tue Oct 18 15:24:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:24:47.317374 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8a1da0a1-3ea0-4d0c-adf6-816bd19dc6b8 tempest-FlavorsV2TestJSON-1379604053 tempest-FlavorsV2TestJSON-1379604053-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:47.339030 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8a1da0a1-3ea0-4d0c-adf6-816bd19dc6b8 tempest-FlavorsV2TestJSON-1379604053 tempest-FlavorsV2TestJSON-1379604053-project] 10.222.0.60 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.025785 Oct 18 15:24:47.340445 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 95/171] 10.222.0.60 () {58 vars in 1125 bytes} [Tue Oct 18 15:24:47 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:47.355481 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7a1fbe47-3cc2-4388-8252-ec06d93e20b9 tempest-FlavorsV2TestJSON-1379604053 tempest-FlavorsV2TestJSON-1379604053-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:47.364721 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7a1fbe47-3cc2-4388-8252-ec06d93e20b9 tempest-FlavorsV2TestJSON-1379604053 tempest-FlavorsV2TestJSON-1379604053-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012993 Oct 18 15:24:47.373022 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 77/172] 10.222.0.60 () {58 vars in 1137 bytes} [Tue Oct 18 15:24:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:24:47.379243 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-196262f0-bfe0-44cf-a505-eb057aae7f36 tempest-FlavorsV2TestJSON-1379604053 tempest-FlavorsV2TestJSON-1379604053-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:47.388772 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-196262f0-bfe0-44cf-a505-eb057aae7f36 tempest-FlavorsV2TestJSON-1379604053 tempest-FlavorsV2TestJSON-1379604053-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013902 Oct 18 15:24:47.393242 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 96/173] 10.222.0.60 () {58 vars in 1137 bytes} [Tue Oct 18 15:24:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:24:47.402690 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-941ae0cb-f0d7-477b-82c7-a6739905a3fe tempest-FlavorsV2TestJSON-1379604053 tempest-FlavorsV2TestJSON-1379604053-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:47.452206 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-941ae0cb-f0d7-477b-82c7-a6739905a3fe tempest-FlavorsV2TestJSON-1379604053 tempest-FlavorsV2TestJSON-1379604053-project] 10.222.0.60 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.053904 Oct 18 15:24:47.454078 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 78/174] 10.222.0.60 () {58 vars in 1165 bytes} [Tue Oct 18 15:24:47 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:47.470893 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d83e9905-05c0-42c4-b217-2c1cd6b6ac38 tempest-FlavorsV2TestJSON-1379604053 tempest-FlavorsV2TestJSON-1379604053-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:47.480023 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d83e9905-05c0-42c4-b217-2c1cd6b6ac38 tempest-FlavorsV2TestJSON-1379604053 tempest-FlavorsV2TestJSON-1379604053-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013111 Oct 18 15:24:47.481087 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 97/175] 10.222.0.60 () {58 vars in 1137 bytes} [Tue Oct 18 15:24:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:24:47.492665 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-79abdfbd-13c5-4a2b-9c08-6605f3f62e9f tempest-FlavorsV2TestJSON-1379604053 tempest-FlavorsV2TestJSON-1379604053-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:47.521441 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-79abdfbd-13c5-4a2b-9c08-6605f3f62e9f tempest-FlavorsV2TestJSON-1379604053 tempest-FlavorsV2TestJSON-1379604053-project] 10.222.0.60 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.032711 Oct 18 15:24:47.533267 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 79/176] 10.222.0.60 () {58 vars in 1169 bytes} [Tue Oct 18 15:24:47 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:47.538094 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-206807cf-823a-45b8-aabf-a5de95289d3c tempest-FlavorsV2TestJSON-1379604053 tempest-FlavorsV2TestJSON-1379604053-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:47.559762 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-206807cf-823a-45b8-aabf-a5de95289d3c tempest-FlavorsV2TestJSON-1379604053 tempest-FlavorsV2TestJSON-1379604053-project] 10.222.0.60 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.025289 Oct 18 15:24:47.560327 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 98/177] 10.222.0.60 () {58 vars in 1161 bytes} [Tue Oct 18 15:24:47 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:24:47.574778 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-918d5734-c1d5-43f2-ab29-f8ba05d4bc03 tempest-FlavorsV2TestJSON-1379604053 tempest-FlavorsV2TestJSON-1379604053-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:47.583776 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-918d5734-c1d5-43f2-ab29-f8ba05d4bc03 tempest-FlavorsV2TestJSON-1379604053 tempest-FlavorsV2TestJSON-1379604053-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012595 Oct 18 15:24:47.589379 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 80/178] 10.222.0.60 () {58 vars in 1137 bytes} [Tue Oct 18 15:24:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:24:47.596625 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-62ee93c4-63cc-4b9f-b599-df9a61eaa28d tempest-FlavorsV2TestJSON-1379604053 tempest-FlavorsV2TestJSON-1379604053-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:47.640484 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-62ee93c4-63cc-4b9f-b599-df9a61eaa28d tempest-FlavorsV2TestJSON-1379604053 tempest-FlavorsV2TestJSON-1379604053-project] 10.222.0.60 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.047435 Oct 18 15:24:47.642540 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 99/179] 10.222.0.60 () {58 vars in 1167 bytes} [Tue Oct 18 15:24:47 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:47.658495 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-54e9edf1-bae5-45fc-bcbf-98da4a8ce54d tempest-FlavorsV2TestJSON-1379604053 tempest-FlavorsV2TestJSON-1379604053-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:47.670433 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-54e9edf1-bae5-45fc-bcbf-98da4a8ce54d tempest-FlavorsV2TestJSON-1379604053 tempest-FlavorsV2TestJSON-1379604053-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016025 Oct 18 15:24:47.671569 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 81/180] 10.222.0.60 () {58 vars in 1137 bytes} [Tue Oct 18 15:24:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:24:47.685090 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-59222dc1-5cdb-40ee-ad8e-8b07c01159f6 tempest-FlavorsV2TestJSON-1379604053 tempest-FlavorsV2TestJSON-1379604053-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:47.719918 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-59222dc1-5cdb-40ee-ad8e-8b07c01159f6 tempest-FlavorsV2TestJSON-1379604053 tempest-FlavorsV2TestJSON-1379604053-project] 10.222.0.60 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.040311 Oct 18 15:24:47.720909 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 100/181] 10.222.0.60 () {58 vars in 1144 bytes} [Tue Oct 18 15:24:47 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:47.737277 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f2a3c214-559b-437c-a886-bef828e0fcdb tempest-FlavorsV2TestJSON-1379604053 tempest-FlavorsV2TestJSON-1379604053-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:47.750880 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f2a3c214-559b-437c-a886-bef828e0fcdb tempest-FlavorsV2TestJSON-1379604053 tempest-FlavorsV2TestJSON-1379604053-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018721 Oct 18 15:24:47.760394 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 82/182] 10.222.0.60 () {58 vars in 1137 bytes} [Tue Oct 18 15:24:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:24:47.764731 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-98336a41-25dc-4fd0-a240-726de34b394b tempest-FlavorsV2TestJSON-1379604053 tempest-FlavorsV2TestJSON-1379604053-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:47.797951 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-98336a41-25dc-4fd0-a240-726de34b394b tempest-FlavorsV2TestJSON-1379604053 tempest-FlavorsV2TestJSON-1379604053-project] 10.222.0.60 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.036433 Oct 18 15:24:47.798918 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 101/183] 10.222.0.60 () {58 vars in 1148 bytes} [Tue Oct 18 15:24:47 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:47.814381 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-29115a29-71e1-46ac-9edd-d0ad25d0150b tempest-FlavorsV2TestJSON-1379604053 tempest-FlavorsV2TestJSON-1379604053-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:47.836088 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-29115a29-71e1-46ac-9edd-d0ad25d0150b tempest-FlavorsV2TestJSON-1379604053 tempest-FlavorsV2TestJSON-1379604053-project] 10.222.0.60 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.027172 Oct 18 15:24:47.837274 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 83/184] 10.222.0.60 () {58 vars in 1140 bytes} [Tue Oct 18 15:24:47 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:24:47.855239 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d56b1bc0-53be-40fa-8d0f-b52171ae05a2 tempest-FlavorsV2TestJSON-1379604053 tempest-FlavorsV2TestJSON-1379604053-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:47.867739 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d56b1bc0-53be-40fa-8d0f-b52171ae05a2 tempest-FlavorsV2TestJSON-1379604053 tempest-FlavorsV2TestJSON-1379604053-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018814 Oct 18 15:24:47.868419 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 102/185] 10.222.0.60 () {58 vars in 1137 bytes} [Tue Oct 18 15:24:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:24:47.881090 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b9e6a517-ca62-4a29-982e-972206b751fa tempest-FlavorsV2TestJSON-1379604053 tempest-FlavorsV2TestJSON-1379604053-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:47.963498 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b9e6a517-ca62-4a29-982e-972206b751fa tempest-FlavorsV2TestJSON-1379604053 tempest-FlavorsV2TestJSON-1379604053-project] 10.222.0.60 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.086065 Oct 18 15:24:47.964105 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 84/186] 10.222.0.60 () {58 vars in 1146 bytes} [Tue Oct 18 15:24:47 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:47.983809 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0a680c7c-a8a5-4b44-8330-e8a4d3d7e64b tempest-FlavorsV2TestJSON-1379604053 tempest-FlavorsV2TestJSON-1379604053-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:48.018372 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0a680c7c-a8a5-4b44-8330-e8a4d3d7e64b tempest-FlavorsV2TestJSON-1379604053 tempest-FlavorsV2TestJSON-1379604053-project] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.039627 Oct 18 15:24:48.019714 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 103/187] 10.222.0.60 () {58 vars in 1146 bytes} [Tue Oct 18 15:24:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:48.050985 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f3a092fe-fee8-46aa-b3bd-5f502d5202aa tempest-FlavorsV2TestJSON-1379604053 tempest-FlavorsV2TestJSON-1379604053-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:48.062030 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f3a092fe-fee8-46aa-b3bd-5f502d5202aa tempest-FlavorsV2TestJSON-1379604053 tempest-FlavorsV2TestJSON-1379604053-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026164 Oct 18 15:24:48.068451 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 85/188] 10.222.0.60 () {58 vars in 1137 bytes} [Tue Oct 18 15:24:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:24:48.135983 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4cdcfdc4-321f-40f0-9d38-42a0eed1994b tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:48.137025 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4cdcfdc4-321f-40f0-9d38-42a0eed1994b tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] [instance: 3f5d6640-30f6-490b-984f-d1169918133f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:24:48.143733 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4cdcfdc4-321f-40f0-9d38-42a0eed1994b tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:48.150320 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4cdcfdc4-321f-40f0-9d38-42a0eed1994b tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:48.155702 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4cdcfdc4-321f-40f0-9d38-42a0eed1994b tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:48.158036 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4cdcfdc4-321f-40f0-9d38-42a0eed1994b tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:48.161004 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4cdcfdc4-321f-40f0-9d38-42a0eed1994b tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:48.166127 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4cdcfdc4-321f-40f0-9d38-42a0eed1994b tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:48.259256 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b0b6ccf6-fba6-4d54-b0c8-11640b64519b tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:48.259873 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b0b6ccf6-fba6-4d54-b0c8-11640b64519b tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: 2dea609b-60cd-4634-b6d6-f5e3e085c1a3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:24:48.273139 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b0b6ccf6-fba6-4d54-b0c8-11640b64519b tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:48.274036 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b0b6ccf6-fba6-4d54-b0c8-11640b64519b tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:48.274710 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b0b6ccf6-fba6-4d54-b0c8-11640b64519b tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:48.277228 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b0b6ccf6-fba6-4d54-b0c8-11640b64519b tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:48.277858 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b0b6ccf6-fba6-4d54-b0c8-11640b64519b tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:48.278440 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b0b6ccf6-fba6-4d54-b0c8-11640b64519b tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:48.661115 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b0b6ccf6-fba6-4d54-b0c8-11640b64519b tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:24:48.669562 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b0b6ccf6-fba6-4d54-b0c8-11640b64519b tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3" status: 200 len: 1311 microversion: 2.1 time: 0.414055 Oct 18 15:24:48.677094 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 86/189] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:24:48 2022] GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3 => generated 1311 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:24:48.795282 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4cdcfdc4-321f-40f0-9d38-42a0eed1994b tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72c1406934749cdaf643c4370dbd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e72a93e9d51401c991e34b7e0f62ed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:24:48.809367 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4cdcfdc4-321f-40f0-9d38-42a0eed1994b tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] 10.222.0.60 "GET /compute/v2.1/servers/3f5d6640-30f6-490b-984f-d1169918133f" status: 200 len: 1339 microversion: 2.1 time: 0.677195 Oct 18 15:24:48.810232 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 104/190] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:24:48 2022] GET /compute/v2.1/servers/3f5d6640-30f6-490b-984f-d1169918133f => generated 1339 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:49.572670 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=8 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:24:49.705159 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c0b9d4f9-86d3-4508-9624-5d72b81660cf tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:49.705732 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c0b9d4f9-86d3-4508-9624-5d72b81660cf tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: 2dea609b-60cd-4634-b6d6-f5e3e085c1a3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:24:49.709580 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=2,nova_api:DELETE=9 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:24:49.726008 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0b9d4f9-86d3-4508-9624-5d72b81660cf tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:49.726646 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0b9d4f9-86d3-4508-9624-5d72b81660cf tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:49.727443 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0b9d4f9-86d3-4508-9624-5d72b81660cf tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:49.730230 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0b9d4f9-86d3-4508-9624-5d72b81660cf tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:49.731715 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0b9d4f9-86d3-4508-9624-5d72b81660cf tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:49.733206 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0b9d4f9-86d3-4508-9624-5d72b81660cf tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:49.759689 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-68a64259-e765-4142-b4af-45d14e218d75 tempest-HypervisorAdminV228Test-2129314848 tempest-HypervisorAdminV228Test-2129314848-project-admin] Calling method '.version_select at 0x7f7c3df24ca0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:49.761861 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-68a64259-e765-4142-b4af-45d14e218d75 tempest-HypervisorAdminV228Test-2129314848 tempest-HypervisorAdminV228Test-2129314848-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:49.762504 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-68a64259-e765-4142-b4af-45d14e218d75 tempest-HypervisorAdminV228Test-2129314848 tempest-HypervisorAdminV228Test-2129314848-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:49.763130 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-68a64259-e765-4142-b4af-45d14e218d75 tempest-HypervisorAdminV228Test-2129314848 tempest-HypervisorAdminV228Test-2129314848-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:49.814966 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-68a64259-e765-4142-b4af-45d14e218d75 tempest-HypervisorAdminV228Test-2129314848 tempest-HypervisorAdminV228Test-2129314848-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:49.816976 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-68a64259-e765-4142-b4af-45d14e218d75 tempest-HypervisorAdminV228Test-2129314848 tempest-HypervisorAdminV228Test-2129314848-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:49.817480 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-68a64259-e765-4142-b4af-45d14e218d75 tempest-HypervisorAdminV228Test-2129314848 tempest-HypervisorAdminV228Test-2129314848-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:49.849391 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-68a64259-e765-4142-b4af-45d14e218d75 tempest-HypervisorAdminV228Test-2129314848 tempest-HypervisorAdminV228Test-2129314848-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:49.852344 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-68a64259-e765-4142-b4af-45d14e218d75 tempest-HypervisorAdminV228Test-2129314848 tempest-HypervisorAdminV228Test-2129314848-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:49.852908 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-68a64259-e765-4142-b4af-45d14e218d75 tempest-HypervisorAdminV228Test-2129314848 tempest-HypervisorAdminV228Test-2129314848-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:49.873883 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-68a64259-e765-4142-b4af-45d14e218d75 tempest-HypervisorAdminV228Test-2129314848 tempest-HypervisorAdminV228Test-2129314848-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.358131 Oct 18 15:24:49.874491 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 87/191] 10.222.0.60 () {60 vars in 1187 bytes} [Tue Oct 18 15:24:49 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:24:49.886837 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-33d96306-06af-4bc5-aa7c-dd9654f659f0 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:49.890022 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-33d96306-06af-4bc5-aa7c-dd9654f659f0 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] [instance: 3f5d6640-30f6-490b-984f-d1169918133f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:24:49.899581 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=4,nova_api:DELETE=9 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:24:49.911652 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-33d96306-06af-4bc5-aa7c-dd9654f659f0 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:49.913744 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-33d96306-06af-4bc5-aa7c-dd9654f659f0 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:49.915913 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-33d96306-06af-4bc5-aa7c-dd9654f659f0 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:49.918167 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-33d96306-06af-4bc5-aa7c-dd9654f659f0 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:49.920223 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-33d96306-06af-4bc5-aa7c-dd9654f659f0 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:49.923286 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-33d96306-06af-4bc5-aa7c-dd9654f659f0 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:50.548637 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c0b9d4f9-86d3-4508-9624-5d72b81660cf tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:24:50.559728 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c0b9d4f9-86d3-4508-9624-5d72b81660cf tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3" status: 200 len: 1311 microversion: 2.1 time: 0.858895 Oct 18 15:24:50.590826 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 105/192] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:24:49 2022] GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3 => generated 1311 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:24:50.602569 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6875e234-a1ea-407b-b6cb-25f6ce5b11e9 tempest-HypervisorAdminV228Test-2129314848 tempest-HypervisorAdminV228Test-2129314848-project-admin] Calling method '.version_select at 0x7f7c3deff040>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:50.608474 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6875e234-a1ea-407b-b6cb-25f6ce5b11e9 tempest-HypervisorAdminV228Test-2129314848 tempest-HypervisorAdminV228Test-2129314848-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:50.610609 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6875e234-a1ea-407b-b6cb-25f6ce5b11e9 tempest-HypervisorAdminV228Test-2129314848 tempest-HypervisorAdminV228Test-2129314848-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:50.616875 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6875e234-a1ea-407b-b6cb-25f6ce5b11e9 tempest-HypervisorAdminV228Test-2129314848 tempest-HypervisorAdminV228Test-2129314848-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:50.623387 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-33d96306-06af-4bc5-aa7c-dd9654f659f0 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72c1406934749cdaf643c4370dbd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e72a93e9d51401c991e34b7e0f62ed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:24:50.637239 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-33d96306-06af-4bc5-aa7c-dd9654f659f0 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] 10.222.0.60 "GET /compute/v2.1/servers/3f5d6640-30f6-490b-984f-d1169918133f" status: 200 len: 1488 microversion: 2.1 time: 0.761137 Oct 18 15:24:50.638115 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 88/193] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:24:49 2022] GET /compute/v2.1/servers/3f5d6640-30f6-490b-984f-d1169918133f => generated 1488 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:50.657542 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=14 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:24:50.665139 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-152d8949-b38b-46fa-8d3c-9c6acd08c775 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:50.666098 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-152d8949-b38b-46fa-8d3c-9c6acd08c775 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] [instance: 3f5d6640-30f6-490b-984f-d1169918133f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:24:50.675816 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-152d8949-b38b-46fa-8d3c-9c6acd08c775 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:50.698279 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-152d8949-b38b-46fa-8d3c-9c6acd08c775 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:50.700421 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-152d8949-b38b-46fa-8d3c-9c6acd08c775 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:50.701459 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-152d8949-b38b-46fa-8d3c-9c6acd08c775 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:50.703934 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-152d8949-b38b-46fa-8d3c-9c6acd08c775 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:50.705954 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-152d8949-b38b-46fa-8d3c-9c6acd08c775 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:50.717884 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6875e234-a1ea-407b-b6cb-25f6ce5b11e9 tempest-HypervisorAdminV228Test-2129314848 tempest-HypervisorAdminV228Test-2129314848-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:50.725947 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6875e234-a1ea-407b-b6cb-25f6ce5b11e9 tempest-HypervisorAdminV228Test-2129314848 tempest-HypervisorAdminV228Test-2129314848-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:50.726780 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6875e234-a1ea-407b-b6cb-25f6ce5b11e9 tempest-HypervisorAdminV228Test-2129314848 tempest-HypervisorAdminV228Test-2129314848-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:50.747779 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6875e234-a1ea-407b-b6cb-25f6ce5b11e9 tempest-HypervisorAdminV228Test-2129314848 tempest-HypervisorAdminV228Test-2129314848-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.155695 Oct 18 15:24:50.748765 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 106/194] 10.222.0.60 () {60 vars in 1193 bytes} [Tue Oct 18 15:24:50 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:24:50.864189 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=10 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:24:51.598953 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-207d91ba-e85a-437b-ab68-c38cfbd54df4 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:51.599811 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-207d91ba-e85a-437b-ab68-c38cfbd54df4 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: 2dea609b-60cd-4634-b6d6-f5e3e085c1a3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:24:51.601474 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:24:51.615034 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-207d91ba-e85a-437b-ab68-c38cfbd54df4 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:51.617862 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-207d91ba-e85a-437b-ab68-c38cfbd54df4 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:51.618597 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-207d91ba-e85a-437b-ab68-c38cfbd54df4 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:51.619995 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-207d91ba-e85a-437b-ab68-c38cfbd54df4 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:51.620818 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-207d91ba-e85a-437b-ab68-c38cfbd54df4 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:51.622395 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-207d91ba-e85a-437b-ab68-c38cfbd54df4 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:52.568041 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-207d91ba-e85a-437b-ab68-c38cfbd54df4 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:24:52.581731 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-207d91ba-e85a-437b-ab68-c38cfbd54df4 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3" status: 200 len: 1311 microversion: 2.1 time: 0.982591 Oct 18 15:24:52.583593 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 107/195] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:24:51 2022] GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3 => generated 1311 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:24:52.952084 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-152d8949-b38b-46fa-8d3c-9c6acd08c775 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/3f5d6640-30f6-490b-984f-d1169918133f" status: 200 len: 1639 microversion: 2.1 time: 2.292007 Oct 18 15:24:52.955752 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 89/196] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:24:50 2022] GET /compute/v2.1/servers/3f5d6640-30f6-490b-984f-d1169918133f => generated 1639 bytes in 2296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:24:52.981980 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1300c43d-759d-4495-8483-cb40845388df tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:52.982812 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1300c43d-759d-4495-8483-cb40845388df tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] [instance: 3f5d6640-30f6-490b-984f-d1169918133f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:24:52.991327 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1300c43d-759d-4495-8483-cb40845388df tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:53.005456 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1300c43d-759d-4495-8483-cb40845388df tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:53.005913 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1300c43d-759d-4495-8483-cb40845388df tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:53.006675 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1300c43d-759d-4495-8483-cb40845388df tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:53.007139 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1300c43d-759d-4495-8483-cb40845388df tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:53.007567 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1300c43d-759d-4495-8483-cb40845388df tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:53.084763 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1300c43d-759d-4495-8483-cb40845388df tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] [instance: 3f5d6640-30f6-490b-984f-d1169918133f] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:24:53.388847 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1300c43d-759d-4495-8483-cb40845388df tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3f5d6640-30f6-490b-984f-d1169918133f" status: 204 len: 0 microversion: 2.1 time: 0.410428 Oct 18 15:24:53.390348 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 108/197] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:24:52 2022] DELETE /compute/v2.1/servers/3f5d6640-30f6-490b-984f-d1169918133f => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:24:53.400629 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9eaf46b7-ccb0-4655-806b-8bd1018c3b7f tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:53.401676 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9eaf46b7-ccb0-4655-806b-8bd1018c3b7f tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] [instance: 3f5d6640-30f6-490b-984f-d1169918133f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:24:53.411393 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9eaf46b7-ccb0-4655-806b-8bd1018c3b7f tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:53.414990 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9eaf46b7-ccb0-4655-806b-8bd1018c3b7f tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:53.416579 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9eaf46b7-ccb0-4655-806b-8bd1018c3b7f tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:53.422538 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9eaf46b7-ccb0-4655-806b-8bd1018c3b7f tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:53.423312 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9eaf46b7-ccb0-4655-806b-8bd1018c3b7f tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:53.425156 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9eaf46b7-ccb0-4655-806b-8bd1018c3b7f tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:53.550813 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-81d591dd-3f35-4f8f-acaa-257d5365fbf0 req-30f394ff-c5ea-4908-9fb3-067101f469df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dea609b-60cd-4634-b6d6-f5e3e085c1a3", "tag": "33616eab-5f4e-4a15-9e20-108e043be5cd"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:24:53.561523 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-81d591dd-3f35-4f8f-acaa-257d5365fbf0 req-30f394ff-c5ea-4908-9fb3-067101f469df service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:53.562430 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-81d591dd-3f35-4f8f-acaa-257d5365fbf0 req-30f394ff-c5ea-4908-9fb3-067101f469df service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:53.563814 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-81d591dd-3f35-4f8f-acaa-257d5365fbf0 req-30f394ff-c5ea-4908-9fb3-067101f469df service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:53.581531 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-81d591dd-3f35-4f8f-acaa-257d5365fbf0 req-30f394ff-c5ea-4908-9fb3-067101f469df service nova] Creating event network-changed:33616eab-5f4e-4a15-9e20-108e043be5cd for instance 2dea609b-60cd-4634-b6d6-f5e3e085c1a3 on n-h1-853682-5 Oct 18 15:24:53.596454 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-81d591dd-3f35-4f8f-acaa-257d5365fbf0 req-30f394ff-c5ea-4908-9fb3-067101f469df service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146732 Oct 18 15:24:53.597429 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 109/198] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:24:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:24:53.611983 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5dea3cea-ffdb-4a57-beda-e5b38754a490 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:53.615963 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5dea3cea-ffdb-4a57-beda-e5b38754a490 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: 2dea609b-60cd-4634-b6d6-f5e3e085c1a3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:24:53.624161 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5dea3cea-ffdb-4a57-beda-e5b38754a490 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:53.625391 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5dea3cea-ffdb-4a57-beda-e5b38754a490 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:53.627077 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5dea3cea-ffdb-4a57-beda-e5b38754a490 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:53.630672 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5dea3cea-ffdb-4a57-beda-e5b38754a490 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:53.631311 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5dea3cea-ffdb-4a57-beda-e5b38754a490 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:53.632298 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5dea3cea-ffdb-4a57-beda-e5b38754a490 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:54.369153 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9eaf46b7-ccb0-4655-806b-8bd1018c3b7f tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72c1406934749cdaf643c4370dbd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e72a93e9d51401c991e34b7e0f62ed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:24:54.378182 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9eaf46b7-ccb0-4655-806b-8bd1018c3b7f tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] 10.222.0.60 "GET /compute/v2.1/servers/3f5d6640-30f6-490b-984f-d1169918133f" status: 200 len: 1494 microversion: 2.1 time: 0.983758 Oct 18 15:24:54.389950 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 90/199] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:24:53 2022] GET /compute/v2.1/servers/3f5d6640-30f6-490b-984f-d1169918133f => generated 1494 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:54.438350 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5dea3cea-ffdb-4a57-beda-e5b38754a490 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:24:54.446166 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5dea3cea-ffdb-4a57-beda-e5b38754a490 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3" status: 200 len: 1311 microversion: 2.1 time: 0.839959 Oct 18 15:24:54.446962 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 110/200] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:24:53 2022] GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3 => generated 1311 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:55.418197 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-888c0c80-fc78-4e65-a8a8-1e93159c25b8 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:55.418846 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-888c0c80-fc78-4e65-a8a8-1e93159c25b8 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] [instance: 3f5d6640-30f6-490b-984f-d1169918133f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:24:55.429227 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-888c0c80-fc78-4e65-a8a8-1e93159c25b8 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:55.430013 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-888c0c80-fc78-4e65-a8a8-1e93159c25b8 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:55.430543 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-888c0c80-fc78-4e65-a8a8-1e93159c25b8 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:55.431493 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-888c0c80-fc78-4e65-a8a8-1e93159c25b8 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:55.432137 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-888c0c80-fc78-4e65-a8a8-1e93159c25b8 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:55.432753 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-888c0c80-fc78-4e65-a8a8-1e93159c25b8 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:55.472728 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-34108761-b7d9-42e1-909e-06ee71b57de9 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:55.474605 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-34108761-b7d9-42e1-909e-06ee71b57de9 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: 2dea609b-60cd-4634-b6d6-f5e3e085c1a3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:24:55.486400 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34108761-b7d9-42e1-909e-06ee71b57de9 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:55.487214 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34108761-b7d9-42e1-909e-06ee71b57de9 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:55.487795 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34108761-b7d9-42e1-909e-06ee71b57de9 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:55.488663 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34108761-b7d9-42e1-909e-06ee71b57de9 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:55.491195 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34108761-b7d9-42e1-909e-06ee71b57de9 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:55.491797 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34108761-b7d9-42e1-909e-06ee71b57de9 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:56.191358 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-888c0c80-fc78-4e65-a8a8-1e93159c25b8 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72c1406934749cdaf643c4370dbd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e72a93e9d51401c991e34b7e0f62ed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:24:56.205603 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-888c0c80-fc78-4e65-a8a8-1e93159c25b8 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] 10.222.0.60 "GET /compute/v2.1/servers/3f5d6640-30f6-490b-984f-d1169918133f" status: 200 len: 1494 microversion: 2.1 time: 0.791965 Oct 18 15:24:56.209119 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 91/201] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:24:55 2022] GET /compute/v2.1/servers/3f5d6640-30f6-490b-984f-d1169918133f => generated 1494 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:56.239484 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-34108761-b7d9-42e1-909e-06ee71b57de9 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:24:56.248662 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-34108761-b7d9-42e1-909e-06ee71b57de9 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3" status: 200 len: 1311 microversion: 2.1 time: 0.780230 Oct 18 15:24:56.269971 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 111/202] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:24:55 2022] GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3 => generated 1311 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:56.336532 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-2f48823d-4197-4fbe-87b6-1ba6ac472a97 req-a2784159-1fe0-4e25-bfab-4f88b936aaff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f5d6640-30f6-490b-984f-d1169918133f", "name": "network-vif-deleted", "tag": "50f1c833-7623-4007-aa9f-c33e88ab237f"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:24:56.386693 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-2f48823d-4197-4fbe-87b6-1ba6ac472a97 req-a2784159-1fe0-4e25-bfab-4f88b936aaff service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:56.392620 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-2f48823d-4197-4fbe-87b6-1ba6ac472a97 req-a2784159-1fe0-4e25-bfab-4f88b936aaff service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:56.393125 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-2f48823d-4197-4fbe-87b6-1ba6ac472a97 req-a2784159-1fe0-4e25-bfab-4f88b936aaff service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:56.472341 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-2f48823d-4197-4fbe-87b6-1ba6ac472a97 req-a2784159-1fe0-4e25-bfab-4f88b936aaff service nova] Creating event network-vif-deleted:50f1c833-7623-4007-aa9f-c33e88ab237f for instance 3f5d6640-30f6-490b-984f-d1169918133f on n-h2-853682-5 Oct 18 15:24:56.474890 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-2f48823d-4197-4fbe-87b6-1ba6ac472a97 req-a2784159-1fe0-4e25-bfab-4f88b936aaff service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120405) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 18 15:24:56.475485 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-2f48823d-4197-4fbe-87b6-1ba6ac472a97 req-a2784159-1fe0-4e25-bfab-4f88b936aaff service nova] Acquired lock "compute-rpcapi-router" {{(pid=120405) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 18 15:24:56.478135 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1375aecf-bb8e-40ab-a6af-2ce4b96ad4bd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:56.479670 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1375aecf-bb8e-40ab-a6af-2ce4b96ad4bd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:56.481562 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1375aecf-bb8e-40ab-a6af-2ce4b96ad4bd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:56.487668 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1375aecf-bb8e-40ab-a6af-2ce4b96ad4bd None None] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:56.488462 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1375aecf-bb8e-40ab-a6af-2ce4b96ad4bd None None] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:56.489684 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1375aecf-bb8e-40ab-a6af-2ce4b96ad4bd None None] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:56.503543 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.compute.rpcapi [None req-1375aecf-bb8e-40ab-a6af-2ce4b96ad4bd None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 18 15:24:56.504695 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1375aecf-bb8e-40ab-a6af-2ce4b96ad4bd None None] Releasing lock "compute-rpcapi-router" {{(pid=120405) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 18 15:24:56.534521 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1375aecf-bb8e-40ab-a6af-2ce4b96ad4bd None None] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.202673 Oct 18 15:24:56.543011 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 92/203] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:24:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:24:57.244991 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e5eba46a-01d0-49e0-b8ea-77160e1c25ad tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:57.246194 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e5eba46a-01d0-49e0-b8ea-77160e1c25ad tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] [instance: 3f5d6640-30f6-490b-984f-d1169918133f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:24:57.254806 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e5eba46a-01d0-49e0-b8ea-77160e1c25ad tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:57.255527 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e5eba46a-01d0-49e0-b8ea-77160e1c25ad tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:57.256312 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e5eba46a-01d0-49e0-b8ea-77160e1c25ad tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:57.257920 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e5eba46a-01d0-49e0-b8ea-77160e1c25ad tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:57.258674 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e5eba46a-01d0-49e0-b8ea-77160e1c25ad tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:57.259633 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e5eba46a-01d0-49e0-b8ea-77160e1c25ad tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:57.276100 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f80d67fa-b008-4781-b4ee-8eeb47ebb888 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:57.277603 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f80d67fa-b008-4781-b4ee-8eeb47ebb888 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: 2dea609b-60cd-4634-b6d6-f5e3e085c1a3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:24:57.298541 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f80d67fa-b008-4781-b4ee-8eeb47ebb888 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:57.300186 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f80d67fa-b008-4781-b4ee-8eeb47ebb888 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:57.300863 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f80d67fa-b008-4781-b4ee-8eeb47ebb888 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:57.303246 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f80d67fa-b008-4781-b4ee-8eeb47ebb888 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:57.307173 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f80d67fa-b008-4781-b4ee-8eeb47ebb888 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:57.309205 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f80d67fa-b008-4781-b4ee-8eeb47ebb888 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:57.367900 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e5eba46a-01d0-49e0-b8ea-77160e1c25ad tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:57.389993 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e5eba46a-01d0-49e0-b8ea-77160e1c25ad tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:57.390576 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e5eba46a-01d0-49e0-b8ea-77160e1c25ad tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:57.391069 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-e5eba46a-01d0-49e0-b8ea-77160e1c25ad tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lazy-loading 'fault' on Instance uuid 3f5d6640-30f6-490b-984f-d1169918133f {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:24:57.778269 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e5eba46a-01d0-49e0-b8ea-77160e1c25ad tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72c1406934749cdaf643c4370dbd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e72a93e9d51401c991e34b7e0f62ed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:24:57.789548 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e5eba46a-01d0-49e0-b8ea-77160e1c25ad tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] 10.222.0.60 "GET /compute/v2.1/servers/3f5d6640-30f6-490b-984f-d1169918133f" status: 200 len: 1329 microversion: 2.1 time: 0.550786 Oct 18 15:24:57.808756 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 112/204] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:24:57 2022] GET /compute/v2.1/servers/3f5d6640-30f6-490b-984f-d1169918133f => generated 1329 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:58.386000 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f80d67fa-b008-4781-b4ee-8eeb47ebb888 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:24:58.396350 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f80d67fa-b008-4781-b4ee-8eeb47ebb888 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3" status: 200 len: 1311 microversion: 2.1 time: 1.124706 Oct 18 15:24:58.417228 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 93/205] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:24:57 2022] GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3 => generated 1311 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:24:58.819264 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4d08c12d-4070-4a85-967a-c346f8e8ad8c tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:58.820167 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-077e7e51-a668-4571-ab00-faf6de73d0fa tempest-HypervisorAdminV253TestBase-2127549717 tempest-HypervisorAdminV253TestBase-2127549717-project-admin] Calling method '.version_select at 0x7f7c3df134c0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:58.822111 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4d08c12d-4070-4a85-967a-c346f8e8ad8c tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] [instance: 3f5d6640-30f6-490b-984f-d1169918133f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:24:58.841850 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-077e7e51-a668-4571-ab00-faf6de73d0fa tempest-HypervisorAdminV253TestBase-2127549717 tempest-HypervisorAdminV253TestBase-2127549717-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:58.842398 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-077e7e51-a668-4571-ab00-faf6de73d0fa tempest-HypervisorAdminV253TestBase-2127549717 tempest-HypervisorAdminV253TestBase-2127549717-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:58.844993 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-077e7e51-a668-4571-ab00-faf6de73d0fa tempest-HypervisorAdminV253TestBase-2127549717 tempest-HypervisorAdminV253TestBase-2127549717-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:58.850662 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4d08c12d-4070-4a85-967a-c346f8e8ad8c tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:58.852487 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4d08c12d-4070-4a85-967a-c346f8e8ad8c tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:58.855140 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4d08c12d-4070-4a85-967a-c346f8e8ad8c tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:58.858432 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4d08c12d-4070-4a85-967a-c346f8e8ad8c tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:58.861166 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4d08c12d-4070-4a85-967a-c346f8e8ad8c tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:58.861938 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4d08c12d-4070-4a85-967a-c346f8e8ad8c tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:58.904101 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-4d08c12d-4070-4a85-967a-c346f8e8ad8c tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] HTTP exception thrown: Instance 3f5d6640-30f6-490b-984f-d1169918133f could not be found. Oct 18 15:24:58.906214 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-077e7e51-a668-4571-ab00-faf6de73d0fa tempest-HypervisorAdminV253TestBase-2127549717 tempest-HypervisorAdminV253TestBase-2127549717-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:58.912089 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4d08c12d-4070-4a85-967a-c346f8e8ad8c tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Request method failure captured: Oct 18 15:24:58.912089 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/3f5d6640-30f6-490b-984f-d1169918133f HTTP/1.1 Oct 18 15:24:58.912089 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:24:58.912089 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:24:58.912089 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:24:58.912089 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:24:58.912089 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:24:58.912089 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:24:58.912089 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:24:58.912089 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:24:58.912089 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsUdEZI1pJKKk15KoQLmsIng-Y2jaOJAWqim56_y5bYSgITn78iN9afoBoLgV20Qy7YOJXVqAZm0JacIkXH-JI1n0Ho3U3-_Dqmw7pwtWnQmOtBdqXdg5wEPIfXnandfaFLcz2P3h5z2UvMsKIc2CTe7MnX48YAgnA-eriyBHlLyRow Oct 18 15:24:58.912089 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:24:58.912089 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:24:58.912089 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:24:58.912089 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:24:58.912089 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:24:58.912089 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:24:58.912089 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 5e72a93e9d51401c991e34b7e0f62ed4 Oct 18 15:24:58.912089 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-AggregatesAdminTestJSON-1118692385 Oct 18 15:24:58.912089 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:24:58.912089 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:24:58.913568 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5e72a93e9d51401c991e34b7e0f62ed4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5e72a93e9d51401c991e34b7e0f62ed4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5e72a93e9d51401c991e34b7e0f62ed4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5e72a93e9d51401c991e34b7e0f62ed4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:24:58.913568 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-AggregatesAdminTestJSON-1118692385 Oct 18 15:24:58.913568 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 5e72a93e9d51401c991e34b7e0f62ed4 Oct 18 15:24:58.913568 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1118692385 Oct 18 15:24:58.913568 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-AggregatesAdminTestJSON-1118692385-project Oct 18 15:24:58.913568 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:24:58.913568 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:24:58.913568 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: a72c1406934749cdaf643c4370dbd306 Oct 18 15:24:58.913568 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-AggregatesAdminTestJSON-1118692385-project Oct 18 15:24:58.913568 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:24:58.913568 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 3f5d6640-30f6-490b-984f-d1169918133f could not be found. Oct 18 15:24:58.913568 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '3f5d6640-30f6-490b-984f-d1169918133f'} Oct 18 15:24:58.915270 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:24:58.915270 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:58.915270 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:24:58.915270 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:24:58.915270 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:24:58.915270 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:24:58.915270 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:24:58.915270 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:24:58.915270 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:24:58.915270 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:24:58.915270 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f5d6640-30f6-490b-984f-d1169918133f could not be found. Oct 18 15:24:58.915270 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:24:58.915270 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:58.915270 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:24:58.915270 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:58.915270 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:58.915270 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:58.915270 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:24:58.915270 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:24:58.915270 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:24:58.919280 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:24:58.919280 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:24:58.919280 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:24:58.919280 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:24:58.919280 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:24:58.919280 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:24:58.919280 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:24:58.919280 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f5d6640-30f6-490b-984f-d1169918133f could not be found. Oct 18 15:24:58.919280 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:24:58.919280 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:24:58.919280 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:24:58.919280 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:24:58.919280 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:24:58.919280 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:24:58.919280 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:24:58.919280 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:24:58.919280 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f5d6640-30f6-490b-984f-d1169918133f could not be found. Oct 18 15:24:58.919280 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:24:58.924921 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4d08c12d-4070-4a85-967a-c346f8e8ad8c tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Returning 404 to user: Instance 3f5d6640-30f6-490b-984f-d1169918133f could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:24:58.924921 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4d08c12d-4070-4a85-967a-c346f8e8ad8c tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] 10.222.0.60 "GET /compute/v2.1/servers/3f5d6640-30f6-490b-984f-d1169918133f" status: 404 len: 111 microversion: 2.1 time: 0.109560 Oct 18 15:24:58.925448 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 94/206] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:24:58 2022] GET /compute/v2.1/servers/3f5d6640-30f6-490b-984f-d1169918133f => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:24:58.928923 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-077e7e51-a668-4571-ab00-faf6de73d0fa tempest-HypervisorAdminV253TestBase-2127549717 tempest-HypervisorAdminV253TestBase-2127549717-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:58.929381 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-077e7e51-a668-4571-ab00-faf6de73d0fa tempest-HypervisorAdminV253TestBase-2127549717 tempest-HypervisorAdminV253TestBase-2127549717-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:58.934602 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1e3d974a-9699-47ae-9376-a5c10c248278 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-853682-5"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:24:58.950447 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1e3d974a-9699-47ae-9376-a5c10c248278 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:58.951101 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1e3d974a-9699-47ae-9376-a5c10c248278 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:58.952506 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1e3d974a-9699-47ae-9376-a5c10c248278 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:59.017069 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-077e7e51-a668-4571-ab00-faf6de73d0fa tempest-HypervisorAdminV253TestBase-2127549717 tempest-HypervisorAdminV253TestBase-2127549717-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:59.018731 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-077e7e51-a668-4571-ab00-faf6de73d0fa tempest-HypervisorAdminV253TestBase-2127549717 tempest-HypervisorAdminV253TestBase-2127549717-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:59.019334 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-077e7e51-a668-4571-ab00-faf6de73d0fa tempest-HypervisorAdminV253TestBase-2127549717 tempest-HypervisorAdminV253TestBase-2127549717-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:59.053769 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-077e7e51-a668-4571-ab00-faf6de73d0fa tempest-HypervisorAdminV253TestBase-2127549717 tempest-HypervisorAdminV253TestBase-2127549717-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:59.054666 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-077e7e51-a668-4571-ab00-faf6de73d0fa tempest-HypervisorAdminV253TestBase-2127549717 tempest-HypervisorAdminV253TestBase-2127549717-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:59.057364 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-077e7e51-a668-4571-ab00-faf6de73d0fa tempest-HypervisorAdminV253TestBase-2127549717 tempest-HypervisorAdminV253TestBase-2127549717-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:59.113306 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-077e7e51-a668-4571-ab00-faf6de73d0fa tempest-HypervisorAdminV253TestBase-2127549717 tempest-HypervisorAdminV253TestBase-2127549717-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:59.114101 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-077e7e51-a668-4571-ab00-faf6de73d0fa tempest-HypervisorAdminV253TestBase-2127549717 tempest-HypervisorAdminV253TestBase-2127549717-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:59.114864 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-077e7e51-a668-4571-ab00-faf6de73d0fa tempest-HypervisorAdminV253TestBase-2127549717 tempest-HypervisorAdminV253TestBase-2127549717-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:59.163650 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-077e7e51-a668-4571-ab00-faf6de73d0fa tempest-HypervisorAdminV253TestBase-2127549717 tempest-HypervisorAdminV253TestBase-2127549717-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1664 microversion: 2.53 time: 0.601997 Oct 18 15:24:59.170641 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 113/207] 10.222.0.60 () {60 vars in 1243 bytes} [Tue Oct 18 15:24:58 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1664 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:24:59.189157 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e7d9d972-c045-4bb3-8185-ed0f057cc13d tempest-HypervisorAdminV253TestBase-2127549717 tempest-HypervisorAdminV253TestBase-2127549717-project-admin] Calling method '.version_select at 0x7f7c3df13ca0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:59.202154 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7d9d972-c045-4bb3-8185-ed0f057cc13d tempest-HypervisorAdminV253TestBase-2127549717 tempest-HypervisorAdminV253TestBase-2127549717-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:59.209627 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7d9d972-c045-4bb3-8185-ed0f057cc13d tempest-HypervisorAdminV253TestBase-2127549717 tempest-HypervisorAdminV253TestBase-2127549717-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:59.210576 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7d9d972-c045-4bb3-8185-ed0f057cc13d tempest-HypervisorAdminV253TestBase-2127549717 tempest-HypervisorAdminV253TestBase-2127549717-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:59.231551 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7d9d972-c045-4bb3-8185-ed0f057cc13d tempest-HypervisorAdminV253TestBase-2127549717 tempest-HypervisorAdminV253TestBase-2127549717-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:59.232320 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7d9d972-c045-4bb3-8185-ed0f057cc13d tempest-HypervisorAdminV253TestBase-2127549717 tempest-HypervisorAdminV253TestBase-2127549717-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:59.233069 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7d9d972-c045-4bb3-8185-ed0f057cc13d tempest-HypervisorAdminV253TestBase-2127549717 tempest-HypervisorAdminV253TestBase-2127549717-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:59.252366 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7d9d972-c045-4bb3-8185-ed0f057cc13d tempest-HypervisorAdminV253TestBase-2127549717 tempest-HypervisorAdminV253TestBase-2127549717-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:59.253343 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7d9d972-c045-4bb3-8185-ed0f057cc13d tempest-HypervisorAdminV253TestBase-2127549717 tempest-HypervisorAdminV253TestBase-2127549717-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:59.253972 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7d9d972-c045-4bb3-8185-ed0f057cc13d tempest-HypervisorAdminV253TestBase-2127549717 tempest-HypervisorAdminV253TestBase-2127549717-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:59.270160 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7d9d972-c045-4bb3-8185-ed0f057cc13d tempest-HypervisorAdminV253TestBase-2127549717 tempest-HypervisorAdminV253TestBase-2127549717-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:59.270950 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7d9d972-c045-4bb3-8185-ed0f057cc13d tempest-HypervisorAdminV253TestBase-2127549717 tempest-HypervisorAdminV253TestBase-2127549717-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:59.271680 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7d9d972-c045-4bb3-8185-ed0f057cc13d tempest-HypervisorAdminV253TestBase-2127549717 tempest-HypervisorAdminV253TestBase-2127549717-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:59.302866 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7d9d972-c045-4bb3-8185-ed0f057cc13d tempest-HypervisorAdminV253TestBase-2127549717 tempest-HypervisorAdminV253TestBase-2127549717-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:59.303359 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7d9d972-c045-4bb3-8185-ed0f057cc13d tempest-HypervisorAdminV253TestBase-2127549717 tempest-HypervisorAdminV253TestBase-2127549717-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:59.303973 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7d9d972-c045-4bb3-8185-ed0f057cc13d tempest-HypervisorAdminV253TestBase-2127549717 tempest-HypervisorAdminV253TestBase-2127549717-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:59.312338 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e7d9d972-c045-4bb3-8185-ed0f057cc13d tempest-HypervisorAdminV253TestBase-2127549717 tempest-HypervisorAdminV253TestBase-2127549717-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 357 microversion: 2.53 time: 0.127565 Oct 18 15:24:59.314002 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 114/208] 10.222.0.60 () {60 vars in 1222 bytes} [Tue Oct 18 15:24:59 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 357 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:24:59.326924 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-34b54507-af79-4fd5-9235-cbf3ad9278a6 tempest-HypervisorAdminV253TestBase-2127549717 tempest-HypervisorAdminV253TestBase-2127549717-project-admin] Calling method '.version_select at 0x7f7c3df13d30>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:59.332182 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34b54507-af79-4fd5-9235-cbf3ad9278a6 tempest-HypervisorAdminV253TestBase-2127549717 tempest-HypervisorAdminV253TestBase-2127549717-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:59.332675 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34b54507-af79-4fd5-9235-cbf3ad9278a6 tempest-HypervisorAdminV253TestBase-2127549717 tempest-HypervisorAdminV253TestBase-2127549717-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:59.334751 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34b54507-af79-4fd5-9235-cbf3ad9278a6 tempest-HypervisorAdminV253TestBase-2127549717 tempest-HypervisorAdminV253TestBase-2127549717-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:59.359725 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34b54507-af79-4fd5-9235-cbf3ad9278a6 tempest-HypervisorAdminV253TestBase-2127549717 tempest-HypervisorAdminV253TestBase-2127549717-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:59.360545 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34b54507-af79-4fd5-9235-cbf3ad9278a6 tempest-HypervisorAdminV253TestBase-2127549717 tempest-HypervisorAdminV253TestBase-2127549717-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:59.361430 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34b54507-af79-4fd5-9235-cbf3ad9278a6 tempest-HypervisorAdminV253TestBase-2127549717 tempest-HypervisorAdminV253TestBase-2127549717-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:59.369147 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:24:59.410812 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-34b54507-af79-4fd5-9235-cbf3ad9278a6 tempest-HypervisorAdminV253TestBase-2127549717 tempest-HypervisorAdminV253TestBase-2127549717-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/5717d3b6-fc9b-448d-befd-f8b94834780d" status: 200 len: 791 microversion: 2.53 time: 0.088089 Oct 18 15:24:59.431490 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 115/209] 10.222.0.60 () {60 vars in 1298 bytes} [Tue Oct 18 15:24:59 2022] GET /compute/v2.1/os-hypervisors/5717d3b6-fc9b-448d-befd-f8b94834780d => generated 791 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:24:59.471851 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c54b3b9a-19a4-480c-8f72-435d7c7442a1 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:59.474338 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c54b3b9a-19a4-480c-8f72-435d7c7442a1 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: 2dea609b-60cd-4634-b6d6-f5e3e085c1a3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:24:59.507187 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c54b3b9a-19a4-480c-8f72-435d7c7442a1 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:59.507977 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c54b3b9a-19a4-480c-8f72-435d7c7442a1 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:59.532950 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c54b3b9a-19a4-480c-8f72-435d7c7442a1 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:59.533416 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c54b3b9a-19a4-480c-8f72-435d7c7442a1 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:59.533979 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c54b3b9a-19a4-480c-8f72-435d7c7442a1 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:59.534482 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c54b3b9a-19a4-480c-8f72-435d7c7442a1 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:24:59.707187 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1e3d974a-9699-47ae-9376-a5c10c248278 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 300 microversion: 2.1 time: 0.777952 Oct 18 15:24:59.708265 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 95/210] 10.222.0.60 () {60 vars in 1191 bytes} [Tue Oct 18 15:24:58 2022] POST /compute/v2.1/os-aggregates/1/action => generated 300 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:24:59.742094 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e22f777e-c845-447f-84ea-b21d9290e8c1 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:24:59.805562 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e22f777e-c845-447f-84ea-b21d9290e8c1 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.077146 Oct 18 15:24:59.806857 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 96/211] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Oct 18 15:24:59 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 15:24:59.828125 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e1524309-db87-4e0e-baa9-32687ff0855f tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-740276898"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:24:59.835670 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.aggregate [None req-e1524309-db87-4e0e-baa9-32687ff0855f tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Generated uuid 99aac035-7184-4c14-af61-ab8ed7d2c704 for aggregate {{(pid=120405) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 15:24:59.905432 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e1524309-db87-4e0e-baa9-32687ff0855f tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.085229 Oct 18 15:24:59.907965 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 97/212] 10.222.0.60 () {60 vars in 1164 bytes} [Tue Oct 18 15:24:59 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:24:59.920744 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-720af131-68e6-42dd-bcef-a2528c528faf tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-853682-5"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:24:59.956717 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-720af131-68e6-42dd-bcef-a2528c528faf tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:24:59.963017 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-720af131-68e6-42dd-bcef-a2528c528faf tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:24:59.965250 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-720af131-68e6-42dd-bcef-a2528c528faf tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:00.209841 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-720af131-68e6-42dd-bcef-a2528c528faf tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 241 microversion: 2.1 time: 0.294846 Oct 18 15:25:00.210744 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 98/213] 10.222.0.60 () {60 vars in 1191 bytes} [Tue Oct 18 15:24:59 2022] POST /compute/v2.1/os-aggregates/2/action => generated 241 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:00.226400 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-536c68bc-13d0-4ebe-bc29-ee6dd5b0446b tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:00.249511 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-536c68bc-13d0-4ebe-bc29-ee6dd5b0446b tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 241 microversion: 2.1 time: 0.028841 Oct 18 15:25:00.250988 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 99/214] 10.222.0.60 () {58 vars in 1149 bytes} [Tue Oct 18 15:25:00 2022] GET /compute/v2.1/os-aggregates/2 => generated 241 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:00.262679 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-24889fdd-16fa-43e0-a00b-18ae54a6cbdd tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-853682-5"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:00.288966 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-24889fdd-16fa-43e0-a00b-18ae54a6cbdd tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:00.289748 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-24889fdd-16fa-43e0-a00b-18ae54a6cbdd tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:00.290427 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-24889fdd-16fa-43e0-a00b-18ae54a6cbdd tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:00.589748 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-24889fdd-16fa-43e0-a00b-18ae54a6cbdd tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 226 microversion: 2.1 time: 0.330746 Oct 18 15:25:00.590929 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 100/215] 10.222.0.60 () {60 vars in 1191 bytes} [Tue Oct 18 15:25:00 2022] POST /compute/v2.1/os-aggregates/2/action => generated 226 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:25:00.604566 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7250683b-bd25-4a9e-8628-8d72036b5b8c tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:00.632765 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7250683b-bd25-4a9e-8628-8d72036b5b8c tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.032482 Oct 18 15:25:00.634170 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 101/216] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Oct 18 15:25:00 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 15:25:00.655068 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0b3d3538-993f-45b3-82fd-ea77603d680f tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-65656321"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:00.666777 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.aggregate [None req-0b3d3538-993f-45b3-82fd-ea77603d680f tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Generated uuid 9288234c-516b-43ae-90fa-601b018f18e3 for aggregate {{(pid=120405) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 15:25:01.075687 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0b3d3538-993f-45b3-82fd-ea77603d680f tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.431559 Oct 18 15:25:01.076407 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 102/217] 10.222.0.60 () {60 vars in 1164 bytes} [Tue Oct 18 15:25:00 2022] POST /compute/v2.1/os-aggregates => generated 196 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:01.094580 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-570648d3-1f06-43e5-948f-f305f7dbfeab tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-853682-5"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:01.106189 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-570648d3-1f06-43e5-948f-f305f7dbfeab tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:01.106697 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-570648d3-1f06-43e5-948f-f305f7dbfeab tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:01.107215 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-570648d3-1f06-43e5-948f-f305f7dbfeab tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:01.176341 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c54b3b9a-19a4-480c-8f72-435d7c7442a1 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:01.187098 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c54b3b9a-19a4-480c-8f72-435d7c7442a1 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3" status: 200 len: 1311 microversion: 2.1 time: 1.740368 Oct 18 15:25:01.187687 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 116/218] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:24:59 2022] GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3 => generated 1311 bytes in 1755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:25:01.458933 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-570648d3-1f06-43e5-948f-f305f7dbfeab tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 240 microversion: 2.1 time: 0.373906 Oct 18 15:25:01.460218 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 103/219] 10.222.0.60 () {60 vars in 1191 bytes} [Tue Oct 18 15:25:01 2022] POST /compute/v2.1/os-aggregates/3/action => generated 240 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:01.473929 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b091069c-90ec-457a-b330-91cb4697f0e9 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:01.494502 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b091069c-90ec-457a-b330-91cb4697f0e9 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates" status: 200 len: 243 microversion: 2.1 time: 0.023716 Oct 18 15:25:01.495600 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 117/220] 10.222.0.60 () {58 vars in 1143 bytes} [Tue Oct 18 15:25:01 2022] GET /compute/v2.1/os-aggregates => generated 243 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:01.507881 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1c804294-313f-420c-8fc1-944aee82e8b9 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-853682-5"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:01.538898 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1c804294-313f-420c-8fc1-944aee82e8b9 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:01.539395 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1c804294-313f-420c-8fc1-944aee82e8b9 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:01.545434 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1c804294-313f-420c-8fc1-944aee82e8b9 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:01.867957 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1c804294-313f-420c-8fc1-944aee82e8b9 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 225 microversion: 2.1 time: 0.363971 Oct 18 15:25:01.869146 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 104/221] 10.222.0.60 () {60 vars in 1191 bytes} [Tue Oct 18 15:25:01 2022] POST /compute/v2.1/os-aggregates/3/action => generated 225 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:25:01.882073 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-605f0e3b-1a7c-4266-8a13-78df36aff49e tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:01.919760 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-605f0e3b-1a7c-4266-8a13-78df36aff49e tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.042029 Oct 18 15:25:01.920592 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 118/222] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Oct 18 15:25:01 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 15:25:01.931582 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a3b2315f-3b4e-44ce-a1a2-d15fb583ea5a tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1194930547"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:01.935783 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.aggregate [None req-a3b2315f-3b4e-44ce-a1a2-d15fb583ea5a tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Generated uuid aecfdf06-932b-4db1-9704-a6a4d685ab77 for aggregate {{(pid=120405) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 15:25:01.975792 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a3b2315f-3b4e-44ce-a1a2-d15fb583ea5a tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.048020 Oct 18 15:25:01.976567 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 105/223] 10.222.0.60 () {60 vars in 1164 bytes} [Tue Oct 18 15:25:01 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:01.990984 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-79b9bba2-bb8e-4faa-abc3-0780b610028d tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-853682-5"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:02.035039 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79b9bba2-bb8e-4faa-abc3-0780b610028d tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:02.037837 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79b9bba2-bb8e-4faa-abc3-0780b610028d tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:02.043410 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79b9bba2-bb8e-4faa-abc3-0780b610028d tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:02.213094 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6ea5fedb-917c-4e28-80cf-f465258d3836 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:02.214518 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6ea5fedb-917c-4e28-80cf-f465258d3836 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: 2dea609b-60cd-4634-b6d6-f5e3e085c1a3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:02.225453 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ea5fedb-917c-4e28-80cf-f465258d3836 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:02.227173 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ea5fedb-917c-4e28-80cf-f465258d3836 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:02.230513 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ea5fedb-917c-4e28-80cf-f465258d3836 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:02.231401 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ea5fedb-917c-4e28-80cf-f465258d3836 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:02.234435 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ea5fedb-917c-4e28-80cf-f465258d3836 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:02.236800 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ea5fedb-917c-4e28-80cf-f465258d3836 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:02.238059 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-79b9bba2-bb8e-4faa-abc3-0780b610028d tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 242 microversion: 2.1 time: 0.253848 Oct 18 15:25:02.238650 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 119/224] 10.222.0.60 () {60 vars in 1191 bytes} [Tue Oct 18 15:25:01 2022] POST /compute/v2.1/os-aggregates/4/action => generated 242 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:25:02.256240 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f18ceb3f-80b7-4333-99b5-b234c2aaae2c tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-853682-5"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:02.288359 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f18ceb3f-80b7-4333-99b5-b234c2aaae2c tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:02.295593 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f18ceb3f-80b7-4333-99b5-b234c2aaae2c tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:02.296290 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f18ceb3f-80b7-4333-99b5-b234c2aaae2c tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:02.588201 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f18ceb3f-80b7-4333-99b5-b234c2aaae2c tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 227 microversion: 2.1 time: 0.341087 Oct 18 15:25:02.589575 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 120/225] 10.222.0.60 () {60 vars in 1191 bytes} [Tue Oct 18 15:25:02 2022] POST /compute/v2.1/os-aggregates/4/action => generated 227 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:02.603592 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ef91acb1-b97a-4599-8dd0-f9fd28b4c184 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:02.679162 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ef91acb1-b97a-4599-8dd0-f9fd28b4c184 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.081411 Oct 18 15:25:02.679772 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 121/226] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Oct 18 15:25:02 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 15:25:02.697338 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5322347c-3354-4cb7-8be8-0e0f58f3319d tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1217542462"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:02.709982 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.aggregate [None req-5322347c-3354-4cb7-8be8-0e0f58f3319d tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Generated uuid dbcb07bb-77fa-426b-9a3a-191bf01e118f for aggregate {{(pid=120406) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 15:25:03.070335 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5322347c-3354-4cb7-8be8-0e0f58f3319d tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.378813 Oct 18 15:25:03.081046 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 122/227] 10.222.0.60 () {60 vars in 1164 bytes} [Tue Oct 18 15:25:02 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:03.083373 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6ea5fedb-917c-4e28-80cf-f465258d3836 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:03.097886 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6ea5fedb-917c-4e28-80cf-f465258d3836 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3" status: 200 len: 1311 microversion: 2.1 time: 0.888622 Oct 18 15:25:03.098262 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4c42e8b8-516b-4a26-93fe-6524de52186b tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-351806315"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:03.106452 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.aggregate [None req-4c42e8b8-516b-4a26-93fe-6524de52186b tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Generated uuid b2a9b5e8-1c54-4141-894a-86ab4a47ad56 for aggregate {{(pid=120406) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 15:25:03.117316 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 106/228] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:25:02 2022] GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3 => generated 1311 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:25:03.126240 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3c68e4be-2fa2-4980-998c-1e5281148f83 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:03.173803 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3c68e4be-2fa2-4980-998c-1e5281148f83 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.055278 Oct 18 15:25:03.174391 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 107/229] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Oct 18 15:25:03 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 15:25:03.174904 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4c42e8b8-516b-4a26-93fe-6524de52186b tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.091792 Oct 18 15:25:03.182408 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-22a6e980-4687-45aa-ba03-f211089857c2 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:03.183952 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 123/230] 10.222.0.60 () {60 vars in 1164 bytes} [Tue Oct 18 15:25:03 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:03.190636 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a687b042-7571-4036-bfbd-1b81e561f6c8 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-853682-5"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:03.191649 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-22a6e980-4687-45aa-ba03-f211089857c2 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Oct 18 15:25:03.193890 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-22a6e980-4687-45aa-ba03-f211089857c2 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Request method failure captured: Oct 18 15:25:03.193890 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/os-aggregates/5 HTTP/1.1 Oct 18 15:25:03.193890 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:25:03.193890 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:25:03.193890 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:25:03.193890 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:25:03.193890 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:25:03.193890 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:25:03.193890 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:25:03.193890 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:25:03.193890 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsUgMQ3pc4stAk8GauxA-eq65j3TXrhJXXoxa6e5dJiF2NGZ_-BC-AE6K9lBZZtDAYrzUdkPk-Yv4p3EASDbDSdLzhFX6D0KIs4uiyVHodbRdasM2zfW7Y8tBOpceL-9wsp_TE-YAWhJWpz1vWoYxf0066BvMcKKQgIQaWZ_j45kR24 Oct 18 15:25:03.193890 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:25:03.193890 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:25:03.193890 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:25:03.193890 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:25:03.193890 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:25:03.193890 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:25:03.193890 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: e4be1c64d642433eb9c731d78a7129f3 Oct 18 15:25:03.193890 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-AggregatesAdminTestJSON-1811259202 Oct 18 15:25:03.193890 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,admin,reader Oct 18 15:25:03.193890 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,admin,reader Oct 18 15:25:03.195085 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e4be1c64d642433eb9c731d78a7129f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e4be1c64d642433eb9c731d78a7129f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e4be1c64d642433eb9c731d78a7129f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e4be1c64d642433eb9c731d78a7129f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:25:03.195085 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-AggregatesAdminTestJSON-1811259202 Oct 18 15:25:03.195085 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: e4be1c64d642433eb9c731d78a7129f3 Oct 18 15:25:03.195085 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1811259202 Oct 18 15:25:03.195085 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-AggregatesAdminTestJSON-1811259202-project-admin Oct 18 15:25:03.195085 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:25:03.195085 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:25:03.195085 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: f0a3a70457a240cda0dd281a575328d3 Oct 18 15:25:03.195085 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-AggregatesAdminTestJSON-1811259202-project-admin Oct 18 15:25:03.195085 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:25:03.195085 n-d-853682-5 devstack@n-api.service[120405]: exception: Aggregate 5 could not be found. Oct 18 15:25:03.195085 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '5'} Oct 18 15:25:03.195085 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:25:03.195858 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:03.195858 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 18 15:25:03.195858 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 18 15:25:03.195858 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 18 15:25:03.195858 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 18 15:25:03.195858 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 15:25:03.195858 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 15:25:03.195858 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 18 15:25:03.195858 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 18 15:25:03.195858 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 15:25:03.195858 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 15:25:03.195858 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 18 15:25:03.195858 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 18 15:25:03.195858 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Oct 18 15:25:03.195858 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:03.195858 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:25:03.195858 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:03.195858 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:03.195858 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:25:03.197013 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:25:03.197013 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:25:03.197013 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:25:03.197013 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:25:03.197013 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:25:03.197013 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 18 15:25:03.197013 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:25:03.197013 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Oct 18 15:25:03.197013 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:03.197013 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:25:03.197013 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:03.197013 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:03.197013 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:25:03.197013 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:25:03.197013 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:25:03.197013 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:25:03.197013 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Oct 18 15:25:03.197013 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:03.197965 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-22a6e980-4687-45aa-ba03-f211089857c2 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:25:03.197965 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-22a6e980-4687-45aa-ba03-f211089857c2 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.016529 Oct 18 15:25:03.202644 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a687b042-7571-4036-bfbd-1b81e561f6c8 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:03.203141 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a687b042-7571-4036-bfbd-1b81e561f6c8 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:03.203751 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a687b042-7571-4036-bfbd-1b81e561f6c8 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:03.205805 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 108/231] 10.222.0.60 () {58 vars in 1149 bytes} [Tue Oct 18 15:25:03 2022] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 15:25:03.217297 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-061fa196-ea86-4938-84a1-631187ea2e8a tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:03.247525 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-061fa196-ea86-4938-84a1-631187ea2e8a tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Oct 18 15:25:03.249613 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-061fa196-ea86-4938-84a1-631187ea2e8a tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Request method failure captured: Oct 18 15:25:03.249613 n-d-853682-5 devstack@n-api.service[120405]: request: DELETE /compute/v2.1/os-aggregates/5 HTTP/1.1 Oct 18 15:25:03.249613 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:25:03.249613 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:25:03.249613 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:25:03.249613 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:25:03.249613 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:25:03.249613 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:25:03.249613 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:25:03.249613 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:25:03.249613 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsUgMQ3pc4stAk8GauxA-eq65j3TXrhJXXoxa6e5dJiF2NGZ_-BC-AE6K9lBZZtDAYrzUdkPk-Yv4p3EASDbDSdLzhFX6D0KIs4uiyVHodbRdasM2zfW7Y8tBOpceL-9wsp_TE-YAWhJWpz1vWoYxf0066BvMcKKQgIQaWZ_j45kR24 Oct 18 15:25:03.249613 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:25:03.249613 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:25:03.249613 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:25:03.249613 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:25:03.249613 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:25:03.249613 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:25:03.249613 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: e4be1c64d642433eb9c731d78a7129f3 Oct 18 15:25:03.249613 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-AggregatesAdminTestJSON-1811259202 Oct 18 15:25:03.249613 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,admin,reader Oct 18 15:25:03.249613 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,admin,reader Oct 18 15:25:03.250981 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e4be1c64d642433eb9c731d78a7129f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e4be1c64d642433eb9c731d78a7129f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e4be1c64d642433eb9c731d78a7129f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e4be1c64d642433eb9c731d78a7129f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:25:03.250981 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-AggregatesAdminTestJSON-1811259202 Oct 18 15:25:03.250981 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: e4be1c64d642433eb9c731d78a7129f3 Oct 18 15:25:03.250981 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1811259202 Oct 18 15:25:03.250981 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-AggregatesAdminTestJSON-1811259202-project-admin Oct 18 15:25:03.250981 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:25:03.250981 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:25:03.250981 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: f0a3a70457a240cda0dd281a575328d3 Oct 18 15:25:03.250981 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-AggregatesAdminTestJSON-1811259202-project-admin Oct 18 15:25:03.250981 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:25:03.250981 n-d-853682-5 devstack@n-api.service[120405]: exception: Aggregate 5 could not be found. Oct 18 15:25:03.250981 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '5'} Oct 18 15:25:03.250981 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:25:03.251716 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:03.251716 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 18 15:25:03.251716 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 18 15:25:03.251716 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 15:25:03.251716 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 15:25:03.251716 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 15:25:03.251716 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 15:25:03.251716 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 15:25:03.251716 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 15:25:03.251716 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 15:25:03.251716 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 15:25:03.251716 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 18 15:25:03.251716 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 18 15:25:03.251716 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 15:25:03.251716 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 15:25:03.251716 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 18 15:25:03.251716 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 18 15:25:03.251716 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 15:25:03.251716 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 15:25:03.252754 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 18 15:25:03.252754 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 18 15:25:03.252754 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Oct 18 15:25:03.252754 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:03.252754 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:25:03.252754 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:03.252754 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:03.252754 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:25:03.252754 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:25:03.252754 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:25:03.252754 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:25:03.252754 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:25:03.252754 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:25:03.252754 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 18 15:25:03.252754 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:25:03.252754 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Oct 18 15:25:03.252754 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:03.252754 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:25:03.252754 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:03.252754 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:03.252754 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:25:03.257288 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:25:03.257288 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:25:03.257288 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:25:03.257288 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Oct 18 15:25:03.257288 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:03.257288 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-061fa196-ea86-4938-84a1-631187ea2e8a tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:25:03.257288 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-061fa196-ea86-4938-84a1-631187ea2e8a tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.041358 Oct 18 15:25:03.257288 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 109/232] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Oct 18 15:25:03 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 15:25:03.270825 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5ed3c7c9-d525-432d-9f5b-bd3072fc646f tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1834968880", "name": "tempest-test_aggregate-1394284868"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:03.279208 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.aggregate [None req-5ed3c7c9-d525-432d-9f5b-bd3072fc646f tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Generated uuid db16a964-2d17-4208-ad37-d8a64742e40c for aggregate {{(pid=120405) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 15:25:03.329826 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5ed3c7c9-d525-432d-9f5b-bd3072fc646f tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.064911 Oct 18 15:25:03.338086 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 110/233] 10.222.0.60 () {60 vars in 1165 bytes} [Tue Oct 18 15:25:03 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:03.351779 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-44c3ce96-c91e-4c58-b046-8f7f1031e8b8 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:03.372845 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=11,nova_api:INSERT=7 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:25:03.393647 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-44c3ce96-c91e-4c58-b046-8f7f1031e8b8 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.048931 Oct 18 15:25:03.399235 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 111/234] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Oct 18 15:25:03 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 15:25:03.409925 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3cb79695-d7c6-4d13-a941-49897cd69ab8 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:03.428141 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-3cb79695-d7c6-4d13-a941-49897cd69ab8 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Oct 18 15:25:03.430675 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3cb79695-d7c6-4d13-a941-49897cd69ab8 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Request method failure captured: Oct 18 15:25:03.430675 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 18 15:25:03.430675 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:25:03.430675 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:25:03.430675 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:25:03.430675 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:25:03.430675 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:25:03.430675 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:25:03.430675 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:25:03.430675 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:25:03.430675 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsUgMQ3pc4stAk8GauxA-eq65j3TXrhJXXoxa6e5dJiF2NGZ_-BC-AE6K9lBZZtDAYrzUdkPk-Yv4p3EASDbDSdLzhFX6D0KIs4uiyVHodbRdasM2zfW7Y8tBOpceL-9wsp_TE-YAWhJWpz1vWoYxf0066BvMcKKQgIQaWZ_j45kR24 Oct 18 15:25:03.430675 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:25:03.430675 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:25:03.430675 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:25:03.430675 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:25:03.430675 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:25:03.430675 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:25:03.430675 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: e4be1c64d642433eb9c731d78a7129f3 Oct 18 15:25:03.430675 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-AggregatesAdminTestJSON-1811259202 Oct 18 15:25:03.430675 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,admin,reader Oct 18 15:25:03.430675 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,admin,reader Oct 18 15:25:03.431986 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e4be1c64d642433eb9c731d78a7129f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e4be1c64d642433eb9c731d78a7129f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e4be1c64d642433eb9c731d78a7129f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e4be1c64d642433eb9c731d78a7129f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:25:03.431986 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-AggregatesAdminTestJSON-1811259202 Oct 18 15:25:03.431986 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: e4be1c64d642433eb9c731d78a7129f3 Oct 18 15:25:03.431986 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1811259202 Oct 18 15:25:03.431986 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-AggregatesAdminTestJSON-1811259202-project-admin Oct 18 15:25:03.431986 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:25:03.431986 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:25:03.431986 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: f0a3a70457a240cda0dd281a575328d3 Oct 18 15:25:03.431986 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-AggregatesAdminTestJSON-1811259202-project-admin Oct 18 15:25:03.431986 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:25:03.431986 n-d-853682-5 devstack@n-api.service[120405]: exception: Aggregate 7 could not be found. Oct 18 15:25:03.431986 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '7'} Oct 18 15:25:03.431986 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:25:03.432957 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:03.432957 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 18 15:25:03.432957 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 18 15:25:03.432957 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 18 15:25:03.432957 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 18 15:25:03.432957 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 15:25:03.432957 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 15:25:03.432957 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 18 15:25:03.432957 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 18 15:25:03.432957 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 15:25:03.432957 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 15:25:03.432957 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 18 15:25:03.432957 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 18 15:25:03.432957 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Oct 18 15:25:03.432957 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:03.432957 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:25:03.432957 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:03.432957 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:03.432957 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:25:03.434232 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:25:03.434232 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:25:03.434232 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:25:03.434232 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:25:03.434232 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:25:03.434232 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 18 15:25:03.434232 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:25:03.434232 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Oct 18 15:25:03.434232 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:03.434232 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:25:03.434232 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:03.434232 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:03.434232 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:25:03.434232 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:25:03.434232 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:25:03.434232 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:25:03.434232 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Oct 18 15:25:03.434232 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:03.436128 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3cb79695-d7c6-4d13-a941-49897cd69ab8 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:25:03.436128 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3cb79695-d7c6-4d13-a941-49897cd69ab8 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.032751 Oct 18 15:25:03.439552 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 112/235] 10.222.0.60 () {58 vars in 1149 bytes} [Tue Oct 18 15:25:03 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 15:25:03.446638 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-785aa76b-a02f-4653-bad5-0a58e76de4d6 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:03.452088 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a687b042-7571-4036-bfbd-1b81e561f6c8 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 241 microversion: 2.1 time: 0.265929 Oct 18 15:25:03.452608 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 124/236] 10.222.0.60 () {60 vars in 1191 bytes} [Tue Oct 18 15:25:03 2022] POST /compute/v2.1/os-aggregates/6/action => generated 241 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:03.467044 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f18b97ba-8a10-4493-a689-bac90a91f86d tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-853682-5"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:03.478013 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-785aa76b-a02f-4653-bad5-0a58e76de4d6 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Oct 18 15:25:03.482079 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-785aa76b-a02f-4653-bad5-0a58e76de4d6 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Request method failure captured: Oct 18 15:25:03.482079 n-d-853682-5 devstack@n-api.service[120405]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 18 15:25:03.482079 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:25:03.482079 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:25:03.482079 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:25:03.482079 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:25:03.482079 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:25:03.482079 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:25:03.482079 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:25:03.482079 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:25:03.482079 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsUgMQ3pc4stAk8GauxA-eq65j3TXrhJXXoxa6e5dJiF2NGZ_-BC-AE6K9lBZZtDAYrzUdkPk-Yv4p3EASDbDSdLzhFX6D0KIs4uiyVHodbRdasM2zfW7Y8tBOpceL-9wsp_TE-YAWhJWpz1vWoYxf0066BvMcKKQgIQaWZ_j45kR24 Oct 18 15:25:03.482079 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:25:03.482079 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:25:03.482079 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:25:03.482079 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:25:03.482079 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:25:03.482079 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:25:03.482079 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: e4be1c64d642433eb9c731d78a7129f3 Oct 18 15:25:03.482079 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-AggregatesAdminTestJSON-1811259202 Oct 18 15:25:03.482079 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,admin,reader Oct 18 15:25:03.482079 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,admin,reader Oct 18 15:25:03.483278 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e4be1c64d642433eb9c731d78a7129f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e4be1c64d642433eb9c731d78a7129f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e4be1c64d642433eb9c731d78a7129f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e4be1c64d642433eb9c731d78a7129f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:25:03.483278 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-AggregatesAdminTestJSON-1811259202 Oct 18 15:25:03.483278 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: e4be1c64d642433eb9c731d78a7129f3 Oct 18 15:25:03.483278 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1811259202 Oct 18 15:25:03.483278 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-AggregatesAdminTestJSON-1811259202-project-admin Oct 18 15:25:03.483278 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:25:03.483278 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:25:03.483278 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: f0a3a70457a240cda0dd281a575328d3 Oct 18 15:25:03.483278 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-AggregatesAdminTestJSON-1811259202-project-admin Oct 18 15:25:03.483278 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:25:03.483278 n-d-853682-5 devstack@n-api.service[120405]: exception: Aggregate 7 could not be found. Oct 18 15:25:03.483278 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '7'} Oct 18 15:25:03.483278 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:25:03.484568 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:03.484568 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 18 15:25:03.484568 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 18 15:25:03.484568 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 15:25:03.484568 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 15:25:03.484568 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 15:25:03.484568 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 15:25:03.484568 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 15:25:03.484568 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 15:25:03.484568 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 15:25:03.484568 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 15:25:03.484568 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 18 15:25:03.484568 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 18 15:25:03.484568 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 15:25:03.484568 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 15:25:03.484568 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 18 15:25:03.484568 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 18 15:25:03.484568 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 15:25:03.484568 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 15:25:03.485865 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 18 15:25:03.485865 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 18 15:25:03.485865 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Oct 18 15:25:03.485865 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:03.485865 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:25:03.485865 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:03.485865 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:03.485865 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:25:03.485865 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:25:03.485865 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:25:03.485865 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:25:03.485865 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:25:03.485865 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:25:03.485865 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 18 15:25:03.485865 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:25:03.485865 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Oct 18 15:25:03.485865 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:03.485865 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:25:03.485865 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:03.485865 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:03.485865 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:25:03.486985 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:25:03.486985 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:25:03.486985 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:25:03.486985 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Oct 18 15:25:03.486985 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:03.486985 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-785aa76b-a02f-4653-bad5-0a58e76de4d6 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:25:03.486985 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-785aa76b-a02f-4653-bad5-0a58e76de4d6 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.044679 Oct 18 15:25:03.496406 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 113/237] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Oct 18 15:25:03 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 15:25:03.497298 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f18b97ba-8a10-4493-a689-bac90a91f86d tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:03.497787 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f18b97ba-8a10-4493-a689-bac90a91f86d tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:03.498222 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f18b97ba-8a10-4493-a689-bac90a91f86d tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:03.506369 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-787fb3bd-d14e-4d25-b33f-a105e0c10820 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1468883851"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:03.514031 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.aggregate [None req-787fb3bd-d14e-4d25-b33f-a105e0c10820 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Generated uuid f26f466f-df2b-4c0b-afce-a557849a9900 for aggregate {{(pid=120405) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 15:25:03.579336 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-787fb3bd-d14e-4d25-b33f-a105e0c10820 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.081743 Oct 18 15:25:03.585460 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 114/238] 10.222.0.60 () {60 vars in 1164 bytes} [Tue Oct 18 15:25:03 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:03.598699 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-f18b97ba-8a10-4493-a689-bac90a91f86d tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] HTTP exception thrown: Aggregate 6 already has host n-h2-853682-5. Oct 18 15:25:03.602886 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7cf73047-61f2-434d-8abf-6e7bbac27c81 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:03.617086 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7cf73047-61f2-434d-8abf-6e7bbac27c81 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 227 microversion: 2.1 time: 0.027306 Oct 18 15:25:03.628662 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 115/239] 10.222.0.60 () {58 vars in 1149 bytes} [Tue Oct 18 15:25:03 2022] GET /compute/v2.1/os-aggregates/8 => generated 227 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:03.628799 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f18b97ba-8a10-4493-a689-bac90a91f86d tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Request method failure captured: Oct 18 15:25:03.628799 n-d-853682-5 devstack@n-api.service[120406]: request: POST /compute/v2.1/os-aggregates/6/action HTTP/1.1 Oct 18 15:25:03.628799 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:25:03.628799 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:25:03.628799 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:25:03.628799 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 39 Oct 18 15:25:03.628799 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:25:03.628799 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:25:03.628799 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:25:03.628799 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:25:03.628799 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsUh6ZHDmvaKM6PaeTx2ho_LB60vx4BrVnb8X4W2tRhBjFjc05Zt_WBi0WaTgOSGYhQiayDM6BmBL34x2VhIy84TFimESRE9cS7-tQ2_8Lc9DVi0veHWUr_p9sVo5uK7PI2ACCwCLVucamuoSbjf3K1nWO2qJCuLznoA5hHN9yTOV38 Oct 18 15:25:03.628799 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:25:03.628799 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:25:03.628799 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:25:03.628799 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:25:03.628799 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:25:03.628799 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:25:03.628799 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 554aa99e7e5845e4b9c3ea1bff5ecc8f Oct 18 15:25:03.628799 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1046113857 Oct 18 15:25:03.628799 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,admin,reader Oct 18 15:25:03.628799 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,admin,reader Oct 18 15:25:03.629963 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/554aa99e7e5845e4b9c3ea1bff5ecc8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/554aa99e7e5845e4b9c3ea1bff5ecc8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/554aa99e7e5845e4b9c3ea1bff5ecc8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_554aa99e7e5845e4b9c3ea1bff5ecc8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:25:03.629963 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1046113857 Oct 18 15:25:03.629963 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 554aa99e7e5845e4b9c3ea1bff5ecc8f Oct 18 15:25:03.629963 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1046113857 Oct 18 15:25:03.629963 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin Oct 18 15:25:03.629963 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:25:03.629963 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:25:03.629963 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 3da81e0aef8541a8b8a67a045077987d Oct 18 15:25:03.629963 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin Oct 18 15:25:03.629963 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:25:03.629963 n-d-853682-5 devstack@n-api.service[120406]: {"add_host": {"host": "n-h2-853682-5"}} Oct 18 15:25:03.629963 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:25:03.629963 n-d-853682-5 devstack@n-api.service[120406]: exception: Aggregate 6 already has host n-h2-853682-5. Oct 18 15:25:03.631596 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '6', 'body': {'add_host': {'host': 'n-h2-853682-5'}}} Oct 18 15:25:03.631596 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:25:03.631596 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:03.631596 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 15:25:03.631596 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 18 15:25:03.631596 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 15:25:03.631596 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 18 15:25:03.631596 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 15:25:03.631596 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 18 15:25:03.631596 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 15:25:03.631596 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 18 15:25:03.631596 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 15:25:03.631596 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 15:25:03.631596 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 15:25:03.631596 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result.read() Oct 18 15:25:03.631596 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 15:25:03.631596 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 18 15:25:03.631596 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 15:25:03.631596 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 18 15:25:03.633873 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 15:25:03.633873 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 18 15:25:03.633873 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 15:25:03.633873 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 18 15:25:03.633873 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-853682-5-6' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 18 15:25:03.633873 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:25:03.633873 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 18 15:25:03.633873 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:25:03.633873 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:03.633873 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 18 15:25:03.633873 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 18 15:25:03.633873 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 18 15:25:03.633873 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi session.flush() Oct 18 15:25:03.633873 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 18 15:25:03.633873 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 18 15:25:03.633873 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 18 15:25:03.633873 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 18 15:25:03.633873 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 18 15:25:03.633873 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 18 15:25:03.634906 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 15:25:03.634906 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception Oct 18 15:25:03.634906 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 18 15:25:03.634906 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 18 15:25:03.634906 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 18 15:25:03.634906 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 18 15:25:03.634906 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 18 15:25:03.634906 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 18 15:25:03.634906 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 18 15:25:03.634906 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 18 15:25:03.634906 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 18 15:25:03.634906 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 18 15:25:03.634906 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 18 15:25:03.634906 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 18 15:25:03.634906 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 18 15:25:03.634906 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 18 15:25:03.634906 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 18 15:25:03.634906 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 18 15:25:03.635859 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 18 15:25:03.635859 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 18 15:25:03.635859 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 18 15:25:03.635859 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 18 15:25:03.635859 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 15:25:03.635859 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception Oct 18 15:25:03.635859 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 15:25:03.635859 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 18 15:25:03.635859 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 15:25:03.635859 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 18 15:25:03.635859 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 15:25:03.635859 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 18 15:25:03.635859 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 15:25:03.635859 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 18 15:25:03.635859 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 15:25:03.635859 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 15:25:03.635859 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 15:25:03.635859 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result.read() Oct 18 15:25:03.639170 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 15:25:03.639170 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 18 15:25:03.639170 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 15:25:03.639170 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 18 15:25:03.639170 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 15:25:03.639170 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 18 15:25:03.639170 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 15:25:03.639170 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 18 15:25:03.639170 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-853682-5-6' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 18 15:25:03.639170 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 18 15:25:03.639170 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 18, 15, 25, 3, 539144), 'updated_at': None, 'host': 'n-h2-853682-5', 'aggregate_id': 6}] Oct 18 15:25:03.639170 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 18 15:25:03.639170 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:25:03.639170 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:25:03.639170 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:25:03.639170 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:03.639170 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 18 15:25:03.640915 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 18 15:25:03.640915 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 15:25:03.640915 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 15:25:03.640915 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 15:25:03.640915 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 15:25:03.640915 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 15:25:03.640915 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 15:25:03.640915 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 15:25:03.640915 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 15:25:03.640915 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Oct 18 15:25:03.640915 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 18 15:25:03.640915 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 18 15:25:03.640915 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 18 15:25:03.640915 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 18 15:25:03.640915 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 18 15:25:03.640915 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 18 15:25:03.640915 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 18 15:25:03.640915 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 6 already has host n-h2-853682-5. Oct 18 15:25:03.640915 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:25:03.640915 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:25:03.646400 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:25:03.646400 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:03.646400 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:25:03.646400 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:25:03.646400 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:25:03.646400 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:25:03.646400 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:25:03.646400 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:25:03.646400 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:25:03.646400 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:25:03.646400 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 18 15:25:03.646400 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 18 15:25:03.646400 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 6 already has host n-h2-853682-5. Oct 18 15:25:03.646400 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:25:03.646400 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:25:03.646400 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:25:03.646400 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:03.646400 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:25:03.646400 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:25:03.646400 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:25:03.646400 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:25:03.647699 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 already has host n-h2-853682-5. Oct 18 15:25:03.647699 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:25:03.647699 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f18b97ba-8a10-4493-a689-bac90a91f86d tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Returning 409 to user: Aggregate 6 already has host n-h2-853682-5. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:25:03.647699 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f18b97ba-8a10-4493-a689-bac90a91f86d tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/6/action" status: 409 len: 95 microversion: 2.1 time: 0.169303 Oct 18 15:25:03.647699 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 125/240] 10.222.0.60 () {60 vars in 1191 bytes} [Tue Oct 18 15:25:03 2022] POST /compute/v2.1/os-aggregates/6/action => generated 95 bytes in 178 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 18 15:25:03.647699 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bc96d338-0efe-42e7-9a2a-d5a0b4daee1d tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:03.658353 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bd0f85c3-6749-4fee-bf5a-24bfe45c288b tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-853682-5"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:03.689018 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bd0f85c3-6749-4fee-bf5a-24bfe45c288b tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:03.693337 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bd0f85c3-6749-4fee-bf5a-24bfe45c288b tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:03.694804 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bd0f85c3-6749-4fee-bf5a-24bfe45c288b tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:03.711938 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bc96d338-0efe-42e7-9a2a-d5a0b4daee1d tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 265 microversion: 2.1 time: 0.072344 Oct 18 15:25:03.713018 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 126/241] 10.222.0.60 () {60 vars in 1191 bytes} [Tue Oct 18 15:25:03 2022] POST /compute/v2.1/os-aggregates/8/action => generated 265 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:03.727977 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a0d6af5a-906f-4227-8cf4-db3de19a476e tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:03.775209 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a0d6af5a-906f-4227-8cf4-db3de19a476e tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 241 microversion: 2.1 time: 0.053883 Oct 18 15:25:03.778467 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 127/242] 10.222.0.60 () {58 vars in 1149 bytes} [Tue Oct 18 15:25:03 2022] GET /compute/v2.1/os-aggregates/8 => generated 241 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:03.811291 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-85fc6017-1ecd-49dc-be05-d1048de43dcc tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:03.835729 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:DELETE=5,nova_api:INSERT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:25:03.885077 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-85fc6017-1ecd-49dc-be05-d1048de43dcc tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.094370 Oct 18 15:25:03.894745 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 128/243] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Oct 18 15:25:03 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 15:25:03.908496 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eae25b27-dd17-4e1a-a87e-dbc67aaa03dd tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1401566503", "availability_zone": "tempest-test_az-843397725"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:03.911438 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-bd0f85c3-6749-4fee-bf5a-24bfe45c288b tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 226 microversion: 2.1 time: 0.261992 Oct 18 15:25:03.921057 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 116/244] 10.222.0.60 () {60 vars in 1191 bytes} [Tue Oct 18 15:25:03 2022] POST /compute/v2.1/os-aggregates/6/action => generated 226 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:03.930934 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d1f693ac-6257-4c90-91f8-0748ce23be7c tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:03.948301 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.aggregate [None req-eae25b27-dd17-4e1a-a87e-dbc67aaa03dd tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Generated uuid 3c52554b-436d-4284-b6ef-39f4d6e8065c for aggregate {{(pid=120406) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 15:25:03.998919 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d1f693ac-6257-4c90-91f8-0748ce23be7c tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.074310 Oct 18 15:25:04.002335 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 117/245] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Oct 18 15:25:03 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 15:25:04.019881 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-eae25b27-dd17-4e1a-a87e-dbc67aaa03dd tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.122145 Oct 18 15:25:04.026530 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-255c2e3b-c702-40e2-bb74-2c1442bd6f53 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-586226595"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:04.029840 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 129/246] 10.222.0.60 () {60 vars in 1165 bytes} [Tue Oct 18 15:25:03 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:04.033778 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.aggregate [None req-255c2e3b-c702-40e2-bb74-2c1442bd6f53 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Generated uuid 2cca08ec-7fbc-4eeb-8f9b-d55cad4e3bb1 for aggregate {{(pid=120405) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 15:25:04.040920 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b201b864-e39c-45f8-b1ab-f1e1a7864475 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1401566503_new", "availability_zone": "tempest-test_az-843397725_new"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:04.095168 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-255c2e3b-c702-40e2-bb74-2c1442bd6f53 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.087006 Oct 18 15:25:04.102278 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 118/247] 10.222.0.60 () {60 vars in 1164 bytes} [Tue Oct 18 15:25:04 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:04.110396 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f12414b1-42b1-4d8e-a0c5-02fc261834ba tempest-AggregatesAdminTestV241-1233066459 tempest-AggregatesAdminTestV241-1233066459-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-77575992"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:04.125539 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.aggregate [None req-f12414b1-42b1-4d8e-a0c5-02fc261834ba tempest-AggregatesAdminTestV241-1233066459 tempest-AggregatesAdminTestV241-1233066459-project-admin] Generated uuid 07ab2d8c-4170-48eb-a6ec-ca8dcf8e7db0 for aggregate {{(pid=120405) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 15:25:04.188994 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f12414b1-42b1-4d8e-a0c5-02fc261834ba tempest-AggregatesAdminTestV241-1233066459 tempest-AggregatesAdminTestV241-1233066459-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.41 time: 0.091248 Oct 18 15:25:04.203410 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 119/248] 10.222.0.60 () {62 vars in 1205 bytes} [Tue Oct 18 15:25:04 2022] POST /compute/v2.1/os-aggregates => generated 245 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:25:04.305114 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b201b864-e39c-45f8-b1ab-f1e1a7864475 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:04.305605 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b201b864-e39c-45f8-b1ab-f1e1a7864475 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:04.306048 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b201b864-e39c-45f8-b1ab-f1e1a7864475 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:04.379627 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b201b864-e39c-45f8-b1ab-f1e1a7864475 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-aggregates/9" status: 200 len: 334 microversion: 2.1 time: 0.347892 Oct 18 15:25:04.383393 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 130/249] 10.222.0.60 () {60 vars in 1170 bytes} [Tue Oct 18 15:25:04 2022] PUT /compute/v2.1/os-aggregates/9 => generated 334 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:04.399695 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-df368727-abab-4d9e-8a6e-7be22e0ff729 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:04.400857 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-df368727-abab-4d9e-8a6e-7be22e0ff729 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: 2dea609b-60cd-4634-b6d6-f5e3e085c1a3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:04.410491 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df368727-abab-4d9e-8a6e-7be22e0ff729 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:04.411319 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df368727-abab-4d9e-8a6e-7be22e0ff729 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:04.412124 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df368727-abab-4d9e-8a6e-7be22e0ff729 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:04.414442 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df368727-abab-4d9e-8a6e-7be22e0ff729 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:04.414986 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df368727-abab-4d9e-8a6e-7be22e0ff729 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:04.415527 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df368727-abab-4d9e-8a6e-7be22e0ff729 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:04.628834 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-21f4ac0a-6519-4df9-bd54-d6a6ab678d0d tempest-AggregatesAdminNegativeTestJSON-1676305769 tempest-AggregatesAdminNegativeTestJSON-1676305769-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-853682-5"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:04.642008 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-21f4ac0a-6519-4df9-bd54-d6a6ab678d0d tempest-AggregatesAdminNegativeTestJSON-1676305769 tempest-AggregatesAdminNegativeTestJSON-1676305769-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'e466ea3d19ce45a4b8244ca95900d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7803392db1444a8d66827b267cc925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:04.648961 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-21f4ac0a-6519-4df9-bd54-d6a6ab678d0d tempest-AggregatesAdminNegativeTestJSON-1676305769 tempest-AggregatesAdminNegativeTestJSON-1676305769-project] Request method failure captured: Oct 18 15:25:04.648961 n-d-853682-5 devstack@n-api.service[120405]: request: POST /compute/v2.1/os-aggregates/10/action HTTP/1.1 Oct 18 15:25:04.648961 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:25:04.648961 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:25:04.648961 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:25:04.648961 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 39 Oct 18 15:25:04.648961 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:25:04.648961 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:25:04.648961 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:25:04.648961 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:25:04.648961 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsUdIBy8QcybZPNE_7e0OzQtThqWeCN2rLv2hZasVKXJipKBz5ZMf8t6Uo1zinl8lADWo0G4Cf0FhwXWmJ10jBikDahUm9HoX5_XxBbVn681TW25mL7s4_BUiQoD15xNIOmwRikKya-iUvmFAqKm5D6WTcwEtBl4pPrEjaj8DIw2cHw Oct 18 15:25:04.648961 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:25:04.648961 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:25:04.648961 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:25:04.648961 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:25:04.648961 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:25:04.648961 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:25:04.648961 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: fe7803392db1444a8d66827b267cc925 Oct 18 15:25:04.648961 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1676305769 Oct 18 15:25:04.648961 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:25:04.648961 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:25:04.650342 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fe7803392db1444a8d66827b267cc925"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fe7803392db1444a8d66827b267cc925"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/fe7803392db1444a8d66827b267cc925"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_fe7803392db1444a8d66827b267cc925"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:25:04.650342 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1676305769 Oct 18 15:25:04.650342 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: fe7803392db1444a8d66827b267cc925 Oct 18 15:25:04.650342 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1676305769 Oct 18 15:25:04.650342 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-AggregatesAdminNegativeTestJSON-1676305769-project Oct 18 15:25:04.650342 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:25:04.650342 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:25:04.650342 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: e466ea3d19ce45a4b8244ca95900d49e Oct 18 15:25:04.650342 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1676305769-project Oct 18 15:25:04.650342 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:25:04.650342 n-d-853682-5 devstack@n-api.service[120405]: {"add_host": {"host": "n-h2-853682-5"}} Oct 18 15:25:04.650342 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:25:04.650342 n-d-853682-5 devstack@n-api.service[120405]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 18 15:25:04.651189 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '10', 'body': {'add_host': {'host': 'n-h2-853682-5'}}} Oct 18 15:25:04.651189 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:25:04.651189 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:04.651189 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:25:04.651189 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:25:04.651189 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:25:04.651189 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:25:04.651189 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:25:04.651189 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:25:04.651189 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:25:04.651189 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:25:04.651189 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 18 15:25:04.651189 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 18 15:25:04.651189 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 15:25:04.651189 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 15:25:04.651189 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 15:25:04.651189 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 15:25:04.651189 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 15:25:04.651189 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 15:25:04.652450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 15:25:04.652450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 15:25:04.652450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 15:25:04.652450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 15:25:04.652450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 15:25:04.652450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 15:25:04.652450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 15:25:04.652450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 15:25:04.652450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 18 15:25:04.652450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:04.652450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:25:04.652450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:04.652450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:04.652450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:25:04.652450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:25:04.652450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 15:25:04.652450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 15:25:04.652450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 18 15:25:04.652450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:04.653698 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-21f4ac0a-6519-4df9-bd54-d6a6ab678d0d tempest-AggregatesAdminNegativeTestJSON-1676305769 tempest-AggregatesAdminNegativeTestJSON-1676305769-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:25:04.653698 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-21f4ac0a-6519-4df9-bd54-d6a6ab678d0d tempest-AggregatesAdminNegativeTestJSON-1676305769 tempest-AggregatesAdminNegativeTestJSON-1676305769-project] 10.222.0.60 "POST /compute/v2.1/os-aggregates/10/action" status: 403 len: 118 microversion: 2.1 time: 0.448104 Oct 18 15:25:04.657277 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 120/250] 10.222.0.60 () {60 vars in 1194 bytes} [Tue Oct 18 15:25:04 2022] POST /compute/v2.1/os-aggregates/10/action => generated 118 bytes in 453 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:25:04.833059 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-df368727-abab-4d9e-8a6e-7be22e0ff729 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:04.848689 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-df368727-abab-4d9e-8a6e-7be22e0ff729 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3" status: 200 len: 1311 microversion: 2.1 time: 0.463763 Oct 18 15:25:04.850923 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 131/251] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:25:04 2022] GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3 => generated 1311 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:25:04.865197 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eb0c2ca0-395b-4bf7-8b16-c50b1a0498ee tempest-AggregatesAdminTestV241-1233066459 tempest-AggregatesAdminTestV241-1233066459-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1076148291"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:04.959035 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-eb0c2ca0-395b-4bf7-8b16-c50b1a0498ee tempest-AggregatesAdminTestV241-1233066459 tempest-AggregatesAdminTestV241-1233066459-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-aggregates/11" status: 200 len: 300 microversion: 2.41 time: 0.109048 Oct 18 15:25:04.959648 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 132/252] 10.222.0.60 () {62 vars in 1213 bytes} [Tue Oct 18 15:25:04 2022] PUT /compute/v2.1/os-aggregates/11 => generated 300 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:25:04.985753 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a1dec6a2-498c-47c5-a0ad-6e1ebe18a214 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:05.010561 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a1dec6a2-498c-47c5-a0ad-6e1ebe18a214 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates" status: 200 len: 790 microversion: 2.1 time: 0.043310 Oct 18 15:25:05.011139 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 133/253] 10.222.0.60 () {58 vars in 1143 bytes} [Tue Oct 18 15:25:04 2022] GET /compute/v2.1/os-aggregates => generated 790 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:05.037071 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-14ee02f6-0fcc-481b-ad20-779d4008278d tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:05.057945 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c37de187-473d-4ac7-9467-5babc6b2c66c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1200257550", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "ef6fe956-3e84-412d-8f85-8f55d9975d85"}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:05.099644 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-14ee02f6-0fcc-481b-ad20-779d4008278d tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.073035 Oct 18 15:25:05.103941 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 134/254] 10.222.0.60 () {58 vars in 1155 bytes} [Tue Oct 18 15:25:05 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 15:25:05.120991 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-37970d75-263c-457e-ad6f-008b29abcf1c tempest-AggregatesAdminTestV241-1233066459 tempest-AggregatesAdminTestV241-1233066459-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:05.137003 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-37970d75-263c-457e-ad6f-008b29abcf1c tempest-AggregatesAdminTestV241-1233066459 tempest-AggregatesAdminTestV241-1233066459-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates/11" status: 200 len: 300 microversion: 2.41 time: 0.031663 Oct 18 15:25:05.149979 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 135/255] 10.222.0.60 () {60 vars in 1193 bytes} [Tue Oct 18 15:25:05 2022] GET /compute/v2.1/os-aggregates/11 => generated 300 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:25:05.154862 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-607c6e3f-5585-4bd2-8bd9-6fb1077be7e7 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:05.197958 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-607c6e3f-5585-4bd2-8bd9-6fb1077be7e7 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.046641 Oct 18 15:25:05.199846 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 136/256] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Oct 18 15:25:05 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 15:25:05.208357 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-761003a3-b43e-4b6a-8169-a33c7101764f tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2075871024"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:05.220230 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-c37de187-473d-4ac7-9467-5babc6b2c66c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] validate_networks() for [('ef6fe956-3e84-412d-8f85-8f55d9975d85', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:25:05.221369 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.aggregate [None req-761003a3-b43e-4b6a-8169-a33c7101764f tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Generated uuid 04a5fa03-7928-421b-81c0-8b38621c7aeb for aggregate {{(pid=120406) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 15:25:05.264061 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-761003a3-b43e-4b6a-8169-a33c7101764f tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.059196 Oct 18 15:25:05.265789 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 137/257] 10.222.0.60 () {60 vars in 1164 bytes} [Tue Oct 18 15:25:05 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:05.274310 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d17d49db-0408-4984-8b25-7469453c5bbc tempest-AggregatesAdminTestV241-1233066459 tempest-AggregatesAdminTestV241-1233066459-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-853682-5"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:05.298576 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d17d49db-0408-4984-8b25-7469453c5bbc tempest-AggregatesAdminTestV241-1233066459 tempest-AggregatesAdminTestV241-1233066459-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:05.299944 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d17d49db-0408-4984-8b25-7469453c5bbc tempest-AggregatesAdminTestV241-1233066459 tempest-AggregatesAdminTestV241-1233066459-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:05.300875 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d17d49db-0408-4984-8b25-7469453c5bbc tempest-AggregatesAdminTestV241-1233066459 tempest-AggregatesAdminTestV241-1233066459-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:05.537831 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d17d49db-0408-4984-8b25-7469453c5bbc tempest-AggregatesAdminTestV241-1233066459 tempest-AggregatesAdminTestV241-1233066459-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 315 microversion: 2.41 time: 0.270729 Oct 18 15:25:05.545777 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 138/258] 10.222.0.60 () {62 vars in 1235 bytes} [Tue Oct 18 15:25:05 2022] POST /compute/v2.1/os-aggregates/11/action => generated 315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:25:05.545777 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8b55848a-3686-4379-b8cf-5eb18b604bdd tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1368278838"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:05.553793 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.aggregate [None req-8b55848a-3686-4379-b8cf-5eb18b604bdd tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Generated uuid 9f9eb937-8ad2-46b4-94a7-5827193e4a64 for aggregate {{(pid=120406) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 15:25:05.596478 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8b55848a-3686-4379-b8cf-5eb18b604bdd tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.056935 Oct 18 15:25:05.597377 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 139/259] 10.222.0.60 () {60 vars in 1164 bytes} [Tue Oct 18 15:25:05 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:05.611224 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ab0edfe2-5d59-45b1-a59a-5ffacce52e09 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-958332977"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:05.623795 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab0edfe2-5d59-45b1-a59a-5ffacce52e09 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:05.625418 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab0edfe2-5d59-45b1-a59a-5ffacce52e09 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:05.625860 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab0edfe2-5d59-45b1-a59a-5ffacce52e09 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:05.634216 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab0edfe2-5d59-45b1-a59a-5ffacce52e09 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:05.635639 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab0edfe2-5d59-45b1-a59a-5ffacce52e09 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:05.636081 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab0edfe2-5d59-45b1-a59a-5ffacce52e09 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:05.644284 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-ab0edfe2-5d59-45b1-a59a-5ffacce52e09 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-958332977 could not be found. Oct 18 15:25:05.647224 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ab0edfe2-5d59-45b1-a59a-5ffacce52e09 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Request method failure captured: Oct 18 15:25:05.647224 n-d-853682-5 devstack@n-api.service[120406]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Oct 18 15:25:05.647224 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:25:05.647224 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:25:05.647224 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:25:05.647224 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 57 Oct 18 15:25:05.647224 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:25:05.647224 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:25:05.647224 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:25:05.647224 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:25:05.647224 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsUh6ZHDmvaKM6PaeTx2ho_LB60vx4BrVnb8X4W2tRhBjFjc05Zt_WBi0WaTgOSGYhQiayDM6BmBL34x2VhIy84TFimESRE9cS7-tQ2_8Lc9DVi0veHWUr_p9sVo5uK7PI2ACCwCLVucamuoSbjf3K1nWO2qJCuLznoA5hHN9yTOV38 Oct 18 15:25:05.647224 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:25:05.647224 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:25:05.647224 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:25:05.647224 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:25:05.647224 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:25:05.647224 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:25:05.647224 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 554aa99e7e5845e4b9c3ea1bff5ecc8f Oct 18 15:25:05.647224 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1046113857 Oct 18 15:25:05.647224 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,admin,reader Oct 18 15:25:05.647224 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,admin,reader Oct 18 15:25:05.648714 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/554aa99e7e5845e4b9c3ea1bff5ecc8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/554aa99e7e5845e4b9c3ea1bff5ecc8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/554aa99e7e5845e4b9c3ea1bff5ecc8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_554aa99e7e5845e4b9c3ea1bff5ecc8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:25:05.648714 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1046113857 Oct 18 15:25:05.648714 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 554aa99e7e5845e4b9c3ea1bff5ecc8f Oct 18 15:25:05.648714 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1046113857 Oct 18 15:25:05.648714 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin Oct 18 15:25:05.648714 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:25:05.648714 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:25:05.648714 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 3da81e0aef8541a8b8a67a045077987d Oct 18 15:25:05.648714 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin Oct 18 15:25:05.648714 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:25:05.648714 n-d-853682-5 devstack@n-api.service[120406]: {"add_host": {"host": "tempest-nonexist_host-958332977"}} Oct 18 15:25:05.648714 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:25:05.649619 n-d-853682-5 devstack@n-api.service[120406]: exception: Compute host tempest-nonexist_host-958332977 could not be found. Oct 18 15:25:05.649619 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '12', 'body': {'add_host': {'host': 'tempest-nonexist_host-958332977'}}} Oct 18 15:25:05.649619 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:25:05.649619 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:05.649619 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 18 15:25:05.649619 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 18 15:25:05.649619 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 15:25:05.649619 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 15:25:05.649619 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 18 15:25:05.649619 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 18 15:25:05.649619 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 15:25:05.649619 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 15:25:05.649619 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 18 15:25:05.649619 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 18 15:25:05.649619 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-958332977' is not mapped to any cell Oct 18 15:25:05.649619 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:25:05.649619 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:25:05.649619 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:25:05.649619 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:05.649619 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 18 15:25:05.651087 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 18 15:25:05.651087 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 18 15:25:05.651087 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 18 15:25:05.651087 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 18 15:25:05.651087 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:25:05.651087 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:25:05.651087 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:25:05.651087 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:05.651087 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 18 15:25:05.651087 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 18 15:25:05.651087 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 15:25:05.651087 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 15:25:05.651087 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 15:25:05.651087 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 15:25:05.651087 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 15:25:05.651087 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 15:25:05.651087 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 15:25:05.651087 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 15:25:05.651087 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Oct 18 15:25:05.651087 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 18 15:25:05.652347 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 18 15:25:05.652347 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 18 15:25:05.652347 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-958332977 could not be found. Oct 18 15:25:05.652347 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:25:05.652347 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:25:05.652347 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:25:05.652347 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:05.652347 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:25:05.652347 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:25:05.652347 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:25:05.652347 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:25:05.652347 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:25:05.652347 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:25:05.652347 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:25:05.652347 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:25:05.652347 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 18 15:25:05.652347 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:25:05.652347 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-958332977 could not be found. Oct 18 15:25:05.652347 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:25:05.652347 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:25:05.652347 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:25:05.653751 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:05.653751 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:25:05.653751 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:25:05.653751 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:25:05.653751 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:25:05.653751 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-958332977 could not be found. Oct 18 15:25:05.653751 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:25:05.653751 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ab0edfe2-5d59-45b1-a59a-5ffacce52e09 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-958332977 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:25:05.653751 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ab0edfe2-5d59-45b1-a59a-5ffacce52e09 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/12/action" status: 404 len: 110 microversion: 2.1 time: 0.043138 Oct 18 15:25:05.653751 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 140/260] 10.222.0.60 () {60 vars in 1194 bytes} [Tue Oct 18 15:25:05 2022] POST /compute/v2.1/os-aggregates/12/action => generated 110 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:25:05.656544 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3382893f-54a5-4a24-baee-c0af70dfab8c tempest-AggregatesAdminTestV241-1233066459 tempest-AggregatesAdminTestV241-1233066459-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-853682-5"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:05.670437 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3382893f-54a5-4a24-baee-c0af70dfab8c tempest-AggregatesAdminTestV241-1233066459 tempest-AggregatesAdminTestV241-1233066459-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:05.670991 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3382893f-54a5-4a24-baee-c0af70dfab8c tempest-AggregatesAdminTestV241-1233066459 tempest-AggregatesAdminTestV241-1233066459-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:05.672176 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3382893f-54a5-4a24-baee-c0af70dfab8c tempest-AggregatesAdminTestV241-1233066459 tempest-AggregatesAdminTestV241-1233066459-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:05.978258 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3382893f-54a5-4a24-baee-c0af70dfab8c tempest-AggregatesAdminTestV241-1233066459 tempest-AggregatesAdminTestV241-1233066459-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 300 microversion: 2.41 time: 0.327628 Oct 18 15:25:05.986951 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 141/261] 10.222.0.60 () {62 vars in 1235 bytes} [Tue Oct 18 15:25:05 2022] POST /compute/v2.1/os-aggregates/11/action => generated 300 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:25:06.001668 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-57b56e92-5aba-4548-9d2d-007c818eee1c tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:06.017707 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-57b56e92-5aba-4548-9d2d-007c818eee1c tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates" status: 200 len: 685 microversion: 2.1 time: 0.028718 Oct 18 15:25:06.018861 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 142/262] 10.222.0.60 () {58 vars in 1143 bytes} [Tue Oct 18 15:25:05 2022] GET /compute/v2.1/os-aggregates => generated 685 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:06.024921 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b3bc2afd-a4e5-4164-83dd-d9b979bf8005 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:06.060208 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b3bc2afd-a4e5-4164-83dd-d9b979bf8005 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.038450 Oct 18 15:25:06.062265 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 143/263] 10.222.0.60 () {58 vars in 1155 bytes} [Tue Oct 18 15:25:06 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 15:25:06.077235 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b43325b8-4d3d-4467-8b72-c1af02f7d09a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:06.079559 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b43325b8-4d3d-4467-8b72-c1af02f7d09a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: 2dea609b-60cd-4634-b6d6-f5e3e085c1a3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:06.094610 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b43325b8-4d3d-4467-8b72-c1af02f7d09a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:06.096959 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b43325b8-4d3d-4467-8b72-c1af02f7d09a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:06.098492 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b43325b8-4d3d-4467-8b72-c1af02f7d09a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:06.101062 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b43325b8-4d3d-4467-8b72-c1af02f7d09a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:06.111138 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b43325b8-4d3d-4467-8b72-c1af02f7d09a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:06.112227 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b43325b8-4d3d-4467-8b72-c1af02f7d09a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:06.271502 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-c37de187-473d-4ac7-9467-5babc6b2c66c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:25:06.272510 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-c37de187-473d-4ac7-9467-5babc6b2c66c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:25:06.273198 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-c37de187-473d-4ac7-9467-5babc6b2c66c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:25:06.273928 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-c37de187-473d-4ac7-9467-5babc6b2c66c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:25:06.274503 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-c37de187-473d-4ac7-9467-5babc6b2c66c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:25:06.290254 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c37de187-473d-4ac7-9467-5babc6b2c66c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:06.294769 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c37de187-473d-4ac7-9467-5babc6b2c66c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:06.295381 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c37de187-473d-4ac7-9467-5babc6b2c66c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:06.296374 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c37de187-473d-4ac7-9467-5babc6b2c66c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:06.298673 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c37de187-473d-4ac7-9467-5babc6b2c66c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:06.299282 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c37de187-473d-4ac7-9467-5babc6b2c66c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:06.340080 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-c37de187-473d-4ac7-9467-5babc6b2c66c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Getting quotas for project ee0a3f0c256544beb2df4f113da56137. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:25:06.350182 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-c37de187-473d-4ac7-9467-5babc6b2c66c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Getting quotas for user ed9cd936192c40efa9099edee445e90e and project ee0a3f0c256544beb2df4f113da56137. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:25:06.380403 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c37de187-473d-4ac7-9467-5babc6b2c66c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:25:06.382810 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c37de187-473d-4ac7-9467-5babc6b2c66c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 51ccbde5-4cf5-4821-9478-c14e19e73ad1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:25:06.471618 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c37de187-473d-4ac7-9467-5babc6b2c66c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.811739 Oct 18 15:25:06.472244 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 121/264] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:25:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:25:06.484512 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-99c1a17a-f87e-48bd-8b4c-b05dc569e925 tempest-AggregatesAdminTestV241-1233066459 tempest-AggregatesAdminTestV241-1233066459-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:06.552745 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b43325b8-4d3d-4467-8b72-c1af02f7d09a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:06.554189 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-99c1a17a-f87e-48bd-8b4c-b05dc569e925 tempest-AggregatesAdminTestV241-1233066459 tempest-AggregatesAdminTestV241-1233066459-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.41 time: 0.080781 Oct 18 15:25:06.564764 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 122/265] 10.222.0.60 () {60 vars in 1196 bytes} [Tue Oct 18 15:25:06 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:06.569895 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b43325b8-4d3d-4467-8b72-c1af02f7d09a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3" status: 200 len: 1311 microversion: 2.1 time: 0.504568 Oct 18 15:25:06.570891 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 144/266] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:25:06 2022] GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3 => generated 1311 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:25:06.585488 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0ebfddbe-5303-41ee-a5f7-796d3afdd9d5 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:06.586974 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-54235029-36ff-4d7b-8f1a-01951de2d82c tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:06.596655 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-54235029-36ff-4d7b-8f1a-01951de2d82c tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Request method failure captured: Oct 18 15:25:06.596655 n-d-853682-5 devstack@n-api.service[120406]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 18 15:25:06.596655 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:25:06.596655 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:25:06.596655 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:25:06.596655 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 283 Oct 18 15:25:06.596655 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:25:06.596655 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:25:06.596655 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:25:06.596655 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:25:06.596655 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsUh6ZHDmvaKM6PaeTx2ho_LB60vx4BrVnb8X4W2tRhBjFjc05Zt_WBi0WaTgOSGYhQiayDM6BmBL34x2VhIy84TFimESRE9cS7-tQ2_8Lc9DVi0veHWUr_p9sVo5uK7PI2ACCwCLVucamuoSbjf3K1nWO2qJCuLznoA5hHN9yTOV38 Oct 18 15:25:06.596655 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:25:06.596655 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:25:06.596655 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:25:06.596655 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:25:06.596655 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:25:06.596655 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:25:06.596655 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 554aa99e7e5845e4b9c3ea1bff5ecc8f Oct 18 15:25:06.596655 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1046113857 Oct 18 15:25:06.596655 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,admin,reader Oct 18 15:25:06.596655 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,admin,reader Oct 18 15:25:06.598239 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/554aa99e7e5845e4b9c3ea1bff5ecc8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/554aa99e7e5845e4b9c3ea1bff5ecc8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/554aa99e7e5845e4b9c3ea1bff5ecc8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_554aa99e7e5845e4b9c3ea1bff5ecc8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:25:06.598239 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1046113857 Oct 18 15:25:06.598239 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 554aa99e7e5845e4b9c3ea1bff5ecc8f Oct 18 15:25:06.598239 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1046113857 Oct 18 15:25:06.598239 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin Oct 18 15:25:06.598239 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:25:06.598239 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:25:06.598239 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 3da81e0aef8541a8b8a67a045077987d Oct 18 15:25:06.598239 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin Oct 18 15:25:06.598239 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:25:06.598892 n-d-853682-5 devstack@n-api.service[120406]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 18 15:25:06.598892 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:25:06.598892 n-d-853682-5 devstack@n-api.service[120406]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 15:25:06.598892 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 18 15:25:06.598892 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:25:06.598892 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:06.598892 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 15:25:06.598892 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 15:25:06.598892 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 15:25:06.598892 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise error Oct 18 15:25:06.599555 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 15:25:06.599555 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:25:06.599555 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 18 15:25:06.599555 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 18 15:25:06.599555 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:25:06.599555 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 18 15:25:06.599555 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 18 15:25:06.599555 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:25:06.599555 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:25:06.599555 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:25:06.599555 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:06.599555 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:25:06.599555 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:25:06.599555 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:25:06.599555 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:25:06.599555 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:25:06.599555 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:25:06.600674 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:25:06.600674 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:25:06.600674 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 15:25:06.600674 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 15:25:06.600674 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 15:25:06.600674 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 15:25:06.600674 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 15:25:06.600674 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 15:25:06.600674 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 15:25:06.600674 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:25:06.600674 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:25:06.600674 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:25:06.600674 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:06.600674 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:25:06.600674 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:25:06.602087 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 15:25:06.602087 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 15:25:06.602087 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 15:25:06.602087 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:25:06.602087 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-54235029-36ff-4d7b-8f1a-01951de2d82c tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:25:06.602680 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-54235029-36ff-4d7b-8f1a-01951de2d82c tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.025861 Oct 18 15:25:06.606004 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 145/267] 10.222.0.60 () {60 vars in 1165 bytes} [Tue Oct 18 15:25:06 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:25:06.700794 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0ebfddbe-5303-41ee-a5f7-796d3afdd9d5 tempest-AggregatesAdminTestJSON-1811259202 tempest-AggregatesAdminTestJSON-1811259202-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.131696 Oct 18 15:25:06.715137 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 123/268] 10.222.0.60 () {58 vars in 1155 bytes} [Tue Oct 18 15:25:06 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 15:25:06.731028 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-526d481a-71e5-4083-a8bc-5bebac747818 req-6ecb1099-ca1e-4e0c-b367-c7ca339a2292 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dea609b-60cd-4634-b6d6-f5e3e085c1a3", "name": "network-vif-plugged", "status": "completed", "tag": "33616eab-5f4e-4a15-9e20-108e043be5cd"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:06.754767 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-526d481a-71e5-4083-a8bc-5bebac747818 req-6ecb1099-ca1e-4e0c-b367-c7ca339a2292 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:06.756241 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-526d481a-71e5-4083-a8bc-5bebac747818 req-6ecb1099-ca1e-4e0c-b367-c7ca339a2292 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:06.757194 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-526d481a-71e5-4083-a8bc-5bebac747818 req-6ecb1099-ca1e-4e0c-b367-c7ca339a2292 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:06.771271 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-526d481a-71e5-4083-a8bc-5bebac747818 req-6ecb1099-ca1e-4e0c-b367-c7ca339a2292 service nova] Creating event network-vif-plugged:33616eab-5f4e-4a15-9e20-108e043be5cd for instance 2dea609b-60cd-4634-b6d6-f5e3e085c1a3 on n-h1-853682-5 Oct 18 15:25:06.778194 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-526d481a-71e5-4083-a8bc-5bebac747818 req-6ecb1099-ca1e-4e0c-b367-c7ca339a2292 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059524 Oct 18 15:25:06.779242 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 124/269] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:06.788303 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6682d93f-9b58-4487-9ae6-7c5427fad925 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:06.789491 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6682d93f-9b58-4487-9ae6-7c5427fad925 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 51ccbde5-4cf5-4821-9478-c14e19e73ad1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:07.003898 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6682d93f-9b58-4487-9ae6-7c5427fad925 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:07.017047 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6682d93f-9b58-4487-9ae6-7c5427fad925 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/51ccbde5-4cf5-4821-9478-c14e19e73ad1" status: 200 len: 1208 microversion: 2.1 time: 0.235995 Oct 18 15:25:07.017935 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 125/270] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:25:06 2022] GET /compute/v2.1/servers/51ccbde5-4cf5-4821-9478-c14e19e73ad1 => generated 1208 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:25:07.023523 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3552bbd1-11ac-44e8-b802-f1d48b0ce2a5 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:07.028253 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3552bbd1-11ac-44e8-b802-f1d48b0ce2a5 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Request method failure captured: Oct 18 15:25:07.028253 n-d-853682-5 devstack@n-api.service[120405]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 18 15:25:07.028253 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:25:07.028253 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:25:07.028253 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:25:07.028253 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 27 Oct 18 15:25:07.028253 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:25:07.028253 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:25:07.028253 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:25:07.028253 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:25:07.028253 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsUh6ZHDmvaKM6PaeTx2ho_LB60vx4BrVnb8X4W2tRhBjFjc05Zt_WBi0WaTgOSGYhQiayDM6BmBL34x2VhIy84TFimESRE9cS7-tQ2_8Lc9DVi0veHWUr_p9sVo5uK7PI2ACCwCLVucamuoSbjf3K1nWO2qJCuLznoA5hHN9yTOV38 Oct 18 15:25:07.028253 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:25:07.028253 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:25:07.028253 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:25:07.028253 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:25:07.028253 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:25:07.028253 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:25:07.028253 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 554aa99e7e5845e4b9c3ea1bff5ecc8f Oct 18 15:25:07.028253 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1046113857 Oct 18 15:25:07.028253 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,admin,reader Oct 18 15:25:07.028253 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,admin,reader Oct 18 15:25:07.029646 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/554aa99e7e5845e4b9c3ea1bff5ecc8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/554aa99e7e5845e4b9c3ea1bff5ecc8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/554aa99e7e5845e4b9c3ea1bff5ecc8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_554aa99e7e5845e4b9c3ea1bff5ecc8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:25:07.029646 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1046113857 Oct 18 15:25:07.029646 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 554aa99e7e5845e4b9c3ea1bff5ecc8f Oct 18 15:25:07.029646 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1046113857 Oct 18 15:25:07.029646 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin Oct 18 15:25:07.029646 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:25:07.029646 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:25:07.029646 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 3da81e0aef8541a8b8a67a045077987d Oct 18 15:25:07.029646 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin Oct 18 15:25:07.029646 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:25:07.029646 n-d-853682-5 devstack@n-api.service[120405]: {"aggregate": {"name": ""}} Oct 18 15:25:07.029646 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:25:07.029646 n-d-853682-5 devstack@n-api.service[120405]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 18 15:25:07.030341 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 18 15:25:07.030341 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:25:07.030341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:07.030341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 15:25:07.030341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 15:25:07.030341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 15:25:07.030341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise error Oct 18 15:25:07.030341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 18 15:25:07.030341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:07.030341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 18 15:25:07.030341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 18 15:25:07.030341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:07.030341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 18 15:25:07.030341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi '' Oct 18 15:25:07.030341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:07.030341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:25:07.030341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:07.030341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:07.030341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:25:07.030341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:25:07.030341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:25:07.030341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:25:07.030341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:25:07.032209 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:25:07.032209 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:25:07.032209 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:25:07.032209 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 15:25:07.032209 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 15:25:07.032209 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 15:25:07.032209 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 15:25:07.032209 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 15:25:07.032209 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 15:25:07.032209 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 18 15:25:07.032209 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:07.032209 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:25:07.032209 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:07.032209 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:07.032209 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:25:07.032209 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:25:07.032209 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 15:25:07.032209 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 15:25:07.032209 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 18 15:25:07.032209 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:07.035381 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3552bbd1-11ac-44e8-b802-f1d48b0ce2a5 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:25:07.036640 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3552bbd1-11ac-44e8-b802-f1d48b0ce2a5 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.016808 Oct 18 15:25:07.037467 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 126/271] 10.222.0.60 () {60 vars in 1164 bytes} [Tue Oct 18 15:25:07 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:25:07.059233 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-20a7b6f8-6a3d-405d-921b-0e909d434dba tempest-InstanceUsageAuditLogNegativeTestJSON-1765508837 tempest-InstanceUsageAuditLogNegativeTestJSON-1765508837-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:07.080522 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-20a7b6f8-6a3d-405d-921b-0e909d434dba tempest-InstanceUsageAuditLogNegativeTestJSON-1765508837 tempest-InstanceUsageAuditLogNegativeTestJSON-1765508837-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 18 15:25:07.098008 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-133842c5-c561-4c8b-a29d-7619b1f137d3 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:07.103669 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-133842c5-c561-4c8b-a29d-7619b1f137d3 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] [instance: 3f5d6640-30f6-490b-984f-d1169918133f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:07.106040 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-20a7b6f8-6a3d-405d-921b-0e909d434dba tempest-InstanceUsageAuditLogNegativeTestJSON-1765508837 tempest-InstanceUsageAuditLogNegativeTestJSON-1765508837-project-admin] Request method failure captured: Oct 18 15:25:07.106040 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 18 15:25:07.106040 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:25:07.106040 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:25:07.106040 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:25:07.106040 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:25:07.106040 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:25:07.106040 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:25:07.106040 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:25:07.106040 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:25:07.106040 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsVSFF01s9o14aeK1miL8lDgES3iEIR6fLeR5mGxcGGthtdBkvt5sJuZXcAQgmAsWySVjFkaQ0p-9DwW3ImgUHoAsL_FN0HTjgdA_jAdGkId8MEEOSE8fkPHGp3dNq_x-Hqa_MF_64owWnIQtW7Ho_BMrX2r5wpiZr3GnMLalBWGhaA Oct 18 15:25:07.106040 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:25:07.106040 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:25:07.106040 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:25:07.106040 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:25:07.106040 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:25:07.106040 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:25:07.106040 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 4f8a5ebbc803426787030dc1d3434ba6 Oct 18 15:25:07.106040 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1765508837 Oct 18 15:25:07.106040 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,admin,reader Oct 18 15:25:07.106040 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,admin,reader Oct 18 15:25:07.107239 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4f8a5ebbc803426787030dc1d3434ba6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4f8a5ebbc803426787030dc1d3434ba6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4f8a5ebbc803426787030dc1d3434ba6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4f8a5ebbc803426787030dc1d3434ba6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:25:07.107239 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1765508837 Oct 18 15:25:07.107239 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 4f8a5ebbc803426787030dc1d3434ba6 Oct 18 15:25:07.107239 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1765508837 Oct 18 15:25:07.107239 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1765508837-project-admin Oct 18 15:25:07.107239 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:25:07.107239 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:25:07.107239 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 525a16b1091a4620bdcca55b832ba488 Oct 18 15:25:07.107239 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1765508837-project-admin Oct 18 15:25:07.107239 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:25:07.107239 n-d-853682-5 devstack@n-api.service[120406]: exception: Invalid timestamp for date invalid_time Oct 18 15:25:07.107860 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'invalid_time'} Oct 18 15:25:07.107860 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:25:07.107860 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:07.107860 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 18 15:25:07.107860 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 18 15:25:07.107860 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 18 15:25:07.107860 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 18 15:25:07.107860 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 18 15:25:07.107860 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 18 15:25:07.107860 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 18 15:25:07.107860 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:25:07.107860 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:25:07.107860 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:25:07.107860 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:07.107860 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:25:07.107860 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:25:07.107860 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:25:07.107860 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:25:07.107860 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:25:07.107860 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:25:07.109644 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 18 15:25:07.109644 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 18 15:25:07.109644 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 18 15:25:07.109644 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:25:07.109644 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:25:07.109644 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:25:07.109644 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:07.109644 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:25:07.109644 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:25:07.109644 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:25:07.109644 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:25:07.109644 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 18 15:25:07.109644 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:25:07.109644 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-20a7b6f8-6a3d-405d-921b-0e909d434dba tempest-InstanceUsageAuditLogNegativeTestJSON-1765508837 tempest-InstanceUsageAuditLogNegativeTestJSON-1765508837-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:25:07.109644 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-20a7b6f8-6a3d-405d-921b-0e909d434dba tempest-InstanceUsageAuditLogNegativeTestJSON-1765508837 tempest-InstanceUsageAuditLogNegativeTestJSON-1765508837-project-admin] 10.222.0.60 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.500618 Oct 18 15:25:07.110480 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 146/272] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Oct 18 15:25:06 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 502 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 18 15:25:07.129263 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6f04abd9-db2c-43d0-bd41-8100e8c07274 tempest-AggregatesAdminNegativeTestJSON-1676305769 tempest-AggregatesAdminNegativeTestJSON-1676305769-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1015593286"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:07.131614 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-133842c5-c561-4c8b-a29d-7619b1f137d3 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:07.135080 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-133842c5-c561-4c8b-a29d-7619b1f137d3 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:07.137360 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-133842c5-c561-4c8b-a29d-7619b1f137d3 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:07.138463 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-133842c5-c561-4c8b-a29d-7619b1f137d3 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:07.143794 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-133842c5-c561-4c8b-a29d-7619b1f137d3 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:07.144685 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-133842c5-c561-4c8b-a29d-7619b1f137d3 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:07.145316 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6f04abd9-db2c-43d0-bd41-8100e8c07274 tempest-AggregatesAdminNegativeTestJSON-1676305769 tempest-AggregatesAdminNegativeTestJSON-1676305769-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'e466ea3d19ce45a4b8244ca95900d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7803392db1444a8d66827b267cc925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:07.149088 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6f04abd9-db2c-43d0-bd41-8100e8c07274 tempest-AggregatesAdminNegativeTestJSON-1676305769 tempest-AggregatesAdminNegativeTestJSON-1676305769-project] Request method failure captured: Oct 18 15:25:07.149088 n-d-853682-5 devstack@n-api.service[120406]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 18 15:25:07.149088 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:25:07.149088 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:25:07.149088 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:25:07.149088 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 60 Oct 18 15:25:07.149088 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:25:07.149088 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:25:07.149088 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:25:07.149088 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:25:07.149088 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsUdIBy8QcybZPNE_7e0OzQtThqWeCN2rLv2hZasVKXJipKBz5ZMf8t6Uo1zinl8lADWo0G4Cf0FhwXWmJ10jBikDahUm9HoX5_XxBbVn681TW25mL7s4_BUiQoD15xNIOmwRikKya-iUvmFAqKm5D6WTcwEtBl4pPrEjaj8DIw2cHw Oct 18 15:25:07.149088 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:25:07.149088 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:25:07.149088 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:25:07.149088 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:25:07.149088 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:25:07.149088 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:25:07.149088 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: fe7803392db1444a8d66827b267cc925 Oct 18 15:25:07.149088 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1676305769 Oct 18 15:25:07.149088 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:25:07.149088 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:25:07.150388 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fe7803392db1444a8d66827b267cc925"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fe7803392db1444a8d66827b267cc925"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/fe7803392db1444a8d66827b267cc925"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_fe7803392db1444a8d66827b267cc925"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:25:07.150388 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1676305769 Oct 18 15:25:07.150388 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: fe7803392db1444a8d66827b267cc925 Oct 18 15:25:07.150388 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1676305769 Oct 18 15:25:07.150388 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-AggregatesAdminNegativeTestJSON-1676305769-project Oct 18 15:25:07.150388 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:25:07.150388 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:25:07.150388 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: e466ea3d19ce45a4b8244ca95900d49e Oct 18 15:25:07.150388 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1676305769-project Oct 18 15:25:07.150388 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:25:07.150388 n-d-853682-5 devstack@n-api.service[120406]: {"aggregate": {"name": "tempest-test_aggregate-1015593286"}} Oct 18 15:25:07.150388 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:25:07.150388 n-d-853682-5 devstack@n-api.service[120406]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 18 15:25:07.151180 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1015593286'}}} Oct 18 15:25:07.151180 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:25:07.151180 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:07.151180 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:25:07.151180 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:25:07.151180 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:25:07.151180 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:25:07.151180 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:25:07.151180 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:25:07.151180 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:25:07.151180 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:25:07.151180 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:25:07.151180 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:25:07.151180 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 18 15:25:07.151180 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 18 15:25:07.151180 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 15:25:07.151180 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 15:25:07.151180 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 15:25:07.151180 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 15:25:07.152272 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 15:25:07.152272 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 15:25:07.152272 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 15:25:07.152272 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 15:25:07.152272 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 15:25:07.152272 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 15:25:07.152272 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 15:25:07.152272 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 15:25:07.152272 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 15:25:07.152272 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 15:25:07.152272 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 18 15:25:07.152272 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:25:07.152272 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:25:07.152272 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:25:07.152272 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:07.152272 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:25:07.152272 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:25:07.152272 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 15:25:07.152272 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 15:25:07.152272 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 18 15:25:07.154844 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:25:07.154844 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6f04abd9-db2c-43d0-bd41-8100e8c07274 tempest-AggregatesAdminNegativeTestJSON-1676305769 tempest-AggregatesAdminNegativeTestJSON-1676305769-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:25:07.155113 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6f04abd9-db2c-43d0-bd41-8100e8c07274 tempest-AggregatesAdminNegativeTestJSON-1676305769 tempest-AggregatesAdminNegativeTestJSON-1676305769-project] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.044923 Oct 18 15:25:07.156211 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 147/273] 10.222.0.60 () {60 vars in 1164 bytes} [Tue Oct 18 15:25:07 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 46 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:25:07.186477 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-133842c5-c561-4c8b-a29d-7619b1f137d3 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] HTTP exception thrown: Instance 3f5d6640-30f6-490b-984f-d1169918133f could not be found. Oct 18 15:25:07.191547 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-133842c5-c561-4c8b-a29d-7619b1f137d3 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Request method failure captured: Oct 18 15:25:07.191547 n-d-853682-5 devstack@n-api.service[120405]: request: DELETE /compute/v2.1/servers/3f5d6640-30f6-490b-984f-d1169918133f HTTP/1.1 Oct 18 15:25:07.191547 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:25:07.191547 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:25:07.191547 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:25:07.191547 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:25:07.191547 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:25:07.191547 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:25:07.191547 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:25:07.191547 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:25:07.191547 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsUdEZI1pJKKk15KoQLmsIng-Y2jaOJAWqim56_y5bYSgITn78iN9afoBoLgV20Qy7YOJXVqAZm0JacIkXH-JI1n0Ho3U3-_Dqmw7pwtWnQmOtBdqXdg5wEPIfXnandfaFLcz2P3h5z2UvMsKIc2CTe7MnX48YAgnA-eriyBHlLyRow Oct 18 15:25:07.191547 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:25:07.191547 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:25:07.191547 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:25:07.191547 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:25:07.191547 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:25:07.191547 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:25:07.191547 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 5e72a93e9d51401c991e34b7e0f62ed4 Oct 18 15:25:07.191547 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-AggregatesAdminTestJSON-1118692385 Oct 18 15:25:07.191547 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:25:07.191547 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:25:07.192840 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5e72a93e9d51401c991e34b7e0f62ed4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5e72a93e9d51401c991e34b7e0f62ed4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5e72a93e9d51401c991e34b7e0f62ed4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5e72a93e9d51401c991e34b7e0f62ed4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:25:07.192840 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-AggregatesAdminTestJSON-1118692385 Oct 18 15:25:07.192840 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 5e72a93e9d51401c991e34b7e0f62ed4 Oct 18 15:25:07.192840 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1118692385 Oct 18 15:25:07.192840 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-AggregatesAdminTestJSON-1118692385-project Oct 18 15:25:07.192840 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:25:07.192840 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:25:07.192840 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: a72c1406934749cdaf643c4370dbd306 Oct 18 15:25:07.192840 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-AggregatesAdminTestJSON-1118692385-project Oct 18 15:25:07.192840 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:25:07.192840 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 3f5d6640-30f6-490b-984f-d1169918133f could not be found. Oct 18 15:25:07.192840 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '3f5d6640-30f6-490b-984f-d1169918133f'} Oct 18 15:25:07.193682 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:25:07.193682 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:07.193682 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:25:07.193682 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:25:07.193682 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:25:07.193682 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:25:07.193682 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:25:07.193682 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:25:07.193682 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:25:07.193682 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:25:07.193682 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f5d6640-30f6-490b-984f-d1169918133f could not be found. Oct 18 15:25:07.193682 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:07.193682 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:25:07.193682 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:07.193682 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:07.193682 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:25:07.193682 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:25:07.193682 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:25:07.193682 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:25:07.193682 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:25:07.194729 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:25:07.194729 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 15:25:07.194729 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 15:25:07.194729 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 15:25:07.194729 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 15:25:07.194729 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:25:07.194729 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:25:07.194729 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:25:07.194729 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:25:07.194729 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f5d6640-30f6-490b-984f-d1169918133f could not be found. Oct 18 15:25:07.194729 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:07.194729 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:25:07.194729 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:07.194729 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:07.194729 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:25:07.194729 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:25:07.194729 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:25:07.194729 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:25:07.194729 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f5d6640-30f6-490b-984f-d1169918133f could not be found. Oct 18 15:25:07.194729 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:07.198915 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-133842c5-c561-4c8b-a29d-7619b1f137d3 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Returning 404 to user: Instance 3f5d6640-30f6-490b-984f-d1169918133f could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:25:07.201409 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-133842c5-c561-4c8b-a29d-7619b1f137d3 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3f5d6640-30f6-490b-984f-d1169918133f" status: 404 len: 111 microversion: 2.1 time: 0.118626 Oct 18 15:25:07.211600 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 127/274] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:25:07 2022] DELETE /compute/v2.1/servers/3f5d6640-30f6-490b-984f-d1169918133f => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:25:07.224517 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ce99cc95-ed78-4f0a-a3d3-5246cc926a88 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-372706104"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:07.232589 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.aggregate [None req-ce99cc95-ed78-4f0a-a3d3-5246cc926a88 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Generated uuid 956dcbec-7da4-429c-8d84-5a142c1411ee for aggregate {{(pid=120405) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 15:25:07.294233 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ce99cc95-ed78-4f0a-a3d3-5246cc926a88 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.080626 Oct 18 15:25:07.295686 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 128/275] 10.222.0.60 () {60 vars in 1164 bytes} [Tue Oct 18 15:25:07 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:07.304445 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-94fa92e8-2e47-4a27-a8e5-783aecd18523 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:07.305585 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-94fa92e8-2e47-4a27-a8e5-783aecd18523 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] [instance: 3f5d6640-30f6-490b-984f-d1169918133f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:07.314613 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-94fa92e8-2e47-4a27-a8e5-783aecd18523 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:07.315621 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-94fa92e8-2e47-4a27-a8e5-783aecd18523 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:07.316377 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-94fa92e8-2e47-4a27-a8e5-783aecd18523 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:07.317599 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-94fa92e8-2e47-4a27-a8e5-783aecd18523 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:07.318511 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-94fa92e8-2e47-4a27-a8e5-783aecd18523 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:07.324171 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-94fa92e8-2e47-4a27-a8e5-783aecd18523 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:07.395267 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-94fa92e8-2e47-4a27-a8e5-783aecd18523 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] HTTP exception thrown: Instance 3f5d6640-30f6-490b-984f-d1169918133f could not be found. Oct 18 15:25:07.403252 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-94fa92e8-2e47-4a27-a8e5-783aecd18523 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Request method failure captured: Oct 18 15:25:07.403252 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/3f5d6640-30f6-490b-984f-d1169918133f HTTP/1.1 Oct 18 15:25:07.403252 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:25:07.403252 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:25:07.403252 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:25:07.403252 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:25:07.403252 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:25:07.403252 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:25:07.403252 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:25:07.403252 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:25:07.403252 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsUdEZI1pJKKk15KoQLmsIng-Y2jaOJAWqim56_y5bYSgITn78iN9afoBoLgV20Qy7YOJXVqAZm0JacIkXH-JI1n0Ho3U3-_Dqmw7pwtWnQmOtBdqXdg5wEPIfXnandfaFLcz2P3h5z2UvMsKIc2CTe7MnX48YAgnA-eriyBHlLyRow Oct 18 15:25:07.403252 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:25:07.403252 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:25:07.403252 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:25:07.403252 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:25:07.403252 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:25:07.403252 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:25:07.403252 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 5e72a93e9d51401c991e34b7e0f62ed4 Oct 18 15:25:07.403252 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-AggregatesAdminTestJSON-1118692385 Oct 18 15:25:07.403252 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:25:07.403252 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:25:07.404508 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5e72a93e9d51401c991e34b7e0f62ed4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5e72a93e9d51401c991e34b7e0f62ed4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5e72a93e9d51401c991e34b7e0f62ed4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5e72a93e9d51401c991e34b7e0f62ed4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:25:07.404508 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-AggregatesAdminTestJSON-1118692385 Oct 18 15:25:07.404508 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 5e72a93e9d51401c991e34b7e0f62ed4 Oct 18 15:25:07.404508 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1118692385 Oct 18 15:25:07.404508 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-AggregatesAdminTestJSON-1118692385-project Oct 18 15:25:07.404508 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:25:07.404508 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:25:07.404508 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: a72c1406934749cdaf643c4370dbd306 Oct 18 15:25:07.404508 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-AggregatesAdminTestJSON-1118692385-project Oct 18 15:25:07.404508 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:25:07.404508 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 3f5d6640-30f6-490b-984f-d1169918133f could not be found. Oct 18 15:25:07.404508 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '3f5d6640-30f6-490b-984f-d1169918133f'} Oct 18 15:25:07.405186 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:25:07.405186 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:07.405186 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:25:07.405186 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:25:07.405186 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:25:07.405186 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:25:07.405186 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:25:07.405186 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:25:07.405186 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:25:07.405186 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:25:07.405186 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f5d6640-30f6-490b-984f-d1169918133f could not be found. Oct 18 15:25:07.405186 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:07.405186 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:25:07.405186 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:07.405186 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:07.405186 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:25:07.405186 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:25:07.405186 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:25:07.405186 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:25:07.405186 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:25:07.406287 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:25:07.406287 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:25:07.406287 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:25:07.406287 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:25:07.406287 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:25:07.406287 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:25:07.406287 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:25:07.406287 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f5d6640-30f6-490b-984f-d1169918133f could not be found. Oct 18 15:25:07.406287 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:07.406287 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:25:07.406287 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:07.406287 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:07.406287 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:25:07.406287 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:25:07.406287 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:25:07.406287 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:25:07.406287 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f5d6640-30f6-490b-984f-d1169918133f could not be found. Oct 18 15:25:07.406287 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:07.413634 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-94fa92e8-2e47-4a27-a8e5-783aecd18523 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] Returning 404 to user: Instance 3f5d6640-30f6-490b-984f-d1169918133f could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:25:07.416210 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-94fa92e8-2e47-4a27-a8e5-783aecd18523 tempest-AggregatesAdminTestJSON-1118692385 tempest-AggregatesAdminTestJSON-1118692385-project] 10.222.0.60 "GET /compute/v2.1/servers/3f5d6640-30f6-490b-984f-d1169918133f" status: 404 len: 111 microversion: 2.1 time: 0.118412 Oct 18 15:25:07.419131 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 129/276] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:25:07 2022] GET /compute/v2.1/servers/3f5d6640-30f6-490b-984f-d1169918133f => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:25:07.441412 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9c79d1e1-e1a8-4ea6-8232-8373faabaa38 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-372706104"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:07.469848 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.aggregate [None req-9c79d1e1-e1a8-4ea6-8232-8373faabaa38 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Generated uuid 4bce4005-0525-40f2-8265-7cc32ec8c3e9 for aggregate {{(pid=120405) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 15:25:07.485421 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-99125926-8a14-4011-b559-a41261c5e6a3 tempest-InstanceUsageAuditLogNegativeTestJSON-1138891934 tempest-InstanceUsageAuditLogNegativeTestJSON-1138891934-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:07.487588 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-99125926-8a14-4011-b559-a41261c5e6a3 tempest-InstanceUsageAuditLogNegativeTestJSON-1138891934 tempest-InstanceUsageAuditLogNegativeTestJSON-1138891934-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'fd5ca6b534a64a70be4050795eb83208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8dd440f77e48a19bcce2bff6c5b61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:07.488594 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-99125926-8a14-4011-b559-a41261c5e6a3 tempest-InstanceUsageAuditLogNegativeTestJSON-1138891934 tempest-InstanceUsageAuditLogNegativeTestJSON-1138891934-project] Request method failure captured: Oct 18 15:25:07.488594 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 18 15:25:07.488594 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:25:07.488594 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:25:07.488594 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:25:07.488594 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:25:07.488594 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:25:07.488594 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:25:07.488594 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:25:07.488594 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:25:07.488594 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsVRLes3A-gWL-2yhTITSpD43iAGJXnRcP5j4lP623u8PMEL6C3MfB21TdVreouf1WyYK31_5Ne9Apjawc8o-tbKghCXsjgfkApy-Kecmu8QE_sqFD8kNBTOirMoE1QVO9HXCwE3IIOd5lo4jD2_pgolvHeshP3Twlit8-KfQcSV828 Oct 18 15:25:07.488594 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:25:07.488594 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:25:07.488594 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:25:07.488594 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:25:07.488594 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:25:07.488594 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:25:07.488594 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: bb8dd440f77e48a19bcce2bff6c5b61b Oct 18 15:25:07.488594 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1138891934 Oct 18 15:25:07.488594 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:25:07.488594 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:25:07.490078 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bb8dd440f77e48a19bcce2bff6c5b61b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bb8dd440f77e48a19bcce2bff6c5b61b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/bb8dd440f77e48a19bcce2bff6c5b61b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_bb8dd440f77e48a19bcce2bff6c5b61b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:25:07.490078 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1138891934 Oct 18 15:25:07.490078 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: bb8dd440f77e48a19bcce2bff6c5b61b Oct 18 15:25:07.490078 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1138891934 Oct 18 15:25:07.490078 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1138891934-project Oct 18 15:25:07.490078 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:25:07.490078 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:25:07.490078 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: fd5ca6b534a64a70be4050795eb83208 Oct 18 15:25:07.490078 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1138891934-project Oct 18 15:25:07.490078 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:25:07.490791 n-d-853682-5 devstack@n-api.service[120406]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 18 15:25:07.490791 n-d-853682-5 devstack@n-api.service[120406]: action_args: {} Oct 18 15:25:07.490791 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:25:07.490791 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:07.490791 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:25:07.490791 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:25:07.490791 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:25:07.490791 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:25:07.490791 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:25:07.490791 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:25:07.490791 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 18 15:25:07.490791 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 18 15:25:07.490791 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 15:25:07.490791 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 15:25:07.490791 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 15:25:07.490791 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 15:25:07.490791 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 15:25:07.490791 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 15:25:07.490791 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 15:25:07.490791 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 15:25:07.492234 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 15:25:07.492234 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 15:25:07.492234 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 15:25:07.492234 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 15:25:07.492234 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 15:25:07.492234 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 15:25:07.492234 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 18 15:25:07.492234 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:25:07.492234 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:25:07.492234 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:25:07.492234 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:07.492234 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:25:07.492234 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:25:07.492234 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 15:25:07.492234 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 15:25:07.492234 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 18 15:25:07.492234 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:25:07.493680 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-99125926-8a14-4011-b559-a41261c5e6a3 tempest-InstanceUsageAuditLogNegativeTestJSON-1138891934 tempest-InstanceUsageAuditLogNegativeTestJSON-1138891934-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:25:07.500497 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-99125926-8a14-4011-b559-a41261c5e6a3 tempest-InstanceUsageAuditLogNegativeTestJSON-1138891934 tempest-InstanceUsageAuditLogNegativeTestJSON-1138891934-project] 10.222.0.60 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.337826 Oct 18 15:25:07.501832 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 148/277] 10.222.0.60 () {58 vars in 1185 bytes} [Tue Oct 18 15:25:07 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 345 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:25:07.502016 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-9c79d1e1-e1a8-4ea6-8232-8373faabaa38 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-372706104 already exists. Oct 18 15:25:07.516433 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9c79d1e1-e1a8-4ea6-8232-8373faabaa38 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Request method failure captured: Oct 18 15:25:07.516433 n-d-853682-5 devstack@n-api.service[120405]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 18 15:25:07.516433 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:25:07.516433 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:25:07.516433 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:25:07.516433 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 59 Oct 18 15:25:07.516433 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:25:07.516433 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:25:07.516433 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:25:07.516433 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:25:07.516433 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsUh6ZHDmvaKM6PaeTx2ho_LB60vx4BrVnb8X4W2tRhBjFjc05Zt_WBi0WaTgOSGYhQiayDM6BmBL34x2VhIy84TFimESRE9cS7-tQ2_8Lc9DVi0veHWUr_p9sVo5uK7PI2ACCwCLVucamuoSbjf3K1nWO2qJCuLznoA5hHN9yTOV38 Oct 18 15:25:07.516433 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:25:07.516433 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:25:07.516433 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:25:07.516433 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:25:07.516433 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:25:07.516433 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:25:07.516433 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 554aa99e7e5845e4b9c3ea1bff5ecc8f Oct 18 15:25:07.516433 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1046113857 Oct 18 15:25:07.516433 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,admin,reader Oct 18 15:25:07.516433 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,admin,reader Oct 18 15:25:07.517750 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/554aa99e7e5845e4b9c3ea1bff5ecc8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/554aa99e7e5845e4b9c3ea1bff5ecc8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/554aa99e7e5845e4b9c3ea1bff5ecc8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_554aa99e7e5845e4b9c3ea1bff5ecc8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:25:07.517750 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1046113857 Oct 18 15:25:07.517750 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 554aa99e7e5845e4b9c3ea1bff5ecc8f Oct 18 15:25:07.517750 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1046113857 Oct 18 15:25:07.517750 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin Oct 18 15:25:07.517750 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:25:07.517750 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:25:07.517750 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 3da81e0aef8541a8b8a67a045077987d Oct 18 15:25:07.517750 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin Oct 18 15:25:07.517750 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:25:07.517750 n-d-853682-5 devstack@n-api.service[120405]: {"aggregate": {"name": "tempest-test_aggregate-372706104"}} Oct 18 15:25:07.517750 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:25:07.517750 n-d-853682-5 devstack@n-api.service[120405]: exception: Aggregate tempest-test_aggregate-372706104 already exists. Oct 18 15:25:07.518450 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-372706104'}}} Oct 18 15:25:07.518450 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:25:07.518450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:07.518450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 18 15:25:07.518450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 18 15:25:07.518450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 15:25:07.518450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 15:25:07.518450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 15:25:07.518450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 15:25:07.518450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 15:25:07.518450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 15:25:07.518450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 15:25:07.518450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 15:25:07.518450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Oct 18 15:25:07.518450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 18 15:25:07.518450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 18 15:25:07.518450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 18 15:25:07.518450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 18 15:25:07.518450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 18 15:25:07.519448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 15:25:07.519448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 15:25:07.519448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 18 15:25:07.519448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 18 15:25:07.519448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-372706104 already exists. Oct 18 15:25:07.519448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:07.519448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:25:07.519448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:07.519448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:07.519448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:25:07.519448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:25:07.519448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:25:07.519448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:25:07.519448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:25:07.519448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:25:07.519448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:25:07.519448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:25:07.519448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:25:07.519448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:25:07.519448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 18 15:25:07.520507 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 18 15:25:07.520507 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-372706104 already exists. Oct 18 15:25:07.520507 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:07.520507 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:25:07.520507 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:07.520507 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:07.520507 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:25:07.520507 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:25:07.520507 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:25:07.520507 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:25:07.520507 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-372706104 already exists. Oct 18 15:25:07.520507 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:07.521213 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3b69d33e-98c6-441e-92b7-19ac65c8427f tempest-InstanceUsageAuditLogNegativeTestJSON-1138891934 tempest-InstanceUsageAuditLogNegativeTestJSON-1138891934-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:07.525959 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3b69d33e-98c6-441e-92b7-19ac65c8427f tempest-InstanceUsageAuditLogNegativeTestJSON-1138891934 tempest-InstanceUsageAuditLogNegativeTestJSON-1138891934-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'fd5ca6b534a64a70be4050795eb83208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8dd440f77e48a19bcce2bff6c5b61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:07.531282 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9c79d1e1-e1a8-4ea6-8232-8373faabaa38 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-372706104 already exists. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:25:07.534651 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3b69d33e-98c6-441e-92b7-19ac65c8427f tempest-InstanceUsageAuditLogNegativeTestJSON-1138891934 tempest-InstanceUsageAuditLogNegativeTestJSON-1138891934-project] Request method failure captured: Oct 18 15:25:07.534651 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-18%2015:25:07 HTTP/1.1 Oct 18 15:25:07.534651 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:25:07.534651 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:25:07.534651 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:25:07.534651 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:25:07.534651 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:25:07.534651 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:25:07.534651 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:25:07.534651 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:25:07.534651 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsVRLes3A-gWL-2yhTITSpD43iAGJXnRcP5j4lP623u8PMEL6C3MfB21TdVreouf1WyYK31_5Ne9Apjawc8o-tbKghCXsjgfkApy-Kecmu8QE_sqFD8kNBTOirMoE1QVO9HXCwE3IIOd5lo4jD2_pgolvHeshP3Twlit8-KfQcSV828 Oct 18 15:25:07.534651 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:25:07.534651 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:25:07.534651 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:25:07.534651 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:25:07.534651 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:25:07.534651 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:25:07.534651 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: bb8dd440f77e48a19bcce2bff6c5b61b Oct 18 15:25:07.534651 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1138891934 Oct 18 15:25:07.534651 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:25:07.534651 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:25:07.537031 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bb8dd440f77e48a19bcce2bff6c5b61b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bb8dd440f77e48a19bcce2bff6c5b61b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/bb8dd440f77e48a19bcce2bff6c5b61b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_bb8dd440f77e48a19bcce2bff6c5b61b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:25:07.537031 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1138891934 Oct 18 15:25:07.537031 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: bb8dd440f77e48a19bcce2bff6c5b61b Oct 18 15:25:07.537031 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1138891934 Oct 18 15:25:07.537031 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1138891934-project Oct 18 15:25:07.537031 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:25:07.537031 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:25:07.537031 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: fd5ca6b534a64a70be4050795eb83208 Oct 18 15:25:07.537031 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1138891934-project Oct 18 15:25:07.537031 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:25:07.537837 n-d-853682-5 devstack@n-api.service[120406]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 18 15:25:07.537837 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '2022-10-18 15:25:07'} Oct 18 15:25:07.537837 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:25:07.537837 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:07.537837 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:25:07.537837 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:25:07.537837 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:25:07.537837 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:25:07.537837 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:25:07.537837 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:25:07.537837 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 18 15:25:07.537837 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 18 15:25:07.537837 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 15:25:07.537837 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 15:25:07.537837 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 15:25:07.537837 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 15:25:07.537837 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 15:25:07.537837 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 15:25:07.537837 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 15:25:07.537837 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 15:25:07.539280 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 15:25:07.539280 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 15:25:07.539280 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 15:25:07.539280 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 15:25:07.539280 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 15:25:07.539280 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 15:25:07.539280 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 18 15:25:07.539280 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:25:07.539280 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:25:07.539280 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:25:07.539280 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:07.539280 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:25:07.539280 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:25:07.539280 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 15:25:07.539280 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 15:25:07.539280 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 18 15:25:07.539280 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:25:07.540343 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9c79d1e1-e1a8-4ea6-8232-8373faabaa38 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.108171 Oct 18 15:25:07.540429 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3b69d33e-98c6-441e-92b7-19ac65c8427f tempest-InstanceUsageAuditLogNegativeTestJSON-1138891934 tempest-InstanceUsageAuditLogNegativeTestJSON-1138891934-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:25:07.544842 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3b69d33e-98c6-441e-92b7-19ac65c8427f tempest-InstanceUsageAuditLogNegativeTestJSON-1138891934 tempest-InstanceUsageAuditLogNegativeTestJSON-1138891934-project] 10.222.0.60 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-18 15:25:07" status: 403 len: 128 microversion: 2.1 time: 0.032915 Oct 18 15:25:07.545005 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 130/278] 10.222.0.60 () {60 vars in 1164 bytes} [Tue Oct 18 15:25:07 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 117 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 15:25:07.545101 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 149/279] 10.222.0.60 () {58 vars in 1251 bytes} [Tue Oct 18 15:25:07 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-18%2015%3A25%3A07 => generated 128 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:25:07.563917 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5f0379b6-6d4c-4fa6-872c-7d6b5bbac33b tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:07.594256 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-046164ec-5820-4203-a849-4a752cd16367 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:07.594909 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-046164ec-5820-4203-a849-4a752cd16367 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: 2dea609b-60cd-4634-b6d6-f5e3e085c1a3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:07.614830 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-046164ec-5820-4203-a849-4a752cd16367 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:07.618656 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-046164ec-5820-4203-a849-4a752cd16367 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:07.619365 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-046164ec-5820-4203-a849-4a752cd16367 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:07.620367 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-046164ec-5820-4203-a849-4a752cd16367 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:07.625907 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-046164ec-5820-4203-a849-4a752cd16367 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:07.626514 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-046164ec-5820-4203-a849-4a752cd16367 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:07.634632 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5f0379b6-6d4c-4fa6-872c-7d6b5bbac33b tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.087934 Oct 18 15:25:07.641829 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 131/280] 10.222.0.60 () {58 vars in 1155 bytes} [Tue Oct 18 15:25:07 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 15:25:07.648267 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a0d0d931-95ce-4f10-9d2a-166777133c91 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1248437095"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:07.654110 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.aggregate [None req-a0d0d931-95ce-4f10-9d2a-166777133c91 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Generated uuid 0bfe35a8-edb1-4c78-a7ab-8b9d48cfd785 for aggregate {{(pid=120405) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 15:25:07.710352 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a0d0d931-95ce-4f10-9d2a-166777133c91 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.066987 Oct 18 15:25:07.719062 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 132/281] 10.222.0.60 () {60 vars in 1164 bytes} [Tue Oct 18 15:25:07 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:07.732162 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-25a8ba85-36d5-44da-86de-6a10dd9d4d0b tempest-AggregatesAdminNegativeTestJSON-1676305769 tempest-AggregatesAdminNegativeTestJSON-1676305769-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:07.737317 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-25a8ba85-36d5-44da-86de-6a10dd9d4d0b tempest-AggregatesAdminNegativeTestJSON-1676305769 tempest-AggregatesAdminNegativeTestJSON-1676305769-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'e466ea3d19ce45a4b8244ca95900d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7803392db1444a8d66827b267cc925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:07.740495 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-25a8ba85-36d5-44da-86de-6a10dd9d4d0b tempest-AggregatesAdminNegativeTestJSON-1676305769 tempest-AggregatesAdminNegativeTestJSON-1676305769-project] Request method failure captured: Oct 18 15:25:07.740495 n-d-853682-5 devstack@n-api.service[120405]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Oct 18 15:25:07.740495 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:25:07.740495 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:25:07.740495 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:25:07.740495 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:25:07.740495 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:25:07.740495 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:25:07.740495 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:25:07.740495 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:25:07.740495 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsUdIBy8QcybZPNE_7e0OzQtThqWeCN2rLv2hZasVKXJipKBz5ZMf8t6Uo1zinl8lADWo0G4Cf0FhwXWmJ10jBikDahUm9HoX5_XxBbVn681TW25mL7s4_BUiQoD15xNIOmwRikKya-iUvmFAqKm5D6WTcwEtBl4pPrEjaj8DIw2cHw Oct 18 15:25:07.740495 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:25:07.740495 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:25:07.740495 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:25:07.740495 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:25:07.740495 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:25:07.740495 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:25:07.740495 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: fe7803392db1444a8d66827b267cc925 Oct 18 15:25:07.740495 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1676305769 Oct 18 15:25:07.740495 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:25:07.740495 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:25:07.741936 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fe7803392db1444a8d66827b267cc925"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fe7803392db1444a8d66827b267cc925"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/fe7803392db1444a8d66827b267cc925"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_fe7803392db1444a8d66827b267cc925"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:25:07.741936 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1676305769 Oct 18 15:25:07.741936 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: fe7803392db1444a8d66827b267cc925 Oct 18 15:25:07.741936 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1676305769 Oct 18 15:25:07.741936 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-AggregatesAdminNegativeTestJSON-1676305769-project Oct 18 15:25:07.741936 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:25:07.741936 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:25:07.741936 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: e466ea3d19ce45a4b8244ca95900d49e Oct 18 15:25:07.741936 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1676305769-project Oct 18 15:25:07.741936 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:25:07.741936 n-d-853682-5 devstack@n-api.service[120405]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 18 15:25:07.741936 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '15'} Oct 18 15:25:07.742706 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:25:07.742706 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:07.742706 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:25:07.742706 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:25:07.742706 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:25:07.742706 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:25:07.742706 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:25:07.742706 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:25:07.742706 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 18 15:25:07.742706 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 18 15:25:07.742706 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 15:25:07.742706 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 15:25:07.742706 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 15:25:07.742706 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 15:25:07.742706 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 15:25:07.742706 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 15:25:07.742706 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 15:25:07.742706 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 15:25:07.742706 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 15:25:07.744079 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 15:25:07.744079 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 15:25:07.744079 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 15:25:07.744079 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 15:25:07.744079 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 15:25:07.744079 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 18 15:25:07.744079 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:07.744079 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:25:07.744079 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:07.744079 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:07.744079 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:25:07.744079 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:25:07.744079 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 15:25:07.744079 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 15:25:07.744079 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 18 15:25:07.744079 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:07.747159 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-25a8ba85-36d5-44da-86de-6a10dd9d4d0b tempest-AggregatesAdminNegativeTestJSON-1676305769 tempest-AggregatesAdminNegativeTestJSON-1676305769-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:25:07.749186 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-25a8ba85-36d5-44da-86de-6a10dd9d4d0b tempest-AggregatesAdminNegativeTestJSON-1676305769 tempest-AggregatesAdminNegativeTestJSON-1676305769-project] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.028180 Oct 18 15:25:07.752573 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 133/282] 10.222.0.60 () {58 vars in 1155 bytes} [Tue Oct 18 15:25:07 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:25:07.771882 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-118facb7-d027-41e2-a14a-445d80e5cd0d tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:07.827412 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-118facb7-d027-41e2-a14a-445d80e5cd0d tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.068919 Oct 18 15:25:07.831597 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 134/283] 10.222.0.60 () {58 vars in 1155 bytes} [Tue Oct 18 15:25:07 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 15:25:07.846786 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-11018be7-686a-47dd-a5a0-dd25c98ef8a0 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:07.874202 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-11018be7-686a-47dd-a5a0-dd25c98ef8a0 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 18 15:25:07.879689 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-11018be7-686a-47dd-a5a0-dd25c98ef8a0 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Request method failure captured: Oct 18 15:25:07.879689 n-d-853682-5 devstack@n-api.service[120405]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 18 15:25:07.879689 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:25:07.879689 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:25:07.879689 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:25:07.879689 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:25:07.879689 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:25:07.879689 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:25:07.879689 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:25:07.879689 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:25:07.879689 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsUh6ZHDmvaKM6PaeTx2ho_LB60vx4BrVnb8X4W2tRhBjFjc05Zt_WBi0WaTgOSGYhQiayDM6BmBL34x2VhIy84TFimESRE9cS7-tQ2_8Lc9DVi0veHWUr_p9sVo5uK7PI2ACCwCLVucamuoSbjf3K1nWO2qJCuLznoA5hHN9yTOV38 Oct 18 15:25:07.879689 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:25:07.879689 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:25:07.879689 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:25:07.879689 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:25:07.879689 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:25:07.879689 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:25:07.879689 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 554aa99e7e5845e4b9c3ea1bff5ecc8f Oct 18 15:25:07.879689 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1046113857 Oct 18 15:25:07.879689 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,admin,reader Oct 18 15:25:07.879689 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,admin,reader Oct 18 15:25:07.881217 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/554aa99e7e5845e4b9c3ea1bff5ecc8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/554aa99e7e5845e4b9c3ea1bff5ecc8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/554aa99e7e5845e4b9c3ea1bff5ecc8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_554aa99e7e5845e4b9c3ea1bff5ecc8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:25:07.881217 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1046113857 Oct 18 15:25:07.881217 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 554aa99e7e5845e4b9c3ea1bff5ecc8f Oct 18 15:25:07.881217 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1046113857 Oct 18 15:25:07.881217 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin Oct 18 15:25:07.881217 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:25:07.881217 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:25:07.881217 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 3da81e0aef8541a8b8a67a045077987d Oct 18 15:25:07.881217 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin Oct 18 15:25:07.881217 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:25:07.881217 n-d-853682-5 devstack@n-api.service[120405]: exception: Aggregate -1 could not be found. Oct 18 15:25:07.881217 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '-1'} Oct 18 15:25:07.882008 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:25:07.882008 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:07.882008 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 18 15:25:07.882008 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 18 15:25:07.882008 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 15:25:07.882008 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 15:25:07.882008 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 15:25:07.882008 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 15:25:07.882008 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 15:25:07.882008 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 15:25:07.882008 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 15:25:07.882008 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 15:25:07.882008 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 18 15:25:07.882008 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 18 15:25:07.882008 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 15:25:07.882008 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 15:25:07.882008 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 18 15:25:07.882008 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 18 15:25:07.882008 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 15:25:07.883212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 15:25:07.883212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 18 15:25:07.883212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 18 15:25:07.883212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 18 15:25:07.883212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:07.883212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:25:07.883212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:07.883212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:07.883212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:25:07.883212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:25:07.883212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:25:07.883212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:25:07.883212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:25:07.883212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:25:07.883212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 18 15:25:07.883212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:25:07.883212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 18 15:25:07.883212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:07.883212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:25:07.883212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:07.883212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:07.884540 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:25:07.884540 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:25:07.884540 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:25:07.884540 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:25:07.884540 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 18 15:25:07.884540 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:07.887590 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-11018be7-686a-47dd-a5a0-dd25c98ef8a0 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:25:07.890741 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-11018be7-686a-47dd-a5a0-dd25c98ef8a0 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.053214 Oct 18 15:25:07.893192 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 135/284] 10.222.0.60 () {58 vars in 1155 bytes} [Tue Oct 18 15:25:07 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 15:25:07.913591 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-60a2ed81-11f1-4d0c-b522-15657cc9e345 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-152345640"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:07.921785 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.aggregate [None req-60a2ed81-11f1-4d0c-b522-15657cc9e345 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Generated uuid 848ed93f-3438-4459-89da-96cca5ee8875 for aggregate {{(pid=120405) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 15:25:07.980055 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-60a2ed81-11f1-4d0c-b522-15657cc9e345 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.075772 Oct 18 15:25:07.981485 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 136/285] 10.222.0.60 () {60 vars in 1164 bytes} [Tue Oct 18 15:25:07 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:08.001912 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-428f1d2d-e00d-45ed-b734-a5034ddd2f61 tempest-AggregatesAdminNegativeTestJSON-1676305769 tempest-AggregatesAdminNegativeTestJSON-1676305769-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:08.009939 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-428f1d2d-e00d-45ed-b734-a5034ddd2f61 tempest-AggregatesAdminNegativeTestJSON-1676305769 tempest-AggregatesAdminNegativeTestJSON-1676305769-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'e466ea3d19ce45a4b8244ca95900d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7803392db1444a8d66827b267cc925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:08.019660 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-428f1d2d-e00d-45ed-b734-a5034ddd2f61 tempest-AggregatesAdminNegativeTestJSON-1676305769 tempest-AggregatesAdminNegativeTestJSON-1676305769-project] Request method failure captured: Oct 18 15:25:08.019660 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Oct 18 15:25:08.019660 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:25:08.019660 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:25:08.019660 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:25:08.019660 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:25:08.019660 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:25:08.019660 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:25:08.019660 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:25:08.019660 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:25:08.019660 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsUdIBy8QcybZPNE_7e0OzQtThqWeCN2rLv2hZasVKXJipKBz5ZMf8t6Uo1zinl8lADWo0G4Cf0FhwXWmJ10jBikDahUm9HoX5_XxBbVn681TW25mL7s4_BUiQoD15xNIOmwRikKya-iUvmFAqKm5D6WTcwEtBl4pPrEjaj8DIw2cHw Oct 18 15:25:08.019660 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:25:08.019660 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:25:08.019660 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:25:08.019660 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:25:08.019660 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:25:08.019660 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:25:08.019660 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: fe7803392db1444a8d66827b267cc925 Oct 18 15:25:08.019660 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1676305769 Oct 18 15:25:08.019660 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:25:08.019660 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:25:08.021113 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fe7803392db1444a8d66827b267cc925"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fe7803392db1444a8d66827b267cc925"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/fe7803392db1444a8d66827b267cc925"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_fe7803392db1444a8d66827b267cc925"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:25:08.021113 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1676305769 Oct 18 15:25:08.021113 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: fe7803392db1444a8d66827b267cc925 Oct 18 15:25:08.021113 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1676305769 Oct 18 15:25:08.021113 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-AggregatesAdminNegativeTestJSON-1676305769-project Oct 18 15:25:08.021113 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:25:08.021113 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:25:08.021113 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: e466ea3d19ce45a4b8244ca95900d49e Oct 18 15:25:08.021113 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1676305769-project Oct 18 15:25:08.021113 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:25:08.021113 n-d-853682-5 devstack@n-api.service[120405]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 18 15:25:08.021113 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '16'} Oct 18 15:25:08.021908 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:25:08.021908 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:08.021908 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:25:08.021908 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:25:08.021908 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:25:08.021908 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:25:08.021908 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:25:08.021908 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:25:08.021908 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 18 15:25:08.021908 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 18 15:25:08.021908 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 15:25:08.021908 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 15:25:08.021908 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 15:25:08.021908 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 15:25:08.021908 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 15:25:08.021908 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 15:25:08.021908 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 15:25:08.021908 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 15:25:08.021908 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 15:25:08.023365 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 15:25:08.023365 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 15:25:08.023365 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 15:25:08.023365 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 15:25:08.023365 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 15:25:08.023365 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 18 15:25:08.023365 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:08.023365 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:25:08.023365 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:08.023365 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:08.023365 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:25:08.023365 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:25:08.023365 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 15:25:08.023365 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 15:25:08.023365 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 18 15:25:08.023365 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:08.023365 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-428f1d2d-e00d-45ed-b734-a5034ddd2f61 tempest-AggregatesAdminNegativeTestJSON-1676305769 tempest-AggregatesAdminNegativeTestJSON-1676305769-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:25:08.024380 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-428f1d2d-e00d-45ed-b734-a5034ddd2f61 tempest-AggregatesAdminNegativeTestJSON-1676305769 tempest-AggregatesAdminNegativeTestJSON-1676305769-project] 10.222.0.60 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.031955 Oct 18 15:25:08.027043 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 137/286] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Oct 18 15:25:07 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:25:08.040540 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1278dbd7-303e-424f-b87c-3987f183c968 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:08.056344 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=9,nova_api:DELETE=11 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:25:08.109883 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1278dbd7-303e-424f-b87c-3987f183c968 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.080394 Oct 18 15:25:08.111349 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 138/287] 10.222.0.60 () {58 vars in 1155 bytes} [Tue Oct 18 15:25:08 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 15:25:08.127003 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-42a74a80-638e-4883-9613-8265b29d2d63 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:08.127858 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-42a74a80-638e-4883-9613-8265b29d2d63 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 51ccbde5-4cf5-4821-9478-c14e19e73ad1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:08.142283 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-42a74a80-638e-4883-9613-8265b29d2d63 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:08.145028 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-42a74a80-638e-4883-9613-8265b29d2d63 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:08.145474 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-42a74a80-638e-4883-9613-8265b29d2d63 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:08.146254 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-42a74a80-638e-4883-9613-8265b29d2d63 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:08.146727 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-42a74a80-638e-4883-9613-8265b29d2d63 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:08.147145 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-42a74a80-638e-4883-9613-8265b29d2d63 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:08.851149 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-42a74a80-638e-4883-9613-8265b29d2d63 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:08.862417 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-42a74a80-638e-4883-9613-8265b29d2d63 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/51ccbde5-4cf5-4821-9478-c14e19e73ad1" status: 200 len: 1212 microversion: 2.1 time: 0.748691 Oct 18 15:25:08.867466 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 139/288] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:25:08 2022] GET /compute/v2.1/servers/51ccbde5-4cf5-4821-9478-c14e19e73ad1 => generated 1212 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:25:08.888356 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2b41294c-0f23-4521-af31-51582e3540d8 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:08.909595 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-2b41294c-0f23-4521-af31-51582e3540d8 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 18 15:25:08.914224 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2b41294c-0f23-4521-af31-51582e3540d8 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Request method failure captured: Oct 18 15:25:08.914224 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 18 15:25:08.914224 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:25:08.914224 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:25:08.914224 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:25:08.914224 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:25:08.914224 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:25:08.914224 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:25:08.914224 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:25:08.914224 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:25:08.914224 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsUh6ZHDmvaKM6PaeTx2ho_LB60vx4BrVnb8X4W2tRhBjFjc05Zt_WBi0WaTgOSGYhQiayDM6BmBL34x2VhIy84TFimESRE9cS7-tQ2_8Lc9DVi0veHWUr_p9sVo5uK7PI2ACCwCLVucamuoSbjf3K1nWO2qJCuLznoA5hHN9yTOV38 Oct 18 15:25:08.914224 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:25:08.914224 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:25:08.914224 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:25:08.914224 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:25:08.914224 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:25:08.914224 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:25:08.914224 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 554aa99e7e5845e4b9c3ea1bff5ecc8f Oct 18 15:25:08.914224 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1046113857 Oct 18 15:25:08.914224 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,admin,reader Oct 18 15:25:08.914224 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,admin,reader Oct 18 15:25:08.915811 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/554aa99e7e5845e4b9c3ea1bff5ecc8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/554aa99e7e5845e4b9c3ea1bff5ecc8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/554aa99e7e5845e4b9c3ea1bff5ecc8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_554aa99e7e5845e4b9c3ea1bff5ecc8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:25:08.915811 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1046113857 Oct 18 15:25:08.915811 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 554aa99e7e5845e4b9c3ea1bff5ecc8f Oct 18 15:25:08.915811 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1046113857 Oct 18 15:25:08.915811 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin Oct 18 15:25:08.915811 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:25:08.915811 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:25:08.915811 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 3da81e0aef8541a8b8a67a045077987d Oct 18 15:25:08.915811 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin Oct 18 15:25:08.915811 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:25:08.915811 n-d-853682-5 devstack@n-api.service[120405]: exception: Aggregate -1 could not be found. Oct 18 15:25:08.915811 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '-1'} Oct 18 15:25:08.916877 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:25:08.916877 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:08.916877 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 18 15:25:08.916877 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 18 15:25:08.916877 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 18 15:25:08.916877 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 18 15:25:08.916877 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 15:25:08.916877 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 15:25:08.916877 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 18 15:25:08.916877 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 18 15:25:08.916877 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 15:25:08.916877 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 15:25:08.916877 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 18 15:25:08.916877 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 18 15:25:08.916877 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 18 15:25:08.916877 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:08.916877 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:25:08.916877 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:08.916877 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:08.916877 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:25:08.918382 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:25:08.918382 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:25:08.918382 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:25:08.918382 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:25:08.918382 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:25:08.918382 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 18 15:25:08.918382 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:25:08.918382 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 18 15:25:08.918382 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:08.918382 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:25:08.918382 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:08.918382 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:08.918382 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:25:08.918382 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:25:08.918382 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:25:08.918382 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:25:08.918382 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 18 15:25:08.918382 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:08.919417 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2b41294c-0f23-4521-af31-51582e3540d8 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:25:08.919417 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2b41294c-0f23-4521-af31-51582e3540d8 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.039483 Oct 18 15:25:08.920844 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 140/289] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Oct 18 15:25:08 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 15:25:08.927415 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-54a68a7d-b7ca-44ee-a564-d8dacb77a74e tempest-AggregatesAdminNegativeTestJSON-1676305769 tempest-AggregatesAdminNegativeTestJSON-1676305769-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:08.932725 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-046164ec-5820-4203-a849-4a752cd16367 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:08.941930 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-046164ec-5820-4203-a849-4a752cd16367 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3" status: 200 len: 1311 microversion: 2.1 time: 1.351618 Oct 18 15:25:08.946069 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 150/290] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:25:07 2022] GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3 => generated 1311 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:25:08.948378 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-54a68a7d-b7ca-44ee-a564-d8dacb77a74e tempest-AggregatesAdminNegativeTestJSON-1676305769 tempest-AggregatesAdminNegativeTestJSON-1676305769-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'e466ea3d19ce45a4b8244ca95900d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7803392db1444a8d66827b267cc925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:08.951548 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-54a68a7d-b7ca-44ee-a564-d8dacb77a74e tempest-AggregatesAdminNegativeTestJSON-1676305769 tempest-AggregatesAdminNegativeTestJSON-1676305769-project] Request method failure captured: Oct 18 15:25:08.951548 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 18 15:25:08.951548 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:25:08.951548 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:25:08.951548 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:25:08.951548 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:25:08.951548 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:25:08.951548 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:25:08.951548 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:25:08.951548 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:25:08.951548 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsUdIBy8QcybZPNE_7e0OzQtThqWeCN2rLv2hZasVKXJipKBz5ZMf8t6Uo1zinl8lADWo0G4Cf0FhwXWmJ10jBikDahUm9HoX5_XxBbVn681TW25mL7s4_BUiQoD15xNIOmwRikKya-iUvmFAqKm5D6WTcwEtBl4pPrEjaj8DIw2cHw Oct 18 15:25:08.951548 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:25:08.951548 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:25:08.951548 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:25:08.951548 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:25:08.951548 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:25:08.951548 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:25:08.951548 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: fe7803392db1444a8d66827b267cc925 Oct 18 15:25:08.951548 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1676305769 Oct 18 15:25:08.951548 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:25:08.951548 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:25:08.953591 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fe7803392db1444a8d66827b267cc925"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fe7803392db1444a8d66827b267cc925"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/fe7803392db1444a8d66827b267cc925"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_fe7803392db1444a8d66827b267cc925"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:25:08.953591 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1676305769 Oct 18 15:25:08.953591 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: fe7803392db1444a8d66827b267cc925 Oct 18 15:25:08.953591 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1676305769 Oct 18 15:25:08.953591 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-AggregatesAdminNegativeTestJSON-1676305769-project Oct 18 15:25:08.953591 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:25:08.953591 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:25:08.953591 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: e466ea3d19ce45a4b8244ca95900d49e Oct 18 15:25:08.953591 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1676305769-project Oct 18 15:25:08.953591 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:25:08.953591 n-d-853682-5 devstack@n-api.service[120405]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 18 15:25:08.953591 n-d-853682-5 devstack@n-api.service[120405]: action_args: {} Oct 18 15:25:08.954425 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:25:08.954425 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:08.954425 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:25:08.954425 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:25:08.954425 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:25:08.954425 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:25:08.954425 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:25:08.954425 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:25:08.954425 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 18 15:25:08.954425 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 18 15:25:08.954425 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 15:25:08.954425 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 15:25:08.954425 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 15:25:08.954425 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 15:25:08.954425 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 15:25:08.954425 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 15:25:08.954425 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 15:25:08.954425 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 15:25:08.954425 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 15:25:08.955798 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 15:25:08.955798 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 15:25:08.955798 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 15:25:08.955798 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 15:25:08.955798 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 15:25:08.955798 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 18 15:25:08.955798 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:08.955798 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:25:08.955798 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:08.955798 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:08.955798 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:25:08.955798 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:25:08.955798 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 15:25:08.955798 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 15:25:08.955798 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 18 15:25:08.955798 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:08.961757 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-54a68a7d-b7ca-44ee-a564-d8dacb77a74e tempest-AggregatesAdminNegativeTestJSON-1676305769 tempest-AggregatesAdminNegativeTestJSON-1676305769-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:25:08.962841 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-54a68a7d-b7ca-44ee-a564-d8dacb77a74e tempest-AggregatesAdminNegativeTestJSON-1676305769 tempest-AggregatesAdminNegativeTestJSON-1676305769-project] 10.222.0.60 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.039286 Oct 18 15:25:08.963865 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 141/291] 10.222.0.60 () {58 vars in 1143 bytes} [Tue Oct 18 15:25:08 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 42 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:25:08.974334 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-35178f49-f5f1-47d7-bb2c-269729393ea5 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1507715852"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:08.981237 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.aggregate [None req-35178f49-f5f1-47d7-bb2c-269729393ea5 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Generated uuid 1a5f0a25-1ab7-43d6-ad58-9b77aa1f6147 for aggregate {{(pid=120406) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 15:25:09.036318 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-35178f49-f5f1-47d7-bb2c-269729393ea5 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.065681 Oct 18 15:25:09.038921 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 151/292] 10.222.0.60 () {60 vars in 1164 bytes} [Tue Oct 18 15:25:08 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:09.049149 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-488c97bd-d8f3-4add-a286-f759873148bb tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-853682-5"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:09.072786 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-488c97bd-d8f3-4add-a286-f759873148bb tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:09.074362 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-488c97bd-d8f3-4add-a286-f759873148bb tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:09.074824 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-488c97bd-d8f3-4add-a286-f759873148bb tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:09.307375 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-488c97bd-d8f3-4add-a286-f759873148bb tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 243 microversion: 2.1 time: 0.262470 Oct 18 15:25:09.308310 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 142/293] 10.222.0.60 () {60 vars in 1194 bytes} [Tue Oct 18 15:25:09 2022] POST /compute/v2.1/os-aggregates/17/action => generated 243 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:09.322671 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6542bdba-2e8b-4674-ade7-4c1d8ba350e2 tempest-AggregatesAdminNegativeTestJSON-1676305769 tempest-AggregatesAdminNegativeTestJSON-1676305769-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-853682-5"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:09.328648 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6542bdba-2e8b-4674-ade7-4c1d8ba350e2 tempest-AggregatesAdminNegativeTestJSON-1676305769 tempest-AggregatesAdminNegativeTestJSON-1676305769-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'e466ea3d19ce45a4b8244ca95900d49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7803392db1444a8d66827b267cc925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:09.335076 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6542bdba-2e8b-4674-ade7-4c1d8ba350e2 tempest-AggregatesAdminNegativeTestJSON-1676305769 tempest-AggregatesAdminNegativeTestJSON-1676305769-project] Request method failure captured: Oct 18 15:25:09.335076 n-d-853682-5 devstack@n-api.service[120406]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Oct 18 15:25:09.335076 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:25:09.335076 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:25:09.335076 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:25:09.335076 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 42 Oct 18 15:25:09.335076 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:25:09.335076 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:25:09.335076 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:25:09.335076 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:25:09.335076 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsUdIBy8QcybZPNE_7e0OzQtThqWeCN2rLv2hZasVKXJipKBz5ZMf8t6Uo1zinl8lADWo0G4Cf0FhwXWmJ10jBikDahUm9HoX5_XxBbVn681TW25mL7s4_BUiQoD15xNIOmwRikKya-iUvmFAqKm5D6WTcwEtBl4pPrEjaj8DIw2cHw Oct 18 15:25:09.335076 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:25:09.335076 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:25:09.335076 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:25:09.335076 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:25:09.335076 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:25:09.335076 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:25:09.335076 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: fe7803392db1444a8d66827b267cc925 Oct 18 15:25:09.335076 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1676305769 Oct 18 15:25:09.335076 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:25:09.335076 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:25:09.336493 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fe7803392db1444a8d66827b267cc925"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fe7803392db1444a8d66827b267cc925"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/fe7803392db1444a8d66827b267cc925"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_fe7803392db1444a8d66827b267cc925"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:25:09.336493 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1676305769 Oct 18 15:25:09.336493 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: fe7803392db1444a8d66827b267cc925 Oct 18 15:25:09.336493 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1676305769 Oct 18 15:25:09.336493 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-AggregatesAdminNegativeTestJSON-1676305769-project Oct 18 15:25:09.336493 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:25:09.336493 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:25:09.336493 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: e466ea3d19ce45a4b8244ca95900d49e Oct 18 15:25:09.336493 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1676305769-project Oct 18 15:25:09.336493 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:25:09.336493 n-d-853682-5 devstack@n-api.service[120406]: {"remove_host": {"host": "n-h2-853682-5"}} Oct 18 15:25:09.336493 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:25:09.336493 n-d-853682-5 devstack@n-api.service[120406]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 18 15:25:09.337425 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h2-853682-5'}}} Oct 18 15:25:09.337425 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:25:09.337425 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:09.337425 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:25:09.337425 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:25:09.337425 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:25:09.337425 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:25:09.337425 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:25:09.337425 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:25:09.337425 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:25:09.337425 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:25:09.337425 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 18 15:25:09.337425 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 18 15:25:09.337425 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 15:25:09.337425 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 15:25:09.337425 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 15:25:09.337425 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 15:25:09.337425 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 15:25:09.337425 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 15:25:09.338537 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 15:25:09.338537 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 15:25:09.338537 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 15:25:09.338537 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 15:25:09.338537 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 15:25:09.338537 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 15:25:09.338537 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 15:25:09.338537 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 15:25:09.338537 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 18 15:25:09.338537 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:25:09.338537 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:25:09.338537 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:25:09.338537 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:09.338537 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:25:09.338537 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:25:09.338537 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 15:25:09.338537 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 15:25:09.338537 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 18 15:25:09.338537 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:25:09.339597 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6542bdba-2e8b-4674-ade7-4c1d8ba350e2 tempest-AggregatesAdminNegativeTestJSON-1676305769 tempest-AggregatesAdminNegativeTestJSON-1676305769-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:25:09.339597 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6542bdba-2e8b-4674-ade7-4c1d8ba350e2 tempest-AggregatesAdminNegativeTestJSON-1676305769 tempest-AggregatesAdminNegativeTestJSON-1676305769-project] 10.222.0.60 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.019487 Oct 18 15:25:09.339597 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 152/294] 10.222.0.60 () {60 vars in 1194 bytes} [Tue Oct 18 15:25:09 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 18 15:25:09.351863 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6d7b6f14-998a-4139-a0c9-897b52a19924 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-853682-5"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:09.365733 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6d7b6f14-998a-4139-a0c9-897b52a19924 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:09.366236 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6d7b6f14-998a-4139-a0c9-897b52a19924 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:09.366744 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6d7b6f14-998a-4139-a0c9-897b52a19924 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:09.408258 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=100 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:25:09.612673 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6d7b6f14-998a-4139-a0c9-897b52a19924 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 228 microversion: 2.1 time: 0.268222 Oct 18 15:25:09.614649 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 143/295] 10.222.0.60 () {60 vars in 1194 bytes} [Tue Oct 18 15:25:09 2022] POST /compute/v2.1/os-aggregates/17/action => generated 228 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:09.627914 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-74380c87-7a02-47bd-8998-4c808cdb2627 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:09.681053 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-74380c87-7a02-47bd-8998-4c808cdb2627 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.059176 Oct 18 15:25:09.683573 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 153/296] 10.222.0.60 () {58 vars in 1155 bytes} [Tue Oct 18 15:25:09 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 15:25:09.698223 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-47b5e5fc-a6d2-42b6-a7e7-05e6f86e209d tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1151648796"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:09.716482 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.aggregate [None req-47b5e5fc-a6d2-42b6-a7e7-05e6f86e209d tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Generated uuid f89751e8-92b7-4a32-9c61-386659a01340 for aggregate {{(pid=120405) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 15:25:09.781846 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-47b5e5fc-a6d2-42b6-a7e7-05e6f86e209d tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.093476 Oct 18 15:25:09.787932 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 144/297] 10.222.0.60 () {60 vars in 1164 bytes} [Tue Oct 18 15:25:09 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:09.796662 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3fe7ad16-4d19-4f42-9840-e445b2b9c366 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:09.821978 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3fe7ad16-4d19-4f42-9840-e445b2b9c366 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:09.824037 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3fe7ad16-4d19-4f42-9840-e445b2b9c366 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:09.826267 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3fe7ad16-4d19-4f42-9840-e445b2b9c366 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:09.838534 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3fe7ad16-4d19-4f42-9840-e445b2b9c366 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:09.841867 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3fe7ad16-4d19-4f42-9840-e445b2b9c366 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:09.842483 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3fe7ad16-4d19-4f42-9840-e445b2b9c366 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:09.881107 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.compute.aggregates [None req-3fe7ad16-4d19-4f42-9840-e445b2b9c366 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 18 15:25:09.888591 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3ab2b5c9-8357-4b3f-bc93-a9f31cd5bb89 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:09.890060 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3ab2b5c9-8357-4b3f-bc93-a9f31cd5bb89 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 51ccbde5-4cf5-4821-9478-c14e19e73ad1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:09.897600 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-3fe7ad16-4d19-4f42-9840-e445b2b9c366 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Oct 18 15:25:09.903220 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3fe7ad16-4d19-4f42-9840-e445b2b9c366 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Request method failure captured: Oct 18 15:25:09.903220 n-d-853682-5 devstack@n-api.service[120406]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Oct 18 15:25:09.903220 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:25:09.903220 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:25:09.903220 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:25:09.903220 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 42 Oct 18 15:25:09.903220 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:25:09.903220 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:25:09.903220 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:25:09.903220 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:25:09.903220 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsUh6ZHDmvaKM6PaeTx2ho_LB60vx4BrVnb8X4W2tRhBjFjc05Zt_WBi0WaTgOSGYhQiayDM6BmBL34x2VhIy84TFimESRE9cS7-tQ2_8Lc9DVi0veHWUr_p9sVo5uK7PI2ACCwCLVucamuoSbjf3K1nWO2qJCuLznoA5hHN9yTOV38 Oct 18 15:25:09.903220 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:25:09.903220 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:25:09.903220 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:25:09.903220 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:25:09.903220 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:25:09.903220 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:25:09.903220 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 554aa99e7e5845e4b9c3ea1bff5ecc8f Oct 18 15:25:09.903220 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1046113857 Oct 18 15:25:09.903220 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,admin,reader Oct 18 15:25:09.903220 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,admin,reader Oct 18 15:25:09.904506 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/554aa99e7e5845e4b9c3ea1bff5ecc8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/554aa99e7e5845e4b9c3ea1bff5ecc8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/554aa99e7e5845e4b9c3ea1bff5ecc8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_554aa99e7e5845e4b9c3ea1bff5ecc8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:25:09.904506 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1046113857 Oct 18 15:25:09.904506 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 554aa99e7e5845e4b9c3ea1bff5ecc8f Oct 18 15:25:09.904506 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1046113857 Oct 18 15:25:09.904506 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin Oct 18 15:25:09.904506 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:25:09.904506 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:25:09.904506 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 3da81e0aef8541a8b8a67a045077987d Oct 18 15:25:09.904506 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin Oct 18 15:25:09.904506 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:25:09.904506 n-d-853682-5 devstack@n-api.service[120406]: {"remove_host": {"host": "nonexist_host"}} Oct 18 15:25:09.904506 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:25:09.904506 n-d-853682-5 devstack@n-api.service[120406]: exception: Cannot remove host nonexist_host in aggregate 18 Oct 18 15:25:09.905274 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 18 15:25:09.905274 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:25:09.905274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:09.905274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 18 15:25:09.905274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 18 15:25:09.905274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 15:25:09.905274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 15:25:09.905274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 18 15:25:09.905274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 18 15:25:09.905274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 15:25:09.905274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 15:25:09.905274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 18 15:25:09.905274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 18 15:25:09.905274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 18 15:25:09.905274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:25:09.905274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:25:09.905274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:25:09.905274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:09.905274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 18 15:25:09.905274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 18 15:25:09.906978 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 18 15:25:09.906978 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 18 15:25:09.906978 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 18 15:25:09.906978 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:25:09.906978 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:25:09.906978 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:25:09.906978 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:09.906978 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 18 15:25:09.906978 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 18 15:25:09.906978 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 15:25:09.906978 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 15:25:09.906978 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 15:25:09.906978 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 15:25:09.906978 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 15:25:09.906978 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 15:25:09.906978 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 15:25:09.906978 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 15:25:09.906978 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Oct 18 15:25:09.906978 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 18 15:25:09.906978 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 18 15:25:09.908089 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 18 15:25:09.908089 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 18 15:25:09.908089 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:25:09.908089 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:25:09.908089 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:25:09.908089 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:09.908089 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:25:09.908089 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:25:09.908089 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:25:09.908089 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:25:09.908089 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:25:09.908089 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:25:09.908089 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:25:09.908089 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:25:09.908089 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 18 15:25:09.908089 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 18 15:25:09.908089 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Oct 18 15:25:09.908089 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:25:09.908089 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:25:09.908089 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:25:09.908089 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:09.909342 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:25:09.909342 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:25:09.909342 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:25:09.909342 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:25:09.909342 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Oct 18 15:25:09.909342 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:25:09.918797 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ab2b5c9-8357-4b3f-bc93-a9f31cd5bb89 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:09.919566 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3fe7ad16-4d19-4f42-9840-e445b2b9c366 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:25:09.922619 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3fe7ad16-4d19-4f42-9840-e445b2b9c366 tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.131029 Oct 18 15:25:09.922908 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ab2b5c9-8357-4b3f-bc93-a9f31cd5bb89 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:09.923793 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ab2b5c9-8357-4b3f-bc93-a9f31cd5bb89 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:09.927238 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ab2b5c9-8357-4b3f-bc93-a9f31cd5bb89 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:09.928468 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 154/298] 10.222.0.60 () {60 vars in 1194 bytes} [Tue Oct 18 15:25:09 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 15:25:09.930242 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ab2b5c9-8357-4b3f-bc93-a9f31cd5bb89 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:09.930915 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ab2b5c9-8357-4b3f-bc93-a9f31cd5bb89 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:09.946468 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9be16dbc-ea4d-4194-b724-913d7f82788b tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:10.031926 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9be16dbc-ea4d-4194-b724-913d7f82788b tempest-AggregatesAdminNegativeTestJSON-1046113857 tempest-AggregatesAdminNegativeTestJSON-1046113857-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.094974 Oct 18 15:25:10.034464 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 155/299] 10.222.0.60 () {58 vars in 1155 bytes} [Tue Oct 18 15:25:09 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 15:25:10.049259 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f0858d06-f737-4127-9f40-c84ca3383ce5 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:10.051544 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f0858d06-f737-4127-9f40-c84ca3383ce5 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: 2dea609b-60cd-4634-b6d6-f5e3e085c1a3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:10.063786 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=13,nova_api:INSERT=6,nova_api:UPDATE=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:25:10.070950 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f0858d06-f737-4127-9f40-c84ca3383ce5 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:10.072514 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f0858d06-f737-4127-9f40-c84ca3383ce5 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:10.074069 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f0858d06-f737-4127-9f40-c84ca3383ce5 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:10.077040 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f0858d06-f737-4127-9f40-c84ca3383ce5 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:10.078713 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f0858d06-f737-4127-9f40-c84ca3383ce5 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:10.079759 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f0858d06-f737-4127-9f40-c84ca3383ce5 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:10.253772 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3ab2b5c9-8357-4b3f-bc93-a9f31cd5bb89 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:10.269889 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3ab2b5c9-8357-4b3f-bc93-a9f31cd5bb89 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/51ccbde5-4cf5-4821-9478-c14e19e73ad1" status: 200 len: 1266 microversion: 2.1 time: 0.385984 Oct 18 15:25:10.274174 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 145/300] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:25:09 2022] GET /compute/v2.1/servers/51ccbde5-4cf5-4821-9478-c14e19e73ad1 => generated 1266 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:25:10.667623 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f0858d06-f737-4127-9f40-c84ca3383ce5 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:10.679135 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f0858d06-f737-4127-9f40-c84ca3383ce5 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3" status: 200 len: 1311 microversion: 2.1 time: 0.642998 Oct 18 15:25:10.693821 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 156/301] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:25:10 2022] GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3 => generated 1311 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:25:11.297976 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-01fe8e4c-b890-40f0-82bd-528bb9fba864 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:11.299922 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-01fe8e4c-b890-40f0-82bd-528bb9fba864 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 51ccbde5-4cf5-4821-9478-c14e19e73ad1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:11.331681 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-01fe8e4c-b890-40f0-82bd-528bb9fba864 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:11.334840 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-01fe8e4c-b890-40f0-82bd-528bb9fba864 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:11.335511 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-01fe8e4c-b890-40f0-82bd-528bb9fba864 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:11.339155 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-01fe8e4c-b890-40f0-82bd-528bb9fba864 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:11.340243 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-01fe8e4c-b890-40f0-82bd-528bb9fba864 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:11.340931 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-01fe8e4c-b890-40f0-82bd-528bb9fba864 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:11.531521 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-01fe8e4c-b890-40f0-82bd-528bb9fba864 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:11.547167 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-01fe8e4c-b890-40f0-82bd-528bb9fba864 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/51ccbde5-4cf5-4821-9478-c14e19e73ad1" status: 200 len: 1266 microversion: 2.1 time: 0.250776 Oct 18 15:25:11.548908 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 146/302] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:25:11 2022] GET /compute/v2.1/servers/51ccbde5-4cf5-4821-9478-c14e19e73ad1 => generated 1266 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:25:11.708171 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-929c2aa6-31c0-40b9-86d2-1075fbf4083f tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:11.708923 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-929c2aa6-31c0-40b9-86d2-1075fbf4083f tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: 2dea609b-60cd-4634-b6d6-f5e3e085c1a3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:11.731189 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-929c2aa6-31c0-40b9-86d2-1075fbf4083f tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:11.735156 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-929c2aa6-31c0-40b9-86d2-1075fbf4083f tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:11.736973 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-929c2aa6-31c0-40b9-86d2-1075fbf4083f tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:11.738062 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-929c2aa6-31c0-40b9-86d2-1075fbf4083f tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:11.739538 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-929c2aa6-31c0-40b9-86d2-1075fbf4083f tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:11.741340 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-929c2aa6-31c0-40b9-86d2-1075fbf4083f tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:12.491890 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-929c2aa6-31c0-40b9-86d2-1075fbf4083f tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:12.505032 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-929c2aa6-31c0-40b9-86d2-1075fbf4083f tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3" status: 200 len: 1493 microversion: 2.1 time: 0.799618 Oct 18 15:25:12.505978 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 157/303] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:25:11 2022] GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3 => generated 1493 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:25:12.571419 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7d41a4f3-1edd-4e3f-8fa9-2a617b9a95f4 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:12.572357 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7d41a4f3-1edd-4e3f-8fa9-2a617b9a95f4 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 51ccbde5-4cf5-4821-9478-c14e19e73ad1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:12.590248 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d41a4f3-1edd-4e3f-8fa9-2a617b9a95f4 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:12.593596 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d41a4f3-1edd-4e3f-8fa9-2a617b9a95f4 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:12.596244 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d41a4f3-1edd-4e3f-8fa9-2a617b9a95f4 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:12.598711 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d41a4f3-1edd-4e3f-8fa9-2a617b9a95f4 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:12.599377 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d41a4f3-1edd-4e3f-8fa9-2a617b9a95f4 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:12.607114 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d41a4f3-1edd-4e3f-8fa9-2a617b9a95f4 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:12.806135 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7d41a4f3-1edd-4e3f-8fa9-2a617b9a95f4 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:12.822664 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7d41a4f3-1edd-4e3f-8fa9-2a617b9a95f4 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/51ccbde5-4cf5-4821-9478-c14e19e73ad1" status: 200 len: 1266 microversion: 2.1 time: 0.254786 Oct 18 15:25:12.826785 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 158/304] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:25:12 2022] GET /compute/v2.1/servers/51ccbde5-4cf5-4821-9478-c14e19e73ad1 => generated 1266 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:25:13.191549 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-658d10d5-75b2-46a1-a1c6-5f6afc9edbf2 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:13.192155 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-658d10d5-75b2-46a1-a1c6-5f6afc9edbf2 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] [instance: 2dea609b-60cd-4634-b6d6-f5e3e085c1a3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:13.203845 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-658d10d5-75b2-46a1-a1c6-5f6afc9edbf2 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:13.204695 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-658d10d5-75b2-46a1-a1c6-5f6afc9edbf2 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:13.205766 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-658d10d5-75b2-46a1-a1c6-5f6afc9edbf2 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:13.207139 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-658d10d5-75b2-46a1-a1c6-5f6afc9edbf2 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:13.209612 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-658d10d5-75b2-46a1-a1c6-5f6afc9edbf2 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:13.210738 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-658d10d5-75b2-46a1-a1c6-5f6afc9edbf2 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:13.628978 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-658d10d5-75b2-46a1-a1c6-5f6afc9edbf2 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3" status: 200 len: 1644 microversion: 2.1 time: 1.100883 Oct 18 15:25:13.629808 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 147/305] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:25:12 2022] GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3 => generated 1644 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:25:13.654437 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eb8348bd-bfb5-4eaf-9469-60c3b7119aaa tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:13.654437 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-eb8348bd-bfb5-4eaf-9469-60c3b7119aaa tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] [instance: 2dea609b-60cd-4634-b6d6-f5e3e085c1a3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:13.668456 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb8348bd-bfb5-4eaf-9469-60c3b7119aaa tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:13.669770 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb8348bd-bfb5-4eaf-9469-60c3b7119aaa tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:13.670765 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb8348bd-bfb5-4eaf-9469-60c3b7119aaa tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:13.672659 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb8348bd-bfb5-4eaf-9469-60c3b7119aaa tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:13.675440 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb8348bd-bfb5-4eaf-9469-60c3b7119aaa tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:13.676246 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb8348bd-bfb5-4eaf-9469-60c3b7119aaa tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:13.852004 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bd5f8592-3c9e-4f7c-98fd-ffe92e43b01c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:13.853013 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-bd5f8592-3c9e-4f7c-98fd-ffe92e43b01c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 51ccbde5-4cf5-4821-9478-c14e19e73ad1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:13.866509 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bd5f8592-3c9e-4f7c-98fd-ffe92e43b01c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:13.872864 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bd5f8592-3c9e-4f7c-98fd-ffe92e43b01c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:13.872864 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bd5f8592-3c9e-4f7c-98fd-ffe92e43b01c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:13.872864 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bd5f8592-3c9e-4f7c-98fd-ffe92e43b01c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:13.872864 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bd5f8592-3c9e-4f7c-98fd-ffe92e43b01c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:13.882412 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bd5f8592-3c9e-4f7c-98fd-ffe92e43b01c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:14.255217 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-bd5f8592-3c9e-4f7c-98fd-ffe92e43b01c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:14.313688 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-bd5f8592-3c9e-4f7c-98fd-ffe92e43b01c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/51ccbde5-4cf5-4821-9478-c14e19e73ad1" status: 200 len: 1266 microversion: 2.1 time: 0.439050 Oct 18 15:25:14.338093 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 148/306] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:25:13 2022] GET /compute/v2.1/servers/51ccbde5-4cf5-4821-9478-c14e19e73ad1 => generated 1266 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:25:14.648756 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-eb8348bd-bfb5-4eaf-9469-60c3b7119aaa tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3" status: 200 len: 1644 microversion: 2.1 time: 1.000517 Oct 18 15:25:14.650564 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 159/307] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:25:13 2022] GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3 => generated 1644 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:25:14.679780 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2d81633c-6742-402c-a65c-483cb6c62112 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:14.697867 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d81633c-6742-402c-a65c-483cb6c62112 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:14.698409 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d81633c-6742-402c-a65c-483cb6c62112 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:14.702064 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d81633c-6742-402c-a65c-483cb6c62112 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:14.706432 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d81633c-6742-402c-a65c-483cb6c62112 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:14.709989 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d81633c-6742-402c-a65c-483cb6c62112 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:14.712334 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d81633c-6742-402c-a65c-483cb6c62112 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:14.804751 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2d81633c-6742-402c-a65c-483cb6c62112 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.129803 Oct 18 15:25:14.816147 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 149/308] 10.222.0.60 () {58 vars in 1176 bytes} [Tue Oct 18 15:25:14 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:14.822042 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-94dbcef0-3b27-4233-801e-6b861e7b8a3f tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-853682-5", "block_migration": true, "disk_over_commit": false}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:14.825442 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-94dbcef0-3b27-4233-801e-6b861e7b8a3f tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] [instance: 2dea609b-60cd-4634-b6d6-f5e3e085c1a3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:14.839061 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94dbcef0-3b27-4233-801e-6b861e7b8a3f tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:14.843783 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94dbcef0-3b27-4233-801e-6b861e7b8a3f tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:14.847412 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94dbcef0-3b27-4233-801e-6b861e7b8a3f tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:14.848287 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94dbcef0-3b27-4233-801e-6b861e7b8a3f tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:14.848771 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94dbcef0-3b27-4233-801e-6b861e7b8a3f tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:14.849679 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94dbcef0-3b27-4233-801e-6b861e7b8a3f tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:15.347310 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-799e8c6d-b484-427b-ac80-fb32e350ac9a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:15.348502 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-799e8c6d-b484-427b-ac80-fb32e350ac9a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 51ccbde5-4cf5-4821-9478-c14e19e73ad1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:15.373736 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-799e8c6d-b484-427b-ac80-fb32e350ac9a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:15.374360 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-799e8c6d-b484-427b-ac80-fb32e350ac9a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:15.376139 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-799e8c6d-b484-427b-ac80-fb32e350ac9a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:15.376888 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-799e8c6d-b484-427b-ac80-fb32e350ac9a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:15.377361 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-799e8c6d-b484-427b-ac80-fb32e350ac9a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:15.377793 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-799e8c6d-b484-427b-ac80-fb32e350ac9a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:16.223434 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-799e8c6d-b484-427b-ac80-fb32e350ac9a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:16.244841 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-799e8c6d-b484-427b-ac80-fb32e350ac9a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/51ccbde5-4cf5-4821-9478-c14e19e73ad1" status: 200 len: 1308 microversion: 2.1 time: 0.902777 Oct 18 15:25:16.245842 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 150/309] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:25:15 2022] GET /compute/v2.1/servers/51ccbde5-4cf5-4821-9478-c14e19e73ad1 => generated 1308 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:25:16.351282 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-94dbcef0-3b27-4233-801e-6b861e7b8a3f tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lazy-loading 'flavor' on Instance uuid 2dea609b-60cd-4634-b6d6-f5e3e085c1a3 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:25:16.607226 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-94dbcef0-3b27-4233-801e-6b861e7b8a3f tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] [instance: 2dea609b-60cd-4634-b6d6-f5e3e085c1a3] Going to try to live migrate instance to n-h2-853682-5 {{(pid=120406) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 18 15:25:17.022480 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=8 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:25:17.361204 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d418cd3b-0f76-447a-83ca-ae20ce8d1ed6 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1481905681", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "2f9fec7c-78b7-46d8-8366-69a39bab2b6f"}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:17.461961 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-d418cd3b-0f76-447a-83ca-ae20ce8d1ed6 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] validate_networks() for [('2f9fec7c-78b7-46d8-8366-69a39bab2b6f', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:25:19.839792 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:25:21.417067 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-d418cd3b-0f76-447a-83ca-ae20ce8d1ed6 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:25:21.417623 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-d418cd3b-0f76-447a-83ca-ae20ce8d1ed6 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:25:21.417961 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-d418cd3b-0f76-447a-83ca-ae20ce8d1ed6 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:25:21.418369 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-d418cd3b-0f76-447a-83ca-ae20ce8d1ed6 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:25:21.419091 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-d418cd3b-0f76-447a-83ca-ae20ce8d1ed6 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:25:21.437442 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d418cd3b-0f76-447a-83ca-ae20ce8d1ed6 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:21.437953 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d418cd3b-0f76-447a-83ca-ae20ce8d1ed6 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:21.438443 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d418cd3b-0f76-447a-83ca-ae20ce8d1ed6 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:21.442494 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d418cd3b-0f76-447a-83ca-ae20ce8d1ed6 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:21.443130 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d418cd3b-0f76-447a-83ca-ae20ce8d1ed6 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:21.443766 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d418cd3b-0f76-447a-83ca-ae20ce8d1ed6 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:21.465607 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=7 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:25:21.491273 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-d418cd3b-0f76-447a-83ca-ae20ce8d1ed6 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Getting quotas for project bb0579704a194ef89144af0973d68f42. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:25:21.502368 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-d418cd3b-0f76-447a-83ca-ae20ce8d1ed6 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Getting quotas for user 51490cfdebda47a7b8349677e4d61a59 and project bb0579704a194ef89144af0973d68f42. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:25:21.546014 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d418cd3b-0f76-447a-83ca-ae20ce8d1ed6 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:25:21.548393 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d418cd3b-0f76-447a-83ca-ae20ce8d1ed6 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: b11f87b9-987d-4c75-9a43-d654ab53de1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:25:21.657936 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d418cd3b-0f76-447a-83ca-ae20ce8d1ed6 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 4.641222 Oct 18 15:25:21.658976 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 151/310] 10.222.0.60 () {62 vars in 1188 bytes} [Tue Oct 18 15:25:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 4643 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 18 15:25:21.669965 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d13aab04-6928-4f0e-ace6-e02ab1210cc8 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:21.671076 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d13aab04-6928-4f0e-ace6-e02ab1210cc8 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 51ccbde5-4cf5-4821-9478-c14e19e73ad1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:21.688681 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d13aab04-6928-4f0e-ace6-e02ab1210cc8 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:21.689094 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d13aab04-6928-4f0e-ace6-e02ab1210cc8 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:21.689699 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d13aab04-6928-4f0e-ace6-e02ab1210cc8 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:21.690586 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d13aab04-6928-4f0e-ace6-e02ab1210cc8 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:21.691214 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d13aab04-6928-4f0e-ace6-e02ab1210cc8 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:21.693559 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d13aab04-6928-4f0e-ace6-e02ab1210cc8 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:22.631020 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d13aab04-6928-4f0e-ace6-e02ab1210cc8 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:22.639613 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d13aab04-6928-4f0e-ace6-e02ab1210cc8 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/51ccbde5-4cf5-4821-9478-c14e19e73ad1" status: 200 len: 1308 microversion: 2.1 time: 0.979276 Oct 18 15:25:22.649631 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 152/311] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:25:21 2022] GET /compute/v2.1/servers/51ccbde5-4cf5-4821-9478-c14e19e73ad1 => generated 1308 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:25:22.654757 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-c96e1e94-c7c4-4fb6-a102-944d2d38c90b req-3d66decb-15d3-4dd2-a502-90ffd4a85671 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51ccbde5-4cf5-4821-9478-c14e19e73ad1", "tag": "df898d7d-c591-40dd-bff2-fd63cc9d55b0"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:22.672734 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-c96e1e94-c7c4-4fb6-a102-944d2d38c90b req-3d66decb-15d3-4dd2-a502-90ffd4a85671 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:22.685648 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-c96e1e94-c7c4-4fb6-a102-944d2d38c90b req-3d66decb-15d3-4dd2-a502-90ffd4a85671 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:22.688409 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-c96e1e94-c7c4-4fb6-a102-944d2d38c90b req-3d66decb-15d3-4dd2-a502-90ffd4a85671 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:22.731417 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-c96e1e94-c7c4-4fb6-a102-944d2d38c90b req-3d66decb-15d3-4dd2-a502-90ffd4a85671 service nova] Creating event network-changed:df898d7d-c591-40dd-bff2-fd63cc9d55b0 for instance 51ccbde5-4cf5-4821-9478-c14e19e73ad1 on n-h2-853682-5 Oct 18 15:25:22.739046 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-c96e1e94-c7c4-4fb6-a102-944d2d38c90b req-3d66decb-15d3-4dd2-a502-90ffd4a85671 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087734 Oct 18 15:25:22.741296 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 153/312] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:23.338251 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1553d928-fb83-477e-9cfd-560581852fa2 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1035037602", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:23.428960 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-1553d928-fb83-477e-9cfd-560581852fa2 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] validate_networks() for None {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:25:24.732927 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-94dbcef0-3b27-4233-801e-6b861e7b8a3f tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3/action" status: 202 len: 0 microversion: 2.1 time: 9.916312 Oct 18 15:25:24.739548 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 160/313] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:25:14 2022] POST /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3/action => generated 0 bytes in 9924 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:25:24.872531 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-197f2b76-adda-453f-8e88-fff5b36643d3 tempest-FlavorsExtraSpecsTestJSON-1426294122 tempest-FlavorsExtraSpecsTestJSON-1426294122-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1515354074", "ram": 512, "vcpus": 1, "disk": 10, "id": 2097468120, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:24.917420 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-197f2b76-adda-453f-8e88-fff5b36643d3 tempest-FlavorsExtraSpecsTestJSON-1426294122 tempest-FlavorsExtraSpecsTestJSON-1426294122-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.172493 Oct 18 15:25:24.918644 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 161/314] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:25:24 2022] POST /compute/v2.1/flavors => generated 416 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:24.933285 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cc1cfa53-0604-4265-b43a-0748778f3f76 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:24.934767 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cc1cfa53-0604-4265-b43a-0748778f3f76 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: b11f87b9-987d-4c75-9a43-d654ab53de1f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:24.953725 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cc1cfa53-0604-4265-b43a-0748778f3f76 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:24.956770 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cc1cfa53-0604-4265-b43a-0748778f3f76 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:24.957517 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cc1cfa53-0604-4265-b43a-0748778f3f76 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:24.958577 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cc1cfa53-0604-4265-b43a-0748778f3f76 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:24.960264 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cc1cfa53-0604-4265-b43a-0748778f3f76 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:24.961865 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cc1cfa53-0604-4265-b43a-0748778f3f76 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:25.212434 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cc1cfa53-0604-4265-b43a-0748778f3f76 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:25.220878 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:25:25.225250 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cc1cfa53-0604-4265-b43a-0748778f3f76 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:25.227603 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cc1cfa53-0604-4265-b43a-0748778f3f76 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:25.229722 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cc1cfa53-0604-4265-b43a-0748778f3f76 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/b11f87b9-987d-4c75-9a43-d654ab53de1f" status: 200 len: 1320 microversion: 2.25 time: 0.306469 Oct 18 15:25:25.245823 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 162/315] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:25:24 2022] GET /compute/v2.1/servers/b11f87b9-987d-4c75-9a43-d654ab53de1f => generated 1320 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:25:25.253528 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-addbaac4-16be-4ffd-99b6-cf99d2afbd89 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:25.254481 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-addbaac4-16be-4ffd-99b6-cf99d2afbd89 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 51ccbde5-4cf5-4821-9478-c14e19e73ad1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:25.262608 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-addbaac4-16be-4ffd-99b6-cf99d2afbd89 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:25.263341 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-addbaac4-16be-4ffd-99b6-cf99d2afbd89 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:25.263953 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-addbaac4-16be-4ffd-99b6-cf99d2afbd89 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:25.265420 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-addbaac4-16be-4ffd-99b6-cf99d2afbd89 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:25.266286 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-addbaac4-16be-4ffd-99b6-cf99d2afbd89 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:25.266867 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-addbaac4-16be-4ffd-99b6-cf99d2afbd89 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:25.323106 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-1553d928-fb83-477e-9cfd-560581852fa2 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:25:25.323678 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-1553d928-fb83-477e-9cfd-560581852fa2 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:25:25.324541 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-1553d928-fb83-477e-9cfd-560581852fa2 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:25:25.325361 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-1553d928-fb83-477e-9cfd-560581852fa2 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:25:25.325952 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-1553d928-fb83-477e-9cfd-560581852fa2 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:25:25.357401 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1553d928-fb83-477e-9cfd-560581852fa2 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:25.360267 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1553d928-fb83-477e-9cfd-560581852fa2 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:25.361728 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1553d928-fb83-477e-9cfd-560581852fa2 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:25.366474 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1553d928-fb83-477e-9cfd-560581852fa2 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:25.368270 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1553d928-fb83-477e-9cfd-560581852fa2 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:25.369078 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1553d928-fb83-477e-9cfd-560581852fa2 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:25.423081 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-1553d928-fb83-477e-9cfd-560581852fa2 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Getting quotas for project 27f40d7ca29449cbb4c2d58df280a01c. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:25:25.432432 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-1553d928-fb83-477e-9cfd-560581852fa2 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Getting quotas for user 385ef457207e45b0b843fc2b8ffff7bb and project 27f40d7ca29449cbb4c2d58df280a01c. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:25:25.455686 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1553d928-fb83-477e-9cfd-560581852fa2 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:25:25.459121 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1553d928-fb83-477e-9cfd-560581852fa2 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] [instance: ff014187-bdd4-4211-b796-abf786781dac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:25:25.599608 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1553d928-fb83-477e-9cfd-560581852fa2 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.848705 Oct 18 15:25:25.600526 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 154/316] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:25:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2851 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:25:25.619885 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e35bf325-4425-4460-88c3-e8fe98fe2732 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:25.622512 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e35bf325-4425-4460-88c3-e8fe98fe2732 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: 2dea609b-60cd-4634-b6d6-f5e3e085c1a3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:25.644455 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e35bf325-4425-4460-88c3-e8fe98fe2732 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:25.645491 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e35bf325-4425-4460-88c3-e8fe98fe2732 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:25.646057 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e35bf325-4425-4460-88c3-e8fe98fe2732 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:25.647432 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e35bf325-4425-4460-88c3-e8fe98fe2732 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:25.650107 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e35bf325-4425-4460-88c3-e8fe98fe2732 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:25.650684 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e35bf325-4425-4460-88c3-e8fe98fe2732 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:26.037157 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-addbaac4-16be-4ffd-99b6-cf99d2afbd89 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:26.057085 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-addbaac4-16be-4ffd-99b6-cf99d2afbd89 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/51ccbde5-4cf5-4821-9478-c14e19e73ad1" status: 200 len: 1308 microversion: 2.1 time: 0.801883 Oct 18 15:25:26.057752 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 163/317] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:25:25 2022] GET /compute/v2.1/servers/51ccbde5-4cf5-4821-9478-c14e19e73ad1 => generated 1308 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:25:26.074087 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d91b7d7f-db08-42db-9a7c-3fcbd0b70513 tempest-FlavorsExtraSpecsTestJSON-1426294122 tempest-FlavorsExtraSpecsTestJSON-1426294122-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:26.147761 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d91b7d7f-db08-42db-9a7c-3fcbd0b70513 tempest-FlavorsExtraSpecsTestJSON-1426294122 tempest-FlavorsExtraSpecsTestJSON-1426294122-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/2097468120/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.086166 Oct 18 15:25:26.148966 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 164/318] 10.222.0.60 () {60 vars in 1224 bytes} [Tue Oct 18 15:25:26 2022] POST /compute/v2.1/flavors/2097468120/os-extra_specs => generated 66 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:25:26.165595 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-43db599a-bb52-4203-bf27-1083ba509ab3 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:26.166462 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-43db599a-bb52-4203-bf27-1083ba509ab3 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] [instance: ff014187-bdd4-4211-b796-abf786781dac] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:26.499115 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-43db599a-bb52-4203-bf27-1083ba509ab3 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '385ef457207e45b0b843fc2b8ffff7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f40d7ca29449cbb4c2d58df280a01c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:26.509596 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-43db599a-bb52-4203-bf27-1083ba509ab3 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] 10.222.0.60 "GET /compute/v2.1/servers/ff014187-bdd4-4211-b796-abf786781dac" status: 200 len: 1220 microversion: 2.1 time: 0.358665 Oct 18 15:25:26.512377 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 165/319] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:25:26 2022] GET /compute/v2.1/servers/ff014187-bdd4-4211-b796-abf786781dac => generated 1220 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:25:26.747469 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e35bf325-4425-4460-88c3-e8fe98fe2732 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:26.765938 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9840842a-6924-4c07-aedc-1139b82f064f tempest-FlavorsExtraSpecsTestJSON-1806153790 tempest-FlavorsExtraSpecsTestJSON-1806153790-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:26.770415 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e35bf325-4425-4460-88c3-e8fe98fe2732 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3" status: 200 len: 1503 microversion: 2.1 time: 1.157800 Oct 18 15:25:26.789678 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 155/320] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:25:25 2022] GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3 => generated 1503 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:25:26.801425 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9840842a-6924-4c07-aedc-1139b82f064f tempest-FlavorsExtraSpecsTestJSON-1806153790 tempest-FlavorsExtraSpecsTestJSON-1806153790-project] 10.222.0.60 "GET /compute/v2.1/flavors/2097468120/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.287060 Oct 18 15:25:26.802047 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 166/321] 10.222.0.60 () {58 vars in 1203 bytes} [Tue Oct 18 15:25:26 2022] GET /compute/v2.1/flavors/2097468120/os-extra_specs => generated 66 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:25:26.804615 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2707b933-ae68-4461-9163-4697b010faaf tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:26.805449 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2707b933-ae68-4461-9163-4697b010faaf tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: b11f87b9-987d-4c75-9a43-d654ab53de1f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:26.813388 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2707b933-ae68-4461-9163-4697b010faaf tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:26.814337 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2707b933-ae68-4461-9163-4697b010faaf tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:26.815028 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2707b933-ae68-4461-9163-4697b010faaf tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:26.816042 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2707b933-ae68-4461-9163-4697b010faaf tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:26.816725 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2707b933-ae68-4461-9163-4697b010faaf tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:26.817404 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2707b933-ae68-4461-9163-4697b010faaf tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:26.835073 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8f7f260b-3f83-4572-85f2-c4a0088dbe81 tempest-FlavorsExtraSpecsTestJSON-1426294122 tempest-FlavorsExtraSpecsTestJSON-1426294122-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:26.968680 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8f7f260b-3f83-4572-85f2-c4a0088dbe81 tempest-FlavorsExtraSpecsTestJSON-1426294122 tempest-FlavorsExtraSpecsTestJSON-1426294122-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/2097468120/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.150060 Oct 18 15:25:26.971090 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 167/322] 10.222.0.60 () {60 vars in 1224 bytes} [Tue Oct 18 15:25:26 2022] POST /compute/v2.1/flavors/2097468120/os-extra_specs => generated 66 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:25:26.984477 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-91be9b16-aefc-4478-863f-771967ea0d8c tempest-FlavorsExtraSpecsTestJSON-1806153790 tempest-FlavorsExtraSpecsTestJSON-1806153790-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:27.011666 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-91be9b16-aefc-4478-863f-771967ea0d8c tempest-FlavorsExtraSpecsTestJSON-1806153790 tempest-FlavorsExtraSpecsTestJSON-1806153790-project] 10.222.0.60 "GET /compute/v2.1/flavors/2097468120/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.030444 Oct 18 15:25:27.019277 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 168/323] 10.222.0.60 () {58 vars in 1245 bytes} [Tue Oct 18 15:25:26 2022] GET /compute/v2.1/flavors/2097468120/os-extra_specs/hw:numa_nodes => generated 22 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 18 15:25:27.030111 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4524cba0-7623-4dc9-8ca8-54c8ad1957b7 tempest-FlavorsExtraSpecsTestJSON-1426294122 tempest-FlavorsExtraSpecsTestJSON-1426294122-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:27.059056 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2707b933-ae68-4461-9163-4697b010faaf tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:27.080539 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2707b933-ae68-4461-9163-4697b010faaf tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:27.082248 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2707b933-ae68-4461-9163-4697b010faaf tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:27.083437 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2707b933-ae68-4461-9163-4697b010faaf tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/b11f87b9-987d-4c75-9a43-d654ab53de1f" status: 200 len: 1320 microversion: 2.25 time: 0.288630 Oct 18 15:25:27.096846 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 156/324] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:25:26 2022] GET /compute/v2.1/servers/b11f87b9-987d-4c75-9a43-d654ab53de1f => generated 1320 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:25:27.108775 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-70b9e8ad-1431-4bda-aa08-4d546066d567 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:27.109295 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4524cba0-7623-4dc9-8ca8-54c8ad1957b7 tempest-FlavorsExtraSpecsTestJSON-1426294122 tempest-FlavorsExtraSpecsTestJSON-1426294122-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/2097468120/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.085515 Oct 18 15:25:27.110737 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-70b9e8ad-1431-4bda-aa08-4d546066d567 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 51ccbde5-4cf5-4821-9478-c14e19e73ad1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:27.111362 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 169/325] 10.222.0.60 () {60 vars in 1224 bytes} [Tue Oct 18 15:25:27 2022] POST /compute/v2.1/flavors/2097468120/os-extra_specs => generated 66 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 18 15:25:27.134415 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c7824c1e-d0b5-4483-b1bd-e8c165e9a270 tempest-FlavorsExtraSpecsTestJSON-1426294122 tempest-FlavorsExtraSpecsTestJSON-1426294122-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:27.141298 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-70b9e8ad-1431-4bda-aa08-4d546066d567 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:27.141845 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-70b9e8ad-1431-4bda-aa08-4d546066d567 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:27.145401 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-70b9e8ad-1431-4bda-aa08-4d546066d567 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:27.147042 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-70b9e8ad-1431-4bda-aa08-4d546066d567 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:27.147535 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-70b9e8ad-1431-4bda-aa08-4d546066d567 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:27.147977 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-70b9e8ad-1431-4bda-aa08-4d546066d567 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:27.154983 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c7824c1e-d0b5-4483-b1bd-e8c165e9a270 tempest-FlavorsExtraSpecsTestJSON-1426294122 tempest-FlavorsExtraSpecsTestJSON-1426294122-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/2097468120/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.036901 Oct 18 15:25:27.155819 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 170/326] 10.222.0.60 () {58 vars in 1203 bytes} [Tue Oct 18 15:25:27 2022] GET /compute/v2.1/flavors/2097468120/os-extra_specs => generated 66 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:25:27.167238 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d8b1c256-a179-4288-8919-29c1c157c15a tempest-FlavorsExtraSpecsTestJSON-1426294122 tempest-FlavorsExtraSpecsTestJSON-1426294122-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:27.257972 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d8b1c256-a179-4288-8919-29c1c157c15a tempest-FlavorsExtraSpecsTestJSON-1426294122 tempest-FlavorsExtraSpecsTestJSON-1426294122-project-admin] 10.222.0.60 "PUT /compute/v2.1/flavors/2097468120/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.095470 Oct 18 15:25:27.258836 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 171/327] 10.222.0.60 () {60 vars in 1265 bytes} [Tue Oct 18 15:25:27 2022] PUT /compute/v2.1/flavors/2097468120/os-extra_specs/hw:numa_nodes => generated 22 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 18 15:25:27.272551 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-83cc96f4-5ecf-41dd-89c2-ffea1b3e8154 tempest-FlavorsExtraSpecsTestJSON-1426294122 tempest-FlavorsExtraSpecsTestJSON-1426294122-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:27.295992 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-83cc96f4-5ecf-41dd-89c2-ffea1b3e8154 tempest-FlavorsExtraSpecsTestJSON-1426294122 tempest-FlavorsExtraSpecsTestJSON-1426294122-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/2097468120/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.030008 Oct 18 15:25:27.310268 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 172/328] 10.222.0.60 () {58 vars in 1203 bytes} [Tue Oct 18 15:25:27 2022] GET /compute/v2.1/flavors/2097468120/os-extra_specs => generated 66 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:25:27.319327 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5a9c54a7-81cd-430f-bfdd-4c589589e134 tempest-FlavorsExtraSpecsTestJSON-1426294122 tempest-FlavorsExtraSpecsTestJSON-1426294122-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:27.408902 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5a9c54a7-81cd-430f-bfdd-4c589589e134 tempest-FlavorsExtraSpecsTestJSON-1426294122 tempest-FlavorsExtraSpecsTestJSON-1426294122-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/2097468120/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.093585 Oct 18 15:25:27.412223 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 173/329] 10.222.0.60 () {58 vars in 1248 bytes} [Tue Oct 18 15:25:27 2022] DELETE /compute/v2.1/flavors/2097468120/os-extra_specs/hw:numa_nodes => generated 0 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 15:25:27.425564 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e540c213-70b6-4d12-a5ee-6bbf403273b2 tempest-FlavorsExtraSpecsTestJSON-1426294122 tempest-FlavorsExtraSpecsTestJSON-1426294122-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:27.454541 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e540c213-70b6-4d12-a5ee-6bbf403273b2 tempest-FlavorsExtraSpecsTestJSON-1426294122 tempest-FlavorsExtraSpecsTestJSON-1426294122-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/2097468120/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.037815 Oct 18 15:25:27.455850 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 174/330] 10.222.0.60 () {58 vars in 1248 bytes} [Tue Oct 18 15:25:27 2022] DELETE /compute/v2.1/flavors/2097468120/os-extra_specs/hw:cpu_policy => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 15:25:27.472214 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-76ba653c-6749-419e-ae37-d1a46c9502ee tempest-FlavorsExtraSpecsTestJSON-1426294122 tempest-FlavorsExtraSpecsTestJSON-1426294122-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:27.498432 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-76ba653c-6749-419e-ae37-d1a46c9502ee tempest-FlavorsExtraSpecsTestJSON-1426294122 tempest-FlavorsExtraSpecsTestJSON-1426294122-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/2097468120/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.038284 Oct 18 15:25:27.500788 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 175/331] 10.222.0.60 () {58 vars in 1203 bytes} [Tue Oct 18 15:25:27 2022] GET /compute/v2.1/flavors/2097468120/os-extra_specs => generated 19 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:25:27.511324 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-90331894-10f0-4a72-aee7-c21c3d58ed26 tempest-FlavorsExtraSpecsTestJSON-1426294122 tempest-FlavorsExtraSpecsTestJSON-1426294122-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:27.566993 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-90331894-10f0-4a72-aee7-c21c3d58ed26 tempest-FlavorsExtraSpecsTestJSON-1426294122 tempest-FlavorsExtraSpecsTestJSON-1426294122-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/2097468120" status: 202 len: 0 microversion: 2.1 time: 0.058969 Oct 18 15:25:27.572546 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 176/332] 10.222.0.60 () {58 vars in 1161 bytes} [Tue Oct 18 15:25:27 2022] DELETE /compute/v2.1/flavors/2097468120 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:25:27.579499 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7f770f6c-4a83-4559-b80f-7eee200b5a32 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:27.580455 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7f770f6c-4a83-4559-b80f-7eee200b5a32 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] [instance: ff014187-bdd4-4211-b796-abf786781dac] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:27.597825 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3,nova_api:SAVEPOINT=9,nova_api:RELEASE=9,nova_api:UPDATE=1,nova_api:DELETE=5 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:25:27.604294 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f770f6c-4a83-4559-b80f-7eee200b5a32 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:27.605363 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f770f6c-4a83-4559-b80f-7eee200b5a32 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:27.606108 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f770f6c-4a83-4559-b80f-7eee200b5a32 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:27.607074 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f770f6c-4a83-4559-b80f-7eee200b5a32 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:27.609371 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f770f6c-4a83-4559-b80f-7eee200b5a32 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:27.612257 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f770f6c-4a83-4559-b80f-7eee200b5a32 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:27.874137 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7f770f6c-4a83-4559-b80f-7eee200b5a32 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '385ef457207e45b0b843fc2b8ffff7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f40d7ca29449cbb4c2d58df280a01c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:27.890141 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7f770f6c-4a83-4559-b80f-7eee200b5a32 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] 10.222.0.60 "GET /compute/v2.1/servers/ff014187-bdd4-4211-b796-abf786781dac" status: 200 len: 1272 microversion: 2.1 time: 0.315420 Oct 18 15:25:27.890725 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 177/333] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:25:27 2022] GET /compute/v2.1/servers/ff014187-bdd4-4211-b796-abf786781dac => generated 1272 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:25:27.895170 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b3a58283-3719-41d8-8a66-be05fb05cd64 tempest-FlavorsExtraSpecsTestJSON-1426294122 tempest-FlavorsExtraSpecsTestJSON-1426294122-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:27.944353 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b3a58283-3719-41d8-8a66-be05fb05cd64 tempest-FlavorsExtraSpecsTestJSON-1426294122 tempest-FlavorsExtraSpecsTestJSON-1426294122-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.052482 Oct 18 15:25:27.958283 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 178/334] 10.222.0.60 () {58 vars in 1146 bytes} [Tue Oct 18 15:25:27 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:25:27.968774 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2b1e172a-71d7-4d12-826f-313aa3901fd1 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:27.969450 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2b1e172a-71d7-4d12-826f-313aa3901fd1 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: 2dea609b-60cd-4634-b6d6-f5e3e085c1a3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:27.988448 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b1e172a-71d7-4d12-826f-313aa3901fd1 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:27.988968 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b1e172a-71d7-4d12-826f-313aa3901fd1 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:27.989395 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b1e172a-71d7-4d12-826f-313aa3901fd1 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:27.990093 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b1e172a-71d7-4d12-826f-313aa3901fd1 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:27.991292 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b1e172a-71d7-4d12-826f-313aa3901fd1 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:27.991292 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b1e172a-71d7-4d12-826f-313aa3901fd1 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:28.471528 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-70b9e8ad-1431-4bda-aa08-4d546066d567 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:28.513037 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-70b9e8ad-1431-4bda-aa08-4d546066d567 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/51ccbde5-4cf5-4821-9478-c14e19e73ad1" status: 200 len: 1308 microversion: 2.1 time: 1.422447 Oct 18 15:25:28.529319 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 157/335] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:25:27 2022] GET /compute/v2.1/servers/51ccbde5-4cf5-4821-9478-c14e19e73ad1 => generated 1308 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:25:28.535023 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9d884a33-2107-4e1c-9599-d8e72293be48 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:28.543301 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9d884a33-2107-4e1c-9599-d8e72293be48 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: b11f87b9-987d-4c75-9a43-d654ab53de1f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:28.569258 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9d884a33-2107-4e1c-9599-d8e72293be48 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:28.569747 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9d884a33-2107-4e1c-9599-d8e72293be48 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:28.570385 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9d884a33-2107-4e1c-9599-d8e72293be48 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:28.571273 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9d884a33-2107-4e1c-9599-d8e72293be48 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:28.571891 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9d884a33-2107-4e1c-9599-d8e72293be48 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:28.572592 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9d884a33-2107-4e1c-9599-d8e72293be48 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:28.619306 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2b1e172a-71d7-4d12-826f-313aa3901fd1 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:28.628656 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2b1e172a-71d7-4d12-826f-313aa3901fd1 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3" status: 200 len: 1503 microversion: 2.1 time: 0.669117 Oct 18 15:25:28.638082 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 179/336] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:25:27 2022] GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3 => generated 1503 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:25:28.817273 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9d884a33-2107-4e1c-9599-d8e72293be48 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:28.818536 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-bf260f62-2117-41f5-9a58-540d25193a31 req-68c8ba59-4fc9-4407-a9c3-42e197a29747 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dea609b-60cd-4634-b6d6-f5e3e085c1a3", "name": "network-vif-unplugged", "status": "completed", "tag": "33616eab-5f4e-4a15-9e20-108e043be5cd"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:28.828245 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9d884a33-2107-4e1c-9599-d8e72293be48 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:28.835500 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9d884a33-2107-4e1c-9599-d8e72293be48 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:28.836871 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9d884a33-2107-4e1c-9599-d8e72293be48 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/b11f87b9-987d-4c75-9a43-d654ab53de1f" status: 200 len: 1320 microversion: 2.25 time: 0.305709 Oct 18 15:25:28.840560 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 158/337] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:25:28 2022] GET /compute/v2.1/servers/b11f87b9-987d-4c75-9a43-d654ab53de1f => generated 1320 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:25:28.842436 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-bf260f62-2117-41f5-9a58-540d25193a31 req-68c8ba59-4fc9-4407-a9c3-42e197a29747 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:28.842922 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-bf260f62-2117-41f5-9a58-540d25193a31 req-68c8ba59-4fc9-4407-a9c3-42e197a29747 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:28.843818 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-bf260f62-2117-41f5-9a58-540d25193a31 req-68c8ba59-4fc9-4407-a9c3-42e197a29747 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:28.870979 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-bf260f62-2117-41f5-9a58-540d25193a31 req-68c8ba59-4fc9-4407-a9c3-42e197a29747 service nova] Creating event network-vif-unplugged:33616eab-5f4e-4a15-9e20-108e043be5cd for instance 2dea609b-60cd-4634-b6d6-f5e3e085c1a3 on n-h1-853682-5 Oct 18 15:25:28.877690 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-bf260f62-2117-41f5-9a58-540d25193a31 req-68c8ba59-4fc9-4407-a9c3-42e197a29747 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062689 Oct 18 15:25:28.878656 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 180/338] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:25:28.917576 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-16924c06-a53b-49ef-9489-7951989fe693 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:28.918421 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-16924c06-a53b-49ef-9489-7951989fe693 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] [instance: ff014187-bdd4-4211-b796-abf786781dac] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:28.928316 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-16924c06-a53b-49ef-9489-7951989fe693 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:28.931263 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-16924c06-a53b-49ef-9489-7951989fe693 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:28.931863 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-16924c06-a53b-49ef-9489-7951989fe693 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:28.932732 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-16924c06-a53b-49ef-9489-7951989fe693 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:28.937874 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-16924c06-a53b-49ef-9489-7951989fe693 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:28.938914 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-16924c06-a53b-49ef-9489-7951989fe693 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:28.983609 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-ba83a74d-c757-4720-836f-cf0b044c5def req-8cbc6f30-9128-4057-a467-b2298150872c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51ccbde5-4cf5-4821-9478-c14e19e73ad1", "name": "network-vif-plugged", "status": "completed", "tag": "df898d7d-c591-40dd-bff2-fd63cc9d55b0"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:29.016420 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ba83a74d-c757-4720-836f-cf0b044c5def req-8cbc6f30-9128-4057-a467-b2298150872c service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:29.016920 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ba83a74d-c757-4720-836f-cf0b044c5def req-8cbc6f30-9128-4057-a467-b2298150872c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:29.017349 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ba83a74d-c757-4720-836f-cf0b044c5def req-8cbc6f30-9128-4057-a467-b2298150872c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:29.048480 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-ba83a74d-c757-4720-836f-cf0b044c5def req-8cbc6f30-9128-4057-a467-b2298150872c service nova] Creating event network-vif-plugged:df898d7d-c591-40dd-bff2-fd63cc9d55b0 for instance 51ccbde5-4cf5-4821-9478-c14e19e73ad1 on n-h2-853682-5 Oct 18 15:25:29.060472 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-ba83a74d-c757-4720-836f-cf0b044c5def req-8cbc6f30-9128-4057-a467-b2298150872c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083722 Oct 18 15:25:29.062547 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 181/339] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:25:29.411853 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-16924c06-a53b-49ef-9489-7951989fe693 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '385ef457207e45b0b843fc2b8ffff7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f40d7ca29449cbb4c2d58df280a01c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:29.431415 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-16924c06-a53b-49ef-9489-7951989fe693 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] 10.222.0.60 "GET /compute/v2.1/servers/ff014187-bdd4-4211-b796-abf786781dac" status: 200 len: 1278 microversion: 2.1 time: 0.516124 Oct 18 15:25:29.438223 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 159/340] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:25:28 2022] GET /compute/v2.1/servers/ff014187-bdd4-4211-b796-abf786781dac => generated 1278 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:25:29.536203 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b22d74f8-6da5-4e9c-9e78-2a407a248963 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:29.536907 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b22d74f8-6da5-4e9c-9e78-2a407a248963 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 51ccbde5-4cf5-4821-9478-c14e19e73ad1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:29.547699 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b22d74f8-6da5-4e9c-9e78-2a407a248963 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:29.548227 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b22d74f8-6da5-4e9c-9e78-2a407a248963 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:29.549477 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b22d74f8-6da5-4e9c-9e78-2a407a248963 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:29.550291 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b22d74f8-6da5-4e9c-9e78-2a407a248963 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:29.550756 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b22d74f8-6da5-4e9c-9e78-2a407a248963 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:29.551190 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b22d74f8-6da5-4e9c-9e78-2a407a248963 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:29.710020 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0e85d7c8-7e06-4fd6-a89d-5012c42fbc25 tempest-FloatingIPsTestJSON-1168319480 tempest-FloatingIPsTestJSON-1168319480-project] Action: 'create', calling method: .version_select at 0x7f7c3dbb2a60>, body: {"pool": null} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:30.898366 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b22d74f8-6da5-4e9c-9e78-2a407a248963 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:30.906630 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b22d74f8-6da5-4e9c-9e78-2a407a248963 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/51ccbde5-4cf5-4821-9478-c14e19e73ad1" status: 200 len: 1308 microversion: 2.1 time: 1.374481 Oct 18 15:25:30.908179 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 160/341] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:25:29 2022] GET /compute/v2.1/servers/51ccbde5-4cf5-4821-9478-c14e19e73ad1 => generated 1308 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:25:30.913384 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4b9c6593-7787-43be-aece-3dd28b65d07f tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:30.914633 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4b9c6593-7787-43be-aece-3dd28b65d07f tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: 2dea609b-60cd-4634-b6d6-f5e3e085c1a3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:30.921317 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4b9c6593-7787-43be-aece-3dd28b65d07f tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:30.922665 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4b9c6593-7787-43be-aece-3dd28b65d07f tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:30.923321 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4b9c6593-7787-43be-aece-3dd28b65d07f tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:30.924852 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4b9c6593-7787-43be-aece-3dd28b65d07f tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:30.925824 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4b9c6593-7787-43be-aece-3dd28b65d07f tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:30.926470 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4b9c6593-7787-43be-aece-3dd28b65d07f tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:31.659242 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4b9c6593-7787-43be-aece-3dd28b65d07f tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:31.670410 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4b9c6593-7787-43be-aece-3dd28b65d07f tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3" status: 200 len: 1503 microversion: 2.1 time: 0.760570 Oct 18 15:25:31.672058 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 161/342] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:25:30 2022] GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3 => generated 1503 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:25:31.696044 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b2a90860-6faa-448a-add2-e2aeba1914fd tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:31.698619 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b2a90860-6faa-448a-add2-e2aeba1914fd tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: b11f87b9-987d-4c75-9a43-d654ab53de1f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:31.729752 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b2a90860-6faa-448a-add2-e2aeba1914fd tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:31.731662 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b2a90860-6faa-448a-add2-e2aeba1914fd tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:31.732510 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b2a90860-6faa-448a-add2-e2aeba1914fd tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:31.734557 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b2a90860-6faa-448a-add2-e2aeba1914fd tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:31.735142 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b2a90860-6faa-448a-add2-e2aeba1914fd tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:31.735684 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b2a90860-6faa-448a-add2-e2aeba1914fd tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:32.541864 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b2a90860-6faa-448a-add2-e2aeba1914fd tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:32.556757 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b2a90860-6faa-448a-add2-e2aeba1914fd tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:32.558274 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b2a90860-6faa-448a-add2-e2aeba1914fd tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:32.559444 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b2a90860-6faa-448a-add2-e2aeba1914fd tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/b11f87b9-987d-4c75-9a43-d654ab53de1f" status: 200 len: 1362 microversion: 2.25 time: 0.886291 Oct 18 15:25:32.593120 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 162/343] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:25:31 2022] GET /compute/v2.1/servers/b11f87b9-987d-4c75-9a43-d654ab53de1f => generated 1362 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:25:32.593120 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6466b7a5-2e5c-4d54-9d95-a433108929b7 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:32.593120 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6466b7a5-2e5c-4d54-9d95-a433108929b7 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] [instance: ff014187-bdd4-4211-b796-abf786781dac] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:32.609968 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6466b7a5-2e5c-4d54-9d95-a433108929b7 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:32.611606 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6466b7a5-2e5c-4d54-9d95-a433108929b7 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:32.616302 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6466b7a5-2e5c-4d54-9d95-a433108929b7 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:32.619474 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6466b7a5-2e5c-4d54-9d95-a433108929b7 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:32.620702 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6466b7a5-2e5c-4d54-9d95-a433108929b7 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:32.622897 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6466b7a5-2e5c-4d54-9d95-a433108929b7 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:32.768368 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6466b7a5-2e5c-4d54-9d95-a433108929b7 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '385ef457207e45b0b843fc2b8ffff7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f40d7ca29449cbb4c2d58df280a01c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:32.779453 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6466b7a5-2e5c-4d54-9d95-a433108929b7 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] 10.222.0.60 "GET /compute/v2.1/servers/ff014187-bdd4-4211-b796-abf786781dac" status: 200 len: 1278 microversion: 2.1 time: 0.196258 Oct 18 15:25:32.783831 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 163/344] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:25:32 2022] GET /compute/v2.1/servers/ff014187-bdd4-4211-b796-abf786781dac => generated 1278 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:25:32.798121 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-d3e40000-8709-45ff-80c2-4ba535579564 req-261032a4-cc5a-4596-8843-65367870fe0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dea609b-60cd-4634-b6d6-f5e3e085c1a3", "tag": "33616eab-5f4e-4a15-9e20-108e043be5cd"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:32.814626 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-d3e40000-8709-45ff-80c2-4ba535579564 req-261032a4-cc5a-4596-8843-65367870fe0a service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:32.817450 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-d3e40000-8709-45ff-80c2-4ba535579564 req-261032a4-cc5a-4596-8843-65367870fe0a service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:32.817964 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-d3e40000-8709-45ff-80c2-4ba535579564 req-261032a4-cc5a-4596-8843-65367870fe0a service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:32.824880 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=100 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:25:32.876388 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-d3e40000-8709-45ff-80c2-4ba535579564 req-261032a4-cc5a-4596-8843-65367870fe0a service nova] Creating event network-changed:33616eab-5f4e-4a15-9e20-108e043be5cd for instance 2dea609b-60cd-4634-b6d6-f5e3e085c1a3 on n-h1-853682-5 Oct 18 15:25:32.891847 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-d3e40000-8709-45ff-80c2-4ba535579564 req-261032a4-cc5a-4596-8843-65367870fe0a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105196 Oct 18 15:25:32.895299 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 164/345] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:25:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:32.904295 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b73e838c-f691-42c5-a3d1-33b179f4bf82 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:32.906432 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b73e838c-f691-42c5-a3d1-33b179f4bf82 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 51ccbde5-4cf5-4821-9478-c14e19e73ad1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:32.929433 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b73e838c-f691-42c5-a3d1-33b179f4bf82 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:32.932846 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b73e838c-f691-42c5-a3d1-33b179f4bf82 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:32.935816 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b73e838c-f691-42c5-a3d1-33b179f4bf82 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:32.938505 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b73e838c-f691-42c5-a3d1-33b179f4bf82 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:32.939212 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b73e838c-f691-42c5-a3d1-33b179f4bf82 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:32.941715 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b73e838c-f691-42c5-a3d1-33b179f4bf82 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:33.317940 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b73e838c-f691-42c5-a3d1-33b179f4bf82 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:33.355904 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b73e838c-f691-42c5-a3d1-33b179f4bf82 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/51ccbde5-4cf5-4821-9478-c14e19e73ad1" status: 200 len: 1488 microversion: 2.1 time: 0.459247 Oct 18 15:25:33.360235 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 165/346] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:25:32 2022] GET /compute/v2.1/servers/51ccbde5-4cf5-4821-9478-c14e19e73ad1 => generated 1488 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:25:33.370464 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-77708c3c-4fd6-41ff-a0a1-038e1cc8678e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:33.374710 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-77708c3c-4fd6-41ff-a0a1-038e1cc8678e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: 2dea609b-60cd-4634-b6d6-f5e3e085c1a3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:33.382149 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=3,nova_api:INSERT=8 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:25:33.401074 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-77708c3c-4fd6-41ff-a0a1-038e1cc8678e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:33.401858 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-77708c3c-4fd6-41ff-a0a1-038e1cc8678e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:33.402449 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-77708c3c-4fd6-41ff-a0a1-038e1cc8678e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:33.407722 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-77708c3c-4fd6-41ff-a0a1-038e1cc8678e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:33.408553 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-77708c3c-4fd6-41ff-a0a1-038e1cc8678e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:33.411692 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-77708c3c-4fd6-41ff-a0a1-038e1cc8678e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:34.890235 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-77708c3c-4fd6-41ff-a0a1-038e1cc8678e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:34.898716 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-77708c3c-4fd6-41ff-a0a1-038e1cc8678e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3" status: 200 len: 1503 microversion: 2.1 time: 1.537062 Oct 18 15:25:34.909004 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 166/347] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:25:33 2022] GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3 => generated 1503 bytes in 1542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:25:35.146834 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-02ab3960-a31e-42e0-93b7-29acebed112c tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Calling method '.version_select at 0x7f7c3dc6cee0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:35.149035 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-02ab3960-a31e-42e0-93b7-29acebed112c tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:35.149657 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-02ab3960-a31e-42e0-93b7-29acebed112c tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:35.150235 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-02ab3960-a31e-42e0-93b7-29acebed112c tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:35.182797 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-02ab3960-a31e-42e0-93b7-29acebed112c tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:35.183297 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-02ab3960-a31e-42e0-93b7-29acebed112c tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:35.183729 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-02ab3960-a31e-42e0-93b7-29acebed112c tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:35.218781 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-02ab3960-a31e-42e0-93b7-29acebed112c tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:35.221484 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-02ab3960-a31e-42e0-93b7-29acebed112c tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:35.225671 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-02ab3960-a31e-42e0-93b7-29acebed112c tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:35.252151 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-02ab3960-a31e-42e0-93b7-29acebed112c tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.344805 Oct 18 15:25:35.253038 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 167/348] 10.222.0.60 () {58 vars in 1146 bytes} [Tue Oct 18 15:25:34 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:35.266476 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a6528240-0085-4fe0-b790-554b92adc659 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:35.267206 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a6528240-0085-4fe0-b790-554b92adc659 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 51ccbde5-4cf5-4821-9478-c14e19e73ad1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:35.282780 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a6528240-0085-4fe0-b790-554b92adc659 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:35.283548 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a6528240-0085-4fe0-b790-554b92adc659 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:35.284126 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a6528240-0085-4fe0-b790-554b92adc659 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:35.285020 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a6528240-0085-4fe0-b790-554b92adc659 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:35.285616 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a6528240-0085-4fe0-b790-554b92adc659 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:35.286193 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a6528240-0085-4fe0-b790-554b92adc659 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:35.439985 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=3 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:25:35.459746 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=12 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:25:35.478635 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a6528240-0085-4fe0-b790-554b92adc659 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "POST /compute/v2.1/servers/51ccbde5-4cf5-4821-9478-c14e19e73ad1/action" status: 202 len: 0 microversion: 2.1 time: 0.223599 Oct 18 15:25:35.508938 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 168/349] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:25:35 2022] POST /compute/v2.1/servers/51ccbde5-4cf5-4821-9478-c14e19e73ad1/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:25:35.539240 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d4cdc6c3-8a4f-40ea-9681-4c8779ebd221 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:35.560208 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d4cdc6c3-8a4f-40ea-9681-4c8779ebd221 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: b11f87b9-987d-4c75-9a43-d654ab53de1f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:35.594880 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4cdc6c3-8a4f-40ea-9681-4c8779ebd221 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:35.596129 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4cdc6c3-8a4f-40ea-9681-4c8779ebd221 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:35.597831 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4cdc6c3-8a4f-40ea-9681-4c8779ebd221 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:35.599273 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4cdc6c3-8a4f-40ea-9681-4c8779ebd221 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:35.600897 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4cdc6c3-8a4f-40ea-9681-4c8779ebd221 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:35.604074 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4cdc6c3-8a4f-40ea-9681-4c8779ebd221 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:36.504742 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:25:37.238115 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d4cdc6c3-8a4f-40ea-9681-4c8779ebd221 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:37.254708 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d4cdc6c3-8a4f-40ea-9681-4c8779ebd221 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:37.256475 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d4cdc6c3-8a4f-40ea-9681-4c8779ebd221 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:37.262107 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d4cdc6c3-8a4f-40ea-9681-4c8779ebd221 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/b11f87b9-987d-4c75-9a43-d654ab53de1f" status: 200 len: 1362 microversion: 2.25 time: 1.746824 Oct 18 15:25:37.266528 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 169/350] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:25:35 2022] GET /compute/v2.1/servers/b11f87b9-987d-4c75-9a43-d654ab53de1f => generated 1362 bytes in 1756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:25:37.278632 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5aa8b5c1-aba3-436b-b529-cea98ce5e7f8 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:37.281601 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5aa8b5c1-aba3-436b-b529-cea98ce5e7f8 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] [instance: ff014187-bdd4-4211-b796-abf786781dac] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:37.289242 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5aa8b5c1-aba3-436b-b529-cea98ce5e7f8 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:37.289969 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5aa8b5c1-aba3-436b-b529-cea98ce5e7f8 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:37.290810 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5aa8b5c1-aba3-436b-b529-cea98ce5e7f8 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:37.291944 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5aa8b5c1-aba3-436b-b529-cea98ce5e7f8 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:37.292998 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5aa8b5c1-aba3-436b-b529-cea98ce5e7f8 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:37.293691 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5aa8b5c1-aba3-436b-b529-cea98ce5e7f8 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:38.131589 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5aa8b5c1-aba3-436b-b529-cea98ce5e7f8 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '385ef457207e45b0b843fc2b8ffff7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f40d7ca29449cbb4c2d58df280a01c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:38.139504 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5aa8b5c1-aba3-436b-b529-cea98ce5e7f8 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] 10.222.0.60 "GET /compute/v2.1/servers/ff014187-bdd4-4211-b796-abf786781dac" status: 200 len: 1320 microversion: 2.1 time: 0.871623 Oct 18 15:25:38.141474 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 170/351] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:25:37 2022] GET /compute/v2.1/servers/ff014187-bdd4-4211-b796-abf786781dac => generated 1320 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:25:38.159987 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5715d90c-54cc-4aef-96ff-b0ae24f87d22 tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Calling method '.version_select at 0x7f7c3dcedaf0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:38.168631 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5715d90c-54cc-4aef-96ff-b0ae24f87d22 tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:38.169887 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5715d90c-54cc-4aef-96ff-b0ae24f87d22 tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:38.170929 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5715d90c-54cc-4aef-96ff-b0ae24f87d22 tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:38.232502 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5715d90c-54cc-4aef-96ff-b0ae24f87d22 tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:38.234082 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5715d90c-54cc-4aef-96ff-b0ae24f87d22 tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:38.235459 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5715d90c-54cc-4aef-96ff-b0ae24f87d22 tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:38.261805 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5715d90c-54cc-4aef-96ff-b0ae24f87d22 tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:38.263087 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5715d90c-54cc-4aef-96ff-b0ae24f87d22 tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:38.266010 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5715d90c-54cc-4aef-96ff-b0ae24f87d22 tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:38.286285 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5715d90c-54cc-4aef-96ff-b0ae24f87d22 tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.142945 Oct 18 15:25:38.287267 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 171/352] 10.222.0.60 () {58 vars in 1167 bytes} [Tue Oct 18 15:25:38 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:25:38.302377 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3d4a1e5b-418b-4f2c-91c8-bc2e9d44b2f8 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:38.303376 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3d4a1e5b-418b-4f2c-91c8-bc2e9d44b2f8 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 51ccbde5-4cf5-4821-9478-c14e19e73ad1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:38.313021 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3d4a1e5b-418b-4f2c-91c8-bc2e9d44b2f8 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:38.313879 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3d4a1e5b-418b-4f2c-91c8-bc2e9d44b2f8 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:38.319068 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3d4a1e5b-418b-4f2c-91c8-bc2e9d44b2f8 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:38.320452 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3d4a1e5b-418b-4f2c-91c8-bc2e9d44b2f8 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:38.321182 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3d4a1e5b-418b-4f2c-91c8-bc2e9d44b2f8 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:38.321990 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3d4a1e5b-418b-4f2c-91c8-bc2e9d44b2f8 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:38.447257 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0e85d7c8-7e06-4fd6-a89d-5012c42fbc25 tempest-FloatingIPsTestJSON-1168319480 tempest-FloatingIPsTestJSON-1168319480-project] 10.222.0.60 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 9.133131 Oct 18 15:25:38.448202 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 182/353] 10.222.0.60 () {60 vars in 1170 bytes} [Tue Oct 18 15:25:29 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 9135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:25:38.453683 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-6fb131d7-6c0d-4757-8f3b-70418267ff36 req-580801d9-b28b-4bef-be8b-33f0357659bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b11f87b9-987d-4c75-9a43-d654ab53de1f", "tag": "34c5d0bc-31cd-4b69-9582-e8aea65b728a"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:38.475503 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6fb131d7-6c0d-4757-8f3b-70418267ff36 req-580801d9-b28b-4bef-be8b-33f0357659bf service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:38.478164 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6fb131d7-6c0d-4757-8f3b-70418267ff36 req-580801d9-b28b-4bef-be8b-33f0357659bf service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:38.478614 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6fb131d7-6c0d-4757-8f3b-70418267ff36 req-580801d9-b28b-4bef-be8b-33f0357659bf service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:38.508276 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-6fb131d7-6c0d-4757-8f3b-70418267ff36 req-580801d9-b28b-4bef-be8b-33f0357659bf service nova] Creating event network-changed:34c5d0bc-31cd-4b69-9582-e8aea65b728a for instance b11f87b9-987d-4c75-9a43-d654ab53de1f on n-h1-853682-5 Oct 18 15:25:38.524488 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-6fb131d7-6c0d-4757-8f3b-70418267ff36 req-580801d9-b28b-4bef-be8b-33f0357659bf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074778 Oct 18 15:25:38.525368 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 183/354] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:38.530590 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e617c287-6e55-479a-9755-4c76393257e3 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:38.531289 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e617c287-6e55-479a-9755-4c76393257e3 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: 2dea609b-60cd-4634-b6d6-f5e3e085c1a3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:38.553592 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e617c287-6e55-479a-9755-4c76393257e3 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:38.554303 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e617c287-6e55-479a-9755-4c76393257e3 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:38.554909 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e617c287-6e55-479a-9755-4c76393257e3 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:38.555854 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e617c287-6e55-479a-9755-4c76393257e3 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:38.557562 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e617c287-6e55-479a-9755-4c76393257e3 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:38.558731 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e617c287-6e55-479a-9755-4c76393257e3 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:39.046122 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3d4a1e5b-418b-4f2c-91c8-bc2e9d44b2f8 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:39.070997 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3d4a1e5b-418b-4f2c-91c8-bc2e9d44b2f8 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/51ccbde5-4cf5-4821-9478-c14e19e73ad1" status: 200 len: 1473 microversion: 2.1 time: 0.779002 Oct 18 15:25:39.072260 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 172/355] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:25:38 2022] GET /compute/v2.1/servers/51ccbde5-4cf5-4821-9478-c14e19e73ad1 => generated 1473 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:25:39.090514 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ad779b25-2c54-40a4-b357-5f2989d3f808 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:39.094389 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ad779b25-2c54-40a4-b357-5f2989d3f808 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: b11f87b9-987d-4c75-9a43-d654ab53de1f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:39.110764 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ad779b25-2c54-40a4-b357-5f2989d3f808 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:39.111809 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ad779b25-2c54-40a4-b357-5f2989d3f808 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:39.112645 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ad779b25-2c54-40a4-b357-5f2989d3f808 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:39.114552 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ad779b25-2c54-40a4-b357-5f2989d3f808 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:39.115219 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ad779b25-2c54-40a4-b357-5f2989d3f808 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:39.118014 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ad779b25-2c54-40a4-b357-5f2989d3f808 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:39.372090 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e617c287-6e55-479a-9755-4c76393257e3 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:39.390818 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e617c287-6e55-479a-9755-4c76393257e3 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3" status: 200 len: 1503 microversion: 2.1 time: 0.864356 Oct 18 15:25:39.396163 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 184/356] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:25:38 2022] GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3 => generated 1503 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:25:39.420977 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8b7f0e10-031a-4065-b99b-1d10d60d090b tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Calling method '.version_select at 0x7f7c3da5cee0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:39.429204 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b7f0e10-031a-4065-b99b-1d10d60d090b tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:39.430002 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b7f0e10-031a-4065-b99b-1d10d60d090b tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:39.430750 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b7f0e10-031a-4065-b99b-1d10d60d090b tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:39.495270 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b7f0e10-031a-4065-b99b-1d10d60d090b tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:39.496477 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b7f0e10-031a-4065-b99b-1d10d60d090b tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:39.497133 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b7f0e10-031a-4065-b99b-1d10d60d090b tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:39.515169 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b7f0e10-031a-4065-b99b-1d10d60d090b tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:39.516065 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b7f0e10-031a-4065-b99b-1d10d60d090b tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:39.516692 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b7f0e10-031a-4065-b99b-1d10d60d090b tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:39.526688 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8b7f0e10-031a-4065-b99b-1d10d60d090b tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.127761 Oct 18 15:25:39.527541 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 185/357] 10.222.0.60 () {58 vars in 1146 bytes} [Tue Oct 18 15:25:39 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:39.534146 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eb2d3764-35e7-453b-968b-7261faed1bf3 tempest-FloatingIPsTestJSON-1168319480 tempest-FloatingIPsTestJSON-1168319480-project] Calling method '.version_select at 0x7f7c3da0aa60>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:39.794568 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ad779b25-2c54-40a4-b357-5f2989d3f808 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:39.808673 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ad779b25-2c54-40a4-b357-5f2989d3f808 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:39.810551 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ad779b25-2c54-40a4-b357-5f2989d3f808 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:39.813025 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ad779b25-2c54-40a4-b357-5f2989d3f808 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/b11f87b9-987d-4c75-9a43-d654ab53de1f" status: 200 len: 1362 microversion: 2.25 time: 0.737880 Oct 18 15:25:39.814165 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 173/358] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:25:39 2022] GET /compute/v2.1/servers/b11f87b9-987d-4c75-9a43-d654ab53de1f => generated 1362 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:25:39.822986 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fd8c7d3c-0c68-4295-a608-c2fdef07f8fc tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-341543523"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:39.827762 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-fd8c7d3c-0c68-4295-a608-c2fdef07f8fc tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 51ccbde5-4cf5-4821-9478-c14e19e73ad1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:39.844394 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fd8c7d3c-0c68-4295-a608-c2fdef07f8fc tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:39.849593 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fd8c7d3c-0c68-4295-a608-c2fdef07f8fc tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:39.852996 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fd8c7d3c-0c68-4295-a608-c2fdef07f8fc tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:39.853902 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fd8c7d3c-0c68-4295-a608-c2fdef07f8fc tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:39.854697 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fd8c7d3c-0c68-4295-a608-c2fdef07f8fc tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:39.856756 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fd8c7d3c-0c68-4295-a608-c2fdef07f8fc tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:40.122455 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-eb2d3764-35e7-453b-968b-7261faed1bf3 tempest-FloatingIPsTestJSON-1168319480 tempest-FloatingIPsTestJSON-1168319480-project] 10.222.0.60 "GET /compute/v2.1/os-floating-ips/586a69ce-4d98-4aae-91fe-540662f25531" status: 200 len: 142 microversion: 2.1 time: 0.593481 Oct 18 15:25:40.124205 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 186/359] 10.222.0.60 () {58 vars in 1260 bytes} [Tue Oct 18 15:25:39 2022] GET /compute/v2.1/os-floating-ips/586a69ce-4d98-4aae-91fe-540662f25531 => generated 142 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:40.131026 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-73b3932e-2484-4241-97c1-055a8f4db333 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:40.132282 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-73b3932e-2484-4241-97c1-055a8f4db333 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] [instance: ff014187-bdd4-4211-b796-abf786781dac] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:40.156374 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73b3932e-2484-4241-97c1-055a8f4db333 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:40.157518 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73b3932e-2484-4241-97c1-055a8f4db333 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:40.158165 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73b3932e-2484-4241-97c1-055a8f4db333 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:40.160726 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73b3932e-2484-4241-97c1-055a8f4db333 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:40.164078 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73b3932e-2484-4241-97c1-055a8f4db333 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:40.165894 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73b3932e-2484-4241-97c1-055a8f4db333 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:40.375004 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fd8c7d3c-0c68-4295-a608-c2fdef07f8fc tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "POST /compute/v2.1/servers/51ccbde5-4cf5-4821-9478-c14e19e73ad1/action" status: 202 len: 0 microversion: 2.1 time: 0.557965 Oct 18 15:25:40.376495 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 174/360] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:25:39 2022] POST /compute/v2.1/servers/51ccbde5-4cf5-4821-9478-c14e19e73ad1/action => generated 0 bytes in 561 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 18 15:25:40.382184 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-053e8526-4448-47a9-9e1b-0ab3dbf4edf4 tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Calling method '.version_select at 0x7f7c3f2dd310>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:40.385306 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-053e8526-4448-47a9-9e1b-0ab3dbf4edf4 tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:40.385967 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-053e8526-4448-47a9-9e1b-0ab3dbf4edf4 tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:40.388784 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-053e8526-4448-47a9-9e1b-0ab3dbf4edf4 tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:40.418848 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-053e8526-4448-47a9-9e1b-0ab3dbf4edf4 tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:40.419575 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-053e8526-4448-47a9-9e1b-0ab3dbf4edf4 tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:40.420894 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-053e8526-4448-47a9-9e1b-0ab3dbf4edf4 tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:40.433863 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-053e8526-4448-47a9-9e1b-0ab3dbf4edf4 tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.055746 Oct 18 15:25:40.435099 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 175/361] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Oct 18 15:25:40 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:40.450650 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b6ec307f-44d8-4f36-8145-d2113e2dbf8c tempest-FloatingIPsTestJSON-1168319480 tempest-FloatingIPsTestJSON-1168319480-project] Calling method '.version_select at 0x7f7c3dca0dc0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:40.571373 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-73b3932e-2484-4241-97c1-055a8f4db333 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '385ef457207e45b0b843fc2b8ffff7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f40d7ca29449cbb4c2d58df280a01c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:40.593800 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-73b3932e-2484-4241-97c1-055a8f4db333 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] 10.222.0.60 "GET /compute/v2.1/servers/ff014187-bdd4-4211-b796-abf786781dac" status: 200 len: 1320 microversion: 2.1 time: 0.467777 Oct 18 15:25:40.595012 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 187/362] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:25:40 2022] GET /compute/v2.1/servers/ff014187-bdd4-4211-b796-abf786781dac => generated 1320 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:25:40.601696 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f0c4dc55-bcc6-43bc-8465-e20f619f2490 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3da5cdc0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:40.668380 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f0c4dc55-bcc6-43bc-8465-e20f619f2490 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/ede050c6-ea2a-474d-a15a-ff210b86a2a8" status: 200 len: 1411 microversion: 2.1 time: 0.071104 Oct 18 15:25:40.669577 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 188/363] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:25:40 2022] GET /compute/v2.1/images/ede050c6-ea2a-474d-a15a-ff210b86a2a8 => generated 1411 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:25:40.675085 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8c2bc1f5-cb07-45c4-b9bd-b9a1443bdb49 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:40.676136 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8c2bc1f5-cb07-45c4-b9bd-b9a1443bdb49 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: 2dea609b-60cd-4634-b6d6-f5e3e085c1a3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:40.705900 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c2bc1f5-cb07-45c4-b9bd-b9a1443bdb49 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:40.706415 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c2bc1f5-cb07-45c4-b9bd-b9a1443bdb49 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:40.706803 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c2bc1f5-cb07-45c4-b9bd-b9a1443bdb49 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:40.707692 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c2bc1f5-cb07-45c4-b9bd-b9a1443bdb49 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:40.708152 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c2bc1f5-cb07-45c4-b9bd-b9a1443bdb49 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:40.708570 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c2bc1f5-cb07-45c4-b9bd-b9a1443bdb49 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:40.996801 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b6ec307f-44d8-4f36-8145-d2113e2dbf8c tempest-FloatingIPsTestJSON-1168319480 tempest-FloatingIPsTestJSON-1168319480-project] 10.222.0.60 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.556931 Oct 18 15:25:40.997416 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 176/364] 10.222.0.60 () {58 vars in 1149 bytes} [Tue Oct 18 15:25:40 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:41.009214 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e8843dd7-e251-4526-8058-dbd6f0920ad9 tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Calling method '.version_select at 0x7f7c3dc3b160>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:41.010951 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e8843dd7-e251-4526-8058-dbd6f0920ad9 tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:41.011443 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e8843dd7-e251-4526-8058-dbd6f0920ad9 tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:41.011890 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e8843dd7-e251-4526-8058-dbd6f0920ad9 tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:41.055688 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e8843dd7-e251-4526-8058-dbd6f0920ad9 tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.057200 Oct 18 15:25:41.066598 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 177/365] 10.222.0.60 () {58 vars in 1179 bytes} [Tue Oct 18 15:25:40 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:41.079009 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-8a78abae-faa9-4183-80b0-caaea48c41be req-b3549d64-066f-4d85-a0dc-0f2b18cfda07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff014187-bdd4-4211-b796-abf786781dac", "tag": "73471ba6-b94b-4b8b-80a2-6e0c8583c38f"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:41.102312 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-8a78abae-faa9-4183-80b0-caaea48c41be req-b3549d64-066f-4d85-a0dc-0f2b18cfda07 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:41.102879 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-8a78abae-faa9-4183-80b0-caaea48c41be req-b3549d64-066f-4d85-a0dc-0f2b18cfda07 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:41.103319 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-8a78abae-faa9-4183-80b0-caaea48c41be req-b3549d64-066f-4d85-a0dc-0f2b18cfda07 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:41.123643 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-8a78abae-faa9-4183-80b0-caaea48c41be req-b3549d64-066f-4d85-a0dc-0f2b18cfda07 service nova] Creating event network-changed:73471ba6-b94b-4b8b-80a2-6e0c8583c38f for instance ff014187-bdd4-4211-b796-abf786781dac on n-h2-853682-5 Oct 18 15:25:41.138662 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-8a78abae-faa9-4183-80b0-caaea48c41be req-b3549d64-066f-4d85-a0dc-0f2b18cfda07 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070700 Oct 18 15:25:41.139465 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 178/366] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:25:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:41.144381 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a7cfe4ea-b283-45f3-aa50-5380a8c8b028 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:41.145135 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a7cfe4ea-b283-45f3-aa50-5380a8c8b028 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: b11f87b9-987d-4c75-9a43-d654ab53de1f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:41.162036 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a7cfe4ea-b283-45f3-aa50-5380a8c8b028 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:41.162530 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a7cfe4ea-b283-45f3-aa50-5380a8c8b028 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:41.162966 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a7cfe4ea-b283-45f3-aa50-5380a8c8b028 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:41.163685 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a7cfe4ea-b283-45f3-aa50-5380a8c8b028 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:41.164142 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a7cfe4ea-b283-45f3-aa50-5380a8c8b028 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:41.164571 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a7cfe4ea-b283-45f3-aa50-5380a8c8b028 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:41.198082 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8c2bc1f5-cb07-45c4-b9bd-b9a1443bdb49 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:41.206184 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8c2bc1f5-cb07-45c4-b9bd-b9a1443bdb49 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3" status: 200 len: 1503 microversion: 2.1 time: 0.535179 Oct 18 15:25:41.206864 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 189/367] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:25:40 2022] GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3 => generated 1503 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:25:41.219485 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5f86f503-9623-43af-a1b9-91ab9ddd48f5 tempest-FloatingIPsTestJSON-1168319480 tempest-FloatingIPsTestJSON-1168319480-project] Calling method '.version_select at 0x7f7c3da04310>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:41.943987 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a7cfe4ea-b283-45f3-aa50-5380a8c8b028 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:41.962255 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a7cfe4ea-b283-45f3-aa50-5380a8c8b028 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:41.965055 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a7cfe4ea-b283-45f3-aa50-5380a8c8b028 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:41.966728 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a7cfe4ea-b283-45f3-aa50-5380a8c8b028 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/b11f87b9-987d-4c75-9a43-d654ab53de1f" status: 200 len: 1362 microversion: 2.25 time: 0.826332 Oct 18 15:25:41.969475 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 179/368] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:25:41 2022] GET /compute/v2.1/servers/b11f87b9-987d-4c75-9a43-d654ab53de1f => generated 1362 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:25:41.985926 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-31532abc-290d-4e3f-a3f0-437a2a90a2d6 tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Calling method '.version_select at 0x7f7c3dc265e0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:41.988043 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-31532abc-290d-4e3f-a3f0-437a2a90a2d6 tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:41.988746 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-31532abc-290d-4e3f-a3f0-437a2a90a2d6 tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:41.989439 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-31532abc-290d-4e3f-a3f0-437a2a90a2d6 tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:42.006917 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-31532abc-290d-4e3f-a3f0-437a2a90a2d6 tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:42.008054 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-31532abc-290d-4e3f-a3f0-437a2a90a2d6 tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:42.008684 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-31532abc-290d-4e3f-a3f0-437a2a90a2d6 tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:42.023836 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-31532abc-290d-4e3f-a3f0-437a2a90a2d6 tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:42.024642 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-31532abc-290d-4e3f-a3f0-437a2a90a2d6 tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:42.025486 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-31532abc-290d-4e3f-a3f0-437a2a90a2d6 tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:42.035818 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-31532abc-290d-4e3f-a3f0-437a2a90a2d6 tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.061516 Oct 18 15:25:42.038896 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 180/369] 10.222.0.60 () {58 vars in 1146 bytes} [Tue Oct 18 15:25:41 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:42.048772 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1c9fcf1c-a2e2-4599-9293-15a736dd2349 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:42.050034 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1c9fcf1c-a2e2-4599-9293-15a736dd2349 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] [instance: ff014187-bdd4-4211-b796-abf786781dac] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:42.075472 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1c9fcf1c-a2e2-4599-9293-15a736dd2349 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:42.075751 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1c9fcf1c-a2e2-4599-9293-15a736dd2349 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:42.076073 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1c9fcf1c-a2e2-4599-9293-15a736dd2349 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:42.077842 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1c9fcf1c-a2e2-4599-9293-15a736dd2349 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:42.078465 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1c9fcf1c-a2e2-4599-9293-15a736dd2349 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:42.079082 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1c9fcf1c-a2e2-4599-9293-15a736dd2349 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:42.605967 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1c9fcf1c-a2e2-4599-9293-15a736dd2349 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '385ef457207e45b0b843fc2b8ffff7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f40d7ca29449cbb4c2d58df280a01c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:42.608931 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:25:42.621185 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1c9fcf1c-a2e2-4599-9293-15a736dd2349 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] 10.222.0.60 "GET /compute/v2.1/servers/ff014187-bdd4-4211-b796-abf786781dac" status: 200 len: 1320 microversion: 2.1 time: 0.582875 Oct 18 15:25:42.628068 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 181/370] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:25:42 2022] GET /compute/v2.1/servers/ff014187-bdd4-4211-b796-abf786781dac => generated 1320 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:25:42.641123 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0e867eb2-f7b4-4202-8cd7-fc2288bfcc94 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3df55820>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:42.731182 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0e867eb2-f7b4-4202-8cd7-fc2288bfcc94 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/ede050c6-ea2a-474d-a15a-ff210b86a2a8" status: 200 len: 1411 microversion: 2.1 time: 0.101661 Oct 18 15:25:42.732304 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 182/371] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:25:42 2022] GET /compute/v2.1/images/ede050c6-ea2a-474d-a15a-ff210b86a2a8 => generated 1411 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:25:42.744915 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-31a55555-ce0d-425e-bfd5-af9543a4342c tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Calling method '.version_select at 0x7f7c3dc6c3a0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:42.747175 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-31a55555-ce0d-425e-bfd5-af9543a4342c tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:42.757591 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-31a55555-ce0d-425e-bfd5-af9543a4342c tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:42.758460 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-31a55555-ce0d-425e-bfd5-af9543a4342c tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:42.788347 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-31a55555-ce0d-425e-bfd5-af9543a4342c tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:42.789409 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-31a55555-ce0d-425e-bfd5-af9543a4342c tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:42.790040 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-31a55555-ce0d-425e-bfd5-af9543a4342c tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:42.806471 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-31a55555-ce0d-425e-bfd5-af9543a4342c tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.072857 Oct 18 15:25:42.820292 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 183/372] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Oct 18 15:25:42 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:42.838180 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-47dc69d0-769c-44bf-8d5e-8ef70c88ea07 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:42.841372 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-47dc69d0-769c-44bf-8d5e-8ef70c88ea07 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: 2dea609b-60cd-4634-b6d6-f5e3e085c1a3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:42.855827 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-47dc69d0-769c-44bf-8d5e-8ef70c88ea07 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:42.860300 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-47dc69d0-769c-44bf-8d5e-8ef70c88ea07 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:42.861136 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-47dc69d0-769c-44bf-8d5e-8ef70c88ea07 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:42.863058 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-47dc69d0-769c-44bf-8d5e-8ef70c88ea07 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:42.867056 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-47dc69d0-769c-44bf-8d5e-8ef70c88ea07 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:42.869271 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-47dc69d0-769c-44bf-8d5e-8ef70c88ea07 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:43.245857 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-47dc69d0-769c-44bf-8d5e-8ef70c88ea07 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:43.263264 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-47dc69d0-769c-44bf-8d5e-8ef70c88ea07 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3" status: 200 len: 1503 microversion: 2.1 time: 0.441479 Oct 18 15:25:43.278367 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 184/373] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:25:42 2022] GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3 => generated 1503 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:25:43.289628 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b5339d0f-13dd-4f65-b0a3-6b205e6144f7 tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Calling method '.version_select at 0x7f7c3ddf59d0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:43.297701 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b5339d0f-13dd-4f65-b0a3-6b205e6144f7 tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:43.299837 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b5339d0f-13dd-4f65-b0a3-6b205e6144f7 tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:43.301045 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b5339d0f-13dd-4f65-b0a3-6b205e6144f7 tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:43.338279 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b5339d0f-13dd-4f65-b0a3-6b205e6144f7 tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:43.338771 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b5339d0f-13dd-4f65-b0a3-6b205e6144f7 tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:43.339201 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b5339d0f-13dd-4f65-b0a3-6b205e6144f7 tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:43.357752 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b5339d0f-13dd-4f65-b0a3-6b205e6144f7 tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.077722 Oct 18 15:25:43.376553 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 185/374] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Oct 18 15:25:43 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:43.393204 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f17bbfc2-f10d-4268-abae-2e1e61fa8946 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:43.401208 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f17bbfc2-f10d-4268-abae-2e1e61fa8946 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: b11f87b9-987d-4c75-9a43-d654ab53de1f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:43.428666 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f17bbfc2-f10d-4268-abae-2e1e61fa8946 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:43.431652 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f17bbfc2-f10d-4268-abae-2e1e61fa8946 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:43.433808 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f17bbfc2-f10d-4268-abae-2e1e61fa8946 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:43.443354 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f17bbfc2-f10d-4268-abae-2e1e61fa8946 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:43.444708 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f17bbfc2-f10d-4268-abae-2e1e61fa8946 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:43.446535 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f17bbfc2-f10d-4268-abae-2e1e61fa8946 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:44.131895 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5f86f503-9623-43af-a1b9-91ab9ddd48f5 tempest-FloatingIPsTestJSON-1168319480 tempest-FloatingIPsTestJSON-1168319480-project] 10.222.0.60 "DELETE /compute/v2.1/os-floating-ips/586a69ce-4d98-4aae-91fe-540662f25531" status: 202 len: 0 microversion: 2.1 time: 2.920427 Oct 18 15:25:44.138484 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 190/375] 10.222.0.60 () {58 vars in 1263 bytes} [Tue Oct 18 15:25:41 2022] DELETE /compute/v2.1/os-floating-ips/586a69ce-4d98-4aae-91fe-540662f25531 => generated 0 bytes in 2927 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:25:44.143198 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b5074886-9174-4040-b1fc-315a15ad1bb2 tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Calling method '.version_select at 0x7f7c3d96e280>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:44.145060 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5074886-9174-4040-b1fc-315a15ad1bb2 tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:44.145485 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5074886-9174-4040-b1fc-315a15ad1bb2 tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:44.145908 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5074886-9174-4040-b1fc-315a15ad1bb2 tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:44.161190 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f17bbfc2-f10d-4268-abae-2e1e61fa8946 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:44.185800 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f17bbfc2-f10d-4268-abae-2e1e61fa8946 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:44.189647 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f17bbfc2-f10d-4268-abae-2e1e61fa8946 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:44.192142 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f17bbfc2-f10d-4268-abae-2e1e61fa8946 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/b11f87b9-987d-4c75-9a43-d654ab53de1f" status: 200 len: 1362 microversion: 2.25 time: 0.811361 Oct 18 15:25:44.197071 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5074886-9174-4040-b1fc-315a15ad1bb2 tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:44.197249 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 186/376] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:25:43 2022] GET /compute/v2.1/servers/b11f87b9-987d-4c75-9a43-d654ab53de1f => generated 1362 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:25:44.198934 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5074886-9174-4040-b1fc-315a15ad1bb2 tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:44.201524 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5074886-9174-4040-b1fc-315a15ad1bb2 tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:44.216193 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2c33c68a-739f-4cb9-a193-94e89e4ce78f tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:44.217987 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2c33c68a-739f-4cb9-a193-94e89e4ce78f tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] [instance: ff014187-bdd4-4211-b796-abf786781dac] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:44.229601 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c33c68a-739f-4cb9-a193-94e89e4ce78f tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:44.232035 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c33c68a-739f-4cb9-a193-94e89e4ce78f tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:44.232379 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c33c68a-739f-4cb9-a193-94e89e4ce78f tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:44.233779 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c33c68a-739f-4cb9-a193-94e89e4ce78f tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:44.234241 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c33c68a-739f-4cb9-a193-94e89e4ce78f tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:44.237814 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5074886-9174-4040-b1fc-315a15ad1bb2 tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:44.238298 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5074886-9174-4040-b1fc-315a15ad1bb2 tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:44.238722 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5074886-9174-4040-b1fc-315a15ad1bb2 tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:44.240117 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c33c68a-739f-4cb9-a193-94e89e4ce78f tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:44.292769 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b5074886-9174-4040-b1fc-315a15ad1bb2 tempest-HypervisorAdminTestJSON-1035662525 tempest-HypervisorAdminTestJSON-1035662525-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.152905 Oct 18 15:25:44.297173 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 191/377] 10.222.0.60 () {58 vars in 1173 bytes} [Tue Oct 18 15:25:44 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:44.315044 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2cf94ccb-eda5-40f5-8d60-53c61043e15b tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3da0d310>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:44.439222 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2cf94ccb-eda5-40f5-8d60-53c61043e15b tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/ede050c6-ea2a-474d-a15a-ff210b86a2a8" status: 200 len: 1411 microversion: 2.1 time: 0.137522 Oct 18 15:25:44.442920 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 192/378] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:25:44 2022] GET /compute/v2.1/images/ede050c6-ea2a-474d-a15a-ff210b86a2a8 => generated 1411 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:25:44.495487 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-197a4279-e780-4a50-ac87-eb1bd3bb83a7 tempest-FloatingIPsTestJSON-1168319480 tempest-FloatingIPsTestJSON-1168319480-project] Action: 'create', calling method: .version_select at 0x7f7c3db74b80>, body: {"pool": null} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:44.684041 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2c33c68a-739f-4cb9-a193-94e89e4ce78f tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '385ef457207e45b0b843fc2b8ffff7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f40d7ca29449cbb4c2d58df280a01c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:44.713049 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2c33c68a-739f-4cb9-a193-94e89e4ce78f tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] 10.222.0.60 "GET /compute/v2.1/servers/ff014187-bdd4-4211-b796-abf786781dac" status: 200 len: 1320 microversion: 2.1 time: 0.513457 Oct 18 15:25:44.716204 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 187/379] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:25:44 2022] GET /compute/v2.1/servers/ff014187-bdd4-4211-b796-abf786781dac => generated 1320 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:25:44.778899 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-37886148-dc5c-4ebb-97df-63d7fb8e0ca0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:44.780684 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-37886148-dc5c-4ebb-97df-63d7fb8e0ca0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: 2dea609b-60cd-4634-b6d6-f5e3e085c1a3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:44.812091 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37886148-dc5c-4ebb-97df-63d7fb8e0ca0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:44.816773 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37886148-dc5c-4ebb-97df-63d7fb8e0ca0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:44.818946 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37886148-dc5c-4ebb-97df-63d7fb8e0ca0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:44.819954 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37886148-dc5c-4ebb-97df-63d7fb8e0ca0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:44.821801 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37886148-dc5c-4ebb-97df-63d7fb8e0ca0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:44.825375 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37886148-dc5c-4ebb-97df-63d7fb8e0ca0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:45.358201 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-37886148-dc5c-4ebb-97df-63d7fb8e0ca0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:45.366086 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-37886148-dc5c-4ebb-97df-63d7fb8e0ca0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3" status: 200 len: 1493 microversion: 2.1 time: 0.621192 Oct 18 15:25:45.366660 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 188/380] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:25:44 2022] GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3 => generated 1493 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:25:45.373987 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ef672544-7343-4761-88a7-3d0e277061c4 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:45.374823 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ef672544-7343-4761-88a7-3d0e277061c4 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: b11f87b9-987d-4c75-9a43-d654ab53de1f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:45.382546 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ef672544-7343-4761-88a7-3d0e277061c4 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:45.385104 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ef672544-7343-4761-88a7-3d0e277061c4 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:45.385791 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ef672544-7343-4761-88a7-3d0e277061c4 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:45.398877 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ef672544-7343-4761-88a7-3d0e277061c4 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:45.399374 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ef672544-7343-4761-88a7-3d0e277061c4 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:45.399817 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ef672544-7343-4761-88a7-3d0e277061c4 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:45.803614 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ef672544-7343-4761-88a7-3d0e277061c4 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:45.816113 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ef672544-7343-4761-88a7-3d0e277061c4 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:45.818893 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ef672544-7343-4761-88a7-3d0e277061c4 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:45.819985 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ef672544-7343-4761-88a7-3d0e277061c4 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/b11f87b9-987d-4c75-9a43-d654ab53de1f" status: 200 len: 1362 microversion: 2.25 time: 0.449852 Oct 18 15:25:45.823423 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 189/381] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:25:45 2022] GET /compute/v2.1/servers/b11f87b9-987d-4c75-9a43-d654ab53de1f => generated 1362 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:25:45.842657 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-e9404d84-bc89-4445-ac1e-e9250b18c99b req-c17db350-b9c2-416b-b3b7-8b276c08cb35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b11f87b9-987d-4c75-9a43-d654ab53de1f", "name": "network-vif-plugged", "status": "completed", "tag": "34c5d0bc-31cd-4b69-9582-e8aea65b728a"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:45.895695 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-e9404d84-bc89-4445-ac1e-e9250b18c99b req-c17db350-b9c2-416b-b3b7-8b276c08cb35 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:45.896176 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-e9404d84-bc89-4445-ac1e-e9250b18c99b req-c17db350-b9c2-416b-b3b7-8b276c08cb35 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:45.903704 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-e9404d84-bc89-4445-ac1e-e9250b18c99b req-c17db350-b9c2-416b-b3b7-8b276c08cb35 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:45.958332 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-e9404d84-bc89-4445-ac1e-e9250b18c99b req-c17db350-b9c2-416b-b3b7-8b276c08cb35 service nova] Creating event network-vif-plugged:34c5d0bc-31cd-4b69-9582-e8aea65b728a for instance b11f87b9-987d-4c75-9a43-d654ab53de1f on n-h1-853682-5 Oct 18 15:25:45.973442 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-e9404d84-bc89-4445-ac1e-e9250b18c99b req-c17db350-b9c2-416b-b3b7-8b276c08cb35 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148266 Oct 18 15:25:45.993889 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 190/382] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:46.014788 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9849cc01-8cf5-4106-9336-2293dbc8cb0e tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Calling method '.version_select at 0x7f7c3dc3bb80>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:46.037713 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9849cc01-8cf5-4106-9336-2293dbc8cb0e tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:46.038431 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9849cc01-8cf5-4106-9336-2293dbc8cb0e tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:46.040087 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9849cc01-8cf5-4106-9336-2293dbc8cb0e tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:46.083976 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9849cc01-8cf5-4106-9336-2293dbc8cb0e tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] 10.222.0.60 "GET /compute/v2.1/os-migrations" status: 200 len: 400 microversion: 2.1 time: 0.088675 Oct 18 15:25:46.099218 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 191/383] 10.222.0.60 () {58 vars in 1143 bytes} [Tue Oct 18 15:25:45 2022] GET /compute/v2.1/os-migrations => generated 400 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:46.105507 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8cff8e42-3b00-4250-8f23-9ab536e2d647 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3dc6cb80>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:46.236549 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8cff8e42-3b00-4250-8f23-9ab536e2d647 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/ede050c6-ea2a-474d-a15a-ff210b86a2a8" status: 200 len: 1411 microversion: 2.1 time: 0.132565 Oct 18 15:25:46.240467 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 192/384] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:25:46 2022] GET /compute/v2.1/images/ede050c6-ea2a-474d-a15a-ff210b86a2a8 => generated 1411 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:25:46.271133 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-14019b24-f89e-4b97-b8ae-84cc72f265e9 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:46.271953 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-14019b24-f89e-4b97-b8ae-84cc72f265e9 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] [instance: ff014187-bdd4-4211-b796-abf786781dac] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:46.311540 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-14019b24-f89e-4b97-b8ae-84cc72f265e9 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:46.318749 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-14019b24-f89e-4b97-b8ae-84cc72f265e9 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:46.322863 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-14019b24-f89e-4b97-b8ae-84cc72f265e9 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:46.328188 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-14019b24-f89e-4b97-b8ae-84cc72f265e9 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:46.328837 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-14019b24-f89e-4b97-b8ae-84cc72f265e9 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:46.329310 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-14019b24-f89e-4b97-b8ae-84cc72f265e9 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:46.999353 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-14019b24-f89e-4b97-b8ae-84cc72f265e9 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '385ef457207e45b0b843fc2b8ffff7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f40d7ca29449cbb4c2d58df280a01c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:47.011452 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-14019b24-f89e-4b97-b8ae-84cc72f265e9 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] 10.222.0.60 "GET /compute/v2.1/servers/ff014187-bdd4-4211-b796-abf786781dac" status: 200 len: 1320 microversion: 2.1 time: 0.766095 Oct 18 15:25:47.012240 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 193/385] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:25:46 2022] GET /compute/v2.1/servers/ff014187-bdd4-4211-b796-abf786781dac => generated 1320 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:25:47.018904 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bbbd9538-e812-46d9-8903-7c6f34f20572 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:47.019723 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-bbbd9538-e812-46d9-8903-7c6f34f20572 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] [instance: 2dea609b-60cd-4634-b6d6-f5e3e085c1a3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:47.026501 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bbbd9538-e812-46d9-8903-7c6f34f20572 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:47.027153 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bbbd9538-e812-46d9-8903-7c6f34f20572 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:47.027734 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bbbd9538-e812-46d9-8903-7c6f34f20572 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:47.028603 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bbbd9538-e812-46d9-8903-7c6f34f20572 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:47.044262 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bbbd9538-e812-46d9-8903-7c6f34f20572 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:47.046695 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bbbd9538-e812-46d9-8903-7c6f34f20572 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:47.686679 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-bbbd9538-e812-46d9-8903-7c6f34f20572 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3" status: 200 len: 1644 microversion: 2.1 time: 0.662781 Oct 18 15:25:47.691274 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 194/386] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:25:47 2022] GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3 => generated 1644 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:25:47.715018 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-55560e0f-f0b2-4f1e-94c2-13194ff32a7a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:47.717704 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-55560e0f-f0b2-4f1e-94c2-13194ff32a7a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: b11f87b9-987d-4c75-9a43-d654ab53de1f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:47.770362 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-55560e0f-f0b2-4f1e-94c2-13194ff32a7a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:47.773614 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-55560e0f-f0b2-4f1e-94c2-13194ff32a7a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:47.774980 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-55560e0f-f0b2-4f1e-94c2-13194ff32a7a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:47.782903 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-55560e0f-f0b2-4f1e-94c2-13194ff32a7a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:47.786615 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-55560e0f-f0b2-4f1e-94c2-13194ff32a7a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:47.788097 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-55560e0f-f0b2-4f1e-94c2-13194ff32a7a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:48.667723 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-55560e0f-f0b2-4f1e-94c2-13194ff32a7a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:48.680565 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-55560e0f-f0b2-4f1e-94c2-13194ff32a7a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:48.682968 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-55560e0f-f0b2-4f1e-94c2-13194ff32a7a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:48.697237 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-55560e0f-f0b2-4f1e-94c2-13194ff32a7a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/b11f87b9-987d-4c75-9a43-d654ab53de1f" status: 200 len: 1362 microversion: 2.25 time: 0.995039 Oct 18 15:25:48.698073 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 195/387] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:25:47 2022] GET /compute/v2.1/servers/b11f87b9-987d-4c75-9a43-d654ab53de1f => generated 1362 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:25:48.703452 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2136b203-4475-49a1-a3e8-77d8b283678c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3dbc8af0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:48.777018 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2136b203-4475-49a1-a3e8-77d8b283678c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/ede050c6-ea2a-474d-a15a-ff210b86a2a8" status: 200 len: 1411 microversion: 2.1 time: 0.077692 Oct 18 15:25:48.778561 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 196/388] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:25:48 2022] GET /compute/v2.1/images/ede050c6-ea2a-474d-a15a-ff210b86a2a8 => generated 1411 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:25:48.790028 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-40546f0f-8287-4e83-90cf-0f49c5718692 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:48.795534 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-40546f0f-8287-4e83-90cf-0f49c5718692 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] [instance: ff014187-bdd4-4211-b796-abf786781dac] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:48.811009 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-40546f0f-8287-4e83-90cf-0f49c5718692 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:48.811764 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-40546f0f-8287-4e83-90cf-0f49c5718692 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:48.817968 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-40546f0f-8287-4e83-90cf-0f49c5718692 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:48.818946 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-40546f0f-8287-4e83-90cf-0f49c5718692 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:48.819561 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-40546f0f-8287-4e83-90cf-0f49c5718692 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:48.821567 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-40546f0f-8287-4e83-90cf-0f49c5718692 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:49.120095 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-40546f0f-8287-4e83-90cf-0f49c5718692 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '385ef457207e45b0b843fc2b8ffff7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f40d7ca29449cbb4c2d58df280a01c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:49.133467 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-40546f0f-8287-4e83-90cf-0f49c5718692 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] 10.222.0.60 "GET /compute/v2.1/servers/ff014187-bdd4-4211-b796-abf786781dac" status: 200 len: 1320 microversion: 2.1 time: 0.352883 Oct 18 15:25:49.136322 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 197/389] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:25:48 2022] GET /compute/v2.1/servers/ff014187-bdd4-4211-b796-abf786781dac => generated 1320 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:25:49.142663 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c35a4d61-b8a4-4fa5-afe3-a03ab2d67b85 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-17085353", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "010df557-27fc-4c93-a23e-d2c3321314f6"}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:49.218784 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-c35a4d61-b8a4-4fa5-afe3-a03ab2d67b85 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] validate_networks() for [('010df557-27fc-4c93-a23e-d2c3321314f6', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:25:49.450447 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-197a4279-e780-4a50-ac87-eb1bd3bb83a7 tempest-FloatingIPsTestJSON-1168319480 tempest-FloatingIPsTestJSON-1168319480-project] 10.222.0.60 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.005781 Oct 18 15:25:49.451625 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 193/390] 10.222.0.60 () {60 vars in 1170 bytes} [Tue Oct 18 15:25:44 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5007 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:49.980570 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-82094dd6-073e-4f1e-a0ae-d04f3deb9a4a tempest-QuotaClassesAdmin257Test-366221352 tempest-QuotaClassesAdmin257Test-366221352-project-admin] Calling method '.version_select at 0x7f7c3d9ff5e0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:50.016338 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-82094dd6-073e-4f1e-a0ae-d04f3deb9a4a tempest-QuotaClassesAdmin257Test-366221352 tempest-QuotaClassesAdmin257Test-366221352-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.563378 Oct 18 15:25:50.034196 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 194/391] 10.222.0.60 () {60 vars in 1226 bytes} [Tue Oct 18 15:25:49 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:25:50.279484 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2b7f1314-4e83-4e76-b2af-52d6245dbf4d tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:50.295354 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2b7f1314-4e83-4e76-b2af-52d6245dbf4d tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.258700 Oct 18 15:25:50.297023 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 195/392] 10.222.0.60 () {58 vars in 1137 bytes} [Tue Oct 18 15:25:50 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:50.309249 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-f55d57f6-437c-4bc0-b1ce-c487088005fa req-5662de07-82ed-4d8e-bbd7-05bb57b2bd3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff014187-bdd4-4211-b796-abf786781dac", "name": "network-vif-plugged", "status": "completed", "tag": "73471ba6-b94b-4b8b-80a2-6e0c8583c38f"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:50.329479 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-c35a4d61-b8a4-4fa5-afe3-a03ab2d67b85 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:25:50.329969 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-c35a4d61-b8a4-4fa5-afe3-a03ab2d67b85 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:25:50.330353 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-c35a4d61-b8a4-4fa5-afe3-a03ab2d67b85 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:25:50.330765 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-c35a4d61-b8a4-4fa5-afe3-a03ab2d67b85 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:25:50.331175 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-c35a4d61-b8a4-4fa5-afe3-a03ab2d67b85 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:25:50.338515 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f55d57f6-437c-4bc0-b1ce-c487088005fa req-5662de07-82ed-4d8e-bbd7-05bb57b2bd3a service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:50.345611 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f55d57f6-437c-4bc0-b1ce-c487088005fa req-5662de07-82ed-4d8e-bbd7-05bb57b2bd3a service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:50.346319 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f55d57f6-437c-4bc0-b1ce-c487088005fa req-5662de07-82ed-4d8e-bbd7-05bb57b2bd3a service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:50.347249 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c35a4d61-b8a4-4fa5-afe3-a03ab2d67b85 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:50.349090 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c35a4d61-b8a4-4fa5-afe3-a03ab2d67b85 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:50.350246 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c35a4d61-b8a4-4fa5-afe3-a03ab2d67b85 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:50.351853 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c35a4d61-b8a4-4fa5-afe3-a03ab2d67b85 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:50.353173 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c35a4d61-b8a4-4fa5-afe3-a03ab2d67b85 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:50.353850 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c35a4d61-b8a4-4fa5-afe3-a03ab2d67b85 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:50.372663 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-f55d57f6-437c-4bc0-b1ce-c487088005fa req-5662de07-82ed-4d8e-bbd7-05bb57b2bd3a service nova] Creating event network-vif-plugged:73471ba6-b94b-4b8b-80a2-6e0c8583c38f for instance ff014187-bdd4-4211-b796-abf786781dac on n-h2-853682-5 Oct 18 15:25:50.377430 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-c35a4d61-b8a4-4fa5-afe3-a03ab2d67b85 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Getting quotas for project a6565f6ef56e4ed3b530d009055cd619. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:25:50.384264 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-c35a4d61-b8a4-4fa5-afe3-a03ab2d67b85 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Getting quotas for user c747aec412924b52b99dbf75d0c77fa4 and project a6565f6ef56e4ed3b530d009055cd619. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:25:50.384694 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-f55d57f6-437c-4bc0-b1ce-c487088005fa req-5662de07-82ed-4d8e-bbd7-05bb57b2bd3a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086269 Oct 18 15:25:50.392558 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 196/393] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:25:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:50.400992 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c35a4d61-b8a4-4fa5-afe3-a03ab2d67b85 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:25:50.405674 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c35a4d61-b8a4-4fa5-afe3-a03ab2d67b85 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: 29ceb840-1b81-4434-841f-a473cded4b73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:25:50.406117 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-83103687-9c2e-4549-87ca-1444af4b182a tempest-FloatingIPsTestJSON-1168319480 tempest-FloatingIPsTestJSON-1168319480-project] Calling method '.version_select at 0x7f7c3d9fff70>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:50.488738 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c35a4d61-b8a4-4fa5-afe3-a03ab2d67b85 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.349126 Oct 18 15:25:50.491674 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 198/394] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:25:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1354 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:25:50.508844 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-81b73f61-5173-4802-9c2f-6eca9e4d1939 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:50.513827 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-81b73f61-5173-4802-9c2f-6eca9e4d1939 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: b11f87b9-987d-4c75-9a43-d654ab53de1f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:50.532112 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-81b73f61-5173-4802-9c2f-6eca9e4d1939 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:50.533795 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-81b73f61-5173-4802-9c2f-6eca9e4d1939 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:50.535035 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-81b73f61-5173-4802-9c2f-6eca9e4d1939 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:50.535789 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-81b73f61-5173-4802-9c2f-6eca9e4d1939 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:50.536506 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-81b73f61-5173-4802-9c2f-6eca9e4d1939 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:50.536971 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-81b73f61-5173-4802-9c2f-6eca9e4d1939 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:51.073369 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-81b73f61-5173-4802-9c2f-6eca9e4d1939 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:51.085041 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-81b73f61-5173-4802-9c2f-6eca9e4d1939 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:51.100544 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-81b73f61-5173-4802-9c2f-6eca9e4d1939 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:51.101806 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-81b73f61-5173-4802-9c2f-6eca9e4d1939 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/b11f87b9-987d-4c75-9a43-d654ab53de1f" status: 200 len: 1557 microversion: 2.25 time: 0.609154 Oct 18 15:25:51.102712 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 199/395] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:25:50 2022] GET /compute/v2.1/servers/b11f87b9-987d-4c75-9a43-d654ab53de1f => generated 1557 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:25:51.107946 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ee8c2e96-2121-4e1e-a79d-9fab6425e275 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3dbc8040>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:51.189719 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ee8c2e96-2121-4e1e-a79d-9fab6425e275 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/ede050c6-ea2a-474d-a15a-ff210b86a2a8" status: 200 len: 1411 microversion: 2.1 time: 0.085753 Oct 18 15:25:51.190300 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 200/396] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:25:51 2022] GET /compute/v2.1/images/ede050c6-ea2a-474d-a15a-ff210b86a2a8 => generated 1411 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:25:51.195160 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-48a35262-117a-46b8-a26b-72775d035296 tempest-QuotaClassesAdmin257Test-366221352 tempest-QuotaClassesAdmin257Test-366221352-project-admin] Action: 'update', calling method: .version_select at 0x7f7c3dbc8a60>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:51.437528 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=8,nova_api:UPDATE=5 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:25:51.519704 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-48a35262-117a-46b8-a26b-72775d035296 tempest-QuotaClassesAdmin257Test-366221352 tempest-QuotaClassesAdmin257Test-366221352-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.327259 Oct 18 15:25:51.520844 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 201/397] 10.222.0.60 () {62 vars in 1247 bytes} [Tue Oct 18 15:25:51 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:25:51.525966 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-29ee9183-945f-4387-a77e-dfa9853e1650 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:51.526960 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-29ee9183-945f-4387-a77e-dfa9853e1650 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] [instance: ff014187-bdd4-4211-b796-abf786781dac] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:51.534484 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-29ee9183-945f-4387-a77e-dfa9853e1650 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:51.535124 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-29ee9183-945f-4387-a77e-dfa9853e1650 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:51.535663 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-29ee9183-945f-4387-a77e-dfa9853e1650 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:51.536636 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-29ee9183-945f-4387-a77e-dfa9853e1650 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:51.538689 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-29ee9183-945f-4387-a77e-dfa9853e1650 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:51.549328 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-29ee9183-945f-4387-a77e-dfa9853e1650 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:51.865487 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-29ee9183-945f-4387-a77e-dfa9853e1650 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '385ef457207e45b0b843fc2b8ffff7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f40d7ca29449cbb4c2d58df280a01c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:51.891717 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-29ee9183-945f-4387-a77e-dfa9853e1650 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] 10.222.0.60 "GET /compute/v2.1/servers/ff014187-bdd4-4211-b796-abf786781dac" status: 200 len: 1320 microversion: 2.1 time: 0.369532 Oct 18 15:25:51.912846 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 202/398] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:25:51 2022] GET /compute/v2.1/servers/ff014187-bdd4-4211-b796-abf786781dac => generated 1320 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:25:52.165177 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-83103687-9c2e-4549-87ca-1444af4b182a tempest-FloatingIPsTestJSON-1168319480 tempest-FloatingIPsTestJSON-1168319480-project] 10.222.0.60 "DELETE /compute/v2.1/os-floating-ips/6c7b5508-f7c3-4324-84ee-920d2393564b" status: 202 len: 0 microversion: 2.1 time: 1.770653 Oct 18 15:25:52.171049 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 197/399] 10.222.0.60 () {58 vars in 1263 bytes} [Tue Oct 18 15:25:50 2022] DELETE /compute/v2.1/os-floating-ips/6c7b5508-f7c3-4324-84ee-920d2393564b => generated 0 bytes in 1777 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:25:52.178846 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6279a4dd-3568-484b-b064-261cab4be495 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:52.179884 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6279a4dd-3568-484b-b064-261cab4be495 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: 29ceb840-1b81-4434-841f-a473cded4b73] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:52.194024 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6279a4dd-3568-484b-b064-261cab4be495 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:52.195755 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6279a4dd-3568-484b-b064-261cab4be495 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:52.196413 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6279a4dd-3568-484b-b064-261cab4be495 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:52.197829 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6279a4dd-3568-484b-b064-261cab4be495 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:52.198933 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6279a4dd-3568-484b-b064-261cab4be495 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:52.199613 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6279a4dd-3568-484b-b064-261cab4be495 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:52.280790 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a2e9002a-5aef-48f2-9270-12c50089a188 tempest-ServersWithSpecificFlavorTestJSON-1003517087 tempest-ServersWithSpecificFlavorTestJSON-1003517087-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-60137625", "id": 886281070, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:52.292329 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6279a4dd-3568-484b-b064-261cab4be495 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:52.304157 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6279a4dd-3568-484b-b064-261cab4be495 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73" status: 200 len: 1261 microversion: 2.1 time: 0.131197 Oct 18 15:25:52.305460 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 198/400] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:25:52 2022] GET /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73 => generated 1261 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:25:52.324002 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a2e9002a-5aef-48f2-9270-12c50089a188 tempest-ServersWithSpecificFlavorTestJSON-1003517087 tempest-ServersWithSpecificFlavorTestJSON-1003517087-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 420 microversion: 2.1 time: 0.409796 Oct 18 15:25:52.325241 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 203/401] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:25:51 2022] POST /compute/v2.1/flavors => generated 420 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:52.332743 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-74cb736b-714a-4095-a740-3f8371837741 tempest-QuotaClassesAdmin257Test-366221352 tempest-QuotaClassesAdmin257Test-366221352-project-admin] Calling method '.version_select at 0x7f7c3db57c10>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:52.349931 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-74cb736b-714a-4095-a740-3f8371837741 tempest-QuotaClassesAdmin257Test-366221352 tempest-QuotaClassesAdmin257Test-366221352-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.023185 Oct 18 15:25:52.350875 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 204/402] 10.222.0.60 () {60 vars in 1226 bytes} [Tue Oct 18 15:25:52 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:25:52.426839 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d4888fb9-fa22-4433-a75b-f2bfebcf5f65 tempest-HypervisorAdminUnderV252Test-2132784612 tempest-HypervisorAdminUnderV252Test-2132784612-project-admin] Calling method '.version_select at 0x7f7c3db57940>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:52.429096 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4888fb9-fa22-4433-a75b-f2bfebcf5f65 tempest-HypervisorAdminUnderV252Test-2132784612 tempest-HypervisorAdminUnderV252Test-2132784612-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:52.429793 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4888fb9-fa22-4433-a75b-f2bfebcf5f65 tempest-HypervisorAdminUnderV252Test-2132784612 tempest-HypervisorAdminUnderV252Test-2132784612-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:52.432184 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4888fb9-fa22-4433-a75b-f2bfebcf5f65 tempest-HypervisorAdminUnderV252Test-2132784612 tempest-HypervisorAdminUnderV252Test-2132784612-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:52.463960 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4888fb9-fa22-4433-a75b-f2bfebcf5f65 tempest-HypervisorAdminUnderV252Test-2132784612 tempest-HypervisorAdminUnderV252Test-2132784612-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:52.465261 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4888fb9-fa22-4433-a75b-f2bfebcf5f65 tempest-HypervisorAdminUnderV252Test-2132784612 tempest-HypervisorAdminUnderV252Test-2132784612-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:52.466974 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4888fb9-fa22-4433-a75b-f2bfebcf5f65 tempest-HypervisorAdminUnderV252Test-2132784612 tempest-HypervisorAdminUnderV252Test-2132784612-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:52.481132 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4888fb9-fa22-4433-a75b-f2bfebcf5f65 tempest-HypervisorAdminUnderV252Test-2132784612 tempest-HypervisorAdminUnderV252Test-2132784612-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:52.481941 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4888fb9-fa22-4433-a75b-f2bfebcf5f65 tempest-HypervisorAdminUnderV252Test-2132784612 tempest-HypervisorAdminUnderV252Test-2132784612-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:52.483160 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4888fb9-fa22-4433-a75b-f2bfebcf5f65 tempest-HypervisorAdminUnderV252Test-2132784612 tempest-HypervisorAdminUnderV252Test-2132784612-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:52.491958 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d4888fb9-fa22-4433-a75b-f2bfebcf5f65 tempest-HypervisorAdminUnderV252Test-2132784612 tempest-HypervisorAdminUnderV252Test-2132784612-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.139824 Oct 18 15:25:52.493011 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 205/403] 10.222.0.60 () {58 vars in 1146 bytes} [Tue Oct 18 15:25:52 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:52.508588 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d42d7048-cc5e-4e66-98d0-9b9b484007a4 tempest-FloatingIPsTestJSON-1168319480 tempest-FloatingIPsTestJSON-1168319480-project] Calling method '.version_select at 0x7f7c3db57550>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:52.527320 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-642540f4-dc1e-4bd4-8ac8-0db9d9c37266 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:52.527320 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-642540f4-dc1e-4bd4-8ac8-0db9d9c37266 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] [instance: b11f87b9-987d-4c75-9a43-d654ab53de1f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:52.557808 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-642540f4-dc1e-4bd4-8ac8-0db9d9c37266 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:52.558487 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-642540f4-dc1e-4bd4-8ac8-0db9d9c37266 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:52.558931 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-642540f4-dc1e-4bd4-8ac8-0db9d9c37266 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:52.559648 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-642540f4-dc1e-4bd4-8ac8-0db9d9c37266 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:52.562103 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-642540f4-dc1e-4bd4-8ac8-0db9d9c37266 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:52.565061 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-642540f4-dc1e-4bd4-8ac8-0db9d9c37266 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:52.626290 n-d-853682-5 devstack@n-api.service[120405]: DEBUG neutronclient.v2_0.client [None req-d42d7048-cc5e-4e66-98d0-9b9b484007a4 tempest-FloatingIPsTestJSON-1168319480 tempest-FloatingIPsTestJSON-1168319480-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 6c7b5508-f7c3-4324-84ee-920d2393564b could not be found", "detail": ""}} {{(pid=120405) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 15:25:52.627111 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-d42d7048-cc5e-4e66-98d0-9b9b484007a4 tempest-FloatingIPsTestJSON-1168319480 tempest-FloatingIPsTestJSON-1168319480-project] HTTP exception thrown: Floating IP not found for ID 6c7b5508-f7c3-4324-84ee-920d2393564b Oct 18 15:25:52.640068 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d42d7048-cc5e-4e66-98d0-9b9b484007a4 tempest-FloatingIPsTestJSON-1168319480 tempest-FloatingIPsTestJSON-1168319480-project] Request method failure captured: Oct 18 15:25:52.640068 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/os-floating-ips/6c7b5508-f7c3-4324-84ee-920d2393564b HTTP/1.1 Oct 18 15:25:52.640068 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:25:52.640068 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:25:52.640068 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:25:52.640068 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:25:52.640068 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:25:52.640068 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:25:52.640068 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:25:52.640068 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:25:52.640068 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsVpGkIJpfjvAncAyuDdJ90I0QFAxUTqRI-T4zIc8Nl88NwY-_mIG1e0T4ZxsenhbX4g2nTP4Y6rCiNuFoEaCY-7XfkUcA87yAk90Mgsdi9Kn40nLyTIh8hVYs9nbskuZq9pGD8aTI4_RfIHvxvHtOdbAW1tCA281_Vk7CPZ3h8LuzY Oct 18 15:25:52.640068 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:25:52.640068 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:25:52.640068 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:25:52.640068 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:25:52.640068 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:25:52.640068 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:25:52.640068 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: c371b01688b24b8c84aed0d261f888d7 Oct 18 15:25:52.640068 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-FloatingIPsTestJSON-1168319480 Oct 18 15:25:52.640068 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:25:52.640068 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:25:52.641762 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c371b01688b24b8c84aed0d261f888d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c371b01688b24b8c84aed0d261f888d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c371b01688b24b8c84aed0d261f888d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c371b01688b24b8c84aed0d261f888d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:25:52.641762 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-FloatingIPsTestJSON-1168319480 Oct 18 15:25:52.641762 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: c371b01688b24b8c84aed0d261f888d7 Oct 18 15:25:52.641762 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1168319480 Oct 18 15:25:52.641762 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-FloatingIPsTestJSON-1168319480-project Oct 18 15:25:52.641762 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:25:52.641762 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:25:52.641762 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 849cbfdf3ffd4772b24431be52aba7c1 Oct 18 15:25:52.641762 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-FloatingIPsTestJSON-1168319480-project Oct 18 15:25:52.641762 n-d-853682-5 devstack@n-api.service[120405]: method: Oct 18 15:25:52.641762 n-d-853682-5 devstack@n-api.service[120405]: exception: Floating IP not found for ID 6c7b5508-f7c3-4324-84ee-920d2393564b Oct 18 15:25:52.641762 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '6c7b5508-f7c3-4324-84ee-920d2393564b'} Oct 18 15:25:52.641762 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:25:52.642706 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:52.642706 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2837, in get_floating_ip Oct 18 15:25:52.642706 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 18 15:25:52.642706 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:25:52.642706 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:25:52.642706 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 18 15:25:52.642706 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 18 15:25:52.642706 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:25:52.642706 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:25:52.642706 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 15:25:52.642706 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 15:25:52.642706 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:25:52.642706 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:25:52.642706 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 15:25:52.642706 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 15:25:52.642706 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:25:52.642706 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:25:52.642706 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 15:25:52.642706 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 15:25:52.643802 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:25:52.643802 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:25:52.643802 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 15:25:52.643802 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 15:25:52.643802 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 15:25:52.643802 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 15:25:52.643802 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 6c7b5508-f7c3-4324-84ee-920d2393564b could not be found Oct 18 15:25:52.643802 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d1be4147-c91f-496c-ba55-0728e96f1cb3'] Oct 18 15:25:52.643802 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:52.643802 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:25:52.643802 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:52.643802 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:52.643802 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 18 15:25:52.643802 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 18 15:25:52.643802 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2840, in get_floating_ip Oct 18 15:25:52.643802 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 18 15:25:52.643802 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 6c7b5508-f7c3-4324-84ee-920d2393564b. Oct 18 15:25:52.643802 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:52.643802 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:25:52.643802 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:52.645032 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:52.645032 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:25:52.645032 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:25:52.645032 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:25:52.645032 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:25:52.645032 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:25:52.645032 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:25:52.645032 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:25:52.645032 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:25:52.645032 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 18 15:25:52.645032 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 18 15:25:52.645032 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 6c7b5508-f7c3-4324-84ee-920d2393564b Oct 18 15:25:52.645032 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:52.645032 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:25:52.645032 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:52.645032 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:52.645032 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:25:52.645032 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:25:52.645032 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:25:52.645032 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:25:52.646174 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 6c7b5508-f7c3-4324-84ee-920d2393564b Oct 18 15:25:52.646174 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:25:52.646174 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d42d7048-cc5e-4e66-98d0-9b9b484007a4 tempest-FloatingIPsTestJSON-1168319480 tempest-FloatingIPsTestJSON-1168319480-project] Returning 404 to user: Floating IP not found for ID 6c7b5508-f7c3-4324-84ee-920d2393564b {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:25:52.646174 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d42d7048-cc5e-4e66-98d0-9b9b484007a4 tempest-FloatingIPsTestJSON-1168319480 tempest-FloatingIPsTestJSON-1168319480-project] 10.222.0.60 "GET /compute/v2.1/os-floating-ips/6c7b5508-f7c3-4324-84ee-920d2393564b" status: 404 len: 111 microversion: 2.1 time: 0.140963 Oct 18 15:25:52.649793 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 206/404] 10.222.0.60 () {58 vars in 1260 bytes} [Tue Oct 18 15:25:52 2022] GET /compute/v2.1/os-floating-ips/6c7b5508-f7c3-4324-84ee-920d2393564b => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:25:52.654921 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-398358e9-b37c-46f8-939f-efdf08450519 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3da8c670>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:52.731769 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-398358e9-b37c-46f8-939f-efdf08450519 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/ede050c6-ea2a-474d-a15a-ff210b86a2a8" status: 200 len: 1411 microversion: 2.1 time: 0.080763 Oct 18 15:25:52.733575 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 207/405] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:25:52 2022] GET /compute/v2.1/images/ede050c6-ea2a-474d-a15a-ff210b86a2a8 => generated 1411 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:25:52.738497 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3b1d7725-3302-439c-a7c5-b668eeeb8146 tempest-ServersWithSpecificFlavorTestJSON-1003517087 tempest-ServersWithSpecificFlavorTestJSON-1003517087-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:52.746464 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3b1d7725-3302-439c-a7c5-b668eeeb8146 tempest-ServersWithSpecificFlavorTestJSON-1003517087 tempest-ServersWithSpecificFlavorTestJSON-1003517087-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.011511 Oct 18 15:25:52.748650 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 208/406] 10.222.0.60 () {58 vars in 1182 bytes} [Tue Oct 18 15:25:52 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:25:52.755296 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-39c78ba3-d5af-435b-b45b-647ce50b26a6 tempest-QuotaClassesAdmin257Test-366221352 tempest-QuotaClassesAdmin257Test-366221352-project-admin] Action: 'update', calling method: .version_select at 0x7f7c3da8c430>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:52.904626 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-642540f4-dc1e-4bd4-8ac8-0db9d9c37266 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lazy-loading 'services' on Instance uuid b11f87b9-987d-4c75-9a43-d654ab53de1f {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:25:52.914357 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-39c78ba3-d5af-435b-b45b-647ce50b26a6 tempest-QuotaClassesAdmin257Test-366221352 tempest-QuotaClassesAdmin257Test-366221352-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.164280 Oct 18 15:25:52.915258 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 209/407] 10.222.0.60 () {62 vars in 1247 bytes} [Tue Oct 18 15:25:52 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:25:52.921644 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-4de957ae-ce6d-4a6c-a217-2aa585585250 req-f1ee41fa-24d1-4500-af01-b4c1dcc697fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51ccbde5-4cf5-4821-9478-c14e19e73ad1", "name": "network-vif-plugged", "status": "completed", "tag": "df898d7d-c591-40dd-bff2-fd63cc9d55b0"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:52.939047 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-4de957ae-ce6d-4a6c-a217-2aa585585250 req-f1ee41fa-24d1-4500-af01-b4c1dcc697fa service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:52.939540 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-4de957ae-ce6d-4a6c-a217-2aa585585250 req-f1ee41fa-24d1-4500-af01-b4c1dcc697fa service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:52.939984 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-4de957ae-ce6d-4a6c-a217-2aa585585250 req-f1ee41fa-24d1-4500-af01-b4c1dcc697fa service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:52.953540 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-4de957ae-ce6d-4a6c-a217-2aa585585250 req-f1ee41fa-24d1-4500-af01-b4c1dcc697fa service nova] Creating event network-vif-plugged:df898d7d-c591-40dd-bff2-fd63cc9d55b0 for instance 51ccbde5-4cf5-4821-9478-c14e19e73ad1 on n-h2-853682-5 Oct 18 15:25:52.962615 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-4de957ae-ce6d-4a6c-a217-2aa585585250 req-f1ee41fa-24d1-4500-af01-b4c1dcc697fa service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045972 Oct 18 15:25:52.963227 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 210/408] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:52.968747 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e9e58129-4c01-4bf7-b703-c492c5c157e0 tempest-HypervisorAdminUnderV252Test-2132784612 tempest-HypervisorAdminUnderV252Test-2132784612-project-admin] Calling method '.version_select at 0x7f7c3db573a0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:52.970498 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e9e58129-4c01-4bf7-b703-c492c5c157e0 tempest-HypervisorAdminUnderV252Test-2132784612 tempest-HypervisorAdminUnderV252Test-2132784612-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:52.970980 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e9e58129-4c01-4bf7-b703-c492c5c157e0 tempest-HypervisorAdminUnderV252Test-2132784612 tempest-HypervisorAdminUnderV252Test-2132784612-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:52.971510 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e9e58129-4c01-4bf7-b703-c492c5c157e0 tempest-HypervisorAdminUnderV252Test-2132784612 tempest-HypervisorAdminUnderV252Test-2132784612-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:52.999900 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-642540f4-dc1e-4bd4-8ac8-0db9d9c37266 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/b11f87b9-987d-4c75-9a43-d654ab53de1f" status: 200 len: 2050 microversion: 2.25 time: 0.693055 Oct 18 15:25:53.000871 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 199/409] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:25:52 2022] GET /compute/v2.1/servers/b11f87b9-987d-4c75-9a43-d654ab53de1f => generated 2050 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:25:53.009950 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8f02f38c-b511-4299-a091-4aadca5f2fe1 tempest-FloatingIPsTestJSON-1168319480 tempest-FloatingIPsTestJSON-1168319480-project] Calling method '.version_select at 0x7f7c3d96e790>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:53.042853 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e9e58129-4c01-4bf7-b703-c492c5c157e0 tempest-HypervisorAdminUnderV252Test-2132784612 tempest-HypervisorAdminUnderV252Test-2132784612-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:53.043362 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e9e58129-4c01-4bf7-b703-c492c5c157e0 tempest-HypervisorAdminUnderV252Test-2132784612 tempest-HypervisorAdminUnderV252Test-2132784612-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:53.043802 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e9e58129-4c01-4bf7-b703-c492c5c157e0 tempest-HypervisorAdminUnderV252Test-2132784612 tempest-HypervisorAdminUnderV252Test-2132784612-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:53.119402 n-d-853682-5 devstack@n-api.service[120406]: DEBUG neutronclient.v2_0.client [None req-8f02f38c-b511-4299-a091-4aadca5f2fe1 tempest-FloatingIPsTestJSON-1168319480 tempest-FloatingIPsTestJSON-1168319480-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 6c7b5508-f7c3-4324-84ee-920d2393564b could not be found", "detail": ""}} {{(pid=120406) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 15:25:53.120368 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-8f02f38c-b511-4299-a091-4aadca5f2fe1 tempest-FloatingIPsTestJSON-1168319480 tempest-FloatingIPsTestJSON-1168319480-project] HTTP exception thrown: Floating IP not found for ID 6c7b5508-f7c3-4324-84ee-920d2393564b Oct 18 15:25:53.125145 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8f02f38c-b511-4299-a091-4aadca5f2fe1 tempest-FloatingIPsTestJSON-1168319480 tempest-FloatingIPsTestJSON-1168319480-project] Request method failure captured: Oct 18 15:25:53.125145 n-d-853682-5 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/os-floating-ips/6c7b5508-f7c3-4324-84ee-920d2393564b HTTP/1.1 Oct 18 15:25:53.125145 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:25:53.125145 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:25:53.125145 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:25:53.125145 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:25:53.125145 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:25:53.125145 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:25:53.125145 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:25:53.125145 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:25:53.125145 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsVpGkIJpfjvAncAyuDdJ90I0QFAxUTqRI-T4zIc8Nl88NwY-_mIG1e0T4ZxsenhbX4g2nTP4Y6rCiNuFoEaCY-7XfkUcA87yAk90Mgsdi9Kn40nLyTIh8hVYs9nbskuZq9pGD8aTI4_RfIHvxvHtOdbAW1tCA281_Vk7CPZ3h8LuzY Oct 18 15:25:53.125145 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:25:53.125145 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:25:53.125145 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:25:53.125145 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:25:53.125145 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:25:53.125145 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:25:53.125145 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: c371b01688b24b8c84aed0d261f888d7 Oct 18 15:25:53.125145 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-FloatingIPsTestJSON-1168319480 Oct 18 15:25:53.125145 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:25:53.125145 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:25:53.126591 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c371b01688b24b8c84aed0d261f888d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c371b01688b24b8c84aed0d261f888d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c371b01688b24b8c84aed0d261f888d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c371b01688b24b8c84aed0d261f888d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:25:53.126591 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-FloatingIPsTestJSON-1168319480 Oct 18 15:25:53.126591 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: c371b01688b24b8c84aed0d261f888d7 Oct 18 15:25:53.126591 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1168319480 Oct 18 15:25:53.126591 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-FloatingIPsTestJSON-1168319480-project Oct 18 15:25:53.126591 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:25:53.126591 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:25:53.126591 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 849cbfdf3ffd4772b24431be52aba7c1 Oct 18 15:25:53.126591 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-FloatingIPsTestJSON-1168319480-project Oct 18 15:25:53.126591 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:25:53.126591 n-d-853682-5 devstack@n-api.service[120406]: exception: Floating IP not found for ID 6c7b5508-f7c3-4324-84ee-920d2393564b Oct 18 15:25:53.126591 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '6c7b5508-f7c3-4324-84ee-920d2393564b'} Oct 18 15:25:53.126591 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:25:53.127739 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:53.127739 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2837, in get_floating_ip Oct 18 15:25:53.127739 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 18 15:25:53.127739 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:25:53.127739 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:25:53.127739 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 18 15:25:53.127739 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 18 15:25:53.127739 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:25:53.127739 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:25:53.127739 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 15:25:53.127739 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 15:25:53.127739 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:25:53.127739 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:25:53.127739 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 15:25:53.127739 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 15:25:53.127739 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:25:53.127739 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:25:53.127739 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 15:25:53.127739 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 15:25:53.129191 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:25:53.129191 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:25:53.129191 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 15:25:53.129191 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 15:25:53.129191 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 15:25:53.129191 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 15:25:53.129191 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 6c7b5508-f7c3-4324-84ee-920d2393564b could not be found Oct 18 15:25:53.129191 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d280c45a-6e58-479a-87e0-d4ed573aae9c'] Oct 18 15:25:53.129191 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:25:53.129191 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:25:53.129191 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:25:53.129191 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:53.129191 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 18 15:25:53.129191 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 18 15:25:53.129191 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2840, in get_floating_ip Oct 18 15:25:53.129191 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 18 15:25:53.129191 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 6c7b5508-f7c3-4324-84ee-920d2393564b. Oct 18 15:25:53.129191 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:25:53.129191 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:25:53.129191 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:25:53.130618 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:53.130618 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:25:53.130618 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:25:53.130618 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:25:53.130618 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:25:53.130618 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:25:53.130618 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:25:53.130618 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:25:53.130618 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:25:53.130618 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 18 15:25:53.130618 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 18 15:25:53.130618 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 6c7b5508-f7c3-4324-84ee-920d2393564b Oct 18 15:25:53.130618 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:25:53.130618 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:25:53.130618 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:25:53.130618 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:25:53.130618 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:25:53.130618 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:25:53.130618 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:25:53.130618 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:25:53.132084 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 6c7b5508-f7c3-4324-84ee-920d2393564b Oct 18 15:25:53.132084 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:25:53.132084 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8f02f38c-b511-4299-a091-4aadca5f2fe1 tempest-FloatingIPsTestJSON-1168319480 tempest-FloatingIPsTestJSON-1168319480-project] Returning 404 to user: Floating IP not found for ID 6c7b5508-f7c3-4324-84ee-920d2393564b {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:25:53.132827 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8f02f38c-b511-4299-a091-4aadca5f2fe1 tempest-FloatingIPsTestJSON-1168319480 tempest-FloatingIPsTestJSON-1168319480-project] 10.222.0.60 "DELETE /compute/v2.1/os-floating-ips/6c7b5508-f7c3-4324-84ee-920d2393564b" status: 404 len: 111 microversion: 2.1 time: 0.130326 Oct 18 15:25:53.135163 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 200/410] 10.222.0.60 () {58 vars in 1263 bytes} [Tue Oct 18 15:25:53 2022] DELETE /compute/v2.1/os-floating-ips/6c7b5508-f7c3-4324-84ee-920d2393564b => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:25:53.150036 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e9e58129-4c01-4bf7-b703-c492c5c157e0 tempest-HypervisorAdminUnderV252Test-2132784612 tempest-HypervisorAdminUnderV252Test-2132784612-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:53.151108 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e9e58129-4c01-4bf7-b703-c492c5c157e0 tempest-HypervisorAdminUnderV252Test-2132784612 tempest-HypervisorAdminUnderV252Test-2132784612-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:53.151224 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-805e761e-2b54-458b-8ead-e4122de80669 tempest-ServersWithSpecificFlavorTestJSON-1003517087 tempest-ServersWithSpecificFlavorTestJSON-1003517087-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-953627907", "id": 40702943, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:53.151554 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e9e58129-4c01-4bf7-b703-c492c5c157e0 tempest-HypervisorAdminUnderV252Test-2132784612 tempest-HypervisorAdminUnderV252Test-2132784612-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:53.161520 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e9e58129-4c01-4bf7-b703-c492c5c157e0 tempest-HypervisorAdminUnderV252Test-2132784612 tempest-HypervisorAdminUnderV252Test-2132784612-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/n-h2-853682-5/servers" status: 200 len: 354 microversion: 2.1 time: 0.197006 Oct 18 15:25:53.162105 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 211/411] 10.222.0.60 () {58 vars in 1212 bytes} [Tue Oct 18 15:25:52 2022] GET /compute/v2.1/os-hypervisors/n-h2-853682-5/servers => generated 354 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:53.174260 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b32e50ca-fa46-4f5f-9004-aee5139f5e48 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:53.175070 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b32e50ca-fa46-4f5f-9004-aee5139f5e48 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] [instance: ff014187-bdd4-4211-b796-abf786781dac] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:53.194833 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-805e761e-2b54-458b-8ead-e4122de80669 tempest-ServersWithSpecificFlavorTestJSON-1003517087 tempest-ServersWithSpecificFlavorTestJSON-1003517087-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 418 microversion: 2.1 time: 0.057904 Oct 18 15:25:53.202499 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b32e50ca-fa46-4f5f-9004-aee5139f5e48 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:53.203066 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b32e50ca-fa46-4f5f-9004-aee5139f5e48 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:53.203599 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b32e50ca-fa46-4f5f-9004-aee5139f5e48 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:53.204222 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b32e50ca-fa46-4f5f-9004-aee5139f5e48 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:53.204747 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b32e50ca-fa46-4f5f-9004-aee5139f5e48 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:53.205258 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b32e50ca-fa46-4f5f-9004-aee5139f5e48 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:53.206971 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 201/412] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:25:53 2022] POST /compute/v2.1/flavors => generated 418 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:53.220384 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1f25199d-4484-43b1-b7ff-4546b535fe67 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:53.221322 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1f25199d-4484-43b1-b7ff-4546b535fe67 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] [instance: b11f87b9-987d-4c75-9a43-d654ab53de1f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:53.237850 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f25199d-4484-43b1-b7ff-4546b535fe67 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:53.238732 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f25199d-4484-43b1-b7ff-4546b535fe67 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:53.239057 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=100 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:25:53.239643 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f25199d-4484-43b1-b7ff-4546b535fe67 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:53.240917 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f25199d-4484-43b1-b7ff-4546b535fe67 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:53.241631 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f25199d-4484-43b1-b7ff-4546b535fe67 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:53.259503 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f25199d-4484-43b1-b7ff-4546b535fe67 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:53.569342 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b32e50ca-fa46-4f5f-9004-aee5139f5e48 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '385ef457207e45b0b843fc2b8ffff7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f40d7ca29449cbb4c2d58df280a01c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:53.583879 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b32e50ca-fa46-4f5f-9004-aee5139f5e48 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] 10.222.0.60 "GET /compute/v2.1/servers/ff014187-bdd4-4211-b796-abf786781dac" status: 200 len: 1469 microversion: 2.1 time: 0.410117 Oct 18 15:25:53.587172 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 212/413] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:25:53 2022] GET /compute/v2.1/servers/ff014187-bdd4-4211-b796-abf786781dac => generated 1469 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:25:53.594087 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-41ef1c83-696d-44d6-bac7-c2e678d87303 tempest-HypervisorAdminUnderV252Test-2132784612 tempest-HypervisorAdminUnderV252Test-2132784612-project-admin] Calling method '.version_select at 0x7f7c3db60b80>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:53.616449 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-1f25199d-4484-43b1-b7ff-4546b535fe67 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lazy-loading 'services' on Instance uuid b11f87b9-987d-4c75-9a43-d654ab53de1f {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:25:53.622461 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-41ef1c83-696d-44d6-bac7-c2e678d87303 tempest-HypervisorAdminUnderV252Test-2132784612 tempest-HypervisorAdminUnderV252Test-2132784612-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:53.623684 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-41ef1c83-696d-44d6-bac7-c2e678d87303 tempest-HypervisorAdminUnderV252Test-2132784612 tempest-HypervisorAdminUnderV252Test-2132784612-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:53.624133 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-41ef1c83-696d-44d6-bac7-c2e678d87303 tempest-HypervisorAdminUnderV252Test-2132784612 tempest-HypervisorAdminUnderV252Test-2132784612-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:53.672415 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1f25199d-4484-43b1-b7ff-4546b535fe67 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/b11f87b9-987d-4c75-9a43-d654ab53de1f" status: 200 len: 2050 microversion: 2.25 time: 0.464187 Oct 18 15:25:53.677171 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 202/414] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:25:53 2022] GET /compute/v2.1/servers/b11f87b9-987d-4c75-9a43-d654ab53de1f => generated 2050 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:25:53.709150 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-41ef1c83-696d-44d6-bac7-c2e678d87303 tempest-HypervisorAdminUnderV252Test-2132784612 tempest-HypervisorAdminUnderV252Test-2132784612-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:53.709640 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-41ef1c83-696d-44d6-bac7-c2e678d87303 tempest-HypervisorAdminUnderV252Test-2132784612 tempest-HypervisorAdminUnderV252Test-2132784612-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:53.711622 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4bbe7542-e3a2-4f58-a137-807cc67b8afd tempest-ServersWithSpecificFlavorTestJSON-1003517087 tempest-ServersWithSpecificFlavorTestJSON-1003517087-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:53.712316 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-41ef1c83-696d-44d6-bac7-c2e678d87303 tempest-HypervisorAdminUnderV252Test-2132784612 tempest-HypervisorAdminUnderV252Test-2132784612-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:53.757666 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4bbe7542-e3a2-4f58-a137-807cc67b8afd tempest-ServersWithSpecificFlavorTestJSON-1003517087 tempest-ServersWithSpecificFlavorTestJSON-1003517087-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.057739 Oct 18 15:25:53.766829 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 203/415] 10.222.0.60 () {58 vars in 1182 bytes} [Tue Oct 18 15:25:53 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:25:53.776140 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-41ef1c83-696d-44d6-bac7-c2e678d87303 tempest-HypervisorAdminUnderV252Test-2132784612 tempest-HypervisorAdminUnderV252Test-2132784612-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:53.777526 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-41ef1c83-696d-44d6-bac7-c2e678d87303 tempest-HypervisorAdminUnderV252Test-2132784612 tempest-HypervisorAdminUnderV252Test-2132784612-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:53.778558 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-41ef1c83-696d-44d6-bac7-c2e678d87303 tempest-HypervisorAdminUnderV252Test-2132784612 tempest-HypervisorAdminUnderV252Test-2132784612-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:53.787093 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2ea3fbdc-bb30-4579-885d-5048bbd0184c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:53.789875 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2ea3fbdc-bb30-4579-885d-5048bbd0184c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: 29ceb840-1b81-4434-841f-a473cded4b73] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:53.807882 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-41ef1c83-696d-44d6-bac7-c2e678d87303 tempest-HypervisorAdminUnderV252Test-2132784612 tempest-HypervisorAdminUnderV252Test-2132784612-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.216519 Oct 18 15:25:53.810813 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 213/416] 10.222.0.60 () {58 vars in 1146 bytes} [Tue Oct 18 15:25:53 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:53.812371 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2ea3fbdc-bb30-4579-885d-5048bbd0184c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:53.813118 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2ea3fbdc-bb30-4579-885d-5048bbd0184c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:53.815946 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2ea3fbdc-bb30-4579-885d-5048bbd0184c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:53.816927 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2ea3fbdc-bb30-4579-885d-5048bbd0184c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:53.817547 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2ea3fbdc-bb30-4579-885d-5048bbd0184c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:53.819354 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2ea3fbdc-bb30-4579-885d-5048bbd0184c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:54.007187 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2ea3fbdc-bb30-4579-885d-5048bbd0184c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:54.023670 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2ea3fbdc-bb30-4579-885d-5048bbd0184c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73" status: 200 len: 1267 microversion: 2.1 time: 0.252696 Oct 18 15:25:54.024464 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 204/417] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:25:53 2022] GET /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73 => generated 1267 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:25:54.046033 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-035dd865-6dda-44e2-a3c6-5a225773a483 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:54.077848 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-035dd865-6dda-44e2-a3c6-5a225773a483 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:54.078513 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-035dd865-6dda-44e2-a3c6-5a225773a483 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:54.079111 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-035dd865-6dda-44e2-a3c6-5a225773a483 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:54.080043 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-035dd865-6dda-44e2-a3c6-5a225773a483 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:54.081083 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-035dd865-6dda-44e2-a3c6-5a225773a483 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:54.081775 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-035dd865-6dda-44e2-a3c6-5a225773a483 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:54.151270 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-035dd865-6dda-44e2-a3c6-5a225773a483 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.125555 Oct 18 15:25:54.158282 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 205/418] 10.222.0.60 () {60 vars in 1217 bytes} [Tue Oct 18 15:25:54 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:25:54.174022 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a43338bf-57bf-42a7-a136-d15663d7596f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d9a1670>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:54.268724 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a43338bf-57bf-42a7-a136-d15663d7596f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/ede050c6-ea2a-474d-a15a-ff210b86a2a8" status: 200 len: 1411 microversion: 2.1 time: 0.106826 Oct 18 15:25:54.273541 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 206/419] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:25:54 2022] GET /compute/v2.1/images/ede050c6-ea2a-474d-a15a-ff210b86a2a8 => generated 1411 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:25:54.278849 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-798109f2-1f15-40f2-9ab8-a34056158e5d tempest-DeleteServersAdminTestJSON-1511257806 tempest-DeleteServersAdminTestJSON-1511257806-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:54.279904 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-798109f2-1f15-40f2-9ab8-a34056158e5d tempest-DeleteServersAdminTestJSON-1511257806 tempest-DeleteServersAdminTestJSON-1511257806-project-admin] [instance: ff014187-bdd4-4211-b796-abf786781dac] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:54.294465 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-798109f2-1f15-40f2-9ab8-a34056158e5d tempest-DeleteServersAdminTestJSON-1511257806 tempest-DeleteServersAdminTestJSON-1511257806-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:54.294958 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-798109f2-1f15-40f2-9ab8-a34056158e5d tempest-DeleteServersAdminTestJSON-1511257806 tempest-DeleteServersAdminTestJSON-1511257806-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:54.295527 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f9fd44fa-ad06-41ca-9b75-92adea3e332a tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Action: 'create', calling method: .version_select at 0x7f7c3da0ad30>, body: {"keypair": {"name": "tempest-keypair-162482596", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ5EU1cTVPFfS/nV2p1WIjTDCzMVEfU3Av8K9uNDqEi6PTWTt8GDrpPk32tePacqy04at4r9Vzw4S6GPN4271/js99XHQqMGWBWrMtdWYcJnWrHuRaMVDglk/MtkmXTPBw=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:54.295651 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-798109f2-1f15-40f2-9ab8-a34056158e5d tempest-DeleteServersAdminTestJSON-1511257806 tempest-DeleteServersAdminTestJSON-1511257806-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:54.296233 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-798109f2-1f15-40f2-9ab8-a34056158e5d tempest-DeleteServersAdminTestJSON-1511257806 tempest-DeleteServersAdminTestJSON-1511257806-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:54.296689 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-798109f2-1f15-40f2-9ab8-a34056158e5d tempest-DeleteServersAdminTestJSON-1511257806 tempest-DeleteServersAdminTestJSON-1511257806-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:54.302713 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-798109f2-1f15-40f2-9ab8-a34056158e5d tempest-DeleteServersAdminTestJSON-1511257806 tempest-DeleteServersAdminTestJSON-1511257806-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:54.364181 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-798109f2-1f15-40f2-9ab8-a34056158e5d tempest-DeleteServersAdminTestJSON-1511257806 tempest-DeleteServersAdminTestJSON-1511257806-project-admin] [instance: ff014187-bdd4-4211-b796-abf786781dac] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:25:54.366733 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-f9fd44fa-ad06-41ca-9b75-92adea3e332a tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Getting quotas for project e6facda3e46640c884583aaf146a8b14. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:25:54.373277 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-f9fd44fa-ad06-41ca-9b75-92adea3e332a tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Getting quotas for user aa2bbb8b77794404af993e8291343afa and project e6facda3e46640c884583aaf146a8b14. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:25:54.414742 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f9fd44fa-ad06-41ca-9b75-92adea3e332a tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.139335 Oct 18 15:25:54.416778 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 207/420] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Oct 18 15:25:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:54.443156 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fc7f3528-9bb4-4d2d-8918-d14e74d0363d tempest-HypervisorAdminUnderV252Test-2132784612 tempest-HypervisorAdminUnderV252Test-2132784612-project-admin] Calling method '.version_select at 0x7f7c3da0dc10>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:54.446647 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc7f3528-9bb4-4d2d-8918-d14e74d0363d tempest-HypervisorAdminUnderV252Test-2132784612 tempest-HypervisorAdminUnderV252Test-2132784612-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:54.449138 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc7f3528-9bb4-4d2d-8918-d14e74d0363d tempest-HypervisorAdminUnderV252Test-2132784612 tempest-HypervisorAdminUnderV252Test-2132784612-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:54.452936 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc7f3528-9bb4-4d2d-8918-d14e74d0363d tempest-HypervisorAdminUnderV252Test-2132784612 tempest-HypervisorAdminUnderV252Test-2132784612-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:54.474249 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc7f3528-9bb4-4d2d-8918-d14e74d0363d tempest-HypervisorAdminUnderV252Test-2132784612 tempest-HypervisorAdminUnderV252Test-2132784612-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:54.475283 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc7f3528-9bb4-4d2d-8918-d14e74d0363d tempest-HypervisorAdminUnderV252Test-2132784612 tempest-HypervisorAdminUnderV252Test-2132784612-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:54.476571 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc7f3528-9bb4-4d2d-8918-d14e74d0363d tempest-HypervisorAdminUnderV252Test-2132784612 tempest-HypervisorAdminUnderV252Test-2132784612-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:54.485149 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fc7f3528-9bb4-4d2d-8918-d14e74d0363d tempest-HypervisorAdminUnderV252Test-2132784612 tempest-HypervisorAdminUnderV252Test-2132784612-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/n-h2-853682-5/search" status: 200 len: 104 microversion: 2.1 time: 0.066809 Oct 18 15:25:54.493454 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 208/421] 10.222.0.60 () {58 vars in 1209 bytes} [Tue Oct 18 15:25:54 2022] GET /compute/v2.1/os-hypervisors/n-h2-853682-5/search => generated 104 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:54.500108 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-40b626f9-6d68-4c38-8b54-ecec538b7ebd tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-853682-5", "block_migration": "auto"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:54.502995 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-40b626f9-6d68-4c38-8b54-ecec538b7ebd tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] [instance: b11f87b9-987d-4c75-9a43-d654ab53de1f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:54.510402 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40b626f9-6d68-4c38-8b54-ecec538b7ebd tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:54.511414 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40b626f9-6d68-4c38-8b54-ecec538b7ebd tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:54.512073 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40b626f9-6d68-4c38-8b54-ecec538b7ebd tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:54.513070 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40b626f9-6d68-4c38-8b54-ecec538b7ebd tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:54.514418 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40b626f9-6d68-4c38-8b54-ecec538b7ebd tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:54.515118 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40b626f9-6d68-4c38-8b54-ecec538b7ebd tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:54.575843 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-40b626f9-6d68-4c38-8b54-ecec538b7ebd tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lazy-loading 'flavor' on Instance uuid b11f87b9-987d-4c75-9a43-d654ab53de1f {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:25:54.602496 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-40b626f9-6d68-4c38-8b54-ecec538b7ebd tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] [instance: b11f87b9-987d-4c75-9a43-d654ab53de1f] Going to try to live migrate instance to n-h2-853682-5 {{(pid=120406) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 18 15:25:54.637439 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:25:54.787947 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-798109f2-1f15-40f2-9ab8-a34056158e5d tempest-DeleteServersAdminTestJSON-1511257806 tempest-DeleteServersAdminTestJSON-1511257806-project-admin] 10.222.0.60 "DELETE /compute/v2.1/servers/ff014187-bdd4-4211-b796-abf786781dac" status: 204 len: 0 microversion: 2.1 time: 0.975693 Oct 18 15:25:54.790409 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 214/422] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:25:53 2022] DELETE /compute/v2.1/servers/ff014187-bdd4-4211-b796-abf786781dac => generated 0 bytes in 979 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:25:54.799959 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1acaa448-591f-42a2-87b8-28647df6cc6e tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:54.801055 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1acaa448-591f-42a2-87b8-28647df6cc6e tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] [instance: ff014187-bdd4-4211-b796-abf786781dac] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:54.817927 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1acaa448-591f-42a2-87b8-28647df6cc6e tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:54.818791 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1acaa448-591f-42a2-87b8-28647df6cc6e tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:54.819349 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1acaa448-591f-42a2-87b8-28647df6cc6e tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:54.820276 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1acaa448-591f-42a2-87b8-28647df6cc6e tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:54.821014 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1acaa448-591f-42a2-87b8-28647df6cc6e tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:54.823597 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1acaa448-591f-42a2-87b8-28647df6cc6e tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:55.299064 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1acaa448-591f-42a2-87b8-28647df6cc6e tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '385ef457207e45b0b843fc2b8ffff7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f40d7ca29449cbb4c2d58df280a01c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:55.309021 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1acaa448-591f-42a2-87b8-28647df6cc6e tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] 10.222.0.60 "GET /compute/v2.1/servers/ff014187-bdd4-4211-b796-abf786781dac" status: 200 len: 1475 microversion: 2.1 time: 0.513049 Oct 18 15:25:55.312680 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 215/423] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:25:54 2022] GET /compute/v2.1/servers/ff014187-bdd4-4211-b796-abf786781dac => generated 1475 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:25:55.322722 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5b17eb0b-9809-4b40-9464-d76dd95fb2ab tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:55.328324 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5b17eb0b-9809-4b40-9464-d76dd95fb2ab tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: 29ceb840-1b81-4434-841f-a473cded4b73] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:55.358666 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5b17eb0b-9809-4b40-9464-d76dd95fb2ab tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:55.364264 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5b17eb0b-9809-4b40-9464-d76dd95fb2ab tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:55.370689 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5b17eb0b-9809-4b40-9464-d76dd95fb2ab tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:55.373304 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5b17eb0b-9809-4b40-9464-d76dd95fb2ab tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:55.381021 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5b17eb0b-9809-4b40-9464-d76dd95fb2ab tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:55.383982 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5b17eb0b-9809-4b40-9464-d76dd95fb2ab tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:55.590763 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5b17eb0b-9809-4b40-9464-d76dd95fb2ab tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:55.599704 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5b17eb0b-9809-4b40-9464-d76dd95fb2ab tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73" status: 200 len: 1267 microversion: 2.1 time: 0.284931 Oct 18 15:25:55.611076 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 216/424] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:25:55 2022] GET /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73 => generated 1267 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:25:55.639909 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4aa0f9bd-0eef-4d4f-bf84-72e522252770 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3db57430>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:55.716347 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4aa0f9bd-0eef-4d4f-bf84-72e522252770 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/ede050c6-ea2a-474d-a15a-ff210b86a2a8" status: 200 len: 1411 microversion: 2.1 time: 0.085563 Oct 18 15:25:55.719187 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 217/425] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:25:55 2022] GET /compute/v2.1/images/ede050c6-ea2a-474d-a15a-ff210b86a2a8 => generated 1411 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:25:56.344666 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c09f8616-cb0e-4a00-8563-04eeef23a0dc tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:56.346359 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c09f8616-cb0e-4a00-8563-04eeef23a0dc tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] [instance: ff014187-bdd4-4211-b796-abf786781dac] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:56.361827 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c09f8616-cb0e-4a00-8563-04eeef23a0dc tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:56.362328 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c09f8616-cb0e-4a00-8563-04eeef23a0dc tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:56.362768 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c09f8616-cb0e-4a00-8563-04eeef23a0dc tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:56.367092 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c09f8616-cb0e-4a00-8563-04eeef23a0dc tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:56.367590 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c09f8616-cb0e-4a00-8563-04eeef23a0dc tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:56.368031 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c09f8616-cb0e-4a00-8563-04eeef23a0dc tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:57.430178 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c09f8616-cb0e-4a00-8563-04eeef23a0dc tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '385ef457207e45b0b843fc2b8ffff7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f40d7ca29449cbb4c2d58df280a01c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:57.443399 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c09f8616-cb0e-4a00-8563-04eeef23a0dc tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] 10.222.0.60 "GET /compute/v2.1/servers/ff014187-bdd4-4211-b796-abf786781dac" status: 200 len: 1475 microversion: 2.1 time: 1.107370 Oct 18 15:25:57.449155 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 218/426] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:25:56 2022] GET /compute/v2.1/servers/ff014187-bdd4-4211-b796-abf786781dac => generated 1475 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:25:57.458297 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b35abce4-3727-422a-b55c-1096164f5a16 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:57.459265 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b35abce4-3727-422a-b55c-1096164f5a16 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: 29ceb840-1b81-4434-841f-a473cded4b73] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:57.491024 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b35abce4-3727-422a-b55c-1096164f5a16 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:57.507323 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b35abce4-3727-422a-b55c-1096164f5a16 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:57.508131 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b35abce4-3727-422a-b55c-1096164f5a16 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:57.510313 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b35abce4-3727-422a-b55c-1096164f5a16 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:57.510902 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b35abce4-3727-422a-b55c-1096164f5a16 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:57.512663 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b35abce4-3727-422a-b55c-1096164f5a16 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:59.279749 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b35abce4-3727-422a-b55c-1096164f5a16 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:59.295245 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b35abce4-3727-422a-b55c-1096164f5a16 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73" status: 200 len: 1309 microversion: 2.1 time: 1.843875 Oct 18 15:25:59.325466 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 219/427] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:25:57 2022] GET /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73 => generated 1309 bytes in 1870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:25:59.366842 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-64ec16f4-3a70-4eca-bd82-b8d92033d438 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3da22ee0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:59.518512 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-64ec16f4-3a70-4eca-bd82-b8d92033d438 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/ede050c6-ea2a-474d-a15a-ff210b86a2a8" status: 200 len: 1411 microversion: 2.1 time: 0.185840 Oct 18 15:25:59.531963 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 220/428] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:25:59 2022] GET /compute/v2.1/images/ede050c6-ea2a-474d-a15a-ff210b86a2a8 => generated 1411 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:25:59.559474 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a0a73d1e-f3bc-494d-b74b-8e4d0d31a661 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:59.561836 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a0a73d1e-f3bc-494d-b74b-8e4d0d31a661 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] [instance: ff014187-bdd4-4211-b796-abf786781dac] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:59.585895 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a0a73d1e-f3bc-494d-b74b-8e4d0d31a661 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:59.588425 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a0a73d1e-f3bc-494d-b74b-8e4d0d31a661 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:59.592279 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a0a73d1e-f3bc-494d-b74b-8e4d0d31a661 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:59.596586 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a0a73d1e-f3bc-494d-b74b-8e4d0d31a661 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:59.600791 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a0a73d1e-f3bc-494d-b74b-8e4d0d31a661 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:59.601803 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a0a73d1e-f3bc-494d-b74b-8e4d0d31a661 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:59.703393 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a0a73d1e-f3bc-494d-b74b-8e4d0d31a661 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:59.709528 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a0a73d1e-f3bc-494d-b74b-8e4d0d31a661 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:59.710213 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a0a73d1e-f3bc-494d-b74b-8e4d0d31a661 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:59.710882 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-a0a73d1e-f3bc-494d-b74b-8e4d0d31a661 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lazy-loading 'fault' on Instance uuid ff014187-bdd4-4211-b796-abf786781dac {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:25:59.811305 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-40b626f9-6d68-4c38-8b54-ecec538b7ebd tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/b11f87b9-987d-4c75-9a43-d654ab53de1f/action" status: 202 len: 0 microversion: 2.25 time: 5.315242 Oct 18 15:25:59.812257 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 209/429] 10.222.0.60 () {62 vars in 1319 bytes} [Tue Oct 18 15:25:54 2022] POST /compute/v2.1/servers/b11f87b9-987d-4c75-9a43-d654ab53de1f/action => generated 0 bytes in 5318 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:25:59.820865 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-c5ef43e6-35b9-4a4b-92fe-cb73234fc4bc req-ef5e5fbb-7f79-4938-bfa1-a6e5f4e44cde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff014187-bdd4-4211-b796-abf786781dac", "name": "network-vif-deleted", "tag": "73471ba6-b94b-4b8b-80a2-6e0c8583c38f"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:59.846431 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:25:59.850798 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a0a73d1e-f3bc-494d-b74b-8e4d0d31a661 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '385ef457207e45b0b843fc2b8ffff7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f40d7ca29449cbb4c2d58df280a01c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:25:59.864798 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a0a73d1e-f3bc-494d-b74b-8e4d0d31a661 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] 10.222.0.60 "GET /compute/v2.1/servers/ff014187-bdd4-4211-b796-abf786781dac" status: 200 len: 1310 microversion: 2.1 time: 0.331106 Oct 18 15:25:59.867444 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 221/430] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:25:59 2022] GET /compute/v2.1/servers/ff014187-bdd4-4211-b796-abf786781dac => generated 1310 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:25:59.884938 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c5ef43e6-35b9-4a4b-92fe-cb73234fc4bc req-ef5e5fbb-7f79-4938-bfa1-a6e5f4e44cde service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:59.887150 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c5ef43e6-35b9-4a4b-92fe-cb73234fc4bc req-ef5e5fbb-7f79-4938-bfa1-a6e5f4e44cde service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:59.890587 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c5ef43e6-35b9-4a4b-92fe-cb73234fc4bc req-ef5e5fbb-7f79-4938-bfa1-a6e5f4e44cde service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:59.894776 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-fb946ac6-bd3a-4120-9018-f960b492088c req-2bbc636d-e8c4-4012-95c4-a736e656d409 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29ceb840-1b81-4434-841f-a473cded4b73", "tag": "1b04f10d-4830-4b9e-b179-bd983eaea7e2"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:25:59.914891 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-fb946ac6-bd3a-4120-9018-f960b492088c req-2bbc636d-e8c4-4012-95c4-a736e656d409 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:59.915379 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-fb946ac6-bd3a-4120-9018-f960b492088c req-2bbc636d-e8c4-4012-95c4-a736e656d409 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:59.915807 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-fb946ac6-bd3a-4120-9018-f960b492088c req-2bbc636d-e8c4-4012-95c4-a736e656d409 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:59.920140 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-c5ef43e6-35b9-4a4b-92fe-cb73234fc4bc req-ef5e5fbb-7f79-4938-bfa1-a6e5f4e44cde service nova] Creating event network-vif-deleted:73471ba6-b94b-4b8b-80a2-6e0c8583c38f for instance ff014187-bdd4-4211-b796-abf786781dac on n-h2-853682-5 Oct 18 15:25:59.928441 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-c5ef43e6-35b9-4a4b-92fe-cb73234fc4bc req-ef5e5fbb-7f79-4938-bfa1-a6e5f4e44cde service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114441 Oct 18 15:25:59.932205 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-fb946ac6-bd3a-4120-9018-f960b492088c req-2bbc636d-e8c4-4012-95c4-a736e656d409 service nova] Creating event network-changed:1b04f10d-4830-4b9e-b179-bd983eaea7e2 for instance 29ceb840-1b81-4434-841f-a473cded4b73 on n-h1-853682-5 Oct 18 15:25:59.932693 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 210/431] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:25:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:59.947202 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b8c297b3-e164-46ed-bdcf-bcdaaf4a7db6 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:25:59.948426 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b8c297b3-e164-46ed-bdcf-bcdaaf4a7db6 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: b11f87b9-987d-4c75-9a43-d654ab53de1f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:25:59.951578 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-fb946ac6-bd3a-4120-9018-f960b492088c req-2bbc636d-e8c4-4012-95c4-a736e656d409 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068192 Oct 18 15:25:59.952784 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 222/432] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:25:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:25:59.989006 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8c297b3-e164-46ed-bdcf-bcdaaf4a7db6 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:59.990029 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8c297b3-e164-46ed-bdcf-bcdaaf4a7db6 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:59.993422 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8c297b3-e164-46ed-bdcf-bcdaaf4a7db6 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:25:59.994649 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8c297b3-e164-46ed-bdcf-bcdaaf4a7db6 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:25:59.996900 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8c297b3-e164-46ed-bdcf-bcdaaf4a7db6 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:25:59.998956 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8c297b3-e164-46ed-bdcf-bcdaaf4a7db6 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:00.325223 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-12194c8c-915a-4077-81ef-cb1675693624 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:00.326732 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-12194c8c-915a-4077-81ef-cb1675693624 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: 29ceb840-1b81-4434-841f-a473cded4b73] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:00.346280 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12194c8c-915a-4077-81ef-cb1675693624 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:00.348241 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12194c8c-915a-4077-81ef-cb1675693624 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:00.348876 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12194c8c-915a-4077-81ef-cb1675693624 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:00.349780 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12194c8c-915a-4077-81ef-cb1675693624 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:00.353422 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12194c8c-915a-4077-81ef-cb1675693624 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:00.354107 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12194c8c-915a-4077-81ef-cb1675693624 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:00.407759 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:26:00.843430 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b8c297b3-e164-46ed-bdcf-bcdaaf4a7db6 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:00.857577 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b8c297b3-e164-46ed-bdcf-bcdaaf4a7db6 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:00.859241 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b8c297b3-e164-46ed-bdcf-bcdaaf4a7db6 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:00.866496 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b8c297b3-e164-46ed-bdcf-bcdaaf4a7db6 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/b11f87b9-987d-4c75-9a43-d654ab53de1f" status: 200 len: 1567 microversion: 2.25 time: 0.932331 Oct 18 15:26:00.867348 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 211/433] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:25:59 2022] GET /compute/v2.1/servers/b11f87b9-987d-4c75-9a43-d654ab53de1f => generated 1567 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:26:00.877489 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-29d49e53-a94b-4963-ab8b-2769bf84abab tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d8675e0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:00.919931 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-12194c8c-915a-4077-81ef-cb1675693624 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:00.928920 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-12194c8c-915a-4077-81ef-cb1675693624 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73" status: 200 len: 1309 microversion: 2.1 time: 0.607972 Oct 18 15:26:00.952294 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 223/434] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:00 2022] GET /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73 => generated 1309 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:00.973563 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-acf401c1-c4e1-4d2e-b557-9dc63c256baf tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:00.974105 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-acf401c1-c4e1-4d2e-b557-9dc63c256baf tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] [instance: ff014187-bdd4-4211-b796-abf786781dac] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:00.988546 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-acf401c1-c4e1-4d2e-b557-9dc63c256baf tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:00.991778 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-acf401c1-c4e1-4d2e-b557-9dc63c256baf tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:00.992383 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-acf401c1-c4e1-4d2e-b557-9dc63c256baf tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:00.993325 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-acf401c1-c4e1-4d2e-b557-9dc63c256baf tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:00.994098 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-acf401c1-c4e1-4d2e-b557-9dc63c256baf tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:00.995628 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-acf401c1-c4e1-4d2e-b557-9dc63c256baf tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:01.013435 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-29d49e53-a94b-4963-ab8b-2769bf84abab tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/ede050c6-ea2a-474d-a15a-ff210b86a2a8" status: 200 len: 1411 microversion: 2.1 time: 0.144656 Oct 18 15:26:01.015315 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 212/435] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:26:00 2022] GET /compute/v2.1/images/ede050c6-ea2a-474d-a15a-ff210b86a2a8 => generated 1411 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:01.032503 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-acf401c1-c4e1-4d2e-b557-9dc63c256baf tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] HTTP exception thrown: Instance ff014187-bdd4-4211-b796-abf786781dac could not be found. Oct 18 15:26:01.037086 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-acf401c1-c4e1-4d2e-b557-9dc63c256baf tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Request method failure captured: Oct 18 15:26:01.037086 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/ff014187-bdd4-4211-b796-abf786781dac HTTP/1.1 Oct 18 15:26:01.037086 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:26:01.037086 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:26:01.037086 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:26:01.037086 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:26:01.037086 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:26:01.037086 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:26:01.037086 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:26:01.037086 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:26:01.037086 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsVdUbJCbKY_grM5TFEpGfQPGW9LeMDi1SGEM6jzV_L8koMCAJezWIVg9hva2cO3ymE-2hLEsDevtR5oqPACQ62BgyHOWJiFAm3LLofM3085KIxxMqdarhu3nTWAH24rL6IsYjb4YKgZWq2eXtkF66Wl7WQWvXeiY3Gl6dA0zUmxgpM Oct 18 15:26:01.037086 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:26:01.037086 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:26:01.037086 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:26:01.037086 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:26:01.037086 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:26:01.037086 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:26:01.037086 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 27f40d7ca29449cbb4c2d58df280a01c Oct 18 15:26:01.037086 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-DeleteServersAdminTestJSON-536887960 Oct 18 15:26:01.037086 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:26:01.037086 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:26:01.038487 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/27f40d7ca29449cbb4c2d58df280a01c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/27f40d7ca29449cbb4c2d58df280a01c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/27f40d7ca29449cbb4c2d58df280a01c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_27f40d7ca29449cbb4c2d58df280a01c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:26:01.038487 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-DeleteServersAdminTestJSON-536887960 Oct 18 15:26:01.038487 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 27f40d7ca29449cbb4c2d58df280a01c Oct 18 15:26:01.038487 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-536887960 Oct 18 15:26:01.038487 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-DeleteServersAdminTestJSON-536887960-project Oct 18 15:26:01.038487 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:26:01.038487 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:26:01.038487 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 385ef457207e45b0b843fc2b8ffff7bb Oct 18 15:26:01.038487 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-DeleteServersAdminTestJSON-536887960-project Oct 18 15:26:01.038487 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:26:01.038487 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance ff014187-bdd4-4211-b796-abf786781dac could not be found. Oct 18 15:26:01.038487 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'ff014187-bdd4-4211-b796-abf786781dac'} Oct 18 15:26:01.039276 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:26:01.039276 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:26:01.039276 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:26:01.039276 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:26:01.039276 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:26:01.039276 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:26:01.039276 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:26:01.039276 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:26:01.039276 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:26:01.039276 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:26:01.039276 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff014187-bdd4-4211-b796-abf786781dac could not be found. Oct 18 15:26:01.039276 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:26:01.039276 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:26:01.039276 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:26:01.039276 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:26:01.039276 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:26:01.039276 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:26:01.039276 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:26:01.039276 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:26:01.039276 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:26:01.040579 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:26:01.040579 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:26:01.040579 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:26:01.040579 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:26:01.040579 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:26:01.040579 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:26:01.040579 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:26:01.040579 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff014187-bdd4-4211-b796-abf786781dac could not be found. Oct 18 15:26:01.040579 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:26:01.040579 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:26:01.040579 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:26:01.040579 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:26:01.040579 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:26:01.040579 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:26:01.040579 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:26:01.040579 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:26:01.040579 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff014187-bdd4-4211-b796-abf786781dac could not be found. Oct 18 15:26:01.040579 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:26:01.042657 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-acf401c1-c4e1-4d2e-b557-9dc63c256baf tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Returning 404 to user: Instance ff014187-bdd4-4211-b796-abf786781dac could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:26:01.046095 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-acf401c1-c4e1-4d2e-b557-9dc63c256baf tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] 10.222.0.60 "GET /compute/v2.1/servers/ff014187-bdd4-4211-b796-abf786781dac" status: 404 len: 111 microversion: 2.1 time: 0.088192 Oct 18 15:26:01.048554 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 224/436] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:00 2022] GET /compute/v2.1/servers/ff014187-bdd4-4211-b796-abf786781dac => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:26:01.177664 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0be7ceb6-367b-4bd1-b396-c3c9b2d014cc tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1389092414", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:01.295536 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-0be7ceb6-367b-4bd1-b396-c3c9b2d014cc tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] validate_networks() for None {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:26:01.752845 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-0be7ceb6-367b-4bd1-b396-c3c9b2d014cc tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:26:01.753411 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-0be7ceb6-367b-4bd1-b396-c3c9b2d014cc tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:26:01.753986 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-0be7ceb6-367b-4bd1-b396-c3c9b2d014cc tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:26:01.754694 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-0be7ceb6-367b-4bd1-b396-c3c9b2d014cc tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:26:01.755820 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-0be7ceb6-367b-4bd1-b396-c3c9b2d014cc tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:26:01.776881 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0be7ceb6-367b-4bd1-b396-c3c9b2d014cc tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:01.777915 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0be7ceb6-367b-4bd1-b396-c3c9b2d014cc tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:01.779209 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0be7ceb6-367b-4bd1-b396-c3c9b2d014cc tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:01.780247 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0be7ceb6-367b-4bd1-b396-c3c9b2d014cc tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:01.780990 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0be7ceb6-367b-4bd1-b396-c3c9b2d014cc tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:01.781766 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0be7ceb6-367b-4bd1-b396-c3c9b2d014cc tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:01.857429 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-0be7ceb6-367b-4bd1-b396-c3c9b2d014cc tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Getting quotas for project 27f40d7ca29449cbb4c2d58df280a01c. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:26:01.868534 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-0be7ceb6-367b-4bd1-b396-c3c9b2d014cc tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Getting quotas for user 385ef457207e45b0b843fc2b8ffff7bb and project 27f40d7ca29449cbb4c2d58df280a01c. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:26:01.897481 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-659f9d43-c3c8-429c-966c-a3f527e82fc9 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:01.898046 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-659f9d43-c3c8-429c-966c-a3f527e82fc9 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: b11f87b9-987d-4c75-9a43-d654ab53de1f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:01.909490 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-659f9d43-c3c8-429c-966c-a3f527e82fc9 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:01.914573 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-659f9d43-c3c8-429c-966c-a3f527e82fc9 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:01.915284 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-659f9d43-c3c8-429c-966c-a3f527e82fc9 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:01.915877 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-659f9d43-c3c8-429c-966c-a3f527e82fc9 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:01.918157 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0be7ceb6-367b-4bd1-b396-c3c9b2d014cc tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:26:01.922474 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0be7ceb6-367b-4bd1-b396-c3c9b2d014cc tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] [instance: 53bb4ff5-ea92-42df-ab9c-4409c6f99dae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:26:01.923227 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-659f9d43-c3c8-429c-966c-a3f527e82fc9 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:01.923707 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-659f9d43-c3c8-429c-966c-a3f527e82fc9 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:02.072007 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0be7ceb6-367b-4bd1-b396-c3c9b2d014cc tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.899015 Oct 18 15:26:02.075454 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 213/437] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:26:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:26:02.091413 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c830c061-3f44-43da-ba05-afc6b62103e7 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-326629398", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "40702943", "adminPass": "***", "networks": [{"uuid": "362d67ce-7667-46f9-8752-c1903dc4553a"}], "security_groups": [{"name": "tempest-securitygroup--728836902"}], "key_name": "tempest-keypair-162482596", "user_data": "}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:02.549362 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-659f9d43-c3c8-429c-966c-a3f527e82fc9 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:02.563825 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-659f9d43-c3c8-429c-966c-a3f527e82fc9 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:02.568157 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-659f9d43-c3c8-429c-966c-a3f527e82fc9 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:02.573481 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-659f9d43-c3c8-429c-966c-a3f527e82fc9 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/b11f87b9-987d-4c75-9a43-d654ab53de1f" status: 200 len: 1567 microversion: 2.25 time: 0.679793 Oct 18 15:26:02.574718 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 225/438] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:26:01 2022] GET /compute/v2.1/servers/b11f87b9-987d-4c75-9a43-d654ab53de1f => generated 1567 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:26:02.579815 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-12249d85-ee38-48f9-a7bf-874b810535d4 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:02.591653 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-12249d85-ee38-48f9-a7bf-874b810535d4 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: 29ceb840-1b81-4434-841f-a473cded4b73] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:02.600263 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12249d85-ee38-48f9-a7bf-874b810535d4 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:02.600763 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12249d85-ee38-48f9-a7bf-874b810535d4 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:02.601240 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12249d85-ee38-48f9-a7bf-874b810535d4 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:02.604589 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12249d85-ee38-48f9-a7bf-874b810535d4 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:02.611437 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12249d85-ee38-48f9-a7bf-874b810535d4 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:02.611948 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12249d85-ee38-48f9-a7bf-874b810535d4 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:02.650754 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-c830c061-3f44-43da-ba05-afc6b62103e7 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] validate_networks() for [('362d67ce-7667-46f9-8752-c1903dc4553a', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:26:02.907764 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=33,nova_cell0:UPDATE=7 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:26:03.358800 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-12249d85-ee38-48f9-a7bf-874b810535d4 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:03.373150 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-12249d85-ee38-48f9-a7bf-874b810535d4 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73" status: 200 len: 1309 microversion: 2.1 time: 0.792854 Oct 18 15:26:03.374227 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 226/439] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:02 2022] GET /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73 => generated 1309 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:03.381030 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-26948f46-8958-4ba2-bdd1-70dd8359a0f4 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3db60550>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:03.485520 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-26948f46-8958-4ba2-bdd1-70dd8359a0f4 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/ede050c6-ea2a-474d-a15a-ff210b86a2a8" status: 200 len: 1411 microversion: 2.1 time: 0.108530 Oct 18 15:26:03.486092 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 227/440] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:26:03 2022] GET /compute/v2.1/images/ede050c6-ea2a-474d-a15a-ff210b86a2a8 => generated 1411 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:03.503620 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7ea53a13-07e9-4c9c-8b41-e7e13799b18a tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:03.520549 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7ea53a13-07e9-4c9c-8b41-e7e13799b18a tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] [instance: 53bb4ff5-ea92-42df-ab9c-4409c6f99dae] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:03.538221 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7ea53a13-07e9-4c9c-8b41-e7e13799b18a tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:03.541200 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7ea53a13-07e9-4c9c-8b41-e7e13799b18a tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:03.541943 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7ea53a13-07e9-4c9c-8b41-e7e13799b18a tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:03.544749 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7ea53a13-07e9-4c9c-8b41-e7e13799b18a tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:03.545420 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7ea53a13-07e9-4c9c-8b41-e7e13799b18a tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:03.547866 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7ea53a13-07e9-4c9c-8b41-e7e13799b18a tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:03.905090 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7ea53a13-07e9-4c9c-8b41-e7e13799b18a tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '385ef457207e45b0b843fc2b8ffff7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f40d7ca29449cbb4c2d58df280a01c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:03.919996 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7ea53a13-07e9-4c9c-8b41-e7e13799b18a tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] 10.222.0.60 "GET /compute/v2.1/servers/53bb4ff5-ea92-42df-ab9c-4409c6f99dae" status: 200 len: 1272 microversion: 2.1 time: 0.432271 Oct 18 15:26:03.937354 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 228/441] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:03 2022] GET /compute/v2.1/servers/53bb4ff5-ea92-42df-ab9c-4409c6f99dae => generated 1272 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:03.954777 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-db9a2cc5-f470-49da-9d4d-40fc4a3e4142 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:03.955693 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-db9a2cc5-f470-49da-9d4d-40fc4a3e4142 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: b11f87b9-987d-4c75-9a43-d654ab53de1f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:03.965404 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-db9a2cc5-f470-49da-9d4d-40fc4a3e4142 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:03.966825 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-db9a2cc5-f470-49da-9d4d-40fc4a3e4142 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:03.977400 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-db9a2cc5-f470-49da-9d4d-40fc4a3e4142 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:03.978779 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-db9a2cc5-f470-49da-9d4d-40fc4a3e4142 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:03.979476 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-db9a2cc5-f470-49da-9d4d-40fc4a3e4142 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:03.980360 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-db9a2cc5-f470-49da-9d4d-40fc4a3e4142 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:04.317144 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-c830c061-3f44-43da-ba05-afc6b62103e7 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:26:04.317654 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-c830c061-3f44-43da-ba05-afc6b62103e7 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:26:04.318030 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-c830c061-3f44-43da-ba05-afc6b62103e7 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:26:04.318634 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-c830c061-3f44-43da-ba05-afc6b62103e7 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:26:04.319206 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-c830c061-3f44-43da-ba05-afc6b62103e7 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:26:04.343612 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c830c061-3f44-43da-ba05-afc6b62103e7 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:04.344668 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c830c061-3f44-43da-ba05-afc6b62103e7 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:04.345316 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c830c061-3f44-43da-ba05-afc6b62103e7 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:04.349836 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c830c061-3f44-43da-ba05-afc6b62103e7 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:04.350596 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c830c061-3f44-43da-ba05-afc6b62103e7 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:04.351191 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c830c061-3f44-43da-ba05-afc6b62103e7 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:04.407345 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-c830c061-3f44-43da-ba05-afc6b62103e7 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Getting quotas for project e6facda3e46640c884583aaf146a8b14. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:26:04.420092 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-c830c061-3f44-43da-ba05-afc6b62103e7 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Getting quotas for user aa2bbb8b77794404af993e8291343afa and project e6facda3e46640c884583aaf146a8b14. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:26:04.444875 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c830c061-3f44-43da-ba05-afc6b62103e7 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:26:04.447818 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c830c061-3f44-43da-ba05-afc6b62103e7 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] [instance: 19061153-9eed-4374-8799-b497b8a8e780] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:26:04.518848 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c830c061-3f44-43da-ba05-afc6b62103e7 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.439350 Oct 18 15:26:04.520627 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 214/442] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:26:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 2444 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:26:04.696554 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-db9a2cc5-f470-49da-9d4d-40fc4a3e4142 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:04.713808 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-db9a2cc5-f470-49da-9d4d-40fc4a3e4142 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:04.718443 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-db9a2cc5-f470-49da-9d4d-40fc4a3e4142 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:04.719722 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-db9a2cc5-f470-49da-9d4d-40fc4a3e4142 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/b11f87b9-987d-4c75-9a43-d654ab53de1f" status: 200 len: 1567 microversion: 2.25 time: 0.781183 Oct 18 15:26:04.733567 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 229/443] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:26:03 2022] GET /compute/v2.1/servers/b11f87b9-987d-4c75-9a43-d654ab53de1f => generated 1567 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:26:04.744039 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0e00c1ee-2ffa-421b-9aa4-8c8245332f6f tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:04.745409 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0e00c1ee-2ffa-421b-9aa4-8c8245332f6f tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: 29ceb840-1b81-4434-841f-a473cded4b73] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:04.772228 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0e00c1ee-2ffa-421b-9aa4-8c8245332f6f tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:04.773905 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0e00c1ee-2ffa-421b-9aa4-8c8245332f6f tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:04.778539 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0e00c1ee-2ffa-421b-9aa4-8c8245332f6f tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:04.783813 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0e00c1ee-2ffa-421b-9aa4-8c8245332f6f tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:04.784587 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0e00c1ee-2ffa-421b-9aa4-8c8245332f6f tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:04.787170 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0e00c1ee-2ffa-421b-9aa4-8c8245332f6f tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:04.810533 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-749d9143-5397-4b81-915c-2714aba9cc81 tempest-InstanceUsageAuditLogTestJSON-2071932080 tempest-InstanceUsageAuditLogTestJSON-2071932080-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:04.854983 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-749d9143-5397-4b81-915c-2714aba9cc81 tempest-InstanceUsageAuditLogTestJSON-2071932080 tempest-InstanceUsageAuditLogTestJSON-2071932080-project-admin] 10.222.0.60 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-18 15:26:04" status: 200 len: 318 microversion: 2.1 time: 0.332776 Oct 18 15:26:04.865308 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 215/444] 10.222.0.60 () {58 vars in 1251 bytes} [Tue Oct 18 15:26:04 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-18%2015%3A26%3A04 => generated 318 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:26:04.881297 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fa2f8862-6ec7-4223-81d3-8b9163aeeb57 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d80b280>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:04.954516 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fa2f8862-6ec7-4223-81d3-8b9163aeeb57 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/ede050c6-ea2a-474d-a15a-ff210b86a2a8" status: 200 len: 1411 microversion: 2.1 time: 0.087994 Oct 18 15:26:04.955636 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 216/445] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:26:04 2022] GET /compute/v2.1/images/ede050c6-ea2a-474d-a15a-ff210b86a2a8 => generated 1411 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:04.991951 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-49449492-7bd4-4e6a-883f-1c242aec1ba7 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:04.991951 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-49449492-7bd4-4e6a-883f-1c242aec1ba7 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] [instance: 19061153-9eed-4374-8799-b497b8a8e780] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:05.156257 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-49449492-7bd4-4e6a-883f-1c242aec1ba7 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2bbb8b77794404af993e8291343afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6facda3e46640c884583aaf146a8b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:05.181462 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-49449492-7bd4-4e6a-883f-1c242aec1ba7 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] 10.222.0.60 "GET /compute/v2.1/servers/19061153-9eed-4374-8799-b497b8a8e780" status: 200 len: 1259 microversion: 2.1 time: 0.223762 Oct 18 15:26:05.201613 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 217/446] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:04 2022] GET /compute/v2.1/servers/19061153-9eed-4374-8799-b497b8a8e780 => generated 1259 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:05.214608 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-a1cfefea-0b59-45c8-9275-99fadee484d8 req-40856779-8d58-4a08-bb1f-f952fc86fc7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b11f87b9-987d-4c75-9a43-d654ab53de1f", "name": "network-vif-unplugged", "status": "completed", "tag": "34c5d0bc-31cd-4b69-9582-e8aea65b728a"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:05.242748 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a1cfefea-0b59-45c8-9275-99fadee484d8 req-40856779-8d58-4a08-bb1f-f952fc86fc7c service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:05.243379 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a1cfefea-0b59-45c8-9275-99fadee484d8 req-40856779-8d58-4a08-bb1f-f952fc86fc7c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:05.248067 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a1cfefea-0b59-45c8-9275-99fadee484d8 req-40856779-8d58-4a08-bb1f-f952fc86fc7c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:05.256136 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0e00c1ee-2ffa-421b-9aa4-8c8245332f6f tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:05.272952 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0e00c1ee-2ffa-421b-9aa4-8c8245332f6f tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73" status: 200 len: 1309 microversion: 2.1 time: 0.537714 Oct 18 15:26:05.285434 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 230/447] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:04 2022] GET /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73 => generated 1309 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:05.303921 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-a1cfefea-0b59-45c8-9275-99fadee484d8 req-40856779-8d58-4a08-bb1f-f952fc86fc7c service nova] Creating event network-vif-unplugged:34c5d0bc-31cd-4b69-9582-e8aea65b728a for instance b11f87b9-987d-4c75-9a43-d654ab53de1f on n-h1-853682-5 Oct 18 15:26:05.313536 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2ac96347-8147-4aaf-ae39-2046758ca0db tempest-InstanceUsageAuditLogTestJSON-2071932080 tempest-InstanceUsageAuditLogTestJSON-2071932080-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:05.332454 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-a1cfefea-0b59-45c8-9275-99fadee484d8 req-40856779-8d58-4a08-bb1f-f952fc86fc7c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.128222 Oct 18 15:26:05.334368 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 218/448] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:26:05.341455 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0f615d6d-1002-498f-8be7-844c7fc12a5f tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:05.342756 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0f615d6d-1002-498f-8be7-844c7fc12a5f tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] [instance: 53bb4ff5-ea92-42df-ab9c-4409c6f99dae] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:05.354095 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f615d6d-1002-498f-8be7-844c7fc12a5f tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:05.354856 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2ac96347-8147-4aaf-ae39-2046758ca0db tempest-InstanceUsageAuditLogTestJSON-2071932080 tempest-InstanceUsageAuditLogTestJSON-2071932080-project-admin] 10.222.0.60 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.060849 Oct 18 15:26:05.355394 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f615d6d-1002-498f-8be7-844c7fc12a5f tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:05.355548 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 231/449] 10.222.0.60 () {58 vars in 1185 bytes} [Tue Oct 18 15:26:05 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:26:05.356329 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f615d6d-1002-498f-8be7-844c7fc12a5f tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:05.357924 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f615d6d-1002-498f-8be7-844c7fc12a5f tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:05.358696 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f615d6d-1002-498f-8be7-844c7fc12a5f tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:05.359352 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f615d6d-1002-498f-8be7-844c7fc12a5f tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:05.749760 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-625de14c-a609-47e7-aa0c-1d55e595ba11 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:05.751379 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-625de14c-a609-47e7-aa0c-1d55e595ba11 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: b11f87b9-987d-4c75-9a43-d654ab53de1f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:05.770688 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-625de14c-a609-47e7-aa0c-1d55e595ba11 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:05.773745 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-625de14c-a609-47e7-aa0c-1d55e595ba11 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:05.775552 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-625de14c-a609-47e7-aa0c-1d55e595ba11 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:05.777725 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-625de14c-a609-47e7-aa0c-1d55e595ba11 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:05.778455 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-625de14c-a609-47e7-aa0c-1d55e595ba11 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:05.782999 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-625de14c-a609-47e7-aa0c-1d55e595ba11 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:05.829917 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:26:06.265662 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0f615d6d-1002-498f-8be7-844c7fc12a5f tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '385ef457207e45b0b843fc2b8ffff7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f40d7ca29449cbb4c2d58df280a01c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:06.277393 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0f615d6d-1002-498f-8be7-844c7fc12a5f tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] 10.222.0.60 "GET /compute/v2.1/servers/53bb4ff5-ea92-42df-ab9c-4409c6f99dae" status: 200 len: 1278 microversion: 2.1 time: 0.941165 Oct 18 15:26:06.281123 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 219/450] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:05 2022] GET /compute/v2.1/servers/53bb4ff5-ea92-42df-ab9c-4409c6f99dae => generated 1278 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:06.291045 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4fce84b5-4255-4893-b734-2d9f9971e640 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d819310>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:06.412718 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4fce84b5-4255-4893-b734-2d9f9971e640 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/ede050c6-ea2a-474d-a15a-ff210b86a2a8" status: 200 len: 1411 microversion: 2.1 time: 0.129658 Oct 18 15:26:06.416120 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 220/451] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:26:06 2022] GET /compute/v2.1/images/ede050c6-ea2a-474d-a15a-ff210b86a2a8 => generated 1411 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:06.430348 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-18a56231-63a9-40ae-b2a6-6fc77a79de24 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:06.433655 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-18a56231-63a9-40ae-b2a6-6fc77a79de24 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] [instance: 19061153-9eed-4374-8799-b497b8a8e780] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:06.451229 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18a56231-63a9-40ae-b2a6-6fc77a79de24 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:06.452543 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18a56231-63a9-40ae-b2a6-6fc77a79de24 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:06.457074 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18a56231-63a9-40ae-b2a6-6fc77a79de24 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:06.458495 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18a56231-63a9-40ae-b2a6-6fc77a79de24 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:06.476174 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18a56231-63a9-40ae-b2a6-6fc77a79de24 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:06.476991 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18a56231-63a9-40ae-b2a6-6fc77a79de24 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:06.574184 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-625de14c-a609-47e7-aa0c-1d55e595ba11 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:06.590490 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-625de14c-a609-47e7-aa0c-1d55e595ba11 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:06.591994 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-625de14c-a609-47e7-aa0c-1d55e595ba11 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:06.593195 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-625de14c-a609-47e7-aa0c-1d55e595ba11 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/b11f87b9-987d-4c75-9a43-d654ab53de1f" status: 200 len: 1567 microversion: 2.25 time: 0.849108 Oct 18 15:26:06.593759 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 232/452] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:26:05 2022] GET /compute/v2.1/servers/b11f87b9-987d-4c75-9a43-d654ab53de1f => generated 1567 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:26:06.614125 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c12c8889-9e9b-421d-826c-592a3149db9d tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:06.614741 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c12c8889-9e9b-421d-826c-592a3149db9d tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: 29ceb840-1b81-4434-841f-a473cded4b73] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:06.642788 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c12c8889-9e9b-421d-826c-592a3149db9d tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:06.643280 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c12c8889-9e9b-421d-826c-592a3149db9d tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:06.643717 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c12c8889-9e9b-421d-826c-592a3149db9d tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:06.644421 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c12c8889-9e9b-421d-826c-592a3149db9d tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:06.644910 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c12c8889-9e9b-421d-826c-592a3149db9d tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:06.645437 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c12c8889-9e9b-421d-826c-592a3149db9d tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:06.672411 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-18a56231-63a9-40ae-b2a6-6fc77a79de24 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2bbb8b77794404af993e8291343afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6facda3e46640c884583aaf146a8b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:06.691061 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-18a56231-63a9-40ae-b2a6-6fc77a79de24 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] 10.222.0.60 "GET /compute/v2.1/servers/19061153-9eed-4374-8799-b497b8a8e780" status: 200 len: 1311 microversion: 2.1 time: 0.266149 Oct 18 15:26:06.714045 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 221/453] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:06 2022] GET /compute/v2.1/servers/19061153-9eed-4374-8799-b497b8a8e780 => generated 1311 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:06.983446 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c12c8889-9e9b-421d-826c-592a3149db9d tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:07.003609 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c12c8889-9e9b-421d-826c-592a3149db9d tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73" status: 200 len: 1309 microversion: 2.1 time: 0.408781 Oct 18 15:26:07.004459 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 233/454] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:06 2022] GET /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73 => generated 1309 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:07.308315 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6ae6fed1-976e-4fd4-a147-312be9789bcf tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:07.309155 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6ae6fed1-976e-4fd4-a147-312be9789bcf tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] [instance: 53bb4ff5-ea92-42df-ab9c-4409c6f99dae] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:07.321741 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ae6fed1-976e-4fd4-a147-312be9789bcf tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:07.322904 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ae6fed1-976e-4fd4-a147-312be9789bcf tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:07.324651 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ae6fed1-976e-4fd4-a147-312be9789bcf tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:07.326064 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ae6fed1-976e-4fd4-a147-312be9789bcf tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:07.327799 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ae6fed1-976e-4fd4-a147-312be9789bcf tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:07.328681 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ae6fed1-976e-4fd4-a147-312be9789bcf tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:07.432436 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ec44cdd3-668a-44ed-85bd-7d32e8064c3c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d9c6550>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:07.518630 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ec44cdd3-668a-44ed-85bd-7d32e8064c3c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/ede050c6-ea2a-474d-a15a-ff210b86a2a8" status: 200 len: 1411 microversion: 2.1 time: 0.091115 Oct 18 15:26:07.519221 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 234/455] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:26:07 2022] GET /compute/v2.1/images/ede050c6-ea2a-474d-a15a-ff210b86a2a8 => generated 1411 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:26:07.576331 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6ae6fed1-976e-4fd4-a147-312be9789bcf tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '385ef457207e45b0b843fc2b8ffff7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f40d7ca29449cbb4c2d58df280a01c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:07.585666 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6ae6fed1-976e-4fd4-a147-312be9789bcf tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] 10.222.0.60 "GET /compute/v2.1/servers/53bb4ff5-ea92-42df-ab9c-4409c6f99dae" status: 200 len: 1278 microversion: 2.1 time: 0.282317 Oct 18 15:26:07.589888 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 222/456] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:07 2022] GET /compute/v2.1/servers/53bb4ff5-ea92-42df-ab9c-4409c6f99dae => generated 1278 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:07.620071 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-febc4a0b-026c-45d9-9e9d-af6f19805e96 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:07.622616 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-febc4a0b-026c-45d9-9e9d-af6f19805e96 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: b11f87b9-987d-4c75-9a43-d654ab53de1f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:07.634593 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-febc4a0b-026c-45d9-9e9d-af6f19805e96 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:07.635310 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-febc4a0b-026c-45d9-9e9d-af6f19805e96 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:07.635960 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-febc4a0b-026c-45d9-9e9d-af6f19805e96 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:07.638469 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-febc4a0b-026c-45d9-9e9d-af6f19805e96 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:07.638963 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-febc4a0b-026c-45d9-9e9d-af6f19805e96 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:07.639403 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-febc4a0b-026c-45d9-9e9d-af6f19805e96 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:07.723400 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4530eee8-9632-4d96-8d0c-4eb358b80324 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:07.724306 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4530eee8-9632-4d96-8d0c-4eb358b80324 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] [instance: 19061153-9eed-4374-8799-b497b8a8e780] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:07.739122 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4530eee8-9632-4d96-8d0c-4eb358b80324 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:07.739754 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4530eee8-9632-4d96-8d0c-4eb358b80324 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:07.740275 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4530eee8-9632-4d96-8d0c-4eb358b80324 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:07.741280 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4530eee8-9632-4d96-8d0c-4eb358b80324 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:07.749996 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4530eee8-9632-4d96-8d0c-4eb358b80324 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:07.753160 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4530eee8-9632-4d96-8d0c-4eb358b80324 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:07.940456 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4530eee8-9632-4d96-8d0c-4eb358b80324 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2bbb8b77794404af993e8291343afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6facda3e46640c884583aaf146a8b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:07.951568 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4530eee8-9632-4d96-8d0c-4eb358b80324 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] 10.222.0.60 "GET /compute/v2.1/servers/19061153-9eed-4374-8799-b497b8a8e780" status: 200 len: 1317 microversion: 2.1 time: 0.231802 Oct 18 15:26:07.957626 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 223/457] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:07 2022] GET /compute/v2.1/servers/19061153-9eed-4374-8799-b497b8a8e780 => generated 1317 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:08.030933 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4ab923e3-0492-4a0e-a070-aae20fab72ca tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:08.031684 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4ab923e3-0492-4a0e-a070-aae20fab72ca tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: 29ceb840-1b81-4434-841f-a473cded4b73] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:08.041247 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ab923e3-0492-4a0e-a070-aae20fab72ca tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:08.042936 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ab923e3-0492-4a0e-a070-aae20fab72ca tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:08.044395 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ab923e3-0492-4a0e-a070-aae20fab72ca tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:08.047367 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ab923e3-0492-4a0e-a070-aae20fab72ca tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:08.048108 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ab923e3-0492-4a0e-a070-aae20fab72ca tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:08.048887 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ab923e3-0492-4a0e-a070-aae20fab72ca tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:08.191197 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-febc4a0b-026c-45d9-9e9d-af6f19805e96 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:08.203473 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-febc4a0b-026c-45d9-9e9d-af6f19805e96 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:08.208835 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-febc4a0b-026c-45d9-9e9d-af6f19805e96 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:08.214047 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-febc4a0b-026c-45d9-9e9d-af6f19805e96 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/b11f87b9-987d-4c75-9a43-d654ab53de1f" status: 200 len: 1567 microversion: 2.25 time: 0.596716 Oct 18 15:26:08.231282 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 235/458] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:26:07 2022] GET /compute/v2.1/servers/b11f87b9-987d-4c75-9a43-d654ab53de1f => generated 1567 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:26:08.252213 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-c6d4ee37-caad-42cd-a43e-a933583be45c req-f471936e-6686-41fa-9006-c79c9db36f8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b11f87b9-987d-4c75-9a43-d654ab53de1f", "tag": "34c5d0bc-31cd-4b69-9582-e8aea65b728a"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:08.279593 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-c6d4ee37-caad-42cd-a43e-a933583be45c req-f471936e-6686-41fa-9006-c79c9db36f8c service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:08.280265 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-c6d4ee37-caad-42cd-a43e-a933583be45c req-f471936e-6686-41fa-9006-c79c9db36f8c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:08.280715 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-c6d4ee37-caad-42cd-a43e-a933583be45c req-f471936e-6686-41fa-9006-c79c9db36f8c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:08.313558 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-c6d4ee37-caad-42cd-a43e-a933583be45c req-f471936e-6686-41fa-9006-c79c9db36f8c service nova] Creating event network-changed:34c5d0bc-31cd-4b69-9582-e8aea65b728a for instance b11f87b9-987d-4c75-9a43-d654ab53de1f on n-h1-853682-5 Oct 18 15:26:08.328621 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-c6d4ee37-caad-42cd-a43e-a933583be45c req-f471936e-6686-41fa-9006-c79c9db36f8c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095398 Oct 18 15:26:08.331333 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 236/459] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:26:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:26:08.535963 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d8317c94-36cc-4fd6-aa95-904438602f45 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3da22a60>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:08.628526 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d8317c94-36cc-4fd6-aa95-904438602f45 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/ede050c6-ea2a-474d-a15a-ff210b86a2a8" status: 200 len: 1411 microversion: 2.1 time: 0.097712 Oct 18 15:26:08.641703 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 237/460] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:26:08 2022] GET /compute/v2.1/images/ede050c6-ea2a-474d-a15a-ff210b86a2a8 => generated 1411 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:26:08.860409 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4ab923e3-0492-4a0e-a070-aae20fab72ca tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:08.894876 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4ab923e3-0492-4a0e-a070-aae20fab72ca tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73" status: 200 len: 1309 microversion: 2.1 time: 0.862323 Oct 18 15:26:08.921783 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 224/461] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:08 2022] GET /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73 => generated 1309 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:26:08.967024 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b47afdb7-3687-4de6-be8e-dfe49c78f6fc tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:08.967823 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b47afdb7-3687-4de6-be8e-dfe49c78f6fc tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] [instance: 53bb4ff5-ea92-42df-ab9c-4409c6f99dae] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:08.985923 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b47afdb7-3687-4de6-be8e-dfe49c78f6fc tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:08.986442 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b47afdb7-3687-4de6-be8e-dfe49c78f6fc tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:08.986869 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b47afdb7-3687-4de6-be8e-dfe49c78f6fc tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:08.987655 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b47afdb7-3687-4de6-be8e-dfe49c78f6fc tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:08.988149 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b47afdb7-3687-4de6-be8e-dfe49c78f6fc tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:08.988548 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b47afdb7-3687-4de6-be8e-dfe49c78f6fc tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:09.007224 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-50a108c5-b608-47b4-bbd5-3afee85f3735 tempest-SecurityGroupsTestAdminJSON-1254180834 tempest-SecurityGroupsTestAdminJSON-1254180834-project] Action: 'create', calling method: .version_select at 0x7f7c3d9c63a0>, body: {"security_group": {"name": "tempest-securitygroup-1304227659", "description": "tempest-description-930288356"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:09.618834 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b47afdb7-3687-4de6-be8e-dfe49c78f6fc tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '385ef457207e45b0b843fc2b8ffff7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f40d7ca29449cbb4c2d58df280a01c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:09.629492 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b47afdb7-3687-4de6-be8e-dfe49c78f6fc tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] 10.222.0.60 "GET /compute/v2.1/servers/53bb4ff5-ea92-42df-ab9c-4409c6f99dae" status: 200 len: 1320 microversion: 2.1 time: 0.688480 Oct 18 15:26:09.633561 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 225/462] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:08 2022] GET /compute/v2.1/servers/53bb4ff5-ea92-42df-ab9c-4409c6f99dae => generated 1320 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:09.655628 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3d2459e0-d3f4-42f9-befe-69b84b4811dc tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:09.656623 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3d2459e0-d3f4-42f9-befe-69b84b4811dc tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] [instance: 19061153-9eed-4374-8799-b497b8a8e780] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:09.663144 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d2459e0-d3f4-42f9-befe-69b84b4811dc tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:09.663953 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d2459e0-d3f4-42f9-befe-69b84b4811dc tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:09.664598 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d2459e0-d3f4-42f9-befe-69b84b4811dc tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:09.665798 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d2459e0-d3f4-42f9-befe-69b84b4811dc tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:09.666453 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d2459e0-d3f4-42f9-befe-69b84b4811dc tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:09.669610 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d2459e0-d3f4-42f9-befe-69b84b4811dc tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:10.303521 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3d2459e0-d3f4-42f9-befe-69b84b4811dc tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2bbb8b77794404af993e8291343afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6facda3e46640c884583aaf146a8b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:10.319343 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3d2459e0-d3f4-42f9-befe-69b84b4811dc tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] 10.222.0.60 "GET /compute/v2.1/servers/19061153-9eed-4374-8799-b497b8a8e780" status: 200 len: 1384 microversion: 2.1 time: 0.684461 Oct 18 15:26:10.320225 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 226/463] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:09 2022] GET /compute/v2.1/servers/19061153-9eed-4374-8799-b497b8a8e780 => generated 1384 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:10.325568 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b8832b09-a0eb-4e73-9e27-3daa1da2fc0f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:10.339359 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b8832b09-a0eb-4e73-9e27-3daa1da2fc0f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: b11f87b9-987d-4c75-9a43-d654ab53de1f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:10.375037 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8832b09-a0eb-4e73-9e27-3daa1da2fc0f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:10.378783 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8832b09-a0eb-4e73-9e27-3daa1da2fc0f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:10.387946 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8832b09-a0eb-4e73-9e27-3daa1da2fc0f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:10.389772 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8832b09-a0eb-4e73-9e27-3daa1da2fc0f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:10.390662 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8832b09-a0eb-4e73-9e27-3daa1da2fc0f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:10.391250 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8832b09-a0eb-4e73-9e27-3daa1da2fc0f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:10.930166 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b8832b09-a0eb-4e73-9e27-3daa1da2fc0f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:10.942471 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b8832b09-a0eb-4e73-9e27-3daa1da2fc0f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:10.945693 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b8832b09-a0eb-4e73-9e27-3daa1da2fc0f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:10.946885 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b8832b09-a0eb-4e73-9e27-3daa1da2fc0f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/b11f87b9-987d-4c75-9a43-d654ab53de1f" status: 200 len: 1567 microversion: 2.25 time: 0.625511 Oct 18 15:26:10.947439 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 227/464] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:26:10 2022] GET /compute/v2.1/servers/b11f87b9-987d-4c75-9a43-d654ab53de1f => generated 1567 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:26:10.963707 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ae714195-eee9-4b6b-a98b-9b95c841b62c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d80b8b0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:11.040693 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ae714195-eee9-4b6b-a98b-9b95c841b62c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/ede050c6-ea2a-474d-a15a-ff210b86a2a8" status: 200 len: 1411 microversion: 2.1 time: 0.086951 Oct 18 15:26:11.041835 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 228/465] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:26:10 2022] GET /compute/v2.1/images/ede050c6-ea2a-474d-a15a-ff210b86a2a8 => generated 1411 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:11.052516 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-52070a1d-a6aa-4cfb-bdf4-275dcf96c2e3 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:11.053408 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-52070a1d-a6aa-4cfb-bdf4-275dcf96c2e3 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: 29ceb840-1b81-4434-841f-a473cded4b73] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:11.069465 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52070a1d-a6aa-4cfb-bdf4-275dcf96c2e3 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:11.070205 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52070a1d-a6aa-4cfb-bdf4-275dcf96c2e3 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:11.070790 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52070a1d-a6aa-4cfb-bdf4-275dcf96c2e3 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:11.071644 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52070a1d-a6aa-4cfb-bdf4-275dcf96c2e3 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:11.072240 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52070a1d-a6aa-4cfb-bdf4-275dcf96c2e3 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:11.073252 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52070a1d-a6aa-4cfb-bdf4-275dcf96c2e3 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:11.514702 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-50a108c5-b608-47b4-bbd5-3afee85f3735 tempest-SecurityGroupsTestAdminJSON-1254180834 tempest-SecurityGroupsTestAdminJSON-1254180834-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 2.871619 Oct 18 15:26:11.516576 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 238/466] 10.222.0.60 () {60 vars in 1180 bytes} [Tue Oct 18 15:26:08 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 2874 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:26:11.521354 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-5dcd5c69-c0f6-4cbd-a579-424525ecf9d8 req-be278363-cbf4-4571-821f-0116e2c7c736 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29ceb840-1b81-4434-841f-a473cded4b73", "name": "network-vif-plugged", "status": "completed", "tag": "1b04f10d-4830-4b9e-b179-bd983eaea7e2"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:11.549011 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-5dcd5c69-c0f6-4cbd-a579-424525ecf9d8 req-be278363-cbf4-4571-821f-0116e2c7c736 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:11.553291 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-5dcd5c69-c0f6-4cbd-a579-424525ecf9d8 req-be278363-cbf4-4571-821f-0116e2c7c736 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:11.554010 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-5dcd5c69-c0f6-4cbd-a579-424525ecf9d8 req-be278363-cbf4-4571-821f-0116e2c7c736 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:11.574969 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-5dcd5c69-c0f6-4cbd-a579-424525ecf9d8 req-be278363-cbf4-4571-821f-0116e2c7c736 service nova] Creating event network-vif-plugged:1b04f10d-4830-4b9e-b179-bd983eaea7e2 for instance 29ceb840-1b81-4434-841f-a473cded4b73 on n-h1-853682-5 Oct 18 15:26:11.584443 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-5dcd5c69-c0f6-4cbd-a579-424525ecf9d8 req-be278363-cbf4-4571-821f-0116e2c7c736 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066455 Oct 18 15:26:11.585088 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 239/467] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:26:11.593733 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-224997ae-554a-4199-a52d-3731a967c842 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:11.594598 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-224997ae-554a-4199-a52d-3731a967c842 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] [instance: 53bb4ff5-ea92-42df-ab9c-4409c6f99dae] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:11.596763 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:UPDATE=10,nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:26:11.602503 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-224997ae-554a-4199-a52d-3731a967c842 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:11.603216 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-224997ae-554a-4199-a52d-3731a967c842 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:11.603812 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-224997ae-554a-4199-a52d-3731a967c842 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:11.604676 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-224997ae-554a-4199-a52d-3731a967c842 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:11.605319 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-224997ae-554a-4199-a52d-3731a967c842 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:11.605906 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-224997ae-554a-4199-a52d-3731a967c842 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:11.805040 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-52070a1d-a6aa-4cfb-bdf4-275dcf96c2e3 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:11.817857 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-52070a1d-a6aa-4cfb-bdf4-275dcf96c2e3 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73" status: 200 len: 1309 microversion: 2.1 time: 0.774717 Oct 18 15:26:11.839116 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 229/468] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:11 2022] GET /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73 => generated 1309 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:11.845190 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-9c95cfa3-4661-441e-9c50-f826a9814995 req-4610b90c-82fb-43a6-953d-98eb29d7041d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53bb4ff5-ea92-42df-ab9c-4409c6f99dae", "tag": "0ae67927-c3c7-442e-8482-14b2626c726b"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:11.859425 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9c95cfa3-4661-441e-9c50-f826a9814995 req-4610b90c-82fb-43a6-953d-98eb29d7041d service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:11.860117 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9c95cfa3-4661-441e-9c50-f826a9814995 req-4610b90c-82fb-43a6-953d-98eb29d7041d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:11.860620 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9c95cfa3-4661-441e-9c50-f826a9814995 req-4610b90c-82fb-43a6-953d-98eb29d7041d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:11.876080 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-9c95cfa3-4661-441e-9c50-f826a9814995 req-4610b90c-82fb-43a6-953d-98eb29d7041d service nova] Creating event network-changed:0ae67927-c3c7-442e-8482-14b2626c726b for instance 53bb4ff5-ea92-42df-ab9c-4409c6f99dae on n-h2-853682-5 Oct 18 15:26:11.884051 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-9c95cfa3-4661-441e-9c50-f826a9814995 req-4610b90c-82fb-43a6-953d-98eb29d7041d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043537 Oct 18 15:26:11.885262 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 230/469] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:26:11.891091 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-724f0b9e-8601-41fc-8200-7ae1de3bdb9b tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:11.891954 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-724f0b9e-8601-41fc-8200-7ae1de3bdb9b tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] [instance: 19061153-9eed-4374-8799-b497b8a8e780] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:11.900245 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-724f0b9e-8601-41fc-8200-7ae1de3bdb9b tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:11.900960 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-724f0b9e-8601-41fc-8200-7ae1de3bdb9b tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:11.901426 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-724f0b9e-8601-41fc-8200-7ae1de3bdb9b tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:11.902121 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-724f0b9e-8601-41fc-8200-7ae1de3bdb9b tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:11.902562 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-724f0b9e-8601-41fc-8200-7ae1de3bdb9b tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:11.903897 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-724f0b9e-8601-41fc-8200-7ae1de3bdb9b tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:12.016124 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-224997ae-554a-4199-a52d-3731a967c842 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '385ef457207e45b0b843fc2b8ffff7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f40d7ca29449cbb4c2d58df280a01c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:12.023896 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-224997ae-554a-4199-a52d-3731a967c842 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] 10.222.0.60 "GET /compute/v2.1/servers/53bb4ff5-ea92-42df-ab9c-4409c6f99dae" status: 200 len: 1320 microversion: 2.1 time: 0.437485 Oct 18 15:26:12.024866 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 240/470] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:11 2022] GET /compute/v2.1/servers/53bb4ff5-ea92-42df-ab9c-4409c6f99dae => generated 1320 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:12.030707 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8ddf8a48-1c43-4fc1-93db-13fee5f1388a tempest-SecurityGroupsTestAdminJSON-1254180834 tempest-SecurityGroupsTestAdminJSON-1254180834-project] Action: 'create', calling method: .version_select at 0x7f7c3da22940>, body: {"security_group": {"name": "tempest-securitygroup-902528510", "description": "tempest-description-592945637"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:12.570554 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-724f0b9e-8601-41fc-8200-7ae1de3bdb9b tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2bbb8b77794404af993e8291343afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6facda3e46640c884583aaf146a8b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:12.581493 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-724f0b9e-8601-41fc-8200-7ae1de3bdb9b tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] 10.222.0.60 "GET /compute/v2.1/servers/19061153-9eed-4374-8799-b497b8a8e780" status: 200 len: 1384 microversion: 2.1 time: 0.695015 Oct 18 15:26:12.593092 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 231/471] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:11 2022] GET /compute/v2.1/servers/19061153-9eed-4374-8799-b497b8a8e780 => generated 1384 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:12.602394 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3762d40d-1150-4ec1-8db0-cf19b52188b7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:12.603403 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3762d40d-1150-4ec1-8db0-cf19b52188b7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: b11f87b9-987d-4c75-9a43-d654ab53de1f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:12.610155 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3762d40d-1150-4ec1-8db0-cf19b52188b7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:12.610727 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3762d40d-1150-4ec1-8db0-cf19b52188b7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:12.611907 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3762d40d-1150-4ec1-8db0-cf19b52188b7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:12.612706 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3762d40d-1150-4ec1-8db0-cf19b52188b7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:12.613369 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3762d40d-1150-4ec1-8db0-cf19b52188b7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:12.613867 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3762d40d-1150-4ec1-8db0-cf19b52188b7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:12.817411 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8ddf8a48-1c43-4fc1-93db-13fee5f1388a tempest-SecurityGroupsTestAdminJSON-1254180834 tempest-SecurityGroupsTestAdminJSON-1254180834-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.790727 Oct 18 15:26:12.828030 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 241/472] 10.222.0.60 () {60 vars in 1180 bytes} [Tue Oct 18 15:26:12 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:26:12.833436 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ea527cc1-4dfe-4bd1-8525-836975a8c861 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3db60700>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:12.891411 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ea527cc1-4dfe-4bd1-8525-836975a8c861 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/ede050c6-ea2a-474d-a15a-ff210b86a2a8" status: 200 len: 1420 microversion: 2.1 time: 0.061324 Oct 18 15:26:12.892092 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 242/473] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:26:12 2022] GET /compute/v2.1/images/ede050c6-ea2a-474d-a15a-ff210b86a2a8 => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:12.897145 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1e33e890-a7a7-42b9-8cb9-3a81cb5304e9 tempest-ImagesMetadataTestJSON-74470835 tempest-ImagesMetadataTestJSON-74470835-project] Calling method '.version_select at 0x7f7c3d9c6820>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:12.942979 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1e33e890-a7a7-42b9-8cb9-3a81cb5304e9 tempest-ImagesMetadataTestJSON-74470835 tempest-ImagesMetadataTestJSON-74470835-project] 10.222.0.60 "GET /compute/v2.1/images/517dc486-620f-48c0-a147-208ee87b88ce" status: 200 len: 637 microversion: 2.1 time: 0.049103 Oct 18 15:26:12.943632 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 243/474] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:26:12 2022] GET /compute/v2.1/images/517dc486-620f-48c0-a147-208ee87b88ce => generated 637 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:26:12.956942 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3762d40d-1150-4ec1-8db0-cf19b52188b7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:12.971494 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3762d40d-1150-4ec1-8db0-cf19b52188b7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:12.974699 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3762d40d-1150-4ec1-8db0-cf19b52188b7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:12.975916 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3762d40d-1150-4ec1-8db0-cf19b52188b7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/b11f87b9-987d-4c75-9a43-d654ab53de1f" status: 200 len: 1567 microversion: 2.25 time: 0.392220 Oct 18 15:26:12.976510 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 232/475] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:26:12 2022] GET /compute/v2.1/servers/b11f87b9-987d-4c75-9a43-d654ab53de1f => generated 1567 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:26:13.096707 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b42dd926-9879-405a-aa5e-6a2931c54da3 tempest-KeyPairsV210TestJSON-544916316 tempest-KeyPairsV210TestJSON-544916316-project-admin] Action: 'create', calling method: .version_select at 0x7f7c3da22d30>, body: {"keypair": {"name": "tempest-keypair-1382566659", "type": "ssh", "user_id": "792f7df7f92a426c8f8aeb169c5bce89", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBOs0gPWJYbsqqpTMPZMKBXNEDK5DS6A/tDK5IbOEdLZ0b/6P1lAZ5yekZ51elylboWSvIbVM/CaI2vV1lLLo3GRvLmqpB9D17aviiyzRsQX39QV5QvaYV404oJ56I/K2Q=="}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:13.132000 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-b42dd926-9879-405a-aa5e-6a2931c54da3 tempest-KeyPairsV210TestJSON-544916316 tempest-KeyPairsV210TestJSON-544916316-project-admin] Getting quotas for project 54c65fa1406641a4bf4279a61c6ebf13. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:26:13.138705 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-b42dd926-9879-405a-aa5e-6a2931c54da3 tempest-KeyPairsV210TestJSON-544916316 tempest-KeyPairsV210TestJSON-544916316-project-admin] Getting quotas for user 9ac0f6cd339344b2b398e87e613d9371 and project 54c65fa1406641a4bf4279a61c6ebf13. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:26:13.182325 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b42dd926-9879-405a-aa5e-6a2931c54da3 tempest-KeyPairsV210TestJSON-544916316 tempest-KeyPairsV210TestJSON-544916316-project-admin] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.236068 Oct 18 15:26:13.185085 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 244/476] 10.222.0.60 () {62 vars in 1200 bytes} [Tue Oct 18 15:26:12 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 241 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 18 15:26:13.203836 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-739f1ff3-6dc8-4a0c-8ffd-06e02ee73b62 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:13.208737 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-739f1ff3-6dc8-4a0c-8ffd-06e02ee73b62 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: 29ceb840-1b81-4434-841f-a473cded4b73] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:13.222371 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-739f1ff3-6dc8-4a0c-8ffd-06e02ee73b62 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:13.222866 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-739f1ff3-6dc8-4a0c-8ffd-06e02ee73b62 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:13.225388 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-739f1ff3-6dc8-4a0c-8ffd-06e02ee73b62 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:13.226135 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-739f1ff3-6dc8-4a0c-8ffd-06e02ee73b62 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:13.226606 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-739f1ff3-6dc8-4a0c-8ffd-06e02ee73b62 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:13.227144 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-739f1ff3-6dc8-4a0c-8ffd-06e02ee73b62 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:13.298464 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2645362d-fb88-4c02-8a57-fa46d02bed34 tempest-SecurityGroupsTestAdminJSON-1497158442 tempest-SecurityGroupsTestAdminJSON-1497158442-project-admin] Action: 'create', calling method: .version_select at 0x7f7c3da04d30>, body: {"security_group": {"name": "tempest-securitygroup-1521048131", "description": "tempest-description-1500307749"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:13.577319 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-739f1ff3-6dc8-4a0c-8ffd-06e02ee73b62 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:13.586626 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-739f1ff3-6dc8-4a0c-8ffd-06e02ee73b62 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73" status: 200 len: 1492 microversion: 2.1 time: 0.399642 Oct 18 15:26:13.587472 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 245/477] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:13 2022] GET /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73 => generated 1492 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:13.592765 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a0eb8569-5984-496b-a830-bdddc5910cf1 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3db600d0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:13.650187 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a0eb8569-5984-496b-a830-bdddc5910cf1 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/ede050c6-ea2a-474d-a15a-ff210b86a2a8" status: 200 len: 1420 microversion: 2.1 time: 0.061473 Oct 18 15:26:13.650764 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 246/478] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:26:13 2022] GET /compute/v2.1/images/ede050c6-ea2a-474d-a15a-ff210b86a2a8 => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:13.664593 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c20fc03e-0653-48d1-bbd8-fd51f801e9ca tempest-ImagesMetadataTestJSON-74470835 tempest-ImagesMetadataTestJSON-74470835-project] Action: 'update_all', calling method: .version_select at 0x7f7c3d9c61f0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:13.738473 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-c20fc03e-0653-48d1-bbd8-fd51f801e9ca tempest-ImagesMetadataTestJSON-74470835 tempest-ImagesMetadataTestJSON-74470835-project] Getting quotas for project f837147b731f491b8a8a3ad2ce5e4f1f. Resources: dict_keys(['metadata_items']) {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:26:13.744246 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-c20fc03e-0653-48d1-bbd8-fd51f801e9ca tempest-ImagesMetadataTestJSON-74470835 tempest-ImagesMetadataTestJSON-74470835-project] Getting quotas for user b4b41842d3ab4820a85369b2be25fe9c and project f837147b731f491b8a8a3ad2ce5e4f1f. Resources: dict_keys(['metadata_items']) {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:26:13.943410 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2645362d-fb88-4c02-8a57-fa46d02bed34 tempest-SecurityGroupsTestAdminJSON-1497158442 tempest-SecurityGroupsTestAdminJSON-1497158442-project-admin] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.959685 Oct 18 15:26:13.946875 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 233/479] 10.222.0.60 () {60 vars in 1180 bytes} [Tue Oct 18 15:26:12 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:26:13.954303 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b2b3995d-346c-4ab1-8432-5bdc92688b2e tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:13.956751 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b2b3995d-346c-4ab1-8432-5bdc92688b2e tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] [instance: 53bb4ff5-ea92-42df-ab9c-4409c6f99dae] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:13.980834 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2b3995d-346c-4ab1-8432-5bdc92688b2e tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:13.981549 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2b3995d-346c-4ab1-8432-5bdc92688b2e tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:13.983060 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2b3995d-346c-4ab1-8432-5bdc92688b2e tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:13.985539 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2b3995d-346c-4ab1-8432-5bdc92688b2e tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:13.987042 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2b3995d-346c-4ab1-8432-5bdc92688b2e tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:13.987488 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2b3995d-346c-4ab1-8432-5bdc92688b2e tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:14.083502 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c20fc03e-0653-48d1-bbd8-fd51f801e9ca tempest-ImagesMetadataTestJSON-74470835 tempest-ImagesMetadataTestJSON-74470835-project] 10.222.0.60 "PUT /compute/v2.1/images/517dc486-620f-48c0-a147-208ee87b88ce/metadata" status: 200 len: 61 microversion: 2.1 time: 0.422768 Oct 18 15:26:14.084091 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 247/480] 10.222.0.60 () {60 vars in 1280 bytes} [Tue Oct 18 15:26:13 2022] PUT /compute/v2.1/images/517dc486-620f-48c0-a147-208ee87b88ce/metadata => generated 61 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:26:14.088797 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-46613149-9b7b-45d0-8001-e09f9763525b tempest-KeyPairsV210TestJSON-544916316 tempest-KeyPairsV210TestJSON-544916316-project-admin] Action: 'create', calling method: .version_select at 0x7f7c3d9c6af0>, body: {"keypair": {"name": "tempest-keypair-551772179", "type": "ssh", "user_id": "792f7df7f92a426c8f8aeb169c5bce89", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfN/v3qJLe3hqj5zAV4xB4r6En5noHfFBuXx0s1tUYemNhRQlDd8YhJKkBdallnIcei7CYKYJ15HfC6fw/Pqdh5Zn1+jdLdxayMa5GMSnmvd7oKqdT/ANr5K6ZWtekILw=="}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:14.103772 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-46613149-9b7b-45d0-8001-e09f9763525b tempest-KeyPairsV210TestJSON-544916316 tempest-KeyPairsV210TestJSON-544916316-project-admin] Getting quotas for project 54c65fa1406641a4bf4279a61c6ebf13. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:26:14.108253 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-46613149-9b7b-45d0-8001-e09f9763525b tempest-KeyPairsV210TestJSON-544916316 tempest-KeyPairsV210TestJSON-544916316-project-admin] Getting quotas for user 9ac0f6cd339344b2b398e87e613d9371 and project 54c65fa1406641a4bf4279a61c6ebf13. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:26:14.125890 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b2b3995d-346c-4ab1-8432-5bdc92688b2e tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '385ef457207e45b0b843fc2b8ffff7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f40d7ca29449cbb4c2d58df280a01c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:14.131416 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-46613149-9b7b-45d0-8001-e09f9763525b tempest-KeyPairsV210TestJSON-544916316 tempest-KeyPairsV210TestJSON-544916316-project-admin] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.046263 Oct 18 15:26:14.132142 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 248/481] 10.222.0.60 () {62 vars in 1200 bytes} [Tue Oct 18 15:26:14 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 47 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 18 15:26:14.137020 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b2b3995d-346c-4ab1-8432-5bdc92688b2e tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] 10.222.0.60 "GET /compute/v2.1/servers/53bb4ff5-ea92-42df-ab9c-4409c6f99dae" status: 200 len: 1320 microversion: 2.1 time: 0.185733 Oct 18 15:26:14.137020 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 234/482] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:13 2022] GET /compute/v2.1/servers/53bb4ff5-ea92-42df-ab9c-4409c6f99dae => generated 1320 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:14.137174 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-664cd8cb-db70-4676-8f47-10714a4cae59 req-3064138f-aa4b-4799-a3a3-e654ac2764ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19061153-9eed-4374-8799-b497b8a8e780", "tag": "8d08d8f8-c7dc-4676-8853-5174b27e7ce8"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:14.142331 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dd24513e-97eb-4926-8c7d-29a9f69ee502 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:14.143124 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dd24513e-97eb-4926-8c7d-29a9f69ee502 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] [instance: 19061153-9eed-4374-8799-b497b8a8e780] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:14.147663 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-664cd8cb-db70-4676-8f47-10714a4cae59 req-3064138f-aa4b-4799-a3a3-e654ac2764ff service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:14.148617 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-664cd8cb-db70-4676-8f47-10714a4cae59 req-3064138f-aa4b-4799-a3a3-e654ac2764ff service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:14.148887 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-664cd8cb-db70-4676-8f47-10714a4cae59 req-3064138f-aa4b-4799-a3a3-e654ac2764ff service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:14.149401 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd24513e-97eb-4926-8c7d-29a9f69ee502 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:14.150071 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd24513e-97eb-4926-8c7d-29a9f69ee502 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:14.150512 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd24513e-97eb-4926-8c7d-29a9f69ee502 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:14.151210 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd24513e-97eb-4926-8c7d-29a9f69ee502 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:14.151668 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd24513e-97eb-4926-8c7d-29a9f69ee502 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:14.152147 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd24513e-97eb-4926-8c7d-29a9f69ee502 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:14.160145 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-664cd8cb-db70-4676-8f47-10714a4cae59 req-3064138f-aa4b-4799-a3a3-e654ac2764ff service nova] Creating event network-changed:8d08d8f8-c7dc-4676-8853-5174b27e7ce8 for instance 19061153-9eed-4374-8799-b497b8a8e780 on n-h2-853682-5 Oct 18 15:26:14.165058 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-664cd8cb-db70-4676-8f47-10714a4cae59 req-3064138f-aa4b-4799-a3a3-e654ac2764ff service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031725 Oct 18 15:26:14.165677 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 249/483] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:26:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:26:14.167344 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:26:14.170621 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-01b351f4-636c-4aab-ab93-317ab2bbaf97 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:14.171912 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-01b351f4-636c-4aab-ab93-317ab2bbaf97 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] [instance: 29ceb840-1b81-4434-841f-a473cded4b73] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:14.177430 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-01b351f4-636c-4aab-ab93-317ab2bbaf97 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:14.177913 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-01b351f4-636c-4aab-ab93-317ab2bbaf97 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:14.178339 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-01b351f4-636c-4aab-ab93-317ab2bbaf97 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:14.179025 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-01b351f4-636c-4aab-ab93-317ab2bbaf97 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:14.179472 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-01b351f4-636c-4aab-ab93-317ab2bbaf97 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:14.179888 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-01b351f4-636c-4aab-ab93-317ab2bbaf97 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:14.350220 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dd24513e-97eb-4926-8c7d-29a9f69ee502 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2bbb8b77794404af993e8291343afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6facda3e46640c884583aaf146a8b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:14.357973 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dd24513e-97eb-4926-8c7d-29a9f69ee502 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] 10.222.0.60 "GET /compute/v2.1/servers/19061153-9eed-4374-8799-b497b8a8e780" status: 200 len: 1384 microversion: 2.1 time: 0.222356 Oct 18 15:26:14.358562 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 235/484] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:14 2022] GET /compute/v2.1/servers/19061153-9eed-4374-8799-b497b8a8e780 => generated 1384 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:14.360550 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-01b351f4-636c-4aab-ab93-317ab2bbaf97 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73" status: 200 len: 1643 microversion: 2.1 time: 0.193633 Oct 18 15:26:14.362843 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 250/485] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:14 2022] GET /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73 => generated 1643 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:14.363142 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7c6baa2f-00f9-407c-9137-6608fa4f5dc1 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d819e50>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:14.366669 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-40eb6801-8a33-4335-9ad4-520ac5269c57 tempest-SecurityGroupsTestAdminJSON-1497158442 tempest-SecurityGroupsTestAdminJSON-1497158442-project-admin] Action: 'create', calling method: .version_select at 0x7f7c3d9c6c10>, body: {"security_group": {"name": "tempest-securitygroup-1924969591", "description": "tempest-description-566432211"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:14.384078 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:26:14.517357 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-40eb6801-8a33-4335-9ad4-520ac5269c57 tempest-SecurityGroupsTestAdminJSON-1497158442 tempest-SecurityGroupsTestAdminJSON-1497158442-project-admin] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.155018 Oct 18 15:26:14.525749 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 251/486] 10.222.0.60 () {60 vars in 1180 bytes} [Tue Oct 18 15:26:14 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:26:14.532006 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2511826c-e5c1-482d-b7d1-09e2d7010797 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:14.532672 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2511826c-e5c1-482d-b7d1-09e2d7010797 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: b11f87b9-987d-4c75-9a43-d654ab53de1f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:14.538580 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2511826c-e5c1-482d-b7d1-09e2d7010797 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:14.539132 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2511826c-e5c1-482d-b7d1-09e2d7010797 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:14.539626 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2511826c-e5c1-482d-b7d1-09e2d7010797 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:14.540374 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2511826c-e5c1-482d-b7d1-09e2d7010797 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:14.540841 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2511826c-e5c1-482d-b7d1-09e2d7010797 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:14.541431 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2511826c-e5c1-482d-b7d1-09e2d7010797 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:14.685815 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2511826c-e5c1-482d-b7d1-09e2d7010797 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:14.694823 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2511826c-e5c1-482d-b7d1-09e2d7010797 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:14.697259 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2511826c-e5c1-482d-b7d1-09e2d7010797 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:14.698419 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2511826c-e5c1-482d-b7d1-09e2d7010797 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/b11f87b9-987d-4c75-9a43-d654ab53de1f" status: 200 len: 1567 microversion: 2.25 time: 0.171253 Oct 18 15:26:14.698964 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 252/487] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:26:14 2022] GET /compute/v2.1/servers/b11f87b9-987d-4c75-9a43-d654ab53de1f => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:26:14.703686 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3fb4e499-86bb-4646-ae24-95ae7ba4750e tempest-ImagesMetadataTestJSON-74470835 tempest-ImagesMetadataTestJSON-74470835-project] Calling method '.version_select at 0x7f7c3da22310>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:14.955697 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7c6baa2f-00f9-407c-9137-6608fa4f5dc1 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "DELETE /compute/v2.1/images/ede050c6-ea2a-474d-a15a-ff210b86a2a8" status: 204 len: 0 microversion: 2.1 time: 0.591657 Oct 18 15:26:14.956543 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 236/488] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:14 2022] DELETE /compute/v2.1/images/ede050c6-ea2a-474d-a15a-ff210b86a2a8 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:26:14.964460 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d48f52aa-c27c-48f2-b168-28736395fb58 tempest-KeyPairsV210TestJSON-544916316 tempest-KeyPairsV210TestJSON-544916316-project-admin] Calling method '.version_select at 0x7f7c3d8415e0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:14.973907 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d48f52aa-c27c-48f2-b168-28736395fb58 tempest-KeyPairsV210TestJSON-544916316 tempest-KeyPairsV210TestJSON-544916316-project-admin] 10.222.0.60 "GET /compute/v2.1/os-keypairs/tempest-keypair-1382566659?user_id=792f7df7f92a426c8f8aeb169c5bce89" status: 200 len: 512 microversion: 2.10 time: 0.015657 Oct 18 15:26:14.974577 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 237/489] 10.222.0.60 () {60 vars in 1340 bytes} [Tue Oct 18 15:26:14 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1382566659?user_id=792f7df7f92a426c8f8aeb169c5bce89 => generated 512 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:26:14.983658 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3fb4e499-86bb-4646-ae24-95ae7ba4750e tempest-ImagesMetadataTestJSON-74470835 tempest-ImagesMetadataTestJSON-74470835-project] 10.222.0.60 "DELETE /compute/v2.1/images/517dc486-620f-48c0-a147-208ee87b88ce/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.281355 Oct 18 15:26:14.987003 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 253/490] 10.222.0.60 () {58 vars in 1296 bytes} [Tue Oct 18 15:26:14 2022] DELETE /compute/v2.1/images/517dc486-620f-48c0-a147-208ee87b88ce/metadata/os_version => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:26:14.989249 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-abeb12d6-7884-4ac7-9bad-10d3af3b50d9 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:14.990430 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-abeb12d6-7884-4ac7-9bad-10d3af3b50d9 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] [instance: 29ceb840-1b81-4434-841f-a473cded4b73] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:14.993112 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-dcefe1c3-24f9-4b9e-8e6a-487f77ffadcc tempest-SecurityGroupsTestAdminJSON-1497158442 tempest-SecurityGroupsTestAdminJSON-1497158442-project-admin] Calling method '.version_select at 0x7f7c3d96d820>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:14.998251 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-abeb12d6-7884-4ac7-9bad-10d3af3b50d9 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:14.998988 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-abeb12d6-7884-4ac7-9bad-10d3af3b50d9 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:14.999490 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-abeb12d6-7884-4ac7-9bad-10d3af3b50d9 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:15.000248 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-abeb12d6-7884-4ac7-9bad-10d3af3b50d9 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:15.001005 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-abeb12d6-7884-4ac7-9bad-10d3af3b50d9 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:15.001619 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-abeb12d6-7884-4ac7-9bad-10d3af3b50d9 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:15.160583 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=24 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:26:15.303978 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-abeb12d6-7884-4ac7-9bad-10d3af3b50d9 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73" status: 200 len: 1643 microversion: 2.1 time: 0.318778 Oct 18 15:26:15.304949 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 238/491] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:14 2022] GET /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73 => generated 1643 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:15.309706 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-95f62dc4-5c9c-4e68-9735-c3f259fcb1fc tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:15.310264 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-95f62dc4-5c9c-4e68-9735-c3f259fcb1fc tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 51ccbde5-4cf5-4821-9478-c14e19e73ad1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:15.316347 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95f62dc4-5c9c-4e68-9735-c3f259fcb1fc tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:15.316924 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95f62dc4-5c9c-4e68-9735-c3f259fcb1fc tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:15.317909 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95f62dc4-5c9c-4e68-9735-c3f259fcb1fc tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:15.318820 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95f62dc4-5c9c-4e68-9735-c3f259fcb1fc tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:15.319456 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95f62dc4-5c9c-4e68-9735-c3f259fcb1fc tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:15.320063 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95f62dc4-5c9c-4e68-9735-c3f259fcb1fc tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:15.349045 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-95f62dc4-5c9c-4e68-9735-c3f259fcb1fc tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 51ccbde5-4cf5-4821-9478-c14e19e73ad1] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:26:15.444602 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-95f62dc4-5c9c-4e68-9735-c3f259fcb1fc tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "DELETE /compute/v2.1/servers/51ccbde5-4cf5-4821-9478-c14e19e73ad1" status: 204 len: 0 microversion: 2.1 time: 0.138118 Oct 18 15:26:15.445399 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 239/492] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:26:15 2022] DELETE /compute/v2.1/servers/51ccbde5-4cf5-4821-9478-c14e19e73ad1 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:26:15.461385 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-11b4dfde-21bb-49a6-af32-f0607ed88138 tempest-KeyPairsV210TestJSON-544916316 tempest-KeyPairsV210TestJSON-544916316-project-admin] Action: 'create', calling method: .version_select at 0x7f7c3d8240d0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-202682838", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBITuTtKbhw8sG27K9hIkEnodk8WI5VoJoGljfglA2Dme8rAKwJlilxjc+Zxs6fdQ3WOLR+7eM+609Zta7IZmZH1qoCR7XYPABA+hIrXGNVrnK52XGN4xTArBigULbaEUFQ=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:15.482616 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-11b4dfde-21bb-49a6-af32-f0607ed88138 tempest-KeyPairsV210TestJSON-544916316 tempest-KeyPairsV210TestJSON-544916316-project-admin] Getting quotas for project 54c65fa1406641a4bf4279a61c6ebf13. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:26:15.488736 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-11b4dfde-21bb-49a6-af32-f0607ed88138 tempest-KeyPairsV210TestJSON-544916316 tempest-KeyPairsV210TestJSON-544916316-project-admin] Getting quotas for user 9ac0f6cd339344b2b398e87e613d9371 and project 54c65fa1406641a4bf4279a61c6ebf13. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:26:15.523754 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-11b4dfde-21bb-49a6-af32-f0607ed88138 tempest-KeyPairsV210TestJSON-544916316 tempest-KeyPairsV210TestJSON-544916316-project-admin] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.075788 Oct 18 15:26:15.524498 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 240/493] 10.222.0.60 () {62 vars in 1200 bytes} [Tue Oct 18 15:26:15 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 78 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 18 15:26:15.536577 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c0053a34-8d4a-4f70-901e-99118525a7cf tempest-ImagesMetadataTestJSON-74470835 tempest-ImagesMetadataTestJSON-74470835-project] Calling method '.version_select at 0x7f7c3d867550>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:15.588599 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c0053a34-8d4a-4f70-901e-99118525a7cf tempest-ImagesMetadataTestJSON-74470835 tempest-ImagesMetadataTestJSON-74470835-project] 10.222.0.60 "GET /compute/v2.1/images/517dc486-620f-48c0-a147-208ee87b88ce/metadata" status: 200 len: 37 microversion: 2.1 time: 0.058376 Oct 18 15:26:15.589190 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 241/494] 10.222.0.60 () {58 vars in 1260 bytes} [Tue Oct 18 15:26:15 2022] GET /compute/v2.1/images/517dc486-620f-48c0-a147-208ee87b88ce/metadata => generated 37 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:26:15.596638 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a8d95652-69cf-49a1-aeb3-42106cd8989b tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:15.600462 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a8d95652-69cf-49a1-aeb3-42106cd8989b tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] [instance: 53bb4ff5-ea92-42df-ab9c-4409c6f99dae] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:15.617181 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8d95652-69cf-49a1-aeb3-42106cd8989b tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:15.617813 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8d95652-69cf-49a1-aeb3-42106cd8989b tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:15.618797 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8d95652-69cf-49a1-aeb3-42106cd8989b tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:15.619572 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8d95652-69cf-49a1-aeb3-42106cd8989b tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:15.620115 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8d95652-69cf-49a1-aeb3-42106cd8989b tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:15.620647 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8d95652-69cf-49a1-aeb3-42106cd8989b tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:15.824762 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a8d95652-69cf-49a1-aeb3-42106cd8989b tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '385ef457207e45b0b843fc2b8ffff7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f40d7ca29449cbb4c2d58df280a01c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:15.835013 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a8d95652-69cf-49a1-aeb3-42106cd8989b tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] 10.222.0.60 "GET /compute/v2.1/servers/53bb4ff5-ea92-42df-ab9c-4409c6f99dae" status: 200 len: 1320 microversion: 2.1 time: 0.244141 Oct 18 15:26:15.843308 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 242/495] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:15 2022] GET /compute/v2.1/servers/53bb4ff5-ea92-42df-ab9c-4409c6f99dae => generated 1320 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:15.850782 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dc8b80bf-540f-4493-a259-7ab02a7d4bff tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:15.855854 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc8b80bf-540f-4493-a259-7ab02a7d4bff tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:15.857380 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc8b80bf-540f-4493-a259-7ab02a7d4bff tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:15.857859 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc8b80bf-540f-4493-a259-7ab02a7d4bff tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:15.858579 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc8b80bf-540f-4493-a259-7ab02a7d4bff tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:15.859043 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc8b80bf-540f-4493-a259-7ab02a7d4bff tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:15.859462 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc8b80bf-540f-4493-a259-7ab02a7d4bff tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:15.893292 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:26:15.902982 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dc8b80bf-540f-4493-a259-7ab02a7d4bff tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.056705 Oct 18 15:26:15.904703 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 243/496] 10.222.0.60 () {58 vars in 1176 bytes} [Tue Oct 18 15:26:15 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:26:15.910010 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7474dac2-0a17-467b-ada7-c17f964629bb tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:15.910798 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7474dac2-0a17-467b-ada7-c17f964629bb tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] [instance: 19061153-9eed-4374-8799-b497b8a8e780] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:15.937233 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7474dac2-0a17-467b-ada7-c17f964629bb tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:15.937992 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7474dac2-0a17-467b-ada7-c17f964629bb tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:15.938571 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7474dac2-0a17-467b-ada7-c17f964629bb tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:15.939809 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7474dac2-0a17-467b-ada7-c17f964629bb tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:15.940621 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7474dac2-0a17-467b-ada7-c17f964629bb tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:15.941407 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7474dac2-0a17-467b-ada7-c17f964629bb tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:16.134355 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7474dac2-0a17-467b-ada7-c17f964629bb tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2bbb8b77794404af993e8291343afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6facda3e46640c884583aaf146a8b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:16.143240 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7474dac2-0a17-467b-ada7-c17f964629bb tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] 10.222.0.60 "GET /compute/v2.1/servers/19061153-9eed-4374-8799-b497b8a8e780" status: 200 len: 1384 microversion: 2.1 time: 0.237240 Oct 18 15:26:16.149225 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 244/497] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:15 2022] GET /compute/v2.1/servers/19061153-9eed-4374-8799-b497b8a8e780 => generated 1384 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:16.161291 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cb5a6a9d-648a-45b3-aaa1-4abf70c97b42 tempest-KeyPairsV210TestJSON-544916316 tempest-KeyPairsV210TestJSON-544916316-project-admin] Calling method '.version_select at 0x7f7c3d85c310>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:16.165539 n-d-853682-5 devstack@n-api.service[120406]: WARNING oslo_db.sqlalchemy.utils [None req-cb5a6a9d-648a-45b3-aaa1-4abf70c97b42 tempest-KeyPairsV210TestJSON-544916316 tempest-KeyPairsV210TestJSON-544916316-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 18 15:26:16.173286 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cb5a6a9d-648a-45b3-aaa1-4abf70c97b42 tempest-KeyPairsV210TestJSON-544916316 tempest-KeyPairsV210TestJSON-544916316-project-admin] 10.222.0.60 "GET /compute/v2.1/os-keypairs?user_id=792f7df7f92a426c8f8aeb169c5bce89" status: 200 len: 725 microversion: 2.10 time: 0.022828 Oct 18 15:26:16.173875 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 245/498] 10.222.0.60 () {60 vars in 1259 bytes} [Tue Oct 18 15:26:16 2022] GET /compute/v2.1/os-keypairs?user_id=792f7df7f92a426c8f8aeb169c5bce89 => generated 725 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:26:16.178716 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-da38079b-9baa-4549-a925-79d4b933cff3 tempest-ImagesMetadataTestJSON-74470835 tempest-ImagesMetadataTestJSON-74470835-project] Action: 'update_all', calling method: .version_select at 0x7f7c3d97a3a0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:16.229522 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-da38079b-9baa-4549-a925-79d4b933cff3 tempest-ImagesMetadataTestJSON-74470835 tempest-ImagesMetadataTestJSON-74470835-project] Getting quotas for project f837147b731f491b8a8a3ad2ce5e4f1f. Resources: dict_keys(['metadata_items']) {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:26:16.234942 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-da38079b-9baa-4549-a925-79d4b933cff3 tempest-ImagesMetadataTestJSON-74470835 tempest-ImagesMetadataTestJSON-74470835-project] Getting quotas for user b4b41842d3ab4820a85369b2be25fe9c and project f837147b731f491b8a8a3ad2ce5e4f1f. Resources: dict_keys(['metadata_items']) {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:26:16.529764 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-da38079b-9baa-4549-a925-79d4b933cff3 tempest-ImagesMetadataTestJSON-74470835 tempest-ImagesMetadataTestJSON-74470835-project] 10.222.0.60 "PUT /compute/v2.1/images/517dc486-620f-48c0-a147-208ee87b88ce/metadata" status: 200 len: 61 microversion: 2.1 time: 0.354620 Oct 18 15:26:16.530435 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 246/499] 10.222.0.60 () {60 vars in 1280 bytes} [Tue Oct 18 15:26:16 2022] PUT /compute/v2.1/images/517dc486-620f-48c0-a147-208ee87b88ce/metadata => generated 61 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:26:16.535302 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e9701e12-9bdd-43cb-8dae-0d6d91e448e9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-389522143", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "ef6fe956-3e84-412d-8f85-8f55d9975d85"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:16.589346 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-e9701e12-9bdd-43cb-8dae-0d6d91e448e9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] validate_networks() for [('ef6fe956-3e84-412d-8f85-8f55d9975d85', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:26:17.188060 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-e9701e12-9bdd-43cb-8dae-0d6d91e448e9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:26:17.188668 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-e9701e12-9bdd-43cb-8dae-0d6d91e448e9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:26:17.189071 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-e9701e12-9bdd-43cb-8dae-0d6d91e448e9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:26:17.189578 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-e9701e12-9bdd-43cb-8dae-0d6d91e448e9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:26:17.189991 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-e9701e12-9bdd-43cb-8dae-0d6d91e448e9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:26:17.198888 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e9701e12-9bdd-43cb-8dae-0d6d91e448e9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:17.199370 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e9701e12-9bdd-43cb-8dae-0d6d91e448e9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:17.199806 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e9701e12-9bdd-43cb-8dae-0d6d91e448e9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:17.200532 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e9701e12-9bdd-43cb-8dae-0d6d91e448e9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:17.201026 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e9701e12-9bdd-43cb-8dae-0d6d91e448e9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:17.201449 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e9701e12-9bdd-43cb-8dae-0d6d91e448e9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:17.220492 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-e9701e12-9bdd-43cb-8dae-0d6d91e448e9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Getting quotas for project ee0a3f0c256544beb2df4f113da56137. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:26:17.225802 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-e9701e12-9bdd-43cb-8dae-0d6d91e448e9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Getting quotas for user ed9cd936192c40efa9099edee445e90e and project ee0a3f0c256544beb2df4f113da56137. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:26:17.238516 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e9701e12-9bdd-43cb-8dae-0d6d91e448e9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:26:17.240835 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e9701e12-9bdd-43cb-8dae-0d6d91e448e9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: f07f6211-dd0e-4bdd-969c-fff2c3633dd0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:26:17.291445 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e9701e12-9bdd-43cb-8dae-0d6d91e448e9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.759712 Oct 18 15:26:17.292671 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 247/500] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:26:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:26:17.302077 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c67eeec9-7ed3-4428-9a83-0224df12651a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:17.302723 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c67eeec9-7ed3-4428-9a83-0224df12651a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: b11f87b9-987d-4c75-9a43-d654ab53de1f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:17.309447 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c67eeec9-7ed3-4428-9a83-0224df12651a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:17.310453 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c67eeec9-7ed3-4428-9a83-0224df12651a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:17.310603 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c67eeec9-7ed3-4428-9a83-0224df12651a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:17.324239 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c67eeec9-7ed3-4428-9a83-0224df12651a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:17.324965 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c67eeec9-7ed3-4428-9a83-0224df12651a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:17.326068 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c67eeec9-7ed3-4428-9a83-0224df12651a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:18.126225 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c67eeec9-7ed3-4428-9a83-0224df12651a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:18.134375 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c67eeec9-7ed3-4428-9a83-0224df12651a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:18.136069 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c67eeec9-7ed3-4428-9a83-0224df12651a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:18.137299 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c67eeec9-7ed3-4428-9a83-0224df12651a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/b11f87b9-987d-4c75-9a43-d654ab53de1f" status: 200 len: 1557 microversion: 2.25 time: 0.843592 Oct 18 15:26:18.139051 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 248/501] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:26:17 2022] GET /compute/v2.1/servers/b11f87b9-987d-4c75-9a43-d654ab53de1f => generated 1557 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:26:18.164469 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cfd510d1-594d-44f9-8e2d-05958e6de6dd tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:18.186534 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cfd510d1-594d-44f9-8e2d-05958e6de6dd tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] [instance: 29ceb840-1b81-4434-841f-a473cded4b73] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:18.195208 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cfd510d1-594d-44f9-8e2d-05958e6de6dd tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:18.195898 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cfd510d1-594d-44f9-8e2d-05958e6de6dd tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:18.196516 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cfd510d1-594d-44f9-8e2d-05958e6de6dd tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:18.197457 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cfd510d1-594d-44f9-8e2d-05958e6de6dd tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:18.198245 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cfd510d1-594d-44f9-8e2d-05958e6de6dd tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:18.198816 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cfd510d1-594d-44f9-8e2d-05958e6de6dd tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:18.267233 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-dcefe1c3-24f9-4b9e-8e6a-487f77ffadcc tempest-SecurityGroupsTestAdminJSON-1497158442 tempest-SecurityGroupsTestAdminJSON-1497158442-project-admin] 10.222.0.60 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 10368 microversion: 2.1 time: 3.278524 Oct 18 15:26:18.269331 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 254/502] 10.222.0.60 () {58 vars in 1191 bytes} [Tue Oct 18 15:26:14 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 10368 bytes in 3282 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:26:18.274388 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d8b03d67-787f-40c4-9bd0-c06b8eb0c277 tempest-KeyPairsV210TestJSON-544916316 tempest-KeyPairsV210TestJSON-544916316-project-admin] Calling method '.version_select at 0x7f7c3da22ca0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:18.306969 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cfd510d1-594d-44f9-8e2d-05958e6de6dd tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73/action" status: 202 len: 0 microversion: 2.1 time: 0.151291 Oct 18 15:26:18.308861 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 249/503] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:26:18 2022] POST /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:26:18.319056 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0442fc78-d1b3-41fc-807e-ff4a50305db0 tempest-ImagesMetadataTestJSON-74470835 tempest-ImagesMetadataTestJSON-74470835-project] Calling method '.version_select at 0x7f7c3d97a820>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:18.320124 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d8b03d67-787f-40c4-9bd0-c06b8eb0c277 tempest-KeyPairsV210TestJSON-544916316 tempest-KeyPairsV210TestJSON-544916316-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-202682838" status: 204 len: 0 microversion: 2.10 time: 0.049249 Oct 18 15:26:18.326639 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 255/504] 10.222.0.60 () {60 vars in 1322 bytes} [Tue Oct 18 15:26:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-202682838 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 15:26:18.332676 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5060ae1a-720a-4fc3-933a-1258af7fb1e4 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:18.333434 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5060ae1a-720a-4fc3-933a-1258af7fb1e4 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] [instance: 53bb4ff5-ea92-42df-ab9c-4409c6f99dae] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:18.341690 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5060ae1a-720a-4fc3-933a-1258af7fb1e4 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:18.342319 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5060ae1a-720a-4fc3-933a-1258af7fb1e4 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:18.342980 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5060ae1a-720a-4fc3-933a-1258af7fb1e4 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:18.344459 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5060ae1a-720a-4fc3-933a-1258af7fb1e4 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:18.345204 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5060ae1a-720a-4fc3-933a-1258af7fb1e4 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:18.345855 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5060ae1a-720a-4fc3-933a-1258af7fb1e4 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:18.365389 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0442fc78-d1b3-41fc-807e-ff4a50305db0 tempest-ImagesMetadataTestJSON-74470835 tempest-ImagesMetadataTestJSON-74470835-project] 10.222.0.60 "GET /compute/v2.1/images/517dc486-620f-48c0-a147-208ee87b88ce/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.052938 Oct 18 15:26:18.366150 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 250/505] 10.222.0.60 () {58 vars in 1290 bytes} [Tue Oct 18 15:26:18 2022] GET /compute/v2.1/images/517dc486-620f-48c0-a147-208ee87b88ce/metadata/os_distro => generated 33 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:26:18.371012 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9858282a-fef4-43c6-9b05-bb75ef33c2fd tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:18.371798 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9858282a-fef4-43c6-9b05-bb75ef33c2fd tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] [instance: 19061153-9eed-4374-8799-b497b8a8e780] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:18.380319 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9858282a-fef4-43c6-9b05-bb75ef33c2fd tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:18.380880 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9858282a-fef4-43c6-9b05-bb75ef33c2fd tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:18.381341 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9858282a-fef4-43c6-9b05-bb75ef33c2fd tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:18.382053 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9858282a-fef4-43c6-9b05-bb75ef33c2fd tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:18.382537 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9858282a-fef4-43c6-9b05-bb75ef33c2fd tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:18.383145 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9858282a-fef4-43c6-9b05-bb75ef33c2fd tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:18.811518 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5060ae1a-720a-4fc3-933a-1258af7fb1e4 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '385ef457207e45b0b843fc2b8ffff7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f40d7ca29449cbb4c2d58df280a01c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:18.825712 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5060ae1a-720a-4fc3-933a-1258af7fb1e4 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] 10.222.0.60 "GET /compute/v2.1/servers/53bb4ff5-ea92-42df-ab9c-4409c6f99dae" status: 200 len: 1320 microversion: 2.1 time: 0.496940 Oct 18 15:26:18.842165 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 256/506] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:18 2022] GET /compute/v2.1/servers/53bb4ff5-ea92-42df-ab9c-4409c6f99dae => generated 1320 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:18.849608 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9858282a-fef4-43c6-9b05-bb75ef33c2fd tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2bbb8b77794404af993e8291343afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6facda3e46640c884583aaf146a8b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:18.869200 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9858282a-fef4-43c6-9b05-bb75ef33c2fd tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] 10.222.0.60 "GET /compute/v2.1/servers/19061153-9eed-4374-8799-b497b8a8e780" status: 200 len: 1384 microversion: 2.1 time: 0.499205 Oct 18 15:26:18.870331 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-40cb0faa-d6b7-4eb1-9b92-3b019d0e6330 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:18.870927 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-40cb0faa-d6b7-4eb1-9b92-3b019d0e6330 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: f07f6211-dd0e-4bdd-969c-fff2c3633dd0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:18.878059 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 251/507] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:18 2022] GET /compute/v2.1/servers/19061153-9eed-4374-8799-b497b8a8e780 => generated 1384 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:18.890197 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-91e4ecfe-5957-4b29-a2ff-e0f793203eb1 req-29fdac08-c4b1-4bc5-8079-25459dec3ac3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53bb4ff5-ea92-42df-ab9c-4409c6f99dae", "name": "network-vif-plugged", "status": "completed", "tag": "0ae67927-c3c7-442e-8482-14b2626c726b"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:18.893546 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-40cb0faa-d6b7-4eb1-9b92-3b019d0e6330 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:18.894232 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-40cb0faa-d6b7-4eb1-9b92-3b019d0e6330 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:18.895887 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-40cb0faa-d6b7-4eb1-9b92-3b019d0e6330 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:18.896620 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-40cb0faa-d6b7-4eb1-9b92-3b019d0e6330 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:18.899314 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-40cb0faa-d6b7-4eb1-9b92-3b019d0e6330 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:18.901013 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-40cb0faa-d6b7-4eb1-9b92-3b019d0e6330 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:18.935265 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-91e4ecfe-5957-4b29-a2ff-e0f793203eb1 req-29fdac08-c4b1-4bc5-8079-25459dec3ac3 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:18.936517 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-91e4ecfe-5957-4b29-a2ff-e0f793203eb1 req-29fdac08-c4b1-4bc5-8079-25459dec3ac3 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:18.939107 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-91e4ecfe-5957-4b29-a2ff-e0f793203eb1 req-29fdac08-c4b1-4bc5-8079-25459dec3ac3 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:18.970502 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-91e4ecfe-5957-4b29-a2ff-e0f793203eb1 req-29fdac08-c4b1-4bc5-8079-25459dec3ac3 service nova] Creating event network-vif-plugged:0ae67927-c3c7-442e-8482-14b2626c726b for instance 53bb4ff5-ea92-42df-ab9c-4409c6f99dae on n-h2-853682-5 Oct 18 15:26:18.979436 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-91e4ecfe-5957-4b29-a2ff-e0f793203eb1 req-29fdac08-c4b1-4bc5-8079-25459dec3ac3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098384 Oct 18 15:26:18.982794 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 252/508] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:26:18.997661 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-edff6307-b45a-473e-90ab-2f10d11a7128 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Calling method '.version_select at 0x7f7c3d7d1dc0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:19.001447 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-edff6307-b45a-473e-90ab-2f10d11a7128 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:19.002288 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-edff6307-b45a-473e-90ab-2f10d11a7128 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:19.002957 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-edff6307-b45a-473e-90ab-2f10d11a7128 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:19.027764 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-edff6307-b45a-473e-90ab-2f10d11a7128 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] 10.222.0.60 "GET /compute/v2.1/os-migrations" status: 200 len: 856 microversion: 2.25 time: 0.042672 Oct 18 15:26:19.037077 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 253/509] 10.222.0.60 () {60 vars in 1184 bytes} [Tue Oct 18 15:26:18 2022] GET /compute/v2.1/os-migrations => generated 856 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:26:19.044426 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-40cb0faa-d6b7-4eb1-9b92-3b019d0e6330 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:19.047657 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f0b63970-2af7-453a-bb7b-812f32832e46 tempest-SecurityGroupsTestAdminJSON-1254180834 tempest-SecurityGroupsTestAdminJSON-1254180834-project] Calling method '.version_select at 0x7f7c3d8243a0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:19.055984 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-40cb0faa-d6b7-4eb1-9b92-3b019d0e6330 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/f07f6211-dd0e-4bdd-969c-fff2c3633dd0" status: 200 len: 1277 microversion: 2.1 time: 0.212590 Oct 18 15:26:19.057781 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 257/510] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:18 2022] GET /compute/v2.1/servers/f07f6211-dd0e-4bdd-969c-fff2c3633dd0 => generated 1277 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:19.065952 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-270b56aa-6fff-4e4f-8ee9-31e3d5b6ba3a tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:19.066913 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-270b56aa-6fff-4e4f-8ee9-31e3d5b6ba3a tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] [instance: 29ceb840-1b81-4434-841f-a473cded4b73] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:19.077204 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-270b56aa-6fff-4e4f-8ee9-31e3d5b6ba3a tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:19.078088 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-270b56aa-6fff-4e4f-8ee9-31e3d5b6ba3a tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:19.078746 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-270b56aa-6fff-4e4f-8ee9-31e3d5b6ba3a tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:19.079700 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-270b56aa-6fff-4e4f-8ee9-31e3d5b6ba3a tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:19.080923 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-270b56aa-6fff-4e4f-8ee9-31e3d5b6ba3a tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:19.081795 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-270b56aa-6fff-4e4f-8ee9-31e3d5b6ba3a tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:19.450918 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-270b56aa-6fff-4e4f-8ee9-31e3d5b6ba3a tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73" status: 200 len: 1628 microversion: 2.1 time: 0.390265 Oct 18 15:26:19.451555 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 258/511] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:19 2022] GET /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73 => generated 1628 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:19.456125 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-23d0069e-3f58-4b4a-b1ed-14a6aea65c2a tempest-KeyPairsV210TestJSON-544916316 tempest-KeyPairsV210TestJSON-544916316-project-admin] Calling method '.version_select at 0x7f7c3d9c6e50>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:19.499356 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-23d0069e-3f58-4b4a-b1ed-14a6aea65c2a tempest-KeyPairsV210TestJSON-544916316 tempest-KeyPairsV210TestJSON-544916316-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-551772179?user_id=792f7df7f92a426c8f8aeb169c5bce89" status: 204 len: 0 microversion: 2.10 time: 0.046784 Oct 18 15:26:19.500141 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 259/512] 10.222.0.60 () {60 vars in 1340 bytes} [Tue Oct 18 15:26:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-551772179?user_id=792f7df7f92a426c8f8aeb169c5bce89 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 15:26:19.505084 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-93d86754-05aa-41c4-a196-acf601918a67 tempest-ImagesMetadataTestJSON-74470835 tempest-ImagesMetadataTestJSON-74470835-project] Action: 'update_all', calling method: .version_select at 0x7f7c3d96db80>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:19.573143 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-93d86754-05aa-41c4-a196-acf601918a67 tempest-ImagesMetadataTestJSON-74470835 tempest-ImagesMetadataTestJSON-74470835-project] Getting quotas for project f837147b731f491b8a8a3ad2ce5e4f1f. Resources: dict_keys(['metadata_items']) {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:26:19.579931 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-93d86754-05aa-41c4-a196-acf601918a67 tempest-ImagesMetadataTestJSON-74470835 tempest-ImagesMetadataTestJSON-74470835-project] Getting quotas for user b4b41842d3ab4820a85369b2be25fe9c and project f837147b731f491b8a8a3ad2ce5e4f1f. Resources: dict_keys(['metadata_items']) {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:26:19.583376 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f0b63970-2af7-453a-bb7b-812f32832e46 tempest-SecurityGroupsTestAdminJSON-1254180834 tempest-SecurityGroupsTestAdminJSON-1254180834-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1110 microversion: 2.1 time: 0.544570 Oct 18 15:26:19.596683 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 254/513] 10.222.0.60 () {58 vars in 1191 bytes} [Tue Oct 18 15:26:19 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1110 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:19.601530 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-1ce4f079-1aa9-479a-868c-fa48d67ade8e req-eb470496-fe4d-44b3-9d5f-e2853f141a88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51ccbde5-4cf5-4821-9478-c14e19e73ad1", "name": "network-vif-deleted", "tag": "df898d7d-c591-40dd-bff2-fd63cc9d55b0"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:19.623559 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1ce4f079-1aa9-479a-868c-fa48d67ade8e req-eb470496-fe4d-44b3-9d5f-e2853f141a88 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:19.624552 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1ce4f079-1aa9-479a-868c-fa48d67ade8e req-eb470496-fe4d-44b3-9d5f-e2853f141a88 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:19.626376 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1ce4f079-1aa9-479a-868c-fa48d67ade8e req-eb470496-fe4d-44b3-9d5f-e2853f141a88 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:19.656543 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-1ce4f079-1aa9-479a-868c-fa48d67ade8e req-eb470496-fe4d-44b3-9d5f-e2853f141a88 service nova] Creating event network-vif-deleted:df898d7d-c591-40dd-bff2-fd63cc9d55b0 for instance 51ccbde5-4cf5-4821-9478-c14e19e73ad1 on n-h2-853682-5 Oct 18 15:26:19.661697 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-1ce4f079-1aa9-479a-868c-fa48d67ade8e req-eb470496-fe4d-44b3-9d5f-e2853f141a88 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063744 Oct 18 15:26:19.662609 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 255/514] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:26:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:26:19.669480 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9da7f450-37cf-4182-ae71-23027f3a1c2c tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:19.670553 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9da7f450-37cf-4182-ae71-23027f3a1c2c tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] [instance: b11f87b9-987d-4c75-9a43-d654ab53de1f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:19.678344 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9da7f450-37cf-4182-ae71-23027f3a1c2c tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:19.679101 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9da7f450-37cf-4182-ae71-23027f3a1c2c tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:19.679797 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9da7f450-37cf-4182-ae71-23027f3a1c2c tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:19.681015 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9da7f450-37cf-4182-ae71-23027f3a1c2c tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:19.681633 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9da7f450-37cf-4182-ae71-23027f3a1c2c tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:19.682446 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9da7f450-37cf-4182-ae71-23027f3a1c2c tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:19.884168 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-93d86754-05aa-41c4-a196-acf601918a67 tempest-ImagesMetadataTestJSON-74470835 tempest-ImagesMetadataTestJSON-74470835-project] 10.222.0.60 "PUT /compute/v2.1/images/517dc486-620f-48c0-a147-208ee87b88ce/metadata" status: 200 len: 61 microversion: 2.1 time: 0.382683 Oct 18 15:26:19.890656 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 260/515] 10.222.0.60 () {60 vars in 1280 bytes} [Tue Oct 18 15:26:19 2022] PUT /compute/v2.1/images/517dc486-620f-48c0-a147-208ee87b88ce/metadata => generated 61 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:26:19.896034 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-cec3a029-92f6-43d3-bf0a-f29edbeb348f tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-853682-5", "block_migration": true, "disk_over_commit": false}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:19.901539 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-9da7f450-37cf-4182-ae71-23027f3a1c2c tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lazy-loading 'services' on Instance uuid b11f87b9-987d-4c75-9a43-d654ab53de1f {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:26:19.902015 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-cec3a029-92f6-43d3-bf0a-f29edbeb348f tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] [instance: 29ceb840-1b81-4434-841f-a473cded4b73] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:19.915494 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cec3a029-92f6-43d3-bf0a-f29edbeb348f tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:19.917065 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cec3a029-92f6-43d3-bf0a-f29edbeb348f tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:19.917348 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9da7f450-37cf-4182-ae71-23027f3a1c2c tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/b11f87b9-987d-4c75-9a43-d654ab53de1f" status: 200 len: 2050 microversion: 2.25 time: 0.253351 Oct 18 15:26:19.917507 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cec3a029-92f6-43d3-bf0a-f29edbeb348f tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:19.917939 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 256/516] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:26:19 2022] GET /compute/v2.1/servers/b11f87b9-987d-4c75-9a43-d654ab53de1f => generated 2050 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:26:19.919522 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cec3a029-92f6-43d3-bf0a-f29edbeb348f tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:19.919928 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cec3a029-92f6-43d3-bf0a-f29edbeb348f tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:19.920354 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cec3a029-92f6-43d3-bf0a-f29edbeb348f tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:19.923798 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-74ddf649-2fd0-4591-9410-0d15810ea702 tempest-KeyPairsV210TestJSON-544916316 tempest-KeyPairsV210TestJSON-544916316-project-admin] Calling method '.version_select at 0x7f7c3d824670>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:19.960333 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-74ddf649-2fd0-4591-9410-0d15810ea702 tempest-KeyPairsV210TestJSON-544916316 tempest-KeyPairsV210TestJSON-544916316-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1382566659?user_id=792f7df7f92a426c8f8aeb169c5bce89" status: 204 len: 0 microversion: 2.10 time: 0.041298 Oct 18 15:26:19.966035 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 257/517] 10.222.0.60 () {60 vars in 1343 bytes} [Tue Oct 18 15:26:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1382566659?user_id=792f7df7f92a426c8f8aeb169c5bce89 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 15:26:19.974819 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-972e0bec-7452-406e-bdc7-84c333324f65 tempest-SecurityGroupsTestAdminJSON-1497158442 tempest-SecurityGroupsTestAdminJSON-1497158442-project-admin] Calling method '.version_select at 0x7f7c3d824ee0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:20.132467 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-cec3a029-92f6-43d3-bf0a-f29edbeb348f tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lazy-loading 'flavor' on Instance uuid 29ceb840-1b81-4434-841f-a473cded4b73 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:26:20.216794 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-cec3a029-92f6-43d3-bf0a-f29edbeb348f tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] [instance: 29ceb840-1b81-4434-841f-a473cded4b73] Going to try to live migrate instance to n-h2-853682-5 {{(pid=120405) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 18 15:26:20.259304 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-972e0bec-7452-406e-bdc7-84c333324f65 tempest-SecurityGroupsTestAdminJSON-1497158442 tempest-SecurityGroupsTestAdminJSON-1497158442-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/88eaa38c-c24a-47c6-96d1-961670de0b32" status: 202 len: 0 microversion: 2.1 time: 0.296366 Oct 18 15:26:20.260553 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 258/518] 10.222.0.60 () {58 vars in 1272 bytes} [Tue Oct 18 15:26:19 2022] DELETE /compute/v2.1/os-security-groups/88eaa38c-c24a-47c6-96d1-961670de0b32 => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:26:20.266492 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ad1cae77-869a-4a64-b645-326df4a32e13 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:20.267990 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ad1cae77-869a-4a64-b645-326df4a32e13 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] [instance: 53bb4ff5-ea92-42df-ab9c-4409c6f99dae] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:20.288381 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad1cae77-869a-4a64-b645-326df4a32e13 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:20.299605 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad1cae77-869a-4a64-b645-326df4a32e13 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:20.302359 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad1cae77-869a-4a64-b645-326df4a32e13 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:20.304921 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad1cae77-869a-4a64-b645-326df4a32e13 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:20.306912 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad1cae77-869a-4a64-b645-326df4a32e13 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:20.307324 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad1cae77-869a-4a64-b645-326df4a32e13 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:20.511219 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ad1cae77-869a-4a64-b645-326df4a32e13 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '385ef457207e45b0b843fc2b8ffff7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f40d7ca29449cbb4c2d58df280a01c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:20.524041 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ad1cae77-869a-4a64-b645-326df4a32e13 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] 10.222.0.60 "GET /compute/v2.1/servers/53bb4ff5-ea92-42df-ab9c-4409c6f99dae" status: 200 len: 1320 microversion: 2.1 time: 0.262202 Oct 18 15:26:20.540791 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 259/519] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:20 2022] GET /compute/v2.1/servers/53bb4ff5-ea92-42df-ab9c-4409c6f99dae => generated 1320 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:20.540791 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6a2c42cd-593b-42f4-8800-155d47fea1de tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:20.540791 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6a2c42cd-593b-42f4-8800-155d47fea1de tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] [instance: 19061153-9eed-4374-8799-b497b8a8e780] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:20.554333 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a2c42cd-593b-42f4-8800-155d47fea1de tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:20.555019 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a2c42cd-593b-42f4-8800-155d47fea1de tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:20.555661 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a2c42cd-593b-42f4-8800-155d47fea1de tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:20.557268 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a2c42cd-593b-42f4-8800-155d47fea1de tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:20.557941 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a2c42cd-593b-42f4-8800-155d47fea1de tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:20.558515 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a2c42cd-593b-42f4-8800-155d47fea1de tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:20.794312 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6a2c42cd-593b-42f4-8800-155d47fea1de tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2bbb8b77794404af993e8291343afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6facda3e46640c884583aaf146a8b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:20.803140 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6a2c42cd-593b-42f4-8800-155d47fea1de tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] 10.222.0.60 "GET /compute/v2.1/servers/19061153-9eed-4374-8799-b497b8a8e780" status: 200 len: 1384 microversion: 2.1 time: 0.272121 Oct 18 15:26:20.805523 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 260/520] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:20 2022] GET /compute/v2.1/servers/19061153-9eed-4374-8799-b497b8a8e780 => generated 1384 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:20.811492 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0ae23801-4108-46fd-b3cc-ff8f48e3320e tempest-ImagesMetadataTestJSON-74470835 tempest-ImagesMetadataTestJSON-74470835-project] Calling method '.version_select at 0x7f7c3d7d19d0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:20.859944 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0ae23801-4108-46fd-b3cc-ff8f48e3320e tempest-ImagesMetadataTestJSON-74470835 tempest-ImagesMetadataTestJSON-74470835-project] 10.222.0.60 "GET /compute/v2.1/images/517dc486-620f-48c0-a147-208ee87b88ce/metadata" status: 200 len: 61 microversion: 2.1 time: 0.053208 Oct 18 15:26:20.861107 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 261/521] 10.222.0.60 () {58 vars in 1260 bytes} [Tue Oct 18 15:26:20 2022] GET /compute/v2.1/images/517dc486-620f-48c0-a147-208ee87b88ce/metadata => generated 61 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:26:20.872499 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2d6d48d2-fd5a-438f-a41a-59988dd4c323 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:20.873545 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2d6d48d2-fd5a-438f-a41a-59988dd4c323 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: f07f6211-dd0e-4bdd-969c-fff2c3633dd0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:20.880282 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d6d48d2-fd5a-438f-a41a-59988dd4c323 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:20.881132 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d6d48d2-fd5a-438f-a41a-59988dd4c323 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:20.881797 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d6d48d2-fd5a-438f-a41a-59988dd4c323 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:20.882822 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d6d48d2-fd5a-438f-a41a-59988dd4c323 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:20.883479 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d6d48d2-fd5a-438f-a41a-59988dd4c323 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:20.884104 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d6d48d2-fd5a-438f-a41a-59988dd4c323 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:21.131299 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2d6d48d2-fd5a-438f-a41a-59988dd4c323 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:21.140617 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2d6d48d2-fd5a-438f-a41a-59988dd4c323 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/f07f6211-dd0e-4bdd-969c-fff2c3633dd0" status: 200 len: 1307 microversion: 2.1 time: 0.278209 Oct 18 15:26:21.153249 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 262/522] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:20 2022] GET /compute/v2.1/servers/f07f6211-dd0e-4bdd-969c-fff2c3633dd0 => generated 1307 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:21.162162 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9f26ea0c-9d3b-42f1-8d46-3d6c69f2da65 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1444899559", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "2f9fec7c-78b7-46d8-8366-69a39bab2b6f"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:21.221944 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-9f26ea0c-9d3b-42f1-8d46-3d6c69f2da65 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] validate_networks() for [('2f9fec7c-78b7-46d8-8366-69a39bab2b6f', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:26:21.820463 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9f26ea0c-9d3b-42f1-8d46-3d6c69f2da65 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:26:21.821102 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9f26ea0c-9d3b-42f1-8d46-3d6c69f2da65 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:26:21.821423 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9f26ea0c-9d3b-42f1-8d46-3d6c69f2da65 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:26:21.821841 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9f26ea0c-9d3b-42f1-8d46-3d6c69f2da65 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:26:21.822252 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9f26ea0c-9d3b-42f1-8d46-3d6c69f2da65 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:26:21.832328 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f26ea0c-9d3b-42f1-8d46-3d6c69f2da65 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:21.833082 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f26ea0c-9d3b-42f1-8d46-3d6c69f2da65 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:21.833685 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f26ea0c-9d3b-42f1-8d46-3d6c69f2da65 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:21.834691 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f26ea0c-9d3b-42f1-8d46-3d6c69f2da65 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:21.835143 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f26ea0c-9d3b-42f1-8d46-3d6c69f2da65 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:21.835836 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f26ea0c-9d3b-42f1-8d46-3d6c69f2da65 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:21.844789 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-cec3a029-92f6-43d3-bf0a-f29edbeb348f tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73/action" status: 202 len: 0 microversion: 2.1 time: 1.956203 Oct 18 15:26:21.846067 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 261/523] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:26:19 2022] POST /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73/action => generated 0 bytes in 1959 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:26:21.851028 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-cd932bb9-4c95-4bdd-b13e-2ff6be5c4e91 tempest-SecurityGroupsTestAdminJSON-1497158442 tempest-SecurityGroupsTestAdminJSON-1497158442-project-admin] Calling method '.version_select at 0x7f7c3d9c69d0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:21.861037 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-9f26ea0c-9d3b-42f1-8d46-3d6c69f2da65 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Getting quotas for project bb0579704a194ef89144af0973d68f42. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:26:21.867723 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-9f26ea0c-9d3b-42f1-8d46-3d6c69f2da65 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Getting quotas for user 51490cfdebda47a7b8349677e4d61a59 and project bb0579704a194ef89144af0973d68f42. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:26:21.884651 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9f26ea0c-9d3b-42f1-8d46-3d6c69f2da65 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:26:21.887816 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9f26ea0c-9d3b-42f1-8d46-3d6c69f2da65 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 28a18615-ab69-4e8e-865c-b8e0b67a74f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:26:21.968600 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9f26ea0c-9d3b-42f1-8d46-3d6c69f2da65 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.813090 Oct 18 15:26:21.969802 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 263/524] 10.222.0.60 () {62 vars in 1188 bytes} [Tue Oct 18 15:26:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 815 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 18 15:26:21.984489 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-fbc97e28-ab7e-4a52-8eb4-9a26311a0785 req-5abf91de-a776-492e-812f-b39991f8bfb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f07f6211-dd0e-4bdd-969c-fff2c3633dd0", "tag": "e96c8294-ebda-4535-aedc-4d4ece4fa197"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:22.004424 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-fbc97e28-ab7e-4a52-8eb4-9a26311a0785 req-5abf91de-a776-492e-812f-b39991f8bfb5 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:22.004939 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-fbc97e28-ab7e-4a52-8eb4-9a26311a0785 req-5abf91de-a776-492e-812f-b39991f8bfb5 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:22.005374 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-fbc97e28-ab7e-4a52-8eb4-9a26311a0785 req-5abf91de-a776-492e-812f-b39991f8bfb5 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:22.010180 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:26:22.024318 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-fbc97e28-ab7e-4a52-8eb4-9a26311a0785 req-5abf91de-a776-492e-812f-b39991f8bfb5 service nova] Creating event network-changed:e96c8294-ebda-4535-aedc-4d4ece4fa197 for instance f07f6211-dd0e-4bdd-969c-fff2c3633dd0 on n-h1-853682-5 Oct 18 15:26:22.031217 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-fbc97e28-ab7e-4a52-8eb4-9a26311a0785 req-5abf91de-a776-492e-812f-b39991f8bfb5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059134 Oct 18 15:26:22.031746 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 264/525] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:26:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:26:22.037669 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ab8a086c-259b-437e-9861-b10024e6b4f0 tempest-ImagesMetadataTestJSON-74470835 tempest-ImagesMetadataTestJSON-74470835-project] Action: 'update_all', calling method: .version_select at 0x7f7c3d841700>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:22.047755 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-cd932bb9-4c95-4bdd-b13e-2ff6be5c4e91 tempest-SecurityGroupsTestAdminJSON-1497158442 tempest-SecurityGroupsTestAdminJSON-1497158442-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/4b2d8a83-33eb-498d-ac2b-d504aa118a17" status: 202 len: 0 microversion: 2.1 time: 0.200377 Oct 18 15:26:22.048626 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 262/526] 10.222.0.60 () {58 vars in 1272 bytes} [Tue Oct 18 15:26:21 2022] DELETE /compute/v2.1/os-security-groups/4b2d8a83-33eb-498d-ac2b-d504aa118a17 => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:26:22.055638 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-e3491e2a-0ad8-4a58-a638-4052a0944dce req-fa818747-4d49-4045-8bff-7c61a496f3c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51ccbde5-4cf5-4821-9478-c14e19e73ad1", "name": "network-vif-unplugged", "status": "completed", "tag": "df898d7d-c591-40dd-bff2-fd63cc9d55b0"}, {"server_uuid": "19061153-9eed-4374-8799-b497b8a8e780", "name": "network-vif-plugged", "status": "completed", "tag": "8d08d8f8-c7dc-4676-8853-5174b27e7ce8"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:22.071070 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-e3491e2a-0ad8-4a58-a638-4052a0944dce req-fa818747-4d49-4045-8bff-7c61a496f3c4 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:22.072414 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-e3491e2a-0ad8-4a58-a638-4052a0944dce req-fa818747-4d49-4045-8bff-7c61a496f3c4 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:22.073525 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-e3491e2a-0ad8-4a58-a638-4052a0944dce req-fa818747-4d49-4045-8bff-7c61a496f3c4 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:22.104108 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-e3491e2a-0ad8-4a58-a638-4052a0944dce req-fa818747-4d49-4045-8bff-7c61a496f3c4 service nova] Creating event network-vif-unplugged:df898d7d-c591-40dd-bff2-fd63cc9d55b0 for instance 51ccbde5-4cf5-4821-9478-c14e19e73ad1 on n-h2-853682-5 Oct 18 15:26:22.108126 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-e3491e2a-0ad8-4a58-a638-4052a0944dce req-fa818747-4d49-4045-8bff-7c61a496f3c4 service nova] Creating event network-vif-plugged:8d08d8f8-c7dc-4676-8853-5174b27e7ce8 for instance 19061153-9eed-4374-8799-b497b8a8e780 on n-h2-853682-5 Oct 18 15:26:22.108300 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-ab8a086c-259b-437e-9861-b10024e6b4f0 tempest-ImagesMetadataTestJSON-74470835 tempest-ImagesMetadataTestJSON-74470835-project] Getting quotas for project f837147b731f491b8a8a3ad2ce5e4f1f. Resources: dict_keys(['metadata_items']) {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:26:22.113213 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-ab8a086c-259b-437e-9861-b10024e6b4f0 tempest-ImagesMetadataTestJSON-74470835 tempest-ImagesMetadataTestJSON-74470835-project] Getting quotas for user b4b41842d3ab4820a85369b2be25fe9c and project f837147b731f491b8a8a3ad2ce5e4f1f. Resources: dict_keys(['metadata_items']) {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:26:22.125582 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-e3491e2a-0ad8-4a58-a638-4052a0944dce req-fa818747-4d49-4045-8bff-7c61a496f3c4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.075345 Oct 18 15:26:22.127977 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 263/527] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:26:22 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:26:22.149659 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ca591901-6415-4230-8ac5-a45bf6fd1161 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:22.150601 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ca591901-6415-4230-8ac5-a45bf6fd1161 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] [instance: 53bb4ff5-ea92-42df-ab9c-4409c6f99dae] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:22.174948 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca591901-6415-4230-8ac5-a45bf6fd1161 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:22.175571 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca591901-6415-4230-8ac5-a45bf6fd1161 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:22.176087 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca591901-6415-4230-8ac5-a45bf6fd1161 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:22.179752 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca591901-6415-4230-8ac5-a45bf6fd1161 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:22.179752 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca591901-6415-4230-8ac5-a45bf6fd1161 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:22.179752 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca591901-6415-4230-8ac5-a45bf6fd1161 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:22.279096 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ab8a086c-259b-437e-9861-b10024e6b4f0 tempest-ImagesMetadataTestJSON-74470835 tempest-ImagesMetadataTestJSON-74470835-project] 10.222.0.60 "PUT /compute/v2.1/images/517dc486-620f-48c0-a147-208ee87b88ce/metadata" status: 200 len: 61 microversion: 2.1 time: 0.245929 Oct 18 15:26:22.284577 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 265/528] 10.222.0.60 () {60 vars in 1280 bytes} [Tue Oct 18 15:26:22 2022] PUT /compute/v2.1/images/517dc486-620f-48c0-a147-208ee87b88ce/metadata => generated 61 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:26:22.289402 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4aaa46b2-9542-4ebc-b094-badcdc0070a6 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:22.290143 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4aaa46b2-9542-4ebc-b094-badcdc0070a6 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] [instance: 19061153-9eed-4374-8799-b497b8a8e780] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:22.297418 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4aaa46b2-9542-4ebc-b094-badcdc0070a6 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:22.297914 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4aaa46b2-9542-4ebc-b094-badcdc0070a6 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:22.298348 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4aaa46b2-9542-4ebc-b094-badcdc0070a6 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:22.299732 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4aaa46b2-9542-4ebc-b094-badcdc0070a6 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:22.300359 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4aaa46b2-9542-4ebc-b094-badcdc0070a6 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:22.301081 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4aaa46b2-9542-4ebc-b094-badcdc0070a6 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:22.405541 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ca591901-6415-4230-8ac5-a45bf6fd1161 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '385ef457207e45b0b843fc2b8ffff7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f40d7ca29449cbb4c2d58df280a01c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:22.413375 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ca591901-6415-4230-8ac5-a45bf6fd1161 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] 10.222.0.60 "GET /compute/v2.1/servers/53bb4ff5-ea92-42df-ab9c-4409c6f99dae" status: 200 len: 1470 microversion: 2.1 time: 0.275809 Oct 18 15:26:22.414703 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 264/529] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:22 2022] GET /compute/v2.1/servers/53bb4ff5-ea92-42df-ab9c-4409c6f99dae => generated 1470 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:22.434415 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-de8655e1-9b41-447f-8ac4-916332814875 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:22.435286 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-de8655e1-9b41-447f-8ac4-916332814875 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: 29ceb840-1b81-4434-841f-a473cded4b73] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:22.448298 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de8655e1-9b41-447f-8ac4-916332814875 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:22.449146 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de8655e1-9b41-447f-8ac4-916332814875 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:22.449924 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de8655e1-9b41-447f-8ac4-916332814875 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:22.450810 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de8655e1-9b41-447f-8ac4-916332814875 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:22.451424 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de8655e1-9b41-447f-8ac4-916332814875 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:22.452127 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de8655e1-9b41-447f-8ac4-916332814875 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:22.572972 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4aaa46b2-9542-4ebc-b094-badcdc0070a6 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2bbb8b77794404af993e8291343afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6facda3e46640c884583aaf146a8b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:22.583669 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4aaa46b2-9542-4ebc-b094-badcdc0070a6 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] 10.222.0.60 "GET /compute/v2.1/servers/19061153-9eed-4374-8799-b497b8a8e780" status: 200 len: 1384 microversion: 2.1 time: 0.297920 Oct 18 15:26:22.600230 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 266/530] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:22 2022] GET /compute/v2.1/servers/19061153-9eed-4374-8799-b497b8a8e780 => generated 1384 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:22.600230 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9294c4f4-8ab0-4ded-8dd0-e057469bb737 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:22.600230 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9294c4f4-8ab0-4ded-8dd0-e057469bb737 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 28a18615-ab69-4e8e-865c-b8e0b67a74f4] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:22.600230 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9294c4f4-8ab0-4ded-8dd0-e057469bb737 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:22.600976 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9294c4f4-8ab0-4ded-8dd0-e057469bb737 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:22.600976 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9294c4f4-8ab0-4ded-8dd0-e057469bb737 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:22.600976 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9294c4f4-8ab0-4ded-8dd0-e057469bb737 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:22.600976 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9294c4f4-8ab0-4ded-8dd0-e057469bb737 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:22.601313 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9294c4f4-8ab0-4ded-8dd0-e057469bb737 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:22.681325 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9294c4f4-8ab0-4ded-8dd0-e057469bb737 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:22.687439 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-de8655e1-9b41-447f-8ac4-916332814875 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:22.695590 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-de8655e1-9b41-447f-8ac4-916332814875 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73" status: 200 len: 1502 microversion: 2.1 time: 0.279704 Oct 18 15:26:22.696169 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 265/531] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:22 2022] GET /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73 => generated 1502 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:22.699518 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9294c4f4-8ab0-4ded-8dd0-e057469bb737 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:22.701565 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9294c4f4-8ab0-4ded-8dd0-e057469bb737 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:22.701707 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-99d1c4af-3872-498d-a54a-6fe5d28cc151 tempest-SecurityGroupsTestAdminJSON-1254180834 tempest-SecurityGroupsTestAdminJSON-1254180834-project] Calling method '.version_select at 0x7f7c3d8b0160>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:22.702670 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9294c4f4-8ab0-4ded-8dd0-e057469bb737 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4" status: 200 len: 1266 microversion: 2.25 time: 0.117346 Oct 18 15:26:22.703377 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 267/532] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:26:22 2022] GET /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4 => generated 1266 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:26:22.708452 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dd13e2f6-db6b-4996-bde9-2b164a06454f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:22.709339 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dd13e2f6-db6b-4996-bde9-2b164a06454f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: f07f6211-dd0e-4bdd-969c-fff2c3633dd0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:22.719396 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd13e2f6-db6b-4996-bde9-2b164a06454f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:22.720123 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd13e2f6-db6b-4996-bde9-2b164a06454f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:22.720712 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd13e2f6-db6b-4996-bde9-2b164a06454f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:22.721571 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd13e2f6-db6b-4996-bde9-2b164a06454f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:22.723066 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd13e2f6-db6b-4996-bde9-2b164a06454f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:22.723682 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd13e2f6-db6b-4996-bde9-2b164a06454f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:23.174222 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dd13e2f6-db6b-4996-bde9-2b164a06454f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:23.182114 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dd13e2f6-db6b-4996-bde9-2b164a06454f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/f07f6211-dd0e-4bdd-969c-fff2c3633dd0" status: 200 len: 1307 microversion: 2.1 time: 0.477359 Oct 18 15:26:23.197037 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 268/533] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:22 2022] GET /compute/v2.1/servers/f07f6211-dd0e-4bdd-969c-fff2c3633dd0 => generated 1307 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:23.204961 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-87f1da50-561d-4d74-bd3e-3c6020e8044c tempest-ImagesMetadataTestJSON-74470835 tempest-ImagesMetadataTestJSON-74470835-project] Action: 'update_all', calling method: .version_select at 0x7f7c3d7dec10>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:23.213972 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-99d1c4af-3872-498d-a54a-6fe5d28cc151 tempest-SecurityGroupsTestAdminJSON-1254180834 tempest-SecurityGroupsTestAdminJSON-1254180834-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/5ce241d0-bfb4-4a91-be30-dd42a547cb04" status: 202 len: 0 microversion: 2.1 time: 0.516347 Oct 18 15:26:23.223150 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 266/534] 10.222.0.60 () {58 vars in 1272 bytes} [Tue Oct 18 15:26:22 2022] DELETE /compute/v2.1/os-security-groups/5ce241d0-bfb4-4a91-be30-dd42a547cb04 => generated 0 bytes in 526 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:26:23.239773 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a18ce237-57bb-465d-9270-43ae15f4ffcc tempest-DeleteServersAdminTestJSON-1511257806 tempest-DeleteServersAdminTestJSON-1511257806-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:23.242312 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a18ce237-57bb-465d-9270-43ae15f4ffcc tempest-DeleteServersAdminTestJSON-1511257806 tempest-DeleteServersAdminTestJSON-1511257806-project-admin] [instance: 53bb4ff5-ea92-42df-ab9c-4409c6f99dae] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:23.269163 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-87f1da50-561d-4d74-bd3e-3c6020e8044c tempest-ImagesMetadataTestJSON-74470835 tempest-ImagesMetadataTestJSON-74470835-project] Getting quotas for project f837147b731f491b8a8a3ad2ce5e4f1f. Resources: dict_keys(['metadata_items']) {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:26:23.274608 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-87f1da50-561d-4d74-bd3e-3c6020e8044c tempest-ImagesMetadataTestJSON-74470835 tempest-ImagesMetadataTestJSON-74470835-project] Getting quotas for user b4b41842d3ab4820a85369b2be25fe9c and project f837147b731f491b8a8a3ad2ce5e4f1f. Resources: dict_keys(['metadata_items']) {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:26:23.281130 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a18ce237-57bb-465d-9270-43ae15f4ffcc tempest-DeleteServersAdminTestJSON-1511257806 tempest-DeleteServersAdminTestJSON-1511257806-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:23.281633 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a18ce237-57bb-465d-9270-43ae15f4ffcc tempest-DeleteServersAdminTestJSON-1511257806 tempest-DeleteServersAdminTestJSON-1511257806-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:23.284789 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a18ce237-57bb-465d-9270-43ae15f4ffcc tempest-DeleteServersAdminTestJSON-1511257806 tempest-DeleteServersAdminTestJSON-1511257806-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:23.286246 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a18ce237-57bb-465d-9270-43ae15f4ffcc tempest-DeleteServersAdminTestJSON-1511257806 tempest-DeleteServersAdminTestJSON-1511257806-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:23.289222 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a18ce237-57bb-465d-9270-43ae15f4ffcc tempest-DeleteServersAdminTestJSON-1511257806 tempest-DeleteServersAdminTestJSON-1511257806-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:23.289702 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a18ce237-57bb-465d-9270-43ae15f4ffcc tempest-DeleteServersAdminTestJSON-1511257806 tempest-DeleteServersAdminTestJSON-1511257806-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:23.343856 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:26:23.436442 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a18ce237-57bb-465d-9270-43ae15f4ffcc tempest-DeleteServersAdminTestJSON-1511257806 tempest-DeleteServersAdminTestJSON-1511257806-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/53bb4ff5-ea92-42df-ab9c-4409c6f99dae/action" status: 202 len: 0 microversion: 2.1 time: 0.211726 Oct 18 15:26:23.439981 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 267/535] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:26:23 2022] POST /compute/v2.1/servers/53bb4ff5-ea92-42df-ab9c-4409c6f99dae/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:26:23.445230 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3b3bf694-c67c-4c87-a6ae-4d659b0b5fdd tempest-SecurityGroupsTestAdminJSON-1254180834 tempest-SecurityGroupsTestAdminJSON-1254180834-project] Calling method '.version_select at 0x7f7c3da22a60>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:23.735363 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-87f1da50-561d-4d74-bd3e-3c6020e8044c tempest-ImagesMetadataTestJSON-74470835 tempest-ImagesMetadataTestJSON-74470835-project] 10.222.0.60 "PUT /compute/v2.1/images/517dc486-620f-48c0-a147-208ee87b88ce/metadata" status: 200 len: 64 microversion: 2.1 time: 0.536775 Oct 18 15:26:23.736055 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 269/536] 10.222.0.60 () {60 vars in 1280 bytes} [Tue Oct 18 15:26:23 2022] PUT /compute/v2.1/images/517dc486-620f-48c0-a147-208ee87b88ce/metadata => generated 64 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:26:23.744266 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-315b01ad-3d93-4115-afd3-9ac44b9b24a9 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:23.745117 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-315b01ad-3d93-4115-afd3-9ac44b9b24a9 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] [instance: 53bb4ff5-ea92-42df-ab9c-4409c6f99dae] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:23.746830 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3b3bf694-c67c-4c87-a6ae-4d659b0b5fdd tempest-SecurityGroupsTestAdminJSON-1254180834 tempest-SecurityGroupsTestAdminJSON-1254180834-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/bbae2a98-ff58-44cd-a14c-856122280b62" status: 202 len: 0 microversion: 2.1 time: 0.307834 Oct 18 15:26:23.749587 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 268/537] 10.222.0.60 () {58 vars in 1272 bytes} [Tue Oct 18 15:26:23 2022] DELETE /compute/v2.1/os-security-groups/bbae2a98-ff58-44cd-a14c-856122280b62 => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:26:23.756743 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-aab6e35e-eb9e-4344-9ebf-a1816667d6f1 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:23.761300 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-aab6e35e-eb9e-4344-9ebf-a1816667d6f1 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] [instance: 19061153-9eed-4374-8799-b497b8a8e780] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:23.767421 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-315b01ad-3d93-4115-afd3-9ac44b9b24a9 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:23.771718 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-315b01ad-3d93-4115-afd3-9ac44b9b24a9 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:23.772357 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-315b01ad-3d93-4115-afd3-9ac44b9b24a9 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:23.784500 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-315b01ad-3d93-4115-afd3-9ac44b9b24a9 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:23.787522 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-315b01ad-3d93-4115-afd3-9ac44b9b24a9 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:23.787980 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aab6e35e-eb9e-4344-9ebf-a1816667d6f1 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:23.788891 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aab6e35e-eb9e-4344-9ebf-a1816667d6f1 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:23.789205 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-315b01ad-3d93-4115-afd3-9ac44b9b24a9 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:23.792328 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aab6e35e-eb9e-4344-9ebf-a1816667d6f1 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:23.795358 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aab6e35e-eb9e-4344-9ebf-a1816667d6f1 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:23.796564 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aab6e35e-eb9e-4344-9ebf-a1816667d6f1 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:23.798706 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aab6e35e-eb9e-4344-9ebf-a1816667d6f1 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:23.878809 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-315b01ad-3d93-4115-afd3-9ac44b9b24a9 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:23.879530 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-315b01ad-3d93-4115-afd3-9ac44b9b24a9 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:23.880130 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-315b01ad-3d93-4115-afd3-9ac44b9b24a9 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:23.880949 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-315b01ad-3d93-4115-afd3-9ac44b9b24a9 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lazy-loading 'fault' on Instance uuid 53bb4ff5-ea92-42df-ab9c-4409c6f99dae {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:26:24.193903 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-315b01ad-3d93-4115-afd3-9ac44b9b24a9 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '385ef457207e45b0b843fc2b8ffff7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f40d7ca29449cbb4c2d58df280a01c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:24.200397 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-aab6e35e-eb9e-4344-9ebf-a1816667d6f1 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2bbb8b77794404af993e8291343afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6facda3e46640c884583aaf146a8b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:24.207040 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-315b01ad-3d93-4115-afd3-9ac44b9b24a9 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] 10.222.0.60 "GET /compute/v2.1/servers/53bb4ff5-ea92-42df-ab9c-4409c6f99dae" status: 200 len: 1453 microversion: 2.1 time: 0.469938 Oct 18 15:26:24.209789 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 270/538] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:23 2022] GET /compute/v2.1/servers/53bb4ff5-ea92-42df-ab9c-4409c6f99dae => generated 1453 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:24.232200 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-aab6e35e-eb9e-4344-9ebf-a1816667d6f1 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] 10.222.0.60 "GET /compute/v2.1/servers/19061153-9eed-4374-8799-b497b8a8e780" status: 200 len: 1384 microversion: 2.1 time: 0.477164 Oct 18 15:26:24.233537 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 269/539] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:23 2022] GET /compute/v2.1/servers/19061153-9eed-4374-8799-b497b8a8e780 => generated 1384 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:24.243602 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a678af0a-e156-4293-9959-1596733f1294 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:24.246814 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a678af0a-e156-4293-9959-1596733f1294 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: 29ceb840-1b81-4434-841f-a473cded4b73] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:24.261766 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a678af0a-e156-4293-9959-1596733f1294 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:24.264837 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a678af0a-e156-4293-9959-1596733f1294 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:24.267187 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a678af0a-e156-4293-9959-1596733f1294 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:24.268227 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a678af0a-e156-4293-9959-1596733f1294 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:24.268929 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a678af0a-e156-4293-9959-1596733f1294 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:24.270866 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a678af0a-e156-4293-9959-1596733f1294 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:24.450330 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6eddc0ad-3cb0-4922-94c5-b53a38a3513e tempest-QuotaClassesAdminTestJSON-744168235 tempest-QuotaClassesAdminTestJSON-744168235-project-admin] Calling method '.version_select at 0x7f7c3d824820>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:24.473258 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6eddc0ad-3cb0-4922-94c5-b53a38a3513e tempest-QuotaClassesAdminTestJSON-744168235 tempest-QuotaClassesAdminTestJSON-744168235-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.262082 Oct 18 15:26:24.474421 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 271/540] 10.222.0.60 () {58 vars in 1185 bytes} [Tue Oct 18 15:26:24 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:26:24.481983 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-464bc40d-62e3-4be5-a931-ab254917009c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:24.483012 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-464bc40d-62e3-4be5-a931-ab254917009c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 28a18615-ab69-4e8e-865c-b8e0b67a74f4] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:24.491487 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-464bc40d-62e3-4be5-a931-ab254917009c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:24.492111 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-464bc40d-62e3-4be5-a931-ab254917009c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:24.492732 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-464bc40d-62e3-4be5-a931-ab254917009c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:24.493558 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-464bc40d-62e3-4be5-a931-ab254917009c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:24.494124 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-464bc40d-62e3-4be5-a931-ab254917009c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:24.495531 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-464bc40d-62e3-4be5-a931-ab254917009c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:24.663663 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-464bc40d-62e3-4be5-a931-ab254917009c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:24.673637 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-464bc40d-62e3-4be5-a931-ab254917009c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:24.675294 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-464bc40d-62e3-4be5-a931-ab254917009c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:24.676511 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-464bc40d-62e3-4be5-a931-ab254917009c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4" status: 200 len: 1320 microversion: 2.25 time: 0.200930 Oct 18 15:26:24.677214 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 272/541] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:26:24 2022] GET /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4 => generated 1320 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:26:24.681950 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9f489f11-9de9-4d90-85f8-5ae5ef3a2e4f tempest-ImagesMetadataTestJSON-74470835 tempest-ImagesMetadataTestJSON-74470835-project] Calling method '.version_select at 0x7f7c3d97a0d0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:24.705527 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a678af0a-e156-4293-9959-1596733f1294 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:24.715369 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a678af0a-e156-4293-9959-1596733f1294 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73" status: 200 len: 1502 microversion: 2.1 time: 0.479797 Oct 18 15:26:24.717753 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 270/542] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:24 2022] GET /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73 => generated 1502 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:24.733689 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9f1b23cc-ed15-49cc-bd03-8c3a7bf57530 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:24.735703 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9f1b23cc-ed15-49cc-bd03-8c3a7bf57530 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: f07f6211-dd0e-4bdd-969c-fff2c3633dd0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:24.751204 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9f1b23cc-ed15-49cc-bd03-8c3a7bf57530 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:24.751954 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9f1b23cc-ed15-49cc-bd03-8c3a7bf57530 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:24.752580 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9f1b23cc-ed15-49cc-bd03-8c3a7bf57530 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:24.753111 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9f489f11-9de9-4d90-85f8-5ae5ef3a2e4f tempest-ImagesMetadataTestJSON-74470835 tempest-ImagesMetadataTestJSON-74470835-project] 10.222.0.60 "GET /compute/v2.1/images/517dc486-620f-48c0-a147-208ee87b88ce/metadata" status: 200 len: 64 microversion: 2.1 time: 0.074459 Oct 18 15:26:24.753614 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9f1b23cc-ed15-49cc-bd03-8c3a7bf57530 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:24.754196 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 273/543] 10.222.0.60 () {58 vars in 1260 bytes} [Tue Oct 18 15:26:24 2022] GET /compute/v2.1/images/517dc486-620f-48c0-a147-208ee87b88ce/metadata => generated 64 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:26:24.755646 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9f1b23cc-ed15-49cc-bd03-8c3a7bf57530 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:24.756331 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9f1b23cc-ed15-49cc-bd03-8c3a7bf57530 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:24.759811 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5a824047-a448-4c12-ad0d-6a0c3584ff2b tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:24.760422 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5a824047-a448-4c12-ad0d-6a0c3584ff2b tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] [instance: 53bb4ff5-ea92-42df-ab9c-4409c6f99dae] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:24.768576 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:26:24.779585 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a824047-a448-4c12-ad0d-6a0c3584ff2b tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:24.780218 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a824047-a448-4c12-ad0d-6a0c3584ff2b tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:24.795395 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a824047-a448-4c12-ad0d-6a0c3584ff2b tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:24.796264 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a824047-a448-4c12-ad0d-6a0c3584ff2b tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:24.796755 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a824047-a448-4c12-ad0d-6a0c3584ff2b tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:24.797217 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a824047-a448-4c12-ad0d-6a0c3584ff2b tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:24.829852 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5a824047-a448-4c12-ad0d-6a0c3584ff2b tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] [instance: 53bb4ff5-ea92-42df-ab9c-4409c6f99dae] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:26:24.920077 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5a824047-a448-4c12-ad0d-6a0c3584ff2b tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] 10.222.0.60 "DELETE /compute/v2.1/servers/53bb4ff5-ea92-42df-ab9c-4409c6f99dae" status: 204 len: 0 microversion: 2.1 time: 0.163796 Oct 18 15:26:24.924885 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 274/544] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:26:24 2022] DELETE /compute/v2.1/servers/53bb4ff5-ea92-42df-ab9c-4409c6f99dae => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:26:24.935282 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-49147539-19d4-465a-837d-5aab447d00a0 tempest-QuotaClassesAdminTestJSON-744168235 tempest-QuotaClassesAdminTestJSON-744168235-project-admin] Action: 'update', calling method: .version_select at 0x7f7c3d97a160>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:25.061613 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9f1b23cc-ed15-49cc-bd03-8c3a7bf57530 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:25.071453 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9f1b23cc-ed15-49cc-bd03-8c3a7bf57530 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/f07f6211-dd0e-4bdd-969c-fff2c3633dd0" status: 200 len: 1307 microversion: 2.1 time: 0.352409 Oct 18 15:26:25.073194 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 271/545] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:24 2022] GET /compute/v2.1/servers/f07f6211-dd0e-4bdd-969c-fff2c3633dd0 => generated 1307 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:25.078942 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-08803738-ba6a-4282-829d-ee7339f736a0 tempest-ImagesMetadataTestJSON-74470835 tempest-ImagesMetadataTestJSON-74470835-project] Action: 'update_all', calling method: .version_select at 0x7f7c3d9c65e0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:25.147574 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-08803738-ba6a-4282-829d-ee7339f736a0 tempest-ImagesMetadataTestJSON-74470835 tempest-ImagesMetadataTestJSON-74470835-project] Getting quotas for project f837147b731f491b8a8a3ad2ce5e4f1f. Resources: dict_keys(['metadata_items']) {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:26:25.162195 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-08803738-ba6a-4282-829d-ee7339f736a0 tempest-ImagesMetadataTestJSON-74470835 tempest-ImagesMetadataTestJSON-74470835-project] Getting quotas for user b4b41842d3ab4820a85369b2be25fe9c and project f837147b731f491b8a8a3ad2ce5e4f1f. Resources: dict_keys(['metadata_items']) {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:26:25.207623 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-49147539-19d4-465a-837d-5aab447d00a0 tempest-QuotaClassesAdminTestJSON-744168235 tempest-QuotaClassesAdminTestJSON-744168235-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.277143 Oct 18 15:26:25.214511 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 275/546] 10.222.0.60 () {60 vars in 1206 bytes} [Tue Oct 18 15:26:24 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:26:25.221651 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9e5eed18-c262-4130-ae6a-65208294b95c tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:25.222695 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9e5eed18-c262-4130-ae6a-65208294b95c tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] [instance: 53bb4ff5-ea92-42df-ab9c-4409c6f99dae] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:25.229025 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e5eed18-c262-4130-ae6a-65208294b95c tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:25.229516 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e5eed18-c262-4130-ae6a-65208294b95c tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:25.229954 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e5eed18-c262-4130-ae6a-65208294b95c tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:25.230732 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e5eed18-c262-4130-ae6a-65208294b95c tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:25.231495 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e5eed18-c262-4130-ae6a-65208294b95c tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:25.231920 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e5eed18-c262-4130-ae6a-65208294b95c tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:25.281040 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e5eed18-c262-4130-ae6a-65208294b95c tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:25.281541 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e5eed18-c262-4130-ae6a-65208294b95c tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:25.281936 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e5eed18-c262-4130-ae6a-65208294b95c tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:25.282383 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-9e5eed18-c262-4130-ae6a-65208294b95c tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lazy-loading 'fault' on Instance uuid 53bb4ff5-ea92-42df-ab9c-4409c6f99dae {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:26:25.522261 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-08803738-ba6a-4282-829d-ee7339f736a0 tempest-ImagesMetadataTestJSON-74470835 tempest-ImagesMetadataTestJSON-74470835-project] 10.222.0.60 "PUT /compute/v2.1/images/517dc486-620f-48c0-a147-208ee87b88ce/metadata" status: 200 len: 61 microversion: 2.1 time: 0.447008 Oct 18 15:26:25.526549 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 272/547] 10.222.0.60 () {60 vars in 1280 bytes} [Tue Oct 18 15:26:25 2022] PUT /compute/v2.1/images/517dc486-620f-48c0-a147-208ee87b88ce/metadata => generated 61 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:26:25.531110 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4d7554f0-c0a4-439c-ba5a-278e781ab900 tempest-QuotaClassesAdminTestJSON-744168235 tempest-QuotaClassesAdminTestJSON-744168235-project-admin] Calling method '.version_select at 0x7f7c3da22ca0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:25.543433 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4d7554f0-c0a4-439c-ba5a-278e781ab900 tempest-QuotaClassesAdminTestJSON-744168235 tempest-QuotaClassesAdminTestJSON-744168235-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.015810 Oct 18 15:26:25.544127 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 273/548] 10.222.0.60 () {58 vars in 1185 bytes} [Tue Oct 18 15:26:25 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:26:25.548857 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9be1015a-8695-42dc-8034-b1ad4db7d9e0 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:25.549912 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9be1015a-8695-42dc-8034-b1ad4db7d9e0 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] [instance: 19061153-9eed-4374-8799-b497b8a8e780] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:25.558279 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9be1015a-8695-42dc-8034-b1ad4db7d9e0 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:25.559378 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9be1015a-8695-42dc-8034-b1ad4db7d9e0 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:25.560390 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9be1015a-8695-42dc-8034-b1ad4db7d9e0 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:25.560950 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9be1015a-8695-42dc-8034-b1ad4db7d9e0 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:25.561408 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9be1015a-8695-42dc-8034-b1ad4db7d9e0 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:25.561825 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9be1015a-8695-42dc-8034-b1ad4db7d9e0 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:25.566266 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9e5eed18-c262-4130-ae6a-65208294b95c tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '385ef457207e45b0b843fc2b8ffff7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f40d7ca29449cbb4c2d58df280a01c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:25.574342 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9e5eed18-c262-4130-ae6a-65208294b95c tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] 10.222.0.60 "GET /compute/v2.1/servers/53bb4ff5-ea92-42df-ab9c-4409c6f99dae" status: 200 len: 1459 microversion: 2.1 time: 0.357623 Oct 18 15:26:25.575589 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 276/549] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:25 2022] GET /compute/v2.1/servers/53bb4ff5-ea92-42df-ab9c-4409c6f99dae => generated 1459 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:25.581076 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-294c09b7-58c1-4ac8-a5f9-b88d7d5df30d tempest-ImagesMetadataTestJSON-74470835 tempest-ImagesMetadataTestJSON-74470835-project] Action: 'update', calling method: .version_select at 0x7f7c3d732f70>, body: {"meta": {"os_version": "alt"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:25.634109 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-294c09b7-58c1-4ac8-a5f9-b88d7d5df30d tempest-ImagesMetadataTestJSON-74470835 tempest-ImagesMetadataTestJSON-74470835-project] Getting quotas for project f837147b731f491b8a8a3ad2ce5e4f1f. Resources: dict_keys(['metadata_items']) {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:26:25.641299 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-294c09b7-58c1-4ac8-a5f9-b88d7d5df30d tempest-ImagesMetadataTestJSON-74470835 tempest-ImagesMetadataTestJSON-74470835-project] Getting quotas for user b4b41842d3ab4820a85369b2be25fe9c and project f837147b731f491b8a8a3ad2ce5e4f1f. Resources: dict_keys(['metadata_items']) {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:26:25.833419 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9be1015a-8695-42dc-8034-b1ad4db7d9e0 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2bbb8b77794404af993e8291343afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6facda3e46640c884583aaf146a8b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:25.842549 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9be1015a-8695-42dc-8034-b1ad4db7d9e0 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] 10.222.0.60 "GET /compute/v2.1/servers/19061153-9eed-4374-8799-b497b8a8e780" status: 200 len: 1584 microversion: 2.1 time: 0.297309 Oct 18 15:26:25.843133 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 274/550] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:25 2022] GET /compute/v2.1/servers/19061153-9eed-4374-8799-b497b8a8e780 => generated 1584 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:25.860619 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-50675d9a-5cdb-4909-9ae4-0819c0a3f7f0 tempest-QuotaClassesAdminTestJSON-744168235 tempest-QuotaClassesAdminTestJSON-744168235-project-admin] Action: 'update', calling method: .version_select at 0x7f7c3d87f040>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:25.910951 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=2,nova_api:DELETE=2,nova_api:UPDATE=3 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:26:25.994905 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-294c09b7-58c1-4ac8-a5f9-b88d7d5df30d tempest-ImagesMetadataTestJSON-74470835 tempest-ImagesMetadataTestJSON-74470835-project] 10.222.0.60 "PUT /compute/v2.1/images/517dc486-620f-48c0-a147-208ee87b88ce/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.417967 Oct 18 15:26:25.995948 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 277/551] 10.222.0.60 () {60 vars in 1313 bytes} [Tue Oct 18 15:26:25 2022] PUT /compute/v2.1/images/517dc486-620f-48c0-a147-208ee87b88ce/metadata/os_version => generated 31 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:26:26.001748 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e8199dfa-b581-487a-b1db-638f66f88565 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:26.004299 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e8199dfa-b581-487a-b1db-638f66f88565 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 28a18615-ab69-4e8e-865c-b8e0b67a74f4] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:26.021113 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8199dfa-b581-487a-b1db-638f66f88565 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:26.021606 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8199dfa-b581-487a-b1db-638f66f88565 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:26.022035 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8199dfa-b581-487a-b1db-638f66f88565 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:26.022734 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8199dfa-b581-487a-b1db-638f66f88565 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:26.023183 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8199dfa-b581-487a-b1db-638f66f88565 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:26.023605 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8199dfa-b581-487a-b1db-638f66f88565 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:26.037138 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-50675d9a-5cdb-4909-9ae4-0819c0a3f7f0 tempest-QuotaClassesAdminTestJSON-744168235 tempest-QuotaClassesAdminTestJSON-744168235-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.192889 Oct 18 15:26:26.038147 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 275/552] 10.222.0.60 () {60 vars in 1206 bytes} [Tue Oct 18 15:26:25 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:26:26.043906 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7663b9b7-6562-4a6c-9a99-817b0b90cc24 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:26.046616 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7663b9b7-6562-4a6c-9a99-817b0b90cc24 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: 29ceb840-1b81-4434-841f-a473cded4b73] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:26.055378 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7663b9b7-6562-4a6c-9a99-817b0b90cc24 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:26.056153 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7663b9b7-6562-4a6c-9a99-817b0b90cc24 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:26.056780 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7663b9b7-6562-4a6c-9a99-817b0b90cc24 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:26.057828 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7663b9b7-6562-4a6c-9a99-817b0b90cc24 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:26.058444 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7663b9b7-6562-4a6c-9a99-817b0b90cc24 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:26.059605 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7663b9b7-6562-4a6c-9a99-817b0b90cc24 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:26.536177 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e8199dfa-b581-487a-b1db-638f66f88565 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:26.547073 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e8199dfa-b581-487a-b1db-638f66f88565 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:26.551483 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e8199dfa-b581-487a-b1db-638f66f88565 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:26.552641 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e8199dfa-b581-487a-b1db-638f66f88565 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4" status: 200 len: 1362 microversion: 2.25 time: 0.554917 Oct 18 15:26:26.553223 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 278/553] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:26:25 2022] GET /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4 => generated 1362 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:26:26.558595 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7663b9b7-6562-4a6c-9a99-817b0b90cc24 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:26.564226 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ac98909d-0a36-4d64-9752-dca348095403 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:26.564718 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ac98909d-0a36-4d64-9752-dca348095403 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] [instance: 19061153-9eed-4374-8799-b497b8a8e780] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:26.574028 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7663b9b7-6562-4a6c-9a99-817b0b90cc24 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73" status: 200 len: 1502 microversion: 2.1 time: 0.533964 Oct 18 15:26:26.578646 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 276/554] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:26 2022] GET /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73 => generated 1502 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:26.591074 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-63083c00-9595-4299-baf8-b704042d1a8e tempest-ImagesMetadataTestJSON-74470835 tempest-ImagesMetadataTestJSON-74470835-project] Calling method '.version_select at 0x7f7c3d99d940>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:26.594766 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac98909d-0a36-4d64-9752-dca348095403 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:26.595260 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac98909d-0a36-4d64-9752-dca348095403 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:26.595692 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac98909d-0a36-4d64-9752-dca348095403 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:26.596401 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac98909d-0a36-4d64-9752-dca348095403 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:26.596911 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac98909d-0a36-4d64-9752-dca348095403 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:26.597339 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac98909d-0a36-4d64-9752-dca348095403 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:26.663437 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-63083c00-9595-4299-baf8-b704042d1a8e tempest-ImagesMetadataTestJSON-74470835 tempest-ImagesMetadataTestJSON-74470835-project] 10.222.0.60 "GET /compute/v2.1/images/517dc486-620f-48c0-a147-208ee87b88ce/metadata" status: 200 len: 58 microversion: 2.1 time: 0.082098 Oct 18 15:26:26.668554 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 277/555] 10.222.0.60 () {58 vars in 1260 bytes} [Tue Oct 18 15:26:26 2022] GET /compute/v2.1/images/517dc486-620f-48c0-a147-208ee87b88ce/metadata => generated 58 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:26:26.678727 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-789e5ad5-8316-40c2-b9a9-9bbc186dc0f6 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:26.695039 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-789e5ad5-8316-40c2-b9a9-9bbc186dc0f6 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: f07f6211-dd0e-4bdd-969c-fff2c3633dd0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:26.713936 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-789e5ad5-8316-40c2-b9a9-9bbc186dc0f6 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:26.714876 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-789e5ad5-8316-40c2-b9a9-9bbc186dc0f6 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:26.715927 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-789e5ad5-8316-40c2-b9a9-9bbc186dc0f6 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:26.716702 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-789e5ad5-8316-40c2-b9a9-9bbc186dc0f6 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:26.717202 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-789e5ad5-8316-40c2-b9a9-9bbc186dc0f6 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:26.717634 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-789e5ad5-8316-40c2-b9a9-9bbc186dc0f6 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:26.766725 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ac98909d-0a36-4d64-9752-dca348095403 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] 10.222.0.60 "GET /compute/v2.1/servers/19061153-9eed-4374-8799-b497b8a8e780/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.212333 Oct 18 15:26:26.768781 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 279/556] 10.222.0.60 () {58 vars in 1275 bytes} [Tue Oct 18 15:26:26 2022] GET /compute/v2.1/servers/19061153-9eed-4374-8799-b497b8a8e780/os-interface => generated 285 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:26:26.775814 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-aa9c82b4-a904-4929-9df9-dfae507096f7 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:26.776601 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-aa9c82b4-a904-4929-9df9-dfae507096f7 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] [instance: 53bb4ff5-ea92-42df-ab9c-4409c6f99dae] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:26.784931 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa9c82b4-a904-4929-9df9-dfae507096f7 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:26.785819 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa9c82b4-a904-4929-9df9-dfae507096f7 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:26.786413 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa9c82b4-a904-4929-9df9-dfae507096f7 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:26.787382 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa9c82b4-a904-4929-9df9-dfae507096f7 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:26.788032 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa9c82b4-a904-4929-9df9-dfae507096f7 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:26.789536 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa9c82b4-a904-4929-9df9-dfae507096f7 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:26.830482 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa9c82b4-a904-4929-9df9-dfae507096f7 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:26.831115 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa9c82b4-a904-4929-9df9-dfae507096f7 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:26.831559 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa9c82b4-a904-4929-9df9-dfae507096f7 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:26.832012 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-aa9c82b4-a904-4929-9df9-dfae507096f7 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lazy-loading 'fault' on Instance uuid 53bb4ff5-ea92-42df-ab9c-4409c6f99dae {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:26:27.376643 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-789e5ad5-8316-40c2-b9a9-9bbc186dc0f6 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:27.389565 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-789e5ad5-8316-40c2-b9a9-9bbc186dc0f6 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/f07f6211-dd0e-4bdd-969c-fff2c3633dd0" status: 200 len: 1307 microversion: 2.1 time: 0.716854 Oct 18 15:26:27.390540 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 278/557] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:26 2022] GET /compute/v2.1/servers/f07f6211-dd0e-4bdd-969c-fff2c3633dd0 => generated 1307 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:27.400282 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0056919e-8fb3-4a4a-9e78-cf7d42ea8ae5 tempest-ImagesMetadataTestJSON-74470835 tempest-ImagesMetadataTestJSON-74470835-project] Action: 'update_all', calling method: .version_select at 0x7f7c3d99dca0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:27.477361 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-aa9c82b4-a904-4929-9df9-dfae507096f7 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '385ef457207e45b0b843fc2b8ffff7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f40d7ca29449cbb4c2d58df280a01c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:27.510740 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-aa9c82b4-a904-4929-9df9-dfae507096f7 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] 10.222.0.60 "GET /compute/v2.1/servers/53bb4ff5-ea92-42df-ab9c-4409c6f99dae" status: 200 len: 1459 microversion: 2.1 time: 0.737643 Oct 18 15:26:27.512225 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 280/558] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:26 2022] GET /compute/v2.1/servers/53bb4ff5-ea92-42df-ab9c-4409c6f99dae => generated 1459 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:27.538553 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-44189cdf-da84-4f51-a45d-e42fec23a462 req-c169c893-9b57-420c-9ae1-084bda07c50a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29ceb840-1b81-4434-841f-a473cded4b73", "name": "network-vif-unplugged", "status": "completed", "tag": "1b04f10d-4830-4b9e-b179-bd983eaea7e2"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:27.544411 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-0056919e-8fb3-4a4a-9e78-cf7d42ea8ae5 tempest-ImagesMetadataTestJSON-74470835 tempest-ImagesMetadataTestJSON-74470835-project] Getting quotas for project f837147b731f491b8a8a3ad2ce5e4f1f. Resources: dict_keys(['metadata_items']) {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:26:27.555524 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-44189cdf-da84-4f51-a45d-e42fec23a462 req-c169c893-9b57-420c-9ae1-084bda07c50a service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:27.556265 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-44189cdf-da84-4f51-a45d-e42fec23a462 req-c169c893-9b57-420c-9ae1-084bda07c50a service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:27.556902 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-44189cdf-da84-4f51-a45d-e42fec23a462 req-c169c893-9b57-420c-9ae1-084bda07c50a service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:27.571770 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-0056919e-8fb3-4a4a-9e78-cf7d42ea8ae5 tempest-ImagesMetadataTestJSON-74470835 tempest-ImagesMetadataTestJSON-74470835-project] Getting quotas for user b4b41842d3ab4820a85369b2be25fe9c and project f837147b731f491b8a8a3ad2ce5e4f1f. Resources: dict_keys(['metadata_items']) {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:26:27.578097 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-44189cdf-da84-4f51-a45d-e42fec23a462 req-c169c893-9b57-420c-9ae1-084bda07c50a service nova] Creating event network-vif-unplugged:1b04f10d-4830-4b9e-b179-bd983eaea7e2 for instance 29ceb840-1b81-4434-841f-a473cded4b73 on n-h1-853682-5 Oct 18 15:26:27.595849 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-44189cdf-da84-4f51-a45d-e42fec23a462 req-c169c893-9b57-420c-9ae1-084bda07c50a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072910 Oct 18 15:26:27.597206 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 281/559] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:26:27.606882 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a2c115bd-e47c-4dae-ab77-2e8242835480 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:27.608208 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a2c115bd-e47c-4dae-ab77-2e8242835480 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 28a18615-ab69-4e8e-865c-b8e0b67a74f4] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:27.617629 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2c115bd-e47c-4dae-ab77-2e8242835480 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:27.618687 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2c115bd-e47c-4dae-ab77-2e8242835480 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:27.619395 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2c115bd-e47c-4dae-ab77-2e8242835480 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:27.621419 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2c115bd-e47c-4dae-ab77-2e8242835480 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:27.622116 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2c115bd-e47c-4dae-ab77-2e8242835480 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:27.622731 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2c115bd-e47c-4dae-ab77-2e8242835480 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:27.945695 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a2c115bd-e47c-4dae-ab77-2e8242835480 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:27.969374 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a2c115bd-e47c-4dae-ab77-2e8242835480 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:27.972720 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a2c115bd-e47c-4dae-ab77-2e8242835480 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:27.979962 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a2c115bd-e47c-4dae-ab77-2e8242835480 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4" status: 200 len: 1362 microversion: 2.25 time: 0.381071 Oct 18 15:26:27.981215 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 282/560] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:26:27 2022] GET /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4 => generated 1362 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:26:27.989042 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0056919e-8fb3-4a4a-9e78-cf7d42ea8ae5 tempest-ImagesMetadataTestJSON-74470835 tempest-ImagesMetadataTestJSON-74470835-project] 10.222.0.60 "PUT /compute/v2.1/images/517dc486-620f-48c0-a147-208ee87b88ce/metadata" status: 200 len: 61 microversion: 2.1 time: 0.596456 Oct 18 15:26:27.989739 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 279/561] 10.222.0.60 () {60 vars in 1280 bytes} [Tue Oct 18 15:26:27 2022] PUT /compute/v2.1/images/517dc486-620f-48c0-a147-208ee87b88ce/metadata => generated 61 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:26:28.009119 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6ce217e4-7127-43b1-929e-c9e2a22c81fb tempest-ImagesMetadataTestJSON-74470835 tempest-ImagesMetadataTestJSON-74470835-project] Action: 'create', calling method: .version_select at 0x7f7c3db600d0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:28.018583 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3aa8e2ae-6a8d-4a26-884d-cab07b71e811 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:28.019513 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3aa8e2ae-6a8d-4a26-884d-cab07b71e811 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: 29ceb840-1b81-4434-841f-a473cded4b73] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:28.034633 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3aa8e2ae-6a8d-4a26-884d-cab07b71e811 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:28.035131 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3aa8e2ae-6a8d-4a26-884d-cab07b71e811 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:28.040274 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3aa8e2ae-6a8d-4a26-884d-cab07b71e811 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:28.041104 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3aa8e2ae-6a8d-4a26-884d-cab07b71e811 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:28.042377 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3aa8e2ae-6a8d-4a26-884d-cab07b71e811 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:28.042957 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3aa8e2ae-6a8d-4a26-884d-cab07b71e811 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:28.092079 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-6ce217e4-7127-43b1-929e-c9e2a22c81fb tempest-ImagesMetadataTestJSON-74470835 tempest-ImagesMetadataTestJSON-74470835-project] Getting quotas for project f837147b731f491b8a8a3ad2ce5e4f1f. Resources: dict_keys(['metadata_items']) {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:26:28.099594 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-6ce217e4-7127-43b1-929e-c9e2a22c81fb tempest-ImagesMetadataTestJSON-74470835 tempest-ImagesMetadataTestJSON-74470835-project] Getting quotas for user b4b41842d3ab4820a85369b2be25fe9c and project f837147b731f491b8a8a3ad2ce5e4f1f. Resources: dict_keys(['metadata_items']) {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:26:28.521449 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6ce217e4-7127-43b1-929e-c9e2a22c81fb tempest-ImagesMetadataTestJSON-74470835 tempest-ImagesMetadataTestJSON-74470835-project] 10.222.0.60 "POST /compute/v2.1/images/517dc486-620f-48c0-a147-208ee87b88ce/metadata" status: 200 len: 85 microversion: 2.1 time: 0.523790 Oct 18 15:26:28.523488 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 280/562] 10.222.0.60 () {60 vars in 1281 bytes} [Tue Oct 18 15:26:27 2022] POST /compute/v2.1/images/517dc486-620f-48c0-a147-208ee87b88ce/metadata => generated 85 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:26:28.579633 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3aa8e2ae-6a8d-4a26-884d-cab07b71e811 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:28.588309 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3aa8e2ae-6a8d-4a26-884d-cab07b71e811 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73" status: 200 len: 1502 microversion: 2.1 time: 0.605006 Oct 18 15:26:28.589158 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 283/563] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:27 2022] GET /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73 => generated 1502 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:28.594811 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-7e04412a-a841-48ae-b81c-b04ba146d6a5 req-4b9335b5-0b07-4a04-a287-718fc8d5bb70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53bb4ff5-ea92-42df-ab9c-4409c6f99dae", "name": "network-vif-deleted", "tag": "0ae67927-c3c7-442e-8482-14b2626c726b"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:28.628744 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7e04412a-a841-48ae-b81c-b04ba146d6a5 req-4b9335b5-0b07-4a04-a287-718fc8d5bb70 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:28.633584 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7e04412a-a841-48ae-b81c-b04ba146d6a5 req-4b9335b5-0b07-4a04-a287-718fc8d5bb70 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:28.635259 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7e04412a-a841-48ae-b81c-b04ba146d6a5 req-4b9335b5-0b07-4a04-a287-718fc8d5bb70 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:28.662064 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-7e04412a-a841-48ae-b81c-b04ba146d6a5 req-4b9335b5-0b07-4a04-a287-718fc8d5bb70 service nova] Creating event network-vif-deleted:0ae67927-c3c7-442e-8482-14b2626c726b for instance 53bb4ff5-ea92-42df-ab9c-4409c6f99dae on n-h2-853682-5 Oct 18 15:26:28.676221 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-7e04412a-a841-48ae-b81c-b04ba146d6a5 req-4b9335b5-0b07-4a04-a287-718fc8d5bb70 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085321 Oct 18 15:26:28.677770 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 284/564] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:26:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:26:28.702860 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0acb91b7-0344-4554-b19b-21888e2a3d35 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:28.704145 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0acb91b7-0344-4554-b19b-21888e2a3d35 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: f07f6211-dd0e-4bdd-969c-fff2c3633dd0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:28.711722 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0acb91b7-0344-4554-b19b-21888e2a3d35 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:28.712219 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0acb91b7-0344-4554-b19b-21888e2a3d35 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:28.712658 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0acb91b7-0344-4554-b19b-21888e2a3d35 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:28.713403 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0acb91b7-0344-4554-b19b-21888e2a3d35 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:28.713861 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0acb91b7-0344-4554-b19b-21888e2a3d35 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:28.714296 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0acb91b7-0344-4554-b19b-21888e2a3d35 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:28.749088 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f4999f6e-fbce-4865-b574-9942817689d6 tempest-ServicesAdminNegativeTestJSON-1329123421 tempest-ServicesAdminNegativeTestJSON-1329123421-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:28.753016 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f4999f6e-fbce-4865-b574-9942817689d6 tempest-ServicesAdminNegativeTestJSON-1329123421 tempest-ServicesAdminNegativeTestJSON-1329123421-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:28.753509 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f4999f6e-fbce-4865-b574-9942817689d6 tempest-ServicesAdminNegativeTestJSON-1329123421 tempest-ServicesAdminNegativeTestJSON-1329123421-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:28.753952 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f4999f6e-fbce-4865-b574-9942817689d6 tempest-ServicesAdminNegativeTestJSON-1329123421 tempest-ServicesAdminNegativeTestJSON-1329123421-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:28.754704 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f4999f6e-fbce-4865-b574-9942817689d6 tempest-ServicesAdminNegativeTestJSON-1329123421 tempest-ServicesAdminNegativeTestJSON-1329123421-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:28.755162 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f4999f6e-fbce-4865-b574-9942817689d6 tempest-ServicesAdminNegativeTestJSON-1329123421 tempest-ServicesAdminNegativeTestJSON-1329123421-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:28.755592 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f4999f6e-fbce-4865-b574-9942817689d6 tempest-ServicesAdminNegativeTestJSON-1329123421 tempest-ServicesAdminNegativeTestJSON-1329123421-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:28.802250 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f4999f6e-fbce-4865-b574-9942817689d6 tempest-ServicesAdminNegativeTestJSON-1329123421 tempest-ServicesAdminNegativeTestJSON-1329123421-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.277354 Oct 18 15:26:28.802853 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 281/565] 10.222.0.60 () {58 vars in 1137 bytes} [Tue Oct 18 15:26:28 2022] GET /compute/v2.1/os-services => generated 944 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:26:28.807836 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-397897da-94ee-4c93-a4e0-62dda62f2743 req-f6cf667b-3f63-4580-8b1c-81534289be24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f07f6211-dd0e-4bdd-969c-fff2c3633dd0", "name": "network-vif-plugged", "status": "completed", "tag": "e96c8294-ebda-4535-aedc-4d4ece4fa197"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:28.818512 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-397897da-94ee-4c93-a4e0-62dda62f2743 req-f6cf667b-3f63-4580-8b1c-81534289be24 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:28.818986 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-397897da-94ee-4c93-a4e0-62dda62f2743 req-f6cf667b-3f63-4580-8b1c-81534289be24 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:28.819410 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-397897da-94ee-4c93-a4e0-62dda62f2743 req-f6cf667b-3f63-4580-8b1c-81534289be24 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:28.831139 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-397897da-94ee-4c93-a4e0-62dda62f2743 req-f6cf667b-3f63-4580-8b1c-81534289be24 service nova] Creating event network-vif-plugged:e96c8294-ebda-4535-aedc-4d4ece4fa197 for instance f07f6211-dd0e-4bdd-969c-fff2c3633dd0 on n-h1-853682-5 Oct 18 15:26:28.843156 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-397897da-94ee-4c93-a4e0-62dda62f2743 req-f6cf667b-3f63-4580-8b1c-81534289be24 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038813 Oct 18 15:26:28.844528 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 282/566] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:26:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:26:28.850724 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a4be3183-e081-4d8f-b92e-9f4f914b1024 tempest-ImagesMetadataTestJSON-74470835 tempest-ImagesMetadataTestJSON-74470835-project] Calling method '.version_select at 0x7f7c3d881700>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:28.917466 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a4be3183-e081-4d8f-b92e-9f4f914b1024 tempest-ImagesMetadataTestJSON-74470835 tempest-ImagesMetadataTestJSON-74470835-project] 10.222.0.60 "GET /compute/v2.1/images/517dc486-620f-48c0-a147-208ee87b88ce/metadata" status: 200 len: 85 microversion: 2.1 time: 0.071281 Oct 18 15:26:28.919476 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 283/567] 10.222.0.60 () {58 vars in 1260 bytes} [Tue Oct 18 15:26:28 2022] GET /compute/v2.1/images/517dc486-620f-48c0-a147-208ee87b88ce/metadata => generated 85 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:26:28.956550 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0acb91b7-0344-4554-b19b-21888e2a3d35 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:28.965199 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c8058840-aa03-430e-a3fb-15c5819f411c tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:28.968262 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0acb91b7-0344-4554-b19b-21888e2a3d35 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/f07f6211-dd0e-4bdd-969c-fff2c3633dd0" status: 200 len: 1307 microversion: 2.1 time: 0.289081 Oct 18 15:26:28.970738 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c8058840-aa03-430e-a3fb-15c5819f411c tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] [instance: 53bb4ff5-ea92-42df-ab9c-4409c6f99dae] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:28.971687 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 285/568] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:28 2022] GET /compute/v2.1/servers/f07f6211-dd0e-4bdd-969c-fff2c3633dd0 => generated 1307 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:28.982981 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a1499251-3371-4fdd-89aa-32d9a8025d50 tempest-ServicesAdminNegativeTestJSON-1329123421 tempest-ServicesAdminNegativeTestJSON-1329123421-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:28.986733 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1499251-3371-4fdd-89aa-32d9a8025d50 tempest-ServicesAdminNegativeTestJSON-1329123421 tempest-ServicesAdminNegativeTestJSON-1329123421-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:28.987218 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1499251-3371-4fdd-89aa-32d9a8025d50 tempest-ServicesAdminNegativeTestJSON-1329123421 tempest-ServicesAdminNegativeTestJSON-1329123421-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:28.987646 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1499251-3371-4fdd-89aa-32d9a8025d50 tempest-ServicesAdminNegativeTestJSON-1329123421 tempest-ServicesAdminNegativeTestJSON-1329123421-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:28.996706 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1499251-3371-4fdd-89aa-32d9a8025d50 tempest-ServicesAdminNegativeTestJSON-1329123421 tempest-ServicesAdminNegativeTestJSON-1329123421-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:28.997545 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c8058840-aa03-430e-a3fb-15c5819f411c tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:28.998108 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c8058840-aa03-430e-a3fb-15c5819f411c tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:28.998518 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c8058840-aa03-430e-a3fb-15c5819f411c tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:28.998691 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1499251-3371-4fdd-89aa-32d9a8025d50 tempest-ServicesAdminNegativeTestJSON-1329123421 tempest-ServicesAdminNegativeTestJSON-1329123421-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:28.999239 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c8058840-aa03-430e-a3fb-15c5819f411c tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:28.999760 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1499251-3371-4fdd-89aa-32d9a8025d50 tempest-ServicesAdminNegativeTestJSON-1329123421 tempest-ServicesAdminNegativeTestJSON-1329123421-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:29.002326 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c8058840-aa03-430e-a3fb-15c5819f411c tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:29.005382 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c8058840-aa03-430e-a3fb-15c5819f411c tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:29.048337 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a1499251-3371-4fdd-89aa-32d9a8025d50 tempest-ServicesAdminNegativeTestJSON-1329123421 tempest-ServicesAdminNegativeTestJSON-1329123421-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.073317 Oct 18 15:26:29.063531 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 286/569] 10.222.0.60 () {58 vars in 1170 bytes} [Tue Oct 18 15:26:28 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:26:29.078445 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-029e5c83-606b-4b66-b979-b4df49b99b31 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:29.079685 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-029e5c83-606b-4b66-b979-b4df49b99b31 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 28a18615-ab69-4e8e-865c-b8e0b67a74f4] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:29.085551 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c8058840-aa03-430e-a3fb-15c5819f411c tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:29.085983 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c8058840-aa03-430e-a3fb-15c5819f411c tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:29.086439 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c8058840-aa03-430e-a3fb-15c5819f411c tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:29.088183 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-c8058840-aa03-430e-a3fb-15c5819f411c tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lazy-loading 'fault' on Instance uuid 53bb4ff5-ea92-42df-ab9c-4409c6f99dae {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:26:29.092725 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-029e5c83-606b-4b66-b979-b4df49b99b31 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:29.093548 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-029e5c83-606b-4b66-b979-b4df49b99b31 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:29.095204 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-029e5c83-606b-4b66-b979-b4df49b99b31 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:29.096409 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-029e5c83-606b-4b66-b979-b4df49b99b31 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:29.097726 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-029e5c83-606b-4b66-b979-b4df49b99b31 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:29.099497 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-029e5c83-606b-4b66-b979-b4df49b99b31 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:29.109725 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:26:29.271872 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c8058840-aa03-430e-a3fb-15c5819f411c tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '385ef457207e45b0b843fc2b8ffff7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f40d7ca29449cbb4c2d58df280a01c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:29.283237 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c8058840-aa03-430e-a3fb-15c5819f411c tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] 10.222.0.60 "GET /compute/v2.1/servers/53bb4ff5-ea92-42df-ab9c-4409c6f99dae" status: 200 len: 1310 microversion: 2.1 time: 0.360154 Oct 18 15:26:29.284277 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 284/570] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:28 2022] GET /compute/v2.1/servers/53bb4ff5-ea92-42df-ab9c-4409c6f99dae => generated 1310 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:29.296518 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e388041b-13ea-48eb-b000-b2946f3f6a11 tempest-ServicesAdminNegativeTestJSON-1329123421 tempest-ServicesAdminNegativeTestJSON-1329123421-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:29.306878 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e388041b-13ea-48eb-b000-b2946f3f6a11 tempest-ServicesAdminNegativeTestJSON-1329123421 tempest-ServicesAdminNegativeTestJSON-1329123421-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:29.309214 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e388041b-13ea-48eb-b000-b2946f3f6a11 tempest-ServicesAdminNegativeTestJSON-1329123421 tempest-ServicesAdminNegativeTestJSON-1329123421-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:29.309677 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e388041b-13ea-48eb-b000-b2946f3f6a11 tempest-ServicesAdminNegativeTestJSON-1329123421 tempest-ServicesAdminNegativeTestJSON-1329123421-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:29.312042 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e388041b-13ea-48eb-b000-b2946f3f6a11 tempest-ServicesAdminNegativeTestJSON-1329123421 tempest-ServicesAdminNegativeTestJSON-1329123421-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:29.313435 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e388041b-13ea-48eb-b000-b2946f3f6a11 tempest-ServicesAdminNegativeTestJSON-1329123421 tempest-ServicesAdminNegativeTestJSON-1329123421-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:29.313878 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e388041b-13ea-48eb-b000-b2946f3f6a11 tempest-ServicesAdminNegativeTestJSON-1329123421 tempest-ServicesAdminNegativeTestJSON-1329123421-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:29.357615 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e388041b-13ea-48eb-b000-b2946f3f6a11 tempest-ServicesAdminNegativeTestJSON-1329123421 tempest-ServicesAdminNegativeTestJSON-1329123421-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.071319 Oct 18 15:26:29.358437 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 285/571] 10.222.0.60 () {58 vars in 1137 bytes} [Tue Oct 18 15:26:29 2022] GET /compute/v2.1/os-services => generated 944 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:26:29.371060 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-77c556b5-b129-46a1-930b-de7eeb1fb09e tempest-ServicesAdminNegativeTestJSON-1329123421 tempest-ServicesAdminNegativeTestJSON-1329123421-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:29.375649 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-77c556b5-b129-46a1-930b-de7eeb1fb09e tempest-ServicesAdminNegativeTestJSON-1329123421 tempest-ServicesAdminNegativeTestJSON-1329123421-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:29.376353 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-77c556b5-b129-46a1-930b-de7eeb1fb09e tempest-ServicesAdminNegativeTestJSON-1329123421 tempest-ServicesAdminNegativeTestJSON-1329123421-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:29.377188 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-77c556b5-b129-46a1-930b-de7eeb1fb09e tempest-ServicesAdminNegativeTestJSON-1329123421 tempest-ServicesAdminNegativeTestJSON-1329123421-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:29.378322 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-77c556b5-b129-46a1-930b-de7eeb1fb09e tempest-ServicesAdminNegativeTestJSON-1329123421 tempest-ServicesAdminNegativeTestJSON-1329123421-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:29.379007 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-77c556b5-b129-46a1-930b-de7eeb1fb09e tempest-ServicesAdminNegativeTestJSON-1329123421 tempest-ServicesAdminNegativeTestJSON-1329123421-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:29.379627 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-77c556b5-b129-46a1-930b-de7eeb1fb09e tempest-ServicesAdminNegativeTestJSON-1329123421 tempest-ServicesAdminNegativeTestJSON-1329123421-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:29.403270 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-029e5c83-606b-4b66-b979-b4df49b99b31 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:29.405512 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-77c556b5-b129-46a1-930b-de7eeb1fb09e tempest-ServicesAdminNegativeTestJSON-1329123421 tempest-ServicesAdminNegativeTestJSON-1329123421-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?host=n-d-853682-5&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.038459 Oct 18 15:26:29.406426 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 286/572] 10.222.0.60 () {58 vars in 1194 bytes} [Tue Oct 18 15:26:29 2022] GET /compute/v2.1/os-services?host=n-d-853682-5&binary=xxx => generated 16 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 18 15:26:29.414184 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-029e5c83-606b-4b66-b979-b4df49b99b31 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:29.415762 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-029e5c83-606b-4b66-b979-b4df49b99b31 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:29.417003 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-029e5c83-606b-4b66-b979-b4df49b99b31 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4" status: 200 len: 1362 microversion: 2.25 time: 0.352369 Oct 18 15:26:29.417955 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 287/573] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:26:29 2022] GET /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4 => generated 1362 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:26:29.431857 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e200bc5c-01e6-4dd4-8a56-75c700e22567 tempest-ServicesAdminNegativeTestJSON-1329123421 tempest-ServicesAdminNegativeTestJSON-1329123421-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:29.437264 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e200bc5c-01e6-4dd4-8a56-75c700e22567 tempest-ServicesAdminNegativeTestJSON-1329123421 tempest-ServicesAdminNegativeTestJSON-1329123421-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:29.438256 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e200bc5c-01e6-4dd4-8a56-75c700e22567 tempest-ServicesAdminNegativeTestJSON-1329123421 tempest-ServicesAdminNegativeTestJSON-1329123421-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:29.438867 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e200bc5c-01e6-4dd4-8a56-75c700e22567 tempest-ServicesAdminNegativeTestJSON-1329123421 tempest-ServicesAdminNegativeTestJSON-1329123421-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:29.439598 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e200bc5c-01e6-4dd4-8a56-75c700e22567 tempest-ServicesAdminNegativeTestJSON-1329123421 tempest-ServicesAdminNegativeTestJSON-1329123421-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:29.440213 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e200bc5c-01e6-4dd4-8a56-75c700e22567 tempest-ServicesAdminNegativeTestJSON-1329123421 tempest-ServicesAdminNegativeTestJSON-1329123421-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:29.440981 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e200bc5c-01e6-4dd4-8a56-75c700e22567 tempest-ServicesAdminNegativeTestJSON-1329123421 tempest-ServicesAdminNegativeTestJSON-1329123421-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:29.467247 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e200bc5c-01e6-4dd4-8a56-75c700e22567 tempest-ServicesAdminNegativeTestJSON-1329123421 tempest-ServicesAdminNegativeTestJSON-1329123421-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.051019 Oct 18 15:26:29.468004 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 287/574] 10.222.0.60 () {58 vars in 1137 bytes} [Tue Oct 18 15:26:29 2022] GET /compute/v2.1/os-services => generated 944 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:26:29.481159 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d2784484-ec59-4ddf-8b67-679cf3bef2c9 tempest-ServicesAdminNegativeTestJSON-1329123421 tempest-ServicesAdminNegativeTestJSON-1329123421-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:29.484854 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2784484-ec59-4ddf-8b67-679cf3bef2c9 tempest-ServicesAdminNegativeTestJSON-1329123421 tempest-ServicesAdminNegativeTestJSON-1329123421-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:29.485128 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2784484-ec59-4ddf-8b67-679cf3bef2c9 tempest-ServicesAdminNegativeTestJSON-1329123421 tempest-ServicesAdminNegativeTestJSON-1329123421-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:29.485930 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2784484-ec59-4ddf-8b67-679cf3bef2c9 tempest-ServicesAdminNegativeTestJSON-1329123421 tempest-ServicesAdminNegativeTestJSON-1329123421-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:29.486684 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2784484-ec59-4ddf-8b67-679cf3bef2c9 tempest-ServicesAdminNegativeTestJSON-1329123421 tempest-ServicesAdminNegativeTestJSON-1329123421-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:29.487110 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2784484-ec59-4ddf-8b67-679cf3bef2c9 tempest-ServicesAdminNegativeTestJSON-1329123421 tempest-ServicesAdminNegativeTestJSON-1329123421-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:29.487530 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2784484-ec59-4ddf-8b67-679cf3bef2c9 tempest-ServicesAdminNegativeTestJSON-1329123421 tempest-ServicesAdminNegativeTestJSON-1329123421-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:29.531989 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d2784484-ec59-4ddf-8b67-679cf3bef2c9 tempest-ServicesAdminNegativeTestJSON-1329123421 tempest-ServicesAdminNegativeTestJSON-1329123421-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.055171 Oct 18 15:26:29.532796 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 288/575] 10.222.0.60 () {58 vars in 1198 bytes} [Tue Oct 18 15:26:29 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:26:29.613826 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-91710b13-b181-4227-80ee-767939e481c5 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:29.614556 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-91710b13-b181-4227-80ee-767939e481c5 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: 29ceb840-1b81-4434-841f-a473cded4b73] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:29.631666 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91710b13-b181-4227-80ee-767939e481c5 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:29.634069 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91710b13-b181-4227-80ee-767939e481c5 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:29.634885 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91710b13-b181-4227-80ee-767939e481c5 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:29.635703 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91710b13-b181-4227-80ee-767939e481c5 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:29.636342 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91710b13-b181-4227-80ee-767939e481c5 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:29.636882 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91710b13-b181-4227-80ee-767939e481c5 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:29.868309 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-91710b13-b181-4227-80ee-767939e481c5 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:29.875983 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-91710b13-b181-4227-80ee-767939e481c5 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73" status: 200 len: 1502 microversion: 2.1 time: 0.266688 Oct 18 15:26:29.895134 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 289/576] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:29 2022] GET /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73 => generated 1502 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:29.896582 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-69051e76-5476-430a-bb70-c3fd647b1e37 req-b1ac6d2c-a95e-47e9-ba9c-d078f395321c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28a18615-ab69-4e8e-865c-b8e0b67a74f4", "tag": "2477c9ea-1c78-4540-bd74-41bf83ab31bb"}, {"name": "network-changed", "server_uuid": "29ceb840-1b81-4434-841f-a473cded4b73", "tag": "1b04f10d-4830-4b9e-b179-bd983eaea7e2"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:29.919397 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-69051e76-5476-430a-bb70-c3fd647b1e37 req-b1ac6d2c-a95e-47e9-ba9c-d078f395321c service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:29.920529 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-69051e76-5476-430a-bb70-c3fd647b1e37 req-b1ac6d2c-a95e-47e9-ba9c-d078f395321c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:29.921259 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-69051e76-5476-430a-bb70-c3fd647b1e37 req-b1ac6d2c-a95e-47e9-ba9c-d078f395321c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:29.948349 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-69051e76-5476-430a-bb70-c3fd647b1e37 req-b1ac6d2c-a95e-47e9-ba9c-d078f395321c service nova] Creating event network-changed:2477c9ea-1c78-4540-bd74-41bf83ab31bb for instance 28a18615-ab69-4e8e-865c-b8e0b67a74f4 on n-h1-853682-5 Oct 18 15:26:29.948636 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-dbd32289-e29a-4482-a6c5-340b231927ac tempest-ServicesAdminNegativeTestJSON-505255369 tempest-ServicesAdminNegativeTestJSON-505255369-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:29.953343 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-69051e76-5476-430a-bb70-c3fd647b1e37 req-b1ac6d2c-a95e-47e9-ba9c-d078f395321c service nova] Creating event network-changed:1b04f10d-4830-4b9e-b179-bd983eaea7e2 for instance 29ceb840-1b81-4434-841f-a473cded4b73 on n-h1-853682-5 Oct 18 15:26:29.954736 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-dbd32289-e29a-4482-a6c5-340b231927ac tempest-ServicesAdminNegativeTestJSON-505255369 tempest-ServicesAdminNegativeTestJSON-505255369-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'ab17fdc871f241d68ebb69c2407e276a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636bae6b22b84ecea7de5c14efe6a233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:29.957899 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-dbd32289-e29a-4482-a6c5-340b231927ac tempest-ServicesAdminNegativeTestJSON-505255369 tempest-ServicesAdminNegativeTestJSON-505255369-project] Request method failure captured: Oct 18 15:26:29.957899 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 18 15:26:29.957899 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:26:29.957899 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:26:29.957899 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:26:29.957899 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:26:29.957899 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:26:29.957899 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:26:29.957899 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:26:29.957899 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:26:29.957899 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsWiI7pftKOLLf7xFTnlmFswbi5PD0NcfeM1zrJT8t5fU6cwNRPesfyeHlcms5uLk0GVfXgJB02bMoHu4dMYNdfAJYBq8y755-z2WgZBT6wKxHxOuG3Q-7UEq5iR57CYDJiF1xbOwQMA8F5IjUCXvjkRuwViRWyrYnFgIc9ReamYRSA Oct 18 15:26:29.957899 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:26:29.957899 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:26:29.957899 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:26:29.957899 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:26:29.957899 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:26:29.957899 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:26:29.957899 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 636bae6b22b84ecea7de5c14efe6a233 Oct 18 15:26:29.957899 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-505255369 Oct 18 15:26:29.957899 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:26:29.957899 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:26:29.959213 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/636bae6b22b84ecea7de5c14efe6a233"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/636bae6b22b84ecea7de5c14efe6a233"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/636bae6b22b84ecea7de5c14efe6a233"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_636bae6b22b84ecea7de5c14efe6a233"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:26:29.959213 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-505255369 Oct 18 15:26:29.959213 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 636bae6b22b84ecea7de5c14efe6a233 Oct 18 15:26:29.959213 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-505255369 Oct 18 15:26:29.959213 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServicesAdminNegativeTestJSON-505255369-project Oct 18 15:26:29.959213 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:26:29.959213 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:26:29.959213 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: ab17fdc871f241d68ebb69c2407e276a Oct 18 15:26:29.959213 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-505255369-project Oct 18 15:26:29.959213 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:26:29.959213 n-d-853682-5 devstack@n-api.service[120405]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 18 15:26:29.959213 n-d-853682-5 devstack@n-api.service[120405]: action_args: {} Oct 18 15:26:29.959988 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:26:29.959988 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:26:29.959988 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:26:29.959988 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:26:29.959988 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:26:29.959988 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:26:29.959988 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 15:26:29.959988 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:26:29.959988 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 15:26:29.959988 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:26:29.959988 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:26:29.959988 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:26:29.959988 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 18 15:26:29.959988 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 18 15:26:29.959988 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 15:26:29.959988 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 15:26:29.959988 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 15:26:29.959988 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 15:26:29.959988 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 15:26:29.961185 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 15:26:29.961185 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 15:26:29.961185 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 15:26:29.961185 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 15:26:29.961185 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 15:26:29.961185 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 15:26:29.961185 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 15:26:29.961185 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 15:26:29.961185 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 15:26:29.961185 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 18 15:26:29.961185 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:26:29.961185 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:26:29.961185 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:26:29.961185 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:26:29.961185 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:26:29.961185 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:26:29.961185 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 15:26:29.961185 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 15:26:29.961185 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 18 15:26:29.961185 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:26:29.966273 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-dbd32289-e29a-4482-a6c5-340b231927ac tempest-ServicesAdminNegativeTestJSON-505255369 tempest-ServicesAdminNegativeTestJSON-505255369-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:26:29.968760 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-dbd32289-e29a-4482-a6c5-340b231927ac tempest-ServicesAdminNegativeTestJSON-505255369 tempest-ServicesAdminNegativeTestJSON-505255369-project] 10.222.0.60 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.426533 Oct 18 15:26:29.970063 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 288/577] 10.222.0.60 () {58 vars in 1137 bytes} [Tue Oct 18 15:26:29 2022] GET /compute/v2.1/os-services => generated 112 bytes in 428 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:26:29.980439 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f7db7696-496d-4ed6-8291-ad4a88cb67f8 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:29.983108 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f7db7696-496d-4ed6-8291-ad4a88cb67f8 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] [instance: 19061153-9eed-4374-8799-b497b8a8e780] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:29.995258 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f7db7696-496d-4ed6-8291-ad4a88cb67f8 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:29.997040 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f7db7696-496d-4ed6-8291-ad4a88cb67f8 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:29.997696 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f7db7696-496d-4ed6-8291-ad4a88cb67f8 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:29.998897 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f7db7696-496d-4ed6-8291-ad4a88cb67f8 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:30.000258 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f7db7696-496d-4ed6-8291-ad4a88cb67f8 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:30.000918 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f7db7696-496d-4ed6-8291-ad4a88cb67f8 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:30.001366 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-69051e76-5476-430a-bb70-c3fd647b1e37 req-b1ac6d2c-a95e-47e9-ba9c-d078f395321c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.114231 Oct 18 15:26:30.006143 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 290/578] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:26:29 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:26:30.018261 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e6ed5386-efbf-4905-a3a8-d37aba253ba7 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:30.020879 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e6ed5386-efbf-4905-a3a8-d37aba253ba7 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: f07f6211-dd0e-4bdd-969c-fff2c3633dd0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:30.028232 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=13,nova_api:INSERT=7 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:26:30.032013 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6ed5386-efbf-4905-a3a8-d37aba253ba7 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:30.032505 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6ed5386-efbf-4905-a3a8-d37aba253ba7 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:30.033565 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6ed5386-efbf-4905-a3a8-d37aba253ba7 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:30.034971 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6ed5386-efbf-4905-a3a8-d37aba253ba7 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:30.035737 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6ed5386-efbf-4905-a3a8-d37aba253ba7 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:30.036354 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6ed5386-efbf-4905-a3a8-d37aba253ba7 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:30.311634 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f7db7696-496d-4ed6-8291-ad4a88cb67f8 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2bbb8b77794404af993e8291343afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6facda3e46640c884583aaf146a8b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:30.320477 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f7db7696-496d-4ed6-8291-ad4a88cb67f8 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] 10.222.0.60 "GET /compute/v2.1/servers/19061153-9eed-4374-8799-b497b8a8e780" status: 200 len: 1584 microversion: 2.1 time: 0.349181 Oct 18 15:26:30.324141 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 289/579] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:29 2022] GET /compute/v2.1/servers/19061153-9eed-4374-8799-b497b8a8e780 => generated 1584 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:30.329531 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0c2ed1ca-3ca8-4ab8-954e-20da02fa1753 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:30.341251 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0c2ed1ca-3ca8-4ab8-954e-20da02fa1753 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] [instance: 53bb4ff5-ea92-42df-ab9c-4409c6f99dae] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:30.343394 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e6ed5386-efbf-4905-a3a8-d37aba253ba7 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:30.349661 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0c2ed1ca-3ca8-4ab8-954e-20da02fa1753 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:30.350139 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0c2ed1ca-3ca8-4ab8-954e-20da02fa1753 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:30.353598 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e6ed5386-efbf-4905-a3a8-d37aba253ba7 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/f07f6211-dd0e-4bdd-969c-fff2c3633dd0" status: 200 len: 1307 microversion: 2.1 time: 0.343899 Oct 18 15:26:30.354192 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 291/580] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:30 2022] GET /compute/v2.1/servers/f07f6211-dd0e-4bdd-969c-fff2c3633dd0 => generated 1307 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:30.357439 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0c2ed1ca-3ca8-4ab8-954e-20da02fa1753 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:30.358365 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0c2ed1ca-3ca8-4ab8-954e-20da02fa1753 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:30.358984 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0c2ed1ca-3ca8-4ab8-954e-20da02fa1753 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:30.359587 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0c2ed1ca-3ca8-4ab8-954e-20da02fa1753 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:30.374418 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-0c2ed1ca-3ca8-4ab8-954e-20da02fa1753 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] HTTP exception thrown: Instance 53bb4ff5-ea92-42df-ab9c-4409c6f99dae could not be found. Oct 18 15:26:30.376195 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0c2ed1ca-3ca8-4ab8-954e-20da02fa1753 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Request method failure captured: Oct 18 15:26:30.376195 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/53bb4ff5-ea92-42df-ab9c-4409c6f99dae HTTP/1.1 Oct 18 15:26:30.376195 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:26:30.376195 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:26:30.376195 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:26:30.376195 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:26:30.376195 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:26:30.376195 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:26:30.376195 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:26:30.376195 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:26:30.376195 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsVdUbJCbKY_grM5TFEpGfQPGW9LeMDi1SGEM6jzV_L8koMCAJezWIVg9hva2cO3ymE-2hLEsDevtR5oqPACQ62BgyHOWJiFAm3LLofM3085KIxxMqdarhu3nTWAH24rL6IsYjb4YKgZWq2eXtkF66Wl7WQWvXeiY3Gl6dA0zUmxgpM Oct 18 15:26:30.376195 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:26:30.376195 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:26:30.376195 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:26:30.376195 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:26:30.376195 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:26:30.376195 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:26:30.376195 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 27f40d7ca29449cbb4c2d58df280a01c Oct 18 15:26:30.376195 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-DeleteServersAdminTestJSON-536887960 Oct 18 15:26:30.376195 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:26:30.376195 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:26:30.377715 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/27f40d7ca29449cbb4c2d58df280a01c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/27f40d7ca29449cbb4c2d58df280a01c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/27f40d7ca29449cbb4c2d58df280a01c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_27f40d7ca29449cbb4c2d58df280a01c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:26:30.377715 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-DeleteServersAdminTestJSON-536887960 Oct 18 15:26:30.377715 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 27f40d7ca29449cbb4c2d58df280a01c Oct 18 15:26:30.377715 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-536887960 Oct 18 15:26:30.377715 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-DeleteServersAdminTestJSON-536887960-project Oct 18 15:26:30.377715 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:26:30.377715 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:26:30.377715 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 385ef457207e45b0b843fc2b8ffff7bb Oct 18 15:26:30.377715 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-DeleteServersAdminTestJSON-536887960-project Oct 18 15:26:30.377715 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:26:30.377715 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 53bb4ff5-ea92-42df-ab9c-4409c6f99dae could not be found. Oct 18 15:26:30.377715 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '53bb4ff5-ea92-42df-ab9c-4409c6f99dae'} Oct 18 15:26:30.378528 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:26:30.378528 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:26:30.378528 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:26:30.378528 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:26:30.378528 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:26:30.378528 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:26:30.378528 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:26:30.378528 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:26:30.378528 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:26:30.378528 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:26:30.378528 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53bb4ff5-ea92-42df-ab9c-4409c6f99dae could not be found. Oct 18 15:26:30.378528 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:26:30.378528 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:26:30.378528 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:26:30.378528 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:26:30.378528 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:26:30.378528 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:26:30.378528 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:26:30.378528 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:26:30.378528 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:26:30.379928 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:26:30.379928 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:26:30.379928 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:26:30.379928 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:26:30.379928 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:26:30.379928 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:26:30.379928 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:26:30.379928 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53bb4ff5-ea92-42df-ab9c-4409c6f99dae could not be found. Oct 18 15:26:30.379928 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:26:30.379928 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:26:30.379928 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:26:30.379928 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:26:30.379928 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:26:30.379928 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:26:30.379928 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:26:30.379928 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:26:30.379928 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53bb4ff5-ea92-42df-ab9c-4409c6f99dae could not be found. Oct 18 15:26:30.379928 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:26:30.381935 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0c2ed1ca-3ca8-4ab8-954e-20da02fa1753 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Returning 404 to user: Instance 53bb4ff5-ea92-42df-ab9c-4409c6f99dae could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:26:30.382785 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0c2ed1ca-3ca8-4ab8-954e-20da02fa1753 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] 10.222.0.60 "GET /compute/v2.1/servers/53bb4ff5-ea92-42df-ab9c-4409c6f99dae" status: 404 len: 111 microversion: 2.1 time: 0.056940 Oct 18 15:26:30.383350 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 290/581] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:30 2022] GET /compute/v2.1/servers/53bb4ff5-ea92-42df-ab9c-4409c6f99dae => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:26:30.398427 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5cd16ec2-4146-4d48-8d40-e3a9d1c51c95 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:30.399380 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5cd16ec2-4146-4d48-8d40-e3a9d1c51c95 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] [instance: 53bb4ff5-ea92-42df-ab9c-4409c6f99dae] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:30.419881 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5cd16ec2-4146-4d48-8d40-e3a9d1c51c95 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:30.421259 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5cd16ec2-4146-4d48-8d40-e3a9d1c51c95 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:30.422679 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5cd16ec2-4146-4d48-8d40-e3a9d1c51c95 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:30.423725 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5cd16ec2-4146-4d48-8d40-e3a9d1c51c95 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:30.424265 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5cd16ec2-4146-4d48-8d40-e3a9d1c51c95 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:30.424766 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5cd16ec2-4146-4d48-8d40-e3a9d1c51c95 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:30.447589 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-5cd16ec2-4146-4d48-8d40-e3a9d1c51c95 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] HTTP exception thrown: Instance 53bb4ff5-ea92-42df-ab9c-4409c6f99dae could not be found. Oct 18 15:26:30.448965 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0be4aed1-0782-4313-8a62-ac3135afbe43 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:30.450306 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5cd16ec2-4146-4d48-8d40-e3a9d1c51c95 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Request method failure captured: Oct 18 15:26:30.450306 n-d-853682-5 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/53bb4ff5-ea92-42df-ab9c-4409c6f99dae HTTP/1.1 Oct 18 15:26:30.450306 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:26:30.450306 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:26:30.450306 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:26:30.450306 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:26:30.450306 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:26:30.450306 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:26:30.450306 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:26:30.450306 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:26:30.450306 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsVdUbJCbKY_grM5TFEpGfQPGW9LeMDi1SGEM6jzV_L8koMCAJezWIVg9hva2cO3ymE-2hLEsDevtR5oqPACQ62BgyHOWJiFAm3LLofM3085KIxxMqdarhu3nTWAH24rL6IsYjb4YKgZWq2eXtkF66Wl7WQWvXeiY3Gl6dA0zUmxgpM Oct 18 15:26:30.450306 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:26:30.450306 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:26:30.450306 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:26:30.450306 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:26:30.450306 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:26:30.450306 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:26:30.450306 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 27f40d7ca29449cbb4c2d58df280a01c Oct 18 15:26:30.450306 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-DeleteServersAdminTestJSON-536887960 Oct 18 15:26:30.450306 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:26:30.450306 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:26:30.451810 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/27f40d7ca29449cbb4c2d58df280a01c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/27f40d7ca29449cbb4c2d58df280a01c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/27f40d7ca29449cbb4c2d58df280a01c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_27f40d7ca29449cbb4c2d58df280a01c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:26:30.451810 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-DeleteServersAdminTestJSON-536887960 Oct 18 15:26:30.451810 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 27f40d7ca29449cbb4c2d58df280a01c Oct 18 15:26:30.451810 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-536887960 Oct 18 15:26:30.451810 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-DeleteServersAdminTestJSON-536887960-project Oct 18 15:26:30.451810 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:26:30.451810 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:26:30.451810 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 385ef457207e45b0b843fc2b8ffff7bb Oct 18 15:26:30.451810 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-DeleteServersAdminTestJSON-536887960-project Oct 18 15:26:30.451810 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:26:30.451810 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 53bb4ff5-ea92-42df-ab9c-4409c6f99dae could not be found. Oct 18 15:26:30.451810 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '53bb4ff5-ea92-42df-ab9c-4409c6f99dae'} Oct 18 15:26:30.452589 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:26:30.452589 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:26:30.452589 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:26:30.452589 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:26:30.452589 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:26:30.452589 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:26:30.452589 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:26:30.452589 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:26:30.452589 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:26:30.452589 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:26:30.452589 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53bb4ff5-ea92-42df-ab9c-4409c6f99dae could not be found. Oct 18 15:26:30.452589 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:26:30.452589 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:26:30.452589 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:26:30.452589 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:26:30.452589 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:26:30.452589 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:26:30.452589 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:26:30.452589 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:26:30.452589 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:26:30.453765 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:26:30.453765 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 15:26:30.453765 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 15:26:30.453765 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 15:26:30.453765 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 15:26:30.453765 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:26:30.453765 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:26:30.453765 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:26:30.453765 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:26:30.453765 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53bb4ff5-ea92-42df-ab9c-4409c6f99dae could not be found. Oct 18 15:26:30.453765 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:26:30.453765 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:26:30.453765 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:26:30.453765 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:26:30.453765 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:26:30.453765 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:26:30.453765 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:26:30.453765 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:26:30.453765 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53bb4ff5-ea92-42df-ab9c-4409c6f99dae could not be found. Oct 18 15:26:30.453765 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:26:30.454999 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5cd16ec2-4146-4d48-8d40-e3a9d1c51c95 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Returning 404 to user: Instance 53bb4ff5-ea92-42df-ab9c-4409c6f99dae could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:26:30.455073 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0be4aed1-0782-4313-8a62-ac3135afbe43 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 28a18615-ab69-4e8e-865c-b8e0b67a74f4] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:30.455149 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5cd16ec2-4146-4d48-8d40-e3a9d1c51c95 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] 10.222.0.60 "DELETE /compute/v2.1/servers/53bb4ff5-ea92-42df-ab9c-4409c6f99dae" status: 404 len: 111 microversion: 2.1 time: 0.059692 Oct 18 15:26:30.455149 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 292/582] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:26:30 2022] DELETE /compute/v2.1/servers/53bb4ff5-ea92-42df-ab9c-4409c6f99dae => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:26:30.462481 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6a1e2f04-db96-47b8-9f43-91100fa0a4bf tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:30.463105 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6a1e2f04-db96-47b8-9f43-91100fa0a4bf tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] [instance: 53bb4ff5-ea92-42df-ab9c-4409c6f99dae] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:30.465867 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0be4aed1-0782-4313-8a62-ac3135afbe43 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:30.466510 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0be4aed1-0782-4313-8a62-ac3135afbe43 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:30.466802 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0be4aed1-0782-4313-8a62-ac3135afbe43 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:30.467513 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0be4aed1-0782-4313-8a62-ac3135afbe43 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:30.468477 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0be4aed1-0782-4313-8a62-ac3135afbe43 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:30.468627 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0be4aed1-0782-4313-8a62-ac3135afbe43 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:30.469580 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a1e2f04-db96-47b8-9f43-91100fa0a4bf tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:30.470159 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a1e2f04-db96-47b8-9f43-91100fa0a4bf tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:30.470598 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a1e2f04-db96-47b8-9f43-91100fa0a4bf tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:30.471632 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a1e2f04-db96-47b8-9f43-91100fa0a4bf tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:30.472096 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a1e2f04-db96-47b8-9f43-91100fa0a4bf tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:30.472518 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a1e2f04-db96-47b8-9f43-91100fa0a4bf tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:30.490699 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-6a1e2f04-db96-47b8-9f43-91100fa0a4bf tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] HTTP exception thrown: Instance 53bb4ff5-ea92-42df-ab9c-4409c6f99dae could not be found. Oct 18 15:26:30.492433 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6a1e2f04-db96-47b8-9f43-91100fa0a4bf tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Request method failure captured: Oct 18 15:26:30.492433 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/53bb4ff5-ea92-42df-ab9c-4409c6f99dae HTTP/1.1 Oct 18 15:26:30.492433 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:26:30.492433 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:26:30.492433 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:26:30.492433 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:26:30.492433 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:26:30.492433 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:26:30.492433 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:26:30.492433 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:26:30.492433 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsVdUbJCbKY_grM5TFEpGfQPGW9LeMDi1SGEM6jzV_L8koMCAJezWIVg9hva2cO3ymE-2hLEsDevtR5oqPACQ62BgyHOWJiFAm3LLofM3085KIxxMqdarhu3nTWAH24rL6IsYjb4YKgZWq2eXtkF66Wl7WQWvXeiY3Gl6dA0zUmxgpM Oct 18 15:26:30.492433 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:26:30.492433 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:26:30.492433 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:26:30.492433 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:26:30.492433 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:26:30.492433 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:26:30.492433 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 27f40d7ca29449cbb4c2d58df280a01c Oct 18 15:26:30.492433 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-DeleteServersAdminTestJSON-536887960 Oct 18 15:26:30.492433 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:26:30.492433 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:26:30.493758 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/27f40d7ca29449cbb4c2d58df280a01c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/27f40d7ca29449cbb4c2d58df280a01c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/27f40d7ca29449cbb4c2d58df280a01c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_27f40d7ca29449cbb4c2d58df280a01c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:26:30.493758 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-DeleteServersAdminTestJSON-536887960 Oct 18 15:26:30.493758 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 27f40d7ca29449cbb4c2d58df280a01c Oct 18 15:26:30.493758 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-536887960 Oct 18 15:26:30.493758 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-DeleteServersAdminTestJSON-536887960-project Oct 18 15:26:30.493758 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:26:30.493758 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:26:30.493758 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 385ef457207e45b0b843fc2b8ffff7bb Oct 18 15:26:30.493758 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-DeleteServersAdminTestJSON-536887960-project Oct 18 15:26:30.493758 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:26:30.493758 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 53bb4ff5-ea92-42df-ab9c-4409c6f99dae could not be found. Oct 18 15:26:30.493758 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '53bb4ff5-ea92-42df-ab9c-4409c6f99dae'} Oct 18 15:26:30.494576 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:26:30.494576 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:26:30.494576 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:26:30.494576 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:26:30.494576 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:26:30.494576 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:26:30.494576 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:26:30.494576 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:26:30.494576 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:26:30.494576 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:26:30.494576 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53bb4ff5-ea92-42df-ab9c-4409c6f99dae could not be found. Oct 18 15:26:30.494576 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:26:30.494576 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:26:30.494576 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:26:30.494576 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:26:30.494576 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:26:30.494576 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:26:30.494576 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:26:30.494576 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:26:30.494576 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:26:30.495734 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:26:30.495734 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:26:30.495734 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:26:30.495734 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:26:30.495734 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:26:30.495734 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:26:30.495734 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:26:30.495734 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53bb4ff5-ea92-42df-ab9c-4409c6f99dae could not be found. Oct 18 15:26:30.495734 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:26:30.495734 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:26:30.495734 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:26:30.495734 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:26:30.495734 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:26:30.495734 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:26:30.495734 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:26:30.495734 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:26:30.495734 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53bb4ff5-ea92-42df-ab9c-4409c6f99dae could not be found. Oct 18 15:26:30.495734 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:26:30.496908 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6a1e2f04-db96-47b8-9f43-91100fa0a4bf tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Returning 404 to user: Instance 53bb4ff5-ea92-42df-ab9c-4409c6f99dae could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:26:30.496908 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6a1e2f04-db96-47b8-9f43-91100fa0a4bf tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] 10.222.0.60 "GET /compute/v2.1/servers/53bb4ff5-ea92-42df-ab9c-4409c6f99dae" status: 404 len: 111 microversion: 2.1 time: 0.035437 Oct 18 15:26:30.498426 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 293/583] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:30 2022] GET /compute/v2.1/servers/53bb4ff5-ea92-42df-ab9c-4409c6f99dae => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 15:26:30.503730 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-40bb4186-381d-42b5-8c2a-7c8f022367ae tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:30.504239 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-40bb4186-381d-42b5-8c2a-7c8f022367ae tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] [instance: ff014187-bdd4-4211-b796-abf786781dac] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:30.510184 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40bb4186-381d-42b5-8c2a-7c8f022367ae tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:30.510679 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40bb4186-381d-42b5-8c2a-7c8f022367ae tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:30.511235 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40bb4186-381d-42b5-8c2a-7c8f022367ae tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:30.512913 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40bb4186-381d-42b5-8c2a-7c8f022367ae tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:30.513490 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40bb4186-381d-42b5-8c2a-7c8f022367ae tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:30.513992 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40bb4186-381d-42b5-8c2a-7c8f022367ae tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:30.529601 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-40bb4186-381d-42b5-8c2a-7c8f022367ae tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] HTTP exception thrown: Instance ff014187-bdd4-4211-b796-abf786781dac could not be found. Oct 18 15:26:30.531153 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-40bb4186-381d-42b5-8c2a-7c8f022367ae tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Request method failure captured: Oct 18 15:26:30.531153 n-d-853682-5 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/ff014187-bdd4-4211-b796-abf786781dac HTTP/1.1 Oct 18 15:26:30.531153 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:26:30.531153 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:26:30.531153 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:26:30.531153 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:26:30.531153 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:26:30.531153 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:26:30.531153 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:26:30.531153 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:26:30.531153 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsVdUbJCbKY_grM5TFEpGfQPGW9LeMDi1SGEM6jzV_L8koMCAJezWIVg9hva2cO3ymE-2hLEsDevtR5oqPACQ62BgyHOWJiFAm3LLofM3085KIxxMqdarhu3nTWAH24rL6IsYjb4YKgZWq2eXtkF66Wl7WQWvXeiY3Gl6dA0zUmxgpM Oct 18 15:26:30.531153 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:26:30.531153 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:26:30.531153 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:26:30.531153 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:26:30.531153 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:26:30.531153 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:26:30.531153 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 27f40d7ca29449cbb4c2d58df280a01c Oct 18 15:26:30.531153 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-DeleteServersAdminTestJSON-536887960 Oct 18 15:26:30.531153 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:26:30.531153 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:26:30.532641 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/27f40d7ca29449cbb4c2d58df280a01c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/27f40d7ca29449cbb4c2d58df280a01c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/27f40d7ca29449cbb4c2d58df280a01c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_27f40d7ca29449cbb4c2d58df280a01c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:26:30.532641 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-DeleteServersAdminTestJSON-536887960 Oct 18 15:26:30.532641 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 27f40d7ca29449cbb4c2d58df280a01c Oct 18 15:26:30.532641 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-536887960 Oct 18 15:26:30.532641 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-DeleteServersAdminTestJSON-536887960-project Oct 18 15:26:30.532641 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:26:30.532641 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:26:30.532641 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 385ef457207e45b0b843fc2b8ffff7bb Oct 18 15:26:30.532641 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-DeleteServersAdminTestJSON-536887960-project Oct 18 15:26:30.532641 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:26:30.532641 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance ff014187-bdd4-4211-b796-abf786781dac could not be found. Oct 18 15:26:30.532641 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'ff014187-bdd4-4211-b796-abf786781dac'} Oct 18 15:26:30.533374 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:26:30.533374 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:26:30.533374 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:26:30.533374 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:26:30.533374 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:26:30.533374 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:26:30.533374 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:26:30.533374 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:26:30.533374 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:26:30.533374 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:26:30.533374 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff014187-bdd4-4211-b796-abf786781dac could not be found. Oct 18 15:26:30.533374 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:26:30.533374 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:26:30.533374 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:26:30.533374 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:26:30.533374 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:26:30.533374 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:26:30.533374 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:26:30.533374 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:26:30.533374 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:26:30.534514 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:26:30.534514 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 15:26:30.534514 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 15:26:30.534514 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 15:26:30.534514 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 15:26:30.534514 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:26:30.534514 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:26:30.534514 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:26:30.534514 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:26:30.534514 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff014187-bdd4-4211-b796-abf786781dac could not be found. Oct 18 15:26:30.534514 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:26:30.534514 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:26:30.534514 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:26:30.534514 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:26:30.534514 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:26:30.534514 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:26:30.534514 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:26:30.534514 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:26:30.534514 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff014187-bdd4-4211-b796-abf786781dac could not be found. Oct 18 15:26:30.534514 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:26:30.535661 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-40bb4186-381d-42b5-8c2a-7c8f022367ae tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Returning 404 to user: Instance ff014187-bdd4-4211-b796-abf786781dac could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:26:30.535661 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-40bb4186-381d-42b5-8c2a-7c8f022367ae tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ff014187-bdd4-4211-b796-abf786781dac" status: 404 len: 111 microversion: 2.1 time: 0.034087 Oct 18 15:26:30.537612 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 294/584] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:26:30 2022] DELETE /compute/v2.1/servers/ff014187-bdd4-4211-b796-abf786781dac => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:26:30.542456 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-483cd8d6-e74d-409e-a1f0-422e2e58ac99 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:30.543632 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-483cd8d6-e74d-409e-a1f0-422e2e58ac99 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] [instance: ff014187-bdd4-4211-b796-abf786781dac] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:30.550084 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-483cd8d6-e74d-409e-a1f0-422e2e58ac99 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:30.550519 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-483cd8d6-e74d-409e-a1f0-422e2e58ac99 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:30.550951 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-483cd8d6-e74d-409e-a1f0-422e2e58ac99 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:30.551651 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-483cd8d6-e74d-409e-a1f0-422e2e58ac99 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:30.552139 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-483cd8d6-e74d-409e-a1f0-422e2e58ac99 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:30.552590 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-483cd8d6-e74d-409e-a1f0-422e2e58ac99 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:30.568938 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-483cd8d6-e74d-409e-a1f0-422e2e58ac99 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] HTTP exception thrown: Instance ff014187-bdd4-4211-b796-abf786781dac could not be found. Oct 18 15:26:30.570603 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-483cd8d6-e74d-409e-a1f0-422e2e58ac99 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Request method failure captured: Oct 18 15:26:30.570603 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/ff014187-bdd4-4211-b796-abf786781dac HTTP/1.1 Oct 18 15:26:30.570603 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:26:30.570603 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:26:30.570603 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:26:30.570603 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:26:30.570603 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:26:30.570603 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:26:30.570603 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:26:30.570603 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:26:30.570603 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsVdUbJCbKY_grM5TFEpGfQPGW9LeMDi1SGEM6jzV_L8koMCAJezWIVg9hva2cO3ymE-2hLEsDevtR5oqPACQ62BgyHOWJiFAm3LLofM3085KIxxMqdarhu3nTWAH24rL6IsYjb4YKgZWq2eXtkF66Wl7WQWvXeiY3Gl6dA0zUmxgpM Oct 18 15:26:30.570603 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:26:30.570603 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:26:30.570603 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:26:30.570603 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:26:30.570603 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:26:30.570603 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:26:30.570603 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 27f40d7ca29449cbb4c2d58df280a01c Oct 18 15:26:30.570603 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-DeleteServersAdminTestJSON-536887960 Oct 18 15:26:30.570603 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:26:30.570603 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:26:30.571932 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/27f40d7ca29449cbb4c2d58df280a01c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/27f40d7ca29449cbb4c2d58df280a01c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/27f40d7ca29449cbb4c2d58df280a01c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_27f40d7ca29449cbb4c2d58df280a01c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:26:30.571932 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-DeleteServersAdminTestJSON-536887960 Oct 18 15:26:30.571932 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 27f40d7ca29449cbb4c2d58df280a01c Oct 18 15:26:30.571932 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-536887960 Oct 18 15:26:30.571932 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-DeleteServersAdminTestJSON-536887960-project Oct 18 15:26:30.571932 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:26:30.571932 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:26:30.571932 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 385ef457207e45b0b843fc2b8ffff7bb Oct 18 15:26:30.571932 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-DeleteServersAdminTestJSON-536887960-project Oct 18 15:26:30.571932 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:26:30.571932 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance ff014187-bdd4-4211-b796-abf786781dac could not be found. Oct 18 15:26:30.571932 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'ff014187-bdd4-4211-b796-abf786781dac'} Oct 18 15:26:30.572681 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:26:30.572681 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:26:30.572681 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:26:30.572681 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:26:30.572681 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:26:30.572681 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:26:30.572681 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:26:30.572681 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:26:30.572681 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:26:30.572681 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:26:30.572681 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff014187-bdd4-4211-b796-abf786781dac could not be found. Oct 18 15:26:30.572681 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:26:30.572681 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:26:30.572681 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:26:30.572681 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:26:30.572681 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:26:30.572681 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:26:30.572681 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:26:30.572681 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:26:30.572681 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:26:30.573909 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:26:30.573909 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:26:30.573909 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:26:30.573909 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:26:30.573909 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:26:30.573909 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:26:30.573909 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:26:30.573909 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff014187-bdd4-4211-b796-abf786781dac could not be found. Oct 18 15:26:30.573909 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:26:30.573909 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:26:30.573909 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:26:30.573909 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:26:30.573909 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:26:30.573909 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:26:30.573909 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:26:30.573909 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:26:30.573909 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff014187-bdd4-4211-b796-abf786781dac could not be found. Oct 18 15:26:30.573909 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:26:30.574998 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-483cd8d6-e74d-409e-a1f0-422e2e58ac99 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] Returning 404 to user: Instance ff014187-bdd4-4211-b796-abf786781dac could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:26:30.574998 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-483cd8d6-e74d-409e-a1f0-422e2e58ac99 tempest-DeleteServersAdminTestJSON-536887960 tempest-DeleteServersAdminTestJSON-536887960-project] 10.222.0.60 "GET /compute/v2.1/servers/ff014187-bdd4-4211-b796-abf786781dac" status: 404 len: 111 microversion: 2.1 time: 0.033727 Oct 18 15:26:30.574998 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 295/585] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:30 2022] GET /compute/v2.1/servers/ff014187-bdd4-4211-b796-abf786781dac => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:26:30.759737 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0be4aed1-0782-4313-8a62-ac3135afbe43 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:30.771403 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0be4aed1-0782-4313-8a62-ac3135afbe43 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:30.776741 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0be4aed1-0782-4313-8a62-ac3135afbe43 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:30.779010 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0be4aed1-0782-4313-8a62-ac3135afbe43 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4" status: 200 len: 1362 microversion: 2.25 time: 0.335870 Oct 18 15:26:30.781646 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 291/586] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:26:30 2022] GET /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4 => generated 1362 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:26:30.906371 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-85f4bf43-112d-4a59-8b19-3e7da2ca8808 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:30.907657 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-85f4bf43-112d-4a59-8b19-3e7da2ca8808 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: 29ceb840-1b81-4434-841f-a473cded4b73] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:30.917893 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85f4bf43-112d-4a59-8b19-3e7da2ca8808 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:30.918968 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85f4bf43-112d-4a59-8b19-3e7da2ca8808 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:30.919407 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85f4bf43-112d-4a59-8b19-3e7da2ca8808 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:30.924428 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85f4bf43-112d-4a59-8b19-3e7da2ca8808 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:30.926273 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85f4bf43-112d-4a59-8b19-3e7da2ca8808 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:30.935709 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85f4bf43-112d-4a59-8b19-3e7da2ca8808 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:30.962805 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-a6864fdb-4ec4-43c5-8824-ddf252b5c94f req-120a6b5c-2d45-45fc-80d0-a1fd317753ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19061153-9eed-4374-8799-b497b8a8e780", "tag": "8d08d8f8-c7dc-4676-8853-5174b27e7ce8"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:30.976998 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-a6864fdb-4ec4-43c5-8824-ddf252b5c94f req-120a6b5c-2d45-45fc-80d0-a1fd317753ba service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:30.978448 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-a6864fdb-4ec4-43c5-8824-ddf252b5c94f req-120a6b5c-2d45-45fc-80d0-a1fd317753ba service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:30.979052 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-a6864fdb-4ec4-43c5-8824-ddf252b5c94f req-120a6b5c-2d45-45fc-80d0-a1fd317753ba service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:30.998587 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-a6864fdb-4ec4-43c5-8824-ddf252b5c94f req-120a6b5c-2d45-45fc-80d0-a1fd317753ba service nova] Creating event network-changed:8d08d8f8-c7dc-4676-8853-5174b27e7ce8 for instance 19061153-9eed-4374-8799-b497b8a8e780 on n-h2-853682-5 Oct 18 15:26:31.005186 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-a6864fdb-4ec4-43c5-8824-ddf252b5c94f req-120a6b5c-2d45-45fc-80d0-a1fd317753ba service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046071 Oct 18 15:26:31.006439 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 292/587] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:26:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:26:31.254583 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-85f4bf43-112d-4a59-8b19-3e7da2ca8808 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:31.268256 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-85f4bf43-112d-4a59-8b19-3e7da2ca8808 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73" status: 200 len: 1502 microversion: 2.1 time: 0.367561 Oct 18 15:26:31.275102 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 296/588] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:30 2022] GET /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73 => generated 1502 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:31.380642 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-798db44f-14aa-4262-b5b4-337497214362 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:31.381489 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-798db44f-14aa-4262-b5b4-337497214362 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: f07f6211-dd0e-4bdd-969c-fff2c3633dd0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:31.393759 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-798db44f-14aa-4262-b5b4-337497214362 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:31.394185 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-798db44f-14aa-4262-b5b4-337497214362 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:31.394626 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-798db44f-14aa-4262-b5b4-337497214362 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:31.395344 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-798db44f-14aa-4262-b5b4-337497214362 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:31.397392 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-798db44f-14aa-4262-b5b4-337497214362 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:31.397843 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-798db44f-14aa-4262-b5b4-337497214362 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:31.657543 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-798db44f-14aa-4262-b5b4-337497214362 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:31.670703 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-798db44f-14aa-4262-b5b4-337497214362 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/f07f6211-dd0e-4bdd-969c-fff2c3633dd0" status: 200 len: 1307 microversion: 2.1 time: 0.294676 Oct 18 15:26:31.674261 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 293/589] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:31 2022] GET /compute/v2.1/servers/f07f6211-dd0e-4bdd-969c-fff2c3633dd0 => generated 1307 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:31.808333 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-493c963c-4fad-4943-9da7-606a8767ff64 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:31.809822 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-493c963c-4fad-4943-9da7-606a8767ff64 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 28a18615-ab69-4e8e-865c-b8e0b67a74f4] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:31.820701 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-493c963c-4fad-4943-9da7-606a8767ff64 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:31.821503 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-493c963c-4fad-4943-9da7-606a8767ff64 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:31.822275 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-493c963c-4fad-4943-9da7-606a8767ff64 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:31.823193 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-493c963c-4fad-4943-9da7-606a8767ff64 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:31.823867 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-493c963c-4fad-4943-9da7-606a8767ff64 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:31.824550 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-493c963c-4fad-4943-9da7-606a8767ff64 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:32.115616 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-493c963c-4fad-4943-9da7-606a8767ff64 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:32.124519 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-493c963c-4fad-4943-9da7-606a8767ff64 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:32.128836 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-493c963c-4fad-4943-9da7-606a8767ff64 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:32.130283 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-493c963c-4fad-4943-9da7-606a8767ff64 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4" status: 200 len: 1362 microversion: 2.25 time: 0.327122 Oct 18 15:26:32.130936 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 297/590] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:26:31 2022] GET /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4 => generated 1362 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:26:32.300157 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3ca0bfed-aa91-4901-bc24-2d42de45b2be tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:32.300768 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3ca0bfed-aa91-4901-bc24-2d42de45b2be tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: 29ceb840-1b81-4434-841f-a473cded4b73] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:32.308946 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ca0bfed-aa91-4901-bc24-2d42de45b2be tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:32.309832 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ca0bfed-aa91-4901-bc24-2d42de45b2be tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:32.310595 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ca0bfed-aa91-4901-bc24-2d42de45b2be tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:32.311678 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ca0bfed-aa91-4901-bc24-2d42de45b2be tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:32.312352 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ca0bfed-aa91-4901-bc24-2d42de45b2be tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:32.313235 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ca0bfed-aa91-4901-bc24-2d42de45b2be tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:32.471661 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3ca0bfed-aa91-4901-bc24-2d42de45b2be tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:32.480938 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3ca0bfed-aa91-4901-bc24-2d42de45b2be tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73" status: 200 len: 1502 microversion: 2.1 time: 0.184699 Oct 18 15:26:32.481869 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 294/591] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:32 2022] GET /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73 => generated 1502 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:32.697937 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-01d968a5-e77a-43cb-97c7-2d44d6fb0a2f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:32.698387 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-01d968a5-e77a-43cb-97c7-2d44d6fb0a2f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: f07f6211-dd0e-4bdd-969c-fff2c3633dd0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:32.710505 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01d968a5-e77a-43cb-97c7-2d44d6fb0a2f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:32.711152 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01d968a5-e77a-43cb-97c7-2d44d6fb0a2f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:32.711603 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01d968a5-e77a-43cb-97c7-2d44d6fb0a2f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:32.712434 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01d968a5-e77a-43cb-97c7-2d44d6fb0a2f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:32.714251 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01d968a5-e77a-43cb-97c7-2d44d6fb0a2f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:32.715524 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01d968a5-e77a-43cb-97c7-2d44d6fb0a2f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:32.983222 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-01d968a5-e77a-43cb-97c7-2d44d6fb0a2f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:32.991313 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-01d968a5-e77a-43cb-97c7-2d44d6fb0a2f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/f07f6211-dd0e-4bdd-969c-fff2c3633dd0" status: 200 len: 1487 microversion: 2.1 time: 0.297197 Oct 18 15:26:32.991899 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 298/592] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:32 2022] GET /compute/v2.1/servers/f07f6211-dd0e-4bdd-969c-fff2c3633dd0 => generated 1487 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:33.018430 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a7456796-e0a1-4bf1-b331-548a6f50dbe9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:33.032776 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a7456796-e0a1-4bf1-b331-548a6f50dbe9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:33.033330 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a7456796-e0a1-4bf1-b331-548a6f50dbe9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:33.033769 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a7456796-e0a1-4bf1-b331-548a6f50dbe9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:33.120724 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a7456796-e0a1-4bf1-b331-548a6f50dbe9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: f07f6211-dd0e-4bdd-969c-fff2c3633dd0] Going to try to stop instance {{(pid=120405) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 18 15:26:33.152456 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=97,nova_cell1:UPDATE=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:26:33.155475 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bae651c5-087c-4ab7-b53d-d0670fe83755 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:33.156079 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bae651c5-087c-4ab7-b53d-d0670fe83755 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 28a18615-ab69-4e8e-865c-b8e0b67a74f4] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:33.172378 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bae651c5-087c-4ab7-b53d-d0670fe83755 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:33.174187 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bae651c5-087c-4ab7-b53d-d0670fe83755 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:33.174829 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bae651c5-087c-4ab7-b53d-d0670fe83755 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:33.175713 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bae651c5-087c-4ab7-b53d-d0670fe83755 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:33.176333 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bae651c5-087c-4ab7-b53d-d0670fe83755 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:33.177117 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bae651c5-087c-4ab7-b53d-d0670fe83755 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:33.191744 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a7456796-e0a1-4bf1-b331-548a6f50dbe9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "POST /compute/v2.1/servers/f07f6211-dd0e-4bdd-969c-fff2c3633dd0/action" status: 202 len: 0 microversion: 2.1 time: 0.176816 Oct 18 15:26:33.193696 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 295/593] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:26:33 2022] POST /compute/v2.1/servers/f07f6211-dd0e-4bdd-969c-fff2c3633dd0/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:26:33.217143 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-cfb84c2f-bfcc-45d6-a2af-3482976776f1 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:33.218772 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-cfb84c2f-bfcc-45d6-a2af-3482976776f1 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: f07f6211-dd0e-4bdd-969c-fff2c3633dd0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:33.226978 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cfb84c2f-bfcc-45d6-a2af-3482976776f1 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:33.227938 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cfb84c2f-bfcc-45d6-a2af-3482976776f1 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:33.228577 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cfb84c2f-bfcc-45d6-a2af-3482976776f1 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:33.230008 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cfb84c2f-bfcc-45d6-a2af-3482976776f1 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:33.231201 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cfb84c2f-bfcc-45d6-a2af-3482976776f1 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:33.231828 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cfb84c2f-bfcc-45d6-a2af-3482976776f1 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:33.612160 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bae651c5-087c-4ab7-b53d-d0670fe83755 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:33.631545 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bae651c5-087c-4ab7-b53d-d0670fe83755 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:33.635731 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bae651c5-087c-4ab7-b53d-d0670fe83755 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:33.638787 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-cfb84c2f-bfcc-45d6-a2af-3482976776f1 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:33.641085 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bae651c5-087c-4ab7-b53d-d0670fe83755 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4" status: 200 len: 1362 microversion: 2.25 time: 0.487434 Oct 18 15:26:33.641929 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 299/594] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:26:33 2022] GET /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4 => generated 1362 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:26:33.650076 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-cfb84c2f-bfcc-45d6-a2af-3482976776f1 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/f07f6211-dd0e-4bdd-969c-fff2c3633dd0" status: 200 len: 1497 microversion: 2.1 time: 0.447872 Oct 18 15:26:33.655588 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2703bb1a-4c98-43d2-b7a6-52cceb0701b4 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:33.656458 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2703bb1a-4c98-43d2-b7a6-52cceb0701b4 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: 29ceb840-1b81-4434-841f-a473cded4b73] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:33.662892 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 296/595] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:33 2022] GET /compute/v2.1/servers/f07f6211-dd0e-4bdd-969c-fff2c3633dd0 => generated 1497 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:33.668728 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2703bb1a-4c98-43d2-b7a6-52cceb0701b4 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:33.670573 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2703bb1a-4c98-43d2-b7a6-52cceb0701b4 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:33.672114 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2703bb1a-4c98-43d2-b7a6-52cceb0701b4 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:33.673581 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2703bb1a-4c98-43d2-b7a6-52cceb0701b4 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:33.680194 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2703bb1a-4c98-43d2-b7a6-52cceb0701b4 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:33.680774 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2703bb1a-4c98-43d2-b7a6-52cceb0701b4 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:33.999563 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2703bb1a-4c98-43d2-b7a6-52cceb0701b4 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:34.011761 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2703bb1a-4c98-43d2-b7a6-52cceb0701b4 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73" status: 200 len: 1502 microversion: 2.1 time: 0.360824 Oct 18 15:26:34.014550 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 300/596] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:33 2022] GET /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73 => generated 1502 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:34.666102 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ac51553a-0f65-4080-a78c-639786b8d97d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:34.666752 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ac51553a-0f65-4080-a78c-639786b8d97d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 28a18615-ab69-4e8e-865c-b8e0b67a74f4] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:34.678197 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac51553a-0f65-4080-a78c-639786b8d97d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:34.678700 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac51553a-0f65-4080-a78c-639786b8d97d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:34.680481 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac51553a-0f65-4080-a78c-639786b8d97d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:34.683039 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac51553a-0f65-4080-a78c-639786b8d97d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:34.684474 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac51553a-0f65-4080-a78c-639786b8d97d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:34.687984 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac51553a-0f65-4080-a78c-639786b8d97d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:34.823874 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-de9a0900-fcd4-4f8c-b820-f4eb0f067a5e tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-2067237145", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:34.905972 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-de9a0900-fcd4-4f8c-b820-f4eb0f067a5e tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] validate_networks() for None {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:26:35.093225 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ac51553a-0f65-4080-a78c-639786b8d97d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:35.101856 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ac51553a-0f65-4080-a78c-639786b8d97d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:35.103323 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ac51553a-0f65-4080-a78c-639786b8d97d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:35.104429 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ac51553a-0f65-4080-a78c-639786b8d97d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4" status: 200 len: 1362 microversion: 2.25 time: 0.442591 Oct 18 15:26:35.106314 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 301/597] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:26:34 2022] GET /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4 => generated 1362 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:26:35.110881 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a253d033-b05c-4f4b-96c1-42b813db78b7 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:35.111588 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a253d033-b05c-4f4b-96c1-42b813db78b7 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: f07f6211-dd0e-4bdd-969c-fff2c3633dd0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:35.117396 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a253d033-b05c-4f4b-96c1-42b813db78b7 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:35.117877 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a253d033-b05c-4f4b-96c1-42b813db78b7 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:35.118321 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a253d033-b05c-4f4b-96c1-42b813db78b7 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:35.119122 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a253d033-b05c-4f4b-96c1-42b813db78b7 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:35.119578 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a253d033-b05c-4f4b-96c1-42b813db78b7 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:35.120004 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a253d033-b05c-4f4b-96c1-42b813db78b7 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:35.625249 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a253d033-b05c-4f4b-96c1-42b813db78b7 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:35.633082 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a253d033-b05c-4f4b-96c1-42b813db78b7 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/f07f6211-dd0e-4bdd-969c-fff2c3633dd0" status: 200 len: 1497 microversion: 2.1 time: 0.525815 Oct 18 15:26:35.634309 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 302/598] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:35 2022] GET /compute/v2.1/servers/f07f6211-dd0e-4bdd-969c-fff2c3633dd0 => generated 1497 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:35.640129 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4bc2b84b-33b1-4915-a0df-d97b3bc2c0a6 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:35.641614 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4bc2b84b-33b1-4915-a0df-d97b3bc2c0a6 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: 29ceb840-1b81-4434-841f-a473cded4b73] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:35.648175 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4bc2b84b-33b1-4915-a0df-d97b3bc2c0a6 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:35.648662 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4bc2b84b-33b1-4915-a0df-d97b3bc2c0a6 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:35.649319 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4bc2b84b-33b1-4915-a0df-d97b3bc2c0a6 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:35.650184 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4bc2b84b-33b1-4915-a0df-d97b3bc2c0a6 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:35.650801 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4bc2b84b-33b1-4915-a0df-d97b3bc2c0a6 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:35.651229 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4bc2b84b-33b1-4915-a0df-d97b3bc2c0a6 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:35.651680 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=57,nova_cell0:UPDATE=7 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:26:35.699003 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-de9a0900-fcd4-4f8c-b820-f4eb0f067a5e tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:26:35.699437 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-de9a0900-fcd4-4f8c-b820-f4eb0f067a5e tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:26:35.699910 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-de9a0900-fcd4-4f8c-b820-f4eb0f067a5e tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:26:35.700325 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-de9a0900-fcd4-4f8c-b820-f4eb0f067a5e tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:26:35.700745 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-de9a0900-fcd4-4f8c-b820-f4eb0f067a5e tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:26:35.708209 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=37 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:26:35.713111 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de9a0900-fcd4-4f8c-b820-f4eb0f067a5e tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:35.713599 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de9a0900-fcd4-4f8c-b820-f4eb0f067a5e tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:35.714036 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de9a0900-fcd4-4f8c-b820-f4eb0f067a5e tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:35.715099 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de9a0900-fcd4-4f8c-b820-f4eb0f067a5e tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:35.715547 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de9a0900-fcd4-4f8c-b820-f4eb0f067a5e tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:35.715974 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de9a0900-fcd4-4f8c-b820-f4eb0f067a5e tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:35.733695 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-de9a0900-fcd4-4f8c-b820-f4eb0f067a5e tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Getting quotas for project d94c87221eb94488ba2e0fdd41386b0c. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:26:35.740199 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-de9a0900-fcd4-4f8c-b820-f4eb0f067a5e tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Getting quotas for user 7357f1c14a544016bba5abeee15f7a6d and project d94c87221eb94488ba2e0fdd41386b0c. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:26:35.753907 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-de9a0900-fcd4-4f8c-b820-f4eb0f067a5e tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:26:35.756216 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-de9a0900-fcd4-4f8c-b820-f4eb0f067a5e tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] [instance: c3a3dd99-9387-4e73-a32d-e0c995b2b8b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:26:35.834361 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-de9a0900-fcd4-4f8c-b820-f4eb0f067a5e tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.391928 Oct 18 15:26:35.842657 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 297/599] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:26:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1395 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:26:35.972468 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4bc2b84b-33b1-4915-a0df-d97b3bc2c0a6 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:35.986250 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4bc2b84b-33b1-4915-a0df-d97b3bc2c0a6 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73" status: 200 len: 1502 microversion: 2.1 time: 0.350799 Oct 18 15:26:35.989712 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 303/600] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:35 2022] GET /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73 => generated 1502 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:35.998443 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-10470d5e-1f77-4ac6-a1ac-1cc3ab2264ed tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:36.014806 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-10470d5e-1f77-4ac6-a1ac-1cc3ab2264ed tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] [instance: c3a3dd99-9387-4e73-a32d-e0c995b2b8b9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:36.048767 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d0d9f5b8-1bd9-4bf0-8578-4defe956f653 tempest-FlavorsAccessTestJSON-1639027594 tempest-FlavorsAccessTestJSON-1639027594-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-551958278", "id": 1071581206, "os-flavor-access:is_public": "False"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:36.099067 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-10470d5e-1f77-4ac6-a1ac-1cc3ab2264ed tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7357f1c14a544016bba5abeee15f7a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c87221eb94488ba2e0fdd41386b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:36.112672 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-10470d5e-1f77-4ac6-a1ac-1cc3ab2264ed tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] 10.222.0.60 "GET /compute/v2.1/servers/c3a3dd99-9387-4e73-a32d-e0c995b2b8b9" status: 200 len: 1222 microversion: 2.1 time: 0.117682 Oct 18 15:26:36.126467 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 304/601] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:35 2022] GET /compute/v2.1/servers/c3a3dd99-9387-4e73-a32d-e0c995b2b8b9 => generated 1222 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:36.130289 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d0d9f5b8-1bd9-4bf0-8578-4defe956f653 tempest-FlavorsAccessTestJSON-1639027594 tempest-FlavorsAccessTestJSON-1639027594-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.293687 Oct 18 15:26:36.135265 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 298/602] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:26:35 2022] POST /compute/v2.1/flavors => generated 430 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:26:36.149649 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-64cb5f77-542b-4772-8d83-a48a3758e27c tempest-FlavorsAccessTestJSON-1639027594 tempest-FlavorsAccessTestJSON-1639027594-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "3c53469b2bfe4f05a2fa9498da6c55ae"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:36.154055 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5d0bbbbf-4425-46a6-b30a-8d81006d4a5b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:36.170609 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5d0bbbbf-4425-46a6-b30a-8d81006d4a5b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 28a18615-ab69-4e8e-865c-b8e0b67a74f4] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:36.194039 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d0bbbbf-4425-46a6-b30a-8d81006d4a5b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:36.194567 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d0bbbbf-4425-46a6-b30a-8d81006d4a5b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:36.195206 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d0bbbbf-4425-46a6-b30a-8d81006d4a5b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:36.201631 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d0bbbbf-4425-46a6-b30a-8d81006d4a5b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:36.208661 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d0bbbbf-4425-46a6-b30a-8d81006d4a5b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:36.209476 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d0bbbbf-4425-46a6-b30a-8d81006d4a5b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:36.259518 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:UPDATE=9,nova_api:SELECT=87,nova_api:INSERT=4 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:26:36.290988 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-64cb5f77-542b-4772-8d83-a48a3758e27c tempest-FlavorsAccessTestJSON-1639027594 tempest-FlavorsAccessTestJSON-1639027594-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/1071581206/action" status: 200 len: 97 microversion: 2.1 time: 0.144987 Oct 18 15:26:36.293628 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 299/603] 10.222.0.60 () {60 vars in 1200 bytes} [Tue Oct 18 15:26:36 2022] POST /compute/v2.1/flavors/1071581206/action => generated 97 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:26:36.512406 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e41799b9-6276-480b-8535-e81d1291e421 tempest-FlavorsAccessTestJSON-1585159880 tempest-FlavorsAccessTestJSON-1585159880-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:36.553804 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e41799b9-6276-480b-8535-e81d1291e421 tempest-FlavorsAccessTestJSON-1585159880 tempest-FlavorsAccessTestJSON-1585159880-project] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 6229 microversion: 2.1 time: 0.252536 Oct 18 15:26:36.572651 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 300/604] 10.222.0.60 () {58 vars in 1146 bytes} [Tue Oct 18 15:26:36 2022] GET /compute/v2.1/flavors/detail => generated 6229 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:36.579913 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5ad42e8b-6ee6-46c4-b1f1-144fb98fc3b5 tempest-FlavorsAccessTestJSON-1639027594 tempest-FlavorsAccessTestJSON-1639027594-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "3c53469b2bfe4f05a2fa9498da6c55ae"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:36.717038 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5ad42e8b-6ee6-46c4-b1f1-144fb98fc3b5 tempest-FlavorsAccessTestJSON-1639027594 tempest-FlavorsAccessTestJSON-1639027594-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/1071581206/action" status: 200 len: 21 microversion: 2.1 time: 0.138937 Oct 18 15:26:36.719783 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 301/605] 10.222.0.60 () {60 vars in 1200 bytes} [Tue Oct 18 15:26:36 2022] POST /compute/v2.1/flavors/1071581206/action => generated 21 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:26:36.733105 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ff696766-72b4-4bcf-b30f-6ea8540658a6 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:36.736755 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ff696766-72b4-4bcf-b30f-6ea8540658a6 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: f07f6211-dd0e-4bdd-969c-fff2c3633dd0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:36.756111 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ff696766-72b4-4bcf-b30f-6ea8540658a6 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:36.760021 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ff696766-72b4-4bcf-b30f-6ea8540658a6 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:36.761771 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ff696766-72b4-4bcf-b30f-6ea8540658a6 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:36.762728 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ff696766-72b4-4bcf-b30f-6ea8540658a6 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:36.763448 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ff696766-72b4-4bcf-b30f-6ea8540658a6 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:36.764065 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ff696766-72b4-4bcf-b30f-6ea8540658a6 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:36.809623 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5d0bbbbf-4425-46a6-b30a-8d81006d4a5b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:36.827724 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5d0bbbbf-4425-46a6-b30a-8d81006d4a5b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:36.830360 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5d0bbbbf-4425-46a6-b30a-8d81006d4a5b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:36.833089 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5d0bbbbf-4425-46a6-b30a-8d81006d4a5b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4" status: 200 len: 1362 microversion: 2.25 time: 0.705115 Oct 18 15:26:36.834652 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 305/606] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:26:36 2022] GET /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4 => generated 1362 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:26:36.842290 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-7a937e7a-f024-4ed4-bed8-666c810d8cf2 req-e252787e-eddf-41ce-b407-43aa153f3320 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28a18615-ab69-4e8e-865c-b8e0b67a74f4", "name": "network-vif-plugged", "status": "completed", "tag": "2477c9ea-1c78-4540-bd74-41bf83ab31bb"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:36.875125 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7a937e7a-f024-4ed4-bed8-666c810d8cf2 req-e252787e-eddf-41ce-b407-43aa153f3320 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:36.877272 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7a937e7a-f024-4ed4-bed8-666c810d8cf2 req-e252787e-eddf-41ce-b407-43aa153f3320 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:36.878029 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7a937e7a-f024-4ed4-bed8-666c810d8cf2 req-e252787e-eddf-41ce-b407-43aa153f3320 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:36.910424 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-7a937e7a-f024-4ed4-bed8-666c810d8cf2 req-e252787e-eddf-41ce-b407-43aa153f3320 service nova] Creating event network-vif-plugged:2477c9ea-1c78-4540-bd74-41bf83ab31bb for instance 28a18615-ab69-4e8e-865c-b8e0b67a74f4 on n-h1-853682-5 Oct 18 15:26:36.928715 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-7a937e7a-f024-4ed4-bed8-666c810d8cf2 req-e252787e-eddf-41ce-b407-43aa153f3320 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091450 Oct 18 15:26:36.930921 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 306/607] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:26:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:26:36.951616 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c5a4da62-a00c-4a26-9f6e-a07a8d388175 tempest-FlavorsAccessTestJSON-1585159880 tempest-FlavorsAccessTestJSON-1585159880-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:36.982746 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c5a4da62-a00c-4a26-9f6e-a07a8d388175 tempest-FlavorsAccessTestJSON-1585159880 tempest-FlavorsAccessTestJSON-1585159880-project] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5809 microversion: 2.1 time: 0.047006 Oct 18 15:26:36.985140 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 307/608] 10.222.0.60 () {58 vars in 1146 bytes} [Tue Oct 18 15:26:36 2022] GET /compute/v2.1/flavors/detail => generated 5809 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:37.005800 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bd1d9dcb-011a-4ec4-9817-b1ab0bdfc322 tempest-FlavorsAccessTestJSON-1639027594 tempest-FlavorsAccessTestJSON-1639027594-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:37.037418 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bd1d9dcb-011a-4ec4-9817-b1ab0bdfc322 tempest-FlavorsAccessTestJSON-1639027594 tempest-FlavorsAccessTestJSON-1639027594-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/1071581206" status: 202 len: 0 microversion: 2.1 time: 0.035094 Oct 18 15:26:37.040220 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 308/609] 10.222.0.60 () {58 vars in 1161 bytes} [Tue Oct 18 15:26:36 2022] DELETE /compute/v2.1/flavors/1071581206 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 15:26:37.050344 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-41e28048-8bd1-478c-8a5c-f583fecabeba tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:37.052103 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-41e28048-8bd1-478c-8a5c-f583fecabeba tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: 29ceb840-1b81-4434-841f-a473cded4b73] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:37.060972 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-41e28048-8bd1-478c-8a5c-f583fecabeba tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:37.062050 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-41e28048-8bd1-478c-8a5c-f583fecabeba tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:37.062700 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-41e28048-8bd1-478c-8a5c-f583fecabeba tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:37.063894 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-41e28048-8bd1-478c-8a5c-f583fecabeba tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:37.064675 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-41e28048-8bd1-478c-8a5c-f583fecabeba tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:37.065380 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-41e28048-8bd1-478c-8a5c-f583fecabeba tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:37.272250 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ff696766-72b4-4bcf-b30f-6ea8540658a6 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:37.282024 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ff696766-72b4-4bcf-b30f-6ea8540658a6 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/f07f6211-dd0e-4bdd-969c-fff2c3633dd0" status: 200 len: 1497 microversion: 2.1 time: 0.561013 Oct 18 15:26:37.297431 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 302/610] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:36 2022] GET /compute/v2.1/servers/f07f6211-dd0e-4bdd-969c-fff2c3633dd0 => generated 1497 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:37.304764 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fa5d84ac-5980-4cb8-9578-39c07a79fb74 tempest-FlavorsAccessTestJSON-1639027594 tempest-FlavorsAccessTestJSON-1639027594-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:37.332729 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fa5d84ac-5980-4cb8-9578-39c07a79fb74 tempest-FlavorsAccessTestJSON-1639027594 tempest-FlavorsAccessTestJSON-1639027594-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5809 microversion: 2.1 time: 0.033323 Oct 18 15:26:37.348310 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 303/611] 10.222.0.60 () {58 vars in 1146 bytes} [Tue Oct 18 15:26:37 2022] GET /compute/v2.1/flavors/detail => generated 5809 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:37.355321 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-add4ebe2-7fc9-47a0-9689-969637731330 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:37.356691 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-add4ebe2-7fc9-47a0-9689-969637731330 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] [instance: c3a3dd99-9387-4e73-a32d-e0c995b2b8b9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:37.363889 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-add4ebe2-7fc9-47a0-9689-969637731330 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:37.364435 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-add4ebe2-7fc9-47a0-9689-969637731330 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:37.365097 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-add4ebe2-7fc9-47a0-9689-969637731330 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:37.366005 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-add4ebe2-7fc9-47a0-9689-969637731330 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:37.366673 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-add4ebe2-7fc9-47a0-9689-969637731330 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:37.367262 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-add4ebe2-7fc9-47a0-9689-969637731330 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:37.518544 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-add4ebe2-7fc9-47a0-9689-969637731330 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7357f1c14a544016bba5abeee15f7a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c87221eb94488ba2e0fdd41386b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:37.532044 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-add4ebe2-7fc9-47a0-9689-969637731330 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] 10.222.0.60 "GET /compute/v2.1/servers/c3a3dd99-9387-4e73-a32d-e0c995b2b8b9" status: 200 len: 1274 microversion: 2.1 time: 0.181506 Oct 18 15:26:37.532286 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-41e28048-8bd1-478c-8a5c-f583fecabeba tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:37.534301 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 304/612] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:37 2022] GET /compute/v2.1/servers/c3a3dd99-9387-4e73-a32d-e0c995b2b8b9 => generated 1274 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:37.540172 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4939df20-f9ee-4b9e-9eb7-e661f75a9987 tempest-FlavorsAccessTestJSON-1639027594 tempest-FlavorsAccessTestJSON-1639027594-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1761961766", "id": 320451156, "os-flavor-access:is_public": "False"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:37.541523 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-41e28048-8bd1-478c-8a5c-f583fecabeba tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73" status: 200 len: 1477 microversion: 2.1 time: 0.498537 Oct 18 15:26:37.542443 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 309/613] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:37 2022] GET /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73 => generated 1477 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:37.567821 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f60e070d-428a-4358-96f2-ab3e5d08f175 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Calling method '.version_select at 0x7f7c3d6fd1f0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:37.570922 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4939df20-f9ee-4b9e-9eb7-e661f75a9987 tempest-FlavorsAccessTestJSON-1639027594 tempest-FlavorsAccessTestJSON-1639027594-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.034869 Oct 18 15:26:37.578831 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 305/614] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:26:37 2022] POST /compute/v2.1/flavors => generated 428 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:26:37.579874 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f60e070d-428a-4358-96f2-ab3e5d08f175 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:37.580571 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f60e070d-428a-4358-96f2-ab3e5d08f175 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:37.581461 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f60e070d-428a-4358-96f2-ab3e5d08f175 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:37.585218 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5f340748-84bb-4638-9cce-559f11e07861 tempest-FlavorsAccessTestJSON-1639027594 tempest-FlavorsAccessTestJSON-1639027594-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:37.595803 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f60e070d-428a-4358-96f2-ab3e5d08f175 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] 10.222.0.60 "GET /compute/v2.1/os-migrations" status: 200 len: 1166 microversion: 2.1 time: 0.031570 Oct 18 15:26:37.598013 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 310/615] 10.222.0.60 () {58 vars in 1143 bytes} [Tue Oct 18 15:26:37 2022] GET /compute/v2.1/os-migrations => generated 1166 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:37.603914 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5f340748-84bb-4638-9cce-559f11e07861 tempest-FlavorsAccessTestJSON-1639027594 tempest-FlavorsAccessTestJSON-1639027594-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/320451156/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.023663 Oct 18 15:26:37.609697 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 306/616] 10.222.0.60 () {58 vars in 1206 bytes} [Tue Oct 18 15:26:37 2022] GET /compute/v2.1/flavors/320451156/os-flavor-access => generated 21 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:26:37.616163 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-68e1b29a-433a-4c97-a11e-5148fcfa5780 tempest-FlavorsAccessTestJSON-1639027594 tempest-FlavorsAccessTestJSON-1639027594-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:37.617845 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5b45ee76-0cfb-4be7-8d5a-5942711b0dd9 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:37.618855 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5b45ee76-0cfb-4be7-8d5a-5942711b0dd9 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] [instance: 29ceb840-1b81-4434-841f-a473cded4b73] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:37.625963 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5b45ee76-0cfb-4be7-8d5a-5942711b0dd9 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:37.627528 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5b45ee76-0cfb-4be7-8d5a-5942711b0dd9 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:37.628220 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5b45ee76-0cfb-4be7-8d5a-5942711b0dd9 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:37.629256 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5b45ee76-0cfb-4be7-8d5a-5942711b0dd9 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:37.629931 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5b45ee76-0cfb-4be7-8d5a-5942711b0dd9 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:37.630568 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5b45ee76-0cfb-4be7-8d5a-5942711b0dd9 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:37.643454 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-68e1b29a-433a-4c97-a11e-5148fcfa5780 tempest-FlavorsAccessTestJSON-1639027594 tempest-FlavorsAccessTestJSON-1639027594-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/320451156" status: 202 len: 0 microversion: 2.1 time: 0.031016 Oct 18 15:26:37.644691 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 307/617] 10.222.0.60 () {58 vars in 1158 bytes} [Tue Oct 18 15:26:37 2022] DELETE /compute/v2.1/flavors/320451156 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:26:37.670680 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7c992b27-47fa-4b88-bd53-ceda8c884f66 tempest-FlavorsAccessTestJSON-1639027594 tempest-FlavorsAccessTestJSON-1639027594-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:37.709445 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7c992b27-47fa-4b88-bd53-ceda8c884f66 tempest-FlavorsAccessTestJSON-1639027594 tempest-FlavorsAccessTestJSON-1639027594-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5809 microversion: 2.1 time: 0.058693 Oct 18 15:26:37.710488 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 308/618] 10.222.0.60 () {58 vars in 1146 bytes} [Tue Oct 18 15:26:37 2022] GET /compute/v2.1/flavors/detail => generated 5809 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:37.861790 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6e95221c-0f6f-4579-8818-7896cf13556b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:37.862575 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6e95221c-0f6f-4579-8818-7896cf13556b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 28a18615-ab69-4e8e-865c-b8e0b67a74f4] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:37.876233 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6e95221c-0f6f-4579-8818-7896cf13556b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:37.884719 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6e95221c-0f6f-4579-8818-7896cf13556b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:37.885367 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6e95221c-0f6f-4579-8818-7896cf13556b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:37.886254 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6e95221c-0f6f-4579-8818-7896cf13556b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:37.887348 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6e95221c-0f6f-4579-8818-7896cf13556b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:37.888034 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6e95221c-0f6f-4579-8818-7896cf13556b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:37.953911 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5b45ee76-0cfb-4be7-8d5a-5942711b0dd9 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73" status: 200 len: 1628 microversion: 2.1 time: 0.341290 Oct 18 15:26:37.959283 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 311/619] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:37 2022] GET /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73 => generated 1628 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:37.991934 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b080d50e-6654-42e3-9cb5-53c01cb0632b tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Action: 'create', calling method: .version_select at 0x7f7c3d6fd1f0>, body: {"keypair": {"name": "tempest-keypair-1738563358", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBaIvSo4NhGeANE1IDNibumE84cWz7/3zJu2Sdgcb//3cJTy6xqJAaH/09ae5dxlIP1bUDo7B9lfRvQoF7N//fzSHSSEkOLz71Vdxsd9ANMDgvlPJNBeB/Nw/qqS7SvXZw=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:38.026158 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-b080d50e-6654-42e3-9cb5-53c01cb0632b tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Getting quotas for project a6565f6ef56e4ed3b530d009055cd619. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:26:38.033532 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-b080d50e-6654-42e3-9cb5-53c01cb0632b tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Getting quotas for user c747aec412924b52b99dbf75d0c77fa4 and project a6565f6ef56e4ed3b530d009055cd619. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:26:38.062964 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b080d50e-6654-42e3-9cb5-53c01cb0632b tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.075403 Oct 18 15:26:38.065455 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 312/620] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Oct 18 15:26:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:26:38.313922 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a10fedf0-ea9e-431d-9003-b4c849501fc2 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:38.315169 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a10fedf0-ea9e-431d-9003-b4c849501fc2 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: f07f6211-dd0e-4bdd-969c-fff2c3633dd0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:38.326989 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a10fedf0-ea9e-431d-9003-b4c849501fc2 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:38.328112 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a10fedf0-ea9e-431d-9003-b4c849501fc2 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:38.329650 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a10fedf0-ea9e-431d-9003-b4c849501fc2 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:38.331006 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a10fedf0-ea9e-431d-9003-b4c849501fc2 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:38.331634 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a10fedf0-ea9e-431d-9003-b4c849501fc2 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:38.332239 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a10fedf0-ea9e-431d-9003-b4c849501fc2 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:38.348407 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:26:38.699388 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6e95221c-0f6f-4579-8818-7896cf13556b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:38.709476 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6e95221c-0f6f-4579-8818-7896cf13556b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:38.711780 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6e95221c-0f6f-4579-8818-7896cf13556b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:38.713974 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6e95221c-0f6f-4579-8818-7896cf13556b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4" status: 200 len: 1362 microversion: 2.25 time: 0.856408 Oct 18 15:26:38.724678 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 309/621] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:26:37 2022] GET /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4 => generated 1362 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:26:38.728205 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5a70a5ed-aa32-477a-8b66-28384a204599 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:38.729714 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5a70a5ed-aa32-477a-8b66-28384a204599 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] [instance: c3a3dd99-9387-4e73-a32d-e0c995b2b8b9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:38.743328 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5a70a5ed-aa32-477a-8b66-28384a204599 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:38.744775 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5a70a5ed-aa32-477a-8b66-28384a204599 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:38.760349 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5a70a5ed-aa32-477a-8b66-28384a204599 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:38.761817 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5a70a5ed-aa32-477a-8b66-28384a204599 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:38.762587 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5a70a5ed-aa32-477a-8b66-28384a204599 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:38.763642 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5a70a5ed-aa32-477a-8b66-28384a204599 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:38.948928 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5a70a5ed-aa32-477a-8b66-28384a204599 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7357f1c14a544016bba5abeee15f7a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c87221eb94488ba2e0fdd41386b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:38.961728 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5a70a5ed-aa32-477a-8b66-28384a204599 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] 10.222.0.60 "GET /compute/v2.1/servers/c3a3dd99-9387-4e73-a32d-e0c995b2b8b9" status: 200 len: 1280 microversion: 2.1 time: 0.238729 Oct 18 15:26:38.962894 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 310/622] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:38 2022] GET /compute/v2.1/servers/c3a3dd99-9387-4e73-a32d-e0c995b2b8b9 => generated 1280 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:39.214908 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a10fedf0-ea9e-431d-9003-b4c849501fc2 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:39.225073 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a10fedf0-ea9e-431d-9003-b4c849501fc2 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/f07f6211-dd0e-4bdd-969c-fff2c3633dd0" status: 200 len: 1497 microversion: 2.1 time: 0.918749 Oct 18 15:26:39.231111 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 313/623] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:38 2022] GET /compute/v2.1/servers/f07f6211-dd0e-4bdd-969c-fff2c3633dd0 => generated 1497 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:39.744987 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-38748d93-a10e-4045-b2ce-ce55c31f7d24 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:39.745609 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-38748d93-a10e-4045-b2ce-ce55c31f7d24 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 28a18615-ab69-4e8e-865c-b8e0b67a74f4] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:39.756029 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-38748d93-a10e-4045-b2ce-ce55c31f7d24 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:39.758424 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-38748d93-a10e-4045-b2ce-ce55c31f7d24 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:39.758918 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-38748d93-a10e-4045-b2ce-ce55c31f7d24 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:39.760206 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-38748d93-a10e-4045-b2ce-ce55c31f7d24 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:39.760670 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-38748d93-a10e-4045-b2ce-ce55c31f7d24 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:39.763066 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-38748d93-a10e-4045-b2ce-ce55c31f7d24 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:39.983461 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=10 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:26:39.989425 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-be4c292d-c317-4bf6-af80-6cd1551f7c83 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:39.990557 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-be4c292d-c317-4bf6-af80-6cd1551f7c83 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] [instance: c3a3dd99-9387-4e73-a32d-e0c995b2b8b9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:40.006475 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be4c292d-c317-4bf6-af80-6cd1551f7c83 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:40.007733 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be4c292d-c317-4bf6-af80-6cd1551f7c83 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:40.010794 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be4c292d-c317-4bf6-af80-6cd1551f7c83 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:40.011819 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be4c292d-c317-4bf6-af80-6cd1551f7c83 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:40.015197 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be4c292d-c317-4bf6-af80-6cd1551f7c83 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:40.020725 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be4c292d-c317-4bf6-af80-6cd1551f7c83 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:40.274442 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-be4c292d-c317-4bf6-af80-6cd1551f7c83 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7357f1c14a544016bba5abeee15f7a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c87221eb94488ba2e0fdd41386b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:40.285205 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-be4c292d-c317-4bf6-af80-6cd1551f7c83 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] 10.222.0.60 "GET /compute/v2.1/servers/c3a3dd99-9387-4e73-a32d-e0c995b2b8b9" status: 200 len: 1280 microversion: 2.1 time: 0.300385 Oct 18 15:26:40.285839 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 314/624] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:39 2022] GET /compute/v2.1/servers/c3a3dd99-9387-4e73-a32d-e0c995b2b8b9 => generated 1280 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:26:40.300950 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-17263d3f-d6f4-4cad-8812-c6dc48e11c3a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:40.300950 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-17263d3f-d6f4-4cad-8812-c6dc48e11c3a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: f07f6211-dd0e-4bdd-969c-fff2c3633dd0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:40.313929 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17263d3f-d6f4-4cad-8812-c6dc48e11c3a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:40.315285 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17263d3f-d6f4-4cad-8812-c6dc48e11c3a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:40.315729 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17263d3f-d6f4-4cad-8812-c6dc48e11c3a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:40.317572 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17263d3f-d6f4-4cad-8812-c6dc48e11c3a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:40.320206 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17263d3f-d6f4-4cad-8812-c6dc48e11c3a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:40.320689 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17263d3f-d6f4-4cad-8812-c6dc48e11c3a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:40.722108 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-38748d93-a10e-4045-b2ce-ce55c31f7d24 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:40.734563 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-38748d93-a10e-4045-b2ce-ce55c31f7d24 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:40.737218 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-38748d93-a10e-4045-b2ce-ce55c31f7d24 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:40.742860 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-38748d93-a10e-4045-b2ce-ce55c31f7d24 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4" status: 200 len: 1557 microversion: 2.25 time: 1.002807 Oct 18 15:26:40.743453 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 311/625] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:26:39 2022] GET /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4 => generated 1557 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:26:40.776112 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e0262ac3-de29-4c80-a0e2-0d2a53b05df9 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:40.777521 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e0262ac3-de29-4c80-a0e2-0d2a53b05df9 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] [instance: 28a18615-ab69-4e8e-865c-b8e0b67a74f4] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:40.784346 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e0262ac3-de29-4c80-a0e2-0d2a53b05df9 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:40.785101 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e0262ac3-de29-4c80-a0e2-0d2a53b05df9 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:40.785867 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e0262ac3-de29-4c80-a0e2-0d2a53b05df9 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:40.786736 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e0262ac3-de29-4c80-a0e2-0d2a53b05df9 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:40.787350 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e0262ac3-de29-4c80-a0e2-0d2a53b05df9 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:40.787933 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e0262ac3-de29-4c80-a0e2-0d2a53b05df9 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:41.001766 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-17263d3f-d6f4-4cad-8812-c6dc48e11c3a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:41.018574 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-17263d3f-d6f4-4cad-8812-c6dc48e11c3a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/f07f6211-dd0e-4bdd-969c-fff2c3633dd0" status: 200 len: 1497 microversion: 2.1 time: 0.731583 Oct 18 15:26:41.020301 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 315/626] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:40 2022] GET /compute/v2.1/servers/f07f6211-dd0e-4bdd-969c-fff2c3633dd0 => generated 1497 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:41.159388 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-e0262ac3-de29-4c80-a0e2-0d2a53b05df9 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lazy-loading 'services' on Instance uuid 28a18615-ab69-4e8e-865c-b8e0b67a74f4 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:26:41.296586 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e0262ac3-de29-4c80-a0e2-0d2a53b05df9 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4" status: 200 len: 2050 microversion: 2.25 time: 0.523943 Oct 18 15:26:41.297493 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 312/627] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:26:40 2022] GET /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4 => generated 2050 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:26:41.323679 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9c601b1e-0555-448e-985b-96f0e55fcbc4 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:41.326995 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9c601b1e-0555-448e-985b-96f0e55fcbc4 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] [instance: c3a3dd99-9387-4e73-a32d-e0c995b2b8b9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:41.328057 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6fd100fe-6cbf-41a9-b38e-a9558589f9fc tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:41.329441 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6fd100fe-6cbf-41a9-b38e-a9558589f9fc tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] [instance: 28a18615-ab69-4e8e-865c-b8e0b67a74f4] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:41.335802 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c601b1e-0555-448e-985b-96f0e55fcbc4 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:41.336797 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c601b1e-0555-448e-985b-96f0e55fcbc4 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:41.337592 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c601b1e-0555-448e-985b-96f0e55fcbc4 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:41.338649 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c601b1e-0555-448e-985b-96f0e55fcbc4 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:41.339599 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c601b1e-0555-448e-985b-96f0e55fcbc4 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:41.340293 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c601b1e-0555-448e-985b-96f0e55fcbc4 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:41.345364 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6fd100fe-6cbf-41a9-b38e-a9558589f9fc tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:41.348526 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6fd100fe-6cbf-41a9-b38e-a9558589f9fc tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:41.351187 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6fd100fe-6cbf-41a9-b38e-a9558589f9fc tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:41.352609 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6fd100fe-6cbf-41a9-b38e-a9558589f9fc tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:41.353189 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6fd100fe-6cbf-41a9-b38e-a9558589f9fc tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:41.354426 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6fd100fe-6cbf-41a9-b38e-a9558589f9fc tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:42.312329 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9c601b1e-0555-448e-985b-96f0e55fcbc4 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7357f1c14a544016bba5abeee15f7a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c87221eb94488ba2e0fdd41386b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:42.325845 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9c601b1e-0555-448e-985b-96f0e55fcbc4 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] 10.222.0.60 "GET /compute/v2.1/servers/c3a3dd99-9387-4e73-a32d-e0c995b2b8b9" status: 200 len: 1322 microversion: 2.1 time: 1.015378 Oct 18 15:26:42.329226 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 316/628] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:41 2022] GET /compute/v2.1/servers/c3a3dd99-9387-4e73-a32d-e0c995b2b8b9 => generated 1322 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:42.349904 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c9e6bfe7-1ad7-47de-99d6-e1a9effdb280 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:42.354487 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c9e6bfe7-1ad7-47de-99d6-e1a9effdb280 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: f07f6211-dd0e-4bdd-969c-fff2c3633dd0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:42.377473 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9e6bfe7-1ad7-47de-99d6-e1a9effdb280 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:42.380450 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9e6bfe7-1ad7-47de-99d6-e1a9effdb280 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:42.381098 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9e6bfe7-1ad7-47de-99d6-e1a9effdb280 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:42.383015 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9e6bfe7-1ad7-47de-99d6-e1a9effdb280 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:42.388144 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9e6bfe7-1ad7-47de-99d6-e1a9effdb280 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:42.389087 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9e6bfe7-1ad7-47de-99d6-e1a9effdb280 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:42.390694 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-6fd100fe-6cbf-41a9-b38e-a9558589f9fc tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lazy-loading 'services' on Instance uuid 28a18615-ab69-4e8e-865c-b8e0b67a74f4 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:26:42.429382 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6fd100fe-6cbf-41a9-b38e-a9558589f9fc tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4" status: 200 len: 2050 microversion: 2.25 time: 1.105996 Oct 18 15:26:42.431009 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 313/629] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:26:41 2022] GET /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4 => generated 2050 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:26:42.456123 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9ed52813-f537-40e6-a39a-49b2a45b0bcc tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:42.460386 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9ed52813-f537-40e6-a39a-49b2a45b0bcc tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:42.461089 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9ed52813-f537-40e6-a39a-49b2a45b0bcc tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:42.461722 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9ed52813-f537-40e6-a39a-49b2a45b0bcc tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:42.462625 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9ed52813-f537-40e6-a39a-49b2a45b0bcc tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:42.463239 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9ed52813-f537-40e6-a39a-49b2a45b0bcc tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:42.463824 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9ed52813-f537-40e6-a39a-49b2a45b0bcc tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:42.499341 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9ed52813-f537-40e6-a39a-49b2a45b0bcc tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.047219 Oct 18 15:26:42.501875 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 314/630] 10.222.0.60 () {60 vars in 1217 bytes} [Tue Oct 18 15:26:42 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 15:26:42.523450 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ef3792bc-3089-49d7-a4b2-a56b2c0a86c9 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:42.524880 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ef3792bc-3089-49d7-a4b2-a56b2c0a86c9 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] [instance: 28a18615-ab69-4e8e-865c-b8e0b67a74f4] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:42.534151 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ef3792bc-3089-49d7-a4b2-a56b2c0a86c9 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:42.535096 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ef3792bc-3089-49d7-a4b2-a56b2c0a86c9 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:42.536072 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ef3792bc-3089-49d7-a4b2-a56b2c0a86c9 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:42.538698 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ef3792bc-3089-49d7-a4b2-a56b2c0a86c9 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:42.539526 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ef3792bc-3089-49d7-a4b2-a56b2c0a86c9 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:42.540392 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ef3792bc-3089-49d7-a4b2-a56b2c0a86c9 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:42.717222 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ef3792bc-3089-49d7-a4b2-a56b2c0a86c9 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4/action" status: 202 len: 0 microversion: 2.25 time: 0.206679 Oct 18 15:26:42.719856 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 315/631] 10.222.0.60 () {62 vars in 1319 bytes} [Tue Oct 18 15:26:42 2022] POST /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:26:42.734072 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-170533be-a492-4108-853a-3ec1c1ff053f tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:42.737289 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-170533be-a492-4108-853a-3ec1c1ff053f tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] [instance: 28a18615-ab69-4e8e-865c-b8e0b67a74f4] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:42.759380 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-170533be-a492-4108-853a-3ec1c1ff053f tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:42.761244 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-170533be-a492-4108-853a-3ec1c1ff053f tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:42.762991 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-170533be-a492-4108-853a-3ec1c1ff053f tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:42.764677 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-170533be-a492-4108-853a-3ec1c1ff053f tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:42.765545 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-170533be-a492-4108-853a-3ec1c1ff053f tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:42.766290 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-170533be-a492-4108-853a-3ec1c1ff053f tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:43.011069 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c9e6bfe7-1ad7-47de-99d6-e1a9effdb280 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:43.021784 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c9e6bfe7-1ad7-47de-99d6-e1a9effdb280 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/f07f6211-dd0e-4bdd-969c-fff2c3633dd0" status: 200 len: 1497 microversion: 2.1 time: 0.687842 Oct 18 15:26:43.031077 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 317/632] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:42 2022] GET /compute/v2.1/servers/f07f6211-dd0e-4bdd-969c-fff2c3633dd0 => generated 1497 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:43.357632 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b51deec7-4f7b-42e6-8385-109d292c4d21 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:43.358235 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b51deec7-4f7b-42e6-8385-109d292c4d21 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] [instance: c3a3dd99-9387-4e73-a32d-e0c995b2b8b9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:43.364647 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-170533be-a492-4108-853a-3ec1c1ff053f tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lazy-loading 'services' on Instance uuid 28a18615-ab69-4e8e-865c-b8e0b67a74f4 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:26:43.371448 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b51deec7-4f7b-42e6-8385-109d292c4d21 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:43.371940 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b51deec7-4f7b-42e6-8385-109d292c4d21 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:43.372372 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b51deec7-4f7b-42e6-8385-109d292c4d21 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:43.373112 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b51deec7-4f7b-42e6-8385-109d292c4d21 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:43.373571 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b51deec7-4f7b-42e6-8385-109d292c4d21 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:43.373993 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b51deec7-4f7b-42e6-8385-109d292c4d21 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:43.408062 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-170533be-a492-4108-853a-3ec1c1ff053f tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4" status: 200 len: 2055 microversion: 2.25 time: 0.669168 Oct 18 15:26:43.425141 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 316/633] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:26:42 2022] GET /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4 => generated 2055 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:26:43.733452 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-170533be-a492-4108-853a-3ec1c1ff053f tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:43.734945 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-170533be-a492-4108-853a-3ec1c1ff053f tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] 10.222.0.60 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002090 Oct 18 15:26:43.736218 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 317/634] 10.222.0.60 () {56 vars in 886 bytes} [Tue Oct 18 15:26:43 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 18 15:26:43.799210 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b51deec7-4f7b-42e6-8385-109d292c4d21 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7357f1c14a544016bba5abeee15f7a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c87221eb94488ba2e0fdd41386b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:43.809236 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b51deec7-4f7b-42e6-8385-109d292c4d21 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] 10.222.0.60 "GET /compute/v2.1/servers/c3a3dd99-9387-4e73-a32d-e0c995b2b8b9" status: 200 len: 1322 microversion: 2.1 time: 0.455902 Oct 18 15:26:43.813529 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 318/635] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:43 2022] GET /compute/v2.1/servers/c3a3dd99-9387-4e73-a32d-e0c995b2b8b9 => generated 1322 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:44.055506 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-24f1eb4c-e768-445c-baa5-dc5651440693 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:44.056122 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-24f1eb4c-e768-445c-baa5-dc5651440693 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: f07f6211-dd0e-4bdd-969c-fff2c3633dd0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:44.077769 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-24f1eb4c-e768-445c-baa5-dc5651440693 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:44.078265 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-24f1eb4c-e768-445c-baa5-dc5651440693 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:44.078701 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-24f1eb4c-e768-445c-baa5-dc5651440693 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:44.079517 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-24f1eb4c-e768-445c-baa5-dc5651440693 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:44.079977 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-24f1eb4c-e768-445c-baa5-dc5651440693 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:44.080401 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-24f1eb4c-e768-445c-baa5-dc5651440693 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:44.333080 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9291626b-ef0d-4455-8bb4-4ee90b2d9a13 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-186545816", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "010df557-27fc-4c93-a23e-d2c3321314f6"}], "security_groups": [{"name": "tempest-securitygroup--1853217379"}], "key_name": "tempest-keypair-1738563358", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:44.507931 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-24f1eb4c-e768-445c-baa5-dc5651440693 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:44.527002 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-24f1eb4c-e768-445c-baa5-dc5651440693 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/f07f6211-dd0e-4bdd-969c-fff2c3633dd0" status: 200 len: 1497 microversion: 2.1 time: 0.473809 Oct 18 15:26:44.528076 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 318/636] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:44 2022] GET /compute/v2.1/servers/f07f6211-dd0e-4bdd-969c-fff2c3633dd0 => generated 1497 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:44.539206 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5fbe843d-a29d-4838-8d2f-e22e930d7ce8 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:44.539833 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5fbe843d-a29d-4838-8d2f-e22e930d7ce8 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] [instance: 28a18615-ab69-4e8e-865c-b8e0b67a74f4] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:44.549804 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5fbe843d-a29d-4838-8d2f-e22e930d7ce8 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:44.550504 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5fbe843d-a29d-4838-8d2f-e22e930d7ce8 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:44.551207 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5fbe843d-a29d-4838-8d2f-e22e930d7ce8 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:44.553656 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5fbe843d-a29d-4838-8d2f-e22e930d7ce8 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:44.554158 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5fbe843d-a29d-4838-8d2f-e22e930d7ce8 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:44.554588 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5fbe843d-a29d-4838-8d2f-e22e930d7ce8 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:44.754566 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-9291626b-ef0d-4455-8bb4-4ee90b2d9a13 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] validate_networks() for [('010df557-27fc-4c93-a23e-d2c3321314f6', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:26:45.100846 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-5fbe843d-a29d-4838-8d2f-e22e930d7ce8 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lazy-loading 'services' on Instance uuid 28a18615-ab69-4e8e-865c-b8e0b67a74f4 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:26:45.138769 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5fbe843d-a29d-4838-8d2f-e22e930d7ce8 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4" status: 200 len: 2035 microversion: 2.25 time: 0.598893 Oct 18 15:26:45.140266 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 319/637] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:26:44 2022] GET /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4 => generated 2035 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:26:45.150913 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a8421d61-9d26-4bc9-a3e3-1ac7aefa5928 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:45.151520 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a8421d61-9d26-4bc9-a3e3-1ac7aefa5928 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] [instance: c3a3dd99-9387-4e73-a32d-e0c995b2b8b9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:45.166732 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a8421d61-9d26-4bc9-a3e3-1ac7aefa5928 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:45.167662 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a8421d61-9d26-4bc9-a3e3-1ac7aefa5928 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:45.168783 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a8421d61-9d26-4bc9-a3e3-1ac7aefa5928 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:45.171875 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a8421d61-9d26-4bc9-a3e3-1ac7aefa5928 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:45.172521 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a8421d61-9d26-4bc9-a3e3-1ac7aefa5928 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:45.175824 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a8421d61-9d26-4bc9-a3e3-1ac7aefa5928 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:45.749152 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=5 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:26:46.249760 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a8421d61-9d26-4bc9-a3e3-1ac7aefa5928 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7357f1c14a544016bba5abeee15f7a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c87221eb94488ba2e0fdd41386b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:46.256337 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:26:46.266673 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a8421d61-9d26-4bc9-a3e3-1ac7aefa5928 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] 10.222.0.60 "GET /compute/v2.1/servers/c3a3dd99-9387-4e73-a32d-e0c995b2b8b9" status: 200 len: 1322 microversion: 2.1 time: 1.124494 Oct 18 15:26:46.269509 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 320/638] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:45 2022] GET /compute/v2.1/servers/c3a3dd99-9387-4e73-a32d-e0c995b2b8b9 => generated 1322 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:46.280255 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ba8c9cf8-d524-485b-95d5-f0e521783803 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-853682-5", "block_migration": "auto"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:46.289156 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ba8c9cf8-d524-485b-95d5-f0e521783803 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] [instance: 28a18615-ab69-4e8e-865c-b8e0b67a74f4] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:46.302807 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba8c9cf8-d524-485b-95d5-f0e521783803 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:46.312900 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba8c9cf8-d524-485b-95d5-f0e521783803 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:46.313627 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba8c9cf8-d524-485b-95d5-f0e521783803 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:46.314683 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba8c9cf8-d524-485b-95d5-f0e521783803 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:46.315294 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba8c9cf8-d524-485b-95d5-f0e521783803 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:46.315891 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba8c9cf8-d524-485b-95d5-f0e521783803 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:46.408570 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-ba8c9cf8-d524-485b-95d5-f0e521783803 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lazy-loading 'flavor' on Instance uuid 28a18615-ab69-4e8e-865c-b8e0b67a74f4 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:26:46.427775 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ba8c9cf8-d524-485b-95d5-f0e521783803 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] [instance: 28a18615-ab69-4e8e-865c-b8e0b67a74f4] Going to try to live migrate instance to n-h2-853682-5 {{(pid=120405) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 18 15:26:47.136995 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9291626b-ef0d-4455-8bb4-4ee90b2d9a13 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:26:47.137731 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9291626b-ef0d-4455-8bb4-4ee90b2d9a13 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:26:47.138315 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9291626b-ef0d-4455-8bb4-4ee90b2d9a13 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:26:47.138843 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9291626b-ef0d-4455-8bb4-4ee90b2d9a13 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:26:47.139495 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9291626b-ef0d-4455-8bb4-4ee90b2d9a13 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:26:47.155190 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9291626b-ef0d-4455-8bb4-4ee90b2d9a13 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:47.156315 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9291626b-ef0d-4455-8bb4-4ee90b2d9a13 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:47.160289 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9291626b-ef0d-4455-8bb4-4ee90b2d9a13 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:47.162977 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9291626b-ef0d-4455-8bb4-4ee90b2d9a13 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:47.164699 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9291626b-ef0d-4455-8bb4-4ee90b2d9a13 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:47.165603 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9291626b-ef0d-4455-8bb4-4ee90b2d9a13 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:47.214044 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-9291626b-ef0d-4455-8bb4-4ee90b2d9a13 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Getting quotas for project a6565f6ef56e4ed3b530d009055cd619. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:26:47.228411 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-9291626b-ef0d-4455-8bb4-4ee90b2d9a13 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Getting quotas for user c747aec412924b52b99dbf75d0c77fa4 and project a6565f6ef56e4ed3b530d009055cd619. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:26:47.268404 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9291626b-ef0d-4455-8bb4-4ee90b2d9a13 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:26:47.271509 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9291626b-ef0d-4455-8bb4-4ee90b2d9a13 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:26:47.367362 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9291626b-ef0d-4455-8bb4-4ee90b2d9a13 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.038800 Oct 18 15:26:47.369890 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 319/639] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:26:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 3042 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 15:26:47.375818 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-67d5cc36-810f-41d0-92b5-02e9b95b18e3 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:47.376911 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-67d5cc36-810f-41d0-92b5-02e9b95b18e3 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: f07f6211-dd0e-4bdd-969c-fff2c3633dd0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:47.390618 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67d5cc36-810f-41d0-92b5-02e9b95b18e3 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:47.391611 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67d5cc36-810f-41d0-92b5-02e9b95b18e3 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:47.392213 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67d5cc36-810f-41d0-92b5-02e9b95b18e3 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:47.393762 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67d5cc36-810f-41d0-92b5-02e9b95b18e3 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:47.394422 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67d5cc36-810f-41d0-92b5-02e9b95b18e3 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:47.395012 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67d5cc36-810f-41d0-92b5-02e9b95b18e3 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:47.920156 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-67d5cc36-810f-41d0-92b5-02e9b95b18e3 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:47.936362 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-67d5cc36-810f-41d0-92b5-02e9b95b18e3 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/f07f6211-dd0e-4bdd-969c-fff2c3633dd0" status: 200 len: 1497 microversion: 2.1 time: 0.564412 Oct 18 15:26:47.937795 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 320/640] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:47 2022] GET /compute/v2.1/servers/f07f6211-dd0e-4bdd-969c-fff2c3633dd0 => generated 1497 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:47.948714 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-eb3db7d4-f253-48da-9622-85f94e93ba1c req-6c6c4160-f595-4707-b467-d243b19f0770 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3a3dd99-9387-4e73-a32d-e0c995b2b8b9", "tag": "fdd8b15f-c862-43e2-b67b-3e615e36105f"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:48.013180 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-eb3db7d4-f253-48da-9622-85f94e93ba1c req-6c6c4160-f595-4707-b467-d243b19f0770 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:48.014104 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-eb3db7d4-f253-48da-9622-85f94e93ba1c req-6c6c4160-f595-4707-b467-d243b19f0770 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:48.016287 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-eb3db7d4-f253-48da-9622-85f94e93ba1c req-6c6c4160-f595-4707-b467-d243b19f0770 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:48.059453 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-eb3db7d4-f253-48da-9622-85f94e93ba1c req-6c6c4160-f595-4707-b467-d243b19f0770 service nova] Creating event network-changed:fdd8b15f-c862-43e2-b67b-3e615e36105f for instance c3a3dd99-9387-4e73-a32d-e0c995b2b8b9 on n-h2-853682-5 Oct 18 15:26:48.077883 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-eb3db7d4-f253-48da-9622-85f94e93ba1c req-6c6c4160-f595-4707-b467-d243b19f0770 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132772 Oct 18 15:26:48.079125 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 321/641] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:26:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:26:48.088370 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-94fd8672-e5b1-4513-b052-d562cf20b49c tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:48.089708 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-94fd8672-e5b1-4513-b052-d562cf20b49c tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] [instance: c3a3dd99-9387-4e73-a32d-e0c995b2b8b9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:48.097590 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94fd8672-e5b1-4513-b052-d562cf20b49c tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:48.098557 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94fd8672-e5b1-4513-b052-d562cf20b49c tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:48.099235 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94fd8672-e5b1-4513-b052-d562cf20b49c tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:48.100413 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94fd8672-e5b1-4513-b052-d562cf20b49c tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:48.101258 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94fd8672-e5b1-4513-b052-d562cf20b49c tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:48.102144 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94fd8672-e5b1-4513-b052-d562cf20b49c tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:48.449005 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-94fd8672-e5b1-4513-b052-d562cf20b49c tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7357f1c14a544016bba5abeee15f7a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c87221eb94488ba2e0fdd41386b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:48.469563 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-94fd8672-e5b1-4513-b052-d562cf20b49c tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] 10.222.0.60 "GET /compute/v2.1/servers/c3a3dd99-9387-4e73-a32d-e0c995b2b8b9" status: 200 len: 1322 microversion: 2.1 time: 0.383771 Oct 18 15:26:48.475088 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 322/642] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:48 2022] GET /compute/v2.1/servers/c3a3dd99-9387-4e73-a32d-e0c995b2b8b9 => generated 1322 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:48.490164 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f21ac23b-5046-4c6b-a1ac-ef315dde2798 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:48.504185 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f21ac23b-5046-4c6b-a1ac-ef315dde2798 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:48.516591 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f21ac23b-5046-4c6b-a1ac-ef315dde2798 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:48.522500 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f21ac23b-5046-4c6b-a1ac-ef315dde2798 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:48.523426 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f21ac23b-5046-4c6b-a1ac-ef315dde2798 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:48.536464 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f21ac23b-5046-4c6b-a1ac-ef315dde2798 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:48.537072 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f21ac23b-5046-4c6b-a1ac-ef315dde2798 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:48.537793 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f21ac23b-5046-4c6b-a1ac-ef315dde2798 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:49.059509 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f21ac23b-5046-4c6b-a1ac-ef315dde2798 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:49.076762 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f21ac23b-5046-4c6b-a1ac-ef315dde2798 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2" status: 200 len: 1230 microversion: 2.1 time: 0.598931 Oct 18 15:26:49.077403 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 323/643] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:48 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2 => generated 1230 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:49.092089 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4e15912a-e59a-403c-8d27-6cb19c757d35 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:49.101571 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4e15912a-e59a-403c-8d27-6cb19c757d35 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: f07f6211-dd0e-4bdd-969c-fff2c3633dd0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:49.117965 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e15912a-e59a-403c-8d27-6cb19c757d35 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:49.118480 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e15912a-e59a-403c-8d27-6cb19c757d35 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:49.118924 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e15912a-e59a-403c-8d27-6cb19c757d35 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:49.121813 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e15912a-e59a-403c-8d27-6cb19c757d35 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:49.122299 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e15912a-e59a-403c-8d27-6cb19c757d35 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:49.122736 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e15912a-e59a-403c-8d27-6cb19c757d35 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:49.416623 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4e15912a-e59a-403c-8d27-6cb19c757d35 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:49.435814 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4e15912a-e59a-403c-8d27-6cb19c757d35 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/f07f6211-dd0e-4bdd-969c-fff2c3633dd0" status: 200 len: 1497 microversion: 2.1 time: 0.357117 Oct 18 15:26:49.454338 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 324/644] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:49 2022] GET /compute/v2.1/servers/f07f6211-dd0e-4bdd-969c-fff2c3633dd0 => generated 1497 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:50.019888 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-06f45217-f128-417e-9101-ff5d94999ec0 tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] Action: 'create', calling method: .version_select at 0x7f7c3d6b7550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-529843916", "description": "tempest-description-1831283294"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:50.386991 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-06f45217-f128-417e-9101-ff5d94999ec0 tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.928077 Oct 18 15:26:50.387850 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 325/645] 10.222.0.60 () {60 vars in 1180 bytes} [Tue Oct 18 15:26:49 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:26:50.393483 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bfab8372-1e62-4213-af3e-bd25c916a8c0 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:50.394342 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bfab8372-1e62-4213-af3e-bd25c916a8c0 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] [instance: c3a3dd99-9387-4e73-a32d-e0c995b2b8b9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:50.406701 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bfab8372-1e62-4213-af3e-bd25c916a8c0 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:50.410766 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bfab8372-1e62-4213-af3e-bd25c916a8c0 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:50.411542 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bfab8372-1e62-4213-af3e-bd25c916a8c0 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:50.412451 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bfab8372-1e62-4213-af3e-bd25c916a8c0 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:50.416560 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bfab8372-1e62-4213-af3e-bd25c916a8c0 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:50.417204 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bfab8372-1e62-4213-af3e-bd25c916a8c0 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:50.662505 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bfab8372-1e62-4213-af3e-bd25c916a8c0 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7357f1c14a544016bba5abeee15f7a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c87221eb94488ba2e0fdd41386b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:50.671861 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bfab8372-1e62-4213-af3e-bd25c916a8c0 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] 10.222.0.60 "GET /compute/v2.1/servers/c3a3dd99-9387-4e73-a32d-e0c995b2b8b9" status: 200 len: 1322 microversion: 2.1 time: 0.282660 Oct 18 15:26:50.702271 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 326/646] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:50 2022] GET /compute/v2.1/servers/c3a3dd99-9387-4e73-a32d-e0c995b2b8b9 => generated 1322 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:50.708442 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5fab0922-8d3f-4cc7-8f30-419a68acc67e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:50.709367 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5fab0922-8d3f-4cc7-8f30-419a68acc67e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:50.716030 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:INSERT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:26:50.717944 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5fab0922-8d3f-4cc7-8f30-419a68acc67e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:50.718672 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5fab0922-8d3f-4cc7-8f30-419a68acc67e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:50.719360 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5fab0922-8d3f-4cc7-8f30-419a68acc67e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:50.720342 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5fab0922-8d3f-4cc7-8f30-419a68acc67e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:50.721059 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5fab0922-8d3f-4cc7-8f30-419a68acc67e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:50.721697 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5fab0922-8d3f-4cc7-8f30-419a68acc67e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:50.800301 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5fab0922-8d3f-4cc7-8f30-419a68acc67e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:50.810313 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5fab0922-8d3f-4cc7-8f30-419a68acc67e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2" status: 200 len: 1292 microversion: 2.1 time: 0.106465 Oct 18 15:26:50.824494 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 327/647] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:50 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2 => generated 1292 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:50.993710 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f1f75698-74d8-4811-9894-e7758c82c1da tempest-NetworksTest-1338558981 tempest-NetworksTest-1338558981-project-admin] Calling method '.version_select at 0x7f7c3dbb2f70>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:51.127671 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f1f75698-74d8-4811-9894-e7758c82c1da tempest-NetworksTest-1338558981 tempest-NetworksTest-1338558981-project-admin] 10.222.0.60 "GET /compute/v2.1/os-networks" status: 200 len: 8809 microversion: 2.1 time: 0.314918 Oct 18 15:26:51.128268 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 328/648] 10.222.0.60 () {58 vars in 1137 bytes} [Tue Oct 18 15:26:50 2022] GET /compute/v2.1/os-networks => generated 8809 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:51.133873 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-93001a83-f2e2-42ee-b243-f9dfb4a70f3c tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] Action: 'create', calling method: .version_select at 0x7f7c3d6b7dc0>, body: {"security_group_rule": {"parent_group_id": "3ff6fe47-8dea-424b-8766-406555817bda", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:51.377902 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-93001a83-f2e2-42ee-b243-f9dfb4a70f3c tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.248023 Oct 18 15:26:51.378945 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 329/649] 10.222.0.60 () {60 vars in 1195 bytes} [Tue Oct 18 15:26:51 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:26:51.385021 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f7a1def9-f11b-4e48-8f30-b92c8ec87263 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:51.387372 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f7a1def9-f11b-4e48-8f30-b92c8ec87263 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: f07f6211-dd0e-4bdd-969c-fff2c3633dd0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:51.405902 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7a1def9-f11b-4e48-8f30-b92c8ec87263 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:51.407845 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7a1def9-f11b-4e48-8f30-b92c8ec87263 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:51.409077 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7a1def9-f11b-4e48-8f30-b92c8ec87263 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:51.410279 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7a1def9-f11b-4e48-8f30-b92c8ec87263 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:51.411210 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7a1def9-f11b-4e48-8f30-b92c8ec87263 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:51.411971 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7a1def9-f11b-4e48-8f30-b92c8ec87263 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:51.657628 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ba8c9cf8-d524-485b-95d5-f0e521783803 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4/action" status: 202 len: 0 microversion: 2.25 time: 5.384928 Oct 18 15:26:51.659532 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 321/650] 10.222.0.60 () {62 vars in 1319 bytes} [Tue Oct 18 15:26:46 2022] POST /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4/action => generated 0 bytes in 5388 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:26:51.670222 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bcd6235f-3158-444b-b893-b6bad2b403b7 tempest-NetworksTest-1338558981 tempest-NetworksTest-1338558981-project-admin] Calling method '.version_select at 0x7f7c3d8b0820>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:51.788033 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f7a1def9-f11b-4e48-8f30-b92c8ec87263 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:51.797325 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f7a1def9-f11b-4e48-8f30-b92c8ec87263 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/f07f6211-dd0e-4bdd-969c-fff2c3633dd0" status: 200 len: 1497 microversion: 2.1 time: 0.416538 Oct 18 15:26:51.801422 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 330/651] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:51 2022] GET /compute/v2.1/servers/f07f6211-dd0e-4bdd-969c-fff2c3633dd0 => generated 1497 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:51.807030 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0104a98a-a5c0-4d33-ade7-3579ebbf1c20 tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] Action: 'create', calling method: .version_select at 0x7f7c3d702310>, body: {"security_group_rule": {"parent_group_id": "3ff6fe47-8dea-424b-8766-406555817bda", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:52.048171 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-0104a98a-a5c0-4d33-ade7-3579ebbf1c20 tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] HTTP exception thrown: This rule already exists in group 3ff6fe47-8dea-424b-8766-406555817bda Oct 18 15:26:52.054807 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-bcd6235f-3158-444b-b893-b6bad2b403b7 tempest-NetworksTest-1338558981 tempest-NetworksTest-1338558981-project-admin] 10.222.0.60 "GET /compute/v2.1/os-networks/4e112f97-3f36-4641-bc49-22bf222d8b0f" status: 200 len: 652 microversion: 2.1 time: 0.392619 Oct 18 15:26:52.062127 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 322/652] 10.222.0.60 () {58 vars in 1248 bytes} [Tue Oct 18 15:26:51 2022] GET /compute/v2.1/os-networks/4e112f97-3f36-4641-bc49-22bf222d8b0f => generated 652 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:26:52.072968 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0104a98a-a5c0-4d33-ade7-3579ebbf1c20 tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] Request method failure captured: Oct 18 15:26:52.072968 n-d-853682-5 devstack@n-api.service[120406]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 18 15:26:52.072968 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:26:52.072968 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:26:52.072968 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:26:52.072968 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 138 Oct 18 15:26:52.072968 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:26:52.072968 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:26:52.072968 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:26:52.072968 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:26:52.072968 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsW51JPianN7i4cc2_i3EiWhcuI-pQbW-E4JZZn0WXzRezWrX9QkBWtVDpCpEZlo8aLMUKgcSy4TCCQZO44Wq4Js3-XNLdRjaEZvWendN8mxoAEhLKhd4n33K4Gf6wBCs84PKjf3AN9-jRuBywNEZNCScThGXrN3PfJyTUXaDqWrfr0 Oct 18 15:26:52.072968 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:26:52.072968 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:26:52.072968 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:26:52.072968 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:26:52.072968 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:26:52.072968 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:26:52.072968 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 6ea5301718fa42c59ac612c63eb34a64 Oct 18 15:26:52.072968 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-422412145 Oct 18 15:26:52.072968 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:26:52.072968 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:26:52.074989 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ea5301718fa42c59ac612c63eb34a64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ea5301718fa42c59ac612c63eb34a64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6ea5301718fa42c59ac612c63eb34a64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6ea5301718fa42c59ac612c63eb34a64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:26:52.074989 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-422412145 Oct 18 15:26:52.074989 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 6ea5301718fa42c59ac612c63eb34a64 Oct 18 15:26:52.074989 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-422412145 Oct 18 15:26:52.074989 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-422412145-project Oct 18 15:26:52.074989 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:26:52.074989 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:26:52.074989 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 8ff58e1a0860437aac930d2448e53278 Oct 18 15:26:52.074989 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-422412145-project Oct 18 15:26:52.074989 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:26:52.074989 n-d-853682-5 devstack@n-api.service[120406]: {"security_group_rule": {"parent_group_id": "3ff6fe47-8dea-424b-8766-406555817bda", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 18 15:26:52.074989 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:26:52.075786 n-d-853682-5 devstack@n-api.service[120406]: exception: This rule already exists in group 3ff6fe47-8dea-424b-8766-406555817bda Oct 18 15:26:52.075786 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'body': {'security_group_rule': {'parent_group_id': '3ff6fe47-8dea-424b-8766-406555817bda', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 18 15:26:52.075786 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:26:52.075786 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:26:52.075786 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 18 15:26:52.075786 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 18 15:26:52.075786 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 18 15:26:52.075786 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 18 15:26:52.075786 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 3ff6fe47-8dea-424b-8766-406555817bda Oct 18 15:26:52.075786 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:26:52.075786 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:26:52.075786 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:26:52.075786 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:26:52.075786 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:26:52.075786 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:26:52.075786 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:26:52.075786 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:26:52.075786 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:26:52.075786 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:26:52.075786 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:26:52.077097 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:26:52.077097 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 18 15:26:52.077097 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 18 15:26:52.077097 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 3ff6fe47-8dea-424b-8766-406555817bda Oct 18 15:26:52.077097 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:26:52.077097 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:26:52.077097 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:26:52.077097 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:26:52.077097 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:26:52.077097 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:26:52.077097 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:26:52.077097 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:26:52.077097 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 3ff6fe47-8dea-424b-8766-406555817bda Oct 18 15:26:52.077097 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:26:52.085040 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0104a98a-a5c0-4d33-ade7-3579ebbf1c20 tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] Returning 400 to user: This rule already exists in group 3ff6fe47-8dea-424b-8766-406555817bda {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:26:52.086555 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0104a98a-a5c0-4d33-ade7-3579ebbf1c20 tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.283294 Oct 18 15:26:52.088528 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b2238188-8925-40fb-9533-4ac98cce228c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:52.090068 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 331/653] 10.222.0.60 () {60 vars in 1195 bytes} [Tue Oct 18 15:26:51 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 288 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:26:52.091314 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b2238188-8925-40fb-9533-4ac98cce228c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 28a18615-ab69-4e8e-865c-b8e0b67a74f4] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:52.106857 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-83d90b89-b96f-4ef8-a251-353a774bff0b tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:52.114142 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-83d90b89-b96f-4ef8-a251-353a774bff0b tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] [instance: c3a3dd99-9387-4e73-a32d-e0c995b2b8b9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:52.116751 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b2238188-8925-40fb-9533-4ac98cce228c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:52.124704 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b2238188-8925-40fb-9533-4ac98cce228c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:52.127045 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b2238188-8925-40fb-9533-4ac98cce228c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:52.131057 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b2238188-8925-40fb-9533-4ac98cce228c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:52.132081 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b2238188-8925-40fb-9533-4ac98cce228c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:52.134164 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b2238188-8925-40fb-9533-4ac98cce228c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:52.141733 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83d90b89-b96f-4ef8-a251-353a774bff0b tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:52.143805 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83d90b89-b96f-4ef8-a251-353a774bff0b tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:52.146659 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83d90b89-b96f-4ef8-a251-353a774bff0b tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:52.147659 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83d90b89-b96f-4ef8-a251-353a774bff0b tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:52.149751 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83d90b89-b96f-4ef8-a251-353a774bff0b tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:52.151597 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83d90b89-b96f-4ef8-a251-353a774bff0b tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:52.473413 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=12 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:26:52.953412 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b2238188-8925-40fb-9533-4ac98cce228c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:52.978739 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-83d90b89-b96f-4ef8-a251-353a774bff0b tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7357f1c14a544016bba5abeee15f7a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c87221eb94488ba2e0fdd41386b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:52.989597 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-83d90b89-b96f-4ef8-a251-353a774bff0b tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] 10.222.0.60 "GET /compute/v2.1/servers/c3a3dd99-9387-4e73-a32d-e0c995b2b8b9" status: 200 len: 1322 microversion: 2.1 time: 0.896981 Oct 18 15:26:52.990411 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 332/654] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:52 2022] GET /compute/v2.1/servers/c3a3dd99-9387-4e73-a32d-e0c995b2b8b9 => generated 1322 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:52.992598 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b2238188-8925-40fb-9533-4ac98cce228c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:52.997650 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b2238188-8925-40fb-9533-4ac98cce228c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:52.999073 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b2238188-8925-40fb-9533-4ac98cce228c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4" status: 200 len: 1567 microversion: 2.25 time: 0.927400 Oct 18 15:26:53.002746 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 323/655] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:26:52 2022] GET /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4 => generated 1567 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:26:53.010454 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b2fd9d81-5fb8-4ac7-bc2f-a27a2cc584cf tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:53.011925 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b2fd9d81-5fb8-4ac7-bc2f-a27a2cc584cf tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:53.023235 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6e723c7d-61ab-41b1-9b82-dad6b7bded56 tempest-NetworksTest-1338558981 tempest-NetworksTest-1338558981-project-admin] Calling method '.version_select at 0x7f7c3d881a60>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:53.023683 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2fd9d81-5fb8-4ac7-bc2f-a27a2cc584cf tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:53.041329 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2fd9d81-5fb8-4ac7-bc2f-a27a2cc584cf tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:53.043510 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2fd9d81-5fb8-4ac7-bc2f-a27a2cc584cf tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:53.044660 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2fd9d81-5fb8-4ac7-bc2f-a27a2cc584cf tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:53.045370 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2fd9d81-5fb8-4ac7-bc2f-a27a2cc584cf tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:53.055297 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2fd9d81-5fb8-4ac7-bc2f-a27a2cc584cf tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:53.478202 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b2fd9d81-5fb8-4ac7-bc2f-a27a2cc584cf tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:53.489132 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b2fd9d81-5fb8-4ac7-bc2f-a27a2cc584cf tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2" status: 200 len: 1360 microversion: 2.1 time: 0.497460 Oct 18 15:26:53.504048 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 333/656] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:52 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2 => generated 1360 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:53.505906 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6e723c7d-61ab-41b1-9b82-dad6b7bded56 tempest-NetworksTest-1338558981 tempest-NetworksTest-1338558981-project-admin] 10.222.0.60 "GET /compute/v2.1/os-networks" status: 200 len: 8809 microversion: 2.1 time: 0.501836 Oct 18 15:26:53.510544 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 324/657] 10.222.0.60 () {58 vars in 1137 bytes} [Tue Oct 18 15:26:53 2022] GET /compute/v2.1/os-networks => generated 8809 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:53.520316 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bfae3a48-9e36-4ead-91df-20019093ff21 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:53.522665 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-bfae3a48-9e36-4ead-91df-20019093ff21 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: f07f6211-dd0e-4bdd-969c-fff2c3633dd0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:53.526192 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1ca48be7-df95-41cf-8a13-0d565e227ebf tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] Calling method '.version_select at 0x7f7c3d732f70>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:53.545906 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bfae3a48-9e36-4ead-91df-20019093ff21 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:53.549061 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bfae3a48-9e36-4ead-91df-20019093ff21 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:53.549895 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bfae3a48-9e36-4ead-91df-20019093ff21 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:53.554311 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bfae3a48-9e36-4ead-91df-20019093ff21 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:53.555059 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bfae3a48-9e36-4ead-91df-20019093ff21 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:53.555617 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bfae3a48-9e36-4ead-91df-20019093ff21 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:54.049794 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-bfae3a48-9e36-4ead-91df-20019093ff21 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:54.061405 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-bfae3a48-9e36-4ead-91df-20019093ff21 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/f07f6211-dd0e-4bdd-969c-fff2c3633dd0" status: 200 len: 1497 microversion: 2.1 time: 0.553376 Oct 18 15:26:54.061997 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 325/658] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:53 2022] GET /compute/v2.1/servers/f07f6211-dd0e-4bdd-969c-fff2c3633dd0 => generated 1497 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:54.072391 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-74dfe647-77ea-4eec-ab0c-862715c84211 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:54.077906 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-74dfe647-77ea-4eec-ab0c-862715c84211 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] [instance: c3a3dd99-9387-4e73-a32d-e0c995b2b8b9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:54.090924 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-74dfe647-77ea-4eec-ab0c-862715c84211 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:54.094726 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-74dfe647-77ea-4eec-ab0c-862715c84211 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:54.096313 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-74dfe647-77ea-4eec-ab0c-862715c84211 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:54.096313 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-74dfe647-77ea-4eec-ab0c-862715c84211 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:54.096662 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-74dfe647-77ea-4eec-ab0c-862715c84211 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:54.097131 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-74dfe647-77ea-4eec-ab0c-862715c84211 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:54.362521 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1ca48be7-df95-41cf-8a13-0d565e227ebf tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-group-rules/6f44cfd0-9da9-428b-822f-365120801de6" status: 202 len: 0 microversion: 2.1 time: 0.857068 Oct 18 15:26:54.363099 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 334/659] 10.222.0.60 () {58 vars in 1287 bytes} [Tue Oct 18 15:26:53 2022] DELETE /compute/v2.1/os-security-group-rules/6f44cfd0-9da9-428b-822f-365120801de6 => generated 0 bytes in 858 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:26:54.368861 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eded27ad-bf09-47bc-872b-a597c03da874 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:54.369787 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-eded27ad-bf09-47bc-872b-a597c03da874 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 28a18615-ab69-4e8e-865c-b8e0b67a74f4] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:54.384701 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eded27ad-bf09-47bc-872b-a597c03da874 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:54.385515 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eded27ad-bf09-47bc-872b-a597c03da874 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:54.389173 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eded27ad-bf09-47bc-872b-a597c03da874 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:54.390229 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eded27ad-bf09-47bc-872b-a597c03da874 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:54.394935 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eded27ad-bf09-47bc-872b-a597c03da874 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:54.395659 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eded27ad-bf09-47bc-872b-a597c03da874 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:54.593792 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-74dfe647-77ea-4eec-ab0c-862715c84211 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7357f1c14a544016bba5abeee15f7a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c87221eb94488ba2e0fdd41386b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:54.606304 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-74dfe647-77ea-4eec-ab0c-862715c84211 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] 10.222.0.60 "GET /compute/v2.1/servers/c3a3dd99-9387-4e73-a32d-e0c995b2b8b9" status: 200 len: 1322 microversion: 2.1 time: 0.539082 Oct 18 15:26:54.607891 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 326/660] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:54 2022] GET /compute/v2.1/servers/c3a3dd99-9387-4e73-a32d-e0c995b2b8b9 => generated 1322 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:54.617991 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-9851697a-7250-47f6-aeff-c39faa0398e1 req-ad7904e9-1d3b-4ae0-869a-fe41fc03bcdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0a3feae-1805-4c09-881b-99dd257bd9c2", "tag": "e6a47323-8aa2-4713-af2b-48bb88888044"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:54.636880 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-9851697a-7250-47f6-aeff-c39faa0398e1 req-ad7904e9-1d3b-4ae0-869a-fe41fc03bcdc service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:54.638045 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-9851697a-7250-47f6-aeff-c39faa0398e1 req-ad7904e9-1d3b-4ae0-869a-fe41fc03bcdc service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:54.638704 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-9851697a-7250-47f6-aeff-c39faa0398e1 req-ad7904e9-1d3b-4ae0-869a-fe41fc03bcdc service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:54.657142 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-9851697a-7250-47f6-aeff-c39faa0398e1 req-ad7904e9-1d3b-4ae0-869a-fe41fc03bcdc service nova] Creating event network-changed:e6a47323-8aa2-4713-af2b-48bb88888044 for instance a0a3feae-1805-4c09-881b-99dd257bd9c2 on n-h1-853682-5 Oct 18 15:26:54.663408 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-9851697a-7250-47f6-aeff-c39faa0398e1 req-ad7904e9-1d3b-4ae0-869a-fe41fc03bcdc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054075 Oct 18 15:26:54.664669 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 327/661] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:26:54.673039 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5827fa84-3fbc-4f33-983c-89a4bda56536 tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] Action: 'create', calling method: .version_select at 0x7f7c3d86ae50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1035292890", "description": "tempest-description-1775901047"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:54.764950 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-eded27ad-bf09-47bc-872b-a597c03da874 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:54.781078 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-eded27ad-bf09-47bc-872b-a597c03da874 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:54.783392 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-eded27ad-bf09-47bc-872b-a597c03da874 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:54.785102 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-eded27ad-bf09-47bc-872b-a597c03da874 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4" status: 200 len: 1567 microversion: 2.25 time: 0.420719 Oct 18 15:26:54.804099 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 335/662] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:26:54 2022] GET /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4 => generated 1567 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:26:54.827801 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b5be5e87-9a84-47d0-99b0-21aefbd9c133 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:54.828623 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b5be5e87-9a84-47d0-99b0-21aefbd9c133 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:54.845363 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5be5e87-9a84-47d0-99b0-21aefbd9c133 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:54.845942 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5be5e87-9a84-47d0-99b0-21aefbd9c133 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:54.846449 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5be5e87-9a84-47d0-99b0-21aefbd9c133 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:54.847440 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5be5e87-9a84-47d0-99b0-21aefbd9c133 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:54.848063 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5be5e87-9a84-47d0-99b0-21aefbd9c133 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:54.856289 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5be5e87-9a84-47d0-99b0-21aefbd9c133 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:54.862572 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:26:55.218529 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b5be5e87-9a84-47d0-99b0-21aefbd9c133 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:55.229293 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b5be5e87-9a84-47d0-99b0-21aefbd9c133 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2" status: 200 len: 1360 microversion: 2.1 time: 0.413220 Oct 18 15:26:55.232546 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 336/663] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:54 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2 => generated 1360 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:55.251136 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-0432d38f-cbcc-400f-a0dd-8a806e7ae07a req-c3b3c091-7501-4274-9d62-8feca2d8f255 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28a18615-ab69-4e8e-865c-b8e0b67a74f4", "name": "network-vif-unplugged", "status": "completed", "tag": "2477c9ea-1c78-4540-bd74-41bf83ab31bb"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:55.270030 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0432d38f-cbcc-400f-a0dd-8a806e7ae07a req-c3b3c091-7501-4274-9d62-8feca2d8f255 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:55.279210 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0432d38f-cbcc-400f-a0dd-8a806e7ae07a req-c3b3c091-7501-4274-9d62-8feca2d8f255 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:55.279879 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0432d38f-cbcc-400f-a0dd-8a806e7ae07a req-c3b3c091-7501-4274-9d62-8feca2d8f255 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:55.306632 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-0432d38f-cbcc-400f-a0dd-8a806e7ae07a req-c3b3c091-7501-4274-9d62-8feca2d8f255 service nova] Creating event network-vif-unplugged:2477c9ea-1c78-4540-bd74-41bf83ab31bb for instance 28a18615-ab69-4e8e-865c-b8e0b67a74f4 on n-h1-853682-5 Oct 18 15:26:55.315800 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-0432d38f-cbcc-400f-a0dd-8a806e7ae07a req-c3b3c091-7501-4274-9d62-8feca2d8f255 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082021 Oct 18 15:26:55.317398 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 337/664] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:26:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:26:55.323301 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-725d9dc6-8ab0-445b-bc88-483a60a6b01a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:55.324998 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-725d9dc6-8ab0-445b-bc88-483a60a6b01a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: f07f6211-dd0e-4bdd-969c-fff2c3633dd0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:55.332403 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-725d9dc6-8ab0-445b-bc88-483a60a6b01a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:55.333890 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-725d9dc6-8ab0-445b-bc88-483a60a6b01a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:55.334701 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-725d9dc6-8ab0-445b-bc88-483a60a6b01a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:55.335752 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-725d9dc6-8ab0-445b-bc88-483a60a6b01a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:55.336413 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-725d9dc6-8ab0-445b-bc88-483a60a6b01a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:55.337054 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-725d9dc6-8ab0-445b-bc88-483a60a6b01a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:55.569135 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5827fa84-3fbc-4f33-983c-89a4bda56536 tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.902908 Oct 18 15:26:55.581369 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 328/665] 10.222.0.60 () {60 vars in 1180 bytes} [Tue Oct 18 15:26:54 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:26:55.592658 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-62a6128e-5cc6-434e-b326-e5996cc4def2 tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] Action: 'create', calling method: .version_select at 0x7f7c3d77e040>, body: {"security_group_rule": {"parent_group_id": "7105e60a-9163-4789-a592-9b8499730e37", "ip_protocol": "tcp", "from_port": 1551418007, "to_port": 22}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:55.765209 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-725d9dc6-8ab0-445b-bc88-483a60a6b01a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:55.770799 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-62a6128e-5cc6-434e-b326-e5996cc4def2 tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] HTTP exception thrown: Invalid port range 1551418007:22. Former value cannot be greater than the later Oct 18 15:26:55.773980 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-62a6128e-5cc6-434e-b326-e5996cc4def2 tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] Request method failure captured: Oct 18 15:26:55.773980 n-d-853682-5 devstack@n-api.service[120405]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 18 15:26:55.773980 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:26:55.773980 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:26:55.773980 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:26:55.773980 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 146 Oct 18 15:26:55.773980 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:26:55.773980 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:26:55.773980 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:26:55.773980 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:26:55.773980 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsW51JPianN7i4cc2_i3EiWhcuI-pQbW-E4JZZn0WXzRezWrX9QkBWtVDpCpEZlo8aLMUKgcSy4TCCQZO44Wq4Js3-XNLdRjaEZvWendN8mxoAEhLKhd4n33K4Gf6wBCs84PKjf3AN9-jRuBywNEZNCScThGXrN3PfJyTUXaDqWrfr0 Oct 18 15:26:55.773980 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:26:55.773980 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:26:55.773980 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:26:55.773980 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:26:55.773980 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:26:55.773980 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:26:55.773980 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 6ea5301718fa42c59ac612c63eb34a64 Oct 18 15:26:55.773980 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-422412145 Oct 18 15:26:55.773980 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:26:55.773980 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:26:55.775294 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ea5301718fa42c59ac612c63eb34a64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ea5301718fa42c59ac612c63eb34a64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6ea5301718fa42c59ac612c63eb34a64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6ea5301718fa42c59ac612c63eb34a64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:26:55.775294 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-422412145 Oct 18 15:26:55.775294 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 6ea5301718fa42c59ac612c63eb34a64 Oct 18 15:26:55.775294 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-422412145 Oct 18 15:26:55.775294 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-422412145-project Oct 18 15:26:55.775294 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:26:55.775294 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:26:55.775294 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 8ff58e1a0860437aac930d2448e53278 Oct 18 15:26:55.775294 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-422412145-project Oct 18 15:26:55.775294 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:26:55.775294 n-d-853682-5 devstack@n-api.service[120405]: {"security_group_rule": {"parent_group_id": "7105e60a-9163-4789-a592-9b8499730e37", "ip_protocol": "tcp", "from_port": 1551418007, "to_port": 22}} Oct 18 15:26:55.775294 n-d-853682-5 devstack@n-api.service[120405]: method: Oct 18 15:26:55.777054 n-d-853682-5 devstack@n-api.service[120405]: exception: Invalid port range 1551418007:22. Former value cannot be greater than the later Oct 18 15:26:55.777054 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'body': {'security_group_rule': {'parent_group_id': '7105e60a-9163-4789-a592-9b8499730e37', 'ip_protocol': 'tcp', 'from_port': 1551418007, 'to_port': 22}}} Oct 18 15:26:55.777054 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:26:55.777054 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:26:55.777054 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 18 15:26:55.777054 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 18 15:26:55.777054 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 18 15:26:55.777054 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 18 15:26:55.777054 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 18 15:26:55.777054 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 18 15:26:55.777054 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 18 15:26:55.777054 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 18 15:26:55.777054 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1551418007:22. Former value cannot be greater than the later Oct 18 15:26:55.777054 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:26:55.777054 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:26:55.777054 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:26:55.777054 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:26:55.777054 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:26:55.777054 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:26:55.778470 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:26:55.778470 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:26:55.778470 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:26:55.778470 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:26:55.778470 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:26:55.778470 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:26:55.778470 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 18 15:26:55.778470 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 18 15:26:55.778470 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1551418007:22. Former value cannot be greater than the later Oct 18 15:26:55.778470 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:26:55.778470 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:26:55.778470 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:26:55.778470 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:26:55.778470 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:26:55.778470 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:26:55.778470 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:26:55.778470 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:26:55.778470 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1551418007:22. Former value cannot be greater than the later Oct 18 15:26:55.778470 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:26:55.779624 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-62a6128e-5cc6-434e-b326-e5996cc4def2 tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] Returning 400 to user: Invalid port range 1551418007:22. Former value cannot be greater than the later {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:26:55.779624 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-62a6128e-5cc6-434e-b326-e5996cc4def2 tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.192470 Oct 18 15:26:55.779624 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 329/666] 10.222.0.60 () {60 vars in 1195 bytes} [Tue Oct 18 15:26:55 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 194 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:26:55.801690 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-725d9dc6-8ab0-445b-bc88-483a60a6b01a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/f07f6211-dd0e-4bdd-969c-fff2c3633dd0" status: 200 len: 1497 microversion: 2.1 time: 0.482819 Oct 18 15:26:55.805361 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 338/667] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:55 2022] GET /compute/v2.1/servers/f07f6211-dd0e-4bdd-969c-fff2c3633dd0 => generated 1497 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:55.821959 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a8141d5f-88d8-4802-afa6-324e88346e21 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:55.821959 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a8141d5f-88d8-4802-afa6-324e88346e21 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] [instance: c3a3dd99-9387-4e73-a32d-e0c995b2b8b9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:55.825121 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6bd46954-4ee5-437c-aeeb-420856499acb tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] Action: 'create', calling method: .version_select at 0x7f7c3da04d30>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1221039401", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:55.831977 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-6bd46954-4ee5-437c-aeeb-420856499acb tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] HTTP exception thrown: Security group id should be uuid Oct 18 15:26:55.833637 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6bd46954-4ee5-437c-aeeb-420856499acb tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] Request method failure captured: Oct 18 15:26:55.833637 n-d-853682-5 devstack@n-api.service[120406]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 18 15:26:55.833637 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:26:55.833637 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:26:55.833637 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:26:55.833637 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 131 Oct 18 15:26:55.833637 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:26:55.833637 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:26:55.833637 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:26:55.833637 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:26:55.833637 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsW51JPianN7i4cc2_i3EiWhcuI-pQbW-E4JZZn0WXzRezWrX9QkBWtVDpCpEZlo8aLMUKgcSy4TCCQZO44Wq4Js3-XNLdRjaEZvWendN8mxoAEhLKhd4n33K4Gf6wBCs84PKjf3AN9-jRuBywNEZNCScThGXrN3PfJyTUXaDqWrfr0 Oct 18 15:26:55.833637 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:26:55.833637 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:26:55.833637 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:26:55.833637 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:26:55.833637 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:26:55.833637 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:26:55.833637 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 6ea5301718fa42c59ac612c63eb34a64 Oct 18 15:26:55.833637 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-422412145 Oct 18 15:26:55.833637 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:26:55.833637 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:26:55.834939 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ea5301718fa42c59ac612c63eb34a64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ea5301718fa42c59ac612c63eb34a64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6ea5301718fa42c59ac612c63eb34a64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6ea5301718fa42c59ac612c63eb34a64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:26:55.834939 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-422412145 Oct 18 15:26:55.834939 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 6ea5301718fa42c59ac612c63eb34a64 Oct 18 15:26:55.834939 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-422412145 Oct 18 15:26:55.834939 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-422412145-project Oct 18 15:26:55.834939 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:26:55.834939 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:26:55.834939 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 8ff58e1a0860437aac930d2448e53278 Oct 18 15:26:55.834939 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-422412145-project Oct 18 15:26:55.834939 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:26:55.834939 n-d-853682-5 devstack@n-api.service[120406]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1221039401", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 18 15:26:55.834939 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:26:55.834939 n-d-853682-5 devstack@n-api.service[120406]: exception: Security group id should be uuid Oct 18 15:26:55.835725 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1221039401', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 18 15:26:55.835725 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:26:55.835725 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:26:55.835725 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 18 15:26:55.835725 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 18 15:26:55.835725 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 18 15:26:55.835725 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 18 15:26:55.835725 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 18 15:26:55.835725 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:26:55.835725 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:26:55.835725 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:26:55.835725 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:26:55.835725 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:26:55.835725 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:26:55.835725 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:26:55.835725 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:26:55.835725 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:26:55.835725 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:26:55.835725 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:26:55.835725 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:26:55.837631 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 18 15:26:55.837631 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 18 15:26:55.837631 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 18 15:26:55.837631 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:26:55.837631 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:26:55.837631 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:26:55.837631 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:26:55.837631 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:26:55.837631 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:26:55.837631 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:26:55.837631 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:26:55.837631 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 18 15:26:55.837631 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:26:55.837631 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6bd46954-4ee5-437c-aeeb-420856499acb tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] Returning 400 to user: Security group id should be uuid {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:26:55.840234 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a8141d5f-88d8-4802-afa6-324e88346e21 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:55.840234 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a8141d5f-88d8-4802-afa6-324e88346e21 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:55.840234 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a8141d5f-88d8-4802-afa6-324e88346e21 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:55.840234 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a8141d5f-88d8-4802-afa6-324e88346e21 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:55.842116 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a8141d5f-88d8-4802-afa6-324e88346e21 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:55.842116 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a8141d5f-88d8-4802-afa6-324e88346e21 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:55.846302 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6bd46954-4ee5-437c-aeeb-420856499acb tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.039810 Oct 18 15:26:55.855969 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 339/668] 10.222.0.60 () {60 vars in 1195 bytes} [Tue Oct 18 15:26:55 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 18 15:26:55.870768 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e2956582-9f96-4182-9ef2-d70ae9072a99 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:55.871394 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e2956582-9f96-4182-9ef2-d70ae9072a99 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 28a18615-ab69-4e8e-865c-b8e0b67a74f4] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:55.887070 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2956582-9f96-4182-9ef2-d70ae9072a99 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:55.887790 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2956582-9f96-4182-9ef2-d70ae9072a99 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:55.888653 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2956582-9f96-4182-9ef2-d70ae9072a99 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:55.889530 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2956582-9f96-4182-9ef2-d70ae9072a99 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:55.890198 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2956582-9f96-4182-9ef2-d70ae9072a99 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:55.902981 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2956582-9f96-4182-9ef2-d70ae9072a99 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:56.209196 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e2956582-9f96-4182-9ef2-d70ae9072a99 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:56.219303 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e2956582-9f96-4182-9ef2-d70ae9072a99 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:56.221857 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e2956582-9f96-4182-9ef2-d70ae9072a99 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:56.223158 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e2956582-9f96-4182-9ef2-d70ae9072a99 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4" status: 200 len: 1567 microversion: 2.25 time: 0.365425 Oct 18 15:26:56.232941 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a8141d5f-88d8-4802-afa6-324e88346e21 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7357f1c14a544016bba5abeee15f7a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c87221eb94488ba2e0fdd41386b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:56.238439 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 340/669] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:26:55 2022] GET /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4 => generated 1567 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:26:56.247199 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a8141d5f-88d8-4802-afa6-324e88346e21 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] 10.222.0.60 "GET /compute/v2.1/servers/c3a3dd99-9387-4e73-a32d-e0c995b2b8b9" status: 200 len: 1322 microversion: 2.1 time: 0.457908 Oct 18 15:26:56.247365 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-385a7524-e61f-438c-9f73-784f0662a711 tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] Action: 'create', calling method: .version_select at 0x7f7c3d679d30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1836580657", "description": "tempest-description-1217988625"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:56.248155 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 330/670] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:55 2022] GET /compute/v2.1/servers/c3a3dd99-9387-4e73-a32d-e0c995b2b8b9 => generated 1322 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:56.497541 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-385a7524-e61f-438c-9f73-784f0662a711 tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.257909 Oct 18 15:26:56.499647 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 341/671] 10.222.0.60 () {60 vars in 1180 bytes} [Tue Oct 18 15:26:56 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:26:56.514284 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-35b4783b-6242-40ec-9839-400a62cede56 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:56.515323 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-35b4783b-6242-40ec-9839-400a62cede56 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:56.530892 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-35b4783b-6242-40ec-9839-400a62cede56 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:56.531492 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-35b4783b-6242-40ec-9839-400a62cede56 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:56.531934 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-35b4783b-6242-40ec-9839-400a62cede56 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:56.532645 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-35b4783b-6242-40ec-9839-400a62cede56 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:56.533136 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-35b4783b-6242-40ec-9839-400a62cede56 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:56.533563 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-35b4783b-6242-40ec-9839-400a62cede56 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:56.700101 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f5547bd8-5c40-45ee-a887-c4db97dce7b7 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Action: 'create', calling method: .version_select at 0x7f7c3d77e4c0>, body: {"keypair": {"name": "tempest-keypair-934683465", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA5X4lus2woxm5zTnSuDcuiXhMG6YHrMa/nLuU1c6moJCKOUffYE8N+irYZcDIiZPA9e9/GiYSxhlSaxuUdwo8KSnjoppMNTiv+FyDYhUEz1y0Hb+GV15guySj+w9S2Avw=="}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:56.721227 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-f5547bd8-5c40-45ee-a887-c4db97dce7b7 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Getting quotas for project ac07f1b2c83a4faab175a5b9ed8e315e. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:26:56.727713 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-f5547bd8-5c40-45ee-a887-c4db97dce7b7 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Getting quotas for user a1023300147f463e8f0894981948f825 and project ac07f1b2c83a4faab175a5b9ed8e315e. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:26:56.751454 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-35b4783b-6242-40ec-9839-400a62cede56 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:56.759264 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-35b4783b-6242-40ec-9839-400a62cede56 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2" status: 200 len: 1360 microversion: 2.1 time: 0.258016 Oct 18 15:26:56.760363 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 342/672] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:56 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2 => generated 1360 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:56.762695 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f5547bd8-5c40-45ee-a887-c4db97dce7b7 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.513210 Oct 18 15:26:56.763737 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 331/673] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Oct 18 15:26:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:26:56.766156 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-d459cba9-0970-4904-8707-8df49f6cdc29 req-f37e536a-916a-480e-a061-0ad83190808e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3a3dd99-9387-4e73-a32d-e0c995b2b8b9", "name": "network-vif-plugged", "status": "completed", "tag": "fdd8b15f-c862-43e2-b67b-3e615e36105f"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:56.776864 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-344cca9a-e90a-4db2-9a5e-9f761c9659df tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] Action: 'create', calling method: .version_select at 0x7f7c3db574c0>, body: {"security_group_rule": {"parent_group_id": "6bfa237c-a186-4cd7-87a7-8c353577d186", "ip_protocol": "tempest-999-2103700107", "from_port": 22, "to_port": 22}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:56.777305 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d459cba9-0970-4904-8707-8df49f6cdc29 req-f37e536a-916a-480e-a061-0ad83190808e service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:56.777938 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d459cba9-0970-4904-8707-8df49f6cdc29 req-f37e536a-916a-480e-a061-0ad83190808e service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:56.778619 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d459cba9-0970-4904-8707-8df49f6cdc29 req-f37e536a-916a-480e-a061-0ad83190808e service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:56.795546 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-d459cba9-0970-4904-8707-8df49f6cdc29 req-f37e536a-916a-480e-a061-0ad83190808e service nova] Creating event network-vif-plugged:fdd8b15f-c862-43e2-b67b-3e615e36105f for instance c3a3dd99-9387-4e73-a32d-e0c995b2b8b9 on n-h2-853682-5 Oct 18 15:26:56.801312 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-d459cba9-0970-4904-8707-8df49f6cdc29 req-f37e536a-916a-480e-a061-0ad83190808e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038732 Oct 18 15:26:56.803103 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 343/674] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:26:56.837061 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ba71c738-4a71-400e-97c5-afd47cdc659d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:56.838030 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ba71c738-4a71-400e-97c5-afd47cdc659d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: f07f6211-dd0e-4bdd-969c-fff2c3633dd0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:56.845344 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba71c738-4a71-400e-97c5-afd47cdc659d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:56.846077 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba71c738-4a71-400e-97c5-afd47cdc659d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:56.846696 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba71c738-4a71-400e-97c5-afd47cdc659d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:56.847565 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba71c738-4a71-400e-97c5-afd47cdc659d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:56.848170 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba71c738-4a71-400e-97c5-afd47cdc659d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:56.848839 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba71c738-4a71-400e-97c5-afd47cdc659d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:56.981438 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-344cca9a-e90a-4db2-9a5e-9f761c9659df tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] HTTP exception thrown: Invalid IP protocol tempest-999-2103700107. Oct 18 15:26:56.983060 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-344cca9a-e90a-4db2-9a5e-9f761c9659df tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] Request method failure captured: Oct 18 15:26:56.983060 n-d-853682-5 devstack@n-api.service[120405]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 18 15:26:56.983060 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:26:56.983060 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:26:56.983060 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:26:56.983060 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 157 Oct 18 15:26:56.983060 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:26:56.983060 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:26:56.983060 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:26:56.983060 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:26:56.983060 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsW51JPianN7i4cc2_i3EiWhcuI-pQbW-E4JZZn0WXzRezWrX9QkBWtVDpCpEZlo8aLMUKgcSy4TCCQZO44Wq4Js3-XNLdRjaEZvWendN8mxoAEhLKhd4n33K4Gf6wBCs84PKjf3AN9-jRuBywNEZNCScThGXrN3PfJyTUXaDqWrfr0 Oct 18 15:26:56.983060 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:26:56.983060 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:26:56.983060 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:26:56.983060 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:26:56.983060 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:26:56.983060 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:26:56.983060 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 6ea5301718fa42c59ac612c63eb34a64 Oct 18 15:26:56.983060 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-422412145 Oct 18 15:26:56.983060 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:26:56.983060 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:26:56.984319 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ea5301718fa42c59ac612c63eb34a64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ea5301718fa42c59ac612c63eb34a64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6ea5301718fa42c59ac612c63eb34a64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6ea5301718fa42c59ac612c63eb34a64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:26:56.984319 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-422412145 Oct 18 15:26:56.984319 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 6ea5301718fa42c59ac612c63eb34a64 Oct 18 15:26:56.984319 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-422412145 Oct 18 15:26:56.984319 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-422412145-project Oct 18 15:26:56.984319 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:26:56.984319 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:26:56.984319 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 8ff58e1a0860437aac930d2448e53278 Oct 18 15:26:56.984319 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-422412145-project Oct 18 15:26:56.984319 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:26:56.984319 n-d-853682-5 devstack@n-api.service[120405]: {"security_group_rule": {"parent_group_id": "6bfa237c-a186-4cd7-87a7-8c353577d186", "ip_protocol": "tempest-999-2103700107", "from_port": 22, "to_port": 22}} Oct 18 15:26:56.984319 n-d-853682-5 devstack@n-api.service[120405]: method: Oct 18 15:26:56.985052 n-d-853682-5 devstack@n-api.service[120405]: exception: Invalid IP protocol tempest-999-2103700107. Oct 18 15:26:56.985052 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'body': {'security_group_rule': {'parent_group_id': '6bfa237c-a186-4cd7-87a7-8c353577d186', 'ip_protocol': 'tempest-999-2103700107', 'from_port': 22, 'to_port': 22}}} Oct 18 15:26:56.985052 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:26:56.985052 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:26:56.985052 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 18 15:26:56.985052 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 18 15:26:56.985052 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 18 15:26:56.985052 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 18 15:26:56.985052 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 18 15:26:56.985052 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 18 15:26:56.985052 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 18 15:26:56.985052 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 18 15:26:56.985052 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-2103700107. Oct 18 15:26:56.985052 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:26:56.985052 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:26:56.985052 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:26:56.985052 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:26:56.985052 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:26:56.985052 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:26:56.986221 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:26:56.986221 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:26:56.986221 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:26:56.986221 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:26:56.986221 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:26:56.986221 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:26:56.986221 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 18 15:26:56.986221 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 18 15:26:56.986221 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-2103700107. Oct 18 15:26:56.986221 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:26:56.986221 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:26:56.986221 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:26:56.986221 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:26:56.986221 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:26:56.986221 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:26:56.986221 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:26:56.986221 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:26:56.986221 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-2103700107. Oct 18 15:26:56.986221 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:26:56.987298 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-344cca9a-e90a-4db2-9a5e-9f761c9659df tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] Returning 400 to user: Invalid IP protocol tempest-999-2103700107. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:26:56.987298 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-344cca9a-e90a-4db2-9a5e-9f761c9659df tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.219788 Oct 18 15:26:56.987298 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 332/675] 10.222.0.60 () {60 vars in 1195 bytes} [Tue Oct 18 15:26:56 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 221 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 18 15:26:56.995152 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-946c3b1e-ddf5-42d3-ae99-7637d657c7b5 tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] Action: 'create', calling method: .version_select at 0x7f7c3d86af70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1703392666", "description": "tempest-description-365052964"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:57.186353 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:26:57.200044 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ba71c738-4a71-400e-97c5-afd47cdc659d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:57.212846 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ba71c738-4a71-400e-97c5-afd47cdc659d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/f07f6211-dd0e-4bdd-969c-fff2c3633dd0" status: 200 len: 1497 microversion: 2.1 time: 0.380488 Oct 18 15:26:57.213847 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 344/676] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:56 2022] GET /compute/v2.1/servers/f07f6211-dd0e-4bdd-969c-fff2c3633dd0 => generated 1497 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:57.252834 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4bef7cf2-6d59-4b06-9139-4dbb7a193643 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:57.253441 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4bef7cf2-6d59-4b06-9139-4dbb7a193643 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 28a18615-ab69-4e8e-865c-b8e0b67a74f4] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:57.256499 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=12 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:26:57.262441 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4bef7cf2-6d59-4b06-9139-4dbb7a193643 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:57.262962 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4bef7cf2-6d59-4b06-9139-4dbb7a193643 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:57.263435 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4bef7cf2-6d59-4b06-9139-4dbb7a193643 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:57.264320 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4bef7cf2-6d59-4b06-9139-4dbb7a193643 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:57.264939 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4bef7cf2-6d59-4b06-9139-4dbb7a193643 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:57.265401 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4bef7cf2-6d59-4b06-9139-4dbb7a193643 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:57.390166 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-946c3b1e-ddf5-42d3-ae99-7637d657c7b5 tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.399641 Oct 18 15:26:57.391074 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 333/677] 10.222.0.60 () {60 vars in 1180 bytes} [Tue Oct 18 15:26:56 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:26:57.403099 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-18dc7f42-6a9e-46ae-a028-3c88f0cb7eef tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:57.404265 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-18dc7f42-6a9e-46ae-a028-3c88f0cb7eef tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] [instance: c3a3dd99-9387-4e73-a32d-e0c995b2b8b9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:57.413908 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-18dc7f42-6a9e-46ae-a028-3c88f0cb7eef tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:57.414568 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-18dc7f42-6a9e-46ae-a028-3c88f0cb7eef tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:57.416363 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-18dc7f42-6a9e-46ae-a028-3c88f0cb7eef tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:57.417715 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-18dc7f42-6a9e-46ae-a028-3c88f0cb7eef tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:57.422835 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-18dc7f42-6a9e-46ae-a028-3c88f0cb7eef tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:57.423529 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-18dc7f42-6a9e-46ae-a028-3c88f0cb7eef tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:57.549080 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4bef7cf2-6d59-4b06-9139-4dbb7a193643 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:57.560218 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4bef7cf2-6d59-4b06-9139-4dbb7a193643 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:57.561459 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4bef7cf2-6d59-4b06-9139-4dbb7a193643 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:57.563268 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4bef7cf2-6d59-4b06-9139-4dbb7a193643 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4" status: 200 len: 1567 microversion: 2.25 time: 0.314149 Oct 18 15:26:57.575305 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 345/678] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:26:57 2022] GET /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4 => generated 1567 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:26:57.591660 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-3d80064a-2a50-4e4c-a3b1-8ccbb68fe15b req-f5ac8519-cad2-4eff-b6c0-490bdaa92152 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28a18615-ab69-4e8e-865c-b8e0b67a74f4", "tag": "2477c9ea-1c78-4540-bd74-41bf83ab31bb"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:57.602827 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3d80064a-2a50-4e4c-a3b1-8ccbb68fe15b req-f5ac8519-cad2-4eff-b6c0-490bdaa92152 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:57.603412 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3d80064a-2a50-4e4c-a3b1-8ccbb68fe15b req-f5ac8519-cad2-4eff-b6c0-490bdaa92152 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:57.603924 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3d80064a-2a50-4e4c-a3b1-8ccbb68fe15b req-f5ac8519-cad2-4eff-b6c0-490bdaa92152 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:57.618236 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-3d80064a-2a50-4e4c-a3b1-8ccbb68fe15b req-f5ac8519-cad2-4eff-b6c0-490bdaa92152 service nova] Creating event network-changed:2477c9ea-1c78-4540-bd74-41bf83ab31bb for instance 28a18615-ab69-4e8e-865c-b8e0b67a74f4 on n-h1-853682-5 Oct 18 15:26:57.625496 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-3d80064a-2a50-4e4c-a3b1-8ccbb68fe15b req-f5ac8519-cad2-4eff-b6c0-490bdaa92152 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040925 Oct 18 15:26:57.640354 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 346/679] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:26:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:26:57.652672 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a8b4d109-8552-469e-975b-33fc5033577d tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] Action: 'create', calling method: .version_select at 0x7f7c3d6b75e0>, body: {"security_group_rule": {"parent_group_id": "c66bfddc-fb62-4351-aec7-8b9088f579a9", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:57.873138 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-18dc7f42-6a9e-46ae-a028-3c88f0cb7eef tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7357f1c14a544016bba5abeee15f7a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c87221eb94488ba2e0fdd41386b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:57.883807 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-18dc7f42-6a9e-46ae-a028-3c88f0cb7eef tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] 10.222.0.60 "GET /compute/v2.1/servers/c3a3dd99-9387-4e73-a32d-e0c995b2b8b9" status: 200 len: 1322 microversion: 2.1 time: 0.491535 Oct 18 15:26:57.890284 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 334/680] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:57 2022] GET /compute/v2.1/servers/c3a3dd99-9387-4e73-a32d-e0c995b2b8b9 => generated 1322 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:57.911244 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ab4904ce-43a8-4dce-9c76-dfd1e7be7dea tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:57.912284 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ab4904ce-43a8-4dce-9c76-dfd1e7be7dea tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:57.913870 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-a8b4d109-8552-469e-975b-33fc5033577d tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 18 15:26:57.917907 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a8b4d109-8552-469e-975b-33fc5033577d tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] Request method failure captured: Oct 18 15:26:57.917907 n-d-853682-5 devstack@n-api.service[120406]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 18 15:26:57.917907 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:26:57.917907 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:26:57.917907 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:26:57.917907 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 138 Oct 18 15:26:57.917907 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:26:57.917907 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:26:57.917907 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:26:57.917907 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:26:57.917907 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsW51JPianN7i4cc2_i3EiWhcuI-pQbW-E4JZZn0WXzRezWrX9QkBWtVDpCpEZlo8aLMUKgcSy4TCCQZO44Wq4Js3-XNLdRjaEZvWendN8mxoAEhLKhd4n33K4Gf6wBCs84PKjf3AN9-jRuBywNEZNCScThGXrN3PfJyTUXaDqWrfr0 Oct 18 15:26:57.917907 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:26:57.917907 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:26:57.917907 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:26:57.917907 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:26:57.917907 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:26:57.917907 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:26:57.917907 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 6ea5301718fa42c59ac612c63eb34a64 Oct 18 15:26:57.917907 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-422412145 Oct 18 15:26:57.917907 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:26:57.917907 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:26:57.919197 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ea5301718fa42c59ac612c63eb34a64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ea5301718fa42c59ac612c63eb34a64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6ea5301718fa42c59ac612c63eb34a64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6ea5301718fa42c59ac612c63eb34a64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:26:57.919197 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-422412145 Oct 18 15:26:57.919197 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 6ea5301718fa42c59ac612c63eb34a64 Oct 18 15:26:57.919197 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-422412145 Oct 18 15:26:57.919197 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-422412145-project Oct 18 15:26:57.919197 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:26:57.919197 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:26:57.919197 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 8ff58e1a0860437aac930d2448e53278 Oct 18 15:26:57.919197 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-422412145-project Oct 18 15:26:57.919197 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:26:57.919197 n-d-853682-5 devstack@n-api.service[120406]: {"security_group_rule": {"parent_group_id": "c66bfddc-fb62-4351-aec7-8b9088f579a9", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 18 15:26:57.919197 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:26:57.919902 n-d-853682-5 devstack@n-api.service[120406]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 18 15:26:57.919902 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'c66bfddc-fb62-4351-aec7-8b9088f579a9', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 18 15:26:57.919902 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:26:57.919902 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:26:57.919902 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 18 15:26:57.919902 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 18 15:26:57.919902 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 18 15:26:57.919902 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 18 15:26:57.919902 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 18 15:26:57.919902 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 18 15:26:57.919902 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 18 15:26:57.919902 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 18 15:26:57.919902 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 18 15:26:57.919902 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:26:57.919902 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:26:57.919902 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:26:57.919902 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:26:57.919902 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:26:57.919902 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:26:57.921026 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:26:57.921026 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:26:57.921026 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:26:57.921026 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:26:57.921026 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:26:57.921026 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:26:57.921026 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 18 15:26:57.921026 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 18 15:26:57.921026 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 18 15:26:57.921026 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:26:57.921026 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:26:57.921026 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:26:57.921026 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:26:57.921026 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:26:57.921026 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:26:57.921026 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:26:57.921026 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:26:57.921026 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 18 15:26:57.921026 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:26:57.922148 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ab4904ce-43a8-4dce-9c76-dfd1e7be7dea tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:57.922148 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ab4904ce-43a8-4dce-9c76-dfd1e7be7dea tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:57.922148 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ab4904ce-43a8-4dce-9c76-dfd1e7be7dea tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:57.922148 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ab4904ce-43a8-4dce-9c76-dfd1e7be7dea tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:57.922436 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a8b4d109-8552-469e-975b-33fc5033577d tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:26:57.922436 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a8b4d109-8552-469e-975b-33fc5033577d tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.278112 Oct 18 15:26:57.923445 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 347/681] 10.222.0.60 () {60 vars in 1195 bytes} [Tue Oct 18 15:26:57 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 282 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:26:57.931457 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ab4904ce-43a8-4dce-9c76-dfd1e7be7dea tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:57.936453 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ee452947-8956-4d56-9d65-9d6dd780d17d tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] Action: 'create', calling method: .version_select at 0x7f7c3d679790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-800117230", "description": "tempest-description-1530401904"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:57.936890 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ab4904ce-43a8-4dce-9c76-dfd1e7be7dea tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:58.388618 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ab4904ce-43a8-4dce-9c76-dfd1e7be7dea tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:58.397901 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ab4904ce-43a8-4dce-9c76-dfd1e7be7dea tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2" status: 200 len: 1360 microversion: 2.1 time: 0.504766 Oct 18 15:26:58.401500 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 335/682] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:57 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2 => generated 1360 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:58.418351 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-eb7e0e41-b033-46ef-ae86-05bd2e9f4068 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:58.419039 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-eb7e0e41-b033-46ef-ae86-05bd2e9f4068 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: f07f6211-dd0e-4bdd-969c-fff2c3633dd0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:58.426211 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eb7e0e41-b033-46ef-ae86-05bd2e9f4068 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:58.428281 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eb7e0e41-b033-46ef-ae86-05bd2e9f4068 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:58.428281 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eb7e0e41-b033-46ef-ae86-05bd2e9f4068 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:58.433646 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eb7e0e41-b033-46ef-ae86-05bd2e9f4068 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:58.434384 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eb7e0e41-b033-46ef-ae86-05bd2e9f4068 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:58.435016 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eb7e0e41-b033-46ef-ae86-05bd2e9f4068 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:58.665406 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ee452947-8956-4d56-9d65-9d6dd780d17d tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.735906 Oct 18 15:26:58.668311 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 348/683] 10.222.0.60 () {60 vars in 1180 bytes} [Tue Oct 18 15:26:57 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:26:58.676339 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e3b51f0e-2665-4cd1-b964-0177305adf24 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:58.677657 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e3b51f0e-2665-4cd1-b964-0177305adf24 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 28a18615-ab69-4e8e-865c-b8e0b67a74f4] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:58.688070 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3b51f0e-2665-4cd1-b964-0177305adf24 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:58.689277 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3b51f0e-2665-4cd1-b964-0177305adf24 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:58.689959 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3b51f0e-2665-4cd1-b964-0177305adf24 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:58.691173 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3b51f0e-2665-4cd1-b964-0177305adf24 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:58.691879 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3b51f0e-2665-4cd1-b964-0177305adf24 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:58.694049 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3b51f0e-2665-4cd1-b964-0177305adf24 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:59.228670 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-eb7e0e41-b033-46ef-ae86-05bd2e9f4068 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:59.238282 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-eb7e0e41-b033-46ef-ae86-05bd2e9f4068 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/f07f6211-dd0e-4bdd-969c-fff2c3633dd0" status: 200 len: 1497 microversion: 2.1 time: 0.835562 Oct 18 15:26:59.239035 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 336/684] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:58 2022] GET /compute/v2.1/servers/f07f6211-dd0e-4bdd-969c-fff2c3633dd0 => generated 1497 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:59.244351 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-009c1339-d250-463a-9010-2d506b785154 tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] Action: 'create', calling method: .version_select at 0x7f7c3d848c10>, body: {"security_group_rule": {"parent_group_id": "fe70159c-cfce-4fac-b6f7-ae21f943e7d7", "ip_protocol": "tcp", "from_port": 22, "to_port": 1987620562}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:59.382593 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e3b51f0e-2665-4cd1-b964-0177305adf24 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:59.391379 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e3b51f0e-2665-4cd1-b964-0177305adf24 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:59.392848 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e3b51f0e-2665-4cd1-b964-0177305adf24 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:59.394044 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e3b51f0e-2665-4cd1-b964-0177305adf24 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4" status: 200 len: 1567 microversion: 2.25 time: 0.724211 Oct 18 15:26:59.394604 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 349/685] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:26:58 2022] GET /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4 => generated 1567 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:26:59.399399 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cf2dd0d9-aa10-4089-8650-5eca99e19af8 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:59.400003 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cf2dd0d9-aa10-4089-8650-5eca99e19af8 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] [instance: c3a3dd99-9387-4e73-a32d-e0c995b2b8b9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:59.406904 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf2dd0d9-aa10-4089-8650-5eca99e19af8 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:59.407580 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf2dd0d9-aa10-4089-8650-5eca99e19af8 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:59.408165 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf2dd0d9-aa10-4089-8650-5eca99e19af8 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:59.409040 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf2dd0d9-aa10-4089-8650-5eca99e19af8 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:59.409631 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf2dd0d9-aa10-4089-8650-5eca99e19af8 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:59.410228 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf2dd0d9-aa10-4089-8650-5eca99e19af8 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:59.419595 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-009c1339-d250-463a-9010-2d506b785154 tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] HTTP exception thrown: Invalid port range 22:1987620562. Valid TCP ports should be between 1-65535 Oct 18 15:26:59.421602 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-009c1339-d250-463a-9010-2d506b785154 tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] Request method failure captured: Oct 18 15:26:59.421602 n-d-853682-5 devstack@n-api.service[120405]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 18 15:26:59.421602 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:26:59.421602 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:26:59.421602 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:26:59.421602 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 146 Oct 18 15:26:59.421602 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:26:59.421602 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:26:59.421602 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:26:59.421602 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:26:59.421602 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsW51JPianN7i4cc2_i3EiWhcuI-pQbW-E4JZZn0WXzRezWrX9QkBWtVDpCpEZlo8aLMUKgcSy4TCCQZO44Wq4Js3-XNLdRjaEZvWendN8mxoAEhLKhd4n33K4Gf6wBCs84PKjf3AN9-jRuBywNEZNCScThGXrN3PfJyTUXaDqWrfr0 Oct 18 15:26:59.421602 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:26:59.421602 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:26:59.421602 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:26:59.421602 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:26:59.421602 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:26:59.421602 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:26:59.421602 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 6ea5301718fa42c59ac612c63eb34a64 Oct 18 15:26:59.421602 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-422412145 Oct 18 15:26:59.421602 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:26:59.421602 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:26:59.422996 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ea5301718fa42c59ac612c63eb34a64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ea5301718fa42c59ac612c63eb34a64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6ea5301718fa42c59ac612c63eb34a64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6ea5301718fa42c59ac612c63eb34a64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:26:59.422996 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-422412145 Oct 18 15:26:59.422996 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 6ea5301718fa42c59ac612c63eb34a64 Oct 18 15:26:59.422996 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-422412145 Oct 18 15:26:59.422996 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-422412145-project Oct 18 15:26:59.422996 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:26:59.422996 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:26:59.422996 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 8ff58e1a0860437aac930d2448e53278 Oct 18 15:26:59.422996 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-422412145-project Oct 18 15:26:59.422996 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:26:59.422996 n-d-853682-5 devstack@n-api.service[120405]: {"security_group_rule": {"parent_group_id": "fe70159c-cfce-4fac-b6f7-ae21f943e7d7", "ip_protocol": "tcp", "from_port": 22, "to_port": 1987620562}} Oct 18 15:26:59.422996 n-d-853682-5 devstack@n-api.service[120405]: method: Oct 18 15:26:59.423872 n-d-853682-5 devstack@n-api.service[120405]: exception: Invalid port range 22:1987620562. Valid TCP ports should be between 1-65535 Oct 18 15:26:59.423872 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'fe70159c-cfce-4fac-b6f7-ae21f943e7d7', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1987620562}}} Oct 18 15:26:59.423872 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:26:59.423872 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:26:59.423872 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 18 15:26:59.423872 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 18 15:26:59.423872 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 18 15:26:59.423872 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 18 15:26:59.423872 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 18 15:26:59.423872 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 18 15:26:59.423872 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 18 15:26:59.423872 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 18 15:26:59.423872 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1987620562. Valid TCP ports should be between 1-65535 Oct 18 15:26:59.423872 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:26:59.423872 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:26:59.423872 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:26:59.423872 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:26:59.423872 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:26:59.423872 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:26:59.425274 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:26:59.425274 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:26:59.425274 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:26:59.425274 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:26:59.425274 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:26:59.425274 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:26:59.425274 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 18 15:26:59.425274 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 18 15:26:59.425274 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1987620562. Valid TCP ports should be between 1-65535 Oct 18 15:26:59.425274 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:26:59.425274 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:26:59.425274 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:26:59.425274 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:26:59.425274 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:26:59.425274 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:26:59.425274 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:26:59.425274 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:26:59.425274 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1987620562. Valid TCP ports should be between 1-65535 Oct 18 15:26:59.425274 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:26:59.426869 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-009c1339-d250-463a-9010-2d506b785154 tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] Returning 400 to user: Invalid port range 22:1987620562. Valid TCP ports should be between 1-65535 {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:26:59.428353 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-009c1339-d250-463a-9010-2d506b785154 tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.187901 Oct 18 15:26:59.430374 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 337/686] 10.222.0.60 () {60 vars in 1195 bytes} [Tue Oct 18 15:26:59 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 190 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:26:59.578203 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ede26b2b-8373-4461-9f2e-3c63393e9737 tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] Calling method '.version_select at 0x7f7c3d8683a0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:59.660672 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ede26b2b-8373-4461-9f2e-3c63393e9737 tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/a3b35cb0402546f8a9b6126c738db922" status: 200 len: 371 microversion: 2.1 time: 0.228320 Oct 18 15:26:59.662083 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 338/687] 10.222.0.60 () {58 vars in 1242 bytes} [Tue Oct 18 15:26:59 2022] GET /compute/v2.1/os-quota-sets/a3b35cb0402546f8a9b6126c738db922 => generated 371 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:26:59.674651 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-54a4063a-61ea-4db7-a2b3-64ed1921dcdd tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:26:59.675571 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-54a4063a-61ea-4db7-a2b3-64ed1921dcdd tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:26:59.682234 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-54a4063a-61ea-4db7-a2b3-64ed1921dcdd tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:59.683492 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-54a4063a-61ea-4db7-a2b3-64ed1921dcdd tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:59.684070 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-54a4063a-61ea-4db7-a2b3-64ed1921dcdd tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:59.684957 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-54a4063a-61ea-4db7-a2b3-64ed1921dcdd tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:26:59.685656 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-54a4063a-61ea-4db7-a2b3-64ed1921dcdd tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:26:59.686647 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-54a4063a-61ea-4db7-a2b3-64ed1921dcdd tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:26:59.702712 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cf2dd0d9-aa10-4089-8650-5eca99e19af8 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7357f1c14a544016bba5abeee15f7a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c87221eb94488ba2e0fdd41386b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:59.712039 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cf2dd0d9-aa10-4089-8650-5eca99e19af8 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] 10.222.0.60 "GET /compute/v2.1/servers/c3a3dd99-9387-4e73-a32d-e0c995b2b8b9" status: 200 len: 1471 microversion: 2.1 time: 0.316120 Oct 18 15:26:59.712631 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 350/688] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:59 2022] GET /compute/v2.1/servers/c3a3dd99-9387-4e73-a32d-e0c995b2b8b9 => generated 1471 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:26:59.738909 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-afb17992-2f3c-406b-b3fa-45a6ddf897a6 tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] Action: 'create', calling method: .version_select at 0x7f7c3d679e50>, body: {"security_group_rule": {"parent_group_id": "be2d419c-3f5a-454e-a2c6-ed231ef42523", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:59.825568 n-d-853682-5 devstack@n-api.service[120406]: DEBUG neutronclient.v2_0.client [None req-afb17992-2f3c-406b-b3fa-45a6ddf897a6 tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group be2d419c-3f5a-454e-a2c6-ed231ef42523 does not exist", "detail": ""}} {{(pid=120406) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 15:26:59.827601 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.security_group_api [None req-afb17992-2f3c-406b-b3fa-45a6ddf897a6 tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] Neutron security group be2d419c-3f5a-454e-a2c6-ed231ef42523 not found {{(pid=120406) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 18 15:26:59.828532 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-afb17992-2f3c-406b-b3fa-45a6ddf897a6 tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] HTTP exception thrown: Security group be2d419c-3f5a-454e-a2c6-ed231ef42523 does not exist Oct 18 15:26:59.828532 n-d-853682-5 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-700ed15c-b3b2-4ff6-9581-2cead7931441'] Oct 18 15:26:59.836006 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-afb17992-2f3c-406b-b3fa-45a6ddf897a6 tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] Request method failure captured: Oct 18 15:26:59.836006 n-d-853682-5 devstack@n-api.service[120406]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 18 15:26:59.836006 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:26:59.836006 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:26:59.836006 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:26:59.836006 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 138 Oct 18 15:26:59.836006 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:26:59.836006 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:26:59.836006 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:26:59.836006 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:26:59.836006 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsW51JPianN7i4cc2_i3EiWhcuI-pQbW-E4JZZn0WXzRezWrX9QkBWtVDpCpEZlo8aLMUKgcSy4TCCQZO44Wq4Js3-XNLdRjaEZvWendN8mxoAEhLKhd4n33K4Gf6wBCs84PKjf3AN9-jRuBywNEZNCScThGXrN3PfJyTUXaDqWrfr0 Oct 18 15:26:59.836006 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:26:59.836006 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:26:59.836006 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:26:59.836006 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:26:59.836006 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:26:59.836006 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:26:59.836006 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 6ea5301718fa42c59ac612c63eb34a64 Oct 18 15:26:59.836006 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-422412145 Oct 18 15:26:59.836006 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:26:59.836006 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:26:59.837653 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ea5301718fa42c59ac612c63eb34a64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ea5301718fa42c59ac612c63eb34a64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6ea5301718fa42c59ac612c63eb34a64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6ea5301718fa42c59ac612c63eb34a64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:26:59.837653 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-422412145 Oct 18 15:26:59.837653 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 6ea5301718fa42c59ac612c63eb34a64 Oct 18 15:26:59.837653 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-422412145 Oct 18 15:26:59.837653 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-422412145-project Oct 18 15:26:59.837653 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:26:59.837653 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:26:59.837653 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 8ff58e1a0860437aac930d2448e53278 Oct 18 15:26:59.837653 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-422412145-project Oct 18 15:26:59.837653 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:26:59.837653 n-d-853682-5 devstack@n-api.service[120406]: {"security_group_rule": {"parent_group_id": "be2d419c-3f5a-454e-a2c6-ed231ef42523", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 18 15:26:59.837653 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:26:59.838545 n-d-853682-5 devstack@n-api.service[120406]: exception: Security group be2d419c-3f5a-454e-a2c6-ed231ef42523 does not exist Oct 18 15:26:59.838545 n-d-853682-5 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-700ed15c-b3b2-4ff6-9581-2cead7931441'] Oct 18 15:26:59.838545 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'be2d419c-3f5a-454e-a2c6-ed231ef42523', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 18 15:26:59.838545 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:26:59.838545 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:26:59.838545 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 18 15:26:59.838545 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 18 15:26:59.838545 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:26:59.838545 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:26:59.838545 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 18 15:26:59.838545 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 18 15:26:59.838545 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:26:59.838545 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:26:59.838545 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 15:26:59.838545 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 15:26:59.838545 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:26:59.838545 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:26:59.838545 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 15:26:59.838545 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 15:26:59.840242 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:26:59.840242 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:26:59.840242 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 15:26:59.840242 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 15:26:59.840242 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:26:59.840242 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:26:59.840242 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 15:26:59.840242 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 15:26:59.840242 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 15:26:59.840242 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 15:26:59.840242 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group be2d419c-3f5a-454e-a2c6-ed231ef42523 does not exist Oct 18 15:26:59.840242 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-700ed15c-b3b2-4ff6-9581-2cead7931441'] Oct 18 15:26:59.840242 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:26:59.840242 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:26:59.840242 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:26:59.840242 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:26:59.840242 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 18 15:26:59.840242 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 18 15:26:59.840242 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 18 15:26:59.842578 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 15:26:59.842578 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group be2d419c-3f5a-454e-a2c6-ed231ef42523 does not exist Oct 18 15:26:59.842578 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-700ed15c-b3b2-4ff6-9581-2cead7931441'] Oct 18 15:26:59.842578 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:26:59.842578 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:26:59.842578 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:26:59.842578 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:26:59.842578 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:26:59.842578 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:26:59.842578 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:26:59.842578 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:26:59.842578 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:26:59.842578 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:26:59.842578 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:26:59.842578 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:26:59.842578 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 18 15:26:59.842578 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 15:26:59.842578 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group be2d419c-3f5a-454e-a2c6-ed231ef42523 does not exist Oct 18 15:26:59.842578 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-700ed15c-b3b2-4ff6-9581-2cead7931441'] Oct 18 15:26:59.842578 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:26:59.844906 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:26:59.844906 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:26:59.844906 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:26:59.844906 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:26:59.844906 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:26:59.844906 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:26:59.844906 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:26:59.844906 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group be2d419c-3f5a-454e-a2c6-ed231ef42523 does not exist Oct 18 15:26:59.844906 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-700ed15c-b3b2-4ff6-9581-2cead7931441'] Oct 18 15:26:59.844906 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:26:59.847482 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-afb17992-2f3c-406b-b3fa-45a6ddf897a6 tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] Returning 404 to user: Security group be2d419c-3f5a-454e-a2c6-ed231ef42523 does not exist Oct 18 15:26:59.847482 n-d-853682-5 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-700ed15c-b3b2-4ff6-9581-2cead7931441'] {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:26:59.848371 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-afb17992-2f3c-406b-b3fa-45a6ddf897a6 tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.115905 Oct 18 15:26:59.850625 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 351/689] 10.222.0.60 () {60 vars in 1195 bytes} [Tue Oct 18 15:26:59 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:26:59.865424 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b1115604-36ff-4971-9f84-be2124a7c589 tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] Action: 'update', calling method: .version_select at 0x7f7c3d68c9d0>, body: {"quota_set": {"ram": "5120"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:26:59.965065 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-54a4063a-61ea-4db7-a2b3-64ed1921dcdd tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:26:59.977555 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-54a4063a-61ea-4db7-a2b3-64ed1921dcdd tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2" status: 200 len: 1360 microversion: 2.1 time: 0.314061 Oct 18 15:26:59.978805 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 339/690] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:26:59 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2 => generated 1360 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:00.011746 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1115604-36ff-4971-9f84-be2124a7c589 tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:00.012513 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1115604-36ff-4971-9f84-be2124a7c589 tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:00.013251 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1115604-36ff-4971-9f84-be2124a7c589 tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:00.014646 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1115604-36ff-4971-9f84-be2124a7c589 tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:00.015272 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1115604-36ff-4971-9f84-be2124a7c589 tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:00.015857 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1115604-36ff-4971-9f84-be2124a7c589 tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:00.114161 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b1115604-36ff-4971-9f84-be2124a7c589 tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/a3b35cb0402546f8a9b6126c738db922" status: 200 len: 328 microversion: 2.1 time: 0.259338 Oct 18 15:27:00.115515 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 352/691] 10.222.0.60 () {60 vars in 1262 bytes} [Tue Oct 18 15:26:59 2022] PUT /compute/v2.1/os-quota-sets/a3b35cb0402546f8a9b6126c738db922 => generated 328 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:27:00.128950 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a3ea7bad-ca32-41b8-bd8c-6558703615c8 tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] Calling method '.version_select at 0x7f7c3f4d2430>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:00.172915 n-d-853682-5 devstack@n-api.service[120406]: DEBUG neutronclient.v2_0.client [None req-a3ea7bad-ca32-41b8-bd8c-6558703615c8 tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 2df1f2e6-25c8-4d68-af2a-750548778274 does not exist", "detail": ""}} {{(pid=120406) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 15:27:00.173757 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.security_group_api [None req-a3ea7bad-ca32-41b8-bd8c-6558703615c8 tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] Neutron security group rule 2df1f2e6-25c8-4d68-af2a-750548778274 not found {{(pid=120406) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 18 15:27:00.174524 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-a3ea7bad-ca32-41b8-bd8c-6558703615c8 tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] HTTP exception thrown: Security group rule 2df1f2e6-25c8-4d68-af2a-750548778274 does not exist Oct 18 15:27:00.174524 n-d-853682-5 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-7198c9eb-d172-4dcf-a3dc-010be6b3cac3'] Oct 18 15:27:00.176839 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a3ea7bad-ca32-41b8-bd8c-6558703615c8 tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] Request method failure captured: Oct 18 15:27:00.176839 n-d-853682-5 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/os-security-group-rules/2df1f2e6-25c8-4d68-af2a-750548778274 HTTP/1.1 Oct 18 15:27:00.176839 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:27:00.176839 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:27:00.176839 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:27:00.176839 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:27:00.176839 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:27:00.176839 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:27:00.176839 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:27:00.176839 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:27:00.176839 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsW51JPianN7i4cc2_i3EiWhcuI-pQbW-E4JZZn0WXzRezWrX9QkBWtVDpCpEZlo8aLMUKgcSy4TCCQZO44Wq4Js3-XNLdRjaEZvWendN8mxoAEhLKhd4n33K4Gf6wBCs84PKjf3AN9-jRuBywNEZNCScThGXrN3PfJyTUXaDqWrfr0 Oct 18 15:27:00.176839 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:27:00.176839 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:27:00.176839 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:27:00.176839 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:27:00.176839 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:27:00.176839 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:27:00.176839 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 6ea5301718fa42c59ac612c63eb34a64 Oct 18 15:27:00.176839 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-422412145 Oct 18 15:27:00.176839 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:27:00.176839 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:27:00.178247 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ea5301718fa42c59ac612c63eb34a64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ea5301718fa42c59ac612c63eb34a64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6ea5301718fa42c59ac612c63eb34a64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6ea5301718fa42c59ac612c63eb34a64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:27:00.178247 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-422412145 Oct 18 15:27:00.178247 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 6ea5301718fa42c59ac612c63eb34a64 Oct 18 15:27:00.178247 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-422412145 Oct 18 15:27:00.178247 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-422412145-project Oct 18 15:27:00.178247 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:27:00.178247 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:27:00.178247 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 8ff58e1a0860437aac930d2448e53278 Oct 18 15:27:00.178247 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-422412145-project Oct 18 15:27:00.178247 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:27:00.178247 n-d-853682-5 devstack@n-api.service[120406]: exception: Security group rule 2df1f2e6-25c8-4d68-af2a-750548778274 does not exist Oct 18 15:27:00.178247 n-d-853682-5 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-7198c9eb-d172-4dcf-a3dc-010be6b3cac3'] Oct 18 15:27:00.185126 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '2df1f2e6-25c8-4d68-af2a-750548778274'} Oct 18 15:27:00.185126 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:27:00.185126 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:27:00.185126 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 18 15:27:00.185126 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 18 15:27:00.185126 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:27:00.185126 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:27:00.185126 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 18 15:27:00.185126 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 18 15:27:00.185126 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:27:00.185126 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:27:00.185126 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 15:27:00.185126 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 15:27:00.185126 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:27:00.185126 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:27:00.185126 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 15:27:00.185126 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 15:27:00.185126 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:27:00.185126 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:27:00.186256 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 15:27:00.186256 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 15:27:00.186256 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:27:00.186256 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:27:00.186256 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 15:27:00.186256 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 15:27:00.186256 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 15:27:00.186256 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 15:27:00.186256 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 2df1f2e6-25c8-4d68-af2a-750548778274 does not exist Oct 18 15:27:00.186256 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7198c9eb-d172-4dcf-a3dc-010be6b3cac3'] Oct 18 15:27:00.186256 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:27:00.186256 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:27:00.186256 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:27:00.186256 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:27:00.186256 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 18 15:27:00.186256 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 18 15:27:00.186256 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 18 15:27:00.186256 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 15:27:00.187308 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 2df1f2e6-25c8-4d68-af2a-750548778274 does not exist Oct 18 15:27:00.187308 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7198c9eb-d172-4dcf-a3dc-010be6b3cac3'] Oct 18 15:27:00.187308 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:27:00.187308 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:27:00.187308 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:27:00.187308 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:27:00.187308 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:27:00.187308 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:27:00.187308 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:27:00.187308 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:27:00.187308 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:27:00.187308 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:27:00.187308 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:27:00.187308 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:27:00.187308 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 18 15:27:00.187308 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 15:27:00.187308 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 2df1f2e6-25c8-4d68-af2a-750548778274 does not exist Oct 18 15:27:00.187308 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7198c9eb-d172-4dcf-a3dc-010be6b3cac3'] Oct 18 15:27:00.187308 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:27:00.187308 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:27:00.188453 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:27:00.188453 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:27:00.188453 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:27:00.188453 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:27:00.188453 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:27:00.188453 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:27:00.188453 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 2df1f2e6-25c8-4d68-af2a-750548778274 does not exist Oct 18 15:27:00.188453 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7198c9eb-d172-4dcf-a3dc-010be6b3cac3'] Oct 18 15:27:00.188453 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:27:00.188453 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a3ea7bad-ca32-41b8-bd8c-6558703615c8 tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] Returning 404 to user: Security group rule 2df1f2e6-25c8-4d68-af2a-750548778274 does not exist Oct 18 15:27:00.188453 n-d-853682-5 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-7198c9eb-d172-4dcf-a3dc-010be6b3cac3'] {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:27:00.188453 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a3ea7bad-ca32-41b8-bd8c-6558703615c8 tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-group-rules/2df1f2e6-25c8-4d68-af2a-750548778274" status: 404 len: 199 microversion: 2.1 time: 0.055928 Oct 18 15:27:00.188453 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 353/692] 10.222.0.60 () {58 vars in 1287 bytes} [Tue Oct 18 15:27:00 2022] DELETE /compute/v2.1/os-security-group-rules/2df1f2e6-25c8-4d68-af2a-750548778274 => generated 199 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:27:00.195804 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-becd0973-3996-449f-8486-3c46b286851d tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:00.215412 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-74742daa-c7dd-4ed3-b8cc-845d7027dafd tempest-ServersAdminNegativeTestJSON-1620600410 tempest-ServersAdminNegativeTestJSON-1620600410-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:27:00.216282 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-74742daa-c7dd-4ed3-b8cc-845d7027dafd tempest-ServersAdminNegativeTestJSON-1620600410 tempest-ServersAdminNegativeTestJSON-1620600410-project-admin] [instance: 05407dfe-7655-4729-a41f-ff5b4b0339dd] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:00.216766 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-becd0973-3996-449f-8486-3c46b286851d tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-quota-sets/a3b35cb0402546f8a9b6126c738db922" status: 202 len: 0 microversion: 2.1 time: 0.036195 Oct 18 15:27:00.217694 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 354/693] 10.222.0.60 () {58 vars in 1245 bytes} [Tue Oct 18 15:27:00 2022] DELETE /compute/v2.1/os-quota-sets/a3b35cb0402546f8a9b6126c738db922 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:27:00.226944 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-74742daa-c7dd-4ed3-b8cc-845d7027dafd tempest-ServersAdminNegativeTestJSON-1620600410 tempest-ServersAdminNegativeTestJSON-1620600410-project-admin] HTTP exception thrown: Instance 05407dfe-7655-4729-a41f-ff5b4b0339dd could not be found. Oct 18 15:27:00.227698 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ae0201aa-49bc-4b91-9234-579625a88d16 tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] Calling method '.version_select at 0x7f7c3d6b7790>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:00.230623 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-74742daa-c7dd-4ed3-b8cc-845d7027dafd tempest-ServersAdminNegativeTestJSON-1620600410 tempest-ServersAdminNegativeTestJSON-1620600410-project-admin] Request method failure captured: Oct 18 15:27:00.230623 n-d-853682-5 devstack@n-api.service[120405]: request: POST /compute/v2.1/servers/05407dfe-7655-4729-a41f-ff5b4b0339dd/action HTTP/1.1 Oct 18 15:27:00.230623 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:27:00.230623 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:27:00.230623 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:27:00.230623 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 15 Oct 18 15:27:00.230623 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:27:00.230623 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:27:00.230623 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:27:00.230623 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:27:00.230623 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsWq1dpMgzIsCWRY0F892VDgNvUvxfWzvxFptNz49mY3aWwE5Vb_K0JSfxO6p36gZKw6w9GIwHT55uY3_yyws0qe6Lmr8jGy1By-l-727jpAlT2J6qSutb75upX7Kiu82-G4IdT27ihwE_LVkwS6fKOnplL_Ld5wOoSPB5hDUAQ1loE Oct 18 15:27:00.230623 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:27:00.230623 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:27:00.230623 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:27:00.230623 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:27:00.230623 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:27:00.230623 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:27:00.230623 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: ad0780e3e2474c07836a17475bdf3ab4 Oct 18 15:27:00.230623 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1620600410 Oct 18 15:27:00.230623 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,admin,reader Oct 18 15:27:00.230623 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,admin,reader Oct 18 15:27:00.232535 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ad0780e3e2474c07836a17475bdf3ab4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ad0780e3e2474c07836a17475bdf3ab4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ad0780e3e2474c07836a17475bdf3ab4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ad0780e3e2474c07836a17475bdf3ab4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:27:00.232535 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1620600410 Oct 18 15:27:00.232535 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: ad0780e3e2474c07836a17475bdf3ab4 Oct 18 15:27:00.232535 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1620600410 Oct 18 15:27:00.232535 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServersAdminNegativeTestJSON-1620600410-project-admin Oct 18 15:27:00.232535 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:27:00.232535 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:27:00.232535 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 4c637bbfb0214b919c1275198a2e0829 Oct 18 15:27:00.232535 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1620600410-project-admin Oct 18 15:27:00.232535 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:27:00.232535 n-d-853682-5 devstack@n-api.service[120405]: {"migrate": {}} Oct 18 15:27:00.232535 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:27:00.232535 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 05407dfe-7655-4729-a41f-ff5b4b0339dd could not be found. Oct 18 15:27:00.233421 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '05407dfe-7655-4729-a41f-ff5b4b0339dd', 'body': {'migrate': {}}} Oct 18 15:27:00.233421 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:27:00.233421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:27:00.233421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:27:00.233421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:27:00.233421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:27:00.233421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:27:00.233421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 15:27:00.233421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 15:27:00.233421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05407dfe-7655-4729-a41f-ff5b4b0339dd could not be found. Oct 18 15:27:00.233421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:27:00.233421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:27:00.233421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:27:00.233421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:27:00.233421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:27:00.233421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:27:00.233421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:27:00.233421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:27:00.233421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:27:00.233421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:27:00.234588 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:27:00.234588 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:27:00.234588 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 18 15:27:00.234588 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 18 15:27:00.234588 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:27:00.234588 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:27:00.234588 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05407dfe-7655-4729-a41f-ff5b4b0339dd could not be found. Oct 18 15:27:00.234588 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:27:00.234588 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:27:00.234588 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:27:00.234588 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:27:00.234588 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:27:00.234588 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:27:00.234588 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:27:00.234588 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:27:00.234588 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05407dfe-7655-4729-a41f-ff5b4b0339dd could not be found. Oct 18 15:27:00.234588 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:27:00.235718 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-74742daa-c7dd-4ed3-b8cc-845d7027dafd tempest-ServersAdminNegativeTestJSON-1620600410 tempest-ServersAdminNegativeTestJSON-1620600410-project-admin] Returning 404 to user: Instance 05407dfe-7655-4729-a41f-ff5b4b0339dd could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:27:00.235718 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-74742daa-c7dd-4ed3-b8cc-845d7027dafd tempest-ServersAdminNegativeTestJSON-1620600410 tempest-ServersAdminNegativeTestJSON-1620600410-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/05407dfe-7655-4729-a41f-ff5b4b0339dd/action" status: 404 len: 111 microversion: 2.1 time: 0.254838 Oct 18 15:27:00.247283 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 340/694] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:26:59 2022] POST /compute/v2.1/servers/05407dfe-7655-4729-a41f-ff5b4b0339dd/action => generated 111 bytes in 268 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:27:00.252390 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-54b44b6e-034f-4676-9c4a-1b81f19aa196 tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] Calling method '.version_select at 0x7f7c3d8481f0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:00.358788 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=93,nova_api:DELETE=4 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:27:00.385113 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-54b44b6e-034f-4676-9c4a-1b81f19aa196 tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/a3b35cb0402546f8a9b6126c738db922" status: 200 len: 371 microversion: 2.1 time: 0.135627 Oct 18 15:27:00.386713 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 341/695] 10.222.0.60 () {58 vars in 1242 bytes} [Tue Oct 18 15:27:00 2022] GET /compute/v2.1/os-quota-sets/a3b35cb0402546f8a9b6126c738db922 => generated 371 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:27:00.409041 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-724f48d3-3d8f-4729-844d-07d74d208e8d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:00.415546 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-724f48d3-3d8f-4729-844d-07d74d208e8d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: f07f6211-dd0e-4bdd-969c-fff2c3633dd0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:00.453271 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-724f48d3-3d8f-4729-844d-07d74d208e8d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:00.454149 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-724f48d3-3d8f-4729-844d-07d74d208e8d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:00.455008 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-724f48d3-3d8f-4729-844d-07d74d208e8d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:00.456245 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-724f48d3-3d8f-4729-844d-07d74d208e8d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:00.457026 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-724f48d3-3d8f-4729-844d-07d74d208e8d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:00.457756 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-724f48d3-3d8f-4729-844d-07d74d208e8d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:00.751801 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ae0201aa-49bc-4b91-9234-579625a88d16 tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/fe70159c-cfce-4fac-b6f7-ae21f943e7d7" status: 202 len: 0 microversion: 2.1 time: 0.528208 Oct 18 15:27:00.752604 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 355/696] 10.222.0.60 () {58 vars in 1272 bytes} [Tue Oct 18 15:27:00 2022] DELETE /compute/v2.1/os-security-groups/fe70159c-cfce-4fac-b6f7-ae21f943e7d7 => generated 0 bytes in 531 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:27:00.757425 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-629eaa49-b91d-4ac3-9664-2fbfa4ccef19 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:00.758028 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-629eaa49-b91d-4ac3-9664-2fbfa4ccef19 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 28a18615-ab69-4e8e-865c-b8e0b67a74f4] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:00.772476 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-629eaa49-b91d-4ac3-9664-2fbfa4ccef19 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:00.773026 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-629eaa49-b91d-4ac3-9664-2fbfa4ccef19 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:00.773442 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-629eaa49-b91d-4ac3-9664-2fbfa4ccef19 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:00.774123 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-629eaa49-b91d-4ac3-9664-2fbfa4ccef19 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:00.776085 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-629eaa49-b91d-4ac3-9664-2fbfa4ccef19 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:00.778913 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-629eaa49-b91d-4ac3-9664-2fbfa4ccef19 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:00.849926 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-724f48d3-3d8f-4729-844d-07d74d208e8d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:00.858276 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-724f48d3-3d8f-4729-844d-07d74d208e8d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/f07f6211-dd0e-4bdd-969c-fff2c3633dd0" status: 200 len: 1474 microversion: 2.1 time: 0.469994 Oct 18 15:27:00.859153 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 342/697] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:00 2022] GET /compute/v2.1/servers/f07f6211-dd0e-4bdd-969c-fff2c3633dd0 => generated 1474 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:00.866265 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3764c020-751e-4655-b9e6-481ea754f383 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-102256491", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:27:00.938617 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-3764c020-751e-4655-b9e6-481ea754f383 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] validate_networks() for None {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:27:00.978017 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-629eaa49-b91d-4ac3-9664-2fbfa4ccef19 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:00.986488 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-629eaa49-b91d-4ac3-9664-2fbfa4ccef19 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:00.987917 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-629eaa49-b91d-4ac3-9664-2fbfa4ccef19 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:00.989116 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-629eaa49-b91d-4ac3-9664-2fbfa4ccef19 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4" status: 200 len: 1567 microversion: 2.25 time: 0.235784 Oct 18 15:27:00.989665 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 356/698] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:27:00 2022] GET /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4 => generated 1567 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:27:01.000405 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d2a63e38-dddb-4017-b9cf-fcd6421c103a tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] Calling method '.version_select at 0x7f7c3d67d670>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:01.182389 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-3764c020-751e-4655-b9e6-481ea754f383 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:27:01.183045 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-3764c020-751e-4655-b9e6-481ea754f383 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:27:01.183787 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-3764c020-751e-4655-b9e6-481ea754f383 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:27:01.184201 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-3764c020-751e-4655-b9e6-481ea754f383 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:27:01.184614 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-3764c020-751e-4655-b9e6-481ea754f383 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:27:01.193514 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3764c020-751e-4655-b9e6-481ea754f383 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:01.194006 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3764c020-751e-4655-b9e6-481ea754f383 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:01.194437 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3764c020-751e-4655-b9e6-481ea754f383 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:01.195412 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3764c020-751e-4655-b9e6-481ea754f383 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:01.195939 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3764c020-751e-4655-b9e6-481ea754f383 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:01.196372 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3764c020-751e-4655-b9e6-481ea754f383 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:01.211876 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d2a63e38-dddb-4017-b9cf-fcd6421c103a tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/bb2bc7fb769c40b1be67ab9b9e8b545c/defaults" status: 200 len: 371 microversion: 2.1 time: 0.214952 Oct 18 15:27:01.222086 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 357/699] 10.222.0.60 () {58 vars in 1269 bytes} [Tue Oct 18 15:27:00 2022] GET /compute/v2.1/os-quota-sets/bb2bc7fb769c40b1be67ab9b9e8b545c/defaults => generated 371 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:27:01.222086 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f9a541ab-db0b-4b0f-aca9-907ff08033a9 tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] Calling method '.version_select at 0x7f7c3d69f940>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:01.234524 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-3764c020-751e-4655-b9e6-481ea754f383 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Getting quotas for project d94c87221eb94488ba2e0fdd41386b0c. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:27:01.241620 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-3764c020-751e-4655-b9e6-481ea754f383 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Getting quotas for user 7357f1c14a544016bba5abeee15f7a6d and project d94c87221eb94488ba2e0fdd41386b0c. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:27:01.272984 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3764c020-751e-4655-b9e6-481ea754f383 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:27:01.275312 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3764c020-751e-4655-b9e6-481ea754f383 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] [instance: aab97ea8-6772-407f-a9f9-60f05d27cbfb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:27:01.334791 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3764c020-751e-4655-b9e6-481ea754f383 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.474301 Oct 18 15:27:01.341400 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 343/700] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:27:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 481 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:27:01.348680 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3d9271f9-61fd-4450-b831-d1d0234eda4a tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1149874888", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "866b72c1-5b66-4cd2-80db-d87d05d0cbaf"}], "security_groups": [{"name": "tempest-securitygroup--1258455914"}], "key_name": "tempest-keypair-934683465", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:27:01.593837 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-3d9271f9-61fd-4450-b831-d1d0234eda4a tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] validate_networks() for [('866b72c1-5b66-4cd2-80db-d87d05d0cbaf', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:27:01.658667 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f9a541ab-db0b-4b0f-aca9-907ff08033a9 tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/c66bfddc-fb62-4351-aec7-8b9088f579a9" status: 202 len: 0 microversion: 2.1 time: 0.445132 Oct 18 15:27:01.659242 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 358/701] 10.222.0.60 () {58 vars in 1272 bytes} [Tue Oct 18 15:27:01 2022] DELETE /compute/v2.1/os-security-groups/c66bfddc-fb62-4351-aec7-8b9088f579a9 => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:27:01.664047 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a3e58eb6-a09d-4802-986c-288b14d4e7dc tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2076551753"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:27:01.666553 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a3e58eb6-a09d-4802-986c-288b14d4e7dc tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: f07f6211-dd0e-4bdd-969c-fff2c3633dd0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:01.681269 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3e58eb6-a09d-4802-986c-288b14d4e7dc tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:01.684703 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3e58eb6-a09d-4802-986c-288b14d4e7dc tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:01.685467 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3e58eb6-a09d-4802-986c-288b14d4e7dc tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:01.686431 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3e58eb6-a09d-4802-986c-288b14d4e7dc tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:01.693260 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3e58eb6-a09d-4802-986c-288b14d4e7dc tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:01.694039 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3e58eb6-a09d-4802-986c-288b14d4e7dc tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:02.029040 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a3e58eb6-a09d-4802-986c-288b14d4e7dc tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "POST /compute/v2.1/servers/f07f6211-dd0e-4bdd-969c-fff2c3633dd0/action" status: 202 len: 0 microversion: 2.1 time: 0.368535 Oct 18 15:27:02.029798 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 359/702] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:27:01 2022] POST /compute/v2.1/servers/f07f6211-dd0e-4bdd-969c-fff2c3633dd0/action => generated 0 bytes in 370 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 18 15:27:02.036003 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0de63fd6-89f8-4cb0-ad6b-9cb2d0f5ed8e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:02.037095 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0de63fd6-89f8-4cb0-ad6b-9cb2d0f5ed8e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:02.044439 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0de63fd6-89f8-4cb0-ad6b-9cb2d0f5ed8e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:02.045715 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0de63fd6-89f8-4cb0-ad6b-9cb2d0f5ed8e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:02.046467 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0de63fd6-89f8-4cb0-ad6b-9cb2d0f5ed8e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:02.047791 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0de63fd6-89f8-4cb0-ad6b-9cb2d0f5ed8e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:02.048600 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0de63fd6-89f8-4cb0-ad6b-9cb2d0f5ed8e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:02.049316 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0de63fd6-89f8-4cb0-ad6b-9cb2d0f5ed8e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:02.392913 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0de63fd6-89f8-4cb0-ad6b-9cb2d0f5ed8e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:02.404768 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0de63fd6-89f8-4cb0-ad6b-9cb2d0f5ed8e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2" status: 200 len: 1360 microversion: 2.1 time: 0.373473 Oct 18 15:27:02.406086 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 360/703] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:02 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2 => generated 1360 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:02.412198 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-797e8aee-47c5-4c5c-954e-fc32a14be85a tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:02.413001 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-797e8aee-47c5-4c5c-954e-fc32a14be85a tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] [instance: aab97ea8-6772-407f-a9f9-60f05d27cbfb] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:02.420360 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-797e8aee-47c5-4c5c-954e-fc32a14be85a tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:02.422425 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-797e8aee-47c5-4c5c-954e-fc32a14be85a tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:02.423125 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-797e8aee-47c5-4c5c-954e-fc32a14be85a tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:02.425049 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-797e8aee-47c5-4c5c-954e-fc32a14be85a tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:02.425758 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-797e8aee-47c5-4c5c-954e-fc32a14be85a tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:02.427926 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-797e8aee-47c5-4c5c-954e-fc32a14be85a tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:02.564631 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-797e8aee-47c5-4c5c-954e-fc32a14be85a tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7357f1c14a544016bba5abeee15f7a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c87221eb94488ba2e0fdd41386b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:02.565729 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-3d9271f9-61fd-4450-b831-d1d0234eda4a tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:27:02.566454 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-3d9271f9-61fd-4450-b831-d1d0234eda4a tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:27:02.566717 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-3d9271f9-61fd-4450-b831-d1d0234eda4a tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:27:02.567194 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-3d9271f9-61fd-4450-b831-d1d0234eda4a tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:27:02.567701 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-3d9271f9-61fd-4450-b831-d1d0234eda4a tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:27:02.577633 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-797e8aee-47c5-4c5c-954e-fc32a14be85a tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] 10.222.0.60 "GET /compute/v2.1/servers/aab97ea8-6772-407f-a9f9-60f05d27cbfb" status: 200 len: 1273 microversion: 2.1 time: 0.170191 Oct 18 15:27:02.579490 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 361/704] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:02 2022] GET /compute/v2.1/servers/aab97ea8-6772-407f-a9f9-60f05d27cbfb => generated 1273 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:02.584535 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0765f005-23e7-4127-b0e7-ccf74bc0ac9a tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] Action: 'update', calling method: .version_select at 0x7f7c3d6413a0>, body: {"quota_set": {"ram": "5120"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:27:02.591628 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3d9271f9-61fd-4450-b831-d1d0234eda4a tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:02.594457 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3d9271f9-61fd-4450-b831-d1d0234eda4a tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:02.595230 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3d9271f9-61fd-4450-b831-d1d0234eda4a tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:02.597353 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3d9271f9-61fd-4450-b831-d1d0234eda4a tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:02.598476 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3d9271f9-61fd-4450-b831-d1d0234eda4a tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:02.600353 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3d9271f9-61fd-4450-b831-d1d0234eda4a tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:02.652606 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-3d9271f9-61fd-4450-b831-d1d0234eda4a tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Getting quotas for project ac07f1b2c83a4faab175a5b9ed8e315e. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:27:02.662245 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-3d9271f9-61fd-4450-b831-d1d0234eda4a tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Getting quotas for user a1023300147f463e8f0894981948f825 and project ac07f1b2c83a4faab175a5b9ed8e315e. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:27:02.686704 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3d9271f9-61fd-4450-b831-d1d0234eda4a tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:27:02.695310 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3d9271f9-61fd-4450-b831-d1d0234eda4a tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: 21ed44b3-c1df-4099-a1ca-a8b167fc3890] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:27:02.747581 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0765f005-23e7-4127-b0e7-ccf74bc0ac9a tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:02.748502 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0765f005-23e7-4127-b0e7-ccf74bc0ac9a tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:02.748971 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0765f005-23e7-4127-b0e7-ccf74bc0ac9a tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:02.749688 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0765f005-23e7-4127-b0e7-ccf74bc0ac9a tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:02.750138 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0765f005-23e7-4127-b0e7-ccf74bc0ac9a tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:02.750554 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0765f005-23e7-4127-b0e7-ccf74bc0ac9a tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:02.751771 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3d9271f9-61fd-4450-b831-d1d0234eda4a tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.408694 Oct 18 15:27:02.754098 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 344/705] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:27:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 1412 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:27:02.773882 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fdf93ea9-61c3-47f2-b0bd-8ae80cca86a6 tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] Calling method '.version_select at 0x7f7c3d8683a0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:02.810464 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0765f005-23e7-4127-b0e7-ccf74bc0ac9a tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/511d8234f077442aae12536f59ec4d44" status: 200 len: 328 microversion: 2.1 time: 0.229597 Oct 18 15:27:02.811225 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 362/706] 10.222.0.60 () {60 vars in 1262 bytes} [Tue Oct 18 15:27:02 2022] PUT /compute/v2.1/os-quota-sets/511d8234f077442aae12536f59ec4d44 => generated 328 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:27:02.816153 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-570032f3-33c8-4362-b138-85755333d821 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:02.816857 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-570032f3-33c8-4362-b138-85755333d821 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 28a18615-ab69-4e8e-865c-b8e0b67a74f4] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:02.822922 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-570032f3-33c8-4362-b138-85755333d821 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:02.824591 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-570032f3-33c8-4362-b138-85755333d821 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:02.825119 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-570032f3-33c8-4362-b138-85755333d821 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:02.825899 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-570032f3-33c8-4362-b138-85755333d821 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:02.826427 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-570032f3-33c8-4362-b138-85755333d821 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:02.827884 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-570032f3-33c8-4362-b138-85755333d821 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:03.029102 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-570032f3-33c8-4362-b138-85755333d821 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:03.038076 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-570032f3-33c8-4362-b138-85755333d821 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:03.040196 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-570032f3-33c8-4362-b138-85755333d821 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:03.041795 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-570032f3-33c8-4362-b138-85755333d821 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4" status: 200 len: 1567 microversion: 2.25 time: 0.229383 Oct 18 15:27:03.042565 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 363/707] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:27:02 2022] GET /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4 => generated 1567 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:27:03.051143 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6135a2b6-4dd1-4996-9d4a-a9e2c9d7fef4 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d69f1f0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:03.079752 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fdf93ea9-61c3-47f2-b0bd-8ae80cca86a6 tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/6bfa237c-a186-4cd7-87a7-8c353577d186" status: 202 len: 0 microversion: 2.1 time: 0.324182 Oct 18 15:27:03.083837 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 345/708] 10.222.0.60 () {58 vars in 1272 bytes} [Tue Oct 18 15:27:02 2022] DELETE /compute/v2.1/os-security-groups/6bfa237c-a186-4cd7-87a7-8c353577d186 => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:27:03.093185 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-9442f15f-3df3-4180-a94c-5a2b636b5e53 req-2f2fa801-84ec-4202-b500-41f360c083b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0a3feae-1805-4c09-881b-99dd257bd9c2", "name": "network-vif-plugged", "status": "completed", "tag": "e6a47323-8aa2-4713-af2b-48bb88888044"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:27:03.104679 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6135a2b6-4dd1-4996-9d4a-a9e2c9d7fef4 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/4cacb5ef-8146-4f19-98d6-b6eb8e8d35e6" status: 200 len: 1412 microversion: 2.1 time: 0.060173 Oct 18 15:27:03.104929 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-9442f15f-3df3-4180-a94c-5a2b636b5e53 req-2f2fa801-84ec-4202-b500-41f360c083b4 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:03.105680 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-9442f15f-3df3-4180-a94c-5a2b636b5e53 req-2f2fa801-84ec-4202-b500-41f360c083b4 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:03.106104 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-9442f15f-3df3-4180-a94c-5a2b636b5e53 req-2f2fa801-84ec-4202-b500-41f360c083b4 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:03.109776 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 364/709] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:27:03 2022] GET /compute/v2.1/images/4cacb5ef-8146-4f19-98d6-b6eb8e8d35e6 => generated 1412 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:03.117441 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-828b7776-c1f0-467b-962b-525be29b80dd tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:03.118060 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-828b7776-c1f0-467b-962b-525be29b80dd tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: 21ed44b3-c1df-4099-a1ca-a8b167fc3890] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:03.140441 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-9442f15f-3df3-4180-a94c-5a2b636b5e53 req-2f2fa801-84ec-4202-b500-41f360c083b4 service nova] Creating event network-vif-plugged:e6a47323-8aa2-4713-af2b-48bb88888044 for instance a0a3feae-1805-4c09-881b-99dd257bd9c2 on n-h1-853682-5 Oct 18 15:27:03.149242 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-9442f15f-3df3-4180-a94c-5a2b636b5e53 req-2f2fa801-84ec-4202-b500-41f360c083b4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060425 Oct 18 15:27:03.150324 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 346/710] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:27:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:27:03.159400 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-33d48947-6409-407f-a207-6846ed83ec62 tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] Calling method '.version_select at 0x7f7c3d76c790>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:03.281721 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-828b7776-c1f0-467b-962b-525be29b80dd tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1023300147f463e8f0894981948f825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac07f1b2c83a4faab175a5b9ed8e315e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:03.308177 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-828b7776-c1f0-467b-962b-525be29b80dd tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/21ed44b3-c1df-4099-a1ca-a8b167fc3890" status: 200 len: 1241 microversion: 2.1 time: 0.192393 Oct 18 15:27:03.310485 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 365/711] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:03 2022] GET /compute/v2.1/servers/21ed44b3-c1df-4099-a1ca-a8b167fc3890 => generated 1241 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:03.312034 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-33d48947-6409-407f-a207-6846ed83ec62 tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:03.312911 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-33d48947-6409-407f-a207-6846ed83ec62 tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:03.313630 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-33d48947-6409-407f-a207-6846ed83ec62 tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:03.314868 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-33d48947-6409-407f-a207-6846ed83ec62 tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:03.315882 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-33d48947-6409-407f-a207-6846ed83ec62 tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:03.316556 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-33d48947-6409-407f-a207-6846ed83ec62 tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:03.330616 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-34de4fad-66e2-407b-934c-acbbabcbd7c5 tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] Calling method '.version_select at 0x7f7c3d712e50>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:03.344425 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-33d48947-6409-407f-a207-6846ed83ec62 tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/511d8234f077442aae12536f59ec4d44/detail" status: 200 len: 916 microversion: 2.1 time: 0.192745 Oct 18 15:27:03.346284 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 347/712] 10.222.0.60 () {58 vars in 1263 bytes} [Tue Oct 18 15:27:03 2022] GET /compute/v2.1/os-quota-sets/511d8234f077442aae12536f59ec4d44/detail => generated 916 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:27:03.431526 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7b0a4b02-10c2-455b-80dc-5ec23fd84411 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:03.432279 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7b0a4b02-10c2-455b-80dc-5ec23fd84411 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:03.442133 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7b0a4b02-10c2-455b-80dc-5ec23fd84411 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:03.442630 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7b0a4b02-10c2-455b-80dc-5ec23fd84411 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:03.443070 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7b0a4b02-10c2-455b-80dc-5ec23fd84411 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:03.443777 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7b0a4b02-10c2-455b-80dc-5ec23fd84411 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:03.444240 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7b0a4b02-10c2-455b-80dc-5ec23fd84411 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:03.444665 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7b0a4b02-10c2-455b-80dc-5ec23fd84411 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:03.893060 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7b0a4b02-10c2-455b-80dc-5ec23fd84411 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:03.903025 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7b0a4b02-10c2-455b-80dc-5ec23fd84411 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2" status: 200 len: 1360 microversion: 2.1 time: 0.475593 Oct 18 15:27:03.920036 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 348/713] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:03 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2 => generated 1360 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:03.925578 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-92629576-0c24-472e-a24c-4796eb292515 tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] Action: 'update', calling method: .version_select at 0x7f7c3d77e280>, body: {"quota_set": {"ram": "2048"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:27:03.978325 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-34de4fad-66e2-407b-934c-acbbabcbd7c5 tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/7105e60a-9163-4789-a592-9b8499730e37" status: 202 len: 0 microversion: 2.1 time: 0.665444 Oct 18 15:27:03.978996 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 366/714] 10.222.0.60 () {58 vars in 1272 bytes} [Tue Oct 18 15:27:03 2022] DELETE /compute/v2.1/os-security-groups/7105e60a-9163-4789-a592-9b8499730e37 => generated 0 bytes in 667 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:27:03.989829 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5b8e7691-c859-4cf3-9425-58e2d356df42 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:03.996619 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5b8e7691-c859-4cf3-9425-58e2d356df42 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] [instance: aab97ea8-6772-407f-a9f9-60f05d27cbfb] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:04.001162 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-92629576-0c24-472e-a24c-4796eb292515 tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:04.001750 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-92629576-0c24-472e-a24c-4796eb292515 tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:04.002451 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-92629576-0c24-472e-a24c-4796eb292515 tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:04.003273 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-92629576-0c24-472e-a24c-4796eb292515 tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:04.003793 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-92629576-0c24-472e-a24c-4796eb292515 tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:04.004282 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-92629576-0c24-472e-a24c-4796eb292515 tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:04.008670 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5b8e7691-c859-4cf3-9425-58e2d356df42 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:04.009211 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5b8e7691-c859-4cf3-9425-58e2d356df42 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:04.009656 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5b8e7691-c859-4cf3-9425-58e2d356df42 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:04.010374 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5b8e7691-c859-4cf3-9425-58e2d356df42 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:04.011411 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5b8e7691-c859-4cf3-9425-58e2d356df42 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:04.012271 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5b8e7691-c859-4cf3-9425-58e2d356df42 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:04.045924 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-92629576-0c24-472e-a24c-4796eb292515 tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:04.046501 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-92629576-0c24-472e-a24c-4796eb292515 tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:04.047151 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-92629576-0c24-472e-a24c-4796eb292515 tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:04.048287 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-92629576-0c24-472e-a24c-4796eb292515 tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:04.048925 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-92629576-0c24-472e-a24c-4796eb292515 tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:04.049810 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-92629576-0c24-472e-a24c-4796eb292515 tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:04.117769 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5b8e7691-c859-4cf3-9425-58e2d356df42 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7357f1c14a544016bba5abeee15f7a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c87221eb94488ba2e0fdd41386b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:04.120579 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:27:04.123755 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-92629576-0c24-472e-a24c-4796eb292515 tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/511d8234f077442aae12536f59ec4d44?user_id=f111eb55e00f4c86a450fb4b222159a8" status: 200 len: 328 microversion: 2.1 time: 0.201976 Oct 18 15:27:04.124392 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 349/715] 10.222.0.60 () {60 vars in 1343 bytes} [Tue Oct 18 15:27:03 2022] PUT /compute/v2.1/os-quota-sets/511d8234f077442aae12536f59ec4d44?user_id=f111eb55e00f4c86a450fb4b222159a8 => generated 328 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:27:04.130175 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-82ec3a3d-46f9-4d73-80d3-2ac9772ed837 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:04.130767 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5b8e7691-c859-4cf3-9425-58e2d356df42 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] 10.222.0.60 "GET /compute/v2.1/servers/aab97ea8-6772-407f-a9f9-60f05d27cbfb" status: 200 len: 1279 microversion: 2.1 time: 0.150062 Oct 18 15:27:04.131245 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-82ec3a3d-46f9-4d73-80d3-2ac9772ed837 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] [instance: 19061153-9eed-4374-8799-b497b8a8e780] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:04.136778 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 367/716] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:03 2022] GET /compute/v2.1/servers/aab97ea8-6772-407f-a9f9-60f05d27cbfb => generated 1279 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:04.138941 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-82ec3a3d-46f9-4d73-80d3-2ac9772ed837 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:04.139650 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-82ec3a3d-46f9-4d73-80d3-2ac9772ed837 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:04.140281 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-82ec3a3d-46f9-4d73-80d3-2ac9772ed837 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:04.141223 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-82ec3a3d-46f9-4d73-80d3-2ac9772ed837 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:04.141919 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-82ec3a3d-46f9-4d73-80d3-2ac9772ed837 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:04.142537 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-82ec3a3d-46f9-4d73-80d3-2ac9772ed837 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:04.143625 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a6b7d377-2575-40bb-8a1f-38f9bc389504 tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] Calling method '.version_select at 0x7f7c3d67db80>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:04.168640 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-82ec3a3d-46f9-4d73-80d3-2ac9772ed837 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] [instance: 19061153-9eed-4374-8799-b497b8a8e780] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:27:04.183122 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:27:04.253807 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-82ec3a3d-46f9-4d73-80d3-2ac9772ed837 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] 10.222.0.60 "DELETE /compute/v2.1/servers/19061153-9eed-4374-8799-b497b8a8e780" status: 204 len: 0 microversion: 2.1 time: 0.128104 Oct 18 15:27:04.254661 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 350/717] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:27:04 2022] DELETE /compute/v2.1/servers/19061153-9eed-4374-8799-b497b8a8e780 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:27:04.259941 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-edc13bfd-0f9b-415f-a632-1be25e4f3208 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:04.260710 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-edc13bfd-0f9b-415f-a632-1be25e4f3208 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 28a18615-ab69-4e8e-865c-b8e0b67a74f4] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:04.267646 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-edc13bfd-0f9b-415f-a632-1be25e4f3208 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:04.268143 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-edc13bfd-0f9b-415f-a632-1be25e4f3208 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:04.268932 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-edc13bfd-0f9b-415f-a632-1be25e4f3208 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:04.269834 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-edc13bfd-0f9b-415f-a632-1be25e4f3208 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:04.270526 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-edc13bfd-0f9b-415f-a632-1be25e4f3208 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:04.270892 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-edc13bfd-0f9b-415f-a632-1be25e4f3208 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:04.756716 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-edc13bfd-0f9b-415f-a632-1be25e4f3208 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:04.765749 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-edc13bfd-0f9b-415f-a632-1be25e4f3208 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:04.767419 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-edc13bfd-0f9b-415f-a632-1be25e4f3208 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:04.768777 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-edc13bfd-0f9b-415f-a632-1be25e4f3208 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4" status: 200 len: 1567 microversion: 2.25 time: 0.513026 Oct 18 15:27:04.769736 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 351/718] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:27:04 2022] GET /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4 => generated 1567 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:27:04.790096 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1afc2c24-4d75-42b0-ab9e-c38461fa36a3 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d848940>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:04.837769 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1afc2c24-4d75-42b0-ab9e-c38461fa36a3 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/4cacb5ef-8146-4f19-98d6-b6eb8e8d35e6" status: 200 len: 1412 microversion: 2.1 time: 0.066728 Oct 18 15:27:04.838330 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 352/719] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:27:04 2022] GET /compute/v2.1/images/4cacb5ef-8146-4f19-98d6-b6eb8e8d35e6 => generated 1412 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:04.843222 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a55422e5-e7fe-4ef4-9a26-a461fecb1851 tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] Calling method '.version_select at 0x7f7c3d86aa60>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:04.872785 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a6b7d377-2575-40bb-8a1f-38f9bc389504 tempest-SecurityGroupRulesNegativeTestJSON-422412145 tempest-SecurityGroupRulesNegativeTestJSON-422412145-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/3ff6fe47-8dea-424b-8766-406555817bda" status: 202 len: 0 microversion: 2.1 time: 0.733109 Oct 18 15:27:04.873914 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 368/720] 10.222.0.60 () {58 vars in 1272 bytes} [Tue Oct 18 15:27:04 2022] DELETE /compute/v2.1/os-security-groups/3ff6fe47-8dea-424b-8766-406555817bda => generated 0 bytes in 737 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:27:04.895077 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c77f68eb-42ee-4226-939e-755f7166152b tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:04.900798 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c77f68eb-42ee-4226-939e-755f7166152b tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: 21ed44b3-c1df-4099-a1ca-a8b167fc3890] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:04.922581 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c77f68eb-42ee-4226-939e-755f7166152b tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:04.923065 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c77f68eb-42ee-4226-939e-755f7166152b tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:04.928347 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c77f68eb-42ee-4226-939e-755f7166152b tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:04.928569 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a55422e5-e7fe-4ef4-9a26-a461fecb1851 tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/511d8234f077442aae12536f59ec4d44?user_id=f111eb55e00f4c86a450fb4b222159a8" status: 200 len: 370 microversion: 2.1 time: 0.088629 Oct 18 15:27:04.929132 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c77f68eb-42ee-4226-939e-755f7166152b tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:04.933671 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 353/721] 10.222.0.60 () {58 vars in 1323 bytes} [Tue Oct 18 15:27:04 2022] GET /compute/v2.1/os-quota-sets/511d8234f077442aae12536f59ec4d44?user_id=f111eb55e00f4c86a450fb4b222159a8 => generated 370 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:27:04.934110 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c77f68eb-42ee-4226-939e-755f7166152b tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:04.934631 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c77f68eb-42ee-4226-939e-755f7166152b tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:04.935741 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d106ef53-c813-445a-9a2a-2c6ba2f3d8ed tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1921675486", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "886281070", "adminPass": "***", "networks": [{"uuid": "362d67ce-7667-46f9-8752-c1903dc4553a"}], "security_groups": [{"name": "tempest-securitygroup--728836902"}], "key_name": "tempest-keypair-162482596", "user_data": "}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:27:05.114299 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c77f68eb-42ee-4226-939e-755f7166152b tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1023300147f463e8f0894981948f825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac07f1b2c83a4faab175a5b9ed8e315e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:05.124965 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c77f68eb-42ee-4226-939e-755f7166152b tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/21ed44b3-c1df-4099-a1ca-a8b167fc3890" status: 200 len: 1293 microversion: 2.1 time: 0.249114 Oct 18 15:27:05.126326 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 369/722] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:04 2022] GET /compute/v2.1/servers/21ed44b3-c1df-4099-a1ca-a8b167fc3890 => generated 1293 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:05.150845 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e8dfb12c-08b4-4d0e-ad35-5be0e3db035e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:05.154687 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e8dfb12c-08b4-4d0e-ad35-5be0e3db035e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:05.162936 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8dfb12c-08b4-4d0e-ad35-5be0e3db035e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:05.163776 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8dfb12c-08b4-4d0e-ad35-5be0e3db035e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:05.168260 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8dfb12c-08b4-4d0e-ad35-5be0e3db035e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:05.169394 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8dfb12c-08b4-4d0e-ad35-5be0e3db035e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:05.170220 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8dfb12c-08b4-4d0e-ad35-5be0e3db035e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:05.170907 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8dfb12c-08b4-4d0e-ad35-5be0e3db035e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:05.173829 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-d106ef53-c813-445a-9a2a-2c6ba2f3d8ed tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] validate_networks() for [('362d67ce-7667-46f9-8752-c1903dc4553a', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:27:05.511515 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e8dfb12c-08b4-4d0e-ad35-5be0e3db035e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:05.521223 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e8dfb12c-08b4-4d0e-ad35-5be0e3db035e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2" status: 200 len: 1360 microversion: 2.1 time: 0.378327 Oct 18 15:27:05.525891 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 370/723] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:05 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2 => generated 1360 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:05.530955 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-28b4098f-dd07-4a3e-84f9-dd261f43625c tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:05.536599 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-28b4098f-dd07-4a3e-84f9-dd261f43625c tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] [instance: aab97ea8-6772-407f-a9f9-60f05d27cbfb] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:05.548844 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-28b4098f-dd07-4a3e-84f9-dd261f43625c tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:05.553670 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-28b4098f-dd07-4a3e-84f9-dd261f43625c tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:05.555679 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-28b4098f-dd07-4a3e-84f9-dd261f43625c tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:05.556604 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-28b4098f-dd07-4a3e-84f9-dd261f43625c tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:05.559158 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-28b4098f-dd07-4a3e-84f9-dd261f43625c tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:05.559746 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-28b4098f-dd07-4a3e-84f9-dd261f43625c tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:06.094450 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-28b4098f-dd07-4a3e-84f9-dd261f43625c tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7357f1c14a544016bba5abeee15f7a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c87221eb94488ba2e0fdd41386b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:06.110243 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-28b4098f-dd07-4a3e-84f9-dd261f43625c tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] 10.222.0.60 "GET /compute/v2.1/servers/aab97ea8-6772-407f-a9f9-60f05d27cbfb" status: 200 len: 1321 microversion: 2.1 time: 0.582914 Oct 18 15:27:06.111573 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 371/724] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:05 2022] GET /compute/v2.1/servers/aab97ea8-6772-407f-a9f9-60f05d27cbfb => generated 1321 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:06.120187 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-741c76a8-ea05-45e9-bce2-06b28c810be2 tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] Calling method '.version_select at 0x7f7c3d64d040>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:06.220380 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-d106ef53-c813-445a-9a2a-2c6ba2f3d8ed tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:27:06.220948 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-d106ef53-c813-445a-9a2a-2c6ba2f3d8ed tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:27:06.221287 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-d106ef53-c813-445a-9a2a-2c6ba2f3d8ed tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:27:06.221696 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-d106ef53-c813-445a-9a2a-2c6ba2f3d8ed tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:27:06.222100 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-d106ef53-c813-445a-9a2a-2c6ba2f3d8ed tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:27:06.239446 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d106ef53-c813-445a-9a2a-2c6ba2f3d8ed tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:06.239931 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d106ef53-c813-445a-9a2a-2c6ba2f3d8ed tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:06.240366 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d106ef53-c813-445a-9a2a-2c6ba2f3d8ed tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:06.241121 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d106ef53-c813-445a-9a2a-2c6ba2f3d8ed tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:06.241743 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d106ef53-c813-445a-9a2a-2c6ba2f3d8ed tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:06.242342 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d106ef53-c813-445a-9a2a-2c6ba2f3d8ed tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:06.290753 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-d106ef53-c813-445a-9a2a-2c6ba2f3d8ed tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Getting quotas for project e6facda3e46640c884583aaf146a8b14. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:27:06.304581 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-d106ef53-c813-445a-9a2a-2c6ba2f3d8ed tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Getting quotas for user aa2bbb8b77794404af993e8291343afa and project e6facda3e46640c884583aaf146a8b14. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:27:06.317116 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:27:06.328658 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d106ef53-c813-445a-9a2a-2c6ba2f3d8ed tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:27:06.337169 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d106ef53-c813-445a-9a2a-2c6ba2f3d8ed tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] [instance: 22a2d6cf-565b-488b-8f9b-2b992b25cc32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:27:06.454978 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d106ef53-c813-445a-9a2a-2c6ba2f3d8ed tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.524051 Oct 18 15:27:06.455868 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 354/725] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:27:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 1526 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:27:06.466438 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-28467070-6976-4a54-993e-98730c0b0f68 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:06.470358 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-28467070-6976-4a54-993e-98730c0b0f68 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 28a18615-ab69-4e8e-865c-b8e0b67a74f4] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:06.489791 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-28467070-6976-4a54-993e-98730c0b0f68 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:06.490666 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-28467070-6976-4a54-993e-98730c0b0f68 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:06.491342 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-28467070-6976-4a54-993e-98730c0b0f68 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:06.492284 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-28467070-6976-4a54-993e-98730c0b0f68 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:06.492999 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-28467070-6976-4a54-993e-98730c0b0f68 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:06.493653 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-28467070-6976-4a54-993e-98730c0b0f68 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:06.603840 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-741c76a8-ea05-45e9-bce2-06b28c810be2 tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/bb2bc7fb769c40b1be67ab9b9e8b545c/defaults" status: 200 len: 371 microversion: 2.1 time: 0.490498 Oct 18 15:27:06.605163 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 372/726] 10.222.0.60 () {58 vars in 1269 bytes} [Tue Oct 18 15:27:06 2022] GET /compute/v2.1/os-quota-sets/bb2bc7fb769c40b1be67ab9b9e8b545c/defaults => generated 371 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:27:06.619333 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4fb6702f-6561-496a-a8af-d377c4e89203 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d679f70>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:06.712922 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4fb6702f-6561-496a-a8af-d377c4e89203 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/4cacb5ef-8146-4f19-98d6-b6eb8e8d35e6" status: 200 len: 1412 microversion: 2.1 time: 0.104300 Oct 18 15:27:06.714359 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 373/727] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:27:06 2022] GET /compute/v2.1/images/4cacb5ef-8146-4f19-98d6-b6eb8e8d35e6 => generated 1412 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:06.727138 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2fc28b41-5526-4240-ad2a-2f7600cd6559 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:06.727963 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2fc28b41-5526-4240-ad2a-2f7600cd6559 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: 21ed44b3-c1df-4099-a1ca-a8b167fc3890] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:06.735380 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2fc28b41-5526-4240-ad2a-2f7600cd6559 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:06.736194 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2fc28b41-5526-4240-ad2a-2f7600cd6559 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:06.736858 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2fc28b41-5526-4240-ad2a-2f7600cd6559 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:06.738419 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2fc28b41-5526-4240-ad2a-2f7600cd6559 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:06.739069 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2fc28b41-5526-4240-ad2a-2f7600cd6559 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:06.739675 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2fc28b41-5526-4240-ad2a-2f7600cd6559 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:06.873618 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2fc28b41-5526-4240-ad2a-2f7600cd6559 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1023300147f463e8f0894981948f825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac07f1b2c83a4faab175a5b9ed8e315e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:06.889846 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2fc28b41-5526-4240-ad2a-2f7600cd6559 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/21ed44b3-c1df-4099-a1ca-a8b167fc3890" status: 200 len: 1311 microversion: 2.1 time: 0.173723 Oct 18 15:27:06.890130 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 374/728] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:06 2022] GET /compute/v2.1/servers/21ed44b3-c1df-4099-a1ca-a8b167fc3890 => generated 1311 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:06.897013 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6d1e6b9f-2327-4332-bb24-07698b81279d tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:06.897622 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6d1e6b9f-2327-4332-bb24-07698b81279d tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] [instance: 22a2d6cf-565b-488b-8f9b-2b992b25cc32] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:07.031771 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6d1e6b9f-2327-4332-bb24-07698b81279d tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2bbb8b77794404af993e8291343afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6facda3e46640c884583aaf146a8b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:07.040935 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6d1e6b9f-2327-4332-bb24-07698b81279d tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] 10.222.0.60 "GET /compute/v2.1/servers/22a2d6cf-565b-488b-8f9b-2b992b25cc32" status: 200 len: 1262 microversion: 2.1 time: 0.149474 Oct 18 15:27:07.042247 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 375/729] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:06 2022] GET /compute/v2.1/servers/22a2d6cf-565b-488b-8f9b-2b992b25cc32 => generated 1262 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:07.047228 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9db53f4f-e726-432d-aa2b-a98c3f7ea2fa tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:07.048101 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9db53f4f-e726-432d-aa2b-a98c3f7ea2fa tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:07.048586 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-28467070-6976-4a54-993e-98730c0b0f68 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:07.055538 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9db53f4f-e726-432d-aa2b-a98c3f7ea2fa tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:07.056329 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9db53f4f-e726-432d-aa2b-a98c3f7ea2fa tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:07.056832 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-28467070-6976-4a54-993e-98730c0b0f68 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:07.058832 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-28467070-6976-4a54-993e-98730c0b0f68 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:07.068413 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9db53f4f-e726-432d-aa2b-a98c3f7ea2fa tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:07.070209 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-28467070-6976-4a54-993e-98730c0b0f68 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4" status: 200 len: 1567 microversion: 2.25 time: 0.612264 Oct 18 15:27:07.071034 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 355/730] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:27:06 2022] GET /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4 => generated 1567 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:27:07.071525 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9db53f4f-e726-432d-aa2b-a98c3f7ea2fa tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:07.072072 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9db53f4f-e726-432d-aa2b-a98c3f7ea2fa tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:07.072518 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9db53f4f-e726-432d-aa2b-a98c3f7ea2fa tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:07.084951 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a65bdb1f-cfef-450b-9b03-dff273a5533d tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] Action: 'update', calling method: .version_select at 0x7f7c3d74be50>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:27:07.181089 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a65bdb1f-cfef-450b-9b03-dff273a5533d tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:07.181583 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a65bdb1f-cfef-450b-9b03-dff273a5533d tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:07.182018 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a65bdb1f-cfef-450b-9b03-dff273a5533d tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:07.183327 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a65bdb1f-cfef-450b-9b03-dff273a5533d tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:07.183745 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a65bdb1f-cfef-450b-9b03-dff273a5533d tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:07.184339 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a65bdb1f-cfef-450b-9b03-dff273a5533d tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:07.545910 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a65bdb1f-cfef-450b-9b03-dff273a5533d tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/bb2bc7fb769c40b1be67ab9b9e8b545c" status: 200 len: 329 microversion: 2.1 time: 0.473153 Oct 18 15:27:07.546665 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 356/731] 10.222.0.60 () {60 vars in 1263 bytes} [Tue Oct 18 15:27:07 2022] PUT /compute/v2.1/os-quota-sets/bb2bc7fb769c40b1be67ab9b9e8b545c => generated 329 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:27:07.555789 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d3c213db-2852-465c-96fd-57dc6a312853 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:07.556679 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d3c213db-2852-465c-96fd-57dc6a312853 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] [instance: aab97ea8-6772-407f-a9f9-60f05d27cbfb] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:07.566662 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d3c213db-2852-465c-96fd-57dc6a312853 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:07.567333 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d3c213db-2852-465c-96fd-57dc6a312853 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:07.567864 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d3c213db-2852-465c-96fd-57dc6a312853 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:07.569027 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d3c213db-2852-465c-96fd-57dc6a312853 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:07.569546 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d3c213db-2852-465c-96fd-57dc6a312853 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:07.570065 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d3c213db-2852-465c-96fd-57dc6a312853 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:07.896156 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9db53f4f-e726-432d-aa2b-a98c3f7ea2fa tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:07.909682 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9db53f4f-e726-432d-aa2b-a98c3f7ea2fa tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2" status: 200 len: 1543 microversion: 2.1 time: 0.866134 Oct 18 15:27:07.916120 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 376/732] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:07 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2 => generated 1543 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:07.949734 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-162b0a7a-e898-4813-a9e6-479c80a2ad1c tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] Action: 'update', calling method: .version_select at 0x7f7c3d6fc280>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:27:08.074420 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-162b0a7a-e898-4813-a9e6-479c80a2ad1c tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:08.075224 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-162b0a7a-e898-4813-a9e6-479c80a2ad1c tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:08.075955 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-162b0a7a-e898-4813-a9e6-479c80a2ad1c tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:08.077169 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-162b0a7a-e898-4813-a9e6-479c80a2ad1c tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:08.077789 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-162b0a7a-e898-4813-a9e6-479c80a2ad1c tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:08.078596 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-162b0a7a-e898-4813-a9e6-479c80a2ad1c tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:08.113268 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=2,nova_api:DELETE=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:27:08.433717 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d3c213db-2852-465c-96fd-57dc6a312853 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7357f1c14a544016bba5abeee15f7a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c87221eb94488ba2e0fdd41386b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:08.503675 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d3c213db-2852-465c-96fd-57dc6a312853 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] 10.222.0.60 "GET /compute/v2.1/servers/aab97ea8-6772-407f-a9f9-60f05d27cbfb" status: 200 len: 1321 microversion: 2.1 time: 0.951853 Oct 18 15:27:08.512948 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 357/733] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:07 2022] GET /compute/v2.1/servers/aab97ea8-6772-407f-a9f9-60f05d27cbfb => generated 1321 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:08.530839 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5af2d91d-1d7a-49b2-884c-bded1ea353f8 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d754700>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:08.657755 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5af2d91d-1d7a-49b2-884c-bded1ea353f8 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/4cacb5ef-8146-4f19-98d6-b6eb8e8d35e6" status: 200 len: 1412 microversion: 2.1 time: 0.132514 Oct 18 15:27:08.658892 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 358/734] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:27:08 2022] GET /compute/v2.1/images/4cacb5ef-8146-4f19-98d6-b6eb8e8d35e6 => generated 1412 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:08.677266 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3dcfacb6-e9cf-44d8-b6fa-325fe1f87a7d tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:08.678044 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3dcfacb6-e9cf-44d8-b6fa-325fe1f87a7d tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: 21ed44b3-c1df-4099-a1ca-a8b167fc3890] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:08.710936 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3dcfacb6-e9cf-44d8-b6fa-325fe1f87a7d tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:08.711333 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3dcfacb6-e9cf-44d8-b6fa-325fe1f87a7d tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:08.711783 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3dcfacb6-e9cf-44d8-b6fa-325fe1f87a7d tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:08.726317 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3dcfacb6-e9cf-44d8-b6fa-325fe1f87a7d tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:08.727106 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3dcfacb6-e9cf-44d8-b6fa-325fe1f87a7d tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:08.727680 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3dcfacb6-e9cf-44d8-b6fa-325fe1f87a7d tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:08.736296 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-162b0a7a-e898-4813-a9e6-479c80a2ad1c tempest-QuotasAdminTestJSON-722131075 tempest-QuotasAdminTestJSON-722131075-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/bb2bc7fb769c40b1be67ab9b9e8b545c" status: 200 len: 329 microversion: 2.1 time: 0.818499 Oct 18 15:27:08.742021 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 377/735] 10.222.0.60 () {60 vars in 1263 bytes} [Tue Oct 18 15:27:07 2022] PUT /compute/v2.1/os-quota-sets/bb2bc7fb769c40b1be67ab9b9e8b545c => generated 329 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:27:08.754551 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-752b7efc-3d2d-413b-960d-0c0d420c149c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:08.759303 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-752b7efc-3d2d-413b-960d-0c0d420c149c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:08.779475 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-752b7efc-3d2d-413b-960d-0c0d420c149c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:08.782649 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-752b7efc-3d2d-413b-960d-0c0d420c149c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:08.789875 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-752b7efc-3d2d-413b-960d-0c0d420c149c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:08.791758 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-752b7efc-3d2d-413b-960d-0c0d420c149c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:08.792889 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-752b7efc-3d2d-413b-960d-0c0d420c149c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:08.793677 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-752b7efc-3d2d-413b-960d-0c0d420c149c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:09.107129 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-752b7efc-3d2d-413b-960d-0c0d420c149c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.363598 Oct 18 15:27:09.108895 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 378/736] 10.222.0.60 () {58 vars in 1275 bytes} [Tue Oct 18 15:27:08 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2/os-interface => generated 285 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:27:09.114870 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-01eedf21-e24f-49a9-a516-5482f75104d3 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:09.118390 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-01eedf21-e24f-49a9-a516-5482f75104d3 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] [instance: 22a2d6cf-565b-488b-8f9b-2b992b25cc32] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:09.142430 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01eedf21-e24f-49a9-a516-5482f75104d3 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:09.144598 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01eedf21-e24f-49a9-a516-5482f75104d3 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:09.146766 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01eedf21-e24f-49a9-a516-5482f75104d3 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:09.151092 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01eedf21-e24f-49a9-a516-5482f75104d3 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:09.151703 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01eedf21-e24f-49a9-a516-5482f75104d3 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:09.158032 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01eedf21-e24f-49a9-a516-5482f75104d3 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:10.239779 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-01eedf21-e24f-49a9-a516-5482f75104d3 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2bbb8b77794404af993e8291343afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6facda3e46640c884583aaf146a8b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:10.271294 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-01eedf21-e24f-49a9-a516-5482f75104d3 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] 10.222.0.60 "GET /compute/v2.1/servers/22a2d6cf-565b-488b-8f9b-2b992b25cc32" status: 200 len: 1332 microversion: 2.1 time: 1.161220 Oct 18 15:27:10.274583 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 379/737] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:09 2022] GET /compute/v2.1/servers/22a2d6cf-565b-488b-8f9b-2b992b25cc32 => generated 1332 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:10.299629 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3dcfacb6-e9cf-44d8-b6fa-325fe1f87a7d tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1023300147f463e8f0894981948f825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac07f1b2c83a4faab175a5b9ed8e315e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:10.302997 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4301c654-e98c-41d5-b4e9-41fc70a5fe88 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:10.305900 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4301c654-e98c-41d5-b4e9-41fc70a5fe88 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 28a18615-ab69-4e8e-865c-b8e0b67a74f4] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:10.315984 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3dcfacb6-e9cf-44d8-b6fa-325fe1f87a7d tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/21ed44b3-c1df-4099-a1ca-a8b167fc3890" status: 200 len: 1299 microversion: 2.1 time: 1.653559 Oct 18 15:27:10.321193 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 359/738] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:08 2022] GET /compute/v2.1/servers/21ed44b3-c1df-4099-a1ca-a8b167fc3890 => generated 1299 bytes in 1662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:10.329300 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4301c654-e98c-41d5-b4e9-41fc70a5fe88 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:10.329790 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4301c654-e98c-41d5-b4e9-41fc70a5fe88 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:10.330220 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4301c654-e98c-41d5-b4e9-41fc70a5fe88 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:10.330925 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4301c654-e98c-41d5-b4e9-41fc70a5fe88 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:10.331378 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4301c654-e98c-41d5-b4e9-41fc70a5fe88 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:10.331802 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4301c654-e98c-41d5-b4e9-41fc70a5fe88 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:10.334946 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-cbdc21dd-e08a-4eb8-a520-96121209ee4c req-0e3600cf-1771-49c9-8ccf-ac1a8b42fa54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19061153-9eed-4374-8799-b497b8a8e780", "name": "network-vif-deleted", "tag": "8d08d8f8-c7dc-4676-8853-5174b27e7ce8"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:27:10.368614 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-cbdc21dd-e08a-4eb8-a520-96121209ee4c req-0e3600cf-1771-49c9-8ccf-ac1a8b42fa54 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:10.369176 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-cbdc21dd-e08a-4eb8-a520-96121209ee4c req-0e3600cf-1771-49c9-8ccf-ac1a8b42fa54 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:10.369646 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-cbdc21dd-e08a-4eb8-a520-96121209ee4c req-0e3600cf-1771-49c9-8ccf-ac1a8b42fa54 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:10.410784 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-cbdc21dd-e08a-4eb8-a520-96121209ee4c req-0e3600cf-1771-49c9-8ccf-ac1a8b42fa54 service nova] Creating event network-vif-deleted:8d08d8f8-c7dc-4676-8853-5174b27e7ce8 for instance 19061153-9eed-4374-8799-b497b8a8e780 on n-h2-853682-5 Oct 18 15:27:10.427054 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-cbdc21dd-e08a-4eb8-a520-96121209ee4c req-0e3600cf-1771-49c9-8ccf-ac1a8b42fa54 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101589 Oct 18 15:27:10.428463 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 360/739] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:27:10.444285 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1e0700f3-445b-49f6-8395-e33efe1966a4 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:10.448416 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1e0700f3-445b-49f6-8395-e33efe1966a4 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] [instance: aab97ea8-6772-407f-a9f9-60f05d27cbfb] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:10.466397 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1e0700f3-445b-49f6-8395-e33efe1966a4 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:10.468787 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1e0700f3-445b-49f6-8395-e33efe1966a4 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:10.469455 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1e0700f3-445b-49f6-8395-e33efe1966a4 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:10.472385 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1e0700f3-445b-49f6-8395-e33efe1966a4 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:10.473090 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1e0700f3-445b-49f6-8395-e33efe1966a4 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:10.473691 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1e0700f3-445b-49f6-8395-e33efe1966a4 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:10.909157 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4301c654-e98c-41d5-b4e9-41fc70a5fe88 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:10.922267 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4301c654-e98c-41d5-b4e9-41fc70a5fe88 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:10.925910 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4301c654-e98c-41d5-b4e9-41fc70a5fe88 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:10.928628 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4301c654-e98c-41d5-b4e9-41fc70a5fe88 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4" status: 200 len: 1542 microversion: 2.25 time: 0.649642 Oct 18 15:27:10.950163 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 380/740] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:27:10 2022] GET /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4 => generated 1542 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:27:10.956512 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-184d12c7-32d9-49bf-a17d-40732236ca40 req-6b192925-0b06-479d-998d-6d4d4aef0fef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f07f6211-dd0e-4bdd-969c-fff2c3633dd0", "name": "network-vif-plugged", "status": "completed", "tag": "e96c8294-ebda-4535-aedc-4d4ece4fa197"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:27:10.976965 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-184d12c7-32d9-49bf-a17d-40732236ca40 req-6b192925-0b06-479d-998d-6d4d4aef0fef service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:10.977531 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-184d12c7-32d9-49bf-a17d-40732236ca40 req-6b192925-0b06-479d-998d-6d4d4aef0fef service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:10.978118 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-184d12c7-32d9-49bf-a17d-40732236ca40 req-6b192925-0b06-479d-998d-6d4d4aef0fef service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:11.003022 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-184d12c7-32d9-49bf-a17d-40732236ca40 req-6b192925-0b06-479d-998d-6d4d4aef0fef service nova] Creating event network-vif-plugged:e96c8294-ebda-4535-aedc-4d4ece4fa197 for instance f07f6211-dd0e-4bdd-969c-fff2c3633dd0 on n-h1-853682-5 Oct 18 15:27:11.012688 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-184d12c7-32d9-49bf-a17d-40732236ca40 req-6b192925-0b06-479d-998d-6d4d4aef0fef service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061231 Oct 18 15:27:11.013523 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 381/741] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:27:11.022738 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1e0700f3-445b-49f6-8395-e33efe1966a4 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7357f1c14a544016bba5abeee15f7a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c87221eb94488ba2e0fdd41386b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:11.027999 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-43d7b5ea-d3cf-4c95-8d22-20a532a7d34b tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d69da60>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:11.038291 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1e0700f3-445b-49f6-8395-e33efe1966a4 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] 10.222.0.60 "GET /compute/v2.1/servers/aab97ea8-6772-407f-a9f9-60f05d27cbfb" status: 200 len: 1321 microversion: 2.1 time: 0.607119 Oct 18 15:27:11.039672 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 361/742] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:10 2022] GET /compute/v2.1/servers/aab97ea8-6772-407f-a9f9-60f05d27cbfb => generated 1321 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:11.054380 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-2740006d-142e-4711-a1cd-32c9641ad891 req-ae81faed-3b7b-487e-8822-ba3c667e73f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aab97ea8-6772-407f-a9f9-60f05d27cbfb", "tag": "265155be-790e-460e-bb12-369a3b6831f8"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:27:11.075676 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-2740006d-142e-4711-a1cd-32c9641ad891 req-ae81faed-3b7b-487e-8822-ba3c667e73f1 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:11.080047 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-2740006d-142e-4711-a1cd-32c9641ad891 req-ae81faed-3b7b-487e-8822-ba3c667e73f1 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:11.080725 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-2740006d-142e-4711-a1cd-32c9641ad891 req-ae81faed-3b7b-487e-8822-ba3c667e73f1 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:11.103527 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-2740006d-142e-4711-a1cd-32c9641ad891 req-ae81faed-3b7b-487e-8822-ba3c667e73f1 service nova] Creating event network-changed:265155be-790e-460e-bb12-369a3b6831f8 for instance aab97ea8-6772-407f-a9f9-60f05d27cbfb on n-h1-853682-5 Oct 18 15:27:11.114398 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-2740006d-142e-4711-a1cd-32c9641ad891 req-ae81faed-3b7b-487e-8822-ba3c667e73f1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073261 Oct 18 15:27:11.117767 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 362/743] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:27:11.129706 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e2bd0bf7-b29d-4e0e-94c8-c62f1e8daadb tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Calling method '.version_select at 0x7f7c3d74bdc0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:11.135575 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-43d7b5ea-d3cf-4c95-8d22-20a532a7d34b tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/4cacb5ef-8146-4f19-98d6-b6eb8e8d35e6" status: 200 len: 1412 microversion: 2.1 time: 0.120973 Oct 18 15:27:11.141285 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e2bd0bf7-b29d-4e0e-94c8-c62f1e8daadb tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:11.142281 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e2bd0bf7-b29d-4e0e-94c8-c62f1e8daadb tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:11.142840 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e2bd0bf7-b29d-4e0e-94c8-c62f1e8daadb tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:11.145969 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 382/744] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:27:11 2022] GET /compute/v2.1/images/4cacb5ef-8146-4f19-98d6-b6eb8e8d35e6 => generated 1412 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:11.176606 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e2bd0bf7-b29d-4e0e-94c8-c62f1e8daadb tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] 10.222.0.60 "GET /compute/v2.1/os-migrations" status: 200 len: 1696 microversion: 2.25 time: 0.055854 Oct 18 15:27:11.178589 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 363/745] 10.222.0.60 () {60 vars in 1184 bytes} [Tue Oct 18 15:27:11 2022] GET /compute/v2.1/os-migrations => generated 1696 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:27:11.199510 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bf37fe35-f1ca-4536-bbfe-6f47f1a1b9ba tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:11.201975 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bf37fe35-f1ca-4536-bbfe-6f47f1a1b9ba tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] [instance: 28a18615-ab69-4e8e-865c-b8e0b67a74f4] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:11.247944 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf37fe35-f1ca-4536-bbfe-6f47f1a1b9ba tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:11.248571 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf37fe35-f1ca-4536-bbfe-6f47f1a1b9ba tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:11.252988 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf37fe35-f1ca-4536-bbfe-6f47f1a1b9ba tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:11.255504 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf37fe35-f1ca-4536-bbfe-6f47f1a1b9ba tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:11.256094 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf37fe35-f1ca-4536-bbfe-6f47f1a1b9ba tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:11.256545 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf37fe35-f1ca-4536-bbfe-6f47f1a1b9ba tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:11.301236 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f05995db-fa88-411b-9ad0-8bc40cc15c69 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:11.301977 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f05995db-fa88-411b-9ad0-8bc40cc15c69 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] [instance: 22a2d6cf-565b-488b-8f9b-2b992b25cc32] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:11.309967 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f05995db-fa88-411b-9ad0-8bc40cc15c69 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:11.310461 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f05995db-fa88-411b-9ad0-8bc40cc15c69 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:11.310906 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f05995db-fa88-411b-9ad0-8bc40cc15c69 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:11.320497 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f05995db-fa88-411b-9ad0-8bc40cc15c69 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:11.323920 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f05995db-fa88-411b-9ad0-8bc40cc15c69 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:11.324408 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f05995db-fa88-411b-9ad0-8bc40cc15c69 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:11.714517 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f05995db-fa88-411b-9ad0-8bc40cc15c69 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2bbb8b77794404af993e8291343afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6facda3e46640c884583aaf146a8b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:11.739688 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f05995db-fa88-411b-9ad0-8bc40cc15c69 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] 10.222.0.60 "GET /compute/v2.1/servers/22a2d6cf-565b-488b-8f9b-2b992b25cc32" status: 200 len: 1320 microversion: 2.1 time: 0.441205 Oct 18 15:27:11.741465 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 364/746] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:11 2022] GET /compute/v2.1/servers/22a2d6cf-565b-488b-8f9b-2b992b25cc32 => generated 1320 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:11.747256 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-014848dc-0d36-4b9a-9347-51f058699d37 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:11.749950 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-014848dc-0d36-4b9a-9347-51f058699d37 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: 21ed44b3-c1df-4099-a1ca-a8b167fc3890] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:11.764328 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-014848dc-0d36-4b9a-9347-51f058699d37 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:11.766035 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-014848dc-0d36-4b9a-9347-51f058699d37 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:11.766933 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-014848dc-0d36-4b9a-9347-51f058699d37 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:11.767884 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-014848dc-0d36-4b9a-9347-51f058699d37 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:11.768691 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-014848dc-0d36-4b9a-9347-51f058699d37 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:11.769867 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-014848dc-0d36-4b9a-9347-51f058699d37 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:12.497509 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-014848dc-0d36-4b9a-9347-51f058699d37 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1023300147f463e8f0894981948f825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac07f1b2c83a4faab175a5b9ed8e315e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:12.507277 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-014848dc-0d36-4b9a-9347-51f058699d37 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/21ed44b3-c1df-4099-a1ca-a8b167fc3890" status: 200 len: 1299 microversion: 2.1 time: 0.764508 Oct 18 15:27:12.511839 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 365/747] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:11 2022] GET /compute/v2.1/servers/21ed44b3-c1df-4099-a1ca-a8b167fc3890 => generated 1299 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:12.520615 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7924b6d4-5c21-4922-8514-a2b9abf456b5 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:12.525153 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7924b6d4-5c21-4922-8514-a2b9abf456b5 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] [instance: aab97ea8-6772-407f-a9f9-60f05d27cbfb] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:12.547701 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7924b6d4-5c21-4922-8514-a2b9abf456b5 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:12.548222 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7924b6d4-5c21-4922-8514-a2b9abf456b5 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:12.548670 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7924b6d4-5c21-4922-8514-a2b9abf456b5 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:12.550954 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7924b6d4-5c21-4922-8514-a2b9abf456b5 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:12.555379 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7924b6d4-5c21-4922-8514-a2b9abf456b5 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:12.556122 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7924b6d4-5c21-4922-8514-a2b9abf456b5 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:12.765368 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-bf37fe35-f1ca-4536-bbfe-6f47f1a1b9ba tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lazy-loading 'services' on Instance uuid 28a18615-ab69-4e8e-865c-b8e0b67a74f4 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:27:12.803202 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bf37fe35-f1ca-4536-bbfe-6f47f1a1b9ba tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4" status: 200 len: 2035 microversion: 2.25 time: 1.610759 Oct 18 15:27:12.805002 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 383/748] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:27:11 2022] GET /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4 => generated 2035 bytes in 1616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:27:12.827419 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8300ed2c-cc4b-4cf2-b6c9-8f88cc8633f1 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d7d1a60>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:12.898652 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8300ed2c-cc4b-4cf2-b6c9-8f88cc8633f1 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/4cacb5ef-8146-4f19-98d6-b6eb8e8d35e6" status: 200 len: 1412 microversion: 2.1 time: 0.092051 Oct 18 15:27:12.902183 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 384/749] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:27:12 2022] GET /compute/v2.1/images/4cacb5ef-8146-4f19-98d6-b6eb8e8d35e6 => generated 1412 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:12.914850 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d221708a-cd31-4caf-85c2-2f221456e235 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:12.917902 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d221708a-cd31-4caf-85c2-2f221456e235 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] [instance: 22a2d6cf-565b-488b-8f9b-2b992b25cc32] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:12.933060 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d221708a-cd31-4caf-85c2-2f221456e235 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:12.933605 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d221708a-cd31-4caf-85c2-2f221456e235 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:12.934334 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d221708a-cd31-4caf-85c2-2f221456e235 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:12.940134 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d221708a-cd31-4caf-85c2-2f221456e235 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:12.942967 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d221708a-cd31-4caf-85c2-2f221456e235 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:12.944964 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d221708a-cd31-4caf-85c2-2f221456e235 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:13.824509 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7924b6d4-5c21-4922-8514-a2b9abf456b5 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7357f1c14a544016bba5abeee15f7a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c87221eb94488ba2e0fdd41386b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:13.830542 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d221708a-cd31-4caf-85c2-2f221456e235 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2bbb8b77794404af993e8291343afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6facda3e46640c884583aaf146a8b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:13.844928 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d221708a-cd31-4caf-85c2-2f221456e235 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] 10.222.0.60 "GET /compute/v2.1/servers/22a2d6cf-565b-488b-8f9b-2b992b25cc32" status: 200 len: 1387 microversion: 2.1 time: 0.941437 Oct 18 15:27:13.845394 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7924b6d4-5c21-4922-8514-a2b9abf456b5 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] 10.222.0.60 "GET /compute/v2.1/servers/aab97ea8-6772-407f-a9f9-60f05d27cbfb" status: 200 len: 1321 microversion: 2.1 time: 1.329641 Oct 18 15:27:13.857222 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 385/750] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:12 2022] GET /compute/v2.1/servers/22a2d6cf-565b-488b-8f9b-2b992b25cc32 => generated 1387 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:13.858788 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 366/751] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:12 2022] GET /compute/v2.1/servers/aab97ea8-6772-407f-a9f9-60f05d27cbfb => generated 1321 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:13.875011 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eac1f2a1-2250-4d3e-abfa-4c0d0f45ed0d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Action: 'create', calling method: .version_select at 0x7f7c3d67d040>, body: {"keypair": {"name": "tempest-keypair-1635577822", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBspCTQg149tSrcasKjzRypCjJFJlXfyZ2QxXBcSCfMl7r4n2mqjMQ2oX/WtxAiq/pbTFj+O28vYAwJ8p77NM9Gzdpor+5Pnk68/fc9R/e8D/tozGu7CX7NQ+R70atwi5w=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:27:13.885597 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0539ed0f-3331-448e-b7b7-c6616fbcf0c9 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:13.886426 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0539ed0f-3331-448e-b7b7-c6616fbcf0c9 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: 21ed44b3-c1df-4099-a1ca-a8b167fc3890] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:13.913207 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0539ed0f-3331-448e-b7b7-c6616fbcf0c9 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:13.914198 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0539ed0f-3331-448e-b7b7-c6616fbcf0c9 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:13.915753 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0539ed0f-3331-448e-b7b7-c6616fbcf0c9 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:13.922108 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0539ed0f-3331-448e-b7b7-c6616fbcf0c9 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:13.925183 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0539ed0f-3331-448e-b7b7-c6616fbcf0c9 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:13.926021 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0539ed0f-3331-448e-b7b7-c6616fbcf0c9 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:13.934078 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-eac1f2a1-2250-4d3e-abfa-4c0d0f45ed0d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Getting quotas for project bb0579704a194ef89144af0973d68f42. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:27:13.961934 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-eac1f2a1-2250-4d3e-abfa-4c0d0f45ed0d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Getting quotas for user 51490cfdebda47a7b8349677e4d61a59 and project bb0579704a194ef89144af0973d68f42. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:27:14.043236 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-eac1f2a1-2250-4d3e-abfa-4c0d0f45ed0d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.191962 Oct 18 15:27:14.046794 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 386/752] 10.222.0.60 () {62 vars in 1200 bytes} [Tue Oct 18 15:27:13 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 196 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 18 15:27:14.057925 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f2e24f78-5885-48e5-ba0c-0db406026ecf tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d6003a0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:14.137149 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f2e24f78-5885-48e5-ba0c-0db406026ecf tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/4cacb5ef-8146-4f19-98d6-b6eb8e8d35e6" status: 200 len: 1412 microversion: 2.1 time: 0.088394 Oct 18 15:27:14.141268 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 387/753] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:27:14 2022] GET /compute/v2.1/images/4cacb5ef-8146-4f19-98d6-b6eb8e8d35e6 => generated 1412 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:14.355563 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-e8819230-c228-4fe8-9faf-c4ff1cd80b3a req-1c0c0ddd-07d8-44d9-b960-9d860c2de9b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0a3feae-1805-4c09-881b-99dd257bd9c2", "tag": "e6a47323-8aa2-4713-af2b-48bb88888044"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:27:14.378240 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e8819230-c228-4fe8-9faf-c4ff1cd80b3a req-1c0c0ddd-07d8-44d9-b960-9d860c2de9b5 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:14.379135 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e8819230-c228-4fe8-9faf-c4ff1cd80b3a req-1c0c0ddd-07d8-44d9-b960-9d860c2de9b5 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:14.379793 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e8819230-c228-4fe8-9faf-c4ff1cd80b3a req-1c0c0ddd-07d8-44d9-b960-9d860c2de9b5 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:14.403047 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-e8819230-c228-4fe8-9faf-c4ff1cd80b3a req-1c0c0ddd-07d8-44d9-b960-9d860c2de9b5 service nova] Creating event network-changed:e6a47323-8aa2-4713-af2b-48bb88888044 for instance a0a3feae-1805-4c09-881b-99dd257bd9c2 on n-h1-853682-5 Oct 18 15:27:14.420544 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-e8819230-c228-4fe8-9faf-c4ff1cd80b3a req-1c0c0ddd-07d8-44d9-b960-9d860c2de9b5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069381 Oct 18 15:27:14.421550 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 388/754] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:27:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:27:14.581045 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0539ed0f-3331-448e-b7b7-c6616fbcf0c9 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1023300147f463e8f0894981948f825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac07f1b2c83a4faab175a5b9ed8e315e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:14.597379 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0539ed0f-3331-448e-b7b7-c6616fbcf0c9 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/21ed44b3-c1df-4099-a1ca-a8b167fc3890" status: 200 len: 1367 microversion: 2.1 time: 0.736962 Oct 18 15:27:14.598954 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 367/755] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:13 2022] GET /compute/v2.1/servers/21ed44b3-c1df-4099-a1ca-a8b167fc3890 => generated 1367 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:14.874785 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eccac689-78c7-41e9-aad9-0f274ad13d02 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:14.875503 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-eccac689-78c7-41e9-aad9-0f274ad13d02 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] [instance: 22a2d6cf-565b-488b-8f9b-2b992b25cc32] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:14.887745 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8300899c-b712-4104-8cb8-b35bbc9414a7 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:14.889254 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8300899c-b712-4104-8cb8-b35bbc9414a7 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] [instance: aab97ea8-6772-407f-a9f9-60f05d27cbfb] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:14.904064 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eccac689-78c7-41e9-aad9-0f274ad13d02 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:14.906888 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8300899c-b712-4104-8cb8-b35bbc9414a7 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:14.907755 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8300899c-b712-4104-8cb8-b35bbc9414a7 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:14.908251 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eccac689-78c7-41e9-aad9-0f274ad13d02 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:14.908903 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eccac689-78c7-41e9-aad9-0f274ad13d02 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:14.909719 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8300899c-b712-4104-8cb8-b35bbc9414a7 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:14.911984 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eccac689-78c7-41e9-aad9-0f274ad13d02 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:14.912461 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eccac689-78c7-41e9-aad9-0f274ad13d02 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:14.913048 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eccac689-78c7-41e9-aad9-0f274ad13d02 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:14.917683 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8300899c-b712-4104-8cb8-b35bbc9414a7 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:14.918235 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8300899c-b712-4104-8cb8-b35bbc9414a7 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:14.918606 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8300899c-b712-4104-8cb8-b35bbc9414a7 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:15.826761 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-eccac689-78c7-41e9-aad9-0f274ad13d02 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2bbb8b77794404af993e8291343afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6facda3e46640c884583aaf146a8b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:15.842020 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-eccac689-78c7-41e9-aad9-0f274ad13d02 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] 10.222.0.60 "GET /compute/v2.1/servers/22a2d6cf-565b-488b-8f9b-2b992b25cc32" status: 200 len: 1387 microversion: 2.1 time: 0.971888 Oct 18 15:27:15.845083 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 389/756] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:14 2022] GET /compute/v2.1/servers/22a2d6cf-565b-488b-8f9b-2b992b25cc32 => generated 1387 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:15.855933 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-949970ab-74b7-42bf-b792-d00f27f92b24 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d6fc280>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:15.953057 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-949970ab-74b7-42bf-b792-d00f27f92b24 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/4cacb5ef-8146-4f19-98d6-b6eb8e8d35e6" status: 200 len: 1412 microversion: 2.1 time: 0.106457 Oct 18 15:27:15.954289 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 390/757] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:27:15 2022] GET /compute/v2.1/images/4cacb5ef-8146-4f19-98d6-b6eb8e8d35e6 => generated 1412 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:15.965552 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-caaecc2e-7896-40b2-953c-0614c1e5aeb4 req-c3e2edd0-a36f-4f1c-90b7-62831ba50f04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22a2d6cf-565b-488b-8f9b-2b992b25cc32", "tag": "92ddf833-9eb5-4dca-a962-d9a729856784"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:27:15.997255 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-caaecc2e-7896-40b2-953c-0614c1e5aeb4 req-c3e2edd0-a36f-4f1c-90b7-62831ba50f04 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:15.998308 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-caaecc2e-7896-40b2-953c-0614c1e5aeb4 req-c3e2edd0-a36f-4f1c-90b7-62831ba50f04 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:15.999014 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-caaecc2e-7896-40b2-953c-0614c1e5aeb4 req-c3e2edd0-a36f-4f1c-90b7-62831ba50f04 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:16.027394 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-caaecc2e-7896-40b2-953c-0614c1e5aeb4 req-c3e2edd0-a36f-4f1c-90b7-62831ba50f04 service nova] Creating event network-changed:92ddf833-9eb5-4dca-a962-d9a729856784 for instance 22a2d6cf-565b-488b-8f9b-2b992b25cc32 on n-h2-853682-5 Oct 18 15:27:16.042947 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-caaecc2e-7896-40b2-953c-0614c1e5aeb4 req-c3e2edd0-a36f-4f1c-90b7-62831ba50f04 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087411 Oct 18 15:27:16.051119 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 391/758] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:27:16.061318 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-36667128-2572-45bb-8178-cfeb814fd3f0 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:16.065112 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-36667128-2572-45bb-8178-cfeb814fd3f0 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: 21ed44b3-c1df-4099-a1ca-a8b167fc3890] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:16.083475 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36667128-2572-45bb-8178-cfeb814fd3f0 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:16.085363 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36667128-2572-45bb-8178-cfeb814fd3f0 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:16.091588 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36667128-2572-45bb-8178-cfeb814fd3f0 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:16.092522 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36667128-2572-45bb-8178-cfeb814fd3f0 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:16.094054 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36667128-2572-45bb-8178-cfeb814fd3f0 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:16.095006 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36667128-2572-45bb-8178-cfeb814fd3f0 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:16.097279 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8300899c-b712-4104-8cb8-b35bbc9414a7 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7357f1c14a544016bba5abeee15f7a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c87221eb94488ba2e0fdd41386b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:16.117439 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8300899c-b712-4104-8cb8-b35bbc9414a7 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] 10.222.0.60 "GET /compute/v2.1/servers/aab97ea8-6772-407f-a9f9-60f05d27cbfb" status: 200 len: 1321 microversion: 2.1 time: 1.225558 Oct 18 15:27:16.119781 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 368/759] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:14 2022] GET /compute/v2.1/servers/aab97ea8-6772-407f-a9f9-60f05d27cbfb => generated 1321 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:16.871268 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-980f8c6d-f0a1-452b-9b02-38e2f5024c8c tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:16.872135 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-980f8c6d-f0a1-452b-9b02-38e2f5024c8c tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] [instance: 22a2d6cf-565b-488b-8f9b-2b992b25cc32] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:16.884990 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-980f8c6d-f0a1-452b-9b02-38e2f5024c8c tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:16.886379 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-980f8c6d-f0a1-452b-9b02-38e2f5024c8c tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:16.887020 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-980f8c6d-f0a1-452b-9b02-38e2f5024c8c tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:16.887956 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-980f8c6d-f0a1-452b-9b02-38e2f5024c8c tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:16.892860 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-980f8c6d-f0a1-452b-9b02-38e2f5024c8c tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:16.893722 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-980f8c6d-f0a1-452b-9b02-38e2f5024c8c tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:17.194201 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=15 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:27:17.533778 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=78 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:27:17.738995 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-36667128-2572-45bb-8178-cfeb814fd3f0 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1023300147f463e8f0894981948f825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac07f1b2c83a4faab175a5b9ed8e315e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:17.748477 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-36667128-2572-45bb-8178-cfeb814fd3f0 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/21ed44b3-c1df-4099-a1ca-a8b167fc3890" status: 200 len: 1367 microversion: 2.1 time: 1.695884 Oct 18 15:27:17.749388 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 392/760] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:16 2022] GET /compute/v2.1/servers/21ed44b3-c1df-4099-a1ca-a8b167fc3890 => generated 1367 bytes in 1698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:17.755598 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f1f49ba4-8a1b-404c-a8c9-871f5b0daac8 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d6b7b80>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:17.836772 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f1f49ba4-8a1b-404c-a8c9-871f5b0daac8 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/4cacb5ef-8146-4f19-98d6-b6eb8e8d35e6" status: 200 len: 1412 microversion: 2.1 time: 0.084635 Oct 18 15:27:17.837990 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 393/761] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:27:17 2022] GET /compute/v2.1/images/4cacb5ef-8146-4f19-98d6-b6eb8e8d35e6 => generated 1412 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:17.843720 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c3d81f15-f69a-41de-beef-158c1ee4d10e tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:17.844397 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c3d81f15-f69a-41de-beef-158c1ee4d10e tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] [instance: aab97ea8-6772-407f-a9f9-60f05d27cbfb] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:17.851908 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3d81f15-f69a-41de-beef-158c1ee4d10e tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:17.852404 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3d81f15-f69a-41de-beef-158c1ee4d10e tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:17.853294 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3d81f15-f69a-41de-beef-158c1ee4d10e tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:17.853563 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3d81f15-f69a-41de-beef-158c1ee4d10e tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:17.854627 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3d81f15-f69a-41de-beef-158c1ee4d10e tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:17.855057 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3d81f15-f69a-41de-beef-158c1ee4d10e tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:18.107159 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:27:18.210790 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-980f8c6d-f0a1-452b-9b02-38e2f5024c8c tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2bbb8b77794404af993e8291343afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6facda3e46640c884583aaf146a8b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:18.229973 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-980f8c6d-f0a1-452b-9b02-38e2f5024c8c tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] 10.222.0.60 "GET /compute/v2.1/servers/22a2d6cf-565b-488b-8f9b-2b992b25cc32" status: 200 len: 1387 microversion: 2.1 time: 1.359941 Oct 18 15:27:18.233339 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 369/762] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:16 2022] GET /compute/v2.1/servers/22a2d6cf-565b-488b-8f9b-2b992b25cc32 => generated 1387 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:18.256260 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-a0ef6589-5014-4b57-870f-82b30a29e2f6 req-26879f8a-7dc1-45da-8aa7-d8ca8b569552 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21ed44b3-c1df-4099-a1ca-a8b167fc3890", "tag": "aa57d87b-6f22-4cfc-9682-ac41b5b434a1"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:27:18.280615 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-a0ef6589-5014-4b57-870f-82b30a29e2f6 req-26879f8a-7dc1-45da-8aa7-d8ca8b569552 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:18.281102 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-a0ef6589-5014-4b57-870f-82b30a29e2f6 req-26879f8a-7dc1-45da-8aa7-d8ca8b569552 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:18.281667 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-a0ef6589-5014-4b57-870f-82b30a29e2f6 req-26879f8a-7dc1-45da-8aa7-d8ca8b569552 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:18.312011 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-a0ef6589-5014-4b57-870f-82b30a29e2f6 req-26879f8a-7dc1-45da-8aa7-d8ca8b569552 service nova] Creating event network-changed:aa57d87b-6f22-4cfc-9682-ac41b5b434a1 for instance 21ed44b3-c1df-4099-a1ca-a8b167fc3890 on n-h2-853682-5 Oct 18 15:27:18.328310 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-a0ef6589-5014-4b57-870f-82b30a29e2f6 req-26879f8a-7dc1-45da-8aa7-d8ca8b569552 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093289 Oct 18 15:27:18.330238 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 370/763] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:27:18.761406 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e3db6d27-d3ec-41a1-a276-c2a1d54d5616 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1654253654", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:27:18.853329 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-e3db6d27-d3ec-41a1-a276-c2a1d54d5616 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] validate_networks() for None {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:27:18.911598 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c3d81f15-f69a-41de-beef-158c1ee4d10e tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7357f1c14a544016bba5abeee15f7a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c87221eb94488ba2e0fdd41386b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:18.927388 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c3d81f15-f69a-41de-beef-158c1ee4d10e tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] 10.222.0.60 "GET /compute/v2.1/servers/aab97ea8-6772-407f-a9f9-60f05d27cbfb" status: 200 len: 1321 microversion: 2.1 time: 1.087290 Oct 18 15:27:18.928445 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 394/764] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:17 2022] GET /compute/v2.1/servers/aab97ea8-6772-407f-a9f9-60f05d27cbfb => generated 1321 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:18.948866 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fbccbcf5-bc72-4e48-bda9-d49511c1836d tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:18.949931 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fbccbcf5-bc72-4e48-bda9-d49511c1836d tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: 21ed44b3-c1df-4099-a1ca-a8b167fc3890] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:18.960619 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=15,nova_api:UPDATE=14 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:27:18.977104 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbccbcf5-bc72-4e48-bda9-d49511c1836d tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:18.978300 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbccbcf5-bc72-4e48-bda9-d49511c1836d tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:18.980009 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbccbcf5-bc72-4e48-bda9-d49511c1836d tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:18.982045 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbccbcf5-bc72-4e48-bda9-d49511c1836d tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:18.982861 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbccbcf5-bc72-4e48-bda9-d49511c1836d tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:18.984343 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbccbcf5-bc72-4e48-bda9-d49511c1836d tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:19.582894 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fbccbcf5-bc72-4e48-bda9-d49511c1836d tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1023300147f463e8f0894981948f825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac07f1b2c83a4faab175a5b9ed8e315e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:19.598200 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fbccbcf5-bc72-4e48-bda9-d49511c1836d tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/21ed44b3-c1df-4099-a1ca-a8b167fc3890" status: 200 len: 1367 microversion: 2.1 time: 0.667642 Oct 18 15:27:19.598803 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 395/765] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:18 2022] GET /compute/v2.1/servers/21ed44b3-c1df-4099-a1ca-a8b167fc3890 => generated 1367 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:19.611497 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6d20bb3a-f3ae-4dd2-a154-37b0fca0b0fc tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d679c10>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:19.677420 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6d20bb3a-f3ae-4dd2-a154-37b0fca0b0fc tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/4cacb5ef-8146-4f19-98d6-b6eb8e8d35e6" status: 200 len: 1412 microversion: 2.1 time: 0.076829 Oct 18 15:27:19.678499 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 396/766] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:27:19 2022] GET /compute/v2.1/images/4cacb5ef-8146-4f19-98d6-b6eb8e8d35e6 => generated 1412 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:19.684098 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ff1fee08-eedf-4885-8a52-0f2281753efb tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:19.685410 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ff1fee08-eedf-4885-8a52-0f2281753efb tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] [instance: 22a2d6cf-565b-488b-8f9b-2b992b25cc32] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:19.703692 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ff1fee08-eedf-4885-8a52-0f2281753efb tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:19.704364 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ff1fee08-eedf-4885-8a52-0f2281753efb tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:19.705534 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ff1fee08-eedf-4885-8a52-0f2281753efb tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:19.708084 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ff1fee08-eedf-4885-8a52-0f2281753efb tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:19.708730 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ff1fee08-eedf-4885-8a52-0f2281753efb tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:19.709345 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ff1fee08-eedf-4885-8a52-0f2281753efb tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:19.751490 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-e3db6d27-d3ec-41a1-a276-c2a1d54d5616 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:27:19.752482 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-e3db6d27-d3ec-41a1-a276-c2a1d54d5616 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:27:19.753290 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-e3db6d27-d3ec-41a1-a276-c2a1d54d5616 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:27:19.753869 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-e3db6d27-d3ec-41a1-a276-c2a1d54d5616 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:27:19.754469 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-e3db6d27-d3ec-41a1-a276-c2a1d54d5616 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:27:19.780897 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e3db6d27-d3ec-41a1-a276-c2a1d54d5616 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:19.781737 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e3db6d27-d3ec-41a1-a276-c2a1d54d5616 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:19.782755 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e3db6d27-d3ec-41a1-a276-c2a1d54d5616 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:19.784302 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e3db6d27-d3ec-41a1-a276-c2a1d54d5616 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:19.785695 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e3db6d27-d3ec-41a1-a276-c2a1d54d5616 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:19.787155 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e3db6d27-d3ec-41a1-a276-c2a1d54d5616 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:19.814977 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-e3db6d27-d3ec-41a1-a276-c2a1d54d5616 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Getting quotas for project 377c3bbd62b546fca545c0f6d0df59e3. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:27:19.851566 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-e3db6d27-d3ec-41a1-a276-c2a1d54d5616 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Getting quotas for user d58aac335a1d421a95928e2754fb2529 and project 377c3bbd62b546fca545c0f6d0df59e3. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:27:19.879703 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e3db6d27-d3ec-41a1-a276-c2a1d54d5616 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:27:19.887427 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e3db6d27-d3ec-41a1-a276-c2a1d54d5616 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 61ca6b08-6a75-4b0a-86d7-86aa22cb308e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:27:19.964279 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e3db6d27-d3ec-41a1-a276-c2a1d54d5616 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.554675 Oct 18 15:27:19.965374 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 371/767] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:27:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 15:27:19.972078 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-83d886b9-2009-421a-9537-c23627efd0ff tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:19.972708 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-83d886b9-2009-421a-9537-c23627efd0ff tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] [instance: aab97ea8-6772-407f-a9f9-60f05d27cbfb] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:19.982696 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-83d886b9-2009-421a-9537-c23627efd0ff tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:19.983782 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-83d886b9-2009-421a-9537-c23627efd0ff tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:19.984392 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-83d886b9-2009-421a-9537-c23627efd0ff tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:19.985358 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-83d886b9-2009-421a-9537-c23627efd0ff tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:19.985827 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-83d886b9-2009-421a-9537-c23627efd0ff tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:19.986260 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-83d886b9-2009-421a-9537-c23627efd0ff tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:20.267172 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ff1fee08-eedf-4885-8a52-0f2281753efb tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2bbb8b77794404af993e8291343afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6facda3e46640c884583aaf146a8b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:20.277357 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ff1fee08-eedf-4885-8a52-0f2281753efb tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] 10.222.0.60 "GET /compute/v2.1/servers/22a2d6cf-565b-488b-8f9b-2b992b25cc32" status: 200 len: 1387 microversion: 2.1 time: 0.597551 Oct 18 15:27:20.281850 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 397/768] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:19 2022] GET /compute/v2.1/servers/22a2d6cf-565b-488b-8f9b-2b992b25cc32 => generated 1387 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:20.306576 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1e2698d8-4bcc-4bab-bb01-3dd2626662a6 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:20.310942 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1e2698d8-4bcc-4bab-bb01-3dd2626662a6 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 61ca6b08-6a75-4b0a-86d7-86aa22cb308e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:20.370768 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-83d886b9-2009-421a-9537-c23627efd0ff tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7357f1c14a544016bba5abeee15f7a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c87221eb94488ba2e0fdd41386b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:20.386592 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-83d886b9-2009-421a-9537-c23627efd0ff tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] 10.222.0.60 "GET /compute/v2.1/servers/aab97ea8-6772-407f-a9f9-60f05d27cbfb" status: 200 len: 1321 microversion: 2.1 time: 0.419969 Oct 18 15:27:20.387753 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 372/769] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:19 2022] GET /compute/v2.1/servers/aab97ea8-6772-407f-a9f9-60f05d27cbfb => generated 1321 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:20.498839 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1e2698d8-4bcc-4bab-bb01-3dd2626662a6 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:20.509643 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1e2698d8-4bcc-4bab-bb01-3dd2626662a6 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/61ca6b08-6a75-4b0a-86d7-86aa22cb308e" status: 200 len: 1217 microversion: 2.1 time: 0.226372 Oct 18 15:27:20.513146 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 398/770] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:20 2022] GET /compute/v2.1/servers/61ca6b08-6a75-4b0a-86d7-86aa22cb308e => generated 1217 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:20.624353 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3351b63b-ac58-468d-a7ec-b2db63644b06 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:20.627617 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3351b63b-ac58-468d-a7ec-b2db63644b06 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: 21ed44b3-c1df-4099-a1ca-a8b167fc3890] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:20.651828 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3351b63b-ac58-468d-a7ec-b2db63644b06 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:20.653045 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3351b63b-ac58-468d-a7ec-b2db63644b06 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:20.653957 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3351b63b-ac58-468d-a7ec-b2db63644b06 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:20.664532 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3351b63b-ac58-468d-a7ec-b2db63644b06 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:20.669452 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3351b63b-ac58-468d-a7ec-b2db63644b06 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:20.671792 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3351b63b-ac58-468d-a7ec-b2db63644b06 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:20.694735 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-af72f812-2bc3-4b8d-9194-512c47921e3b tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d6103a0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:20.824330 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-af72f812-2bc3-4b8d-9194-512c47921e3b tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/4cacb5ef-8146-4f19-98d6-b6eb8e8d35e6" status: 200 len: 1412 microversion: 2.1 time: 0.132350 Oct 18 15:27:20.835173 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 399/771] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:27:20 2022] GET /compute/v2.1/images/4cacb5ef-8146-4f19-98d6-b6eb8e8d35e6 => generated 1412 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:21.160719 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3351b63b-ac58-468d-a7ec-b2db63644b06 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1023300147f463e8f0894981948f825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac07f1b2c83a4faab175a5b9ed8e315e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:21.167751 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:27:21.170295 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3351b63b-ac58-468d-a7ec-b2db63644b06 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/21ed44b3-c1df-4099-a1ca-a8b167fc3890" status: 200 len: 1367 microversion: 2.1 time: 0.550865 Oct 18 15:27:21.177115 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 373/772] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:20 2022] GET /compute/v2.1/servers/21ed44b3-c1df-4099-a1ca-a8b167fc3890 => generated 1367 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:21.215915 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-5fd5d09e-30ee-4c14-850c-4d68cdedc9cc req-3c2280c9-76f0-425f-b2a4-ab5aa6409cae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aab97ea8-6772-407f-a9f9-60f05d27cbfb", "name": "network-vif-plugged", "status": "completed", "tag": "265155be-790e-460e-bb12-369a3b6831f8"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:27:21.225088 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-43c8ddc8-513b-4d20-90ad-c8b73c07980f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-368733338", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "2f9fec7c-78b7-46d8-8366-69a39bab2b6f"}], "security_groups": [{"name": "tempest-securitygroup--683332439"}], "key_name": "tempest-keypair-1635577822", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:27:21.239469 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5fd5d09e-30ee-4c14-850c-4d68cdedc9cc req-3c2280c9-76f0-425f-b2a4-ab5aa6409cae service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:21.241357 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5fd5d09e-30ee-4c14-850c-4d68cdedc9cc req-3c2280c9-76f0-425f-b2a4-ab5aa6409cae service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:21.242939 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5fd5d09e-30ee-4c14-850c-4d68cdedc9cc req-3c2280c9-76f0-425f-b2a4-ab5aa6409cae service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:21.276206 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:27:21.308299 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-5fd5d09e-30ee-4c14-850c-4d68cdedc9cc req-3c2280c9-76f0-425f-b2a4-ab5aa6409cae service nova] Creating event network-vif-plugged:265155be-790e-460e-bb12-369a3b6831f8 for instance aab97ea8-6772-407f-a9f9-60f05d27cbfb on n-h1-853682-5 Oct 18 15:27:21.325914 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-5fd5d09e-30ee-4c14-850c-4d68cdedc9cc req-3c2280c9-76f0-425f-b2a4-ab5aa6409cae service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110355 Oct 18 15:27:21.327490 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 400/773] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:27:21.338773 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c91f9f90-de29-4e53-98d7-b18a1b269780 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:21.342397 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c91f9f90-de29-4e53-98d7-b18a1b269780 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] [instance: 22a2d6cf-565b-488b-8f9b-2b992b25cc32] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:21.362828 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c91f9f90-de29-4e53-98d7-b18a1b269780 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:21.365415 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c91f9f90-de29-4e53-98d7-b18a1b269780 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:21.366149 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c91f9f90-de29-4e53-98d7-b18a1b269780 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:21.381809 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c91f9f90-de29-4e53-98d7-b18a1b269780 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:21.387975 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c91f9f90-de29-4e53-98d7-b18a1b269780 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:21.388715 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c91f9f90-de29-4e53-98d7-b18a1b269780 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:21.423594 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-43c8ddc8-513b-4d20-90ad-c8b73c07980f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] validate_networks() for [('2f9fec7c-78b7-46d8-8366-69a39bab2b6f', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:27:21.692600 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c91f9f90-de29-4e53-98d7-b18a1b269780 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2bbb8b77794404af993e8291343afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6facda3e46640c884583aaf146a8b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:21.714876 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c91f9f90-de29-4e53-98d7-b18a1b269780 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] 10.222.0.60 "GET /compute/v2.1/servers/22a2d6cf-565b-488b-8f9b-2b992b25cc32" status: 200 len: 1387 microversion: 2.1 time: 0.385130 Oct 18 15:27:21.721315 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 401/774] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:21 2022] GET /compute/v2.1/servers/22a2d6cf-565b-488b-8f9b-2b992b25cc32 => generated 1387 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:21.731662 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bbcbbd88-93c8-41d6-bc8f-a90a7c85eb61 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:21.735362 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bbcbbd88-93c8-41d6-bc8f-a90a7c85eb61 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] [instance: aab97ea8-6772-407f-a9f9-60f05d27cbfb] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:21.754515 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bbcbbd88-93c8-41d6-bc8f-a90a7c85eb61 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:21.755178 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bbcbbd88-93c8-41d6-bc8f-a90a7c85eb61 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:21.755713 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bbcbbd88-93c8-41d6-bc8f-a90a7c85eb61 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:21.756585 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bbcbbd88-93c8-41d6-bc8f-a90a7c85eb61 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:21.757311 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bbcbbd88-93c8-41d6-bc8f-a90a7c85eb61 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:21.757673 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bbcbbd88-93c8-41d6-bc8f-a90a7c85eb61 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:22.544104 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bbcbbd88-93c8-41d6-bc8f-a90a7c85eb61 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7357f1c14a544016bba5abeee15f7a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c87221eb94488ba2e0fdd41386b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:22.555429 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bbcbbd88-93c8-41d6-bc8f-a90a7c85eb61 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] 10.222.0.60 "GET /compute/v2.1/servers/aab97ea8-6772-407f-a9f9-60f05d27cbfb" status: 200 len: 1321 microversion: 2.1 time: 0.828979 Oct 18 15:27:22.556059 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 402/775] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:21 2022] GET /compute/v2.1/servers/aab97ea8-6772-407f-a9f9-60f05d27cbfb => generated 1321 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:22.564187 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3e6960de-e2d7-43a3-8e59-1fe1ad85e034 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:22.566677 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3e6960de-e2d7-43a3-8e59-1fe1ad85e034 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 61ca6b08-6a75-4b0a-86d7-86aa22cb308e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:22.583009 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e6960de-e2d7-43a3-8e59-1fe1ad85e034 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:22.589412 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e6960de-e2d7-43a3-8e59-1fe1ad85e034 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:22.590065 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e6960de-e2d7-43a3-8e59-1fe1ad85e034 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:22.590965 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e6960de-e2d7-43a3-8e59-1fe1ad85e034 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:22.591615 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e6960de-e2d7-43a3-8e59-1fe1ad85e034 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:22.592214 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e6960de-e2d7-43a3-8e59-1fe1ad85e034 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:22.695171 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3e6960de-e2d7-43a3-8e59-1fe1ad85e034 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:22.705951 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3e6960de-e2d7-43a3-8e59-1fe1ad85e034 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/61ca6b08-6a75-4b0a-86d7-86aa22cb308e" status: 200 len: 1269 microversion: 2.1 time: 0.147026 Oct 18 15:27:22.710546 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 403/776] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:22 2022] GET /compute/v2.1/servers/61ca6b08-6a75-4b0a-86d7-86aa22cb308e => generated 1269 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:22.718436 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ea4df331-b12e-45f7-849f-59f01d4bd7c5 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d69fd30>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:22.799864 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ea4df331-b12e-45f7-849f-59f01d4bd7c5 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/4cacb5ef-8146-4f19-98d6-b6eb8e8d35e6" status: 200 len: 1412 microversion: 2.1 time: 0.087716 Oct 18 15:27:22.809339 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 404/777] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:27:22 2022] GET /compute/v2.1/images/4cacb5ef-8146-4f19-98d6-b6eb8e8d35e6 => generated 1412 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:22.813368 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-43c8ddc8-513b-4d20-90ad-c8b73c07980f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:27:22.813876 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-43c8ddc8-513b-4d20-90ad-c8b73c07980f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:27:22.814710 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-43c8ddc8-513b-4d20-90ad-c8b73c07980f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:27:22.815240 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-43c8ddc8-513b-4d20-90ad-c8b73c07980f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:27:22.815663 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-072088e7-0892-483d-9efa-7de600779107 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:22.815813 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-43c8ddc8-513b-4d20-90ad-c8b73c07980f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:27:22.816587 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-072088e7-0892-483d-9efa-7de600779107 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: 21ed44b3-c1df-4099-a1ca-a8b167fc3890] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:22.823709 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-072088e7-0892-483d-9efa-7de600779107 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:22.824418 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-072088e7-0892-483d-9efa-7de600779107 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:22.825043 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-072088e7-0892-483d-9efa-7de600779107 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:22.826095 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-072088e7-0892-483d-9efa-7de600779107 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:22.826714 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-072088e7-0892-483d-9efa-7de600779107 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:22.827458 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-072088e7-0892-483d-9efa-7de600779107 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:22.834705 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-43c8ddc8-513b-4d20-90ad-c8b73c07980f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:22.837812 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-43c8ddc8-513b-4d20-90ad-c8b73c07980f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:22.838781 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-43c8ddc8-513b-4d20-90ad-c8b73c07980f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:22.843160 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-43c8ddc8-513b-4d20-90ad-c8b73c07980f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:22.843931 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-43c8ddc8-513b-4d20-90ad-c8b73c07980f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:22.844552 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-43c8ddc8-513b-4d20-90ad-c8b73c07980f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:22.877201 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-43c8ddc8-513b-4d20-90ad-c8b73c07980f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Getting quotas for project bb0579704a194ef89144af0973d68f42. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:27:22.882623 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=20 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:27:22.883895 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-43c8ddc8-513b-4d20-90ad-c8b73c07980f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Getting quotas for user 51490cfdebda47a7b8349677e4d61a59 and project bb0579704a194ef89144af0973d68f42. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:27:22.907296 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-43c8ddc8-513b-4d20-90ad-c8b73c07980f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:27:22.910874 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-43c8ddc8-513b-4d20-90ad-c8b73c07980f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: cc806839-862f-4ea7-9078-c970f50b3793] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:27:23.019440 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-43c8ddc8-513b-4d20-90ad-c8b73c07980f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 1.794659 Oct 18 15:27:23.020714 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 374/778] 10.222.0.60 () {62 vars in 1188 bytes} [Tue Oct 18 15:27:21 2022] POST /compute/v2.1/servers => generated 405 bytes in 1801 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 18 15:27:23.033258 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-92c7eca4-aca3-4d3e-9140-960480ef0f93 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:23.035680 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-92c7eca4-aca3-4d3e-9140-960480ef0f93 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] [instance: 22a2d6cf-565b-488b-8f9b-2b992b25cc32] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:23.052137 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-92c7eca4-aca3-4d3e-9140-960480ef0f93 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:23.053085 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-92c7eca4-aca3-4d3e-9140-960480ef0f93 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:23.053930 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-92c7eca4-aca3-4d3e-9140-960480ef0f93 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:23.055073 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-92c7eca4-aca3-4d3e-9140-960480ef0f93 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:23.055893 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-92c7eca4-aca3-4d3e-9140-960480ef0f93 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:23.057658 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-92c7eca4-aca3-4d3e-9140-960480ef0f93 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:23.214811 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-072088e7-0892-483d-9efa-7de600779107 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1023300147f463e8f0894981948f825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac07f1b2c83a4faab175a5b9ed8e315e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:23.224282 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-072088e7-0892-483d-9efa-7de600779107 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/21ed44b3-c1df-4099-a1ca-a8b167fc3890" status: 200 len: 1367 microversion: 2.1 time: 0.413511 Oct 18 15:27:23.242505 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 405/779] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:22 2022] GET /compute/v2.1/servers/21ed44b3-c1df-4099-a1ca-a8b167fc3890 => generated 1367 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:23.262006 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f4c15987-ed39-499f-aaf8-73f1dec25a1c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:23.262974 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f4c15987-ed39-499f-aaf8-73f1dec25a1c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:23.357828 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f4c15987-ed39-499f-aaf8-73f1dec25a1c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:23.371366 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f4c15987-ed39-499f-aaf8-73f1dec25a1c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:23.372836 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f4c15987-ed39-499f-aaf8-73f1dec25a1c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:23.373997 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f4c15987-ed39-499f-aaf8-73f1dec25a1c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793" status: 200 len: 1285 microversion: 2.25 time: 0.130241 Oct 18 15:27:23.375464 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 406/780] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:27:23 2022] GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793 => generated 1285 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:27:23.423243 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-c07ae5e4-7a00-4630-be3b-f579269ba19d req-4e98fe73-8308-4de8-bd60-bb3c925b9caf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22a2d6cf-565b-488b-8f9b-2b992b25cc32", "name": "network-vif-plugged", "status": "completed", "tag": "92ddf833-9eb5-4dca-a962-d9a729856784"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:27:23.447099 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c07ae5e4-7a00-4630-be3b-f579269ba19d req-4e98fe73-8308-4de8-bd60-bb3c925b9caf service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:23.447690 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c07ae5e4-7a00-4630-be3b-f579269ba19d req-4e98fe73-8308-4de8-bd60-bb3c925b9caf service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:23.448152 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c07ae5e4-7a00-4630-be3b-f579269ba19d req-4e98fe73-8308-4de8-bd60-bb3c925b9caf service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:23.496843 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-c07ae5e4-7a00-4630-be3b-f579269ba19d req-4e98fe73-8308-4de8-bd60-bb3c925b9caf service nova] Creating event network-vif-plugged:92ddf833-9eb5-4dca-a962-d9a729856784 for instance 22a2d6cf-565b-488b-8f9b-2b992b25cc32 on n-h2-853682-5 Oct 18 15:27:23.529448 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-c07ae5e4-7a00-4630-be3b-f579269ba19d req-4e98fe73-8308-4de8-bd60-bb3c925b9caf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110172 Oct 18 15:27:23.539465 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 407/781] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:27:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:27:23.578670 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9785c06c-e680-49b4-b0da-9f64d45c397f tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:23.579419 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9785c06c-e680-49b4-b0da-9f64d45c397f tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] [instance: aab97ea8-6772-407f-a9f9-60f05d27cbfb] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:23.587828 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9785c06c-e680-49b4-b0da-9f64d45c397f tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:23.598256 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9785c06c-e680-49b4-b0da-9f64d45c397f tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:23.601467 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9785c06c-e680-49b4-b0da-9f64d45c397f tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:23.605576 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9785c06c-e680-49b4-b0da-9f64d45c397f tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:23.606273 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9785c06c-e680-49b4-b0da-9f64d45c397f tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:23.609625 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9785c06c-e680-49b4-b0da-9f64d45c397f tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:23.633298 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-92c7eca4-aca3-4d3e-9140-960480ef0f93 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2bbb8b77794404af993e8291343afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6facda3e46640c884583aaf146a8b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:23.646332 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-92c7eca4-aca3-4d3e-9140-960480ef0f93 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] 10.222.0.60 "GET /compute/v2.1/servers/22a2d6cf-565b-488b-8f9b-2b992b25cc32" status: 200 len: 1387 microversion: 2.1 time: 0.623675 Oct 18 15:27:23.648767 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 375/782] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:23 2022] GET /compute/v2.1/servers/22a2d6cf-565b-488b-8f9b-2b992b25cc32 => generated 1387 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:23.736196 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-15fc912a-8cd9-4aec-afe7-b7d7e67f5eaa tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:23.736911 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-15fc912a-8cd9-4aec-afe7-b7d7e67f5eaa tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 61ca6b08-6a75-4b0a-86d7-86aa22cb308e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:23.749812 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-15fc912a-8cd9-4aec-afe7-b7d7e67f5eaa tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:23.750421 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-15fc912a-8cd9-4aec-afe7-b7d7e67f5eaa tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:23.750880 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-15fc912a-8cd9-4aec-afe7-b7d7e67f5eaa tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:23.753768 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-15fc912a-8cd9-4aec-afe7-b7d7e67f5eaa tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:23.757652 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-15fc912a-8cd9-4aec-afe7-b7d7e67f5eaa tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:23.761979 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-15fc912a-8cd9-4aec-afe7-b7d7e67f5eaa tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:23.946600 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-15fc912a-8cd9-4aec-afe7-b7d7e67f5eaa tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:23.955174 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-15fc912a-8cd9-4aec-afe7-b7d7e67f5eaa tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/61ca6b08-6a75-4b0a-86d7-86aa22cb308e" status: 200 len: 1275 microversion: 2.1 time: 0.224045 Oct 18 15:27:23.966245 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 376/783] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:23 2022] GET /compute/v2.1/servers/61ca6b08-6a75-4b0a-86d7-86aa22cb308e => generated 1275 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:27:23.971318 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fb723b5c-53ac-4d7e-aaa0-a970893cebc0 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d703310>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:24.039652 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9785c06c-e680-49b4-b0da-9f64d45c397f tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7357f1c14a544016bba5abeee15f7a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c87221eb94488ba2e0fdd41386b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:24.052240 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9785c06c-e680-49b4-b0da-9f64d45c397f tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] 10.222.0.60 "GET /compute/v2.1/servers/aab97ea8-6772-407f-a9f9-60f05d27cbfb" status: 200 len: 1470 microversion: 2.1 time: 0.478208 Oct 18 15:27:24.069827 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fb723b5c-53ac-4d7e-aaa0-a970893cebc0 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/4cacb5ef-8146-4f19-98d6-b6eb8e8d35e6" status: 200 len: 1412 microversion: 2.1 time: 0.102343 Oct 18 15:27:24.070403 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 377/784] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:27:23 2022] GET /compute/v2.1/images/4cacb5ef-8146-4f19-98d6-b6eb8e8d35e6 => generated 1412 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:24.078245 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 408/785] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:23 2022] GET /compute/v2.1/servers/aab97ea8-6772-407f-a9f9-60f05d27cbfb => generated 1470 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:24.085027 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3ad5ad4a-3f36-4fc3-a96d-735c40e95236 tempest-ServersAdminNegativeTestJSON-1620600410 tempest-ServersAdminNegativeTestJSON-1620600410-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:27:24.085832 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3ad5ad4a-3f36-4fc3-a96d-735c40e95236 tempest-ServersAdminNegativeTestJSON-1620600410 tempest-ServersAdminNegativeTestJSON-1620600410-project-admin] [instance: aab97ea8-6772-407f-a9f9-60f05d27cbfb] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:24.096425 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ad5ad4a-3f36-4fc3-a96d-735c40e95236 tempest-ServersAdminNegativeTestJSON-1620600410 tempest-ServersAdminNegativeTestJSON-1620600410-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:24.097510 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ad5ad4a-3f36-4fc3-a96d-735c40e95236 tempest-ServersAdminNegativeTestJSON-1620600410 tempest-ServersAdminNegativeTestJSON-1620600410-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:24.098341 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ad5ad4a-3f36-4fc3-a96d-735c40e95236 tempest-ServersAdminNegativeTestJSON-1620600410 tempest-ServersAdminNegativeTestJSON-1620600410-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:24.099876 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ad5ad4a-3f36-4fc3-a96d-735c40e95236 tempest-ServersAdminNegativeTestJSON-1620600410 tempest-ServersAdminNegativeTestJSON-1620600410-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:24.105340 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ad5ad4a-3f36-4fc3-a96d-735c40e95236 tempest-ServersAdminNegativeTestJSON-1620600410 tempest-ServersAdminNegativeTestJSON-1620600410-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:24.110286 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ad5ad4a-3f36-4fc3-a96d-735c40e95236 tempest-ServersAdminNegativeTestJSON-1620600410 tempest-ServersAdminNegativeTestJSON-1620600410-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:24.167854 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-3ad5ad4a-3f36-4fc3-a96d-735c40e95236 tempest-ServersAdminNegativeTestJSON-1620600410 tempest-ServersAdminNegativeTestJSON-1620600410-project-admin] Lazy-loading 'flavor' on Instance uuid aab97ea8-6772-407f-a9f9-60f05d27cbfb {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:27:24.254801 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-92cf7204-fce4-451b-8798-731b8d58f221 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:24.255651 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-92cf7204-fce4-451b-8798-731b8d58f221 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: 21ed44b3-c1df-4099-a1ca-a8b167fc3890] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:24.271417 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92cf7204-fce4-451b-8798-731b8d58f221 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:24.271909 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92cf7204-fce4-451b-8798-731b8d58f221 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:24.272341 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92cf7204-fce4-451b-8798-731b8d58f221 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:24.273067 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92cf7204-fce4-451b-8798-731b8d58f221 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:24.273541 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92cf7204-fce4-451b-8798-731b8d58f221 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:24.277974 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92cf7204-fce4-451b-8798-731b8d58f221 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:24.376321 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3ad5ad4a-3f36-4fc3-a96d-735c40e95236 tempest-ServersAdminNegativeTestJSON-1620600410 tempest-ServersAdminNegativeTestJSON-1620600410-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/aab97ea8-6772-407f-a9f9-60f05d27cbfb/action" status: 202 len: 0 microversion: 2.1 time: 0.285037 Oct 18 15:27:24.390362 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 378/786] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:27:24 2022] POST /compute/v2.1/servers/aab97ea8-6772-407f-a9f9-60f05d27cbfb/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:27:24.405713 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0ab31e6f-170a-481c-a572-2d24b685b192 tempest-ServersAdminNegativeTestJSON-1620600410 tempest-ServersAdminNegativeTestJSON-1620600410-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:24.406838 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0ab31e6f-170a-481c-a572-2d24b685b192 tempest-ServersAdminNegativeTestJSON-1620600410 tempest-ServersAdminNegativeTestJSON-1620600410-project-admin] [instance: aab97ea8-6772-407f-a9f9-60f05d27cbfb] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:24.421816 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0ab31e6f-170a-481c-a572-2d24b685b192 tempest-ServersAdminNegativeTestJSON-1620600410 tempest-ServersAdminNegativeTestJSON-1620600410-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:24.422311 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0ab31e6f-170a-481c-a572-2d24b685b192 tempest-ServersAdminNegativeTestJSON-1620600410 tempest-ServersAdminNegativeTestJSON-1620600410-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:24.422749 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0ab31e6f-170a-481c-a572-2d24b685b192 tempest-ServersAdminNegativeTestJSON-1620600410 tempest-ServersAdminNegativeTestJSON-1620600410-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:24.424843 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0ab31e6f-170a-481c-a572-2d24b685b192 tempest-ServersAdminNegativeTestJSON-1620600410 tempest-ServersAdminNegativeTestJSON-1620600410-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:24.425340 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0ab31e6f-170a-481c-a572-2d24b685b192 tempest-ServersAdminNegativeTestJSON-1620600410 tempest-ServersAdminNegativeTestJSON-1620600410-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:24.425777 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0ab31e6f-170a-481c-a572-2d24b685b192 tempest-ServersAdminNegativeTestJSON-1620600410 tempest-ServersAdminNegativeTestJSON-1620600410-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:24.656589 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-92cf7204-fce4-451b-8798-731b8d58f221 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1023300147f463e8f0894981948f825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac07f1b2c83a4faab175a5b9ed8e315e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:24.667263 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-92cf7204-fce4-451b-8798-731b8d58f221 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/21ed44b3-c1df-4099-a1ca-a8b167fc3890" status: 200 len: 1367 microversion: 2.1 time: 0.415488 Oct 18 15:27:24.672865 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 409/787] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:24 2022] GET /compute/v2.1/servers/21ed44b3-c1df-4099-a1ca-a8b167fc3890 => generated 1367 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:27:24.698584 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4594b33e-b17e-4a38-82f7-02dcb375e0d4 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:24.700895 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4594b33e-b17e-4a38-82f7-02dcb375e0d4 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:24.708382 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4594b33e-b17e-4a38-82f7-02dcb375e0d4 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:24.709320 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4594b33e-b17e-4a38-82f7-02dcb375e0d4 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:24.710002 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4594b33e-b17e-4a38-82f7-02dcb375e0d4 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:24.710904 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4594b33e-b17e-4a38-82f7-02dcb375e0d4 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:24.718831 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4594b33e-b17e-4a38-82f7-02dcb375e0d4 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:24.719756 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4594b33e-b17e-4a38-82f7-02dcb375e0d4 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:24.840759 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4594b33e-b17e-4a38-82f7-02dcb375e0d4 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:24.857123 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4594b33e-b17e-4a38-82f7-02dcb375e0d4 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:24.862117 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0ab31e6f-170a-481c-a572-2d24b685b192 tempest-ServersAdminNegativeTestJSON-1620600410 tempest-ServersAdminNegativeTestJSON-1620600410-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/aab97ea8-6772-407f-a9f9-60f05d27cbfb" status: 200 len: 1629 microversion: 2.1 time: 0.468424 Oct 18 15:27:24.870654 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4594b33e-b17e-4a38-82f7-02dcb375e0d4 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:24.873356 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4594b33e-b17e-4a38-82f7-02dcb375e0d4 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793" status: 200 len: 1337 microversion: 2.25 time: 0.187354 Oct 18 15:27:24.886203 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 379/788] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:24 2022] GET /compute/v2.1/servers/aab97ea8-6772-407f-a9f9-60f05d27cbfb => generated 1629 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:24.894678 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 410/789] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:27:24 2022] GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793 => generated 1337 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:27:24.910148 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1a678cc0-142c-4081-9be2-ee2192b7e0f4 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:24.911324 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1a678cc0-142c-4081-9be2-ee2192b7e0f4 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] [instance: 22a2d6cf-565b-488b-8f9b-2b992b25cc32] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:24.922676 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1a678cc0-142c-4081-9be2-ee2192b7e0f4 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:24.923442 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1a678cc0-142c-4081-9be2-ee2192b7e0f4 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:24.924055 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1a678cc0-142c-4081-9be2-ee2192b7e0f4 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:24.925509 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1a678cc0-142c-4081-9be2-ee2192b7e0f4 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:24.926136 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1a678cc0-142c-4081-9be2-ee2192b7e0f4 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:24.926748 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1a678cc0-142c-4081-9be2-ee2192b7e0f4 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:24.997827 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9466585b-4091-40b0-bddb-049c6179cc66 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:24.999174 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9466585b-4091-40b0-bddb-049c6179cc66 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 61ca6b08-6a75-4b0a-86d7-86aa22cb308e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:25.008901 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9466585b-4091-40b0-bddb-049c6179cc66 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:25.011982 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9466585b-4091-40b0-bddb-049c6179cc66 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:25.013103 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9466585b-4091-40b0-bddb-049c6179cc66 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:25.014249 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9466585b-4091-40b0-bddb-049c6179cc66 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:25.014987 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9466585b-4091-40b0-bddb-049c6179cc66 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:25.018091 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9466585b-4091-40b0-bddb-049c6179cc66 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:25.278418 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9466585b-4091-40b0-bddb-049c6179cc66 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:25.302800 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9466585b-4091-40b0-bddb-049c6179cc66 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/61ca6b08-6a75-4b0a-86d7-86aa22cb308e" status: 200 len: 1275 microversion: 2.1 time: 0.318609 Oct 18 15:27:25.336733 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 411/790] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:24 2022] GET /compute/v2.1/servers/61ca6b08-6a75-4b0a-86d7-86aa22cb308e => generated 1275 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:25.354860 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-243426c9-0ece-4490-8468-f730796a27c7 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d67dd30>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:25.492975 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-243426c9-0ece-4490-8468-f730796a27c7 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/4cacb5ef-8146-4f19-98d6-b6eb8e8d35e6" status: 200 len: 1412 microversion: 2.1 time: 0.150619 Oct 18 15:27:25.493578 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 412/791] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:27:25 2022] GET /compute/v2.1/images/4cacb5ef-8146-4f19-98d6-b6eb8e8d35e6 => generated 1412 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:25.505487 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1a678cc0-142c-4081-9be2-ee2192b7e0f4 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2bbb8b77794404af993e8291343afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6facda3e46640c884583aaf146a8b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:25.519333 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1a678cc0-142c-4081-9be2-ee2192b7e0f4 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] 10.222.0.60 "GET /compute/v2.1/servers/22a2d6cf-565b-488b-8f9b-2b992b25cc32" status: 200 len: 1387 microversion: 2.1 time: 0.629658 Oct 18 15:27:25.535169 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 380/792] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:24 2022] GET /compute/v2.1/servers/22a2d6cf-565b-488b-8f9b-2b992b25cc32 => generated 1387 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:25.707964 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-125f9cc9-9a5a-479f-9e9c-ca74adfa9f08 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:25.709197 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-125f9cc9-9a5a-479f-9e9c-ca74adfa9f08 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: 21ed44b3-c1df-4099-a1ca-a8b167fc3890] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:25.730066 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-125f9cc9-9a5a-479f-9e9c-ca74adfa9f08 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:25.732503 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-125f9cc9-9a5a-479f-9e9c-ca74adfa9f08 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:25.733271 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-125f9cc9-9a5a-479f-9e9c-ca74adfa9f08 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:25.734342 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-125f9cc9-9a5a-479f-9e9c-ca74adfa9f08 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:25.736526 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-125f9cc9-9a5a-479f-9e9c-ca74adfa9f08 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:25.738966 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-125f9cc9-9a5a-479f-9e9c-ca74adfa9f08 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:25.892163 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-694e12cb-98f5-4d42-816d-76d8de6a23fb tempest-ServersAdminNegativeTestJSON-1620600410 tempest-ServersAdminNegativeTestJSON-1620600410-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:25.893521 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-694e12cb-98f5-4d42-816d-76d8de6a23fb tempest-ServersAdminNegativeTestJSON-1620600410 tempest-ServersAdminNegativeTestJSON-1620600410-project-admin] [instance: aab97ea8-6772-407f-a9f9-60f05d27cbfb] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:25.922659 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-694e12cb-98f5-4d42-816d-76d8de6a23fb tempest-ServersAdminNegativeTestJSON-1620600410 tempest-ServersAdminNegativeTestJSON-1620600410-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:25.923574 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-694e12cb-98f5-4d42-816d-76d8de6a23fb tempest-ServersAdminNegativeTestJSON-1620600410 tempest-ServersAdminNegativeTestJSON-1620600410-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:25.924241 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-694e12cb-98f5-4d42-816d-76d8de6a23fb tempest-ServersAdminNegativeTestJSON-1620600410 tempest-ServersAdminNegativeTestJSON-1620600410-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:25.925161 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-694e12cb-98f5-4d42-816d-76d8de6a23fb tempest-ServersAdminNegativeTestJSON-1620600410 tempest-ServersAdminNegativeTestJSON-1620600410-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:25.933874 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-694e12cb-98f5-4d42-816d-76d8de6a23fb tempest-ServersAdminNegativeTestJSON-1620600410 tempest-ServersAdminNegativeTestJSON-1620600410-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:25.934582 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-694e12cb-98f5-4d42-816d-76d8de6a23fb tempest-ServersAdminNegativeTestJSON-1620600410 tempest-ServersAdminNegativeTestJSON-1620600410-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:26.434108 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-125f9cc9-9a5a-479f-9e9c-ca74adfa9f08 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1023300147f463e8f0894981948f825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac07f1b2c83a4faab175a5b9ed8e315e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:26.450605 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-125f9cc9-9a5a-479f-9e9c-ca74adfa9f08 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/21ed44b3-c1df-4099-a1ca-a8b167fc3890" status: 200 len: 1367 microversion: 2.1 time: 0.750119 Oct 18 15:27:26.466524 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 413/793] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:25 2022] GET /compute/v2.1/servers/21ed44b3-c1df-4099-a1ca-a8b167fc3890 => generated 1367 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:26.475657 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-547e8084-7273-4654-b25f-249e08123d6e tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:26.477071 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-547e8084-7273-4654-b25f-249e08123d6e tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:26.487715 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-547e8084-7273-4654-b25f-249e08123d6e tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:26.488649 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-547e8084-7273-4654-b25f-249e08123d6e tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:26.490252 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-547e8084-7273-4654-b25f-249e08123d6e tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:26.491706 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-547e8084-7273-4654-b25f-249e08123d6e tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:26.492617 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-547e8084-7273-4654-b25f-249e08123d6e tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:26.493299 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-547e8084-7273-4654-b25f-249e08123d6e tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:26.581270 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-694e12cb-98f5-4d42-816d-76d8de6a23fb tempest-ServersAdminNegativeTestJSON-1620600410 tempest-ServersAdminNegativeTestJSON-1620600410-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/aab97ea8-6772-407f-a9f9-60f05d27cbfb" status: 200 len: 1612 microversion: 2.1 time: 0.692906 Oct 18 15:27:26.585589 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 381/794] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:25 2022] GET /compute/v2.1/servers/aab97ea8-6772-407f-a9f9-60f05d27cbfb => generated 1612 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:26.594167 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6bcfbcb4-0fde-4dcb-9596-b217ec00c12b tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:26.594716 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6bcfbcb4-0fde-4dcb-9596-b217ec00c12b tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 61ca6b08-6a75-4b0a-86d7-86aa22cb308e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:26.622673 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6bcfbcb4-0fde-4dcb-9596-b217ec00c12b tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:26.623190 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6bcfbcb4-0fde-4dcb-9596-b217ec00c12b tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:26.623721 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6bcfbcb4-0fde-4dcb-9596-b217ec00c12b tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:26.624457 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6bcfbcb4-0fde-4dcb-9596-b217ec00c12b tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:26.625021 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6bcfbcb4-0fde-4dcb-9596-b217ec00c12b tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:26.625454 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6bcfbcb4-0fde-4dcb-9596-b217ec00c12b tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:26.640358 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-547e8084-7273-4654-b25f-249e08123d6e tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:26.655253 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-547e8084-7273-4654-b25f-249e08123d6e tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:26.657800 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-547e8084-7273-4654-b25f-249e08123d6e tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:26.661429 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-547e8084-7273-4654-b25f-249e08123d6e tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793" status: 200 len: 1343 microversion: 2.25 time: 0.190832 Oct 18 15:27:26.662045 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 414/795] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:27:26 2022] GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793 => generated 1343 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:27:26.670740 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-66894064-82e2-4a7a-8722-97bdf0e4f4bf tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d6101f0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:26.761698 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-66894064-82e2-4a7a-8722-97bdf0e4f4bf tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/4cacb5ef-8146-4f19-98d6-b6eb8e8d35e6" status: 200 len: 1412 microversion: 2.1 time: 0.098550 Oct 18 15:27:26.766633 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 415/796] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:27:26 2022] GET /compute/v2.1/images/4cacb5ef-8146-4f19-98d6-b6eb8e8d35e6 => generated 1412 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:26.776338 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-33f2f700-9c59-49c2-a84f-3cfd57c98e75 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:26.777562 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-33f2f700-9c59-49c2-a84f-3cfd57c98e75 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] [instance: 22a2d6cf-565b-488b-8f9b-2b992b25cc32] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:26.785530 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33f2f700-9c59-49c2-a84f-3cfd57c98e75 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:26.786312 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33f2f700-9c59-49c2-a84f-3cfd57c98e75 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:26.786987 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33f2f700-9c59-49c2-a84f-3cfd57c98e75 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:26.787863 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33f2f700-9c59-49c2-a84f-3cfd57c98e75 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:26.788479 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33f2f700-9c59-49c2-a84f-3cfd57c98e75 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:26.789093 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33f2f700-9c59-49c2-a84f-3cfd57c98e75 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:26.862357 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6bcfbcb4-0fde-4dcb-9596-b217ec00c12b tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:26.872170 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6bcfbcb4-0fde-4dcb-9596-b217ec00c12b tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/61ca6b08-6a75-4b0a-86d7-86aa22cb308e" status: 200 len: 1275 microversion: 2.1 time: 0.285502 Oct 18 15:27:26.876931 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 382/797] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:26 2022] GET /compute/v2.1/servers/61ca6b08-6a75-4b0a-86d7-86aa22cb308e => generated 1275 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:26.884776 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-87705e83-339e-4fb8-8ef8-5911cafbefdf tempest-ServersAdminNegativeTestJSON-1620600410 tempest-ServersAdminNegativeTestJSON-1620600410-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:27:26.887274 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-87705e83-339e-4fb8-8ef8-5911cafbefdf tempest-ServersAdminNegativeTestJSON-1620600410 tempest-ServersAdminNegativeTestJSON-1620600410-project-admin] [instance: aab97ea8-6772-407f-a9f9-60f05d27cbfb] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:26.902463 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-87705e83-339e-4fb8-8ef8-5911cafbefdf tempest-ServersAdminNegativeTestJSON-1620600410 tempest-ServersAdminNegativeTestJSON-1620600410-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:26.903199 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-87705e83-339e-4fb8-8ef8-5911cafbefdf tempest-ServersAdminNegativeTestJSON-1620600410 tempest-ServersAdminNegativeTestJSON-1620600410-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:26.903893 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-87705e83-339e-4fb8-8ef8-5911cafbefdf tempest-ServersAdminNegativeTestJSON-1620600410 tempest-ServersAdminNegativeTestJSON-1620600410-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:26.904853 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-87705e83-339e-4fb8-8ef8-5911cafbefdf tempest-ServersAdminNegativeTestJSON-1620600410 tempest-ServersAdminNegativeTestJSON-1620600410-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:26.908321 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-87705e83-339e-4fb8-8ef8-5911cafbefdf tempest-ServersAdminNegativeTestJSON-1620600410 tempest-ServersAdminNegativeTestJSON-1620600410-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:26.909288 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-87705e83-339e-4fb8-8ef8-5911cafbefdf tempest-ServersAdminNegativeTestJSON-1620600410 tempest-ServersAdminNegativeTestJSON-1620600410-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:27.043186 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-33f2f700-9c59-49c2-a84f-3cfd57c98e75 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2bbb8b77794404af993e8291343afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6facda3e46640c884583aaf146a8b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:27.055587 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-33f2f700-9c59-49c2-a84f-3cfd57c98e75 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] 10.222.0.60 "GET /compute/v2.1/servers/22a2d6cf-565b-488b-8f9b-2b992b25cc32" status: 200 len: 1587 microversion: 2.1 time: 0.287652 Oct 18 15:27:27.056543 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 416/798] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:26 2022] GET /compute/v2.1/servers/22a2d6cf-565b-488b-8f9b-2b992b25cc32 => generated 1587 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:27.073788 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-2c22638a-2bda-4b1a-95d3-b73d93ca2cbb req-f9e6ed0f-c9cd-426f-8283-5d42f2adf8e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21ed44b3-c1df-4099-a1ca-a8b167fc3890", "name": "network-vif-plugged", "status": "completed", "tag": "aa57d87b-6f22-4cfc-9682-ac41b5b434a1"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:27:27.097064 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2c22638a-2bda-4b1a-95d3-b73d93ca2cbb req-f9e6ed0f-c9cd-426f-8283-5d42f2adf8e1 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:27.105455 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2c22638a-2bda-4b1a-95d3-b73d93ca2cbb req-f9e6ed0f-c9cd-426f-8283-5d42f2adf8e1 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:27.107599 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2c22638a-2bda-4b1a-95d3-b73d93ca2cbb req-f9e6ed0f-c9cd-426f-8283-5d42f2adf8e1 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:27.111346 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-87705e83-339e-4fb8-8ef8-5911cafbefdf tempest-ServersAdminNegativeTestJSON-1620600410 tempest-ServersAdminNegativeTestJSON-1620600410-project-admin] HTTP exception thrown: Cannot 'migrate' instance aab97ea8-6772-407f-a9f9-60f05d27cbfb while it is in vm_state suspended Oct 18 15:27:27.113543 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-87705e83-339e-4fb8-8ef8-5911cafbefdf tempest-ServersAdminNegativeTestJSON-1620600410 tempest-ServersAdminNegativeTestJSON-1620600410-project-admin] Request method failure captured: Oct 18 15:27:27.113543 n-d-853682-5 devstack@n-api.service[120405]: request: POST /compute/v2.1/servers/aab97ea8-6772-407f-a9f9-60f05d27cbfb/action HTTP/1.1 Oct 18 15:27:27.113543 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:27:27.113543 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:27:27.113543 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:27:27.113543 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 15 Oct 18 15:27:27.113543 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:27:27.113543 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:27:27.113543 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:27:27.113543 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:27:27.113543 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsWq1dpMgzIsCWRY0F892VDgNvUvxfWzvxFptNz49mY3aWwE5Vb_K0JSfxO6p36gZKw6w9GIwHT55uY3_yyws0qe6Lmr8jGy1By-l-727jpAlT2J6qSutb75upX7Kiu82-G4IdT27ihwE_LVkwS6fKOnplL_Ld5wOoSPB5hDUAQ1loE Oct 18 15:27:27.113543 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:27:27.113543 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:27:27.113543 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:27:27.113543 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:27:27.113543 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:27:27.113543 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:27:27.113543 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: ad0780e3e2474c07836a17475bdf3ab4 Oct 18 15:27:27.113543 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1620600410 Oct 18 15:27:27.113543 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,admin,reader Oct 18 15:27:27.113543 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,admin,reader Oct 18 15:27:27.114905 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ad0780e3e2474c07836a17475bdf3ab4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ad0780e3e2474c07836a17475bdf3ab4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ad0780e3e2474c07836a17475bdf3ab4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ad0780e3e2474c07836a17475bdf3ab4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:27:27.114905 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1620600410 Oct 18 15:27:27.114905 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: ad0780e3e2474c07836a17475bdf3ab4 Oct 18 15:27:27.114905 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1620600410 Oct 18 15:27:27.114905 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServersAdminNegativeTestJSON-1620600410-project-admin Oct 18 15:27:27.114905 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:27:27.114905 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:27:27.114905 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 4c637bbfb0214b919c1275198a2e0829 Oct 18 15:27:27.114905 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1620600410-project-admin Oct 18 15:27:27.114905 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:27:27.114905 n-d-853682-5 devstack@n-api.service[120405]: {"migrate": {}} Oct 18 15:27:27.114905 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:27:27.114905 n-d-853682-5 devstack@n-api.service[120405]: exception: Cannot 'migrate' instance aab97ea8-6772-407f-a9f9-60f05d27cbfb while it is in vm_state suspended Oct 18 15:27:27.115691 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'aab97ea8-6772-407f-a9f9-60f05d27cbfb', 'body': {'migrate': {}}} Oct 18 15:27:27.115691 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:27:27.115691 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:27:27.115691 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 18 15:27:27.115691 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 18 15:27:27.115691 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 18 15:27:27.115691 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 15:27:27.115691 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 18 15:27:27.115691 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 15:27:27.115691 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 18 15:27:27.115691 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 15:27:27.115691 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 15:27:27.115691 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 15:27:27.115691 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 18 15:27:27.115691 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 15:27:27.115691 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance aab97ea8-6772-407f-a9f9-60f05d27cbfb in vm_state suspended. Cannot resize while the instance is in this state. Oct 18 15:27:27.115691 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:27:27.115691 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:27:27.115691 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:27:27.115691 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:27:27.117003 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:27:27.117003 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:27:27.117003 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:27:27.117003 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:27:27.117003 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:27:27.117003 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:27:27.117003 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:27:27.117003 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:27:27.117003 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 18 15:27:27.117003 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 18 15:27:27.117003 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 15:27:27.117003 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 15:27:27.117003 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance aab97ea8-6772-407f-a9f9-60f05d27cbfb while it is in vm_state suspended Oct 18 15:27:27.117003 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:27:27.117003 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:27:27.117003 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:27:27.117003 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:27:27.117003 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:27:27.117003 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:27:27.122943 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:27:27.122943 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:27:27.122943 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance aab97ea8-6772-407f-a9f9-60f05d27cbfb while it is in vm_state suspended Oct 18 15:27:27.122943 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:27:27.122943 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-87705e83-339e-4fb8-8ef8-5911cafbefdf tempest-ServersAdminNegativeTestJSON-1620600410 tempest-ServersAdminNegativeTestJSON-1620600410-project-admin] Returning 409 to user: Cannot 'migrate' instance aab97ea8-6772-407f-a9f9-60f05d27cbfb while it is in vm_state suspended {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:27:27.122943 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-87705e83-339e-4fb8-8ef8-5911cafbefdf tempest-ServersAdminNegativeTestJSON-1620600410 tempest-ServersAdminNegativeTestJSON-1620600410-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/aab97ea8-6772-407f-a9f9-60f05d27cbfb/action" status: 409 len: 148 microversion: 2.1 time: 0.236714 Oct 18 15:27:27.122943 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 383/799] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:27:26 2022] POST /compute/v2.1/servers/aab97ea8-6772-407f-a9f9-60f05d27cbfb/action => generated 148 bytes in 243 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 15:27:27.125789 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9dfcdd71-640a-4d6e-aa98-ac0b428c6ec6 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:27.126292 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9dfcdd71-640a-4d6e-aa98-ac0b428c6ec6 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] [instance: 22a2d6cf-565b-488b-8f9b-2b992b25cc32] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:27.137852 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9dfcdd71-640a-4d6e-aa98-ac0b428c6ec6 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:27.138351 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9dfcdd71-640a-4d6e-aa98-ac0b428c6ec6 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:27.138790 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9dfcdd71-640a-4d6e-aa98-ac0b428c6ec6 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:27.139740 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9dfcdd71-640a-4d6e-aa98-ac0b428c6ec6 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:27.140458 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9dfcdd71-640a-4d6e-aa98-ac0b428c6ec6 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:27.141088 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9dfcdd71-640a-4d6e-aa98-ac0b428c6ec6 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:27.149408 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-2c22638a-2bda-4b1a-95d3-b73d93ca2cbb req-f9e6ed0f-c9cd-426f-8283-5d42f2adf8e1 service nova] Creating event network-vif-plugged:aa57d87b-6f22-4cfc-9682-ac41b5b434a1 for instance 21ed44b3-c1df-4099-a1ca-a8b167fc3890 on n-h2-853682-5 Oct 18 15:27:27.161663 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-2c22638a-2bda-4b1a-95d3-b73d93ca2cbb req-f9e6ed0f-c9cd-426f-8283-5d42f2adf8e1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103653 Oct 18 15:27:27.164042 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 417/800] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:27:27.172440 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c1620d1e-e1ae-4962-ac7e-d430081ba118 tempest-ServersAdminNegativeTestJSON-1620600410 tempest-ServersAdminNegativeTestJSON-1620600410-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:27:27.186401 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c1620d1e-e1ae-4962-ac7e-d430081ba118 tempest-ServersAdminNegativeTestJSON-1620600410 tempest-ServersAdminNegativeTestJSON-1620600410-project-admin] Request method failure captured: Oct 18 15:27:27.186401 n-d-853682-5 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers/c3a3dd99-9387-4e73-a32d-e0c995b2b8b9/action HTTP/1.1 Oct 18 15:27:27.186401 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:27:27.186401 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:27:27.186401 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:27:27.186401 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 39 Oct 18 15:27:27.186401 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:27:27.186401 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:27:27.186401 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:27:27.186401 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:27:27.186401 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsWq1dpMgzIsCWRY0F892VDgNvUvxfWzvxFptNz49mY3aWwE5Vb_K0JSfxO6p36gZKw6w9GIwHT55uY3_yyws0qe6Lmr8jGy1By-l-727jpAlT2J6qSutb75upX7Kiu82-G4IdT27ihwE_LVkwS6fKOnplL_Ld5wOoSPB5hDUAQ1loE Oct 18 15:27:27.186401 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:27:27.186401 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:27:27.186401 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:27:27.186401 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:27:27.186401 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:27:27.186401 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:27:27.186401 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: ad0780e3e2474c07836a17475bdf3ab4 Oct 18 15:27:27.186401 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1620600410 Oct 18 15:27:27.186401 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,admin,reader Oct 18 15:27:27.186401 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,admin,reader Oct 18 15:27:27.188030 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ad0780e3e2474c07836a17475bdf3ab4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ad0780e3e2474c07836a17475bdf3ab4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ad0780e3e2474c07836a17475bdf3ab4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ad0780e3e2474c07836a17475bdf3ab4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:27:27.188030 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1620600410 Oct 18 15:27:27.188030 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: ad0780e3e2474c07836a17475bdf3ab4 Oct 18 15:27:27.188030 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1620600410 Oct 18 15:27:27.188030 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersAdminNegativeTestJSON-1620600410-project-admin Oct 18 15:27:27.188030 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:27:27.188030 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:27:27.188030 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 4c637bbfb0214b919c1275198a2e0829 Oct 18 15:27:27.188030 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1620600410-project-admin Oct 18 15:27:27.188030 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:27:27.188030 n-d-853682-5 devstack@n-api.service[120406]: {"os-resetState": {"state": "invalid"}} Oct 18 15:27:27.188030 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:27:27.188762 n-d-853682-5 devstack@n-api.service[120406]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 18 15:27:27.188762 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'c3a3dd99-9387-4e73-a32d-e0c995b2b8b9', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 18 15:27:27.188762 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:27:27.188762 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:27:27.188762 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 15:27:27.188762 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 15:27:27.188762 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 15:27:27.188762 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise error Oct 18 15:27:27.188762 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 18 15:27:27.188762 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:27:27.188762 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 18 15:27:27.188762 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 18 15:27:27.188762 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:27:27.188762 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 18 15:27:27.188762 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'invalid' Oct 18 15:27:27.188762 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:27:27.188762 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:27:27.188762 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:27:27.188762 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:27:27.188762 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:27:27.188762 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:27:27.188762 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:27:27.190661 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:27:27.190661 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:27:27.190661 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:27:27.190661 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 15:27:27.190661 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 15:27:27.190661 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 15:27:27.190661 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 15:27:27.190661 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 15:27:27.190661 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 15:27:27.190661 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 18 15:27:27.190661 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:27:27.190661 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:27:27.190661 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:27:27.190661 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:27:27.190661 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:27:27.190661 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:27:27.190661 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 15:27:27.190661 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 15:27:27.190661 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 18 15:27:27.192400 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:27:27.192400 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c1620d1e-e1ae-4962-ac7e-d430081ba118 tempest-ServersAdminNegativeTestJSON-1620600410 tempest-ServersAdminNegativeTestJSON-1620600410-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:27:27.192400 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c1620d1e-e1ae-4962-ac7e-d430081ba118 tempest-ServersAdminNegativeTestJSON-1620600410 tempest-ServersAdminNegativeTestJSON-1620600410-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/c3a3dd99-9387-4e73-a32d-e0c995b2b8b9/action" status: 400 len: 144 microversion: 2.1 time: 0.021071 Oct 18 15:27:27.199101 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 418/801] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:27:27 2022] POST /compute/v2.1/servers/c3a3dd99-9387-4e73-a32d-e0c995b2b8b9/action => generated 144 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:27:27.216186 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a02df51e-bb3a-4217-9735-3d41f69dc71a tempest-ServersAdminNegativeTestJSON-1620600410 tempest-ServersAdminNegativeTestJSON-1620600410-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:27:27.219902 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a02df51e-bb3a-4217-9735-3d41f69dc71a tempest-ServersAdminNegativeTestJSON-1620600410 tempest-ServersAdminNegativeTestJSON-1620600410-project-admin] Request method failure captured: Oct 18 15:27:27.219902 n-d-853682-5 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers/c3a3dd99-9387-4e73-a32d-e0c995b2b8b9/action HTTP/1.1 Oct 18 15:27:27.219902 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:27:27.219902 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:27:27.219902 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:27:27.219902 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 31 Oct 18 15:27:27.219902 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:27:27.219902 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:27:27.219902 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:27:27.219902 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:27:27.219902 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsWq1dpMgzIsCWRY0F892VDgNvUvxfWzvxFptNz49mY3aWwE5Vb_K0JSfxO6p36gZKw6w9GIwHT55uY3_yyws0qe6Lmr8jGy1By-l-727jpAlT2J6qSutb75upX7Kiu82-G4IdT27ihwE_LVkwS6fKOnplL_Ld5wOoSPB5hDUAQ1loE Oct 18 15:27:27.219902 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:27:27.219902 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:27:27.219902 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:27:27.219902 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:27:27.219902 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:27:27.219902 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:27:27.219902 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: ad0780e3e2474c07836a17475bdf3ab4 Oct 18 15:27:27.219902 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1620600410 Oct 18 15:27:27.219902 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,admin,reader Oct 18 15:27:27.219902 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,admin,reader Oct 18 15:27:27.221548 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ad0780e3e2474c07836a17475bdf3ab4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ad0780e3e2474c07836a17475bdf3ab4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ad0780e3e2474c07836a17475bdf3ab4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ad0780e3e2474c07836a17475bdf3ab4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:27:27.221548 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1620600410 Oct 18 15:27:27.221548 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: ad0780e3e2474c07836a17475bdf3ab4 Oct 18 15:27:27.221548 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1620600410 Oct 18 15:27:27.221548 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersAdminNegativeTestJSON-1620600410-project-admin Oct 18 15:27:27.221548 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:27:27.221548 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:27:27.221548 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 4c637bbfb0214b919c1275198a2e0829 Oct 18 15:27:27.221548 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1620600410-project-admin Oct 18 15:27:27.221548 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:27:27.221548 n-d-853682-5 devstack@n-api.service[120406]: {"os-resetState": {"state": 1}} Oct 18 15:27:27.221548 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:27:27.221548 n-d-853682-5 devstack@n-api.service[120406]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 18 15:27:27.222349 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'c3a3dd99-9387-4e73-a32d-e0c995b2b8b9', 'body': {'os-resetState': {'state': 1}}} Oct 18 15:27:27.222349 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:27:27.222349 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:27:27.222349 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 15:27:27.222349 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 15:27:27.222349 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 15:27:27.222349 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise error Oct 18 15:27:27.222349 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 18 15:27:27.222349 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:27:27.222349 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 18 15:27:27.222349 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 18 15:27:27.222349 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:27:27.222349 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 18 15:27:27.222349 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 1 Oct 18 15:27:27.222349 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:27:27.222349 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:27:27.222349 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:27:27.222349 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:27:27.222349 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:27:27.222349 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:27:27.222349 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:27:27.222349 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:27:27.224082 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:27:27.224082 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:27:27.224082 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 15:27:27.224082 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 15:27:27.224082 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 15:27:27.224082 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 15:27:27.224082 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 15:27:27.224082 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 15:27:27.224082 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 18 15:27:27.224082 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:27:27.224082 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:27:27.224082 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:27:27.224082 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:27:27.224082 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:27:27.224082 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:27:27.224082 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 15:27:27.224082 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 15:27:27.224082 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 18 15:27:27.224082 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:27:27.225499 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a02df51e-bb3a-4217-9735-3d41f69dc71a tempest-ServersAdminNegativeTestJSON-1620600410 tempest-ServersAdminNegativeTestJSON-1620600410-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:27:27.225499 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a02df51e-bb3a-4217-9735-3d41f69dc71a tempest-ServersAdminNegativeTestJSON-1620600410 tempest-ServersAdminNegativeTestJSON-1620600410-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/c3a3dd99-9387-4e73-a32d-e0c995b2b8b9/action" status: 400 len: 120 microversion: 2.1 time: 0.021169 Oct 18 15:27:27.226752 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 419/802] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:27:27 2022] POST /compute/v2.1/servers/c3a3dd99-9387-4e73-a32d-e0c995b2b8b9/action => generated 120 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:27:27.242273 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bdf94fd3-eec4-4a5c-b137-5658c918d066 tempest-ServersAdminNegativeTestJSON-1620600410 tempest-ServersAdminNegativeTestJSON-1620600410-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:27:27.245156 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bdf94fd3-eec4-4a5c-b137-5658c918d066 tempest-ServersAdminNegativeTestJSON-1620600410 tempest-ServersAdminNegativeTestJSON-1620600410-project-admin] Failed to fetch instance by id 999 {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 18 15:27:27.251456 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-bdf94fd3-eec4-4a5c-b137-5658c918d066 tempest-ServersAdminNegativeTestJSON-1620600410 tempest-ServersAdminNegativeTestJSON-1620600410-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 18 15:27:27.253527 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bdf94fd3-eec4-4a5c-b137-5658c918d066 tempest-ServersAdminNegativeTestJSON-1620600410 tempest-ServersAdminNegativeTestJSON-1620600410-project-admin] Request method failure captured: Oct 18 15:27:27.253527 n-d-853682-5 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 18 15:27:27.253527 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:27:27.253527 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:27:27.253527 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:27:27.253527 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 37 Oct 18 15:27:27.253527 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:27:27.253527 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:27:27.253527 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:27:27.253527 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:27:27.253527 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsWq1dpMgzIsCWRY0F892VDgNvUvxfWzvxFptNz49mY3aWwE5Vb_K0JSfxO6p36gZKw6w9GIwHT55uY3_yyws0qe6Lmr8jGy1By-l-727jpAlT2J6qSutb75upX7Kiu82-G4IdT27ihwE_LVkwS6fKOnplL_Ld5wOoSPB5hDUAQ1loE Oct 18 15:27:27.253527 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:27:27.253527 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:27:27.253527 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:27:27.253527 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:27:27.253527 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:27:27.253527 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:27:27.253527 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: ad0780e3e2474c07836a17475bdf3ab4 Oct 18 15:27:27.253527 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1620600410 Oct 18 15:27:27.253527 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,admin,reader Oct 18 15:27:27.253527 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,admin,reader Oct 18 15:27:27.255029 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ad0780e3e2474c07836a17475bdf3ab4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ad0780e3e2474c07836a17475bdf3ab4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ad0780e3e2474c07836a17475bdf3ab4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ad0780e3e2474c07836a17475bdf3ab4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:27:27.255029 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1620600410 Oct 18 15:27:27.255029 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: ad0780e3e2474c07836a17475bdf3ab4 Oct 18 15:27:27.255029 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1620600410 Oct 18 15:27:27.255029 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersAdminNegativeTestJSON-1620600410-project-admin Oct 18 15:27:27.255029 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:27:27.255029 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:27:27.255029 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 4c637bbfb0214b919c1275198a2e0829 Oct 18 15:27:27.255029 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1620600410-project-admin Oct 18 15:27:27.255029 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:27:27.255029 n-d-853682-5 devstack@n-api.service[120406]: {"os-resetState": {"state": "error"}} Oct 18 15:27:27.255029 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:27:27.255029 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 999 could not be found. Oct 18 15:27:27.255809 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 18 15:27:27.255809 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:27:27.255809 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:27:27.255809 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:27:27.255809 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:27:27.255809 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 18 15:27:27.255809 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 18 15:27:27.255809 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 18 15:27:27.255809 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:27:27.255809 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:27:27.255809 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:27:27.255809 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:27:27.255809 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:27:27.255809 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:27:27.255809 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:27:27.255809 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:27:27.255809 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:27:27.255809 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:27:27.255809 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:27:27.255809 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:27:27.255809 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 18 15:27:27.257160 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 18 15:27:27.257160 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:27:27.257160 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:27:27.257160 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 18 15:27:27.257160 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:27:27.257160 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:27:27.257160 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:27:27.257160 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:27:27.257160 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:27:27.257160 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:27:27.257160 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:27:27.257160 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:27:27.257160 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 18 15:27:27.257160 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:27:27.260799 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bdf94fd3-eec4-4a5c-b137-5658c918d066 tempest-ServersAdminNegativeTestJSON-1620600410 tempest-ServersAdminNegativeTestJSON-1620600410-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:27:27.261666 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bdf94fd3-eec4-4a5c-b137-5658c918d066 tempest-ServersAdminNegativeTestJSON-1620600410 tempest-ServersAdminNegativeTestJSON-1620600410-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.033945 Oct 18 15:27:27.271586 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 420/803] 10.222.0.60 () {60 vars in 1179 bytes} [Tue Oct 18 15:27:27 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 15:27:27.277145 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-755b1173-a1e5-407a-9dc7-0ccde7adeb22 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:27.278011 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-755b1173-a1e5-407a-9dc7-0ccde7adeb22 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] [instance: aab97ea8-6772-407f-a9f9-60f05d27cbfb] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:27.284904 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-755b1173-a1e5-407a-9dc7-0ccde7adeb22 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:27.285630 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-755b1173-a1e5-407a-9dc7-0ccde7adeb22 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:27.286230 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-755b1173-a1e5-407a-9dc7-0ccde7adeb22 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:27.287212 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-755b1173-a1e5-407a-9dc7-0ccde7adeb22 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:27.287902 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-755b1173-a1e5-407a-9dc7-0ccde7adeb22 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:27.288563 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-755b1173-a1e5-407a-9dc7-0ccde7adeb22 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:27.319392 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-755b1173-a1e5-407a-9dc7-0ccde7adeb22 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] [instance: aab97ea8-6772-407f-a9f9-60f05d27cbfb] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:27:27.441163 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9dfcdd71-640a-4d6e-aa98-ac0b428c6ec6 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] 10.222.0.60 "GET /compute/v2.1/servers/22a2d6cf-565b-488b-8f9b-2b992b25cc32/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.319215 Oct 18 15:27:27.442087 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 384/804] 10.222.0.60 () {58 vars in 1275 bytes} [Tue Oct 18 15:27:27 2022] GET /compute/v2.1/servers/22a2d6cf-565b-488b-8f9b-2b992b25cc32/os-interface => generated 285 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:27:27.480883 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-05a9084b-8969-4727-832d-adbac6776c2e tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:27.481516 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-05a9084b-8969-4727-832d-adbac6776c2e tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: 21ed44b3-c1df-4099-a1ca-a8b167fc3890] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:27.493054 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-755b1173-a1e5-407a-9dc7-0ccde7adeb22 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] 10.222.0.60 "DELETE /compute/v2.1/servers/aab97ea8-6772-407f-a9f9-60f05d27cbfb" status: 204 len: 0 microversion: 2.1 time: 0.219625 Oct 18 15:27:27.493698 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 421/805] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:27:27 2022] DELETE /compute/v2.1/servers/aab97ea8-6772-407f-a9f9-60f05d27cbfb => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:27:27.498321 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-05a9084b-8969-4727-832d-adbac6776c2e tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:27.505688 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-05a9084b-8969-4727-832d-adbac6776c2e tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:27.506259 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-05a9084b-8969-4727-832d-adbac6776c2e tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:27.507141 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-05a9084b-8969-4727-832d-adbac6776c2e tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:27.507701 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-05a9084b-8969-4727-832d-adbac6776c2e tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:27.508192 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-05a9084b-8969-4727-832d-adbac6776c2e tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:27.511973 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-47c0d026-fa7d-4237-9fb4-ab4230915d0a tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:27.513659 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-47c0d026-fa7d-4237-9fb4-ab4230915d0a tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] [instance: aab97ea8-6772-407f-a9f9-60f05d27cbfb] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:27.523853 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47c0d026-fa7d-4237-9fb4-ab4230915d0a tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:27.525974 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47c0d026-fa7d-4237-9fb4-ab4230915d0a tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:27.527654 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47c0d026-fa7d-4237-9fb4-ab4230915d0a tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:27.529664 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47c0d026-fa7d-4237-9fb4-ab4230915d0a tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:27.532287 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47c0d026-fa7d-4237-9fb4-ab4230915d0a tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:27.533408 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47c0d026-fa7d-4237-9fb4-ab4230915d0a tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:28.055203 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-47c0d026-fa7d-4237-9fb4-ab4230915d0a tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7357f1c14a544016bba5abeee15f7a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c87221eb94488ba2e0fdd41386b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:28.061365 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-05a9084b-8969-4727-832d-adbac6776c2e tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1023300147f463e8f0894981948f825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac07f1b2c83a4faab175a5b9ed8e315e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:28.071465 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-47c0d026-fa7d-4237-9fb4-ab4230915d0a tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] 10.222.0.60 "GET /compute/v2.1/servers/aab97ea8-6772-407f-a9f9-60f05d27cbfb" status: 200 len: 1467 microversion: 2.1 time: 0.573330 Oct 18 15:27:28.072767 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 422/806] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:27 2022] GET /compute/v2.1/servers/aab97ea8-6772-407f-a9f9-60f05d27cbfb => generated 1467 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:28.074053 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-05a9084b-8969-4727-832d-adbac6776c2e tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/21ed44b3-c1df-4099-a1ca-a8b167fc3890" status: 200 len: 1367 microversion: 2.1 time: 0.598441 Oct 18 15:27:28.088833 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 385/807] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:27 2022] GET /compute/v2.1/servers/21ed44b3-c1df-4099-a1ca-a8b167fc3890 => generated 1367 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:28.088833 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3c7793e9-e5ea-452d-84cc-4cae54ddf5e6 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d7541f0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:28.104762 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-848c755a-f688-4885-b7e5-e2d27aaeb193 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:28.108272 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-848c755a-f688-4885-b7e5-e2d27aaeb193 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:28.117916 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-848c755a-f688-4885-b7e5-e2d27aaeb193 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:28.118407 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-848c755a-f688-4885-b7e5-e2d27aaeb193 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:28.121645 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-848c755a-f688-4885-b7e5-e2d27aaeb193 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:28.123702 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-848c755a-f688-4885-b7e5-e2d27aaeb193 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:28.125561 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-848c755a-f688-4885-b7e5-e2d27aaeb193 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:28.128075 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-848c755a-f688-4885-b7e5-e2d27aaeb193 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:28.163912 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3c7793e9-e5ea-452d-84cc-4cae54ddf5e6 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/4cacb5ef-8146-4f19-98d6-b6eb8e8d35e6" status: 200 len: 1412 microversion: 2.1 time: 0.086097 Oct 18 15:27:28.165130 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 386/808] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:27:28 2022] GET /compute/v2.1/images/4cacb5ef-8146-4f19-98d6-b6eb8e8d35e6 => generated 1412 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:28.176940 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9091a73b-8e50-47fd-a7d3-da30028fa9c4 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:28.182363 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9091a73b-8e50-47fd-a7d3-da30028fa9c4 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 61ca6b08-6a75-4b0a-86d7-86aa22cb308e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:28.196195 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9091a73b-8e50-47fd-a7d3-da30028fa9c4 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:28.196903 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9091a73b-8e50-47fd-a7d3-da30028fa9c4 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:28.199931 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9091a73b-8e50-47fd-a7d3-da30028fa9c4 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:28.200767 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9091a73b-8e50-47fd-a7d3-da30028fa9c4 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:28.201280 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9091a73b-8e50-47fd-a7d3-da30028fa9c4 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:28.201715 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9091a73b-8e50-47fd-a7d3-da30028fa9c4 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:28.542842 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9091a73b-8e50-47fd-a7d3-da30028fa9c4 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:28.551506 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9091a73b-8e50-47fd-a7d3-da30028fa9c4 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/61ca6b08-6a75-4b0a-86d7-86aa22cb308e" status: 200 len: 1317 microversion: 2.1 time: 0.385085 Oct 18 15:27:28.557231 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 387/809] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:28 2022] GET /compute/v2.1/servers/61ca6b08-6a75-4b0a-86d7-86aa22cb308e => generated 1317 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:28.695710 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-848c755a-f688-4885-b7e5-e2d27aaeb193 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:28.705629 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-848c755a-f688-4885-b7e5-e2d27aaeb193 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:28.721065 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-848c755a-f688-4885-b7e5-e2d27aaeb193 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:28.723074 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-848c755a-f688-4885-b7e5-e2d27aaeb193 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793" status: 200 len: 1410 microversion: 2.25 time: 0.648338 Oct 18 15:27:28.736838 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 423/810] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:27:28 2022] GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793 => generated 1410 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:27:29.095723 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-24716fa6-a498-446c-a1f6-b71074c0a6aa tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:29.096952 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-24716fa6-a498-446c-a1f6-b71074c0a6aa tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] [instance: aab97ea8-6772-407f-a9f9-60f05d27cbfb] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:29.105676 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cc4562a7-a2d2-4c6d-8b92-847242653a0a tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:29.106914 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cc4562a7-a2d2-4c6d-8b92-847242653a0a tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: 21ed44b3-c1df-4099-a1ca-a8b167fc3890] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:29.122246 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cc4562a7-a2d2-4c6d-8b92-847242653a0a tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:29.125711 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-24716fa6-a498-446c-a1f6-b71074c0a6aa tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:29.127104 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cc4562a7-a2d2-4c6d-8b92-847242653a0a tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:29.127797 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-24716fa6-a498-446c-a1f6-b71074c0a6aa tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:29.130579 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cc4562a7-a2d2-4c6d-8b92-847242653a0a tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:29.132085 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cc4562a7-a2d2-4c6d-8b92-847242653a0a tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:29.132478 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-24716fa6-a498-446c-a1f6-b71074c0a6aa tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:29.133589 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cc4562a7-a2d2-4c6d-8b92-847242653a0a tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:29.134310 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-24716fa6-a498-446c-a1f6-b71074c0a6aa tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:29.136971 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cc4562a7-a2d2-4c6d-8b92-847242653a0a tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:29.137543 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-24716fa6-a498-446c-a1f6-b71074c0a6aa tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:29.138864 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-24716fa6-a498-446c-a1f6-b71074c0a6aa tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:29.207650 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:27:30.122922 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cc4562a7-a2d2-4c6d-8b92-847242653a0a tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1023300147f463e8f0894981948f825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac07f1b2c83a4faab175a5b9ed8e315e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:30.131505 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cc4562a7-a2d2-4c6d-8b92-847242653a0a tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/21ed44b3-c1df-4099-a1ca-a8b167fc3890" status: 200 len: 1367 microversion: 2.1 time: 1.030168 Oct 18 15:27:30.137479 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 424/811] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:29 2022] GET /compute/v2.1/servers/21ed44b3-c1df-4099-a1ca-a8b167fc3890 => generated 1367 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:30.142501 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-38cbef3a-8597-4968-a802-be8558ef82ec tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d616550>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:30.214856 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-24716fa6-a498-446c-a1f6-b71074c0a6aa tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7357f1c14a544016bba5abeee15f7a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c87221eb94488ba2e0fdd41386b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:30.232179 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-24716fa6-a498-446c-a1f6-b71074c0a6aa tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] 10.222.0.60 "GET /compute/v2.1/servers/aab97ea8-6772-407f-a9f9-60f05d27cbfb" status: 200 len: 1467 microversion: 2.1 time: 1.140865 Oct 18 15:27:30.236021 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 388/812] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:29 2022] GET /compute/v2.1/servers/aab97ea8-6772-407f-a9f9-60f05d27cbfb => generated 1467 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:30.241527 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-38cbef3a-8597-4968-a802-be8558ef82ec tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/4cacb5ef-8146-4f19-98d6-b6eb8e8d35e6" status: 200 len: 1412 microversion: 2.1 time: 0.098697 Oct 18 15:27:30.246433 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0ae9e5d4-a2e6-44cf-930f-2c61ff7f5dcd tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:30.250859 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 425/813] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:27:30 2022] GET /compute/v2.1/images/4cacb5ef-8146-4f19-98d6-b6eb8e8d35e6 => generated 1412 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:30.251392 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0ae9e5d4-a2e6-44cf-930f-2c61ff7f5dcd tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 61ca6b08-6a75-4b0a-86d7-86aa22cb308e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:30.262153 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-acfd5532-34d4-47a6-b151-f46ae3237885 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:30.265639 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-acfd5532-34d4-47a6-b151-f46ae3237885 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:30.270951 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0ae9e5d4-a2e6-44cf-930f-2c61ff7f5dcd tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:30.271445 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0ae9e5d4-a2e6-44cf-930f-2c61ff7f5dcd tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:30.274102 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0ae9e5d4-a2e6-44cf-930f-2c61ff7f5dcd tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:30.274877 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0ae9e5d4-a2e6-44cf-930f-2c61ff7f5dcd tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:30.275384 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0ae9e5d4-a2e6-44cf-930f-2c61ff7f5dcd tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:30.275818 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0ae9e5d4-a2e6-44cf-930f-2c61ff7f5dcd tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:30.284192 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-acfd5532-34d4-47a6-b151-f46ae3237885 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:30.286861 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-acfd5532-34d4-47a6-b151-f46ae3237885 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:30.287474 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-acfd5532-34d4-47a6-b151-f46ae3237885 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:30.288496 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-acfd5532-34d4-47a6-b151-f46ae3237885 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:30.289244 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-acfd5532-34d4-47a6-b151-f46ae3237885 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:30.291536 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-acfd5532-34d4-47a6-b151-f46ae3237885 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:31.513963 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-acfd5532-34d4-47a6-b151-f46ae3237885 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:31.517397 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0ae9e5d4-a2e6-44cf-930f-2c61ff7f5dcd tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:31.536008 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0ae9e5d4-a2e6-44cf-930f-2c61ff7f5dcd tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/61ca6b08-6a75-4b0a-86d7-86aa22cb308e" status: 200 len: 1317 microversion: 2.1 time: 1.298638 Oct 18 15:27:31.539696 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-acfd5532-34d4-47a6-b151-f46ae3237885 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:31.544022 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-acfd5532-34d4-47a6-b151-f46ae3237885 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:31.545022 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 389/814] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:30 2022] GET /compute/v2.1/servers/61ca6b08-6a75-4b0a-86d7-86aa22cb308e => generated 1317 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:31.546435 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-acfd5532-34d4-47a6-b151-f46ae3237885 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793" status: 200 len: 1410 microversion: 2.25 time: 1.294178 Oct 18 15:27:31.563394 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 426/815] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:27:30 2022] GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793 => generated 1410 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:27:31.565968 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-baa47408-4dbf-4764-8de2-de827e1390ca tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:31.565968 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-baa47408-4dbf-4764-8de2-de827e1390ca tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] [instance: 22a2d6cf-565b-488b-8f9b-2b992b25cc32] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:31.568143 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-4eb221b0-e76b-4aee-9667-731e08265a46 req-a16dd43a-7079-42b4-b7f6-02f1ebba484c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22a2d6cf-565b-488b-8f9b-2b992b25cc32", "tag": "92ddf833-9eb5-4dca-a962-d9a729856784"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:27:31.582891 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-baa47408-4dbf-4764-8de2-de827e1390ca tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:31.583298 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-baa47408-4dbf-4764-8de2-de827e1390ca tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:31.584356 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-baa47408-4dbf-4764-8de2-de827e1390ca tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:31.593555 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-baa47408-4dbf-4764-8de2-de827e1390ca tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:31.594944 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-baa47408-4dbf-4764-8de2-de827e1390ca tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:31.595660 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-baa47408-4dbf-4764-8de2-de827e1390ca tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:31.602426 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4eb221b0-e76b-4aee-9667-731e08265a46 req-a16dd43a-7079-42b4-b7f6-02f1ebba484c service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:31.603299 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4eb221b0-e76b-4aee-9667-731e08265a46 req-a16dd43a-7079-42b4-b7f6-02f1ebba484c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:31.606206 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4eb221b0-e76b-4aee-9667-731e08265a46 req-a16dd43a-7079-42b4-b7f6-02f1ebba484c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:31.648397 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-4eb221b0-e76b-4aee-9667-731e08265a46 req-a16dd43a-7079-42b4-b7f6-02f1ebba484c service nova] Creating event network-changed:92ddf833-9eb5-4dca-a962-d9a729856784 for instance 22a2d6cf-565b-488b-8f9b-2b992b25cc32 on n-h2-853682-5 Oct 18 15:27:31.663762 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-4eb221b0-e76b-4aee-9667-731e08265a46 req-a16dd43a-7079-42b4-b7f6-02f1ebba484c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105830 Oct 18 15:27:31.668642 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 427/816] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:27:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:27:31.686378 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dfde556d-2970-4189-b3e6-c472cefd887d tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:31.688677 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dfde556d-2970-4189-b3e6-c472cefd887d tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: 21ed44b3-c1df-4099-a1ca-a8b167fc3890] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:31.711300 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfde556d-2970-4189-b3e6-c472cefd887d tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:31.711814 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfde556d-2970-4189-b3e6-c472cefd887d tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:31.712258 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfde556d-2970-4189-b3e6-c472cefd887d tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:31.717187 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfde556d-2970-4189-b3e6-c472cefd887d tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:31.718293 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfde556d-2970-4189-b3e6-c472cefd887d tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:31.718961 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfde556d-2970-4189-b3e6-c472cefd887d tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:32.142347 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dfde556d-2970-4189-b3e6-c472cefd887d tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1023300147f463e8f0894981948f825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac07f1b2c83a4faab175a5b9ed8e315e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:32.154074 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dfde556d-2970-4189-b3e6-c472cefd887d tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/21ed44b3-c1df-4099-a1ca-a8b167fc3890" status: 200 len: 1557 microversion: 2.1 time: 0.484054 Oct 18 15:27:32.154679 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 428/817] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:31 2022] GET /compute/v2.1/servers/21ed44b3-c1df-4099-a1ca-a8b167fc3890 => generated 1557 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:32.175251 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9128f0c2-d167-4f4f-9378-82fe9d123680 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d5f7e50>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:32.280400 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9128f0c2-d167-4f4f-9378-82fe9d123680 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/4cacb5ef-8146-4f19-98d6-b6eb8e8d35e6" status: 200 len: 1412 microversion: 2.1 time: 0.120473 Oct 18 15:27:32.281778 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 429/818] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:27:32 2022] GET /compute/v2.1/images/4cacb5ef-8146-4f19-98d6-b6eb8e8d35e6 => generated 1412 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:32.304158 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ab270642-1c13-4778-a787-58d0a9bcaa59 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:32.306497 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ab270642-1c13-4778-a787-58d0a9bcaa59 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] [instance: aab97ea8-6772-407f-a9f9-60f05d27cbfb] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:32.331118 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab270642-1c13-4778-a787-58d0a9bcaa59 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:32.331621 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab270642-1c13-4778-a787-58d0a9bcaa59 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:32.333590 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab270642-1c13-4778-a787-58d0a9bcaa59 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:32.334696 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab270642-1c13-4778-a787-58d0a9bcaa59 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:32.335183 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab270642-1c13-4778-a787-58d0a9bcaa59 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:32.335623 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab270642-1c13-4778-a787-58d0a9bcaa59 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:32.550728 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ab270642-1c13-4778-a787-58d0a9bcaa59 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7357f1c14a544016bba5abeee15f7a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c87221eb94488ba2e0fdd41386b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:32.564936 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ab270642-1c13-4778-a787-58d0a9bcaa59 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] 10.222.0.60 "GET /compute/v2.1/servers/aab97ea8-6772-407f-a9f9-60f05d27cbfb" status: 200 len: 1425 microversion: 2.1 time: 0.277996 Oct 18 15:27:32.567595 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 430/819] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:32 2022] GET /compute/v2.1/servers/aab97ea8-6772-407f-a9f9-60f05d27cbfb => generated 1425 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:32.576159 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ea274a40-ee7d-4908-bc4c-f3b265d88ab2 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:32.577027 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ea274a40-ee7d-4908-bc4c-f3b265d88ab2 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: 21ed44b3-c1df-4099-a1ca-a8b167fc3890] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:32.583747 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea274a40-ee7d-4908-bc4c-f3b265d88ab2 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:32.584530 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea274a40-ee7d-4908-bc4c-f3b265d88ab2 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:32.585224 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea274a40-ee7d-4908-bc4c-f3b265d88ab2 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:32.586161 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea274a40-ee7d-4908-bc4c-f3b265d88ab2 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:32.586846 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea274a40-ee7d-4908-bc4c-f3b265d88ab2 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:32.587689 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea274a40-ee7d-4908-bc4c-f3b265d88ab2 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:32.671138 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-baa47408-4dbf-4764-8de2-de827e1390ca tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2bbb8b77794404af993e8291343afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6facda3e46640c884583aaf146a8b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:32.709680 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-baa47408-4dbf-4764-8de2-de827e1390ca tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] 10.222.0.60 "GET /compute/v2.1/servers/22a2d6cf-565b-488b-8f9b-2b992b25cc32" status: 200 len: 1587 microversion: 2.1 time: 1.156656 Oct 18 15:27:32.717577 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 390/820] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:31 2022] GET /compute/v2.1/servers/22a2d6cf-565b-488b-8f9b-2b992b25cc32 => generated 1587 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:32.731596 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-f6c0045e-f744-43cc-9b20-9f18709779f8 req-d11a10e5-1fe5-47b0-acc4-bb69c5b71adf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aab97ea8-6772-407f-a9f9-60f05d27cbfb", "name": "network-vif-deleted", "tag": "265155be-790e-460e-bb12-369a3b6831f8"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:27:32.745952 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-f6c0045e-f744-43cc-9b20-9f18709779f8 req-d11a10e5-1fe5-47b0-acc4-bb69c5b71adf service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:32.746826 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-f6c0045e-f744-43cc-9b20-9f18709779f8 req-d11a10e5-1fe5-47b0-acc4-bb69c5b71adf service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:32.747819 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-f6c0045e-f744-43cc-9b20-9f18709779f8 req-d11a10e5-1fe5-47b0-acc4-bb69c5b71adf service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:32.761665 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-f6c0045e-f744-43cc-9b20-9f18709779f8 req-d11a10e5-1fe5-47b0-acc4-bb69c5b71adf service nova] Creating event network-vif-deleted:265155be-790e-460e-bb12-369a3b6831f8 for instance aab97ea8-6772-407f-a9f9-60f05d27cbfb on n-h1-853682-5 Oct 18 15:27:32.767749 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-f6c0045e-f744-43cc-9b20-9f18709779f8 req-d11a10e5-1fe5-47b0-acc4-bb69c5b71adf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048715 Oct 18 15:27:32.772990 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 391/821] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:27:32.774431 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-eb268dd1-71fc-444e-ad34-c2cebf11e1ad tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:32.776402 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-eb268dd1-71fc-444e-ad34-c2cebf11e1ad tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 61ca6b08-6a75-4b0a-86d7-86aa22cb308e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:32.784503 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eb268dd1-71fc-444e-ad34-c2cebf11e1ad tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:32.785333 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eb268dd1-71fc-444e-ad34-c2cebf11e1ad tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:32.785989 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eb268dd1-71fc-444e-ad34-c2cebf11e1ad tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:32.787010 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eb268dd1-71fc-444e-ad34-c2cebf11e1ad tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:32.787562 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eb268dd1-71fc-444e-ad34-c2cebf11e1ad tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:32.788079 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eb268dd1-71fc-444e-ad34-c2cebf11e1ad tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:32.820210 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ea274a40-ee7d-4908-bc4c-f3b265d88ab2 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/21ed44b3-c1df-4099-a1ca-a8b167fc3890/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.250369 Oct 18 15:27:32.821385 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 431/822] 10.222.0.60 () {58 vars in 1275 bytes} [Tue Oct 18 15:27:32 2022] GET /compute/v2.1/servers/21ed44b3-c1df-4099-a1ca-a8b167fc3890/os-interface => generated 285 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:27:32.826879 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-484d43b3-68ca-4b86-afab-05440196fdb1 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:32.827578 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-484d43b3-68ca-4b86-afab-05440196fdb1 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:32.860375 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-484d43b3-68ca-4b86-afab-05440196fdb1 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:32.866467 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-484d43b3-68ca-4b86-afab-05440196fdb1 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:32.867354 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-484d43b3-68ca-4b86-afab-05440196fdb1 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:32.869877 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-484d43b3-68ca-4b86-afab-05440196fdb1 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:32.870821 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-484d43b3-68ca-4b86-afab-05440196fdb1 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:32.889086 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=4 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:27:32.889497 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-484d43b3-68ca-4b86-afab-05440196fdb1 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:32.895116 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=12 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:27:33.253478 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-484d43b3-68ca-4b86-afab-05440196fdb1 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:33.266297 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-484d43b3-68ca-4b86-afab-05440196fdb1 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:33.268038 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-484d43b3-68ca-4b86-afab-05440196fdb1 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:33.274476 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-484d43b3-68ca-4b86-afab-05440196fdb1 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793" status: 200 len: 1410 microversion: 2.25 time: 0.451204 Oct 18 15:27:33.276260 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 432/823] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:27:32 2022] GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793 => generated 1410 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:27:33.297699 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f3afa843-4827-4241-858a-3bb88f5d9a60 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d5b8820>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:33.367625 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f3afa843-4827-4241-858a-3bb88f5d9a60 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/4cacb5ef-8146-4f19-98d6-b6eb8e8d35e6" status: 200 len: 1412 microversion: 2.1 time: 0.074120 Oct 18 15:27:33.372948 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 433/824] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:27:33 2022] GET /compute/v2.1/images/4cacb5ef-8146-4f19-98d6-b6eb8e8d35e6 => generated 1412 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:33.515430 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-eb268dd1-71fc-444e-ad34-c2cebf11e1ad tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:33.517861 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:27:33.532267 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-eb268dd1-71fc-444e-ad34-c2cebf11e1ad tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/61ca6b08-6a75-4b0a-86d7-86aa22cb308e" status: 200 len: 1317 microversion: 2.1 time: 0.761706 Oct 18 15:27:33.533395 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 392/825] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:32 2022] GET /compute/v2.1/servers/61ca6b08-6a75-4b0a-86d7-86aa22cb308e => generated 1317 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:33.594720 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-69c70dfe-4854-4883-af41-b940c559d92b tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:33.595318 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-69c70dfe-4854-4883-af41-b940c559d92b tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] [instance: aab97ea8-6772-407f-a9f9-60f05d27cbfb] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:33.597531 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=62 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:27:33.612111 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69c70dfe-4854-4883-af41-b940c559d92b tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:33.619312 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69c70dfe-4854-4883-af41-b940c559d92b tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:33.620210 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69c70dfe-4854-4883-af41-b940c559d92b tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:33.621166 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69c70dfe-4854-4883-af41-b940c559d92b tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:33.622578 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69c70dfe-4854-4883-af41-b940c559d92b tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:33.622993 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69c70dfe-4854-4883-af41-b940c559d92b tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:33.675730 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69c70dfe-4854-4883-af41-b940c559d92b tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:33.676222 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69c70dfe-4854-4883-af41-b940c559d92b tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:33.676647 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69c70dfe-4854-4883-af41-b940c559d92b tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:33.677124 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-69c70dfe-4854-4883-af41-b940c559d92b tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lazy-loading 'fault' on Instance uuid aab97ea8-6772-407f-a9f9-60f05d27cbfb {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:27:33.725069 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-317b3620-e3e6-46fe-96e4-c858420ae69b req-dfe6803c-10d3-4d3d-9aa8-acc1831c1035 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61ca6b08-6a75-4b0a-86d7-86aa22cb308e", "tag": "58bcda15-2a2a-4876-9238-6d661ea3a876"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:27:33.751230 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-317b3620-e3e6-46fe-96e4-c858420ae69b req-dfe6803c-10d3-4d3d-9aa8-acc1831c1035 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:33.751974 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-317b3620-e3e6-46fe-96e4-c858420ae69b req-dfe6803c-10d3-4d3d-9aa8-acc1831c1035 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:33.752713 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-317b3620-e3e6-46fe-96e4-c858420ae69b req-dfe6803c-10d3-4d3d-9aa8-acc1831c1035 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:33.773177 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-317b3620-e3e6-46fe-96e4-c858420ae69b req-dfe6803c-10d3-4d3d-9aa8-acc1831c1035 service nova] Creating event network-changed:58bcda15-2a2a-4876-9238-6d661ea3a876 for instance 61ca6b08-6a75-4b0a-86d7-86aa22cb308e on n-h1-853682-5 Oct 18 15:27:33.779077 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-317b3620-e3e6-46fe-96e4-c858420ae69b req-dfe6803c-10d3-4d3d-9aa8-acc1831c1035 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058774 Oct 18 15:27:33.780376 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 393/826] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:27:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:27:34.162555 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-69c70dfe-4854-4883-af41-b940c559d92b tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7357f1c14a544016bba5abeee15f7a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c87221eb94488ba2e0fdd41386b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:34.175071 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-69c70dfe-4854-4883-af41-b940c559d92b tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] 10.222.0.60 "GET /compute/v2.1/servers/aab97ea8-6772-407f-a9f9-60f05d27cbfb" status: 200 len: 1311 microversion: 2.1 time: 0.584006 Oct 18 15:27:34.176314 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 434/827] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:33 2022] GET /compute/v2.1/servers/aab97ea8-6772-407f-a9f9-60f05d27cbfb => generated 1311 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:34.308788 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-47c36980-1f6b-4b09-92e3-a7acdaeb8f09 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:34.309956 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-47c36980-1f6b-4b09-92e3-a7acdaeb8f09 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:34.318895 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-47c36980-1f6b-4b09-92e3-a7acdaeb8f09 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:34.319670 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-47c36980-1f6b-4b09-92e3-a7acdaeb8f09 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:34.320353 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-47c36980-1f6b-4b09-92e3-a7acdaeb8f09 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:34.321640 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-47c36980-1f6b-4b09-92e3-a7acdaeb8f09 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:34.322198 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-47c36980-1f6b-4b09-92e3-a7acdaeb8f09 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:34.323648 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-47c36980-1f6b-4b09-92e3-a7acdaeb8f09 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:34.389149 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a48b2a30-a763-4e26-82a9-0066e6269be6 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d610550>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:34.440947 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a48b2a30-a763-4e26-82a9-0066e6269be6 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/4cacb5ef-8146-4f19-98d6-b6eb8e8d35e6" status: 200 len: 1421 microversion: 2.1 time: 0.056517 Oct 18 15:27:34.442079 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 435/828] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:27:34 2022] GET /compute/v2.1/images/4cacb5ef-8146-4f19-98d6-b6eb8e8d35e6 => generated 1421 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:27:34.457511 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-80f69af8-76e8-4bc9-bf4c-beb6c58f699d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d69da60>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:34.510252 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-80f69af8-76e8-4bc9-bf4c-beb6c58f699d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/4cacb5ef-8146-4f19-98d6-b6eb8e8d35e6" status: 200 len: 1421 microversion: 2.1 time: 0.057064 Oct 18 15:27:34.511377 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 436/829] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:27:34 2022] GET /compute/v2.1/images/4cacb5ef-8146-4f19-98d6-b6eb8e8d35e6 => generated 1421 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:34.525527 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-125f2c78-c02f-442b-b6d0-bfbd069c5396 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d610b80>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:34.891123 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-47c36980-1f6b-4b09-92e3-a7acdaeb8f09 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:34.902485 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-47c36980-1f6b-4b09-92e3-a7acdaeb8f09 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:34.904149 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-47c36980-1f6b-4b09-92e3-a7acdaeb8f09 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:34.905792 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-47c36980-1f6b-4b09-92e3-a7acdaeb8f09 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793" status: 200 len: 1410 microversion: 2.25 time: 0.603430 Oct 18 15:27:34.926078 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 394/830] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:27:34 2022] GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793 => generated 1410 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:27:34.940210 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b351a011-ee97-4811-8485-a383ecadca69 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:34.940793 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b351a011-ee97-4811-8485-a383ecadca69 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 61ca6b08-6a75-4b0a-86d7-86aa22cb308e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:34.947009 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b351a011-ee97-4811-8485-a383ecadca69 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:34.947499 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b351a011-ee97-4811-8485-a383ecadca69 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:34.947936 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b351a011-ee97-4811-8485-a383ecadca69 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:34.949392 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b351a011-ee97-4811-8485-a383ecadca69 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:34.950197 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b351a011-ee97-4811-8485-a383ecadca69 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:34.950966 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b351a011-ee97-4811-8485-a383ecadca69 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:35.298150 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-125f2c78-c02f-442b-b6d0-bfbd069c5396 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "DELETE /compute/v2.1/images/4cacb5ef-8146-4f19-98d6-b6eb8e8d35e6" status: 204 len: 0 microversion: 2.1 time: 0.776026 Oct 18 15:27:35.302159 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 437/831] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:34 2022] DELETE /compute/v2.1/images/4cacb5ef-8146-4f19-98d6-b6eb8e8d35e6 => generated 0 bytes in 778 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 15:27:35.306994 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-fec6124f-ac86-40ca-afa6-eed6c16c1aad req-962e92fc-0254-43ed-9eb8-54f27a5880b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc806839-862f-4ea7-9078-c970f50b3793", "tag": "6ef23d0f-e4be-4f4e-9d5b-21e8e69f9d6f"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:27:35.317128 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-fec6124f-ac86-40ca-afa6-eed6c16c1aad req-962e92fc-0254-43ed-9eb8-54f27a5880b1 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:35.318517 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-fec6124f-ac86-40ca-afa6-eed6c16c1aad req-962e92fc-0254-43ed-9eb8-54f27a5880b1 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:35.319105 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-fec6124f-ac86-40ca-afa6-eed6c16c1aad req-962e92fc-0254-43ed-9eb8-54f27a5880b1 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:35.331358 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-fec6124f-ac86-40ca-afa6-eed6c16c1aad req-962e92fc-0254-43ed-9eb8-54f27a5880b1 service nova] Creating event network-changed:6ef23d0f-e4be-4f4e-9d5b-21e8e69f9d6f for instance cc806839-862f-4ea7-9078-c970f50b3793 on n-h1-853682-5 Oct 18 15:27:35.336916 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-fec6124f-ac86-40ca-afa6-eed6c16c1aad req-962e92fc-0254-43ed-9eb8-54f27a5880b1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033469 Oct 18 15:27:35.339130 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 438/832] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:27:35.344644 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-978c6674-ecfe-45cf-926c-d55087187e9f tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:35.345566 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-978c6674-ecfe-45cf-926c-d55087187e9f tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] [instance: aab97ea8-6772-407f-a9f9-60f05d27cbfb] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:35.352353 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-978c6674-ecfe-45cf-926c-d55087187e9f tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:35.353208 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-978c6674-ecfe-45cf-926c-d55087187e9f tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:35.354937 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-978c6674-ecfe-45cf-926c-d55087187e9f tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:35.355823 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-978c6674-ecfe-45cf-926c-d55087187e9f tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:35.356434 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-978c6674-ecfe-45cf-926c-d55087187e9f tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:35.357041 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-978c6674-ecfe-45cf-926c-d55087187e9f tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:35.371611 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-978c6674-ecfe-45cf-926c-d55087187e9f tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] HTTP exception thrown: Instance aab97ea8-6772-407f-a9f9-60f05d27cbfb could not be found. Oct 18 15:27:35.373655 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-978c6674-ecfe-45cf-926c-d55087187e9f tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Request method failure captured: Oct 18 15:27:35.373655 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/aab97ea8-6772-407f-a9f9-60f05d27cbfb HTTP/1.1 Oct 18 15:27:35.373655 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:27:35.373655 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:27:35.373655 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:27:35.373655 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:27:35.373655 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:27:35.373655 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:27:35.373655 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:27:35.373655 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:27:35.373655 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsWoY5X63uGK0EVWwYq-wK7hJbeA9VHgyyQ7IkmzoOuT3pc1f4oxRLphyXZc1feoLfb_QqOnUVv5q2nMd5re8kVJx4uwi2OT6GXDx63sTdQRacEcMx30-_V5tdquA-4DwMT25M9woed2FZ_F72wNewhGLCQfzIbqDnJQlL0cxAgeVVw Oct 18 15:27:35.373655 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:27:35.373655 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:27:35.373655 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:27:35.373655 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:27:35.373655 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:27:35.373655 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:27:35.373655 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: d94c87221eb94488ba2e0fdd41386b0c Oct 18 15:27:35.373655 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2003199531 Oct 18 15:27:35.373655 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:27:35.373655 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:27:35.375314 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d94c87221eb94488ba2e0fdd41386b0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d94c87221eb94488ba2e0fdd41386b0c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d94c87221eb94488ba2e0fdd41386b0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d94c87221eb94488ba2e0fdd41386b0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:27:35.375314 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2003199531 Oct 18 15:27:35.375314 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: d94c87221eb94488ba2e0fdd41386b0c Oct 18 15:27:35.375314 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2003199531 Oct 18 15:27:35.375314 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersAdminNegativeTestJSON-2003199531-project Oct 18 15:27:35.375314 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:27:35.375314 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:27:35.375314 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 7357f1c14a544016bba5abeee15f7a6d Oct 18 15:27:35.375314 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2003199531-project Oct 18 15:27:35.375314 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:27:35.375314 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance aab97ea8-6772-407f-a9f9-60f05d27cbfb could not be found. Oct 18 15:27:35.375314 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'aab97ea8-6772-407f-a9f9-60f05d27cbfb'} Oct 18 15:27:35.376229 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:27:35.376229 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:27:35.376229 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:27:35.376229 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:27:35.376229 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:27:35.376229 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:27:35.376229 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:27:35.376229 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:27:35.376229 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:27:35.376229 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:27:35.376229 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aab97ea8-6772-407f-a9f9-60f05d27cbfb could not be found. Oct 18 15:27:35.376229 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:27:35.376229 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:27:35.376229 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:27:35.376229 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:27:35.376229 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:27:35.376229 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:27:35.376229 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:27:35.376229 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:27:35.376229 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:27:35.377699 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:27:35.377699 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:27:35.377699 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:27:35.377699 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:27:35.377699 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:27:35.377699 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:27:35.377699 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:27:35.377699 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aab97ea8-6772-407f-a9f9-60f05d27cbfb could not be found. Oct 18 15:27:35.377699 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:27:35.377699 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:27:35.377699 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:27:35.377699 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:27:35.377699 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:27:35.377699 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:27:35.377699 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:27:35.377699 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:27:35.377699 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aab97ea8-6772-407f-a9f9-60f05d27cbfb could not be found. Oct 18 15:27:35.377699 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:27:35.379699 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-978c6674-ecfe-45cf-926c-d55087187e9f tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Returning 404 to user: Instance aab97ea8-6772-407f-a9f9-60f05d27cbfb could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:27:35.380728 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-978c6674-ecfe-45cf-926c-d55087187e9f tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] 10.222.0.60 "GET /compute/v2.1/servers/aab97ea8-6772-407f-a9f9-60f05d27cbfb" status: 404 len: 111 microversion: 2.1 time: 0.040350 Oct 18 15:27:35.381641 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 439/833] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:35 2022] GET /compute/v2.1/servers/aab97ea8-6772-407f-a9f9-60f05d27cbfb => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:27:35.386856 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-52edf694-abec-477b-8116-fd7831af3b35 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:35.387531 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-52edf694-abec-477b-8116-fd7831af3b35 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: f07f6211-dd0e-4bdd-969c-fff2c3633dd0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:35.393721 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52edf694-abec-477b-8116-fd7831af3b35 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:35.394990 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52edf694-abec-477b-8116-fd7831af3b35 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:35.395609 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52edf694-abec-477b-8116-fd7831af3b35 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:35.396487 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52edf694-abec-477b-8116-fd7831af3b35 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:35.397133 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52edf694-abec-477b-8116-fd7831af3b35 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:35.397700 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52edf694-abec-477b-8116-fd7831af3b35 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:35.421273 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b351a011-ee97-4811-8485-a383ecadca69 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:35.430798 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b351a011-ee97-4811-8485-a383ecadca69 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/61ca6b08-6a75-4b0a-86d7-86aa22cb308e" status: 200 len: 1317 microversion: 2.1 time: 0.503198 Oct 18 15:27:35.432048 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 395/834] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:34 2022] GET /compute/v2.1/servers/61ca6b08-6a75-4b0a-86d7-86aa22cb308e => generated 1317 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:35.437095 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-34ad0afa-f71a-4925-a410-c73ada1f6997 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:35.438002 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-34ad0afa-f71a-4925-a410-c73ada1f6997 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] [instance: c3a3dd99-9387-4e73-a32d-e0c995b2b8b9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:35.444284 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-52edf694-abec-477b-8116-fd7831af3b35 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: f07f6211-dd0e-4bdd-969c-fff2c3633dd0] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:27:35.444977 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-34ad0afa-f71a-4925-a410-c73ada1f6997 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:35.445683 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-34ad0afa-f71a-4925-a410-c73ada1f6997 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:35.447501 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-34ad0afa-f71a-4925-a410-c73ada1f6997 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:35.448647 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-34ad0afa-f71a-4925-a410-c73ada1f6997 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:35.449189 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-34ad0afa-f71a-4925-a410-c73ada1f6997 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:35.449702 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-34ad0afa-f71a-4925-a410-c73ada1f6997 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:35.484016 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-34ad0afa-f71a-4925-a410-c73ada1f6997 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] [instance: c3a3dd99-9387-4e73-a32d-e0c995b2b8b9] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:27:35.612250 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-52edf694-abec-477b-8116-fd7831af3b35 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f07f6211-dd0e-4bdd-969c-fff2c3633dd0" status: 204 len: 0 microversion: 2.1 time: 0.226772 Oct 18 15:27:35.613707 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 440/835] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:27:35 2022] DELETE /compute/v2.1/servers/f07f6211-dd0e-4bdd-969c-fff2c3633dd0 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:27:35.656296 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-34ad0afa-f71a-4925-a410-c73ada1f6997 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c3a3dd99-9387-4e73-a32d-e0c995b2b8b9" status: 204 len: 0 microversion: 2.1 time: 0.222755 Oct 18 15:27:35.658422 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 396/836] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:27:35 2022] DELETE /compute/v2.1/servers/c3a3dd99-9387-4e73-a32d-e0c995b2b8b9 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:27:35.668417 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bf054f16-2e46-404e-875d-e73a899644ef tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:35.676991 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bf054f16-2e46-404e-875d-e73a899644ef tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] [instance: c3a3dd99-9387-4e73-a32d-e0c995b2b8b9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:35.702602 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf054f16-2e46-404e-875d-e73a899644ef tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:35.703522 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf054f16-2e46-404e-875d-e73a899644ef tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:35.706080 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf054f16-2e46-404e-875d-e73a899644ef tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:35.707083 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf054f16-2e46-404e-875d-e73a899644ef tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:35.710358 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf054f16-2e46-404e-875d-e73a899644ef tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:35.711889 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf054f16-2e46-404e-875d-e73a899644ef tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:35.791130 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-28ee446c-d248-4af7-be71-b654af79ad68 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-34733068", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "ef6fe956-3e84-412d-8f85-8f55d9975d85"}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:27:35.870481 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-28ee446c-d248-4af7-be71-b654af79ad68 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] validate_networks() for [('ef6fe956-3e84-412d-8f85-8f55d9975d85', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:27:36.067120 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bf054f16-2e46-404e-875d-e73a899644ef tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7357f1c14a544016bba5abeee15f7a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c87221eb94488ba2e0fdd41386b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:36.082254 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bf054f16-2e46-404e-875d-e73a899644ef tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] 10.222.0.60 "GET /compute/v2.1/servers/c3a3dd99-9387-4e73-a32d-e0c995b2b8b9" status: 200 len: 1477 microversion: 2.1 time: 0.419440 Oct 18 15:27:36.082843 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 441/837] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:35 2022] GET /compute/v2.1/servers/c3a3dd99-9387-4e73-a32d-e0c995b2b8b9 => generated 1477 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:36.088995 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-a4a42b16-de65-4585-87ac-93e13c90661b req-3455b19e-7fe0-4145-b164-c552e1702c0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21ed44b3-c1df-4099-a1ca-a8b167fc3890", "tag": "aa57d87b-6f22-4cfc-9682-ac41b5b434a1"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:27:36.098883 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a4a42b16-de65-4585-87ac-93e13c90661b req-3455b19e-7fe0-4145-b164-c552e1702c0b service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:36.099393 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a4a42b16-de65-4585-87ac-93e13c90661b req-3455b19e-7fe0-4145-b164-c552e1702c0b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:36.099813 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a4a42b16-de65-4585-87ac-93e13c90661b req-3455b19e-7fe0-4145-b164-c552e1702c0b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:36.110999 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-a4a42b16-de65-4585-87ac-93e13c90661b req-3455b19e-7fe0-4145-b164-c552e1702c0b service nova] Creating event network-changed:aa57d87b-6f22-4cfc-9682-ac41b5b434a1 for instance 21ed44b3-c1df-4099-a1ca-a8b167fc3890 on n-h2-853682-5 Oct 18 15:27:36.115934 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-a4a42b16-de65-4585-87ac-93e13c90661b req-3455b19e-7fe0-4145-b164-c552e1702c0b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031239 Oct 18 15:27:36.116523 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 442/838] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:27:36.121546 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c34d8c37-7d39-4c3e-8502-ec9a4b3a941c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:36.122237 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c34d8c37-7d39-4c3e-8502-ec9a4b3a941c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:36.129535 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c34d8c37-7d39-4c3e-8502-ec9a4b3a941c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:36.130189 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c34d8c37-7d39-4c3e-8502-ec9a4b3a941c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:36.130781 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c34d8c37-7d39-4c3e-8502-ec9a4b3a941c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:36.132376 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c34d8c37-7d39-4c3e-8502-ec9a4b3a941c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:36.133007 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c34d8c37-7d39-4c3e-8502-ec9a4b3a941c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:36.133432 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c34d8c37-7d39-4c3e-8502-ec9a4b3a941c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:36.668424 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c34d8c37-7d39-4c3e-8502-ec9a4b3a941c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:36.688343 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c34d8c37-7d39-4c3e-8502-ec9a4b3a941c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:36.692006 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c34d8c37-7d39-4c3e-8502-ec9a4b3a941c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:36.694319 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c34d8c37-7d39-4c3e-8502-ec9a4b3a941c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793" status: 200 len: 1410 microversion: 2.25 time: 0.576194 Oct 18 15:27:36.698220 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 443/839] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:27:36 2022] GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793 => generated 1410 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:27:36.706829 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b5ff3416-0e3f-4892-95d2-8a5a144fcab0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:36.709667 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b5ff3416-0e3f-4892-95d2-8a5a144fcab0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 61ca6b08-6a75-4b0a-86d7-86aa22cb308e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:36.720316 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5ff3416-0e3f-4892-95d2-8a5a144fcab0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:36.721070 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5ff3416-0e3f-4892-95d2-8a5a144fcab0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:36.721681 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5ff3416-0e3f-4892-95d2-8a5a144fcab0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:36.722758 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5ff3416-0e3f-4892-95d2-8a5a144fcab0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:36.723686 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5ff3416-0e3f-4892-95d2-8a5a144fcab0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:36.724378 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5ff3416-0e3f-4892-95d2-8a5a144fcab0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:36.948209 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-28ee446c-d248-4af7-be71-b654af79ad68 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:27:36.948796 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-28ee446c-d248-4af7-be71-b654af79ad68 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:27:36.949123 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-28ee446c-d248-4af7-be71-b654af79ad68 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:27:36.949528 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-28ee446c-d248-4af7-be71-b654af79ad68 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:27:36.949937 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-28ee446c-d248-4af7-be71-b654af79ad68 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:27:36.966285 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-28ee446c-d248-4af7-be71-b654af79ad68 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:36.968510 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-28ee446c-d248-4af7-be71-b654af79ad68 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:36.968980 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-28ee446c-d248-4af7-be71-b654af79ad68 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:36.969738 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-28ee446c-d248-4af7-be71-b654af79ad68 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:36.970191 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-28ee446c-d248-4af7-be71-b654af79ad68 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:36.970606 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-28ee446c-d248-4af7-be71-b654af79ad68 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:36.986274 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b5ff3416-0e3f-4892-95d2-8a5a144fcab0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:37.002323 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b5ff3416-0e3f-4892-95d2-8a5a144fcab0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/61ca6b08-6a75-4b0a-86d7-86aa22cb308e" status: 200 len: 1317 microversion: 2.1 time: 0.302505 Oct 18 15:27:37.005724 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 444/840] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:36 2022] GET /compute/v2.1/servers/61ca6b08-6a75-4b0a-86d7-86aa22cb308e => generated 1317 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:37.011463 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-4eec16f0-c400-4833-a100-8207ee88899a req-54db6869-b0a7-43f3-8d8d-fe1ebf1fd078 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61ca6b08-6a75-4b0a-86d7-86aa22cb308e", "name": "network-vif-plugged", "status": "completed", "tag": "58bcda15-2a2a-4876-9238-6d661ea3a876"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:27:37.039377 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4eec16f0-c400-4833-a100-8207ee88899a req-54db6869-b0a7-43f3-8d8d-fe1ebf1fd078 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:37.043577 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4eec16f0-c400-4833-a100-8207ee88899a req-54db6869-b0a7-43f3-8d8d-fe1ebf1fd078 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:37.044748 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4eec16f0-c400-4833-a100-8207ee88899a req-54db6869-b0a7-43f3-8d8d-fe1ebf1fd078 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:37.044922 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-28ee446c-d248-4af7-be71-b654af79ad68 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Getting quotas for project ee0a3f0c256544beb2df4f113da56137. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:27:37.059173 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-28ee446c-d248-4af7-be71-b654af79ad68 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Getting quotas for user ed9cd936192c40efa9099edee445e90e and project ee0a3f0c256544beb2df4f113da56137. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:27:37.066515 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-4eec16f0-c400-4833-a100-8207ee88899a req-54db6869-b0a7-43f3-8d8d-fe1ebf1fd078 service nova] Creating event network-vif-plugged:58bcda15-2a2a-4876-9238-6d661ea3a876 for instance 61ca6b08-6a75-4b0a-86d7-86aa22cb308e on n-h1-853682-5 Oct 18 15:27:37.076268 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-28ee446c-d248-4af7-be71-b654af79ad68 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:27:37.079849 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-28ee446c-d248-4af7-be71-b654af79ad68 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: dd3fd462-cb66-45c0-92a3-2f9aca2cb16f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:27:37.089239 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-4eec16f0-c400-4833-a100-8207ee88899a req-54db6869-b0a7-43f3-8d8d-fe1ebf1fd078 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082017 Oct 18 15:27:37.090290 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 445/841] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:27:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:27:37.106330 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a0b511c8-d66c-465f-a06f-79593dd21b35 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:37.107022 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a0b511c8-d66c-465f-a06f-79593dd21b35 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] [instance: c3a3dd99-9387-4e73-a32d-e0c995b2b8b9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:37.119952 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0b511c8-d66c-465f-a06f-79593dd21b35 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:37.120437 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0b511c8-d66c-465f-a06f-79593dd21b35 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:37.121249 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0b511c8-d66c-465f-a06f-79593dd21b35 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:37.123196 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0b511c8-d66c-465f-a06f-79593dd21b35 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:37.125824 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0b511c8-d66c-465f-a06f-79593dd21b35 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:37.126652 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0b511c8-d66c-465f-a06f-79593dd21b35 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:37.151174 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-28ee446c-d248-4af7-be71-b654af79ad68 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.363781 Oct 18 15:27:37.152269 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 397/842] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:27:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1367 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:27:37.166160 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6dc0e2e0-47d0-4859-8e56-81e327d29160 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:37.167787 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6dc0e2e0-47d0-4859-8e56-81e327d29160 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: dd3fd462-cb66-45c0-92a3-2f9aca2cb16f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:37.270192 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6dc0e2e0-47d0-4859-8e56-81e327d29160 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:37.281312 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6dc0e2e0-47d0-4859-8e56-81e327d29160 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/dd3fd462-cb66-45c0-92a3-2f9aca2cb16f" status: 200 len: 1206 microversion: 2.1 time: 0.119523 Oct 18 15:27:37.285646 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 398/843] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:37 2022] GET /compute/v2.1/servers/dd3fd462-cb66-45c0-92a3-2f9aca2cb16f => generated 1206 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:37.401808 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a0b511c8-d66c-465f-a06f-79593dd21b35 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7357f1c14a544016bba5abeee15f7a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c87221eb94488ba2e0fdd41386b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:37.412645 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a0b511c8-d66c-465f-a06f-79593dd21b35 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] 10.222.0.60 "GET /compute/v2.1/servers/c3a3dd99-9387-4e73-a32d-e0c995b2b8b9" status: 200 len: 1477 microversion: 2.1 time: 0.310521 Oct 18 15:27:37.416444 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 446/844] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:37 2022] GET /compute/v2.1/servers/c3a3dd99-9387-4e73-a32d-e0c995b2b8b9 => generated 1477 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:27:37.722506 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-62831380-35ac-475f-a026-d0d9e703ada7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:37.723171 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-62831380-35ac-475f-a026-d0d9e703ada7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:37.732697 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-62831380-35ac-475f-a026-d0d9e703ada7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:37.736263 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-62831380-35ac-475f-a026-d0d9e703ada7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:37.737224 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-62831380-35ac-475f-a026-d0d9e703ada7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:37.738222 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-62831380-35ac-475f-a026-d0d9e703ada7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:37.738831 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-62831380-35ac-475f-a026-d0d9e703ada7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:37.741016 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-62831380-35ac-475f-a026-d0d9e703ada7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:37.951767 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-62831380-35ac-475f-a026-d0d9e703ada7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:37.963741 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-62831380-35ac-475f-a026-d0d9e703ada7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:37.965668 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-62831380-35ac-475f-a026-d0d9e703ada7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:37.966849 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-62831380-35ac-475f-a026-d0d9e703ada7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793" status: 200 len: 1410 microversion: 2.25 time: 0.248422 Oct 18 15:27:37.967635 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 399/845] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:27:37 2022] GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793 => generated 1410 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:27:38.028925 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d6922d16-7907-4c9d-b192-403044d816c4 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:38.031462 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d6922d16-7907-4c9d-b192-403044d816c4 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 61ca6b08-6a75-4b0a-86d7-86aa22cb308e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:38.039084 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d6922d16-7907-4c9d-b192-403044d816c4 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:38.039869 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d6922d16-7907-4c9d-b192-403044d816c4 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:38.040297 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d6922d16-7907-4c9d-b192-403044d816c4 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:38.041829 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d6922d16-7907-4c9d-b192-403044d816c4 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:38.042357 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d6922d16-7907-4c9d-b192-403044d816c4 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:38.042856 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d6922d16-7907-4c9d-b192-403044d816c4 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:38.190166 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-81d06114-96d0-4708-ad9a-6a3ff0f35054 req-65a592ec-3d0b-4e5e-b199-e5b4f719ec37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3a3dd99-9387-4e73-a32d-e0c995b2b8b9", "name": "network-vif-deleted", "tag": "fdd8b15f-c862-43e2-b67b-3e615e36105f"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:27:38.209184 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-81d06114-96d0-4708-ad9a-6a3ff0f35054 req-65a592ec-3d0b-4e5e-b199-e5b4f719ec37 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:38.210766 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-81d06114-96d0-4708-ad9a-6a3ff0f35054 req-65a592ec-3d0b-4e5e-b199-e5b4f719ec37 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:38.211801 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-81d06114-96d0-4708-ad9a-6a3ff0f35054 req-65a592ec-3d0b-4e5e-b199-e5b4f719ec37 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:38.226092 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-81d06114-96d0-4708-ad9a-6a3ff0f35054 req-65a592ec-3d0b-4e5e-b199-e5b4f719ec37 service nova] Creating event network-vif-deleted:fdd8b15f-c862-43e2-b67b-3e615e36105f for instance c3a3dd99-9387-4e73-a32d-e0c995b2b8b9 on n-h2-853682-5 Oct 18 15:27:38.232767 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-81d06114-96d0-4708-ad9a-6a3ff0f35054 req-65a592ec-3d0b-4e5e-b199-e5b4f719ec37 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050245 Oct 18 15:27:38.235929 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 400/846] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:27:38.304616 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-48b03bb3-b9e9-46b9-9fea-8cad4ea993fd tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:38.307258 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-48b03bb3-b9e9-46b9-9fea-8cad4ea993fd tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: dd3fd462-cb66-45c0-92a3-2f9aca2cb16f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:38.316755 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-48b03bb3-b9e9-46b9-9fea-8cad4ea993fd tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:38.317518 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-48b03bb3-b9e9-46b9-9fea-8cad4ea993fd tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:38.318151 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-48b03bb3-b9e9-46b9-9fea-8cad4ea993fd tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:38.319739 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-48b03bb3-b9e9-46b9-9fea-8cad4ea993fd tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:38.320336 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-48b03bb3-b9e9-46b9-9fea-8cad4ea993fd tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:38.321343 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-48b03bb3-b9e9-46b9-9fea-8cad4ea993fd tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:38.334450 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d6922d16-7907-4c9d-b192-403044d816c4 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:38.344427 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d6922d16-7907-4c9d-b192-403044d816c4 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/61ca6b08-6a75-4b0a-86d7-86aa22cb308e" status: 200 len: 1317 microversion: 2.1 time: 0.321630 Oct 18 15:27:38.345362 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 447/847] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:38 2022] GET /compute/v2.1/servers/61ca6b08-6a75-4b0a-86d7-86aa22cb308e => generated 1317 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:38.440236 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-70bde360-9a17-401e-a018-6e78e3b061e4 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:38.441152 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-70bde360-9a17-401e-a018-6e78e3b061e4 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] [instance: c3a3dd99-9387-4e73-a32d-e0c995b2b8b9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:38.452300 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70bde360-9a17-401e-a018-6e78e3b061e4 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:38.453026 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70bde360-9a17-401e-a018-6e78e3b061e4 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:38.453633 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70bde360-9a17-401e-a018-6e78e3b061e4 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:38.455110 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70bde360-9a17-401e-a018-6e78e3b061e4 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:38.457918 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70bde360-9a17-401e-a018-6e78e3b061e4 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:38.458566 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70bde360-9a17-401e-a018-6e78e3b061e4 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:38.481217 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-48b03bb3-b9e9-46b9-9fea-8cad4ea993fd tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:38.496879 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:27:38.537331 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-48b03bb3-b9e9-46b9-9fea-8cad4ea993fd tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/dd3fd462-cb66-45c0-92a3-2f9aca2cb16f" status: 200 len: 1210 microversion: 2.1 time: 0.237177 Oct 18 15:27:38.545038 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 401/848] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:38 2022] GET /compute/v2.1/servers/dd3fd462-cb66-45c0-92a3-2f9aca2cb16f => generated 1210 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:27:38.547480 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70bde360-9a17-401e-a018-6e78e3b061e4 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:38.548149 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70bde360-9a17-401e-a018-6e78e3b061e4 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:38.548616 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70bde360-9a17-401e-a018-6e78e3b061e4 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:38.549090 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-70bde360-9a17-401e-a018-6e78e3b061e4 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lazy-loading 'fault' on Instance uuid c3a3dd99-9387-4e73-a32d-e0c995b2b8b9 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:27:38.651021 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-70bde360-9a17-401e-a018-6e78e3b061e4 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7357f1c14a544016bba5abeee15f7a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c87221eb94488ba2e0fdd41386b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:38.663856 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-70bde360-9a17-401e-a018-6e78e3b061e4 tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] 10.222.0.60 "GET /compute/v2.1/servers/c3a3dd99-9387-4e73-a32d-e0c995b2b8b9" status: 200 len: 1312 microversion: 2.1 time: 0.226704 Oct 18 15:27:38.665835 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 448/849] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:38 2022] GET /compute/v2.1/servers/c3a3dd99-9387-4e73-a32d-e0c995b2b8b9 => generated 1312 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:38.995375 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3a02d42d-9aff-42d0-a340-60173c249cdf tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:38.996881 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3a02d42d-9aff-42d0-a340-60173c249cdf tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:39.020536 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3a02d42d-9aff-42d0-a340-60173c249cdf tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:39.021389 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3a02d42d-9aff-42d0-a340-60173c249cdf tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:39.022096 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3a02d42d-9aff-42d0-a340-60173c249cdf tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:39.023926 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3a02d42d-9aff-42d0-a340-60173c249cdf tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:39.024780 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3a02d42d-9aff-42d0-a340-60173c249cdf tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:39.026438 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3a02d42d-9aff-42d0-a340-60173c249cdf tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:39.124355 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-53e703d6-1616-4c32-82d2-b338f8e26429 req-56d14256-ae5f-4e1b-884a-3e3fb3973e4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f07f6211-dd0e-4bdd-969c-fff2c3633dd0", "name": "network-vif-unplugged", "status": "completed", "tag": "e96c8294-ebda-4535-aedc-4d4ece4fa197"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:27:39.139671 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:27:39.142597 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-53e703d6-1616-4c32-82d2-b338f8e26429 req-56d14256-ae5f-4e1b-884a-3e3fb3973e4f service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:39.143164 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-53e703d6-1616-4c32-82d2-b338f8e26429 req-56d14256-ae5f-4e1b-884a-3e3fb3973e4f service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:39.143663 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-53e703d6-1616-4c32-82d2-b338f8e26429 req-56d14256-ae5f-4e1b-884a-3e3fb3973e4f service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:39.160376 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-53e703d6-1616-4c32-82d2-b338f8e26429 req-56d14256-ae5f-4e1b-884a-3e3fb3973e4f service nova] Creating event network-vif-unplugged:e96c8294-ebda-4535-aedc-4d4ece4fa197 for instance f07f6211-dd0e-4bdd-969c-fff2c3633dd0 on n-h1-853682-5 Oct 18 15:27:39.166762 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-53e703d6-1616-4c32-82d2-b338f8e26429 req-56d14256-ae5f-4e1b-884a-3e3fb3973e4f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048378 Oct 18 15:27:39.167775 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 449/850] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:27:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:27:39.368466 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2396529f-f31b-4160-8a22-29578ae4c20c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:39.370577 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2396529f-f31b-4160-8a22-29578ae4c20c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 61ca6b08-6a75-4b0a-86d7-86aa22cb308e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:39.385322 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2396529f-f31b-4160-8a22-29578ae4c20c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:39.387815 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2396529f-f31b-4160-8a22-29578ae4c20c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:39.388488 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2396529f-f31b-4160-8a22-29578ae4c20c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:39.392777 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2396529f-f31b-4160-8a22-29578ae4c20c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:39.394067 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2396529f-f31b-4160-8a22-29578ae4c20c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:39.395074 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2396529f-f31b-4160-8a22-29578ae4c20c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:39.754049 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3a02d42d-9aff-42d0-a340-60173c249cdf tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:39.768566 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3a02d42d-9aff-42d0-a340-60173c249cdf tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:39.770355 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3a02d42d-9aff-42d0-a340-60173c249cdf tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:39.771476 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3a02d42d-9aff-42d0-a340-60173c249cdf tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793" status: 200 len: 1410 microversion: 2.25 time: 0.781428 Oct 18 15:27:39.773305 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 402/851] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:27:38 2022] GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793 => generated 1410 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:27:39.778267 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-437650de-3bf4-4d70-a8ae-53234ea4bbc6 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:39.779092 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-437650de-3bf4-4d70-a8ae-53234ea4bbc6 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: dd3fd462-cb66-45c0-92a3-2f9aca2cb16f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:39.794173 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-437650de-3bf4-4d70-a8ae-53234ea4bbc6 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:39.796477 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-437650de-3bf4-4d70-a8ae-53234ea4bbc6 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:39.796954 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-437650de-3bf4-4d70-a8ae-53234ea4bbc6 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:39.797682 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-437650de-3bf4-4d70-a8ae-53234ea4bbc6 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:39.798139 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-437650de-3bf4-4d70-a8ae-53234ea4bbc6 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:39.798563 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-437650de-3bf4-4d70-a8ae-53234ea4bbc6 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:39.954751 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-437650de-3bf4-4d70-a8ae-53234ea4bbc6 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:39.972432 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-437650de-3bf4-4d70-a8ae-53234ea4bbc6 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/dd3fd462-cb66-45c0-92a3-2f9aca2cb16f" status: 200 len: 1258 microversion: 2.1 time: 0.195517 Oct 18 15:27:39.973118 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 403/852] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:39 2022] GET /compute/v2.1/servers/dd3fd462-cb66-45c0-92a3-2f9aca2cb16f => generated 1258 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:39.985092 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9dbc2060-2e61-4ae3-8ad8-be7121fb94be tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:39.985995 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9dbc2060-2e61-4ae3-8ad8-be7121fb94be tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] [instance: c3a3dd99-9387-4e73-a32d-e0c995b2b8b9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:39.995731 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9dbc2060-2e61-4ae3-8ad8-be7121fb94be tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:39.997896 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9dbc2060-2e61-4ae3-8ad8-be7121fb94be tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:39.998588 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9dbc2060-2e61-4ae3-8ad8-be7121fb94be tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:40.000762 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9dbc2060-2e61-4ae3-8ad8-be7121fb94be tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:40.001307 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9dbc2060-2e61-4ae3-8ad8-be7121fb94be tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:40.002023 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9dbc2060-2e61-4ae3-8ad8-be7121fb94be tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:40.021348 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-9dbc2060-2e61-4ae3-8ad8-be7121fb94be tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] HTTP exception thrown: Instance c3a3dd99-9387-4e73-a32d-e0c995b2b8b9 could not be found. Oct 18 15:27:40.025884 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9dbc2060-2e61-4ae3-8ad8-be7121fb94be tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Request method failure captured: Oct 18 15:27:40.025884 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/c3a3dd99-9387-4e73-a32d-e0c995b2b8b9 HTTP/1.1 Oct 18 15:27:40.025884 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:27:40.025884 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:27:40.025884 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:27:40.025884 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:27:40.025884 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:27:40.025884 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:27:40.025884 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:27:40.025884 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:27:40.025884 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsWoY5X63uGK0EVWwYq-wK7hJbeA9VHgyyQ7IkmzoOuT3pc1f4oxRLphyXZc1feoLfb_QqOnUVv5q2nMd5re8kVJx4uwi2OT6GXDx63sTdQRacEcMx30-_V5tdquA-4DwMT25M9woed2FZ_F72wNewhGLCQfzIbqDnJQlL0cxAgeVVw Oct 18 15:27:40.025884 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:27:40.025884 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:27:40.025884 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:27:40.025884 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:27:40.025884 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:27:40.025884 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:27:40.025884 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: d94c87221eb94488ba2e0fdd41386b0c Oct 18 15:27:40.025884 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2003199531 Oct 18 15:27:40.025884 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:27:40.025884 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:27:40.027501 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d94c87221eb94488ba2e0fdd41386b0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d94c87221eb94488ba2e0fdd41386b0c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d94c87221eb94488ba2e0fdd41386b0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d94c87221eb94488ba2e0fdd41386b0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:27:40.027501 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2003199531 Oct 18 15:27:40.027501 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: d94c87221eb94488ba2e0fdd41386b0c Oct 18 15:27:40.027501 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2003199531 Oct 18 15:27:40.027501 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServersAdminNegativeTestJSON-2003199531-project Oct 18 15:27:40.027501 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:27:40.027501 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:27:40.027501 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 7357f1c14a544016bba5abeee15f7a6d Oct 18 15:27:40.027501 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2003199531-project Oct 18 15:27:40.027501 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:27:40.027501 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance c3a3dd99-9387-4e73-a32d-e0c995b2b8b9 could not be found. Oct 18 15:27:40.027501 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'c3a3dd99-9387-4e73-a32d-e0c995b2b8b9'} Oct 18 15:27:40.028367 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:27:40.028367 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:27:40.028367 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:27:40.028367 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:27:40.028367 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:27:40.028367 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:27:40.028367 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:27:40.028367 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:27:40.028367 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:27:40.028367 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:27:40.028367 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3a3dd99-9387-4e73-a32d-e0c995b2b8b9 could not be found. Oct 18 15:27:40.028367 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:27:40.028367 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:27:40.028367 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:27:40.028367 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:27:40.028367 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:27:40.028367 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:27:40.028367 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:27:40.028367 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:27:40.028367 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:27:40.029708 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:27:40.029708 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:27:40.029708 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:27:40.029708 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:27:40.029708 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:27:40.029708 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:27:40.029708 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:27:40.029708 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3a3dd99-9387-4e73-a32d-e0c995b2b8b9 could not be found. Oct 18 15:27:40.029708 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:27:40.029708 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:27:40.029708 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:27:40.029708 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:27:40.029708 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:27:40.029708 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:27:40.029708 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:27:40.029708 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:27:40.029708 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3a3dd99-9387-4e73-a32d-e0c995b2b8b9 could not be found. Oct 18 15:27:40.029708 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:27:40.033478 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9dbc2060-2e61-4ae3-8ad8-be7121fb94be tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] Returning 404 to user: Instance c3a3dd99-9387-4e73-a32d-e0c995b2b8b9 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:27:40.034523 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9dbc2060-2e61-4ae3-8ad8-be7121fb94be tempest-ServersAdminNegativeTestJSON-2003199531 tempest-ServersAdminNegativeTestJSON-2003199531-project] 10.222.0.60 "GET /compute/v2.1/servers/c3a3dd99-9387-4e73-a32d-e0c995b2b8b9" status: 404 len: 111 microversion: 2.1 time: 0.060256 Oct 18 15:27:40.035083 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 404/853] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:39 2022] GET /compute/v2.1/servers/c3a3dd99-9387-4e73-a32d-e0c995b2b8b9 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:27:40.074862 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2396529f-f31b-4160-8a22-29578ae4c20c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:40.083719 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2396529f-f31b-4160-8a22-29578ae4c20c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/61ca6b08-6a75-4b0a-86d7-86aa22cb308e" status: 200 len: 1317 microversion: 2.1 time: 0.719410 Oct 18 15:27:40.084781 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 450/854] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:39 2022] GET /compute/v2.1/servers/61ca6b08-6a75-4b0a-86d7-86aa22cb308e => generated 1317 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:40.800116 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-14bc0931-169b-41ca-97fa-42c9ab9879c4 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:40.801383 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-14bc0931-169b-41ca-97fa-42c9ab9879c4 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:40.811851 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-14bc0931-169b-41ca-97fa-42c9ab9879c4 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:40.813638 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-14bc0931-169b-41ca-97fa-42c9ab9879c4 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:40.815952 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-14bc0931-169b-41ca-97fa-42c9ab9879c4 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:40.817110 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-14bc0931-169b-41ca-97fa-42c9ab9879c4 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:40.817670 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-14bc0931-169b-41ca-97fa-42c9ab9879c4 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:40.818328 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-14bc0931-169b-41ca-97fa-42c9ab9879c4 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:40.977559 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-8317d846-921b-4a60-9b11-1129d4b53db7 req-487d3c81-8b80-4201-955d-c87d7587bbd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f07f6211-dd0e-4bdd-969c-fff2c3633dd0", "name": "network-vif-deleted", "tag": "e96c8294-ebda-4535-aedc-4d4ece4fa197"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:27:41.022654 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8317d846-921b-4a60-9b11-1129d4b53db7 req-487d3c81-8b80-4201-955d-c87d7587bbd3 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:41.024310 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8317d846-921b-4a60-9b11-1129d4b53db7 req-487d3c81-8b80-4201-955d-c87d7587bbd3 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:41.029863 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8317d846-921b-4a60-9b11-1129d4b53db7 req-487d3c81-8b80-4201-955d-c87d7587bbd3 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:41.541018 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-8317d846-921b-4a60-9b11-1129d4b53db7 req-487d3c81-8b80-4201-955d-c87d7587bbd3 service nova] Creating event network-vif-deleted:e96c8294-ebda-4535-aedc-4d4ece4fa197 for instance f07f6211-dd0e-4bdd-969c-fff2c3633dd0 on n-h1-853682-5 Oct 18 15:27:41.546181 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-8317d846-921b-4a60-9b11-1129d4b53db7 req-487d3c81-8b80-4201-955d-c87d7587bbd3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.573617 Oct 18 15:27:41.547608 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 451/855] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:27:41.553457 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-42916435-8462-4fdd-8f04-10c7b875c854 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:41.555339 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-42916435-8462-4fdd-8f04-10c7b875c854 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: dd3fd462-cb66-45c0-92a3-2f9aca2cb16f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:41.562102 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42916435-8462-4fdd-8f04-10c7b875c854 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:41.562704 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42916435-8462-4fdd-8f04-10c7b875c854 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:41.563243 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42916435-8462-4fdd-8f04-10c7b875c854 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:41.564269 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42916435-8462-4fdd-8f04-10c7b875c854 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:41.564727 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42916435-8462-4fdd-8f04-10c7b875c854 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:41.565518 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42916435-8462-4fdd-8f04-10c7b875c854 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:41.833236 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-42916435-8462-4fdd-8f04-10c7b875c854 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:41.841219 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-42916435-8462-4fdd-8f04-10c7b875c854 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/dd3fd462-cb66-45c0-92a3-2f9aca2cb16f" status: 200 len: 1264 microversion: 2.1 time: 0.292414 Oct 18 15:27:41.841801 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 452/856] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:41 2022] GET /compute/v2.1/servers/dd3fd462-cb66-45c0-92a3-2f9aca2cb16f => generated 1264 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:41.862355 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bd8d7ab1-abdd-40c1-8981-fdb72eb4986a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:41.863227 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bd8d7ab1-abdd-40c1-8981-fdb72eb4986a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 61ca6b08-6a75-4b0a-86d7-86aa22cb308e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:41.870581 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd8d7ab1-abdd-40c1-8981-fdb72eb4986a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:41.871359 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd8d7ab1-abdd-40c1-8981-fdb72eb4986a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:41.871881 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd8d7ab1-abdd-40c1-8981-fdb72eb4986a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:41.872869 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd8d7ab1-abdd-40c1-8981-fdb72eb4986a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:41.873641 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd8d7ab1-abdd-40c1-8981-fdb72eb4986a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:41.874263 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd8d7ab1-abdd-40c1-8981-fdb72eb4986a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:42.107912 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-14bc0931-169b-41ca-97fa-42c9ab9879c4 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:42.123727 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-14bc0931-169b-41ca-97fa-42c9ab9879c4 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:42.127968 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-14bc0931-169b-41ca-97fa-42c9ab9879c4 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:42.129162 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-14bc0931-169b-41ca-97fa-42c9ab9879c4 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793" status: 200 len: 1410 microversion: 2.25 time: 1.333473 Oct 18 15:27:42.132275 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 405/857] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:27:40 2022] GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793 => generated 1410 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:27:42.394551 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bd8d7ab1-abdd-40c1-8981-fdb72eb4986a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:42.403458 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bd8d7ab1-abdd-40c1-8981-fdb72eb4986a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/61ca6b08-6a75-4b0a-86d7-86aa22cb308e" status: 200 len: 1467 microversion: 2.1 time: 0.548857 Oct 18 15:27:42.404137 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 453/858] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:41 2022] GET /compute/v2.1/servers/61ca6b08-6a75-4b0a-86d7-86aa22cb308e => generated 1467 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:42.655013 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1df67fc4-8f70-48b3-8386-318c334de6a6 tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:42.657324 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1df67fc4-8f70-48b3-8386-318c334de6a6 tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] [instance: 61ca6b08-6a75-4b0a-86d7-86aa22cb308e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:42.670588 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1df67fc4-8f70-48b3-8386-318c334de6a6 tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:42.673248 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1df67fc4-8f70-48b3-8386-318c334de6a6 tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:42.673829 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1df67fc4-8f70-48b3-8386-318c334de6a6 tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:42.677308 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1df67fc4-8f70-48b3-8386-318c334de6a6 tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:42.677957 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1df67fc4-8f70-48b3-8386-318c334de6a6 tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:42.678569 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1df67fc4-8f70-48b3-8386-318c334de6a6 tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:42.869954 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-de628823-3139-4623-a14e-11445fca315f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:42.870588 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-de628823-3139-4623-a14e-11445fca315f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: dd3fd462-cb66-45c0-92a3-2f9aca2cb16f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:42.882283 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de628823-3139-4623-a14e-11445fca315f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:42.886114 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de628823-3139-4623-a14e-11445fca315f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:42.886666 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de628823-3139-4623-a14e-11445fca315f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:42.887399 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de628823-3139-4623-a14e-11445fca315f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:42.888923 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de628823-3139-4623-a14e-11445fca315f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:42.889374 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de628823-3139-4623-a14e-11445fca315f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:43.104926 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-de628823-3139-4623-a14e-11445fca315f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:43.117950 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-de628823-3139-4623-a14e-11445fca315f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/dd3fd462-cb66-45c0-92a3-2f9aca2cb16f" status: 200 len: 1264 microversion: 2.1 time: 0.250630 Oct 18 15:27:43.119154 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 454/859] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:42 2022] GET /compute/v2.1/servers/dd3fd462-cb66-45c0-92a3-2f9aca2cb16f => generated 1264 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:43.156764 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-02d73630-df3c-4805-abc1-135d93a998a2 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:43.157765 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-02d73630-df3c-4805-abc1-135d93a998a2 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:43.167924 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02d73630-df3c-4805-abc1-135d93a998a2 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:43.168669 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02d73630-df3c-4805-abc1-135d93a998a2 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:43.170170 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02d73630-df3c-4805-abc1-135d93a998a2 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:43.173455 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02d73630-df3c-4805-abc1-135d93a998a2 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:43.174114 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02d73630-df3c-4805-abc1-135d93a998a2 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:43.174986 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02d73630-df3c-4805-abc1-135d93a998a2 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:43.341388 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1df67fc4-8f70-48b3-8386-318c334de6a6 tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/61ca6b08-6a75-4b0a-86d7-86aa22cb308e" status: 200 len: 1618 microversion: 2.1 time: 0.915752 Oct 18 15:27:43.364920 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 406/860] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:42 2022] GET /compute/v2.1/servers/61ca6b08-6a75-4b0a-86d7-86aa22cb308e => generated 1618 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:43.364920 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-4f28d2db-02c2-4bc0-b468-b5c8d9c4c417 req-4f650768-fd8c-4c25-aba2-41ad42b55b73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc806839-862f-4ea7-9078-c970f50b3793", "name": "network-vif-plugged", "status": "completed", "tag": "6ef23d0f-e4be-4f4e-9d5b-21e8e69f9d6f"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:27:43.370635 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-4f28d2db-02c2-4bc0-b468-b5c8d9c4c417 req-4f650768-fd8c-4c25-aba2-41ad42b55b73 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:43.371343 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-4f28d2db-02c2-4bc0-b468-b5c8d9c4c417 req-4f650768-fd8c-4c25-aba2-41ad42b55b73 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:43.372462 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-4f28d2db-02c2-4bc0-b468-b5c8d9c4c417 req-4f650768-fd8c-4c25-aba2-41ad42b55b73 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:43.393985 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-4f28d2db-02c2-4bc0-b468-b5c8d9c4c417 req-4f650768-fd8c-4c25-aba2-41ad42b55b73 service nova] Creating event network-vif-plugged:6ef23d0f-e4be-4f4e-9d5b-21e8e69f9d6f for instance cc806839-862f-4ea7-9078-c970f50b3793 on n-h1-853682-5 Oct 18 15:27:43.413825 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-4f28d2db-02c2-4bc0-b468-b5c8d9c4c417 req-4f650768-fd8c-4c25-aba2-41ad42b55b73 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063899 Oct 18 15:27:43.415549 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 407/861] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:27:43.431244 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a66ea303-8424-45b8-8938-8cdc9b174652 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Action: 'create', calling method: .version_select at 0x7f7c3d6cf0d0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-255783821", "policies": ["affinity"]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:27:43.516664 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-a66ea303-8424-45b8-8938-8cdc9b174652 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Getting quotas for project 377c3bbd62b546fca545c0f6d0df59e3. Resources: {'server_groups'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:27:43.521685 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:27:43.546490 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-a66ea303-8424-45b8-8938-8cdc9b174652 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Getting quotas for user d58aac335a1d421a95928e2754fb2529 and project 377c3bbd62b546fca545c0f6d0df59e3. Resources: {'server_groups'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:27:43.626897 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-a66ea303-8424-45b8-8938-8cdc9b174652 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Getting quotas for project 377c3bbd62b546fca545c0f6d0df59e3. Resources: {'server_groups'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:27:43.634656 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-a66ea303-8424-45b8-8938-8cdc9b174652 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Getting quotas for user d58aac335a1d421a95928e2754fb2529 and project 377c3bbd62b546fca545c0f6d0df59e3. Resources: {'server_groups'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:27:43.653501 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a66ea303-8424-45b8-8938-8cdc9b174652 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.236063 Oct 18 15:27:43.655164 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 408/862] 10.222.0.60 () {60 vars in 1174 bytes} [Tue Oct 18 15:27:43 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:27:43.778901 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-02d73630-df3c-4805-abc1-135d93a998a2 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:43.791998 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-02d73630-df3c-4805-abc1-135d93a998a2 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:43.800499 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-02d73630-df3c-4805-abc1-135d93a998a2 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:43.802116 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-02d73630-df3c-4805-abc1-135d93a998a2 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793" status: 200 len: 1410 microversion: 2.25 time: 0.649722 Oct 18 15:27:43.803172 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 455/863] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:27:43 2022] GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793 => generated 1410 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:27:43.930611 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9f4168e9-2eda-4f9f-89dc-aca301dbc1fe tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1982632180", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "c0b3f01f-e83d-47cb-abe4-1a5666e6238c"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:27:44.017264 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-9f4168e9-2eda-4f9f-89dc-aca301dbc1fe tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] validate_networks() for None {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:27:44.140599 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a9c0fd7b-3d22-466b-81da-22bd330d4aac tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-1287344655", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": "none"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:27:44.227634 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-a9c0fd7b-3d22-466b-81da-22bd330d4aac tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:27:44.228971 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-a9c0fd7b-3d22-466b-81da-22bd330d4aac tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:27:44.229679 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-a9c0fd7b-3d22-466b-81da-22bd330d4aac tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:27:44.230351 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-a9c0fd7b-3d22-466b-81da-22bd330d4aac tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:27:44.231223 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-a9c0fd7b-3d22-466b-81da-22bd330d4aac tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:27:44.241980 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9c0fd7b-3d22-466b-81da-22bd330d4aac tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:44.242813 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9c0fd7b-3d22-466b-81da-22bd330d4aac tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:44.244119 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9c0fd7b-3d22-466b-81da-22bd330d4aac tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:44.245628 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9c0fd7b-3d22-466b-81da-22bd330d4aac tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:44.246354 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9c0fd7b-3d22-466b-81da-22bd330d4aac tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:44.247345 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9c0fd7b-3d22-466b-81da-22bd330d4aac tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:44.271212 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-a9c0fd7b-3d22-466b-81da-22bd330d4aac tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Getting quotas for project 3c66d69e5e97432481c48f671455f2d8. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:27:44.286697 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-a9c0fd7b-3d22-466b-81da-22bd330d4aac tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Getting quotas for user eefcb4da26a84c2cab78793782a5ada9 and project 3c66d69e5e97432481c48f671455f2d8. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:27:44.325478 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a9c0fd7b-3d22-466b-81da-22bd330d4aac tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:27:44.329805 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a9c0fd7b-3d22-466b-81da-22bd330d4aac tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:27:44.443159 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a9c0fd7b-3d22-466b-81da-22bd330d4aac tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.505806 Oct 18 15:27:44.450502 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 456/864] 10.222.0.60 () {62 vars in 1188 bytes} [Tue Oct 18 15:27:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 513 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 18 15:27:44.461409 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2ad2ad44-188f-4ac9-942e-52817391ee31 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:44.463238 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2ad2ad44-188f-4ac9-942e-52817391ee31 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: dd3fd462-cb66-45c0-92a3-2f9aca2cb16f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:44.479852 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-9f4168e9-2eda-4f9f-89dc-aca301dbc1fe tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:27:44.480425 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-9f4168e9-2eda-4f9f-89dc-aca301dbc1fe tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:27:44.480733 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-9f4168e9-2eda-4f9f-89dc-aca301dbc1fe tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:27:44.481203 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-9f4168e9-2eda-4f9f-89dc-aca301dbc1fe tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:27:44.481994 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-9f4168e9-2eda-4f9f-89dc-aca301dbc1fe tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:27:44.483207 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2ad2ad44-188f-4ac9-942e-52817391ee31 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:44.483710 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2ad2ad44-188f-4ac9-942e-52817391ee31 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:44.484147 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2ad2ad44-188f-4ac9-942e-52817391ee31 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:44.492957 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2ad2ad44-188f-4ac9-942e-52817391ee31 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:44.493533 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2ad2ad44-188f-4ac9-942e-52817391ee31 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:44.493984 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2ad2ad44-188f-4ac9-942e-52817391ee31 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:44.552111 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9f4168e9-2eda-4f9f-89dc-aca301dbc1fe tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:44.559281 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9f4168e9-2eda-4f9f-89dc-aca301dbc1fe tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:44.559888 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9f4168e9-2eda-4f9f-89dc-aca301dbc1fe tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:44.560837 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9f4168e9-2eda-4f9f-89dc-aca301dbc1fe tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:44.561726 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9f4168e9-2eda-4f9f-89dc-aca301dbc1fe tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:44.562296 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9f4168e9-2eda-4f9f-89dc-aca301dbc1fe tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:44.604123 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-9f4168e9-2eda-4f9f-89dc-aca301dbc1fe tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Getting quotas for project 377c3bbd62b546fca545c0f6d0df59e3. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:27:44.622643 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-9f4168e9-2eda-4f9f-89dc-aca301dbc1fe tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Getting quotas for user d58aac335a1d421a95928e2754fb2529 and project 377c3bbd62b546fca545c0f6d0df59e3. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:27:44.640418 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9f4168e9-2eda-4f9f-89dc-aca301dbc1fe tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Going to run 2 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:27:44.643183 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9f4168e9-2eda-4f9f-89dc-aca301dbc1fe tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 92daf2e6-9a72-4b2a-94aa-4316c7edb3c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:27:44.738585 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-9f4168e9-2eda-4f9f-89dc-aca301dbc1fe tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=120405) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 18 15:27:44.765842 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-9f4168e9-2eda-4f9f-89dc-aca301dbc1fe tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Getting quotas for project 377c3bbd62b546fca545c0f6d0df59e3. Resources: {'server_group_members'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:27:44.772618 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-9f4168e9-2eda-4f9f-89dc-aca301dbc1fe tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Getting quotas for user d58aac335a1d421a95928e2754fb2529 and project 377c3bbd62b546fca545c0f6d0df59e3. Resources: {'server_group_members'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:27:44.875900 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2ad2ad44-188f-4ac9-942e-52817391ee31 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:44.886085 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-9f4168e9-2eda-4f9f-89dc-aca301dbc1fe tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Getting quotas for project 377c3bbd62b546fca545c0f6d0df59e3. Resources: {'server_group_members'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:27:44.887001 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2ad2ad44-188f-4ac9-942e-52817391ee31 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/dd3fd462-cb66-45c0-92a3-2f9aca2cb16f" status: 200 len: 1306 microversion: 2.1 time: 0.435762 Oct 18 15:27:44.888556 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 457/865] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:44 2022] GET /compute/v2.1/servers/dd3fd462-cb66-45c0-92a3-2f9aca2cb16f => generated 1306 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:44.900448 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-82cdf8d1-70c6-40c3-be8a-1809bc7a86fb tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:44.901240 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-82cdf8d1-70c6-40c3-be8a-1809bc7a86fb tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:44.909357 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-9f4168e9-2eda-4f9f-89dc-aca301dbc1fe tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Getting quotas for user d58aac335a1d421a95928e2754fb2529 and project 377c3bbd62b546fca545c0f6d0df59e3. Resources: {'server_group_members'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:27:44.961855 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9f4168e9-2eda-4f9f-89dc-aca301dbc1fe tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 13432f77-a4ba-4dea-a1a7-a47fb9b425b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=92daf2e6-9a72-4b2a-94aa-4316c7edb3c0,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:27:44.990957 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-82cdf8d1-70c6-40c3-be8a-1809bc7a86fb tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:44.999822 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-82cdf8d1-70c6-40c3-be8a-1809bc7a86fb tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:45.001511 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-82cdf8d1-70c6-40c3-be8a-1809bc7a86fb tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:45.042690 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-82cdf8d1-70c6-40c3-be8a-1809bc7a86fb tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1454 microversion: 2.91 time: 0.151616 Oct 18 15:27:45.043701 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 458/866] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:27:44 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1454 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:27:45.048686 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4bf3dcb6-4ed7-4b17-9f7e-8c965b35a471 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:45.049596 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4bf3dcb6-4ed7-4b17-9f7e-8c965b35a471 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:45.063547 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4bf3dcb6-4ed7-4b17-9f7e-8c965b35a471 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:45.067344 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4bf3dcb6-4ed7-4b17-9f7e-8c965b35a471 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:45.069633 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4bf3dcb6-4ed7-4b17-9f7e-8c965b35a471 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:45.070764 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4bf3dcb6-4ed7-4b17-9f7e-8c965b35a471 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:45.072449 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4bf3dcb6-4ed7-4b17-9f7e-8c965b35a471 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:45.073675 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4bf3dcb6-4ed7-4b17-9f7e-8c965b35a471 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:45.075072 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-9f4168e9-2eda-4f9f-89dc-aca301dbc1fe tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Getting quotas for project 377c3bbd62b546fca545c0f6d0df59e3. Resources: {'server_group_members'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:27:45.084768 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-9f4168e9-2eda-4f9f-89dc-aca301dbc1fe tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Getting quotas for user d58aac335a1d421a95928e2754fb2529 and project 377c3bbd62b546fca545c0f6d0df59e3. Resources: {'server_group_members'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:27:45.161182 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-9f4168e9-2eda-4f9f-89dc-aca301dbc1fe tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Getting quotas for project 377c3bbd62b546fca545c0f6d0df59e3. Resources: {'server_group_members'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:27:45.176232 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-9f4168e9-2eda-4f9f-89dc-aca301dbc1fe tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Getting quotas for user d58aac335a1d421a95928e2754fb2529 and project 377c3bbd62b546fca545c0f6d0df59e3. Resources: {'server_group_members'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:27:45.219133 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9f4168e9-2eda-4f9f-89dc-aca301dbc1fe tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.293615 Oct 18 15:27:45.220587 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 409/867] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:27:43 2022] POST /compute/v2.1/servers => generated 32 bytes in 1296 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 18 15:27:45.243917 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ba1c8285-e3f6-4237-8c56-a9a91d8b82ab tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:45.250650 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ba1c8285-e3f6-4237-8c56-a9a91d8b82ab tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:45.251768 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ba1c8285-e3f6-4237-8c56-a9a91d8b82ab tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Searching by: {'deleted': False, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3'} {{(pid=120405) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 15:27:45.274854 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba1c8285-e3f6-4237-8c56-a9a91d8b82ab tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:45.275566 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba1c8285-e3f6-4237-8c56-a9a91d8b82ab tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:45.276175 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba1c8285-e3f6-4237-8c56-a9a91d8b82ab tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:45.277554 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba1c8285-e3f6-4237-8c56-a9a91d8b82ab tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:45.278549 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba1c8285-e3f6-4237-8c56-a9a91d8b82ab tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:45.279134 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba1c8285-e3f6-4237-8c56-a9a91d8b82ab tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:45.357425 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4bf3dcb6-4ed7-4b17-9f7e-8c965b35a471 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:45.376344 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4bf3dcb6-4ed7-4b17-9f7e-8c965b35a471 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:45.378748 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4bf3dcb6-4ed7-4b17-9f7e-8c965b35a471 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:45.388328 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4bf3dcb6-4ed7-4b17-9f7e-8c965b35a471 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793" status: 200 len: 1410 microversion: 2.25 time: 0.343390 Oct 18 15:27:45.390319 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 459/868] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:27:45 2022] GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793 => generated 1410 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:27:45.469498 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.multi_cell_list [None req-ba1c8285-e3f6-4237-8c56-a9a91d8b82ab tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=120405) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 15:27:45.573495 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-45995ebd-0a83-4ff2-9c2e-1ea55f57b07b req-28433f82-fdbf-4eb3-a1fe-dc58521227a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd3fd462-cb66-45c0-92a3-2f9aca2cb16f", "tag": "860bb5b6-138a-4440-96eb-ea0a81600e4f"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:27:45.611006 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-45995ebd-0a83-4ff2-9c2e-1ea55f57b07b req-28433f82-fdbf-4eb3-a1fe-dc58521227a2 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:45.611767 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-45995ebd-0a83-4ff2-9c2e-1ea55f57b07b req-28433f82-fdbf-4eb3-a1fe-dc58521227a2 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:45.612380 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-45995ebd-0a83-4ff2-9c2e-1ea55f57b07b req-28433f82-fdbf-4eb3-a1fe-dc58521227a2 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:45.643025 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-45995ebd-0a83-4ff2-9c2e-1ea55f57b07b req-28433f82-fdbf-4eb3-a1fe-dc58521227a2 service nova] Creating event network-changed:860bb5b6-138a-4440-96eb-ea0a81600e4f for instance dd3fd462-cb66-45c0-92a3-2f9aca2cb16f on n-h1-853682-5 Oct 18 15:27:45.652183 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-45995ebd-0a83-4ff2-9c2e-1ea55f57b07b req-28433f82-fdbf-4eb3-a1fe-dc58521227a2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083670 Oct 18 15:27:45.656039 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 460/869] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:27:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:27:45.714242 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ba1c8285-e3f6-4237-8c56-a9a91d8b82ab tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 1004 microversion: 2.1 time: 0.484214 Oct 18 15:27:45.716125 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 410/870] 10.222.0.60 () {58 vars in 1125 bytes} [Tue Oct 18 15:27:45 2022] GET /compute/v2.1/servers => generated 1004 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:45.730658 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e1ebec8f-0f4a-4b7a-a6aa-49b176443a70 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:45.731667 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e1ebec8f-0f4a-4b7a-a6aa-49b176443a70 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 13432f77-a4ba-4dea-a1a7-a47fb9b425b9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:45.890499 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e1ebec8f-0f4a-4b7a-a6aa-49b176443a70 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:45.897382 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e1ebec8f-0f4a-4b7a-a6aa-49b176443a70 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/13432f77-a4ba-4dea-a1a7-a47fb9b425b9" status: 200 len: 1219 microversion: 2.1 time: 0.172100 Oct 18 15:27:45.898456 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 461/871] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:45 2022] GET /compute/v2.1/servers/13432f77-a4ba-4dea-a1a7-a47fb9b425b9 => generated 1219 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:45.916796 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8d484db2-8eab-4fb1-9f00-54da36ae7846 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:45.917449 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8d484db2-8eab-4fb1-9f00-54da36ae7846 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: dd3fd462-cb66-45c0-92a3-2f9aca2cb16f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:45.953108 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8d484db2-8eab-4fb1-9f00-54da36ae7846 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:45.953750 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8d484db2-8eab-4fb1-9f00-54da36ae7846 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:45.954203 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8d484db2-8eab-4fb1-9f00-54da36ae7846 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:45.954962 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8d484db2-8eab-4fb1-9f00-54da36ae7846 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:45.955417 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8d484db2-8eab-4fb1-9f00-54da36ae7846 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:45.955850 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8d484db2-8eab-4fb1-9f00-54da36ae7846 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:46.072956 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e9f930b5-bb58-4bcc-ba1d-8197a8bbc3a0 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:46.073602 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e9f930b5-bb58-4bcc-ba1d-8197a8bbc3a0 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:46.083754 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e9f930b5-bb58-4bcc-ba1d-8197a8bbc3a0 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:46.083942 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e9f930b5-bb58-4bcc-ba1d-8197a8bbc3a0 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:46.084380 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e9f930b5-bb58-4bcc-ba1d-8197a8bbc3a0 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:46.085135 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e9f930b5-bb58-4bcc-ba1d-8197a8bbc3a0 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:46.085569 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e9f930b5-bb58-4bcc-ba1d-8197a8bbc3a0 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:46.094692 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e9f930b5-bb58-4bcc-ba1d-8197a8bbc3a0 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:46.336769 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e9f930b5-bb58-4bcc-ba1d-8197a8bbc3a0 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:46.350223 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e9f930b5-bb58-4bcc-ba1d-8197a8bbc3a0 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:46.352559 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e9f930b5-bb58-4bcc-ba1d-8197a8bbc3a0 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:46.359656 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e9f930b5-bb58-4bcc-ba1d-8197a8bbc3a0 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1506 microversion: 2.91 time: 0.290751 Oct 18 15:27:46.361402 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 462/872] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:27:46 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1506 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:27:46.419762 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ca70ceda-4ce2-48dd-ae6d-64da28c0f276 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:46.421035 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ca70ceda-4ce2-48dd-ae6d-64da28c0f276 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:46.442153 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca70ceda-4ce2-48dd-ae6d-64da28c0f276 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:46.444698 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca70ceda-4ce2-48dd-ae6d-64da28c0f276 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:46.448005 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca70ceda-4ce2-48dd-ae6d-64da28c0f276 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:46.451715 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca70ceda-4ce2-48dd-ae6d-64da28c0f276 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:46.454058 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca70ceda-4ce2-48dd-ae6d-64da28c0f276 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:46.457495 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca70ceda-4ce2-48dd-ae6d-64da28c0f276 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:46.757785 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8d484db2-8eab-4fb1-9f00-54da36ae7846 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:46.766240 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8d484db2-8eab-4fb1-9f00-54da36ae7846 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/dd3fd462-cb66-45c0-92a3-2f9aca2cb16f" status: 200 len: 1306 microversion: 2.1 time: 0.854149 Oct 18 15:27:46.766809 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 411/873] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:45 2022] GET /compute/v2.1/servers/dd3fd462-cb66-45c0-92a3-2f9aca2cb16f => generated 1306 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:46.781066 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ca70ceda-4ce2-48dd-ae6d-64da28c0f276 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:46.789961 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ca70ceda-4ce2-48dd-ae6d-64da28c0f276 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:46.791540 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ca70ceda-4ce2-48dd-ae6d-64da28c0f276 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:46.792722 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ca70ceda-4ce2-48dd-ae6d-64da28c0f276 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793" status: 200 len: 1605 microversion: 2.25 time: 0.381249 Oct 18 15:27:46.793347 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 463/874] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:27:46 2022] GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793 => generated 1605 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:27:46.817997 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f4b5716e-bde2-41ca-9517-311d445f97ac tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:46.818602 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f4b5716e-bde2-41ca-9517-311d445f97ac tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:46.825617 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f4b5716e-bde2-41ca-9517-311d445f97ac tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:46.826354 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f4b5716e-bde2-41ca-9517-311d445f97ac tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:46.826787 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f4b5716e-bde2-41ca-9517-311d445f97ac tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:46.827674 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f4b5716e-bde2-41ca-9517-311d445f97ac tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:46.828140 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f4b5716e-bde2-41ca-9517-311d445f97ac tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:46.828568 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f4b5716e-bde2-41ca-9517-311d445f97ac tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:46.924269 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-caee70d3-8e77-4f1e-b39a-c9073b422825 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:46.924993 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-caee70d3-8e77-4f1e-b39a-c9073b422825 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 13432f77-a4ba-4dea-a1a7-a47fb9b425b9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:46.942231 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-caee70d3-8e77-4f1e-b39a-c9073b422825 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:46.942834 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-caee70d3-8e77-4f1e-b39a-c9073b422825 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:46.943347 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-caee70d3-8e77-4f1e-b39a-c9073b422825 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:46.944146 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-caee70d3-8e77-4f1e-b39a-c9073b422825 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:46.944670 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-caee70d3-8e77-4f1e-b39a-c9073b422825 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:46.945216 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-caee70d3-8e77-4f1e-b39a-c9073b422825 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:47.010713 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f4b5716e-bde2-41ca-9517-311d445f97ac tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.196758 Oct 18 15:27:47.012282 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 412/875] 10.222.0.60 () {60 vars in 1316 bytes} [Tue Oct 18 15:27:46 2022] GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793/os-interface => generated 284 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:27:47.063446 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-caee70d3-8e77-4f1e-b39a-c9073b422825 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:47.090520 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-caee70d3-8e77-4f1e-b39a-c9073b422825 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/13432f77-a4ba-4dea-a1a7-a47fb9b425b9" status: 200 len: 1223 microversion: 2.1 time: 0.170194 Oct 18 15:27:47.093997 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 464/876] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:46 2022] GET /compute/v2.1/servers/13432f77-a4ba-4dea-a1a7-a47fb9b425b9 => generated 1223 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:47.392524 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f84a9820-5ce8-48c8-b1ec-a4349e50a8d9 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:47.393186 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f84a9820-5ce8-48c8-b1ec-a4349e50a8d9 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:47.396731 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:27:47.400699 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f84a9820-5ce8-48c8-b1ec-a4349e50a8d9 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:47.401213 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f84a9820-5ce8-48c8-b1ec-a4349e50a8d9 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:47.401644 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f84a9820-5ce8-48c8-b1ec-a4349e50a8d9 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:47.402345 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f84a9820-5ce8-48c8-b1ec-a4349e50a8d9 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:47.402797 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f84a9820-5ce8-48c8-b1ec-a4349e50a8d9 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:47.403218 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f84a9820-5ce8-48c8-b1ec-a4349e50a8d9 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:47.564300 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f84a9820-5ce8-48c8-b1ec-a4349e50a8d9 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:47.566514 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:27:47.580933 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f84a9820-5ce8-48c8-b1ec-a4349e50a8d9 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:47.580933 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f84a9820-5ce8-48c8-b1ec-a4349e50a8d9 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:47.587609 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f84a9820-5ce8-48c8-b1ec-a4349e50a8d9 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1524 microversion: 2.91 time: 0.199773 Oct 18 15:27:47.588468 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 413/877] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:27:47 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1524 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:27:47.790469 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0f5bbec6-478c-4a92-a6e4-1a9b4b300016 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:47.791438 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0f5bbec6-478c-4a92-a6e4-1a9b4b300016 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: dd3fd462-cb66-45c0-92a3-2f9aca2cb16f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:47.800184 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f5bbec6-478c-4a92-a6e4-1a9b4b300016 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:47.801776 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f5bbec6-478c-4a92-a6e4-1a9b4b300016 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:47.802384 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f5bbec6-478c-4a92-a6e4-1a9b4b300016 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:47.803311 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f5bbec6-478c-4a92-a6e4-1a9b4b300016 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:47.803921 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f5bbec6-478c-4a92-a6e4-1a9b4b300016 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:47.804497 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f5bbec6-478c-4a92-a6e4-1a9b4b300016 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:47.999344 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0f5bbec6-478c-4a92-a6e4-1a9b4b300016 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:48.007525 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0f5bbec6-478c-4a92-a6e4-1a9b4b300016 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/dd3fd462-cb66-45c0-92a3-2f9aca2cb16f" status: 200 len: 1306 microversion: 2.1 time: 0.222156 Oct 18 15:27:48.008715 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 465/878] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:47 2022] GET /compute/v2.1/servers/dd3fd462-cb66-45c0-92a3-2f9aca2cb16f => generated 1306 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:48.115777 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-80cf4d66-1403-40a2-a496-610ef1c63e68 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:48.117002 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-80cf4d66-1403-40a2-a496-610ef1c63e68 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 13432f77-a4ba-4dea-a1a7-a47fb9b425b9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:48.127030 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-80cf4d66-1403-40a2-a496-610ef1c63e68 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:48.127744 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-80cf4d66-1403-40a2-a496-610ef1c63e68 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:48.128338 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-80cf4d66-1403-40a2-a496-610ef1c63e68 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:48.129274 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-80cf4d66-1403-40a2-a496-610ef1c63e68 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:48.131297 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-80cf4d66-1403-40a2-a496-610ef1c63e68 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:48.131925 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-80cf4d66-1403-40a2-a496-610ef1c63e68 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:48.211559 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-fe776201-b765-4e9d-9b8f-8802853278f1 req-cc28db57-669c-4c2b-a804-698969177e9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc806839-862f-4ea7-9078-c970f50b3793", "tag": "6ef23d0f-e4be-4f4e-9d5b-21e8e69f9d6f"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:27:48.225905 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-fe776201-b765-4e9d-9b8f-8802853278f1 req-cc28db57-669c-4c2b-a804-698969177e9a service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:48.226669 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-fe776201-b765-4e9d-9b8f-8802853278f1 req-cc28db57-669c-4c2b-a804-698969177e9a service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:48.227248 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-fe776201-b765-4e9d-9b8f-8802853278f1 req-cc28db57-669c-4c2b-a804-698969177e9a service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:48.227389 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-80cf4d66-1403-40a2-a496-610ef1c63e68 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:48.237081 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-80cf4d66-1403-40a2-a496-610ef1c63e68 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/13432f77-a4ba-4dea-a1a7-a47fb9b425b9" status: 200 len: 1215 microversion: 2.1 time: 0.125272 Oct 18 15:27:48.239118 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 414/879] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:48 2022] GET /compute/v2.1/servers/13432f77-a4ba-4dea-a1a7-a47fb9b425b9 => generated 1215 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:48.241169 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-fe776201-b765-4e9d-9b8f-8802853278f1 req-cc28db57-669c-4c2b-a804-698969177e9a service nova] Creating event network-changed:6ef23d0f-e4be-4f4e-9d5b-21e8e69f9d6f for instance cc806839-862f-4ea7-9078-c970f50b3793 on n-h1-853682-5 Oct 18 15:27:48.250303 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-fe776201-b765-4e9d-9b8f-8802853278f1 req-cc28db57-669c-4c2b-a804-698969177e9a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040412 Oct 18 15:27:48.251068 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 466/880] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:27:48.616612 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-61091a9a-1057-4a98-b215-204c3ebd7bc9 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:48.617250 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-61091a9a-1057-4a98-b215-204c3ebd7bc9 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:48.630690 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-61091a9a-1057-4a98-b215-204c3ebd7bc9 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:48.631187 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-61091a9a-1057-4a98-b215-204c3ebd7bc9 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:48.631626 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-61091a9a-1057-4a98-b215-204c3ebd7bc9 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:48.634636 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-61091a9a-1057-4a98-b215-204c3ebd7bc9 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:48.635108 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-61091a9a-1057-4a98-b215-204c3ebd7bc9 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:48.635632 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-61091a9a-1057-4a98-b215-204c3ebd7bc9 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:48.747569 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-61091a9a-1057-4a98-b215-204c3ebd7bc9 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:48.757278 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-61091a9a-1057-4a98-b215-204c3ebd7bc9 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:48.760303 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-61091a9a-1057-4a98-b215-204c3ebd7bc9 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:48.770396 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-61091a9a-1057-4a98-b215-204c3ebd7bc9 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1524 microversion: 2.91 time: 0.158365 Oct 18 15:27:48.776976 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 415/881] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:27:48 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1524 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:27:49.032277 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1f85e684-962f-45a9-8bb2-7da52fa9addd tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:49.033243 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1f85e684-962f-45a9-8bb2-7da52fa9addd tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: dd3fd462-cb66-45c0-92a3-2f9aca2cb16f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:49.041232 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f85e684-962f-45a9-8bb2-7da52fa9addd tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:49.041848 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f85e684-962f-45a9-8bb2-7da52fa9addd tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:49.042386 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f85e684-962f-45a9-8bb2-7da52fa9addd tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:49.043304 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f85e684-962f-45a9-8bb2-7da52fa9addd tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:49.043858 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f85e684-962f-45a9-8bb2-7da52fa9addd tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:49.044382 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f85e684-962f-45a9-8bb2-7da52fa9addd tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:49.236372 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1f85e684-962f-45a9-8bb2-7da52fa9addd tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:49.255961 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1f85e684-962f-45a9-8bb2-7da52fa9addd tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/dd3fd462-cb66-45c0-92a3-2f9aca2cb16f" status: 200 len: 1306 microversion: 2.1 time: 0.228110 Oct 18 15:27:49.273687 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 467/882] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:49 2022] GET /compute/v2.1/servers/dd3fd462-cb66-45c0-92a3-2f9aca2cb16f => generated 1306 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:49.276441 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f3e62c60-8086-4302-b296-228235598569 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:49.277401 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f3e62c60-8086-4302-b296-228235598569 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 13432f77-a4ba-4dea-a1a7-a47fb9b425b9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:49.287179 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f3e62c60-8086-4302-b296-228235598569 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:49.288359 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f3e62c60-8086-4302-b296-228235598569 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:49.289365 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f3e62c60-8086-4302-b296-228235598569 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:49.291480 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f3e62c60-8086-4302-b296-228235598569 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:49.292513 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f3e62c60-8086-4302-b296-228235598569 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:49.293422 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f3e62c60-8086-4302-b296-228235598569 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:49.416846 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f3e62c60-8086-4302-b296-228235598569 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:49.428943 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f3e62c60-8086-4302-b296-228235598569 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/13432f77-a4ba-4dea-a1a7-a47fb9b425b9" status: 200 len: 1215 microversion: 2.1 time: 0.157452 Oct 18 15:27:49.429544 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 416/883] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:49 2022] GET /compute/v2.1/servers/13432f77-a4ba-4dea-a1a7-a47fb9b425b9 => generated 1215 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:49.804241 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-04ed785b-fbf8-41b7-9cc2-d7b077789e83 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:49.805182 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-04ed785b-fbf8-41b7-9cc2-d7b077789e83 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:49.813930 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04ed785b-fbf8-41b7-9cc2-d7b077789e83 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:49.814687 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04ed785b-fbf8-41b7-9cc2-d7b077789e83 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:49.815747 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04ed785b-fbf8-41b7-9cc2-d7b077789e83 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:49.816638 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04ed785b-fbf8-41b7-9cc2-d7b077789e83 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:49.817127 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04ed785b-fbf8-41b7-9cc2-d7b077789e83 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:49.817556 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04ed785b-fbf8-41b7-9cc2-d7b077789e83 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:50.029098 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-04ed785b-fbf8-41b7-9cc2-d7b077789e83 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:50.043644 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-04ed785b-fbf8-41b7-9cc2-d7b077789e83 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:50.045916 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-04ed785b-fbf8-41b7-9cc2-d7b077789e83 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:50.057064 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-04ed785b-fbf8-41b7-9cc2-d7b077789e83 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1512 microversion: 2.91 time: 0.260655 Oct 18 15:27:50.073472 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 468/884] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:27:49 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1512 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:27:50.279291 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1fe99be9-8074-4eb3-95c8-b61871213d6c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:50.280497 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1fe99be9-8074-4eb3-95c8-b61871213d6c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: dd3fd462-cb66-45c0-92a3-2f9aca2cb16f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:50.288124 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1fe99be9-8074-4eb3-95c8-b61871213d6c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:50.288660 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1fe99be9-8074-4eb3-95c8-b61871213d6c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:50.289286 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1fe99be9-8074-4eb3-95c8-b61871213d6c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:50.290594 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1fe99be9-8074-4eb3-95c8-b61871213d6c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:50.291097 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1fe99be9-8074-4eb3-95c8-b61871213d6c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:50.291539 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1fe99be9-8074-4eb3-95c8-b61871213d6c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:50.452263 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-580de321-07f8-4773-8659-227525e1f5f0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:50.452916 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-580de321-07f8-4773-8659-227525e1f5f0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 13432f77-a4ba-4dea-a1a7-a47fb9b425b9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:50.456579 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1fe99be9-8074-4eb3-95c8-b61871213d6c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:50.461032 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-580de321-07f8-4773-8659-227525e1f5f0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:50.461880 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-580de321-07f8-4773-8659-227525e1f5f0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:50.463392 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-580de321-07f8-4773-8659-227525e1f5f0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:50.464480 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-580de321-07f8-4773-8659-227525e1f5f0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:50.465127 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-580de321-07f8-4773-8659-227525e1f5f0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:50.466488 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-580de321-07f8-4773-8659-227525e1f5f0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:50.474798 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1fe99be9-8074-4eb3-95c8-b61871213d6c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/dd3fd462-cb66-45c0-92a3-2f9aca2cb16f" status: 200 len: 1306 microversion: 2.1 time: 0.199480 Oct 18 15:27:50.475752 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 417/885] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:50 2022] GET /compute/v2.1/servers/dd3fd462-cb66-45c0-92a3-2f9aca2cb16f => generated 1306 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:50.544723 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-580de321-07f8-4773-8659-227525e1f5f0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:50.554132 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-580de321-07f8-4773-8659-227525e1f5f0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/13432f77-a4ba-4dea-a1a7-a47fb9b425b9" status: 200 len: 1271 microversion: 2.1 time: 0.105654 Oct 18 15:27:50.555021 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 469/886] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:50 2022] GET /compute/v2.1/servers/13432f77-a4ba-4dea-a1a7-a47fb9b425b9 => generated 1271 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:27:51.087013 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2e58ccc6-aa22-44ed-8a5d-6434fe121ae5 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:51.088900 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2e58ccc6-aa22-44ed-8a5d-6434fe121ae5 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:51.096714 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2e58ccc6-aa22-44ed-8a5d-6434fe121ae5 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:51.097099 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2e58ccc6-aa22-44ed-8a5d-6434fe121ae5 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:51.097548 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2e58ccc6-aa22-44ed-8a5d-6434fe121ae5 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:51.098288 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2e58ccc6-aa22-44ed-8a5d-6434fe121ae5 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:51.098754 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2e58ccc6-aa22-44ed-8a5d-6434fe121ae5 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:51.099183 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2e58ccc6-aa22-44ed-8a5d-6434fe121ae5 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:51.177035 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2e58ccc6-aa22-44ed-8a5d-6434fe121ae5 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:51.187065 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2e58ccc6-aa22-44ed-8a5d-6434fe121ae5 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:51.188592 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2e58ccc6-aa22-44ed-8a5d-6434fe121ae5 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:51.195841 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2e58ccc6-aa22-44ed-8a5d-6434fe121ae5 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1512 microversion: 2.91 time: 0.113087 Oct 18 15:27:51.199023 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 418/887] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:27:51 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1512 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:27:51.500489 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3a9757c6-99d1-4314-a21e-75045e3920b4 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:51.501427 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3a9757c6-99d1-4314-a21e-75045e3920b4 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: dd3fd462-cb66-45c0-92a3-2f9aca2cb16f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:51.509140 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a9757c6-99d1-4314-a21e-75045e3920b4 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:51.509741 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a9757c6-99d1-4314-a21e-75045e3920b4 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:51.510246 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a9757c6-99d1-4314-a21e-75045e3920b4 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:51.511182 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a9757c6-99d1-4314-a21e-75045e3920b4 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:51.511709 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a9757c6-99d1-4314-a21e-75045e3920b4 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:51.512220 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a9757c6-99d1-4314-a21e-75045e3920b4 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:51.515132 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:27:51.578545 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d90e1f92-c992-4a64-b8e2-9379c85e6774 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:51.579156 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d90e1f92-c992-4a64-b8e2-9379c85e6774 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 13432f77-a4ba-4dea-a1a7-a47fb9b425b9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:51.586892 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d90e1f92-c992-4a64-b8e2-9379c85e6774 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:51.588202 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d90e1f92-c992-4a64-b8e2-9379c85e6774 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:51.588913 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d90e1f92-c992-4a64-b8e2-9379c85e6774 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:51.590346 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d90e1f92-c992-4a64-b8e2-9379c85e6774 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:51.590963 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d90e1f92-c992-4a64-b8e2-9379c85e6774 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:51.591555 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d90e1f92-c992-4a64-b8e2-9379c85e6774 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:51.669908 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d90e1f92-c992-4a64-b8e2-9379c85e6774 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:51.678453 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d90e1f92-c992-4a64-b8e2-9379c85e6774 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/13432f77-a4ba-4dea-a1a7-a47fb9b425b9" status: 200 len: 1271 microversion: 2.1 time: 0.103886 Oct 18 15:27:51.685945 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3a9757c6-99d1-4314-a21e-75045e3920b4 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:51.694425 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3a9757c6-99d1-4314-a21e-75045e3920b4 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/dd3fd462-cb66-45c0-92a3-2f9aca2cb16f" status: 200 len: 1306 microversion: 2.1 time: 0.199004 Oct 18 15:27:51.707865 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 470/888] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:51 2022] GET /compute/v2.1/servers/dd3fd462-cb66-45c0-92a3-2f9aca2cb16f => generated 1306 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:51.708121 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 419/889] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:51 2022] GET /compute/v2.1/servers/13432f77-a4ba-4dea-a1a7-a47fb9b425b9 => generated 1271 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:27:52.230764 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-050adec6-1641-4ccc-839e-c409f8e7955d tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:52.231469 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-050adec6-1641-4ccc-839e-c409f8e7955d tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:52.237741 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-050adec6-1641-4ccc-839e-c409f8e7955d tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:52.238291 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-050adec6-1641-4ccc-839e-c409f8e7955d tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:52.238785 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-050adec6-1641-4ccc-839e-c409f8e7955d tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:52.239546 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-050adec6-1641-4ccc-839e-c409f8e7955d tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:52.240078 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-050adec6-1641-4ccc-839e-c409f8e7955d tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:52.240668 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-050adec6-1641-4ccc-839e-c409f8e7955d tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:52.313397 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-050adec6-1641-4ccc-839e-c409f8e7955d tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:52.322438 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-050adec6-1641-4ccc-839e-c409f8e7955d tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:52.323927 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-050adec6-1641-4ccc-839e-c409f8e7955d tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:52.329452 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-050adec6-1641-4ccc-839e-c409f8e7955d tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1512 microversion: 2.91 time: 0.103347 Oct 18 15:27:52.330027 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 471/890] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:27:52 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1512 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:27:52.705361 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e0bd77d2-4eb1-43a8-82f3-781d78d284c8 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:52.705976 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e0bd77d2-4eb1-43a8-82f3-781d78d284c8 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 13432f77-a4ba-4dea-a1a7-a47fb9b425b9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:52.716111 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e0bd77d2-4eb1-43a8-82f3-781d78d284c8 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:52.716705 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e0bd77d2-4eb1-43a8-82f3-781d78d284c8 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:52.717465 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e0bd77d2-4eb1-43a8-82f3-781d78d284c8 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:52.718223 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e0bd77d2-4eb1-43a8-82f3-781d78d284c8 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:52.718692 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e0bd77d2-4eb1-43a8-82f3-781d78d284c8 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:52.719120 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e0bd77d2-4eb1-43a8-82f3-781d78d284c8 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:52.723173 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-533b4192-674f-4bdf-9688-fa7b2b8bd925 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:52.723783 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-533b4192-674f-4bdf-9688-fa7b2b8bd925 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: dd3fd462-cb66-45c0-92a3-2f9aca2cb16f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:52.731337 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-533b4192-674f-4bdf-9688-fa7b2b8bd925 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:52.732021 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-533b4192-674f-4bdf-9688-fa7b2b8bd925 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:52.732885 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-533b4192-674f-4bdf-9688-fa7b2b8bd925 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:52.733965 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-533b4192-674f-4bdf-9688-fa7b2b8bd925 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:52.734580 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-533b4192-674f-4bdf-9688-fa7b2b8bd925 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:52.735004 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-533b4192-674f-4bdf-9688-fa7b2b8bd925 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:52.794464 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e0bd77d2-4eb1-43a8-82f3-781d78d284c8 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:52.802844 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e0bd77d2-4eb1-43a8-82f3-781d78d284c8 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/13432f77-a4ba-4dea-a1a7-a47fb9b425b9" status: 200 len: 1271 microversion: 2.1 time: 0.101352 Oct 18 15:27:52.812892 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 420/891] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:52 2022] GET /compute/v2.1/servers/13432f77-a4ba-4dea-a1a7-a47fb9b425b9 => generated 1271 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:53.037731 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-533b4192-674f-4bdf-9688-fa7b2b8bd925 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:53.047527 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-533b4192-674f-4bdf-9688-fa7b2b8bd925 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/dd3fd462-cb66-45c0-92a3-2f9aca2cb16f" status: 200 len: 1306 microversion: 2.1 time: 0.328787 Oct 18 15:27:53.061559 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 472/892] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:52 2022] GET /compute/v2.1/servers/dd3fd462-cb66-45c0-92a3-2f9aca2cb16f => generated 1306 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:27:53.162824 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-a4c47e35-ae34-43a2-9c6d-5105d88f39bd req-bffc0ab9-85bb-4400-a667-edf6e61ac03c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd3fd462-cb66-45c0-92a3-2f9aca2cb16f", "name": "network-vif-plugged", "status": "completed", "tag": "860bb5b6-138a-4440-96eb-ea0a81600e4f"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:27:53.173460 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-a4c47e35-ae34-43a2-9c6d-5105d88f39bd req-bffc0ab9-85bb-4400-a667-edf6e61ac03c service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:53.174039 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-a4c47e35-ae34-43a2-9c6d-5105d88f39bd req-bffc0ab9-85bb-4400-a667-edf6e61ac03c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:53.174521 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-a4c47e35-ae34-43a2-9c6d-5105d88f39bd req-bffc0ab9-85bb-4400-a667-edf6e61ac03c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:53.191128 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-a4c47e35-ae34-43a2-9c6d-5105d88f39bd req-bffc0ab9-85bb-4400-a667-edf6e61ac03c service nova] Creating event network-vif-plugged:860bb5b6-138a-4440-96eb-ea0a81600e4f for instance dd3fd462-cb66-45c0-92a3-2f9aca2cb16f on n-h1-853682-5 Oct 18 15:27:53.196763 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-a4c47e35-ae34-43a2-9c6d-5105d88f39bd req-bffc0ab9-85bb-4400-a667-edf6e61ac03c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037401 Oct 18 15:27:53.197393 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 421/893] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:27:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:27:53.360015 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-973fea96-a36d-43f8-bd93-d16bb897c252 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:53.360665 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-973fea96-a36d-43f8-bd93-d16bb897c252 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:53.367166 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-973fea96-a36d-43f8-bd93-d16bb897c252 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:53.367662 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-973fea96-a36d-43f8-bd93-d16bb897c252 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:53.368186 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-973fea96-a36d-43f8-bd93-d16bb897c252 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:53.368926 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-973fea96-a36d-43f8-bd93-d16bb897c252 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:53.369387 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-973fea96-a36d-43f8-bd93-d16bb897c252 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:53.369817 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-973fea96-a36d-43f8-bd93-d16bb897c252 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:53.438917 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-973fea96-a36d-43f8-bd93-d16bb897c252 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:53.448267 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-973fea96-a36d-43f8-bd93-d16bb897c252 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:53.450023 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-973fea96-a36d-43f8-bd93-d16bb897c252 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:53.455978 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-973fea96-a36d-43f8-bd93-d16bb897c252 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1512 microversion: 2.91 time: 0.099875 Oct 18 15:27:53.456567 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 473/894] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:27:53 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1512 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:27:53.828570 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-be7c1c5b-f40f-4c4c-9fde-4d61b8674135 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:53.830821 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-be7c1c5b-f40f-4c4c-9fde-4d61b8674135 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 13432f77-a4ba-4dea-a1a7-a47fb9b425b9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:53.846340 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-be7c1c5b-f40f-4c4c-9fde-4d61b8674135 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:53.849606 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-be7c1c5b-f40f-4c4c-9fde-4d61b8674135 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:53.851672 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-be7c1c5b-f40f-4c4c-9fde-4d61b8674135 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:53.854701 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-be7c1c5b-f40f-4c4c-9fde-4d61b8674135 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:53.855341 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-be7c1c5b-f40f-4c4c-9fde-4d61b8674135 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:53.859493 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-be7c1c5b-f40f-4c4c-9fde-4d61b8674135 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:54.060141 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-be7c1c5b-f40f-4c4c-9fde-4d61b8674135 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:54.068256 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-be7c1c5b-f40f-4c4c-9fde-4d61b8674135 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/13432f77-a4ba-4dea-a1a7-a47fb9b425b9" status: 200 len: 1271 microversion: 2.1 time: 0.245129 Oct 18 15:27:54.070834 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 422/895] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:53 2022] GET /compute/v2.1/servers/13432f77-a4ba-4dea-a1a7-a47fb9b425b9 => generated 1271 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:27:54.071567 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7f745825-a3dc-42b8-b4f3-b9a97ca641b9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:54.072450 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7f745825-a3dc-42b8-b4f3-b9a97ca641b9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: dd3fd462-cb66-45c0-92a3-2f9aca2cb16f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:54.080476 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f745825-a3dc-42b8-b4f3-b9a97ca641b9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:54.080997 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f745825-a3dc-42b8-b4f3-b9a97ca641b9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:54.081686 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f745825-a3dc-42b8-b4f3-b9a97ca641b9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:54.082566 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f745825-a3dc-42b8-b4f3-b9a97ca641b9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:54.083181 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f745825-a3dc-42b8-b4f3-b9a97ca641b9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:54.083765 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f745825-a3dc-42b8-b4f3-b9a97ca641b9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:54.259285 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:27:54.335166 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7f745825-a3dc-42b8-b4f3-b9a97ca641b9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:54.349051 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7f745825-a3dc-42b8-b4f3-b9a97ca641b9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/dd3fd462-cb66-45c0-92a3-2f9aca2cb16f" status: 200 len: 1306 microversion: 2.1 time: 0.281435 Oct 18 15:27:54.373138 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 474/896] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:54 2022] GET /compute/v2.1/servers/dd3fd462-cb66-45c0-92a3-2f9aca2cb16f => generated 1306 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:27:54.484968 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d21e0ca8-9ecc-4b88-b976-54caaa6f0613 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:54.485575 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d21e0ca8-9ecc-4b88-b976-54caaa6f0613 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:54.491882 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d21e0ca8-9ecc-4b88-b976-54caaa6f0613 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:54.492374 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d21e0ca8-9ecc-4b88-b976-54caaa6f0613 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:54.492872 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d21e0ca8-9ecc-4b88-b976-54caaa6f0613 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:54.494010 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d21e0ca8-9ecc-4b88-b976-54caaa6f0613 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:54.494698 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d21e0ca8-9ecc-4b88-b976-54caaa6f0613 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:54.495335 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d21e0ca8-9ecc-4b88-b976-54caaa6f0613 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:54.572053 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d21e0ca8-9ecc-4b88-b976-54caaa6f0613 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:54.580832 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d21e0ca8-9ecc-4b88-b976-54caaa6f0613 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:54.582370 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d21e0ca8-9ecc-4b88-b976-54caaa6f0613 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:54.592872 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d21e0ca8-9ecc-4b88-b976-54caaa6f0613 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1533 microversion: 2.91 time: 0.111678 Oct 18 15:27:54.593455 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 423/897] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:27:54 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1533 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:27:54.683489 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-310b5ca6-9182-4021-a8a9-8467fbfe2b6b tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:54.684374 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-310b5ca6-9182-4021-a8a9-8467fbfe2b6b tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:54.697256 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-310b5ca6-9182-4021-a8a9-8467fbfe2b6b tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:54.697755 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-310b5ca6-9182-4021-a8a9-8467fbfe2b6b tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:54.698334 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-310b5ca6-9182-4021-a8a9-8467fbfe2b6b tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:54.699169 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-310b5ca6-9182-4021-a8a9-8467fbfe2b6b tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:54.699653 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-310b5ca6-9182-4021-a8a9-8467fbfe2b6b tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:54.700138 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-310b5ca6-9182-4021-a8a9-8467fbfe2b6b tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:54.851473 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-310b5ca6-9182-4021-a8a9-8467fbfe2b6b tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] Lazy-loading 'services' on Instance uuid 45bc3ebe-2b14-4188-a636-309fd0582617 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:27:54.879850 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-310b5ca6-9182-4021-a8a9-8467fbfe2b6b tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1938 microversion: 2.91 time: 0.262114 Oct 18 15:27:54.888999 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 475/898] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:27:54 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1938 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:27:54.910332 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e227e3ce-0c33-4ab7-b0f8-caf38babf7db tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:54.912215 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e227e3ce-0c33-4ab7-b0f8-caf38babf7db tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:54.931877 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e227e3ce-0c33-4ab7-b0f8-caf38babf7db tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:54.932545 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e227e3ce-0c33-4ab7-b0f8-caf38babf7db tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:54.933151 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e227e3ce-0c33-4ab7-b0f8-caf38babf7db tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:54.934025 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e227e3ce-0c33-4ab7-b0f8-caf38babf7db tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:54.934821 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e227e3ce-0c33-4ab7-b0f8-caf38babf7db tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:54.935377 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e227e3ce-0c33-4ab7-b0f8-caf38babf7db tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:55.081986 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-e227e3ce-0c33-4ab7-b0f8-caf38babf7db tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] Lazy-loading 'services' on Instance uuid 45bc3ebe-2b14-4188-a636-309fd0582617 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:27:55.094613 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3d366f68-b8e4-4d4e-a8b6-ad3033e11613 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:55.095333 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3d366f68-b8e4-4d4e-a8b6-ad3033e11613 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 13432f77-a4ba-4dea-a1a7-a47fb9b425b9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:55.103887 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d366f68-b8e4-4d4e-a8b6-ad3033e11613 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:55.105146 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d366f68-b8e4-4d4e-a8b6-ad3033e11613 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:55.105766 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d366f68-b8e4-4d4e-a8b6-ad3033e11613 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:55.106665 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d366f68-b8e4-4d4e-a8b6-ad3033e11613 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:55.107461 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d366f68-b8e4-4d4e-a8b6-ad3033e11613 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:55.108051 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d366f68-b8e4-4d4e-a8b6-ad3033e11613 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:55.114962 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e227e3ce-0c33-4ab7-b0f8-caf38babf7db tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1938 microversion: 2.91 time: 0.209837 Oct 18 15:27:55.116361 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 424/899] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:27:54 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1938 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:27:55.144688 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d5fec4b6-bbdf-40af-98aa-07398d83a47b tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:55.149041 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d5fec4b6-bbdf-40af-98aa-07398d83a47b tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:55.149571 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d5fec4b6-bbdf-40af-98aa-07398d83a47b tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:55.150043 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d5fec4b6-bbdf-40af-98aa-07398d83a47b tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:55.150862 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d5fec4b6-bbdf-40af-98aa-07398d83a47b tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:55.151324 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d5fec4b6-bbdf-40af-98aa-07398d83a47b tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:55.151751 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d5fec4b6-bbdf-40af-98aa-07398d83a47b tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:55.181794 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d5fec4b6-bbdf-40af-98aa-07398d83a47b tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.041373 Oct 18 15:27:55.182431 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 425/900] 10.222.0.60 () {60 vars in 1217 bytes} [Tue Oct 18 15:27:55 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 15:27:55.199304 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b1d2ff6a-95ac-4266-87ce-7596fb6a3af8 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:27:55.199492 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3d366f68-b8e4-4d4e-a8b6-ad3033e11613 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:55.200752 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b1d2ff6a-95ac-4266-87ce-7596fb6a3af8 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:55.205404 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=38 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:27:55.216087 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3d366f68-b8e4-4d4e-a8b6-ad3033e11613 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/13432f77-a4ba-4dea-a1a7-a47fb9b425b9" status: 200 len: 1279 microversion: 2.1 time: 0.126037 Oct 18 15:27:55.217151 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b1d2ff6a-95ac-4266-87ce-7596fb6a3af8 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:55.217463 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 476/901] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:55 2022] GET /compute/v2.1/servers/13432f77-a4ba-4dea-a1a7-a47fb9b425b9 => generated 1279 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:55.217610 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b1d2ff6a-95ac-4266-87ce-7596fb6a3af8 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:55.218066 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b1d2ff6a-95ac-4266-87ce-7596fb6a3af8 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:55.218783 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b1d2ff6a-95ac-4266-87ce-7596fb6a3af8 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:55.219238 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b1d2ff6a-95ac-4266-87ce-7596fb6a3af8 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:55.219670 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b1d2ff6a-95ac-4266-87ce-7596fb6a3af8 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:55.259766 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-b1d2ff6a-95ac-4266-87ce-7596fb6a3af8 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lazy-loading 'flavor' on Instance uuid 45bc3ebe-2b14-4188-a636-309fd0582617 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:27:55.373412 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-282bdd44-c484-4735-b345-c806b97c6b06 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:55.374761 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-282bdd44-c484-4735-b345-c806b97c6b06 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: dd3fd462-cb66-45c0-92a3-2f9aca2cb16f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:55.382296 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-282bdd44-c484-4735-b345-c806b97c6b06 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:55.383043 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-282bdd44-c484-4735-b345-c806b97c6b06 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:55.383665 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-282bdd44-c484-4735-b345-c806b97c6b06 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:55.384793 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-282bdd44-c484-4735-b345-c806b97c6b06 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:55.388240 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-282bdd44-c484-4735-b345-c806b97c6b06 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:55.389126 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-282bdd44-c484-4735-b345-c806b97c6b06 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:55.577911 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b1d2ff6a-95ac-4266-87ce-7596fb6a3af8 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "POST /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617/action" status: 202 len: 0 microversion: 2.91 time: 0.384243 Oct 18 15:27:55.578514 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 426/902] 10.222.0.60 () {62 vars in 1319 bytes} [Tue Oct 18 15:27:55 2022] POST /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617/action => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:27:55.586494 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-282bdd44-c484-4735-b345-c806b97c6b06 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:55.597924 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-282bdd44-c484-4735-b345-c806b97c6b06 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/dd3fd462-cb66-45c0-92a3-2f9aca2cb16f" status: 200 len: 1306 microversion: 2.1 time: 0.229616 Oct 18 15:27:55.598888 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 477/903] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:55 2022] GET /compute/v2.1/servers/dd3fd462-cb66-45c0-92a3-2f9aca2cb16f => generated 1306 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:27:55.606402 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-63ae5be5-6bb4-4718-994d-ca9b364c8f5d req-de32de40-df60-4e89-9457-8bdb9ccdbbc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92daf2e6-9a72-4b2a-94aa-4316c7edb3c0", "tag": "311e5c1f-7a46-43b7-bc59-f1a84c1c33de"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:27:55.610761 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-58e3b7c2-4acd-48b9-8968-824700b1bdef tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:55.611514 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-58e3b7c2-4acd-48b9-8968-824700b1bdef tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:55.626160 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-63ae5be5-6bb4-4718-994d-ca9b364c8f5d req-de32de40-df60-4e89-9457-8bdb9ccdbbc9 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:55.626647 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-63ae5be5-6bb4-4718-994d-ca9b364c8f5d req-de32de40-df60-4e89-9457-8bdb9ccdbbc9 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:55.627076 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-63ae5be5-6bb4-4718-994d-ca9b364c8f5d req-de32de40-df60-4e89-9457-8bdb9ccdbbc9 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:55.629034 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58e3b7c2-4acd-48b9-8968-824700b1bdef tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:55.629754 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58e3b7c2-4acd-48b9-8968-824700b1bdef tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:55.630187 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58e3b7c2-4acd-48b9-8968-824700b1bdef tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:55.630899 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58e3b7c2-4acd-48b9-8968-824700b1bdef tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:55.631352 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58e3b7c2-4acd-48b9-8968-824700b1bdef tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:55.631777 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58e3b7c2-4acd-48b9-8968-824700b1bdef tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:55.650664 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-63ae5be5-6bb4-4718-994d-ca9b364c8f5d req-de32de40-df60-4e89-9457-8bdb9ccdbbc9 service nova] Creating event network-changed:311e5c1f-7a46-43b7-bc59-f1a84c1c33de for instance 92daf2e6-9a72-4b2a-94aa-4316c7edb3c0 on n-h1-853682-5 Oct 18 15:27:55.657368 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-63ae5be5-6bb4-4718-994d-ca9b364c8f5d req-de32de40-df60-4e89-9457-8bdb9ccdbbc9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077052 Oct 18 15:27:55.658617 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 427/904] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:27:55.739174 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-58e3b7c2-4acd-48b9-8968-824700b1bdef tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:55.749392 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-58e3b7c2-4acd-48b9-8968-824700b1bdef tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:55.751389 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-58e3b7c2-4acd-48b9-8968-824700b1bdef tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:55.757284 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-58e3b7c2-4acd-48b9-8968-824700b1bdef tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1539 microversion: 2.91 time: 0.155328 Oct 18 15:27:55.758289 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 478/905] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:27:55 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1539 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:27:56.242641 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-66da6d76-3c1a-42ba-a488-f24229713bc3 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:56.243750 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-66da6d76-3c1a-42ba-a488-f24229713bc3 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 13432f77-a4ba-4dea-a1a7-a47fb9b425b9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:56.251838 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-66da6d76-3c1a-42ba-a488-f24229713bc3 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:56.252722 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-66da6d76-3c1a-42ba-a488-f24229713bc3 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:56.253442 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-66da6d76-3c1a-42ba-a488-f24229713bc3 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:56.254399 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-66da6d76-3c1a-42ba-a488-f24229713bc3 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:56.254933 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-66da6d76-3c1a-42ba-a488-f24229713bc3 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:56.255434 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-66da6d76-3c1a-42ba-a488-f24229713bc3 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:56.329191 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-66da6d76-3c1a-42ba-a488-f24229713bc3 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:56.340225 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-66da6d76-3c1a-42ba-a488-f24229713bc3 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/13432f77-a4ba-4dea-a1a7-a47fb9b425b9" status: 200 len: 1277 microversion: 2.1 time: 0.103374 Oct 18 15:27:56.341081 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 428/906] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:56 2022] GET /compute/v2.1/servers/13432f77-a4ba-4dea-a1a7-a47fb9b425b9 => generated 1277 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:56.622219 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5f1b87ff-3f3b-44a6-a3cd-8d02a709daab tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:56.623784 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5f1b87ff-3f3b-44a6-a3cd-8d02a709daab tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: dd3fd462-cb66-45c0-92a3-2f9aca2cb16f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:56.629362 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=10 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:27:56.634278 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f1b87ff-3f3b-44a6-a3cd-8d02a709daab tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:56.635743 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f1b87ff-3f3b-44a6-a3cd-8d02a709daab tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:56.636370 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f1b87ff-3f3b-44a6-a3cd-8d02a709daab tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:56.637208 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f1b87ff-3f3b-44a6-a3cd-8d02a709daab tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:56.637863 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f1b87ff-3f3b-44a6-a3cd-8d02a709daab tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:56.638509 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f1b87ff-3f3b-44a6-a3cd-8d02a709daab tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:56.786171 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1c4d5799-c4db-4c2c-9b16-e65b419a7ddd tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:56.787197 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1c4d5799-c4db-4c2c-9b16-e65b419a7ddd tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:56.796127 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1c4d5799-c4db-4c2c-9b16-e65b419a7ddd tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:56.796933 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1c4d5799-c4db-4c2c-9b16-e65b419a7ddd tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:56.797579 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1c4d5799-c4db-4c2c-9b16-e65b419a7ddd tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:56.797774 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5f1b87ff-3f3b-44a6-a3cd-8d02a709daab tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:56.798297 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1c4d5799-c4db-4c2c-9b16-e65b419a7ddd tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:56.798997 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1c4d5799-c4db-4c2c-9b16-e65b419a7ddd tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:56.800008 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1c4d5799-c4db-4c2c-9b16-e65b419a7ddd tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:56.807436 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5f1b87ff-3f3b-44a6-a3cd-8d02a709daab tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/dd3fd462-cb66-45c0-92a3-2f9aca2cb16f" status: 200 len: 1486 microversion: 2.1 time: 0.189581 Oct 18 15:27:56.809271 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 479/907] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:56 2022] GET /compute/v2.1/servers/dd3fd462-cb66-45c0-92a3-2f9aca2cb16f => generated 1486 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:56.831676 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5d7c0088-deb4-460c-898c-cd99dfedf072 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:27:56.832037 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5d7c0088-deb4-460c-898c-cd99dfedf072 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: dd3fd462-cb66-45c0-92a3-2f9aca2cb16f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:56.839904 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d7c0088-deb4-460c-898c-cd99dfedf072 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:56.839904 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d7c0088-deb4-460c-898c-cd99dfedf072 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:56.839904 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d7c0088-deb4-460c-898c-cd99dfedf072 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:56.840295 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d7c0088-deb4-460c-898c-cd99dfedf072 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:56.840568 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d7c0088-deb4-460c-898c-cd99dfedf072 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:56.841046 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d7c0088-deb4-460c-898c-cd99dfedf072 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:56.878038 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1c4d5799-c4db-4c2c-9b16-e65b419a7ddd tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:56.884519 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-5d7c0088-deb4-460c-898c-cd99dfedf072 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lazy-loading 'flavor' on Instance uuid dd3fd462-cb66-45c0-92a3-2f9aca2cb16f {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:27:56.887999 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1c4d5799-c4db-4c2c-9b16-e65b419a7ddd tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:56.889792 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1c4d5799-c4db-4c2c-9b16-e65b419a7ddd tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:56.895554 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1c4d5799-c4db-4c2c-9b16-e65b419a7ddd tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1539 microversion: 2.91 time: 0.114119 Oct 18 15:27:56.912829 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 429/908] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:27:56 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1539 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:27:57.051492 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5d7c0088-deb4-460c-898c-cd99dfedf072 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "POST /compute/v2.1/servers/dd3fd462-cb66-45c0-92a3-2f9aca2cb16f/action" status: 202 len: 0 microversion: 2.1 time: 0.223561 Oct 18 15:27:57.052469 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 480/909] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:27:56 2022] POST /compute/v2.1/servers/dd3fd462-cb66-45c0-92a3-2f9aca2cb16f/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 15:27:57.060455 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-80ef483a-55fa-4ab5-b7de-8652bffd31ee tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:57.061449 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-80ef483a-55fa-4ab5-b7de-8652bffd31ee tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: dd3fd462-cb66-45c0-92a3-2f9aca2cb16f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:57.067713 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-80ef483a-55fa-4ab5-b7de-8652bffd31ee tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:57.069962 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-80ef483a-55fa-4ab5-b7de-8652bffd31ee tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:57.070429 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-80ef483a-55fa-4ab5-b7de-8652bffd31ee tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:57.071871 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-80ef483a-55fa-4ab5-b7de-8652bffd31ee tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:57.072351 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-80ef483a-55fa-4ab5-b7de-8652bffd31ee tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:57.072783 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-80ef483a-55fa-4ab5-b7de-8652bffd31ee tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:57.082471 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:27:57.280999 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-80ef483a-55fa-4ab5-b7de-8652bffd31ee tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:57.288742 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-80ef483a-55fa-4ab5-b7de-8652bffd31ee tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/dd3fd462-cb66-45c0-92a3-2f9aca2cb16f" status: 200 len: 1494 microversion: 2.1 time: 0.232337 Oct 18 15:27:57.289714 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 430/910] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:57 2022] GET /compute/v2.1/servers/dd3fd462-cb66-45c0-92a3-2f9aca2cb16f => generated 1494 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:57.364197 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c56de814-ddb9-484e-b295-b4c3cafb20de tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:57.364924 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c56de814-ddb9-484e-b295-b4c3cafb20de tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 13432f77-a4ba-4dea-a1a7-a47fb9b425b9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:57.373082 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c56de814-ddb9-484e-b295-b4c3cafb20de tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:57.373307 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c56de814-ddb9-484e-b295-b4c3cafb20de tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:57.373800 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c56de814-ddb9-484e-b295-b4c3cafb20de tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:57.374589 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c56de814-ddb9-484e-b295-b4c3cafb20de tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:57.375112 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c56de814-ddb9-484e-b295-b4c3cafb20de tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:57.375532 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c56de814-ddb9-484e-b295-b4c3cafb20de tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:57.514437 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c56de814-ddb9-484e-b295-b4c3cafb20de tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:57.522703 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c56de814-ddb9-484e-b295-b4c3cafb20de tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/13432f77-a4ba-4dea-a1a7-a47fb9b425b9" status: 200 len: 1319 microversion: 2.1 time: 0.162669 Oct 18 15:27:57.523408 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 481/911] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:57 2022] GET /compute/v2.1/servers/13432f77-a4ba-4dea-a1a7-a47fb9b425b9 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:57.925092 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c39018cf-69e6-4187-827f-c638ae23c54c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:57.925714 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c39018cf-69e6-4187-827f-c638ae23c54c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:57.932259 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c39018cf-69e6-4187-827f-c638ae23c54c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:57.932784 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c39018cf-69e6-4187-827f-c638ae23c54c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:57.933249 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c39018cf-69e6-4187-827f-c638ae23c54c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:57.933962 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c39018cf-69e6-4187-827f-c638ae23c54c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:57.934425 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c39018cf-69e6-4187-827f-c638ae23c54c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:57.934851 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c39018cf-69e6-4187-827f-c638ae23c54c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:58.004123 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c39018cf-69e6-4187-827f-c638ae23c54c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:58.012993 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c39018cf-69e6-4187-827f-c638ae23c54c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:58.014438 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c39018cf-69e6-4187-827f-c638ae23c54c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:58.019933 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c39018cf-69e6-4187-827f-c638ae23c54c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1539 microversion: 2.91 time: 0.098810 Oct 18 15:27:58.021062 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 431/912] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:27:57 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1539 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:27:58.311349 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eb9034a5-2b1d-4b8f-9910-17698f3a866d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:58.311986 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-eb9034a5-2b1d-4b8f-9910-17698f3a866d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: dd3fd462-cb66-45c0-92a3-2f9aca2cb16f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:58.318831 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb9034a5-2b1d-4b8f-9910-17698f3a866d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:58.319306 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb9034a5-2b1d-4b8f-9910-17698f3a866d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:58.319734 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb9034a5-2b1d-4b8f-9910-17698f3a866d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:58.320425 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb9034a5-2b1d-4b8f-9910-17698f3a866d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:58.321424 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb9034a5-2b1d-4b8f-9910-17698f3a866d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:58.321856 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb9034a5-2b1d-4b8f-9910-17698f3a866d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:58.462359 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-eb9034a5-2b1d-4b8f-9910-17698f3a866d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:58.470558 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-eb9034a5-2b1d-4b8f-9910-17698f3a866d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/dd3fd462-cb66-45c0-92a3-2f9aca2cb16f" status: 200 len: 1494 microversion: 2.1 time: 0.163043 Oct 18 15:27:58.471126 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 482/913] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:58 2022] GET /compute/v2.1/servers/dd3fd462-cb66-45c0-92a3-2f9aca2cb16f => generated 1494 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:58.546306 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fa8b19ca-b577-418a-8fdc-3c07c4075f0b tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:58.548342 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-fa8b19ca-b577-418a-8fdc-3c07c4075f0b tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 13432f77-a4ba-4dea-a1a7-a47fb9b425b9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:58.556164 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fa8b19ca-b577-418a-8fdc-3c07c4075f0b tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:58.556857 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fa8b19ca-b577-418a-8fdc-3c07c4075f0b tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:58.557560 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fa8b19ca-b577-418a-8fdc-3c07c4075f0b tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:58.558384 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fa8b19ca-b577-418a-8fdc-3c07c4075f0b tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:58.558904 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fa8b19ca-b577-418a-8fdc-3c07c4075f0b tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:58.559341 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fa8b19ca-b577-418a-8fdc-3c07c4075f0b tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:58.699231 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-fa8b19ca-b577-418a-8fdc-3c07c4075f0b tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:58.706918 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fa8b19ca-b577-418a-8fdc-3c07c4075f0b tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/13432f77-a4ba-4dea-a1a7-a47fb9b425b9" status: 200 len: 1319 microversion: 2.1 time: 0.164497 Oct 18 15:27:58.707494 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 432/914] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:58 2022] GET /compute/v2.1/servers/13432f77-a4ba-4dea-a1a7-a47fb9b425b9 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:59.048836 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0ea701e1-af91-4cb0-a836-17f4df0c9284 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:59.049448 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0ea701e1-af91-4cb0-a836-17f4df0c9284 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:59.052620 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:27:59.056844 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ea701e1-af91-4cb0-a836-17f4df0c9284 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:59.057341 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ea701e1-af91-4cb0-a836-17f4df0c9284 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:59.057785 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ea701e1-af91-4cb0-a836-17f4df0c9284 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:59.058495 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ea701e1-af91-4cb0-a836-17f4df0c9284 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:59.058947 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ea701e1-af91-4cb0-a836-17f4df0c9284 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:59.059375 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ea701e1-af91-4cb0-a836-17f4df0c9284 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:59.127968 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0ea701e1-af91-4cb0-a836-17f4df0c9284 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:59.136541 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0ea701e1-af91-4cb0-a836-17f4df0c9284 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:59.138002 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0ea701e1-af91-4cb0-a836-17f4df0c9284 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:59.143155 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0ea701e1-af91-4cb0-a836-17f4df0c9284 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1539 microversion: 2.91 time: 0.098318 Oct 18 15:27:59.143730 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 483/915] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:27:59 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1539 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:27:59.494012 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fea083e9-d566-4384-8a39-387c73b0fb40 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:59.494714 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-fea083e9-d566-4384-8a39-387c73b0fb40 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: dd3fd462-cb66-45c0-92a3-2f9aca2cb16f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:59.501002 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fea083e9-d566-4384-8a39-387c73b0fb40 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:59.501558 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fea083e9-d566-4384-8a39-387c73b0fb40 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:59.502071 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fea083e9-d566-4384-8a39-387c73b0fb40 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:59.502849 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fea083e9-d566-4384-8a39-387c73b0fb40 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:59.503377 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fea083e9-d566-4384-8a39-387c73b0fb40 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:59.504060 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fea083e9-d566-4384-8a39-387c73b0fb40 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:59.648801 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-fea083e9-d566-4384-8a39-387c73b0fb40 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:59.657858 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fea083e9-d566-4384-8a39-387c73b0fb40 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/dd3fd462-cb66-45c0-92a3-2f9aca2cb16f" status: 200 len: 1494 microversion: 2.1 time: 0.167865 Oct 18 15:27:59.658564 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 433/916] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:59 2022] GET /compute/v2.1/servers/dd3fd462-cb66-45c0-92a3-2f9aca2cb16f => generated 1494 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:27:59.731028 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4a2f7ccf-cb8f-43b9-9e92-331ff21b028f tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:27:59.731695 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4a2f7ccf-cb8f-43b9-9e92-331ff21b028f tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 13432f77-a4ba-4dea-a1a7-a47fb9b425b9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:27:59.738672 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a2f7ccf-cb8f-43b9-9e92-331ff21b028f tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:59.739151 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a2f7ccf-cb8f-43b9-9e92-331ff21b028f tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:59.739582 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a2f7ccf-cb8f-43b9-9e92-331ff21b028f tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:59.740276 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a2f7ccf-cb8f-43b9-9e92-331ff21b028f tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:27:59.740759 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a2f7ccf-cb8f-43b9-9e92-331ff21b028f tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:27:59.741205 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a2f7ccf-cb8f-43b9-9e92-331ff21b028f tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:27:59.891693 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4a2f7ccf-cb8f-43b9-9e92-331ff21b028f tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:27:59.894253 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:27:59.901553 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4a2f7ccf-cb8f-43b9-9e92-331ff21b028f tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/13432f77-a4ba-4dea-a1a7-a47fb9b425b9" status: 200 len: 1319 microversion: 2.1 time: 0.174428 Oct 18 15:27:59.902371 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 484/917] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:27:59 2022] GET /compute/v2.1/servers/13432f77-a4ba-4dea-a1a7-a47fb9b425b9 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:00.170816 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fd012806-566d-40d8-bf0c-72425d1c429c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:00.171558 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-fd012806-566d-40d8-bf0c-72425d1c429c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:00.177610 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fd012806-566d-40d8-bf0c-72425d1c429c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:00.178095 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fd012806-566d-40d8-bf0c-72425d1c429c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:00.178532 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fd012806-566d-40d8-bf0c-72425d1c429c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:00.179225 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fd012806-566d-40d8-bf0c-72425d1c429c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:00.179683 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fd012806-566d-40d8-bf0c-72425d1c429c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:00.180106 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fd012806-566d-40d8-bf0c-72425d1c429c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:00.254328 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-fd012806-566d-40d8-bf0c-72425d1c429c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:00.265496 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-fd012806-566d-40d8-bf0c-72425d1c429c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:00.267040 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-fd012806-566d-40d8-bf0c-72425d1c429c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:00.272634 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fd012806-566d-40d8-bf0c-72425d1c429c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1539 microversion: 2.91 time: 0.105759 Oct 18 15:28:00.273608 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 434/918] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:28:00 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1539 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:28:00.497430 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-60bc2ba6-08a7-47ef-a69f-675f0806b7df req-6db0ce6b-70c1-4b92-a7ca-ea2d81ae9fae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13432f77-a4ba-4dea-a1a7-a47fb9b425b9", "tag": "b792d990-7c86-4077-8a5d-ea59cddbd88a"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:28:00.507701 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-60bc2ba6-08a7-47ef-a69f-675f0806b7df req-6db0ce6b-70c1-4b92-a7ca-ea2d81ae9fae service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:00.508190 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-60bc2ba6-08a7-47ef-a69f-675f0806b7df req-6db0ce6b-70c1-4b92-a7ca-ea2d81ae9fae service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:00.522147 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-60bc2ba6-08a7-47ef-a69f-675f0806b7df req-6db0ce6b-70c1-4b92-a7ca-ea2d81ae9fae service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:00.537239 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-60bc2ba6-08a7-47ef-a69f-675f0806b7df req-6db0ce6b-70c1-4b92-a7ca-ea2d81ae9fae service nova] Creating event network-changed:b792d990-7c86-4077-8a5d-ea59cddbd88a for instance 13432f77-a4ba-4dea-a1a7-a47fb9b425b9 on n-h1-853682-5 Oct 18 15:28:00.542233 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-60bc2ba6-08a7-47ef-a69f-675f0806b7df req-6db0ce6b-70c1-4b92-a7ca-ea2d81ae9fae service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050197 Oct 18 15:28:00.543404 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 485/919] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:28:00.682309 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8cc6973a-ca81-446d-b01a-db8caaff6373 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:00.683804 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8cc6973a-ca81-446d-b01a-db8caaff6373 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: dd3fd462-cb66-45c0-92a3-2f9aca2cb16f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:00.691292 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8cc6973a-ca81-446d-b01a-db8caaff6373 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:00.692056 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8cc6973a-ca81-446d-b01a-db8caaff6373 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:00.692718 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8cc6973a-ca81-446d-b01a-db8caaff6373 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:00.693666 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8cc6973a-ca81-446d-b01a-db8caaff6373 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:00.694455 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8cc6973a-ca81-446d-b01a-db8caaff6373 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:00.695135 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8cc6973a-ca81-446d-b01a-db8caaff6373 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:00.835586 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8cc6973a-ca81-446d-b01a-db8caaff6373 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:00.845491 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8cc6973a-ca81-446d-b01a-db8caaff6373 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/dd3fd462-cb66-45c0-92a3-2f9aca2cb16f" status: 200 len: 1477 microversion: 2.1 time: 0.167931 Oct 18 15:28:00.846078 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 435/920] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:00 2022] GET /compute/v2.1/servers/dd3fd462-cb66-45c0-92a3-2f9aca2cb16f => generated 1477 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:00.870432 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f5ff2fcc-e741-4954-8f59-8df646c1f69a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2000171539"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:28:00.873923 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f5ff2fcc-e741-4954-8f59-8df646c1f69a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: dd3fd462-cb66-45c0-92a3-2f9aca2cb16f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:00.880575 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f5ff2fcc-e741-4954-8f59-8df646c1f69a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:00.881113 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f5ff2fcc-e741-4954-8f59-8df646c1f69a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:00.881558 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f5ff2fcc-e741-4954-8f59-8df646c1f69a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:00.882273 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f5ff2fcc-e741-4954-8f59-8df646c1f69a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:00.882738 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f5ff2fcc-e741-4954-8f59-8df646c1f69a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:00.883168 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f5ff2fcc-e741-4954-8f59-8df646c1f69a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:00.928848 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-44377314-a1c4-457e-a67a-c020e7a9761e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:00.931077 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-44377314-a1c4-457e-a67a-c020e7a9761e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 13432f77-a4ba-4dea-a1a7-a47fb9b425b9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:00.938173 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-44377314-a1c4-457e-a67a-c020e7a9761e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:00.938946 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-44377314-a1c4-457e-a67a-c020e7a9761e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:00.939383 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-44377314-a1c4-457e-a67a-c020e7a9761e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:00.940261 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-44377314-a1c4-457e-a67a-c020e7a9761e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:00.940906 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-44377314-a1c4-457e-a67a-c020e7a9761e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:00.941495 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-44377314-a1c4-457e-a67a-c020e7a9761e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:01.127135 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-44377314-a1c4-457e-a67a-c020e7a9761e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:01.137943 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-44377314-a1c4-457e-a67a-c020e7a9761e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/13432f77-a4ba-4dea-a1a7-a47fb9b425b9" status: 200 len: 1319 microversion: 2.1 time: 0.212807 Oct 18 15:28:01.138881 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 436/921] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:00 2022] GET /compute/v2.1/servers/13432f77-a4ba-4dea-a1a7-a47fb9b425b9 => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:28:01.146050 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f5ff2fcc-e741-4954-8f59-8df646c1f69a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "POST /compute/v2.1/servers/dd3fd462-cb66-45c0-92a3-2f9aca2cb16f/action" status: 202 len: 0 microversion: 2.1 time: 0.281413 Oct 18 15:28:01.147383 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 486/922] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:28:00 2022] POST /compute/v2.1/servers/dd3fd462-cb66-45c0-92a3-2f9aca2cb16f/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 18 15:28:01.158150 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4e7cc027-099c-4e4e-ab8c-d21814b2e8f2 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3dbc85e0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:01.205654 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4e7cc027-099c-4e4e-ab8c-d21814b2e8f2 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/a3cce994-6f52-4376-b348-a7cf7a071d8d" status: 200 len: 1438 microversion: 2.1 time: 0.051214 Oct 18 15:28:01.229178 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 437/923] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:28:01 2022] GET /compute/v2.1/images/a3cce994-6f52-4376-b348-a7cf7a071d8d => generated 1438 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:28:01.301786 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c04c0c72-5100-4954-9fc7-9cb1bd679f77 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:01.302481 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c04c0c72-5100-4954-9fc7-9cb1bd679f77 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:01.308566 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c04c0c72-5100-4954-9fc7-9cb1bd679f77 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:01.309083 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c04c0c72-5100-4954-9fc7-9cb1bd679f77 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:01.309508 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c04c0c72-5100-4954-9fc7-9cb1bd679f77 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:01.310389 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c04c0c72-5100-4954-9fc7-9cb1bd679f77 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:01.311024 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c04c0c72-5100-4954-9fc7-9cb1bd679f77 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:01.311644 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c04c0c72-5100-4954-9fc7-9cb1bd679f77 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:01.377688 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c04c0c72-5100-4954-9fc7-9cb1bd679f77 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:01.386536 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c04c0c72-5100-4954-9fc7-9cb1bd679f77 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:01.387954 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c04c0c72-5100-4954-9fc7-9cb1bd679f77 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:01.392851 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c04c0c72-5100-4954-9fc7-9cb1bd679f77 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1539 microversion: 2.91 time: 0.095288 Oct 18 15:28:01.393411 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 487/924] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:28:01 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1539 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:28:02.163319 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1e78095e-8b08-4a97-99dc-0d2eb2aaf594 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:02.164088 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1e78095e-8b08-4a97-99dc-0d2eb2aaf594 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 13432f77-a4ba-4dea-a1a7-a47fb9b425b9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:02.170289 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1e78095e-8b08-4a97-99dc-0d2eb2aaf594 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:02.170852 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1e78095e-8b08-4a97-99dc-0d2eb2aaf594 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:02.171364 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1e78095e-8b08-4a97-99dc-0d2eb2aaf594 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:02.172197 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1e78095e-8b08-4a97-99dc-0d2eb2aaf594 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:02.173035 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1e78095e-8b08-4a97-99dc-0d2eb2aaf594 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:02.173210 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1e78095e-8b08-4a97-99dc-0d2eb2aaf594 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:02.221633 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-27e326ab-416a-47eb-82bb-cec5f8e1f7c0 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d867f70>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:02.270087 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-27e326ab-416a-47eb-82bb-cec5f8e1f7c0 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/a3cce994-6f52-4376-b348-a7cf7a071d8d" status: 200 len: 1438 microversion: 2.1 time: 0.052338 Oct 18 15:28:02.270869 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 488/925] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:28:02 2022] GET /compute/v2.1/images/a3cce994-6f52-4376-b348-a7cf7a071d8d => generated 1438 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:28:02.326078 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1e78095e-8b08-4a97-99dc-0d2eb2aaf594 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:02.334010 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1e78095e-8b08-4a97-99dc-0d2eb2aaf594 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/13432f77-a4ba-4dea-a1a7-a47fb9b425b9" status: 200 len: 1319 microversion: 2.1 time: 0.175176 Oct 18 15:28:02.335203 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 438/926] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:02 2022] GET /compute/v2.1/servers/13432f77-a4ba-4dea-a1a7-a47fb9b425b9 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:02.421444 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9ff3ea24-0d1a-45e3-aaea-dc57db169e55 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:02.422057 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9ff3ea24-0d1a-45e3-aaea-dc57db169e55 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:02.429166 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ff3ea24-0d1a-45e3-aaea-dc57db169e55 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:02.429659 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ff3ea24-0d1a-45e3-aaea-dc57db169e55 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:02.430234 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ff3ea24-0d1a-45e3-aaea-dc57db169e55 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:02.430947 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ff3ea24-0d1a-45e3-aaea-dc57db169e55 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:02.431407 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ff3ea24-0d1a-45e3-aaea-dc57db169e55 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:02.431834 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ff3ea24-0d1a-45e3-aaea-dc57db169e55 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:02.507908 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9ff3ea24-0d1a-45e3-aaea-dc57db169e55 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:02.517928 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9ff3ea24-0d1a-45e3-aaea-dc57db169e55 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:02.519351 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9ff3ea24-0d1a-45e3-aaea-dc57db169e55 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:02.525556 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9ff3ea24-0d1a-45e3-aaea-dc57db169e55 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1539 microversion: 2.91 time: 0.108083 Oct 18 15:28:02.526128 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 489/927] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:28:02 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1539 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:28:03.286638 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0efe9bc0-a805-4f81-a84a-e908a41566ca tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d6cf8b0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:03.334700 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0efe9bc0-a805-4f81-a84a-e908a41566ca tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/a3cce994-6f52-4376-b348-a7cf7a071d8d" status: 200 len: 1438 microversion: 2.1 time: 0.052217 Oct 18 15:28:03.335441 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 439/928] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:28:03 2022] GET /compute/v2.1/images/a3cce994-6f52-4376-b348-a7cf7a071d8d => generated 1438 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:03.359064 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6e2a7c22-ab64-4f0b-95dc-4db05aca89d2 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:03.360065 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6e2a7c22-ab64-4f0b-95dc-4db05aca89d2 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 13432f77-a4ba-4dea-a1a7-a47fb9b425b9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:03.367366 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6e2a7c22-ab64-4f0b-95dc-4db05aca89d2 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:03.369343 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6e2a7c22-ab64-4f0b-95dc-4db05aca89d2 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:03.369992 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6e2a7c22-ab64-4f0b-95dc-4db05aca89d2 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:03.370773 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6e2a7c22-ab64-4f0b-95dc-4db05aca89d2 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:03.371287 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6e2a7c22-ab64-4f0b-95dc-4db05aca89d2 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:03.371930 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6e2a7c22-ab64-4f0b-95dc-4db05aca89d2 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:03.407684 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-4daf48c3-f420-48cf-9936-591461370ee6 req-42c00a21-a515-49b7-88bb-cee53c7b844f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92daf2e6-9a72-4b2a-94aa-4316c7edb3c0", "name": "network-vif-plugged", "status": "completed", "tag": "311e5c1f-7a46-43b7-bc59-f1a84c1c33de"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:28:03.424167 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-4daf48c3-f420-48cf-9936-591461370ee6 req-42c00a21-a515-49b7-88bb-cee53c7b844f service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:03.425037 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-4daf48c3-f420-48cf-9936-591461370ee6 req-42c00a21-a515-49b7-88bb-cee53c7b844f service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:03.425935 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-4daf48c3-f420-48cf-9936-591461370ee6 req-42c00a21-a515-49b7-88bb-cee53c7b844f service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:03.438313 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-4daf48c3-f420-48cf-9936-591461370ee6 req-42c00a21-a515-49b7-88bb-cee53c7b844f service nova] Creating event network-vif-plugged:311e5c1f-7a46-43b7-bc59-f1a84c1c33de for instance 92daf2e6-9a72-4b2a-94aa-4316c7edb3c0 on n-h1-853682-5 Oct 18 15:28:03.445079 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-4daf48c3-f420-48cf-9936-591461370ee6 req-42c00a21-a515-49b7-88bb-cee53c7b844f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043979 Oct 18 15:28:03.446069 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 440/929] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:28:03.521876 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6e2a7c22-ab64-4f0b-95dc-4db05aca89d2 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:03.530470 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6e2a7c22-ab64-4f0b-95dc-4db05aca89d2 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/13432f77-a4ba-4dea-a1a7-a47fb9b425b9" status: 200 len: 1319 microversion: 2.1 time: 0.175980 Oct 18 15:28:03.531041 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 490/930] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:03 2022] GET /compute/v2.1/servers/13432f77-a4ba-4dea-a1a7-a47fb9b425b9 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:03.555322 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-10f54467-1bd1-44bb-a747-f7295c9d069a tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:03.556020 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-10f54467-1bd1-44bb-a747-f7295c9d069a tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:03.562409 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-10f54467-1bd1-44bb-a747-f7295c9d069a tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:03.562904 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-10f54467-1bd1-44bb-a747-f7295c9d069a tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:03.563378 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-10f54467-1bd1-44bb-a747-f7295c9d069a tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:03.564076 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-10f54467-1bd1-44bb-a747-f7295c9d069a tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:03.564538 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-10f54467-1bd1-44bb-a747-f7295c9d069a tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:03.565010 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-10f54467-1bd1-44bb-a747-f7295c9d069a tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:03.639659 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-10f54467-1bd1-44bb-a747-f7295c9d069a tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:03.648607 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-10f54467-1bd1-44bb-a747-f7295c9d069a tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:03.650177 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-10f54467-1bd1-44bb-a747-f7295c9d069a tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:03.655944 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-10f54467-1bd1-44bb-a747-f7295c9d069a tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1539 microversion: 2.91 time: 0.105013 Oct 18 15:28:03.656553 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 441/931] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:28:03 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1539 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:28:04.350929 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8b8c1d3a-5288-479d-aac0-6c4fc566c4f3 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d6fd700>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:04.395095 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8b8c1d3a-5288-479d-aac0-6c4fc566c4f3 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/a3cce994-6f52-4376-b348-a7cf7a071d8d" status: 200 len: 1438 microversion: 2.1 time: 0.048029 Oct 18 15:28:04.396045 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 491/932] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:28:04 2022] GET /compute/v2.1/images/a3cce994-6f52-4376-b348-a7cf7a071d8d => generated 1438 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:04.554416 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4f66b0fb-8a53-4a1c-9f0d-4671acf71380 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:04.555731 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4f66b0fb-8a53-4a1c-9f0d-4671acf71380 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 13432f77-a4ba-4dea-a1a7-a47fb9b425b9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:04.562399 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4f66b0fb-8a53-4a1c-9f0d-4671acf71380 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:04.562874 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4f66b0fb-8a53-4a1c-9f0d-4671acf71380 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:04.563302 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4f66b0fb-8a53-4a1c-9f0d-4671acf71380 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:04.563990 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4f66b0fb-8a53-4a1c-9f0d-4671acf71380 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:04.564439 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4f66b0fb-8a53-4a1c-9f0d-4671acf71380 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:04.564890 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4f66b0fb-8a53-4a1c-9f0d-4671acf71380 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:04.709811 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a87b8adf-6d91-4224-9156-85569e24485b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:04.713564 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a87b8adf-6d91-4224-9156-85569e24485b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:04.715109 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4f66b0fb-8a53-4a1c-9f0d-4671acf71380 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:04.721112 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a87b8adf-6d91-4224-9156-85569e24485b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:04.721998 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a87b8adf-6d91-4224-9156-85569e24485b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:04.722405 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a87b8adf-6d91-4224-9156-85569e24485b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:04.723241 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a87b8adf-6d91-4224-9156-85569e24485b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:04.723707 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a87b8adf-6d91-4224-9156-85569e24485b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:04.724139 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a87b8adf-6d91-4224-9156-85569e24485b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:04.726324 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4f66b0fb-8a53-4a1c-9f0d-4671acf71380 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/13432f77-a4ba-4dea-a1a7-a47fb9b425b9" status: 200 len: 1319 microversion: 2.1 time: 0.175454 Oct 18 15:28:04.735378 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 442/933] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:04 2022] GET /compute/v2.1/servers/13432f77-a4ba-4dea-a1a7-a47fb9b425b9 => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:04.823464 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a87b8adf-6d91-4224-9156-85569e24485b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:04.833738 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a87b8adf-6d91-4224-9156-85569e24485b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:04.835232 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a87b8adf-6d91-4224-9156-85569e24485b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:04.841567 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a87b8adf-6d91-4224-9156-85569e24485b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1539 microversion: 2.91 time: 0.161793 Oct 18 15:28:04.857053 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 492/934] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:28:04 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1539 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:28:05.312442 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0d9a6896-c032-4d7e-b8b8-f2bc490a25d9 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:05.313183 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0d9a6896-c032-4d7e-b8b8-f2bc490a25d9 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] [instance: 22a2d6cf-565b-488b-8f9b-2b992b25cc32] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:05.315378 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=8 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:28:05.322889 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0d9a6896-c032-4d7e-b8b8-f2bc490a25d9 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:05.323550 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0d9a6896-c032-4d7e-b8b8-f2bc490a25d9 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:05.324670 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0d9a6896-c032-4d7e-b8b8-f2bc490a25d9 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:05.325733 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0d9a6896-c032-4d7e-b8b8-f2bc490a25d9 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:05.331598 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0d9a6896-c032-4d7e-b8b8-f2bc490a25d9 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:05.332266 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0d9a6896-c032-4d7e-b8b8-f2bc490a25d9 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:05.392762 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0d9a6896-c032-4d7e-b8b8-f2bc490a25d9 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] [instance: 22a2d6cf-565b-488b-8f9b-2b992b25cc32] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:28:05.413330 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7cb2bd90-eecc-4474-82b5-23449167db3f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d6fdca0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:05.487196 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7cb2bd90-eecc-4474-82b5-23449167db3f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/a3cce994-6f52-4376-b348-a7cf7a071d8d" status: 200 len: 1438 microversion: 2.1 time: 0.080398 Oct 18 15:28:05.488063 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 493/935] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:28:05 2022] GET /compute/v2.1/images/a3cce994-6f52-4376-b348-a7cf7a071d8d => generated 1438 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:05.490806 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0d9a6896-c032-4d7e-b8b8-f2bc490a25d9 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] 10.222.0.60 "DELETE /compute/v2.1/servers/22a2d6cf-565b-488b-8f9b-2b992b25cc32" status: 204 len: 0 microversion: 2.1 time: 0.182199 Oct 18 15:28:05.491864 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 443/936] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:28:05 2022] DELETE /compute/v2.1/servers/22a2d6cf-565b-488b-8f9b-2b992b25cc32 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:28:05.503620 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e80d7a4a-00bd-4a8b-8399-551a9dc96981 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:05.504471 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e80d7a4a-00bd-4a8b-8399-551a9dc96981 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] [instance: 22a2d6cf-565b-488b-8f9b-2b992b25cc32] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:05.527420 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e80d7a4a-00bd-4a8b-8399-551a9dc96981 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:05.527920 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e80d7a4a-00bd-4a8b-8399-551a9dc96981 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:05.528361 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e80d7a4a-00bd-4a8b-8399-551a9dc96981 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:05.529112 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e80d7a4a-00bd-4a8b-8399-551a9dc96981 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:05.529576 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e80d7a4a-00bd-4a8b-8399-551a9dc96981 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:05.530009 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e80d7a4a-00bd-4a8b-8399-551a9dc96981 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:05.677299 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e80d7a4a-00bd-4a8b-8399-551a9dc96981 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2bbb8b77794404af993e8291343afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6facda3e46640c884583aaf146a8b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:05.686898 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e80d7a4a-00bd-4a8b-8399-551a9dc96981 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] 10.222.0.60 "GET /compute/v2.1/servers/22a2d6cf-565b-488b-8f9b-2b992b25cc32" status: 200 len: 1712 microversion: 2.1 time: 0.190388 Oct 18 15:28:05.688137 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 494/937] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:05 2022] GET /compute/v2.1/servers/22a2d6cf-565b-488b-8f9b-2b992b25cc32 => generated 1712 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:28:05.755063 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-91c41c90-964d-463c-8232-6cd69d3ec415 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:05.755844 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-91c41c90-964d-463c-8232-6cd69d3ec415 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 13432f77-a4ba-4dea-a1a7-a47fb9b425b9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:05.762910 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-91c41c90-964d-463c-8232-6cd69d3ec415 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:05.763416 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-91c41c90-964d-463c-8232-6cd69d3ec415 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:05.763852 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-91c41c90-964d-463c-8232-6cd69d3ec415 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:05.764540 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-91c41c90-964d-463c-8232-6cd69d3ec415 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:05.765030 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-91c41c90-964d-463c-8232-6cd69d3ec415 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:05.765454 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-91c41c90-964d-463c-8232-6cd69d3ec415 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:05.870683 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c8a41484-f30e-4b07-8071-2877e0d8842a tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:05.871651 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c8a41484-f30e-4b07-8071-2877e0d8842a tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:05.878105 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8a41484-f30e-4b07-8071-2877e0d8842a tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:05.878672 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8a41484-f30e-4b07-8071-2877e0d8842a tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:05.879332 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8a41484-f30e-4b07-8071-2877e0d8842a tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:05.880232 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8a41484-f30e-4b07-8071-2877e0d8842a tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:05.880901 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8a41484-f30e-4b07-8071-2877e0d8842a tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:05.881542 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8a41484-f30e-4b07-8071-2877e0d8842a tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:05.906527 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-91c41c90-964d-463c-8232-6cd69d3ec415 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:05.916320 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-91c41c90-964d-463c-8232-6cd69d3ec415 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/13432f77-a4ba-4dea-a1a7-a47fb9b425b9" status: 200 len: 1319 microversion: 2.1 time: 0.165359 Oct 18 15:28:05.929381 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 444/938] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:05 2022] GET /compute/v2.1/servers/13432f77-a4ba-4dea-a1a7-a47fb9b425b9 => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:05.958921 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c8a41484-f30e-4b07-8071-2877e0d8842a tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:05.967569 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c8a41484-f30e-4b07-8071-2877e0d8842a tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:05.969046 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c8a41484-f30e-4b07-8071-2877e0d8842a tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:05.974035 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c8a41484-f30e-4b07-8071-2877e0d8842a tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1539 microversion: 2.91 time: 0.108414 Oct 18 15:28:05.974607 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 495/939] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:28:05 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1539 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:28:06.506682 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d7f11b18-91eb-42fb-974b-e2df5f32feec tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d77ee50>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:06.550510 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d7f11b18-91eb-42fb-974b-e2df5f32feec tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/a3cce994-6f52-4376-b348-a7cf7a071d8d" status: 200 len: 1438 microversion: 2.1 time: 0.047608 Oct 18 15:28:06.551114 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 445/940] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:28:06 2022] GET /compute/v2.1/images/a3cce994-6f52-4376-b348-a7cf7a071d8d => generated 1438 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:06.712182 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ddde32cc-d46e-4e90-9e27-4b3975173b98 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:06.713084 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ddde32cc-d46e-4e90-9e27-4b3975173b98 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] [instance: 22a2d6cf-565b-488b-8f9b-2b992b25cc32] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:06.719797 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ddde32cc-d46e-4e90-9e27-4b3975173b98 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:06.720273 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ddde32cc-d46e-4e90-9e27-4b3975173b98 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:06.720700 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ddde32cc-d46e-4e90-9e27-4b3975173b98 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:06.721408 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ddde32cc-d46e-4e90-9e27-4b3975173b98 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:06.721857 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ddde32cc-d46e-4e90-9e27-4b3975173b98 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:06.722273 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ddde32cc-d46e-4e90-9e27-4b3975173b98 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:06.893801 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ddde32cc-d46e-4e90-9e27-4b3975173b98 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2bbb8b77794404af993e8291343afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6facda3e46640c884583aaf146a8b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:06.902822 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ddde32cc-d46e-4e90-9e27-4b3975173b98 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] 10.222.0.60 "GET /compute/v2.1/servers/22a2d6cf-565b-488b-8f9b-2b992b25cc32" status: 200 len: 1712 microversion: 2.1 time: 0.195139 Oct 18 15:28:06.903403 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 496/941] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:06 2022] GET /compute/v2.1/servers/22a2d6cf-565b-488b-8f9b-2b992b25cc32 => generated 1712 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:06.940131 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6ca9a1b1-ca6d-4fee-b786-7b8b5a38e947 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:06.941499 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6ca9a1b1-ca6d-4fee-b786-7b8b5a38e947 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 13432f77-a4ba-4dea-a1a7-a47fb9b425b9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:06.949016 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ca9a1b1-ca6d-4fee-b786-7b8b5a38e947 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:06.949561 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ca9a1b1-ca6d-4fee-b786-7b8b5a38e947 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:06.950218 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ca9a1b1-ca6d-4fee-b786-7b8b5a38e947 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:06.951003 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ca9a1b1-ca6d-4fee-b786-7b8b5a38e947 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:06.951458 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ca9a1b1-ca6d-4fee-b786-7b8b5a38e947 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:06.952173 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ca9a1b1-ca6d-4fee-b786-7b8b5a38e947 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:07.004718 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f6e11f95-b445-42a4-b612-8def50f21303 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:07.005360 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f6e11f95-b445-42a4-b612-8def50f21303 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:07.013195 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f6e11f95-b445-42a4-b612-8def50f21303 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:07.013968 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f6e11f95-b445-42a4-b612-8def50f21303 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:07.014566 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f6e11f95-b445-42a4-b612-8def50f21303 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:07.015289 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f6e11f95-b445-42a4-b612-8def50f21303 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:07.015964 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f6e11f95-b445-42a4-b612-8def50f21303 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:07.016630 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f6e11f95-b445-42a4-b612-8def50f21303 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:07.131366 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f6e11f95-b445-42a4-b612-8def50f21303 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:07.140964 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f6e11f95-b445-42a4-b612-8def50f21303 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:07.142854 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f6e11f95-b445-42a4-b612-8def50f21303 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:07.151063 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f6e11f95-b445-42a4-b612-8def50f21303 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1539 microversion: 2.91 time: 0.150455 Oct 18 15:28:07.152024 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 497/942] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:28:06 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1539 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:28:07.182832 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6ca9a1b1-ca6d-4fee-b786-7b8b5a38e947 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:07.193103 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6ca9a1b1-ca6d-4fee-b786-7b8b5a38e947 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/13432f77-a4ba-4dea-a1a7-a47fb9b425b9" status: 200 len: 1319 microversion: 2.1 time: 0.256987 Oct 18 15:28:07.193694 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 446/943] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:06 2022] GET /compute/v2.1/servers/13432f77-a4ba-4dea-a1a7-a47fb9b425b9 => generated 1319 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:07.568355 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3f331de8-d9bd-4d56-9f15-e14b30ac1c77 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d6fd8b0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:07.627789 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3f331de8-d9bd-4d56-9f15-e14b30ac1c77 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/a3cce994-6f52-4376-b348-a7cf7a071d8d" status: 200 len: 1438 microversion: 2.1 time: 0.065278 Oct 18 15:28:07.628578 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 498/944] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:28:07 2022] GET /compute/v2.1/images/a3cce994-6f52-4376-b348-a7cf7a071d8d => generated 1438 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:07.927526 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-74e2d338-a263-4ad2-8577-39dc5b5b0e86 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:07.928675 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-74e2d338-a263-4ad2-8577-39dc5b5b0e86 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] [instance: 22a2d6cf-565b-488b-8f9b-2b992b25cc32] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:07.936605 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-74e2d338-a263-4ad2-8577-39dc5b5b0e86 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:07.937459 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-74e2d338-a263-4ad2-8577-39dc5b5b0e86 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:07.938140 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-74e2d338-a263-4ad2-8577-39dc5b5b0e86 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:07.939266 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-74e2d338-a263-4ad2-8577-39dc5b5b0e86 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:07.940230 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-74e2d338-a263-4ad2-8577-39dc5b5b0e86 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:07.941533 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-74e2d338-a263-4ad2-8577-39dc5b5b0e86 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:08.030924 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-74e2d338-a263-4ad2-8577-39dc5b5b0e86 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2bbb8b77794404af993e8291343afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6facda3e46640c884583aaf146a8b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:08.042959 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-74e2d338-a263-4ad2-8577-39dc5b5b0e86 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] 10.222.0.60 "GET /compute/v2.1/servers/22a2d6cf-565b-488b-8f9b-2b992b25cc32" status: 200 len: 1645 microversion: 2.1 time: 0.120512 Oct 18 15:28:08.043937 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 447/945] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:07 2022] GET /compute/v2.1/servers/22a2d6cf-565b-488b-8f9b-2b992b25cc32 => generated 1645 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:08.179367 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7ba5635a-06e0-411b-af30-36c2aaba70ce tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:08.180665 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7ba5635a-06e0-411b-af30-36c2aaba70ce tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:08.195339 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ba5635a-06e0-411b-af30-36c2aaba70ce tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:08.197853 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ba5635a-06e0-411b-af30-36c2aaba70ce tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:08.199722 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ba5635a-06e0-411b-af30-36c2aaba70ce tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:08.204477 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ba5635a-06e0-411b-af30-36c2aaba70ce tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:08.205563 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ba5635a-06e0-411b-af30-36c2aaba70ce tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:08.206111 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ba5635a-06e0-411b-af30-36c2aaba70ce tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:08.223028 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0076cab8-f64a-4d21-9124-4001c88039fd tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:08.224040 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0076cab8-f64a-4d21-9124-4001c88039fd tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 13432f77-a4ba-4dea-a1a7-a47fb9b425b9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:08.240521 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0076cab8-f64a-4d21-9124-4001c88039fd tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:08.245793 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0076cab8-f64a-4d21-9124-4001c88039fd tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:08.247048 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0076cab8-f64a-4d21-9124-4001c88039fd tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:08.253706 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0076cab8-f64a-4d21-9124-4001c88039fd tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:08.257878 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0076cab8-f64a-4d21-9124-4001c88039fd tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:08.263565 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0076cab8-f64a-4d21-9124-4001c88039fd tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:08.732152 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7ba5635a-06e0-411b-af30-36c2aaba70ce tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:08.741165 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7ba5635a-06e0-411b-af30-36c2aaba70ce tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:08.751955 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7ba5635a-06e0-411b-af30-36c2aaba70ce tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:08.759954 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7ba5635a-06e0-411b-af30-36c2aaba70ce tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1539 microversion: 2.91 time: 0.584548 Oct 18 15:28:08.761352 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 499/946] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:28:08 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1539 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:28:08.778929 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-dde27f8c-b86f-47a8-b0bf-d8926146b02d req-a0c4ec5f-1b91-4484-8bfc-b10b5110998c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13432f77-a4ba-4dea-a1a7-a47fb9b425b9", "name": "network-vif-plugged", "status": "completed", "tag": "b792d990-7c86-4077-8a5d-ea59cddbd88a"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:28:08.796334 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-dde27f8c-b86f-47a8-b0bf-d8926146b02d req-a0c4ec5f-1b91-4484-8bfc-b10b5110998c service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:08.797143 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-dde27f8c-b86f-47a8-b0bf-d8926146b02d req-a0c4ec5f-1b91-4484-8bfc-b10b5110998c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:08.797815 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-dde27f8c-b86f-47a8-b0bf-d8926146b02d req-a0c4ec5f-1b91-4484-8bfc-b10b5110998c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:08.811570 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-dde27f8c-b86f-47a8-b0bf-d8926146b02d req-a0c4ec5f-1b91-4484-8bfc-b10b5110998c service nova] Creating event network-vif-plugged:b792d990-7c86-4077-8a5d-ea59cddbd88a for instance 13432f77-a4ba-4dea-a1a7-a47fb9b425b9 on n-h1-853682-5 Oct 18 15:28:08.818694 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-dde27f8c-b86f-47a8-b0bf-d8926146b02d req-a0c4ec5f-1b91-4484-8bfc-b10b5110998c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055954 Oct 18 15:28:08.824467 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 500/947] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:28:08.830774 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d3fb9e0d-93ca-47d2-ba8d-53a8e9e1b57f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d6fd0d0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:08.894862 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d3fb9e0d-93ca-47d2-ba8d-53a8e9e1b57f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/a3cce994-6f52-4376-b348-a7cf7a071d8d" status: 200 len: 1438 microversion: 2.1 time: 0.068613 Oct 18 15:28:08.903135 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 501/948] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:28:08 2022] GET /compute/v2.1/images/a3cce994-6f52-4376-b348-a7cf7a071d8d => generated 1438 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:08.908513 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0076cab8-f64a-4d21-9124-4001c88039fd tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:08.911095 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:28:08.913140 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-7e137d04-01bd-4fbe-b2e0-a1f6f6546a9a req-e9349c7f-fd6b-46e4-96e4-8addb94438fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22a2d6cf-565b-488b-8f9b-2b992b25cc32", "name": "network-vif-deleted", "tag": "92ddf833-9eb5-4dca-a962-d9a729856784"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:28:08.920874 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0076cab8-f64a-4d21-9124-4001c88039fd tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/13432f77-a4ba-4dea-a1a7-a47fb9b425b9" status: 200 len: 1319 microversion: 2.1 time: 0.708543 Oct 18 15:28:08.930747 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7e137d04-01bd-4fbe-b2e0-a1f6f6546a9a req-e9349c7f-fd6b-46e4-96e4-8addb94438fd service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:08.931563 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7e137d04-01bd-4fbe-b2e0-a1f6f6546a9a req-e9349c7f-fd6b-46e4-96e4-8addb94438fd service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:08.932212 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7e137d04-01bd-4fbe-b2e0-a1f6f6546a9a req-e9349c7f-fd6b-46e4-96e4-8addb94438fd service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:08.940490 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 448/949] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:08 2022] GET /compute/v2.1/servers/13432f77-a4ba-4dea-a1a7-a47fb9b425b9 => generated 1319 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:08.955556 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-7e137d04-01bd-4fbe-b2e0-a1f6f6546a9a req-e9349c7f-fd6b-46e4-96e4-8addb94438fd service nova] Creating event network-vif-deleted:92ddf833-9eb5-4dca-a962-d9a729856784 for instance 22a2d6cf-565b-488b-8f9b-2b992b25cc32 on n-h2-853682-5 Oct 18 15:28:08.960729 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-7e137d04-01bd-4fbe-b2e0-a1f6f6546a9a req-e9349c7f-fd6b-46e4-96e4-8addb94438fd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056074 Oct 18 15:28:08.961711 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 502/950] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:28:09.066616 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9d5cf3e9-87d5-44a8-b1ee-2744e5c92dd2 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:09.067373 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9d5cf3e9-87d5-44a8-b1ee-2744e5c92dd2 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] [instance: 22a2d6cf-565b-488b-8f9b-2b992b25cc32] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:09.084296 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9d5cf3e9-87d5-44a8-b1ee-2744e5c92dd2 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:09.085048 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9d5cf3e9-87d5-44a8-b1ee-2744e5c92dd2 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:09.085835 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9d5cf3e9-87d5-44a8-b1ee-2744e5c92dd2 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:09.086763 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9d5cf3e9-87d5-44a8-b1ee-2744e5c92dd2 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:09.087668 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9d5cf3e9-87d5-44a8-b1ee-2744e5c92dd2 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:09.088281 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9d5cf3e9-87d5-44a8-b1ee-2744e5c92dd2 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:09.136355 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9d5cf3e9-87d5-44a8-b1ee-2744e5c92dd2 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:09.137056 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9d5cf3e9-87d5-44a8-b1ee-2744e5c92dd2 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:09.137767 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9d5cf3e9-87d5-44a8-b1ee-2744e5c92dd2 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:09.138337 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-9d5cf3e9-87d5-44a8-b1ee-2744e5c92dd2 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lazy-loading 'fault' on Instance uuid 22a2d6cf-565b-488b-8f9b-2b992b25cc32 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:28:09.185510 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9d5cf3e9-87d5-44a8-b1ee-2744e5c92dd2 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2bbb8b77794404af993e8291343afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6facda3e46640c884583aaf146a8b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:09.193765 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9d5cf3e9-87d5-44a8-b1ee-2744e5c92dd2 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] 10.222.0.60 "GET /compute/v2.1/servers/22a2d6cf-565b-488b-8f9b-2b992b25cc32" status: 200 len: 1352 microversion: 2.1 time: 0.131049 Oct 18 15:28:09.194337 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 449/951] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:09 2022] GET /compute/v2.1/servers/22a2d6cf-565b-488b-8f9b-2b992b25cc32 => generated 1352 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:09.793889 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3c7e2c4d-bbdb-4c2a-99e4-d815a04c853e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:09.794600 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3c7e2c4d-bbdb-4c2a-99e4-d815a04c853e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:09.800860 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c7e2c4d-bbdb-4c2a-99e4-d815a04c853e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:09.801353 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c7e2c4d-bbdb-4c2a-99e4-d815a04c853e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:09.801788 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c7e2c4d-bbdb-4c2a-99e4-d815a04c853e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:09.802701 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c7e2c4d-bbdb-4c2a-99e4-d815a04c853e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:09.803157 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c7e2c4d-bbdb-4c2a-99e4-d815a04c853e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:09.803579 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c7e2c4d-bbdb-4c2a-99e4-d815a04c853e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:09.877517 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3c7e2c4d-bbdb-4c2a-99e4-d815a04c853e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:09.886664 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3c7e2c4d-bbdb-4c2a-99e4-d815a04c853e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:09.888042 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3c7e2c4d-bbdb-4c2a-99e4-d815a04c853e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:09.893258 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3c7e2c4d-bbdb-4c2a-99e4-d815a04c853e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1539 microversion: 2.91 time: 0.105046 Oct 18 15:28:09.893827 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 503/952] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:28:09 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1539 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:28:09.916517 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2b211923-ed3a-4646-b871-e09927cd5ffc tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d754af0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:09.949575 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-63d360b6-cb87-44a3-adb1-00f5cb2f8e55 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:09.950378 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-63d360b6-cb87-44a3-adb1-00f5cb2f8e55 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 13432f77-a4ba-4dea-a1a7-a47fb9b425b9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:09.957805 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63d360b6-cb87-44a3-adb1-00f5cb2f8e55 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:09.958573 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63d360b6-cb87-44a3-adb1-00f5cb2f8e55 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:09.961652 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63d360b6-cb87-44a3-adb1-00f5cb2f8e55 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:09.961652 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63d360b6-cb87-44a3-adb1-00f5cb2f8e55 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:09.962481 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63d360b6-cb87-44a3-adb1-00f5cb2f8e55 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:09.963200 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63d360b6-cb87-44a3-adb1-00f5cb2f8e55 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:09.966760 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2b211923-ed3a-4646-b871-e09927cd5ffc tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/a3cce994-6f52-4376-b348-a7cf7a071d8d" status: 200 len: 1438 microversion: 2.1 time: 0.054980 Oct 18 15:28:09.967731 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 450/953] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:28:09 2022] GET /compute/v2.1/images/a3cce994-6f52-4376-b348-a7cf7a071d8d => generated 1438 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:10.117280 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-63d360b6-cb87-44a3-adb1-00f5cb2f8e55 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:10.125315 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-63d360b6-cb87-44a3-adb1-00f5cb2f8e55 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/13432f77-a4ba-4dea-a1a7-a47fb9b425b9" status: 200 len: 1319 microversion: 2.1 time: 0.181357 Oct 18 15:28:10.125902 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 504/954] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:09 2022] GET /compute/v2.1/servers/13432f77-a4ba-4dea-a1a7-a47fb9b425b9 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:28:10.218301 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7f61ade8-9aae-48c7-a6bb-a8e8bc1b2ea8 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:10.218941 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7f61ade8-9aae-48c7-a6bb-a8e8bc1b2ea8 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] [instance: 22a2d6cf-565b-488b-8f9b-2b992b25cc32] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:10.225101 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7f61ade8-9aae-48c7-a6bb-a8e8bc1b2ea8 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:10.225574 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7f61ade8-9aae-48c7-a6bb-a8e8bc1b2ea8 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:10.226000 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7f61ade8-9aae-48c7-a6bb-a8e8bc1b2ea8 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:10.226678 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7f61ade8-9aae-48c7-a6bb-a8e8bc1b2ea8 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:10.227714 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7f61ade8-9aae-48c7-a6bb-a8e8bc1b2ea8 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:10.228132 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7f61ade8-9aae-48c7-a6bb-a8e8bc1b2ea8 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:10.243749 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-7f61ade8-9aae-48c7-a6bb-a8e8bc1b2ea8 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] HTTP exception thrown: Instance 22a2d6cf-565b-488b-8f9b-2b992b25cc32 could not be found. Oct 18 15:28:10.245443 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7f61ade8-9aae-48c7-a6bb-a8e8bc1b2ea8 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Request method failure captured: Oct 18 15:28:10.245443 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/22a2d6cf-565b-488b-8f9b-2b992b25cc32 HTTP/1.1 Oct 18 15:28:10.245443 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:28:10.245443 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:28:10.245443 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:28:10.245443 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:28:10.245443 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:28:10.245443 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:28:10.245443 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:28:10.245443 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:28:10.245443 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsVxeQk-CD5CQSpFpXvnQ3pWaXxLx7C0QVQTECQtzV4PmBf9zzHBrRJhBQg4OfT0o71lNKVnYfSVDSTWueMpRFcEinDxqg6NsS027zjOlboJqLmMwJocUS_g1GY0npseh17jMK1wPoEZuDSD8Sq8o6cmi-aArekSqmR_QY5ffbryKjQ Oct 18 15:28:10.245443 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:28:10.245443 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:28:10.245443 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:28:10.245443 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:28:10.245443 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:28:10.245443 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:28:10.245443 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: e6facda3e46640c884583aaf146a8b14 Oct 18 15:28:10.245443 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-889889771 Oct 18 15:28:10.245443 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:28:10.245443 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:28:10.247111 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e6facda3e46640c884583aaf146a8b14"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e6facda3e46640c884583aaf146a8b14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e6facda3e46640c884583aaf146a8b14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e6facda3e46640c884583aaf146a8b14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:28:10.247111 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-889889771 Oct 18 15:28:10.247111 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: e6facda3e46640c884583aaf146a8b14 Oct 18 15:28:10.247111 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-889889771 Oct 18 15:28:10.247111 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServersWithSpecificFlavorTestJSON-889889771-project Oct 18 15:28:10.247111 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:28:10.247111 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:28:10.247111 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: aa2bbb8b77794404af993e8291343afa Oct 18 15:28:10.247111 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-889889771-project Oct 18 15:28:10.247111 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:28:10.247111 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 22a2d6cf-565b-488b-8f9b-2b992b25cc32 could not be found. Oct 18 15:28:10.247111 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '22a2d6cf-565b-488b-8f9b-2b992b25cc32'} Oct 18 15:28:10.248052 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:28:10.248052 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:28:10.248052 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:28:10.248052 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:28:10.248052 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:28:10.248052 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:28:10.248052 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:28:10.248052 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:28:10.248052 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:28:10.248052 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:28:10.248052 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22a2d6cf-565b-488b-8f9b-2b992b25cc32 could not be found. Oct 18 15:28:10.248052 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:28:10.248052 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:28:10.248052 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:28:10.248052 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:28:10.248052 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:28:10.248052 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:28:10.248052 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:28:10.248052 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:28:10.248052 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:28:10.249632 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:28:10.249632 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:28:10.249632 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:28:10.249632 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:28:10.249632 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:28:10.249632 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:28:10.249632 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:28:10.249632 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22a2d6cf-565b-488b-8f9b-2b992b25cc32 could not be found. Oct 18 15:28:10.249632 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:28:10.249632 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:28:10.249632 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:28:10.249632 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:28:10.249632 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:28:10.249632 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:28:10.249632 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:28:10.249632 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:28:10.249632 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22a2d6cf-565b-488b-8f9b-2b992b25cc32 could not be found. Oct 18 15:28:10.249632 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:28:10.250959 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7f61ade8-9aae-48c7-a6bb-a8e8bc1b2ea8 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Returning 404 to user: Instance 22a2d6cf-565b-488b-8f9b-2b992b25cc32 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:28:10.250959 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7f61ade8-9aae-48c7-a6bb-a8e8bc1b2ea8 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] 10.222.0.60 "GET /compute/v2.1/servers/22a2d6cf-565b-488b-8f9b-2b992b25cc32" status: 404 len: 111 microversion: 2.1 time: 0.033319 Oct 18 15:28:10.250959 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 451/955] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:10 2022] GET /compute/v2.1/servers/22a2d6cf-565b-488b-8f9b-2b992b25cc32 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:28:10.255613 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-aa7ca264-892d-4de2-83fa-aae6c0faca8f tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:10.256100 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-aa7ca264-892d-4de2-83fa-aae6c0faca8f tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] [instance: 19061153-9eed-4374-8799-b497b8a8e780] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:10.262308 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa7ca264-892d-4de2-83fa-aae6c0faca8f tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:10.262782 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa7ca264-892d-4de2-83fa-aae6c0faca8f tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:10.263212 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa7ca264-892d-4de2-83fa-aae6c0faca8f tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:10.263900 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa7ca264-892d-4de2-83fa-aae6c0faca8f tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:10.264346 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa7ca264-892d-4de2-83fa-aae6c0faca8f tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:10.264793 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa7ca264-892d-4de2-83fa-aae6c0faca8f tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:10.279262 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-aa7ca264-892d-4de2-83fa-aae6c0faca8f tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] HTTP exception thrown: Instance 19061153-9eed-4374-8799-b497b8a8e780 could not be found. Oct 18 15:28:10.281004 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-aa7ca264-892d-4de2-83fa-aae6c0faca8f tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Request method failure captured: Oct 18 15:28:10.281004 n-d-853682-5 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/19061153-9eed-4374-8799-b497b8a8e780 HTTP/1.1 Oct 18 15:28:10.281004 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:28:10.281004 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:28:10.281004 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:28:10.281004 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:28:10.281004 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:28:10.281004 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:28:10.281004 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:28:10.281004 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:28:10.281004 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsVxeQk-CD5CQSpFpXvnQ3pWaXxLx7C0QVQTECQtzV4PmBf9zzHBrRJhBQg4OfT0o71lNKVnYfSVDSTWueMpRFcEinDxqg6NsS027zjOlboJqLmMwJocUS_g1GY0npseh17jMK1wPoEZuDSD8Sq8o6cmi-aArekSqmR_QY5ffbryKjQ Oct 18 15:28:10.281004 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:28:10.281004 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:28:10.281004 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:28:10.281004 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:28:10.281004 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:28:10.281004 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:28:10.281004 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: e6facda3e46640c884583aaf146a8b14 Oct 18 15:28:10.281004 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-889889771 Oct 18 15:28:10.281004 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:28:10.281004 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:28:10.282582 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e6facda3e46640c884583aaf146a8b14"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e6facda3e46640c884583aaf146a8b14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e6facda3e46640c884583aaf146a8b14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e6facda3e46640c884583aaf146a8b14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:28:10.282582 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-889889771 Oct 18 15:28:10.282582 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: e6facda3e46640c884583aaf146a8b14 Oct 18 15:28:10.282582 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-889889771 Oct 18 15:28:10.282582 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersWithSpecificFlavorTestJSON-889889771-project Oct 18 15:28:10.282582 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:28:10.282582 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:28:10.282582 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: aa2bbb8b77794404af993e8291343afa Oct 18 15:28:10.282582 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-889889771-project Oct 18 15:28:10.282582 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:28:10.282582 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 19061153-9eed-4374-8799-b497b8a8e780 could not be found. Oct 18 15:28:10.282582 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '19061153-9eed-4374-8799-b497b8a8e780'} Oct 18 15:28:10.283588 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:28:10.283588 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:28:10.283588 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:28:10.283588 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:28:10.283588 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:28:10.283588 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:28:10.283588 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:28:10.283588 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:28:10.283588 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:28:10.283588 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:28:10.283588 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19061153-9eed-4374-8799-b497b8a8e780 could not be found. Oct 18 15:28:10.283588 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:28:10.283588 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:28:10.283588 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:28:10.283588 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:28:10.283588 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:28:10.283588 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:28:10.283588 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:28:10.283588 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:28:10.283588 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:28:10.285091 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:28:10.285091 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 15:28:10.285091 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 15:28:10.285091 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 15:28:10.285091 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 15:28:10.285091 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:28:10.285091 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:28:10.285091 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:28:10.285091 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:28:10.285091 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19061153-9eed-4374-8799-b497b8a8e780 could not be found. Oct 18 15:28:10.285091 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:28:10.285091 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:28:10.285091 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:28:10.285091 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:28:10.285091 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:28:10.285091 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:28:10.285091 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:28:10.285091 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:28:10.285091 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19061153-9eed-4374-8799-b497b8a8e780 could not be found. Oct 18 15:28:10.285091 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:28:10.286476 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-aa7ca264-892d-4de2-83fa-aae6c0faca8f tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Returning 404 to user: Instance 19061153-9eed-4374-8799-b497b8a8e780 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:28:10.286476 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-aa7ca264-892d-4de2-83fa-aae6c0faca8f tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] 10.222.0.60 "DELETE /compute/v2.1/servers/19061153-9eed-4374-8799-b497b8a8e780" status: 404 len: 111 microversion: 2.1 time: 0.030602 Oct 18 15:28:10.286476 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 505/956] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:28:10 2022] DELETE /compute/v2.1/servers/19061153-9eed-4374-8799-b497b8a8e780 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:28:10.292174 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c6256ab0-10cb-4684-baa9-2070b89ae598 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:10.292900 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c6256ab0-10cb-4684-baa9-2070b89ae598 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] [instance: 19061153-9eed-4374-8799-b497b8a8e780] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:10.299025 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c6256ab0-10cb-4684-baa9-2070b89ae598 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:10.299570 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c6256ab0-10cb-4684-baa9-2070b89ae598 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:10.300066 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c6256ab0-10cb-4684-baa9-2070b89ae598 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:10.300835 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c6256ab0-10cb-4684-baa9-2070b89ae598 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:10.301352 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c6256ab0-10cb-4684-baa9-2070b89ae598 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:10.301839 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c6256ab0-10cb-4684-baa9-2070b89ae598 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:10.315319 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-c6256ab0-10cb-4684-baa9-2070b89ae598 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] HTTP exception thrown: Instance 19061153-9eed-4374-8799-b497b8a8e780 could not be found. Oct 18 15:28:10.316974 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c6256ab0-10cb-4684-baa9-2070b89ae598 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Request method failure captured: Oct 18 15:28:10.316974 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/19061153-9eed-4374-8799-b497b8a8e780 HTTP/1.1 Oct 18 15:28:10.316974 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:28:10.316974 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:28:10.316974 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:28:10.316974 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:28:10.316974 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:28:10.316974 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:28:10.316974 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:28:10.316974 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:28:10.316974 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsVxeQk-CD5CQSpFpXvnQ3pWaXxLx7C0QVQTECQtzV4PmBf9zzHBrRJhBQg4OfT0o71lNKVnYfSVDSTWueMpRFcEinDxqg6NsS027zjOlboJqLmMwJocUS_g1GY0npseh17jMK1wPoEZuDSD8Sq8o6cmi-aArekSqmR_QY5ffbryKjQ Oct 18 15:28:10.316974 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:28:10.316974 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:28:10.316974 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:28:10.316974 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:28:10.316974 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:28:10.316974 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:28:10.316974 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: e6facda3e46640c884583aaf146a8b14 Oct 18 15:28:10.316974 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-889889771 Oct 18 15:28:10.316974 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:28:10.316974 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:28:10.318523 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e6facda3e46640c884583aaf146a8b14"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e6facda3e46640c884583aaf146a8b14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e6facda3e46640c884583aaf146a8b14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e6facda3e46640c884583aaf146a8b14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:28:10.318523 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-889889771 Oct 18 15:28:10.318523 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: e6facda3e46640c884583aaf146a8b14 Oct 18 15:28:10.318523 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-889889771 Oct 18 15:28:10.318523 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServersWithSpecificFlavorTestJSON-889889771-project Oct 18 15:28:10.318523 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:28:10.318523 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:28:10.318523 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: aa2bbb8b77794404af993e8291343afa Oct 18 15:28:10.318523 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-889889771-project Oct 18 15:28:10.318523 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:28:10.318523 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 19061153-9eed-4374-8799-b497b8a8e780 could not be found. Oct 18 15:28:10.318523 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '19061153-9eed-4374-8799-b497b8a8e780'} Oct 18 15:28:10.319429 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:28:10.319429 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:28:10.319429 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:28:10.319429 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:28:10.319429 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:28:10.319429 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:28:10.319429 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:28:10.319429 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:28:10.319429 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:28:10.319429 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:28:10.319429 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19061153-9eed-4374-8799-b497b8a8e780 could not be found. Oct 18 15:28:10.319429 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:28:10.319429 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:28:10.319429 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:28:10.319429 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:28:10.319429 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:28:10.319429 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:28:10.319429 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:28:10.319429 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:28:10.319429 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:28:10.321456 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:28:10.321456 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:28:10.321456 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:28:10.321456 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:28:10.321456 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:28:10.321456 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:28:10.321456 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:28:10.321456 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19061153-9eed-4374-8799-b497b8a8e780 could not be found. Oct 18 15:28:10.321456 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:28:10.321456 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:28:10.321456 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:28:10.321456 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:28:10.321456 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:28:10.321456 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:28:10.321456 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:28:10.321456 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:28:10.321456 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19061153-9eed-4374-8799-b497b8a8e780 could not be found. Oct 18 15:28:10.321456 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:28:10.322665 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c6256ab0-10cb-4684-baa9-2070b89ae598 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Returning 404 to user: Instance 19061153-9eed-4374-8799-b497b8a8e780 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:28:10.322665 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c6256ab0-10cb-4684-baa9-2070b89ae598 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] 10.222.0.60 "GET /compute/v2.1/servers/19061153-9eed-4374-8799-b497b8a8e780" status: 404 len: 111 microversion: 2.1 time: 0.032042 Oct 18 15:28:10.322665 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 452/957] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:10 2022] GET /compute/v2.1/servers/19061153-9eed-4374-8799-b497b8a8e780 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:28:10.330464 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-829ce704-b17a-4f9b-99d2-757b04e85012 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Calling method '.version_select at 0x7f7c3d6c55e0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:10.350819 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-829ce704-b17a-4f9b-99d2-757b04e85012 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-162482596" status: 202 len: 0 microversion: 2.1 time: 0.024174 Oct 18 15:28:10.351358 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 506/958] 10.222.0.60 () {58 vars in 1218 bytes} [Tue Oct 18 15:28:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-162482596 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:28:10.698967 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-26944bc9-f149-4a22-8e0c-53e107beea79 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0ae73688-0eb0-4783-876d-d80550175f94"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:28:10.701539 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-26944bc9-f149-4a22-8e0c-53e107beea79 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: 21ed44b3-c1df-4099-a1ca-a8b167fc3890] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:10.704425 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:28:10.707770 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26944bc9-f149-4a22-8e0c-53e107beea79 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:10.708245 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26944bc9-f149-4a22-8e0c-53e107beea79 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:10.708910 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26944bc9-f149-4a22-8e0c-53e107beea79 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:10.709610 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26944bc9-f149-4a22-8e0c-53e107beea79 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:10.710212 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26944bc9-f149-4a22-8e0c-53e107beea79 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:10.710781 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26944bc9-f149-4a22-8e0c-53e107beea79 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:10.837098 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-fed97f54-a9c6-472e-bd89-c03c20fa177b req-cbdf25b4-bfac-4970-927a-7b5d18cafb7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd3fd462-cb66-45c0-92a3-2f9aca2cb16f", "name": "network-vif-plugged", "status": "completed", "tag": "860bb5b6-138a-4440-96eb-ea0a81600e4f"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:28:10.860847 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-fed97f54-a9c6-472e-bd89-c03c20fa177b req-cbdf25b4-bfac-4970-927a-7b5d18cafb7d service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:10.863565 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-fed97f54-a9c6-472e-bd89-c03c20fa177b req-cbdf25b4-bfac-4970-927a-7b5d18cafb7d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:10.864174 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-fed97f54-a9c6-472e-bd89-c03c20fa177b req-cbdf25b4-bfac-4970-927a-7b5d18cafb7d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:10.880442 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-fed97f54-a9c6-472e-bd89-c03c20fa177b req-cbdf25b4-bfac-4970-927a-7b5d18cafb7d service nova] Creating event network-vif-plugged:860bb5b6-138a-4440-96eb-ea0a81600e4f for instance dd3fd462-cb66-45c0-92a3-2f9aca2cb16f on n-h1-853682-5 Oct 18 15:28:10.888270 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-fed97f54-a9c6-472e-bd89-c03c20fa177b req-cbdf25b4-bfac-4970-927a-7b5d18cafb7d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054680 Oct 18 15:28:10.892541 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 507/959] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:28:10.924286 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c084564a-1a35-4584-af7d-896b05907892 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:10.925430 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c084564a-1a35-4584-af7d-896b05907892 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:10.939658 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c084564a-1a35-4584-af7d-896b05907892 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:10.940527 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c084564a-1a35-4584-af7d-896b05907892 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:10.941028 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c084564a-1a35-4584-af7d-896b05907892 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:10.941749 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c084564a-1a35-4584-af7d-896b05907892 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:10.942299 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c084564a-1a35-4584-af7d-896b05907892 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:10.943620 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c084564a-1a35-4584-af7d-896b05907892 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:11.049250 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c084564a-1a35-4584-af7d-896b05907892 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:11.059430 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c084564a-1a35-4584-af7d-896b05907892 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:11.061071 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c084564a-1a35-4584-af7d-896b05907892 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:11.069584 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c084564a-1a35-4584-af7d-896b05907892 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1539 microversion: 2.91 time: 0.150836 Oct 18 15:28:11.070165 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 508/960] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:28:10 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1539 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:28:11.075279 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fa26b48d-11dd-41c3-9dc0-8fad3d9a734e tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d712b80>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:11.108975 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-26944bc9-f149-4a22-8e0c-53e107beea79 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "POST /compute/v2.1/servers/21ed44b3-c1df-4099-a1ca-a8b167fc3890/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.414102 Oct 18 15:28:11.109763 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 453/961] 10.222.0.60 () {60 vars in 1323 bytes} [Tue Oct 18 15:28:10 2022] POST /compute/v2.1/servers/21ed44b3-c1df-4099-a1ca-a8b167fc3890/os-volume_attachments => generated 194 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:28:11.129495 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d8d871dc-8cfc-4ee0-a8f3-9523b0d7ee68 tempest-ServersWithSpecificFlavorTestJSON-1003517087 tempest-ServersWithSpecificFlavorTestJSON-1003517087-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:11.132498 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fa26b48d-11dd-41c3-9dc0-8fad3d9a734e tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/a3cce994-6f52-4376-b348-a7cf7a071d8d" status: 200 len: 1438 microversion: 2.1 time: 0.060557 Oct 18 15:28:11.133540 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 509/962] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:28:11 2022] GET /compute/v2.1/images/a3cce994-6f52-4376-b348-a7cf7a071d8d => generated 1438 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:11.149934 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2f7a49a5-2863-41aa-914d-3690cef8cf05 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:11.150720 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2f7a49a5-2863-41aa-914d-3690cef8cf05 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 13432f77-a4ba-4dea-a1a7-a47fb9b425b9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:11.152709 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d8d871dc-8cfc-4ee0-a8f3-9523b0d7ee68 tempest-ServersWithSpecificFlavorTestJSON-1003517087 tempest-ServersWithSpecificFlavorTestJSON-1003517087-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/40702943" status: 202 len: 0 microversion: 2.1 time: 0.041045 Oct 18 15:28:11.153495 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 454/963] 10.222.0.60 () {58 vars in 1155 bytes} [Tue Oct 18 15:28:11 2022] DELETE /compute/v2.1/flavors/40702943 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:28:11.165107 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5f9ff997-ad09-4fb1-8089-928ca2f689b8 tempest-ServersWithSpecificFlavorTestJSON-1003517087 tempest-ServersWithSpecificFlavorTestJSON-1003517087-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:11.171611 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f7a49a5-2863-41aa-914d-3690cef8cf05 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:11.172369 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f7a49a5-2863-41aa-914d-3690cef8cf05 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:11.173162 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f7a49a5-2863-41aa-914d-3690cef8cf05 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:11.174271 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f7a49a5-2863-41aa-914d-3690cef8cf05 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:11.174933 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f7a49a5-2863-41aa-914d-3690cef8cf05 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:11.175516 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f7a49a5-2863-41aa-914d-3690cef8cf05 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:11.194309 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:28:11.203801 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5f9ff997-ad09-4fb1-8089-928ca2f689b8 tempest-ServersWithSpecificFlavorTestJSON-1003517087 tempest-ServersWithSpecificFlavorTestJSON-1003517087-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5401 microversion: 2.1 time: 0.044163 Oct 18 15:28:11.205370 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 455/964] 10.222.0.60 () {58 vars in 1146 bytes} [Tue Oct 18 15:28:11 2022] GET /compute/v2.1/flavors/detail => generated 5401 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:28:11.223689 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b721f18f-b3a4-482b-b120-ea939d9f1b83 tempest-ServersWithSpecificFlavorTestJSON-1003517087 tempest-ServersWithSpecificFlavorTestJSON-1003517087-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:11.241974 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b721f18f-b3a4-482b-b120-ea939d9f1b83 tempest-ServersWithSpecificFlavorTestJSON-1003517087 tempest-ServersWithSpecificFlavorTestJSON-1003517087-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/886281070" status: 202 len: 0 microversion: 2.1 time: 0.022694 Oct 18 15:28:11.243112 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 456/965] 10.222.0.60 () {58 vars in 1158 bytes} [Tue Oct 18 15:28:11 2022] DELETE /compute/v2.1/flavors/886281070 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 15:28:11.251115 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a0837bc4-336e-44c8-b20e-86551b2836aa tempest-ServersWithSpecificFlavorTestJSON-1003517087 tempest-ServersWithSpecificFlavorTestJSON-1003517087-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:11.271731 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a0837bc4-336e-44c8-b20e-86551b2836aa tempest-ServersWithSpecificFlavorTestJSON-1003517087 tempest-ServersWithSpecificFlavorTestJSON-1003517087-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024119 Oct 18 15:28:11.272329 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 457/966] 10.222.0.60 () {58 vars in 1146 bytes} [Tue Oct 18 15:28:11 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:11.297485 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4fbca510-6c50-4644-8237-8c7097dc3183 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:11.298697 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4fbca510-6c50-4644-8237-8c7097dc3183 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] [instance: 22a2d6cf-565b-488b-8f9b-2b992b25cc32] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:11.307043 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4fbca510-6c50-4644-8237-8c7097dc3183 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:11.308012 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4fbca510-6c50-4644-8237-8c7097dc3183 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:11.308722 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4fbca510-6c50-4644-8237-8c7097dc3183 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:11.309522 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4fbca510-6c50-4644-8237-8c7097dc3183 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:11.310335 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4fbca510-6c50-4644-8237-8c7097dc3183 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:11.310951 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4fbca510-6c50-4644-8237-8c7097dc3183 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:11.333481 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-4fbca510-6c50-4644-8237-8c7097dc3183 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] HTTP exception thrown: Instance 22a2d6cf-565b-488b-8f9b-2b992b25cc32 could not be found. Oct 18 15:28:11.335484 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4fbca510-6c50-4644-8237-8c7097dc3183 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Request method failure captured: Oct 18 15:28:11.335484 n-d-853682-5 devstack@n-api.service[120405]: request: DELETE /compute/v2.1/servers/22a2d6cf-565b-488b-8f9b-2b992b25cc32 HTTP/1.1 Oct 18 15:28:11.335484 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:28:11.335484 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:28:11.335484 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:28:11.335484 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:28:11.335484 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:28:11.335484 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:28:11.335484 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:28:11.335484 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:28:11.335484 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsVxeQk-CD5CQSpFpXvnQ3pWaXxLx7C0QVQTECQtzV4PmBf9zzHBrRJhBQg4OfT0o71lNKVnYfSVDSTWueMpRFcEinDxqg6NsS027zjOlboJqLmMwJocUS_g1GY0npseh17jMK1wPoEZuDSD8Sq8o6cmi-aArekSqmR_QY5ffbryKjQ Oct 18 15:28:11.335484 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:28:11.335484 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:28:11.335484 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:28:11.335484 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:28:11.335484 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:28:11.335484 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:28:11.335484 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: e6facda3e46640c884583aaf146a8b14 Oct 18 15:28:11.335484 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-889889771 Oct 18 15:28:11.335484 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:28:11.335484 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:28:11.337401 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e6facda3e46640c884583aaf146a8b14"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e6facda3e46640c884583aaf146a8b14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e6facda3e46640c884583aaf146a8b14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e6facda3e46640c884583aaf146a8b14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:28:11.337401 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-889889771 Oct 18 15:28:11.337401 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: e6facda3e46640c884583aaf146a8b14 Oct 18 15:28:11.337401 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-889889771 Oct 18 15:28:11.337401 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServersWithSpecificFlavorTestJSON-889889771-project Oct 18 15:28:11.337401 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:28:11.337401 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:28:11.337401 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: aa2bbb8b77794404af993e8291343afa Oct 18 15:28:11.337401 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-889889771-project Oct 18 15:28:11.337401 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:28:11.337401 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 22a2d6cf-565b-488b-8f9b-2b992b25cc32 could not be found. Oct 18 15:28:11.337401 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '22a2d6cf-565b-488b-8f9b-2b992b25cc32'} Oct 18 15:28:11.338181 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:28:11.338181 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:28:11.338181 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:28:11.338181 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:28:11.338181 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:28:11.338181 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:28:11.338181 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:28:11.338181 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:28:11.338181 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:28:11.338181 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:28:11.338181 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22a2d6cf-565b-488b-8f9b-2b992b25cc32 could not be found. Oct 18 15:28:11.338181 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:28:11.338181 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:28:11.338181 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:28:11.338181 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:28:11.338181 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:28:11.338181 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:28:11.338181 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:28:11.338181 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:28:11.338181 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:28:11.339350 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:28:11.339350 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 15:28:11.339350 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 15:28:11.339350 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 15:28:11.339350 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 15:28:11.339350 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:28:11.339350 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:28:11.339350 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:28:11.339350 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:28:11.339350 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22a2d6cf-565b-488b-8f9b-2b992b25cc32 could not be found. Oct 18 15:28:11.339350 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:28:11.339350 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:28:11.339350 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:28:11.339350 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:28:11.339350 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:28:11.339350 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:28:11.339350 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:28:11.339350 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:28:11.339350 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22a2d6cf-565b-488b-8f9b-2b992b25cc32 could not be found. Oct 18 15:28:11.339350 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:28:11.342319 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4fbca510-6c50-4644-8237-8c7097dc3183 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Returning 404 to user: Instance 22a2d6cf-565b-488b-8f9b-2b992b25cc32 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:28:11.343514 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4fbca510-6c50-4644-8237-8c7097dc3183 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] 10.222.0.60 "DELETE /compute/v2.1/servers/22a2d6cf-565b-488b-8f9b-2b992b25cc32" status: 404 len: 111 microversion: 2.1 time: 0.050614 Oct 18 15:28:11.344305 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 458/967] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:28:11 2022] DELETE /compute/v2.1/servers/22a2d6cf-565b-488b-8f9b-2b992b25cc32 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 15:28:11.353194 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ffca70d3-54d8-423a-bbd1-7c1e6c9af0f0 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:11.354017 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ffca70d3-54d8-423a-bbd1-7c1e6c9af0f0 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] [instance: 22a2d6cf-565b-488b-8f9b-2b992b25cc32] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:11.361589 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ffca70d3-54d8-423a-bbd1-7c1e6c9af0f0 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:11.362055 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ffca70d3-54d8-423a-bbd1-7c1e6c9af0f0 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:11.362773 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ffca70d3-54d8-423a-bbd1-7c1e6c9af0f0 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:11.363454 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ffca70d3-54d8-423a-bbd1-7c1e6c9af0f0 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:11.364179 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ffca70d3-54d8-423a-bbd1-7c1e6c9af0f0 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:11.365063 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ffca70d3-54d8-423a-bbd1-7c1e6c9af0f0 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:11.380411 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-ffca70d3-54d8-423a-bbd1-7c1e6c9af0f0 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] HTTP exception thrown: Instance 22a2d6cf-565b-488b-8f9b-2b992b25cc32 could not be found. Oct 18 15:28:11.382189 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ffca70d3-54d8-423a-bbd1-7c1e6c9af0f0 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Request method failure captured: Oct 18 15:28:11.382189 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/22a2d6cf-565b-488b-8f9b-2b992b25cc32 HTTP/1.1 Oct 18 15:28:11.382189 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:28:11.382189 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:28:11.382189 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:28:11.382189 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:28:11.382189 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:28:11.382189 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:28:11.382189 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:28:11.382189 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:28:11.382189 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsVxeQk-CD5CQSpFpXvnQ3pWaXxLx7C0QVQTECQtzV4PmBf9zzHBrRJhBQg4OfT0o71lNKVnYfSVDSTWueMpRFcEinDxqg6NsS027zjOlboJqLmMwJocUS_g1GY0npseh17jMK1wPoEZuDSD8Sq8o6cmi-aArekSqmR_QY5ffbryKjQ Oct 18 15:28:11.382189 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:28:11.382189 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:28:11.382189 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:28:11.382189 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:28:11.382189 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:28:11.382189 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:28:11.382189 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: e6facda3e46640c884583aaf146a8b14 Oct 18 15:28:11.382189 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-889889771 Oct 18 15:28:11.382189 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:28:11.382189 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:28:11.383840 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e6facda3e46640c884583aaf146a8b14"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e6facda3e46640c884583aaf146a8b14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e6facda3e46640c884583aaf146a8b14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e6facda3e46640c884583aaf146a8b14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:28:11.383840 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-889889771 Oct 18 15:28:11.383840 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: e6facda3e46640c884583aaf146a8b14 Oct 18 15:28:11.383840 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-889889771 Oct 18 15:28:11.383840 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServersWithSpecificFlavorTestJSON-889889771-project Oct 18 15:28:11.383840 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:28:11.383840 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:28:11.383840 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: aa2bbb8b77794404af993e8291343afa Oct 18 15:28:11.383840 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-889889771-project Oct 18 15:28:11.383840 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:28:11.383840 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 22a2d6cf-565b-488b-8f9b-2b992b25cc32 could not be found. Oct 18 15:28:11.383840 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '22a2d6cf-565b-488b-8f9b-2b992b25cc32'} Oct 18 15:28:11.384747 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:28:11.384747 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:28:11.384747 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:28:11.384747 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:28:11.384747 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:28:11.384747 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:28:11.384747 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:28:11.384747 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:28:11.384747 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:28:11.384747 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:28:11.384747 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22a2d6cf-565b-488b-8f9b-2b992b25cc32 could not be found. Oct 18 15:28:11.384747 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:28:11.384747 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:28:11.384747 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:28:11.384747 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:28:11.384747 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:28:11.384747 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:28:11.384747 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:28:11.384747 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:28:11.384747 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:28:11.386200 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:28:11.386200 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:28:11.386200 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:28:11.386200 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:28:11.386200 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:28:11.386200 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:28:11.386200 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:28:11.386200 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22a2d6cf-565b-488b-8f9b-2b992b25cc32 could not be found. Oct 18 15:28:11.386200 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:28:11.386200 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:28:11.386200 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:28:11.386200 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:28:11.386200 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:28:11.386200 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:28:11.386200 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:28:11.386200 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:28:11.386200 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22a2d6cf-565b-488b-8f9b-2b992b25cc32 could not be found. Oct 18 15:28:11.386200 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:28:11.387552 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ffca70d3-54d8-423a-bbd1-7c1e6c9af0f0 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Returning 404 to user: Instance 22a2d6cf-565b-488b-8f9b-2b992b25cc32 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:28:11.387552 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ffca70d3-54d8-423a-bbd1-7c1e6c9af0f0 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] 10.222.0.60 "GET /compute/v2.1/servers/22a2d6cf-565b-488b-8f9b-2b992b25cc32" status: 404 len: 111 microversion: 2.1 time: 0.035399 Oct 18 15:28:11.387552 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 459/968] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:11 2022] GET /compute/v2.1/servers/22a2d6cf-565b-488b-8f9b-2b992b25cc32 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 15:28:11.397348 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-13d9bda5-98e4-4891-8bf7-a5383254c44a tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:11.398083 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-13d9bda5-98e4-4891-8bf7-a5383254c44a tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] [instance: 19061153-9eed-4374-8799-b497b8a8e780] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:11.405368 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-13d9bda5-98e4-4891-8bf7-a5383254c44a tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:11.405785 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-13d9bda5-98e4-4891-8bf7-a5383254c44a tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:11.406301 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-13d9bda5-98e4-4891-8bf7-a5383254c44a tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:11.407213 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-13d9bda5-98e4-4891-8bf7-a5383254c44a tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:11.407807 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-13d9bda5-98e4-4891-8bf7-a5383254c44a tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:11.408251 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-13d9bda5-98e4-4891-8bf7-a5383254c44a tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:11.424274 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-13d9bda5-98e4-4891-8bf7-a5383254c44a tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] HTTP exception thrown: Instance 19061153-9eed-4374-8799-b497b8a8e780 could not be found. Oct 18 15:28:11.425844 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-13d9bda5-98e4-4891-8bf7-a5383254c44a tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Request method failure captured: Oct 18 15:28:11.425844 n-d-853682-5 devstack@n-api.service[120405]: request: DELETE /compute/v2.1/servers/19061153-9eed-4374-8799-b497b8a8e780 HTTP/1.1 Oct 18 15:28:11.425844 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:28:11.425844 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:28:11.425844 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:28:11.425844 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:28:11.425844 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:28:11.425844 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:28:11.425844 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:28:11.425844 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:28:11.425844 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsVxeQk-CD5CQSpFpXvnQ3pWaXxLx7C0QVQTECQtzV4PmBf9zzHBrRJhBQg4OfT0o71lNKVnYfSVDSTWueMpRFcEinDxqg6NsS027zjOlboJqLmMwJocUS_g1GY0npseh17jMK1wPoEZuDSD8Sq8o6cmi-aArekSqmR_QY5ffbryKjQ Oct 18 15:28:11.425844 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:28:11.425844 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:28:11.425844 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:28:11.425844 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:28:11.425844 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:28:11.425844 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:28:11.425844 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: e6facda3e46640c884583aaf146a8b14 Oct 18 15:28:11.425844 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-889889771 Oct 18 15:28:11.425844 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:28:11.425844 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:28:11.427382 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e6facda3e46640c884583aaf146a8b14"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e6facda3e46640c884583aaf146a8b14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e6facda3e46640c884583aaf146a8b14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e6facda3e46640c884583aaf146a8b14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:28:11.427382 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-889889771 Oct 18 15:28:11.427382 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: e6facda3e46640c884583aaf146a8b14 Oct 18 15:28:11.427382 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-889889771 Oct 18 15:28:11.427382 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServersWithSpecificFlavorTestJSON-889889771-project Oct 18 15:28:11.427382 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:28:11.427382 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:28:11.427382 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: aa2bbb8b77794404af993e8291343afa Oct 18 15:28:11.427382 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-889889771-project Oct 18 15:28:11.427382 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:28:11.427382 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 19061153-9eed-4374-8799-b497b8a8e780 could not be found. Oct 18 15:28:11.427382 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '19061153-9eed-4374-8799-b497b8a8e780'} Oct 18 15:28:11.428539 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:28:11.428539 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:28:11.428539 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:28:11.428539 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:28:11.428539 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:28:11.428539 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:28:11.428539 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:28:11.428539 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:28:11.428539 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:28:11.428539 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:28:11.428539 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19061153-9eed-4374-8799-b497b8a8e780 could not be found. Oct 18 15:28:11.428539 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:28:11.428539 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:28:11.428539 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:28:11.428539 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:28:11.428539 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:28:11.428539 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:28:11.428539 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:28:11.428539 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:28:11.428539 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:28:11.429846 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:28:11.429846 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 15:28:11.429846 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 15:28:11.429846 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 15:28:11.429846 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 15:28:11.429846 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:28:11.429846 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:28:11.429846 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:28:11.429846 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:28:11.429846 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19061153-9eed-4374-8799-b497b8a8e780 could not be found. Oct 18 15:28:11.429846 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:28:11.429846 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:28:11.429846 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:28:11.429846 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:28:11.429846 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:28:11.429846 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:28:11.429846 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:28:11.429846 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:28:11.429846 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19061153-9eed-4374-8799-b497b8a8e780 could not be found. Oct 18 15:28:11.429846 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:28:11.431919 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-13d9bda5-98e4-4891-8bf7-a5383254c44a tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Returning 404 to user: Instance 19061153-9eed-4374-8799-b497b8a8e780 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:28:11.431919 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-13d9bda5-98e4-4891-8bf7-a5383254c44a tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] 10.222.0.60 "DELETE /compute/v2.1/servers/19061153-9eed-4374-8799-b497b8a8e780" status: 404 len: 111 microversion: 2.1 time: 0.033783 Oct 18 15:28:11.431919 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 460/969] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:28:11 2022] DELETE /compute/v2.1/servers/19061153-9eed-4374-8799-b497b8a8e780 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:28:11.436221 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-85cce6b2-289a-4f43-b550-1da6919e85f2 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:11.436856 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-85cce6b2-289a-4f43-b550-1da6919e85f2 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] [instance: 19061153-9eed-4374-8799-b497b8a8e780] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:11.443231 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-85cce6b2-289a-4f43-b550-1da6919e85f2 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:11.443717 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-85cce6b2-289a-4f43-b550-1da6919e85f2 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:11.444226 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-85cce6b2-289a-4f43-b550-1da6919e85f2 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:11.444994 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-85cce6b2-289a-4f43-b550-1da6919e85f2 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:11.445645 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-85cce6b2-289a-4f43-b550-1da6919e85f2 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:11.446127 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-85cce6b2-289a-4f43-b550-1da6919e85f2 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:11.449568 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2f7a49a5-2863-41aa-914d-3690cef8cf05 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:11.458943 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2f7a49a5-2863-41aa-914d-3690cef8cf05 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/13432f77-a4ba-4dea-a1a7-a47fb9b425b9" status: 200 len: 1319 microversion: 2.1 time: 0.314975 Oct 18 15:28:11.460410 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 510/970] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:11 2022] GET /compute/v2.1/servers/13432f77-a4ba-4dea-a1a7-a47fb9b425b9 => generated 1319 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:28:11.468382 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-85cce6b2-289a-4f43-b550-1da6919e85f2 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] HTTP exception thrown: Instance 19061153-9eed-4374-8799-b497b8a8e780 could not be found. Oct 18 15:28:11.470115 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-85cce6b2-289a-4f43-b550-1da6919e85f2 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Request method failure captured: Oct 18 15:28:11.470115 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/19061153-9eed-4374-8799-b497b8a8e780 HTTP/1.1 Oct 18 15:28:11.470115 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:28:11.470115 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:28:11.470115 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:28:11.470115 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:28:11.470115 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:28:11.470115 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:28:11.470115 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:28:11.470115 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:28:11.470115 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsVxeQk-CD5CQSpFpXvnQ3pWaXxLx7C0QVQTECQtzV4PmBf9zzHBrRJhBQg4OfT0o71lNKVnYfSVDSTWueMpRFcEinDxqg6NsS027zjOlboJqLmMwJocUS_g1GY0npseh17jMK1wPoEZuDSD8Sq8o6cmi-aArekSqmR_QY5ffbryKjQ Oct 18 15:28:11.470115 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:28:11.470115 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:28:11.470115 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:28:11.470115 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:28:11.470115 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:28:11.470115 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:28:11.470115 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: e6facda3e46640c884583aaf146a8b14 Oct 18 15:28:11.470115 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-889889771 Oct 18 15:28:11.470115 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:28:11.470115 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:28:11.471565 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e6facda3e46640c884583aaf146a8b14"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e6facda3e46640c884583aaf146a8b14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e6facda3e46640c884583aaf146a8b14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e6facda3e46640c884583aaf146a8b14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:28:11.471565 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-889889771 Oct 18 15:28:11.471565 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: e6facda3e46640c884583aaf146a8b14 Oct 18 15:28:11.471565 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-889889771 Oct 18 15:28:11.471565 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServersWithSpecificFlavorTestJSON-889889771-project Oct 18 15:28:11.471565 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:28:11.471565 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:28:11.471565 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: aa2bbb8b77794404af993e8291343afa Oct 18 15:28:11.471565 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-889889771-project Oct 18 15:28:11.471565 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:28:11.471565 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 19061153-9eed-4374-8799-b497b8a8e780 could not be found. Oct 18 15:28:11.471565 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '19061153-9eed-4374-8799-b497b8a8e780'} Oct 18 15:28:11.472651 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:28:11.472651 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:28:11.472651 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:28:11.472651 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:28:11.472651 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:28:11.472651 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:28:11.472651 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:28:11.472651 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:28:11.472651 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:28:11.472651 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:28:11.472651 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19061153-9eed-4374-8799-b497b8a8e780 could not be found. Oct 18 15:28:11.472651 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:28:11.472651 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:28:11.472651 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:28:11.472651 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:28:11.472651 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:28:11.472651 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:28:11.472651 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:28:11.472651 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:28:11.472651 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:28:11.474133 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:28:11.474133 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:28:11.474133 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:28:11.474133 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:28:11.474133 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:28:11.474133 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:28:11.474133 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:28:11.474133 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19061153-9eed-4374-8799-b497b8a8e780 could not be found. Oct 18 15:28:11.474133 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:28:11.474133 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:28:11.474133 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:28:11.474133 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:28:11.474133 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:28:11.474133 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:28:11.474133 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:28:11.474133 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:28:11.474133 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19061153-9eed-4374-8799-b497b8a8e780 could not be found. Oct 18 15:28:11.474133 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:28:11.476502 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-85cce6b2-289a-4f43-b550-1da6919e85f2 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] Returning 404 to user: Instance 19061153-9eed-4374-8799-b497b8a8e780 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:28:11.478143 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-85cce6b2-289a-4f43-b550-1da6919e85f2 tempest-ServersWithSpecificFlavorTestJSON-889889771 tempest-ServersWithSpecificFlavorTestJSON-889889771-project] 10.222.0.60 "GET /compute/v2.1/servers/19061153-9eed-4374-8799-b497b8a8e780" status: 404 len: 111 microversion: 2.1 time: 0.045660 Oct 18 15:28:11.478696 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 461/971] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:11 2022] GET /compute/v2.1/servers/19061153-9eed-4374-8799-b497b8a8e780 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 15:28:12.102700 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-df392209-8d75-4719-b321-9c4b111189dd tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:12.103313 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-df392209-8d75-4719-b321-9c4b111189dd tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:12.112824 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df392209-8d75-4719-b321-9c4b111189dd tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:12.118117 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df392209-8d75-4719-b321-9c4b111189dd tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:12.118577 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df392209-8d75-4719-b321-9c4b111189dd tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:12.119543 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df392209-8d75-4719-b321-9c4b111189dd tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:12.120015 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df392209-8d75-4719-b321-9c4b111189dd tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:12.120446 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df392209-8d75-4719-b321-9c4b111189dd tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:12.149521 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ee27a6e1-1af9-430f-a62f-fe14d0991a77 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d3b6a60>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:12.214505 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ee27a6e1-1af9-430f-a62f-fe14d0991a77 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/a3cce994-6f52-4376-b348-a7cf7a071d8d" status: 200 len: 1438 microversion: 2.1 time: 0.070683 Oct 18 15:28:12.219709 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-df392209-8d75-4719-b321-9c4b111189dd tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:12.225050 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 462/972] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:28:12 2022] GET /compute/v2.1/images/a3cce994-6f52-4376-b348-a7cf7a071d8d => generated 1438 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:12.228648 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-df392209-8d75-4719-b321-9c4b111189dd tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:12.230155 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-df392209-8d75-4719-b321-9c4b111189dd tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:12.250117 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-df392209-8d75-4719-b321-9c4b111189dd tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1539 microversion: 2.91 time: 0.148223 Oct 18 15:28:12.251792 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 511/973] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:28:12 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1539 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:28:12.485993 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5e8ca759-e800-47d1-8ee8-4e04515fc7ab tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:12.486942 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5e8ca759-e800-47d1-8ee8-4e04515fc7ab tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 13432f77-a4ba-4dea-a1a7-a47fb9b425b9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:12.502568 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5e8ca759-e800-47d1-8ee8-4e04515fc7ab tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:12.504088 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5e8ca759-e800-47d1-8ee8-4e04515fc7ab tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:12.505198 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5e8ca759-e800-47d1-8ee8-4e04515fc7ab tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:12.506117 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5e8ca759-e800-47d1-8ee8-4e04515fc7ab tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:12.506747 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5e8ca759-e800-47d1-8ee8-4e04515fc7ab tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:12.507464 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5e8ca759-e800-47d1-8ee8-4e04515fc7ab tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:12.793730 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5e8ca759-e800-47d1-8ee8-4e04515fc7ab tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:12.803172 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5e8ca759-e800-47d1-8ee8-4e04515fc7ab tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/13432f77-a4ba-4dea-a1a7-a47fb9b425b9" status: 200 len: 1469 microversion: 2.1 time: 0.321373 Oct 18 15:28:12.816021 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 463/974] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:12 2022] GET /compute/v2.1/servers/13432f77-a4ba-4dea-a1a7-a47fb9b425b9 => generated 1469 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:12.831944 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0cf7f2c5-4947-41dc-823f-a86f5ccbda74 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:12.832559 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0cf7f2c5-4947-41dc-823f-a86f5ccbda74 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 92daf2e6-9a72-4b2a-94aa-4316c7edb3c0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:12.849306 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0cf7f2c5-4947-41dc-823f-a86f5ccbda74 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:12.849977 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0cf7f2c5-4947-41dc-823f-a86f5ccbda74 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:12.850599 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0cf7f2c5-4947-41dc-823f-a86f5ccbda74 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:12.851465 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0cf7f2c5-4947-41dc-823f-a86f5ccbda74 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:12.852601 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0cf7f2c5-4947-41dc-823f-a86f5ccbda74 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:12.853207 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0cf7f2c5-4947-41dc-823f-a86f5ccbda74 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:13.232048 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9984bf34-3817-49a1-89a4-769e31c74d9a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d3b6f70>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:13.313953 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9984bf34-3817-49a1-89a4-769e31c74d9a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/a3cce994-6f52-4376-b348-a7cf7a071d8d" status: 200 len: 1438 microversion: 2.1 time: 0.087001 Oct 18 15:28:13.315234 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 464/975] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:28:13 2022] GET /compute/v2.1/images/a3cce994-6f52-4376-b348-a7cf7a071d8d => generated 1438 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:13.333943 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4416945a-3cf7-4ed7-ad9d-557150625941 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:13.334770 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4416945a-3cf7-4ed7-ad9d-557150625941 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:13.364920 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4416945a-3cf7-4ed7-ad9d-557150625941 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:13.365691 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4416945a-3cf7-4ed7-ad9d-557150625941 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:13.366372 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4416945a-3cf7-4ed7-ad9d-557150625941 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:13.367948 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4416945a-3cf7-4ed7-ad9d-557150625941 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:13.370182 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4416945a-3cf7-4ed7-ad9d-557150625941 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:13.370806 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4416945a-3cf7-4ed7-ad9d-557150625941 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:13.827531 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0cf7f2c5-4947-41dc-823f-a86f5ccbda74 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:13.833257 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4416945a-3cf7-4ed7-ad9d-557150625941 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:13.843186 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0cf7f2c5-4947-41dc-823f-a86f5ccbda74 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/92daf2e6-9a72-4b2a-94aa-4316c7edb3c0" status: 200 len: 1469 microversion: 2.1 time: 1.010943 Oct 18 15:28:13.849727 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4416945a-3cf7-4ed7-ad9d-557150625941 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:13.854811 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4416945a-3cf7-4ed7-ad9d-557150625941 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:13.867993 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 512/976] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:12 2022] GET /compute/v2.1/servers/92daf2e6-9a72-4b2a-94aa-4316c7edb3c0 => generated 1469 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:13.871858 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4416945a-3cf7-4ed7-ad9d-557150625941 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1539 microversion: 2.91 time: 0.555100 Oct 18 15:28:13.878381 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6280b001-a03f-4759-b52f-2f98ea551bfd tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:13.878889 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 465/977] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:28:13 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1539 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:28:13.886319 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6280b001-a03f-4759-b52f-2f98ea551bfd tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:13.894102 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6280b001-a03f-4759-b52f-2f98ea551bfd tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Searching by: {'reservation_id': 'r-k00zdlqb', 'deleted': False, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3'} {{(pid=120406) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 15:28:13.910348 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6280b001-a03f-4759-b52f-2f98ea551bfd tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:13.913447 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6280b001-a03f-4759-b52f-2f98ea551bfd tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:13.919448 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6280b001-a03f-4759-b52f-2f98ea551bfd tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:13.920346 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6280b001-a03f-4759-b52f-2f98ea551bfd tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:13.925965 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6280b001-a03f-4759-b52f-2f98ea551bfd tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:13.926405 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6280b001-a03f-4759-b52f-2f98ea551bfd tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:14.202982 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.multi_cell_list [None req-6280b001-a03f-4759-b52f-2f98ea551bfd tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120406) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 15:28:14.333519 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-82a009d8-5add-4f52-81cf-90ecc4cc4dc0 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d3d58b0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:14.420674 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-82a009d8-5add-4f52-81cf-90ecc4cc4dc0 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/a3cce994-6f52-4376-b348-a7cf7a071d8d" status: 200 len: 1438 microversion: 2.1 time: 0.092868 Oct 18 15:28:14.432200 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 466/978] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:28:14 2022] GET /compute/v2.1/images/a3cce994-6f52-4376-b348-a7cf7a071d8d => generated 1438 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:28:14.482378 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6280b001-a03f-4759-b52f-2f98ea551bfd tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:14.501435 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6280b001-a03f-4759-b52f-2f98ea551bfd tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:14.503076 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6280b001-a03f-4759-b52f-2f98ea551bfd tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:14.507947 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6280b001-a03f-4759-b52f-2f98ea551bfd tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:14.909511 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-33ea8731-39c4-4202-9de1-de7e8f32d60a tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:14.910397 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-33ea8731-39c4-4202-9de1-de7e8f32d60a tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:14.926350 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-33ea8731-39c4-4202-9de1-de7e8f32d60a tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:14.927173 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-33ea8731-39c4-4202-9de1-de7e8f32d60a tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:14.935837 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-33ea8731-39c4-4202-9de1-de7e8f32d60a tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:14.939324 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-33ea8731-39c4-4202-9de1-de7e8f32d60a tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:14.940035 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-33ea8731-39c4-4202-9de1-de7e8f32d60a tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:14.940878 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-33ea8731-39c4-4202-9de1-de7e8f32d60a tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:15.034369 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6280b001-a03f-4759-b52f-2f98ea551bfd tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/detail?reservation_id=r-k00zdlqb" status: 200 len: 2931 microversion: 2.1 time: 1.164536 Oct 18 15:28:15.036407 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 513/979] 10.222.0.60 () {58 vars in 1197 bytes} [Tue Oct 18 15:28:13 2022] GET /compute/v2.1/servers/detail?reservation_id=r-k00zdlqb => generated 2931 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:15.068722 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6fae37ab-fece-4597-bca6-e256def9225c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:15.140382 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.compute.server_groups [None req-6fae37ab-fece-4597-bca6-e256def9225c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Querying cell 8ab54c98-adc3-429d-89a9-d68fdb0f782a(cell1) for 2 instances {{(pid=120406) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 18 15:28:15.142495 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6fae37ab-fece-4597-bca6-e256def9225c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:15.143310 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6fae37ab-fece-4597-bca6-e256def9225c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:15.144477 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6fae37ab-fece-4597-bca6-e256def9225c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:15.184693 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6fae37ab-fece-4597-bca6-e256def9225c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/os-server-groups/c0b3f01f-e83d-47cb-abe4-1a5666e6238c" status: 200 len: 265 microversion: 2.1 time: 0.119525 Oct 18 15:28:15.192064 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 514/980] 10.222.0.60 () {58 vars in 1263 bytes} [Tue Oct 18 15:28:15 2022] GET /compute/v2.1/os-server-groups/c0b3f01f-e83d-47cb-abe4-1a5666e6238c => generated 265 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:28:15.197729 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bcb48e3f-2516-4fa9-9466-3c7b0359bdbc tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:15.198463 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bcb48e3f-2516-4fa9-9466-3c7b0359bdbc tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] [instance: 13432f77-a4ba-4dea-a1a7-a47fb9b425b9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:15.206035 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bcb48e3f-2516-4fa9-9466-3c7b0359bdbc tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:15.206694 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bcb48e3f-2516-4fa9-9466-3c7b0359bdbc tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:15.207281 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bcb48e3f-2516-4fa9-9466-3c7b0359bdbc tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:15.208037 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bcb48e3f-2516-4fa9-9466-3c7b0359bdbc tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:15.208596 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bcb48e3f-2516-4fa9-9466-3c7b0359bdbc tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:15.209227 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bcb48e3f-2516-4fa9-9466-3c7b0359bdbc tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:15.319423 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-33ea8731-39c4-4202-9de1-de7e8f32d60a tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:15.332872 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-33ea8731-39c4-4202-9de1-de7e8f32d60a tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:15.334613 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-33ea8731-39c4-4202-9de1-de7e8f32d60a tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:15.346894 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-33ea8731-39c4-4202-9de1-de7e8f32d60a tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1539 microversion: 2.91 time: 0.444006 Oct 18 15:28:15.368673 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 467/981] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:28:14 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1539 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:28:15.440510 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-22d66725-5417-45d8-b2a2-d4dafeb6c2ba tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d3bc9d0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:15.483715 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bcb48e3f-2516-4fa9-9466-3c7b0359bdbc tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/13432f77-a4ba-4dea-a1a7-a47fb9b425b9" status: 200 len: 1620 microversion: 2.1 time: 0.290083 Oct 18 15:28:15.488209 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 515/982] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:15 2022] GET /compute/v2.1/servers/13432f77-a4ba-4dea-a1a7-a47fb9b425b9 => generated 1620 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:15.516639 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dd95a465-51e6-4263-8b36-76c857647816 tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:15.528575 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dd95a465-51e6-4263-8b36-76c857647816 tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] [instance: 92daf2e6-9a72-4b2a-94aa-4316c7edb3c0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:15.571399 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd95a465-51e6-4263-8b36-76c857647816 tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:15.581771 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd95a465-51e6-4263-8b36-76c857647816 tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:15.585427 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd95a465-51e6-4263-8b36-76c857647816 tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:15.588015 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd95a465-51e6-4263-8b36-76c857647816 tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:15.588682 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd95a465-51e6-4263-8b36-76c857647816 tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:15.589988 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd95a465-51e6-4263-8b36-76c857647816 tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:15.594001 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-22d66725-5417-45d8-b2a2-d4dafeb6c2ba tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/a3cce994-6f52-4376-b348-a7cf7a071d8d" status: 200 len: 1438 microversion: 2.1 time: 0.159350 Oct 18 15:28:15.594582 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 468/983] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:28:15 2022] GET /compute/v2.1/images/a3cce994-6f52-4376-b348-a7cf7a071d8d => generated 1438 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:16.280371 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dd95a465-51e6-4263-8b36-76c857647816 tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/92daf2e6-9a72-4b2a-94aa-4316c7edb3c0" status: 200 len: 1620 microversion: 2.1 time: 0.765035 Oct 18 15:28:16.286091 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 516/984] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:15 2022] GET /compute/v2.1/servers/92daf2e6-9a72-4b2a-94aa-4316c7edb3c0 => generated 1620 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:16.326173 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e4895a37-9b25-40d0-8aad-28decd7d6296 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Action: 'create', calling method: .version_select at 0x7f7c3d3b2040>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1710716631", "policies": ["anti-affinity"]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:28:16.384021 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-930955c5-ae65-418a-9dde-cf677235125b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:16.384744 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-930955c5-ae65-418a-9dde-cf677235125b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:16.399599 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-930955c5-ae65-418a-9dde-cf677235125b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:16.405561 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-930955c5-ae65-418a-9dde-cf677235125b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:16.410446 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-930955c5-ae65-418a-9dde-cf677235125b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:16.412248 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-930955c5-ae65-418a-9dde-cf677235125b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:16.415643 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-e4895a37-9b25-40d0-8aad-28decd7d6296 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Getting quotas for project 377c3bbd62b546fca545c0f6d0df59e3. Resources: {'server_groups'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:28:16.417968 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-930955c5-ae65-418a-9dde-cf677235125b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:16.420967 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-930955c5-ae65-418a-9dde-cf677235125b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:16.457753 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-e4895a37-9b25-40d0-8aad-28decd7d6296 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Getting quotas for user d58aac335a1d421a95928e2754fb2529 and project 377c3bbd62b546fca545c0f6d0df59e3. Resources: {'server_groups'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:28:16.672000 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-930955c5-ae65-418a-9dde-cf677235125b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:16.692460 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-930955c5-ae65-418a-9dde-cf677235125b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:16.703262 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-930955c5-ae65-418a-9dde-cf677235125b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:16.705964 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-e4895a37-9b25-40d0-8aad-28decd7d6296 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Getting quotas for project 377c3bbd62b546fca545c0f6d0df59e3. Resources: {'server_groups'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:28:16.723194 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-930955c5-ae65-418a-9dde-cf677235125b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1539 microversion: 2.91 time: 0.343131 Oct 18 15:28:16.723927 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 517/985] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:28:16 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1539 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:28:16.740366 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2cdaf79d-45cd-49ac-8b98-bb56423d05f9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d96e1f0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:16.745629 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-e4895a37-9b25-40d0-8aad-28decd7d6296 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Getting quotas for user d58aac335a1d421a95928e2754fb2529 and project 377c3bbd62b546fca545c0f6d0df59e3. Resources: {'server_groups'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:28:16.835629 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e4895a37-9b25-40d0-8aad-28decd7d6296 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.511269 Oct 18 15:28:16.840457 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 469/986] 10.222.0.60 () {60 vars in 1174 bytes} [Tue Oct 18 15:28:16 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:28:16.868422 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2cdaf79d-45cd-49ac-8b98-bb56423d05f9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/a3cce994-6f52-4376-b348-a7cf7a071d8d" status: 200 len: 1438 microversion: 2.1 time: 0.140005 Oct 18 15:28:16.879440 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 518/987] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:28:16 2022] GET /compute/v2.1/images/a3cce994-6f52-4376-b348-a7cf7a071d8d => generated 1438 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:16.942621 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1504efc6-2090-4b1d-adf2-ee390a9f8524 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1797720353", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "8facea0e-84b1-4be3-aed0-15854c6df1b4"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:28:17.067362 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-1504efc6-2090-4b1d-adf2-ee390a9f8524 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] validate_networks() for None {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:28:17.531146 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-1504efc6-2090-4b1d-adf2-ee390a9f8524 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:28:17.532251 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-1504efc6-2090-4b1d-adf2-ee390a9f8524 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:28:17.533183 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-1504efc6-2090-4b1d-adf2-ee390a9f8524 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:28:17.533750 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-1504efc6-2090-4b1d-adf2-ee390a9f8524 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:28:17.535636 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-1504efc6-2090-4b1d-adf2-ee390a9f8524 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:28:17.567476 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1504efc6-2090-4b1d-adf2-ee390a9f8524 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:17.568248 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1504efc6-2090-4b1d-adf2-ee390a9f8524 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:17.568899 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1504efc6-2090-4b1d-adf2-ee390a9f8524 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:17.573793 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1504efc6-2090-4b1d-adf2-ee390a9f8524 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:17.574475 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1504efc6-2090-4b1d-adf2-ee390a9f8524 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:17.575086 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1504efc6-2090-4b1d-adf2-ee390a9f8524 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:17.616408 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-1504efc6-2090-4b1d-adf2-ee390a9f8524 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Getting quotas for project 377c3bbd62b546fca545c0f6d0df59e3. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:28:17.628515 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-1504efc6-2090-4b1d-adf2-ee390a9f8524 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Getting quotas for user d58aac335a1d421a95928e2754fb2529 and project 377c3bbd62b546fca545c0f6d0df59e3. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:28:17.655313 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1504efc6-2090-4b1d-adf2-ee390a9f8524 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Going to run 2 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:28:17.666130 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1504efc6-2090-4b1d-adf2-ee390a9f8524 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 803b657a-c370-4fa9-8fbc-27ec5d844758] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:28:17.759612 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-83a613e4-9da1-4f95-bcbf-420485f4c2d8 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:17.760862 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-83a613e4-9da1-4f95-bcbf-420485f4c2d8 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:17.785873 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83a613e4-9da1-4f95-bcbf-420485f4c2d8 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:17.786411 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83a613e4-9da1-4f95-bcbf-420485f4c2d8 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:17.790048 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83a613e4-9da1-4f95-bcbf-420485f4c2d8 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:17.791132 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83a613e4-9da1-4f95-bcbf-420485f4c2d8 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:17.791594 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-1504efc6-2090-4b1d-adf2-ee390a9f8524 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Getting quotas for project 377c3bbd62b546fca545c0f6d0df59e3. Resources: {'server_group_members'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:28:17.795233 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83a613e4-9da1-4f95-bcbf-420485f4c2d8 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:17.795689 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83a613e4-9da1-4f95-bcbf-420485f4c2d8 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:17.805696 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-1504efc6-2090-4b1d-adf2-ee390a9f8524 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Getting quotas for user d58aac335a1d421a95928e2754fb2529 and project 377c3bbd62b546fca545c0f6d0df59e3. Resources: {'server_group_members'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:28:17.917438 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-1504efc6-2090-4b1d-adf2-ee390a9f8524 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Getting quotas for project 377c3bbd62b546fca545c0f6d0df59e3. Resources: {'server_group_members'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:28:17.929396 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=6,nova_api:INSERT=6 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:28:17.933429 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-1504efc6-2090-4b1d-adf2-ee390a9f8524 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Getting quotas for user d58aac335a1d421a95928e2754fb2529 and project 377c3bbd62b546fca545c0f6d0df59e3. Resources: {'server_group_members'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:28:17.979818 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1504efc6-2090-4b1d-adf2-ee390a9f8524 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: fba41720-c579-4efc-acd3-bcd27c6ae037] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=803b657a-c370-4fa9-8fbc-27ec5d844758,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:28:17.980105 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-83a613e4-9da1-4f95-bcbf-420485f4c2d8 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:17.992509 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-83a613e4-9da1-4f95-bcbf-420485f4c2d8 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:17.993994 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-83a613e4-9da1-4f95-bcbf-420485f4c2d8 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:18.016881 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-83a613e4-9da1-4f95-bcbf-420485f4c2d8 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1539 microversion: 2.91 time: 0.266804 Oct 18 15:28:18.017447 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 519/988] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:28:17 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1539 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:28:18.044765 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5e3e8d90-6b4c-4f8c-92b1-574301e9555f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d881c10>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:18.143615 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-1504efc6-2090-4b1d-adf2-ee390a9f8524 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Getting quotas for project 377c3bbd62b546fca545c0f6d0df59e3. Resources: {'server_group_members'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:28:18.156438 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-1504efc6-2090-4b1d-adf2-ee390a9f8524 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Getting quotas for user d58aac335a1d421a95928e2754fb2529 and project 377c3bbd62b546fca545c0f6d0df59e3. Resources: {'server_group_members'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:28:18.171829 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5e3e8d90-6b4c-4f8c-92b1-574301e9555f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/a3cce994-6f52-4376-b348-a7cf7a071d8d" status: 200 len: 1438 microversion: 2.1 time: 0.142162 Oct 18 15:28:18.180065 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 520/989] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:28:18 2022] GET /compute/v2.1/images/a3cce994-6f52-4376-b348-a7cf7a071d8d => generated 1438 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:18.270327 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-1504efc6-2090-4b1d-adf2-ee390a9f8524 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Getting quotas for project 377c3bbd62b546fca545c0f6d0df59e3. Resources: {'server_group_members'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:28:18.292725 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-1504efc6-2090-4b1d-adf2-ee390a9f8524 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Getting quotas for user d58aac335a1d421a95928e2754fb2529 and project 377c3bbd62b546fca545c0f6d0df59e3. Resources: {'server_group_members'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:28:18.357359 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1504efc6-2090-4b1d-adf2-ee390a9f8524 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.420242 Oct 18 15:28:18.358544 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 470/990] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:28:16 2022] POST /compute/v2.1/servers => generated 32 bytes in 1422 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 18 15:28:18.366688 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3bd64cc9-6a23-426f-bfe8-8d36c8c9e1df tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:18.377823 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3bd64cc9-6a23-426f-bfe8-8d36c8c9e1df tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:18.378045 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3bd64cc9-6a23-426f-bfe8-8d36c8c9e1df tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Searching by: {'deleted': False, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3'} {{(pid=120406) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 15:28:18.412729 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3bd64cc9-6a23-426f-bfe8-8d36c8c9e1df tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:18.413496 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3bd64cc9-6a23-426f-bfe8-8d36c8c9e1df tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:18.414291 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3bd64cc9-6a23-426f-bfe8-8d36c8c9e1df tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:18.415184 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3bd64cc9-6a23-426f-bfe8-8d36c8c9e1df tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:18.418511 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3bd64cc9-6a23-426f-bfe8-8d36c8c9e1df tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:18.419159 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3bd64cc9-6a23-426f-bfe8-8d36c8c9e1df tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:18.548259 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.multi_cell_list [None req-3bd64cc9-6a23-426f-bfe8-8d36c8c9e1df tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=120406) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 15:28:18.611986 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3bd64cc9-6a23-426f-bfe8-8d36c8c9e1df tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 1666 microversion: 2.1 time: 0.249297 Oct 18 15:28:18.621542 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 521/991] 10.222.0.60 () {58 vars in 1125 bytes} [Tue Oct 18 15:28:18 2022] GET /compute/v2.1/servers => generated 1666 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:18.626475 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0e512e13-7a60-4ec7-b4fa-37defaeba9d2 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:18.627101 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0e512e13-7a60-4ec7-b4fa-37defaeba9d2 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: fba41720-c579-4efc-acd3-bcd27c6ae037] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:18.774770 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0e512e13-7a60-4ec7-b4fa-37defaeba9d2 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:18.802753 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0e512e13-7a60-4ec7-b4fa-37defaeba9d2 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/fba41720-c579-4efc-acd3-bcd27c6ae037" status: 200 len: 1219 microversion: 2.1 time: 0.180223 Oct 18 15:28:18.809187 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 471/992] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:18 2022] GET /compute/v2.1/servers/fba41720-c579-4efc-acd3-bcd27c6ae037 => generated 1219 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:28:19.051548 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c6c3ef19-3344-4825-a390-f5cf4eaaead3 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:19.052156 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c6c3ef19-3344-4825-a390-f5cf4eaaead3 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:19.067877 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6c3ef19-3344-4825-a390-f5cf4eaaead3 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:19.068402 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6c3ef19-3344-4825-a390-f5cf4eaaead3 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:19.068838 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6c3ef19-3344-4825-a390-f5cf4eaaead3 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:19.071738 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6c3ef19-3344-4825-a390-f5cf4eaaead3 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:19.073268 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6c3ef19-3344-4825-a390-f5cf4eaaead3 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:19.074147 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6c3ef19-3344-4825-a390-f5cf4eaaead3 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:19.187486 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b33a5476-36f2-480b-aa62-0fd2db0a0e26 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d377040>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:19.222380 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c6c3ef19-3344-4825-a390-f5cf4eaaead3 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:19.235091 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c6c3ef19-3344-4825-a390-f5cf4eaaead3 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:19.236592 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c6c3ef19-3344-4825-a390-f5cf4eaaead3 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:19.255090 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c6c3ef19-3344-4825-a390-f5cf4eaaead3 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1539 microversion: 2.91 time: 0.212711 Oct 18 15:28:19.255685 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 522/993] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:28:19 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1539 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:28:19.271739 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b33a5476-36f2-480b-aa62-0fd2db0a0e26 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/a3cce994-6f52-4376-b348-a7cf7a071d8d" status: 200 len: 1438 microversion: 2.1 time: 0.087293 Oct 18 15:28:19.272357 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 472/994] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:28:19 2022] GET /compute/v2.1/images/a3cce994-6f52-4376-b348-a7cf7a071d8d => generated 1438 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:28:19.466790 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a9471592-7deb-4200-b2eb-a56785f5b860 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Action: 'create', calling method: .version_select at 0x7f7c3d881c10>, body: {"keypair": {"name": "tempest-keypair-1500708318", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHxVe3qIEHgY1ja5Yj5zXNNZKhU8K8oyVHTInks6PQ6SdoaYLcxT2bVrjrBedj3WOrOJACK2ODvUTFP1hCx0OA5I8doupATTKAGVZM2s8jNmfVAPg1iaWVQkf6+J68zY0Q=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:28:19.518279 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-a9471592-7deb-4200-b2eb-a56785f5b860 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Getting quotas for project ac3cdc1276f14660a6fc8101364d2a35. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:28:19.520911 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:28:19.535889 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-a9471592-7deb-4200-b2eb-a56785f5b860 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Getting quotas for user 8f10b8a9983f41e8b30183dcafbdce1d and project ac3cdc1276f14660a6fc8101364d2a35. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:28:19.609256 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a9471592-7deb-4200-b2eb-a56785f5b860 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.147074 Oct 18 15:28:19.609963 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 523/995] 10.222.0.60 () {62 vars in 1200 bytes} [Tue Oct 18 15:28:19 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 149 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 18 15:28:19.831833 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5d8a9219-0fb4-4dd8-af40-096630e100e3 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:19.832543 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5d8a9219-0fb4-4dd8-af40-096630e100e3 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: fba41720-c579-4efc-acd3-bcd27c6ae037] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:19.950200 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5d8a9219-0fb4-4dd8-af40-096630e100e3 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:19.958827 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5d8a9219-0fb4-4dd8-af40-096630e100e3 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/fba41720-c579-4efc-acd3-bcd27c6ae037" status: 200 len: 1219 microversion: 2.1 time: 0.130957 Oct 18 15:28:19.961275 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 473/996] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:19 2022] GET /compute/v2.1/servers/fba41720-c579-4efc-acd3-bcd27c6ae037 => generated 1219 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:28:20.294090 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-773e18e7-7e53-42ae-93d5-a601c7fcdede tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:20.295296 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-773e18e7-7e53-42ae-93d5-a601c7fcdede tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:20.297659 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-27799332-cd30-42b9-9aa5-91ebb33ee4df tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d3d5d30>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:20.319557 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-773e18e7-7e53-42ae-93d5-a601c7fcdede tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:20.322236 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-773e18e7-7e53-42ae-93d5-a601c7fcdede tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:20.322870 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-773e18e7-7e53-42ae-93d5-a601c7fcdede tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:20.326970 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-773e18e7-7e53-42ae-93d5-a601c7fcdede tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:20.327481 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-773e18e7-7e53-42ae-93d5-a601c7fcdede tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:20.327918 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-773e18e7-7e53-42ae-93d5-a601c7fcdede tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:20.410327 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-27799332-cd30-42b9-9aa5-91ebb33ee4df tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/a3cce994-6f52-4376-b348-a7cf7a071d8d" status: 200 len: 1438 microversion: 2.1 time: 0.122424 Oct 18 15:28:20.421277 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 474/997] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:28:20 2022] GET /compute/v2.1/images/a3cce994-6f52-4376-b348-a7cf7a071d8d => generated 1438 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:20.523918 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-773e18e7-7e53-42ae-93d5-a601c7fcdede tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:20.541531 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-773e18e7-7e53-42ae-93d5-a601c7fcdede tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:20.556016 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-773e18e7-7e53-42ae-93d5-a601c7fcdede tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:20.574810 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-773e18e7-7e53-42ae-93d5-a601c7fcdede tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1539 microversion: 2.91 time: 0.290711 Oct 18 15:28:20.589156 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 524/998] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:28:20 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1539 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:28:20.984195 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-40b0ec96-341b-4a89-aa3c-1dbb1c9f41cd tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:20.985035 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-40b0ec96-341b-4a89-aa3c-1dbb1c9f41cd tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: fba41720-c579-4efc-acd3-bcd27c6ae037] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:20.995813 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-40b0ec96-341b-4a89-aa3c-1dbb1c9f41cd tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:20.996406 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-40b0ec96-341b-4a89-aa3c-1dbb1c9f41cd tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:21.006564 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-40b0ec96-341b-4a89-aa3c-1dbb1c9f41cd tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:21.011943 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-40b0ec96-341b-4a89-aa3c-1dbb1c9f41cd tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:21.014382 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-40b0ec96-341b-4a89-aa3c-1dbb1c9f41cd tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:21.016065 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-40b0ec96-341b-4a89-aa3c-1dbb1c9f41cd tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:21.246064 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-40b0ec96-341b-4a89-aa3c-1dbb1c9f41cd tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:21.279149 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-40b0ec96-341b-4a89-aa3c-1dbb1c9f41cd tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/fba41720-c579-4efc-acd3-bcd27c6ae037" status: 200 len: 1271 microversion: 2.1 time: 0.294715 Oct 18 15:28:21.296832 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 475/999] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:20 2022] GET /compute/v2.1/servers/fba41720-c579-4efc-acd3-bcd27c6ae037 => generated 1271 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:21.429425 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1b647c39-4780-46cf-98c0-062e78bddc2f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d85c280>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:21.541538 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1b647c39-4780-46cf-98c0-062e78bddc2f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/a3cce994-6f52-4376-b348-a7cf7a071d8d" status: 200 len: 1438 microversion: 2.1 time: 0.116695 Oct 18 15:28:21.542059 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 525/1000] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:28:21 2022] GET /compute/v2.1/images/a3cce994-6f52-4376-b348-a7cf7a071d8d => generated 1438 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:21.608260 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3e25c39b-c75c-417e-8212-84c7d3458e29 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:21.608926 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3e25c39b-c75c-417e-8212-84c7d3458e29 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:21.639129 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3e25c39b-c75c-417e-8212-84c7d3458e29 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:21.639667 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3e25c39b-c75c-417e-8212-84c7d3458e29 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:21.640115 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3e25c39b-c75c-417e-8212-84c7d3458e29 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:21.640857 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3e25c39b-c75c-417e-8212-84c7d3458e29 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:21.641319 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3e25c39b-c75c-417e-8212-84c7d3458e29 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:21.641751 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3e25c39b-c75c-417e-8212-84c7d3458e29 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:22.240958 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3e25c39b-c75c-417e-8212-84c7d3458e29 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:22.262532 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3e25c39b-c75c-417e-8212-84c7d3458e29 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:22.266248 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3e25c39b-c75c-417e-8212-84c7d3458e29 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:22.284041 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3e25c39b-c75c-417e-8212-84c7d3458e29 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1539 microversion: 2.91 time: 0.676591 Oct 18 15:28:22.285223 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 476/1001] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:28:21 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1539 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:28:22.307729 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fc79b1fb-9fa8-4bde-9245-3debc38ab297 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:22.308439 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fc79b1fb-9fa8-4bde-9245-3debc38ab297 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: fba41720-c579-4efc-acd3-bcd27c6ae037] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:22.322309 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc79b1fb-9fa8-4bde-9245-3debc38ab297 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:22.333738 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc79b1fb-9fa8-4bde-9245-3debc38ab297 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:22.334471 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc79b1fb-9fa8-4bde-9245-3debc38ab297 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:22.335241 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc79b1fb-9fa8-4bde-9245-3debc38ab297 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:22.339433 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc79b1fb-9fa8-4bde-9245-3debc38ab297 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:22.340093 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc79b1fb-9fa8-4bde-9245-3debc38ab297 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:22.557016 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fc79b1fb-9fa8-4bde-9245-3debc38ab297 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:22.558823 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3ce63cab-2eb1-4e51-8802-1ecf3779bcfd tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d3d5b80>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:22.576754 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fc79b1fb-9fa8-4bde-9245-3debc38ab297 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/fba41720-c579-4efc-acd3-bcd27c6ae037" status: 200 len: 1279 microversion: 2.1 time: 0.270033 Oct 18 15:28:22.581245 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 526/1002] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:22 2022] GET /compute/v2.1/servers/fba41720-c579-4efc-acd3-bcd27c6ae037 => generated 1279 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:22.727515 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3ce63cab-2eb1-4e51-8802-1ecf3779bcfd tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/a3cce994-6f52-4376-b348-a7cf7a071d8d" status: 200 len: 1438 microversion: 2.1 time: 0.171135 Oct 18 15:28:22.733366 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 477/1003] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:28:22 2022] GET /compute/v2.1/images/a3cce994-6f52-4376-b348-a7cf7a071d8d => generated 1438 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:28:23.317942 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-72083a3b-f627-4957-bca3-77f8415d94ea tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:23.318716 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-72083a3b-f627-4957-bca3-77f8415d94ea tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:23.332547 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-72083a3b-f627-4957-bca3-77f8415d94ea tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:23.341844 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-72083a3b-f627-4957-bca3-77f8415d94ea tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:23.341844 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-72083a3b-f627-4957-bca3-77f8415d94ea tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:23.343060 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-72083a3b-f627-4957-bca3-77f8415d94ea tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:23.344603 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-72083a3b-f627-4957-bca3-77f8415d94ea tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:23.345245 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-72083a3b-f627-4957-bca3-77f8415d94ea tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:23.603671 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bca04f47-2386-4103-b64f-40f82160ddc1 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:23.605962 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-bca04f47-2386-4103-b64f-40f82160ddc1 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: fba41720-c579-4efc-acd3-bcd27c6ae037] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:23.624526 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-72083a3b-f627-4957-bca3-77f8415d94ea tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:23.642583 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-72083a3b-f627-4957-bca3-77f8415d94ea tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:23.645898 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bca04f47-2386-4103-b64f-40f82160ddc1 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:23.646960 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bca04f47-2386-4103-b64f-40f82160ddc1 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:23.649909 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bca04f47-2386-4103-b64f-40f82160ddc1 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:23.655408 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bca04f47-2386-4103-b64f-40f82160ddc1 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:23.661470 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-72083a3b-f627-4957-bca3-77f8415d94ea tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:23.665462 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bca04f47-2386-4103-b64f-40f82160ddc1 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:23.666338 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bca04f47-2386-4103-b64f-40f82160ddc1 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:23.695842 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-72083a3b-f627-4957-bca3-77f8415d94ea tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1560 microversion: 2.91 time: 0.375869 Oct 18 15:28:23.717087 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 527/1004] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:28:23 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1560 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:28:23.749155 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ac2a5b4c-4593-42db-bab9-198f65df7dca tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d96e280>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:23.914712 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ac2a5b4c-4593-42db-bab9-198f65df7dca tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/a3cce994-6f52-4376-b348-a7cf7a071d8d" status: 200 len: 1438 microversion: 2.1 time: 0.170203 Oct 18 15:28:23.915306 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 528/1005] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:28:23 2022] GET /compute/v2.1/images/a3cce994-6f52-4376-b348-a7cf7a071d8d => generated 1438 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:28:24.006992 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-bca04f47-2386-4103-b64f-40f82160ddc1 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:24.017895 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-bca04f47-2386-4103-b64f-40f82160ddc1 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/fba41720-c579-4efc-acd3-bcd27c6ae037" status: 200 len: 1277 microversion: 2.1 time: 0.418875 Oct 18 15:28:24.043433 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 478/1006] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:23 2022] GET /compute/v2.1/servers/fba41720-c579-4efc-acd3-bcd27c6ae037 => generated 1277 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:24.561960 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8a429c97-5ff9-42d3-98ba-251789114731 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1527498010", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "8071d320-7790-4389-9e52-c9e3895ff47a"}, {"port": "65d90ee5-e161-439c-956f-7f6040e4c2c0", "tag": "port-1"}, {"port": "76b7ba58-dbc1-487b-a62e-3d7ee373767c", "tag": "port-2"}, {"uuid": "d2103e1e-a7ee-4bef-882d-1094190ce4e8", "tag": "net-1"}, {"uuid": "d2103e1e-a7ee-4bef-882d-1094190ce4e8"}, {"uuid": "409f4d31-3be0-4c18-8cff-9af4f6da4d24", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "409f4d31-3be0-4c18-8cff-9af4f6da4d24", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "537e8ac8-4f4e-4b66-9033-250c8f8efd04", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "96ef5e45-f5a0-4486-8116-0ffbb28b084e", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "aea31e55-95cf-43b8-bd01-96feecf51a7e", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1114024308"}], "key_name": "tempest-keypair-1500708318", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:28:24.742139 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-debb22bf-7990-4b36-9cd9-190f00bf55d7 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:24.743072 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-debb22bf-7990-4b36-9cd9-190f00bf55d7 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:24.771437 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-debb22bf-7990-4b36-9cd9-190f00bf55d7 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:24.771970 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-debb22bf-7990-4b36-9cd9-190f00bf55d7 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:24.772423 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-debb22bf-7990-4b36-9cd9-190f00bf55d7 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:24.775155 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-debb22bf-7990-4b36-9cd9-190f00bf55d7 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:24.775633 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-debb22bf-7990-4b36-9cd9-190f00bf55d7 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:24.776572 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-debb22bf-7990-4b36-9cd9-190f00bf55d7 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:24.928020 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-debb22bf-7990-4b36-9cd9-190f00bf55d7 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:24.955481 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-8a429c97-5ff9-42d3-98ba-251789114731 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] validate_networks() for [('8071d320-7790-4389-9e52-c9e3895ff47a', None, None, None, None, None), (None, None, '65d90ee5-e161-439c-956f-7f6040e4c2c0', None, None, None), (None, None, '76b7ba58-dbc1-487b-a62e-3d7ee373767c', None, None, None), ('d2103e1e-a7ee-4bef-882d-1094190ce4e8', None, None, None, None, None), ('d2103e1e-a7ee-4bef-882d-1094190ce4e8', None, None, None, None, None), ('409f4d31-3be0-4c18-8cff-9af4f6da4d24', '10.2.2.100', None, None, None, None), ('409f4d31-3be0-4c18-8cff-9af4f6da4d24', '10.2.2.200', None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:28:24.957448 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-debb22bf-7990-4b36-9cd9-190f00bf55d7 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:24.963658 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-debb22bf-7990-4b36-9cd9-190f00bf55d7 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:24.983483 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-debb22bf-7990-4b36-9cd9-190f00bf55d7 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1560 microversion: 2.91 time: 0.251766 Oct 18 15:28:24.986254 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 479/1007] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:28:24 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1560 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:28:25.016048 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b7b621e8-3a00-496b-93e9-5116b6def68a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d3b6550>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:25.137393 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b7b621e8-3a00-496b-93e9-5116b6def68a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/a3cce994-6f52-4376-b348-a7cf7a071d8d" status: 200 len: 1438 microversion: 2.1 time: 0.149357 Oct 18 15:28:25.138809 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 480/1008] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:28:24 2022] GET /compute/v2.1/images/a3cce994-6f52-4376-b348-a7cf7a071d8d => generated 1438 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:25.152500 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-65628555-e268-49bd-a181-e50d38f70219 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:25.155875 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-65628555-e268-49bd-a181-e50d38f70219 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: fba41720-c579-4efc-acd3-bcd27c6ae037] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:25.185833 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-65628555-e268-49bd-a181-e50d38f70219 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:25.189589 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-65628555-e268-49bd-a181-e50d38f70219 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:25.191528 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-65628555-e268-49bd-a181-e50d38f70219 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:25.200301 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-65628555-e268-49bd-a181-e50d38f70219 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:25.201275 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-65628555-e268-49bd-a181-e50d38f70219 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:25.204745 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-65628555-e268-49bd-a181-e50d38f70219 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:25.459362 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-65628555-e268-49bd-a181-e50d38f70219 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:25.475146 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-65628555-e268-49bd-a181-e50d38f70219 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/fba41720-c579-4efc-acd3-bcd27c6ae037" status: 200 len: 1277 microversion: 2.1 time: 0.332762 Oct 18 15:28:25.490871 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 481/1009] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:25 2022] GET /compute/v2.1/servers/fba41720-c579-4efc-acd3-bcd27c6ae037 => generated 1277 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:26.023125 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3f3423e0-ed31-481c-a232-d65b6566f117 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:26.023799 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3f3423e0-ed31-481c-a232-d65b6566f117 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:26.039234 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3f3423e0-ed31-481c-a232-d65b6566f117 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:26.040380 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3f3423e0-ed31-481c-a232-d65b6566f117 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:26.041399 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3f3423e0-ed31-481c-a232-d65b6566f117 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:26.042289 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3f3423e0-ed31-481c-a232-d65b6566f117 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:26.046272 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3f3423e0-ed31-481c-a232-d65b6566f117 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:26.046915 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3f3423e0-ed31-481c-a232-d65b6566f117 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:26.335283 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3f3423e0-ed31-481c-a232-d65b6566f117 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:26.346695 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3f3423e0-ed31-481c-a232-d65b6566f117 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:26.364431 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3f3423e0-ed31-481c-a232-d65b6566f117 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:26.377401 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3f3423e0-ed31-481c-a232-d65b6566f117 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1560 microversion: 2.91 time: 0.358732 Oct 18 15:28:26.401718 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 482/1010] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:28:26 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1560 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:28:26.412674 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ba841662-714c-4662-bead-447d37e743c8 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d3b6700>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:26.484027 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ba841662-714c-4662-bead-447d37e743c8 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/a3cce994-6f52-4376-b348-a7cf7a071d8d" status: 200 len: 1438 microversion: 2.1 time: 0.080413 Oct 18 15:28:26.492893 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 483/1011] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:28:26 2022] GET /compute/v2.1/images/a3cce994-6f52-4376-b348-a7cf7a071d8d => generated 1438 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:26.499158 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-17c4d445-0f48-488f-9b4b-f34d51e8b654 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:26.500042 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-17c4d445-0f48-488f-9b4b-f34d51e8b654 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: fba41720-c579-4efc-acd3-bcd27c6ae037] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:26.510504 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-17c4d445-0f48-488f-9b4b-f34d51e8b654 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:26.511675 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-17c4d445-0f48-488f-9b4b-f34d51e8b654 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:26.512354 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-17c4d445-0f48-488f-9b4b-f34d51e8b654 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:26.515475 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-17c4d445-0f48-488f-9b4b-f34d51e8b654 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:26.516660 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-17c4d445-0f48-488f-9b4b-f34d51e8b654 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:26.518892 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-17c4d445-0f48-488f-9b4b-f34d51e8b654 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:27.224222 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-17c4d445-0f48-488f-9b4b-f34d51e8b654 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:27.241281 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-17c4d445-0f48-488f-9b4b-f34d51e8b654 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/fba41720-c579-4efc-acd3-bcd27c6ae037" status: 200 len: 1319 microversion: 2.1 time: 0.746239 Oct 18 15:28:27.253095 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 484/1012] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:26 2022] GET /compute/v2.1/servers/fba41720-c579-4efc-acd3-bcd27c6ae037 => generated 1319 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:27.257574 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e970e01c-af59-46cb-9658-8b26aacc7b1a tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:27.260150 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e970e01c-af59-46cb-9658-8b26aacc7b1a tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:27.274891 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e970e01c-af59-46cb-9658-8b26aacc7b1a tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:27.278145 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e970e01c-af59-46cb-9658-8b26aacc7b1a tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:27.278596 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e970e01c-af59-46cb-9658-8b26aacc7b1a tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:27.281254 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e970e01c-af59-46cb-9658-8b26aacc7b1a tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:27.286613 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e970e01c-af59-46cb-9658-8b26aacc7b1a tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:27.287548 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e970e01c-af59-46cb-9658-8b26aacc7b1a tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:27.339769 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:28:27.591802 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:28:27.890245 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e970e01c-af59-46cb-9658-8b26aacc7b1a tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2" status: 200 len: 1812 microversion: 2.1 time: 0.643033 Oct 18 15:28:27.890831 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 485/1013] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:27 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2 => generated 1812 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:27.905934 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-48d0763d-95a3-4ab2-aa53-2a67d88c342f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:27.906547 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-48d0763d-95a3-4ab2-aa53-2a67d88c342f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:27.914668 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-48d0763d-95a3-4ab2-aa53-2a67d88c342f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:27.915664 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-48d0763d-95a3-4ab2-aa53-2a67d88c342f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:27.916306 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-48d0763d-95a3-4ab2-aa53-2a67d88c342f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:27.918041 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-48d0763d-95a3-4ab2-aa53-2a67d88c342f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:27.918877 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-48d0763d-95a3-4ab2-aa53-2a67d88c342f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:27.919504 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-48d0763d-95a3-4ab2-aa53-2a67d88c342f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:28.473470 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-48d0763d-95a3-4ab2-aa53-2a67d88c342f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:28.481653 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-48d0763d-95a3-4ab2-aa53-2a67d88c342f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:28.486544 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-48d0763d-95a3-4ab2-aa53-2a67d88c342f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:28.499662 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-48d0763d-95a3-4ab2-aa53-2a67d88c342f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1560 microversion: 2.91 time: 0.597580 Oct 18 15:28:28.500257 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 486/1014] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:28:27 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1560 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:28:28.501754 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:28:28.516124 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8400360c-1484-465b-9f53-c27ebc96ed71 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d33d1f0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:28.576776 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8400360c-1484-465b-9f53-c27ebc96ed71 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/a3cce994-6f52-4376-b348-a7cf7a071d8d" status: 200 len: 1438 microversion: 2.1 time: 0.075464 Oct 18 15:28:28.585544 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 487/1015] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:28:28 2022] GET /compute/v2.1/images/a3cce994-6f52-4376-b348-a7cf7a071d8d => generated 1438 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:28.591561 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c3ef87d0-8ddf-46aa-9cb9-60ebe7ba0698 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:28.595435 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c3ef87d0-8ddf-46aa-9cb9-60ebe7ba0698 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:28.596116 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c3ef87d0-8ddf-46aa-9cb9-60ebe7ba0698 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:28.596727 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c3ef87d0-8ddf-46aa-9cb9-60ebe7ba0698 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:28.597667 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c3ef87d0-8ddf-46aa-9cb9-60ebe7ba0698 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:28.598297 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c3ef87d0-8ddf-46aa-9cb9-60ebe7ba0698 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:28.598896 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c3ef87d0-8ddf-46aa-9cb9-60ebe7ba0698 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:28.625598 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c3ef87d0-8ddf-46aa-9cb9-60ebe7ba0698 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.037850 Oct 18 15:28:28.630508 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 488/1016] 10.222.0.60 () {58 vars in 1176 bytes} [Tue Oct 18 15:28:28 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:28:28.639884 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-a1f9e771-345a-41f5-86dc-73edee91e7bd req-39fbfb80-5d14-4967-ad93-98691979f3ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fba41720-c579-4efc-acd3-bcd27c6ae037", "tag": "a75e36c6-b161-4d2e-8a55-6794f0194f5a"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:28:28.653114 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-a1f9e771-345a-41f5-86dc-73edee91e7bd req-39fbfb80-5d14-4967-ad93-98691979f3ed service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:28.653845 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-a1f9e771-345a-41f5-86dc-73edee91e7bd req-39fbfb80-5d14-4967-ad93-98691979f3ed service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:28.654424 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-a1f9e771-345a-41f5-86dc-73edee91e7bd req-39fbfb80-5d14-4967-ad93-98691979f3ed service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:28.672134 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-a1f9e771-345a-41f5-86dc-73edee91e7bd req-39fbfb80-5d14-4967-ad93-98691979f3ed service nova] Creating event network-changed:a75e36c6-b161-4d2e-8a55-6794f0194f5a for instance fba41720-c579-4efc-acd3-bcd27c6ae037 on n-h1-853682-5 Oct 18 15:28:28.683515 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-a1f9e771-345a-41f5-86dc-73edee91e7bd req-39fbfb80-5d14-4967-ad93-98691979f3ed service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049483 Oct 18 15:28:28.690411 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 489/1017] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:28:28.703641 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-271ba5dc-b7b0-40e2-9b4d-b6a1a0940b53 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:28.706451 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-271ba5dc-b7b0-40e2-9b4d-b6a1a0940b53 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: fba41720-c579-4efc-acd3-bcd27c6ae037] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:28.718178 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-271ba5dc-b7b0-40e2-9b4d-b6a1a0940b53 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:28.718674 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-271ba5dc-b7b0-40e2-9b4d-b6a1a0940b53 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:28.719110 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-271ba5dc-b7b0-40e2-9b4d-b6a1a0940b53 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:28.723761 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-271ba5dc-b7b0-40e2-9b4d-b6a1a0940b53 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:28.724212 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-271ba5dc-b7b0-40e2-9b4d-b6a1a0940b53 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:28.724661 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-271ba5dc-b7b0-40e2-9b4d-b6a1a0940b53 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:29.564916 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:28:29.571092 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-271ba5dc-b7b0-40e2-9b4d-b6a1a0940b53 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:29.581959 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-271ba5dc-b7b0-40e2-9b4d-b6a1a0940b53 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/fba41720-c579-4efc-acd3-bcd27c6ae037" status: 200 len: 1319 microversion: 2.1 time: 0.890009 Oct 18 15:28:29.593290 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 490/1018] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:28 2022] GET /compute/v2.1/servers/fba41720-c579-4efc-acd3-bcd27c6ae037 => generated 1319 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:29.606464 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-002e9145-d7a0-4c68-b045-fb1936438217 req-55d580d6-2939-4e65-b700-3113c5133dd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "803b657a-c370-4fa9-8fbc-27ec5d844758", "tag": "63c889c5-9191-4db6-aa38-39459869cc45"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:28:29.616300 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-002e9145-d7a0-4c68-b045-fb1936438217 req-55d580d6-2939-4e65-b700-3113c5133dd8 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:29.617362 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-002e9145-d7a0-4c68-b045-fb1936438217 req-55d580d6-2939-4e65-b700-3113c5133dd8 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:29.618978 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-002e9145-d7a0-4c68-b045-fb1936438217 req-55d580d6-2939-4e65-b700-3113c5133dd8 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:29.630618 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-002e9145-d7a0-4c68-b045-fb1936438217 req-55d580d6-2939-4e65-b700-3113c5133dd8 service nova] Creating event network-changed:63c889c5-9191-4db6-aa38-39459869cc45 for instance 803b657a-c370-4fa9-8fbc-27ec5d844758 on n-h2-853682-5 Oct 18 15:28:29.636626 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-002e9145-d7a0-4c68-b045-fb1936438217 req-55d580d6-2939-4e65-b700-3113c5133dd8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042066 Oct 18 15:28:29.637565 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 491/1019] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:28:29.642902 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-573c98d4-c776-417d-93c6-1f021183f7ac tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:29.643824 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-573c98d4-c776-417d-93c6-1f021183f7ac tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:29.652167 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-573c98d4-c776-417d-93c6-1f021183f7ac tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:29.652919 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-573c98d4-c776-417d-93c6-1f021183f7ac tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:29.653545 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-573c98d4-c776-417d-93c6-1f021183f7ac tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:29.654426 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-573c98d4-c776-417d-93c6-1f021183f7ac tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:29.655224 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-573c98d4-c776-417d-93c6-1f021183f7ac tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:29.656029 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-573c98d4-c776-417d-93c6-1f021183f7ac tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:29.946890 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-573c98d4-c776-417d-93c6-1f021183f7ac tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:29.959641 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=34 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:28:29.978193 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-573c98d4-c776-417d-93c6-1f021183f7ac tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:29.979876 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-573c98d4-c776-417d-93c6-1f021183f7ac tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:30.010225 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-573c98d4-c776-417d-93c6-1f021183f7ac tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1555 microversion: 2.91 time: 0.371094 Oct 18 15:28:30.021607 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 492/1020] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:28:29 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1555 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:28:30.302304 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9f2d784b-bbae-4f5f-a7d4-76df0b5d4430 tempest-VolumesAdminNegativeTest-1056302673 tempest-VolumesAdminNegativeTest-1056302673-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "521c4a8c-d74c-4feb-a222-8b1e800300e4"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:28:30.303915 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9f2d784b-bbae-4f5f-a7d4-76df0b5d4430 tempest-VolumesAdminNegativeTest-1056302673 tempest-VolumesAdminNegativeTest-1056302673-project-admin] [instance: 21ed44b3-c1df-4099-a1ca-a8b167fc3890] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:30.320680 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9f2d784b-bbae-4f5f-a7d4-76df0b5d4430 tempest-VolumesAdminNegativeTest-1056302673 tempest-VolumesAdminNegativeTest-1056302673-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:30.321239 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9f2d784b-bbae-4f5f-a7d4-76df0b5d4430 tempest-VolumesAdminNegativeTest-1056302673 tempest-VolumesAdminNegativeTest-1056302673-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:30.321690 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9f2d784b-bbae-4f5f-a7d4-76df0b5d4430 tempest-VolumesAdminNegativeTest-1056302673 tempest-VolumesAdminNegativeTest-1056302673-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:30.322415 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9f2d784b-bbae-4f5f-a7d4-76df0b5d4430 tempest-VolumesAdminNegativeTest-1056302673 tempest-VolumesAdminNegativeTest-1056302673-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:30.322880 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9f2d784b-bbae-4f5f-a7d4-76df0b5d4430 tempest-VolumesAdminNegativeTest-1056302673 tempest-VolumesAdminNegativeTest-1056302673-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:30.323317 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9f2d784b-bbae-4f5f-a7d4-76df0b5d4430 tempest-VolumesAdminNegativeTest-1056302673 tempest-VolumesAdminNegativeTest-1056302673-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:30.717621 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-9f2d784b-bbae-4f5f-a7d4-76df0b5d4430 tempest-VolumesAdminNegativeTest-1056302673 tempest-VolumesAdminNegativeTest-1056302673-project-admin] HTTP exception thrown: Volume 521c4a8c-d74c-4feb-a222-8b1e800300e4 could not be found. Oct 18 15:28:30.722769 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9f2d784b-bbae-4f5f-a7d4-76df0b5d4430 tempest-VolumesAdminNegativeTest-1056302673 tempest-VolumesAdminNegativeTest-1056302673-project-admin] Request method failure captured: Oct 18 15:28:30.722769 n-d-853682-5 devstack@n-api.service[120405]: request: PUT /compute/v2.1/servers/21ed44b3-c1df-4099-a1ca-a8b167fc3890/os-volume_attachments/0ae73688-0eb0-4783-876d-d80550175f94 HTTP/1.1 Oct 18 15:28:30.722769 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:28:30.722769 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:28:30.722769 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:28:30.722769 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 74 Oct 18 15:28:30.722769 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:28:30.722769 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:28:30.722769 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:28:30.722769 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:28:30.722769 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsW_bzlEfd1-cTEDXgvtiGevlgDnrc31EcMNC4xjDHUC6-rH_uBVz5r30OsOmUnFL_snOyTr5gdIpl_YN2G3QTGGMUKfG9ntNQg_9vlMyG0iJ6STiM6y0P7A5NZ_PY8dx_mHgTXpHtxpAbQImljUZpxPAEL3MnXEx7HyJYvjaGR7nsk Oct 18 15:28:30.722769 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:28:30.722769 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:28:30.722769 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:28:30.722769 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:28:30.722769 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:28:30.722769 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:28:30.722769 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 51002c3a82b644358d46c0b57678a5c2 Oct 18 15:28:30.722769 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-VolumesAdminNegativeTest-1056302673 Oct 18 15:28:30.722769 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,admin,reader Oct 18 15:28:30.722769 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,admin,reader Oct 18 15:28:30.724367 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/51002c3a82b644358d46c0b57678a5c2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/51002c3a82b644358d46c0b57678a5c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/51002c3a82b644358d46c0b57678a5c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_51002c3a82b644358d46c0b57678a5c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:28:30.724367 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-VolumesAdminNegativeTest-1056302673 Oct 18 15:28:30.724367 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 51002c3a82b644358d46c0b57678a5c2 Oct 18 15:28:30.724367 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1056302673 Oct 18 15:28:30.724367 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-VolumesAdminNegativeTest-1056302673-project-admin Oct 18 15:28:30.724367 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:28:30.724367 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:28:30.724367 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 5d2f92b917ea429abd9b46a84d4a0a8e Oct 18 15:28:30.724367 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-VolumesAdminNegativeTest-1056302673-project-admin Oct 18 15:28:30.724367 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:28:30.724367 n-d-853682-5 devstack@n-api.service[120405]: {"volumeAttachment": {"volumeId": "521c4a8c-d74c-4feb-a222-8b1e800300e4"}} Oct 18 15:28:30.724367 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:28:30.724367 n-d-853682-5 devstack@n-api.service[120405]: exception: Volume 521c4a8c-d74c-4feb-a222-8b1e800300e4 could not be found. Oct 18 15:28:30.725359 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'server_id': '21ed44b3-c1df-4099-a1ca-a8b167fc3890', 'id': '0ae73688-0eb0-4783-876d-d80550175f94', 'body': {'volumeAttachment': {'volumeId': '521c4a8c-d74c-4feb-a222-8b1e800300e4'}}} Oct 18 15:28:30.725359 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:28:30.725359 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:28:30.725359 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 15:28:30.725359 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 15:28:30.725359 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 18 15:28:30.725359 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 18 15:28:30.725359 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 18 15:28:30.725359 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 18 15:28:30.725359 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 15:28:30.725359 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 15:28:30.725359 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 15:28:30.725359 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 15:28:30.725359 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 15:28:30.725359 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 15:28:30.725359 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 15:28:30.725359 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 15:28:30.727073 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 521c4a8c-d74c-4feb-a222-8b1e800300e4 could not be found. (HTTP 404) (Request-ID: req-0a23822f-9e60-4f27-a194-ba8d3e4e4974) Oct 18 15:28:30.727073 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:28:30.727073 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:28:30.727073 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:28:30.727073 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:28:30.727073 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 18 15:28:30.727073 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 18 15:28:30.727073 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 18 15:28:30.727073 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 18 15:28:30.727073 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 18 15:28:30.727073 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 18 15:28:30.727073 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 18 15:28:30.727073 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 18 15:28:30.727073 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 15:28:30.727073 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 15:28:30.727073 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 18 15:28:30.727073 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 18 15:28:30.727073 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 18 15:28:30.727073 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 18 15:28:30.728392 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 15:28:30.728392 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 15:28:30.728392 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 15:28:30.728392 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 15:28:30.728392 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 15:28:30.728392 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 15:28:30.728392 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 15:28:30.728392 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 15:28:30.728392 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 521c4a8c-d74c-4feb-a222-8b1e800300e4 could not be found. Oct 18 15:28:30.728392 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:28:30.728392 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:28:30.728392 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:28:30.728392 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:28:30.728392 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:28:30.728392 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:28:30.728392 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:28:30.728392 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:28:30.728392 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:28:30.728392 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:28:30.729718 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:28:30.729718 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:28:30.729718 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:28:30.729718 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:28:30.729718 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 18 15:28:30.729718 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 18 15:28:30.729718 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 18 15:28:30.729718 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 18 15:28:30.729718 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 521c4a8c-d74c-4feb-a222-8b1e800300e4 could not be found. Oct 18 15:28:30.729718 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:28:30.729718 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:28:30.729718 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:28:30.729718 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:28:30.729718 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:28:30.729718 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:28:30.729718 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:28:30.729718 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:28:30.729718 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 521c4a8c-d74c-4feb-a222-8b1e800300e4 could not be found. Oct 18 15:28:30.729718 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:28:30.732263 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9f2d784b-bbae-4f5f-a7d4-76df0b5d4430 tempest-VolumesAdminNegativeTest-1056302673 tempest-VolumesAdminNegativeTest-1056302673-project-admin] Returning 400 to user: Volume 521c4a8c-d74c-4feb-a222-8b1e800300e4 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:28:30.733346 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9f2d784b-bbae-4f5f-a7d4-76df0b5d4430 tempest-VolumesAdminNegativeTest-1056302673 tempest-VolumesAdminNegativeTest-1056302673-project-admin] 10.222.0.60 "PUT /compute/v2.1/servers/21ed44b3-c1df-4099-a1ca-a8b167fc3890/os-volume_attachments/0ae73688-0eb0-4783-876d-d80550175f94" status: 400 len: 107 microversion: 2.1 time: 0.710704 Oct 18 15:28:30.733937 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 493/1021] 10.222.0.60 () {60 vars in 1433 bytes} [Tue Oct 18 15:28:30 2022] PUT /compute/v2.1/servers/21ed44b3-c1df-4099-a1ca-a8b167fc3890/os-volume_attachments/0ae73688-0eb0-4783-876d-d80550175f94 => generated 107 bytes in 712 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:28:30.749778 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e5e3f5d1-ad2f-4277-8d89-8cf1f98bd4ab tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3dc6cb80>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:30.835939 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e5e3f5d1-ad2f-4277-8d89-8cf1f98bd4ab tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/a3cce994-6f52-4376-b348-a7cf7a071d8d" status: 200 len: 1438 microversion: 2.1 time: 0.100742 Oct 18 15:28:30.836538 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 494/1022] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:28:30 2022] GET /compute/v2.1/images/a3cce994-6f52-4376-b348-a7cf7a071d8d => generated 1438 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:30.868116 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4512895d-753d-4775-8aab-49a478145288 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:30.868768 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4512895d-753d-4775-8aab-49a478145288 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: fba41720-c579-4efc-acd3-bcd27c6ae037] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:30.881008 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4512895d-753d-4775-8aab-49a478145288 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:30.881508 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4512895d-753d-4775-8aab-49a478145288 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:30.883881 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4512895d-753d-4775-8aab-49a478145288 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:30.885829 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4512895d-753d-4775-8aab-49a478145288 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:30.891232 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4512895d-753d-4775-8aab-49a478145288 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:30.892055 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4512895d-753d-4775-8aab-49a478145288 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:31.172466 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4512895d-753d-4775-8aab-49a478145288 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:31.181999 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4512895d-753d-4775-8aab-49a478145288 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/fba41720-c579-4efc-acd3-bcd27c6ae037" status: 200 len: 1319 microversion: 2.1 time: 0.329614 Oct 18 15:28:31.205354 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 495/1023] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:30 2022] GET /compute/v2.1/servers/fba41720-c579-4efc-acd3-bcd27c6ae037 => generated 1319 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:31.214548 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-57c2dce6-be28-4cd4-93d0-2780e66a5504 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:31.215221 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-57c2dce6-be28-4cd4-93d0-2780e66a5504 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: 21ed44b3-c1df-4099-a1ca-a8b167fc3890] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:31.230033 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57c2dce6-be28-4cd4-93d0-2780e66a5504 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:31.232725 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57c2dce6-be28-4cd4-93d0-2780e66a5504 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:31.233879 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57c2dce6-be28-4cd4-93d0-2780e66a5504 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:31.235082 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57c2dce6-be28-4cd4-93d0-2780e66a5504 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:31.236013 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57c2dce6-be28-4cd4-93d0-2780e66a5504 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:31.236880 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57c2dce6-be28-4cd4-93d0-2780e66a5504 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:31.433402 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-57c2dce6-be28-4cd4-93d0-2780e66a5504 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lazy-loading 'services' on Instance uuid 21ed44b3-c1df-4099-a1ca-a8b167fc3890 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:28:31.608346 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-57c2dce6-be28-4cd4-93d0-2780e66a5504 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "DELETE /compute/v2.1/servers/21ed44b3-c1df-4099-a1ca-a8b167fc3890/os-volume_attachments/0ae73688-0eb0-4783-876d-d80550175f94" status: 202 len: 0 microversion: 2.1 time: 0.412297 Oct 18 15:28:31.609692 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 496/1024] 10.222.0.60 () {58 vars in 1416 bytes} [Tue Oct 18 15:28:31 2022] DELETE /compute/v2.1/servers/21ed44b3-c1df-4099-a1ca-a8b167fc3890/os-volume_attachments/0ae73688-0eb0-4783-876d-d80550175f94 => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:28:31.616025 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-eaea823f-819b-450a-8566-bd422bd40cc1 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:31.617827 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-eaea823f-819b-450a-8566-bd422bd40cc1 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:31.624327 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eaea823f-819b-450a-8566-bd422bd40cc1 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:31.625382 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eaea823f-819b-450a-8566-bd422bd40cc1 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:31.626447 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eaea823f-819b-450a-8566-bd422bd40cc1 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:31.627195 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eaea823f-819b-450a-8566-bd422bd40cc1 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:31.627748 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eaea823f-819b-450a-8566-bd422bd40cc1 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:31.628246 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eaea823f-819b-450a-8566-bd422bd40cc1 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:31.776570 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-eaea823f-819b-450a-8566-bd422bd40cc1 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:31.794118 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-eaea823f-819b-450a-8566-bd422bd40cc1 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:31.795618 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-eaea823f-819b-450a-8566-bd422bd40cc1 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:31.809140 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-eaea823f-819b-450a-8566-bd422bd40cc1 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1555 microversion: 2.91 time: 0.197770 Oct 18 15:28:31.809771 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 497/1025] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:28:31 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1555 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:28:31.818173 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-501b61cb-aae8-47ac-90ab-5b00ea921e9a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2c12f9a0-8ca1-4a33-945f-423d0911f66a", "device": "/dev/xvdb"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:28:31.821593 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-501b61cb-aae8-47ac-90ab-5b00ea921e9a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:31.836002 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-501b61cb-aae8-47ac-90ab-5b00ea921e9a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:31.837080 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-501b61cb-aae8-47ac-90ab-5b00ea921e9a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:31.837526 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-501b61cb-aae8-47ac-90ab-5b00ea921e9a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:31.838242 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-501b61cb-aae8-47ac-90ab-5b00ea921e9a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:31.838709 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-501b61cb-aae8-47ac-90ab-5b00ea921e9a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:31.839282 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-501b61cb-aae8-47ac-90ab-5b00ea921e9a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:32.431406 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-501b61cb-aae8-47ac-90ab-5b00ea921e9a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "POST /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.620250 Oct 18 15:28:32.432041 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 498/1026] 10.222.0.60 () {60 vars in 1323 bytes} [Tue Oct 18 15:28:31 2022] POST /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2/os-volume_attachments => generated 194 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:28:32.465534 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-8a429c97-5ff9-42d3-98ba-251789114731 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:28:32.466488 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-8a429c97-5ff9-42d3-98ba-251789114731 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:28:32.467184 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-8a429c97-5ff9-42d3-98ba-251789114731 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:28:32.467752 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-8a429c97-5ff9-42d3-98ba-251789114731 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:28:32.468351 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-8a429c97-5ff9-42d3-98ba-251789114731 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:28:32.485698 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e8886efe-efdf-4d2f-bd35-3270f1a164b6 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:32.506982 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a429c97-5ff9-42d3-98ba-251789114731 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:32.516796 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e8886efe-efdf-4d2f-bd35-3270f1a164b6 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: 21ed44b3-c1df-4099-a1ca-a8b167fc3890] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:32.517823 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a429c97-5ff9-42d3-98ba-251789114731 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:32.521858 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a429c97-5ff9-42d3-98ba-251789114731 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:32.527564 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a429c97-5ff9-42d3-98ba-251789114731 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:32.537713 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a429c97-5ff9-42d3-98ba-251789114731 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:32.538204 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a429c97-5ff9-42d3-98ba-251789114731 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:32.561650 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e8886efe-efdf-4d2f-bd35-3270f1a164b6 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:32.563478 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e8886efe-efdf-4d2f-bd35-3270f1a164b6 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:32.566680 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e8886efe-efdf-4d2f-bd35-3270f1a164b6 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:32.571143 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e8886efe-efdf-4d2f-bd35-3270f1a164b6 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:32.579910 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e8886efe-efdf-4d2f-bd35-3270f1a164b6 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:32.582593 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e8886efe-efdf-4d2f-bd35-3270f1a164b6 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:32.623377 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-8a429c97-5ff9-42d3-98ba-251789114731 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Getting quotas for project ac3cdc1276f14660a6fc8101364d2a35. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:28:32.635285 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-8a429c97-5ff9-42d3-98ba-251789114731 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Getting quotas for user 8f10b8a9983f41e8b30183dcafbdce1d and project ac3cdc1276f14660a6fc8101364d2a35. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:28:32.692395 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e8886efe-efdf-4d2f-bd35-3270f1a164b6 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/21ed44b3-c1df-4099-a1ca-a8b167fc3890/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.234622 Oct 18 15:28:32.700663 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 499/1027] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 15:28:32 2022] GET /compute/v2.1/servers/21ed44b3-c1df-4099-a1ca-a8b167fc3890/os-volume_attachments => generated 197 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:28:32.718223 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f3daebe9-bdfc-4a01-9cb9-0bb221700496 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d296c10>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:33.028689 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8a429c97-5ff9-42d3-98ba-251789114731 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:28:33.031477 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8a429c97-5ff9-42d3-98ba-251789114731 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='537e8ac8-4f4e-4b66-9033-250c8f8efd04',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='96ef5e45-f5a0-4486-8116-0ffbb28b084e',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='aea31e55-95cf-43b8-bd01-96feecf51a7e',volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:28:37.363754 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f3daebe9-bdfc-4a01-9cb9-0bb221700496 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/a3cce994-6f52-4376-b348-a7cf7a071d8d" status: 200 len: 1447 microversion: 2.1 time: 4.661622 Oct 18 15:28:37.372880 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 500/1028] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:28:32 2022] GET /compute/v2.1/images/a3cce994-6f52-4376-b348-a7cf7a071d8d => generated 1447 bytes in 4663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:37.377689 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6c18cf61-39ca-40d2-ad36-3bba852d411e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:37.378686 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6c18cf61-39ca-40d2-ad36-3bba852d411e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: fba41720-c579-4efc-acd3-bcd27c6ae037] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:37.385575 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6c18cf61-39ca-40d2-ad36-3bba852d411e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:37.386413 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6c18cf61-39ca-40d2-ad36-3bba852d411e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:37.387097 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6c18cf61-39ca-40d2-ad36-3bba852d411e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:37.388076 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6c18cf61-39ca-40d2-ad36-3bba852d411e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:37.388783 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6c18cf61-39ca-40d2-ad36-3bba852d411e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:37.389453 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6c18cf61-39ca-40d2-ad36-3bba852d411e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:37.576025 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6c18cf61-39ca-40d2-ad36-3bba852d411e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:37.594071 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6c18cf61-39ca-40d2-ad36-3bba852d411e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/fba41720-c579-4efc-acd3-bcd27c6ae037" status: 200 len: 1319 microversion: 2.1 time: 0.228240 Oct 18 15:28:37.594661 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 501/1029] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:37 2022] GET /compute/v2.1/servers/fba41720-c579-4efc-acd3-bcd27c6ae037 => generated 1319 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:37.601470 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ba34950a-927e-4548-947f-713c054a92a8 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:37.602471 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ba34950a-927e-4548-947f-713c054a92a8 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:37.609494 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba34950a-927e-4548-947f-713c054a92a8 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:37.610479 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba34950a-927e-4548-947f-713c054a92a8 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:37.611342 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba34950a-927e-4548-947f-713c054a92a8 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:37.612270 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba34950a-927e-4548-947f-713c054a92a8 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:37.612972 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba34950a-927e-4548-947f-713c054a92a8 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:37.613712 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba34950a-927e-4548-947f-713c054a92a8 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:37.707386 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ba34950a-927e-4548-947f-713c054a92a8 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:37.718234 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ba34950a-927e-4548-947f-713c054a92a8 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:37.719870 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ba34950a-927e-4548-947f-713c054a92a8 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:37.724367 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:28:37.726842 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ba34950a-927e-4548-947f-713c054a92a8 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1555 microversion: 2.91 time: 0.129864 Oct 18 15:28:37.727719 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 502/1030] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:28:37 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1555 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:28:37.755097 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bdc6bd90-f2e7-4ab3-883d-aaa37cd58461 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:37.758031 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-bdc6bd90-f2e7-4ab3-883d-aaa37cd58461 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: 21ed44b3-c1df-4099-a1ca-a8b167fc3890] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:37.765513 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bdc6bd90-f2e7-4ab3-883d-aaa37cd58461 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:37.766006 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bdc6bd90-f2e7-4ab3-883d-aaa37cd58461 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:37.766439 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bdc6bd90-f2e7-4ab3-883d-aaa37cd58461 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:37.767334 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bdc6bd90-f2e7-4ab3-883d-aaa37cd58461 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:37.767800 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bdc6bd90-f2e7-4ab3-883d-aaa37cd58461 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:37.768229 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bdc6bd90-f2e7-4ab3-883d-aaa37cd58461 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:37.803364 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-bdc6bd90-f2e7-4ab3-883d-aaa37cd58461 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/21ed44b3-c1df-4099-a1ca-a8b167fc3890/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053374 Oct 18 15:28:37.804490 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 503/1031] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 15:28:37 2022] GET /compute/v2.1/servers/21ed44b3-c1df-4099-a1ca-a8b167fc3890/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:28:37.986800 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4739b2fa-cfd3-4304-9de1-8054acc21fea tempest-FlavorMetadataValidation-2090954563 tempest-FlavorMetadataValidation-2090954563-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1269355100", "id": 2123097706, "os-flavor-access:is_public": "True"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:28:38.011699 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4739b2fa-cfd3-4304-9de1-8054acc21fea tempest-FlavorMetadataValidation-2090954563 tempest-FlavorMetadataValidation-2090954563-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 0.205911 Oct 18 15:28:38.013036 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 504/1032] 10.222.0.60 () {62 vars in 1188 bytes} [Tue Oct 18 15:28:37 2022] POST /compute/v2.1/flavors => generated 471 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:28:38.026667 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-9c40b478-59e8-49c6-a12b-a83714837913 req-180dec73-4cfd-4fd9-81bd-fd7992d489ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fba41720-c579-4efc-acd3-bcd27c6ae037", "name": "network-vif-plugged", "status": "completed", "tag": "a75e36c6-b161-4d2e-8a55-6794f0194f5a"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:28:38.037945 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-9c40b478-59e8-49c6-a12b-a83714837913 req-180dec73-4cfd-4fd9-81bd-fd7992d489ee service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:38.038797 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-9c40b478-59e8-49c6-a12b-a83714837913 req-180dec73-4cfd-4fd9-81bd-fd7992d489ee service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:38.039402 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-9c40b478-59e8-49c6-a12b-a83714837913 req-180dec73-4cfd-4fd9-81bd-fd7992d489ee service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:38.051649 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-9c40b478-59e8-49c6-a12b-a83714837913 req-180dec73-4cfd-4fd9-81bd-fd7992d489ee service nova] Creating event network-vif-plugged:a75e36c6-b161-4d2e-8a55-6794f0194f5a for instance fba41720-c579-4efc-acd3-bcd27c6ae037 on n-h1-853682-5 Oct 18 15:28:38.066799 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-9c40b478-59e8-49c6-a12b-a83714837913 req-180dec73-4cfd-4fd9-81bd-fd7992d489ee service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052020 Oct 18 15:28:38.067359 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 505/1033] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:28:38.074283 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-320e22a4-8728-4383-9bce-505806d29131 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d24c1f0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:38.139884 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-320e22a4-8728-4383-9bce-505806d29131 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/a3cce994-6f52-4376-b348-a7cf7a071d8d" status: 200 len: 1447 microversion: 2.1 time: 0.071219 Oct 18 15:28:38.140627 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 506/1034] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:28:38 2022] GET /compute/v2.1/images/a3cce994-6f52-4376-b348-a7cf7a071d8d => generated 1447 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:38.144979 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3ebabd69-77a5-441a-833d-1f289d5e5c79 tempest-FlavorMetadataValidation-2090954563 tempest-FlavorMetadataValidation-2090954563-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:28:38.354224 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3ebabd69-77a5-441a-833d-1f289d5e5c79 tempest-FlavorMetadataValidation-2090954563 tempest-FlavorMetadataValidation-2090954563-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/2123097706/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.212660 Oct 18 15:28:38.354951 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 507/1035] 10.222.0.60 () {62 vars in 1265 bytes} [Tue Oct 18 15:28:38 2022] POST /compute/v2.1/flavors/2123097706/os-extra_specs => generated 62 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:38.362433 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fdaa220f-1c05-4880-8bb5-cae56173ea59 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d24c1f0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:38.610808 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:28:39.105939 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fdaa220f-1c05-4880-8bb5-cae56173ea59 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "DELETE /compute/v2.1/images/a3cce994-6f52-4376-b348-a7cf7a071d8d" status: 204 len: 0 microversion: 2.1 time: 0.749353 Oct 18 15:28:39.106915 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 508/1036] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:38 2022] DELETE /compute/v2.1/images/a3cce994-6f52-4376-b348-a7cf7a071d8d => generated 0 bytes in 751 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:28:39.114911 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1e08129b-6884-4709-a79e-b5fe9e0d1359 tempest-FlavorMetadataValidation-2090954563 tempest-FlavorMetadataValidation-2090954563-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:39.139843 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1e08129b-6884-4709-a79e-b5fe9e0d1359 tempest-FlavorMetadataValidation-2090954563 tempest-FlavorMetadataValidation-2090954563-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/2123097706" status: 202 len: 0 microversion: 2.86 time: 0.031502 Oct 18 15:28:39.141309 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 509/1037] 10.222.0.60 () {60 vars in 1202 bytes} [Tue Oct 18 15:28:39 2022] DELETE /compute/v2.1/flavors/2123097706 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:28:39.149769 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-07bf9f7f-829f-4370-85af-fad724765da0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:39.150905 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-07bf9f7f-829f-4370-85af-fad724765da0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: fba41720-c579-4efc-acd3-bcd27c6ae037] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:39.158528 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-07bf9f7f-829f-4370-85af-fad724765da0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:39.159351 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-07bf9f7f-829f-4370-85af-fad724765da0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:39.160021 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-07bf9f7f-829f-4370-85af-fad724765da0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:39.161097 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-07bf9f7f-829f-4370-85af-fad724765da0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:39.161960 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-07bf9f7f-829f-4370-85af-fad724765da0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:39.162655 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-07bf9f7f-829f-4370-85af-fad724765da0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:39.319326 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-07bf9f7f-829f-4370-85af-fad724765da0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:39.331859 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-07bf9f7f-829f-4370-85af-fad724765da0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/fba41720-c579-4efc-acd3-bcd27c6ae037" status: 200 len: 1319 microversion: 2.1 time: 0.188955 Oct 18 15:28:39.332844 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 510/1038] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:39 2022] GET /compute/v2.1/servers/fba41720-c579-4efc-acd3-bcd27c6ae037 => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:39.338165 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b09189d2-6d75-42bf-aed4-20318752c03c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:39.338893 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b09189d2-6d75-42bf-aed4-20318752c03c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:39.354192 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b09189d2-6d75-42bf-aed4-20318752c03c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:39.354990 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b09189d2-6d75-42bf-aed4-20318752c03c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:39.355963 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b09189d2-6d75-42bf-aed4-20318752c03c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:39.357026 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b09189d2-6d75-42bf-aed4-20318752c03c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:39.357593 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b09189d2-6d75-42bf-aed4-20318752c03c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:39.358117 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b09189d2-6d75-42bf-aed4-20318752c03c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:39.361349 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:28:39.439244 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b09189d2-6d75-42bf-aed4-20318752c03c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:39.461087 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b09189d2-6d75-42bf-aed4-20318752c03c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:39.463265 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b09189d2-6d75-42bf-aed4-20318752c03c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:39.470844 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b09189d2-6d75-42bf-aed4-20318752c03c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1555 microversion: 2.91 time: 0.136616 Oct 18 15:28:39.471776 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 511/1039] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:28:39 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1555 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:28:39.495572 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-071bb26d-f2e6-498b-80ea-0f86a1a8cefe tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:39.502149 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-071bb26d-f2e6-498b-80ea-0f86a1a8cefe tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: 21ed44b3-c1df-4099-a1ca-a8b167fc3890] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:39.515659 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-071bb26d-f2e6-498b-80ea-0f86a1a8cefe tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:39.517584 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-071bb26d-f2e6-498b-80ea-0f86a1a8cefe tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:39.518910 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-071bb26d-f2e6-498b-80ea-0f86a1a8cefe tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:39.520658 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-071bb26d-f2e6-498b-80ea-0f86a1a8cefe tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:39.521940 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-071bb26d-f2e6-498b-80ea-0f86a1a8cefe tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:39.523797 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-071bb26d-f2e6-498b-80ea-0f86a1a8cefe tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:39.570433 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-071bb26d-f2e6-498b-80ea-0f86a1a8cefe tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/21ed44b3-c1df-4099-a1ca-a8b167fc3890/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096219 Oct 18 15:28:39.571633 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 512/1040] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 15:28:39 2022] GET /compute/v2.1/servers/21ed44b3-c1df-4099-a1ca-a8b167fc3890/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:28:39.576746 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a0cc31d4-5bae-4efc-be48-caeb4b4b2b12 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:39.577513 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a0cc31d4-5bae-4efc-be48-caeb4b4b2b12 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: dd3fd462-cb66-45c0-92a3-2f9aca2cb16f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:39.584744 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a0cc31d4-5bae-4efc-be48-caeb4b4b2b12 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:39.585570 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a0cc31d4-5bae-4efc-be48-caeb4b4b2b12 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:39.586254 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a0cc31d4-5bae-4efc-be48-caeb4b4b2b12 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:39.587451 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a0cc31d4-5bae-4efc-be48-caeb4b4b2b12 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:39.588064 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a0cc31d4-5bae-4efc-be48-caeb4b4b2b12 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:39.589024 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a0cc31d4-5bae-4efc-be48-caeb4b4b2b12 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:39.625277 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a0cc31d4-5bae-4efc-be48-caeb4b4b2b12 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: dd3fd462-cb66-45c0-92a3-2f9aca2cb16f] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:28:39.806669 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a0cc31d4-5bae-4efc-be48-caeb4b4b2b12 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "DELETE /compute/v2.1/servers/dd3fd462-cb66-45c0-92a3-2f9aca2cb16f" status: 204 len: 0 microversion: 2.1 time: 0.233486 Oct 18 15:28:39.807420 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 513/1041] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:28:39 2022] DELETE /compute/v2.1/servers/dd3fd462-cb66-45c0-92a3-2f9aca2cb16f => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:28:39.823511 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-62ec2cd6-5776-451b-aca3-c29b372b4363 tempest-FlavorMetadataValidation-2090954563 tempest-FlavorMetadataValidation-2090954563-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:39.854043 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-62ec2cd6-5776-451b-aca3-c29b372b4363 tempest-FlavorMetadataValidation-2090954563 tempest-FlavorMetadataValidation-2090954563-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.045039 Oct 18 15:28:39.854991 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 514/1042] 10.222.0.60 () {60 vars in 1187 bytes} [Tue Oct 18 15:28:39 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:28:40.045061 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b664cc28-7c3b-425b-88cd-74a9ed6ce216 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-441446499", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "ef6fe956-3e84-412d-8f85-8f55d9975d85"}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:28:40.117334 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8a429c97-5ff9-42d3-98ba-251789114731 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 15.562925 Oct 18 15:28:40.118747 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 529/1043] 10.222.0.60 () {62 vars in 1189 bytes} [Tue Oct 18 15:28:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 15566 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 18 15:28:40.124449 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-51867711-f487-477d-80b7-8eca1780b1f9 req-0809f1c4-951b-4dca-b801-e2967305d5e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "803b657a-c370-4fa9-8fbc-27ec5d844758", "name": "network-vif-plugged", "status": "completed", "tag": "63c889c5-9191-4db6-aa38-39459869cc45"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:28:40.135818 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-51867711-f487-477d-80b7-8eca1780b1f9 req-0809f1c4-951b-4dca-b801-e2967305d5e2 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:40.136675 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-51867711-f487-477d-80b7-8eca1780b1f9 req-0809f1c4-951b-4dca-b801-e2967305d5e2 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:40.137311 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-51867711-f487-477d-80b7-8eca1780b1f9 req-0809f1c4-951b-4dca-b801-e2967305d5e2 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:40.149591 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-51867711-f487-477d-80b7-8eca1780b1f9 req-0809f1c4-951b-4dca-b801-e2967305d5e2 service nova] Creating event network-vif-plugged:63c889c5-9191-4db6-aa38-39459869cc45 for instance 803b657a-c370-4fa9-8fbc-27ec5d844758 on n-h2-853682-5 Oct 18 15:28:40.157839 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-51867711-f487-477d-80b7-8eca1780b1f9 req-0809f1c4-951b-4dca-b801-e2967305d5e2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037328 Oct 18 15:28:40.158996 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 530/1044] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:28:40.170681 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e3146678-a9c0-4d9d-a180-c737bc330010 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:40.171575 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e3146678-a9c0-4d9d-a180-c737bc330010 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:40.212288 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-b664cc28-7c3b-425b-88cd-74a9ed6ce216 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] validate_networks() for [('ef6fe956-3e84-412d-8f85-8f55d9975d85', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:28:40.290131 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e3146678-a9c0-4d9d-a180-c737bc330010 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:40.302905 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e3146678-a9c0-4d9d-a180-c737bc330010 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:40.304395 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e3146678-a9c0-4d9d-a180-c737bc330010 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:40.306688 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e3146678-a9c0-4d9d-a180-c737bc330010 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 1286 microversion: 2.42 time: 0.146410 Oct 18 15:28:40.310269 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 531/1045] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:28:40 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 1286 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:28:40.355921 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2e8eb4b5-62e6-40d1-84cf-f021faf3bdf3 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:40.356854 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2e8eb4b5-62e6-40d1-84cf-f021faf3bdf3 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: fba41720-c579-4efc-acd3-bcd27c6ae037] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:40.370506 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e8eb4b5-62e6-40d1-84cf-f021faf3bdf3 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:40.371982 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e8eb4b5-62e6-40d1-84cf-f021faf3bdf3 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:40.372722 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e8eb4b5-62e6-40d1-84cf-f021faf3bdf3 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:40.374599 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e8eb4b5-62e6-40d1-84cf-f021faf3bdf3 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:40.377161 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e8eb4b5-62e6-40d1-84cf-f021faf3bdf3 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:40.377879 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e8eb4b5-62e6-40d1-84cf-f021faf3bdf3 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:40.840297 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2e8eb4b5-62e6-40d1-84cf-f021faf3bdf3 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:40.849898 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2e8eb4b5-62e6-40d1-84cf-f021faf3bdf3 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/fba41720-c579-4efc-acd3-bcd27c6ae037" status: 200 len: 1319 microversion: 2.1 time: 0.498501 Oct 18 15:28:40.853772 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 532/1046] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:40 2022] GET /compute/v2.1/servers/fba41720-c579-4efc-acd3-bcd27c6ae037 => generated 1319 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:40.863500 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-71fd70d3-1f4e-4dc7-a175-4695b1d011a6 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:40.866146 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-71fd70d3-1f4e-4dc7-a175-4695b1d011a6 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:40.880514 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71fd70d3-1f4e-4dc7-a175-4695b1d011a6 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:40.881353 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71fd70d3-1f4e-4dc7-a175-4695b1d011a6 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:40.882107 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71fd70d3-1f4e-4dc7-a175-4695b1d011a6 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:40.883635 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71fd70d3-1f4e-4dc7-a175-4695b1d011a6 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:40.884988 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71fd70d3-1f4e-4dc7-a175-4695b1d011a6 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:40.885576 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71fd70d3-1f4e-4dc7-a175-4695b1d011a6 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:40.998330 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-71fd70d3-1f4e-4dc7-a175-4695b1d011a6 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:41.002800 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:28:41.023763 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-71fd70d3-1f4e-4dc7-a175-4695b1d011a6 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:41.035590 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-71fd70d3-1f4e-4dc7-a175-4695b1d011a6 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:41.077665 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-71fd70d3-1f4e-4dc7-a175-4695b1d011a6 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1555 microversion: 2.91 time: 0.216107 Oct 18 15:28:41.078564 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 533/1047] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:28:40 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1555 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:28:41.096787 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-24b7b530-3c21-4fa4-8fe4-39d5c9bd0f14 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:41.106890 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-24b7b530-3c21-4fa4-8fe4-39d5c9bd0f14 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: 21ed44b3-c1df-4099-a1ca-a8b167fc3890] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:41.112026 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-b664cc28-7c3b-425b-88cd-74a9ed6ce216 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:28:41.112574 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-b664cc28-7c3b-425b-88cd-74a9ed6ce216 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:28:41.114625 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-b664cc28-7c3b-425b-88cd-74a9ed6ce216 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:28:41.115536 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-b664cc28-7c3b-425b-88cd-74a9ed6ce216 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:28:41.116117 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-b664cc28-7c3b-425b-88cd-74a9ed6ce216 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:28:41.129565 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b664cc28-7c3b-425b-88cd-74a9ed6ce216 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:41.130189 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b664cc28-7c3b-425b-88cd-74a9ed6ce216 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:41.131455 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b664cc28-7c3b-425b-88cd-74a9ed6ce216 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:41.131455 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b664cc28-7c3b-425b-88cd-74a9ed6ce216 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:41.132719 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b664cc28-7c3b-425b-88cd-74a9ed6ce216 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:41.133227 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b664cc28-7c3b-425b-88cd-74a9ed6ce216 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:41.135915 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24b7b530-3c21-4fa4-8fe4-39d5c9bd0f14 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:41.136432 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24b7b530-3c21-4fa4-8fe4-39d5c9bd0f14 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:41.136883 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24b7b530-3c21-4fa4-8fe4-39d5c9bd0f14 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:41.137602 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24b7b530-3c21-4fa4-8fe4-39d5c9bd0f14 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:41.152464 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24b7b530-3c21-4fa4-8fe4-39d5c9bd0f14 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:41.155466 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24b7b530-3c21-4fa4-8fe4-39d5c9bd0f14 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:41.155628 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-b664cc28-7c3b-425b-88cd-74a9ed6ce216 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Getting quotas for project ee0a3f0c256544beb2df4f113da56137. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:28:41.162223 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-b664cc28-7c3b-425b-88cd-74a9ed6ce216 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Getting quotas for user ed9cd936192c40efa9099edee445e90e and project ee0a3f0c256544beb2df4f113da56137. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:28:41.178877 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b664cc28-7c3b-425b-88cd-74a9ed6ce216 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:28:41.181801 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b664cc28-7c3b-425b-88cd-74a9ed6ce216 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: ec3790f8-37cf-4e63-b753-83d38e982580] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:28:41.247588 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b664cc28-7c3b-425b-88cd-74a9ed6ce216 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.206940 Oct 18 15:28:41.252920 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 515/1048] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:28:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1209 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:28:41.312157 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-24b7b530-3c21-4fa4-8fe4-39d5c9bd0f14 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/21ed44b3-c1df-4099-a1ca-a8b167fc3890/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.225492 Oct 18 15:28:41.319073 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 534/1049] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 15:28:41 2022] GET /compute/v2.1/servers/21ed44b3-c1df-4099-a1ca-a8b167fc3890/os-volume_attachments => generated 25 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:28:41.324231 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-00de90f9-f759-478b-98c2-93b212d943bc tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:41.325915 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-00de90f9-f759-478b-98c2-93b212d943bc tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: ec3790f8-37cf-4e63-b753-83d38e982580] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:41.362189 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-98687bc4-4133-4603-be1d-0507db84686b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:41.366406 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-98687bc4-4133-4603-be1d-0507db84686b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:41.441735 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-00de90f9-f759-478b-98c2-93b212d943bc tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:41.456967 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-00de90f9-f759-478b-98c2-93b212d943bc tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/ec3790f8-37cf-4e63-b753-83d38e982580" status: 200 len: 1207 microversion: 2.1 time: 0.154467 Oct 18 15:28:41.472617 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 516/1050] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:41 2022] GET /compute/v2.1/servers/ec3790f8-37cf-4e63-b753-83d38e982580 => generated 1207 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:41.573173 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-98687bc4-4133-4603-be1d-0507db84686b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:41.580734 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-98687bc4-4133-4603-be1d-0507db84686b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:41.582195 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-98687bc4-4133-4603-be1d-0507db84686b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:41.583325 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-98687bc4-4133-4603-be1d-0507db84686b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 1286 microversion: 2.42 time: 0.238967 Oct 18 15:28:41.583892 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 535/1051] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:28:41 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 1286 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:28:41.756732 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7c4cb7f7-cc70-472e-85a9-10527ad7e5f2 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-993525250", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "866b72c1-5b66-4cd2-80db-d87d05d0cbaf"}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:28:41.879899 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6a62fbd9-5535-4218-87d5-b95fb0ef6461 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:41.880784 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6a62fbd9-5535-4218-87d5-b95fb0ef6461 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: fba41720-c579-4efc-acd3-bcd27c6ae037] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:41.902024 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a62fbd9-5535-4218-87d5-b95fb0ef6461 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:41.904996 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a62fbd9-5535-4218-87d5-b95fb0ef6461 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:41.908003 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a62fbd9-5535-4218-87d5-b95fb0ef6461 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:41.908838 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a62fbd9-5535-4218-87d5-b95fb0ef6461 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:41.909333 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a62fbd9-5535-4218-87d5-b95fb0ef6461 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:41.909773 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a62fbd9-5535-4218-87d5-b95fb0ef6461 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:41.945868 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-7c4cb7f7-cc70-472e-85a9-10527ad7e5f2 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] validate_networks() for [('866b72c1-5b66-4cd2-80db-d87d05d0cbaf', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:28:42.349114 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6a62fbd9-5535-4218-87d5-b95fb0ef6461 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:42.373905 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6a62fbd9-5535-4218-87d5-b95fb0ef6461 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/fba41720-c579-4efc-acd3-bcd27c6ae037" status: 200 len: 1469 microversion: 2.1 time: 0.487157 Oct 18 15:28:42.378428 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 536/1052] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:41 2022] GET /compute/v2.1/servers/fba41720-c579-4efc-acd3-bcd27c6ae037 => generated 1469 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:42.383961 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-729ed678-7764-497f-9156-d26c502792af tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:42.410647 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-729ed678-7764-497f-9156-d26c502792af tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:42.425731 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-729ed678-7764-497f-9156-d26c502792af tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:42.426531 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-729ed678-7764-497f-9156-d26c502792af tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:42.427157 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-729ed678-7764-497f-9156-d26c502792af tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:42.428027 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-729ed678-7764-497f-9156-d26c502792af tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:42.430573 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-729ed678-7764-497f-9156-d26c502792af tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:42.432587 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-729ed678-7764-497f-9156-d26c502792af tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:42.589848 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:28:42.595201 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-729ed678-7764-497f-9156-d26c502792af tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:42.606874 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-729ed678-7764-497f-9156-d26c502792af tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:42.626888 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-729ed678-7764-497f-9156-d26c502792af tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:42.635172 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-729ed678-7764-497f-9156-d26c502792af tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1555 microversion: 2.91 time: 0.255567 Oct 18 15:28:42.636111 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 537/1053] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:28:42 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1555 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:28:42.641305 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a9adbd44-8db2-4130-8ef4-011755e38f44 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:42.642317 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a9adbd44-8db2-4130-8ef4-011755e38f44 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 803b657a-c370-4fa9-8fbc-27ec5d844758] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:42.649770 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9adbd44-8db2-4130-8ef4-011755e38f44 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:42.650860 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9adbd44-8db2-4130-8ef4-011755e38f44 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:42.651511 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9adbd44-8db2-4130-8ef4-011755e38f44 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:42.652478 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9adbd44-8db2-4130-8ef4-011755e38f44 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:42.653206 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9adbd44-8db2-4130-8ef4-011755e38f44 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:42.653848 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9adbd44-8db2-4130-8ef4-011755e38f44 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:42.924333 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a9adbd44-8db2-4130-8ef4-011755e38f44 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:42.934926 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a9adbd44-8db2-4130-8ef4-011755e38f44 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/803b657a-c370-4fa9-8fbc-27ec5d844758" status: 200 len: 1469 microversion: 2.1 time: 0.297320 Oct 18 15:28:42.950329 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 538/1054] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:42 2022] GET /compute/v2.1/servers/803b657a-c370-4fa9-8fbc-27ec5d844758 => generated 1469 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:42.968703 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fdbfb23c-51d3-4c4a-bcdf-c74a50e2bc8f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:42.969355 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fdbfb23c-51d3-4c4a-bcdf-c74a50e2bc8f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: ec3790f8-37cf-4e63-b753-83d38e982580] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:42.983975 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fdbfb23c-51d3-4c4a-bcdf-c74a50e2bc8f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:42.984468 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fdbfb23c-51d3-4c4a-bcdf-c74a50e2bc8f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:42.984927 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fdbfb23c-51d3-4c4a-bcdf-c74a50e2bc8f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:42.991605 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fdbfb23c-51d3-4c4a-bcdf-c74a50e2bc8f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:42.993291 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fdbfb23c-51d3-4c4a-bcdf-c74a50e2bc8f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:42.993945 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fdbfb23c-51d3-4c4a-bcdf-c74a50e2bc8f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:43.119013 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fdbfb23c-51d3-4c4a-bcdf-c74a50e2bc8f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:43.132209 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fdbfb23c-51d3-4c4a-bcdf-c74a50e2bc8f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/ec3790f8-37cf-4e63-b753-83d38e982580" status: 200 len: 1203 microversion: 2.1 time: 0.173403 Oct 18 15:28:43.133508 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 539/1055] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:42 2022] GET /compute/v2.1/servers/ec3790f8-37cf-4e63-b753-83d38e982580 => generated 1203 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:43.146144 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-198f8dc4-278d-42ce-9c34-8085e33f2216 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:43.150702 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-198f8dc4-278d-42ce-9c34-8085e33f2216 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:43.164971 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-198f8dc4-278d-42ce-9c34-8085e33f2216 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:43.166055 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-198f8dc4-278d-42ce-9c34-8085e33f2216 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:43.166634 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-198f8dc4-278d-42ce-9c34-8085e33f2216 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:43.167370 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-198f8dc4-278d-42ce-9c34-8085e33f2216 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:43.167827 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-198f8dc4-278d-42ce-9c34-8085e33f2216 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:43.168248 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-198f8dc4-278d-42ce-9c34-8085e33f2216 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:43.205671 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-7c4cb7f7-cc70-472e-85a9-10527ad7e5f2 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:28:43.206183 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-7c4cb7f7-cc70-472e-85a9-10527ad7e5f2 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:28:43.206769 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-7c4cb7f7-cc70-472e-85a9-10527ad7e5f2 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:28:43.207306 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-7c4cb7f7-cc70-472e-85a9-10527ad7e5f2 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:28:43.207822 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-7c4cb7f7-cc70-472e-85a9-10527ad7e5f2 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:28:43.221971 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7c4cb7f7-cc70-472e-85a9-10527ad7e5f2 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:43.222811 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7c4cb7f7-cc70-472e-85a9-10527ad7e5f2 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:43.223629 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7c4cb7f7-cc70-472e-85a9-10527ad7e5f2 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:43.225057 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7c4cb7f7-cc70-472e-85a9-10527ad7e5f2 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:43.225791 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7c4cb7f7-cc70-472e-85a9-10527ad7e5f2 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:43.226729 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7c4cb7f7-cc70-472e-85a9-10527ad7e5f2 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:43.248406 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-7c4cb7f7-cc70-472e-85a9-10527ad7e5f2 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Getting quotas for project ac07f1b2c83a4faab175a5b9ed8e315e. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:28:43.255379 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-7c4cb7f7-cc70-472e-85a9-10527ad7e5f2 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Getting quotas for user a1023300147f463e8f0894981948f825 and project ac07f1b2c83a4faab175a5b9ed8e315e. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:28:43.272764 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7c4cb7f7-cc70-472e-85a9-10527ad7e5f2 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:28:43.275927 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7c4cb7f7-cc70-472e-85a9-10527ad7e5f2 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: bd6231eb-95a4-465e-a859-077a7f82f585] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:28:43.338998 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-198f8dc4-278d-42ce-9c34-8085e33f2216 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:43.356650 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-198f8dc4-278d-42ce-9c34-8085e33f2216 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:43.359027 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-198f8dc4-278d-42ce-9c34-8085e33f2216 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:43.360184 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-198f8dc4-278d-42ce-9c34-8085e33f2216 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 1576 microversion: 2.42 time: 0.223604 Oct 18 15:28:43.364755 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7c4cb7f7-cc70-472e-85a9-10527ad7e5f2 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.611962 Oct 18 15:28:43.372731 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 517/1056] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:28:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:28:43.378331 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-2fb332d3-b086-40c6-85e8-54adae3bc6b6 req-de8976fe-0fcf-4ffb-bd54-7cc1b56fa992 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd3fd462-cb66-45c0-92a3-2f9aca2cb16f", "name": "network-vif-unplugged", "status": "completed", "tag": "860bb5b6-138a-4440-96eb-ea0a81600e4f"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:28:43.382109 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 540/1057] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:28:43 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 1576 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:28:43.391271 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-2fb332d3-b086-40c6-85e8-54adae3bc6b6 req-de8976fe-0fcf-4ffb-bd54-7cc1b56fa992 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:43.392139 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-2fb332d3-b086-40c6-85e8-54adae3bc6b6 req-de8976fe-0fcf-4ffb-bd54-7cc1b56fa992 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:43.392841 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-2fb332d3-b086-40c6-85e8-54adae3bc6b6 req-de8976fe-0fcf-4ffb-bd54-7cc1b56fa992 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:43.393146 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cdc083f2-1fd0-4459-9201-e855ae75177a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:43.405639 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cdc083f2-1fd0-4459-9201-e855ae75177a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:43.406420 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cdc083f2-1fd0-4459-9201-e855ae75177a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Searching by: {'reservation_id': 'r-343y042m', 'deleted': False, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3'} {{(pid=120406) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 15:28:43.407662 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-2fb332d3-b086-40c6-85e8-54adae3bc6b6 req-de8976fe-0fcf-4ffb-bd54-7cc1b56fa992 service nova] Creating event network-vif-unplugged:860bb5b6-138a-4440-96eb-ea0a81600e4f for instance dd3fd462-cb66-45c0-92a3-2f9aca2cb16f on n-h1-853682-5 Oct 18 15:28:43.413567 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-2fb332d3-b086-40c6-85e8-54adae3bc6b6 req-de8976fe-0fcf-4ffb-bd54-7cc1b56fa992 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038927 Oct 18 15:28:43.415238 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 518/1058] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:28:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:28:43.422186 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cdc083f2-1fd0-4459-9201-e855ae75177a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:43.422674 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cdc083f2-1fd0-4459-9201-e855ae75177a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:43.422926 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d19f2f0b-1e0d-40b4-beb5-2c021023d0ef tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:43.423096 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cdc083f2-1fd0-4459-9201-e855ae75177a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:43.423954 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d19f2f0b-1e0d-40b4-beb5-2c021023d0ef tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: bd6231eb-95a4-465e-a859-077a7f82f585] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:43.424211 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cdc083f2-1fd0-4459-9201-e855ae75177a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:43.432251 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cdc083f2-1fd0-4459-9201-e855ae75177a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:43.433494 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cdc083f2-1fd0-4459-9201-e855ae75177a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:43.495269 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d19f2f0b-1e0d-40b4-beb5-2c021023d0ef tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1023300147f463e8f0894981948f825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac07f1b2c83a4faab175a5b9ed8e315e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:43.509296 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d19f2f0b-1e0d-40b4-beb5-2c021023d0ef tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585" status: 200 len: 1217 microversion: 2.1 time: 0.091172 Oct 18 15:28:43.522040 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 519/1059] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:43 2022] GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585 => generated 1217 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:43.647942 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.multi_cell_list [None req-cdc083f2-1fd0-4459-9201-e855ae75177a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120406) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 15:28:43.670044 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f22860c1-74ca-4580-91df-b98229b816b2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:43.670955 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f22860c1-74ca-4580-91df-b98229b816b2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:43.686748 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f22860c1-74ca-4580-91df-b98229b816b2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:43.697758 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f22860c1-74ca-4580-91df-b98229b816b2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:43.700936 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f22860c1-74ca-4580-91df-b98229b816b2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:43.706044 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f22860c1-74ca-4580-91df-b98229b816b2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:43.707191 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f22860c1-74ca-4580-91df-b98229b816b2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:43.712371 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f22860c1-74ca-4580-91df-b98229b816b2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:43.826939 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cdc083f2-1fd0-4459-9201-e855ae75177a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:43.851674 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cdc083f2-1fd0-4459-9201-e855ae75177a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:43.854506 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cdc083f2-1fd0-4459-9201-e855ae75177a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:43.864590 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cdc083f2-1fd0-4459-9201-e855ae75177a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:44.688157 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f22860c1-74ca-4580-91df-b98229b816b2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:44.703122 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f22860c1-74ca-4580-91df-b98229b816b2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:44.715025 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f22860c1-74ca-4580-91df-b98229b816b2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:44.721798 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f22860c1-74ca-4580-91df-b98229b816b2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1555 microversion: 2.91 time: 1.056552 Oct 18 15:28:44.722554 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 520/1060] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:28:43 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1555 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:28:44.727755 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2866536c-9c20-44cd-b6d3-ba9943b510ae tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:44.736389 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2866536c-9c20-44cd-b6d3-ba9943b510ae tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: ec3790f8-37cf-4e63-b753-83d38e982580] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:44.747786 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2866536c-9c20-44cd-b6d3-ba9943b510ae tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:44.748500 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2866536c-9c20-44cd-b6d3-ba9943b510ae tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:44.753638 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2866536c-9c20-44cd-b6d3-ba9943b510ae tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:44.754648 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2866536c-9c20-44cd-b6d3-ba9943b510ae tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:44.755389 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2866536c-9c20-44cd-b6d3-ba9943b510ae tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:44.755986 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2866536c-9c20-44cd-b6d3-ba9943b510ae tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:45.016647 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2866536c-9c20-44cd-b6d3-ba9943b510ae tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:45.037503 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2866536c-9c20-44cd-b6d3-ba9943b510ae tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/ec3790f8-37cf-4e63-b753-83d38e982580" status: 200 len: 1259 microversion: 2.1 time: 0.313639 Oct 18 15:28:45.038630 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 521/1061] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:44 2022] GET /compute/v2.1/servers/ec3790f8-37cf-4e63-b753-83d38e982580 => generated 1259 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:45.064842 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-7b282537-369b-453b-a3f0-2b1d101b5391 req-25f82ce5-85a1-4d9c-a72b-f9398811b3a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd3fd462-cb66-45c0-92a3-2f9aca2cb16f", "name": "network-vif-deleted", "tag": "860bb5b6-138a-4440-96eb-ea0a81600e4f"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:28:45.163345 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-7b282537-369b-453b-a3f0-2b1d101b5391 req-25f82ce5-85a1-4d9c-a72b-f9398811b3a5 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:45.184522 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-7b282537-369b-453b-a3f0-2b1d101b5391 req-25f82ce5-85a1-4d9c-a72b-f9398811b3a5 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:45.185690 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-7b282537-369b-453b-a3f0-2b1d101b5391 req-25f82ce5-85a1-4d9c-a72b-f9398811b3a5 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:45.246929 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cdc083f2-1fd0-4459-9201-e855ae75177a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/detail?reservation_id=r-343y042m" status: 200 len: 2931 microversion: 2.1 time: 1.863612 Oct 18 15:28:45.248131 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 541/1062] 10.222.0.60 () {58 vars in 1197 bytes} [Tue Oct 18 15:28:43 2022] GET /compute/v2.1/servers/detail?reservation_id=r-343y042m => generated 2931 bytes in 1865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:45.253085 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-abf5cea6-70ed-4840-9ae9-d7146d4ca958 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:45.255319 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-7b282537-369b-453b-a3f0-2b1d101b5391 req-25f82ce5-85a1-4d9c-a72b-f9398811b3a5 service nova] Creating event network-vif-deleted:860bb5b6-138a-4440-96eb-ea0a81600e4f for instance dd3fd462-cb66-45c0-92a3-2f9aca2cb16f on n-h1-853682-5 Oct 18 15:28:45.259368 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-abf5cea6-70ed-4840-9ae9-d7146d4ca958 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:45.275694 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-7b282537-369b-453b-a3f0-2b1d101b5391 req-25f82ce5-85a1-4d9c-a72b-f9398811b3a5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.222831 Oct 18 15:28:45.283751 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 522/1063] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:28:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:28:45.285671 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-abf5cea6-70ed-4840-9ae9-d7146d4ca958 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:45.286163 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-abf5cea6-70ed-4840-9ae9-d7146d4ca958 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:45.286800 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-abf5cea6-70ed-4840-9ae9-d7146d4ca958 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:45.291939 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-abf5cea6-70ed-4840-9ae9-d7146d4ca958 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:45.293776 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-abf5cea6-70ed-4840-9ae9-d7146d4ca958 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:45.294428 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-abf5cea6-70ed-4840-9ae9-d7146d4ca958 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:45.310104 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2ec5e5c1-7f8c-47cf-b1da-b160e22da1ae tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:45.314469 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2ec5e5c1-7f8c-47cf-b1da-b160e22da1ae tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: bd6231eb-95a4-465e-a859-077a7f82f585] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:45.357503 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2ec5e5c1-7f8c-47cf-b1da-b160e22da1ae tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:45.358222 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2ec5e5c1-7f8c-47cf-b1da-b160e22da1ae tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:45.358818 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2ec5e5c1-7f8c-47cf-b1da-b160e22da1ae tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:45.360238 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2ec5e5c1-7f8c-47cf-b1da-b160e22da1ae tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:45.361730 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2ec5e5c1-7f8c-47cf-b1da-b160e22da1ae tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:45.363326 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2ec5e5c1-7f8c-47cf-b1da-b160e22da1ae tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:45.588300 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-abf5cea6-70ed-4840-9ae9-d7146d4ca958 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:45.602577 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-abf5cea6-70ed-4840-9ae9-d7146d4ca958 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:45.605234 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-abf5cea6-70ed-4840-9ae9-d7146d4ca958 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:45.606721 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-abf5cea6-70ed-4840-9ae9-d7146d4ca958 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 1594 microversion: 2.42 time: 0.357270 Oct 18 15:28:45.609571 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 542/1064] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:28:45 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 1594 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:28:45.620999 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c5c088ac-6e65-4ba0-9e8b-442871b56456 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:45.622330 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2ec5e5c1-7f8c-47cf-b1da-b160e22da1ae tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1023300147f463e8f0894981948f825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac07f1b2c83a4faab175a5b9ed8e315e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:45.633734 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2ec5e5c1-7f8c-47cf-b1da-b160e22da1ae tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585" status: 200 len: 1213 microversion: 2.1 time: 0.342343 Oct 18 15:28:45.634685 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 523/1065] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:45 2022] GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585 => generated 1213 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:45.662288 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.compute.server_groups [None req-c5c088ac-6e65-4ba0-9e8b-442871b56456 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Querying cell 8ab54c98-adc3-429d-89a9-d68fdb0f782a(cell1) for 2 instances {{(pid=120406) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 18 15:28:45.665333 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5c088ac-6e65-4ba0-9e8b-442871b56456 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:45.666218 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5c088ac-6e65-4ba0-9e8b-442871b56456 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:45.668918 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5c088ac-6e65-4ba0-9e8b-442871b56456 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:45.734556 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c5c088ac-6e65-4ba0-9e8b-442871b56456 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/os-server-groups/8facea0e-84b1-4be3-aed0-15854c6df1b4" status: 200 len: 271 microversion: 2.1 time: 0.123719 Oct 18 15:28:45.735157 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 543/1066] 10.222.0.60 () {58 vars in 1263 bytes} [Tue Oct 18 15:28:45 2022] GET /compute/v2.1/os-server-groups/8facea0e-84b1-4be3-aed0-15854c6df1b4 => generated 271 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:28:45.746600 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-26551f10-d769-452b-a75d-2fbf10c37784 tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:45.747303 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-26551f10-d769-452b-a75d-2fbf10c37784 tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] [instance: fba41720-c579-4efc-acd3-bcd27c6ae037] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:45.758240 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d80d2991-df9a-4f89-8a94-f21963ec4e48 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:45.758856 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d80d2991-df9a-4f89-8a94-f21963ec4e48 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:45.765665 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=9,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:28:45.770552 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26551f10-d769-452b-a75d-2fbf10c37784 tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:45.774678 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d80d2991-df9a-4f89-8a94-f21963ec4e48 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:45.775185 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d80d2991-df9a-4f89-8a94-f21963ec4e48 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:45.775790 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d80d2991-df9a-4f89-8a94-f21963ec4e48 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:45.776335 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d80d2991-df9a-4f89-8a94-f21963ec4e48 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:45.776796 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d80d2991-df9a-4f89-8a94-f21963ec4e48 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:45.779546 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d80d2991-df9a-4f89-8a94-f21963ec4e48 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:45.780208 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26551f10-d769-452b-a75d-2fbf10c37784 tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:45.781919 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26551f10-d769-452b-a75d-2fbf10c37784 tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:45.784071 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26551f10-d769-452b-a75d-2fbf10c37784 tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:45.791208 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26551f10-d769-452b-a75d-2fbf10c37784 tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:45.796565 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26551f10-d769-452b-a75d-2fbf10c37784 tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:46.056660 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d80d2991-df9a-4f89-8a94-f21963ec4e48 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:46.075498 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d80d2991-df9a-4f89-8a94-f21963ec4e48 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:46.080091 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d80d2991-df9a-4f89-8a94-f21963ec4e48 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:46.092278 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d80d2991-df9a-4f89-8a94-f21963ec4e48 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1555 microversion: 2.91 time: 0.339406 Oct 18 15:28:46.113491 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 544/1067] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:28:45 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1555 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:28:46.127923 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-46a0b924-bdae-4f52-9547-db5e948c11ae tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:46.129460 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-46a0b924-bdae-4f52-9547-db5e948c11ae tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: ec3790f8-37cf-4e63-b753-83d38e982580] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:46.141368 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-46a0b924-bdae-4f52-9547-db5e948c11ae tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:46.142454 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-46a0b924-bdae-4f52-9547-db5e948c11ae tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:46.144095 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-46a0b924-bdae-4f52-9547-db5e948c11ae tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:46.147052 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-46a0b924-bdae-4f52-9547-db5e948c11ae tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:46.148368 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-46a0b924-bdae-4f52-9547-db5e948c11ae tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:46.150385 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-46a0b924-bdae-4f52-9547-db5e948c11ae tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:46.372088 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-46a0b924-bdae-4f52-9547-db5e948c11ae tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:46.388605 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-46a0b924-bdae-4f52-9547-db5e948c11ae tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/ec3790f8-37cf-4e63-b753-83d38e982580" status: 200 len: 1265 microversion: 2.1 time: 0.273390 Oct 18 15:28:46.391777 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 545/1068] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:46 2022] GET /compute/v2.1/servers/ec3790f8-37cf-4e63-b753-83d38e982580 => generated 1265 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:46.487136 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-26551f10-d769-452b-a75d-2fbf10c37784 tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/fba41720-c579-4efc-acd3-bcd27c6ae037" status: 200 len: 1620 microversion: 2.1 time: 0.744039 Oct 18 15:28:46.491531 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 524/1069] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:45 2022] GET /compute/v2.1/servers/fba41720-c579-4efc-acd3-bcd27c6ae037 => generated 1620 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:46.516953 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-333fd6e2-6e4c-4076-aa59-ae6153fd3c3b tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:46.518549 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-333fd6e2-6e4c-4076-aa59-ae6153fd3c3b tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] [instance: 803b657a-c370-4fa9-8fbc-27ec5d844758] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:46.526976 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-333fd6e2-6e4c-4076-aa59-ae6153fd3c3b tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:46.528199 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-333fd6e2-6e4c-4076-aa59-ae6153fd3c3b tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:46.529082 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-333fd6e2-6e4c-4076-aa59-ae6153fd3c3b tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:46.530318 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-333fd6e2-6e4c-4076-aa59-ae6153fd3c3b tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:46.531522 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-333fd6e2-6e4c-4076-aa59-ae6153fd3c3b tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:46.532674 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-333fd6e2-6e4c-4076-aa59-ae6153fd3c3b tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:46.636043 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bccc5523-a988-4d27-b552-51a06cf286e7 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:46.637139 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-bccc5523-a988-4d27-b552-51a06cf286e7 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:46.644787 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bccc5523-a988-4d27-b552-51a06cf286e7 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:46.645302 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bccc5523-a988-4d27-b552-51a06cf286e7 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:46.649921 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bccc5523-a988-4d27-b552-51a06cf286e7 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:46.650687 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bccc5523-a988-4d27-b552-51a06cf286e7 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:46.655381 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bccc5523-a988-4d27-b552-51a06cf286e7 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:46.656071 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bccc5523-a988-4d27-b552-51a06cf286e7 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:47.047182 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-bccc5523-a988-4d27-b552-51a06cf286e7 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:47.078155 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-bccc5523-a988-4d27-b552-51a06cf286e7 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:47.079715 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-bccc5523-a988-4d27-b552-51a06cf286e7 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:47.080940 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-bccc5523-a988-4d27-b552-51a06cf286e7 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 1594 microversion: 2.42 time: 0.449671 Oct 18 15:28:47.087408 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 525/1070] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:28:46 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 1594 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:28:47.094629 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-cf98ed5b-78e0-4b91-b936-c204145124f5 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:47.105727 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-cf98ed5b-78e0-4b91-b936-c204145124f5 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: bd6231eb-95a4-465e-a859-077a7f82f585] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:47.124118 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cf98ed5b-78e0-4b91-b936-c204145124f5 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:47.124641 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cf98ed5b-78e0-4b91-b936-c204145124f5 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:47.125153 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cf98ed5b-78e0-4b91-b936-c204145124f5 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:47.125855 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cf98ed5b-78e0-4b91-b936-c204145124f5 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:47.126323 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cf98ed5b-78e0-4b91-b936-c204145124f5 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:47.127093 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cf98ed5b-78e0-4b91-b936-c204145124f5 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:47.314538 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-cf98ed5b-78e0-4b91-b936-c204145124f5 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1023300147f463e8f0894981948f825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac07f1b2c83a4faab175a5b9ed8e315e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:47.327189 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-cf98ed5b-78e0-4b91-b936-c204145124f5 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585" status: 200 len: 1277 microversion: 2.1 time: 0.238415 Oct 18 15:28:47.337049 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-333fd6e2-6e4c-4076-aa59-ae6153fd3c3b tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/803b657a-c370-4fa9-8fbc-27ec5d844758" status: 200 len: 1620 microversion: 2.1 time: 0.821099 Oct 18 15:28:47.337049 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 546/1071] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:46 2022] GET /compute/v2.1/servers/803b657a-c370-4fa9-8fbc-27ec5d844758 => generated 1620 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:47.337993 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 526/1072] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:47 2022] GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585 => generated 1277 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:47.380588 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-70218d91-33fa-42ce-ab08-c679abe66b9c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:47.381251 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-70218d91-33fa-42ce-ab08-c679abe66b9c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:47.412005 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-70218d91-33fa-42ce-ab08-c679abe66b9c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:47.413336 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-70218d91-33fa-42ce-ab08-c679abe66b9c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:47.414044 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-70218d91-33fa-42ce-ab08-c679abe66b9c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:47.415336 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-70218d91-33fa-42ce-ab08-c679abe66b9c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:47.416113 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-70218d91-33fa-42ce-ab08-c679abe66b9c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:47.416944 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-70218d91-33fa-42ce-ab08-c679abe66b9c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:47.589351 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-70218d91-33fa-42ce-ab08-c679abe66b9c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:47.604097 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-70218d91-33fa-42ce-ab08-c679abe66b9c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:47.605978 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-70218d91-33fa-42ce-ab08-c679abe66b9c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:47.622862 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-70218d91-33fa-42ce-ab08-c679abe66b9c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1555 microversion: 2.91 time: 0.283543 Oct 18 15:28:47.626650 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 527/1073] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:28:47 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1555 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:28:47.650804 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2f402137-0edb-444e-84d8-118461168440 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:47.654064 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2f402137-0edb-444e-84d8-118461168440 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: ec3790f8-37cf-4e63-b753-83d38e982580] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:47.679005 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2f402137-0edb-444e-84d8-118461168440 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:47.684956 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2f402137-0edb-444e-84d8-118461168440 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:47.685711 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2f402137-0edb-444e-84d8-118461168440 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:47.686630 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2f402137-0edb-444e-84d8-118461168440 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:47.690353 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2f402137-0edb-444e-84d8-118461168440 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:47.692517 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2f402137-0edb-444e-84d8-118461168440 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:47.713892 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1f3bfeed-4f05-4f2b-8763-58189db8a795 tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] Calling method '.version_select at 0x7f7c3d96ee50>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:47.719792 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f3bfeed-4f05-4f2b-8763-58189db8a795 tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:47.723353 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f3bfeed-4f05-4f2b-8763-58189db8a795 tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:47.727113 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f3bfeed-4f05-4f2b-8763-58189db8a795 tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:47.730890 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f3bfeed-4f05-4f2b-8763-58189db8a795 tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:47.731535 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f3bfeed-4f05-4f2b-8763-58189db8a795 tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:47.732281 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f3bfeed-4f05-4f2b-8763-58189db8a795 tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:47.837775 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1f3bfeed-4f05-4f2b-8763-58189db8a795 tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.501898 Oct 18 15:28:47.839962 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 547/1074] 10.222.0.60 () {58 vars in 1128 bytes} [Tue Oct 18 15:28:47 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:28:47.850980 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f07ad3c5-8685-4667-8c44-fd6ee38b4d7c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-225515296", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "61ca6b08-6a75-4b0a-86d7-86aa22cb308e"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:28:47.968706 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-f07ad3c5-8685-4667-8c44-fd6ee38b4d7c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] validate_networks() for None {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:28:48.310792 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2f402137-0edb-444e-84d8-118461168440 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:48.321589 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2f402137-0edb-444e-84d8-118461168440 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/ec3790f8-37cf-4e63-b753-83d38e982580" status: 200 len: 1307 microversion: 2.1 time: 0.689567 Oct 18 15:28:48.323210 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 528/1075] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:47 2022] GET /compute/v2.1/servers/ec3790f8-37cf-4e63-b753-83d38e982580 => generated 1307 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:48.338220 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d16027eb-8fa9-4d4d-b001-a886210a232e tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] Calling method '.version_select at 0x7f7c3dbc8700>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:48.347238 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d16027eb-8fa9-4d4d-b001-a886210a232e tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:48.347735 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d16027eb-8fa9-4d4d-b001-a886210a232e tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:48.351180 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d16027eb-8fa9-4d4d-b001-a886210a232e tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:48.352848 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d16027eb-8fa9-4d4d-b001-a886210a232e tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:48.354445 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d16027eb-8fa9-4d4d-b001-a886210a232e tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:48.355481 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d16027eb-8fa9-4d4d-b001-a886210a232e tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:48.420628 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d16027eb-8fa9-4d4d-b001-a886210a232e tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 376 microversion: 2.1 time: 0.093888 Oct 18 15:28:48.422456 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 529/1076] 10.222.0.60 () {58 vars in 1139 bytes} [Tue Oct 18 15:28:48 2022] GET /compute/v2.1/os-hosts?zone= => generated 376 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:28:48.431589 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1c7db0b5-ac94-4396-bb18-9914415753f2 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:48.432249 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1c7db0b5-ac94-4396-bb18-9914415753f2 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:48.449878 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-f07ad3c5-8685-4667-8c44-fd6ee38b4d7c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:28:48.450312 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-f07ad3c5-8685-4667-8c44-fd6ee38b4d7c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:28:48.450841 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-f07ad3c5-8685-4667-8c44-fd6ee38b4d7c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:28:48.451255 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-f07ad3c5-8685-4667-8c44-fd6ee38b4d7c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:28:48.451677 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-f07ad3c5-8685-4667-8c44-fd6ee38b4d7c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:28:48.456077 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1c7db0b5-ac94-4396-bb18-9914415753f2 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:48.456581 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1c7db0b5-ac94-4396-bb18-9914415753f2 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:48.457056 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1c7db0b5-ac94-4396-bb18-9914415753f2 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:48.457773 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1c7db0b5-ac94-4396-bb18-9914415753f2 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:48.459623 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1c7db0b5-ac94-4396-bb18-9914415753f2 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:48.460095 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1c7db0b5-ac94-4396-bb18-9914415753f2 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:48.471600 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f07ad3c5-8685-4667-8c44-fd6ee38b4d7c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:48.472089 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f07ad3c5-8685-4667-8c44-fd6ee38b4d7c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:48.472529 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f07ad3c5-8685-4667-8c44-fd6ee38b4d7c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:48.473299 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f07ad3c5-8685-4667-8c44-fd6ee38b4d7c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:48.476860 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f07ad3c5-8685-4667-8c44-fd6ee38b4d7c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:48.477364 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f07ad3c5-8685-4667-8c44-fd6ee38b4d7c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:48.518657 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-f07ad3c5-8685-4667-8c44-fd6ee38b4d7c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Getting quotas for project 377c3bbd62b546fca545c0f6d0df59e3. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:28:48.536028 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-f07ad3c5-8685-4667-8c44-fd6ee38b4d7c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Getting quotas for user d58aac335a1d421a95928e2754fb2529 and project 377c3bbd62b546fca545c0f6d0df59e3. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:28:48.566922 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f07ad3c5-8685-4667-8c44-fd6ee38b4d7c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:28:48.570427 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f07ad3c5-8685-4667-8c44-fd6ee38b4d7c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:28:48.596775 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:28:48.689264 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f07ad3c5-8685-4667-8c44-fd6ee38b4d7c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.847817 Oct 18 15:28:48.690348 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 548/1077] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:28:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:28:48.702896 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d14b0d73-c5c4-46e0-9e6a-c0f1562fa255 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:48.705905 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d14b0d73-c5c4-46e0-9e6a-c0f1562fa255 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: bd6231eb-95a4-465e-a859-077a7f82f585] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:48.710163 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1c7db0b5-ac94-4396-bb18-9914415753f2 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:48.734709 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d14b0d73-c5c4-46e0-9e6a-c0f1562fa255 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:48.735219 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1c7db0b5-ac94-4396-bb18-9914415753f2 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:48.736945 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d14b0d73-c5c4-46e0-9e6a-c0f1562fa255 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:48.737614 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d14b0d73-c5c4-46e0-9e6a-c0f1562fa255 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:48.738568 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d14b0d73-c5c4-46e0-9e6a-c0f1562fa255 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:48.739250 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d14b0d73-c5c4-46e0-9e6a-c0f1562fa255 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:48.739903 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d14b0d73-c5c4-46e0-9e6a-c0f1562fa255 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:48.744005 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1c7db0b5-ac94-4396-bb18-9914415753f2 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:48.745817 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1c7db0b5-ac94-4396-bb18-9914415753f2 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 1662 microversion: 2.42 time: 0.322343 Oct 18 15:28:48.761745 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 530/1078] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:28:48 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 1662 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:28:48.779456 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2581b377-2a77-48f5-9a6a-3349d8a262de tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] Calling method '.version_select at 0x7f7c3d1c11f0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:48.786529 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2581b377-2a77-48f5-9a6a-3349d8a262de tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:48.789712 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2581b377-2a77-48f5-9a6a-3349d8a262de tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:48.790183 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2581b377-2a77-48f5-9a6a-3349d8a262de tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:48.790943 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2581b377-2a77-48f5-9a6a-3349d8a262de tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:48.794477 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2581b377-2a77-48f5-9a6a-3349d8a262de tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:48.795235 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2581b377-2a77-48f5-9a6a-3349d8a262de tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:48.848000 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2581b377-2a77-48f5-9a6a-3349d8a262de tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.084954 Oct 18 15:28:48.853816 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 531/1079] 10.222.0.60 () {58 vars in 1145 bytes} [Tue Oct 18 15:28:48 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:28:48.867542 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a93c7055-58cf-46e0-9706-1edc7587cfb2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:48.868329 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d14b0d73-c5c4-46e0-9e6a-c0f1562fa255 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1023300147f463e8f0894981948f825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac07f1b2c83a4faab175a5b9ed8e315e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:48.868894 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a93c7055-58cf-46e0-9706-1edc7587cfb2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:48.880785 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a93c7055-58cf-46e0-9706-1edc7587cfb2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:48.883192 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d14b0d73-c5c4-46e0-9e6a-c0f1562fa255 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585" status: 200 len: 1275 microversion: 2.1 time: 0.184179 Oct 18 15:28:48.883803 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 549/1080] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:48 2022] GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585 => generated 1275 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:48.885603 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a93c7055-58cf-46e0-9706-1edc7587cfb2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:48.888100 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a93c7055-58cf-46e0-9706-1edc7587cfb2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:48.889055 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a93c7055-58cf-46e0-9706-1edc7587cfb2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:48.889811 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a93c7055-58cf-46e0-9706-1edc7587cfb2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:48.891322 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a93c7055-58cf-46e0-9706-1edc7587cfb2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:48.952481 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-34c6cbe5-7189-4940-bd99-13c3358daf38 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:48.953721 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-34c6cbe5-7189-4940-bd99-13c3358daf38 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:49.122663 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a93c7055-58cf-46e0-9706-1edc7587cfb2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:49.139506 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a93c7055-58cf-46e0-9706-1edc7587cfb2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:49.142716 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a93c7055-58cf-46e0-9706-1edc7587cfb2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:49.145823 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-34c6cbe5-7189-4940-bd99-13c3358daf38 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:49.163243 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-34c6cbe5-7189-4940-bd99-13c3358daf38 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62" status: 200 len: 1216 microversion: 2.1 time: 0.249870 Oct 18 15:28:49.167432 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 550/1081] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:48 2022] GET /compute/v2.1/servers/f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62 => generated 1216 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:49.169356 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a93c7055-58cf-46e0-9706-1edc7587cfb2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1555 microversion: 2.91 time: 0.308188 Oct 18 15:28:49.172310 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 532/1082] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:28:48 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1555 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:28:49.179931 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eebf4e7b-3986-46f2-ad43-5f5eff233610 tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] Calling method '.version_select at 0x7f7c3ec71c10>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:49.183409 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eebf4e7b-3986-46f2-ad43-5f5eff233610 tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:49.183895 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eebf4e7b-3986-46f2-ad43-5f5eff233610 tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:49.192409 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eebf4e7b-3986-46f2-ad43-5f5eff233610 tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:49.194453 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eebf4e7b-3986-46f2-ad43-5f5eff233610 tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:49.194825 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-bb5e48af-a59b-4612-8f64-9159c4bd2b19 req-ff7820d9-5eaf-45dc-a168-a8bc38bc9efd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec3790f8-37cf-4e63-b753-83d38e982580", "tag": "b9fd6f98-f225-43c4-9891-632e489ce46e"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:28:49.194962 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eebf4e7b-3986-46f2-ad43-5f5eff233610 tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:49.195355 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eebf4e7b-3986-46f2-ad43-5f5eff233610 tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:49.239315 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-bb5e48af-a59b-4612-8f64-9159c4bd2b19 req-ff7820d9-5eaf-45dc-a168-a8bc38bc9efd service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:49.241562 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-bb5e48af-a59b-4612-8f64-9159c4bd2b19 req-ff7820d9-5eaf-45dc-a168-a8bc38bc9efd service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:49.243499 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-bb5e48af-a59b-4612-8f64-9159c4bd2b19 req-ff7820d9-5eaf-45dc-a168-a8bc38bc9efd service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:49.255703 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-eebf4e7b-3986-46f2-ad43-5f5eff233610 tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.085617 Oct 18 15:28:49.256249 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:28:49.263949 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 551/1083] 10.222.0.60 () {58 vars in 1128 bytes} [Tue Oct 18 15:28:49 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:28:49.275135 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e39b92e5-a88f-40a4-a711-81726465330e tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] Calling method '.version_select at 0x7f7c3d2f0dc0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:49.279115 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e39b92e5-a88f-40a4-a711-81726465330e tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:49.281573 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-bb5e48af-a59b-4612-8f64-9159c4bd2b19 req-ff7820d9-5eaf-45dc-a168-a8bc38bc9efd service nova] Creating event network-changed:b9fd6f98-f225-43c4-9891-632e489ce46e for instance ec3790f8-37cf-4e63-b753-83d38e982580 on n-h2-853682-5 Oct 18 15:28:49.285412 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e39b92e5-a88f-40a4-a711-81726465330e tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:49.286111 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e39b92e5-a88f-40a4-a711-81726465330e tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:49.288620 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e39b92e5-a88f-40a4-a711-81726465330e tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:49.289935 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e39b92e5-a88f-40a4-a711-81726465330e tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:49.290706 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e39b92e5-a88f-40a4-a711-81726465330e tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:49.303301 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-bb5e48af-a59b-4612-8f64-9159c4bd2b19 req-ff7820d9-5eaf-45dc-a168-a8bc38bc9efd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125851 Oct 18 15:28:49.306875 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 533/1084] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:28:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:28:49.348470 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-30b95c14-7633-4f2b-9c9b-d888f5072ac8 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:49.349464 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-30b95c14-7633-4f2b-9c9b-d888f5072ac8 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: ec3790f8-37cf-4e63-b753-83d38e982580] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:49.360241 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e39b92e5-a88f-40a4-a711-81726465330e tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.089378 Oct 18 15:28:49.364661 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-30b95c14-7633-4f2b-9c9b-d888f5072ac8 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:49.365426 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-30b95c14-7633-4f2b-9c9b-d888f5072ac8 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:49.367436 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-30b95c14-7633-4f2b-9c9b-d888f5072ac8 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:49.369262 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-30b95c14-7633-4f2b-9c9b-d888f5072ac8 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:49.369437 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 552/1085] 10.222.0.60 () {58 vars in 1155 bytes} [Tue Oct 18 15:28:49 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:28:49.371200 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-30b95c14-7633-4f2b-9c9b-d888f5072ac8 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:49.373094 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-30b95c14-7633-4f2b-9c9b-d888f5072ac8 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:49.382043 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2f3a1a37-3a7d-44db-b1aa-4380dc2c2a28 tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] Calling method '.version_select at 0x7f7c3d97a4c0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:49.392135 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f3a1a37-3a7d-44db-b1aa-4380dc2c2a28 tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:49.409566 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f3a1a37-3a7d-44db-b1aa-4380dc2c2a28 tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:49.410386 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f3a1a37-3a7d-44db-b1aa-4380dc2c2a28 tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:49.411463 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f3a1a37-3a7d-44db-b1aa-4380dc2c2a28 tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:49.412244 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f3a1a37-3a7d-44db-b1aa-4380dc2c2a28 tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:49.412959 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f3a1a37-3a7d-44db-b1aa-4380dc2c2a28 tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:49.496793 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2f3a1a37-3a7d-44db-b1aa-4380dc2c2a28 tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.121001 Oct 18 15:28:49.502589 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 553/1086] 10.222.0.60 () {58 vars in 1128 bytes} [Tue Oct 18 15:28:49 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:28:49.513070 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-08b83643-d4a5-4f66-b011-6cef56517219 tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] Calling method '.version_select at 0x7f7c3da0a670>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:49.530170 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-08b83643-d4a5-4f66-b011-6cef56517219 tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:49.533545 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-08b83643-d4a5-4f66-b011-6cef56517219 tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:49.534257 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-08b83643-d4a5-4f66-b011-6cef56517219 tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:49.585421 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-08b83643-d4a5-4f66-b011-6cef56517219 tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:49.591951 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-08b83643-d4a5-4f66-b011-6cef56517219 tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:49.592500 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-08b83643-d4a5-4f66-b011-6cef56517219 tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:49.681507 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-08b83643-d4a5-4f66-b011-6cef56517219 tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts/n-h2-853682-5" status: 200 len: 1122 microversion: 2.1 time: 0.172194 Oct 18 15:28:49.688782 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 554/1087] 10.222.0.60 () {58 vars in 1170 bytes} [Tue Oct 18 15:28:49 2022] GET /compute/v2.1/os-hosts/n-h2-853682-5 => generated 1122 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:28:49.708978 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9cbcea52-449d-4955-ad5c-9351bfdfd6f7 tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] Calling method '.version_select at 0x7f7c3d97a700>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:49.737223 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9cbcea52-449d-4955-ad5c-9351bfdfd6f7 tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:49.739134 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9cbcea52-449d-4955-ad5c-9351bfdfd6f7 tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:49.739816 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9cbcea52-449d-4955-ad5c-9351bfdfd6f7 tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:49.798958 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9cbcea52-449d-4955-ad5c-9351bfdfd6f7 tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:49.800503 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9cbcea52-449d-4955-ad5c-9351bfdfd6f7 tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:49.801196 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9cbcea52-449d-4955-ad5c-9351bfdfd6f7 tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:49.809564 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:28:49.873746 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-30b95c14-7633-4f2b-9c9b-d888f5072ac8 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:49.891993 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-30b95c14-7633-4f2b-9c9b-d888f5072ac8 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/ec3790f8-37cf-4e63-b753-83d38e982580" status: 200 len: 1307 microversion: 2.1 time: 0.545806 Oct 18 15:28:49.892689 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9cbcea52-449d-4955-ad5c-9351bfdfd6f7 tempest-HostsAdminTestJSON-2131226582 tempest-HostsAdminTestJSON-2131226582-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts/n-h1-853682-5" status: 200 len: 991 microversion: 2.1 time: 0.181351 Oct 18 15:28:49.894993 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 555/1088] 10.222.0.60 () {58 vars in 1170 bytes} [Tue Oct 18 15:28:49 2022] GET /compute/v2.1/os-hosts/n-h1-853682-5 => generated 991 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:28:49.900397 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 534/1089] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:49 2022] GET /compute/v2.1/servers/ec3790f8-37cf-4e63-b753-83d38e982580 => generated 1307 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:28:49.915259 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6d6e7afa-00d3-4ee5-9bae-6fbd00959776 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:49.916079 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6d6e7afa-00d3-4ee5-9bae-6fbd00959776 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:49.924025 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-07fbd478-bc02-40dd-a532-ad02ef3ea163 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:49.925016 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-07fbd478-bc02-40dd-a532-ad02ef3ea163 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: bd6231eb-95a4-465e-a859-077a7f82f585] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:49.933155 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d6e7afa-00d3-4ee5-9bae-6fbd00959776 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:49.942353 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-07fbd478-bc02-40dd-a532-ad02ef3ea163 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:49.943225 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d6e7afa-00d3-4ee5-9bae-6fbd00959776 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:49.945851 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d6e7afa-00d3-4ee5-9bae-6fbd00959776 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:49.946354 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-07fbd478-bc02-40dd-a532-ad02ef3ea163 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:49.948594 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-07fbd478-bc02-40dd-a532-ad02ef3ea163 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:49.949757 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d6e7afa-00d3-4ee5-9bae-6fbd00959776 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:49.950642 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-07fbd478-bc02-40dd-a532-ad02ef3ea163 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:49.957290 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d6e7afa-00d3-4ee5-9bae-6fbd00959776 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:49.957662 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-07fbd478-bc02-40dd-a532-ad02ef3ea163 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:49.958225 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-07fbd478-bc02-40dd-a532-ad02ef3ea163 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:49.958739 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d6e7afa-00d3-4ee5-9bae-6fbd00959776 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:50.528612 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6d6e7afa-00d3-4ee5-9bae-6fbd00959776 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:50.557328 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6d6e7afa-00d3-4ee5-9bae-6fbd00959776 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:50.560840 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6d6e7afa-00d3-4ee5-9bae-6fbd00959776 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:50.566705 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6d6e7afa-00d3-4ee5-9bae-6fbd00959776 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 1709 microversion: 2.42 time: 0.670349 Oct 18 15:28:50.587263 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 556/1090] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:28:49 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 1709 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:28:50.593200 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a52309e4-f18f-4a37-a2b5-f806d6b10830 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:50.601619 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a52309e4-f18f-4a37-a2b5-f806d6b10830 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:50.603976 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-07fbd478-bc02-40dd-a532-ad02ef3ea163 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1023300147f463e8f0894981948f825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac07f1b2c83a4faab175a5b9ed8e315e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:50.617364 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a52309e4-f18f-4a37-a2b5-f806d6b10830 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:50.618233 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a52309e4-f18f-4a37-a2b5-f806d6b10830 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:50.618907 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a52309e4-f18f-4a37-a2b5-f806d6b10830 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:50.619869 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a52309e4-f18f-4a37-a2b5-f806d6b10830 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:50.623409 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a52309e4-f18f-4a37-a2b5-f806d6b10830 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:50.624166 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a52309e4-f18f-4a37-a2b5-f806d6b10830 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:50.625779 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-07fbd478-bc02-40dd-a532-ad02ef3ea163 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585" status: 200 len: 1317 microversion: 2.1 time: 0.708121 Oct 18 15:28:50.632648 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 535/1091] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:49 2022] GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585 => generated 1317 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:28:50.659440 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7482a133-a24c-4021-bf6c-15f16aedf52c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:50.664537 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7482a133-a24c-4021-bf6c-15f16aedf52c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:50.701619 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7482a133-a24c-4021-bf6c-15f16aedf52c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:50.707062 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7482a133-a24c-4021-bf6c-15f16aedf52c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:50.708957 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7482a133-a24c-4021-bf6c-15f16aedf52c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:50.712077 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7482a133-a24c-4021-bf6c-15f16aedf52c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:50.712559 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7482a133-a24c-4021-bf6c-15f16aedf52c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:50.713028 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7482a133-a24c-4021-bf6c-15f16aedf52c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:50.816476 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a52309e4-f18f-4a37-a2b5-f806d6b10830 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:50.825724 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a52309e4-f18f-4a37-a2b5-f806d6b10830 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62" status: 200 len: 1212 microversion: 2.1 time: 0.236172 Oct 18 15:28:50.843055 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 557/1092] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:50 2022] GET /compute/v2.1/servers/f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62 => generated 1212 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:50.929147 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b8675d95-a5a4-40ad-8082-55f0fc2bb922 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:50.929938 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b8675d95-a5a4-40ad-8082-55f0fc2bb922 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: ec3790f8-37cf-4e63-b753-83d38e982580] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:50.947680 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8675d95-a5a4-40ad-8082-55f0fc2bb922 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:50.948310 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8675d95-a5a4-40ad-8082-55f0fc2bb922 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:50.949064 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8675d95-a5a4-40ad-8082-55f0fc2bb922 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:50.949926 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8675d95-a5a4-40ad-8082-55f0fc2bb922 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:50.950496 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8675d95-a5a4-40ad-8082-55f0fc2bb922 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:50.951196 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8675d95-a5a4-40ad-8082-55f0fc2bb922 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:51.084012 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7482a133-a24c-4021-bf6c-15f16aedf52c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:51.100919 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7482a133-a24c-4021-bf6c-15f16aedf52c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:51.109003 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7482a133-a24c-4021-bf6c-15f16aedf52c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:51.121402 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7482a133-a24c-4021-bf6c-15f16aedf52c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1555 microversion: 2.91 time: 0.487245 Oct 18 15:28:51.127440 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 536/1093] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:28:50 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1555 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:28:51.571373 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b8675d95-a5a4-40ad-8082-55f0fc2bb922 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:51.593685 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-31290709-fcbd-4cad-a946-1f2751745556 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:51.594417 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-31290709-fcbd-4cad-a946-1f2751745556 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:51.599356 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b8675d95-a5a4-40ad-8082-55f0fc2bb922 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/ec3790f8-37cf-4e63-b753-83d38e982580" status: 200 len: 1307 microversion: 2.1 time: 0.675641 Oct 18 15:28:51.605493 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 558/1094] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:50 2022] GET /compute/v2.1/servers/ec3790f8-37cf-4e63-b753-83d38e982580 => generated 1307 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:51.607326 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-31290709-fcbd-4cad-a946-1f2751745556 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:51.618004 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-31290709-fcbd-4cad-a946-1f2751745556 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:51.618862 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-31290709-fcbd-4cad-a946-1f2751745556 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:51.619860 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-31290709-fcbd-4cad-a946-1f2751745556 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:51.620560 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-31290709-fcbd-4cad-a946-1f2751745556 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:51.621345 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-31290709-fcbd-4cad-a946-1f2751745556 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:51.650928 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ecd9b789-7dc2-499b-b45b-934c654d1f16 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:51.652059 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ecd9b789-7dc2-499b-b45b-934c654d1f16 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: bd6231eb-95a4-465e-a859-077a7f82f585] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:51.664878 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ecd9b789-7dc2-499b-b45b-934c654d1f16 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:51.666466 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ecd9b789-7dc2-499b-b45b-934c654d1f16 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:51.677473 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ecd9b789-7dc2-499b-b45b-934c654d1f16 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:51.684075 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ecd9b789-7dc2-499b-b45b-934c654d1f16 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:51.684966 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ecd9b789-7dc2-499b-b45b-934c654d1f16 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:51.685645 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ecd9b789-7dc2-499b-b45b-934c654d1f16 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:52.226770 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-31290709-fcbd-4cad-a946-1f2751745556 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:52.243726 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-31290709-fcbd-4cad-a946-1f2751745556 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:52.245243 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-31290709-fcbd-4cad-a946-1f2751745556 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:52.246624 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-31290709-fcbd-4cad-a946-1f2751745556 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 1756 microversion: 2.42 time: 0.657143 Oct 18 15:28:52.251211 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 537/1095] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:28:51 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 1756 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:28:52.269491 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a44561d8-81ca-4b13-9f69-e73bf4fd36bb tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:52.271176 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a44561d8-81ca-4b13-9f69-e73bf4fd36bb tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:52.285210 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a44561d8-81ca-4b13-9f69-e73bf4fd36bb tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:52.295561 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a44561d8-81ca-4b13-9f69-e73bf4fd36bb tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:52.296273 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a44561d8-81ca-4b13-9f69-e73bf4fd36bb tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:52.307924 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a44561d8-81ca-4b13-9f69-e73bf4fd36bb tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:52.308679 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a44561d8-81ca-4b13-9f69-e73bf4fd36bb tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:52.309315 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a44561d8-81ca-4b13-9f69-e73bf4fd36bb tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:52.368077 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ecd9b789-7dc2-499b-b45b-934c654d1f16 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1023300147f463e8f0894981948f825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac07f1b2c83a4faab175a5b9ed8e315e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:52.386121 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ecd9b789-7dc2-499b-b45b-934c654d1f16 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585" status: 200 len: 1317 microversion: 2.1 time: 0.740076 Oct 18 15:28:52.387032 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 559/1096] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:51 2022] GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585 => generated 1317 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:52.403043 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6189c7c6-fcfe-40d3-96cd-c638afc4a473 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:52.410164 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6189c7c6-fcfe-40d3-96cd-c638afc4a473 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:52.425946 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6189c7c6-fcfe-40d3-96cd-c638afc4a473 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:52.427043 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6189c7c6-fcfe-40d3-96cd-c638afc4a473 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:52.431871 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6189c7c6-fcfe-40d3-96cd-c638afc4a473 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:52.445318 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6189c7c6-fcfe-40d3-96cd-c638afc4a473 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:52.450189 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6189c7c6-fcfe-40d3-96cd-c638afc4a473 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:52.451875 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6189c7c6-fcfe-40d3-96cd-c638afc4a473 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:52.455919 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a44561d8-81ca-4b13-9f69-e73bf4fd36bb tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:52.468951 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a44561d8-81ca-4b13-9f69-e73bf4fd36bb tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62" status: 200 len: 1276 microversion: 2.1 time: 0.215198 Oct 18 15:28:52.472578 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 538/1097] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:52 2022] GET /compute/v2.1/servers/f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62 => generated 1276 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:52.633153 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-de4a562e-de28-42f8-b0f1-53f0377a5721 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:52.635661 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-de4a562e-de28-42f8-b0f1-53f0377a5721 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: ec3790f8-37cf-4e63-b753-83d38e982580] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:52.652198 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de4a562e-de28-42f8-b0f1-53f0377a5721 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:52.652959 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de4a562e-de28-42f8-b0f1-53f0377a5721 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:52.655165 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de4a562e-de28-42f8-b0f1-53f0377a5721 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:52.656110 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de4a562e-de28-42f8-b0f1-53f0377a5721 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:52.656759 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de4a562e-de28-42f8-b0f1-53f0377a5721 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:52.658545 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de4a562e-de28-42f8-b0f1-53f0377a5721 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:52.677221 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6189c7c6-fcfe-40d3-96cd-c638afc4a473 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:52.716258 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6189c7c6-fcfe-40d3-96cd-c638afc4a473 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:52.718971 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6189c7c6-fcfe-40d3-96cd-c638afc4a473 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:52.727853 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6189c7c6-fcfe-40d3-96cd-c638afc4a473 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1555 microversion: 2.91 time: 0.336109 Oct 18 15:28:52.729016 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 560/1098] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:28:52 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1555 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:28:53.284571 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c3eb4212-31a7-4898-815d-d45bf6dccb68 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:53.285652 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c3eb4212-31a7-4898-815d-d45bf6dccb68 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:53.304603 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3eb4212-31a7-4898-815d-d45bf6dccb68 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:53.305804 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3eb4212-31a7-4898-815d-d45bf6dccb68 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:53.307430 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3eb4212-31a7-4898-815d-d45bf6dccb68 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:53.316765 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3eb4212-31a7-4898-815d-d45bf6dccb68 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:53.317339 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3eb4212-31a7-4898-815d-d45bf6dccb68 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:53.317810 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3eb4212-31a7-4898-815d-d45bf6dccb68 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:53.506959 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=16 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:28:53.685748 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-de4a562e-de28-42f8-b0f1-53f0377a5721 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:53.697401 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-de4a562e-de28-42f8-b0f1-53f0377a5721 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/ec3790f8-37cf-4e63-b753-83d38e982580" status: 200 len: 1307 microversion: 2.1 time: 1.069282 Oct 18 15:28:53.701634 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 539/1099] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:52 2022] GET /compute/v2.1/servers/ec3790f8-37cf-4e63-b753-83d38e982580 => generated 1307 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:53.716734 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0da31cd7-169a-4944-827b-efccfffa2841 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:53.717756 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0da31cd7-169a-4944-827b-efccfffa2841 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: bd6231eb-95a4-465e-a859-077a7f82f585] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:53.724158 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0da31cd7-169a-4944-827b-efccfffa2841 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:53.737620 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0da31cd7-169a-4944-827b-efccfffa2841 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:53.738454 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0da31cd7-169a-4944-827b-efccfffa2841 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:53.739426 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0da31cd7-169a-4944-827b-efccfffa2841 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:53.740115 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0da31cd7-169a-4944-827b-efccfffa2841 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:53.741349 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0da31cd7-169a-4944-827b-efccfffa2841 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:53.915766 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c3eb4212-31a7-4898-815d-d45bf6dccb68 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:53.936738 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c3eb4212-31a7-4898-815d-d45bf6dccb68 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:53.938532 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c3eb4212-31a7-4898-815d-d45bf6dccb68 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:53.939927 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c3eb4212-31a7-4898-815d-d45bf6dccb68 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 1756 microversion: 2.42 time: 0.660992 Oct 18 15:28:53.941055 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 561/1100] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:28:53 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 1756 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:28:53.956613 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9823fa10-dbfb-4374-9538-9184bae2fd2a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:53.957572 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9823fa10-dbfb-4374-9538-9184bae2fd2a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:53.972131 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9823fa10-dbfb-4374-9538-9184bae2fd2a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:53.973002 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9823fa10-dbfb-4374-9538-9184bae2fd2a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:53.973663 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9823fa10-dbfb-4374-9538-9184bae2fd2a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:53.974634 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9823fa10-dbfb-4374-9538-9184bae2fd2a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:53.975309 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9823fa10-dbfb-4374-9538-9184bae2fd2a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:53.975923 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9823fa10-dbfb-4374-9538-9184bae2fd2a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:54.136349 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9823fa10-dbfb-4374-9538-9184bae2fd2a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:54.145976 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9823fa10-dbfb-4374-9538-9184bae2fd2a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62" status: 200 len: 1274 microversion: 2.1 time: 0.203601 Oct 18 15:28:54.147049 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 562/1101] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:53 2022] GET /compute/v2.1/servers/f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62 => generated 1274 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:54.154417 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1e16c1f1-2fe5-4dbd-963e-0fdcb09a5f7b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:54.155045 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1e16c1f1-2fe5-4dbd-963e-0fdcb09a5f7b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:54.165394 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e16c1f1-2fe5-4dbd-963e-0fdcb09a5f7b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:54.165881 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e16c1f1-2fe5-4dbd-963e-0fdcb09a5f7b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:54.166363 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e16c1f1-2fe5-4dbd-963e-0fdcb09a5f7b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:54.167602 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e16c1f1-2fe5-4dbd-963e-0fdcb09a5f7b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:54.167799 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e16c1f1-2fe5-4dbd-963e-0fdcb09a5f7b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:54.168227 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e16c1f1-2fe5-4dbd-963e-0fdcb09a5f7b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:54.228234 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0da31cd7-169a-4944-827b-efccfffa2841 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1023300147f463e8f0894981948f825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac07f1b2c83a4faab175a5b9ed8e315e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:54.240245 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0da31cd7-169a-4944-827b-efccfffa2841 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585" status: 200 len: 1317 microversion: 2.1 time: 0.536042 Oct 18 15:28:54.242569 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 540/1102] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:53 2022] GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585 => generated 1317 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:54.251993 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-35ed15e6-f8f3-4b3f-8032-9d0c00098394 req-2e75b648-49be-4312-9888-58f1e6004cd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd6231eb-95a4-465e-a859-077a7f82f585", "tag": "5c14163f-63a4-4c55-8e7e-3d6fb857fbbd"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:28:54.273682 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-35ed15e6-f8f3-4b3f-8032-9d0c00098394 req-2e75b648-49be-4312-9888-58f1e6004cd8 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:54.276025 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-35ed15e6-f8f3-4b3f-8032-9d0c00098394 req-2e75b648-49be-4312-9888-58f1e6004cd8 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:54.276574 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-35ed15e6-f8f3-4b3f-8032-9d0c00098394 req-2e75b648-49be-4312-9888-58f1e6004cd8 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:54.302721 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-35ed15e6-f8f3-4b3f-8032-9d0c00098394 req-2e75b648-49be-4312-9888-58f1e6004cd8 service nova] Creating event network-changed:5c14163f-63a4-4c55-8e7e-3d6fb857fbbd for instance bd6231eb-95a4-465e-a859-077a7f82f585 on n-h1-853682-5 Oct 18 15:28:54.312165 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-35ed15e6-f8f3-4b3f-8032-9d0c00098394 req-2e75b648-49be-4312-9888-58f1e6004cd8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066184 Oct 18 15:28:54.314079 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 541/1103] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:28:54.393553 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1e16c1f1-2fe5-4dbd-963e-0fdcb09a5f7b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:54.429972 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1e16c1f1-2fe5-4dbd-963e-0fdcb09a5f7b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:54.440303 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1e16c1f1-2fe5-4dbd-963e-0fdcb09a5f7b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:54.455550 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1e16c1f1-2fe5-4dbd-963e-0fdcb09a5f7b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1555 microversion: 2.91 time: 0.306354 Oct 18 15:28:54.457636 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 563/1104] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:28:54 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1555 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:28:54.729399 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-af1c56cc-845e-4bf6-9f07-2bec9bc47939 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:54.730291 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-af1c56cc-845e-4bf6-9f07-2bec9bc47939 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: ec3790f8-37cf-4e63-b753-83d38e982580] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:54.752952 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-af1c56cc-845e-4bf6-9f07-2bec9bc47939 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:54.757670 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-af1c56cc-845e-4bf6-9f07-2bec9bc47939 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:54.758407 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-af1c56cc-845e-4bf6-9f07-2bec9bc47939 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:54.760098 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-af1c56cc-845e-4bf6-9f07-2bec9bc47939 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:54.761528 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-af1c56cc-845e-4bf6-9f07-2bec9bc47939 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:54.767583 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-af1c56cc-845e-4bf6-9f07-2bec9bc47939 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:54.976323 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bd0a053c-11e4-4295-82b3-f161d2d9d32d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:54.978517 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bd0a053c-11e4-4295-82b3-f161d2d9d32d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:54.997969 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd0a053c-11e4-4295-82b3-f161d2d9d32d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:55.002148 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd0a053c-11e4-4295-82b3-f161d2d9d32d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:55.005574 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd0a053c-11e4-4295-82b3-f161d2d9d32d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:55.009759 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd0a053c-11e4-4295-82b3-f161d2d9d32d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:55.012396 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd0a053c-11e4-4295-82b3-f161d2d9d32d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:55.013513 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd0a053c-11e4-4295-82b3-f161d2d9d32d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:55.935133 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bd0a053c-11e4-4295-82b3-f161d2d9d32d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:55.955405 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bd0a053c-11e4-4295-82b3-f161d2d9d32d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:55.957886 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bd0a053c-11e4-4295-82b3-f161d2d9d32d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:55.959537 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bd0a053c-11e4-4295-82b3-f161d2d9d32d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 1803 microversion: 2.42 time: 0.991544 Oct 18 15:28:55.962793 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 564/1105] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:28:54 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 1803 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:28:55.976467 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-de37d2a2-c1a5-43c0-9f90-ccc3ca445b2a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:55.980987 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-de37d2a2-c1a5-43c0-9f90-ccc3ca445b2a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:55.994037 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-af1c56cc-845e-4bf6-9f07-2bec9bc47939 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:56.000330 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de37d2a2-c1a5-43c0-9f90-ccc3ca445b2a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:56.003827 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de37d2a2-c1a5-43c0-9f90-ccc3ca445b2a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:56.004535 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de37d2a2-c1a5-43c0-9f90-ccc3ca445b2a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:56.005257 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-af1c56cc-845e-4bf6-9f07-2bec9bc47939 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/ec3790f8-37cf-4e63-b753-83d38e982580" status: 200 len: 1307 microversion: 2.1 time: 1.280549 Oct 18 15:28:56.008151 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 542/1106] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:54 2022] GET /compute/v2.1/servers/ec3790f8-37cf-4e63-b753-83d38e982580 => generated 1307 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:56.008331 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de37d2a2-c1a5-43c0-9f90-ccc3ca445b2a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:56.008673 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de37d2a2-c1a5-43c0-9f90-ccc3ca445b2a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:56.010262 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de37d2a2-c1a5-43c0-9f90-ccc3ca445b2a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:56.018986 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ff0f5e0e-23ec-4416-97df-6badd6359131 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:56.022344 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ff0f5e0e-23ec-4416-97df-6badd6359131 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: bd6231eb-95a4-465e-a859-077a7f82f585] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:56.030761 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ff0f5e0e-23ec-4416-97df-6badd6359131 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:56.031717 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ff0f5e0e-23ec-4416-97df-6badd6359131 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:56.032320 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ff0f5e0e-23ec-4416-97df-6badd6359131 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:56.041735 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ff0f5e0e-23ec-4416-97df-6badd6359131 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:56.043346 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ff0f5e0e-23ec-4416-97df-6badd6359131 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:56.045111 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ff0f5e0e-23ec-4416-97df-6badd6359131 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:56.573091 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-de37d2a2-c1a5-43c0-9f90-ccc3ca445b2a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:56.582073 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-de37d2a2-c1a5-43c0-9f90-ccc3ca445b2a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62" status: 200 len: 1316 microversion: 2.1 time: 0.617775 Oct 18 15:28:56.593520 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 565/1107] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:55 2022] GET /compute/v2.1/servers/f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62 => generated 1316 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:56.609296 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-076dfd94-4d81-4c40-b457-b71c463360b4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:56.613122 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-076dfd94-4d81-4c40-b457-b71c463360b4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:56.648562 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-076dfd94-4d81-4c40-b457-b71c463360b4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:56.652332 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-076dfd94-4d81-4c40-b457-b71c463360b4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:56.652782 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-076dfd94-4d81-4c40-b457-b71c463360b4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:56.653554 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-076dfd94-4d81-4c40-b457-b71c463360b4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:56.666294 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-076dfd94-4d81-4c40-b457-b71c463360b4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:56.666985 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-076dfd94-4d81-4c40-b457-b71c463360b4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:56.816592 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ff0f5e0e-23ec-4416-97df-6badd6359131 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1023300147f463e8f0894981948f825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac07f1b2c83a4faab175a5b9ed8e315e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:56.830727 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ff0f5e0e-23ec-4416-97df-6badd6359131 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585" status: 200 len: 1317 microversion: 2.1 time: 0.819873 Oct 18 15:28:56.836769 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 543/1108] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:56 2022] GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585 => generated 1317 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:56.852659 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-b59c7039-5943-4313-b071-2e0276136a58 req-c31b53b9-dd00-43cf-9f43-5a955ba4a8af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec3790f8-37cf-4e63-b753-83d38e982580", "name": "network-vif-plugged", "status": "completed", "tag": "b9fd6f98-f225-43c4-9891-632e489ce46e"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:28:56.874902 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-b59c7039-5943-4313-b071-2e0276136a58 req-c31b53b9-dd00-43cf-9f43-5a955ba4a8af service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:56.875670 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-b59c7039-5943-4313-b071-2e0276136a58 req-c31b53b9-dd00-43cf-9f43-5a955ba4a8af service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:56.876306 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-b59c7039-5943-4313-b071-2e0276136a58 req-c31b53b9-dd00-43cf-9f43-5a955ba4a8af service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:56.907456 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-b59c7039-5943-4313-b071-2e0276136a58 req-c31b53b9-dd00-43cf-9f43-5a955ba4a8af service nova] Creating event network-vif-plugged:b9fd6f98-f225-43c4-9891-632e489ce46e for instance ec3790f8-37cf-4e63-b753-83d38e982580 on n-h2-853682-5 Oct 18 15:28:56.907748 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-076dfd94-4d81-4c40-b457-b71c463360b4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:56.916739 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-b59c7039-5943-4313-b071-2e0276136a58 req-c31b53b9-dd00-43cf-9f43-5a955ba4a8af service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077357 Oct 18 15:28:56.918320 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 544/1109] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:28:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:28:56.926491 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-db80af77-e40a-4888-baf7-fa0c5f714796 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:56.926811 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-076dfd94-4d81-4c40-b457-b71c463360b4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:56.927730 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-db80af77-e40a-4888-baf7-fa0c5f714796 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:56.928682 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-076dfd94-4d81-4c40-b457-b71c463360b4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:56.937281 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-db80af77-e40a-4888-baf7-fa0c5f714796 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:56.938205 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-db80af77-e40a-4888-baf7-fa0c5f714796 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:56.938994 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-db80af77-e40a-4888-baf7-fa0c5f714796 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:56.940015 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-db80af77-e40a-4888-baf7-fa0c5f714796 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:56.940714 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-db80af77-e40a-4888-baf7-fa0c5f714796 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:56.941322 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-076dfd94-4d81-4c40-b457-b71c463360b4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1555 microversion: 2.91 time: 0.346334 Oct 18 15:28:56.941906 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-db80af77-e40a-4888-baf7-fa0c5f714796 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:56.958162 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 566/1110] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:28:56 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1555 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:28:56.988569 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3c8df80e-7dc5-47ae-aba3-0118213fc396 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:56.989288 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3c8df80e-7dc5-47ae-aba3-0118213fc396 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:56.999104 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c8df80e-7dc5-47ae-aba3-0118213fc396 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:57.000094 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c8df80e-7dc5-47ae-aba3-0118213fc396 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:57.000582 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c8df80e-7dc5-47ae-aba3-0118213fc396 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:57.001590 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c8df80e-7dc5-47ae-aba3-0118213fc396 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:57.002229 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c8df80e-7dc5-47ae-aba3-0118213fc396 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:57.002933 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c8df80e-7dc5-47ae-aba3-0118213fc396 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:57.269895 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3c8df80e-7dc5-47ae-aba3-0118213fc396 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:57.283663 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3c8df80e-7dc5-47ae-aba3-0118213fc396 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:57.284472 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3c8df80e-7dc5-47ae-aba3-0118213fc396 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:57.290380 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3c8df80e-7dc5-47ae-aba3-0118213fc396 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 1803 microversion: 2.42 time: 0.306559 Oct 18 15:28:57.290978 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 567/1111] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:28:56 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 1803 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:28:57.299315 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6ca94537-1258-4791-b5ae-33c639431115 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:57.299929 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6ca94537-1258-4791-b5ae-33c639431115 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: ec3790f8-37cf-4e63-b753-83d38e982580] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:57.311797 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ca94537-1258-4791-b5ae-33c639431115 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:57.312574 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ca94537-1258-4791-b5ae-33c639431115 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:57.313197 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ca94537-1258-4791-b5ae-33c639431115 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:57.314087 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ca94537-1258-4791-b5ae-33c639431115 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:57.314970 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ca94537-1258-4791-b5ae-33c639431115 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:57.315543 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ca94537-1258-4791-b5ae-33c639431115 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:57.372174 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-db80af77-e40a-4888-baf7-fa0c5f714796 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2" status: 200 len: 1858 microversion: 2.1 time: 0.451731 Oct 18 15:28:57.374008 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 545/1112] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:56 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2 => generated 1858 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:57.401403 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-84a0514c-ca44-479a-96cc-b7e2ae121f2d tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-853682-5", "block_migration": true, "disk_over_commit": false}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:28:57.404131 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-84a0514c-ca44-479a-96cc-b7e2ae121f2d tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:57.411114 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-84a0514c-ca44-479a-96cc-b7e2ae121f2d tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:57.411874 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-84a0514c-ca44-479a-96cc-b7e2ae121f2d tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:57.412522 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-84a0514c-ca44-479a-96cc-b7e2ae121f2d tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:57.413446 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-84a0514c-ca44-479a-96cc-b7e2ae121f2d tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:57.414103 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-84a0514c-ca44-479a-96cc-b7e2ae121f2d tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:57.414690 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-84a0514c-ca44-479a-96cc-b7e2ae121f2d tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:57.448076 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-84a0514c-ca44-479a-96cc-b7e2ae121f2d tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lazy-loading 'flavor' on Instance uuid a0a3feae-1805-4c09-881b-99dd257bd9c2 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:28:57.465592 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-84a0514c-ca44-479a-96cc-b7e2ae121f2d tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Going to try to live migrate instance to n-h2-853682-5 {{(pid=120405) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 18 15:28:57.539312 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6ca94537-1258-4791-b5ae-33c639431115 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:57.550405 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6ca94537-1258-4791-b5ae-33c639431115 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/ec3790f8-37cf-4e63-b753-83d38e982580" status: 200 len: 1307 microversion: 2.1 time: 0.258186 Oct 18 15:28:57.551509 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 568/1113] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:57 2022] GET /compute/v2.1/servers/ec3790f8-37cf-4e63-b753-83d38e982580 => generated 1307 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:57.829608 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-610395b0-dfdc-49c6-a858-5d750caa80d5 tempest-HypervisorAdminNegativeUnderV252Test-136149023 tempest-HypervisorAdminNegativeUnderV252Test-136149023-project-admin] Calling method '.version_select at 0x7f7c3d9ff1f0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:57.831566 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-610395b0-dfdc-49c6-a858-5d750caa80d5 tempest-HypervisorAdminNegativeUnderV252Test-136149023 tempest-HypervisorAdminNegativeUnderV252Test-136149023-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:57.832340 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-610395b0-dfdc-49c6-a858-5d750caa80d5 tempest-HypervisorAdminNegativeUnderV252Test-136149023 tempest-HypervisorAdminNegativeUnderV252Test-136149023-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:57.833045 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-610395b0-dfdc-49c6-a858-5d750caa80d5 tempest-HypervisorAdminNegativeUnderV252Test-136149023 tempest-HypervisorAdminNegativeUnderV252Test-136149023-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:57.859978 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-610395b0-dfdc-49c6-a858-5d750caa80d5 tempest-HypervisorAdminNegativeUnderV252Test-136149023 tempest-HypervisorAdminNegativeUnderV252Test-136149023-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:57.864333 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-610395b0-dfdc-49c6-a858-5d750caa80d5 tempest-HypervisorAdminNegativeUnderV252Test-136149023 tempest-HypervisorAdminNegativeUnderV252Test-136149023-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:57.866212 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-610395b0-dfdc-49c6-a858-5d750caa80d5 tempest-HypervisorAdminNegativeUnderV252Test-136149023 tempest-HypervisorAdminNegativeUnderV252Test-136149023-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:57.885650 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-610395b0-dfdc-49c6-a858-5d750caa80d5 tempest-HypervisorAdminNegativeUnderV252Test-136149023 tempest-HypervisorAdminNegativeUnderV252Test-136149023-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:57.886126 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-610395b0-dfdc-49c6-a858-5d750caa80d5 tempest-HypervisorAdminNegativeUnderV252Test-136149023 tempest-HypervisorAdminNegativeUnderV252Test-136149023-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:57.887285 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-610395b0-dfdc-49c6-a858-5d750caa80d5 tempest-HypervisorAdminNegativeUnderV252Test-136149023 tempest-HypervisorAdminNegativeUnderV252Test-136149023-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:57.895388 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-610395b0-dfdc-49c6-a858-5d750caa80d5 tempest-HypervisorAdminNegativeUnderV252Test-136149023 tempest-HypervisorAdminNegativeUnderV252Test-136149023-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.318979 Oct 18 15:28:57.896483 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 569/1114] 10.222.0.60 () {58 vars in 1146 bytes} [Tue Oct 18 15:28:57 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:28:57.902173 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b93f7f31-1576-4255-b997-4b420928deff tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:57.903169 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b93f7f31-1576-4255-b997-4b420928deff tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:57.911248 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b93f7f31-1576-4255-b997-4b420928deff tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:57.912104 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b93f7f31-1576-4255-b997-4b420928deff tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:57.912830 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b93f7f31-1576-4255-b997-4b420928deff tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:57.913794 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b93f7f31-1576-4255-b997-4b420928deff tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:57.914467 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b93f7f31-1576-4255-b997-4b420928deff tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:57.915253 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b93f7f31-1576-4255-b997-4b420928deff tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:58.082496 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b93f7f31-1576-4255-b997-4b420928deff tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:58.093513 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b93f7f31-1576-4255-b997-4b420928deff tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62" status: 200 len: 1316 microversion: 2.1 time: 0.194891 Oct 18 15:28:58.095757 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 570/1115] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:57 2022] GET /compute/v2.1/servers/f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62 => generated 1316 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:58.100899 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e1e6b028-a9af-4fa5-8f68-06742f67ef90 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:58.101864 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e1e6b028-a9af-4fa5-8f68-06742f67ef90 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: bd6231eb-95a4-465e-a859-077a7f82f585] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:58.110989 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e1e6b028-a9af-4fa5-8f68-06742f67ef90 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:58.113455 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e1e6b028-a9af-4fa5-8f68-06742f67ef90 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:58.116669 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e1e6b028-a9af-4fa5-8f68-06742f67ef90 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:58.119027 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e1e6b028-a9af-4fa5-8f68-06742f67ef90 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:58.119925 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e1e6b028-a9af-4fa5-8f68-06742f67ef90 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:58.120793 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e1e6b028-a9af-4fa5-8f68-06742f67ef90 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:58.403577 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e1e6b028-a9af-4fa5-8f68-06742f67ef90 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1023300147f463e8f0894981948f825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac07f1b2c83a4faab175a5b9ed8e315e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:58.413472 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e1e6b028-a9af-4fa5-8f68-06742f67ef90 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585" status: 200 len: 1317 microversion: 2.1 time: 0.316371 Oct 18 15:28:58.415464 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 571/1116] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:58 2022] GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585 => generated 1317 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:58.605152 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cf72c8b1-d52c-43ed-aff0-3fee5de9f55c tempest-HypervisorAdminNegativeUnderV252Test-1549984706 tempest-HypervisorAdminNegativeUnderV252Test-1549984706-project] Calling method '.version_select at 0x7f7c3d163310>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:58.608350 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cf72c8b1-d52c-43ed-aff0-3fee5de9f55c tempest-HypervisorAdminNegativeUnderV252Test-1549984706 tempest-HypervisorAdminNegativeUnderV252Test-1549984706-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'dd6401a331a445d09d92f1a5599efc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21166266984fc98bec26ea9147909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:58.615547 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cf72c8b1-d52c-43ed-aff0-3fee5de9f55c tempest-HypervisorAdminNegativeUnderV252Test-1549984706 tempest-HypervisorAdminNegativeUnderV252Test-1549984706-project] Request method failure captured: Oct 18 15:28:58.615547 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/os-hypervisors/n-h2-853682-5/search HTTP/1.1 Oct 18 15:28:58.615547 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:28:58.615547 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:28:58.615547 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:28:58.615547 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:28:58.615547 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:28:58.615547 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:28:58.615547 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:28:58.615547 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:28:58.615547 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsY4MwPjCaFcmvvgEjWEeJrUxWjpc-fRywFPp5_YkgLTDbzxXyHZXE6GwFYEzKW8oWkt1zx6MYvsGKgjL18aBzh_V_E-R2v-dpuac_vhlef_R69muWIn2ly5gbwrsoK4bk7xeJg3TcHwnOb4je2XNmI5kRRIeYgDTDJKZkY4VUltFw8 Oct 18 15:28:58.615547 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:28:58.615547 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:28:58.615547 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:28:58.615547 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:28:58.615547 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:28:58.615547 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:28:58.615547 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 9a21166266984fc98bec26ea9147909f Oct 18 15:28:58.615547 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1549984706 Oct 18 15:28:58.615547 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:28:58.615547 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:28:58.617524 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9a21166266984fc98bec26ea9147909f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9a21166266984fc98bec26ea9147909f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9a21166266984fc98bec26ea9147909f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9a21166266984fc98bec26ea9147909f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:28:58.617524 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1549984706 Oct 18 15:28:58.617524 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 9a21166266984fc98bec26ea9147909f Oct 18 15:28:58.617524 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1549984706 Oct 18 15:28:58.617524 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1549984706-project Oct 18 15:28:58.617524 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:28:58.617524 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:28:58.617524 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: dd6401a331a445d09d92f1a5599efc00 Oct 18 15:28:58.617524 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1549984706-project Oct 18 15:28:58.617524 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:28:58.617524 n-d-853682-5 devstack@n-api.service[120406]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 18 15:28:58.617524 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'n-h2-853682-5'} Oct 18 15:28:58.618544 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:28:58.618544 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:28:58.618544 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:28:58.618544 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:28:58.618544 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:28:58.618544 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:28:58.618544 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:28:58.618544 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:28:58.618544 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:28:58.618544 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:28:58.618544 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 18 15:28:58.618544 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 18 15:28:58.618544 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 15:28:58.618544 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 15:28:58.618544 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 15:28:58.618544 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 15:28:58.618544 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 15:28:58.618544 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 15:28:58.618544 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 15:28:58.620977 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 15:28:58.620977 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 15:28:58.620977 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 15:28:58.620977 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 15:28:58.620977 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 15:28:58.620977 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 15:28:58.620977 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 15:28:58.620977 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 18 15:28:58.620977 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:28:58.620977 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:28:58.620977 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:28:58.620977 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:28:58.620977 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:28:58.620977 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:28:58.620977 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 15:28:58.620977 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 15:28:58.620977 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 18 15:28:58.620977 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:28:58.623650 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cf72c8b1-d52c-43ed-aff0-3fee5de9f55c tempest-HypervisorAdminNegativeUnderV252Test-1549984706 tempest-HypervisorAdminNegativeUnderV252Test-1549984706-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:28:58.625557 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cf72c8b1-d52c-43ed-aff0-3fee5de9f55c tempest-HypervisorAdminNegativeUnderV252Test-1549984706 tempest-HypervisorAdminNegativeUnderV252Test-1549984706-project] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/n-h2-853682-5/search" status: 403 len: 117 microversion: 2.1 time: 0.207922 Oct 18 15:28:58.626260 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 572/1117] 10.222.0.60 () {58 vars in 1209 bytes} [Tue Oct 18 15:28:58 2022] GET /compute/v2.1/os-hypervisors/n-h2-853682-5/search => generated 117 bytes in 210 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:28:58.637406 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f5b4ca63-64eb-468e-a0a8-97dfc1e50447 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:58.642321 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f5b4ca63-64eb-468e-a0a8-97dfc1e50447 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:58.662535 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f5b4ca63-64eb-468e-a0a8-97dfc1e50447 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:58.662954 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f5b4ca63-64eb-468e-a0a8-97dfc1e50447 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:58.663956 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f5b4ca63-64eb-468e-a0a8-97dfc1e50447 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:58.664790 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f5b4ca63-64eb-468e-a0a8-97dfc1e50447 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:58.665293 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f5b4ca63-64eb-468e-a0a8-97dfc1e50447 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:58.665908 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f5b4ca63-64eb-468e-a0a8-97dfc1e50447 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:58.671874 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:28:58.790784 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f5b4ca63-64eb-468e-a0a8-97dfc1e50447 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:58.805554 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f5b4ca63-64eb-468e-a0a8-97dfc1e50447 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:58.808652 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f5b4ca63-64eb-468e-a0a8-97dfc1e50447 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:58.816406 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f5b4ca63-64eb-468e-a0a8-97dfc1e50447 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1537 microversion: 2.91 time: 0.188935 Oct 18 15:28:58.817285 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 573/1118] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:28:58 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1537 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:28:58.822818 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-57dce038-3854-4bcb-bc2a-180281736a93 req-e141f88d-5faa-4d9e-9e64-36901bce5a00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62", "tag": "c40f10a5-5df6-423f-9402-7931e116c295"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:28:58.835449 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-57dce038-3854-4bcb-bc2a-180281736a93 req-e141f88d-5faa-4d9e-9e64-36901bce5a00 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:58.835922 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-57dce038-3854-4bcb-bc2a-180281736a93 req-e141f88d-5faa-4d9e-9e64-36901bce5a00 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:58.836591 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-57dce038-3854-4bcb-bc2a-180281736a93 req-e141f88d-5faa-4d9e-9e64-36901bce5a00 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:58.838481 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=8 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:28:58.860130 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-57dce038-3854-4bcb-bc2a-180281736a93 req-e141f88d-5faa-4d9e-9e64-36901bce5a00 service nova] Creating event network-changed:c40f10a5-5df6-423f-9402-7931e116c295 for instance f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62 on n-h2-853682-5 Oct 18 15:28:58.866451 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-57dce038-3854-4bcb-bc2a-180281736a93 req-e141f88d-5faa-4d9e-9e64-36901bce5a00 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047697 Oct 18 15:28:58.867462 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 574/1119] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:28:58.873875 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8102c8a0-03d9-4087-b140-f7ff931f91de tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:58.874581 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8102c8a0-03d9-4087-b140-f7ff931f91de tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:58.883155 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8102c8a0-03d9-4087-b140-f7ff931f91de tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:58.883654 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8102c8a0-03d9-4087-b140-f7ff931f91de tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:58.884095 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8102c8a0-03d9-4087-b140-f7ff931f91de tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:58.884838 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8102c8a0-03d9-4087-b140-f7ff931f91de tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:58.885294 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8102c8a0-03d9-4087-b140-f7ff931f91de tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:58.886032 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8102c8a0-03d9-4087-b140-f7ff931f91de tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:59.158245 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=20 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:28:59.275162 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8102c8a0-03d9-4087-b140-f7ff931f91de tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:59.285357 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8102c8a0-03d9-4087-b140-f7ff931f91de tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:59.286797 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8102c8a0-03d9-4087-b140-f7ff931f91de tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:59.288092 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8102c8a0-03d9-4087-b140-f7ff931f91de tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 1850 microversion: 2.42 time: 0.419272 Oct 18 15:28:59.288659 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 575/1120] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:28:58 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 1850 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:28:59.295214 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c7b890c4-e90c-46ae-9d31-821bae9a02ac tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:59.296032 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c7b890c4-e90c-46ae-9d31-821bae9a02ac tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: ec3790f8-37cf-4e63-b753-83d38e982580] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:59.302546 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c7b890c4-e90c-46ae-9d31-821bae9a02ac tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:59.303391 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c7b890c4-e90c-46ae-9d31-821bae9a02ac tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:59.304221 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c7b890c4-e90c-46ae-9d31-821bae9a02ac tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:59.305099 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c7b890c4-e90c-46ae-9d31-821bae9a02ac tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:59.305926 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c7b890c4-e90c-46ae-9d31-821bae9a02ac tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:59.306683 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c7b890c4-e90c-46ae-9d31-821bae9a02ac tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:59.431951 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=12 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:28:59.581014 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c7b890c4-e90c-46ae-9d31-821bae9a02ac tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:59.590934 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c7b890c4-e90c-46ae-9d31-821bae9a02ac tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/ec3790f8-37cf-4e63-b753-83d38e982580" status: 200 len: 1487 microversion: 2.1 time: 0.300909 Oct 18 15:28:59.591733 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 576/1121] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:59 2022] GET /compute/v2.1/servers/ec3790f8-37cf-4e63-b753-83d38e982580 => generated 1487 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:59.596203 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1d0e7891-9a82-4668-ba5c-be183cba85f2 tempest-HypervisorAdminNegativeUnderV252Test-136149023 tempest-HypervisorAdminNegativeUnderV252Test-136149023-project-admin] Calling method '.version_select at 0x7f7c3d80b820>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:59.597944 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d0e7891-9a82-4668-ba5c-be183cba85f2 tempest-HypervisorAdminNegativeUnderV252Test-136149023 tempest-HypervisorAdminNegativeUnderV252Test-136149023-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:59.598417 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d0e7891-9a82-4668-ba5c-be183cba85f2 tempest-HypervisorAdminNegativeUnderV252Test-136149023 tempest-HypervisorAdminNegativeUnderV252Test-136149023-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:59.598845 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d0e7891-9a82-4668-ba5c-be183cba85f2 tempest-HypervisorAdminNegativeUnderV252Test-136149023 tempest-HypervisorAdminNegativeUnderV252Test-136149023-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:59.605432 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-1d0e7891-9a82-4668-ba5c-be183cba85f2 tempest-HypervisorAdminNegativeUnderV252Test-136149023 tempest-HypervisorAdminNegativeUnderV252Test-136149023-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 18 15:28:59.606869 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1d0e7891-9a82-4668-ba5c-be183cba85f2 tempest-HypervisorAdminNegativeUnderV252Test-136149023 tempest-HypervisorAdminNegativeUnderV252Test-136149023-project-admin] Request method failure captured: Oct 18 15:28:59.606869 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 18 15:28:59.606869 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:28:59.606869 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:28:59.606869 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:28:59.606869 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:28:59.606869 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:28:59.606869 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:28:59.606869 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:28:59.606869 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:28:59.606869 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsY5u8_S4gVjePiLOndHhNlhgzc4DqEapNiOYz4X5ZS5KQcWolviD74ePRwDFAIdAPEao_-QtQ0jpqhtMx7bGwwdFW0E30gCiQExKnvvZv1GwMkVjRF6mWapFClEYunDogA98eqHlJy6gJ-8JlTM-UiDgoGYHfrg5c3qJVE6Ggeb2MM Oct 18 15:28:59.606869 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:28:59.606869 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:28:59.606869 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:28:59.606869 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:28:59.606869 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:28:59.606869 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:28:59.606869 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 814b28f96e444f2cb4ebe21ce3a84604 Oct 18 15:28:59.606869 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-136149023 Oct 18 15:28:59.606869 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,admin,reader Oct 18 15:28:59.606869 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,admin,reader Oct 18 15:28:59.608324 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/814b28f96e444f2cb4ebe21ce3a84604"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/814b28f96e444f2cb4ebe21ce3a84604"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/814b28f96e444f2cb4ebe21ce3a84604"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_814b28f96e444f2cb4ebe21ce3a84604"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:28:59.608324 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-136149023 Oct 18 15:28:59.608324 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 814b28f96e444f2cb4ebe21ce3a84604 Oct 18 15:28:59.608324 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-136149023 Oct 18 15:28:59.608324 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-136149023-project-admin Oct 18 15:28:59.608324 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:28:59.608324 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:28:59.608324 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 7603bbfd94e644898c64833a0d31c630 Oct 18 15:28:59.608324 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-136149023-project-admin Oct 18 15:28:59.608324 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:28:59.608324 n-d-853682-5 devstack@n-api.service[120406]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 18 15:28:59.608324 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 18 15:28:59.609750 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:28:59.609750 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:28:59.609750 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:28:59.609750 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:28:59.609750 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:28:59.609750 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:28:59.609750 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:28:59.609750 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:28:59.609750 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:28:59.609750 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:28:59.609750 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 18 15:28:59.609750 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 18 15:28:59.609750 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 18 15:28:59.609750 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 18 15:28:59.609750 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 18 15:28:59.609750 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:28:59.609750 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:28:59.609750 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:28:59.609750 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:28:59.609750 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:28:59.611395 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:28:59.611395 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:28:59.611395 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:28:59.611395 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 18 15:28:59.611395 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:28:59.611395 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1d0e7891-9a82-4668-ba5c-be183cba85f2 tempest-HypervisorAdminNegativeUnderV252Test-136149023 tempest-HypervisorAdminNegativeUnderV252Test-136149023-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:28:59.611395 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1d0e7891-9a82-4668-ba5c-be183cba85f2 tempest-HypervisorAdminNegativeUnderV252Test-136149023 tempest-HypervisorAdminNegativeUnderV252Test-136149023-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.015399 Oct 18 15:28:59.614043 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 577/1122] 10.222.0.60 () {58 vars in 1251 bytes} [Tue Oct 18 15:28:59 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:28:59.618039 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2a5333a8-085b-403d-8f42-63a2d4dc4918 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:59.618649 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2a5333a8-085b-403d-8f42-63a2d4dc4918 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:59.627259 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a5333a8-085b-403d-8f42-63a2d4dc4918 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:59.627779 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a5333a8-085b-403d-8f42-63a2d4dc4918 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:59.628654 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a5333a8-085b-403d-8f42-63a2d4dc4918 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:59.629780 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a5333a8-085b-403d-8f42-63a2d4dc4918 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:59.630177 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a5333a8-085b-403d-8f42-63a2d4dc4918 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:59.630601 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a5333a8-085b-403d-8f42-63a2d4dc4918 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:59.677761 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-84a0514c-ca44-479a-96cc-b7e2ae121f2d tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2/action" status: 202 len: 0 microversion: 2.1 time: 2.279777 Oct 18 15:28:59.678767 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 546/1123] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:28:57 2022] POST /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2/action => generated 0 bytes in 2282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:28:59.684383 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2a5b22bc-95a9-4757-979d-984a2a83edc3 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:59.685240 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2a5b22bc-95a9-4757-979d-984a2a83edc3 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: bd6231eb-95a4-465e-a859-077a7f82f585] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:59.696224 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a5b22bc-95a9-4757-979d-984a2a83edc3 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:59.699602 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a5b22bc-95a9-4757-979d-984a2a83edc3 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:59.700435 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a5b22bc-95a9-4757-979d-984a2a83edc3 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:59.701431 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a5b22bc-95a9-4757-979d-984a2a83edc3 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:59.702373 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a5b22bc-95a9-4757-979d-984a2a83edc3 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:59.703010 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a5b22bc-95a9-4757-979d-984a2a83edc3 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:59.869308 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2a5333a8-085b-403d-8f42-63a2d4dc4918 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:59.877110 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2a5333a8-085b-403d-8f42-63a2d4dc4918 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62" status: 200 len: 1316 microversion: 2.1 time: 0.262889 Oct 18 15:28:59.878215 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 578/1124] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:59 2022] GET /compute/v2.1/servers/f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62 => generated 1316 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:59.883124 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-77d276d2-6e70-4f08-b07d-28cdcbee4f6e tempest-HypervisorAdminNegativeUnderV252Test-136149023 tempest-HypervisorAdminNegativeUnderV252Test-136149023-project-admin] Calling method '.version_select at 0x7f7c3d1d7550>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:59.885032 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77d276d2-6e70-4f08-b07d-28cdcbee4f6e tempest-HypervisorAdminNegativeUnderV252Test-136149023 tempest-HypervisorAdminNegativeUnderV252Test-136149023-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:59.885582 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77d276d2-6e70-4f08-b07d-28cdcbee4f6e tempest-HypervisorAdminNegativeUnderV252Test-136149023 tempest-HypervisorAdminNegativeUnderV252Test-136149023-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:59.886090 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77d276d2-6e70-4f08-b07d-28cdcbee4f6e tempest-HypervisorAdminNegativeUnderV252Test-136149023 tempest-HypervisorAdminNegativeUnderV252Test-136149023-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:59.900763 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77d276d2-6e70-4f08-b07d-28cdcbee4f6e tempest-HypervisorAdminNegativeUnderV252Test-136149023 tempest-HypervisorAdminNegativeUnderV252Test-136149023-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:59.901374 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77d276d2-6e70-4f08-b07d-28cdcbee4f6e tempest-HypervisorAdminNegativeUnderV252Test-136149023 tempest-HypervisorAdminNegativeUnderV252Test-136149023-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:59.901880 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77d276d2-6e70-4f08-b07d-28cdcbee4f6e tempest-HypervisorAdminNegativeUnderV252Test-136149023 tempest-HypervisorAdminNegativeUnderV252Test-136149023-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:59.912766 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77d276d2-6e70-4f08-b07d-28cdcbee4f6e tempest-HypervisorAdminNegativeUnderV252Test-136149023 tempest-HypervisorAdminNegativeUnderV252Test-136149023-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:59.913283 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77d276d2-6e70-4f08-b07d-28cdcbee4f6e tempest-HypervisorAdminNegativeUnderV252Test-136149023 tempest-HypervisorAdminNegativeUnderV252Test-136149023-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:59.913715 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77d276d2-6e70-4f08-b07d-28cdcbee4f6e tempest-HypervisorAdminNegativeUnderV252Test-136149023 tempest-HypervisorAdminNegativeUnderV252Test-136149023-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:59.915530 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2a5b22bc-95a9-4757-979d-984a2a83edc3 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1023300147f463e8f0894981948f825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac07f1b2c83a4faab175a5b9ed8e315e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:28:59.919627 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-77d276d2-6e70-4f08-b07d-28cdcbee4f6e tempest-HypervisorAdminNegativeUnderV252Test-136149023 tempest-HypervisorAdminNegativeUnderV252Test-136149023-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.040387 Oct 18 15:28:59.924986 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 579/1125] 10.222.0.60 () {58 vars in 1146 bytes} [Tue Oct 18 15:28:59 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:28:59.925144 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e4a67daf-52a1-4a7d-baee-b13d4f6528ca tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-459636265"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:28:59.927577 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e4a67daf-52a1-4a7d-baee-b13d4f6528ca tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: ec3790f8-37cf-4e63-b753-83d38e982580] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:59.928878 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2a5b22bc-95a9-4757-979d-984a2a83edc3 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585" status: 200 len: 1317 microversion: 2.1 time: 0.247828 Oct 18 15:28:59.929862 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 547/1126] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:59 2022] GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585 => generated 1317 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:28:59.933624 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4a67daf-52a1-4a7d-baee-b13d4f6528ca tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:59.934117 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4a67daf-52a1-4a7d-baee-b13d4f6528ca tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:59.934557 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4a67daf-52a1-4a7d-baee-b13d4f6528ca tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:59.935256 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4a67daf-52a1-4a7d-baee-b13d4f6528ca tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:59.935710 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4a67daf-52a1-4a7d-baee-b13d4f6528ca tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:59.936130 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4a67daf-52a1-4a7d-baee-b13d4f6528ca tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:59.938181 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-bc31d3d1-92b4-422a-a3f7-b9974afa44b8 req-5b5bea46-bf2e-4b57-94fe-bf0e7930ce54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23bdadc4-6faa-4e55-8daf-eef04dd34a8a", "tag": "31a34f24-b614-446a-bba2-e9ae313005fa"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:28:59.949393 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-bc31d3d1-92b4-422a-a3f7-b9974afa44b8 req-5b5bea46-bf2e-4b57-94fe-bf0e7930ce54 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:59.949882 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-bc31d3d1-92b4-422a-a3f7-b9974afa44b8 req-5b5bea46-bf2e-4b57-94fe-bf0e7930ce54 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:59.950544 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-bc31d3d1-92b4-422a-a3f7-b9974afa44b8 req-5b5bea46-bf2e-4b57-94fe-bf0e7930ce54 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:59.963297 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-bc31d3d1-92b4-422a-a3f7-b9974afa44b8 req-5b5bea46-bf2e-4b57-94fe-bf0e7930ce54 service nova] Creating event network-changed:31a34f24-b614-446a-bba2-e9ae313005fa for instance 23bdadc4-6faa-4e55-8daf-eef04dd34a8a on n-h2-853682-5 Oct 18 15:28:59.968495 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-bc31d3d1-92b4-422a-a3f7-b9974afa44b8 req-5b5bea46-bf2e-4b57-94fe-bf0e7930ce54 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037351 Oct 18 15:28:59.969230 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 548/1127] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:28:59.975153 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-eecddcb9-fee8-4335-82d3-a9ad3d1a30b0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:28:59.975843 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-eecddcb9-fee8-4335-82d3-a9ad3d1a30b0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:28:59.982400 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eecddcb9-fee8-4335-82d3-a9ad3d1a30b0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:59.983150 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eecddcb9-fee8-4335-82d3-a9ad3d1a30b0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:59.986074 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eecddcb9-fee8-4335-82d3-a9ad3d1a30b0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:28:59.986789 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eecddcb9-fee8-4335-82d3-a9ad3d1a30b0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:28:59.987250 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eecddcb9-fee8-4335-82d3-a9ad3d1a30b0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:28:59.987678 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eecddcb9-fee8-4335-82d3-a9ad3d1a30b0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:00.205357 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e4a67daf-52a1-4a7d-baee-b13d4f6528ca tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "POST /compute/v2.1/servers/ec3790f8-37cf-4e63-b753-83d38e982580/action" status: 202 len: 0 microversion: 2.1 time: 0.283286 Oct 18 15:29:00.207638 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 580/1128] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:28:59 2022] POST /compute/v2.1/servers/ec3790f8-37cf-4e63-b753-83d38e982580/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 18 15:29:00.214547 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e061830b-3254-48ae-900b-f42f7318e02e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:00.215482 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e061830b-3254-48ae-900b-f42f7318e02e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:00.224642 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e061830b-3254-48ae-900b-f42f7318e02e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:00.225396 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e061830b-3254-48ae-900b-f42f7318e02e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:00.226009 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e061830b-3254-48ae-900b-f42f7318e02e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:00.227685 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e061830b-3254-48ae-900b-f42f7318e02e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:00.228313 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e061830b-3254-48ae-900b-f42f7318e02e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:00.229185 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e061830b-3254-48ae-900b-f42f7318e02e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:00.268485 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-eecddcb9-fee8-4335-82d3-a9ad3d1a30b0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:00.280823 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-eecddcb9-fee8-4335-82d3-a9ad3d1a30b0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2" status: 200 len: 1717 microversion: 2.1 time: 0.310077 Oct 18 15:29:00.281769 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 549/1129] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:28:59 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2 => generated 1717 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:00.288070 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-13cbace8-5909-4eb6-8481-335a649781fd tempest-HypervisorAdminNegativeUnderV252Test-1549984706 tempest-HypervisorAdminNegativeUnderV252Test-1549984706-project] Calling method '.version_select at 0x7f7c3d1388b0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:00.290976 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-13cbace8-5909-4eb6-8481-335a649781fd tempest-HypervisorAdminNegativeUnderV252Test-1549984706 tempest-HypervisorAdminNegativeUnderV252Test-1549984706-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'dd6401a331a445d09d92f1a5599efc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21166266984fc98bec26ea9147909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:00.293258 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-13cbace8-5909-4eb6-8481-335a649781fd tempest-HypervisorAdminNegativeUnderV252Test-1549984706 tempest-HypervisorAdminNegativeUnderV252Test-1549984706-project] Request method failure captured: Oct 18 15:29:00.293258 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 18 15:29:00.293258 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:29:00.293258 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:29:00.293258 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:29:00.293258 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:29:00.293258 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:29:00.293258 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:29:00.293258 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:29:00.293258 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:29:00.293258 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsY4MwPjCaFcmvvgEjWEeJrUxWjpc-fRywFPp5_YkgLTDbzxXyHZXE6GwFYEzKW8oWkt1zx6MYvsGKgjL18aBzh_V_E-R2v-dpuac_vhlef_R69muWIn2ly5gbwrsoK4bk7xeJg3TcHwnOb4je2XNmI5kRRIeYgDTDJKZkY4VUltFw8 Oct 18 15:29:00.293258 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:29:00.293258 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:29:00.293258 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:29:00.293258 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:29:00.293258 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:29:00.293258 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:29:00.293258 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 9a21166266984fc98bec26ea9147909f Oct 18 15:29:00.293258 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1549984706 Oct 18 15:29:00.293258 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:29:00.293258 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:29:00.294823 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9a21166266984fc98bec26ea9147909f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9a21166266984fc98bec26ea9147909f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9a21166266984fc98bec26ea9147909f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9a21166266984fc98bec26ea9147909f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:29:00.294823 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1549984706 Oct 18 15:29:00.294823 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 9a21166266984fc98bec26ea9147909f Oct 18 15:29:00.294823 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1549984706 Oct 18 15:29:00.294823 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1549984706-project Oct 18 15:29:00.294823 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:29:00.294823 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:29:00.294823 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: dd6401a331a445d09d92f1a5599efc00 Oct 18 15:29:00.294823 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1549984706-project Oct 18 15:29:00.294823 n-d-853682-5 devstack@n-api.service[120405]: method: Oct 18 15:29:00.294823 n-d-853682-5 devstack@n-api.service[120405]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 18 15:29:00.294823 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '1'} Oct 18 15:29:00.295583 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:29:00.295583 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:29:00.295583 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:29:00.295583 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:29:00.295583 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:29:00.295583 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:29:00.295583 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:29:00.295583 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:29:00.295583 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:29:00.295583 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:29:00.295583 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 18 15:29:00.295583 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 18 15:29:00.295583 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 15:29:00.295583 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 15:29:00.295583 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 15:29:00.295583 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 15:29:00.295583 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 15:29:00.295583 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 15:29:00.295583 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 15:29:00.296989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 15:29:00.296989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 15:29:00.296989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 15:29:00.296989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 15:29:00.296989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 15:29:00.296989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 15:29:00.296989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 15:29:00.296989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 18 15:29:00.296989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:29:00.296989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:29:00.296989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:29:00.296989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:29:00.296989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:29:00.296989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:29:00.296989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 15:29:00.296989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 15:29:00.296989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 18 15:29:00.296989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:29:00.299440 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-13cbace8-5909-4eb6-8481-335a649781fd tempest-HypervisorAdminNegativeUnderV252Test-1549984706 tempest-HypervisorAdminNegativeUnderV252Test-1549984706-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:29:00.300491 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-13cbace8-5909-4eb6-8481-335a649781fd tempest-HypervisorAdminNegativeUnderV252Test-1549984706 tempest-HypervisorAdminNegativeUnderV252Test-1549984706-project] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.017797 Oct 18 15:29:00.301619 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 550/1130] 10.222.0.60 () {58 vars in 1176 bytes} [Tue Oct 18 15:29:00 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:29:00.326605 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-27d76fda-5a96-4083-aa65-d39612d04c33 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d15c3a0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:00.376450 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-27d76fda-5a96-4083-aa65-d39612d04c33 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/55cd5e90-ef2b-4aec-a711-c27fc895dbba" status: 200 len: 1411 microversion: 2.1 time: 0.073535 Oct 18 15:29:00.377803 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 551/1131] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:29:00 2022] GET /compute/v2.1/images/55cd5e90-ef2b-4aec-a711-c27fc895dbba => generated 1411 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:00.383202 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f42f7a89-101d-4c4e-93a8-b30089320692 tempest-HypervisorAdminNegativeUnderV252Test-136149023 tempest-HypervisorAdminNegativeUnderV252Test-136149023-project-admin] Calling method '.version_select at 0x7f7c3d33dd30>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:00.385750 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f42f7a89-101d-4c4e-93a8-b30089320692 tempest-HypervisorAdminNegativeUnderV252Test-136149023 tempest-HypervisorAdminNegativeUnderV252Test-136149023-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:00.386324 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f42f7a89-101d-4c4e-93a8-b30089320692 tempest-HypervisorAdminNegativeUnderV252Test-136149023 tempest-HypervisorAdminNegativeUnderV252Test-136149023-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:00.386930 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f42f7a89-101d-4c4e-93a8-b30089320692 tempest-HypervisorAdminNegativeUnderV252Test-136149023 tempest-HypervisorAdminNegativeUnderV252Test-136149023-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:00.393784 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-f42f7a89-101d-4c4e-93a8-b30089320692 tempest-HypervisorAdminNegativeUnderV252Test-136149023 tempest-HypervisorAdminNegativeUnderV252Test-136149023-project-admin] HTTP exception thrown: No hypervisor matching '637694ce-a86f-46d1-bedc-524c5052397a' could be found. Oct 18 15:29:00.395416 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f42f7a89-101d-4c4e-93a8-b30089320692 tempest-HypervisorAdminNegativeUnderV252Test-136149023 tempest-HypervisorAdminNegativeUnderV252Test-136149023-project-admin] Request method failure captured: Oct 18 15:29:00.395416 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/os-hypervisors/637694ce-a86f-46d1-bedc-524c5052397a/servers HTTP/1.1 Oct 18 15:29:00.395416 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:29:00.395416 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:29:00.395416 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:29:00.395416 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:29:00.395416 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:29:00.395416 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:29:00.395416 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:29:00.395416 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:29:00.395416 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsY5u8_S4gVjePiLOndHhNlhgzc4DqEapNiOYz4X5ZS5KQcWolviD74ePRwDFAIdAPEao_-QtQ0jpqhtMx7bGwwdFW0E30gCiQExKnvvZv1GwMkVjRF6mWapFClEYunDogA98eqHlJy6gJ-8JlTM-UiDgoGYHfrg5c3qJVE6Ggeb2MM Oct 18 15:29:00.395416 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:29:00.395416 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:29:00.395416 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:29:00.395416 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:29:00.395416 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:29:00.395416 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:29:00.395416 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 814b28f96e444f2cb4ebe21ce3a84604 Oct 18 15:29:00.395416 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-136149023 Oct 18 15:29:00.395416 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,admin,reader Oct 18 15:29:00.395416 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,admin,reader Oct 18 15:29:00.397670 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/814b28f96e444f2cb4ebe21ce3a84604"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/814b28f96e444f2cb4ebe21ce3a84604"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/814b28f96e444f2cb4ebe21ce3a84604"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_814b28f96e444f2cb4ebe21ce3a84604"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:29:00.397670 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-136149023 Oct 18 15:29:00.397670 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 814b28f96e444f2cb4ebe21ce3a84604 Oct 18 15:29:00.397670 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-136149023 Oct 18 15:29:00.397670 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-136149023-project-admin Oct 18 15:29:00.397670 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:29:00.397670 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:29:00.397670 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 7603bbfd94e644898c64833a0d31c630 Oct 18 15:29:00.397670 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-136149023-project-admin Oct 18 15:29:00.397670 n-d-853682-5 devstack@n-api.service[120405]: method: Oct 18 15:29:00.397670 n-d-853682-5 devstack@n-api.service[120405]: exception: No hypervisor matching '637694ce-a86f-46d1-bedc-524c5052397a' could be found. Oct 18 15:29:00.397670 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '637694ce-a86f-46d1-bedc-524c5052397a'} Oct 18 15:29:00.398404 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:29:00.398404 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:29:00.398404 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:29:00.398404 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:29:00.398404 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:29:00.398404 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:29:00.398404 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:29:00.398404 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:29:00.398404 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:29:00.398404 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:29:00.398404 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 18 15:29:00.398404 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 18 15:29:00.398404 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 18 15:29:00.398404 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 18 15:29:00.398404 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '637694ce-a86f-46d1-bedc-524c5052397a' could be found. Oct 18 15:29:00.398404 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:29:00.398404 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:29:00.398404 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:29:00.398404 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:29:00.405076 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:29:00.405076 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:29:00.405076 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:29:00.405076 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:29:00.405076 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '637694ce-a86f-46d1-bedc-524c5052397a' could be found. Oct 18 15:29:00.405076 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:29:00.405076 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f42f7a89-101d-4c4e-93a8-b30089320692 tempest-HypervisorAdminNegativeUnderV252Test-136149023 tempest-HypervisorAdminNegativeUnderV252Test-136149023-project-admin] Returning 404 to user: No hypervisor matching '637694ce-a86f-46d1-bedc-524c5052397a' could be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:29:00.405076 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f42f7a89-101d-4c4e-93a8-b30089320692 tempest-HypervisorAdminNegativeUnderV252Test-136149023 tempest-HypervisorAdminNegativeUnderV252Test-136149023-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/637694ce-a86f-46d1-bedc-524c5052397a/servers" status: 404 len: 123 microversion: 2.1 time: 0.018617 Oct 18 15:29:00.405076 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 552/1132] 10.222.0.60 () {58 vars in 1281 bytes} [Tue Oct 18 15:29:00 2022] GET /compute/v2.1/os-hypervisors/637694ce-a86f-46d1-bedc-524c5052397a/servers => generated 123 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:29:00.412002 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-15a52da6-c281-403a-94aa-25a758efd234 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:00.413413 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-15a52da6-c281-403a-94aa-25a758efd234 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:00.421923 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-15a52da6-c281-403a-94aa-25a758efd234 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:00.422750 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-15a52da6-c281-403a-94aa-25a758efd234 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:00.423512 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-15a52da6-c281-403a-94aa-25a758efd234 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:00.424398 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-15a52da6-c281-403a-94aa-25a758efd234 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:00.425105 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-15a52da6-c281-403a-94aa-25a758efd234 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:00.425690 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-15a52da6-c281-403a-94aa-25a758efd234 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:00.431407 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:29:00.555851 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e061830b-3254-48ae-900b-f42f7318e02e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:00.572741 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e061830b-3254-48ae-900b-f42f7318e02e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:00.577140 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e061830b-3254-48ae-900b-f42f7318e02e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:00.593468 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e061830b-3254-48ae-900b-f42f7318e02e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1537 microversion: 2.91 time: 0.383504 Oct 18 15:29:00.594330 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 581/1133] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:00 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1537 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:00.711319 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-15a52da6-c281-403a-94aa-25a758efd234 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:00.722378 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-15a52da6-c281-403a-94aa-25a758efd234 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:00.733204 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-15a52da6-c281-403a-94aa-25a758efd234 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:00.734600 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-15a52da6-c281-403a-94aa-25a758efd234 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 1850 microversion: 2.42 time: 0.334746 Oct 18 15:29:00.735195 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 553/1134] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:00 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 1850 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:00.902105 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3b10dc7a-2718-44c0-8acd-91dca7024c2b tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:00.903038 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3b10dc7a-2718-44c0-8acd-91dca7024c2b tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:00.909889 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b10dc7a-2718-44c0-8acd-91dca7024c2b tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:00.910800 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b10dc7a-2718-44c0-8acd-91dca7024c2b tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:00.911708 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b10dc7a-2718-44c0-8acd-91dca7024c2b tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:00.913955 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b10dc7a-2718-44c0-8acd-91dca7024c2b tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:00.914693 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b10dc7a-2718-44c0-8acd-91dca7024c2b tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:00.915959 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b10dc7a-2718-44c0-8acd-91dca7024c2b tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:00.952537 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4a919aed-0a7a-4ec6-9889-c42ae9d71fd3 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:00.953954 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4a919aed-0a7a-4ec6-9889-c42ae9d71fd3 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: bd6231eb-95a4-465e-a859-077a7f82f585] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:00.965579 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4a919aed-0a7a-4ec6-9889-c42ae9d71fd3 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:00.966276 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4a919aed-0a7a-4ec6-9889-c42ae9d71fd3 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:00.966998 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4a919aed-0a7a-4ec6-9889-c42ae9d71fd3 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:00.977864 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4a919aed-0a7a-4ec6-9889-c42ae9d71fd3 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:00.978364 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4a919aed-0a7a-4ec6-9889-c42ae9d71fd3 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:00.978809 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4a919aed-0a7a-4ec6-9889-c42ae9d71fd3 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:01.183067 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3b10dc7a-2718-44c0-8acd-91dca7024c2b tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:01.193450 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3b10dc7a-2718-44c0-8acd-91dca7024c2b tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62" status: 200 len: 1316 microversion: 2.1 time: 0.297523 Oct 18 15:29:01.196087 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 582/1135] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:00 2022] GET /compute/v2.1/servers/f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62 => generated 1316 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:01.258155 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4a919aed-0a7a-4ec6-9889-c42ae9d71fd3 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1023300147f463e8f0894981948f825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac07f1b2c83a4faab175a5b9ed8e315e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:01.307130 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5eb399a6-97f4-4c3b-996a-e86531a43c87 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:01.308237 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5eb399a6-97f4-4c3b-996a-e86531a43c87 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:01.316347 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4a919aed-0a7a-4ec6-9889-c42ae9d71fd3 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585" status: 200 len: 1317 microversion: 2.1 time: 0.364976 Oct 18 15:29:01.317063 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 554/1136] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:00 2022] GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585 => generated 1317 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:29:01.331813 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5eb399a6-97f4-4c3b-996a-e86531a43c87 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:01.332742 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5eb399a6-97f4-4c3b-996a-e86531a43c87 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:01.333719 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5eb399a6-97f4-4c3b-996a-e86531a43c87 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:01.339259 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5eb399a6-97f4-4c3b-996a-e86531a43c87 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:01.340277 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5eb399a6-97f4-4c3b-996a-e86531a43c87 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:01.341011 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5eb399a6-97f4-4c3b-996a-e86531a43c87 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:01.394086 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2b409a22-99d5-4dc1-9ce7-42836c837390 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d37a790>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:01.468478 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2b409a22-99d5-4dc1-9ce7-42836c837390 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/55cd5e90-ef2b-4aec-a711-c27fc895dbba" status: 200 len: 1411 microversion: 2.1 time: 0.079322 Oct 18 15:29:01.469528 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 555/1137] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:29:01 2022] GET /compute/v2.1/images/55cd5e90-ef2b-4aec-a711-c27fc895dbba => generated 1411 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:01.625921 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-243fb6d8-ff09-4d80-a49a-bc757b50cb1f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:01.626716 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-243fb6d8-ff09-4d80-a49a-bc757b50cb1f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:01.633929 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-243fb6d8-ff09-4d80-a49a-bc757b50cb1f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:01.634989 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-243fb6d8-ff09-4d80-a49a-bc757b50cb1f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:01.635434 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-243fb6d8-ff09-4d80-a49a-bc757b50cb1f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:01.636182 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-243fb6d8-ff09-4d80-a49a-bc757b50cb1f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:01.639137 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-243fb6d8-ff09-4d80-a49a-bc757b50cb1f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:01.639608 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-243fb6d8-ff09-4d80-a49a-bc757b50cb1f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:01.885919 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-243fb6d8-ff09-4d80-a49a-bc757b50cb1f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:01.895238 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-243fb6d8-ff09-4d80-a49a-bc757b50cb1f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:01.897010 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-243fb6d8-ff09-4d80-a49a-bc757b50cb1f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:01.902831 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-243fb6d8-ff09-4d80-a49a-bc757b50cb1f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1537 microversion: 2.91 time: 0.281065 Oct 18 15:29:01.903956 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 556/1138] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:01 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1537 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:01.918010 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6009011b-cf0a-4ad8-b914-db6a21046d87 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:01.920617 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6009011b-cf0a-4ad8-b914-db6a21046d87 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:01.933565 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6009011b-cf0a-4ad8-b914-db6a21046d87 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:01.934208 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6009011b-cf0a-4ad8-b914-db6a21046d87 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:01.934741 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6009011b-cf0a-4ad8-b914-db6a21046d87 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:01.935657 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6009011b-cf0a-4ad8-b914-db6a21046d87 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:01.936212 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6009011b-cf0a-4ad8-b914-db6a21046d87 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:01.936645 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6009011b-cf0a-4ad8-b914-db6a21046d87 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:02.143576 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5eb399a6-97f4-4c3b-996a-e86531a43c87 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:02.158797 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5eb399a6-97f4-4c3b-996a-e86531a43c87 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2" status: 200 len: 1717 microversion: 2.1 time: 0.855603 Oct 18 15:29:02.166559 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 583/1139] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:01 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2 => generated 1717 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:02.172028 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-3485ca80-d501-431c-b930-66428d7a0687 req-f0abe1d5-9665-428f-b8dc-c4496b8a3090 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23bdadc4-6faa-4e55-8daf-eef04dd34a8a", "tag": "65d90ee5-e161-439c-956f-7f6040e4c2c0"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:29:02.189549 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3485ca80-d501-431c-b930-66428d7a0687 req-f0abe1d5-9665-428f-b8dc-c4496b8a3090 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:02.190214 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3485ca80-d501-431c-b930-66428d7a0687 req-f0abe1d5-9665-428f-b8dc-c4496b8a3090 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:02.190811 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3485ca80-d501-431c-b930-66428d7a0687 req-f0abe1d5-9665-428f-b8dc-c4496b8a3090 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:02.240846 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-3485ca80-d501-431c-b930-66428d7a0687 req-f0abe1d5-9665-428f-b8dc-c4496b8a3090 service nova] Creating event network-changed:65d90ee5-e161-439c-956f-7f6040e4c2c0 for instance 23bdadc4-6faa-4e55-8daf-eef04dd34a8a on n-h2-853682-5 Oct 18 15:29:02.249809 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-3485ca80-d501-431c-b930-66428d7a0687 req-f0abe1d5-9665-428f-b8dc-c4496b8a3090 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081889 Oct 18 15:29:02.251771 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 584/1140] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:29:02.263834 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-50398c54-fa6a-4b5d-a8a1-49738c719ccb tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:02.264544 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-50398c54-fa6a-4b5d-a8a1-49738c719ccb tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:02.272902 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50398c54-fa6a-4b5d-a8a1-49738c719ccb tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:02.273402 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50398c54-fa6a-4b5d-a8a1-49738c719ccb tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:02.274000 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50398c54-fa6a-4b5d-a8a1-49738c719ccb tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:02.274866 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50398c54-fa6a-4b5d-a8a1-49738c719ccb tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:02.275335 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50398c54-fa6a-4b5d-a8a1-49738c719ccb tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:02.275764 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50398c54-fa6a-4b5d-a8a1-49738c719ccb tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:02.360898 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6009011b-cf0a-4ad8-b914-db6a21046d87 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:02.370622 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6009011b-cf0a-4ad8-b914-db6a21046d87 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:02.372571 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6009011b-cf0a-4ad8-b914-db6a21046d87 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:02.382144 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6009011b-cf0a-4ad8-b914-db6a21046d87 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 1871 microversion: 2.42 time: 0.468153 Oct 18 15:29:02.385518 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 557/1141] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:01 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 1871 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:02.392386 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9a0f9e3a-5359-444b-a58f-0ca9bc2e44cf tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:02.393293 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9a0f9e3a-5359-444b-a58f-0ca9bc2e44cf tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: bd6231eb-95a4-465e-a859-077a7f82f585] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:02.410524 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9a0f9e3a-5359-444b-a58f-0ca9bc2e44cf tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:02.411044 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9a0f9e3a-5359-444b-a58f-0ca9bc2e44cf tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:02.414514 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9a0f9e3a-5359-444b-a58f-0ca9bc2e44cf tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:02.415386 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9a0f9e3a-5359-444b-a58f-0ca9bc2e44cf tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:02.416481 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9a0f9e3a-5359-444b-a58f-0ca9bc2e44cf tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:02.416959 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9a0f9e3a-5359-444b-a58f-0ca9bc2e44cf tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:02.676544 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-50398c54-fa6a-4b5d-a8a1-49738c719ccb tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:02.688787 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-50398c54-fa6a-4b5d-a8a1-49738c719ccb tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62" status: 200 len: 1316 microversion: 2.1 time: 0.429074 Oct 18 15:29:02.689635 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 585/1142] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:02 2022] GET /compute/v2.1/servers/f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62 => generated 1316 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:02.701211 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9dd252f8-502d-40ac-b5f5-1833315d67db tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d96edc0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:02.770894 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9dd252f8-502d-40ac-b5f5-1833315d67db tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/55cd5e90-ef2b-4aec-a711-c27fc895dbba" status: 200 len: 1411 microversion: 2.1 time: 0.079950 Oct 18 15:29:02.771910 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 586/1143] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:29:02 2022] GET /compute/v2.1/images/55cd5e90-ef2b-4aec-a711-c27fc895dbba => generated 1411 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:02.838780 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9a0f9e3a-5359-444b-a58f-0ca9bc2e44cf tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1023300147f463e8f0894981948f825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac07f1b2c83a4faab175a5b9ed8e315e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:02.852758 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9a0f9e3a-5359-444b-a58f-0ca9bc2e44cf tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585" status: 200 len: 1317 microversion: 2.1 time: 0.461507 Oct 18 15:29:02.856229 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 558/1144] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:02 2022] GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585 => generated 1317 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:02.936646 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bee34334-bca2-4916-9713-27c3ab5be599 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:02.937295 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bee34334-bca2-4916-9713-27c3ab5be599 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:02.950871 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=98 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:29:02.964932 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bee34334-bca2-4916-9713-27c3ab5be599 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:02.967248 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bee34334-bca2-4916-9713-27c3ab5be599 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:02.967692 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bee34334-bca2-4916-9713-27c3ab5be599 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:02.968408 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bee34334-bca2-4916-9713-27c3ab5be599 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:02.968895 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bee34334-bca2-4916-9713-27c3ab5be599 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:02.969319 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bee34334-bca2-4916-9713-27c3ab5be599 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:03.140244 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bee34334-bca2-4916-9713-27c3ab5be599 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:03.156418 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bee34334-bca2-4916-9713-27c3ab5be599 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:03.161679 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bee34334-bca2-4916-9713-27c3ab5be599 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:03.177360 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bee34334-bca2-4916-9713-27c3ab5be599 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1537 microversion: 2.91 time: 0.243575 Oct 18 15:29:03.180799 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 587/1145] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:02 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1537 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:03.197464 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-848da267-1f7f-420c-932f-59843f631e7f tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:03.198298 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-848da267-1f7f-420c-932f-59843f631e7f tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:03.207039 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-848da267-1f7f-420c-932f-59843f631e7f tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:03.208230 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-848da267-1f7f-420c-932f-59843f631e7f tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:03.209720 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-848da267-1f7f-420c-932f-59843f631e7f tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:03.210667 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-848da267-1f7f-420c-932f-59843f631e7f tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:03.212154 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-848da267-1f7f-420c-932f-59843f631e7f tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:03.213095 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-848da267-1f7f-420c-932f-59843f631e7f tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:03.418236 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-675f2247-ae53-41dd-9ea9-8d252ba5ec1f tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:03.419221 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-675f2247-ae53-41dd-9ea9-8d252ba5ec1f tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:03.436430 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-675f2247-ae53-41dd-9ea9-8d252ba5ec1f tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:03.441108 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-675f2247-ae53-41dd-9ea9-8d252ba5ec1f tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:03.441691 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-675f2247-ae53-41dd-9ea9-8d252ba5ec1f tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:03.442561 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-675f2247-ae53-41dd-9ea9-8d252ba5ec1f tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:03.445779 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-675f2247-ae53-41dd-9ea9-8d252ba5ec1f tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:03.446424 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-675f2247-ae53-41dd-9ea9-8d252ba5ec1f tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:03.606789 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-848da267-1f7f-420c-932f-59843f631e7f tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:03.623483 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-848da267-1f7f-420c-932f-59843f631e7f tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2" status: 200 len: 1717 microversion: 2.1 time: 0.433484 Oct 18 15:29:03.626502 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 559/1146] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:03 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2 => generated 1717 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:03.717643 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7470958e-30a0-4811-8ae1-106cae5a15f2 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:03.718516 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7470958e-30a0-4811-8ae1-106cae5a15f2 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:03.727602 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7470958e-30a0-4811-8ae1-106cae5a15f2 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:03.728297 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7470958e-30a0-4811-8ae1-106cae5a15f2 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:03.733327 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7470958e-30a0-4811-8ae1-106cae5a15f2 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:03.734315 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7470958e-30a0-4811-8ae1-106cae5a15f2 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:03.734958 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7470958e-30a0-4811-8ae1-106cae5a15f2 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:03.735551 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7470958e-30a0-4811-8ae1-106cae5a15f2 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:04.203271 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-675f2247-ae53-41dd-9ea9-8d252ba5ec1f tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:04.225785 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-675f2247-ae53-41dd-9ea9-8d252ba5ec1f tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:04.241347 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-675f2247-ae53-41dd-9ea9-8d252ba5ec1f tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:04.243823 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-675f2247-ae53-41dd-9ea9-8d252ba5ec1f tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 1892 microversion: 2.42 time: 0.830206 Oct 18 15:29:04.247313 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 588/1147] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:03 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 1892 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:04.253351 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6dc109e6-6e39-4f85-9f29-dc0cce106b59 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d1724c0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:04.354296 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6dc109e6-6e39-4f85-9f29-dc0cce106b59 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/55cd5e90-ef2b-4aec-a711-c27fc895dbba" status: 200 len: 1411 microversion: 2.1 time: 0.104077 Oct 18 15:29:04.354889 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 589/1148] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:29:04 2022] GET /compute/v2.1/images/55cd5e90-ef2b-4aec-a711-c27fc895dbba => generated 1411 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:04.372143 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e814c180-761b-48dd-8a45-497807ed0454 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:04.373066 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e814c180-761b-48dd-8a45-497807ed0454 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: bd6231eb-95a4-465e-a859-077a7f82f585] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:04.390034 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e814c180-761b-48dd-8a45-497807ed0454 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:04.391095 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e814c180-761b-48dd-8a45-497807ed0454 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:04.391724 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e814c180-761b-48dd-8a45-497807ed0454 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:04.395317 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e814c180-761b-48dd-8a45-497807ed0454 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:04.395968 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e814c180-761b-48dd-8a45-497807ed0454 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:04.397160 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e814c180-761b-48dd-8a45-497807ed0454 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:04.495154 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7470958e-30a0-4811-8ae1-106cae5a15f2 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:04.509862 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7470958e-30a0-4811-8ae1-106cae5a15f2 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62" status: 200 len: 1316 microversion: 2.1 time: 0.796073 Oct 18 15:29:04.526056 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 560/1149] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:03 2022] GET /compute/v2.1/servers/f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62 => generated 1316 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:04.533717 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-78097484-fb9c-44f5-b70d-963347e125ca tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:04.534607 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-78097484-fb9c-44f5-b70d-963347e125ca tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:04.541968 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-78097484-fb9c-44f5-b70d-963347e125ca tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:04.542463 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-78097484-fb9c-44f5-b70d-963347e125ca tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:04.542897 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-78097484-fb9c-44f5-b70d-963347e125ca tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:04.543599 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-78097484-fb9c-44f5-b70d-963347e125ca tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:04.544055 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-78097484-fb9c-44f5-b70d-963347e125ca tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:04.544471 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-78097484-fb9c-44f5-b70d-963347e125ca tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:04.752842 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-78097484-fb9c-44f5-b70d-963347e125ca tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:04.789946 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-78097484-fb9c-44f5-b70d-963347e125ca tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:04.795793 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-78097484-fb9c-44f5-b70d-963347e125ca tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:04.824206 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-78097484-fb9c-44f5-b70d-963347e125ca tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1480 microversion: 2.91 time: 0.296666 Oct 18 15:29:04.829946 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 561/1150] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:04 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1480 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:04.844120 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-9b9cf5a8-227f-417a-a48b-7de4c417a539 req-8dc67a22-b188-4faf-ae25-d3a02d697458 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23bdadc4-6faa-4e55-8daf-eef04dd34a8a", "tag": "76b7ba58-dbc1-487b-a62e-3d7ee373767c"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:29:04.871886 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-9b9cf5a8-227f-417a-a48b-7de4c417a539 req-8dc67a22-b188-4faf-ae25-d3a02d697458 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:04.875965 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-9b9cf5a8-227f-417a-a48b-7de4c417a539 req-8dc67a22-b188-4faf-ae25-d3a02d697458 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:04.876414 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-9b9cf5a8-227f-417a-a48b-7de4c417a539 req-8dc67a22-b188-4faf-ae25-d3a02d697458 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:04.909474 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-9b9cf5a8-227f-417a-a48b-7de4c417a539 req-8dc67a22-b188-4faf-ae25-d3a02d697458 service nova] Creating event network-changed:76b7ba58-dbc1-487b-a62e-3d7ee373767c for instance 23bdadc4-6faa-4e55-8daf-eef04dd34a8a on n-h2-853682-5 Oct 18 15:29:04.923638 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-9b9cf5a8-227f-417a-a48b-7de4c417a539 req-8dc67a22-b188-4faf-ae25-d3a02d697458 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092013 Oct 18 15:29:04.929612 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 562/1151] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:29:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:29:04.940104 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-05fb415d-7d03-4fe0-969f-1bb2c3ff52a3 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:04.942014 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-05fb415d-7d03-4fe0-969f-1bb2c3ff52a3 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:04.955640 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-05fb415d-7d03-4fe0-969f-1bb2c3ff52a3 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:04.962070 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-05fb415d-7d03-4fe0-969f-1bb2c3ff52a3 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:04.962751 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-05fb415d-7d03-4fe0-969f-1bb2c3ff52a3 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:04.963759 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-05fb415d-7d03-4fe0-969f-1bb2c3ff52a3 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:04.964440 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-05fb415d-7d03-4fe0-969f-1bb2c3ff52a3 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:04.968073 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-05fb415d-7d03-4fe0-969f-1bb2c3ff52a3 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:05.070472 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e814c180-761b-48dd-8a45-497807ed0454 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1023300147f463e8f0894981948f825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac07f1b2c83a4faab175a5b9ed8e315e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:05.078865 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e814c180-761b-48dd-8a45-497807ed0454 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585" status: 200 len: 1317 microversion: 2.1 time: 0.720846 Oct 18 15:29:05.095383 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 590/1152] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:04 2022] GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585 => generated 1317 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:05.107213 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a5e91367-a58d-4f69-a96a-9ac756e7c958 tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-853682-5"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:29:05.115991 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a5e91367-a58d-4f69-a96a-9ac756e7c958 tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:05.134283 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5e91367-a58d-4f69-a96a-9ac756e7c958 tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:05.134796 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5e91367-a58d-4f69-a96a-9ac756e7c958 tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:05.135255 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5e91367-a58d-4f69-a96a-9ac756e7c958 tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:05.136338 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5e91367-a58d-4f69-a96a-9ac756e7c958 tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:05.136834 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5e91367-a58d-4f69-a96a-9ac756e7c958 tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:05.137257 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5e91367-a58d-4f69-a96a-9ac756e7c958 tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:05.313914 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a5e91367-a58d-4f69-a96a-9ac756e7c958 tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-853682-5". {{(pid=120406) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 18 15:29:05.413442 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:29:05.444857 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-05fb415d-7d03-4fe0-969f-1bb2c3ff52a3 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:05.457911 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-05fb415d-7d03-4fe0-969f-1bb2c3ff52a3 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2" status: 200 len: 1717 microversion: 2.1 time: 0.526588 Oct 18 15:29:05.458500 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 563/1153] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:04 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2 => generated 1717 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:05.472523 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a5e91367-a58d-4f69-a96a-9ac756e7c958 tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617/action" status: 202 len: 0 microversion: 2.91 time: 0.377110 Oct 18 15:29:05.474857 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-19d6ffb3-9bcd-4976-8260-34b99e3e93dc tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:05.477627 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 591/1154] 10.222.0.60 () {62 vars in 1319 bytes} [Tue Oct 18 15:29:05 2022] POST /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617/action => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:29:05.481835 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-19d6ffb3-9bcd-4976-8260-34b99e3e93dc tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:05.510064 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-19d6ffb3-9bcd-4976-8260-34b99e3e93dc tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:05.511036 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-19d6ffb3-9bcd-4976-8260-34b99e3e93dc tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:05.511842 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-19d6ffb3-9bcd-4976-8260-34b99e3e93dc tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:05.514917 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-19d6ffb3-9bcd-4976-8260-34b99e3e93dc tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:05.515854 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-19d6ffb3-9bcd-4976-8260-34b99e3e93dc tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:05.517526 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-19d6ffb3-9bcd-4976-8260-34b99e3e93dc tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:05.714352 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-949bc516-4c19-4a28-bd40-36bd178fe7cf tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-919591745", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:29:05.810067 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-949bc516-4c19-4a28-bd40-36bd178fe7cf tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] validate_networks() for None {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:29:06.453355 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-19d6ffb3-9bcd-4976-8260-34b99e3e93dc tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:06.487534 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-19d6ffb3-9bcd-4976-8260-34b99e3e93dc tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:06.495769 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-19d6ffb3-9bcd-4976-8260-34b99e3e93dc tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:06.497430 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-19d6ffb3-9bcd-4976-8260-34b99e3e93dc tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 1892 microversion: 2.42 time: 1.035170 Oct 18 15:29:06.502903 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 564/1155] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:05 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 1892 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:06.514144 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d49e02d5-e01c-463b-9044-c26dde682793 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d13df70>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:06.609754 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d49e02d5-e01c-463b-9044-c26dde682793 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/55cd5e90-ef2b-4aec-a711-c27fc895dbba" status: 200 len: 1411 microversion: 2.1 time: 0.105500 Oct 18 15:29:06.617057 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 565/1156] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:29:06 2022] GET /compute/v2.1/images/55cd5e90-ef2b-4aec-a711-c27fc895dbba => generated 1411 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:06.628446 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-95365d80-3c40-44d8-bc8f-31b11070834d tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:06.634294 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-95365d80-3c40-44d8-bc8f-31b11070834d tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:06.643656 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-949bc516-4c19-4a28-bd40-36bd178fe7cf tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:29:06.644217 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-949bc516-4c19-4a28-bd40-36bd178fe7cf tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:29:06.644890 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-949bc516-4c19-4a28-bd40-36bd178fe7cf tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:29:06.645401 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-949bc516-4c19-4a28-bd40-36bd178fe7cf tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:29:06.646538 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-949bc516-4c19-4a28-bd40-36bd178fe7cf tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:29:06.673199 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-95365d80-3c40-44d8-bc8f-31b11070834d tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:06.676040 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-95365d80-3c40-44d8-bc8f-31b11070834d tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:06.676747 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-95365d80-3c40-44d8-bc8f-31b11070834d tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:06.681305 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-95365d80-3c40-44d8-bc8f-31b11070834d tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:06.686795 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-949bc516-4c19-4a28-bd40-36bd178fe7cf tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:06.687027 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-95365d80-3c40-44d8-bc8f-31b11070834d tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:06.687684 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-95365d80-3c40-44d8-bc8f-31b11070834d tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:06.690520 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-949bc516-4c19-4a28-bd40-36bd178fe7cf tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:06.692612 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-949bc516-4c19-4a28-bd40-36bd178fe7cf tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:06.697597 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-949bc516-4c19-4a28-bd40-36bd178fe7cf tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:06.701403 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-949bc516-4c19-4a28-bd40-36bd178fe7cf tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:06.706202 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-949bc516-4c19-4a28-bd40-36bd178fe7cf tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:06.768979 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-949bc516-4c19-4a28-bd40-36bd178fe7cf tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Getting quotas for project 5df909cb429f46c39a83c29fb260b169. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:29:06.779417 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-949bc516-4c19-4a28-bd40-36bd178fe7cf tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Getting quotas for user ebe80f2ae3ec4365a031ca7472d76e33 and project 5df909cb429f46c39a83c29fb260b169. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:29:06.812006 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-949bc516-4c19-4a28-bd40-36bd178fe7cf tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:29:06.819079 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-949bc516-4c19-4a28-bd40-36bd178fe7cf tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] [instance: 5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:29:06.903319 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-95365d80-3c40-44d8-bc8f-31b11070834d tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:06.919852 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-95365d80-3c40-44d8-bc8f-31b11070834d tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:06.921524 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-95365d80-3c40-44d8-bc8f-31b11070834d tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:06.936751 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-95365d80-3c40-44d8-bc8f-31b11070834d tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1488 microversion: 2.91 time: 0.316589 Oct 18 15:29:06.942377 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 566/1157] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:06 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1488 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:06.945912 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-949bc516-4c19-4a28-bd40-36bd178fe7cf tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.467175 Oct 18 15:29:06.951980 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 592/1158] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:29:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1474 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:29:06.953501 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-76a2d79c-f36c-4d15-8a73-215e34af7c1c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:06.954432 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-76a2d79c-f36c-4d15-8a73-215e34af7c1c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:06.966026 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-00b8773d-f58e-4246-adf5-f6ca4193ed58 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:06.967829 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-00b8773d-f58e-4246-adf5-f6ca4193ed58 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: bd6231eb-95a4-465e-a859-077a7f82f585] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:06.982949 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00b8773d-f58e-4246-adf5-f6ca4193ed58 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:06.986328 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00b8773d-f58e-4246-adf5-f6ca4193ed58 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:06.988333 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00b8773d-f58e-4246-adf5-f6ca4193ed58 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:06.989391 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00b8773d-f58e-4246-adf5-f6ca4193ed58 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:06.992932 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00b8773d-f58e-4246-adf5-f6ca4193ed58 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:06.994186 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00b8773d-f58e-4246-adf5-f6ca4193ed58 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:07.002101 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-76a2d79c-f36c-4d15-8a73-215e34af7c1c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:07.005531 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-76a2d79c-f36c-4d15-8a73-215e34af7c1c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:07.013680 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-76a2d79c-f36c-4d15-8a73-215e34af7c1c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:07.016512 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-76a2d79c-f36c-4d15-8a73-215e34af7c1c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:07.018873 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-76a2d79c-f36c-4d15-8a73-215e34af7c1c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:07.023174 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-76a2d79c-f36c-4d15-8a73-215e34af7c1c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:07.405076 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-76a2d79c-f36c-4d15-8a73-215e34af7c1c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:07.423224 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-76a2d79c-f36c-4d15-8a73-215e34af7c1c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62" status: 200 len: 1316 microversion: 2.1 time: 0.478539 Oct 18 15:29:07.424009 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 567/1159] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:06 2022] GET /compute/v2.1/servers/f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62 => generated 1316 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:07.445938 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-00b8773d-f58e-4246-adf5-f6ca4193ed58 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1023300147f463e8f0894981948f825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac07f1b2c83a4faab175a5b9ed8e315e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:07.457169 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-00b8773d-f58e-4246-adf5-f6ca4193ed58 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585" status: 200 len: 1317 microversion: 2.1 time: 0.500813 Oct 18 15:29:07.466436 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-97fc4f95-984f-40af-af8f-eea0b0e5a013 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:07.467684 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-97fc4f95-984f-40af-af8f-eea0b0e5a013 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:07.482932 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97fc4f95-984f-40af-af8f-eea0b0e5a013 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:07.485310 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97fc4f95-984f-40af-af8f-eea0b0e5a013 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:07.486120 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97fc4f95-984f-40af-af8f-eea0b0e5a013 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:07.487683 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97fc4f95-984f-40af-af8f-eea0b0e5a013 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:07.490797 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 593/1160] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:06 2022] GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585 => generated 1317 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:07.491132 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97fc4f95-984f-40af-af8f-eea0b0e5a013 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:07.491695 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97fc4f95-984f-40af-af8f-eea0b0e5a013 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:07.530344 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4411834d-d957-4e6b-8736-2f49acaed23d tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:07.531567 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4411834d-d957-4e6b-8736-2f49acaed23d tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] [instance: 5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:07.665960 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4411834d-d957-4e6b-8736-2f49acaed23d tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe80f2ae3ec4365a031ca7472d76e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df909cb429f46c39a83c29fb260b169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:07.675363 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4411834d-d957-4e6b-8736-2f49acaed23d tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] 10.222.0.60 "GET /compute/v2.1/servers/5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38" status: 200 len: 1218 microversion: 2.1 time: 0.181988 Oct 18 15:29:07.693903 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 594/1161] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:07 2022] GET /compute/v2.1/servers/5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38 => generated 1218 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:07.714297 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-8155caaf-f167-4559-8977-bdc1205834b5 req-5c668511-001a-4762-af9d-6874b5485aac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23bdadc4-6faa-4e55-8daf-eef04dd34a8a", "tag": "44427cac-ace4-451a-be16-8086d2ad6d0e"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:29:07.743820 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8155caaf-f167-4559-8977-bdc1205834b5 req-5c668511-001a-4762-af9d-6874b5485aac service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:07.745322 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8155caaf-f167-4559-8977-bdc1205834b5 req-5c668511-001a-4762-af9d-6874b5485aac service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:07.745934 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8155caaf-f167-4559-8977-bdc1205834b5 req-5c668511-001a-4762-af9d-6874b5485aac service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:07.798609 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-8155caaf-f167-4559-8977-bdc1205834b5 req-5c668511-001a-4762-af9d-6874b5485aac service nova] Creating event network-changed:44427cac-ace4-451a-be16-8086d2ad6d0e for instance 23bdadc4-6faa-4e55-8daf-eef04dd34a8a on n-h2-853682-5 Oct 18 15:29:07.819688 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-8155caaf-f167-4559-8977-bdc1205834b5 req-5c668511-001a-4762-af9d-6874b5485aac service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121032 Oct 18 15:29:07.820658 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 595/1162] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:29:07.840675 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0fe1192e-d257-44cc-b11a-d3e2982ce347 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:07.846000 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0fe1192e-d257-44cc-b11a-d3e2982ce347 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:07.871050 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0fe1192e-d257-44cc-b11a-d3e2982ce347 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:07.871737 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0fe1192e-d257-44cc-b11a-d3e2982ce347 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:07.874488 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0fe1192e-d257-44cc-b11a-d3e2982ce347 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:07.875297 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0fe1192e-d257-44cc-b11a-d3e2982ce347 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:07.875836 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0fe1192e-d257-44cc-b11a-d3e2982ce347 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:07.880500 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0fe1192e-d257-44cc-b11a-d3e2982ce347 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:08.400802 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-97fc4f95-984f-40af-af8f-eea0b0e5a013 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:08.414535 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-97fc4f95-984f-40af-af8f-eea0b0e5a013 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2" status: 200 len: 1717 microversion: 2.1 time: 0.989625 Oct 18 15:29:08.417506 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 568/1163] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:07 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2 => generated 1717 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:08.429862 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3b0c4474-4820-4182-93e7-a0f31aa3e2b2 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d13dca0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:08.497684 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0fe1192e-d257-44cc-b11a-d3e2982ce347 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:08.512549 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3b0c4474-4820-4182-93e7-a0f31aa3e2b2 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/55cd5e90-ef2b-4aec-a711-c27fc895dbba" status: 200 len: 1411 microversion: 2.1 time: 0.093776 Oct 18 15:29:08.520566 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 569/1164] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:29:08 2022] GET /compute/v2.1/images/55cd5e90-ef2b-4aec-a711-c27fc895dbba => generated 1411 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:08.520711 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0fe1192e-d257-44cc-b11a-d3e2982ce347 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:08.520711 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0fe1192e-d257-44cc-b11a-d3e2982ce347 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:08.522327 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0fe1192e-d257-44cc-b11a-d3e2982ce347 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 1892 microversion: 2.42 time: 0.699550 Oct 18 15:29:08.523056 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 596/1165] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:07 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 1892 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:08.542412 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6ef01f47-c16b-435f-8a96-e0b349482a24 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:08.542868 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-22bff6b9-f0fe-4b44-bed4-3dfab4e2816d req-3d0b4d7b-21cb-4c56-ab83-95f3d2ed5428 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec3790f8-37cf-4e63-b753-83d38e982580", "name": "network-vif-plugged", "status": "completed", "tag": "b9fd6f98-f225-43c4-9891-632e489ce46e"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:29:08.560042 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6ef01f47-c16b-435f-8a96-e0b349482a24 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:08.568539 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-22bff6b9-f0fe-4b44-bed4-3dfab4e2816d req-3d0b4d7b-21cb-4c56-ab83-95f3d2ed5428 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:08.569052 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-22bff6b9-f0fe-4b44-bed4-3dfab4e2816d req-3d0b4d7b-21cb-4c56-ab83-95f3d2ed5428 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:08.569508 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-22bff6b9-f0fe-4b44-bed4-3dfab4e2816d req-3d0b4d7b-21cb-4c56-ab83-95f3d2ed5428 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:08.576605 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ef01f47-c16b-435f-8a96-e0b349482a24 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:08.577148 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ef01f47-c16b-435f-8a96-e0b349482a24 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:08.577586 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ef01f47-c16b-435f-8a96-e0b349482a24 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:08.578298 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ef01f47-c16b-435f-8a96-e0b349482a24 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:08.578756 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ef01f47-c16b-435f-8a96-e0b349482a24 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:08.579183 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ef01f47-c16b-435f-8a96-e0b349482a24 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:08.607881 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-22bff6b9-f0fe-4b44-bed4-3dfab4e2816d req-3d0b4d7b-21cb-4c56-ab83-95f3d2ed5428 service nova] Creating event network-vif-plugged:b9fd6f98-f225-43c4-9891-632e489ce46e for instance ec3790f8-37cf-4e63-b753-83d38e982580 on n-h2-853682-5 Oct 18 15:29:08.613737 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-22bff6b9-f0fe-4b44-bed4-3dfab4e2816d req-3d0b4d7b-21cb-4c56-ab83-95f3d2ed5428 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098897 Oct 18 15:29:08.614882 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 570/1166] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:29:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:29:08.622457 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3fc592d4-42c4-4829-834c-06e16547f2d9 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:08.624215 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3fc592d4-42c4-4829-834c-06e16547f2d9 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:08.631320 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=100 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:29:08.633323 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3fc592d4-42c4-4829-834c-06e16547f2d9 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:08.634036 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3fc592d4-42c4-4829-834c-06e16547f2d9 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:08.634645 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3fc592d4-42c4-4829-834c-06e16547f2d9 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:08.636664 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3fc592d4-42c4-4829-834c-06e16547f2d9 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:08.636664 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3fc592d4-42c4-4829-834c-06e16547f2d9 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:08.636664 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3fc592d4-42c4-4829-834c-06e16547f2d9 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:08.918425 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6ef01f47-c16b-435f-8a96-e0b349482a24 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:08.929131 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6ef01f47-c16b-435f-8a96-e0b349482a24 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:08.930568 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6ef01f47-c16b-435f-8a96-e0b349482a24 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:08.967041 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6ef01f47-c16b-435f-8a96-e0b349482a24 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1546 microversion: 2.91 time: 0.428658 Oct 18 15:29:08.969512 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 597/1167] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:08 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1546 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:08.994676 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-88094e20-6db5-4ca7-acae-61eb8630c21a tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:08.995809 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-88094e20-6db5-4ca7-acae-61eb8630c21a tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: bd6231eb-95a4-465e-a859-077a7f82f585] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:09.010699 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88094e20-6db5-4ca7-acae-61eb8630c21a tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:09.022382 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88094e20-6db5-4ca7-acae-61eb8630c21a tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:09.035203 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88094e20-6db5-4ca7-acae-61eb8630c21a tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:09.036217 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88094e20-6db5-4ca7-acae-61eb8630c21a tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:09.037619 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88094e20-6db5-4ca7-acae-61eb8630c21a tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:09.039280 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88094e20-6db5-4ca7-acae-61eb8630c21a tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:09.241310 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3fc592d4-42c4-4829-834c-06e16547f2d9 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:09.250942 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3fc592d4-42c4-4829-834c-06e16547f2d9 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62" status: 200 len: 1316 microversion: 2.1 time: 0.633579 Oct 18 15:29:09.252021 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 571/1168] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:08 2022] GET /compute/v2.1/servers/f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62 => generated 1316 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:09.260424 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-90d4f5f0-94f3-4a95-849b-113aef698e3b tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:09.261311 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-90d4f5f0-94f3-4a95-849b-113aef698e3b tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] [instance: 5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:09.268595 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-90d4f5f0-94f3-4a95-849b-113aef698e3b tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:09.274034 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-90d4f5f0-94f3-4a95-849b-113aef698e3b tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:09.275733 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-90d4f5f0-94f3-4a95-849b-113aef698e3b tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:09.279385 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-90d4f5f0-94f3-4a95-849b-113aef698e3b tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:09.280044 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-90d4f5f0-94f3-4a95-849b-113aef698e3b tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:09.280970 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-90d4f5f0-94f3-4a95-849b-113aef698e3b tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:09.348890 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-88094e20-6db5-4ca7-acae-61eb8630c21a tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1023300147f463e8f0894981948f825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac07f1b2c83a4faab175a5b9ed8e315e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:09.369881 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-88094e20-6db5-4ca7-acae-61eb8630c21a tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585" status: 200 len: 1317 microversion: 2.1 time: 0.398981 Oct 18 15:29:09.371733 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 598/1169] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:08 2022] GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585 => generated 1317 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:09.406508 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-90d4f5f0-94f3-4a95-849b-113aef698e3b tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe80f2ae3ec4365a031ca7472d76e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df909cb429f46c39a83c29fb260b169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:09.418874 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-90d4f5f0-94f3-4a95-849b-113aef698e3b tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] 10.222.0.60 "GET /compute/v2.1/servers/5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38" status: 200 len: 1270 microversion: 2.1 time: 0.163599 Oct 18 15:29:09.421118 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 572/1170] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:09 2022] GET /compute/v2.1/servers/5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38 => generated 1270 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:09.447331 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0cbbae63-18d6-46ae-b8a5-4cc9592e9724 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:09.447923 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0cbbae63-18d6-46ae-b8a5-4cc9592e9724 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:09.456036 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0cbbae63-18d6-46ae-b8a5-4cc9592e9724 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:09.456521 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0cbbae63-18d6-46ae-b8a5-4cc9592e9724 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:09.456982 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0cbbae63-18d6-46ae-b8a5-4cc9592e9724 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:09.457686 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0cbbae63-18d6-46ae-b8a5-4cc9592e9724 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:09.458136 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0cbbae63-18d6-46ae-b8a5-4cc9592e9724 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:09.458554 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0cbbae63-18d6-46ae-b8a5-4cc9592e9724 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:09.528112 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-cb1399b0-3cf8-48c2-87c1-e97b304546fd tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d16ae50>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:09.715807 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0cbbae63-18d6-46ae-b8a5-4cc9592e9724 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:09.732985 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0cbbae63-18d6-46ae-b8a5-4cc9592e9724 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2" status: 200 len: 1717 microversion: 2.1 time: 0.291752 Oct 18 15:29:09.748549 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 599/1171] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:09 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2 => generated 1717 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:09.756276 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a8728be4-5241-45f0-a8c1-c223d5266ee9 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:09.759728 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a8728be4-5241-45f0-a8c1-c223d5266ee9 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:09.781059 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8728be4-5241-45f0-a8c1-c223d5266ee9 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:09.786990 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8728be4-5241-45f0-a8c1-c223d5266ee9 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:09.790000 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8728be4-5241-45f0-a8c1-c223d5266ee9 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:09.791683 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8728be4-5241-45f0-a8c1-c223d5266ee9 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:09.792316 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8728be4-5241-45f0-a8c1-c223d5266ee9 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:09.792941 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8728be4-5241-45f0-a8c1-c223d5266ee9 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:10.324064 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a8728be4-5241-45f0-a8c1-c223d5266ee9 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:10.341829 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a8728be4-5241-45f0-a8c1-c223d5266ee9 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:10.343457 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a8728be4-5241-45f0-a8c1-c223d5266ee9 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:10.349131 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a8728be4-5241-45f0-a8c1-c223d5266ee9 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 1892 microversion: 2.42 time: 0.594893 Oct 18 15:29:10.357789 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 600/1172] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:09 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 1892 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:10.383500 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-6919a3fb-a414-46ef-a5cb-8d88627bf74b req-78167159-0537-4205-b9ad-baa62b6de1fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23bdadc4-6faa-4e55-8daf-eef04dd34a8a", "tag": "6ea5a9f2-9734-4014-8e33-f46906bf9bfb"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:29:10.394441 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6919a3fb-a414-46ef-a5cb-8d88627bf74b req-78167159-0537-4205-b9ad-baa62b6de1fb service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:10.395069 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6919a3fb-a414-46ef-a5cb-8d88627bf74b req-78167159-0537-4205-b9ad-baa62b6de1fb service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:10.395519 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6919a3fb-a414-46ef-a5cb-8d88627bf74b req-78167159-0537-4205-b9ad-baa62b6de1fb service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:10.408242 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-6919a3fb-a414-46ef-a5cb-8d88627bf74b req-78167159-0537-4205-b9ad-baa62b6de1fb service nova] Creating event network-changed:6ea5a9f2-9734-4014-8e33-f46906bf9bfb for instance 23bdadc4-6faa-4e55-8daf-eef04dd34a8a on n-h2-853682-5 Oct 18 15:29:10.434659 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-6919a3fb-a414-46ef-a5cb-8d88627bf74b req-78167159-0537-4205-b9ad-baa62b6de1fb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063282 Oct 18 15:29:10.435451 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 601/1173] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:29:10.457554 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ef890850-e6ab-4250-bd44-34b31db856d7 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:10.458150 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ef890850-e6ab-4250-bd44-34b31db856d7 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:10.495067 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ef890850-e6ab-4250-bd44-34b31db856d7 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:10.497411 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ef890850-e6ab-4250-bd44-34b31db856d7 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:10.498105 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ef890850-e6ab-4250-bd44-34b31db856d7 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:10.499062 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ef890850-e6ab-4250-bd44-34b31db856d7 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:10.501288 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ef890850-e6ab-4250-bd44-34b31db856d7 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:10.502032 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ef890850-e6ab-4250-bd44-34b31db856d7 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:10.680205 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ef890850-e6ab-4250-bd44-34b31db856d7 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:10.710050 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ef890850-e6ab-4250-bd44-34b31db856d7 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:10.712360 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ef890850-e6ab-4250-bd44-34b31db856d7 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:10.718277 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ef890850-e6ab-4250-bd44-34b31db856d7 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1546 microversion: 2.91 time: 0.281619 Oct 18 15:29:10.719812 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 602/1174] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:10 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1546 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:10.741094 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4327dff8-e8eb-467d-bc22-2b1195d32b9e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:10.741831 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4327dff8-e8eb-467d-bc22-2b1195d32b9e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:10.748345 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4327dff8-e8eb-467d-bc22-2b1195d32b9e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:10.748888 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4327dff8-e8eb-467d-bc22-2b1195d32b9e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:10.749552 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4327dff8-e8eb-467d-bc22-2b1195d32b9e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:10.750487 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4327dff8-e8eb-467d-bc22-2b1195d32b9e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:10.751113 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4327dff8-e8eb-467d-bc22-2b1195d32b9e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:10.751703 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4327dff8-e8eb-467d-bc22-2b1195d32b9e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:11.036994 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4327dff8-e8eb-467d-bc22-2b1195d32b9e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:11.048961 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4327dff8-e8eb-467d-bc22-2b1195d32b9e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62" status: 200 len: 1316 microversion: 2.1 time: 0.327398 Oct 18 15:29:11.080581 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 603/1175] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:10 2022] GET /compute/v2.1/servers/f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62 => generated 1316 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:11.096586 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f88c6e17-c7e6-4cbd-9366-424dc5a31ffe tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:11.101616 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f88c6e17-c7e6-4cbd-9366-424dc5a31ffe tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: bd6231eb-95a4-465e-a859-077a7f82f585] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:11.113029 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f88c6e17-c7e6-4cbd-9366-424dc5a31ffe tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:11.116013 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f88c6e17-c7e6-4cbd-9366-424dc5a31ffe tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:11.116648 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f88c6e17-c7e6-4cbd-9366-424dc5a31ffe tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:11.119410 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f88c6e17-c7e6-4cbd-9366-424dc5a31ffe tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:11.120120 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f88c6e17-c7e6-4cbd-9366-424dc5a31ffe tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:11.120748 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f88c6e17-c7e6-4cbd-9366-424dc5a31ffe tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:11.559409 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f88c6e17-c7e6-4cbd-9366-424dc5a31ffe tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1023300147f463e8f0894981948f825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac07f1b2c83a4faab175a5b9ed8e315e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:11.574641 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f88c6e17-c7e6-4cbd-9366-424dc5a31ffe tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585" status: 200 len: 1317 microversion: 2.1 time: 0.492434 Oct 18 15:29:11.595734 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 604/1176] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:11 2022] GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585 => generated 1317 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:11.609946 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b52c85da-4e8e-4863-ad7f-268fbcf29865 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:11.610996 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b52c85da-4e8e-4863-ad7f-268fbcf29865 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] [instance: 5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:11.618912 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b52c85da-4e8e-4863-ad7f-268fbcf29865 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:11.619695 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b52c85da-4e8e-4863-ad7f-268fbcf29865 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:11.620608 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b52c85da-4e8e-4863-ad7f-268fbcf29865 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:11.621683 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b52c85da-4e8e-4863-ad7f-268fbcf29865 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:11.622309 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b52c85da-4e8e-4863-ad7f-268fbcf29865 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:11.622898 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b52c85da-4e8e-4863-ad7f-268fbcf29865 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:11.815893 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b52c85da-4e8e-4863-ad7f-268fbcf29865 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe80f2ae3ec4365a031ca7472d76e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df909cb429f46c39a83c29fb260b169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:11.837527 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b52c85da-4e8e-4863-ad7f-268fbcf29865 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] 10.222.0.60 "GET /compute/v2.1/servers/5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38" status: 200 len: 1276 microversion: 2.1 time: 0.236575 Oct 18 15:29:11.849414 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 605/1177] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:11 2022] GET /compute/v2.1/servers/5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38 => generated 1276 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:11.866451 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-c08f5c40-35c8-48b8-bf62-309059eb4986 req-dc8bbc54-beb6-4d7a-960e-c6f30ed5a7ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd6231eb-95a4-465e-a859-077a7f82f585", "name": "network-vif-plugged", "status": "completed", "tag": "5c14163f-63a4-4c55-8e7e-3d6fb857fbbd"}, {"server_uuid": "f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62", "name": "network-vif-plugged", "status": "completed", "tag": "c40f10a5-5df6-423f-9402-7931e116c295"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:29:11.907195 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c08f5c40-35c8-48b8-bf62-309059eb4986 req-dc8bbc54-beb6-4d7a-960e-c6f30ed5a7ee service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:11.908173 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c08f5c40-35c8-48b8-bf62-309059eb4986 req-dc8bbc54-beb6-4d7a-960e-c6f30ed5a7ee service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:11.910576 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c08f5c40-35c8-48b8-bf62-309059eb4986 req-dc8bbc54-beb6-4d7a-960e-c6f30ed5a7ee service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:11.965700 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-c08f5c40-35c8-48b8-bf62-309059eb4986 req-dc8bbc54-beb6-4d7a-960e-c6f30ed5a7ee service nova] Creating event network-vif-plugged:5c14163f-63a4-4c55-8e7e-3d6fb857fbbd for instance bd6231eb-95a4-465e-a859-077a7f82f585 on n-h1-853682-5 Oct 18 15:29:11.966245 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-c08f5c40-35c8-48b8-bf62-309059eb4986 req-dc8bbc54-beb6-4d7a-960e-c6f30ed5a7ee service nova] Creating event network-vif-plugged:c40f10a5-5df6-423f-9402-7931e116c295 for instance f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62 on n-h2-853682-5 Oct 18 15:29:11.990274 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-c08f5c40-35c8-48b8-bf62-309059eb4986 req-dc8bbc54-beb6-4d7a-960e-c6f30ed5a7ee service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.139069 Oct 18 15:29:11.992298 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 606/1178] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:29:12.012844 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-050a323d-9423-48bf-b94c-a75329316f35 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:12.015719 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-050a323d-9423-48bf-b94c-a75329316f35 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:12.041233 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-050a323d-9423-48bf-b94c-a75329316f35 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:12.043237 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-050a323d-9423-48bf-b94c-a75329316f35 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:12.044113 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-050a323d-9423-48bf-b94c-a75329316f35 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:12.047253 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-050a323d-9423-48bf-b94c-a75329316f35 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:12.047927 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-050a323d-9423-48bf-b94c-a75329316f35 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:12.049586 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-050a323d-9423-48bf-b94c-a75329316f35 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:12.803930 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-050a323d-9423-48bf-b94c-a75329316f35 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:12.818336 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-050a323d-9423-48bf-b94c-a75329316f35 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2" status: 200 len: 1717 microversion: 2.1 time: 0.822305 Oct 18 15:29:12.820768 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 607/1179] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:11 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2 => generated 1717 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:12.839953 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-486571bf-20db-47bb-aa1f-6b18f566290a tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:12.840577 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-486571bf-20db-47bb-aa1f-6b18f566290a tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:12.861359 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-486571bf-20db-47bb-aa1f-6b18f566290a tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:12.861864 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-486571bf-20db-47bb-aa1f-6b18f566290a tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:12.862310 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-486571bf-20db-47bb-aa1f-6b18f566290a tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:12.863037 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-486571bf-20db-47bb-aa1f-6b18f566290a tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:12.863504 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-486571bf-20db-47bb-aa1f-6b18f566290a tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:12.867748 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-486571bf-20db-47bb-aa1f-6b18f566290a tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:13.581926 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-486571bf-20db-47bb-aa1f-6b18f566290a tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:13.598850 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-486571bf-20db-47bb-aa1f-6b18f566290a tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:13.600946 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-486571bf-20db-47bb-aa1f-6b18f566290a tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:13.602148 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-486571bf-20db-47bb-aa1f-6b18f566290a tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 1892 microversion: 2.42 time: 0.780166 Oct 18 15:29:13.602712 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 608/1180] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:12 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 1892 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:13.622743 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b2b89e33-4f22-4c27-9970-4258ea0c3044 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:13.623858 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b2b89e33-4f22-4c27-9970-4258ea0c3044 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:13.644147 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2b89e33-4f22-4c27-9970-4258ea0c3044 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:13.644667 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2b89e33-4f22-4c27-9970-4258ea0c3044 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:13.645117 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2b89e33-4f22-4c27-9970-4258ea0c3044 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:13.645831 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2b89e33-4f22-4c27-9970-4258ea0c3044 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:13.646348 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2b89e33-4f22-4c27-9970-4258ea0c3044 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:13.646776 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2b89e33-4f22-4c27-9970-4258ea0c3044 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:13.918948 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b2b89e33-4f22-4c27-9970-4258ea0c3044 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:13.936295 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b2b89e33-4f22-4c27-9970-4258ea0c3044 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:13.937793 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b2b89e33-4f22-4c27-9970-4258ea0c3044 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:13.964309 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b2b89e33-4f22-4c27-9970-4258ea0c3044 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1546 microversion: 2.91 time: 0.360475 Oct 18 15:29:13.989192 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 609/1181] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:13 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1546 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:13.997048 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6c33a396-8286-4932-8f80-eb6c1ee433d0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:13.999100 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6c33a396-8286-4932-8f80-eb6c1ee433d0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:14.014568 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6c33a396-8286-4932-8f80-eb6c1ee433d0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:14.015298 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6c33a396-8286-4932-8f80-eb6c1ee433d0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:14.018113 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6c33a396-8286-4932-8f80-eb6c1ee433d0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:14.019327 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6c33a396-8286-4932-8f80-eb6c1ee433d0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:14.020689 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6c33a396-8286-4932-8f80-eb6c1ee433d0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:14.025187 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6c33a396-8286-4932-8f80-eb6c1ee433d0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:14.775814 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6c33a396-8286-4932-8f80-eb6c1ee433d0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:14.791507 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6c33a396-8286-4932-8f80-eb6c1ee433d0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62" status: 200 len: 1466 microversion: 2.1 time: 0.800794 Oct 18 15:29:14.792116 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 610/1182] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:13 2022] GET /compute/v2.1/servers/f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62 => generated 1466 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:14.815680 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9a84c2da-5949-4235-8df4-aaf434a236c1 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:14.816354 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9a84c2da-5949-4235-8df4-aaf434a236c1 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: bd6231eb-95a4-465e-a859-077a7f82f585] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:14.828442 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a84c2da-5949-4235-8df4-aaf434a236c1 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:14.831134 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a84c2da-5949-4235-8df4-aaf434a236c1 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:14.831600 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a84c2da-5949-4235-8df4-aaf434a236c1 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:14.832331 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a84c2da-5949-4235-8df4-aaf434a236c1 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:14.832792 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a84c2da-5949-4235-8df4-aaf434a236c1 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:14.836212 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a84c2da-5949-4235-8df4-aaf434a236c1 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:14.870233 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:29:15.108068 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9a84c2da-5949-4235-8df4-aaf434a236c1 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1023300147f463e8f0894981948f825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac07f1b2c83a4faab175a5b9ed8e315e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:15.125971 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9a84c2da-5949-4235-8df4-aaf434a236c1 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585" status: 200 len: 1506 microversion: 2.1 time: 0.314874 Oct 18 15:29:15.146007 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 611/1183] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:14 2022] GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585 => generated 1506 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:15.170639 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-211b4258-930e-417e-accf-cf5d99340cb9 req-494bcc58-d710-4222-933b-eae5de1d68fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23bdadc4-6faa-4e55-8daf-eef04dd34a8a", "tag": "b1a9859a-97e3-466a-9b12-d8aaa13a8141"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:29:15.195623 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-211b4258-930e-417e-accf-cf5d99340cb9 req-494bcc58-d710-4222-933b-eae5de1d68fe service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:15.203238 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-211b4258-930e-417e-accf-cf5d99340cb9 req-494bcc58-d710-4222-933b-eae5de1d68fe service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:15.204095 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-211b4258-930e-417e-accf-cf5d99340cb9 req-494bcc58-d710-4222-933b-eae5de1d68fe service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:15.239274 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-211b4258-930e-417e-accf-cf5d99340cb9 req-494bcc58-d710-4222-933b-eae5de1d68fe service nova] Creating event network-changed:b1a9859a-97e3-466a-9b12-d8aaa13a8141 for instance 23bdadc4-6faa-4e55-8daf-eef04dd34a8a on n-h2-853682-5 Oct 18 15:29:15.290838 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-211b4258-930e-417e-accf-cf5d99340cb9 req-494bcc58-d710-4222-933b-eae5de1d68fe service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141725 Oct 18 15:29:15.291640 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 612/1184] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:29:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:29:15.338710 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9d8744aa-09d8-45d9-b30c-ccbf17a45708 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:15.342945 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9d8744aa-09d8-45d9-b30c-ccbf17a45708 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] [instance: 5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:15.376721 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d8744aa-09d8-45d9-b30c-ccbf17a45708 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:15.377243 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d8744aa-09d8-45d9-b30c-ccbf17a45708 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:15.377685 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d8744aa-09d8-45d9-b30c-ccbf17a45708 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:15.385576 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d8744aa-09d8-45d9-b30c-ccbf17a45708 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:15.386307 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d8744aa-09d8-45d9-b30c-ccbf17a45708 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:15.386765 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d8744aa-09d8-45d9-b30c-ccbf17a45708 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:16.152704 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9d8744aa-09d8-45d9-b30c-ccbf17a45708 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe80f2ae3ec4365a031ca7472d76e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df909cb429f46c39a83c29fb260b169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:16.168527 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9d8744aa-09d8-45d9-b30c-ccbf17a45708 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] 10.222.0.60 "GET /compute/v2.1/servers/5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38" status: 200 len: 1318 microversion: 2.1 time: 0.843271 Oct 18 15:29:16.173077 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 613/1185] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:15 2022] GET /compute/v2.1/servers/5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38 => generated 1318 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:16.205631 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0146db1c-b315-482e-9b35-4e22d1a4a567 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:16.209766 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0146db1c-b315-482e-9b35-4e22d1a4a567 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:16.237854 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0146db1c-b315-482e-9b35-4e22d1a4a567 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:16.238731 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0146db1c-b315-482e-9b35-4e22d1a4a567 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:16.241647 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0146db1c-b315-482e-9b35-4e22d1a4a567 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:16.244362 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0146db1c-b315-482e-9b35-4e22d1a4a567 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:16.250978 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0146db1c-b315-482e-9b35-4e22d1a4a567 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:16.251739 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0146db1c-b315-482e-9b35-4e22d1a4a567 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:16.742705 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:29:16.836666 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0146db1c-b315-482e-9b35-4e22d1a4a567 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:16.845744 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0146db1c-b315-482e-9b35-4e22d1a4a567 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2" status: 200 len: 1717 microversion: 2.1 time: 0.650965 Oct 18 15:29:16.863086 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 614/1186] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:16 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2 => generated 1717 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:16.863086 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-f0559f60-8ecc-40ea-af09-aa1d3d0e532a req-df57f54e-3355-4995-a5fc-70150d0b5d23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38", "tag": "93f89e2b-abbd-43b8-ab95-9c6c72800e89"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:29:16.889010 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f0559f60-8ecc-40ea-af09-aa1d3d0e532a req-df57f54e-3355-4995-a5fc-70150d0b5d23 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:16.889773 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f0559f60-8ecc-40ea-af09-aa1d3d0e532a req-df57f54e-3355-4995-a5fc-70150d0b5d23 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:16.890334 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f0559f60-8ecc-40ea-af09-aa1d3d0e532a req-df57f54e-3355-4995-a5fc-70150d0b5d23 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:16.912045 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-f0559f60-8ecc-40ea-af09-aa1d3d0e532a req-df57f54e-3355-4995-a5fc-70150d0b5d23 service nova] Creating event network-changed:93f89e2b-abbd-43b8-ab95-9c6c72800e89 for instance 5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38 on n-h1-853682-5 Oct 18 15:29:16.921588 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-f0559f60-8ecc-40ea-af09-aa1d3d0e532a req-df57f54e-3355-4995-a5fc-70150d0b5d23 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069026 Oct 18 15:29:16.925843 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 615/1187] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:29:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:29:16.934617 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d313e286-1674-4ff3-9b54-c551a8346faa tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:16.936674 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d313e286-1674-4ff3-9b54-c551a8346faa tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:16.948654 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d313e286-1674-4ff3-9b54-c551a8346faa tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:16.949404 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d313e286-1674-4ff3-9b54-c551a8346faa tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:16.950047 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d313e286-1674-4ff3-9b54-c551a8346faa tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:16.951020 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d313e286-1674-4ff3-9b54-c551a8346faa tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:16.951575 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d313e286-1674-4ff3-9b54-c551a8346faa tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:16.958443 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d313e286-1674-4ff3-9b54-c551a8346faa tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:17.230668 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d313e286-1674-4ff3-9b54-c551a8346faa tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:17.241415 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d313e286-1674-4ff3-9b54-c551a8346faa tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:17.243531 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d313e286-1674-4ff3-9b54-c551a8346faa tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:17.244969 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d313e286-1674-4ff3-9b54-c551a8346faa tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 1892 microversion: 2.42 time: 0.318244 Oct 18 15:29:17.246125 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 616/1188] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:16 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 1892 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:17.251006 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8f2b3e82-93b5-4b2d-a382-082da7687d00 tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:17.251922 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8f2b3e82-93b5-4b2d-a382-082da7687d00 tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] [instance: f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:17.258913 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f2b3e82-93b5-4b2d-a382-082da7687d00 tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:17.259676 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f2b3e82-93b5-4b2d-a382-082da7687d00 tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:17.260332 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f2b3e82-93b5-4b2d-a382-082da7687d00 tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:17.261295 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f2b3e82-93b5-4b2d-a382-082da7687d00 tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:17.261964 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f2b3e82-93b5-4b2d-a382-082da7687d00 tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:17.262950 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f2b3e82-93b5-4b2d-a382-082da7687d00 tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:17.581198 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8f2b3e82-93b5-4b2d-a382-082da7687d00 tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62" status: 200 len: 1617 microversion: 2.1 time: 0.333644 Oct 18 15:29:17.582032 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 617/1189] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:17 2022] GET /compute/v2.1/servers/f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62 => generated 1617 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:17.609332 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c397f587-fb38-4364-a57d-ab96f4f4b54e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:17.621289 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c397f587-fb38-4364-a57d-ab96f4f4b54e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:17.666818 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c397f587-fb38-4364-a57d-ab96f4f4b54e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:17.666818 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c397f587-fb38-4364-a57d-ab96f4f4b54e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:17.666818 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c397f587-fb38-4364-a57d-ab96f4f4b54e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:17.666818 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c397f587-fb38-4364-a57d-ab96f4f4b54e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:17.667297 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c397f587-fb38-4364-a57d-ab96f4f4b54e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:17.667297 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c397f587-fb38-4364-a57d-ab96f4f4b54e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:17.685053 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=8 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:29:17.815196 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c397f587-fb38-4364-a57d-ab96f4f4b54e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:17.827574 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c397f587-fb38-4364-a57d-ab96f4f4b54e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:17.829043 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c397f587-fb38-4364-a57d-ab96f4f4b54e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:17.845450 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c397f587-fb38-4364-a57d-ab96f4f4b54e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1546 microversion: 2.91 time: 0.241384 Oct 18 15:29:17.846059 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 618/1190] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:17 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1546 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:17.860842 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3d4d4db2-2fe3-4b0c-8277-3877c0d0bd24 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:17.862267 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3d4d4db2-2fe3-4b0c-8277-3877c0d0bd24 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] [instance: 5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:17.880664 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d4d4db2-2fe3-4b0c-8277-3877c0d0bd24 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:17.880664 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d4d4db2-2fe3-4b0c-8277-3877c0d0bd24 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:17.880664 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d4d4db2-2fe3-4b0c-8277-3877c0d0bd24 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:17.880664 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d4d4db2-2fe3-4b0c-8277-3877c0d0bd24 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:17.881543 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d4d4db2-2fe3-4b0c-8277-3877c0d0bd24 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:17.881543 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d4d4db2-2fe3-4b0c-8277-3877c0d0bd24 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:18.247491 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3d4d4db2-2fe3-4b0c-8277-3877c0d0bd24 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe80f2ae3ec4365a031ca7472d76e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df909cb429f46c39a83c29fb260b169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:18.259758 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3d4d4db2-2fe3-4b0c-8277-3877c0d0bd24 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] 10.222.0.60 "GET /compute/v2.1/servers/5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38" status: 200 len: 1318 microversion: 2.1 time: 0.405483 Oct 18 15:29:18.261656 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 619/1191] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:17 2022] GET /compute/v2.1/servers/5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38 => generated 1318 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:18.266623 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-23c21b06-b9b6-4e70-b8d3-7530df43b318 req-f8413dc9-91f7-42de-abaf-32ab2e9ccb82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23bdadc4-6faa-4e55-8daf-eef04dd34a8a", "tag": "338571d6-62fa-444c-a91e-c4a1fb9c42c5"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:29:18.277656 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-23c21b06-b9b6-4e70-b8d3-7530df43b318 req-f8413dc9-91f7-42de-abaf-32ab2e9ccb82 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:18.278516 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-23c21b06-b9b6-4e70-b8d3-7530df43b318 req-f8413dc9-91f7-42de-abaf-32ab2e9ccb82 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:18.279196 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-23c21b06-b9b6-4e70-b8d3-7530df43b318 req-f8413dc9-91f7-42de-abaf-32ab2e9ccb82 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:18.297762 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-23c21b06-b9b6-4e70-b8d3-7530df43b318 req-f8413dc9-91f7-42de-abaf-32ab2e9ccb82 service nova] Creating event network-changed:338571d6-62fa-444c-a91e-c4a1fb9c42c5 for instance 23bdadc4-6faa-4e55-8daf-eef04dd34a8a on n-h2-853682-5 Oct 18 15:29:18.319911 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-23c21b06-b9b6-4e70-b8d3-7530df43b318 req-f8413dc9-91f7-42de-abaf-32ab2e9ccb82 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052980 Oct 18 15:29:18.322354 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 620/1192] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:29:18.329678 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-034769f0-1754-4665-bb4e-75d26d8a873d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1150985669", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["61ca6b08-6a75-4b0a-86d7-86aa22cb308e"]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:29:19.265531 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:29:19.413427 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=93 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:29:23.350486 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-cb1399b0-3cf8-48c2-87c1-e97b304546fd tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/55cd5e90-ef2b-4aec-a711-c27fc895dbba" status: 200 len: 1411 microversion: 2.1 time: 13.826302 Oct 18 15:29:23.356899 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 573/1193] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:29:09 2022] GET /compute/v2.1/images/55cd5e90-ef2b-4aec-a711-c27fc895dbba => generated 1411 bytes in 13828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:23.362910 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-258fd7d5-d1f1-45ab-9bb7-1378f4a3af19 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:23.363536 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-258fd7d5-d1f1-45ab-9bb7-1378f4a3af19 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:23.387276 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-258fd7d5-d1f1-45ab-9bb7-1378f4a3af19 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:23.387771 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-258fd7d5-d1f1-45ab-9bb7-1378f4a3af19 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:23.391636 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-258fd7d5-d1f1-45ab-9bb7-1378f4a3af19 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:23.392484 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-258fd7d5-d1f1-45ab-9bb7-1378f4a3af19 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:23.393407 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-258fd7d5-d1f1-45ab-9bb7-1378f4a3af19 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:23.393851 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-258fd7d5-d1f1-45ab-9bb7-1378f4a3af19 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:23.600773 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-034769f0-1754-4665-bb4e-75d26d8a873d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] validate_networks() for None {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:29:24.166083 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-258fd7d5-d1f1-45ab-9bb7-1378f4a3af19 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:24.175471 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-258fd7d5-d1f1-45ab-9bb7-1378f4a3af19 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2" status: 200 len: 1717 microversion: 2.1 time: 0.821145 Oct 18 15:29:24.176524 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 574/1194] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:23 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2 => generated 1717 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:24.190972 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9a6d2e6e-6692-4d18-9cc5-f67a772a7ba4 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:24.191604 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9a6d2e6e-6692-4d18-9cc5-f67a772a7ba4 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:24.199996 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9a6d2e6e-6692-4d18-9cc5-f67a772a7ba4 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:24.200488 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9a6d2e6e-6692-4d18-9cc5-f67a772a7ba4 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:24.201272 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9a6d2e6e-6692-4d18-9cc5-f67a772a7ba4 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:24.202315 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9a6d2e6e-6692-4d18-9cc5-f67a772a7ba4 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:24.202845 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9a6d2e6e-6692-4d18-9cc5-f67a772a7ba4 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:24.203345 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9a6d2e6e-6692-4d18-9cc5-f67a772a7ba4 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:24.299245 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-034769f0-1754-4665-bb4e-75d26d8a873d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:29:24.299747 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-034769f0-1754-4665-bb4e-75d26d8a873d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:29:24.300306 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-034769f0-1754-4665-bb4e-75d26d8a873d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:29:24.300777 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-034769f0-1754-4665-bb4e-75d26d8a873d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:29:24.301441 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-034769f0-1754-4665-bb4e-75d26d8a873d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:29:24.310886 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-034769f0-1754-4665-bb4e-75d26d8a873d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:24.311480 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-034769f0-1754-4665-bb4e-75d26d8a873d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:24.311943 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-034769f0-1754-4665-bb4e-75d26d8a873d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:24.312753 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-034769f0-1754-4665-bb4e-75d26d8a873d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:24.313613 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-034769f0-1754-4665-bb4e-75d26d8a873d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:24.314097 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-034769f0-1754-4665-bb4e-75d26d8a873d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:24.328522 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:29:24.336752 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-034769f0-1754-4665-bb4e-75d26d8a873d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Getting quotas for project 377c3bbd62b546fca545c0f6d0df59e3. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:29:24.343943 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-034769f0-1754-4665-bb4e-75d26d8a873d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Getting quotas for user d58aac335a1d421a95928e2754fb2529 and project 377c3bbd62b546fca545c0f6d0df59e3. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:29:24.358108 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-034769f0-1754-4665-bb4e-75d26d8a873d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:29:24.360889 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-034769f0-1754-4665-bb4e-75d26d8a873d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 7c7a376f-fa78-4101-adf7-e84f23b4e068] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:29:24.379368 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-9a6d2e6e-6692-4d18-9cc5-f67a772a7ba4 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lazy-loading 'services' on Instance uuid cc806839-862f-4ea7-9078-c970f50b3793 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:29:24.394993 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9a6d2e6e-6692-4d18-9cc5-f67a772a7ba4 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793" status: 200 len: 2342 microversion: 2.25 time: 0.216605 Oct 18 15:29:24.397056 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 575/1195] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:24 2022] GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793 => generated 2342 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:24.408651 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-628e303a-5999-425a-8609-f51acf68de6d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:24.409312 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-628e303a-5999-425a-8609-f51acf68de6d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:24.420014 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-628e303a-5999-425a-8609-f51acf68de6d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:24.420446 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-628e303a-5999-425a-8609-f51acf68de6d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:24.420905 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-628e303a-5999-425a-8609-f51acf68de6d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:24.421816 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-628e303a-5999-425a-8609-f51acf68de6d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:24.422787 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-628e303a-5999-425a-8609-f51acf68de6d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:24.423382 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-628e303a-5999-425a-8609-f51acf68de6d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:24.428984 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-034769f0-1754-4665-bb4e-75d26d8a873d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.104939 Oct 18 15:29:24.430366 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 621/1196] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:29:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 6107 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:29:24.444361 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eb5503ac-615c-4349-a1e3-33a40a7f9c68 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:24.445970 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-eb5503ac-615c-4349-a1e3-33a40a7f9c68 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:24.454286 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb5503ac-615c-4349-a1e3-33a40a7f9c68 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:24.455157 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb5503ac-615c-4349-a1e3-33a40a7f9c68 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:24.455863 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb5503ac-615c-4349-a1e3-33a40a7f9c68 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:24.456794 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb5503ac-615c-4349-a1e3-33a40a7f9c68 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:24.457462 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb5503ac-615c-4349-a1e3-33a40a7f9c68 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:24.458663 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb5503ac-615c-4349-a1e3-33a40a7f9c68 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:24.565749 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-eb5503ac-615c-4349-a1e3-33a40a7f9c68 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:24.584143 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-eb5503ac-615c-4349-a1e3-33a40a7f9c68 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:24.587062 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-eb5503ac-615c-4349-a1e3-33a40a7f9c68 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:24.593587 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-eb5503ac-615c-4349-a1e3-33a40a7f9c68 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1546 microversion: 2.91 time: 0.161897 Oct 18 15:29:24.594595 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 622/1197] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:24 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1546 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:24.601028 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8b231e2e-24d2-46bb-859d-994c19523d30 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:24.601825 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8b231e2e-24d2-46bb-859d-994c19523d30 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] [instance: 5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:24.608016 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b231e2e-24d2-46bb-859d-994c19523d30 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:24.608469 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b231e2e-24d2-46bb-859d-994c19523d30 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:24.609028 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b231e2e-24d2-46bb-859d-994c19523d30 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:24.609793 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b231e2e-24d2-46bb-859d-994c19523d30 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:24.610314 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b231e2e-24d2-46bb-859d-994c19523d30 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:24.610873 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b231e2e-24d2-46bb-859d-994c19523d30 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:24.793391 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-628e303a-5999-425a-8609-f51acf68de6d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:24.806508 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-628e303a-5999-425a-8609-f51acf68de6d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:24.825177 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-628e303a-5999-425a-8609-f51acf68de6d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:24.825177 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-628e303a-5999-425a-8609-f51acf68de6d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 1880 microversion: 2.42 time: 0.410997 Oct 18 15:29:24.830900 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 576/1198] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:24 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 1880 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:24.837936 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-047addf5-238f-4861-a97d-fc0d56f74292 tempest-VolumesAdminNegativeTest-1056302673 tempest-VolumesAdminNegativeTest-1056302673-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "ebba83fe-5fef-4f12-84f0-2282b5a95b37"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:29:24.849842 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-047addf5-238f-4861-a97d-fc0d56f74292 tempest-VolumesAdminNegativeTest-1056302673 tempest-VolumesAdminNegativeTest-1056302673-project-admin] [instance: bd6231eb-95a4-465e-a859-077a7f82f585] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:24.863666 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-047addf5-238f-4861-a97d-fc0d56f74292 tempest-VolumesAdminNegativeTest-1056302673 tempest-VolumesAdminNegativeTest-1056302673-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:24.864175 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-047addf5-238f-4861-a97d-fc0d56f74292 tempest-VolumesAdminNegativeTest-1056302673 tempest-VolumesAdminNegativeTest-1056302673-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:24.864965 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-047addf5-238f-4861-a97d-fc0d56f74292 tempest-VolumesAdminNegativeTest-1056302673 tempest-VolumesAdminNegativeTest-1056302673-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:24.865693 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-047addf5-238f-4861-a97d-fc0d56f74292 tempest-VolumesAdminNegativeTest-1056302673 tempest-VolumesAdminNegativeTest-1056302673-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:24.866161 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-047addf5-238f-4861-a97d-fc0d56f74292 tempest-VolumesAdminNegativeTest-1056302673 tempest-VolumesAdminNegativeTest-1056302673-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:24.866590 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-047addf5-238f-4861-a97d-fc0d56f74292 tempest-VolumesAdminNegativeTest-1056302673 tempest-VolumesAdminNegativeTest-1056302673-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:24.912229 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8b231e2e-24d2-46bb-859d-994c19523d30 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe80f2ae3ec4365a031ca7472d76e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df909cb429f46c39a83c29fb260b169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:24.921865 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8b231e2e-24d2-46bb-859d-994c19523d30 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] 10.222.0.60 "GET /compute/v2.1/servers/5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38" status: 200 len: 1318 microversion: 2.1 time: 0.325859 Oct 18 15:29:24.923104 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 623/1199] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:24 2022] GET /compute/v2.1/servers/5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38 => generated 1318 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:24.932790 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-7a8546dc-5d23-431a-9c36-238949ea0cc3 req-383d4402-9301-49ef-8337-d782661a7616 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38", "name": "network-vif-plugged", "status": "completed", "tag": "93f89e2b-abbd-43b8-ab95-9c6c72800e89"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:29:24.969514 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7a8546dc-5d23-431a-9c36-238949ea0cc3 req-383d4402-9301-49ef-8337-d782661a7616 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:24.970313 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-047addf5-238f-4861-a97d-fc0d56f74292 tempest-VolumesAdminNegativeTest-1056302673 tempest-VolumesAdminNegativeTest-1056302673-project-admin] HTTP exception thrown: Volume 88d74b20-4958-4f42-ad12-441f84ca74a3 could not be found. Oct 18 15:29:24.970464 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7a8546dc-5d23-431a-9c36-238949ea0cc3 req-383d4402-9301-49ef-8337-d782661a7616 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:24.971050 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7a8546dc-5d23-431a-9c36-238949ea0cc3 req-383d4402-9301-49ef-8337-d782661a7616 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:24.974350 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-047addf5-238f-4861-a97d-fc0d56f74292 tempest-VolumesAdminNegativeTest-1056302673 tempest-VolumesAdminNegativeTest-1056302673-project-admin] Request method failure captured: Oct 18 15:29:24.974350 n-d-853682-5 devstack@n-api.service[120405]: request: PUT /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585/os-volume_attachments/88d74b20-4958-4f42-ad12-441f84ca74a3 HTTP/1.1 Oct 18 15:29:24.974350 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:29:24.974350 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:29:24.974350 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:29:24.974350 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 74 Oct 18 15:29:24.974350 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:29:24.974350 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:29:24.974350 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:29:24.974350 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:29:24.974350 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsW_bzlEfd1-cTEDXgvtiGevlgDnrc31EcMNC4xjDHUC6-rH_uBVz5r30OsOmUnFL_snOyTr5gdIpl_YN2G3QTGGMUKfG9ntNQg_9vlMyG0iJ6STiM6y0P7A5NZ_PY8dx_mHgTXpHtxpAbQImljUZpxPAEL3MnXEx7HyJYvjaGR7nsk Oct 18 15:29:24.974350 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:29:24.974350 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:29:24.974350 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:29:24.974350 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:29:24.974350 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:29:24.974350 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:29:24.974350 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 51002c3a82b644358d46c0b57678a5c2 Oct 18 15:29:24.974350 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-VolumesAdminNegativeTest-1056302673 Oct 18 15:29:24.974350 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,admin,reader Oct 18 15:29:24.974350 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,admin,reader Oct 18 15:29:24.975774 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/51002c3a82b644358d46c0b57678a5c2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/51002c3a82b644358d46c0b57678a5c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/51002c3a82b644358d46c0b57678a5c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_51002c3a82b644358d46c0b57678a5c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:29:24.975774 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-VolumesAdminNegativeTest-1056302673 Oct 18 15:29:24.975774 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 51002c3a82b644358d46c0b57678a5c2 Oct 18 15:29:24.975774 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1056302673 Oct 18 15:29:24.975774 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-VolumesAdminNegativeTest-1056302673-project-admin Oct 18 15:29:24.975774 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:29:24.975774 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:29:24.975774 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 5d2f92b917ea429abd9b46a84d4a0a8e Oct 18 15:29:24.975774 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-VolumesAdminNegativeTest-1056302673-project-admin Oct 18 15:29:24.975774 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:29:24.975774 n-d-853682-5 devstack@n-api.service[120405]: {"volumeAttachment": {"volumeId": "ebba83fe-5fef-4f12-84f0-2282b5a95b37"}} Oct 18 15:29:24.975774 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:29:24.975774 n-d-853682-5 devstack@n-api.service[120405]: exception: Volume 88d74b20-4958-4f42-ad12-441f84ca74a3 could not be found. Oct 18 15:29:24.976611 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'server_id': 'bd6231eb-95a4-465e-a859-077a7f82f585', 'id': '88d74b20-4958-4f42-ad12-441f84ca74a3', 'body': {'volumeAttachment': {'volumeId': 'ebba83fe-5fef-4f12-84f0-2282b5a95b37'}}} Oct 18 15:29:24.976611 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:29:24.976611 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:29:24.976611 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 15:29:24.976611 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 15:29:24.976611 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 18 15:29:24.976611 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 18 15:29:24.976611 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 18 15:29:24.976611 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 18 15:29:24.976611 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 15:29:24.976611 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 15:29:24.976611 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 15:29:24.976611 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 15:29:24.976611 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 15:29:24.976611 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 15:29:24.976611 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 15:29:24.976611 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 15:29:24.977713 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 88d74b20-4958-4f42-ad12-441f84ca74a3 could not be found. (HTTP 404) (Request-ID: req-556fe738-15d5-4043-83d4-641c9f8f43bc) Oct 18 15:29:24.977713 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:29:24.977713 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:29:24.977713 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:29:24.977713 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:29:24.977713 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 18 15:29:24.977713 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 18 15:29:24.977713 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 18 15:29:24.977713 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 18 15:29:24.977713 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 18 15:29:24.977713 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 18 15:29:24.977713 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 18 15:29:24.977713 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 18 15:29:24.977713 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 15:29:24.977713 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 15:29:24.977713 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 18 15:29:24.977713 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 18 15:29:24.977713 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 18 15:29:24.977713 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 18 15:29:24.978946 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 15:29:24.978946 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 15:29:24.978946 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 15:29:24.978946 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 15:29:24.978946 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 15:29:24.978946 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 15:29:24.978946 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 15:29:24.978946 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 15:29:24.978946 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 88d74b20-4958-4f42-ad12-441f84ca74a3 could not be found. Oct 18 15:29:24.978946 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:29:24.978946 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:29:24.978946 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:29:24.978946 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:29:24.978946 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:29:24.978946 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:29:24.978946 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:29:24.978946 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:29:24.978946 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:29:24.978946 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:29:24.981641 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:29:24.981641 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:29:24.981641 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:29:24.981641 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:29:24.981641 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 18 15:29:24.981641 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 18 15:29:24.981641 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 18 15:29:24.981641 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:29:24.981641 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 88d74b20-4958-4f42-ad12-441f84ca74a3 could not be found. Oct 18 15:29:24.981641 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:29:24.981641 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:29:24.981641 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:29:24.981641 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:29:24.981641 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:29:24.981641 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:29:24.981641 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:29:24.981641 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:29:24.981641 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 88d74b20-4958-4f42-ad12-441f84ca74a3 could not be found. Oct 18 15:29:24.981641 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:29:24.984617 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-047addf5-238f-4861-a97d-fc0d56f74292 tempest-VolumesAdminNegativeTest-1056302673 tempest-VolumesAdminNegativeTest-1056302673-project-admin] Returning 404 to user: Volume 88d74b20-4958-4f42-ad12-441f84ca74a3 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:29:24.984617 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-047addf5-238f-4861-a97d-fc0d56f74292 tempest-VolumesAdminNegativeTest-1056302673 tempest-VolumesAdminNegativeTest-1056302673-project-admin] 10.222.0.60 "PUT /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585/os-volume_attachments/88d74b20-4958-4f42-ad12-441f84ca74a3" status: 404 len: 109 microversion: 2.1 time: 0.149607 Oct 18 15:29:24.984617 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 577/1200] 10.222.0.60 () {60 vars in 1433 bytes} [Tue Oct 18 15:29:24 2022] PUT /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585/os-volume_attachments/88d74b20-4958-4f42-ad12-441f84ca74a3 => generated 109 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:29:24.996104 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ebfc8db8-0d87-4b3f-b875-2de2d64778c4 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d16a310>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:25.001543 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-7a8546dc-5d23-431a-9c36-238949ea0cc3 req-383d4402-9301-49ef-8337-d782661a7616 service nova] Creating event network-vif-plugged:93f89e2b-abbd-43b8-ab95-9c6c72800e89 for instance 5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38 on n-h1-853682-5 Oct 18 15:29:25.013049 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-7a8546dc-5d23-431a-9c36-238949ea0cc3 req-383d4402-9301-49ef-8337-d782661a7616 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084110 Oct 18 15:29:25.013049 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 624/1201] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:29:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:29:25.015645 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f7ad3be7-5635-496b-a4e9-dc1580e5065d tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:25.021282 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7ad3be7-5635-496b-a4e9-dc1580e5065d tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:25.021771 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7ad3be7-5635-496b-a4e9-dc1580e5065d tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:25.022208 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7ad3be7-5635-496b-a4e9-dc1580e5065d tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:25.024057 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7ad3be7-5635-496b-a4e9-dc1580e5065d tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:25.024515 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7ad3be7-5635-496b-a4e9-dc1580e5065d tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:25.024967 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7ad3be7-5635-496b-a4e9-dc1580e5065d tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:25.054007 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f7ad3be7-5635-496b-a4e9-dc1580e5065d tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.043198 Oct 18 15:29:25.054623 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 625/1202] 10.222.0.60 () {60 vars in 1217 bytes} [Tue Oct 18 15:29:25 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:29:25.061172 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a07dbaaf-2c13-4557-a709-5d99713dfd72 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:25.062218 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a07dbaaf-2c13-4557-a709-5d99713dfd72 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 7c7a376f-fa78-4101-adf7-e84f23b4e068] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:25.115791 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ebfc8db8-0d87-4b3f-b875-2de2d64778c4 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/55cd5e90-ef2b-4aec-a711-c27fc895dbba" status: 200 len: 1420 microversion: 2.1 time: 0.131716 Oct 18 15:29:25.118517 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 578/1203] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:29:24 2022] GET /compute/v2.1/images/55cd5e90-ef2b-4aec-a711-c27fc895dbba => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:25.121195 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a07dbaaf-2c13-4557-a709-5d99713dfd72 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:25.133332 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a07dbaaf-2c13-4557-a709-5d99713dfd72 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/7c7a376f-fa78-4101-adf7-e84f23b4e068" status: 200 len: 1217 microversion: 2.1 time: 0.077500 Oct 18 15:29:25.134915 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 626/1204] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:25 2022] GET /compute/v2.1/servers/7c7a376f-fa78-4101-adf7-e84f23b4e068 => generated 1217 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:25.139333 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f01ccd89-9589-48d9-8f8e-88265c162d86 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d16a3a0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:25.204855 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7f44b88b-3882-404b-a848-9523f681b070 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:25.205736 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7f44b88b-3882-404b-a848-9523f681b070 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:25.228177 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f44b88b-3882-404b-a848-9523f681b070 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:25.230712 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f44b88b-3882-404b-a848-9523f681b070 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:25.235240 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f44b88b-3882-404b-a848-9523f681b070 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:25.236421 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f44b88b-3882-404b-a848-9523f681b070 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:25.239971 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f44b88b-3882-404b-a848-9523f681b070 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:25.240647 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f44b88b-3882-404b-a848-9523f681b070 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:25.244403 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f01ccd89-9589-48d9-8f8e-88265c162d86 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/55cd5e90-ef2b-4aec-a711-c27fc895dbba" status: 200 len: 1420 microversion: 2.1 time: 0.114255 Oct 18 15:29:25.245015 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 579/1205] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:29:25 2022] GET /compute/v2.1/images/55cd5e90-ef2b-4aec-a711-c27fc895dbba => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:25.523802 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a7791362-9658-41e3-b0e1-253fef884d19 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-780748888", "imageRef": "55cd5e90-ef2b-4aec-a711-c27fc895dbba", "flavorRef": "452", "networks": [{"uuid": "ef6fe956-3e84-412d-8f85-8f55d9975d85"}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:29:25.663364 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7f44b88b-3882-404b-a848-9523f681b070 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:25.663930 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-a7791362-9658-41e3-b0e1-253fef884d19 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] validate_networks() for [('ef6fe956-3e84-412d-8f85-8f55d9975d85', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:29:25.671960 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7f44b88b-3882-404b-a848-9523f681b070 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2" status: 200 len: 1717 microversion: 2.1 time: 0.474524 Oct 18 15:29:25.685145 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 627/1206] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:25 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2 => generated 1717 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:29:25.701002 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ef853cc8-518d-4baa-b49d-19d4219302e4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:25.701631 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ef853cc8-518d-4baa-b49d-19d4219302e4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:25.722668 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ef853cc8-518d-4baa-b49d-19d4219302e4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:25.723174 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ef853cc8-518d-4baa-b49d-19d4219302e4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:25.723641 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ef853cc8-518d-4baa-b49d-19d4219302e4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:25.724361 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ef853cc8-518d-4baa-b49d-19d4219302e4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:25.737074 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ef853cc8-518d-4baa-b49d-19d4219302e4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:25.737074 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ef853cc8-518d-4baa-b49d-19d4219302e4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:26.003646 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ef853cc8-518d-4baa-b49d-19d4219302e4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:26.019477 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ef853cc8-518d-4baa-b49d-19d4219302e4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:26.021730 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ef853cc8-518d-4baa-b49d-19d4219302e4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:26.034133 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ef853cc8-518d-4baa-b49d-19d4219302e4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1546 microversion: 2.91 time: 0.347694 Oct 18 15:29:26.048344 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 628/1207] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:25 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1546 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:26.060755 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-24b66837-3aca-4749-b8d0-1a736fb53112 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:26.062029 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-24b66837-3aca-4749-b8d0-1a736fb53112 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:26.074654 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24b66837-3aca-4749-b8d0-1a736fb53112 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:26.075260 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24b66837-3aca-4749-b8d0-1a736fb53112 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:26.075588 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24b66837-3aca-4749-b8d0-1a736fb53112 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:26.076302 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24b66837-3aca-4749-b8d0-1a736fb53112 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:26.076756 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24b66837-3aca-4749-b8d0-1a736fb53112 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:26.077210 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24b66837-3aca-4749-b8d0-1a736fb53112 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:27.215691 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-24b66837-3aca-4749-b8d0-1a736fb53112 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:27.228370 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-24b66837-3aca-4749-b8d0-1a736fb53112 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:27.230580 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-24b66837-3aca-4749-b8d0-1a736fb53112 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:27.232166 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-24b66837-3aca-4749-b8d0-1a736fb53112 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 1880 microversion: 2.42 time: 1.182709 Oct 18 15:29:27.244836 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 629/1208] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:26 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 1880 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:27.244836 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3a131077-1945-44c8-8e62-a4ff8bf15853 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:27.244836 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3a131077-1945-44c8-8e62-a4ff8bf15853 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] [instance: 5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:27.251437 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a131077-1945-44c8-8e62-a4ff8bf15853 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:27.252148 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a131077-1945-44c8-8e62-a4ff8bf15853 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:27.252752 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a131077-1945-44c8-8e62-a4ff8bf15853 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:27.253842 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a131077-1945-44c8-8e62-a4ff8bf15853 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:27.254568 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a131077-1945-44c8-8e62-a4ff8bf15853 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:27.255988 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a131077-1945-44c8-8e62-a4ff8bf15853 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:27.892017 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-a7791362-9658-41e3-b0e1-253fef884d19 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:29:27.892621 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-a7791362-9658-41e3-b0e1-253fef884d19 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:29:27.893183 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-a7791362-9658-41e3-b0e1-253fef884d19 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:29:27.893845 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-a7791362-9658-41e3-b0e1-253fef884d19 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:29:27.894478 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-a7791362-9658-41e3-b0e1-253fef884d19 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:29:27.917399 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a7791362-9658-41e3-b0e1-253fef884d19 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:27.920707 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a7791362-9658-41e3-b0e1-253fef884d19 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:27.921460 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a7791362-9658-41e3-b0e1-253fef884d19 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:27.922482 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a7791362-9658-41e3-b0e1-253fef884d19 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:27.925190 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a7791362-9658-41e3-b0e1-253fef884d19 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:27.925934 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a7791362-9658-41e3-b0e1-253fef884d19 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:27.976409 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-a7791362-9658-41e3-b0e1-253fef884d19 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Getting quotas for project ee0a3f0c256544beb2df4f113da56137. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:29:27.983668 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-a7791362-9658-41e3-b0e1-253fef884d19 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Getting quotas for user ed9cd936192c40efa9099edee445e90e and project ee0a3f0c256544beb2df4f113da56137. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:29:28.000953 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a7791362-9658-41e3-b0e1-253fef884d19 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:29:28.003856 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a7791362-9658-41e3-b0e1-253fef884d19 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 4b959d9f-3c8e-44ef-92f1-83cfb8e04804] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='55cd5e90-ef2b-4aec-a711-c27fc895dbba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:29:28.094612 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3a131077-1945-44c8-8e62-a4ff8bf15853 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe80f2ae3ec4365a031ca7472d76e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df909cb429f46c39a83c29fb260b169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:28.094867 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a7791362-9658-41e3-b0e1-253fef884d19 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.576216 Oct 18 15:29:28.103186 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 580/1209] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:29:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:29:28.113865 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-175598fb-0ca5-4380-a11a-a6771b2507e2 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:28.115048 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-175598fb-0ca5-4380-a11a-a6771b2507e2 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 7c7a376f-fa78-4101-adf7-e84f23b4e068] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:28.120679 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3a131077-1945-44c8-8e62-a4ff8bf15853 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] 10.222.0.60 "GET /compute/v2.1/servers/5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38" status: 200 len: 1318 microversion: 2.1 time: 0.878318 Oct 18 15:29:28.123123 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 630/1210] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:27 2022] GET /compute/v2.1/servers/5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38 => generated 1318 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:28.146210 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-175598fb-0ca5-4380-a11a-a6771b2507e2 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:28.146982 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-175598fb-0ca5-4380-a11a-a6771b2507e2 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:28.147098 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-175598fb-0ca5-4380-a11a-a6771b2507e2 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:28.147742 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-175598fb-0ca5-4380-a11a-a6771b2507e2 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:28.148199 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-175598fb-0ca5-4380-a11a-a6771b2507e2 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:28.148625 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-175598fb-0ca5-4380-a11a-a6771b2507e2 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:28.149480 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9716cc97-612c-417e-87e8-bd3c813c991d tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:28.150450 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9716cc97-612c-417e-87e8-bd3c813c991d tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:28.164834 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9716cc97-612c-417e-87e8-bd3c813c991d tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:28.166084 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9716cc97-612c-417e-87e8-bd3c813c991d tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:28.166758 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9716cc97-612c-417e-87e8-bd3c813c991d tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:28.167716 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9716cc97-612c-417e-87e8-bd3c813c991d tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:28.168511 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9716cc97-612c-417e-87e8-bd3c813c991d tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:28.169228 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9716cc97-612c-417e-87e8-bd3c813c991d tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:28.263646 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-175598fb-0ca5-4380-a11a-a6771b2507e2 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:28.273019 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-175598fb-0ca5-4380-a11a-a6771b2507e2 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/7c7a376f-fa78-4101-adf7-e84f23b4e068" status: 200 len: 1275 microversion: 2.1 time: 0.168463 Oct 18 15:29:28.274274 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 581/1211] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:28 2022] GET /compute/v2.1/servers/7c7a376f-fa78-4101-adf7-e84f23b4e068 => generated 1275 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:28.293098 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bcd8245c-9cd1-4fc7-a811-8e0cbee61ee2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:28.293731 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-bcd8245c-9cd1-4fc7-a811-8e0cbee61ee2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:28.301077 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bcd8245c-9cd1-4fc7-a811-8e0cbee61ee2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:28.302357 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bcd8245c-9cd1-4fc7-a811-8e0cbee61ee2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:28.304035 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bcd8245c-9cd1-4fc7-a811-8e0cbee61ee2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:28.305006 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bcd8245c-9cd1-4fc7-a811-8e0cbee61ee2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:28.305638 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bcd8245c-9cd1-4fc7-a811-8e0cbee61ee2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:28.306240 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bcd8245c-9cd1-4fc7-a811-8e0cbee61ee2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:28.422335 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-bcd8245c-9cd1-4fc7-a811-8e0cbee61ee2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:28.435371 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-bcd8245c-9cd1-4fc7-a811-8e0cbee61ee2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:28.437196 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-bcd8245c-9cd1-4fc7-a811-8e0cbee61ee2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:28.447404 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-bcd8245c-9cd1-4fc7-a811-8e0cbee61ee2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1546 microversion: 2.91 time: 0.171796 Oct 18 15:29:28.450566 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 582/1212] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:28 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1546 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:28.460801 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-d8dc4239-02a3-4e30-b211-26ebafa88485 req-9bb57aea-b3ca-4592-8f08-ee5149f3744f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0a3feae-1805-4c09-881b-99dd257bd9c2", "name": "network-vif-unplugged", "status": "completed", "tag": "e6a47323-8aa2-4713-af2b-48bb88888044"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:29:28.485352 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-d8dc4239-02a3-4e30-b211-26ebafa88485 req-9bb57aea-b3ca-4592-8f08-ee5149f3744f service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:28.491700 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-d8dc4239-02a3-4e30-b211-26ebafa88485 req-9bb57aea-b3ca-4592-8f08-ee5149f3744f service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:28.494786 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-d8dc4239-02a3-4e30-b211-26ebafa88485 req-9bb57aea-b3ca-4592-8f08-ee5149f3744f service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:28.524794 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-d8dc4239-02a3-4e30-b211-26ebafa88485 req-9bb57aea-b3ca-4592-8f08-ee5149f3744f service nova] Creating event network-vif-unplugged:e6a47323-8aa2-4713-af2b-48bb88888044 for instance a0a3feae-1805-4c09-881b-99dd257bd9c2 on n-h1-853682-5 Oct 18 15:29:28.538734 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-d8dc4239-02a3-4e30-b211-26ebafa88485 req-9bb57aea-b3ca-4592-8f08-ee5149f3744f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086415 Oct 18 15:29:28.539825 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 583/1213] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:29:28.549345 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3abc8bd7-013d-4507-9f8b-1086777f9d44 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f2a7d035-dd2d-4d67-9a02-e7aaf58af91a", "device": "/dev/xvdb"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:29:28.553906 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3abc8bd7-013d-4507-9f8b-1086777f9d44 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:28.561702 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3abc8bd7-013d-4507-9f8b-1086777f9d44 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:28.562577 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3abc8bd7-013d-4507-9f8b-1086777f9d44 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:28.563292 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3abc8bd7-013d-4507-9f8b-1086777f9d44 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:28.564262 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3abc8bd7-013d-4507-9f8b-1086777f9d44 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:28.565103 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3abc8bd7-013d-4507-9f8b-1086777f9d44 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:28.565798 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3abc8bd7-013d-4507-9f8b-1086777f9d44 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:28.945037 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9716cc97-612c-417e-87e8-bd3c813c991d tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:28.960102 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9716cc97-612c-417e-87e8-bd3c813c991d tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2" status: 200 len: 1717 microversion: 2.1 time: 0.833146 Oct 18 15:29:28.976949 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 631/1214] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:28 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2 => generated 1717 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:28.987675 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1030fc7b-6a90-4f0f-a0b8-07d752d7748e tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:28.993169 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1030fc7b-6a90-4f0f-a0b8-07d752d7748e tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 4b959d9f-3c8e-44ef-92f1-83cfb8e04804] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:29.004974 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1030fc7b-6a90-4f0f-a0b8-07d752d7748e tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:29.018269 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1030fc7b-6a90-4f0f-a0b8-07d752d7748e tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:29.021585 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1030fc7b-6a90-4f0f-a0b8-07d752d7748e tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:29.024120 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1030fc7b-6a90-4f0f-a0b8-07d752d7748e tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:29.025759 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1030fc7b-6a90-4f0f-a0b8-07d752d7748e tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:29.033616 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1030fc7b-6a90-4f0f-a0b8-07d752d7748e tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:29.128794 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1030fc7b-6a90-4f0f-a0b8-07d752d7748e tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:29.140216 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1030fc7b-6a90-4f0f-a0b8-07d752d7748e tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804" status: 200 len: 1211 microversion: 2.1 time: 0.160701 Oct 18 15:29:29.143531 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 632/1215] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:28 2022] GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804 => generated 1211 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:29.150723 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5c780c67-dd5b-4968-a033-02a2a6a233f6 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:29.151718 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5c780c67-dd5b-4968-a033-02a2a6a233f6 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:29.158934 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c780c67-dd5b-4968-a033-02a2a6a233f6 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:29.159870 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c780c67-dd5b-4968-a033-02a2a6a233f6 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:29.161693 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c780c67-dd5b-4968-a033-02a2a6a233f6 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:29.162777 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c780c67-dd5b-4968-a033-02a2a6a233f6 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:29.163244 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c780c67-dd5b-4968-a033-02a2a6a233f6 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:29.163670 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c780c67-dd5b-4968-a033-02a2a6a233f6 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:29.167078 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:29:29.403224 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5c780c67-dd5b-4968-a033-02a2a6a233f6 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:29.414208 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5c780c67-dd5b-4968-a033-02a2a6a233f6 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:29.416647 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5c780c67-dd5b-4968-a033-02a2a6a233f6 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:29.418110 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5c780c67-dd5b-4968-a033-02a2a6a233f6 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 1880 microversion: 2.42 time: 0.273148 Oct 18 15:29:29.433725 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 633/1216] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:29 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 1880 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:29.443788 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6a1d2972-2d79-4b79-9640-6b72a35d921e tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:29.444702 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6a1d2972-2d79-4b79-9640-6b72a35d921e tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] [instance: 5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:29.451639 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a1d2972-2d79-4b79-9640-6b72a35d921e tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:29.452451 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a1d2972-2d79-4b79-9640-6b72a35d921e tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:29.453112 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a1d2972-2d79-4b79-9640-6b72a35d921e tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:29.454034 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a1d2972-2d79-4b79-9640-6b72a35d921e tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:29.454745 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a1d2972-2d79-4b79-9640-6b72a35d921e tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:29.455530 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a1d2972-2d79-4b79-9640-6b72a35d921e tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:29.637748 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6a1d2972-2d79-4b79-9640-6b72a35d921e tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe80f2ae3ec4365a031ca7472d76e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df909cb429f46c39a83c29fb260b169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:29.646678 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6a1d2972-2d79-4b79-9640-6b72a35d921e tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] 10.222.0.60 "GET /compute/v2.1/servers/5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38" status: 200 len: 1318 microversion: 2.1 time: 0.211472 Oct 18 15:29:29.661275 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 634/1217] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:29 2022] GET /compute/v2.1/servers/5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38 => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:29.667993 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f0baca8f-1789-4a0e-8208-3e998375f91d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:29.668973 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f0baca8f-1789-4a0e-8208-3e998375f91d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 7c7a376f-fa78-4101-adf7-e84f23b4e068] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:29.675260 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f0baca8f-1789-4a0e-8208-3e998375f91d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:29.676050 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f0baca8f-1789-4a0e-8208-3e998375f91d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:29.677292 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f0baca8f-1789-4a0e-8208-3e998375f91d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:29.678245 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f0baca8f-1789-4a0e-8208-3e998375f91d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:29.678932 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f0baca8f-1789-4a0e-8208-3e998375f91d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:29.679603 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f0baca8f-1789-4a0e-8208-3e998375f91d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:29.855628 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f0baca8f-1789-4a0e-8208-3e998375f91d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:29.867397 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f0baca8f-1789-4a0e-8208-3e998375f91d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/7c7a376f-fa78-4101-adf7-e84f23b4e068" status: 200 len: 1317 microversion: 2.1 time: 0.204174 Oct 18 15:29:29.868697 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 635/1218] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:29 2022] GET /compute/v2.1/servers/7c7a376f-fa78-4101-adf7-e84f23b4e068 => generated 1317 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:29.873664 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-20488e22-af23-4fdc-9f9d-689978256a93 req-e3222db3-5d6c-4081-a48b-f8d89dc651e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec3790f8-37cf-4e63-b753-83d38e982580", "name": "network-vif-unplugged", "status": "completed", "tag": "b9fd6f98-f225-43c4-9891-632e489ce46e"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:29:29.883810 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-20488e22-af23-4fdc-9f9d-689978256a93 req-e3222db3-5d6c-4081-a48b-f8d89dc651e6 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:29.884374 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-20488e22-af23-4fdc-9f9d-689978256a93 req-e3222db3-5d6c-4081-a48b-f8d89dc651e6 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:29.885003 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-20488e22-af23-4fdc-9f9d-689978256a93 req-e3222db3-5d6c-4081-a48b-f8d89dc651e6 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:29.897142 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-20488e22-af23-4fdc-9f9d-689978256a93 req-e3222db3-5d6c-4081-a48b-f8d89dc651e6 service nova] Creating event network-vif-unplugged:b9fd6f98-f225-43c4-9891-632e489ce46e for instance ec3790f8-37cf-4e63-b753-83d38e982580 on n-h2-853682-5 Oct 18 15:29:29.902616 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-20488e22-af23-4fdc-9f9d-689978256a93 req-e3222db3-5d6c-4081-a48b-f8d89dc651e6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032366 Oct 18 15:29:29.905154 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 636/1219] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:29:29.914171 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-330ff8ec-0a5d-43e8-b5a0-5a27887be87b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:29.915087 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-330ff8ec-0a5d-43e8-b5a0-5a27887be87b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:29.934884 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-330ff8ec-0a5d-43e8-b5a0-5a27887be87b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:29.935450 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-330ff8ec-0a5d-43e8-b5a0-5a27887be87b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:29.936435 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-330ff8ec-0a5d-43e8-b5a0-5a27887be87b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:29.937441 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-330ff8ec-0a5d-43e8-b5a0-5a27887be87b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:29.937996 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-330ff8ec-0a5d-43e8-b5a0-5a27887be87b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:29.938536 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-330ff8ec-0a5d-43e8-b5a0-5a27887be87b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:30.022160 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-330ff8ec-0a5d-43e8-b5a0-5a27887be87b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:30.031406 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-330ff8ec-0a5d-43e8-b5a0-5a27887be87b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:30.032951 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-330ff8ec-0a5d-43e8-b5a0-5a27887be87b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:30.039285 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-330ff8ec-0a5d-43e8-b5a0-5a27887be87b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1546 microversion: 2.91 time: 0.132555 Oct 18 15:29:30.039879 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 637/1220] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:29 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1546 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:30.044983 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0b5ac4eb-f9b8-47cf-99b7-cd23d97ffebd tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:30.045824 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0b5ac4eb-f9b8-47cf-99b7-cd23d97ffebd tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: bd6231eb-95a4-465e-a859-077a7f82f585] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:30.052953 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b5ac4eb-f9b8-47cf-99b7-cd23d97ffebd tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:30.053828 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b5ac4eb-f9b8-47cf-99b7-cd23d97ffebd tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:30.054488 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b5ac4eb-f9b8-47cf-99b7-cd23d97ffebd tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:30.055443 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b5ac4eb-f9b8-47cf-99b7-cd23d97ffebd tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:30.056139 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b5ac4eb-f9b8-47cf-99b7-cd23d97ffebd tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:30.056900 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b5ac4eb-f9b8-47cf-99b7-cd23d97ffebd tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:30.088714 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0b5ac4eb-f9b8-47cf-99b7-cd23d97ffebd tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: bd6231eb-95a4-465e-a859-077a7f82f585] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:29:30.367709 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0b5ac4eb-f9b8-47cf-99b7-cd23d97ffebd tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "DELETE /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585" status: 204 len: 0 microversion: 2.1 time: 0.326302 Oct 18 15:29:30.368390 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 638/1221] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:29:30 2022] DELETE /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:29:30.373645 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-4fbc9012-f04f-469e-9adb-1a0f9a820bbd req-4e9c1f7e-abfa-483f-89f3-467ae94aa555 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c7a376f-fa78-4101-adf7-e84f23b4e068", "tag": "bfb12eda-2062-4a65-ac38-ccc02fcaf772"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:29:30.382994 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4fbc9012-f04f-469e-9adb-1a0f9a820bbd req-4e9c1f7e-abfa-483f-89f3-467ae94aa555 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:30.383589 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4fbc9012-f04f-469e-9adb-1a0f9a820bbd req-4e9c1f7e-abfa-483f-89f3-467ae94aa555 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:30.384060 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4fbc9012-f04f-469e-9adb-1a0f9a820bbd req-4e9c1f7e-abfa-483f-89f3-467ae94aa555 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:30.396718 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-4fbc9012-f04f-469e-9adb-1a0f9a820bbd req-4e9c1f7e-abfa-483f-89f3-467ae94aa555 service nova] Creating event network-changed:bfb12eda-2062-4a65-ac38-ccc02fcaf772 for instance 7c7a376f-fa78-4101-adf7-e84f23b4e068 on n-h2-853682-5 Oct 18 15:29:30.401502 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-4fbc9012-f04f-469e-9adb-1a0f9a820bbd req-4e9c1f7e-abfa-483f-89f3-467ae94aa555 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031801 Oct 18 15:29:30.402102 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 639/1222] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:29:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:29:30.407578 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7e157150-3aaa-42a7-8165-d75b68b4eeb5 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:30.408272 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7e157150-3aaa-42a7-8165-d75b68b4eeb5 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:30.415086 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e157150-3aaa-42a7-8165-d75b68b4eeb5 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:30.415573 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e157150-3aaa-42a7-8165-d75b68b4eeb5 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:30.416106 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e157150-3aaa-42a7-8165-d75b68b4eeb5 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:30.416914 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e157150-3aaa-42a7-8165-d75b68b4eeb5 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:30.417374 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e157150-3aaa-42a7-8165-d75b68b4eeb5 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:30.417798 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e157150-3aaa-42a7-8165-d75b68b4eeb5 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:30.563733 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7e157150-3aaa-42a7-8165-d75b68b4eeb5 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:30.573651 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7e157150-3aaa-42a7-8165-d75b68b4eeb5 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2" status: 200 len: 1717 microversion: 2.1 time: 0.170346 Oct 18 15:29:30.574443 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 640/1223] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:30 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2 => generated 1717 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:30.579314 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e66eb005-12a4-4109-b358-84ff12cce383 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:30.579937 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e66eb005-12a4-4109-b358-84ff12cce383 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 4b959d9f-3c8e-44ef-92f1-83cfb8e04804] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:30.589003 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e66eb005-12a4-4109-b358-84ff12cce383 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:30.589983 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e66eb005-12a4-4109-b358-84ff12cce383 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:30.590693 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e66eb005-12a4-4109-b358-84ff12cce383 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:30.591409 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e66eb005-12a4-4109-b358-84ff12cce383 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:30.591867 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e66eb005-12a4-4109-b358-84ff12cce383 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:30.592751 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e66eb005-12a4-4109-b358-84ff12cce383 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:30.673238 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e66eb005-12a4-4109-b358-84ff12cce383 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:30.692912 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e66eb005-12a4-4109-b358-84ff12cce383 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804" status: 200 len: 1211 microversion: 2.1 time: 0.112830 Oct 18 15:29:30.692912 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 641/1224] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:30 2022] GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804 => generated 1211 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:30.695442 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c444bb6d-e004-4851-a9a1-65717d423221 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:30.696133 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c444bb6d-e004-4851-a9a1-65717d423221 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: bd6231eb-95a4-465e-a859-077a7f82f585] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:30.702601 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c444bb6d-e004-4851-a9a1-65717d423221 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:30.703104 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c444bb6d-e004-4851-a9a1-65717d423221 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:30.703545 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c444bb6d-e004-4851-a9a1-65717d423221 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:30.704250 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c444bb6d-e004-4851-a9a1-65717d423221 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:30.704909 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c444bb6d-e004-4851-a9a1-65717d423221 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:30.705354 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c444bb6d-e004-4851-a9a1-65717d423221 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:30.837918 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c444bb6d-e004-4851-a9a1-65717d423221 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1023300147f463e8f0894981948f825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac07f1b2c83a4faab175a5b9ed8e315e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:30.845722 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c444bb6d-e004-4851-a9a1-65717d423221 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585" status: 200 len: 1512 microversion: 2.1 time: 0.155568 Oct 18 15:29:30.846309 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 642/1225] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:30 2022] GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585 => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:30.850716 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5dcfa793-e623-4d7e-8277-2d83f4f9bfb1 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:30.851316 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5dcfa793-e623-4d7e-8277-2d83f4f9bfb1 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:30.856983 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5dcfa793-e623-4d7e-8277-2d83f4f9bfb1 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:30.857467 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5dcfa793-e623-4d7e-8277-2d83f4f9bfb1 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:30.857901 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5dcfa793-e623-4d7e-8277-2d83f4f9bfb1 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:30.858587 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5dcfa793-e623-4d7e-8277-2d83f4f9bfb1 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:30.859037 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5dcfa793-e623-4d7e-8277-2d83f4f9bfb1 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:30.859459 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5dcfa793-e623-4d7e-8277-2d83f4f9bfb1 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:31.040988 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5dcfa793-e623-4d7e-8277-2d83f4f9bfb1 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:31.049946 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5dcfa793-e623-4d7e-8277-2d83f4f9bfb1 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:31.051359 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5dcfa793-e623-4d7e-8277-2d83f4f9bfb1 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:31.053064 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5dcfa793-e623-4d7e-8277-2d83f4f9bfb1 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 1880 microversion: 2.42 time: 0.205799 Oct 18 15:29:31.053597 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 643/1226] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:30 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 1880 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:31.057904 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-07c8e798-abac-4b4b-bee6-3c5b7d72ecfc req-097f6347-9d72-41dc-ae45-a64613c7f212 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0a3feae-1805-4c09-881b-99dd257bd9c2", "tag": "e6a47323-8aa2-4713-af2b-48bb88888044"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:29:31.068000 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-07c8e798-abac-4b4b-bee6-3c5b7d72ecfc req-097f6347-9d72-41dc-ae45-a64613c7f212 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:31.068485 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-07c8e798-abac-4b4b-bee6-3c5b7d72ecfc req-097f6347-9d72-41dc-ae45-a64613c7f212 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:31.068940 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-07c8e798-abac-4b4b-bee6-3c5b7d72ecfc req-097f6347-9d72-41dc-ae45-a64613c7f212 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:31.079757 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-07c8e798-abac-4b4b-bee6-3c5b7d72ecfc req-097f6347-9d72-41dc-ae45-a64613c7f212 service nova] Creating event network-changed:e6a47323-8aa2-4713-af2b-48bb88888044 for instance a0a3feae-1805-4c09-881b-99dd257bd9c2 on n-h1-853682-5 Oct 18 15:29:31.084895 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-07c8e798-abac-4b4b-bee6-3c5b7d72ecfc req-097f6347-9d72-41dc-ae45-a64613c7f212 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030185 Oct 18 15:29:31.085741 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 644/1227] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:29:31.090615 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8e9e247d-e241-4c69-8fdb-8449a00740ae tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:31.091304 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8e9e247d-e241-4c69-8fdb-8449a00740ae tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] [instance: 5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:31.097121 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e9e247d-e241-4c69-8fdb-8449a00740ae tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:31.097601 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e9e247d-e241-4c69-8fdb-8449a00740ae tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:31.098029 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e9e247d-e241-4c69-8fdb-8449a00740ae tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:31.098733 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e9e247d-e241-4c69-8fdb-8449a00740ae tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:31.099184 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e9e247d-e241-4c69-8fdb-8449a00740ae tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:31.099654 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e9e247d-e241-4c69-8fdb-8449a00740ae tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:31.229466 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8e9e247d-e241-4c69-8fdb-8449a00740ae tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe80f2ae3ec4365a031ca7472d76e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df909cb429f46c39a83c29fb260b169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:31.237089 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8e9e247d-e241-4c69-8fdb-8449a00740ae tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] 10.222.0.60 "GET /compute/v2.1/servers/5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38" status: 200 len: 1318 microversion: 2.1 time: 0.150244 Oct 18 15:29:31.237666 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 645/1228] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:31 2022] GET /compute/v2.1/servers/5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:31.242605 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-36104325-7130-40df-b580-9e45fa4477db tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:31.243208 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-36104325-7130-40df-b580-9e45fa4477db tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 7c7a376f-fa78-4101-adf7-e84f23b4e068] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:31.248756 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36104325-7130-40df-b580-9e45fa4477db tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:31.249276 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36104325-7130-40df-b580-9e45fa4477db tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:31.249709 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36104325-7130-40df-b580-9e45fa4477db tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:31.250403 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36104325-7130-40df-b580-9e45fa4477db tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:31.250894 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36104325-7130-40df-b580-9e45fa4477db tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:31.251320 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36104325-7130-40df-b580-9e45fa4477db tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:31.382943 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-36104325-7130-40df-b580-9e45fa4477db tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:31.391001 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-36104325-7130-40df-b580-9e45fa4477db tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/7c7a376f-fa78-4101-adf7-e84f23b4e068" status: 200 len: 1317 microversion: 2.1 time: 0.152401 Oct 18 15:29:31.391560 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 646/1229] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:31 2022] GET /compute/v2.1/servers/7c7a376f-fa78-4101-adf7-e84f23b4e068 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:31.395989 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-465f2403-0a55-4c95-a42c-6793ec325a10 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:31.396589 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-465f2403-0a55-4c95-a42c-6793ec325a10 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:31.402630 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-465f2403-0a55-4c95-a42c-6793ec325a10 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:31.403392 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-465f2403-0a55-4c95-a42c-6793ec325a10 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:31.403834 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-465f2403-0a55-4c95-a42c-6793ec325a10 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:31.404525 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-465f2403-0a55-4c95-a42c-6793ec325a10 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:31.405020 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-465f2403-0a55-4c95-a42c-6793ec325a10 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:31.405447 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-465f2403-0a55-4c95-a42c-6793ec325a10 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:31.470448 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-465f2403-0a55-4c95-a42c-6793ec325a10 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:31.479136 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-465f2403-0a55-4c95-a42c-6793ec325a10 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:31.480518 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-465f2403-0a55-4c95-a42c-6793ec325a10 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:31.485290 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-465f2403-0a55-4c95-a42c-6793ec325a10 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1546 microversion: 2.91 time: 0.092787 Oct 18 15:29:31.485861 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 647/1230] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:31 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1546 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:31.597439 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-edd0b661-1767-41d4-8b59-94304f6bc84b tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:31.598050 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-edd0b661-1767-41d4-8b59-94304f6bc84b tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:31.604438 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-edd0b661-1767-41d4-8b59-94304f6bc84b tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:31.604946 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-edd0b661-1767-41d4-8b59-94304f6bc84b tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:31.605380 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-edd0b661-1767-41d4-8b59-94304f6bc84b tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:31.606073 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-edd0b661-1767-41d4-8b59-94304f6bc84b tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:31.606526 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-edd0b661-1767-41d4-8b59-94304f6bc84b tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:31.606962 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-edd0b661-1767-41d4-8b59-94304f6bc84b tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:31.735394 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-edd0b661-1767-41d4-8b59-94304f6bc84b tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:31.743644 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-edd0b661-1767-41d4-8b59-94304f6bc84b tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2" status: 200 len: 1717 microversion: 2.1 time: 0.150081 Oct 18 15:29:31.744207 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 648/1231] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:31 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2 => generated 1717 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:29:31.748638 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d2e54d11-043c-4abe-9988-7ecd42aa6dea tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:31.749273 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d2e54d11-043c-4abe-9988-7ecd42aa6dea tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 4b959d9f-3c8e-44ef-92f1-83cfb8e04804] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:31.754868 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2e54d11-043c-4abe-9988-7ecd42aa6dea tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:31.755350 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2e54d11-043c-4abe-9988-7ecd42aa6dea tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:31.755786 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2e54d11-043c-4abe-9988-7ecd42aa6dea tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:31.757389 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2e54d11-043c-4abe-9988-7ecd42aa6dea tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:31.757852 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2e54d11-043c-4abe-9988-7ecd42aa6dea tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:31.758716 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2e54d11-043c-4abe-9988-7ecd42aa6dea tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:31.842618 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d2e54d11-043c-4abe-9988-7ecd42aa6dea tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:31.850350 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d2e54d11-043c-4abe-9988-7ecd42aa6dea tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804" status: 200 len: 1211 microversion: 2.1 time: 0.105204 Oct 18 15:29:31.850907 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 649/1232] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:31 2022] GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804 => generated 1211 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:31.868122 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c88b753c-8da1-484f-8976-35c394bbc023 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:31.868748 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c88b753c-8da1-484f-8976-35c394bbc023 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: bd6231eb-95a4-465e-a859-077a7f82f585] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:31.874629 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c88b753c-8da1-484f-8976-35c394bbc023 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:31.875117 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c88b753c-8da1-484f-8976-35c394bbc023 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:31.875548 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c88b753c-8da1-484f-8976-35c394bbc023 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:31.876232 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c88b753c-8da1-484f-8976-35c394bbc023 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:31.876681 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c88b753c-8da1-484f-8976-35c394bbc023 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:31.877219 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c88b753c-8da1-484f-8976-35c394bbc023 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:31.881739 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:29:32.015944 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c88b753c-8da1-484f-8976-35c394bbc023 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1023300147f463e8f0894981948f825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac07f1b2c83a4faab175a5b9ed8e315e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:32.024027 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c88b753c-8da1-484f-8976-35c394bbc023 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585" status: 200 len: 1512 microversion: 2.1 time: 0.160275 Oct 18 15:29:32.024706 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 650/1233] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:31 2022] GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585 => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:29:32.079258 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0255ef7a-4d56-4112-a4dc-9d284f6e9378 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:32.079871 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0255ef7a-4d56-4112-a4dc-9d284f6e9378 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:32.086591 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0255ef7a-4d56-4112-a4dc-9d284f6e9378 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:32.087079 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0255ef7a-4d56-4112-a4dc-9d284f6e9378 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:32.087513 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0255ef7a-4d56-4112-a4dc-9d284f6e9378 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:32.088264 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0255ef7a-4d56-4112-a4dc-9d284f6e9378 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:32.088721 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0255ef7a-4d56-4112-a4dc-9d284f6e9378 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:32.089171 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0255ef7a-4d56-4112-a4dc-9d284f6e9378 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:32.276538 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0255ef7a-4d56-4112-a4dc-9d284f6e9378 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:32.285637 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0255ef7a-4d56-4112-a4dc-9d284f6e9378 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:32.287572 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0255ef7a-4d56-4112-a4dc-9d284f6e9378 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:32.288718 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0255ef7a-4d56-4112-a4dc-9d284f6e9378 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 1880 microversion: 2.42 time: 0.213472 Oct 18 15:29:32.289291 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 651/1234] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:32 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 1880 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:29:32.293721 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-af00ca7c-28cf-4450-8ad4-4377cdeda875 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:32.294980 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-af00ca7c-28cf-4450-8ad4-4377cdeda875 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] [instance: 5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:32.300166 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af00ca7c-28cf-4450-8ad4-4377cdeda875 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:32.300643 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af00ca7c-28cf-4450-8ad4-4377cdeda875 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:32.301105 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af00ca7c-28cf-4450-8ad4-4377cdeda875 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:32.302370 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af00ca7c-28cf-4450-8ad4-4377cdeda875 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:32.302818 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af00ca7c-28cf-4450-8ad4-4377cdeda875 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:32.303239 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af00ca7c-28cf-4450-8ad4-4377cdeda875 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:32.434310 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-af00ca7c-28cf-4450-8ad4-4377cdeda875 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe80f2ae3ec4365a031ca7472d76e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df909cb429f46c39a83c29fb260b169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:32.442061 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-af00ca7c-28cf-4450-8ad4-4377cdeda875 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] 10.222.0.60 "GET /compute/v2.1/servers/5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38" status: 200 len: 1467 microversion: 2.1 time: 0.151795 Oct 18 15:29:32.442630 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 652/1235] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:32 2022] GET /compute/v2.1/servers/5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38 => generated 1467 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:32.447518 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8cfb6059-e7ba-4553-a7d3-c4b091fafc86 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:32.448031 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8cfb6059-e7ba-4553-a7d3-c4b091fafc86 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 7c7a376f-fa78-4101-adf7-e84f23b4e068] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:32.454363 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8cfb6059-e7ba-4553-a7d3-c4b091fafc86 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:32.454847 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8cfb6059-e7ba-4553-a7d3-c4b091fafc86 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:32.455279 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8cfb6059-e7ba-4553-a7d3-c4b091fafc86 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:32.455971 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8cfb6059-e7ba-4553-a7d3-c4b091fafc86 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:32.456453 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8cfb6059-e7ba-4553-a7d3-c4b091fafc86 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:32.456982 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8cfb6059-e7ba-4553-a7d3-c4b091fafc86 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:32.596287 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8cfb6059-e7ba-4553-a7d3-c4b091fafc86 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:32.604915 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8cfb6059-e7ba-4553-a7d3-c4b091fafc86 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/7c7a376f-fa78-4101-adf7-e84f23b4e068" status: 200 len: 1317 microversion: 2.1 time: 0.161206 Oct 18 15:29:32.605496 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 653/1236] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:32 2022] GET /compute/v2.1/servers/7c7a376f-fa78-4101-adf7-e84f23b4e068 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:32.660152 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-aa51a999-001c-44d1-a3b2-536f657866ed tempest-LiveMigrationNegativeTest-41355881 tempest-LiveMigrationNegativeTest-41355881-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-405310270", "block_migration": true, "disk_over_commit": false}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:29:32.663280 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-aa51a999-001c-44d1-a3b2-536f657866ed tempest-LiveMigrationNegativeTest-41355881 tempest-LiveMigrationNegativeTest-41355881-project-admin] [instance: 5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:32.669401 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa51a999-001c-44d1-a3b2-536f657866ed tempest-LiveMigrationNegativeTest-41355881 tempest-LiveMigrationNegativeTest-41355881-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:32.669886 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa51a999-001c-44d1-a3b2-536f657866ed tempest-LiveMigrationNegativeTest-41355881 tempest-LiveMigrationNegativeTest-41355881-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:32.670325 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa51a999-001c-44d1-a3b2-536f657866ed tempest-LiveMigrationNegativeTest-41355881 tempest-LiveMigrationNegativeTest-41355881-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:32.671022 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa51a999-001c-44d1-a3b2-536f657866ed tempest-LiveMigrationNegativeTest-41355881 tempest-LiveMigrationNegativeTest-41355881-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:32.671476 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa51a999-001c-44d1-a3b2-536f657866ed tempest-LiveMigrationNegativeTest-41355881 tempest-LiveMigrationNegativeTest-41355881-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:32.671899 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa51a999-001c-44d1-a3b2-536f657866ed tempest-LiveMigrationNegativeTest-41355881 tempest-LiveMigrationNegativeTest-41355881-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:32.697000 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-aa51a999-001c-44d1-a3b2-536f657866ed tempest-LiveMigrationNegativeTest-41355881 tempest-LiveMigrationNegativeTest-41355881-project-admin] Lazy-loading 'flavor' on Instance uuid 5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:29:32.709504 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-aa51a999-001c-44d1-a3b2-536f657866ed tempest-LiveMigrationNegativeTest-41355881 tempest-LiveMigrationNegativeTest-41355881-project-admin] [instance: 5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38] Going to try to live migrate instance to tempest-host-405310270 {{(pid=120406) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 18 15:29:32.716301 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-aa51a999-001c-44d1-a3b2-536f657866ed tempest-LiveMigrationNegativeTest-41355881 tempest-LiveMigrationNegativeTest-41355881-project-admin] HTTP exception thrown: Compute host tempest-host-405310270 could not be found. Oct 18 15:29:32.725353 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-aa51a999-001c-44d1-a3b2-536f657866ed tempest-LiveMigrationNegativeTest-41355881 tempest-LiveMigrationNegativeTest-41355881-project-admin] Request method failure captured: Oct 18 15:29:32.725353 n-d-853682-5 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers/5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38/action HTTP/1.1 Oct 18 15:29:32.725353 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:29:32.725353 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:29:32.725353 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:29:32.725353 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 106 Oct 18 15:29:32.725353 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:29:32.725353 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:29:32.725353 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:29:32.725353 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:29:32.725353 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsZAc0h-P-HzZqJZVANcDYwvfBKk_4Qsdn8j0MmmDxq8GR5pEMWLhjT9iyU0iIFSOAoteby0EYGYLpFjuW4cSAEZfUCqZWQzyqvZbWmaly2aSDsdQFLcAc0XE4TMq9do4mO457MDQwNwBFgdkuaRmyMZ4J1TyzGn16lWNN3RBXVLTpw Oct 18 15:29:32.725353 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:29:32.725353 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:29:32.725353 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:29:32.725353 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:29:32.725353 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:29:32.725353 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:29:32.725353 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 80b61cbce55b48629f9c838f79180443 Oct 18 15:29:32.725353 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-LiveMigrationNegativeTest-41355881 Oct 18 15:29:32.725353 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,admin,reader Oct 18 15:29:32.725353 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,admin,reader Oct 18 15:29:32.726857 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/80b61cbce55b48629f9c838f79180443"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/80b61cbce55b48629f9c838f79180443"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/80b61cbce55b48629f9c838f79180443"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_80b61cbce55b48629f9c838f79180443"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:29:32.726857 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-LiveMigrationNegativeTest-41355881 Oct 18 15:29:32.726857 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 80b61cbce55b48629f9c838f79180443 Oct 18 15:29:32.726857 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-41355881 Oct 18 15:29:32.726857 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-LiveMigrationNegativeTest-41355881-project-admin Oct 18 15:29:32.726857 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:29:32.726857 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:29:32.726857 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: b8fcc2f71b274d9aba6b35987c68da2f Oct 18 15:29:32.726857 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-LiveMigrationNegativeTest-41355881-project-admin Oct 18 15:29:32.726857 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:29:32.726857 n-d-853682-5 devstack@n-api.service[120406]: {"os-migrateLive": {"host": "tempest-host-405310270", "block_migration": true, "disk_over_commit": false}} Oct 18 15:29:32.726857 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:29:32.727938 n-d-853682-5 devstack@n-api.service[120406]: exception: Compute host tempest-host-405310270 could not be found. Oct 18 15:29:32.727938 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38', 'body': {'os-migrateLive': {'host': 'tempest-host-405310270', 'block_migration': True, 'disk_over_commit': False}}} Oct 18 15:29:32.727938 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:29:32.727938 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:29:32.727938 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 18 15:29:32.727938 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 18 15:29:32.727938 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 18 15:29:32.727938 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 15:29:32.727938 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 18 15:29:32.727938 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 15:29:32.727938 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 18 15:29:32.727938 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 15:29:32.727938 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 18 15:29:32.727938 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 15:29:32.727938 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 18 15:29:32.727938 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 15:29:32.727938 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 18 15:29:32.727938 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 15:29:32.727938 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 15:29:32.729590 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 15:29:32.729590 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 18 15:29:32.729590 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 15:29:32.729590 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Oct 18 15:29:32.729590 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 18 15:29:32.729590 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 15:29:32.729590 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 15:29:32.729590 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 18 15:29:32.729590 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 18 15:29:32.729590 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 18 15:29:32.729590 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:29:32.729590 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 18 15:29:32.729590 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 18 15:29:32.729590 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 18 15:29:32.729590 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 18 15:29:32.729590 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 18 15:29:32.729590 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 18 15:29:32.729590 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-405310270 could not be found. Oct 18 15:29:32.729590 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:29:32.731483 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:29:32.731483 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:29:32.731483 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:29:32.731483 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:29:32.731483 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:29:32.731483 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:29:32.731483 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:29:32.731483 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:29:32.731483 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:29:32.731483 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:29:32.731483 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:29:32.731483 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:29:32.731483 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:29:32.731483 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:29:32.731483 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:29:32.731483 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 18 15:29:32.731483 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 18 15:29:32.731483 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 18 15:29:32.731483 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-405310270 could not be found. Oct 18 15:29:32.731483 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:29:32.733068 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:29:32.733068 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:29:32.733068 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:29:32.733068 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:29:32.733068 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:29:32.733068 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:29:32.733068 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:29:32.733068 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-405310270 could not be found. Oct 18 15:29:32.733068 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:29:32.733068 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-aa51a999-001c-44d1-a3b2-536f657866ed tempest-LiveMigrationNegativeTest-41355881 tempest-LiveMigrationNegativeTest-41355881-project-admin] Returning 400 to user: Compute host tempest-host-405310270 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:29:32.733068 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-aa51a999-001c-44d1-a3b2-536f657866ed tempest-LiveMigrationNegativeTest-41355881 tempest-LiveMigrationNegativeTest-41355881-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38/action" status: 400 len: 99 microversion: 2.1 time: 0.120347 Oct 18 15:29:32.733068 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 654/1237] 10.222.0.60 () {60 vars in 1279 bytes} [Tue Oct 18 15:29:32 2022] POST /compute/v2.1/servers/5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38/action => generated 99 bytes in 121 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 18 15:29:32.734028 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d44a9278-cfb7-430b-85de-e9c9c5b03afb tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:32.734028 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d44a9278-cfb7-430b-85de-e9c9c5b03afb tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:32.738867 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d44a9278-cfb7-430b-85de-e9c9c5b03afb tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:32.739500 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d44a9278-cfb7-430b-85de-e9c9c5b03afb tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:32.739936 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d44a9278-cfb7-430b-85de-e9c9c5b03afb tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:32.740630 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d44a9278-cfb7-430b-85de-e9c9c5b03afb tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:32.741104 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d44a9278-cfb7-430b-85de-e9c9c5b03afb tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:32.741529 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d44a9278-cfb7-430b-85de-e9c9c5b03afb tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:32.807558 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d44a9278-cfb7-430b-85de-e9c9c5b03afb tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:32.815658 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d44a9278-cfb7-430b-85de-e9c9c5b03afb tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:32.817660 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d44a9278-cfb7-430b-85de-e9c9c5b03afb tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:32.822464 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d44a9278-cfb7-430b-85de-e9c9c5b03afb tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1546 microversion: 2.91 time: 0.094260 Oct 18 15:29:32.823022 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 655/1238] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:32 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1546 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:32.827703 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-111d7cd8-f008-4947-9681-5357d5ed412d tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:32.828308 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-111d7cd8-f008-4947-9681-5357d5ed412d tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] [instance: 5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:32.829882 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:29:32.835865 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-111d7cd8-f008-4947-9681-5357d5ed412d tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:32.836343 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-111d7cd8-f008-4947-9681-5357d5ed412d tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:32.836775 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-111d7cd8-f008-4947-9681-5357d5ed412d tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:32.837486 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-111d7cd8-f008-4947-9681-5357d5ed412d tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:32.837949 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-111d7cd8-f008-4947-9681-5357d5ed412d tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:32.838371 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-111d7cd8-f008-4947-9681-5357d5ed412d tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:32.968277 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-111d7cd8-f008-4947-9681-5357d5ed412d tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe80f2ae3ec4365a031ca7472d76e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df909cb429f46c39a83c29fb260b169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:32.975950 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-111d7cd8-f008-4947-9681-5357d5ed412d tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] 10.222.0.60 "GET /compute/v2.1/servers/5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38" status: 200 len: 1467 microversion: 2.1 time: 0.152002 Oct 18 15:29:32.976508 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 656/1239] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:32 2022] GET /compute/v2.1/servers/5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38 => generated 1467 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:32.981095 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-403e437b-60f8-4a74-af0c-2d1a4e22b2bb tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:32.981692 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-403e437b-60f8-4a74-af0c-2d1a4e22b2bb tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:32.987376 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-403e437b-60f8-4a74-af0c-2d1a4e22b2bb tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:32.987886 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-403e437b-60f8-4a74-af0c-2d1a4e22b2bb tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:32.988320 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-403e437b-60f8-4a74-af0c-2d1a4e22b2bb tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:32.989040 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-403e437b-60f8-4a74-af0c-2d1a4e22b2bb tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:32.989500 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-403e437b-60f8-4a74-af0c-2d1a4e22b2bb tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:32.989944 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-403e437b-60f8-4a74-af0c-2d1a4e22b2bb tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:33.126789 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-403e437b-60f8-4a74-af0c-2d1a4e22b2bb tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:33.135758 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-403e437b-60f8-4a74-af0c-2d1a4e22b2bb tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2" status: 200 len: 1717 microversion: 2.1 time: 0.158123 Oct 18 15:29:33.136324 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 657/1240] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:32 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2 => generated 1717 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:33.141004 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-243a22da-13d0-4402-a5fa-e036e1f5e956 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:33.141606 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-243a22da-13d0-4402-a5fa-e036e1f5e956 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 4b959d9f-3c8e-44ef-92f1-83cfb8e04804] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:33.147587 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-243a22da-13d0-4402-a5fa-e036e1f5e956 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:33.148067 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-243a22da-13d0-4402-a5fa-e036e1f5e956 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:33.148498 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-243a22da-13d0-4402-a5fa-e036e1f5e956 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:33.149204 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-243a22da-13d0-4402-a5fa-e036e1f5e956 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:33.149660 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-243a22da-13d0-4402-a5fa-e036e1f5e956 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:33.150079 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-243a22da-13d0-4402-a5fa-e036e1f5e956 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:33.216723 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-243a22da-13d0-4402-a5fa-e036e1f5e956 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:33.224632 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-243a22da-13d0-4402-a5fa-e036e1f5e956 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804" status: 200 len: 1211 microversion: 2.1 time: 0.087300 Oct 18 15:29:33.225250 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 658/1241] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:33 2022] GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804 => generated 1211 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:33.229714 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-74f5e3e4-3c45-4136-86b7-b3d425c4280b tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:33.230320 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-74f5e3e4-3c45-4136-86b7-b3d425c4280b tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: bd6231eb-95a4-465e-a859-077a7f82f585] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:33.236407 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-74f5e3e4-3c45-4136-86b7-b3d425c4280b tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:33.236927 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-74f5e3e4-3c45-4136-86b7-b3d425c4280b tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:33.237371 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-74f5e3e4-3c45-4136-86b7-b3d425c4280b tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:33.238103 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-74f5e3e4-3c45-4136-86b7-b3d425c4280b tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:33.238565 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-74f5e3e4-3c45-4136-86b7-b3d425c4280b tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:33.239484 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-74f5e3e4-3c45-4136-86b7-b3d425c4280b tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:33.379060 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-74f5e3e4-3c45-4136-86b7-b3d425c4280b tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1023300147f463e8f0894981948f825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac07f1b2c83a4faab175a5b9ed8e315e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:33.387257 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-74f5e3e4-3c45-4136-86b7-b3d425c4280b tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585" status: 200 len: 1512 microversion: 2.1 time: 0.161062 Oct 18 15:29:33.387826 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 659/1242] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:33 2022] GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585 => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:33.392370 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c4477f97-9bd5-4bca-ac90-c54aed3c03e7 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-934311984", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:29:33.449823 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-c4477f97-9bd5-4bca-ac90-c54aed3c03e7 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] validate_networks() for None {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:29:33.661190 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-c4477f97-9bd5-4bca-ac90-c54aed3c03e7 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:29:33.661684 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-c4477f97-9bd5-4bca-ac90-c54aed3c03e7 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:29:33.662303 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-c4477f97-9bd5-4bca-ac90-c54aed3c03e7 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:29:33.662806 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-c4477f97-9bd5-4bca-ac90-c54aed3c03e7 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:29:33.663332 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-c4477f97-9bd5-4bca-ac90-c54aed3c03e7 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:29:33.672318 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4477f97-9bd5-4bca-ac90-c54aed3c03e7 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:33.672802 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4477f97-9bd5-4bca-ac90-c54aed3c03e7 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:33.673272 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4477f97-9bd5-4bca-ac90-c54aed3c03e7 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:33.674004 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4477f97-9bd5-4bca-ac90-c54aed3c03e7 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:33.674464 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4477f97-9bd5-4bca-ac90-c54aed3c03e7 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:33.674892 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4477f97-9bd5-4bca-ac90-c54aed3c03e7 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:33.691725 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-c4477f97-9bd5-4bca-ac90-c54aed3c03e7 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Getting quotas for project 5df909cb429f46c39a83c29fb260b169. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:29:33.697501 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-c4477f97-9bd5-4bca-ac90-c54aed3c03e7 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Getting quotas for user ebe80f2ae3ec4365a031ca7472d76e33 and project 5df909cb429f46c39a83c29fb260b169. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:29:33.710689 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c4477f97-9bd5-4bca-ac90-c54aed3c03e7 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:29:33.713021 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c4477f97-9bd5-4bca-ac90-c54aed3c03e7 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] [instance: 74e5ae75-9c35-4610-9cb5-61afa6f98581] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:29:33.758667 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c4477f97-9bd5-4bca-ac90-c54aed3c03e7 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.369825 Oct 18 15:29:33.759772 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 660/1243] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:29:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 371 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:29:33.764358 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d51a6f1d-211e-45e7-94cf-dc6a321c4a38 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:33.765160 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d51a6f1d-211e-45e7-94cf-dc6a321c4a38 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:33.772388 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d51a6f1d-211e-45e7-94cf-dc6a321c4a38 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:33.772900 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d51a6f1d-211e-45e7-94cf-dc6a321c4a38 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:33.773344 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d51a6f1d-211e-45e7-94cf-dc6a321c4a38 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:33.774049 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d51a6f1d-211e-45e7-94cf-dc6a321c4a38 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:33.774509 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d51a6f1d-211e-45e7-94cf-dc6a321c4a38 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:33.774937 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d51a6f1d-211e-45e7-94cf-dc6a321c4a38 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:33.968614 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d51a6f1d-211e-45e7-94cf-dc6a321c4a38 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:33.978822 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d51a6f1d-211e-45e7-94cf-dc6a321c4a38 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:33.980263 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d51a6f1d-211e-45e7-94cf-dc6a321c4a38 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:33.981457 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d51a6f1d-211e-45e7-94cf-dc6a321c4a38 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 1880 microversion: 2.42 time: 0.220765 Oct 18 15:29:34.001032 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 661/1244] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:33 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 1880 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:34.011211 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-872bb8ba-423a-4a02-ab59-766765b0c1cd tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:34.011923 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-872bb8ba-423a-4a02-ab59-766765b0c1cd tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 7c7a376f-fa78-4101-adf7-e84f23b4e068] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:34.018058 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-872bb8ba-423a-4a02-ab59-766765b0c1cd tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:34.018541 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-872bb8ba-423a-4a02-ab59-766765b0c1cd tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:34.018975 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-872bb8ba-423a-4a02-ab59-766765b0c1cd tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:34.019783 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-872bb8ba-423a-4a02-ab59-766765b0c1cd tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:34.020257 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-872bb8ba-423a-4a02-ab59-766765b0c1cd tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:34.023027 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-872bb8ba-423a-4a02-ab59-766765b0c1cd tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:34.118959 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3abc8bd7-013d-4507-9f8b-1086777f9d44 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "POST /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 5.577324 Oct 18 15:29:34.120637 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 584/1245] 10.222.0.60 () {62 vars in 1364 bytes} [Tue Oct 18 15:29:28 2022] POST /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793/os-volume_attachments => generated 194 bytes in 5580 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:29:34.142792 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c9a40059-f3ff-498d-b15d-1dfb872b6238 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:34.144104 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c9a40059-f3ff-498d-b15d-1dfb872b6238 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] [instance: 74e5ae75-9c35-4610-9cb5-61afa6f98581] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:34.250498 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c9a40059-f3ff-498d-b15d-1dfb872b6238 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe80f2ae3ec4365a031ca7472d76e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df909cb429f46c39a83c29fb260b169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:34.258481 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c9a40059-f3ff-498d-b15d-1dfb872b6238 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] 10.222.0.60 "GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581" status: 200 len: 1218 microversion: 2.1 time: 0.136345 Oct 18 15:29:34.259046 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 585/1246] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:34 2022] GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581 => generated 1218 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:34.265325 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8bc139ba-c172-4d85-a028-45bf4920b8e3 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:34.266023 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8bc139ba-c172-4d85-a028-45bf4920b8e3 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:34.276485 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8bc139ba-c172-4d85-a028-45bf4920b8e3 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:34.277121 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8bc139ba-c172-4d85-a028-45bf4920b8e3 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:34.277568 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8bc139ba-c172-4d85-a028-45bf4920b8e3 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:34.278288 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8bc139ba-c172-4d85-a028-45bf4920b8e3 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:34.278540 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-872bb8ba-423a-4a02-ab59-766765b0c1cd tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:34.279034 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8bc139ba-c172-4d85-a028-45bf4920b8e3 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:34.279175 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8bc139ba-c172-4d85-a028-45bf4920b8e3 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:34.286884 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-872bb8ba-423a-4a02-ab59-766765b0c1cd tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/7c7a376f-fa78-4101-adf7-e84f23b4e068" status: 200 len: 1317 microversion: 2.1 time: 0.284810 Oct 18 15:29:34.287778 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 662/1247] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:34 2022] GET /compute/v2.1/servers/7c7a376f-fa78-4101-adf7-e84f23b4e068 => generated 1317 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:34.292447 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3006e6e9-d09b-4db8-8eac-1acb543281ba tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:34.293069 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3006e6e9-d09b-4db8-8eac-1acb543281ba tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:34.299128 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3006e6e9-d09b-4db8-8eac-1acb543281ba tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:34.299727 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3006e6e9-d09b-4db8-8eac-1acb543281ba tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:34.300167 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3006e6e9-d09b-4db8-8eac-1acb543281ba tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:34.300869 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3006e6e9-d09b-4db8-8eac-1acb543281ba tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:34.301325 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3006e6e9-d09b-4db8-8eac-1acb543281ba tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:34.302268 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3006e6e9-d09b-4db8-8eac-1acb543281ba tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:34.347932 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8bc139ba-c172-4d85-a028-45bf4920b8e3 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:34.357414 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8bc139ba-c172-4d85-a028-45bf4920b8e3 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:34.358865 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8bc139ba-c172-4d85-a028-45bf4920b8e3 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:34.363885 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8bc139ba-c172-4d85-a028-45bf4920b8e3 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1546 microversion: 2.91 time: 0.103880 Oct 18 15:29:34.365221 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 586/1248] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:34 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1546 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:34.369860 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7ec5cbe7-8dc2-4fa8-a049-0881a568e582 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:34.370509 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7ec5cbe7-8dc2-4fa8-a049-0881a568e582 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 4b959d9f-3c8e-44ef-92f1-83cfb8e04804] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:34.376543 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7ec5cbe7-8dc2-4fa8-a049-0881a568e582 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:34.377303 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7ec5cbe7-8dc2-4fa8-a049-0881a568e582 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:34.377987 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7ec5cbe7-8dc2-4fa8-a049-0881a568e582 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:34.378693 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7ec5cbe7-8dc2-4fa8-a049-0881a568e582 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:34.379152 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7ec5cbe7-8dc2-4fa8-a049-0881a568e582 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:34.379583 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7ec5cbe7-8dc2-4fa8-a049-0881a568e582 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:34.455831 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7ec5cbe7-8dc2-4fa8-a049-0881a568e582 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:34.466493 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7ec5cbe7-8dc2-4fa8-a049-0881a568e582 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804" status: 200 len: 1203 microversion: 2.1 time: 0.100043 Oct 18 15:29:34.467012 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 587/1249] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:34 2022] GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804 => generated 1203 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:34.472050 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0fbabec1-7ba3-47fd-a450-f3b2d9ddfd23 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:34.473006 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0fbabec1-7ba3-47fd-a450-f3b2d9ddfd23 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: bd6231eb-95a4-465e-a859-077a7f82f585] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:34.479797 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0fbabec1-7ba3-47fd-a450-f3b2d9ddfd23 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:34.480616 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0fbabec1-7ba3-47fd-a450-f3b2d9ddfd23 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:34.481320 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0fbabec1-7ba3-47fd-a450-f3b2d9ddfd23 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:34.482408 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0fbabec1-7ba3-47fd-a450-f3b2d9ddfd23 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:34.483089 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0fbabec1-7ba3-47fd-a450-f3b2d9ddfd23 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:34.483729 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0fbabec1-7ba3-47fd-a450-f3b2d9ddfd23 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:34.505738 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3006e6e9-d09b-4db8-8eac-1acb543281ba tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:34.516862 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3006e6e9-d09b-4db8-8eac-1acb543281ba tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2" status: 200 len: 1717 microversion: 2.1 time: 0.227832 Oct 18 15:29:34.533436 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 663/1250] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:34 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2 => generated 1717 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:34.659232 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0fbabec1-7ba3-47fd-a450-f3b2d9ddfd23 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1023300147f463e8f0894981948f825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac07f1b2c83a4faab175a5b9ed8e315e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:34.671674 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0fbabec1-7ba3-47fd-a450-f3b2d9ddfd23 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585" status: 200 len: 1512 microversion: 2.1 time: 0.203263 Oct 18 15:29:34.672567 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 588/1251] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:34 2022] GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585 => generated 1512 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:35.015880 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-45059ace-7e64-4ec3-9ae3-e61eac07230b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:35.016605 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-45059ace-7e64-4ec3-9ae3-e61eac07230b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:35.023789 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45059ace-7e64-4ec3-9ae3-e61eac07230b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:35.024283 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45059ace-7e64-4ec3-9ae3-e61eac07230b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:35.024720 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45059ace-7e64-4ec3-9ae3-e61eac07230b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:35.025588 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45059ace-7e64-4ec3-9ae3-e61eac07230b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:35.026050 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45059ace-7e64-4ec3-9ae3-e61eac07230b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:35.026481 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45059ace-7e64-4ec3-9ae3-e61eac07230b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:35.055609 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-8c34c7ed-1cbe-4693-9333-90ab76a22ed2 req-c517b9a1-99cc-496a-bc09-986abbd34e50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd6231eb-95a4-465e-a859-077a7f82f585", "name": "network-vif-deleted", "tag": "5c14163f-63a4-4c55-8e7e-3d6fb857fbbd"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:29:35.066191 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-8c34c7ed-1cbe-4693-9333-90ab76a22ed2 req-c517b9a1-99cc-496a-bc09-986abbd34e50 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:35.066768 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-8c34c7ed-1cbe-4693-9333-90ab76a22ed2 req-c517b9a1-99cc-496a-bc09-986abbd34e50 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:35.067779 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-8c34c7ed-1cbe-4693-9333-90ab76a22ed2 req-c517b9a1-99cc-496a-bc09-986abbd34e50 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:35.079902 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-8c34c7ed-1cbe-4693-9333-90ab76a22ed2 req-c517b9a1-99cc-496a-bc09-986abbd34e50 service nova] Creating event network-vif-deleted:5c14163f-63a4-4c55-8e7e-3d6fb857fbbd for instance bd6231eb-95a4-465e-a859-077a7f82f585 on n-h1-853682-5 Oct 18 15:29:35.086208 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-8c34c7ed-1cbe-4693-9333-90ab76a22ed2 req-c517b9a1-99cc-496a-bc09-986abbd34e50 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040068 Oct 18 15:29:35.087444 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 589/1252] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:29:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:29:35.227895 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-45059ace-7e64-4ec3-9ae3-e61eac07230b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:35.237105 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-45059ace-7e64-4ec3-9ae3-e61eac07230b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:35.238547 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-45059ace-7e64-4ec3-9ae3-e61eac07230b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:35.240285 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-45059ace-7e64-4ec3-9ae3-e61eac07230b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 1880 microversion: 2.42 time: 0.228516 Oct 18 15:29:35.244863 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 664/1253] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:35 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 1880 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:35.282671 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-10520fba-76a3-4194-9c4d-c036d99a9234 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:35.283384 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-10520fba-76a3-4194-9c4d-c036d99a9234 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] [instance: 74e5ae75-9c35-4610-9cb5-61afa6f98581] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:35.290418 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-10520fba-76a3-4194-9c4d-c036d99a9234 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:35.291008 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-10520fba-76a3-4194-9c4d-c036d99a9234 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:35.291456 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-10520fba-76a3-4194-9c4d-c036d99a9234 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:35.292192 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-10520fba-76a3-4194-9c4d-c036d99a9234 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:35.292647 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-10520fba-76a3-4194-9c4d-c036d99a9234 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:35.293107 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-10520fba-76a3-4194-9c4d-c036d99a9234 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:35.310825 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-adaf6938-2c79-4561-96f9-dbcfe96fa487 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:35.311601 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-adaf6938-2c79-4561-96f9-dbcfe96fa487 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 7c7a376f-fa78-4101-adf7-e84f23b4e068] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:35.317658 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-adaf6938-2c79-4561-96f9-dbcfe96fa487 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:35.318419 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-adaf6938-2c79-4561-96f9-dbcfe96fa487 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:35.318852 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-adaf6938-2c79-4561-96f9-dbcfe96fa487 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:35.319759 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-adaf6938-2c79-4561-96f9-dbcfe96fa487 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:35.320216 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-adaf6938-2c79-4561-96f9-dbcfe96fa487 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:35.320638 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-adaf6938-2c79-4561-96f9-dbcfe96fa487 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:35.356842 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-10520fba-76a3-4194-9c4d-c036d99a9234 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe80f2ae3ec4365a031ca7472d76e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df909cb429f46c39a83c29fb260b169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:35.365145 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-10520fba-76a3-4194-9c4d-c036d99a9234 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] 10.222.0.60 "GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581" status: 200 len: 1214 microversion: 2.1 time: 0.086738 Oct 18 15:29:35.365731 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 590/1254] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:35 2022] GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:35.393050 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0cf5fd0c-48a5-4de5-8604-0162de1e72fb tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:35.393656 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0cf5fd0c-48a5-4de5-8604-0162de1e72fb tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:35.399476 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0cf5fd0c-48a5-4de5-8604-0162de1e72fb tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:35.399950 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0cf5fd0c-48a5-4de5-8604-0162de1e72fb tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:35.400380 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0cf5fd0c-48a5-4de5-8604-0162de1e72fb tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:35.401088 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0cf5fd0c-48a5-4de5-8604-0162de1e72fb tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:35.401540 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0cf5fd0c-48a5-4de5-8604-0162de1e72fb tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:35.401958 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0cf5fd0c-48a5-4de5-8604-0162de1e72fb tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:35.479223 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0cf5fd0c-48a5-4de5-8604-0162de1e72fb tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:35.482494 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-adaf6938-2c79-4561-96f9-dbcfe96fa487 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:35.487437 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0cf5fd0c-48a5-4de5-8604-0162de1e72fb tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:35.488929 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0cf5fd0c-48a5-4de5-8604-0162de1e72fb tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:35.490379 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-adaf6938-2c79-4561-96f9-dbcfe96fa487 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/7c7a376f-fa78-4101-adf7-e84f23b4e068" status: 200 len: 1317 microversion: 2.1 time: 0.183505 Oct 18 15:29:35.490959 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 665/1255] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:35 2022] GET /compute/v2.1/servers/7c7a376f-fa78-4101-adf7-e84f23b4e068 => generated 1317 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:29:35.494178 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0cf5fd0c-48a5-4de5-8604-0162de1e72fb tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1546 microversion: 2.91 time: 0.104974 Oct 18 15:29:35.494732 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 591/1256] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:35 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1546 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:29:35.495636 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e9eacf74-9e4f-4689-95a8-40f62660aa79 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:35.496599 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e9eacf74-9e4f-4689-95a8-40f62660aa79 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 4b959d9f-3c8e-44ef-92f1-83cfb8e04804] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:35.502455 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e9eacf74-9e4f-4689-95a8-40f62660aa79 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:35.502939 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e9eacf74-9e4f-4689-95a8-40f62660aa79 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:35.503377 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e9eacf74-9e4f-4689-95a8-40f62660aa79 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:35.504072 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e9eacf74-9e4f-4689-95a8-40f62660aa79 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:35.504532 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e9eacf74-9e4f-4689-95a8-40f62660aa79 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:35.505005 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e9eacf74-9e4f-4689-95a8-40f62660aa79 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:35.541470 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-292a8ddc-7a6d-4a13-82e4-3714363b04d3 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:35.542229 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-292a8ddc-7a6d-4a13-82e4-3714363b04d3 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:35.548112 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-292a8ddc-7a6d-4a13-82e4-3714363b04d3 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:35.548593 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-292a8ddc-7a6d-4a13-82e4-3714363b04d3 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:35.549058 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-292a8ddc-7a6d-4a13-82e4-3714363b04d3 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:35.549750 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-292a8ddc-7a6d-4a13-82e4-3714363b04d3 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:35.550199 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-292a8ddc-7a6d-4a13-82e4-3714363b04d3 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:35.550617 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-292a8ddc-7a6d-4a13-82e4-3714363b04d3 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:35.567963 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e9eacf74-9e4f-4689-95a8-40f62660aa79 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:35.575535 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e9eacf74-9e4f-4689-95a8-40f62660aa79 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804" status: 200 len: 1259 microversion: 2.1 time: 0.083413 Oct 18 15:29:35.576113 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 666/1257] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:35 2022] GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804 => generated 1259 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:35.681181 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-292a8ddc-7a6d-4a13-82e4-3714363b04d3 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:35.689698 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-292a8ddc-7a6d-4a13-82e4-3714363b04d3 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2" status: 200 len: 1717 microversion: 2.1 time: 0.152102 Oct 18 15:29:35.690911 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 592/1258] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:35 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2 => generated 1717 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:35.696097 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-752eb0c7-715c-4c9c-b6f9-bbab0f546dc9 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:35.696753 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-752eb0c7-715c-4c9c-b6f9-bbab0f546dc9 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: bd6231eb-95a4-465e-a859-077a7f82f585] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:35.702972 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-752eb0c7-715c-4c9c-b6f9-bbab0f546dc9 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:35.703458 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-752eb0c7-715c-4c9c-b6f9-bbab0f546dc9 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:35.703913 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-752eb0c7-715c-4c9c-b6f9-bbab0f546dc9 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:35.704588 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-752eb0c7-715c-4c9c-b6f9-bbab0f546dc9 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:35.705075 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-752eb0c7-715c-4c9c-b6f9-bbab0f546dc9 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:35.705502 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-752eb0c7-715c-4c9c-b6f9-bbab0f546dc9 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:35.709951 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:29:35.767436 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-752eb0c7-715c-4c9c-b6f9-bbab0f546dc9 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1023300147f463e8f0894981948f825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac07f1b2c83a4faab175a5b9ed8e315e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:35.776133 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-752eb0c7-715c-4c9c-b6f9-bbab0f546dc9 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585" status: 200 len: 1470 microversion: 2.1 time: 0.084309 Oct 18 15:29:35.776710 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 667/1259] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:35 2022] GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585 => generated 1470 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:36.265922 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-961e01e7-3e92-4614-8437-dc590cc45395 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:36.266532 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-961e01e7-3e92-4614-8437-dc590cc45395 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:36.272939 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-961e01e7-3e92-4614-8437-dc590cc45395 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:36.273421 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-961e01e7-3e92-4614-8437-dc590cc45395 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:36.273854 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-961e01e7-3e92-4614-8437-dc590cc45395 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:36.274543 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-961e01e7-3e92-4614-8437-dc590cc45395 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:36.275000 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-961e01e7-3e92-4614-8437-dc590cc45395 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:36.275421 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-961e01e7-3e92-4614-8437-dc590cc45395 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:36.388157 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-29f82a2a-3e87-4e86-b46e-bb9a1f03bc7a tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:36.388952 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-29f82a2a-3e87-4e86-b46e-bb9a1f03bc7a tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] [instance: 74e5ae75-9c35-4610-9cb5-61afa6f98581] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:36.395693 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29f82a2a-3e87-4e86-b46e-bb9a1f03bc7a tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:36.396512 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29f82a2a-3e87-4e86-b46e-bb9a1f03bc7a tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:36.396976 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29f82a2a-3e87-4e86-b46e-bb9a1f03bc7a tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:36.397677 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29f82a2a-3e87-4e86-b46e-bb9a1f03bc7a tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:36.398135 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29f82a2a-3e87-4e86-b46e-bb9a1f03bc7a tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:36.398556 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29f82a2a-3e87-4e86-b46e-bb9a1f03bc7a tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:36.474778 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-29f82a2a-3e87-4e86-b46e-bb9a1f03bc7a tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe80f2ae3ec4365a031ca7472d76e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df909cb429f46c39a83c29fb260b169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:36.482500 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-29f82a2a-3e87-4e86-b46e-bb9a1f03bc7a tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] 10.222.0.60 "GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581" status: 200 len: 1214 microversion: 2.1 time: 0.098263 Oct 18 15:29:36.483086 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 668/1260] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:36 2022] GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581 => generated 1214 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:29:36.487230 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-961e01e7-3e92-4614-8437-dc590cc45395 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:36.497067 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-961e01e7-3e92-4614-8437-dc590cc45395 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:36.498511 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-961e01e7-3e92-4614-8437-dc590cc45395 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:36.499655 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-961e01e7-3e92-4614-8437-dc590cc45395 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 1880 microversion: 2.42 time: 0.237664 Oct 18 15:29:36.500204 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 593/1261] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:36 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 1880 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:36.513252 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e2ea4713-527c-42f9-9969-3a7b8eae4f54 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:36.513869 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e2ea4713-527c-42f9-9969-3a7b8eae4f54 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 7c7a376f-fa78-4101-adf7-e84f23b4e068] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:36.520345 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2ea4713-527c-42f9-9969-3a7b8eae4f54 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:36.520851 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2ea4713-527c-42f9-9969-3a7b8eae4f54 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:36.521055 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7e3d74ae-ade3-4cf7-aaca-d67aef71da4a tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:36.521294 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2ea4713-527c-42f9-9969-3a7b8eae4f54 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:36.521676 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7e3d74ae-ade3-4cf7-aaca-d67aef71da4a tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:36.521983 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2ea4713-527c-42f9-9969-3a7b8eae4f54 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:36.522437 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2ea4713-527c-42f9-9969-3a7b8eae4f54 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:36.522860 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2ea4713-527c-42f9-9969-3a7b8eae4f54 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:36.527724 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7e3d74ae-ade3-4cf7-aaca-d67aef71da4a tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:36.528282 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7e3d74ae-ade3-4cf7-aaca-d67aef71da4a tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:36.528725 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7e3d74ae-ade3-4cf7-aaca-d67aef71da4a tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:36.529489 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7e3d74ae-ade3-4cf7-aaca-d67aef71da4a tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:36.529951 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7e3d74ae-ade3-4cf7-aaca-d67aef71da4a tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:36.530380 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7e3d74ae-ade3-4cf7-aaca-d67aef71da4a tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:36.534821 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:29:36.615318 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7e3d74ae-ade3-4cf7-aaca-d67aef71da4a tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:36.623426 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7e3d74ae-ade3-4cf7-aaca-d67aef71da4a tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:36.625040 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7e3d74ae-ade3-4cf7-aaca-d67aef71da4a tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:36.629955 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7e3d74ae-ade3-4cf7-aaca-d67aef71da4a tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1546 microversion: 2.91 time: 0.112605 Oct 18 15:29:36.630528 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 594/1262] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:36 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1546 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:29:36.635024 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-cf9f2053-cf56-466c-b80e-3b067a70c431 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:36.635907 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-cf9f2053-cf56-466c-b80e-3b067a70c431 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 4b959d9f-3c8e-44ef-92f1-83cfb8e04804] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:36.641806 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cf9f2053-cf56-466c-b80e-3b067a70c431 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:36.642302 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cf9f2053-cf56-466c-b80e-3b067a70c431 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:36.642743 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cf9f2053-cf56-466c-b80e-3b067a70c431 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:36.643444 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cf9f2053-cf56-466c-b80e-3b067a70c431 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:36.643908 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cf9f2053-cf56-466c-b80e-3b067a70c431 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:36.644334 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cf9f2053-cf56-466c-b80e-3b067a70c431 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:36.679691 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e2ea4713-527c-42f9-9969-3a7b8eae4f54 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:36.690278 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e2ea4713-527c-42f9-9969-3a7b8eae4f54 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/7c7a376f-fa78-4101-adf7-e84f23b4e068" status: 200 len: 1317 microversion: 2.1 time: 0.180685 Oct 18 15:29:36.703199 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 669/1263] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:36 2022] GET /compute/v2.1/servers/7c7a376f-fa78-4101-adf7-e84f23b4e068 => generated 1317 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:36.713238 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-08818e5c-c40f-4d4d-bd9e-1991c8681513 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:36.713809 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-cf9f2053-cf56-466c-b80e-3b067a70c431 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:36.714009 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-08818e5c-c40f-4d4d-bd9e-1991c8681513 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:36.719821 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-08818e5c-c40f-4d4d-bd9e-1991c8681513 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:36.720310 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-08818e5c-c40f-4d4d-bd9e-1991c8681513 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:36.720751 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-08818e5c-c40f-4d4d-bd9e-1991c8681513 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:36.721482 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-08818e5c-c40f-4d4d-bd9e-1991c8681513 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:36.721948 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-08818e5c-c40f-4d4d-bd9e-1991c8681513 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:36.722374 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-08818e5c-c40f-4d4d-bd9e-1991c8681513 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:36.724349 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-cf9f2053-cf56-466c-b80e-3b067a70c431 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804" status: 200 len: 1259 microversion: 2.1 time: 0.092803 Oct 18 15:29:36.725235 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 595/1264] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:36 2022] GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804 => generated 1259 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:36.799909 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4c4eaaa8-3c20-4c13-a673-7ddad9ffc614 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:36.800701 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4c4eaaa8-3c20-4c13-a673-7ddad9ffc614 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: bd6231eb-95a4-465e-a859-077a7f82f585] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:36.809045 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4c4eaaa8-3c20-4c13-a673-7ddad9ffc614 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:36.809540 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4c4eaaa8-3c20-4c13-a673-7ddad9ffc614 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:36.809985 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4c4eaaa8-3c20-4c13-a673-7ddad9ffc614 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:36.810694 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4c4eaaa8-3c20-4c13-a673-7ddad9ffc614 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:36.811296 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4c4eaaa8-3c20-4c13-a673-7ddad9ffc614 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:36.811726 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4c4eaaa8-3c20-4c13-a673-7ddad9ffc614 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:36.890905 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4c4eaaa8-3c20-4c13-a673-7ddad9ffc614 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1023300147f463e8f0894981948f825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac07f1b2c83a4faab175a5b9ed8e315e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:36.895726 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-08818e5c-c40f-4d4d-bd9e-1991c8681513 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:36.899543 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4c4eaaa8-3c20-4c13-a673-7ddad9ffc614 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585" status: 200 len: 1470 microversion: 2.1 time: 0.104868 Oct 18 15:29:36.904822 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-08818e5c-c40f-4d4d-bd9e-1991c8681513 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2" status: 200 len: 1717 microversion: 2.1 time: 0.195830 Oct 18 15:29:36.905651 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 670/1265] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:36 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2 => generated 1717 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:29:36.911322 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-46541e98-5b0f-46a3-8858-a8fc0b2d5d0b req-ce292eb6-64ae-40fd-b315-210b97b45843 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c7a376f-fa78-4101-adf7-e84f23b4e068", "name": "network-vif-plugged", "status": "completed", "tag": "bfb12eda-2062-4a65-ac38-ccc02fcaf772"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:29:36.915661 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 596/1266] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:36 2022] GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585 => generated 1470 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:29:36.921407 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-46541e98-5b0f-46a3-8858-a8fc0b2d5d0b req-ce292eb6-64ae-40fd-b315-210b97b45843 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:36.921993 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-46541e98-5b0f-46a3-8858-a8fc0b2d5d0b req-ce292eb6-64ae-40fd-b315-210b97b45843 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:36.922502 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-46541e98-5b0f-46a3-8858-a8fc0b2d5d0b req-ce292eb6-64ae-40fd-b315-210b97b45843 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:36.934587 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-46541e98-5b0f-46a3-8858-a8fc0b2d5d0b req-ce292eb6-64ae-40fd-b315-210b97b45843 service nova] Creating event network-vif-plugged:bfb12eda-2062-4a65-ac38-ccc02fcaf772 for instance 7c7a376f-fa78-4101-adf7-e84f23b4e068 on n-h2-853682-5 Oct 18 15:29:36.939403 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-46541e98-5b0f-46a3-8858-a8fc0b2d5d0b req-ce292eb6-64ae-40fd-b315-210b97b45843 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032048 Oct 18 15:29:36.939987 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 671/1267] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:29:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:29:37.505904 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6917f396-01a2-4ae6-bc7a-cfc1b215177d tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:37.506517 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6917f396-01a2-4ae6-bc7a-cfc1b215177d tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] [instance: 74e5ae75-9c35-4610-9cb5-61afa6f98581] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:37.513785 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6917f396-01a2-4ae6-bc7a-cfc1b215177d tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:37.514398 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6917f396-01a2-4ae6-bc7a-cfc1b215177d tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:37.514956 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6917f396-01a2-4ae6-bc7a-cfc1b215177d tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:37.515763 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6917f396-01a2-4ae6-bc7a-cfc1b215177d tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:37.516327 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6917f396-01a2-4ae6-bc7a-cfc1b215177d tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:37.517215 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6917f396-01a2-4ae6-bc7a-cfc1b215177d tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:37.529431 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d4631ac3-4b45-45b1-b34a-535e71ac7d8f tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:37.530323 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d4631ac3-4b45-45b1-b34a-535e71ac7d8f tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:37.537696 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d4631ac3-4b45-45b1-b34a-535e71ac7d8f tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:37.538211 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d4631ac3-4b45-45b1-b34a-535e71ac7d8f tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:37.538975 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d4631ac3-4b45-45b1-b34a-535e71ac7d8f tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:37.539685 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d4631ac3-4b45-45b1-b34a-535e71ac7d8f tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:37.540173 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d4631ac3-4b45-45b1-b34a-535e71ac7d8f tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:37.540598 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d4631ac3-4b45-45b1-b34a-535e71ac7d8f tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:37.603102 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6917f396-01a2-4ae6-bc7a-cfc1b215177d tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe80f2ae3ec4365a031ca7472d76e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df909cb429f46c39a83c29fb260b169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:37.615664 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6917f396-01a2-4ae6-bc7a-cfc1b215177d tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] 10.222.0.60 "GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581" status: 200 len: 1214 microversion: 2.1 time: 0.113570 Oct 18 15:29:37.617260 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 597/1268] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:37 2022] GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581 => generated 1214 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:37.658047 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5655186c-478d-4b65-abe7-6f6617352b38 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:37.658663 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5655186c-478d-4b65-abe7-6f6617352b38 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:37.665464 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5655186c-478d-4b65-abe7-6f6617352b38 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:37.665953 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5655186c-478d-4b65-abe7-6f6617352b38 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:37.666421 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5655186c-478d-4b65-abe7-6f6617352b38 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:37.667090 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5655186c-478d-4b65-abe7-6f6617352b38 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:37.667546 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5655186c-478d-4b65-abe7-6f6617352b38 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:37.667975 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5655186c-478d-4b65-abe7-6f6617352b38 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:37.756654 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5655186c-478d-4b65-abe7-6f6617352b38 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:37.765431 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5655186c-478d-4b65-abe7-6f6617352b38 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:37.766879 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5655186c-478d-4b65-abe7-6f6617352b38 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:37.772266 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5655186c-478d-4b65-abe7-6f6617352b38 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1546 microversion: 2.91 time: 0.118184 Oct 18 15:29:37.772866 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 598/1269] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:37 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1546 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:37.774408 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d4631ac3-4b45-45b1-b34a-535e71ac7d8f tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:37.777940 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5b424cbd-5f05-4560-b5bd-d3dce2966034 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:37.778555 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5b424cbd-5f05-4560-b5bd-d3dce2966034 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 7c7a376f-fa78-4101-adf7-e84f23b4e068] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:37.783979 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d4631ac3-4b45-45b1-b34a-535e71ac7d8f tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:37.784324 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5b424cbd-5f05-4560-b5bd-d3dce2966034 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:37.784943 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5b424cbd-5f05-4560-b5bd-d3dce2966034 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:37.785263 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5b424cbd-5f05-4560-b5bd-d3dce2966034 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:37.786328 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d4631ac3-4b45-45b1-b34a-535e71ac7d8f tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:37.786716 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5b424cbd-5f05-4560-b5bd-d3dce2966034 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:37.787172 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5b424cbd-5f05-4560-b5bd-d3dce2966034 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:37.787596 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5b424cbd-5f05-4560-b5bd-d3dce2966034 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:37.787697 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d4631ac3-4b45-45b1-b34a-535e71ac7d8f tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 1880 microversion: 2.42 time: 0.265858 Oct 18 15:29:37.788363 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 672/1270] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:37 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 1880 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:37.793847 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b1a33ea1-df82-4d4d-9d92-4152b4e3c7b9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:37.794451 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b1a33ea1-df82-4d4d-9d92-4152b4e3c7b9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 4b959d9f-3c8e-44ef-92f1-83cfb8e04804] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:37.800378 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1a33ea1-df82-4d4d-9d92-4152b4e3c7b9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:37.800887 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1a33ea1-df82-4d4d-9d92-4152b4e3c7b9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:37.801365 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1a33ea1-df82-4d4d-9d92-4152b4e3c7b9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:37.802085 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1a33ea1-df82-4d4d-9d92-4152b4e3c7b9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:37.809687 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1a33ea1-df82-4d4d-9d92-4152b4e3c7b9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:37.810427 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1a33ea1-df82-4d4d-9d92-4152b4e3c7b9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:37.902332 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b1a33ea1-df82-4d4d-9d92-4152b4e3c7b9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:37.912086 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b1a33ea1-df82-4d4d-9d92-4152b4e3c7b9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804" status: 200 len: 1259 microversion: 2.1 time: 0.121536 Oct 18 15:29:37.912482 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 673/1271] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:37 2022] GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804 => generated 1259 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:37.924518 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f8ae025a-9c65-40be-9183-85ff34768012 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:37.925419 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f8ae025a-9c65-40be-9183-85ff34768012 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: bd6231eb-95a4-465e-a859-077a7f82f585] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:37.933697 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8ae025a-9c65-40be-9183-85ff34768012 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:37.934374 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8ae025a-9c65-40be-9183-85ff34768012 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:37.935006 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8ae025a-9c65-40be-9183-85ff34768012 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:37.935877 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8ae025a-9c65-40be-9183-85ff34768012 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:37.936496 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8ae025a-9c65-40be-9183-85ff34768012 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:37.937126 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8ae025a-9c65-40be-9183-85ff34768012 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:37.964491 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:29:37.980252 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5b424cbd-5f05-4560-b5bd-d3dce2966034 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:37.982349 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8ae025a-9c65-40be-9183-85ff34768012 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:37.982845 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8ae025a-9c65-40be-9183-85ff34768012 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:37.983276 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8ae025a-9c65-40be-9183-85ff34768012 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:37.983719 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-f8ae025a-9c65-40be-9183-85ff34768012 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lazy-loading 'fault' on Instance uuid bd6231eb-95a4-465e-a859-077a7f82f585 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:29:37.988844 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5b424cbd-5f05-4560-b5bd-d3dce2966034 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/7c7a376f-fa78-4101-adf7-e84f23b4e068" status: 200 len: 1317 microversion: 2.1 time: 0.214745 Oct 18 15:29:37.989765 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 599/1272] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:37 2022] GET /compute/v2.1/servers/7c7a376f-fa78-4101-adf7-e84f23b4e068 => generated 1317 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:38.026048 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f8ae025a-9c65-40be-9183-85ff34768012 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1023300147f463e8f0894981948f825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac07f1b2c83a4faab175a5b9ed8e315e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:38.034404 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f8ae025a-9c65-40be-9183-85ff34768012 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585" status: 200 len: 1307 microversion: 2.1 time: 0.113778 Oct 18 15:29:38.035152 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 674/1273] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:37 2022] GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585 => generated 1307 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:38.115721 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f26b7c54-c8aa-4454-9474-2eee98d33608 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:38.116429 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f26b7c54-c8aa-4454-9474-2eee98d33608 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:38.122576 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f26b7c54-c8aa-4454-9474-2eee98d33608 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:38.123134 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f26b7c54-c8aa-4454-9474-2eee98d33608 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:38.123659 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f26b7c54-c8aa-4454-9474-2eee98d33608 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:38.124425 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f26b7c54-c8aa-4454-9474-2eee98d33608 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:38.124981 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f26b7c54-c8aa-4454-9474-2eee98d33608 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:38.125502 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f26b7c54-c8aa-4454-9474-2eee98d33608 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:38.256255 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f26b7c54-c8aa-4454-9474-2eee98d33608 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:38.264525 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f26b7c54-c8aa-4454-9474-2eee98d33608 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2" status: 200 len: 1717 microversion: 2.1 time: 0.273666 Oct 18 15:29:38.265128 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 600/1274] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:37 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2 => generated 1717 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:38.639214 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a60a84e5-44a4-4dc0-a380-25419656d626 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:38.639833 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a60a84e5-44a4-4dc0-a380-25419656d626 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] [instance: 74e5ae75-9c35-4610-9cb5-61afa6f98581] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:38.648071 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a60a84e5-44a4-4dc0-a380-25419656d626 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:38.648569 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a60a84e5-44a4-4dc0-a380-25419656d626 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:38.649057 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a60a84e5-44a4-4dc0-a380-25419656d626 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:38.649755 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a60a84e5-44a4-4dc0-a380-25419656d626 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:38.650214 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a60a84e5-44a4-4dc0-a380-25419656d626 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:38.651085 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a60a84e5-44a4-4dc0-a380-25419656d626 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:38.750579 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a60a84e5-44a4-4dc0-a380-25419656d626 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe80f2ae3ec4365a031ca7472d76e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df909cb429f46c39a83c29fb260b169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:38.759031 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a60a84e5-44a4-4dc0-a380-25419656d626 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] 10.222.0.60 "GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581" status: 200 len: 1214 microversion: 2.1 time: 0.124027 Oct 18 15:29:38.759599 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 675/1275] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:38 2022] GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581 => generated 1214 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:38.799519 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7c36d913-4281-428b-90fd-431e65918dc6 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:38.800134 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7c36d913-4281-428b-90fd-431e65918dc6 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:38.807512 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7c36d913-4281-428b-90fd-431e65918dc6 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:38.808018 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7c36d913-4281-428b-90fd-431e65918dc6 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:38.808431 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7c36d913-4281-428b-90fd-431e65918dc6 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:38.809160 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7c36d913-4281-428b-90fd-431e65918dc6 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:38.809615 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7c36d913-4281-428b-90fd-431e65918dc6 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:38.810038 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7c36d913-4281-428b-90fd-431e65918dc6 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:38.816563 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ee8ccf48-7428-41f8-b330-b0447bb6fc2f tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:38.817870 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ee8ccf48-7428-41f8-b330-b0447bb6fc2f tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:38.824919 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee8ccf48-7428-41f8-b330-b0447bb6fc2f tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:38.825412 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee8ccf48-7428-41f8-b330-b0447bb6fc2f tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:38.825849 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee8ccf48-7428-41f8-b330-b0447bb6fc2f tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:38.826599 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee8ccf48-7428-41f8-b330-b0447bb6fc2f tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:38.827005 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee8ccf48-7428-41f8-b330-b0447bb6fc2f tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:38.827428 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee8ccf48-7428-41f8-b330-b0447bb6fc2f tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:38.884158 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7c36d913-4281-428b-90fd-431e65918dc6 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:38.892791 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7c36d913-4281-428b-90fd-431e65918dc6 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:38.894265 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7c36d913-4281-428b-90fd-431e65918dc6 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:38.899466 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7c36d913-4281-428b-90fd-431e65918dc6 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1546 microversion: 2.91 time: 0.103913 Oct 18 15:29:38.900303 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 601/1276] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:38 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1546 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:38.935931 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5f838d97-e8b5-4b7f-87c5-98800adb9481 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:38.936662 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5f838d97-e8b5-4b7f-87c5-98800adb9481 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 4b959d9f-3c8e-44ef-92f1-83cfb8e04804] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:38.943331 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5f838d97-e8b5-4b7f-87c5-98800adb9481 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:38.943929 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5f838d97-e8b5-4b7f-87c5-98800adb9481 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:38.944558 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5f838d97-e8b5-4b7f-87c5-98800adb9481 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:38.945380 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5f838d97-e8b5-4b7f-87c5-98800adb9481 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:38.945944 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5f838d97-e8b5-4b7f-87c5-98800adb9481 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:38.946479 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5f838d97-e8b5-4b7f-87c5-98800adb9481 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:39.024345 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5f838d97-e8b5-4b7f-87c5-98800adb9481 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:39.032498 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5f838d97-e8b5-4b7f-87c5-98800adb9481 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804" status: 200 len: 1259 microversion: 2.1 time: 0.100760 Oct 18 15:29:39.033434 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 602/1277] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:38 2022] GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804 => generated 1259 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:29:39.038883 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d045f7c7-be33-4175-8a7b-4d437a49496d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:39.039496 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d045f7c7-be33-4175-8a7b-4d437a49496d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 7c7a376f-fa78-4101-adf7-e84f23b4e068] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:39.045700 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d045f7c7-be33-4175-8a7b-4d437a49496d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:39.046382 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d045f7c7-be33-4175-8a7b-4d437a49496d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:39.046972 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d045f7c7-be33-4175-8a7b-4d437a49496d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:39.047821 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d045f7c7-be33-4175-8a7b-4d437a49496d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:39.048452 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d045f7c7-be33-4175-8a7b-4d437a49496d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:39.049065 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d045f7c7-be33-4175-8a7b-4d437a49496d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:39.070902 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ee8ccf48-7428-41f8-b330-b0447bb6fc2f tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:39.080376 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ee8ccf48-7428-41f8-b330-b0447bb6fc2f tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:39.081781 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ee8ccf48-7428-41f8-b330-b0447bb6fc2f tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:39.083574 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ee8ccf48-7428-41f8-b330-b0447bb6fc2f tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 1880 microversion: 2.42 time: 0.271892 Oct 18 15:29:39.084144 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 676/1278] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:38 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 1880 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:39.093247 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a76412c7-2d50-41c7-aa45-ab9eca24509e tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:39.094049 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a76412c7-2d50-41c7-aa45-ab9eca24509e tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: bd6231eb-95a4-465e-a859-077a7f82f585] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:39.105929 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a76412c7-2d50-41c7-aa45-ab9eca24509e tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:39.106421 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a76412c7-2d50-41c7-aa45-ab9eca24509e tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:39.106851 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a76412c7-2d50-41c7-aa45-ab9eca24509e tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:39.107568 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a76412c7-2d50-41c7-aa45-ab9eca24509e tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:39.108017 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a76412c7-2d50-41c7-aa45-ab9eca24509e tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:39.108438 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a76412c7-2d50-41c7-aa45-ab9eca24509e tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:39.143364 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a76412c7-2d50-41c7-aa45-ab9eca24509e tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:39.143842 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a76412c7-2d50-41c7-aa45-ab9eca24509e tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:39.144272 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a76412c7-2d50-41c7-aa45-ab9eca24509e tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:39.144713 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-a76412c7-2d50-41c7-aa45-ab9eca24509e tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lazy-loading 'fault' on Instance uuid bd6231eb-95a4-465e-a859-077a7f82f585 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:29:39.213899 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a76412c7-2d50-41c7-aa45-ab9eca24509e tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1023300147f463e8f0894981948f825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac07f1b2c83a4faab175a5b9ed8e315e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:39.218672 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d045f7c7-be33-4175-8a7b-4d437a49496d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:39.222224 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a76412c7-2d50-41c7-aa45-ab9eca24509e tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585" status: 200 len: 1307 microversion: 2.1 time: 0.136941 Oct 18 15:29:39.223779 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 677/1279] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:39 2022] GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585 => generated 1307 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:39.227300 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d045f7c7-be33-4175-8a7b-4d437a49496d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/7c7a376f-fa78-4101-adf7-e84f23b4e068" status: 200 len: 1467 microversion: 2.1 time: 0.192631 Oct 18 15:29:39.228893 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 603/1280] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:39 2022] GET /compute/v2.1/servers/7c7a376f-fa78-4101-adf7-e84f23b4e068 => generated 1467 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:39.249031 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ad5c0e26-b5ea-419a-817a-12d18afb7b86 tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:39.249922 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ad5c0e26-b5ea-419a-817a-12d18afb7b86 tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] [instance: 7c7a376f-fa78-4101-adf7-e84f23b4e068] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:39.256172 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad5c0e26-b5ea-419a-817a-12d18afb7b86 tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:39.256643 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad5c0e26-b5ea-419a-817a-12d18afb7b86 tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:39.257097 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad5c0e26-b5ea-419a-817a-12d18afb7b86 tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:39.257784 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad5c0e26-b5ea-419a-817a-12d18afb7b86 tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:39.258230 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad5c0e26-b5ea-419a-817a-12d18afb7b86 tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:39.258647 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad5c0e26-b5ea-419a-817a-12d18afb7b86 tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:39.288502 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c7e430d0-c231-4f3f-a1a9-8d2b7b9b4159 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:39.289250 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c7e430d0-c231-4f3f-a1a9-8d2b7b9b4159 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:39.298113 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c7e430d0-c231-4f3f-a1a9-8d2b7b9b4159 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:39.298591 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c7e430d0-c231-4f3f-a1a9-8d2b7b9b4159 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:39.299022 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c7e430d0-c231-4f3f-a1a9-8d2b7b9b4159 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:39.299716 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c7e430d0-c231-4f3f-a1a9-8d2b7b9b4159 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:39.300167 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c7e430d0-c231-4f3f-a1a9-8d2b7b9b4159 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:39.300881 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c7e430d0-c231-4f3f-a1a9-8d2b7b9b4159 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:39.842750 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ad5c0e26-b5ea-419a-817a-12d18afb7b86 tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/7c7a376f-fa78-4101-adf7-e84f23b4e068" status: 200 len: 1618 microversion: 2.1 time: 0.597327 Oct 18 15:29:39.847411 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 678/1281] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:39 2022] GET /compute/v2.1/servers/7c7a376f-fa78-4101-adf7-e84f23b4e068 => generated 1618 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:39.853979 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c7e430d0-c231-4f3f-a1a9-8d2b7b9b4159 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:39.867360 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c7e430d0-c231-4f3f-a1a9-8d2b7b9b4159 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2" status: 200 len: 1717 microversion: 2.1 time: 0.583350 Oct 18 15:29:39.886265 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 604/1282] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:39 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2 => generated 1717 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:39.889887 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-00d3fa11-7049-42b9-8ed9-458bb7a52ff6 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:39.890905 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-00d3fa11-7049-42b9-8ed9-458bb7a52ff6 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] [instance: 74e5ae75-9c35-4610-9cb5-61afa6f98581] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:39.898434 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00d3fa11-7049-42b9-8ed9-458bb7a52ff6 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:39.899146 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00d3fa11-7049-42b9-8ed9-458bb7a52ff6 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:39.900302 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00d3fa11-7049-42b9-8ed9-458bb7a52ff6 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:39.901314 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00d3fa11-7049-42b9-8ed9-458bb7a52ff6 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:39.901933 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00d3fa11-7049-42b9-8ed9-458bb7a52ff6 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:39.902524 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00d3fa11-7049-42b9-8ed9-458bb7a52ff6 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:39.929441 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b35568b9-4db1-408e-ba26-003d3937d3b8 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:39.930329 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b35568b9-4db1-408e-ba26-003d3937d3b8 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:39.938871 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b35568b9-4db1-408e-ba26-003d3937d3b8 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:39.940506 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b35568b9-4db1-408e-ba26-003d3937d3b8 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:39.942116 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b35568b9-4db1-408e-ba26-003d3937d3b8 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:39.944259 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b35568b9-4db1-408e-ba26-003d3937d3b8 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:39.945884 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b35568b9-4db1-408e-ba26-003d3937d3b8 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:39.946653 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b35568b9-4db1-408e-ba26-003d3937d3b8 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:40.036529 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-00d3fa11-7049-42b9-8ed9-458bb7a52ff6 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe80f2ae3ec4365a031ca7472d76e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df909cb429f46c39a83c29fb260b169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:40.047690 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-00d3fa11-7049-42b9-8ed9-458bb7a52ff6 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] 10.222.0.60 "GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581" status: 200 len: 1270 microversion: 2.1 time: 0.196789 Oct 18 15:29:40.048694 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 679/1283] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:39 2022] GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581 => generated 1270 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:40.076130 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f9f4eb58-b0d9-4c3b-98b1-7a63d891bdf9 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-323968479", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "61ca6b08-6a75-4b0a-86d7-86aa22cb308e"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:29:40.127253 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b35568b9-4db1-408e-ba26-003d3937d3b8 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:40.135734 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b35568b9-4db1-408e-ba26-003d3937d3b8 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:40.138573 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b35568b9-4db1-408e-ba26-003d3937d3b8 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:40.144792 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b35568b9-4db1-408e-ba26-003d3937d3b8 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1546 microversion: 2.91 time: 0.219481 Oct 18 15:29:40.145982 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 605/1284] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:39 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1546 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:40.151667 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a552f667-0091-4407-bd89-a2bcd862b7d4 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:40.152545 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a552f667-0091-4407-bd89-a2bcd862b7d4 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 4b959d9f-3c8e-44ef-92f1-83cfb8e04804] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:40.163354 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-f9f4eb58-b0d9-4c3b-98b1-7a63d891bdf9 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] validate_networks() for None {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:29:40.166164 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a552f667-0091-4407-bd89-a2bcd862b7d4 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:40.169451 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a552f667-0091-4407-bd89-a2bcd862b7d4 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:40.169976 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a552f667-0091-4407-bd89-a2bcd862b7d4 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:40.170807 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a552f667-0091-4407-bd89-a2bcd862b7d4 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:40.171348 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a552f667-0091-4407-bd89-a2bcd862b7d4 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:40.171852 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a552f667-0091-4407-bd89-a2bcd862b7d4 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:40.302606 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a552f667-0091-4407-bd89-a2bcd862b7d4 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:40.318147 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a552f667-0091-4407-bd89-a2bcd862b7d4 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804" status: 200 len: 1265 microversion: 2.1 time: 0.170447 Oct 18 15:29:40.319430 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 606/1285] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:40 2022] GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:40.325842 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b94ee98f-7a7b-48b7-8d41-415383214a67 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:40.327027 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b94ee98f-7a7b-48b7-8d41-415383214a67 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:40.340303 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b94ee98f-7a7b-48b7-8d41-415383214a67 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:40.341337 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b94ee98f-7a7b-48b7-8d41-415383214a67 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:40.342630 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b94ee98f-7a7b-48b7-8d41-415383214a67 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:40.345327 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b94ee98f-7a7b-48b7-8d41-415383214a67 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:40.346389 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b94ee98f-7a7b-48b7-8d41-415383214a67 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:40.350991 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b94ee98f-7a7b-48b7-8d41-415383214a67 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:40.677465 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-f9f4eb58-b0d9-4c3b-98b1-7a63d891bdf9 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:29:40.678320 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-f9f4eb58-b0d9-4c3b-98b1-7a63d891bdf9 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:29:40.679017 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-f9f4eb58-b0d9-4c3b-98b1-7a63d891bdf9 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:29:40.696144 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-f9f4eb58-b0d9-4c3b-98b1-7a63d891bdf9 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:29:40.697814 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-f9f4eb58-b0d9-4c3b-98b1-7a63d891bdf9 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:29:40.709772 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9f4eb58-b0d9-4c3b-98b1-7a63d891bdf9 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:40.710774 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9f4eb58-b0d9-4c3b-98b1-7a63d891bdf9 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:40.711379 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9f4eb58-b0d9-4c3b-98b1-7a63d891bdf9 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:40.713192 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9f4eb58-b0d9-4c3b-98b1-7a63d891bdf9 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:40.713857 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9f4eb58-b0d9-4c3b-98b1-7a63d891bdf9 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:40.714457 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9f4eb58-b0d9-4c3b-98b1-7a63d891bdf9 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:40.757252 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-f9f4eb58-b0d9-4c3b-98b1-7a63d891bdf9 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Getting quotas for project 377c3bbd62b546fca545c0f6d0df59e3. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:29:40.772494 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-f9f4eb58-b0d9-4c3b-98b1-7a63d891bdf9 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Getting quotas for user d58aac335a1d421a95928e2754fb2529 and project 377c3bbd62b546fca545c0f6d0df59e3. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:29:40.798701 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b94ee98f-7a7b-48b7-8d41-415383214a67 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:40.818376 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f9f4eb58-b0d9-4c3b-98b1-7a63d891bdf9 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:29:40.820558 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b94ee98f-7a7b-48b7-8d41-415383214a67 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:40.825678 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b94ee98f-7a7b-48b7-8d41-415383214a67 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:40.829776 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f9f4eb58-b0d9-4c3b-98b1-7a63d891bdf9 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 40097653-662f-4191-983d-881387af06a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:29:40.831108 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b94ee98f-7a7b-48b7-8d41-415383214a67 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 1880 microversion: 2.42 time: 0.506294 Oct 18 15:29:40.831927 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 607/1286] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:40 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 1880 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:40.839477 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bf571590-4865-4812-b026-ac0c3f87f2b4 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:40.840321 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-bf571590-4865-4812-b026-ac0c3f87f2b4 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: bd6231eb-95a4-465e-a859-077a7f82f585] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:40.849144 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bf571590-4865-4812-b026-ac0c3f87f2b4 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:40.850105 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bf571590-4865-4812-b026-ac0c3f87f2b4 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:40.850785 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bf571590-4865-4812-b026-ac0c3f87f2b4 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:40.851934 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bf571590-4865-4812-b026-ac0c3f87f2b4 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:40.852932 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bf571590-4865-4812-b026-ac0c3f87f2b4 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:40.853538 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bf571590-4865-4812-b026-ac0c3f87f2b4 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:40.909097 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bf571590-4865-4812-b026-ac0c3f87f2b4 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:40.910389 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bf571590-4865-4812-b026-ac0c3f87f2b4 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:40.911755 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bf571590-4865-4812-b026-ac0c3f87f2b4 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:40.912673 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-bf571590-4865-4812-b026-ac0c3f87f2b4 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lazy-loading 'fault' on Instance uuid bd6231eb-95a4-465e-a859-077a7f82f585 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:29:40.929734 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f9f4eb58-b0d9-4c3b-98b1-7a63d891bdf9 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.867356 Oct 18 15:29:40.933245 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 680/1287] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:29:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 874 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:29:40.939099 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6324f3d9-9c60-4098-ab6c-d462c3fb1acd tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:40.939732 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6324f3d9-9c60-4098-ab6c-d462c3fb1acd tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:40.982215 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6324f3d9-9c60-4098-ab6c-d462c3fb1acd tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:40.982350 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6324f3d9-9c60-4098-ab6c-d462c3fb1acd tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:40.982750 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6324f3d9-9c60-4098-ab6c-d462c3fb1acd tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:40.983504 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6324f3d9-9c60-4098-ab6c-d462c3fb1acd tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:40.983964 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6324f3d9-9c60-4098-ab6c-d462c3fb1acd tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:40.984405 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6324f3d9-9c60-4098-ab6c-d462c3fb1acd tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:40.990300 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-bf571590-4865-4812-b026-ac0c3f87f2b4 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1023300147f463e8f0894981948f825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac07f1b2c83a4faab175a5b9ed8e315e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:41.001758 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-bf571590-4865-4812-b026-ac0c3f87f2b4 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585" status: 200 len: 1307 microversion: 2.1 time: 0.166699 Oct 18 15:29:41.003056 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 608/1288] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:40 2022] GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585 => generated 1307 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:41.008925 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-20e642e2-6463-4d61-9916-36cba0356756 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:41.009751 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-20e642e2-6463-4d61-9916-36cba0356756 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 40097653-662f-4191-983d-881387af06a8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:41.016712 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:29:41.085481 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-20e642e2-6463-4d61-9916-36cba0356756 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:41.096351 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-20e642e2-6463-4d61-9916-36cba0356756 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8" status: 200 len: 1216 microversion: 2.1 time: 0.091739 Oct 18 15:29:41.107653 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 609/1289] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:41 2022] GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8 => generated 1216 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:41.123370 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e5ab0db1-754a-49eb-980a-b7e6e1e1f262 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:41.124477 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e5ab0db1-754a-49eb-980a-b7e6e1e1f262 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] [instance: 74e5ae75-9c35-4610-9cb5-61afa6f98581] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:41.134198 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e5ab0db1-754a-49eb-980a-b7e6e1e1f262 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:41.135024 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e5ab0db1-754a-49eb-980a-b7e6e1e1f262 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:41.135845 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e5ab0db1-754a-49eb-980a-b7e6e1e1f262 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:41.136929 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e5ab0db1-754a-49eb-980a-b7e6e1e1f262 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:41.138390 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e5ab0db1-754a-49eb-980a-b7e6e1e1f262 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:41.138997 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e5ab0db1-754a-49eb-980a-b7e6e1e1f262 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:41.330064 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e5ab0db1-754a-49eb-980a-b7e6e1e1f262 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe80f2ae3ec4365a031ca7472d76e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df909cb429f46c39a83c29fb260b169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:41.343304 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e5ab0db1-754a-49eb-980a-b7e6e1e1f262 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] 10.222.0.60 "GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581" status: 200 len: 1270 microversion: 2.1 time: 0.230052 Oct 18 15:29:41.347818 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 610/1290] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:41 2022] GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581 => generated 1270 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:41.367916 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7c11b6ea-d3fe-4288-8e6f-59ff25d9c248 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:41.382886 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7c11b6ea-d3fe-4288-8e6f-59ff25d9c248 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:41.419073 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7c11b6ea-d3fe-4288-8e6f-59ff25d9c248 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:41.419504 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7c11b6ea-d3fe-4288-8e6f-59ff25d9c248 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:41.419935 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7c11b6ea-d3fe-4288-8e6f-59ff25d9c248 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:41.420648 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7c11b6ea-d3fe-4288-8e6f-59ff25d9c248 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:41.421124 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7c11b6ea-d3fe-4288-8e6f-59ff25d9c248 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:41.421606 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7c11b6ea-d3fe-4288-8e6f-59ff25d9c248 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:41.500355 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=100 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:29:41.533798 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6324f3d9-9c60-4098-ab6c-d462c3fb1acd tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:41.552285 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6324f3d9-9c60-4098-ab6c-d462c3fb1acd tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2" status: 200 len: 1717 microversion: 2.1 time: 0.617410 Oct 18 15:29:41.565877 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 681/1291] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:40 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2 => generated 1717 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:41.584708 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f99cff34-67fa-4b7c-b895-295e2eff04e0 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:41.585719 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f99cff34-67fa-4b7c-b895-295e2eff04e0 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 4b959d9f-3c8e-44ef-92f1-83cfb8e04804] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:41.592862 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f99cff34-67fa-4b7c-b895-295e2eff04e0 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:41.593652 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f99cff34-67fa-4b7c-b895-295e2eff04e0 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:41.594262 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f99cff34-67fa-4b7c-b895-295e2eff04e0 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:41.595246 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f99cff34-67fa-4b7c-b895-295e2eff04e0 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:41.595881 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f99cff34-67fa-4b7c-b895-295e2eff04e0 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:41.596455 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f99cff34-67fa-4b7c-b895-295e2eff04e0 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:41.668307 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7c11b6ea-d3fe-4288-8e6f-59ff25d9c248 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:41.691356 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7c11b6ea-d3fe-4288-8e6f-59ff25d9c248 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:41.694165 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7c11b6ea-d3fe-4288-8e6f-59ff25d9c248 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:41.714568 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7c11b6ea-d3fe-4288-8e6f-59ff25d9c248 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1533 microversion: 2.91 time: 0.364115 Oct 18 15:29:41.736406 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 611/1292] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:41 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1533 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:41.749613 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e1df30fa-ee41-4b60-9aed-546c43fdebe2 tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:41.754733 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e1df30fa-ee41-4b60-9aed-546c43fdebe2 tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:41.771746 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e1df30fa-ee41-4b60-9aed-546c43fdebe2 tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:41.772361 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e1df30fa-ee41-4b60-9aed-546c43fdebe2 tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:41.774489 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e1df30fa-ee41-4b60-9aed-546c43fdebe2 tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:41.775713 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e1df30fa-ee41-4b60-9aed-546c43fdebe2 tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:41.777241 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e1df30fa-ee41-4b60-9aed-546c43fdebe2 tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:41.778943 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e1df30fa-ee41-4b60-9aed-546c43fdebe2 tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:41.998121 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f99cff34-67fa-4b7c-b895-295e2eff04e0 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:42.024550 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f99cff34-67fa-4b7c-b895-295e2eff04e0 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804" status: 200 len: 1307 microversion: 2.1 time: 0.455538 Oct 18 15:29:42.030604 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 682/1293] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:41 2022] GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804 => generated 1307 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:42.059053 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ebf39c9c-feb7-4663-b4f3-ccc1598768fb tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:42.063156 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ebf39c9c-feb7-4663-b4f3-ccc1598768fb tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:42.100515 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ebf39c9c-feb7-4663-b4f3-ccc1598768fb tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:42.101406 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ebf39c9c-feb7-4663-b4f3-ccc1598768fb tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:42.102069 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ebf39c9c-feb7-4663-b4f3-ccc1598768fb tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:42.103541 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ebf39c9c-feb7-4663-b4f3-ccc1598768fb tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:42.106600 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ebf39c9c-feb7-4663-b4f3-ccc1598768fb tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:42.107287 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ebf39c9c-feb7-4663-b4f3-ccc1598768fb tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:42.129732 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-e1df30fa-ee41-4b60-9aed-546c43fdebe2 tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] Lazy-loading 'services' on Instance uuid 45bc3ebe-2b14-4188-a636-309fd0582617 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:29:42.168489 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e1df30fa-ee41-4b60-9aed-546c43fdebe2 tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1938 microversion: 2.91 time: 0.422603 Oct 18 15:29:42.172894 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 612/1294] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:41 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1938 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:42.177926 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c6dfb838-feb7-4e77-b88c-88b0ac126b10 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:42.182395 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c6dfb838-feb7-4e77-b88c-88b0ac126b10 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: bd6231eb-95a4-465e-a859-077a7f82f585] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:42.195574 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c6dfb838-feb7-4e77-b88c-88b0ac126b10 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:42.202640 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c6dfb838-feb7-4e77-b88c-88b0ac126b10 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:42.203549 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c6dfb838-feb7-4e77-b88c-88b0ac126b10 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:42.204523 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c6dfb838-feb7-4e77-b88c-88b0ac126b10 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:42.205247 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c6dfb838-feb7-4e77-b88c-88b0ac126b10 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:42.205919 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c6dfb838-feb7-4e77-b88c-88b0ac126b10 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:42.297074 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c6dfb838-feb7-4e77-b88c-88b0ac126b10 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:42.297898 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c6dfb838-feb7-4e77-b88c-88b0ac126b10 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:42.298297 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c6dfb838-feb7-4e77-b88c-88b0ac126b10 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:42.298690 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-c6dfb838-feb7-4e77-b88c-88b0ac126b10 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lazy-loading 'fault' on Instance uuid bd6231eb-95a4-465e-a859-077a7f82f585 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:29:42.536407 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c6dfb838-feb7-4e77-b88c-88b0ac126b10 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1023300147f463e8f0894981948f825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac07f1b2c83a4faab175a5b9ed8e315e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:42.560200 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c6dfb838-feb7-4e77-b88c-88b0ac126b10 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585" status: 200 len: 1307 microversion: 2.1 time: 0.385896 Oct 18 15:29:42.573267 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 613/1295] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:42 2022] GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585 => generated 1307 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:42.581884 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-15e300f2-3fd7-47ce-a170-08f92556430e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:42.582864 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-15e300f2-3fd7-47ce-a170-08f92556430e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 40097653-662f-4191-983d-881387af06a8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:42.590437 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-15e300f2-3fd7-47ce-a170-08f92556430e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:42.591187 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-15e300f2-3fd7-47ce-a170-08f92556430e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:42.591804 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-15e300f2-3fd7-47ce-a170-08f92556430e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:42.592700 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-15e300f2-3fd7-47ce-a170-08f92556430e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:42.593354 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-15e300f2-3fd7-47ce-a170-08f92556430e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:42.593945 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-15e300f2-3fd7-47ce-a170-08f92556430e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:42.627180 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ebf39c9c-feb7-4663-b4f3-ccc1598768fb tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:42.638049 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ebf39c9c-feb7-4663-b4f3-ccc1598768fb tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:42.649802 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ebf39c9c-feb7-4663-b4f3-ccc1598768fb tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:42.651301 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ebf39c9c-feb7-4663-b4f3-ccc1598768fb tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 1880 microversion: 2.42 time: 0.616752 Oct 18 15:29:42.656878 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 683/1296] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:42 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 1880 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:42.673717 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0e63e45f-721d-4902-b3a8-6afa3dedef90 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:29:42.681115 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0e63e45f-721d-4902-b3a8-6afa3dedef90 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:42.696272 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e63e45f-721d-4902-b3a8-6afa3dedef90 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:42.701291 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e63e45f-721d-4902-b3a8-6afa3dedef90 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:42.701982 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e63e45f-721d-4902-b3a8-6afa3dedef90 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:42.703086 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e63e45f-721d-4902-b3a8-6afa3dedef90 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:42.705821 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e63e45f-721d-4902-b3a8-6afa3dedef90 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:42.708158 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e63e45f-721d-4902-b3a8-6afa3dedef90 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:42.734594 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-15e300f2-3fd7-47ce-a170-08f92556430e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:42.747957 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-15e300f2-3fd7-47ce-a170-08f92556430e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8" status: 200 len: 1220 microversion: 2.1 time: 0.169949 Oct 18 15:29:42.748937 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 614/1297] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:42 2022] GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8 => generated 1220 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:42.772858 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5ce6a0cb-14f0-4596-9626-df867b5e44bc tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:42.773736 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5ce6a0cb-14f0-4596-9626-df867b5e44bc tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] [instance: 74e5ae75-9c35-4610-9cb5-61afa6f98581] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:42.786304 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:29:42.794744 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5ce6a0cb-14f0-4596-9626-df867b5e44bc tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:42.796708 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5ce6a0cb-14f0-4596-9626-df867b5e44bc tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:42.799935 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-0e63e45f-721d-4902-b3a8-6afa3dedef90 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lazy-loading 'flavor' on Instance uuid 45bc3ebe-2b14-4188-a636-309fd0582617 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:29:42.800718 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5ce6a0cb-14f0-4596-9626-df867b5e44bc tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:42.802228 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5ce6a0cb-14f0-4596-9626-df867b5e44bc tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:42.802864 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5ce6a0cb-14f0-4596-9626-df867b5e44bc tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:42.806451 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5ce6a0cb-14f0-4596-9626-df867b5e44bc tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:42.989636 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5ce6a0cb-14f0-4596-9626-df867b5e44bc tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe80f2ae3ec4365a031ca7472d76e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df909cb429f46c39a83c29fb260b169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:43.005005 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5ce6a0cb-14f0-4596-9626-df867b5e44bc tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] 10.222.0.60 "GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581" status: 200 len: 1278 microversion: 2.1 time: 0.254190 Oct 18 15:29:43.017384 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 615/1298] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:42 2022] GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581 => generated 1278 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:43.040513 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-df2bdf44-e0ca-4d53-b144-e561887ddf9c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:43.041184 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-df2bdf44-e0ca-4d53-b144-e561887ddf9c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:43.056330 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-df2bdf44-e0ca-4d53-b144-e561887ddf9c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:43.056755 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-df2bdf44-e0ca-4d53-b144-e561887ddf9c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:43.057471 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-df2bdf44-e0ca-4d53-b144-e561887ddf9c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:43.058786 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-df2bdf44-e0ca-4d53-b144-e561887ddf9c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:43.059457 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-df2bdf44-e0ca-4d53-b144-e561887ddf9c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:43.060085 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-df2bdf44-e0ca-4d53-b144-e561887ddf9c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:43.326443 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0e63e45f-721d-4902-b3a8-6afa3dedef90 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "POST /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617/action" status: 202 len: 0 microversion: 2.91 time: 0.667859 Oct 18 15:29:43.327090 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 684/1299] 10.222.0.60 () {62 vars in 1319 bytes} [Tue Oct 18 15:29:42 2022] POST /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617/action => generated 0 bytes in 669 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:29:43.349281 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0df5db2f-859d-44a9-a2b3-9584845f808d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:43.351523 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0df5db2f-859d-44a9-a2b3-9584845f808d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 4b959d9f-3c8e-44ef-92f1-83cfb8e04804] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:43.362236 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0df5db2f-859d-44a9-a2b3-9584845f808d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:43.362719 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0df5db2f-859d-44a9-a2b3-9584845f808d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:43.363150 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0df5db2f-859d-44a9-a2b3-9584845f808d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:43.363889 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0df5db2f-859d-44a9-a2b3-9584845f808d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:43.364764 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0df5db2f-859d-44a9-a2b3-9584845f808d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:43.364764 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0df5db2f-859d-44a9-a2b3-9584845f808d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:43.376253 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-df2bdf44-e0ca-4d53-b144-e561887ddf9c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:43.386664 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-df2bdf44-e0ca-4d53-b144-e561887ddf9c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2" status: 200 len: 1717 microversion: 2.1 time: 0.359716 Oct 18 15:29:43.392617 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 616/1300] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:43 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2 => generated 1717 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:43.416134 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b9b75aff-9c16-4fc9-999c-ccdc34992bc5 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:43.417837 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b9b75aff-9c16-4fc9-999c-ccdc34992bc5 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:43.434462 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b9b75aff-9c16-4fc9-999c-ccdc34992bc5 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:43.436690 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b9b75aff-9c16-4fc9-999c-ccdc34992bc5 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:43.438822 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b9b75aff-9c16-4fc9-999c-ccdc34992bc5 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:43.448948 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b9b75aff-9c16-4fc9-999c-ccdc34992bc5 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:43.449760 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b9b75aff-9c16-4fc9-999c-ccdc34992bc5 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:43.452178 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b9b75aff-9c16-4fc9-999c-ccdc34992bc5 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:43.679033 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0df5db2f-859d-44a9-a2b3-9584845f808d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:43.688577 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0df5db2f-859d-44a9-a2b3-9584845f808d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804" status: 200 len: 1307 microversion: 2.1 time: 0.349994 Oct 18 15:29:43.696182 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b9b75aff-9c16-4fc9-999c-ccdc34992bc5 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:43.698231 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 685/1301] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:43 2022] GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804 => generated 1307 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:43.713871 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b9b75aff-9c16-4fc9-999c-ccdc34992bc5 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:43.715314 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b9b75aff-9c16-4fc9-999c-ccdc34992bc5 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:43.723358 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4a90c391-479e-4528-a609-07d81f6fa682 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:43.724339 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4a90c391-479e-4528-a609-07d81f6fa682 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: bd6231eb-95a4-465e-a859-077a7f82f585] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:43.734246 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b9b75aff-9c16-4fc9-999c-ccdc34992bc5 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1539 microversion: 2.91 time: 0.339228 Oct 18 15:29:43.739308 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 617/1302] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:43 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1539 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:43.743857 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a90c391-479e-4528-a609-07d81f6fa682 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:43.747408 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a90c391-479e-4528-a609-07d81f6fa682 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:43.748083 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a90c391-479e-4528-a609-07d81f6fa682 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:43.749084 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a90c391-479e-4528-a609-07d81f6fa682 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:43.750846 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a8a87866-2777-472d-81d4-85e60941737b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:43.751624 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a90c391-479e-4528-a609-07d81f6fa682 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:43.752750 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a90c391-479e-4528-a609-07d81f6fa682 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:43.755935 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a8a87866-2777-472d-81d4-85e60941737b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:43.765806 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a8a87866-2777-472d-81d4-85e60941737b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:43.766640 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a8a87866-2777-472d-81d4-85e60941737b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:43.767450 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a8a87866-2777-472d-81d4-85e60941737b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:43.768406 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a8a87866-2777-472d-81d4-85e60941737b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:43.769183 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a8a87866-2777-472d-81d4-85e60941737b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:43.770661 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a8a87866-2777-472d-81d4-85e60941737b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:43.841436 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a90c391-479e-4528-a609-07d81f6fa682 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:43.841943 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a90c391-479e-4528-a609-07d81f6fa682 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:43.842390 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a90c391-479e-4528-a609-07d81f6fa682 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:43.842856 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-4a90c391-479e-4528-a609-07d81f6fa682 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lazy-loading 'fault' on Instance uuid bd6231eb-95a4-465e-a859-077a7f82f585 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:29:43.998366 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4a90c391-479e-4528-a609-07d81f6fa682 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1023300147f463e8f0894981948f825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac07f1b2c83a4faab175a5b9ed8e315e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:44.021583 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4a90c391-479e-4528-a609-07d81f6fa682 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585" status: 200 len: 1307 microversion: 2.1 time: 0.322180 Oct 18 15:29:44.039161 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 686/1303] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:43 2022] GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585 => generated 1307 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:44.046937 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e66c483d-38f9-4b65-9765-8cddf0e87d6e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:44.047905 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e66c483d-38f9-4b65-9765-8cddf0e87d6e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 40097653-662f-4191-983d-881387af06a8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:44.057690 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e66c483d-38f9-4b65-9765-8cddf0e87d6e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:44.058852 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e66c483d-38f9-4b65-9765-8cddf0e87d6e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:44.060047 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e66c483d-38f9-4b65-9765-8cddf0e87d6e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:44.061653 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e66c483d-38f9-4b65-9765-8cddf0e87d6e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:44.062346 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e66c483d-38f9-4b65-9765-8cddf0e87d6e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:44.063006 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e66c483d-38f9-4b65-9765-8cddf0e87d6e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:44.091248 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a8a87866-2777-472d-81d4-85e60941737b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:44.124852 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a8a87866-2777-472d-81d4-85e60941737b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:44.132062 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a8a87866-2777-472d-81d4-85e60941737b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:44.134924 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a8a87866-2777-472d-81d4-85e60941737b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 1880 microversion: 2.42 time: 0.393667 Oct 18 15:29:44.138884 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 618/1304] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:43 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 1880 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:44.189552 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e66c483d-38f9-4b65-9765-8cddf0e87d6e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:44.198192 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e66c483d-38f9-4b65-9765-8cddf0e87d6e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8" status: 200 len: 1220 microversion: 2.1 time: 0.157485 Oct 18 15:29:44.200836 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 687/1305] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:44 2022] GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8 => generated 1220 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:44.226640 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b34f77a9-8c02-4d47-a987-c0fc4fe94bdc tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:44.229742 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b34f77a9-8c02-4d47-a987-c0fc4fe94bdc tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] [instance: 74e5ae75-9c35-4610-9cb5-61afa6f98581] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:44.245767 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b34f77a9-8c02-4d47-a987-c0fc4fe94bdc tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:44.246520 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b34f77a9-8c02-4d47-a987-c0fc4fe94bdc tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:44.248009 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b34f77a9-8c02-4d47-a987-c0fc4fe94bdc tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:44.249240 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b34f77a9-8c02-4d47-a987-c0fc4fe94bdc tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:44.251222 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b34f77a9-8c02-4d47-a987-c0fc4fe94bdc tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:44.251915 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b34f77a9-8c02-4d47-a987-c0fc4fe94bdc tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:44.272015 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-11d85f42-c9e7-4e25-9cc7-0e4eb10f6901 req-4e84ca92-c8d7-4eb9-a370-224ff88fe510 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b959d9f-3c8e-44ef-92f1-83cfb8e04804", "tag": "497df88b-7ec7-4c49-ac83-b558f8c280b3"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:29:44.293582 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-11d85f42-c9e7-4e25-9cc7-0e4eb10f6901 req-4e84ca92-c8d7-4eb9-a370-224ff88fe510 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:44.294637 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-11d85f42-c9e7-4e25-9cc7-0e4eb10f6901 req-4e84ca92-c8d7-4eb9-a370-224ff88fe510 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:44.295231 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-11d85f42-c9e7-4e25-9cc7-0e4eb10f6901 req-4e84ca92-c8d7-4eb9-a370-224ff88fe510 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:44.335221 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-11d85f42-c9e7-4e25-9cc7-0e4eb10f6901 req-4e84ca92-c8d7-4eb9-a370-224ff88fe510 service nova] Creating event network-changed:497df88b-7ec7-4c49-ac83-b558f8c280b3 for instance 4b959d9f-3c8e-44ef-92f1-83cfb8e04804 on n-h1-853682-5 Oct 18 15:29:44.345030 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-11d85f42-c9e7-4e25-9cc7-0e4eb10f6901 req-4e84ca92-c8d7-4eb9-a370-224ff88fe510 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.203871 Oct 18 15:29:44.346347 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 619/1306] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:29:44.402588 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b34f77a9-8c02-4d47-a987-c0fc4fe94bdc tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe80f2ae3ec4365a031ca7472d76e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df909cb429f46c39a83c29fb260b169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:44.418950 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b34f77a9-8c02-4d47-a987-c0fc4fe94bdc tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] 10.222.0.60 "GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581" status: 200 len: 1278 microversion: 2.1 time: 0.203955 Oct 18 15:29:44.419877 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 688/1307] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:44 2022] GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581 => generated 1278 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:44.426447 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-238b837c-f30d-4d04-8e73-7ec1208c1220 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:44.427924 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-238b837c-f30d-4d04-8e73-7ec1208c1220 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:44.444265 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-238b837c-f30d-4d04-8e73-7ec1208c1220 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:44.444546 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-238b837c-f30d-4d04-8e73-7ec1208c1220 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:44.444781 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-238b837c-f30d-4d04-8e73-7ec1208c1220 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:44.448472 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-238b837c-f30d-4d04-8e73-7ec1208c1220 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:44.449385 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-238b837c-f30d-4d04-8e73-7ec1208c1220 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:44.451050 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-238b837c-f30d-4d04-8e73-7ec1208c1220 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:44.714160 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d384994f-ef18-4df0-afc3-ff79ecccb03d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:44.714987 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d384994f-ef18-4df0-afc3-ff79ecccb03d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 4b959d9f-3c8e-44ef-92f1-83cfb8e04804] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:44.746199 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:29:44.750303 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d384994f-ef18-4df0-afc3-ff79ecccb03d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:44.752177 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d384994f-ef18-4df0-afc3-ff79ecccb03d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:44.757018 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d384994f-ef18-4df0-afc3-ff79ecccb03d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:44.757951 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d384994f-ef18-4df0-afc3-ff79ecccb03d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:44.758540 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d384994f-ef18-4df0-afc3-ff79ecccb03d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:44.759124 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d384994f-ef18-4df0-afc3-ff79ecccb03d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:44.829682 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-238b837c-f30d-4d04-8e73-7ec1208c1220 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:44.845795 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-238b837c-f30d-4d04-8e73-7ec1208c1220 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2" status: 200 len: 1717 microversion: 2.1 time: 0.433337 Oct 18 15:29:44.848177 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 620/1308] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:44 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2 => generated 1717 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:44.857902 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9d8cbdda-b2af-4ff1-804d-5b1595593091 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:44.861810 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9d8cbdda-b2af-4ff1-804d-5b1595593091 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:44.874107 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9d8cbdda-b2af-4ff1-804d-5b1595593091 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:44.877393 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9d8cbdda-b2af-4ff1-804d-5b1595593091 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:44.878108 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9d8cbdda-b2af-4ff1-804d-5b1595593091 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:44.893573 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9d8cbdda-b2af-4ff1-804d-5b1595593091 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:44.895535 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9d8cbdda-b2af-4ff1-804d-5b1595593091 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:44.901568 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9d8cbdda-b2af-4ff1-804d-5b1595593091 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:45.031945 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9d8cbdda-b2af-4ff1-804d-5b1595593091 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:45.045794 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9d8cbdda-b2af-4ff1-804d-5b1595593091 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:45.051491 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9d8cbdda-b2af-4ff1-804d-5b1595593091 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:45.065336 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9d8cbdda-b2af-4ff1-804d-5b1595593091 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1539 microversion: 2.91 time: 0.215399 Oct 18 15:29:45.081600 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 621/1309] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:44 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1539 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:45.092668 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-69a72865-9a3f-492c-af01-6d2adba5fe8b tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:45.094437 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-69a72865-9a3f-492c-af01-6d2adba5fe8b tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: bd6231eb-95a4-465e-a859-077a7f82f585] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:45.104560 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-69a72865-9a3f-492c-af01-6d2adba5fe8b tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:45.109149 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-69a72865-9a3f-492c-af01-6d2adba5fe8b tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:45.109929 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-69a72865-9a3f-492c-af01-6d2adba5fe8b tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:45.112092 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-69a72865-9a3f-492c-af01-6d2adba5fe8b tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:45.112835 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-69a72865-9a3f-492c-af01-6d2adba5fe8b tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:45.125126 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d384994f-ef18-4df0-afc3-ff79ecccb03d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:45.139399 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d384994f-ef18-4df0-afc3-ff79ecccb03d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804" status: 200 len: 1307 microversion: 2.1 time: 0.429286 Oct 18 15:29:45.140304 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-69a72865-9a3f-492c-af01-6d2adba5fe8b tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:45.144732 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 689/1310] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:44 2022] GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804 => generated 1307 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:29:45.167496 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-47143def-ed6f-4043-83c2-c1aa58fcaf83 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:45.168542 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-47143def-ed6f-4043-83c2-c1aa58fcaf83 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:45.177597 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47143def-ed6f-4043-83c2-c1aa58fcaf83 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:45.180314 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47143def-ed6f-4043-83c2-c1aa58fcaf83 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:45.181933 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47143def-ed6f-4043-83c2-c1aa58fcaf83 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:45.183232 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47143def-ed6f-4043-83c2-c1aa58fcaf83 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:45.190263 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47143def-ed6f-4043-83c2-c1aa58fcaf83 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:45.191035 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47143def-ed6f-4043-83c2-c1aa58fcaf83 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:45.212912 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-69a72865-9a3f-492c-af01-6d2adba5fe8b tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:45.213756 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-69a72865-9a3f-492c-af01-6d2adba5fe8b tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:45.214434 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-69a72865-9a3f-492c-af01-6d2adba5fe8b tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:45.215106 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-69a72865-9a3f-492c-af01-6d2adba5fe8b tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lazy-loading 'fault' on Instance uuid bd6231eb-95a4-465e-a859-077a7f82f585 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:29:45.278671 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-69a72865-9a3f-492c-af01-6d2adba5fe8b tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1023300147f463e8f0894981948f825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac07f1b2c83a4faab175a5b9ed8e315e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:45.288878 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-69a72865-9a3f-492c-af01-6d2adba5fe8b tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585" status: 200 len: 1307 microversion: 2.1 time: 0.205746 Oct 18 15:29:45.290715 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 622/1311] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:45 2022] GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585 => generated 1307 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:45.300839 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1ab0bda3-7ede-437f-95b5-402ef55bda08 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:45.305261 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1ab0bda3-7ede-437f-95b5-402ef55bda08 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 40097653-662f-4191-983d-881387af06a8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:45.314508 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1ab0bda3-7ede-437f-95b5-402ef55bda08 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:45.315479 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1ab0bda3-7ede-437f-95b5-402ef55bda08 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:45.316146 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1ab0bda3-7ede-437f-95b5-402ef55bda08 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:45.317696 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1ab0bda3-7ede-437f-95b5-402ef55bda08 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:45.318377 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1ab0bda3-7ede-437f-95b5-402ef55bda08 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:45.319023 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1ab0bda3-7ede-437f-95b5-402ef55bda08 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:45.424479 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1ab0bda3-7ede-437f-95b5-402ef55bda08 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:45.438035 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1ab0bda3-7ede-437f-95b5-402ef55bda08 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8" status: 200 len: 1220 microversion: 2.1 time: 0.140756 Oct 18 15:29:45.439617 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 623/1312] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:45 2022] GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8 => generated 1220 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:45.450159 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-458267ea-a3ef-4baa-ba4a-90972ad847ed tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:45.453691 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-458267ea-a3ef-4baa-ba4a-90972ad847ed tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] [instance: 74e5ae75-9c35-4610-9cb5-61afa6f98581] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:45.466674 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-458267ea-a3ef-4baa-ba4a-90972ad847ed tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:45.468131 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-458267ea-a3ef-4baa-ba4a-90972ad847ed tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:45.470142 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-458267ea-a3ef-4baa-ba4a-90972ad847ed tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:45.471150 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-458267ea-a3ef-4baa-ba4a-90972ad847ed tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:45.476915 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-458267ea-a3ef-4baa-ba4a-90972ad847ed tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:45.477825 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-458267ea-a3ef-4baa-ba4a-90972ad847ed tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:45.577682 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-458267ea-a3ef-4baa-ba4a-90972ad847ed tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe80f2ae3ec4365a031ca7472d76e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df909cb429f46c39a83c29fb260b169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:45.588609 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-458267ea-a3ef-4baa-ba4a-90972ad847ed tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] 10.222.0.60 "GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581" status: 200 len: 1278 microversion: 2.1 time: 0.145458 Oct 18 15:29:45.599205 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 624/1313] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:45 2022] GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581 => generated 1278 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:45.692678 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-47143def-ed6f-4043-83c2-c1aa58fcaf83 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:45.703557 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-47143def-ed6f-4043-83c2-c1aa58fcaf83 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:45.705045 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-47143def-ed6f-4043-83c2-c1aa58fcaf83 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:45.706287 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-47143def-ed6f-4043-83c2-c1aa58fcaf83 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 1880 microversion: 2.42 time: 0.543049 Oct 18 15:29:45.717291 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 690/1314] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:45 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 1880 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:29:45.875695 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-92dcd513-e4a3-48a4-bead-f3b0964ab3ed tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:45.876557 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-92dcd513-e4a3-48a4-bead-f3b0964ab3ed tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:45.884082 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-92dcd513-e4a3-48a4-bead-f3b0964ab3ed tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:45.884854 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-92dcd513-e4a3-48a4-bead-f3b0964ab3ed tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:45.885784 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-92dcd513-e4a3-48a4-bead-f3b0964ab3ed tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:45.886746 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-92dcd513-e4a3-48a4-bead-f3b0964ab3ed tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:45.887655 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-92dcd513-e4a3-48a4-bead-f3b0964ab3ed tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:45.888321 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-92dcd513-e4a3-48a4-bead-f3b0964ab3ed tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:46.042350 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-92dcd513-e4a3-48a4-bead-f3b0964ab3ed tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:46.050596 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-92dcd513-e4a3-48a4-bead-f3b0964ab3ed tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2" status: 200 len: 1717 microversion: 2.1 time: 0.180103 Oct 18 15:29:46.051211 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 625/1315] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:45 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2 => generated 1717 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:46.101066 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a20bfa8a-2099-4521-a764-7cbfd26b8dfa tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:46.102034 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a20bfa8a-2099-4521-a764-7cbfd26b8dfa tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:46.109022 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a20bfa8a-2099-4521-a764-7cbfd26b8dfa tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:46.110466 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a20bfa8a-2099-4521-a764-7cbfd26b8dfa tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:46.111153 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a20bfa8a-2099-4521-a764-7cbfd26b8dfa tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:46.112132 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a20bfa8a-2099-4521-a764-7cbfd26b8dfa tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:46.112784 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a20bfa8a-2099-4521-a764-7cbfd26b8dfa tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:46.113435 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a20bfa8a-2099-4521-a764-7cbfd26b8dfa tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:46.173160 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-03749849-6fc3-4624-ae00-55d882a5450c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:46.174196 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-03749849-6fc3-4624-ae00-55d882a5450c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 4b959d9f-3c8e-44ef-92f1-83cfb8e04804] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:46.180107 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-03749849-6fc3-4624-ae00-55d882a5450c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:46.180591 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-03749849-6fc3-4624-ae00-55d882a5450c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:46.181145 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-03749849-6fc3-4624-ae00-55d882a5450c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:46.181832 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-03749849-6fc3-4624-ae00-55d882a5450c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:46.182466 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-03749849-6fc3-4624-ae00-55d882a5450c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:46.182880 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-03749849-6fc3-4624-ae00-55d882a5450c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:46.186931 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a20bfa8a-2099-4521-a764-7cbfd26b8dfa tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:46.196133 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a20bfa8a-2099-4521-a764-7cbfd26b8dfa tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:46.198158 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a20bfa8a-2099-4521-a764-7cbfd26b8dfa tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:46.204974 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a20bfa8a-2099-4521-a764-7cbfd26b8dfa tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1539 microversion: 2.91 time: 0.108483 Oct 18 15:29:46.217564 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 691/1316] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:46 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1539 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:46.315556 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e482ab41-848c-4853-ae2b-8717d458ea3a tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:46.316112 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e482ab41-848c-4853-ae2b-8717d458ea3a tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: bd6231eb-95a4-465e-a859-077a7f82f585] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:46.323392 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e482ab41-848c-4853-ae2b-8717d458ea3a tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:46.323882 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e482ab41-848c-4853-ae2b-8717d458ea3a tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:46.324316 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e482ab41-848c-4853-ae2b-8717d458ea3a tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:46.325062 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e482ab41-848c-4853-ae2b-8717d458ea3a tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:46.325517 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e482ab41-848c-4853-ae2b-8717d458ea3a tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:46.325939 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e482ab41-848c-4853-ae2b-8717d458ea3a tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:46.363959 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e482ab41-848c-4853-ae2b-8717d458ea3a tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:46.364834 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e482ab41-848c-4853-ae2b-8717d458ea3a tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:46.365482 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e482ab41-848c-4853-ae2b-8717d458ea3a tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:46.366941 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-e482ab41-848c-4853-ae2b-8717d458ea3a tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lazy-loading 'fault' on Instance uuid bd6231eb-95a4-465e-a859-077a7f82f585 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:29:46.376313 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-03749849-6fc3-4624-ae00-55d882a5450c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:46.393969 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-03749849-6fc3-4624-ae00-55d882a5450c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804" status: 200 len: 1307 microversion: 2.1 time: 0.224530 Oct 18 15:29:46.408838 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 626/1317] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:46 2022] GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804 => generated 1307 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:29:46.419188 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e482ab41-848c-4853-ae2b-8717d458ea3a tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1023300147f463e8f0894981948f825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac07f1b2c83a4faab175a5b9ed8e315e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:46.429625 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e482ab41-848c-4853-ae2b-8717d458ea3a tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585" status: 200 len: 1307 microversion: 2.1 time: 0.117839 Oct 18 15:29:46.439211 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 692/1318] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:46 2022] GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585 => generated 1307 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:29:46.467841 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5cee44a8-d339-4445-96a8-6fa359908387 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:46.468436 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5cee44a8-d339-4445-96a8-6fa359908387 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 40097653-662f-4191-983d-881387af06a8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:46.474954 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5cee44a8-d339-4445-96a8-6fa359908387 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:46.475394 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5cee44a8-d339-4445-96a8-6fa359908387 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:46.475826 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5cee44a8-d339-4445-96a8-6fa359908387 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:46.476533 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5cee44a8-d339-4445-96a8-6fa359908387 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:46.477024 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5cee44a8-d339-4445-96a8-6fa359908387 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:46.477455 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5cee44a8-d339-4445-96a8-6fa359908387 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:46.556551 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5cee44a8-d339-4445-96a8-6fa359908387 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:46.560380 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=100 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:29:46.565178 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5cee44a8-d339-4445-96a8-6fa359908387 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8" status: 200 len: 1220 microversion: 2.1 time: 0.101113 Oct 18 15:29:46.565757 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 627/1319] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:46 2022] GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8 => generated 1220 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:29:46.615617 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9c2ee560-79ed-4639-ad5a-d9d3cd069244 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:46.616254 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9c2ee560-79ed-4639-ad5a-d9d3cd069244 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] [instance: 74e5ae75-9c35-4610-9cb5-61afa6f98581] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:46.623455 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c2ee560-79ed-4639-ad5a-d9d3cd069244 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:46.624326 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c2ee560-79ed-4639-ad5a-d9d3cd069244 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:46.625219 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c2ee560-79ed-4639-ad5a-d9d3cd069244 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:46.626081 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c2ee560-79ed-4639-ad5a-d9d3cd069244 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:46.626551 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c2ee560-79ed-4639-ad5a-d9d3cd069244 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:46.627057 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c2ee560-79ed-4639-ad5a-d9d3cd069244 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:46.706631 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9c2ee560-79ed-4639-ad5a-d9d3cd069244 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe80f2ae3ec4365a031ca7472d76e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df909cb429f46c39a83c29fb260b169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:46.719634 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9c2ee560-79ed-4639-ad5a-d9d3cd069244 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] 10.222.0.60 "GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581" status: 200 len: 1278 microversion: 2.1 time: 0.109179 Oct 18 15:29:46.720932 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 693/1320] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:46 2022] GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581 => generated 1278 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:46.736744 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e7549695-7b9a-4d0f-bfa8-4c8f15506938 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:46.737388 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e7549695-7b9a-4d0f-bfa8-4c8f15506938 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:46.745460 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e7549695-7b9a-4d0f-bfa8-4c8f15506938 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:46.747296 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e7549695-7b9a-4d0f-bfa8-4c8f15506938 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:46.747296 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e7549695-7b9a-4d0f-bfa8-4c8f15506938 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:46.747296 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e7549695-7b9a-4d0f-bfa8-4c8f15506938 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:46.747596 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e7549695-7b9a-4d0f-bfa8-4c8f15506938 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:46.747947 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e7549695-7b9a-4d0f-bfa8-4c8f15506938 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:46.954411 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e7549695-7b9a-4d0f-bfa8-4c8f15506938 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:46.964930 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e7549695-7b9a-4d0f-bfa8-4c8f15506938 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:46.966392 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e7549695-7b9a-4d0f-bfa8-4c8f15506938 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:46.967553 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e7549695-7b9a-4d0f-bfa8-4c8f15506938 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 1880 microversion: 2.42 time: 0.234648 Oct 18 15:29:46.968137 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 628/1321] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:46 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 1880 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:47.074346 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9d3206d9-8cca-4b4b-9251-6589c1662ae2 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:47.075032 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9d3206d9-8cca-4b4b-9251-6589c1662ae2 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:47.081829 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d3206d9-8cca-4b4b-9251-6589c1662ae2 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:47.083191 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d3206d9-8cca-4b4b-9251-6589c1662ae2 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:47.083636 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d3206d9-8cca-4b4b-9251-6589c1662ae2 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:47.084405 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d3206d9-8cca-4b4b-9251-6589c1662ae2 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:47.085276 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d3206d9-8cca-4b4b-9251-6589c1662ae2 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:47.085707 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d3206d9-8cca-4b4b-9251-6589c1662ae2 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:47.235591 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d46012ae-b2bb-4430-ae3f-f7367e610149 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:47.235751 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9d3206d9-8cca-4b4b-9251-6589c1662ae2 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:47.236202 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d46012ae-b2bb-4430-ae3f-f7367e610149 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:47.242190 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d46012ae-b2bb-4430-ae3f-f7367e610149 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:47.242674 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d46012ae-b2bb-4430-ae3f-f7367e610149 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:47.243111 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d46012ae-b2bb-4430-ae3f-f7367e610149 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:47.243802 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d46012ae-b2bb-4430-ae3f-f7367e610149 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:47.244155 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9d3206d9-8cca-4b4b-9251-6589c1662ae2 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2" status: 200 len: 1717 microversion: 2.1 time: 0.174313 Oct 18 15:29:47.244281 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d46012ae-b2bb-4430-ae3f-f7367e610149 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:47.244696 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d46012ae-b2bb-4430-ae3f-f7367e610149 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:47.244793 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 694/1322] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:47 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2 => generated 1717 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:47.309477 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d46012ae-b2bb-4430-ae3f-f7367e610149 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:47.318246 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d46012ae-b2bb-4430-ae3f-f7367e610149 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:47.319715 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d46012ae-b2bb-4430-ae3f-f7367e610149 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:47.326116 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d46012ae-b2bb-4430-ae3f-f7367e610149 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1539 microversion: 2.91 time: 0.094270 Oct 18 15:29:47.326615 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 629/1323] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:47 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1539 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:29:47.423845 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a992ea4c-1994-418d-9062-77cc0c622661 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:47.424462 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a992ea4c-1994-418d-9062-77cc0c622661 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 4b959d9f-3c8e-44ef-92f1-83cfb8e04804] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:47.430976 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a992ea4c-1994-418d-9062-77cc0c622661 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:47.432061 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a992ea4c-1994-418d-9062-77cc0c622661 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:47.432061 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a992ea4c-1994-418d-9062-77cc0c622661 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:47.432696 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a992ea4c-1994-418d-9062-77cc0c622661 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:47.433411 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a992ea4c-1994-418d-9062-77cc0c622661 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:47.433628 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a992ea4c-1994-418d-9062-77cc0c622661 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:47.456550 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a937140c-b85a-449b-8f8e-bdcd1077aefd tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:47.464949 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a937140c-b85a-449b-8f8e-bdcd1077aefd tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: bd6231eb-95a4-465e-a859-077a7f82f585] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:47.471322 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a937140c-b85a-449b-8f8e-bdcd1077aefd tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:47.471962 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a937140c-b85a-449b-8f8e-bdcd1077aefd tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:47.476630 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a937140c-b85a-449b-8f8e-bdcd1077aefd tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:47.477532 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a937140c-b85a-449b-8f8e-bdcd1077aefd tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:47.478122 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a937140c-b85a-449b-8f8e-bdcd1077aefd tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:47.478655 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a937140c-b85a-449b-8f8e-bdcd1077aefd tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:47.529659 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a937140c-b85a-449b-8f8e-bdcd1077aefd tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:47.530421 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a937140c-b85a-449b-8f8e-bdcd1077aefd tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:47.530860 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a937140c-b85a-449b-8f8e-bdcd1077aefd tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:47.531311 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-a937140c-b85a-449b-8f8e-bdcd1077aefd tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lazy-loading 'fault' on Instance uuid bd6231eb-95a4-465e-a859-077a7f82f585 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:29:47.627205 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a937140c-b85a-449b-8f8e-bdcd1077aefd tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1023300147f463e8f0894981948f825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac07f1b2c83a4faab175a5b9ed8e315e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:47.635754 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a937140c-b85a-449b-8f8e-bdcd1077aefd tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585" status: 200 len: 1307 microversion: 2.1 time: 0.184865 Oct 18 15:29:47.636907 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 630/1324] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:47 2022] GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585 => generated 1307 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:47.646564 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fecd1581-dd24-4b0c-891c-8e436f5fbd75 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:47.647115 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-fecd1581-dd24-4b0c-891c-8e436f5fbd75 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 40097653-662f-4191-983d-881387af06a8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:47.658967 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fecd1581-dd24-4b0c-891c-8e436f5fbd75 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:47.659496 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fecd1581-dd24-4b0c-891c-8e436f5fbd75 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:47.659921 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fecd1581-dd24-4b0c-891c-8e436f5fbd75 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:47.660058 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a992ea4c-1994-418d-9062-77cc0c622661 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:47.661223 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fecd1581-dd24-4b0c-891c-8e436f5fbd75 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:47.661692 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fecd1581-dd24-4b0c-891c-8e436f5fbd75 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:47.662123 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fecd1581-dd24-4b0c-891c-8e436f5fbd75 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:47.669631 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a992ea4c-1994-418d-9062-77cc0c622661 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804" status: 200 len: 1307 microversion: 2.1 time: 0.249595 Oct 18 15:29:47.686921 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 695/1325] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:47 2022] GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804 => generated 1307 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:47.743995 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0785415b-7664-4902-bd1f-cab08c29d678 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:47.744655 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0785415b-7664-4902-bd1f-cab08c29d678 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] [instance: 74e5ae75-9c35-4610-9cb5-61afa6f98581] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:47.754753 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0785415b-7664-4902-bd1f-cab08c29d678 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:47.754868 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-fecd1581-dd24-4b0c-891c-8e436f5fbd75 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:47.754971 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0785415b-7664-4902-bd1f-cab08c29d678 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:47.754971 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0785415b-7664-4902-bd1f-cab08c29d678 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:47.754971 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0785415b-7664-4902-bd1f-cab08c29d678 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:47.754971 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0785415b-7664-4902-bd1f-cab08c29d678 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:47.755284 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0785415b-7664-4902-bd1f-cab08c29d678 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:47.760764 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fecd1581-dd24-4b0c-891c-8e436f5fbd75 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8" status: 200 len: 1220 microversion: 2.1 time: 0.122589 Oct 18 15:29:47.761397 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 631/1326] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:47 2022] GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8 => generated 1220 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:47.831843 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0785415b-7664-4902-bd1f-cab08c29d678 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe80f2ae3ec4365a031ca7472d76e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df909cb429f46c39a83c29fb260b169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:47.839925 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0785415b-7664-4902-bd1f-cab08c29d678 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] 10.222.0.60 "GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581" status: 200 len: 1278 microversion: 2.1 time: 0.100152 Oct 18 15:29:47.840644 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 696/1327] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:47 2022] GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581 => generated 1278 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:47.992954 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c11b6613-01b1-428b-a2d3-5177ffc16d7b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:47.993934 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c11b6613-01b1-428b-a2d3-5177ffc16d7b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:48.001147 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c11b6613-01b1-428b-a2d3-5177ffc16d7b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:48.001924 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c11b6613-01b1-428b-a2d3-5177ffc16d7b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:48.002366 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c11b6613-01b1-428b-a2d3-5177ffc16d7b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:48.003092 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c11b6613-01b1-428b-a2d3-5177ffc16d7b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:48.003549 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c11b6613-01b1-428b-a2d3-5177ffc16d7b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:48.004496 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c11b6613-01b1-428b-a2d3-5177ffc16d7b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:48.201450 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c11b6613-01b1-428b-a2d3-5177ffc16d7b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:48.211524 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c11b6613-01b1-428b-a2d3-5177ffc16d7b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:48.213008 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c11b6613-01b1-428b-a2d3-5177ffc16d7b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:48.214180 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c11b6613-01b1-428b-a2d3-5177ffc16d7b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 1880 microversion: 2.42 time: 0.225112 Oct 18 15:29:48.214741 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 632/1328] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:47 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 1880 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:48.269920 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-978c7762-b680-45fa-9252-96ec328fccf1 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:48.271233 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-978c7762-b680-45fa-9252-96ec328fccf1 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:48.279442 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-978c7762-b680-45fa-9252-96ec328fccf1 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:48.279966 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-978c7762-b680-45fa-9252-96ec328fccf1 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:48.280426 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-978c7762-b680-45fa-9252-96ec328fccf1 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:48.281207 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-978c7762-b680-45fa-9252-96ec328fccf1 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:48.281659 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-978c7762-b680-45fa-9252-96ec328fccf1 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:48.282082 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-978c7762-b680-45fa-9252-96ec328fccf1 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:48.354806 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e4e60a15-87ea-47b3-9801-efdea9e25790 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:48.355454 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e4e60a15-87ea-47b3-9801-efdea9e25790 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:48.361390 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4e60a15-87ea-47b3-9801-efdea9e25790 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:48.361889 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4e60a15-87ea-47b3-9801-efdea9e25790 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:48.362325 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4e60a15-87ea-47b3-9801-efdea9e25790 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:48.363026 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4e60a15-87ea-47b3-9801-efdea9e25790 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:48.364099 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4e60a15-87ea-47b3-9801-efdea9e25790 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:48.364533 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4e60a15-87ea-47b3-9801-efdea9e25790 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:48.443467 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-978c7762-b680-45fa-9252-96ec328fccf1 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:48.447915 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e4e60a15-87ea-47b3-9801-efdea9e25790 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:48.452516 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-978c7762-b680-45fa-9252-96ec328fccf1 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2" status: 200 len: 1717 microversion: 2.1 time: 0.188006 Oct 18 15:29:48.453074 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 697/1329] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:48 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2 => generated 1717 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:48.457021 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e4e60a15-87ea-47b3-9801-efdea9e25790 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:48.458518 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e4e60a15-87ea-47b3-9801-efdea9e25790 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:48.463767 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e4e60a15-87ea-47b3-9801-efdea9e25790 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1539 microversion: 2.91 time: 0.112917 Oct 18 15:29:48.464328 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 633/1330] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:48 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1539 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:29:48.666783 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7dad971f-940f-4368-8721-78691d7cd743 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:48.667392 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7dad971f-940f-4368-8721-78691d7cd743 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: bd6231eb-95a4-465e-a859-077a7f82f585] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:48.673408 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7dad971f-940f-4368-8721-78691d7cd743 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:48.673883 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7dad971f-940f-4368-8721-78691d7cd743 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:48.674312 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7dad971f-940f-4368-8721-78691d7cd743 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:48.674993 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7dad971f-940f-4368-8721-78691d7cd743 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:48.675471 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7dad971f-940f-4368-8721-78691d7cd743 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:48.676586 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7dad971f-940f-4368-8721-78691d7cd743 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:48.691812 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c98abbbd-68b7-4428-95bc-d9ddd4b162c0 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:48.692461 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:29:48.693116 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c98abbbd-68b7-4428-95bc-d9ddd4b162c0 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 4b959d9f-3c8e-44ef-92f1-83cfb8e04804] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:48.699852 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c98abbbd-68b7-4428-95bc-d9ddd4b162c0 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:48.700340 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c98abbbd-68b7-4428-95bc-d9ddd4b162c0 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:48.700773 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c98abbbd-68b7-4428-95bc-d9ddd4b162c0 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:48.701492 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c98abbbd-68b7-4428-95bc-d9ddd4b162c0 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:48.702049 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c98abbbd-68b7-4428-95bc-d9ddd4b162c0 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:48.702734 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c98abbbd-68b7-4428-95bc-d9ddd4b162c0 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:48.712630 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7dad971f-940f-4368-8721-78691d7cd743 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:48.713144 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7dad971f-940f-4368-8721-78691d7cd743 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:48.713581 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7dad971f-940f-4368-8721-78691d7cd743 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:48.714035 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-7dad971f-940f-4368-8721-78691d7cd743 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lazy-loading 'fault' on Instance uuid bd6231eb-95a4-465e-a859-077a7f82f585 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:29:48.803011 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7dad971f-940f-4368-8721-78691d7cd743 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1023300147f463e8f0894981948f825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac07f1b2c83a4faab175a5b9ed8e315e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:48.811237 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7dad971f-940f-4368-8721-78691d7cd743 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585" status: 200 len: 1307 microversion: 2.1 time: 0.148204 Oct 18 15:29:48.811930 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 698/1331] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:48 2022] GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585 => generated 1307 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:48.820940 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6646bd9e-b20d-42c8-9603-93eb805bda65 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:48.820940 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6646bd9e-b20d-42c8-9603-93eb805bda65 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 40097653-662f-4191-983d-881387af06a8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:48.825393 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6646bd9e-b20d-42c8-9603-93eb805bda65 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:48.826001 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6646bd9e-b20d-42c8-9603-93eb805bda65 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:48.826519 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6646bd9e-b20d-42c8-9603-93eb805bda65 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:48.827387 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6646bd9e-b20d-42c8-9603-93eb805bda65 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:48.827914 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6646bd9e-b20d-42c8-9603-93eb805bda65 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:48.828410 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6646bd9e-b20d-42c8-9603-93eb805bda65 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:48.930272 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6646bd9e-b20d-42c8-9603-93eb805bda65 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:48.934567 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c98abbbd-68b7-4428-95bc-d9ddd4b162c0 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:48.946426 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c98abbbd-68b7-4428-95bc-d9ddd4b162c0 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804" status: 200 len: 1307 microversion: 2.1 time: 0.257633 Oct 18 15:29:48.948131 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 634/1332] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:48 2022] GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804 => generated 1307 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:29:48.955317 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6646bd9e-b20d-42c8-9603-93eb805bda65 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8" status: 200 len: 1220 microversion: 2.1 time: 0.142169 Oct 18 15:29:48.955834 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 699/1333] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:48 2022] GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8 => generated 1220 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:48.963508 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3cfe0755-b8c3-4a2b-afed-122b10706f8e tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:48.964135 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3cfe0755-b8c3-4a2b-afed-122b10706f8e tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] [instance: 74e5ae75-9c35-4610-9cb5-61afa6f98581] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:48.979268 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3cfe0755-b8c3-4a2b-afed-122b10706f8e tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:48.979840 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3cfe0755-b8c3-4a2b-afed-122b10706f8e tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:48.980338 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3cfe0755-b8c3-4a2b-afed-122b10706f8e tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:48.981174 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3cfe0755-b8c3-4a2b-afed-122b10706f8e tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:48.981727 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3cfe0755-b8c3-4a2b-afed-122b10706f8e tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:48.982215 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3cfe0755-b8c3-4a2b-afed-122b10706f8e tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:49.060075 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3cfe0755-b8c3-4a2b-afed-122b10706f8e tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe80f2ae3ec4365a031ca7472d76e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df909cb429f46c39a83c29fb260b169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:49.068377 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3cfe0755-b8c3-4a2b-afed-122b10706f8e tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] 10.222.0.60 "GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581" status: 200 len: 1278 microversion: 2.1 time: 0.117948 Oct 18 15:29:49.069414 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 635/1334] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:48 2022] GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581 => generated 1278 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:49.239798 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-623451ac-aa85-420e-96d2-5cff87d8726b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:49.240678 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-623451ac-aa85-420e-96d2-5cff87d8726b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:49.247631 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-623451ac-aa85-420e-96d2-5cff87d8726b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:49.248397 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-623451ac-aa85-420e-96d2-5cff87d8726b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:49.249045 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-623451ac-aa85-420e-96d2-5cff87d8726b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:49.249791 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-623451ac-aa85-420e-96d2-5cff87d8726b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:49.250250 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-623451ac-aa85-420e-96d2-5cff87d8726b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:49.250678 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-623451ac-aa85-420e-96d2-5cff87d8726b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:49.454298 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-623451ac-aa85-420e-96d2-5cff87d8726b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:49.464320 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-623451ac-aa85-420e-96d2-5cff87d8726b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:49.465802 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-623451ac-aa85-420e-96d2-5cff87d8726b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:49.466987 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-623451ac-aa85-420e-96d2-5cff87d8726b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 1880 microversion: 2.42 time: 0.231312 Oct 18 15:29:49.469005 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 700/1335] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:49 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 1880 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:49.479473 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-db3ba25f-ca12-429f-ae2e-517612eea0ff tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:49.480453 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-db3ba25f-ca12-429f-ae2e-517612eea0ff tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:49.488599 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-db3ba25f-ca12-429f-ae2e-517612eea0ff tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:49.489196 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-db3ba25f-ca12-429f-ae2e-517612eea0ff tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:49.489638 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-db3ba25f-ca12-429f-ae2e-517612eea0ff tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:49.490528 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-db3ba25f-ca12-429f-ae2e-517612eea0ff tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:49.490935 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-db3ba25f-ca12-429f-ae2e-517612eea0ff tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:49.491368 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-db3ba25f-ca12-429f-ae2e-517612eea0ff tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:49.493627 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0cea7b7f-3e81-42d9-adc6-575d31bfc08e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:49.496265 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0cea7b7f-3e81-42d9-adc6-575d31bfc08e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:49.504657 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0cea7b7f-3e81-42d9-adc6-575d31bfc08e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:49.505547 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0cea7b7f-3e81-42d9-adc6-575d31bfc08e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:49.506229 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0cea7b7f-3e81-42d9-adc6-575d31bfc08e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:49.507197 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0cea7b7f-3e81-42d9-adc6-575d31bfc08e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:49.507877 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0cea7b7f-3e81-42d9-adc6-575d31bfc08e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:49.508550 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0cea7b7f-3e81-42d9-adc6-575d31bfc08e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:49.595511 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0cea7b7f-3e81-42d9-adc6-575d31bfc08e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:49.606804 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0cea7b7f-3e81-42d9-adc6-575d31bfc08e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:49.610759 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0cea7b7f-3e81-42d9-adc6-575d31bfc08e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:49.614989 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0cea7b7f-3e81-42d9-adc6-575d31bfc08e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1539 microversion: 2.91 time: 0.125247 Oct 18 15:29:49.630215 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 701/1336] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:49 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1539 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:49.662890 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-db3ba25f-ca12-429f-ae2e-517612eea0ff tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:49.671188 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-db3ba25f-ca12-429f-ae2e-517612eea0ff tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2" status: 200 len: 1717 microversion: 2.1 time: 0.199686 Oct 18 15:29:49.671761 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 636/1337] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:49 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2 => generated 1717 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:49.834191 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dd552b44-1c31-481e-bfed-1f509fda49a3 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:49.835082 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dd552b44-1c31-481e-bfed-1f509fda49a3 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: bd6231eb-95a4-465e-a859-077a7f82f585] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:49.841137 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd552b44-1c31-481e-bfed-1f509fda49a3 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:49.841616 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd552b44-1c31-481e-bfed-1f509fda49a3 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:49.842048 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd552b44-1c31-481e-bfed-1f509fda49a3 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:49.842726 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd552b44-1c31-481e-bfed-1f509fda49a3 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:49.843173 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd552b44-1c31-481e-bfed-1f509fda49a3 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:49.843592 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd552b44-1c31-481e-bfed-1f509fda49a3 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:49.875115 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd552b44-1c31-481e-bfed-1f509fda49a3 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:49.875607 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd552b44-1c31-481e-bfed-1f509fda49a3 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:49.876049 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd552b44-1c31-481e-bfed-1f509fda49a3 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:49.876489 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-dd552b44-1c31-481e-bfed-1f509fda49a3 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lazy-loading 'fault' on Instance uuid bd6231eb-95a4-465e-a859-077a7f82f585 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:29:49.918954 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dd552b44-1c31-481e-bfed-1f509fda49a3 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1023300147f463e8f0894981948f825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac07f1b2c83a4faab175a5b9ed8e315e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:49.928578 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dd552b44-1c31-481e-bfed-1f509fda49a3 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585" status: 200 len: 1307 microversion: 2.1 time: 0.098331 Oct 18 15:29:49.929291 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 702/1338] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:49 2022] GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585 => generated 1307 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:49.971588 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2b60acb6-0099-4df5-a571-89bdd2a8baf9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:49.972306 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2b60acb6-0099-4df5-a571-89bdd2a8baf9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 4b959d9f-3c8e-44ef-92f1-83cfb8e04804] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:49.979421 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-517dcd4c-4a30-4dd5-ac71-385357eff0b1 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:49.980145 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-517dcd4c-4a30-4dd5-ac71-385357eff0b1 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 40097653-662f-4191-983d-881387af06a8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:49.986424 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-517dcd4c-4a30-4dd5-ac71-385357eff0b1 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:49.987103 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-517dcd4c-4a30-4dd5-ac71-385357eff0b1 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:49.987618 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-517dcd4c-4a30-4dd5-ac71-385357eff0b1 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:49.987813 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2b60acb6-0099-4df5-a571-89bdd2a8baf9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:49.988942 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-517dcd4c-4a30-4dd5-ac71-385357eff0b1 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:49.989095 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2b60acb6-0099-4df5-a571-89bdd2a8baf9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:49.989462 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-517dcd4c-4a30-4dd5-ac71-385357eff0b1 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:49.989582 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2b60acb6-0099-4df5-a571-89bdd2a8baf9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:49.989929 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-517dcd4c-4a30-4dd5-ac71-385357eff0b1 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:49.990414 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2b60acb6-0099-4df5-a571-89bdd2a8baf9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:49.990928 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2b60acb6-0099-4df5-a571-89bdd2a8baf9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:49.991412 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2b60acb6-0099-4df5-a571-89bdd2a8baf9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:50.062379 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-517dcd4c-4a30-4dd5-ac71-385357eff0b1 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:50.072153 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-517dcd4c-4a30-4dd5-ac71-385357eff0b1 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8" status: 200 len: 1220 microversion: 2.1 time: 0.096670 Oct 18 15:29:50.086745 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 703/1339] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:49 2022] GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8 => generated 1220 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:29:50.100425 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a18a1d7c-81a8-4279-b3ee-c825294c7246 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:50.101240 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a18a1d7c-81a8-4279-b3ee-c825294c7246 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] [instance: 74e5ae75-9c35-4610-9cb5-61afa6f98581] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:50.108381 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a18a1d7c-81a8-4279-b3ee-c825294c7246 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:50.109052 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a18a1d7c-81a8-4279-b3ee-c825294c7246 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:50.109618 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a18a1d7c-81a8-4279-b3ee-c825294c7246 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:50.110403 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a18a1d7c-81a8-4279-b3ee-c825294c7246 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:50.111063 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a18a1d7c-81a8-4279-b3ee-c825294c7246 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:50.111580 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a18a1d7c-81a8-4279-b3ee-c825294c7246 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:50.194104 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2b60acb6-0099-4df5-a571-89bdd2a8baf9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:50.204524 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2b60acb6-0099-4df5-a571-89bdd2a8baf9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804" status: 200 len: 1307 microversion: 2.1 time: 0.236772 Oct 18 15:29:50.208302 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 637/1340] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:49 2022] GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804 => generated 1307 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:50.211107 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a18a1d7c-81a8-4279-b3ee-c825294c7246 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe80f2ae3ec4365a031ca7472d76e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df909cb429f46c39a83c29fb260b169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:50.219199 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a18a1d7c-81a8-4279-b3ee-c825294c7246 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] 10.222.0.60 "GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581" status: 200 len: 1278 microversion: 2.1 time: 0.125977 Oct 18 15:29:50.219974 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 704/1341] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:50 2022] GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581 => generated 1278 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:50.492987 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7cafee7c-a04b-407a-bb2b-59a0241a9a21 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:50.493607 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7cafee7c-a04b-407a-bb2b-59a0241a9a21 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:50.499721 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7cafee7c-a04b-407a-bb2b-59a0241a9a21 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:50.500208 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7cafee7c-a04b-407a-bb2b-59a0241a9a21 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:50.500647 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7cafee7c-a04b-407a-bb2b-59a0241a9a21 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:50.501368 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7cafee7c-a04b-407a-bb2b-59a0241a9a21 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:50.501827 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7cafee7c-a04b-407a-bb2b-59a0241a9a21 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:50.502255 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7cafee7c-a04b-407a-bb2b-59a0241a9a21 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:50.644662 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c1eb1211-1822-47f1-b5a7-f8bb9995c221 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:50.646114 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c1eb1211-1822-47f1-b5a7-f8bb9995c221 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:50.653556 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1eb1211-1822-47f1-b5a7-f8bb9995c221 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:50.654311 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1eb1211-1822-47f1-b5a7-f8bb9995c221 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:50.654939 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1eb1211-1822-47f1-b5a7-f8bb9995c221 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:50.656322 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1eb1211-1822-47f1-b5a7-f8bb9995c221 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:50.657193 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1eb1211-1822-47f1-b5a7-f8bb9995c221 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:50.657871 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1eb1211-1822-47f1-b5a7-f8bb9995c221 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:50.699438 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7cafee7c-a04b-407a-bb2b-59a0241a9a21 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:50.708661 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7cafee7c-a04b-407a-bb2b-59a0241a9a21 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:50.710437 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7cafee7c-a04b-407a-bb2b-59a0241a9a21 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:50.711597 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7cafee7c-a04b-407a-bb2b-59a0241a9a21 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 1880 microversion: 2.42 time: 0.222559 Oct 18 15:29:50.712359 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 638/1342] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:50 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 1880 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:50.716844 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7ec01388-10bf-451f-9a20-0761748ba625 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:50.717459 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7ec01388-10bf-451f-9a20-0761748ba625 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:50.723781 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7ec01388-10bf-451f-9a20-0761748ba625 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:50.724267 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7ec01388-10bf-451f-9a20-0761748ba625 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:50.724705 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7ec01388-10bf-451f-9a20-0761748ba625 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:50.725434 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7ec01388-10bf-451f-9a20-0761748ba625 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:50.725895 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7ec01388-10bf-451f-9a20-0761748ba625 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:50.726321 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7ec01388-10bf-451f-9a20-0761748ba625 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:50.728887 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=8 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:29:50.748080 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c1eb1211-1822-47f1-b5a7-f8bb9995c221 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:50.757996 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c1eb1211-1822-47f1-b5a7-f8bb9995c221 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:50.759441 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c1eb1211-1822-47f1-b5a7-f8bb9995c221 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:50.764619 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c1eb1211-1822-47f1-b5a7-f8bb9995c221 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1539 microversion: 2.91 time: 0.123824 Oct 18 15:29:50.765229 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 705/1343] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:50 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1539 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:29:50.868567 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7ec01388-10bf-451f-9a20-0761748ba625 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:50.876875 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7ec01388-10bf-451f-9a20-0761748ba625 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2" status: 200 len: 1717 microversion: 2.1 time: 0.163651 Oct 18 15:29:50.877777 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 639/1344] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:50 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2 => generated 1717 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:50.951653 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9b500ba0-077a-42e7-9da7-4c719481b4cf tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:50.952250 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9b500ba0-077a-42e7-9da7-4c719481b4cf tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: bd6231eb-95a4-465e-a859-077a7f82f585] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:50.954148 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=20 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:29:50.960064 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9b500ba0-077a-42e7-9da7-4c719481b4cf tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:50.960659 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9b500ba0-077a-42e7-9da7-4c719481b4cf tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:50.961174 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9b500ba0-077a-42e7-9da7-4c719481b4cf tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:50.962014 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9b500ba0-077a-42e7-9da7-4c719481b4cf tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:50.962556 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9b500ba0-077a-42e7-9da7-4c719481b4cf tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:50.963045 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9b500ba0-077a-42e7-9da7-4c719481b4cf tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:50.995599 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9b500ba0-077a-42e7-9da7-4c719481b4cf tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:50.996071 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9b500ba0-077a-42e7-9da7-4c719481b4cf tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:50.996502 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9b500ba0-077a-42e7-9da7-4c719481b4cf tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:50.996982 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-9b500ba0-077a-42e7-9da7-4c719481b4cf tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lazy-loading 'fault' on Instance uuid bd6231eb-95a4-465e-a859-077a7f82f585 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:29:51.044184 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9b500ba0-077a-42e7-9da7-4c719481b4cf tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1023300147f463e8f0894981948f825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac07f1b2c83a4faab175a5b9ed8e315e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:51.055141 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9b500ba0-077a-42e7-9da7-4c719481b4cf tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585" status: 200 len: 1307 microversion: 2.1 time: 0.107390 Oct 18 15:29:51.055741 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 706/1345] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:50 2022] GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585 => generated 1307 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:51.076486 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-32fed9ea-7d7f-4302-ac2e-11713ef08ac9 req-05c36f34-fd10-485a-badf-621fa491d213 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23bdadc4-6faa-4e55-8daf-eef04dd34a8a", "name": "network-vif-plugged", "status": "completed", "tag": "b1a9859a-97e3-466a-9b12-d8aaa13a8141"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:29:51.086792 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-32fed9ea-7d7f-4302-ac2e-11713ef08ac9 req-05c36f34-fd10-485a-badf-621fa491d213 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:51.087536 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-32fed9ea-7d7f-4302-ac2e-11713ef08ac9 req-05c36f34-fd10-485a-badf-621fa491d213 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:51.087987 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-32fed9ea-7d7f-4302-ac2e-11713ef08ac9 req-05c36f34-fd10-485a-badf-621fa491d213 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:51.093060 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=10 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:29:51.099688 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dfa444ba-d60e-4389-9d1a-124242beba68 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:51.100936 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dfa444ba-d60e-4389-9d1a-124242beba68 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 40097653-662f-4191-983d-881387af06a8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:51.103030 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-32fed9ea-7d7f-4302-ac2e-11713ef08ac9 req-05c36f34-fd10-485a-badf-621fa491d213 service nova] Creating event network-vif-plugged:b1a9859a-97e3-466a-9b12-d8aaa13a8141 for instance 23bdadc4-6faa-4e55-8daf-eef04dd34a8a on n-h2-853682-5 Oct 18 15:29:51.108149 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfa444ba-d60e-4389-9d1a-124242beba68 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:51.109036 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-32fed9ea-7d7f-4302-ac2e-11713ef08ac9 req-05c36f34-fd10-485a-badf-621fa491d213 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102029 Oct 18 15:29:51.109407 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfa444ba-d60e-4389-9d1a-124242beba68 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:51.109661 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 640/1346] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:29:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:29:51.110274 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfa444ba-d60e-4389-9d1a-124242beba68 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:51.111520 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfa444ba-d60e-4389-9d1a-124242beba68 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:51.112077 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfa444ba-d60e-4389-9d1a-124242beba68 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:51.112581 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfa444ba-d60e-4389-9d1a-124242beba68 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:51.180368 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dfa444ba-d60e-4389-9d1a-124242beba68 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:51.192705 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dfa444ba-d60e-4389-9d1a-124242beba68 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8" status: 200 len: 1220 microversion: 2.1 time: 0.097518 Oct 18 15:29:51.205573 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 707/1347] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:51 2022] GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8 => generated 1220 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:51.232825 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c2a363ae-3c28-4305-836b-c249a2e5f563 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:51.233909 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c2a363ae-3c28-4305-836b-c249a2e5f563 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 4b959d9f-3c8e-44ef-92f1-83cfb8e04804] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:51.241262 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c2a363ae-3c28-4305-836b-c249a2e5f563 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:51.241832 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c2a363ae-3c28-4305-836b-c249a2e5f563 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:51.242369 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c2a363ae-3c28-4305-836b-c249a2e5f563 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:51.243180 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c2a363ae-3c28-4305-836b-c249a2e5f563 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:51.243762 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c2a363ae-3c28-4305-836b-c249a2e5f563 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:51.244255 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c2a363ae-3c28-4305-836b-c249a2e5f563 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:51.245132 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-262a7cc8-2efd-4fde-9a36-f5088bde7537 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:51.245751 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-262a7cc8-2efd-4fde-9a36-f5088bde7537 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] [instance: 74e5ae75-9c35-4610-9cb5-61afa6f98581] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:51.253423 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-262a7cc8-2efd-4fde-9a36-f5088bde7537 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:51.253965 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-262a7cc8-2efd-4fde-9a36-f5088bde7537 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:51.254410 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-262a7cc8-2efd-4fde-9a36-f5088bde7537 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:51.255130 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-262a7cc8-2efd-4fde-9a36-f5088bde7537 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:51.255588 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-262a7cc8-2efd-4fde-9a36-f5088bde7537 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:51.256015 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-262a7cc8-2efd-4fde-9a36-f5088bde7537 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:51.355938 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-262a7cc8-2efd-4fde-9a36-f5088bde7537 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe80f2ae3ec4365a031ca7472d76e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df909cb429f46c39a83c29fb260b169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:51.365398 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-262a7cc8-2efd-4fde-9a36-f5088bde7537 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] 10.222.0.60 "GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581" status: 200 len: 1278 microversion: 2.1 time: 0.125312 Oct 18 15:29:51.366552 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 708/1348] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:51 2022] GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581 => generated 1278 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:29:51.417434 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c2a363ae-3c28-4305-836b-c249a2e5f563 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:51.424983 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c2a363ae-3c28-4305-836b-c249a2e5f563 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804" status: 200 len: 1307 microversion: 2.1 time: 0.197259 Oct 18 15:29:51.425544 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 641/1349] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:51 2022] GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804 => generated 1307 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:29:51.741018 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-73a2a10e-b14b-4b3b-9b21-b7d323ca5eca tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:51.741636 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-73a2a10e-b14b-4b3b-9b21-b7d323ca5eca tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:51.748360 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73a2a10e-b14b-4b3b-9b21-b7d323ca5eca tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:51.748880 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73a2a10e-b14b-4b3b-9b21-b7d323ca5eca tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:51.749323 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73a2a10e-b14b-4b3b-9b21-b7d323ca5eca tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:51.750136 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73a2a10e-b14b-4b3b-9b21-b7d323ca5eca tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:51.750600 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73a2a10e-b14b-4b3b-9b21-b7d323ca5eca tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:51.751022 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73a2a10e-b14b-4b3b-9b21-b7d323ca5eca tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:51.793517 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bf6a9bfe-5c26-4298-84bb-23392ebb897b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:51.794297 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-bf6a9bfe-5c26-4298-84bb-23392ebb897b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:51.803139 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bf6a9bfe-5c26-4298-84bb-23392ebb897b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:51.803765 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bf6a9bfe-5c26-4298-84bb-23392ebb897b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:51.804303 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bf6a9bfe-5c26-4298-84bb-23392ebb897b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:51.805143 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bf6a9bfe-5c26-4298-84bb-23392ebb897b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:51.805679 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bf6a9bfe-5c26-4298-84bb-23392ebb897b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:51.806171 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bf6a9bfe-5c26-4298-84bb-23392ebb897b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:51.924651 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-bf6a9bfe-5c26-4298-84bb-23392ebb897b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:51.934744 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-bf6a9bfe-5c26-4298-84bb-23392ebb897b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:51.936574 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-bf6a9bfe-5c26-4298-84bb-23392ebb897b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:51.943065 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-bf6a9bfe-5c26-4298-84bb-23392ebb897b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1539 microversion: 2.91 time: 0.154753 Oct 18 15:29:51.944501 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 642/1350] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:51 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1539 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:51.949712 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-37e201d1-c574-4b3b-b8aa-5f2588bbbd0a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:51.950408 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-37e201d1-c574-4b3b-b8aa-5f2588bbbd0a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:51.956843 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37e201d1-c574-4b3b-b8aa-5f2588bbbd0a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:51.958080 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37e201d1-c574-4b3b-b8aa-5f2588bbbd0a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:51.958593 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37e201d1-c574-4b3b-b8aa-5f2588bbbd0a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:51.960558 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37e201d1-c574-4b3b-b8aa-5f2588bbbd0a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:51.960558 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37e201d1-c574-4b3b-b8aa-5f2588bbbd0a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:51.961056 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37e201d1-c574-4b3b-b8aa-5f2588bbbd0a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:51.973764 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-73a2a10e-b14b-4b3b-9b21-b7d323ca5eca tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:51.983713 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-73a2a10e-b14b-4b3b-9b21-b7d323ca5eca tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:51.985099 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-73a2a10e-b14b-4b3b-9b21-b7d323ca5eca tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:51.986803 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-73a2a10e-b14b-4b3b-9b21-b7d323ca5eca tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 1880 microversion: 2.42 time: 0.250538 Oct 18 15:29:51.996926 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 709/1351] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:51 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 1880 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:52.077842 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ac99e922-0d05-4d99-9936-206670773bab tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:52.078457 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ac99e922-0d05-4d99-9936-206670773bab tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: bd6231eb-95a4-465e-a859-077a7f82f585] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:52.084581 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac99e922-0d05-4d99-9936-206670773bab tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:52.085394 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac99e922-0d05-4d99-9936-206670773bab tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:52.085790 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac99e922-0d05-4d99-9936-206670773bab tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:52.086484 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac99e922-0d05-4d99-9936-206670773bab tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:52.087320 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac99e922-0d05-4d99-9936-206670773bab tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:52.087623 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac99e922-0d05-4d99-9936-206670773bab tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:52.109123 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-37e201d1-c574-4b3b-b8aa-5f2588bbbd0a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:52.118335 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-37e201d1-c574-4b3b-b8aa-5f2588bbbd0a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2" status: 200 len: 1717 microversion: 2.1 time: 0.172303 Oct 18 15:29:52.119504 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 643/1352] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:51 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2 => generated 1717 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:52.129773 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac99e922-0d05-4d99-9936-206670773bab tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:52.129773 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac99e922-0d05-4d99-9936-206670773bab tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:52.129773 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac99e922-0d05-4d99-9936-206670773bab tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:52.129773 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-ac99e922-0d05-4d99-9936-206670773bab tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lazy-loading 'fault' on Instance uuid bd6231eb-95a4-465e-a859-077a7f82f585 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:29:52.172425 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ac99e922-0d05-4d99-9936-206670773bab tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1023300147f463e8f0894981948f825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac07f1b2c83a4faab175a5b9ed8e315e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:52.180609 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ac99e922-0d05-4d99-9936-206670773bab tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585" status: 200 len: 1307 microversion: 2.1 time: 0.106653 Oct 18 15:29:52.181208 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 710/1353] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:52 2022] GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585 => generated 1307 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:29:52.217910 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-10943cab-cbe7-47c9-ab67-56bafbd7d0b0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:52.218553 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-10943cab-cbe7-47c9-ab67-56bafbd7d0b0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 40097653-662f-4191-983d-881387af06a8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:52.224841 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-10943cab-cbe7-47c9-ab67-56bafbd7d0b0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:52.225330 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-10943cab-cbe7-47c9-ab67-56bafbd7d0b0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:52.225765 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-10943cab-cbe7-47c9-ab67-56bafbd7d0b0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:52.226487 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-10943cab-cbe7-47c9-ab67-56bafbd7d0b0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:52.226972 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-10943cab-cbe7-47c9-ab67-56bafbd7d0b0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:52.227399 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-10943cab-cbe7-47c9-ab67-56bafbd7d0b0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:52.288796 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-10943cab-cbe7-47c9-ab67-56bafbd7d0b0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:52.292445 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=100 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:29:52.297479 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-10943cab-cbe7-47c9-ab67-56bafbd7d0b0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8" status: 200 len: 1220 microversion: 2.1 time: 0.083421 Oct 18 15:29:52.298054 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 644/1354] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:52 2022] GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:52.389555 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b9ccdbac-4c27-4899-b96c-3546d9f5c77f tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:52.390101 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b9ccdbac-4c27-4899-b96c-3546d9f5c77f tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] [instance: 74e5ae75-9c35-4610-9cb5-61afa6f98581] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:52.396166 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b9ccdbac-4c27-4899-b96c-3546d9f5c77f tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:52.396658 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b9ccdbac-4c27-4899-b96c-3546d9f5c77f tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:52.397127 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b9ccdbac-4c27-4899-b96c-3546d9f5c77f tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:52.397817 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b9ccdbac-4c27-4899-b96c-3546d9f5c77f tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:52.398274 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b9ccdbac-4c27-4899-b96c-3546d9f5c77f tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:52.398702 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b9ccdbac-4c27-4899-b96c-3546d9f5c77f tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:52.447448 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ed664a12-2911-4cc6-80c6-afac78d4542c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:52.448216 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ed664a12-2911-4cc6-80c6-afac78d4542c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 4b959d9f-3c8e-44ef-92f1-83cfb8e04804] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:52.454815 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ed664a12-2911-4cc6-80c6-afac78d4542c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:52.455303 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ed664a12-2911-4cc6-80c6-afac78d4542c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:52.455744 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ed664a12-2911-4cc6-80c6-afac78d4542c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:52.456445 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ed664a12-2911-4cc6-80c6-afac78d4542c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:52.456965 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ed664a12-2911-4cc6-80c6-afac78d4542c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:52.457403 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ed664a12-2911-4cc6-80c6-afac78d4542c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:52.460769 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b9ccdbac-4c27-4899-b96c-3546d9f5c77f tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe80f2ae3ec4365a031ca7472d76e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df909cb429f46c39a83c29fb260b169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:52.468830 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b9ccdbac-4c27-4899-b96c-3546d9f5c77f tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] 10.222.0.60 "GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581" status: 200 len: 1278 microversion: 2.1 time: 0.083293 Oct 18 15:29:52.469440 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 711/1355] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:52 2022] GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581 => generated 1278 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:52.584531 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ed664a12-2911-4cc6-80c6-afac78d4542c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:52.592413 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ed664a12-2911-4cc6-80c6-afac78d4542c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804" status: 200 len: 1307 microversion: 2.1 time: 0.148775 Oct 18 15:29:52.593007 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 645/1356] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:52 2022] GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804 => generated 1307 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:29:52.974454 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ee7eee5a-2a74-467c-9de0-a12b5e6cc418 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:52.974977 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ee7eee5a-2a74-467c-9de0-a12b5e6cc418 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:52.981771 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee7eee5a-2a74-467c-9de0-a12b5e6cc418 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:52.982249 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee7eee5a-2a74-467c-9de0-a12b5e6cc418 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:52.982678 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee7eee5a-2a74-467c-9de0-a12b5e6cc418 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:52.983356 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee7eee5a-2a74-467c-9de0-a12b5e6cc418 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:52.983808 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee7eee5a-2a74-467c-9de0-a12b5e6cc418 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:52.984227 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee7eee5a-2a74-467c-9de0-a12b5e6cc418 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:53.014841 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-539dd0b1-bbf5-47e8-babe-943874e73ced tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:53.015461 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-539dd0b1-bbf5-47e8-babe-943874e73ced tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:53.022452 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-539dd0b1-bbf5-47e8-babe-943874e73ced tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:53.022940 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-539dd0b1-bbf5-47e8-babe-943874e73ced tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:53.023381 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-539dd0b1-bbf5-47e8-babe-943874e73ced tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:53.024096 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-539dd0b1-bbf5-47e8-babe-943874e73ced tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:53.024640 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-539dd0b1-bbf5-47e8-babe-943874e73ced tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:53.025100 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-539dd0b1-bbf5-47e8-babe-943874e73ced tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:53.052242 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ee7eee5a-2a74-467c-9de0-a12b5e6cc418 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:53.060394 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ee7eee5a-2a74-467c-9de0-a12b5e6cc418 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:53.061928 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ee7eee5a-2a74-467c-9de0-a12b5e6cc418 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:53.067552 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ee7eee5a-2a74-467c-9de0-a12b5e6cc418 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1539 microversion: 2.91 time: 0.097646 Oct 18 15:29:53.068842 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 712/1357] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:52 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1539 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:53.129872 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-05431636-fa7b-4eaa-b43a-ccfcf65a08be req-3ec5ba9d-6afb-4206-89f0-343182b65022 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23bdadc4-6faa-4e55-8daf-eef04dd34a8a", "name": "network-vif-plugged", "status": "completed", "tag": "44427cac-ace4-451a-be16-8086d2ad6d0e"}, {"server_uuid": "23bdadc4-6faa-4e55-8daf-eef04dd34a8a", "name": "network-vif-plugged", "status": "completed", "tag": "76b7ba58-dbc1-487b-a62e-3d7ee373767c"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:29:53.139715 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-05431636-fa7b-4eaa-b43a-ccfcf65a08be req-3ec5ba9d-6afb-4206-89f0-343182b65022 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:53.140185 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-05431636-fa7b-4eaa-b43a-ccfcf65a08be req-3ec5ba9d-6afb-4206-89f0-343182b65022 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:53.140604 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-05431636-fa7b-4eaa-b43a-ccfcf65a08be req-3ec5ba9d-6afb-4206-89f0-343182b65022 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:53.153982 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-05431636-fa7b-4eaa-b43a-ccfcf65a08be req-3ec5ba9d-6afb-4206-89f0-343182b65022 service nova] Creating event network-vif-plugged:44427cac-ace4-451a-be16-8086d2ad6d0e for instance 23bdadc4-6faa-4e55-8daf-eef04dd34a8a on n-h2-853682-5 Oct 18 15:29:53.154492 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-05431636-fa7b-4eaa-b43a-ccfcf65a08be req-3ec5ba9d-6afb-4206-89f0-343182b65022 service nova] Creating event network-vif-plugged:76b7ba58-dbc1-487b-a62e-3d7ee373767c for instance 23bdadc4-6faa-4e55-8daf-eef04dd34a8a on n-h2-853682-5 Oct 18 15:29:53.160607 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-05431636-fa7b-4eaa-b43a-ccfcf65a08be req-3ec5ba9d-6afb-4206-89f0-343182b65022 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034195 Oct 18 15:29:53.161264 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 713/1358] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:29:53 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:29:53.166499 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fccb1a74-708d-4d25-a876-f6637e00c8f6 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:53.167213 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fccb1a74-708d-4d25-a876-f6637e00c8f6 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:53.173343 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fccb1a74-708d-4d25-a876-f6637e00c8f6 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:53.173825 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fccb1a74-708d-4d25-a876-f6637e00c8f6 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:53.174255 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fccb1a74-708d-4d25-a876-f6637e00c8f6 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:53.174948 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fccb1a74-708d-4d25-a876-f6637e00c8f6 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:53.175402 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fccb1a74-708d-4d25-a876-f6637e00c8f6 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:53.176405 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fccb1a74-708d-4d25-a876-f6637e00c8f6 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:53.192318 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:29:53.209214 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-539dd0b1-bbf5-47e8-babe-943874e73ced tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:53.218785 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-539dd0b1-bbf5-47e8-babe-943874e73ced tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:53.220237 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-539dd0b1-bbf5-47e8-babe-943874e73ced tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:53.221433 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-539dd0b1-bbf5-47e8-babe-943874e73ced tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 1880 microversion: 2.42 time: 0.211073 Oct 18 15:29:53.222389 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 646/1359] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:53 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 1880 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:29:53.227822 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-29b41ae2-e362-4b6e-8e68-e852967414ee tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:53.228351 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-29b41ae2-e362-4b6e-8e68-e852967414ee tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: bd6231eb-95a4-465e-a859-077a7f82f585] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:53.234462 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-29b41ae2-e362-4b6e-8e68-e852967414ee tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:53.235006 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-29b41ae2-e362-4b6e-8e68-e852967414ee tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:53.235449 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-29b41ae2-e362-4b6e-8e68-e852967414ee tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:53.236148 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-29b41ae2-e362-4b6e-8e68-e852967414ee tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:53.236610 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-29b41ae2-e362-4b6e-8e68-e852967414ee tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:53.237068 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-29b41ae2-e362-4b6e-8e68-e852967414ee tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:53.265877 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=100 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:29:53.269874 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-29b41ae2-e362-4b6e-8e68-e852967414ee tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:53.270367 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-29b41ae2-e362-4b6e-8e68-e852967414ee tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:53.270808 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-29b41ae2-e362-4b6e-8e68-e852967414ee tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:53.271261 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-29b41ae2-e362-4b6e-8e68-e852967414ee tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lazy-loading 'fault' on Instance uuid bd6231eb-95a4-465e-a859-077a7f82f585 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:29:53.322784 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-29b41ae2-e362-4b6e-8e68-e852967414ee tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1023300147f463e8f0894981948f825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac07f1b2c83a4faab175a5b9ed8e315e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:53.330990 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-29b41ae2-e362-4b6e-8e68-e852967414ee tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585" status: 200 len: 1307 microversion: 2.1 time: 0.107029 Oct 18 15:29:53.331578 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 647/1360] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:53 2022] GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585 => generated 1307 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:53.336600 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a9849485-4f8b-41b7-9f87-5d1d2b76d36a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:53.337418 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a9849485-4f8b-41b7-9f87-5d1d2b76d36a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 40097653-662f-4191-983d-881387af06a8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:53.343303 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9849485-4f8b-41b7-9f87-5d1d2b76d36a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:53.343523 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fccb1a74-708d-4d25-a876-f6637e00c8f6 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:53.343785 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9849485-4f8b-41b7-9f87-5d1d2b76d36a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:53.344224 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9849485-4f8b-41b7-9f87-5d1d2b76d36a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:53.344947 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9849485-4f8b-41b7-9f87-5d1d2b76d36a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:53.345478 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9849485-4f8b-41b7-9f87-5d1d2b76d36a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:53.345832 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9849485-4f8b-41b7-9f87-5d1d2b76d36a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:53.355912 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fccb1a74-708d-4d25-a876-f6637e00c8f6 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2" status: 200 len: 1717 microversion: 2.1 time: 0.193374 Oct 18 15:29:53.356720 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 714/1361] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:53 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2 => generated 1717 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:53.407317 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a9849485-4f8b-41b7-9f87-5d1d2b76d36a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:53.415431 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a9849485-4f8b-41b7-9f87-5d1d2b76d36a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8" status: 200 len: 1220 microversion: 2.1 time: 0.082870 Oct 18 15:29:53.415998 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 648/1362] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:53 2022] GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:53.493109 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-261d6a40-7ef4-41c6-bc6c-ff6d4a74af6c tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:53.493963 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-261d6a40-7ef4-41c6-bc6c-ff6d4a74af6c tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] [instance: 74e5ae75-9c35-4610-9cb5-61afa6f98581] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:53.499697 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-261d6a40-7ef4-41c6-bc6c-ff6d4a74af6c tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:53.500177 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-261d6a40-7ef4-41c6-bc6c-ff6d4a74af6c tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:53.500608 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-261d6a40-7ef4-41c6-bc6c-ff6d4a74af6c tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:53.501338 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-261d6a40-7ef4-41c6-bc6c-ff6d4a74af6c tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:53.501787 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-261d6a40-7ef4-41c6-bc6c-ff6d4a74af6c tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:53.502210 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-261d6a40-7ef4-41c6-bc6c-ff6d4a74af6c tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:53.562462 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-261d6a40-7ef4-41c6-bc6c-ff6d4a74af6c tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe80f2ae3ec4365a031ca7472d76e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df909cb429f46c39a83c29fb260b169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:53.570106 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-261d6a40-7ef4-41c6-bc6c-ff6d4a74af6c tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] 10.222.0.60 "GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581" status: 200 len: 1278 microversion: 2.1 time: 0.081082 Oct 18 15:29:53.570678 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 715/1363] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:53 2022] GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581 => generated 1278 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:53.615682 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ad3aae1c-8f86-4b1e-a5a0-f2c0efb7a715 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:53.616291 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ad3aae1c-8f86-4b1e-a5a0-f2c0efb7a715 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 4b959d9f-3c8e-44ef-92f1-83cfb8e04804] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:53.622321 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ad3aae1c-8f86-4b1e-a5a0-f2c0efb7a715 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:53.622807 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ad3aae1c-8f86-4b1e-a5a0-f2c0efb7a715 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:53.623274 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ad3aae1c-8f86-4b1e-a5a0-f2c0efb7a715 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:53.623962 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ad3aae1c-8f86-4b1e-a5a0-f2c0efb7a715 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:53.624417 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ad3aae1c-8f86-4b1e-a5a0-f2c0efb7a715 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:53.624868 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ad3aae1c-8f86-4b1e-a5a0-f2c0efb7a715 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:53.755790 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ad3aae1c-8f86-4b1e-a5a0-f2c0efb7a715 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:53.763489 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ad3aae1c-8f86-4b1e-a5a0-f2c0efb7a715 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804" status: 200 len: 1307 microversion: 2.1 time: 0.151940 Oct 18 15:29:53.764060 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 649/1364] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:53 2022] GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804 => generated 1307 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:54.095588 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6023944f-9a09-42c2-b2ae-1a7de932866f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:54.096221 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6023944f-9a09-42c2-b2ae-1a7de932866f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:54.103195 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6023944f-9a09-42c2-b2ae-1a7de932866f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:54.103677 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6023944f-9a09-42c2-b2ae-1a7de932866f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:54.104114 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6023944f-9a09-42c2-b2ae-1a7de932866f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:54.104867 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6023944f-9a09-42c2-b2ae-1a7de932866f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:54.105327 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6023944f-9a09-42c2-b2ae-1a7de932866f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:54.105752 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6023944f-9a09-42c2-b2ae-1a7de932866f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:54.171032 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6023944f-9a09-42c2-b2ae-1a7de932866f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:54.179382 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6023944f-9a09-42c2-b2ae-1a7de932866f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:54.181100 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6023944f-9a09-42c2-b2ae-1a7de932866f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:54.186705 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6023944f-9a09-42c2-b2ae-1a7de932866f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1539 microversion: 2.91 time: 0.095474 Oct 18 15:29:54.187464 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 716/1365] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:54 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1539 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:54.248961 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1a89122a-feb4-4d0d-80ef-0f05e9e02435 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:54.249582 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1a89122a-feb4-4d0d-80ef-0f05e9e02435 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:54.256728 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1a89122a-feb4-4d0d-80ef-0f05e9e02435 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:54.263894 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1a89122a-feb4-4d0d-80ef-0f05e9e02435 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:54.277152 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1a89122a-feb4-4d0d-80ef-0f05e9e02435 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:54.277152 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1a89122a-feb4-4d0d-80ef-0f05e9e02435 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:54.277152 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1a89122a-feb4-4d0d-80ef-0f05e9e02435 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:54.277152 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1a89122a-feb4-4d0d-80ef-0f05e9e02435 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:54.357784 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2265cc4b-4010-4b7a-82cc-bec38ebd1276 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:54.358192 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2265cc4b-4010-4b7a-82cc-bec38ebd1276 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: bd6231eb-95a4-465e-a859-077a7f82f585] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:54.371575 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2265cc4b-4010-4b7a-82cc-bec38ebd1276 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:54.374389 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2265cc4b-4010-4b7a-82cc-bec38ebd1276 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:54.375009 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2265cc4b-4010-4b7a-82cc-bec38ebd1276 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:54.375940 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2265cc4b-4010-4b7a-82cc-bec38ebd1276 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:54.379482 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2265cc4b-4010-4b7a-82cc-bec38ebd1276 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:54.380174 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2265cc4b-4010-4b7a-82cc-bec38ebd1276 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:54.458867 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2265cc4b-4010-4b7a-82cc-bec38ebd1276 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:54.459363 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2265cc4b-4010-4b7a-82cc-bec38ebd1276 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:54.460254 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2265cc4b-4010-4b7a-82cc-bec38ebd1276 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:54.460710 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-2265cc4b-4010-4b7a-82cc-bec38ebd1276 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lazy-loading 'fault' on Instance uuid bd6231eb-95a4-465e-a859-077a7f82f585 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:29:54.562589 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2265cc4b-4010-4b7a-82cc-bec38ebd1276 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1023300147f463e8f0894981948f825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac07f1b2c83a4faab175a5b9ed8e315e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:54.570907 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2265cc4b-4010-4b7a-82cc-bec38ebd1276 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585" status: 200 len: 1307 microversion: 2.1 time: 0.220217 Oct 18 15:29:54.585123 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 717/1366] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:54 2022] GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585 => generated 1307 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:54.585123 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dd4f01cd-a18f-4901-8613-670873909ef6 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:54.585123 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dd4f01cd-a18f-4901-8613-670873909ef6 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:54.585123 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd4f01cd-a18f-4901-8613-670873909ef6 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:54.585123 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd4f01cd-a18f-4901-8613-670873909ef6 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:54.585666 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd4f01cd-a18f-4901-8613-670873909ef6 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:54.585666 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd4f01cd-a18f-4901-8613-670873909ef6 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:54.585666 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd4f01cd-a18f-4901-8613-670873909ef6 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:54.585666 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd4f01cd-a18f-4901-8613-670873909ef6 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:54.615888 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1a89122a-feb4-4d0d-80ef-0f05e9e02435 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:54.632734 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1a89122a-feb4-4d0d-80ef-0f05e9e02435 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:54.637340 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1a89122a-feb4-4d0d-80ef-0f05e9e02435 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:54.637540 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1a89122a-feb4-4d0d-80ef-0f05e9e02435 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 1880 microversion: 2.42 time: 0.393040 Oct 18 15:29:54.655486 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 650/1367] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:54 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 1880 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:54.668150 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-431e7dbe-4f82-4ab3-847f-b006c537a985 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:54.668777 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-431e7dbe-4f82-4ab3-847f-b006c537a985 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 40097653-662f-4191-983d-881387af06a8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:54.675175 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-431e7dbe-4f82-4ab3-847f-b006c537a985 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:54.676234 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-431e7dbe-4f82-4ab3-847f-b006c537a985 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:54.676753 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-431e7dbe-4f82-4ab3-847f-b006c537a985 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:54.677503 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-431e7dbe-4f82-4ab3-847f-b006c537a985 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:54.677968 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-431e7dbe-4f82-4ab3-847f-b006c537a985 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:54.678440 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-431e7dbe-4f82-4ab3-847f-b006c537a985 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:54.784157 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-431e7dbe-4f82-4ab3-847f-b006c537a985 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:54.792868 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-431e7dbe-4f82-4ab3-847f-b006c537a985 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8" status: 200 len: 1212 microversion: 2.1 time: 0.134533 Oct 18 15:29:54.801970 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 651/1368] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:54 2022] GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8 => generated 1212 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:54.816518 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-983d4f59-ffcc-4387-89c1-e8029f360ef5 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:54.817194 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-983d4f59-ffcc-4387-89c1-e8029f360ef5 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] [instance: 74e5ae75-9c35-4610-9cb5-61afa6f98581] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:54.823085 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-983d4f59-ffcc-4387-89c1-e8029f360ef5 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:54.823574 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-983d4f59-ffcc-4387-89c1-e8029f360ef5 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:54.824011 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-983d4f59-ffcc-4387-89c1-e8029f360ef5 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:54.824709 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-983d4f59-ffcc-4387-89c1-e8029f360ef5 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:54.825218 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-983d4f59-ffcc-4387-89c1-e8029f360ef5 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:54.826318 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-983d4f59-ffcc-4387-89c1-e8029f360ef5 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:54.869956 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dd4f01cd-a18f-4901-8613-670873909ef6 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:54.879539 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dd4f01cd-a18f-4901-8613-670873909ef6 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2" status: 200 len: 1717 microversion: 2.1 time: 0.306996 Oct 18 15:29:54.894855 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 718/1369] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:54 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2 => generated 1717 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:54.894855 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7e4f5a74-08b7-4071-b610-450aa07344a0 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:54.894855 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7e4f5a74-08b7-4071-b610-450aa07344a0 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 4b959d9f-3c8e-44ef-92f1-83cfb8e04804] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:54.894855 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e4f5a74-08b7-4071-b610-450aa07344a0 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:54.894855 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e4f5a74-08b7-4071-b610-450aa07344a0 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:54.895388 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e4f5a74-08b7-4071-b610-450aa07344a0 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:54.895388 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e4f5a74-08b7-4071-b610-450aa07344a0 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:54.896603 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e4f5a74-08b7-4071-b610-450aa07344a0 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:54.897185 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e4f5a74-08b7-4071-b610-450aa07344a0 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:54.908268 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-983d4f59-ffcc-4387-89c1-e8029f360ef5 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe80f2ae3ec4365a031ca7472d76e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df909cb429f46c39a83c29fb260b169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:54.918676 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-983d4f59-ffcc-4387-89c1-e8029f360ef5 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] 10.222.0.60 "GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581" status: 200 len: 1276 microversion: 2.1 time: 0.108608 Oct 18 15:29:54.920393 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 652/1370] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:54 2022] GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581 => generated 1276 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:55.121818 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7e4f5a74-08b7-4071-b610-450aa07344a0 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:55.130376 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7e4f5a74-08b7-4071-b610-450aa07344a0 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804" status: 200 len: 1307 microversion: 2.1 time: 0.248782 Oct 18 15:29:55.130970 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 719/1371] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:54 2022] GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804 => generated 1307 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:55.217757 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-11159217-7007-4f7b-962f-f39e82adce95 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:55.218381 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-11159217-7007-4f7b-962f-f39e82adce95 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:55.225595 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-11159217-7007-4f7b-962f-f39e82adce95 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:55.226086 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-11159217-7007-4f7b-962f-f39e82adce95 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:55.226519 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-11159217-7007-4f7b-962f-f39e82adce95 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:55.227589 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-11159217-7007-4f7b-962f-f39e82adce95 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:55.228049 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-11159217-7007-4f7b-962f-f39e82adce95 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:55.228473 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-11159217-7007-4f7b-962f-f39e82adce95 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:55.387135 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-11159217-7007-4f7b-962f-f39e82adce95 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:55.400319 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-11159217-7007-4f7b-962f-f39e82adce95 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:55.402009 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-11159217-7007-4f7b-962f-f39e82adce95 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:55.410731 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-11159217-7007-4f7b-962f-f39e82adce95 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1539 microversion: 2.91 time: 0.197291 Oct 18 15:29:55.411993 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 653/1372] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:55 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1539 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:55.596411 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3b220552-ed95-417a-b6e7-59dcd2c5d320 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:55.597113 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3b220552-ed95-417a-b6e7-59dcd2c5d320 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: bd6231eb-95a4-465e-a859-077a7f82f585] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:55.604985 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b220552-ed95-417a-b6e7-59dcd2c5d320 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:55.605683 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b220552-ed95-417a-b6e7-59dcd2c5d320 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:55.606273 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b220552-ed95-417a-b6e7-59dcd2c5d320 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:55.607042 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b220552-ed95-417a-b6e7-59dcd2c5d320 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:55.607502 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b220552-ed95-417a-b6e7-59dcd2c5d320 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:55.607979 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b220552-ed95-417a-b6e7-59dcd2c5d320 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:55.656116 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a986291f-c1f7-4f8a-ab57-08978f0b83fa tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:55.656284 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a986291f-c1f7-4f8a-ab57-08978f0b83fa tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:55.663203 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a986291f-c1f7-4f8a-ab57-08978f0b83fa tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:55.663879 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a986291f-c1f7-4f8a-ab57-08978f0b83fa tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:55.664321 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a986291f-c1f7-4f8a-ab57-08978f0b83fa tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:55.665170 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a986291f-c1f7-4f8a-ab57-08978f0b83fa tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:55.665634 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a986291f-c1f7-4f8a-ab57-08978f0b83fa tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:55.666062 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a986291f-c1f7-4f8a-ab57-08978f0b83fa tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:55.671145 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b220552-ed95-417a-b6e7-59dcd2c5d320 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:55.671145 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b220552-ed95-417a-b6e7-59dcd2c5d320 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:55.671145 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b220552-ed95-417a-b6e7-59dcd2c5d320 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:55.671479 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-3b220552-ed95-417a-b6e7-59dcd2c5d320 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lazy-loading 'fault' on Instance uuid bd6231eb-95a4-465e-a859-077a7f82f585 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:29:55.750001 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3b220552-ed95-417a-b6e7-59dcd2c5d320 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1023300147f463e8f0894981948f825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac07f1b2c83a4faab175a5b9ed8e315e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:55.758065 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3b220552-ed95-417a-b6e7-59dcd2c5d320 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585" status: 200 len: 1307 microversion: 2.1 time: 0.166498 Oct 18 15:29:55.758967 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 720/1373] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:55 2022] GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585 => generated 1307 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:55.763521 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a1d42fa6-5346-46fb-bed6-ada4e1a754d5 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:55.764125 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a1d42fa6-5346-46fb-bed6-ada4e1a754d5 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:55.770888 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1d42fa6-5346-46fb-bed6-ada4e1a754d5 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:55.771363 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1d42fa6-5346-46fb-bed6-ada4e1a754d5 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:55.771797 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1d42fa6-5346-46fb-bed6-ada4e1a754d5 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:55.773104 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1d42fa6-5346-46fb-bed6-ada4e1a754d5 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:55.773563 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1d42fa6-5346-46fb-bed6-ada4e1a754d5 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:55.773990 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1d42fa6-5346-46fb-bed6-ada4e1a754d5 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:55.892304 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-a986291f-c1f7-4f8a-ab57-08978f0b83fa tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lazy-loading 'services' on Instance uuid cc806839-862f-4ea7-9078-c970f50b3793 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:29:55.907227 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a986291f-c1f7-4f8a-ab57-08978f0b83fa tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793" status: 200 len: 2420 microversion: 2.25 time: 0.255293 Oct 18 15:29:55.908209 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 654/1374] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:55 2022] GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793 => generated 2420 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:29:55.913458 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1fc4d79e-331e-45ad-a4b6-10b042f45d3c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:55.914147 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1fc4d79e-331e-45ad-a4b6-10b042f45d3c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 40097653-662f-4191-983d-881387af06a8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:55.920440 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1fc4d79e-331e-45ad-a4b6-10b042f45d3c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:55.920975 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1fc4d79e-331e-45ad-a4b6-10b042f45d3c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:55.921406 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1fc4d79e-331e-45ad-a4b6-10b042f45d3c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:55.922097 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1fc4d79e-331e-45ad-a4b6-10b042f45d3c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:55.922544 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1fc4d79e-331e-45ad-a4b6-10b042f45d3c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:55.922959 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1fc4d79e-331e-45ad-a4b6-10b042f45d3c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:56.008994 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1fc4d79e-331e-45ad-a4b6-10b042f45d3c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:56.020296 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1fc4d79e-331e-45ad-a4b6-10b042f45d3c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8" status: 200 len: 1212 microversion: 2.1 time: 0.110469 Oct 18 15:29:56.023704 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a1d42fa6-5346-46fb-bed6-ada4e1a754d5 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:56.025035 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 655/1375] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:55 2022] GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8 => generated 1212 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:56.030881 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7ef76704-6d27-4275-bd0a-1a0dc76247a0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:56.031835 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7ef76704-6d27-4275-bd0a-1a0dc76247a0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:56.034748 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a1d42fa6-5346-46fb-bed6-ada4e1a754d5 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:56.037074 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a1d42fa6-5346-46fb-bed6-ada4e1a754d5 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:56.038325 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a1d42fa6-5346-46fb-bed6-ada4e1a754d5 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 1880 microversion: 2.42 time: 0.278390 Oct 18 15:29:56.040551 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 721/1376] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:55 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 1880 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:56.042139 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7ef76704-6d27-4275-bd0a-1a0dc76247a0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:56.042139 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7ef76704-6d27-4275-bd0a-1a0dc76247a0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:56.042139 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7ef76704-6d27-4275-bd0a-1a0dc76247a0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:56.045882 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7ef76704-6d27-4275-bd0a-1a0dc76247a0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:56.045882 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7ef76704-6d27-4275-bd0a-1a0dc76247a0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:56.045882 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7ef76704-6d27-4275-bd0a-1a0dc76247a0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:56.046232 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-92801b2c-5489-4ed6-8236-ea14b566945d tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-853682-5", "block_migration": "auto"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:29:56.048923 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-92801b2c-5489-4ed6-8236-ea14b566945d tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:56.056725 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92801b2c-5489-4ed6-8236-ea14b566945d tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:56.057435 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92801b2c-5489-4ed6-8236-ea14b566945d tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:56.057966 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92801b2c-5489-4ed6-8236-ea14b566945d tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:56.058880 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92801b2c-5489-4ed6-8236-ea14b566945d tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:56.059456 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92801b2c-5489-4ed6-8236-ea14b566945d tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:56.059980 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92801b2c-5489-4ed6-8236-ea14b566945d tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:56.118780 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-92801b2c-5489-4ed6-8236-ea14b566945d tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lazy-loading 'flavor' on Instance uuid cc806839-862f-4ea7-9078-c970f50b3793 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:29:56.149334 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-92801b2c-5489-4ed6-8236-ea14b566945d tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Going to try to live migrate instance to n-h2-853682-5 {{(pid=120406) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 18 15:29:56.253239 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7ef76704-6d27-4275-bd0a-1a0dc76247a0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:56.273074 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7ef76704-6d27-4275-bd0a-1a0dc76247a0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2" status: 200 len: 1717 microversion: 2.1 time: 0.245826 Oct 18 15:29:56.274889 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 656/1377] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:56 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2 => generated 1717 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:56.280548 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f23ffe17-443f-4bdb-b9eb-6334ad26751c tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:56.281657 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f23ffe17-443f-4bdb-b9eb-6334ad26751c tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] [instance: 74e5ae75-9c35-4610-9cb5-61afa6f98581] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:56.290201 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f23ffe17-443f-4bdb-b9eb-6334ad26751c tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:56.290815 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f23ffe17-443f-4bdb-b9eb-6334ad26751c tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:56.291347 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f23ffe17-443f-4bdb-b9eb-6334ad26751c tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:56.292351 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f23ffe17-443f-4bdb-b9eb-6334ad26751c tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:56.292934 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f23ffe17-443f-4bdb-b9eb-6334ad26751c tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:56.294254 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f23ffe17-443f-4bdb-b9eb-6334ad26751c tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:56.489565 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f23ffe17-443f-4bdb-b9eb-6334ad26751c tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe80f2ae3ec4365a031ca7472d76e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df909cb429f46c39a83c29fb260b169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:56.500072 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f23ffe17-443f-4bdb-b9eb-6334ad26751c tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] 10.222.0.60 "GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581" status: 200 len: 1318 microversion: 2.1 time: 0.223796 Oct 18 15:29:56.501590 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 657/1378] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:56 2022] GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581 => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:56.506279 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-55c76233-438c-4406-a6e8-a6ac3c40ef1e tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:56.506964 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-55c76233-438c-4406-a6e8-a6ac3c40ef1e tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 4b959d9f-3c8e-44ef-92f1-83cfb8e04804] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:56.513646 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-55c76233-438c-4406-a6e8-a6ac3c40ef1e tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:56.514228 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-55c76233-438c-4406-a6e8-a6ac3c40ef1e tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:56.514836 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-55c76233-438c-4406-a6e8-a6ac3c40ef1e tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:56.516608 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-55c76233-438c-4406-a6e8-a6ac3c40ef1e tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:56.517184 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-55c76233-438c-4406-a6e8-a6ac3c40ef1e tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:56.517610 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-55c76233-438c-4406-a6e8-a6ac3c40ef1e tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:56.696513 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-55c76233-438c-4406-a6e8-a6ac3c40ef1e tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:56.705368 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-55c76233-438c-4406-a6e8-a6ac3c40ef1e tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804" status: 200 len: 1307 microversion: 2.1 time: 0.202342 Oct 18 15:29:56.721563 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 658/1379] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:56 2022] GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804 => generated 1307 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:56.728224 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6d507e0d-a797-4117-9c0b-2a08db3e62d4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:56.728971 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6d507e0d-a797-4117-9c0b-2a08db3e62d4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:56.735808 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6d507e0d-a797-4117-9c0b-2a08db3e62d4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:56.736663 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6d507e0d-a797-4117-9c0b-2a08db3e62d4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:56.736867 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6d507e0d-a797-4117-9c0b-2a08db3e62d4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:56.737487 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6d507e0d-a797-4117-9c0b-2a08db3e62d4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:56.737946 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6d507e0d-a797-4117-9c0b-2a08db3e62d4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:56.738467 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6d507e0d-a797-4117-9c0b-2a08db3e62d4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:56.820920 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6d507e0d-a797-4117-9c0b-2a08db3e62d4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:56.833756 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6d507e0d-a797-4117-9c0b-2a08db3e62d4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:56.835598 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6d507e0d-a797-4117-9c0b-2a08db3e62d4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:56.842897 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6d507e0d-a797-4117-9c0b-2a08db3e62d4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1539 microversion: 2.91 time: 0.119807 Oct 18 15:29:56.847278 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 659/1380] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:56 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1539 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:56.869875 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5ccc2a01-caba-4bdf-a42b-bdb7a63c0e43 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:56.870478 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5ccc2a01-caba-4bdf-a42b-bdb7a63c0e43 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: bd6231eb-95a4-465e-a859-077a7f82f585] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:56.876690 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5ccc2a01-caba-4bdf-a42b-bdb7a63c0e43 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:56.877607 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5ccc2a01-caba-4bdf-a42b-bdb7a63c0e43 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:56.877773 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5ccc2a01-caba-4bdf-a42b-bdb7a63c0e43 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:56.878483 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5ccc2a01-caba-4bdf-a42b-bdb7a63c0e43 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:56.879500 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5ccc2a01-caba-4bdf-a42b-bdb7a63c0e43 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:56.879904 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5ccc2a01-caba-4bdf-a42b-bdb7a63c0e43 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:56.896064 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-5ccc2a01-caba-4bdf-a42b-bdb7a63c0e43 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] HTTP exception thrown: Instance bd6231eb-95a4-465e-a859-077a7f82f585 could not be found. Oct 18 15:29:56.897890 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5ccc2a01-caba-4bdf-a42b-bdb7a63c0e43 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Request method failure captured: Oct 18 15:29:56.897890 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585 HTTP/1.1 Oct 18 15:29:56.897890 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:29:56.897890 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:29:56.897890 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:29:56.897890 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:29:56.897890 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:29:56.897890 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:29:56.897890 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:29:56.897890 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:29:56.897890 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsW0UV85WLlKZ364uAWmmy7letPaZ8FgqMvn-CkxvQolKVsKOuvxkXCTiJtOawDg6-GQw90qLXqscHh-OPCVr7rV900F4Bd5mqd8BnOf4ndiRrK8No2KRjIfxCRA4g6L6-UAkjoW4dw_P6pVx_yopePZek81tV9jY-AcWKwaj011DJI Oct 18 15:29:56.897890 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:29:56.897890 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:29:56.897890 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:29:56.897890 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:29:56.897890 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:29:56.897890 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:29:56.897890 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: ac07f1b2c83a4faab175a5b9ed8e315e Oct 18 15:29:56.897890 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-VolumesAdminNegativeTest-738536875 Oct 18 15:29:56.897890 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:29:56.897890 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:29:56.902284 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ac07f1b2c83a4faab175a5b9ed8e315e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ac07f1b2c83a4faab175a5b9ed8e315e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ac07f1b2c83a4faab175a5b9ed8e315e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ac07f1b2c83a4faab175a5b9ed8e315e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:29:56.902284 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-VolumesAdminNegativeTest-738536875 Oct 18 15:29:56.902284 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: ac07f1b2c83a4faab175a5b9ed8e315e Oct 18 15:29:56.902284 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-738536875 Oct 18 15:29:56.902284 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-VolumesAdminNegativeTest-738536875-project Oct 18 15:29:56.902284 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:29:56.902284 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:29:56.902284 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: a1023300147f463e8f0894981948f825 Oct 18 15:29:56.902284 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-VolumesAdminNegativeTest-738536875-project Oct 18 15:29:56.902284 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:29:56.902284 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance bd6231eb-95a4-465e-a859-077a7f82f585 could not be found. Oct 18 15:29:56.902284 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'bd6231eb-95a4-465e-a859-077a7f82f585'} Oct 18 15:29:56.906455 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:29:56.906455 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:29:56.906455 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:29:56.906455 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:29:56.906455 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:29:56.906455 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:29:56.906455 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:29:56.906455 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:29:56.906455 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:29:56.906455 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:29:56.906455 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd6231eb-95a4-465e-a859-077a7f82f585 could not be found. Oct 18 15:29:56.906455 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:29:56.906455 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:29:56.906455 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:29:56.906455 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:29:56.906455 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:29:56.906455 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:29:56.906455 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:29:56.906455 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:29:56.906455 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:29:56.910961 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:29:56.910961 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:29:56.910961 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:29:56.910961 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:29:56.910961 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:29:56.910961 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:29:56.910961 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:29:56.910961 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd6231eb-95a4-465e-a859-077a7f82f585 could not be found. Oct 18 15:29:56.910961 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:29:56.910961 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:29:56.910961 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:29:56.910961 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:29:56.910961 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:29:56.910961 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:29:56.910961 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:29:56.910961 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:29:56.910961 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd6231eb-95a4-465e-a859-077a7f82f585 could not be found. Oct 18 15:29:56.910961 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:29:56.914090 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5ccc2a01-caba-4bdf-a42b-bdb7a63c0e43 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Returning 404 to user: Instance bd6231eb-95a4-465e-a859-077a7f82f585 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:29:56.914090 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5ccc2a01-caba-4bdf-a42b-bdb7a63c0e43 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585" status: 404 len: 111 microversion: 2.1 time: 0.033653 Oct 18 15:29:56.914090 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 660/1381] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:56 2022] GET /compute/v2.1/servers/bd6231eb-95a4-465e-a859-077a7f82f585 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:29:56.914090 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-1c575b84-aded-4cd8-b05b-302b11dc975d req-541cfeb6-6f8f-4eb3-b17b-92aa0d7158b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74e5ae75-9c35-4610-9cb5-61afa6f98581", "tag": "da601fb9-7eac-4831-80d1-a76275a0d8ed"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:29:56.922527 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-1c575b84-aded-4cd8-b05b-302b11dc975d req-541cfeb6-6f8f-4eb3-b17b-92aa0d7158b4 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:56.923100 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-1c575b84-aded-4cd8-b05b-302b11dc975d req-541cfeb6-6f8f-4eb3-b17b-92aa0d7158b4 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:56.923608 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-1c575b84-aded-4cd8-b05b-302b11dc975d req-541cfeb6-6f8f-4eb3-b17b-92aa0d7158b4 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:56.937140 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-1c575b84-aded-4cd8-b05b-302b11dc975d req-541cfeb6-6f8f-4eb3-b17b-92aa0d7158b4 service nova] Creating event network-changed:da601fb9-7eac-4831-80d1-a76275a0d8ed for instance 74e5ae75-9c35-4610-9cb5-61afa6f98581 on n-h1-853682-5 Oct 18 15:29:56.946306 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-1c575b84-aded-4cd8-b05b-302b11dc975d req-541cfeb6-6f8f-4eb3-b17b-92aa0d7158b4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039783 Oct 18 15:29:56.948511 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 661/1382] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:29:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:29:57.047513 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2d9e544b-cbd2-4a50-812f-223bbff63724 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:57.048734 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2d9e544b-cbd2-4a50-812f-223bbff63724 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 40097653-662f-4191-983d-881387af06a8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:57.070037 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d9e544b-cbd2-4a50-812f-223bbff63724 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:57.070990 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d9e544b-cbd2-4a50-812f-223bbff63724 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:57.071620 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d9e544b-cbd2-4a50-812f-223bbff63724 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:57.072520 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d9e544b-cbd2-4a50-812f-223bbff63724 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:57.073231 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d9e544b-cbd2-4a50-812f-223bbff63724 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:57.073661 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d9e544b-cbd2-4a50-812f-223bbff63724 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:57.079448 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=100 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:29:57.167640 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2d9e544b-cbd2-4a50-812f-223bbff63724 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:57.176041 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2d9e544b-cbd2-4a50-812f-223bbff63724 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8" status: 200 len: 1268 microversion: 2.1 time: 0.136040 Oct 18 15:29:57.176981 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 662/1383] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:57 2022] GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8 => generated 1268 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:29:57.182005 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8a00277c-d460-428d-b6e1-49e62a65d085 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:57.182838 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8a00277c-d460-428d-b6e1-49e62a65d085 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:57.189891 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8a00277c-d460-428d-b6e1-49e62a65d085 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:57.190682 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8a00277c-d460-428d-b6e1-49e62a65d085 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:57.191988 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8a00277c-d460-428d-b6e1-49e62a65d085 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:57.192975 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8a00277c-d460-428d-b6e1-49e62a65d085 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:57.193654 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8a00277c-d460-428d-b6e1-49e62a65d085 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:57.194450 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8a00277c-d460-428d-b6e1-49e62a65d085 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:57.393797 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8a00277c-d460-428d-b6e1-49e62a65d085 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:57.404717 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8a00277c-d460-428d-b6e1-49e62a65d085 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:57.406246 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8a00277c-d460-428d-b6e1-49e62a65d085 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:57.407450 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8a00277c-d460-428d-b6e1-49e62a65d085 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 1880 microversion: 2.42 time: 0.229355 Oct 18 15:29:57.408014 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 663/1384] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:57 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 1880 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:57.413676 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-9bb05a90-ba36-440c-b316-0fcd2e0a8fa3 req-bc4d14c3-4dd4-423b-838d-ccdd883fbe77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23bdadc4-6faa-4e55-8daf-eef04dd34a8a", "name": "network-vif-plugged", "status": "completed", "tag": "6ea5a9f2-9734-4014-8e33-f46906bf9bfb"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:29:57.424778 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-9bb05a90-ba36-440c-b316-0fcd2e0a8fa3 req-bc4d14c3-4dd4-423b-838d-ccdd883fbe77 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:57.425560 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-9bb05a90-ba36-440c-b316-0fcd2e0a8fa3 req-bc4d14c3-4dd4-423b-838d-ccdd883fbe77 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:57.425994 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-9bb05a90-ba36-440c-b316-0fcd2e0a8fa3 req-bc4d14c3-4dd4-423b-838d-ccdd883fbe77 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:57.438362 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-9bb05a90-ba36-440c-b316-0fcd2e0a8fa3 req-bc4d14c3-4dd4-423b-838d-ccdd883fbe77 service nova] Creating event network-vif-plugged:6ea5a9f2-9734-4014-8e33-f46906bf9bfb for instance 23bdadc4-6faa-4e55-8daf-eef04dd34a8a on n-h2-853682-5 Oct 18 15:29:57.443748 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-9bb05a90-ba36-440c-b316-0fcd2e0a8fa3 req-bc4d14c3-4dd4-423b-838d-ccdd883fbe77 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034093 Oct 18 15:29:57.444428 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 664/1385] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:29:57.450018 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5c5b60e7-99b8-4abd-afc1-6e48e30c0357 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:57.450546 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5c5b60e7-99b8-4abd-afc1-6e48e30c0357 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:57.458075 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5c5b60e7-99b8-4abd-afc1-6e48e30c0357 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:57.458568 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5c5b60e7-99b8-4abd-afc1-6e48e30c0357 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:57.459372 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5c5b60e7-99b8-4abd-afc1-6e48e30c0357 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:57.459960 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5c5b60e7-99b8-4abd-afc1-6e48e30c0357 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:57.460604 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5c5b60e7-99b8-4abd-afc1-6e48e30c0357 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:57.461067 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5c5b60e7-99b8-4abd-afc1-6e48e30c0357 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:57.597043 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5c5b60e7-99b8-4abd-afc1-6e48e30c0357 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:57.619936 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5c5b60e7-99b8-4abd-afc1-6e48e30c0357 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2" status: 200 len: 1717 microversion: 2.1 time: 0.174037 Oct 18 15:29:57.620522 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 665/1386] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:57 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2 => generated 1717 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:57.625096 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-84e1438d-5d28-4fbc-bd57-cc4dcbd907e7 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:57.625946 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-84e1438d-5d28-4fbc-bd57-cc4dcbd907e7 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] [instance: 74e5ae75-9c35-4610-9cb5-61afa6f98581] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:57.632533 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-84e1438d-5d28-4fbc-bd57-cc4dcbd907e7 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:57.633673 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-84e1438d-5d28-4fbc-bd57-cc4dcbd907e7 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:57.634261 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-84e1438d-5d28-4fbc-bd57-cc4dcbd907e7 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:57.635120 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-84e1438d-5d28-4fbc-bd57-cc4dcbd907e7 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:57.635736 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-84e1438d-5d28-4fbc-bd57-cc4dcbd907e7 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:57.636306 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-84e1438d-5d28-4fbc-bd57-cc4dcbd907e7 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:57.785686 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-84e1438d-5d28-4fbc-bd57-cc4dcbd907e7 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe80f2ae3ec4365a031ca7472d76e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df909cb429f46c39a83c29fb260b169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:57.794012 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-84e1438d-5d28-4fbc-bd57-cc4dcbd907e7 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] 10.222.0.60 "GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581" status: 200 len: 1318 microversion: 2.1 time: 0.172290 Oct 18 15:29:57.794580 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 666/1387] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:57 2022] GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:57.799766 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4407bd90-4d5c-451d-9313-7dc49ab50741 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:57.801332 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4407bd90-4d5c-451d-9313-7dc49ab50741 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 4b959d9f-3c8e-44ef-92f1-83cfb8e04804] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:57.808114 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4407bd90-4d5c-451d-9313-7dc49ab50741 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:57.808602 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4407bd90-4d5c-451d-9313-7dc49ab50741 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:57.809290 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4407bd90-4d5c-451d-9313-7dc49ab50741 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:57.810323 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4407bd90-4d5c-451d-9313-7dc49ab50741 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:57.810933 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4407bd90-4d5c-451d-9313-7dc49ab50741 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:57.812014 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4407bd90-4d5c-451d-9313-7dc49ab50741 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:57.955461 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4407bd90-4d5c-451d-9313-7dc49ab50741 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:57.969949 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4407bd90-4d5c-451d-9313-7dc49ab50741 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804" status: 200 len: 1307 microversion: 2.1 time: 0.173796 Oct 18 15:29:57.970885 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 667/1388] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:57 2022] GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804 => generated 1307 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:57.979268 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e88b8f4d-6aab-44c1-8acd-a34ec2447f73 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:57.980345 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e88b8f4d-6aab-44c1-8acd-a34ec2447f73 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:57.989853 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e88b8f4d-6aab-44c1-8acd-a34ec2447f73 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:57.990669 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e88b8f4d-6aab-44c1-8acd-a34ec2447f73 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:57.991415 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e88b8f4d-6aab-44c1-8acd-a34ec2447f73 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:57.992605 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e88b8f4d-6aab-44c1-8acd-a34ec2447f73 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:57.993422 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e88b8f4d-6aab-44c1-8acd-a34ec2447f73 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:57.994164 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e88b8f4d-6aab-44c1-8acd-a34ec2447f73 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:58.089487 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e88b8f4d-6aab-44c1-8acd-a34ec2447f73 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:58.099113 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e88b8f4d-6aab-44c1-8acd-a34ec2447f73 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:58.100836 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e88b8f4d-6aab-44c1-8acd-a34ec2447f73 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:58.105959 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e88b8f4d-6aab-44c1-8acd-a34ec2447f73 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1539 microversion: 2.91 time: 0.133750 Oct 18 15:29:58.106622 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 668/1389] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:57 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1539 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:58.200314 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fa391c4d-d0a2-4dfb-81cf-77d558d74df3 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:58.200843 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-fa391c4d-d0a2-4dfb-81cf-77d558d74df3 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 40097653-662f-4191-983d-881387af06a8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:58.207363 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fa391c4d-d0a2-4dfb-81cf-77d558d74df3 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:58.207841 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fa391c4d-d0a2-4dfb-81cf-77d558d74df3 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:58.208271 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fa391c4d-d0a2-4dfb-81cf-77d558d74df3 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:58.208979 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fa391c4d-d0a2-4dfb-81cf-77d558d74df3 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:58.209434 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fa391c4d-d0a2-4dfb-81cf-77d558d74df3 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:58.210108 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fa391c4d-d0a2-4dfb-81cf-77d558d74df3 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:58.270651 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-fa391c4d-d0a2-4dfb-81cf-77d558d74df3 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:58.278380 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fa391c4d-d0a2-4dfb-81cf-77d558d74df3 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8" status: 200 len: 1276 microversion: 2.1 time: 0.082057 Oct 18 15:29:58.278955 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 669/1390] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:58 2022] GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8 => generated 1276 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:29:58.433278 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-891a3cf4-a10b-4d2f-b4eb-d67487c853e5 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:58.433889 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-891a3cf4-a10b-4d2f-b4eb-d67487c853e5 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:58.441504 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-891a3cf4-a10b-4d2f-b4eb-d67487c853e5 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:58.442023 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-891a3cf4-a10b-4d2f-b4eb-d67487c853e5 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:58.442490 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-891a3cf4-a10b-4d2f-b4eb-d67487c853e5 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:58.443218 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-891a3cf4-a10b-4d2f-b4eb-d67487c853e5 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:58.443674 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-891a3cf4-a10b-4d2f-b4eb-d67487c853e5 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:58.444119 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-891a3cf4-a10b-4d2f-b4eb-d67487c853e5 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:58.630385 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-891a3cf4-a10b-4d2f-b4eb-d67487c853e5 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:58.639920 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-891a3cf4-a10b-4d2f-b4eb-d67487c853e5 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:58.641377 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-891a3cf4-a10b-4d2f-b4eb-d67487c853e5 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:58.642515 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-891a3cf4-a10b-4d2f-b4eb-d67487c853e5 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 1880 microversion: 2.42 time: 0.213205 Oct 18 15:29:58.643072 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 670/1391] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:58 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 1880 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:29:58.647374 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-26f03fa6-5227-4498-a8cd-5c944356ec3b tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:58.647970 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-26f03fa6-5227-4498-a8cd-5c944356ec3b tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:58.653833 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26f03fa6-5227-4498-a8cd-5c944356ec3b tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:58.654334 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26f03fa6-5227-4498-a8cd-5c944356ec3b tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:58.654977 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26f03fa6-5227-4498-a8cd-5c944356ec3b tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:58.655661 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26f03fa6-5227-4498-a8cd-5c944356ec3b tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:58.656109 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26f03fa6-5227-4498-a8cd-5c944356ec3b tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:58.656527 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26f03fa6-5227-4498-a8cd-5c944356ec3b tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:58.792161 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-26f03fa6-5227-4498-a8cd-5c944356ec3b tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:58.800937 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-26f03fa6-5227-4498-a8cd-5c944356ec3b tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2" status: 200 len: 1717 microversion: 2.1 time: 0.156389 Oct 18 15:29:58.801511 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 671/1392] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:58 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2 => generated 1717 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:29:58.817353 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5493d660-4f54-43eb-9f4d-68d60d7ab4f6 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:58.817890 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5493d660-4f54-43eb-9f4d-68d60d7ab4f6 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] [instance: 74e5ae75-9c35-4610-9cb5-61afa6f98581] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:58.823747 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5493d660-4f54-43eb-9f4d-68d60d7ab4f6 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:58.824234 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5493d660-4f54-43eb-9f4d-68d60d7ab4f6 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:58.824685 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5493d660-4f54-43eb-9f4d-68d60d7ab4f6 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:58.825394 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5493d660-4f54-43eb-9f4d-68d60d7ab4f6 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:58.825844 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5493d660-4f54-43eb-9f4d-68d60d7ab4f6 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:58.826261 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5493d660-4f54-43eb-9f4d-68d60d7ab4f6 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:58.960545 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5493d660-4f54-43eb-9f4d-68d60d7ab4f6 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe80f2ae3ec4365a031ca7472d76e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df909cb429f46c39a83c29fb260b169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:58.968358 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5493d660-4f54-43eb-9f4d-68d60d7ab4f6 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] 10.222.0.60 "GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581" status: 200 len: 1318 microversion: 2.1 time: 0.155337 Oct 18 15:29:58.968943 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 672/1393] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:58 2022] GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:29:58.993447 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-57998560-a11d-4e14-b43e-80d6487e9ff2 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:58.994089 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-57998560-a11d-4e14-b43e-80d6487e9ff2 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 4b959d9f-3c8e-44ef-92f1-83cfb8e04804] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:58.999978 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57998560-a11d-4e14-b43e-80d6487e9ff2 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:59.000464 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57998560-a11d-4e14-b43e-80d6487e9ff2 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:59.000927 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57998560-a11d-4e14-b43e-80d6487e9ff2 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:59.001621 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57998560-a11d-4e14-b43e-80d6487e9ff2 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:59.002080 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57998560-a11d-4e14-b43e-80d6487e9ff2 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:59.002509 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57998560-a11d-4e14-b43e-80d6487e9ff2 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:59.139169 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-57998560-a11d-4e14-b43e-80d6487e9ff2 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:59.147128 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-57998560-a11d-4e14-b43e-80d6487e9ff2 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804" status: 200 len: 1307 microversion: 2.1 time: 0.157270 Oct 18 15:29:59.161085 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 673/1394] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:58 2022] GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804 => generated 1307 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:29:59.161085 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6f18c518-7a03-48a7-8b64-63d63175c625 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:59.161085 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6f18c518-7a03-48a7-8b64-63d63175c625 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:59.161085 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6f18c518-7a03-48a7-8b64-63d63175c625 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:59.161939 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6f18c518-7a03-48a7-8b64-63d63175c625 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:59.161939 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6f18c518-7a03-48a7-8b64-63d63175c625 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:59.161939 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6f18c518-7a03-48a7-8b64-63d63175c625 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:59.162238 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6f18c518-7a03-48a7-8b64-63d63175c625 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:59.162442 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6f18c518-7a03-48a7-8b64-63d63175c625 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:59.233000 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6f18c518-7a03-48a7-8b64-63d63175c625 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:59.241753 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6f18c518-7a03-48a7-8b64-63d63175c625 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:59.243268 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6f18c518-7a03-48a7-8b64-63d63175c625 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:59.248165 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6f18c518-7a03-48a7-8b64-63d63175c625 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1539 microversion: 2.91 time: 0.099524 Oct 18 15:29:59.248829 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 674/1395] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:59 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1539 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:59.306875 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-933c1c5c-e245-42d7-be4f-b0e3d465de26 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:59.307487 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-933c1c5c-e245-42d7-be4f-b0e3d465de26 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 40097653-662f-4191-983d-881387af06a8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:59.313426 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-933c1c5c-e245-42d7-be4f-b0e3d465de26 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:59.313912 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-933c1c5c-e245-42d7-be4f-b0e3d465de26 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:59.314348 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-933c1c5c-e245-42d7-be4f-b0e3d465de26 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:59.315035 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-933c1c5c-e245-42d7-be4f-b0e3d465de26 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:59.315489 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-933c1c5c-e245-42d7-be4f-b0e3d465de26 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:59.316146 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-933c1c5c-e245-42d7-be4f-b0e3d465de26 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:59.377882 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-933c1c5c-e245-42d7-be4f-b0e3d465de26 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:59.385594 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-933c1c5c-e245-42d7-be4f-b0e3d465de26 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8" status: 200 len: 1276 microversion: 2.1 time: 0.082772 Oct 18 15:29:59.386171 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 675/1396] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:59 2022] GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8 => generated 1276 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:29:59.459281 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-8d5fb5b5-93a9-438b-a5ac-e799513118b6 req-087183ce-e00a-4918-af84-c1a2d35eaee3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23bdadc4-6faa-4e55-8daf-eef04dd34a8a", "name": "network-vif-plugged", "status": "completed", "tag": "65d90ee5-e161-439c-956f-7f6040e4c2c0"}, {"server_uuid": "23bdadc4-6faa-4e55-8daf-eef04dd34a8a", "name": "network-vif-plugged", "status": "completed", "tag": "338571d6-62fa-444c-a91e-c4a1fb9c42c5"}, {"server_uuid": "23bdadc4-6faa-4e55-8daf-eef04dd34a8a", "name": "network-vif-plugged", "status": "completed", "tag": "31a34f24-b614-446a-bba2-e9ae313005fa"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:29:59.470416 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-8d5fb5b5-93a9-438b-a5ac-e799513118b6 req-087183ce-e00a-4918-af84-c1a2d35eaee3 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:59.470990 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-8d5fb5b5-93a9-438b-a5ac-e799513118b6 req-087183ce-e00a-4918-af84-c1a2d35eaee3 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:59.471484 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-8d5fb5b5-93a9-438b-a5ac-e799513118b6 req-087183ce-e00a-4918-af84-c1a2d35eaee3 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:59.483748 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-8d5fb5b5-93a9-438b-a5ac-e799513118b6 req-087183ce-e00a-4918-af84-c1a2d35eaee3 service nova] Creating event network-vif-plugged:65d90ee5-e161-439c-956f-7f6040e4c2c0 for instance 23bdadc4-6faa-4e55-8daf-eef04dd34a8a on n-h2-853682-5 Oct 18 15:29:59.484252 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-8d5fb5b5-93a9-438b-a5ac-e799513118b6 req-087183ce-e00a-4918-af84-c1a2d35eaee3 service nova] Creating event network-vif-plugged:338571d6-62fa-444c-a91e-c4a1fb9c42c5 for instance 23bdadc4-6faa-4e55-8daf-eef04dd34a8a on n-h2-853682-5 Oct 18 15:29:59.484751 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-8d5fb5b5-93a9-438b-a5ac-e799513118b6 req-087183ce-e00a-4918-af84-c1a2d35eaee3 service nova] Creating event network-vif-plugged:31a34f24-b614-446a-bba2-e9ae313005fa for instance 23bdadc4-6faa-4e55-8daf-eef04dd34a8a on n-h2-853682-5 Oct 18 15:29:59.490151 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-8d5fb5b5-93a9-438b-a5ac-e799513118b6 req-087183ce-e00a-4918-af84-c1a2d35eaee3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.035111 Oct 18 15:29:59.490748 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 676/1397] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:29:59 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:29:59.670291 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e74d3e2a-6304-4f6a-8f6b-54344e64cf0e tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:59.670993 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e74d3e2a-6304-4f6a-8f6b-54344e64cf0e tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:59.677482 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e74d3e2a-6304-4f6a-8f6b-54344e64cf0e tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:59.677971 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e74d3e2a-6304-4f6a-8f6b-54344e64cf0e tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:59.678407 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e74d3e2a-6304-4f6a-8f6b-54344e64cf0e tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:59.679104 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e74d3e2a-6304-4f6a-8f6b-54344e64cf0e tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:59.679568 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e74d3e2a-6304-4f6a-8f6b-54344e64cf0e tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:59.679994 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e74d3e2a-6304-4f6a-8f6b-54344e64cf0e tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:59.878099 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e74d3e2a-6304-4f6a-8f6b-54344e64cf0e tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:59.888997 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e74d3e2a-6304-4f6a-8f6b-54344e64cf0e tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:59.890642 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e74d3e2a-6304-4f6a-8f6b-54344e64cf0e tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:29:59.891810 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e74d3e2a-6304-4f6a-8f6b-54344e64cf0e tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 1880 microversion: 2.42 time: 0.225860 Oct 18 15:29:59.892371 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 677/1398] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:29:59 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 1880 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:29:59.898195 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ec168fc1-2a2a-46a4-b40e-7c5da4237755 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:29:59.898803 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ec168fc1-2a2a-46a4-b40e-7c5da4237755 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:29:59.905165 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ec168fc1-2a2a-46a4-b40e-7c5da4237755 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:59.905663 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ec168fc1-2a2a-46a4-b40e-7c5da4237755 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:59.906159 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ec168fc1-2a2a-46a4-b40e-7c5da4237755 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:29:59.906860 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ec168fc1-2a2a-46a4-b40e-7c5da4237755 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:29:59.907343 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ec168fc1-2a2a-46a4-b40e-7c5da4237755 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:29:59.907770 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ec168fc1-2a2a-46a4-b40e-7c5da4237755 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:00.063657 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ec168fc1-2a2a-46a4-b40e-7c5da4237755 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:00.076792 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ec168fc1-2a2a-46a4-b40e-7c5da4237755 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2" status: 200 len: 1717 microversion: 2.1 time: 0.183202 Oct 18 15:30:00.089694 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 678/1399] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:29:59 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2 => generated 1717 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:00.098765 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-adc15980-44f5-4f5f-b137-1105efea339f tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:00.099841 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-adc15980-44f5-4f5f-b137-1105efea339f tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] [instance: 74e5ae75-9c35-4610-9cb5-61afa6f98581] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:00.121196 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-adc15980-44f5-4f5f-b137-1105efea339f tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:00.122268 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-adc15980-44f5-4f5f-b137-1105efea339f tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:00.122837 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-adc15980-44f5-4f5f-b137-1105efea339f tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:00.123816 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-adc15980-44f5-4f5f-b137-1105efea339f tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:00.124385 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-adc15980-44f5-4f5f-b137-1105efea339f tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:00.124970 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-adc15980-44f5-4f5f-b137-1105efea339f tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:00.307176 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-adc15980-44f5-4f5f-b137-1105efea339f tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe80f2ae3ec4365a031ca7472d76e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df909cb429f46c39a83c29fb260b169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:00.314926 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-adc15980-44f5-4f5f-b137-1105efea339f tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] 10.222.0.60 "GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581" status: 200 len: 1318 microversion: 2.1 time: 0.223969 Oct 18 15:30:00.320997 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 679/1400] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:00 2022] GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581 => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:00.321756 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0a79009d-e80e-4d0f-99db-2834c93b89fb tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:00.322360 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0a79009d-e80e-4d0f-99db-2834c93b89fb tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 4b959d9f-3c8e-44ef-92f1-83cfb8e04804] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:00.336922 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0a79009d-e80e-4d0f-99db-2834c93b89fb tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:00.337486 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0a79009d-e80e-4d0f-99db-2834c93b89fb tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:00.337951 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0a79009d-e80e-4d0f-99db-2834c93b89fb tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:00.338720 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0a79009d-e80e-4d0f-99db-2834c93b89fb tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:00.339097 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0a79009d-e80e-4d0f-99db-2834c93b89fb tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:00.339515 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0a79009d-e80e-4d0f-99db-2834c93b89fb tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:00.344910 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=100 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:30:00.481611 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0a79009d-e80e-4d0f-99db-2834c93b89fb tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:00.490857 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0a79009d-e80e-4d0f-99db-2834c93b89fb tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804" status: 200 len: 1307 microversion: 2.1 time: 0.174216 Oct 18 15:30:00.505343 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 680/1401] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:00 2022] GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804 => generated 1307 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:00.512493 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-dca10a61-e87d-4750-9743-1ca6c15d4ba5 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:00.513029 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-dca10a61-e87d-4750-9743-1ca6c15d4ba5 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: 21ed44b3-c1df-4099-a1ca-a8b167fc3890] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:00.520109 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dca10a61-e87d-4750-9743-1ca6c15d4ba5 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:00.520596 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dca10a61-e87d-4750-9743-1ca6c15d4ba5 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:00.521061 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dca10a61-e87d-4750-9743-1ca6c15d4ba5 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:00.521765 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dca10a61-e87d-4750-9743-1ca6c15d4ba5 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:00.522215 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dca10a61-e87d-4750-9743-1ca6c15d4ba5 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:00.522721 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dca10a61-e87d-4750-9743-1ca6c15d4ba5 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:00.550225 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-dca10a61-e87d-4750-9743-1ca6c15d4ba5 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: 21ed44b3-c1df-4099-a1ca-a8b167fc3890] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:30:00.635728 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-dca10a61-e87d-4750-9743-1ca6c15d4ba5 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "DELETE /compute/v2.1/servers/21ed44b3-c1df-4099-a1ca-a8b167fc3890" status: 204 len: 0 microversion: 2.1 time: 0.128892 Oct 18 15:30:00.639131 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 681/1402] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:30:00 2022] DELETE /compute/v2.1/servers/21ed44b3-c1df-4099-a1ca-a8b167fc3890 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:30:00.642846 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f0622aee-c7c8-4eca-9f5d-bd5eb35c8bb2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:00.643932 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f0622aee-c7c8-4eca-9f5d-bd5eb35c8bb2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:00.650583 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f0622aee-c7c8-4eca-9f5d-bd5eb35c8bb2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:00.651150 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f0622aee-c7c8-4eca-9f5d-bd5eb35c8bb2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:00.651683 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f0622aee-c7c8-4eca-9f5d-bd5eb35c8bb2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:00.652621 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f0622aee-c7c8-4eca-9f5d-bd5eb35c8bb2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:00.653324 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f0622aee-c7c8-4eca-9f5d-bd5eb35c8bb2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:00.654132 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f0622aee-c7c8-4eca-9f5d-bd5eb35c8bb2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:00.728829 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f0622aee-c7c8-4eca-9f5d-bd5eb35c8bb2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:00.737972 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f0622aee-c7c8-4eca-9f5d-bd5eb35c8bb2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:00.740318 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f0622aee-c7c8-4eca-9f5d-bd5eb35c8bb2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:00.746012 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f0622aee-c7c8-4eca-9f5d-bd5eb35c8bb2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1539 microversion: 2.91 time: 0.107887 Oct 18 15:30:00.747575 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 682/1403] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:00 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1539 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:30:00.753150 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8c906031-3937-40a8-b1ba-c3c8cd4e3b77 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:00.754347 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8c906031-3937-40a8-b1ba-c3c8cd4e3b77 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 40097653-662f-4191-983d-881387af06a8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:00.761462 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c906031-3937-40a8-b1ba-c3c8cd4e3b77 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:00.762184 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c906031-3937-40a8-b1ba-c3c8cd4e3b77 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:00.762678 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c906031-3937-40a8-b1ba-c3c8cd4e3b77 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:00.763425 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c906031-3937-40a8-b1ba-c3c8cd4e3b77 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:00.763999 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c906031-3937-40a8-b1ba-c3c8cd4e3b77 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:00.764469 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c906031-3937-40a8-b1ba-c3c8cd4e3b77 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:00.830453 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8c906031-3937-40a8-b1ba-c3c8cd4e3b77 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:00.840226 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8c906031-3937-40a8-b1ba-c3c8cd4e3b77 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8" status: 200 len: 1274 microversion: 2.1 time: 0.091837 Oct 18 15:30:00.841144 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 683/1404] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:00 2022] GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8 => generated 1274 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:00.846712 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-75ba06d4-2489-4521-ad85-c272e711ca0c tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:00.847811 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-75ba06d4-2489-4521-ad85-c272e711ca0c tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: 21ed44b3-c1df-4099-a1ca-a8b167fc3890] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:00.853998 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-75ba06d4-2489-4521-ad85-c272e711ca0c tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:00.854484 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-75ba06d4-2489-4521-ad85-c272e711ca0c tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:00.854922 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-75ba06d4-2489-4521-ad85-c272e711ca0c tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:00.855622 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-75ba06d4-2489-4521-ad85-c272e711ca0c tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:00.856079 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-75ba06d4-2489-4521-ad85-c272e711ca0c tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:00.856506 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-75ba06d4-2489-4521-ad85-c272e711ca0c tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:01.004254 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-75ba06d4-2489-4521-ad85-c272e711ca0c tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1023300147f463e8f0894981948f825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac07f1b2c83a4faab175a5b9ed8e315e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:01.013422 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-75ba06d4-2489-4521-ad85-c272e711ca0c tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/21ed44b3-c1df-4099-a1ca-a8b167fc3890" status: 200 len: 1682 microversion: 2.1 time: 0.170152 Oct 18 15:30:01.017537 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 684/1405] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:00 2022] GET /compute/v2.1/servers/21ed44b3-c1df-4099-a1ca-a8b167fc3890 => generated 1682 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:01.021145 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-236b5e28-d4d1-4f9a-914a-056a7d85a5a9 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:01.022542 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-236b5e28-d4d1-4f9a-914a-056a7d85a5a9 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:01.028756 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-236b5e28-d4d1-4f9a-914a-056a7d85a5a9 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:01.029408 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-236b5e28-d4d1-4f9a-914a-056a7d85a5a9 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:01.029991 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-236b5e28-d4d1-4f9a-914a-056a7d85a5a9 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:01.030701 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-236b5e28-d4d1-4f9a-914a-056a7d85a5a9 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:01.031154 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-236b5e28-d4d1-4f9a-914a-056a7d85a5a9 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:01.031617 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-236b5e28-d4d1-4f9a-914a-056a7d85a5a9 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:01.236761 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-236b5e28-d4d1-4f9a-914a-056a7d85a5a9 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:01.246213 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-236b5e28-d4d1-4f9a-914a-056a7d85a5a9 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:01.247667 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-236b5e28-d4d1-4f9a-914a-056a7d85a5a9 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:01.248843 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-236b5e28-d4d1-4f9a-914a-056a7d85a5a9 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 1880 microversion: 2.42 time: 0.232812 Oct 18 15:30:01.249419 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 685/1406] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:01 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 1880 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:30:01.254787 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f84d14d0-f492-4222-9241-03878647979a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:01.255406 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f84d14d0-f492-4222-9241-03878647979a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:01.262344 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f84d14d0-f492-4222-9241-03878647979a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:01.262344 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f84d14d0-f492-4222-9241-03878647979a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:01.262713 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f84d14d0-f492-4222-9241-03878647979a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:01.263725 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f84d14d0-f492-4222-9241-03878647979a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:01.264245 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f84d14d0-f492-4222-9241-03878647979a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:01.264712 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f84d14d0-f492-4222-9241-03878647979a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:01.328794 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-92801b2c-5489-4ed6-8236-ea14b566945d tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793/action" status: 202 len: 0 microversion: 2.25 time: 5.287947 Oct 18 15:30:01.334108 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 722/1407] 10.222.0.60 () {62 vars in 1319 bytes} [Tue Oct 18 15:29:56 2022] POST /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793/action => generated 0 bytes in 5293 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:30:01.339626 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c23db30b-aa1b-4b1c-8187-b2ee17a5addd tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:01.340252 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c23db30b-aa1b-4b1c-8187-b2ee17a5addd tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:01.364516 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c23db30b-aa1b-4b1c-8187-b2ee17a5addd tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:01.365041 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c23db30b-aa1b-4b1c-8187-b2ee17a5addd tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:01.369473 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c23db30b-aa1b-4b1c-8187-b2ee17a5addd tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:01.370455 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c23db30b-aa1b-4b1c-8187-b2ee17a5addd tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:01.371215 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c23db30b-aa1b-4b1c-8187-b2ee17a5addd tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:01.371811 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c23db30b-aa1b-4b1c-8187-b2ee17a5addd tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:01.831631 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f84d14d0-f492-4222-9241-03878647979a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:01.840676 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f84d14d0-f492-4222-9241-03878647979a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2" status: 200 len: 1717 microversion: 2.1 time: 0.589742 Oct 18 15:30:01.841241 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 686/1408] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:01 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2 => generated 1717 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:01.851368 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c23db30b-aa1b-4b1c-8187-b2ee17a5addd tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:01.856710 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6a099fb4-8348-45d5-a0f0-ffc0ae81b359 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:01.859434 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6a099fb4-8348-45d5-a0f0-ffc0ae81b359 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] [instance: 74e5ae75-9c35-4610-9cb5-61afa6f98581] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:01.865994 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c23db30b-aa1b-4b1c-8187-b2ee17a5addd tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:01.866181 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6a099fb4-8348-45d5-a0f0-ffc0ae81b359 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:01.866676 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6a099fb4-8348-45d5-a0f0-ffc0ae81b359 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:01.866918 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6a099fb4-8348-45d5-a0f0-ffc0ae81b359 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:01.867610 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6a099fb4-8348-45d5-a0f0-ffc0ae81b359 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:01.868016 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c23db30b-aa1b-4b1c-8187-b2ee17a5addd tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:01.868150 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6a099fb4-8348-45d5-a0f0-ffc0ae81b359 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:01.868469 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6a099fb4-8348-45d5-a0f0-ffc0ae81b359 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:01.869952 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c23db30b-aa1b-4b1c-8187-b2ee17a5addd tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793" status: 200 len: 1812 microversion: 2.25 time: 0.534468 Oct 18 15:30:01.871690 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 723/1409] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:01 2022] GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793 => generated 1812 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:30:01.878414 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c812eb10-54fc-4d37-8e1c-6e2c53a79eca tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:01.879560 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c812eb10-54fc-4d37-8e1c-6e2c53a79eca tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 4b959d9f-3c8e-44ef-92f1-83cfb8e04804] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:01.890642 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c812eb10-54fc-4d37-8e1c-6e2c53a79eca tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:01.891322 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c812eb10-54fc-4d37-8e1c-6e2c53a79eca tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:01.892475 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c812eb10-54fc-4d37-8e1c-6e2c53a79eca tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:01.893484 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c812eb10-54fc-4d37-8e1c-6e2c53a79eca tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:01.894082 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c812eb10-54fc-4d37-8e1c-6e2c53a79eca tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:01.894952 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c812eb10-54fc-4d37-8e1c-6e2c53a79eca tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:02.071025 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6a099fb4-8348-45d5-a0f0-ffc0ae81b359 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe80f2ae3ec4365a031ca7472d76e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df909cb429f46c39a83c29fb260b169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:02.079202 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6a099fb4-8348-45d5-a0f0-ffc0ae81b359 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] 10.222.0.60 "GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581" status: 200 len: 1318 microversion: 2.1 time: 0.237215 Oct 18 15:30:02.088893 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 687/1410] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:01 2022] GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581 => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:02.089113 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c812eb10-54fc-4d37-8e1c-6e2c53a79eca tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:02.089223 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-64549bea-1fe7-47fb-8d83-a8782ec5fe07 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:02.089223 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-64549bea-1fe7-47fb-8d83-a8782ec5fe07 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:02.091966 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c812eb10-54fc-4d37-8e1c-6e2c53a79eca tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804" status: 200 len: 1307 microversion: 2.1 time: 0.218653 Oct 18 15:30:02.093010 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 724/1411] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:01 2022] GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804 => generated 1307 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:02.093295 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-64549bea-1fe7-47fb-8d83-a8782ec5fe07 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:02.094134 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-64549bea-1fe7-47fb-8d83-a8782ec5fe07 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:02.094799 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-64549bea-1fe7-47fb-8d83-a8782ec5fe07 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:02.095594 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-64549bea-1fe7-47fb-8d83-a8782ec5fe07 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:02.096240 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-64549bea-1fe7-47fb-8d83-a8782ec5fe07 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:02.096751 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-64549bea-1fe7-47fb-8d83-a8782ec5fe07 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:02.099053 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4b69642b-d0c0-4d05-8134-73cf3f0e5074 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:02.099750 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4b69642b-d0c0-4d05-8134-73cf3f0e5074 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 40097653-662f-4191-983d-881387af06a8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:02.106579 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b69642b-d0c0-4d05-8134-73cf3f0e5074 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:02.107917 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b69642b-d0c0-4d05-8134-73cf3f0e5074 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:02.108360 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b69642b-d0c0-4d05-8134-73cf3f0e5074 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:02.109119 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b69642b-d0c0-4d05-8134-73cf3f0e5074 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:02.109558 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b69642b-d0c0-4d05-8134-73cf3f0e5074 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:02.110710 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b69642b-d0c0-4d05-8134-73cf3f0e5074 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:02.179802 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-64549bea-1fe7-47fb-8d83-a8782ec5fe07 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:02.188172 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-64549bea-1fe7-47fb-8d83-a8782ec5fe07 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:02.189703 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-64549bea-1fe7-47fb-8d83-a8782ec5fe07 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:02.192593 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:30:02.196512 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-64549bea-1fe7-47fb-8d83-a8782ec5fe07 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1539 microversion: 2.91 time: 0.115654 Oct 18 15:30:02.207026 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 688/1412] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:02 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1539 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:30:02.207026 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-504204e5-58ef-4462-88b4-3e8fc621e971 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:02.207026 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-504204e5-58ef-4462-88b4-3e8fc621e971 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: 21ed44b3-c1df-4099-a1ca-a8b167fc3890] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:02.216147 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-504204e5-58ef-4462-88b4-3e8fc621e971 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:02.216147 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-504204e5-58ef-4462-88b4-3e8fc621e971 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:02.216147 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-504204e5-58ef-4462-88b4-3e8fc621e971 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:02.216147 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-504204e5-58ef-4462-88b4-3e8fc621e971 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:02.216651 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-504204e5-58ef-4462-88b4-3e8fc621e971 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:02.216651 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-504204e5-58ef-4462-88b4-3e8fc621e971 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:02.318315 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4b69642b-d0c0-4d05-8134-73cf3f0e5074 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:02.333510 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4b69642b-d0c0-4d05-8134-73cf3f0e5074 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8" status: 200 len: 1316 microversion: 2.1 time: 0.239192 Oct 18 15:30:02.352911 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 725/1413] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:02 2022] GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8 => generated 1316 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:02.358402 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9cf3b727-186a-43cb-908b-d5c913364674 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:02.359019 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9cf3b727-186a-43cb-908b-d5c913364674 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:02.366112 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:30:02.368292 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9cf3b727-186a-43cb-908b-d5c913364674 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:02.368979 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9cf3b727-186a-43cb-908b-d5c913364674 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:02.369652 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9cf3b727-186a-43cb-908b-d5c913364674 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:02.370778 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9cf3b727-186a-43cb-908b-d5c913364674 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:02.371408 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9cf3b727-186a-43cb-908b-d5c913364674 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:02.372332 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9cf3b727-186a-43cb-908b-d5c913364674 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:02.396731 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-504204e5-58ef-4462-88b4-3e8fc621e971 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1023300147f463e8f0894981948f825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac07f1b2c83a4faab175a5b9ed8e315e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:02.407766 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-504204e5-58ef-4462-88b4-3e8fc621e971 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/21ed44b3-c1df-4099-a1ca-a8b167fc3890" status: 200 len: 1682 microversion: 2.1 time: 0.208969 Oct 18 15:30:02.421432 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 689/1414] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:02 2022] GET /compute/v2.1/servers/21ed44b3-c1df-4099-a1ca-a8b167fc3890 => generated 1682 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:02.582992 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9cf3b727-186a-43cb-908b-d5c913364674 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:02.592443 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9cf3b727-186a-43cb-908b-d5c913364674 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:02.593915 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9cf3b727-186a-43cb-908b-d5c913364674 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:02.595071 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9cf3b727-186a-43cb-908b-d5c913364674 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 1880 microversion: 2.42 time: 0.241031 Oct 18 15:30:02.595633 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 726/1415] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:02 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 1880 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:30:02.863782 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-dd9a0efb-91f2-480c-86fb-3048cf2b9ae1 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:02.864402 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-dd9a0efb-91f2-480c-86fb-3048cf2b9ae1 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:02.873329 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dd9a0efb-91f2-480c-86fb-3048cf2b9ae1 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:02.873825 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dd9a0efb-91f2-480c-86fb-3048cf2b9ae1 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:02.874914 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dd9a0efb-91f2-480c-86fb-3048cf2b9ae1 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:02.875636 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dd9a0efb-91f2-480c-86fb-3048cf2b9ae1 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:02.876210 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dd9a0efb-91f2-480c-86fb-3048cf2b9ae1 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:02.876637 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dd9a0efb-91f2-480c-86fb-3048cf2b9ae1 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:02.903825 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-21f1cb36-a178-4c2c-9ea5-13456cf4b399 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:02.904695 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-21f1cb36-a178-4c2c-9ea5-13456cf4b399 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:02.911934 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21f1cb36-a178-4c2c-9ea5-13456cf4b399 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:02.912774 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21f1cb36-a178-4c2c-9ea5-13456cf4b399 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:02.913492 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21f1cb36-a178-4c2c-9ea5-13456cf4b399 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:02.914296 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21f1cb36-a178-4c2c-9ea5-13456cf4b399 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:02.914966 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21f1cb36-a178-4c2c-9ea5-13456cf4b399 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:02.915529 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21f1cb36-a178-4c2c-9ea5-13456cf4b399 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:03.228936 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-dd9a0efb-91f2-480c-86fb-3048cf2b9ae1 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:03.239771 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-dd9a0efb-91f2-480c-86fb-3048cf2b9ae1 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2" status: 200 len: 1717 microversion: 2.1 time: 0.379849 Oct 18 15:30:03.240359 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 690/1416] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:02 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2 => generated 1717 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:03.259945 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-47bb37a1-db47-4ea5-8b57-20cf03754deb tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:03.260723 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-47bb37a1-db47-4ea5-8b57-20cf03754deb tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] [instance: 74e5ae75-9c35-4610-9cb5-61afa6f98581] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:03.267025 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-47bb37a1-db47-4ea5-8b57-20cf03754deb tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:03.267508 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-47bb37a1-db47-4ea5-8b57-20cf03754deb tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:03.268066 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-47bb37a1-db47-4ea5-8b57-20cf03754deb tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:03.268760 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-47bb37a1-db47-4ea5-8b57-20cf03754deb tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:03.269237 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-47bb37a1-db47-4ea5-8b57-20cf03754deb tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:03.270068 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-47bb37a1-db47-4ea5-8b57-20cf03754deb tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:03.281164 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-21f1cb36-a178-4c2c-9ea5-13456cf4b399 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:03.298975 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-21f1cb36-a178-4c2c-9ea5-13456cf4b399 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:03.307094 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-21f1cb36-a178-4c2c-9ea5-13456cf4b399 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:03.312504 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-21f1cb36-a178-4c2c-9ea5-13456cf4b399 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793" status: 200 len: 1812 microversion: 2.25 time: 0.417131 Oct 18 15:30:03.317839 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 727/1417] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:02 2022] GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793 => generated 1812 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:30:03.325672 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d70bdcbb-e755-41dc-a4ee-4a21c79ed482 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:03.331091 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d70bdcbb-e755-41dc-a4ee-4a21c79ed482 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 4b959d9f-3c8e-44ef-92f1-83cfb8e04804] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:03.349048 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d70bdcbb-e755-41dc-a4ee-4a21c79ed482 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:03.350569 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d70bdcbb-e755-41dc-a4ee-4a21c79ed482 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:03.351449 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d70bdcbb-e755-41dc-a4ee-4a21c79ed482 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:03.352240 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d70bdcbb-e755-41dc-a4ee-4a21c79ed482 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:03.354590 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d70bdcbb-e755-41dc-a4ee-4a21c79ed482 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:03.355034 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d70bdcbb-e755-41dc-a4ee-4a21c79ed482 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:03.395944 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:30:03.617253 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-47bb37a1-db47-4ea5-8b57-20cf03754deb tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe80f2ae3ec4365a031ca7472d76e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df909cb429f46c39a83c29fb260b169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:03.635144 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-47bb37a1-db47-4ea5-8b57-20cf03754deb tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] 10.222.0.60 "GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581" status: 200 len: 1318 microversion: 2.1 time: 0.377830 Oct 18 15:30:03.636533 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 691/1418] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:03 2022] GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581 => generated 1318 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:03.643045 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-dae8a95e-e003-4ec3-bcff-885e22267798 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:03.643841 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-dae8a95e-e003-4ec3-bcff-885e22267798 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:03.651560 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dae8a95e-e003-4ec3-bcff-885e22267798 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:03.652323 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dae8a95e-e003-4ec3-bcff-885e22267798 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:03.653138 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dae8a95e-e003-4ec3-bcff-885e22267798 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:03.654711 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dae8a95e-e003-4ec3-bcff-885e22267798 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:03.656253 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dae8a95e-e003-4ec3-bcff-885e22267798 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:03.656887 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dae8a95e-e003-4ec3-bcff-885e22267798 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:03.717985 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d70bdcbb-e755-41dc-a4ee-4a21c79ed482 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:03.726110 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d70bdcbb-e755-41dc-a4ee-4a21c79ed482 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804" status: 200 len: 1307 microversion: 2.1 time: 0.406073 Oct 18 15:30:03.726819 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 728/1419] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:03 2022] GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804 => generated 1307 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:03.744767 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-21cf3be8-9d54-46f8-a3de-895f22204b5d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:03.746006 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-21cf3be8-9d54-46f8-a3de-895f22204b5d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 40097653-662f-4191-983d-881387af06a8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:03.748717 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-dae8a95e-e003-4ec3-bcff-885e22267798 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:03.761797 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21cf3be8-9d54-46f8-a3de-895f22204b5d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:03.762212 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21cf3be8-9d54-46f8-a3de-895f22204b5d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:03.762402 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-dae8a95e-e003-4ec3-bcff-885e22267798 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:03.762937 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21cf3be8-9d54-46f8-a3de-895f22204b5d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:03.763997 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21cf3be8-9d54-46f8-a3de-895f22204b5d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:03.764728 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21cf3be8-9d54-46f8-a3de-895f22204b5d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:03.765420 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21cf3be8-9d54-46f8-a3de-895f22204b5d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:03.766271 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-dae8a95e-e003-4ec3-bcff-885e22267798 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:03.776085 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-dae8a95e-e003-4ec3-bcff-885e22267798 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1539 microversion: 2.91 time: 0.138254 Oct 18 15:30:03.777231 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 692/1420] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:03 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1539 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:30:03.788083 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b44c358f-96bf-41f6-ad5b-c0ccee3adcae tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:03.789129 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b44c358f-96bf-41f6-ad5b-c0ccee3adcae tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: 21ed44b3-c1df-4099-a1ca-a8b167fc3890] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:03.798351 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b44c358f-96bf-41f6-ad5b-c0ccee3adcae tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:03.799234 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b44c358f-96bf-41f6-ad5b-c0ccee3adcae tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:03.799747 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b44c358f-96bf-41f6-ad5b-c0ccee3adcae tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:03.800710 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b44c358f-96bf-41f6-ad5b-c0ccee3adcae tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:03.801358 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b44c358f-96bf-41f6-ad5b-c0ccee3adcae tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:03.801922 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b44c358f-96bf-41f6-ad5b-c0ccee3adcae tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:03.896858 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b44c358f-96bf-41f6-ad5b-c0ccee3adcae tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1023300147f463e8f0894981948f825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac07f1b2c83a4faab175a5b9ed8e315e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:03.905832 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b44c358f-96bf-41f6-ad5b-c0ccee3adcae tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/21ed44b3-c1df-4099-a1ca-a8b167fc3890" status: 200 len: 1614 microversion: 2.1 time: 0.123763 Oct 18 15:30:03.906641 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 693/1421] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:03 2022] GET /compute/v2.1/servers/21ed44b3-c1df-4099-a1ca-a8b167fc3890 => generated 1614 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:03.914240 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fb9f114a-6b9a-45cf-8c13-cae0754843a7 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:03.914889 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-fb9f114a-6b9a-45cf-8c13-cae0754843a7 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:03.920960 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fb9f114a-6b9a-45cf-8c13-cae0754843a7 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:03.921521 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fb9f114a-6b9a-45cf-8c13-cae0754843a7 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:03.922188 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fb9f114a-6b9a-45cf-8c13-cae0754843a7 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:03.923108 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fb9f114a-6b9a-45cf-8c13-cae0754843a7 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:03.923744 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fb9f114a-6b9a-45cf-8c13-cae0754843a7 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:03.924152 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fb9f114a-6b9a-45cf-8c13-cae0754843a7 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:04.125922 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-21cf3be8-9d54-46f8-a3de-895f22204b5d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:04.134611 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-21cf3be8-9d54-46f8-a3de-895f22204b5d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8" status: 200 len: 1316 microversion: 2.1 time: 0.400129 Oct 18 15:30:04.135196 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 729/1422] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:03 2022] GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8 => generated 1316 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:04.231944 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-fb9f114a-6b9a-45cf-8c13-cae0754843a7 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:04.243492 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-fb9f114a-6b9a-45cf-8c13-cae0754843a7 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:04.245661 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-fb9f114a-6b9a-45cf-8c13-cae0754843a7 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:04.264591 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fb9f114a-6b9a-45cf-8c13-cae0754843a7 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 2836 microversion: 2.42 time: 0.353729 Oct 18 15:30:04.265834 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 694/1423] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:03 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 2836 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:30:04.270681 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-338a3409-e857-4125-8730-3a6aa20d9c6e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:04.272260 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-338a3409-e857-4125-8730-3a6aa20d9c6e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:04.279846 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-338a3409-e857-4125-8730-3a6aa20d9c6e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:04.280588 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-338a3409-e857-4125-8730-3a6aa20d9c6e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:04.281412 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-338a3409-e857-4125-8730-3a6aa20d9c6e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:04.282444 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-338a3409-e857-4125-8730-3a6aa20d9c6e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:04.283400 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-338a3409-e857-4125-8730-3a6aa20d9c6e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:04.284245 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-338a3409-e857-4125-8730-3a6aa20d9c6e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:04.313333 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:30:04.332629 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-582d72a4-1ede-4127-a8f3-eb19527e80c8 req-d84cfcd3-47dd-495e-b63a-1f42b6094c45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21ed44b3-c1df-4099-a1ca-a8b167fc3890", "name": "network-vif-deleted", "tag": "aa57d87b-6f22-4cfc-9682-ac41b5b434a1"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:30:04.351461 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-582d72a4-1ede-4127-a8f3-eb19527e80c8 req-d84cfcd3-47dd-495e-b63a-1f42b6094c45 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:04.353133 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-582d72a4-1ede-4127-a8f3-eb19527e80c8 req-d84cfcd3-47dd-495e-b63a-1f42b6094c45 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:04.353851 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-582d72a4-1ede-4127-a8f3-eb19527e80c8 req-d84cfcd3-47dd-495e-b63a-1f42b6094c45 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:04.370554 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-582d72a4-1ede-4127-a8f3-eb19527e80c8 req-d84cfcd3-47dd-495e-b63a-1f42b6094c45 service nova] Creating event network-vif-deleted:aa57d87b-6f22-4cfc-9682-ac41b5b434a1 for instance 21ed44b3-c1df-4099-a1ca-a8b167fc3890 on n-h2-853682-5 Oct 18 15:30:04.376864 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-582d72a4-1ede-4127-a8f3-eb19527e80c8 req-d84cfcd3-47dd-495e-b63a-1f42b6094c45 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143163 Oct 18 15:30:04.378229 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 730/1424] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:30:04.385898 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d7483107-e70a-441a-b29e-f5a8107d4e82 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:04.387357 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d7483107-e70a-441a-b29e-f5a8107d4e82 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:04.394957 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d7483107-e70a-441a-b29e-f5a8107d4e82 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:04.395729 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d7483107-e70a-441a-b29e-f5a8107d4e82 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:04.396180 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d7483107-e70a-441a-b29e-f5a8107d4e82 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:04.396971 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d7483107-e70a-441a-b29e-f5a8107d4e82 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:04.397700 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d7483107-e70a-441a-b29e-f5a8107d4e82 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:04.398211 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d7483107-e70a-441a-b29e-f5a8107d4e82 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:04.459906 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-338a3409-e857-4125-8730-3a6aa20d9c6e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:04.468655 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-338a3409-e857-4125-8730-3a6aa20d9c6e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2" status: 200 len: 1707 microversion: 2.1 time: 0.201586 Oct 18 15:30:04.476902 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 695/1425] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:04 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2 => generated 1707 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:04.476902 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e4e55cb3-5983-4c0d-ad5c-8c3d78260889 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:04.477429 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e4e55cb3-5983-4c0d-ad5c-8c3d78260889 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:04.495895 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4e55cb3-5983-4c0d-ad5c-8c3d78260889 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:04.496424 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4e55cb3-5983-4c0d-ad5c-8c3d78260889 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:04.497440 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4e55cb3-5983-4c0d-ad5c-8c3d78260889 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:04.498610 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4e55cb3-5983-4c0d-ad5c-8c3d78260889 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:04.498747 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4e55cb3-5983-4c0d-ad5c-8c3d78260889 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:04.499111 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4e55cb3-5983-4c0d-ad5c-8c3d78260889 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:04.586622 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d7483107-e70a-441a-b29e-f5a8107d4e82 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.200151 Oct 18 15:30:04.588783 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 731/1426] 10.222.0.60 () {60 vars in 1316 bytes} [Tue Oct 18 15:30:04 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a/os-interface => generated 1830 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:30:04.599619 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2c210fdc-0e15-475d-8461-6ef2d8ecd41b tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Calling method '.version_select at 0x7f7c3d9b0af0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:04.610105 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c210fdc-0e15-475d-8461-6ef2d8ecd41b tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:04.610550 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c210fdc-0e15-475d-8461-6ef2d8ecd41b tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:04.615292 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c210fdc-0e15-475d-8461-6ef2d8ecd41b tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:04.640668 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2c210fdc-0e15-475d-8461-6ef2d8ecd41b tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] 10.222.0.60 "GET /compute/v2.1/os-migrations" status: 200 len: 2315 microversion: 2.1 time: 0.050369 Oct 18 15:30:04.641345 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 732/1427] 10.222.0.60 () {58 vars in 1143 bytes} [Tue Oct 18 15:30:04 2022] GET /compute/v2.1/os-migrations => generated 2315 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:04.657551 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-06356238-12bb-485a-933f-da8a85c04d7f tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:04.658180 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-06356238-12bb-485a-933f-da8a85c04d7f tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:04.667975 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06356238-12bb-485a-933f-da8a85c04d7f tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:04.668498 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06356238-12bb-485a-933f-da8a85c04d7f tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:04.671891 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06356238-12bb-485a-933f-da8a85c04d7f tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:04.673545 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06356238-12bb-485a-933f-da8a85c04d7f tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:04.676080 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06356238-12bb-485a-933f-da8a85c04d7f tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:04.676738 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06356238-12bb-485a-933f-da8a85c04d7f tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:04.766994 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e4e55cb3-5983-4c0d-ad5c-8c3d78260889 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:04.778011 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e4e55cb3-5983-4c0d-ad5c-8c3d78260889 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:04.779785 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e4e55cb3-5983-4c0d-ad5c-8c3d78260889 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:04.781100 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e4e55cb3-5983-4c0d-ad5c-8c3d78260889 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793" status: 200 len: 1812 microversion: 2.25 time: 0.310237 Oct 18 15:30:04.792833 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 696/1428] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:04 2022] GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793 => generated 1812 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:30:04.823385 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-07f22701-1ad1-4aef-8301-a29cf607c508 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:04.824068 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-07f22701-1ad1-4aef-8301-a29cf607c508 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] [instance: 74e5ae75-9c35-4610-9cb5-61afa6f98581] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:04.832170 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-07f22701-1ad1-4aef-8301-a29cf607c508 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:04.832664 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-07f22701-1ad1-4aef-8301-a29cf607c508 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:04.834885 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-07f22701-1ad1-4aef-8301-a29cf607c508 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:04.837973 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-07f22701-1ad1-4aef-8301-a29cf607c508 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:04.838561 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-07f22701-1ad1-4aef-8301-a29cf607c508 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:04.839003 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-07f22701-1ad1-4aef-8301-a29cf607c508 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:04.912444 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-06356238-12bb-485a-933f-da8a85c04d7f tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2" status: 200 len: 1858 microversion: 2.1 time: 0.257110 Oct 18 15:30:04.914659 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 733/1429] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:04 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2 => generated 1858 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:05.049599 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-77762ac9-6040-4207-a1b1-96b94e83274b tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:05.051309 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-77762ac9-6040-4207-a1b1-96b94e83274b tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 4b959d9f-3c8e-44ef-92f1-83cfb8e04804] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:05.065511 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77762ac9-6040-4207-a1b1-96b94e83274b tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:05.071832 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77762ac9-6040-4207-a1b1-96b94e83274b tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:05.072546 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77762ac9-6040-4207-a1b1-96b94e83274b tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:05.073482 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77762ac9-6040-4207-a1b1-96b94e83274b tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:05.075022 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77762ac9-6040-4207-a1b1-96b94e83274b tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:05.075657 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77762ac9-6040-4207-a1b1-96b94e83274b tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:05.084847 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-07f22701-1ad1-4aef-8301-a29cf607c508 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe80f2ae3ec4365a031ca7472d76e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df909cb429f46c39a83c29fb260b169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:05.096853 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-07f22701-1ad1-4aef-8301-a29cf607c508 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] 10.222.0.60 "GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581" status: 200 len: 1318 microversion: 2.1 time: 0.313562 Oct 18 15:30:05.109573 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 697/1430] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:04 2022] GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581 => generated 1318 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:05.109573 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-12fc1420-2383-46c9-a102-638330193bb4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:05.109573 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-12fc1420-2383-46c9-a102-638330193bb4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:05.116117 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12fc1420-2383-46c9-a102-638330193bb4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:05.116693 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12fc1420-2383-46c9-a102-638330193bb4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:05.117256 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12fc1420-2383-46c9-a102-638330193bb4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:05.118066 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12fc1420-2383-46c9-a102-638330193bb4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:05.118620 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12fc1420-2383-46c9-a102-638330193bb4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:05.119139 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12fc1420-2383-46c9-a102-638330193bb4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:05.248093 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-12fc1420-2383-46c9-a102-638330193bb4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:05.258832 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-12fc1420-2383-46c9-a102-638330193bb4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:05.261530 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-12fc1420-2383-46c9-a102-638330193bb4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:05.274929 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-12fc1420-2383-46c9-a102-638330193bb4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1539 microversion: 2.91 time: 0.172601 Oct 18 15:30:05.276133 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 698/1431] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:05 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1539 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:30:05.281253 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-97d3db85-6ac3-4fbf-a3d3-48f2e0816749 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:05.282712 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-97d3db85-6ac3-4fbf-a3d3-48f2e0816749 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: 21ed44b3-c1df-4099-a1ca-a8b167fc3890] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:05.290842 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-77762ac9-6040-4207-a1b1-96b94e83274b tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:05.302032 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-77762ac9-6040-4207-a1b1-96b94e83274b tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804" status: 200 len: 1307 microversion: 2.1 time: 0.383495 Oct 18 15:30:05.302652 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 734/1432] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:04 2022] GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804 => generated 1307 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:05.304465 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97d3db85-6ac3-4fbf-a3d3-48f2e0816749 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:05.305192 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97d3db85-6ac3-4fbf-a3d3-48f2e0816749 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:05.305834 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97d3db85-6ac3-4fbf-a3d3-48f2e0816749 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:05.306706 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97d3db85-6ac3-4fbf-a3d3-48f2e0816749 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:05.307327 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97d3db85-6ac3-4fbf-a3d3-48f2e0816749 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:05.307911 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97d3db85-6ac3-4fbf-a3d3-48f2e0816749 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:05.318983 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-142205ce-1eaf-49f4-8f2e-ae9e893c2716 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:05.320038 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-142205ce-1eaf-49f4-8f2e-ae9e893c2716 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:05.335383 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-142205ce-1eaf-49f4-8f2e-ae9e893c2716 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:05.336473 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-142205ce-1eaf-49f4-8f2e-ae9e893c2716 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:05.340504 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-142205ce-1eaf-49f4-8f2e-ae9e893c2716 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:05.341764 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-142205ce-1eaf-49f4-8f2e-ae9e893c2716 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:05.342441 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-142205ce-1eaf-49f4-8f2e-ae9e893c2716 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:05.343999 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-142205ce-1eaf-49f4-8f2e-ae9e893c2716 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:05.371670 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97d3db85-6ac3-4fbf-a3d3-48f2e0816749 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:05.372151 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97d3db85-6ac3-4fbf-a3d3-48f2e0816749 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:05.372584 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97d3db85-6ac3-4fbf-a3d3-48f2e0816749 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:05.374913 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-97d3db85-6ac3-4fbf-a3d3-48f2e0816749 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lazy-loading 'fault' on Instance uuid 21ed44b3-c1df-4099-a1ca-a8b167fc3890 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:30:05.452466 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-97d3db85-6ac3-4fbf-a3d3-48f2e0816749 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1023300147f463e8f0894981948f825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac07f1b2c83a4faab175a5b9ed8e315e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:05.467145 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-97d3db85-6ac3-4fbf-a3d3-48f2e0816749 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/21ed44b3-c1df-4099-a1ca-a8b167fc3890" status: 200 len: 1331 microversion: 2.1 time: 0.189685 Oct 18 15:30:05.470796 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 699/1433] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:05 2022] GET /compute/v2.1/servers/21ed44b3-c1df-4099-a1ca-a8b167fc3890 => generated 1331 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:05.486373 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-05b1912e-5b31-4d50-ae4b-0583e4eae0c8 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:05.487193 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-05b1912e-5b31-4d50-ae4b-0583e4eae0c8 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 40097653-662f-4191-983d-881387af06a8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:05.497387 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-05b1912e-5b31-4d50-ae4b-0583e4eae0c8 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:05.498259 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-05b1912e-5b31-4d50-ae4b-0583e4eae0c8 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:05.498942 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-05b1912e-5b31-4d50-ae4b-0583e4eae0c8 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:05.499877 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-05b1912e-5b31-4d50-ae4b-0583e4eae0c8 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:05.500723 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-05b1912e-5b31-4d50-ae4b-0583e4eae0c8 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:05.501299 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-05b1912e-5b31-4d50-ae4b-0583e4eae0c8 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:05.566661 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-142205ce-1eaf-49f4-8f2e-ae9e893c2716 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2" status: 200 len: 1858 microversion: 2.1 time: 0.258465 Oct 18 15:30:05.569103 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 735/1434] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:05 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2 => generated 1858 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:05.709324 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-05b1912e-5b31-4d50-ae4b-0583e4eae0c8 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:05.720014 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-05b1912e-5b31-4d50-ae4b-0583e4eae0c8 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8" status: 200 len: 1316 microversion: 2.1 time: 0.246123 Oct 18 15:30:05.721078 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 700/1435] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:05 2022] GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8 => generated 1316 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:05.743035 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-73566179-9846-4c15-8bf5-ba92c5a8e48a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:05.743762 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-73566179-9846-4c15-8bf5-ba92c5a8e48a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:05.751053 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73566179-9846-4c15-8bf5-ba92c5a8e48a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:05.751717 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73566179-9846-4c15-8bf5-ba92c5a8e48a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:05.752340 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73566179-9846-4c15-8bf5-ba92c5a8e48a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:05.753273 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73566179-9846-4c15-8bf5-ba92c5a8e48a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:05.753892 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73566179-9846-4c15-8bf5-ba92c5a8e48a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:05.754474 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73566179-9846-4c15-8bf5-ba92c5a8e48a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:05.813033 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-80cd966d-5afd-4cd7-a543-b2a68360fa1c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:05.813954 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-80cd966d-5afd-4cd7-a543-b2a68360fa1c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:05.826660 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-80cd966d-5afd-4cd7-a543-b2a68360fa1c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:05.827414 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-80cd966d-5afd-4cd7-a543-b2a68360fa1c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:05.828029 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-80cd966d-5afd-4cd7-a543-b2a68360fa1c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:05.830619 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-80cd966d-5afd-4cd7-a543-b2a68360fa1c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:05.832164 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-80cd966d-5afd-4cd7-a543-b2a68360fa1c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:05.833681 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-80cd966d-5afd-4cd7-a543-b2a68360fa1c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:05.992799 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-73566179-9846-4c15-8bf5-ba92c5a8e48a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lazy-loading 'services' on Instance uuid a0a3feae-1805-4c09-881b-99dd257bd9c2 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:30:06.013785 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-80cd966d-5afd-4cd7-a543-b2a68360fa1c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:06.026316 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-80cd966d-5afd-4cd7-a543-b2a68360fa1c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:06.027982 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-80cd966d-5afd-4cd7-a543-b2a68360fa1c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:06.030473 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-80cd966d-5afd-4cd7-a543-b2a68360fa1c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793" status: 200 len: 1812 microversion: 2.25 time: 0.222906 Oct 18 15:30:06.031466 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 701/1436] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:05 2022] GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793 => generated 1812 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:30:06.125510 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-cf8f7e89-6321-48b7-8925-a91657ace202 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:06.126462 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-cf8f7e89-6321-48b7-8925-a91657ace202 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] [instance: 74e5ae75-9c35-4610-9cb5-61afa6f98581] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:06.135650 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-73566179-9846-4c15-8bf5-ba92c5a8e48a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2/os-volume_attachments/2c12f9a0-8ca1-4a33-945f-423d0911f66a" status: 202 len: 0 microversion: 2.1 time: 0.396404 Oct 18 15:30:06.138155 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cf8f7e89-6321-48b7-8925-a91657ace202 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:06.139613 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cf8f7e89-6321-48b7-8925-a91657ace202 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:06.140008 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 736/1437] 10.222.0.60 () {58 vars in 1416 bytes} [Tue Oct 18 15:30:05 2022] DELETE /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2/os-volume_attachments/2c12f9a0-8ca1-4a33-945f-423d0911f66a => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:30:06.146457 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-08f6bed5-8d1a-493e-baaf-1c0b4bcc9b6e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:06.149097 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-08f6bed5-8d1a-493e-baaf-1c0b4bcc9b6e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:06.153885 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cf8f7e89-6321-48b7-8925-a91657ace202 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:06.155281 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cf8f7e89-6321-48b7-8925-a91657ace202 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:06.156040 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cf8f7e89-6321-48b7-8925-a91657ace202 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:06.156954 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cf8f7e89-6321-48b7-8925-a91657ace202 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:06.159847 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-08f6bed5-8d1a-493e-baaf-1c0b4bcc9b6e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:06.160348 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-08f6bed5-8d1a-493e-baaf-1c0b4bcc9b6e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:06.160834 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-08f6bed5-8d1a-493e-baaf-1c0b4bcc9b6e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:06.162315 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-08f6bed5-8d1a-493e-baaf-1c0b4bcc9b6e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:06.162994 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-08f6bed5-8d1a-493e-baaf-1c0b4bcc9b6e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:06.163892 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-08f6bed5-8d1a-493e-baaf-1c0b4bcc9b6e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:06.200429 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-08f6bed5-8d1a-493e-baaf-1c0b4bcc9b6e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058893 Oct 18 15:30:06.211644 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 737/1438] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 15:30:06 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:30:06.307378 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bcefc909-21f3-4d70-8fc9-1ecc22a23ffd tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:06.307995 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bcefc909-21f3-4d70-8fc9-1ecc22a23ffd tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:06.318454 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bcefc909-21f3-4d70-8fc9-1ecc22a23ffd tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:06.319384 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bcefc909-21f3-4d70-8fc9-1ecc22a23ffd tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:06.319839 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bcefc909-21f3-4d70-8fc9-1ecc22a23ffd tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:06.320597 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bcefc909-21f3-4d70-8fc9-1ecc22a23ffd tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:06.321171 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bcefc909-21f3-4d70-8fc9-1ecc22a23ffd tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:06.323667 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bcefc909-21f3-4d70-8fc9-1ecc22a23ffd tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:06.421197 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bcefc909-21f3-4d70-8fc9-1ecc22a23ffd tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:06.427216 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-cf8f7e89-6321-48b7-8925-a91657ace202 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe80f2ae3ec4365a031ca7472d76e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df909cb429f46c39a83c29fb260b169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:06.441800 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bcefc909-21f3-4d70-8fc9-1ecc22a23ffd tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:06.443586 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bcefc909-21f3-4d70-8fc9-1ecc22a23ffd tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:06.450780 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bcefc909-21f3-4d70-8fc9-1ecc22a23ffd tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1539 microversion: 2.91 time: 0.147274 Oct 18 15:30:06.451829 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 738/1439] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:06 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1539 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:30:06.482365 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-03c36bbd-5840-4d82-ac30-a62dbe65a165 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:06.483125 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-cf8f7e89-6321-48b7-8925-a91657ace202 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] 10.222.0.60 "GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581" status: 200 len: 1318 microversion: 2.1 time: 0.360619 Oct 18 15:30:06.483875 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-03c36bbd-5840-4d82-ac30-a62dbe65a165 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 4b959d9f-3c8e-44ef-92f1-83cfb8e04804] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:06.488424 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 702/1440] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:06 2022] GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581 => generated 1318 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:30:06.494359 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-cc37dab5-78d0-4633-9cb8-000e04141d32 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:06.495630 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-cc37dab5-78d0-4633-9cb8-000e04141d32 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] [instance: 21ed44b3-c1df-4099-a1ca-a8b167fc3890] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:06.502569 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cc37dab5-78d0-4633-9cb8-000e04141d32 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:06.505500 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cc37dab5-78d0-4633-9cb8-000e04141d32 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:06.506495 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cc37dab5-78d0-4633-9cb8-000e04141d32 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:06.507449 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cc37dab5-78d0-4633-9cb8-000e04141d32 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:06.508138 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cc37dab5-78d0-4633-9cb8-000e04141d32 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:06.508755 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03c36bbd-5840-4d82-ac30-a62dbe65a165 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:06.509035 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cc37dab5-78d0-4633-9cb8-000e04141d32 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:06.509744 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03c36bbd-5840-4d82-ac30-a62dbe65a165 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:06.510446 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03c36bbd-5840-4d82-ac30-a62dbe65a165 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:06.511506 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03c36bbd-5840-4d82-ac30-a62dbe65a165 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:06.513133 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03c36bbd-5840-4d82-ac30-a62dbe65a165 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:06.513834 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03c36bbd-5840-4d82-ac30-a62dbe65a165 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:06.526856 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-cc37dab5-78d0-4633-9cb8-000e04141d32 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] HTTP exception thrown: Instance 21ed44b3-c1df-4099-a1ca-a8b167fc3890 could not be found. Oct 18 15:30:06.529007 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-cc37dab5-78d0-4633-9cb8-000e04141d32 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Request method failure captured: Oct 18 15:30:06.529007 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/21ed44b3-c1df-4099-a1ca-a8b167fc3890 HTTP/1.1 Oct 18 15:30:06.529007 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:30:06.529007 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:30:06.529007 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:30:06.529007 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:30:06.529007 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:30:06.529007 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:30:06.529007 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:30:06.529007 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:30:06.529007 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsW0UV85WLlKZ364uAWmmy7letPaZ8FgqMvn-CkxvQolKVsKOuvxkXCTiJtOawDg6-GQw90qLXqscHh-OPCVr7rV900F4Bd5mqd8BnOf4ndiRrK8No2KRjIfxCRA4g6L6-UAkjoW4dw_P6pVx_yopePZek81tV9jY-AcWKwaj011DJI Oct 18 15:30:06.529007 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:30:06.529007 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:30:06.529007 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:30:06.529007 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:30:06.529007 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:30:06.529007 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:30:06.529007 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: ac07f1b2c83a4faab175a5b9ed8e315e Oct 18 15:30:06.529007 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-VolumesAdminNegativeTest-738536875 Oct 18 15:30:06.529007 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:30:06.529007 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:30:06.530804 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ac07f1b2c83a4faab175a5b9ed8e315e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ac07f1b2c83a4faab175a5b9ed8e315e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ac07f1b2c83a4faab175a5b9ed8e315e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ac07f1b2c83a4faab175a5b9ed8e315e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:30:06.530804 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-VolumesAdminNegativeTest-738536875 Oct 18 15:30:06.530804 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: ac07f1b2c83a4faab175a5b9ed8e315e Oct 18 15:30:06.530804 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-738536875 Oct 18 15:30:06.530804 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-VolumesAdminNegativeTest-738536875-project Oct 18 15:30:06.530804 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:30:06.530804 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:30:06.530804 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: a1023300147f463e8f0894981948f825 Oct 18 15:30:06.530804 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-VolumesAdminNegativeTest-738536875-project Oct 18 15:30:06.530804 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:30:06.530804 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 21ed44b3-c1df-4099-a1ca-a8b167fc3890 could not be found. Oct 18 15:30:06.530804 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '21ed44b3-c1df-4099-a1ca-a8b167fc3890'} Oct 18 15:30:06.531764 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:30:06.531764 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:30:06.531764 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:30:06.531764 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:30:06.531764 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:30:06.531764 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:30:06.531764 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:30:06.531764 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:30:06.531764 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:30:06.531764 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:30:06.531764 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21ed44b3-c1df-4099-a1ca-a8b167fc3890 could not be found. Oct 18 15:30:06.531764 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:30:06.531764 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:30:06.531764 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:30:06.531764 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:30:06.531764 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:30:06.531764 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:30:06.531764 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:30:06.531764 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:30:06.531764 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:30:06.533060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:30:06.533060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:30:06.533060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:30:06.533060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:30:06.533060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:30:06.533060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:30:06.533060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:30:06.533060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21ed44b3-c1df-4099-a1ca-a8b167fc3890 could not be found. Oct 18 15:30:06.533060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:30:06.533060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:30:06.533060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:30:06.533060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:30:06.533060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:30:06.533060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:30:06.533060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:30:06.533060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:30:06.533060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21ed44b3-c1df-4099-a1ca-a8b167fc3890 could not be found. Oct 18 15:30:06.533060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:30:06.534329 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-cc37dab5-78d0-4633-9cb8-000e04141d32 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Returning 404 to user: Instance 21ed44b3-c1df-4099-a1ca-a8b167fc3890 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:30:06.536916 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-cc37dab5-78d0-4633-9cb8-000e04141d32 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "GET /compute/v2.1/servers/21ed44b3-c1df-4099-a1ca-a8b167fc3890" status: 404 len: 111 microversion: 2.1 time: 0.044306 Oct 18 15:30:06.538005 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 703/1441] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:06 2022] GET /compute/v2.1/servers/21ed44b3-c1df-4099-a1ca-a8b167fc3890 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:30:06.548117 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-793bc956-71aa-46cc-9ebc-75f4f28c05a2 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] Calling method '.version_select at 0x7f7c3d0074c0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:06.588942 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-793bc956-71aa-46cc-9ebc-75f4f28c05a2 tempest-VolumesAdminNegativeTest-738536875 tempest-VolumesAdminNegativeTest-738536875-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-934683465" status: 202 len: 0 microversion: 2.1 time: 0.046240 Oct 18 15:30:06.589715 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 704/1442] 10.222.0.60 () {58 vars in 1218 bytes} [Tue Oct 18 15:30:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-934683465 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:30:06.696242 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-03c36bbd-5840-4d82-ac30-a62dbe65a165 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:06.704681 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-03c36bbd-5840-4d82-ac30-a62dbe65a165 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804" status: 200 len: 1307 microversion: 2.1 time: 0.251452 Oct 18 15:30:06.705434 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 739/1443] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:06 2022] GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804 => generated 1307 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:06.747306 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7e2ceb79-ad72-43b2-8f0a-6a3c7276f2a8 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:06.748270 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7e2ceb79-ad72-43b2-8f0a-6a3c7276f2a8 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 40097653-662f-4191-983d-881387af06a8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:06.758063 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7e2ceb79-ad72-43b2-8f0a-6a3c7276f2a8 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:06.759097 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7e2ceb79-ad72-43b2-8f0a-6a3c7276f2a8 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:06.759663 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7e2ceb79-ad72-43b2-8f0a-6a3c7276f2a8 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:06.760508 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7e2ceb79-ad72-43b2-8f0a-6a3c7276f2a8 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:06.765157 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7e2ceb79-ad72-43b2-8f0a-6a3c7276f2a8 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:06.766146 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7e2ceb79-ad72-43b2-8f0a-6a3c7276f2a8 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:06.958042 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-441a17fd-68d9-45cb-9daa-b219e0fe4b75 req-feb786fc-6ed2-4c64-9be6-608d386a6fea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b959d9f-3c8e-44ef-92f1-83cfb8e04804", "name": "network-vif-plugged", "status": "completed", "tag": "497df88b-7ec7-4c49-ac83-b558f8c280b3"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:30:06.978311 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-441a17fd-68d9-45cb-9daa-b219e0fe4b75 req-feb786fc-6ed2-4c64-9be6-608d386a6fea service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:06.982377 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-441a17fd-68d9-45cb-9daa-b219e0fe4b75 req-feb786fc-6ed2-4c64-9be6-608d386a6fea service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:06.983239 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-441a17fd-68d9-45cb-9daa-b219e0fe4b75 req-feb786fc-6ed2-4c64-9be6-608d386a6fea service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:07.009856 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-441a17fd-68d9-45cb-9daa-b219e0fe4b75 req-feb786fc-6ed2-4c64-9be6-608d386a6fea service nova] Creating event network-vif-plugged:497df88b-7ec7-4c49-ac83-b558f8c280b3 for instance 4b959d9f-3c8e-44ef-92f1-83cfb8e04804 on n-h1-853682-5 Oct 18 15:30:07.031470 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-441a17fd-68d9-45cb-9daa-b219e0fe4b75 req-feb786fc-6ed2-4c64-9be6-608d386a6fea service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077639 Oct 18 15:30:07.033590 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 740/1444] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:30:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:30:07.041752 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-eb837b29-3796-48ef-99db-cea4ad32a914 req-133c9cfa-7ac5-480c-a3e5-f351c192cd07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40097653-662f-4191-983d-881387af06a8", "tag": "4da77dc8-5cc4-4661-bd00-573bf094fde7"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:30:07.042115 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7e2ceb79-ad72-43b2-8f0a-6a3c7276f2a8 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:07.053470 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7e2ceb79-ad72-43b2-8f0a-6a3c7276f2a8 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8" status: 200 len: 1316 microversion: 2.1 time: 0.312238 Oct 18 15:30:07.056429 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 705/1445] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:06 2022] GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8 => generated 1316 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:07.064771 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-087925ba-1521-4fc8-9d00-2cd86ff9c25b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:07.065703 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-087925ba-1521-4fc8-9d00-2cd86ff9c25b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:07.067212 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-eb837b29-3796-48ef-99db-cea4ad32a914 req-133c9cfa-7ac5-480c-a3e5-f351c192cd07 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:07.077294 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-eb837b29-3796-48ef-99db-cea4ad32a914 req-133c9cfa-7ac5-480c-a3e5-f351c192cd07 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:07.078826 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-eb837b29-3796-48ef-99db-cea4ad32a914 req-133c9cfa-7ac5-480c-a3e5-f351c192cd07 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:07.091699 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-eb837b29-3796-48ef-99db-cea4ad32a914 req-133c9cfa-7ac5-480c-a3e5-f351c192cd07 service nova] Creating event network-changed:4da77dc8-5cc4-4661-bd00-573bf094fde7 for instance 40097653-662f-4191-983d-881387af06a8 on n-h1-853682-5 Oct 18 15:30:07.093466 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-087925ba-1521-4fc8-9d00-2cd86ff9c25b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:07.094192 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-087925ba-1521-4fc8-9d00-2cd86ff9c25b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:07.094852 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-087925ba-1521-4fc8-9d00-2cd86ff9c25b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:07.096248 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-087925ba-1521-4fc8-9d00-2cd86ff9c25b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:07.096965 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-087925ba-1521-4fc8-9d00-2cd86ff9c25b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:07.098353 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-087925ba-1521-4fc8-9d00-2cd86ff9c25b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:07.109660 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-eb837b29-3796-48ef-99db-cea4ad32a914 req-133c9cfa-7ac5-480c-a3e5-f351c192cd07 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073823 Oct 18 15:30:07.111586 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 741/1446] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:30:07.226891 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c0e5442a-f062-45ea-80d3-b8e7fcfb0487 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:07.230412 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c0e5442a-f062-45ea-80d3-b8e7fcfb0487 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:07.247288 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0e5442a-f062-45ea-80d3-b8e7fcfb0487 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:07.248274 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0e5442a-f062-45ea-80d3-b8e7fcfb0487 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:07.248904 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0e5442a-f062-45ea-80d3-b8e7fcfb0487 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:07.251906 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0e5442a-f062-45ea-80d3-b8e7fcfb0487 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:07.253793 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0e5442a-f062-45ea-80d3-b8e7fcfb0487 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:07.254396 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0e5442a-f062-45ea-80d3-b8e7fcfb0487 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:07.351804 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c0e5442a-f062-45ea-80d3-b8e7fcfb0487 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131437 Oct 18 15:30:07.357634 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 742/1447] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 15:30:07 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:30:07.485214 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-46970e30-1700-4794-b15b-25fd74976035 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:07.485753 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-46970e30-1700-4794-b15b-25fd74976035 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:07.498453 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-46970e30-1700-4794-b15b-25fd74976035 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:07.498951 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-46970e30-1700-4794-b15b-25fd74976035 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:07.499388 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-46970e30-1700-4794-b15b-25fd74976035 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:07.500119 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-46970e30-1700-4794-b15b-25fd74976035 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:07.500574 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-46970e30-1700-4794-b15b-25fd74976035 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:07.500995 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-087925ba-1521-4fc8-9d00-2cd86ff9c25b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:07.501476 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-46970e30-1700-4794-b15b-25fd74976035 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:07.518480 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-087925ba-1521-4fc8-9d00-2cd86ff9c25b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:07.526373 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-087925ba-1521-4fc8-9d00-2cd86ff9c25b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:07.530017 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-087925ba-1521-4fc8-9d00-2cd86ff9c25b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793" status: 200 len: 1812 microversion: 2.25 time: 0.472006 Oct 18 15:30:07.531251 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 706/1448] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:07 2022] GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793 => generated 1812 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:30:07.542147 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-468268ca-6404-42f5-982f-88c3bdf2f32a tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:07.545225 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-468268ca-6404-42f5-982f-88c3bdf2f32a tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] [instance: 74e5ae75-9c35-4610-9cb5-61afa6f98581] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:07.556709 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-468268ca-6404-42f5-982f-88c3bdf2f32a tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:07.557241 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-468268ca-6404-42f5-982f-88c3bdf2f32a tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:07.557680 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-468268ca-6404-42f5-982f-88c3bdf2f32a tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:07.558395 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-468268ca-6404-42f5-982f-88c3bdf2f32a tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:07.558853 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-468268ca-6404-42f5-982f-88c3bdf2f32a tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:07.571631 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-468268ca-6404-42f5-982f-88c3bdf2f32a tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:07.711120 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-46970e30-1700-4794-b15b-25fd74976035 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:07.725654 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-46970e30-1700-4794-b15b-25fd74976035 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:07.728755 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-46970e30-1700-4794-b15b-25fd74976035 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:07.736721 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-46970e30-1700-4794-b15b-25fd74976035 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1539 microversion: 2.91 time: 0.258427 Oct 18 15:30:07.738217 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 743/1449] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:07 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1539 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:30:07.744259 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cf379229-c3e4-437a-b1ad-9d26ef64045c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:07.745562 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cf379229-c3e4-437a-b1ad-9d26ef64045c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 4b959d9f-3c8e-44ef-92f1-83cfb8e04804] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:07.755861 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf379229-c3e4-437a-b1ad-9d26ef64045c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:07.756613 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf379229-c3e4-437a-b1ad-9d26ef64045c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:07.757439 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf379229-c3e4-437a-b1ad-9d26ef64045c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:07.758278 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf379229-c3e4-437a-b1ad-9d26ef64045c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:07.759052 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf379229-c3e4-437a-b1ad-9d26ef64045c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:07.759692 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf379229-c3e4-437a-b1ad-9d26ef64045c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:08.095547 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-468268ca-6404-42f5-982f-88c3bdf2f32a tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe80f2ae3ec4365a031ca7472d76e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df909cb429f46c39a83c29fb260b169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:08.107358 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-468268ca-6404-42f5-982f-88c3bdf2f32a tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] 10.222.0.60 "GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581" status: 200 len: 1318 microversion: 2.1 time: 0.571542 Oct 18 15:30:08.109091 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 707/1450] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:07 2022] GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581 => generated 1318 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:08.115287 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-01897280-43bb-4b7b-9505-f3b34917edd0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:08.117154 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-01897280-43bb-4b7b-9505-f3b34917edd0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 40097653-662f-4191-983d-881387af06a8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:08.128936 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-01897280-43bb-4b7b-9505-f3b34917edd0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:08.129914 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-01897280-43bb-4b7b-9505-f3b34917edd0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:08.130529 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-01897280-43bb-4b7b-9505-f3b34917edd0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:08.131511 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-01897280-43bb-4b7b-9505-f3b34917edd0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:08.132246 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-01897280-43bb-4b7b-9505-f3b34917edd0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:08.133784 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-01897280-43bb-4b7b-9505-f3b34917edd0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:08.265344 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cf379229-c3e4-437a-b1ad-9d26ef64045c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:08.277813 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cf379229-c3e4-437a-b1ad-9d26ef64045c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804" status: 200 len: 1307 microversion: 2.1 time: 0.537889 Oct 18 15:30:08.280385 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 744/1451] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:07 2022] GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804 => generated 1307 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:08.368719 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8c82ebcc-88c2-4a74-8e17-8e2040131e8e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:08.371772 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8c82ebcc-88c2-4a74-8e17-8e2040131e8e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:08.379545 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c82ebcc-88c2-4a74-8e17-8e2040131e8e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:08.380317 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c82ebcc-88c2-4a74-8e17-8e2040131e8e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:08.381117 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c82ebcc-88c2-4a74-8e17-8e2040131e8e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:08.382137 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c82ebcc-88c2-4a74-8e17-8e2040131e8e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:08.382810 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c82ebcc-88c2-4a74-8e17-8e2040131e8e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:08.383406 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c82ebcc-88c2-4a74-8e17-8e2040131e8e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:08.422404 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8c82ebcc-88c2-4a74-8e17-8e2040131e8e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061105 Oct 18 15:30:08.423748 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 745/1452] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 15:30:08 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:30:08.562505 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2be18bdf-3bce-4379-aeaf-0939577a0f5a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:08.563236 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2be18bdf-3bce-4379-aeaf-0939577a0f5a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:08.575282 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2be18bdf-3bce-4379-aeaf-0939577a0f5a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:08.577333 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2be18bdf-3bce-4379-aeaf-0939577a0f5a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:08.578554 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2be18bdf-3bce-4379-aeaf-0939577a0f5a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:08.585608 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2be18bdf-3bce-4379-aeaf-0939577a0f5a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:08.586122 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2be18bdf-3bce-4379-aeaf-0939577a0f5a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:08.586565 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2be18bdf-3bce-4379-aeaf-0939577a0f5a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:08.647549 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-01897280-43bb-4b7b-9505-f3b34917edd0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:08.656445 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-01897280-43bb-4b7b-9505-f3b34917edd0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8" status: 200 len: 1316 microversion: 2.1 time: 0.546102 Oct 18 15:30:08.659879 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 708/1453] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:08 2022] GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8 => generated 1316 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:08.771007 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-96ee318b-e0b9-42c8-b5bb-38c3ff934d81 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:08.771731 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-96ee318b-e0b9-42c8-b5bb-38c3ff934d81 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:08.780586 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-96ee318b-e0b9-42c8-b5bb-38c3ff934d81 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:08.785170 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-96ee318b-e0b9-42c8-b5bb-38c3ff934d81 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:08.785963 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-96ee318b-e0b9-42c8-b5bb-38c3ff934d81 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:08.786938 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-96ee318b-e0b9-42c8-b5bb-38c3ff934d81 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:08.787564 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-96ee318b-e0b9-42c8-b5bb-38c3ff934d81 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:08.788171 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-96ee318b-e0b9-42c8-b5bb-38c3ff934d81 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:09.321775 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-96ee318b-e0b9-42c8-b5bb-38c3ff934d81 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:09.336495 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-96ee318b-e0b9-42c8-b5bb-38c3ff934d81 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:09.339476 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-96ee318b-e0b9-42c8-b5bb-38c3ff934d81 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:09.347626 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-96ee318b-e0b9-42c8-b5bb-38c3ff934d81 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1539 microversion: 2.91 time: 0.580606 Oct 18 15:30:09.348927 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 709/1454] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:08 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1539 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:30:09.358325 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-83457acc-6243-478e-82de-f2d90e787ed1 req-377aff09-2866-491f-a08f-b12d5b8884b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74e5ae75-9c35-4610-9cb5-61afa6f98581", "name": "network-vif-plugged", "status": "completed", "tag": "da601fb9-7eac-4831-80d1-a76275a0d8ed"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:30:09.379650 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-83457acc-6243-478e-82de-f2d90e787ed1 req-377aff09-2866-491f-a08f-b12d5b8884b7 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:09.380396 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-83457acc-6243-478e-82de-f2d90e787ed1 req-377aff09-2866-491f-a08f-b12d5b8884b7 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:09.380858 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-83457acc-6243-478e-82de-f2d90e787ed1 req-377aff09-2866-491f-a08f-b12d5b8884b7 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:09.390454 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2be18bdf-3bce-4379-aeaf-0939577a0f5a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:09.397087 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-83457acc-6243-478e-82de-f2d90e787ed1 req-377aff09-2866-491f-a08f-b12d5b8884b7 service nova] Creating event network-vif-plugged:da601fb9-7eac-4831-80d1-a76275a0d8ed for instance 74e5ae75-9c35-4610-9cb5-61afa6f98581 on n-h1-853682-5 Oct 18 15:30:09.403530 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-83457acc-6243-478e-82de-f2d90e787ed1 req-377aff09-2866-491f-a08f-b12d5b8884b7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048491 Oct 18 15:30:09.405329 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 710/1455] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:30:09.410009 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2be18bdf-3bce-4379-aeaf-0939577a0f5a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:09.411491 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2be18bdf-3bce-4379-aeaf-0939577a0f5a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:09.412771 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2be18bdf-3bce-4379-aeaf-0939577a0f5a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793" status: 200 len: 1812 microversion: 2.25 time: 0.854837 Oct 18 15:30:09.413770 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-de984766-8603-4ba9-acc8-b49171e4ccc8 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:09.414788 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-de984766-8603-4ba9-acc8-b49171e4ccc8 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] [instance: 74e5ae75-9c35-4610-9cb5-61afa6f98581] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:09.417861 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 746/1456] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:08 2022] GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793 => generated 1812 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:30:09.421717 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de984766-8603-4ba9-acc8-b49171e4ccc8 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:09.422384 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de984766-8603-4ba9-acc8-b49171e4ccc8 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:09.423904 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de984766-8603-4ba9-acc8-b49171e4ccc8 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:09.425489 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de984766-8603-4ba9-acc8-b49171e4ccc8 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:09.426107 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de984766-8603-4ba9-acc8-b49171e4ccc8 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:09.426693 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de984766-8603-4ba9-acc8-b49171e4ccc8 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:09.429491 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-7d20d4f5-1688-458f-9ddf-74942864faab req-01de5452-c8d0-4cfc-a690-ebcc91d07610 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23bdadc4-6faa-4e55-8daf-eef04dd34a8a", "tag": "31a34f24-b614-446a-bba2-e9ae313005fa"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:30:09.442106 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7d20d4f5-1688-458f-9ddf-74942864faab req-01de5452-c8d0-4cfc-a690-ebcc91d07610 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:09.442825 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7d20d4f5-1688-458f-9ddf-74942864faab req-01de5452-c8d0-4cfc-a690-ebcc91d07610 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:09.443253 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7d20d4f5-1688-458f-9ddf-74942864faab req-01de5452-c8d0-4cfc-a690-ebcc91d07610 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:09.463825 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-7d20d4f5-1688-458f-9ddf-74942864faab req-01de5452-c8d0-4cfc-a690-ebcc91d07610 service nova] Creating event network-changed:31a34f24-b614-446a-bba2-e9ae313005fa for instance 23bdadc4-6faa-4e55-8daf-eef04dd34a8a on n-h2-853682-5 Oct 18 15:30:09.470319 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-7d20d4f5-1688-458f-9ddf-74942864faab req-01de5452-c8d0-4cfc-a690-ebcc91d07610 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050955 Oct 18 15:30:09.471199 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 747/1457] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:30:09.479346 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4f3f9a28-667f-446b-b693-4e8d323d741c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:09.480963 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4f3f9a28-667f-446b-b693-4e8d323d741c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 4b959d9f-3c8e-44ef-92f1-83cfb8e04804] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:09.488851 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f3f9a28-667f-446b-b693-4e8d323d741c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:09.489570 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f3f9a28-667f-446b-b693-4e8d323d741c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:09.490521 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f3f9a28-667f-446b-b693-4e8d323d741c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:09.492539 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f3f9a28-667f-446b-b693-4e8d323d741c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:09.493209 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f3f9a28-667f-446b-b693-4e8d323d741c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:09.494440 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f3f9a28-667f-446b-b693-4e8d323d741c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:09.499251 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:30:09.875237 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-de984766-8603-4ba9-acc8-b49171e4ccc8 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe80f2ae3ec4365a031ca7472d76e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df909cb429f46c39a83c29fb260b169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:09.890469 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-de984766-8603-4ba9-acc8-b49171e4ccc8 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] 10.222.0.60 "GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581" status: 200 len: 1318 microversion: 2.1 time: 0.481966 Oct 18 15:30:09.894893 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 711/1458] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:09 2022] GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581 => generated 1318 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:09.901577 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4f3f9a28-667f-446b-b693-4e8d323d741c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:09.906562 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e864bef4-a098-47d3-98dd-44d07681c226 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:09.910341 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e864bef4-a098-47d3-98dd-44d07681c226 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:09.913664 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4f3f9a28-667f-446b-b693-4e8d323d741c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804" status: 200 len: 1487 microversion: 2.1 time: 0.440006 Oct 18 15:30:09.928883 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 748/1459] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:09 2022] GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804 => generated 1487 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:09.928883 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eece7ab2-7ffe-4cd5-9b03-4e09e82a94c7 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:09.928883 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-eece7ab2-7ffe-4cd5-9b03-4e09e82a94c7 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 40097653-662f-4191-983d-881387af06a8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:09.929280 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e864bef4-a098-47d3-98dd-44d07681c226 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:09.929280 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e864bef4-a098-47d3-98dd-44d07681c226 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:09.929280 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e864bef4-a098-47d3-98dd-44d07681c226 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:09.933697 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e864bef4-a098-47d3-98dd-44d07681c226 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:09.934575 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e864bef4-a098-47d3-98dd-44d07681c226 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:09.934769 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e864bef4-a098-47d3-98dd-44d07681c226 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:09.954980 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eece7ab2-7ffe-4cd5-9b03-4e09e82a94c7 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:09.955570 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eece7ab2-7ffe-4cd5-9b03-4e09e82a94c7 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:09.956022 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eece7ab2-7ffe-4cd5-9b03-4e09e82a94c7 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:09.957038 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eece7ab2-7ffe-4cd5-9b03-4e09e82a94c7 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:09.957564 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eece7ab2-7ffe-4cd5-9b03-4e09e82a94c7 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:09.958301 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eece7ab2-7ffe-4cd5-9b03-4e09e82a94c7 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:10.022201 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e864bef4-a098-47d3-98dd-44d07681c226 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126105 Oct 18 15:30:10.022826 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 712/1460] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 15:30:09 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:30:10.027497 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9d5ac0e1-cf1a-4a26-82dc-e12b5539ef0f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:10.027996 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9d5ac0e1-cf1a-4a26-82dc-e12b5539ef0f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 4b959d9f-3c8e-44ef-92f1-83cfb8e04804] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:10.034778 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9d5ac0e1-cf1a-4a26-82dc-e12b5539ef0f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:10.035272 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9d5ac0e1-cf1a-4a26-82dc-e12b5539ef0f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:10.035711 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9d5ac0e1-cf1a-4a26-82dc-e12b5539ef0f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:10.036428 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9d5ac0e1-cf1a-4a26-82dc-e12b5539ef0f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:10.036912 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9d5ac0e1-cf1a-4a26-82dc-e12b5539ef0f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:10.037451 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9d5ac0e1-cf1a-4a26-82dc-e12b5539ef0f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:10.070477 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9d5ac0e1-cf1a-4a26-82dc-e12b5539ef0f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 4b959d9f-3c8e-44ef-92f1-83cfb8e04804] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:30:10.074307 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=100 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:30:10.176976 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9d5ac0e1-cf1a-4a26-82dc-e12b5539ef0f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804" status: 204 len: 0 microversion: 2.1 time: 0.152759 Oct 18 15:30:10.178838 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 713/1461] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:30:10 2022] DELETE /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:30:10.187444 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-dadf9d81-44e7-4439-8df3-64acb9d2a67a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:10.188290 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-dadf9d81-44e7-4439-8df3-64acb9d2a67a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 4b959d9f-3c8e-44ef-92f1-83cfb8e04804] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:10.198081 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dadf9d81-44e7-4439-8df3-64acb9d2a67a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:10.200512 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dadf9d81-44e7-4439-8df3-64acb9d2a67a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:10.201163 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dadf9d81-44e7-4439-8df3-64acb9d2a67a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:10.202537 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dadf9d81-44e7-4439-8df3-64acb9d2a67a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:10.203100 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dadf9d81-44e7-4439-8df3-64acb9d2a67a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:10.203623 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dadf9d81-44e7-4439-8df3-64acb9d2a67a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:10.435875 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-eece7ab2-7ffe-4cd5-9b03-4e09e82a94c7 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:10.448229 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-eece7ab2-7ffe-4cd5-9b03-4e09e82a94c7 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8" status: 200 len: 1316 microversion: 2.1 time: 0.524987 Oct 18 15:30:10.449723 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 749/1462] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:09 2022] GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8 => generated 1316 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:10.457016 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-80c45370-44c2-46b4-a857-a26e1eed698f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:10.458507 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-80c45370-44c2-46b4-a857-a26e1eed698f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:10.469892 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80c45370-44c2-46b4-a857-a26e1eed698f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:10.470623 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80c45370-44c2-46b4-a857-a26e1eed698f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:10.471515 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80c45370-44c2-46b4-a857-a26e1eed698f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:10.473148 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80c45370-44c2-46b4-a857-a26e1eed698f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:10.474617 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80c45370-44c2-46b4-a857-a26e1eed698f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:10.475109 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80c45370-44c2-46b4-a857-a26e1eed698f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:10.584820 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-80c45370-44c2-46b4-a857-a26e1eed698f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:10.593950 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-80c45370-44c2-46b4-a857-a26e1eed698f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:10.594726 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-dadf9d81-44e7-4439-8df3-64acb9d2a67a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:10.595384 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-80c45370-44c2-46b4-a857-a26e1eed698f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:10.601283 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-80c45370-44c2-46b4-a857-a26e1eed698f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1539 microversion: 2.91 time: 0.150322 Oct 18 15:30:10.602795 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 750/1463] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:10 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1539 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:30:10.604672 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-dadf9d81-44e7-4439-8df3-64acb9d2a67a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804" status: 200 len: 1493 microversion: 2.1 time: 0.422590 Oct 18 15:30:10.609899 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0c8e73b5-f795-455e-b436-b04f7068ac3d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:10.610692 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0c8e73b5-f795-455e-b436-b04f7068ac3d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:10.616727 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c8e73b5-f795-455e-b436-b04f7068ac3d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:10.617491 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c8e73b5-f795-455e-b436-b04f7068ac3d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:10.618218 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c8e73b5-f795-455e-b436-b04f7068ac3d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:10.620412 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c8e73b5-f795-455e-b436-b04f7068ac3d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:10.621062 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c8e73b5-f795-455e-b436-b04f7068ac3d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:10.621782 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c8e73b5-f795-455e-b436-b04f7068ac3d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:10.621911 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 714/1464] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:10 2022] GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804 => generated 1493 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:10.911735 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-817b28dd-c45e-439a-9fe3-163f9ed40564 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:10.912435 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-817b28dd-c45e-439a-9fe3-163f9ed40564 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] [instance: 74e5ae75-9c35-4610-9cb5-61afa6f98581] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:10.918784 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-817b28dd-c45e-439a-9fe3-163f9ed40564 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:10.919030 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0c8e73b5-f795-455e-b436-b04f7068ac3d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:10.919742 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-817b28dd-c45e-439a-9fe3-163f9ed40564 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:10.919742 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-817b28dd-c45e-439a-9fe3-163f9ed40564 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:10.920403 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-817b28dd-c45e-439a-9fe3-163f9ed40564 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:10.920882 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-817b28dd-c45e-439a-9fe3-163f9ed40564 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:10.921314 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-817b28dd-c45e-439a-9fe3-163f9ed40564 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:10.941939 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0c8e73b5-f795-455e-b436-b04f7068ac3d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:10.943421 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0c8e73b5-f795-455e-b436-b04f7068ac3d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:10.944656 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0c8e73b5-f795-455e-b436-b04f7068ac3d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793" status: 200 len: 1812 microversion: 2.25 time: 0.339477 Oct 18 15:30:10.945286 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 751/1465] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:10 2022] GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793 => generated 1812 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:30:11.035629 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-72cd9464-d481-4aa6-b948-8d4fcc28f766 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:11.039915 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-72cd9464-d481-4aa6-b948-8d4fcc28f766 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:11.046927 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-72cd9464-d481-4aa6-b948-8d4fcc28f766 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:11.047501 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-72cd9464-d481-4aa6-b948-8d4fcc28f766 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:11.048168 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-72cd9464-d481-4aa6-b948-8d4fcc28f766 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:11.048963 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-72cd9464-d481-4aa6-b948-8d4fcc28f766 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:11.049690 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-72cd9464-d481-4aa6-b948-8d4fcc28f766 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:11.051928 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-72cd9464-d481-4aa6-b948-8d4fcc28f766 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:11.086819 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-72cd9464-d481-4aa6-b948-8d4fcc28f766 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055819 Oct 18 15:30:11.088437 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 752/1466] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 15:30:11 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:30:11.153275 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-817b28dd-c45e-439a-9fe3-163f9ed40564 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe80f2ae3ec4365a031ca7472d76e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df909cb429f46c39a83c29fb260b169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:11.161039 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-817b28dd-c45e-439a-9fe3-163f9ed40564 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] 10.222.0.60 "GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581" status: 200 len: 1318 microversion: 2.1 time: 0.253386 Oct 18 15:30:11.162275 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 715/1467] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:10 2022] GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581 => generated 1318 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:30:11.481377 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-54b4402e-297a-4ecd-9f20-0dd6f6f6b748 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:11.482792 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-54b4402e-297a-4ecd-9f20-0dd6f6f6b748 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 40097653-662f-4191-983d-881387af06a8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:11.490322 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54b4402e-297a-4ecd-9f20-0dd6f6f6b748 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:11.490813 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54b4402e-297a-4ecd-9f20-0dd6f6f6b748 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:11.491426 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54b4402e-297a-4ecd-9f20-0dd6f6f6b748 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:11.493027 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54b4402e-297a-4ecd-9f20-0dd6f6f6b748 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:11.495144 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54b4402e-297a-4ecd-9f20-0dd6f6f6b748 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:11.495768 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54b4402e-297a-4ecd-9f20-0dd6f6f6b748 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:11.629953 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-821339d4-a5a7-4719-9ffe-15c2647e91cf tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:11.630579 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-821339d4-a5a7-4719-9ffe-15c2647e91cf tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 4b959d9f-3c8e-44ef-92f1-83cfb8e04804] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:11.640082 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-821339d4-a5a7-4719-9ffe-15c2647e91cf tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:11.640905 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-821339d4-a5a7-4719-9ffe-15c2647e91cf tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:11.641523 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-821339d4-a5a7-4719-9ffe-15c2647e91cf tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:11.642407 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-821339d4-a5a7-4719-9ffe-15c2647e91cf tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:11.643033 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-821339d4-a5a7-4719-9ffe-15c2647e91cf tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:11.643676 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-821339d4-a5a7-4719-9ffe-15c2647e91cf tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:11.698585 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-54b4402e-297a-4ecd-9f20-0dd6f6f6b748 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:11.706604 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-54b4402e-297a-4ecd-9f20-0dd6f6f6b748 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8" status: 200 len: 1316 microversion: 2.1 time: 0.230254 Oct 18 15:30:11.722370 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 753/1468] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:11 2022] GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8 => generated 1316 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:11.733349 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8fe7f72c-1474-4701-8e10-daca0f4a2c8f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:11.734212 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8fe7f72c-1474-4701-8e10-daca0f4a2c8f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:11.741618 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8fe7f72c-1474-4701-8e10-daca0f4a2c8f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:11.742342 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8fe7f72c-1474-4701-8e10-daca0f4a2c8f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:11.742964 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8fe7f72c-1474-4701-8e10-daca0f4a2c8f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:11.743914 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8fe7f72c-1474-4701-8e10-daca0f4a2c8f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:11.744549 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8fe7f72c-1474-4701-8e10-daca0f4a2c8f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:11.745201 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8fe7f72c-1474-4701-8e10-daca0f4a2c8f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:11.842164 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8fe7f72c-1474-4701-8e10-daca0f4a2c8f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:11.855297 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8fe7f72c-1474-4701-8e10-daca0f4a2c8f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:11.856872 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8fe7f72c-1474-4701-8e10-daca0f4a2c8f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:11.864778 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8fe7f72c-1474-4701-8e10-daca0f4a2c8f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1539 microversion: 2.91 time: 0.140495 Oct 18 15:30:11.883159 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 754/1469] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:11 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1539 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:30:11.941531 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-821339d4-a5a7-4719-9ffe-15c2647e91cf tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:11.952261 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-821339d4-a5a7-4719-9ffe-15c2647e91cf tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804" status: 200 len: 1493 microversion: 2.1 time: 0.327026 Oct 18 15:30:11.961580 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 716/1470] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:11 2022] GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804 => generated 1493 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:30:11.973709 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6117e041-8425-4f5a-b60b-8f1fafbef2c1 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:11.974476 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6117e041-8425-4f5a-b60b-8f1fafbef2c1 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:11.981323 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6117e041-8425-4f5a-b60b-8f1fafbef2c1 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:11.982296 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6117e041-8425-4f5a-b60b-8f1fafbef2c1 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:11.982630 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6117e041-8425-4f5a-b60b-8f1fafbef2c1 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:11.983678 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6117e041-8425-4f5a-b60b-8f1fafbef2c1 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:11.984018 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6117e041-8425-4f5a-b60b-8f1fafbef2c1 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:11.984538 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6117e041-8425-4f5a-b60b-8f1fafbef2c1 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:12.108750 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bbe7a944-13e9-44c3-971f-51fc1c48bbda tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:12.117471 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-bbe7a944-13e9-44c3-971f-51fc1c48bbda tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:12.139235 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bbe7a944-13e9-44c3-971f-51fc1c48bbda tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:12.141191 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bbe7a944-13e9-44c3-971f-51fc1c48bbda tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:12.141191 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bbe7a944-13e9-44c3-971f-51fc1c48bbda tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:12.143402 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bbe7a944-13e9-44c3-971f-51fc1c48bbda tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:12.144197 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bbe7a944-13e9-44c3-971f-51fc1c48bbda tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:12.145224 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bbe7a944-13e9-44c3-971f-51fc1c48bbda tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:12.215830 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-bbe7a944-13e9-44c3-971f-51fc1c48bbda tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.115669 Oct 18 15:30:12.227080 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 717/1471] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 15:30:12 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2/os-volume_attachments => generated 25 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:30:12.243145 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f27ec437-505d-4fac-9a83-22a27076a1e3 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:12.245456 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f27ec437-505d-4fac-9a83-22a27076a1e3 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] [instance: 74e5ae75-9c35-4610-9cb5-61afa6f98581] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:12.262619 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f27ec437-505d-4fac-9a83-22a27076a1e3 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:12.266177 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f27ec437-505d-4fac-9a83-22a27076a1e3 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:12.267677 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f27ec437-505d-4fac-9a83-22a27076a1e3 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:12.273552 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f27ec437-505d-4fac-9a83-22a27076a1e3 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:12.274161 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f27ec437-505d-4fac-9a83-22a27076a1e3 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:12.276212 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f27ec437-505d-4fac-9a83-22a27076a1e3 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:12.432251 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6117e041-8425-4f5a-b60b-8f1fafbef2c1 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:12.442166 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6117e041-8425-4f5a-b60b-8f1fafbef2c1 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:12.446672 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6117e041-8425-4f5a-b60b-8f1fafbef2c1 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:12.447879 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6117e041-8425-4f5a-b60b-8f1fafbef2c1 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793" status: 200 len: 1812 microversion: 2.25 time: 0.480650 Oct 18 15:30:12.458879 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 755/1472] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:11 2022] GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793 => generated 1812 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:30:12.733672 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-197c4db2-2f1b-4ab3-a744-a5b71479ed9b tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:12.734462 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-197c4db2-2f1b-4ab3-a744-a5b71479ed9b tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 40097653-662f-4191-983d-881387af06a8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:12.748614 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-197c4db2-2f1b-4ab3-a744-a5b71479ed9b tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:12.751482 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-197c4db2-2f1b-4ab3-a744-a5b71479ed9b tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:12.752201 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-197c4db2-2f1b-4ab3-a744-a5b71479ed9b tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:12.754120 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-197c4db2-2f1b-4ab3-a744-a5b71479ed9b tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:12.756679 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-197c4db2-2f1b-4ab3-a744-a5b71479ed9b tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:12.757515 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-197c4db2-2f1b-4ab3-a744-a5b71479ed9b tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:13.211748 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f27ec437-505d-4fac-9a83-22a27076a1e3 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe80f2ae3ec4365a031ca7472d76e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df909cb429f46c39a83c29fb260b169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:13.222070 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f27ec437-505d-4fac-9a83-22a27076a1e3 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] 10.222.0.60 "GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581" status: 200 len: 1318 microversion: 2.1 time: 0.997890 Oct 18 15:30:13.222678 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 718/1473] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:12 2022] GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581 => generated 1318 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:13.265006 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-347e1569-c3ad-44cf-af67-475e0c097c10 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:13.267271 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-347e1569-c3ad-44cf-af67-475e0c097c10 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:13.276193 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-347e1569-c3ad-44cf-af67-475e0c097c10 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:13.277145 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-347e1569-c3ad-44cf-af67-475e0c097c10 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:13.277760 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-347e1569-c3ad-44cf-af67-475e0c097c10 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:13.280073 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-347e1569-c3ad-44cf-af67-475e0c097c10 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:13.280543 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-347e1569-c3ad-44cf-af67-475e0c097c10 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:13.281181 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-347e1569-c3ad-44cf-af67-475e0c097c10 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:13.485832 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-347e1569-c3ad-44cf-af67-475e0c097c10 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:13.503435 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-347e1569-c3ad-44cf-af67-475e0c097c10 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:13.504163 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-197c4db2-2f1b-4ab3-a744-a5b71479ed9b tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:13.513978 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-197c4db2-2f1b-4ab3-a744-a5b71479ed9b tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8" status: 200 len: 1316 microversion: 2.1 time: 0.784486 Oct 18 15:30:13.514900 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-347e1569-c3ad-44cf-af67-475e0c097c10 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:13.516004 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 756/1474] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:12 2022] GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8 => generated 1316 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:30:13.522153 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-540f87a9-cff2-4ab5-9c55-0ed7a4f65d75 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:13.524031 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-540f87a9-cff2-4ab5-9c55-0ed7a4f65d75 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 4b959d9f-3c8e-44ef-92f1-83cfb8e04804] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:13.538127 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-347e1569-c3ad-44cf-af67-475e0c097c10 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1539 microversion: 2.91 time: 0.295762 Oct 18 15:30:13.539023 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 719/1475] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:13 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1539 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:30:13.543713 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-eb988c28-3576-4b8d-9edb-ef8e4fd52d8e tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:13.553786 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-eb988c28-3576-4b8d-9edb-ef8e4fd52d8e tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:13.568127 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-540f87a9-cff2-4ab5-9c55-0ed7a4f65d75 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:13.568544 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eb988c28-3576-4b8d-9edb-ef8e4fd52d8e tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:13.569172 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-540f87a9-cff2-4ab5-9c55-0ed7a4f65d75 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:13.572132 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-540f87a9-cff2-4ab5-9c55-0ed7a4f65d75 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:13.575506 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eb988c28-3576-4b8d-9edb-ef8e4fd52d8e tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:13.575722 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-540f87a9-cff2-4ab5-9c55-0ed7a4f65d75 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:13.575860 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eb988c28-3576-4b8d-9edb-ef8e4fd52d8e tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:13.576501 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-540f87a9-cff2-4ab5-9c55-0ed7a4f65d75 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:13.577172 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-540f87a9-cff2-4ab5-9c55-0ed7a4f65d75 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:13.579884 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eb988c28-3576-4b8d-9edb-ef8e4fd52d8e tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:13.580464 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eb988c28-3576-4b8d-9edb-ef8e4fd52d8e tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:13.580878 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eb988c28-3576-4b8d-9edb-ef8e4fd52d8e tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:14.031468 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-eb988c28-3576-4b8d-9edb-ef8e4fd52d8e tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:14.045395 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-eb988c28-3576-4b8d-9edb-ef8e4fd52d8e tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:14.047405 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-540f87a9-cff2-4ab5-9c55-0ed7a4f65d75 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:14.053213 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-eb988c28-3576-4b8d-9edb-ef8e4fd52d8e tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:14.057318 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-eb988c28-3576-4b8d-9edb-ef8e4fd52d8e tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793" status: 200 len: 1812 microversion: 2.25 time: 0.517139 Oct 18 15:30:14.061974 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-540f87a9-cff2-4ab5-9c55-0ed7a4f65d75 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804" status: 200 len: 1493 microversion: 2.1 time: 0.544724 Oct 18 15:30:14.062277 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 720/1476] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:13 2022] GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793 => generated 1812 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:30:14.062768 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 757/1477] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:13 2022] GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804 => generated 1493 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:14.250257 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-48953293-7698-4600-998e-43d4438b5a9c tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:14.251251 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-48953293-7698-4600-998e-43d4438b5a9c tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] [instance: 74e5ae75-9c35-4610-9cb5-61afa6f98581] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:14.265590 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-48953293-7698-4600-998e-43d4438b5a9c tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:14.268721 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-48953293-7698-4600-998e-43d4438b5a9c tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:14.269453 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-48953293-7698-4600-998e-43d4438b5a9c tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:14.270669 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-48953293-7698-4600-998e-43d4438b5a9c tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:14.271472 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-48953293-7698-4600-998e-43d4438b5a9c tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:14.272764 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-48953293-7698-4600-998e-43d4438b5a9c tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:14.541154 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7ec820d4-2884-4131-bbc9-9fa7b9b3660a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:14.542277 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7ec820d4-2884-4131-bbc9-9fa7b9b3660a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 40097653-662f-4191-983d-881387af06a8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:14.604105 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ec820d4-2884-4131-bbc9-9fa7b9b3660a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:14.606983 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ec820d4-2884-4131-bbc9-9fa7b9b3660a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:14.608093 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ec820d4-2884-4131-bbc9-9fa7b9b3660a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:14.610519 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ec820d4-2884-4131-bbc9-9fa7b9b3660a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:14.611598 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ec820d4-2884-4131-bbc9-9fa7b9b3660a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:14.612597 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ec820d4-2884-4131-bbc9-9fa7b9b3660a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:14.708481 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-48953293-7698-4600-998e-43d4438b5a9c tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe80f2ae3ec4365a031ca7472d76e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df909cb429f46c39a83c29fb260b169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:14.726490 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-48953293-7698-4600-998e-43d4438b5a9c tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] 10.222.0.60 "GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581" status: 200 len: 1318 microversion: 2.1 time: 0.480799 Oct 18 15:30:14.728564 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 721/1478] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:14 2022] GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581 => generated 1318 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:14.735835 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ebe76caf-4ad7-4920-a032-089793790799 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:14.736757 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ebe76caf-4ad7-4920-a032-089793790799 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:14.761078 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ebe76caf-4ad7-4920-a032-089793790799 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:14.765475 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ebe76caf-4ad7-4920-a032-089793790799 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:14.765938 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ebe76caf-4ad7-4920-a032-089793790799 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:14.766909 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ebe76caf-4ad7-4920-a032-089793790799 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:14.767384 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ebe76caf-4ad7-4920-a032-089793790799 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:14.767818 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ebe76caf-4ad7-4920-a032-089793790799 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:15.162970 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7ec820d4-2884-4131-bbc9-9fa7b9b3660a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:15.203303 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7ec820d4-2884-4131-bbc9-9fa7b9b3660a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8" status: 200 len: 1316 microversion: 2.1 time: 0.657768 Oct 18 15:30:15.225323 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 758/1479] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:14 2022] GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8 => generated 1316 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:15.248093 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e9186157-367e-44d3-b280-3519275e1aea tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:15.261639 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e9186157-367e-44d3-b280-3519275e1aea tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 4b959d9f-3c8e-44ef-92f1-83cfb8e04804] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:15.284874 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e9186157-367e-44d3-b280-3519275e1aea tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:15.286348 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e9186157-367e-44d3-b280-3519275e1aea tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:15.289476 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e9186157-367e-44d3-b280-3519275e1aea tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:15.293872 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e9186157-367e-44d3-b280-3519275e1aea tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:15.294580 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e9186157-367e-44d3-b280-3519275e1aea tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:15.296474 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e9186157-367e-44d3-b280-3519275e1aea tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:15.802651 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ebe76caf-4ad7-4920-a032-089793790799 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:15.820452 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ebe76caf-4ad7-4920-a032-089793790799 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:15.822072 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ebe76caf-4ad7-4920-a032-089793790799 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:15.846096 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ebe76caf-4ad7-4920-a032-089793790799 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1560 microversion: 2.91 time: 1.113820 Oct 18 15:30:15.847168 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 722/1480] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:14 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1560 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:30:15.861450 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5de22364-30d5-4259-9ed1-9274895067e7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:15.865614 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5de22364-30d5-4259-9ed1-9274895067e7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:15.903055 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5de22364-30d5-4259-9ed1-9274895067e7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:15.905563 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5de22364-30d5-4259-9ed1-9274895067e7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:15.911061 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5de22364-30d5-4259-9ed1-9274895067e7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:15.914260 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5de22364-30d5-4259-9ed1-9274895067e7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:15.915193 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5de22364-30d5-4259-9ed1-9274895067e7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:15.915830 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5de22364-30d5-4259-9ed1-9274895067e7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:16.245544 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e9186157-367e-44d3-b280-3519275e1aea tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:16.262690 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e9186157-367e-44d3-b280-3519275e1aea tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804" status: 200 len: 1493 microversion: 2.1 time: 1.036125 Oct 18 15:30:16.288055 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 759/1481] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:15 2022] GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804 => generated 1493 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:16.312549 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-28c3632f-577f-4b48-ba1b-0825041f5dce tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:16.314501 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-28c3632f-577f-4b48-ba1b-0825041f5dce tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] [instance: 74e5ae75-9c35-4610-9cb5-61afa6f98581] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:16.337537 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-28c3632f-577f-4b48-ba1b-0825041f5dce tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:16.341791 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-28c3632f-577f-4b48-ba1b-0825041f5dce tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:16.343764 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-28c3632f-577f-4b48-ba1b-0825041f5dce tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:16.349650 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-28c3632f-577f-4b48-ba1b-0825041f5dce tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:16.354066 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-28c3632f-577f-4b48-ba1b-0825041f5dce tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:16.355595 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-28c3632f-577f-4b48-ba1b-0825041f5dce tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:16.432023 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5de22364-30d5-4259-9ed1-9274895067e7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:16.473109 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5de22364-30d5-4259-9ed1-9274895067e7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:16.479600 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5de22364-30d5-4259-9ed1-9274895067e7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:16.484329 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5de22364-30d5-4259-9ed1-9274895067e7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793" status: 200 len: 1812 microversion: 2.25 time: 0.630198 Oct 18 15:30:16.507165 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 723/1482] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:15 2022] GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793 => generated 1812 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:30:16.524204 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-b543c4bd-3974-44e6-adca-1890a20b5f97 req-35e53142-c60f-4759-ad68-24e513c592c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b959d9f-3c8e-44ef-92f1-83cfb8e04804", "name": "network-vif-deleted", "tag": "497df88b-7ec7-4c49-ac83-b558f8c280b3"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:30:16.539409 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-b543c4bd-3974-44e6-adca-1890a20b5f97 req-35e53142-c60f-4759-ad68-24e513c592c8 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:16.540250 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-b543c4bd-3974-44e6-adca-1890a20b5f97 req-35e53142-c60f-4759-ad68-24e513c592c8 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:16.540893 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-b543c4bd-3974-44e6-adca-1890a20b5f97 req-35e53142-c60f-4759-ad68-24e513c592c8 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:16.563789 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-b543c4bd-3974-44e6-adca-1890a20b5f97 req-35e53142-c60f-4759-ad68-24e513c592c8 service nova] Creating event network-vif-deleted:497df88b-7ec7-4c49-ac83-b558f8c280b3 for instance 4b959d9f-3c8e-44ef-92f1-83cfb8e04804 on n-h1-853682-5 Oct 18 15:30:16.576264 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-b543c4bd-3974-44e6-adca-1890a20b5f97 req-35e53142-c60f-4759-ad68-24e513c592c8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066624 Oct 18 15:30:16.577852 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 724/1483] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:30:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:30:16.593924 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b32e737e-33bc-4636-b8a3-58d55f7340d0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:16.594709 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b32e737e-33bc-4636-b8a3-58d55f7340d0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 40097653-662f-4191-983d-881387af06a8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:16.605638 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b32e737e-33bc-4636-b8a3-58d55f7340d0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:16.606419 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b32e737e-33bc-4636-b8a3-58d55f7340d0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:16.607034 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b32e737e-33bc-4636-b8a3-58d55f7340d0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:16.608136 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b32e737e-33bc-4636-b8a3-58d55f7340d0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:16.608770 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b32e737e-33bc-4636-b8a3-58d55f7340d0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:16.609385 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b32e737e-33bc-4636-b8a3-58d55f7340d0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:16.780856 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-28c3632f-577f-4b48-ba1b-0825041f5dce tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe80f2ae3ec4365a031ca7472d76e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df909cb429f46c39a83c29fb260b169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:16.798831 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-28c3632f-577f-4b48-ba1b-0825041f5dce tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] 10.222.0.60 "GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581" status: 200 len: 1468 microversion: 2.1 time: 0.508695 Oct 18 15:30:16.799221 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 760/1484] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:16 2022] GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581 => generated 1468 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:16.813718 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-1ccbf851-717d-4b62-983a-7a5f0e17b2b1 req-69c2d1c1-9178-43bb-8b5d-6f4909deaa39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40097653-662f-4191-983d-881387af06a8", "name": "network-vif-plugged", "status": "completed", "tag": "4da77dc8-5cc4-4661-bd00-573bf094fde7"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:30:16.850149 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1ccbf851-717d-4b62-983a-7a5f0e17b2b1 req-69c2d1c1-9178-43bb-8b5d-6f4909deaa39 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:16.853018 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1ccbf851-717d-4b62-983a-7a5f0e17b2b1 req-69c2d1c1-9178-43bb-8b5d-6f4909deaa39 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:16.853519 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1ccbf851-717d-4b62-983a-7a5f0e17b2b1 req-69c2d1c1-9178-43bb-8b5d-6f4909deaa39 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:16.873656 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b32e737e-33bc-4636-b8a3-58d55f7340d0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:16.884478 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b32e737e-33bc-4636-b8a3-58d55f7340d0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8" status: 200 len: 1316 microversion: 2.1 time: 0.305070 Oct 18 15:30:16.885562 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 725/1485] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:16 2022] GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8 => generated 1316 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:16.903711 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-1ccbf851-717d-4b62-983a-7a5f0e17b2b1 req-69c2d1c1-9178-43bb-8b5d-6f4909deaa39 service nova] Creating event network-vif-plugged:4da77dc8-5cc4-4661-bd00-573bf094fde7 for instance 40097653-662f-4191-983d-881387af06a8 on n-h1-853682-5 Oct 18 15:30:16.907807 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-1ccbf851-717d-4b62-983a-7a5f0e17b2b1 req-69c2d1c1-9178-43bb-8b5d-6f4909deaa39 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099371 Oct 18 15:30:16.910006 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-77fe6401-819f-468b-a09d-932d5f346353 tempest-LiveMigrationNegativeTest-41355881 tempest-LiveMigrationNegativeTest-41355881-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:30:16.911190 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-77fe6401-819f-468b-a09d-932d5f346353 tempest-LiveMigrationNegativeTest-41355881 tempest-LiveMigrationNegativeTest-41355881-project-admin] [instance: 74e5ae75-9c35-4610-9cb5-61afa6f98581] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:16.918524 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 761/1486] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:30:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:30:16.919366 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-77fe6401-819f-468b-a09d-932d5f346353 tempest-LiveMigrationNegativeTest-41355881 tempest-LiveMigrationNegativeTest-41355881-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:16.920289 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-77fe6401-819f-468b-a09d-932d5f346353 tempest-LiveMigrationNegativeTest-41355881 tempest-LiveMigrationNegativeTest-41355881-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:16.920937 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-77fe6401-819f-468b-a09d-932d5f346353 tempest-LiveMigrationNegativeTest-41355881 tempest-LiveMigrationNegativeTest-41355881-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:16.921841 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-77fe6401-819f-468b-a09d-932d5f346353 tempest-LiveMigrationNegativeTest-41355881 tempest-LiveMigrationNegativeTest-41355881-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:16.922469 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-77fe6401-819f-468b-a09d-932d5f346353 tempest-LiveMigrationNegativeTest-41355881 tempest-LiveMigrationNegativeTest-41355881-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:16.923687 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-77fe6401-819f-468b-a09d-932d5f346353 tempest-LiveMigrationNegativeTest-41355881 tempest-LiveMigrationNegativeTest-41355881-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:16.943575 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e78a83fb-bc0d-4c87-a517-7fd8fbb8e8ea tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:16.944317 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e78a83fb-bc0d-4c87-a517-7fd8fbb8e8ea tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:16.955810 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e78a83fb-bc0d-4c87-a517-7fd8fbb8e8ea tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:16.957019 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e78a83fb-bc0d-4c87-a517-7fd8fbb8e8ea tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:16.957439 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e78a83fb-bc0d-4c87-a517-7fd8fbb8e8ea tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:16.958144 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e78a83fb-bc0d-4c87-a517-7fd8fbb8e8ea tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:16.958589 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e78a83fb-bc0d-4c87-a517-7fd8fbb8e8ea tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:16.961459 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e78a83fb-bc0d-4c87-a517-7fd8fbb8e8ea tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:16.972764 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-77fe6401-819f-468b-a09d-932d5f346353 tempest-LiveMigrationNegativeTest-41355881 tempest-LiveMigrationNegativeTest-41355881-project-admin] Lazy-loading 'flavor' on Instance uuid 74e5ae75-9c35-4610-9cb5-61afa6f98581 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:30:17.109765 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-77fe6401-819f-468b-a09d-932d5f346353 tempest-LiveMigrationNegativeTest-41355881 tempest-LiveMigrationNegativeTest-41355881-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581/action" status: 202 len: 0 microversion: 2.1 time: 0.211449 Oct 18 15:30:17.111127 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 726/1487] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:30:16 2022] POST /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:30:17.136599 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-44ebd054-29de-4c66-ba11-96e00af55f06 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:17.136599 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-44ebd054-29de-4c66-ba11-96e00af55f06 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] [instance: 74e5ae75-9c35-4610-9cb5-61afa6f98581] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:17.145754 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-44ebd054-29de-4c66-ba11-96e00af55f06 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:17.149663 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-44ebd054-29de-4c66-ba11-96e00af55f06 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:17.150128 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-44ebd054-29de-4c66-ba11-96e00af55f06 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:17.151333 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-44ebd054-29de-4c66-ba11-96e00af55f06 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:17.151812 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-44ebd054-29de-4c66-ba11-96e00af55f06 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:17.152242 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-44ebd054-29de-4c66-ba11-96e00af55f06 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:17.211294 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e78a83fb-bc0d-4c87-a517-7fd8fbb8e8ea tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:17.232933 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e78a83fb-bc0d-4c87-a517-7fd8fbb8e8ea tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:17.236385 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e78a83fb-bc0d-4c87-a517-7fd8fbb8e8ea tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:17.270824 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e78a83fb-bc0d-4c87-a517-7fd8fbb8e8ea tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1560 microversion: 2.91 time: 0.349968 Oct 18 15:30:17.278638 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 762/1488] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:16 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1560 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:30:17.291643 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5ca35253-e441-4bc5-9345-41ad24c5afda tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:17.292477 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5ca35253-e441-4bc5-9345-41ad24c5afda tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 4b959d9f-3c8e-44ef-92f1-83cfb8e04804] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:17.299253 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ca35253-e441-4bc5-9345-41ad24c5afda tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:17.306822 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ca35253-e441-4bc5-9345-41ad24c5afda tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:17.307526 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ca35253-e441-4bc5-9345-41ad24c5afda tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:17.308428 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ca35253-e441-4bc5-9345-41ad24c5afda tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:17.309061 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ca35253-e441-4bc5-9345-41ad24c5afda tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:17.309702 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ca35253-e441-4bc5-9345-41ad24c5afda tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:17.376871 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ca35253-e441-4bc5-9345-41ad24c5afda tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:17.378504 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ca35253-e441-4bc5-9345-41ad24c5afda tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:17.379161 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ca35253-e441-4bc5-9345-41ad24c5afda tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:17.379795 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-5ca35253-e441-4bc5-9345-41ad24c5afda tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lazy-loading 'fault' on Instance uuid 4b959d9f-3c8e-44ef-92f1-83cfb8e04804 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:30:17.467487 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5ca35253-e441-4bc5-9345-41ad24c5afda tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:17.481808 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5ca35253-e441-4bc5-9345-41ad24c5afda tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804" status: 200 len: 1297 microversion: 2.1 time: 0.194126 Oct 18 15:30:17.497819 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 763/1489] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:17 2022] GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804 => generated 1297 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:30:17.509245 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-44ebd054-29de-4c66-ba11-96e00af55f06 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe80f2ae3ec4365a031ca7472d76e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df909cb429f46c39a83c29fb260b169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:17.514052 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:30:17.533243 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-44ebd054-29de-4c66-ba11-96e00af55f06 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] 10.222.0.60 "GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581" status: 200 len: 1476 microversion: 2.1 time: 0.408610 Oct 18 15:30:17.536793 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 727/1490] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:17 2022] GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581 => generated 1476 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:30:17.691827 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-01e97f35-fba8-48ad-9f96-7274047228d5 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:17.692878 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-01e97f35-fba8-48ad-9f96-7274047228d5 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:17.701126 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01e97f35-fba8-48ad-9f96-7274047228d5 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:17.701821 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01e97f35-fba8-48ad-9f96-7274047228d5 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:17.702770 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01e97f35-fba8-48ad-9f96-7274047228d5 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:17.704074 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01e97f35-fba8-48ad-9f96-7274047228d5 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:17.704694 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01e97f35-fba8-48ad-9f96-7274047228d5 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:17.705735 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01e97f35-fba8-48ad-9f96-7274047228d5 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:17.877298 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-01e97f35-fba8-48ad-9f96-7274047228d5 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:17.891623 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-01e97f35-fba8-48ad-9f96-7274047228d5 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:17.896346 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-01e97f35-fba8-48ad-9f96-7274047228d5 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:17.898104 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-01e97f35-fba8-48ad-9f96-7274047228d5 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793" status: 200 len: 1812 microversion: 2.25 time: 0.382314 Oct 18 15:30:17.899609 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 764/1491] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:17 2022] GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793 => generated 1812 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:30:17.920509 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-83719492-6bf8-4a8a-be1a-28400c988a90 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:17.922239 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-83719492-6bf8-4a8a-be1a-28400c988a90 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 40097653-662f-4191-983d-881387af06a8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:17.942052 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:30:17.943796 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-83719492-6bf8-4a8a-be1a-28400c988a90 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:17.950934 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-83719492-6bf8-4a8a-be1a-28400c988a90 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:17.951655 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-83719492-6bf8-4a8a-be1a-28400c988a90 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:17.953060 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-83719492-6bf8-4a8a-be1a-28400c988a90 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:17.953679 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-83719492-6bf8-4a8a-be1a-28400c988a90 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:17.954280 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-83719492-6bf8-4a8a-be1a-28400c988a90 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:18.260596 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-83719492-6bf8-4a8a-be1a-28400c988a90 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:18.273390 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-83719492-6bf8-4a8a-be1a-28400c988a90 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8" status: 200 len: 1316 microversion: 2.1 time: 0.357582 Oct 18 15:30:18.274995 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 728/1492] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:17 2022] GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8 => generated 1316 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:18.309669 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-44b586fc-36b9-444d-ab18-ff84a011a487 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:18.310268 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-44b586fc-36b9-444d-ab18-ff84a011a487 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:18.328494 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44b586fc-36b9-444d-ab18-ff84a011a487 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:18.329308 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44b586fc-36b9-444d-ab18-ff84a011a487 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:18.329726 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44b586fc-36b9-444d-ab18-ff84a011a487 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:18.330441 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44b586fc-36b9-444d-ab18-ff84a011a487 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:18.331441 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44b586fc-36b9-444d-ab18-ff84a011a487 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:18.331874 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44b586fc-36b9-444d-ab18-ff84a011a487 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:18.336934 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:30:18.438447 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-44b586fc-36b9-444d-ab18-ff84a011a487 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:18.452111 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-44b586fc-36b9-444d-ab18-ff84a011a487 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:18.454636 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-44b586fc-36b9-444d-ab18-ff84a011a487 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:18.462057 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-44b586fc-36b9-444d-ab18-ff84a011a487 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1560 microversion: 2.91 time: 0.157850 Oct 18 15:30:18.463301 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 765/1493] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:18 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:30:18.507588 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2bbb3572-1ffa-4e13-862d-cdaa0e88dcc3 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:18.508329 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2bbb3572-1ffa-4e13-862d-cdaa0e88dcc3 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 4b959d9f-3c8e-44ef-92f1-83cfb8e04804] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:18.521248 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2bbb3572-1ffa-4e13-862d-cdaa0e88dcc3 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:18.521777 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2bbb3572-1ffa-4e13-862d-cdaa0e88dcc3 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:18.522232 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2bbb3572-1ffa-4e13-862d-cdaa0e88dcc3 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:18.523416 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2bbb3572-1ffa-4e13-862d-cdaa0e88dcc3 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:18.523416 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2bbb3572-1ffa-4e13-862d-cdaa0e88dcc3 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:18.523820 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2bbb3572-1ffa-4e13-862d-cdaa0e88dcc3 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:18.560159 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e434ee57-3d34-417a-9b0f-a389c1819773 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:18.560975 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e434ee57-3d34-417a-9b0f-a389c1819773 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] [instance: 74e5ae75-9c35-4610-9cb5-61afa6f98581] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:18.575177 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e434ee57-3d34-417a-9b0f-a389c1819773 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:18.575948 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e434ee57-3d34-417a-9b0f-a389c1819773 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:18.576565 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e434ee57-3d34-417a-9b0f-a389c1819773 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:18.577774 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e434ee57-3d34-417a-9b0f-a389c1819773 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:18.578920 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e434ee57-3d34-417a-9b0f-a389c1819773 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:18.579508 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e434ee57-3d34-417a-9b0f-a389c1819773 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:18.592528 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2bbb3572-1ffa-4e13-862d-cdaa0e88dcc3 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:18.594088 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2bbb3572-1ffa-4e13-862d-cdaa0e88dcc3 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:18.595329 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2bbb3572-1ffa-4e13-862d-cdaa0e88dcc3 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:18.596711 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-2bbb3572-1ffa-4e13-862d-cdaa0e88dcc3 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lazy-loading 'fault' on Instance uuid 4b959d9f-3c8e-44ef-92f1-83cfb8e04804 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:30:18.689772 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2bbb3572-1ffa-4e13-862d-cdaa0e88dcc3 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:18.705603 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2bbb3572-1ffa-4e13-862d-cdaa0e88dcc3 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804" status: 200 len: 1297 microversion: 2.1 time: 0.202137 Oct 18 15:30:18.707424 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 729/1494] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:18 2022] GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804 => generated 1297 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:18.916322 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e434ee57-3d34-417a-9b0f-a389c1819773 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe80f2ae3ec4365a031ca7472d76e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df909cb429f46c39a83c29fb260b169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:18.929968 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e434ee57-3d34-417a-9b0f-a389c1819773 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] 10.222.0.60 "GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581" status: 200 len: 1459 microversion: 2.1 time: 0.375089 Oct 18 15:30:18.933540 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ecdf9449-99eb-4d21-ae1d-3ab7e94e59db tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:18.935374 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ecdf9449-99eb-4d21-ae1d-3ab7e94e59db tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:18.945929 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 766/1495] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:18 2022] GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581 => generated 1459 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:30:18.949907 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ecdf9449-99eb-4d21-ae1d-3ab7e94e59db tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:18.951790 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ecdf9449-99eb-4d21-ae1d-3ab7e94e59db tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:18.953537 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ecdf9449-99eb-4d21-ae1d-3ab7e94e59db tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:18.954538 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ecdf9449-99eb-4d21-ae1d-3ab7e94e59db tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:18.955228 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ecdf9449-99eb-4d21-ae1d-3ab7e94e59db tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:18.956359 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-db820327-5651-4453-a881-019feabd097c tempest-LiveMigrationNegativeTest-41355881 tempest-LiveMigrationNegativeTest-41355881-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:18.957612 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-db820327-5651-4453-a881-019feabd097c tempest-LiveMigrationNegativeTest-41355881 tempest-LiveMigrationNegativeTest-41355881-project-admin] [instance: 74e5ae75-9c35-4610-9cb5-61afa6f98581] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:18.957754 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ecdf9449-99eb-4d21-ae1d-3ab7e94e59db tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:18.965340 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db820327-5651-4453-a881-019feabd097c tempest-LiveMigrationNegativeTest-41355881 tempest-LiveMigrationNegativeTest-41355881-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:18.966248 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db820327-5651-4453-a881-019feabd097c tempest-LiveMigrationNegativeTest-41355881 tempest-LiveMigrationNegativeTest-41355881-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:18.966938 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db820327-5651-4453-a881-019feabd097c tempest-LiveMigrationNegativeTest-41355881 tempest-LiveMigrationNegativeTest-41355881-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:18.970344 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db820327-5651-4453-a881-019feabd097c tempest-LiveMigrationNegativeTest-41355881 tempest-LiveMigrationNegativeTest-41355881-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:18.970937 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db820327-5651-4453-a881-019feabd097c tempest-LiveMigrationNegativeTest-41355881 tempest-LiveMigrationNegativeTest-41355881-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:18.972233 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db820327-5651-4453-a881-019feabd097c tempest-LiveMigrationNegativeTest-41355881 tempest-LiveMigrationNegativeTest-41355881-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:19.302496 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ecdf9449-99eb-4d21-ae1d-3ab7e94e59db tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:19.316001 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ecdf9449-99eb-4d21-ae1d-3ab7e94e59db tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:19.318525 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ecdf9449-99eb-4d21-ae1d-3ab7e94e59db tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:19.322560 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ecdf9449-99eb-4d21-ae1d-3ab7e94e59db tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793" status: 200 len: 1812 microversion: 2.25 time: 0.395205 Oct 18 15:30:19.323822 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 730/1496] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:18 2022] GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793 => generated 1812 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:30:19.330811 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5791ac49-acfa-46bf-880b-e3c13e4852c7 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:19.333427 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5791ac49-acfa-46bf-880b-e3c13e4852c7 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 40097653-662f-4191-983d-881387af06a8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:19.346419 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5791ac49-acfa-46bf-880b-e3c13e4852c7 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:19.347275 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5791ac49-acfa-46bf-880b-e3c13e4852c7 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:19.348640 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5791ac49-acfa-46bf-880b-e3c13e4852c7 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:19.349709 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5791ac49-acfa-46bf-880b-e3c13e4852c7 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:19.352458 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5791ac49-acfa-46bf-880b-e3c13e4852c7 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:19.356471 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5791ac49-acfa-46bf-880b-e3c13e4852c7 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:19.775549 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5791ac49-acfa-46bf-880b-e3c13e4852c7 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:19.787458 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5791ac49-acfa-46bf-880b-e3c13e4852c7 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8" status: 200 len: 1466 microversion: 2.1 time: 0.461330 Oct 18 15:30:19.788115 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 731/1497] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:19 2022] GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8 => generated 1466 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:19.794206 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4237df27-5b1e-471e-ada3-21abf5eace87 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:19.795059 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4237df27-5b1e-471e-ada3-21abf5eace87 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:19.819722 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4237df27-5b1e-471e-ada3-21abf5eace87 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:19.821100 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4237df27-5b1e-471e-ada3-21abf5eace87 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:19.822608 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4237df27-5b1e-471e-ada3-21abf5eace87 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:19.824526 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4237df27-5b1e-471e-ada3-21abf5eace87 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:19.825304 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4237df27-5b1e-471e-ada3-21abf5eace87 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:19.825953 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4237df27-5b1e-471e-ada3-21abf5eace87 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:19.951848 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-db820327-5651-4453-a881-019feabd097c tempest-LiveMigrationNegativeTest-41355881 tempest-LiveMigrationNegativeTest-41355881-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581" status: 200 len: 1610 microversion: 2.1 time: 1.000885 Oct 18 15:30:19.954631 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 767/1498] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:18 2022] GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581 => generated 1610 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:19.965464 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4237df27-5b1e-471e-ada3-21abf5eace87 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:19.986351 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-642cf284-b911-41b0-b748-b2414c659d2c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:19.988295 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-642cf284-b911-41b0-b748-b2414c659d2c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 4b959d9f-3c8e-44ef-92f1-83cfb8e04804] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:20.005968 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4237df27-5b1e-471e-ada3-21abf5eace87 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:20.008470 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4237df27-5b1e-471e-ada3-21abf5eace87 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:20.015354 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-642cf284-b911-41b0-b748-b2414c659d2c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:20.016513 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-642cf284-b911-41b0-b748-b2414c659d2c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:20.017575 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-642cf284-b911-41b0-b748-b2414c659d2c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:20.021018 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-642cf284-b911-41b0-b748-b2414c659d2c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:20.022314 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-642cf284-b911-41b0-b748-b2414c659d2c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:20.024435 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-642cf284-b911-41b0-b748-b2414c659d2c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:20.038833 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4237df27-5b1e-471e-ada3-21abf5eace87 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1555 microversion: 2.91 time: 0.249001 Oct 18 15:30:20.045203 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 732/1499] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:19 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1555 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:30:20.058516 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9d6884b9-5c82-4046-9360-0714eec3230a tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:20.059443 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9d6884b9-5c82-4046-9360-0714eec3230a tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] [instance: 40097653-662f-4191-983d-881387af06a8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:20.071392 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-642cf284-b911-41b0-b748-b2414c659d2c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] HTTP exception thrown: Instance 4b959d9f-3c8e-44ef-92f1-83cfb8e04804 could not be found. Oct 18 15:30:20.079105 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-642cf284-b911-41b0-b748-b2414c659d2c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Request method failure captured: Oct 18 15:30:20.079105 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804 HTTP/1.1 Oct 18 15:30:20.079105 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:30:20.079105 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:30:20.079105 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:30:20.079105 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:30:20.079105 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:30:20.079105 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:30:20.079105 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:30:20.079105 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:30:20.079105 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsVPb3L3FP-98gtLv8YIMCLfGhe2cuyCUoKBkQOJf_VQrrdw3zjQkBJXdrz51U5RIPirvM4vBy0eEwDlKKADnhe_mWPayJHcQ6gOCTAUKl7bKbkNPv5luVRbp4n9QMAAUTtxVS9n4JhIyNIlSMcaFy8kvjpV-EFu6g7N-rErWpfgdCw Oct 18 15:30:20.079105 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:30:20.079105 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:30:20.079105 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:30:20.079105 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:30:20.079105 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:30:20.079105 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:30:20.079105 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: ee0a3f0c256544beb2df4f113da56137 Oct 18 15:30:20.079105 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ImagesTestJSON-180911091 Oct 18 15:30:20.079105 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:30:20.079105 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:30:20.082261 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:30:20.082261 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ImagesTestJSON-180911091 Oct 18 15:30:20.082261 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: ee0a3f0c256544beb2df4f113da56137 Oct 18 15:30:20.082261 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ImagesTestJSON-180911091 Oct 18 15:30:20.082261 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ImagesTestJSON-180911091-project Oct 18 15:30:20.082261 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:30:20.082261 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:30:20.082261 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: ed9cd936192c40efa9099edee445e90e Oct 18 15:30:20.082261 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ImagesTestJSON-180911091-project Oct 18 15:30:20.082261 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:30:20.082261 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 4b959d9f-3c8e-44ef-92f1-83cfb8e04804 could not be found. Oct 18 15:30:20.082261 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '4b959d9f-3c8e-44ef-92f1-83cfb8e04804'} Oct 18 15:30:20.084628 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:30:20.084628 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:30:20.084628 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:30:20.084628 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:30:20.084628 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:30:20.084628 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:30:20.084628 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:30:20.084628 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:30:20.084628 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:30:20.084628 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:30:20.084628 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b959d9f-3c8e-44ef-92f1-83cfb8e04804 could not be found. Oct 18 15:30:20.084628 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:30:20.084628 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:30:20.084628 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:30:20.084628 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:30:20.084628 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:30:20.084628 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:30:20.084628 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:30:20.084628 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:30:20.084628 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:30:20.094053 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:30:20.094053 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:30:20.094053 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:30:20.094053 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:30:20.094053 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:30:20.094053 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:30:20.094053 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:30:20.094053 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b959d9f-3c8e-44ef-92f1-83cfb8e04804 could not be found. Oct 18 15:30:20.094053 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:30:20.094053 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:30:20.094053 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:30:20.094053 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:30:20.094053 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:30:20.094053 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:30:20.094053 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:30:20.094053 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:30:20.094053 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b959d9f-3c8e-44ef-92f1-83cfb8e04804 could not be found. Oct 18 15:30:20.094053 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:30:20.097612 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9d6884b9-5c82-4046-9360-0714eec3230a tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:20.097612 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9d6884b9-5c82-4046-9360-0714eec3230a tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:20.097612 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9d6884b9-5c82-4046-9360-0714eec3230a tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:20.097612 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9d6884b9-5c82-4046-9360-0714eec3230a tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:20.100233 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-642cf284-b911-41b0-b748-b2414c659d2c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Returning 404 to user: Instance 4b959d9f-3c8e-44ef-92f1-83cfb8e04804 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:30:20.101980 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-642cf284-b911-41b0-b748-b2414c659d2c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804" status: 404 len: 111 microversion: 2.1 time: 0.130103 Oct 18 15:30:20.102750 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9d6884b9-5c82-4046-9360-0714eec3230a tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:20.103822 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9d6884b9-5c82-4046-9360-0714eec3230a tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:20.105312 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 768/1500] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:19 2022] GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804 => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:30:20.120877 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d97c29a4-b42c-4082-b2df-e9186187902e tempest-LiveMigrationNegativeTest-41355881 tempest-LiveMigrationNegativeTest-41355881-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:20.128543 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d97c29a4-b42c-4082-b2df-e9186187902e tempest-LiveMigrationNegativeTest-41355881 tempest-LiveMigrationNegativeTest-41355881-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:20.129777 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d97c29a4-b42c-4082-b2df-e9186187902e tempest-LiveMigrationNegativeTest-41355881 tempest-LiveMigrationNegativeTest-41355881-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:20.130750 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d97c29a4-b42c-4082-b2df-e9186187902e tempest-LiveMigrationNegativeTest-41355881 tempest-LiveMigrationNegativeTest-41355881-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:20.132962 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d97c29a4-b42c-4082-b2df-e9186187902e tempest-LiveMigrationNegativeTest-41355881 tempest-LiveMigrationNegativeTest-41355881-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:20.134022 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d97c29a4-b42c-4082-b2df-e9186187902e tempest-LiveMigrationNegativeTest-41355881 tempest-LiveMigrationNegativeTest-41355881-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:20.134942 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d97c29a4-b42c-4082-b2df-e9186187902e tempest-LiveMigrationNegativeTest-41355881 tempest-LiveMigrationNegativeTest-41355881-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:20.173280 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:30:20.185861 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d97c29a4-b42c-4082-b2df-e9186187902e tempest-LiveMigrationNegativeTest-41355881 tempest-LiveMigrationNegativeTest-41355881-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.075218 Oct 18 15:30:20.187511 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 769/1501] 10.222.0.60 () {58 vars in 1176 bytes} [Tue Oct 18 15:30:20 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:30:20.195114 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e462f15f-11a5-4a24-a3ce-30623503351c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d69dd30>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:20.557072 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9d6884b9-5c82-4046-9360-0714eec3230a tempest-ServersOnMultiNodesTest-345117190 tempest-ServersOnMultiNodesTest-345117190-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8" status: 200 len: 1617 microversion: 2.1 time: 0.510287 Oct 18 15:30:20.569615 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 733/1502] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:20 2022] GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8 => generated 1617 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:20.575612 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-022930b0-7548-4ebd-8b57-240ac3afb0ac tempest-LiveMigrationNegativeTest-41355881 tempest-LiveMigrationNegativeTest-41355881-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-853682-5", "block_migration": true, "disk_over_commit": false}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:30:20.578638 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-022930b0-7548-4ebd-8b57-240ac3afb0ac tempest-LiveMigrationNegativeTest-41355881 tempest-LiveMigrationNegativeTest-41355881-project-admin] [instance: 74e5ae75-9c35-4610-9cb5-61afa6f98581] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:20.586961 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-022930b0-7548-4ebd-8b57-240ac3afb0ac tempest-LiveMigrationNegativeTest-41355881 tempest-LiveMigrationNegativeTest-41355881-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:20.587756 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-022930b0-7548-4ebd-8b57-240ac3afb0ac tempest-LiveMigrationNegativeTest-41355881 tempest-LiveMigrationNegativeTest-41355881-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:20.588379 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-022930b0-7548-4ebd-8b57-240ac3afb0ac tempest-LiveMigrationNegativeTest-41355881 tempest-LiveMigrationNegativeTest-41355881-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:20.589746 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-022930b0-7548-4ebd-8b57-240ac3afb0ac tempest-LiveMigrationNegativeTest-41355881 tempest-LiveMigrationNegativeTest-41355881-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:20.590763 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-022930b0-7548-4ebd-8b57-240ac3afb0ac tempest-LiveMigrationNegativeTest-41355881 tempest-LiveMigrationNegativeTest-41355881-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:20.592249 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-022930b0-7548-4ebd-8b57-240ac3afb0ac tempest-LiveMigrationNegativeTest-41355881 tempest-LiveMigrationNegativeTest-41355881-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:20.631639 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-022930b0-7548-4ebd-8b57-240ac3afb0ac tempest-LiveMigrationNegativeTest-41355881 tempest-LiveMigrationNegativeTest-41355881-project-admin] Lazy-loading 'flavor' on Instance uuid 74e5ae75-9c35-4610-9cb5-61afa6f98581 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:30:20.664496 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-022930b0-7548-4ebd-8b57-240ac3afb0ac tempest-LiveMigrationNegativeTest-41355881 tempest-LiveMigrationNegativeTest-41355881-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 74e5ae75-9c35-4610-9cb5-61afa6f98581 while it is in vm_state suspended Oct 18 15:30:20.667172 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-022930b0-7548-4ebd-8b57-240ac3afb0ac tempest-LiveMigrationNegativeTest-41355881 tempest-LiveMigrationNegativeTest-41355881-project-admin] Request method failure captured: Oct 18 15:30:20.667172 n-d-853682-5 devstack@n-api.service[120405]: request: POST /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581/action HTTP/1.1 Oct 18 15:30:20.667172 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:30:20.667172 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:30:20.667172 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:30:20.667172 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 97 Oct 18 15:30:20.667172 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:30:20.667172 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:30:20.667172 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:30:20.667172 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:30:20.667172 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsZAc0h-P-HzZqJZVANcDYwvfBKk_4Qsdn8j0MmmDxq8GR5pEMWLhjT9iyU0iIFSOAoteby0EYGYLpFjuW4cSAEZfUCqZWQzyqvZbWmaly2aSDsdQFLcAc0XE4TMq9do4mO457MDQwNwBFgdkuaRmyMZ4J1TyzGn16lWNN3RBXVLTpw Oct 18 15:30:20.667172 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:30:20.667172 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:30:20.667172 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:30:20.667172 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:30:20.667172 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:30:20.667172 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:30:20.667172 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 80b61cbce55b48629f9c838f79180443 Oct 18 15:30:20.667172 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-LiveMigrationNegativeTest-41355881 Oct 18 15:30:20.667172 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,admin,reader Oct 18 15:30:20.667172 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,admin,reader Oct 18 15:30:20.668620 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/80b61cbce55b48629f9c838f79180443"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/80b61cbce55b48629f9c838f79180443"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/80b61cbce55b48629f9c838f79180443"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_80b61cbce55b48629f9c838f79180443"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:30:20.668620 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-LiveMigrationNegativeTest-41355881 Oct 18 15:30:20.668620 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 80b61cbce55b48629f9c838f79180443 Oct 18 15:30:20.668620 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-41355881 Oct 18 15:30:20.668620 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-LiveMigrationNegativeTest-41355881-project-admin Oct 18 15:30:20.668620 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:30:20.668620 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:30:20.668620 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: b8fcc2f71b274d9aba6b35987c68da2f Oct 18 15:30:20.668620 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-LiveMigrationNegativeTest-41355881-project-admin Oct 18 15:30:20.668620 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:30:20.668620 n-d-853682-5 devstack@n-api.service[120405]: {"os-migrateLive": {"host": "n-h2-853682-5", "block_migration": true, "disk_over_commit": false}} Oct 18 15:30:20.668620 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:30:20.669512 n-d-853682-5 devstack@n-api.service[120405]: exception: Cannot 'os-migrateLive' instance 74e5ae75-9c35-4610-9cb5-61afa6f98581 while it is in vm_state suspended Oct 18 15:30:20.669512 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '74e5ae75-9c35-4610-9cb5-61afa6f98581', 'body': {'os-migrateLive': {'host': 'n-h2-853682-5', 'block_migration': True, 'disk_over_commit': False}}} Oct 18 15:30:20.669512 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:30:20.669512 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:30:20.669512 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 18 15:30:20.669512 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 18 15:30:20.669512 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 18 15:30:20.669512 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 15:30:20.669512 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 18 15:30:20.669512 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 15:30:20.669512 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 18 15:30:20.669512 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 15:30:20.669512 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 18 15:30:20.669512 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 15:30:20.669512 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 18 15:30:20.669512 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 15:30:20.669512 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 18 15:30:20.669512 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 15:30:20.670713 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 15:30:20.670713 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 15:30:20.670713 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 18 15:30:20.670713 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 15:30:20.670713 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 74e5ae75-9c35-4610-9cb5-61afa6f98581 in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 18 15:30:20.670713 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:30:20.670713 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:30:20.670713 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:30:20.670713 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:30:20.670713 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:30:20.670713 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:30:20.670713 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:30:20.670713 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:30:20.670713 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:30:20.670713 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:30:20.670713 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:30:20.670713 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:30:20.670713 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:30:20.670713 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:30:20.670713 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:30:20.672054 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:30:20.672054 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 18 15:30:20.672054 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 18 15:30:20.672054 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 18 15:30:20.672054 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 15:30:20.672054 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 15:30:20.672054 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 74e5ae75-9c35-4610-9cb5-61afa6f98581 while it is in vm_state suspended Oct 18 15:30:20.672054 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:30:20.672054 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:30:20.672054 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:30:20.672054 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:30:20.672054 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:30:20.672054 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:30:20.672054 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:30:20.672054 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:30:20.672054 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 74e5ae75-9c35-4610-9cb5-61afa6f98581 while it is in vm_state suspended Oct 18 15:30:20.672054 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:30:20.674366 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-022930b0-7548-4ebd-8b57-240ac3afb0ac tempest-LiveMigrationNegativeTest-41355881 tempest-LiveMigrationNegativeTest-41355881-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 74e5ae75-9c35-4610-9cb5-61afa6f98581 while it is in vm_state suspended {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:30:20.674366 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-022930b0-7548-4ebd-8b57-240ac3afb0ac tempest-LiveMigrationNegativeTest-41355881 tempest-LiveMigrationNegativeTest-41355881-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581/action" status: 409 len: 155 microversion: 2.1 time: 0.100863 Oct 18 15:30:20.677274 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 734/1503] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:30:20 2022] POST /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581/action => generated 155 bytes in 107 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 15:30:20.683355 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ca1ce95a-7cf9-41ba-b531-8dc0158cef24 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:20.684294 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ca1ce95a-7cf9-41ba-b531-8dc0158cef24 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:20.692257 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca1ce95a-7cf9-41ba-b531-8dc0158cef24 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:20.693042 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca1ce95a-7cf9-41ba-b531-8dc0158cef24 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:20.693694 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca1ce95a-7cf9-41ba-b531-8dc0158cef24 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:20.694409 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca1ce95a-7cf9-41ba-b531-8dc0158cef24 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:20.694868 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca1ce95a-7cf9-41ba-b531-8dc0158cef24 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:20.695295 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca1ce95a-7cf9-41ba-b531-8dc0158cef24 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:21.445200 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ca1ce95a-7cf9-41ba-b531-8dc0158cef24 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:21.458625 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ca1ce95a-7cf9-41ba-b531-8dc0158cef24 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:21.460406 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ca1ce95a-7cf9-41ba-b531-8dc0158cef24 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:21.462596 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ca1ce95a-7cf9-41ba-b531-8dc0158cef24 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793" status: 200 len: 1812 microversion: 2.25 time: 0.783383 Oct 18 15:30:21.491781 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 735/1504] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:20 2022] GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793 => generated 1812 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:30:21.497132 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ed5d1575-3dd3-47d3-9f36-7d57da266233 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:21.497881 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ed5d1575-3dd3-47d3-9f36-7d57da266233 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 40097653-662f-4191-983d-881387af06a8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:21.509399 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ed5d1575-3dd3-47d3-9f36-7d57da266233 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:21.510230 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ed5d1575-3dd3-47d3-9f36-7d57da266233 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:21.510884 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ed5d1575-3dd3-47d3-9f36-7d57da266233 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:21.512277 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ed5d1575-3dd3-47d3-9f36-7d57da266233 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:21.513288 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ed5d1575-3dd3-47d3-9f36-7d57da266233 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:21.513941 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ed5d1575-3dd3-47d3-9f36-7d57da266233 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:21.571822 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ed5d1575-3dd3-47d3-9f36-7d57da266233 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 40097653-662f-4191-983d-881387af06a8] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:30:21.774990 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ed5d1575-3dd3-47d3-9f36-7d57da266233 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "DELETE /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8" status: 204 len: 0 microversion: 2.1 time: 0.281276 Oct 18 15:30:21.776080 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 736/1505] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:30:21 2022] DELETE /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:30:21.783388 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f4c8e735-5a64-4e8a-a716-aac2ca0f56c5 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:21.784785 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f4c8e735-5a64-4e8a-a716-aac2ca0f56c5 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] [instance: 74e5ae75-9c35-4610-9cb5-61afa6f98581] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:21.791399 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f4c8e735-5a64-4e8a-a716-aac2ca0f56c5 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:21.791849 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f4c8e735-5a64-4e8a-a716-aac2ca0f56c5 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:21.792283 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f4c8e735-5a64-4e8a-a716-aac2ca0f56c5 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:21.793029 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f4c8e735-5a64-4e8a-a716-aac2ca0f56c5 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:21.794321 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f4c8e735-5a64-4e8a-a716-aac2ca0f56c5 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:21.794592 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f4c8e735-5a64-4e8a-a716-aac2ca0f56c5 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:21.837675 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f4c8e735-5a64-4e8a-a716-aac2ca0f56c5 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] [instance: 74e5ae75-9c35-4610-9cb5-61afa6f98581] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:30:22.009789 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f4c8e735-5a64-4e8a-a716-aac2ca0f56c5 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] 10.222.0.60 "DELETE /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581" status: 204 len: 0 microversion: 2.1 time: 0.232358 Oct 18 15:30:22.010899 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 737/1506] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:30:21 2022] DELETE /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:30:22.031270 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-71b62b00-d576-452e-a1d0-65432436fd1a tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:22.033008 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-71b62b00-d576-452e-a1d0-65432436fd1a tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:22.049895 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-71b62b00-d576-452e-a1d0-65432436fd1a tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:22.050140 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-71b62b00-d576-452e-a1d0-65432436fd1a tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:22.053804 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-71b62b00-d576-452e-a1d0-65432436fd1a tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:22.056359 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-71b62b00-d576-452e-a1d0-65432436fd1a tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:22.068834 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-71b62b00-d576-452e-a1d0-65432436fd1a tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:22.068834 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-71b62b00-d576-452e-a1d0-65432436fd1a tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:22.248938 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-71b62b00-d576-452e-a1d0-65432436fd1a tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:22.262452 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-71b62b00-d576-452e-a1d0-65432436fd1a tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:22.264542 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-71b62b00-d576-452e-a1d0-65432436fd1a tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:22.273752 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-71b62b00-d576-452e-a1d0-65432436fd1a tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1555 microversion: 2.91 time: 0.259120 Oct 18 15:30:22.289483 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 738/1507] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:22 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1555 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:30:22.307865 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-800f5524-d571-4276-b0f0-cadb6bb616a1 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:22.308495 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-800f5524-d571-4276-b0f0-cadb6bb616a1 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 40097653-662f-4191-983d-881387af06a8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:22.316482 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-800f5524-d571-4276-b0f0-cadb6bb616a1 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:22.317022 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-800f5524-d571-4276-b0f0-cadb6bb616a1 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:22.317828 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-800f5524-d571-4276-b0f0-cadb6bb616a1 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:22.318173 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-800f5524-d571-4276-b0f0-cadb6bb616a1 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:22.318634 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-800f5524-d571-4276-b0f0-cadb6bb616a1 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:22.319176 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-800f5524-d571-4276-b0f0-cadb6bb616a1 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:22.607660 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-800f5524-d571-4276-b0f0-cadb6bb616a1 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:22.626668 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-800f5524-d571-4276-b0f0-cadb6bb616a1 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8" status: 200 len: 1472 microversion: 2.1 time: 0.334505 Oct 18 15:30:22.630582 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 739/1508] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:22 2022] GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8 => generated 1472 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:22.641599 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-57d5ba0a-c64e-4f05-87c7-a2e267d85d41 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:22.642227 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-57d5ba0a-c64e-4f05-87c7-a2e267d85d41 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] [instance: 74e5ae75-9c35-4610-9cb5-61afa6f98581] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:22.658698 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57d5ba0a-c64e-4f05-87c7-a2e267d85d41 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:22.659781 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57d5ba0a-c64e-4f05-87c7-a2e267d85d41 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:22.660193 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57d5ba0a-c64e-4f05-87c7-a2e267d85d41 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:22.660936 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57d5ba0a-c64e-4f05-87c7-a2e267d85d41 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:22.661929 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57d5ba0a-c64e-4f05-87c7-a2e267d85d41 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:22.661929 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57d5ba0a-c64e-4f05-87c7-a2e267d85d41 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:22.958485 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-57d5ba0a-c64e-4f05-87c7-a2e267d85d41 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe80f2ae3ec4365a031ca7472d76e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df909cb429f46c39a83c29fb260b169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:22.964334 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:30:22.981539 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-57d5ba0a-c64e-4f05-87c7-a2e267d85d41 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] 10.222.0.60 "GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581" status: 200 len: 1465 microversion: 2.1 time: 0.349269 Oct 18 15:30:22.982508 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 740/1509] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:22 2022] GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581 => generated 1465 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:22.994132 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6abe7e1c-fd81-4f55-ac58-6614fd6be415 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:22.994876 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6abe7e1c-fd81-4f55-ac58-6614fd6be415 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:23.012250 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6abe7e1c-fd81-4f55-ac58-6614fd6be415 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:23.012781 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6abe7e1c-fd81-4f55-ac58-6614fd6be415 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:23.014013 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6abe7e1c-fd81-4f55-ac58-6614fd6be415 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:23.015228 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6abe7e1c-fd81-4f55-ac58-6614fd6be415 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:23.015888 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6abe7e1c-fd81-4f55-ac58-6614fd6be415 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:23.016356 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6abe7e1c-fd81-4f55-ac58-6614fd6be415 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:23.316481 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6abe7e1c-fd81-4f55-ac58-6614fd6be415 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:23.333865 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6abe7e1c-fd81-4f55-ac58-6614fd6be415 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:23.336793 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6abe7e1c-fd81-4f55-ac58-6614fd6be415 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:23.339187 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6abe7e1c-fd81-4f55-ac58-6614fd6be415 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793" status: 200 len: 1812 microversion: 2.25 time: 0.354823 Oct 18 15:30:23.340263 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 741/1510] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:22 2022] GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793 => generated 1812 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:30:23.345509 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ac37ffcc-77c0-4077-af2e-76e9c3e9cd77 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:23.346342 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ac37ffcc-77c0-4077-af2e-76e9c3e9cd77 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:23.353865 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ac37ffcc-77c0-4077-af2e-76e9c3e9cd77 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:23.354491 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ac37ffcc-77c0-4077-af2e-76e9c3e9cd77 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:23.355058 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ac37ffcc-77c0-4077-af2e-76e9c3e9cd77 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:23.356655 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ac37ffcc-77c0-4077-af2e-76e9c3e9cd77 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:23.363112 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ac37ffcc-77c0-4077-af2e-76e9c3e9cd77 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:23.363112 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ac37ffcc-77c0-4077-af2e-76e9c3e9cd77 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:23.543092 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ac37ffcc-77c0-4077-af2e-76e9c3e9cd77 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:23.564788 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ac37ffcc-77c0-4077-af2e-76e9c3e9cd77 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:23.572653 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ac37ffcc-77c0-4077-af2e-76e9c3e9cd77 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:23.585281 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ac37ffcc-77c0-4077-af2e-76e9c3e9cd77 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1555 microversion: 2.91 time: 0.243657 Oct 18 15:30:23.587356 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 742/1511] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:23 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1555 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:30:23.655968 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d8b94fe4-c702-4aa5-a96b-d0eeefdc2331 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:23.657055 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d8b94fe4-c702-4aa5-a96b-d0eeefdc2331 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 40097653-662f-4191-983d-881387af06a8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:23.668850 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d8b94fe4-c702-4aa5-a96b-d0eeefdc2331 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:23.669766 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d8b94fe4-c702-4aa5-a96b-d0eeefdc2331 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:23.670582 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d8b94fe4-c702-4aa5-a96b-d0eeefdc2331 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:23.671433 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d8b94fe4-c702-4aa5-a96b-d0eeefdc2331 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:23.675250 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d8b94fe4-c702-4aa5-a96b-d0eeefdc2331 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:23.676463 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d8b94fe4-c702-4aa5-a96b-d0eeefdc2331 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:24.076706 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d8b94fe4-c702-4aa5-a96b-d0eeefdc2331 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:24.102588 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d8b94fe4-c702-4aa5-a96b-d0eeefdc2331 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8" status: 200 len: 1472 microversion: 2.1 time: 0.453714 Oct 18 15:30:24.103269 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 743/1512] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:23 2022] GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8 => generated 1472 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:30:24.109180 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-939acd85-9737-47fe-a87a-b1b1a6cc35e8 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:24.110070 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-939acd85-9737-47fe-a87a-b1b1a6cc35e8 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] [instance: 74e5ae75-9c35-4610-9cb5-61afa6f98581] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:24.152003 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-939acd85-9737-47fe-a87a-b1b1a6cc35e8 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:24.157640 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-939acd85-9737-47fe-a87a-b1b1a6cc35e8 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:24.158446 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-939acd85-9737-47fe-a87a-b1b1a6cc35e8 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:24.159116 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-939acd85-9737-47fe-a87a-b1b1a6cc35e8 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:24.159684 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-939acd85-9737-47fe-a87a-b1b1a6cc35e8 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:24.163446 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-939acd85-9737-47fe-a87a-b1b1a6cc35e8 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:24.454613 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-939acd85-9737-47fe-a87a-b1b1a6cc35e8 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe80f2ae3ec4365a031ca7472d76e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df909cb429f46c39a83c29fb260b169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:24.468003 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-939acd85-9737-47fe-a87a-b1b1a6cc35e8 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] 10.222.0.60 "GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581" status: 200 len: 1465 microversion: 2.1 time: 0.363300 Oct 18 15:30:24.478688 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 744/1513] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:24 2022] GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581 => generated 1465 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:24.478688 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-60486ce0-1243-4d6d-b492-3b4eb2347ea0 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:24.478688 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-60486ce0-1243-4d6d-b492-3b4eb2347ea0 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:24.484475 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-60486ce0-1243-4d6d-b492-3b4eb2347ea0 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:24.484475 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-60486ce0-1243-4d6d-b492-3b4eb2347ea0 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:24.484475 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-60486ce0-1243-4d6d-b492-3b4eb2347ea0 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:24.484475 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-60486ce0-1243-4d6d-b492-3b4eb2347ea0 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:24.485861 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-60486ce0-1243-4d6d-b492-3b4eb2347ea0 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:24.485861 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-60486ce0-1243-4d6d-b492-3b4eb2347ea0 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:24.962638 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-60486ce0-1243-4d6d-b492-3b4eb2347ea0 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:24.997260 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-60486ce0-1243-4d6d-b492-3b4eb2347ea0 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:25.009520 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-60486ce0-1243-4d6d-b492-3b4eb2347ea0 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:25.017469 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-60486ce0-1243-4d6d-b492-3b4eb2347ea0 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793" status: 200 len: 1812 microversion: 2.25 time: 0.546848 Oct 18 15:30:25.038778 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 745/1514] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:24 2022] GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793 => generated 1812 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:30:25.064936 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-868f7aee-2ee0-4d3a-9bd5-73bec5e0a049 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:25.066107 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-868f7aee-2ee0-4d3a-9bd5-73bec5e0a049 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:25.093111 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-868f7aee-2ee0-4d3a-9bd5-73bec5e0a049 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:25.093629 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-868f7aee-2ee0-4d3a-9bd5-73bec5e0a049 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:25.094079 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-868f7aee-2ee0-4d3a-9bd5-73bec5e0a049 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:25.101565 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-868f7aee-2ee0-4d3a-9bd5-73bec5e0a049 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:25.102916 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-868f7aee-2ee0-4d3a-9bd5-73bec5e0a049 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:25.104595 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-868f7aee-2ee0-4d3a-9bd5-73bec5e0a049 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:25.468639 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-868f7aee-2ee0-4d3a-9bd5-73bec5e0a049 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:25.484105 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-868f7aee-2ee0-4d3a-9bd5-73bec5e0a049 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:25.488751 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-868f7aee-2ee0-4d3a-9bd5-73bec5e0a049 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:25.499054 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-868f7aee-2ee0-4d3a-9bd5-73bec5e0a049 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1555 microversion: 2.91 time: 0.453984 Oct 18 15:30:25.517740 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 746/1515] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:25 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1555 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:30:25.525212 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-faea4121-d2c6-4c42-a71d-725e22bbc386 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:25.526102 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-faea4121-d2c6-4c42-a71d-725e22bbc386 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 40097653-662f-4191-983d-881387af06a8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:25.534811 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-faea4121-d2c6-4c42-a71d-725e22bbc386 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:25.535522 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-faea4121-d2c6-4c42-a71d-725e22bbc386 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:25.536123 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-faea4121-d2c6-4c42-a71d-725e22bbc386 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:25.537029 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-faea4121-d2c6-4c42-a71d-725e22bbc386 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:25.537883 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-faea4121-d2c6-4c42-a71d-725e22bbc386 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:25.538904 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-faea4121-d2c6-4c42-a71d-725e22bbc386 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:25.854806 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-faea4121-d2c6-4c42-a71d-725e22bbc386 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:25.878344 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-faea4121-d2c6-4c42-a71d-725e22bbc386 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8" status: 200 len: 1472 microversion: 2.1 time: 0.357258 Oct 18 15:30:25.882033 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 747/1516] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:25 2022] GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8 => generated 1472 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:25.887524 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ef060ea8-2744-492b-8324-d29eaed2092f tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:25.888538 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ef060ea8-2744-492b-8324-d29eaed2092f tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] [instance: 74e5ae75-9c35-4610-9cb5-61afa6f98581] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:25.896715 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ef060ea8-2744-492b-8324-d29eaed2092f tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:25.897253 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ef060ea8-2744-492b-8324-d29eaed2092f tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:25.897781 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ef060ea8-2744-492b-8324-d29eaed2092f tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:25.910991 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ef060ea8-2744-492b-8324-d29eaed2092f tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:25.910991 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ef060ea8-2744-492b-8324-d29eaed2092f tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:25.910991 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ef060ea8-2744-492b-8324-d29eaed2092f tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:26.090543 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ef060ea8-2744-492b-8324-d29eaed2092f tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe80f2ae3ec4365a031ca7472d76e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df909cb429f46c39a83c29fb260b169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:26.106466 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ef060ea8-2744-492b-8324-d29eaed2092f tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] 10.222.0.60 "GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581" status: 200 len: 1465 microversion: 2.1 time: 0.222889 Oct 18 15:30:26.108305 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 748/1517] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:25 2022] GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581 => generated 1465 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:26.118391 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d16d5ada-7ac7-435a-b063-0cb63efbd8a0 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:26.119874 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d16d5ada-7ac7-435a-b063-0cb63efbd8a0 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:26.131901 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d16d5ada-7ac7-435a-b063-0cb63efbd8a0 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:26.133518 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d16d5ada-7ac7-435a-b063-0cb63efbd8a0 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:26.134181 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d16d5ada-7ac7-435a-b063-0cb63efbd8a0 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:26.135327 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d16d5ada-7ac7-435a-b063-0cb63efbd8a0 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:26.135952 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d16d5ada-7ac7-435a-b063-0cb63efbd8a0 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:26.136548 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d16d5ada-7ac7-435a-b063-0cb63efbd8a0 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:26.972399 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d16d5ada-7ac7-435a-b063-0cb63efbd8a0 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:26.986677 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d16d5ada-7ac7-435a-b063-0cb63efbd8a0 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:26.992213 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d16d5ada-7ac7-435a-b063-0cb63efbd8a0 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:26.995267 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d16d5ada-7ac7-435a-b063-0cb63efbd8a0 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793" status: 200 len: 1812 microversion: 2.25 time: 0.885549 Oct 18 15:30:27.003281 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 749/1518] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:26 2022] GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793 => generated 1812 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:30:27.014201 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-2a914f1d-ea63-4629-a7a2-962a71ea8662 req-1c7811ad-47da-4283-a2c3-2b3918c8a031 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74e5ae75-9c35-4610-9cb5-61afa6f98581", "name": "network-vif-deleted", "tag": "da601fb9-7eac-4831-80d1-a76275a0d8ed"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:30:27.043042 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-2a914f1d-ea63-4629-a7a2-962a71ea8662 req-1c7811ad-47da-4283-a2c3-2b3918c8a031 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:27.045540 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-2a914f1d-ea63-4629-a7a2-962a71ea8662 req-1c7811ad-47da-4283-a2c3-2b3918c8a031 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:27.048951 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-2a914f1d-ea63-4629-a7a2-962a71ea8662 req-1c7811ad-47da-4283-a2c3-2b3918c8a031 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:27.087457 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-2a914f1d-ea63-4629-a7a2-962a71ea8662 req-1c7811ad-47da-4283-a2c3-2b3918c8a031 service nova] Creating event network-vif-deleted:da601fb9-7eac-4831-80d1-a76275a0d8ed for instance 74e5ae75-9c35-4610-9cb5-61afa6f98581 on n-h1-853682-5 Oct 18 15:30:27.097053 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-2a914f1d-ea63-4629-a7a2-962a71ea8662 req-1c7811ad-47da-4283-a2c3-2b3918c8a031 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091197 Oct 18 15:30:27.099956 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 750/1519] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:30:27.122023 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-59631f2f-7193-4be3-b282-16933ef26d9c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:27.123960 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-59631f2f-7193-4be3-b282-16933ef26d9c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:27.141463 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-59631f2f-7193-4be3-b282-16933ef26d9c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:27.144074 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-59631f2f-7193-4be3-b282-16933ef26d9c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:27.144777 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-59631f2f-7193-4be3-b282-16933ef26d9c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:27.147962 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-59631f2f-7193-4be3-b282-16933ef26d9c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:27.151726 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-59631f2f-7193-4be3-b282-16933ef26d9c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:27.154684 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-59631f2f-7193-4be3-b282-16933ef26d9c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:27.526828 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-59631f2f-7193-4be3-b282-16933ef26d9c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:27.538773 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-59631f2f-7193-4be3-b282-16933ef26d9c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:27.540442 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-59631f2f-7193-4be3-b282-16933ef26d9c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:27.579647 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-59631f2f-7193-4be3-b282-16933ef26d9c tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1555 microversion: 2.91 time: 0.469581 Oct 18 15:30:27.590179 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 751/1520] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:27 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1555 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:30:27.622985 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-d3dbbc90-bc38-4eac-b74a-6679bb47f262 req-58ad9786-b0c8-43db-8489-5b50070f221e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40097653-662f-4191-983d-881387af06a8", "name": "network-vif-deleted", "tag": "4da77dc8-5cc4-4661-bd00-573bf094fde7"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:30:27.691786 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-d3dbbc90-bc38-4eac-b74a-6679bb47f262 req-58ad9786-b0c8-43db-8489-5b50070f221e service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:27.697550 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-d3dbbc90-bc38-4eac-b74a-6679bb47f262 req-58ad9786-b0c8-43db-8489-5b50070f221e service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:27.699679 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-d3dbbc90-bc38-4eac-b74a-6679bb47f262 req-58ad9786-b0c8-43db-8489-5b50070f221e service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:27.760247 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-d3dbbc90-bc38-4eac-b74a-6679bb47f262 req-58ad9786-b0c8-43db-8489-5b50070f221e service nova] Creating event network-vif-deleted:4da77dc8-5cc4-4661-bd00-573bf094fde7 for instance 40097653-662f-4191-983d-881387af06a8 on n-h1-853682-5 Oct 18 15:30:27.780138 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-d3dbbc90-bc38-4eac-b74a-6679bb47f262 req-58ad9786-b0c8-43db-8489-5b50070f221e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.185398 Oct 18 15:30:27.788283 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 752/1521] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:30:27.825819 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4c22713a-5912-405f-b327-f2f803e88e57 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:27.830238 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4c22713a-5912-405f-b327-f2f803e88e57 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 40097653-662f-4191-983d-881387af06a8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:27.886587 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4c22713a-5912-405f-b327-f2f803e88e57 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:27.889427 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4c22713a-5912-405f-b327-f2f803e88e57 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:27.894109 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4c22713a-5912-405f-b327-f2f803e88e57 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:27.895422 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4c22713a-5912-405f-b327-f2f803e88e57 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:27.897794 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4c22713a-5912-405f-b327-f2f803e88e57 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:27.899317 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4c22713a-5912-405f-b327-f2f803e88e57 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:28.013975 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4c22713a-5912-405f-b327-f2f803e88e57 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:28.014989 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4c22713a-5912-405f-b327-f2f803e88e57 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:28.015679 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4c22713a-5912-405f-b327-f2f803e88e57 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:28.016547 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-4c22713a-5912-405f-b327-f2f803e88e57 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lazy-loading 'fault' on Instance uuid 40097653-662f-4191-983d-881387af06a8 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:30:28.151086 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4c22713a-5912-405f-b327-f2f803e88e57 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:28.166474 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4c22713a-5912-405f-b327-f2f803e88e57 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8" status: 200 len: 1306 microversion: 2.1 time: 0.373421 Oct 18 15:30:28.170387 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 753/1522] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:27 2022] GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8 => generated 1306 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:28.177408 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-45400ba0-3510-4d06-9f66-6bbd7ccb7b26 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:28.184665 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-45400ba0-3510-4d06-9f66-6bbd7ccb7b26 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] [instance: 74e5ae75-9c35-4610-9cb5-61afa6f98581] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:28.202903 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-45400ba0-3510-4d06-9f66-6bbd7ccb7b26 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:28.204072 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-45400ba0-3510-4d06-9f66-6bbd7ccb7b26 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:28.204749 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-45400ba0-3510-4d06-9f66-6bbd7ccb7b26 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:28.205827 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-45400ba0-3510-4d06-9f66-6bbd7ccb7b26 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:28.207847 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-45400ba0-3510-4d06-9f66-6bbd7ccb7b26 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:28.212032 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-45400ba0-3510-4d06-9f66-6bbd7ccb7b26 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:28.241113 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-45400ba0-3510-4d06-9f66-6bbd7ccb7b26 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] HTTP exception thrown: Instance 74e5ae75-9c35-4610-9cb5-61afa6f98581 could not be found. Oct 18 15:30:28.250671 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-45400ba0-3510-4d06-9f66-6bbd7ccb7b26 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Request method failure captured: Oct 18 15:30:28.250671 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581 HTTP/1.1 Oct 18 15:30:28.250671 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:30:28.250671 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:30:28.250671 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:30:28.250671 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:30:28.250671 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:30:28.250671 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:30:28.250671 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:30:28.250671 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:30:28.250671 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsY_cJVstV_UlgeJ2_ro9UnUvp_WMr6EnQPX56LTO_t7Qrbj6Z3OtnIHpl0YZJKzgYXu87BMGGlFTvUFvorWZPKFrJQ8VHcpcNWyMDSlzQ1mtjmE2tMclWKVrI-5YHDorm8Lx1H6DZw3ZJ3-j0-53Chlh9r9pMdJSFVwbrNt1HULqMY Oct 18 15:30:28.250671 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:30:28.250671 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:30:28.250671 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:30:28.250671 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:30:28.250671 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:30:28.250671 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:30:28.250671 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 5df909cb429f46c39a83c29fb260b169 Oct 18 15:30:28.250671 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-LiveMigrationNegativeTest-871860616 Oct 18 15:30:28.250671 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:30:28.250671 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:30:28.252260 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5df909cb429f46c39a83c29fb260b169"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5df909cb429f46c39a83c29fb260b169"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5df909cb429f46c39a83c29fb260b169"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5df909cb429f46c39a83c29fb260b169"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:30:28.252260 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-LiveMigrationNegativeTest-871860616 Oct 18 15:30:28.252260 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 5df909cb429f46c39a83c29fb260b169 Oct 18 15:30:28.252260 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-871860616 Oct 18 15:30:28.252260 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-LiveMigrationNegativeTest-871860616-project Oct 18 15:30:28.252260 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:30:28.252260 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:30:28.252260 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: ebe80f2ae3ec4365a031ca7472d76e33 Oct 18 15:30:28.252260 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-LiveMigrationNegativeTest-871860616-project Oct 18 15:30:28.252260 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:30:28.252260 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 74e5ae75-9c35-4610-9cb5-61afa6f98581 could not be found. Oct 18 15:30:28.252260 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '74e5ae75-9c35-4610-9cb5-61afa6f98581'} Oct 18 15:30:28.253775 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:30:28.253775 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:30:28.253775 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:30:28.253775 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:30:28.253775 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:30:28.253775 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:30:28.253775 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:30:28.253775 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:30:28.253775 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:30:28.253775 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:30:28.253775 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74e5ae75-9c35-4610-9cb5-61afa6f98581 could not be found. Oct 18 15:30:28.253775 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:30:28.253775 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:30:28.253775 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:30:28.253775 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:30:28.253775 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:30:28.253775 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:30:28.253775 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:30:28.253775 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:30:28.253775 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:30:28.255153 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:30:28.255153 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:30:28.255153 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:30:28.255153 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:30:28.255153 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:30:28.255153 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:30:28.255153 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:30:28.255153 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74e5ae75-9c35-4610-9cb5-61afa6f98581 could not be found. Oct 18 15:30:28.255153 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:30:28.255153 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:30:28.255153 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:30:28.255153 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:30:28.255153 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:30:28.255153 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:30:28.255153 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:30:28.255153 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:30:28.255153 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74e5ae75-9c35-4610-9cb5-61afa6f98581 could not be found. Oct 18 15:30:28.255153 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:30:28.261085 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-45400ba0-3510-4d06-9f66-6bbd7ccb7b26 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Returning 404 to user: Instance 74e5ae75-9c35-4610-9cb5-61afa6f98581 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:30:28.262528 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-45400ba0-3510-4d06-9f66-6bbd7ccb7b26 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] 10.222.0.60 "GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581" status: 404 len: 111 microversion: 2.1 time: 0.090848 Oct 18 15:30:28.265185 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 754/1523] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:28 2022] GET /compute/v2.1/servers/74e5ae75-9c35-4610-9cb5-61afa6f98581 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:30:28.272437 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4a9bb4d6-f51d-4de9-b8f8-929b02125c95 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:28.278638 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4a9bb4d6-f51d-4de9-b8f8-929b02125c95 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:28.290859 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4a9bb4d6-f51d-4de9-b8f8-929b02125c95 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:28.293331 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4a9bb4d6-f51d-4de9-b8f8-929b02125c95 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:28.293922 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4a9bb4d6-f51d-4de9-b8f8-929b02125c95 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:28.297038 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4a9bb4d6-f51d-4de9-b8f8-929b02125c95 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:28.297635 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4a9bb4d6-f51d-4de9-b8f8-929b02125c95 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:28.298193 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4a9bb4d6-f51d-4de9-b8f8-929b02125c95 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:28.647646 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4a9bb4d6-f51d-4de9-b8f8-929b02125c95 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:28.665515 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4a9bb4d6-f51d-4de9-b8f8-929b02125c95 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:28.674530 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4a9bb4d6-f51d-4de9-b8f8-929b02125c95 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:28.702004 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4a9bb4d6-f51d-4de9-b8f8-929b02125c95 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793" status: 200 len: 1812 microversion: 2.25 time: 0.411557 Oct 18 15:30:28.720245 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 755/1524] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:28 2022] GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793 => generated 1812 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:30:28.735542 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-62ecdcf9-fa84-4e4f-ac7f-789c079bb2dc tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:28.736213 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-62ecdcf9-fa84-4e4f-ac7f-789c079bb2dc tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] [instance: 5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:28.750505 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-62ecdcf9-fa84-4e4f-ac7f-789c079bb2dc tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:28.756495 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-62ecdcf9-fa84-4e4f-ac7f-789c079bb2dc tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:28.757534 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-62ecdcf9-fa84-4e4f-ac7f-789c079bb2dc tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:28.762920 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-62ecdcf9-fa84-4e4f-ac7f-789c079bb2dc tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:28.764711 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-62ecdcf9-fa84-4e4f-ac7f-789c079bb2dc tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:28.766091 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-62ecdcf9-fa84-4e4f-ac7f-789c079bb2dc tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:28.830390 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-62ecdcf9-fa84-4e4f-ac7f-789c079bb2dc tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] [instance: 5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:30:29.075897 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-62ecdcf9-fa84-4e4f-ac7f-789c079bb2dc tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38" status: 204 len: 0 microversion: 2.1 time: 0.352189 Oct 18 15:30:29.078772 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 756/1525] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:30:28 2022] DELETE /compute/v2.1/servers/5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:30:29.098459 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d8c6ff7a-4fe8-406b-a2f9-6b29ccc1eff0 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:29.099226 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d8c6ff7a-4fe8-406b-a2f9-6b29ccc1eff0 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:29.126232 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d8c6ff7a-4fe8-406b-a2f9-6b29ccc1eff0 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:29.128552 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d8c6ff7a-4fe8-406b-a2f9-6b29ccc1eff0 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:29.129970 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d8c6ff7a-4fe8-406b-a2f9-6b29ccc1eff0 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:29.130757 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d8c6ff7a-4fe8-406b-a2f9-6b29ccc1eff0 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:29.131295 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d8c6ff7a-4fe8-406b-a2f9-6b29ccc1eff0 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:29.131733 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d8c6ff7a-4fe8-406b-a2f9-6b29ccc1eff0 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:29.165988 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:30:29.249981 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d8c6ff7a-4fe8-406b-a2f9-6b29ccc1eff0 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:29.266143 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d8c6ff7a-4fe8-406b-a2f9-6b29ccc1eff0 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:29.268757 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d8c6ff7a-4fe8-406b-a2f9-6b29ccc1eff0 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:29.275731 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d8c6ff7a-4fe8-406b-a2f9-6b29ccc1eff0 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1555 microversion: 2.91 time: 0.195721 Oct 18 15:30:29.276748 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 757/1526] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:29 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1555 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:30:29.282659 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3797cbfc-4148-4630-8867-d1411b107c62 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:29.284188 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3797cbfc-4148-4630-8867-d1411b107c62 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] [instance: 5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:29.293105 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3797cbfc-4148-4630-8867-d1411b107c62 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:29.294420 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3797cbfc-4148-4630-8867-d1411b107c62 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:29.295053 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3797cbfc-4148-4630-8867-d1411b107c62 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:29.296372 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3797cbfc-4148-4630-8867-d1411b107c62 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:29.296918 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3797cbfc-4148-4630-8867-d1411b107c62 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:29.297864 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3797cbfc-4148-4630-8867-d1411b107c62 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:29.558009 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3797cbfc-4148-4630-8867-d1411b107c62 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe80f2ae3ec4365a031ca7472d76e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df909cb429f46c39a83c29fb260b169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:29.573690 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3797cbfc-4148-4630-8867-d1411b107c62 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] 10.222.0.60 "GET /compute/v2.1/servers/5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38" status: 200 len: 1473 microversion: 2.1 time: 0.295557 Oct 18 15:30:29.574703 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 758/1527] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:29 2022] GET /compute/v2.1/servers/5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38 => generated 1473 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:29.580767 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d9ecc70d-5f12-417f-b3c7-2a9b1fb35e1c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:29.581510 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d9ecc70d-5f12-417f-b3c7-2a9b1fb35e1c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 40097653-662f-4191-983d-881387af06a8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:29.588484 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d9ecc70d-5f12-417f-b3c7-2a9b1fb35e1c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:29.589126 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d9ecc70d-5f12-417f-b3c7-2a9b1fb35e1c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:29.589662 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d9ecc70d-5f12-417f-b3c7-2a9b1fb35e1c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:29.590655 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d9ecc70d-5f12-417f-b3c7-2a9b1fb35e1c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:29.594864 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d9ecc70d-5f12-417f-b3c7-2a9b1fb35e1c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:29.594864 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d9ecc70d-5f12-417f-b3c7-2a9b1fb35e1c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:29.608980 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-d9ecc70d-5f12-417f-b3c7-2a9b1fb35e1c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] HTTP exception thrown: Instance 40097653-662f-4191-983d-881387af06a8 could not be found. Oct 18 15:30:29.610786 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d9ecc70d-5f12-417f-b3c7-2a9b1fb35e1c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Request method failure captured: Oct 18 15:30:29.610786 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8 HTTP/1.1 Oct 18 15:30:29.610786 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:30:29.610786 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:30:29.610786 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:30:29.610786 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:30:29.610786 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:30:29.610786 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:30:29.610786 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:30:29.610786 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:30:29.610786 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsXUy9FAAJJ0Ruh4wwEA9szjF7RLudGwF2cxYyUzJkwyma_At_umHw9EflsFK-fFl5HDZF0eGpwWYNbkl96nz5je7IB6PyqBeik4MLzcoYbCjQBM01G06iG1mP4Ny9aewc_L7MlMIXu3Yta_wCU8nd9Gbv-uOlENc7ZsnBI5A37iAsc Oct 18 15:30:29.610786 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:30:29.610786 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:30:29.610786 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:30:29.610786 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:30:29.610786 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:30:29.610786 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:30:29.610786 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 377c3bbd62b546fca545c0f6d0df59e3 Oct 18 15:30:29.610786 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServersOnMultiNodesTest-1788579982 Oct 18 15:30:29.610786 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:30:29.610786 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:30:29.613036 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/377c3bbd62b546fca545c0f6d0df59e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/377c3bbd62b546fca545c0f6d0df59e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/377c3bbd62b546fca545c0f6d0df59e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_377c3bbd62b546fca545c0f6d0df59e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:30:29.613036 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServersOnMultiNodesTest-1788579982 Oct 18 15:30:29.613036 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 377c3bbd62b546fca545c0f6d0df59e3 Oct 18 15:30:29.613036 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1788579982 Oct 18 15:30:29.613036 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServersOnMultiNodesTest-1788579982-project Oct 18 15:30:29.613036 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:30:29.613036 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:30:29.613036 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: d58aac335a1d421a95928e2754fb2529 Oct 18 15:30:29.613036 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServersOnMultiNodesTest-1788579982-project Oct 18 15:30:29.613036 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:30:29.613036 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 40097653-662f-4191-983d-881387af06a8 could not be found. Oct 18 15:30:29.613036 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '40097653-662f-4191-983d-881387af06a8'} Oct 18 15:30:29.614028 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:30:29.614028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:30:29.614028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:30:29.614028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:30:29.614028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:30:29.614028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:30:29.614028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:30:29.614028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:30:29.614028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:30:29.614028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:30:29.614028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40097653-662f-4191-983d-881387af06a8 could not be found. Oct 18 15:30:29.614028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:30:29.614028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:30:29.614028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:30:29.614028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:30:29.614028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:30:29.614028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:30:29.614028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:30:29.614028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:30:29.614028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:30:29.615576 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:30:29.615576 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:30:29.615576 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:30:29.615576 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:30:29.615576 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:30:29.615576 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:30:29.615576 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:30:29.615576 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40097653-662f-4191-983d-881387af06a8 could not be found. Oct 18 15:30:29.615576 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:30:29.615576 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:30:29.615576 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:30:29.615576 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:30:29.615576 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:30:29.615576 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:30:29.615576 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:30:29.615576 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:30:29.615576 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40097653-662f-4191-983d-881387af06a8 could not be found. Oct 18 15:30:29.615576 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:30:29.616908 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d9ecc70d-5f12-417f-b3c7-2a9b1fb35e1c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Returning 404 to user: Instance 40097653-662f-4191-983d-881387af06a8 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:30:29.616908 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d9ecc70d-5f12-417f-b3c7-2a9b1fb35e1c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8" status: 404 len: 111 microversion: 2.1 time: 0.037362 Oct 18 15:30:29.616908 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 759/1528] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:29 2022] GET /compute/v2.1/servers/40097653-662f-4191-983d-881387af06a8 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:30:29.624352 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3ea70551-ba6f-4ab6-8a95-c500b1f8430f tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:29.626871 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3ea70551-ba6f-4ab6-8a95-c500b1f8430f tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 7c7a376f-fa78-4101-adf7-e84f23b4e068] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:29.631856 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ea70551-ba6f-4ab6-8a95-c500b1f8430f tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:29.632628 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ea70551-ba6f-4ab6-8a95-c500b1f8430f tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:29.633093 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ea70551-ba6f-4ab6-8a95-c500b1f8430f tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:29.634124 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ea70551-ba6f-4ab6-8a95-c500b1f8430f tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:29.634777 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ea70551-ba6f-4ab6-8a95-c500b1f8430f tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:29.635232 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ea70551-ba6f-4ab6-8a95-c500b1f8430f tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:29.667528 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3ea70551-ba6f-4ab6-8a95-c500b1f8430f tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 7c7a376f-fa78-4101-adf7-e84f23b4e068] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:30:29.891432 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:30:29.992399 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3ea70551-ba6f-4ab6-8a95-c500b1f8430f tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7c7a376f-fa78-4101-adf7-e84f23b4e068" status: 204 len: 0 microversion: 2.1 time: 0.372187 Oct 18 15:30:30.000063 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 760/1529] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:30:29 2022] DELETE /compute/v2.1/servers/7c7a376f-fa78-4101-adf7-e84f23b4e068 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:30:30.010556 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c0a4994f-7b5e-445a-94e7-645e0b3ca3ce tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:30.011471 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c0a4994f-7b5e-445a-94e7-645e0b3ca3ce tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:30.020713 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c0a4994f-7b5e-445a-94e7-645e0b3ca3ce tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:30.021835 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c0a4994f-7b5e-445a-94e7-645e0b3ca3ce tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:30.022340 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c0a4994f-7b5e-445a-94e7-645e0b3ca3ce tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:30.023825 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c0a4994f-7b5e-445a-94e7-645e0b3ca3ce tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:30.024348 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c0a4994f-7b5e-445a-94e7-645e0b3ca3ce tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:30.025400 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c0a4994f-7b5e-445a-94e7-645e0b3ca3ce tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:30.149617 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:30:30.157612 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=21 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:30:30.179093 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:30:30.401489 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c0a4994f-7b5e-445a-94e7-645e0b3ca3ce tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:30.425204 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c0a4994f-7b5e-445a-94e7-645e0b3ca3ce tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:30.427390 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c0a4994f-7b5e-445a-94e7-645e0b3ca3ce tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:30.429283 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c0a4994f-7b5e-445a-94e7-645e0b3ca3ce tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793" status: 200 len: 1812 microversion: 2.25 time: 0.428199 Oct 18 15:30:30.432354 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 761/1530] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:29 2022] GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793 => generated 1812 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:30:30.444887 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-d718d3f9-41d1-4218-adfe-a633255d1826 req-3b08ea31-e0f3-4a8a-ba66-c99fb613fd5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc806839-862f-4ea7-9078-c970f50b3793", "name": "network-vif-unplugged", "status": "completed", "tag": "6ef23d0f-e4be-4f4e-9d5b-21e8e69f9d6f"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:30:30.484202 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-d718d3f9-41d1-4218-adfe-a633255d1826 req-3b08ea31-e0f3-4a8a-ba66-c99fb613fd5b service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:30.485980 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-d718d3f9-41d1-4218-adfe-a633255d1826 req-3b08ea31-e0f3-4a8a-ba66-c99fb613fd5b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:30.486100 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-d718d3f9-41d1-4218-adfe-a633255d1826 req-3b08ea31-e0f3-4a8a-ba66-c99fb613fd5b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:30.509157 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-d718d3f9-41d1-4218-adfe-a633255d1826 req-3b08ea31-e0f3-4a8a-ba66-c99fb613fd5b service nova] Creating event network-vif-unplugged:6ef23d0f-e4be-4f4e-9d5b-21e8e69f9d6f for instance cc806839-862f-4ea7-9078-c970f50b3793 on n-h1-853682-5 Oct 18 15:30:30.516089 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-d718d3f9-41d1-4218-adfe-a633255d1826 req-3b08ea31-e0f3-4a8a-ba66-c99fb613fd5b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080530 Oct 18 15:30:30.519623 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 762/1531] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:30:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:30:30.534473 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a74c2107-d6cd-4945-a2b5-7f8e79473e9a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:30.535247 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a74c2107-d6cd-4945-a2b5-7f8e79473e9a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 7c7a376f-fa78-4101-adf7-e84f23b4e068] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:30.558950 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a74c2107-d6cd-4945-a2b5-7f8e79473e9a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:30.559368 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a74c2107-d6cd-4945-a2b5-7f8e79473e9a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:30.559800 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a74c2107-d6cd-4945-a2b5-7f8e79473e9a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:30.560506 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a74c2107-d6cd-4945-a2b5-7f8e79473e9a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:30.561025 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a74c2107-d6cd-4945-a2b5-7f8e79473e9a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:30.561531 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a74c2107-d6cd-4945-a2b5-7f8e79473e9a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:31.063626 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a74c2107-d6cd-4945-a2b5-7f8e79473e9a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:31.079972 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a74c2107-d6cd-4945-a2b5-7f8e79473e9a tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/7c7a376f-fa78-4101-adf7-e84f23b4e068" status: 200 len: 1473 microversion: 2.1 time: 0.557576 Oct 18 15:30:31.083480 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 763/1532] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:30 2022] GET /compute/v2.1/servers/7c7a376f-fa78-4101-adf7-e84f23b4e068 => generated 1473 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:31.104221 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-70eab810-efd0-4083-9a6e-12211836987b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:31.104755 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-70eab810-efd0-4083-9a6e-12211836987b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:31.117687 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-70eab810-efd0-4083-9a6e-12211836987b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:31.118551 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-70eab810-efd0-4083-9a6e-12211836987b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:31.119523 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-70eab810-efd0-4083-9a6e-12211836987b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:31.124204 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-70eab810-efd0-4083-9a6e-12211836987b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:31.125259 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-70eab810-efd0-4083-9a6e-12211836987b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:31.125910 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-70eab810-efd0-4083-9a6e-12211836987b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:31.298416 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-70eab810-efd0-4083-9a6e-12211836987b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:31.317964 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-70eab810-efd0-4083-9a6e-12211836987b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:31.333303 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-70eab810-efd0-4083-9a6e-12211836987b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:31.360919 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-70eab810-efd0-4083-9a6e-12211836987b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1555 microversion: 2.91 time: 0.275641 Oct 18 15:30:31.363960 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 764/1533] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:31 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1555 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:30:31.397676 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a394f9e8-9ee7-4407-a8eb-273d08cd98dd tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:31.398344 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a394f9e8-9ee7-4407-a8eb-273d08cd98dd tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] [instance: 5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:31.413669 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a394f9e8-9ee7-4407-a8eb-273d08cd98dd tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:31.414345 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a394f9e8-9ee7-4407-a8eb-273d08cd98dd tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:31.418101 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a394f9e8-9ee7-4407-a8eb-273d08cd98dd tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:31.421345 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a394f9e8-9ee7-4407-a8eb-273d08cd98dd tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:31.421841 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a394f9e8-9ee7-4407-a8eb-273d08cd98dd tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:31.422287 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a394f9e8-9ee7-4407-a8eb-273d08cd98dd tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:31.996422 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a394f9e8-9ee7-4407-a8eb-273d08cd98dd tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe80f2ae3ec4365a031ca7472d76e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df909cb429f46c39a83c29fb260b169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:32.018553 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a394f9e8-9ee7-4407-a8eb-273d08cd98dd tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] 10.222.0.60 "GET /compute/v2.1/servers/5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38" status: 200 len: 1473 microversion: 2.1 time: 0.628561 Oct 18 15:30:32.041157 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 765/1534] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:31 2022] GET /compute/v2.1/servers/5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38 => generated 1473 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:32.055319 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6dd93082-75b2-4d18-a2fe-515014ca9893 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:32.055968 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6dd93082-75b2-4d18-a2fe-515014ca9893 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:32.071122 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6dd93082-75b2-4d18-a2fe-515014ca9893 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:32.071625 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6dd93082-75b2-4d18-a2fe-515014ca9893 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:32.072075 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6dd93082-75b2-4d18-a2fe-515014ca9893 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:32.075430 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6dd93082-75b2-4d18-a2fe-515014ca9893 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:32.076207 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6dd93082-75b2-4d18-a2fe-515014ca9893 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:32.076608 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6dd93082-75b2-4d18-a2fe-515014ca9893 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:32.574106 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6dd93082-75b2-4d18-a2fe-515014ca9893 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:32.594105 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6dd93082-75b2-4d18-a2fe-515014ca9893 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:32.600631 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6dd93082-75b2-4d18-a2fe-515014ca9893 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:32.602133 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6dd93082-75b2-4d18-a2fe-515014ca9893 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793" status: 200 len: 1812 microversion: 2.25 time: 0.565495 Oct 18 15:30:32.603476 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 766/1535] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:32 2022] GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793 => generated 1812 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:30:32.610338 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-cbdf3742-3c94-485b-9fba-a28b18b91c92 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:32.611052 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-cbdf3742-3c94-485b-9fba-a28b18b91c92 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 7c7a376f-fa78-4101-adf7-e84f23b4e068] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:32.626775 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cbdf3742-3c94-485b-9fba-a28b18b91c92 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:32.627861 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cbdf3742-3c94-485b-9fba-a28b18b91c92 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:32.648527 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cbdf3742-3c94-485b-9fba-a28b18b91c92 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:32.652866 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cbdf3742-3c94-485b-9fba-a28b18b91c92 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:32.653313 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cbdf3742-3c94-485b-9fba-a28b18b91c92 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:32.668580 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cbdf3742-3c94-485b-9fba-a28b18b91c92 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:33.582668 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-cbdf3742-3c94-485b-9fba-a28b18b91c92 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:33.597135 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-cbdf3742-3c94-485b-9fba-a28b18b91c92 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/7c7a376f-fa78-4101-adf7-e84f23b4e068" status: 200 len: 1473 microversion: 2.1 time: 0.992365 Oct 18 15:30:33.603637 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 767/1536] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:32 2022] GET /compute/v2.1/servers/7c7a376f-fa78-4101-adf7-e84f23b4e068 => generated 1473 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:33.617100 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3e276914-2017-4092-bd92-a36d0735adca tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:33.617713 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3e276914-2017-4092-bd92-a36d0735adca tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:33.658291 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3e276914-2017-4092-bd92-a36d0735adca tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:33.660031 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3e276914-2017-4092-bd92-a36d0735adca tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:33.660503 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3e276914-2017-4092-bd92-a36d0735adca tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:33.668464 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3e276914-2017-4092-bd92-a36d0735adca tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:33.671203 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3e276914-2017-4092-bd92-a36d0735adca tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:33.673733 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3e276914-2017-4092-bd92-a36d0735adca tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:33.902712 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3e276914-2017-4092-bd92-a36d0735adca tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:33.935211 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3e276914-2017-4092-bd92-a36d0735adca tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:33.936670 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3e276914-2017-4092-bd92-a36d0735adca tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:33.972877 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3e276914-2017-4092-bd92-a36d0735adca tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1555 microversion: 2.91 time: 0.366872 Oct 18 15:30:33.984454 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 768/1537] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:33 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1555 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:30:34.011491 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-e1b51062-8d76-48ff-aea2-33e795d5e5f2 req-4f46eafd-690f-4d59-80ea-7bc702459c74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc806839-862f-4ea7-9078-c970f50b3793", "tag": "6ef23d0f-e4be-4f4e-9d5b-21e8e69f9d6f"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:30:34.058272 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-e1b51062-8d76-48ff-aea2-33e795d5e5f2 req-4f46eafd-690f-4d59-80ea-7bc702459c74 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:34.059804 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-e1b51062-8d76-48ff-aea2-33e795d5e5f2 req-4f46eafd-690f-4d59-80ea-7bc702459c74 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:34.068448 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-e1b51062-8d76-48ff-aea2-33e795d5e5f2 req-4f46eafd-690f-4d59-80ea-7bc702459c74 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:34.126467 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-e1b51062-8d76-48ff-aea2-33e795d5e5f2 req-4f46eafd-690f-4d59-80ea-7bc702459c74 service nova] Creating event network-changed:6ef23d0f-e4be-4f4e-9d5b-21e8e69f9d6f for instance cc806839-862f-4ea7-9078-c970f50b3793 on n-h1-853682-5 Oct 18 15:30:34.145106 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-e1b51062-8d76-48ff-aea2-33e795d5e5f2 req-4f46eafd-690f-4d59-80ea-7bc702459c74 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156683 Oct 18 15:30:34.148738 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 769/1538] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:30:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:30:34.156442 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-010815c3-1eee-44f8-89a6-4a33a5791891 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:34.157610 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-010815c3-1eee-44f8-89a6-4a33a5791891 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] [instance: 5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:34.170411 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-010815c3-1eee-44f8-89a6-4a33a5791891 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:34.172319 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-010815c3-1eee-44f8-89a6-4a33a5791891 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:34.179488 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-010815c3-1eee-44f8-89a6-4a33a5791891 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:34.187354 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-010815c3-1eee-44f8-89a6-4a33a5791891 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:34.190636 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-010815c3-1eee-44f8-89a6-4a33a5791891 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:34.192544 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-010815c3-1eee-44f8-89a6-4a33a5791891 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:34.349687 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-010815c3-1eee-44f8-89a6-4a33a5791891 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:34.350611 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-010815c3-1eee-44f8-89a6-4a33a5791891 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:34.357924 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-010815c3-1eee-44f8-89a6-4a33a5791891 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:34.360215 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-010815c3-1eee-44f8-89a6-4a33a5791891 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lazy-loading 'fault' on Instance uuid 5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:30:34.988727 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-010815c3-1eee-44f8-89a6-4a33a5791891 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe80f2ae3ec4365a031ca7472d76e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df909cb429f46c39a83c29fb260b169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:35.009248 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-010815c3-1eee-44f8-89a6-4a33a5791891 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] 10.222.0.60 "GET /compute/v2.1/servers/5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38" status: 200 len: 1308 microversion: 2.1 time: 0.858630 Oct 18 15:30:35.016164 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 770/1539] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:34 2022] GET /compute/v2.1/servers/5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38 => generated 1308 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:35.029657 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-b5277e82-b09e-4c52-83ff-44450f1fbed8 req-aea86def-e829-47f5-bf0c-0d2a3f65f5e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38", "name": "network-vif-deleted", "tag": "93f89e2b-abbd-43b8-ab95-9c6c72800e89"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:30:35.087619 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-b5277e82-b09e-4c52-83ff-44450f1fbed8 req-aea86def-e829-47f5-bf0c-0d2a3f65f5e6 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:35.090630 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-b5277e82-b09e-4c52-83ff-44450f1fbed8 req-aea86def-e829-47f5-bf0c-0d2a3f65f5e6 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:35.093962 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-b5277e82-b09e-4c52-83ff-44450f1fbed8 req-aea86def-e829-47f5-bf0c-0d2a3f65f5e6 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:35.147524 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-b5277e82-b09e-4c52-83ff-44450f1fbed8 req-aea86def-e829-47f5-bf0c-0d2a3f65f5e6 service nova] Creating event network-vif-deleted:93f89e2b-abbd-43b8-ab95-9c6c72800e89 for instance 5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38 on n-h1-853682-5 Oct 18 15:30:35.177277 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-b5277e82-b09e-4c52-83ff-44450f1fbed8 req-aea86def-e829-47f5-bf0c-0d2a3f65f5e6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147990 Oct 18 15:30:35.181794 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 771/1540] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:30:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:30:35.199722 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-395546af-730b-4724-86bb-aa5cf00adadc tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:35.207817 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-395546af-730b-4724-86bb-aa5cf00adadc tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:35.231074 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-395546af-730b-4724-86bb-aa5cf00adadc tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:35.233371 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-395546af-730b-4724-86bb-aa5cf00adadc tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:35.250758 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-395546af-730b-4724-86bb-aa5cf00adadc tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:35.253314 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-395546af-730b-4724-86bb-aa5cf00adadc tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:35.254346 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-395546af-730b-4724-86bb-aa5cf00adadc tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:35.255228 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-395546af-730b-4724-86bb-aa5cf00adadc tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:37.031856 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-395546af-730b-4724-86bb-aa5cf00adadc tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:37.060410 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-395546af-730b-4724-86bb-aa5cf00adadc tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:37.067121 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-395546af-730b-4724-86bb-aa5cf00adadc tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:37.070101 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-395546af-730b-4724-86bb-aa5cf00adadc tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793" status: 200 len: 1812 microversion: 2.25 time: 1.886691 Oct 18 15:30:37.074344 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 772/1541] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:35 2022] GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793 => generated 1812 bytes in 1892 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:30:37.084303 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d524a622-954a-4d7d-a032-48146f4370bc tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:37.085913 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d524a622-954a-4d7d-a032-48146f4370bc tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 7c7a376f-fa78-4101-adf7-e84f23b4e068] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:37.121815 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d524a622-954a-4d7d-a032-48146f4370bc tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:37.123728 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d524a622-954a-4d7d-a032-48146f4370bc tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:37.125294 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d524a622-954a-4d7d-a032-48146f4370bc tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:37.126806 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d524a622-954a-4d7d-a032-48146f4370bc tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:37.129755 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d524a622-954a-4d7d-a032-48146f4370bc tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:37.130514 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d524a622-954a-4d7d-a032-48146f4370bc tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:37.169722 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-d524a622-954a-4d7d-a032-48146f4370bc tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] HTTP exception thrown: Instance 7c7a376f-fa78-4101-adf7-e84f23b4e068 could not be found. Oct 18 15:30:37.171697 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d524a622-954a-4d7d-a032-48146f4370bc tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Request method failure captured: Oct 18 15:30:37.171697 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/7c7a376f-fa78-4101-adf7-e84f23b4e068 HTTP/1.1 Oct 18 15:30:37.171697 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:30:37.171697 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:30:37.171697 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:30:37.171697 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:30:37.171697 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:30:37.171697 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:30:37.171697 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:30:37.171697 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:30:37.171697 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsXUy9FAAJJ0Ruh4wwEA9szjF7RLudGwF2cxYyUzJkwyma_At_umHw9EflsFK-fFl5HDZF0eGpwWYNbkl96nz5je7IB6PyqBeik4MLzcoYbCjQBM01G06iG1mP4Ny9aewc_L7MlMIXu3Yta_wCU8nd9Gbv-uOlENc7ZsnBI5A37iAsc Oct 18 15:30:37.171697 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:30:37.171697 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:30:37.171697 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:30:37.171697 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:30:37.171697 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:30:37.171697 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:30:37.171697 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 377c3bbd62b546fca545c0f6d0df59e3 Oct 18 15:30:37.171697 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServersOnMultiNodesTest-1788579982 Oct 18 15:30:37.171697 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:30:37.171697 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:30:37.173237 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/377c3bbd62b546fca545c0f6d0df59e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/377c3bbd62b546fca545c0f6d0df59e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/377c3bbd62b546fca545c0f6d0df59e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_377c3bbd62b546fca545c0f6d0df59e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:30:37.173237 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServersOnMultiNodesTest-1788579982 Oct 18 15:30:37.173237 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 377c3bbd62b546fca545c0f6d0df59e3 Oct 18 15:30:37.173237 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1788579982 Oct 18 15:30:37.173237 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServersOnMultiNodesTest-1788579982-project Oct 18 15:30:37.173237 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:30:37.173237 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:30:37.173237 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: d58aac335a1d421a95928e2754fb2529 Oct 18 15:30:37.173237 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServersOnMultiNodesTest-1788579982-project Oct 18 15:30:37.173237 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:30:37.173237 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 7c7a376f-fa78-4101-adf7-e84f23b4e068 could not be found. Oct 18 15:30:37.173237 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '7c7a376f-fa78-4101-adf7-e84f23b4e068'} Oct 18 15:30:37.175543 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:30:37.175543 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:30:37.175543 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:30:37.175543 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:30:37.175543 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:30:37.175543 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:30:37.175543 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:30:37.175543 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:30:37.175543 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:30:37.175543 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:30:37.175543 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c7a376f-fa78-4101-adf7-e84f23b4e068 could not be found. Oct 18 15:30:37.175543 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:30:37.175543 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:30:37.175543 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:30:37.175543 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:30:37.175543 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:30:37.175543 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:30:37.175543 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:30:37.175543 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:30:37.175543 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:30:37.178661 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:30:37.178661 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:30:37.178661 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:30:37.178661 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:30:37.178661 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:30:37.178661 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:30:37.178661 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:30:37.178661 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c7a376f-fa78-4101-adf7-e84f23b4e068 could not be found. Oct 18 15:30:37.178661 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:30:37.178661 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:30:37.178661 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:30:37.178661 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:30:37.178661 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:30:37.178661 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:30:37.178661 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:30:37.178661 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:30:37.178661 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c7a376f-fa78-4101-adf7-e84f23b4e068 could not be found. Oct 18 15:30:37.178661 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:30:37.183897 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d524a622-954a-4d7d-a032-48146f4370bc tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Returning 404 to user: Instance 7c7a376f-fa78-4101-adf7-e84f23b4e068 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:30:37.185553 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d524a622-954a-4d7d-a032-48146f4370bc tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/7c7a376f-fa78-4101-adf7-e84f23b4e068" status: 404 len: 111 microversion: 2.1 time: 0.109416 Oct 18 15:30:37.187450 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 773/1542] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:37 2022] GET /compute/v2.1/servers/7c7a376f-fa78-4101-adf7-e84f23b4e068 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:30:37.195542 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f70c3a28-4880-46c4-b3b3-a9a44e819277 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:37.196796 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f70c3a28-4880-46c4-b3b3-a9a44e819277 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:37.205258 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f70c3a28-4880-46c4-b3b3-a9a44e819277 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:37.206079 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f70c3a28-4880-46c4-b3b3-a9a44e819277 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:37.206855 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f70c3a28-4880-46c4-b3b3-a9a44e819277 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:37.207800 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f70c3a28-4880-46c4-b3b3-a9a44e819277 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:37.209595 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f70c3a28-4880-46c4-b3b3-a9a44e819277 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:37.210279 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f70c3a28-4880-46c4-b3b3-a9a44e819277 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:37.428058 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f70c3a28-4880-46c4-b3b3-a9a44e819277 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:37.457271 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f70c3a28-4880-46c4-b3b3-a9a44e819277 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:37.459350 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f70c3a28-4880-46c4-b3b3-a9a44e819277 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:37.482773 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f70c3a28-4880-46c4-b3b3-a9a44e819277 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1555 microversion: 2.91 time: 0.293219 Oct 18 15:30:37.490503 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 774/1543] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:37 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1555 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:30:37.508709 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a9226581-854e-46e4-8e49-2b7ca1ac1ca7 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:37.509644 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a9226581-854e-46e4-8e49-2b7ca1ac1ca7 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] [instance: 5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:37.533043 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9226581-854e-46e4-8e49-2b7ca1ac1ca7 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:37.538241 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9226581-854e-46e4-8e49-2b7ca1ac1ca7 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:37.540644 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9226581-854e-46e4-8e49-2b7ca1ac1ca7 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:37.541482 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9226581-854e-46e4-8e49-2b7ca1ac1ca7 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:37.541965 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9226581-854e-46e4-8e49-2b7ca1ac1ca7 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:37.546315 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9226581-854e-46e4-8e49-2b7ca1ac1ca7 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:37.607636 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-a9226581-854e-46e4-8e49-2b7ca1ac1ca7 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] HTTP exception thrown: Instance 5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38 could not be found. Oct 18 15:30:37.635702 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a9226581-854e-46e4-8e49-2b7ca1ac1ca7 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Request method failure captured: Oct 18 15:30:37.635702 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38 HTTP/1.1 Oct 18 15:30:37.635702 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:30:37.635702 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:30:37.635702 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:30:37.635702 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:30:37.635702 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:30:37.635702 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:30:37.635702 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:30:37.635702 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:30:37.635702 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsY_cJVstV_UlgeJ2_ro9UnUvp_WMr6EnQPX56LTO_t7Qrbj6Z3OtnIHpl0YZJKzgYXu87BMGGlFTvUFvorWZPKFrJQ8VHcpcNWyMDSlzQ1mtjmE2tMclWKVrI-5YHDorm8Lx1H6DZw3ZJ3-j0-53Chlh9r9pMdJSFVwbrNt1HULqMY Oct 18 15:30:37.635702 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:30:37.635702 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:30:37.635702 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:30:37.635702 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:30:37.635702 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:30:37.635702 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:30:37.635702 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 5df909cb429f46c39a83c29fb260b169 Oct 18 15:30:37.635702 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-LiveMigrationNegativeTest-871860616 Oct 18 15:30:37.635702 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:30:37.635702 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:30:37.637397 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5df909cb429f46c39a83c29fb260b169"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5df909cb429f46c39a83c29fb260b169"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5df909cb429f46c39a83c29fb260b169"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5df909cb429f46c39a83c29fb260b169"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:30:37.637397 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-LiveMigrationNegativeTest-871860616 Oct 18 15:30:37.637397 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 5df909cb429f46c39a83c29fb260b169 Oct 18 15:30:37.637397 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-871860616 Oct 18 15:30:37.637397 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-LiveMigrationNegativeTest-871860616-project Oct 18 15:30:37.637397 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:30:37.637397 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:30:37.637397 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: ebe80f2ae3ec4365a031ca7472d76e33 Oct 18 15:30:37.637397 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-LiveMigrationNegativeTest-871860616-project Oct 18 15:30:37.637397 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:30:37.637397 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38 could not be found. Oct 18 15:30:37.637397 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38'} Oct 18 15:30:37.638226 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:30:37.638226 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:30:37.638226 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:30:37.638226 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:30:37.638226 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:30:37.638226 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:30:37.638226 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:30:37.638226 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:30:37.638226 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:30:37.638226 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:30:37.638226 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38 could not be found. Oct 18 15:30:37.638226 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:30:37.638226 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:30:37.638226 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:30:37.638226 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:30:37.638226 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:30:37.638226 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:30:37.638226 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:30:37.638226 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:30:37.638226 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:30:37.639857 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:30:37.639857 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:30:37.639857 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:30:37.639857 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:30:37.639857 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:30:37.639857 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:30:37.639857 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:30:37.639857 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38 could not be found. Oct 18 15:30:37.639857 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:30:37.639857 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:30:37.639857 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:30:37.639857 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:30:37.639857 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:30:37.639857 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:30:37.639857 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:30:37.639857 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:30:37.639857 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38 could not be found. Oct 18 15:30:37.639857 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:30:37.646676 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a9226581-854e-46e4-8e49-2b7ca1ac1ca7 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] Returning 404 to user: Instance 5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:30:37.651896 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a9226581-854e-46e4-8e49-2b7ca1ac1ca7 tempest-LiveMigrationNegativeTest-871860616 tempest-LiveMigrationNegativeTest-871860616-project] 10.222.0.60 "GET /compute/v2.1/servers/5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38" status: 404 len: 111 microversion: 2.1 time: 0.159746 Oct 18 15:30:37.653755 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 775/1544] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:37 2022] GET /compute/v2.1/servers/5bb8c87b-3ec4-4db5-99af-0c1e4ec49d38 => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:30:37.669372 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-52d385f1-fa8f-4bd6-a0df-bbe610fcc842 req-76fa15f9-6611-4f4c-84cb-153fc31d35f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c7a376f-fa78-4101-adf7-e84f23b4e068", "name": "network-vif-deleted", "tag": "bfb12eda-2062-4a65-ac38-ccc02fcaf772"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:30:37.719947 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-52d385f1-fa8f-4bd6-a0df-bbe610fcc842 req-76fa15f9-6611-4f4c-84cb-153fc31d35f3 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:37.722108 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-52d385f1-fa8f-4bd6-a0df-bbe610fcc842 req-76fa15f9-6611-4f4c-84cb-153fc31d35f3 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:37.722855 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-52d385f1-fa8f-4bd6-a0df-bbe610fcc842 req-76fa15f9-6611-4f4c-84cb-153fc31d35f3 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:37.795682 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:30:37.801779 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-52d385f1-fa8f-4bd6-a0df-bbe610fcc842 req-76fa15f9-6611-4f4c-84cb-153fc31d35f3 service nova] Creating event network-vif-deleted:bfb12eda-2062-4a65-ac38-ccc02fcaf772 for instance 7c7a376f-fa78-4101-adf7-e84f23b4e068 on n-h2-853682-5 Oct 18 15:30:37.840688 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-52d385f1-fa8f-4bd6-a0df-bbe610fcc842 req-76fa15f9-6611-4f4c-84cb-153fc31d35f3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.181808 Oct 18 15:30:37.845286 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 776/1545] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:30:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:30:37.880661 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6a606490-1bd8-488a-b58a-4c193700d093 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:37.881922 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6a606490-1bd8-488a-b58a-4c193700d093 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:37.918541 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6a606490-1bd8-488a-b58a-4c193700d093 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:37.919617 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6a606490-1bd8-488a-b58a-4c193700d093 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:37.928116 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6a606490-1bd8-488a-b58a-4c193700d093 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:37.934345 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6a606490-1bd8-488a-b58a-4c193700d093 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:37.935613 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6a606490-1bd8-488a-b58a-4c193700d093 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:37.938843 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6a606490-1bd8-488a-b58a-4c193700d093 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:38.114485 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6a606490-1bd8-488a-b58a-4c193700d093 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:30:38.435954 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6a606490-1bd8-488a-b58a-4c193700d093 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62" status: 204 len: 0 microversion: 2.1 time: 0.587534 Oct 18 15:30:38.438000 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 777/1546] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:30:37 2022] DELETE /compute/v2.1/servers/f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:30:38.446978 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bacec3cd-4c83-4a0a-8e3d-f866590d3b38 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:38.448384 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-bacec3cd-4c83-4a0a-8e3d-f866590d3b38 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:38.457328 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bacec3cd-4c83-4a0a-8e3d-f866590d3b38 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:38.458320 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bacec3cd-4c83-4a0a-8e3d-f866590d3b38 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:38.459391 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bacec3cd-4c83-4a0a-8e3d-f866590d3b38 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:38.460393 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bacec3cd-4c83-4a0a-8e3d-f866590d3b38 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:38.462535 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bacec3cd-4c83-4a0a-8e3d-f866590d3b38 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:38.463560 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bacec3cd-4c83-4a0a-8e3d-f866590d3b38 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:39.615195 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-bacec3cd-4c83-4a0a-8e3d-f866590d3b38 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:39.643923 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-bacec3cd-4c83-4a0a-8e3d-f866590d3b38 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:39.661502 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-bacec3cd-4c83-4a0a-8e3d-f866590d3b38 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:39.662848 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-bacec3cd-4c83-4a0a-8e3d-f866590d3b38 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793" status: 200 len: 1812 microversion: 2.25 time: 1.223380 Oct 18 15:30:39.663328 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 778/1547] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:38 2022] GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793 => generated 1812 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:30:39.712167 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4977c4be-2fbb-4360-9830-4fb9331ade22 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:39.713404 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4977c4be-2fbb-4360-9830-4fb9331ade22 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:39.756131 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4977c4be-2fbb-4360-9830-4fb9331ade22 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:39.756690 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4977c4be-2fbb-4360-9830-4fb9331ade22 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:39.757196 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4977c4be-2fbb-4360-9830-4fb9331ade22 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:39.757943 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4977c4be-2fbb-4360-9830-4fb9331ade22 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:39.758400 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4977c4be-2fbb-4360-9830-4fb9331ade22 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:39.758821 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4977c4be-2fbb-4360-9830-4fb9331ade22 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:39.944711 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e462f15f-11a5-4a24-a3ce-30623503351c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "DELETE /compute/v2.1/images/55cd5e90-ef2b-4aec-a711-c27fc895dbba" status: 204 len: 0 microversion: 2.1 time: 19.754738 Oct 18 15:30:39.948163 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 770/1548] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:20 2022] DELETE /compute/v2.1/images/55cd5e90-ef2b-4aec-a711-c27fc895dbba => generated 0 bytes in 19760 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:30:39.956958 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d79d52f7-57a1-425b-81de-afc26fc5d20d tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:39.961459 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d79d52f7-57a1-425b-81de-afc26fc5d20d tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:39.991945 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d79d52f7-57a1-425b-81de-afc26fc5d20d tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:39.992458 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d79d52f7-57a1-425b-81de-afc26fc5d20d tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:39.992936 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d79d52f7-57a1-425b-81de-afc26fc5d20d tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:39.993677 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d79d52f7-57a1-425b-81de-afc26fc5d20d tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:39.994140 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d79d52f7-57a1-425b-81de-afc26fc5d20d tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:39.994570 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d79d52f7-57a1-425b-81de-afc26fc5d20d tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:40.650681 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d79d52f7-57a1-425b-81de-afc26fc5d20d tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:40.667096 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d79d52f7-57a1-425b-81de-afc26fc5d20d tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:40.668366 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d79d52f7-57a1-425b-81de-afc26fc5d20d tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:40.713745 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d79d52f7-57a1-425b-81de-afc26fc5d20d tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1555 microversion: 2.91 time: 0.763757 Oct 18 15:30:40.742008 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 771/1549] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:39 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1555 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:30:40.779316 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0ef32f2e-dbff-491d-a792-932511b914da tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:40.781314 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0ef32f2e-dbff-491d-a792-932511b914da tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: ec3790f8-37cf-4e63-b753-83d38e982580] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:40.808055 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ef32f2e-dbff-491d-a792-932511b914da tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:40.808589 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ef32f2e-dbff-491d-a792-932511b914da tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:40.814096 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ef32f2e-dbff-491d-a792-932511b914da tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:40.822923 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ef32f2e-dbff-491d-a792-932511b914da tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:40.826773 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ef32f2e-dbff-491d-a792-932511b914da tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:40.828598 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ef32f2e-dbff-491d-a792-932511b914da tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:40.915772 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4977c4be-2fbb-4360-9830-4fb9331ade22 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:40.918875 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0ef32f2e-dbff-491d-a792-932511b914da tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: ec3790f8-37cf-4e63-b753-83d38e982580] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:30:40.929378 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4977c4be-2fbb-4360-9830-4fb9331ade22 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62" status: 200 len: 1472 microversion: 2.1 time: 1.241276 Oct 18 15:30:40.941776 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 779/1550] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:39 2022] GET /compute/v2.1/servers/f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62 => generated 1472 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:40.964646 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5295a288-df8a-4182-92e9-c58dadf0c0ea tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:40.965462 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5295a288-df8a-4182-92e9-c58dadf0c0ea tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:40.986882 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5295a288-df8a-4182-92e9-c58dadf0c0ea tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:40.992677 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5295a288-df8a-4182-92e9-c58dadf0c0ea tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:40.997686 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5295a288-df8a-4182-92e9-c58dadf0c0ea tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:41.003427 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5295a288-df8a-4182-92e9-c58dadf0c0ea tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:41.004156 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5295a288-df8a-4182-92e9-c58dadf0c0ea tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:41.004799 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5295a288-df8a-4182-92e9-c58dadf0c0ea tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:41.289579 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0ef32f2e-dbff-491d-a792-932511b914da tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ec3790f8-37cf-4e63-b753-83d38e982580" status: 204 len: 0 microversion: 2.1 time: 0.545931 Oct 18 15:30:41.291250 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 772/1551] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:30:40 2022] DELETE /compute/v2.1/servers/ec3790f8-37cf-4e63-b753-83d38e982580 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:30:41.748395 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-137a39d4-e0d6-4348-b100-d2cc490f404e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:41.749563 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-137a39d4-e0d6-4348-b100-d2cc490f404e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:41.771868 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-137a39d4-e0d6-4348-b100-d2cc490f404e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:41.772864 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-137a39d4-e0d6-4348-b100-d2cc490f404e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:41.779894 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-137a39d4-e0d6-4348-b100-d2cc490f404e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:41.782598 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-137a39d4-e0d6-4348-b100-d2cc490f404e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:41.787223 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-137a39d4-e0d6-4348-b100-d2cc490f404e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:41.788007 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-137a39d4-e0d6-4348-b100-d2cc490f404e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:42.515981 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5295a288-df8a-4182-92e9-c58dadf0c0ea tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:42.556681 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-137a39d4-e0d6-4348-b100-d2cc490f404e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:42.569349 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5295a288-df8a-4182-92e9-c58dadf0c0ea tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:42.581079 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5295a288-df8a-4182-92e9-c58dadf0c0ea tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:42.584456 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-137a39d4-e0d6-4348-b100-d2cc490f404e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:42.590105 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5295a288-df8a-4182-92e9-c58dadf0c0ea tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793" status: 200 len: 1812 microversion: 2.25 time: 1.645987 Oct 18 15:30:42.594686 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-137a39d4-e0d6-4348-b100-d2cc490f404e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:42.601244 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 780/1552] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:40 2022] GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793 => generated 1812 bytes in 1658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:30:42.614179 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-45f03208-58d9-4057-a226-059cef6b449f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-208085926", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "ef6fe956-3e84-412d-8f85-8f55d9975d85"}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:30:42.635162 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-137a39d4-e0d6-4348-b100-d2cc490f404e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1555 microversion: 2.91 time: 0.891931 Oct 18 15:30:42.668274 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 773/1553] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:41 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1555 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:30:42.690629 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2b6a5854-7bfd-40ec-aa1d-2a63e8201df0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:42.691248 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2b6a5854-7bfd-40ec-aa1d-2a63e8201df0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:42.728418 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b6a5854-7bfd-40ec-aa1d-2a63e8201df0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:42.737034 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b6a5854-7bfd-40ec-aa1d-2a63e8201df0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:42.737978 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b6a5854-7bfd-40ec-aa1d-2a63e8201df0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:42.741574 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b6a5854-7bfd-40ec-aa1d-2a63e8201df0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:42.746128 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b6a5854-7bfd-40ec-aa1d-2a63e8201df0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:42.749218 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b6a5854-7bfd-40ec-aa1d-2a63e8201df0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:42.894627 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-45f03208-58d9-4057-a226-059cef6b449f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] validate_networks() for [('ef6fe956-3e84-412d-8f85-8f55d9975d85', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:30:43.936850 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2b6a5854-7bfd-40ec-aa1d-2a63e8201df0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:43.947004 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2b6a5854-7bfd-40ec-aa1d-2a63e8201df0 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62" status: 200 len: 1472 microversion: 2.1 time: 1.277390 Oct 18 15:30:43.965047 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 774/1554] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:42 2022] GET /compute/v2.1/servers/f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62 => generated 1472 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:44.009887 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-24917090-39f8-4966-a3ff-d8dbb68faefc tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:44.010617 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-24917090-39f8-4966-a3ff-d8dbb68faefc tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:44.043062 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24917090-39f8-4966-a3ff-d8dbb68faefc tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:44.046831 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24917090-39f8-4966-a3ff-d8dbb68faefc tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:44.048226 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24917090-39f8-4966-a3ff-d8dbb68faefc tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:44.062647 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24917090-39f8-4966-a3ff-d8dbb68faefc tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:44.064046 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24917090-39f8-4966-a3ff-d8dbb68faefc tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:44.067540 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24917090-39f8-4966-a3ff-d8dbb68faefc tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:44.974033 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-24917090-39f8-4966-a3ff-d8dbb68faefc tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:45.055196 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-24917090-39f8-4966-a3ff-d8dbb68faefc tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:45.063741 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-24917090-39f8-4966-a3ff-d8dbb68faefc tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:45.083316 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-24917090-39f8-4966-a3ff-d8dbb68faefc tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793" status: 200 len: 1812 microversion: 2.25 time: 1.116508 Oct 18 15:30:45.084270 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 775/1555] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:43 2022] GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793 => generated 1812 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:30:45.108867 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-64e9cd4c-2adb-4132-801e-2e0b57cc4a95 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:45.109809 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-64e9cd4c-2adb-4132-801e-2e0b57cc4a95 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:45.121976 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64e9cd4c-2adb-4132-801e-2e0b57cc4a95 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:45.126459 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64e9cd4c-2adb-4132-801e-2e0b57cc4a95 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:45.129259 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64e9cd4c-2adb-4132-801e-2e0b57cc4a95 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:45.131300 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64e9cd4c-2adb-4132-801e-2e0b57cc4a95 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:45.135938 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64e9cd4c-2adb-4132-801e-2e0b57cc4a95 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:45.137755 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64e9cd4c-2adb-4132-801e-2e0b57cc4a95 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:45.445984 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-64e9cd4c-2adb-4132-801e-2e0b57cc4a95 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:45.457509 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-64e9cd4c-2adb-4132-801e-2e0b57cc4a95 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:45.479943 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-64e9cd4c-2adb-4132-801e-2e0b57cc4a95 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:45.506110 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-64e9cd4c-2adb-4132-801e-2e0b57cc4a95 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1555 microversion: 2.91 time: 0.407344 Oct 18 15:30:45.511786 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 776/1556] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:45 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1555 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:30:45.516632 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-880a0340-7c81-4705-93a2-193e47ed3530 req-c26e6ff2-58f1-426e-b85e-336c217bedc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62", "name": "network-vif-deleted", "tag": "c40f10a5-5df6-423f-9402-7931e116c295"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:30:45.559389 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-880a0340-7c81-4705-93a2-193e47ed3530 req-c26e6ff2-58f1-426e-b85e-336c217bedc1 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:45.572534 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-880a0340-7c81-4705-93a2-193e47ed3530 req-c26e6ff2-58f1-426e-b85e-336c217bedc1 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:45.573097 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-880a0340-7c81-4705-93a2-193e47ed3530 req-c26e6ff2-58f1-426e-b85e-336c217bedc1 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:45.616049 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-880a0340-7c81-4705-93a2-193e47ed3530 req-c26e6ff2-58f1-426e-b85e-336c217bedc1 service nova] Creating event network-vif-deleted:c40f10a5-5df6-423f-9402-7931e116c295 for instance f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62 on n-h2-853682-5 Oct 18 15:30:45.638742 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-880a0340-7c81-4705-93a2-193e47ed3530 req-c26e6ff2-58f1-426e-b85e-336c217bedc1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125589 Oct 18 15:30:45.654256 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 777/1557] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:30:45.668964 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-16742af5-1586-4c4a-98cb-30ca1bbe56b1 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:45.686121 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-16742af5-1586-4c4a-98cb-30ca1bbe56b1 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:45.717139 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16742af5-1586-4c4a-98cb-30ca1bbe56b1 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:45.726899 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16742af5-1586-4c4a-98cb-30ca1bbe56b1 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:45.730673 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16742af5-1586-4c4a-98cb-30ca1bbe56b1 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:45.732189 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16742af5-1586-4c4a-98cb-30ca1bbe56b1 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:45.733550 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16742af5-1586-4c4a-98cb-30ca1bbe56b1 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:45.734890 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16742af5-1586-4c4a-98cb-30ca1bbe56b1 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:45.863602 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-16742af5-1586-4c4a-98cb-30ca1bbe56b1 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] HTTP exception thrown: Instance f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62 could not be found. Oct 18 15:30:45.868534 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-16742af5-1586-4c4a-98cb-30ca1bbe56b1 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Request method failure captured: Oct 18 15:30:45.868534 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62 HTTP/1.1 Oct 18 15:30:45.868534 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:30:45.868534 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:30:45.868534 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:30:45.868534 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:30:45.868534 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:30:45.868534 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:30:45.868534 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:30:45.868534 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:30:45.868534 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsXUy9FAAJJ0Ruh4wwEA9szjF7RLudGwF2cxYyUzJkwyma_At_umHw9EflsFK-fFl5HDZF0eGpwWYNbkl96nz5je7IB6PyqBeik4MLzcoYbCjQBM01G06iG1mP4Ny9aewc_L7MlMIXu3Yta_wCU8nd9Gbv-uOlENc7ZsnBI5A37iAsc Oct 18 15:30:45.868534 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:30:45.868534 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:30:45.868534 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:30:45.868534 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:30:45.868534 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:30:45.868534 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:30:45.868534 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 377c3bbd62b546fca545c0f6d0df59e3 Oct 18 15:30:45.868534 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersOnMultiNodesTest-1788579982 Oct 18 15:30:45.868534 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:30:45.868534 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:30:45.869995 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/377c3bbd62b546fca545c0f6d0df59e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/377c3bbd62b546fca545c0f6d0df59e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/377c3bbd62b546fca545c0f6d0df59e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_377c3bbd62b546fca545c0f6d0df59e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:30:45.869995 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersOnMultiNodesTest-1788579982 Oct 18 15:30:45.869995 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 377c3bbd62b546fca545c0f6d0df59e3 Oct 18 15:30:45.869995 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1788579982 Oct 18 15:30:45.869995 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersOnMultiNodesTest-1788579982-project Oct 18 15:30:45.869995 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:30:45.869995 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:30:45.869995 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: d58aac335a1d421a95928e2754fb2529 Oct 18 15:30:45.869995 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersOnMultiNodesTest-1788579982-project Oct 18 15:30:45.869995 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:30:45.869995 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62 could not be found. Oct 18 15:30:45.869995 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62'} Oct 18 15:30:45.870784 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:30:45.870784 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:30:45.870784 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:30:45.870784 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:30:45.870784 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:30:45.870784 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:30:45.870784 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:30:45.870784 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:30:45.870784 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:30:45.870784 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:30:45.870784 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62 could not be found. Oct 18 15:30:45.870784 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:30:45.870784 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:30:45.870784 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:30:45.870784 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:30:45.870784 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:30:45.870784 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:30:45.870784 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:30:45.870784 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:30:45.870784 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:30:45.872063 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:30:45.872063 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:30:45.872063 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:30:45.872063 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:30:45.872063 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:30:45.872063 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:30:45.872063 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:30:45.872063 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62 could not be found. Oct 18 15:30:45.872063 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:30:45.872063 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:30:45.872063 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:30:45.872063 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:30:45.872063 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:30:45.872063 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:30:45.872063 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:30:45.872063 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:30:45.872063 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62 could not be found. Oct 18 15:30:45.872063 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:30:45.873277 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-16742af5-1586-4c4a-98cb-30ca1bbe56b1 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Returning 404 to user: Instance f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:30:45.874067 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-16742af5-1586-4c4a-98cb-30ca1bbe56b1 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62" status: 404 len: 111 microversion: 2.1 time: 0.217388 Oct 18 15:30:45.877999 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 778/1558] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:45 2022] GET /compute/v2.1/servers/f7a52d4d-5e70-4fba-b9d5-3a7e79e38c62 => generated 111 bytes in 222 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:30:45.899386 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-cb516b1f-4480-4583-a232-f0b60420206d req-1dd718e2-82ab-4ab5-b806-a4773e5534a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec3790f8-37cf-4e63-b753-83d38e982580", "name": "network-vif-deleted", "tag": "b9fd6f98-f225-43c4-9891-632e489ce46e"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:30:45.945857 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-cb516b1f-4480-4583-a232-f0b60420206d req-1dd718e2-82ab-4ab5-b806-a4773e5534a5 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:45.954032 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-cb516b1f-4480-4583-a232-f0b60420206d req-1dd718e2-82ab-4ab5-b806-a4773e5534a5 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:45.955930 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-cb516b1f-4480-4583-a232-f0b60420206d req-1dd718e2-82ab-4ab5-b806-a4773e5534a5 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:46.016123 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-cb516b1f-4480-4583-a232-f0b60420206d req-1dd718e2-82ab-4ab5-b806-a4773e5534a5 service nova] Creating event network-vif-deleted:b9fd6f98-f225-43c4-9891-632e489ce46e for instance ec3790f8-37cf-4e63-b753-83d38e982580 on n-h2-853682-5 Oct 18 15:30:46.037512 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-cb516b1f-4480-4583-a232-f0b60420206d req-1dd718e2-82ab-4ab5-b806-a4773e5534a5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156204 Oct 18 15:30:46.041672 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 779/1559] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:30:46.070546 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fd9bdc00-7c42-422b-b1e8-14c4e48eb53e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:46.073759 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fd9bdc00-7c42-422b-b1e8-14c4e48eb53e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 803b657a-c370-4fa9-8fbc-27ec5d844758] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:46.101883 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd9bdc00-7c42-422b-b1e8-14c4e48eb53e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:46.106620 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd9bdc00-7c42-422b-b1e8-14c4e48eb53e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:46.108535 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd9bdc00-7c42-422b-b1e8-14c4e48eb53e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:46.113755 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd9bdc00-7c42-422b-b1e8-14c4e48eb53e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:46.114341 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd9bdc00-7c42-422b-b1e8-14c4e48eb53e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:46.114922 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd9bdc00-7c42-422b-b1e8-14c4e48eb53e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:46.205892 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fd9bdc00-7c42-422b-b1e8-14c4e48eb53e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 803b657a-c370-4fa9-8fbc-27ec5d844758] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:30:46.271970 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-45f03208-58d9-4057-a226-059cef6b449f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:30:46.274005 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-45f03208-58d9-4057-a226-059cef6b449f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:30:46.274883 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-45f03208-58d9-4057-a226-059cef6b449f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:30:46.275528 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-45f03208-58d9-4057-a226-059cef6b449f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:30:46.276153 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-45f03208-58d9-4057-a226-059cef6b449f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:30:46.316167 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-45f03208-58d9-4057-a226-059cef6b449f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:46.317931 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-45f03208-58d9-4057-a226-059cef6b449f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:46.319551 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-45f03208-58d9-4057-a226-059cef6b449f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:46.321703 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-45f03208-58d9-4057-a226-059cef6b449f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:46.323005 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-45f03208-58d9-4057-a226-059cef6b449f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:46.326332 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-45f03208-58d9-4057-a226-059cef6b449f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:46.422808 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-45f03208-58d9-4057-a226-059cef6b449f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Getting quotas for project ee0a3f0c256544beb2df4f113da56137. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:30:46.442522 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-45f03208-58d9-4057-a226-059cef6b449f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Getting quotas for user ed9cd936192c40efa9099edee445e90e and project ee0a3f0c256544beb2df4f113da56137. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:30:46.479038 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-45f03208-58d9-4057-a226-059cef6b449f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:30:46.488248 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-45f03208-58d9-4057-a226-059cef6b449f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 44a77c90-3a7e-435e-adba-e3a0551d573f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:30:46.518294 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fd9bdc00-7c42-422b-b1e8-14c4e48eb53e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "DELETE /compute/v2.1/servers/803b657a-c370-4fa9-8fbc-27ec5d844758" status: 204 len: 0 microversion: 2.1 time: 0.463409 Oct 18 15:30:46.520293 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 780/1560] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:30:46 2022] DELETE /compute/v2.1/servers/803b657a-c370-4fa9-8fbc-27ec5d844758 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:30:46.539619 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-023fd9e2-d376-4963-9149-0067225359b1 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:46.546777 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-023fd9e2-d376-4963-9149-0067225359b1 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:46.572281 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-023fd9e2-d376-4963-9149-0067225359b1 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:46.579597 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-023fd9e2-d376-4963-9149-0067225359b1 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:46.585443 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-023fd9e2-d376-4963-9149-0067225359b1 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:46.592529 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-023fd9e2-d376-4963-9149-0067225359b1 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:46.598501 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-45f03208-58d9-4057-a226-059cef6b449f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.995781 Oct 18 15:30:46.599493 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 781/1561] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:30:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 3997 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:30:46.601042 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-023fd9e2-d376-4963-9149-0067225359b1 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:46.601493 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-023fd9e2-d376-4963-9149-0067225359b1 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:46.896948 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-023fd9e2-d376-4963-9149-0067225359b1 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:46.909584 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-023fd9e2-d376-4963-9149-0067225359b1 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:46.926262 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-023fd9e2-d376-4963-9149-0067225359b1 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:46.929210 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-023fd9e2-d376-4963-9149-0067225359b1 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793" status: 200 len: 1812 microversion: 2.25 time: 0.403661 Oct 18 15:30:46.929789 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 781/1562] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:46 2022] GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793 => generated 1812 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:30:46.938467 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-659d384b-3954-4fec-8438-900580156d16 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:46.939212 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-659d384b-3954-4fec-8438-900580156d16 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: fba41720-c579-4efc-acd3-bcd27c6ae037] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:46.969015 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-659d384b-3954-4fec-8438-900580156d16 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:46.971576 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-659d384b-3954-4fec-8438-900580156d16 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:46.973687 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-659d384b-3954-4fec-8438-900580156d16 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:46.975937 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-659d384b-3954-4fec-8438-900580156d16 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:46.976581 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-659d384b-3954-4fec-8438-900580156d16 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:46.981729 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-659d384b-3954-4fec-8438-900580156d16 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:47.015066 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-587115d8-363d-4287-9302-22905a195ab1 tempest-QuotasAdminTestV257-1974304974 tempest-QuotasAdminTestV257-1974304974-project-admin] Action: 'update', calling method: .version_select at 0x7f7c3d01a700>, body: {"quota_set": {"ram": "5120"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:30:47.106907 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-659d384b-3954-4fec-8438-900580156d16 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: fba41720-c579-4efc-acd3-bcd27c6ae037] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:30:47.203036 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-587115d8-363d-4287-9302-22905a195ab1 tempest-QuotasAdminTestV257-1974304974 tempest-QuotasAdminTestV257-1974304974-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:47.203532 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-587115d8-363d-4287-9302-22905a195ab1 tempest-QuotasAdminTestV257-1974304974 tempest-QuotasAdminTestV257-1974304974-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:47.203987 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-587115d8-363d-4287-9302-22905a195ab1 tempest-QuotasAdminTestV257-1974304974 tempest-QuotasAdminTestV257-1974304974-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:47.204759 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-587115d8-363d-4287-9302-22905a195ab1 tempest-QuotasAdminTestV257-1974304974 tempest-QuotasAdminTestV257-1974304974-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:47.209936 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-587115d8-363d-4287-9302-22905a195ab1 tempest-QuotasAdminTestV257-1974304974 tempest-QuotasAdminTestV257-1974304974-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:47.210797 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-587115d8-363d-4287-9302-22905a195ab1 tempest-QuotasAdminTestV257-1974304974 tempest-QuotasAdminTestV257-1974304974-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:47.364770 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-659d384b-3954-4fec-8438-900580156d16 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "DELETE /compute/v2.1/servers/fba41720-c579-4efc-acd3-bcd27c6ae037" status: 204 len: 0 microversion: 2.1 time: 0.433269 Oct 18 15:30:47.367106 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 782/1563] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:30:46 2022] DELETE /compute/v2.1/servers/fba41720-c579-4efc-acd3-bcd27c6ae037 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:30:47.379089 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-33ee7eaf-11ed-4937-bf12-486161d943ab tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:47.382240 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-33ee7eaf-11ed-4937-bf12-486161d943ab tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:47.391653 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-587115d8-363d-4287-9302-22905a195ab1 tempest-QuotasAdminTestV257-1974304974 tempest-QuotasAdminTestV257-1974304974-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/d81cced88c9f47cb8772e95e5af2d2b5" status: 200 len: 148 microversion: 2.57 time: 0.784108 Oct 18 15:30:47.391653 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 782/1564] 10.222.0.60 () {62 vars in 1303 bytes} [Tue Oct 18 15:30:46 2022] PUT /compute/v2.1/os-quota-sets/d81cced88c9f47cb8772e95e5af2d2b5 => generated 148 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:30:47.399771 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33ee7eaf-11ed-4937-bf12-486161d943ab tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:47.400429 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33ee7eaf-11ed-4937-bf12-486161d943ab tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:47.401168 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33ee7eaf-11ed-4937-bf12-486161d943ab tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:47.402379 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33ee7eaf-11ed-4937-bf12-486161d943ab tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:47.403002 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33ee7eaf-11ed-4937-bf12-486161d943ab tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:47.403511 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33ee7eaf-11ed-4937-bf12-486161d943ab tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:47.432095 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-eb104a9f-98e8-490d-bcb8-0ff57bfa0c16 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:47.432832 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-eb104a9f-98e8-490d-bcb8-0ff57bfa0c16 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 44a77c90-3a7e-435e-adba-e3a0551d573f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:47.607511 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-33ee7eaf-11ed-4937-bf12-486161d943ab tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:47.637617 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-33ee7eaf-11ed-4937-bf12-486161d943ab tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:47.640545 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-33ee7eaf-11ed-4937-bf12-486161d943ab tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:47.680282 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-33ee7eaf-11ed-4937-bf12-486161d943ab tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1555 microversion: 2.91 time: 0.311700 Oct 18 15:30:47.682018 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 783/1565] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:47 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1555 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:30:47.689006 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5127e3c5-4519-44f3-93dd-38aaa8b7248f tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:47.689912 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5127e3c5-4519-44f3-93dd-38aaa8b7248f tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 803b657a-c370-4fa9-8fbc-27ec5d844758] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:47.699881 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5127e3c5-4519-44f3-93dd-38aaa8b7248f tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:47.700545 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5127e3c5-4519-44f3-93dd-38aaa8b7248f tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:47.701201 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5127e3c5-4519-44f3-93dd-38aaa8b7248f tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:47.702090 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5127e3c5-4519-44f3-93dd-38aaa8b7248f tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:47.702755 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5127e3c5-4519-44f3-93dd-38aaa8b7248f tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:47.702880 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-eb104a9f-98e8-490d-bcb8-0ff57bfa0c16 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:47.703472 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5127e3c5-4519-44f3-93dd-38aaa8b7248f tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:47.710801 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-eb104a9f-98e8-490d-bcb8-0ff57bfa0c16 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f" status: 200 len: 1207 microversion: 2.1 time: 0.323659 Oct 18 15:30:47.723626 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 783/1566] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:47 2022] GET /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f => generated 1207 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:47.739935 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-793e4642-62d1-4f5e-9382-54b058bbff5e tempest-QuotasAdminTestV257-1974304974 tempest-QuotasAdminTestV257-1974304974-project-admin] Calling method '.version_select at 0x7f7c3d33de50>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:47.753722 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:30:48.031622 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-793e4642-62d1-4f5e-9382-54b058bbff5e tempest-QuotasAdminTestV257-1974304974 tempest-QuotasAdminTestV257-1974304974-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:48.032247 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-793e4642-62d1-4f5e-9382-54b058bbff5e tempest-QuotasAdminTestV257-1974304974 tempest-QuotasAdminTestV257-1974304974-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:48.039282 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-793e4642-62d1-4f5e-9382-54b058bbff5e tempest-QuotasAdminTestV257-1974304974 tempest-QuotasAdminTestV257-1974304974-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:48.040934 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-793e4642-62d1-4f5e-9382-54b058bbff5e tempest-QuotasAdminTestV257-1974304974 tempest-QuotasAdminTestV257-1974304974-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:48.041578 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-793e4642-62d1-4f5e-9382-54b058bbff5e tempest-QuotasAdminTestV257-1974304974 tempest-QuotasAdminTestV257-1974304974-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:48.042996 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-793e4642-62d1-4f5e-9382-54b058bbff5e tempest-QuotasAdminTestV257-1974304974 tempest-QuotasAdminTestV257-1974304974-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:48.122462 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-793e4642-62d1-4f5e-9382-54b058bbff5e tempest-QuotasAdminTestV257-1974304974 tempest-QuotasAdminTestV257-1974304974-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/d81cced88c9f47cb8772e95e5af2d2b5/detail" status: 200 len: 463 microversion: 2.57 time: 0.383368 Oct 18 15:30:48.123147 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 784/1567] 10.222.0.60 () {60 vars in 1304 bytes} [Tue Oct 18 15:30:47 2022] GET /compute/v2.1/os-quota-sets/d81cced88c9f47cb8772e95e5af2d2b5/detail => generated 463 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:30:48.123545 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5127e3c5-4519-44f3-93dd-38aaa8b7248f tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:48.129678 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-350c49f8-1c30-4533-add6-f89b590935c7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:48.130558 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-350c49f8-1c30-4533-add6-f89b590935c7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:48.150393 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5127e3c5-4519-44f3-93dd-38aaa8b7248f tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/803b657a-c370-4fa9-8fbc-27ec5d844758" status: 200 len: 1475 microversion: 2.1 time: 0.449456 Oct 18 15:30:48.152205 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:30:48.154486 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-350c49f8-1c30-4533-add6-f89b590935c7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:48.155345 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-350c49f8-1c30-4533-add6-f89b590935c7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:48.156088 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-350c49f8-1c30-4533-add6-f89b590935c7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:48.157020 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-350c49f8-1c30-4533-add6-f89b590935c7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:48.157641 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-350c49f8-1c30-4533-add6-f89b590935c7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:48.160207 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 784/1568] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:47 2022] GET /compute/v2.1/servers/803b657a-c370-4fa9-8fbc-27ec5d844758 => generated 1475 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:48.161263 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-350c49f8-1c30-4533-add6-f89b590935c7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:48.452566 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-350c49f8-1c30-4533-add6-f89b590935c7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:48.471485 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-350c49f8-1c30-4533-add6-f89b590935c7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:48.474413 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a256149a-a375-4cea-92cf-c5b81052b35f tempest-QuotasAdminTestV257-1974304974 tempest-QuotasAdminTestV257-1974304974-project-admin] Action: 'update', calling method: .version_select at 0x7f7c3d77dd30>, body: {"quota_set": {"ram": "2048"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:30:48.475492 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-350c49f8-1c30-4533-add6-f89b590935c7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:48.479450 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-350c49f8-1c30-4533-add6-f89b590935c7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793" status: 200 len: 1812 microversion: 2.25 time: 0.353140 Oct 18 15:30:48.481288 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 785/1569] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:48 2022] GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793 => generated 1812 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:30:48.716834 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2894d1b7-491d-4d56-a847-7fc40f245194 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:48.717735 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2894d1b7-491d-4d56-a847-7fc40f245194 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:48.736486 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2894d1b7-491d-4d56-a847-7fc40f245194 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:48.737764 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2894d1b7-491d-4d56-a847-7fc40f245194 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:48.740120 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2894d1b7-491d-4d56-a847-7fc40f245194 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:48.741452 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2894d1b7-491d-4d56-a847-7fc40f245194 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:48.745559 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2894d1b7-491d-4d56-a847-7fc40f245194 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:48.749025 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2894d1b7-491d-4d56-a847-7fc40f245194 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:48.781471 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a256149a-a375-4cea-92cf-c5b81052b35f tempest-QuotasAdminTestV257-1974304974 tempest-QuotasAdminTestV257-1974304974-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:48.782227 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a256149a-a375-4cea-92cf-c5b81052b35f tempest-QuotasAdminTestV257-1974304974 tempest-QuotasAdminTestV257-1974304974-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:48.782889 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a256149a-a375-4cea-92cf-c5b81052b35f tempest-QuotasAdminTestV257-1974304974 tempest-QuotasAdminTestV257-1974304974-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:48.784068 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a256149a-a375-4cea-92cf-c5b81052b35f tempest-QuotasAdminTestV257-1974304974 tempest-QuotasAdminTestV257-1974304974-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:48.784717 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a256149a-a375-4cea-92cf-c5b81052b35f tempest-QuotasAdminTestV257-1974304974 tempest-QuotasAdminTestV257-1974304974-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:48.785319 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a256149a-a375-4cea-92cf-c5b81052b35f tempest-QuotasAdminTestV257-1974304974 tempest-QuotasAdminTestV257-1974304974-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:48.888781 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a256149a-a375-4cea-92cf-c5b81052b35f tempest-QuotasAdminTestV257-1974304974 tempest-QuotasAdminTestV257-1974304974-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:48.889655 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a256149a-a375-4cea-92cf-c5b81052b35f tempest-QuotasAdminTestV257-1974304974 tempest-QuotasAdminTestV257-1974304974-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:48.890288 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a256149a-a375-4cea-92cf-c5b81052b35f tempest-QuotasAdminTestV257-1974304974 tempest-QuotasAdminTestV257-1974304974-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:48.896563 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2894d1b7-491d-4d56-a847-7fc40f245194 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:48.898591 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a256149a-a375-4cea-92cf-c5b81052b35f tempest-QuotasAdminTestV257-1974304974 tempest-QuotasAdminTestV257-1974304974-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:48.899310 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a256149a-a375-4cea-92cf-c5b81052b35f tempest-QuotasAdminTestV257-1974304974 tempest-QuotasAdminTestV257-1974304974-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:48.899968 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a256149a-a375-4cea-92cf-c5b81052b35f tempest-QuotasAdminTestV257-1974304974 tempest-QuotasAdminTestV257-1974304974-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:48.962103 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2894d1b7-491d-4d56-a847-7fc40f245194 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:48.963780 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2894d1b7-491d-4d56-a847-7fc40f245194 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:48.987549 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2894d1b7-491d-4d56-a847-7fc40f245194 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1555 microversion: 2.91 time: 0.275658 Oct 18 15:30:48.990337 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 786/1570] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:48 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1555 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:30:49.000987 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-09626c60-ea3d-47be-a2ec-e2174b098548 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:49.003572 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-09626c60-ea3d-47be-a2ec-e2174b098548 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 44a77c90-3a7e-435e-adba-e3a0551d573f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:49.024432 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09626c60-ea3d-47be-a2ec-e2174b098548 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:49.024710 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09626c60-ea3d-47be-a2ec-e2174b098548 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:49.025202 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09626c60-ea3d-47be-a2ec-e2174b098548 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:49.026351 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09626c60-ea3d-47be-a2ec-e2174b098548 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:49.026990 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09626c60-ea3d-47be-a2ec-e2174b098548 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:49.027584 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09626c60-ea3d-47be-a2ec-e2174b098548 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:49.146298 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a256149a-a375-4cea-92cf-c5b81052b35f tempest-QuotasAdminTestV257-1974304974 tempest-QuotasAdminTestV257-1974304974-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/d81cced88c9f47cb8772e95e5af2d2b5?user_id=e473894839ee436990ed4e301eac6aaf" status: 200 len: 148 microversion: 2.57 time: 0.678608 Oct 18 15:30:49.153837 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 785/1571] 10.222.0.60 () {62 vars in 1384 bytes} [Tue Oct 18 15:30:48 2022] PUT /compute/v2.1/os-quota-sets/d81cced88c9f47cb8772e95e5af2d2b5?user_id=e473894839ee436990ed4e301eac6aaf => generated 148 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 15:30:49.164413 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e7003434-0335-4bf8-b9d7-c0f5d23a5bed tempest-QuotasAdminTestV257-1974304974 tempest-QuotasAdminTestV257-1974304974-project-admin] Calling method '.version_select at 0x7f7c3d69da60>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:49.194379 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-09626c60-ea3d-47be-a2ec-e2174b098548 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:49.209552 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-09626c60-ea3d-47be-a2ec-e2174b098548 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f" status: 200 len: 1259 microversion: 2.1 time: 0.217840 Oct 18 15:30:49.212998 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 787/1572] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:48 2022] GET /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f => generated 1259 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:49.224003 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-977d2dae-092f-4a24-9d3d-c97ffcd69d4f tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:49.225558 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-977d2dae-092f-4a24-9d3d-c97ffcd69d4f tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 803b657a-c370-4fa9-8fbc-27ec5d844758] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:49.238807 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-977d2dae-092f-4a24-9d3d-c97ffcd69d4f tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:49.241235 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-977d2dae-092f-4a24-9d3d-c97ffcd69d4f tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:49.242758 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-977d2dae-092f-4a24-9d3d-c97ffcd69d4f tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:49.243669 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-977d2dae-092f-4a24-9d3d-c97ffcd69d4f tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:49.245224 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-977d2dae-092f-4a24-9d3d-c97ffcd69d4f tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:49.248527 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-977d2dae-092f-4a24-9d3d-c97ffcd69d4f tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:49.325729 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e7003434-0335-4bf8-b9d7-c0f5d23a5bed tempest-QuotasAdminTestV257-1974304974 tempest-QuotasAdminTestV257-1974304974-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/d81cced88c9f47cb8772e95e5af2d2b5?user_id=e473894839ee436990ed4e301eac6aaf" status: 200 len: 190 microversion: 2.57 time: 0.164883 Oct 18 15:30:49.331848 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 786/1573] 10.222.0.60 () {60 vars in 1364 bytes} [Tue Oct 18 15:30:49 2022] GET /compute/v2.1/os-quota-sets/d81cced88c9f47cb8772e95e5af2d2b5?user_id=e473894839ee436990ed4e301eac6aaf => generated 190 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:30:49.511591 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3cd3493f-b2e5-4405-ab54-debc3a353388 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:49.512212 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3cd3493f-b2e5-4405-ab54-debc3a353388 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:49.528720 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3cd3493f-b2e5-4405-ab54-debc3a353388 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:49.531655 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3cd3493f-b2e5-4405-ab54-debc3a353388 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:49.533863 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3cd3493f-b2e5-4405-ab54-debc3a353388 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:49.535732 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3cd3493f-b2e5-4405-ab54-debc3a353388 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:49.539075 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3cd3493f-b2e5-4405-ab54-debc3a353388 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:49.539740 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3cd3493f-b2e5-4405-ab54-debc3a353388 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:50.216357 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3cd3493f-b2e5-4405-ab54-debc3a353388 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:50.230353 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3cd3493f-b2e5-4405-ab54-debc3a353388 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:50.236429 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3cd3493f-b2e5-4405-ab54-debc3a353388 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:50.239908 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3cd3493f-b2e5-4405-ab54-debc3a353388 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793" status: 200 len: 1812 microversion: 2.25 time: 0.732859 Oct 18 15:30:50.242025 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 787/1574] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:49 2022] GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793 => generated 1812 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:30:50.260647 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9d76b3ba-c1c2-4127-8aef-685a6931d571 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:50.262448 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9d76b3ba-c1c2-4127-8aef-685a6931d571 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:50.268500 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-977d2dae-092f-4a24-9d3d-c97ffcd69d4f tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:50.290537 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-977d2dae-092f-4a24-9d3d-c97ffcd69d4f tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/803b657a-c370-4fa9-8fbc-27ec5d844758" status: 200 len: 1475 microversion: 2.1 time: 1.072755 Oct 18 15:30:50.295165 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 788/1575] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:49 2022] GET /compute/v2.1/servers/803b657a-c370-4fa9-8fbc-27ec5d844758 => generated 1475 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:50.308756 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d76b3ba-c1c2-4127-8aef-685a6931d571 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:50.309366 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d76b3ba-c1c2-4127-8aef-685a6931d571 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:50.309820 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d76b3ba-c1c2-4127-8aef-685a6931d571 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:50.310549 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d76b3ba-c1c2-4127-8aef-685a6931d571 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:50.311058 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d76b3ba-c1c2-4127-8aef-685a6931d571 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:50.311493 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d76b3ba-c1c2-4127-8aef-685a6931d571 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:50.322806 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a9077545-0813-47ca-96f5-f4c64dcc212f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:50.330473 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a9077545-0813-47ca-96f5-f4c64dcc212f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 44a77c90-3a7e-435e-adba-e3a0551d573f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:50.340710 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9077545-0813-47ca-96f5-f4c64dcc212f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:50.341816 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9077545-0813-47ca-96f5-f4c64dcc212f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:50.342619 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9077545-0813-47ca-96f5-f4c64dcc212f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:50.343644 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9077545-0813-47ca-96f5-f4c64dcc212f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:50.345838 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9077545-0813-47ca-96f5-f4c64dcc212f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:50.346727 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9077545-0813-47ca-96f5-f4c64dcc212f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:50.778160 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a9077545-0813-47ca-96f5-f4c64dcc212f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:50.792647 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a9077545-0813-47ca-96f5-f4c64dcc212f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f" status: 200 len: 1277 microversion: 2.1 time: 0.493283 Oct 18 15:30:50.793546 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 789/1576] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:50 2022] GET /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f => generated 1277 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:50.855441 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9d76b3ba-c1c2-4127-8aef-685a6931d571 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:50.873941 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9d76b3ba-c1c2-4127-8aef-685a6931d571 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:50.878842 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9d76b3ba-c1c2-4127-8aef-685a6931d571 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:50.905272 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9d76b3ba-c1c2-4127-8aef-685a6931d571 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1555 microversion: 2.91 time: 0.660928 Oct 18 15:30:50.905913 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 788/1577] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:50 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1555 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:30:51.101972 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-cd020663-71f9-4fef-a4da-108d51347de6 req-c70324ab-2a22-491f-bcd3-60d76566b8ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fba41720-c579-4efc-acd3-bcd27c6ae037", "name": "network-vif-deleted", "tag": "a75e36c6-b161-4d2e-8a55-6794f0194f5a"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:30:51.125708 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-cd020663-71f9-4fef-a4da-108d51347de6 req-c70324ab-2a22-491f-bcd3-60d76566b8ac service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:51.126849 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-cd020663-71f9-4fef-a4da-108d51347de6 req-c70324ab-2a22-491f-bcd3-60d76566b8ac service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:51.128637 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-cd020663-71f9-4fef-a4da-108d51347de6 req-c70324ab-2a22-491f-bcd3-60d76566b8ac service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:51.170005 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-cd020663-71f9-4fef-a4da-108d51347de6 req-c70324ab-2a22-491f-bcd3-60d76566b8ac service nova] Creating event network-vif-deleted:a75e36c6-b161-4d2e-8a55-6794f0194f5a for instance fba41720-c579-4efc-acd3-bcd27c6ae037 on n-h1-853682-5 Oct 18 15:30:51.183605 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-cd020663-71f9-4fef-a4da-108d51347de6 req-c70324ab-2a22-491f-bcd3-60d76566b8ac service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086370 Oct 18 15:30:51.186517 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 790/1578] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:30:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:30:51.275476 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6fdfc09c-ca19-4834-9268-d028fa9875d3 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:51.277133 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6fdfc09c-ca19-4834-9268-d028fa9875d3 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:51.327697 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e0429659-d6ea-49c1-8621-f7cb98f56f5e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:51.328481 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e0429659-d6ea-49c1-8621-f7cb98f56f5e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 803b657a-c370-4fa9-8fbc-27ec5d844758] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:51.346065 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e0429659-d6ea-49c1-8621-f7cb98f56f5e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:51.347070 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e0429659-d6ea-49c1-8621-f7cb98f56f5e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:51.348766 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e0429659-d6ea-49c1-8621-f7cb98f56f5e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:51.349668 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6fdfc09c-ca19-4834-9268-d028fa9875d3 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:51.350207 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e0429659-d6ea-49c1-8621-f7cb98f56f5e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:51.351027 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e0429659-d6ea-49c1-8621-f7cb98f56f5e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:51.352110 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e0429659-d6ea-49c1-8621-f7cb98f56f5e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:51.354939 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6fdfc09c-ca19-4834-9268-d028fa9875d3 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:51.356946 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6fdfc09c-ca19-4834-9268-d028fa9875d3 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:51.382800 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6fdfc09c-ca19-4834-9268-d028fa9875d3 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:51.383376 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6fdfc09c-ca19-4834-9268-d028fa9875d3 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:51.390372 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6fdfc09c-ca19-4834-9268-d028fa9875d3 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:52.008358 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e0429659-d6ea-49c1-8621-f7cb98f56f5e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:52.021543 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e0429659-d6ea-49c1-8621-f7cb98f56f5e tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/803b657a-c370-4fa9-8fbc-27ec5d844758" status: 200 len: 1304 microversion: 2.1 time: 0.700093 Oct 18 15:30:52.023707 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 791/1579] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:51 2022] GET /compute/v2.1/servers/803b657a-c370-4fa9-8fbc-27ec5d844758 => generated 1304 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:52.038165 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9801e27d-7b53-4971-a4ce-95f715fb5d3a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:52.039280 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9801e27d-7b53-4971-a4ce-95f715fb5d3a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 44a77c90-3a7e-435e-adba-e3a0551d573f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:52.056015 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9801e27d-7b53-4971-a4ce-95f715fb5d3a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:52.065482 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9801e27d-7b53-4971-a4ce-95f715fb5d3a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:52.066295 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9801e27d-7b53-4971-a4ce-95f715fb5d3a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:52.068511 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9801e27d-7b53-4971-a4ce-95f715fb5d3a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:52.070724 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9801e27d-7b53-4971-a4ce-95f715fb5d3a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:52.071582 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9801e27d-7b53-4971-a4ce-95f715fb5d3a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:52.369621 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9801e27d-7b53-4971-a4ce-95f715fb5d3a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:52.385632 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9801e27d-7b53-4971-a4ce-95f715fb5d3a tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f" status: 200 len: 1265 microversion: 2.1 time: 0.354500 Oct 18 15:30:52.386752 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 792/1580] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:52 2022] GET /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f => generated 1265 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:52.392387 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bf00a130-ad38-4fc2-bdee-b99674ab8c1b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:52.400322 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-bf00a130-ad38-4fc2-bdee-b99674ab8c1b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:52.410610 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bf00a130-ad38-4fc2-bdee-b99674ab8c1b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:52.415158 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bf00a130-ad38-4fc2-bdee-b99674ab8c1b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:52.415746 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bf00a130-ad38-4fc2-bdee-b99674ab8c1b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:52.416859 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bf00a130-ad38-4fc2-bdee-b99674ab8c1b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:52.417488 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bf00a130-ad38-4fc2-bdee-b99674ab8c1b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:52.418008 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bf00a130-ad38-4fc2-bdee-b99674ab8c1b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:52.647232 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-bf00a130-ad38-4fc2-bdee-b99674ab8c1b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:52.659219 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-bf00a130-ad38-4fc2-bdee-b99674ab8c1b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:52.661603 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-bf00a130-ad38-4fc2-bdee-b99674ab8c1b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:52.669473 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-bf00a130-ad38-4fc2-bdee-b99674ab8c1b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1537 microversion: 2.91 time: 0.281435 Oct 18 15:30:52.671786 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 793/1581] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:52 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1537 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:30:52.773255 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6fdfc09c-ca19-4834-9268-d028fa9875d3 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:52.786724 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6fdfc09c-ca19-4834-9268-d028fa9875d3 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:52.789909 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6fdfc09c-ca19-4834-9268-d028fa9875d3 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:52.792801 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6fdfc09c-ca19-4834-9268-d028fa9875d3 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793" status: 200 len: 1812 microversion: 2.25 time: 1.522070 Oct 18 15:30:52.797481 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 789/1582] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:51 2022] GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793 => generated 1812 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:30:52.934104 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1880ce8d-8589-411a-b490-7433b5f92b15 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-905913930", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "c8cbad2e-1e4a-4486-8251-0e45cfac1ea9"}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:30:53.048182 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6d3b2e51-ac8e-4f10-a3a2-2ee4e41005fc tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:53.049234 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6d3b2e51-ac8e-4f10-a3a2-2ee4e41005fc tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 803b657a-c370-4fa9-8fbc-27ec5d844758] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:53.062290 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d3b2e51-ac8e-4f10-a3a2-2ee4e41005fc tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:53.062788 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d3b2e51-ac8e-4f10-a3a2-2ee4e41005fc tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:53.063237 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d3b2e51-ac8e-4f10-a3a2-2ee4e41005fc tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:53.070147 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d3b2e51-ac8e-4f10-a3a2-2ee4e41005fc tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:53.070733 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d3b2e51-ac8e-4f10-a3a2-2ee4e41005fc tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:53.073394 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d3b2e51-ac8e-4f10-a3a2-2ee4e41005fc tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:53.082040 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-1880ce8d-8589-411a-b490-7433b5f92b15 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] validate_networks() for [('c8cbad2e-1e4a-4486-8251-0e45cfac1ea9', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:30:53.130940 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-6d3b2e51-ac8e-4f10-a3a2-2ee4e41005fc tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] HTTP exception thrown: Instance 803b657a-c370-4fa9-8fbc-27ec5d844758 could not be found. Oct 18 15:30:53.135038 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6d3b2e51-ac8e-4f10-a3a2-2ee4e41005fc tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Request method failure captured: Oct 18 15:30:53.135038 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/803b657a-c370-4fa9-8fbc-27ec5d844758 HTTP/1.1 Oct 18 15:30:53.135038 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:30:53.135038 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:30:53.135038 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:30:53.135038 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:30:53.135038 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:30:53.135038 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:30:53.135038 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:30:53.135038 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:30:53.135038 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsXUy9FAAJJ0Ruh4wwEA9szjF7RLudGwF2cxYyUzJkwyma_At_umHw9EflsFK-fFl5HDZF0eGpwWYNbkl96nz5je7IB6PyqBeik4MLzcoYbCjQBM01G06iG1mP4Ny9aewc_L7MlMIXu3Yta_wCU8nd9Gbv-uOlENc7ZsnBI5A37iAsc Oct 18 15:30:53.135038 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:30:53.135038 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:30:53.135038 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:30:53.135038 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:30:53.135038 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:30:53.135038 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:30:53.135038 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 377c3bbd62b546fca545c0f6d0df59e3 Oct 18 15:30:53.135038 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersOnMultiNodesTest-1788579982 Oct 18 15:30:53.135038 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:30:53.135038 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:30:53.136764 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/377c3bbd62b546fca545c0f6d0df59e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/377c3bbd62b546fca545c0f6d0df59e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/377c3bbd62b546fca545c0f6d0df59e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_377c3bbd62b546fca545c0f6d0df59e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:30:53.136764 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersOnMultiNodesTest-1788579982 Oct 18 15:30:53.136764 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 377c3bbd62b546fca545c0f6d0df59e3 Oct 18 15:30:53.136764 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1788579982 Oct 18 15:30:53.136764 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersOnMultiNodesTest-1788579982-project Oct 18 15:30:53.136764 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:30:53.136764 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:30:53.136764 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: d58aac335a1d421a95928e2754fb2529 Oct 18 15:30:53.136764 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersOnMultiNodesTest-1788579982-project Oct 18 15:30:53.136764 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:30:53.136764 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 803b657a-c370-4fa9-8fbc-27ec5d844758 could not be found. Oct 18 15:30:53.136764 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '803b657a-c370-4fa9-8fbc-27ec5d844758'} Oct 18 15:30:53.137743 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:30:53.137743 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:30:53.137743 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:30:53.137743 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:30:53.137743 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:30:53.137743 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:30:53.137743 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:30:53.137743 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:30:53.137743 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:30:53.137743 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:30:53.137743 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 803b657a-c370-4fa9-8fbc-27ec5d844758 could not be found. Oct 18 15:30:53.137743 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:30:53.137743 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:30:53.137743 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:30:53.137743 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:30:53.137743 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:30:53.137743 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:30:53.137743 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:30:53.137743 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:30:53.137743 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:30:53.139310 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:30:53.139310 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:30:53.139310 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:30:53.139310 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:30:53.139310 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:30:53.139310 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:30:53.139310 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:30:53.139310 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 803b657a-c370-4fa9-8fbc-27ec5d844758 could not be found. Oct 18 15:30:53.139310 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:30:53.139310 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:30:53.139310 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:30:53.139310 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:30:53.139310 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:30:53.139310 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:30:53.139310 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:30:53.139310 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:30:53.139310 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 803b657a-c370-4fa9-8fbc-27ec5d844758 could not be found. Oct 18 15:30:53.139310 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:30:53.146132 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6d3b2e51-ac8e-4f10-a3a2-2ee4e41005fc tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Returning 404 to user: Instance 803b657a-c370-4fa9-8fbc-27ec5d844758 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:30:53.147913 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6d3b2e51-ac8e-4f10-a3a2-2ee4e41005fc tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/803b657a-c370-4fa9-8fbc-27ec5d844758" status: 404 len: 111 microversion: 2.1 time: 0.103255 Oct 18 15:30:53.152877 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 790/1583] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:53 2022] GET /compute/v2.1/servers/803b657a-c370-4fa9-8fbc-27ec5d844758 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 15:30:53.170578 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-715dc9aa-5429-4854-afc7-95ceaca301db tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:53.172034 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-715dc9aa-5429-4854-afc7-95ceaca301db tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: fba41720-c579-4efc-acd3-bcd27c6ae037] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:53.189772 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-715dc9aa-5429-4854-afc7-95ceaca301db tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:53.190796 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-715dc9aa-5429-4854-afc7-95ceaca301db tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:53.192047 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-715dc9aa-5429-4854-afc7-95ceaca301db tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:53.194907 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-715dc9aa-5429-4854-afc7-95ceaca301db tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:53.195653 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-715dc9aa-5429-4854-afc7-95ceaca301db tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:53.196298 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-715dc9aa-5429-4854-afc7-95ceaca301db tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:53.229674 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-715dc9aa-5429-4854-afc7-95ceaca301db tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] HTTP exception thrown: Instance fba41720-c579-4efc-acd3-bcd27c6ae037 could not be found. Oct 18 15:30:53.231965 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-715dc9aa-5429-4854-afc7-95ceaca301db tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Request method failure captured: Oct 18 15:30:53.231965 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/fba41720-c579-4efc-acd3-bcd27c6ae037 HTTP/1.1 Oct 18 15:30:53.231965 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:30:53.231965 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:30:53.231965 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:30:53.231965 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:30:53.231965 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:30:53.231965 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:30:53.231965 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:30:53.231965 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:30:53.231965 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsXUy9FAAJJ0Ruh4wwEA9szjF7RLudGwF2cxYyUzJkwyma_At_umHw9EflsFK-fFl5HDZF0eGpwWYNbkl96nz5je7IB6PyqBeik4MLzcoYbCjQBM01G06iG1mP4Ny9aewc_L7MlMIXu3Yta_wCU8nd9Gbv-uOlENc7ZsnBI5A37iAsc Oct 18 15:30:53.231965 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:30:53.231965 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:30:53.231965 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:30:53.231965 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:30:53.231965 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:30:53.231965 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:30:53.231965 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 377c3bbd62b546fca545c0f6d0df59e3 Oct 18 15:30:53.231965 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersOnMultiNodesTest-1788579982 Oct 18 15:30:53.231965 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:30:53.231965 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:30:53.233515 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/377c3bbd62b546fca545c0f6d0df59e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/377c3bbd62b546fca545c0f6d0df59e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/377c3bbd62b546fca545c0f6d0df59e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_377c3bbd62b546fca545c0f6d0df59e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:30:53.233515 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersOnMultiNodesTest-1788579982 Oct 18 15:30:53.233515 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 377c3bbd62b546fca545c0f6d0df59e3 Oct 18 15:30:53.233515 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1788579982 Oct 18 15:30:53.233515 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersOnMultiNodesTest-1788579982-project Oct 18 15:30:53.233515 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:30:53.233515 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:30:53.233515 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: d58aac335a1d421a95928e2754fb2529 Oct 18 15:30:53.233515 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersOnMultiNodesTest-1788579982-project Oct 18 15:30:53.233515 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:30:53.233515 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance fba41720-c579-4efc-acd3-bcd27c6ae037 could not be found. Oct 18 15:30:53.233515 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'fba41720-c579-4efc-acd3-bcd27c6ae037'} Oct 18 15:30:53.234344 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:30:53.234344 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:30:53.234344 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:30:53.234344 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:30:53.234344 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:30:53.234344 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:30:53.234344 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:30:53.234344 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:30:53.234344 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:30:53.234344 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:30:53.234344 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fba41720-c579-4efc-acd3-bcd27c6ae037 could not be found. Oct 18 15:30:53.234344 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:30:53.234344 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:30:53.234344 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:30:53.234344 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:30:53.234344 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:30:53.234344 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:30:53.234344 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:30:53.234344 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:30:53.234344 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:30:53.237788 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:30:53.237788 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:30:53.237788 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:30:53.237788 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:30:53.237788 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:30:53.237788 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:30:53.237788 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:30:53.237788 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fba41720-c579-4efc-acd3-bcd27c6ae037 could not be found. Oct 18 15:30:53.237788 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:30:53.237788 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:30:53.237788 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:30:53.237788 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:30:53.237788 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:30:53.237788 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:30:53.237788 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:30:53.237788 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:30:53.237788 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fba41720-c579-4efc-acd3-bcd27c6ae037 could not be found. Oct 18 15:30:53.237788 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:30:53.239148 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-715dc9aa-5429-4854-afc7-95ceaca301db tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Returning 404 to user: Instance fba41720-c579-4efc-acd3-bcd27c6ae037 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:30:53.239148 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-715dc9aa-5429-4854-afc7-95ceaca301db tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/fba41720-c579-4efc-acd3-bcd27c6ae037" status: 404 len: 111 microversion: 2.1 time: 0.076239 Oct 18 15:30:53.239148 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 791/1584] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:53 2022] GET /compute/v2.1/servers/fba41720-c579-4efc-acd3-bcd27c6ae037 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:30:53.258659 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-634e0b1e-e3ca-4ffb-a416-a3066bcedb61 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:53.328694 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:30:53.350811 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-634e0b1e-e3ca-4ffb-a416-a3066bcedb61 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/8facea0e-84b1-4be3-aed0-15854c6df1b4" status: 204 len: 0 microversion: 2.1 time: 0.108537 Oct 18 15:30:53.351443 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 792/1585] 10.222.0.60 () {58 vars in 1266 bytes} [Tue Oct 18 15:30:53 2022] DELETE /compute/v2.1/os-server-groups/8facea0e-84b1-4be3-aed0-15854c6df1b4 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:30:53.359157 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-e97a40bf-09de-434c-869e-a63e899a9d0b req-211a26b1-3336-4c03-9081-f7beea90f2cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "803b657a-c370-4fa9-8fbc-27ec5d844758", "name": "network-vif-deleted", "tag": "63c889c5-9191-4db6-aa38-39459869cc45"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:30:53.381480 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e97a40bf-09de-434c-869e-a63e899a9d0b req-211a26b1-3336-4c03-9081-f7beea90f2cc service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:53.393961 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e97a40bf-09de-434c-869e-a63e899a9d0b req-211a26b1-3336-4c03-9081-f7beea90f2cc service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:53.394608 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e97a40bf-09de-434c-869e-a63e899a9d0b req-211a26b1-3336-4c03-9081-f7beea90f2cc service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:53.416989 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-e97a40bf-09de-434c-869e-a63e899a9d0b req-211a26b1-3336-4c03-9081-f7beea90f2cc service nova] Creating event network-vif-deleted:63c889c5-9191-4db6-aa38-39459869cc45 for instance 803b657a-c370-4fa9-8fbc-27ec5d844758 on n-h2-853682-5 Oct 18 15:30:53.429064 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-e97a40bf-09de-434c-869e-a63e899a9d0b req-211a26b1-3336-4c03-9081-f7beea90f2cc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074019 Oct 18 15:30:53.436449 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 793/1586] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:30:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:30:53.464550 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5f8a12d2-ca5f-4390-a476-9e4b64df6ba9 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:53.469492 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5f8a12d2-ca5f-4390-a476-9e4b64df6ba9 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 92daf2e6-9a72-4b2a-94aa-4316c7edb3c0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:53.479940 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f8a12d2-ca5f-4390-a476-9e4b64df6ba9 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:53.481651 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f8a12d2-ca5f-4390-a476-9e4b64df6ba9 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:53.482651 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f8a12d2-ca5f-4390-a476-9e4b64df6ba9 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:53.486609 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f8a12d2-ca5f-4390-a476-9e4b64df6ba9 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:53.487691 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f8a12d2-ca5f-4390-a476-9e4b64df6ba9 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:53.488477 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f8a12d2-ca5f-4390-a476-9e4b64df6ba9 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:53.548253 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5f8a12d2-ca5f-4390-a476-9e4b64df6ba9 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 92daf2e6-9a72-4b2a-94aa-4316c7edb3c0] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:30:53.744903 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5f8a12d2-ca5f-4390-a476-9e4b64df6ba9 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "DELETE /compute/v2.1/servers/92daf2e6-9a72-4b2a-94aa-4316c7edb3c0" status: 204 len: 0 microversion: 2.1 time: 0.302215 Oct 18 15:30:53.745774 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 794/1587] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:30:53 2022] DELETE /compute/v2.1/servers/92daf2e6-9a72-4b2a-94aa-4316c7edb3c0 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:30:53.754670 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-43d6155d-f3a9-4ce3-a0cd-3bd902d573b9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:53.758496 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-43d6155d-f3a9-4ce3-a0cd-3bd902d573b9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 44a77c90-3a7e-435e-adba-e3a0551d573f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:53.770485 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-43d6155d-f3a9-4ce3-a0cd-3bd902d573b9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:53.772218 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-43d6155d-f3a9-4ce3-a0cd-3bd902d573b9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:53.773089 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-43d6155d-f3a9-4ce3-a0cd-3bd902d573b9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:53.775118 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-43d6155d-f3a9-4ce3-a0cd-3bd902d573b9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:53.776342 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-43d6155d-f3a9-4ce3-a0cd-3bd902d573b9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:53.777083 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-43d6155d-f3a9-4ce3-a0cd-3bd902d573b9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:53.900240 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-43d6155d-f3a9-4ce3-a0cd-3bd902d573b9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:53.929512 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-43d6155d-f3a9-4ce3-a0cd-3bd902d573b9 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f" status: 200 len: 1265 microversion: 2.1 time: 0.179620 Oct 18 15:30:53.941489 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 795/1588] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:53 2022] GET /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f => generated 1265 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:53.955331 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cbb52287-9ba4-4616-9041-5d9722cd5626 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:53.955981 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cbb52287-9ba4-4616-9041-5d9722cd5626 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:53.971220 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbb52287-9ba4-4616-9041-5d9722cd5626 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:53.972273 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbb52287-9ba4-4616-9041-5d9722cd5626 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:53.972933 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbb52287-9ba4-4616-9041-5d9722cd5626 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:53.973881 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbb52287-9ba4-4616-9041-5d9722cd5626 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:53.975850 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbb52287-9ba4-4616-9041-5d9722cd5626 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:53.977160 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbb52287-9ba4-4616-9041-5d9722cd5626 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:54.072207 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cbb52287-9ba4-4616-9041-5d9722cd5626 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:54.087592 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cbb52287-9ba4-4616-9041-5d9722cd5626 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:54.090829 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cbb52287-9ba4-4616-9041-5d9722cd5626 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:54.098770 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cbb52287-9ba4-4616-9041-5d9722cd5626 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1537 microversion: 2.91 time: 0.156166 Oct 18 15:30:54.099560 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 796/1589] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:53 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1537 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:30:54.105879 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6aff8ad5-43d0-4c69-bfda-4e4ff454f4f4 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:54.106621 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6aff8ad5-43d0-4c69-bfda-4e4ff454f4f4 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 13432f77-a4ba-4dea-a1a7-a47fb9b425b9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:54.113786 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6aff8ad5-43d0-4c69-bfda-4e4ff454f4f4 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:54.114578 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6aff8ad5-43d0-4c69-bfda-4e4ff454f4f4 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:54.115202 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6aff8ad5-43d0-4c69-bfda-4e4ff454f4f4 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:54.116153 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6aff8ad5-43d0-4c69-bfda-4e4ff454f4f4 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:54.116770 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6aff8ad5-43d0-4c69-bfda-4e4ff454f4f4 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:54.117395 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6aff8ad5-43d0-4c69-bfda-4e4ff454f4f4 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:54.151420 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6aff8ad5-43d0-4c69-bfda-4e4ff454f4f4 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 13432f77-a4ba-4dea-a1a7-a47fb9b425b9] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:30:54.288330 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6aff8ad5-43d0-4c69-bfda-4e4ff454f4f4 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "DELETE /compute/v2.1/servers/13432f77-a4ba-4dea-a1a7-a47fb9b425b9" status: 204 len: 0 microversion: 2.1 time: 0.186955 Oct 18 15:30:54.289149 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 797/1590] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:30:54 2022] DELETE /compute/v2.1/servers/13432f77-a4ba-4dea-a1a7-a47fb9b425b9 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:30:54.294530 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-86ee7ac7-c230-475b-bc0e-c3ce9a560923 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:54.295220 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-86ee7ac7-c230-475b-bc0e-c3ce9a560923 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:54.302186 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86ee7ac7-c230-475b-bc0e-c3ce9a560923 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:54.302796 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86ee7ac7-c230-475b-bc0e-c3ce9a560923 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:54.303240 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86ee7ac7-c230-475b-bc0e-c3ce9a560923 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:54.303964 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86ee7ac7-c230-475b-bc0e-c3ce9a560923 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:54.304428 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86ee7ac7-c230-475b-bc0e-c3ce9a560923 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:54.304904 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86ee7ac7-c230-475b-bc0e-c3ce9a560923 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:54.637287 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-1880ce8d-8589-411a-b490-7433b5f92b15 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:30:54.639427 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-1880ce8d-8589-411a-b490-7433b5f92b15 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:30:54.640101 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-1880ce8d-8589-411a-b490-7433b5f92b15 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:30:54.645439 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-1880ce8d-8589-411a-b490-7433b5f92b15 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:30:54.646100 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-1880ce8d-8589-411a-b490-7433b5f92b15 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:30:54.657609 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-86ee7ac7-c230-475b-bc0e-c3ce9a560923 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:54.681647 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1880ce8d-8589-411a-b490-7433b5f92b15 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:54.685254 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1880ce8d-8589-411a-b490-7433b5f92b15 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:54.691010 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1880ce8d-8589-411a-b490-7433b5f92b15 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:54.692869 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1880ce8d-8589-411a-b490-7433b5f92b15 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:54.697537 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-86ee7ac7-c230-475b-bc0e-c3ce9a560923 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:54.698510 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1880ce8d-8589-411a-b490-7433b5f92b15 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:54.698981 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1880ce8d-8589-411a-b490-7433b5f92b15 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:54.702386 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-86ee7ac7-c230-475b-bc0e-c3ce9a560923 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:54.703963 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-86ee7ac7-c230-475b-bc0e-c3ce9a560923 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793" status: 200 len: 1802 microversion: 2.25 time: 0.413551 Oct 18 15:30:54.720844 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 798/1591] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:54 2022] GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793 => generated 1802 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:30:54.720844 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3ded7fc4-eb5e-4472-bc91-85244f2613d7 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:54.720844 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3ded7fc4-eb5e-4472-bc91-85244f2613d7 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 92daf2e6-9a72-4b2a-94aa-4316c7edb3c0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:54.722103 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ded7fc4-eb5e-4472-bc91-85244f2613d7 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:54.728568 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ded7fc4-eb5e-4472-bc91-85244f2613d7 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:54.728568 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ded7fc4-eb5e-4472-bc91-85244f2613d7 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:54.728568 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ded7fc4-eb5e-4472-bc91-85244f2613d7 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:54.729202 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ded7fc4-eb5e-4472-bc91-85244f2613d7 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:54.729729 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ded7fc4-eb5e-4472-bc91-85244f2613d7 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:54.776069 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-1880ce8d-8589-411a-b490-7433b5f92b15 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Getting quotas for project 7ae26b8b2a734cb09f6fd2c26f75c66a. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:30:54.785086 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-1880ce8d-8589-411a-b490-7433b5f92b15 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Getting quotas for user 9fd21586dad64dd0832fc9794aa18971 and project 7ae26b8b2a734cb09f6fd2c26f75c66a. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:30:54.831586 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1880ce8d-8589-411a-b490-7433b5f92b15 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:30:54.838630 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1880ce8d-8589-411a-b490-7433b5f92b15 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] [instance: d463b5e2-5fc0-4272-b141-476b1672cb18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:30:54.911691 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1880ce8d-8589-411a-b490-7433b5f92b15 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.220572 Oct 18 15:30:54.912664 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 794/1592] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:30:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2240 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:30:54.917377 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3f6438c5-d5e2-41ec-930e-36583336352a tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Calling method '.version_select at 0x7f7c3d299940>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:54.921610 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3f6438c5-d5e2-41ec-930e-36583336352a tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:54.922130 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3f6438c5-d5e2-41ec-930e-36583336352a tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:54.922581 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3f6438c5-d5e2-41ec-930e-36583336352a tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:54.936232 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3f6438c5-d5e2-41ec-930e-36583336352a tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] 10.222.0.60 "GET /compute/v2.1/os-migrations" status: 200 len: 2780 microversion: 2.25 time: 0.022373 Oct 18 15:30:54.936502 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3ded7fc4-eb5e-4472-bc91-85244f2613d7 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:54.938116 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 795/1593] 10.222.0.60 () {60 vars in 1184 bytes} [Tue Oct 18 15:30:54 2022] GET /compute/v2.1/os-migrations => generated 2780 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:30:54.943951 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d4c703c6-4d2a-4fa8-88e3-54b7d3945642 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:54.944838 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d4c703c6-4d2a-4fa8-88e3-54b7d3945642 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] [instance: d463b5e2-5fc0-4272-b141-476b1672cb18] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:54.989563 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3ded7fc4-eb5e-4472-bc91-85244f2613d7 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/92daf2e6-9a72-4b2a-94aa-4316c7edb3c0" status: 200 len: 1475 microversion: 2.1 time: 0.269683 Oct 18 15:30:54.990253 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 799/1594] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:54 2022] GET /compute/v2.1/servers/92daf2e6-9a72-4b2a-94aa-4316c7edb3c0 => generated 1475 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:55.006600 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ebfcba24-e0a7-4a6c-8b5c-4d9dc808ebf8 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:55.007681 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ebfcba24-e0a7-4a6c-8b5c-4d9dc808ebf8 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:55.015157 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d4c703c6-4d2a-4fa8-88e3-54b7d3945642 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fd21586dad64dd0832fc9794aa18971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae26b8b2a734cb09f6fd2c26f75c66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:55.029461 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d4c703c6-4d2a-4fa8-88e3-54b7d3945642 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] 10.222.0.60 "GET /compute/v2.1/servers/d463b5e2-5fc0-4272-b141-476b1672cb18" status: 200 len: 1215 microversion: 2.1 time: 0.086523 Oct 18 15:30:55.029686 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ebfcba24-e0a7-4a6c-8b5c-4d9dc808ebf8 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:55.030211 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ebfcba24-e0a7-4a6c-8b5c-4d9dc808ebf8 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:55.030727 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ebfcba24-e0a7-4a6c-8b5c-4d9dc808ebf8 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:55.031699 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ebfcba24-e0a7-4a6c-8b5c-4d9dc808ebf8 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:55.033472 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 796/1595] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:54 2022] GET /compute/v2.1/servers/d463b5e2-5fc0-4272-b141-476b1672cb18 => generated 1215 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:55.035760 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ebfcba24-e0a7-4a6c-8b5c-4d9dc808ebf8 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:55.036723 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ebfcba24-e0a7-4a6c-8b5c-4d9dc808ebf8 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:55.043614 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-24eac840-6a57-46ed-8180-4f1b7098a02d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:55.047471 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-24eac840-6a57-46ed-8180-4f1b7098a02d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 44a77c90-3a7e-435e-adba-e3a0551d573f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:55.074236 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-24eac840-6a57-46ed-8180-4f1b7098a02d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:55.075033 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-24eac840-6a57-46ed-8180-4f1b7098a02d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:55.078813 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-24eac840-6a57-46ed-8180-4f1b7098a02d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:55.080294 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-24eac840-6a57-46ed-8180-4f1b7098a02d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:55.088762 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-24eac840-6a57-46ed-8180-4f1b7098a02d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:55.089644 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-24eac840-6a57-46ed-8180-4f1b7098a02d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:55.289814 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-ebfcba24-e0a7-4a6c-8b5c-4d9dc808ebf8 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lazy-loading 'services' on Instance uuid cc806839-862f-4ea7-9078-c970f50b3793 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:30:55.326325 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ebfcba24-e0a7-4a6c-8b5c-4d9dc808ebf8 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793" status: 200 len: 2420 microversion: 2.25 time: 0.331728 Oct 18 15:30:55.327133 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 800/1596] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:54 2022] GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793 => generated 2420 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:30:55.354496 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bd4a79fc-66fb-40d9-913b-7ed9f4f37714 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:55.354868 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bd4a79fc-66fb-40d9-913b-7ed9f4f37714 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:55.361846 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd4a79fc-66fb-40d9-913b-7ed9f4f37714 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:55.362593 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd4a79fc-66fb-40d9-913b-7ed9f4f37714 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:55.363290 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd4a79fc-66fb-40d9-913b-7ed9f4f37714 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:55.364197 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd4a79fc-66fb-40d9-913b-7ed9f4f37714 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:55.365123 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd4a79fc-66fb-40d9-913b-7ed9f4f37714 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:55.365911 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd4a79fc-66fb-40d9-913b-7ed9f4f37714 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:55.469058 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bd4a79fc-66fb-40d9-913b-7ed9f4f37714 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:55.472304 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-24eac840-6a57-46ed-8180-4f1b7098a02d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:55.477477 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:30:55.479931 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:30:55.483041 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bd4a79fc-66fb-40d9-913b-7ed9f4f37714 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:55.483467 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-24eac840-6a57-46ed-8180-4f1b7098a02d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f" status: 200 len: 1307 microversion: 2.1 time: 0.448273 Oct 18 15:30:55.484222 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 797/1597] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:55 2022] GET /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f => generated 1307 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:55.484661 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bd4a79fc-66fb-40d9-913b-7ed9f4f37714 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:55.490020 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2acbe888-824f-4250-8034-fc97a185b071 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:55.490631 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2acbe888-824f-4250-8034-fc97a185b071 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:55.497704 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2acbe888-824f-4250-8034-fc97a185b071 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:55.498192 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2acbe888-824f-4250-8034-fc97a185b071 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:55.498623 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2acbe888-824f-4250-8034-fc97a185b071 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:55.498745 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bd4a79fc-66fb-40d9-913b-7ed9f4f37714 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1537 microversion: 2.91 time: 0.156690 Oct 18 15:30:55.499353 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 801/1598] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:55 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1537 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:30:55.511234 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2acbe888-824f-4250-8034-fc97a185b071 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:55.511234 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2acbe888-824f-4250-8034-fc97a185b071 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:55.511234 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2acbe888-824f-4250-8034-fc97a185b071 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:55.518868 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3573f9aa-605b-4a1e-8e3f-8e3a3c10f813 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1117316692", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "010df557-27fc-4c93-a23e-d2c3321314f6"}], "block_device_mapping_v2": [{"uuid": "f23cad1e-4c28-4ef7-86c7-f3d4db9ee8ae", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:30:55.681826 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-2acbe888-824f-4250-8034-fc97a185b071 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lazy-loading 'services' on Instance uuid cc806839-862f-4ea7-9078-c970f50b3793 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:30:55.718348 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-3573f9aa-605b-4a1e-8e3f-8e3a3c10f813 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] validate_networks() for [('010df557-27fc-4c93-a23e-d2c3321314f6', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:30:55.721247 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2acbe888-824f-4250-8034-fc97a185b071 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793" status: 200 len: 2420 microversion: 2.25 time: 0.235111 Oct 18 15:30:55.722576 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 798/1599] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:55 2022] GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793 => generated 2420 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:30:55.837245 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c4b27499-dd5e-42d2-b364-4338ea3bdd4f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:55.837765 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c4b27499-dd5e-42d2-b364-4338ea3bdd4f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:55.859527 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c4b27499-dd5e-42d2-b364-4338ea3bdd4f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:55.862078 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c4b27499-dd5e-42d2-b364-4338ea3bdd4f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:55.866415 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c4b27499-dd5e-42d2-b364-4338ea3bdd4f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:55.867557 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c4b27499-dd5e-42d2-b364-4338ea3bdd4f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:55.868769 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c4b27499-dd5e-42d2-b364-4338ea3bdd4f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:55.869656 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c4b27499-dd5e-42d2-b364-4338ea3bdd4f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:56.007107 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-c4b27499-dd5e-42d2-b364-4338ea3bdd4f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lazy-loading 'services' on Instance uuid cc806839-862f-4ea7-9078-c970f50b3793 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:30:56.121428 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c4b27499-dd5e-42d2-b364-4338ea3bdd4f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "DELETE /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793/os-volume_attachments/f2a7d035-dd2d-4d67-9a02-e7aaf58af91a" status: 202 len: 0 microversion: 2.25 time: 0.293020 Oct 18 15:30:56.122062 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 799/1600] 10.222.0.60 () {60 vars in 1457 bytes} [Tue Oct 18 15:30:55 2022] DELETE /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793/os-volume_attachments/f2a7d035-dd2d-4d67-9a02-e7aaf58af91a => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:30:56.147066 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-03ebac17-3ae3-45af-b844-fe735929c462 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:56.147800 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-03ebac17-3ae3-45af-b844-fe735929c462 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 92daf2e6-9a72-4b2a-94aa-4316c7edb3c0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:56.170994 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-03ebac17-3ae3-45af-b844-fe735929c462 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:56.171523 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-03ebac17-3ae3-45af-b844-fe735929c462 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:56.172180 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-03ebac17-3ae3-45af-b844-fe735929c462 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:56.172928 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-03ebac17-3ae3-45af-b844-fe735929c462 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:56.173576 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-03ebac17-3ae3-45af-b844-fe735929c462 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:56.174169 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-03ebac17-3ae3-45af-b844-fe735929c462 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:56.464760 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-03ebac17-3ae3-45af-b844-fe735929c462 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:56.476706 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-03ebac17-3ae3-45af-b844-fe735929c462 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/92daf2e6-9a72-4b2a-94aa-4316c7edb3c0" status: 200 len: 1475 microversion: 2.1 time: 0.352349 Oct 18 15:30:56.490038 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 800/1601] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:56 2022] GET /compute/v2.1/servers/92daf2e6-9a72-4b2a-94aa-4316c7edb3c0 => generated 1475 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:56.495824 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-650a15db-3f1a-421c-a42e-6b5f6347ed04 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:56.496657 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-650a15db-3f1a-421c-a42e-6b5f6347ed04 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] [instance: d463b5e2-5fc0-4272-b141-476b1672cb18] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:56.504388 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-650a15db-3f1a-421c-a42e-6b5f6347ed04 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:56.504939 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-650a15db-3f1a-421c-a42e-6b5f6347ed04 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:56.505671 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-650a15db-3f1a-421c-a42e-6b5f6347ed04 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:56.506825 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-650a15db-3f1a-421c-a42e-6b5f6347ed04 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:56.507052 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-650a15db-3f1a-421c-a42e-6b5f6347ed04 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:56.507515 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-650a15db-3f1a-421c-a42e-6b5f6347ed04 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:56.586448 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-3573f9aa-605b-4a1e-8e3f-8e3a3c10f813 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:30:56.586963 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-3573f9aa-605b-4a1e-8e3f-8e3a3c10f813 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:30:56.587322 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-3573f9aa-605b-4a1e-8e3f-8e3a3c10f813 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:30:56.588074 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-3573f9aa-605b-4a1e-8e3f-8e3a3c10f813 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:30:56.588671 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-3573f9aa-605b-4a1e-8e3f-8e3a3c10f813 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:30:56.590316 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-650a15db-3f1a-421c-a42e-6b5f6347ed04 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fd21586dad64dd0832fc9794aa18971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae26b8b2a734cb09f6fd2c26f75c66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:56.598809 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-650a15db-3f1a-421c-a42e-6b5f6347ed04 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] 10.222.0.60 "GET /compute/v2.1/servers/d463b5e2-5fc0-4272-b141-476b1672cb18" status: 200 len: 1267 microversion: 2.1 time: 0.107317 Oct 18 15:30:56.599036 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3573f9aa-605b-4a1e-8e3f-8e3a3c10f813 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:56.599444 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3573f9aa-605b-4a1e-8e3f-8e3a3c10f813 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:56.599756 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3573f9aa-605b-4a1e-8e3f-8e3a3c10f813 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:56.599885 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 801/1602] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:56 2022] GET /compute/v2.1/servers/d463b5e2-5fc0-4272-b141-476b1672cb18 => generated 1267 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:56.600738 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3573f9aa-605b-4a1e-8e3f-8e3a3c10f813 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:56.601365 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3573f9aa-605b-4a1e-8e3f-8e3a3c10f813 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:56.601966 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3573f9aa-605b-4a1e-8e3f-8e3a3c10f813 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:56.608928 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-789d4b8e-bef4-4b4f-8873-a45fe88242c1 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:56.611372 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-789d4b8e-bef4-4b4f-8873-a45fe88242c1 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:56.618268 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-789d4b8e-bef4-4b4f-8873-a45fe88242c1 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:56.618767 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-789d4b8e-bef4-4b4f-8873-a45fe88242c1 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:56.619206 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-789d4b8e-bef4-4b4f-8873-a45fe88242c1 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:56.619910 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-789d4b8e-bef4-4b4f-8873-a45fe88242c1 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:56.620362 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-789d4b8e-bef4-4b4f-8873-a45fe88242c1 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:56.620785 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-789d4b8e-bef4-4b4f-8873-a45fe88242c1 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:56.626800 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-3573f9aa-605b-4a1e-8e3f-8e3a3c10f813 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Getting quotas for project a6565f6ef56e4ed3b530d009055cd619. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:30:56.632681 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-3573f9aa-605b-4a1e-8e3f-8e3a3c10f813 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Getting quotas for user c747aec412924b52b99dbf75d0c77fa4 and project a6565f6ef56e4ed3b530d009055cd619. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:30:56.655008 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-789d4b8e-bef4-4b4f-8873-a45fe88242c1 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.049861 Oct 18 15:30:56.655983 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 802/1603] 10.222.0.60 () {60 vars in 1343 bytes} [Tue Oct 18 15:30:56 2022] GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:30:56.712266 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3573f9aa-605b-4a1e-8e3f-8e3a3c10f813 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:30:56.714388 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3573f9aa-605b-4a1e-8e3f-8e3a3c10f813 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: da62499c-f590-4083-80b6-b849b6695c4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f23cad1e-4c28-4ef7-86c7-f3d4db9ee8ae',volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:30:56.829012 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9fb41518-98c2-43c2-a507-e63ae00b54f8 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-281125344", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": "none"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:30:56.920001 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3573f9aa-605b-4a1e-8e3f-8e3a3c10f813 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.414432 Oct 18 15:30:56.920666 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 802/1604] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:30:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1416 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:30:56.930298 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e1aa8ba7-6279-49b6-9931-3459313a8117 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:56.930921 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e1aa8ba7-6279-49b6-9931-3459313a8117 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 44a77c90-3a7e-435e-adba-e3a0551d573f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:56.942798 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e1aa8ba7-6279-49b6-9931-3459313a8117 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:56.943288 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e1aa8ba7-6279-49b6-9931-3459313a8117 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:56.943910 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e1aa8ba7-6279-49b6-9931-3459313a8117 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:56.944644 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e1aa8ba7-6279-49b6-9931-3459313a8117 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:56.945199 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e1aa8ba7-6279-49b6-9931-3459313a8117 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:56.945619 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e1aa8ba7-6279-49b6-9931-3459313a8117 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:56.951121 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-9fb41518-98c2-43c2-a507-e63ae00b54f8 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:30:56.951792 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-9fb41518-98c2-43c2-a507-e63ae00b54f8 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:30:56.952273 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-9fb41518-98c2-43c2-a507-e63ae00b54f8 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:30:56.953098 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-9fb41518-98c2-43c2-a507-e63ae00b54f8 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:30:56.957255 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-9fb41518-98c2-43c2-a507-e63ae00b54f8 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:30:56.970851 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9fb41518-98c2-43c2-a507-e63ae00b54f8 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:56.971348 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9fb41518-98c2-43c2-a507-e63ae00b54f8 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:56.971902 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9fb41518-98c2-43c2-a507-e63ae00b54f8 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:56.972942 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9fb41518-98c2-43c2-a507-e63ae00b54f8 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:56.973501 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9fb41518-98c2-43c2-a507-e63ae00b54f8 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:56.975657 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9fb41518-98c2-43c2-a507-e63ae00b54f8 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:56.997926 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-9fb41518-98c2-43c2-a507-e63ae00b54f8 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Getting quotas for project 76ad6814a3424a85abc4d07802516718. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:30:57.004406 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-9fb41518-98c2-43c2-a507-e63ae00b54f8 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Getting quotas for user d74d93a92b684aa1aa01c483522bcfd7 and project 76ad6814a3424a85abc4d07802516718. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:30:57.020169 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9fb41518-98c2-43c2-a507-e63ae00b54f8 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:30:57.022608 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9fb41518-98c2-43c2-a507-e63ae00b54f8 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] [instance: 234a024f-c13b-40de-bbcb-ffcdda611d01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:30:57.102139 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9fb41518-98c2-43c2-a507-e63ae00b54f8 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.444107 Oct 18 15:30:57.103525 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 803/1605] 10.222.0.60 () {62 vars in 1188 bytes} [Tue Oct 18 15:30:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 447 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 18 15:30:57.109258 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-062f1921-89b2-4e90-8d25-c92a0fcb2137 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:57.111918 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-062f1921-89b2-4e90-8d25-c92a0fcb2137 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:57.130012 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-062f1921-89b2-4e90-8d25-c92a0fcb2137 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:57.131574 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-062f1921-89b2-4e90-8d25-c92a0fcb2137 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:57.134435 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-062f1921-89b2-4e90-8d25-c92a0fcb2137 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:57.142215 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-062f1921-89b2-4e90-8d25-c92a0fcb2137 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:57.142810 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-062f1921-89b2-4e90-8d25-c92a0fcb2137 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:57.146574 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-062f1921-89b2-4e90-8d25-c92a0fcb2137 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:57.324621 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-062f1921-89b2-4e90-8d25-c92a0fcb2137 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:57.337321 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-062f1921-89b2-4e90-8d25-c92a0fcb2137 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:57.339715 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-062f1921-89b2-4e90-8d25-c92a0fcb2137 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:57.369103 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-062f1921-89b2-4e90-8d25-c92a0fcb2137 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1540 microversion: 2.91 time: 0.261848 Oct 18 15:30:57.369735 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 804/1606] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:57 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1540 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:30:57.388716 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-eae281da-913d-4b47-ba11-56ad4900cbf0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:57.389817 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-eae281da-913d-4b47-ba11-56ad4900cbf0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:57.406023 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e1aa8ba7-6279-49b6-9931-3459313a8117 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:57.417742 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e1aa8ba7-6279-49b6-9931-3459313a8117 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f" status: 200 len: 1307 microversion: 2.1 time: 0.495970 Oct 18 15:30:57.421448 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 803/1607] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:56 2022] GET /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f => generated 1307 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:57.433009 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e3284874-7cec-44ba-baa3-fbf578b7cbbe tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:30:57.435487 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e3284874-7cec-44ba-baa3-fbf578b7cbbe tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] [instance: 234a024f-c13b-40de-bbcb-ffcdda611d01] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:57.904274 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e3284874-7cec-44ba-baa3-fbf578b7cbbe tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:57.915484 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e3284874-7cec-44ba-baa3-fbf578b7cbbe tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:57.917219 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e3284874-7cec-44ba-baa3-fbf578b7cbbe tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:57.928447 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-eae281da-913d-4b47-ba11-56ad4900cbf0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:57.935643 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-eae281da-913d-4b47-ba11-56ad4900cbf0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e" status: 200 len: 1053 microversion: 2.1 time: 0.564841 Oct 18 15:30:57.945608 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 805/1608] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:57 2022] GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e => generated 1053 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:57.956968 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e3284874-7cec-44ba-baa3-fbf578b7cbbe tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] 10.222.0.60 "PUT /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01" status: 200 len: 1358 microversion: 2.75 time: 0.528312 Oct 18 15:30:57.956968 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 804/1609] 10.222.0.60 () {62 vars in 1297 bytes} [Tue Oct 18 15:30:57 2022] PUT /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01 => generated 1358 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:30:57.957188 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-407a8f31-3b34-4fc4-bd40-c94c2960ca38 tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-853682-5"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:30:57.959394 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-003c1a1b-8ee4-4d15-8cf7-b29f4abd2a65 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:57.961499 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-407a8f31-3b34-4fc4-bd40-c94c2960ca38 tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:57.962288 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-003c1a1b-8ee4-4d15-8cf7-b29f4abd2a65 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 92daf2e6-9a72-4b2a-94aa-4316c7edb3c0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:57.982447 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-003c1a1b-8ee4-4d15-8cf7-b29f4abd2a65 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:57.985415 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-407a8f31-3b34-4fc4-bd40-c94c2960ca38 tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:57.987818 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-003c1a1b-8ee4-4d15-8cf7-b29f4abd2a65 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:57.988455 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-003c1a1b-8ee4-4d15-8cf7-b29f4abd2a65 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:57.989664 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-003c1a1b-8ee4-4d15-8cf7-b29f4abd2a65 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:57.997495 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-407a8f31-3b34-4fc4-bd40-c94c2960ca38 tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:57.998219 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-407a8f31-3b34-4fc4-bd40-c94c2960ca38 tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:57.999043 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-003c1a1b-8ee4-4d15-8cf7-b29f4abd2a65 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:57.999960 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-407a8f31-3b34-4fc4-bd40-c94c2960ca38 tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:58.000558 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-003c1a1b-8ee4-4d15-8cf7-b29f4abd2a65 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:58.002653 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-407a8f31-3b34-4fc4-bd40-c94c2960ca38 tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:58.003299 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-407a8f31-3b34-4fc4-bd40-c94c2960ca38 tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:58.135403 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-407a8f31-3b34-4fc4-bd40-c94c2960ca38 tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-853682-5". {{(pid=120405) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 18 15:30:58.270366 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-407a8f31-3b34-4fc4-bd40-c94c2960ca38 tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617/action" status: 202 len: 0 microversion: 2.91 time: 0.323583 Oct 18 15:30:58.270991 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 806/1610] 10.222.0.60 () {62 vars in 1319 bytes} [Tue Oct 18 15:30:57 2022] POST /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:30:58.278281 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0b83bbda-ae3d-4686-971b-c95e40ba342b tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:58.278914 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0b83bbda-ae3d-4686-971b-c95e40ba342b tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] [instance: d463b5e2-5fc0-4272-b141-476b1672cb18] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:58.296276 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0b83bbda-ae3d-4686-971b-c95e40ba342b tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:58.296784 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0b83bbda-ae3d-4686-971b-c95e40ba342b tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:58.297268 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0b83bbda-ae3d-4686-971b-c95e40ba342b tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:58.298058 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0b83bbda-ae3d-4686-971b-c95e40ba342b tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:58.298534 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0b83bbda-ae3d-4686-971b-c95e40ba342b tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:58.298973 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0b83bbda-ae3d-4686-971b-c95e40ba342b tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:58.563029 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0b83bbda-ae3d-4686-971b-c95e40ba342b tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fd21586dad64dd0832fc9794aa18971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae26b8b2a734cb09f6fd2c26f75c66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:58.573886 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0b83bbda-ae3d-4686-971b-c95e40ba342b tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] 10.222.0.60 "GET /compute/v2.1/servers/d463b5e2-5fc0-4272-b141-476b1672cb18" status: 200 len: 1273 microversion: 2.1 time: 0.301602 Oct 18 15:30:58.578371 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 807/1611] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:58 2022] GET /compute/v2.1/servers/d463b5e2-5fc0-4272-b141-476b1672cb18 => generated 1273 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:58.597227 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-939493a4-6f4d-4ca2-bdbf-50591e9cd266 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:58.603954 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-939493a4-6f4d-4ca2-bdbf-50591e9cd266 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:58.619428 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-939493a4-6f4d-4ca2-bdbf-50591e9cd266 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:58.622792 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-939493a4-6f4d-4ca2-bdbf-50591e9cd266 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:58.624265 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-939493a4-6f4d-4ca2-bdbf-50591e9cd266 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:58.627711 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-939493a4-6f4d-4ca2-bdbf-50591e9cd266 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:58.628508 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-939493a4-6f4d-4ca2-bdbf-50591e9cd266 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:58.630666 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-939493a4-6f4d-4ca2-bdbf-50591e9cd266 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:58.699309 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-003c1a1b-8ee4-4d15-8cf7-b29f4abd2a65 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:58.714931 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-003c1a1b-8ee4-4d15-8cf7-b29f4abd2a65 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/92daf2e6-9a72-4b2a-94aa-4316c7edb3c0" status: 200 len: 1475 microversion: 2.1 time: 0.762294 Oct 18 15:30:58.716344 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 805/1612] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:57 2022] GET /compute/v2.1/servers/92daf2e6-9a72-4b2a-94aa-4316c7edb3c0 => generated 1475 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:30:58.725234 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b6fa894f-b095-4ad1-a44e-6a42f6ce9029 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:58.726584 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b6fa894f-b095-4ad1-a44e-6a42f6ce9029 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] [instance: 234a024f-c13b-40de-bbcb-ffcdda611d01] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:58.749744 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b6fa894f-b095-4ad1-a44e-6a42f6ce9029 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:58.749744 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b6fa894f-b095-4ad1-a44e-6a42f6ce9029 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:58.750143 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b6fa894f-b095-4ad1-a44e-6a42f6ce9029 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:58.759156 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-939493a4-6f4d-4ca2-bdbf-50591e9cd266 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.177321 Oct 18 15:30:58.761027 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b6fa894f-b095-4ad1-a44e-6a42f6ce9029 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:58.761851 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b6fa894f-b095-4ad1-a44e-6a42f6ce9029 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:58.762750 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 808/1613] 10.222.0.60 () {60 vars in 1343 bytes} [Tue Oct 18 15:30:58 2022] GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793/os-volume_attachments => generated 197 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:30:58.763515 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b6fa894f-b095-4ad1-a44e-6a42f6ce9029 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:58.785266 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-11bc88dd-db2a-4ad0-887c-73e56d7cedc2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:58.787775 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-11bc88dd-db2a-4ad0-887c-73e56d7cedc2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:58.814835 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-11bc88dd-db2a-4ad0-887c-73e56d7cedc2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:58.815767 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-11bc88dd-db2a-4ad0-887c-73e56d7cedc2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:58.816691 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-11bc88dd-db2a-4ad0-887c-73e56d7cedc2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:58.821176 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-11bc88dd-db2a-4ad0-887c-73e56d7cedc2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:58.822172 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-11bc88dd-db2a-4ad0-887c-73e56d7cedc2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:58.822725 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-11bc88dd-db2a-4ad0-887c-73e56d7cedc2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:59.160634 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b6fa894f-b095-4ad1-a44e-6a42f6ce9029 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:59.162044 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-11bc88dd-db2a-4ad0-887c-73e56d7cedc2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:59.177993 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b6fa894f-b095-4ad1-a44e-6a42f6ce9029 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:59.181530 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-11bc88dd-db2a-4ad0-887c-73e56d7cedc2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:59.188787 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-11bc88dd-db2a-4ad0-887c-73e56d7cedc2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:59.194148 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b6fa894f-b095-4ad1-a44e-6a42f6ce9029 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:30:59.206317 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-11bc88dd-db2a-4ad0-887c-73e56d7cedc2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1488 microversion: 2.91 time: 0.436141 Oct 18 15:30:59.212769 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b6fa894f-b095-4ad1-a44e-6a42f6ce9029 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] 10.222.0.60 "GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01" status: 200 len: 1362 microversion: 2.75 time: 0.495016 Oct 18 15:30:59.213055 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 809/1614] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:58 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1488 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:30:59.225604 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 806/1615] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:30:58 2022] GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01 => generated 1362 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:30:59.229630 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0fa17405-a757-4793-98a0-162579057329 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:59.230261 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0fa17405-a757-4793-98a0-162579057329 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 44a77c90-3a7e-435e-adba-e3a0551d573f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:59.237532 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a73299bd-7097-47e6-9052-b72b2392e330 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:30:59.238337 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a73299bd-7097-47e6-9052-b72b2392e330 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:30:59.246492 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0fa17405-a757-4793-98a0-162579057329 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:59.252204 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a73299bd-7097-47e6-9052-b72b2392e330 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:59.253109 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0fa17405-a757-4793-98a0-162579057329 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:59.257708 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0fa17405-a757-4793-98a0-162579057329 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:59.265881 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0fa17405-a757-4793-98a0-162579057329 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:59.266410 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0fa17405-a757-4793-98a0-162579057329 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:59.266876 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0fa17405-a757-4793-98a0-162579057329 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:59.270717 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a73299bd-7097-47e6-9052-b72b2392e330 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:59.272313 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a73299bd-7097-47e6-9052-b72b2392e330 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:30:59.273091 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a73299bd-7097-47e6-9052-b72b2392e330 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:30:59.278101 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a73299bd-7097-47e6-9052-b72b2392e330 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:30:59.279837 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a73299bd-7097-47e6-9052-b72b2392e330 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:00.070683 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a73299bd-7097-47e6-9052-b72b2392e330 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:00.085579 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a73299bd-7097-47e6-9052-b72b2392e330 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e" status: 200 len: 1151 microversion: 2.1 time: 0.851308 Oct 18 15:31:00.086518 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 807/1616] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:59 2022] GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e => generated 1151 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:00.092193 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-45e9eaf9-6d12-407b-8c5c-96c5a5601db9 req-1e89027b-ac61-4b2a-9de9-f3f9dec6bf02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13432f77-a4ba-4dea-a1a7-a47fb9b425b9", "name": "network-vif-deleted", "tag": "b792d990-7c86-4077-8a5d-ea59cddbd88a"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:31:00.115365 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-45e9eaf9-6d12-407b-8c5c-96c5a5601db9 req-1e89027b-ac61-4b2a-9de9-f3f9dec6bf02 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:00.115913 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-45e9eaf9-6d12-407b-8c5c-96c5a5601db9 req-1e89027b-ac61-4b2a-9de9-f3f9dec6bf02 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:00.116345 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-45e9eaf9-6d12-407b-8c5c-96c5a5601db9 req-1e89027b-ac61-4b2a-9de9-f3f9dec6bf02 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:00.166609 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-45e9eaf9-6d12-407b-8c5c-96c5a5601db9 req-1e89027b-ac61-4b2a-9de9-f3f9dec6bf02 service nova] Creating event network-vif-deleted:b792d990-7c86-4077-8a5d-ea59cddbd88a for instance 13432f77-a4ba-4dea-a1a7-a47fb9b425b9 on n-h1-853682-5 Oct 18 15:31:00.180843 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-45e9eaf9-6d12-407b-8c5c-96c5a5601db9 req-1e89027b-ac61-4b2a-9de9-f3f9dec6bf02 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092002 Oct 18 15:31:00.183743 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 808/1617] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:31:00.199616 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f79612dd-be24-436f-9ddd-547260a1fbae tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:00.200887 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f79612dd-be24-436f-9ddd-547260a1fbae tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] [instance: d463b5e2-5fc0-4272-b141-476b1672cb18] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:00.229918 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f79612dd-be24-436f-9ddd-547260a1fbae tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:00.232678 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f79612dd-be24-436f-9ddd-547260a1fbae tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:00.233944 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f79612dd-be24-436f-9ddd-547260a1fbae tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:00.240109 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f79612dd-be24-436f-9ddd-547260a1fbae tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:00.242065 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f79612dd-be24-436f-9ddd-547260a1fbae tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:00.244871 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f79612dd-be24-436f-9ddd-547260a1fbae tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:00.379251 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0fa17405-a757-4793-98a0-162579057329 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:00.391221 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0fa17405-a757-4793-98a0-162579057329 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f" status: 200 len: 1307 microversion: 2.1 time: 1.176812 Oct 18 15:31:00.393988 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 810/1618] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:30:59 2022] GET /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f => generated 1307 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:00.426621 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-16325aec-99f9-4e1a-81e8-30d4f415da2d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:00.427259 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-16325aec-99f9-4e1a-81e8-30d4f415da2d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 92daf2e6-9a72-4b2a-94aa-4316c7edb3c0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:00.445690 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-16325aec-99f9-4e1a-81e8-30d4f415da2d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:00.446493 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-16325aec-99f9-4e1a-81e8-30d4f415da2d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:00.447188 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-16325aec-99f9-4e1a-81e8-30d4f415da2d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:00.450290 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-16325aec-99f9-4e1a-81e8-30d4f415da2d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:00.451367 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-16325aec-99f9-4e1a-81e8-30d4f415da2d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:00.452222 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-16325aec-99f9-4e1a-81e8-30d4f415da2d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:00.497478 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-16325aec-99f9-4e1a-81e8-30d4f415da2d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:00.498259 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-16325aec-99f9-4e1a-81e8-30d4f415da2d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:00.498932 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-16325aec-99f9-4e1a-81e8-30d4f415da2d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:00.499553 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-16325aec-99f9-4e1a-81e8-30d4f415da2d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lazy-loading 'fault' on Instance uuid 92daf2e6-9a72-4b2a-94aa-4316c7edb3c0 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:31:00.609566 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-16325aec-99f9-4e1a-81e8-30d4f415da2d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:00.624572 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-16325aec-99f9-4e1a-81e8-30d4f415da2d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/92daf2e6-9a72-4b2a-94aa-4316c7edb3c0" status: 200 len: 1309 microversion: 2.1 time: 0.202910 Oct 18 15:31:00.625264 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 811/1619] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:00 2022] GET /compute/v2.1/servers/92daf2e6-9a72-4b2a-94aa-4316c7edb3c0 => generated 1309 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:00.637217 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-29bbdddd-7bef-4952-a137-bd3e1f1f00fc tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:00.648186 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-29bbdddd-7bef-4952-a137-bd3e1f1f00fc tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:00.677716 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-29bbdddd-7bef-4952-a137-bd3e1f1f00fc tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:00.678341 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-29bbdddd-7bef-4952-a137-bd3e1f1f00fc tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:00.678806 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-29bbdddd-7bef-4952-a137-bd3e1f1f00fc tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:00.689794 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-29bbdddd-7bef-4952-a137-bd3e1f1f00fc tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:00.691839 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-29bbdddd-7bef-4952-a137-bd3e1f1f00fc tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:00.692544 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-29bbdddd-7bef-4952-a137-bd3e1f1f00fc tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:00.822765 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-29bbdddd-7bef-4952-a137-bd3e1f1f00fc tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.196189 Oct 18 15:31:00.823703 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 812/1620] 10.222.0.60 () {60 vars in 1343 bytes} [Tue Oct 18 15:31:00 2022] GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793/os-volume_attachments => generated 197 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:31:00.838508 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8dac282b-73b7-4a8d-a553-2a0550b50554 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:00.849313 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8dac282b-73b7-4a8d-a553-2a0550b50554 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:00.856441 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:31:00.872075 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8dac282b-73b7-4a8d-a553-2a0550b50554 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:00.873723 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8dac282b-73b7-4a8d-a553-2a0550b50554 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:00.878509 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8dac282b-73b7-4a8d-a553-2a0550b50554 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:00.880016 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8dac282b-73b7-4a8d-a553-2a0550b50554 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:00.880654 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8dac282b-73b7-4a8d-a553-2a0550b50554 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:00.881224 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8dac282b-73b7-4a8d-a553-2a0550b50554 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:00.887390 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f79612dd-be24-436f-9ddd-547260a1fbae tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fd21586dad64dd0832fc9794aa18971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae26b8b2a734cb09f6fd2c26f75c66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:00.898460 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f79612dd-be24-436f-9ddd-547260a1fbae tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] 10.222.0.60 "GET /compute/v2.1/servers/d463b5e2-5fc0-4272-b141-476b1672cb18" status: 200 len: 1315 microversion: 2.1 time: 0.712141 Oct 18 15:31:00.902734 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 809/1621] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:00 2022] GET /compute/v2.1/servers/d463b5e2-5fc0-4272-b141-476b1672cb18 => generated 1315 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:00.918191 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-aad80123-00c6-4fac-be6e-042ebc102b51 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:00.926011 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:31:00.953043 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-aad80123-00c6-4fac-be6e-042ebc102b51 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] [instance: 234a024f-c13b-40de-bbcb-ffcdda611d01] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:00.977736 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aad80123-00c6-4fac-be6e-042ebc102b51 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:00.978230 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aad80123-00c6-4fac-be6e-042ebc102b51 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:00.978671 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aad80123-00c6-4fac-be6e-042ebc102b51 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:00.979390 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aad80123-00c6-4fac-be6e-042ebc102b51 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:00.979844 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aad80123-00c6-4fac-be6e-042ebc102b51 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:00.980274 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aad80123-00c6-4fac-be6e-042ebc102b51 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:01.100698 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8dac282b-73b7-4a8d-a553-2a0550b50554 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:01.113103 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8dac282b-73b7-4a8d-a553-2a0550b50554 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:01.131184 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8dac282b-73b7-4a8d-a553-2a0550b50554 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:01.153767 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8dac282b-73b7-4a8d-a553-2a0550b50554 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1546 microversion: 2.91 time: 0.327772 Oct 18 15:31:01.155296 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 813/1622] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:00 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1546 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:31:01.171046 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fcf34fc1-e781-40e9-b3b6-838dc4a4326a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:01.177238 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-fcf34fc1-e781-40e9-b3b6-838dc4a4326a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:01.205543 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fcf34fc1-e781-40e9-b3b6-838dc4a4326a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:01.209976 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fcf34fc1-e781-40e9-b3b6-838dc4a4326a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:01.213228 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fcf34fc1-e781-40e9-b3b6-838dc4a4326a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:01.214772 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fcf34fc1-e781-40e9-b3b6-838dc4a4326a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:01.220798 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fcf34fc1-e781-40e9-b3b6-838dc4a4326a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:01.222339 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fcf34fc1-e781-40e9-b3b6-838dc4a4326a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:01.356131 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-aad80123-00c6-4fac-be6e-042ebc102b51 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:01.375573 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-aad80123-00c6-4fac-be6e-042ebc102b51 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:01.384970 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-aad80123-00c6-4fac-be6e-042ebc102b51 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:01.400915 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-aad80123-00c6-4fac-be6e-042ebc102b51 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] 10.222.0.60 "GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01" status: 200 len: 1428 microversion: 2.75 time: 0.495521 Oct 18 15:31:01.402873 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 810/1623] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:00 2022] GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01 => generated 1428 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:31:01.432903 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-bc512202-9db5-49b0-8a2a-33b2c6ca4cbb req-a1b7e1c9-b12e-437c-bd2a-7dbd64e33199 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44a77c90-3a7e-435e-adba-e3a0551d573f", "tag": "80678c44-08fb-43ea-9c10-8772eef6cf68"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:31:01.458527 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-bc512202-9db5-49b0-8a2a-33b2c6ca4cbb req-a1b7e1c9-b12e-437c-bd2a-7dbd64e33199 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:01.459493 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-bc512202-9db5-49b0-8a2a-33b2c6ca4cbb req-a1b7e1c9-b12e-437c-bd2a-7dbd64e33199 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:01.460186 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-bc512202-9db5-49b0-8a2a-33b2c6ca4cbb req-a1b7e1c9-b12e-437c-bd2a-7dbd64e33199 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:01.491647 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-bc512202-9db5-49b0-8a2a-33b2c6ca4cbb req-a1b7e1c9-b12e-437c-bd2a-7dbd64e33199 service nova] Creating event network-changed:80678c44-08fb-43ea-9c10-8772eef6cf68 for instance 44a77c90-3a7e-435e-adba-e3a0551d573f on n-h1-853682-5 Oct 18 15:31:01.504795 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-bc512202-9db5-49b0-8a2a-33b2c6ca4cbb req-a1b7e1c9-b12e-437c-bd2a-7dbd64e33199 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097091 Oct 18 15:31:01.508875 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 811/1624] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:31:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:31:01.524171 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c686d9a9-cdfa-49b6-9f42-61bb32b9e95b tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:01.525228 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c686d9a9-cdfa-49b6-9f42-61bb32b9e95b tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 44a77c90-3a7e-435e-adba-e3a0551d573f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:01.541764 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c686d9a9-cdfa-49b6-9f42-61bb32b9e95b tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:01.542215 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c686d9a9-cdfa-49b6-9f42-61bb32b9e95b tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:01.542655 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c686d9a9-cdfa-49b6-9f42-61bb32b9e95b tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:01.546219 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c686d9a9-cdfa-49b6-9f42-61bb32b9e95b tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:01.549991 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c686d9a9-cdfa-49b6-9f42-61bb32b9e95b tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:01.551417 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c686d9a9-cdfa-49b6-9f42-61bb32b9e95b tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:02.301197 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-fcf34fc1-e781-40e9-b3b6-838dc4a4326a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:02.322361 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fcf34fc1-e781-40e9-b3b6-838dc4a4326a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e" status: 200 len: 1211 microversion: 2.1 time: 1.161931 Oct 18 15:31:02.323262 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 814/1625] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:01 2022] GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e => generated 1211 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:02.345396 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-df6a67fd-23cd-4429-b0fa-5700a6268e9d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:02.346626 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-df6a67fd-23cd-4429-b0fa-5700a6268e9d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 92daf2e6-9a72-4b2a-94aa-4316c7edb3c0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:02.355456 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-df6a67fd-23cd-4429-b0fa-5700a6268e9d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:02.356193 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-df6a67fd-23cd-4429-b0fa-5700a6268e9d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:02.357111 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-df6a67fd-23cd-4429-b0fa-5700a6268e9d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:02.358050 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-df6a67fd-23cd-4429-b0fa-5700a6268e9d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:02.358664 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-df6a67fd-23cd-4429-b0fa-5700a6268e9d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:02.359246 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-df6a67fd-23cd-4429-b0fa-5700a6268e9d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:02.373818 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c686d9a9-cdfa-49b6-9f42-61bb32b9e95b tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:02.389381 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c686d9a9-cdfa-49b6-9f42-61bb32b9e95b tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f" status: 200 len: 1307 microversion: 2.1 time: 0.877822 Oct 18 15:31:02.391256 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 812/1626] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:01 2022] GET /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f => generated 1307 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:02.403101 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-85a94fdd-9848-4001-a6ee-0a1051626521 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:02.408122 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-85a94fdd-9848-4001-a6ee-0a1051626521 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:02.424502 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85a94fdd-9848-4001-a6ee-0a1051626521 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:02.425020 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85a94fdd-9848-4001-a6ee-0a1051626521 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:02.425452 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85a94fdd-9848-4001-a6ee-0a1051626521 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:02.426156 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85a94fdd-9848-4001-a6ee-0a1051626521 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:02.430775 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85a94fdd-9848-4001-a6ee-0a1051626521 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:02.431285 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85a94fdd-9848-4001-a6ee-0a1051626521 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:02.440877 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-df6a67fd-23cd-4429-b0fa-5700a6268e9d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:02.441300 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-df6a67fd-23cd-4429-b0fa-5700a6268e9d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:02.441781 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-df6a67fd-23cd-4429-b0fa-5700a6268e9d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:02.442196 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-df6a67fd-23cd-4429-b0fa-5700a6268e9d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lazy-loading 'fault' on Instance uuid 92daf2e6-9a72-4b2a-94aa-4316c7edb3c0 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:31:02.487216 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-85a94fdd-9848-4001-a6ee-0a1051626521 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.093225 Oct 18 15:31:02.488321 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 813/1627] 10.222.0.60 () {60 vars in 1343 bytes} [Tue Oct 18 15:31:02 2022] GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:31:02.494647 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1a3a64b5-3579-4cba-a065-94512de37be7 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:02.495400 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1a3a64b5-3579-4cba-a065-94512de37be7 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] [instance: d463b5e2-5fc0-4272-b141-476b1672cb18] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:02.506940 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1a3a64b5-3579-4cba-a065-94512de37be7 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:02.507823 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1a3a64b5-3579-4cba-a065-94512de37be7 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:02.508409 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1a3a64b5-3579-4cba-a065-94512de37be7 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:02.509303 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1a3a64b5-3579-4cba-a065-94512de37be7 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:02.509914 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1a3a64b5-3579-4cba-a065-94512de37be7 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:02.510807 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1a3a64b5-3579-4cba-a065-94512de37be7 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:02.779240 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-df6a67fd-23cd-4429-b0fa-5700a6268e9d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:02.787697 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-df6a67fd-23cd-4429-b0fa-5700a6268e9d tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/92daf2e6-9a72-4b2a-94aa-4316c7edb3c0" status: 200 len: 1309 microversion: 2.1 time: 0.461757 Oct 18 15:31:02.791487 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 815/1628] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:02 2022] GET /compute/v2.1/servers/92daf2e6-9a72-4b2a-94aa-4316c7edb3c0 => generated 1309 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:02.801079 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1168d5dc-7fb9-4986-bae4-38c9c04f1aec tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:02.801709 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1168d5dc-7fb9-4986-bae4-38c9c04f1aec tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:02.814383 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1168d5dc-7fb9-4986-bae4-38c9c04f1aec tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:02.814886 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1168d5dc-7fb9-4986-bae4-38c9c04f1aec tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:02.815332 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1168d5dc-7fb9-4986-bae4-38c9c04f1aec tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:02.816052 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1168d5dc-7fb9-4986-bae4-38c9c04f1aec tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:02.816518 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1168d5dc-7fb9-4986-bae4-38c9c04f1aec tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:02.816980 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1168d5dc-7fb9-4986-bae4-38c9c04f1aec tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:02.952594 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1168d5dc-7fb9-4986-bae4-38c9c04f1aec tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:02.962261 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1168d5dc-7fb9-4986-bae4-38c9c04f1aec tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:02.973992 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1168d5dc-7fb9-4986-bae4-38c9c04f1aec tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:02.988311 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1168d5dc-7fb9-4986-bae4-38c9c04f1aec tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1546 microversion: 2.91 time: 0.195680 Oct 18 15:31:02.989507 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 816/1629] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:02 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1546 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:31:02.998559 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4c2c8663-0393-4c8a-8395-0458836ea530 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:02.999432 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4c2c8663-0393-4c8a-8395-0458836ea530 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] [instance: 234a024f-c13b-40de-bbcb-ffcdda611d01] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:03.014730 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4c2c8663-0393-4c8a-8395-0458836ea530 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:03.015486 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4c2c8663-0393-4c8a-8395-0458836ea530 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:03.016121 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4c2c8663-0393-4c8a-8395-0458836ea530 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:03.017097 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4c2c8663-0393-4c8a-8395-0458836ea530 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:03.017849 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4c2c8663-0393-4c8a-8395-0458836ea530 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:03.018532 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4c2c8663-0393-4c8a-8395-0458836ea530 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:03.194656 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4c2c8663-0393-4c8a-8395-0458836ea530 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:03.212711 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4c2c8663-0393-4c8a-8395-0458836ea530 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:03.215362 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4c2c8663-0393-4c8a-8395-0458836ea530 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:03.221526 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1a3a64b5-3579-4cba-a065-94512de37be7 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fd21586dad64dd0832fc9794aa18971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae26b8b2a734cb09f6fd2c26f75c66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:03.230264 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1a3a64b5-3579-4cba-a065-94512de37be7 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] 10.222.0.60 "GET /compute/v2.1/servers/d463b5e2-5fc0-4272-b141-476b1672cb18" status: 200 len: 1315 microversion: 2.1 time: 0.740766 Oct 18 15:31:03.234060 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 814/1630] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:02 2022] GET /compute/v2.1/servers/d463b5e2-5fc0-4272-b141-476b1672cb18 => generated 1315 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:03.239348 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-6527f577-06ba-487f-a172-4d83965fd968 req-6c5e65cd-a26a-4d5a-bf7a-086d8d1047b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92daf2e6-9a72-4b2a-94aa-4316c7edb3c0", "name": "network-vif-deleted", "tag": "311e5c1f-7a46-43b7-bc59-f1a84c1c33de"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:31:03.241062 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4c2c8663-0393-4c8a-8395-0458836ea530 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] 10.222.0.60 "GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01" status: 200 len: 1416 microversion: 2.75 time: 0.250201 Oct 18 15:31:03.242079 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 817/1631] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:02 2022] GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01 => generated 1416 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:31:03.251810 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-946789bd-b1a1-4dad-b46e-da5d64a0b104 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:03.252836 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-946789bd-b1a1-4dad-b46e-da5d64a0b104 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:03.261408 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6527f577-06ba-487f-a172-4d83965fd968 req-6c5e65cd-a26a-4d5a-bf7a-086d8d1047b1 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:03.263947 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6527f577-06ba-487f-a172-4d83965fd968 req-6c5e65cd-a26a-4d5a-bf7a-086d8d1047b1 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:03.264982 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6527f577-06ba-487f-a172-4d83965fd968 req-6c5e65cd-a26a-4d5a-bf7a-086d8d1047b1 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:03.267032 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-946789bd-b1a1-4dad-b46e-da5d64a0b104 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:03.267796 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-946789bd-b1a1-4dad-b46e-da5d64a0b104 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:03.268474 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-946789bd-b1a1-4dad-b46e-da5d64a0b104 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:03.273839 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-946789bd-b1a1-4dad-b46e-da5d64a0b104 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:03.274696 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-946789bd-b1a1-4dad-b46e-da5d64a0b104 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:03.275385 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-946789bd-b1a1-4dad-b46e-da5d64a0b104 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:03.296951 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-6527f577-06ba-487f-a172-4d83965fd968 req-6c5e65cd-a26a-4d5a-bf7a-086d8d1047b1 service nova] Creating event network-vif-deleted:311e5c1f-7a46-43b7-bc59-f1a84c1c33de for instance 92daf2e6-9a72-4b2a-94aa-4316c7edb3c0 on n-h1-853682-5 Oct 18 15:31:03.305742 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-6527f577-06ba-487f-a172-4d83965fd968 req-6c5e65cd-a26a-4d5a-bf7a-086d8d1047b1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069730 Oct 18 15:31:03.310581 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 815/1632] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:31:03.347746 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-686ab9ac-216b-40fd-bfb8-1a4d3b38e24c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:03.348631 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-686ab9ac-216b-40fd-bfb8-1a4d3b38e24c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:03.370588 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-686ab9ac-216b-40fd-bfb8-1a4d3b38e24c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:03.371504 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-686ab9ac-216b-40fd-bfb8-1a4d3b38e24c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:03.372180 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-686ab9ac-216b-40fd-bfb8-1a4d3b38e24c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:03.373177 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-686ab9ac-216b-40fd-bfb8-1a4d3b38e24c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:03.373872 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-686ab9ac-216b-40fd-bfb8-1a4d3b38e24c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:03.374993 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-686ab9ac-216b-40fd-bfb8-1a4d3b38e24c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:03.647920 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-686ab9ac-216b-40fd-bfb8-1a4d3b38e24c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:03.662315 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-686ab9ac-216b-40fd-bfb8-1a4d3b38e24c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e" status: 200 len: 1211 microversion: 2.1 time: 0.318672 Oct 18 15:31:03.679706 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 816/1633] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:03 2022] GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e => generated 1211 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:31:03.694156 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7f60f421-8df6-4bac-9daa-f06e1e8067c3 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:03.695313 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7f60f421-8df6-4bac-9daa-f06e1e8067c3 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 44a77c90-3a7e-435e-adba-e3a0551d573f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:03.703575 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f60f421-8df6-4bac-9daa-f06e1e8067c3 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:03.705350 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f60f421-8df6-4bac-9daa-f06e1e8067c3 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:03.706028 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f60f421-8df6-4bac-9daa-f06e1e8067c3 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:03.706956 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f60f421-8df6-4bac-9daa-f06e1e8067c3 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:03.707627 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f60f421-8df6-4bac-9daa-f06e1e8067c3 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:03.733123 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f60f421-8df6-4bac-9daa-f06e1e8067c3 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:04.310424 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-946789bd-b1a1-4dad-b46e-da5d64a0b104 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:04.322094 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-946789bd-b1a1-4dad-b46e-da5d64a0b104 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:04.330193 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-946789bd-b1a1-4dad-b46e-da5d64a0b104 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:04.331834 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-946789bd-b1a1-4dad-b46e-da5d64a0b104 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 2955 microversion: 2.42 time: 1.088726 Oct 18 15:31:04.337579 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 818/1634] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:03 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 2955 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:31:04.342723 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d91029fa-d8a5-4699-ab78-c96b520c3152 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:04.355512 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d91029fa-d8a5-4699-ab78-c96b520c3152 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:04.364604 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d91029fa-d8a5-4699-ab78-c96b520c3152 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:04.365412 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d91029fa-d8a5-4699-ab78-c96b520c3152 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:04.366419 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d91029fa-d8a5-4699-ab78-c96b520c3152 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:04.369744 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d91029fa-d8a5-4699-ab78-c96b520c3152 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:04.370449 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d91029fa-d8a5-4699-ab78-c96b520c3152 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:04.371059 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d91029fa-d8a5-4699-ab78-c96b520c3152 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:04.440038 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d91029fa-d8a5-4699-ab78-c96b520c3152 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.101073 Oct 18 15:31:04.448684 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 819/1635] 10.222.0.60 () {60 vars in 1343 bytes} [Tue Oct 18 15:31:04 2022] GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:31:04.465991 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-476a9c0b-8249-4428-942a-19af6bba90b2 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:04.466561 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7f60f421-8df6-4bac-9daa-f06e1e8067c3 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:04.467077 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-476a9c0b-8249-4428-942a-19af6bba90b2 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 92daf2e6-9a72-4b2a-94aa-4316c7edb3c0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:04.473865 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-476a9c0b-8249-4428-942a-19af6bba90b2 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:04.474203 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-476a9c0b-8249-4428-942a-19af6bba90b2 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:04.475217 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-476a9c0b-8249-4428-942a-19af6bba90b2 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:04.476236 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-476a9c0b-8249-4428-942a-19af6bba90b2 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:04.476918 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-476a9c0b-8249-4428-942a-19af6bba90b2 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:04.486163 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-476a9c0b-8249-4428-942a-19af6bba90b2 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:04.504670 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7f60f421-8df6-4bac-9daa-f06e1e8067c3 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f" status: 200 len: 1307 microversion: 2.1 time: 0.823286 Oct 18 15:31:04.505323 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 817/1636] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:03 2022] GET /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f => generated 1307 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:04.518673 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-476a9c0b-8249-4428-942a-19af6bba90b2 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] HTTP exception thrown: Instance 92daf2e6-9a72-4b2a-94aa-4316c7edb3c0 could not be found. Oct 18 15:31:04.520769 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-476a9c0b-8249-4428-942a-19af6bba90b2 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Request method failure captured: Oct 18 15:31:04.520769 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/92daf2e6-9a72-4b2a-94aa-4316c7edb3c0 HTTP/1.1 Oct 18 15:31:04.520769 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:31:04.520769 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:31:04.520769 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:31:04.520769 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:31:04.520769 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:31:04.520769 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:31:04.520769 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:31:04.520769 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:31:04.520769 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsXUy9FAAJJ0Ruh4wwEA9szjF7RLudGwF2cxYyUzJkwyma_At_umHw9EflsFK-fFl5HDZF0eGpwWYNbkl96nz5je7IB6PyqBeik4MLzcoYbCjQBM01G06iG1mP4Ny9aewc_L7MlMIXu3Yta_wCU8nd9Gbv-uOlENc7ZsnBI5A37iAsc Oct 18 15:31:04.520769 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:31:04.520769 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:31:04.520769 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:31:04.520769 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:31:04.520769 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:31:04.520769 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:31:04.520769 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 377c3bbd62b546fca545c0f6d0df59e3 Oct 18 15:31:04.520769 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServersOnMultiNodesTest-1788579982 Oct 18 15:31:04.520769 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:31:04.520769 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:31:04.522340 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/377c3bbd62b546fca545c0f6d0df59e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/377c3bbd62b546fca545c0f6d0df59e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/377c3bbd62b546fca545c0f6d0df59e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_377c3bbd62b546fca545c0f6d0df59e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:31:04.522340 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServersOnMultiNodesTest-1788579982 Oct 18 15:31:04.522340 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 377c3bbd62b546fca545c0f6d0df59e3 Oct 18 15:31:04.522340 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1788579982 Oct 18 15:31:04.522340 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServersOnMultiNodesTest-1788579982-project Oct 18 15:31:04.522340 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:31:04.522340 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:31:04.522340 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: d58aac335a1d421a95928e2754fb2529 Oct 18 15:31:04.522340 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServersOnMultiNodesTest-1788579982-project Oct 18 15:31:04.522340 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:31:04.522340 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 92daf2e6-9a72-4b2a-94aa-4316c7edb3c0 could not be found. Oct 18 15:31:04.522340 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '92daf2e6-9a72-4b2a-94aa-4316c7edb3c0'} Oct 18 15:31:04.523137 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:31:04.523137 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:04.523137 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:31:04.523137 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:31:04.523137 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:31:04.523137 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:31:04.523137 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:31:04.523137 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:31:04.523137 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:31:04.523137 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:31:04.523137 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92daf2e6-9a72-4b2a-94aa-4316c7edb3c0 could not be found. Oct 18 15:31:04.523137 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:04.523137 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:04.523137 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:04.523137 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:04.523137 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:04.523137 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:04.523137 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:31:04.523137 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:31:04.523137 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:31:04.524444 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:31:04.524444 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:31:04.524444 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:31:04.524444 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:31:04.524444 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:31:04.524444 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:31:04.524444 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:31:04.524444 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92daf2e6-9a72-4b2a-94aa-4316c7edb3c0 could not be found. Oct 18 15:31:04.524444 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:04.524444 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:04.524444 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:04.524444 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:04.524444 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:04.524444 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:04.524444 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:31:04.524444 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:31:04.524444 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92daf2e6-9a72-4b2a-94aa-4316c7edb3c0 could not be found. Oct 18 15:31:04.524444 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:04.527841 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-476a9c0b-8249-4428-942a-19af6bba90b2 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Returning 404 to user: Instance 92daf2e6-9a72-4b2a-94aa-4316c7edb3c0 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:31:04.528736 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-476a9c0b-8249-4428-942a-19af6bba90b2 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/92daf2e6-9a72-4b2a-94aa-4316c7edb3c0" status: 404 len: 111 microversion: 2.1 time: 0.078786 Oct 18 15:31:04.529661 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 820/1637] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:04 2022] GET /compute/v2.1/servers/92daf2e6-9a72-4b2a-94aa-4316c7edb3c0 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:31:04.535250 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-60c7b40f-0bed-4e6e-9afa-aa73b8801ab5 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:04.536180 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-60c7b40f-0bed-4e6e-9afa-aa73b8801ab5 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] [instance: d463b5e2-5fc0-4272-b141-476b1672cb18] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:04.536748 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b0b7fc74-3b5e-4e75-a609-32927e26070d tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:04.537399 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b0b7fc74-3b5e-4e75-a609-32927e26070d tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:04.543255 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-60c7b40f-0bed-4e6e-9afa-aa73b8801ab5 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:04.544101 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-60c7b40f-0bed-4e6e-9afa-aa73b8801ab5 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:04.544776 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-60c7b40f-0bed-4e6e-9afa-aa73b8801ab5 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:04.545863 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-60c7b40f-0bed-4e6e-9afa-aa73b8801ab5 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:04.546560 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-60c7b40f-0bed-4e6e-9afa-aa73b8801ab5 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:04.547223 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-60c7b40f-0bed-4e6e-9afa-aa73b8801ab5 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:04.572041 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b0b7fc74-3b5e-4e75-a609-32927e26070d tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:04.572749 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b0b7fc74-3b5e-4e75-a609-32927e26070d tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:04.573230 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b0b7fc74-3b5e-4e75-a609-32927e26070d tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:04.573970 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b0b7fc74-3b5e-4e75-a609-32927e26070d tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:04.574429 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b0b7fc74-3b5e-4e75-a609-32927e26070d tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:04.574877 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b0b7fc74-3b5e-4e75-a609-32927e26070d tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:04.880115 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b0b7fc74-3b5e-4e75-a609-32927e26070d tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:04.895900 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b0b7fc74-3b5e-4e75-a609-32927e26070d tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:04.900257 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b0b7fc74-3b5e-4e75-a609-32927e26070d tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:04.914495 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b0b7fc74-3b5e-4e75-a609-32927e26070d tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1546 microversion: 2.91 time: 0.394454 Oct 18 15:31:04.916769 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 818/1638] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:04 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1546 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:31:04.930560 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-52d43af3-56e4-4be3-b104-f74c0dcf6a76 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:04.934323 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-52d43af3-56e4-4be3-b104-f74c0dcf6a76 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] [instance: 234a024f-c13b-40de-bbcb-ffcdda611d01] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:04.950827 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:DELETE=3,nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:31:04.957082 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52d43af3-56e4-4be3-b104-f74c0dcf6a76 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:04.958645 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52d43af3-56e4-4be3-b104-f74c0dcf6a76 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:04.959578 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52d43af3-56e4-4be3-b104-f74c0dcf6a76 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:04.961035 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52d43af3-56e4-4be3-b104-f74c0dcf6a76 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:04.961885 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52d43af3-56e4-4be3-b104-f74c0dcf6a76 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:04.962627 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52d43af3-56e4-4be3-b104-f74c0dcf6a76 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:05.311566 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-52d43af3-56e4-4be3-b104-f74c0dcf6a76 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:05.323624 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-52d43af3-56e4-4be3-b104-f74c0dcf6a76 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:05.328504 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-52d43af3-56e4-4be3-b104-f74c0dcf6a76 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:05.340319 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-52d43af3-56e4-4be3-b104-f74c0dcf6a76 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] 10.222.0.60 "GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01" status: 200 len: 1416 microversion: 2.75 time: 0.417806 Oct 18 15:31:05.353980 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 819/1639] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:04 2022] GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01 => generated 1416 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:31:05.363509 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7404b5b6-6446-4a8d-9acd-1d7eb8733c0d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:05.367473 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7404b5b6-6446-4a8d-9acd-1d7eb8733c0d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:05.381034 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7404b5b6-6446-4a8d-9acd-1d7eb8733c0d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:05.382697 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7404b5b6-6446-4a8d-9acd-1d7eb8733c0d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:05.383205 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7404b5b6-6446-4a8d-9acd-1d7eb8733c0d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:05.385748 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7404b5b6-6446-4a8d-9acd-1d7eb8733c0d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:05.386329 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7404b5b6-6446-4a8d-9acd-1d7eb8733c0d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:05.387833 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7404b5b6-6446-4a8d-9acd-1d7eb8733c0d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:05.593243 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7404b5b6-6446-4a8d-9acd-1d7eb8733c0d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.237747 Oct 18 15:31:05.593860 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 820/1640] 10.222.0.60 () {60 vars in 1316 bytes} [Tue Oct 18 15:31:05 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a/os-interface => generated 1830 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:31:05.608847 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-037dcaa2-90d1-40b8-8e4f-a1ae9b8bc3c5 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:05.609744 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-037dcaa2-90d1-40b8-8e4f-a1ae9b8bc3c5 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 13432f77-a4ba-4dea-a1a7-a47fb9b425b9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:05.618964 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-037dcaa2-90d1-40b8-8e4f-a1ae9b8bc3c5 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:05.619636 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-037dcaa2-90d1-40b8-8e4f-a1ae9b8bc3c5 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:05.620245 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-037dcaa2-90d1-40b8-8e4f-a1ae9b8bc3c5 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:05.621143 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-037dcaa2-90d1-40b8-8e4f-a1ae9b8bc3c5 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:05.621757 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-037dcaa2-90d1-40b8-8e4f-a1ae9b8bc3c5 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:05.622386 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-037dcaa2-90d1-40b8-8e4f-a1ae9b8bc3c5 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:05.622754 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-60c7b40f-0bed-4e6e-9afa-aa73b8801ab5 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fd21586dad64dd0832fc9794aa18971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae26b8b2a734cb09f6fd2c26f75c66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:05.637929 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-037dcaa2-90d1-40b8-8e4f-a1ae9b8bc3c5 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] HTTP exception thrown: Instance 13432f77-a4ba-4dea-a1a7-a47fb9b425b9 could not be found. Oct 18 15:31:05.639840 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-037dcaa2-90d1-40b8-8e4f-a1ae9b8bc3c5 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Request method failure captured: Oct 18 15:31:05.639840 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/13432f77-a4ba-4dea-a1a7-a47fb9b425b9 HTTP/1.1 Oct 18 15:31:05.639840 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:31:05.639840 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:31:05.639840 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:31:05.639840 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:31:05.639840 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:31:05.639840 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:31:05.639840 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:31:05.639840 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:31:05.639840 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsXUy9FAAJJ0Ruh4wwEA9szjF7RLudGwF2cxYyUzJkwyma_At_umHw9EflsFK-fFl5HDZF0eGpwWYNbkl96nz5je7IB6PyqBeik4MLzcoYbCjQBM01G06iG1mP4Ny9aewc_L7MlMIXu3Yta_wCU8nd9Gbv-uOlENc7ZsnBI5A37iAsc Oct 18 15:31:05.639840 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:31:05.639840 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:31:05.639840 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:31:05.639840 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:31:05.639840 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:31:05.639840 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:31:05.639840 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 377c3bbd62b546fca545c0f6d0df59e3 Oct 18 15:31:05.639840 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersOnMultiNodesTest-1788579982 Oct 18 15:31:05.639840 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:31:05.639840 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:31:05.642104 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/377c3bbd62b546fca545c0f6d0df59e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/377c3bbd62b546fca545c0f6d0df59e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/377c3bbd62b546fca545c0f6d0df59e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_377c3bbd62b546fca545c0f6d0df59e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:31:05.642104 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersOnMultiNodesTest-1788579982 Oct 18 15:31:05.642104 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 377c3bbd62b546fca545c0f6d0df59e3 Oct 18 15:31:05.642104 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1788579982 Oct 18 15:31:05.642104 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersOnMultiNodesTest-1788579982-project Oct 18 15:31:05.642104 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:31:05.642104 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:31:05.642104 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: d58aac335a1d421a95928e2754fb2529 Oct 18 15:31:05.642104 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersOnMultiNodesTest-1788579982-project Oct 18 15:31:05.642104 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:31:05.642104 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 13432f77-a4ba-4dea-a1a7-a47fb9b425b9 could not be found. Oct 18 15:31:05.642104 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '13432f77-a4ba-4dea-a1a7-a47fb9b425b9'} Oct 18 15:31:05.643070 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:31:05.643070 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:05.643070 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:31:05.643070 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:31:05.643070 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:31:05.643070 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:31:05.643070 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:31:05.643070 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:31:05.643070 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:31:05.643070 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:31:05.643070 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13432f77-a4ba-4dea-a1a7-a47fb9b425b9 could not be found. Oct 18 15:31:05.643070 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:31:05.643070 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:05.643070 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:31:05.643070 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:05.643070 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:05.643070 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:05.643070 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:31:05.643070 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:31:05.643070 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:31:05.644600 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:31:05.644600 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:31:05.644600 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:31:05.644600 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:31:05.644600 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:31:05.644600 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:31:05.644600 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:31:05.644600 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13432f77-a4ba-4dea-a1a7-a47fb9b425b9 could not be found. Oct 18 15:31:05.644600 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:31:05.644600 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:05.644600 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:31:05.644600 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:05.644600 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:05.644600 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:05.644600 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:31:05.644600 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:31:05.644600 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13432f77-a4ba-4dea-a1a7-a47fb9b425b9 could not be found. Oct 18 15:31:05.644600 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:31:05.646642 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-60c7b40f-0bed-4e6e-9afa-aa73b8801ab5 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] 10.222.0.60 "GET /compute/v2.1/servers/d463b5e2-5fc0-4272-b141-476b1672cb18" status: 200 len: 1315 microversion: 2.1 time: 1.107148 Oct 18 15:31:05.648359 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 821/1641] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:04 2022] GET /compute/v2.1/servers/d463b5e2-5fc0-4272-b141-476b1672cb18 => generated 1315 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:05.648650 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-037dcaa2-90d1-40b8-8e4f-a1ae9b8bc3c5 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Returning 404 to user: Instance 13432f77-a4ba-4dea-a1a7-a47fb9b425b9 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:31:05.649752 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-037dcaa2-90d1-40b8-8e4f-a1ae9b8bc3c5 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/13432f77-a4ba-4dea-a1a7-a47fb9b425b9" status: 404 len: 111 microversion: 2.1 time: 0.054766 Oct 18 15:31:05.653621 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 821/1642] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:05 2022] GET /compute/v2.1/servers/13432f77-a4ba-4dea-a1a7-a47fb9b425b9 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:31:05.659390 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f4ae2b68-b9a6-4c51-8762-d4f7a337bf19 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:05.660330 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f4ae2b68-b9a6-4c51-8762-d4f7a337bf19 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:05.668073 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4ae2b68-b9a6-4c51-8762-d4f7a337bf19 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:05.671025 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4ae2b68-b9a6-4c51-8762-d4f7a337bf19 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:05.671154 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-3eabd038-d20d-483b-9805-b68d233f15cd req-0f94edea-27f7-4213-8b50-df2ae63effdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d463b5e2-5fc0-4272-b141-476b1672cb18", "tag": "74e379cc-981c-4e4c-ab35-62118bbf38c0"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:31:05.671835 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4ae2b68-b9a6-4c51-8762-d4f7a337bf19 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:05.673383 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4ae2b68-b9a6-4c51-8762-d4f7a337bf19 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:05.674081 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4ae2b68-b9a6-4c51-8762-d4f7a337bf19 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:05.674746 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4ae2b68-b9a6-4c51-8762-d4f7a337bf19 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:05.690328 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-3eabd038-d20d-483b-9805-b68d233f15cd req-0f94edea-27f7-4213-8b50-df2ae63effdb service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:05.691021 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-3eabd038-d20d-483b-9805-b68d233f15cd req-0f94edea-27f7-4213-8b50-df2ae63effdb service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:05.691936 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-3eabd038-d20d-483b-9805-b68d233f15cd req-0f94edea-27f7-4213-8b50-df2ae63effdb service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:05.732416 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-3eabd038-d20d-483b-9805-b68d233f15cd req-0f94edea-27f7-4213-8b50-df2ae63effdb service nova] Creating event network-changed:74e379cc-981c-4e4c-ab35-62118bbf38c0 for instance d463b5e2-5fc0-4272-b141-476b1672cb18 on n-h2-853682-5 Oct 18 15:31:05.741375 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-3eabd038-d20d-483b-9805-b68d233f15cd req-0f94edea-27f7-4213-8b50-df2ae63effdb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091129 Oct 18 15:31:05.742293 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 822/1643] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:31:05.747389 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-07f78f83-7f21-4c77-8366-07256855aeeb req-97c67e46-8554-4faf-a4d4-a55fd16220dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da62499c-f590-4083-80b6-b849b6695c4e", "tag": "e34ef547-0315-4841-b1d6-53dcfae3bb30"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:31:05.758750 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-07f78f83-7f21-4c77-8366-07256855aeeb req-97c67e46-8554-4faf-a4d4-a55fd16220dd service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:05.759230 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-07f78f83-7f21-4c77-8366-07256855aeeb req-97c67e46-8554-4faf-a4d4-a55fd16220dd service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:05.759666 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-07f78f83-7f21-4c77-8366-07256855aeeb req-97c67e46-8554-4faf-a4d4-a55fd16220dd service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:05.783177 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-07f78f83-7f21-4c77-8366-07256855aeeb req-97c67e46-8554-4faf-a4d4-a55fd16220dd service nova] Creating event network-changed:e34ef547-0315-4841-b1d6-53dcfae3bb30 for instance da62499c-f590-4083-80b6-b849b6695c4e on n-h1-853682-5 Oct 18 15:31:05.796835 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-07f78f83-7f21-4c77-8366-07256855aeeb req-97c67e46-8554-4faf-a4d4-a55fd16220dd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053113 Oct 18 15:31:05.798182 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 823/1644] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:31:05.817626 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f0d44967-5990-4bb6-8c08-ef846b0dc292 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:05.822414 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f0d44967-5990-4bb6-8c08-ef846b0dc292 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:05.829405 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f0d44967-5990-4bb6-8c08-ef846b0dc292 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:05.830999 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f0d44967-5990-4bb6-8c08-ef846b0dc292 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:05.831928 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f0d44967-5990-4bb6-8c08-ef846b0dc292 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:05.833803 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f0d44967-5990-4bb6-8c08-ef846b0dc292 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:05.834280 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f0d44967-5990-4bb6-8c08-ef846b0dc292 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:05.834799 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f0d44967-5990-4bb6-8c08-ef846b0dc292 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:05.904951 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f0d44967-5990-4bb6-8c08-ef846b0dc292 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.105525 Oct 18 15:31:05.912064 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 824/1645] 10.222.0.60 () {60 vars in 1343 bytes} [Tue Oct 18 15:31:05 2022] GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793/os-volume_attachments => generated 25 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:05.924906 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b282444c-3805-489d-bab2-128767bfa97c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:05.925531 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b282444c-3805-489d-bab2-128767bfa97c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 44a77c90-3a7e-435e-adba-e3a0551d573f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:05.942751 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b282444c-3805-489d-bab2-128767bfa97c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:05.942751 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b282444c-3805-489d-bab2-128767bfa97c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:05.942979 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b282444c-3805-489d-bab2-128767bfa97c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:05.943667 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b282444c-3805-489d-bab2-128767bfa97c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:05.944133 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b282444c-3805-489d-bab2-128767bfa97c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:05.944561 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b282444c-3805-489d-bab2-128767bfa97c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:06.314533 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f4ae2b68-b9a6-4c51-8762-d4f7a337bf19 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:06.322880 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f4ae2b68-b9a6-4c51-8762-d4f7a337bf19 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e" status: 200 len: 1211 microversion: 2.1 time: 0.667906 Oct 18 15:31:06.323469 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 822/1646] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:05 2022] GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e => generated 1211 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:06.327972 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1722f681-4f7e-4212-b6aa-48dc9a4268ee tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:06.405114 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1722f681-4f7e-4212-b6aa-48dc9a4268ee tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/c0b3f01f-e83d-47cb-abe4-1a5666e6238c" status: 204 len: 0 microversion: 2.1 time: 0.080518 Oct 18 15:31:06.412614 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 823/1647] 10.222.0.60 () {58 vars in 1266 bytes} [Tue Oct 18 15:31:06 2022] DELETE /compute/v2.1/os-server-groups/c0b3f01f-e83d-47cb-abe4-1a5666e6238c => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:31:06.421624 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eb227446-75e2-4bc6-b379-6ed8a1455118 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:06.423860 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-eb227446-75e2-4bc6-b379-6ed8a1455118 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:06.465703 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb227446-75e2-4bc6-b379-6ed8a1455118 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:06.466217 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb227446-75e2-4bc6-b379-6ed8a1455118 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:06.466659 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb227446-75e2-4bc6-b379-6ed8a1455118 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:06.476198 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb227446-75e2-4bc6-b379-6ed8a1455118 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:06.476893 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb227446-75e2-4bc6-b379-6ed8a1455118 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:06.477698 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb227446-75e2-4bc6-b379-6ed8a1455118 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:06.481827 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:31:06.619762 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=7 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:31:06.852617 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-eb227446-75e2-4bc6-b379-6ed8a1455118 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:06.883740 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-eb227446-75e2-4bc6-b379-6ed8a1455118 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:06.894604 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-eb227446-75e2-4bc6-b379-6ed8a1455118 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:06.918471 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-eb227446-75e2-4bc6-b379-6ed8a1455118 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1546 microversion: 2.91 time: 0.501250 Oct 18 15:31:06.923830 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 824/1648] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:06 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1546 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:31:06.935577 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a061dd43-2ab4-4ed8-941d-1ed0f818f04f tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:06.939304 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b282444c-3805-489d-bab2-128767bfa97c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:06.941148 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a061dd43-2ab4-4ed8-941d-1ed0f818f04f tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] [instance: 234a024f-c13b-40de-bbcb-ffcdda611d01] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:06.950328 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b282444c-3805-489d-bab2-128767bfa97c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f" status: 200 len: 1307 microversion: 2.1 time: 1.039485 Oct 18 15:31:06.962702 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a061dd43-2ab4-4ed8-941d-1ed0f818f04f tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:06.963395 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a061dd43-2ab4-4ed8-941d-1ed0f818f04f tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:06.963754 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a061dd43-2ab4-4ed8-941d-1ed0f818f04f tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:06.967322 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a061dd43-2ab4-4ed8-941d-1ed0f818f04f tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:06.967805 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a061dd43-2ab4-4ed8-941d-1ed0f818f04f tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:06.970096 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 825/1649] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:05 2022] GET /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f => generated 1307 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:06.978347 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ffbee2cd-9165-4d84-9d63-ce90c83a8013 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:06.983593 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a061dd43-2ab4-4ed8-941d-1ed0f818f04f tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:06.989381 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ffbee2cd-9165-4d84-9d63-ce90c83a8013 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 61ca6b08-6a75-4b0a-86d7-86aa22cb308e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:06.997002 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=10 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:31:07.014237 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ffbee2cd-9165-4d84-9d63-ce90c83a8013 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:07.017812 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ffbee2cd-9165-4d84-9d63-ce90c83a8013 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:07.021610 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ffbee2cd-9165-4d84-9d63-ce90c83a8013 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:07.029703 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ffbee2cd-9165-4d84-9d63-ce90c83a8013 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:07.030464 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ffbee2cd-9165-4d84-9d63-ce90c83a8013 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:07.033696 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ffbee2cd-9165-4d84-9d63-ce90c83a8013 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:07.143304 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ffbee2cd-9165-4d84-9d63-ce90c83a8013 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 61ca6b08-6a75-4b0a-86d7-86aa22cb308e] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:31:07.347843 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a061dd43-2ab4-4ed8-941d-1ed0f818f04f tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:07.357688 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a061dd43-2ab4-4ed8-941d-1ed0f818f04f tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:07.388618 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a061dd43-2ab4-4ed8-941d-1ed0f818f04f tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:07.399778 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ffbee2cd-9165-4d84-9d63-ce90c83a8013 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "DELETE /compute/v2.1/servers/61ca6b08-6a75-4b0a-86d7-86aa22cb308e" status: 204 len: 0 microversion: 2.1 time: 0.423481 Oct 18 15:31:07.403747 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 826/1650] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:31:06 2022] DELETE /compute/v2.1/servers/61ca6b08-6a75-4b0a-86d7-86aa22cb308e => generated 0 bytes in 428 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:31:07.411005 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a061dd43-2ab4-4ed8-941d-1ed0f818f04f tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] 10.222.0.60 "GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01" status: 200 len: 1437 microversion: 2.75 time: 0.486064 Oct 18 15:31:07.417462 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 825/1651] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:06 2022] GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01 => generated 1437 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:31:07.418939 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-66105758-3fe5-4edd-81d8-114b95717aa2 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:07.421027 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-66105758-3fe5-4edd-81d8-114b95717aa2 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] [instance: d463b5e2-5fc0-4272-b141-476b1672cb18] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:07.432631 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f2eea485-6ceb-40a0-9ce3-cc815b92cf99 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:07.440315 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f2eea485-6ceb-40a0-9ce3-cc815b92cf99 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:07.441067 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-66105758-3fe5-4edd-81d8-114b95717aa2 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:07.445992 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-66105758-3fe5-4edd-81d8-114b95717aa2 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:07.447997 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-66105758-3fe5-4edd-81d8-114b95717aa2 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:07.453764 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-66105758-3fe5-4edd-81d8-114b95717aa2 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:07.455592 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-66105758-3fe5-4edd-81d8-114b95717aa2 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:07.460854 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-66105758-3fe5-4edd-81d8-114b95717aa2 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:07.470314 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2eea485-6ceb-40a0-9ce3-cc815b92cf99 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:07.470762 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2eea485-6ceb-40a0-9ce3-cc815b92cf99 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:07.471204 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2eea485-6ceb-40a0-9ce3-cc815b92cf99 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:07.471932 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2eea485-6ceb-40a0-9ce3-cc815b92cf99 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:07.472391 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2eea485-6ceb-40a0-9ce3-cc815b92cf99 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:07.472838 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2eea485-6ceb-40a0-9ce3-cc815b92cf99 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:07.911382 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=24 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:31:07.932994 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=34 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:31:07.977288 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-66105758-3fe5-4edd-81d8-114b95717aa2 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fd21586dad64dd0832fc9794aa18971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae26b8b2a734cb09f6fd2c26f75c66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:07.987541 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-66105758-3fe5-4edd-81d8-114b95717aa2 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] 10.222.0.60 "GET /compute/v2.1/servers/d463b5e2-5fc0-4272-b141-476b1672cb18" status: 200 len: 1315 microversion: 2.1 time: 0.583687 Oct 18 15:31:08.001116 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 827/1652] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:07 2022] GET /compute/v2.1/servers/d463b5e2-5fc0-4272-b141-476b1672cb18 => generated 1315 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:08.001116 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-68609d2c-0338-41c9-85e7-5ac9b7430f01 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:08.001116 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-68609d2c-0338-41c9-85e7-5ac9b7430f01 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 61ca6b08-6a75-4b0a-86d7-86aa22cb308e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:08.013761 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f2eea485-6ceb-40a0-9ce3-cc815b92cf99 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:08.015218 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-68609d2c-0338-41c9-85e7-5ac9b7430f01 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:08.015740 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-68609d2c-0338-41c9-85e7-5ac9b7430f01 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:08.018844 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-68609d2c-0338-41c9-85e7-5ac9b7430f01 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:08.019626 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-68609d2c-0338-41c9-85e7-5ac9b7430f01 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:08.020212 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-68609d2c-0338-41c9-85e7-5ac9b7430f01 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:08.020654 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-68609d2c-0338-41c9-85e7-5ac9b7430f01 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:08.054663 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f2eea485-6ceb-40a0-9ce3-cc815b92cf99 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e" status: 200 len: 1211 microversion: 2.1 time: 0.624437 Oct 18 15:31:08.055967 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 826/1653] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:07 2022] GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e => generated 1211 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:08.076564 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-60d03841-1878-4fe5-b65e-ac3d72e6e1f4 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:31:08.080520 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-60d03841-1878-4fe5-b65e-ac3d72e6e1f4 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] [instance: 234a024f-c13b-40de-bbcb-ffcdda611d01] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:08.097014 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60d03841-1878-4fe5-b65e-ac3d72e6e1f4 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:08.101141 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60d03841-1878-4fe5-b65e-ac3d72e6e1f4 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:08.101831 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60d03841-1878-4fe5-b65e-ac3d72e6e1f4 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:08.103987 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60d03841-1878-4fe5-b65e-ac3d72e6e1f4 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:08.104637 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60d03841-1878-4fe5-b65e-ac3d72e6e1f4 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:08.106135 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60d03841-1878-4fe5-b65e-ac3d72e6e1f4 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:08.269721 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-68609d2c-0338-41c9-85e7-5ac9b7430f01 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:08.279319 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-68609d2c-0338-41c9-85e7-5ac9b7430f01 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/61ca6b08-6a75-4b0a-86d7-86aa22cb308e" status: 200 len: 1473 microversion: 2.1 time: 0.285553 Oct 18 15:31:08.281285 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 828/1654] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:07 2022] GET /compute/v2.1/servers/61ca6b08-6a75-4b0a-86d7-86aa22cb308e => generated 1473 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:08.293564 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-578efe75-d8be-4569-a4dd-1194672312c4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:08.294444 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-578efe75-d8be-4569-a4dd-1194672312c4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:08.325865 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-578efe75-d8be-4569-a4dd-1194672312c4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:08.326376 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-578efe75-d8be-4569-a4dd-1194672312c4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:08.326827 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-578efe75-d8be-4569-a4dd-1194672312c4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:08.327556 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-578efe75-d8be-4569-a4dd-1194672312c4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:08.329973 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-578efe75-d8be-4569-a4dd-1194672312c4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:08.330425 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-578efe75-d8be-4569-a4dd-1194672312c4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:08.449186 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-578efe75-d8be-4569-a4dd-1194672312c4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:08.459143 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-578efe75-d8be-4569-a4dd-1194672312c4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:08.461285 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-578efe75-d8be-4569-a4dd-1194672312c4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:08.478178 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-578efe75-d8be-4569-a4dd-1194672312c4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1546 microversion: 2.91 time: 0.195779 Oct 18 15:31:08.478932 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 829/1655] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:08 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1546 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:31:08.484012 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-cb299023-7800-4e56-9878-0883d7e10311 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:08.484829 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-cb299023-7800-4e56-9878-0883d7e10311 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 44a77c90-3a7e-435e-adba-e3a0551d573f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:08.491928 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cb299023-7800-4e56-9878-0883d7e10311 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:08.492839 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cb299023-7800-4e56-9878-0883d7e10311 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:08.493536 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cb299023-7800-4e56-9878-0883d7e10311 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:08.494459 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cb299023-7800-4e56-9878-0883d7e10311 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:08.495131 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cb299023-7800-4e56-9878-0883d7e10311 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:08.495770 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cb299023-7800-4e56-9878-0883d7e10311 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:08.500715 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:31:08.681243 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-cb299023-7800-4e56-9878-0883d7e10311 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:08.704176 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-cb299023-7800-4e56-9878-0883d7e10311 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f" status: 200 len: 1307 microversion: 2.1 time: 0.219975 Oct 18 15:31:08.709176 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 830/1656] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:08 2022] GET /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f => generated 1307 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:09.014983 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bc6aea26-0ad6-4bb0-9fd6-29d60ba9fd77 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:09.015607 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-bc6aea26-0ad6-4bb0-9fd6-29d60ba9fd77 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] [instance: d463b5e2-5fc0-4272-b141-476b1672cb18] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:09.022273 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bc6aea26-0ad6-4bb0-9fd6-29d60ba9fd77 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:09.023008 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bc6aea26-0ad6-4bb0-9fd6-29d60ba9fd77 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:09.023459 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bc6aea26-0ad6-4bb0-9fd6-29d60ba9fd77 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:09.024165 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bc6aea26-0ad6-4bb0-9fd6-29d60ba9fd77 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:09.024916 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bc6aea26-0ad6-4bb0-9fd6-29d60ba9fd77 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:09.025351 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bc6aea26-0ad6-4bb0-9fd6-29d60ba9fd77 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:09.237333 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-bc6aea26-0ad6-4bb0-9fd6-29d60ba9fd77 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fd21586dad64dd0832fc9794aa18971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae26b8b2a734cb09f6fd2c26f75c66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:09.252585 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-bc6aea26-0ad6-4bb0-9fd6-29d60ba9fd77 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] 10.222.0.60 "GET /compute/v2.1/servers/d463b5e2-5fc0-4272-b141-476b1672cb18" status: 200 len: 1315 microversion: 2.1 time: 0.241475 Oct 18 15:31:09.253508 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 831/1657] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:09 2022] GET /compute/v2.1/servers/d463b5e2-5fc0-4272-b141-476b1672cb18 => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:31:09.264541 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1f48c5d4-00ae-4951-85fb-8b3960f18f05 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:09.267192 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1f48c5d4-00ae-4951-85fb-8b3960f18f05 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:09.282966 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1f48c5d4-00ae-4951-85fb-8b3960f18f05 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:09.290395 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1f48c5d4-00ae-4951-85fb-8b3960f18f05 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:09.290946 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1f48c5d4-00ae-4951-85fb-8b3960f18f05 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:09.291764 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1f48c5d4-00ae-4951-85fb-8b3960f18f05 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:09.292746 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1f48c5d4-00ae-4951-85fb-8b3960f18f05 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:09.292746 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1f48c5d4-00ae-4951-85fb-8b3960f18f05 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:09.552441 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1f48c5d4-00ae-4951-85fb-8b3960f18f05 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:09.563900 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1f48c5d4-00ae-4951-85fb-8b3960f18f05 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e" status: 200 len: 1211 microversion: 2.1 time: 0.309151 Oct 18 15:31:09.564973 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 832/1658] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:09 2022] GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e => generated 1211 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:09.573271 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-580d9ab5-4efd-401e-8c20-ff3b6b2a420c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:09.574671 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-580d9ab5-4efd-401e-8c20-ff3b6b2a420c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 61ca6b08-6a75-4b0a-86d7-86aa22cb308e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:09.589998 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-580d9ab5-4efd-401e-8c20-ff3b6b2a420c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:09.593344 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-580d9ab5-4efd-401e-8c20-ff3b6b2a420c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:09.594239 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-580d9ab5-4efd-401e-8c20-ff3b6b2a420c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:09.595977 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-580d9ab5-4efd-401e-8c20-ff3b6b2a420c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:09.596663 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-580d9ab5-4efd-401e-8c20-ff3b6b2a420c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:09.597407 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-580d9ab5-4efd-401e-8c20-ff3b6b2a420c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:10.510440 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-580d9ab5-4efd-401e-8c20-ff3b6b2a420c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:10.524234 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-580d9ab5-4efd-401e-8c20-ff3b6b2a420c tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/61ca6b08-6a75-4b0a-86d7-86aa22cb308e" status: 200 len: 1473 microversion: 2.1 time: 0.957978 Oct 18 15:31:10.585619 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 833/1659] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:09 2022] GET /compute/v2.1/servers/61ca6b08-6a75-4b0a-86d7-86aa22cb308e => generated 1473 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:10.595925 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-99468eec-2b50-4531-8cf9-a24e3165468f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:10.604934 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-99468eec-2b50-4531-8cf9-a24e3165468f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:10.641794 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-99468eec-2b50-4531-8cf9-a24e3165468f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:10.649994 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-99468eec-2b50-4531-8cf9-a24e3165468f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:10.652006 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-99468eec-2b50-4531-8cf9-a24e3165468f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:10.654345 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-99468eec-2b50-4531-8cf9-a24e3165468f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:10.655918 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-99468eec-2b50-4531-8cf9-a24e3165468f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:10.658595 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-99468eec-2b50-4531-8cf9-a24e3165468f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:10.816361 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-99468eec-2b50-4531-8cf9-a24e3165468f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:10.826607 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-99468eec-2b50-4531-8cf9-a24e3165468f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:10.828450 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-99468eec-2b50-4531-8cf9-a24e3165468f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:10.836023 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-99468eec-2b50-4531-8cf9-a24e3165468f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1546 microversion: 2.91 time: 0.246196 Oct 18 15:31:10.836770 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 834/1660] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:10 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1546 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:31:10.864834 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-41d0339f-9f02-4140-b3c2-df9cb231de41 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:10.865451 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-41d0339f-9f02-4140-b3c2-df9cb231de41 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 44a77c90-3a7e-435e-adba-e3a0551d573f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:10.881942 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-41d0339f-9f02-4140-b3c2-df9cb231de41 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:10.882842 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-41d0339f-9f02-4140-b3c2-df9cb231de41 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:10.883253 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-41d0339f-9f02-4140-b3c2-df9cb231de41 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:10.887892 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-41d0339f-9f02-4140-b3c2-df9cb231de41 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:10.888594 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-41d0339f-9f02-4140-b3c2-df9cb231de41 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:10.889147 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-41d0339f-9f02-4140-b3c2-df9cb231de41 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:11.347947 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-41d0339f-9f02-4140-b3c2-df9cb231de41 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:11.362729 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-41d0339f-9f02-4140-b3c2-df9cb231de41 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f" status: 200 len: 1307 microversion: 2.1 time: 0.508134 Oct 18 15:31:11.376844 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 835/1661] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:10 2022] GET /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f => generated 1307 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:11.379386 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8c240d15-86b2-46a3-b158-bd8cf1afbafe tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:11.385060 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8c240d15-86b2-46a3-b158-bd8cf1afbafe tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] [instance: d463b5e2-5fc0-4272-b141-476b1672cb18] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:11.400208 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c240d15-86b2-46a3-b158-bd8cf1afbafe tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:11.400829 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c240d15-86b2-46a3-b158-bd8cf1afbafe tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:11.401273 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c240d15-86b2-46a3-b158-bd8cf1afbafe tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:11.404548 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c240d15-86b2-46a3-b158-bd8cf1afbafe tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:11.406128 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c240d15-86b2-46a3-b158-bd8cf1afbafe tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:11.406611 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c240d15-86b2-46a3-b158-bd8cf1afbafe tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:12.194569 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8c240d15-86b2-46a3-b158-bd8cf1afbafe tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fd21586dad64dd0832fc9794aa18971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae26b8b2a734cb09f6fd2c26f75c66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:12.206628 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8c240d15-86b2-46a3-b158-bd8cf1afbafe tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] 10.222.0.60 "GET /compute/v2.1/servers/d463b5e2-5fc0-4272-b141-476b1672cb18" status: 200 len: 1315 microversion: 2.1 time: 0.834547 Oct 18 15:31:12.216161 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 836/1662] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:11 2022] GET /compute/v2.1/servers/d463b5e2-5fc0-4272-b141-476b1672cb18 => generated 1315 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:12.216394 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ce849272-22e0-49ac-a5a4-a4873e632209 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:12.216963 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ce849272-22e0-49ac-a5a4-a4873e632209 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:12.234869 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ce849272-22e0-49ac-a5a4-a4873e632209 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:12.237497 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ce849272-22e0-49ac-a5a4-a4873e632209 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:12.237497 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ce849272-22e0-49ac-a5a4-a4873e632209 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:12.237754 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ce849272-22e0-49ac-a5a4-a4873e632209 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:12.239631 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ce849272-22e0-49ac-a5a4-a4873e632209 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:12.241239 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ce849272-22e0-49ac-a5a4-a4873e632209 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:12.621538 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ce849272-22e0-49ac-a5a4-a4873e632209 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:12.642018 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ce849272-22e0-49ac-a5a4-a4873e632209 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e" status: 200 len: 1211 microversion: 2.1 time: 0.430285 Oct 18 15:31:12.651396 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 837/1663] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:12 2022] GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e => generated 1211 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:12.666862 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-986f30fe-5057-470e-afbb-aa1335bd1230 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:12.667433 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-986f30fe-5057-470e-afbb-aa1335bd1230 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 61ca6b08-6a75-4b0a-86d7-86aa22cb308e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:12.702147 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-986f30fe-5057-470e-afbb-aa1335bd1230 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:12.702688 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-986f30fe-5057-470e-afbb-aa1335bd1230 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:12.703141 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-986f30fe-5057-470e-afbb-aa1335bd1230 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:12.704005 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-986f30fe-5057-470e-afbb-aa1335bd1230 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:12.706966 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-986f30fe-5057-470e-afbb-aa1335bd1230 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:12.707485 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-986f30fe-5057-470e-afbb-aa1335bd1230 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:12.925301 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-986f30fe-5057-470e-afbb-aa1335bd1230 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58aac335a1d421a95928e2754fb2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377c3bbd62b546fca545c0f6d0df59e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:12.942679 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-986f30fe-5057-470e-afbb-aa1335bd1230 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/61ca6b08-6a75-4b0a-86d7-86aa22cb308e" status: 200 len: 1302 microversion: 2.1 time: 0.288986 Oct 18 15:31:12.944314 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 838/1664] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:12 2022] GET /compute/v2.1/servers/61ca6b08-6a75-4b0a-86d7-86aa22cb308e => generated 1302 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:12.951550 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-1982c04c-00a6-40dd-be8b-4ad1700a2377 req-56a467f1-515a-4be4-911d-0ca28d406612 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d463b5e2-5fc0-4272-b141-476b1672cb18", "name": "network-vif-plugged", "status": "completed", "tag": "74e379cc-981c-4e4c-ab35-62118bbf38c0"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:31:12.965247 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-1982c04c-00a6-40dd-be8b-4ad1700a2377 req-56a467f1-515a-4be4-911d-0ca28d406612 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:12.966123 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-1982c04c-00a6-40dd-be8b-4ad1700a2377 req-56a467f1-515a-4be4-911d-0ca28d406612 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:12.966993 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-1982c04c-00a6-40dd-be8b-4ad1700a2377 req-56a467f1-515a-4be4-911d-0ca28d406612 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:12.995841 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-1982c04c-00a6-40dd-be8b-4ad1700a2377 req-56a467f1-515a-4be4-911d-0ca28d406612 service nova] Creating event network-vif-plugged:74e379cc-981c-4e4c-ab35-62118bbf38c0 for instance d463b5e2-5fc0-4272-b141-476b1672cb18 on n-h2-853682-5 Oct 18 15:31:13.013868 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-1982c04c-00a6-40dd-be8b-4ad1700a2377 req-56a467f1-515a-4be4-911d-0ca28d406612 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067954 Oct 18 15:31:13.028428 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 839/1665] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:31:13.081014 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c670555c-25d2-4bd3-84f6-514fd97e1b34 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:13.082474 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c670555c-25d2-4bd3-84f6-514fd97e1b34 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:13.103339 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c670555c-25d2-4bd3-84f6-514fd97e1b34 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:13.105153 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c670555c-25d2-4bd3-84f6-514fd97e1b34 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:13.110913 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c670555c-25d2-4bd3-84f6-514fd97e1b34 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:13.114806 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c670555c-25d2-4bd3-84f6-514fd97e1b34 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:13.115625 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c670555c-25d2-4bd3-84f6-514fd97e1b34 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:13.117368 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c670555c-25d2-4bd3-84f6-514fd97e1b34 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:13.295207 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c670555c-25d2-4bd3-84f6-514fd97e1b34 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:13.314232 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c670555c-25d2-4bd3-84f6-514fd97e1b34 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:13.316522 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c670555c-25d2-4bd3-84f6-514fd97e1b34 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:13.323788 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c670555c-25d2-4bd3-84f6-514fd97e1b34 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1546 microversion: 2.91 time: 0.280464 Oct 18 15:31:13.325196 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 840/1666] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:13 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1546 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:31:13.330137 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b4388032-ab94-433c-9257-c61409edca88 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:13.330874 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b4388032-ab94-433c-9257-c61409edca88 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 44a77c90-3a7e-435e-adba-e3a0551d573f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:13.337647 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b4388032-ab94-433c-9257-c61409edca88 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:13.338260 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b4388032-ab94-433c-9257-c61409edca88 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:13.338804 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b4388032-ab94-433c-9257-c61409edca88 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:13.339618 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b4388032-ab94-433c-9257-c61409edca88 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:13.340181 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b4388032-ab94-433c-9257-c61409edca88 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:13.340712 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b4388032-ab94-433c-9257-c61409edca88 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:13.568099 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b4388032-ab94-433c-9257-c61409edca88 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:13.579486 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b4388032-ab94-433c-9257-c61409edca88 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f" status: 200 len: 1307 microversion: 2.1 time: 0.252213 Oct 18 15:31:13.591216 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 841/1667] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:13 2022] GET /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f => generated 1307 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:13.603728 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-a58b1067-848a-4288-98e8-beb4d794661d req-6424a722-6029-45c3-91d6-9f450e7db1a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61ca6b08-6a75-4b0a-86d7-86aa22cb308e", "name": "network-vif-deleted", "tag": "58bcda15-2a2a-4876-9238-6d661ea3a876"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:31:13.615171 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-a58b1067-848a-4288-98e8-beb4d794661d req-6424a722-6029-45c3-91d6-9f450e7db1a2 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:13.615866 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-a58b1067-848a-4288-98e8-beb4d794661d req-6424a722-6029-45c3-91d6-9f450e7db1a2 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:13.616723 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-a58b1067-848a-4288-98e8-beb4d794661d req-6424a722-6029-45c3-91d6-9f450e7db1a2 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:13.631418 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-a58b1067-848a-4288-98e8-beb4d794661d req-6424a722-6029-45c3-91d6-9f450e7db1a2 service nova] Creating event network-vif-deleted:58bcda15-2a2a-4876-9238-6d661ea3a876 for instance 61ca6b08-6a75-4b0a-86d7-86aa22cb308e on n-h1-853682-5 Oct 18 15:31:13.637256 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-a58b1067-848a-4288-98e8-beb4d794661d req-6424a722-6029-45c3-91d6-9f450e7db1a2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038522 Oct 18 15:31:13.638410 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 842/1668] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:31:13.645402 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-93deac07-ad9f-4bc5-a147-24c93da5aaa0 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:13.646249 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-93deac07-ad9f-4bc5-a147-24c93da5aaa0 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] [instance: d463b5e2-5fc0-4272-b141-476b1672cb18] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:13.653891 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-93deac07-ad9f-4bc5-a147-24c93da5aaa0 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:13.654521 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-93deac07-ad9f-4bc5-a147-24c93da5aaa0 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:13.655300 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-93deac07-ad9f-4bc5-a147-24c93da5aaa0 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:13.656242 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-93deac07-ad9f-4bc5-a147-24c93da5aaa0 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:13.657366 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-93deac07-ad9f-4bc5-a147-24c93da5aaa0 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:13.657893 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-93deac07-ad9f-4bc5-a147-24c93da5aaa0 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:13.882987 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-93deac07-ad9f-4bc5-a147-24c93da5aaa0 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fd21586dad64dd0832fc9794aa18971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae26b8b2a734cb09f6fd2c26f75c66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:13.894242 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-93deac07-ad9f-4bc5-a147-24c93da5aaa0 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] 10.222.0.60 "GET /compute/v2.1/servers/d463b5e2-5fc0-4272-b141-476b1672cb18" status: 200 len: 1315 microversion: 2.1 time: 0.254182 Oct 18 15:31:13.908741 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 843/1669] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:13 2022] GET /compute/v2.1/servers/d463b5e2-5fc0-4272-b141-476b1672cb18 => generated 1315 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:13.928238 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0473909f-e6bf-4f2a-ab38-60cd844d61b0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:13.929706 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0473909f-e6bf-4f2a-ab38-60cd844d61b0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:13.941152 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0473909f-e6bf-4f2a-ab38-60cd844d61b0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:13.941622 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0473909f-e6bf-4f2a-ab38-60cd844d61b0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:13.942074 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0473909f-e6bf-4f2a-ab38-60cd844d61b0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:13.942863 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0473909f-e6bf-4f2a-ab38-60cd844d61b0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:13.949593 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0473909f-e6bf-4f2a-ab38-60cd844d61b0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:13.951650 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0473909f-e6bf-4f2a-ab38-60cd844d61b0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:14.147165 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0473909f-e6bf-4f2a-ab38-60cd844d61b0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:14.159973 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0473909f-e6bf-4f2a-ab38-60cd844d61b0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e" status: 200 len: 1199 microversion: 2.1 time: 0.249547 Oct 18 15:31:14.161031 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 844/1670] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:13 2022] GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e => generated 1199 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:14.166771 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b1ae59ee-4074-43dc-820c-4e1547faf8e1 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:14.167384 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b1ae59ee-4074-43dc-820c-4e1547faf8e1 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] [instance: 61ca6b08-6a75-4b0a-86d7-86aa22cb308e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:14.174257 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b1ae59ee-4074-43dc-820c-4e1547faf8e1 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:14.175807 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b1ae59ee-4074-43dc-820c-4e1547faf8e1 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:14.176313 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b1ae59ee-4074-43dc-820c-4e1547faf8e1 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:14.177062 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b1ae59ee-4074-43dc-820c-4e1547faf8e1 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:14.177520 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b1ae59ee-4074-43dc-820c-4e1547faf8e1 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:14.178149 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b1ae59ee-4074-43dc-820c-4e1547faf8e1 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:14.195081 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-b1ae59ee-4074-43dc-820c-4e1547faf8e1 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] HTTP exception thrown: Instance 61ca6b08-6a75-4b0a-86d7-86aa22cb308e could not be found. Oct 18 15:31:14.197314 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b1ae59ee-4074-43dc-820c-4e1547faf8e1 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Request method failure captured: Oct 18 15:31:14.197314 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/61ca6b08-6a75-4b0a-86d7-86aa22cb308e HTTP/1.1 Oct 18 15:31:14.197314 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:31:14.197314 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:31:14.197314 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:31:14.197314 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:31:14.197314 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:31:14.197314 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:31:14.197314 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:31:14.197314 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:31:14.197314 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsXUy9FAAJJ0Ruh4wwEA9szjF7RLudGwF2cxYyUzJkwyma_At_umHw9EflsFK-fFl5HDZF0eGpwWYNbkl96nz5je7IB6PyqBeik4MLzcoYbCjQBM01G06iG1mP4Ny9aewc_L7MlMIXu3Yta_wCU8nd9Gbv-uOlENc7ZsnBI5A37iAsc Oct 18 15:31:14.197314 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:31:14.197314 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:31:14.197314 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:31:14.197314 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:31:14.197314 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:31:14.197314 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:31:14.197314 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 377c3bbd62b546fca545c0f6d0df59e3 Oct 18 15:31:14.197314 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServersOnMultiNodesTest-1788579982 Oct 18 15:31:14.197314 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:31:14.197314 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:31:14.199137 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/377c3bbd62b546fca545c0f6d0df59e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/377c3bbd62b546fca545c0f6d0df59e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/377c3bbd62b546fca545c0f6d0df59e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_377c3bbd62b546fca545c0f6d0df59e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:31:14.199137 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServersOnMultiNodesTest-1788579982 Oct 18 15:31:14.199137 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 377c3bbd62b546fca545c0f6d0df59e3 Oct 18 15:31:14.199137 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1788579982 Oct 18 15:31:14.199137 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServersOnMultiNodesTest-1788579982-project Oct 18 15:31:14.199137 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:31:14.199137 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:31:14.199137 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: d58aac335a1d421a95928e2754fb2529 Oct 18 15:31:14.199137 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServersOnMultiNodesTest-1788579982-project Oct 18 15:31:14.199137 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:31:14.199137 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 61ca6b08-6a75-4b0a-86d7-86aa22cb308e could not be found. Oct 18 15:31:14.199137 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '61ca6b08-6a75-4b0a-86d7-86aa22cb308e'} Oct 18 15:31:14.200179 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:31:14.200179 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:14.200179 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:31:14.200179 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:31:14.200179 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:31:14.200179 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:31:14.200179 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:31:14.200179 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:31:14.200179 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:31:14.200179 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:31:14.200179 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61ca6b08-6a75-4b0a-86d7-86aa22cb308e could not be found. Oct 18 15:31:14.200179 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:14.200179 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:14.200179 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:14.200179 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:14.200179 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:14.200179 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:14.200179 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:31:14.200179 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:31:14.200179 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:31:14.202003 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:31:14.202003 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:31:14.202003 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:31:14.202003 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:31:14.202003 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:31:14.202003 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:31:14.202003 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:31:14.202003 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61ca6b08-6a75-4b0a-86d7-86aa22cb308e could not be found. Oct 18 15:31:14.202003 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:14.202003 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:14.202003 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:14.202003 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:14.202003 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:14.202003 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:14.202003 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:31:14.202003 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:31:14.202003 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61ca6b08-6a75-4b0a-86d7-86aa22cb308e could not be found. Oct 18 15:31:14.202003 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:14.205188 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b1ae59ee-4074-43dc-820c-4e1547faf8e1 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] Returning 404 to user: Instance 61ca6b08-6a75-4b0a-86d7-86aa22cb308e could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:31:14.205188 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b1ae59ee-4074-43dc-820c-4e1547faf8e1 tempest-ServersOnMultiNodesTest-1788579982 tempest-ServersOnMultiNodesTest-1788579982-project] 10.222.0.60 "GET /compute/v2.1/servers/61ca6b08-6a75-4b0a-86d7-86aa22cb308e" status: 404 len: 111 microversion: 2.1 time: 0.036081 Oct 18 15:31:14.205188 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 845/1671] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:14 2022] GET /compute/v2.1/servers/61ca6b08-6a75-4b0a-86d7-86aa22cb308e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:31:14.360245 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2045011d-242c-4a39-aa91-a43dc0873f6f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:14.361595 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2045011d-242c-4a39-aa91-a43dc0873f6f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:14.370140 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2045011d-242c-4a39-aa91-a43dc0873f6f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:14.370647 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2045011d-242c-4a39-aa91-a43dc0873f6f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:14.371073 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2045011d-242c-4a39-aa91-a43dc0873f6f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:14.373070 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2045011d-242c-4a39-aa91-a43dc0873f6f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:14.373544 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2045011d-242c-4a39-aa91-a43dc0873f6f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:14.374118 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2045011d-242c-4a39-aa91-a43dc0873f6f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:14.480972 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2045011d-242c-4a39-aa91-a43dc0873f6f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:14.496190 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2045011d-242c-4a39-aa91-a43dc0873f6f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:14.498075 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2045011d-242c-4a39-aa91-a43dc0873f6f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:14.510026 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2045011d-242c-4a39-aa91-a43dc0873f6f tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1546 microversion: 2.91 time: 0.153975 Oct 18 15:31:14.514300 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 846/1672] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:14 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1546 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:31:14.567162 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-60d03841-1878-4fe5-b65e-ac3d72e6e1f4 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:31:14.568238 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-60d03841-1878-4fe5-b65e-ac3d72e6e1f4 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:31:14.568720 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-60d03841-1878-4fe5-b65e-ac3d72e6e1f4 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:31:14.569159 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-60d03841-1878-4fe5-b65e-ac3d72e6e1f4 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:31:14.569572 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-60d03841-1878-4fe5-b65e-ac3d72e6e1f4 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:31:14.605816 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1e31ae63-b812-4088-980b-c8d6f67e0b8c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:14.606541 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1e31ae63-b812-4088-980b-c8d6f67e0b8c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 44a77c90-3a7e-435e-adba-e3a0551d573f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:14.613387 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1e31ae63-b812-4088-980b-c8d6f67e0b8c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:14.614179 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1e31ae63-b812-4088-980b-c8d6f67e0b8c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:14.614759 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1e31ae63-b812-4088-980b-c8d6f67e0b8c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:14.615856 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1e31ae63-b812-4088-980b-c8d6f67e0b8c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:14.616328 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1e31ae63-b812-4088-980b-c8d6f67e0b8c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:14.618424 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1e31ae63-b812-4088-980b-c8d6f67e0b8c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:14.650851 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-60d03841-1878-4fe5-b65e-ac3d72e6e1f4 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] [instance: 234a024f-c13b-40de-bbcb-ffcdda611d01] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:14.660773 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60d03841-1878-4fe5-b65e-ac3d72e6e1f4 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:14.661687 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60d03841-1878-4fe5-b65e-ac3d72e6e1f4 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:14.662435 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60d03841-1878-4fe5-b65e-ac3d72e6e1f4 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:14.663575 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60d03841-1878-4fe5-b65e-ac3d72e6e1f4 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:14.664932 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60d03841-1878-4fe5-b65e-ac3d72e6e1f4 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:14.665153 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60d03841-1878-4fe5-b65e-ac3d72e6e1f4 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:14.758485 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-60d03841-1878-4fe5-b65e-ac3d72e6e1f4 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:14.767699 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-60d03841-1878-4fe5-b65e-ac3d72e6e1f4 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:14.770850 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-60d03841-1878-4fe5-b65e-ac3d72e6e1f4 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:14.777205 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-60d03841-1878-4fe5-b65e-ac3d72e6e1f4 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] 10.222.0.60 "POST /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01/action" status: 202 len: 1494 microversion: 2.75 time: 6.719257 Oct 18 15:31:14.788898 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 827/1673] 10.222.0.60 () {62 vars in 1319 bytes} [Tue Oct 18 15:31:08 2022] POST /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01/action => generated 1494 bytes in 6729 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 18 15:31:14.808612 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-806ee9e0-29ed-478a-8948-d909112f1bbf tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:14.809311 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-806ee9e0-29ed-478a-8948-d909112f1bbf tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] [instance: 234a024f-c13b-40de-bbcb-ffcdda611d01] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:14.819140 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-806ee9e0-29ed-478a-8948-d909112f1bbf tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:14.819560 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-806ee9e0-29ed-478a-8948-d909112f1bbf tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:14.820001 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-806ee9e0-29ed-478a-8948-d909112f1bbf tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:14.820718 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-806ee9e0-29ed-478a-8948-d909112f1bbf tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:14.821209 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-806ee9e0-29ed-478a-8948-d909112f1bbf tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:14.821636 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-806ee9e0-29ed-478a-8948-d909112f1bbf tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:14.839644 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1e31ae63-b812-4088-980b-c8d6f67e0b8c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:14.849081 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1e31ae63-b812-4088-980b-c8d6f67e0b8c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f" status: 200 len: 1307 microversion: 2.1 time: 0.247581 Oct 18 15:31:14.858128 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 847/1674] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:14 2022] GET /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f => generated 1307 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:31:14.921805 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a5387833-54f8-4978-b75e-2aacc02cc464 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:14.921805 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a5387833-54f8-4978-b75e-2aacc02cc464 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] [instance: d463b5e2-5fc0-4272-b141-476b1672cb18] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:14.926990 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a5387833-54f8-4978-b75e-2aacc02cc464 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:14.927486 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a5387833-54f8-4978-b75e-2aacc02cc464 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:14.927992 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a5387833-54f8-4978-b75e-2aacc02cc464 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:14.931276 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-806ee9e0-29ed-478a-8948-d909112f1bbf tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:14.936581 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a5387833-54f8-4978-b75e-2aacc02cc464 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:14.937123 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a5387833-54f8-4978-b75e-2aacc02cc464 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:14.937642 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a5387833-54f8-4978-b75e-2aacc02cc464 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:14.942126 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-806ee9e0-29ed-478a-8948-d909112f1bbf tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:14.946384 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-806ee9e0-29ed-478a-8948-d909112f1bbf tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:14.953071 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-806ee9e0-29ed-478a-8948-d909112f1bbf tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] 10.222.0.60 "GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01" status: 200 len: 1446 microversion: 2.75 time: 0.148258 Oct 18 15:31:14.954039 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 828/1675] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:14 2022] GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01 => generated 1446 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:31:15.124143 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a5387833-54f8-4978-b75e-2aacc02cc464 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fd21586dad64dd0832fc9794aa18971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae26b8b2a734cb09f6fd2c26f75c66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:15.129154 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=100 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:31:15.137106 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a5387833-54f8-4978-b75e-2aacc02cc464 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] 10.222.0.60 "GET /compute/v2.1/servers/d463b5e2-5fc0-4272-b141-476b1672cb18" status: 200 len: 1315 microversion: 2.1 time: 0.222913 Oct 18 15:31:15.138300 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 848/1676] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:14 2022] GET /compute/v2.1/servers/d463b5e2-5fc0-4272-b141-476b1672cb18 => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:31:15.186981 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e695e2c0-38c5-466e-bdde-030d3bb04f89 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:15.189464 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e695e2c0-38c5-466e-bdde-030d3bb04f89 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:15.198128 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e695e2c0-38c5-466e-bdde-030d3bb04f89 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:15.199224 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e695e2c0-38c5-466e-bdde-030d3bb04f89 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:15.199873 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e695e2c0-38c5-466e-bdde-030d3bb04f89 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:15.200791 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e695e2c0-38c5-466e-bdde-030d3bb04f89 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:15.201595 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e695e2c0-38c5-466e-bdde-030d3bb04f89 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:15.202354 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e695e2c0-38c5-466e-bdde-030d3bb04f89 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:15.370349 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e695e2c0-38c5-466e-bdde-030d3bb04f89 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:15.380561 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e695e2c0-38c5-466e-bdde-030d3bb04f89 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e" status: 200 len: 1199 microversion: 2.1 time: 0.198616 Oct 18 15:31:15.396997 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 829/1677] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:15 2022] GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e => generated 1199 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:15.532138 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-943600f5-279b-4241-bec4-3ffe0087286c req-20948659-35cc-47db-bc7e-4922ca151d80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44a77c90-3a7e-435e-adba-e3a0551d573f", "name": "network-vif-plugged", "status": "completed", "tag": "80678c44-08fb-43ea-9c10-8772eef6cf68"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:31:15.550353 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-943600f5-279b-4241-bec4-3ffe0087286c req-20948659-35cc-47db-bc7e-4922ca151d80 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:15.551752 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-943600f5-279b-4241-bec4-3ffe0087286c req-20948659-35cc-47db-bc7e-4922ca151d80 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:15.552301 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-943600f5-279b-4241-bec4-3ffe0087286c req-20948659-35cc-47db-bc7e-4922ca151d80 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:15.560291 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b2b39ea3-d0ce-411a-96f9-bcaa88235ce0 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:15.561450 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b2b39ea3-d0ce-411a-96f9-bcaa88235ce0 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:15.568028 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-943600f5-279b-4241-bec4-3ffe0087286c req-20948659-35cc-47db-bc7e-4922ca151d80 service nova] Creating event network-vif-plugged:80678c44-08fb-43ea-9c10-8772eef6cf68 for instance 44a77c90-3a7e-435e-adba-e3a0551d573f on n-h1-853682-5 Oct 18 15:31:15.574626 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2b39ea3-d0ce-411a-96f9-bcaa88235ce0 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:15.575191 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-943600f5-279b-4241-bec4-3ffe0087286c req-20948659-35cc-47db-bc7e-4922ca151d80 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050089 Oct 18 15:31:15.575854 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 849/1678] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:31:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:31:15.575983 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2b39ea3-d0ce-411a-96f9-bcaa88235ce0 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:15.576321 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2b39ea3-d0ce-411a-96f9-bcaa88235ce0 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:15.579388 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2b39ea3-d0ce-411a-96f9-bcaa88235ce0 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:15.580341 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2b39ea3-d0ce-411a-96f9-bcaa88235ce0 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:15.581925 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2b39ea3-d0ce-411a-96f9-bcaa88235ce0 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:15.733074 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b2b39ea3-d0ce-411a-96f9-bcaa88235ce0 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:15.751514 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b2b39ea3-d0ce-411a-96f9-bcaa88235ce0 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:15.752997 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b2b39ea3-d0ce-411a-96f9-bcaa88235ce0 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:15.769647 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b2b39ea3-d0ce-411a-96f9-bcaa88235ce0 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1546 microversion: 2.91 time: 0.213097 Oct 18 15:31:15.770519 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 830/1679] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:15 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1546 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:31:15.878682 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-37e7c75c-e175-4799-be0b-aedd9b665406 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:15.879376 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-37e7c75c-e175-4799-be0b-aedd9b665406 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 44a77c90-3a7e-435e-adba-e3a0551d573f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:15.885774 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37e7c75c-e175-4799-be0b-aedd9b665406 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:15.886291 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37e7c75c-e175-4799-be0b-aedd9b665406 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:15.886709 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37e7c75c-e175-4799-be0b-aedd9b665406 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:15.887397 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37e7c75c-e175-4799-be0b-aedd9b665406 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:15.887938 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37e7c75c-e175-4799-be0b-aedd9b665406 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:15.888547 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37e7c75c-e175-4799-be0b-aedd9b665406 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:15.984581 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-407ad921-f807-4002-bb6b-836fe54f2e3d tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:15.986172 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-407ad921-f807-4002-bb6b-836fe54f2e3d tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] [instance: 234a024f-c13b-40de-bbcb-ffcdda611d01] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:15.999327 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-407ad921-f807-4002-bb6b-836fe54f2e3d tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:16.000067 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-407ad921-f807-4002-bb6b-836fe54f2e3d tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:16.000775 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-407ad921-f807-4002-bb6b-836fe54f2e3d tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:16.001723 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-407ad921-f807-4002-bb6b-836fe54f2e3d tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:16.002475 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-407ad921-f807-4002-bb6b-836fe54f2e3d tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:16.003886 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-407ad921-f807-4002-bb6b-836fe54f2e3d tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:16.062149 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-37e7c75c-e175-4799-be0b-aedd9b665406 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:16.074516 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-37e7c75c-e175-4799-be0b-aedd9b665406 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f" status: 200 len: 1307 microversion: 2.1 time: 0.197768 Oct 18 15:31:16.077886 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 850/1680] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:15 2022] GET /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f => generated 1307 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:16.137174 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-407ad921-f807-4002-bb6b-836fe54f2e3d tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:16.148359 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-407ad921-f807-4002-bb6b-836fe54f2e3d tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:16.150331 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-407ad921-f807-4002-bb6b-836fe54f2e3d tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:16.157363 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-407ad921-f807-4002-bb6b-836fe54f2e3d tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] 10.222.0.60 "GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01" status: 200 len: 1446 microversion: 2.75 time: 0.178191 Oct 18 15:31:16.157986 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 831/1681] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:15 2022] GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01 => generated 1446 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:31:16.160930 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4776fd37-c4b5-45c1-8dd6-c4b37c7776bf tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:16.162258 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4776fd37-c4b5-45c1-8dd6-c4b37c7776bf tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] [instance: d463b5e2-5fc0-4272-b141-476b1672cb18] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:16.168315 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4776fd37-c4b5-45c1-8dd6-c4b37c7776bf tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:16.169954 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4776fd37-c4b5-45c1-8dd6-c4b37c7776bf tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:16.170772 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4776fd37-c4b5-45c1-8dd6-c4b37c7776bf tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:16.173145 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4776fd37-c4b5-45c1-8dd6-c4b37c7776bf tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:16.173615 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4776fd37-c4b5-45c1-8dd6-c4b37c7776bf tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:16.174225 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4776fd37-c4b5-45c1-8dd6-c4b37c7776bf tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:16.340960 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4776fd37-c4b5-45c1-8dd6-c4b37c7776bf tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fd21586dad64dd0832fc9794aa18971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae26b8b2a734cb09f6fd2c26f75c66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:16.351999 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4776fd37-c4b5-45c1-8dd6-c4b37c7776bf tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] 10.222.0.60 "GET /compute/v2.1/servers/d463b5e2-5fc0-4272-b141-476b1672cb18" status: 200 len: 1315 microversion: 2.1 time: 0.194429 Oct 18 15:31:16.364907 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 851/1682] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:16 2022] GET /compute/v2.1/servers/d463b5e2-5fc0-4272-b141-476b1672cb18 => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:31:16.407375 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d1bf8d94-2b17-4aff-a071-30d4cb314597 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:16.408348 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d1bf8d94-2b17-4aff-a071-30d4cb314597 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:16.416442 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1bf8d94-2b17-4aff-a071-30d4cb314597 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:16.417329 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1bf8d94-2b17-4aff-a071-30d4cb314597 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:16.417756 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1bf8d94-2b17-4aff-a071-30d4cb314597 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:16.418490 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1bf8d94-2b17-4aff-a071-30d4cb314597 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:16.419070 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1bf8d94-2b17-4aff-a071-30d4cb314597 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:16.419682 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1bf8d94-2b17-4aff-a071-30d4cb314597 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:16.631273 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d1bf8d94-2b17-4aff-a071-30d4cb314597 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:16.641192 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d1bf8d94-2b17-4aff-a071-30d4cb314597 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e" status: 200 len: 1199 microversion: 2.1 time: 0.241278 Oct 18 15:31:16.654165 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 832/1683] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:16 2022] GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e => generated 1199 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:16.800930 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ed002d83-a87f-4927-8e01-b81876b8c5c2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:16.801637 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ed002d83-a87f-4927-8e01-b81876b8c5c2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:16.809688 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:31:16.811391 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ed002d83-a87f-4927-8e01-b81876b8c5c2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:16.815093 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ed002d83-a87f-4927-8e01-b81876b8c5c2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:16.815926 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ed002d83-a87f-4927-8e01-b81876b8c5c2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:16.817004 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ed002d83-a87f-4927-8e01-b81876b8c5c2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:16.817651 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ed002d83-a87f-4927-8e01-b81876b8c5c2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:16.818271 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ed002d83-a87f-4927-8e01-b81876b8c5c2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:16.900057 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ed002d83-a87f-4927-8e01-b81876b8c5c2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:16.910938 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ed002d83-a87f-4927-8e01-b81876b8c5c2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:16.913050 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ed002d83-a87f-4927-8e01-b81876b8c5c2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:16.920888 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ed002d83-a87f-4927-8e01-b81876b8c5c2 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1546 microversion: 2.91 time: 0.124511 Oct 18 15:31:16.925221 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 852/1684] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:16 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1546 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:31:17.101716 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-747b2363-64d9-49a2-a559-73ad39d68e73 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:17.103346 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-747b2363-64d9-49a2-a559-73ad39d68e73 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 44a77c90-3a7e-435e-adba-e3a0551d573f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:17.112598 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-747b2363-64d9-49a2-a559-73ad39d68e73 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:17.113135 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-747b2363-64d9-49a2-a559-73ad39d68e73 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:17.113569 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-747b2363-64d9-49a2-a559-73ad39d68e73 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:17.114456 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-747b2363-64d9-49a2-a559-73ad39d68e73 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:17.114916 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-747b2363-64d9-49a2-a559-73ad39d68e73 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:17.115343 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-747b2363-64d9-49a2-a559-73ad39d68e73 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:17.187288 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f1548557-8789-4035-9987-8e9c17fcb1e7 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:17.187939 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f1548557-8789-4035-9987-8e9c17fcb1e7 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] [instance: 234a024f-c13b-40de-bbcb-ffcdda611d01] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:17.195383 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f1548557-8789-4035-9987-8e9c17fcb1e7 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:17.196105 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f1548557-8789-4035-9987-8e9c17fcb1e7 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:17.196536 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f1548557-8789-4035-9987-8e9c17fcb1e7 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:17.197263 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f1548557-8789-4035-9987-8e9c17fcb1e7 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:17.198298 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f1548557-8789-4035-9987-8e9c17fcb1e7 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:17.198877 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f1548557-8789-4035-9987-8e9c17fcb1e7 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:17.320628 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f1548557-8789-4035-9987-8e9c17fcb1e7 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:17.330588 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f1548557-8789-4035-9987-8e9c17fcb1e7 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:17.332062 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f1548557-8789-4035-9987-8e9c17fcb1e7 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:17.338956 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f1548557-8789-4035-9987-8e9c17fcb1e7 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] 10.222.0.60 "GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01" status: 200 len: 1446 microversion: 2.75 time: 0.155790 Oct 18 15:31:17.349455 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 853/1685] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:17 2022] GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01 => generated 1446 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:31:17.361095 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-747b2363-64d9-49a2-a559-73ad39d68e73 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:17.372702 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-747b2363-64d9-49a2-a559-73ad39d68e73 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f" status: 200 len: 1307 microversion: 2.1 time: 0.274620 Oct 18 15:31:17.373911 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 833/1686] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:17 2022] GET /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f => generated 1307 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:17.377562 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0bcfbe89-be65-4881-99ac-4359a7cf5aca tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:17.378187 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0bcfbe89-be65-4881-99ac-4359a7cf5aca tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] [instance: d463b5e2-5fc0-4272-b141-476b1672cb18] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:17.385312 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0bcfbe89-be65-4881-99ac-4359a7cf5aca tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:17.385812 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0bcfbe89-be65-4881-99ac-4359a7cf5aca tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:17.386254 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0bcfbe89-be65-4881-99ac-4359a7cf5aca tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:17.386972 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0bcfbe89-be65-4881-99ac-4359a7cf5aca tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:17.387433 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0bcfbe89-be65-4881-99ac-4359a7cf5aca tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:17.387865 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0bcfbe89-be65-4881-99ac-4359a7cf5aca tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:17.539484 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0bcfbe89-be65-4881-99ac-4359a7cf5aca tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fd21586dad64dd0832fc9794aa18971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae26b8b2a734cb09f6fd2c26f75c66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:17.548956 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0bcfbe89-be65-4881-99ac-4359a7cf5aca tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] 10.222.0.60 "GET /compute/v2.1/servers/d463b5e2-5fc0-4272-b141-476b1672cb18" status: 200 len: 1503 microversion: 2.1 time: 0.175803 Oct 18 15:31:17.549742 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 854/1687] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:17 2022] GET /compute/v2.1/servers/d463b5e2-5fc0-4272-b141-476b1672cb18 => generated 1503 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:31:17.572585 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e698ee65-0558-4cb8-ac9c-57d20b03fae1 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:17.573218 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e698ee65-0558-4cb8-ac9c-57d20b03fae1 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] [instance: d463b5e2-5fc0-4272-b141-476b1672cb18] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:17.581018 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e698ee65-0558-4cb8-ac9c-57d20b03fae1 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:17.581966 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e698ee65-0558-4cb8-ac9c-57d20b03fae1 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:17.583056 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e698ee65-0558-4cb8-ac9c-57d20b03fae1 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:17.584144 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e698ee65-0558-4cb8-ac9c-57d20b03fae1 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:17.585179 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e698ee65-0558-4cb8-ac9c-57d20b03fae1 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:17.585746 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e698ee65-0558-4cb8-ac9c-57d20b03fae1 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:17.617779 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e698ee65-0558-4cb8-ac9c-57d20b03fae1 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] [instance: d463b5e2-5fc0-4272-b141-476b1672cb18] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:31:17.666103 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-57539a5b-83c8-4814-bca2-efc8ef7f025f tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:17.668152 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-57539a5b-83c8-4814-bca2-efc8ef7f025f tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:17.679370 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57539a5b-83c8-4814-bca2-efc8ef7f025f tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:17.680445 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57539a5b-83c8-4814-bca2-efc8ef7f025f tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:17.681090 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57539a5b-83c8-4814-bca2-efc8ef7f025f tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:17.681655 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57539a5b-83c8-4814-bca2-efc8ef7f025f tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:17.682823 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57539a5b-83c8-4814-bca2-efc8ef7f025f tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:17.682823 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57539a5b-83c8-4814-bca2-efc8ef7f025f tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:17.722492 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e698ee65-0558-4cb8-ac9c-57d20b03fae1 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d463b5e2-5fc0-4272-b141-476b1672cb18" status: 204 len: 0 microversion: 2.1 time: 0.153682 Oct 18 15:31:17.723113 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 834/1688] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:31:17 2022] DELETE /compute/v2.1/servers/d463b5e2-5fc0-4272-b141-476b1672cb18 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:31:17.733916 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5ee85107-041a-4170-a970-08cabaa37dd6 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:17.735579 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5ee85107-041a-4170-a970-08cabaa37dd6 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] [instance: d463b5e2-5fc0-4272-b141-476b1672cb18] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:17.744296 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ee85107-041a-4170-a970-08cabaa37dd6 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:17.744909 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ee85107-041a-4170-a970-08cabaa37dd6 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:17.745692 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ee85107-041a-4170-a970-08cabaa37dd6 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:17.746503 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ee85107-041a-4170-a970-08cabaa37dd6 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:17.747033 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ee85107-041a-4170-a970-08cabaa37dd6 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:17.747809 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ee85107-041a-4170-a970-08cabaa37dd6 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:17.922630 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-57539a5b-83c8-4814-bca2-efc8ef7f025f tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:17.931434 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-57539a5b-83c8-4814-bca2-efc8ef7f025f tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e" status: 200 len: 1199 microversion: 2.1 time: 0.269713 Oct 18 15:31:17.932213 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 855/1689] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:17 2022] GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e => generated 1199 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:17.966914 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5ee85107-041a-4170-a970-08cabaa37dd6 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fd21586dad64dd0832fc9794aa18971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae26b8b2a734cb09f6fd2c26f75c66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:17.978510 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5ee85107-041a-4170-a970-08cabaa37dd6 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] 10.222.0.60 "GET /compute/v2.1/servers/d463b5e2-5fc0-4272-b141-476b1672cb18" status: 200 len: 1509 microversion: 2.1 time: 0.250665 Oct 18 15:31:17.979094 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 835/1690] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:17 2022] GET /compute/v2.1/servers/d463b5e2-5fc0-4272-b141-476b1672cb18 => generated 1509 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:31:17.983910 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5ec37121-be0b-4448-a36d-8fd425d90097 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:17.984731 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5ec37121-be0b-4448-a36d-8fd425d90097 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:17.992040 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ec37121-be0b-4448-a36d-8fd425d90097 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:17.992528 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ec37121-be0b-4448-a36d-8fd425d90097 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:17.993004 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ec37121-be0b-4448-a36d-8fd425d90097 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:17.993706 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ec37121-be0b-4448-a36d-8fd425d90097 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:17.994239 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ec37121-be0b-4448-a36d-8fd425d90097 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:17.994669 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ec37121-be0b-4448-a36d-8fd425d90097 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:18.068405 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5ec37121-be0b-4448-a36d-8fd425d90097 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:18.070756 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:31:18.080299 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5ec37121-be0b-4448-a36d-8fd425d90097 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:18.081799 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5ec37121-be0b-4448-a36d-8fd425d90097 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:18.088359 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5ec37121-be0b-4448-a36d-8fd425d90097 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1546 microversion: 2.91 time: 0.107992 Oct 18 15:31:18.089037 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 836/1691] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:17 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1546 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:31:18.103819 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1495de68-bfac-45ed-bf3d-f27eedd3e6b7 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-437474500", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:31:18.160442 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-1495de68-bfac-45ed-bf3d-f27eedd3e6b7 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] validate_networks() for None {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:31:18.360735 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-1495de68-bfac-45ed-bf3d-f27eedd3e6b7 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:31:18.361196 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-1495de68-bfac-45ed-bf3d-f27eedd3e6b7 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:31:18.361981 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-1495de68-bfac-45ed-bf3d-f27eedd3e6b7 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:31:18.362401 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-1495de68-bfac-45ed-bf3d-f27eedd3e6b7 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:31:18.362849 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-1495de68-bfac-45ed-bf3d-f27eedd3e6b7 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:31:18.369383 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f5f61039-eb10-4a52-bef6-74b521fab451 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:18.370066 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f5f61039-eb10-4a52-bef6-74b521fab451 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] [instance: 234a024f-c13b-40de-bbcb-ffcdda611d01] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:18.373831 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1495de68-bfac-45ed-bf3d-f27eedd3e6b7 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:18.373831 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1495de68-bfac-45ed-bf3d-f27eedd3e6b7 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:18.375804 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1495de68-bfac-45ed-bf3d-f27eedd3e6b7 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:18.377090 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1495de68-bfac-45ed-bf3d-f27eedd3e6b7 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:18.377961 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1495de68-bfac-45ed-bf3d-f27eedd3e6b7 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:18.378655 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1495de68-bfac-45ed-bf3d-f27eedd3e6b7 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:18.379242 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f5f61039-eb10-4a52-bef6-74b521fab451 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:18.379789 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f5f61039-eb10-4a52-bef6-74b521fab451 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:18.380282 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f5f61039-eb10-4a52-bef6-74b521fab451 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:18.381069 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f5f61039-eb10-4a52-bef6-74b521fab451 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:18.381594 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f5f61039-eb10-4a52-bef6-74b521fab451 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:18.382083 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f5f61039-eb10-4a52-bef6-74b521fab451 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:18.410588 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-1495de68-bfac-45ed-bf3d-f27eedd3e6b7 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Getting quotas for project feee8ee03b8646998338de04f4cb80dc. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:31:18.417782 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-1495de68-bfac-45ed-bf3d-f27eedd3e6b7 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Getting quotas for user e2678c8aad39402c885b6f780fd33165 and project feee8ee03b8646998338de04f4cb80dc. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:31:18.431039 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1495de68-bfac-45ed-bf3d-f27eedd3e6b7 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:31:18.433397 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1495de68-bfac-45ed-bf3d-f27eedd3e6b7 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] [instance: d869973f-2d6e-4324-951e-1f26239a593e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:31:18.462524 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f5f61039-eb10-4a52-bef6-74b521fab451 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:18.471550 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f5f61039-eb10-4a52-bef6-74b521fab451 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:18.475163 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f5f61039-eb10-4a52-bef6-74b521fab451 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:18.480725 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f5f61039-eb10-4a52-bef6-74b521fab451 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] 10.222.0.60 "GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01" status: 200 len: 1446 microversion: 2.75 time: 0.115244 Oct 18 15:31:18.481310 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1495de68-bfac-45ed-bf3d-f27eedd3e6b7 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.547909 Oct 18 15:31:18.481956 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 856/1692] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:31:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:31:18.486727 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-cd27e70e-4965-4cf2-a9e6-8a46609ff355 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:18.487343 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-cd27e70e-4965-4cf2-a9e6-8a46609ff355 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 44a77c90-3a7e-435e-adba-e3a0551d573f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:18.493389 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 837/1693] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:18 2022] GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01 => generated 1446 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:31:18.493626 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cd27e70e-4965-4cf2-a9e6-8a46609ff355 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:18.494118 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cd27e70e-4965-4cf2-a9e6-8a46609ff355 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:18.494725 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cd27e70e-4965-4cf2-a9e6-8a46609ff355 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:18.495444 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cd27e70e-4965-4cf2-a9e6-8a46609ff355 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:18.495918 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cd27e70e-4965-4cf2-a9e6-8a46609ff355 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:18.496332 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cd27e70e-4965-4cf2-a9e6-8a46609ff355 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:18.517204 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c5ef05fb-571b-47ff-be94-093414996459 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:18.517824 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c5ef05fb-571b-47ff-be94-093414996459 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] [instance: d869973f-2d6e-4324-951e-1f26239a593e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:18.597321 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c5ef05fb-571b-47ff-be94-093414996459 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2678c8aad39402c885b6f780fd33165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feee8ee03b8646998338de04f4cb80dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:18.606860 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c5ef05fb-571b-47ff-be94-093414996459 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] 10.222.0.60 "GET /compute/v2.1/servers/d869973f-2d6e-4324-951e-1f26239a593e" status: 200 len: 1213 microversion: 2.1 time: 0.101852 Oct 18 15:31:18.608300 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 838/1694] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:18 2022] GET /compute/v2.1/servers/d869973f-2d6e-4324-951e-1f26239a593e => generated 1213 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:18.665286 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-cd27e70e-4965-4cf2-a9e6-8a46609ff355 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:18.674839 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-cd27e70e-4965-4cf2-a9e6-8a46609ff355 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f" status: 200 len: 1487 microversion: 2.1 time: 0.191808 Oct 18 15:31:18.675693 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 857/1695] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:18 2022] GET /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f => generated 1487 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:18.697520 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-88bb8aa2-1dac-4ac6-98e5-370a2db48977 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-374212103"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:31:18.699920 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-88bb8aa2-1dac-4ac6-98e5-370a2db48977 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 44a77c90-3a7e-435e-adba-e3a0551d573f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:18.706849 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88bb8aa2-1dac-4ac6-98e5-370a2db48977 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:18.707344 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88bb8aa2-1dac-4ac6-98e5-370a2db48977 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:18.708051 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88bb8aa2-1dac-4ac6-98e5-370a2db48977 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:18.708752 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88bb8aa2-1dac-4ac6-98e5-370a2db48977 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:18.709230 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88bb8aa2-1dac-4ac6-98e5-370a2db48977 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:18.709655 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88bb8aa2-1dac-4ac6-98e5-370a2db48977 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:18.953696 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-88bb8aa2-1dac-4ac6-98e5-370a2db48977 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "POST /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f/action" status: 202 len: 0 microversion: 2.1 time: 0.259677 Oct 18 15:31:18.954633 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 839/1696] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:31:18 2022] POST /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 18 15:31:18.963214 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-32dbbb02-7c94-4293-8e22-055cc1546c38 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:18.964081 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-32dbbb02-7c94-4293-8e22-055cc1546c38 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:18.976366 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-32dbbb02-7c94-4293-8e22-055cc1546c38 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:18.979930 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-31e0398a-6baf-40ed-9c80-71c5375b8f6f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3cfbfdc0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:18.980528 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-32dbbb02-7c94-4293-8e22-055cc1546c38 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:18.981660 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-32dbbb02-7c94-4293-8e22-055cc1546c38 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:18.982678 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-32dbbb02-7c94-4293-8e22-055cc1546c38 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:18.986125 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-32dbbb02-7c94-4293-8e22-055cc1546c38 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:18.986768 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-32dbbb02-7c94-4293-8e22-055cc1546c38 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:19.212525 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-32dbbb02-7c94-4293-8e22-055cc1546c38 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:19.221982 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-32dbbb02-7c94-4293-8e22-055cc1546c38 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e" status: 200 len: 1199 microversion: 2.1 time: 0.270425 Oct 18 15:31:19.234849 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 858/1697] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:18 2022] GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e => generated 1199 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:19.240135 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-724c1ab0-4a27-40d4-9b58-850818a5b688 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:19.240967 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-724c1ab0-4a27-40d4-9b58-850818a5b688 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] [instance: d463b5e2-5fc0-4272-b141-476b1672cb18] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:19.248851 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-724c1ab0-4a27-40d4-9b58-850818a5b688 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:19.249342 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-724c1ab0-4a27-40d4-9b58-850818a5b688 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:19.250079 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-724c1ab0-4a27-40d4-9b58-850818a5b688 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:19.250831 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-724c1ab0-4a27-40d4-9b58-850818a5b688 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:19.251290 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-724c1ab0-4a27-40d4-9b58-850818a5b688 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:19.251929 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-724c1ab0-4a27-40d4-9b58-850818a5b688 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:19.503882 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-724c1ab0-4a27-40d4-9b58-850818a5b688 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fd21586dad64dd0832fc9794aa18971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae26b8b2a734cb09f6fd2c26f75c66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:19.512720 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-724c1ab0-4a27-40d4-9b58-850818a5b688 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] 10.222.0.60 "GET /compute/v2.1/servers/d463b5e2-5fc0-4272-b141-476b1672cb18" status: 200 len: 1509 microversion: 2.1 time: 0.282170 Oct 18 15:31:19.532136 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 859/1698] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:19 2022] GET /compute/v2.1/servers/d463b5e2-5fc0-4272-b141-476b1672cb18 => generated 1509 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:19.538460 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-82643d40-691c-4db5-be1a-8517a42861f4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:19.539083 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-82643d40-691c-4db5-be1a-8517a42861f4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:19.545323 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-82643d40-691c-4db5-be1a-8517a42861f4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:19.545793 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-82643d40-691c-4db5-be1a-8517a42861f4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:19.546286 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-82643d40-691c-4db5-be1a-8517a42861f4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:19.546989 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-82643d40-691c-4db5-be1a-8517a42861f4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:19.547501 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-82643d40-691c-4db5-be1a-8517a42861f4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:19.549771 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-82643d40-691c-4db5-be1a-8517a42861f4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:19.674272 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-82643d40-691c-4db5-be1a-8517a42861f4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:19.691764 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-82643d40-691c-4db5-be1a-8517a42861f4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:19.708983 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-82643d40-691c-4db5-be1a-8517a42861f4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:19.717669 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-82643d40-691c-4db5-be1a-8517a42861f4 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1546 microversion: 2.91 time: 0.184207 Oct 18 15:31:19.718892 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 860/1699] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:19 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1546 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:31:19.723708 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a94e247f-34b2-4418-8c2a-8b771d0208ea tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:19.724399 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a94e247f-34b2-4418-8c2a-8b771d0208ea tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] [instance: 234a024f-c13b-40de-bbcb-ffcdda611d01] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:19.743696 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a94e247f-34b2-4418-8c2a-8b771d0208ea tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:19.744460 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a94e247f-34b2-4418-8c2a-8b771d0208ea tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:19.745127 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a94e247f-34b2-4418-8c2a-8b771d0208ea tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:19.746846 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a94e247f-34b2-4418-8c2a-8b771d0208ea tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:19.747318 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a94e247f-34b2-4418-8c2a-8b771d0208ea tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:19.747802 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a94e247f-34b2-4418-8c2a-8b771d0208ea tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:19.832978 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a94e247f-34b2-4418-8c2a-8b771d0208ea tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:19.844959 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a94e247f-34b2-4418-8c2a-8b771d0208ea tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:19.847726 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a94e247f-34b2-4418-8c2a-8b771d0208ea tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:19.854356 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a94e247f-34b2-4418-8c2a-8b771d0208ea tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] 10.222.0.60 "GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01" status: 200 len: 1446 microversion: 2.75 time: 0.134299 Oct 18 15:31:19.871757 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 861/1700] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:19 2022] GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01 => generated 1446 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:31:19.877697 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-420f7ac9-5cf9-4b74-9aab-8fa0cfbf1995 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:19.881858 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-420f7ac9-5cf9-4b74-9aab-8fa0cfbf1995 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] [instance: d869973f-2d6e-4324-951e-1f26239a593e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:19.889482 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-420f7ac9-5cf9-4b74-9aab-8fa0cfbf1995 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:19.890394 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-420f7ac9-5cf9-4b74-9aab-8fa0cfbf1995 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:19.891473 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-420f7ac9-5cf9-4b74-9aab-8fa0cfbf1995 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:19.892257 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-420f7ac9-5cf9-4b74-9aab-8fa0cfbf1995 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:19.892794 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-420f7ac9-5cf9-4b74-9aab-8fa0cfbf1995 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:19.893461 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-420f7ac9-5cf9-4b74-9aab-8fa0cfbf1995 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:19.967371 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-31e0398a-6baf-40ed-9c80-71c5375b8f6f tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/fa50c49b-ee3b-42d3-9b04-297c3561e1e5" status: 200 len: 1411 microversion: 2.1 time: 0.997342 Oct 18 15:31:19.969366 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 840/1701] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:31:18 2022] GET /compute/v2.1/images/fa50c49b-ee3b-42d3-9b04-297c3561e1e5 => generated 1411 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:19.976596 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-420f7ac9-5cf9-4b74-9aab-8fa0cfbf1995 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2678c8aad39402c885b6f780fd33165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feee8ee03b8646998338de04f4cb80dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:19.991413 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-420f7ac9-5cf9-4b74-9aab-8fa0cfbf1995 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] 10.222.0.60 "GET /compute/v2.1/servers/d869973f-2d6e-4324-951e-1f26239a593e" status: 200 len: 1265 microversion: 2.1 time: 0.117370 Oct 18 15:31:19.992724 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 862/1702] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:19 2022] GET /compute/v2.1/servers/d869973f-2d6e-4324-951e-1f26239a593e => generated 1265 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:19.993828 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f33974be-edc1-4d0c-97e9-d31730309ab4 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3cfbfd30>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:20.073167 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f33974be-edc1-4d0c-97e9-d31730309ab4 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/fa50c49b-ee3b-42d3-9b04-297c3561e1e5" status: 200 len: 1411 microversion: 2.1 time: 0.085134 Oct 18 15:31:20.075795 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 841/1703] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:31:19 2022] GET /compute/v2.1/images/fa50c49b-ee3b-42d3-9b04-297c3561e1e5 => generated 1411 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:20.092832 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-271d092e-83b8-4460-842f-295e11a21be4 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d1d5160>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:20.152504 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-e7c7dccc-59c5-4141-a800-84eb06a82dbe req-0edbc209-564e-4219-b1c7-74d7d7593be3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d463b5e2-5fc0-4272-b141-476b1672cb18", "name": "network-vif-deleted", "tag": "74e379cc-981c-4e4c-ab35-62118bbf38c0"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:31:20.185564 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e7c7dccc-59c5-4141-a800-84eb06a82dbe req-0edbc209-564e-4219-b1c7-74d7d7593be3 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:20.186172 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e7c7dccc-59c5-4141-a800-84eb06a82dbe req-0edbc209-564e-4219-b1c7-74d7d7593be3 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:20.187485 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e7c7dccc-59c5-4141-a800-84eb06a82dbe req-0edbc209-564e-4219-b1c7-74d7d7593be3 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:20.228091 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-e7c7dccc-59c5-4141-a800-84eb06a82dbe req-0edbc209-564e-4219-b1c7-74d7d7593be3 service nova] Creating event network-vif-deleted:74e379cc-981c-4e4c-ab35-62118bbf38c0 for instance d463b5e2-5fc0-4272-b141-476b1672cb18 on n-h2-853682-5 Oct 18 15:31:20.236487 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-e7c7dccc-59c5-4141-a800-84eb06a82dbe req-0edbc209-564e-4219-b1c7-74d7d7593be3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089804 Oct 18 15:31:20.237417 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 842/1704] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:31:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:31:20.244775 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a7148f51-f6fa-4cb9-9338-71e396feaa37 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:20.245568 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a7148f51-f6fa-4cb9-9338-71e396feaa37 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:20.252318 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7148f51-f6fa-4cb9-9338-71e396feaa37 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:20.252853 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7148f51-f6fa-4cb9-9338-71e396feaa37 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:20.253270 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7148f51-f6fa-4cb9-9338-71e396feaa37 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:20.254093 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7148f51-f6fa-4cb9-9338-71e396feaa37 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:20.254553 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7148f51-f6fa-4cb9-9338-71e396feaa37 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:20.255069 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7148f51-f6fa-4cb9-9338-71e396feaa37 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:20.282875 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-271d092e-83b8-4460-842f-295e11a21be4 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "DELETE /compute/v2.1/images/fa50c49b-ee3b-42d3-9b04-297c3561e1e5" status: 204 len: 0 microversion: 2.1 time: 0.196495 Oct 18 15:31:20.284179 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 863/1705] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:20 2022] DELETE /compute/v2.1/images/fa50c49b-ee3b-42d3-9b04-297c3561e1e5 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:31:20.292073 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7c9857e6-00d9-4ca6-b871-0f5c7cdf6011 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d377af0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:20.334847 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-7c9857e6-00d9-4ca6-b871-0f5c7cdf6011 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] HTTP exception thrown: Image not found. Oct 18 15:31:20.385729 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7c9857e6-00d9-4ca6-b871-0f5c7cdf6011 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Request method failure captured: Oct 18 15:31:20.385729 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/images/fa50c49b-ee3b-42d3-9b04-297c3561e1e5 HTTP/1.1 Oct 18 15:31:20.385729 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:31:20.385729 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:31:20.385729 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:31:20.385729 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:31:20.385729 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:31:20.385729 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:31:20.385729 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:31:20.385729 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:31:20.385729 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsVPb3L3FP-98gtLv8YIMCLfGhe2cuyCUoKBkQOJf_VQrrdw3zjQkBJXdrz51U5RIPirvM4vBy0eEwDlKKADnhe_mWPayJHcQ6gOCTAUKl7bKbkNPv5luVRbp4n9QMAAUTtxVS9n4JhIyNIlSMcaFy8kvjpV-EFu6g7N-rErWpfgdCw Oct 18 15:31:20.385729 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:31:20.385729 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:31:20.385729 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:31:20.385729 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:31:20.385729 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:31:20.385729 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:31:20.385729 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: ee0a3f0c256544beb2df4f113da56137 Oct 18 15:31:20.385729 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ImagesTestJSON-180911091 Oct 18 15:31:20.385729 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:31:20.385729 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:31:20.387666 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:31:20.387666 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ImagesTestJSON-180911091 Oct 18 15:31:20.387666 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: ee0a3f0c256544beb2df4f113da56137 Oct 18 15:31:20.387666 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ImagesTestJSON-180911091 Oct 18 15:31:20.387666 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ImagesTestJSON-180911091-project Oct 18 15:31:20.387666 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:31:20.387666 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:31:20.387666 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: ed9cd936192c40efa9099edee445e90e Oct 18 15:31:20.387666 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ImagesTestJSON-180911091-project Oct 18 15:31:20.387666 n-d-853682-5 devstack@n-api.service[120405]: method: Oct 18 15:31:20.387666 n-d-853682-5 devstack@n-api.service[120405]: exception: Image not found. Oct 18 15:31:20.387666 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'fa50c49b-ee3b-42d3-9b04-297c3561e1e5'} Oct 18 15:31:20.387666 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:31:20.387666 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:20.389442 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 15:31:20.389442 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 15:31:20.389442 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 15:31:20.389442 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 15:31:20.389442 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 15:31:20.389442 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 15:31:20.389442 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 15:31:20.389442 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 15:31:20.389442 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 15:31:20.389442 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 15:31:20.389442 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 15:31:20.389442 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 15:31:20.389442 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 15:31:20.389442 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 15:31:20.389442 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 15:31:20.389442 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 15:31:20.389442 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID fa50c49b-ee3b-42d3-9b04-297c3561e1e5 Oct 18 15:31:20.389442 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:20.392170 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:20.392170 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:20.392170 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:20.392170 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 18 15:31:20.392170 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 18 15:31:20.392170 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 18 15:31:20.392170 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 18 15:31:20.392170 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 18 15:31:20.392170 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 18 15:31:20.392170 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 18 15:31:20.392170 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 18 15:31:20.392170 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 15:31:20.392170 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 15:31:20.392170 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 15:31:20.392170 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 15:31:20.392170 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 15:31:20.392170 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 15:31:20.392170 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 15:31:20.392170 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 15:31:20.393802 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 15:31:20.393802 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 15:31:20.393802 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 15:31:20.393802 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 15:31:20.393802 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 15:31:20.393802 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 15:31:20.393802 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 15:31:20.393802 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 15:31:20.393802 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fa50c49b-ee3b-42d3-9b04-297c3561e1e5 could not be found. Oct 18 15:31:20.393802 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:20.393802 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:20.393802 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:20.393802 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:20.393802 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:20.393802 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:20.393802 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:31:20.393802 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:31:20.393802 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:31:20.393802 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:31:20.395174 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:31:20.395174 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:31:20.395174 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 18 15:31:20.395174 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 15:31:20.395174 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 15:31:20.395174 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:20.395174 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:20.395174 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:20.395174 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:20.395174 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:20.395174 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:20.395174 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:31:20.395174 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:31:20.395174 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 15:31:20.395174 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:20.400736 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7c9857e6-00d9-4ca6-b871-0f5c7cdf6011 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Returning 404 to user: Image not found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:31:20.400736 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7c9857e6-00d9-4ca6-b871-0f5c7cdf6011 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/images/fa50c49b-ee3b-42d3-9b04-297c3561e1e5" status: 404 len: 62 microversion: 2.1 time: 0.111695 Oct 18 15:31:20.400736 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 864/1706] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:31:20 2022] GET /compute/v2.1/images/fa50c49b-ee3b-42d3-9b04-297c3561e1e5 => generated 62 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 18 15:31:20.414401 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-70a6d9b5-8176-465f-ba76-df55cfa2b161 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:20.415328 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-70a6d9b5-8176-465f-ba76-df55cfa2b161 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 44a77c90-3a7e-435e-adba-e3a0551d573f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:20.422950 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-70a6d9b5-8176-465f-ba76-df55cfa2b161 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:20.423738 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-70a6d9b5-8176-465f-ba76-df55cfa2b161 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:20.424339 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-70a6d9b5-8176-465f-ba76-df55cfa2b161 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:20.425263 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-70a6d9b5-8176-465f-ba76-df55cfa2b161 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:20.425891 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-70a6d9b5-8176-465f-ba76-df55cfa2b161 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:20.426461 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-70a6d9b5-8176-465f-ba76-df55cfa2b161 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:20.488699 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a7148f51-f6fa-4cb9-9338-71e396feaa37 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:20.506466 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a7148f51-f6fa-4cb9-9338-71e396feaa37 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e" status: 200 len: 1199 microversion: 2.1 time: 0.265984 Oct 18 15:31:20.507057 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 843/1707] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:20 2022] GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e => generated 1199 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:20.547664 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3a2787cc-68eb-4a9c-97fe-0e08fc8cb0b8 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:20.548264 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3a2787cc-68eb-4a9c-97fe-0e08fc8cb0b8 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] [instance: d463b5e2-5fc0-4272-b141-476b1672cb18] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:20.556311 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a2787cc-68eb-4a9c-97fe-0e08fc8cb0b8 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:20.557324 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a2787cc-68eb-4a9c-97fe-0e08fc8cb0b8 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:20.557788 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a2787cc-68eb-4a9c-97fe-0e08fc8cb0b8 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:20.559476 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a2787cc-68eb-4a9c-97fe-0e08fc8cb0b8 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:20.560134 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a2787cc-68eb-4a9c-97fe-0e08fc8cb0b8 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:20.561021 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a2787cc-68eb-4a9c-97fe-0e08fc8cb0b8 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:20.594630 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-70a6d9b5-8176-465f-ba76-df55cfa2b161 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:20.602891 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-70a6d9b5-8176-465f-ba76-df55cfa2b161 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f" status: 200 len: 1499 microversion: 2.1 time: 0.198172 Oct 18 15:31:20.604341 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 865/1708] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:20 2022] GET /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f => generated 1499 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:20.609394 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a2787cc-68eb-4a9c-97fe-0e08fc8cb0b8 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:20.610309 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a2787cc-68eb-4a9c-97fe-0e08fc8cb0b8 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:20.610745 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a2787cc-68eb-4a9c-97fe-0e08fc8cb0b8 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:20.611190 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-3a2787cc-68eb-4a9c-97fe-0e08fc8cb0b8 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lazy-loading 'fault' on Instance uuid d463b5e2-5fc0-4272-b141-476b1672cb18 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:31:20.653625 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3a2787cc-68eb-4a9c-97fe-0e08fc8cb0b8 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fd21586dad64dd0832fc9794aa18971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae26b8b2a734cb09f6fd2c26f75c66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:20.662015 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3a2787cc-68eb-4a9c-97fe-0e08fc8cb0b8 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] 10.222.0.60 "GET /compute/v2.1/servers/d463b5e2-5fc0-4272-b141-476b1672cb18" status: 200 len: 1305 microversion: 2.1 time: 0.119185 Oct 18 15:31:20.676851 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 844/1709] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:20 2022] GET /compute/v2.1/servers/d463b5e2-5fc0-4272-b141-476b1672cb18 => generated 1305 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:31:20.747161 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-62eef028-9a43-4fab-b0cc-7957772c431b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:20.747771 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-62eef028-9a43-4fab-b0cc-7957772c431b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:20.754473 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-62eef028-9a43-4fab-b0cc-7957772c431b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:20.754952 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-62eef028-9a43-4fab-b0cc-7957772c431b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:20.755388 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-62eef028-9a43-4fab-b0cc-7957772c431b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:20.756082 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-62eef028-9a43-4fab-b0cc-7957772c431b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:20.756536 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-62eef028-9a43-4fab-b0cc-7957772c431b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:20.756991 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-62eef028-9a43-4fab-b0cc-7957772c431b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:20.825584 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-62eef028-9a43-4fab-b0cc-7957772c431b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:20.834932 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-62eef028-9a43-4fab-b0cc-7957772c431b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:20.836310 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-62eef028-9a43-4fab-b0cc-7957772c431b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:20.842179 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-62eef028-9a43-4fab-b0cc-7957772c431b tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1533 microversion: 2.91 time: 0.099065 Oct 18 15:31:20.842803 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 866/1710] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:20 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1533 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:31:20.869423 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-51590bc6-286d-447a-aa7d-73faa21e60c4 tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:20.870111 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-51590bc6-286d-447a-aa7d-73faa21e60c4 tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:20.877000 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51590bc6-286d-447a-aa7d-73faa21e60c4 tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:20.877488 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51590bc6-286d-447a-aa7d-73faa21e60c4 tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:20.877921 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51590bc6-286d-447a-aa7d-73faa21e60c4 tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:20.878867 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51590bc6-286d-447a-aa7d-73faa21e60c4 tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:20.879327 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51590bc6-286d-447a-aa7d-73faa21e60c4 tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:20.879753 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51590bc6-286d-447a-aa7d-73faa21e60c4 tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:20.883374 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a7f9719a-30ec-43d9-96d7-7bad0cfb39a8 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:20.883990 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a7f9719a-30ec-43d9-96d7-7bad0cfb39a8 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] [instance: 234a024f-c13b-40de-bbcb-ffcdda611d01] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:20.890422 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a7f9719a-30ec-43d9-96d7-7bad0cfb39a8 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:20.890973 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a7f9719a-30ec-43d9-96d7-7bad0cfb39a8 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:20.891415 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a7f9719a-30ec-43d9-96d7-7bad0cfb39a8 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:20.892121 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a7f9719a-30ec-43d9-96d7-7bad0cfb39a8 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:20.892577 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a7f9719a-30ec-43d9-96d7-7bad0cfb39a8 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:20.893035 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a7f9719a-30ec-43d9-96d7-7bad0cfb39a8 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:20.981044 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a7f9719a-30ec-43d9-96d7-7bad0cfb39a8 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:20.990602 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a7f9719a-30ec-43d9-96d7-7bad0cfb39a8 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:20.990800 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-51590bc6-286d-447a-aa7d-73faa21e60c4 tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] Lazy-loading 'services' on Instance uuid 45bc3ebe-2b14-4188-a636-309fd0582617 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:31:20.992070 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a7f9719a-30ec-43d9-96d7-7bad0cfb39a8 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:20.997470 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a7f9719a-30ec-43d9-96d7-7bad0cfb39a8 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] 10.222.0.60 "GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01" status: 200 len: 1446 microversion: 2.75 time: 0.118021 Oct 18 15:31:20.998815 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 867/1711] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:20 2022] GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01 => generated 1446 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:31:21.010205 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-51590bc6-286d-447a-aa7d-73faa21e60c4 tempest-UnshelveToHostMultiNodesTest-77203623 tempest-UnshelveToHostMultiNodesTest-77203623-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1938 microversion: 2.91 time: 0.144410 Oct 18 15:31:21.013046 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 845/1712] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:20 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1938 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:31:21.022631 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7072150e-d04d-406b-8347-dded11f707a8 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:21.023400 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7072150e-d04d-406b-8347-dded11f707a8 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] [instance: d869973f-2d6e-4324-951e-1f26239a593e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:21.029847 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7072150e-d04d-406b-8347-dded11f707a8 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:21.030357 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7072150e-d04d-406b-8347-dded11f707a8 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:21.030842 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7072150e-d04d-406b-8347-dded11f707a8 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:21.032116 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7072150e-d04d-406b-8347-dded11f707a8 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:21.032677 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7072150e-d04d-406b-8347-dded11f707a8 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:21.033190 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7072150e-d04d-406b-8347-dded11f707a8 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:21.074196 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-17e5ae88-df74-4163-b451-a3cd325f245e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:21.075200 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-17e5ae88-df74-4163-b451-a3cd325f245e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:21.082857 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17e5ae88-df74-4163-b451-a3cd325f245e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:21.083681 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17e5ae88-df74-4163-b451-a3cd325f245e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:21.084546 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17e5ae88-df74-4163-b451-a3cd325f245e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:21.086204 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17e5ae88-df74-4163-b451-a3cd325f245e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:21.086493 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17e5ae88-df74-4163-b451-a3cd325f245e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:21.087148 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17e5ae88-df74-4163-b451-a3cd325f245e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:21.118538 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7072150e-d04d-406b-8347-dded11f707a8 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2678c8aad39402c885b6f780fd33165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feee8ee03b8646998338de04f4cb80dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:21.118719 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-17e5ae88-df74-4163-b451-a3cd325f245e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:31:21.122349 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=100 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:31:21.127715 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7072150e-d04d-406b-8347-dded11f707a8 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] 10.222.0.60 "GET /compute/v2.1/servers/d869973f-2d6e-4324-951e-1f26239a593e" status: 200 len: 1273 microversion: 2.1 time: 0.109270 Oct 18 15:31:21.128562 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 868/1713] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:21 2022] GET /compute/v2.1/servers/d869973f-2d6e-4324-951e-1f26239a593e => generated 1273 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:21.209845 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-17e5ae88-df74-4163-b451-a3cd325f245e tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "DELETE /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 204 len: 0 microversion: 2.91 time: 0.143131 Oct 18 15:31:21.211086 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 846/1714] 10.222.0.60 () {60 vars in 1280 bytes} [Tue Oct 18 15:31:21 2022] DELETE /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 15:31:21.220936 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8914612a-350d-41c5-95d0-8cdacd3809dd tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:21.221904 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8914612a-350d-41c5-95d0-8cdacd3809dd tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:21.229311 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8914612a-350d-41c5-95d0-8cdacd3809dd tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:21.230189 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8914612a-350d-41c5-95d0-8cdacd3809dd tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:21.230846 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8914612a-350d-41c5-95d0-8cdacd3809dd tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:21.231796 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8914612a-350d-41c5-95d0-8cdacd3809dd tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:21.232505 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8914612a-350d-41c5-95d0-8cdacd3809dd tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:21.233289 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8914612a-350d-41c5-95d0-8cdacd3809dd tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:21.445026 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8914612a-350d-41c5-95d0-8cdacd3809dd tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:21.455631 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8914612a-350d-41c5-95d0-8cdacd3809dd tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:21.458354 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8914612a-350d-41c5-95d0-8cdacd3809dd tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:21.467229 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8914612a-350d-41c5-95d0-8cdacd3809dd tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1539 microversion: 2.91 time: 0.252104 Oct 18 15:31:21.468945 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 869/1715] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:21 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1539 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:31:21.533502 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cdbc1dbd-6ce6-492a-98e9-914e55c8f6d4 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:21.534339 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cdbc1dbd-6ce6-492a-98e9-914e55c8f6d4 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:21.541687 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cdbc1dbd-6ce6-492a-98e9-914e55c8f6d4 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:21.542285 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cdbc1dbd-6ce6-492a-98e9-914e55c8f6d4 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:21.542813 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cdbc1dbd-6ce6-492a-98e9-914e55c8f6d4 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:21.543696 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cdbc1dbd-6ce6-492a-98e9-914e55c8f6d4 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:21.544328 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cdbc1dbd-6ce6-492a-98e9-914e55c8f6d4 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:21.544838 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cdbc1dbd-6ce6-492a-98e9-914e55c8f6d4 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:21.627713 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f18f6549-c84f-43f2-b81b-80dee5bd8d4e tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:21.628631 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f18f6549-c84f-43f2-b81b-80dee5bd8d4e tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 44a77c90-3a7e-435e-adba-e3a0551d573f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:21.635548 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f18f6549-c84f-43f2-b81b-80dee5bd8d4e tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:21.636397 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f18f6549-c84f-43f2-b81b-80dee5bd8d4e tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:21.636975 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f18f6549-c84f-43f2-b81b-80dee5bd8d4e tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:21.637791 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f18f6549-c84f-43f2-b81b-80dee5bd8d4e tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:21.638352 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f18f6549-c84f-43f2-b81b-80dee5bd8d4e tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:21.638884 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f18f6549-c84f-43f2-b81b-80dee5bd8d4e tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:21.853292 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cdbc1dbd-6ce6-492a-98e9-914e55c8f6d4 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:21.864269 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cdbc1dbd-6ce6-492a-98e9-914e55c8f6d4 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e" status: 200 len: 1199 microversion: 2.1 time: 0.335052 Oct 18 15:31:21.871612 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 847/1716] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:21 2022] GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e => generated 1199 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:21.871612 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-39459087-b24d-45fc-8351-1042127acad2 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:21.872382 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-39459087-b24d-45fc-8351-1042127acad2 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] [instance: d463b5e2-5fc0-4272-b141-476b1672cb18] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:21.877385 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=3,nova_api:UPDATE=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:31:21.885033 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39459087-b24d-45fc-8351-1042127acad2 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:21.885607 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39459087-b24d-45fc-8351-1042127acad2 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:21.886194 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39459087-b24d-45fc-8351-1042127acad2 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:21.886969 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39459087-b24d-45fc-8351-1042127acad2 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:21.887533 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39459087-b24d-45fc-8351-1042127acad2 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:21.888038 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39459087-b24d-45fc-8351-1042127acad2 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:21.898474 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f18f6549-c84f-43f2-b81b-80dee5bd8d4e tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:21.907191 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-39459087-b24d-45fc-8351-1042127acad2 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] HTTP exception thrown: Instance d463b5e2-5fc0-4272-b141-476b1672cb18 could not be found. Oct 18 15:31:21.909235 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-39459087-b24d-45fc-8351-1042127acad2 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Request method failure captured: Oct 18 15:31:21.909235 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/d463b5e2-5fc0-4272-b141-476b1672cb18 HTTP/1.1 Oct 18 15:31:21.909235 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:31:21.909235 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:31:21.909235 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:31:21.909235 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:31:21.909235 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:31:21.909235 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:31:21.909235 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:31:21.909235 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:31:21.909235 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsasZRq5DK4P-E040a7EAOdo9DDnW3-xcAJ3FRpKumjN9CYAYOYS5KADjFEDnvQJrTaBmgrBm8m0z6AVKp2gINqq4SAAcaiaf2hXaYiPa3T8JQ03k7qF1IsxLhE8Q5QeGP4g8_bRblIvVY6NYOEdRNVXd0UwDbE_Tdmw7Qz914XUsmU Oct 18 15:31:21.909235 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:31:21.909235 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:31:21.909235 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:31:21.909235 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:31:21.909235 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:31:21.909235 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:31:21.909235 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 7ae26b8b2a734cb09f6fd2c26f75c66a Oct 18 15:31:21.909235 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ImagesNegativeTestJSON-1310083737 Oct 18 15:31:21.909235 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:31:21.909235 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:31:21.911018 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7ae26b8b2a734cb09f6fd2c26f75c66a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7ae26b8b2a734cb09f6fd2c26f75c66a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/7ae26b8b2a734cb09f6fd2c26f75c66a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_7ae26b8b2a734cb09f6fd2c26f75c66a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:31:21.911018 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ImagesNegativeTestJSON-1310083737 Oct 18 15:31:21.911018 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 7ae26b8b2a734cb09f6fd2c26f75c66a Oct 18 15:31:21.911018 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1310083737 Oct 18 15:31:21.911018 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ImagesNegativeTestJSON-1310083737-project Oct 18 15:31:21.911018 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:31:21.911018 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:31:21.911018 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 9fd21586dad64dd0832fc9794aa18971 Oct 18 15:31:21.911018 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ImagesNegativeTestJSON-1310083737-project Oct 18 15:31:21.911018 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:31:21.911018 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance d463b5e2-5fc0-4272-b141-476b1672cb18 could not be found. Oct 18 15:31:21.911018 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'd463b5e2-5fc0-4272-b141-476b1672cb18'} Oct 18 15:31:21.920024 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:31:21.920024 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:21.920024 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:31:21.920024 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:31:21.920024 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:31:21.920024 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:31:21.920024 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:31:21.920024 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:31:21.920024 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:31:21.920024 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:31:21.920024 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d463b5e2-5fc0-4272-b141-476b1672cb18 could not be found. Oct 18 15:31:21.920024 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:31:21.920024 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:21.920024 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:31:21.920024 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:21.920024 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:21.920024 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:21.920024 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:31:21.920024 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:31:21.920024 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:31:21.921702 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:31:21.921702 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:31:21.921702 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:31:21.921702 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:31:21.921702 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:31:21.921702 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:31:21.921702 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:31:21.921702 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d463b5e2-5fc0-4272-b141-476b1672cb18 could not be found. Oct 18 15:31:21.921702 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:31:21.921702 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:21.921702 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:31:21.921702 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:21.921702 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:21.921702 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:21.921702 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:31:21.921702 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:31:21.921702 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d463b5e2-5fc0-4272-b141-476b1672cb18 could not be found. Oct 18 15:31:21.921702 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:31:21.923198 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-39459087-b24d-45fc-8351-1042127acad2 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Returning 404 to user: Instance d463b5e2-5fc0-4272-b141-476b1672cb18 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:31:21.923313 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f18f6549-c84f-43f2-b81b-80dee5bd8d4e tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f" status: 200 len: 1505 microversion: 2.1 time: 0.287191 Oct 18 15:31:21.923313 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 870/1717] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:21 2022] GET /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f => generated 1505 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:31:21.923498 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-39459087-b24d-45fc-8351-1042127acad2 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] 10.222.0.60 "GET /compute/v2.1/servers/d463b5e2-5fc0-4272-b141-476b1672cb18" status: 404 len: 111 microversion: 2.1 time: 0.046832 Oct 18 15:31:21.923498 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 848/1718] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:21 2022] GET /compute/v2.1/servers/d463b5e2-5fc0-4272-b141-476b1672cb18 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:31:21.923670 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-611b3a21-3406-4058-94a1-6bd596bd7ccb tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1269240857", "metadata": {"image_type": "test"}}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:31:21.926662 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-611b3a21-3406-4058-94a1-6bd596bd7ccb tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] [instance: d463b5e2-5fc0-4272-b141-476b1672cb18] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:21.933408 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-611b3a21-3406-4058-94a1-6bd596bd7ccb tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:21.933906 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-611b3a21-3406-4058-94a1-6bd596bd7ccb tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:21.934353 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-611b3a21-3406-4058-94a1-6bd596bd7ccb tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:21.935352 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-611b3a21-3406-4058-94a1-6bd596bd7ccb tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:21.935819 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-611b3a21-3406-4058-94a1-6bd596bd7ccb tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:21.936257 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-611b3a21-3406-4058-94a1-6bd596bd7ccb tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:21.952278 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-611b3a21-3406-4058-94a1-6bd596bd7ccb tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] HTTP exception thrown: Instance d463b5e2-5fc0-4272-b141-476b1672cb18 could not be found. Oct 18 15:31:21.953941 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-611b3a21-3406-4058-94a1-6bd596bd7ccb tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Request method failure captured: Oct 18 15:31:21.953941 n-d-853682-5 devstack@n-api.service[120405]: request: POST /compute/v2.1/servers/d463b5e2-5fc0-4272-b141-476b1672cb18/action HTTP/1.1 Oct 18 15:31:21.953941 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:31:21.953941 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:31:21.953941 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:31:21.953941 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 112 Oct 18 15:31:21.953941 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:31:21.953941 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:31:21.953941 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:31:21.953941 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:31:21.953941 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsasZRq5DK4P-E040a7EAOdo9DDnW3-xcAJ3FRpKumjN9CYAYOYS5KADjFEDnvQJrTaBmgrBm8m0z6AVKp2gINqq4SAAcaiaf2hXaYiPa3T8JQ03k7qF1IsxLhE8Q5QeGP4g8_bRblIvVY6NYOEdRNVXd0UwDbE_Tdmw7Qz914XUsmU Oct 18 15:31:21.953941 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:31:21.953941 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:31:21.953941 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:31:21.953941 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:31:21.953941 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:31:21.953941 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:31:21.953941 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 7ae26b8b2a734cb09f6fd2c26f75c66a Oct 18 15:31:21.953941 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ImagesNegativeTestJSON-1310083737 Oct 18 15:31:21.953941 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:31:21.953941 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:31:21.955852 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7ae26b8b2a734cb09f6fd2c26f75c66a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7ae26b8b2a734cb09f6fd2c26f75c66a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/7ae26b8b2a734cb09f6fd2c26f75c66a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_7ae26b8b2a734cb09f6fd2c26f75c66a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:31:21.955852 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ImagesNegativeTestJSON-1310083737 Oct 18 15:31:21.955852 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 7ae26b8b2a734cb09f6fd2c26f75c66a Oct 18 15:31:21.955852 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1310083737 Oct 18 15:31:21.955852 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ImagesNegativeTestJSON-1310083737-project Oct 18 15:31:21.955852 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:31:21.955852 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:31:21.955852 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 9fd21586dad64dd0832fc9794aa18971 Oct 18 15:31:21.955852 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ImagesNegativeTestJSON-1310083737-project Oct 18 15:31:21.955852 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:31:21.955852 n-d-853682-5 devstack@n-api.service[120405]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1269240857", "metadata": {"image_type": "test"}}} Oct 18 15:31:21.955852 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:31:21.956742 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance d463b5e2-5fc0-4272-b141-476b1672cb18 could not be found. Oct 18 15:31:21.956742 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'd463b5e2-5fc0-4272-b141-476b1672cb18', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1269240857', 'metadata': {'image_type': 'test'}}}} Oct 18 15:31:21.956742 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:31:21.956742 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:21.956742 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:31:21.956742 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:31:21.956742 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:31:21.956742 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:31:21.956742 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:31:21.956742 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:31:21.956742 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:31:21.956742 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:31:21.956742 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d463b5e2-5fc0-4272-b141-476b1672cb18 could not be found. Oct 18 15:31:21.956742 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:21.956742 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:21.956742 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:21.956742 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:21.956742 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:21.956742 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:21.958363 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:31:21.958363 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:31:21.958363 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:31:21.958363 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:31:21.958363 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:31:21.958363 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:31:21.958363 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:31:21.958363 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:31:21.958363 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 18 15:31:21.958363 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 18 15:31:21.958363 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:31:21.958363 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:31:21.958363 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:31:21.958363 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:31:21.958363 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d463b5e2-5fc0-4272-b141-476b1672cb18 could not be found. Oct 18 15:31:21.958363 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:21.958363 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:21.958363 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:21.958363 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:21.958363 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:21.959792 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:21.959792 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:31:21.959792 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:31:21.959792 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d463b5e2-5fc0-4272-b141-476b1672cb18 could not be found. Oct 18 15:31:21.959792 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:21.959792 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-611b3a21-3406-4058-94a1-6bd596bd7ccb tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Returning 404 to user: Instance d463b5e2-5fc0-4272-b141-476b1672cb18 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:31:21.959792 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-611b3a21-3406-4058-94a1-6bd596bd7ccb tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] 10.222.0.60 "POST /compute/v2.1/servers/d463b5e2-5fc0-4272-b141-476b1672cb18/action" status: 404 len: 111 microversion: 2.1 time: 0.037188 Oct 18 15:31:21.959792 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 871/1719] 10.222.0.60 () {60 vars in 1279 bytes} [Tue Oct 18 15:31:21 2022] POST /compute/v2.1/servers/d463b5e2-5fc0-4272-b141-476b1672cb18/action => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 15:31:21.967793 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-64540eea-a0f1-43af-9e6b-96c1470db384 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-363650696", "metadata": {"image_type": "test"}}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:31:21.970324 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-64540eea-a0f1-43af-9e6b-96c1470db384 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Failed to fetch instance by id tempest-invalid-381359368 {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 18 15:31:21.970938 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-64540eea-a0f1-43af-9e6b-96c1470db384 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] HTTP exception thrown: Instance tempest-invalid-381359368 could not be found. Oct 18 15:31:21.972475 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-64540eea-a0f1-43af-9e6b-96c1470db384 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Request method failure captured: Oct 18 15:31:21.972475 n-d-853682-5 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers/tempest-invalid-381359368/action HTTP/1.1 Oct 18 15:31:21.972475 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:31:21.972475 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:31:21.972475 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:31:21.972475 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 111 Oct 18 15:31:21.972475 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:31:21.972475 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:31:21.972475 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:31:21.972475 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:31:21.972475 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsasZRq5DK4P-E040a7EAOdo9DDnW3-xcAJ3FRpKumjN9CYAYOYS5KADjFEDnvQJrTaBmgrBm8m0z6AVKp2gINqq4SAAcaiaf2hXaYiPa3T8JQ03k7qF1IsxLhE8Q5QeGP4g8_bRblIvVY6NYOEdRNVXd0UwDbE_Tdmw7Qz914XUsmU Oct 18 15:31:21.972475 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:31:21.972475 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:31:21.972475 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:31:21.972475 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:31:21.972475 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:31:21.972475 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:31:21.972475 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 7ae26b8b2a734cb09f6fd2c26f75c66a Oct 18 15:31:21.972475 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ImagesNegativeTestJSON-1310083737 Oct 18 15:31:21.972475 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:31:21.972475 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:31:21.974280 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7ae26b8b2a734cb09f6fd2c26f75c66a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7ae26b8b2a734cb09f6fd2c26f75c66a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/7ae26b8b2a734cb09f6fd2c26f75c66a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_7ae26b8b2a734cb09f6fd2c26f75c66a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:31:21.974280 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ImagesNegativeTestJSON-1310083737 Oct 18 15:31:21.974280 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 7ae26b8b2a734cb09f6fd2c26f75c66a Oct 18 15:31:21.974280 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1310083737 Oct 18 15:31:21.974280 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ImagesNegativeTestJSON-1310083737-project Oct 18 15:31:21.974280 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:31:21.974280 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:31:21.974280 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 9fd21586dad64dd0832fc9794aa18971 Oct 18 15:31:21.974280 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ImagesNegativeTestJSON-1310083737-project Oct 18 15:31:21.974280 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:31:21.974280 n-d-853682-5 devstack@n-api.service[120406]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-363650696", "metadata": {"image_type": "test"}}} Oct 18 15:31:21.974280 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:31:21.975159 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance tempest-invalid-381359368 could not be found. Oct 18 15:31:21.975159 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'tempest-invalid-381359368', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-363650696', 'metadata': {'image_type': 'test'}}}} Oct 18 15:31:21.975159 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:31:21.975159 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:21.975159 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:31:21.975159 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:31:21.975159 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 18 15:31:21.975159 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 18 15:31:21.975159 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-381359368 could not be found. Oct 18 15:31:21.975159 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:31:21.975159 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:21.975159 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:31:21.975159 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:21.975159 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:21.975159 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:21.975159 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:31:21.975159 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:31:21.975159 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:31:21.975159 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:31:21.975159 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:31:21.976536 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:31:21.976536 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:31:21.976536 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:31:21.976536 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 18 15:31:21.976536 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 18 15:31:21.976536 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:31:21.976536 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:31:21.976536 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:31:21.976536 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:31:21.976536 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-381359368 could not be found. Oct 18 15:31:21.976536 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:31:21.976536 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:21.976536 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:31:21.976536 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:21.976536 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:21.976536 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:21.976536 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:31:21.976536 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:31:21.976536 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-381359368 could not be found. Oct 18 15:31:21.976536 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:31:21.979126 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-64540eea-a0f1-43af-9e6b-96c1470db384 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Returning 404 to user: Instance tempest-invalid-381359368 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:31:21.979126 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-64540eea-a0f1-43af-9e6b-96c1470db384 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] 10.222.0.60 "POST /compute/v2.1/servers/tempest-invalid-381359368/action" status: 404 len: 100 microversion: 2.1 time: 0.010519 Oct 18 15:31:21.979126 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 849/1720] 10.222.0.60 () {60 vars in 1246 bytes} [Tue Oct 18 15:31:21 2022] POST /compute/v2.1/servers/tempest-invalid-381359368/action => generated 100 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:31:21.985726 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-301bcfc6-d9db-419f-8ab7-8cce4ad39c1d tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-441127568"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:31:21.988298 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-301bcfc6-d9db-419f-8ab7-8cce4ad39c1d tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 18 15:31:21.988836 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-301bcfc6-d9db-419f-8ab7-8cce4ad39c1d tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 18 15:31:21.990515 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-301bcfc6-d9db-419f-8ab7-8cce4ad39c1d tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Request method failure captured: Oct 18 15:31:21.990515 n-d-853682-5 devstack@n-api.service[120405]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 18 15:31:21.990515 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:31:21.990515 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:31:21.990515 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:31:21.990515 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 56 Oct 18 15:31:21.990515 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:31:21.990515 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:31:21.990515 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:31:21.990515 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:31:21.990515 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsasZRq5DK4P-E040a7EAOdo9DDnW3-xcAJ3FRpKumjN9CYAYOYS5KADjFEDnvQJrTaBmgrBm8m0z6AVKp2gINqq4SAAcaiaf2hXaYiPa3T8JQ03k7qF1IsxLhE8Q5QeGP4g8_bRblIvVY6NYOEdRNVXd0UwDbE_Tdmw7Qz914XUsmU Oct 18 15:31:21.990515 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:31:21.990515 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:31:21.990515 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:31:21.990515 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:31:21.990515 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:31:21.990515 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:31:21.990515 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 7ae26b8b2a734cb09f6fd2c26f75c66a Oct 18 15:31:21.990515 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ImagesNegativeTestJSON-1310083737 Oct 18 15:31:21.990515 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:31:21.990515 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:31:21.992256 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7ae26b8b2a734cb09f6fd2c26f75c66a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7ae26b8b2a734cb09f6fd2c26f75c66a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/7ae26b8b2a734cb09f6fd2c26f75c66a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_7ae26b8b2a734cb09f6fd2c26f75c66a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:31:21.992256 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ImagesNegativeTestJSON-1310083737 Oct 18 15:31:21.992256 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 7ae26b8b2a734cb09f6fd2c26f75c66a Oct 18 15:31:21.992256 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1310083737 Oct 18 15:31:21.992256 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ImagesNegativeTestJSON-1310083737-project Oct 18 15:31:21.992256 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:31:21.992256 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:31:21.992256 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 9fd21586dad64dd0832fc9794aa18971 Oct 18 15:31:21.992256 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ImagesNegativeTestJSON-1310083737-project Oct 18 15:31:21.992256 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:31:21.992256 n-d-853682-5 devstack@n-api.service[120405]: {"createImage": {"name": "tempest-test-snap-441127568"}} Oct 18 15:31:21.992256 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:31:21.992256 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 18 15:31:21.993506 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-441127568'}}} Oct 18 15:31:21.993506 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:31:21.993506 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:21.993506 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:31:21.993506 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:31:21.993506 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 18 15:31:21.993506 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 18 15:31:21.993506 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 18 15:31:21.993506 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:21.993506 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:21.993506 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:21.993506 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:21.993506 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:21.993506 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:21.993506 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:31:21.993506 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:31:21.993506 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:31:21.993506 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:31:21.993506 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:31:21.993506 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:31:21.995105 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:31:21.995105 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:31:21.995105 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 18 15:31:21.995105 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 18 15:31:21.995105 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:31:21.995105 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:31:21.995105 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:31:21.995105 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:31:21.995105 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 18 15:31:21.995105 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:21.995105 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:21.995105 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:21.995105 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:21.995105 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:21.995105 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:21.995105 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:31:21.995105 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:31:21.995105 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 18 15:31:21.995105 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:21.996469 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-301bcfc6-d9db-419f-8ab7-8cce4ad39c1d tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:31:21.996469 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-301bcfc6-d9db-419f-8ab7-8cce4ad39c1d tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] 10.222.0.60 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.011026 Oct 18 15:31:21.996469 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 872/1721] 10.222.0.60 () {60 vars in 1275 bytes} [Tue Oct 18 15:31:21 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:31:22.002954 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7632e09f-a90c-462c-8576-8480fdb91296 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1346889329"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:31:22.007980 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7632e09f-a90c-462c-8576-8480fdb91296 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 18 15:31:22.008524 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-7632e09f-a90c-462c-8576-8480fdb91296 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 18 15:31:22.010272 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7632e09f-a90c-462c-8576-8480fdb91296 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Request method failure captured: Oct 18 15:31:22.010272 n-d-853682-5 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 18 15:31:22.010272 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:31:22.010272 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:31:22.010272 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:31:22.010272 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 57 Oct 18 15:31:22.010272 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:31:22.010272 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:31:22.010272 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:31:22.010272 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:31:22.010272 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsasZRq5DK4P-E040a7EAOdo9DDnW3-xcAJ3FRpKumjN9CYAYOYS5KADjFEDnvQJrTaBmgrBm8m0z6AVKp2gINqq4SAAcaiaf2hXaYiPa3T8JQ03k7qF1IsxLhE8Q5QeGP4g8_bRblIvVY6NYOEdRNVXd0UwDbE_Tdmw7Qz914XUsmU Oct 18 15:31:22.010272 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:31:22.010272 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:31:22.010272 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:31:22.010272 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:31:22.010272 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:31:22.010272 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:31:22.010272 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 7ae26b8b2a734cb09f6fd2c26f75c66a Oct 18 15:31:22.010272 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ImagesNegativeTestJSON-1310083737 Oct 18 15:31:22.010272 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:31:22.010272 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:31:22.011950 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7ae26b8b2a734cb09f6fd2c26f75c66a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7ae26b8b2a734cb09f6fd2c26f75c66a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/7ae26b8b2a734cb09f6fd2c26f75c66a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_7ae26b8b2a734cb09f6fd2c26f75c66a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:31:22.011950 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ImagesNegativeTestJSON-1310083737 Oct 18 15:31:22.011950 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 7ae26b8b2a734cb09f6fd2c26f75c66a Oct 18 15:31:22.011950 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1310083737 Oct 18 15:31:22.011950 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ImagesNegativeTestJSON-1310083737-project Oct 18 15:31:22.011950 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:31:22.011950 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:31:22.011950 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 9fd21586dad64dd0832fc9794aa18971 Oct 18 15:31:22.011950 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ImagesNegativeTestJSON-1310083737-project Oct 18 15:31:22.011950 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:31:22.011950 n-d-853682-5 devstack@n-api.service[120406]: {"createImage": {"name": "tempest-test-snap-1346889329"}} Oct 18 15:31:22.011950 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:31:22.011950 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 18 15:31:22.012955 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1346889329'}}} Oct 18 15:31:22.012955 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:31:22.012955 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:22.012955 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:31:22.012955 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:31:22.012955 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 18 15:31:22.012955 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 18 15:31:22.012955 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 18 15:31:22.012955 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:31:22.012955 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:22.012955 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:31:22.012955 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:22.012955 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:22.012955 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:22.012955 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:31:22.012955 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:31:22.012955 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:31:22.012955 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:31:22.012955 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:31:22.012955 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:31:22.014447 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:31:22.014447 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:31:22.014447 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 18 15:31:22.014447 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 18 15:31:22.014447 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:31:22.014447 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:31:22.014447 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:31:22.014447 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:31:22.014447 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 18 15:31:22.014447 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:31:22.014447 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:22.014447 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:31:22.014447 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:22.014447 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:22.014447 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:22.014447 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:31:22.014447 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:31:22.014447 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 18 15:31:22.014447 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:31:22.016377 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7632e09f-a90c-462c-8576-8480fdb91296 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:31:22.016377 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7632e09f-a90c-462c-8576-8480fdb91296 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] 10.222.0.60 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.013677 Oct 18 15:31:22.016377 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 850/1722] 10.222.0.60 () {60 vars in 1281 bytes} [Tue Oct 18 15:31:21 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:31:22.026499 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7eb50a3b-d5e5-4d25-803a-b22932dc2447 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:22.027328 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-04c2e648-322e-4438-9200-ca99477babc8 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:22.027462 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7eb50a3b-d5e5-4d25-803a-b22932dc2447 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] [instance: d463b5e2-5fc0-4272-b141-476b1672cb18] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:22.027730 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-04c2e648-322e-4438-9200-ca99477babc8 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] [instance: 234a024f-c13b-40de-bbcb-ffcdda611d01] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:22.035073 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04c2e648-322e-4438-9200-ca99477babc8 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:22.036267 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04c2e648-322e-4438-9200-ca99477babc8 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:22.036267 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04c2e648-322e-4438-9200-ca99477babc8 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:22.036961 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04c2e648-322e-4438-9200-ca99477babc8 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:22.037498 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04c2e648-322e-4438-9200-ca99477babc8 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:22.038076 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04c2e648-322e-4438-9200-ca99477babc8 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:22.040872 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7eb50a3b-d5e5-4d25-803a-b22932dc2447 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:22.042826 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7eb50a3b-d5e5-4d25-803a-b22932dc2447 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:22.043342 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7eb50a3b-d5e5-4d25-803a-b22932dc2447 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:22.044186 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7eb50a3b-d5e5-4d25-803a-b22932dc2447 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:22.045963 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7eb50a3b-d5e5-4d25-803a-b22932dc2447 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:22.046546 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7eb50a3b-d5e5-4d25-803a-b22932dc2447 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:22.089750 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-7eb50a3b-d5e5-4d25-803a-b22932dc2447 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] HTTP exception thrown: Instance d463b5e2-5fc0-4272-b141-476b1672cb18 could not be found. Oct 18 15:31:22.091647 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7eb50a3b-d5e5-4d25-803a-b22932dc2447 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Request method failure captured: Oct 18 15:31:22.091647 n-d-853682-5 devstack@n-api.service[120405]: request: DELETE /compute/v2.1/servers/d463b5e2-5fc0-4272-b141-476b1672cb18 HTTP/1.1 Oct 18 15:31:22.091647 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:31:22.091647 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:31:22.091647 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:31:22.091647 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:31:22.091647 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:31:22.091647 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:31:22.091647 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:31:22.091647 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:31:22.091647 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsasZRq5DK4P-E040a7EAOdo9DDnW3-xcAJ3FRpKumjN9CYAYOYS5KADjFEDnvQJrTaBmgrBm8m0z6AVKp2gINqq4SAAcaiaf2hXaYiPa3T8JQ03k7qF1IsxLhE8Q5QeGP4g8_bRblIvVY6NYOEdRNVXd0UwDbE_Tdmw7Qz914XUsmU Oct 18 15:31:22.091647 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:31:22.091647 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:31:22.091647 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:31:22.091647 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:31:22.091647 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:31:22.091647 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:31:22.091647 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 7ae26b8b2a734cb09f6fd2c26f75c66a Oct 18 15:31:22.091647 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ImagesNegativeTestJSON-1310083737 Oct 18 15:31:22.091647 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:31:22.091647 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:31:22.093213 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7ae26b8b2a734cb09f6fd2c26f75c66a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7ae26b8b2a734cb09f6fd2c26f75c66a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/7ae26b8b2a734cb09f6fd2c26f75c66a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_7ae26b8b2a734cb09f6fd2c26f75c66a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:31:22.093213 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ImagesNegativeTestJSON-1310083737 Oct 18 15:31:22.093213 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 7ae26b8b2a734cb09f6fd2c26f75c66a Oct 18 15:31:22.093213 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1310083737 Oct 18 15:31:22.093213 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ImagesNegativeTestJSON-1310083737-project Oct 18 15:31:22.093213 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:31:22.093213 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:31:22.093213 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 9fd21586dad64dd0832fc9794aa18971 Oct 18 15:31:22.093213 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ImagesNegativeTestJSON-1310083737-project Oct 18 15:31:22.093213 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:31:22.093213 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance d463b5e2-5fc0-4272-b141-476b1672cb18 could not be found. Oct 18 15:31:22.093213 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'd463b5e2-5fc0-4272-b141-476b1672cb18'} Oct 18 15:31:22.094119 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:31:22.094119 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:22.094119 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:31:22.094119 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:31:22.094119 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:31:22.094119 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:31:22.094119 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:31:22.094119 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:31:22.094119 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:31:22.094119 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:31:22.094119 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d463b5e2-5fc0-4272-b141-476b1672cb18 could not be found. Oct 18 15:31:22.094119 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:22.094119 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:22.094119 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:22.094119 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:22.094119 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:22.094119 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:22.094119 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:31:22.094119 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:31:22.094119 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:31:22.095910 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:31:22.095910 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 15:31:22.095910 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 15:31:22.095910 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 15:31:22.095910 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 15:31:22.095910 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:31:22.095910 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:31:22.095910 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:31:22.095910 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:31:22.095910 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d463b5e2-5fc0-4272-b141-476b1672cb18 could not be found. Oct 18 15:31:22.095910 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:22.095910 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:22.095910 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:22.095910 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:22.095910 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:22.095910 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:22.095910 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:31:22.095910 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:31:22.095910 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d463b5e2-5fc0-4272-b141-476b1672cb18 could not be found. Oct 18 15:31:22.095910 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:22.098036 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7eb50a3b-d5e5-4d25-803a-b22932dc2447 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Returning 404 to user: Instance d463b5e2-5fc0-4272-b141-476b1672cb18 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:31:22.098036 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7eb50a3b-d5e5-4d25-803a-b22932dc2447 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d463b5e2-5fc0-4272-b141-476b1672cb18" status: 404 len: 111 microversion: 2.1 time: 0.073910 Oct 18 15:31:22.098036 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 873/1723] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:31:22 2022] DELETE /compute/v2.1/servers/d463b5e2-5fc0-4272-b141-476b1672cb18 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:31:22.105357 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-93ccf445-e05d-46e3-a60a-bbeb6119f641 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:22.106124 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-93ccf445-e05d-46e3-a60a-bbeb6119f641 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] [instance: d463b5e2-5fc0-4272-b141-476b1672cb18] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:22.114967 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-93ccf445-e05d-46e3-a60a-bbeb6119f641 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:22.115491 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-93ccf445-e05d-46e3-a60a-bbeb6119f641 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:22.115932 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-93ccf445-e05d-46e3-a60a-bbeb6119f641 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:22.116638 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-93ccf445-e05d-46e3-a60a-bbeb6119f641 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:22.117135 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-93ccf445-e05d-46e3-a60a-bbeb6119f641 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:22.117586 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-93ccf445-e05d-46e3-a60a-bbeb6119f641 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:22.135956 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-04c2e648-322e-4438-9200-ca99477babc8 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:22.138509 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-93ccf445-e05d-46e3-a60a-bbeb6119f641 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] HTTP exception thrown: Instance d463b5e2-5fc0-4272-b141-476b1672cb18 could not be found. Oct 18 15:31:22.140261 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-93ccf445-e05d-46e3-a60a-bbeb6119f641 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Request method failure captured: Oct 18 15:31:22.140261 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/d463b5e2-5fc0-4272-b141-476b1672cb18 HTTP/1.1 Oct 18 15:31:22.140261 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:31:22.140261 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:31:22.140261 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:31:22.140261 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:31:22.140261 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:31:22.140261 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:31:22.140261 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:31:22.140261 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:31:22.140261 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsasZRq5DK4P-E040a7EAOdo9DDnW3-xcAJ3FRpKumjN9CYAYOYS5KADjFEDnvQJrTaBmgrBm8m0z6AVKp2gINqq4SAAcaiaf2hXaYiPa3T8JQ03k7qF1IsxLhE8Q5QeGP4g8_bRblIvVY6NYOEdRNVXd0UwDbE_Tdmw7Qz914XUsmU Oct 18 15:31:22.140261 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:31:22.140261 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:31:22.140261 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:31:22.140261 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:31:22.140261 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:31:22.140261 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:31:22.140261 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 7ae26b8b2a734cb09f6fd2c26f75c66a Oct 18 15:31:22.140261 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ImagesNegativeTestJSON-1310083737 Oct 18 15:31:22.140261 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:31:22.140261 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:31:22.142089 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7ae26b8b2a734cb09f6fd2c26f75c66a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7ae26b8b2a734cb09f6fd2c26f75c66a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/7ae26b8b2a734cb09f6fd2c26f75c66a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_7ae26b8b2a734cb09f6fd2c26f75c66a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:31:22.142089 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ImagesNegativeTestJSON-1310083737 Oct 18 15:31:22.142089 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 7ae26b8b2a734cb09f6fd2c26f75c66a Oct 18 15:31:22.142089 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1310083737 Oct 18 15:31:22.142089 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ImagesNegativeTestJSON-1310083737-project Oct 18 15:31:22.142089 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:31:22.142089 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:31:22.142089 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 9fd21586dad64dd0832fc9794aa18971 Oct 18 15:31:22.142089 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ImagesNegativeTestJSON-1310083737-project Oct 18 15:31:22.142089 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:31:22.142089 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance d463b5e2-5fc0-4272-b141-476b1672cb18 could not be found. Oct 18 15:31:22.142089 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'd463b5e2-5fc0-4272-b141-476b1672cb18'} Oct 18 15:31:22.143043 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:31:22.143043 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:22.143043 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:31:22.143043 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:31:22.143043 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:31:22.143043 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:31:22.143043 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:31:22.143043 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:31:22.143043 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:31:22.143043 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:31:22.143043 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d463b5e2-5fc0-4272-b141-476b1672cb18 could not be found. Oct 18 15:31:22.143043 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:22.143043 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:22.143043 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:22.143043 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:22.143043 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:22.143043 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:22.143043 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:31:22.143043 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:31:22.143043 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:31:22.144625 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:31:22.144625 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:31:22.144625 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:31:22.144625 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:31:22.144625 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:31:22.144625 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:31:22.144625 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:31:22.144625 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d463b5e2-5fc0-4272-b141-476b1672cb18 could not be found. Oct 18 15:31:22.144625 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:22.144625 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:22.144625 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:22.144625 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:22.144625 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:22.144625 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:22.144625 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:31:22.144625 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:31:22.144625 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d463b5e2-5fc0-4272-b141-476b1672cb18 could not be found. Oct 18 15:31:22.144625 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:22.146164 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-93ccf445-e05d-46e3-a60a-bbeb6119f641 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] Returning 404 to user: Instance d463b5e2-5fc0-4272-b141-476b1672cb18 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:31:22.146164 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-93ccf445-e05d-46e3-a60a-bbeb6119f641 tempest-ImagesNegativeTestJSON-1310083737 tempest-ImagesNegativeTestJSON-1310083737-project] 10.222.0.60 "GET /compute/v2.1/servers/d463b5e2-5fc0-4272-b141-476b1672cb18" status: 404 len: 111 microversion: 2.1 time: 0.041970 Oct 18 15:31:22.146164 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 874/1724] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:22 2022] GET /compute/v2.1/servers/d463b5e2-5fc0-4272-b141-476b1672cb18 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:31:22.153300 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7d262825-447a-47dc-93a4-cadb88814eef tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:22.154037 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7d262825-447a-47dc-93a4-cadb88814eef tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] [instance: d869973f-2d6e-4324-951e-1f26239a593e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:22.157028 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-04c2e648-322e-4438-9200-ca99477babc8 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:22.159577 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-04c2e648-322e-4438-9200-ca99477babc8 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:22.162638 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7d262825-447a-47dc-93a4-cadb88814eef tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:22.163222 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7d262825-447a-47dc-93a4-cadb88814eef tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:22.163737 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7d262825-447a-47dc-93a4-cadb88814eef tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:22.164521 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7d262825-447a-47dc-93a4-cadb88814eef tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:22.165328 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7d262825-447a-47dc-93a4-cadb88814eef tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:22.165831 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7d262825-447a-47dc-93a4-cadb88814eef tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:22.182492 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-04c2e648-322e-4438-9200-ca99477babc8 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] 10.222.0.60 "GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01" status: 200 len: 1446 microversion: 2.75 time: 0.159760 Oct 18 15:31:22.188446 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 851/1725] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:22 2022] GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01 => generated 1446 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:31:22.267108 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7d262825-447a-47dc-93a4-cadb88814eef tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2678c8aad39402c885b6f780fd33165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feee8ee03b8646998338de04f4cb80dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:22.277385 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7d262825-447a-47dc-93a4-cadb88814eef tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] 10.222.0.60 "GET /compute/v2.1/servers/d869973f-2d6e-4324-951e-1f26239a593e" status: 200 len: 1271 microversion: 2.1 time: 0.129730 Oct 18 15:31:22.278400 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 875/1726] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:22 2022] GET /compute/v2.1/servers/d869973f-2d6e-4324-951e-1f26239a593e => generated 1271 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:31:22.501582 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-15ba9a32-1a6f-4bff-9466-21175a27af86 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:22.502467 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-15ba9a32-1a6f-4bff-9466-21175a27af86 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:22.513740 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15ba9a32-1a6f-4bff-9466-21175a27af86 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:22.514880 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15ba9a32-1a6f-4bff-9466-21175a27af86 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:22.515953 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15ba9a32-1a6f-4bff-9466-21175a27af86 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:22.517198 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15ba9a32-1a6f-4bff-9466-21175a27af86 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:22.518911 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15ba9a32-1a6f-4bff-9466-21175a27af86 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:22.519439 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15ba9a32-1a6f-4bff-9466-21175a27af86 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:22.643416 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-15ba9a32-1a6f-4bff-9466-21175a27af86 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:22.653415 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-15ba9a32-1a6f-4bff-9466-21175a27af86 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:22.655276 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-15ba9a32-1a6f-4bff-9466-21175a27af86 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eefcb4da26a84c2cab78793782a5ada9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66d69e5e97432481c48f671455f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:22.663193 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-15ba9a32-1a6f-4bff-9466-21175a27af86 tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 200 len: 1539 microversion: 2.91 time: 0.167244 Oct 18 15:31:22.664423 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 852/1727] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:22 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 1539 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:31:22.887888 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9abd6772-86ef-4285-8480-4e98114d1f34 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:22.888991 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9abd6772-86ef-4285-8480-4e98114d1f34 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:22.897161 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9abd6772-86ef-4285-8480-4e98114d1f34 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:22.904867 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9abd6772-86ef-4285-8480-4e98114d1f34 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:22.905851 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9abd6772-86ef-4285-8480-4e98114d1f34 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:22.907244 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9abd6772-86ef-4285-8480-4e98114d1f34 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:22.907896 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9abd6772-86ef-4285-8480-4e98114d1f34 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:22.908355 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9abd6772-86ef-4285-8480-4e98114d1f34 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:22.934969 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-02ba60e3-03d7-46b3-86b5-1c990198308c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:22.935584 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-02ba60e3-03d7-46b3-86b5-1c990198308c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 44a77c90-3a7e-435e-adba-e3a0551d573f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:22.942881 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02ba60e3-03d7-46b3-86b5-1c990198308c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:22.943224 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02ba60e3-03d7-46b3-86b5-1c990198308c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:22.943658 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02ba60e3-03d7-46b3-86b5-1c990198308c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:22.944592 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02ba60e3-03d7-46b3-86b5-1c990198308c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:22.945255 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02ba60e3-03d7-46b3-86b5-1c990198308c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:22.946407 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02ba60e3-03d7-46b3-86b5-1c990198308c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:23.279250 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9abd6772-86ef-4285-8480-4e98114d1f34 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:23.292764 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9abd6772-86ef-4285-8480-4e98114d1f34 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e" status: 200 len: 1199 microversion: 2.1 time: 0.407460 Oct 18 15:31:23.293840 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 876/1728] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:22 2022] GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e => generated 1199 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:23.305455 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-02ba60e3-03d7-46b3-86b5-1c990198308c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:23.316567 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-02ba60e3-03d7-46b3-86b5-1c990198308c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f" status: 200 len: 1505 microversion: 2.1 time: 0.385264 Oct 18 15:31:23.317348 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 853/1729] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:22 2022] GET /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f => generated 1505 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:23.331579 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c5067f28-9298-4c69-b642-3a32f1039e64 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:23.331579 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c5067f28-9298-4c69-b642-3a32f1039e64 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] [instance: d869973f-2d6e-4324-951e-1f26239a593e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:23.346454 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5067f28-9298-4c69-b642-3a32f1039e64 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:23.348089 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b6d6cb8f-8d88-4203-9e18-d0a3b8313844 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:23.348999 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5067f28-9298-4c69-b642-3a32f1039e64 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:23.350352 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5067f28-9298-4c69-b642-3a32f1039e64 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:23.350669 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b6d6cb8f-8d88-4203-9e18-d0a3b8313844 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] [instance: 234a024f-c13b-40de-bbcb-ffcdda611d01] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:23.355119 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5067f28-9298-4c69-b642-3a32f1039e64 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:23.356029 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5067f28-9298-4c69-b642-3a32f1039e64 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:23.357769 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5067f28-9298-4c69-b642-3a32f1039e64 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:23.367812 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b6d6cb8f-8d88-4203-9e18-d0a3b8313844 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:23.368461 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b6d6cb8f-8d88-4203-9e18-d0a3b8313844 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:23.375973 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b6d6cb8f-8d88-4203-9e18-d0a3b8313844 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:23.377351 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b6d6cb8f-8d88-4203-9e18-d0a3b8313844 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:23.378200 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b6d6cb8f-8d88-4203-9e18-d0a3b8313844 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:23.379578 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b6d6cb8f-8d88-4203-9e18-d0a3b8313844 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:23.950748 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b6d6cb8f-8d88-4203-9e18-d0a3b8313844 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:23.970137 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b6d6cb8f-8d88-4203-9e18-d0a3b8313844 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:23.973245 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b6d6cb8f-8d88-4203-9e18-d0a3b8313844 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:23.993431 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b6d6cb8f-8d88-4203-9e18-d0a3b8313844 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] 10.222.0.60 "GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01" status: 200 len: 1446 microversion: 2.75 time: 0.675697 Oct 18 15:31:24.015564 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 877/1730] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:23 2022] GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01 => generated 1446 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:31:24.024271 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-61c4273b-7f0a-45e1-ad2a-4c57f92088fb tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:24.025239 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-61c4273b-7f0a-45e1-ad2a-4c57f92088fb tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] [instance: 45bc3ebe-2b14-4188-a636-309fd0582617] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:24.032563 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-61c4273b-7f0a-45e1-ad2a-4c57f92088fb tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:24.033236 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-61c4273b-7f0a-45e1-ad2a-4c57f92088fb tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:24.033775 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-61c4273b-7f0a-45e1-ad2a-4c57f92088fb tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:24.034791 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-61c4273b-7f0a-45e1-ad2a-4c57f92088fb tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:24.035479 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-61c4273b-7f0a-45e1-ad2a-4c57f92088fb tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:24.036303 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-61c4273b-7f0a-45e1-ad2a-4c57f92088fb tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:24.063263 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-61c4273b-7f0a-45e1-ad2a-4c57f92088fb tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] HTTP exception thrown: Instance 45bc3ebe-2b14-4188-a636-309fd0582617 could not be found. Oct 18 15:31:24.065298 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-61c4273b-7f0a-45e1-ad2a-4c57f92088fb tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Request method failure captured: Oct 18 15:31:24.065298 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 HTTP/1.1 Oct 18 15:31:24.065298 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:31:24.065298 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:31:24.065298 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:31:24.065298 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:31:24.065298 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:31:24.065298 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:31:24.065298 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:31:24.065298 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:31:24.065298 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsXu2N6Rb4Yj8ksGoqHbg2nCLMzRqOAIywj6IYo_zrPbWhNtTYgl3NKT44gK5XRBYWyS-J1N_Bn-L-yZEtoHT-nE9hQB1uexEGMpMvMNr2Kj5BucAOxtYz2YZgVoZmNR8-_5YHePkMgoW-K4I7DUZQ0nE4xTC3h93DRLzJsK9imSDZ4 Oct 18 15:31:24.065298 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:31:24.065298 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:31:24.065298 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:31:24.065298 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:31:24.065298 n-d-853682-5 devstack@n-api.service[120405]: X-Openstack-Nova-Api-Version: 2.91 Oct 18 15:31:24.065298 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:31:24.065298 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:31:24.065298 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 3c66d69e5e97432481c48f671455f2d8 Oct 18 15:31:24.065298 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-1290824467 Oct 18 15:31:24.065298 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:31:24.065298 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:31:24.066890 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3c66d69e5e97432481c48f671455f2d8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3c66d69e5e97432481c48f671455f2d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3c66d69e5e97432481c48f671455f2d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3c66d69e5e97432481c48f671455f2d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:31:24.066890 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-1290824467 Oct 18 15:31:24.066890 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 3c66d69e5e97432481c48f671455f2d8 Oct 18 15:31:24.066890 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-1290824467 Oct 18 15:31:24.066890 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-UnshelveToHostMultiNodesTest-1290824467-project Oct 18 15:31:24.066890 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:31:24.066890 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:31:24.066890 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: eefcb4da26a84c2cab78793782a5ada9 Oct 18 15:31:24.066890 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-1290824467-project Oct 18 15:31:24.066890 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:31:24.066890 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 45bc3ebe-2b14-4188-a636-309fd0582617 could not be found. Oct 18 15:31:24.066890 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '45bc3ebe-2b14-4188-a636-309fd0582617'} Oct 18 15:31:24.067983 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:31:24.067983 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:24.067983 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:31:24.067983 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:31:24.067983 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:31:24.067983 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:31:24.067983 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:31:24.067983 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:31:24.067983 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:31:24.067983 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:31:24.067983 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45bc3ebe-2b14-4188-a636-309fd0582617 could not be found. Oct 18 15:31:24.067983 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:24.067983 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:24.067983 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:24.067983 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:24.067983 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:24.067983 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:24.067983 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:31:24.067983 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:31:24.067983 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:31:24.069474 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:31:24.069474 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:31:24.069474 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:31:24.069474 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:31:24.069474 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:31:24.069474 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:31:24.069474 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:31:24.069474 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45bc3ebe-2b14-4188-a636-309fd0582617 could not be found. Oct 18 15:31:24.069474 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:24.069474 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:24.069474 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:24.069474 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:24.069474 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:24.069474 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:24.069474 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:31:24.069474 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:31:24.069474 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45bc3ebe-2b14-4188-a636-309fd0582617 could not be found. Oct 18 15:31:24.069474 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:24.072547 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-61c4273b-7f0a-45e1-ad2a-4c57f92088fb tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] Returning 404 to user: Instance 45bc3ebe-2b14-4188-a636-309fd0582617 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:31:24.073697 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-61c4273b-7f0a-45e1-ad2a-4c57f92088fb tempest-UnshelveToHostMultiNodesTest-1290824467 tempest-UnshelveToHostMultiNodesTest-1290824467-project] 10.222.0.60 "GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617" status: 404 len: 111 microversion: 2.91 time: 0.055442 Oct 18 15:31:24.074820 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 878/1731] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:24 2022] GET /compute/v2.1/servers/45bc3ebe-2b14-4188-a636-309fd0582617 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:31:24.217698 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c5067f28-9298-4c69-b642-3a32f1039e64 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2678c8aad39402c885b6f780fd33165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feee8ee03b8646998338de04f4cb80dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:24.227364 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c5067f28-9298-4c69-b642-3a32f1039e64 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] 10.222.0.60 "GET /compute/v2.1/servers/d869973f-2d6e-4324-951e-1f26239a593e" status: 200 len: 1313 microversion: 2.1 time: 0.908970 Oct 18 15:31:24.229564 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 854/1732] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:23 2022] GET /compute/v2.1/servers/d869973f-2d6e-4324-951e-1f26239a593e => generated 1313 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:24.322024 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5f05054e-cae2-4bd6-9077-33ad5d70902d tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:24.322654 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5f05054e-cae2-4bd6-9077-33ad5d70902d tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:24.335937 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5f05054e-cae2-4bd6-9077-33ad5d70902d tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:24.336438 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5f05054e-cae2-4bd6-9077-33ad5d70902d tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:24.337136 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5f05054e-cae2-4bd6-9077-33ad5d70902d tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:24.337692 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5f05054e-cae2-4bd6-9077-33ad5d70902d tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:24.338156 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5f05054e-cae2-4bd6-9077-33ad5d70902d tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:24.338589 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5f05054e-cae2-4bd6-9077-33ad5d70902d tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:24.344713 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d8c0b02c-d5c0-486b-8ab7-fed087040dc2 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:24.345358 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d8c0b02c-d5c0-486b-8ab7-fed087040dc2 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 44a77c90-3a7e-435e-adba-e3a0551d573f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:24.364682 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8c0b02c-d5c0-486b-8ab7-fed087040dc2 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:24.365537 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8c0b02c-d5c0-486b-8ab7-fed087040dc2 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:24.366154 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8c0b02c-d5c0-486b-8ab7-fed087040dc2 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:24.367160 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8c0b02c-d5c0-486b-8ab7-fed087040dc2 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:24.367786 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8c0b02c-d5c0-486b-8ab7-fed087040dc2 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:24.368408 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8c0b02c-d5c0-486b-8ab7-fed087040dc2 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:25.060313 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5f05054e-cae2-4bd6-9077-33ad5d70902d tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:25.073598 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5f05054e-cae2-4bd6-9077-33ad5d70902d tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e" status: 200 len: 1199 microversion: 2.1 time: 0.755322 Oct 18 15:31:25.087435 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 879/1733] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:24 2022] GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e => generated 1199 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:25.087435 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ce4c6b45-b7c6-40aa-9356-12b5a74eafb2 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:25.087435 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ce4c6b45-b7c6-40aa-9356-12b5a74eafb2 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] [instance: 234a024f-c13b-40de-bbcb-ffcdda611d01] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:25.103464 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ce4c6b45-b7c6-40aa-9356-12b5a74eafb2 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:25.103963 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ce4c6b45-b7c6-40aa-9356-12b5a74eafb2 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:25.106560 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ce4c6b45-b7c6-40aa-9356-12b5a74eafb2 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:25.107747 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ce4c6b45-b7c6-40aa-9356-12b5a74eafb2 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:25.108350 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ce4c6b45-b7c6-40aa-9356-12b5a74eafb2 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:25.108796 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ce4c6b45-b7c6-40aa-9356-12b5a74eafb2 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:25.174452 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d8c0b02c-d5c0-486b-8ab7-fed087040dc2 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:25.206552 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d8c0b02c-d5c0-486b-8ab7-fed087040dc2 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f" status: 200 len: 1505 microversion: 2.1 time: 0.865597 Oct 18 15:31:25.222370 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 855/1734] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:24 2022] GET /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f => generated 1505 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:31:25.260050 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e743da18-1b7d-4fdd-a4e7-240da003c9cf tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:25.260892 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e743da18-1b7d-4fdd-a4e7-240da003c9cf tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] [instance: d869973f-2d6e-4324-951e-1f26239a593e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:25.273557 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ce4c6b45-b7c6-40aa-9356-12b5a74eafb2 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:25.283574 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e743da18-1b7d-4fdd-a4e7-240da003c9cf tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:25.285768 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e743da18-1b7d-4fdd-a4e7-240da003c9cf tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:25.286810 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e743da18-1b7d-4fdd-a4e7-240da003c9cf tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:25.287798 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e743da18-1b7d-4fdd-a4e7-240da003c9cf tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:25.289646 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e743da18-1b7d-4fdd-a4e7-240da003c9cf tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:25.293568 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e743da18-1b7d-4fdd-a4e7-240da003c9cf tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:25.295753 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ce4c6b45-b7c6-40aa-9356-12b5a74eafb2 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:25.297775 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ce4c6b45-b7c6-40aa-9356-12b5a74eafb2 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:25.306968 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:31:25.307234 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ce4c6b45-b7c6-40aa-9356-12b5a74eafb2 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] 10.222.0.60 "GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01" status: 200 len: 1446 microversion: 2.75 time: 0.231247 Oct 18 15:31:25.317181 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 880/1735] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:25 2022] GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01 => generated 1446 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:31:25.831030 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-8b46fdf6-7295-44cc-82d2-8d116984589c req-a810013e-c5b1-410f-9cca-18f43b87c2bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d869973f-2d6e-4324-951e-1f26239a593e", "tag": "14fe3073-6fca-4e2a-85b6-92cf8f4e4a63"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:31:25.854158 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-8b46fdf6-7295-44cc-82d2-8d116984589c req-a810013e-c5b1-410f-9cca-18f43b87c2bc service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:25.854611 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-8b46fdf6-7295-44cc-82d2-8d116984589c req-a810013e-c5b1-410f-9cca-18f43b87c2bc service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:25.855650 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-8b46fdf6-7295-44cc-82d2-8d116984589c req-a810013e-c5b1-410f-9cca-18f43b87c2bc service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:25.873919 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e743da18-1b7d-4fdd-a4e7-240da003c9cf tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2678c8aad39402c885b6f780fd33165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feee8ee03b8646998338de04f4cb80dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:25.883413 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e743da18-1b7d-4fdd-a4e7-240da003c9cf tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] 10.222.0.60 "GET /compute/v2.1/servers/d869973f-2d6e-4324-951e-1f26239a593e" status: 200 len: 1313 microversion: 2.1 time: 0.629838 Oct 18 15:31:25.901319 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 856/1736] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:25 2022] GET /compute/v2.1/servers/d869973f-2d6e-4324-951e-1f26239a593e => generated 1313 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:25.907191 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-8b46fdf6-7295-44cc-82d2-8d116984589c req-a810013e-c5b1-410f-9cca-18f43b87c2bc service nova] Creating event network-changed:14fe3073-6fca-4e2a-85b6-92cf8f4e4a63 for instance d869973f-2d6e-4324-951e-1f26239a593e on n-h1-853682-5 Oct 18 15:31:25.913296 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-8b46fdf6-7295-44cc-82d2-8d116984589c req-a810013e-c5b1-410f-9cca-18f43b87c2bc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086669 Oct 18 15:31:25.914770 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 881/1737] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:31:26.103491 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5c777ac0-3497-4603-9188-62e01974d138 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:26.104416 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5c777ac0-3497-4603-9188-62e01974d138 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:26.113490 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c777ac0-3497-4603-9188-62e01974d138 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:26.114216 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c777ac0-3497-4603-9188-62e01974d138 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:26.114878 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c777ac0-3497-4603-9188-62e01974d138 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:26.115782 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c777ac0-3497-4603-9188-62e01974d138 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:26.116407 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c777ac0-3497-4603-9188-62e01974d138 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:26.117071 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c777ac0-3497-4603-9188-62e01974d138 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:26.234755 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a59c3e27-eded-40c4-8fae-3c131180410c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:26.235484 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a59c3e27-eded-40c4-8fae-3c131180410c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 44a77c90-3a7e-435e-adba-e3a0551d573f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:26.243101 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a59c3e27-eded-40c4-8fae-3c131180410c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:26.243905 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a59c3e27-eded-40c4-8fae-3c131180410c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:26.244362 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a59c3e27-eded-40c4-8fae-3c131180410c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:26.245755 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a59c3e27-eded-40c4-8fae-3c131180410c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:26.246232 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a59c3e27-eded-40c4-8fae-3c131180410c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:26.246849 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a59c3e27-eded-40c4-8fae-3c131180410c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:26.455959 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5c777ac0-3497-4603-9188-62e01974d138 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:26.477671 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5c777ac0-3497-4603-9188-62e01974d138 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e" status: 200 len: 1199 microversion: 2.1 time: 0.373449 Oct 18 15:31:26.478583 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 857/1738] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:26 2022] GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e => generated 1199 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:31:26.483973 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4023dae3-bf35-4228-9607-83c25d3162be tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:26.495299 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4023dae3-bf35-4228-9607-83c25d3162be tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] [instance: 234a024f-c13b-40de-bbcb-ffcdda611d01] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:26.505352 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4023dae3-bf35-4228-9607-83c25d3162be tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:26.506935 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4023dae3-bf35-4228-9607-83c25d3162be tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:26.507565 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4023dae3-bf35-4228-9607-83c25d3162be tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:26.511663 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4023dae3-bf35-4228-9607-83c25d3162be tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:26.512303 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4023dae3-bf35-4228-9607-83c25d3162be tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:26.512941 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4023dae3-bf35-4228-9607-83c25d3162be tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:26.767829 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4023dae3-bf35-4228-9607-83c25d3162be tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:26.776631 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4023dae3-bf35-4228-9607-83c25d3162be tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:26.782251 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4023dae3-bf35-4228-9607-83c25d3162be tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:26.794690 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4023dae3-bf35-4228-9607-83c25d3162be tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] 10.222.0.60 "GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01" status: 200 len: 1446 microversion: 2.75 time: 0.314582 Oct 18 15:31:26.795877 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 858/1739] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:26 2022] GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01 => generated 1446 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:31:26.874228 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a59c3e27-eded-40c4-8fae-3c131180410c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:26.892452 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a59c3e27-eded-40c4-8fae-3c131180410c tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f" status: 200 len: 1487 microversion: 2.1 time: 0.662421 Oct 18 15:31:26.894620 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 882/1740] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:26 2022] GET /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f => generated 1487 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:31:26.917604 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fcb787f6-797e-4daf-a4d4-e5be064ca959 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:26.918836 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fcb787f6-797e-4daf-a4d4-e5be064ca959 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] [instance: d869973f-2d6e-4324-951e-1f26239a593e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:26.919138 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-412117ab-505b-47b0-8472-9a13a68bbb59 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:26.919897 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-412117ab-505b-47b0-8472-9a13a68bbb59 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 44a77c90-3a7e-435e-adba-e3a0551d573f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:26.927644 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-412117ab-505b-47b0-8472-9a13a68bbb59 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:26.927890 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fcb787f6-797e-4daf-a4d4-e5be064ca959 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:26.928245 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fcb787f6-797e-4daf-a4d4-e5be064ca959 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:26.928911 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fcb787f6-797e-4daf-a4d4-e5be064ca959 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:26.929147 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-412117ab-505b-47b0-8472-9a13a68bbb59 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:26.929773 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-412117ab-505b-47b0-8472-9a13a68bbb59 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:26.929989 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fcb787f6-797e-4daf-a4d4-e5be064ca959 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:26.930451 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fcb787f6-797e-4daf-a4d4-e5be064ca959 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:26.930879 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fcb787f6-797e-4daf-a4d4-e5be064ca959 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:26.931419 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-412117ab-505b-47b0-8472-9a13a68bbb59 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:26.932456 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-412117ab-505b-47b0-8472-9a13a68bbb59 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:26.933240 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-412117ab-505b-47b0-8472-9a13a68bbb59 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:27.047480 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-412117ab-505b-47b0-8472-9a13a68bbb59 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 44a77c90-3a7e-435e-adba-e3a0551d573f] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:31:27.219478 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-412117ab-505b-47b0-8472-9a13a68bbb59 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "DELETE /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f" status: 204 len: 0 microversion: 2.1 time: 0.305843 Oct 18 15:31:27.220244 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 883/1741] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:31:26 2022] DELETE /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:31:27.246084 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fcb787f6-797e-4daf-a4d4-e5be064ca959 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2678c8aad39402c885b6f780fd33165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feee8ee03b8646998338de04f4cb80dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:27.254712 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ff257686-db3a-4ecf-96c9-a77686eeb560 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d87f790>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:27.255055 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fcb787f6-797e-4daf-a4d4-e5be064ca959 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] 10.222.0.60 "GET /compute/v2.1/servers/d869973f-2d6e-4324-951e-1f26239a593e" status: 200 len: 1313 microversion: 2.1 time: 0.346546 Oct 18 15:31:27.255554 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 859/1742] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:26 2022] GET /compute/v2.1/servers/d869973f-2d6e-4324-951e-1f26239a593e => generated 1313 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:27.319080 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-ff257686-db3a-4ecf-96c9-a77686eeb560 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] HTTP exception thrown: Image not found. Oct 18 15:31:27.321167 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ff257686-db3a-4ecf-96c9-a77686eeb560 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Request method failure captured: Oct 18 15:31:27.321167 n-d-853682-5 devstack@n-api.service[120405]: request: DELETE /compute/v2.1/images/fa50c49b-ee3b-42d3-9b04-297c3561e1e5 HTTP/1.1 Oct 18 15:31:27.321167 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:31:27.321167 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:31:27.321167 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:31:27.321167 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:31:27.321167 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:31:27.321167 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:31:27.321167 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:31:27.321167 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:31:27.321167 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsVPb3L3FP-98gtLv8YIMCLfGhe2cuyCUoKBkQOJf_VQrrdw3zjQkBJXdrz51U5RIPirvM4vBy0eEwDlKKADnhe_mWPayJHcQ6gOCTAUKl7bKbkNPv5luVRbp4n9QMAAUTtxVS9n4JhIyNIlSMcaFy8kvjpV-EFu6g7N-rErWpfgdCw Oct 18 15:31:27.321167 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:31:27.321167 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:31:27.321167 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:31:27.321167 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:31:27.321167 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:31:27.321167 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:31:27.321167 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: ee0a3f0c256544beb2df4f113da56137 Oct 18 15:31:27.321167 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ImagesTestJSON-180911091 Oct 18 15:31:27.321167 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:31:27.321167 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:31:27.322661 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:31:27.322661 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ImagesTestJSON-180911091 Oct 18 15:31:27.322661 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: ee0a3f0c256544beb2df4f113da56137 Oct 18 15:31:27.322661 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ImagesTestJSON-180911091 Oct 18 15:31:27.322661 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ImagesTestJSON-180911091-project Oct 18 15:31:27.322661 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:31:27.322661 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:31:27.322661 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: ed9cd936192c40efa9099edee445e90e Oct 18 15:31:27.322661 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ImagesTestJSON-180911091-project Oct 18 15:31:27.322661 n-d-853682-5 devstack@n-api.service[120405]: method: Oct 18 15:31:27.322661 n-d-853682-5 devstack@n-api.service[120405]: exception: Image not found. Oct 18 15:31:27.322661 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'fa50c49b-ee3b-42d3-9b04-297c3561e1e5'} Oct 18 15:31:27.322661 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:31:27.322661 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:27.323605 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 18 15:31:27.323605 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 18 15:31:27.323605 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 15:31:27.323605 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 15:31:27.323605 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 15:31:27.323605 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 15:31:27.323605 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 18 15:31:27.323605 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 18 15:31:27.323605 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 18 15:31:27.323605 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 18 15:31:27.323605 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 15:31:27.323605 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 15:31:27.323605 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 15:31:27.323605 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 15:31:27.323605 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image fa50c49b-ee3b-42d3-9b04-297c3561e1e5 to delete Oct 18 15:31:27.323605 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:27.323605 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:27.323605 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:27.323605 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:27.325687 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 18 15:31:27.325687 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 18 15:31:27.325687 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 18 15:31:27.325687 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 18 15:31:27.325687 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 18 15:31:27.325687 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 18 15:31:27.325687 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fa50c49b-ee3b-42d3-9b04-297c3561e1e5 could not be found. Oct 18 15:31:27.325687 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:27.325687 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:27.325687 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:27.325687 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:27.325687 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:27.325687 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:27.325687 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:31:27.325687 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:31:27.325687 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:31:27.325687 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:31:27.325687 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:31:27.325687 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:31:27.325687 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 18 15:31:27.327676 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 15:31:27.327676 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 15:31:27.327676 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:27.327676 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:27.327676 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:27.327676 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:27.327676 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:27.327676 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:27.327676 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:31:27.327676 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:31:27.327676 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 15:31:27.327676 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:27.327676 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ff257686-db3a-4ecf-96c9-a77686eeb560 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Returning 404 to user: Image not found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:31:27.327676 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ff257686-db3a-4ecf-96c9-a77686eeb560 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "DELETE /compute/v2.1/images/fa50c49b-ee3b-42d3-9b04-297c3561e1e5" status: 404 len: 62 microversion: 2.1 time: 0.078303 Oct 18 15:31:27.327676 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 884/1743] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:27 2022] DELETE /compute/v2.1/images/fa50c49b-ee3b-42d3-9b04-297c3561e1e5 => generated 62 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 15:31:27.333367 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4bc405fa-a273-4664-baee-d642cda30d1d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:27.333902 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4bc405fa-a273-4664-baee-d642cda30d1d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 44a77c90-3a7e-435e-adba-e3a0551d573f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:27.345223 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4bc405fa-a273-4664-baee-d642cda30d1d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:27.346322 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4bc405fa-a273-4664-baee-d642cda30d1d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:27.346985 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4bc405fa-a273-4664-baee-d642cda30d1d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:27.348209 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4bc405fa-a273-4664-baee-d642cda30d1d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:27.349398 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4bc405fa-a273-4664-baee-d642cda30d1d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:27.350567 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4bc405fa-a273-4664-baee-d642cda30d1d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:27.424571 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4bc405fa-a273-4664-baee-d642cda30d1d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 44a77c90-3a7e-435e-adba-e3a0551d573f] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:31:27.489559 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.compute.api [None req-4bc405fa-a273-4664-baee-d642cda30d1d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 44a77c90-3a7e-435e-adba-e3a0551d573f] Instance is already in deleting state, ignoring this request Oct 18 15:31:27.490907 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4bc405fa-a273-4664-baee-d642cda30d1d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "DELETE /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f" status: 204 len: 0 microversion: 2.1 time: 0.162768 Oct 18 15:31:27.491812 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 860/1744] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:31:27 2022] DELETE /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:31:27.499454 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e41c0df8-0f6b-4110-8fd5-12263812c8c7 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:27.500670 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e41c0df8-0f6b-4110-8fd5-12263812c8c7 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 44a77c90-3a7e-435e-adba-e3a0551d573f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:27.511451 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-31072f9a-2a88-41ab-a00d-1c3f5cc89696 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:27.512679 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-31072f9a-2a88-41ab-a00d-1c3f5cc89696 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:27.517483 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e41c0df8-0f6b-4110-8fd5-12263812c8c7 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:27.518277 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e41c0df8-0f6b-4110-8fd5-12263812c8c7 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:27.518919 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e41c0df8-0f6b-4110-8fd5-12263812c8c7 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:27.519927 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e41c0df8-0f6b-4110-8fd5-12263812c8c7 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:27.520628 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e41c0df8-0f6b-4110-8fd5-12263812c8c7 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:27.521307 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e41c0df8-0f6b-4110-8fd5-12263812c8c7 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:27.539221 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31072f9a-2a88-41ab-a00d-1c3f5cc89696 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:27.540287 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31072f9a-2a88-41ab-a00d-1c3f5cc89696 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:27.540384 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31072f9a-2a88-41ab-a00d-1c3f5cc89696 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:27.543214 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31072f9a-2a88-41ab-a00d-1c3f5cc89696 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:27.543704 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31072f9a-2a88-41ab-a00d-1c3f5cc89696 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:27.544145 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31072f9a-2a88-41ab-a00d-1c3f5cc89696 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:27.956076 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e41c0df8-0f6b-4110-8fd5-12263812c8c7 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:27.970944 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e41c0df8-0f6b-4110-8fd5-12263812c8c7 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f" status: 200 len: 1493 microversion: 2.1 time: 0.474041 Oct 18 15:31:27.972194 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 885/1745] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:27 2022] GET /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f => generated 1493 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:27.982426 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5ad0757c-5408-44bf-8e3e-bbf7d0b9ef33 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:27.988708 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5ad0757c-5408-44bf-8e3e-bbf7d0b9ef33 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] [instance: 234a024f-c13b-40de-bbcb-ffcdda611d01] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:28.004670 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5ad0757c-5408-44bf-8e3e-bbf7d0b9ef33 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:28.006095 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5ad0757c-5408-44bf-8e3e-bbf7d0b9ef33 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:28.009737 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5ad0757c-5408-44bf-8e3e-bbf7d0b9ef33 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:28.011999 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5ad0757c-5408-44bf-8e3e-bbf7d0b9ef33 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:28.013875 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5ad0757c-5408-44bf-8e3e-bbf7d0b9ef33 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:28.014553 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5ad0757c-5408-44bf-8e3e-bbf7d0b9ef33 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:28.097414 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-31072f9a-2a88-41ab-a00d-1c3f5cc89696 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:28.106644 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-31072f9a-2a88-41ab-a00d-1c3f5cc89696 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e" status: 200 len: 1199 microversion: 2.1 time: 0.600414 Oct 18 15:31:28.126847 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 861/1746] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:27 2022] GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e => generated 1199 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:28.140020 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-1722a0af-4a06-4e8c-9be0-0445b96d6e32 req-8cc8c095-e962-40b1-9227-71be337f6d44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da62499c-f590-4083-80b6-b849b6695c4e", "name": "network-vif-plugged", "status": "completed", "tag": "e34ef547-0315-4841-b1d6-53dcfae3bb30"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:31:28.161845 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1722a0af-4a06-4e8c-9be0-0445b96d6e32 req-8cc8c095-e962-40b1-9227-71be337f6d44 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:28.162342 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1722a0af-4a06-4e8c-9be0-0445b96d6e32 req-8cc8c095-e962-40b1-9227-71be337f6d44 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:28.164516 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1722a0af-4a06-4e8c-9be0-0445b96d6e32 req-8cc8c095-e962-40b1-9227-71be337f6d44 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:28.164924 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5ad0757c-5408-44bf-8e3e-bbf7d0b9ef33 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:28.177508 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5ad0757c-5408-44bf-8e3e-bbf7d0b9ef33 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:28.188248 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5ad0757c-5408-44bf-8e3e-bbf7d0b9ef33 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:28.191186 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-1722a0af-4a06-4e8c-9be0-0445b96d6e32 req-8cc8c095-e962-40b1-9227-71be337f6d44 service nova] Creating event network-vif-plugged:e34ef547-0315-4841-b1d6-53dcfae3bb30 for instance da62499c-f590-4083-80b6-b849b6695c4e on n-h1-853682-5 Oct 18 15:31:28.205314 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:31:28.207788 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-1722a0af-4a06-4e8c-9be0-0445b96d6e32 req-8cc8c095-e962-40b1-9227-71be337f6d44 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078558 Oct 18 15:31:28.208623 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 862/1747] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:31:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:31:28.215569 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5ad0757c-5408-44bf-8e3e-bbf7d0b9ef33 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] 10.222.0.60 "GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01" status: 200 len: 1446 microversion: 2.75 time: 0.240877 Oct 18 15:31:28.229400 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 886/1748] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:27 2022] GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01 => generated 1446 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:31:28.281535 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e0b2df6b-4cbe-4bd6-8674-693dcddb3435 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:28.282256 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e0b2df6b-4cbe-4bd6-8674-693dcddb3435 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] [instance: d869973f-2d6e-4324-951e-1f26239a593e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:28.290980 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e0b2df6b-4cbe-4bd6-8674-693dcddb3435 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:28.291475 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e0b2df6b-4cbe-4bd6-8674-693dcddb3435 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:28.291913 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e0b2df6b-4cbe-4bd6-8674-693dcddb3435 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:28.298674 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e0b2df6b-4cbe-4bd6-8674-693dcddb3435 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:28.299287 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e0b2df6b-4cbe-4bd6-8674-693dcddb3435 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:28.299730 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e0b2df6b-4cbe-4bd6-8674-693dcddb3435 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:28.554664 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e0b2df6b-4cbe-4bd6-8674-693dcddb3435 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2678c8aad39402c885b6f780fd33165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feee8ee03b8646998338de04f4cb80dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:28.566056 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e0b2df6b-4cbe-4bd6-8674-693dcddb3435 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] 10.222.0.60 "GET /compute/v2.1/servers/d869973f-2d6e-4324-951e-1f26239a593e" status: 200 len: 1313 microversion: 2.1 time: 0.289801 Oct 18 15:31:28.567339 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 863/1749] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:28 2022] GET /compute/v2.1/servers/d869973f-2d6e-4324-951e-1f26239a593e => generated 1313 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:28.999726 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8caec2bd-3841-4444-8cdd-0d7d72301798 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:29.003675 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8caec2bd-3841-4444-8cdd-0d7d72301798 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 44a77c90-3a7e-435e-adba-e3a0551d573f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:29.019970 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:31:29.022978 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=6 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:31:29.025818 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8caec2bd-3841-4444-8cdd-0d7d72301798 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:29.026654 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8caec2bd-3841-4444-8cdd-0d7d72301798 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:29.027105 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8caec2bd-3841-4444-8cdd-0d7d72301798 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:29.028109 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8caec2bd-3841-4444-8cdd-0d7d72301798 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:29.028749 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8caec2bd-3841-4444-8cdd-0d7d72301798 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:29.029657 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8caec2bd-3841-4444-8cdd-0d7d72301798 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:29.135083 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2520d66d-9a62-41bd-b07b-14cb7d44de19 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:29.136550 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2520d66d-9a62-41bd-b07b-14cb7d44de19 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:29.143983 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:31:29.148165 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2520d66d-9a62-41bd-b07b-14cb7d44de19 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:29.148909 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2520d66d-9a62-41bd-b07b-14cb7d44de19 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:29.149617 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2520d66d-9a62-41bd-b07b-14cb7d44de19 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:29.150761 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2520d66d-9a62-41bd-b07b-14cb7d44de19 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:29.151507 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2520d66d-9a62-41bd-b07b-14cb7d44de19 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:29.152236 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2520d66d-9a62-41bd-b07b-14cb7d44de19 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:29.336894 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8caec2bd-3841-4444-8cdd-0d7d72301798 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:29.347604 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8caec2bd-3841-4444-8cdd-0d7d72301798 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f" status: 200 len: 1493 microversion: 2.1 time: 0.356984 Oct 18 15:31:29.362083 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 887/1750] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:28 2022] GET /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f => generated 1493 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:29.371342 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-125efc63-d959-47c0-9cce-d61d4ab1d2fa tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:29.372141 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-125efc63-d959-47c0-9cce-d61d4ab1d2fa tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] [instance: 234a024f-c13b-40de-bbcb-ffcdda611d01] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:29.378932 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-125efc63-d959-47c0-9cce-d61d4ab1d2fa tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:29.379413 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-125efc63-d959-47c0-9cce-d61d4ab1d2fa tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:29.380051 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-125efc63-d959-47c0-9cce-d61d4ab1d2fa tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:29.380987 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-125efc63-d959-47c0-9cce-d61d4ab1d2fa tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:29.381612 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-125efc63-d959-47c0-9cce-d61d4ab1d2fa tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:29.382343 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-125efc63-d959-47c0-9cce-d61d4ab1d2fa tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:29.447951 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2520d66d-9a62-41bd-b07b-14cb7d44de19 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:29.462730 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-125efc63-d959-47c0-9cce-d61d4ab1d2fa tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:29.464701 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2520d66d-9a62-41bd-b07b-14cb7d44de19 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e" status: 200 len: 1199 microversion: 2.1 time: 0.335345 Oct 18 15:31:29.469188 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 864/1751] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:29 2022] GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e => generated 1199 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:31:29.480766 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-125efc63-d959-47c0-9cce-d61d4ab1d2fa tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:29.482333 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-125efc63-d959-47c0-9cce-d61d4ab1d2fa tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:29.488948 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-125efc63-d959-47c0-9cce-d61d4ab1d2fa tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] 10.222.0.60 "GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01" status: 200 len: 1446 microversion: 2.75 time: 0.125733 Oct 18 15:31:29.499772 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 888/1752] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:29 2022] GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01 => generated 1446 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:31:29.591102 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-49df8d3f-b01e-4811-b8bc-b19042786303 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:29.591718 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-49df8d3f-b01e-4811-b8bc-b19042786303 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] [instance: d869973f-2d6e-4324-951e-1f26239a593e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:29.599361 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49df8d3f-b01e-4811-b8bc-b19042786303 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:29.599855 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49df8d3f-b01e-4811-b8bc-b19042786303 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:29.600338 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49df8d3f-b01e-4811-b8bc-b19042786303 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:29.601193 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49df8d3f-b01e-4811-b8bc-b19042786303 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:29.602794 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49df8d3f-b01e-4811-b8bc-b19042786303 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:29.602953 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49df8d3f-b01e-4811-b8bc-b19042786303 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:29.812611 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-49df8d3f-b01e-4811-b8bc-b19042786303 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2678c8aad39402c885b6f780fd33165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feee8ee03b8646998338de04f4cb80dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:29.822706 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-49df8d3f-b01e-4811-b8bc-b19042786303 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] 10.222.0.60 "GET /compute/v2.1/servers/d869973f-2d6e-4324-951e-1f26239a593e" status: 200 len: 1313 microversion: 2.1 time: 0.235981 Oct 18 15:31:29.824177 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 865/1753] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:29 2022] GET /compute/v2.1/servers/d869973f-2d6e-4324-951e-1f26239a593e => generated 1313 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:30.159595 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-bb2b5735-f369-4e10-a041-8032a9774ec8 tempest-TenantUsagesNegativeTestJSON-105138023 tempest-TenantUsagesNegativeTestJSON-105138023-project-admin] 10.222.0.60 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-17T15%3A31%3A30.040599&end=2022-10-19T15%3A31%3A30.040599" status: 404 len: 112 microversion: - time: 0.115332 Oct 18 15:31:30.160842 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 889/1754] 10.222.0.60 () {58 vars in 1316 bytes} [Tue Oct 18 15:31:30 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-17T15%3A31%3A30.040599&end=2022-10-19T15%3A31%3A30.040599 => generated 112 bytes in 117 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 18 15:31:30.169476 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ef87fe1c-8774-4794-ad36-2f50d1152fb7 tempest-TenantUsagesNegativeTestJSON-105138023 tempest-TenantUsagesNegativeTestJSON-105138023-project-admin] Calling method '.version_select at 0x7f7c3cf940d0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:30.176059 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-ef87fe1c-8774-4794-ad36-2f50d1152fb7 tempest-TenantUsagesNegativeTestJSON-105138023 tempest-TenantUsagesNegativeTestJSON-105138023-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 18 15:31:30.183912 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ef87fe1c-8774-4794-ad36-2f50d1152fb7 tempest-TenantUsagesNegativeTestJSON-105138023 tempest-TenantUsagesNegativeTestJSON-105138023-project-admin] Request method failure captured: Oct 18 15:31:30.183912 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/os-simple-tenant-usage/9fbb6e8127f547d78e0516e84679b112?start=2022-10-19T15%3A31%3A30.040599&end=2022-10-17T15%3A31%3A30.040599 HTTP/1.1 Oct 18 15:31:30.183912 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:31:30.183912 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:31:30.183912 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:31:30.183912 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:31:30.183912 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:31:30.183912 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:31:30.183912 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:31:30.183912 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:31:30.183912 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsbRLNOALvleYNiMG8iq6lTru_txIv5u0L1wU4xphZBVKOlmrexlwIvxll_NAikcv_RnDpjR3L-Jox04lL3BKbrEhNGVBMivOrh-VFXlyjYLeH-J3Rz-iaQASrW8l0QMrWoP0W-Fb_c9LUMR_gSBMXOAGQ-18IoULgOdExxxTgyqyDs Oct 18 15:31:30.183912 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:31:30.183912 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:31:30.183912 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:31:30.183912 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:31:30.183912 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:31:30.183912 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:31:30.183912 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: f50d48367d6244d9ad4faad9a1dbb5c5 Oct 18 15:31:30.183912 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-105138023 Oct 18 15:31:30.183912 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,admin,reader Oct 18 15:31:30.183912 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,admin,reader Oct 18 15:31:30.185760 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f50d48367d6244d9ad4faad9a1dbb5c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f50d48367d6244d9ad4faad9a1dbb5c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f50d48367d6244d9ad4faad9a1dbb5c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f50d48367d6244d9ad4faad9a1dbb5c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:31:30.185760 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-105138023 Oct 18 15:31:30.185760 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: f50d48367d6244d9ad4faad9a1dbb5c5 Oct 18 15:31:30.185760 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-105138023 Oct 18 15:31:30.185760 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-TenantUsagesNegativeTestJSON-105138023-project-admin Oct 18 15:31:30.185760 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:31:30.185760 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:31:30.185760 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: fe313b85730740ea8e64830b27d37372 Oct 18 15:31:30.185760 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-105138023-project-admin Oct 18 15:31:30.185760 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:31:30.185760 n-d-853682-5 devstack@n-api.service[120406]: exception: Invalid start time. The start time cannot occur after the end time. Oct 18 15:31:30.185760 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '9fbb6e8127f547d78e0516e84679b112'} Oct 18 15:31:30.186828 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:31:30.186828 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:30.186828 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:30.186828 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:30.186828 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:31:30.186828 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:31:30.186828 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:31:30.186828 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:31:30.186828 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 15:31:30.186828 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:31:30.186828 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:31:30.186828 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:31:30.186828 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 18 15:31:30.186828 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 18 15:31:30.186828 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 18 15:31:30.186828 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 18 15:31:30.186828 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 18 15:31:30.186828 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 18 15:31:30.186828 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 18 15:31:30.188438 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:31:30.188438 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:30.188438 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:31:30.188438 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:30.188438 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:30.188438 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:30.188438 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:31:30.188438 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:31:30.188438 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 18 15:31:30.188438 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:31:30.188438 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ef87fe1c-8774-4794-ad36-2f50d1152fb7 tempest-TenantUsagesNegativeTestJSON-105138023 tempest-TenantUsagesNegativeTestJSON-105138023-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:31:30.188438 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ef87fe1c-8774-4794-ad36-2f50d1152fb7 tempest-TenantUsagesNegativeTestJSON-105138023 tempest-TenantUsagesNegativeTestJSON-105138023-project-admin] 10.222.0.60 "GET /compute/v2.1/os-simple-tenant-usage/9fbb6e8127f547d78e0516e84679b112?start=2022-10-19T15%3A31%3A30.040599&end=2022-10-17T15%3A31%3A30.040599" status: 400 len: 111 microversion: 2.1 time: 0.019630 Oct 18 15:31:30.189402 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 866/1755] 10.222.0.60 () {58 vars in 1412 bytes} [Tue Oct 18 15:31:30 2022] GET /compute/v2.1/os-simple-tenant-usage/9fbb6e8127f547d78e0516e84679b112?start=2022-10-19T15%3A31%3A30.040599&end=2022-10-17T15%3A31%3A30.040599 => generated 111 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:31:30.298128 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1e9ca5fc-9224-4603-b95d-e624c806a8ba tempest-TenantUsagesNegativeTestJSON-271564969 tempest-TenantUsagesNegativeTestJSON-271564969-project] Calling method '.version_select at 0x7f7c3d8489d0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:30.301711 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1e9ca5fc-9224-4603-b95d-e624c806a8ba tempest-TenantUsagesNegativeTestJSON-271564969 tempest-TenantUsagesNegativeTestJSON-271564969-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '7c7db73513094050a89855e566534bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fbb6e8127f547d78e0516e84679b112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:30.303627 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1e9ca5fc-9224-4603-b95d-e624c806a8ba tempest-TenantUsagesNegativeTestJSON-271564969 tempest-TenantUsagesNegativeTestJSON-271564969-project] Request method failure captured: Oct 18 15:31:30.303627 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-17T15%3A31%3A30.040599&end=2022-10-19T15%3A31%3A30.040599&detailed=1 HTTP/1.1 Oct 18 15:31:30.303627 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:31:30.303627 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:31:30.303627 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:31:30.303627 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:31:30.303627 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:31:30.303627 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:31:30.303627 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:31:30.303627 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:31:30.303627 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsbRlerQy3m6Ttq6qRXy5l75i0DkmfTM3VojB3JE3rx9jUWa96Uz1wJ8aJL2U2-pRsAnbjMHYZnYNqRge1-p-Bta21cIXfbKTsEKkCX7RFP-haFwJew1XdeBmNXN49Rs-DL29zBTZZNA5P7twkhNHqT1PyGxm9GeF7_v6AQvb81BDMQ Oct 18 15:31:30.303627 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:31:30.303627 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:31:30.303627 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:31:30.303627 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:31:30.303627 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:31:30.303627 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:31:30.303627 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 9fbb6e8127f547d78e0516e84679b112 Oct 18 15:31:30.303627 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-271564969 Oct 18 15:31:30.303627 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:31:30.303627 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:31:30.305359 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9fbb6e8127f547d78e0516e84679b112"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9fbb6e8127f547d78e0516e84679b112"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9fbb6e8127f547d78e0516e84679b112"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9fbb6e8127f547d78e0516e84679b112"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:31:30.305359 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-271564969 Oct 18 15:31:30.305359 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 9fbb6e8127f547d78e0516e84679b112 Oct 18 15:31:30.305359 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-271564969 Oct 18 15:31:30.305359 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-TenantUsagesNegativeTestJSON-271564969-project Oct 18 15:31:30.305359 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:31:30.305359 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:31:30.305359 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 7c7db73513094050a89855e566534bfe Oct 18 15:31:30.305359 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-271564969-project Oct 18 15:31:30.305359 n-d-853682-5 devstack@n-api.service[120405]: method: Oct 18 15:31:30.305359 n-d-853682-5 devstack@n-api.service[120405]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 18 15:31:30.305359 n-d-853682-5 devstack@n-api.service[120405]: action_args: {} Oct 18 15:31:30.305359 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:31:30.306507 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:30.306507 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:30.306507 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:30.306507 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:31:30.306507 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:31:30.306507 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:31:30.306507 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:31:30.306507 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 15:31:30.306507 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:31:30.306507 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:31:30.306507 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:31:30.306507 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 18 15:31:30.306507 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 18 15:31:30.306507 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 18 15:31:30.306507 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 18 15:31:30.306507 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 15:31:30.306507 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 15:31:30.306507 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 15:31:30.306507 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 15:31:30.307936 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 15:31:30.307936 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 15:31:30.307936 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 15:31:30.307936 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 15:31:30.307936 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 15:31:30.307936 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 15:31:30.307936 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 15:31:30.307936 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 15:31:30.307936 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 15:31:30.307936 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 15:31:30.307936 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 18 15:31:30.307936 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:30.307936 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:30.307936 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:30.307936 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:30.307936 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:30.307936 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:30.307936 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 15:31:30.307936 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 15:31:30.309355 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 18 15:31:30.309355 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:30.309355 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1e9ca5fc-9224-4603-b95d-e624c806a8ba tempest-TenantUsagesNegativeTestJSON-271564969 tempest-TenantUsagesNegativeTestJSON-271564969-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:31:30.309355 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1e9ca5fc-9224-4603-b95d-e624c806a8ba tempest-TenantUsagesNegativeTestJSON-271564969 tempest-TenantUsagesNegativeTestJSON-271564969-project] 10.222.0.60 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-17T15%3A31%3A30.040599&end=2022-10-19T15%3A31%3A30.040599&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.112622 Oct 18 15:31:30.309355 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 890/1756] 10.222.0.60 () {58 vars in 1335 bytes} [Tue Oct 18 15:31:30 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-17T15%3A31%3A30.040599&end=2022-10-19T15%3A31%3A30.040599&detailed=1 => generated 123 bytes in 114 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:31:30.376611 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-aaf63197-b6d0-4eae-947c-2635eade6870 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:30.377672 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-aaf63197-b6d0-4eae-947c-2635eade6870 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 44a77c90-3a7e-435e-adba-e3a0551d573f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:30.387931 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aaf63197-b6d0-4eae-947c-2635eade6870 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:30.388549 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aaf63197-b6d0-4eae-947c-2635eade6870 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:30.389055 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aaf63197-b6d0-4eae-947c-2635eade6870 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:30.389840 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aaf63197-b6d0-4eae-947c-2635eade6870 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:30.390998 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aaf63197-b6d0-4eae-947c-2635eade6870 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:30.391649 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aaf63197-b6d0-4eae-947c-2635eade6870 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:30.489932 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0680df50-0090-4146-b161-352c27035f21 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:30.491034 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0680df50-0090-4146-b161-352c27035f21 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:30.499071 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0680df50-0090-4146-b161-352c27035f21 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:30.500077 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0680df50-0090-4146-b161-352c27035f21 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:30.500675 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0680df50-0090-4146-b161-352c27035f21 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:30.501385 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0680df50-0090-4146-b161-352c27035f21 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:30.501854 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0680df50-0090-4146-b161-352c27035f21 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:30.502308 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0680df50-0090-4146-b161-352c27035f21 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:30.508111 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:31:30.599424 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-aaf63197-b6d0-4eae-947c-2635eade6870 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:30.610440 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-aaf63197-b6d0-4eae-947c-2635eade6870 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f" status: 200 len: 1493 microversion: 2.1 time: 0.239777 Oct 18 15:31:30.611685 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 867/1757] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:30 2022] GET /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f => generated 1493 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:30.620734 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4c040cfe-ce38-40e8-83e3-441254b14e05 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:30.621625 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4c040cfe-ce38-40e8-83e3-441254b14e05 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] [instance: 234a024f-c13b-40de-bbcb-ffcdda611d01] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:30.630119 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c040cfe-ce38-40e8-83e3-441254b14e05 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:30.630932 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c040cfe-ce38-40e8-83e3-441254b14e05 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:30.631599 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c040cfe-ce38-40e8-83e3-441254b14e05 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:30.632535 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c040cfe-ce38-40e8-83e3-441254b14e05 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:30.633223 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c040cfe-ce38-40e8-83e3-441254b14e05 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:30.634373 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c040cfe-ce38-40e8-83e3-441254b14e05 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:30.739235 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0680df50-0090-4146-b161-352c27035f21 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:30.755646 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0680df50-0090-4146-b161-352c27035f21 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e" status: 200 len: 1199 microversion: 2.1 time: 0.271484 Oct 18 15:31:30.756491 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 891/1758] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:30 2022] GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e => generated 1199 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:30.827626 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4c040cfe-ce38-40e8-83e3-441254b14e05 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:30.840894 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4c040cfe-ce38-40e8-83e3-441254b14e05 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:30.844004 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4c040cfe-ce38-40e8-83e3-441254b14e05 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:30.848918 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ba3c914f-d44f-4c5e-9390-d499305419fb tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:30.849519 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ba3c914f-d44f-4c5e-9390-d499305419fb tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] [instance: d869973f-2d6e-4324-951e-1f26239a593e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:30.851553 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4c040cfe-ce38-40e8-83e3-441254b14e05 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] 10.222.0.60 "GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01" status: 200 len: 1446 microversion: 2.75 time: 0.237934 Oct 18 15:31:30.852341 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 868/1759] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:30 2022] GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01 => generated 1446 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:31:30.864845 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba3c914f-d44f-4c5e-9390-d499305419fb tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:30.865362 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba3c914f-d44f-4c5e-9390-d499305419fb tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:30.866007 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba3c914f-d44f-4c5e-9390-d499305419fb tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:30.866912 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba3c914f-d44f-4c5e-9390-d499305419fb tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:30.867560 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba3c914f-d44f-4c5e-9390-d499305419fb tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:30.868153 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba3c914f-d44f-4c5e-9390-d499305419fb tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:31.167170 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ba3c914f-d44f-4c5e-9390-d499305419fb tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2678c8aad39402c885b6f780fd33165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feee8ee03b8646998338de04f4cb80dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:31.177525 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ba3c914f-d44f-4c5e-9390-d499305419fb tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] 10.222.0.60 "GET /compute/v2.1/servers/d869973f-2d6e-4324-951e-1f26239a593e" status: 200 len: 1313 microversion: 2.1 time: 0.333626 Oct 18 15:31:31.193385 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 892/1760] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:30 2022] GET /compute/v2.1/servers/d869973f-2d6e-4324-951e-1f26239a593e => generated 1313 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:31.479236 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e31e8ecd-a734-4bb0-b0ce-7f54ca115827 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c3cfa08b0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:31.548783 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e31e8ecd-a734-4bb0-b0ce-7f54ca115827 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/bdaf13f6-f09b-4386-bc97-7843e78e9dde" status: 200 len: 661 microversion: 2.1 time: 0.094121 Oct 18 15:31:31.549682 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 869/1761] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:31:31 2022] GET /compute/v2.1/images/bdaf13f6-f09b-4386-bc97-7843e78e9dde => generated 661 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:31:31.563663 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9c9b1b92-ebde-4fd2-90ea-3b0f8260cb59 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c3d3d53a0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:31.616736 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9c9b1b92-ebde-4fd2-90ea-3b0f8260cb59 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/bdaf13f6-f09b-4386-bc97-7843e78e9dde" status: 200 len: 661 microversion: 2.1 time: 0.057309 Oct 18 15:31:31.635522 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-969c43ed-4885-4b8f-83fa-568e8cad55b4 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:31.636135 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-969c43ed-4885-4b8f-83fa-568e8cad55b4 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 44a77c90-3a7e-435e-adba-e3a0551d573f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:31.647434 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 893/1762] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:31:31 2022] GET /compute/v2.1/images/bdaf13f6-f09b-4386-bc97-7843e78e9dde => generated 661 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:31:31.653862 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-969c43ed-4885-4b8f-83fa-568e8cad55b4 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:31.654362 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-969c43ed-4885-4b8f-83fa-568e8cad55b4 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:31.655446 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-969c43ed-4885-4b8f-83fa-568e8cad55b4 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:31.659262 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-969c43ed-4885-4b8f-83fa-568e8cad55b4 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:31.659738 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-969c43ed-4885-4b8f-83fa-568e8cad55b4 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:31.660174 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-969c43ed-4885-4b8f-83fa-568e8cad55b4 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:31.779431 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8b0f9008-4cb8-4301-9118-09cf388246a6 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:31.780656 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8b0f9008-4cb8-4301-9118-09cf388246a6 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:31.789655 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8b0f9008-4cb8-4301-9118-09cf388246a6 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:31.790536 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8b0f9008-4cb8-4301-9118-09cf388246a6 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:31.791133 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8b0f9008-4cb8-4301-9118-09cf388246a6 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:31.792310 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8b0f9008-4cb8-4301-9118-09cf388246a6 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:31.792964 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8b0f9008-4cb8-4301-9118-09cf388246a6 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:31.793548 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8b0f9008-4cb8-4301-9118-09cf388246a6 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:31.821173 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-969c43ed-4885-4b8f-83fa-568e8cad55b4 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:31.834034 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-969c43ed-4885-4b8f-83fa-568e8cad55b4 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f" status: 200 len: 1493 microversion: 2.1 time: 0.201511 Oct 18 15:31:31.844865 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 870/1763] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:31 2022] GET /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f => generated 1493 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:31.882831 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-050c8d39-edbb-462a-92c6-6eef378b8249 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:31.883444 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-050c8d39-edbb-462a-92c6-6eef378b8249 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] [instance: 234a024f-c13b-40de-bbcb-ffcdda611d01] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:31.895823 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-050c8d39-edbb-462a-92c6-6eef378b8249 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:31.896537 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-050c8d39-edbb-462a-92c6-6eef378b8249 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:31.897025 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-050c8d39-edbb-462a-92c6-6eef378b8249 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:31.897935 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-050c8d39-edbb-462a-92c6-6eef378b8249 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:31.898542 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-050c8d39-edbb-462a-92c6-6eef378b8249 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:31.899125 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-050c8d39-edbb-462a-92c6-6eef378b8249 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:31.956890 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8b0f9008-4cb8-4301-9118-09cf388246a6 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:31.966217 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8b0f9008-4cb8-4301-9118-09cf388246a6 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e" status: 200 len: 1199 microversion: 2.1 time: 0.191494 Oct 18 15:31:31.980363 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 894/1764] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:31 2022] GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e => generated 1199 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:32.001150 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-050c8d39-edbb-462a-92c6-6eef378b8249 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:32.011155 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-050c8d39-edbb-462a-92c6-6eef378b8249 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:32.012614 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-050c8d39-edbb-462a-92c6-6eef378b8249 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:32.019283 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-050c8d39-edbb-462a-92c6-6eef378b8249 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] 10.222.0.60 "GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01" status: 200 len: 1446 microversion: 2.75 time: 0.140172 Oct 18 15:31:32.020484 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 871/1765] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:31 2022] GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01 => generated 1446 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:31:32.201529 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-41512314-2980-44a2-8e21-3dea329933c1 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:32.202684 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-41512314-2980-44a2-8e21-3dea329933c1 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] [instance: d869973f-2d6e-4324-951e-1f26239a593e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:32.212732 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-41512314-2980-44a2-8e21-3dea329933c1 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:32.213361 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-41512314-2980-44a2-8e21-3dea329933c1 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:32.213920 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-41512314-2980-44a2-8e21-3dea329933c1 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:32.214652 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-41512314-2980-44a2-8e21-3dea329933c1 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:32.215207 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-41512314-2980-44a2-8e21-3dea329933c1 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:32.215673 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-41512314-2980-44a2-8e21-3dea329933c1 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:32.488345 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-41512314-2980-44a2-8e21-3dea329933c1 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2678c8aad39402c885b6f780fd33165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feee8ee03b8646998338de04f4cb80dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:32.513981 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-41512314-2980-44a2-8e21-3dea329933c1 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] 10.222.0.60 "GET /compute/v2.1/servers/d869973f-2d6e-4324-951e-1f26239a593e" status: 200 len: 1313 microversion: 2.1 time: 0.315225 Oct 18 15:31:32.516009 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 895/1766] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:32 2022] GET /compute/v2.1/servers/d869973f-2d6e-4324-951e-1f26239a593e => generated 1313 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:32.558603 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d19e1ae5-9e6a-476b-9c88-de4f2fc97a2f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-918122770", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "2f9fec7c-78b7-46d8-8366-69a39bab2b6f"}], "block_device_mapping_v2": [{"uuid": "368938ac-82cc-4a62-a8d0-842b2c246a35", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:31:32.653542 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-d19e1ae5-9e6a-476b-9c88-de4f2fc97a2f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] validate_networks() for [('2f9fec7c-78b7-46d8-8366-69a39bab2b6f', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:31:32.853046 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-ec53b85a-3032-44e0-8358-246e4eb17925 req-28ea83c9-1ede-4065-9add-131a740f7c06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44a77c90-3a7e-435e-adba-e3a0551d573f", "name": "network-vif-deleted", "tag": "80678c44-08fb-43ea-9c10-8772eef6cf68"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:31:32.870303 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-ec53b85a-3032-44e0-8358-246e4eb17925 req-28ea83c9-1ede-4065-9add-131a740f7c06 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:32.870790 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-ec53b85a-3032-44e0-8358-246e4eb17925 req-28ea83c9-1ede-4065-9add-131a740f7c06 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:32.871502 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-ec53b85a-3032-44e0-8358-246e4eb17925 req-28ea83c9-1ede-4065-9add-131a740f7c06 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:32.888431 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-ec53b85a-3032-44e0-8358-246e4eb17925 req-28ea83c9-1ede-4065-9add-131a740f7c06 service nova] Creating event network-vif-deleted:80678c44-08fb-43ea-9c10-8772eef6cf68 for instance 44a77c90-3a7e-435e-adba-e3a0551d573f on n-h1-853682-5 Oct 18 15:31:32.893665 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-ec53b85a-3032-44e0-8358-246e4eb17925 req-28ea83c9-1ede-4065-9add-131a740f7c06 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047741 Oct 18 15:31:32.894995 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 896/1767] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:31:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:31:32.903030 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-66b892ce-aa4c-422b-8814-53f07d63e1aa tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:32.905536 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-66b892ce-aa4c-422b-8814-53f07d63e1aa tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 44a77c90-3a7e-435e-adba-e3a0551d573f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:32.916283 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-66b892ce-aa4c-422b-8814-53f07d63e1aa tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:32.928838 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-66b892ce-aa4c-422b-8814-53f07d63e1aa tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:32.930200 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-66b892ce-aa4c-422b-8814-53f07d63e1aa tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:32.931223 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-66b892ce-aa4c-422b-8814-53f07d63e1aa tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:32.933338 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-66b892ce-aa4c-422b-8814-53f07d63e1aa tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:32.934076 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-66b892ce-aa4c-422b-8814-53f07d63e1aa tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:33.094662 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-66b892ce-aa4c-422b-8814-53f07d63e1aa tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9cd936192c40efa9099edee445e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee0a3f0c256544beb2df4f113da56137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:33.106925 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-66b892ce-aa4c-422b-8814-53f07d63e1aa tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f" status: 200 len: 1292 microversion: 2.1 time: 0.209957 Oct 18 15:31:33.121688 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 897/1768] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:32 2022] GET /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f => generated 1292 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:33.129193 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f5a7da17-f1ba-494e-9d67-db14a54a52ad tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:33.129808 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f5a7da17-f1ba-494e-9d67-db14a54a52ad tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:33.135873 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f5a7da17-f1ba-494e-9d67-db14a54a52ad tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:33.136359 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f5a7da17-f1ba-494e-9d67-db14a54a52ad tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:33.136787 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f5a7da17-f1ba-494e-9d67-db14a54a52ad tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:33.137754 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f5a7da17-f1ba-494e-9d67-db14a54a52ad tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:33.138423 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f5a7da17-f1ba-494e-9d67-db14a54a52ad tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:33.139351 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f5a7da17-f1ba-494e-9d67-db14a54a52ad tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:33.409754 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f5a7da17-f1ba-494e-9d67-db14a54a52ad tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:33.417502 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f5a7da17-f1ba-494e-9d67-db14a54a52ad tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e" status: 200 len: 1381 microversion: 2.1 time: 0.294493 Oct 18 15:31:33.418070 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 898/1769] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:33 2022] GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e => generated 1381 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:33.422874 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4cbdcf29-8db6-4a28-99e1-ba178cc09f16 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:33.423547 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4cbdcf29-8db6-4a28-99e1-ba178cc09f16 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] [instance: 234a024f-c13b-40de-bbcb-ffcdda611d01] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:33.429379 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4cbdcf29-8db6-4a28-99e1-ba178cc09f16 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:33.430096 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4cbdcf29-8db6-4a28-99e1-ba178cc09f16 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:33.431041 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4cbdcf29-8db6-4a28-99e1-ba178cc09f16 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:33.432507 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4cbdcf29-8db6-4a28-99e1-ba178cc09f16 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:33.433268 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4cbdcf29-8db6-4a28-99e1-ba178cc09f16 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:33.433919 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4cbdcf29-8db6-4a28-99e1-ba178cc09f16 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:33.475467 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-d19e1ae5-9e6a-476b-9c88-de4f2fc97a2f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:31:33.476226 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-d19e1ae5-9e6a-476b-9c88-de4f2fc97a2f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:31:33.476952 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-d19e1ae5-9e6a-476b-9c88-de4f2fc97a2f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:31:33.477518 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-d19e1ae5-9e6a-476b-9c88-de4f2fc97a2f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:31:33.478108 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-d19e1ae5-9e6a-476b-9c88-de4f2fc97a2f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:31:33.488378 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d19e1ae5-9e6a-476b-9c88-de4f2fc97a2f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:33.489203 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d19e1ae5-9e6a-476b-9c88-de4f2fc97a2f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:33.489646 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d19e1ae5-9e6a-476b-9c88-de4f2fc97a2f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:33.490387 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d19e1ae5-9e6a-476b-9c88-de4f2fc97a2f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:33.490882 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d19e1ae5-9e6a-476b-9c88-de4f2fc97a2f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:33.491223 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d19e1ae5-9e6a-476b-9c88-de4f2fc97a2f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:33.513318 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4cbdcf29-8db6-4a28-99e1-ba178cc09f16 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:33.516932 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-d19e1ae5-9e6a-476b-9c88-de4f2fc97a2f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Getting quotas for project bb0579704a194ef89144af0973d68f42. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:31:33.523862 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4cbdcf29-8db6-4a28-99e1-ba178cc09f16 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:33.524125 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-d19e1ae5-9e6a-476b-9c88-de4f2fc97a2f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Getting quotas for user 51490cfdebda47a7b8349677e4d61a59 and project bb0579704a194ef89144af0973d68f42. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:31:33.525749 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4cbdcf29-8db6-4a28-99e1-ba178cc09f16 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:33.533422 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4cbdcf29-8db6-4a28-99e1-ba178cc09f16 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] 10.222.0.60 "GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01" status: 200 len: 1446 microversion: 2.75 time: 0.113916 Oct 18 15:31:33.535262 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 899/1770] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:33 2022] GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01 => generated 1446 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:31:33.541438 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ee04adfd-5063-4825-a397-39dd6b9f5b5e tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c3d3ead30>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:33.610747 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ee04adfd-5063-4825-a397-39dd6b9f5b5e tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/8076f360-cd14-41a0-a27b-3c929bfb05d6" status: 200 len: 662 microversion: 2.1 time: 0.074140 Oct 18 15:31:33.614277 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 900/1771] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:31:33 2022] GET /compute/v2.1/images/8076f360-cd14-41a0-a27b-3c929bfb05d6 => generated 662 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:31:33.616494 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d19e1ae5-9e6a-476b-9c88-de4f2fc97a2f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:31:33.618725 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d19e1ae5-9e6a-476b-9c88-de4f2fc97a2f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 0dfb045a-8cea-41b6-bbdc-8fa6600046d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='368938ac-82cc-4a62-a8d0-842b2c246a35',volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:31:33.838515 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d19e1ae5-9e6a-476b-9c88-de4f2fc97a2f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.283196 Oct 18 15:31:33.844857 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 872/1772] 10.222.0.60 () {62 vars in 1188 bytes} [Tue Oct 18 15:31:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1285 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 18 15:31:33.851493 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0ebd07ca-40cf-4dbf-8357-ec9bb3a7f295 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:33.852120 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0ebd07ca-40cf-4dbf-8357-ec9bb3a7f295 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] [instance: d869973f-2d6e-4324-951e-1f26239a593e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:33.875520 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ebd07ca-40cf-4dbf-8357-ec9bb3a7f295 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:33.876854 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ebd07ca-40cf-4dbf-8357-ec9bb3a7f295 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:33.878002 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ebd07ca-40cf-4dbf-8357-ec9bb3a7f295 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:33.878900 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ebd07ca-40cf-4dbf-8357-ec9bb3a7f295 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:33.879529 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ebd07ca-40cf-4dbf-8357-ec9bb3a7f295 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:33.881192 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ebd07ca-40cf-4dbf-8357-ec9bb3a7f295 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:33.895259 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1c562812-6975-43d9-9d74-d4121c06008a tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:33.896777 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1c562812-6975-43d9-9d74-d4121c06008a tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:33.904040 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1c562812-6975-43d9-9d74-d4121c06008a tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:33.904739 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1c562812-6975-43d9-9d74-d4121c06008a tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:33.905484 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1c562812-6975-43d9-9d74-d4121c06008a tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:33.906885 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1c562812-6975-43d9-9d74-d4121c06008a tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:33.907544 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1c562812-6975-43d9-9d74-d4121c06008a tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:33.908422 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1c562812-6975-43d9-9d74-d4121c06008a tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:34.185942 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0ebd07ca-40cf-4dbf-8357-ec9bb3a7f295 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2678c8aad39402c885b6f780fd33165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feee8ee03b8646998338de04f4cb80dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:34.197637 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0ebd07ca-40cf-4dbf-8357-ec9bb3a7f295 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] 10.222.0.60 "GET /compute/v2.1/servers/d869973f-2d6e-4324-951e-1f26239a593e" status: 200 len: 1313 microversion: 2.1 time: 0.356744 Oct 18 15:31:34.199364 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 873/1773] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:33 2022] GET /compute/v2.1/servers/d869973f-2d6e-4324-951e-1f26239a593e => generated 1313 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:34.206720 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1c562812-6975-43d9-9d74-d4121c06008a tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e" status: 200 len: 1532 microversion: 2.1 time: 0.591183 Oct 18 15:31:34.207628 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 901/1774] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:33 2022] GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e => generated 1532 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:34.214083 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-32107661-ae08-4379-b0ec-b40d2ca522a1 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c3cf9d700>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:34.215624 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-096bb7a8-ea86-4ef9-9566-3e65954c567b req-c46041b4-506e-45a5-8108-b119004fea7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d869973f-2d6e-4324-951e-1f26239a593e", "name": "network-vif-plugged", "status": "completed", "tag": "14fe3073-6fca-4e2a-85b6-92cf8f4e4a63"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:31:34.235089 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-096bb7a8-ea86-4ef9-9566-3e65954c567b req-c46041b4-506e-45a5-8108-b119004fea7d service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:34.235576 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-096bb7a8-ea86-4ef9-9566-3e65954c567b req-c46041b4-506e-45a5-8108-b119004fea7d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:34.236013 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-096bb7a8-ea86-4ef9-9566-3e65954c567b req-c46041b4-506e-45a5-8108-b119004fea7d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:34.259260 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-096bb7a8-ea86-4ef9-9566-3e65954c567b req-c46041b4-506e-45a5-8108-b119004fea7d service nova] Creating event network-vif-plugged:14fe3073-6fca-4e2a-85b6-92cf8f4e4a63 for instance d869973f-2d6e-4324-951e-1f26239a593e on n-h1-853682-5 Oct 18 15:31:34.269430 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-096bb7a8-ea86-4ef9-9566-3e65954c567b req-c46041b4-506e-45a5-8108-b119004fea7d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057389 Oct 18 15:31:34.270346 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 902/1775] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:31:34.275567 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a3b8c2b3-0f81-462e-b2bf-ce170a138cb7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:34.276463 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a3b8c2b3-0f81-462e-b2bf-ce170a138cb7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 0dfb045a-8cea-41b6-bbdc-8fa6600046d1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:34.279191 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-32107661-ae08-4379-b0ec-b40d2ca522a1 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/8076f360-cd14-41a0-a27b-3c929bfb05d6" status: 200 len: 662 microversion: 2.1 time: 0.078385 Oct 18 15:31:34.281014 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 874/1776] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:31:34 2022] GET /compute/v2.1/images/8076f360-cd14-41a0-a27b-3c929bfb05d6 => generated 662 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:31:34.301782 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-376b9474-e701-491c-98d4-554041d4bdcb tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:34.302403 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-376b9474-e701-491c-98d4-554041d4bdcb tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 44a77c90-3a7e-435e-adba-e3a0551d573f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:34.317335 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-376b9474-e701-491c-98d4-554041d4bdcb tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:34.318051 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-376b9474-e701-491c-98d4-554041d4bdcb tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:34.318645 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-376b9474-e701-491c-98d4-554041d4bdcb tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:34.324887 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-376b9474-e701-491c-98d4-554041d4bdcb tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:34.325620 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-376b9474-e701-491c-98d4-554041d4bdcb tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:34.326286 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-376b9474-e701-491c-98d4-554041d4bdcb tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:34.348865 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-376b9474-e701-491c-98d4-554041d4bdcb tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] HTTP exception thrown: Instance 44a77c90-3a7e-435e-adba-e3a0551d573f could not be found. Oct 18 15:31:34.350882 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-376b9474-e701-491c-98d4-554041d4bdcb tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Request method failure captured: Oct 18 15:31:34.350882 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f HTTP/1.1 Oct 18 15:31:34.350882 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:31:34.350882 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:31:34.350882 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:31:34.350882 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:31:34.350882 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:31:34.350882 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:31:34.350882 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:31:34.350882 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:31:34.350882 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsVPb3L3FP-98gtLv8YIMCLfGhe2cuyCUoKBkQOJf_VQrrdw3zjQkBJXdrz51U5RIPirvM4vBy0eEwDlKKADnhe_mWPayJHcQ6gOCTAUKl7bKbkNPv5luVRbp4n9QMAAUTtxVS9n4JhIyNIlSMcaFy8kvjpV-EFu6g7N-rErWpfgdCw Oct 18 15:31:34.350882 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:31:34.350882 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:31:34.350882 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:31:34.350882 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:31:34.350882 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:31:34.350882 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:31:34.350882 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: ee0a3f0c256544beb2df4f113da56137 Oct 18 15:31:34.350882 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ImagesTestJSON-180911091 Oct 18 15:31:34.350882 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:31:34.350882 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:31:34.352375 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:31:34.352375 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ImagesTestJSON-180911091 Oct 18 15:31:34.352375 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: ee0a3f0c256544beb2df4f113da56137 Oct 18 15:31:34.352375 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ImagesTestJSON-180911091 Oct 18 15:31:34.352375 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ImagesTestJSON-180911091-project Oct 18 15:31:34.352375 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:31:34.352375 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:31:34.352375 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: ed9cd936192c40efa9099edee445e90e Oct 18 15:31:34.352375 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ImagesTestJSON-180911091-project Oct 18 15:31:34.352375 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:31:34.352375 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 44a77c90-3a7e-435e-adba-e3a0551d573f could not be found. Oct 18 15:31:34.352375 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '44a77c90-3a7e-435e-adba-e3a0551d573f'} Oct 18 15:31:34.354220 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:31:34.354220 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:34.354220 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:31:34.354220 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:31:34.354220 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:31:34.354220 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:31:34.354220 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:31:34.354220 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:31:34.354220 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:31:34.354220 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:31:34.354220 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44a77c90-3a7e-435e-adba-e3a0551d573f could not be found. Oct 18 15:31:34.354220 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:31:34.354220 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:34.354220 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:31:34.354220 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:34.354220 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:34.354220 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:34.354220 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:31:34.354220 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:31:34.354220 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:31:34.355977 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:31:34.355977 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:31:34.355977 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:31:34.355977 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:31:34.355977 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:31:34.355977 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:31:34.355977 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:31:34.355977 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44a77c90-3a7e-435e-adba-e3a0551d573f could not be found. Oct 18 15:31:34.355977 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:31:34.355977 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:34.355977 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:31:34.355977 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:34.355977 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:34.355977 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:34.355977 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:31:34.355977 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:31:34.355977 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44a77c90-3a7e-435e-adba-e3a0551d573f could not be found. Oct 18 15:31:34.355977 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:31:34.359334 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-376b9474-e701-491c-98d4-554041d4bdcb tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Returning 404 to user: Instance 44a77c90-3a7e-435e-adba-e3a0551d573f could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:31:34.360452 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-376b9474-e701-491c-98d4-554041d4bdcb tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f" status: 404 len: 111 microversion: 2.1 time: 0.067751 Oct 18 15:31:34.361643 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 875/1777] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:34 2022] GET /compute/v2.1/servers/44a77c90-3a7e-435e-adba-e3a0551d573f => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:31:34.366552 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fbf69fd6-6974-43d3-824d-752e58df243c tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:34.367598 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fbf69fd6-6974-43d3-824d-752e58df243c tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:34.374170 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbf69fd6-6974-43d3-824d-752e58df243c tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:34.375576 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbf69fd6-6974-43d3-824d-752e58df243c tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:34.376088 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbf69fd6-6974-43d3-824d-752e58df243c tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:34.376978 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbf69fd6-6974-43d3-824d-752e58df243c tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:34.377507 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbf69fd6-6974-43d3-824d-752e58df243c tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:34.378003 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbf69fd6-6974-43d3-824d-752e58df243c tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:34.378559 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a3b8c2b3-0f81-462e-b2bf-ce170a138cb7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:34.394434 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a3b8c2b3-0f81-462e-b2bf-ce170a138cb7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:34.396043 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:31:34.402586 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a3b8c2b3-0f81-462e-b2bf-ce170a138cb7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:34.405427 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a3b8c2b3-0f81-462e-b2bf-ce170a138cb7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1" status: 200 len: 1103 microversion: 2.25 time: 0.133280 Oct 18 15:31:34.408436 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 903/1778] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:34 2022] GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1 => generated 1103 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:31:34.421513 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c136928c-147d-437c-bb5f-ec06eb95d709 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:34.424667 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c136928c-147d-437c-bb5f-ec06eb95d709 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 4b959d9f-3c8e-44ef-92f1-83cfb8e04804] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:34.433344 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c136928c-147d-437c-bb5f-ec06eb95d709 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:34.433930 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c136928c-147d-437c-bb5f-ec06eb95d709 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:34.434374 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c136928c-147d-437c-bb5f-ec06eb95d709 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:34.435415 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c136928c-147d-437c-bb5f-ec06eb95d709 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:34.435621 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c136928c-147d-437c-bb5f-ec06eb95d709 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:34.436168 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c136928c-147d-437c-bb5f-ec06eb95d709 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:34.452849 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-c136928c-147d-437c-bb5f-ec06eb95d709 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] HTTP exception thrown: Instance 4b959d9f-3c8e-44ef-92f1-83cfb8e04804 could not be found. Oct 18 15:31:34.454707 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c136928c-147d-437c-bb5f-ec06eb95d709 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Request method failure captured: Oct 18 15:31:34.454707 n-d-853682-5 devstack@n-api.service[120405]: request: DELETE /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804 HTTP/1.1 Oct 18 15:31:34.454707 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:31:34.454707 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:31:34.454707 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:31:34.454707 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:31:34.454707 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:31:34.454707 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:31:34.454707 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:31:34.454707 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:31:34.454707 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsVPb3L3FP-98gtLv8YIMCLfGhe2cuyCUoKBkQOJf_VQrrdw3zjQkBJXdrz51U5RIPirvM4vBy0eEwDlKKADnhe_mWPayJHcQ6gOCTAUKl7bKbkNPv5luVRbp4n9QMAAUTtxVS9n4JhIyNIlSMcaFy8kvjpV-EFu6g7N-rErWpfgdCw Oct 18 15:31:34.454707 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:31:34.454707 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:31:34.454707 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:31:34.454707 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:31:34.454707 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:31:34.454707 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:31:34.454707 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: ee0a3f0c256544beb2df4f113da56137 Oct 18 15:31:34.454707 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ImagesTestJSON-180911091 Oct 18 15:31:34.454707 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:31:34.454707 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:31:34.457783 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:31:34.457783 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ImagesTestJSON-180911091 Oct 18 15:31:34.457783 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: ee0a3f0c256544beb2df4f113da56137 Oct 18 15:31:34.457783 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ImagesTestJSON-180911091 Oct 18 15:31:34.457783 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ImagesTestJSON-180911091-project Oct 18 15:31:34.457783 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:31:34.457783 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:31:34.457783 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: ed9cd936192c40efa9099edee445e90e Oct 18 15:31:34.457783 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ImagesTestJSON-180911091-project Oct 18 15:31:34.457783 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:31:34.457783 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 4b959d9f-3c8e-44ef-92f1-83cfb8e04804 could not be found. Oct 18 15:31:34.457783 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '4b959d9f-3c8e-44ef-92f1-83cfb8e04804'} Oct 18 15:31:34.458723 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:31:34.458723 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:34.458723 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:31:34.458723 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:31:34.458723 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:31:34.458723 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:31:34.458723 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:31:34.458723 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:31:34.458723 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:31:34.458723 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:31:34.458723 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b959d9f-3c8e-44ef-92f1-83cfb8e04804 could not be found. Oct 18 15:31:34.458723 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:34.458723 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:34.458723 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:34.458723 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:34.458723 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:34.458723 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:34.458723 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:31:34.458723 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:31:34.458723 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:31:34.460615 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:31:34.460615 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 15:31:34.460615 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 15:31:34.460615 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 15:31:34.460615 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 15:31:34.460615 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:31:34.460615 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:31:34.460615 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:31:34.460615 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:31:34.460615 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b959d9f-3c8e-44ef-92f1-83cfb8e04804 could not be found. Oct 18 15:31:34.460615 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:34.460615 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:34.460615 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:34.460615 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:34.460615 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:34.460615 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:34.460615 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:31:34.460615 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:31:34.460615 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b959d9f-3c8e-44ef-92f1-83cfb8e04804 could not be found. Oct 18 15:31:34.460615 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:34.462450 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c136928c-147d-437c-bb5f-ec06eb95d709 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Returning 404 to user: Instance 4b959d9f-3c8e-44ef-92f1-83cfb8e04804 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:31:34.462450 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c136928c-147d-437c-bb5f-ec06eb95d709 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804" status: 404 len: 111 microversion: 2.1 time: 0.045183 Oct 18 15:31:34.462450 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 904/1779] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:31:34 2022] DELETE /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:31:34.467776 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-685da19a-6f40-4b25-9ac8-3dcf1ac0a508 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:34.469216 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-685da19a-6f40-4b25-9ac8-3dcf1ac0a508 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 4b959d9f-3c8e-44ef-92f1-83cfb8e04804] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:34.477277 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-685da19a-6f40-4b25-9ac8-3dcf1ac0a508 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:34.478025 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-685da19a-6f40-4b25-9ac8-3dcf1ac0a508 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:34.478466 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-685da19a-6f40-4b25-9ac8-3dcf1ac0a508 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:34.479164 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-685da19a-6f40-4b25-9ac8-3dcf1ac0a508 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:34.480468 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-685da19a-6f40-4b25-9ac8-3dcf1ac0a508 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:34.481150 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-685da19a-6f40-4b25-9ac8-3dcf1ac0a508 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:34.497916 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-685da19a-6f40-4b25-9ac8-3dcf1ac0a508 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] HTTP exception thrown: Instance 4b959d9f-3c8e-44ef-92f1-83cfb8e04804 could not be found. Oct 18 15:31:34.499644 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-685da19a-6f40-4b25-9ac8-3dcf1ac0a508 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Request method failure captured: Oct 18 15:31:34.499644 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804 HTTP/1.1 Oct 18 15:31:34.499644 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:31:34.499644 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:31:34.499644 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:31:34.499644 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:31:34.499644 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:31:34.499644 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:31:34.499644 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:31:34.499644 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:31:34.499644 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsVPb3L3FP-98gtLv8YIMCLfGhe2cuyCUoKBkQOJf_VQrrdw3zjQkBJXdrz51U5RIPirvM4vBy0eEwDlKKADnhe_mWPayJHcQ6gOCTAUKl7bKbkNPv5luVRbp4n9QMAAUTtxVS9n4JhIyNIlSMcaFy8kvjpV-EFu6g7N-rErWpfgdCw Oct 18 15:31:34.499644 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:31:34.499644 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:31:34.499644 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:31:34.499644 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:31:34.499644 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:31:34.499644 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:31:34.499644 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: ee0a3f0c256544beb2df4f113da56137 Oct 18 15:31:34.499644 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ImagesTestJSON-180911091 Oct 18 15:31:34.499644 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:31:34.499644 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:31:34.502533 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:31:34.502533 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ImagesTestJSON-180911091 Oct 18 15:31:34.502533 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: ee0a3f0c256544beb2df4f113da56137 Oct 18 15:31:34.502533 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ImagesTestJSON-180911091 Oct 18 15:31:34.502533 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ImagesTestJSON-180911091-project Oct 18 15:31:34.502533 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:31:34.502533 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:31:34.502533 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: ed9cd936192c40efa9099edee445e90e Oct 18 15:31:34.502533 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ImagesTestJSON-180911091-project Oct 18 15:31:34.502533 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:31:34.502533 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 4b959d9f-3c8e-44ef-92f1-83cfb8e04804 could not be found. Oct 18 15:31:34.502533 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '4b959d9f-3c8e-44ef-92f1-83cfb8e04804'} Oct 18 15:31:34.503513 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:31:34.503513 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:34.503513 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:31:34.503513 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:31:34.503513 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:31:34.503513 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:31:34.503513 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:31:34.503513 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:31:34.503513 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:31:34.503513 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:31:34.503513 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b959d9f-3c8e-44ef-92f1-83cfb8e04804 could not be found. Oct 18 15:31:34.503513 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:34.503513 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:34.503513 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:34.503513 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:34.503513 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:34.503513 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:34.503513 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:31:34.503513 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:31:34.503513 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:31:34.505560 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:31:34.505560 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:31:34.505560 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:31:34.505560 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:31:34.505560 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:31:34.505560 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:31:34.505560 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:31:34.505560 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b959d9f-3c8e-44ef-92f1-83cfb8e04804 could not be found. Oct 18 15:31:34.505560 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:34.505560 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:34.505560 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:34.505560 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:34.505560 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:34.505560 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:34.505560 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:31:34.505560 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:31:34.505560 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b959d9f-3c8e-44ef-92f1-83cfb8e04804 could not be found. Oct 18 15:31:34.505560 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:34.507662 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-685da19a-6f40-4b25-9ac8-3dcf1ac0a508 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Returning 404 to user: Instance 4b959d9f-3c8e-44ef-92f1-83cfb8e04804 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:31:34.507662 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-685da19a-6f40-4b25-9ac8-3dcf1ac0a508 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804" status: 404 len: 111 microversion: 2.1 time: 0.039688 Oct 18 15:31:34.507662 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 905/1780] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:34 2022] GET /compute/v2.1/servers/4b959d9f-3c8e-44ef-92f1-83cfb8e04804 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:31:34.516637 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d1d0a238-3d48-4e0b-b038-2cd683de34c5 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d68de50>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:34.559743 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-d1d0a238-3d48-4e0b-b038-2cd683de34c5 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] HTTP exception thrown: Image not found. Oct 18 15:31:34.563920 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d1d0a238-3d48-4e0b-b038-2cd683de34c5 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Request method failure captured: Oct 18 15:31:34.563920 n-d-853682-5 devstack@n-api.service[120405]: request: DELETE /compute/v2.1/images/55cd5e90-ef2b-4aec-a711-c27fc895dbba HTTP/1.1 Oct 18 15:31:34.563920 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:31:34.563920 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:31:34.563920 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:31:34.563920 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:31:34.563920 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:31:34.563920 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:31:34.563920 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:31:34.563920 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:31:34.563920 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsVPb3L3FP-98gtLv8YIMCLfGhe2cuyCUoKBkQOJf_VQrrdw3zjQkBJXdrz51U5RIPirvM4vBy0eEwDlKKADnhe_mWPayJHcQ6gOCTAUKl7bKbkNPv5luVRbp4n9QMAAUTtxVS9n4JhIyNIlSMcaFy8kvjpV-EFu6g7N-rErWpfgdCw Oct 18 15:31:34.563920 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:31:34.563920 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:31:34.563920 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:31:34.563920 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:31:34.563920 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:31:34.563920 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:31:34.563920 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: ee0a3f0c256544beb2df4f113da56137 Oct 18 15:31:34.563920 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ImagesTestJSON-180911091 Oct 18 15:31:34.563920 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:31:34.563920 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:31:34.565651 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:31:34.565651 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ImagesTestJSON-180911091 Oct 18 15:31:34.565651 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: ee0a3f0c256544beb2df4f113da56137 Oct 18 15:31:34.565651 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ImagesTestJSON-180911091 Oct 18 15:31:34.565651 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ImagesTestJSON-180911091-project Oct 18 15:31:34.565651 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:31:34.565651 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:31:34.565651 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: ed9cd936192c40efa9099edee445e90e Oct 18 15:31:34.565651 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ImagesTestJSON-180911091-project Oct 18 15:31:34.565651 n-d-853682-5 devstack@n-api.service[120405]: method: Oct 18 15:31:34.565651 n-d-853682-5 devstack@n-api.service[120405]: exception: Image not found. Oct 18 15:31:34.565651 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '55cd5e90-ef2b-4aec-a711-c27fc895dbba'} Oct 18 15:31:34.565651 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:31:34.565651 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:34.566698 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 18 15:31:34.566698 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 18 15:31:34.566698 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 15:31:34.566698 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 15:31:34.566698 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 15:31:34.566698 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 15:31:34.566698 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 18 15:31:34.566698 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 18 15:31:34.566698 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 18 15:31:34.566698 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 18 15:31:34.566698 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 15:31:34.566698 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 15:31:34.566698 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 15:31:34.566698 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 15:31:34.566698 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 55cd5e90-ef2b-4aec-a711-c27fc895dbba to delete Oct 18 15:31:34.566698 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:34.566698 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:34.566698 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:34.566698 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:34.568204 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 18 15:31:34.568204 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 18 15:31:34.568204 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 18 15:31:34.568204 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 18 15:31:34.568204 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 18 15:31:34.568204 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 18 15:31:34.568204 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 55cd5e90-ef2b-4aec-a711-c27fc895dbba could not be found. Oct 18 15:31:34.568204 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:34.568204 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:34.568204 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:34.568204 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:34.568204 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:34.568204 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:34.568204 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:31:34.568204 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:31:34.568204 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:31:34.568204 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:31:34.568204 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:31:34.568204 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:31:34.568204 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 18 15:31:34.569636 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 15:31:34.569636 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 15:31:34.569636 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:34.569636 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:34.569636 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:34.569636 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:34.569636 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:34.569636 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:34.569636 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:31:34.569636 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:31:34.569636 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 15:31:34.569636 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:34.569636 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d1d0a238-3d48-4e0b-b038-2cd683de34c5 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Returning 404 to user: Image not found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:31:34.569636 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d1d0a238-3d48-4e0b-b038-2cd683de34c5 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "DELETE /compute/v2.1/images/55cd5e90-ef2b-4aec-a711-c27fc895dbba" status: 404 len: 62 microversion: 2.1 time: 0.056885 Oct 18 15:31:34.569636 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 906/1781] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:34 2022] DELETE /compute/v2.1/images/55cd5e90-ef2b-4aec-a711-c27fc895dbba => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 15:31:34.577735 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5db0fe9f-ef3f-4028-8b4a-dd8ff88f9570 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:34.579026 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5db0fe9f-ef3f-4028-8b4a-dd8ff88f9570 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] [instance: 234a024f-c13b-40de-bbcb-ffcdda611d01] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:34.591930 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5db0fe9f-ef3f-4028-8b4a-dd8ff88f9570 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:34.592827 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5db0fe9f-ef3f-4028-8b4a-dd8ff88f9570 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:34.594177 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5db0fe9f-ef3f-4028-8b4a-dd8ff88f9570 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:34.595397 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5db0fe9f-ef3f-4028-8b4a-dd8ff88f9570 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:34.596236 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5db0fe9f-ef3f-4028-8b4a-dd8ff88f9570 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:34.597057 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5db0fe9f-ef3f-4028-8b4a-dd8ff88f9570 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:34.723424 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5db0fe9f-ef3f-4028-8b4a-dd8ff88f9570 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:34.733555 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5db0fe9f-ef3f-4028-8b4a-dd8ff88f9570 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:34.736549 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5db0fe9f-ef3f-4028-8b4a-dd8ff88f9570 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:34.742858 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5db0fe9f-ef3f-4028-8b4a-dd8ff88f9570 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] 10.222.0.60 "GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01" status: 200 len: 1446 microversion: 2.75 time: 0.173730 Oct 18 15:31:34.743553 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 907/1782] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:34 2022] GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01 => generated 1446 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:31:34.766619 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e7a1d1d4-d00f-40ac-a81f-b58ad805531d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:34.766619 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e7a1d1d4-d00f-40ac-a81f-b58ad805531d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: ec3790f8-37cf-4e63-b753-83d38e982580] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:34.768794 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e7a1d1d4-d00f-40ac-a81f-b58ad805531d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:34.769435 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e7a1d1d4-d00f-40ac-a81f-b58ad805531d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:34.769937 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e7a1d1d4-d00f-40ac-a81f-b58ad805531d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:34.770829 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e7a1d1d4-d00f-40ac-a81f-b58ad805531d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:34.771246 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e7a1d1d4-d00f-40ac-a81f-b58ad805531d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:34.771867 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e7a1d1d4-d00f-40ac-a81f-b58ad805531d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:34.773973 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fbf69fd6-6974-43d3-824d-752e58df243c tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e" status: 200 len: 1532 microversion: 2.1 time: 0.410737 Oct 18 15:31:34.775372 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 876/1783] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:34 2022] GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e => generated 1532 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:34.799982 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-e7a1d1d4-d00f-40ac-a81f-b58ad805531d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] HTTP exception thrown: Instance ec3790f8-37cf-4e63-b753-83d38e982580 could not be found. Oct 18 15:31:34.801841 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e7a1d1d4-d00f-40ac-a81f-b58ad805531d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Request method failure captured: Oct 18 15:31:34.801841 n-d-853682-5 devstack@n-api.service[120405]: request: DELETE /compute/v2.1/servers/ec3790f8-37cf-4e63-b753-83d38e982580 HTTP/1.1 Oct 18 15:31:34.801841 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:31:34.801841 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:31:34.801841 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:31:34.801841 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:31:34.801841 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:31:34.801841 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:31:34.801841 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:31:34.801841 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:31:34.801841 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsVPb3L3FP-98gtLv8YIMCLfGhe2cuyCUoKBkQOJf_VQrrdw3zjQkBJXdrz51U5RIPirvM4vBy0eEwDlKKADnhe_mWPayJHcQ6gOCTAUKl7bKbkNPv5luVRbp4n9QMAAUTtxVS9n4JhIyNIlSMcaFy8kvjpV-EFu6g7N-rErWpfgdCw Oct 18 15:31:34.801841 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:31:34.801841 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:31:34.801841 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:31:34.801841 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:31:34.801841 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:31:34.801841 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:31:34.801841 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: ee0a3f0c256544beb2df4f113da56137 Oct 18 15:31:34.801841 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ImagesTestJSON-180911091 Oct 18 15:31:34.801841 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:31:34.801841 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:31:34.806187 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:31:34.806187 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ImagesTestJSON-180911091 Oct 18 15:31:34.806187 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: ee0a3f0c256544beb2df4f113da56137 Oct 18 15:31:34.806187 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ImagesTestJSON-180911091 Oct 18 15:31:34.806187 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ImagesTestJSON-180911091-project Oct 18 15:31:34.806187 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:31:34.806187 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:31:34.806187 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: ed9cd936192c40efa9099edee445e90e Oct 18 15:31:34.806187 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ImagesTestJSON-180911091-project Oct 18 15:31:34.806187 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:31:34.806187 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance ec3790f8-37cf-4e63-b753-83d38e982580 could not be found. Oct 18 15:31:34.806187 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'ec3790f8-37cf-4e63-b753-83d38e982580'} Oct 18 15:31:34.807343 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:31:34.807343 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:34.807343 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:31:34.807343 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:31:34.807343 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:31:34.807343 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:31:34.807343 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:31:34.807343 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:31:34.807343 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:31:34.807343 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:31:34.807343 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec3790f8-37cf-4e63-b753-83d38e982580 could not be found. Oct 18 15:31:34.807343 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:34.807343 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:34.807343 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:34.807343 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:34.807343 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:34.807343 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:34.807343 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:31:34.807343 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:31:34.807343 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:31:34.809000 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:31:34.809000 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 15:31:34.809000 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 15:31:34.809000 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 15:31:34.809000 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 15:31:34.809000 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:31:34.809000 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:31:34.809000 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:31:34.809000 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:31:34.809000 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec3790f8-37cf-4e63-b753-83d38e982580 could not be found. Oct 18 15:31:34.809000 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:34.809000 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:34.809000 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:34.809000 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:34.809000 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:34.809000 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:34.809000 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:31:34.809000 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:31:34.809000 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec3790f8-37cf-4e63-b753-83d38e982580 could not be found. Oct 18 15:31:34.809000 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:34.811567 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bbd4b765-112a-4ada-857d-89aad4c0f8a4 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:34.811567 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bbd4b765-112a-4ada-857d-89aad4c0f8a4 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:34.811567 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bbd4b765-112a-4ada-857d-89aad4c0f8a4 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:34.811567 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bbd4b765-112a-4ada-857d-89aad4c0f8a4 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:34.812213 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bbd4b765-112a-4ada-857d-89aad4c0f8a4 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:34.812455 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bbd4b765-112a-4ada-857d-89aad4c0f8a4 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:34.813042 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bbd4b765-112a-4ada-857d-89aad4c0f8a4 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:34.817765 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e7a1d1d4-d00f-40ac-a81f-b58ad805531d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Returning 404 to user: Instance ec3790f8-37cf-4e63-b753-83d38e982580 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:31:34.819259 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e7a1d1d4-d00f-40ac-a81f-b58ad805531d tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ec3790f8-37cf-4e63-b753-83d38e982580" status: 404 len: 111 microversion: 2.1 time: 0.063475 Oct 18 15:31:34.820935 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 908/1784] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:31:34 2022] DELETE /compute/v2.1/servers/ec3790f8-37cf-4e63-b753-83d38e982580 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:31:34.829918 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d9085294-afbd-4db1-a9bc-7f627ef3c458 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:34.832078 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d9085294-afbd-4db1-a9bc-7f627ef3c458 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: ec3790f8-37cf-4e63-b753-83d38e982580] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:34.839697 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d9085294-afbd-4db1-a9bc-7f627ef3c458 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:34.840527 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d9085294-afbd-4db1-a9bc-7f627ef3c458 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:34.841201 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d9085294-afbd-4db1-a9bc-7f627ef3c458 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:34.842481 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d9085294-afbd-4db1-a9bc-7f627ef3c458 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:34.843156 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d9085294-afbd-4db1-a9bc-7f627ef3c458 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:34.844377 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d9085294-afbd-4db1-a9bc-7f627ef3c458 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:34.846927 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bbd4b765-112a-4ada-857d-89aad4c0f8a4 tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.050550 Oct 18 15:31:34.847696 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 877/1785] 10.222.0.60 () {58 vars in 1176 bytes} [Tue Oct 18 15:31:34 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:31:34.861757 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-699dfda4-b204-42b8-9a6e-de6bf11aea3d tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-853682-5", "block_migration": false, "disk_over_commit": false}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:31:34.865709 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-699dfda4-b204-42b8-9a6e-de6bf11aea3d tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:34.866826 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-d9085294-afbd-4db1-a9bc-7f627ef3c458 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] HTTP exception thrown: Instance ec3790f8-37cf-4e63-b753-83d38e982580 could not be found. Oct 18 15:31:34.869865 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d9085294-afbd-4db1-a9bc-7f627ef3c458 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Request method failure captured: Oct 18 15:31:34.869865 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/ec3790f8-37cf-4e63-b753-83d38e982580 HTTP/1.1 Oct 18 15:31:34.869865 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:31:34.869865 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:31:34.869865 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:31:34.869865 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:31:34.869865 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:31:34.869865 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:31:34.869865 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:31:34.869865 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:31:34.869865 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsVPb3L3FP-98gtLv8YIMCLfGhe2cuyCUoKBkQOJf_VQrrdw3zjQkBJXdrz51U5RIPirvM4vBy0eEwDlKKADnhe_mWPayJHcQ6gOCTAUKl7bKbkNPv5luVRbp4n9QMAAUTtxVS9n4JhIyNIlSMcaFy8kvjpV-EFu6g7N-rErWpfgdCw Oct 18 15:31:34.869865 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:31:34.869865 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:31:34.869865 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:31:34.869865 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:31:34.869865 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:31:34.869865 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:31:34.869865 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: ee0a3f0c256544beb2df4f113da56137 Oct 18 15:31:34.869865 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ImagesTestJSON-180911091 Oct 18 15:31:34.869865 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:31:34.869865 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:31:34.871544 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:31:34.871544 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ImagesTestJSON-180911091 Oct 18 15:31:34.871544 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: ee0a3f0c256544beb2df4f113da56137 Oct 18 15:31:34.871544 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ImagesTestJSON-180911091 Oct 18 15:31:34.871544 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ImagesTestJSON-180911091-project Oct 18 15:31:34.871544 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:31:34.871544 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:31:34.871544 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: ed9cd936192c40efa9099edee445e90e Oct 18 15:31:34.871544 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ImagesTestJSON-180911091-project Oct 18 15:31:34.871544 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:31:34.871544 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance ec3790f8-37cf-4e63-b753-83d38e982580 could not be found. Oct 18 15:31:34.871544 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'ec3790f8-37cf-4e63-b753-83d38e982580'} Oct 18 15:31:34.872441 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:31:34.872441 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:34.872441 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:31:34.872441 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:31:34.872441 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:31:34.872441 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:31:34.872441 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:31:34.872441 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:31:34.872441 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:31:34.872441 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:31:34.872441 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec3790f8-37cf-4e63-b753-83d38e982580 could not be found. Oct 18 15:31:34.872441 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:34.872441 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:34.872441 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:34.872441 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:34.872441 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:34.872441 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:34.872441 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:31:34.872441 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:31:34.872441 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:31:34.879080 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:31:34.879080 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:31:34.879080 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:31:34.879080 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:31:34.879080 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:31:34.879080 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:31:34.879080 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:31:34.879080 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec3790f8-37cf-4e63-b753-83d38e982580 could not be found. Oct 18 15:31:34.879080 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:34.879080 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:34.879080 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:34.879080 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:34.879080 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:34.879080 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:34.879080 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:31:34.879080 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:31:34.879080 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec3790f8-37cf-4e63-b753-83d38e982580 could not be found. Oct 18 15:31:34.879080 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:34.882248 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d9085294-afbd-4db1-a9bc-7f627ef3c458 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Returning 404 to user: Instance ec3790f8-37cf-4e63-b753-83d38e982580 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:31:34.882248 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d9085294-afbd-4db1-a9bc-7f627ef3c458 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/ec3790f8-37cf-4e63-b753-83d38e982580" status: 404 len: 111 microversion: 2.1 time: 0.046993 Oct 18 15:31:34.882248 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 909/1786] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:34 2022] GET /compute/v2.1/servers/ec3790f8-37cf-4e63-b753-83d38e982580 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:31:34.882688 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-699dfda4-b204-42b8-9a6e-de6bf11aea3d tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:34.882688 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-699dfda4-b204-42b8-9a6e-de6bf11aea3d tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:34.882688 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-699dfda4-b204-42b8-9a6e-de6bf11aea3d tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:34.882688 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-699dfda4-b204-42b8-9a6e-de6bf11aea3d tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:34.883400 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-699dfda4-b204-42b8-9a6e-de6bf11aea3d tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:34.883400 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-699dfda4-b204-42b8-9a6e-de6bf11aea3d tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:34.884705 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f1590bd6-c07c-419c-b7b9-eebf4739d2b3 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d3ea790>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:34.911042 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-f1590bd6-c07c-419c-b7b9-eebf4739d2b3 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] HTTP exception thrown: Image not found. Oct 18 15:31:34.913106 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-699dfda4-b204-42b8-9a6e-de6bf11aea3d tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lazy-loading 'flavor' on Instance uuid da62499c-f590-4083-80b6-b849b6695c4e {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:31:34.913615 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f1590bd6-c07c-419c-b7b9-eebf4739d2b3 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Request method failure captured: Oct 18 15:31:34.913615 n-d-853682-5 devstack@n-api.service[120405]: request: DELETE /compute/v2.1/images/a3cce994-6f52-4376-b348-a7cf7a071d8d HTTP/1.1 Oct 18 15:31:34.913615 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:31:34.913615 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:31:34.913615 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:31:34.913615 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:31:34.913615 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:31:34.913615 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:31:34.913615 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:31:34.913615 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:31:34.913615 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsVPb3L3FP-98gtLv8YIMCLfGhe2cuyCUoKBkQOJf_VQrrdw3zjQkBJXdrz51U5RIPirvM4vBy0eEwDlKKADnhe_mWPayJHcQ6gOCTAUKl7bKbkNPv5luVRbp4n9QMAAUTtxVS9n4JhIyNIlSMcaFy8kvjpV-EFu6g7N-rErWpfgdCw Oct 18 15:31:34.913615 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:31:34.913615 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:31:34.913615 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:31:34.913615 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:31:34.913615 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:31:34.913615 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:31:34.913615 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: ee0a3f0c256544beb2df4f113da56137 Oct 18 15:31:34.913615 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ImagesTestJSON-180911091 Oct 18 15:31:34.913615 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:31:34.913615 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:31:34.915107 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:31:34.915107 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ImagesTestJSON-180911091 Oct 18 15:31:34.915107 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: ee0a3f0c256544beb2df4f113da56137 Oct 18 15:31:34.915107 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ImagesTestJSON-180911091 Oct 18 15:31:34.915107 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ImagesTestJSON-180911091-project Oct 18 15:31:34.915107 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:31:34.915107 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:31:34.915107 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: ed9cd936192c40efa9099edee445e90e Oct 18 15:31:34.915107 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ImagesTestJSON-180911091-project Oct 18 15:31:34.915107 n-d-853682-5 devstack@n-api.service[120405]: method: Oct 18 15:31:34.915107 n-d-853682-5 devstack@n-api.service[120405]: exception: Image not found. Oct 18 15:31:34.915107 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'a3cce994-6f52-4376-b348-a7cf7a071d8d'} Oct 18 15:31:34.915107 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:31:34.915107 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:34.916055 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 18 15:31:34.916055 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 18 15:31:34.916055 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 15:31:34.916055 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 15:31:34.916055 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 15:31:34.916055 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 15:31:34.916055 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 18 15:31:34.916055 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 18 15:31:34.916055 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 18 15:31:34.916055 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 18 15:31:34.916055 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 15:31:34.916055 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 15:31:34.916055 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 15:31:34.916055 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 15:31:34.916055 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a3cce994-6f52-4376-b348-a7cf7a071d8d to delete Oct 18 15:31:34.916055 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:34.916055 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:34.916055 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:34.916055 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:34.917341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 18 15:31:34.917341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 18 15:31:34.917341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 18 15:31:34.917341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 18 15:31:34.917341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 18 15:31:34.917341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 18 15:31:34.917341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a3cce994-6f52-4376-b348-a7cf7a071d8d could not be found. Oct 18 15:31:34.917341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:34.917341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:34.917341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:34.917341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:34.917341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:34.917341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:34.917341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:31:34.917341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:31:34.917341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:31:34.917341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:31:34.917341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:31:34.917341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:31:34.917341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 18 15:31:34.918637 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 15:31:34.918637 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 15:31:34.918637 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:34.918637 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:34.918637 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:34.918637 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:34.918637 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:34.918637 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:34.918637 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:31:34.918637 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:31:34.918637 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 15:31:34.918637 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:34.918637 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f1590bd6-c07c-419c-b7b9-eebf4739d2b3 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Returning 404 to user: Image not found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:31:34.918637 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f1590bd6-c07c-419c-b7b9-eebf4739d2b3 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "DELETE /compute/v2.1/images/a3cce994-6f52-4376-b348-a7cf7a071d8d" status: 404 len: 62 microversion: 2.1 time: 0.035651 Oct 18 15:31:34.918637 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 910/1787] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:34 2022] DELETE /compute/v2.1/images/a3cce994-6f52-4376-b348-a7cf7a071d8d => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 18 15:31:34.929096 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-59f4068c-e839-4f87-a0a3-ae10de09c7a3 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:34.931058 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-59f4068c-e839-4f87-a0a3-ae10de09c7a3 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: dd3fd462-cb66-45c0-92a3-2f9aca2cb16f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:34.937670 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-699dfda4-b204-42b8-9a6e-de6bf11aea3d tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Going to try to live migrate instance to n-h2-853682-5 {{(pid=120406) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 18 15:31:34.941377 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-59f4068c-e839-4f87-a0a3-ae10de09c7a3 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:34.942095 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-59f4068c-e839-4f87-a0a3-ae10de09c7a3 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:34.942693 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-59f4068c-e839-4f87-a0a3-ae10de09c7a3 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:34.943876 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-59f4068c-e839-4f87-a0a3-ae10de09c7a3 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:34.945576 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-59f4068c-e839-4f87-a0a3-ae10de09c7a3 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:34.945963 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-59f4068c-e839-4f87-a0a3-ae10de09c7a3 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:34.975244 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-59f4068c-e839-4f87-a0a3-ae10de09c7a3 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] HTTP exception thrown: Instance dd3fd462-cb66-45c0-92a3-2f9aca2cb16f could not be found. Oct 18 15:31:34.977589 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-59f4068c-e839-4f87-a0a3-ae10de09c7a3 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Request method failure captured: Oct 18 15:31:34.977589 n-d-853682-5 devstack@n-api.service[120405]: request: DELETE /compute/v2.1/servers/dd3fd462-cb66-45c0-92a3-2f9aca2cb16f HTTP/1.1 Oct 18 15:31:34.977589 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:31:34.977589 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:31:34.977589 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:31:34.977589 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:31:34.977589 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:31:34.977589 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:31:34.977589 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:31:34.977589 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:31:34.977589 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsVPb3L3FP-98gtLv8YIMCLfGhe2cuyCUoKBkQOJf_VQrrdw3zjQkBJXdrz51U5RIPirvM4vBy0eEwDlKKADnhe_mWPayJHcQ6gOCTAUKl7bKbkNPv5luVRbp4n9QMAAUTtxVS9n4JhIyNIlSMcaFy8kvjpV-EFu6g7N-rErWpfgdCw Oct 18 15:31:34.977589 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:31:34.977589 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:31:34.977589 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:31:34.977589 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:31:34.977589 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:31:34.977589 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:31:34.977589 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: ee0a3f0c256544beb2df4f113da56137 Oct 18 15:31:34.977589 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ImagesTestJSON-180911091 Oct 18 15:31:34.977589 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:31:34.977589 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:31:34.979047 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:31:34.979047 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ImagesTestJSON-180911091 Oct 18 15:31:34.979047 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: ee0a3f0c256544beb2df4f113da56137 Oct 18 15:31:34.979047 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ImagesTestJSON-180911091 Oct 18 15:31:34.979047 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ImagesTestJSON-180911091-project Oct 18 15:31:34.979047 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:31:34.979047 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:31:34.979047 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: ed9cd936192c40efa9099edee445e90e Oct 18 15:31:34.979047 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ImagesTestJSON-180911091-project Oct 18 15:31:34.979047 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:31:34.979047 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance dd3fd462-cb66-45c0-92a3-2f9aca2cb16f could not be found. Oct 18 15:31:34.979047 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'dd3fd462-cb66-45c0-92a3-2f9aca2cb16f'} Oct 18 15:31:34.979878 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:31:34.979878 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:34.979878 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:31:34.979878 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:31:34.979878 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:31:34.979878 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:31:34.979878 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:31:34.979878 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:31:34.979878 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:31:34.979878 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:31:34.979878 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd3fd462-cb66-45c0-92a3-2f9aca2cb16f could not be found. Oct 18 15:31:34.979878 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:34.979878 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:34.979878 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:34.979878 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:34.979878 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:34.979878 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:34.979878 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:31:34.979878 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:31:34.979878 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:31:34.981264 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:31:34.981264 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 15:31:34.981264 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 15:31:34.981264 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 15:31:34.981264 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 15:31:34.981264 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:31:34.981264 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:31:34.981264 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:31:34.981264 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:31:34.981264 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd3fd462-cb66-45c0-92a3-2f9aca2cb16f could not be found. Oct 18 15:31:34.981264 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:34.981264 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:34.981264 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:34.981264 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:34.981264 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:34.981264 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:34.981264 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:31:34.981264 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:31:34.981264 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd3fd462-cb66-45c0-92a3-2f9aca2cb16f could not be found. Oct 18 15:31:34.981264 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:34.982623 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-59f4068c-e839-4f87-a0a3-ae10de09c7a3 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Returning 404 to user: Instance dd3fd462-cb66-45c0-92a3-2f9aca2cb16f could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:31:34.982623 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-59f4068c-e839-4f87-a0a3-ae10de09c7a3 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "DELETE /compute/v2.1/servers/dd3fd462-cb66-45c0-92a3-2f9aca2cb16f" status: 404 len: 111 microversion: 2.1 time: 0.057508 Oct 18 15:31:34.982623 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 911/1788] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:31:34 2022] DELETE /compute/v2.1/servers/dd3fd462-cb66-45c0-92a3-2f9aca2cb16f => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:31:34.994207 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9c35105d-6dfa-4b4a-b335-977c0ac078f2 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:34.995190 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9c35105d-6dfa-4b4a-b335-977c0ac078f2 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: dd3fd462-cb66-45c0-92a3-2f9aca2cb16f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:35.003152 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9c35105d-6dfa-4b4a-b335-977c0ac078f2 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:35.003919 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9c35105d-6dfa-4b4a-b335-977c0ac078f2 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:35.004867 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9c35105d-6dfa-4b4a-b335-977c0ac078f2 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:35.005813 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9c35105d-6dfa-4b4a-b335-977c0ac078f2 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:35.006455 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9c35105d-6dfa-4b4a-b335-977c0ac078f2 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:35.007068 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9c35105d-6dfa-4b4a-b335-977c0ac078f2 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:35.025256 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-9c35105d-6dfa-4b4a-b335-977c0ac078f2 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] HTTP exception thrown: Instance dd3fd462-cb66-45c0-92a3-2f9aca2cb16f could not be found. Oct 18 15:31:35.027432 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9c35105d-6dfa-4b4a-b335-977c0ac078f2 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Request method failure captured: Oct 18 15:31:35.027432 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/dd3fd462-cb66-45c0-92a3-2f9aca2cb16f HTTP/1.1 Oct 18 15:31:35.027432 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:31:35.027432 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:31:35.027432 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:31:35.027432 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:31:35.027432 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:31:35.027432 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:31:35.027432 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:31:35.027432 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:31:35.027432 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsVPb3L3FP-98gtLv8YIMCLfGhe2cuyCUoKBkQOJf_VQrrdw3zjQkBJXdrz51U5RIPirvM4vBy0eEwDlKKADnhe_mWPayJHcQ6gOCTAUKl7bKbkNPv5luVRbp4n9QMAAUTtxVS9n4JhIyNIlSMcaFy8kvjpV-EFu6g7N-rErWpfgdCw Oct 18 15:31:35.027432 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:31:35.027432 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:31:35.027432 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:31:35.027432 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:31:35.027432 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:31:35.027432 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:31:35.027432 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: ee0a3f0c256544beb2df4f113da56137 Oct 18 15:31:35.027432 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ImagesTestJSON-180911091 Oct 18 15:31:35.027432 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:31:35.027432 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:31:35.029214 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:31:35.029214 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ImagesTestJSON-180911091 Oct 18 15:31:35.029214 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: ee0a3f0c256544beb2df4f113da56137 Oct 18 15:31:35.029214 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ImagesTestJSON-180911091 Oct 18 15:31:35.029214 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ImagesTestJSON-180911091-project Oct 18 15:31:35.029214 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:31:35.029214 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:31:35.029214 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: ed9cd936192c40efa9099edee445e90e Oct 18 15:31:35.029214 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ImagesTestJSON-180911091-project Oct 18 15:31:35.029214 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:31:35.029214 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance dd3fd462-cb66-45c0-92a3-2f9aca2cb16f could not be found. Oct 18 15:31:35.029214 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'dd3fd462-cb66-45c0-92a3-2f9aca2cb16f'} Oct 18 15:31:35.030146 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:31:35.030146 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:35.030146 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:31:35.030146 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:31:35.030146 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:31:35.030146 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:31:35.030146 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:31:35.030146 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:31:35.030146 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:31:35.030146 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:31:35.030146 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd3fd462-cb66-45c0-92a3-2f9aca2cb16f could not be found. Oct 18 15:31:35.030146 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:35.030146 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:35.030146 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:35.030146 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:35.030146 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:35.030146 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:35.030146 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:31:35.030146 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:31:35.030146 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:31:35.032264 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:31:35.032264 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:31:35.032264 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:31:35.032264 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:31:35.032264 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:31:35.032264 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:31:35.032264 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:31:35.032264 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd3fd462-cb66-45c0-92a3-2f9aca2cb16f could not be found. Oct 18 15:31:35.032264 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:35.032264 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:35.032264 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:35.032264 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:35.032264 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:35.032264 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:35.032264 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:31:35.032264 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:31:35.032264 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd3fd462-cb66-45c0-92a3-2f9aca2cb16f could not be found. Oct 18 15:31:35.032264 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:35.035109 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9c35105d-6dfa-4b4a-b335-977c0ac078f2 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Returning 404 to user: Instance dd3fd462-cb66-45c0-92a3-2f9aca2cb16f could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:31:35.035109 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9c35105d-6dfa-4b4a-b335-977c0ac078f2 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/dd3fd462-cb66-45c0-92a3-2f9aca2cb16f" status: 404 len: 111 microversion: 2.1 time: 0.043349 Oct 18 15:31:35.035109 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 912/1789] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:34 2022] GET /compute/v2.1/servers/dd3fd462-cb66-45c0-92a3-2f9aca2cb16f => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 15:31:35.038752 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-940ebda1-3479-4750-a74e-3ab15ff24a85 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d68dca0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:35.065655 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-940ebda1-3479-4750-a74e-3ab15ff24a85 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] HTTP exception thrown: Image not found. Oct 18 15:31:35.067659 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-940ebda1-3479-4750-a74e-3ab15ff24a85 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Request method failure captured: Oct 18 15:31:35.067659 n-d-853682-5 devstack@n-api.service[120405]: request: DELETE /compute/v2.1/images/4cacb5ef-8146-4f19-98d6-b6eb8e8d35e6 HTTP/1.1 Oct 18 15:31:35.067659 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:31:35.067659 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:31:35.067659 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:31:35.067659 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:31:35.067659 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:31:35.067659 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:31:35.067659 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:31:35.067659 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:31:35.067659 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsVPb3L3FP-98gtLv8YIMCLfGhe2cuyCUoKBkQOJf_VQrrdw3zjQkBJXdrz51U5RIPirvM4vBy0eEwDlKKADnhe_mWPayJHcQ6gOCTAUKl7bKbkNPv5luVRbp4n9QMAAUTtxVS9n4JhIyNIlSMcaFy8kvjpV-EFu6g7N-rErWpfgdCw Oct 18 15:31:35.067659 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:31:35.067659 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:31:35.067659 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:31:35.067659 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:31:35.067659 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:31:35.067659 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:31:35.067659 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: ee0a3f0c256544beb2df4f113da56137 Oct 18 15:31:35.067659 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ImagesTestJSON-180911091 Oct 18 15:31:35.067659 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:31:35.067659 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:31:35.069125 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:31:35.069125 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ImagesTestJSON-180911091 Oct 18 15:31:35.069125 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: ee0a3f0c256544beb2df4f113da56137 Oct 18 15:31:35.069125 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ImagesTestJSON-180911091 Oct 18 15:31:35.069125 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ImagesTestJSON-180911091-project Oct 18 15:31:35.069125 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:31:35.069125 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:31:35.069125 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: ed9cd936192c40efa9099edee445e90e Oct 18 15:31:35.069125 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ImagesTestJSON-180911091-project Oct 18 15:31:35.069125 n-d-853682-5 devstack@n-api.service[120405]: method: Oct 18 15:31:35.069125 n-d-853682-5 devstack@n-api.service[120405]: exception: Image not found. Oct 18 15:31:35.069125 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '4cacb5ef-8146-4f19-98d6-b6eb8e8d35e6'} Oct 18 15:31:35.069125 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:31:35.069125 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:35.070121 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 18 15:31:35.070121 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 18 15:31:35.070121 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 15:31:35.070121 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 15:31:35.070121 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 15:31:35.070121 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 15:31:35.070121 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 18 15:31:35.070121 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 18 15:31:35.070121 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 18 15:31:35.070121 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 18 15:31:35.070121 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 15:31:35.070121 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 15:31:35.070121 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 15:31:35.070121 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 15:31:35.070121 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 4cacb5ef-8146-4f19-98d6-b6eb8e8d35e6 to delete Oct 18 15:31:35.070121 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:35.070121 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:35.070121 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:35.070121 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:35.071358 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 18 15:31:35.071358 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 18 15:31:35.071358 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 18 15:31:35.071358 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 18 15:31:35.071358 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 18 15:31:35.071358 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 18 15:31:35.071358 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4cacb5ef-8146-4f19-98d6-b6eb8e8d35e6 could not be found. Oct 18 15:31:35.071358 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:35.071358 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:35.071358 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:35.071358 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:35.071358 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:35.071358 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:35.071358 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:31:35.071358 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:31:35.071358 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:31:35.071358 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:31:35.071358 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:31:35.071358 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:31:35.071358 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 18 15:31:35.072657 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 15:31:35.072657 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 15:31:35.072657 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:35.072657 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:35.072657 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:35.072657 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:35.072657 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:35.072657 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:35.072657 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:31:35.072657 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:31:35.072657 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 15:31:35.072657 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:35.075323 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-940ebda1-3479-4750-a74e-3ab15ff24a85 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Returning 404 to user: Image not found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:31:35.076685 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-940ebda1-3479-4750-a74e-3ab15ff24a85 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "DELETE /compute/v2.1/images/4cacb5ef-8146-4f19-98d6-b6eb8e8d35e6" status: 404 len: 62 microversion: 2.1 time: 0.042025 Oct 18 15:31:35.080672 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 913/1790] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:35 2022] DELETE /compute/v2.1/images/4cacb5ef-8146-4f19-98d6-b6eb8e8d35e6 => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 15:31:35.086194 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ace3e2f4-3cd0-423f-b804-2b40c9c0f7de tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:35.086931 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ace3e2f4-3cd0-423f-b804-2b40c9c0f7de tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: f07f6211-dd0e-4bdd-969c-fff2c3633dd0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:35.096761 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ace3e2f4-3cd0-423f-b804-2b40c9c0f7de tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:35.097490 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ace3e2f4-3cd0-423f-b804-2b40c9c0f7de tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:35.098252 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ace3e2f4-3cd0-423f-b804-2b40c9c0f7de tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:35.099170 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ace3e2f4-3cd0-423f-b804-2b40c9c0f7de tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:35.099815 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ace3e2f4-3cd0-423f-b804-2b40c9c0f7de tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:35.100541 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ace3e2f4-3cd0-423f-b804-2b40c9c0f7de tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:35.116204 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-ace3e2f4-3cd0-423f-b804-2b40c9c0f7de tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] HTTP exception thrown: Instance f07f6211-dd0e-4bdd-969c-fff2c3633dd0 could not be found. Oct 18 15:31:35.117901 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ace3e2f4-3cd0-423f-b804-2b40c9c0f7de tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Request method failure captured: Oct 18 15:31:35.117901 n-d-853682-5 devstack@n-api.service[120405]: request: DELETE /compute/v2.1/servers/f07f6211-dd0e-4bdd-969c-fff2c3633dd0 HTTP/1.1 Oct 18 15:31:35.117901 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:31:35.117901 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:31:35.117901 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:31:35.117901 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:31:35.117901 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:31:35.117901 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:31:35.117901 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:31:35.117901 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:31:35.117901 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsVPb3L3FP-98gtLv8YIMCLfGhe2cuyCUoKBkQOJf_VQrrdw3zjQkBJXdrz51U5RIPirvM4vBy0eEwDlKKADnhe_mWPayJHcQ6gOCTAUKl7bKbkNPv5luVRbp4n9QMAAUTtxVS9n4JhIyNIlSMcaFy8kvjpV-EFu6g7N-rErWpfgdCw Oct 18 15:31:35.117901 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:31:35.117901 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:31:35.117901 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:31:35.117901 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:31:35.117901 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:31:35.117901 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:31:35.117901 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: ee0a3f0c256544beb2df4f113da56137 Oct 18 15:31:35.117901 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ImagesTestJSON-180911091 Oct 18 15:31:35.117901 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:31:35.117901 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:31:35.119373 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:31:35.119373 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ImagesTestJSON-180911091 Oct 18 15:31:35.119373 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: ee0a3f0c256544beb2df4f113da56137 Oct 18 15:31:35.119373 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ImagesTestJSON-180911091 Oct 18 15:31:35.119373 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ImagesTestJSON-180911091-project Oct 18 15:31:35.119373 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:31:35.119373 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:31:35.119373 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: ed9cd936192c40efa9099edee445e90e Oct 18 15:31:35.119373 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ImagesTestJSON-180911091-project Oct 18 15:31:35.119373 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:31:35.119373 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance f07f6211-dd0e-4bdd-969c-fff2c3633dd0 could not be found. Oct 18 15:31:35.119373 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'f07f6211-dd0e-4bdd-969c-fff2c3633dd0'} Oct 18 15:31:35.120196 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:31:35.120196 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:35.120196 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:31:35.120196 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:31:35.120196 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:31:35.120196 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:31:35.120196 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:31:35.120196 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:31:35.120196 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:31:35.120196 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:31:35.120196 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f07f6211-dd0e-4bdd-969c-fff2c3633dd0 could not be found. Oct 18 15:31:35.120196 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:35.120196 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:35.120196 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:35.120196 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:35.120196 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:35.120196 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:35.120196 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:31:35.120196 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:31:35.120196 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:31:35.121582 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:31:35.121582 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 15:31:35.121582 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 15:31:35.121582 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 15:31:35.121582 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 15:31:35.121582 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:31:35.121582 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:31:35.121582 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:31:35.121582 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:31:35.121582 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f07f6211-dd0e-4bdd-969c-fff2c3633dd0 could not be found. Oct 18 15:31:35.121582 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:35.121582 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:35.121582 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:35.121582 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:35.121582 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:35.121582 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:35.121582 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:31:35.121582 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:31:35.121582 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f07f6211-dd0e-4bdd-969c-fff2c3633dd0 could not be found. Oct 18 15:31:35.121582 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:35.124307 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ace3e2f4-3cd0-423f-b804-2b40c9c0f7de tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Returning 404 to user: Instance f07f6211-dd0e-4bdd-969c-fff2c3633dd0 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:31:35.126427 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ace3e2f4-3cd0-423f-b804-2b40c9c0f7de tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f07f6211-dd0e-4bdd-969c-fff2c3633dd0" status: 404 len: 111 microversion: 2.1 time: 0.044462 Oct 18 15:31:35.130254 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 914/1791] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:31:35 2022] DELETE /compute/v2.1/servers/f07f6211-dd0e-4bdd-969c-fff2c3633dd0 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:31:35.135307 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c8fee5aa-5d23-4e29-9e4e-30ac69d6d618 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:35.136518 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c8fee5aa-5d23-4e29-9e4e-30ac69d6d618 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: f07f6211-dd0e-4bdd-969c-fff2c3633dd0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:35.143372 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c8fee5aa-5d23-4e29-9e4e-30ac69d6d618 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:35.144088 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c8fee5aa-5d23-4e29-9e4e-30ac69d6d618 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:35.145417 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c8fee5aa-5d23-4e29-9e4e-30ac69d6d618 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:35.146754 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c8fee5aa-5d23-4e29-9e4e-30ac69d6d618 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:35.147286 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c8fee5aa-5d23-4e29-9e4e-30ac69d6d618 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:35.147871 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c8fee5aa-5d23-4e29-9e4e-30ac69d6d618 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:35.169129 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-c8fee5aa-5d23-4e29-9e4e-30ac69d6d618 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] HTTP exception thrown: Instance f07f6211-dd0e-4bdd-969c-fff2c3633dd0 could not be found. Oct 18 15:31:35.171338 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c8fee5aa-5d23-4e29-9e4e-30ac69d6d618 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Request method failure captured: Oct 18 15:31:35.171338 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/f07f6211-dd0e-4bdd-969c-fff2c3633dd0 HTTP/1.1 Oct 18 15:31:35.171338 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:31:35.171338 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:31:35.171338 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:31:35.171338 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:31:35.171338 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:31:35.171338 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:31:35.171338 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:31:35.171338 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:31:35.171338 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsVPb3L3FP-98gtLv8YIMCLfGhe2cuyCUoKBkQOJf_VQrrdw3zjQkBJXdrz51U5RIPirvM4vBy0eEwDlKKADnhe_mWPayJHcQ6gOCTAUKl7bKbkNPv5luVRbp4n9QMAAUTtxVS9n4JhIyNIlSMcaFy8kvjpV-EFu6g7N-rErWpfgdCw Oct 18 15:31:35.171338 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:31:35.171338 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:31:35.171338 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:31:35.171338 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:31:35.171338 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:31:35.171338 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:31:35.171338 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: ee0a3f0c256544beb2df4f113da56137 Oct 18 15:31:35.171338 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ImagesTestJSON-180911091 Oct 18 15:31:35.171338 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:31:35.171338 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:31:35.173237 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:31:35.173237 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ImagesTestJSON-180911091 Oct 18 15:31:35.173237 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: ee0a3f0c256544beb2df4f113da56137 Oct 18 15:31:35.173237 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ImagesTestJSON-180911091 Oct 18 15:31:35.173237 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ImagesTestJSON-180911091-project Oct 18 15:31:35.173237 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:31:35.173237 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:31:35.173237 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: ed9cd936192c40efa9099edee445e90e Oct 18 15:31:35.173237 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ImagesTestJSON-180911091-project Oct 18 15:31:35.173237 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:31:35.173237 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance f07f6211-dd0e-4bdd-969c-fff2c3633dd0 could not be found. Oct 18 15:31:35.173237 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'f07f6211-dd0e-4bdd-969c-fff2c3633dd0'} Oct 18 15:31:35.174247 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:31:35.174247 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:35.174247 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:31:35.174247 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:31:35.174247 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:31:35.174247 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:31:35.174247 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:31:35.174247 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:31:35.174247 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:31:35.174247 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:31:35.174247 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f07f6211-dd0e-4bdd-969c-fff2c3633dd0 could not be found. Oct 18 15:31:35.174247 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:35.174247 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:35.174247 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:35.174247 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:35.174247 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:35.174247 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:35.174247 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:31:35.174247 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:31:35.174247 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:31:35.176156 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:31:35.176156 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:31:35.176156 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:31:35.176156 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:31:35.176156 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:31:35.176156 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:31:35.176156 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:31:35.176156 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f07f6211-dd0e-4bdd-969c-fff2c3633dd0 could not be found. Oct 18 15:31:35.176156 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:35.176156 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:35.176156 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:35.176156 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:35.176156 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:35.176156 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:35.176156 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:31:35.176156 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:31:35.176156 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f07f6211-dd0e-4bdd-969c-fff2c3633dd0 could not be found. Oct 18 15:31:35.176156 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:35.177417 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c8fee5aa-5d23-4e29-9e4e-30ac69d6d618 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Returning 404 to user: Instance f07f6211-dd0e-4bdd-969c-fff2c3633dd0 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:31:35.177417 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c8fee5aa-5d23-4e29-9e4e-30ac69d6d618 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/f07f6211-dd0e-4bdd-969c-fff2c3633dd0" status: 404 len: 111 microversion: 2.1 time: 0.042620 Oct 18 15:31:35.177417 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 915/1792] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:35 2022] GET /compute/v2.1/servers/f07f6211-dd0e-4bdd-969c-fff2c3633dd0 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:31:35.184969 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-47eeae94-b357-4476-9ca5-46e98fd48ca6 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '.version_select at 0x7f7c3d66f280>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:35.213337 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-47eeae94-b357-4476-9ca5-46e98fd48ca6 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] HTTP exception thrown: Image not found. Oct 18 15:31:35.216030 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-47eeae94-b357-4476-9ca5-46e98fd48ca6 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Request method failure captured: Oct 18 15:31:35.216030 n-d-853682-5 devstack@n-api.service[120405]: request: DELETE /compute/v2.1/images/ede050c6-ea2a-474d-a15a-ff210b86a2a8 HTTP/1.1 Oct 18 15:31:35.216030 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:31:35.216030 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:31:35.216030 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:31:35.216030 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:31:35.216030 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:31:35.216030 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:31:35.216030 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:31:35.216030 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:31:35.216030 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsVPb3L3FP-98gtLv8YIMCLfGhe2cuyCUoKBkQOJf_VQrrdw3zjQkBJXdrz51U5RIPirvM4vBy0eEwDlKKADnhe_mWPayJHcQ6gOCTAUKl7bKbkNPv5luVRbp4n9QMAAUTtxVS9n4JhIyNIlSMcaFy8kvjpV-EFu6g7N-rErWpfgdCw Oct 18 15:31:35.216030 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:31:35.216030 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:31:35.216030 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:31:35.216030 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:31:35.216030 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:31:35.216030 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:31:35.216030 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: ee0a3f0c256544beb2df4f113da56137 Oct 18 15:31:35.216030 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ImagesTestJSON-180911091 Oct 18 15:31:35.216030 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:31:35.216030 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:31:35.217737 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:31:35.217737 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ImagesTestJSON-180911091 Oct 18 15:31:35.217737 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: ee0a3f0c256544beb2df4f113da56137 Oct 18 15:31:35.217737 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ImagesTestJSON-180911091 Oct 18 15:31:35.217737 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ImagesTestJSON-180911091-project Oct 18 15:31:35.217737 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:31:35.217737 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:31:35.217737 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: ed9cd936192c40efa9099edee445e90e Oct 18 15:31:35.217737 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ImagesTestJSON-180911091-project Oct 18 15:31:35.217737 n-d-853682-5 devstack@n-api.service[120405]: method: Oct 18 15:31:35.217737 n-d-853682-5 devstack@n-api.service[120405]: exception: Image not found. Oct 18 15:31:35.217737 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'ede050c6-ea2a-474d-a15a-ff210b86a2a8'} Oct 18 15:31:35.217737 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:31:35.217737 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:35.221369 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 18 15:31:35.221369 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 18 15:31:35.221369 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 15:31:35.221369 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 15:31:35.221369 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 15:31:35.221369 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 15:31:35.221369 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 18 15:31:35.221369 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 18 15:31:35.221369 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 18 15:31:35.221369 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 18 15:31:35.221369 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 15:31:35.221369 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 15:31:35.221369 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 15:31:35.221369 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 15:31:35.221369 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ede050c6-ea2a-474d-a15a-ff210b86a2a8 to delete Oct 18 15:31:35.221369 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:35.221369 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:35.221369 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:35.221369 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:35.222767 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 18 15:31:35.222767 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 18 15:31:35.222767 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 18 15:31:35.222767 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 18 15:31:35.222767 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 18 15:31:35.222767 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 18 15:31:35.222767 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ede050c6-ea2a-474d-a15a-ff210b86a2a8 could not be found. Oct 18 15:31:35.222767 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:35.222767 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:35.222767 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:35.222767 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:35.222767 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:35.222767 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:35.222767 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:31:35.222767 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:31:35.222767 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:31:35.222767 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:31:35.222767 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:31:35.222767 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:31:35.222767 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 18 15:31:35.224331 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 15:31:35.224331 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 15:31:35.224331 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:35.224331 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:35.224331 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:35.224331 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:35.224331 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:35.224331 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:35.224331 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:31:35.224331 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:31:35.224331 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 15:31:35.224331 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:35.224331 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-47eeae94-b357-4476-9ca5-46e98fd48ca6 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Returning 404 to user: Image not found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:31:35.224331 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-47eeae94-b357-4476-9ca5-46e98fd48ca6 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "DELETE /compute/v2.1/images/ede050c6-ea2a-474d-a15a-ff210b86a2a8" status: 404 len: 62 microversion: 2.1 time: 0.038159 Oct 18 15:31:35.224331 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 916/1793] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:35 2022] DELETE /compute/v2.1/images/ede050c6-ea2a-474d-a15a-ff210b86a2a8 => generated 62 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 15:31:35.227341 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bab95aa9-6f6a-4921-8bb8-e49839b6c968 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:35.227849 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-bab95aa9-6f6a-4921-8bb8-e49839b6c968 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 51ccbde5-4cf5-4821-9478-c14e19e73ad1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:35.240177 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bab95aa9-6f6a-4921-8bb8-e49839b6c968 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:35.240674 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bab95aa9-6f6a-4921-8bb8-e49839b6c968 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:35.241321 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bab95aa9-6f6a-4921-8bb8-e49839b6c968 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:35.242036 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bab95aa9-6f6a-4921-8bb8-e49839b6c968 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:35.242688 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bab95aa9-6f6a-4921-8bb8-e49839b6c968 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:35.243125 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bab95aa9-6f6a-4921-8bb8-e49839b6c968 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:35.258677 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-bab95aa9-6f6a-4921-8bb8-e49839b6c968 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] HTTP exception thrown: Instance 51ccbde5-4cf5-4821-9478-c14e19e73ad1 could not be found. Oct 18 15:31:35.260615 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bab95aa9-6f6a-4921-8bb8-e49839b6c968 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Request method failure captured: Oct 18 15:31:35.260615 n-d-853682-5 devstack@n-api.service[120405]: request: DELETE /compute/v2.1/servers/51ccbde5-4cf5-4821-9478-c14e19e73ad1 HTTP/1.1 Oct 18 15:31:35.260615 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:31:35.260615 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:31:35.260615 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:31:35.260615 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:31:35.260615 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:31:35.260615 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:31:35.260615 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:31:35.260615 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:31:35.260615 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsVPb3L3FP-98gtLv8YIMCLfGhe2cuyCUoKBkQOJf_VQrrdw3zjQkBJXdrz51U5RIPirvM4vBy0eEwDlKKADnhe_mWPayJHcQ6gOCTAUKl7bKbkNPv5luVRbp4n9QMAAUTtxVS9n4JhIyNIlSMcaFy8kvjpV-EFu6g7N-rErWpfgdCw Oct 18 15:31:35.260615 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:31:35.260615 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:31:35.260615 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:31:35.260615 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:31:35.260615 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:31:35.260615 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:31:35.260615 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: ee0a3f0c256544beb2df4f113da56137 Oct 18 15:31:35.260615 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ImagesTestJSON-180911091 Oct 18 15:31:35.260615 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:31:35.260615 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:31:35.262688 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:31:35.262688 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ImagesTestJSON-180911091 Oct 18 15:31:35.262688 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: ee0a3f0c256544beb2df4f113da56137 Oct 18 15:31:35.262688 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ImagesTestJSON-180911091 Oct 18 15:31:35.262688 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ImagesTestJSON-180911091-project Oct 18 15:31:35.262688 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:31:35.262688 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:31:35.262688 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: ed9cd936192c40efa9099edee445e90e Oct 18 15:31:35.262688 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ImagesTestJSON-180911091-project Oct 18 15:31:35.262688 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:31:35.262688 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 51ccbde5-4cf5-4821-9478-c14e19e73ad1 could not be found. Oct 18 15:31:35.262688 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '51ccbde5-4cf5-4821-9478-c14e19e73ad1'} Oct 18 15:31:35.263632 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:31:35.263632 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:35.263632 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:31:35.263632 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:31:35.263632 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:31:35.263632 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:31:35.263632 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:31:35.263632 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:31:35.263632 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:31:35.263632 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:31:35.263632 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51ccbde5-4cf5-4821-9478-c14e19e73ad1 could not be found. Oct 18 15:31:35.263632 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:35.263632 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:35.263632 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:35.263632 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:35.263632 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:35.263632 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:35.263632 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:31:35.263632 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:31:35.263632 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:31:35.265989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:31:35.265989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 15:31:35.265989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 15:31:35.265989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 15:31:35.265989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 15:31:35.265989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:31:35.265989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:31:35.265989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:31:35.265989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:31:35.265989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51ccbde5-4cf5-4821-9478-c14e19e73ad1 could not be found. Oct 18 15:31:35.265989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:35.265989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:35.265989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:35.265989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:35.265989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:35.265989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:35.265989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:31:35.265989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:31:35.265989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51ccbde5-4cf5-4821-9478-c14e19e73ad1 could not be found. Oct 18 15:31:35.265989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:35.283231 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bab95aa9-6f6a-4921-8bb8-e49839b6c968 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Returning 404 to user: Instance 51ccbde5-4cf5-4821-9478-c14e19e73ad1 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:31:35.285839 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-bab95aa9-6f6a-4921-8bb8-e49839b6c968 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "DELETE /compute/v2.1/servers/51ccbde5-4cf5-4821-9478-c14e19e73ad1" status: 404 len: 111 microversion: 2.1 time: 0.062848 Oct 18 15:31:35.286968 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 917/1794] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:31:35 2022] DELETE /compute/v2.1/servers/51ccbde5-4cf5-4821-9478-c14e19e73ad1 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:31:35.294131 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c4adaa07-4ed5-4db1-89c5-9ad8d97a8282 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:35.294989 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c4adaa07-4ed5-4db1-89c5-9ad8d97a8282 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] [instance: d869973f-2d6e-4324-951e-1f26239a593e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:35.301448 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c4adaa07-4ed5-4db1-89c5-9ad8d97a8282 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:35.301936 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c4adaa07-4ed5-4db1-89c5-9ad8d97a8282 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:35.302371 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c4adaa07-4ed5-4db1-89c5-9ad8d97a8282 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:35.303077 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c4adaa07-4ed5-4db1-89c5-9ad8d97a8282 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:35.303535 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c4adaa07-4ed5-4db1-89c5-9ad8d97a8282 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:35.303962 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c4adaa07-4ed5-4db1-89c5-9ad8d97a8282 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:35.814555 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c4adaa07-4ed5-4db1-89c5-9ad8d97a8282 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2678c8aad39402c885b6f780fd33165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feee8ee03b8646998338de04f4cb80dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:35.831428 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c4adaa07-4ed5-4db1-89c5-9ad8d97a8282 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] 10.222.0.60 "GET /compute/v2.1/servers/d869973f-2d6e-4324-951e-1f26239a593e" status: 200 len: 1313 microversion: 2.1 time: 0.543036 Oct 18 15:31:35.833361 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 918/1795] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:35 2022] GET /compute/v2.1/servers/d869973f-2d6e-4324-951e-1f26239a593e => generated 1313 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:35.839758 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-443e7232-eda5-432c-abb8-8a1bd0c1fd75 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:35.850824 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-443e7232-eda5-432c-abb8-8a1bd0c1fd75 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] [instance: 51ccbde5-4cf5-4821-9478-c14e19e73ad1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:35.864245 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-443e7232-eda5-432c-abb8-8a1bd0c1fd75 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:35.865024 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-443e7232-eda5-432c-abb8-8a1bd0c1fd75 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:35.865993 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-443e7232-eda5-432c-abb8-8a1bd0c1fd75 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:35.869506 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-443e7232-eda5-432c-abb8-8a1bd0c1fd75 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:35.870181 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-443e7232-eda5-432c-abb8-8a1bd0c1fd75 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:35.870822 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-443e7232-eda5-432c-abb8-8a1bd0c1fd75 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:35.901207 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-443e7232-eda5-432c-abb8-8a1bd0c1fd75 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] HTTP exception thrown: Instance 51ccbde5-4cf5-4821-9478-c14e19e73ad1 could not be found. Oct 18 15:31:35.902841 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-443e7232-eda5-432c-abb8-8a1bd0c1fd75 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Request method failure captured: Oct 18 15:31:35.902841 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/51ccbde5-4cf5-4821-9478-c14e19e73ad1 HTTP/1.1 Oct 18 15:31:35.902841 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:31:35.902841 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:31:35.902841 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:31:35.902841 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:31:35.902841 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:31:35.902841 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:31:35.902841 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:31:35.902841 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:31:35.902841 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsVPb3L3FP-98gtLv8YIMCLfGhe2cuyCUoKBkQOJf_VQrrdw3zjQkBJXdrz51U5RIPirvM4vBy0eEwDlKKADnhe_mWPayJHcQ6gOCTAUKl7bKbkNPv5luVRbp4n9QMAAUTtxVS9n4JhIyNIlSMcaFy8kvjpV-EFu6g7N-rErWpfgdCw Oct 18 15:31:35.902841 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:31:35.902841 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:31:35.902841 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:31:35.902841 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:31:35.902841 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:31:35.902841 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:31:35.902841 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: ee0a3f0c256544beb2df4f113da56137 Oct 18 15:31:35.902841 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ImagesTestJSON-180911091 Oct 18 15:31:35.902841 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:31:35.902841 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:31:35.904338 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ee0a3f0c256544beb2df4f113da56137"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:31:35.904338 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ImagesTestJSON-180911091 Oct 18 15:31:35.904338 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: ee0a3f0c256544beb2df4f113da56137 Oct 18 15:31:35.904338 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ImagesTestJSON-180911091 Oct 18 15:31:35.904338 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ImagesTestJSON-180911091-project Oct 18 15:31:35.904338 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:31:35.904338 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:31:35.904338 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: ed9cd936192c40efa9099edee445e90e Oct 18 15:31:35.904338 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ImagesTestJSON-180911091-project Oct 18 15:31:35.904338 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:31:35.904338 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 51ccbde5-4cf5-4821-9478-c14e19e73ad1 could not be found. Oct 18 15:31:35.904338 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '51ccbde5-4cf5-4821-9478-c14e19e73ad1'} Oct 18 15:31:35.905182 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:31:35.905182 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:35.905182 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:31:35.905182 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:31:35.905182 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:31:35.905182 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:31:35.905182 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:31:35.905182 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:31:35.905182 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:31:35.905182 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:31:35.905182 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51ccbde5-4cf5-4821-9478-c14e19e73ad1 could not be found. Oct 18 15:31:35.905182 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:35.905182 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:35.905182 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:35.905182 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:35.905182 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:35.905182 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:35.905182 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:31:35.905182 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:31:35.905182 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:31:35.907949 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:31:35.907949 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:31:35.907949 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:31:35.907949 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:31:35.907949 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:31:35.907949 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:31:35.907949 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:31:35.907949 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51ccbde5-4cf5-4821-9478-c14e19e73ad1 could not be found. Oct 18 15:31:35.907949 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:35.907949 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:35.907949 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:35.907949 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:35.907949 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:35.907949 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:35.907949 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:31:35.907949 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:31:35.907949 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51ccbde5-4cf5-4821-9478-c14e19e73ad1 could not be found. Oct 18 15:31:35.907949 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:31:35.909639 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-443e7232-eda5-432c-abb8-8a1bd0c1fd75 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] Returning 404 to user: Instance 51ccbde5-4cf5-4821-9478-c14e19e73ad1 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:31:35.909639 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-443e7232-eda5-432c-abb8-8a1bd0c1fd75 tempest-ImagesTestJSON-180911091 tempest-ImagesTestJSON-180911091-project] 10.222.0.60 "GET /compute/v2.1/servers/51ccbde5-4cf5-4821-9478-c14e19e73ad1" status: 404 len: 111 microversion: 2.1 time: 0.068246 Oct 18 15:31:35.909639 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 919/1796] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:35 2022] GET /compute/v2.1/servers/51ccbde5-4cf5-4821-9478-c14e19e73ad1 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:31:35.930074 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1e823c55-05c0-4740-a397-2ed5287b6598 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:35.930695 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1e823c55-05c0-4740-a397-2ed5287b6598 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 0dfb045a-8cea-41b6-bbdc-8fa6600046d1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:35.955446 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1e823c55-05c0-4740-a397-2ed5287b6598 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:35.956238 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1e823c55-05c0-4740-a397-2ed5287b6598 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:35.956748 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1e823c55-05c0-4740-a397-2ed5287b6598 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:35.960675 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1e823c55-05c0-4740-a397-2ed5287b6598 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:35.961702 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1e823c55-05c0-4740-a397-2ed5287b6598 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:35.962274 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1e823c55-05c0-4740-a397-2ed5287b6598 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:36.138337 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1e823c55-05c0-4740-a397-2ed5287b6598 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:36.158508 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1e823c55-05c0-4740-a397-2ed5287b6598 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:36.159951 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1e823c55-05c0-4740-a397-2ed5287b6598 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:36.164940 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1e823c55-05c0-4740-a397-2ed5287b6598 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1" status: 200 len: 1250 microversion: 2.25 time: 0.259034 Oct 18 15:31:36.172454 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 920/1797] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:35 2022] GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1 => generated 1250 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:31:36.179332 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-56373fe5-a115-48c2-ba6b-ef334fe8e702 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:36.179966 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-56373fe5-a115-48c2-ba6b-ef334fe8e702 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] [instance: 234a024f-c13b-40de-bbcb-ffcdda611d01] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:36.200273 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-56373fe5-a115-48c2-ba6b-ef334fe8e702 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:36.200762 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-56373fe5-a115-48c2-ba6b-ef334fe8e702 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:36.201267 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-56373fe5-a115-48c2-ba6b-ef334fe8e702 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:36.201972 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-56373fe5-a115-48c2-ba6b-ef334fe8e702 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:36.205221 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-56373fe5-a115-48c2-ba6b-ef334fe8e702 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:36.211368 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-56373fe5-a115-48c2-ba6b-ef334fe8e702 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:36.317164 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-56373fe5-a115-48c2-ba6b-ef334fe8e702 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:36.330950 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-56373fe5-a115-48c2-ba6b-ef334fe8e702 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:36.333002 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-56373fe5-a115-48c2-ba6b-ef334fe8e702 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:36.349731 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-56373fe5-a115-48c2-ba6b-ef334fe8e702 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] 10.222.0.60 "GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01" status: 200 len: 1446 microversion: 2.75 time: 0.176062 Oct 18 15:31:36.351449 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 921/1798] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:36 2022] GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01 => generated 1446 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:31:36.362020 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c742c4df-aa8c-4413-a1f6-f8b88f132a61 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c3d10ec10>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:36.460090 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c742c4df-aa8c-4413-a1f6-f8b88f132a61 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/90e4a2d6-0135-42c3-bfb1-aa6439ca7be4" status: 200 len: 662 microversion: 2.1 time: 0.106396 Oct 18 15:31:36.476143 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 922/1799] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:31:36 2022] GET /compute/v2.1/images/90e4a2d6-0135-42c3-bfb1-aa6439ca7be4 => generated 662 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:31:36.494391 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-af1fb121-6054-4d1d-80c4-5982dc1d489c tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c3d703790>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:36.576141 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-af1fb121-6054-4d1d-80c4-5982dc1d489c tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/90e4a2d6-0135-42c3-bfb1-aa6439ca7be4" status: 200 len: 662 microversion: 2.1 time: 0.098330 Oct 18 15:31:36.576959 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 923/1800] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:31:36 2022] GET /compute/v2.1/images/90e4a2d6-0135-42c3-bfb1-aa6439ca7be4 => generated 662 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:31:36.757980 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d57e787b-9517-444d-8db9-c0ec5ae13434 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-151782563", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:31:36.873412 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-d57e787b-9517-444d-8db9-c0ec5ae13434 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] validate_networks() for None {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:31:37.947661 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-d57e787b-9517-444d-8db9-c0ec5ae13434 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:31:37.948288 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-d57e787b-9517-444d-8db9-c0ec5ae13434 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:31:37.948611 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-d57e787b-9517-444d-8db9-c0ec5ae13434 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:31:37.950304 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-d57e787b-9517-444d-8db9-c0ec5ae13434 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:31:37.950778 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-d57e787b-9517-444d-8db9-c0ec5ae13434 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:31:37.970644 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d57e787b-9517-444d-8db9-c0ec5ae13434 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:37.971145 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d57e787b-9517-444d-8db9-c0ec5ae13434 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:37.971582 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d57e787b-9517-444d-8db9-c0ec5ae13434 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:37.972446 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d57e787b-9517-444d-8db9-c0ec5ae13434 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:37.972932 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d57e787b-9517-444d-8db9-c0ec5ae13434 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:37.973363 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d57e787b-9517-444d-8db9-c0ec5ae13434 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:38.014407 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-d57e787b-9517-444d-8db9-c0ec5ae13434 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Getting quotas for project c369c078bd4c49148290abb7de3d076f. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:31:38.022046 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-d57e787b-9517-444d-8db9-c0ec5ae13434 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Getting quotas for user 79f901dea4594eb6831a78e2e603e8a0 and project c369c078bd4c49148290abb7de3d076f. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:31:38.038496 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d57e787b-9517-444d-8db9-c0ec5ae13434 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:31:38.041309 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d57e787b-9517-444d-8db9-c0ec5ae13434 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] [instance: 4e1ae723-8f58-4752-b578-da0b39e9a668] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:31:38.109974 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d57e787b-9517-444d-8db9-c0ec5ae13434 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.357647 Oct 18 15:31:38.112166 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 924/1801] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:31:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1361 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:31:38.122874 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-53f67f77-7861-4ea8-baea-057d119b30d5 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:38.127601 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-53f67f77-7861-4ea8-baea-057d119b30d5 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] [instance: d869973f-2d6e-4324-951e-1f26239a593e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:38.138809 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-53f67f77-7861-4ea8-baea-057d119b30d5 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:38.139590 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-53f67f77-7861-4ea8-baea-057d119b30d5 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:38.140316 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-53f67f77-7861-4ea8-baea-057d119b30d5 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:38.141323 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-53f67f77-7861-4ea8-baea-057d119b30d5 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:38.142181 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-53f67f77-7861-4ea8-baea-057d119b30d5 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:38.142895 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-53f67f77-7861-4ea8-baea-057d119b30d5 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:38.172250 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=100 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:31:38.758044 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-53f67f77-7861-4ea8-baea-057d119b30d5 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2678c8aad39402c885b6f780fd33165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feee8ee03b8646998338de04f4cb80dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:38.777290 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-53f67f77-7861-4ea8-baea-057d119b30d5 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] 10.222.0.60 "GET /compute/v2.1/servers/d869973f-2d6e-4324-951e-1f26239a593e" status: 200 len: 1462 microversion: 2.1 time: 0.662767 Oct 18 15:31:38.795606 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 925/1802] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:38 2022] GET /compute/v2.1/servers/d869973f-2d6e-4324-951e-1f26239a593e => generated 1462 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:38.808482 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-65584767-8222-4ac3-8a70-00b1d2785cae tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:38.809491 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-65584767-8222-4ac3-8a70-00b1d2785cae tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 0dfb045a-8cea-41b6-bbdc-8fa6600046d1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:38.816996 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-65584767-8222-4ac3-8a70-00b1d2785cae tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:38.817769 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-65584767-8222-4ac3-8a70-00b1d2785cae tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:38.818392 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-65584767-8222-4ac3-8a70-00b1d2785cae tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:38.819288 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-65584767-8222-4ac3-8a70-00b1d2785cae tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:38.819940 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-65584767-8222-4ac3-8a70-00b1d2785cae tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:38.820525 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-65584767-8222-4ac3-8a70-00b1d2785cae tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:38.889499 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-699dfda4-b204-42b8-9a6e-de6bf11aea3d tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e/action" status: 202 len: 0 microversion: 2.1 time: 4.032721 Oct 18 15:31:38.891431 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 878/1803] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:31:34 2022] POST /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e/action => generated 0 bytes in 4036 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:31:38.898136 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6810e4fb-7845-4ac2-b3e1-aaa9b7ca8572 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:38.899022 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6810e4fb-7845-4ac2-b3e1-aaa9b7ca8572 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] [instance: 234a024f-c13b-40de-bbcb-ffcdda611d01] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:38.907352 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6810e4fb-7845-4ac2-b3e1-aaa9b7ca8572 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:38.911239 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6810e4fb-7845-4ac2-b3e1-aaa9b7ca8572 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:38.911874 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6810e4fb-7845-4ac2-b3e1-aaa9b7ca8572 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:38.918081 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6810e4fb-7845-4ac2-b3e1-aaa9b7ca8572 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:38.919179 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6810e4fb-7845-4ac2-b3e1-aaa9b7ca8572 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:38.919835 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6810e4fb-7845-4ac2-b3e1-aaa9b7ca8572 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:39.129029 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6810e4fb-7845-4ac2-b3e1-aaa9b7ca8572 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:39.149462 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6810e4fb-7845-4ac2-b3e1-aaa9b7ca8572 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:39.152741 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6810e4fb-7845-4ac2-b3e1-aaa9b7ca8572 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:39.164969 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6810e4fb-7845-4ac2-b3e1-aaa9b7ca8572 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] 10.222.0.60 "GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01" status: 200 len: 1452 microversion: 2.75 time: 0.272086 Oct 18 15:31:39.167228 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-65584767-8222-4ac3-8a70-00b1d2785cae tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:39.168835 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 879/1804] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:38 2022] GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01 => generated 1452 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:31:39.180897 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-65584767-8222-4ac3-8a70-00b1d2785cae tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:39.182280 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0bf4fbee-26ce-4f7c-8097-9084d6b6db24 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1534174934", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:31:39.182638 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-65584767-8222-4ac3-8a70-00b1d2785cae tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:39.184344 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-65584767-8222-4ac3-8a70-00b1d2785cae tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1" status: 200 len: 1292 microversion: 2.25 time: 0.387522 Oct 18 15:31:39.188425 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 926/1805] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:38 2022] GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1 => generated 1292 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:31:39.306766 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-0bf4fbee-26ce-4f7c-8097-9084d6b6db24 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] validate_networks() for None {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:31:39.437313 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-181b7605-3a9f-429c-bf14-d5607444b39f tempest-TenantUsagesTestJSON-743641930 tempest-TenantUsagesTestJSON-743641930-project-admin] Calling method '.version_select at 0x7f7c3d76cca0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:39.456789 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-181b7605-3a9f-429c-bf14-d5607444b39f tempest-TenantUsagesTestJSON-743641930 tempest-TenantUsagesTestJSON-743641930-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:39.457864 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-181b7605-3a9f-429c-bf14-d5607444b39f tempest-TenantUsagesTestJSON-743641930 tempest-TenantUsagesTestJSON-743641930-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:39.459355 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-181b7605-3a9f-429c-bf14-d5607444b39f tempest-TenantUsagesTestJSON-743641930 tempest-TenantUsagesTestJSON-743641930-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:39.502404 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-181b7605-3a9f-429c-bf14-d5607444b39f tempest-TenantUsagesTestJSON-743641930 tempest-TenantUsagesTestJSON-743641930-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:39.502901 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-181b7605-3a9f-429c-bf14-d5607444b39f tempest-TenantUsagesTestJSON-743641930 tempest-TenantUsagesTestJSON-743641930-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:39.508280 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-181b7605-3a9f-429c-bf14-d5607444b39f tempest-TenantUsagesTestJSON-743641930 tempest-TenantUsagesTestJSON-743641930-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:39.557803 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-181b7605-3a9f-429c-bf14-d5607444b39f tempest-TenantUsagesTestJSON-743641930 tempest-TenantUsagesTestJSON-743641930-project-admin] 10.222.0.60 "GET /compute/v2.1/os-simple-tenant-usage/feee8ee03b8646998338de04f4cb80dc?start=2022-10-17T15%3A31%3A38.798727&end=2022-10-19T15%3A31%3A38.798727" status: 200 len: 694 microversion: 2.1 time: 0.366934 Oct 18 15:31:39.559670 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 927/1806] 10.222.0.60 () {58 vars in 1412 bytes} [Tue Oct 18 15:31:39 2022] GET /compute/v2.1/os-simple-tenant-usage/feee8ee03b8646998338de04f4cb80dc?start=2022-10-17T15%3A31%3A38.798727&end=2022-10-19T15%3A31%3A38.798727 => generated 694 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:31:39.581176 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3e1a5426-9d4b-48f1-82ad-5c8a923fb9a7 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:39.584653 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3e1a5426-9d4b-48f1-82ad-5c8a923fb9a7 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:39.604462 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3e1a5426-9d4b-48f1-82ad-5c8a923fb9a7 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:39.606431 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3e1a5426-9d4b-48f1-82ad-5c8a923fb9a7 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:39.609716 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3e1a5426-9d4b-48f1-82ad-5c8a923fb9a7 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:39.612620 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3e1a5426-9d4b-48f1-82ad-5c8a923fb9a7 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:39.614014 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3e1a5426-9d4b-48f1-82ad-5c8a923fb9a7 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:39.617088 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3e1a5426-9d4b-48f1-82ad-5c8a923fb9a7 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:39.755622 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-0bf4fbee-26ce-4f7c-8097-9084d6b6db24 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:31:39.756052 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-0bf4fbee-26ce-4f7c-8097-9084d6b6db24 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:31:39.756544 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-0bf4fbee-26ce-4f7c-8097-9084d6b6db24 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:31:39.757010 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-0bf4fbee-26ce-4f7c-8097-9084d6b6db24 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:31:39.757433 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-0bf4fbee-26ce-4f7c-8097-9084d6b6db24 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:31:39.773412 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0bf4fbee-26ce-4f7c-8097-9084d6b6db24 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:39.773911 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0bf4fbee-26ce-4f7c-8097-9084d6b6db24 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:39.776540 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0bf4fbee-26ce-4f7c-8097-9084d6b6db24 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:39.777358 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0bf4fbee-26ce-4f7c-8097-9084d6b6db24 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:39.777837 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0bf4fbee-26ce-4f7c-8097-9084d6b6db24 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:39.781813 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0bf4fbee-26ce-4f7c-8097-9084d6b6db24 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:39.824976 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-0bf4fbee-26ce-4f7c-8097-9084d6b6db24 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Getting quotas for project c369c078bd4c49148290abb7de3d076f. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:31:39.837664 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-0bf4fbee-26ce-4f7c-8097-9084d6b6db24 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Getting quotas for user 79f901dea4594eb6831a78e2e603e8a0 and project c369c078bd4c49148290abb7de3d076f. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:31:39.871799 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0bf4fbee-26ce-4f7c-8097-9084d6b6db24 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:31:39.876905 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0bf4fbee-26ce-4f7c-8097-9084d6b6db24 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] [instance: 0d0c7fc6-9245-41f3-9257-d2b8955a6d4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:31:40.011815 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0bf4fbee-26ce-4f7c-8097-9084d6b6db24 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.830428 Oct 18 15:31:40.014589 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 880/1807] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:31:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:31:40.054729 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dcfd8c5c-1492-468b-81d3-e2be501d9547 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Calling method '.version_select at 0x7f7c3cf5eaf0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:40.061001 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:31:40.079145 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dcfd8c5c-1492-468b-81d3-e2be501d9547 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:40.080694 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dcfd8c5c-1492-468b-81d3-e2be501d9547 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:40.083886 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dcfd8c5c-1492-468b-81d3-e2be501d9547 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:40.139048 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dcfd8c5c-1492-468b-81d3-e2be501d9547 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:40.139533 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dcfd8c5c-1492-468b-81d3-e2be501d9547 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:40.148314 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dcfd8c5c-1492-468b-81d3-e2be501d9547 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:40.222829 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dcfd8c5c-1492-468b-81d3-e2be501d9547 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] 10.222.0.60 "GET /compute/v2.1/os-simple-tenant-usage/feee8ee03b8646998338de04f4cb80dc?start=2022-10-17T15%3A31%3A38.798727&end=2022-10-19T15%3A31%3A38.798727" status: 200 len: 690 microversion: 2.1 time: 0.201946 Oct 18 15:31:40.224318 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 881/1808] 10.222.0.60 () {58 vars in 1412 bytes} [Tue Oct 18 15:31:40 2022] GET /compute/v2.1/os-simple-tenant-usage/feee8ee03b8646998338de04f4cb80dc?start=2022-10-17T15%3A31%3A38.798727&end=2022-10-19T15%3A31%3A38.798727 => generated 690 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:31:40.250691 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6b4d47de-e3a6-438a-988d-4d0509df4e59 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:40.251700 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6b4d47de-e3a6-438a-988d-4d0509df4e59 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] [instance: 0d0c7fc6-9245-41f3-9257-d2b8955a6d4d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:40.257937 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3e1a5426-9d4b-48f1-82ad-5c8a923fb9a7 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:40.273999 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3e1a5426-9d4b-48f1-82ad-5c8a923fb9a7 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e" status: 200 len: 1391 microversion: 2.1 time: 0.710932 Oct 18 15:31:40.276106 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 928/1809] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:39 2022] GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e => generated 1391 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:40.285414 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-966a8d23-0f52-4227-b14d-244195458239 req-cf54ff35-5e5c-4eef-a884-dd378e3526de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dfb045a-8cea-41b6-bbdc-8fa6600046d1", "tag": "8b71a6b8-e604-4cd4-9224-71a40ab44fd3"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:31:40.313204 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-966a8d23-0f52-4227-b14d-244195458239 req-cf54ff35-5e5c-4eef-a884-dd378e3526de service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:40.313679 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-966a8d23-0f52-4227-b14d-244195458239 req-cf54ff35-5e5c-4eef-a884-dd378e3526de service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:40.314099 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-966a8d23-0f52-4227-b14d-244195458239 req-cf54ff35-5e5c-4eef-a884-dd378e3526de service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:40.351862 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-966a8d23-0f52-4227-b14d-244195458239 req-cf54ff35-5e5c-4eef-a884-dd378e3526de service nova] Creating event network-changed:8b71a6b8-e604-4cd4-9224-71a40ab44fd3 for instance 0dfb045a-8cea-41b6-bbdc-8fa6600046d1 on n-h2-853682-5 Oct 18 15:31:40.365939 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-966a8d23-0f52-4227-b14d-244195458239 req-cf54ff35-5e5c-4eef-a884-dd378e3526de service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084350 Oct 18 15:31:40.369208 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 929/1810] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:31:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:31:40.377462 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-cde3f624-4e55-4e31-b3be-0e844a811c7d tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:40.378378 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-cde3f624-4e55-4e31-b3be-0e844a811c7d tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] [instance: 234a024f-c13b-40de-bbcb-ffcdda611d01] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:40.385953 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cde3f624-4e55-4e31-b3be-0e844a811c7d tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:40.387647 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cde3f624-4e55-4e31-b3be-0e844a811c7d tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:40.388271 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cde3f624-4e55-4e31-b3be-0e844a811c7d tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:40.389200 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cde3f624-4e55-4e31-b3be-0e844a811c7d tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:40.389814 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cde3f624-4e55-4e31-b3be-0e844a811c7d tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:40.390749 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cde3f624-4e55-4e31-b3be-0e844a811c7d tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:40.391455 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6b4d47de-e3a6-438a-988d-4d0509df4e59 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f901dea4594eb6831a78e2e603e8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c369c078bd4c49148290abb7de3d076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:40.399221 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6b4d47de-e3a6-438a-988d-4d0509df4e59 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/servers/0d0c7fc6-9245-41f3-9257-d2b8955a6d4d" status: 200 len: 1218 microversion: 2.1 time: 0.158809 Oct 18 15:31:40.402480 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 882/1811] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:40 2022] GET /compute/v2.1/servers/0d0c7fc6-9245-41f3-9257-d2b8955a6d4d => generated 1218 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:40.412680 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9d4c8b22-efe0-4993-8c38-668484576b6b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:40.415661 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9d4c8b22-efe0-4993-8c38-668484576b6b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 0dfb045a-8cea-41b6-bbdc-8fa6600046d1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:40.431017 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d4c8b22-efe0-4993-8c38-668484576b6b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:40.432290 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d4c8b22-efe0-4993-8c38-668484576b6b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:40.433506 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d4c8b22-efe0-4993-8c38-668484576b6b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:40.436377 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d4c8b22-efe0-4993-8c38-668484576b6b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:40.438593 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d4c8b22-efe0-4993-8c38-668484576b6b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:40.441459 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d4c8b22-efe0-4993-8c38-668484576b6b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:40.574581 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-cde3f624-4e55-4e31-b3be-0e844a811c7d tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:40.588981 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-cde3f624-4e55-4e31-b3be-0e844a811c7d tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:40.594786 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-cde3f624-4e55-4e31-b3be-0e844a811c7d tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:40.610942 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-cde3f624-4e55-4e31-b3be-0e844a811c7d tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] 10.222.0.60 "GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01" status: 200 len: 1452 microversion: 2.75 time: 0.239321 Oct 18 15:31:40.612926 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 930/1812] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:40 2022] GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01 => generated 1452 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:31:40.638714 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b69f4bc9-d3d1-40c6-a970-7c88e3e32954 tempest-TenantUsagesTestJSON-743641930 tempest-TenantUsagesTestJSON-743641930-project-admin] Calling method '.version_select at 0x7f7c3d10eca0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:40.677209 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b69f4bc9-d3d1-40c6-a970-7c88e3e32954 tempest-TenantUsagesTestJSON-743641930 tempest-TenantUsagesTestJSON-743641930-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:40.678049 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b69f4bc9-d3d1-40c6-a970-7c88e3e32954 tempest-TenantUsagesTestJSON-743641930 tempest-TenantUsagesTestJSON-743641930-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:40.679635 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b69f4bc9-d3d1-40c6-a970-7c88e3e32954 tempest-TenantUsagesTestJSON-743641930 tempest-TenantUsagesTestJSON-743641930-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:40.723892 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b69f4bc9-d3d1-40c6-a970-7c88e3e32954 tempest-TenantUsagesTestJSON-743641930 tempest-TenantUsagesTestJSON-743641930-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:40.724730 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b69f4bc9-d3d1-40c6-a970-7c88e3e32954 tempest-TenantUsagesTestJSON-743641930 tempest-TenantUsagesTestJSON-743641930-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:40.726688 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b69f4bc9-d3d1-40c6-a970-7c88e3e32954 tempest-TenantUsagesTestJSON-743641930 tempest-TenantUsagesTestJSON-743641930-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:40.793575 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9d4c8b22-efe0-4993-8c38-668484576b6b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:40.803531 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9d4c8b22-efe0-4993-8c38-668484576b6b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:40.805014 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9d4c8b22-efe0-4993-8c38-668484576b6b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:40.821148 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9d4c8b22-efe0-4993-8c38-668484576b6b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1" status: 200 len: 1292 microversion: 2.25 time: 0.402567 Oct 18 15:31:40.822041 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 883/1813] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:40 2022] GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1 => generated 1292 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:31:40.957295 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b69f4bc9-d3d1-40c6-a970-7c88e3e32954 tempest-TenantUsagesTestJSON-743641930 tempest-TenantUsagesTestJSON-743641930-project-admin] 10.222.0.60 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-17T15%3A31%3A38.798727&end=2022-10-19T15%3A31%3A38.798727&detailed=1" status: 200 len: 18900 microversion: 2.1 time: 0.341556 Oct 18 15:31:40.960744 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 931/1814] 10.222.0.60 () {58 vars in 1335 bytes} [Tue Oct 18 15:31:40 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-17T15%3A31%3A38.798727&end=2022-10-19T15%3A31%3A38.798727&detailed=1 => generated 18900 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:31:41.005979 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-981dc00e-e905-4f61-a13b-1981ee9ef719 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:41.006493 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-981dc00e-e905-4f61-a13b-1981ee9ef719 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] [instance: d869973f-2d6e-4324-951e-1f26239a593e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:41.019017 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-981dc00e-e905-4f61-a13b-1981ee9ef719 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:41.019825 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-981dc00e-e905-4f61-a13b-1981ee9ef719 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:41.020088 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-981dc00e-e905-4f61-a13b-1981ee9ef719 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:41.024441 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-981dc00e-e905-4f61-a13b-1981ee9ef719 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:41.027005 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-981dc00e-e905-4f61-a13b-1981ee9ef719 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:41.027470 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-981dc00e-e905-4f61-a13b-1981ee9ef719 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:41.102735 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-981dc00e-e905-4f61-a13b-1981ee9ef719 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] [instance: d869973f-2d6e-4324-951e-1f26239a593e] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:31:41.270886 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-981dc00e-e905-4f61-a13b-1981ee9ef719 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d869973f-2d6e-4324-951e-1f26239a593e" status: 204 len: 0 microversion: 2.1 time: 0.271035 Oct 18 15:31:41.283305 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 884/1815] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:31:40 2022] DELETE /compute/v2.1/servers/d869973f-2d6e-4324-951e-1f26239a593e => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:31:41.286097 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-73659a3b-039d-4fe3-8746-21fa8ce5fa30 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:41.286736 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-73659a3b-039d-4fe3-8746-21fa8ce5fa30 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] [instance: d869973f-2d6e-4324-951e-1f26239a593e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:41.300465 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5d6906e1-aa9a-457a-8267-9745fb86acdd tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:41.301194 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5d6906e1-aa9a-457a-8267-9745fb86acdd tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:41.306708 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-73659a3b-039d-4fe3-8746-21fa8ce5fa30 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:41.307193 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-73659a3b-039d-4fe3-8746-21fa8ce5fa30 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:41.307619 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-73659a3b-039d-4fe3-8746-21fa8ce5fa30 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:41.308322 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-73659a3b-039d-4fe3-8746-21fa8ce5fa30 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:41.314392 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-73659a3b-039d-4fe3-8746-21fa8ce5fa30 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:41.314885 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-73659a3b-039d-4fe3-8746-21fa8ce5fa30 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:41.317205 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d6906e1-aa9a-457a-8267-9745fb86acdd tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:41.318520 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d6906e1-aa9a-457a-8267-9745fb86acdd tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:41.319747 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d6906e1-aa9a-457a-8267-9745fb86acdd tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:41.321140 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d6906e1-aa9a-457a-8267-9745fb86acdd tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:41.323845 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d6906e1-aa9a-457a-8267-9745fb86acdd tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:41.325111 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d6906e1-aa9a-457a-8267-9745fb86acdd tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:41.760697 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5d6906e1-aa9a-457a-8267-9745fb86acdd tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:41.775383 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5d6906e1-aa9a-457a-8267-9745fb86acdd tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e" status: 200 len: 1391 microversion: 2.1 time: 0.479831 Oct 18 15:31:41.779876 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 885/1816] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:41 2022] GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e => generated 1391 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:41.791750 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-60c3139f-0106-47c0-b611-1108a01d3603 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:41.794016 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-60c3139f-0106-47c0-b611-1108a01d3603 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] [instance: 0d0c7fc6-9245-41f3-9257-d2b8955a6d4d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:41.818320 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60c3139f-0106-47c0-b611-1108a01d3603 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:41.821525 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60c3139f-0106-47c0-b611-1108a01d3603 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:41.822150 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60c3139f-0106-47c0-b611-1108a01d3603 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:41.823020 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60c3139f-0106-47c0-b611-1108a01d3603 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:41.825179 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60c3139f-0106-47c0-b611-1108a01d3603 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:41.828379 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60c3139f-0106-47c0-b611-1108a01d3603 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:41.898170 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-73659a3b-039d-4fe3-8746-21fa8ce5fa30 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2678c8aad39402c885b6f780fd33165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feee8ee03b8646998338de04f4cb80dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:41.906985 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-73659a3b-039d-4fe3-8746-21fa8ce5fa30 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] 10.222.0.60 "GET /compute/v2.1/servers/d869973f-2d6e-4324-951e-1f26239a593e" status: 200 len: 1468 microversion: 2.1 time: 0.629160 Oct 18 15:31:41.907571 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 932/1817] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:41 2022] GET /compute/v2.1/servers/d869973f-2d6e-4324-951e-1f26239a593e => generated 1468 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:41.930971 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-db35db0b-1de4-4985-8886-b1046002fde9 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:41.939908 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-db35db0b-1de4-4985-8886-b1046002fde9 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] [instance: 234a024f-c13b-40de-bbcb-ffcdda611d01] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:41.944068 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:31:41.963848 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-db35db0b-1de4-4985-8886-b1046002fde9 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:41.964350 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-db35db0b-1de4-4985-8886-b1046002fde9 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:41.964792 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-db35db0b-1de4-4985-8886-b1046002fde9 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:41.965541 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-db35db0b-1de4-4985-8886-b1046002fde9 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:41.965993 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-db35db0b-1de4-4985-8886-b1046002fde9 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:41.966407 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-db35db0b-1de4-4985-8886-b1046002fde9 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:42.017363 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-60c3139f-0106-47c0-b611-1108a01d3603 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f901dea4594eb6831a78e2e603e8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c369c078bd4c49148290abb7de3d076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:42.029289 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-60c3139f-0106-47c0-b611-1108a01d3603 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/servers/0d0c7fc6-9245-41f3-9257-d2b8955a6d4d" status: 200 len: 1214 microversion: 2.1 time: 0.247453 Oct 18 15:31:42.032326 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 886/1818] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:41 2022] GET /compute/v2.1/servers/0d0c7fc6-9245-41f3-9257-d2b8955a6d4d => generated 1214 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:42.039397 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cbbafd7c-27a9-44db-90b3-5a350f2daec0 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:42.040323 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cbbafd7c-27a9-44db-90b3-5a350f2daec0 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 0dfb045a-8cea-41b6-bbdc-8fa6600046d1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:42.059289 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbbafd7c-27a9-44db-90b3-5a350f2daec0 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:42.060189 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbbafd7c-27a9-44db-90b3-5a350f2daec0 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:42.063557 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbbafd7c-27a9-44db-90b3-5a350f2daec0 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:42.066184 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbbafd7c-27a9-44db-90b3-5a350f2daec0 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:42.067894 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbbafd7c-27a9-44db-90b3-5a350f2daec0 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:42.068776 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbbafd7c-27a9-44db-90b3-5a350f2daec0 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:42.182738 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-db35db0b-1de4-4985-8886-b1046002fde9 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:42.192438 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-db35db0b-1de4-4985-8886-b1046002fde9 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:42.193931 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-db35db0b-1de4-4985-8886-b1046002fde9 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:42.210575 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-db35db0b-1de4-4985-8886-b1046002fde9 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] 10.222.0.60 "GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01" status: 200 len: 1437 microversion: 2.75 time: 0.287662 Oct 18 15:31:42.211491 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 933/1819] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:41 2022] GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01 => generated 1437 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:31:42.407628 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c386ae35-363d-4c81-a905-38374c9ea53f tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:31:42.411831 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c386ae35-363d-4c81-a905-38374c9ea53f tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] [instance: 234a024f-c13b-40de-bbcb-ffcdda611d01] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:42.418922 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c386ae35-363d-4c81-a905-38374c9ea53f tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:42.419958 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c386ae35-363d-4c81-a905-38374c9ea53f tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:42.420715 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c386ae35-363d-4c81-a905-38374c9ea53f tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:42.421649 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c386ae35-363d-4c81-a905-38374c9ea53f tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:42.422277 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c386ae35-363d-4c81-a905-38374c9ea53f tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:42.423694 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c386ae35-363d-4c81-a905-38374c9ea53f tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:42.550677 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-c386ae35-363d-4c81-a905-38374c9ea53f tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:31:42.551210 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-c386ae35-363d-4c81-a905-38374c9ea53f tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:31:42.551769 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-c386ae35-363d-4c81-a905-38374c9ea53f tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:31:42.552258 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-c386ae35-363d-4c81-a905-38374c9ea53f tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:31:42.552772 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-c386ae35-363d-4c81-a905-38374c9ea53f tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:31:42.600067 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cbbafd7c-27a9-44db-90b3-5a350f2daec0 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:42.614390 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cbbafd7c-27a9-44db-90b3-5a350f2daec0 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:42.619748 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cbbafd7c-27a9-44db-90b3-5a350f2daec0 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:42.628036 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cbbafd7c-27a9-44db-90b3-5a350f2daec0 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1" status: 200 len: 1292 microversion: 2.25 time: 0.591788 Oct 18 15:31:42.631840 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 887/1820] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:42 2022] GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1 => generated 1292 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:31:42.763873 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c386ae35-363d-4c81-a905-38374c9ea53f tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] [instance: 234a024f-c13b-40de-bbcb-ffcdda611d01] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:42.783219 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c386ae35-363d-4c81-a905-38374c9ea53f tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:42.785861 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c386ae35-363d-4c81-a905-38374c9ea53f tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:42.786344 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c386ae35-363d-4c81-a905-38374c9ea53f tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:42.787100 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c386ae35-363d-4c81-a905-38374c9ea53f tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:42.787897 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c386ae35-363d-4c81-a905-38374c9ea53f tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:42.788264 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c386ae35-363d-4c81-a905-38374c9ea53f tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:42.798133 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3181a3eb-1e83-4946-a3bb-39914e4290cd tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:42.798755 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3181a3eb-1e83-4946-a3bb-39914e4290cd tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:42.810552 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3181a3eb-1e83-4946-a3bb-39914e4290cd tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:42.830164 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3181a3eb-1e83-4946-a3bb-39914e4290cd tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:42.830626 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3181a3eb-1e83-4946-a3bb-39914e4290cd tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:42.835254 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3181a3eb-1e83-4946-a3bb-39914e4290cd tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:42.837177 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3181a3eb-1e83-4946-a3bb-39914e4290cd tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:42.837638 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3181a3eb-1e83-4946-a3bb-39914e4290cd tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:43.167534 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-c386ae35-363d-4c81-a905-38374c9ea53f tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lazy-loading 'services' on Instance uuid 234a024f-c13b-40de-bbcb-ffcdda611d01 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:31:43.226655 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c386ae35-363d-4c81-a905-38374c9ea53f tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01/action" status: 202 len: 1940 microversion: 2.75 time: 0.981755 Oct 18 15:31:43.228196 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 934/1821] 10.222.0.60 () {62 vars in 1319 bytes} [Tue Oct 18 15:31:42 2022] POST /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01/action => generated 1940 bytes in 987 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 18 15:31:43.244167 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-37030e43-9883-45a7-b7a4-9563b5809f1f tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:43.250261 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-37030e43-9883-45a7-b7a4-9563b5809f1f tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] [instance: d869973f-2d6e-4324-951e-1f26239a593e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:43.280731 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37030e43-9883-45a7-b7a4-9563b5809f1f tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:43.280731 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37030e43-9883-45a7-b7a4-9563b5809f1f tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:43.285631 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37030e43-9883-45a7-b7a4-9563b5809f1f tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:43.286739 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37030e43-9883-45a7-b7a4-9563b5809f1f tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:43.291795 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37030e43-9883-45a7-b7a4-9563b5809f1f tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:43.292616 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37030e43-9883-45a7-b7a4-9563b5809f1f tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:43.903468 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3181a3eb-1e83-4946-a3bb-39914e4290cd tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:43.921775 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3181a3eb-1e83-4946-a3bb-39914e4290cd tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e" status: 200 len: 1391 microversion: 2.1 time: 1.127390 Oct 18 15:31:43.924075 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 888/1822] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:42 2022] GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e => generated 1391 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:31:43.932625 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fdd8f78a-c6ad-4fbe-8a4d-5f801ef63a09 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:43.933279 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fdd8f78a-c6ad-4fbe-8a4d-5f801ef63a09 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] [instance: 0d0c7fc6-9245-41f3-9257-d2b8955a6d4d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:43.957659 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fdd8f78a-c6ad-4fbe-8a4d-5f801ef63a09 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:43.958204 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fdd8f78a-c6ad-4fbe-8a4d-5f801ef63a09 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:43.958576 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fdd8f78a-c6ad-4fbe-8a4d-5f801ef63a09 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:43.959289 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fdd8f78a-c6ad-4fbe-8a4d-5f801ef63a09 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:43.959742 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fdd8f78a-c6ad-4fbe-8a4d-5f801ef63a09 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:43.960178 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fdd8f78a-c6ad-4fbe-8a4d-5f801ef63a09 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:44.007067 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-37030e43-9883-45a7-b7a4-9563b5809f1f tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2678c8aad39402c885b6f780fd33165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feee8ee03b8646998338de04f4cb80dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:44.018822 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-37030e43-9883-45a7-b7a4-9563b5809f1f tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] 10.222.0.60 "GET /compute/v2.1/servers/d869973f-2d6e-4324-951e-1f26239a593e" status: 200 len: 1468 microversion: 2.1 time: 0.789369 Oct 18 15:31:44.025332 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 935/1823] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:43 2022] GET /compute/v2.1/servers/d869973f-2d6e-4324-951e-1f26239a593e => generated 1468 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:44.033744 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-af3d4dd5-1523-4d1e-bfdd-bc65869d4b6c tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:44.034372 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-af3d4dd5-1523-4d1e-bfdd-bc65869d4b6c tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] [instance: 234a024f-c13b-40de-bbcb-ffcdda611d01] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:44.052628 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-af3d4dd5-1523-4d1e-bfdd-bc65869d4b6c tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:44.058394 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-af3d4dd5-1523-4d1e-bfdd-bc65869d4b6c tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:44.059304 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-af3d4dd5-1523-4d1e-bfdd-bc65869d4b6c tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:44.059534 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-af3d4dd5-1523-4d1e-bfdd-bc65869d4b6c tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:44.065328 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-af3d4dd5-1523-4d1e-bfdd-bc65869d4b6c tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:44.066380 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-af3d4dd5-1523-4d1e-bfdd-bc65869d4b6c tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:44.352686 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fdd8f78a-c6ad-4fbe-8a4d-5f801ef63a09 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f901dea4594eb6831a78e2e603e8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c369c078bd4c49148290abb7de3d076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:44.399518 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fdd8f78a-c6ad-4fbe-8a4d-5f801ef63a09 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/servers/0d0c7fc6-9245-41f3-9257-d2b8955a6d4d" status: 200 len: 1270 microversion: 2.1 time: 0.474043 Oct 18 15:31:44.430428 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 889/1824] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:43 2022] GET /compute/v2.1/servers/0d0c7fc6-9245-41f3-9257-d2b8955a6d4d => generated 1270 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:44.453395 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f0caa6d7-1669-4f79-9992-80eb28a8c65a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:44.457364 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f0caa6d7-1669-4f79-9992-80eb28a8c65a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 0dfb045a-8cea-41b6-bbdc-8fa6600046d1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:44.487815 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f0caa6d7-1669-4f79-9992-80eb28a8c65a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:44.492397 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f0caa6d7-1669-4f79-9992-80eb28a8c65a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:44.493202 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f0caa6d7-1669-4f79-9992-80eb28a8c65a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:44.498181 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f0caa6d7-1669-4f79-9992-80eb28a8c65a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:44.500940 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f0caa6d7-1669-4f79-9992-80eb28a8c65a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:44.503958 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f0caa6d7-1669-4f79-9992-80eb28a8c65a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:44.576307 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-af3d4dd5-1523-4d1e-bfdd-bc65869d4b6c tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lazy-loading 'services' on Instance uuid 234a024f-c13b-40de-bbcb-ffcdda611d01 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:31:44.654355 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-af3d4dd5-1523-4d1e-bfdd-bc65869d4b6c tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01" status: 200 len: 1927 microversion: 2.75 time: 0.627382 Oct 18 15:31:44.677574 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 936/1825] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:44 2022] GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01 => generated 1927 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:31:44.968958 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a5d722a2-9d40-4ca6-922a-beacde2f969c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:44.970571 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a5d722a2-9d40-4ca6-922a-beacde2f969c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:45.016962 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a5d722a2-9d40-4ca6-922a-beacde2f969c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:45.020019 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a5d722a2-9d40-4ca6-922a-beacde2f969c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:45.021991 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a5d722a2-9d40-4ca6-922a-beacde2f969c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:45.025301 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a5d722a2-9d40-4ca6-922a-beacde2f969c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:45.025905 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f0caa6d7-1669-4f79-9992-80eb28a8c65a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:45.027143 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a5d722a2-9d40-4ca6-922a-beacde2f969c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:45.028896 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a5d722a2-9d40-4ca6-922a-beacde2f969c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:45.070992 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f0caa6d7-1669-4f79-9992-80eb28a8c65a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:45.078160 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f0caa6d7-1669-4f79-9992-80eb28a8c65a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:45.082288 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f0caa6d7-1669-4f79-9992-80eb28a8c65a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1" status: 200 len: 1292 microversion: 2.25 time: 0.646523 Oct 18 15:31:45.085741 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 890/1826] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:44 2022] GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1 => generated 1292 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:31:45.101120 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f4066f20-aa6e-434c-b3ea-2f4f99761307 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:45.103710 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f4066f20-aa6e-434c-b3ea-2f4f99761307 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] [instance: d869973f-2d6e-4324-951e-1f26239a593e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:45.118201 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4066f20-aa6e-434c-b3ea-2f4f99761307 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:45.118698 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4066f20-aa6e-434c-b3ea-2f4f99761307 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:45.121447 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4066f20-aa6e-434c-b3ea-2f4f99761307 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:45.122250 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4066f20-aa6e-434c-b3ea-2f4f99761307 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:45.122729 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4066f20-aa6e-434c-b3ea-2f4f99761307 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:45.125319 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4066f20-aa6e-434c-b3ea-2f4f99761307 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:45.512614 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f4066f20-aa6e-434c-b3ea-2f4f99761307 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2678c8aad39402c885b6f780fd33165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feee8ee03b8646998338de04f4cb80dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:45.526189 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f4066f20-aa6e-434c-b3ea-2f4f99761307 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] 10.222.0.60 "GET /compute/v2.1/servers/d869973f-2d6e-4324-951e-1f26239a593e" status: 200 len: 1468 microversion: 2.1 time: 0.438921 Oct 18 15:31:45.527046 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 891/1827] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:45 2022] GET /compute/v2.1/servers/d869973f-2d6e-4324-951e-1f26239a593e => generated 1468 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:45.542832 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3770d0aa-a40a-4ca7-b202-c5a0440f2386 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:45.543726 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3770d0aa-a40a-4ca7-b202-c5a0440f2386 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] [instance: 0d0c7fc6-9245-41f3-9257-d2b8955a6d4d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:45.555635 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3770d0aa-a40a-4ca7-b202-c5a0440f2386 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:45.556370 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3770d0aa-a40a-4ca7-b202-c5a0440f2386 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:45.557071 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3770d0aa-a40a-4ca7-b202-c5a0440f2386 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:45.558177 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3770d0aa-a40a-4ca7-b202-c5a0440f2386 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:45.558822 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3770d0aa-a40a-4ca7-b202-c5a0440f2386 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:45.559538 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3770d0aa-a40a-4ca7-b202-c5a0440f2386 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:45.600010 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:31:45.654840 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a5d722a2-9d40-4ca6-922a-beacde2f969c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:45.667418 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a5d722a2-9d40-4ca6-922a-beacde2f969c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e" status: 200 len: 1391 microversion: 2.1 time: 0.708175 Oct 18 15:31:45.674111 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 937/1828] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:44 2022] GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e => generated 1391 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:45.699402 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b367817e-6fb8-4181-933b-abe8a59f6f4e tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:45.700538 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b367817e-6fb8-4181-933b-abe8a59f6f4e tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] [instance: 234a024f-c13b-40de-bbcb-ffcdda611d01] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:45.711835 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b367817e-6fb8-4181-933b-abe8a59f6f4e tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:45.713383 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b367817e-6fb8-4181-933b-abe8a59f6f4e tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:45.714001 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b367817e-6fb8-4181-933b-abe8a59f6f4e tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:45.715125 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b367817e-6fb8-4181-933b-abe8a59f6f4e tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:45.715759 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b367817e-6fb8-4181-933b-abe8a59f6f4e tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:45.717622 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b367817e-6fb8-4181-933b-abe8a59f6f4e tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:45.763232 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3770d0aa-a40a-4ca7-b202-c5a0440f2386 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f901dea4594eb6831a78e2e603e8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c369c078bd4c49148290abb7de3d076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:45.772291 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3770d0aa-a40a-4ca7-b202-c5a0440f2386 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/servers/0d0c7fc6-9245-41f3-9257-d2b8955a6d4d" status: 200 len: 1276 microversion: 2.1 time: 0.243933 Oct 18 15:31:45.773273 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 892/1829] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:45 2022] GET /compute/v2.1/servers/0d0c7fc6-9245-41f3-9257-d2b8955a6d4d => generated 1276 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:45.828019 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-b367817e-6fb8-4181-933b-abe8a59f6f4e tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lazy-loading 'services' on Instance uuid 234a024f-c13b-40de-bbcb-ffcdda611d01 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:31:45.867587 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b367817e-6fb8-4181-933b-abe8a59f6f4e tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01" status: 200 len: 1927 microversion: 2.75 time: 0.176340 Oct 18 15:31:45.868194 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 938/1830] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:45 2022] GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01 => generated 1927 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:31:46.114861 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-59f711ef-58d1-4f78-ab3f-058e9baa9e89 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:46.116169 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-59f711ef-58d1-4f78-ab3f-058e9baa9e89 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 0dfb045a-8cea-41b6-bbdc-8fa6600046d1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:46.125071 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-59f711ef-58d1-4f78-ab3f-058e9baa9e89 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:46.125881 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-59f711ef-58d1-4f78-ab3f-058e9baa9e89 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:46.126545 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-59f711ef-58d1-4f78-ab3f-058e9baa9e89 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:46.127264 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-59f711ef-58d1-4f78-ab3f-058e9baa9e89 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:46.127734 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-59f711ef-58d1-4f78-ab3f-058e9baa9e89 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:46.128307 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-59f711ef-58d1-4f78-ab3f-058e9baa9e89 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:46.488138 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-59f711ef-58d1-4f78-ab3f-058e9baa9e89 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:46.522544 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-59f711ef-58d1-4f78-ab3f-058e9baa9e89 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:46.525196 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-59f711ef-58d1-4f78-ab3f-058e9baa9e89 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:46.526840 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-59f711ef-58d1-4f78-ab3f-058e9baa9e89 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1" status: 200 len: 1280 microversion: 2.25 time: 0.415977 Oct 18 15:31:46.537747 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 893/1831] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:46 2022] GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1 => generated 1280 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:31:46.558809 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-57acaf9a-9054-4515-b152-6fe31ef9113b tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:46.560229 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-57acaf9a-9054-4515-b152-6fe31ef9113b tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] [instance: d869973f-2d6e-4324-951e-1f26239a593e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:46.569065 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57acaf9a-9054-4515-b152-6fe31ef9113b tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:46.570237 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57acaf9a-9054-4515-b152-6fe31ef9113b tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:46.571263 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57acaf9a-9054-4515-b152-6fe31ef9113b tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:46.572724 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57acaf9a-9054-4515-b152-6fe31ef9113b tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:46.574582 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57acaf9a-9054-4515-b152-6fe31ef9113b tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:46.575914 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57acaf9a-9054-4515-b152-6fe31ef9113b tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:46.717652 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9008111e-ec4c-401b-b9a9-debe03bdd3bb tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:46.718586 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9008111e-ec4c-401b-b9a9-debe03bdd3bb tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:46.735627 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9008111e-ec4c-401b-b9a9-debe03bdd3bb tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:46.736985 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9008111e-ec4c-401b-b9a9-debe03bdd3bb tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:46.737829 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9008111e-ec4c-401b-b9a9-debe03bdd3bb tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:46.739357 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9008111e-ec4c-401b-b9a9-debe03bdd3bb tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:46.740254 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9008111e-ec4c-401b-b9a9-debe03bdd3bb tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:46.741150 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9008111e-ec4c-401b-b9a9-debe03bdd3bb tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:46.756267 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-57acaf9a-9054-4515-b152-6fe31ef9113b tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2678c8aad39402c885b6f780fd33165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feee8ee03b8646998338de04f4cb80dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:46.775865 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-57acaf9a-9054-4515-b152-6fe31ef9113b tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] 10.222.0.60 "GET /compute/v2.1/servers/d869973f-2d6e-4324-951e-1f26239a593e" status: 200 len: 1426 microversion: 2.1 time: 0.220364 Oct 18 15:31:46.777054 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 939/1832] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:46 2022] GET /compute/v2.1/servers/d869973f-2d6e-4324-951e-1f26239a593e => generated 1426 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:46.804176 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-46dcd1f2-cb5e-4c52-ba5c-956f5f135d52 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:46.805179 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-46dcd1f2-cb5e-4c52-ba5c-956f5f135d52 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] [instance: 0d0c7fc6-9245-41f3-9257-d2b8955a6d4d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:46.823307 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-46dcd1f2-cb5e-4c52-ba5c-956f5f135d52 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:46.823858 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-46dcd1f2-cb5e-4c52-ba5c-956f5f135d52 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:46.824455 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-46dcd1f2-cb5e-4c52-ba5c-956f5f135d52 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:46.826517 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-46dcd1f2-cb5e-4c52-ba5c-956f5f135d52 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:46.826995 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-46dcd1f2-cb5e-4c52-ba5c-956f5f135d52 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:46.827434 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-46dcd1f2-cb5e-4c52-ba5c-956f5f135d52 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:46.951260 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-46dcd1f2-cb5e-4c52-ba5c-956f5f135d52 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f901dea4594eb6831a78e2e603e8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c369c078bd4c49148290abb7de3d076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:46.956846 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:31:46.971908 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-46dcd1f2-cb5e-4c52-ba5c-956f5f135d52 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/servers/0d0c7fc6-9245-41f3-9257-d2b8955a6d4d" status: 200 len: 1276 microversion: 2.1 time: 0.172140 Oct 18 15:31:47.000937 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 940/1833] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:46 2022] GET /compute/v2.1/servers/0d0c7fc6-9245-41f3-9257-d2b8955a6d4d => generated 1276 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:31:47.007543 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-696a84b9-8bce-40d0-a1dc-30c0504e3280 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:47.008906 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-696a84b9-8bce-40d0-a1dc-30c0504e3280 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] [instance: 234a024f-c13b-40de-bbcb-ffcdda611d01] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:47.020792 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-696a84b9-8bce-40d0-a1dc-30c0504e3280 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:47.022185 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-696a84b9-8bce-40d0-a1dc-30c0504e3280 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:47.023220 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-696a84b9-8bce-40d0-a1dc-30c0504e3280 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:47.024658 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-696a84b9-8bce-40d0-a1dc-30c0504e3280 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:47.025760 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-696a84b9-8bce-40d0-a1dc-30c0504e3280 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:47.026812 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-696a84b9-8bce-40d0-a1dc-30c0504e3280 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:47.101680 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9008111e-ec4c-401b-b9a9-debe03bdd3bb tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:47.118295 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9008111e-ec4c-401b-b9a9-debe03bdd3bb tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e" status: 200 len: 1391 microversion: 2.1 time: 0.410252 Oct 18 15:31:47.120152 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 894/1834] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:46 2022] GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e => generated 1391 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:47.128319 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-adb5f5eb-1033-4e27-b37c-1c6b28e61921 req-cf35bfd7-8529-4ec0-92e2-6c5835321ee2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d869973f-2d6e-4324-951e-1f26239a593e", "name": "network-vif-deleted", "tag": "14fe3073-6fca-4e2a-85b6-92cf8f4e4a63"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:31:47.162075 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-adb5f5eb-1033-4e27-b37c-1c6b28e61921 req-cf35bfd7-8529-4ec0-92e2-6c5835321ee2 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:47.162991 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-adb5f5eb-1033-4e27-b37c-1c6b28e61921 req-cf35bfd7-8529-4ec0-92e2-6c5835321ee2 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:47.163650 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-adb5f5eb-1033-4e27-b37c-1c6b28e61921 req-cf35bfd7-8529-4ec0-92e2-6c5835321ee2 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:47.189530 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-adb5f5eb-1033-4e27-b37c-1c6b28e61921 req-cf35bfd7-8529-4ec0-92e2-6c5835321ee2 service nova] Creating event network-vif-deleted:14fe3073-6fca-4e2a-85b6-92cf8f4e4a63 for instance d869973f-2d6e-4324-951e-1f26239a593e on n-h1-853682-5 Oct 18 15:31:47.194529 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-adb5f5eb-1033-4e27-b37c-1c6b28e61921 req-cf35bfd7-8529-4ec0-92e2-6c5835321ee2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072109 Oct 18 15:31:47.195440 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 895/1835] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:31:47.212521 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-696a84b9-8bce-40d0-a1dc-30c0504e3280 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lazy-loading 'services' on Instance uuid 234a024f-c13b-40de-bbcb-ffcdda611d01 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:31:47.236251 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-696a84b9-8bce-40d0-a1dc-30c0504e3280 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01" status: 200 len: 1927 microversion: 2.75 time: 0.233773 Oct 18 15:31:47.250850 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 941/1836] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:47 2022] GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01 => generated 1927 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:31:47.526569 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-36ea4be2-1dbc-4d90-8cca-5e05262771d9 tempest-FloatingIPsNegativeTestJSON-1409130541 tempest-FloatingIPsNegativeTestJSON-1409130541-project] Calling method '.version_select at 0x7f7c3d006670>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:47.554795 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-81a94e64-df2c-4425-ba3a-6fee11aa91c7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:47.555431 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-81a94e64-df2c-4425-ba3a-6fee11aa91c7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 0dfb045a-8cea-41b6-bbdc-8fa6600046d1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:47.566478 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-81a94e64-df2c-4425-ba3a-6fee11aa91c7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:47.567081 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-81a94e64-df2c-4425-ba3a-6fee11aa91c7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:47.567413 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-81a94e64-df2c-4425-ba3a-6fee11aa91c7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:47.568133 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-81a94e64-df2c-4425-ba3a-6fee11aa91c7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:47.568591 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-81a94e64-df2c-4425-ba3a-6fee11aa91c7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:47.571946 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-81a94e64-df2c-4425-ba3a-6fee11aa91c7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:47.879056 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-36ea4be2-1dbc-4d90-8cca-5e05262771d9 tempest-FloatingIPsNegativeTestJSON-1409130541 tempest-FloatingIPsNegativeTestJSON-1409130541-project] 10.222.0.60 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.424927 Oct 18 15:31:47.880345 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 896/1837] 10.222.0.60 () {58 vars in 1149 bytes} [Tue Oct 18 15:31:47 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:31:47.896105 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0be85648-2838-4bd3-8746-4420564ad644 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:47.897478 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0be85648-2838-4bd3-8746-4420564ad644 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] [instance: d869973f-2d6e-4324-951e-1f26239a593e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:47.906208 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0be85648-2838-4bd3-8746-4420564ad644 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:47.908697 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0be85648-2838-4bd3-8746-4420564ad644 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:47.911561 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0be85648-2838-4bd3-8746-4420564ad644 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:47.912541 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0be85648-2838-4bd3-8746-4420564ad644 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:47.913212 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0be85648-2838-4bd3-8746-4420564ad644 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:47.915539 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0be85648-2838-4bd3-8746-4420564ad644 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:47.971468 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-0be85648-2838-4bd3-8746-4420564ad644 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] HTTP exception thrown: Instance d869973f-2d6e-4324-951e-1f26239a593e could not be found. Oct 18 15:31:47.982084 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0be85648-2838-4bd3-8746-4420564ad644 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Request method failure captured: Oct 18 15:31:47.982084 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/d869973f-2d6e-4324-951e-1f26239a593e HTTP/1.1 Oct 18 15:31:47.982084 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:31:47.982084 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:31:47.982084 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:31:47.982084 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:31:47.982084 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:31:47.982084 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:31:47.982084 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:31:47.982084 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:31:47.982084 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsbEUEsqY98Z8OtD11E0QTHIQYCCFh-yAgixsU7LXEgAXABZaMRjnnz4_b3cCJrshr8HVOGmk8w8cYy4IVl7D1EsIsynJaKASOhrl1X9_Dbc-rH2kdOgpLOPiGqTBRX6YtRRU_G0yfdYDL501nIhZVxUwTjXnjftHbjMzbnpKfouuvc Oct 18 15:31:47.982084 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:31:47.982084 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:31:47.982084 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:31:47.982084 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:31:47.982084 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:31:47.982084 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:31:47.982084 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: feee8ee03b8646998338de04f4cb80dc Oct 18 15:31:47.982084 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-TenantUsagesTestJSON-2127330056 Oct 18 15:31:47.982084 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:31:47.982084 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:31:47.984059 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/feee8ee03b8646998338de04f4cb80dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/feee8ee03b8646998338de04f4cb80dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/feee8ee03b8646998338de04f4cb80dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_feee8ee03b8646998338de04f4cb80dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:31:47.984059 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-TenantUsagesTestJSON-2127330056 Oct 18 15:31:47.984059 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: feee8ee03b8646998338de04f4cb80dc Oct 18 15:31:47.984059 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-TenantUsagesTestJSON-2127330056 Oct 18 15:31:47.984059 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-TenantUsagesTestJSON-2127330056-project Oct 18 15:31:47.984059 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:31:47.984059 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:31:47.984059 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: e2678c8aad39402c885b6f780fd33165 Oct 18 15:31:47.984059 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-TenantUsagesTestJSON-2127330056-project Oct 18 15:31:47.984059 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:31:47.984059 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance d869973f-2d6e-4324-951e-1f26239a593e could not be found. Oct 18 15:31:47.984059 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'd869973f-2d6e-4324-951e-1f26239a593e'} Oct 18 15:31:47.985109 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:31:47.985109 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:47.985109 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:31:47.985109 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:31:47.985109 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:31:47.985109 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:31:47.985109 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:31:47.985109 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:31:47.985109 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:31:47.985109 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:31:47.985109 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d869973f-2d6e-4324-951e-1f26239a593e could not be found. Oct 18 15:31:47.985109 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:31:47.985109 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:47.985109 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:31:47.985109 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:47.985109 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:47.985109 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:47.985109 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:31:47.985109 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:31:47.985109 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:31:47.986891 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:31:47.986891 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:31:47.986891 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:31:47.986891 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:31:47.986891 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:31:47.986891 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:31:47.986891 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:31:47.986891 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d869973f-2d6e-4324-951e-1f26239a593e could not be found. Oct 18 15:31:47.986891 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:31:47.986891 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:47.986891 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:31:47.986891 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:47.986891 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:47.986891 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:47.986891 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:31:47.986891 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:31:47.986891 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d869973f-2d6e-4324-951e-1f26239a593e could not be found. Oct 18 15:31:47.986891 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:31:47.988379 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0be85648-2838-4bd3-8746-4420564ad644 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] Returning 404 to user: Instance d869973f-2d6e-4324-951e-1f26239a593e could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:31:47.988379 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0be85648-2838-4bd3-8746-4420564ad644 tempest-TenantUsagesTestJSON-2127330056 tempest-TenantUsagesTestJSON-2127330056-project] 10.222.0.60 "GET /compute/v2.1/servers/d869973f-2d6e-4324-951e-1f26239a593e" status: 404 len: 111 microversion: 2.1 time: 0.104199 Oct 18 15:31:47.988992 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 897/1838] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:47 2022] GET /compute/v2.1/servers/d869973f-2d6e-4324-951e-1f26239a593e => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:31:48.011003 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d83e5dcb-1250-4c9a-8434-72d659fc05ed tempest-FloatingIPsNegativeTestJSON-1409130541 tempest-FloatingIPsNegativeTestJSON-1409130541-project] Action: 'create', calling method: .version_select at 0x7f7c3d006c10>, body: {"pool": "non_exist_pool"} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:31:48.033673 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=8 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:31:48.135082 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-d83e5dcb-1250-4c9a-8434-72d659fc05ed tempest-FloatingIPsNegativeTestJSON-1409130541 tempest-FloatingIPsNegativeTestJSON-1409130541-project] HTTP exception thrown: Floating IP pool not found. Oct 18 15:31:48.138169 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d83e5dcb-1250-4c9a-8434-72d659fc05ed tempest-FloatingIPsNegativeTestJSON-1409130541 tempest-FloatingIPsNegativeTestJSON-1409130541-project] Request method failure captured: Oct 18 15:31:48.138169 n-d-853682-5 devstack@n-api.service[120406]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 18 15:31:48.138169 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:31:48.138169 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:31:48.138169 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:31:48.138169 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 26 Oct 18 15:31:48.138169 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:31:48.138169 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:31:48.138169 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:31:48.138169 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:31:48.138169 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsbjCMO5bFF0vvXu0aj3SfGz5hqWTQPRnoYMZt370sGLJsZErhIhiMSw0TJanufKsxhKn_45B8eL6PhGndkFTtsZtv_elFvY6dXB7s51z3Ta3v9Z3Arlzmno1s7ehKEyjDyGRhJgT7QBKzr4aKEvhH1SuiJlhGcHl8VEjtGYk7cXH94 Oct 18 15:31:48.138169 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:31:48.138169 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:31:48.138169 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:31:48.138169 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:31:48.138169 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:31:48.138169 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:31:48.138169 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 3902b281b7d640e5970697f3d71acbce Oct 18 15:31:48.138169 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1409130541 Oct 18 15:31:48.138169 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:31:48.138169 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:31:48.139987 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3902b281b7d640e5970697f3d71acbce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3902b281b7d640e5970697f3d71acbce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3902b281b7d640e5970697f3d71acbce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3902b281b7d640e5970697f3d71acbce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:31:48.139987 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1409130541 Oct 18 15:31:48.139987 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 3902b281b7d640e5970697f3d71acbce Oct 18 15:31:48.139987 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1409130541 Oct 18 15:31:48.139987 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-FloatingIPsNegativeTestJSON-1409130541-project Oct 18 15:31:48.139987 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:31:48.139987 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:31:48.139987 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 3b187b25be5240918141048c9c065fdd Oct 18 15:31:48.139987 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1409130541-project Oct 18 15:31:48.139987 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:31:48.139987 n-d-853682-5 devstack@n-api.service[120406]: {"pool": "non_exist_pool"} Oct 18 15:31:48.139987 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:31:48.139987 n-d-853682-5 devstack@n-api.service[120406]: exception: Floating IP pool not found. Oct 18 15:31:48.139987 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 18 15:31:48.139987 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:31:48.141303 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:48.141303 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 18 15:31:48.141303 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 18 15:31:48.141303 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2985, in allocate_floating_ip Oct 18 15:31:48.141303 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 18 15:31:48.141303 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in _get_floating_ip_pool_id_by_name_or_id Oct 18 15:31:48.141303 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 18 15:31:48.141303 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 18 15:31:48.141303 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:31:48.141303 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:48.141303 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:31:48.141303 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:48.141303 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:48.141303 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:48.141303 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:31:48.141303 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:31:48.141303 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:31:48.141303 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:31:48.141303 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:31:48.141303 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:31:48.143644 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 18 15:31:48.143644 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:31:48.143644 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 18 15:31:48.143644 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:31:48.143644 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:48.143644 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:31:48.143644 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:48.143644 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:48.143644 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:48.143644 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:31:48.143644 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:31:48.143644 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 18 15:31:48.143644 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:31:48.143644 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d83e5dcb-1250-4c9a-8434-72d659fc05ed tempest-FloatingIPsNegativeTestJSON-1409130541 tempest-FloatingIPsNegativeTestJSON-1409130541-project] Returning 404 to user: Floating IP pool not found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:31:48.147169 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d83e5dcb-1250-4c9a-8434-72d659fc05ed tempest-FloatingIPsNegativeTestJSON-1409130541 tempest-FloatingIPsNegativeTestJSON-1409130541-project] 10.222.0.60 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.155760 Oct 18 15:31:48.157583 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 898/1839] 10.222.0.60 () {60 vars in 1170 bytes} [Tue Oct 18 15:31:47 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 15:31:48.174681 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0f28d51f-8291-4c22-b5a2-02bf9e135bac tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:48.178303 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0f28d51f-8291-4c22-b5a2-02bf9e135bac tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] [instance: 0d0c7fc6-9245-41f3-9257-d2b8955a6d4d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:48.201480 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f28d51f-8291-4c22-b5a2-02bf9e135bac tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:48.204657 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f28d51f-8291-4c22-b5a2-02bf9e135bac tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:48.205967 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f28d51f-8291-4c22-b5a2-02bf9e135bac tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:48.207708 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f28d51f-8291-4c22-b5a2-02bf9e135bac tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:48.209015 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f28d51f-8291-4c22-b5a2-02bf9e135bac tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:48.209944 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f28d51f-8291-4c22-b5a2-02bf9e135bac tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:48.418930 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-81a94e64-df2c-4425-ba3a-6fee11aa91c7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:48.431046 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-81a94e64-df2c-4425-ba3a-6fee11aa91c7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:48.433095 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-81a94e64-df2c-4425-ba3a-6fee11aa91c7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:48.436593 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-81a94e64-df2c-4425-ba3a-6fee11aa91c7 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1" status: 200 len: 1280 microversion: 2.25 time: 0.888309 Oct 18 15:31:48.441944 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 942/1840] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:47 2022] GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1 => generated 1280 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:31:48.447855 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fc67cf8a-966a-45bc-81dc-c53dc80335f7 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:48.448483 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-fc67cf8a-966a-45bc-81dc-c53dc80335f7 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:48.464781 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fc67cf8a-966a-45bc-81dc-c53dc80335f7 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:48.468343 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fc67cf8a-966a-45bc-81dc-c53dc80335f7 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:48.469020 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fc67cf8a-966a-45bc-81dc-c53dc80335f7 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:48.469925 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fc67cf8a-966a-45bc-81dc-c53dc80335f7 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:48.471371 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fc67cf8a-966a-45bc-81dc-c53dc80335f7 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:48.471978 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fc67cf8a-966a-45bc-81dc-c53dc80335f7 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:48.480415 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0f28d51f-8291-4c22-b5a2-02bf9e135bac tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f901dea4594eb6831a78e2e603e8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c369c078bd4c49148290abb7de3d076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:48.491219 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0f28d51f-8291-4c22-b5a2-02bf9e135bac tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/servers/0d0c7fc6-9245-41f3-9257-d2b8955a6d4d" status: 200 len: 1318 microversion: 2.1 time: 0.330232 Oct 18 15:31:48.491814 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 899/1841] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:48 2022] GET /compute/v2.1/servers/0d0c7fc6-9245-41f3-9257-d2b8955a6d4d => generated 1318 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:48.515998 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7aa97845-269f-4338-863d-75851f1f5e6a tempest-FloatingIPsNegativeTestJSON-1409130541 tempest-FloatingIPsNegativeTestJSON-1409130541-project] Calling method '.version_select at 0x7f7c3cf944c0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:49.001103 n-d-853682-5 devstack@n-api.service[120406]: DEBUG neutronclient.v2_0.client [None req-7aa97845-269f-4338-863d-75851f1f5e6a tempest-FloatingIPsNegativeTestJSON-1409130541 tempest-FloatingIPsNegativeTestJSON-1409130541-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 48d2f544-799c-4558-9399-5352df3fc520 could not be found", "detail": ""}} {{(pid=120406) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 15:31:49.001787 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-7aa97845-269f-4338-863d-75851f1f5e6a tempest-FloatingIPsNegativeTestJSON-1409130541 tempest-FloatingIPsNegativeTestJSON-1409130541-project] HTTP exception thrown: Floating IP not found for ID 48d2f544-799c-4558-9399-5352df3fc520 Oct 18 15:31:49.003712 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7aa97845-269f-4338-863d-75851f1f5e6a tempest-FloatingIPsNegativeTestJSON-1409130541 tempest-FloatingIPsNegativeTestJSON-1409130541-project] Request method failure captured: Oct 18 15:31:49.003712 n-d-853682-5 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/os-floating-ips/48d2f544-799c-4558-9399-5352df3fc520 HTTP/1.1 Oct 18 15:31:49.003712 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:31:49.003712 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:31:49.003712 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:31:49.003712 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:31:49.003712 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:31:49.003712 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:31:49.003712 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:31:49.003712 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:31:49.003712 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsbjCMO5bFF0vvXu0aj3SfGz5hqWTQPRnoYMZt370sGLJsZErhIhiMSw0TJanufKsxhKn_45B8eL6PhGndkFTtsZtv_elFvY6dXB7s51z3Ta3v9Z3Arlzmno1s7ehKEyjDyGRhJgT7QBKzr4aKEvhH1SuiJlhGcHl8VEjtGYk7cXH94 Oct 18 15:31:49.003712 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:31:49.003712 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:31:49.003712 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:31:49.003712 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:31:49.003712 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:31:49.003712 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:31:49.003712 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 3902b281b7d640e5970697f3d71acbce Oct 18 15:31:49.003712 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1409130541 Oct 18 15:31:49.003712 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:31:49.003712 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:31:49.006351 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3902b281b7d640e5970697f3d71acbce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3902b281b7d640e5970697f3d71acbce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3902b281b7d640e5970697f3d71acbce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3902b281b7d640e5970697f3d71acbce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:31:49.006351 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1409130541 Oct 18 15:31:49.006351 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 3902b281b7d640e5970697f3d71acbce Oct 18 15:31:49.006351 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1409130541 Oct 18 15:31:49.006351 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-FloatingIPsNegativeTestJSON-1409130541-project Oct 18 15:31:49.006351 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:31:49.006351 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:31:49.006351 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 3b187b25be5240918141048c9c065fdd Oct 18 15:31:49.006351 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1409130541-project Oct 18 15:31:49.006351 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:31:49.006351 n-d-853682-5 devstack@n-api.service[120406]: exception: Floating IP not found for ID 48d2f544-799c-4558-9399-5352df3fc520 Oct 18 15:31:49.006351 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '48d2f544-799c-4558-9399-5352df3fc520'} Oct 18 15:31:49.006351 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:31:49.007754 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:49.007754 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2837, in get_floating_ip Oct 18 15:31:49.007754 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 18 15:31:49.007754 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:31:49.007754 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:31:49.007754 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 18 15:31:49.007754 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 18 15:31:49.007754 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:31:49.007754 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:31:49.007754 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 15:31:49.007754 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 15:31:49.007754 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:31:49.007754 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:31:49.007754 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 15:31:49.007754 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 15:31:49.007754 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:31:49.007754 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:31:49.007754 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 15:31:49.007754 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 15:31:49.009865 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:31:49.009865 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:31:49.009865 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 15:31:49.009865 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 15:31:49.009865 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 15:31:49.009865 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 15:31:49.009865 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 48d2f544-799c-4558-9399-5352df3fc520 could not be found Oct 18 15:31:49.009865 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e1f9ad0e-f459-48d0-a5dc-28589d9f0a5d'] Oct 18 15:31:49.009865 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:31:49.009865 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:49.009865 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:31:49.009865 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:49.009865 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 18 15:31:49.009865 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 18 15:31:49.009865 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2840, in get_floating_ip Oct 18 15:31:49.009865 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 18 15:31:49.009865 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 48d2f544-799c-4558-9399-5352df3fc520. Oct 18 15:31:49.009865 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:31:49.009865 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:49.009865 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:31:49.012039 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:49.012039 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:49.012039 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:49.012039 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:31:49.012039 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:31:49.012039 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:31:49.012039 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:31:49.012039 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:31:49.012039 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:31:49.012039 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 18 15:31:49.012039 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 18 15:31:49.012039 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 48d2f544-799c-4558-9399-5352df3fc520 Oct 18 15:31:49.012039 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:31:49.012039 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:49.012039 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:31:49.012039 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:49.012039 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:49.012039 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:49.012039 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:31:49.012039 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:31:49.019789 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 48d2f544-799c-4558-9399-5352df3fc520 Oct 18 15:31:49.019789 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:31:49.019789 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7aa97845-269f-4338-863d-75851f1f5e6a tempest-FloatingIPsNegativeTestJSON-1409130541 tempest-FloatingIPsNegativeTestJSON-1409130541-project] Returning 404 to user: Floating IP not found for ID 48d2f544-799c-4558-9399-5352df3fc520 {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:31:49.019789 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7aa97845-269f-4338-863d-75851f1f5e6a tempest-FloatingIPsNegativeTestJSON-1409130541 tempest-FloatingIPsNegativeTestJSON-1409130541-project] 10.222.0.60 "DELETE /compute/v2.1/os-floating-ips/48d2f544-799c-4558-9399-5352df3fc520" status: 404 len: 111 microversion: 2.1 time: 0.508709 Oct 18 15:31:49.019789 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 900/1842] 10.222.0.60 () {58 vars in 1263 bytes} [Tue Oct 18 15:31:48 2022] DELETE /compute/v2.1/os-floating-ips/48d2f544-799c-4558-9399-5352df3fc520 => generated 111 bytes in 519 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:31:49.019789 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-01470982-5dfa-4114-a0b0-84bd2e55d2c0 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:49.020935 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-01470982-5dfa-4114-a0b0-84bd2e55d2c0 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] [instance: 234a024f-c13b-40de-bbcb-ffcdda611d01] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:49.039828 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01470982-5dfa-4114-a0b0-84bd2e55d2c0 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:49.040323 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01470982-5dfa-4114-a0b0-84bd2e55d2c0 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:49.040754 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01470982-5dfa-4114-a0b0-84bd2e55d2c0 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:49.047138 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01470982-5dfa-4114-a0b0-84bd2e55d2c0 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:49.047620 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01470982-5dfa-4114-a0b0-84bd2e55d2c0 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:49.048055 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01470982-5dfa-4114-a0b0-84bd2e55d2c0 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:49.304612 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-01470982-5dfa-4114-a0b0-84bd2e55d2c0 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lazy-loading 'services' on Instance uuid 234a024f-c13b-40de-bbcb-ffcdda611d01 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:31:49.351280 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-01470982-5dfa-4114-a0b0-84bd2e55d2c0 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01" status: 200 len: 1927 microversion: 2.75 time: 0.338767 Oct 18 15:31:49.355165 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 901/1843] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:49 2022] GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01 => generated 1927 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:31:49.398081 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-fc67cf8a-966a-45bc-81dc-c53dc80335f7 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:49.411234 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fc67cf8a-966a-45bc-81dc-c53dc80335f7 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e" status: 200 len: 1391 microversion: 2.1 time: 0.967885 Oct 18 15:31:49.412165 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 943/1844] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:48 2022] GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e => generated 1391 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:49.474786 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-45fb646e-1ee8-41ef-ab52-aca92eaadcae tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:49.477493 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-45fb646e-1ee8-41ef-ab52-aca92eaadcae tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 0dfb045a-8cea-41b6-bbdc-8fa6600046d1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:49.504061 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45fb646e-1ee8-41ef-ab52-aca92eaadcae tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:49.506333 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45fb646e-1ee8-41ef-ab52-aca92eaadcae tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:49.506997 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45fb646e-1ee8-41ef-ab52-aca92eaadcae tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:49.508250 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45fb646e-1ee8-41ef-ab52-aca92eaadcae tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:49.509279 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45fb646e-1ee8-41ef-ab52-aca92eaadcae tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:49.527015 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-068eca56-d3bc-40ca-afb6-53c4740e9960 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:49.527892 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-068eca56-d3bc-40ca-afb6-53c4740e9960 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] [instance: 0d0c7fc6-9245-41f3-9257-d2b8955a6d4d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:49.529784 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45fb646e-1ee8-41ef-ab52-aca92eaadcae tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:49.549472 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-068eca56-d3bc-40ca-afb6-53c4740e9960 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:49.549983 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-068eca56-d3bc-40ca-afb6-53c4740e9960 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:49.550559 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-068eca56-d3bc-40ca-afb6-53c4740e9960 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:49.551298 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-068eca56-d3bc-40ca-afb6-53c4740e9960 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:49.551856 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-068eca56-d3bc-40ca-afb6-53c4740e9960 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:49.552296 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-068eca56-d3bc-40ca-afb6-53c4740e9960 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:49.885451 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-068eca56-d3bc-40ca-afb6-53c4740e9960 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f901dea4594eb6831a78e2e603e8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c369c078bd4c49148290abb7de3d076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:49.893909 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-068eca56-d3bc-40ca-afb6-53c4740e9960 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/servers/0d0c7fc6-9245-41f3-9257-d2b8955a6d4d" status: 200 len: 1318 microversion: 2.1 time: 0.370944 Oct 18 15:31:49.909571 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 944/1845] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:49 2022] GET /compute/v2.1/servers/0d0c7fc6-9245-41f3-9257-d2b8955a6d4d => generated 1318 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:49.974928 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-8019af26-44ac-4c71-b29c-d6f3f9169445 req-49d790b4-f9be-4204-8960-71cf0ecb910a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e1ae723-8f58-4752-b578-da0b39e9a668", "tag": "2083c6f4-97f8-4301-a307-2ecb7417f192"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:31:49.996054 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-8019af26-44ac-4c71-b29c-d6f3f9169445 req-49d790b4-f9be-4204-8960-71cf0ecb910a service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:49.996779 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-8019af26-44ac-4c71-b29c-d6f3f9169445 req-49d790b4-f9be-4204-8960-71cf0ecb910a service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:49.997987 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-8019af26-44ac-4c71-b29c-d6f3f9169445 req-49d790b4-f9be-4204-8960-71cf0ecb910a service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:50.016223 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-8019af26-44ac-4c71-b29c-d6f3f9169445 req-49d790b4-f9be-4204-8960-71cf0ecb910a service nova] Creating event network-changed:2083c6f4-97f8-4301-a307-2ecb7417f192 for instance 4e1ae723-8f58-4752-b578-da0b39e9a668 on n-h1-853682-5 Oct 18 15:31:50.023212 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-8019af26-44ac-4c71-b29c-d6f3f9169445 req-49d790b4-f9be-4204-8960-71cf0ecb910a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051971 Oct 18 15:31:50.024383 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 945/1846] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:31:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:31:50.078203 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-45fb646e-1ee8-41ef-ab52-aca92eaadcae tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:50.091554 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-45fb646e-1ee8-41ef-ab52-aca92eaadcae tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:50.094994 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-45fb646e-1ee8-41ef-ab52-aca92eaadcae tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:50.099712 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-45fb646e-1ee8-41ef-ab52-aca92eaadcae tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1" status: 200 len: 1280 microversion: 2.25 time: 0.631640 Oct 18 15:31:50.101294 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 902/1847] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:49 2022] GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1 => generated 1280 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:31:50.392162 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5cde757c-a169-41c4-b2f5-8f015f2fa078 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:50.393219 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5cde757c-a169-41c4-b2f5-8f015f2fa078 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] [instance: 234a024f-c13b-40de-bbcb-ffcdda611d01] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:50.407028 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5cde757c-a169-41c4-b2f5-8f015f2fa078 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:50.408319 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5cde757c-a169-41c4-b2f5-8f015f2fa078 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:50.409632 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5cde757c-a169-41c4-b2f5-8f015f2fa078 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:50.411770 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5cde757c-a169-41c4-b2f5-8f015f2fa078 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:50.413458 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5cde757c-a169-41c4-b2f5-8f015f2fa078 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:50.415353 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5cde757c-a169-41c4-b2f5-8f015f2fa078 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:50.459970 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b59858bf-b0f6-47ee-8d8c-c24a4c1f91ba tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:50.461667 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b59858bf-b0f6-47ee-8d8c-c24a4c1f91ba tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:50.477292 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=8 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:31:50.480004 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=14 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:31:50.488233 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b59858bf-b0f6-47ee-8d8c-c24a4c1f91ba tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:50.492358 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b59858bf-b0f6-47ee-8d8c-c24a4c1f91ba tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:50.494127 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b59858bf-b0f6-47ee-8d8c-c24a4c1f91ba tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:50.498458 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b59858bf-b0f6-47ee-8d8c-c24a4c1f91ba tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:50.499725 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b59858bf-b0f6-47ee-8d8c-c24a4c1f91ba tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:50.501507 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b59858bf-b0f6-47ee-8d8c-c24a4c1f91ba tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:50.714144 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-5cde757c-a169-41c4-b2f5-8f015f2fa078 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lazy-loading 'services' on Instance uuid 234a024f-c13b-40de-bbcb-ffcdda611d01 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:31:50.729322 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=6 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:31:50.765790 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5cde757c-a169-41c4-b2f5-8f015f2fa078 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01" status: 200 len: 1927 microversion: 2.75 time: 0.378158 Oct 18 15:31:50.766716 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 946/1848] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:50 2022] GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01 => generated 1927 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:31:50.833878 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-0bb3fe0f-09d9-4b94-a853-5a037a0c4d73 req-4d843c6b-8967-41fe-8057-0fdb4e58a588 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d0c7fc6-9245-41f3-9257-d2b8955a6d4d", "tag": "ccf2639c-dfaf-46eb-a27f-c279d0c6c5c1"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:31:50.848099 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-0bb3fe0f-09d9-4b94-a853-5a037a0c4d73 req-4d843c6b-8967-41fe-8057-0fdb4e58a588 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:50.848611 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-0bb3fe0f-09d9-4b94-a853-5a037a0c4d73 req-4d843c6b-8967-41fe-8057-0fdb4e58a588 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:50.849091 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-0bb3fe0f-09d9-4b94-a853-5a037a0c4d73 req-4d843c6b-8967-41fe-8057-0fdb4e58a588 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:50.871829 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-0bb3fe0f-09d9-4b94-a853-5a037a0c4d73 req-4d843c6b-8967-41fe-8057-0fdb4e58a588 service nova] Creating event network-changed:ccf2639c-dfaf-46eb-a27f-c279d0c6c5c1 for instance 0d0c7fc6-9245-41f3-9257-d2b8955a6d4d on n-h1-853682-5 Oct 18 15:31:50.885798 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-0bb3fe0f-09d9-4b94-a853-5a037a0c4d73 req-4d843c6b-8967-41fe-8057-0fdb4e58a588 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055896 Oct 18 15:31:50.887349 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 947/1849] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:31:50.919376 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b59858bf-b0f6-47ee-8d8c-c24a4c1f91ba tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:50.937811 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-55f4f790-c6f0-41d9-aaaa-bb253445a702 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:50.938802 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-55f4f790-c6f0-41d9-aaaa-bb253445a702 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] [instance: 0d0c7fc6-9245-41f3-9257-d2b8955a6d4d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:50.947455 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-55f4f790-c6f0-41d9-aaaa-bb253445a702 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:50.949775 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b59858bf-b0f6-47ee-8d8c-c24a4c1f91ba tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e" status: 200 len: 1391 microversion: 2.1 time: 0.497284 Oct 18 15:31:50.952322 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-55f4f790-c6f0-41d9-aaaa-bb253445a702 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:50.952548 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 903/1850] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:50 2022] GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e => generated 1391 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:50.953192 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-55f4f790-c6f0-41d9-aaaa-bb253445a702 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:50.954140 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-55f4f790-c6f0-41d9-aaaa-bb253445a702 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:50.954609 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-55f4f790-c6f0-41d9-aaaa-bb253445a702 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:50.955042 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-55f4f790-c6f0-41d9-aaaa-bb253445a702 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:51.138805 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b8c03b6e-844d-4678-9125-d0524cac917f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:51.141772 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b8c03b6e-844d-4678-9125-d0524cac917f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 0dfb045a-8cea-41b6-bbdc-8fa6600046d1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:51.177278 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8c03b6e-844d-4678-9125-d0524cac917f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:51.177978 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8c03b6e-844d-4678-9125-d0524cac917f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:51.178591 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8c03b6e-844d-4678-9125-d0524cac917f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:51.179662 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8c03b6e-844d-4678-9125-d0524cac917f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:51.187076 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8c03b6e-844d-4678-9125-d0524cac917f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:51.188239 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8c03b6e-844d-4678-9125-d0524cac917f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:51.254285 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-55f4f790-c6f0-41d9-aaaa-bb253445a702 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f901dea4594eb6831a78e2e603e8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c369c078bd4c49148290abb7de3d076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:51.272412 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-55f4f790-c6f0-41d9-aaaa-bb253445a702 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/servers/0d0c7fc6-9245-41f3-9257-d2b8955a6d4d" status: 200 len: 1318 microversion: 2.1 time: 0.331603 Oct 18 15:31:51.273846 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 948/1851] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:50 2022] GET /compute/v2.1/servers/0d0c7fc6-9245-41f3-9257-d2b8955a6d4d => generated 1318 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:31:51.585188 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b8c03b6e-844d-4678-9125-d0524cac917f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:51.601502 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b8c03b6e-844d-4678-9125-d0524cac917f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:51.606260 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b8c03b6e-844d-4678-9125-d0524cac917f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:51.613499 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b8c03b6e-844d-4678-9125-d0524cac917f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1" status: 200 len: 1280 microversion: 2.25 time: 0.486484 Oct 18 15:31:51.615247 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 904/1852] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:51 2022] GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1 => generated 1280 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:31:51.810709 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8acdeec2-43b5-4d74-a72a-d5749b3b7d57 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:51.813881 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8acdeec2-43b5-4d74-a72a-d5749b3b7d57 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] [instance: 234a024f-c13b-40de-bbcb-ffcdda611d01] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:51.832536 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8acdeec2-43b5-4d74-a72a-d5749b3b7d57 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:51.833383 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8acdeec2-43b5-4d74-a72a-d5749b3b7d57 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:51.835937 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8acdeec2-43b5-4d74-a72a-d5749b3b7d57 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:51.837091 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8acdeec2-43b5-4d74-a72a-d5749b3b7d57 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:51.857369 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8acdeec2-43b5-4d74-a72a-d5749b3b7d57 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:51.861751 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8acdeec2-43b5-4d74-a72a-d5749b3b7d57 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:51.981410 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-630dfdce-2ab1-429f-9827-5bee54947304 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:51.990679 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-630dfdce-2ab1-429f-9827-5bee54947304 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:52.021598 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-630dfdce-2ab1-429f-9827-5bee54947304 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:52.022136 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-630dfdce-2ab1-429f-9827-5bee54947304 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:52.023840 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-630dfdce-2ab1-429f-9827-5bee54947304 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:52.026027 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-630dfdce-2ab1-429f-9827-5bee54947304 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:52.026582 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-630dfdce-2ab1-429f-9827-5bee54947304 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:52.027063 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-630dfdce-2ab1-429f-9827-5bee54947304 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:52.115174 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-8acdeec2-43b5-4d74-a72a-d5749b3b7d57 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lazy-loading 'services' on Instance uuid 234a024f-c13b-40de-bbcb-ffcdda611d01 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:31:52.172998 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8acdeec2-43b5-4d74-a72a-d5749b3b7d57 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01" status: 200 len: 1927 microversion: 2.75 time: 0.366314 Oct 18 15:31:52.174096 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 949/1853] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:51 2022] GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01 => generated 1927 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:31:52.308549 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3b189d5b-f480-41fd-912b-7cba1b0de478 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:52.309772 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3b189d5b-f480-41fd-912b-7cba1b0de478 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] [instance: 0d0c7fc6-9245-41f3-9257-d2b8955a6d4d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:52.341468 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3b189d5b-f480-41fd-912b-7cba1b0de478 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:52.345537 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3b189d5b-f480-41fd-912b-7cba1b0de478 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:52.346980 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3b189d5b-f480-41fd-912b-7cba1b0de478 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:52.349178 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3b189d5b-f480-41fd-912b-7cba1b0de478 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:52.350868 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3b189d5b-f480-41fd-912b-7cba1b0de478 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:52.352977 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3b189d5b-f480-41fd-912b-7cba1b0de478 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:52.565210 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-630dfdce-2ab1-429f-9827-5bee54947304 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:52.576493 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-630dfdce-2ab1-429f-9827-5bee54947304 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e" status: 200 len: 1391 microversion: 2.1 time: 0.598682 Oct 18 15:31:52.578920 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 905/1854] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:51 2022] GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e => generated 1391 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:52.652130 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-428a800e-f40f-4166-9dd3-46a7cf67fe0f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:52.653089 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-428a800e-f40f-4166-9dd3-46a7cf67fe0f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 0dfb045a-8cea-41b6-bbdc-8fa6600046d1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:52.675188 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3b189d5b-f480-41fd-912b-7cba1b0de478 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f901dea4594eb6831a78e2e603e8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c369c078bd4c49148290abb7de3d076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:52.675911 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-428a800e-f40f-4166-9dd3-46a7cf67fe0f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:52.676598 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-428a800e-f40f-4166-9dd3-46a7cf67fe0f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:52.677080 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-428a800e-f40f-4166-9dd3-46a7cf67fe0f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:52.677872 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-428a800e-f40f-4166-9dd3-46a7cf67fe0f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:52.678339 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-428a800e-f40f-4166-9dd3-46a7cf67fe0f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:52.678889 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-428a800e-f40f-4166-9dd3-46a7cf67fe0f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:52.686925 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3b189d5b-f480-41fd-912b-7cba1b0de478 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/servers/0d0c7fc6-9245-41f3-9257-d2b8955a6d4d" status: 200 len: 1318 microversion: 2.1 time: 0.383367 Oct 18 15:31:52.691902 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 950/1855] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:52 2022] GET /compute/v2.1/servers/0d0c7fc6-9245-41f3-9257-d2b8955a6d4d => generated 1318 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:52.984399 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-428a800e-f40f-4166-9dd3-46a7cf67fe0f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:52.993391 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-428a800e-f40f-4166-9dd3-46a7cf67fe0f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:52.999572 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-428a800e-f40f-4166-9dd3-46a7cf67fe0f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:53.002327 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-428a800e-f40f-4166-9dd3-46a7cf67fe0f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1" status: 200 len: 1280 microversion: 2.25 time: 0.358643 Oct 18 15:31:53.004764 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 906/1856] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:52 2022] GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1 => generated 1280 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:31:53.217702 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d32f6a63-7114-4f1c-8fa6-23ecace10e81 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:53.218740 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d32f6a63-7114-4f1c-8fa6-23ecace10e81 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] [instance: 234a024f-c13b-40de-bbcb-ffcdda611d01] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:53.233386 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d32f6a63-7114-4f1c-8fa6-23ecace10e81 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:53.243427 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d32f6a63-7114-4f1c-8fa6-23ecace10e81 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:53.244305 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d32f6a63-7114-4f1c-8fa6-23ecace10e81 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:53.249739 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d32f6a63-7114-4f1c-8fa6-23ecace10e81 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:53.250485 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d32f6a63-7114-4f1c-8fa6-23ecace10e81 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:53.251158 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d32f6a63-7114-4f1c-8fa6-23ecace10e81 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:53.605990 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-d32f6a63-7114-4f1c-8fa6-23ecace10e81 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lazy-loading 'services' on Instance uuid 234a024f-c13b-40de-bbcb-ffcdda611d01 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:31:53.616277 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4cf558ed-cde2-4b31-a9ed-f19a1bc9750a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:53.617479 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4cf558ed-cde2-4b31-a9ed-f19a1bc9750a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:53.636138 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4cf558ed-cde2-4b31-a9ed-f19a1bc9750a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:53.638430 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4cf558ed-cde2-4b31-a9ed-f19a1bc9750a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:53.641803 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4cf558ed-cde2-4b31-a9ed-f19a1bc9750a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:53.642741 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4cf558ed-cde2-4b31-a9ed-f19a1bc9750a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:53.644173 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4cf558ed-cde2-4b31-a9ed-f19a1bc9750a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:53.654666 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4cf558ed-cde2-4b31-a9ed-f19a1bc9750a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:53.661520 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d32f6a63-7114-4f1c-8fa6-23ecace10e81 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01" status: 200 len: 1927 microversion: 2.75 time: 0.447851 Oct 18 15:31:53.662444 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 951/1857] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:53 2022] GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01 => generated 1927 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:31:53.736431 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-42c0f110-3685-4cac-86ee-c7d17c258d71 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:53.737160 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-42c0f110-3685-4cac-86ee-c7d17c258d71 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] [instance: 0d0c7fc6-9245-41f3-9257-d2b8955a6d4d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:53.759984 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-42c0f110-3685-4cac-86ee-c7d17c258d71 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:53.760482 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-42c0f110-3685-4cac-86ee-c7d17c258d71 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:53.760957 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-42c0f110-3685-4cac-86ee-c7d17c258d71 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:53.764709 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-42c0f110-3685-4cac-86ee-c7d17c258d71 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:53.765306 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-42c0f110-3685-4cac-86ee-c7d17c258d71 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:53.769918 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-42c0f110-3685-4cac-86ee-c7d17c258d71 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:54.303985 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4cf558ed-cde2-4b31-a9ed-f19a1bc9750a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:54.319317 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4cf558ed-cde2-4b31-a9ed-f19a1bc9750a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e" status: 200 len: 1391 microversion: 2.1 time: 0.711413 Oct 18 15:31:54.341698 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-42c0f110-3685-4cac-86ee-c7d17c258d71 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f901dea4594eb6831a78e2e603e8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c369c078bd4c49148290abb7de3d076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:54.348210 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 907/1858] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:53 2022] GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e => generated 1391 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:31:54.360904 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-42c0f110-3685-4cac-86ee-c7d17c258d71 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/servers/0d0c7fc6-9245-41f3-9257-d2b8955a6d4d" status: 200 len: 1318 microversion: 2.1 time: 0.628994 Oct 18 15:31:54.362082 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 952/1859] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:53 2022] GET /compute/v2.1/servers/0d0c7fc6-9245-41f3-9257-d2b8955a6d4d => generated 1318 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:31:54.370958 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3f2d6e03-1da0-42c9-a501-caab6b26b92d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:54.372507 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3f2d6e03-1da0-42c9-a501-caab6b26b92d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 0dfb045a-8cea-41b6-bbdc-8fa6600046d1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:54.381884 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3f2d6e03-1da0-42c9-a501-caab6b26b92d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:54.385028 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3f2d6e03-1da0-42c9-a501-caab6b26b92d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:54.386136 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3f2d6e03-1da0-42c9-a501-caab6b26b92d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:54.387332 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3f2d6e03-1da0-42c9-a501-caab6b26b92d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:54.388060 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3f2d6e03-1da0-42c9-a501-caab6b26b92d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:54.388688 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3f2d6e03-1da0-42c9-a501-caab6b26b92d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:54.533641 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7084d9cb-d9f6-4912-bbfb-9a520dde77ee tempest-ListImageFiltersNegativeTestJSON-261556342 tempest-ListImageFiltersNegativeTestJSON-261556342-project] Calling method '.version_select at 0x7f7c3cf9d430>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:54.557418 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-7084d9cb-d9f6-4912-bbfb-9a520dde77ee tempest-ListImageFiltersNegativeTestJSON-261556342 tempest-ListImageFiltersNegativeTestJSON-261556342-project] HTTP exception thrown: Image not found. Oct 18 15:31:54.562848 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7084d9cb-d9f6-4912-bbfb-9a520dde77ee tempest-ListImageFiltersNegativeTestJSON-261556342 tempest-ListImageFiltersNegativeTestJSON-261556342-project] Request method failure captured: Oct 18 15:31:54.562848 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/images/3dc6211d-2fb7-473c-ac38-56e62f2abd79 HTTP/1.1 Oct 18 15:31:54.562848 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:31:54.562848 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:31:54.562848 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:31:54.562848 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:31:54.562848 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:31:54.562848 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:31:54.562848 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:31:54.562848 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:31:54.562848 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsbp6CHTpq3StJJP5PZ3YUjOpU-Ec26FabEGRy1yd2Rc39_OLvYElbtKYfz5XD_nWAXw2vFS1GjjdX7OrV9R0d4eeG6HwYfayGzns-9hXjfr0K1omCANp_nK6vsZjvxM747ap1c56QrCltu68h5YcwbRSZbJHEUeYR4KRZvKZ80KKic Oct 18 15:31:54.562848 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:31:54.562848 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:31:54.562848 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:31:54.562848 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:31:54.562848 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:31:54.562848 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:31:54.562848 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 92358bd76bb748e58689f8022996926c Oct 18 15:31:54.562848 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-261556342 Oct 18 15:31:54.562848 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:31:54.562848 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:31:54.564526 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/92358bd76bb748e58689f8022996926c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/92358bd76bb748e58689f8022996926c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/92358bd76bb748e58689f8022996926c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_92358bd76bb748e58689f8022996926c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:31:54.564526 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-261556342 Oct 18 15:31:54.564526 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 92358bd76bb748e58689f8022996926c Oct 18 15:31:54.564526 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-261556342 Oct 18 15:31:54.564526 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ListImageFiltersNegativeTestJSON-261556342-project Oct 18 15:31:54.564526 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:31:54.564526 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:31:54.564526 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 1eed13e935f346b1b2f7dfb6f528aebd Oct 18 15:31:54.564526 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-261556342-project Oct 18 15:31:54.564526 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:31:54.564526 n-d-853682-5 devstack@n-api.service[120406]: exception: Image not found. Oct 18 15:31:54.564526 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '3dc6211d-2fb7-473c-ac38-56e62f2abd79'} Oct 18 15:31:54.564526 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:31:54.565564 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:54.565564 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 15:31:54.565564 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 15:31:54.565564 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 15:31:54.565564 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 15:31:54.565564 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 15:31:54.565564 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 15:31:54.565564 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 15:31:54.565564 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 15:31:54.565564 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 15:31:54.565564 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 15:31:54.565564 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 15:31:54.565564 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 15:31:54.565564 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 15:31:54.565564 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 15:31:54.565564 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 15:31:54.565564 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 15:31:54.565564 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 3dc6211d-2fb7-473c-ac38-56e62f2abd79 Oct 18 15:31:54.566838 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:31:54.566838 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:54.566838 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:31:54.566838 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:54.566838 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 18 15:31:54.566838 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 18 15:31:54.566838 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 18 15:31:54.566838 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 18 15:31:54.566838 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 18 15:31:54.566838 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 18 15:31:54.566838 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 18 15:31:54.566838 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 18 15:31:54.566838 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 15:31:54.566838 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 15:31:54.566838 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 15:31:54.566838 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 15:31:54.566838 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 15:31:54.566838 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 15:31:54.566838 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 15:31:54.566838 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 15:31:54.568244 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 15:31:54.568244 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 15:31:54.568244 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 15:31:54.568244 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 15:31:54.568244 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 15:31:54.568244 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 15:31:54.568244 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 15:31:54.568244 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 15:31:54.568244 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3dc6211d-2fb7-473c-ac38-56e62f2abd79 could not be found. Oct 18 15:31:54.568244 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:31:54.568244 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:54.568244 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:31:54.568244 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:54.568244 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:54.568244 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:54.568244 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:31:54.568244 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:31:54.568244 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:31:54.568244 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:31:54.569617 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:31:54.569617 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:31:54.569617 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 18 15:31:54.569617 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 15:31:54.569617 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 15:31:54.569617 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:31:54.569617 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:31:54.569617 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:31:54.569617 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:31:54.569617 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:31:54.569617 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:31:54.569617 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:31:54.569617 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:31:54.569617 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 15:31:54.569617 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:31:54.569617 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7084d9cb-d9f6-4912-bbfb-9a520dde77ee tempest-ListImageFiltersNegativeTestJSON-261556342 tempest-ListImageFiltersNegativeTestJSON-261556342-project] Returning 404 to user: Image not found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:31:54.570963 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7084d9cb-d9f6-4912-bbfb-9a520dde77ee tempest-ListImageFiltersNegativeTestJSON-261556342 tempest-ListImageFiltersNegativeTestJSON-261556342-project] 10.222.0.60 "GET /compute/v2.1/images/3dc6211d-2fb7-473c-ac38-56e62f2abd79" status: 404 len: 62 microversion: 2.1 time: 0.210732 Oct 18 15:31:54.570963 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 908/1860] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:31:54 2022] GET /compute/v2.1/images/3dc6211d-2fb7-473c-ac38-56e62f2abd79 => generated 62 bytes in 212 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 15:31:54.706002 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-60c2abf2-1642-4a81-8cd5-ba91d7f47bf0 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:54.708141 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-60c2abf2-1642-4a81-8cd5-ba91d7f47bf0 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] [instance: 234a024f-c13b-40de-bbcb-ffcdda611d01] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:54.719003 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60c2abf2-1642-4a81-8cd5-ba91d7f47bf0 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:54.719885 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60c2abf2-1642-4a81-8cd5-ba91d7f47bf0 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:54.721722 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60c2abf2-1642-4a81-8cd5-ba91d7f47bf0 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:54.722568 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60c2abf2-1642-4a81-8cd5-ba91d7f47bf0 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:54.723036 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60c2abf2-1642-4a81-8cd5-ba91d7f47bf0 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:54.723523 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60c2abf2-1642-4a81-8cd5-ba91d7f47bf0 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:54.731420 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3f2d6e03-1da0-42c9-a501-caab6b26b92d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:54.742025 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3f2d6e03-1da0-42c9-a501-caab6b26b92d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:54.743486 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3f2d6e03-1da0-42c9-a501-caab6b26b92d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:54.744641 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3f2d6e03-1da0-42c9-a501-caab6b26b92d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1" status: 200 len: 1280 microversion: 2.25 time: 0.381393 Oct 18 15:31:54.761242 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 953/1861] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:54 2022] GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1 => generated 1280 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:31:54.870665 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-60c2abf2-1642-4a81-8cd5-ba91d7f47bf0 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lazy-loading 'services' on Instance uuid 234a024f-c13b-40de-bbcb-ffcdda611d01 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:31:54.890106 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-60c2abf2-1642-4a81-8cd5-ba91d7f47bf0 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01" status: 200 len: 1927 microversion: 2.75 time: 0.200283 Oct 18 15:31:54.906246 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 909/1862] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:54 2022] GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01 => generated 1927 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:31:55.345543 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c15e9535-70d6-43de-be8f-a37d15a80a33 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:55.346862 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c15e9535-70d6-43de-be8f-a37d15a80a33 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:55.357950 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c15e9535-70d6-43de-be8f-a37d15a80a33 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:55.359005 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c15e9535-70d6-43de-be8f-a37d15a80a33 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:55.359437 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c15e9535-70d6-43de-be8f-a37d15a80a33 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:55.360134 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c15e9535-70d6-43de-be8f-a37d15a80a33 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:55.361859 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c15e9535-70d6-43de-be8f-a37d15a80a33 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:55.363853 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c15e9535-70d6-43de-be8f-a37d15a80a33 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:55.387834 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-96312fe1-6df4-4a2a-92da-6fbb8f711ffc tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:55.388533 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-96312fe1-6df4-4a2a-92da-6fbb8f711ffc tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] [instance: 0d0c7fc6-9245-41f3-9257-d2b8955a6d4d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:55.398133 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96312fe1-6df4-4a2a-92da-6fbb8f711ffc tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:55.398915 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96312fe1-6df4-4a2a-92da-6fbb8f711ffc tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:55.399685 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96312fe1-6df4-4a2a-92da-6fbb8f711ffc tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:55.400987 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96312fe1-6df4-4a2a-92da-6fbb8f711ffc tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:55.401747 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96312fe1-6df4-4a2a-92da-6fbb8f711ffc tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:55.402514 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96312fe1-6df4-4a2a-92da-6fbb8f711ffc tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:55.765566 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c15e9535-70d6-43de-be8f-a37d15a80a33 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:55.774612 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c15e9535-70d6-43de-be8f-a37d15a80a33 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e" status: 200 len: 1391 microversion: 2.1 time: 0.433908 Oct 18 15:31:55.775204 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 954/1863] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:55 2022] GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e => generated 1391 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:55.790391 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-423ba6c2-7125-46f6-945a-18271a1013c9 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:55.791068 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-423ba6c2-7125-46f6-945a-18271a1013c9 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 0dfb045a-8cea-41b6-bbdc-8fa6600046d1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:55.806128 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-423ba6c2-7125-46f6-945a-18271a1013c9 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:55.806626 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-423ba6c2-7125-46f6-945a-18271a1013c9 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:55.807073 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-423ba6c2-7125-46f6-945a-18271a1013c9 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:55.807790 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-423ba6c2-7125-46f6-945a-18271a1013c9 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:55.808310 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-423ba6c2-7125-46f6-945a-18271a1013c9 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:55.821369 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-423ba6c2-7125-46f6-945a-18271a1013c9 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:55.929793 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-96312fe1-6df4-4a2a-92da-6fbb8f711ffc tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f901dea4594eb6831a78e2e603e8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c369c078bd4c49148290abb7de3d076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:55.942636 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-96312fe1-6df4-4a2a-92da-6fbb8f711ffc tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/servers/0d0c7fc6-9245-41f3-9257-d2b8955a6d4d" status: 200 len: 1318 microversion: 2.1 time: 0.559486 Oct 18 15:31:55.955185 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 910/1864] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:55 2022] GET /compute/v2.1/servers/0d0c7fc6-9245-41f3-9257-d2b8955a6d4d => generated 1318 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:55.966776 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2a99c7c1-c9a3-4a6e-9fd8-5868d681f0b2 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:55.969664 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2a99c7c1-c9a3-4a6e-9fd8-5868d681f0b2 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] [instance: 234a024f-c13b-40de-bbcb-ffcdda611d01] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:55.977846 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a99c7c1-c9a3-4a6e-9fd8-5868d681f0b2 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:55.978811 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a99c7c1-c9a3-4a6e-9fd8-5868d681f0b2 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:55.979449 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a99c7c1-c9a3-4a6e-9fd8-5868d681f0b2 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:55.980404 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a99c7c1-c9a3-4a6e-9fd8-5868d681f0b2 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:55.981053 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a99c7c1-c9a3-4a6e-9fd8-5868d681f0b2 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:55.982410 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a99c7c1-c9a3-4a6e-9fd8-5868d681f0b2 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:56.150727 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-2a99c7c1-c9a3-4a6e-9fd8-5868d681f0b2 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lazy-loading 'services' on Instance uuid 234a024f-c13b-40de-bbcb-ffcdda611d01 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:31:56.170922 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2a99c7c1-c9a3-4a6e-9fd8-5868d681f0b2 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01" status: 200 len: 1927 microversion: 2.75 time: 0.214117 Oct 18 15:31:56.171790 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 911/1865] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:55 2022] GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01 => generated 1927 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:31:56.221638 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-423ba6c2-7125-46f6-945a-18271a1013c9 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:56.232690 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-423ba6c2-7125-46f6-945a-18271a1013c9 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:56.234767 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-423ba6c2-7125-46f6-945a-18271a1013c9 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:56.236173 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-423ba6c2-7125-46f6-945a-18271a1013c9 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1" status: 200 len: 1280 microversion: 2.25 time: 0.455115 Oct 18 15:31:56.246312 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 955/1866] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:55 2022] GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1 => generated 1280 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:31:56.804597 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-89caef5d-ba6e-4724-85e7-0398e445b56d tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:56.805785 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-89caef5d-ba6e-4724-85e7-0398e445b56d tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:56.813579 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89caef5d-ba6e-4724-85e7-0398e445b56d tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:56.821688 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89caef5d-ba6e-4724-85e7-0398e445b56d tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:56.823208 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89caef5d-ba6e-4724-85e7-0398e445b56d tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:56.823208 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89caef5d-ba6e-4724-85e7-0398e445b56d tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:56.824508 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89caef5d-ba6e-4724-85e7-0398e445b56d tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:56.837641 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89caef5d-ba6e-4724-85e7-0398e445b56d tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:56.972281 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-25cd9026-8486-4d38-9999-cef7ec466a34 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:56.975213 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-25cd9026-8486-4d38-9999-cef7ec466a34 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] [instance: 0d0c7fc6-9245-41f3-9257-d2b8955a6d4d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:57.005765 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-25cd9026-8486-4d38-9999-cef7ec466a34 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:57.006311 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-25cd9026-8486-4d38-9999-cef7ec466a34 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:57.007220 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-25cd9026-8486-4d38-9999-cef7ec466a34 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:57.007499 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-25cd9026-8486-4d38-9999-cef7ec466a34 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:57.008003 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-25cd9026-8486-4d38-9999-cef7ec466a34 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:57.008438 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-25cd9026-8486-4d38-9999-cef7ec466a34 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:57.578145 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-25cd9026-8486-4d38-9999-cef7ec466a34 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f901dea4594eb6831a78e2e603e8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c369c078bd4c49148290abb7de3d076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:57.589405 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-25cd9026-8486-4d38-9999-cef7ec466a34 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/servers/0d0c7fc6-9245-41f3-9257-d2b8955a6d4d" status: 200 len: 1318 microversion: 2.1 time: 0.625080 Oct 18 15:31:57.590335 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 956/1867] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:56 2022] GET /compute/v2.1/servers/0d0c7fc6-9245-41f3-9257-d2b8955a6d4d => generated 1318 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:57.602460 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-89caef5d-ba6e-4724-85e7-0398e445b56d tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:57.608149 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5ff0b6be-1497-459d-8984-edcaa78fceb7 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:57.608780 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5ff0b6be-1497-459d-8984-edcaa78fceb7 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] [instance: 234a024f-c13b-40de-bbcb-ffcdda611d01] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:57.626015 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-89caef5d-ba6e-4724-85e7-0398e445b56d tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e" status: 200 len: 1391 microversion: 2.1 time: 0.827002 Oct 18 15:31:57.626846 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 912/1868] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:56 2022] GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e => generated 1391 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:57.633751 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6b1e10e0-8703-4293-81ce-005b48f63f34 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:57.634358 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6b1e10e0-8703-4293-81ce-005b48f63f34 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 0dfb045a-8cea-41b6-bbdc-8fa6600046d1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:57.638577 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5ff0b6be-1497-459d-8984-edcaa78fceb7 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:57.639081 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5ff0b6be-1497-459d-8984-edcaa78fceb7 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:57.640108 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5ff0b6be-1497-459d-8984-edcaa78fceb7 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:57.640840 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5ff0b6be-1497-459d-8984-edcaa78fceb7 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:57.641312 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5ff0b6be-1497-459d-8984-edcaa78fceb7 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:57.641910 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5ff0b6be-1497-459d-8984-edcaa78fceb7 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:57.657188 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b1e10e0-8703-4293-81ce-005b48f63f34 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:57.665536 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b1e10e0-8703-4293-81ce-005b48f63f34 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:57.665988 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b1e10e0-8703-4293-81ce-005b48f63f34 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:57.666738 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b1e10e0-8703-4293-81ce-005b48f63f34 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:57.667203 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b1e10e0-8703-4293-81ce-005b48f63f34 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:57.667630 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b1e10e0-8703-4293-81ce-005b48f63f34 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:57.719627 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=100 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:31:57.727253 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:31:57.907108 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-5ff0b6be-1497-459d-8984-edcaa78fceb7 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lazy-loading 'services' on Instance uuid 234a024f-c13b-40de-bbcb-ffcdda611d01 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:31:57.939375 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5ff0b6be-1497-459d-8984-edcaa78fceb7 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01" status: 200 len: 1927 microversion: 2.75 time: 0.347979 Oct 18 15:31:57.940721 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 957/1869] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:57 2022] GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01 => generated 1927 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:31:58.209718 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6b1e10e0-8703-4293-81ce-005b48f63f34 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:58.232931 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6b1e10e0-8703-4293-81ce-005b48f63f34 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:58.236409 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6b1e10e0-8703-4293-81ce-005b48f63f34 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:58.238824 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6b1e10e0-8703-4293-81ce-005b48f63f34 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1" status: 200 len: 1280 microversion: 2.25 time: 0.608662 Oct 18 15:31:58.241170 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 913/1870] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:57 2022] GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1 => generated 1280 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:31:58.617144 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-16570054-f148-4901-af77-8ab1ee514443 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:58.617784 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-16570054-f148-4901-af77-8ab1ee514443 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] [instance: 0d0c7fc6-9245-41f3-9257-d2b8955a6d4d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:58.630637 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-16570054-f148-4901-af77-8ab1ee514443 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:58.635607 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-16570054-f148-4901-af77-8ab1ee514443 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:58.636330 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-16570054-f148-4901-af77-8ab1ee514443 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:58.637584 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-16570054-f148-4901-af77-8ab1ee514443 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:58.638067 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-16570054-f148-4901-af77-8ab1ee514443 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:58.638499 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-16570054-f148-4901-af77-8ab1ee514443 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:58.658351 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-68fead00-e73c-43da-b0d9-d5e14b2e0287 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:58.662561 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-68fead00-e73c-43da-b0d9-d5e14b2e0287 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:58.678677 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68fead00-e73c-43da-b0d9-d5e14b2e0287 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:58.699046 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68fead00-e73c-43da-b0d9-d5e14b2e0287 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:58.700144 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68fead00-e73c-43da-b0d9-d5e14b2e0287 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:58.702844 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68fead00-e73c-43da-b0d9-d5e14b2e0287 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:58.705493 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68fead00-e73c-43da-b0d9-d5e14b2e0287 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:58.706446 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68fead00-e73c-43da-b0d9-d5e14b2e0287 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:59.170176 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-68fead00-e73c-43da-b0d9-d5e14b2e0287 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:59.184777 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-68fead00-e73c-43da-b0d9-d5e14b2e0287 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e" status: 200 len: 1391 microversion: 2.1 time: 0.530918 Oct 18 15:31:59.202099 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 914/1871] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:58 2022] GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e => generated 1391 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:59.223699 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-16570054-f148-4901-af77-8ab1ee514443 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f901dea4594eb6831a78e2e603e8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c369c078bd4c49148290abb7de3d076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:59.229714 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-f3d0f3ad-c1c7-4ad9-8f0a-e419d35d6629 req-4df82002-29bf-4ea4-b078-cb693190b5d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e1ae723-8f58-4752-b578-da0b39e9a668", "name": "network-vif-plugged", "status": "completed", "tag": "2083c6f4-97f8-4301-a307-2ecb7417f192"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:31:59.232754 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-16570054-f148-4901-af77-8ab1ee514443 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/servers/0d0c7fc6-9245-41f3-9257-d2b8955a6d4d" status: 200 len: 1318 microversion: 2.1 time: 0.621951 Oct 18 15:31:59.253936 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f3d0f3ad-c1c7-4ad9-8f0a-e419d35d6629 req-4df82002-29bf-4ea4-b078-cb693190b5d3 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:59.257095 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f3d0f3ad-c1c7-4ad9-8f0a-e419d35d6629 req-4df82002-29bf-4ea4-b078-cb693190b5d3 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:59.257548 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f3d0f3ad-c1c7-4ad9-8f0a-e419d35d6629 req-4df82002-29bf-4ea4-b078-cb693190b5d3 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:59.270965 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 958/1872] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:31:58 2022] GET /compute/v2.1/servers/0d0c7fc6-9245-41f3-9257-d2b8955a6d4d => generated 1318 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:31:59.276525 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-31d00649-3e22-4d53-8f10-d86c685ff3df tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:59.277462 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-31d00649-3e22-4d53-8f10-d86c685ff3df tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] [instance: 234a024f-c13b-40de-bbcb-ffcdda611d01] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:59.279643 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-f3d0f3ad-c1c7-4ad9-8f0a-e419d35d6629 req-4df82002-29bf-4ea4-b078-cb693190b5d3 service nova] Creating event network-vif-plugged:2083c6f4-97f8-4301-a307-2ecb7417f192 for instance 4e1ae723-8f58-4752-b578-da0b39e9a668 on n-h1-853682-5 Oct 18 15:31:59.290725 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-31d00649-3e22-4d53-8f10-d86c685ff3df tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:59.293415 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-31d00649-3e22-4d53-8f10-d86c685ff3df tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:59.294590 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-31d00649-3e22-4d53-8f10-d86c685ff3df tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:59.296391 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-f3d0f3ad-c1c7-4ad9-8f0a-e419d35d6629 req-4df82002-29bf-4ea4-b078-cb693190b5d3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087900 Oct 18 15:31:59.297392 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-31d00649-3e22-4d53-8f10-d86c685ff3df tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:59.298093 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-31d00649-3e22-4d53-8f10-d86c685ff3df tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:59.298686 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-31d00649-3e22-4d53-8f10-d86c685ff3df tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:59.301263 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 915/1873] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:31:59.311918 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ce503c1b-a507-4579-a825-9bd80edd1b3b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:31:59.313231 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ce503c1b-a507-4579-a825-9bd80edd1b3b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 0dfb045a-8cea-41b6-bbdc-8fa6600046d1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:31:59.320402 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce503c1b-a507-4579-a825-9bd80edd1b3b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:59.321402 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce503c1b-a507-4579-a825-9bd80edd1b3b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:59.322151 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce503c1b-a507-4579-a825-9bd80edd1b3b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:59.323318 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce503c1b-a507-4579-a825-9bd80edd1b3b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:31:59.324167 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce503c1b-a507-4579-a825-9bd80edd1b3b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:31:59.324794 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce503c1b-a507-4579-a825-9bd80edd1b3b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:31:59.482619 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-31d00649-3e22-4d53-8f10-d86c685ff3df tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lazy-loading 'services' on Instance uuid 234a024f-c13b-40de-bbcb-ffcdda611d01 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:31:59.532945 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-31d00649-3e22-4d53-8f10-d86c685ff3df tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01" status: 200 len: 1927 microversion: 2.75 time: 0.260069 Oct 18 15:31:59.546820 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 959/1874] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:59 2022] GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01 => generated 1927 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:31:59.856113 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ce503c1b-a507-4579-a825-9bd80edd1b3b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:59.870809 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ce503c1b-a507-4579-a825-9bd80edd1b3b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:59.872317 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ce503c1b-a507-4579-a825-9bd80edd1b3b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:31:59.879263 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ce503c1b-a507-4579-a825-9bd80edd1b3b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1" status: 200 len: 1280 microversion: 2.25 time: 0.571025 Oct 18 15:31:59.883122 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 916/1875] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:31:59 2022] GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1 => generated 1280 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:32:00.218181 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-cf8b3da3-6a12-48e0-8877-95f070626f4c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:00.219576 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-cf8b3da3-6a12-48e0-8877-95f070626f4c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:00.232453 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cf8b3da3-6a12-48e0-8877-95f070626f4c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:00.233726 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cf8b3da3-6a12-48e0-8877-95f070626f4c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:00.234654 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cf8b3da3-6a12-48e0-8877-95f070626f4c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:00.236066 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cf8b3da3-6a12-48e0-8877-95f070626f4c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:00.236909 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cf8b3da3-6a12-48e0-8877-95f070626f4c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:00.237774 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cf8b3da3-6a12-48e0-8877-95f070626f4c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:00.279265 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ec7fdc24-4152-455e-b455-7f16a48d920f tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:00.280756 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ec7fdc24-4152-455e-b455-7f16a48d920f tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] [instance: 0d0c7fc6-9245-41f3-9257-d2b8955a6d4d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:00.293653 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec7fdc24-4152-455e-b455-7f16a48d920f tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:00.295040 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec7fdc24-4152-455e-b455-7f16a48d920f tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:00.296560 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec7fdc24-4152-455e-b455-7f16a48d920f tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:00.300454 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec7fdc24-4152-455e-b455-7f16a48d920f tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:00.302153 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec7fdc24-4152-455e-b455-7f16a48d920f tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:00.303946 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec7fdc24-4152-455e-b455-7f16a48d920f tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:00.677253 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-cf8b3da3-6a12-48e0-8877-95f070626f4c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:00.707580 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-cf8b3da3-6a12-48e0-8877-95f070626f4c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e" status: 200 len: 1391 microversion: 2.1 time: 0.495570 Oct 18 15:32:00.721543 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 960/1876] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:32:00 2022] GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e => generated 1391 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:32:00.732011 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3545da71-c0e7-41dc-a963-8872953c920e tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:00.732696 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3545da71-c0e7-41dc-a963-8872953c920e tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] [instance: 234a024f-c13b-40de-bbcb-ffcdda611d01] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:00.750677 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3545da71-c0e7-41dc-a963-8872953c920e tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:00.751498 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3545da71-c0e7-41dc-a963-8872953c920e tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:00.751652 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3545da71-c0e7-41dc-a963-8872953c920e tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:00.754111 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3545da71-c0e7-41dc-a963-8872953c920e tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:00.754972 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3545da71-c0e7-41dc-a963-8872953c920e tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:00.756494 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3545da71-c0e7-41dc-a963-8872953c920e tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:00.787119 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ec7fdc24-4152-455e-b455-7f16a48d920f tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f901dea4594eb6831a78e2e603e8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c369c078bd4c49148290abb7de3d076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:00.800688 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ec7fdc24-4152-455e-b455-7f16a48d920f tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/servers/0d0c7fc6-9245-41f3-9257-d2b8955a6d4d" status: 200 len: 1318 microversion: 2.1 time: 0.525779 Oct 18 15:32:00.801669 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 917/1877] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:32:00 2022] GET /compute/v2.1/servers/0d0c7fc6-9245-41f3-9257-d2b8955a6d4d => generated 1318 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:32:00.912152 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c43d755d-2bc3-496b-8826-5cce71591d07 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:00.912776 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c43d755d-2bc3-496b-8826-5cce71591d07 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 0dfb045a-8cea-41b6-bbdc-8fa6600046d1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:00.925727 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c43d755d-2bc3-496b-8826-5cce71591d07 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:00.926284 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c43d755d-2bc3-496b-8826-5cce71591d07 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:00.926998 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c43d755d-2bc3-496b-8826-5cce71591d07 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:00.927894 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c43d755d-2bc3-496b-8826-5cce71591d07 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:00.928454 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c43d755d-2bc3-496b-8826-5cce71591d07 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:00.931641 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c43d755d-2bc3-496b-8826-5cce71591d07 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:00.938915 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-3545da71-c0e7-41dc-a963-8872953c920e tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lazy-loading 'services' on Instance uuid 234a024f-c13b-40de-bbcb-ffcdda611d01 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:32:00.961367 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3545da71-c0e7-41dc-a963-8872953c920e tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01" status: 200 len: 1927 microversion: 2.75 time: 0.239515 Oct 18 15:32:00.962571 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 961/1878] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:32:00 2022] GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01 => generated 1927 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:32:00.968248 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-0d46348e-3cba-45ab-8940-c6b5ef88199e req-6e1c1174-8ac0-435c-8d7d-2237dd73b5a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da62499c-f590-4083-80b6-b849b6695c4e", "name": "network-vif-unplugged", "status": "completed", "tag": "e34ef547-0315-4841-b1d6-53dcfae3bb30"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:32:00.978509 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-0d46348e-3cba-45ab-8940-c6b5ef88199e req-6e1c1174-8ac0-435c-8d7d-2237dd73b5a2 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:00.979289 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-0d46348e-3cba-45ab-8940-c6b5ef88199e req-6e1c1174-8ac0-435c-8d7d-2237dd73b5a2 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:00.979887 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-0d46348e-3cba-45ab-8940-c6b5ef88199e req-6e1c1174-8ac0-435c-8d7d-2237dd73b5a2 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:00.993051 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-0d46348e-3cba-45ab-8940-c6b5ef88199e req-6e1c1174-8ac0-435c-8d7d-2237dd73b5a2 service nova] Creating event network-vif-unplugged:e34ef547-0315-4841-b1d6-53dcfae3bb30 for instance da62499c-f590-4083-80b6-b849b6695c4e on n-h1-853682-5 Oct 18 15:32:00.999494 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-0d46348e-3cba-45ab-8940-c6b5ef88199e req-6e1c1174-8ac0-435c-8d7d-2237dd73b5a2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034788 Oct 18 15:32:01.001262 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 962/1879] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:32:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:32:01.362344 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-b9e08a79-88f8-4667-88f0-f435b6ad47b8 req-606dd7b8-b42f-451a-9480-2003eb4254c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dfb045a-8cea-41b6-bbdc-8fa6600046d1", "name": "network-vif-plugged", "status": "completed", "tag": "8b71a6b8-e604-4cd4-9224-71a40ab44fd3"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:32:01.381622 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c43d755d-2bc3-496b-8826-5cce71591d07 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:01.388233 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-b9e08a79-88f8-4667-88f0-f435b6ad47b8 req-606dd7b8-b42f-451a-9480-2003eb4254c2 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:01.389132 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-b9e08a79-88f8-4667-88f0-f435b6ad47b8 req-606dd7b8-b42f-451a-9480-2003eb4254c2 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:01.393430 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-b9e08a79-88f8-4667-88f0-f435b6ad47b8 req-606dd7b8-b42f-451a-9480-2003eb4254c2 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:01.398856 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c43d755d-2bc3-496b-8826-5cce71591d07 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:01.400646 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c43d755d-2bc3-496b-8826-5cce71591d07 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:01.401849 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c43d755d-2bc3-496b-8826-5cce71591d07 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1" status: 200 len: 1280 microversion: 2.25 time: 0.493994 Oct 18 15:32:01.408724 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 918/1880] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:32:00 2022] GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1 => generated 1280 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:32:01.425334 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-b9e08a79-88f8-4667-88f0-f435b6ad47b8 req-606dd7b8-b42f-451a-9480-2003eb4254c2 service nova] Creating event network-vif-plugged:8b71a6b8-e604-4cd4-9224-71a40ab44fd3 for instance 0dfb045a-8cea-41b6-bbdc-8fa6600046d1 on n-h2-853682-5 Oct 18 15:32:01.437061 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-b9e08a79-88f8-4667-88f0-f435b6ad47b8 req-606dd7b8-b42f-451a-9480-2003eb4254c2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092999 Oct 18 15:32:01.438493 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 963/1881] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:32:01.750787 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-62b5eea9-00bc-4758-a22b-f4323562c6a7 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:01.762243 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-62b5eea9-00bc-4758-a22b-f4323562c6a7 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:01.773356 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62b5eea9-00bc-4758-a22b-f4323562c6a7 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:01.775369 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62b5eea9-00bc-4758-a22b-f4323562c6a7 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:01.776178 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62b5eea9-00bc-4758-a22b-f4323562c6a7 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:01.782455 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62b5eea9-00bc-4758-a22b-f4323562c6a7 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:01.783323 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62b5eea9-00bc-4758-a22b-f4323562c6a7 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:01.783984 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62b5eea9-00bc-4758-a22b-f4323562c6a7 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:01.829171 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1a2bde36-486a-4771-a920-69defcb01e63 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:01.830367 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1a2bde36-486a-4771-a920-69defcb01e63 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] [instance: 0d0c7fc6-9245-41f3-9257-d2b8955a6d4d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:01.853453 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1a2bde36-486a-4771-a920-69defcb01e63 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:01.855689 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1a2bde36-486a-4771-a920-69defcb01e63 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:01.856622 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1a2bde36-486a-4771-a920-69defcb01e63 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:01.857718 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1a2bde36-486a-4771-a920-69defcb01e63 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:01.859706 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1a2bde36-486a-4771-a920-69defcb01e63 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:01.860443 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1a2bde36-486a-4771-a920-69defcb01e63 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:03.014039 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-62b5eea9-00bc-4758-a22b-f4323562c6a7 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:03.038532 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-62b5eea9-00bc-4758-a22b-f4323562c6a7 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e" status: 200 len: 1391 microversion: 2.1 time: 1.300161 Oct 18 15:32:03.040877 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 919/1882] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:32:01 2022] GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e => generated 1391 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:32:03.057667 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-86ea04e2-daca-4b97-932a-9efed49d62fe tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:03.059085 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-86ea04e2-daca-4b97-932a-9efed49d62fe tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] [instance: 234a024f-c13b-40de-bbcb-ffcdda611d01] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:03.102489 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86ea04e2-daca-4b97-932a-9efed49d62fe tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:03.103438 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86ea04e2-daca-4b97-932a-9efed49d62fe tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:03.104688 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86ea04e2-daca-4b97-932a-9efed49d62fe tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:03.107398 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86ea04e2-daca-4b97-932a-9efed49d62fe tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:03.108756 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86ea04e2-daca-4b97-932a-9efed49d62fe tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:03.110084 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86ea04e2-daca-4b97-932a-9efed49d62fe tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:03.189630 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1a2bde36-486a-4771-a920-69defcb01e63 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f901dea4594eb6831a78e2e603e8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c369c078bd4c49148290abb7de3d076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:03.199486 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1a2bde36-486a-4771-a920-69defcb01e63 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/servers/0d0c7fc6-9245-41f3-9257-d2b8955a6d4d" status: 200 len: 1318 microversion: 2.1 time: 1.376327 Oct 18 15:32:03.211077 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 964/1883] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:32:01 2022] GET /compute/v2.1/servers/0d0c7fc6-9245-41f3-9257-d2b8955a6d4d => generated 1318 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:32:03.225188 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5d78678f-bb57-4c42-874b-4b9ab476be1e tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:03.226236 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5d78678f-bb57-4c42-874b-4b9ab476be1e tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 0dfb045a-8cea-41b6-bbdc-8fa6600046d1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:03.248193 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5d78678f-bb57-4c42-874b-4b9ab476be1e tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:03.251065 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5d78678f-bb57-4c42-874b-4b9ab476be1e tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:03.252131 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5d78678f-bb57-4c42-874b-4b9ab476be1e tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:03.257992 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5d78678f-bb57-4c42-874b-4b9ab476be1e tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:03.259402 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5d78678f-bb57-4c42-874b-4b9ab476be1e tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:03.260458 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5d78678f-bb57-4c42-874b-4b9ab476be1e tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:03.294783 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-86ea04e2-daca-4b97-932a-9efed49d62fe tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lazy-loading 'services' on Instance uuid 234a024f-c13b-40de-bbcb-ffcdda611d01 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:32:03.324640 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-86ea04e2-daca-4b97-932a-9efed49d62fe tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01" status: 200 len: 1927 microversion: 2.75 time: 0.280122 Oct 18 15:32:03.343008 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 920/1884] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:32:03 2022] GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01 => generated 1927 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:32:03.354577 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-89d51458-432a-4ebb-b1cb-040640ac2b6d req-9191af10-e183-4650-8122-7acfabb14f6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da62499c-f590-4083-80b6-b849b6695c4e", "tag": "e34ef547-0315-4841-b1d6-53dcfae3bb30"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:32:03.369855 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-89d51458-432a-4ebb-b1cb-040640ac2b6d req-9191af10-e183-4650-8122-7acfabb14f6b service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:03.370587 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-89d51458-432a-4ebb-b1cb-040640ac2b6d req-9191af10-e183-4650-8122-7acfabb14f6b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:03.372515 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-89d51458-432a-4ebb-b1cb-040640ac2b6d req-9191af10-e183-4650-8122-7acfabb14f6b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:03.387049 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-89d51458-432a-4ebb-b1cb-040640ac2b6d req-9191af10-e183-4650-8122-7acfabb14f6b service nova] Creating event network-changed:e34ef547-0315-4841-b1d6-53dcfae3bb30 for instance da62499c-f590-4083-80b6-b849b6695c4e on n-h1-853682-5 Oct 18 15:32:03.399120 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-89d51458-432a-4ebb-b1cb-040640ac2b6d req-9191af10-e183-4650-8122-7acfabb14f6b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053949 Oct 18 15:32:03.400307 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 921/1885] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:32:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:32:03.797872 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5d78678f-bb57-4c42-874b-4b9ab476be1e tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:03.807435 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5d78678f-bb57-4c42-874b-4b9ab476be1e tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:03.812010 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5d78678f-bb57-4c42-874b-4b9ab476be1e tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:03.813398 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5d78678f-bb57-4c42-874b-4b9ab476be1e tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1" status: 200 len: 1476 microversion: 2.25 time: 0.594555 Oct 18 15:32:03.814381 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 965/1886] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:32:03 2022] GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1 => generated 1476 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:32:03.842711 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b5c1e6f5-9f3c-43f6-92a8-c45fb9804dac tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:03.843788 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b5c1e6f5-9f3c-43f6-92a8-c45fb9804dac tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] [instance: 0dfb045a-8cea-41b6-bbdc-8fa6600046d1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:03.852678 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5c1e6f5-9f3c-43f6-92a8-c45fb9804dac tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:03.853804 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5c1e6f5-9f3c-43f6-92a8-c45fb9804dac tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:03.854673 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5c1e6f5-9f3c-43f6-92a8-c45fb9804dac tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:03.855853 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5c1e6f5-9f3c-43f6-92a8-c45fb9804dac tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:03.856688 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5c1e6f5-9f3c-43f6-92a8-c45fb9804dac tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:03.857504 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5c1e6f5-9f3c-43f6-92a8-c45fb9804dac tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:03.973498 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-626f19d3-5675-4fe3-9903-bc4ca8aa0097 req-81ebcdef-f763-4416-a7a7-8cc40068c40e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d0c7fc6-9245-41f3-9257-d2b8955a6d4d", "name": "network-vif-plugged", "status": "completed", "tag": "ccf2639c-dfaf-46eb-a27f-c279d0c6c5c1"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:32:04.003269 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-626f19d3-5675-4fe3-9903-bc4ca8aa0097 req-81ebcdef-f763-4416-a7a7-8cc40068c40e service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:04.005324 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-626f19d3-5675-4fe3-9903-bc4ca8aa0097 req-81ebcdef-f763-4416-a7a7-8cc40068c40e service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:04.007459 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-626f19d3-5675-4fe3-9903-bc4ca8aa0097 req-81ebcdef-f763-4416-a7a7-8cc40068c40e service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:04.042182 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-626f19d3-5675-4fe3-9903-bc4ca8aa0097 req-81ebcdef-f763-4416-a7a7-8cc40068c40e service nova] Creating event network-vif-plugged:ccf2639c-dfaf-46eb-a27f-c279d0c6c5c1 for instance 0d0c7fc6-9245-41f3-9257-d2b8955a6d4d on n-h1-853682-5 Oct 18 15:32:04.058514 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-626f19d3-5675-4fe3-9903-bc4ca8aa0097 req-81ebcdef-f763-4416-a7a7-8cc40068c40e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089415 Oct 18 15:32:04.062479 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 966/1887] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:32:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:32:04.080485 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-96a06ced-b544-458d-b34d-a0d3f4747c5a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:04.081950 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-96a06ced-b544-458d-b34d-a0d3f4747c5a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:04.107355 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-96a06ced-b544-458d-b34d-a0d3f4747c5a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:04.111647 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-96a06ced-b544-458d-b34d-a0d3f4747c5a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:04.119119 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-96a06ced-b544-458d-b34d-a0d3f4747c5a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:04.121772 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-96a06ced-b544-458d-b34d-a0d3f4747c5a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:04.125552 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-96a06ced-b544-458d-b34d-a0d3f4747c5a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:04.126352 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-96a06ced-b544-458d-b34d-a0d3f4747c5a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:04.839995 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-b5c1e6f5-9f3c-43f6-92a8-c45fb9804dac tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lazy-loading 'services' on Instance uuid 0dfb045a-8cea-41b6-bbdc-8fa6600046d1 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:32:04.860681 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b5c1e6f5-9f3c-43f6-92a8-c45fb9804dac tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1" status: 200 len: 1968 microversion: 2.25 time: 1.021775 Oct 18 15:32:04.862223 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 922/1888] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:32:03 2022] GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1 => generated 1968 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:32:04.867752 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e8c8e42e-7af3-4a4e-a388-5aa38a0cf54d tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:04.868715 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e8c8e42e-7af3-4a4e-a388-5aa38a0cf54d tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] [instance: 0d0c7fc6-9245-41f3-9257-d2b8955a6d4d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:04.875520 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8c8e42e-7af3-4a4e-a388-5aa38a0cf54d tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:04.876248 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8c8e42e-7af3-4a4e-a388-5aa38a0cf54d tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:04.877191 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-96a06ced-b544-458d-b34d-a0d3f4747c5a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:04.877789 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8c8e42e-7af3-4a4e-a388-5aa38a0cf54d tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:04.878873 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8c8e42e-7af3-4a4e-a388-5aa38a0cf54d tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:04.879694 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8c8e42e-7af3-4a4e-a388-5aa38a0cf54d tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:04.881452 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8c8e42e-7af3-4a4e-a388-5aa38a0cf54d tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:04.892089 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-96a06ced-b544-458d-b34d-a0d3f4747c5a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e" status: 200 len: 1391 microversion: 2.1 time: 0.826103 Oct 18 15:32:04.892360 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 967/1889] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:32:04 2022] GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e => generated 1391 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:32:04.915390 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e4529df0-6a86-48a2-9735-c889fbd18ad2 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:04.916154 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e4529df0-6a86-48a2-9735-c889fbd18ad2 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] [instance: 234a024f-c13b-40de-bbcb-ffcdda611d01] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:04.943753 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4529df0-6a86-48a2-9735-c889fbd18ad2 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:04.944249 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4529df0-6a86-48a2-9735-c889fbd18ad2 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:04.945130 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4529df0-6a86-48a2-9735-c889fbd18ad2 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:04.945452 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4529df0-6a86-48a2-9735-c889fbd18ad2 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:04.945929 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4529df0-6a86-48a2-9735-c889fbd18ad2 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:04.953513 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4529df0-6a86-48a2-9735-c889fbd18ad2 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:05.274993 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-e4529df0-6a86-48a2-9735-c889fbd18ad2 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lazy-loading 'services' on Instance uuid 234a024f-c13b-40de-bbcb-ffcdda611d01 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:32:05.316080 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e4529df0-6a86-48a2-9735-c889fbd18ad2 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01" status: 200 len: 1927 microversion: 2.75 time: 0.422667 Oct 18 15:32:05.318394 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 968/1890] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:32:04 2022] GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01 => generated 1927 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:32:05.332176 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6bc9e31c-f198-401a-9f33-e470cee8ec2a tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:05.333448 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6bc9e31c-f198-401a-9f33-e470cee8ec2a tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] [instance: 0dfb045a-8cea-41b6-bbdc-8fa6600046d1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:05.336781 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=100 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:32:05.349296 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6bc9e31c-f198-401a-9f33-e470cee8ec2a tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:05.353099 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6bc9e31c-f198-401a-9f33-e470cee8ec2a tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:05.353922 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6bc9e31c-f198-401a-9f33-e470cee8ec2a tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:05.354860 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6bc9e31c-f198-401a-9f33-e470cee8ec2a tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:05.355560 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6bc9e31c-f198-401a-9f33-e470cee8ec2a tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:05.356237 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6bc9e31c-f198-401a-9f33-e470cee8ec2a tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:05.379289 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e8c8e42e-7af3-4a4e-a388-5aa38a0cf54d tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f901dea4594eb6831a78e2e603e8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c369c078bd4c49148290abb7de3d076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:05.390890 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e8c8e42e-7af3-4a4e-a388-5aa38a0cf54d tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/servers/0d0c7fc6-9245-41f3-9257-d2b8955a6d4d" status: 200 len: 1318 microversion: 2.1 time: 0.527130 Oct 18 15:32:05.391726 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 923/1891] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:32:04 2022] GET /compute/v2.1/servers/0d0c7fc6-9245-41f3-9257-d2b8955a6d4d => generated 1318 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:32:05.735286 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-6bc9e31c-f198-401a-9f33-e470cee8ec2a tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lazy-loading 'services' on Instance uuid 0dfb045a-8cea-41b6-bbdc-8fa6600046d1 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:32:05.772662 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6bc9e31c-f198-401a-9f33-e470cee8ec2a tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1" status: 200 len: 1968 microversion: 2.25 time: 0.447825 Oct 18 15:32:05.773913 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 969/1892] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:32:05 2022] GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1 => generated 1968 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:32:05.806048 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a4a1334c-b384-4878-8d01-6080e8ef1a57 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:05.820151 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4a1334c-b384-4878-8d01-6080e8ef1a57 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:05.821192 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4a1334c-b384-4878-8d01-6080e8ef1a57 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:05.822203 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4a1334c-b384-4878-8d01-6080e8ef1a57 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:05.825819 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4a1334c-b384-4878-8d01-6080e8ef1a57 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:05.827305 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4a1334c-b384-4878-8d01-6080e8ef1a57 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:05.829396 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4a1334c-b384-4878-8d01-6080e8ef1a57 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:05.925250 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c4c57852-c8e0-4f3a-bffa-aa16638c18a6 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:05.925916 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c4c57852-c8e0-4f3a-bffa-aa16638c18a6 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:05.955445 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c4c57852-c8e0-4f3a-bffa-aa16638c18a6 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:05.958669 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c4c57852-c8e0-4f3a-bffa-aa16638c18a6 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:05.959418 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c4c57852-c8e0-4f3a-bffa-aa16638c18a6 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:05.963145 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c4c57852-c8e0-4f3a-bffa-aa16638c18a6 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:05.964584 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c4c57852-c8e0-4f3a-bffa-aa16638c18a6 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:05.969099 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c4c57852-c8e0-4f3a-bffa-aa16638c18a6 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:06.004159 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a4a1334c-b384-4878-8d01-6080e8ef1a57 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.202691 Oct 18 15:32:06.010092 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 924/1893] 10.222.0.60 () {60 vars in 1217 bytes} [Tue Oct 18 15:32:05 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:32:06.023509 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1fb3629f-f98a-474d-af7e-02735379ff04 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-853682-5", "block_migration": "auto"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:32:06.031256 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1fb3629f-f98a-474d-af7e-02735379ff04 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] [instance: 0dfb045a-8cea-41b6-bbdc-8fa6600046d1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:06.050721 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1fb3629f-f98a-474d-af7e-02735379ff04 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:06.052959 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1fb3629f-f98a-474d-af7e-02735379ff04 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:06.053727 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1fb3629f-f98a-474d-af7e-02735379ff04 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:06.058087 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1fb3629f-f98a-474d-af7e-02735379ff04 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:06.059546 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1fb3629f-f98a-474d-af7e-02735379ff04 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:06.061687 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1fb3629f-f98a-474d-af7e-02735379ff04 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:06.131426 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-1fb3629f-f98a-474d-af7e-02735379ff04 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lazy-loading 'flavor' on Instance uuid 0dfb045a-8cea-41b6-bbdc-8fa6600046d1 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:32:06.168946 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1fb3629f-f98a-474d-af7e-02735379ff04 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] [instance: 0dfb045a-8cea-41b6-bbdc-8fa6600046d1] Going to try to live migrate instance to n-h1-853682-5 {{(pid=120406) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 18 15:32:06.209103 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:32:06.772373 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c4c57852-c8e0-4f3a-bffa-aa16638c18a6 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:06.802212 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c4c57852-c8e0-4f3a-bffa-aa16638c18a6 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e" status: 200 len: 1391 microversion: 2.1 time: 0.881001 Oct 18 15:32:06.805414 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 970/1894] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:32:05 2022] GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e => generated 1391 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:32:06.833661 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-23c85254-f7de-4474-8842-e9453fde16cd tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:06.835146 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-23c85254-f7de-4474-8842-e9453fde16cd tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] [instance: 234a024f-c13b-40de-bbcb-ffcdda611d01] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:06.861465 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-23c85254-f7de-4474-8842-e9453fde16cd tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:06.867604 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-23c85254-f7de-4474-8842-e9453fde16cd tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:06.868489 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-23c85254-f7de-4474-8842-e9453fde16cd tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:06.869592 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-23c85254-f7de-4474-8842-e9453fde16cd tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:06.870306 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-23c85254-f7de-4474-8842-e9453fde16cd tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:06.876052 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-23c85254-f7de-4474-8842-e9453fde16cd tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:07.076161 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-23c85254-f7de-4474-8842-e9453fde16cd tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lazy-loading 'services' on Instance uuid 234a024f-c13b-40de-bbcb-ffcdda611d01 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:32:07.131245 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-23c85254-f7de-4474-8842-e9453fde16cd tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01" status: 200 len: 1927 microversion: 2.75 time: 0.323691 Oct 18 15:32:07.134660 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 971/1895] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:32:06 2022] GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01 => generated 1927 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:32:07.173317 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-555a8e39-3300-4d18-8c69-3eca21e62041 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:07.174051 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-555a8e39-3300-4d18-8c69-3eca21e62041 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] [instance: 0d0c7fc6-9245-41f3-9257-d2b8955a6d4d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:07.189413 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-555a8e39-3300-4d18-8c69-3eca21e62041 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:07.190821 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-555a8e39-3300-4d18-8c69-3eca21e62041 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:07.192676 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-555a8e39-3300-4d18-8c69-3eca21e62041 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:07.194054 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-555a8e39-3300-4d18-8c69-3eca21e62041 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:07.195317 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-555a8e39-3300-4d18-8c69-3eca21e62041 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:07.197356 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-555a8e39-3300-4d18-8c69-3eca21e62041 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:07.975997 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-555a8e39-3300-4d18-8c69-3eca21e62041 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f901dea4594eb6831a78e2e603e8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c369c078bd4c49148290abb7de3d076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:07.987248 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-555a8e39-3300-4d18-8c69-3eca21e62041 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/servers/0d0c7fc6-9245-41f3-9257-d2b8955a6d4d" status: 200 len: 1468 microversion: 2.1 time: 0.841141 Oct 18 15:32:07.998211 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 972/1896] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:32:07 2022] GET /compute/v2.1/servers/0d0c7fc6-9245-41f3-9257-d2b8955a6d4d => generated 1468 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:32:08.003535 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-12dd61c3-9e2f-4ffc-ae19-e8df7b8b0ba0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:08.004570 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-12dd61c3-9e2f-4ffc-ae19-e8df7b8b0ba0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:08.012176 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12dd61c3-9e2f-4ffc-ae19-e8df7b8b0ba0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:08.013067 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12dd61c3-9e2f-4ffc-ae19-e8df7b8b0ba0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:08.014270 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12dd61c3-9e2f-4ffc-ae19-e8df7b8b0ba0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:08.015445 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12dd61c3-9e2f-4ffc-ae19-e8df7b8b0ba0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:08.016373 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12dd61c3-9e2f-4ffc-ae19-e8df7b8b0ba0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:08.017035 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12dd61c3-9e2f-4ffc-ae19-e8df7b8b0ba0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:09.094292 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-12dd61c3-9e2f-4ffc-ae19-e8df7b8b0ba0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:09.115313 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-12dd61c3-9e2f-4ffc-ae19-e8df7b8b0ba0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e" status: 200 len: 1391 microversion: 2.1 time: 1.115503 Oct 18 15:32:09.136196 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 973/1897] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:32:07 2022] GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e => generated 1391 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:32:09.167259 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d5f5505e-0d52-4a88-b87c-602bb4f4eab5 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:09.169611 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d5f5505e-0d52-4a88-b87c-602bb4f4eab5 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] [instance: 4e1ae723-8f58-4752-b578-da0b39e9a668] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:09.197656 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d5f5505e-0d52-4a88-b87c-602bb4f4eab5 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:09.204361 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d5f5505e-0d52-4a88-b87c-602bb4f4eab5 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:09.205943 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d5f5505e-0d52-4a88-b87c-602bb4f4eab5 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:09.207710 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d5f5505e-0d52-4a88-b87c-602bb4f4eab5 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:09.212365 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d5f5505e-0d52-4a88-b87c-602bb4f4eab5 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:09.213220 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d5f5505e-0d52-4a88-b87c-602bb4f4eab5 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:09.223769 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=100 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:32:10.094680 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d5f5505e-0d52-4a88-b87c-602bb4f4eab5 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f901dea4594eb6831a78e2e603e8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c369c078bd4c49148290abb7de3d076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:10.110140 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d5f5505e-0d52-4a88-b87c-602bb4f4eab5 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/servers/4e1ae723-8f58-4752-b578-da0b39e9a668" status: 200 len: 1467 microversion: 2.1 time: 0.968528 Oct 18 15:32:10.114892 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 974/1898] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:32:09 2022] GET /compute/v2.1/servers/4e1ae723-8f58-4752-b578-da0b39e9a668 => generated 1467 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:32:10.125262 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fae39b6d-3156-4c98-baa2-5415969a09ce tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:10.125899 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-fae39b6d-3156-4c98-baa2-5415969a09ce tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] [instance: 234a024f-c13b-40de-bbcb-ffcdda611d01] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:10.163608 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fae39b6d-3156-4c98-baa2-5415969a09ce tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:10.166008 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fae39b6d-3156-4c98-baa2-5415969a09ce tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:10.166634 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fae39b6d-3156-4c98-baa2-5415969a09ce tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:10.172031 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fae39b6d-3156-4c98-baa2-5415969a09ce tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:10.172610 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fae39b6d-3156-4c98-baa2-5415969a09ce tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:10.173205 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fae39b6d-3156-4c98-baa2-5415969a09ce tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:10.313290 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-fae39b6d-3156-4c98-baa2-5415969a09ce tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lazy-loading 'services' on Instance uuid 234a024f-c13b-40de-bbcb-ffcdda611d01 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:32:10.349615 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fae39b6d-3156-4c98-baa2-5415969a09ce tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01" status: 200 len: 1927 microversion: 2.75 time: 0.233469 Oct 18 15:32:10.353300 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 975/1899] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:32:10 2022] GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01 => generated 1927 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:32:10.365214 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5cb985f8-8200-4eb2-a4b7-dba869d2c5c1 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-532483714"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:32:10.370625 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5cb985f8-8200-4eb2-a4b7-dba869d2c5c1 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] [instance: 4e1ae723-8f58-4752-b578-da0b39e9a668] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:10.384020 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5cb985f8-8200-4eb2-a4b7-dba869d2c5c1 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:10.385413 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5cb985f8-8200-4eb2-a4b7-dba869d2c5c1 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:10.386057 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5cb985f8-8200-4eb2-a4b7-dba869d2c5c1 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:10.386973 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5cb985f8-8200-4eb2-a4b7-dba869d2c5c1 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:10.387614 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5cb985f8-8200-4eb2-a4b7-dba869d2c5c1 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:10.388218 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5cb985f8-8200-4eb2-a4b7-dba869d2c5c1 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:10.470389 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1fb3629f-f98a-474d-af7e-02735379ff04 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1/action" status: 202 len: 0 microversion: 2.25 time: 4.451702 Oct 18 15:32:10.476763 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 925/1900] 10.222.0.60 () {62 vars in 1319 bytes} [Tue Oct 18 15:32:06 2022] POST /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1/action => generated 0 bytes in 4459 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:32:10.493456 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6acb4215-9fd6-454b-a3ad-41edca6d3d0a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:10.494769 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6acb4215-9fd6-454b-a3ad-41edca6d3d0a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:10.524026 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6acb4215-9fd6-454b-a3ad-41edca6d3d0a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:10.536127 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6acb4215-9fd6-454b-a3ad-41edca6d3d0a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:10.537340 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6acb4215-9fd6-454b-a3ad-41edca6d3d0a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:10.539988 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6acb4215-9fd6-454b-a3ad-41edca6d3d0a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:10.544142 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6acb4215-9fd6-454b-a3ad-41edca6d3d0a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:10.544829 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6acb4215-9fd6-454b-a3ad-41edca6d3d0a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:10.848078 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6acb4215-9fd6-454b-a3ad-41edca6d3d0a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:10.863877 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6acb4215-9fd6-454b-a3ad-41edca6d3d0a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e" status: 200 len: 1391 microversion: 2.1 time: 0.384067 Oct 18 15:32:10.866692 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 926/1901] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:32:10 2022] GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e => generated 1391 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:32:10.876703 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a6bbe1bc-fc64-43be-80a6-326181aca278 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:10.877966 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a6bbe1bc-fc64-43be-80a6-326181aca278 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 0dfb045a-8cea-41b6-bbdc-8fa6600046d1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:10.894135 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a6bbe1bc-fc64-43be-80a6-326181aca278 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:10.897806 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a6bbe1bc-fc64-43be-80a6-326181aca278 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:10.899882 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a6bbe1bc-fc64-43be-80a6-326181aca278 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:10.901186 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a6bbe1bc-fc64-43be-80a6-326181aca278 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:10.902640 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a6bbe1bc-fc64-43be-80a6-326181aca278 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:10.903989 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a6bbe1bc-fc64-43be-80a6-326181aca278 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:10.951909 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5cb985f8-8200-4eb2-a4b7-dba869d2c5c1 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "POST /compute/v2.1/servers/4e1ae723-8f58-4752-b578-da0b39e9a668/action" status: 202 len: 0 microversion: 2.1 time: 0.593095 Oct 18 15:32:10.952603 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 976/1902] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:32:10 2022] POST /compute/v2.1/servers/4e1ae723-8f58-4752-b578-da0b39e9a668/action => generated 0 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 18 15:32:10.966898 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6401d093-8db5-42ef-a1c9-98c6b3d0dea8 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c3d17e280>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:11.082705 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6401d093-8db5-42ef-a1c9-98c6b3d0dea8 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/f739839c-98aa-47e3-80e7-07753aa06df7" status: 200 len: 1454 microversion: 2.1 time: 0.122701 Oct 18 15:32:11.084619 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 977/1903] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:32:10 2022] GET /compute/v2.1/images/f739839c-98aa-47e3-80e7-07753aa06df7 => generated 1454 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:32:11.385772 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e67f1671-1a82-4df8-a03b-a363986dceee tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:11.386574 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e67f1671-1a82-4df8-a03b-a363986dceee tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] [instance: 234a024f-c13b-40de-bbcb-ffcdda611d01] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:11.403551 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e67f1671-1a82-4df8-a03b-a363986dceee tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:11.404051 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e67f1671-1a82-4df8-a03b-a363986dceee tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:11.404575 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e67f1671-1a82-4df8-a03b-a363986dceee tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:11.405378 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e67f1671-1a82-4df8-a03b-a363986dceee tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:11.405841 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e67f1671-1a82-4df8-a03b-a363986dceee tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:11.406273 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e67f1671-1a82-4df8-a03b-a363986dceee tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:11.518288 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a6bbe1bc-fc64-43be-80a6-326181aca278 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:11.528067 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a6bbe1bc-fc64-43be-80a6-326181aca278 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:11.540509 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a6bbe1bc-fc64-43be-80a6-326181aca278 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:11.541998 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a6bbe1bc-fc64-43be-80a6-326181aca278 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1" status: 200 len: 1486 microversion: 2.25 time: 0.673528 Oct 18 15:32:11.562058 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 927/1904] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:32:10 2022] GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1 => generated 1486 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:32:11.601530 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-e67f1671-1a82-4df8-a03b-a363986dceee tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lazy-loading 'services' on Instance uuid 234a024f-c13b-40de-bbcb-ffcdda611d01 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:32:11.627169 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e67f1671-1a82-4df8-a03b-a363986dceee tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01" status: 200 len: 1927 microversion: 2.75 time: 0.245137 Oct 18 15:32:11.640837 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 978/1905] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:32:11 2022] GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01 => generated 1927 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:32:11.895211 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0ea7cb2c-cbc6-4ea8-8d2b-435236f07bac tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:11.896202 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0ea7cb2c-cbc6-4ea8-8d2b-435236f07bac tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:11.903687 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ea7cb2c-cbc6-4ea8-8d2b-435236f07bac tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:11.904510 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ea7cb2c-cbc6-4ea8-8d2b-435236f07bac tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:11.905198 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ea7cb2c-cbc6-4ea8-8d2b-435236f07bac tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:11.906127 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ea7cb2c-cbc6-4ea8-8d2b-435236f07bac tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:11.906786 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ea7cb2c-cbc6-4ea8-8d2b-435236f07bac tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:11.907428 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ea7cb2c-cbc6-4ea8-8d2b-435236f07bac tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:12.100619 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7863154d-51c9-4bfb-a3b6-820417fca23a tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c3d0074c0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:12.151087 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0ea7cb2c-cbc6-4ea8-8d2b-435236f07bac tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:12.161048 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0ea7cb2c-cbc6-4ea8-8d2b-435236f07bac tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e" status: 200 len: 1391 microversion: 2.1 time: 0.269538 Oct 18 15:32:12.166853 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 928/1906] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:32:11 2022] GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e => generated 1391 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:32:12.167717 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7863154d-51c9-4bfb-a3b6-820417fca23a tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/f739839c-98aa-47e3-80e7-07753aa06df7" status: 200 len: 1454 microversion: 2.1 time: 0.071889 Oct 18 15:32:12.169959 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 979/1907] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:32:12 2022] GET /compute/v2.1/images/f739839c-98aa-47e3-80e7-07753aa06df7 => generated 1454 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:32:12.575415 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fbf0a6f0-b954-4ec6-bdc6-5329ad7b412d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:12.577295 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fbf0a6f0-b954-4ec6-bdc6-5329ad7b412d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 0dfb045a-8cea-41b6-bbdc-8fa6600046d1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:12.588526 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbf0a6f0-b954-4ec6-bdc6-5329ad7b412d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:12.589343 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbf0a6f0-b954-4ec6-bdc6-5329ad7b412d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:12.589993 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbf0a6f0-b954-4ec6-bdc6-5329ad7b412d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:12.590937 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbf0a6f0-b954-4ec6-bdc6-5329ad7b412d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:12.591628 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbf0a6f0-b954-4ec6-bdc6-5329ad7b412d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:12.592268 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbf0a6f0-b954-4ec6-bdc6-5329ad7b412d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:12.653573 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:32:12.659917 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-954040dc-4ea7-4999-a905-f1430655a8ef tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:12.660681 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-954040dc-4ea7-4999-a905-f1430655a8ef tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] [instance: 234a024f-c13b-40de-bbcb-ffcdda611d01] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:12.670815 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-954040dc-4ea7-4999-a905-f1430655a8ef tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:12.671471 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-954040dc-4ea7-4999-a905-f1430655a8ef tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:12.671914 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-954040dc-4ea7-4999-a905-f1430655a8ef tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:12.678134 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-954040dc-4ea7-4999-a905-f1430655a8ef tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:12.678656 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-954040dc-4ea7-4999-a905-f1430655a8ef tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:12.679111 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-954040dc-4ea7-4999-a905-f1430655a8ef tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:13.437835 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-954040dc-4ea7-4999-a905-f1430655a8ef tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lazy-loading 'services' on Instance uuid 234a024f-c13b-40de-bbcb-ffcdda611d01 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:32:13.490712 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-954040dc-4ea7-4999-a905-f1430655a8ef tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01" status: 200 len: 1927 microversion: 2.75 time: 0.832592 Oct 18 15:32:13.493464 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 980/1908] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:32:12 2022] GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01 => generated 1927 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:32:13.518374 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ce22ca13-2777-45e2-8453-1df821132bbd tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c3d0073a0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:13.635954 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ce22ca13-2777-45e2-8453-1df821132bbd tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/f739839c-98aa-47e3-80e7-07753aa06df7" status: 200 len: 1454 microversion: 2.1 time: 0.138021 Oct 18 15:32:13.636762 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 981/1909] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:32:13 2022] GET /compute/v2.1/images/f739839c-98aa-47e3-80e7-07753aa06df7 => generated 1454 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:32:13.654450 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-34a655e1-2089-4c5d-9e70-a31022f42c8a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:13.655785 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-34a655e1-2089-4c5d-9e70-a31022f42c8a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:13.675518 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-34a655e1-2089-4c5d-9e70-a31022f42c8a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:13.678144 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-34a655e1-2089-4c5d-9e70-a31022f42c8a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:13.687088 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-34a655e1-2089-4c5d-9e70-a31022f42c8a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:13.689126 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-34a655e1-2089-4c5d-9e70-a31022f42c8a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:13.690695 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-34a655e1-2089-4c5d-9e70-a31022f42c8a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:13.691206 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-34a655e1-2089-4c5d-9e70-a31022f42c8a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:14.020372 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fbf0a6f0-b954-4ec6-bdc6-5329ad7b412d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:14.040316 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fbf0a6f0-b954-4ec6-bdc6-5329ad7b412d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:14.068226 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fbf0a6f0-b954-4ec6-bdc6-5329ad7b412d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:14.070186 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fbf0a6f0-b954-4ec6-bdc6-5329ad7b412d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1" status: 200 len: 1486 microversion: 2.25 time: 1.498478 Oct 18 15:32:14.075518 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 929/1910] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:32:12 2022] GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1 => generated 1486 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:32:14.105907 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-34a655e1-2089-4c5d-9e70-a31022f42c8a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:14.123645 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-34a655e1-2089-4c5d-9e70-a31022f42c8a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e" status: 200 len: 1391 microversion: 2.1 time: 0.482756 Oct 18 15:32:14.137608 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 982/1911] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:32:13 2022] GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e => generated 1391 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:32:14.341523 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d887c6ca-5834-4b07-8bad-d66d4f0b0ada tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Action: 'create', calling method: .version_select at 0x7f7c3cf5ee50>, body: {"keypair": {"name": "tempest-keypair-2031885278", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBtigEopfNHUlmw4v1O0oOSRKrHpFNDaFH7NoRDnQb5dXEbt5t08+Y8ZCEgdrf3MxlhIRKAc6u/1m8zFzS06QsBCUHCMONA45VQRHaejQC8OH7tFPSMk+efMrCZrUCsLbQ=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:32:14.360020 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-d887c6ca-5834-4b07-8bad-d66d4f0b0ada tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Getting quotas for project 75878827878e4ad796216561bf73b8c2. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:32:14.367574 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-d887c6ca-5834-4b07-8bad-d66d4f0b0ada tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Getting quotas for user 28a044b3132948fabf926cdd494c2c16 and project 75878827878e4ad796216561bf73b8c2. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:32:14.394356 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d887c6ca-5834-4b07-8bad-d66d4f0b0ada tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.315199 Oct 18 15:32:14.394979 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 930/1912] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Oct 18 15:32:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:32:14.524090 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8efc42f6-2d36-45f5-b3fa-95064f4462c6 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:14.524919 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8efc42f6-2d36-45f5-b3fa-95064f4462c6 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] [instance: 234a024f-c13b-40de-bbcb-ffcdda611d01] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:14.532869 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8efc42f6-2d36-45f5-b3fa-95064f4462c6 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:14.533746 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8efc42f6-2d36-45f5-b3fa-95064f4462c6 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:14.535147 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8efc42f6-2d36-45f5-b3fa-95064f4462c6 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:14.537162 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8efc42f6-2d36-45f5-b3fa-95064f4462c6 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:14.537931 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8efc42f6-2d36-45f5-b3fa-95064f4462c6 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:14.538751 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8efc42f6-2d36-45f5-b3fa-95064f4462c6 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:14.651560 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5257484e-5c6d-4613-a0b0-a1fa7e994482 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c3ce89a60>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:14.683057 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-8efc42f6-2d36-45f5-b3fa-95064f4462c6 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lazy-loading 'services' on Instance uuid 234a024f-c13b-40de-bbcb-ffcdda611d01 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:32:14.711394 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8efc42f6-2d36-45f5-b3fa-95064f4462c6 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01" status: 200 len: 1933 microversion: 2.75 time: 0.191412 Oct 18 15:32:14.724742 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 983/1913] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:32:14 2022] GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01 => generated 1933 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:32:14.775696 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5257484e-5c6d-4613-a0b0-a1fa7e994482 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/f739839c-98aa-47e3-80e7-07753aa06df7" status: 200 len: 1454 microversion: 2.1 time: 0.126608 Oct 18 15:32:14.777648 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 931/1914] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:32:14 2022] GET /compute/v2.1/images/f739839c-98aa-47e3-80e7-07753aa06df7 => generated 1454 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:32:15.097343 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0b757eb4-2d74-47ee-9abb-faffbcf03b0d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:15.098003 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0b757eb4-2d74-47ee-9abb-faffbcf03b0d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 0dfb045a-8cea-41b6-bbdc-8fa6600046d1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:15.108041 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0b757eb4-2d74-47ee-9abb-faffbcf03b0d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:15.108536 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0b757eb4-2d74-47ee-9abb-faffbcf03b0d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:15.111283 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0b757eb4-2d74-47ee-9abb-faffbcf03b0d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:15.112110 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0b757eb4-2d74-47ee-9abb-faffbcf03b0d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:15.112888 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0b757eb4-2d74-47ee-9abb-faffbcf03b0d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:15.113045 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0b757eb4-2d74-47ee-9abb-faffbcf03b0d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:15.150652 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f8488eff-8217-4cd9-b701-d4607697ecd9 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:15.151251 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f8488eff-8217-4cd9-b701-d4607697ecd9 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:15.161453 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8488eff-8217-4cd9-b701-d4607697ecd9 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:15.162912 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8488eff-8217-4cd9-b701-d4607697ecd9 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:15.163791 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8488eff-8217-4cd9-b701-d4607697ecd9 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:15.164797 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8488eff-8217-4cd9-b701-d4607697ecd9 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:15.165577 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8488eff-8217-4cd9-b701-d4607697ecd9 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:15.166261 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8488eff-8217-4cd9-b701-d4607697ecd9 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:15.437259 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0b757eb4-2d74-47ee-9abb-faffbcf03b0d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:15.457777 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0b757eb4-2d74-47ee-9abb-faffbcf03b0d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:15.464082 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0b757eb4-2d74-47ee-9abb-faffbcf03b0d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:15.471661 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0b757eb4-2d74-47ee-9abb-faffbcf03b0d tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1" status: 200 len: 1486 microversion: 2.25 time: 0.375657 Oct 18 15:32:15.477697 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 984/1915] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:32:15 2022] GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1 => generated 1486 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:32:15.521697 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f8488eff-8217-4cd9-b701-d4607697ecd9 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:15.536704 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f8488eff-8217-4cd9-b701-d4607697ecd9 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e" status: 200 len: 1391 microversion: 2.1 time: 0.390663 Oct 18 15:32:15.538423 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 932/1916] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:32:15 2022] GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e => generated 1391 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:32:15.586884 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f377e54a-9b4b-4c33-8017-6d627d94f059 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-446930860", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "eb221192-5893-4db2-8b3e-3f76e8b8dfc0"}, {"uuid": "6da2a112-1349-4734-a262-9c42376c761b"}, {"uuid": "eb221192-5893-4db2-8b3e-3f76e8b8dfc0"}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:32:15.660470 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-f377e54a-9b4b-4c33-8017-6d627d94f059 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] validate_networks() for [('eb221192-5893-4db2-8b3e-3f76e8b8dfc0', None, None, None, None, None), ('6da2a112-1349-4734-a262-9c42376c761b', None, None, None, None, None), ('eb221192-5893-4db2-8b3e-3f76e8b8dfc0', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:32:15.760688 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3cca8088-be62-4fb4-abb7-da00935c04b3 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:15.762421 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3cca8088-be62-4fb4-abb7-da00935c04b3 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] [instance: 234a024f-c13b-40de-bbcb-ffcdda611d01] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:15.788586 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3cca8088-be62-4fb4-abb7-da00935c04b3 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:15.789999 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3cca8088-be62-4fb4-abb7-da00935c04b3 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:15.790696 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3cca8088-be62-4fb4-abb7-da00935c04b3 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:15.794115 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3cca8088-be62-4fb4-abb7-da00935c04b3 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:15.794726 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3cca8088-be62-4fb4-abb7-da00935c04b3 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:15.795167 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3cca8088-be62-4fb4-abb7-da00935c04b3 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:15.887836 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:32:16.063401 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-3cca8088-be62-4fb4-abb7-da00935c04b3 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lazy-loading 'services' on Instance uuid 234a024f-c13b-40de-bbcb-ffcdda611d01 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:32:16.108232 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3cca8088-be62-4fb4-abb7-da00935c04b3 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01" status: 200 len: 1933 microversion: 2.75 time: 0.364869 Oct 18 15:32:16.109704 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 933/1917] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:32:15 2022] GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01 => generated 1933 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:32:16.134008 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7bef2bbb-9f61-4292-bb66-4e3b341b4ac1 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c3ce97f70>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:16.188645 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7bef2bbb-9f61-4292-bb66-4e3b341b4ac1 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/f739839c-98aa-47e3-80e7-07753aa06df7" status: 200 len: 1454 microversion: 2.1 time: 0.077612 Oct 18 15:32:16.198510 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 934/1918] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:32:16 2022] GET /compute/v2.1/images/f739839c-98aa-47e3-80e7-07753aa06df7 => generated 1454 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:32:16.508651 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e6124a2f-fe1b-4086-9afc-09ef42036d46 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:16.509487 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e6124a2f-fe1b-4086-9afc-09ef42036d46 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 0dfb045a-8cea-41b6-bbdc-8fa6600046d1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:16.543854 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6124a2f-fe1b-4086-9afc-09ef42036d46 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:16.544768 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6124a2f-fe1b-4086-9afc-09ef42036d46 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:16.545488 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6124a2f-fe1b-4086-9afc-09ef42036d46 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:16.546521 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6124a2f-fe1b-4086-9afc-09ef42036d46 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:16.547220 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6124a2f-fe1b-4086-9afc-09ef42036d46 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:16.547816 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6124a2f-fe1b-4086-9afc-09ef42036d46 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:17.474584 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e6124a2f-fe1b-4086-9afc-09ef42036d46 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:17.491927 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e6124a2f-fe1b-4086-9afc-09ef42036d46 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:17.495342 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e6124a2f-fe1b-4086-9afc-09ef42036d46 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:17.501206 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e6124a2f-fe1b-4086-9afc-09ef42036d46 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1" status: 200 len: 1486 microversion: 2.25 time: 0.998312 Oct 18 15:32:17.514058 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 935/1919] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:32:16 2022] GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1 => generated 1486 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:32:17.522544 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-34c39c99-ac78-4475-98b9-a76d1ecc7e5c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:17.523229 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-34c39c99-ac78-4475-98b9-a76d1ecc7e5c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:17.532698 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34c39c99-ac78-4475-98b9-a76d1ecc7e5c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:17.533582 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34c39c99-ac78-4475-98b9-a76d1ecc7e5c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:17.535706 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34c39c99-ac78-4475-98b9-a76d1ecc7e5c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:17.538277 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34c39c99-ac78-4475-98b9-a76d1ecc7e5c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:17.539134 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34c39c99-ac78-4475-98b9-a76d1ecc7e5c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:17.539831 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34c39c99-ac78-4475-98b9-a76d1ecc7e5c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:19.084131 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-34c39c99-ac78-4475-98b9-a76d1ecc7e5c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:19.097425 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-34c39c99-ac78-4475-98b9-a76d1ecc7e5c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e" status: 200 len: 1391 microversion: 2.1 time: 1.581897 Oct 18 15:32:19.099209 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 936/1920] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:32:17 2022] GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e => generated 1391 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:32:19.131486 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c088d87f-7aee-4387-bc7d-4b98f83530c8 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:19.135433 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c088d87f-7aee-4387-bc7d-4b98f83530c8 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] [instance: 234a024f-c13b-40de-bbcb-ffcdda611d01] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:19.164411 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c088d87f-7aee-4387-bc7d-4b98f83530c8 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:19.165958 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c088d87f-7aee-4387-bc7d-4b98f83530c8 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:19.166454 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c088d87f-7aee-4387-bc7d-4b98f83530c8 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:19.170580 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c088d87f-7aee-4387-bc7d-4b98f83530c8 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:19.171414 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c088d87f-7aee-4387-bc7d-4b98f83530c8 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:19.172195 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c088d87f-7aee-4387-bc7d-4b98f83530c8 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:19.753846 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-f377e54a-9b4b-4c33-8017-6d627d94f059 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:32:19.755105 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-f377e54a-9b4b-4c33-8017-6d627d94f059 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:32:19.755806 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-f377e54a-9b4b-4c33-8017-6d627d94f059 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:32:19.758557 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-f377e54a-9b4b-4c33-8017-6d627d94f059 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:32:19.759264 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-f377e54a-9b4b-4c33-8017-6d627d94f059 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:32:19.776172 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-c088d87f-7aee-4387-bc7d-4b98f83530c8 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] Lazy-loading 'services' on Instance uuid 234a024f-c13b-40de-bbcb-ffcdda611d01 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:32:19.819504 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f377e54a-9b4b-4c33-8017-6d627d94f059 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:19.826456 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f377e54a-9b4b-4c33-8017-6d627d94f059 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:19.828027 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f377e54a-9b4b-4c33-8017-6d627d94f059 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:19.833566 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f377e54a-9b4b-4c33-8017-6d627d94f059 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:19.838666 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f377e54a-9b4b-4c33-8017-6d627d94f059 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:19.839200 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f377e54a-9b4b-4c33-8017-6d627d94f059 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:19.896613 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c088d87f-7aee-4387-bc7d-4b98f83530c8 tempest-ServersAdmin275Test-1258437562 tempest-ServersAdmin275Test-1258437562-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01" status: 200 len: 1918 microversion: 2.75 time: 0.778909 Oct 18 15:32:19.901985 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 937/1921] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:32:19 2022] GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01 => generated 1918 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:32:19.930811 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7e23b1bf-6089-47d5-bfc5-b5808d1eee9c tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c3cef0af0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:19.956612 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-f377e54a-9b4b-4c33-8017-6d627d94f059 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Getting quotas for project b17eee1a6b8d43589bf66e6e18059021. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:32:19.972898 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-f377e54a-9b4b-4c33-8017-6d627d94f059 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Getting quotas for user db93066933684d41a77863c156deb4da and project b17eee1a6b8d43589bf66e6e18059021. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:32:20.021465 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f377e54a-9b4b-4c33-8017-6d627d94f059 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:32:20.029628 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f377e54a-9b4b-4c33-8017-6d627d94f059 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] [instance: 078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:32:20.214093 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f377e54a-9b4b-4c33-8017-6d627d94f059 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.630262 Oct 18 15:32:20.219470 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 985/1922] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:32:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 4638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:32:20.242545 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bed5422c-b820-449c-8a54-cf3bf0fc9c07 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:20.246749 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-bed5422c-b820-449c-8a54-cf3bf0fc9c07 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 0dfb045a-8cea-41b6-bbdc-8fa6600046d1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:20.294367 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bed5422c-b820-449c-8a54-cf3bf0fc9c07 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:20.299814 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bed5422c-b820-449c-8a54-cf3bf0fc9c07 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:20.305257 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bed5422c-b820-449c-8a54-cf3bf0fc9c07 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:20.321440 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bed5422c-b820-449c-8a54-cf3bf0fc9c07 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:20.327544 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bed5422c-b820-449c-8a54-cf3bf0fc9c07 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:20.334099 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bed5422c-b820-449c-8a54-cf3bf0fc9c07 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:21.114808 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-bed5422c-b820-449c-8a54-cf3bf0fc9c07 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:21.127355 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-bed5422c-b820-449c-8a54-cf3bf0fc9c07 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:21.136755 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-bed5422c-b820-449c-8a54-cf3bf0fc9c07 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:21.156906 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-bed5422c-b820-449c-8a54-cf3bf0fc9c07 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1" status: 200 len: 1486 microversion: 2.25 time: 0.928670 Oct 18 15:32:21.157537 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 986/1923] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:32:20 2022] GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1 => generated 1486 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:32:21.183281 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-655d5951-7c5d-42a4-8754-39f2a2bbd82a tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:21.184074 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-655d5951-7c5d-42a4-8754-39f2a2bbd82a tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] [instance: 234a024f-c13b-40de-bbcb-ffcdda611d01] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:21.213285 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-655d5951-7c5d-42a4-8754-39f2a2bbd82a tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:21.215952 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-655d5951-7c5d-42a4-8754-39f2a2bbd82a tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:21.216492 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-655d5951-7c5d-42a4-8754-39f2a2bbd82a tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:21.220004 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-655d5951-7c5d-42a4-8754-39f2a2bbd82a tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:21.226072 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-655d5951-7c5d-42a4-8754-39f2a2bbd82a tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:21.226528 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-655d5951-7c5d-42a4-8754-39f2a2bbd82a tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:21.311999 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-655d5951-7c5d-42a4-8754-39f2a2bbd82a tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] [instance: 234a024f-c13b-40de-bbcb-ffcdda611d01] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:32:21.662206 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-655d5951-7c5d-42a4-8754-39f2a2bbd82a tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] 10.222.0.60 "DELETE /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01" status: 204 len: 0 microversion: 2.75 time: 0.502249 Oct 18 15:32:21.667169 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 987/1924] 10.222.0.60 () {60 vars in 1280 bytes} [Tue Oct 18 15:32:21 2022] DELETE /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 15:32:21.718816 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1a1411c3-5127-42d4-bcf5-616c7719e811 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:21.719657 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1a1411c3-5127-42d4-bcf5-616c7719e811 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:21.770915 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1a1411c3-5127-42d4-bcf5-616c7719e811 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:21.771412 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1a1411c3-5127-42d4-bcf5-616c7719e811 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:21.771863 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1a1411c3-5127-42d4-bcf5-616c7719e811 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:21.772589 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1a1411c3-5127-42d4-bcf5-616c7719e811 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:21.773083 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1a1411c3-5127-42d4-bcf5-616c7719e811 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:21.773519 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1a1411c3-5127-42d4-bcf5-616c7719e811 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:22.917906 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1a1411c3-5127-42d4-bcf5-616c7719e811 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:22.949338 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1a1411c3-5127-42d4-bcf5-616c7719e811 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e" status: 200 len: 1381 microversion: 2.1 time: 1.272830 Oct 18 15:32:22.950809 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 988/1925] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:32:21 2022] GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e => generated 1381 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:32:22.976303 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2cd07c9c-cc38-4800-b20f-fb5500518c38 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:22.980305 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2cd07c9c-cc38-4800-b20f-fb5500518c38 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] [instance: 078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:23.006830 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2cd07c9c-cc38-4800-b20f-fb5500518c38 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:23.012007 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2cd07c9c-cc38-4800-b20f-fb5500518c38 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:23.013343 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2cd07c9c-cc38-4800-b20f-fb5500518c38 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:23.016133 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2cd07c9c-cc38-4800-b20f-fb5500518c38 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:23.019652 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2cd07c9c-cc38-4800-b20f-fb5500518c38 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:23.021503 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2cd07c9c-cc38-4800-b20f-fb5500518c38 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:23.371372 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2cd07c9c-cc38-4800-b20f-fb5500518c38 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db93066933684d41a77863c156deb4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17eee1a6b8d43589bf66e6e18059021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:23.394203 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2cd07c9c-cc38-4800-b20f-fb5500518c38 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] 10.222.0.60 "GET /compute/v2.1/servers/078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4" status: 200 len: 1264 microversion: 2.1 time: 0.434058 Oct 18 15:32:23.399208 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 989/1926] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:32:22 2022] GET /compute/v2.1/servers/078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4 => generated 1264 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:32:23.419259 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c610b694-7afb-4877-b236-37584383395b tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:23.424089 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c610b694-7afb-4877-b236-37584383395b tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] [instance: 234a024f-c13b-40de-bbcb-ffcdda611d01] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:23.460337 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c610b694-7afb-4877-b236-37584383395b tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:23.472305 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c610b694-7afb-4877-b236-37584383395b tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:23.476600 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c610b694-7afb-4877-b236-37584383395b tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:23.478560 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c610b694-7afb-4877-b236-37584383395b tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:23.485800 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c610b694-7afb-4877-b236-37584383395b tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:23.497085 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c610b694-7afb-4877-b236-37584383395b tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:23.523296 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:32:23.721332 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c610b694-7afb-4877-b236-37584383395b tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:23.751134 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c610b694-7afb-4877-b236-37584383395b tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:23.755166 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c610b694-7afb-4877-b236-37584383395b tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:23.800171 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c610b694-7afb-4877-b236-37584383395b tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] 10.222.0.60 "GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01" status: 200 len: 1443 microversion: 2.75 time: 0.383772 Oct 18 15:32:23.806103 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 990/1927] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:32:23 2022] GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01 => generated 1443 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:32:23.814702 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a351ef31-2fda-41b7-8a04-91467131fb1e tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:23.817518 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a351ef31-2fda-41b7-8a04-91467131fb1e tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 0dfb045a-8cea-41b6-bbdc-8fa6600046d1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:23.832972 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a351ef31-2fda-41b7-8a04-91467131fb1e tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:23.834185 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a351ef31-2fda-41b7-8a04-91467131fb1e tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:23.834885 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a351ef31-2fda-41b7-8a04-91467131fb1e tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:23.835901 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a351ef31-2fda-41b7-8a04-91467131fb1e tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:23.837018 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a351ef31-2fda-41b7-8a04-91467131fb1e tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:23.837687 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a351ef31-2fda-41b7-8a04-91467131fb1e tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:24.262798 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a351ef31-2fda-41b7-8a04-91467131fb1e tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:24.314742 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a351ef31-2fda-41b7-8a04-91467131fb1e tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:24.340758 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a351ef31-2fda-41b7-8a04-91467131fb1e tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:24.343908 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a351ef31-2fda-41b7-8a04-91467131fb1e tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1" status: 200 len: 1486 microversion: 2.25 time: 0.536350 Oct 18 15:32:24.352495 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 991/1928] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:32:23 2022] GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1 => generated 1486 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:32:24.376090 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:32:24.383863 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2e62ef8f-e01c-43c6-9574-cf67e342999d tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Calling method '.version_select at 0x7f7c416f0430>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:24.403034 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2e62ef8f-e01c-43c6-9574-cf67e342999d tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:24.403694 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2e62ef8f-e01c-43c6-9574-cf67e342999d tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:24.407039 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2e62ef8f-e01c-43c6-9574-cf67e342999d tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:24.477726 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2e62ef8f-e01c-43c6-9574-cf67e342999d tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] 10.222.0.60 "GET /compute/v2.1/os-migrations" status: 200 len: 3086 microversion: 2.1 time: 0.121739 Oct 18 15:32:24.485839 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 992/1929] 10.222.0.60 () {58 vars in 1143 bytes} [Tue Oct 18 15:32:24 2022] GET /compute/v2.1/os-migrations => generated 3086 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:32:24.503226 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-065b1aaf-f226-4a52-aff3-53b1efa52c26 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:24.508411 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-065b1aaf-f226-4a52-aff3-53b1efa52c26 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] [instance: 078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:24.544174 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-065b1aaf-f226-4a52-aff3-53b1efa52c26 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:24.546314 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-065b1aaf-f226-4a52-aff3-53b1efa52c26 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:24.555472 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-065b1aaf-f226-4a52-aff3-53b1efa52c26 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:24.557023 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-065b1aaf-f226-4a52-aff3-53b1efa52c26 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:24.571047 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-065b1aaf-f226-4a52-aff3-53b1efa52c26 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:24.573331 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-065b1aaf-f226-4a52-aff3-53b1efa52c26 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:25.057625 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-065b1aaf-f226-4a52-aff3-53b1efa52c26 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db93066933684d41a77863c156deb4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17eee1a6b8d43589bf66e6e18059021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:25.071190 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-065b1aaf-f226-4a52-aff3-53b1efa52c26 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] 10.222.0.60 "GET /compute/v2.1/servers/078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4" status: 200 len: 1282 microversion: 2.1 time: 0.583499 Oct 18 15:32:25.076307 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 993/1930] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:32:24 2022] GET /compute/v2.1/servers/078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4 => generated 1282 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:32:25.097013 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f6150b8b-e4c9-4f33-863d-b0619448e52a tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:25.101914 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f6150b8b-e4c9-4f33-863d-b0619448e52a tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:25.125555 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f6150b8b-e4c9-4f33-863d-b0619448e52a tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:25.126064 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f6150b8b-e4c9-4f33-863d-b0619448e52a tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:25.126702 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f6150b8b-e4c9-4f33-863d-b0619448e52a tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:25.133706 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f6150b8b-e4c9-4f33-863d-b0619448e52a tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:25.137612 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f6150b8b-e4c9-4f33-863d-b0619448e52a tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:25.138440 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f6150b8b-e4c9-4f33-863d-b0619448e52a tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:25.502343 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f6150b8b-e4c9-4f33-863d-b0619448e52a tempest-LiveMigrationTest-1006184305 tempest-LiveMigrationTest-1006184305-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e" status: 200 len: 1532 microversion: 2.1 time: 0.423895 Oct 18 15:32:25.516853 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 994/1931] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:32:25 2022] GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e => generated 1532 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:32:25.562461 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-42a27284-99b6-4c39-8853-7dc309234e2b tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:25.563613 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-42a27284-99b6-4c39-8853-7dc309234e2b tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] [instance: 234a024f-c13b-40de-bbcb-ffcdda611d01] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:25.600749 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-42a27284-99b6-4c39-8853-7dc309234e2b tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:25.601275 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-42a27284-99b6-4c39-8853-7dc309234e2b tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:25.601710 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-42a27284-99b6-4c39-8853-7dc309234e2b tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:25.609685 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-42a27284-99b6-4c39-8853-7dc309234e2b tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:25.610531 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-42a27284-99b6-4c39-8853-7dc309234e2b tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:25.611148 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-42a27284-99b6-4c39-8853-7dc309234e2b tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:25.680975 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-42a27284-99b6-4c39-8853-7dc309234e2b tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:25.681699 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-42a27284-99b6-4c39-8853-7dc309234e2b tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:25.683191 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-42a27284-99b6-4c39-8853-7dc309234e2b tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:25.683844 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-42a27284-99b6-4c39-8853-7dc309234e2b tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lazy-loading 'fault' on Instance uuid 234a024f-c13b-40de-bbcb-ffcdda611d01 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:32:26.672124 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-42a27284-99b6-4c39-8853-7dc309234e2b tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:26.690242 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-42a27284-99b6-4c39-8853-7dc309234e2b tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:26.692002 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-42a27284-99b6-4c39-8853-7dc309234e2b tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd74d93a92b684aa1aa01c483522bcfd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ad6814a3424a85abc4d07802516718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:26.723722 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-42a27284-99b6-4c39-8853-7dc309234e2b tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] 10.222.0.60 "GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01" status: 200 len: 1448 microversion: 2.75 time: 1.208515 Oct 18 15:32:26.724311 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 995/1932] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:32:25 2022] GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01 => generated 1448 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:32:26.746769 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-37764162-e1a6-4f4f-a97c-2715f6591a32 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:26.753341 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-37764162-e1a6-4f4f-a97c-2715f6591a32 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 0dfb045a-8cea-41b6-bbdc-8fa6600046d1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:26.766764 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37764162-e1a6-4f4f-a97c-2715f6591a32 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:26.767911 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37764162-e1a6-4f4f-a97c-2715f6591a32 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:26.773686 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37764162-e1a6-4f4f-a97c-2715f6591a32 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:26.774750 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37764162-e1a6-4f4f-a97c-2715f6591a32 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:26.775388 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37764162-e1a6-4f4f-a97c-2715f6591a32 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:26.775998 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37764162-e1a6-4f4f-a97c-2715f6591a32 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:28.121190 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-37764162-e1a6-4f4f-a97c-2715f6591a32 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:28.161658 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-37764162-e1a6-4f4f-a97c-2715f6591a32 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:28.168300 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-37764162-e1a6-4f4f-a97c-2715f6591a32 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:28.171312 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-37764162-e1a6-4f4f-a97c-2715f6591a32 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1" status: 200 len: 1486 microversion: 2.25 time: 1.433542 Oct 18 15:32:28.177813 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 996/1933] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:32:26 2022] GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1 => generated 1486 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:32:28.196329 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6ce657b9-82e4-49a4-bffb-3f4ca67b5a33 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:28.201791 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6ce657b9-82e4-49a4-bffb-3f4ca67b5a33 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:28.226318 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ce657b9-82e4-49a4-bffb-3f4ca67b5a33 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:28.226700 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ce657b9-82e4-49a4-bffb-3f4ca67b5a33 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:28.227146 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ce657b9-82e4-49a4-bffb-3f4ca67b5a33 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:28.227865 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ce657b9-82e4-49a4-bffb-3f4ca67b5a33 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:28.228318 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ce657b9-82e4-49a4-bffb-3f4ca67b5a33 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:28.228737 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ce657b9-82e4-49a4-bffb-3f4ca67b5a33 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:28.332180 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6ce657b9-82e4-49a4-bffb-3f4ca67b5a33 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:32:28.684484 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6ce657b9-82e4-49a4-bffb-3f4ca67b5a33 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "DELETE /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e" status: 204 len: 0 microversion: 2.1 time: 0.496129 Oct 18 15:32:28.688020 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 997/1934] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:32:28 2022] DELETE /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e => generated 0 bytes in 509 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:32:28.713018 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8fb2f064-cc1b-4d14-acbd-60cd9e0040fe tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:28.714890 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8fb2f064-cc1b-4d14-acbd-60cd9e0040fe tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] [instance: 078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:28.740364 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8fb2f064-cc1b-4d14-acbd-60cd9e0040fe tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:28.741458 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8fb2f064-cc1b-4d14-acbd-60cd9e0040fe tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:28.742141 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8fb2f064-cc1b-4d14-acbd-60cd9e0040fe tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:28.743111 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8fb2f064-cc1b-4d14-acbd-60cd9e0040fe tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:28.743815 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8fb2f064-cc1b-4d14-acbd-60cd9e0040fe tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:28.744620 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8fb2f064-cc1b-4d14-acbd-60cd9e0040fe tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:29.419971 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8fb2f064-cc1b-4d14-acbd-60cd9e0040fe tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db93066933684d41a77863c156deb4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17eee1a6b8d43589bf66e6e18059021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:29.429668 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8fb2f064-cc1b-4d14-acbd-60cd9e0040fe tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] 10.222.0.60 "GET /compute/v2.1/servers/078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4" status: 200 len: 1312 microversion: 2.1 time: 0.740006 Oct 18 15:32:29.439532 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 998/1935] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:32:28 2022] GET /compute/v2.1/servers/078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4 => generated 1312 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:32:29.458798 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-3854919d-96ef-499a-af2b-6bfb6b95b484 req-15ef75e0-d31b-4211-ba65-46596113b987 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e1ae723-8f58-4752-b578-da0b39e9a668", "name": "network-vif-plugged", "status": "completed", "tag": "2083c6f4-97f8-4301-a307-2ecb7417f192"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:32:29.520491 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-3854919d-96ef-499a-af2b-6bfb6b95b484 req-15ef75e0-d31b-4211-ba65-46596113b987 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:29.525927 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-3854919d-96ef-499a-af2b-6bfb6b95b484 req-15ef75e0-d31b-4211-ba65-46596113b987 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:29.526805 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-3854919d-96ef-499a-af2b-6bfb6b95b484 req-15ef75e0-d31b-4211-ba65-46596113b987 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:29.582845 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-3854919d-96ef-499a-af2b-6bfb6b95b484 req-15ef75e0-d31b-4211-ba65-46596113b987 service nova] Creating event network-vif-plugged:2083c6f4-97f8-4301-a307-2ecb7417f192 for instance 4e1ae723-8f58-4752-b578-da0b39e9a668 on n-h1-853682-5 Oct 18 15:32:29.606534 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-3854919d-96ef-499a-af2b-6bfb6b95b484 req-15ef75e0-d31b-4211-ba65-46596113b987 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163489 Oct 18 15:32:29.613939 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 999/1936] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:32:29.663593 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-eff964f9-a1c2-47f5-97cc-6c82e2b6e135 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:29.669154 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-eff964f9-a1c2-47f5-97cc-6c82e2b6e135 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] [instance: 234a024f-c13b-40de-bbcb-ffcdda611d01] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:29.704431 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eff964f9-a1c2-47f5-97cc-6c82e2b6e135 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:29.705393 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eff964f9-a1c2-47f5-97cc-6c82e2b6e135 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:29.708781 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eff964f9-a1c2-47f5-97cc-6c82e2b6e135 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:29.714079 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eff964f9-a1c2-47f5-97cc-6c82e2b6e135 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:29.719209 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eff964f9-a1c2-47f5-97cc-6c82e2b6e135 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:29.720180 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eff964f9-a1c2-47f5-97cc-6c82e2b6e135 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:29.775421 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-eff964f9-a1c2-47f5-97cc-6c82e2b6e135 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] HTTP exception thrown: Instance 234a024f-c13b-40de-bbcb-ffcdda611d01 could not be found. Oct 18 15:32:29.777596 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-eff964f9-a1c2-47f5-97cc-6c82e2b6e135 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Request method failure captured: Oct 18 15:32:29.777596 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01 HTTP/1.1 Oct 18 15:32:29.777596 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:32:29.777596 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:32:29.777596 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:32:29.777596 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:32:29.777596 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:32:29.777596 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:32:29.777596 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:32:29.777596 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:32:29.777596 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsavHtJhsAb2yLDlI7eLut1b7FWPov0LsNSpDKubh6G2neeKbmmrmkO8OvfZnx60nL3uzQTnv1d7hqLfvVQYffLPLj-kjCF-F4xLmkFFSEo9zbZSTr29E4vmN_hRhZIBPbHV1C87ad9oFvKA3WLyPhxxQuFgOlgDCxS9efLqxylO0nY Oct 18 15:32:29.777596 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:32:29.777596 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:32:29.777596 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:32:29.777596 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:32:29.777596 n-d-853682-5 devstack@n-api.service[120405]: X-Openstack-Nova-Api-Version: 2.75 Oct 18 15:32:29.777596 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:32:29.777596 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:32:29.777596 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 76ad6814a3424a85abc4d07802516718 Oct 18 15:32:29.777596 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServersAdmin275Test-179247970 Oct 18 15:32:29.777596 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:32:29.777596 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:32:29.779372 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/76ad6814a3424a85abc4d07802516718"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/76ad6814a3424a85abc4d07802516718"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/76ad6814a3424a85abc4d07802516718"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_76ad6814a3424a85abc4d07802516718"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:32:29.779372 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServersAdmin275Test-179247970 Oct 18 15:32:29.779372 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 76ad6814a3424a85abc4d07802516718 Oct 18 15:32:29.779372 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServersAdmin275Test-179247970 Oct 18 15:32:29.779372 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServersAdmin275Test-179247970-project Oct 18 15:32:29.779372 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:32:29.779372 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:32:29.779372 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: d74d93a92b684aa1aa01c483522bcfd7 Oct 18 15:32:29.779372 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServersAdmin275Test-179247970-project Oct 18 15:32:29.779372 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:32:29.779372 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 234a024f-c13b-40de-bbcb-ffcdda611d01 could not be found. Oct 18 15:32:29.779372 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '234a024f-c13b-40de-bbcb-ffcdda611d01'} Oct 18 15:32:29.780330 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:32:29.780330 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:32:29.780330 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:32:29.780330 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:32:29.780330 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:32:29.780330 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:32:29.780330 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:32:29.780330 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:32:29.780330 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:32:29.780330 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:32:29.780330 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 234a024f-c13b-40de-bbcb-ffcdda611d01 could not be found. Oct 18 15:32:29.780330 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:32:29.780330 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:32:29.780330 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:32:29.780330 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:32:29.780330 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:32:29.780330 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:32:29.780330 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:32:29.780330 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:32:29.780330 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:32:29.781894 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:32:29.781894 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:32:29.781894 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:32:29.781894 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:32:29.781894 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:32:29.781894 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:32:29.781894 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:32:29.781894 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 234a024f-c13b-40de-bbcb-ffcdda611d01 could not be found. Oct 18 15:32:29.781894 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:32:29.781894 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:32:29.781894 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:32:29.781894 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:32:29.781894 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:32:29.781894 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:32:29.781894 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:32:29.781894 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:32:29.781894 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 234a024f-c13b-40de-bbcb-ffcdda611d01 could not be found. Oct 18 15:32:29.781894 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:32:29.787763 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-eff964f9-a1c2-47f5-97cc-6c82e2b6e135 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] Returning 404 to user: Instance 234a024f-c13b-40de-bbcb-ffcdda611d01 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:32:29.788931 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-eff964f9-a1c2-47f5-97cc-6c82e2b6e135 tempest-ServersAdmin275Test-179247970 tempest-ServersAdmin275Test-179247970-project] 10.222.0.60 "GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01" status: 404 len: 111 microversion: 2.75 time: 0.173347 Oct 18 15:32:29.790070 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1000/1937] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:32:29 2022] GET /compute/v2.1/servers/234a024f-c13b-40de-bbcb-ffcdda611d01 => generated 111 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:32:29.797196 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-26296803-63c9-4c25-a377-d21367508427 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:29.798316 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-26296803-63c9-4c25-a377-d21367508427 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:29.809125 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26296803-63c9-4c25-a377-d21367508427 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:29.810643 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26296803-63c9-4c25-a377-d21367508427 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:29.811389 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26296803-63c9-4c25-a377-d21367508427 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:29.812399 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26296803-63c9-4c25-a377-d21367508427 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:29.813288 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26296803-63c9-4c25-a377-d21367508427 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:29.814013 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26296803-63c9-4c25-a377-d21367508427 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:29.854652 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=37 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:32:29.888468 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:32:29.899824 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:32:30.040024 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=6 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:32:30.410725 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-26296803-63c9-4c25-a377-d21367508427 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:30.425967 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-26296803-63c9-4c25-a377-d21367508427 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e" status: 200 len: 1387 microversion: 2.1 time: 0.628521 Oct 18 15:32:30.446297 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1001/1938] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:32:29 2022] GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e => generated 1387 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:32:30.464474 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2d844f82-8e92-4d5c-aa61-885921999da0 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:30.474116 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2d844f82-8e92-4d5c-aa61-885921999da0 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 0dfb045a-8cea-41b6-bbdc-8fa6600046d1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:30.501614 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:32:30.505925 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d844f82-8e92-4d5c-aa61-885921999da0 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:30.511505 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d844f82-8e92-4d5c-aa61-885921999da0 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:30.514598 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d844f82-8e92-4d5c-aa61-885921999da0 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:30.519409 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d844f82-8e92-4d5c-aa61-885921999da0 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:30.522936 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d844f82-8e92-4d5c-aa61-885921999da0 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:30.525576 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d844f82-8e92-4d5c-aa61-885921999da0 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:31.363363 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2d844f82-8e92-4d5c-aa61-885921999da0 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:31.378589 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2d844f82-8e92-4d5c-aa61-885921999da0 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:31.381731 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2d844f82-8e92-4d5c-aa61-885921999da0 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:31.383179 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2d844f82-8e92-4d5c-aa61-885921999da0 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1" status: 200 len: 1486 microversion: 2.25 time: 0.934068 Oct 18 15:32:31.391032 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1002/1939] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:32:30 2022] GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1 => generated 1486 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:32:31.400914 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9f4e0bc0-2e8c-46b0-8f4d-0352f0d79955 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:31.405975 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9f4e0bc0-2e8c-46b0-8f4d-0352f0d79955 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] [instance: 078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:31.424039 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9f4e0bc0-2e8c-46b0-8f4d-0352f0d79955 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:31.427168 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9f4e0bc0-2e8c-46b0-8f4d-0352f0d79955 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:31.428329 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9f4e0bc0-2e8c-46b0-8f4d-0352f0d79955 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:31.430309 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9f4e0bc0-2e8c-46b0-8f4d-0352f0d79955 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:31.431377 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9f4e0bc0-2e8c-46b0-8f4d-0352f0d79955 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:31.437486 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9f4e0bc0-2e8c-46b0-8f4d-0352f0d79955 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:31.925482 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9f4e0bc0-2e8c-46b0-8f4d-0352f0d79955 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db93066933684d41a77863c156deb4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17eee1a6b8d43589bf66e6e18059021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:31.938071 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9f4e0bc0-2e8c-46b0-8f4d-0352f0d79955 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] 10.222.0.60 "GET /compute/v2.1/servers/078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4" status: 200 len: 1312 microversion: 2.1 time: 0.542032 Oct 18 15:32:31.939617 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1003/1940] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:32:31 2022] GET /compute/v2.1/servers/078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4 => generated 1312 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:32:31.956091 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-32b0bab5-e252-4604-a391-cd2337dbf39e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:31.969515 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-32b0bab5-e252-4604-a391-cd2337dbf39e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:31.986063 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-32b0bab5-e252-4604-a391-cd2337dbf39e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:31.987306 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-32b0bab5-e252-4604-a391-cd2337dbf39e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:31.987306 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-32b0bab5-e252-4604-a391-cd2337dbf39e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:31.989363 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-32b0bab5-e252-4604-a391-cd2337dbf39e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:31.992182 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-32b0bab5-e252-4604-a391-cd2337dbf39e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:31.992850 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-32b0bab5-e252-4604-a391-cd2337dbf39e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:32.208920 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-32b0bab5-e252-4604-a391-cd2337dbf39e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:32.230484 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-32b0bab5-e252-4604-a391-cd2337dbf39e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e" status: 200 len: 1184 microversion: 2.1 time: 0.278767 Oct 18 15:32:32.243712 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1004/1941] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:32:31 2022] GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e => generated 1184 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:32:32.249414 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-f4251ced-402e-4c11-8816-5d6dac8078a8 req-035800d9-f3af-4dfa-87e9-1dd1998d3c1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da62499c-f590-4083-80b6-b849b6695c4e", "name": "network-vif-deleted", "tag": "e34ef547-0315-4841-b1d6-53dcfae3bb30"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:32:32.273493 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-f4251ced-402e-4c11-8816-5d6dac8078a8 req-035800d9-f3af-4dfa-87e9-1dd1998d3c1c service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:32.274007 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-f4251ced-402e-4c11-8816-5d6dac8078a8 req-035800d9-f3af-4dfa-87e9-1dd1998d3c1c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:32.276209 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-f4251ced-402e-4c11-8816-5d6dac8078a8 req-035800d9-f3af-4dfa-87e9-1dd1998d3c1c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:32.332131 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-f4251ced-402e-4c11-8816-5d6dac8078a8 req-035800d9-f3af-4dfa-87e9-1dd1998d3c1c service nova] Creating event network-vif-deleted:e34ef547-0315-4841-b1d6-53dcfae3bb30 for instance da62499c-f590-4083-80b6-b849b6695c4e on n-h2-853682-5 Oct 18 15:32:32.364701 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-f4251ced-402e-4c11-8816-5d6dac8078a8 req-035800d9-f3af-4dfa-87e9-1dd1998d3c1c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120417 Oct 18 15:32:32.368550 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1005/1942] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:32:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:32:32.420198 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-075e82ee-e4dc-4310-9d3b-e45f44554468 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:32.423656 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-075e82ee-e4dc-4310-9d3b-e45f44554468 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 0dfb045a-8cea-41b6-bbdc-8fa6600046d1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:32.459939 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-075e82ee-e4dc-4310-9d3b-e45f44554468 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:32.461798 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-075e82ee-e4dc-4310-9d3b-e45f44554468 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:32.463749 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-075e82ee-e4dc-4310-9d3b-e45f44554468 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:32.468000 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-075e82ee-e4dc-4310-9d3b-e45f44554468 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:32.469448 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-075e82ee-e4dc-4310-9d3b-e45f44554468 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:32.474556 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-075e82ee-e4dc-4310-9d3b-e45f44554468 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:33.327918 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-075e82ee-e4dc-4310-9d3b-e45f44554468 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:33.354359 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-075e82ee-e4dc-4310-9d3b-e45f44554468 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:33.360095 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-075e82ee-e4dc-4310-9d3b-e45f44554468 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:33.380851 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-075e82ee-e4dc-4310-9d3b-e45f44554468 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1" status: 200 len: 1486 microversion: 2.25 time: 0.964087 Oct 18 15:32:33.385267 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1006/1943] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:32:32 2022] GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1 => generated 1486 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:32:33.392595 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6256c5d3-a5f1-4660-b9b2-d2c7063f216d tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:33.393495 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6256c5d3-a5f1-4660-b9b2-d2c7063f216d tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] [instance: 078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:33.421859 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6256c5d3-a5f1-4660-b9b2-d2c7063f216d tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:33.423257 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6256c5d3-a5f1-4660-b9b2-d2c7063f216d tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:33.425330 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6256c5d3-a5f1-4660-b9b2-d2c7063f216d tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:33.428322 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6256c5d3-a5f1-4660-b9b2-d2c7063f216d tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:33.430748 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6256c5d3-a5f1-4660-b9b2-d2c7063f216d tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:33.432628 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6256c5d3-a5f1-4660-b9b2-d2c7063f216d tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:33.517396 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:32:33.954790 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6256c5d3-a5f1-4660-b9b2-d2c7063f216d tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db93066933684d41a77863c156deb4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17eee1a6b8d43589bf66e6e18059021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:33.969123 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6256c5d3-a5f1-4660-b9b2-d2c7063f216d tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] 10.222.0.60 "GET /compute/v2.1/servers/078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4" status: 200 len: 1333 microversion: 2.1 time: 0.582411 Oct 18 15:32:33.974642 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1007/1944] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:32:33 2022] GET /compute/v2.1/servers/078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4 => generated 1333 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:32:33.992077 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-018afbf2-4af4-46f1-9bd9-a0ac1a876389 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:33.997142 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-018afbf2-4af4-46f1-9bd9-a0ac1a876389 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:34.022266 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-018afbf2-4af4-46f1-9bd9-a0ac1a876389 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:34.023014 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-018afbf2-4af4-46f1-9bd9-a0ac1a876389 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:34.023528 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-018afbf2-4af4-46f1-9bd9-a0ac1a876389 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:34.025615 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-018afbf2-4af4-46f1-9bd9-a0ac1a876389 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:34.026294 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-018afbf2-4af4-46f1-9bd9-a0ac1a876389 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:34.029441 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-018afbf2-4af4-46f1-9bd9-a0ac1a876389 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:34.278233 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-018afbf2-4af4-46f1-9bd9-a0ac1a876389 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:34.290672 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-018afbf2-4af4-46f1-9bd9-a0ac1a876389 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e" status: 200 len: 1184 microversion: 2.1 time: 0.314860 Oct 18 15:32:34.291311 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1008/1945] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:32:33 2022] GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e => generated 1184 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:32:34.407661 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-099ad2cc-a436-42e9-b816-96a9209d99cc tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:34.408272 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-099ad2cc-a436-42e9-b816-96a9209d99cc tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 0dfb045a-8cea-41b6-bbdc-8fa6600046d1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:34.415569 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-099ad2cc-a436-42e9-b816-96a9209d99cc tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:34.421406 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-099ad2cc-a436-42e9-b816-96a9209d99cc tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:34.427751 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-099ad2cc-a436-42e9-b816-96a9209d99cc tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:34.431162 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-099ad2cc-a436-42e9-b816-96a9209d99cc tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:34.431842 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-099ad2cc-a436-42e9-b816-96a9209d99cc tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:34.433571 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-099ad2cc-a436-42e9-b816-96a9209d99cc tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:35.012411 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-099ad2cc-a436-42e9-b816-96a9209d99cc tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:35.025147 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-099ad2cc-a436-42e9-b816-96a9209d99cc tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:35.038621 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-099ad2cc-a436-42e9-b816-96a9209d99cc tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:35.041105 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-099ad2cc-a436-42e9-b816-96a9209d99cc tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1" status: 200 len: 1486 microversion: 2.25 time: 0.637110 Oct 18 15:32:35.046181 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1009/1946] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:32:34 2022] GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1 => generated 1486 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:32:35.062170 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-31203ba8-f82b-4fed-b1d2-d1ce1e551633 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:35.064284 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-31203ba8-f82b-4fed-b1d2-d1ce1e551633 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] [instance: 078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:35.081163 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-31203ba8-f82b-4fed-b1d2-d1ce1e551633 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:35.084793 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-31203ba8-f82b-4fed-b1d2-d1ce1e551633 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:35.088569 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-31203ba8-f82b-4fed-b1d2-d1ce1e551633 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:35.089842 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-31203ba8-f82b-4fed-b1d2-d1ce1e551633 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:35.091858 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-31203ba8-f82b-4fed-b1d2-d1ce1e551633 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:35.092951 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-31203ba8-f82b-4fed-b1d2-d1ce1e551633 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:35.750167 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-31203ba8-f82b-4fed-b1d2-d1ce1e551633 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db93066933684d41a77863c156deb4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17eee1a6b8d43589bf66e6e18059021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:35.762532 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-31203ba8-f82b-4fed-b1d2-d1ce1e551633 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] 10.222.0.60 "GET /compute/v2.1/servers/078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4" status: 200 len: 1354 microversion: 2.1 time: 0.712408 Oct 18 15:32:35.764675 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1010/1947] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:32:35 2022] GET /compute/v2.1/servers/078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4 => generated 1354 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:32:35.783546 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2b8ace75-6d8e-4373-a6e6-40493bca290c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:35.786615 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2b8ace75-6d8e-4373-a6e6-40493bca290c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:35.814219 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2b8ace75-6d8e-4373-a6e6-40493bca290c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:35.818285 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2b8ace75-6d8e-4373-a6e6-40493bca290c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:35.818748 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2b8ace75-6d8e-4373-a6e6-40493bca290c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:35.819507 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2b8ace75-6d8e-4373-a6e6-40493bca290c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:35.819971 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2b8ace75-6d8e-4373-a6e6-40493bca290c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:35.820398 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2b8ace75-6d8e-4373-a6e6-40493bca290c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:36.277957 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2b8ace75-6d8e-4373-a6e6-40493bca290c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:36.296830 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2b8ace75-6d8e-4373-a6e6-40493bca290c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e" status: 200 len: 1184 microversion: 2.1 time: 0.529328 Oct 18 15:32:36.299957 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1011/1948] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:32:35 2022] GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e => generated 1184 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:32:36.310813 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-65015e76-ff12-4549-b64b-acb579e2f4ab tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:36.312261 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-65015e76-ff12-4549-b64b-acb579e2f4ab tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 0dfb045a-8cea-41b6-bbdc-8fa6600046d1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:36.351902 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-65015e76-ff12-4549-b64b-acb579e2f4ab tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:36.353352 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-65015e76-ff12-4549-b64b-acb579e2f4ab tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:36.357818 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-65015e76-ff12-4549-b64b-acb579e2f4ab tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:36.361868 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-65015e76-ff12-4549-b64b-acb579e2f4ab tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:36.362705 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-65015e76-ff12-4549-b64b-acb579e2f4ab tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:36.364574 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-65015e76-ff12-4549-b64b-acb579e2f4ab tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:37.228949 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-65015e76-ff12-4549-b64b-acb579e2f4ab tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:37.264190 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-65015e76-ff12-4549-b64b-acb579e2f4ab tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:37.266599 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-65015e76-ff12-4549-b64b-acb579e2f4ab tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:37.269817 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-65015e76-ff12-4549-b64b-acb579e2f4ab tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1" status: 200 len: 1486 microversion: 2.25 time: 0.967810 Oct 18 15:32:37.271394 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1012/1949] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:32:36 2022] GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1 => generated 1486 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:32:37.578959 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-71bf8b88-7390-4bed-a710-1cf3311b3281 tempest-FlavorsV2NegativeTest-917708931 tempest-FlavorsV2NegativeTest-917708931-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:37.599683 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-71bf8b88-7390-4bed-a710-1cf3311b3281 tempest-FlavorsV2NegativeTest-917708931 tempest-FlavorsV2NegativeTest-917708931-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.323548 Oct 18 15:32:37.602602 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1013/1950] 10.222.0.60 () {58 vars in 1137 bytes} [Tue Oct 18 15:32:37 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:32:37.618105 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-33f640e1-1d70-462b-a603-aa5eb9b1a4fe tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:37.619727 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-33f640e1-1d70-462b-a603-aa5eb9b1a4fe tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] [instance: 078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:37.643281 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-33f640e1-1d70-462b-a603-aa5eb9b1a4fe tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:37.645332 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-33f640e1-1d70-462b-a603-aa5eb9b1a4fe tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:37.646846 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-33f640e1-1d70-462b-a603-aa5eb9b1a4fe tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:37.648621 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-33f640e1-1d70-462b-a603-aa5eb9b1a4fe tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:37.649886 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-33f640e1-1d70-462b-a603-aa5eb9b1a4fe tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:37.653793 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-33f640e1-1d70-462b-a603-aa5eb9b1a4fe tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:38.159543 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-33f640e1-1d70-462b-a603-aa5eb9b1a4fe tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db93066933684d41a77863c156deb4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17eee1a6b8d43589bf66e6e18059021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:38.167764 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-33f640e1-1d70-462b-a603-aa5eb9b1a4fe tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] 10.222.0.60 "GET /compute/v2.1/servers/078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4" status: 200 len: 1354 microversion: 2.1 time: 0.563069 Oct 18 15:32:38.168357 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1014/1951] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:32:37 2022] GET /compute/v2.1/servers/078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4 => generated 1354 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:32:38.182946 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d28fdec0-0c0b-4a2f-9414-e60be856daca tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:38.183820 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d28fdec0-0c0b-4a2f-9414-e60be856daca tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:38.202734 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d28fdec0-0c0b-4a2f-9414-e60be856daca tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:38.203642 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d28fdec0-0c0b-4a2f-9414-e60be856daca tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:38.209091 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d28fdec0-0c0b-4a2f-9414-e60be856daca tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:38.210182 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d28fdec0-0c0b-4a2f-9414-e60be856daca tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:38.210926 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d28fdec0-0c0b-4a2f-9414-e60be856daca tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:38.211550 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d28fdec0-0c0b-4a2f-9414-e60be856daca tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:38.320259 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d28fdec0-0c0b-4a2f-9414-e60be856daca tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:38.330172 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d28fdec0-0c0b-4a2f-9414-e60be856daca tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e" status: 200 len: 1184 microversion: 2.1 time: 0.160105 Oct 18 15:32:38.334289 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1015/1952] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:32:38 2022] GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e => generated 1184 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:32:38.347903 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-11c1eb6a-c04a-4307-9a0e-7122f6af236a req-2d66d985-c6aa-4d03-b8cf-f99c6bc97ccf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4", "tag": "fa5913cd-9730-4003-abf6-95f3a02345c4"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:32:38.375846 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-11c1eb6a-c04a-4307-9a0e-7122f6af236a req-2d66d985-c6aa-4d03-b8cf-f99c6bc97ccf service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:38.379274 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-11c1eb6a-c04a-4307-9a0e-7122f6af236a req-2d66d985-c6aa-4d03-b8cf-f99c6bc97ccf service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:38.382420 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-11c1eb6a-c04a-4307-9a0e-7122f6af236a req-2d66d985-c6aa-4d03-b8cf-f99c6bc97ccf service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:38.407839 n-d-853682-5 devstack@n-api.service[120405]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 15:32:38.408664 n-d-853682-5 devstack@n-api.service[120405]: Tue Oct 18 15:32:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.60) !!! Oct 18 15:32:38.415215 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-11c1eb6a-c04a-4307-9a0e-7122f6af236a req-2d66d985-c6aa-4d03-b8cf-f99c6bc97ccf service nova] Creating event network-changed:fa5913cd-9730-4003-abf6-95f3a02345c4 for instance 078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4 on n-h2-853682-5 Oct 18 15:32:38.427330 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-11c1eb6a-c04a-4307-9a0e-7122f6af236a req-2d66d985-c6aa-4d03-b8cf-f99c6bc97ccf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089825 Oct 18 15:32:38.431706 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1016/1953] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:32:38.448710 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e8b486a5-143e-4ed5-81fa-703d1a3b6dae tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:38.453816 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e8b486a5-143e-4ed5-81fa-703d1a3b6dae tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 0dfb045a-8cea-41b6-bbdc-8fa6600046d1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:38.473128 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e8b486a5-143e-4ed5-81fa-703d1a3b6dae tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:38.477046 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e8b486a5-143e-4ed5-81fa-703d1a3b6dae tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:38.478160 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e8b486a5-143e-4ed5-81fa-703d1a3b6dae tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:38.479459 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e8b486a5-143e-4ed5-81fa-703d1a3b6dae tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:38.482873 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e8b486a5-143e-4ed5-81fa-703d1a3b6dae tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:38.483934 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e8b486a5-143e-4ed5-81fa-703d1a3b6dae tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:38.791729 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e8b486a5-143e-4ed5-81fa-703d1a3b6dae tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:38.821989 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e8b486a5-143e-4ed5-81fa-703d1a3b6dae tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:38.824173 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e8b486a5-143e-4ed5-81fa-703d1a3b6dae tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:38.831341 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e8b486a5-143e-4ed5-81fa-703d1a3b6dae tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1" status: 200 len: 1486 microversion: 2.25 time: 0.396599 Oct 18 15:32:38.834168 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1017/1954] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:32:38 2022] GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1 => generated 1486 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:32:39.196049 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-dc672663-fe41-40f9-8b15-8c896e9fbf8e tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:39.197432 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-dc672663-fe41-40f9-8b15-8c896e9fbf8e tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] [instance: 078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:39.208952 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dc672663-fe41-40f9-8b15-8c896e9fbf8e tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:39.210348 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dc672663-fe41-40f9-8b15-8c896e9fbf8e tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:39.213543 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dc672663-fe41-40f9-8b15-8c896e9fbf8e tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:39.214882 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dc672663-fe41-40f9-8b15-8c896e9fbf8e tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:39.216907 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dc672663-fe41-40f9-8b15-8c896e9fbf8e tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:39.218435 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dc672663-fe41-40f9-8b15-8c896e9fbf8e tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:39.514856 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-dc672663-fe41-40f9-8b15-8c896e9fbf8e tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db93066933684d41a77863c156deb4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17eee1a6b8d43589bf66e6e18059021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:39.524837 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-dc672663-fe41-40f9-8b15-8c896e9fbf8e tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] 10.222.0.60 "GET /compute/v2.1/servers/078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4" status: 200 len: 1354 microversion: 2.1 time: 0.333691 Oct 18 15:32:39.540791 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1018/1955] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:32:39 2022] GET /compute/v2.1/servers/078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4 => generated 1354 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:32:39.550004 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2c847e8f-9ec1-4026-a958-7646f976c42d tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:39.550872 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2c847e8f-9ec1-4026-a958-7646f976c42d tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:39.558101 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c847e8f-9ec1-4026-a958-7646f976c42d tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:39.558686 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c847e8f-9ec1-4026-a958-7646f976c42d tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:39.559198 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c847e8f-9ec1-4026-a958-7646f976c42d tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:39.560581 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c847e8f-9ec1-4026-a958-7646f976c42d tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:39.561147 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c847e8f-9ec1-4026-a958-7646f976c42d tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:39.562027 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c847e8f-9ec1-4026-a958-7646f976c42d tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:39.700791 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2c847e8f-9ec1-4026-a958-7646f976c42d tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:39.717142 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2c847e8f-9ec1-4026-a958-7646f976c42d tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e" status: 200 len: 1184 microversion: 2.1 time: 0.173827 Oct 18 15:32:39.736984 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1019/1956] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:32:39 2022] GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e => generated 1184 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:32:39.863486 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-db4d4005-a873-47b6-b658-25873ccad174 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:39.865168 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-db4d4005-a873-47b6-b658-25873ccad174 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 0dfb045a-8cea-41b6-bbdc-8fa6600046d1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:39.878727 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-db4d4005-a873-47b6-b658-25873ccad174 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:39.879612 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-db4d4005-a873-47b6-b658-25873ccad174 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:39.880480 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-db4d4005-a873-47b6-b658-25873ccad174 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:39.882351 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-db4d4005-a873-47b6-b658-25873ccad174 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:39.885205 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-db4d4005-a873-47b6-b658-25873ccad174 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:39.885898 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-db4d4005-a873-47b6-b658-25873ccad174 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:40.468794 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-db4d4005-a873-47b6-b658-25873ccad174 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:40.482898 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-db4d4005-a873-47b6-b658-25873ccad174 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:40.487387 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-db4d4005-a873-47b6-b658-25873ccad174 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:40.490168 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-db4d4005-a873-47b6-b658-25873ccad174 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1" status: 200 len: 1486 microversion: 2.25 time: 0.631092 Oct 18 15:32:40.490945 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1020/1957] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:32:39 2022] GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1 => generated 1486 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:32:40.498864 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-3cf4522f-12ef-4ea7-80f8-2b81f1a247f4 req-3b4df4fc-b33b-4d37-976e-25f98e488bc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4", "tag": "afe51523-a5a5-4406-9404-6e8e8b95aabb"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:32:40.538510 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-3cf4522f-12ef-4ea7-80f8-2b81f1a247f4 req-3b4df4fc-b33b-4d37-976e-25f98e488bc1 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:40.540450 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-3cf4522f-12ef-4ea7-80f8-2b81f1a247f4 req-3b4df4fc-b33b-4d37-976e-25f98e488bc1 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:40.542438 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-3cf4522f-12ef-4ea7-80f8-2b81f1a247f4 req-3b4df4fc-b33b-4d37-976e-25f98e488bc1 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:40.572208 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-3cf4522f-12ef-4ea7-80f8-2b81f1a247f4 req-3b4df4fc-b33b-4d37-976e-25f98e488bc1 service nova] Creating event network-changed:afe51523-a5a5-4406-9404-6e8e8b95aabb for instance 078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4 on n-h2-853682-5 Oct 18 15:32:40.584042 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-3cf4522f-12ef-4ea7-80f8-2b81f1a247f4 req-3b4df4fc-b33b-4d37-976e-25f98e488bc1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089882 Oct 18 15:32:40.584721 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1021/1958] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:32:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:32:40.612052 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3d49477a-3a15-4774-b81f-8266d3c8fc39 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:40.613824 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3d49477a-3a15-4774-b81f-8266d3c8fc39 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] [instance: 078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:40.627317 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3d49477a-3a15-4774-b81f-8266d3c8fc39 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:40.630992 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3d49477a-3a15-4774-b81f-8266d3c8fc39 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:40.631878 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3d49477a-3a15-4774-b81f-8266d3c8fc39 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:40.636231 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3d49477a-3a15-4774-b81f-8266d3c8fc39 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:40.637197 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3d49477a-3a15-4774-b81f-8266d3c8fc39 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:40.637958 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3d49477a-3a15-4774-b81f-8266d3c8fc39 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:40.983222 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3d49477a-3a15-4774-b81f-8266d3c8fc39 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db93066933684d41a77863c156deb4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17eee1a6b8d43589bf66e6e18059021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:40.998520 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3d49477a-3a15-4774-b81f-8266d3c8fc39 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] 10.222.0.60 "GET /compute/v2.1/servers/078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4" status: 200 len: 1354 microversion: 2.1 time: 0.404093 Oct 18 15:32:41.004744 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1022/1959] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:32:40 2022] GET /compute/v2.1/servers/078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4 => generated 1354 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:32:41.009576 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-31525889-23f2-43fa-a86b-592fd0fcc27e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:41.019803 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-31525889-23f2-43fa-a86b-592fd0fcc27e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:41.036181 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-31525889-23f2-43fa-a86b-592fd0fcc27e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:41.036872 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-31525889-23f2-43fa-a86b-592fd0fcc27e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:41.038149 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-31525889-23f2-43fa-a86b-592fd0fcc27e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:41.040475 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-31525889-23f2-43fa-a86b-592fd0fcc27e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:41.041131 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-31525889-23f2-43fa-a86b-592fd0fcc27e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:41.045242 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-31525889-23f2-43fa-a86b-592fd0fcc27e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:41.184062 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-31525889-23f2-43fa-a86b-592fd0fcc27e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:41.203967 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-31525889-23f2-43fa-a86b-592fd0fcc27e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e" status: 200 len: 1184 microversion: 2.1 time: 0.197649 Oct 18 15:32:41.224884 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1023/1960] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:32:41 2022] GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e => generated 1184 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:32:41.533441 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1ca899a6-40f6-400b-9ecb-4b102f4b695c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:41.534331 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1ca899a6-40f6-400b-9ecb-4b102f4b695c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 0dfb045a-8cea-41b6-bbdc-8fa6600046d1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:41.560898 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1ca899a6-40f6-400b-9ecb-4b102f4b695c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:41.561964 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1ca899a6-40f6-400b-9ecb-4b102f4b695c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:41.562808 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1ca899a6-40f6-400b-9ecb-4b102f4b695c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:41.564235 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1ca899a6-40f6-400b-9ecb-4b102f4b695c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:41.564998 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1ca899a6-40f6-400b-9ecb-4b102f4b695c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:41.565602 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1ca899a6-40f6-400b-9ecb-4b102f4b695c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:41.869447 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1ca899a6-40f6-400b-9ecb-4b102f4b695c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:41.882095 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1ca899a6-40f6-400b-9ecb-4b102f4b695c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:41.883938 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1ca899a6-40f6-400b-9ecb-4b102f4b695c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:41.886208 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1ca899a6-40f6-400b-9ecb-4b102f4b695c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1" status: 200 len: 1486 microversion: 2.25 time: 0.362849 Oct 18 15:32:41.887210 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1024/1961] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:32:41 2022] GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1 => generated 1486 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:32:42.029989 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-cf2b2c3f-9a8c-4e31-9c36-5367a2f39de7 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:42.031497 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-cf2b2c3f-9a8c-4e31-9c36-5367a2f39de7 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] [instance: 078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:42.042890 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cf2b2c3f-9a8c-4e31-9c36-5367a2f39de7 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:42.044210 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cf2b2c3f-9a8c-4e31-9c36-5367a2f39de7 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:42.044768 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cf2b2c3f-9a8c-4e31-9c36-5367a2f39de7 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:42.045638 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cf2b2c3f-9a8c-4e31-9c36-5367a2f39de7 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:42.046486 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cf2b2c3f-9a8c-4e31-9c36-5367a2f39de7 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:42.047015 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cf2b2c3f-9a8c-4e31-9c36-5367a2f39de7 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:42.353793 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-cf2b2c3f-9a8c-4e31-9c36-5367a2f39de7 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db93066933684d41a77863c156deb4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17eee1a6b8d43589bf66e6e18059021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:42.379925 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-cf2b2c3f-9a8c-4e31-9c36-5367a2f39de7 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] 10.222.0.60 "GET /compute/v2.1/servers/078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4" status: 200 len: 1354 microversion: 2.1 time: 0.353654 Oct 18 15:32:42.382864 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1025/1962] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:32:42 2022] GET /compute/v2.1/servers/078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4 => generated 1354 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:32:42.391908 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3a00991d-5695-4dc8-8aa0-eab3784de16e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:42.392935 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3a00991d-5695-4dc8-8aa0-eab3784de16e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:42.406815 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3a00991d-5695-4dc8-8aa0-eab3784de16e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:42.408393 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3a00991d-5695-4dc8-8aa0-eab3784de16e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:42.409661 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3a00991d-5695-4dc8-8aa0-eab3784de16e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:42.410797 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3a00991d-5695-4dc8-8aa0-eab3784de16e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:42.411518 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3a00991d-5695-4dc8-8aa0-eab3784de16e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:42.412417 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3a00991d-5695-4dc8-8aa0-eab3784de16e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:42.442814 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=100 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:32:42.505452 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3a00991d-5695-4dc8-8aa0-eab3784de16e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:42.517291 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3a00991d-5695-4dc8-8aa0-eab3784de16e tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e" status: 200 len: 1184 microversion: 2.1 time: 0.132339 Oct 18 15:32:42.518698 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1026/1963] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:32:42 2022] GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e => generated 1184 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:32:42.605178 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-d3e67d91-2a13-44aa-9056-28723e9ad19f req-57c34fd8-2108-4be4-9fde-cf84a77c56aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4", "tag": "38a3909b-6479-4afc-a2c5-41eea4aba3ee"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:32:42.647944 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-d3e67d91-2a13-44aa-9056-28723e9ad19f req-57c34fd8-2108-4be4-9fde-cf84a77c56aa service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:42.652279 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-d3e67d91-2a13-44aa-9056-28723e9ad19f req-57c34fd8-2108-4be4-9fde-cf84a77c56aa service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:42.653156 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-d3e67d91-2a13-44aa-9056-28723e9ad19f req-57c34fd8-2108-4be4-9fde-cf84a77c56aa service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:42.683559 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-d3e67d91-2a13-44aa-9056-28723e9ad19f req-57c34fd8-2108-4be4-9fde-cf84a77c56aa service nova] Creating event network-changed:38a3909b-6479-4afc-a2c5-41eea4aba3ee for instance 078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4 on n-h2-853682-5 Oct 18 15:32:42.690077 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-d3e67d91-2a13-44aa-9056-28723e9ad19f req-57c34fd8-2108-4be4-9fde-cf84a77c56aa service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091329 Oct 18 15:32:42.707145 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1027/1964] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:32:42.915058 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ebc39e5d-5340-4bb8-a246-88301697006b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:42.915792 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ebc39e5d-5340-4bb8-a246-88301697006b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 0dfb045a-8cea-41b6-bbdc-8fa6600046d1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:42.928067 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ebc39e5d-5340-4bb8-a246-88301697006b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:42.928572 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ebc39e5d-5340-4bb8-a246-88301697006b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:42.929037 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ebc39e5d-5340-4bb8-a246-88301697006b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:42.929749 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ebc39e5d-5340-4bb8-a246-88301697006b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:42.930207 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ebc39e5d-5340-4bb8-a246-88301697006b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:42.930632 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ebc39e5d-5340-4bb8-a246-88301697006b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:43.257709 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ebc39e5d-5340-4bb8-a246-88301697006b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:43.274485 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ebc39e5d-5340-4bb8-a246-88301697006b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:43.276071 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ebc39e5d-5340-4bb8-a246-88301697006b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:43.281230 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ebc39e5d-5340-4bb8-a246-88301697006b tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1" status: 200 len: 1486 microversion: 2.25 time: 0.368925 Oct 18 15:32:43.281830 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1028/1965] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:32:42 2022] GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1 => generated 1486 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:32:43.410721 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8fdda982-d5f5-4f28-8cd7-6c20b619dd0f tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:43.412347 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8fdda982-d5f5-4f28-8cd7-6c20b619dd0f tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] [instance: 078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:43.426937 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8fdda982-d5f5-4f28-8cd7-6c20b619dd0f tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:43.427445 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8fdda982-d5f5-4f28-8cd7-6c20b619dd0f tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:43.427886 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8fdda982-d5f5-4f28-8cd7-6c20b619dd0f tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:43.428987 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8fdda982-d5f5-4f28-8cd7-6c20b619dd0f tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:43.430034 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8fdda982-d5f5-4f28-8cd7-6c20b619dd0f tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:43.436835 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8fdda982-d5f5-4f28-8cd7-6c20b619dd0f tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:43.860526 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7e23b1bf-6089-47d5-bfc5-b5808d1eee9c tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/f739839c-98aa-47e3-80e7-07753aa06df7" status: 200 len: 1454 microversion: 2.1 time: 23.954720 Oct 18 15:32:43.863332 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 938/1966] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:32:19 2022] GET /compute/v2.1/images/f739839c-98aa-47e3-80e7-07753aa06df7 => generated 1454 bytes in 23960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:32:43.880461 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b391b8a5-9170-4171-b5ea-5b786544e402 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:43.883590 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b391b8a5-9170-4171-b5ea-5b786544e402 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:43.906364 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b391b8a5-9170-4171-b5ea-5b786544e402 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:43.907854 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b391b8a5-9170-4171-b5ea-5b786544e402 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:43.909342 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b391b8a5-9170-4171-b5ea-5b786544e402 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:43.912037 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b391b8a5-9170-4171-b5ea-5b786544e402 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:43.913547 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b391b8a5-9170-4171-b5ea-5b786544e402 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:43.915580 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b391b8a5-9170-4171-b5ea-5b786544e402 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:44.010411 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b391b8a5-9170-4171-b5ea-5b786544e402 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:44.013423 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b391b8a5-9170-4171-b5ea-5b786544e402 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:44.014087 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b391b8a5-9170-4171-b5ea-5b786544e402 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:44.014736 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-b391b8a5-9170-4171-b5ea-5b786544e402 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lazy-loading 'fault' on Instance uuid da62499c-f590-4083-80b6-b849b6695c4e {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:32:44.372193 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b391b8a5-9170-4171-b5ea-5b786544e402 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:44.380655 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b391b8a5-9170-4171-b5ea-5b786544e402 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e" status: 200 len: 1143 microversion: 2.1 time: 0.516002 Oct 18 15:32:44.387084 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 939/1967] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:32:43 2022] GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e => generated 1143 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:32:44.392624 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-90d73200-4bcb-43bd-b315-0ac9ca75f5a4 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:44.408887 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-90d73200-4bcb-43bd-b315-0ac9ca75f5a4 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 0dfb045a-8cea-41b6-bbdc-8fa6600046d1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:44.426648 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90d73200-4bcb-43bd-b315-0ac9ca75f5a4 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:44.435860 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90d73200-4bcb-43bd-b315-0ac9ca75f5a4 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:44.439292 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90d73200-4bcb-43bd-b315-0ac9ca75f5a4 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:44.442885 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90d73200-4bcb-43bd-b315-0ac9ca75f5a4 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:44.445844 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90d73200-4bcb-43bd-b315-0ac9ca75f5a4 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:44.446238 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8fdda982-d5f5-4f28-8cd7-6c20b619dd0f tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db93066933684d41a77863c156deb4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17eee1a6b8d43589bf66e6e18059021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:44.447929 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90d73200-4bcb-43bd-b315-0ac9ca75f5a4 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:44.462089 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8fdda982-d5f5-4f28-8cd7-6c20b619dd0f tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] 10.222.0.60 "GET /compute/v2.1/servers/078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4" status: 200 len: 1354 microversion: 2.1 time: 1.053905 Oct 18 15:32:44.471189 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1029/1968] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:32:43 2022] GET /compute/v2.1/servers/078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4 => generated 1354 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:32:44.724603 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-e1918523-47b8-4a2c-977e-832f38ecf07f req-211d3736-1489-461a-a729-881a762d9f53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dfb045a-8cea-41b6-bbdc-8fa6600046d1", "name": "network-vif-unplugged", "status": "completed", "tag": "8b71a6b8-e604-4cd4-9224-71a40ab44fd3"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:32:44.755946 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-e1918523-47b8-4a2c-977e-832f38ecf07f req-211d3736-1489-461a-a729-881a762d9f53 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:44.757439 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-e1918523-47b8-4a2c-977e-832f38ecf07f req-211d3736-1489-461a-a729-881a762d9f53 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:44.758133 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-e1918523-47b8-4a2c-977e-832f38ecf07f req-211d3736-1489-461a-a729-881a762d9f53 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:44.779963 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-e1918523-47b8-4a2c-977e-832f38ecf07f req-211d3736-1489-461a-a729-881a762d9f53 service nova] Creating event network-vif-unplugged:8b71a6b8-e604-4cd4-9224-71a40ab44fd3 for instance 0dfb045a-8cea-41b6-bbdc-8fa6600046d1 on n-h2-853682-5 Oct 18 15:32:44.786148 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-e1918523-47b8-4a2c-977e-832f38ecf07f req-211d3736-1489-461a-a729-881a762d9f53 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070005 Oct 18 15:32:44.787490 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1030/1969] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:32:44.883179 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a1b1a50f-74eb-40a4-985a-b303e4b1d733 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c416f8040>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:44.890506 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-90d73200-4bcb-43bd-b315-0ac9ca75f5a4 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:44.899845 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-90d73200-4bcb-43bd-b315-0ac9ca75f5a4 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:44.910845 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-90d73200-4bcb-43bd-b315-0ac9ca75f5a4 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:44.914196 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-90d73200-4bcb-43bd-b315-0ac9ca75f5a4 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1" status: 200 len: 1486 microversion: 2.25 time: 0.525742 Oct 18 15:32:44.918177 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 940/1970] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:32:44 2022] GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1 => generated 1486 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:32:45.413569 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7d3b5c52-e743-4e6f-8cc0-1eb13901b712 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:45.414197 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7d3b5c52-e743-4e6f-8cc0-1eb13901b712 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: da62499c-f590-4083-80b6-b849b6695c4e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:45.431674 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d3b5c52-e743-4e6f-8cc0-1eb13901b712 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:45.433405 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d3b5c52-e743-4e6f-8cc0-1eb13901b712 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:45.434054 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d3b5c52-e743-4e6f-8cc0-1eb13901b712 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:45.439488 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d3b5c52-e743-4e6f-8cc0-1eb13901b712 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:45.440631 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d3b5c52-e743-4e6f-8cc0-1eb13901b712 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:45.441211 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d3b5c52-e743-4e6f-8cc0-1eb13901b712 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:45.498659 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-7d3b5c52-e743-4e6f-8cc0-1eb13901b712 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] HTTP exception thrown: Instance da62499c-f590-4083-80b6-b849b6695c4e could not be found. Oct 18 15:32:45.506824 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7d3b5c52-e743-4e6f-8cc0-1eb13901b712 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Request method failure captured: Oct 18 15:32:45.506824 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e HTTP/1.1 Oct 18 15:32:45.506824 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:32:45.506824 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:32:45.506824 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:32:45.506824 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:32:45.506824 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:32:45.506824 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:32:45.506824 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:32:45.506824 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:32:45.506824 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsUkGjMP8SjffvouuV50DvwlNdoUk3Q8vLUFcV0A2x652BNW6xWL9154nGgy7NsbEx0ieOHcq-kaOYynRivFB9-xv9EzXZcbjE75S3D-xLvfYzqMvco4WZxCQ5vHukzGevKOCqI92gfSfyxpF_yo0jschT8PzGwnqZSfEW-ovydAl8o Oct 18 15:32:45.506824 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:32:45.506824 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:32:45.506824 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:32:45.506824 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:32:45.506824 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:32:45.506824 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:32:45.506824 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: a6565f6ef56e4ed3b530d009055cd619 Oct 18 15:32:45.506824 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-LiveMigrationTest-1739198630 Oct 18 15:32:45.506824 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:32:45.506824 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:32:45.508711 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a6565f6ef56e4ed3b530d009055cd619"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a6565f6ef56e4ed3b530d009055cd619"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a6565f6ef56e4ed3b530d009055cd619"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a6565f6ef56e4ed3b530d009055cd619"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:32:45.508711 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-LiveMigrationTest-1739198630 Oct 18 15:32:45.508711 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: a6565f6ef56e4ed3b530d009055cd619 Oct 18 15:32:45.508711 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-LiveMigrationTest-1739198630 Oct 18 15:32:45.508711 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-LiveMigrationTest-1739198630-project Oct 18 15:32:45.508711 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:32:45.508711 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:32:45.508711 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: c747aec412924b52b99dbf75d0c77fa4 Oct 18 15:32:45.508711 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-LiveMigrationTest-1739198630-project Oct 18 15:32:45.508711 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:32:45.508711 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance da62499c-f590-4083-80b6-b849b6695c4e could not be found. Oct 18 15:32:45.508711 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'da62499c-f590-4083-80b6-b849b6695c4e'} Oct 18 15:32:45.509717 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:32:45.509717 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:32:45.509717 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:32:45.509717 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:32:45.509717 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:32:45.509717 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:32:45.509717 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:32:45.509717 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:32:45.509717 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:32:45.509717 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:32:45.509717 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da62499c-f590-4083-80b6-b849b6695c4e could not be found. Oct 18 15:32:45.509717 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:32:45.509717 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:32:45.509717 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:32:45.509717 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:32:45.509717 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:32:45.509717 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:32:45.509717 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:32:45.509717 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:32:45.509717 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:32:45.511238 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:32:45.511238 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:32:45.511238 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:32:45.511238 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:32:45.511238 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:32:45.511238 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:32:45.511238 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:32:45.511238 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da62499c-f590-4083-80b6-b849b6695c4e could not be found. Oct 18 15:32:45.511238 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:32:45.511238 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:32:45.511238 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:32:45.511238 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:32:45.511238 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:32:45.511238 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:32:45.511238 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:32:45.511238 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:32:45.511238 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da62499c-f590-4083-80b6-b849b6695c4e could not be found. Oct 18 15:32:45.511238 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:32:45.517976 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7d3b5c52-e743-4e6f-8cc0-1eb13901b712 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Returning 404 to user: Instance da62499c-f590-4083-80b6-b849b6695c4e could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:32:45.520362 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7d3b5c52-e743-4e6f-8cc0-1eb13901b712 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e" status: 404 len: 111 microversion: 2.1 time: 0.111386 Oct 18 15:32:45.527729 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 941/1971] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:32:45 2022] GET /compute/v2.1/servers/da62499c-f590-4083-80b6-b849b6695c4e => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:32:45.539598 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f371971d-85bf-4dc5-acba-446a10f1a87f tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:45.553257 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f371971d-85bf-4dc5-acba-446a10f1a87f tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] [instance: 078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:45.568244 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f371971d-85bf-4dc5-acba-446a10f1a87f tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:45.576613 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f371971d-85bf-4dc5-acba-446a10f1a87f tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:45.577457 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f371971d-85bf-4dc5-acba-446a10f1a87f tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:45.578461 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f371971d-85bf-4dc5-acba-446a10f1a87f tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:45.579150 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f371971d-85bf-4dc5-acba-446a10f1a87f tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:45.579818 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f371971d-85bf-4dc5-acba-446a10f1a87f tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:46.097487 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f371971d-85bf-4dc5-acba-446a10f1a87f tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db93066933684d41a77863c156deb4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17eee1a6b8d43589bf66e6e18059021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:46.110489 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f371971d-85bf-4dc5-acba-446a10f1a87f tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] 10.222.0.60 "GET /compute/v2.1/servers/078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4" status: 200 len: 1354 microversion: 2.1 time: 0.579389 Oct 18 15:32:46.121412 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 942/1972] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:32:45 2022] GET /compute/v2.1/servers/078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4 => generated 1354 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:32:46.142167 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2970f8f8-d412-4ae7-8e4b-e1a2b3450f02 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:46.143728 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2970f8f8-d412-4ae7-8e4b-e1a2b3450f02 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 0dfb045a-8cea-41b6-bbdc-8fa6600046d1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:46.156942 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2970f8f8-d412-4ae7-8e4b-e1a2b3450f02 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:46.159848 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2970f8f8-d412-4ae7-8e4b-e1a2b3450f02 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:46.160562 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2970f8f8-d412-4ae7-8e4b-e1a2b3450f02 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:46.162290 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2970f8f8-d412-4ae7-8e4b-e1a2b3450f02 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:46.162956 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2970f8f8-d412-4ae7-8e4b-e1a2b3450f02 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:46.167936 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2970f8f8-d412-4ae7-8e4b-e1a2b3450f02 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:46.612906 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2970f8f8-d412-4ae7-8e4b-e1a2b3450f02 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:46.627448 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2970f8f8-d412-4ae7-8e4b-e1a2b3450f02 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:46.635326 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2970f8f8-d412-4ae7-8e4b-e1a2b3450f02 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:46.638551 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2970f8f8-d412-4ae7-8e4b-e1a2b3450f02 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1" status: 200 len: 1486 microversion: 2.25 time: 0.515546 Oct 18 15:32:46.646075 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 943/1973] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:32:46 2022] GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1 => generated 1486 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:32:46.804544 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-8505026a-f79c-478d-9f3c-b2917ec869d4 req-bb8fcef9-cb1f-4d01-857c-62c26660028d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dfb045a-8cea-41b6-bbdc-8fa6600046d1", "tag": "8b71a6b8-e604-4cd4-9224-71a40ab44fd3"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:32:46.833551 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8505026a-f79c-478d-9f3c-b2917ec869d4 req-bb8fcef9-cb1f-4d01-857c-62c26660028d service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:46.834336 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8505026a-f79c-478d-9f3c-b2917ec869d4 req-bb8fcef9-cb1f-4d01-857c-62c26660028d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:46.834963 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8505026a-f79c-478d-9f3c-b2917ec869d4 req-bb8fcef9-cb1f-4d01-857c-62c26660028d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:46.864162 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-8505026a-f79c-478d-9f3c-b2917ec869d4 req-bb8fcef9-cb1f-4d01-857c-62c26660028d service nova] Creating event network-changed:8b71a6b8-e604-4cd4-9224-71a40ab44fd3 for instance 0dfb045a-8cea-41b6-bbdc-8fa6600046d1 on n-h2-853682-5 Oct 18 15:32:46.870469 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-8505026a-f79c-478d-9f3c-b2917ec869d4 req-bb8fcef9-cb1f-4d01-857c-62c26660028d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070021 Oct 18 15:32:46.871410 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 944/1974] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:32:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:32:47.139308 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9992cebd-dd86-47ca-a007-176b48a8e20f tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:47.140090 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9992cebd-dd86-47ca-a007-176b48a8e20f tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] [instance: 078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:47.160319 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9992cebd-dd86-47ca-a007-176b48a8e20f tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:47.160831 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9992cebd-dd86-47ca-a007-176b48a8e20f tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:47.161273 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9992cebd-dd86-47ca-a007-176b48a8e20f tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:47.161996 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9992cebd-dd86-47ca-a007-176b48a8e20f tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:47.162464 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9992cebd-dd86-47ca-a007-176b48a8e20f tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:47.162892 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9992cebd-dd86-47ca-a007-176b48a8e20f tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:48.548574 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9992cebd-dd86-47ca-a007-176b48a8e20f tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db93066933684d41a77863c156deb4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17eee1a6b8d43589bf66e6e18059021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:48.560143 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9992cebd-dd86-47ca-a007-176b48a8e20f tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] 10.222.0.60 "GET /compute/v2.1/servers/078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4" status: 200 len: 1354 microversion: 2.1 time: 1.425102 Oct 18 15:32:48.575417 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 945/1975] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:32:47 2022] GET /compute/v2.1/servers/078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4 => generated 1354 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:32:48.596201 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c5f17cb8-4dc9-4021-822c-3dabe6ec9fc9 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:48.604500 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c5f17cb8-4dc9-4021-822c-3dabe6ec9fc9 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 0dfb045a-8cea-41b6-bbdc-8fa6600046d1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:48.613175 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5f17cb8-4dc9-4021-822c-3dabe6ec9fc9 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:48.614583 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5f17cb8-4dc9-4021-822c-3dabe6ec9fc9 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:48.622128 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5f17cb8-4dc9-4021-822c-3dabe6ec9fc9 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:48.623328 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5f17cb8-4dc9-4021-822c-3dabe6ec9fc9 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:48.626660 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5f17cb8-4dc9-4021-822c-3dabe6ec9fc9 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:48.627427 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5f17cb8-4dc9-4021-822c-3dabe6ec9fc9 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:49.144944 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c5f17cb8-4dc9-4021-822c-3dabe6ec9fc9 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:49.158062 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c5f17cb8-4dc9-4021-822c-3dabe6ec9fc9 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:49.165331 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c5f17cb8-4dc9-4021-822c-3dabe6ec9fc9 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:49.166718 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c5f17cb8-4dc9-4021-822c-3dabe6ec9fc9 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1" status: 200 len: 1486 microversion: 2.25 time: 0.590030 Oct 18 15:32:49.184052 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 946/1976] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:32:48 2022] GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1 => generated 1486 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:32:49.554113 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-93e8679f-4b69-4e20-abb4-cc38243fabc7 tempest-FlavorsV2NegativeTest-917708931 tempest-FlavorsV2NegativeTest-917708931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1220912925", "imageRef": "5a2bfc4f-e47a-4cdc-90d8-6bf7f0376c30", "flavorRef": "452"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:32:49.641662 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a1b1a50f-74eb-40a4-985a-b303e4b1d733 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/f739839c-98aa-47e3-80e7-07753aa06df7" status: 200 len: 1454 microversion: 2.1 time: 4.765254 Oct 18 15:32:49.650025 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1031/1977] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:32:44 2022] GET /compute/v2.1/images/f739839c-98aa-47e3-80e7-07753aa06df7 => generated 1454 bytes in 4775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:32:49.663429 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-65567a0c-484b-4194-8c48-cca6dba351d9 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:49.669533 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-65567a0c-484b-4194-8c48-cca6dba351d9 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] [instance: 078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:49.689957 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-65567a0c-484b-4194-8c48-cca6dba351d9 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:49.698919 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-65567a0c-484b-4194-8c48-cca6dba351d9 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:49.699462 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-65567a0c-484b-4194-8c48-cca6dba351d9 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:49.709813 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-65567a0c-484b-4194-8c48-cca6dba351d9 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:49.711157 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-65567a0c-484b-4194-8c48-cca6dba351d9 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:49.717048 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-93e8679f-4b69-4e20-abb4-cc38243fabc7 tempest-FlavorsV2NegativeTest-917708931 tempest-FlavorsV2NegativeTest-917708931-project] validate_networks() for None {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:32:49.717523 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-65567a0c-484b-4194-8c48-cca6dba351d9 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:50.577080 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-65567a0c-484b-4194-8c48-cca6dba351d9 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db93066933684d41a77863c156deb4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17eee1a6b8d43589bf66e6e18059021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:50.591801 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-65567a0c-484b-4194-8c48-cca6dba351d9 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] 10.222.0.60 "GET /compute/v2.1/servers/078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4" status: 200 len: 1354 microversion: 2.1 time: 0.940607 Oct 18 15:32:50.596334 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1032/1978] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:32:49 2022] GET /compute/v2.1/servers/078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4 => generated 1354 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:32:50.615124 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4d26f5e3-e3f5-4c51-9843-3c84302c4189 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:50.629227 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4d26f5e3-e3f5-4c51-9843-3c84302c4189 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 0dfb045a-8cea-41b6-bbdc-8fa6600046d1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:50.654928 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4d26f5e3-e3f5-4c51-9843-3c84302c4189 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:50.666326 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4d26f5e3-e3f5-4c51-9843-3c84302c4189 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:50.668073 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4d26f5e3-e3f5-4c51-9843-3c84302c4189 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:50.673466 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4d26f5e3-e3f5-4c51-9843-3c84302c4189 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:50.680149 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4d26f5e3-e3f5-4c51-9843-3c84302c4189 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:50.686768 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4d26f5e3-e3f5-4c51-9843-3c84302c4189 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:50.754002 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-93e8679f-4b69-4e20-abb4-cc38243fabc7 tempest-FlavorsV2NegativeTest-917708931 tempest-FlavorsV2NegativeTest-917708931-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 18 15:32:50.756271 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-93e8679f-4b69-4e20-abb4-cc38243fabc7 tempest-FlavorsV2NegativeTest-917708931 tempest-FlavorsV2NegativeTest-917708931-project] Request method failure captured: Oct 18 15:32:50.756271 n-d-853682-5 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 15:32:50.756271 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:32:50.756271 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:32:50.756271 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:32:50.756271 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 143 Oct 18 15:32:50.756271 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:32:50.756271 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:32:50.756271 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:32:50.756271 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:32:50.756271 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTscUFdkHsfWMoT-tB-Ws3xMe8_KregEecp1dIfkZtYmTZC2lp72Qvs_rXNLNG-5X1gznI_V-ZaQAtGAdfNSgh04lmrQMzHLwBhd9h4Ak1LHPWzkvkPTMuKabR2G-YSRjzdvF4qG-jqg-Xf2hOFVZGckCOK8izJ9Yt7-ZQingtyxMfDo Oct 18 15:32:50.756271 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:32:50.756271 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:32:50.756271 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:32:50.756271 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:32:50.756271 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:32:50.756271 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:32:50.756271 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: dbdb83c391a84959b637bb087a378b4f Oct 18 15:32:50.756271 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-FlavorsV2NegativeTest-917708931 Oct 18 15:32:50.756271 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:32:50.756271 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:32:50.760236 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/dbdb83c391a84959b637bb087a378b4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/dbdb83c391a84959b637bb087a378b4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/dbdb83c391a84959b637bb087a378b4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_dbdb83c391a84959b637bb087a378b4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:32:50.760236 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-FlavorsV2NegativeTest-917708931 Oct 18 15:32:50.760236 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: dbdb83c391a84959b637bb087a378b4f Oct 18 15:32:50.760236 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-917708931 Oct 18 15:32:50.760236 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-FlavorsV2NegativeTest-917708931-project Oct 18 15:32:50.760236 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:32:50.760236 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:32:50.760236 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: cb24198a81eb4ff58e3b2b427343a82e Oct 18 15:32:50.760236 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-FlavorsV2NegativeTest-917708931-project Oct 18 15:32:50.760236 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:32:50.760236 n-d-853682-5 devstack@n-api.service[120406]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1220912925", "imageRef": "5a2bfc4f-e47a-4cdc-90d8-6bf7f0376c30", "flavorRef": "452"}} Oct 18 15:32:50.760236 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:32:50.761248 n-d-853682-5 devstack@n-api.service[120406]: exception: Flavor's memory is too small for requested image. Oct 18 15:32:50.761248 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1220912925', 'imageRef': '5a2bfc4f-e47a-4cdc-90d8-6bf7f0376c30', 'flavorRef': '452'}}} Oct 18 15:32:50.761248 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:32:50.761248 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:32:50.761248 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 18 15:32:50.761248 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 18 15:32:50.761248 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 18 15:32:50.761248 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 18 15:32:50.761248 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 18 15:32:50.761248 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 18 15:32:50.761248 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 18 15:32:50.761248 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 18 15:32:50.761248 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 18 15:32:50.761248 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 18 15:32:50.761248 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 18 15:32:50.761248 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 18 15:32:50.761248 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 18 15:32:50.761248 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:32:50.761248 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:32:50.761248 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:32:50.762780 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:32:50.762780 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:32:50.762780 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:32:50.762780 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:32:50.762780 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:32:50.762780 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:32:50.762780 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:32:50.762780 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:32:50.762780 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:32:50.762780 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:32:50.762780 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:32:50.762780 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:32:50.762780 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:32:50.762780 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 18 15:32:50.762780 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 18 15:32:50.762780 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 18 15:32:50.762780 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 18 15:32:50.762780 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:32:50.762780 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:32:50.762780 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:32:50.762780 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:32:50.764378 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:32:50.764378 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:32:50.764378 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:32:50.764378 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:32:50.764378 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 18 15:32:50.764378 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:32:50.764378 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-93e8679f-4b69-4e20-abb4-cc38243fabc7 tempest-FlavorsV2NegativeTest-917708931 tempest-FlavorsV2NegativeTest-917708931-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:32:50.764378 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-93e8679f-4b69-4e20-abb4-cc38243fabc7 tempest-FlavorsV2NegativeTest-917708931 tempest-FlavorsV2NegativeTest-917708931-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 1.208953 Oct 18 15:32:50.764378 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 947/1979] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:32:49 2022] POST /compute/v2.1/servers => generated 93 bytes in 1210 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 18 15:32:50.791431 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-522299a8-b010-4c96-bb3f-eb2c67c74aa7 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c3cf203a0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:51.458563 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4d26f5e3-e3f5-4c51-9843-3c84302c4189 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:51.504183 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4d26f5e3-e3f5-4c51-9843-3c84302c4189 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:51.506170 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4d26f5e3-e3f5-4c51-9843-3c84302c4189 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:51.507668 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4d26f5e3-e3f5-4c51-9843-3c84302c4189 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1" status: 200 len: 1486 microversion: 2.25 time: 0.906649 Oct 18 15:32:51.524579 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1033/1980] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:32:50 2022] GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1 => generated 1486 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:32:51.628211 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e33f7a77-2e1f-4a30-a97a-83859ef2009e tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:51.629243 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e33f7a77-2e1f-4a30-a97a-83859ef2009e tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] [instance: 078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:51.647417 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e33f7a77-2e1f-4a30-a97a-83859ef2009e tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:51.657571 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e33f7a77-2e1f-4a30-a97a-83859ef2009e tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:51.658995 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e33f7a77-2e1f-4a30-a97a-83859ef2009e tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:51.659995 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e33f7a77-2e1f-4a30-a97a-83859ef2009e tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:51.660683 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e33f7a77-2e1f-4a30-a97a-83859ef2009e tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:51.661398 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e33f7a77-2e1f-4a30-a97a-83859ef2009e tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:51.912641 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-522299a8-b010-4c96-bb3f-eb2c67c74aa7 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/f739839c-98aa-47e3-80e7-07753aa06df7" status: 200 len: 1454 microversion: 2.1 time: 1.141856 Oct 18 15:32:51.914616 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 948/1981] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:32:50 2022] GET /compute/v2.1/images/f739839c-98aa-47e3-80e7-07753aa06df7 => generated 1454 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:32:52.077362 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e33f7a77-2e1f-4a30-a97a-83859ef2009e tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db93066933684d41a77863c156deb4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17eee1a6b8d43589bf66e6e18059021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:52.087608 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e33f7a77-2e1f-4a30-a97a-83859ef2009e tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] 10.222.0.60 "GET /compute/v2.1/servers/078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4" status: 200 len: 1354 microversion: 2.1 time: 0.463336 Oct 18 15:32:52.105014 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1034/1982] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:32:51 2022] GET /compute/v2.1/servers/078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4 => generated 1354 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:32:52.545396 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dfb8223a-54cb-490a-b0d8-1968fd057f25 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:52.546057 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dfb8223a-54cb-490a-b0d8-1968fd057f25 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 0dfb045a-8cea-41b6-bbdc-8fa6600046d1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:52.562095 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfb8223a-54cb-490a-b0d8-1968fd057f25 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:52.591045 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfb8223a-54cb-490a-b0d8-1968fd057f25 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:52.591045 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfb8223a-54cb-490a-b0d8-1968fd057f25 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:52.591437 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfb8223a-54cb-490a-b0d8-1968fd057f25 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:52.591891 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfb8223a-54cb-490a-b0d8-1968fd057f25 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:52.592319 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfb8223a-54cb-490a-b0d8-1968fd057f25 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:52.929473 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-eefdf457-76d3-4e21-a85f-2ee3079b627e tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c416769d0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:53.018921 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-eefdf457-76d3-4e21-a85f-2ee3079b627e tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/f739839c-98aa-47e3-80e7-07753aa06df7" status: 200 len: 1454 microversion: 2.1 time: 0.093354 Oct 18 15:32:53.032408 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1035/1983] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:32:52 2022] GET /compute/v2.1/images/f739839c-98aa-47e3-80e7-07753aa06df7 => generated 1454 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:32:53.128410 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5f7d0459-9d19-4a12-967a-79072de9c542 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:53.134350 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5f7d0459-9d19-4a12-967a-79072de9c542 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] [instance: 078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:53.143279 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5f7d0459-9d19-4a12-967a-79072de9c542 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:53.147724 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5f7d0459-9d19-4a12-967a-79072de9c542 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:53.150049 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5f7d0459-9d19-4a12-967a-79072de9c542 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:53.151942 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5f7d0459-9d19-4a12-967a-79072de9c542 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:53.165620 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5f7d0459-9d19-4a12-967a-79072de9c542 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:53.169535 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5f7d0459-9d19-4a12-967a-79072de9c542 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:53.235476 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dfb8223a-54cb-490a-b0d8-1968fd057f25 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:53.245877 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dfb8223a-54cb-490a-b0d8-1968fd057f25 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:53.280438 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dfb8223a-54cb-490a-b0d8-1968fd057f25 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:53.283645 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dfb8223a-54cb-490a-b0d8-1968fd057f25 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1" status: 200 len: 1486 microversion: 2.25 time: 0.743883 Oct 18 15:32:53.296842 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 949/1984] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:32:52 2022] GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1 => generated 1486 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:32:53.703165 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5f7d0459-9d19-4a12-967a-79072de9c542 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db93066933684d41a77863c156deb4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17eee1a6b8d43589bf66e6e18059021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:53.717292 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5f7d0459-9d19-4a12-967a-79072de9c542 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] 10.222.0.60 "GET /compute/v2.1/servers/078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4" status: 200 len: 1354 microversion: 2.1 time: 0.593360 Oct 18 15:32:53.771602 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1036/1985] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:32:53 2022] GET /compute/v2.1/servers/078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4 => generated 1354 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:32:54.043901 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5d1b3b80-aeda-4529-9e96-9708367df878 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c3ce8cca0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:54.140427 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5d1b3b80-aeda-4529-9e96-9708367df878 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/f739839c-98aa-47e3-80e7-07753aa06df7" status: 200 len: 1463 microversion: 2.1 time: 0.100270 Oct 18 15:32:54.141620 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 950/1986] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:32:54 2022] GET /compute/v2.1/images/f739839c-98aa-47e3-80e7-07753aa06df7 => generated 1463 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:32:54.156513 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-de991778-1e95-42f5-aeef-a12fa48a88b0 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c3d025b80>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:54.236069 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-de991778-1e95-42f5-aeef-a12fa48a88b0 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/f739839c-98aa-47e3-80e7-07753aa06df7" status: 200 len: 1463 microversion: 2.1 time: 0.083301 Oct 18 15:32:54.253220 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1037/1987] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:32:54 2022] GET /compute/v2.1/images/f739839c-98aa-47e3-80e7-07753aa06df7 => generated 1463 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:32:54.266354 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c60ac3b9-d7e0-4f90-a466-53506ee362f1 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:54.267843 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c60ac3b9-d7e0-4f90-a466-53506ee362f1 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] [instance: 4e1ae723-8f58-4752-b578-da0b39e9a668] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:54.278411 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c60ac3b9-d7e0-4f90-a466-53506ee362f1 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:54.281319 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c60ac3b9-d7e0-4f90-a466-53506ee362f1 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:54.282015 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c60ac3b9-d7e0-4f90-a466-53506ee362f1 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:54.285474 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c60ac3b9-d7e0-4f90-a466-53506ee362f1 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:54.286227 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c60ac3b9-d7e0-4f90-a466-53506ee362f1 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:54.286903 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c60ac3b9-d7e0-4f90-a466-53506ee362f1 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:54.325433 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7f65063e-8ac2-481f-84fb-79c2e579e92f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:54.326433 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7f65063e-8ac2-481f-84fb-79c2e579e92f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 0dfb045a-8cea-41b6-bbdc-8fa6600046d1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:54.344593 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7f65063e-8ac2-481f-84fb-79c2e579e92f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:54.345496 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7f65063e-8ac2-481f-84fb-79c2e579e92f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:54.346176 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7f65063e-8ac2-481f-84fb-79c2e579e92f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:54.347157 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7f65063e-8ac2-481f-84fb-79c2e579e92f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:54.351382 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7f65063e-8ac2-481f-84fb-79c2e579e92f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:54.357300 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7f65063e-8ac2-481f-84fb-79c2e579e92f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:54.696293 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c60ac3b9-d7e0-4f90-a466-53506ee362f1 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f901dea4594eb6831a78e2e603e8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c369c078bd4c49148290abb7de3d076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:54.707614 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c60ac3b9-d7e0-4f90-a466-53506ee362f1 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/servers/4e1ae723-8f58-4752-b578-da0b39e9a668" status: 200 len: 1480 microversion: 2.1 time: 0.444972 Oct 18 15:32:54.725265 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 951/1988] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:32:54 2022] GET /compute/v2.1/servers/4e1ae723-8f58-4752-b578-da0b39e9a668 => generated 1480 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:32:54.732407 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7f65063e-8ac2-481f-84fb-79c2e579e92f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:54.751917 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7f65063e-8ac2-481f-84fb-79c2e579e92f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:54.771087 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-40dcf7cf-6404-4173-85a4-c0b427e79bbf tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:54.771709 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-40dcf7cf-6404-4173-85a4-c0b427e79bbf tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] [instance: 078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:54.775151 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7f65063e-8ac2-481f-84fb-79c2e579e92f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:54.776403 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7f65063e-8ac2-481f-84fb-79c2e579e92f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1" status: 200 len: 1486 microversion: 2.25 time: 0.454917 Oct 18 15:32:54.788992 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1038/1989] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:32:54 2022] GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1 => generated 1486 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:32:54.805921 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40dcf7cf-6404-4173-85a4-c0b427e79bbf tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:54.807304 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40dcf7cf-6404-4173-85a4-c0b427e79bbf tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:54.808046 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40dcf7cf-6404-4173-85a4-c0b427e79bbf tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:54.809206 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40dcf7cf-6404-4173-85a4-c0b427e79bbf tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:54.809846 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40dcf7cf-6404-4173-85a4-c0b427e79bbf tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:54.810446 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40dcf7cf-6404-4173-85a4-c0b427e79bbf tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:55.119667 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-40dcf7cf-6404-4173-85a4-c0b427e79bbf tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db93066933684d41a77863c156deb4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17eee1a6b8d43589bf66e6e18059021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:55.128129 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-40dcf7cf-6404-4173-85a4-c0b427e79bbf tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] 10.222.0.60 "GET /compute/v2.1/servers/078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4" status: 200 len: 1354 microversion: 2.1 time: 0.360890 Oct 18 15:32:55.147398 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 952/1990] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:32:54 2022] GET /compute/v2.1/servers/078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4 => generated 1354 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:32:55.250714 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-a4909fb1-59c2-44c1-9b65-b0970360d18b req-9bfdbca2-2c0b-4885-bc50-322e5d8e57a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4", "name": "network-vif-plugged", "status": "completed", "tag": "38a3909b-6479-4afc-a2c5-41eea4aba3ee"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:32:55.275170 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-a4909fb1-59c2-44c1-9b65-b0970360d18b req-9bfdbca2-2c0b-4885-bc50-322e5d8e57a2 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:55.276352 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-a4909fb1-59c2-44c1-9b65-b0970360d18b req-9bfdbca2-2c0b-4885-bc50-322e5d8e57a2 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:55.277275 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-a4909fb1-59c2-44c1-9b65-b0970360d18b req-9bfdbca2-2c0b-4885-bc50-322e5d8e57a2 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:55.324137 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-a4909fb1-59c2-44c1-9b65-b0970360d18b req-9bfdbca2-2c0b-4885-bc50-322e5d8e57a2 service nova] Creating event network-vif-plugged:38a3909b-6479-4afc-a2c5-41eea4aba3ee for instance 078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4 on n-h2-853682-5 Oct 18 15:32:55.339642 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-a4909fb1-59c2-44c1-9b65-b0970360d18b req-9bfdbca2-2c0b-4885-bc50-322e5d8e57a2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093842 Oct 18 15:32:55.349432 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1039/1991] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:32:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:32:55.743976 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-61c4e07d-6ce6-41d7-b66c-ef707d518550 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:55.744604 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-61c4e07d-6ce6-41d7-b66c-ef707d518550 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] [instance: 4e1ae723-8f58-4752-b578-da0b39e9a668] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:55.758421 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-61c4e07d-6ce6-41d7-b66c-ef707d518550 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:55.758928 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-61c4e07d-6ce6-41d7-b66c-ef707d518550 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:55.759373 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-61c4e07d-6ce6-41d7-b66c-ef707d518550 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:55.760090 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-61c4e07d-6ce6-41d7-b66c-ef707d518550 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:55.760555 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-61c4e07d-6ce6-41d7-b66c-ef707d518550 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:55.761030 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-61c4e07d-6ce6-41d7-b66c-ef707d518550 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:55.815654 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c27142da-e602-4fa8-bf03-84f6189353d8 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:55.816520 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c27142da-e602-4fa8-bf03-84f6189353d8 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 0dfb045a-8cea-41b6-bbdc-8fa6600046d1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:55.826344 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c27142da-e602-4fa8-bf03-84f6189353d8 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:55.828681 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c27142da-e602-4fa8-bf03-84f6189353d8 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:55.829400 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c27142da-e602-4fa8-bf03-84f6189353d8 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:55.833709 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c27142da-e602-4fa8-bf03-84f6189353d8 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:55.834447 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c27142da-e602-4fa8-bf03-84f6189353d8 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:55.837701 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c27142da-e602-4fa8-bf03-84f6189353d8 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:56.323185 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-61c4e07d-6ce6-41d7-b66c-ef707d518550 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f901dea4594eb6831a78e2e603e8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c369c078bd4c49148290abb7de3d076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:56.339389 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-61c4e07d-6ce6-41d7-b66c-ef707d518550 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/servers/4e1ae723-8f58-4752-b578-da0b39e9a668" status: 200 len: 1467 microversion: 2.1 time: 0.599113 Oct 18 15:32:56.345448 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 953/1992] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:32:55 2022] GET /compute/v2.1/servers/4e1ae723-8f58-4752-b578-da0b39e9a668 => generated 1467 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:32:56.350775 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-67ba7046-51b4-40e7-98c4-0d2889e358b0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:56.359997 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-67ba7046-51b4-40e7-98c4-0d2889e358b0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:56.394894 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67ba7046-51b4-40e7-98c4-0d2889e358b0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:56.395929 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67ba7046-51b4-40e7-98c4-0d2889e358b0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:56.396556 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67ba7046-51b4-40e7-98c4-0d2889e358b0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:56.398150 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67ba7046-51b4-40e7-98c4-0d2889e358b0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:56.402119 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67ba7046-51b4-40e7-98c4-0d2889e358b0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:56.404003 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67ba7046-51b4-40e7-98c4-0d2889e358b0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:56.491631 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-67ba7046-51b4-40e7-98c4-0d2889e358b0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:32:56.703870 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c27142da-e602-4fa8-bf03-84f6189353d8 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:56.727326 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c27142da-e602-4fa8-bf03-84f6189353d8 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:56.734546 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c27142da-e602-4fa8-bf03-84f6189353d8 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:56.737436 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c27142da-e602-4fa8-bf03-84f6189353d8 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1" status: 200 len: 1486 microversion: 2.25 time: 0.926021 Oct 18 15:32:56.741521 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1040/1993] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:32:55 2022] GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1 => generated 1486 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:32:56.763975 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3fcba056-3c0f-4318-9e67-c304f7ecd297 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:56.765167 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3fcba056-3c0f-4318-9e67-c304f7ecd297 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] [instance: 078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:56.781486 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3fcba056-3c0f-4318-9e67-c304f7ecd297 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:56.783538 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3fcba056-3c0f-4318-9e67-c304f7ecd297 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:56.784238 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3fcba056-3c0f-4318-9e67-c304f7ecd297 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:56.785945 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3fcba056-3c0f-4318-9e67-c304f7ecd297 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:56.787152 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3fcba056-3c0f-4318-9e67-c304f7ecd297 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:56.788342 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3fcba056-3c0f-4318-9e67-c304f7ecd297 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:56.826776 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-67ba7046-51b4-40e7-98c4-0d2889e358b0 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2" status: 204 len: 0 microversion: 2.1 time: 0.475836 Oct 18 15:32:56.836333 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 954/1994] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:32:56 2022] DELETE /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:32:56.858338 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2cae5db8-1606-4735-915e-5915df424661 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1133657582"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:32:56.867658 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2cae5db8-1606-4735-915e-5915df424661 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] [instance: 0d0c7fc6-9245-41f3-9257-d2b8955a6d4d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:56.895696 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2cae5db8-1606-4735-915e-5915df424661 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:56.897787 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2cae5db8-1606-4735-915e-5915df424661 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:56.899297 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2cae5db8-1606-4735-915e-5915df424661 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:56.900257 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2cae5db8-1606-4735-915e-5915df424661 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:56.902452 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2cae5db8-1606-4735-915e-5915df424661 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:56.903760 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2cae5db8-1606-4735-915e-5915df424661 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:57.325333 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3fcba056-3c0f-4318-9e67-c304f7ecd297 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db93066933684d41a77863c156deb4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17eee1a6b8d43589bf66e6e18059021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:57.337306 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3fcba056-3c0f-4318-9e67-c304f7ecd297 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] 10.222.0.60 "GET /compute/v2.1/servers/078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4" status: 200 len: 1354 microversion: 2.1 time: 0.592537 Oct 18 15:32:57.338848 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1041/1995] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:32:56 2022] GET /compute/v2.1/servers/078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4 => generated 1354 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:32:57.359703 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8b4f3d9a-bbf3-44e9-8cee-f46766e31837 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:57.364758 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8b4f3d9a-bbf3-44e9-8cee-f46766e31837 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:57.383644 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2cae5db8-1606-4735-915e-5915df424661 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "POST /compute/v2.1/servers/0d0c7fc6-9245-41f3-9257-d2b8955a6d4d/action" status: 202 len: 0 microversion: 2.1 time: 0.543453 Oct 18 15:32:57.385582 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 955/1996] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:32:56 2022] POST /compute/v2.1/servers/0d0c7fc6-9245-41f3-9257-d2b8955a6d4d/action => generated 0 bytes in 548 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 18 15:32:57.391553 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8b4f3d9a-bbf3-44e9-8cee-f46766e31837 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:57.394149 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8b4f3d9a-bbf3-44e9-8cee-f46766e31837 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:57.394610 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8b4f3d9a-bbf3-44e9-8cee-f46766e31837 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:57.398659 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a8e9a7a9-27a1-4c02-9091-4b37ade45f2f tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c3ce2b8b0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:57.399243 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8b4f3d9a-bbf3-44e9-8cee-f46766e31837 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:57.399730 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8b4f3d9a-bbf3-44e9-8cee-f46766e31837 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:57.404429 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8b4f3d9a-bbf3-44e9-8cee-f46766e31837 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:57.541520 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a8e9a7a9-27a1-4c02-9091-4b37ade45f2f tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/93adc85c-6524-4498-aef9-436e2b0ea7c9" status: 200 len: 1455 microversion: 2.1 time: 0.148872 Oct 18 15:32:57.550749 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 956/1997] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:32:57 2022] GET /compute/v2.1/images/93adc85c-6524-4498-aef9-436e2b0ea7c9 => generated 1455 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:32:57.555887 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-f4f6fc8a-2f11-438a-86c6-faaaeb30e5ab req-bfea06b7-5c1c-4d41-9700-b8e5229773cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4", "name": "network-vif-plugged", "status": "completed", "tag": "fa5913cd-9730-4003-abf6-95f3a02345c4"}, {"server_uuid": "078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4", "name": "network-vif-plugged", "status": "completed", "tag": "afe51523-a5a5-4406-9404-6e8e8b95aabb"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:32:57.590898 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f4f6fc8a-2f11-438a-86c6-faaaeb30e5ab req-bfea06b7-5c1c-4d41-9700-b8e5229773cc service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:57.591382 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f4f6fc8a-2f11-438a-86c6-faaaeb30e5ab req-bfea06b7-5c1c-4d41-9700-b8e5229773cc service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:57.591812 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f4f6fc8a-2f11-438a-86c6-faaaeb30e5ab req-bfea06b7-5c1c-4d41-9700-b8e5229773cc service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:57.632183 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-f4f6fc8a-2f11-438a-86c6-faaaeb30e5ab req-bfea06b7-5c1c-4d41-9700-b8e5229773cc service nova] Creating event network-vif-plugged:fa5913cd-9730-4003-abf6-95f3a02345c4 for instance 078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4 on n-h2-853682-5 Oct 18 15:32:57.633313 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-f4f6fc8a-2f11-438a-86c6-faaaeb30e5ab req-bfea06b7-5c1c-4d41-9700-b8e5229773cc service nova] Creating event network-vif-plugged:afe51523-a5a5-4406-9404-6e8e8b95aabb for instance 078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4 on n-h2-853682-5 Oct 18 15:32:57.647768 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-f4f6fc8a-2f11-438a-86c6-faaaeb30e5ab req-bfea06b7-5c1c-4d41-9700-b8e5229773cc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.095421 Oct 18 15:32:57.658749 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 957/1998] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:32:57 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:32:57.771044 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6b4f1e6c-f73f-4f1f-98eb-64f7a9937733 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:57.771304 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6b4f1e6c-f73f-4f1f-98eb-64f7a9937733 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 0dfb045a-8cea-41b6-bbdc-8fa6600046d1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:57.779515 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b4f1e6c-f73f-4f1f-98eb-64f7a9937733 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:57.780009 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b4f1e6c-f73f-4f1f-98eb-64f7a9937733 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:57.780484 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b4f1e6c-f73f-4f1f-98eb-64f7a9937733 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:57.781181 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b4f1e6c-f73f-4f1f-98eb-64f7a9937733 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:57.781639 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b4f1e6c-f73f-4f1f-98eb-64f7a9937733 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:57.782068 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b4f1e6c-f73f-4f1f-98eb-64f7a9937733 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:57.796721 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:32:58.216984 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8b4f3d9a-bbf3-44e9-8cee-f46766e31837 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:58.234109 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8b4f3d9a-bbf3-44e9-8cee-f46766e31837 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2" status: 200 len: 1667 microversion: 2.1 time: 0.890894 Oct 18 15:32:58.234842 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1042/1999] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:32:57 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2 => generated 1667 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:32:58.362963 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0fff5db8-8d30-4276-8cbc-5412667d10f8 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:58.363487 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0fff5db8-8d30-4276-8cbc-5412667d10f8 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] [instance: 078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:58.372889 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0fff5db8-8d30-4276-8cbc-5412667d10f8 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:58.373345 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0fff5db8-8d30-4276-8cbc-5412667d10f8 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:58.373775 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0fff5db8-8d30-4276-8cbc-5412667d10f8 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:58.374486 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0fff5db8-8d30-4276-8cbc-5412667d10f8 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:58.374931 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0fff5db8-8d30-4276-8cbc-5412667d10f8 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:58.375351 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0fff5db8-8d30-4276-8cbc-5412667d10f8 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:58.388551 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6b4f1e6c-f73f-4f1f-98eb-64f7a9937733 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:58.401974 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6b4f1e6c-f73f-4f1f-98eb-64f7a9937733 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:58.404409 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6b4f1e6c-f73f-4f1f-98eb-64f7a9937733 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:58.415544 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6b4f1e6c-f73f-4f1f-98eb-64f7a9937733 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1" status: 200 len: 1486 microversion: 2.25 time: 0.648995 Oct 18 15:32:58.416297 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 958/2000] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:32:57 2022] GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1 => generated 1486 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:32:58.558200 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-819adbea-d4b2-426a-b60f-6b3d43a22f73 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c3ce2b1f0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:58.637361 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-819adbea-d4b2-426a-b60f-6b3d43a22f73 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/93adc85c-6524-4498-aef9-436e2b0ea7c9" status: 200 len: 1455 microversion: 2.1 time: 0.083070 Oct 18 15:32:58.641065 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 959/2001] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:32:58 2022] GET /compute/v2.1/images/93adc85c-6524-4498-aef9-436e2b0ea7c9 => generated 1455 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:32:58.773736 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0fff5db8-8d30-4276-8cbc-5412667d10f8 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db93066933684d41a77863c156deb4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17eee1a6b8d43589bf66e6e18059021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:58.792000 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0fff5db8-8d30-4276-8cbc-5412667d10f8 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] 10.222.0.60 "GET /compute/v2.1/servers/078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4" status: 200 len: 1354 microversion: 2.1 time: 0.432404 Oct 18 15:32:58.794952 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1043/2002] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:32:58 2022] GET /compute/v2.1/servers/078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4 => generated 1354 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:32:59.267005 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-55262d89-7c59-4254-a088-537548fb7d2c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:59.267853 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-55262d89-7c59-4254-a088-537548fb7d2c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:59.276995 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55262d89-7c59-4254-a088-537548fb7d2c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:59.278034 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55262d89-7c59-4254-a088-537548fb7d2c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:59.278475 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55262d89-7c59-4254-a088-537548fb7d2c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:59.279183 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55262d89-7c59-4254-a088-537548fb7d2c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:59.279637 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55262d89-7c59-4254-a088-537548fb7d2c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:59.280061 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55262d89-7c59-4254-a088-537548fb7d2c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:59.447129 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-deb35515-d760-4d61-86d0-f925e2a48147 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:59.448390 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-deb35515-d760-4d61-86d0-f925e2a48147 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 0dfb045a-8cea-41b6-bbdc-8fa6600046d1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:59.462250 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-deb35515-d760-4d61-86d0-f925e2a48147 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:59.469008 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-deb35515-d760-4d61-86d0-f925e2a48147 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:59.469899 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-deb35515-d760-4d61-86d0-f925e2a48147 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:59.470869 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-deb35515-d760-4d61-86d0-f925e2a48147 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:59.471522 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-deb35515-d760-4d61-86d0-f925e2a48147 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:59.472123 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-deb35515-d760-4d61-86d0-f925e2a48147 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:59.602834 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-55262d89-7c59-4254-a088-537548fb7d2c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:32:59.620034 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-55262d89-7c59-4254-a088-537548fb7d2c tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2" status: 200 len: 1599 microversion: 2.1 time: 0.362622 Oct 18 15:32:59.621601 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 960/2003] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:32:59 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2 => generated 1599 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:32:59.639025 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-672956f8-1132-4d6b-af66-a35148e794eb req-a4c63a89-4d4d-47fe-bfed-85d99104c238 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0a3feae-1805-4c09-881b-99dd257bd9c2", "name": "network-vif-deleted", "tag": "e6a47323-8aa2-4713-af2b-48bb88888044"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:32:59.664343 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-672956f8-1132-4d6b-af66-a35148e794eb req-a4c63a89-4d4d-47fe-bfed-85d99104c238 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:59.665219 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-672956f8-1132-4d6b-af66-a35148e794eb req-a4c63a89-4d4d-47fe-bfed-85d99104c238 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:59.665819 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-672956f8-1132-4d6b-af66-a35148e794eb req-a4c63a89-4d4d-47fe-bfed-85d99104c238 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:59.697483 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-672956f8-1132-4d6b-af66-a35148e794eb req-a4c63a89-4d4d-47fe-bfed-85d99104c238 service nova] Creating event network-vif-deleted:e6a47323-8aa2-4713-af2b-48bb88888044 for instance a0a3feae-1805-4c09-881b-99dd257bd9c2 on n-h2-853682-5 Oct 18 15:32:59.710174 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-672956f8-1132-4d6b-af66-a35148e794eb req-a4c63a89-4d4d-47fe-bfed-85d99104c238 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086871 Oct 18 15:32:59.711137 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 961/2004] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:32:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:32:59.719003 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6611dd42-14e7-45b7-bcb8-73b27cab3d79 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c3ce2bee0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:59.834932 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6611dd42-14e7-45b7-bcb8-73b27cab3d79 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/93adc85c-6524-4498-aef9-436e2b0ea7c9" status: 200 len: 1455 microversion: 2.1 time: 0.121339 Oct 18 15:32:59.837261 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 962/2005] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:32:59 2022] GET /compute/v2.1/images/93adc85c-6524-4498-aef9-436e2b0ea7c9 => generated 1455 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:32:59.850390 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-696b3b49-d1e6-4f55-bfa4-79921eaf60f0 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:32:59.854739 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-696b3b49-d1e6-4f55-bfa4-79921eaf60f0 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] [instance: 078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:32:59.906652 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-696b3b49-d1e6-4f55-bfa4-79921eaf60f0 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:59.908708 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-696b3b49-d1e6-4f55-bfa4-79921eaf60f0 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:59.911662 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-696b3b49-d1e6-4f55-bfa4-79921eaf60f0 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:32:59.913549 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-696b3b49-d1e6-4f55-bfa4-79921eaf60f0 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:32:59.914960 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-696b3b49-d1e6-4f55-bfa4-79921eaf60f0 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:32:59.918690 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-696b3b49-d1e6-4f55-bfa4-79921eaf60f0 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:00.354093 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-deb35515-d760-4d61-86d0-f925e2a48147 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:00.366349 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-deb35515-d760-4d61-86d0-f925e2a48147 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:00.367815 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-deb35515-d760-4d61-86d0-f925e2a48147 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:00.369021 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-deb35515-d760-4d61-86d0-f925e2a48147 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1" status: 200 len: 1476 microversion: 2.25 time: 0.926904 Oct 18 15:33:00.392980 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1044/2006] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:32:59 2022] GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1 => generated 1476 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:33:00.397878 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-d0256c91-8abd-46b0-ad10-c681cc1b04dc req-81f6df9b-6141-4c44-b0f7-ae822c3d1427 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e1ae723-8f58-4752-b578-da0b39e9a668", "name": "network-vif-unplugged", "status": "completed", "tag": "2083c6f4-97f8-4301-a307-2ecb7417f192"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:33:00.423293 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-d0256c91-8abd-46b0-ad10-c681cc1b04dc req-81f6df9b-6141-4c44-b0f7-ae822c3d1427 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:00.423861 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-d0256c91-8abd-46b0-ad10-c681cc1b04dc req-81f6df9b-6141-4c44-b0f7-ae822c3d1427 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:00.424301 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-d0256c91-8abd-46b0-ad10-c681cc1b04dc req-81f6df9b-6141-4c44-b0f7-ae822c3d1427 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:00.472010 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-d0256c91-8abd-46b0-ad10-c681cc1b04dc req-81f6df9b-6141-4c44-b0f7-ae822c3d1427 service nova] Creating event network-vif-unplugged:2083c6f4-97f8-4301-a307-2ecb7417f192 for instance 4e1ae723-8f58-4752-b578-da0b39e9a668 on n-h1-853682-5 Oct 18 15:33:00.488224 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-d0256c91-8abd-46b0-ad10-c681cc1b04dc req-81f6df9b-6141-4c44-b0f7-ae822c3d1427 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088488 Oct 18 15:33:00.489178 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1045/2007] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:33:00.501040 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b5297782-aba3-4c1b-a78d-2b6d8e722c47 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Calling method '.version_select at 0x7f7c417143a0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:00.521610 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b5297782-aba3-4c1b-a78d-2b6d8e722c47 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:00.525512 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b5297782-aba3-4c1b-a78d-2b6d8e722c47 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:00.526237 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b5297782-aba3-4c1b-a78d-2b6d8e722c47 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:00.550917 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b5297782-aba3-4c1b-a78d-2b6d8e722c47 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] 10.222.0.60 "GET /compute/v2.1/os-migrations" status: 200 len: 3200 microversion: 2.25 time: 0.055135 Oct 18 15:33:00.553390 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1046/2008] 10.222.0.60 () {60 vars in 1184 bytes} [Tue Oct 18 15:33:00 2022] GET /compute/v2.1/os-migrations => generated 3200 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:33:00.556360 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-696b3b49-d1e6-4f55-bfa4-79921eaf60f0 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db93066933684d41a77863c156deb4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17eee1a6b8d43589bf66e6e18059021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:00.575898 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6e723367-ca16-4739-938e-2d9d57866b95 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:00.577115 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6e723367-ca16-4739-938e-2d9d57866b95 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] [instance: 0dfb045a-8cea-41b6-bbdc-8fa6600046d1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:00.589471 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6e723367-ca16-4739-938e-2d9d57866b95 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:00.592903 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6e723367-ca16-4739-938e-2d9d57866b95 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:00.593576 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6e723367-ca16-4739-938e-2d9d57866b95 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:00.595583 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6e723367-ca16-4739-938e-2d9d57866b95 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:00.597321 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6e723367-ca16-4739-938e-2d9d57866b95 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:00.597973 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6e723367-ca16-4739-938e-2d9d57866b95 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:00.598660 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-696b3b49-d1e6-4f55-bfa4-79921eaf60f0 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] 10.222.0.60 "GET /compute/v2.1/servers/078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4" status: 200 len: 1805 microversion: 2.1 time: 0.756170 Oct 18 15:33:00.612839 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 963/2009] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:32:59 2022] GET /compute/v2.1/servers/078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4 => generated 1805 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:33:00.629997 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a7a9ba2d-3389-407e-8452-e4fa897caa7f tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:00.630660 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a7a9ba2d-3389-407e-8452-e4fa897caa7f tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] [instance: 078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:00.646165 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7a9ba2d-3389-407e-8452-e4fa897caa7f tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:00.648460 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7a9ba2d-3389-407e-8452-e4fa897caa7f tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:00.649912 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7a9ba2d-3389-407e-8452-e4fa897caa7f tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:00.654370 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7a9ba2d-3389-407e-8452-e4fa897caa7f tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:00.655458 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7a9ba2d-3389-407e-8452-e4fa897caa7f tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:00.659222 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7a9ba2d-3389-407e-8452-e4fa897caa7f tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:00.736605 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a7a9ba2d-3389-407e-8452-e4fa897caa7f tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] 10.222.0.60 "GET /compute/v2.1/servers/078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4/ips" status: 200 len: 219 microversion: 2.1 time: 0.111505 Oct 18 15:33:00.741250 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 964/2010] 10.222.0.60 () {58 vars in 1248 bytes} [Tue Oct 18 15:33:00 2022] GET /compute/v2.1/servers/078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4/ips => generated 219 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:33:00.752583 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f6dbfc0e-4812-493f-b4d9-ac81c6f9200b tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:00.753673 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f6dbfc0e-4812-493f-b4d9-ac81c6f9200b tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:00.768900 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f6dbfc0e-4812-493f-b4d9-ac81c6f9200b tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:00.769457 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f6dbfc0e-4812-493f-b4d9-ac81c6f9200b tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:00.769837 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f6dbfc0e-4812-493f-b4d9-ac81c6f9200b tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:00.770539 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f6dbfc0e-4812-493f-b4d9-ac81c6f9200b tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:00.771000 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f6dbfc0e-4812-493f-b4d9-ac81c6f9200b tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:00.776057 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f6dbfc0e-4812-493f-b4d9-ac81c6f9200b tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:00.859452 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f6dbfc0e-4812-493f-b4d9-ac81c6f9200b tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:00.863972 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f6dbfc0e-4812-493f-b4d9-ac81c6f9200b tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:00.865140 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f6dbfc0e-4812-493f-b4d9-ac81c6f9200b tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:00.865685 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-f6dbfc0e-4812-493f-b4d9-ac81c6f9200b tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lazy-loading 'fault' on Instance uuid a0a3feae-1805-4c09-881b-99dd257bd9c2 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:33:01.130434 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f6dbfc0e-4812-493f-b4d9-ac81c6f9200b tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:01.146589 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f6dbfc0e-4812-493f-b4d9-ac81c6f9200b tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2" status: 200 len: 1324 microversion: 2.1 time: 0.403949 Oct 18 15:33:01.161357 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 965/2011] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:33:00 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2 => generated 1324 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:33:01.168631 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bf3e8fe6-7ff1-45e9-b3be-0d1e2cbf333c tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:01.172787 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bf3e8fe6-7ff1-45e9-b3be-0d1e2cbf333c tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] [instance: 078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:01.190259 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf3e8fe6-7ff1-45e9-b3be-0d1e2cbf333c tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:01.191314 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf3e8fe6-7ff1-45e9-b3be-0d1e2cbf333c tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:01.191314 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf3e8fe6-7ff1-45e9-b3be-0d1e2cbf333c tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:01.192030 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf3e8fe6-7ff1-45e9-b3be-0d1e2cbf333c tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:01.192602 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf3e8fe6-7ff1-45e9-b3be-0d1e2cbf333c tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:01.193171 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf3e8fe6-7ff1-45e9-b3be-0d1e2cbf333c tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:01.246751 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bf3e8fe6-7ff1-45e9-b3be-0d1e2cbf333c tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] [instance: 078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:33:01.313542 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-6e723367-ca16-4739-938e-2d9d57866b95 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] Lazy-loading 'services' on Instance uuid 0dfb045a-8cea-41b6-bbdc-8fa6600046d1 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:33:01.350109 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6e723367-ca16-4739-938e-2d9d57866b95 tempest-LiveAutoBlockMigrationV225Test-1940813248 tempest-LiveAutoBlockMigrationV225Test-1940813248-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1" status: 200 len: 1968 microversion: 2.25 time: 0.781072 Oct 18 15:33:01.351249 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1047/2012] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:33:00 2022] GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1 => generated 1968 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:33:01.371802 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3d082f47-6936-4edb-a951-0974a1f410cf tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c41684280>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:01.472703 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bf3e8fe6-7ff1-45e9-b3be-0d1e2cbf333c tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] 10.222.0.60 "DELETE /compute/v2.1/servers/078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4" status: 204 len: 0 microversion: 2.1 time: 0.309500 Oct 18 15:33:01.474052 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 966/2013] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:33:01 2022] DELETE /compute/v2.1/servers/078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:33:01.484570 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-91688351-917b-448d-b790-3204538ade5c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:01.489173 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-91688351-917b-448d-b790-3204538ade5c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 0dfb045a-8cea-41b6-bbdc-8fa6600046d1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:01.489896 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3d082f47-6936-4edb-a951-0974a1f410cf tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/93adc85c-6524-4498-aef9-436e2b0ea7c9" status: 200 len: 1455 microversion: 2.1 time: 0.136969 Oct 18 15:33:01.491676 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1048/2014] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:33:01 2022] GET /compute/v2.1/images/93adc85c-6524-4498-aef9-436e2b0ea7c9 => generated 1455 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:33:01.505041 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91688351-917b-448d-b790-3204538ade5c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:01.505795 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91688351-917b-448d-b790-3204538ade5c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:01.506519 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91688351-917b-448d-b790-3204538ade5c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:01.507040 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-43390029-9464-49c3-9c3b-f25e562b331d tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:01.507448 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91688351-917b-448d-b790-3204538ade5c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:01.508052 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91688351-917b-448d-b790-3204538ade5c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:01.508451 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-43390029-9464-49c3-9c3b-f25e562b331d tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] [instance: 078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:01.509966 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91688351-917b-448d-b790-3204538ade5c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:01.520332 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=83 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:33:01.531259 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-43390029-9464-49c3-9c3b-f25e562b331d tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:01.532246 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-43390029-9464-49c3-9c3b-f25e562b331d tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:01.533090 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-43390029-9464-49c3-9c3b-f25e562b331d tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:01.534227 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-43390029-9464-49c3-9c3b-f25e562b331d tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:01.535298 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-43390029-9464-49c3-9c3b-f25e562b331d tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:01.536047 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-43390029-9464-49c3-9c3b-f25e562b331d tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:01.588146 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-91688351-917b-448d-b790-3204538ade5c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 0dfb045a-8cea-41b6-bbdc-8fa6600046d1] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:33:01.812965 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-91688351-917b-448d-b790-3204538ade5c tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "DELETE /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1" status: 204 len: 0 microversion: 2.25 time: 0.336133 Oct 18 15:33:01.813881 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 967/2015] 10.222.0.60 () {60 vars in 1280 bytes} [Tue Oct 18 15:33:01 2022] DELETE /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 15:33:01.823273 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0e42b05f-89a4-4c93-9b1b-a6d847d04169 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:01.824031 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0e42b05f-89a4-4c93-9b1b-a6d847d04169 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 0dfb045a-8cea-41b6-bbdc-8fa6600046d1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:01.842418 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e42b05f-89a4-4c93-9b1b-a6d847d04169 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:01.842914 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e42b05f-89a4-4c93-9b1b-a6d847d04169 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:01.843356 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e42b05f-89a4-4c93-9b1b-a6d847d04169 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:01.844070 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e42b05f-89a4-4c93-9b1b-a6d847d04169 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:01.844526 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e42b05f-89a4-4c93-9b1b-a6d847d04169 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:01.845039 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e42b05f-89a4-4c93-9b1b-a6d847d04169 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:02.288120 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-43390029-9464-49c3-9c3b-f25e562b331d tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db93066933684d41a77863c156deb4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17eee1a6b8d43589bf66e6e18059021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:02.308776 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-43390029-9464-49c3-9c3b-f25e562b331d tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] 10.222.0.60 "GET /compute/v2.1/servers/078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4" status: 200 len: 1811 microversion: 2.1 time: 0.815551 Oct 18 15:33:02.310974 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1049/2016] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:33:01 2022] GET /compute/v2.1/servers/078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4 => generated 1811 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:33:02.325599 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-aa9d9c16-203f-4d1e-9cac-2e524501c878 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:02.329433 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-aa9d9c16-203f-4d1e-9cac-2e524501c878 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: a0a3feae-1805-4c09-881b-99dd257bd9c2] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:02.353629 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0e42b05f-89a4-4c93-9b1b-a6d847d04169 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:02.355171 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aa9d9c16-203f-4d1e-9cac-2e524501c878 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:02.356250 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aa9d9c16-203f-4d1e-9cac-2e524501c878 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:02.364602 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0e42b05f-89a4-4c93-9b1b-a6d847d04169 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:02.365826 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aa9d9c16-203f-4d1e-9cac-2e524501c878 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:02.366661 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aa9d9c16-203f-4d1e-9cac-2e524501c878 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:02.370481 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aa9d9c16-203f-4d1e-9cac-2e524501c878 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:02.373095 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0e42b05f-89a4-4c93-9b1b-a6d847d04169 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:02.373395 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aa9d9c16-203f-4d1e-9cac-2e524501c878 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:02.374817 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0e42b05f-89a4-4c93-9b1b-a6d847d04169 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1" status: 200 len: 1482 microversion: 2.25 time: 0.555964 Oct 18 15:33:02.378304 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 968/2017] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:33:01 2022] GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1 => generated 1482 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:33:02.399420 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=100 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:33:02.405509 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-aa9d9c16-203f-4d1e-9cac-2e524501c878 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] HTTP exception thrown: Instance a0a3feae-1805-4c09-881b-99dd257bd9c2 could not be found. Oct 18 15:33:02.407819 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-aa9d9c16-203f-4d1e-9cac-2e524501c878 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Request method failure captured: Oct 18 15:33:02.407819 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2 HTTP/1.1 Oct 18 15:33:02.407819 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:33:02.407819 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:33:02.407819 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:33:02.407819 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:33:02.407819 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:33:02.407819 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:33:02.407819 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:33:02.407819 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:33:02.407819 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsUkGjMP8SjffvouuV50DvwlNdoUk3Q8vLUFcV0A2x652BNW6xWL9154nGgy7NsbEx0ieOHcq-kaOYynRivFB9-xv9EzXZcbjE75S3D-xLvfYzqMvco4WZxCQ5vHukzGevKOCqI92gfSfyxpF_yo0jschT8PzGwnqZSfEW-ovydAl8o Oct 18 15:33:02.407819 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:33:02.407819 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:33:02.407819 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:33:02.407819 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:33:02.407819 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:33:02.407819 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:33:02.407819 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: a6565f6ef56e4ed3b530d009055cd619 Oct 18 15:33:02.407819 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-LiveMigrationTest-1739198630 Oct 18 15:33:02.407819 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:33:02.407819 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:33:02.409704 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a6565f6ef56e4ed3b530d009055cd619"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a6565f6ef56e4ed3b530d009055cd619"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a6565f6ef56e4ed3b530d009055cd619"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a6565f6ef56e4ed3b530d009055cd619"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:33:02.409704 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-LiveMigrationTest-1739198630 Oct 18 15:33:02.409704 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: a6565f6ef56e4ed3b530d009055cd619 Oct 18 15:33:02.409704 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-LiveMigrationTest-1739198630 Oct 18 15:33:02.409704 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-LiveMigrationTest-1739198630-project Oct 18 15:33:02.409704 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:33:02.409704 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:33:02.409704 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: c747aec412924b52b99dbf75d0c77fa4 Oct 18 15:33:02.409704 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-LiveMigrationTest-1739198630-project Oct 18 15:33:02.409704 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:33:02.409704 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance a0a3feae-1805-4c09-881b-99dd257bd9c2 could not be found. Oct 18 15:33:02.409704 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'a0a3feae-1805-4c09-881b-99dd257bd9c2'} Oct 18 15:33:02.410745 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:33:02.410745 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:33:02.410745 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:33:02.410745 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:33:02.410745 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:33:02.410745 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:33:02.410745 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:33:02.410745 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:33:02.410745 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:33:02.410745 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:33:02.410745 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0a3feae-1805-4c09-881b-99dd257bd9c2 could not be found. Oct 18 15:33:02.410745 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:33:02.410745 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:33:02.410745 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:33:02.410745 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:33:02.410745 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:33:02.410745 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:33:02.410745 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:33:02.410745 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:33:02.410745 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:33:02.412526 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:33:02.412526 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:33:02.412526 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:33:02.412526 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:33:02.412526 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:33:02.412526 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:33:02.412526 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:33:02.412526 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0a3feae-1805-4c09-881b-99dd257bd9c2 could not be found. Oct 18 15:33:02.412526 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:33:02.412526 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:33:02.412526 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:33:02.412526 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:33:02.412526 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:33:02.412526 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:33:02.412526 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:33:02.412526 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:33:02.412526 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0a3feae-1805-4c09-881b-99dd257bd9c2 could not be found. Oct 18 15:33:02.412526 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:33:02.415651 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-aa9d9c16-203f-4d1e-9cac-2e524501c878 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Returning 404 to user: Instance a0a3feae-1805-4c09-881b-99dd257bd9c2 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:33:02.416680 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-aa9d9c16-203f-4d1e-9cac-2e524501c878 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2" status: 404 len: 111 microversion: 2.1 time: 0.104589 Oct 18 15:33:02.417421 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1050/2018] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:33:02 2022] GET /compute/v2.1/servers/a0a3feae-1805-4c09-881b-99dd257bd9c2 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:33:02.427590 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fd02b323-ab1d-476a-a521-050a2ca2045b tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '.version_select at 0x7f7c3cf5e8b0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:02.470115 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fd02b323-ab1d-476a-a521-050a2ca2045b tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1738563358" status: 202 len: 0 microversion: 2.1 time: 0.047607 Oct 18 15:33:02.471027 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 969/2019] 10.222.0.60 () {58 vars in 1221 bytes} [Tue Oct 18 15:33:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1738563358 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:33:02.509480 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-79674e98-a7c3-4e9f-92a3-946de58b19e5 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c416a8d30>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:02.598420 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-79674e98-a7c3-4e9f-92a3-946de58b19e5 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/93adc85c-6524-4498-aef9-436e2b0ea7c9" status: 200 len: 1455 microversion: 2.1 time: 0.094057 Oct 18 15:33:02.611487 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1051/2020] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:33:02 2022] GET /compute/v2.1/images/93adc85c-6524-4498-aef9-436e2b0ea7c9 => generated 1455 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:33:03.336086 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fea5e48d-274c-42a5-ad45-d5be450aaea0 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:03.336773 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fea5e48d-274c-42a5-ad45-d5be450aaea0 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] [instance: 078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:03.365448 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fea5e48d-274c-42a5-ad45-d5be450aaea0 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:03.369473 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fea5e48d-274c-42a5-ad45-d5be450aaea0 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:03.370153 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fea5e48d-274c-42a5-ad45-d5be450aaea0 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:03.370939 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fea5e48d-274c-42a5-ad45-d5be450aaea0 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:03.377180 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fea5e48d-274c-42a5-ad45-d5be450aaea0 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:03.378315 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fea5e48d-274c-42a5-ad45-d5be450aaea0 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:03.403101 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-17292e3b-5286-44f3-8430-e8088671c9ce tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:03.404301 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-17292e3b-5286-44f3-8430-e8088671c9ce tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 0dfb045a-8cea-41b6-bbdc-8fa6600046d1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:03.421195 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-17292e3b-5286-44f3-8430-e8088671c9ce tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:03.424382 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-17292e3b-5286-44f3-8430-e8088671c9ce tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:03.431975 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-17292e3b-5286-44f3-8430-e8088671c9ce tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:03.436844 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-17292e3b-5286-44f3-8430-e8088671c9ce tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:03.442746 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-17292e3b-5286-44f3-8430-e8088671c9ce tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:03.446857 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-17292e3b-5286-44f3-8430-e8088671c9ce tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:04.323013 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fea5e48d-274c-42a5-ad45-d5be450aaea0 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db93066933684d41a77863c156deb4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17eee1a6b8d43589bf66e6e18059021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:04.331647 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fea5e48d-274c-42a5-ad45-d5be450aaea0 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] 10.222.0.60 "GET /compute/v2.1/servers/078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4" status: 200 len: 1811 microversion: 2.1 time: 1.000394 Oct 18 15:33:04.349315 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 970/2021] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:33:03 2022] GET /compute/v2.1/servers/078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4 => generated 1811 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:33:04.367288 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-213ce756-7063-40e2-88c2-e72e08e6bf3b tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c3cef0f70>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:04.425137 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-17292e3b-5286-44f3-8430-e8088671c9ce tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:04.438750 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-17292e3b-5286-44f3-8430-e8088671c9ce tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:04.440385 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-17292e3b-5286-44f3-8430-e8088671c9ce tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:04.442196 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-213ce756-7063-40e2-88c2-e72e08e6bf3b tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/93adc85c-6524-4498-aef9-436e2b0ea7c9" status: 200 len: 1455 microversion: 2.1 time: 0.091018 Oct 18 15:33:04.442767 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 971/2022] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:33:04 2022] GET /compute/v2.1/images/93adc85c-6524-4498-aef9-436e2b0ea7c9 => generated 1455 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:33:04.453905 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-17292e3b-5286-44f3-8430-e8088671c9ce tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1" status: 200 len: 1482 microversion: 2.25 time: 1.048818 Oct 18 15:33:04.456666 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1052/2023] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:33:03 2022] GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1 => generated 1482 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:33:04.885843 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-f6ff53e3-4017-450e-8e54-359bd8f8d171 req-c093c98d-912c-487d-beef-c24a1ed1243b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4", "name": "network-vif-deleted", "tag": "38a3909b-6479-4afc-a2c5-41eea4aba3ee"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:33:04.904109 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f6ff53e3-4017-450e-8e54-359bd8f8d171 req-c093c98d-912c-487d-beef-c24a1ed1243b service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:04.904600 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f6ff53e3-4017-450e-8e54-359bd8f8d171 req-c093c98d-912c-487d-beef-c24a1ed1243b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:04.905062 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f6ff53e3-4017-450e-8e54-359bd8f8d171 req-c093c98d-912c-487d-beef-c24a1ed1243b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:04.972554 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-f6ff53e3-4017-450e-8e54-359bd8f8d171 req-c093c98d-912c-487d-beef-c24a1ed1243b service nova] Creating event network-vif-deleted:38a3909b-6479-4afc-a2c5-41eea4aba3ee for instance 078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4 on n-h2-853682-5 Oct 18 15:33:04.993259 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-f6ff53e3-4017-450e-8e54-359bd8f8d171 req-c093c98d-912c-487d-beef-c24a1ed1243b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123196 Oct 18 15:33:04.994753 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 972/2024] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:33:05.080840 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1af9b00c-2d85-43fb-bccf-d1921f4b62f6 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1170178781", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "7e9974f0-8a43-4e4e-a408-a829638d44f4"}], "security_groups": [{"name": "tempest-securitygroup--1318446807"}], "key_name": "tempest-keypair-2031885278", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "7a07d3b3-141a-44bb-a6eb-9088a95d534a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:33:05.182338 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1da44f70-00af-4551-8b36-de9f1bfa400a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:05.183907 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1da44f70-00af-4551-8b36-de9f1bfa400a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: 29ceb840-1b81-4434-841f-a473cded4b73] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:05.194468 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1da44f70-00af-4551-8b36-de9f1bfa400a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:05.197137 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1da44f70-00af-4551-8b36-de9f1bfa400a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:05.198171 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1da44f70-00af-4551-8b36-de9f1bfa400a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:05.200382 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1da44f70-00af-4551-8b36-de9f1bfa400a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:05.201192 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1da44f70-00af-4551-8b36-de9f1bfa400a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:05.203016 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1da44f70-00af-4551-8b36-de9f1bfa400a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:05.265238 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1da44f70-00af-4551-8b36-de9f1bfa400a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: 29ceb840-1b81-4434-841f-a473cded4b73] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:33:05.435839 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1da44f70-00af-4551-8b36-de9f1bfa400a tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "DELETE /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73" status: 204 len: 0 microversion: 2.1 time: 0.258856 Oct 18 15:33:05.437741 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 973/2025] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:33:05 2022] DELETE /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:33:05.443631 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-25b62ff6-c542-4169-9e25-1080569e5192 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:05.445065 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-25b62ff6-c542-4169-9e25-1080569e5192 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] [instance: 078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:05.460356 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25b62ff6-c542-4169-9e25-1080569e5192 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:05.462772 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25b62ff6-c542-4169-9e25-1080569e5192 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:05.463446 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25b62ff6-c542-4169-9e25-1080569e5192 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:05.465525 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25b62ff6-c542-4169-9e25-1080569e5192 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:05.466643 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25b62ff6-c542-4169-9e25-1080569e5192 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:05.469421 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25b62ff6-c542-4169-9e25-1080569e5192 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:05.489544 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-1af9b00c-2d85-43fb-bccf-d1921f4b62f6 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] validate_networks() for [('7e9974f0-8a43-4e4e-a408-a829638d44f4', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:33:06.328618 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-25b62ff6-c542-4169-9e25-1080569e5192 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db93066933684d41a77863c156deb4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17eee1a6b8d43589bf66e6e18059021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:06.367788 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-25b62ff6-c542-4169-9e25-1080569e5192 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] 10.222.0.60 "GET /compute/v2.1/servers/078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4" status: 200 len: 1675 microversion: 2.1 time: 0.928597 Oct 18 15:33:06.374400 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 974/2026] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:33:05 2022] GET /compute/v2.1/servers/078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4 => generated 1675 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:33:06.403270 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4f0a125e-7f98-444e-a303-8e0758b38467 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:06.405230 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4f0a125e-7f98-444e-a303-8e0758b38467 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: 29ceb840-1b81-4434-841f-a473cded4b73] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:06.429125 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f0a125e-7f98-444e-a303-8e0758b38467 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:06.435144 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f0a125e-7f98-444e-a303-8e0758b38467 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:06.435972 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f0a125e-7f98-444e-a303-8e0758b38467 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:06.437411 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f0a125e-7f98-444e-a303-8e0758b38467 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:06.439523 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f0a125e-7f98-444e-a303-8e0758b38467 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:06.440179 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f0a125e-7f98-444e-a303-8e0758b38467 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:06.450572 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:33:07.591115 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4f0a125e-7f98-444e-a303-8e0758b38467 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:07.637610 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4f0a125e-7f98-444e-a303-8e0758b38467 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73" status: 200 len: 1483 microversion: 2.1 time: 1.253340 Oct 18 15:33:07.639117 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 975/2027] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:33:06 2022] GET /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73 => generated 1483 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:33:07.644905 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ae491318-95fe-4bcd-a349-ac6af1b06c88 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c3ce188b0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:08.058095 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-1af9b00c-2d85-43fb-bccf-d1921f4b62f6 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Getting quotas for project 75878827878e4ad796216561bf73b8c2. Resources: dict_keys(['metadata_items']) {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:33:08.075723 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-1af9b00c-2d85-43fb-bccf-d1921f4b62f6 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Getting quotas for user 28a044b3132948fabf926cdd494c2c16 and project 75878827878e4ad796216561bf73b8c2. Resources: dict_keys(['metadata_items']) {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:33:08.145353 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-1af9b00c-2d85-43fb-bccf-d1921f4b62f6 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:33:08.148450 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-1af9b00c-2d85-43fb-bccf-d1921f4b62f6 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:33:08.149564 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-1af9b00c-2d85-43fb-bccf-d1921f4b62f6 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:33:08.152079 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-1af9b00c-2d85-43fb-bccf-d1921f4b62f6 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:33:08.153131 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-1af9b00c-2d85-43fb-bccf-d1921f4b62f6 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:33:08.179305 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1af9b00c-2d85-43fb-bccf-d1921f4b62f6 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:08.180831 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1af9b00c-2d85-43fb-bccf-d1921f4b62f6 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:08.181982 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1af9b00c-2d85-43fb-bccf-d1921f4b62f6 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:08.183092 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1af9b00c-2d85-43fb-bccf-d1921f4b62f6 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:08.186325 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1af9b00c-2d85-43fb-bccf-d1921f4b62f6 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:08.188528 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1af9b00c-2d85-43fb-bccf-d1921f4b62f6 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:08.248705 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-1af9b00c-2d85-43fb-bccf-d1921f4b62f6 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Getting quotas for project 75878827878e4ad796216561bf73b8c2. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:33:08.260423 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-1af9b00c-2d85-43fb-bccf-d1921f4b62f6 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Getting quotas for user 28a044b3132948fabf926cdd494c2c16 and project 75878827878e4ad796216561bf73b8c2. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:33:08.493210 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1af9b00c-2d85-43fb-bccf-d1921f4b62f6 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:33:08.499502 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1af9b00c-2d85-43fb-bccf-d1921f4b62f6 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] [instance: b649575f-a244-45c4-891b-c1fc2f9b4b95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7a07d3b3-141a-44bb-a6eb-9088a95d534a',volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:33:08.863022 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1af9b00c-2d85-43fb-bccf-d1921f4b62f6 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 3.786348 Oct 18 15:33:08.868265 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1053/2028] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:33:05 2022] POST /compute/v2.1/servers => generated 407 bytes in 3793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:33:08.882260 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-5b23c488-069f-4530-bce9-070f380f83f5 req-75f02a5a-d489-44df-b74c-cff55606cb73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dfb045a-8cea-41b6-bbdc-8fa6600046d1", "name": "network-vif-deleted", "tag": "8b71a6b8-e604-4cd4-9224-71a40ab44fd3"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:33:08.919426 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-5b23c488-069f-4530-bce9-070f380f83f5 req-75f02a5a-d489-44df-b74c-cff55606cb73 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:08.922769 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-5b23c488-069f-4530-bce9-070f380f83f5 req-75f02a5a-d489-44df-b74c-cff55606cb73 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:08.923554 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-5b23c488-069f-4530-bce9-070f380f83f5 req-75f02a5a-d489-44df-b74c-cff55606cb73 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:08.952525 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-5b23c488-069f-4530-bce9-070f380f83f5 req-75f02a5a-d489-44df-b74c-cff55606cb73 service nova] Creating event network-vif-deleted:8b71a6b8-e604-4cd4-9224-71a40ab44fd3 for instance 0dfb045a-8cea-41b6-bbdc-8fa6600046d1 on n-h1-853682-5 Oct 18 15:33:08.962259 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-5b23c488-069f-4530-bce9-070f380f83f5 req-75f02a5a-d489-44df-b74c-cff55606cb73 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091848 Oct 18 15:33:08.965229 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1054/2029] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:33:08.977786 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ebb3ac8b-d786-4930-9a64-351c3361e47f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:08.979450 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ebb3ac8b-d786-4930-9a64-351c3361e47f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 0dfb045a-8cea-41b6-bbdc-8fa6600046d1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:08.994852 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ebb3ac8b-d786-4930-9a64-351c3361e47f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:08.997069 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ebb3ac8b-d786-4930-9a64-351c3361e47f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:08.999068 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ebb3ac8b-d786-4930-9a64-351c3361e47f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:09.000148 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ebb3ac8b-d786-4930-9a64-351c3361e47f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:09.002035 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ebb3ac8b-d786-4930-9a64-351c3361e47f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:09.005085 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ebb3ac8b-d786-4930-9a64-351c3361e47f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:09.138141 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ebb3ac8b-d786-4930-9a64-351c3361e47f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:09.153273 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ebb3ac8b-d786-4930-9a64-351c3361e47f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:09.159552 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ebb3ac8b-d786-4930-9a64-351c3361e47f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:09.168693 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ebb3ac8b-d786-4930-9a64-351c3361e47f tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1" status: 200 len: 1265 microversion: 2.25 time: 0.199423 Oct 18 15:33:09.184835 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1055/2030] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:33:08 2022] GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1 => generated 1265 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:33:09.189614 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-57a7b727-1c2d-4723-8c3f-aabcde7ebee0 req-da97c64b-9f20-4ec2-bc78-7f67cef7411b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d0c7fc6-9245-41f3-9257-d2b8955a6d4d", "name": "network-vif-plugged", "status": "completed", "tag": "ccf2639c-dfaf-46eb-a27f-c279d0c6c5c1"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:33:09.225463 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-57a7b727-1c2d-4723-8c3f-aabcde7ebee0 req-da97c64b-9f20-4ec2-bc78-7f67cef7411b service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:09.226631 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-57a7b727-1c2d-4723-8c3f-aabcde7ebee0 req-da97c64b-9f20-4ec2-bc78-7f67cef7411b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:09.228192 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-57a7b727-1c2d-4723-8c3f-aabcde7ebee0 req-da97c64b-9f20-4ec2-bc78-7f67cef7411b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:09.281317 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-57a7b727-1c2d-4723-8c3f-aabcde7ebee0 req-da97c64b-9f20-4ec2-bc78-7f67cef7411b service nova] Creating event network-vif-plugged:ccf2639c-dfaf-46eb-a27f-c279d0c6c5c1 for instance 0d0c7fc6-9245-41f3-9257-d2b8955a6d4d on n-h1-853682-5 Oct 18 15:33:09.305264 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-57a7b727-1c2d-4723-8c3f-aabcde7ebee0 req-da97c64b-9f20-4ec2-bc78-7f67cef7411b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129287 Oct 18 15:33:09.315824 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1056/2031] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:33:09.340421 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-db7885ad-7886-4bb6-a50d-5f1c6806bf87 req-3bbf2260-5728-4acd-9564-b74c7f36127c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4", "name": "network-vif-deleted", "tag": "afe51523-a5a5-4406-9404-6e8e8b95aabb"}, {"server_uuid": "078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4", "name": "network-vif-deleted", "tag": "fa5913cd-9730-4003-abf6-95f3a02345c4"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:33:09.380981 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-db7885ad-7886-4bb6-a50d-5f1c6806bf87 req-3bbf2260-5728-4acd-9564-b74c7f36127c service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:09.384629 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-db7885ad-7886-4bb6-a50d-5f1c6806bf87 req-3bbf2260-5728-4acd-9564-b74c7f36127c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:09.385172 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-db7885ad-7886-4bb6-a50d-5f1c6806bf87 req-3bbf2260-5728-4acd-9564-b74c7f36127c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:09.431605 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-db7885ad-7886-4bb6-a50d-5f1c6806bf87 req-3bbf2260-5728-4acd-9564-b74c7f36127c service nova] Creating event network-vif-deleted:afe51523-a5a5-4406-9404-6e8e8b95aabb for instance 078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4 on n-h2-853682-5 Oct 18 15:33:09.431748 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-db7885ad-7886-4bb6-a50d-5f1c6806bf87 req-3bbf2260-5728-4acd-9564-b74c7f36127c service nova] Creating event network-vif-deleted:fa5913cd-9730-4003-abf6-95f3a02345c4 for instance 078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4 on n-h2-853682-5 Oct 18 15:33:09.443007 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-db7885ad-7886-4bb6-a50d-5f1c6806bf87 req-3bbf2260-5728-4acd-9564-b74c7f36127c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.125666 Oct 18 15:33:09.444552 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1057/2032] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:33:09.456730 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d92389df-1026-4555-abb9-92c9675e37dd tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:09.457455 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d92389df-1026-4555-abb9-92c9675e37dd tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] [instance: 078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:09.472366 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d92389df-1026-4555-abb9-92c9675e37dd tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:09.474692 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d92389df-1026-4555-abb9-92c9675e37dd tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:09.475537 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d92389df-1026-4555-abb9-92c9675e37dd tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:09.476387 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d92389df-1026-4555-abb9-92c9675e37dd tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:09.478704 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d92389df-1026-4555-abb9-92c9675e37dd tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:09.479548 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d92389df-1026-4555-abb9-92c9675e37dd tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:09.516149 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-d92389df-1026-4555-abb9-92c9675e37dd tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] HTTP exception thrown: Instance 078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4 could not be found. Oct 18 15:33:09.519734 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d92389df-1026-4555-abb9-92c9675e37dd tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Request method failure captured: Oct 18 15:33:09.519734 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4 HTTP/1.1 Oct 18 15:33:09.519734 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:33:09.519734 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:33:09.519734 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:33:09.519734 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:33:09.519734 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:33:09.519734 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:33:09.519734 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:33:09.519734 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:33:09.519734 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsb3pfiEaxcnXx3ihmPPXpG7_P6_BfY5Wpx3U9izDjyP4ZKeMoVOYRBLtHkU6k9zvjSPxHpG6JfjUfialgGEewoEmUlRTJv3ueLe74ey6f1lV4D6tvVIl7UCdBjDDPb_LMWkb6yllIK_yimws2bdf7musbVieeZIh26V-IrSnDd0SaM Oct 18 15:33:09.519734 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:33:09.519734 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:33:09.519734 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:33:09.519734 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:33:09.519734 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:33:09.519734 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:33:09.519734 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: b17eee1a6b8d43589bf66e6e18059021 Oct 18 15:33:09.519734 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServersTestMultiNic-1438592096 Oct 18 15:33:09.519734 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:33:09.519734 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:33:09.521526 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b17eee1a6b8d43589bf66e6e18059021"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b17eee1a6b8d43589bf66e6e18059021"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b17eee1a6b8d43589bf66e6e18059021"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b17eee1a6b8d43589bf66e6e18059021"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:33:09.521526 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServersTestMultiNic-1438592096 Oct 18 15:33:09.521526 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: b17eee1a6b8d43589bf66e6e18059021 Oct 18 15:33:09.521526 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServersTestMultiNic-1438592096 Oct 18 15:33:09.521526 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServersTestMultiNic-1438592096-project Oct 18 15:33:09.521526 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:33:09.521526 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:33:09.521526 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: db93066933684d41a77863c156deb4da Oct 18 15:33:09.521526 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServersTestMultiNic-1438592096-project Oct 18 15:33:09.521526 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:33:09.521526 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4 could not be found. Oct 18 15:33:09.521526 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4'} Oct 18 15:33:09.522557 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:33:09.522557 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:33:09.522557 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:33:09.522557 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:33:09.522557 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:33:09.522557 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:33:09.522557 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:33:09.522557 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:33:09.522557 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:33:09.522557 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:33:09.522557 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4 could not be found. Oct 18 15:33:09.522557 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:33:09.522557 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:33:09.522557 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:33:09.522557 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:33:09.522557 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:33:09.522557 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:33:09.522557 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:33:09.522557 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:33:09.522557 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:33:09.524202 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:33:09.524202 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:33:09.524202 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:33:09.524202 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:33:09.524202 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:33:09.524202 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:33:09.524202 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:33:09.524202 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4 could not be found. Oct 18 15:33:09.524202 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:33:09.524202 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:33:09.524202 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:33:09.524202 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:33:09.524202 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:33:09.524202 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:33:09.524202 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:33:09.524202 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:33:09.524202 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4 could not be found. Oct 18 15:33:09.524202 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:33:09.525765 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d92389df-1026-4555-abb9-92c9675e37dd tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Returning 404 to user: Instance 078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:33:09.525765 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d92389df-1026-4555-abb9-92c9675e37dd tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] 10.222.0.60 "GET /compute/v2.1/servers/078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4" status: 404 len: 111 microversion: 2.1 time: 0.077198 Oct 18 15:33:09.538975 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1058/2033] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:33:09 2022] GET /compute/v2.1/servers/078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:33:09.553311 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-12ea59ec-7d52-4bf9-968f-153b88cd6846 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:09.553942 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-12ea59ec-7d52-4bf9-968f-153b88cd6846 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: 29ceb840-1b81-4434-841f-a473cded4b73] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:09.579128 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12ea59ec-7d52-4bf9-968f-153b88cd6846 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:09.583471 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12ea59ec-7d52-4bf9-968f-153b88cd6846 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:09.584027 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12ea59ec-7d52-4bf9-968f-153b88cd6846 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:09.584796 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12ea59ec-7d52-4bf9-968f-153b88cd6846 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:09.585295 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12ea59ec-7d52-4bf9-968f-153b88cd6846 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:09.592632 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12ea59ec-7d52-4bf9-968f-153b88cd6846 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:09.716360 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12ea59ec-7d52-4bf9-968f-153b88cd6846 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:09.717030 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12ea59ec-7d52-4bf9-968f-153b88cd6846 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:09.722829 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12ea59ec-7d52-4bf9-968f-153b88cd6846 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:09.724365 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-12ea59ec-7d52-4bf9-968f-153b88cd6846 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lazy-loading 'fault' on Instance uuid 29ceb840-1b81-4434-841f-a473cded4b73 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:33:09.898694 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-12ea59ec-7d52-4bf9-968f-153b88cd6846 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:09.907754 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-12ea59ec-7d52-4bf9-968f-153b88cd6846 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73" status: 200 len: 1299 microversion: 2.1 time: 0.367483 Oct 18 15:33:09.908541 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1059/2034] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:33:09 2022] GET /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73 => generated 1299 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:33:09.929491 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9734a576-83b0-4174-93ea-6b9960196b17 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:09.932721 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9734a576-83b0-4174-93ea-6b9960196b17 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] [instance: b649575f-a244-45c4-891b-c1fc2f9b4b95] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:10.252591 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9734a576-83b0-4174-93ea-6b9960196b17 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a044b3132948fabf926cdd494c2c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75878827878e4ad796216561bf73b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:10.264525 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9734a576-83b0-4174-93ea-6b9960196b17 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] 10.222.0.60 "GET /compute/v2.1/servers/b649575f-a244-45c4-891b-c1fc2f9b4b95" status: 200 len: 1122 microversion: 2.1 time: 0.355049 Oct 18 15:33:10.266629 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1060/2035] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:33:09 2022] GET /compute/v2.1/servers/b649575f-a244-45c4-891b-c1fc2f9b4b95 => generated 1122 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:33:10.906520 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c8f97937-d517-4e9f-9b53-6de8e6335dc1 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:10.907289 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c8f97937-d517-4e9f-9b53-6de8e6335dc1 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:10.936460 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c8f97937-d517-4e9f-9b53-6de8e6335dc1 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:10.938536 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c8f97937-d517-4e9f-9b53-6de8e6335dc1 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:10.939039 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c8f97937-d517-4e9f-9b53-6de8e6335dc1 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:10.944537 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c8f97937-d517-4e9f-9b53-6de8e6335dc1 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:10.947717 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c8f97937-d517-4e9f-9b53-6de8e6335dc1 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:10.948213 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c8f97937-d517-4e9f-9b53-6de8e6335dc1 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:11.083955 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c8f97937-d517-4e9f-9b53-6de8e6335dc1 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:33:11.338535 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c8f97937-d517-4e9f-9b53-6de8e6335dc1 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "DELETE /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 204 len: 0 microversion: 2.42 time: 1.055027 Oct 18 15:33:11.344172 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1061/2036] 10.222.0.60 () {60 vars in 1280 bytes} [Tue Oct 18 15:33:10 2022] DELETE /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 0 bytes in 1073 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 15:33:11.364824 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-72725b96-c3a1-4316-85ef-3bfe239a0525 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:11.366719 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-72725b96-c3a1-4316-85ef-3bfe239a0525 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 0dfb045a-8cea-41b6-bbdc-8fa6600046d1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:11.384557 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-72725b96-c3a1-4316-85ef-3bfe239a0525 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:11.385088 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-72725b96-c3a1-4316-85ef-3bfe239a0525 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:11.391756 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-72725b96-c3a1-4316-85ef-3bfe239a0525 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:11.392529 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-72725b96-c3a1-4316-85ef-3bfe239a0525 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:11.393036 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-72725b96-c3a1-4316-85ef-3bfe239a0525 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:11.393493 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-72725b96-c3a1-4316-85ef-3bfe239a0525 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:11.533838 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-72725b96-c3a1-4316-85ef-3bfe239a0525 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:11.554978 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-72725b96-c3a1-4316-85ef-3bfe239a0525 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:11.557361 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-72725b96-c3a1-4316-85ef-3bfe239a0525 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:11.558599 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-72725b96-c3a1-4316-85ef-3bfe239a0525 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1" status: 200 len: 1265 microversion: 2.25 time: 0.213750 Oct 18 15:33:11.570126 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1062/2037] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:33:11 2022] GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1 => generated 1265 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:33:11.592525 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-71ecc79c-85f9-4cb1-9d21-7cbbbe5843ef tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:11.592896 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-71ecc79c-85f9-4cb1-9d21-7cbbbe5843ef tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: 29ceb840-1b81-4434-841f-a473cded4b73] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:11.609153 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-71ecc79c-85f9-4cb1-9d21-7cbbbe5843ef tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:11.609679 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-71ecc79c-85f9-4cb1-9d21-7cbbbe5843ef tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:11.610135 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-71ecc79c-85f9-4cb1-9d21-7cbbbe5843ef tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:11.610876 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-71ecc79c-85f9-4cb1-9d21-7cbbbe5843ef tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:11.613865 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-71ecc79c-85f9-4cb1-9d21-7cbbbe5843ef tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:11.614324 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-71ecc79c-85f9-4cb1-9d21-7cbbbe5843ef tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:11.646501 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-71ecc79c-85f9-4cb1-9d21-7cbbbe5843ef tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] HTTP exception thrown: Instance 29ceb840-1b81-4434-841f-a473cded4b73 could not be found. Oct 18 15:33:11.653606 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-71ecc79c-85f9-4cb1-9d21-7cbbbe5843ef tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Request method failure captured: Oct 18 15:33:11.653606 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73 HTTP/1.1 Oct 18 15:33:11.653606 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:33:11.653606 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:33:11.653606 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:33:11.653606 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:33:11.653606 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:33:11.653606 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:33:11.653606 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:33:11.653606 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:33:11.653606 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsUkGjMP8SjffvouuV50DvwlNdoUk3Q8vLUFcV0A2x652BNW6xWL9154nGgy7NsbEx0ieOHcq-kaOYynRivFB9-xv9EzXZcbjE75S3D-xLvfYzqMvco4WZxCQ5vHukzGevKOCqI92gfSfyxpF_yo0jschT8PzGwnqZSfEW-ovydAl8o Oct 18 15:33:11.653606 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:33:11.653606 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:33:11.653606 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:33:11.653606 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:33:11.653606 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:33:11.653606 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:33:11.653606 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: a6565f6ef56e4ed3b530d009055cd619 Oct 18 15:33:11.653606 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-LiveMigrationTest-1739198630 Oct 18 15:33:11.653606 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:33:11.653606 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:33:11.655503 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a6565f6ef56e4ed3b530d009055cd619"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a6565f6ef56e4ed3b530d009055cd619"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a6565f6ef56e4ed3b530d009055cd619"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a6565f6ef56e4ed3b530d009055cd619"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:33:11.655503 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-LiveMigrationTest-1739198630 Oct 18 15:33:11.655503 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: a6565f6ef56e4ed3b530d009055cd619 Oct 18 15:33:11.655503 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-LiveMigrationTest-1739198630 Oct 18 15:33:11.655503 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-LiveMigrationTest-1739198630-project Oct 18 15:33:11.655503 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:33:11.655503 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:33:11.655503 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: c747aec412924b52b99dbf75d0c77fa4 Oct 18 15:33:11.655503 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-LiveMigrationTest-1739198630-project Oct 18 15:33:11.655503 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:33:11.655503 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 29ceb840-1b81-4434-841f-a473cded4b73 could not be found. Oct 18 15:33:11.655503 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '29ceb840-1b81-4434-841f-a473cded4b73'} Oct 18 15:33:11.656526 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:33:11.656526 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:33:11.656526 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:33:11.656526 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:33:11.656526 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:33:11.656526 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:33:11.656526 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:33:11.656526 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:33:11.656526 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:33:11.656526 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:33:11.656526 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29ceb840-1b81-4434-841f-a473cded4b73 could not be found. Oct 18 15:33:11.656526 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:33:11.656526 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:33:11.656526 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:33:11.656526 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:33:11.656526 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:33:11.656526 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:33:11.656526 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:33:11.656526 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:33:11.656526 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:33:11.658267 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:33:11.658267 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:33:11.658267 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:33:11.658267 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:33:11.658267 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:33:11.658267 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:33:11.658267 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:33:11.658267 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29ceb840-1b81-4434-841f-a473cded4b73 could not be found. Oct 18 15:33:11.658267 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:33:11.658267 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:33:11.658267 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:33:11.658267 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:33:11.658267 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:33:11.658267 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:33:11.658267 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:33:11.658267 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:33:11.658267 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29ceb840-1b81-4434-841f-a473cded4b73 could not be found. Oct 18 15:33:11.658267 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:33:11.659703 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-71ecc79c-85f9-4cb1-9d21-7cbbbe5843ef tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Returning 404 to user: Instance 29ceb840-1b81-4434-841f-a473cded4b73 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:33:11.659703 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-71ecc79c-85f9-4cb1-9d21-7cbbbe5843ef tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73" status: 404 len: 111 microversion: 2.1 time: 0.083971 Oct 18 15:33:11.659703 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1063/2038] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:33:11 2022] GET /compute/v2.1/servers/29ceb840-1b81-4434-841f-a473cded4b73 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:33:11.667525 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-439841e2-7d49-4493-8f87-28b12a06912a req-97eda8a7-d0ba-401a-8250-dce4a50b05a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29ceb840-1b81-4434-841f-a473cded4b73", "name": "network-vif-deleted", "tag": "1b04f10d-4830-4b9e-b179-bd983eaea7e2"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:33:11.723714 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-439841e2-7d49-4493-8f87-28b12a06912a req-97eda8a7-d0ba-401a-8250-dce4a50b05a5 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:11.725267 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-439841e2-7d49-4493-8f87-28b12a06912a req-97eda8a7-d0ba-401a-8250-dce4a50b05a5 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:11.734331 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-439841e2-7d49-4493-8f87-28b12a06912a req-97eda8a7-d0ba-401a-8250-dce4a50b05a5 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:11.770793 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-439841e2-7d49-4493-8f87-28b12a06912a req-97eda8a7-d0ba-401a-8250-dce4a50b05a5 service nova] Creating event network-vif-deleted:1b04f10d-4830-4b9e-b179-bd983eaea7e2 for instance 29ceb840-1b81-4434-841f-a473cded4b73 on n-h2-853682-5 Oct 18 15:33:11.792653 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-439841e2-7d49-4493-8f87-28b12a06912a req-97eda8a7-d0ba-401a-8250-dce4a50b05a5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132571 Oct 18 15:33:11.793625 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1064/2039] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:33:11.801138 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-36d329be-4c38-495b-bef4-01a8f9cf9208 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:11.801845 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-36d329be-4c38-495b-bef4-01a8f9cf9208 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] [instance: b649575f-a244-45c4-891b-c1fc2f9b4b95] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:11.833329 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-36d329be-4c38-495b-bef4-01a8f9cf9208 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:11.833827 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-36d329be-4c38-495b-bef4-01a8f9cf9208 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:11.834267 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-36d329be-4c38-495b-bef4-01a8f9cf9208 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:11.834989 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-36d329be-4c38-495b-bef4-01a8f9cf9208 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:11.835449 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-36d329be-4c38-495b-bef4-01a8f9cf9208 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:11.835887 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-36d329be-4c38-495b-bef4-01a8f9cf9208 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:12.057928 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-36d329be-4c38-495b-bef4-01a8f9cf9208 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a044b3132948fabf926cdd494c2c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75878827878e4ad796216561bf73b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:12.068453 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-36d329be-4c38-495b-bef4-01a8f9cf9208 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] 10.222.0.60 "GET /compute/v2.1/servers/b649575f-a244-45c4-891b-c1fc2f9b4b95" status: 200 len: 1228 microversion: 2.1 time: 0.273585 Oct 18 15:33:12.069078 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1065/2040] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:33:11 2022] GET /compute/v2.1/servers/b649575f-a244-45c4-891b-c1fc2f9b4b95 => generated 1228 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:33:12.086962 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e29a8187-6c21-41de-bd15-3544483fe8eb tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:12.087592 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e29a8187-6c21-41de-bd15-3544483fe8eb tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:12.113531 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e29a8187-6c21-41de-bd15-3544483fe8eb tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:12.114035 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e29a8187-6c21-41de-bd15-3544483fe8eb tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:12.123239 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e29a8187-6c21-41de-bd15-3544483fe8eb tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:12.124040 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e29a8187-6c21-41de-bd15-3544483fe8eb tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:12.125902 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e29a8187-6c21-41de-bd15-3544483fe8eb tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:12.126367 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e29a8187-6c21-41de-bd15-3544483fe8eb tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:12.995781 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e29a8187-6c21-41de-bd15-3544483fe8eb tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:13.012595 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e29a8187-6c21-41de-bd15-3544483fe8eb tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:13.031326 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e29a8187-6c21-41de-bd15-3544483fe8eb tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:13.042513 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e29a8187-6c21-41de-bd15-3544483fe8eb tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 2961 microversion: 2.42 time: 0.972333 Oct 18 15:33:13.049672 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1066/2041] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:33:12 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 2961 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:33:13.072260 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-55cca709-09ed-478a-bd22-268a83cc1d71 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:13.075707 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-55cca709-09ed-478a-bd22-268a83cc1d71 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: 2dea609b-60cd-4634-b6d6-f5e3e085c1a3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:13.106605 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-55cca709-09ed-478a-bd22-268a83cc1d71 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:13.107273 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-55cca709-09ed-478a-bd22-268a83cc1d71 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:13.109368 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-55cca709-09ed-478a-bd22-268a83cc1d71 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:13.113387 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-55cca709-09ed-478a-bd22-268a83cc1d71 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:13.127856 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-55cca709-09ed-478a-bd22-268a83cc1d71 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:13.128369 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-55cca709-09ed-478a-bd22-268a83cc1d71 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:13.248759 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-55cca709-09ed-478a-bd22-268a83cc1d71 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: 2dea609b-60cd-4634-b6d6-f5e3e085c1a3] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:33:13.524522 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-55cca709-09ed-478a-bd22-268a83cc1d71 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "DELETE /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3" status: 204 len: 0 microversion: 2.1 time: 0.470760 Oct 18 15:33:13.531865 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1067/2042] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:33:13 2022] DELETE /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:33:13.540896 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-083c6b80-4b58-4537-afd9-ae25da6f5775 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:13.545669 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-083c6b80-4b58-4537-afd9-ae25da6f5775 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 0dfb045a-8cea-41b6-bbdc-8fa6600046d1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:13.562741 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-083c6b80-4b58-4537-afd9-ae25da6f5775 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:13.563468 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-083c6b80-4b58-4537-afd9-ae25da6f5775 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:13.563950 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-083c6b80-4b58-4537-afd9-ae25da6f5775 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:13.564673 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-083c6b80-4b58-4537-afd9-ae25da6f5775 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:13.569792 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-083c6b80-4b58-4537-afd9-ae25da6f5775 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:13.570548 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-083c6b80-4b58-4537-afd9-ae25da6f5775 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:15.550434 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-083c6b80-4b58-4537-afd9-ae25da6f5775 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:15.563809 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-083c6b80-4b58-4537-afd9-ae25da6f5775 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:15.569894 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-083c6b80-4b58-4537-afd9-ae25da6f5775 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:15.571300 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-083c6b80-4b58-4537-afd9-ae25da6f5775 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1" status: 200 len: 1265 microversion: 2.25 time: 2.037999 Oct 18 15:33:15.610890 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1068/2043] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:33:13 2022] GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1 => generated 1265 bytes in 2077 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:33:15.631900 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-759a68fa-1745-4548-82e7-9f4ce55a6fa1 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:15.636226 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-759a68fa-1745-4548-82e7-9f4ce55a6fa1 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] [instance: b649575f-a244-45c4-891b-c1fc2f9b4b95] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:15.648715 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-759a68fa-1745-4548-82e7-9f4ce55a6fa1 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:15.651240 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-759a68fa-1745-4548-82e7-9f4ce55a6fa1 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:15.651917 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-759a68fa-1745-4548-82e7-9f4ce55a6fa1 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:15.653722 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-759a68fa-1745-4548-82e7-9f4ce55a6fa1 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:15.655267 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-759a68fa-1745-4548-82e7-9f4ce55a6fa1 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:15.657165 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-759a68fa-1745-4548-82e7-9f4ce55a6fa1 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:16.419457 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=4,nova_api:DELETE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:33:16.471022 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-759a68fa-1745-4548-82e7-9f4ce55a6fa1 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a044b3132948fabf926cdd494c2c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75878827878e4ad796216561bf73b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:16.482277 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-759a68fa-1745-4548-82e7-9f4ce55a6fa1 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] 10.222.0.60 "GET /compute/v2.1/servers/b649575f-a244-45c4-891b-c1fc2f9b4b95" status: 200 len: 1306 microversion: 2.1 time: 0.866913 Oct 18 15:33:16.484781 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1069/2044] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:33:15 2022] GET /compute/v2.1/servers/b649575f-a244-45c4-891b-c1fc2f9b4b95 => generated 1306 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:33:16.501144 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-91e31311-af41-4260-933e-02ed30a8a0d4 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:16.502138 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-91e31311-af41-4260-933e-02ed30a8a0d4 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: 2dea609b-60cd-4634-b6d6-f5e3e085c1a3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:16.520021 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-91e31311-af41-4260-933e-02ed30a8a0d4 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:16.522501 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-91e31311-af41-4260-933e-02ed30a8a0d4 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:16.523306 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-91e31311-af41-4260-933e-02ed30a8a0d4 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:16.524224 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-91e31311-af41-4260-933e-02ed30a8a0d4 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:16.527907 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-91e31311-af41-4260-933e-02ed30a8a0d4 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:16.528646 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-91e31311-af41-4260-933e-02ed30a8a0d4 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:16.586610 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:33:17.080619 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-91e31311-af41-4260-933e-02ed30a8a0d4 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c747aec412924b52b99dbf75d0c77fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6565f6ef56e4ed3b530d009055cd619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:17.092574 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-91e31311-af41-4260-933e-02ed30a8a0d4 tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3" status: 200 len: 1457 microversion: 2.1 time: 0.605248 Oct 18 15:33:17.103804 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1070/2045] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:33:16 2022] GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3 => generated 1457 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:33:17.124470 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-051e4c2a-c418-49f5-a747-d647f3eba191 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:17.125539 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-051e4c2a-c418-49f5-a747-d647f3eba191 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:17.147970 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-051e4c2a-c418-49f5-a747-d647f3eba191 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:17.153767 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-051e4c2a-c418-49f5-a747-d647f3eba191 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:17.157930 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-051e4c2a-c418-49f5-a747-d647f3eba191 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:17.162260 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-051e4c2a-c418-49f5-a747-d647f3eba191 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:17.163306 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-051e4c2a-c418-49f5-a747-d647f3eba191 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:17.165119 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-051e4c2a-c418-49f5-a747-d647f3eba191 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:17.622680 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:33:18.220685 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:33:18.275657 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-051e4c2a-c418-49f5-a747-d647f3eba191 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:18.301787 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-051e4c2a-c418-49f5-a747-d647f3eba191 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:18.310661 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-051e4c2a-c418-49f5-a747-d647f3eba191 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:18.316798 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-051e4c2a-c418-49f5-a747-d647f3eba191 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 2961 microversion: 2.42 time: 1.210799 Oct 18 15:33:18.317441 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1071/2046] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:33:17 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 2961 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:33:18.350249 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0cb361b5-7610-4a79-b280-43766df9b952 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:18.352375 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0cb361b5-7610-4a79-b280-43766df9b952 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 0dfb045a-8cea-41b6-bbdc-8fa6600046d1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:18.375584 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0cb361b5-7610-4a79-b280-43766df9b952 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:18.378861 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0cb361b5-7610-4a79-b280-43766df9b952 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:18.379952 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0cb361b5-7610-4a79-b280-43766df9b952 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:18.381487 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0cb361b5-7610-4a79-b280-43766df9b952 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:18.381972 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0cb361b5-7610-4a79-b280-43766df9b952 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:18.382412 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0cb361b5-7610-4a79-b280-43766df9b952 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:18.629454 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0cb361b5-7610-4a79-b280-43766df9b952 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:18.650863 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0cb361b5-7610-4a79-b280-43766df9b952 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:18.660636 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0cb361b5-7610-4a79-b280-43766df9b952 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:18.666331 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0cb361b5-7610-4a79-b280-43766df9b952 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1" status: 200 len: 1265 microversion: 2.25 time: 0.335556 Oct 18 15:33:18.672850 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1072/2047] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:33:18 2022] GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1 => generated 1265 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:33:18.688547 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-8a1644ec-e50c-485b-9c46-d40012504021 req-0ab62289-5729-44e6-812c-e736709b3be7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23bdadc4-6faa-4e55-8daf-eef04dd34a8a", "name": "network-vif-unplugged", "status": "completed", "tag": "b1a9859a-97e3-466a-9b12-d8aaa13a8141"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:33:18.745739 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-8a1644ec-e50c-485b-9c46-d40012504021 req-0ab62289-5729-44e6-812c-e736709b3be7 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:18.749583 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-8a1644ec-e50c-485b-9c46-d40012504021 req-0ab62289-5729-44e6-812c-e736709b3be7 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:18.751492 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-8a1644ec-e50c-485b-9c46-d40012504021 req-0ab62289-5729-44e6-812c-e736709b3be7 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:18.812766 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-8a1644ec-e50c-485b-9c46-d40012504021 req-0ab62289-5729-44e6-812c-e736709b3be7 service nova] Creating event network-vif-unplugged:b1a9859a-97e3-466a-9b12-d8aaa13a8141 for instance 23bdadc4-6faa-4e55-8daf-eef04dd34a8a on n-h2-853682-5 Oct 18 15:33:18.841006 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-8a1644ec-e50c-485b-9c46-d40012504021 req-0ab62289-5729-44e6-812c-e736709b3be7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.165411 Oct 18 15:33:18.842108 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1073/2048] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:33:18.859920 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e3017755-1098-427f-a44c-bc656cd05d5f tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:18.868686 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e3017755-1098-427f-a44c-bc656cd05d5f tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] [instance: b649575f-a244-45c4-891b-c1fc2f9b4b95] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:18.890078 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e3017755-1098-427f-a44c-bc656cd05d5f tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:18.890427 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e3017755-1098-427f-a44c-bc656cd05d5f tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:18.890788 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e3017755-1098-427f-a44c-bc656cd05d5f tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:18.891528 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e3017755-1098-427f-a44c-bc656cd05d5f tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:18.891989 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e3017755-1098-427f-a44c-bc656cd05d5f tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:18.892415 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e3017755-1098-427f-a44c-bc656cd05d5f tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:19.567861 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e3017755-1098-427f-a44c-bc656cd05d5f tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a044b3132948fabf926cdd494c2c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75878827878e4ad796216561bf73b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:19.585979 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e3017755-1098-427f-a44c-bc656cd05d5f tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] 10.222.0.60 "GET /compute/v2.1/servers/b649575f-a244-45c4-891b-c1fc2f9b4b95" status: 200 len: 1306 microversion: 2.1 time: 0.738213 Oct 18 15:33:19.586854 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1074/2049] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:33:18 2022] GET /compute/v2.1/servers/b649575f-a244-45c4-891b-c1fc2f9b4b95 => generated 1306 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:33:19.607207 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-dd6fc74a-3678-4232-89fc-25d49101f473 req-8fb0c926-c7ec-4db9-a244-ef50c324bf73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dea609b-60cd-4634-b6d6-f5e3e085c1a3", "name": "network-vif-deleted", "tag": "33616eab-5f4e-4a15-9e20-108e043be5cd"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:33:19.643678 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-dd6fc74a-3678-4232-89fc-25d49101f473 req-8fb0c926-c7ec-4db9-a244-ef50c324bf73 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:19.648390 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-dd6fc74a-3678-4232-89fc-25d49101f473 req-8fb0c926-c7ec-4db9-a244-ef50c324bf73 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:19.649036 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-dd6fc74a-3678-4232-89fc-25d49101f473 req-8fb0c926-c7ec-4db9-a244-ef50c324bf73 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:19.694586 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-dd6fc74a-3678-4232-89fc-25d49101f473 req-8fb0c926-c7ec-4db9-a244-ef50c324bf73 service nova] Creating event network-vif-deleted:33616eab-5f4e-4a15-9e20-108e043be5cd for instance 2dea609b-60cd-4634-b6d6-f5e3e085c1a3 on n-h2-853682-5 Oct 18 15:33:19.711808 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-dd6fc74a-3678-4232-89fc-25d49101f473 req-8fb0c926-c7ec-4db9-a244-ef50c324bf73 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119744 Oct 18 15:33:19.713816 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1075/2050] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:33:19.868599 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-82e9a652-a443-4c46-b766-7ed6e3241758 tempest-FloatingIPDetailsTestJSON-817235475 tempest-FloatingIPDetailsTestJSON-817235475-project] Action: 'create', calling method: .version_select at 0x7f7c416598b0>, body: {"pool": null} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:33:20.260175 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=12 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:33:25.075633 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ae491318-95fe-4bcd-a349-ac6af1b06c88 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/93adc85c-6524-4498-aef9-436e2b0ea7c9" status: 200 len: 1455 microversion: 2.1 time: 17.434784 Oct 18 15:33:25.076227 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 976/2051] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:33:07 2022] GET /compute/v2.1/images/93adc85c-6524-4498-aef9-436e2b0ea7c9 => generated 1455 bytes in 17436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:33:25.086151 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-226531f5-03e8-445c-a996-dcfb30ee99ed tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:25.086761 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-226531f5-03e8-445c-a996-dcfb30ee99ed tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] [instance: 2dea609b-60cd-4634-b6d6-f5e3e085c1a3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:25.105947 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-226531f5-03e8-445c-a996-dcfb30ee99ed tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:25.106414 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-226531f5-03e8-445c-a996-dcfb30ee99ed tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:25.106859 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-226531f5-03e8-445c-a996-dcfb30ee99ed tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:25.111219 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-226531f5-03e8-445c-a996-dcfb30ee99ed tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:25.111858 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-226531f5-03e8-445c-a996-dcfb30ee99ed tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:25.112500 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-226531f5-03e8-445c-a996-dcfb30ee99ed tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:25.147587 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-226531f5-03e8-445c-a996-dcfb30ee99ed tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] HTTP exception thrown: Instance 2dea609b-60cd-4634-b6d6-f5e3e085c1a3 could not be found. Oct 18 15:33:25.149777 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-226531f5-03e8-445c-a996-dcfb30ee99ed tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Request method failure captured: Oct 18 15:33:25.149777 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3 HTTP/1.1 Oct 18 15:33:25.149777 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:33:25.149777 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:33:25.149777 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:33:25.149777 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:33:25.149777 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:33:25.149777 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:33:25.149777 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:33:25.149777 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:33:25.149777 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsUkGjMP8SjffvouuV50DvwlNdoUk3Q8vLUFcV0A2x652BNW6xWL9154nGgy7NsbEx0ieOHcq-kaOYynRivFB9-xv9EzXZcbjE75S3D-xLvfYzqMvco4WZxCQ5vHukzGevKOCqI92gfSfyxpF_yo0jschT8PzGwnqZSfEW-ovydAl8o Oct 18 15:33:25.149777 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:33:25.149777 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:33:25.149777 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:33:25.149777 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:33:25.149777 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:33:25.149777 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:33:25.149777 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: a6565f6ef56e4ed3b530d009055cd619 Oct 18 15:33:25.149777 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-LiveMigrationTest-1739198630 Oct 18 15:33:25.149777 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:33:25.149777 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:33:25.152346 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a6565f6ef56e4ed3b530d009055cd619"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a6565f6ef56e4ed3b530d009055cd619"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a6565f6ef56e4ed3b530d009055cd619"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a6565f6ef56e4ed3b530d009055cd619"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:33:25.152346 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-LiveMigrationTest-1739198630 Oct 18 15:33:25.152346 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: a6565f6ef56e4ed3b530d009055cd619 Oct 18 15:33:25.152346 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-LiveMigrationTest-1739198630 Oct 18 15:33:25.152346 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-LiveMigrationTest-1739198630-project Oct 18 15:33:25.152346 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:33:25.152346 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:33:25.152346 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: c747aec412924b52b99dbf75d0c77fa4 Oct 18 15:33:25.152346 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-LiveMigrationTest-1739198630-project Oct 18 15:33:25.152346 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:33:25.152346 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 2dea609b-60cd-4634-b6d6-f5e3e085c1a3 could not be found. Oct 18 15:33:25.152346 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '2dea609b-60cd-4634-b6d6-f5e3e085c1a3'} Oct 18 15:33:25.153439 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:33:25.153439 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:33:25.153439 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:33:25.153439 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:33:25.153439 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:33:25.153439 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:33:25.153439 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:33:25.153439 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:33:25.153439 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:33:25.153439 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:33:25.153439 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dea609b-60cd-4634-b6d6-f5e3e085c1a3 could not be found. Oct 18 15:33:25.153439 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:33:25.153439 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:33:25.153439 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:33:25.153439 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:33:25.153439 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:33:25.153439 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:33:25.153439 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:33:25.153439 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:33:25.153439 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:33:25.155327 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:33:25.155327 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:33:25.155327 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:33:25.155327 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:33:25.155327 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:33:25.155327 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:33:25.155327 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:33:25.155327 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dea609b-60cd-4634-b6d6-f5e3e085c1a3 could not be found. Oct 18 15:33:25.155327 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:33:25.155327 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:33:25.155327 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:33:25.155327 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:33:25.155327 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:33:25.155327 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:33:25.155327 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:33:25.155327 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:33:25.155327 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dea609b-60cd-4634-b6d6-f5e3e085c1a3 could not be found. Oct 18 15:33:25.155327 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:33:25.159066 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-226531f5-03e8-445c-a996-dcfb30ee99ed tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] Returning 404 to user: Instance 2dea609b-60cd-4634-b6d6-f5e3e085c1a3 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:33:25.161831 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-226531f5-03e8-445c-a996-dcfb30ee99ed tempest-LiveMigrationTest-1739198630 tempest-LiveMigrationTest-1739198630-project] 10.222.0.60 "GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3" status: 404 len: 111 microversion: 2.1 time: 0.084670 Oct 18 15:33:25.164999 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 977/2052] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:33:25 2022] GET /compute/v2.1/servers/2dea609b-60cd-4634-b6d6-f5e3e085c1a3 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:33:25.174703 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-85ea2701-70d1-4041-bc2b-8cab36371baa tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:25.178871 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-85ea2701-70d1-4041-bc2b-8cab36371baa tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:25.192796 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85ea2701-70d1-4041-bc2b-8cab36371baa tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:25.193700 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85ea2701-70d1-4041-bc2b-8cab36371baa tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:25.195117 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85ea2701-70d1-4041-bc2b-8cab36371baa tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:25.196101 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85ea2701-70d1-4041-bc2b-8cab36371baa tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:25.199506 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85ea2701-70d1-4041-bc2b-8cab36371baa tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:25.202179 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85ea2701-70d1-4041-bc2b-8cab36371baa tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:25.384110 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-82e9a652-a443-4c46-b766-7ed6e3241758 tempest-FloatingIPDetailsTestJSON-817235475 tempest-FloatingIPDetailsTestJSON-817235475-project] 10.222.0.60 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.668730 Oct 18 15:33:25.386312 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1076/2053] 10.222.0.60 () {60 vars in 1170 bytes} [Tue Oct 18 15:33:19 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5671 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:33:25.391753 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4895330d-53dc-43d9-9682-5c6fadd9f884 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:25.393895 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4895330d-53dc-43d9-9682-5c6fadd9f884 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 0dfb045a-8cea-41b6-bbdc-8fa6600046d1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:25.420657 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4895330d-53dc-43d9-9682-5c6fadd9f884 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:25.421232 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4895330d-53dc-43d9-9682-5c6fadd9f884 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:25.421803 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4895330d-53dc-43d9-9682-5c6fadd9f884 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:25.424154 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4895330d-53dc-43d9-9682-5c6fadd9f884 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:25.425366 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4895330d-53dc-43d9-9682-5c6fadd9f884 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:25.427032 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4895330d-53dc-43d9-9682-5c6fadd9f884 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:25.485820 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-4895330d-53dc-43d9-9682-5c6fadd9f884 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] HTTP exception thrown: Instance 0dfb045a-8cea-41b6-bbdc-8fa6600046d1 could not be found. Oct 18 15:33:25.490667 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4895330d-53dc-43d9-9682-5c6fadd9f884 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Request method failure captured: Oct 18 15:33:25.490667 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1 HTTP/1.1 Oct 18 15:33:25.490667 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:33:25.490667 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:33:25.490667 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:33:25.490667 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:33:25.490667 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:33:25.490667 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:33:25.490667 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:33:25.490667 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:33:25.490667 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsVMowNqcRzCbiV3A6e8SIjCJeRnkej20kweA224xsk5d92QvEKKiuxfBpg5T03lsjG64njsb3Q-4NtzUh69pfX_S9U13QfD6-OmtFRMH9s_Nc45BtT5FkYRFTQQqIJsdV-e7Bqk8VMneZg7cIELbZqBD10tEt8ncSh-_jdOaC21uLE Oct 18 15:33:25.490667 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:33:25.490667 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:33:25.490667 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:33:25.490667 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:33:25.490667 n-d-853682-5 devstack@n-api.service[120405]: X-Openstack-Nova-Api-Version: 2.25 Oct 18 15:33:25.490667 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:33:25.490667 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:33:25.490667 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: bb0579704a194ef89144af0973d68f42 Oct 18 15:33:25.490667 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1247661447 Oct 18 15:33:25.490667 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:33:25.490667 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:33:25.492357 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bb0579704a194ef89144af0973d68f42"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bb0579704a194ef89144af0973d68f42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/bb0579704a194ef89144af0973d68f42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_bb0579704a194ef89144af0973d68f42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:33:25.492357 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1247661447 Oct 18 15:33:25.492357 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: bb0579704a194ef89144af0973d68f42 Oct 18 15:33:25.492357 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1247661447 Oct 18 15:33:25.492357 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-LiveAutoBlockMigrationV225Test-1247661447-project Oct 18 15:33:25.492357 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:33:25.492357 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:33:25.492357 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 51490cfdebda47a7b8349677e4d61a59 Oct 18 15:33:25.492357 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1247661447-project Oct 18 15:33:25.492357 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:33:25.492357 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 0dfb045a-8cea-41b6-bbdc-8fa6600046d1 could not be found. Oct 18 15:33:25.492357 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '0dfb045a-8cea-41b6-bbdc-8fa6600046d1'} Oct 18 15:33:25.493474 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:33:25.493474 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:33:25.493474 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:33:25.493474 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:33:25.493474 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:33:25.493474 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:33:25.493474 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:33:25.493474 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:33:25.493474 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:33:25.493474 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:33:25.493474 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dfb045a-8cea-41b6-bbdc-8fa6600046d1 could not be found. Oct 18 15:33:25.493474 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:33:25.493474 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:33:25.493474 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:33:25.493474 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:33:25.493474 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:33:25.493474 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:33:25.493474 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:33:25.493474 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:33:25.493474 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:33:25.495422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:33:25.495422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:33:25.495422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:33:25.495422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:33:25.495422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:33:25.495422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:33:25.495422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:33:25.495422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dfb045a-8cea-41b6-bbdc-8fa6600046d1 could not be found. Oct 18 15:33:25.495422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:33:25.495422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:33:25.495422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:33:25.495422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:33:25.495422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:33:25.495422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:33:25.495422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:33:25.495422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:33:25.495422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dfb045a-8cea-41b6-bbdc-8fa6600046d1 could not be found. Oct 18 15:33:25.495422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:33:25.497439 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4895330d-53dc-43d9-9682-5c6fadd9f884 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Returning 404 to user: Instance 0dfb045a-8cea-41b6-bbdc-8fa6600046d1 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:33:25.497439 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4895330d-53dc-43d9-9682-5c6fadd9f884 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1" status: 404 len: 111 microversion: 2.25 time: 0.104692 Oct 18 15:33:25.497439 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1077/2054] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:33:25 2022] GET /compute/v2.1/servers/0dfb045a-8cea-41b6-bbdc-8fa6600046d1 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:33:25.512406 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-033a6654-89e6-424e-b088-8d1bf38b902b req-f172c1f6-15cf-4b3f-846d-5bb39ab2eafb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b649575f-a244-45c4-891b-c1fc2f9b4b95", "tag": "39223ede-8764-4387-9a5c-55534f30a099"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:33:25.541542 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-033a6654-89e6-424e-b088-8d1bf38b902b req-f172c1f6-15cf-4b3f-846d-5bb39ab2eafb service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:25.542745 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-033a6654-89e6-424e-b088-8d1bf38b902b req-f172c1f6-15cf-4b3f-846d-5bb39ab2eafb service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:25.544904 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-033a6654-89e6-424e-b088-8d1bf38b902b req-f172c1f6-15cf-4b3f-846d-5bb39ab2eafb service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:25.575211 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-033a6654-89e6-424e-b088-8d1bf38b902b req-f172c1f6-15cf-4b3f-846d-5bb39ab2eafb service nova] Creating event network-changed:39223ede-8764-4387-9a5c-55534f30a099 for instance b649575f-a244-45c4-891b-c1fc2f9b4b95 on n-h1-853682-5 Oct 18 15:33:25.589848 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-033a6654-89e6-424e-b088-8d1bf38b902b req-f172c1f6-15cf-4b3f-846d-5bb39ab2eafb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080703 Oct 18 15:33:25.591077 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1078/2055] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:33:25.606459 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3075202a-1413-45da-870e-c61767398f88 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:25.607776 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3075202a-1413-45da-870e-c61767398f88 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] [instance: b649575f-a244-45c4-891b-c1fc2f9b4b95] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:25.627770 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3075202a-1413-45da-870e-c61767398f88 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:25.630939 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3075202a-1413-45da-870e-c61767398f88 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:25.631617 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3075202a-1413-45da-870e-c61767398f88 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:25.632541 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3075202a-1413-45da-870e-c61767398f88 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:25.634667 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3075202a-1413-45da-870e-c61767398f88 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:25.636339 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3075202a-1413-45da-870e-c61767398f88 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:26.280762 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-85ea2701-70d1-4041-bc2b-8cab36371baa tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:26.303080 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-85ea2701-70d1-4041-bc2b-8cab36371baa tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:26.311549 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-85ea2701-70d1-4041-bc2b-8cab36371baa tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:26.322978 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-85ea2701-70d1-4041-bc2b-8cab36371baa tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 2825 microversion: 2.42 time: 1.152232 Oct 18 15:33:26.326378 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 978/2056] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:33:25 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 2825 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:33:26.341291 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-66622fd4-81fe-454d-99fc-ee61f12d9246 req-7873c185-1977-4376-b541-ded0c20a00db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23bdadc4-6faa-4e55-8daf-eef04dd34a8a", "name": "network-vif-unplugged", "status": "completed", "tag": "44427cac-ace4-451a-be16-8086d2ad6d0e"}, {"server_uuid": "23bdadc4-6faa-4e55-8daf-eef04dd34a8a", "name": "network-vif-unplugged", "status": "completed", "tag": "6ea5a9f2-9734-4014-8e33-f46906bf9bfb"}, {"server_uuid": "23bdadc4-6faa-4e55-8daf-eef04dd34a8a", "name": "network-vif-unplugged", "status": "completed", "tag": "338571d6-62fa-444c-a91e-c4a1fb9c42c5"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:33:26.368649 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3075202a-1413-45da-870e-c61767398f88 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a044b3132948fabf926cdd494c2c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75878827878e4ad796216561bf73b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:26.376776 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3075202a-1413-45da-870e-c61767398f88 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] 10.222.0.60 "GET /compute/v2.1/servers/b649575f-a244-45c4-891b-c1fc2f9b4b95" status: 200 len: 1306 microversion: 2.1 time: 0.784258 Oct 18 15:33:26.388260 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1079/2057] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:33:25 2022] GET /compute/v2.1/servers/b649575f-a244-45c4-891b-c1fc2f9b4b95 => generated 1306 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:33:26.390241 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-66622fd4-81fe-454d-99fc-ee61f12d9246 req-7873c185-1977-4376-b541-ded0c20a00db service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:26.394666 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-0ed9ead1-bddc-40fe-80ca-e85e467d3f9a req-9f1cdf03-0fb2-44b0-b542-a178607f5884 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23bdadc4-6faa-4e55-8daf-eef04dd34a8a", "name": "network-vif-deleted", "tag": "44427cac-ace4-451a-be16-8086d2ad6d0e"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:33:26.396792 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-66622fd4-81fe-454d-99fc-ee61f12d9246 req-7873c185-1977-4376-b541-ded0c20a00db service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:26.399570 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-66622fd4-81fe-454d-99fc-ee61f12d9246 req-7873c185-1977-4376-b541-ded0c20a00db service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:26.414964 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-0ed9ead1-bddc-40fe-80ca-e85e467d3f9a req-9f1cdf03-0fb2-44b0-b542-a178607f5884 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:26.415757 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-0ed9ead1-bddc-40fe-80ca-e85e467d3f9a req-9f1cdf03-0fb2-44b0-b542-a178607f5884 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:26.416374 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-0ed9ead1-bddc-40fe-80ca-e85e467d3f9a req-9f1cdf03-0fb2-44b0-b542-a178607f5884 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:26.443167 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-66622fd4-81fe-454d-99fc-ee61f12d9246 req-7873c185-1977-4376-b541-ded0c20a00db service nova] Creating event network-vif-unplugged:44427cac-ace4-451a-be16-8086d2ad6d0e for instance 23bdadc4-6faa-4e55-8daf-eef04dd34a8a on n-h2-853682-5 Oct 18 15:33:26.445214 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-0ed9ead1-bddc-40fe-80ca-e85e467d3f9a req-9f1cdf03-0fb2-44b0-b542-a178607f5884 service nova] Creating event network-vif-deleted:44427cac-ace4-451a-be16-8086d2ad6d0e for instance 23bdadc4-6faa-4e55-8daf-eef04dd34a8a on n-h2-853682-5 Oct 18 15:33:26.455402 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-66622fd4-81fe-454d-99fc-ee61f12d9246 req-7873c185-1977-4376-b541-ded0c20a00db service nova] Creating event network-vif-unplugged:6ea5a9f2-9734-4014-8e33-f46906bf9bfb for instance 23bdadc4-6faa-4e55-8daf-eef04dd34a8a on n-h2-853682-5 Oct 18 15:33:26.456176 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-66622fd4-81fe-454d-99fc-ee61f12d9246 req-7873c185-1977-4376-b541-ded0c20a00db service nova] Creating event network-vif-unplugged:338571d6-62fa-444c-a91e-c4a1fb9c42c5 for instance 23bdadc4-6faa-4e55-8daf-eef04dd34a8a on n-h2-853682-5 Oct 18 15:33:26.457992 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-0ed9ead1-bddc-40fe-80ca-e85e467d3f9a req-9f1cdf03-0fb2-44b0-b542-a178607f5884 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067754 Oct 18 15:33:26.461621 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1080/2058] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:33:26.475258 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-66622fd4-81fe-454d-99fc-ee61f12d9246 req-7873c185-1977-4376-b541-ded0c20a00db service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.146149 Oct 18 15:33:26.484608 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 979/2059] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:33:26.508500 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ed5f85d5-cb0a-4797-955a-0becda0dcd9b tempest-FloatingIPDetailsTestJSON-817235475 tempest-FloatingIPDetailsTestJSON-817235475-project] Action: 'create', calling method: .version_select at 0x7f7c3ce35670>, body: {"pool": null} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:33:26.734743 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d8da681e-920d-48e8-b4d3-79166464f90e tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Action: 'create', calling method: .version_select at 0x7f7c41640af0>, body: {"keypair": {"name": "tempest-keypair-1397377738", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMKQjwuV7mPtMz3MzqNiZTBaUAIxOluBT0d7TNcCjbWll6rDHv5c6g5xP8WMfguv1emnbg1+/snWODV24NBAvYf8OPZScRcgYXo05V34Kq6XRV4w1UQoCP0no4FBpwxJ1g=="}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:33:26.762854 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:33:26.801931 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-d8da681e-920d-48e8-b4d3-79166464f90e tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Getting quotas for project 82c561322de64f83a8c90d1bdcc833ea. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:33:26.829333 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-d8da681e-920d-48e8-b4d3-79166464f90e tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Getting quotas for user 8769f6ac73af4d8589d9e94175259031 and project 82c561322de64f83a8c90d1bdcc833ea. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:33:26.924237 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d8da681e-920d-48e8-b4d3-79166464f90e tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.456417 Oct 18 15:33:26.925015 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1081/2060] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Oct 18 15:33:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:33:26.936326 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d80468b8-bf70-4bb0-81e8-cdadd7366188 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c415f5430>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:27.033690 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d80468b8-bf70-4bb0-81e8-cdadd7366188 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/93adc85c-6524-4498-aef9-436e2b0ea7c9" status: 200 len: 1455 microversion: 2.1 time: 0.101581 Oct 18 15:33:27.041943 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1082/2061] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:33:26 2022] GET /compute/v2.1/images/93adc85c-6524-4498-aef9-436e2b0ea7c9 => generated 1455 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:33:27.357275 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-cf0da322-b849-47b7-8f9c-6da213817f48 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:27.358085 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-cf0da322-b849-47b7-8f9c-6da213817f48 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:27.381267 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cf0da322-b849-47b7-8f9c-6da213817f48 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:27.383318 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cf0da322-b849-47b7-8f9c-6da213817f48 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:27.383806 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cf0da322-b849-47b7-8f9c-6da213817f48 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:27.389807 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cf0da322-b849-47b7-8f9c-6da213817f48 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:27.393457 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cf0da322-b849-47b7-8f9c-6da213817f48 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:27.398205 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cf0da322-b849-47b7-8f9c-6da213817f48 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:29.729685 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-cf0da322-b849-47b7-8f9c-6da213817f48 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:29.750508 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-cf0da322-b849-47b7-8f9c-6da213817f48 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:29.752223 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-cf0da322-b849-47b7-8f9c-6da213817f48 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:29.753648 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-cf0da322-b849-47b7-8f9c-6da213817f48 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 2665 microversion: 2.42 time: 2.400974 Oct 18 15:33:29.754223 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1083/2062] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:33:27 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 2665 bytes in 2402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:33:29.805797 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7752c3a5-58cd-468a-aba5-0075829f404b tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:29.812647 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7752c3a5-58cd-468a-aba5-0075829f404b tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] [instance: b649575f-a244-45c4-891b-c1fc2f9b4b95] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:29.830842 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7752c3a5-58cd-468a-aba5-0075829f404b tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:29.831338 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7752c3a5-58cd-468a-aba5-0075829f404b tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:29.831780 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7752c3a5-58cd-468a-aba5-0075829f404b tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:29.832501 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7752c3a5-58cd-468a-aba5-0075829f404b tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:29.833004 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7752c3a5-58cd-468a-aba5-0075829f404b tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:29.833970 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7752c3a5-58cd-468a-aba5-0075829f404b tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:30.169361 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7752c3a5-58cd-468a-aba5-0075829f404b tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a044b3132948fabf926cdd494c2c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75878827878e4ad796216561bf73b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:30.183711 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7752c3a5-58cd-468a-aba5-0075829f404b tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] 10.222.0.60 "GET /compute/v2.1/servers/b649575f-a244-45c4-891b-c1fc2f9b4b95" status: 200 len: 1306 microversion: 2.1 time: 0.392009 Oct 18 15:33:30.185998 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1084/2063] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:33:29 2022] GET /compute/v2.1/servers/b649575f-a244-45c4-891b-c1fc2f9b4b95 => generated 1306 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:33:30.193848 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-54ecadc7-aec0-4a91-bb81-adfb01d9ab4e tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c415f51f0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:30.296851 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-54ecadc7-aec0-4a91-bb81-adfb01d9ab4e tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/93adc85c-6524-4498-aef9-436e2b0ea7c9" status: 200 len: 1455 microversion: 2.1 time: 0.109198 Oct 18 15:33:30.309295 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1085/2064] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:33:30 2022] GET /compute/v2.1/images/93adc85c-6524-4498-aef9-436e2b0ea7c9 => generated 1455 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:33:30.315243 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-6805a76d-d51b-4f1c-83d2-d38d19803aad req-5172f3eb-fb99-4da8-b15c-6489060661e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23bdadc4-6faa-4e55-8daf-eef04dd34a8a", "name": "network-vif-unplugged", "status": "completed", "tag": "31a34f24-b614-446a-bba2-e9ae313005fa"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:33:30.340868 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-6805a76d-d51b-4f1c-83d2-d38d19803aad req-5172f3eb-fb99-4da8-b15c-6489060661e4 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:30.341694 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-6805a76d-d51b-4f1c-83d2-d38d19803aad req-5172f3eb-fb99-4da8-b15c-6489060661e4 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:30.342308 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-6805a76d-d51b-4f1c-83d2-d38d19803aad req-5172f3eb-fb99-4da8-b15c-6489060661e4 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:30.372559 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-6805a76d-d51b-4f1c-83d2-d38d19803aad req-5172f3eb-fb99-4da8-b15c-6489060661e4 service nova] Creating event network-vif-unplugged:31a34f24-b614-446a-bba2-e9ae313005fa for instance 23bdadc4-6faa-4e55-8daf-eef04dd34a8a on n-h2-853682-5 Oct 18 15:33:30.385750 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-6805a76d-d51b-4f1c-83d2-d38d19803aad req-5172f3eb-fb99-4da8-b15c-6489060661e4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073293 Oct 18 15:33:30.387543 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1086/2065] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:33:30.399772 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-18d91d3b-d999-4d6d-b9d7-cc7a0300c13d req-e225e195-9cfe-4e80-a09b-b822cf564f9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23bdadc4-6faa-4e55-8daf-eef04dd34a8a", "name": "network-vif-deleted", "tag": "31a34f24-b614-446a-bba2-e9ae313005fa"}, {"server_uuid": "23bdadc4-6faa-4e55-8daf-eef04dd34a8a", "name": "network-vif-deleted", "tag": "338571d6-62fa-444c-a91e-c4a1fb9c42c5"}, {"server_uuid": "23bdadc4-6faa-4e55-8daf-eef04dd34a8a", "name": "network-vif-deleted", "tag": "b1a9859a-97e3-466a-9b12-d8aaa13a8141"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:33:30.429887 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-18d91d3b-d999-4d6d-b9d7-cc7a0300c13d req-e225e195-9cfe-4e80-a09b-b822cf564f9e service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:30.435499 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-18d91d3b-d999-4d6d-b9d7-cc7a0300c13d req-e225e195-9cfe-4e80-a09b-b822cf564f9e service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:30.436657 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-18d91d3b-d999-4d6d-b9d7-cc7a0300c13d req-e225e195-9cfe-4e80-a09b-b822cf564f9e service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:30.461984 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-18d91d3b-d999-4d6d-b9d7-cc7a0300c13d req-e225e195-9cfe-4e80-a09b-b822cf564f9e service nova] Creating event network-vif-deleted:31a34f24-b614-446a-bba2-e9ae313005fa for instance 23bdadc4-6faa-4e55-8daf-eef04dd34a8a on n-h2-853682-5 Oct 18 15:33:30.463993 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-18d91d3b-d999-4d6d-b9d7-cc7a0300c13d req-e225e195-9cfe-4e80-a09b-b822cf564f9e service nova] Creating event network-vif-deleted:338571d6-62fa-444c-a91e-c4a1fb9c42c5 for instance 23bdadc4-6faa-4e55-8daf-eef04dd34a8a on n-h2-853682-5 Oct 18 15:33:30.464696 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-18d91d3b-d999-4d6d-b9d7-cc7a0300c13d req-e225e195-9cfe-4e80-a09b-b822cf564f9e service nova] Creating event network-vif-deleted:b1a9859a-97e3-466a-9b12-d8aaa13a8141 for instance 23bdadc4-6faa-4e55-8daf-eef04dd34a8a on n-h2-853682-5 Oct 18 15:33:30.480789 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-18d91d3b-d999-4d6d-b9d7-cc7a0300c13d req-e225e195-9cfe-4e80-a09b-b822cf564f9e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.091203 Oct 18 15:33:30.483478 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1087/2066] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:33:30.789830 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c4420838-af76-40ac-bbcb-5a7369e1159d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:30.790643 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c4420838-af76-40ac-bbcb-5a7369e1159d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:30.806166 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c4420838-af76-40ac-bbcb-5a7369e1159d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:30.811096 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c4420838-af76-40ac-bbcb-5a7369e1159d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:30.812707 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c4420838-af76-40ac-bbcb-5a7369e1159d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:30.815089 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c4420838-af76-40ac-bbcb-5a7369e1159d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:30.816905 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c4420838-af76-40ac-bbcb-5a7369e1159d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:30.817372 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c4420838-af76-40ac-bbcb-5a7369e1159d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:31.837397 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c4420838-af76-40ac-bbcb-5a7369e1159d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:31.866359 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c4420838-af76-40ac-bbcb-5a7369e1159d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:31.883768 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c4420838-af76-40ac-bbcb-5a7369e1159d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:31.896292 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c4420838-af76-40ac-bbcb-5a7369e1159d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 2055 microversion: 2.42 time: 1.112050 Oct 18 15:33:31.901714 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1088/2067] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:33:30 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 2055 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:33:31.914732 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a6155464-83b8-44e4-af26-4d34a0282fcb tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:31.923228 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a6155464-83b8-44e4-af26-4d34a0282fcb tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] [instance: b649575f-a244-45c4-891b-c1fc2f9b4b95] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:31.956447 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a6155464-83b8-44e4-af26-4d34a0282fcb tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:31.960268 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a6155464-83b8-44e4-af26-4d34a0282fcb tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:31.961057 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a6155464-83b8-44e4-af26-4d34a0282fcb tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:31.962218 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a6155464-83b8-44e4-af26-4d34a0282fcb tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:31.965225 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a6155464-83b8-44e4-af26-4d34a0282fcb tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:31.965977 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a6155464-83b8-44e4-af26-4d34a0282fcb tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:32.398301 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a6155464-83b8-44e4-af26-4d34a0282fcb tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a044b3132948fabf926cdd494c2c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75878827878e4ad796216561bf73b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:32.411160 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a6155464-83b8-44e4-af26-4d34a0282fcb tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] 10.222.0.60 "GET /compute/v2.1/servers/b649575f-a244-45c4-891b-c1fc2f9b4b95" status: 200 len: 1306 microversion: 2.1 time: 0.504680 Oct 18 15:33:32.424843 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1089/2068] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:33:31 2022] GET /compute/v2.1/servers/b649575f-a244-45c4-891b-c1fc2f9b4b95 => generated 1306 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:33:32.430970 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-52445c22-a9ca-4c75-922f-b0b6904e4453 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c416f80d0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:32.513009 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-52445c22-a9ca-4c75-922f-b0b6904e4453 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/93adc85c-6524-4498-aef9-436e2b0ea7c9" status: 200 len: 1455 microversion: 2.1 time: 0.093753 Oct 18 15:33:32.513601 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1090/2069] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:33:32 2022] GET /compute/v2.1/images/93adc85c-6524-4498-aef9-436e2b0ea7c9 => generated 1455 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:33:32.531351 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-3dbccf41-f842-4693-ae8b-d0c598a890d1 req-f818ec2a-ce64-44f9-af36-0184d1b05251 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23bdadc4-6faa-4e55-8daf-eef04dd34a8a", "name": "network-vif-deleted", "tag": "6ea5a9f2-9734-4014-8e33-f46906bf9bfb"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:33:32.554061 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-3dbccf41-f842-4693-ae8b-d0c598a890d1 req-f818ec2a-ce64-44f9-af36-0184d1b05251 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:32.562131 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-3dbccf41-f842-4693-ae8b-d0c598a890d1 req-f818ec2a-ce64-44f9-af36-0184d1b05251 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:32.563410 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-3dbccf41-f842-4693-ae8b-d0c598a890d1 req-f818ec2a-ce64-44f9-af36-0184d1b05251 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:32.592292 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-3dbccf41-f842-4693-ae8b-d0c598a890d1 req-f818ec2a-ce64-44f9-af36-0184d1b05251 service nova] Creating event network-vif-deleted:6ea5a9f2-9734-4014-8e33-f46906bf9bfb for instance 23bdadc4-6faa-4e55-8daf-eef04dd34a8a on n-h2-853682-5 Oct 18 15:33:32.609609 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-3dbccf41-f842-4693-ae8b-d0c598a890d1 req-f818ec2a-ce64-44f9-af36-0184d1b05251 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080029 Oct 18 15:33:32.610942 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1091/2070] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:33:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:33:32.617918 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-278ad1f3-4c3b-4c9f-8d34-3bb456406738 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-93703310", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "3d9e0675-fac1-47a2-85f7-b74f81230d06"}, {"uuid": "1aea46e1-05a2-4ede-b85b-d3e2d0180275"}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:33:32.794397 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-278ad1f3-4c3b-4c9f-8d34-3bb456406738 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] validate_networks() for [('3d9e0675-fac1-47a2-85f7-b74f81230d06', None, None, None, None, None), ('1aea46e1-05a2-4ede-b85b-d3e2d0180275', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:33:36.259629 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ed5f85d5-cb0a-4797-955a-0becda0dcd9b tempest-FloatingIPDetailsTestJSON-817235475 tempest-FloatingIPDetailsTestJSON-817235475-project] 10.222.0.60 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 9.771366 Oct 18 15:33:36.261083 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 980/2071] 10.222.0.60 () {60 vars in 1170 bytes} [Tue Oct 18 15:33:26 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 9776 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:33:36.274028 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-20c1fee4-cd09-47b4-9b89-6a2caf0ed597 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:36.274768 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-20c1fee4-cd09-47b4-9b89-6a2caf0ed597 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:36.300797 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20c1fee4-cd09-47b4-9b89-6a2caf0ed597 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:36.300797 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20c1fee4-cd09-47b4-9b89-6a2caf0ed597 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:36.300797 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20c1fee4-cd09-47b4-9b89-6a2caf0ed597 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:36.306897 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20c1fee4-cd09-47b4-9b89-6a2caf0ed597 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:36.307504 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20c1fee4-cd09-47b4-9b89-6a2caf0ed597 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:36.308003 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20c1fee4-cd09-47b4-9b89-6a2caf0ed597 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:36.560306 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-20c1fee4-cd09-47b4-9b89-6a2caf0ed597 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:36.590639 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-20c1fee4-cd09-47b4-9b89-6a2caf0ed597 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:36.592298 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-20c1fee4-cd09-47b4-9b89-6a2caf0ed597 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:36.597054 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-20c1fee4-cd09-47b4-9b89-6a2caf0ed597 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 1605 microversion: 2.42 time: 0.327032 Oct 18 15:33:36.632903 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 981/2072] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:33:36 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 1605 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:33:36.653795 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9a64a7e0-b2d8-4e96-bf08-4cd58de686d8 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:36.680081 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9a64a7e0-b2d8-4e96-bf08-4cd58de686d8 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] [instance: b649575f-a244-45c4-891b-c1fc2f9b4b95] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:36.691660 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a64a7e0-b2d8-4e96-bf08-4cd58de686d8 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:36.692159 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a64a7e0-b2d8-4e96-bf08-4cd58de686d8 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:36.692590 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a64a7e0-b2d8-4e96-bf08-4cd58de686d8 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:36.693710 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a64a7e0-b2d8-4e96-bf08-4cd58de686d8 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:36.694329 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a64a7e0-b2d8-4e96-bf08-4cd58de686d8 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:36.696699 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a64a7e0-b2d8-4e96-bf08-4cd58de686d8 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:36.876307 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=4 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:33:36.896110 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-278ad1f3-4c3b-4c9f-8d34-3bb456406738 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:33:36.899032 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-278ad1f3-4c3b-4c9f-8d34-3bb456406738 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:33:36.900439 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-278ad1f3-4c3b-4c9f-8d34-3bb456406738 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:33:36.901724 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-278ad1f3-4c3b-4c9f-8d34-3bb456406738 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:33:36.902222 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-278ad1f3-4c3b-4c9f-8d34-3bb456406738 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:33:36.914159 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-278ad1f3-4c3b-4c9f-8d34-3bb456406738 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:36.914812 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-278ad1f3-4c3b-4c9f-8d34-3bb456406738 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:36.915545 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-278ad1f3-4c3b-4c9f-8d34-3bb456406738 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:36.916592 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-278ad1f3-4c3b-4c9f-8d34-3bb456406738 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:36.919713 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-278ad1f3-4c3b-4c9f-8d34-3bb456406738 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:36.920555 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-278ad1f3-4c3b-4c9f-8d34-3bb456406738 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:36.944502 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-278ad1f3-4c3b-4c9f-8d34-3bb456406738 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Getting quotas for project b17eee1a6b8d43589bf66e6e18059021. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:33:36.961737 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-278ad1f3-4c3b-4c9f-8d34-3bb456406738 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Getting quotas for user db93066933684d41a77863c156deb4da and project b17eee1a6b8d43589bf66e6e18059021. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:33:36.994930 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-278ad1f3-4c3b-4c9f-8d34-3bb456406738 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:33:37.004991 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-278ad1f3-4c3b-4c9f-8d34-3bb456406738 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] [instance: ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:33:37.105616 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-278ad1f3-4c3b-4c9f-8d34-3bb456406738 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.493332 Oct 18 15:33:37.106570 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1092/2073] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:33:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 4495 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:33:37.112100 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-84269932-8972-443a-b357-b0e34138315f tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c41640b80>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:37.172278 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-84269932-8972-443a-b357-b0e34138315f tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/93adc85c-6524-4498-aef9-436e2b0ea7c9" status: 200 len: 1464 microversion: 2.1 time: 0.063997 Oct 18 15:33:37.173745 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1093/2074] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:33:37 2022] GET /compute/v2.1/images/93adc85c-6524-4498-aef9-436e2b0ea7c9 => generated 1464 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:33:37.179989 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-197e16e4-e184-4d72-8a8d-e9c293dee94b tempest-FloatingIPDetailsTestJSON-817235475 tempest-FloatingIPDetailsTestJSON-817235475-project] Action: 'create', calling method: .version_select at 0x7f7c41640a60>, body: {"pool": null} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:33:37.601516 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9a64a7e0-b2d8-4e96-bf08-4cd58de686d8 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a044b3132948fabf926cdd494c2c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75878827878e4ad796216561bf73b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:37.616032 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9a64a7e0-b2d8-4e96-bf08-4cd58de686d8 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] 10.222.0.60 "GET /compute/v2.1/servers/b649575f-a244-45c4-891b-c1fc2f9b4b95" status: 200 len: 1294 microversion: 2.1 time: 0.981637 Oct 18 15:33:37.619625 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 982/2075] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:33:36 2022] GET /compute/v2.1/servers/b649575f-a244-45c4-891b-c1fc2f9b4b95 => generated 1294 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:33:37.631509 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a19216dc-bc07-4249-9168-3d8d63b45cf1 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1116539268", "imageRef": "f1c947db-5fe0-4b6e-9b19-8d41bc5658d8", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "9f2ea308-bf85-4e2c-aee1-23151b8eee6c"}], "security_groups": [{"name": "tempest-securitygroup--183778615"}], "key_name": "tempest-keypair-1397377738", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:33:38.132321 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-a19216dc-bc07-4249-9168-3d8d63b45cf1 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] validate_networks() for [('9f2ea308-bf85-4e2c-aee1-23151b8eee6c', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:33:39.552533 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-a19216dc-bc07-4249-9168-3d8d63b45cf1 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:33:39.553712 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-a19216dc-bc07-4249-9168-3d8d63b45cf1 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:33:39.554439 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-a19216dc-bc07-4249-9168-3d8d63b45cf1 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:33:39.555078 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-a19216dc-bc07-4249-9168-3d8d63b45cf1 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:33:39.555809 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-a19216dc-bc07-4249-9168-3d8d63b45cf1 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:33:39.573407 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a19216dc-bc07-4249-9168-3d8d63b45cf1 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:39.575228 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a19216dc-bc07-4249-9168-3d8d63b45cf1 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:39.580263 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a19216dc-bc07-4249-9168-3d8d63b45cf1 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:39.583098 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a19216dc-bc07-4249-9168-3d8d63b45cf1 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:39.583828 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a19216dc-bc07-4249-9168-3d8d63b45cf1 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:39.585301 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a19216dc-bc07-4249-9168-3d8d63b45cf1 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:39.632069 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-a19216dc-bc07-4249-9168-3d8d63b45cf1 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Getting quotas for project 82c561322de64f83a8c90d1bdcc833ea. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:33:39.646430 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-a19216dc-bc07-4249-9168-3d8d63b45cf1 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Getting quotas for user 8769f6ac73af4d8589d9e94175259031 and project 82c561322de64f83a8c90d1bdcc833ea. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:33:39.681470 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a19216dc-bc07-4249-9168-3d8d63b45cf1 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:33:39.687680 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a19216dc-bc07-4249-9168-3d8d63b45cf1 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] [instance: 5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f1c947db-5fe0-4b6e-9b19-8d41bc5658d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:33:39.833674 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a19216dc-bc07-4249-9168-3d8d63b45cf1 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.212044 Oct 18 15:33:39.834350 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 983/2076] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:33:37 2022] POST /compute/v2.1/servers => generated 405 bytes in 2213 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:33:39.853500 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-49fa7760-b3ac-4dba-bbd6-be9c4fc952fb tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:39.878754 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-49fa7760-b3ac-4dba-bbd6-be9c4fc952fb tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] [instance: ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:39.899721 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49fa7760-b3ac-4dba-bbd6-be9c4fc952fb tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:39.900385 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49fa7760-b3ac-4dba-bbd6-be9c4fc952fb tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:39.901958 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49fa7760-b3ac-4dba-bbd6-be9c4fc952fb tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:39.902577 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49fa7760-b3ac-4dba-bbd6-be9c4fc952fb tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:39.906723 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49fa7760-b3ac-4dba-bbd6-be9c4fc952fb tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:39.918054 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49fa7760-b3ac-4dba-bbd6-be9c4fc952fb tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:40.424457 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-49fa7760-b3ac-4dba-bbd6-be9c4fc952fb tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db93066933684d41a77863c156deb4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17eee1a6b8d43589bf66e6e18059021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:40.438794 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-49fa7760-b3ac-4dba-bbd6-be9c4fc952fb tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] 10.222.0.60 "GET /compute/v2.1/servers/ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d" status: 200 len: 1269 microversion: 2.1 time: 0.603150 Oct 18 15:33:40.439222 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 984/2077] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:33:39 2022] GET /compute/v2.1/servers/ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d => generated 1269 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:33:40.444014 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3a87b2df-c057-4a57-bba6-a6255bd64e95 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c3cf9d700>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:40.555701 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3a87b2df-c057-4a57-bba6-a6255bd64e95 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/93adc85c-6524-4498-aef9-436e2b0ea7c9" status: 200 len: 1464 microversion: 2.1 time: 0.115137 Oct 18 15:33:40.566968 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 985/2078] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:33:40 2022] GET /compute/v2.1/images/93adc85c-6524-4498-aef9-436e2b0ea7c9 => generated 1464 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:33:40.573944 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-86b18a46-c1b0-4b54-914a-16380eb9558d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:40.574561 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-86b18a46-c1b0-4b54-914a-16380eb9558d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:40.599318 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86b18a46-c1b0-4b54-914a-16380eb9558d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:40.599896 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86b18a46-c1b0-4b54-914a-16380eb9558d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:40.600569 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86b18a46-c1b0-4b54-914a-16380eb9558d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:40.601504 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86b18a46-c1b0-4b54-914a-16380eb9558d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:40.602160 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86b18a46-c1b0-4b54-914a-16380eb9558d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:40.602870 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86b18a46-c1b0-4b54-914a-16380eb9558d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:40.718371 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-86b18a46-c1b0-4b54-914a-16380eb9558d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:40.733748 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-86b18a46-c1b0-4b54-914a-16380eb9558d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:40.748669 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-86b18a46-c1b0-4b54-914a-16380eb9558d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:40.752311 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-86b18a46-c1b0-4b54-914a-16380eb9558d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 1605 microversion: 2.42 time: 0.184738 Oct 18 15:33:40.760047 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 986/2079] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:33:40 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 1605 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:33:40.765670 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5d64a72d-b7f2-47c4-aa20-ee1b8ea66097 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:40.770010 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5d64a72d-b7f2-47c4-aa20-ee1b8ea66097 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:40.794659 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d64a72d-b7f2-47c4-aa20-ee1b8ea66097 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:40.803013 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d64a72d-b7f2-47c4-aa20-ee1b8ea66097 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:40.803461 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d64a72d-b7f2-47c4-aa20-ee1b8ea66097 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:40.804467 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d64a72d-b7f2-47c4-aa20-ee1b8ea66097 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:40.804958 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d64a72d-b7f2-47c4-aa20-ee1b8ea66097 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:40.805390 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d64a72d-b7f2-47c4-aa20-ee1b8ea66097 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:40.902110 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5d64a72d-b7f2-47c4-aa20-ee1b8ea66097 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:33:41.147885 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5d64a72d-b7f2-47c4-aa20-ee1b8ea66097 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "DELETE /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793" status: 204 len: 0 microversion: 2.25 time: 0.385559 Oct 18 15:33:41.149861 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 987/2080] 10.222.0.60 () {60 vars in 1280 bytes} [Tue Oct 18 15:33:40 2022] DELETE /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 15:33:41.162669 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0f0b01a4-8d01-4dbc-a389-d5d6ae928920 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:41.163706 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0f0b01a4-8d01-4dbc-a389-d5d6ae928920 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] [instance: b649575f-a244-45c4-891b-c1fc2f9b4b95] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:41.175222 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f0b01a4-8d01-4dbc-a389-d5d6ae928920 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:41.176409 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f0b01a4-8d01-4dbc-a389-d5d6ae928920 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:41.177753 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f0b01a4-8d01-4dbc-a389-d5d6ae928920 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:41.178823 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f0b01a4-8d01-4dbc-a389-d5d6ae928920 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:41.180306 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f0b01a4-8d01-4dbc-a389-d5d6ae928920 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:41.181528 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f0b01a4-8d01-4dbc-a389-d5d6ae928920 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:41.547896 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0f0b01a4-8d01-4dbc-a389-d5d6ae928920 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a044b3132948fabf926cdd494c2c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75878827878e4ad796216561bf73b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:41.562953 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0f0b01a4-8d01-4dbc-a389-d5d6ae928920 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] 10.222.0.60 "GET /compute/v2.1/servers/b649575f-a244-45c4-891b-c1fc2f9b4b95" status: 200 len: 1294 microversion: 2.1 time: 0.405539 Oct 18 15:33:41.564761 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 988/2081] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:33:41 2022] GET /compute/v2.1/servers/b649575f-a244-45c4-891b-c1fc2f9b4b95 => generated 1294 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:33:41.574794 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6e4e3589-7e85-4dab-9816-e1a26312305d tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:41.577110 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6e4e3589-7e85-4dab-9816-e1a26312305d tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] [instance: 5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:41.590681 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6e4e3589-7e85-4dab-9816-e1a26312305d tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:41.593139 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6e4e3589-7e85-4dab-9816-e1a26312305d tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:41.598070 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6e4e3589-7e85-4dab-9816-e1a26312305d tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:41.599726 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6e4e3589-7e85-4dab-9816-e1a26312305d tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:41.601006 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6e4e3589-7e85-4dab-9816-e1a26312305d tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:41.602359 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6e4e3589-7e85-4dab-9816-e1a26312305d tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:41.603809 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-197e16e4-e184-4d72-8a8d-e9c293dee94b tempest-FloatingIPDetailsTestJSON-817235475 tempest-FloatingIPDetailsTestJSON-817235475-project] 10.222.0.60 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.428152 Oct 18 15:33:41.606051 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1094/2082] 10.222.0.60 () {60 vars in 1170 bytes} [Tue Oct 18 15:33:37 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:33:41.611406 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-96ba5bad-28c1-498e-8818-b8cf99718203 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:41.612388 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-96ba5bad-28c1-498e-8818-b8cf99718203 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] [instance: 0d0c7fc6-9245-41f3-9257-d2b8955a6d4d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:41.627991 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-96ba5bad-28c1-498e-8818-b8cf99718203 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:41.630427 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-96ba5bad-28c1-498e-8818-b8cf99718203 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:41.631138 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-96ba5bad-28c1-498e-8818-b8cf99718203 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:41.633164 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-96ba5bad-28c1-498e-8818-b8cf99718203 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:41.636328 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-96ba5bad-28c1-498e-8818-b8cf99718203 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:41.638370 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-96ba5bad-28c1-498e-8818-b8cf99718203 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:41.808745 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6e4e3589-7e85-4dab-9816-e1a26312305d tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8769f6ac73af4d8589d9e94175259031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c561322de64f83a8c90d1bdcc833ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:41.822571 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6e4e3589-7e85-4dab-9816-e1a26312305d tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] 10.222.0.60 "GET /compute/v2.1/servers/5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e" status: 200 len: 1298 microversion: 2.1 time: 0.255007 Oct 18 15:33:41.823545 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 989/2083] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:33:41 2022] GET /compute/v2.1/servers/5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e => generated 1298 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:33:41.828485 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-56c51fc6-5c72-41a9-b26d-85855830fda3 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:41.830636 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-56c51fc6-5c72-41a9-b26d-85855830fda3 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:41.837409 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-56c51fc6-5c72-41a9-b26d-85855830fda3 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:41.838220 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-56c51fc6-5c72-41a9-b26d-85855830fda3 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:41.839477 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-56c51fc6-5c72-41a9-b26d-85855830fda3 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:41.840447 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-56c51fc6-5c72-41a9-b26d-85855830fda3 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:41.841187 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-56c51fc6-5c72-41a9-b26d-85855830fda3 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:41.841898 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-56c51fc6-5c72-41a9-b26d-85855830fda3 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:42.807179 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-96ba5bad-28c1-498e-8818-b8cf99718203 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f901dea4594eb6831a78e2e603e8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c369c078bd4c49148290abb7de3d076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:42.822353 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-96ba5bad-28c1-498e-8818-b8cf99718203 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/servers/0d0c7fc6-9245-41f3-9257-d2b8955a6d4d" status: 200 len: 1468 microversion: 2.1 time: 1.209372 Oct 18 15:33:42.824283 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1095/2084] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:33:41 2022] GET /compute/v2.1/servers/0d0c7fc6-9245-41f3-9257-d2b8955a6d4d => generated 1468 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:33:42.836128 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-58216baa-df95-484b-a0b4-21f53784f1da tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:42.836753 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-58216baa-df95-484b-a0b4-21f53784f1da tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] [instance: ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:42.876212 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-58216baa-df95-484b-a0b4-21f53784f1da tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:42.891825 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-58216baa-df95-484b-a0b4-21f53784f1da tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:42.894499 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-58216baa-df95-484b-a0b4-21f53784f1da tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:42.894758 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-58216baa-df95-484b-a0b4-21f53784f1da tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:42.903366 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-58216baa-df95-484b-a0b4-21f53784f1da tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:42.906661 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-58216baa-df95-484b-a0b4-21f53784f1da tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:43.481607 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-56c51fc6-5c72-41a9-b26d-85855830fda3 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:43.491629 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-56c51fc6-5c72-41a9-b26d-85855830fda3 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:43.498267 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-56c51fc6-5c72-41a9-b26d-85855830fda3 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:43.499701 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-56c51fc6-5c72-41a9-b26d-85855830fda3 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793" status: 200 len: 1730 microversion: 2.25 time: 1.674771 Oct 18 15:33:43.500486 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 990/2085] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:33:41 2022] GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793 => generated 1730 bytes in 1676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:33:43.539988 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4c9f1611-bc46-4f81-86ec-39a584789cc4 tempest-FloatingIPDetailsTestJSON-817235475 tempest-FloatingIPDetailsTestJSON-817235475-project] Action: 'create', calling method: .version_select at 0x7f7c3ce92160>, body: {"pool": null} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:33:44.064613 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-58216baa-df95-484b-a0b4-21f53784f1da tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db93066933684d41a77863c156deb4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17eee1a6b8d43589bf66e6e18059021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:44.091643 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-58216baa-df95-484b-a0b4-21f53784f1da tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] 10.222.0.60 "GET /compute/v2.1/servers/ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d" status: 200 len: 1332 microversion: 2.1 time: 1.264215 Oct 18 15:33:44.092260 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1096/2086] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:33:42 2022] GET /compute/v2.1/servers/ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d => generated 1332 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:33:44.135651 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0201526d-eeb7-41e7-8cbf-088b4fad1b7f tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:44.137022 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0201526d-eeb7-41e7-8cbf-088b4fad1b7f tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:44.149343 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0201526d-eeb7-41e7-8cbf-088b4fad1b7f tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:44.156546 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0201526d-eeb7-41e7-8cbf-088b4fad1b7f tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:44.157305 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0201526d-eeb7-41e7-8cbf-088b4fad1b7f tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:44.158243 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0201526d-eeb7-41e7-8cbf-088b4fad1b7f tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:44.158870 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0201526d-eeb7-41e7-8cbf-088b4fad1b7f tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:44.159471 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0201526d-eeb7-41e7-8cbf-088b4fad1b7f tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:44.355769 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0201526d-eeb7-41e7-8cbf-088b4fad1b7f tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:44.366907 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0201526d-eeb7-41e7-8cbf-088b4fad1b7f tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:44.368450 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0201526d-eeb7-41e7-8cbf-088b4fad1b7f tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:44.383112 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0201526d-eeb7-41e7-8cbf-088b4fad1b7f tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 1605 microversion: 2.42 time: 0.256018 Oct 18 15:33:44.389178 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1097/2087] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:33:44 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 1605 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:33:44.406201 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-326dc80f-aeb9-4329-8895-3f40e880d891 req-d64ef416-cadb-4ad6-9f0c-690dd9c6eb81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b649575f-a244-45c4-891b-c1fc2f9b4b95", "name": "network-vif-plugged", "status": "completed", "tag": "39223ede-8764-4387-9a5c-55534f30a099"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:33:44.460435 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-326dc80f-aeb9-4329-8895-3f40e880d891 req-d64ef416-cadb-4ad6-9f0c-690dd9c6eb81 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:44.462998 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-326dc80f-aeb9-4329-8895-3f40e880d891 req-d64ef416-cadb-4ad6-9f0c-690dd9c6eb81 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:44.463633 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-326dc80f-aeb9-4329-8895-3f40e880d891 req-d64ef416-cadb-4ad6-9f0c-690dd9c6eb81 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:44.496199 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-326dc80f-aeb9-4329-8895-3f40e880d891 req-d64ef416-cadb-4ad6-9f0c-690dd9c6eb81 service nova] Creating event network-vif-plugged:39223ede-8764-4387-9a5c-55534f30a099 for instance b649575f-a244-45c4-891b-c1fc2f9b4b95 on n-h1-853682-5 Oct 18 15:33:44.513769 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-326dc80f-aeb9-4329-8895-3f40e880d891 req-d64ef416-cadb-4ad6-9f0c-690dd9c6eb81 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122997 Oct 18 15:33:44.514744 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1098/2088] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:33:44.522407 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4d1674bb-815f-4021-a7ea-5f241e67b893 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:44.523479 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4d1674bb-815f-4021-a7ea-5f241e67b893 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] [instance: b649575f-a244-45c4-891b-c1fc2f9b4b95] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:44.532246 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4d1674bb-815f-4021-a7ea-5f241e67b893 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:44.533044 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4d1674bb-815f-4021-a7ea-5f241e67b893 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:44.533659 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4d1674bb-815f-4021-a7ea-5f241e67b893 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:44.534583 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4d1674bb-815f-4021-a7ea-5f241e67b893 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:44.535218 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4d1674bb-815f-4021-a7ea-5f241e67b893 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:44.535835 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4d1674bb-815f-4021-a7ea-5f241e67b893 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:45.330180 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4d1674bb-815f-4021-a7ea-5f241e67b893 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a044b3132948fabf926cdd494c2c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75878827878e4ad796216561bf73b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:45.346289 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4d1674bb-815f-4021-a7ea-5f241e67b893 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] 10.222.0.60 "GET /compute/v2.1/servers/b649575f-a244-45c4-891b-c1fc2f9b4b95" status: 200 len: 1294 microversion: 2.1 time: 0.829324 Oct 18 15:33:45.351389 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1099/2089] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:33:44 2022] GET /compute/v2.1/servers/b649575f-a244-45c4-891b-c1fc2f9b4b95 => generated 1294 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:33:45.364614 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-977c38c9-76c5-48ac-aa9c-4d9bb456da57 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:45.365325 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-977c38c9-76c5-48ac-aa9c-4d9bb456da57 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] [instance: 5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:45.381801 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-977c38c9-76c5-48ac-aa9c-4d9bb456da57 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:45.384065 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-977c38c9-76c5-48ac-aa9c-4d9bb456da57 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:45.384612 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-977c38c9-76c5-48ac-aa9c-4d9bb456da57 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:45.389145 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-977c38c9-76c5-48ac-aa9c-4d9bb456da57 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:45.390870 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-977c38c9-76c5-48ac-aa9c-4d9bb456da57 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:45.392173 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-977c38c9-76c5-48ac-aa9c-4d9bb456da57 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:45.930308 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-977c38c9-76c5-48ac-aa9c-4d9bb456da57 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8769f6ac73af4d8589d9e94175259031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c561322de64f83a8c90d1bdcc833ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:45.938784 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=100 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:33:45.943063 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-977c38c9-76c5-48ac-aa9c-4d9bb456da57 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] 10.222.0.60 "GET /compute/v2.1/servers/5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e" status: 200 len: 1371 microversion: 2.1 time: 0.589981 Oct 18 15:33:45.947906 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1100/2090] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:33:45 2022] GET /compute/v2.1/servers/5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e => generated 1371 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:33:45.961411 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-461f61d1-d773-41e2-9e54-a62bb470bf90 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-279565592"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:33:45.965503 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-461f61d1-d773-41e2-9e54-a62bb470bf90 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] [instance: 4e1ae723-8f58-4752-b578-da0b39e9a668] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:45.975217 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-461f61d1-d773-41e2-9e54-a62bb470bf90 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:45.976044 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-461f61d1-d773-41e2-9e54-a62bb470bf90 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:45.976713 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-461f61d1-d773-41e2-9e54-a62bb470bf90 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:45.977716 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-461f61d1-d773-41e2-9e54-a62bb470bf90 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:45.978421 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-461f61d1-d773-41e2-9e54-a62bb470bf90 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:45.979685 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-461f61d1-d773-41e2-9e54-a62bb470bf90 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:46.301934 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-461f61d1-d773-41e2-9e54-a62bb470bf90 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "POST /compute/v2.1/servers/4e1ae723-8f58-4752-b578-da0b39e9a668/action" status: 202 len: 0 microversion: 2.1 time: 0.352351 Oct 18 15:33:46.309488 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1101/2091] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:33:45 2022] POST /compute/v2.1/servers/4e1ae723-8f58-4752-b578-da0b39e9a668/action => generated 0 bytes in 361 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 18 15:33:46.315205 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-0e7be75b-2874-49a4-a220-8014863b9535 req-037521c5-bae4-4bc5-ad87-2769ee5b8d1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d", "tag": "cec6b302-e9b5-409c-aae1-792a43821281"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:33:46.326283 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-0e7be75b-2874-49a4-a220-8014863b9535 req-037521c5-bae4-4bc5-ad87-2769ee5b8d1f service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:46.327068 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-0e7be75b-2874-49a4-a220-8014863b9535 req-037521c5-bae4-4bc5-ad87-2769ee5b8d1f service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:46.327700 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-0e7be75b-2874-49a4-a220-8014863b9535 req-037521c5-bae4-4bc5-ad87-2769ee5b8d1f service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:46.345946 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-0e7be75b-2874-49a4-a220-8014863b9535 req-037521c5-bae4-4bc5-ad87-2769ee5b8d1f service nova] Creating event network-changed:cec6b302-e9b5-409c-aae1-792a43821281 for instance ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d on n-h2-853682-5 Oct 18 15:33:46.354266 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-0e7be75b-2874-49a4-a220-8014863b9535 req-037521c5-bae4-4bc5-ad87-2769ee5b8d1f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042898 Oct 18 15:33:46.355500 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1102/2092] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:33:46.361634 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-27b823f5-ff5b-4f8c-9b60-fe808b3dcfb3 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:46.362716 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-27b823f5-ff5b-4f8c-9b60-fe808b3dcfb3 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:46.372634 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-27b823f5-ff5b-4f8c-9b60-fe808b3dcfb3 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:46.374396 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-27b823f5-ff5b-4f8c-9b60-fe808b3dcfb3 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:46.375199 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-27b823f5-ff5b-4f8c-9b60-fe808b3dcfb3 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:46.376182 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-27b823f5-ff5b-4f8c-9b60-fe808b3dcfb3 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:46.376917 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-27b823f5-ff5b-4f8c-9b60-fe808b3dcfb3 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:46.377644 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-27b823f5-ff5b-4f8c-9b60-fe808b3dcfb3 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:46.470872 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-27b823f5-ff5b-4f8c-9b60-fe808b3dcfb3 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:46.508595 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-27b823f5-ff5b-4f8c-9b60-fe808b3dcfb3 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:46.515979 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-27b823f5-ff5b-4f8c-9b60-fe808b3dcfb3 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:46.518435 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-27b823f5-ff5b-4f8c-9b60-fe808b3dcfb3 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793" status: 200 len: 1663 microversion: 2.25 time: 0.161617 Oct 18 15:33:46.542545 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1103/2093] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:33:46 2022] GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793 => generated 1663 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:33:46.547739 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6c6753f8-2ad8-41a3-b9f3-6fb554f8d3a3 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:46.548357 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6c6753f8-2ad8-41a3-b9f3-6fb554f8d3a3 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] [instance: ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:46.568674 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6c6753f8-2ad8-41a3-b9f3-6fb554f8d3a3 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:46.569219 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6c6753f8-2ad8-41a3-b9f3-6fb554f8d3a3 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:46.569767 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6c6753f8-2ad8-41a3-b9f3-6fb554f8d3a3 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:46.570585 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6c6753f8-2ad8-41a3-b9f3-6fb554f8d3a3 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:46.571051 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6c6753f8-2ad8-41a3-b9f3-6fb554f8d3a3 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:46.571484 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6c6753f8-2ad8-41a3-b9f3-6fb554f8d3a3 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:46.929587 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:33:46.980318 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=6 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:33:47.116195 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6c6753f8-2ad8-41a3-b9f3-6fb554f8d3a3 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db93066933684d41a77863c156deb4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17eee1a6b8d43589bf66e6e18059021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:47.129244 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6c6753f8-2ad8-41a3-b9f3-6fb554f8d3a3 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] 10.222.0.60 "GET /compute/v2.1/servers/ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d" status: 200 len: 1332 microversion: 2.1 time: 0.585272 Oct 18 15:33:47.157474 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1104/2094] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:33:46 2022] GET /compute/v2.1/servers/ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d => generated 1332 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:33:47.163153 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-32398996-59ee-4fb0-a9e2-aecbd255ef4d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:47.164265 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-32398996-59ee-4fb0-a9e2-aecbd255ef4d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:47.171939 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-32398996-59ee-4fb0-a9e2-aecbd255ef4d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:47.172827 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-32398996-59ee-4fb0-a9e2-aecbd255ef4d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:47.173616 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-32398996-59ee-4fb0-a9e2-aecbd255ef4d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:47.175052 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-32398996-59ee-4fb0-a9e2-aecbd255ef4d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:47.176016 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-32398996-59ee-4fb0-a9e2-aecbd255ef4d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:47.176722 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-32398996-59ee-4fb0-a9e2-aecbd255ef4d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:47.303731 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-32398996-59ee-4fb0-a9e2-aecbd255ef4d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:47.325784 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-32398996-59ee-4fb0-a9e2-aecbd255ef4d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:47.331568 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-32398996-59ee-4fb0-a9e2-aecbd255ef4d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:47.333181 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-32398996-59ee-4fb0-a9e2-aecbd255ef4d tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 1605 microversion: 2.42 time: 0.173970 Oct 18 15:33:47.335770 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1105/2095] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:33:47 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 1605 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:33:47.367421 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a198cb4e-fe9b-4e9e-8b75-7c4f1e3f6ee2 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c4166ca60>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:47.459864 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a198cb4e-fe9b-4e9e-8b75-7c4f1e3f6ee2 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7" status: 200 len: 1454 microversion: 2.1 time: 0.109087 Oct 18 15:33:47.471013 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1106/2096] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:33:47 2022] GET /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7 => generated 1454 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:33:47.486130 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-943a2489-e5d0-408f-a180-c64c4f211c35 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:47.486785 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-943a2489-e5d0-408f-a180-c64c4f211c35 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] [instance: b649575f-a244-45c4-891b-c1fc2f9b4b95] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:47.506381 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-943a2489-e5d0-408f-a180-c64c4f211c35 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:47.507393 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-943a2489-e5d0-408f-a180-c64c4f211c35 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:47.508209 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-943a2489-e5d0-408f-a180-c64c4f211c35 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:47.509225 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-943a2489-e5d0-408f-a180-c64c4f211c35 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:47.509919 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-943a2489-e5d0-408f-a180-c64c4f211c35 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:47.512519 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-943a2489-e5d0-408f-a180-c64c4f211c35 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:47.651136 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4c9f1611-bc46-4f81-86ec-39a584789cc4 tempest-FloatingIPDetailsTestJSON-817235475 tempest-FloatingIPDetailsTestJSON-817235475-project] 10.222.0.60 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.115579 Oct 18 15:33:47.652792 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 991/2097] 10.222.0.60 () {60 vars in 1170 bytes} [Tue Oct 18 15:33:43 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:33:47.657876 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-b243b236-32e4-448a-b7f1-b78cb75c7241 req-119622e2-6df5-4fd9-9e20-b76a6aa5e027 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d0c7fc6-9245-41f3-9257-d2b8955a6d4d", "name": "network-vif-unplugged", "status": "completed", "tag": "ccf2639c-dfaf-46eb-a27f-c279d0c6c5c1"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:33:47.680753 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:33:47.688705 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b243b236-32e4-448a-b7f1-b78cb75c7241 req-119622e2-6df5-4fd9-9e20-b76a6aa5e027 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:47.689601 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b243b236-32e4-448a-b7f1-b78cb75c7241 req-119622e2-6df5-4fd9-9e20-b76a6aa5e027 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:47.690214 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b243b236-32e4-448a-b7f1-b78cb75c7241 req-119622e2-6df5-4fd9-9e20-b76a6aa5e027 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:47.703174 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:33:47.723339 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-b243b236-32e4-448a-b7f1-b78cb75c7241 req-119622e2-6df5-4fd9-9e20-b76a6aa5e027 service nova] Creating event network-vif-unplugged:ccf2639c-dfaf-46eb-a27f-c279d0c6c5c1 for instance 0d0c7fc6-9245-41f3-9257-d2b8955a6d4d on n-h1-853682-5 Oct 18 15:33:47.735869 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-b243b236-32e4-448a-b7f1-b78cb75c7241 req-119622e2-6df5-4fd9-9e20-b76a6aa5e027 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081518 Oct 18 15:33:47.741100 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-943a2489-e5d0-408f-a180-c64c4f211c35 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a044b3132948fabf926cdd494c2c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75878827878e4ad796216561bf73b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:47.751475 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-943a2489-e5d0-408f-a180-c64c4f211c35 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] 10.222.0.60 "GET /compute/v2.1/servers/b649575f-a244-45c4-891b-c1fc2f9b4b95" status: 200 len: 1294 microversion: 2.1 time: 0.277749 Oct 18 15:33:47.751956 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 992/2098] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:33:47.764834 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1107/2099] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:33:47 2022] GET /compute/v2.1/servers/b649575f-a244-45c4-891b-c1fc2f9b4b95 => generated 1294 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:33:47.764834 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-2dc6cfc5-2492-4ac3-94da-6ba3c5597e9e req-2fb22e38-3366-442f-9c80-52017e0b9a12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc806839-862f-4ea7-9078-c970f50b3793", "name": "network-vif-deleted", "tag": "6ef23d0f-e4be-4f4e-9d5b-21e8e69f9d6f"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:33:47.785815 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-2dc6cfc5-2492-4ac3-94da-6ba3c5597e9e req-2fb22e38-3366-442f-9c80-52017e0b9a12 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:47.786420 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-2dc6cfc5-2492-4ac3-94da-6ba3c5597e9e req-2fb22e38-3366-442f-9c80-52017e0b9a12 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:47.786949 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-2dc6cfc5-2492-4ac3-94da-6ba3c5597e9e req-2fb22e38-3366-442f-9c80-52017e0b9a12 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:47.795728 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-86ab8b6b-ae8b-4137-b881-19d573bc6647 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:47.796430 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-86ab8b6b-ae8b-4137-b881-19d573bc6647 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] [instance: 5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:47.804698 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-2dc6cfc5-2492-4ac3-94da-6ba3c5597e9e req-2fb22e38-3366-442f-9c80-52017e0b9a12 service nova] Creating event network-vif-deleted:6ef23d0f-e4be-4f4e-9d5b-21e8e69f9d6f for instance cc806839-862f-4ea7-9078-c970f50b3793 on n-h2-853682-5 Oct 18 15:33:47.817677 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-2dc6cfc5-2492-4ac3-94da-6ba3c5597e9e req-2fb22e38-3366-442f-9c80-52017e0b9a12 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061629 Oct 18 15:33:47.819034 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1108/2100] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:33:47.832096 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86ab8b6b-ae8b-4137-b881-19d573bc6647 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:47.832632 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86ab8b6b-ae8b-4137-b881-19d573bc6647 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:47.833100 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86ab8b6b-ae8b-4137-b881-19d573bc6647 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:47.837718 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86ab8b6b-ae8b-4137-b881-19d573bc6647 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:47.840617 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86ab8b6b-ae8b-4137-b881-19d573bc6647 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:47.842310 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9b5b74eb-7f3c-440c-9bb9-c9af670476c9 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:47.843342 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9b5b74eb-7f3c-440c-9bb9-c9af670476c9 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:47.846414 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86ab8b6b-ae8b-4137-b881-19d573bc6647 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:47.867429 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9b5b74eb-7f3c-440c-9bb9-c9af670476c9 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:47.868350 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9b5b74eb-7f3c-440c-9bb9-c9af670476c9 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:47.869626 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9b5b74eb-7f3c-440c-9bb9-c9af670476c9 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:47.871250 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9b5b74eb-7f3c-440c-9bb9-c9af670476c9 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:47.873645 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9b5b74eb-7f3c-440c-9bb9-c9af670476c9 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:47.874399 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9b5b74eb-7f3c-440c-9bb9-c9af670476c9 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:47.924599 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9b5b74eb-7f3c-440c-9bb9-c9af670476c9 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:47.925373 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9b5b74eb-7f3c-440c-9bb9-c9af670476c9 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:47.926232 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9b5b74eb-7f3c-440c-9bb9-c9af670476c9 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:47.927690 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-9b5b74eb-7f3c-440c-9bb9-c9af670476c9 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lazy-loading 'fault' on Instance uuid cc806839-862f-4ea7-9078-c970f50b3793 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:33:48.010759 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9b5b74eb-7f3c-440c-9bb9-c9af670476c9 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:48.022911 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9b5b74eb-7f3c-440c-9bb9-c9af670476c9 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:48.028788 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9b5b74eb-7f3c-440c-9bb9-c9af670476c9 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:48.035392 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9b5b74eb-7f3c-440c-9bb9-c9af670476c9 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793" status: 200 len: 1375 microversion: 2.25 time: 0.208916 Oct 18 15:33:48.036658 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1109/2101] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:33:47 2022] GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793 => generated 1375 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:33:48.042301 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-31ce105c-0c93-494c-a575-b2b7eb10b6b1 tempest-FloatingIPDetailsTestJSON-817235475 tempest-FloatingIPDetailsTestJSON-817235475-project] Calling method '.version_select at 0x7f7c4166c0d0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:48.347978 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-86ab8b6b-ae8b-4137-b881-19d573bc6647 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8769f6ac73af4d8589d9e94175259031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c561322de64f83a8c90d1bdcc833ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:48.357631 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-86ab8b6b-ae8b-4137-b881-19d573bc6647 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] 10.222.0.60 "GET /compute/v2.1/servers/5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e" status: 200 len: 1371 microversion: 2.1 time: 0.604175 Oct 18 15:33:48.359084 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 993/2102] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:33:47 2022] GET /compute/v2.1/servers/5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e => generated 1371 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:33:48.364162 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-66fe17dd-fcbb-4fe6-8c0a-35268f72abdb tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:48.365279 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-66fe17dd-fcbb-4fe6-8c0a-35268f72abdb tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] [instance: ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:48.371791 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66fe17dd-fcbb-4fe6-8c0a-35268f72abdb tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:48.372658 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66fe17dd-fcbb-4fe6-8c0a-35268f72abdb tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:48.373292 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66fe17dd-fcbb-4fe6-8c0a-35268f72abdb tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:48.374195 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66fe17dd-fcbb-4fe6-8c0a-35268f72abdb tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:48.374935 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66fe17dd-fcbb-4fe6-8c0a-35268f72abdb tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:48.375675 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66fe17dd-fcbb-4fe6-8c0a-35268f72abdb tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:48.427087 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-31ce105c-0c93-494c-a575-b2b7eb10b6b1 tempest-FloatingIPDetailsTestJSON-817235475 tempest-FloatingIPDetailsTestJSON-817235475-project] 10.222.0.60 "GET /compute/v2.1/os-floating-ips/ec19ee8c-2c7d-4685-ba19-a82641e5f639" status: 200 len: 142 microversion: 2.1 time: 0.387822 Oct 18 15:33:48.428274 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1110/2103] 10.222.0.60 () {58 vars in 1260 bytes} [Tue Oct 18 15:33:48 2022] GET /compute/v2.1/os-floating-ips/ec19ee8c-2c7d-4685-ba19-a82641e5f639 => generated 142 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:33:48.434687 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-414f8e7d-751c-4b65-b4b2-d3aff1f3c773 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:48.435525 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-414f8e7d-751c-4b65-b4b2-d3aff1f3c773 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:48.453251 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-414f8e7d-751c-4b65-b4b2-d3aff1f3c773 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:48.454257 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-414f8e7d-751c-4b65-b4b2-d3aff1f3c773 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:48.455152 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-414f8e7d-751c-4b65-b4b2-d3aff1f3c773 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:48.456053 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-414f8e7d-751c-4b65-b4b2-d3aff1f3c773 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:48.456776 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-414f8e7d-751c-4b65-b4b2-d3aff1f3c773 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:48.457548 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-414f8e7d-751c-4b65-b4b2-d3aff1f3c773 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:48.629374 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-414f8e7d-751c-4b65-b4b2-d3aff1f3c773 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:48.644658 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-414f8e7d-751c-4b65-b4b2-d3aff1f3c773 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:48.650698 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-414f8e7d-751c-4b65-b4b2-d3aff1f3c773 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:48.652802 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-414f8e7d-751c-4b65-b4b2-d3aff1f3c773 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 1605 microversion: 2.42 time: 0.222974 Oct 18 15:33:48.656310 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1111/2104] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:33:48 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 1605 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:33:48.663538 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a08c598c-4a44-476f-8a10-4c7996b7421a tempest-FloatingIPDetailsTestJSON-817235475 tempest-FloatingIPDetailsTestJSON-817235475-project] Calling method '.version_select at 0x7f7c415fd9d0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:48.786006 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-66fe17dd-fcbb-4fe6-8c0a-35268f72abdb tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db93066933684d41a77863c156deb4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17eee1a6b8d43589bf66e6e18059021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:48.804209 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-66fe17dd-fcbb-4fe6-8c0a-35268f72abdb tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] 10.222.0.60 "GET /compute/v2.1/servers/ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d" status: 200 len: 1332 microversion: 2.1 time: 0.443767 Oct 18 15:33:48.805358 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 994/2105] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:33:48 2022] GET /compute/v2.1/servers/ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d => generated 1332 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:33:48.832531 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d98bc95e-fe16-4745-8d03-e15d26fb0556 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c3ce24160>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:48.991717 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d98bc95e-fe16-4745-8d03-e15d26fb0556 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7" status: 200 len: 1454 microversion: 2.1 time: 0.184464 Oct 18 15:33:48.997169 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 995/2106] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:33:48 2022] GET /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7 => generated 1454 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:33:49.008229 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-44fca1f5-a9ea-448a-99c6-b983e97aa0f4 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:49.008651 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-44fca1f5-a9ea-448a-99c6-b983e97aa0f4 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] [instance: b649575f-a244-45c4-891b-c1fc2f9b4b95] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:49.046089 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44fca1f5-a9ea-448a-99c6-b983e97aa0f4 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:49.046876 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44fca1f5-a9ea-448a-99c6-b983e97aa0f4 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:49.047496 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44fca1f5-a9ea-448a-99c6-b983e97aa0f4 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:49.054077 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44fca1f5-a9ea-448a-99c6-b983e97aa0f4 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:49.054608 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44fca1f5-a9ea-448a-99c6-b983e97aa0f4 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:49.055102 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44fca1f5-a9ea-448a-99c6-b983e97aa0f4 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:49.612243 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:33:49.668369 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:33:50.478507 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-44fca1f5-a9ea-448a-99c6-b983e97aa0f4 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a044b3132948fabf926cdd494c2c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75878827878e4ad796216561bf73b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:50.497420 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-44fca1f5-a9ea-448a-99c6-b983e97aa0f4 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] 10.222.0.60 "GET /compute/v2.1/servers/b649575f-a244-45c4-891b-c1fc2f9b4b95" status: 200 len: 1485 microversion: 2.1 time: 1.498852 Oct 18 15:33:50.498490 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 996/2107] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:33:48 2022] GET /compute/v2.1/servers/b649575f-a244-45c4-891b-c1fc2f9b4b95 => generated 1485 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:33:50.503778 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-32ae13c4-fc87-45b3-80e9-d1412c6421f2 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:50.504455 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-32ae13c4-fc87-45b3-80e9-d1412c6421f2 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: cc806839-862f-4ea7-9078-c970f50b3793] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:50.513573 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32ae13c4-fc87-45b3-80e9-d1412c6421f2 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:50.514351 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32ae13c4-fc87-45b3-80e9-d1412c6421f2 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:50.515044 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32ae13c4-fc87-45b3-80e9-d1412c6421f2 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:50.515975 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32ae13c4-fc87-45b3-80e9-d1412c6421f2 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:50.516907 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32ae13c4-fc87-45b3-80e9-d1412c6421f2 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:50.517534 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32ae13c4-fc87-45b3-80e9-d1412c6421f2 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:50.536913 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-32ae13c4-fc87-45b3-80e9-d1412c6421f2 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] HTTP exception thrown: Instance cc806839-862f-4ea7-9078-c970f50b3793 could not be found. Oct 18 15:33:50.539167 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-32ae13c4-fc87-45b3-80e9-d1412c6421f2 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Request method failure captured: Oct 18 15:33:50.539167 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793 HTTP/1.1 Oct 18 15:33:50.539167 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:33:50.539167 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:33:50.539167 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:33:50.539167 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:33:50.539167 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:33:50.539167 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:33:50.539167 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:33:50.539167 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:33:50.539167 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsVMowNqcRzCbiV3A6e8SIjCJeRnkej20kweA224xsk5d92QvEKKiuxfBpg5T03lsjG64njsb3Q-4NtzUh69pfX_S9U13QfD6-OmtFRMH9s_Nc45BtT5FkYRFTQQqIJsdV-e7Bqk8VMneZg7cIELbZqBD10tEt8ncSh-_jdOaC21uLE Oct 18 15:33:50.539167 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:33:50.539167 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:33:50.539167 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:33:50.539167 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:33:50.539167 n-d-853682-5 devstack@n-api.service[120406]: X-Openstack-Nova-Api-Version: 2.25 Oct 18 15:33:50.539167 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:33:50.539167 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:33:50.539167 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: bb0579704a194ef89144af0973d68f42 Oct 18 15:33:50.539167 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1247661447 Oct 18 15:33:50.539167 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:33:50.539167 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:33:50.541771 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bb0579704a194ef89144af0973d68f42"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bb0579704a194ef89144af0973d68f42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/bb0579704a194ef89144af0973d68f42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_bb0579704a194ef89144af0973d68f42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:33:50.541771 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1247661447 Oct 18 15:33:50.541771 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: bb0579704a194ef89144af0973d68f42 Oct 18 15:33:50.541771 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1247661447 Oct 18 15:33:50.541771 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-LiveAutoBlockMigrationV225Test-1247661447-project Oct 18 15:33:50.541771 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:33:50.541771 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:33:50.541771 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 51490cfdebda47a7b8349677e4d61a59 Oct 18 15:33:50.541771 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1247661447-project Oct 18 15:33:50.541771 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:33:50.541771 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance cc806839-862f-4ea7-9078-c970f50b3793 could not be found. Oct 18 15:33:50.541771 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'cc806839-862f-4ea7-9078-c970f50b3793'} Oct 18 15:33:50.543213 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:33:50.543213 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:33:50.543213 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:33:50.543213 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:33:50.543213 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:33:50.543213 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:33:50.543213 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:33:50.543213 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:33:50.543213 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:33:50.543213 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:33:50.543213 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc806839-862f-4ea7-9078-c970f50b3793 could not be found. Oct 18 15:33:50.543213 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:33:50.543213 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:33:50.543213 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:33:50.543213 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:33:50.543213 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:33:50.543213 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:33:50.543213 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:33:50.543213 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:33:50.543213 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:33:50.545514 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:33:50.545514 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:33:50.545514 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:33:50.545514 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:33:50.545514 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:33:50.545514 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:33:50.545514 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:33:50.545514 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc806839-862f-4ea7-9078-c970f50b3793 could not be found. Oct 18 15:33:50.545514 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:33:50.545514 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:33:50.545514 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:33:50.545514 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:33:50.545514 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:33:50.545514 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:33:50.545514 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:33:50.545514 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:33:50.545514 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc806839-862f-4ea7-9078-c970f50b3793 could not be found. Oct 18 15:33:50.545514 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:33:50.548754 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-32ae13c4-fc87-45b3-80e9-d1412c6421f2 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Returning 404 to user: Instance cc806839-862f-4ea7-9078-c970f50b3793 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:33:50.550120 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-32ae13c4-fc87-45b3-80e9-d1412c6421f2 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793" status: 404 len: 111 microversion: 2.25 time: 0.050681 Oct 18 15:33:50.551396 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 997/2108] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:33:50 2022] GET /compute/v2.1/servers/cc806839-862f-4ea7-9078-c970f50b3793 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:33:50.557619 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-71b3a15c-8d42-4bc8-92e1-7ac8cc66b23b tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:50.558478 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-71b3a15c-8d42-4bc8-92e1-7ac8cc66b23b tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] [instance: 5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:50.564963 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71b3a15c-8d42-4bc8-92e1-7ac8cc66b23b tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:50.565714 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71b3a15c-8d42-4bc8-92e1-7ac8cc66b23b tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:50.566320 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71b3a15c-8d42-4bc8-92e1-7ac8cc66b23b tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:50.567202 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71b3a15c-8d42-4bc8-92e1-7ac8cc66b23b tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:50.567974 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71b3a15c-8d42-4bc8-92e1-7ac8cc66b23b tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:50.568768 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71b3a15c-8d42-4bc8-92e1-7ac8cc66b23b tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:51.082168 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-71b3a15c-8d42-4bc8-92e1-7ac8cc66b23b tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8769f6ac73af4d8589d9e94175259031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c561322de64f83a8c90d1bdcc833ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:51.099437 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-71b3a15c-8d42-4bc8-92e1-7ac8cc66b23b tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] 10.222.0.60 "GET /compute/v2.1/servers/5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e" status: 200 len: 1371 microversion: 2.1 time: 0.545901 Oct 18 15:33:51.100042 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 998/2109] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:33:50 2022] GET /compute/v2.1/servers/5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e => generated 1371 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:33:51.136004 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-c451a746-b3bf-4aeb-8e59-70596a2a0a62 req-d9a92d40-1d08-4350-9908-4040c762df13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d", "tag": "c0f09542-868c-4fec-a8f3-195e5159d9eb"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:33:51.164240 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c451a746-b3bf-4aeb-8e59-70596a2a0a62 req-d9a92d40-1d08-4350-9908-4040c762df13 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:51.165161 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c451a746-b3bf-4aeb-8e59-70596a2a0a62 req-d9a92d40-1d08-4350-9908-4040c762df13 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:51.168743 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c451a746-b3bf-4aeb-8e59-70596a2a0a62 req-d9a92d40-1d08-4350-9908-4040c762df13 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:51.200025 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-c451a746-b3bf-4aeb-8e59-70596a2a0a62 req-d9a92d40-1d08-4350-9908-4040c762df13 service nova] Creating event network-changed:c0f09542-868c-4fec-a8f3-195e5159d9eb for instance ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d on n-h2-853682-5 Oct 18 15:33:51.216616 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-c451a746-b3bf-4aeb-8e59-70596a2a0a62 req-d9a92d40-1d08-4350-9908-4040c762df13 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089424 Oct 18 15:33:51.218097 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 999/2110] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:33:51.235008 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-884f4078-0471-4d1c-bbe5-d9a6096502a3 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:51.236136 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-884f4078-0471-4d1c-bbe5-d9a6096502a3 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:51.247220 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-884f4078-0471-4d1c-bbe5-d9a6096502a3 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:51.250041 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-884f4078-0471-4d1c-bbe5-d9a6096502a3 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:51.253483 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-884f4078-0471-4d1c-bbe5-d9a6096502a3 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:51.254596 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-884f4078-0471-4d1c-bbe5-d9a6096502a3 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:51.255284 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-884f4078-0471-4d1c-bbe5-d9a6096502a3 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:51.255994 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-884f4078-0471-4d1c-bbe5-d9a6096502a3 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:51.439578 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-884f4078-0471-4d1c-bbe5-d9a6096502a3 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:51.463226 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-884f4078-0471-4d1c-bbe5-d9a6096502a3 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:51.470756 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-884f4078-0471-4d1c-bbe5-d9a6096502a3 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:51.477884 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-884f4078-0471-4d1c-bbe5-d9a6096502a3 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 1605 microversion: 2.42 time: 0.257923 Oct 18 15:33:51.481117 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1000/2111] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:33:51 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 1605 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:33:51.506178 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-51f4f3f1-baad-4736-8563-fa19ced9336c tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:51.509938 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-51f4f3f1-baad-4736-8563-fa19ced9336c tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] [instance: ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:51.528031 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51f4f3f1-baad-4736-8563-fa19ced9336c tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:51.530774 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51f4f3f1-baad-4736-8563-fa19ced9336c tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:51.532201 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51f4f3f1-baad-4736-8563-fa19ced9336c tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:51.536855 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51f4f3f1-baad-4736-8563-fa19ced9336c tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:51.537905 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51f4f3f1-baad-4736-8563-fa19ced9336c tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:51.538620 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51f4f3f1-baad-4736-8563-fa19ced9336c tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:52.300919 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-51f4f3f1-baad-4736-8563-fa19ced9336c tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db93066933684d41a77863c156deb4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17eee1a6b8d43589bf66e6e18059021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:52.316969 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-51f4f3f1-baad-4736-8563-fa19ced9336c tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] 10.222.0.60 "GET /compute/v2.1/servers/ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d" status: 200 len: 1332 microversion: 2.1 time: 0.833956 Oct 18 15:33:52.345436 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1001/2112] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:33:51 2022] GET /compute/v2.1/servers/ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d => generated 1332 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:33:52.356881 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-93dfd742-fb0a-4ed3-90d3-db8c1b821d0c tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c3ce01430>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:52.428104 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-93dfd742-fb0a-4ed3-90d3-db8c1b821d0c tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7" status: 200 len: 1454 microversion: 2.1 time: 0.081251 Oct 18 15:33:52.433826 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1002/2113] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:33:52 2022] GET /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7 => generated 1454 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:33:52.439112 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-18e3c7e6-b6eb-4e8e-9664-e0e32b49ea01 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:52.439432 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-18e3c7e6-b6eb-4e8e-9664-e0e32b49ea01 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] [instance: b649575f-a244-45c4-891b-c1fc2f9b4b95] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:52.459621 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18e3c7e6-b6eb-4e8e-9664-e0e32b49ea01 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:52.460159 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18e3c7e6-b6eb-4e8e-9664-e0e32b49ea01 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:52.460582 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18e3c7e6-b6eb-4e8e-9664-e0e32b49ea01 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:52.462168 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18e3c7e6-b6eb-4e8e-9664-e0e32b49ea01 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:52.463051 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18e3c7e6-b6eb-4e8e-9664-e0e32b49ea01 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:52.464236 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18e3c7e6-b6eb-4e8e-9664-e0e32b49ea01 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:52.621138 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a08c598c-4a44-476f-8a10-4c7996b7421a tempest-FloatingIPDetailsTestJSON-817235475 tempest-FloatingIPDetailsTestJSON-817235475-project] 10.222.0.60 "DELETE /compute/v2.1/os-floating-ips/ec19ee8c-2c7d-4685-ba19-a82641e5f639" status: 202 len: 0 microversion: 2.1 time: 3.963629 Oct 18 15:33:52.625693 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1112/2114] 10.222.0.60 () {58 vars in 1263 bytes} [Tue Oct 18 15:33:48 2022] DELETE /compute/v2.1/os-floating-ips/ec19ee8c-2c7d-4685-ba19-a82641e5f639 => generated 0 bytes in 3965 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:33:52.627227 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c538fb0d-5f1f-4463-9d37-38646962972a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '.version_select at 0x7f7c41659d30>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:52.658284 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-18e3c7e6-b6eb-4e8e-9664-e0e32b49ea01 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] 10.222.0.60 "GET /compute/v2.1/servers/b649575f-a244-45c4-891b-c1fc2f9b4b95/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.223072 Oct 18 15:33:52.663038 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1003/2115] 10.222.0.60 () {58 vars in 1275 bytes} [Tue Oct 18 15:33:52 2022] GET /compute/v2.1/servers/b649575f-a244-45c4-891b-c1fc2f9b4b95/os-interface => generated 285 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:33:52.705024 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c538fb0d-5f1f-4463-9d37-38646962972a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1635577822" status: 204 len: 0 microversion: 2.25 time: 0.081623 Oct 18 15:33:52.705861 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1113/2116] 10.222.0.60 () {60 vars in 1262 bytes} [Tue Oct 18 15:33:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1635577822 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 15:33:52.710744 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-50949404-e7fa-4964-bee4-a35203b44b20 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:52.721710 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4753a88c-d14c-4f85-bcab-057e6e493999 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:52.722805 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4753a88c-d14c-4f85-bcab-057e6e493999 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] [instance: 5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:52.723228 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-50949404-e7fa-4964-bee4-a35203b44b20 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:52.740134 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4753a88c-d14c-4f85-bcab-057e6e493999 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:52.742856 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4753a88c-d14c-4f85-bcab-057e6e493999 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:52.743823 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4753a88c-d14c-4f85-bcab-057e6e493999 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:52.747551 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4753a88c-d14c-4f85-bcab-057e6e493999 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:52.749258 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4753a88c-d14c-4f85-bcab-057e6e493999 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:52.750466 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4753a88c-d14c-4f85-bcab-057e6e493999 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:52.757838 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-50949404-e7fa-4964-bee4-a35203b44b20 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:52.759683 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-50949404-e7fa-4964-bee4-a35203b44b20 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:52.769521 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-50949404-e7fa-4964-bee4-a35203b44b20 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:52.770563 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-50949404-e7fa-4964-bee4-a35203b44b20 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:52.771202 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-50949404-e7fa-4964-bee4-a35203b44b20 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:52.771807 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-50949404-e7fa-4964-bee4-a35203b44b20 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:52.996437 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-50949404-e7fa-4964-bee4-a35203b44b20 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:53.013072 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-50949404-e7fa-4964-bee4-a35203b44b20 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:53.014453 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-50949404-e7fa-4964-bee4-a35203b44b20 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:53.015826 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-50949404-e7fa-4964-bee4-a35203b44b20 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 1605 microversion: 2.42 time: 0.308784 Oct 18 15:33:53.016472 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1114/2117] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:33:52 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 1605 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:33:53.061368 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-233c526e-9a1a-455e-9518-e2ded25aff44 tempest-FloatingIPDetailsTestJSON-817235475 tempest-FloatingIPDetailsTestJSON-817235475-project] Calling method '.version_select at 0x7f7c41684940>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:53.620141 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-233c526e-9a1a-455e-9518-e2ded25aff44 tempest-FloatingIPDetailsTestJSON-817235475 tempest-FloatingIPDetailsTestJSON-817235475-project] 10.222.0.60 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.574118 Oct 18 15:33:53.621899 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1115/2118] 10.222.0.60 () {58 vars in 1164 bytes} [Tue Oct 18 15:33:53 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:33:53.629900 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-3cf053eb-679a-47f5-bd58-11d881166594 req-92cab28b-4f44-4dbc-b3e9-8a2d993d6b2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e", "tag": "b9d918b6-52d1-43d5-8681-978c95391cfc"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:33:53.654946 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-3cf053eb-679a-47f5-bd58-11d881166594 req-92cab28b-4f44-4dbc-b3e9-8a2d993d6b2d service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:53.655902 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-3cf053eb-679a-47f5-bd58-11d881166594 req-92cab28b-4f44-4dbc-b3e9-8a2d993d6b2d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:53.656736 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-3cf053eb-679a-47f5-bd58-11d881166594 req-92cab28b-4f44-4dbc-b3e9-8a2d993d6b2d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:53.678839 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-3cf053eb-679a-47f5-bd58-11d881166594 req-92cab28b-4f44-4dbc-b3e9-8a2d993d6b2d service nova] Creating event network-changed:b9d918b6-52d1-43d5-8681-978c95391cfc for instance 5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e on n-h1-853682-5 Oct 18 15:33:53.704225 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-3cf053eb-679a-47f5-bd58-11d881166594 req-92cab28b-4f44-4dbc-b3e9-8a2d993d6b2d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080748 Oct 18 15:33:53.706171 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1116/2119] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:33:53.715337 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-406d99ff-8326-4e0c-8e4e-bb8a81815171 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:53.716657 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-406d99ff-8326-4e0c-8e4e-bb8a81815171 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] [instance: ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:53.724919 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-406d99ff-8326-4e0c-8e4e-bb8a81815171 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:53.726129 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-406d99ff-8326-4e0c-8e4e-bb8a81815171 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:53.726915 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-406d99ff-8326-4e0c-8e4e-bb8a81815171 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:53.728234 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-406d99ff-8326-4e0c-8e4e-bb8a81815171 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:53.730250 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-406d99ff-8326-4e0c-8e4e-bb8a81815171 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:53.731080 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-406d99ff-8326-4e0c-8e4e-bb8a81815171 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:53.807222 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4753a88c-d14c-4f85-bcab-057e6e493999 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8769f6ac73af4d8589d9e94175259031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c561322de64f83a8c90d1bdcc833ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:53.828026 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4753a88c-d14c-4f85-bcab-057e6e493999 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] 10.222.0.60 "GET /compute/v2.1/servers/5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e" status: 200 len: 1371 microversion: 2.1 time: 1.158764 Oct 18 15:33:53.848951 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1004/2120] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:33:52 2022] GET /compute/v2.1/servers/5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e => generated 1371 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:33:53.865244 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d276566c-da82-4e2f-bcbc-92640a7acc96 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c3ce57dc0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:53.977790 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d276566c-da82-4e2f-bcbc-92640a7acc96 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7" status: 200 len: 1454 microversion: 2.1 time: 0.125845 Oct 18 15:33:53.979147 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1005/2121] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:33:53 2022] GET /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7 => generated 1454 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:33:54.001373 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a80ccbc3-0aaa-4c0c-a344-d959c9923e40 tempest-FloatingIPDetailsTestJSON-817235475 tempest-FloatingIPDetailsTestJSON-817235475-project] Calling method '.version_select at 0x7f7c3cfbf790>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:54.553874 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-406d99ff-8326-4e0c-8e4e-bb8a81815171 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db93066933684d41a77863c156deb4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17eee1a6b8d43589bf66e6e18059021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:54.567418 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-406d99ff-8326-4e0c-8e4e-bb8a81815171 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] 10.222.0.60 "GET /compute/v2.1/servers/ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d" status: 200 len: 1332 microversion: 2.1 time: 0.859670 Oct 18 15:33:54.570023 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1117/2122] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:33:53 2022] GET /compute/v2.1/servers/ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d => generated 1332 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:33:54.578237 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-eee3bf28-65ff-42e0-b1b9-3650137bedd1 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:54.578774 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-eee3bf28-65ff-42e0-b1b9-3650137bedd1 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:54.599394 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eee3bf28-65ff-42e0-b1b9-3650137bedd1 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:54.599888 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eee3bf28-65ff-42e0-b1b9-3650137bedd1 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:54.600339 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eee3bf28-65ff-42e0-b1b9-3650137bedd1 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:54.602026 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eee3bf28-65ff-42e0-b1b9-3650137bedd1 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:54.602498 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eee3bf28-65ff-42e0-b1b9-3650137bedd1 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:54.602946 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eee3bf28-65ff-42e0-b1b9-3650137bedd1 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:54.826582 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-eee3bf28-65ff-42e0-b1b9-3650137bedd1 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:54.858779 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-eee3bf28-65ff-42e0-b1b9-3650137bedd1 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:54.864294 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-eee3bf28-65ff-42e0-b1b9-3650137bedd1 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:54.868903 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-eee3bf28-65ff-42e0-b1b9-3650137bedd1 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 1605 microversion: 2.42 time: 0.296457 Oct 18 15:33:54.870441 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1118/2123] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:33:54 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 1605 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:33:54.876040 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-23f17f15-7620-48a8-87fb-1a16f7e08a03 req-d5559083-ede5-4f90-8d1f-848d5a305823 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e1ae723-8f58-4752-b578-da0b39e9a668", "name": "network-vif-plugged", "status": "completed", "tag": "2083c6f4-97f8-4301-a307-2ecb7417f192"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:33:54.902571 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-23f17f15-7620-48a8-87fb-1a16f7e08a03 req-d5559083-ede5-4f90-8d1f-848d5a305823 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:54.903080 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-23f17f15-7620-48a8-87fb-1a16f7e08a03 req-d5559083-ede5-4f90-8d1f-848d5a305823 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:54.903869 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-23f17f15-7620-48a8-87fb-1a16f7e08a03 req-d5559083-ede5-4f90-8d1f-848d5a305823 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:54.920918 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-23f17f15-7620-48a8-87fb-1a16f7e08a03 req-d5559083-ede5-4f90-8d1f-848d5a305823 service nova] Creating event network-vif-plugged:2083c6f4-97f8-4301-a307-2ecb7417f192 for instance 4e1ae723-8f58-4752-b578-da0b39e9a668 on n-h1-853682-5 Oct 18 15:33:54.945177 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-23f17f15-7620-48a8-87fb-1a16f7e08a03 req-d5559083-ede5-4f90-8d1f-848d5a305823 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073354 Oct 18 15:33:54.946128 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1119/2124] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:33:54.951884 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8c39ef3a-d3c0-4430-a87a-c339cd928d91 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:54.952618 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8c39ef3a-d3c0-4430-a87a-c339cd928d91 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] [instance: 5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:54.975048 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c39ef3a-d3c0-4430-a87a-c339cd928d91 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:54.976423 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c39ef3a-d3c0-4430-a87a-c339cd928d91 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:54.977485 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c39ef3a-d3c0-4430-a87a-c339cd928d91 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:54.978241 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c39ef3a-d3c0-4430-a87a-c339cd928d91 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:54.978707 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c39ef3a-d3c0-4430-a87a-c339cd928d91 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:54.986611 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c39ef3a-d3c0-4430-a87a-c339cd928d91 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:55.080917 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a80ccbc3-0aaa-4c0c-a344-d959c9923e40 tempest-FloatingIPDetailsTestJSON-817235475 tempest-FloatingIPDetailsTestJSON-817235475-project] 10.222.0.60 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 1.096561 Oct 18 15:33:55.081920 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1006/2125] 10.222.0.60 () {58 vars in 1149 bytes} [Tue Oct 18 15:33:53 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:33:55.088083 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dc08096f-9fff-4eaa-9b4a-1a73b3152eba tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c3ce1ddc0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:55.202941 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dc08096f-9fff-4eaa-9b4a-1a73b3152eba tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7" status: 200 len: 1454 microversion: 2.1 time: 0.119804 Oct 18 15:33:55.224636 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1007/2126] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:33:55 2022] GET /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7 => generated 1454 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:33:55.246775 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bf73d31b-ab05-468d-9d93-e5a17e89bca9 tempest-FloatingIPDetailsTestJSON-817235475 tempest-FloatingIPDetailsTestJSON-817235475-project] Calling method '.version_select at 0x7f7c3ce57e50>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:55.693376 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8c39ef3a-d3c0-4430-a87a-c339cd928d91 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8769f6ac73af4d8589d9e94175259031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c561322de64f83a8c90d1bdcc833ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:55.715056 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8c39ef3a-d3c0-4430-a87a-c339cd928d91 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] 10.222.0.60 "GET /compute/v2.1/servers/5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e" status: 200 len: 1371 microversion: 2.1 time: 0.765713 Oct 18 15:33:55.716195 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1120/2127] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:33:54 2022] GET /compute/v2.1/servers/5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e => generated 1371 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:33:55.727295 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a3f18efb-0b4e-4c0f-9dca-5f6f7ff76512 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:55.731352 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a3f18efb-0b4e-4c0f-9dca-5f6f7ff76512 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] [instance: ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:55.746655 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a3f18efb-0b4e-4c0f-9dca-5f6f7ff76512 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:55.748539 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a3f18efb-0b4e-4c0f-9dca-5f6f7ff76512 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:55.750210 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a3f18efb-0b4e-4c0f-9dca-5f6f7ff76512 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:55.753085 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a3f18efb-0b4e-4c0f-9dca-5f6f7ff76512 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:55.753781 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a3f18efb-0b4e-4c0f-9dca-5f6f7ff76512 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:55.755396 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a3f18efb-0b4e-4c0f-9dca-5f6f7ff76512 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:56.218515 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a3f18efb-0b4e-4c0f-9dca-5f6f7ff76512 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db93066933684d41a77863c156deb4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17eee1a6b8d43589bf66e6e18059021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:56.229005 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a3f18efb-0b4e-4c0f-9dca-5f6f7ff76512 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] 10.222.0.60 "GET /compute/v2.1/servers/ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d" status: 200 len: 1332 microversion: 2.1 time: 0.508505 Oct 18 15:33:56.232997 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1121/2128] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:33:55 2022] GET /compute/v2.1/servers/ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d => generated 1332 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:33:56.251634 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-41bbb81b-c351-4b77-ae2c-bf5b2ec4832b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:56.252473 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-41bbb81b-c351-4b77-ae2c-bf5b2ec4832b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:56.258971 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-41bbb81b-c351-4b77-ae2c-bf5b2ec4832b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:56.259643 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-41bbb81b-c351-4b77-ae2c-bf5b2ec4832b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:56.260261 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-41bbb81b-c351-4b77-ae2c-bf5b2ec4832b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:56.261131 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-41bbb81b-c351-4b77-ae2c-bf5b2ec4832b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:56.261725 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-41bbb81b-c351-4b77-ae2c-bf5b2ec4832b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:56.262369 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-41bbb81b-c351-4b77-ae2c-bf5b2ec4832b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:56.541890 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-41bbb81b-c351-4b77-ae2c-bf5b2ec4832b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:56.562891 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-41bbb81b-c351-4b77-ae2c-bf5b2ec4832b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:56.565031 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-41bbb81b-c351-4b77-ae2c-bf5b2ec4832b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f10b8a9983f41e8b30183dcafbdce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3cdc1276f14660a6fc8101364d2a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:56.566827 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-41bbb81b-c351-4b77-ae2c-bf5b2ec4832b tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 200 len: 1605 microversion: 2.42 time: 0.332691 Oct 18 15:33:56.578592 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1122/2129] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:33:56 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 1605 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:33:56.591033 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-09e34815-242d-44fc-8349-18df42d1b352 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:56.591752 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-09e34815-242d-44fc-8349-18df42d1b352 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 28a18615-ab69-4e8e-865c-b8e0b67a74f4] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:56.599181 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09e34815-242d-44fc-8349-18df42d1b352 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:56.599872 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09e34815-242d-44fc-8349-18df42d1b352 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:56.600457 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09e34815-242d-44fc-8349-18df42d1b352 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:56.601336 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09e34815-242d-44fc-8349-18df42d1b352 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:56.602386 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09e34815-242d-44fc-8349-18df42d1b352 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:56.603313 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09e34815-242d-44fc-8349-18df42d1b352 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:56.625512 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:33:56.667996 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-09e34815-242d-44fc-8349-18df42d1b352 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 28a18615-ab69-4e8e-865c-b8e0b67a74f4] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:33:56.803423 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:33:56.811361 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-09e34815-242d-44fc-8349-18df42d1b352 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "DELETE /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4" status: 204 len: 0 microversion: 2.25 time: 0.231125 Oct 18 15:33:56.826727 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1123/2130] 10.222.0.60 () {60 vars in 1280 bytes} [Tue Oct 18 15:33:56 2022] DELETE /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 15:33:56.844625 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2727ea45-29ca-4822-af2f-c6995371963f tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c41642700>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:56.926003 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2727ea45-29ca-4822-af2f-c6995371963f tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7" status: 200 len: 1454 microversion: 2.1 time: 0.095459 Oct 18 15:33:56.926593 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1124/2131] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:33:56 2022] GET /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7 => generated 1454 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:33:56.937616 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bf73d31b-ab05-468d-9d93-e5a17e89bca9 tempest-FloatingIPDetailsTestJSON-817235475 tempest-FloatingIPDetailsTestJSON-817235475-project] 10.222.0.60 "DELETE /compute/v2.1/os-floating-ips/70c41ebc-aedb-4790-9481-464e249faac6" status: 202 len: 0 microversion: 2.1 time: 1.711538 Oct 18 15:33:56.942232 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1008/2132] 10.222.0.60 () {58 vars in 1263 bytes} [Tue Oct 18 15:33:55 2022] DELETE /compute/v2.1/os-floating-ips/70c41ebc-aedb-4790-9481-464e249faac6 => generated 0 bytes in 1717 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:33:56.942737 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-37670afd-e81d-43eb-91f7-e9066ca4d08d tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:56.943508 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-37670afd-e81d-43eb-91f7-e9066ca4d08d tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] [instance: b649575f-a244-45c4-891b-c1fc2f9b4b95] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:56.949837 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-d265dc1b-2f7b-4f05-aa59-705158f98bde req-37b6eddf-1a7a-4cd0-a6b8-e5565b0c696b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b649575f-a244-45c4-891b-c1fc2f9b4b95", "tag": "39223ede-8764-4387-9a5c-55534f30a099"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:33:56.963455 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d265dc1b-2f7b-4f05-aa59-705158f98bde req-37b6eddf-1a7a-4cd0-a6b8-e5565b0c696b service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:56.964152 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d265dc1b-2f7b-4f05-aa59-705158f98bde req-37b6eddf-1a7a-4cd0-a6b8-e5565b0c696b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:56.964790 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d265dc1b-2f7b-4f05-aa59-705158f98bde req-37b6eddf-1a7a-4cd0-a6b8-e5565b0c696b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:56.967135 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37670afd-e81d-43eb-91f7-e9066ca4d08d tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:56.967640 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37670afd-e81d-43eb-91f7-e9066ca4d08d tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:56.968087 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37670afd-e81d-43eb-91f7-e9066ca4d08d tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:56.973070 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37670afd-e81d-43eb-91f7-e9066ca4d08d tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:56.973582 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37670afd-e81d-43eb-91f7-e9066ca4d08d tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:56.974033 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37670afd-e81d-43eb-91f7-e9066ca4d08d tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:56.984752 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-d265dc1b-2f7b-4f05-aa59-705158f98bde req-37b6eddf-1a7a-4cd0-a6b8-e5565b0c696b service nova] Creating event network-changed:39223ede-8764-4387-9a5c-55534f30a099 for instance b649575f-a244-45c4-891b-c1fc2f9b4b95 on n-h1-853682-5 Oct 18 15:33:56.993622 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-d265dc1b-2f7b-4f05-aa59-705158f98bde req-37b6eddf-1a7a-4cd0-a6b8-e5565b0c696b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049146 Oct 18 15:33:56.995811 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1009/2133] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:33:57.003803 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-05b7656e-33f5-43f0-a15f-ab69035e373a tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:57.004750 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-05b7656e-33f5-43f0-a15f-ab69035e373a tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] [instance: 5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:57.013573 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-05b7656e-33f5-43f0-a15f-ab69035e373a tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:57.014291 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-05b7656e-33f5-43f0-a15f-ab69035e373a tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:57.015736 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-05b7656e-33f5-43f0-a15f-ab69035e373a tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:57.016691 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-05b7656e-33f5-43f0-a15f-ab69035e373a tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:57.017428 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-05b7656e-33f5-43f0-a15f-ab69035e373a tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:57.018051 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-05b7656e-33f5-43f0-a15f-ab69035e373a tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:57.774536 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-05b7656e-33f5-43f0-a15f-ab69035e373a tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8769f6ac73af4d8589d9e94175259031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c561322de64f83a8c90d1bdcc833ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:57.784527 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-05b7656e-33f5-43f0-a15f-ab69035e373a tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] 10.222.0.60 "GET /compute/v2.1/servers/5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e" status: 200 len: 1371 microversion: 2.1 time: 0.786733 Oct 18 15:33:57.785958 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1010/2134] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:33:56 2022] GET /compute/v2.1/servers/5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e => generated 1371 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:33:57.799238 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-71a40a37-a743-45e3-8217-b3ac45b6a211 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:57.799930 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-71a40a37-a743-45e3-8217-b3ac45b6a211 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 28a18615-ab69-4e8e-865c-b8e0b67a74f4] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:57.804244 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-37670afd-e81d-43eb-91f7-e9066ca4d08d tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a044b3132948fabf926cdd494c2c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75878827878e4ad796216561bf73b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:57.815159 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71a40a37-a743-45e3-8217-b3ac45b6a211 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:57.815452 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-37670afd-e81d-43eb-91f7-e9066ca4d08d tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] 10.222.0.60 "GET /compute/v2.1/servers/b649575f-a244-45c4-891b-c1fc2f9b4b95" status: 200 len: 1485 microversion: 2.1 time: 0.887598 Oct 18 15:33:57.815713 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71a40a37-a743-45e3-8217-b3ac45b6a211 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:57.816168 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71a40a37-a743-45e3-8217-b3ac45b6a211 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:57.816929 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71a40a37-a743-45e3-8217-b3ac45b6a211 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:57.818389 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71a40a37-a743-45e3-8217-b3ac45b6a211 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:57.819832 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71a40a37-a743-45e3-8217-b3ac45b6a211 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:57.834028 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1125/2135] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:33:56 2022] GET /compute/v2.1/servers/b649575f-a244-45c4-891b-c1fc2f9b4b95 => generated 1485 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:33:57.840723 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6eba2604-91f7-43e7-967d-945068ee7584 tempest-FloatingIPDetailsTestJSON-817235475 tempest-FloatingIPDetailsTestJSON-817235475-project] Calling method '.version_select at 0x7f7c3d025d30>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:58.803412 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-71a40a37-a743-45e3-8217-b3ac45b6a211 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:58.818000 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-71a40a37-a743-45e3-8217-b3ac45b6a211 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:58.819499 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-71a40a37-a743-45e3-8217-b3ac45b6a211 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:58.823824 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-71a40a37-a743-45e3-8217-b3ac45b6a211 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4" status: 200 len: 1548 microversion: 2.25 time: 1.033715 Oct 18 15:33:58.826263 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1011/2136] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:33:57 2022] GET /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4 => generated 1548 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:33:58.836368 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7b2d8022-691f-4a8b-b542-4840fa9e1055 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:58.837027 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7b2d8022-691f-4a8b-b542-4840fa9e1055 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] [instance: ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:58.855052 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b2d8022-691f-4a8b-b542-4840fa9e1055 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:58.855873 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b2d8022-691f-4a8b-b542-4840fa9e1055 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:58.856467 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b2d8022-691f-4a8b-b542-4840fa9e1055 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:58.859027 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b2d8022-691f-4a8b-b542-4840fa9e1055 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:58.859581 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b2d8022-691f-4a8b-b542-4840fa9e1055 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:58.860021 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b2d8022-691f-4a8b-b542-4840fa9e1055 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:59.265611 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7b2d8022-691f-4a8b-b542-4840fa9e1055 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db93066933684d41a77863c156deb4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17eee1a6b8d43589bf66e6e18059021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:33:59.275900 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7b2d8022-691f-4a8b-b542-4840fa9e1055 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] 10.222.0.60 "GET /compute/v2.1/servers/ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d" status: 200 len: 1332 microversion: 2.1 time: 0.448551 Oct 18 15:33:59.276957 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1012/2137] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:33:58 2022] GET /compute/v2.1/servers/ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d => generated 1332 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:33:59.283813 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4d547b58-76c5-4276-95bf-577b18e930cd tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:59.284590 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4d547b58-76c5-4276-95bf-577b18e930cd tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:59.302862 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d547b58-76c5-4276-95bf-577b18e930cd tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:59.303359 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d547b58-76c5-4276-95bf-577b18e930cd tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:59.303796 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d547b58-76c5-4276-95bf-577b18e930cd tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:59.304497 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d547b58-76c5-4276-95bf-577b18e930cd tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:59.305184 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d547b58-76c5-4276-95bf-577b18e930cd tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:59.306596 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d547b58-76c5-4276-95bf-577b18e930cd tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:59.334525 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-4d547b58-76c5-4276-95bf-577b18e930cd tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] HTTP exception thrown: Instance 23bdadc4-6faa-4e55-8daf-eef04dd34a8a could not be found. Oct 18 15:33:59.336376 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4d547b58-76c5-4276-95bf-577b18e930cd tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Request method failure captured: Oct 18 15:33:59.336376 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a HTTP/1.1 Oct 18 15:33:59.336376 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:33:59.336376 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:33:59.336376 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:33:59.336376 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:33:59.336376 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:33:59.336376 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:33:59.336376 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:33:59.336376 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:33:59.336376 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsXofW8_4N228buLP9UGSZfdfPfzDbauc4AJgXIRPWPJQvgd4SJqZQXDLWbeNeeKZB57naYqLKJvUILo2YhJHqk4ZGAS7Rv5kYN1n86LIScokjHTs1LDxQf5Dk-RLGo8pRpkGRchLP1dqueUlChrcn3OqK_id7GGCtPczXNixMcczCY Oct 18 15:33:59.336376 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:33:59.336376 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:33:59.336376 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:33:59.336376 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:33:59.336376 n-d-853682-5 devstack@n-api.service[120406]: X-Openstack-Nova-Api-Version: 2.42 Oct 18 15:33:59.336376 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:33:59.336376 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:33:59.336376 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: ac3cdc1276f14660a6fc8101364d2a35 Oct 18 15:33:59.336376 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-406219374 Oct 18 15:33:59.336376 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:33:59.336376 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:33:59.338142 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ac3cdc1276f14660a6fc8101364d2a35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ac3cdc1276f14660a6fc8101364d2a35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ac3cdc1276f14660a6fc8101364d2a35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ac3cdc1276f14660a6fc8101364d2a35"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:33:59.338142 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-TaggedBootDevicesTest_v242-406219374 Oct 18 15:33:59.338142 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: ac3cdc1276f14660a6fc8101364d2a35 Oct 18 15:33:59.338142 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-406219374 Oct 18 15:33:59.338142 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-TaggedBootDevicesTest_v242-406219374-project Oct 18 15:33:59.338142 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:33:59.338142 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:33:59.338142 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 8f10b8a9983f41e8b30183dcafbdce1d Oct 18 15:33:59.338142 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-TaggedBootDevicesTest_v242-406219374-project Oct 18 15:33:59.338142 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:33:59.338142 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 23bdadc4-6faa-4e55-8daf-eef04dd34a8a could not be found. Oct 18 15:33:59.338142 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '23bdadc4-6faa-4e55-8daf-eef04dd34a8a'} Oct 18 15:33:59.338889 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:33:59.338889 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:33:59.338889 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:33:59.338889 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:33:59.338889 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:33:59.338889 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:33:59.338889 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:33:59.338889 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:33:59.338889 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:33:59.338889 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:33:59.338889 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23bdadc4-6faa-4e55-8daf-eef04dd34a8a could not be found. Oct 18 15:33:59.338889 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:33:59.338889 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:33:59.338889 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:33:59.338889 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:33:59.338889 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:33:59.338889 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:33:59.338889 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:33:59.338889 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:33:59.338889 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:33:59.339928 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:33:59.339928 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:33:59.339928 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:33:59.339928 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:33:59.339928 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:33:59.339928 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:33:59.339928 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:33:59.339928 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23bdadc4-6faa-4e55-8daf-eef04dd34a8a could not be found. Oct 18 15:33:59.339928 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:33:59.339928 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:33:59.339928 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:33:59.339928 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:33:59.339928 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:33:59.339928 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:33:59.339928 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:33:59.339928 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:33:59.339928 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23bdadc4-6faa-4e55-8daf-eef04dd34a8a could not be found. Oct 18 15:33:59.339928 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:33:59.342998 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4d547b58-76c5-4276-95bf-577b18e930cd tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Returning 404 to user: Instance 23bdadc4-6faa-4e55-8daf-eef04dd34a8a could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:33:59.344149 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4d547b58-76c5-4276-95bf-577b18e930cd tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 404 len: 111 microversion: 2.42 time: 0.066051 Oct 18 15:33:59.345411 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1013/2138] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:33:59 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:33:59.350265 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7ffcf5a7-7e2c-4ed3-87d5-3bb889ca888e tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c3ce22670>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:59.419160 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7ffcf5a7-7e2c-4ed3-87d5-3bb889ca888e tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7" status: 200 len: 1454 microversion: 2.1 time: 0.072297 Oct 18 15:33:59.437574 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1014/2139] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:33:59 2022] GET /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7 => generated 1454 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:33:59.448749 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-a456b211-212d-4633-97c8-7362ff0a5690 req-5173ae0e-fa3a-474f-8047-c878c0f4e9f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d", "name": "network-vif-plugged", "status": "completed", "tag": "c0f09542-868c-4fec-a8f3-195e5159d9eb"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:33:59.463276 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a456b211-212d-4633-97c8-7362ff0a5690 req-5173ae0e-fa3a-474f-8047-c878c0f4e9f2 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:59.466526 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a456b211-212d-4633-97c8-7362ff0a5690 req-5173ae0e-fa3a-474f-8047-c878c0f4e9f2 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:59.467263 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a456b211-212d-4633-97c8-7362ff0a5690 req-5173ae0e-fa3a-474f-8047-c878c0f4e9f2 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:59.474984 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6eba2604-91f7-43e7-967d-945068ee7584 tempest-FloatingIPDetailsTestJSON-817235475 tempest-FloatingIPDetailsTestJSON-817235475-project] 10.222.0.60 "DELETE /compute/v2.1/os-floating-ips/3953c3c5-eec4-4936-a02b-6d73845db20a" status: 202 len: 0 microversion: 2.1 time: 1.639329 Oct 18 15:33:59.475739 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1126/2140] 10.222.0.60 () {58 vars in 1263 bytes} [Tue Oct 18 15:33:57 2022] DELETE /compute/v2.1/os-floating-ips/3953c3c5-eec4-4936-a02b-6d73845db20a => generated 0 bytes in 1641 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:33:59.483405 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-a456b211-212d-4633-97c8-7362ff0a5690 req-5173ae0e-fa3a-474f-8047-c878c0f4e9f2 service nova] Creating event network-vif-plugged:c0f09542-868c-4fec-a8f3-195e5159d9eb for instance ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d on n-h2-853682-5 Oct 18 15:33:59.487015 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-efad00cf-b31a-42e4-91a1-119ea32575cf tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:59.492002 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-a456b211-212d-4633-97c8-7362ff0a5690 req-5173ae0e-fa3a-474f-8047-c878c0f4e9f2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050549 Oct 18 15:33:59.493797 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1015/2141] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:33:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:33:59.496608 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-efad00cf-b31a-42e4-91a1-119ea32575cf tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] [instance: 5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:33:59.503706 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-0dc74cdb-a527-4e58-bef5-b5d2ff18afff req-0c9db363-321b-4c28-825a-5b11466ad1b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28a18615-ab69-4e8e-865c-b8e0b67a74f4", "name": "network-vif-deleted", "tag": "2477c9ea-1c78-4540-bd74-41bf83ab31bb"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:33:59.515357 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-efad00cf-b31a-42e4-91a1-119ea32575cf tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:59.515814 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-efad00cf-b31a-42e4-91a1-119ea32575cf tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:59.517365 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-efad00cf-b31a-42e4-91a1-119ea32575cf tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:59.519419 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-efad00cf-b31a-42e4-91a1-119ea32575cf tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:59.519705 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0dc74cdb-a527-4e58-bef5-b5d2ff18afff req-0c9db363-321b-4c28-825a-5b11466ad1b2 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:33:59.521785 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0dc74cdb-a527-4e58-bef5-b5d2ff18afff req-0c9db363-321b-4c28-825a-5b11466ad1b2 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:59.522446 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0dc74cdb-a527-4e58-bef5-b5d2ff18afff req-0c9db363-321b-4c28-825a-5b11466ad1b2 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:59.523373 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-efad00cf-b31a-42e4-91a1-119ea32575cf tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:33:59.525794 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-efad00cf-b31a-42e4-91a1-119ea32575cf tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:33:59.546417 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-0dc74cdb-a527-4e58-bef5-b5d2ff18afff req-0c9db363-321b-4c28-825a-5b11466ad1b2 service nova] Creating event network-vif-deleted:2477c9ea-1c78-4540-bd74-41bf83ab31bb for instance 28a18615-ab69-4e8e-865c-b8e0b67a74f4 on n-h2-853682-5 Oct 18 15:33:59.553409 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-0dc74cdb-a527-4e58-bef5-b5d2ff18afff req-0c9db363-321b-4c28-825a-5b11466ad1b2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057141 Oct 18 15:33:59.554576 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1016/2142] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:33:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:33:59.563616 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-48af1b84-e051-4fb1-b915-eeb75039b5af tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '.version_select at 0x7f7c3ce570d0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:33:59.601479 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-48af1b84-e051-4fb1-b915-eeb75039b5af tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1500708318" status: 204 len: 0 microversion: 2.42 time: 0.045049 Oct 18 15:33:59.602559 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1017/2143] 10.222.0.60 () {60 vars in 1262 bytes} [Tue Oct 18 15:33:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1500708318 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 15:33:59.622456 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f10473cd-5182-4cc5-9da1-c0bab637ec2a tempest-FloatingIPDetailsTestJSON-817235475 tempest-FloatingIPDetailsTestJSON-817235475-project] Calling method '.version_select at 0x7f7c3cf5eb80>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:00.128966 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-efad00cf-b31a-42e4-91a1-119ea32575cf tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8769f6ac73af4d8589d9e94175259031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c561322de64f83a8c90d1bdcc833ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:00.159093 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-efad00cf-b31a-42e4-91a1-119ea32575cf tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] 10.222.0.60 "GET /compute/v2.1/servers/5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e" status: 200 len: 1371 microversion: 2.1 time: 0.675890 Oct 18 15:34:00.160423 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1127/2144] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:33:59 2022] GET /compute/v2.1/servers/5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e => generated 1371 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:00.167640 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a62f0844-e9bd-4604-902e-82920802fc6e tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:00.168761 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a62f0844-e9bd-4604-902e-82920802fc6e tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: 28a18615-ab69-4e8e-865c-b8e0b67a74f4] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:00.186601 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a62f0844-e9bd-4604-902e-82920802fc6e tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:00.188984 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a62f0844-e9bd-4604-902e-82920802fc6e tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:00.192034 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a62f0844-e9bd-4604-902e-82920802fc6e tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:00.197147 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a62f0844-e9bd-4604-902e-82920802fc6e tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:00.216050 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a62f0844-e9bd-4604-902e-82920802fc6e tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:00.216925 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a62f0844-e9bd-4604-902e-82920802fc6e tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:00.236198 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-a62f0844-e9bd-4604-902e-82920802fc6e tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] HTTP exception thrown: Instance 28a18615-ab69-4e8e-865c-b8e0b67a74f4 could not be found. Oct 18 15:34:00.246470 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a62f0844-e9bd-4604-902e-82920802fc6e tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Request method failure captured: Oct 18 15:34:00.246470 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4 HTTP/1.1 Oct 18 15:34:00.246470 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:34:00.246470 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:34:00.246470 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:34:00.246470 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:34:00.246470 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:34:00.246470 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:34:00.246470 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:34:00.246470 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:34:00.246470 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsVMowNqcRzCbiV3A6e8SIjCJeRnkej20kweA224xsk5d92QvEKKiuxfBpg5T03lsjG64njsb3Q-4NtzUh69pfX_S9U13QfD6-OmtFRMH9s_Nc45BtT5FkYRFTQQqIJsdV-e7Bqk8VMneZg7cIELbZqBD10tEt8ncSh-_jdOaC21uLE Oct 18 15:34:00.246470 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:34:00.246470 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:34:00.246470 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:34:00.246470 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:34:00.246470 n-d-853682-5 devstack@n-api.service[120405]: X-Openstack-Nova-Api-Version: 2.25 Oct 18 15:34:00.246470 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:34:00.246470 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:34:00.246470 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: bb0579704a194ef89144af0973d68f42 Oct 18 15:34:00.246470 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1247661447 Oct 18 15:34:00.246470 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:34:00.246470 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:34:00.247800 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bb0579704a194ef89144af0973d68f42"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bb0579704a194ef89144af0973d68f42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/bb0579704a194ef89144af0973d68f42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_bb0579704a194ef89144af0973d68f42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:34:00.247800 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1247661447 Oct 18 15:34:00.247800 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: bb0579704a194ef89144af0973d68f42 Oct 18 15:34:00.247800 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1247661447 Oct 18 15:34:00.247800 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-LiveAutoBlockMigrationV225Test-1247661447-project Oct 18 15:34:00.247800 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:34:00.247800 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:34:00.247800 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 51490cfdebda47a7b8349677e4d61a59 Oct 18 15:34:00.247800 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1247661447-project Oct 18 15:34:00.247800 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:34:00.247800 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 28a18615-ab69-4e8e-865c-b8e0b67a74f4 could not be found. Oct 18 15:34:00.247800 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '28a18615-ab69-4e8e-865c-b8e0b67a74f4'} Oct 18 15:34:00.248413 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:34:00.248413 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:00.248413 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:34:00.248413 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:34:00.248413 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:34:00.248413 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:34:00.248413 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:34:00.248413 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:34:00.248413 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:34:00.248413 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:34:00.248413 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28a18615-ab69-4e8e-865c-b8e0b67a74f4 could not be found. Oct 18 15:34:00.248413 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:00.248413 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:34:00.248413 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:00.248413 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:00.248413 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:34:00.248413 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:34:00.248413 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:34:00.248413 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:34:00.248413 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:34:00.249457 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:34:00.249457 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:34:00.249457 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:34:00.249457 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:34:00.249457 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:34:00.249457 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:34:00.249457 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:34:00.249457 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28a18615-ab69-4e8e-865c-b8e0b67a74f4 could not be found. Oct 18 15:34:00.249457 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:00.249457 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:34:00.249457 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:00.249457 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:00.249457 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:34:00.249457 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:34:00.249457 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:34:00.249457 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:34:00.249457 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28a18615-ab69-4e8e-865c-b8e0b67a74f4 could not be found. Oct 18 15:34:00.249457 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:00.252254 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a62f0844-e9bd-4604-902e-82920802fc6e tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Returning 404 to user: Instance 28a18615-ab69-4e8e-865c-b8e0b67a74f4 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:34:00.255099 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a62f0844-e9bd-4604-902e-82920802fc6e tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4" status: 404 len: 111 microversion: 2.25 time: 0.091400 Oct 18 15:34:00.256432 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1128/2145] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:34:00 2022] GET /compute/v2.1/servers/28a18615-ab69-4e8e-865c-b8e0b67a74f4 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:34:00.441733 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-74c2a3a6-3304-44e9-a7f5-305f9caf004c tempest-QuotasAdminTestV236-2040666766 tempest-QuotasAdminTestV236-2040666766-project-admin] Action: 'update', calling method: .version_select at 0x7f7c41640d30>, body: {"quota_set": {"ram": "5120"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:34:00.512893 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-74c2a3a6-3304-44e9-a7f5-305f9caf004c tempest-QuotasAdminTestV236-2040666766 tempest-QuotasAdminTestV236-2040666766-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:00.514125 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-74c2a3a6-3304-44e9-a7f5-305f9caf004c tempest-QuotasAdminTestV236-2040666766 tempest-QuotasAdminTestV236-2040666766-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:00.514707 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-74c2a3a6-3304-44e9-a7f5-305f9caf004c tempest-QuotasAdminTestV236-2040666766 tempest-QuotasAdminTestV236-2040666766-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:00.515612 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-74c2a3a6-3304-44e9-a7f5-305f9caf004c tempest-QuotasAdminTestV236-2040666766 tempest-QuotasAdminTestV236-2040666766-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:00.516282 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-74c2a3a6-3304-44e9-a7f5-305f9caf004c tempest-QuotasAdminTestV236-2040666766 tempest-QuotasAdminTestV236-2040666766-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:00.516855 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-74c2a3a6-3304-44e9-a7f5-305f9caf004c tempest-QuotasAdminTestV236-2040666766 tempest-QuotasAdminTestV236-2040666766-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:00.587044 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-74c2a3a6-3304-44e9-a7f5-305f9caf004c tempest-QuotasAdminTestV236-2040666766 tempest-QuotasAdminTestV236-2040666766-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/b448abe85bee4f83a74311e581a3d3bd" status: 200 len: 240 microversion: 2.36 time: 0.329151 Oct 18 15:34:00.587988 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1129/2146] 10.222.0.60 () {62 vars in 1303 bytes} [Tue Oct 18 15:34:00 2022] PUT /compute/v2.1/os-quota-sets/b448abe85bee4f83a74311e581a3d3bd => generated 240 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:34:00.595027 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b13cd621-3d08-4672-854d-6a6304abfc66 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:00.596699 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b13cd621-3d08-4672-854d-6a6304abfc66 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: b11f87b9-987d-4c75-9a43-d654ab53de1f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:00.604035 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b13cd621-3d08-4672-854d-6a6304abfc66 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:00.605090 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b13cd621-3d08-4672-854d-6a6304abfc66 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:00.605526 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b13cd621-3d08-4672-854d-6a6304abfc66 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:00.606277 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b13cd621-3d08-4672-854d-6a6304abfc66 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:00.607125 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b13cd621-3d08-4672-854d-6a6304abfc66 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:00.607555 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b13cd621-3d08-4672-854d-6a6304abfc66 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:00.650020 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b13cd621-3d08-4672-854d-6a6304abfc66 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: b11f87b9-987d-4c75-9a43-d654ab53de1f] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:34:00.810679 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b13cd621-3d08-4672-854d-6a6304abfc66 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b11f87b9-987d-4c75-9a43-d654ab53de1f" status: 204 len: 0 microversion: 2.25 time: 0.219283 Oct 18 15:34:00.813726 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1130/2147] 10.222.0.60 () {60 vars in 1280 bytes} [Tue Oct 18 15:34:00 2022] DELETE /compute/v2.1/servers/b11f87b9-987d-4c75-9a43-d654ab53de1f => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 15:34:00.823047 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8c845fb3-6046-43ff-9087-496ec3589c08 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:00.824073 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8c845fb3-6046-43ff-9087-496ec3589c08 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] [instance: ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:00.833419 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c845fb3-6046-43ff-9087-496ec3589c08 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:00.834200 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c845fb3-6046-43ff-9087-496ec3589c08 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:00.835057 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c845fb3-6046-43ff-9087-496ec3589c08 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:00.836755 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c845fb3-6046-43ff-9087-496ec3589c08 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:00.837923 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c845fb3-6046-43ff-9087-496ec3589c08 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:00.839313 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c845fb3-6046-43ff-9087-496ec3589c08 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:01.065363 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f10473cd-5182-4cc5-9da1-c0bab637ec2a tempest-FloatingIPDetailsTestJSON-817235475 tempest-FloatingIPDetailsTestJSON-817235475-project] 10.222.0.60 "DELETE /compute/v2.1/os-floating-ips/be2c0982-73b9-467d-a01e-4b84500bd0ae" status: 202 len: 0 microversion: 2.1 time: 1.446740 Oct 18 15:34:01.066274 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1018/2148] 10.222.0.60 () {58 vars in 1263 bytes} [Tue Oct 18 15:33:59 2022] DELETE /compute/v2.1/os-floating-ips/be2c0982-73b9-467d-a01e-4b84500bd0ae => generated 0 bytes in 1463 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:34:01.071159 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ab835ee9-95cb-433f-ac50-27a7d9fed263 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c3cfbfee0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:01.143423 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ab835ee9-95cb-433f-ac50-27a7d9fed263 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7" status: 200 len: 1454 microversion: 2.1 time: 0.075986 Oct 18 15:34:01.144081 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1019/2149] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:34:01 2022] GET /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7 => generated 1454 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:01.159279 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dc4cf37b-4cba-4097-bbea-d6debc02e367 tempest-QuotasAdminTestV236-2040666766 tempest-QuotasAdminTestV236-2040666766-project-admin] Calling method '.version_select at 0x7f7c3ce97700>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:01.288554 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc4cf37b-4cba-4097-bbea-d6debc02e367 tempest-QuotasAdminTestV236-2040666766 tempest-QuotasAdminTestV236-2040666766-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:01.289263 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc4cf37b-4cba-4097-bbea-d6debc02e367 tempest-QuotasAdminTestV236-2040666766 tempest-QuotasAdminTestV236-2040666766-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:01.289735 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc4cf37b-4cba-4097-bbea-d6debc02e367 tempest-QuotasAdminTestV236-2040666766 tempest-QuotasAdminTestV236-2040666766-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:01.290798 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc4cf37b-4cba-4097-bbea-d6debc02e367 tempest-QuotasAdminTestV236-2040666766 tempest-QuotasAdminTestV236-2040666766-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:01.291351 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc4cf37b-4cba-4097-bbea-d6debc02e367 tempest-QuotasAdminTestV236-2040666766 tempest-QuotasAdminTestV236-2040666766-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:01.295300 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc4cf37b-4cba-4097-bbea-d6debc02e367 tempest-QuotasAdminTestV236-2040666766 tempest-QuotasAdminTestV236-2040666766-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:01.322239 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dc4cf37b-4cba-4097-bbea-d6debc02e367 tempest-QuotasAdminTestV236-2040666766 tempest-QuotasAdminTestV236-2040666766-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/b448abe85bee4f83a74311e581a3d3bd/detail" status: 200 len: 672 microversion: 2.36 time: 0.177025 Oct 18 15:34:01.323220 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1020/2150] 10.222.0.60 () {60 vars in 1304 bytes} [Tue Oct 18 15:34:01 2022] GET /compute/v2.1/os-quota-sets/b448abe85bee4f83a74311e581a3d3bd/detail => generated 672 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:34:01.330480 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-26d651a5-24c2-4705-b59d-0ab2d2104369 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:01.331600 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-26d651a5-24c2-4705-b59d-0ab2d2104369 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: b11f87b9-987d-4c75-9a43-d654ab53de1f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:01.342241 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26d651a5-24c2-4705-b59d-0ab2d2104369 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:01.343111 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26d651a5-24c2-4705-b59d-0ab2d2104369 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:01.343815 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26d651a5-24c2-4705-b59d-0ab2d2104369 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:01.346322 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26d651a5-24c2-4705-b59d-0ab2d2104369 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:01.347002 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26d651a5-24c2-4705-b59d-0ab2d2104369 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:01.347327 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8c845fb3-6046-43ff-9087-496ec3589c08 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db93066933684d41a77863c156deb4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17eee1a6b8d43589bf66e6e18059021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:01.348209 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26d651a5-24c2-4705-b59d-0ab2d2104369 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:01.361074 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8c845fb3-6046-43ff-9087-496ec3589c08 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] 10.222.0.60 "GET /compute/v2.1/servers/ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d" status: 200 len: 1332 microversion: 2.1 time: 0.545363 Oct 18 15:34:01.366678 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1131/2151] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:00 2022] GET /compute/v2.1/servers/ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d => generated 1332 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:01.377836 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-11bed558-b9c4-4a36-af4f-21c23a2e804e tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:01.378988 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-11bed558-b9c4-4a36-af4f-21c23a2e804e tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] [instance: 5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:01.388723 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-11bed558-b9c4-4a36-af4f-21c23a2e804e tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:01.390983 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-11bed558-b9c4-4a36-af4f-21c23a2e804e tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:01.397407 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-11bed558-b9c4-4a36-af4f-21c23a2e804e tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:01.398625 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-11bed558-b9c4-4a36-af4f-21c23a2e804e tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:01.399423 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-11bed558-b9c4-4a36-af4f-21c23a2e804e tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:01.400052 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-11bed558-b9c4-4a36-af4f-21c23a2e804e tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:02.145498 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-26d651a5-24c2-4705-b59d-0ab2d2104369 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:02.159177 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-26d651a5-24c2-4705-b59d-0ab2d2104369 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:02.161024 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-26d651a5-24c2-4705-b59d-0ab2d2104369 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:02.170173 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-26d651a5-24c2-4705-b59d-0ab2d2104369 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/b11f87b9-987d-4c75-9a43-d654ab53de1f" status: 200 len: 1563 microversion: 2.25 time: 0.844663 Oct 18 15:34:02.172359 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1021/2152] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:34:01 2022] GET /compute/v2.1/servers/b11f87b9-987d-4c75-9a43-d654ab53de1f => generated 1563 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:34:02.189082 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-8debf97f-d098-48e8-af35-456c342748bf req-25df4b3d-4f7a-48d7-844d-53c39bb83ea7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d", "name": "network-vif-plugged", "status": "completed", "tag": "cec6b302-e9b5-409c-aae1-792a43821281"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:34:02.202805 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8debf97f-d098-48e8-af35-456c342748bf req-25df4b3d-4f7a-48d7-844d-53c39bb83ea7 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:02.209917 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8debf97f-d098-48e8-af35-456c342748bf req-25df4b3d-4f7a-48d7-844d-53c39bb83ea7 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:02.210565 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8debf97f-d098-48e8-af35-456c342748bf req-25df4b3d-4f7a-48d7-844d-53c39bb83ea7 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:02.231877 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-8debf97f-d098-48e8-af35-456c342748bf req-25df4b3d-4f7a-48d7-844d-53c39bb83ea7 service nova] Creating event network-vif-plugged:cec6b302-e9b5-409c-aae1-792a43821281 for instance ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d on n-h2-853682-5 Oct 18 15:34:02.254291 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-8debf97f-d098-48e8-af35-456c342748bf req-25df4b3d-4f7a-48d7-844d-53c39bb83ea7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080357 Oct 18 15:34:02.258246 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1022/2153] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:34:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:34:02.279846 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-84f0461a-8f7d-4afa-ab3c-be14363ea694 tempest-QuotasAdminTestV236-2040666766 tempest-QuotasAdminTestV236-2040666766-project-admin] Action: 'update', calling method: .version_select at 0x7f7c3ce57dc0>, body: {"quota_set": {"ram": "2048"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:34:02.419823 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84f0461a-8f7d-4afa-ab3c-be14363ea694 tempest-QuotasAdminTestV236-2040666766 tempest-QuotasAdminTestV236-2040666766-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:02.420544 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84f0461a-8f7d-4afa-ab3c-be14363ea694 tempest-QuotasAdminTestV236-2040666766 tempest-QuotasAdminTestV236-2040666766-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:02.421614 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84f0461a-8f7d-4afa-ab3c-be14363ea694 tempest-QuotasAdminTestV236-2040666766 tempest-QuotasAdminTestV236-2040666766-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:02.422551 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84f0461a-8f7d-4afa-ab3c-be14363ea694 tempest-QuotasAdminTestV236-2040666766 tempest-QuotasAdminTestV236-2040666766-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:02.423163 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84f0461a-8f7d-4afa-ab3c-be14363ea694 tempest-QuotasAdminTestV236-2040666766 tempest-QuotasAdminTestV236-2040666766-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:02.423729 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84f0461a-8f7d-4afa-ab3c-be14363ea694 tempest-QuotasAdminTestV236-2040666766 tempest-QuotasAdminTestV236-2040666766-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:02.493006 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84f0461a-8f7d-4afa-ab3c-be14363ea694 tempest-QuotasAdminTestV236-2040666766 tempest-QuotasAdminTestV236-2040666766-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:02.493967 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84f0461a-8f7d-4afa-ab3c-be14363ea694 tempest-QuotasAdminTestV236-2040666766 tempest-QuotasAdminTestV236-2040666766-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:02.494767 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84f0461a-8f7d-4afa-ab3c-be14363ea694 tempest-QuotasAdminTestV236-2040666766 tempest-QuotasAdminTestV236-2040666766-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:02.495796 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84f0461a-8f7d-4afa-ab3c-be14363ea694 tempest-QuotasAdminTestV236-2040666766 tempest-QuotasAdminTestV236-2040666766-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:02.496572 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84f0461a-8f7d-4afa-ab3c-be14363ea694 tempest-QuotasAdminTestV236-2040666766 tempest-QuotasAdminTestV236-2040666766-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:02.497227 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84f0461a-8f7d-4afa-ab3c-be14363ea694 tempest-QuotasAdminTestV236-2040666766 tempest-QuotasAdminTestV236-2040666766-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:02.504050 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-11bed558-b9c4-4a36-af4f-21c23a2e804e tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8769f6ac73af4d8589d9e94175259031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c561322de64f83a8c90d1bdcc833ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:02.517088 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-11bed558-b9c4-4a36-af4f-21c23a2e804e tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] 10.222.0.60 "GET /compute/v2.1/servers/5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e" status: 200 len: 1371 microversion: 2.1 time: 1.148810 Oct 18 15:34:02.520419 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1132/2154] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:01 2022] GET /compute/v2.1/servers/5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e => generated 1371 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:02.529453 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7e1081aa-0e40-4bc6-b627-4070e4d04531 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c4166c5e0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:02.606858 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7e1081aa-0e40-4bc6-b627-4070e4d04531 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7" status: 200 len: 1454 microversion: 2.1 time: 0.085108 Oct 18 15:34:02.607751 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1133/2155] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:34:02 2022] GET /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7 => generated 1454 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:02.624025 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ab89fe61-2ab1-47a2-94a9-d1b0818a5c4f tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:02.625002 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ab89fe61-2ab1-47a2-94a9-d1b0818a5c4f tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] [instance: ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:02.635286 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ab89fe61-2ab1-47a2-94a9-d1b0818a5c4f tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:02.636658 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ab89fe61-2ab1-47a2-94a9-d1b0818a5c4f tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:02.640619 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ab89fe61-2ab1-47a2-94a9-d1b0818a5c4f tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:02.641769 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ab89fe61-2ab1-47a2-94a9-d1b0818a5c4f tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:02.642445 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ab89fe61-2ab1-47a2-94a9-d1b0818a5c4f tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:02.643072 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ab89fe61-2ab1-47a2-94a9-d1b0818a5c4f tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:02.649318 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-84f0461a-8f7d-4afa-ab3c-be14363ea694 tempest-QuotasAdminTestV236-2040666766 tempest-QuotasAdminTestV236-2040666766-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/b448abe85bee4f83a74311e581a3d3bd?user_id=aab93c18327e4362bca4df79eb1e3e5b" status: 200 len: 240 microversion: 2.36 time: 0.389418 Oct 18 15:34:02.649926 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1023/2156] 10.222.0.60 () {62 vars in 1384 bytes} [Tue Oct 18 15:34:02 2022] PUT /compute/v2.1/os-quota-sets/b448abe85bee4f83a74311e581a3d3bd?user_id=aab93c18327e4362bca4df79eb1e3e5b => generated 240 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:34:02.662210 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-92f4a8cd-b37c-427e-a816-8847f9fcecce tempest-QuotasAdminTestV236-2040666766 tempest-QuotasAdminTestV236-2040666766-project-admin] Calling method '.version_select at 0x7f7c3ce1e940>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:02.795355 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-92f4a8cd-b37c-427e-a816-8847f9fcecce tempest-QuotasAdminTestV236-2040666766 tempest-QuotasAdminTestV236-2040666766-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/b448abe85bee4f83a74311e581a3d3bd?user_id=aab93c18327e4362bca4df79eb1e3e5b" status: 200 len: 282 microversion: 2.36 time: 0.136749 Oct 18 15:34:02.796710 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1024/2157] 10.222.0.60 () {60 vars in 1364 bytes} [Tue Oct 18 15:34:02 2022] GET /compute/v2.1/os-quota-sets/b448abe85bee4f83a74311e581a3d3bd?user_id=aab93c18327e4362bca4df79eb1e3e5b => generated 282 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:34:02.966896 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-0148f2f4-d205-42ae-b6a9-b0a69fccd7e3 req-115268b0-b4af-4382-aeb5-a471fab35642 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b11f87b9-987d-4c75-9a43-d654ab53de1f", "name": "network-vif-deleted", "tag": "34c5d0bc-31cd-4b69-9582-e8aea65b728a"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:34:02.990167 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0148f2f4-d205-42ae-b6a9-b0a69fccd7e3 req-115268b0-b4af-4382-aeb5-a471fab35642 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:02.990723 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0148f2f4-d205-42ae-b6a9-b0a69fccd7e3 req-115268b0-b4af-4382-aeb5-a471fab35642 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:02.991180 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0148f2f4-d205-42ae-b6a9-b0a69fccd7e3 req-115268b0-b4af-4382-aeb5-a471fab35642 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:03.035629 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-0148f2f4-d205-42ae-b6a9-b0a69fccd7e3 req-115268b0-b4af-4382-aeb5-a471fab35642 service nova] Creating event network-vif-deleted:34c5d0bc-31cd-4b69-9582-e8aea65b728a for instance b11f87b9-987d-4c75-9a43-d654ab53de1f on n-h2-853682-5 Oct 18 15:34:03.050745 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-0148f2f4-d205-42ae-b6a9-b0a69fccd7e3 req-115268b0-b4af-4382-aeb5-a471fab35642 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087852 Oct 18 15:34:03.056650 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1025/2158] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:34:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:34:03.188856 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ab89fe61-2ab1-47a2-94a9-d1b0818a5c4f tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db93066933684d41a77863c156deb4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17eee1a6b8d43589bf66e6e18059021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:03.203590 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-23213616-bbe8-42e5-b99f-9f77586e003a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:03.206593 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-23213616-bbe8-42e5-b99f-9f77586e003a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: b11f87b9-987d-4c75-9a43-d654ab53de1f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:03.209687 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ab89fe61-2ab1-47a2-94a9-d1b0818a5c4f tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] 10.222.0.60 "GET /compute/v2.1/servers/ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d" status: 200 len: 1332 microversion: 2.1 time: 0.600617 Oct 18 15:34:03.214884 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23213616-bbe8-42e5-b99f-9f77586e003a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:03.215660 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23213616-bbe8-42e5-b99f-9f77586e003a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:03.216392 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23213616-bbe8-42e5-b99f-9f77586e003a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:03.217514 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23213616-bbe8-42e5-b99f-9f77586e003a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:03.218265 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23213616-bbe8-42e5-b99f-9f77586e003a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:03.218933 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23213616-bbe8-42e5-b99f-9f77586e003a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:03.231137 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1134/2159] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:02 2022] GET /compute/v2.1/servers/ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d => generated 1332 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:03.550050 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f7a3485a-afa2-4119-9a1b-a074a24a9e93 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:03.552772 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f7a3485a-afa2-4119-9a1b-a074a24a9e93 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] [instance: 5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:03.566258 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f7a3485a-afa2-4119-9a1b-a074a24a9e93 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:03.567223 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f7a3485a-afa2-4119-9a1b-a074a24a9e93 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:03.567913 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f7a3485a-afa2-4119-9a1b-a074a24a9e93 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:03.568907 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f7a3485a-afa2-4119-9a1b-a074a24a9e93 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:03.569561 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f7a3485a-afa2-4119-9a1b-a074a24a9e93 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:03.570240 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f7a3485a-afa2-4119-9a1b-a074a24a9e93 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:03.645205 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-23213616-bbe8-42e5-b99f-9f77586e003a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:03.651843 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:34:03.659944 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-23213616-bbe8-42e5-b99f-9f77586e003a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:03.665050 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-23213616-bbe8-42e5-b99f-9f77586e003a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51490cfdebda47a7b8349677e4d61a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0579704a194ef89144af0973d68f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:03.667148 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-23213616-bbe8-42e5-b99f-9f77586e003a tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/b11f87b9-987d-4c75-9a43-d654ab53de1f" status: 200 len: 1347 microversion: 2.25 time: 0.468484 Oct 18 15:34:03.677365 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1026/2160] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:34:03 2022] GET /compute/v2.1/servers/b11f87b9-987d-4c75-9a43-d654ab53de1f => generated 1347 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:34:03.683611 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b6048596-2c59-4eaf-a6ba-fd6d3482aa13 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c3cdbea60>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:03.780228 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b6048596-2c59-4eaf-a6ba-fd6d3482aa13 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7" status: 200 len: 1454 microversion: 2.1 time: 0.101764 Oct 18 15:34:03.780889 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1027/2161] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:34:03 2022] GET /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7 => generated 1454 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:03.973949 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f7a3485a-afa2-4119-9a1b-a074a24a9e93 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8769f6ac73af4d8589d9e94175259031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c561322de64f83a8c90d1bdcc833ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:03.984941 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f7a3485a-afa2-4119-9a1b-a074a24a9e93 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] 10.222.0.60 "GET /compute/v2.1/servers/5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e" status: 200 len: 1371 microversion: 2.1 time: 0.444124 Oct 18 15:34:03.986744 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1135/2162] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:03 2022] GET /compute/v2.1/servers/5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e => generated 1371 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:04.247991 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-514ae4bd-dd24-4556-b447-a26ccc4ce862 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:04.249644 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-514ae4bd-dd24-4556-b447-a26ccc4ce862 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] [instance: ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:04.268641 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-514ae4bd-dd24-4556-b447-a26ccc4ce862 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:04.271013 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-514ae4bd-dd24-4556-b447-a26ccc4ce862 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:04.272371 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-514ae4bd-dd24-4556-b447-a26ccc4ce862 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:04.274272 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-514ae4bd-dd24-4556-b447-a26ccc4ce862 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:04.274986 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-514ae4bd-dd24-4556-b447-a26ccc4ce862 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:04.275894 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-514ae4bd-dd24-4556-b447-a26ccc4ce862 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:04.715973 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-cfb971d2-f7de-4ae6-bdce-9d679e305813 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:04.722782 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-cfb971d2-f7de-4ae6-bdce-9d679e305813 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] [instance: b11f87b9-987d-4c75-9a43-d654ab53de1f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:04.763576 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cfb971d2-f7de-4ae6-bdce-9d679e305813 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:04.767658 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cfb971d2-f7de-4ae6-bdce-9d679e305813 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:04.770540 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cfb971d2-f7de-4ae6-bdce-9d679e305813 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:04.775479 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cfb971d2-f7de-4ae6-bdce-9d679e305813 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:04.777770 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cfb971d2-f7de-4ae6-bdce-9d679e305813 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:04.780646 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cfb971d2-f7de-4ae6-bdce-9d679e305813 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:04.849200 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-cfb971d2-f7de-4ae6-bdce-9d679e305813 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] HTTP exception thrown: Instance b11f87b9-987d-4c75-9a43-d654ab53de1f could not be found. Oct 18 15:34:04.855442 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-cfb971d2-f7de-4ae6-bdce-9d679e305813 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Request method failure captured: Oct 18 15:34:04.855442 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/b11f87b9-987d-4c75-9a43-d654ab53de1f HTTP/1.1 Oct 18 15:34:04.855442 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:34:04.855442 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:34:04.855442 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:34:04.855442 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:34:04.855442 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:34:04.855442 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:34:04.855442 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:34:04.855442 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:34:04.855442 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsVMowNqcRzCbiV3A6e8SIjCJeRnkej20kweA224xsk5d92QvEKKiuxfBpg5T03lsjG64njsb3Q-4NtzUh69pfX_S9U13QfD6-OmtFRMH9s_Nc45BtT5FkYRFTQQqIJsdV-e7Bqk8VMneZg7cIELbZqBD10tEt8ncSh-_jdOaC21uLE Oct 18 15:34:04.855442 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:34:04.855442 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:34:04.855442 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:34:04.855442 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:34:04.855442 n-d-853682-5 devstack@n-api.service[120405]: X-Openstack-Nova-Api-Version: 2.25 Oct 18 15:34:04.855442 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:34:04.855442 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:34:04.855442 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: bb0579704a194ef89144af0973d68f42 Oct 18 15:34:04.855442 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1247661447 Oct 18 15:34:04.855442 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:34:04.855442 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:34:04.856903 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bb0579704a194ef89144af0973d68f42"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bb0579704a194ef89144af0973d68f42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/bb0579704a194ef89144af0973d68f42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_bb0579704a194ef89144af0973d68f42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:34:04.856903 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1247661447 Oct 18 15:34:04.856903 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: bb0579704a194ef89144af0973d68f42 Oct 18 15:34:04.856903 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1247661447 Oct 18 15:34:04.856903 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-LiveAutoBlockMigrationV225Test-1247661447-project Oct 18 15:34:04.856903 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:34:04.856903 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:34:04.856903 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 51490cfdebda47a7b8349677e4d61a59 Oct 18 15:34:04.856903 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1247661447-project Oct 18 15:34:04.856903 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:34:04.856903 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance b11f87b9-987d-4c75-9a43-d654ab53de1f could not be found. Oct 18 15:34:04.856903 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'b11f87b9-987d-4c75-9a43-d654ab53de1f'} Oct 18 15:34:04.857633 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:34:04.857633 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:04.857633 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:34:04.857633 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:34:04.857633 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:34:04.857633 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:34:04.857633 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:34:04.857633 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:34:04.857633 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:34:04.857633 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:34:04.857633 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b11f87b9-987d-4c75-9a43-d654ab53de1f could not be found. Oct 18 15:34:04.857633 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:04.857633 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:34:04.857633 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:04.857633 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:04.857633 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:34:04.857633 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:34:04.857633 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:34:04.857633 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:34:04.857633 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:34:04.858793 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:34:04.858793 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:34:04.858793 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:34:04.858793 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:34:04.858793 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:34:04.858793 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:34:04.858793 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:34:04.858793 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b11f87b9-987d-4c75-9a43-d654ab53de1f could not be found. Oct 18 15:34:04.858793 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:04.858793 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:34:04.858793 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:04.858793 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:04.858793 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:34:04.858793 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:34:04.858793 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:34:04.858793 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:34:04.858793 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b11f87b9-987d-4c75-9a43-d654ab53de1f could not be found. Oct 18 15:34:04.858793 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:04.861757 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-cfb971d2-f7de-4ae6-bdce-9d679e305813 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] Returning 404 to user: Instance b11f87b9-987d-4c75-9a43-d654ab53de1f could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:34:04.862908 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-cfb971d2-f7de-4ae6-bdce-9d679e305813 tempest-LiveAutoBlockMigrationV225Test-1247661447 tempest-LiveAutoBlockMigrationV225Test-1247661447-project] 10.222.0.60 "GET /compute/v2.1/servers/b11f87b9-987d-4c75-9a43-d654ab53de1f" status: 404 len: 111 microversion: 2.25 time: 0.160109 Oct 18 15:34:04.864331 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1136/2163] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:34:04 2022] GET /compute/v2.1/servers/b11f87b9-987d-4c75-9a43-d654ab53de1f => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:34:04.887875 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0d833f55-f702-4d20-8f0a-a93d97ab9851 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c415bb700>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:05.023010 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0d833f55-f702-4d20-8f0a-a93d97ab9851 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7" status: 200 len: 1454 microversion: 2.1 time: 0.155067 Oct 18 15:34:05.023936 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1137/2164] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:34:04 2022] GET /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7 => generated 1454 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:05.030998 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-65f60da7-a749-4138-9294-d9285aebced0 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:05.037277 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-65f60da7-a749-4138-9294-d9285aebced0 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] [instance: 5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:05.058257 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-65f60da7-a749-4138-9294-d9285aebced0 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:05.065259 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-65f60da7-a749-4138-9294-d9285aebced0 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:05.067493 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-65f60da7-a749-4138-9294-d9285aebced0 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:05.069029 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-65f60da7-a749-4138-9294-d9285aebced0 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:05.069591 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-65f60da7-a749-4138-9294-d9285aebced0 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:05.070714 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-65f60da7-a749-4138-9294-d9285aebced0 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:05.779712 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-514ae4bd-dd24-4556-b447-a26ccc4ce862 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db93066933684d41a77863c156deb4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17eee1a6b8d43589bf66e6e18059021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:05.800902 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-514ae4bd-dd24-4556-b447-a26ccc4ce862 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] 10.222.0.60 "GET /compute/v2.1/servers/ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d" status: 200 len: 1667 microversion: 2.1 time: 1.566875 Oct 18 15:34:05.818911 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1028/2165] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:04 2022] GET /compute/v2.1/servers/ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d => generated 1667 bytes in 1585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:05.835056 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-c17b89d6-821e-4299-bfc1-dfa91ff8036c req-7cd3644d-2a3e-402b-8f68-4c476414f450 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e", "name": "network-vif-plugged", "status": "completed", "tag": "b9d918b6-52d1-43d5-8681-978c95391cfc"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:34:05.846970 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c17b89d6-821e-4299-bfc1-dfa91ff8036c req-7cd3644d-2a3e-402b-8f68-4c476414f450 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:05.847746 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c17b89d6-821e-4299-bfc1-dfa91ff8036c req-7cd3644d-2a3e-402b-8f68-4c476414f450 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:05.848309 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c17b89d6-821e-4299-bfc1-dfa91ff8036c req-7cd3644d-2a3e-402b-8f68-4c476414f450 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:05.868217 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-c17b89d6-821e-4299-bfc1-dfa91ff8036c req-7cd3644d-2a3e-402b-8f68-4c476414f450 service nova] Creating event network-vif-plugged:b9d918b6-52d1-43d5-8681-978c95391cfc for instance 5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e on n-h1-853682-5 Oct 18 15:34:05.905400 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-65f60da7-a749-4138-9294-d9285aebced0 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8769f6ac73af4d8589d9e94175259031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c561322de64f83a8c90d1bdcc833ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:05.927315 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-c17b89d6-821e-4299-bfc1-dfa91ff8036c req-7cd3644d-2a3e-402b-8f68-4c476414f450 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102324 Oct 18 15:34:05.939462 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1029/2166] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:34:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:34:05.941813 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-65f60da7-a749-4138-9294-d9285aebced0 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] 10.222.0.60 "GET /compute/v2.1/servers/5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e" status: 200 len: 1371 microversion: 2.1 time: 0.914403 Oct 18 15:34:05.957098 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1138/2167] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:05 2022] GET /compute/v2.1/servers/5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e => generated 1371 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:05.960753 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-53163b2a-ae84-4e1f-9db9-8dade3ef81f9 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:05.967727 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-53163b2a-ae84-4e1f-9db9-8dade3ef81f9 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] [instance: ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:05.990147 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-53163b2a-ae84-4e1f-9db9-8dade3ef81f9 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:05.991392 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-53163b2a-ae84-4e1f-9db9-8dade3ef81f9 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:05.993757 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-53163b2a-ae84-4e1f-9db9-8dade3ef81f9 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:05.994907 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-53163b2a-ae84-4e1f-9db9-8dade3ef81f9 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:05.995593 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-53163b2a-ae84-4e1f-9db9-8dade3ef81f9 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:05.997426 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-53163b2a-ae84-4e1f-9db9-8dade3ef81f9 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:06.093276 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c163ac9c-9aaf-4e87-9da9-58c97f462001 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c416f0430>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:06.094878 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-53163b2a-ae84-4e1f-9db9-8dade3ef81f9 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] 10.222.0.60 "GET /compute/v2.1/servers/ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d/ips" status: 200 len: 179 microversion: 2.1 time: 0.103241 Oct 18 15:34:06.094878 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1030/2168] 10.222.0.60 () {58 vars in 1248 bytes} [Tue Oct 18 15:34:05 2022] GET /compute/v2.1/servers/ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d/ips => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:34:06.101643 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-88ac5f01-2071-4899-8b67-4c359208a0ab tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:06.102362 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-88ac5f01-2071-4899-8b67-4c359208a0ab tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] [instance: ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:06.117169 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88ac5f01-2071-4899-8b67-4c359208a0ab tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:06.118041 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88ac5f01-2071-4899-8b67-4c359208a0ab tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:06.118637 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88ac5f01-2071-4899-8b67-4c359208a0ab tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:06.119561 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88ac5f01-2071-4899-8b67-4c359208a0ab tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:06.120168 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88ac5f01-2071-4899-8b67-4c359208a0ab tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:06.120746 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88ac5f01-2071-4899-8b67-4c359208a0ab tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:06.148713 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c163ac9c-9aaf-4e87-9da9-58c97f462001 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7" status: 200 len: 1454 microversion: 2.1 time: 0.112634 Oct 18 15:34:06.152265 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1139/2169] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:34:06 2022] GET /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7 => generated 1454 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:06.183165 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-88ac5f01-2071-4899-8b67-4c359208a0ab tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] [instance: ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:34:06.368329 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-88ac5f01-2071-4899-8b67-4c359208a0ab tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d" status: 204 len: 0 microversion: 2.1 time: 0.270168 Oct 18 15:34:06.370279 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1031/2170] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:34:06 2022] DELETE /compute/v2.1/servers/ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 15:34:06.379355 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e0bb1e56-47ab-40e1-95d1-8fe92411ee60 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:06.382307 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e0bb1e56-47ab-40e1-95d1-8fe92411ee60 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] [instance: ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:06.409430 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e0bb1e56-47ab-40e1-95d1-8fe92411ee60 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:06.412263 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e0bb1e56-47ab-40e1-95d1-8fe92411ee60 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:06.414500 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e0bb1e56-47ab-40e1-95d1-8fe92411ee60 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:06.416448 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e0bb1e56-47ab-40e1-95d1-8fe92411ee60 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:06.418696 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e0bb1e56-47ab-40e1-95d1-8fe92411ee60 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:06.423479 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e0bb1e56-47ab-40e1-95d1-8fe92411ee60 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:06.860908 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e0bb1e56-47ab-40e1-95d1-8fe92411ee60 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db93066933684d41a77863c156deb4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17eee1a6b8d43589bf66e6e18059021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:06.879520 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e0bb1e56-47ab-40e1-95d1-8fe92411ee60 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] 10.222.0.60 "GET /compute/v2.1/servers/ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d" status: 200 len: 1673 microversion: 2.1 time: 0.504005 Oct 18 15:34:06.896479 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1140/2171] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:06 2022] GET /compute/v2.1/servers/ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d => generated 1673 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:06.968152 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9f3dc05e-8b99-45c8-bdc9-d8917471f162 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:06.969321 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9f3dc05e-8b99-45c8-bdc9-d8917471f162 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] [instance: 5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:06.976970 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f3dc05e-8b99-45c8-bdc9-d8917471f162 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:06.977467 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f3dc05e-8b99-45c8-bdc9-d8917471f162 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:06.977909 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f3dc05e-8b99-45c8-bdc9-d8917471f162 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:06.978626 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f3dc05e-8b99-45c8-bdc9-d8917471f162 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:06.979725 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f3dc05e-8b99-45c8-bdc9-d8917471f162 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:06.980164 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f3dc05e-8b99-45c8-bdc9-d8917471f162 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:07.170814 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-62201746-5713-4cc1-8b81-a24db5569c18 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c41575820>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:07.274358 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-62201746-5713-4cc1-8b81-a24db5569c18 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7" status: 200 len: 1454 microversion: 2.1 time: 0.111043 Oct 18 15:34:07.278666 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1141/2172] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:34:07 2022] GET /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7 => generated 1454 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:07.418184 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5fd76feb-58d6-4f84-8e7e-6b22165f4b10 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:07.419162 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5fd76feb-58d6-4f84-8e7e-6b22165f4b10 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:07.450588 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5fd76feb-58d6-4f84-8e7e-6b22165f4b10 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:07.457111 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5fd76feb-58d6-4f84-8e7e-6b22165f4b10 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:07.457879 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5fd76feb-58d6-4f84-8e7e-6b22165f4b10 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:07.458769 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5fd76feb-58d6-4f84-8e7e-6b22165f4b10 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:07.459339 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5fd76feb-58d6-4f84-8e7e-6b22165f4b10 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:07.460055 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5fd76feb-58d6-4f84-8e7e-6b22165f4b10 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:07.498399 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-5fd76feb-58d6-4f84-8e7e-6b22165f4b10 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] HTTP exception thrown: Instance 23bdadc4-6faa-4e55-8daf-eef04dd34a8a could not be found. Oct 18 15:34:07.506329 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5fd76feb-58d6-4f84-8e7e-6b22165f4b10 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Request method failure captured: Oct 18 15:34:07.506329 n-d-853682-5 devstack@n-api.service[120405]: request: DELETE /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a HTTP/1.1 Oct 18 15:34:07.506329 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:34:07.506329 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:34:07.506329 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:34:07.506329 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:34:07.506329 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:34:07.506329 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:34:07.506329 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:34:07.506329 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:34:07.506329 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsXofW8_4N228buLP9UGSZfdfPfzDbauc4AJgXIRPWPJQvgd4SJqZQXDLWbeNeeKZB57naYqLKJvUILo2YhJHqk4ZGAS7Rv5kYN1n86LIScokjHTs1LDxQf5Dk-RLGo8pRpkGRchLP1dqueUlChrcn3OqK_id7GGCtPczXNixMcczCY Oct 18 15:34:07.506329 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:34:07.506329 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:34:07.506329 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:34:07.506329 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:34:07.506329 n-d-853682-5 devstack@n-api.service[120405]: X-Openstack-Nova-Api-Version: 2.42 Oct 18 15:34:07.506329 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:34:07.506329 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:34:07.506329 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: ac3cdc1276f14660a6fc8101364d2a35 Oct 18 15:34:07.506329 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-406219374 Oct 18 15:34:07.506329 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:34:07.506329 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:34:07.507482 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ac3cdc1276f14660a6fc8101364d2a35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ac3cdc1276f14660a6fc8101364d2a35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ac3cdc1276f14660a6fc8101364d2a35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ac3cdc1276f14660a6fc8101364d2a35"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:34:07.507482 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-TaggedBootDevicesTest_v242-406219374 Oct 18 15:34:07.507482 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: ac3cdc1276f14660a6fc8101364d2a35 Oct 18 15:34:07.507482 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-406219374 Oct 18 15:34:07.507482 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-TaggedBootDevicesTest_v242-406219374-project Oct 18 15:34:07.507482 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:34:07.507482 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:34:07.507482 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 8f10b8a9983f41e8b30183dcafbdce1d Oct 18 15:34:07.507482 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-TaggedBootDevicesTest_v242-406219374-project Oct 18 15:34:07.507482 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:34:07.507482 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 23bdadc4-6faa-4e55-8daf-eef04dd34a8a could not be found. Oct 18 15:34:07.507482 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '23bdadc4-6faa-4e55-8daf-eef04dd34a8a'} Oct 18 15:34:07.508134 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:34:07.508134 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:07.508134 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:34:07.508134 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:34:07.508134 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:34:07.508134 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:34:07.508134 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:34:07.508134 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:34:07.508134 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:34:07.508134 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:34:07.508134 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23bdadc4-6faa-4e55-8daf-eef04dd34a8a could not be found. Oct 18 15:34:07.508134 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:07.508134 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:34:07.508134 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:07.508134 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:07.508134 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:34:07.508134 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:34:07.508134 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:34:07.508134 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:34:07.508134 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:34:07.509150 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:34:07.509150 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 15:34:07.509150 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 15:34:07.509150 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 15:34:07.509150 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 15:34:07.509150 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:34:07.509150 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:34:07.509150 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:34:07.509150 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:34:07.509150 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23bdadc4-6faa-4e55-8daf-eef04dd34a8a could not be found. Oct 18 15:34:07.509150 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:07.509150 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:34:07.509150 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:07.509150 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:07.509150 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:34:07.509150 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:34:07.509150 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:34:07.509150 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:34:07.509150 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23bdadc4-6faa-4e55-8daf-eef04dd34a8a could not be found. Oct 18 15:34:07.509150 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:07.511097 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5fd76feb-58d6-4f84-8e7e-6b22165f4b10 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Returning 404 to user: Instance 23bdadc4-6faa-4e55-8daf-eef04dd34a8a could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:34:07.512227 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5fd76feb-58d6-4f84-8e7e-6b22165f4b10 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "DELETE /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 404 len: 111 microversion: 2.42 time: 0.102696 Oct 18 15:34:07.516331 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1142/2173] 10.222.0.60 () {60 vars in 1280 bytes} [Tue Oct 18 15:34:07 2022] DELETE /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 18 15:34:07.529565 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-74b5ffd9-a08b-43da-af09-19a446b1c4f5 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:07.530631 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-74b5ffd9-a08b-43da-af09-19a446b1c4f5 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] [instance: 23bdadc4-6faa-4e55-8daf-eef04dd34a8a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:07.544859 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-74b5ffd9-a08b-43da-af09-19a446b1c4f5 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:07.545579 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-74b5ffd9-a08b-43da-af09-19a446b1c4f5 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:07.546171 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-74b5ffd9-a08b-43da-af09-19a446b1c4f5 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:07.547047 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-74b5ffd9-a08b-43da-af09-19a446b1c4f5 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:07.547693 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-74b5ffd9-a08b-43da-af09-19a446b1c4f5 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:07.548291 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-74b5ffd9-a08b-43da-af09-19a446b1c4f5 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:07.583448 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-74b5ffd9-a08b-43da-af09-19a446b1c4f5 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] HTTP exception thrown: Instance 23bdadc4-6faa-4e55-8daf-eef04dd34a8a could not be found. Oct 18 15:34:07.585703 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-74b5ffd9-a08b-43da-af09-19a446b1c4f5 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Request method failure captured: Oct 18 15:34:07.585703 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a HTTP/1.1 Oct 18 15:34:07.585703 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:34:07.585703 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:34:07.585703 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:34:07.585703 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:34:07.585703 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:34:07.585703 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:34:07.585703 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:34:07.585703 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:34:07.585703 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsXofW8_4N228buLP9UGSZfdfPfzDbauc4AJgXIRPWPJQvgd4SJqZQXDLWbeNeeKZB57naYqLKJvUILo2YhJHqk4ZGAS7Rv5kYN1n86LIScokjHTs1LDxQf5Dk-RLGo8pRpkGRchLP1dqueUlChrcn3OqK_id7GGCtPczXNixMcczCY Oct 18 15:34:07.585703 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:34:07.585703 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:34:07.585703 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:34:07.585703 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:34:07.585703 n-d-853682-5 devstack@n-api.service[120405]: X-Openstack-Nova-Api-Version: 2.42 Oct 18 15:34:07.585703 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:34:07.585703 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:34:07.585703 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: ac3cdc1276f14660a6fc8101364d2a35 Oct 18 15:34:07.585703 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-406219374 Oct 18 15:34:07.585703 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:34:07.585703 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:34:07.586869 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ac3cdc1276f14660a6fc8101364d2a35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ac3cdc1276f14660a6fc8101364d2a35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ac3cdc1276f14660a6fc8101364d2a35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ac3cdc1276f14660a6fc8101364d2a35"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:34:07.586869 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-TaggedBootDevicesTest_v242-406219374 Oct 18 15:34:07.586869 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: ac3cdc1276f14660a6fc8101364d2a35 Oct 18 15:34:07.586869 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-406219374 Oct 18 15:34:07.586869 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-TaggedBootDevicesTest_v242-406219374-project Oct 18 15:34:07.586869 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:34:07.586869 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:34:07.586869 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 8f10b8a9983f41e8b30183dcafbdce1d Oct 18 15:34:07.586869 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-TaggedBootDevicesTest_v242-406219374-project Oct 18 15:34:07.586869 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:34:07.586869 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 23bdadc4-6faa-4e55-8daf-eef04dd34a8a could not be found. Oct 18 15:34:07.586869 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '23bdadc4-6faa-4e55-8daf-eef04dd34a8a'} Oct 18 15:34:07.587495 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:34:07.587495 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:07.587495 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:34:07.587495 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:34:07.587495 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:34:07.587495 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:34:07.587495 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:34:07.587495 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:34:07.587495 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:34:07.587495 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:34:07.587495 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23bdadc4-6faa-4e55-8daf-eef04dd34a8a could not be found. Oct 18 15:34:07.587495 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:07.587495 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:34:07.587495 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:07.587495 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:07.587495 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:34:07.587495 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:34:07.587495 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:34:07.587495 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:34:07.587495 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:34:07.589081 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:34:07.589081 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:34:07.589081 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:34:07.589081 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:34:07.589081 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:34:07.589081 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:34:07.589081 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:34:07.589081 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23bdadc4-6faa-4e55-8daf-eef04dd34a8a could not be found. Oct 18 15:34:07.589081 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:07.589081 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:34:07.589081 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:07.589081 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:07.589081 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:34:07.589081 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:34:07.589081 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:34:07.589081 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:34:07.589081 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23bdadc4-6faa-4e55-8daf-eef04dd34a8a could not be found. Oct 18 15:34:07.589081 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:07.594202 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-74b5ffd9-a08b-43da-af09-19a446b1c4f5 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] Returning 404 to user: Instance 23bdadc4-6faa-4e55-8daf-eef04dd34a8a could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:34:07.595625 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-74b5ffd9-a08b-43da-af09-19a446b1c4f5 tempest-TaggedBootDevicesTest_v242-406219374 tempest-TaggedBootDevicesTest_v242-406219374-project] 10.222.0.60 "GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a" status: 404 len: 111 microversion: 2.42 time: 0.077965 Oct 18 15:34:07.599835 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1143/2174] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:34:07 2022] GET /compute/v2.1/servers/23bdadc4-6faa-4e55-8daf-eef04dd34a8a => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:34:07.915603 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f5f4cced-3f7f-4b41-b6c4-f790f9dbc9e3 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:07.916501 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f5f4cced-3f7f-4b41-b6c4-f790f9dbc9e3 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] [instance: ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:07.926703 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f5f4cced-3f7f-4b41-b6c4-f790f9dbc9e3 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:07.929962 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f5f4cced-3f7f-4b41-b6c4-f790f9dbc9e3 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:07.930555 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f5f4cced-3f7f-4b41-b6c4-f790f9dbc9e3 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:07.941956 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f5f4cced-3f7f-4b41-b6c4-f790f9dbc9e3 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:07.946133 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f5f4cced-3f7f-4b41-b6c4-f790f9dbc9e3 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:07.950341 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f5f4cced-3f7f-4b41-b6c4-f790f9dbc9e3 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:07.955788 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9f3dc05e-8b99-45c8-bdc9-d8917471f162 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8769f6ac73af4d8589d9e94175259031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c561322de64f83a8c90d1bdcc833ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:07.967897 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9f3dc05e-8b99-45c8-bdc9-d8917471f162 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] 10.222.0.60 "GET /compute/v2.1/servers/5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e" status: 200 len: 1371 microversion: 2.1 time: 1.003726 Oct 18 15:34:07.969163 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1032/2175] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:06 2022] GET /compute/v2.1/servers/5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e => generated 1371 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:08.291683 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9db1133a-95eb-45e9-b826-96ac99075a17 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c3cf5aca0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:08.363901 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f5f4cced-3f7f-4b41-b6c4-f790f9dbc9e3 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db93066933684d41a77863c156deb4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17eee1a6b8d43589bf66e6e18059021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:08.372693 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9db1133a-95eb-45e9-b826-96ac99075a17 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7" status: 200 len: 1454 microversion: 2.1 time: 0.084858 Oct 18 15:34:08.374628 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1033/2176] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:34:08 2022] GET /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7 => generated 1454 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:34:08.384745 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f5f4cced-3f7f-4b41-b6c4-f790f9dbc9e3 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] 10.222.0.60 "GET /compute/v2.1/servers/ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d" status: 200 len: 1673 microversion: 2.1 time: 0.472405 Oct 18 15:34:08.396155 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1144/2177] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:07 2022] GET /compute/v2.1/servers/ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d => generated 1673 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:08.999806 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5c162599-5241-415d-9e66-07dfd4614eb3 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:09.001181 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5c162599-5241-415d-9e66-07dfd4614eb3 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] [instance: 5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:09.006912 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:34:09.015329 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c162599-5241-415d-9e66-07dfd4614eb3 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:09.016553 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c162599-5241-415d-9e66-07dfd4614eb3 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:09.017169 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c162599-5241-415d-9e66-07dfd4614eb3 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:09.018028 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c162599-5241-415d-9e66-07dfd4614eb3 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:09.018631 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c162599-5241-415d-9e66-07dfd4614eb3 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:09.019201 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c162599-5241-415d-9e66-07dfd4614eb3 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:09.339590 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5c162599-5241-415d-9e66-07dfd4614eb3 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8769f6ac73af4d8589d9e94175259031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c561322de64f83a8c90d1bdcc833ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:09.348188 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5c162599-5241-415d-9e66-07dfd4614eb3 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] 10.222.0.60 "GET /compute/v2.1/servers/5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e" status: 200 len: 1558 microversion: 2.1 time: 0.353629 Oct 18 15:34:09.348778 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1034/2178] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:08 2022] GET /compute/v2.1/servers/5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e => generated 1558 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:09.380685 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-42cbb5cb-3a68-4280-b684-1d2d3fa52d5e tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:09.382022 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-42cbb5cb-3a68-4280-b684-1d2d3fa52d5e tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] [instance: 5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:09.391296 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-37291a0f-b32d-49ec-868c-67eeb5c6998e tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c3cf5e940>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:09.418525 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-42cbb5cb-3a68-4280-b684-1d2d3fa52d5e tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:09.422016 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-42cbb5cb-3a68-4280-b684-1d2d3fa52d5e tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:09.424796 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-42cbb5cb-3a68-4280-b684-1d2d3fa52d5e tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:09.431565 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-42cbb5cb-3a68-4280-b684-1d2d3fa52d5e tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:09.433797 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-42cbb5cb-3a68-4280-b684-1d2d3fa52d5e tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:09.434426 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-42cbb5cb-3a68-4280-b684-1d2d3fa52d5e tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:09.503384 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-37291a0f-b32d-49ec-868c-67eeb5c6998e tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7" status: 200 len: 1454 microversion: 2.1 time: 0.118050 Oct 18 15:34:09.504227 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1035/2179] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:34:09 2022] GET /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7 => generated 1454 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:09.520363 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f727f942-11d8-4d18-bbae-9f0d07feedfb tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:09.521263 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f727f942-11d8-4d18-bbae-9f0d07feedfb tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] [instance: ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:09.546389 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f727f942-11d8-4d18-bbae-9f0d07feedfb tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:09.554862 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f727f942-11d8-4d18-bbae-9f0d07feedfb tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:09.555326 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f727f942-11d8-4d18-bbae-9f0d07feedfb tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:09.560764 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f727f942-11d8-4d18-bbae-9f0d07feedfb tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:09.567143 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f727f942-11d8-4d18-bbae-9f0d07feedfb tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:09.573945 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f727f942-11d8-4d18-bbae-9f0d07feedfb tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:09.670429 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-42cbb5cb-3a68-4280-b684-1d2d3fa52d5e tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] 10.222.0.60 "GET /compute/v2.1/servers/5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.296377 Oct 18 15:34:09.671015 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1145/2180] 10.222.0.60 () {58 vars in 1275 bytes} [Tue Oct 18 15:34:09 2022] GET /compute/v2.1/servers/5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e/os-interface => generated 285 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:34:10.332269 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f727f942-11d8-4d18-bbae-9f0d07feedfb tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db93066933684d41a77863c156deb4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17eee1a6b8d43589bf66e6e18059021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:10.357650 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f727f942-11d8-4d18-bbae-9f0d07feedfb tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] 10.222.0.60 "GET /compute/v2.1/servers/ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d" status: 200 len: 1673 microversion: 2.1 time: 0.850808 Oct 18 15:34:10.358471 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1036/2181] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:09 2022] GET /compute/v2.1/servers/ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d => generated 1673 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:10.519415 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4cc64c1c-6ce3-4107-8d6e-e63eec6f2975 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c415f5310>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:10.534620 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:34:10.577705 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=8 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:34:10.628172 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4cc64c1c-6ce3-4107-8d6e-e63eec6f2975 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7" status: 200 len: 1454 microversion: 2.1 time: 0.112427 Oct 18 15:34:10.636738 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1146/2182] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:34:10 2022] GET /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7 => generated 1454 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:11.388574 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-55587c59-9ae8-4799-8123-b11b1173f611 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:11.389412 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-55587c59-9ae8-4799-8123-b11b1173f611 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] [instance: ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:11.420406 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55587c59-9ae8-4799-8123-b11b1173f611 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:11.423565 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55587c59-9ae8-4799-8123-b11b1173f611 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:11.426713 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55587c59-9ae8-4799-8123-b11b1173f611 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:11.430157 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55587c59-9ae8-4799-8123-b11b1173f611 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:11.431228 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55587c59-9ae8-4799-8123-b11b1173f611 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:11.432846 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55587c59-9ae8-4799-8123-b11b1173f611 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:11.644110 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-330bf6da-08fb-4370-99f7-669c5014843b tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c3d6f9c10>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:11.733142 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-330bf6da-08fb-4370-99f7-669c5014843b tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7" status: 200 len: 1454 microversion: 2.1 time: 0.093473 Oct 18 15:34:11.738109 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-55587c59-9ae8-4799-8123-b11b1173f611 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db93066933684d41a77863c156deb4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17eee1a6b8d43589bf66e6e18059021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:11.739150 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1147/2183] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:34:11 2022] GET /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7 => generated 1454 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:34:11.752948 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-55587c59-9ae8-4799-8123-b11b1173f611 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] 10.222.0.60 "GET /compute/v2.1/servers/ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d" status: 200 len: 1673 microversion: 2.1 time: 0.368760 Oct 18 15:34:11.754206 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1037/2184] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:11 2022] GET /compute/v2.1/servers/ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d => generated 1673 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:12.332348 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5e583211-40ee-452c-9d4c-8e7464d60476 tempest-QuotasAdminNegativeTest-1773909701 tempest-QuotasAdminNegativeTest-1773909701-project-admin] Calling method '.version_select at 0x7f7c415f5310>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:12.556150 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5e583211-40ee-452c-9d4c-8e7464d60476 tempest-QuotasAdminNegativeTest-1773909701 tempest-QuotasAdminNegativeTest-1773909701-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/513dcb2cc0c24b39af4790735163e300" status: 200 len: 371 microversion: 2.1 time: 0.511935 Oct 18 15:34:12.571983 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1148/2185] 10.222.0.60 () {58 vars in 1242 bytes} [Tue Oct 18 15:34:12 2022] GET /compute/v2.1/os-quota-sets/513dcb2cc0c24b39af4790735163e300 => generated 371 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:34:12.584752 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5e65bc37-4336-44d6-b022-e8604e2b4279 tempest-QuotasAdminNegativeTest-1773909701 tempest-QuotasAdminNegativeTest-1773909701-project-admin] Action: 'update', calling method: .version_select at 0x7f7c3cf5e940>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:34:12.622163 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=7 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:34:12.635971 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-7f0bd1fe-df3d-46f1-8d0b-e5bb77bf9f6b req-47f393ca-d259-4005-9a38-a7c16ddd2c49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d", "name": "network-vif-unplugged", "status": "completed", "tag": "cec6b302-e9b5-409c-aae1-792a43821281"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:34:12.701447 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-7f0bd1fe-df3d-46f1-8d0b-e5bb77bf9f6b req-47f393ca-d259-4005-9a38-a7c16ddd2c49 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:12.702074 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-7f0bd1fe-df3d-46f1-8d0b-e5bb77bf9f6b req-47f393ca-d259-4005-9a38-a7c16ddd2c49 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:12.702357 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-7f0bd1fe-df3d-46f1-8d0b-e5bb77bf9f6b req-47f393ca-d259-4005-9a38-a7c16ddd2c49 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:12.732757 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-7f0bd1fe-df3d-46f1-8d0b-e5bb77bf9f6b req-47f393ca-d259-4005-9a38-a7c16ddd2c49 service nova] Creating event network-vif-unplugged:cec6b302-e9b5-409c-aae1-792a43821281 for instance ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d on n-h2-853682-5 Oct 18 15:34:12.742870 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-7f0bd1fe-df3d-46f1-8d0b-e5bb77bf9f6b req-47f393ca-d259-4005-9a38-a7c16ddd2c49 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.111281 Oct 18 15:34:12.746212 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1149/2186] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:34:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:34:12.763305 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-555b7fa9-f17c-416c-a7fd-bfe3e8abefa2 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c41640550>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:12.774438 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=18 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:34:12.839286 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e65bc37-4336-44d6-b022-e8604e2b4279 tempest-QuotasAdminNegativeTest-1773909701 tempest-QuotasAdminNegativeTest-1773909701-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:12.845646 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e65bc37-4336-44d6-b022-e8604e2b4279 tempest-QuotasAdminNegativeTest-1773909701 tempest-QuotasAdminNegativeTest-1773909701-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:12.846315 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e65bc37-4336-44d6-b022-e8604e2b4279 tempest-QuotasAdminNegativeTest-1773909701 tempest-QuotasAdminNegativeTest-1773909701-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:12.847275 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e65bc37-4336-44d6-b022-e8604e2b4279 tempest-QuotasAdminNegativeTest-1773909701 tempest-QuotasAdminNegativeTest-1773909701-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:12.849515 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e65bc37-4336-44d6-b022-e8604e2b4279 tempest-QuotasAdminNegativeTest-1773909701 tempest-QuotasAdminNegativeTest-1773909701-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:12.850285 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e65bc37-4336-44d6-b022-e8604e2b4279 tempest-QuotasAdminNegativeTest-1773909701 tempest-QuotasAdminNegativeTest-1773909701-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:12.925501 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-555b7fa9-f17c-416c-a7fd-bfe3e8abefa2 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7" status: 200 len: 1454 microversion: 2.1 time: 0.171139 Oct 18 15:34:12.926944 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1150/2187] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:34:12 2022] GET /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7 => generated 1454 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:12.933785 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-46fba603-c6f3-401a-9394-09b8f7018618 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:12.934835 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-46fba603-c6f3-401a-9394-09b8f7018618 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] [instance: ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:12.977935 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-46fba603-c6f3-401a-9394-09b8f7018618 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:12.982786 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-46fba603-c6f3-401a-9394-09b8f7018618 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:12.984216 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-46fba603-c6f3-401a-9394-09b8f7018618 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:12.985584 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-46fba603-c6f3-401a-9394-09b8f7018618 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:12.987778 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-46fba603-c6f3-401a-9394-09b8f7018618 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:12.989978 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-46fba603-c6f3-401a-9394-09b8f7018618 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:13.004352 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:34:13.032903 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5e65bc37-4336-44d6-b022-e8604e2b4279 tempest-QuotasAdminNegativeTest-1773909701 tempest-QuotasAdminNegativeTest-1773909701-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/513dcb2cc0c24b39af4790735163e300" status: 200 len: 328 microversion: 2.1 time: 0.451872 Oct 18 15:34:13.033546 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1038/2188] 10.222.0.60 () {60 vars in 1262 bytes} [Tue Oct 18 15:34:12 2022] PUT /compute/v2.1/os-quota-sets/513dcb2cc0c24b39af4790735163e300 => generated 328 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:34:13.054532 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-5ba4b765-4fa1-4b45-8d58-5a241d61cc8e req-692b5113-1bfe-4352-a653-afd1d0e9116d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d", "name": "network-vif-deleted", "tag": "c0f09542-868c-4fec-a8f3-195e5159d9eb"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:34:13.096635 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5ba4b765-4fa1-4b45-8d58-5a241d61cc8e req-692b5113-1bfe-4352-a653-afd1d0e9116d service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:13.102138 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5ba4b765-4fa1-4b45-8d58-5a241d61cc8e req-692b5113-1bfe-4352-a653-afd1d0e9116d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:13.102727 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5ba4b765-4fa1-4b45-8d58-5a241d61cc8e req-692b5113-1bfe-4352-a653-afd1d0e9116d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:13.122295 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-5ba4b765-4fa1-4b45-8d58-5a241d61cc8e req-692b5113-1bfe-4352-a653-afd1d0e9116d service nova] Creating event network-vif-deleted:c0f09542-868c-4fec-a8f3-195e5159d9eb for instance ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d on n-h2-853682-5 Oct 18 15:34:13.138782 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-5ba4b765-4fa1-4b45-8d58-5a241d61cc8e req-692b5113-1bfe-4352-a653-afd1d0e9116d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098448 Oct 18 15:34:13.140673 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1039/2189] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:34:13.346448 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-46fba603-c6f3-401a-9394-09b8f7018618 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db93066933684d41a77863c156deb4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17eee1a6b8d43589bf66e6e18059021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:13.361651 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-46fba603-c6f3-401a-9394-09b8f7018618 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] 10.222.0.60 "GET /compute/v2.1/servers/ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d" status: 200 len: 1652 microversion: 2.1 time: 0.431904 Oct 18 15:34:13.376844 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1151/2190] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:12 2022] GET /compute/v2.1/servers/ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d => generated 1652 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:13.403173 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-16f809a4-19e9-451e-aff9-e5676613c93d tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2078454297", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:34:13.543256 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-16f809a4-19e9-451e-aff9-e5676613c93d tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] validate_networks() for None {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:34:13.768031 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-6c180881-bacf-42be-9a07-38fbafa9606c req-673febc2-2766-4f19-a7f1-e76b2c45c962 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e", "tag": "b9d918b6-52d1-43d5-8681-978c95391cfc"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:34:13.789956 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-6c180881-bacf-42be-9a07-38fbafa9606c req-673febc2-2766-4f19-a7f1-e76b2c45c962 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:13.790452 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-6c180881-bacf-42be-9a07-38fbafa9606c req-673febc2-2766-4f19-a7f1-e76b2c45c962 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:13.792296 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-6c180881-bacf-42be-9a07-38fbafa9606c req-673febc2-2766-4f19-a7f1-e76b2c45c962 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:13.827927 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-6c180881-bacf-42be-9a07-38fbafa9606c req-673febc2-2766-4f19-a7f1-e76b2c45c962 service nova] Creating event network-changed:b9d918b6-52d1-43d5-8681-978c95391cfc for instance 5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e on n-h1-853682-5 Oct 18 15:34:13.845623 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-6c180881-bacf-42be-9a07-38fbafa9606c req-673febc2-2766-4f19-a7f1-e76b2c45c962 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081499 Oct 18 15:34:13.847916 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1152/2191] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:34:13.943349 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8e68494a-d4f7-4ebe-882b-086b5d24e791 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c41640550>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:14.046334 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8e68494a-d4f7-4ebe-882b-086b5d24e791 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7" status: 200 len: 1454 microversion: 2.1 time: 0.107245 Oct 18 15:34:14.048226 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1153/2192] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:34:13 2022] GET /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7 => generated 1454 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:34:14.394932 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3af354e8-73d6-4d71-80e7-87045cff88c8 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:14.395493 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3af354e8-73d6-4d71-80e7-87045cff88c8 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] [instance: ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:14.421021 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3af354e8-73d6-4d71-80e7-87045cff88c8 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:14.421571 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3af354e8-73d6-4d71-80e7-87045cff88c8 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:14.422034 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3af354e8-73d6-4d71-80e7-87045cff88c8 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:14.422822 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3af354e8-73d6-4d71-80e7-87045cff88c8 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:14.423414 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3af354e8-73d6-4d71-80e7-87045cff88c8 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:14.427896 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3af354e8-73d6-4d71-80e7-87045cff88c8 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:14.451603 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-16f809a4-19e9-451e-aff9-e5676613c93d tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:34:14.453167 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-16f809a4-19e9-451e-aff9-e5676613c93d tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:34:14.454200 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-16f809a4-19e9-451e-aff9-e5676613c93d tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:34:14.459470 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-16f809a4-19e9-451e-aff9-e5676613c93d tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:34:14.461549 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-16f809a4-19e9-451e-aff9-e5676613c93d tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:34:14.492587 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16f809a4-19e9-451e-aff9-e5676613c93d tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:14.493616 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16f809a4-19e9-451e-aff9-e5676613c93d tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:14.494277 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16f809a4-19e9-451e-aff9-e5676613c93d tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:14.498079 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16f809a4-19e9-451e-aff9-e5676613c93d tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:14.499062 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16f809a4-19e9-451e-aff9-e5676613c93d tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:14.501720 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16f809a4-19e9-451e-aff9-e5676613c93d tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:14.548109 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-16f809a4-19e9-451e-aff9-e5676613c93d tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] Getting quotas for project 513dcb2cc0c24b39af4790735163e300. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:34:14.572249 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-16f809a4-19e9-451e-aff9-e5676613c93d tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] Getting quotas for user 29e02da9aa8a4c1f93c306fbe90d4752 and project 513dcb2cc0c24b39af4790735163e300. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:34:14.618791 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.utils [None req-16f809a4-19e9-451e-aff9-e5676613c93d tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] cores quota exceeded for 513dcb2cc0c24b39af4790735163e300, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120406) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 18 15:34:14.623146 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-16f809a4-19e9-451e-aff9-e5676613c93d tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 18 15:34:14.660526 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-16f809a4-19e9-451e-aff9-e5676613c93d tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] Request method failure captured: Oct 18 15:34:14.660526 n-d-853682-5 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 15:34:14.660526 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:34:14.660526 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:34:14.660526 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:34:14.660526 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 145 Oct 18 15:34:14.660526 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:34:14.660526 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:34:14.660526 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:34:14.660526 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:34:14.660526 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsdyGv2dFwvT9aofkWHslglH18yJ5lVarO_Q9hECLVMHakiOtJlhHwdxSEldFIS07mj-ansotLUFkJYdXIpMvA8EqXm9691pLSzB27ZIdD2-3bwxNZZrkYfsmxUmmXSZqJ9mIZoewBqJqwlqezu7BULVmI9b6Z5vPkE_wF1GtlZ4gs4 Oct 18 15:34:14.660526 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:34:14.660526 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:34:14.660526 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:34:14.660526 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:34:14.660526 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:34:14.660526 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:34:14.660526 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 513dcb2cc0c24b39af4790735163e300 Oct 18 15:34:14.660526 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-QuotasAdminNegativeTest-1878214098 Oct 18 15:34:14.660526 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:34:14.660526 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:34:14.661749 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/513dcb2cc0c24b39af4790735163e300"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/513dcb2cc0c24b39af4790735163e300"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/513dcb2cc0c24b39af4790735163e300"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_513dcb2cc0c24b39af4790735163e300"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:34:14.661749 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-QuotasAdminNegativeTest-1878214098 Oct 18 15:34:14.661749 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 513dcb2cc0c24b39af4790735163e300 Oct 18 15:34:14.661749 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1878214098 Oct 18 15:34:14.661749 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-QuotasAdminNegativeTest-1878214098-project Oct 18 15:34:14.661749 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:34:14.661749 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:34:14.661749 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 29e02da9aa8a4c1f93c306fbe90d4752 Oct 18 15:34:14.661749 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-QuotasAdminNegativeTest-1878214098-project Oct 18 15:34:14.661749 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:34:14.661749 n-d-853682-5 devstack@n-api.service[120406]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2078454297", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452"}} Oct 18 15:34:14.661749 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:34:14.662380 n-d-853682-5 devstack@n-api.service[120406]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 18 15:34:14.662380 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-2078454297', 'imageRef': '8f4db252-bff6-4685-9c8d-4c5d6bd9f78b', 'flavorRef': '452'}}} Oct 18 15:34:14.662380 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:34:14.662380 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:14.662380 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 18 15:34:14.662380 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 18 15:34:14.662380 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 15:34:14.662380 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 15:34:14.662380 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 18 15:34:14.662380 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc Oct 18 15:34:14.662380 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 18 15:34:14.662380 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 18 15:34:14.662380 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 15:34:14.662380 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 15:34:14.662380 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 18 15:34:14.662380 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 18 15:34:14.662380 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 18 15:34:14.662380 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 18 15:34:14.663467 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 18 15:34:14.663467 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 18 15:34:14.663467 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 18 15:34:14.663467 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:14.663467 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:34:14.663467 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:14.663467 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:14.663467 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 18 15:34:14.663467 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 18 15:34:14.663467 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 18 15:34:14.663467 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 18 15:34:14.663467 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 18 15:34:14.663467 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 18 15:34:14.663467 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 18 15:34:14.663467 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 18 15:34:14.663467 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 18 15:34:14.663467 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 18 15:34:14.663467 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 18 15:34:14.663467 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:14.663467 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:34:14.663467 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:14.664489 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:14.664489 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:34:14.664489 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:34:14.664489 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:34:14.664489 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:34:14.664489 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:34:14.664489 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:34:14.664489 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:34:14.664489 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:34:14.664489 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:34:14.664489 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:34:14.664489 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:34:14.664489 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:34:14.664489 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 18 15:34:14.664489 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 18 15:34:14.664489 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 18 15:34:14.664489 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 18 15:34:14.664489 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:14.664489 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:34:14.664489 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:14.664489 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:14.665583 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:34:14.665583 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:34:14.665583 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:34:14.665583 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:34:14.665583 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 18 15:34:14.665583 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:14.671602 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-16f809a4-19e9-451e-aff9-e5676613c93d tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:34:14.674348 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-16f809a4-19e9-451e-aff9-e5676613c93d tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.397635 Oct 18 15:34:14.675605 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1040/2193] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:34:13 2022] POST /compute/v2.1/servers => generated 111 bytes in 1401 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:34:14.710549 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8bbd476a-5adf-4876-91ae-f5429f550227 tempest-QuotasAdminNegativeTest-1773909701 tempest-QuotasAdminNegativeTest-1773909701-project-admin] Action: 'update', calling method: .version_select at 0x7f7c3cfa0820>, body: {"quota_set": {"cores": 20}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:34:14.882827 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8bbd476a-5adf-4876-91ae-f5429f550227 tempest-QuotasAdminNegativeTest-1773909701 tempest-QuotasAdminNegativeTest-1773909701-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:14.885879 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8bbd476a-5adf-4876-91ae-f5429f550227 tempest-QuotasAdminNegativeTest-1773909701 tempest-QuotasAdminNegativeTest-1773909701-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:14.887359 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8bbd476a-5adf-4876-91ae-f5429f550227 tempest-QuotasAdminNegativeTest-1773909701 tempest-QuotasAdminNegativeTest-1773909701-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:14.896575 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8bbd476a-5adf-4876-91ae-f5429f550227 tempest-QuotasAdminNegativeTest-1773909701 tempest-QuotasAdminNegativeTest-1773909701-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:14.897446 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8bbd476a-5adf-4876-91ae-f5429f550227 tempest-QuotasAdminNegativeTest-1773909701 tempest-QuotasAdminNegativeTest-1773909701-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:14.898211 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8bbd476a-5adf-4876-91ae-f5429f550227 tempest-QuotasAdminNegativeTest-1773909701 tempest-QuotasAdminNegativeTest-1773909701-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:15.175365 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8bbd476a-5adf-4876-91ae-f5429f550227 tempest-QuotasAdminNegativeTest-1773909701 tempest-QuotasAdminNegativeTest-1773909701-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/513dcb2cc0c24b39af4790735163e300" status: 200 len: 329 microversion: 2.1 time: 0.478522 Oct 18 15:34:15.194195 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1041/2194] 10.222.0.60 () {60 vars in 1262 bytes} [Tue Oct 18 15:34:14 2022] PUT /compute/v2.1/os-quota-sets/513dcb2cc0c24b39af4790735163e300 => generated 329 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:34:15.210913 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3bfc894d-73e4-4f6e-8960-28ccab8d3395 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c3cfa0b80>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:15.225808 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3af354e8-73d6-4d71-80e7-87045cff88c8 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db93066933684d41a77863c156deb4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17eee1a6b8d43589bf66e6e18059021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:15.241683 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3af354e8-73d6-4d71-80e7-87045cff88c8 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] 10.222.0.60 "GET /compute/v2.1/servers/ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d" status: 200 len: 1494 microversion: 2.1 time: 0.853766 Oct 18 15:34:15.243848 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1154/2195] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:14 2022] GET /compute/v2.1/servers/ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d => generated 1494 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:15.268612 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-88fadee8-bd32-4685-ab9d-45d80eb94ef8 tempest-QuotasAdminNegativeTest-1773909701 tempest-QuotasAdminNegativeTest-1773909701-project-admin] Calling method '.version_select at 0x7f7c415dbf70>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:15.329084 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3bfc894d-73e4-4f6e-8960-28ccab8d3395 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7" status: 200 len: 1454 microversion: 2.1 time: 0.133199 Oct 18 15:34:15.331274 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1042/2196] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:34:15 2022] GET /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7 => generated 1454 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:15.463739 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-88fadee8-bd32-4685-ab9d-45d80eb94ef8 tempest-QuotasAdminNegativeTest-1773909701 tempest-QuotasAdminNegativeTest-1773909701-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/513dcb2cc0c24b39af4790735163e300" status: 200 len: 371 microversion: 2.1 time: 0.203708 Oct 18 15:34:15.468277 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1155/2197] 10.222.0.60 () {58 vars in 1242 bytes} [Tue Oct 18 15:34:15 2022] GET /compute/v2.1/os-quota-sets/513dcb2cc0c24b39af4790735163e300 => generated 371 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:34:15.480444 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2be4a653-1a10-47b7-ae04-87f946cd3de5 tempest-QuotasAdminNegativeTest-1773909701 tempest-QuotasAdminNegativeTest-1773909701-project-admin] Action: 'update', calling method: .version_select at 0x7f7c3cf9d9d0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:34:15.681100 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2be4a653-1a10-47b7-ae04-87f946cd3de5 tempest-QuotasAdminNegativeTest-1773909701 tempest-QuotasAdminNegativeTest-1773909701-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:15.691250 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2be4a653-1a10-47b7-ae04-87f946cd3de5 tempest-QuotasAdminNegativeTest-1773909701 tempest-QuotasAdminNegativeTest-1773909701-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:15.699621 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2be4a653-1a10-47b7-ae04-87f946cd3de5 tempest-QuotasAdminNegativeTest-1773909701 tempest-QuotasAdminNegativeTest-1773909701-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:15.701218 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2be4a653-1a10-47b7-ae04-87f946cd3de5 tempest-QuotasAdminNegativeTest-1773909701 tempest-QuotasAdminNegativeTest-1773909701-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:15.701714 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2be4a653-1a10-47b7-ae04-87f946cd3de5 tempest-QuotasAdminNegativeTest-1773909701 tempest-QuotasAdminNegativeTest-1773909701-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:15.702158 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2be4a653-1a10-47b7-ae04-87f946cd3de5 tempest-QuotasAdminNegativeTest-1773909701 tempest-QuotasAdminNegativeTest-1773909701-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:15.990981 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2be4a653-1a10-47b7-ae04-87f946cd3de5 tempest-QuotasAdminNegativeTest-1773909701 tempest-QuotasAdminNegativeTest-1773909701-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/513dcb2cc0c24b39af4790735163e300" status: 200 len: 328 microversion: 2.1 time: 0.506434 Oct 18 15:34:15.995136 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1043/2198] 10.222.0.60 () {60 vars in 1262 bytes} [Tue Oct 18 15:34:15 2022] PUT /compute/v2.1/os-quota-sets/513dcb2cc0c24b39af4790735163e300 => generated 328 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:34:16.156614 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5fc8c784-0c5a-4f79-a71f-0813eaf084c9 tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-463940431", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:34:16.250326 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-af56f0c3-1f4b-4c9c-9540-0356412c7fd8 req-e4e47243-6c7d-4a16-8036-31113fbda0e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d", "name": "network-vif-deleted", "tag": "cec6b302-e9b5-409c-aae1-792a43821281"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:34:16.289102 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-af56f0c3-1f4b-4c9c-9540-0356412c7fd8 req-e4e47243-6c7d-4a16-8036-31113fbda0e5 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:16.293455 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-af56f0c3-1f4b-4c9c-9540-0356412c7fd8 req-e4e47243-6c7d-4a16-8036-31113fbda0e5 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:16.294100 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-af56f0c3-1f4b-4c9c-9540-0356412c7fd8 req-e4e47243-6c7d-4a16-8036-31113fbda0e5 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:16.318915 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-af56f0c3-1f4b-4c9c-9540-0356412c7fd8 req-e4e47243-6c7d-4a16-8036-31113fbda0e5 service nova] Creating event network-vif-deleted:cec6b302-e9b5-409c-aae1-792a43821281 for instance ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d on n-h2-853682-5 Oct 18 15:34:16.340334 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-af56f0c3-1f4b-4c9c-9540-0356412c7fd8 req-e4e47243-6c7d-4a16-8036-31113fbda0e5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094677 Oct 18 15:34:16.340334 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1044/2199] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:34:16.346879 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-97cd7ed0-5d0b-40ef-b39a-92527ac01a0a tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:16.347581 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-97cd7ed0-5d0b-40ef-b39a-92527ac01a0a tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] [instance: ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:16.376987 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-97cd7ed0-5d0b-40ef-b39a-92527ac01a0a tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:16.378701 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-97cd7ed0-5d0b-40ef-b39a-92527ac01a0a tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:16.381089 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-97cd7ed0-5d0b-40ef-b39a-92527ac01a0a tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:16.385857 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-97cd7ed0-5d0b-40ef-b39a-92527ac01a0a tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:16.386678 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-97cd7ed0-5d0b-40ef-b39a-92527ac01a0a tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:16.389796 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-97cd7ed0-5d0b-40ef-b39a-92527ac01a0a tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:16.403118 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-5fc8c784-0c5a-4f79-a71f-0813eaf084c9 tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] validate_networks() for None {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:34:17.137419 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-5fc8c784-0c5a-4f79-a71f-0813eaf084c9 tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:34:17.137840 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-5fc8c784-0c5a-4f79-a71f-0813eaf084c9 tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:34:17.140652 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-5fc8c784-0c5a-4f79-a71f-0813eaf084c9 tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:34:17.146299 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-5fc8c784-0c5a-4f79-a71f-0813eaf084c9 tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:34:17.149744 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-5fc8c784-0c5a-4f79-a71f-0813eaf084c9 tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:34:17.167954 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-97cd7ed0-5d0b-40ef-b39a-92527ac01a0a tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db93066933684d41a77863c156deb4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17eee1a6b8d43589bf66e6e18059021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:17.169649 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5fc8c784-0c5a-4f79-a71f-0813eaf084c9 tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:17.171121 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5fc8c784-0c5a-4f79-a71f-0813eaf084c9 tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:17.171859 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5fc8c784-0c5a-4f79-a71f-0813eaf084c9 tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:17.173111 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5fc8c784-0c5a-4f79-a71f-0813eaf084c9 tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:17.173977 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5fc8c784-0c5a-4f79-a71f-0813eaf084c9 tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:17.174658 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5fc8c784-0c5a-4f79-a71f-0813eaf084c9 tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:17.185218 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-97cd7ed0-5d0b-40ef-b39a-92527ac01a0a tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] 10.222.0.60 "GET /compute/v2.1/servers/ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d" status: 200 len: 1296 microversion: 2.1 time: 0.836497 Oct 18 15:34:17.189193 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1045/2200] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:16 2022] GET /compute/v2.1/servers/ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d => generated 1296 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:17.214353 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-5fc8c784-0c5a-4f79-a71f-0813eaf084c9 tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] Getting quotas for project 513dcb2cc0c24b39af4790735163e300. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:34:17.217927 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4263296b-df4c-40a3-8bea-6f23af9d5ec7 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c3cfbf550>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:17.238558 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-5fc8c784-0c5a-4f79-a71f-0813eaf084c9 tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] Getting quotas for user 29e02da9aa8a4c1f93c306fbe90d4752 and project 513dcb2cc0c24b39af4790735163e300. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:34:17.278623 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.utils [None req-5fc8c784-0c5a-4f79-a71f-0813eaf084c9 tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] instances quota exceeded for 513dcb2cc0c24b39af4790735163e300, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120405) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 18 15:34:17.296640 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-5fc8c784-0c5a-4f79-a71f-0813eaf084c9 tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 18 15:34:17.311267 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5fc8c784-0c5a-4f79-a71f-0813eaf084c9 tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] Request method failure captured: Oct 18 15:34:17.311267 n-d-853682-5 devstack@n-api.service[120405]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 15:34:17.311267 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:34:17.311267 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:34:17.311267 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:34:17.311267 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 144 Oct 18 15:34:17.311267 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:34:17.311267 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:34:17.311267 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:34:17.311267 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:34:17.311267 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsdyGv2dFwvT9aofkWHslglH18yJ5lVarO_Q9hECLVMHakiOtJlhHwdxSEldFIS07mj-ansotLUFkJYdXIpMvA8EqXm9691pLSzB27ZIdD2-3bwxNZZrkYfsmxUmmXSZqJ9mIZoewBqJqwlqezu7BULVmI9b6Z5vPkE_wF1GtlZ4gs4 Oct 18 15:34:17.311267 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:34:17.311267 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:34:17.311267 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:34:17.311267 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:34:17.311267 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:34:17.311267 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:34:17.311267 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 513dcb2cc0c24b39af4790735163e300 Oct 18 15:34:17.311267 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-QuotasAdminNegativeTest-1878214098 Oct 18 15:34:17.311267 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:34:17.311267 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:34:17.312781 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/513dcb2cc0c24b39af4790735163e300"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/513dcb2cc0c24b39af4790735163e300"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/513dcb2cc0c24b39af4790735163e300"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_513dcb2cc0c24b39af4790735163e300"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:34:17.312781 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-QuotasAdminNegativeTest-1878214098 Oct 18 15:34:17.312781 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 513dcb2cc0c24b39af4790735163e300 Oct 18 15:34:17.312781 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1878214098 Oct 18 15:34:17.312781 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-QuotasAdminNegativeTest-1878214098-project Oct 18 15:34:17.312781 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:34:17.312781 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:34:17.312781 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 29e02da9aa8a4c1f93c306fbe90d4752 Oct 18 15:34:17.312781 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-QuotasAdminNegativeTest-1878214098-project Oct 18 15:34:17.312781 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:34:17.312781 n-d-853682-5 devstack@n-api.service[120405]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-463940431", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452"}} Oct 18 15:34:17.312781 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:34:17.313445 n-d-853682-5 devstack@n-api.service[120405]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 18 15:34:17.313445 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-463940431', 'imageRef': '8f4db252-bff6-4685-9c8d-4c5d6bd9f78b', 'flavorRef': '452'}}} Oct 18 15:34:17.313445 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:34:17.313445 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:17.313445 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 18 15:34:17.313445 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 18 15:34:17.313445 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 15:34:17.313445 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 15:34:17.313445 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 18 15:34:17.313445 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc Oct 18 15:34:17.313445 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 18 15:34:17.313445 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 18 15:34:17.313445 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 15:34:17.313445 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 15:34:17.313445 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 18 15:34:17.313445 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 18 15:34:17.313445 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 18 15:34:17.313445 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 18 15:34:17.314313 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 18 15:34:17.314313 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 18 15:34:17.314313 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 18 15:34:17.314313 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:17.314313 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:34:17.314313 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:17.314313 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:17.314313 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 18 15:34:17.314313 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 18 15:34:17.314313 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 18 15:34:17.314313 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 18 15:34:17.314313 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 18 15:34:17.314313 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 18 15:34:17.314313 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 18 15:34:17.314313 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 18 15:34:17.314313 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 18 15:34:17.314313 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 18 15:34:17.314313 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 18 15:34:17.314313 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:17.314313 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:34:17.314313 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:17.315343 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:17.315343 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:34:17.315343 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:34:17.315343 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:34:17.315343 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:34:17.315343 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:34:17.315343 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:34:17.315343 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:34:17.315343 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:34:17.315343 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:34:17.315343 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:34:17.315343 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:34:17.315343 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:34:17.315343 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 18 15:34:17.315343 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 18 15:34:17.315343 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 18 15:34:17.315343 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 18 15:34:17.315343 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:17.315343 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:34:17.315343 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:17.315343 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:17.318083 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:34:17.318083 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:34:17.318083 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:34:17.318083 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:34:17.318083 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 18 15:34:17.318083 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:17.318083 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5fc8c784-0c5a-4f79-a71f-0813eaf084c9 tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:34:17.318083 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5fc8c784-0c5a-4f79-a71f-0813eaf084c9 tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.160878 Oct 18 15:34:17.318083 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1156/2201] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:34:16 2022] POST /compute/v2.1/servers => generated 119 bytes in 1166 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:34:17.322196 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1bb96e79-0615-49cf-9479-cec740c0767b tempest-QuotasAdminNegativeTest-1773909701 tempest-QuotasAdminNegativeTest-1773909701-project-admin] Action: 'update', calling method: .version_select at 0x7f7c4166c040>, body: {"quota_set": {"instances": 10}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:34:17.333082 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4263296b-df4c-40a3-8bea-6f23af9d5ec7 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7" status: 200 len: 1454 microversion: 2.1 time: 0.142609 Oct 18 15:34:17.334018 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1046/2202] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:34:17 2022] GET /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7 => generated 1454 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:17.509740 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1bb96e79-0615-49cf-9479-cec740c0767b tempest-QuotasAdminNegativeTest-1773909701 tempest-QuotasAdminNegativeTest-1773909701-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:17.513803 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1bb96e79-0615-49cf-9479-cec740c0767b tempest-QuotasAdminNegativeTest-1773909701 tempest-QuotasAdminNegativeTest-1773909701-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:17.515898 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1bb96e79-0615-49cf-9479-cec740c0767b tempest-QuotasAdminNegativeTest-1773909701 tempest-QuotasAdminNegativeTest-1773909701-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:17.517891 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1bb96e79-0615-49cf-9479-cec740c0767b tempest-QuotasAdminNegativeTest-1773909701 tempest-QuotasAdminNegativeTest-1773909701-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:17.518600 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1bb96e79-0615-49cf-9479-cec740c0767b tempest-QuotasAdminNegativeTest-1773909701 tempest-QuotasAdminNegativeTest-1773909701-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:17.519245 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1bb96e79-0615-49cf-9479-cec740c0767b tempest-QuotasAdminNegativeTest-1773909701 tempest-QuotasAdminNegativeTest-1773909701-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:17.663391 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1bb96e79-0615-49cf-9479-cec740c0767b tempest-QuotasAdminNegativeTest-1773909701 tempest-QuotasAdminNegativeTest-1773909701-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/513dcb2cc0c24b39af4790735163e300" status: 200 len: 329 microversion: 2.1 time: 0.344985 Oct 18 15:34:17.664668 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1157/2203] 10.222.0.60 () {60 vars in 1262 bytes} [Tue Oct 18 15:34:17 2022] PUT /compute/v2.1/os-quota-sets/513dcb2cc0c24b39af4790735163e300 => generated 329 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:34:17.684187 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e28363b6-9a92-4e82-a351-c6a407ce8019 tempest-QuotasAdminNegativeTest-1773909701 tempest-QuotasAdminNegativeTest-1773909701-project-admin] Calling method '.version_select at 0x7f7c3cf9d9d0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:17.879827 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e28363b6-9a92-4e82-a351-c6a407ce8019 tempest-QuotasAdminNegativeTest-1773909701 tempest-QuotasAdminNegativeTest-1773909701-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/513dcb2cc0c24b39af4790735163e300" status: 200 len: 371 microversion: 2.1 time: 0.200454 Oct 18 15:34:17.882531 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1047/2204] 10.222.0.60 () {58 vars in 1242 bytes} [Tue Oct 18 15:34:17 2022] GET /compute/v2.1/os-quota-sets/513dcb2cc0c24b39af4790735163e300 => generated 371 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:34:17.895136 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5acf3729-2a27-40b6-87e8-27a7ccdd1b9f tempest-QuotasAdminNegativeTest-1773909701 tempest-QuotasAdminNegativeTest-1773909701-project-admin] Action: 'update', calling method: .version_select at 0x7f7c415bb700>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:34:18.064886 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5acf3729-2a27-40b6-87e8-27a7ccdd1b9f tempest-QuotasAdminNegativeTest-1773909701 tempest-QuotasAdminNegativeTest-1773909701-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:18.067242 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5acf3729-2a27-40b6-87e8-27a7ccdd1b9f tempest-QuotasAdminNegativeTest-1773909701 tempest-QuotasAdminNegativeTest-1773909701-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:18.069200 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5acf3729-2a27-40b6-87e8-27a7ccdd1b9f tempest-QuotasAdminNegativeTest-1773909701 tempest-QuotasAdminNegativeTest-1773909701-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:18.070215 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5acf3729-2a27-40b6-87e8-27a7ccdd1b9f tempest-QuotasAdminNegativeTest-1773909701 tempest-QuotasAdminNegativeTest-1773909701-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:18.071008 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5acf3729-2a27-40b6-87e8-27a7ccdd1b9f tempest-QuotasAdminNegativeTest-1773909701 tempest-QuotasAdminNegativeTest-1773909701-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:18.072068 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5acf3729-2a27-40b6-87e8-27a7ccdd1b9f tempest-QuotasAdminNegativeTest-1773909701 tempest-QuotasAdminNegativeTest-1773909701-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:18.125807 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=2,nova_api:UPDATE=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:34:18.219045 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dd9cb174-d803-42da-b4ce-3d64ed118edc tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:18.220316 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dd9cb174-d803-42da-b4ce-3d64ed118edc tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] [instance: ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:18.231467 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5acf3729-2a27-40b6-87e8-27a7ccdd1b9f tempest-QuotasAdminNegativeTest-1773909701 tempest-QuotasAdminNegativeTest-1773909701-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/513dcb2cc0c24b39af4790735163e300" status: 200 len: 325 microversion: 2.1 time: 0.341467 Oct 18 15:34:18.233176 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd9cb174-d803-42da-b4ce-3d64ed118edc tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:18.233900 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1158/2205] 10.222.0.60 () {60 vars in 1262 bytes} [Tue Oct 18 15:34:17 2022] PUT /compute/v2.1/os-quota-sets/513dcb2cc0c24b39af4790735163e300 => generated 325 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:34:18.234734 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd9cb174-d803-42da-b4ce-3d64ed118edc tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:18.235518 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd9cb174-d803-42da-b4ce-3d64ed118edc tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:18.236449 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd9cb174-d803-42da-b4ce-3d64ed118edc tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:18.237641 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd9cb174-d803-42da-b4ce-3d64ed118edc tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:18.238229 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd9cb174-d803-42da-b4ce-3d64ed118edc tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:18.283123 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-dd9cb174-d803-42da-b4ce-3d64ed118edc tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] HTTP exception thrown: Instance ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d could not be found. Oct 18 15:34:18.284801 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dd9cb174-d803-42da-b4ce-3d64ed118edc tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Request method failure captured: Oct 18 15:34:18.284801 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d HTTP/1.1 Oct 18 15:34:18.284801 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:34:18.284801 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:34:18.284801 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:34:18.284801 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:34:18.284801 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:34:18.284801 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:34:18.284801 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:34:18.284801 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:34:18.284801 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsb3pfiEaxcnXx3ihmPPXpG7_P6_BfY5Wpx3U9izDjyP4ZKeMoVOYRBLtHkU6k9zvjSPxHpG6JfjUfialgGEewoEmUlRTJv3ueLe74ey6f1lV4D6tvVIl7UCdBjDDPb_LMWkb6yllIK_yimws2bdf7musbVieeZIh26V-IrSnDd0SaM Oct 18 15:34:18.284801 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:34:18.284801 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:34:18.284801 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:34:18.284801 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:34:18.284801 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:34:18.284801 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:34:18.284801 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: b17eee1a6b8d43589bf66e6e18059021 Oct 18 15:34:18.284801 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersTestMultiNic-1438592096 Oct 18 15:34:18.284801 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:34:18.284801 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:34:18.286203 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b17eee1a6b8d43589bf66e6e18059021"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b17eee1a6b8d43589bf66e6e18059021"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b17eee1a6b8d43589bf66e6e18059021"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b17eee1a6b8d43589bf66e6e18059021"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:34:18.286203 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersTestMultiNic-1438592096 Oct 18 15:34:18.286203 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: b17eee1a6b8d43589bf66e6e18059021 Oct 18 15:34:18.286203 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersTestMultiNic-1438592096 Oct 18 15:34:18.286203 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersTestMultiNic-1438592096-project Oct 18 15:34:18.286203 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:34:18.286203 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:34:18.286203 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: db93066933684d41a77863c156deb4da Oct 18 15:34:18.286203 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersTestMultiNic-1438592096-project Oct 18 15:34:18.286203 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:34:18.286203 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d could not be found. Oct 18 15:34:18.286203 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d'} Oct 18 15:34:18.287009 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:34:18.287009 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:18.287009 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:34:18.287009 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:34:18.287009 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:34:18.287009 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:34:18.287009 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:34:18.287009 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:34:18.287009 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:34:18.287009 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:34:18.287009 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d could not be found. Oct 18 15:34:18.287009 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:18.287009 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:34:18.287009 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:18.287009 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:18.287009 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:34:18.287009 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:34:18.287009 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:34:18.287009 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:34:18.287009 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:34:18.288313 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:34:18.288313 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:34:18.288313 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:34:18.288313 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:34:18.288313 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:34:18.288313 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:34:18.288313 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:34:18.288313 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d could not be found. Oct 18 15:34:18.288313 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:18.288313 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:34:18.288313 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:18.288313 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:18.288313 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:34:18.288313 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:34:18.288313 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:34:18.288313 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:34:18.288313 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d could not be found. Oct 18 15:34:18.288313 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:18.289538 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dd9cb174-d803-42da-b4ce-3d64ed118edc tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Returning 404 to user: Instance ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:34:18.289538 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dd9cb174-d803-42da-b4ce-3d64ed118edc tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] 10.222.0.60 "GET /compute/v2.1/servers/ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d" status: 404 len: 111 microversion: 2.1 time: 0.072629 Oct 18 15:34:18.296090 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1048/2206] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:18 2022] GET /compute/v2.1/servers/ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:34:18.360352 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d9432b89-db8c-422f-9f48-2a87ad5856d6 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c415e6940>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:18.450240 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7b774b62-d9d5-4773-bbdf-35e925241c77 tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1664607536", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:34:18.485588 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d9432b89-db8c-422f-9f48-2a87ad5856d6 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7" status: 200 len: 1454 microversion: 2.1 time: 0.137915 Oct 18 15:34:18.487924 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1159/2207] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:34:18 2022] GET /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7 => generated 1454 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:18.562619 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-7b774b62-d9d5-4773-bbdf-35e925241c77 tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] validate_networks() for None {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:34:19.232837 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-7b774b62-d9d5-4773-bbdf-35e925241c77 tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:34:19.236280 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-7b774b62-d9d5-4773-bbdf-35e925241c77 tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:34:19.238351 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-7b774b62-d9d5-4773-bbdf-35e925241c77 tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:34:19.238838 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-7b774b62-d9d5-4773-bbdf-35e925241c77 tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:34:19.239694 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-7b774b62-d9d5-4773-bbdf-35e925241c77 tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:34:19.252201 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b774b62-d9d5-4773-bbdf-35e925241c77 tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:19.253934 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b774b62-d9d5-4773-bbdf-35e925241c77 tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:19.254531 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b774b62-d9d5-4773-bbdf-35e925241c77 tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:19.255747 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b774b62-d9d5-4773-bbdf-35e925241c77 tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:19.257328 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b774b62-d9d5-4773-bbdf-35e925241c77 tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:19.258405 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b774b62-d9d5-4773-bbdf-35e925241c77 tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:19.312618 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-7b774b62-d9d5-4773-bbdf-35e925241c77 tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] Getting quotas for project 513dcb2cc0c24b39af4790735163e300. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:34:19.326647 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-7b774b62-d9d5-4773-bbdf-35e925241c77 tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] Getting quotas for user 29e02da9aa8a4c1f93c306fbe90d4752 and project 513dcb2cc0c24b39af4790735163e300. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:34:19.358767 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.utils [None req-7b774b62-d9d5-4773-bbdf-35e925241c77 tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] ram quota exceeded for 513dcb2cc0c24b39af4790735163e300, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120406) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 18 15:34:19.359796 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-7b774b62-d9d5-4773-bbdf-35e925241c77 tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 18 15:34:19.364217 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7b774b62-d9d5-4773-bbdf-35e925241c77 tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] Request method failure captured: Oct 18 15:34:19.364217 n-d-853682-5 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 15:34:19.364217 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:34:19.364217 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:34:19.364217 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:34:19.364217 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 145 Oct 18 15:34:19.364217 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:34:19.364217 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:34:19.364217 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:34:19.364217 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:34:19.364217 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsdyGv2dFwvT9aofkWHslglH18yJ5lVarO_Q9hECLVMHakiOtJlhHwdxSEldFIS07mj-ansotLUFkJYdXIpMvA8EqXm9691pLSzB27ZIdD2-3bwxNZZrkYfsmxUmmXSZqJ9mIZoewBqJqwlqezu7BULVmI9b6Z5vPkE_wF1GtlZ4gs4 Oct 18 15:34:19.364217 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:34:19.364217 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:34:19.364217 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:34:19.364217 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:34:19.364217 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:34:19.364217 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:34:19.364217 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 513dcb2cc0c24b39af4790735163e300 Oct 18 15:34:19.364217 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-QuotasAdminNegativeTest-1878214098 Oct 18 15:34:19.364217 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:34:19.364217 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:34:19.365424 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/513dcb2cc0c24b39af4790735163e300"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/513dcb2cc0c24b39af4790735163e300"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/513dcb2cc0c24b39af4790735163e300"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_513dcb2cc0c24b39af4790735163e300"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:34:19.365424 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-QuotasAdminNegativeTest-1878214098 Oct 18 15:34:19.365424 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 513dcb2cc0c24b39af4790735163e300 Oct 18 15:34:19.365424 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1878214098 Oct 18 15:34:19.365424 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-QuotasAdminNegativeTest-1878214098-project Oct 18 15:34:19.365424 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:34:19.365424 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:34:19.365424 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 29e02da9aa8a4c1f93c306fbe90d4752 Oct 18 15:34:19.365424 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-QuotasAdminNegativeTest-1878214098-project Oct 18 15:34:19.365424 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:34:19.365424 n-d-853682-5 devstack@n-api.service[120406]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1664607536", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452"}} Oct 18 15:34:19.365424 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:34:19.366055 n-d-853682-5 devstack@n-api.service[120406]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 18 15:34:19.366055 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1664607536', 'imageRef': '8f4db252-bff6-4685-9c8d-4c5d6bd9f78b', 'flavorRef': '452'}}} Oct 18 15:34:19.366055 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:34:19.366055 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:19.366055 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 18 15:34:19.366055 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 18 15:34:19.366055 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 15:34:19.366055 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 15:34:19.366055 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 18 15:34:19.366055 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc Oct 18 15:34:19.366055 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 18 15:34:19.366055 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 18 15:34:19.366055 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 15:34:19.366055 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 15:34:19.366055 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 18 15:34:19.366055 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 18 15:34:19.366055 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 18 15:34:19.366055 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 18 15:34:19.366949 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 18 15:34:19.366949 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 18 15:34:19.366949 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 18 15:34:19.366949 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:19.366949 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:34:19.366949 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:19.366949 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:19.366949 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 18 15:34:19.366949 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 18 15:34:19.366949 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 18 15:34:19.366949 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 18 15:34:19.366949 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 18 15:34:19.366949 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 18 15:34:19.366949 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 18 15:34:19.366949 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 18 15:34:19.366949 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 18 15:34:19.366949 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 18 15:34:19.366949 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 18 15:34:19.366949 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:19.366949 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:34:19.366949 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:19.367992 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:19.367992 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:34:19.367992 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:34:19.367992 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:34:19.367992 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:34:19.367992 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:34:19.367992 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:34:19.367992 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:34:19.367992 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:34:19.367992 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:34:19.367992 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:34:19.367992 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:34:19.367992 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:34:19.367992 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 18 15:34:19.367992 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 18 15:34:19.367992 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 18 15:34:19.367992 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 18 15:34:19.367992 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:19.367992 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:34:19.367992 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:19.367992 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:19.369046 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:34:19.369046 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:34:19.369046 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:34:19.369046 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:34:19.369046 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 18 15:34:19.369046 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:19.374475 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7b774b62-d9d5-4773-bbdf-35e925241c77 tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:34:19.375686 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7b774b62-d9d5-4773-bbdf-35e925241c77 tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.930077 Oct 18 15:34:19.379285 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1049/2208] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:34:18 2022] POST /compute/v2.1/servers => generated 110 bytes in 935 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:34:19.389052 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-904554bf-0932-48f9-abe4-bf4bacbfa2ed tempest-QuotasAdminNegativeTest-1773909701 tempest-QuotasAdminNegativeTest-1773909701-project-admin] Action: 'update', calling method: .version_select at 0x7f7c41544d30>, body: {"quota_set": {"ram": 51200}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:34:19.507666 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8b88e28b-0df4-4fd9-aa23-ec8d2d050eca tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c3cfd88b0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:19.618637 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8b88e28b-0df4-4fd9-aa23-ec8d2d050eca tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7" status: 200 len: 1454 microversion: 2.1 time: 0.116653 Oct 18 15:34:19.620422 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1050/2209] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:34:19 2022] GET /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7 => generated 1454 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:19.995468 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-904554bf-0932-48f9-abe4-bf4bacbfa2ed tempest-QuotasAdminNegativeTest-1773909701 tempest-QuotasAdminNegativeTest-1773909701-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:19.998548 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-904554bf-0932-48f9-abe4-bf4bacbfa2ed tempest-QuotasAdminNegativeTest-1773909701 tempest-QuotasAdminNegativeTest-1773909701-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:19.999241 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-904554bf-0932-48f9-abe4-bf4bacbfa2ed tempest-QuotasAdminNegativeTest-1773909701 tempest-QuotasAdminNegativeTest-1773909701-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:20.001602 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-904554bf-0932-48f9-abe4-bf4bacbfa2ed tempest-QuotasAdminNegativeTest-1773909701 tempest-QuotasAdminNegativeTest-1773909701-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:20.002556 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-904554bf-0932-48f9-abe4-bf4bacbfa2ed tempest-QuotasAdminNegativeTest-1773909701 tempest-QuotasAdminNegativeTest-1773909701-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:20.004379 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-904554bf-0932-48f9-abe4-bf4bacbfa2ed tempest-QuotasAdminNegativeTest-1773909701 tempest-QuotasAdminNegativeTest-1773909701-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:20.173924 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-904554bf-0932-48f9-abe4-bf4bacbfa2ed tempest-QuotasAdminNegativeTest-1773909701 tempest-QuotasAdminNegativeTest-1773909701-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/513dcb2cc0c24b39af4790735163e300" status: 200 len: 329 microversion: 2.1 time: 0.789165 Oct 18 15:34:20.176556 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1160/2210] 10.222.0.60 () {60 vars in 1262 bytes} [Tue Oct 18 15:34:19 2022] PUT /compute/v2.1/os-quota-sets/513dcb2cc0c24b39af4790735163e300 => generated 329 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:34:20.193543 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-55a8fa32-d051-408b-b490-432c5f906160 tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] Action: 'update', calling method: .version_select at 0x7f7c3cfd81f0>, body: {"quota_set": {"ram": 0}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:34:20.202625 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-55a8fa32-d051-408b-b490-432c5f906160 tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '29e02da9aa8a4c1f93c306fbe90d4752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513dcb2cc0c24b39af4790735163e300', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:20.259162 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-55a8fa32-d051-408b-b490-432c5f906160 tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] Request method failure captured: Oct 18 15:34:20.259162 n-d-853682-5 devstack@n-api.service[120406]: request: PUT /compute/v2.1/os-quota-sets/513dcb2cc0c24b39af4790735163e300 HTTP/1.1 Oct 18 15:34:20.259162 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:34:20.259162 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:34:20.259162 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:34:20.259162 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 25 Oct 18 15:34:20.259162 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:34:20.259162 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:34:20.259162 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:34:20.259162 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:34:20.259162 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsdyGv2dFwvT9aofkWHslglH18yJ5lVarO_Q9hECLVMHakiOtJlhHwdxSEldFIS07mj-ansotLUFkJYdXIpMvA8EqXm9691pLSzB27ZIdD2-3bwxNZZrkYfsmxUmmXSZqJ9mIZoewBqJqwlqezu7BULVmI9b6Z5vPkE_wF1GtlZ4gs4 Oct 18 15:34:20.259162 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:34:20.259162 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:34:20.259162 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:34:20.259162 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:34:20.259162 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:34:20.259162 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:34:20.259162 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 513dcb2cc0c24b39af4790735163e300 Oct 18 15:34:20.259162 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-QuotasAdminNegativeTest-1878214098 Oct 18 15:34:20.259162 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:34:20.259162 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:34:20.262718 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/513dcb2cc0c24b39af4790735163e300"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/513dcb2cc0c24b39af4790735163e300"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/513dcb2cc0c24b39af4790735163e300"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_513dcb2cc0c24b39af4790735163e300"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:34:20.262718 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-QuotasAdminNegativeTest-1878214098 Oct 18 15:34:20.262718 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 513dcb2cc0c24b39af4790735163e300 Oct 18 15:34:20.262718 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1878214098 Oct 18 15:34:20.262718 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-QuotasAdminNegativeTest-1878214098-project Oct 18 15:34:20.262718 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:34:20.262718 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:34:20.262718 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 29e02da9aa8a4c1f93c306fbe90d4752 Oct 18 15:34:20.262718 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-QuotasAdminNegativeTest-1878214098-project Oct 18 15:34:20.262718 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:34:20.262718 n-d-853682-5 devstack@n-api.service[120406]: {"quota_set": {"ram": 0}} Oct 18 15:34:20.262718 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:34:20.262718 n-d-853682-5 devstack@n-api.service[120406]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 18 15:34:20.262718 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '513dcb2cc0c24b39af4790735163e300', 'body': {'quota_set': {'ram': 0}}} Oct 18 15:34:20.264528 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:34:20.264528 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:20.264528 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:34:20.264528 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:34:20.264528 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:34:20.264528 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:34:20.264528 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:34:20.264528 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:34:20.264528 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:34:20.264528 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:34:20.264528 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:34:20.264528 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:34:20.264528 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 18 15:34:20.264528 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 18 15:34:20.264528 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 15:34:20.264528 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:34:20.264528 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 15:34:20.264528 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:34:20.264528 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 18 15:34:20.267438 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 18 15:34:20.267438 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 15:34:20.267438 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 15:34:20.267438 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 15:34:20.267438 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 15:34:20.267438 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 15:34:20.267438 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 15:34:20.267438 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 15:34:20.267438 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 15:34:20.267438 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 15:34:20.267438 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 15:34:20.267438 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 15:34:20.267438 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 15:34:20.267438 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 15:34:20.267438 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 15:34:20.267438 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 18 15:34:20.267438 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:20.267438 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:34:20.267438 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:20.267438 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:20.268856 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:34:20.268856 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:34:20.268856 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 15:34:20.268856 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 15:34:20.268856 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 18 15:34:20.268856 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:20.268856 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-55a8fa32-d051-408b-b490-432c5f906160 tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:34:20.268856 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-55a8fa32-d051-408b-b490-432c5f906160 tempest-QuotasAdminNegativeTest-1878214098 tempest-QuotasAdminNegativeTest-1878214098-project] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/513dcb2cc0c24b39af4790735163e300" status: 403 len: 116 microversion: 2.1 time: 0.074354 Oct 18 15:34:20.272208 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1051/2211] 10.222.0.60 () {60 vars in 1262 bytes} [Tue Oct 18 15:34:20 2022] PUT /compute/v2.1/os-quota-sets/513dcb2cc0c24b39af4790735163e300 => generated 116 bytes in 79 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:34:20.649943 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7418315c-dde0-416d-8dde-5f4b4421b606 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c3cf5e310>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:20.743040 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7418315c-dde0-416d-8dde-5f4b4421b606 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7" status: 200 len: 1454 microversion: 2.1 time: 0.111710 Oct 18 15:34:20.745609 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1052/2212] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:34:20 2022] GET /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7 => generated 1454 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:21.098535 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0f842f84-7caa-4bde-afc5-f97470c1cff3 tempest-ImagesMetadataNegativeTestJSON-1150769155 tempest-ImagesMetadataNegativeTestJSON-1150769155-project] Calling method '.version_select at 0x7f7c415bbdc0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:21.142177 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-0f842f84-7caa-4bde-afc5-f97470c1cff3 tempest-ImagesMetadataNegativeTestJSON-1150769155 tempest-ImagesMetadataNegativeTestJSON-1150769155-project] HTTP exception thrown: Image not found. Oct 18 15:34:21.147874 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0f842f84-7caa-4bde-afc5-f97470c1cff3 tempest-ImagesMetadataNegativeTestJSON-1150769155 tempest-ImagesMetadataNegativeTestJSON-1150769155-project] Request method failure captured: Oct 18 15:34:21.147874 n-d-853682-5 devstack@n-api.service[120405]: request: DELETE /compute/v2.1/images/5a6dca74-032a-454e-a540-044302dc0d11/metadata/os_distro HTTP/1.1 Oct 18 15:34:21.147874 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:34:21.147874 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:34:21.147874 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:34:21.147874 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:34:21.147874 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:34:21.147874 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:34:21.147874 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:34:21.147874 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:34:21.147874 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsd8j2ggK8PzqkcVxu0saVaZQBhqbhnQvi2NHS_6jBQL9cUlN0eJ5o52yh0_7mQs7-fmdE84PAsz6qwb8lrPW5XGe89BuOaiT-cxmDKqrKAIOo8jtFiVqHBj9gLuDlWEhzg1Tpjbk-R0-OKOZJO4Zkv0ufWQc0kerwalC5AHfHhTcDE Oct 18 15:34:21.147874 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:34:21.147874 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:34:21.147874 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:34:21.147874 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:34:21.147874 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:34:21.147874 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:34:21.147874 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 8ab85bbd71bd49e1a9b83d8c126ea001 Oct 18 15:34:21.147874 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1150769155 Oct 18 15:34:21.147874 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:34:21.147874 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:34:21.151106 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8ab85bbd71bd49e1a9b83d8c126ea001"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8ab85bbd71bd49e1a9b83d8c126ea001"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8ab85bbd71bd49e1a9b83d8c126ea001"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8ab85bbd71bd49e1a9b83d8c126ea001"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:34:21.151106 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1150769155 Oct 18 15:34:21.151106 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 8ab85bbd71bd49e1a9b83d8c126ea001 Oct 18 15:34:21.151106 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1150769155 Oct 18 15:34:21.151106 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ImagesMetadataNegativeTestJSON-1150769155-project Oct 18 15:34:21.151106 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:34:21.151106 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:34:21.151106 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 4f38487cb57c42cbab78d9882ec092e3 Oct 18 15:34:21.151106 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1150769155-project Oct 18 15:34:21.151106 n-d-853682-5 devstack@n-api.service[120405]: method: Oct 18 15:34:21.151106 n-d-853682-5 devstack@n-api.service[120405]: exception: Image not found. Oct 18 15:34:21.151106 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'image_id': '5a6dca74-032a-454e-a540-044302dc0d11', 'id': 'os_distro'} Oct 18 15:34:21.151106 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:34:21.151782 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:21.151782 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 15:34:21.151782 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 15:34:21.151782 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 15:34:21.151782 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 15:34:21.151782 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 15:34:21.151782 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 15:34:21.151782 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 15:34:21.151782 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 15:34:21.151782 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 15:34:21.151782 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 15:34:21.151782 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 15:34:21.151782 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 15:34:21.151782 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 15:34:21.151782 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 15:34:21.151782 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 15:34:21.151782 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 15:34:21.151782 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5a6dca74-032a-454e-a540-044302dc0d11 Oct 18 15:34:21.152654 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:21.152654 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:34:21.152654 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:21.152654 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:21.152654 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 18 15:34:21.152654 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 18 15:34:21.152654 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 18 15:34:21.152654 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 18 15:34:21.152654 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 18 15:34:21.152654 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 18 15:34:21.152654 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 18 15:34:21.152654 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 18 15:34:21.152654 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 15:34:21.152654 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 15:34:21.152654 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 15:34:21.152654 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 15:34:21.152654 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 15:34:21.152654 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 15:34:21.152654 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 15:34:21.152654 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 15:34:21.153661 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 15:34:21.153661 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 15:34:21.153661 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 15:34:21.153661 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 15:34:21.153661 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 15:34:21.153661 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 15:34:21.153661 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 15:34:21.153661 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 15:34:21.153661 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5a6dca74-032a-454e-a540-044302dc0d11 could not be found. Oct 18 15:34:21.153661 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:21.153661 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:34:21.153661 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:21.153661 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:21.153661 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:34:21.153661 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:34:21.153661 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:34:21.153661 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:34:21.153661 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:34:21.153661 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:34:21.154582 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:34:21.154582 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:34:21.154582 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 18 15:34:21.154582 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 18 15:34:21.154582 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 18 15:34:21.154582 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 18 15:34:21.154582 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 15:34:21.154582 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:21.154582 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:34:21.154582 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:21.154582 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:21.154582 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:34:21.154582 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:34:21.154582 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:34:21.154582 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:34:21.154582 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 15:34:21.154582 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:21.154582 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0f842f84-7caa-4bde-afc5-f97470c1cff3 tempest-ImagesMetadataNegativeTestJSON-1150769155 tempest-ImagesMetadataNegativeTestJSON-1150769155-project] Returning 404 to user: Image not found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:34:21.155518 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0f842f84-7caa-4bde-afc5-f97470c1cff3 tempest-ImagesMetadataNegativeTestJSON-1150769155 tempest-ImagesMetadataNegativeTestJSON-1150769155-project] 10.222.0.60 "DELETE /compute/v2.1/images/5a6dca74-032a-454e-a540-044302dc0d11/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.616258 Oct 18 15:34:21.157987 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1161/2213] 10.222.0.60 () {58 vars in 1293 bytes} [Tue Oct 18 15:34:20 2022] DELETE /compute/v2.1/images/5a6dca74-032a-454e-a540-044302dc0d11/metadata/os_distro => generated 62 bytes in 624 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 15:34:21.165124 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b7f39c8d-fc31-48fd-807b-28d4d2b52d8c tempest-ImagesMetadataNegativeTestJSON-1150769155 tempest-ImagesMetadataNegativeTestJSON-1150769155-project] Calling method '.version_select at 0x7f7c3cef08b0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:21.242352 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-b7f39c8d-fc31-48fd-807b-28d4d2b52d8c tempest-ImagesMetadataNegativeTestJSON-1150769155 tempest-ImagesMetadataNegativeTestJSON-1150769155-project] HTTP exception thrown: Image not found. Oct 18 15:34:21.247478 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b7f39c8d-fc31-48fd-807b-28d4d2b52d8c tempest-ImagesMetadataNegativeTestJSON-1150769155 tempest-ImagesMetadataNegativeTestJSON-1150769155-project] Request method failure captured: Oct 18 15:34:21.247478 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/images/bde0b556-29eb-40a2-a3d4-8929a43e0dde/metadata/os_version HTTP/1.1 Oct 18 15:34:21.247478 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:34:21.247478 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:34:21.247478 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:34:21.247478 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:34:21.247478 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:34:21.247478 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:34:21.247478 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:34:21.247478 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:34:21.247478 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsd8j2ggK8PzqkcVxu0saVaZQBhqbhnQvi2NHS_6jBQL9cUlN0eJ5o52yh0_7mQs7-fmdE84PAsz6qwb8lrPW5XGe89BuOaiT-cxmDKqrKAIOo8jtFiVqHBj9gLuDlWEhzg1Tpjbk-R0-OKOZJO4Zkv0ufWQc0kerwalC5AHfHhTcDE Oct 18 15:34:21.247478 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:34:21.247478 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:34:21.247478 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:34:21.247478 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:34:21.247478 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:34:21.247478 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:34:21.247478 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 8ab85bbd71bd49e1a9b83d8c126ea001 Oct 18 15:34:21.247478 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1150769155 Oct 18 15:34:21.247478 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:34:21.247478 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:34:21.249659 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8ab85bbd71bd49e1a9b83d8c126ea001"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8ab85bbd71bd49e1a9b83d8c126ea001"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8ab85bbd71bd49e1a9b83d8c126ea001"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8ab85bbd71bd49e1a9b83d8c126ea001"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:34:21.249659 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1150769155 Oct 18 15:34:21.249659 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 8ab85bbd71bd49e1a9b83d8c126ea001 Oct 18 15:34:21.249659 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1150769155 Oct 18 15:34:21.249659 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ImagesMetadataNegativeTestJSON-1150769155-project Oct 18 15:34:21.249659 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:34:21.249659 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:34:21.249659 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 4f38487cb57c42cbab78d9882ec092e3 Oct 18 15:34:21.249659 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1150769155-project Oct 18 15:34:21.249659 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:34:21.249659 n-d-853682-5 devstack@n-api.service[120406]: exception: Image not found. Oct 18 15:34:21.249659 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'image_id': 'bde0b556-29eb-40a2-a3d4-8929a43e0dde', 'id': 'os_version'} Oct 18 15:34:21.249659 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:34:21.250964 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:21.250964 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 15:34:21.250964 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 15:34:21.250964 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 15:34:21.250964 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 15:34:21.250964 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 15:34:21.250964 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 15:34:21.250964 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 15:34:21.250964 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 15:34:21.250964 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 15:34:21.250964 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 15:34:21.250964 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 15:34:21.250964 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 15:34:21.250964 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 15:34:21.250964 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 15:34:21.250964 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 15:34:21.250964 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 15:34:21.250964 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID bde0b556-29eb-40a2-a3d4-8929a43e0dde Oct 18 15:34:21.252209 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:21.252209 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:34:21.252209 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:21.252209 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:21.252209 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 18 15:34:21.252209 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 18 15:34:21.252209 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 18 15:34:21.252209 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 18 15:34:21.252209 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 18 15:34:21.252209 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 18 15:34:21.252209 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 18 15:34:21.252209 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 18 15:34:21.252209 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 15:34:21.252209 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 15:34:21.252209 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 15:34:21.252209 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 15:34:21.252209 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 15:34:21.252209 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 15:34:21.252209 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 15:34:21.252209 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 15:34:21.253702 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 15:34:21.253702 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 15:34:21.253702 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 15:34:21.253702 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 15:34:21.253702 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 15:34:21.253702 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 15:34:21.253702 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 15:34:21.253702 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 15:34:21.253702 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image bde0b556-29eb-40a2-a3d4-8929a43e0dde could not be found. Oct 18 15:34:21.253702 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:21.253702 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:34:21.253702 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:21.253702 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:21.253702 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:34:21.253702 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:34:21.253702 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:34:21.253702 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:34:21.253702 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:34:21.253702 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:34:21.255279 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:34:21.255279 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:34:21.255279 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 18 15:34:21.255279 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 18 15:34:21.255279 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 18 15:34:21.255279 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 18 15:34:21.255279 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 15:34:21.255279 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:21.255279 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:34:21.255279 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:21.255279 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:21.255279 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:34:21.255279 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:34:21.255279 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:34:21.255279 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:34:21.255279 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 15:34:21.255279 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:21.257645 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b7f39c8d-fc31-48fd-807b-28d4d2b52d8c tempest-ImagesMetadataNegativeTestJSON-1150769155 tempest-ImagesMetadataNegativeTestJSON-1150769155-project] Returning 404 to user: Image not found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:34:21.258664 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b7f39c8d-fc31-48fd-807b-28d4d2b52d8c tempest-ImagesMetadataNegativeTestJSON-1150769155 tempest-ImagesMetadataNegativeTestJSON-1150769155-project] 10.222.0.60 "GET /compute/v2.1/images/bde0b556-29eb-40a2-a3d4-8929a43e0dde/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.099923 Oct 18 15:34:21.262003 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1053/2214] 10.222.0.60 () {58 vars in 1293 bytes} [Tue Oct 18 15:34:21 2022] GET /compute/v2.1/images/bde0b556-29eb-40a2-a3d4-8929a43e0dde/metadata/os_version => generated 62 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 15:34:21.273696 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fcd4472f-873f-46f1-b643-1f5ac429f8d9 tempest-ImagesMetadataNegativeTestJSON-1150769155 tempest-ImagesMetadataNegativeTestJSON-1150769155-project] Calling method '.version_select at 0x7f7c41548310>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:21.299657 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-fcd4472f-873f-46f1-b643-1f5ac429f8d9 tempest-ImagesMetadataNegativeTestJSON-1150769155 tempest-ImagesMetadataNegativeTestJSON-1150769155-project] HTTP exception thrown: Image not found. Oct 18 15:34:21.301752 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fcd4472f-873f-46f1-b643-1f5ac429f8d9 tempest-ImagesMetadataNegativeTestJSON-1150769155 tempest-ImagesMetadataNegativeTestJSON-1150769155-project] Request method failure captured: Oct 18 15:34:21.301752 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/images/55ac5e16-bfed-435a-8590-5714f6b3b7c9/metadata HTTP/1.1 Oct 18 15:34:21.301752 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:34:21.301752 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:34:21.301752 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:34:21.301752 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:34:21.301752 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:34:21.301752 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:34:21.301752 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:34:21.301752 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:34:21.301752 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsd8j2ggK8PzqkcVxu0saVaZQBhqbhnQvi2NHS_6jBQL9cUlN0eJ5o52yh0_7mQs7-fmdE84PAsz6qwb8lrPW5XGe89BuOaiT-cxmDKqrKAIOo8jtFiVqHBj9gLuDlWEhzg1Tpjbk-R0-OKOZJO4Zkv0ufWQc0kerwalC5AHfHhTcDE Oct 18 15:34:21.301752 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:34:21.301752 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:34:21.301752 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:34:21.301752 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:34:21.301752 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:34:21.301752 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:34:21.301752 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 8ab85bbd71bd49e1a9b83d8c126ea001 Oct 18 15:34:21.301752 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1150769155 Oct 18 15:34:21.301752 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:34:21.301752 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:34:21.303085 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8ab85bbd71bd49e1a9b83d8c126ea001"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8ab85bbd71bd49e1a9b83d8c126ea001"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8ab85bbd71bd49e1a9b83d8c126ea001"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8ab85bbd71bd49e1a9b83d8c126ea001"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:34:21.303085 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1150769155 Oct 18 15:34:21.303085 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 8ab85bbd71bd49e1a9b83d8c126ea001 Oct 18 15:34:21.303085 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1150769155 Oct 18 15:34:21.303085 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ImagesMetadataNegativeTestJSON-1150769155-project Oct 18 15:34:21.303085 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:34:21.303085 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:34:21.303085 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 4f38487cb57c42cbab78d9882ec092e3 Oct 18 15:34:21.303085 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1150769155-project Oct 18 15:34:21.303085 n-d-853682-5 devstack@n-api.service[120405]: method: Oct 18 15:34:21.303085 n-d-853682-5 devstack@n-api.service[120405]: exception: Image not found. Oct 18 15:34:21.303085 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'image_id': '55ac5e16-bfed-435a-8590-5714f6b3b7c9'} Oct 18 15:34:21.303085 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:34:21.305020 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:21.305020 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 15:34:21.305020 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 15:34:21.305020 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 15:34:21.305020 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 15:34:21.305020 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 15:34:21.305020 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 15:34:21.305020 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 15:34:21.305020 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 15:34:21.305020 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 15:34:21.305020 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 15:34:21.305020 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 15:34:21.305020 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 15:34:21.305020 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 15:34:21.305020 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 15:34:21.305020 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 15:34:21.305020 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 15:34:21.305020 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 55ac5e16-bfed-435a-8590-5714f6b3b7c9 Oct 18 15:34:21.308160 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:21.308160 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:34:21.308160 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:21.308160 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:21.308160 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 18 15:34:21.308160 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 18 15:34:21.308160 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 18 15:34:21.308160 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 18 15:34:21.308160 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 18 15:34:21.308160 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 18 15:34:21.308160 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 18 15:34:21.308160 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 18 15:34:21.308160 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 15:34:21.308160 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 15:34:21.308160 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 15:34:21.308160 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 15:34:21.308160 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 15:34:21.308160 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 15:34:21.308160 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 15:34:21.308160 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 15:34:21.310289 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 15:34:21.310289 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 15:34:21.310289 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 15:34:21.310289 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 15:34:21.310289 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 15:34:21.310289 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 15:34:21.310289 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 15:34:21.310289 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 15:34:21.310289 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 55ac5e16-bfed-435a-8590-5714f6b3b7c9 could not be found. Oct 18 15:34:21.310289 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:21.310289 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:34:21.310289 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:21.310289 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:21.310289 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:34:21.310289 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:34:21.310289 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:34:21.310289 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:34:21.310289 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:34:21.310289 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:34:21.311853 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:34:21.311853 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:34:21.311853 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 18 15:34:21.311853 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 18 15:34:21.311853 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 18 15:34:21.311853 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 18 15:34:21.311853 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 15:34:21.311853 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:21.311853 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:34:21.311853 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:21.311853 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:21.311853 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:34:21.311853 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:34:21.311853 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:34:21.311853 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:34:21.311853 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 15:34:21.311853 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:21.311853 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fcd4472f-873f-46f1-b643-1f5ac429f8d9 tempest-ImagesMetadataNegativeTestJSON-1150769155 tempest-ImagesMetadataNegativeTestJSON-1150769155-project] Returning 404 to user: Image not found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:34:21.314061 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fcd4472f-873f-46f1-b643-1f5ac429f8d9 tempest-ImagesMetadataNegativeTestJSON-1150769155 tempest-ImagesMetadataNegativeTestJSON-1150769155-project] 10.222.0.60 "GET /compute/v2.1/images/55ac5e16-bfed-435a-8590-5714f6b3b7c9/metadata" status: 404 len: 62 microversion: 2.1 time: 0.036081 Oct 18 15:34:21.314061 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1162/2215] 10.222.0.60 () {58 vars in 1260 bytes} [Tue Oct 18 15:34:21 2022] GET /compute/v2.1/images/55ac5e16-bfed-435a-8590-5714f6b3b7c9/metadata => generated 62 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 15:34:21.315840 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a9555498-958f-41c5-b953-7ad34afa2ade tempest-ImagesMetadataNegativeTestJSON-1150769155 tempest-ImagesMetadataNegativeTestJSON-1150769155-project] Action: 'update_all', calling method: .version_select at 0x7f7c3ce01160>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:34:21.364952 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-a9555498-958f-41c5-b953-7ad34afa2ade tempest-ImagesMetadataNegativeTestJSON-1150769155 tempest-ImagesMetadataNegativeTestJSON-1150769155-project] HTTP exception thrown: Image not found. Oct 18 15:34:21.367942 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a9555498-958f-41c5-b953-7ad34afa2ade tempest-ImagesMetadataNegativeTestJSON-1150769155 tempest-ImagesMetadataNegativeTestJSON-1150769155-project] Request method failure captured: Oct 18 15:34:21.367942 n-d-853682-5 devstack@n-api.service[120406]: request: PUT /compute/v2.1/images/6a43776a-7b85-436e-a9dc-8164a403f1eb/metadata HTTP/1.1 Oct 18 15:34:21.367942 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:34:21.367942 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:34:21.367942 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:34:21.367942 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 57 Oct 18 15:34:21.367942 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:34:21.367942 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:34:21.367942 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:34:21.367942 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:34:21.367942 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsd8j2ggK8PzqkcVxu0saVaZQBhqbhnQvi2NHS_6jBQL9cUlN0eJ5o52yh0_7mQs7-fmdE84PAsz6qwb8lrPW5XGe89BuOaiT-cxmDKqrKAIOo8jtFiVqHBj9gLuDlWEhzg1Tpjbk-R0-OKOZJO4Zkv0ufWQc0kerwalC5AHfHhTcDE Oct 18 15:34:21.367942 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:34:21.367942 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:34:21.367942 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:34:21.367942 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:34:21.367942 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:34:21.367942 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:34:21.367942 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 8ab85bbd71bd49e1a9b83d8c126ea001 Oct 18 15:34:21.367942 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1150769155 Oct 18 15:34:21.367942 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:34:21.367942 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:34:21.370011 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8ab85bbd71bd49e1a9b83d8c126ea001"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8ab85bbd71bd49e1a9b83d8c126ea001"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8ab85bbd71bd49e1a9b83d8c126ea001"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8ab85bbd71bd49e1a9b83d8c126ea001"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:34:21.370011 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1150769155 Oct 18 15:34:21.370011 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 8ab85bbd71bd49e1a9b83d8c126ea001 Oct 18 15:34:21.370011 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1150769155 Oct 18 15:34:21.370011 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ImagesMetadataNegativeTestJSON-1150769155-project Oct 18 15:34:21.370011 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:34:21.370011 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:34:21.370011 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 4f38487cb57c42cbab78d9882ec092e3 Oct 18 15:34:21.370011 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1150769155-project Oct 18 15:34:21.370011 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:34:21.370011 n-d-853682-5 devstack@n-api.service[120406]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 18 15:34:21.370011 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:34:21.370011 n-d-853682-5 devstack@n-api.service[120406]: exception: Image not found. Oct 18 15:34:21.371146 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'image_id': '6a43776a-7b85-436e-a9dc-8164a403f1eb', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 18 15:34:21.371146 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:34:21.371146 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:21.371146 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 15:34:21.371146 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 15:34:21.371146 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 15:34:21.371146 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 15:34:21.371146 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 15:34:21.371146 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 15:34:21.371146 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 15:34:21.371146 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 15:34:21.371146 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 15:34:21.371146 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 15:34:21.371146 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 15:34:21.371146 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 15:34:21.371146 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 15:34:21.371146 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 15:34:21.371146 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 15:34:21.374252 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 15:34:21.374252 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 6a43776a-7b85-436e-a9dc-8164a403f1eb Oct 18 15:34:21.374252 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:21.374252 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:34:21.374252 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:21.374252 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:21.374252 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 18 15:34:21.374252 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 18 15:34:21.374252 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 18 15:34:21.374252 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 18 15:34:21.374252 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 18 15:34:21.374252 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 18 15:34:21.374252 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 18 15:34:21.374252 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 18 15:34:21.374252 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 15:34:21.374252 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 15:34:21.374252 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 15:34:21.374252 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 15:34:21.374252 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 15:34:21.374252 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 15:34:21.376231 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 15:34:21.376231 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 15:34:21.376231 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 15:34:21.376231 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 15:34:21.376231 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 15:34:21.376231 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 15:34:21.376231 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 15:34:21.376231 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 15:34:21.376231 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 15:34:21.376231 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 15:34:21.376231 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6a43776a-7b85-436e-a9dc-8164a403f1eb could not be found. Oct 18 15:34:21.376231 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:21.376231 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:34:21.376231 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:21.376231 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:21.376231 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:34:21.376231 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:34:21.376231 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:34:21.376231 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:34:21.377607 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:34:21.377607 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:34:21.377607 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:34:21.377607 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:34:21.377607 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:34:21.377607 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:34:21.377607 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 18 15:34:21.377607 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 18 15:34:21.377607 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 18 15:34:21.377607 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 18 15:34:21.377607 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 15:34:21.377607 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:21.377607 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:34:21.377607 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:21.377607 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:21.377607 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:34:21.377607 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:34:21.377607 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:34:21.377607 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:34:21.377607 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 15:34:21.377607 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:21.379112 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a9555498-958f-41c5-b953-7ad34afa2ade tempest-ImagesMetadataNegativeTestJSON-1150769155 tempest-ImagesMetadataNegativeTestJSON-1150769155-project] Returning 404 to user: Image not found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:34:21.379112 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a9555498-958f-41c5-b953-7ad34afa2ade tempest-ImagesMetadataNegativeTestJSON-1150769155 tempest-ImagesMetadataNegativeTestJSON-1150769155-project] 10.222.0.60 "PUT /compute/v2.1/images/6a43776a-7b85-436e-a9dc-8164a403f1eb/metadata" status: 404 len: 62 microversion: 2.1 time: 0.059691 Oct 18 15:34:21.392480 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-052a5fa1-acfc-4ab2-9d60-576816c49731 tempest-ImagesMetadataNegativeTestJSON-1150769155 tempest-ImagesMetadataNegativeTestJSON-1150769155-project] Action: 'update', calling method: .version_select at 0x7f7c415bbc10>, body: {"meta": {"os_distro": "alt"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:34:21.394186 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1054/2216] 10.222.0.60 () {60 vars in 1280 bytes} [Tue Oct 18 15:34:21 2022] PUT /compute/v2.1/images/6a43776a-7b85-436e-a9dc-8164a403f1eb/metadata => generated 62 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 15:34:21.453797 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-052a5fa1-acfc-4ab2-9d60-576816c49731 tempest-ImagesMetadataNegativeTestJSON-1150769155 tempest-ImagesMetadataNegativeTestJSON-1150769155-project] HTTP exception thrown: Image not found. Oct 18 15:34:21.456200 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-052a5fa1-acfc-4ab2-9d60-576816c49731 tempest-ImagesMetadataNegativeTestJSON-1150769155 tempest-ImagesMetadataNegativeTestJSON-1150769155-project] Request method failure captured: Oct 18 15:34:21.456200 n-d-853682-5 devstack@n-api.service[120405]: request: PUT /compute/v2.1/images/d7aa0262-05af-43df-9a9b-91e5861bb961/metadata/os_distro HTTP/1.1 Oct 18 15:34:21.456200 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:34:21.456200 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:34:21.456200 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:34:21.456200 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 30 Oct 18 15:34:21.456200 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:34:21.456200 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:34:21.456200 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:34:21.456200 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:34:21.456200 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsd8j2ggK8PzqkcVxu0saVaZQBhqbhnQvi2NHS_6jBQL9cUlN0eJ5o52yh0_7mQs7-fmdE84PAsz6qwb8lrPW5XGe89BuOaiT-cxmDKqrKAIOo8jtFiVqHBj9gLuDlWEhzg1Tpjbk-R0-OKOZJO4Zkv0ufWQc0kerwalC5AHfHhTcDE Oct 18 15:34:21.456200 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:34:21.456200 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:34:21.456200 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:34:21.456200 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:34:21.456200 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:34:21.456200 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:34:21.456200 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 8ab85bbd71bd49e1a9b83d8c126ea001 Oct 18 15:34:21.456200 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1150769155 Oct 18 15:34:21.456200 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:34:21.456200 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:34:21.457884 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8ab85bbd71bd49e1a9b83d8c126ea001"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8ab85bbd71bd49e1a9b83d8c126ea001"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8ab85bbd71bd49e1a9b83d8c126ea001"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8ab85bbd71bd49e1a9b83d8c126ea001"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:34:21.457884 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1150769155 Oct 18 15:34:21.457884 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 8ab85bbd71bd49e1a9b83d8c126ea001 Oct 18 15:34:21.457884 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1150769155 Oct 18 15:34:21.457884 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ImagesMetadataNegativeTestJSON-1150769155-project Oct 18 15:34:21.457884 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:34:21.457884 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:34:21.457884 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 4f38487cb57c42cbab78d9882ec092e3 Oct 18 15:34:21.457884 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1150769155-project Oct 18 15:34:21.457884 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:34:21.457884 n-d-853682-5 devstack@n-api.service[120405]: {"meta": {"os_distro": "alt"}} Oct 18 15:34:21.457884 n-d-853682-5 devstack@n-api.service[120405]: method: Oct 18 15:34:21.457884 n-d-853682-5 devstack@n-api.service[120405]: exception: Image not found. Oct 18 15:34:21.457884 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'image_id': 'd7aa0262-05af-43df-9a9b-91e5861bb961', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 18 15:34:21.458757 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:34:21.458757 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:21.458757 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 15:34:21.458757 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 15:34:21.458757 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 15:34:21.458757 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 15:34:21.458757 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 15:34:21.458757 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 15:34:21.458757 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 15:34:21.458757 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 15:34:21.458757 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 15:34:21.458757 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 15:34:21.458757 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 15:34:21.458757 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 15:34:21.458757 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 15:34:21.458757 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 15:34:21.458757 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 15:34:21.458757 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 15:34:21.462591 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d7aa0262-05af-43df-9a9b-91e5861bb961 Oct 18 15:34:21.462591 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:21.462591 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:34:21.462591 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:21.462591 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:21.462591 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 18 15:34:21.462591 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 18 15:34:21.462591 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 18 15:34:21.462591 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 18 15:34:21.462591 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 18 15:34:21.462591 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 18 15:34:21.462591 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 18 15:34:21.462591 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 18 15:34:21.462591 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 15:34:21.462591 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 15:34:21.462591 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 15:34:21.462591 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 15:34:21.462591 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 15:34:21.462591 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 15:34:21.465838 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 15:34:21.465838 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 15:34:21.465838 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 15:34:21.465838 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 15:34:21.465838 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 15:34:21.465838 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 15:34:21.465838 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 15:34:21.465838 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 15:34:21.465838 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 15:34:21.465838 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 15:34:21.465838 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d7aa0262-05af-43df-9a9b-91e5861bb961 could not be found. Oct 18 15:34:21.465838 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:21.465838 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:34:21.465838 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:21.465838 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:21.465838 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:34:21.465838 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:34:21.465838 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:34:21.465838 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:34:21.468341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:34:21.468341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:34:21.468341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:34:21.468341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:34:21.468341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:34:21.468341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:34:21.468341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 18 15:34:21.468341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 18 15:34:21.468341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 18 15:34:21.468341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 18 15:34:21.468341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 15:34:21.468341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:21.468341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:34:21.468341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:21.468341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:21.468341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:34:21.468341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:34:21.468341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:34:21.468341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:34:21.468341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 15:34:21.468341 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:21.471596 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-052a5fa1-acfc-4ab2-9d60-576816c49731 tempest-ImagesMetadataNegativeTestJSON-1150769155 tempest-ImagesMetadataNegativeTestJSON-1150769155-project] Returning 404 to user: Image not found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:34:21.471596 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-052a5fa1-acfc-4ab2-9d60-576816c49731 tempest-ImagesMetadataNegativeTestJSON-1150769155 tempest-ImagesMetadataNegativeTestJSON-1150769155-project] 10.222.0.60 "PUT /compute/v2.1/images/d7aa0262-05af-43df-9a9b-91e5861bb961/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.080777 Oct 18 15:34:21.472006 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-efa6390f-efbf-4352-9c11-d8e9d7c784ba tempest-ImagesMetadataNegativeTestJSON-1150769155 tempest-ImagesMetadataNegativeTestJSON-1150769155-project] Action: 'create', calling method: .version_select at 0x7f7c3cfd8160>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:34:21.472218 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1163/2217] 10.222.0.60 () {60 vars in 1310 bytes} [Tue Oct 18 15:34:21 2022] PUT /compute/v2.1/images/d7aa0262-05af-43df-9a9b-91e5861bb961/metadata/os_distro => generated 62 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 15:34:21.505911 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-efa6390f-efbf-4352-9c11-d8e9d7c784ba tempest-ImagesMetadataNegativeTestJSON-1150769155 tempest-ImagesMetadataNegativeTestJSON-1150769155-project] HTTP exception thrown: Image not found. Oct 18 15:34:21.519300 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-efa6390f-efbf-4352-9c11-d8e9d7c784ba tempest-ImagesMetadataNegativeTestJSON-1150769155 tempest-ImagesMetadataNegativeTestJSON-1150769155-project] Request method failure captured: Oct 18 15:34:21.519300 n-d-853682-5 devstack@n-api.service[120406]: request: POST /compute/v2.1/images/a8c40080-8d5b-425e-acf3-e5653e90ca6b/metadata HTTP/1.1 Oct 18 15:34:21.519300 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:34:21.519300 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:34:21.519300 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:34:21.519300 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 57 Oct 18 15:34:21.519300 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:34:21.519300 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:34:21.519300 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:34:21.519300 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:34:21.519300 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsd8j2ggK8PzqkcVxu0saVaZQBhqbhnQvi2NHS_6jBQL9cUlN0eJ5o52yh0_7mQs7-fmdE84PAsz6qwb8lrPW5XGe89BuOaiT-cxmDKqrKAIOo8jtFiVqHBj9gLuDlWEhzg1Tpjbk-R0-OKOZJO4Zkv0ufWQc0kerwalC5AHfHhTcDE Oct 18 15:34:21.519300 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:34:21.519300 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:34:21.519300 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:34:21.519300 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:34:21.519300 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:34:21.519300 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:34:21.519300 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 8ab85bbd71bd49e1a9b83d8c126ea001 Oct 18 15:34:21.519300 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1150769155 Oct 18 15:34:21.519300 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:34:21.519300 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:34:21.520946 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8ab85bbd71bd49e1a9b83d8c126ea001"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8ab85bbd71bd49e1a9b83d8c126ea001"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8ab85bbd71bd49e1a9b83d8c126ea001"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8ab85bbd71bd49e1a9b83d8c126ea001"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:34:21.520946 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1150769155 Oct 18 15:34:21.520946 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 8ab85bbd71bd49e1a9b83d8c126ea001 Oct 18 15:34:21.520946 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1150769155 Oct 18 15:34:21.520946 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ImagesMetadataNegativeTestJSON-1150769155-project Oct 18 15:34:21.520946 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:34:21.520946 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:34:21.520946 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 4f38487cb57c42cbab78d9882ec092e3 Oct 18 15:34:21.520946 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1150769155-project Oct 18 15:34:21.520946 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:34:21.520946 n-d-853682-5 devstack@n-api.service[120406]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 18 15:34:21.520946 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:34:21.520946 n-d-853682-5 devstack@n-api.service[120406]: exception: Image not found. Oct 18 15:34:21.520946 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'image_id': 'a8c40080-8d5b-425e-acf3-e5653e90ca6b', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 18 15:34:21.522092 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:34:21.522092 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:21.522092 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 15:34:21.522092 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 15:34:21.522092 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 15:34:21.522092 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 15:34:21.522092 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 15:34:21.522092 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 15:34:21.522092 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 15:34:21.522092 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 15:34:21.522092 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 15:34:21.522092 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 15:34:21.522092 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 15:34:21.522092 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 15:34:21.522092 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 15:34:21.522092 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 15:34:21.522092 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 15:34:21.522092 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 15:34:21.523478 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a8c40080-8d5b-425e-acf3-e5653e90ca6b Oct 18 15:34:21.523478 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:21.523478 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:34:21.523478 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:21.523478 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:21.523478 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 18 15:34:21.523478 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 18 15:34:21.523478 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 18 15:34:21.523478 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 18 15:34:21.523478 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 18 15:34:21.523478 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 18 15:34:21.523478 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 18 15:34:21.523478 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 18 15:34:21.523478 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 15:34:21.523478 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 15:34:21.523478 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 15:34:21.523478 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 15:34:21.523478 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 15:34:21.523478 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 15:34:21.527148 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 15:34:21.527148 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 15:34:21.527148 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 15:34:21.527148 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 15:34:21.527148 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 15:34:21.527148 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 15:34:21.527148 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 15:34:21.527148 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 15:34:21.527148 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 15:34:21.527148 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 15:34:21.527148 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a8c40080-8d5b-425e-acf3-e5653e90ca6b could not be found. Oct 18 15:34:21.527148 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:21.527148 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:34:21.527148 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:21.527148 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:21.527148 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:34:21.527148 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:34:21.527148 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:34:21.527148 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:34:21.528779 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:34:21.528779 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:34:21.528779 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:34:21.528779 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:34:21.528779 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:34:21.528779 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:34:21.528779 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 18 15:34:21.528779 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 18 15:34:21.528779 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 18 15:34:21.528779 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 18 15:34:21.528779 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 15:34:21.528779 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:21.528779 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:34:21.528779 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:21.528779 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:21.528779 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:34:21.528779 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:34:21.528779 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:34:21.528779 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:34:21.528779 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 15:34:21.528779 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:21.530424 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-efa6390f-efbf-4352-9c11-d8e9d7c784ba tempest-ImagesMetadataNegativeTestJSON-1150769155 tempest-ImagesMetadataNegativeTestJSON-1150769155-project] Returning 404 to user: Image not found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:34:21.530424 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-efa6390f-efbf-4352-9c11-d8e9d7c784ba tempest-ImagesMetadataNegativeTestJSON-1150769155 tempest-ImagesMetadataNegativeTestJSON-1150769155-project] 10.222.0.60 "POST /compute/v2.1/images/a8c40080-8d5b-425e-acf3-e5653e90ca6b/metadata" status: 404 len: 62 microversion: 2.1 time: 0.056648 Oct 18 15:34:21.537630 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1055/2218] 10.222.0.60 () {60 vars in 1281 bytes} [Tue Oct 18 15:34:21 2022] POST /compute/v2.1/images/a8c40080-8d5b-425e-acf3-e5653e90ca6b/metadata => generated 62 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 15:34:21.768130 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e232cf5b-097f-4ed8-8616-12b5aac4cf49 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c415488b0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:21.859485 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e232cf5b-097f-4ed8-8616-12b5aac4cf49 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7" status: 200 len: 1454 microversion: 2.1 time: 0.104061 Oct 18 15:34:21.860861 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1164/2219] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:34:21 2022] GET /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7 => generated 1454 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:22.876492 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-07b1057c-e14e-4402-9bcf-04c32c6594a4 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c3ceeeee0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:22.982546 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-07b1057c-e14e-4402-9bcf-04c32c6594a4 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7" status: 200 len: 1454 microversion: 2.1 time: 0.109030 Oct 18 15:34:22.983163 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1056/2220] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:34:22 2022] GET /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7 => generated 1454 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:24.000721 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ec566a2f-cbda-4f66-a66e-3a45cf40ab9b tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c4154fb80>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:24.511764 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-65aa32e6-b115-421a-9791-c1612a3d460e tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:24.512314 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-65aa32e6-b115-421a-9791-c1612a3d460e tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] [instance: ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:24.527940 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65aa32e6-b115-421a-9791-c1612a3d460e tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:24.528436 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65aa32e6-b115-421a-9791-c1612a3d460e tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:24.535151 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65aa32e6-b115-421a-9791-c1612a3d460e tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:24.538986 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65aa32e6-b115-421a-9791-c1612a3d460e tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:24.542159 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65aa32e6-b115-421a-9791-c1612a3d460e tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:24.542835 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65aa32e6-b115-421a-9791-c1612a3d460e tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:24.585075 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-65aa32e6-b115-421a-9791-c1612a3d460e tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] HTTP exception thrown: Instance ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d could not be found. Oct 18 15:34:24.592475 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-65aa32e6-b115-421a-9791-c1612a3d460e tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Request method failure captured: Oct 18 15:34:24.592475 n-d-853682-5 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d HTTP/1.1 Oct 18 15:34:24.592475 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:34:24.592475 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:34:24.592475 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:34:24.592475 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:34:24.592475 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:34:24.592475 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:34:24.592475 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:34:24.592475 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:34:24.592475 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsb3pfiEaxcnXx3ihmPPXpG7_P6_BfY5Wpx3U9izDjyP4ZKeMoVOYRBLtHkU6k9zvjSPxHpG6JfjUfialgGEewoEmUlRTJv3ueLe74ey6f1lV4D6tvVIl7UCdBjDDPb_LMWkb6yllIK_yimws2bdf7musbVieeZIh26V-IrSnDd0SaM Oct 18 15:34:24.592475 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:34:24.592475 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:34:24.592475 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:34:24.592475 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:34:24.592475 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:34:24.592475 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:34:24.592475 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: b17eee1a6b8d43589bf66e6e18059021 Oct 18 15:34:24.592475 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersTestMultiNic-1438592096 Oct 18 15:34:24.592475 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:34:24.592475 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:34:24.593949 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b17eee1a6b8d43589bf66e6e18059021"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b17eee1a6b8d43589bf66e6e18059021"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b17eee1a6b8d43589bf66e6e18059021"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b17eee1a6b8d43589bf66e6e18059021"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:34:24.593949 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersTestMultiNic-1438592096 Oct 18 15:34:24.593949 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: b17eee1a6b8d43589bf66e6e18059021 Oct 18 15:34:24.593949 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersTestMultiNic-1438592096 Oct 18 15:34:24.593949 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersTestMultiNic-1438592096-project Oct 18 15:34:24.593949 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:34:24.593949 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:34:24.593949 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: db93066933684d41a77863c156deb4da Oct 18 15:34:24.593949 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersTestMultiNic-1438592096-project Oct 18 15:34:24.593949 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:34:24.593949 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d could not be found. Oct 18 15:34:24.593949 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d'} Oct 18 15:34:24.594686 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:34:24.594686 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:24.594686 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:34:24.594686 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:34:24.594686 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:34:24.594686 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:34:24.594686 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:34:24.594686 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:34:24.594686 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:34:24.594686 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:34:24.594686 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d could not be found. Oct 18 15:34:24.594686 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:24.594686 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:34:24.594686 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:24.594686 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:24.594686 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:34:24.594686 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:34:24.594686 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:34:24.594686 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:34:24.594686 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:34:24.595779 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:34:24.595779 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 15:34:24.595779 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 15:34:24.595779 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 15:34:24.595779 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 15:34:24.595779 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:34:24.595779 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:34:24.595779 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:34:24.595779 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:34:24.595779 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d could not be found. Oct 18 15:34:24.595779 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:24.595779 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:34:24.595779 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:24.595779 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:24.595779 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:34:24.595779 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:34:24.595779 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:34:24.595779 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:34:24.595779 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d could not be found. Oct 18 15:34:24.595779 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:24.598956 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-65aa32e6-b115-421a-9791-c1612a3d460e tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Returning 404 to user: Instance ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:34:24.603695 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-65aa32e6-b115-421a-9791-c1612a3d460e tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d" status: 404 len: 111 microversion: 2.1 time: 0.095310 Oct 18 15:34:24.607209 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1057/2221] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:34:24 2022] DELETE /compute/v2.1/servers/ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:34:24.621926 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2fdd14f6-04c3-4f3d-a004-9665cdcfe57d tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:24.627175 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2fdd14f6-04c3-4f3d-a004-9665cdcfe57d tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] [instance: ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:24.670103 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2fdd14f6-04c3-4f3d-a004-9665cdcfe57d tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:24.674259 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2fdd14f6-04c3-4f3d-a004-9665cdcfe57d tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:24.678299 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2fdd14f6-04c3-4f3d-a004-9665cdcfe57d tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:24.682655 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2fdd14f6-04c3-4f3d-a004-9665cdcfe57d tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:24.683557 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2fdd14f6-04c3-4f3d-a004-9665cdcfe57d tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:24.690273 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2fdd14f6-04c3-4f3d-a004-9665cdcfe57d tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:24.742162 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-2fdd14f6-04c3-4f3d-a004-9665cdcfe57d tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] HTTP exception thrown: Instance ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d could not be found. Oct 18 15:34:24.747538 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2fdd14f6-04c3-4f3d-a004-9665cdcfe57d tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Request method failure captured: Oct 18 15:34:24.747538 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d HTTP/1.1 Oct 18 15:34:24.747538 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:34:24.747538 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:34:24.747538 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:34:24.747538 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:34:24.747538 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:34:24.747538 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:34:24.747538 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:34:24.747538 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:34:24.747538 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsb3pfiEaxcnXx3ihmPPXpG7_P6_BfY5Wpx3U9izDjyP4ZKeMoVOYRBLtHkU6k9zvjSPxHpG6JfjUfialgGEewoEmUlRTJv3ueLe74ey6f1lV4D6tvVIl7UCdBjDDPb_LMWkb6yllIK_yimws2bdf7musbVieeZIh26V-IrSnDd0SaM Oct 18 15:34:24.747538 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:34:24.747538 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:34:24.747538 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:34:24.747538 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:34:24.747538 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:34:24.747538 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:34:24.747538 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: b17eee1a6b8d43589bf66e6e18059021 Oct 18 15:34:24.747538 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersTestMultiNic-1438592096 Oct 18 15:34:24.747538 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:34:24.747538 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:34:24.748915 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b17eee1a6b8d43589bf66e6e18059021"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b17eee1a6b8d43589bf66e6e18059021"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b17eee1a6b8d43589bf66e6e18059021"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b17eee1a6b8d43589bf66e6e18059021"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:34:24.748915 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersTestMultiNic-1438592096 Oct 18 15:34:24.748915 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: b17eee1a6b8d43589bf66e6e18059021 Oct 18 15:34:24.748915 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersTestMultiNic-1438592096 Oct 18 15:34:24.748915 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersTestMultiNic-1438592096-project Oct 18 15:34:24.748915 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:34:24.748915 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:34:24.748915 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: db93066933684d41a77863c156deb4da Oct 18 15:34:24.748915 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersTestMultiNic-1438592096-project Oct 18 15:34:24.748915 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:34:24.748915 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d could not be found. Oct 18 15:34:24.748915 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d'} Oct 18 15:34:24.749629 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:34:24.749629 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:24.749629 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:34:24.749629 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:34:24.749629 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:34:24.749629 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:34:24.749629 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:34:24.749629 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:34:24.749629 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:34:24.749629 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:34:24.749629 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d could not be found. Oct 18 15:34:24.749629 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:24.749629 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:34:24.749629 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:24.749629 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:24.749629 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:34:24.749629 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:34:24.749629 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:34:24.749629 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:34:24.749629 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:34:24.750911 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:34:24.750911 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:34:24.750911 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:34:24.750911 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:34:24.750911 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:34:24.750911 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:34:24.750911 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:34:24.750911 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d could not be found. Oct 18 15:34:24.750911 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:24.750911 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:34:24.750911 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:24.750911 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:24.750911 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:34:24.750911 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:34:24.750911 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:34:24.750911 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:34:24.750911 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d could not be found. Oct 18 15:34:24.750911 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:24.751938 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2fdd14f6-04c3-4f3d-a004-9665cdcfe57d tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Returning 404 to user: Instance ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:34:24.753832 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2fdd14f6-04c3-4f3d-a004-9665cdcfe57d tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] 10.222.0.60 "GET /compute/v2.1/servers/ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d" status: 404 len: 111 microversion: 2.1 time: 0.143209 Oct 18 15:34:24.755547 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1058/2222] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:24 2022] GET /compute/v2.1/servers/ec62f6e3-4389-4ab3-b65f-1568d9b3bb5d => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:34:24.771766 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2884b64f-761c-4a32-8b3f-c3010ddf1955 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:24.772280 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2884b64f-761c-4a32-8b3f-c3010ddf1955 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] [instance: 078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:24.797774 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2884b64f-761c-4a32-8b3f-c3010ddf1955 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:24.799223 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2884b64f-761c-4a32-8b3f-c3010ddf1955 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:24.799672 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2884b64f-761c-4a32-8b3f-c3010ddf1955 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:24.803385 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2884b64f-761c-4a32-8b3f-c3010ddf1955 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:24.803914 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2884b64f-761c-4a32-8b3f-c3010ddf1955 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:24.804362 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2884b64f-761c-4a32-8b3f-c3010ddf1955 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:24.861672 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-2884b64f-761c-4a32-8b3f-c3010ddf1955 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] HTTP exception thrown: Instance 078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4 could not be found. Oct 18 15:34:24.866546 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2884b64f-761c-4a32-8b3f-c3010ddf1955 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Request method failure captured: Oct 18 15:34:24.866546 n-d-853682-5 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4 HTTP/1.1 Oct 18 15:34:24.866546 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:34:24.866546 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:34:24.866546 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:34:24.866546 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:34:24.866546 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:34:24.866546 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:34:24.866546 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:34:24.866546 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:34:24.866546 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsb3pfiEaxcnXx3ihmPPXpG7_P6_BfY5Wpx3U9izDjyP4ZKeMoVOYRBLtHkU6k9zvjSPxHpG6JfjUfialgGEewoEmUlRTJv3ueLe74ey6f1lV4D6tvVIl7UCdBjDDPb_LMWkb6yllIK_yimws2bdf7musbVieeZIh26V-IrSnDd0SaM Oct 18 15:34:24.866546 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:34:24.866546 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:34:24.866546 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:34:24.866546 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:34:24.866546 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:34:24.866546 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:34:24.866546 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: b17eee1a6b8d43589bf66e6e18059021 Oct 18 15:34:24.866546 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersTestMultiNic-1438592096 Oct 18 15:34:24.866546 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:34:24.866546 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:34:24.867949 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b17eee1a6b8d43589bf66e6e18059021"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b17eee1a6b8d43589bf66e6e18059021"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b17eee1a6b8d43589bf66e6e18059021"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b17eee1a6b8d43589bf66e6e18059021"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:34:24.867949 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersTestMultiNic-1438592096 Oct 18 15:34:24.867949 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: b17eee1a6b8d43589bf66e6e18059021 Oct 18 15:34:24.867949 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersTestMultiNic-1438592096 Oct 18 15:34:24.867949 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersTestMultiNic-1438592096-project Oct 18 15:34:24.867949 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:34:24.867949 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:34:24.867949 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: db93066933684d41a77863c156deb4da Oct 18 15:34:24.867949 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersTestMultiNic-1438592096-project Oct 18 15:34:24.867949 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:34:24.867949 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4 could not be found. Oct 18 15:34:24.867949 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4'} Oct 18 15:34:24.868687 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:34:24.868687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:24.868687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:34:24.868687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:34:24.868687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:34:24.868687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:34:24.868687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:34:24.868687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:34:24.868687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:34:24.868687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:34:24.868687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4 could not be found. Oct 18 15:34:24.868687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:24.868687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:34:24.868687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:24.868687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:24.868687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:34:24.868687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:34:24.868687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:34:24.868687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:34:24.868687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:34:24.870137 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:34:24.870137 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 15:34:24.870137 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 15:34:24.870137 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 15:34:24.870137 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 15:34:24.870137 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:34:24.870137 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:34:24.870137 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:34:24.870137 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:34:24.870137 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4 could not be found. Oct 18 15:34:24.870137 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:24.870137 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:34:24.870137 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:24.870137 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:24.870137 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:34:24.870137 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:34:24.870137 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:34:24.870137 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:34:24.870137 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4 could not be found. Oct 18 15:34:24.870137 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:24.874531 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2884b64f-761c-4a32-8b3f-c3010ddf1955 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Returning 404 to user: Instance 078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:34:24.877435 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2884b64f-761c-4a32-8b3f-c3010ddf1955 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] 10.222.0.60 "DELETE /compute/v2.1/servers/078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4" status: 404 len: 111 microversion: 2.1 time: 0.116114 Oct 18 15:34:24.887669 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ec566a2f-cbda-4f66-a66e-3a45cf40ab9b tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7" status: 200 len: 1454 microversion: 2.1 time: 0.892517 Oct 18 15:34:24.894261 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1165/2224] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:34:23 2022] GET /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7 => generated 1454 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:24.895023 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1059/2224] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:34:24 2022] DELETE /compute/v2.1/servers/078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:34:24.915046 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a665e072-b8a1-4560-b2f2-f5df60903fc8 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:24.915732 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a665e072-b8a1-4560-b2f2-f5df60903fc8 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] [instance: 078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:24.952742 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a665e072-b8a1-4560-b2f2-f5df60903fc8 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:24.957916 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a665e072-b8a1-4560-b2f2-f5df60903fc8 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:24.961188 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a665e072-b8a1-4560-b2f2-f5df60903fc8 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:24.962285 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a665e072-b8a1-4560-b2f2-f5df60903fc8 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:24.962980 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a665e072-b8a1-4560-b2f2-f5df60903fc8 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:24.965072 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a665e072-b8a1-4560-b2f2-f5df60903fc8 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:24.995293 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-a665e072-b8a1-4560-b2f2-f5df60903fc8 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] HTTP exception thrown: Instance 078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4 could not be found. Oct 18 15:34:25.001637 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a665e072-b8a1-4560-b2f2-f5df60903fc8 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Request method failure captured: Oct 18 15:34:25.001637 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4 HTTP/1.1 Oct 18 15:34:25.001637 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:34:25.001637 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:34:25.001637 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:34:25.001637 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:34:25.001637 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:34:25.001637 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:34:25.001637 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:34:25.001637 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:34:25.001637 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsb3pfiEaxcnXx3ihmPPXpG7_P6_BfY5Wpx3U9izDjyP4ZKeMoVOYRBLtHkU6k9zvjSPxHpG6JfjUfialgGEewoEmUlRTJv3ueLe74ey6f1lV4D6tvVIl7UCdBjDDPb_LMWkb6yllIK_yimws2bdf7musbVieeZIh26V-IrSnDd0SaM Oct 18 15:34:25.001637 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:34:25.001637 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:34:25.001637 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:34:25.001637 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:34:25.001637 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:34:25.001637 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:34:25.001637 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: b17eee1a6b8d43589bf66e6e18059021 Oct 18 15:34:25.001637 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServersTestMultiNic-1438592096 Oct 18 15:34:25.001637 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:34:25.001637 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:34:25.003328 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b17eee1a6b8d43589bf66e6e18059021"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b17eee1a6b8d43589bf66e6e18059021"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b17eee1a6b8d43589bf66e6e18059021"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b17eee1a6b8d43589bf66e6e18059021"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:34:25.003328 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServersTestMultiNic-1438592096 Oct 18 15:34:25.003328 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: b17eee1a6b8d43589bf66e6e18059021 Oct 18 15:34:25.003328 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServersTestMultiNic-1438592096 Oct 18 15:34:25.003328 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServersTestMultiNic-1438592096-project Oct 18 15:34:25.003328 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:34:25.003328 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:34:25.003328 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: db93066933684d41a77863c156deb4da Oct 18 15:34:25.003328 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServersTestMultiNic-1438592096-project Oct 18 15:34:25.003328 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:34:25.003328 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4 could not be found. Oct 18 15:34:25.003328 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4'} Oct 18 15:34:25.004003 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:34:25.004003 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:25.004003 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:34:25.004003 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:34:25.004003 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:34:25.004003 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:34:25.004003 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:34:25.004003 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:34:25.004003 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:34:25.004003 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:34:25.004003 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4 could not be found. Oct 18 15:34:25.004003 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:25.004003 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:34:25.004003 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:25.004003 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:25.004003 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:34:25.004003 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:34:25.004003 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:34:25.004003 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:34:25.004003 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:34:25.006174 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:34:25.006174 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:34:25.006174 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:34:25.006174 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:34:25.006174 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:34:25.006174 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:34:25.006174 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:34:25.006174 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4 could not be found. Oct 18 15:34:25.006174 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:25.006174 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:34:25.006174 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:25.006174 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:25.006174 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:34:25.006174 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:34:25.006174 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:34:25.006174 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:34:25.006174 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4 could not be found. Oct 18 15:34:25.006174 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:25.015917 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a665e072-b8a1-4560-b2f2-f5df60903fc8 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] Returning 404 to user: Instance 078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:34:25.018233 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a665e072-b8a1-4560-b2f2-f5df60903fc8 tempest-ServersTestMultiNic-1438592096 tempest-ServersTestMultiNic-1438592096-project] 10.222.0.60 "GET /compute/v2.1/servers/078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4" status: 404 len: 111 microversion: 2.1 time: 0.122007 Oct 18 15:34:25.036015 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1166/2225] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:24 2022] GET /compute/v2.1/servers/078f9d8f-c2d8-4c6d-b5b9-e7c3554cebe4 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:34:25.908299 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a2f4c80b-44df-4886-bf73-2f71af9d8faf tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c3cef01f0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:26.538838 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a2f4c80b-44df-4886-bf73-2f71af9d8faf tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7" status: 200 len: 1454 microversion: 2.1 time: 0.627376 Oct 18 15:34:26.539682 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1060/2226] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:34:25 2022] GET /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7 => generated 1454 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:27.033791 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b905420f-7866-43af-ace3-58c45a9b6931 tempest-KeyPairsV2TestJSON-681326840 tempest-KeyPairsV2TestJSON-681326840-project] Action: 'create', calling method: .version_select at 0x7f7c41548d30>, body: {"keypair": {"name": "tempest-keypair-1591786999", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJ2oWi58w2UIKphqxdl4qVfUbaCQaZle2uNB07DLUm0HVGMltnNDc51E+OR9EHzOtRbxvSYac8ZbZPx22TM0pMJyYthd8u2yZMyVetZAbg4hdRjK36PdU2Jm0dXa3+rbw=="}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:34:27.088866 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-b905420f-7866-43af-ace3-58c45a9b6931 tempest-KeyPairsV2TestJSON-681326840 tempest-KeyPairsV2TestJSON-681326840-project] Getting quotas for project 358f43d752c046e2b6729d02d102bb5f. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:34:27.114550 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-b905420f-7866-43af-ace3-58c45a9b6931 tempest-KeyPairsV2TestJSON-681326840 tempest-KeyPairsV2TestJSON-681326840-project] Getting quotas for user 2b178f6aec914ef9804e941a0f66619f and project 358f43d752c046e2b6729d02d102bb5f. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:34:27.215335 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b905420f-7866-43af-ace3-58c45a9b6931 tempest-KeyPairsV2TestJSON-681326840 tempest-KeyPairsV2TestJSON-681326840-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.602793 Oct 18 15:34:27.225693 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1167/2227] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Oct 18 15:34:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:34:27.230940 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-52a9f731-12bc-4ffe-9789-8e08818d2a79 tempest-KeyPairsV2TestJSON-681326840 tempest-KeyPairsV2TestJSON-681326840-project] Calling method '.version_select at 0x7f7c3d0249d0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:27.265237 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-52a9f731-12bc-4ffe-9789-8e08818d2a79 tempest-KeyPairsV2TestJSON-681326840 tempest-KeyPairsV2TestJSON-681326840-project] 10.222.0.60 "GET /compute/v2.1/os-keypairs/tempest-keypair-1591786999" status: 200 len: 498 microversion: 2.1 time: 0.035520 Oct 18 15:34:27.280340 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1061/2228] 10.222.0.60 () {58 vars in 1218 bytes} [Tue Oct 18 15:34:27 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1591786999 => generated 498 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:34:27.280939 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-78ddfc91-b36b-4697-9170-d5a058bf6ea7 tempest-KeyPairsV2TestJSON-681326840 tempest-KeyPairsV2TestJSON-681326840-project] Calling method '.version_select at 0x7f7c3d6f9c10>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:27.326235 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-78ddfc91-b36b-4697-9170-d5a058bf6ea7 tempest-KeyPairsV2TestJSON-681326840 tempest-KeyPairsV2TestJSON-681326840-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1591786999" status: 202 len: 0 microversion: 2.1 time: 0.049513 Oct 18 15:34:27.326937 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1168/2229] 10.222.0.60 () {58 vars in 1221 bytes} [Tue Oct 18 15:34:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1591786999 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:34:27.354641 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c4304ced-8e58-49f6-8b79-1d90400d5f84 tempest-KeyPairsV2TestJSON-681326840 tempest-KeyPairsV2TestJSON-681326840-project] Action: 'create', calling method: .version_select at 0x7f7c3cef0dc0>, body: {"keypair": {"name": "tempest-keypair-95023514", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAL1cuxLT33RJEgSpLALTS+2n8IVu3bK5PdNYintOUOJLDoWPaUZfMEIXSM8BUPVTPZARPXSDsMok+UOzDLnx5MubJDCzdwdQ8adl4GRvFGNmY36T0ZoqXlE1qxNz4ZXgw=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:34:27.388224 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-c4304ced-8e58-49f6-8b79-1d90400d5f84 tempest-KeyPairsV2TestJSON-681326840 tempest-KeyPairsV2TestJSON-681326840-project] Getting quotas for project 358f43d752c046e2b6729d02d102bb5f. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:34:27.402897 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-c4304ced-8e58-49f6-8b79-1d90400d5f84 tempest-KeyPairsV2TestJSON-681326840 tempest-KeyPairsV2TestJSON-681326840-project] Getting quotas for user 2b178f6aec914ef9804e941a0f66619f and project 358f43d752c046e2b6729d02d102bb5f. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:34:27.410778 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:34:27.463587 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c4304ced-8e58-49f6-8b79-1d90400d5f84 tempest-KeyPairsV2TestJSON-681326840 tempest-KeyPairsV2TestJSON-681326840-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.121251 Oct 18 15:34:27.468461 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1062/2230] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Oct 18 15:34:27 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:34:27.480333 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-44ba2576-f604-470a-8238-16cf5eff3adb tempest-KeyPairsV2TestJSON-681326840 tempest-KeyPairsV2TestJSON-681326840-project] Calling method '.version_select at 0x7f7c4154d790>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:27.532886 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-44ba2576-f604-470a-8238-16cf5eff3adb tempest-KeyPairsV2TestJSON-681326840 tempest-KeyPairsV2TestJSON-681326840-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-95023514" status: 202 len: 0 microversion: 2.1 time: 0.056461 Oct 18 15:34:27.535319 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1169/2231] 10.222.0.60 () {58 vars in 1215 bytes} [Tue Oct 18 15:34:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-95023514 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:34:27.545761 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-09d36a07-66da-4a1a-8922-e0724d2d0bda tempest-KeyPairsV2TestJSON-681326840 tempest-KeyPairsV2TestJSON-681326840-project] Action: 'create', calling method: .version_select at 0x7f7c3d024160>, body: {"keypair": {"name": "tempest-keypair-1846911844", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:34:27.561241 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a1ee6ced-ddcd-4f8a-ab56-a46dbf1d612d tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c41553160>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:27.588080 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-09d36a07-66da-4a1a-8922-e0724d2d0bda tempest-KeyPairsV2TestJSON-681326840 tempest-KeyPairsV2TestJSON-681326840-project] Getting quotas for project 358f43d752c046e2b6729d02d102bb5f. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:34:27.622261 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-09d36a07-66da-4a1a-8922-e0724d2d0bda tempest-KeyPairsV2TestJSON-681326840 tempest-KeyPairsV2TestJSON-681326840-project] Getting quotas for user 2b178f6aec914ef9804e941a0f66619f and project 358f43d752c046e2b6729d02d102bb5f. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:34:27.651508 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a1ee6ced-ddcd-4f8a-ab56-a46dbf1d612d tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7" status: 200 len: 1463 microversion: 2.1 time: 0.097805 Oct 18 15:34:27.666172 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1170/2232] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:34:27 2022] GET /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7 => generated 1463 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:34:27.675460 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-56d52128-1957-4363-93b7-9ea68cffce8c tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c41551700>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:27.735692 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-09d36a07-66da-4a1a-8922-e0724d2d0bda tempest-KeyPairsV2TestJSON-681326840 tempest-KeyPairsV2TestJSON-681326840-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.194030 Oct 18 15:34:27.738172 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1063/2233] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Oct 18 15:34:27 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:34:27.752134 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c82a441a-52a0-4bd3-be16-f3a1e842cd6b tempest-KeyPairsV2TestJSON-681326840 tempest-KeyPairsV2TestJSON-681326840-project] Calling method '.version_select at 0x7f7c3d01f4c0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:27.756874 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-56d52128-1957-4363-93b7-9ea68cffce8c tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7" status: 200 len: 1463 microversion: 2.1 time: 0.089281 Oct 18 15:34:27.757416 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1171/2234] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:34:27 2022] GET /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7 => generated 1463 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:27.779924 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ae9e7b7b-c178-44e5-b649-f3baf4b1d219 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:27.781425 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c82a441a-52a0-4bd3-be16-f3a1e842cd6b tempest-KeyPairsV2TestJSON-681326840 tempest-KeyPairsV2TestJSON-681326840-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1846911844" status: 202 len: 0 microversion: 2.1 time: 0.035301 Oct 18 15:34:27.782753 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1064/2235] 10.222.0.60 () {58 vars in 1221 bytes} [Tue Oct 18 15:34:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1846911844 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 15:34:27.783327 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ae9e7b7b-c178-44e5-b649-f3baf4b1d219 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] [instance: 4e1ae723-8f58-4752-b578-da0b39e9a668] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:27.797961 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae9e7b7b-c178-44e5-b649-f3baf4b1d219 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:27.798494 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a5daf9e1-38d6-4878-8052-f3bae556da8b tempest-KeyPairsV2TestJSON-681326840 tempest-KeyPairsV2TestJSON-681326840-project] Action: 'create', calling method: .version_select at 0x7f7c3d024f70>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1012567110", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPKI9S6XJJHr/IckZ+AkvV4JueB6n7E6TO2vfRZyOp356Vn6cbJZtZsp557ceS1ehi0JpkUnFnxiENtxMNkArkjgP3VlhJJGnRbA113O0542x8nvcs4jWRVA6TqdIxas9w=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:34:27.799180 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae9e7b7b-c178-44e5-b649-f3baf4b1d219 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:27.801091 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae9e7b7b-c178-44e5-b649-f3baf4b1d219 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:27.801981 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae9e7b7b-c178-44e5-b649-f3baf4b1d219 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:27.804222 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae9e7b7b-c178-44e5-b649-f3baf4b1d219 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:27.804883 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae9e7b7b-c178-44e5-b649-f3baf4b1d219 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:27.839807 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-a5daf9e1-38d6-4878-8052-f3bae556da8b tempest-KeyPairsV2TestJSON-681326840 tempest-KeyPairsV2TestJSON-681326840-project] Getting quotas for project 358f43d752c046e2b6729d02d102bb5f. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:34:27.862258 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-a5daf9e1-38d6-4878-8052-f3bae556da8b tempest-KeyPairsV2TestJSON-681326840 tempest-KeyPairsV2TestJSON-681326840-project] Getting quotas for user 2b178f6aec914ef9804e941a0f66619f and project 358f43d752c046e2b6729d02d102bb5f. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:34:27.953048 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a5daf9e1-38d6-4878-8052-f3bae556da8b tempest-KeyPairsV2TestJSON-681326840 tempest-KeyPairsV2TestJSON-681326840-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.160333 Oct 18 15:34:27.953763 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1065/2236] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Oct 18 15:34:27 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:34:28.174827 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-378b3072-0f97-489a-ae0b-1a3d043ba877 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1172670011", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:34:28.242333 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-378b3072-0f97-489a-ae0b-1a3d043ba877 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] validate_networks() for None {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:34:28.837335 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ae9e7b7b-c178-44e5-b649-f3baf4b1d219 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f901dea4594eb6831a78e2e603e8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c369c078bd4c49148290abb7de3d076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:28.858123 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ae9e7b7b-c178-44e5-b649-f3baf4b1d219 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/servers/4e1ae723-8f58-4752-b578-da0b39e9a668" status: 200 len: 1467 microversion: 2.1 time: 1.082929 Oct 18 15:34:28.886448 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1172/2237] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:27 2022] GET /compute/v2.1/servers/4e1ae723-8f58-4752-b578-da0b39e9a668 => generated 1467 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:28.891894 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b9f907ac-ddb7-48ad-b49a-100b50d18031 tempest-KeyPairsV2TestJSON-681326840 tempest-KeyPairsV2TestJSON-681326840-project] Action: 'create', calling method: .version_select at 0x7f7c41548700>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1722648128", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA0PgzmJ92PENOmJ2UpV2Le5OpaP/Ctr9KtyUAoru3wBZsBS9sNpwjQK2ES1uRl61gVjMG5e5sYjhhhkaSrfCQ6ZG3u9H0GzdrvAzxCsiWT2im12vv3IOTY505QUoNjbBQ=="}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:34:28.940876 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-b9f907ac-ddb7-48ad-b49a-100b50d18031 tempest-KeyPairsV2TestJSON-681326840 tempest-KeyPairsV2TestJSON-681326840-project] Getting quotas for project 358f43d752c046e2b6729d02d102bb5f. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:34:28.947471 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-b9f907ac-ddb7-48ad-b49a-100b50d18031 tempest-KeyPairsV2TestJSON-681326840 tempest-KeyPairsV2TestJSON-681326840-project] Getting quotas for user 2b178f6aec914ef9804e941a0f66619f and project 358f43d752c046e2b6729d02d102bb5f. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:34:29.003795 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b9f907ac-ddb7-48ad-b49a-100b50d18031 tempest-KeyPairsV2TestJSON-681326840 tempest-KeyPairsV2TestJSON-681326840-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.115701 Oct 18 15:34:29.012687 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1173/2238] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Oct 18 15:34:28 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:34:29.014499 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5c80caa9-fc39-4410-bee3-d1bf51bf08a5 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c415e6e50>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:29.240091 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5c80caa9-fc39-4410-bee3-d1bf51bf08a5 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images?changes-since=2022-10-18T15%3A31%3A34Z" status: 200 len: 2328 microversion: 2.1 time: 0.233977 Oct 18 15:34:29.241210 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1174/2239] 10.222.0.60 () {58 vars in 1199 bytes} [Tue Oct 18 15:34:29 2022] GET /compute/v2.1/images?changes-since=2022-10-18T15%3A31%3A34Z => generated 2328 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:29.258460 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-60ebf81b-b2a0-4b96-a51e-f25affd0f6c2 tempest-KeyPairsV2TestJSON-681326840 tempest-KeyPairsV2TestJSON-681326840-project] Action: 'create', calling method: .version_select at 0x7f7c41544820>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1419992584", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI9Mn79Eupw9FDp2wpVVPgjHRm1tPHAXweO19w3nHRGQNE/A79oatFsB/pVPTMHpTrHzDmhg6h5yYpDujQaAxujzkdqmiDt0iN/IL1SoWZMsVU0FQSp9BGGFTqdPo1V/dA=="}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:34:29.280189 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=10 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:34:29.286189 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-60ebf81b-b2a0-4b96-a51e-f25affd0f6c2 tempest-KeyPairsV2TestJSON-681326840 tempest-KeyPairsV2TestJSON-681326840-project] Getting quotas for project 358f43d752c046e2b6729d02d102bb5f. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:34:29.302121 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-60ebf81b-b2a0-4b96-a51e-f25affd0f6c2 tempest-KeyPairsV2TestJSON-681326840 tempest-KeyPairsV2TestJSON-681326840-project] Getting quotas for user 2b178f6aec914ef9804e941a0f66619f and project 358f43d752c046e2b6729d02d102bb5f. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:34:29.375737 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-60ebf81b-b2a0-4b96-a51e-f25affd0f6c2 tempest-KeyPairsV2TestJSON-681326840 tempest-KeyPairsV2TestJSON-681326840-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.121786 Oct 18 15:34:29.382403 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1175/2240] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Oct 18 15:34:29 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:34:29.388233 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4a4b540a-e07e-4bb8-8ede-a4392dc29bc0 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c415488b0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:29.530268 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4a4b540a-e07e-4bb8-8ede-a4392dc29bc0 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-810487769" status: 200 len: 484 microversion: 2.1 time: 0.146443 Oct 18 15:34:29.531390 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1176/2241] 10.222.0.60 () {58 vars in 1229 bytes} [Tue Oct 18 15:34:29 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-810487769 => generated 484 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:34:29.538728 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-378b3072-0f97-489a-ae0b-1a3d043ba877 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:34:29.538728 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-378b3072-0f97-489a-ae0b-1a3d043ba877 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:34:29.539314 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-378b3072-0f97-489a-ae0b-1a3d043ba877 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:34:29.539627 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-378b3072-0f97-489a-ae0b-1a3d043ba877 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:34:29.540050 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-378b3072-0f97-489a-ae0b-1a3d043ba877 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:34:29.545529 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8d8fc3f5-866e-4984-b3b5-d92c366d5073 tempest-KeyPairsV2TestJSON-681326840 tempest-KeyPairsV2TestJSON-681326840-project] Calling method '.version_select at 0x7f7c41575a60>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:29.550838 n-d-853682-5 devstack@n-api.service[120405]: WARNING oslo_db.sqlalchemy.utils [None req-8d8fc3f5-866e-4984-b3b5-d92c366d5073 tempest-KeyPairsV2TestJSON-681326840 tempest-KeyPairsV2TestJSON-681326840-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 18 15:34:29.557891 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-378b3072-0f97-489a-ae0b-1a3d043ba877 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:29.558395 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-378b3072-0f97-489a-ae0b-1a3d043ba877 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:29.558844 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-378b3072-0f97-489a-ae0b-1a3d043ba877 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:29.559603 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-378b3072-0f97-489a-ae0b-1a3d043ba877 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:29.560069 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-378b3072-0f97-489a-ae0b-1a3d043ba877 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:29.560496 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-378b3072-0f97-489a-ae0b-1a3d043ba877 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:29.563733 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8d8fc3f5-866e-4984-b3b5-d92c366d5073 tempest-KeyPairsV2TestJSON-681326840 tempest-KeyPairsV2TestJSON-681326840-project] 10.222.0.60 "GET /compute/v2.1/os-keypairs" status: 200 len: 1094 microversion: 2.1 time: 0.030903 Oct 18 15:34:29.565323 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1177/2242] 10.222.0.60 () {58 vars in 1137 bytes} [Tue Oct 18 15:34:29 2022] GET /compute/v2.1/os-keypairs => generated 1094 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:29.580404 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2cac6789-58e8-46b1-8d29-9b886c113c17 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c41684670>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:29.611637 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-378b3072-0f97-489a-ae0b-1a3d043ba877 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Getting quotas for project c357719084cd4fc4ae89b665a6aca5dd. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:34:29.637608 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-378b3072-0f97-489a-ae0b-1a3d043ba877 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Getting quotas for user 05be677eedec4a69b3da6e417f5201b1 and project c357719084cd4fc4ae89b665a6aca5dd. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:34:29.711172 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-378b3072-0f97-489a-ae0b-1a3d043ba877 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:34:29.714131 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-378b3072-0f97-489a-ae0b-1a3d043ba877 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] [instance: 1931cdff-d761-428e-9b1c-38172c965058] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:34:29.815722 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-378b3072-0f97-489a-ae0b-1a3d043ba877 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.859677 Oct 18 15:34:29.818832 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1066/2243] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:34:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1864 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:34:29.833582 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5db48163-04c0-4961-ae51-9a59d2bd5f49 tempest-KeyPairsV2TestJSON-681326840 tempest-KeyPairsV2TestJSON-681326840-project] Calling method '.version_select at 0x7f7c3d39fee0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:29.838656 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2cac6789-58e8-46b1-8d29-9b886c113c17 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images?server=4e1ae723-8f58-4752-b578-da0b39e9a668" status: 200 len: 956 microversion: 2.1 time: 0.266176 Oct 18 15:34:29.839350 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1178/2244] 10.222.0.60 () {58 vars in 1209 bytes} [Tue Oct 18 15:34:29 2022] GET /compute/v2.1/images?server=4e1ae723-8f58-4752-b578-da0b39e9a668 => generated 956 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:34:29.874970 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6a183f6a-9c33-4d32-a06f-7cf912c40233 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:29.876360 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6a183f6a-9c33-4d32-a06f-7cf912c40233 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] [instance: 1931cdff-d761-428e-9b1c-38172c965058] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:29.912713 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5db48163-04c0-4961-ae51-9a59d2bd5f49 tempest-KeyPairsV2TestJSON-681326840 tempest-KeyPairsV2TestJSON-681326840-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1419992584" status: 202 len: 0 microversion: 2.1 time: 0.087766 Oct 18 15:34:29.914678 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1067/2245] 10.222.0.60 () {58 vars in 1278 bytes} [Tue Oct 18 15:34:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1419992584 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:34:29.939330 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-26d5b19e-2c95-4e50-9902-d32e06af02f1 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c3cf5a4c0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:30.023581 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=8 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:34:30.060415 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-26d5b19e-2c95-4e50-9902-d32e06af02f1 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.60%2Fcompute%2Fv2.1%2Fservers%2F0d0c7fc6-9245-41f3-9257-d2b8955a6d4d" status: 200 len: 485 microversion: 2.1 time: 0.139672 Oct 18 15:34:30.062574 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1068/2246] 10.222.0.60 () {58 vars in 1317 bytes} [Tue Oct 18 15:34:29 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.60%2Fcompute%2Fv2.1%2Fservers%2F0d0c7fc6-9245-41f3-9257-d2b8955a6d4d => generated 485 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:34:30.074236 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-184d549f-7bcd-4558-a253-0c8984401fdf tempest-KeyPairsV2TestJSON-681326840 tempest-KeyPairsV2TestJSON-681326840-project] Calling method '.version_select at 0x7f7c3cf5e670>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:30.139306 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-184d549f-7bcd-4558-a253-0c8984401fdf tempest-KeyPairsV2TestJSON-681326840 tempest-KeyPairsV2TestJSON-681326840-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1722648128" status: 202 len: 0 microversion: 2.1 time: 0.070956 Oct 18 15:34:30.143016 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1069/2247] 10.222.0.60 () {58 vars in 1278 bytes} [Tue Oct 18 15:34:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1722648128 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:34:30.174546 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d33938f5-c125-4d8e-85ae-e8f6e9915395 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c3cfd8940>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:30.240266 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d33938f5-c125-4d8e-85ae-e8f6e9915395 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.60%2Fcompute%2Fservers%2F0d0c7fc6-9245-41f3-9257-d2b8955a6d4d" status: 200 len: 485 microversion: 2.1 time: 0.095571 Oct 18 15:34:30.249028 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1070/2248] 10.222.0.60 () {58 vars in 1303 bytes} [Tue Oct 18 15:34:30 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.60%2Fcompute%2Fservers%2F0d0c7fc6-9245-41f3-9257-d2b8955a6d4d => generated 485 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:34:30.249028 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d2422746-dd59-42cb-abf5-d8a847364a2d tempest-KeyPairsV2TestJSON-681326840 tempest-KeyPairsV2TestJSON-681326840-project] Calling method '.version_select at 0x7f7c3ce923a0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:30.275734 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d2422746-dd59-42cb-abf5-d8a847364a2d tempest-KeyPairsV2TestJSON-681326840 tempest-KeyPairsV2TestJSON-681326840-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1012567110" status: 202 len: 0 microversion: 2.1 time: 0.033295 Oct 18 15:34:30.277011 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1071/2249] 10.222.0.60 () {58 vars in 1278 bytes} [Tue Oct 18 15:34:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1012567110 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:34:30.310251 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2432ceb7-58d3-4bda-aaf5-c097b249c00a tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c3d0245e0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:30.492228 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6a183f6a-9c33-4d32-a06f-7cf912c40233 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05be677eedec4a69b3da6e417f5201b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c357719084cd4fc4ae89b665a6aca5dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:30.518711 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6a183f6a-9c33-4d32-a06f-7cf912c40233 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] 10.222.0.60 "GET /compute/v2.1/servers/1931cdff-d761-428e-9b1c-38172c965058" status: 200 len: 1223 microversion: 2.1 time: 0.676749 Oct 18 15:34:30.520130 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1179/2250] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:29 2022] GET /compute/v2.1/servers/1931cdff-d761-428e-9b1c-38172c965058 => generated 1223 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:30.543421 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2432ceb7-58d3-4bda-aaf5-c097b249c00a tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3706 microversion: 2.1 time: 0.249157 Oct 18 15:34:30.553401 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1072/2251] 10.222.0.60 () {58 vars in 1149 bytes} [Tue Oct 18 15:34:30 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3706 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:30.570116 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9ad67caa-e237-4110-b790-67cda70eee59 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c41548dc0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:30.740889 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9ad67caa-e237-4110-b790-67cda70eee59 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.175636 Oct 18 15:34:30.743013 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1180/2252] 10.222.0.60 () {58 vars in 1149 bytes} [Tue Oct 18 15:34:30 2022] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:34:30.757364 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2bd43953-0920-4824-8d01-63882d401042 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c3d01f430>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:30.827669 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-77d77b7c-2fed-4af6-8409-a33568829fc7 req-6eb489ce-d72e-4009-b100-ba9286ed8347 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e1ae723-8f58-4752-b578-da0b39e9a668", "name": "network-vif-unplugged", "status": "completed", "tag": "2083c6f4-97f8-4301-a307-2ecb7417f192"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:34:30.862445 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-77d77b7c-2fed-4af6-8409-a33568829fc7 req-6eb489ce-d72e-4009-b100-ba9286ed8347 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:30.864307 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-77d77b7c-2fed-4af6-8409-a33568829fc7 req-6eb489ce-d72e-4009-b100-ba9286ed8347 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:30.867130 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-77d77b7c-2fed-4af6-8409-a33568829fc7 req-6eb489ce-d72e-4009-b100-ba9286ed8347 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:30.901283 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-77d77b7c-2fed-4af6-8409-a33568829fc7 req-6eb489ce-d72e-4009-b100-ba9286ed8347 service nova] Creating event network-vif-unplugged:2083c6f4-97f8-4301-a307-2ecb7417f192 for instance 4e1ae723-8f58-4752-b578-da0b39e9a668 on n-h1-853682-5 Oct 18 15:34:30.913544 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-77d77b7c-2fed-4af6-8409-a33568829fc7 req-6eb489ce-d72e-4009-b100-ba9286ed8347 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087437 Oct 18 15:34:30.919904 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1181/2253] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:34:30.955095 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2bd43953-0920-4824-8d01-63882d401042 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.201653 Oct 18 15:34:30.966431 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1073/2254] 10.222.0.60 () {58 vars in 1137 bytes} [Tue Oct 18 15:34:30 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:34:30.989572 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-962074d0-1de3-4161-a786-02302bf6e316 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c415448b0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:31.259366 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-962074d0-1de3-4161-a786-02302bf6e316 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/detail?changes-since=2022-10-18T15%3A31%3A30Z" status: 200 len: 7021 microversion: 2.1 time: 0.293324 Oct 18 15:34:31.259996 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1182/2255] 10.222.0.60 () {58 vars in 1220 bytes} [Tue Oct 18 15:34:30 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-18T15%3A31%3A30Z => generated 7021 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:31.288864 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7b3f1e4b-6b36-469f-87ca-6ef54add76ba tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c3cf9d310>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:31.419865 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7b3f1e4b-6b36-469f-87ca-6ef54add76ba tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-810487769" status: 200 len: 664 microversion: 2.1 time: 0.140613 Oct 18 15:34:31.427513 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1074/2256] 10.222.0.60 () {58 vars in 1250 bytes} [Tue Oct 18 15:34:31 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-810487769 => generated 664 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:34:31.439347 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e4937f4b-8d12-4423-a5b2-5b2a3a7ab0c8 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c415488b0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:31.522179 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e4937f4b-8d12-4423-a5b2-5b2a3a7ab0c8 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.60%2Fcompute%2Fv2.1%2Fservers%2F0d0c7fc6-9245-41f3-9257-d2b8955a6d4d" status: 200 len: 1467 microversion: 2.1 time: 0.086045 Oct 18 15:34:31.528076 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1183/2257] 10.222.0.60 () {58 vars in 1338 bytes} [Tue Oct 18 15:34:31 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.60%2Fcompute%2Fv2.1%2Fservers%2F0d0c7fc6-9245-41f3-9257-d2b8955a6d4d => generated 1467 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:34:31.548717 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-340e7d17-065e-43a5-88d9-1a9c549230eb tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c41684790>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:31.549478 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-78edbd64-565d-4c88-9b29-99fe5136017e tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:31.550322 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-78edbd64-565d-4c88-9b29-99fe5136017e tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] [instance: 1931cdff-d761-428e-9b1c-38172c965058] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:31.572892 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-78edbd64-565d-4c88-9b29-99fe5136017e tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:31.574741 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-78edbd64-565d-4c88-9b29-99fe5136017e tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:31.576482 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-78edbd64-565d-4c88-9b29-99fe5136017e tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:31.578990 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-78edbd64-565d-4c88-9b29-99fe5136017e tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:31.580054 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-78edbd64-565d-4c88-9b29-99fe5136017e tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:31.584088 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-78edbd64-565d-4c88-9b29-99fe5136017e tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:31.693413 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-340e7d17-065e-43a5-88d9-1a9c549230eb tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.60%2Fcompute%2Fservers%2F0d0c7fc6-9245-41f3-9257-d2b8955a6d4d" status: 200 len: 1467 microversion: 2.1 time: 0.148936 Oct 18 15:34:31.706299 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1184/2258] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Oct 18 15:34:31 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.60%2Fcompute%2Fservers%2F0d0c7fc6-9245-41f3-9257-d2b8955a6d4d => generated 1467 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:31.712240 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ee153282-91b8-467b-952f-5e9afe91da60 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c415e6040>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:31.849009 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ee153282-91b8-467b-952f-5e9afe91da60 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7796 microversion: 2.1 time: 0.140505 Oct 18 15:34:31.864478 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1185/2259] 10.222.0.60 () {58 vars in 1170 bytes} [Tue Oct 18 15:34:31 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7796 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:34:31.870369 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b1ad6a9f-d43a-419a-9e75-2c67a39c03a0 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c41548280>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:31.988614 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-78edbd64-565d-4c88-9b29-99fe5136017e tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05be677eedec4a69b3da6e417f5201b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c357719084cd4fc4ae89b665a6aca5dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:31.993687 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b1ad6a9f-d43a-419a-9e75-2c67a39c03a0 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4375 microversion: 2.1 time: 0.117496 Oct 18 15:34:31.994326 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-78edbd64-565d-4c88-9b29-99fe5136017e tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] 10.222.0.60 "GET /compute/v2.1/servers/1931cdff-d761-428e-9b1c-38172c965058" status: 200 len: 1275 microversion: 2.1 time: 0.453684 Oct 18 15:34:31.995135 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1186/2260] 10.222.0.60 () {58 vars in 1170 bytes} [Tue Oct 18 15:34:31 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4375 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:34:32.003559 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1075/2261] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:31 2022] GET /compute/v2.1/servers/1931cdff-d761-428e-9b1c-38172c965058 => generated 1275 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:32.014553 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d6ab2417-f909-4ae1-9fec-622996e428fe tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c415bb5e0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:32.112352 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d6ab2417-f909-4ae1-9fec-622996e428fe tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/8f4db252-bff6-4685-9c8d-4c5d6bd9f78b" status: 200 len: 784 microversion: 2.1 time: 0.100352 Oct 18 15:34:32.120840 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1187/2262] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:34:32 2022] GET /compute/v2.1/images/8f4db252-bff6-4685-9c8d-4c5d6bd9f78b => generated 784 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:34:32.136575 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fdf149f1-bad2-4916-a305-1963eb00c15d tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c3cfa0b80>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:32.259758 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fdf149f1-bad2-4916-a305-1963eb00c15d tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1610 microversion: 2.1 time: 0.114904 Oct 18 15:34:32.264741 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1076/2263] 10.222.0.60 () {58 vars in 1158 bytes} [Tue Oct 18 15:34:32 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1610 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:32.282970 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-92925667-c88a-4daf-8f3f-10409966e79c tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c415fd790>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:33.028928 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a3c62746-b966-4365-bb43-cbbab5f7772c tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:33.030099 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a3c62746-b966-4365-bb43-cbbab5f7772c tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] [instance: 1931cdff-d761-428e-9b1c-38172c965058] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:33.057626 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3c62746-b966-4365-bb43-cbbab5f7772c tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:33.058306 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3c62746-b966-4365-bb43-cbbab5f7772c tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:33.058980 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3c62746-b966-4365-bb43-cbbab5f7772c tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:33.059868 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3c62746-b966-4365-bb43-cbbab5f7772c tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:33.060484 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3c62746-b966-4365-bb43-cbbab5f7772c tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:33.061098 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3c62746-b966-4365-bb43-cbbab5f7772c tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:33.200492 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a3c62746-b966-4365-bb43-cbbab5f7772c tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05be677eedec4a69b3da6e417f5201b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c357719084cd4fc4ae89b665a6aca5dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:33.216415 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a3c62746-b966-4365-bb43-cbbab5f7772c tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] 10.222.0.60 "GET /compute/v2.1/servers/1931cdff-d761-428e-9b1c-38172c965058" status: 200 len: 1281 microversion: 2.1 time: 0.192736 Oct 18 15:34:33.221864 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1077/2264] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:33 2022] GET /compute/v2.1/servers/1931cdff-d761-428e-9b1c-38172c965058 => generated 1281 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:34:33.391573 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-92925667-c88a-4daf-8f3f-10409966e79c tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "DELETE /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7" status: 204 len: 0 microversion: 2.1 time: 1.113670 Oct 18 15:34:33.393315 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1188/2265] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:32 2022] DELETE /compute/v2.1/images/7253eedf-cc1e-4e5b-9a82-2096718f42d7 => generated 0 bytes in 1116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:34:33.400293 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fe2f190d-01e7-41cc-bff6-ff462e32f8f3 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c3d024d30>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:34.250975 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2eb71127-bfd8-4811-943c-0140c486e6c3 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:34.251987 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2eb71127-bfd8-4811-943c-0140c486e6c3 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] [instance: 1931cdff-d761-428e-9b1c-38172c965058] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:34.269230 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2eb71127-bfd8-4811-943c-0140c486e6c3 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:34.270577 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2eb71127-bfd8-4811-943c-0140c486e6c3 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:34.273466 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2eb71127-bfd8-4811-943c-0140c486e6c3 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:34.274780 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2eb71127-bfd8-4811-943c-0140c486e6c3 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:34.277827 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2eb71127-bfd8-4811-943c-0140c486e6c3 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:34.278529 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2eb71127-bfd8-4811-943c-0140c486e6c3 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:34.965123 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fe2f190d-01e7-41cc-bff6-ff462e32f8f3 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "DELETE /compute/v2.1/images/93adc85c-6524-4498-aef9-436e2b0ea7c9" status: 204 len: 0 microversion: 2.1 time: 1.568666 Oct 18 15:34:34.970516 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1078/2266] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:33 2022] DELETE /compute/v2.1/images/93adc85c-6524-4498-aef9-436e2b0ea7c9 => generated 0 bytes in 1571 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:34:34.976129 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4c29bb10-a70d-4ea4-93a8-f5c5375c9fda tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c3cfbfa60>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:35.014425 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2eb71127-bfd8-4811-943c-0140c486e6c3 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05be677eedec4a69b3da6e417f5201b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c357719084cd4fc4ae89b665a6aca5dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:35.029630 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2eb71127-bfd8-4811-943c-0140c486e6c3 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] 10.222.0.60 "GET /compute/v2.1/servers/1931cdff-d761-428e-9b1c-38172c965058" status: 200 len: 1323 microversion: 2.1 time: 0.783957 Oct 18 15:34:35.032908 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1189/2267] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:34 2022] GET /compute/v2.1/servers/1931cdff-d761-428e-9b1c-38172c965058 => generated 1323 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:36.060099 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5ba8f993-319e-4d2f-a18e-1eb3fbf15981 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:36.061033 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5ba8f993-319e-4d2f-a18e-1eb3fbf15981 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] [instance: 1931cdff-d761-428e-9b1c-38172c965058] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:36.072652 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5ba8f993-319e-4d2f-a18e-1eb3fbf15981 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:36.073249 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5ba8f993-319e-4d2f-a18e-1eb3fbf15981 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:36.073827 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5ba8f993-319e-4d2f-a18e-1eb3fbf15981 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:36.074773 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5ba8f993-319e-4d2f-a18e-1eb3fbf15981 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:36.074988 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5ba8f993-319e-4d2f-a18e-1eb3fbf15981 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:36.075511 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5ba8f993-319e-4d2f-a18e-1eb3fbf15981 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:36.536178 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5ba8f993-319e-4d2f-a18e-1eb3fbf15981 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05be677eedec4a69b3da6e417f5201b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c357719084cd4fc4ae89b665a6aca5dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:36.547314 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5ba8f993-319e-4d2f-a18e-1eb3fbf15981 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] 10.222.0.60 "GET /compute/v2.1/servers/1931cdff-d761-428e-9b1c-38172c965058" status: 200 len: 1323 microversion: 2.1 time: 0.492373 Oct 18 15:34:36.554509 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1190/2268] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:36 2022] GET /compute/v2.1/servers/1931cdff-d761-428e-9b1c-38172c965058 => generated 1323 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:34:36.570411 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4c29bb10-a70d-4ea4-93a8-f5c5375c9fda tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "DELETE /compute/v2.1/images/f739839c-98aa-47e3-80e7-07753aa06df7" status: 204 len: 0 microversion: 2.1 time: 1.598326 Oct 18 15:34:36.571264 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1079/2269] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:34 2022] DELETE /compute/v2.1/images/f739839c-98aa-47e3-80e7-07753aa06df7 => generated 0 bytes in 1600 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:34:36.579276 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-297cce03-0f0f-49b4-89e2-41a4958d27b2 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:36.589126 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-297cce03-0f0f-49b4-89e2-41a4958d27b2 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] [instance: 0d0c7fc6-9245-41f3-9257-d2b8955a6d4d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:36.591384 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-297cce03-0f0f-49b4-89e2-41a4958d27b2 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:36.592093 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-297cce03-0f0f-49b4-89e2-41a4958d27b2 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:36.592629 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-297cce03-0f0f-49b4-89e2-41a4958d27b2 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:36.593471 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-297cce03-0f0f-49b4-89e2-41a4958d27b2 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:36.594022 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-297cce03-0f0f-49b4-89e2-41a4958d27b2 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:36.594719 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-297cce03-0f0f-49b4-89e2-41a4958d27b2 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:36.631177 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-297cce03-0f0f-49b4-89e2-41a4958d27b2 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] [instance: 0d0c7fc6-9245-41f3-9257-d2b8955a6d4d] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:34:36.771137 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-297cce03-0f0f-49b4-89e2-41a4958d27b2 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "DELETE /compute/v2.1/servers/0d0c7fc6-9245-41f3-9257-d2b8955a6d4d" status: 204 len: 0 microversion: 2.1 time: 0.195369 Oct 18 15:34:36.774682 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1191/2270] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:34:36 2022] DELETE /compute/v2.1/servers/0d0c7fc6-9245-41f3-9257-d2b8955a6d4d => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:34:36.794740 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8efe96a3-5f19-48d8-8ba7-ec0358402d2f tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:36.795823 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8efe96a3-5f19-48d8-8ba7-ec0358402d2f tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] [instance: 0d0c7fc6-9245-41f3-9257-d2b8955a6d4d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:36.796399 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-367e391a-14d0-40f7-956a-e15901d14087 req-3ddfe054-b653-429c-91fa-7818a75125ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1931cdff-d761-428e-9b1c-38172c965058", "tag": "231b7655-99e3-4e87-8adc-002c31052bf1"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:34:36.822719 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8efe96a3-5f19-48d8-8ba7-ec0358402d2f tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:36.823874 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-367e391a-14d0-40f7-956a-e15901d14087 req-3ddfe054-b653-429c-91fa-7818a75125ff service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:36.825836 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-367e391a-14d0-40f7-956a-e15901d14087 req-3ddfe054-b653-429c-91fa-7818a75125ff service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:36.826423 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-367e391a-14d0-40f7-956a-e15901d14087 req-3ddfe054-b653-429c-91fa-7818a75125ff service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:36.826538 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8efe96a3-5f19-48d8-8ba7-ec0358402d2f tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:36.826976 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8efe96a3-5f19-48d8-8ba7-ec0358402d2f tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:36.827729 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8efe96a3-5f19-48d8-8ba7-ec0358402d2f tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:36.828197 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8efe96a3-5f19-48d8-8ba7-ec0358402d2f tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:36.832283 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8efe96a3-5f19-48d8-8ba7-ec0358402d2f tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:36.869104 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-367e391a-14d0-40f7-956a-e15901d14087 req-3ddfe054-b653-429c-91fa-7818a75125ff service nova] Creating event network-changed:231b7655-99e3-4e87-8adc-002c31052bf1 for instance 1931cdff-d761-428e-9b1c-38172c965058 on n-h2-853682-5 Oct 18 15:34:36.879761 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-367e391a-14d0-40f7-956a-e15901d14087 req-3ddfe054-b653-429c-91fa-7818a75125ff service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100557 Oct 18 15:34:36.881267 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:34:36.882428 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1192/2271] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:34:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:34:37.297048 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-00676b1e-10e6-4eee-81f2-cb7d09a7b903 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-251122324", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": "none"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:34:37.391406 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-00676b1e-10e6-4eee-81f2-cb7d09a7b903 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:34:37.391825 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-00676b1e-10e6-4eee-81f2-cb7d09a7b903 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:34:37.392943 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-00676b1e-10e6-4eee-81f2-cb7d09a7b903 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:34:37.393319 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-00676b1e-10e6-4eee-81f2-cb7d09a7b903 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:34:37.393728 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-00676b1e-10e6-4eee-81f2-cb7d09a7b903 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:34:37.405748 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-00676b1e-10e6-4eee-81f2-cb7d09a7b903 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:37.406227 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-00676b1e-10e6-4eee-81f2-cb7d09a7b903 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:37.406825 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-00676b1e-10e6-4eee-81f2-cb7d09a7b903 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:37.407704 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-00676b1e-10e6-4eee-81f2-cb7d09a7b903 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:37.408332 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-00676b1e-10e6-4eee-81f2-cb7d09a7b903 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:37.409077 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-00676b1e-10e6-4eee-81f2-cb7d09a7b903 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:37.432333 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=5,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:34:37.449729 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-00676b1e-10e6-4eee-81f2-cb7d09a7b903 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Getting quotas for project 238884d1b84f47969b59ca56d6c568e0. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:34:37.460216 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-00676b1e-10e6-4eee-81f2-cb7d09a7b903 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Getting quotas for user 122fdcf75d8047e5aa7961d2dde86c0d and project 238884d1b84f47969b59ca56d6c568e0. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:34:37.477490 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-00676b1e-10e6-4eee-81f2-cb7d09a7b903 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:34:37.480760 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-00676b1e-10e6-4eee-81f2-cb7d09a7b903 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] [instance: 91379e3c-806e-4061-8f3b-ec788e6e50ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:34:37.522817 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8efe96a3-5f19-48d8-8ba7-ec0358402d2f tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f901dea4594eb6831a78e2e603e8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c369c078bd4c49148290abb7de3d076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:37.536055 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8efe96a3-5f19-48d8-8ba7-ec0358402d2f tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/servers/0d0c7fc6-9245-41f3-9257-d2b8955a6d4d" status: 200 len: 1474 microversion: 2.1 time: 0.758241 Oct 18 15:34:37.538082 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1080/2272] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:36 2022] GET /compute/v2.1/servers/0d0c7fc6-9245-41f3-9257-d2b8955a6d4d => generated 1474 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:37.581236 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-13b8db5d-b6a7-48a4-8f91-7dca992d2986 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:37.582655 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-13b8db5d-b6a7-48a4-8f91-7dca992d2986 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] [instance: 1931cdff-d761-428e-9b1c-38172c965058] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:37.598126 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13b8db5d-b6a7-48a4-8f91-7dca992d2986 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:37.598683 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13b8db5d-b6a7-48a4-8f91-7dca992d2986 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:37.603039 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13b8db5d-b6a7-48a4-8f91-7dca992d2986 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:37.607581 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13b8db5d-b6a7-48a4-8f91-7dca992d2986 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:37.608071 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13b8db5d-b6a7-48a4-8f91-7dca992d2986 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:37.609254 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-00676b1e-10e6-4eee-81f2-cb7d09a7b903 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.696352 Oct 18 15:34:37.615918 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13b8db5d-b6a7-48a4-8f91-7dca992d2986 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:37.616442 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1193/2273] 10.222.0.60 () {62 vars in 1188 bytes} [Tue Oct 18 15:34:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 18 15:34:37.648694 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3e3003b7-47b5-46fe-ae40-cd8b7c683591 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:37.652782 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3e3003b7-47b5-46fe-ae40-cd8b7c683591 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] [instance: 91379e3c-806e-4061-8f3b-ec788e6e50ec] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:37.879881 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3e3003b7-47b5-46fe-ae40-cd8b7c683591 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122fdcf75d8047e5aa7961d2dde86c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238884d1b84f47969b59ca56d6c568e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:37.893546 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3e3003b7-47b5-46fe-ae40-cd8b7c683591 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122fdcf75d8047e5aa7961d2dde86c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238884d1b84f47969b59ca56d6c568e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:37.895219 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3e3003b7-47b5-46fe-ae40-cd8b7c683591 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122fdcf75d8047e5aa7961d2dde86c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238884d1b84f47969b59ca56d6c568e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:37.903552 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3e3003b7-47b5-46fe-ae40-cd8b7c683591 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] 10.222.0.60 "GET /compute/v2.1/servers/91379e3c-806e-4061-8f3b-ec788e6e50ec" status: 200 len: 1280 microversion: 2.47 time: 0.273882 Oct 18 15:34:37.921570 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1194/2274] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:34:37 2022] GET /compute/v2.1/servers/91379e3c-806e-4061-8f3b-ec788e6e50ec => generated 1280 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:34:38.201342 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-13b8db5d-b6a7-48a4-8f91-7dca992d2986 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05be677eedec4a69b3da6e417f5201b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c357719084cd4fc4ae89b665a6aca5dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:38.214210 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-13b8db5d-b6a7-48a4-8f91-7dca992d2986 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] 10.222.0.60 "GET /compute/v2.1/servers/1931cdff-d761-428e-9b1c-38172c965058" status: 200 len: 1323 microversion: 2.1 time: 0.638345 Oct 18 15:34:38.231046 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1081/2275] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:37 2022] GET /compute/v2.1/servers/1931cdff-d761-428e-9b1c-38172c965058 => generated 1323 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:34:38.573448 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9934985a-5209-433a-ad92-136cdf932a7e tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:38.576850 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9934985a-5209-433a-ad92-136cdf932a7e tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] [instance: 0d0c7fc6-9245-41f3-9257-d2b8955a6d4d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:38.604840 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9934985a-5209-433a-ad92-136cdf932a7e tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:38.606888 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9934985a-5209-433a-ad92-136cdf932a7e tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:38.607585 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9934985a-5209-433a-ad92-136cdf932a7e tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:38.608680 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9934985a-5209-433a-ad92-136cdf932a7e tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:38.608943 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9934985a-5209-433a-ad92-136cdf932a7e tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:38.609365 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9934985a-5209-433a-ad92-136cdf932a7e tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:38.929943 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5fac0417-d8fa-483a-a910-a51dfb969d0f tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:38.930658 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5fac0417-d8fa-483a-a910-a51dfb969d0f tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] [instance: 91379e3c-806e-4061-8f3b-ec788e6e50ec] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:38.952051 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5fac0417-d8fa-483a-a910-a51dfb969d0f tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:38.952051 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5fac0417-d8fa-483a-a910-a51dfb969d0f tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:38.952051 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5fac0417-d8fa-483a-a910-a51dfb969d0f tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:38.953379 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5fac0417-d8fa-483a-a910-a51dfb969d0f tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:38.953856 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5fac0417-d8fa-483a-a910-a51dfb969d0f tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:38.954362 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5fac0417-d8fa-483a-a910-a51dfb969d0f tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:39.519548 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5fac0417-d8fa-483a-a910-a51dfb969d0f tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122fdcf75d8047e5aa7961d2dde86c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238884d1b84f47969b59ca56d6c568e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:39.548790 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5fac0417-d8fa-483a-a910-a51dfb969d0f tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122fdcf75d8047e5aa7961d2dde86c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238884d1b84f47969b59ca56d6c568e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:39.556055 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5fac0417-d8fa-483a-a910-a51dfb969d0f tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122fdcf75d8047e5aa7961d2dde86c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238884d1b84f47969b59ca56d6c568e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:39.558084 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5fac0417-d8fa-483a-a910-a51dfb969d0f tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] 10.222.0.60 "GET /compute/v2.1/servers/91379e3c-806e-4061-8f3b-ec788e6e50ec" status: 200 len: 1332 microversion: 2.47 time: 0.632715 Oct 18 15:34:39.558673 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1082/2276] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:34:38 2022] GET /compute/v2.1/servers/91379e3c-806e-4061-8f3b-ec788e6e50ec => generated 1332 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:34:39.590434 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3f12e5e2-0c3f-460e-8be9-4c2d5ce2014b tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:39.592870 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3f12e5e2-0c3f-460e-8be9-4c2d5ce2014b tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] [instance: 1931cdff-d761-428e-9b1c-38172c965058] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:39.595510 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:34:39.602875 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3f12e5e2-0c3f-460e-8be9-4c2d5ce2014b tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:39.604833 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3f12e5e2-0c3f-460e-8be9-4c2d5ce2014b tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:39.608779 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3f12e5e2-0c3f-460e-8be9-4c2d5ce2014b tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:39.610095 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3f12e5e2-0c3f-460e-8be9-4c2d5ce2014b tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:39.610794 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3f12e5e2-0c3f-460e-8be9-4c2d5ce2014b tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:39.611428 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3f12e5e2-0c3f-460e-8be9-4c2d5ce2014b tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:39.693079 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=56 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:34:39.781884 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9934985a-5209-433a-ad92-136cdf932a7e tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f901dea4594eb6831a78e2e603e8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c369c078bd4c49148290abb7de3d076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:39.793157 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9934985a-5209-433a-ad92-136cdf932a7e tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/servers/0d0c7fc6-9245-41f3-9257-d2b8955a6d4d" status: 200 len: 1474 microversion: 2.1 time: 1.234184 Oct 18 15:34:39.807890 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1195/2277] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:38 2022] GET /compute/v2.1/servers/0d0c7fc6-9245-41f3-9257-d2b8955a6d4d => generated 1474 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:40.044081 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3f12e5e2-0c3f-460e-8be9-4c2d5ce2014b tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05be677eedec4a69b3da6e417f5201b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c357719084cd4fc4ae89b665a6aca5dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:40.062890 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3f12e5e2-0c3f-460e-8be9-4c2d5ce2014b tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] 10.222.0.60 "GET /compute/v2.1/servers/1931cdff-d761-428e-9b1c-38172c965058" status: 200 len: 1323 microversion: 2.1 time: 0.499535 Oct 18 15:34:40.064005 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1083/2278] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:39 2022] GET /compute/v2.1/servers/1931cdff-d761-428e-9b1c-38172c965058 => generated 1323 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:40.069756 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f313b271-a8b3-49e9-8d3a-56ff50446537 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:40.079492 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f313b271-a8b3-49e9-8d3a-56ff50446537 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '28a044b3132948fabf926cdd494c2c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75878827878e4ad796216561bf73b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:40.080685 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f313b271-a8b3-49e9-8d3a-56ff50446537 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Searching by: {'deleted': False, 'project_id': '75878827878e4ad796216561bf73b8c2'} {{(pid=120406) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 15:34:40.088477 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f313b271-a8b3-49e9-8d3a-56ff50446537 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:40.089000 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f313b271-a8b3-49e9-8d3a-56ff50446537 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:40.089434 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f313b271-a8b3-49e9-8d3a-56ff50446537 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:40.090151 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f313b271-a8b3-49e9-8d3a-56ff50446537 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:40.090595 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f313b271-a8b3-49e9-8d3a-56ff50446537 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:40.091009 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f313b271-a8b3-49e9-8d3a-56ff50446537 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:40.124191 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4a6d94b5-f55c-4930-80b7-ecc40811b1fb tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-588060706", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:34:40.124831 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.multi_cell_list [None req-f313b271-a8b3-49e9-8d3a-56ff50446537 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120406) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 15:34:40.167907 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f313b271-a8b3-49e9-8d3a-56ff50446537 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.101954 Oct 18 15:34:40.169089 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1084/2279] 10.222.0.60 () {58 vars in 1125 bytes} [Tue Oct 18 15:34:40 2022] GET /compute/v2.1/servers => generated 344 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:34:40.195515 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-4a6d94b5-f55c-4930-80b7-ecc40811b1fb tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] validate_networks() for None {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:34:40.197649 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ab8ab822-c235-42f1-b4fb-ae6447b4281c tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:40.203764 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ab8ab822-c235-42f1-b4fb-ae6447b4281c tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '28a044b3132948fabf926cdd494c2c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75878827878e4ad796216561bf73b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:40.205314 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ab8ab822-c235-42f1-b4fb-ae6447b4281c tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Searching by: {'deleted': False, 'project_id': '75878827878e4ad796216561bf73b8c2'} {{(pid=120406) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 15:34:40.211283 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab8ab822-c235-42f1-b4fb-ae6447b4281c tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:40.211890 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab8ab822-c235-42f1-b4fb-ae6447b4281c tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:40.212321 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab8ab822-c235-42f1-b4fb-ae6447b4281c tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:40.214635 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab8ab822-c235-42f1-b4fb-ae6447b4281c tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:40.215271 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab8ab822-c235-42f1-b4fb-ae6447b4281c tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:40.216341 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab8ab822-c235-42f1-b4fb-ae6447b4281c tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:40.341171 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.multi_cell_list [None req-ab8ab822-c235-42f1-b4fb-ae6447b4281c tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120406) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 15:34:40.415059 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ab8ab822-c235-42f1-b4fb-ae6447b4281c tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a044b3132948fabf926cdd494c2c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75878827878e4ad796216561bf73b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:40.423663 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab8ab822-c235-42f1-b4fb-ae6447b4281c tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:40.424156 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab8ab822-c235-42f1-b4fb-ae6447b4281c tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:40.424594 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab8ab822-c235-42f1-b4fb-ae6447b4281c tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:40.852533 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ab8ab822-c235-42f1-b4fb-ae6447b4281c tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] 10.222.0.60 "GET /compute/v2.1/servers/detail" status: 200 len: 1607 microversion: 2.1 time: 0.673538 Oct 18 15:34:40.865287 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1085/2280] 10.222.0.60 () {58 vars in 1146 bytes} [Tue Oct 18 15:34:40 2022] GET /compute/v2.1/servers/detail => generated 1607 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:40.881051 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9d289e04-7fb2-49d7-b269-2e0d51af9939 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:40.881051 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9d289e04-7fb2-49d7-b269-2e0d51af9939 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] [instance: 91379e3c-806e-4061-8f3b-ec788e6e50ec] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:40.908754 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d289e04-7fb2-49d7-b269-2e0d51af9939 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:40.911631 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d289e04-7fb2-49d7-b269-2e0d51af9939 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:40.912229 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d289e04-7fb2-49d7-b269-2e0d51af9939 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:40.914161 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d289e04-7fb2-49d7-b269-2e0d51af9939 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:40.915779 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d289e04-7fb2-49d7-b269-2e0d51af9939 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:40.917331 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d289e04-7fb2-49d7-b269-2e0d51af9939 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:40.991799 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-4a6d94b5-f55c-4930-80b7-ecc40811b1fb tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:34:40.992321 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-4a6d94b5-f55c-4930-80b7-ecc40811b1fb tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:34:40.992676 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-4a6d94b5-f55c-4930-80b7-ecc40811b1fb tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:34:40.993105 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-4a6d94b5-f55c-4930-80b7-ecc40811b1fb tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:34:40.993515 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-4a6d94b5-f55c-4930-80b7-ecc40811b1fb tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:34:41.011892 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=57 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:34:41.014173 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4a6d94b5-f55c-4930-80b7-ecc40811b1fb tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:41.015135 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4a6d94b5-f55c-4930-80b7-ecc40811b1fb tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:41.016728 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4a6d94b5-f55c-4930-80b7-ecc40811b1fb tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:41.017724 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4a6d94b5-f55c-4930-80b7-ecc40811b1fb tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:41.018392 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4a6d94b5-f55c-4930-80b7-ecc40811b1fb tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:41.019139 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4a6d94b5-f55c-4930-80b7-ecc40811b1fb tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:41.026342 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9d289e04-7fb2-49d7-b269-2e0d51af9939 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122fdcf75d8047e5aa7961d2dde86c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238884d1b84f47969b59ca56d6c568e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:41.045687 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-4a6d94b5-f55c-4930-80b7-ecc40811b1fb tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Getting quotas for project 91719d2b1f1640f391aa0b54c9725d2a. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:34:41.047059 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9d289e04-7fb2-49d7-b269-2e0d51af9939 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122fdcf75d8047e5aa7961d2dde86c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238884d1b84f47969b59ca56d6c568e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:41.050293 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9d289e04-7fb2-49d7-b269-2e0d51af9939 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122fdcf75d8047e5aa7961d2dde86c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238884d1b84f47969b59ca56d6c568e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:41.052315 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9d289e04-7fb2-49d7-b269-2e0d51af9939 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] 10.222.0.60 "GET /compute/v2.1/servers/91379e3c-806e-4061-8f3b-ec788e6e50ec" status: 200 len: 1338 microversion: 2.47 time: 0.185139 Oct 18 15:34:41.057522 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1086/2281] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:34:40 2022] GET /compute/v2.1/servers/91379e3c-806e-4061-8f3b-ec788e6e50ec => generated 1338 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:34:41.071584 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5c2b9e7f-3083-4859-999b-d2caae417946 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:41.072554 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5c2b9e7f-3083-4859-999b-d2caae417946 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] [instance: 0d0c7fc6-9245-41f3-9257-d2b8955a6d4d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:41.088346 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-4a6d94b5-f55c-4930-80b7-ecc40811b1fb tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Getting quotas for user 926f2a98aa66431fab2a6032f21d5ae7 and project 91719d2b1f1640f391aa0b54c9725d2a. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:34:41.090473 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c2b9e7f-3083-4859-999b-d2caae417946 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:41.091146 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c2b9e7f-3083-4859-999b-d2caae417946 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:41.091723 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c2b9e7f-3083-4859-999b-d2caae417946 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:41.092632 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c2b9e7f-3083-4859-999b-d2caae417946 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:41.093261 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c2b9e7f-3083-4859-999b-d2caae417946 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:41.093826 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c2b9e7f-3083-4859-999b-d2caae417946 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:41.122180 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4a6d94b5-f55c-4930-80b7-ecc40811b1fb tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:34:41.124379 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4a6d94b5-f55c-4930-80b7-ecc40811b1fb tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 0dbbde45-f255-4ac5-8887-1ce8de673fca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:34:41.207129 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5c2b9e7f-3083-4859-999b-d2caae417946 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f901dea4594eb6831a78e2e603e8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c369c078bd4c49148290abb7de3d076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:41.220092 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5c2b9e7f-3083-4859-999b-d2caae417946 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/servers/0d0c7fc6-9245-41f3-9257-d2b8955a6d4d" status: 200 len: 1432 microversion: 2.1 time: 0.161343 Oct 18 15:34:41.225133 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1087/2282] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:41 2022] GET /compute/v2.1/servers/0d0c7fc6-9245-41f3-9257-d2b8955a6d4d => generated 1432 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:41.238073 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1487f0b4-a37b-4ef9-a9dd-bb23e34a9c5e tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:41.238589 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4a6d94b5-f55c-4930-80b7-ecc40811b1fb tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.429157 Oct 18 15:34:41.249617 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1196/2283] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:34:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1441 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:34:41.265225 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-295e8b56-d2ce-4e61-afa3-9f4ab7659333 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:41.266198 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-295e8b56-d2ce-4e61-afa3-9f4ab7659333 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] [instance: 1931cdff-d761-428e-9b1c-38172c965058] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:41.275747 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-295e8b56-d2ce-4e61-afa3-9f4ab7659333 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:41.276995 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-295e8b56-d2ce-4e61-afa3-9f4ab7659333 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:41.277629 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1487f0b4-a37b-4ef9-a9dd-bb23e34a9c5e tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.047848 Oct 18 15:34:41.277893 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-295e8b56-d2ce-4e61-afa3-9f4ab7659333 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:41.278372 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1088/2284] 10.222.0.60 () {58 vars in 1137 bytes} [Tue Oct 18 15:34:41 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:34:41.286543 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-295e8b56-d2ce-4e61-afa3-9f4ab7659333 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:41.286543 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-295e8b56-d2ce-4e61-afa3-9f4ab7659333 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:41.286543 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-295e8b56-d2ce-4e61-afa3-9f4ab7659333 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:41.302670 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-452241d1-ff6c-45cf-a552-5d46ee98e576 req-c61cdb40-efc6-45b6-9730-b249405a314f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d0c7fc6-9245-41f3-9257-d2b8955a6d4d", "name": "network-vif-deleted", "tag": "ccf2639c-dfaf-46eb-a27f-c279d0c6c5c1"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:34:41.333629 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-452241d1-ff6c-45cf-a552-5d46ee98e576 req-c61cdb40-efc6-45b6-9730-b249405a314f service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:41.334262 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-452241d1-ff6c-45cf-a552-5d46ee98e576 req-c61cdb40-efc6-45b6-9730-b249405a314f service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:41.334788 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-452241d1-ff6c-45cf-a552-5d46ee98e576 req-c61cdb40-efc6-45b6-9730-b249405a314f service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:41.347891 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-452241d1-ff6c-45cf-a552-5d46ee98e576 req-c61cdb40-efc6-45b6-9730-b249405a314f service nova] Creating event network-vif-deleted:ccf2639c-dfaf-46eb-a27f-c279d0c6c5c1 for instance 0d0c7fc6-9245-41f3-9257-d2b8955a6d4d on n-h1-853682-5 Oct 18 15:34:41.355665 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-452241d1-ff6c-45cf-a552-5d46ee98e576 req-c61cdb40-efc6-45b6-9730-b249405a314f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059066 Oct 18 15:34:41.357036 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1089/2285] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:34:41.365552 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7f2004a2-cad0-4f08-91c9-1bab92dbf17a tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:41.365552 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7f2004a2-cad0-4f08-91c9-1bab92dbf17a tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 0dbbde45-f255-4ac5-8887-1ce8de673fca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:41.470900 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7f2004a2-cad0-4f08-91c9-1bab92dbf17a tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:41.484512 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7f2004a2-cad0-4f08-91c9-1bab92dbf17a tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca" status: 200 len: 1212 microversion: 2.1 time: 0.126188 Oct 18 15:34:41.502492 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1090/2286] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:41 2022] GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca => generated 1212 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:41.607709 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e58b91a8-af07-4e17-880b-2fab3b7c127f tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:41.613280 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e58b91a8-af07-4e17-880b-2fab3b7c127f tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] [instance: b649575f-a244-45c4-891b-c1fc2f9b4b95] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:41.630683 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e58b91a8-af07-4e17-880b-2fab3b7c127f tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:41.631345 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e58b91a8-af07-4e17-880b-2fab3b7c127f tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:41.631935 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e58b91a8-af07-4e17-880b-2fab3b7c127f tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:41.633693 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e58b91a8-af07-4e17-880b-2fab3b7c127f tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:41.636935 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e58b91a8-af07-4e17-880b-2fab3b7c127f tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:41.637641 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e58b91a8-af07-4e17-880b-2fab3b7c127f tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:41.721329 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e58b91a8-af07-4e17-880b-2fab3b7c127f tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] [instance: b649575f-a244-45c4-891b-c1fc2f9b4b95] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:34:41.889815 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e58b91a8-af07-4e17-880b-2fab3b7c127f tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b649575f-a244-45c4-891b-c1fc2f9b4b95" status: 204 len: 0 microversion: 2.1 time: 0.285767 Oct 18 15:34:41.891653 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1091/2287] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:34:41 2022] DELETE /compute/v2.1/servers/b649575f-a244-45c4-891b-c1fc2f9b4b95 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:34:41.898399 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-4354c9d8-81ea-431a-aac6-ec184f08c0ed req-894aa59d-98a0-4c22-8095-f9531abc0319 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1931cdff-d761-428e-9b1c-38172c965058", "name": "network-vif-plugged", "status": "completed", "tag": "231b7655-99e3-4e87-8adc-002c31052bf1"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:34:41.919600 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6,nova_api:DELETE=4,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:34:41.922133 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4354c9d8-81ea-431a-aac6-ec184f08c0ed req-894aa59d-98a0-4c22-8095-f9531abc0319 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:41.922853 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4354c9d8-81ea-431a-aac6-ec184f08c0ed req-894aa59d-98a0-4c22-8095-f9531abc0319 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:41.923501 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4354c9d8-81ea-431a-aac6-ec184f08c0ed req-894aa59d-98a0-4c22-8095-f9531abc0319 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:41.941927 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-4354c9d8-81ea-431a-aac6-ec184f08c0ed req-894aa59d-98a0-4c22-8095-f9531abc0319 service nova] Creating event network-vif-plugged:231b7655-99e3-4e87-8adc-002c31052bf1 for instance 1931cdff-d761-428e-9b1c-38172c965058 on n-h2-853682-5 Oct 18 15:34:41.950842 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-4354c9d8-81ea-431a-aac6-ec184f08c0ed req-894aa59d-98a0-4c22-8095-f9531abc0319 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056584 Oct 18 15:34:41.953389 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1092/2288] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:34:41.987542 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-295e8b56-d2ce-4e61-afa3-9f4ab7659333 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05be677eedec4a69b3da6e417f5201b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c357719084cd4fc4ae89b665a6aca5dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:41.987924 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c3175726-748c-4eb1-a88f-3073512e6d12 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:41.988511 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c3175726-748c-4eb1-a88f-3073512e6d12 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] [instance: b649575f-a244-45c4-891b-c1fc2f9b4b95] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:42.009875 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-295e8b56-d2ce-4e61-afa3-9f4ab7659333 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] 10.222.0.60 "GET /compute/v2.1/servers/1931cdff-d761-428e-9b1c-38172c965058" status: 200 len: 1323 microversion: 2.1 time: 0.755908 Oct 18 15:34:42.010655 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1197/2289] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:41 2022] GET /compute/v2.1/servers/1931cdff-d761-428e-9b1c-38172c965058 => generated 1323 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:42.017558 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3175726-748c-4eb1-a88f-3073512e6d12 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:42.018055 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3175726-748c-4eb1-a88f-3073512e6d12 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:42.018493 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3175726-748c-4eb1-a88f-3073512e6d12 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:42.023138 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3175726-748c-4eb1-a88f-3073512e6d12 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:42.023945 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3175726-748c-4eb1-a88f-3073512e6d12 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:42.025816 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3175726-748c-4eb1-a88f-3073512e6d12 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:42.083515 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-babb1f03-e42a-41f3-8c1e-36f22a87be08 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:42.084153 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-babb1f03-e42a-41f3-8c1e-36f22a87be08 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] [instance: 91379e3c-806e-4061-8f3b-ec788e6e50ec] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:42.101090 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-babb1f03-e42a-41f3-8c1e-36f22a87be08 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:42.101586 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-babb1f03-e42a-41f3-8c1e-36f22a87be08 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:42.102028 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-babb1f03-e42a-41f3-8c1e-36f22a87be08 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:42.102741 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-babb1f03-e42a-41f3-8c1e-36f22a87be08 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:42.103199 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-babb1f03-e42a-41f3-8c1e-36f22a87be08 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:42.104204 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-babb1f03-e42a-41f3-8c1e-36f22a87be08 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:42.331592 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-babb1f03-e42a-41f3-8c1e-36f22a87be08 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122fdcf75d8047e5aa7961d2dde86c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238884d1b84f47969b59ca56d6c568e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:42.345935 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-babb1f03-e42a-41f3-8c1e-36f22a87be08 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122fdcf75d8047e5aa7961d2dde86c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238884d1b84f47969b59ca56d6c568e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:42.348601 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-babb1f03-e42a-41f3-8c1e-36f22a87be08 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122fdcf75d8047e5aa7961d2dde86c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238884d1b84f47969b59ca56d6c568e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:42.351221 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-babb1f03-e42a-41f3-8c1e-36f22a87be08 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] 10.222.0.60 "GET /compute/v2.1/servers/91379e3c-806e-4061-8f3b-ec788e6e50ec" status: 200 len: 1338 microversion: 2.47 time: 0.272385 Oct 18 15:34:42.352945 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1198/2290] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:34:42 2022] GET /compute/v2.1/servers/91379e3c-806e-4061-8f3b-ec788e6e50ec => generated 1338 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:34:42.369423 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-27d69289-ead9-4ced-b543-f43060d909a6 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:42.373501 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-27d69289-ead9-4ced-b543-f43060d909a6 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] [instance: 0d0c7fc6-9245-41f3-9257-d2b8955a6d4d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:42.381423 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c3175726-748c-4eb1-a88f-3073512e6d12 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a044b3132948fabf926cdd494c2c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75878827878e4ad796216561bf73b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:42.388522 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-27d69289-ead9-4ced-b543-f43060d909a6 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:42.389171 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-27d69289-ead9-4ced-b543-f43060d909a6 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:42.389683 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-27d69289-ead9-4ced-b543-f43060d909a6 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:42.391405 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c3175726-748c-4eb1-a88f-3073512e6d12 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] 10.222.0.60 "GET /compute/v2.1/servers/b649575f-a244-45c4-891b-c1fc2f9b4b95" status: 200 len: 1610 microversion: 2.1 time: 0.416425 Oct 18 15:34:42.392295 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-27d69289-ead9-4ced-b543-f43060d909a6 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:42.392510 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1093/2291] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:41 2022] GET /compute/v2.1/servers/b649575f-a244-45c4-891b-c1fc2f9b4b95 => generated 1610 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:42.392851 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-27d69289-ead9-4ced-b543-f43060d909a6 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:42.395068 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-27d69289-ead9-4ced-b543-f43060d909a6 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:42.498338 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-27d69289-ead9-4ced-b543-f43060d909a6 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f901dea4594eb6831a78e2e603e8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c369c078bd4c49148290abb7de3d076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:42.516677 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-11628b2d-7869-4370-abf2-436a47453e45 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:42.517599 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-11628b2d-7869-4370-abf2-436a47453e45 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 0dbbde45-f255-4ac5-8887-1ce8de673fca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:42.524213 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-27d69289-ead9-4ced-b543-f43060d909a6 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/servers/0d0c7fc6-9245-41f3-9257-d2b8955a6d4d" status: 200 len: 1432 microversion: 2.1 time: 0.156269 Oct 18 15:34:42.526056 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1199/2292] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:42 2022] GET /compute/v2.1/servers/0d0c7fc6-9245-41f3-9257-d2b8955a6d4d => generated 1432 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:42.529141 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-11628b2d-7869-4370-abf2-436a47453e45 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:42.533455 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-11628b2d-7869-4370-abf2-436a47453e45 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:42.534106 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-11628b2d-7869-4370-abf2-436a47453e45 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:42.537480 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-11628b2d-7869-4370-abf2-436a47453e45 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:42.541401 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-11628b2d-7869-4370-abf2-436a47453e45 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:42.542053 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-11628b2d-7869-4370-abf2-436a47453e45 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:42.768474 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-11628b2d-7869-4370-abf2-436a47453e45 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:42.784278 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-11628b2d-7869-4370-abf2-436a47453e45 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca" status: 200 len: 1208 microversion: 2.1 time: 0.278646 Oct 18 15:34:42.800348 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1094/2293] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:42 2022] GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca => generated 1208 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:34:43.111806 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f4435f30-6ba3-4fb6-8580-109891eb44c1 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:43.112847 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f4435f30-6ba3-4fb6-8580-109891eb44c1 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] [instance: 1931cdff-d761-428e-9b1c-38172c965058] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:43.127282 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f4435f30-6ba3-4fb6-8580-109891eb44c1 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:43.129073 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f4435f30-6ba3-4fb6-8580-109891eb44c1 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:43.131168 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f4435f30-6ba3-4fb6-8580-109891eb44c1 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:43.132342 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f4435f30-6ba3-4fb6-8580-109891eb44c1 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:43.134800 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f4435f30-6ba3-4fb6-8580-109891eb44c1 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:43.136269 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f4435f30-6ba3-4fb6-8580-109891eb44c1 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:43.142041 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:34:43.381438 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-90e70c1e-0677-458e-b0ea-910b18e61ebd tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:43.382783 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-90e70c1e-0677-458e-b0ea-910b18e61ebd tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] [instance: 91379e3c-806e-4061-8f3b-ec788e6e50ec] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:43.411378 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90e70c1e-0677-458e-b0ea-910b18e61ebd tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:43.411378 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90e70c1e-0677-458e-b0ea-910b18e61ebd tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:43.411785 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90e70c1e-0677-458e-b0ea-910b18e61ebd tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:43.419728 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90e70c1e-0677-458e-b0ea-910b18e61ebd tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:43.419728 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90e70c1e-0677-458e-b0ea-910b18e61ebd tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:43.424548 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90e70c1e-0677-458e-b0ea-910b18e61ebd tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:43.537126 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f4435f30-6ba3-4fb6-8580-109891eb44c1 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05be677eedec4a69b3da6e417f5201b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c357719084cd4fc4ae89b665a6aca5dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:43.550433 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f4435f30-6ba3-4fb6-8580-109891eb44c1 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] 10.222.0.60 "GET /compute/v2.1/servers/1931cdff-d761-428e-9b1c-38172c965058" status: 200 len: 1323 microversion: 2.1 time: 0.442121 Oct 18 15:34:43.552543 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1200/2294] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:43 2022] GET /compute/v2.1/servers/1931cdff-d761-428e-9b1c-38172c965058 => generated 1323 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:43.564474 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-207db44a-0507-4e65-b3e3-62212dc3bdca tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:43.565312 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-207db44a-0507-4e65-b3e3-62212dc3bdca tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] [instance: b649575f-a244-45c4-891b-c1fc2f9b4b95] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:43.586312 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-207db44a-0507-4e65-b3e3-62212dc3bdca tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:43.586812 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-207db44a-0507-4e65-b3e3-62212dc3bdca tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:43.587292 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-207db44a-0507-4e65-b3e3-62212dc3bdca tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:43.588497 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-207db44a-0507-4e65-b3e3-62212dc3bdca tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:43.597716 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-207db44a-0507-4e65-b3e3-62212dc3bdca tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:43.601342 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-207db44a-0507-4e65-b3e3-62212dc3bdca tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:43.699827 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-90e70c1e-0677-458e-b0ea-910b18e61ebd tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122fdcf75d8047e5aa7961d2dde86c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238884d1b84f47969b59ca56d6c568e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:43.720771 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-90e70c1e-0677-458e-b0ea-910b18e61ebd tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122fdcf75d8047e5aa7961d2dde86c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238884d1b84f47969b59ca56d6c568e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:43.722260 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-90e70c1e-0677-458e-b0ea-910b18e61ebd tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122fdcf75d8047e5aa7961d2dde86c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238884d1b84f47969b59ca56d6c568e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:43.723422 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-90e70c1e-0677-458e-b0ea-910b18e61ebd tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] 10.222.0.60 "GET /compute/v2.1/servers/91379e3c-806e-4061-8f3b-ec788e6e50ec" status: 200 len: 1338 microversion: 2.47 time: 0.347993 Oct 18 15:34:43.724005 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1095/2295] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:34:43 2022] GET /compute/v2.1/servers/91379e3c-806e-4061-8f3b-ec788e6e50ec => generated 1338 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:34:43.747307 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c66af0ce-e9b6-4d10-8741-9ea236fe8b05 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:43.747934 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c66af0ce-e9b6-4d10-8741-9ea236fe8b05 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] [instance: 0d0c7fc6-9245-41f3-9257-d2b8955a6d4d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:43.776910 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c66af0ce-e9b6-4d10-8741-9ea236fe8b05 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:43.777409 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c66af0ce-e9b6-4d10-8741-9ea236fe8b05 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:43.777815 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c66af0ce-e9b6-4d10-8741-9ea236fe8b05 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:43.778532 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c66af0ce-e9b6-4d10-8741-9ea236fe8b05 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:43.778991 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c66af0ce-e9b6-4d10-8741-9ea236fe8b05 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:43.779419 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c66af0ce-e9b6-4d10-8741-9ea236fe8b05 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:44.087382 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c66af0ce-e9b6-4d10-8741-9ea236fe8b05 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f901dea4594eb6831a78e2e603e8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c369c078bd4c49148290abb7de3d076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:44.095356 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-207db44a-0507-4e65-b3e3-62212dc3bdca tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a044b3132948fabf926cdd494c2c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75878827878e4ad796216561bf73b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:44.100301 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c66af0ce-e9b6-4d10-8741-9ea236fe8b05 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/servers/0d0c7fc6-9245-41f3-9257-d2b8955a6d4d" status: 200 len: 1303 microversion: 2.1 time: 0.373802 Oct 18 15:34:44.101242 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1096/2296] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:43 2022] GET /compute/v2.1/servers/0d0c7fc6-9245-41f3-9257-d2b8955a6d4d => generated 1303 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:44.116582 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-207db44a-0507-4e65-b3e3-62212dc3bdca tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] 10.222.0.60 "GET /compute/v2.1/servers/b649575f-a244-45c4-891b-c1fc2f9b4b95" status: 200 len: 1610 microversion: 2.1 time: 0.562717 Oct 18 15:34:44.121067 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1201/2297] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:43 2022] GET /compute/v2.1/servers/b649575f-a244-45c4-891b-c1fc2f9b4b95 => generated 1610 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:44.130121 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8b22c14a-59a7-456f-802d-a4c4b129a375 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:44.130842 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8b22c14a-59a7-456f-802d-a4c4b129a375 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 0dbbde45-f255-4ac5-8887-1ce8de673fca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:44.142840 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b22c14a-59a7-456f-802d-a4c4b129a375 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:44.143409 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b22c14a-59a7-456f-802d-a4c4b129a375 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:44.148955 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b22c14a-59a7-456f-802d-a4c4b129a375 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:44.150088 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b22c14a-59a7-456f-802d-a4c4b129a375 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:44.151321 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b22c14a-59a7-456f-802d-a4c4b129a375 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:44.151946 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b22c14a-59a7-456f-802d-a4c4b129a375 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:44.178671 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:34:44.274696 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8b22c14a-59a7-456f-802d-a4c4b129a375 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:44.286679 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8b22c14a-59a7-456f-802d-a4c4b129a375 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca" status: 200 len: 1270 microversion: 2.1 time: 0.183493 Oct 18 15:34:44.287637 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1097/2298] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:44 2022] GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca => generated 1270 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:44.577239 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a4271a66-ee4c-4406-a57f-1a4e0b11f890 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:44.577852 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a4271a66-ee4c-4406-a57f-1a4e0b11f890 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] [instance: 1931cdff-d761-428e-9b1c-38172c965058] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:44.593519 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a4271a66-ee4c-4406-a57f-1a4e0b11f890 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:44.594414 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a4271a66-ee4c-4406-a57f-1a4e0b11f890 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:44.595113 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a4271a66-ee4c-4406-a57f-1a4e0b11f890 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:44.597617 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a4271a66-ee4c-4406-a57f-1a4e0b11f890 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:44.598317 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a4271a66-ee4c-4406-a57f-1a4e0b11f890 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:44.599454 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a4271a66-ee4c-4406-a57f-1a4e0b11f890 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:44.752688 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a36b8d90-5f78-4088-a1c0-2e89f5feb2ad tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:44.754203 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a36b8d90-5f78-4088-a1c0-2e89f5feb2ad tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] [instance: 91379e3c-806e-4061-8f3b-ec788e6e50ec] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:44.766810 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a36b8d90-5f78-4088-a1c0-2e89f5feb2ad tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:44.767302 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a36b8d90-5f78-4088-a1c0-2e89f5feb2ad tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:44.773924 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a36b8d90-5f78-4088-a1c0-2e89f5feb2ad tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:44.774213 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a36b8d90-5f78-4088-a1c0-2e89f5feb2ad tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:44.774874 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a36b8d90-5f78-4088-a1c0-2e89f5feb2ad tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:44.776348 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a36b8d90-5f78-4088-a1c0-2e89f5feb2ad tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:44.927746 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a36b8d90-5f78-4088-a1c0-2e89f5feb2ad tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122fdcf75d8047e5aa7961d2dde86c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238884d1b84f47969b59ca56d6c568e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:44.944122 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a36b8d90-5f78-4088-a1c0-2e89f5feb2ad tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122fdcf75d8047e5aa7961d2dde86c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238884d1b84f47969b59ca56d6c568e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:44.946004 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a36b8d90-5f78-4088-a1c0-2e89f5feb2ad tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122fdcf75d8047e5aa7961d2dde86c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238884d1b84f47969b59ca56d6c568e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:44.949345 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a36b8d90-5f78-4088-a1c0-2e89f5feb2ad tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] 10.222.0.60 "GET /compute/v2.1/servers/91379e3c-806e-4061-8f3b-ec788e6e50ec" status: 200 len: 1338 microversion: 2.47 time: 0.201041 Oct 18 15:34:44.953528 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1098/2299] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:34:44 2022] GET /compute/v2.1/servers/91379e3c-806e-4061-8f3b-ec788e6e50ec => generated 1338 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:34:45.056061 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a4271a66-ee4c-4406-a57f-1a4e0b11f890 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05be677eedec4a69b3da6e417f5201b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c357719084cd4fc4ae89b665a6aca5dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:45.070522 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a4271a66-ee4c-4406-a57f-1a4e0b11f890 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] 10.222.0.60 "GET /compute/v2.1/servers/1931cdff-d761-428e-9b1c-38172c965058" status: 200 len: 1473 microversion: 2.1 time: 0.498399 Oct 18 15:34:45.074378 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1202/2300] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:44 2022] GET /compute/v2.1/servers/1931cdff-d761-428e-9b1c-38172c965058 => generated 1473 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:45.101885 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f8430394-9c16-4b7e-87b0-1494e296f388 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:45.102630 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f8430394-9c16-4b7e-87b0-1494e296f388 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] [instance: 1931cdff-d761-428e-9b1c-38172c965058] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:45.114760 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8430394-9c16-4b7e-87b0-1494e296f388 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:45.115503 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8430394-9c16-4b7e-87b0-1494e296f388 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:45.116139 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8430394-9c16-4b7e-87b0-1494e296f388 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:45.117045 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8430394-9c16-4b7e-87b0-1494e296f388 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:45.117659 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8430394-9c16-4b7e-87b0-1494e296f388 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:45.118404 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8430394-9c16-4b7e-87b0-1494e296f388 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:45.128074 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6fd22a60-c4db-4796-9100-b1722a738870 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:45.129425 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6fd22a60-c4db-4796-9100-b1722a738870 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] [instance: 0d0c7fc6-9245-41f3-9257-d2b8955a6d4d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:45.144676 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6fd22a60-c4db-4796-9100-b1722a738870 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:45.148081 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6fd22a60-c4db-4796-9100-b1722a738870 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:45.150148 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6fd22a60-c4db-4796-9100-b1722a738870 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:45.154003 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6fd22a60-c4db-4796-9100-b1722a738870 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:45.155217 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6fd22a60-c4db-4796-9100-b1722a738870 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:45.156851 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6fd22a60-c4db-4796-9100-b1722a738870 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:45.164609 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f8430394-9c16-4b7e-87b0-1494e296f388 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '05be677eedec4a69b3da6e417f5201b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c357719084cd4fc4ae89b665a6aca5dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:45.173077 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f8430394-9c16-4b7e-87b0-1494e296f388 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Request method failure captured: Oct 18 15:34:45.173077 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/1931cdff-d761-428e-9b1c-38172c965058/diagnostics HTTP/1.1 Oct 18 15:34:45.173077 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:34:45.173077 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:34:45.173077 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:34:45.173077 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:34:45.173077 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:34:45.173077 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:34:45.173077 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:34:45.173077 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:34:45.173077 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTseBXq5wYUcvWjsz0PMkKl8mDku4vmaIrb4BQLkr749EbQMK007JyRou9nlFNm5dCFWKq--uRZvYcQWHRoZtZ5T1xjThbbVT9cTPWhWtGQnBdB73M0RQkydOMiWfwmVw80hNdW5PveKL-jWcRHkEJ2iKWv_LmC8-BZU3AaSIhlKbr3A Oct 18 15:34:45.173077 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:34:45.173077 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:34:45.173077 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:34:45.173077 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:34:45.173077 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:34:45.173077 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:34:45.173077 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: c357719084cd4fc4ae89b665a6aca5dd Oct 18 15:34:45.173077 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-29981249 Oct 18 15:34:45.173077 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:34:45.173077 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:34:45.174589 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c357719084cd4fc4ae89b665a6aca5dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c357719084cd4fc4ae89b665a6aca5dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c357719084cd4fc4ae89b665a6aca5dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c357719084cd4fc4ae89b665a6aca5dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:34:45.174589 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-29981249 Oct 18 15:34:45.174589 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: c357719084cd4fc4ae89b665a6aca5dd Oct 18 15:34:45.174589 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-29981249 Oct 18 15:34:45.174589 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServerDiagnosticsNegativeTest-29981249-project Oct 18 15:34:45.174589 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:34:45.174589 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:34:45.174589 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 05be677eedec4a69b3da6e417f5201b1 Oct 18 15:34:45.174589 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-29981249-project Oct 18 15:34:45.174589 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:34:45.174589 n-d-853682-5 devstack@n-api.service[120406]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 18 15:34:45.175425 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'server_id': '1931cdff-d761-428e-9b1c-38172c965058'} Oct 18 15:34:45.175425 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:34:45.175425 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:45.175425 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:34:45.175425 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:34:45.175425 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:34:45.175425 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:34:45.175425 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:34:45.175425 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:34:45.175425 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 18 15:34:45.175425 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 18 15:34:45.175425 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 15:34:45.175425 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 15:34:45.175425 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 15:34:45.175425 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 15:34:45.175425 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 15:34:45.175425 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 15:34:45.175425 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 15:34:45.175425 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 15:34:45.175425 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 15:34:45.176894 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 15:34:45.176894 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 15:34:45.176894 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 15:34:45.176894 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 15:34:45.176894 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 15:34:45.176894 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 18 15:34:45.176894 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:45.176894 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:34:45.176894 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:45.176894 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:45.176894 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:34:45.176894 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:34:45.176894 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 15:34:45.176894 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 15:34:45.176894 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 18 15:34:45.176894 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:45.176894 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f8430394-9c16-4b7e-87b0-1494e296f388 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:34:45.177925 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f8430394-9c16-4b7e-87b0-1494e296f388 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] 10.222.0.60 "GET /compute/v2.1/servers/1931cdff-d761-428e-9b1c-38172c965058/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.076874 Oct 18 15:34:45.180465 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1099/2301] 10.222.0.60 () {58 vars in 1272 bytes} [Tue Oct 18 15:34:45 2022] GET /compute/v2.1/servers/1931cdff-d761-428e-9b1c-38172c965058/diagnostics => generated 117 bytes in 83 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:34:45.185591 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6ebbd94c-de96-412d-8f1a-6cdc3c267545 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:45.194058 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6ebbd94c-de96-412d-8f1a-6cdc3c267545 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] [instance: b649575f-a244-45c4-891b-c1fc2f9b4b95] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:45.209770 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ebbd94c-de96-412d-8f1a-6cdc3c267545 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:45.213477 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ebbd94c-de96-412d-8f1a-6cdc3c267545 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:45.213931 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ebbd94c-de96-412d-8f1a-6cdc3c267545 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:45.214659 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ebbd94c-de96-412d-8f1a-6cdc3c267545 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:45.215121 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ebbd94c-de96-412d-8f1a-6cdc3c267545 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:45.215557 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ebbd94c-de96-412d-8f1a-6cdc3c267545 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:45.245942 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6fd22a60-c4db-4796-9100-b1722a738870 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:45.246482 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6fd22a60-c4db-4796-9100-b1722a738870 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:45.246936 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6fd22a60-c4db-4796-9100-b1722a738870 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:45.247405 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-6fd22a60-c4db-4796-9100-b1722a738870 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lazy-loading 'fault' on Instance uuid 0d0c7fc6-9245-41f3-9257-d2b8955a6d4d {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:34:45.515245 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6fd22a60-c4db-4796-9100-b1722a738870 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f901dea4594eb6831a78e2e603e8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c369c078bd4c49148290abb7de3d076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:45.549002 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6fd22a60-c4db-4796-9100-b1722a738870 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/servers/0d0c7fc6-9245-41f3-9257-d2b8955a6d4d" status: 200 len: 1308 microversion: 2.1 time: 0.423771 Oct 18 15:34:45.551234 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1203/2302] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:45 2022] GET /compute/v2.1/servers/0d0c7fc6-9245-41f3-9257-d2b8955a6d4d => generated 1308 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:45.570837 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a46ac6bf-a8e0-4b66-a80c-4a1b7ca6c882 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:45.571659 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a46ac6bf-a8e0-4b66-a80c-4a1b7ca6c882 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] [instance: 1931cdff-d761-428e-9b1c-38172c965058] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:45.583872 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a46ac6bf-a8e0-4b66-a80c-4a1b7ca6c882 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:45.584540 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a46ac6bf-a8e0-4b66-a80c-4a1b7ca6c882 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:45.585159 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a46ac6bf-a8e0-4b66-a80c-4a1b7ca6c882 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:45.586080 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a46ac6bf-a8e0-4b66-a80c-4a1b7ca6c882 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:45.586984 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a46ac6bf-a8e0-4b66-a80c-4a1b7ca6c882 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:45.587574 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a46ac6bf-a8e0-4b66-a80c-4a1b7ca6c882 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:45.621766 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a46ac6bf-a8e0-4b66-a80c-4a1b7ca6c882 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] [instance: 1931cdff-d761-428e-9b1c-38172c965058] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:34:45.768199 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a46ac6bf-a8e0-4b66-a80c-4a1b7ca6c882 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1931cdff-d761-428e-9b1c-38172c965058" status: 204 len: 0 microversion: 2.1 time: 0.214571 Oct 18 15:34:45.769522 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1204/2303] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:34:45 2022] DELETE /compute/v2.1/servers/1931cdff-d761-428e-9b1c-38172c965058 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:34:45.778619 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c19ae791-6b89-4ce8-a8a2-9ecf8987664c tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:45.779565 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c19ae791-6b89-4ce8-a8a2-9ecf8987664c tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 0dbbde45-f255-4ac5-8887-1ce8de673fca] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:45.787414 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c19ae791-6b89-4ce8-a8a2-9ecf8987664c tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:45.788329 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c19ae791-6b89-4ce8-a8a2-9ecf8987664c tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:45.788990 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c19ae791-6b89-4ce8-a8a2-9ecf8987664c tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:45.789860 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c19ae791-6b89-4ce8-a8a2-9ecf8987664c tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:45.790466 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c19ae791-6b89-4ce8-a8a2-9ecf8987664c tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:45.791601 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c19ae791-6b89-4ce8-a8a2-9ecf8987664c tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:45.799398 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6ebbd94c-de96-412d-8f1a-6cdc3c267545 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a044b3132948fabf926cdd494c2c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75878827878e4ad796216561bf73b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:45.815435 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6ebbd94c-de96-412d-8f1a-6cdc3c267545 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] 10.222.0.60 "GET /compute/v2.1/servers/b649575f-a244-45c4-891b-c1fc2f9b4b95" status: 200 len: 1610 microversion: 2.1 time: 0.633468 Oct 18 15:34:45.816275 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1100/2304] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:45 2022] GET /compute/v2.1/servers/b649575f-a244-45c4-891b-c1fc2f9b4b95 => generated 1610 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:45.832306 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ea936673-fe41-4c08-97a1-7af924832a12 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:45.834612 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ea936673-fe41-4c08-97a1-7af924832a12 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] [instance: 1931cdff-d761-428e-9b1c-38172c965058] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:45.854296 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea936673-fe41-4c08-97a1-7af924832a12 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:45.859435 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea936673-fe41-4c08-97a1-7af924832a12 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:45.860191 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea936673-fe41-4c08-97a1-7af924832a12 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:45.861146 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea936673-fe41-4c08-97a1-7af924832a12 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:45.862623 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea936673-fe41-4c08-97a1-7af924832a12 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:45.863561 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea936673-fe41-4c08-97a1-7af924832a12 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:46.491822 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c19ae791-6b89-4ce8-a8a2-9ecf8987664c tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:46.500698 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c19ae791-6b89-4ce8-a8a2-9ecf8987664c tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca" status: 200 len: 1312 microversion: 2.1 time: 0.729569 Oct 18 15:34:46.514240 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1205/2305] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:45 2022] GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca => generated 1312 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:46.531605 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8e76ec14-4044-494d-a135-c961e1d92900 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:46.532483 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8e76ec14-4044-494d-a135-c961e1d92900 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] [instance: 91379e3c-806e-4061-8f3b-ec788e6e50ec] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:46.550421 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8e76ec14-4044-494d-a135-c961e1d92900 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:46.554988 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8e76ec14-4044-494d-a135-c961e1d92900 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:46.555603 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8e76ec14-4044-494d-a135-c961e1d92900 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:46.560427 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8e76ec14-4044-494d-a135-c961e1d92900 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:46.561174 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8e76ec14-4044-494d-a135-c961e1d92900 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:46.561555 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8e76ec14-4044-494d-a135-c961e1d92900 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:47.161101 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8e76ec14-4044-494d-a135-c961e1d92900 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122fdcf75d8047e5aa7961d2dde86c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238884d1b84f47969b59ca56d6c568e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:47.169576 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8e76ec14-4044-494d-a135-c961e1d92900 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122fdcf75d8047e5aa7961d2dde86c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238884d1b84f47969b59ca56d6c568e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:47.174680 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8e76ec14-4044-494d-a135-c961e1d92900 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122fdcf75d8047e5aa7961d2dde86c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238884d1b84f47969b59ca56d6c568e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:47.178197 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8e76ec14-4044-494d-a135-c961e1d92900 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] 10.222.0.60 "GET /compute/v2.1/servers/91379e3c-806e-4061-8f3b-ec788e6e50ec" status: 200 len: 1359 microversion: 2.47 time: 0.659127 Oct 18 15:34:47.179474 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ea936673-fe41-4c08-97a1-7af924832a12 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05be677eedec4a69b3da6e417f5201b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c357719084cd4fc4ae89b665a6aca5dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:47.180581 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1206/2306] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:34:46 2022] GET /compute/v2.1/servers/91379e3c-806e-4061-8f3b-ec788e6e50ec => generated 1359 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:34:47.192210 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-471d6bc4-c27d-4b32-99be-91ece4200af9 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:47.192460 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ea936673-fe41-4c08-97a1-7af924832a12 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] 10.222.0.60 "GET /compute/v2.1/servers/1931cdff-d761-428e-9b1c-38172c965058" status: 200 len: 1479 microversion: 2.1 time: 1.374380 Oct 18 15:34:47.193086 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-471d6bc4-c27d-4b32-99be-91ece4200af9 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] [instance: 0d0c7fc6-9245-41f3-9257-d2b8955a6d4d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:47.193940 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1101/2307] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:45 2022] GET /compute/v2.1/servers/1931cdff-d761-428e-9b1c-38172c965058 => generated 1479 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:47.208032 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-471d6bc4-c27d-4b32-99be-91ece4200af9 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:47.209541 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-471d6bc4-c27d-4b32-99be-91ece4200af9 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:47.210484 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-471d6bc4-c27d-4b32-99be-91ece4200af9 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:47.214692 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-471d6bc4-c27d-4b32-99be-91ece4200af9 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:47.215355 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-471d6bc4-c27d-4b32-99be-91ece4200af9 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:47.215952 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-471d6bc4-c27d-4b32-99be-91ece4200af9 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:47.567414 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-ae9d3375-db49-4b1d-a504-60fe5d945280 req-2336bc5d-02a7-4811-95e2-4d2742b27c97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dbbde45-f255-4ac5-8887-1ce8de673fca", "tag": "0ad973d8-f2bb-4e15-a985-502b69cec140"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:34:47.589117 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ae9d3375-db49-4b1d-a504-60fe5d945280 req-2336bc5d-02a7-4811-95e2-4d2742b27c97 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:47.589781 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ae9d3375-db49-4b1d-a504-60fe5d945280 req-2336bc5d-02a7-4811-95e2-4d2742b27c97 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:47.590361 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ae9d3375-db49-4b1d-a504-60fe5d945280 req-2336bc5d-02a7-4811-95e2-4d2742b27c97 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:47.615621 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-ae9d3375-db49-4b1d-a504-60fe5d945280 req-2336bc5d-02a7-4811-95e2-4d2742b27c97 service nova] Creating event network-changed:0ad973d8-f2bb-4e15-a985-502b69cec140 for instance 0dbbde45-f255-4ac5-8887-1ce8de673fca on n-h2-853682-5 Oct 18 15:34:47.626086 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-ae9d3375-db49-4b1d-a504-60fe5d945280 req-2336bc5d-02a7-4811-95e2-4d2742b27c97 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.430775 Oct 18 15:34:47.628885 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1102/2308] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:34:47.643395 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-84e59345-0af4-403c-9e6e-8b4c7850658f tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:47.648494 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-84e59345-0af4-403c-9e6e-8b4c7850658f tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] [instance: b649575f-a244-45c4-891b-c1fc2f9b4b95] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:47.661187 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84e59345-0af4-403c-9e6e-8b4c7850658f tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:47.661855 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84e59345-0af4-403c-9e6e-8b4c7850658f tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:47.664846 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84e59345-0af4-403c-9e6e-8b4c7850658f tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:47.666399 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84e59345-0af4-403c-9e6e-8b4c7850658f tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:47.668399 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84e59345-0af4-403c-9e6e-8b4c7850658f tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:47.669090 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84e59345-0af4-403c-9e6e-8b4c7850658f tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:47.696416 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-471d6bc4-c27d-4b32-99be-91ece4200af9 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] HTTP exception thrown: Instance 0d0c7fc6-9245-41f3-9257-d2b8955a6d4d could not be found. Oct 18 15:34:47.699474 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-471d6bc4-c27d-4b32-99be-91ece4200af9 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Request method failure captured: Oct 18 15:34:47.699474 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/0d0c7fc6-9245-41f3-9257-d2b8955a6d4d HTTP/1.1 Oct 18 15:34:47.699474 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:34:47.699474 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:34:47.699474 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:34:47.699474 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:34:47.699474 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:34:47.699474 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:34:47.699474 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:34:47.699474 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:34:47.699474 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsbRFrYEzgiPfgYGqMGFOEdmkpBP6cxw4fg6wUYClPSco-YU86iApA9v9HgD0FjaY8pFtBQFpobpa9BV0g0x8CwcgtkKTuIbx4PkGUX9Y3mcp4kTE9xqLTtJDAKXhut0WKjIxviXOuzqI5e1b8XLeWKJRgHJKDlHY0bE8VYcyCGX-GY Oct 18 15:34:47.699474 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:34:47.699474 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:34:47.699474 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:34:47.699474 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:34:47.699474 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:34:47.699474 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:34:47.699474 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: c369c078bd4c49148290abb7de3d076f Oct 18 15:34:47.699474 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ListImageFiltersTestJSON-1331268878 Oct 18 15:34:47.699474 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:34:47.699474 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:34:47.700712 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c369c078bd4c49148290abb7de3d076f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c369c078bd4c49148290abb7de3d076f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c369c078bd4c49148290abb7de3d076f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c369c078bd4c49148290abb7de3d076f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:34:47.700712 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ListImageFiltersTestJSON-1331268878 Oct 18 15:34:47.700712 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: c369c078bd4c49148290abb7de3d076f Oct 18 15:34:47.700712 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1331268878 Oct 18 15:34:47.700712 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ListImageFiltersTestJSON-1331268878-project Oct 18 15:34:47.700712 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:34:47.700712 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:34:47.700712 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 79f901dea4594eb6831a78e2e603e8a0 Oct 18 15:34:47.700712 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ListImageFiltersTestJSON-1331268878-project Oct 18 15:34:47.700712 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:34:47.700712 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 0d0c7fc6-9245-41f3-9257-d2b8955a6d4d could not be found. Oct 18 15:34:47.700712 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '0d0c7fc6-9245-41f3-9257-d2b8955a6d4d'} Oct 18 15:34:47.701426 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:34:47.701426 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:47.701426 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:34:47.701426 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:34:47.701426 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:34:47.701426 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:34:47.701426 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:34:47.701426 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:34:47.701426 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:34:47.701426 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:34:47.701426 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d0c7fc6-9245-41f3-9257-d2b8955a6d4d could not be found. Oct 18 15:34:47.701426 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:47.701426 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:34:47.701426 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:47.701426 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:47.701426 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:34:47.701426 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:34:47.701426 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:34:47.701426 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:34:47.701426 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:34:47.702607 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:34:47.702607 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:34:47.702607 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:34:47.702607 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:34:47.702607 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:34:47.702607 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:34:47.702607 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:34:47.702607 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d0c7fc6-9245-41f3-9257-d2b8955a6d4d could not be found. Oct 18 15:34:47.702607 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:47.702607 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:34:47.702607 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:47.702607 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:47.702607 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:34:47.702607 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:34:47.702607 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:34:47.702607 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:34:47.702607 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d0c7fc6-9245-41f3-9257-d2b8955a6d4d could not be found. Oct 18 15:34:47.702607 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:47.703595 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-471d6bc4-c27d-4b32-99be-91ece4200af9 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Returning 404 to user: Instance 0d0c7fc6-9245-41f3-9257-d2b8955a6d4d could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:34:47.703595 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-471d6bc4-c27d-4b32-99be-91ece4200af9 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/servers/0d0c7fc6-9245-41f3-9257-d2b8955a6d4d" status: 404 len: 111 microversion: 2.1 time: 0.512773 Oct 18 15:34:47.703595 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1207/2309] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:47 2022] GET /compute/v2.1/servers/0d0c7fc6-9245-41f3-9257-d2b8955a6d4d => generated 111 bytes in 514 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:34:47.707401 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2c2bf3ec-32fb-4111-a4c8-3ea788d090ce tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-888596271"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:34:47.709889 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2c2bf3ec-32fb-4111-a4c8-3ea788d090ce tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] [instance: 91379e3c-806e-4061-8f3b-ec788e6e50ec] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:47.717201 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c2bf3ec-32fb-4111-a4c8-3ea788d090ce tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:47.717694 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c2bf3ec-32fb-4111-a4c8-3ea788d090ce tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:47.718232 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c2bf3ec-32fb-4111-a4c8-3ea788d090ce tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:47.718963 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c2bf3ec-32fb-4111-a4c8-3ea788d090ce tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:47.719414 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c2bf3ec-32fb-4111-a4c8-3ea788d090ce tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:47.719843 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c2bf3ec-32fb-4111-a4c8-3ea788d090ce tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:48.055012 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2c2bf3ec-32fb-4111-a4c8-3ea788d090ce tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] 10.222.0.60 "POST /compute/v2.1/servers/91379e3c-806e-4061-8f3b-ec788e6e50ec/action" status: 202 len: 52 microversion: 2.47 time: 0.336217 Oct 18 15:34:48.057175 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1208/2310] 10.222.0.60 () {62 vars in 1319 bytes} [Tue Oct 18 15:34:47 2022] POST /compute/v2.1/servers/91379e3c-806e-4061-8f3b-ec788e6e50ec/action => generated 52 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Oct 18 15:34:48.067843 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e81a31ce-696c-4faa-a655-1f78e5717cdd tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:48.068656 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e81a31ce-696c-4faa-a655-1f78e5717cdd tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 0dbbde45-f255-4ac5-8887-1ce8de673fca] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:48.086907 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e81a31ce-696c-4faa-a655-1f78e5717cdd tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:48.087843 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e81a31ce-696c-4faa-a655-1f78e5717cdd tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:48.088484 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e81a31ce-696c-4faa-a655-1f78e5717cdd tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:48.089486 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e81a31ce-696c-4faa-a655-1f78e5717cdd tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:48.090163 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e81a31ce-696c-4faa-a655-1f78e5717cdd tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:48.090816 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e81a31ce-696c-4faa-a655-1f78e5717cdd tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:48.184748 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-84e59345-0af4-403c-9e6e-8b4c7850658f tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a044b3132948fabf926cdd494c2c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75878827878e4ad796216561bf73b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:48.199981 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-84e59345-0af4-403c-9e6e-8b4c7850658f tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] 10.222.0.60 "GET /compute/v2.1/servers/b649575f-a244-45c4-891b-c1fc2f9b4b95" status: 200 len: 1610 microversion: 2.1 time: 0.567131 Oct 18 15:34:48.201386 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1103/2311] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:47 2022] GET /compute/v2.1/servers/b649575f-a244-45c4-891b-c1fc2f9b4b95 => generated 1610 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:48.212054 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-78ed150f-160f-4b7b-8957-650b1fa8f92d tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:48.213592 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-78ed150f-160f-4b7b-8957-650b1fa8f92d tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] [instance: 4e1ae723-8f58-4752-b578-da0b39e9a668] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:48.225765 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-78ed150f-160f-4b7b-8957-650b1fa8f92d tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:48.228091 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-78ed150f-160f-4b7b-8957-650b1fa8f92d tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:48.229297 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-78ed150f-160f-4b7b-8957-650b1fa8f92d tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:48.230207 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-78ed150f-160f-4b7b-8957-650b1fa8f92d tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:48.230672 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-78ed150f-160f-4b7b-8957-650b1fa8f92d tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:48.231899 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-78ed150f-160f-4b7b-8957-650b1fa8f92d tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:48.263887 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-78ed150f-160f-4b7b-8957-650b1fa8f92d tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] [instance: 4e1ae723-8f58-4752-b578-da0b39e9a668] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:34:48.374081 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e81a31ce-696c-4faa-a655-1f78e5717cdd tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:48.388289 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e81a31ce-696c-4faa-a655-1f78e5717cdd tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca" status: 200 len: 1312 microversion: 2.1 time: 0.327122 Oct 18 15:34:48.389043 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1209/2312] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:48 2022] GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca => generated 1312 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:48.397997 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-78ed150f-160f-4b7b-8957-650b1fa8f92d tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4e1ae723-8f58-4752-b578-da0b39e9a668" status: 204 len: 0 microversion: 2.1 time: 0.193086 Oct 18 15:34:48.403088 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1104/2313] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:34:48 2022] DELETE /compute/v2.1/servers/4e1ae723-8f58-4752-b578-da0b39e9a668 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:34:48.411573 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-79dc84c8-6fb1-48e3-bf64-8471dc9422be tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:48.413939 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-79dc84c8-6fb1-48e3-bf64-8471dc9422be tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] [instance: 91379e3c-806e-4061-8f3b-ec788e6e50ec] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:48.444075 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-79dc84c8-6fb1-48e3-bf64-8471dc9422be tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:48.444758 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-79dc84c8-6fb1-48e3-bf64-8471dc9422be tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:48.445487 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-79dc84c8-6fb1-48e3-bf64-8471dc9422be tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:48.450997 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-79dc84c8-6fb1-48e3-bf64-8471dc9422be tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:48.451496 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-79dc84c8-6fb1-48e3-bf64-8471dc9422be tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:48.452558 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-79dc84c8-6fb1-48e3-bf64-8471dc9422be tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:48.478888 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4f0b31f7-3c49-4f11-ba8d-d793ea47ecfe tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2146139856", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "670a85ee-2ce6-476a-bad3-558d8003ee5a"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:34:48.538525 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-79dc84c8-6fb1-48e3-bf64-8471dc9422be tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] [instance: 91379e3c-806e-4061-8f3b-ec788e6e50ec] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:34:48.548936 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-4f0b31f7-3c49-4f11-ba8d-d793ea47ecfe tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] validate_networks() for [('670a85ee-2ce6-476a-bad3-558d8003ee5a', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:34:48.699645 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-79dc84c8-6fb1-48e3-bf64-8471dc9422be tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] 10.222.0.60 "DELETE /compute/v2.1/servers/91379e3c-806e-4061-8f3b-ec788e6e50ec" status: 204 len: 0 microversion: 2.47 time: 0.309322 Oct 18 15:34:48.700245 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1210/2314] 10.222.0.60 () {60 vars in 1280 bytes} [Tue Oct 18 15:34:48 2022] DELETE /compute/v2.1/servers/91379e3c-806e-4061-8f3b-ec788e6e50ec => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 15:34:48.706798 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5d1aa55d-e52d-4dcd-9a26-d2b8ea3147b7 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:48.707986 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5d1aa55d-e52d-4dcd-9a26-d2b8ea3147b7 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] [instance: 1931cdff-d761-428e-9b1c-38172c965058] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:48.716344 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5d1aa55d-e52d-4dcd-9a26-d2b8ea3147b7 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:48.716894 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5d1aa55d-e52d-4dcd-9a26-d2b8ea3147b7 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:48.717499 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5d1aa55d-e52d-4dcd-9a26-d2b8ea3147b7 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:48.718374 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5d1aa55d-e52d-4dcd-9a26-d2b8ea3147b7 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:48.719156 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5d1aa55d-e52d-4dcd-9a26-d2b8ea3147b7 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:48.719583 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5d1aa55d-e52d-4dcd-9a26-d2b8ea3147b7 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:48.824059 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5d1aa55d-e52d-4dcd-9a26-d2b8ea3147b7 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05be677eedec4a69b3da6e417f5201b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c357719084cd4fc4ae89b665a6aca5dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:48.841233 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5d1aa55d-e52d-4dcd-9a26-d2b8ea3147b7 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] 10.222.0.60 "GET /compute/v2.1/servers/1931cdff-d761-428e-9b1c-38172c965058" status: 200 len: 1437 microversion: 2.1 time: 0.131631 Oct 18 15:34:48.842822 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1211/2315] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:48 2022] GET /compute/v2.1/servers/1931cdff-d761-428e-9b1c-38172c965058 => generated 1437 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:48.848955 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f2e4389a-1823-485a-8b96-3a269679101a tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:48.849829 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f2e4389a-1823-485a-8b96-3a269679101a tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] [instance: 4e1ae723-8f58-4752-b578-da0b39e9a668] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:48.859185 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f2e4389a-1823-485a-8b96-3a269679101a tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:48.859911 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f2e4389a-1823-485a-8b96-3a269679101a tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:48.860682 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f2e4389a-1823-485a-8b96-3a269679101a tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:48.864838 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f2e4389a-1823-485a-8b96-3a269679101a tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:48.865595 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f2e4389a-1823-485a-8b96-3a269679101a tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:48.866240 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f2e4389a-1823-485a-8b96-3a269679101a tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:48.889479 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:34:49.453721 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f2e4389a-1823-485a-8b96-3a269679101a tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f901dea4594eb6831a78e2e603e8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c369c078bd4c49148290abb7de3d076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:49.486036 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f2e4389a-1823-485a-8b96-3a269679101a tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/servers/4e1ae723-8f58-4752-b578-da0b39e9a668" status: 200 len: 1473 microversion: 2.1 time: 0.641773 Oct 18 15:34:49.486907 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1212/2316] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:48 2022] GET /compute/v2.1/servers/4e1ae723-8f58-4752-b578-da0b39e9a668 => generated 1473 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:49.507252 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-eadf4fbe-88c4-4950-b1a1-c026380b0e92 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:49.508162 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-eadf4fbe-88c4-4950-b1a1-c026380b0e92 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] [instance: 91379e3c-806e-4061-8f3b-ec788e6e50ec] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:49.518415 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eadf4fbe-88c4-4950-b1a1-c026380b0e92 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:49.519110 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eadf4fbe-88c4-4950-b1a1-c026380b0e92 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:49.519700 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eadf4fbe-88c4-4950-b1a1-c026380b0e92 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:49.520487 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eadf4fbe-88c4-4950-b1a1-c026380b0e92 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:49.521940 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eadf4fbe-88c4-4950-b1a1-c026380b0e92 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:49.522453 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eadf4fbe-88c4-4950-b1a1-c026380b0e92 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:49.642801 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-eadf4fbe-88c4-4950-b1a1-c026380b0e92 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122fdcf75d8047e5aa7961d2dde86c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238884d1b84f47969b59ca56d6c568e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:49.665222 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-eadf4fbe-88c4-4950-b1a1-c026380b0e92 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122fdcf75d8047e5aa7961d2dde86c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238884d1b84f47969b59ca56d6c568e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:49.668904 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-eadf4fbe-88c4-4950-b1a1-c026380b0e92 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122fdcf75d8047e5aa7961d2dde86c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238884d1b84f47969b59ca56d6c568e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:49.670351 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-eadf4fbe-88c4-4950-b1a1-c026380b0e92 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] 10.222.0.60 "GET /compute/v2.1/servers/91379e3c-806e-4061-8f3b-ec788e6e50ec" status: 200 len: 1365 microversion: 2.47 time: 0.179355 Oct 18 15:34:49.685676 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1213/2317] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:34:49 2022] GET /compute/v2.1/servers/91379e3c-806e-4061-8f3b-ec788e6e50ec => generated 1365 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:34:49.697554 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-ee25dd59-9f96-4f1a-b630-ff1412570191 req-2280603f-312b-42c9-a58d-d45ad77e6149 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b649575f-a244-45c4-891b-c1fc2f9b4b95", "name": "network-vif-deleted", "tag": "39223ede-8764-4387-9a5c-55534f30a099"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:34:49.708778 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-ee25dd59-9f96-4f1a-b630-ff1412570191 req-2280603f-312b-42c9-a58d-d45ad77e6149 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:49.709436 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-ee25dd59-9f96-4f1a-b630-ff1412570191 req-2280603f-312b-42c9-a58d-d45ad77e6149 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:49.709863 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-ee25dd59-9f96-4f1a-b630-ff1412570191 req-2280603f-312b-42c9-a58d-d45ad77e6149 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:49.732753 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-ee25dd59-9f96-4f1a-b630-ff1412570191 req-2280603f-312b-42c9-a58d-d45ad77e6149 service nova] Creating event network-vif-deleted:39223ede-8764-4387-9a5c-55534f30a099 for instance b649575f-a244-45c4-891b-c1fc2f9b4b95 on n-h1-853682-5 Oct 18 15:34:49.741831 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-4f0b31f7-3c49-4f11-ba8d-d793ea47ecfe tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:34:49.742804 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-4f0b31f7-3c49-4f11-ba8d-d793ea47ecfe tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:34:49.743466 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-4f0b31f7-3c49-4f11-ba8d-d793ea47ecfe tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:34:49.744734 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-ee25dd59-9f96-4f1a-b630-ff1412570191 req-2280603f-312b-42c9-a58d-d45ad77e6149 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054959 Oct 18 15:34:49.744995 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-4f0b31f7-3c49-4f11-ba8d-d793ea47ecfe tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:34:49.745604 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-4f0b31f7-3c49-4f11-ba8d-d793ea47ecfe tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:34:49.747367 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1214/2318] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:34:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:34:49.760151 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e4d424bc-ca0e-436f-8216-c63be5a7210b tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:49.760997 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e4d424bc-ca0e-436f-8216-c63be5a7210b tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] [instance: b649575f-a244-45c4-891b-c1fc2f9b4b95] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:49.774483 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f0b31f7-3c49-4f11-ba8d-d793ea47ecfe tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:49.775840 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f0b31f7-3c49-4f11-ba8d-d793ea47ecfe tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:49.776477 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4d424bc-ca0e-436f-8216-c63be5a7210b tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:49.778181 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f0b31f7-3c49-4f11-ba8d-d793ea47ecfe tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:49.778814 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4d424bc-ca0e-436f-8216-c63be5a7210b tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:49.779486 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4d424bc-ca0e-436f-8216-c63be5a7210b tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:49.780228 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4d424bc-ca0e-436f-8216-c63be5a7210b tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:49.782958 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f0b31f7-3c49-4f11-ba8d-d793ea47ecfe tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:49.783578 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f0b31f7-3c49-4f11-ba8d-d793ea47ecfe tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:49.783803 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4d424bc-ca0e-436f-8216-c63be5a7210b tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:49.784526 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f0b31f7-3c49-4f11-ba8d-d793ea47ecfe tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:49.793501 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4d424bc-ca0e-436f-8216-c63be5a7210b tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:49.849262 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-4f0b31f7-3c49-4f11-ba8d-d793ea47ecfe tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Getting quotas for project 04fd51d598a04ff7a909b3ced951dea8. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:34:49.870003 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-4f0b31f7-3c49-4f11-ba8d-d793ea47ecfe tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Getting quotas for user 5309baeeec484df194123d22779b0255 and project 04fd51d598a04ff7a909b3ced951dea8. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:34:49.884961 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4f0b31f7-3c49-4f11-ba8d-d793ea47ecfe tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:34:49.889438 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4f0b31f7-3c49-4f11-ba8d-d793ea47ecfe tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 201e386f-6cc8-4840-9692-b9d718a8e346] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:34:49.938553 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e4d424bc-ca0e-436f-8216-c63be5a7210b tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a044b3132948fabf926cdd494c2c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75878827878e4ad796216561bf73b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:49.953957 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e4d424bc-ca0e-436f-8216-c63be5a7210b tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] 10.222.0.60 "GET /compute/v2.1/servers/b649575f-a244-45c4-891b-c1fc2f9b4b95" status: 200 len: 1542 microversion: 2.1 time: 0.205247 Oct 18 15:34:49.969214 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1215/2319] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:49 2022] GET /compute/v2.1/servers/b649575f-a244-45c4-891b-c1fc2f9b4b95 => generated 1542 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:49.976608 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d89b7bff-6803-4acd-821d-3657117f08ad tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:49.985564 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d89b7bff-6803-4acd-821d-3657117f08ad tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 0dbbde45-f255-4ac5-8887-1ce8de673fca] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:49.991131 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4f0b31f7-3c49-4f11-ba8d-d793ea47ecfe tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.583164 Oct 18 15:34:50.000064 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1105/2320] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:34:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:34:50.005680 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d89b7bff-6803-4acd-821d-3657117f08ad tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:50.007127 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eb10980f-ce25-42d4-add1-b90611ac9ec0 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:50.007720 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d89b7bff-6803-4acd-821d-3657117f08ad tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:50.008201 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-eb10980f-ce25-42d4-add1-b90611ac9ec0 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] [instance: 1931cdff-d761-428e-9b1c-38172c965058] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:50.008993 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d89b7bff-6803-4acd-821d-3657117f08ad tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:50.009979 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d89b7bff-6803-4acd-821d-3657117f08ad tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:50.012751 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d89b7bff-6803-4acd-821d-3657117f08ad tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:50.014669 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d89b7bff-6803-4acd-821d-3657117f08ad tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:50.017597 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb10980f-ce25-42d4-add1-b90611ac9ec0 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:50.018212 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb10980f-ce25-42d4-add1-b90611ac9ec0 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:50.018770 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb10980f-ce25-42d4-add1-b90611ac9ec0 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:50.019541 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb10980f-ce25-42d4-add1-b90611ac9ec0 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:50.020208 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb10980f-ce25-42d4-add1-b90611ac9ec0 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:50.020841 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb10980f-ce25-42d4-add1-b90611ac9ec0 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:50.039614 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-eb10980f-ce25-42d4-add1-b90611ac9ec0 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] HTTP exception thrown: Instance 1931cdff-d761-428e-9b1c-38172c965058 could not be found. Oct 18 15:34:50.042224 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eb10980f-ce25-42d4-add1-b90611ac9ec0 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Request method failure captured: Oct 18 15:34:50.042224 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/1931cdff-d761-428e-9b1c-38172c965058 HTTP/1.1 Oct 18 15:34:50.042224 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:34:50.042224 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:34:50.042224 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:34:50.042224 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:34:50.042224 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:34:50.042224 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:34:50.042224 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:34:50.042224 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:34:50.042224 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTseBXq5wYUcvWjsz0PMkKl8mDku4vmaIrb4BQLkr749EbQMK007JyRou9nlFNm5dCFWKq--uRZvYcQWHRoZtZ5T1xjThbbVT9cTPWhWtGQnBdB73M0RQkydOMiWfwmVw80hNdW5PveKL-jWcRHkEJ2iKWv_LmC8-BZU3AaSIhlKbr3A Oct 18 15:34:50.042224 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:34:50.042224 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:34:50.042224 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:34:50.042224 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:34:50.042224 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:34:50.042224 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:34:50.042224 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: c357719084cd4fc4ae89b665a6aca5dd Oct 18 15:34:50.042224 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-29981249 Oct 18 15:34:50.042224 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:34:50.042224 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:34:50.043665 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c357719084cd4fc4ae89b665a6aca5dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c357719084cd4fc4ae89b665a6aca5dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c357719084cd4fc4ae89b665a6aca5dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c357719084cd4fc4ae89b665a6aca5dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:34:50.043665 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-29981249 Oct 18 15:34:50.043665 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: c357719084cd4fc4ae89b665a6aca5dd Oct 18 15:34:50.043665 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-29981249 Oct 18 15:34:50.043665 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServerDiagnosticsNegativeTest-29981249-project Oct 18 15:34:50.043665 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:34:50.043665 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:34:50.043665 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 05be677eedec4a69b3da6e417f5201b1 Oct 18 15:34:50.043665 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-29981249-project Oct 18 15:34:50.043665 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:34:50.043665 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 1931cdff-d761-428e-9b1c-38172c965058 could not be found. Oct 18 15:34:50.043665 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '1931cdff-d761-428e-9b1c-38172c965058'} Oct 18 15:34:50.044471 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:34:50.044471 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:50.044471 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:34:50.044471 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:34:50.044471 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:34:50.044471 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:34:50.044471 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:34:50.044471 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:34:50.044471 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:34:50.044471 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:34:50.044471 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1931cdff-d761-428e-9b1c-38172c965058 could not be found. Oct 18 15:34:50.044471 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:50.044471 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:34:50.044471 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:50.044471 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:50.044471 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:34:50.044471 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:34:50.044471 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:34:50.044471 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:34:50.044471 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:34:50.045839 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:34:50.045839 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:34:50.045839 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:34:50.045839 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:34:50.045839 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:34:50.045839 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:34:50.045839 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:34:50.045839 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1931cdff-d761-428e-9b1c-38172c965058 could not be found. Oct 18 15:34:50.045839 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:50.045839 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:34:50.045839 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:50.045839 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:50.045839 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:34:50.045839 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:34:50.045839 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:34:50.045839 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:34:50.045839 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1931cdff-d761-428e-9b1c-38172c965058 could not be found. Oct 18 15:34:50.045839 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:34:50.047006 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eb10980f-ce25-42d4-add1-b90611ac9ec0 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] Returning 404 to user: Instance 1931cdff-d761-428e-9b1c-38172c965058 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:34:50.047006 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-eb10980f-ce25-42d4-add1-b90611ac9ec0 tempest-ServerDiagnosticsNegativeTest-29981249 tempest-ServerDiagnosticsNegativeTest-29981249-project] 10.222.0.60 "GET /compute/v2.1/servers/1931cdff-d761-428e-9b1c-38172c965058" status: 404 len: 111 microversion: 2.1 time: 0.043447 Oct 18 15:34:50.047470 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1106/2321] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:50 2022] GET /compute/v2.1/servers/1931cdff-d761-428e-9b1c-38172c965058 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:34:50.065904 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-5be3d74c-4ed5-4bf0-b9fc-952f5cc3bc9d req-5a3ca29a-decc-41f1-9962-9a58952f4672 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1931cdff-d761-428e-9b1c-38172c965058", "name": "network-vif-deleted", "tag": "231b7655-99e3-4e87-8adc-002c31052bf1"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:34:50.077694 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5be3d74c-4ed5-4bf0-b9fc-952f5cc3bc9d req-5a3ca29a-decc-41f1-9962-9a58952f4672 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:50.078411 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5be3d74c-4ed5-4bf0-b9fc-952f5cc3bc9d req-5a3ca29a-decc-41f1-9962-9a58952f4672 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:50.079018 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5be3d74c-4ed5-4bf0-b9fc-952f5cc3bc9d req-5a3ca29a-decc-41f1-9962-9a58952f4672 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:50.156094 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-5be3d74c-4ed5-4bf0-b9fc-952f5cc3bc9d req-5a3ca29a-decc-41f1-9962-9a58952f4672 service nova] Creating event network-vif-deleted:231b7655-99e3-4e87-8adc-002c31052bf1 for instance 1931cdff-d761-428e-9b1c-38172c965058 on n-h2-853682-5 Oct 18 15:34:50.168119 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-5be3d74c-4ed5-4bf0-b9fc-952f5cc3bc9d req-5a3ca29a-decc-41f1-9962-9a58952f4672 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118434 Oct 18 15:34:50.169432 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1107/2322] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:34:50.178767 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0be64d30-f913-47a7-9880-e606eb85d715 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:50.190365 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0be64d30-f913-47a7-9880-e606eb85d715 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 201e386f-6cc8-4840-9692-b9d718a8e346] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:50.518451 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0be64d30-f913-47a7-9880-e606eb85d715 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:50.532470 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0be64d30-f913-47a7-9880-e606eb85d715 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/201e386f-6cc8-4840-9692-b9d718a8e346" status: 200 len: 1215 microversion: 2.1 time: 0.361605 Oct 18 15:34:50.554130 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1108/2323] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:50 2022] GET /compute/v2.1/servers/201e386f-6cc8-4840-9692-b9d718a8e346 => generated 1215 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:50.577808 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ce2fa04a-753e-4a57-a9c7-e25ca4836790 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:50.581073 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ce2fa04a-753e-4a57-a9c7-e25ca4836790 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] [instance: 4e1ae723-8f58-4752-b578-da0b39e9a668] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:50.616099 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce2fa04a-753e-4a57-a9c7-e25ca4836790 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:50.616964 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce2fa04a-753e-4a57-a9c7-e25ca4836790 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:50.618373 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce2fa04a-753e-4a57-a9c7-e25ca4836790 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:50.620875 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce2fa04a-753e-4a57-a9c7-e25ca4836790 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:50.623309 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce2fa04a-753e-4a57-a9c7-e25ca4836790 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:50.628563 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce2fa04a-753e-4a57-a9c7-e25ca4836790 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:51.034939 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=4 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:34:51.072873 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d89b7bff-6803-4acd-821d-3657117f08ad tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:51.092909 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d89b7bff-6803-4acd-821d-3657117f08ad tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca" status: 200 len: 1312 microversion: 2.1 time: 1.129114 Oct 18 15:34:51.117850 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1216/2324] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:49 2022] GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca => generated 1312 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:51.161249 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a3dba1da-f918-40cb-a8b7-71469b9abc37 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:51.163278 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a3dba1da-f918-40cb-a8b7-71469b9abc37 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] [instance: 91379e3c-806e-4061-8f3b-ec788e6e50ec] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:51.174380 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=5 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:34:51.178595 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a3dba1da-f918-40cb-a8b7-71469b9abc37 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:51.179355 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a3dba1da-f918-40cb-a8b7-71469b9abc37 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:51.180566 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a3dba1da-f918-40cb-a8b7-71469b9abc37 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:51.182751 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a3dba1da-f918-40cb-a8b7-71469b9abc37 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:51.185419 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a3dba1da-f918-40cb-a8b7-71469b9abc37 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:51.186030 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a3dba1da-f918-40cb-a8b7-71469b9abc37 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:51.714469 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a3dba1da-f918-40cb-a8b7-71469b9abc37 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122fdcf75d8047e5aa7961d2dde86c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238884d1b84f47969b59ca56d6c568e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:51.731370 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a3dba1da-f918-40cb-a8b7-71469b9abc37 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122fdcf75d8047e5aa7961d2dde86c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238884d1b84f47969b59ca56d6c568e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:51.733057 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a3dba1da-f918-40cb-a8b7-71469b9abc37 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122fdcf75d8047e5aa7961d2dde86c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238884d1b84f47969b59ca56d6c568e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:51.736096 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a3dba1da-f918-40cb-a8b7-71469b9abc37 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] 10.222.0.60 "GET /compute/v2.1/servers/91379e3c-806e-4061-8f3b-ec788e6e50ec" status: 200 len: 1365 microversion: 2.47 time: 0.597661 Oct 18 15:34:51.738656 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1217/2325] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:34:51 2022] GET /compute/v2.1/servers/91379e3c-806e-4061-8f3b-ec788e6e50ec => generated 1365 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:34:51.748414 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6036223b-0ad7-4752-971c-15116f34f4c2 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:51.749313 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6036223b-0ad7-4752-971c-15116f34f4c2 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] [instance: b649575f-a244-45c4-891b-c1fc2f9b4b95] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:51.764782 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6036223b-0ad7-4752-971c-15116f34f4c2 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:51.765553 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6036223b-0ad7-4752-971c-15116f34f4c2 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:51.766169 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6036223b-0ad7-4752-971c-15116f34f4c2 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:51.769020 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6036223b-0ad7-4752-971c-15116f34f4c2 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:51.770271 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6036223b-0ad7-4752-971c-15116f34f4c2 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:51.770958 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6036223b-0ad7-4752-971c-15116f34f4c2 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:51.816431 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ce2fa04a-753e-4a57-a9c7-e25ca4836790 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f901dea4594eb6831a78e2e603e8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c369c078bd4c49148290abb7de3d076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:51.835077 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ce2fa04a-753e-4a57-a9c7-e25ca4836790 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/servers/4e1ae723-8f58-4752-b578-da0b39e9a668" status: 200 len: 1473 microversion: 2.1 time: 1.277692 Oct 18 15:34:51.847727 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1109/2326] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:50 2022] GET /compute/v2.1/servers/4e1ae723-8f58-4752-b578-da0b39e9a668 => generated 1473 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:51.867686 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e56fc6fc-0774-4f41-ac36-37bd5bcd77c5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:51.868550 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e56fc6fc-0774-4f41-ac36-37bd5bcd77c5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 201e386f-6cc8-4840-9692-b9d718a8e346] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:51.884576 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e56fc6fc-0774-4f41-ac36-37bd5bcd77c5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:51.887141 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e56fc6fc-0774-4f41-ac36-37bd5bcd77c5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:51.889389 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e56fc6fc-0774-4f41-ac36-37bd5bcd77c5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:51.890329 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e56fc6fc-0774-4f41-ac36-37bd5bcd77c5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:51.891337 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e56fc6fc-0774-4f41-ac36-37bd5bcd77c5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:51.895911 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e56fc6fc-0774-4f41-ac36-37bd5bcd77c5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:52.017800 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6036223b-0ad7-4752-971c-15116f34f4c2 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a044b3132948fabf926cdd494c2c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75878827878e4ad796216561bf73b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:52.036448 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6036223b-0ad7-4752-971c-15116f34f4c2 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] 10.222.0.60 "GET /compute/v2.1/servers/b649575f-a244-45c4-891b-c1fc2f9b4b95" status: 200 len: 1253 microversion: 2.1 time: 0.290413 Oct 18 15:34:52.039940 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1218/2327] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:51 2022] GET /compute/v2.1/servers/b649575f-a244-45c4-891b-c1fc2f9b4b95 => generated 1253 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:52.132940 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f03cd990-2200-4fb3-aa85-ec1c4df1aa25 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:52.133759 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f03cd990-2200-4fb3-aa85-ec1c4df1aa25 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 0dbbde45-f255-4ac5-8887-1ce8de673fca] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:52.161768 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f03cd990-2200-4fb3-aa85-ec1c4df1aa25 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:52.162253 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f03cd990-2200-4fb3-aa85-ec1c4df1aa25 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:52.162693 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f03cd990-2200-4fb3-aa85-ec1c4df1aa25 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:52.170748 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e56fc6fc-0774-4f41-ac36-37bd5bcd77c5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:52.179290 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e56fc6fc-0774-4f41-ac36-37bd5bcd77c5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/201e386f-6cc8-4840-9692-b9d718a8e346" status: 200 len: 1267 microversion: 2.1 time: 0.329691 Oct 18 15:34:52.180435 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f03cd990-2200-4fb3-aa85-ec1c4df1aa25 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:52.183477 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f03cd990-2200-4fb3-aa85-ec1c4df1aa25 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:52.187580 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f03cd990-2200-4fb3-aa85-ec1c4df1aa25 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:52.194737 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1110/2328] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:51 2022] GET /compute/v2.1/servers/201e386f-6cc8-4840-9692-b9d718a8e346 => generated 1267 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:52.228353 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-970408d1-a181-4b5d-bd38-028e3d2b100b req-d9839485-7b40-40f2-ab00-e3777099b843 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e1ae723-8f58-4752-b578-da0b39e9a668", "name": "network-vif-deleted", "tag": "2083c6f4-97f8-4301-a307-2ecb7417f192"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:34:52.276576 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-970408d1-a181-4b5d-bd38-028e3d2b100b req-d9839485-7b40-40f2-ab00-e3777099b843 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:52.277466 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-970408d1-a181-4b5d-bd38-028e3d2b100b req-d9839485-7b40-40f2-ab00-e3777099b843 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:52.279151 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-970408d1-a181-4b5d-bd38-028e3d2b100b req-d9839485-7b40-40f2-ab00-e3777099b843 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:52.312102 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-970408d1-a181-4b5d-bd38-028e3d2b100b req-d9839485-7b40-40f2-ab00-e3777099b843 service nova] Creating event network-vif-deleted:2083c6f4-97f8-4301-a307-2ecb7417f192 for instance 4e1ae723-8f58-4752-b578-da0b39e9a668 on n-h1-853682-5 Oct 18 15:34:52.333377 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-970408d1-a181-4b5d-bd38-028e3d2b100b req-d9839485-7b40-40f2-ab00-e3777099b843 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118211 Oct 18 15:34:52.334430 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1111/2329] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:34:52.521971 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f03cd990-2200-4fb3-aa85-ec1c4df1aa25 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:52.534301 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f03cd990-2200-4fb3-aa85-ec1c4df1aa25 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca" status: 200 len: 1312 microversion: 2.1 time: 0.420339 Oct 18 15:34:52.551534 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1219/2330] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:52 2022] GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca => generated 1312 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:34:52.766087 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-50f19594-3179-4581-8815-dbc0de919fc8 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:52.766877 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-50f19594-3179-4581-8815-dbc0de919fc8 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] [instance: 91379e3c-806e-4061-8f3b-ec788e6e50ec] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:52.784489 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50f19594-3179-4581-8815-dbc0de919fc8 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:52.791555 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50f19594-3179-4581-8815-dbc0de919fc8 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:52.798334 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50f19594-3179-4581-8815-dbc0de919fc8 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:52.799105 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50f19594-3179-4581-8815-dbc0de919fc8 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:52.799751 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50f19594-3179-4581-8815-dbc0de919fc8 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:52.800332 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50f19594-3179-4581-8815-dbc0de919fc8 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:52.876297 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a5f4db84-0a3f-4e09-983e-da8e52f53989 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:52.877353 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a5f4db84-0a3f-4e09-983e-da8e52f53989 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] [instance: 4e1ae723-8f58-4752-b578-da0b39e9a668] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:52.887447 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a5f4db84-0a3f-4e09-983e-da8e52f53989 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:52.890789 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a5f4db84-0a3f-4e09-983e-da8e52f53989 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:52.892667 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a5f4db84-0a3f-4e09-983e-da8e52f53989 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:52.895870 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a5f4db84-0a3f-4e09-983e-da8e52f53989 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:52.896607 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a5f4db84-0a3f-4e09-983e-da8e52f53989 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:52.898664 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a5f4db84-0a3f-4e09-983e-da8e52f53989 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:53.035105 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-50f19594-3179-4581-8815-dbc0de919fc8 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122fdcf75d8047e5aa7961d2dde86c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238884d1b84f47969b59ca56d6c568e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:53.053108 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-50f19594-3179-4581-8815-dbc0de919fc8 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122fdcf75d8047e5aa7961d2dde86c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238884d1b84f47969b59ca56d6c568e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:53.054910 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-50f19594-3179-4581-8815-dbc0de919fc8 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122fdcf75d8047e5aa7961d2dde86c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238884d1b84f47969b59ca56d6c568e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:53.056141 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-50f19594-3179-4581-8815-dbc0de919fc8 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] 10.222.0.60 "GET /compute/v2.1/servers/91379e3c-806e-4061-8f3b-ec788e6e50ec" status: 200 len: 1365 microversion: 2.47 time: 0.294609 Oct 18 15:34:53.073545 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1112/2331] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:34:52 2022] GET /compute/v2.1/servers/91379e3c-806e-4061-8f3b-ec788e6e50ec => generated 1365 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:34:53.084133 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1dd00645-b0de-43bd-81c7-40c361d3f372 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:53.090309 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1dd00645-b0de-43bd-81c7-40c361d3f372 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] [instance: b649575f-a244-45c4-891b-c1fc2f9b4b95] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:53.107865 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1dd00645-b0de-43bd-81c7-40c361d3f372 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:53.108361 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1dd00645-b0de-43bd-81c7-40c361d3f372 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:53.108823 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1dd00645-b0de-43bd-81c7-40c361d3f372 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:53.109556 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1dd00645-b0de-43bd-81c7-40c361d3f372 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:53.110013 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1dd00645-b0de-43bd-81c7-40c361d3f372 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:53.110442 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1dd00645-b0de-43bd-81c7-40c361d3f372 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:53.147793 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a5f4db84-0a3f-4e09-983e-da8e52f53989 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f901dea4594eb6831a78e2e603e8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c369c078bd4c49148290abb7de3d076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:53.185299 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a5f4db84-0a3f-4e09-983e-da8e52f53989 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/servers/4e1ae723-8f58-4752-b578-da0b39e9a668" status: 200 len: 1302 microversion: 2.1 time: 0.313552 Oct 18 15:34:53.188516 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1220/2332] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:52 2022] GET /compute/v2.1/servers/4e1ae723-8f58-4752-b578-da0b39e9a668 => generated 1302 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:53.206793 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3884c95b-a113-44e2-8d86-a9b7fdfbda6a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:53.207649 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3884c95b-a113-44e2-8d86-a9b7fdfbda6a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 201e386f-6cc8-4840-9692-b9d718a8e346] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:53.226838 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3884c95b-a113-44e2-8d86-a9b7fdfbda6a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:53.232625 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3884c95b-a113-44e2-8d86-a9b7fdfbda6a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:53.234122 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3884c95b-a113-44e2-8d86-a9b7fdfbda6a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:53.249296 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1dd00645-b0de-43bd-81c7-40c361d3f372 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a044b3132948fabf926cdd494c2c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75878827878e4ad796216561bf73b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:53.249985 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3884c95b-a113-44e2-8d86-a9b7fdfbda6a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:53.250507 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3884c95b-a113-44e2-8d86-a9b7fdfbda6a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:53.250949 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3884c95b-a113-44e2-8d86-a9b7fdfbda6a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:53.262179 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1dd00645-b0de-43bd-81c7-40c361d3f372 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] 10.222.0.60 "GET /compute/v2.1/servers/b649575f-a244-45c4-891b-c1fc2f9b4b95" status: 200 len: 1253 microversion: 2.1 time: 0.187807 Oct 18 15:34:53.265617 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1113/2333] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:53 2022] GET /compute/v2.1/servers/b649575f-a244-45c4-891b-c1fc2f9b4b95 => generated 1253 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:53.560560 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c1d7e9c8-8cda-44f2-a233-2644c67a036e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:53.561217 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c1d7e9c8-8cda-44f2-a233-2644c67a036e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 0dbbde45-f255-4ac5-8887-1ce8de673fca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:53.576122 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1d7e9c8-8cda-44f2-a233-2644c67a036e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:53.576636 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1d7e9c8-8cda-44f2-a233-2644c67a036e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:53.577114 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1d7e9c8-8cda-44f2-a233-2644c67a036e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:53.586568 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1d7e9c8-8cda-44f2-a233-2644c67a036e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:53.587073 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1d7e9c8-8cda-44f2-a233-2644c67a036e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:53.587736 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1d7e9c8-8cda-44f2-a233-2644c67a036e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:54.010425 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3884c95b-a113-44e2-8d86-a9b7fdfbda6a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:54.022888 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3884c95b-a113-44e2-8d86-a9b7fdfbda6a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/201e386f-6cc8-4840-9692-b9d718a8e346" status: 200 len: 1273 microversion: 2.1 time: 0.821174 Oct 18 15:34:54.025920 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1221/2334] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:53 2022] GET /compute/v2.1/servers/201e386f-6cc8-4840-9692-b9d718a8e346 => generated 1273 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:54.093040 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-50e1d534-361b-4b21-a220-671048032e13 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:54.093923 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-50e1d534-361b-4b21-a220-671048032e13 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] [instance: 91379e3c-806e-4061-8f3b-ec788e6e50ec] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:54.100758 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-50e1d534-361b-4b21-a220-671048032e13 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:54.105408 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-50e1d534-361b-4b21-a220-671048032e13 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:54.106068 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-50e1d534-361b-4b21-a220-671048032e13 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:54.106968 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-50e1d534-361b-4b21-a220-671048032e13 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:54.107848 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-50e1d534-361b-4b21-a220-671048032e13 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:54.108462 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-50e1d534-361b-4b21-a220-671048032e13 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:54.254931 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-50e1d534-361b-4b21-a220-671048032e13 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122fdcf75d8047e5aa7961d2dde86c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238884d1b84f47969b59ca56d6c568e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:54.270747 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-50e1d534-361b-4b21-a220-671048032e13 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122fdcf75d8047e5aa7961d2dde86c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238884d1b84f47969b59ca56d6c568e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:54.280193 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-50e1d534-361b-4b21-a220-671048032e13 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122fdcf75d8047e5aa7961d2dde86c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238884d1b84f47969b59ca56d6c568e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:54.281608 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-50e1d534-361b-4b21-a220-671048032e13 tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] 10.222.0.60 "GET /compute/v2.1/servers/91379e3c-806e-4061-8f3b-ec788e6e50ec" status: 200 len: 1365 microversion: 2.47 time: 0.192480 Oct 18 15:34:54.282750 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1222/2335] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:34:54 2022] GET /compute/v2.1/servers/91379e3c-806e-4061-8f3b-ec788e6e50ec => generated 1365 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:34:54.308682 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-de6c646d-89ce-4c36-b9de-98f4d278f77f tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:54.309639 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-de6c646d-89ce-4c36-b9de-98f4d278f77f tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] [instance: 4e1ae723-8f58-4752-b578-da0b39e9a668] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:54.316500 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:34:54.318418 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de6c646d-89ce-4c36-b9de-98f4d278f77f tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:54.322861 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de6c646d-89ce-4c36-b9de-98f4d278f77f tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:54.323515 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de6c646d-89ce-4c36-b9de-98f4d278f77f tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:54.324437 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de6c646d-89ce-4c36-b9de-98f4d278f77f tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:54.325074 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de6c646d-89ce-4c36-b9de-98f4d278f77f tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:54.327905 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de6c646d-89ce-4c36-b9de-98f4d278f77f tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:54.374585 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c1d7e9c8-8cda-44f2-a233-2644c67a036e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:54.381034 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-de6c646d-89ce-4c36-b9de-98f4d278f77f tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] HTTP exception thrown: Instance 4e1ae723-8f58-4752-b578-da0b39e9a668 could not be found. Oct 18 15:34:54.383608 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-de6c646d-89ce-4c36-b9de-98f4d278f77f tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Request method failure captured: Oct 18 15:34:54.383608 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/4e1ae723-8f58-4752-b578-da0b39e9a668 HTTP/1.1 Oct 18 15:34:54.383608 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:34:54.383608 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:34:54.383608 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:34:54.383608 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:34:54.383608 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:34:54.383608 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:34:54.383608 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:34:54.383608 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:34:54.383608 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsbRFrYEzgiPfgYGqMGFOEdmkpBP6cxw4fg6wUYClPSco-YU86iApA9v9HgD0FjaY8pFtBQFpobpa9BV0g0x8CwcgtkKTuIbx4PkGUX9Y3mcp4kTE9xqLTtJDAKXhut0WKjIxviXOuzqI5e1b8XLeWKJRgHJKDlHY0bE8VYcyCGX-GY Oct 18 15:34:54.383608 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:34:54.383608 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:34:54.383608 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:34:54.383608 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:34:54.383608 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:34:54.383608 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:34:54.383608 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: c369c078bd4c49148290abb7de3d076f Oct 18 15:34:54.383608 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ListImageFiltersTestJSON-1331268878 Oct 18 15:34:54.383608 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:34:54.383608 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:34:54.385485 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c369c078bd4c49148290abb7de3d076f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c369c078bd4c49148290abb7de3d076f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c369c078bd4c49148290abb7de3d076f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c369c078bd4c49148290abb7de3d076f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:34:54.385485 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ListImageFiltersTestJSON-1331268878 Oct 18 15:34:54.385485 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: c369c078bd4c49148290abb7de3d076f Oct 18 15:34:54.385485 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1331268878 Oct 18 15:34:54.385485 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ListImageFiltersTestJSON-1331268878-project Oct 18 15:34:54.385485 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:34:54.385485 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:34:54.385485 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 79f901dea4594eb6831a78e2e603e8a0 Oct 18 15:34:54.385485 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ListImageFiltersTestJSON-1331268878-project Oct 18 15:34:54.385485 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:34:54.385485 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 4e1ae723-8f58-4752-b578-da0b39e9a668 could not be found. Oct 18 15:34:54.385485 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '4e1ae723-8f58-4752-b578-da0b39e9a668'} Oct 18 15:34:54.386151 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:34:54.386151 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:54.386151 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:34:54.386151 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:34:54.386151 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:34:54.386151 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:34:54.386151 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:34:54.386151 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:34:54.386151 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:34:54.386151 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:34:54.386151 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e1ae723-8f58-4752-b578-da0b39e9a668 could not be found. Oct 18 15:34:54.386151 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:54.386151 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:34:54.386151 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:54.386151 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:54.386151 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:34:54.386151 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:34:54.386151 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:34:54.386151 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:34:54.386151 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:34:54.387187 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:34:54.387187 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:34:54.387187 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:34:54.387187 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:34:54.387187 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:34:54.387187 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:34:54.387187 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:34:54.387187 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e1ae723-8f58-4752-b578-da0b39e9a668 could not be found. Oct 18 15:34:54.387187 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:54.387187 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:34:54.387187 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:54.387187 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:54.387187 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:34:54.387187 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:34:54.387187 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:34:54.387187 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:34:54.387187 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e1ae723-8f58-4752-b578-da0b39e9a668 could not be found. Oct 18 15:34:54.387187 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:54.388133 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-de6c646d-89ce-4c36-b9de-98f4d278f77f tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Returning 404 to user: Instance 4e1ae723-8f58-4752-b578-da0b39e9a668 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:34:54.388133 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-de6c646d-89ce-4c36-b9de-98f4d278f77f tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "GET /compute/v2.1/servers/4e1ae723-8f58-4752-b578-da0b39e9a668" status: 404 len: 111 microversion: 2.1 time: 0.102119 Oct 18 15:34:54.389865 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1223/2336] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:54 2022] GET /compute/v2.1/servers/4e1ae723-8f58-4752-b578-da0b39e9a668 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:34:54.397624 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c1d7e9c8-8cda-44f2-a233-2644c67a036e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca" status: 200 len: 1312 microversion: 2.1 time: 0.841256 Oct 18 15:34:54.399737 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b80e7882-a6e7-4d28-a93c-9134dcb50d06 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:54.401712 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b80e7882-a6e7-4d28-a93c-9134dcb50d06 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] [instance: b649575f-a244-45c4-891b-c1fc2f9b4b95] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:54.417418 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1114/2337] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:53 2022] GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca => generated 1312 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:54.421930 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b80e7882-a6e7-4d28-a93c-9134dcb50d06 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:54.422662 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b80e7882-a6e7-4d28-a93c-9134dcb50d06 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:54.423305 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b80e7882-a6e7-4d28-a93c-9134dcb50d06 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:54.424184 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b80e7882-a6e7-4d28-a93c-9134dcb50d06 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:54.425276 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b80e7882-a6e7-4d28-a93c-9134dcb50d06 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:54.425853 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b80e7882-a6e7-4d28-a93c-9134dcb50d06 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:54.442956 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3bb38e2d-8adf-4178-9a68-5bdcd3906006 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c3cef05e0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:54.606442 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b80e7882-a6e7-4d28-a93c-9134dcb50d06 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a044b3132948fabf926cdd494c2c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75878827878e4ad796216561bf73b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:54.619388 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b80e7882-a6e7-4d28-a93c-9134dcb50d06 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] 10.222.0.60 "GET /compute/v2.1/servers/b649575f-a244-45c4-891b-c1fc2f9b4b95" status: 200 len: 1253 microversion: 2.1 time: 0.228355 Oct 18 15:34:54.621549 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1224/2338] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:54 2022] GET /compute/v2.1/servers/b649575f-a244-45c4-891b-c1fc2f9b4b95 => generated 1253 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:55.054013 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-eb628e19-2465-45de-9cda-992a099e0173 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:55.055163 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-eb628e19-2465-45de-9cda-992a099e0173 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 201e386f-6cc8-4840-9692-b9d718a8e346] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:55.064727 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eb628e19-2465-45de-9cda-992a099e0173 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:55.065732 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eb628e19-2465-45de-9cda-992a099e0173 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:55.066351 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eb628e19-2465-45de-9cda-992a099e0173 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:55.067243 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eb628e19-2465-45de-9cda-992a099e0173 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:55.068272 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eb628e19-2465-45de-9cda-992a099e0173 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:55.069046 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eb628e19-2465-45de-9cda-992a099e0173 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:55.101546 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3bb38e2d-8adf-4178-9a68-5bdcd3906006 tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "DELETE /compute/v2.1/images/90e4a2d6-0135-42c3-bfb1-aa6439ca7be4" status: 204 len: 0 microversion: 2.1 time: 0.681084 Oct 18 15:34:55.105850 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1115/2339] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:54 2022] DELETE /compute/v2.1/images/90e4a2d6-0135-42c3-bfb1-aa6439ca7be4 => generated 0 bytes in 686 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:34:55.117207 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-26f47a2b-bcc5-4062-a3ea-ca02ed9f568a tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c3d679820>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:55.406295 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-eb628e19-2465-45de-9cda-992a099e0173 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:55.425243 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-eb628e19-2465-45de-9cda-992a099e0173 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/201e386f-6cc8-4840-9692-b9d718a8e346" status: 200 len: 1315 microversion: 2.1 time: 0.377723 Oct 18 15:34:55.432622 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1225/2340] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:55 2022] GET /compute/v2.1/servers/201e386f-6cc8-4840-9692-b9d718a8e346 => generated 1315 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:55.448725 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b21cf069-0e06-4c74-8089-16e15911c10a tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:55.448725 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b21cf069-0e06-4c74-8089-16e15911c10a tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] [instance: 91379e3c-806e-4061-8f3b-ec788e6e50ec] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:55.467279 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b21cf069-0e06-4c74-8089-16e15911c10a tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:55.471807 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b21cf069-0e06-4c74-8089-16e15911c10a tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:55.478738 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b21cf069-0e06-4c74-8089-16e15911c10a tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:55.482605 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b21cf069-0e06-4c74-8089-16e15911c10a tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:55.487159 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b21cf069-0e06-4c74-8089-16e15911c10a tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:55.489224 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b21cf069-0e06-4c74-8089-16e15911c10a tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:55.551701 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-b21cf069-0e06-4c74-8089-16e15911c10a tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] HTTP exception thrown: Instance 91379e3c-806e-4061-8f3b-ec788e6e50ec could not be found. Oct 18 15:34:55.557197 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b21cf069-0e06-4c74-8089-16e15911c10a tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Request method failure captured: Oct 18 15:34:55.557197 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/91379e3c-806e-4061-8f3b-ec788e6e50ec HTTP/1.1 Oct 18 15:34:55.557197 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:34:55.557197 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:34:55.557197 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:34:55.557197 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:34:55.557197 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:34:55.557197 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:34:55.557197 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:34:55.557197 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:34:55.557197 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTseMbvaPuhf_CPx-B-xkuOQQxbTVTlhK12z5ZSvTjmqCDoGgJYMO9kyeAHYpzHWm3VbyoT-fXT_fvDiEwpeIFPLHVugJkP3g-Qy_AUzR54sR4SC9wMdIYSuH4e71Du6FsIIIjBajwZHP382xUj4KJAm00xeXVHBXCGXQTOTDPgzB0iw Oct 18 15:34:55.557197 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:34:55.557197 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:34:55.557197 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:34:55.557197 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:34:55.557197 n-d-853682-5 devstack@n-api.service[120405]: X-Openstack-Nova-Api-Version: 2.47 Oct 18 15:34:55.557197 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:34:55.557197 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:34:55.557197 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 238884d1b84f47969b59ca56d6c568e0 Oct 18 15:34:55.557197 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServersAaction247Test-1785455963 Oct 18 15:34:55.557197 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:34:55.557197 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:34:55.562184 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/238884d1b84f47969b59ca56d6c568e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/238884d1b84f47969b59ca56d6c568e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/238884d1b84f47969b59ca56d6c568e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_238884d1b84f47969b59ca56d6c568e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:34:55.562184 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServersAaction247Test-1785455963 Oct 18 15:34:55.562184 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 238884d1b84f47969b59ca56d6c568e0 Oct 18 15:34:55.562184 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServersAaction247Test-1785455963 Oct 18 15:34:55.562184 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServersAaction247Test-1785455963-project Oct 18 15:34:55.562184 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:34:55.562184 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:34:55.562184 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 122fdcf75d8047e5aa7961d2dde86c0d Oct 18 15:34:55.562184 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServersAaction247Test-1785455963-project Oct 18 15:34:55.562184 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:34:55.562184 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 91379e3c-806e-4061-8f3b-ec788e6e50ec could not be found. Oct 18 15:34:55.562184 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '91379e3c-806e-4061-8f3b-ec788e6e50ec'} Oct 18 15:34:55.562933 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:34:55.562933 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:55.562933 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:34:55.562933 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:34:55.562933 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:34:55.562933 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:34:55.562933 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:34:55.562933 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:34:55.562933 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:34:55.562933 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:34:55.562933 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91379e3c-806e-4061-8f3b-ec788e6e50ec could not be found. Oct 18 15:34:55.562933 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:55.562933 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:34:55.562933 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:55.562933 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:55.562933 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:34:55.562933 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:34:55.562933 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:34:55.562933 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:34:55.562933 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:34:55.563982 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:34:55.563982 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:34:55.563982 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:34:55.563982 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:34:55.563982 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:34:55.563982 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:34:55.563982 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:34:55.563982 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91379e3c-806e-4061-8f3b-ec788e6e50ec could not be found. Oct 18 15:34:55.563982 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:55.563982 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:34:55.563982 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:55.563982 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:34:55.563982 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:34:55.563982 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:34:55.563982 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:34:55.563982 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:34:55.563982 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91379e3c-806e-4061-8f3b-ec788e6e50ec could not be found. Oct 18 15:34:55.563982 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:34:55.565181 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b21cf069-0e06-4c74-8089-16e15911c10a tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] Returning 404 to user: Instance 91379e3c-806e-4061-8f3b-ec788e6e50ec could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:34:55.565181 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b21cf069-0e06-4c74-8089-16e15911c10a tempest-ServersAaction247Test-1785455963 tempest-ServersAaction247Test-1785455963-project] 10.222.0.60 "GET /compute/v2.1/servers/91379e3c-806e-4061-8f3b-ec788e6e50ec" status: 404 len: 111 microversion: 2.47 time: 0.124508 Oct 18 15:34:55.565181 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1226/2341] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:34:55 2022] GET /compute/v2.1/servers/91379e3c-806e-4061-8f3b-ec788e6e50ec => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:34:55.575952 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2564af7f-20d6-483a-872a-a64cdd58fb2b tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:55.582738 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2564af7f-20d6-483a-872a-a64cdd58fb2b tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 0dbbde45-f255-4ac5-8887-1ce8de673fca] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:55.602852 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2564af7f-20d6-483a-872a-a64cdd58fb2b tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:55.603391 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2564af7f-20d6-483a-872a-a64cdd58fb2b tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:55.605070 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2564af7f-20d6-483a-872a-a64cdd58fb2b tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:55.607002 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2564af7f-20d6-483a-872a-a64cdd58fb2b tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:55.607477 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2564af7f-20d6-483a-872a-a64cdd58fb2b tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:55.607909 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2564af7f-20d6-483a-872a-a64cdd58fb2b tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:55.637706 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-26f47a2b-bcc5-4062-a3ea-ca02ed9f568a tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "DELETE /compute/v2.1/images/8076f360-cd14-41a0-a27b-3c929bfb05d6" status: 204 len: 0 microversion: 2.1 time: 0.527025 Oct 18 15:34:55.638339 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1116/2342] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:55 2022] DELETE /compute/v2.1/images/8076f360-cd14-41a0-a27b-3c929bfb05d6 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 15:34:55.650483 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6a3baea0-39ec-43d3-a7c4-e82b614d7fe6 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:55.651204 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6a3baea0-39ec-43d3-a7c4-e82b614d7fe6 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] [instance: b649575f-a244-45c4-891b-c1fc2f9b4b95] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:55.672173 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a3baea0-39ec-43d3-a7c4-e82b614d7fe6 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:55.673103 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a3baea0-39ec-43d3-a7c4-e82b614d7fe6 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:55.673713 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a3baea0-39ec-43d3-a7c4-e82b614d7fe6 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:55.677952 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a3baea0-39ec-43d3-a7c4-e82b614d7fe6 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:55.678571 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a3baea0-39ec-43d3-a7c4-e82b614d7fe6 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:55.686406 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a3baea0-39ec-43d3-a7c4-e82b614d7fe6 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:55.875061 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6a3baea0-39ec-43d3-a7c4-e82b614d7fe6 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a044b3132948fabf926cdd494c2c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75878827878e4ad796216561bf73b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:55.895580 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6a3baea0-39ec-43d3-a7c4-e82b614d7fe6 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] 10.222.0.60 "GET /compute/v2.1/servers/b649575f-a244-45c4-891b-c1fc2f9b4b95" status: 200 len: 1253 microversion: 2.1 time: 0.247757 Oct 18 15:34:55.898796 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1117/2343] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:55 2022] GET /compute/v2.1/servers/b649575f-a244-45c4-891b-c1fc2f9b4b95 => generated 1253 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:55.918490 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f13c17ea-7e73-4e6b-bb89-23fd09f09ffb tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] Calling method '.version_select at 0x7f7c3cfd8160>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:56.224112 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2564af7f-20d6-483a-872a-a64cdd58fb2b tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:56.235240 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2564af7f-20d6-483a-872a-a64cdd58fb2b tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca" status: 200 len: 1312 microversion: 2.1 time: 0.670968 Oct 18 15:34:56.236417 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1227/2344] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:55 2022] GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca => generated 1312 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:56.456501 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-70f7313f-aa50-4e55-a16e-90576cc431bf tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:56.458174 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-70f7313f-aa50-4e55-a16e-90576cc431bf tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 201e386f-6cc8-4840-9692-b9d718a8e346] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:56.475075 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-70f7313f-aa50-4e55-a16e-90576cc431bf tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:56.477479 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-70f7313f-aa50-4e55-a16e-90576cc431bf tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:56.479017 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-70f7313f-aa50-4e55-a16e-90576cc431bf tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:56.484469 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-70f7313f-aa50-4e55-a16e-90576cc431bf tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:56.485016 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-70f7313f-aa50-4e55-a16e-90576cc431bf tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:56.485466 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-70f7313f-aa50-4e55-a16e-90576cc431bf tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:56.705833 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f13c17ea-7e73-4e6b-bb89-23fd09f09ffb tempest-ListImageFiltersTestJSON-1331268878 tempest-ListImageFiltersTestJSON-1331268878-project] 10.222.0.60 "DELETE /compute/v2.1/images/bdaf13f6-f09b-4386-bc97-7843e78e9dde" status: 204 len: 0 microversion: 2.1 time: 0.805684 Oct 18 15:34:56.707521 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1118/2345] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:55 2022] DELETE /compute/v2.1/images/bdaf13f6-f09b-4386-bc97-7843e78e9dde => generated 0 bytes in 808 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:34:56.908543 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-70f7313f-aa50-4e55-a16e-90576cc431bf tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:56.920877 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-70f7313f-aa50-4e55-a16e-90576cc431bf tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/201e386f-6cc8-4840-9692-b9d718a8e346" status: 200 len: 1315 microversion: 2.1 time: 0.468812 Oct 18 15:34:56.922643 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1228/2346] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:56 2022] GET /compute/v2.1/servers/201e386f-6cc8-4840-9692-b9d718a8e346 => generated 1315 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:34:56.923224 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f39be9c3-f1c5-45c0-96be-7968cc80fe71 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:56.923844 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f39be9c3-f1c5-45c0-96be-7968cc80fe71 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] [instance: b649575f-a244-45c4-891b-c1fc2f9b4b95] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:56.937337 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f39be9c3-f1c5-45c0-96be-7968cc80fe71 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:56.938450 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f39be9c3-f1c5-45c0-96be-7968cc80fe71 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:56.938450 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f39be9c3-f1c5-45c0-96be-7968cc80fe71 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:56.939241 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f39be9c3-f1c5-45c0-96be-7968cc80fe71 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:56.939420 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f39be9c3-f1c5-45c0-96be-7968cc80fe71 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:56.939820 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f39be9c3-f1c5-45c0-96be-7968cc80fe71 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:57.171072 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f39be9c3-f1c5-45c0-96be-7968cc80fe71 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a044b3132948fabf926cdd494c2c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75878827878e4ad796216561bf73b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:57.179390 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f39be9c3-f1c5-45c0-96be-7968cc80fe71 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] 10.222.0.60 "GET /compute/v2.1/servers/b649575f-a244-45c4-891b-c1fc2f9b4b95" status: 200 len: 1253 microversion: 2.1 time: 0.260525 Oct 18 15:34:57.188502 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1119/2347] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:56 2022] GET /compute/v2.1/servers/b649575f-a244-45c4-891b-c1fc2f9b4b95 => generated 1253 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:34:57.205698 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-516a5af1-1885-487c-8dbf-4544c08ea7f0 req-6fe2aa8d-063e-4fe9-951a-48a4405d865c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "201e386f-6cc8-4840-9692-b9d718a8e346", "tag": "c27784e9-99d1-4a4c-8101-bf8238d04e69"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:34:57.241029 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-516a5af1-1885-487c-8dbf-4544c08ea7f0 req-6fe2aa8d-063e-4fe9-951a-48a4405d865c service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:57.242029 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-516a5af1-1885-487c-8dbf-4544c08ea7f0 req-6fe2aa8d-063e-4fe9-951a-48a4405d865c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:57.242642 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-516a5af1-1885-487c-8dbf-4544c08ea7f0 req-6fe2aa8d-063e-4fe9-951a-48a4405d865c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:57.247409 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:34:57.263978 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-516a5af1-1885-487c-8dbf-4544c08ea7f0 req-6fe2aa8d-063e-4fe9-951a-48a4405d865c service nova] Creating event network-changed:c27784e9-99d1-4a4c-8101-bf8238d04e69 for instance 201e386f-6cc8-4840-9692-b9d718a8e346 on n-h2-853682-5 Oct 18 15:34:57.272778 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-516a5af1-1885-487c-8dbf-4544c08ea7f0 req-6fe2aa8d-063e-4fe9-951a-48a4405d865c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082877 Oct 18 15:34:57.287725 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1120/2348] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:34:57.297170 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7874c0aa-66e2-4709-815a-d0f75b4eed23 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:57.298098 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7874c0aa-66e2-4709-815a-d0f75b4eed23 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 0dbbde45-f255-4ac5-8887-1ce8de673fca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:57.315068 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7874c0aa-66e2-4709-815a-d0f75b4eed23 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:57.315759 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7874c0aa-66e2-4709-815a-d0f75b4eed23 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:57.316355 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7874c0aa-66e2-4709-815a-d0f75b4eed23 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:57.317283 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7874c0aa-66e2-4709-815a-d0f75b4eed23 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:57.317903 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7874c0aa-66e2-4709-815a-d0f75b4eed23 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:57.318484 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7874c0aa-66e2-4709-815a-d0f75b4eed23 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:57.336122 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-3ae30d87-f3f7-4ffa-8a58-cfa2dbb73e68 req-6b11cf19-2dc2-426b-ba1b-40ce0b0b53fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dbbde45-f255-4ac5-8887-1ce8de673fca", "name": "network-vif-plugged", "status": "completed", "tag": "0ad973d8-f2bb-4e15-a985-502b69cec140"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:34:57.361831 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-3ae30d87-f3f7-4ffa-8a58-cfa2dbb73e68 req-6b11cf19-2dc2-426b-ba1b-40ce0b0b53fd service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:57.363846 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-3ae30d87-f3f7-4ffa-8a58-cfa2dbb73e68 req-6b11cf19-2dc2-426b-ba1b-40ce0b0b53fd service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:57.364530 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-3ae30d87-f3f7-4ffa-8a58-cfa2dbb73e68 req-6b11cf19-2dc2-426b-ba1b-40ce0b0b53fd service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:57.397748 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-3ae30d87-f3f7-4ffa-8a58-cfa2dbb73e68 req-6b11cf19-2dc2-426b-ba1b-40ce0b0b53fd service nova] Creating event network-vif-plugged:0ad973d8-f2bb-4e15-a985-502b69cec140 for instance 0dbbde45-f255-4ac5-8887-1ce8de673fca on n-h2-853682-5 Oct 18 15:34:57.412012 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-3ae30d87-f3f7-4ffa-8a58-cfa2dbb73e68 req-6b11cf19-2dc2-426b-ba1b-40ce0b0b53fd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.486062 Oct 18 15:34:57.417007 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1229/2349] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:34:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:34:57.715199 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7874c0aa-66e2-4709-815a-d0f75b4eed23 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:57.729188 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7874c0aa-66e2-4709-815a-d0f75b4eed23 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca" status: 200 len: 1312 microversion: 2.1 time: 0.435296 Oct 18 15:34:57.730526 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1121/2350] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:57 2022] GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca => generated 1312 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:57.945426 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ecb62606-4072-467a-a8e6-a3d317482e20 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:57.946293 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ecb62606-4072-467a-a8e6-a3d317482e20 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 201e386f-6cc8-4840-9692-b9d718a8e346] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:57.958766 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ecb62606-4072-467a-a8e6-a3d317482e20 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:57.959725 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ecb62606-4072-467a-a8e6-a3d317482e20 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:57.962030 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ecb62606-4072-467a-a8e6-a3d317482e20 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:57.963398 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ecb62606-4072-467a-a8e6-a3d317482e20 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:57.964676 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ecb62606-4072-467a-a8e6-a3d317482e20 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:57.964676 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ecb62606-4072-467a-a8e6-a3d317482e20 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:58.207838 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1189adb4-1ba3-4cb4-8857-a07d703e9604 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:58.208594 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1189adb4-1ba3-4cb4-8857-a07d703e9604 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] [instance: b649575f-a244-45c4-891b-c1fc2f9b4b95] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:58.226245 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1189adb4-1ba3-4cb4-8857-a07d703e9604 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:58.229416 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1189adb4-1ba3-4cb4-8857-a07d703e9604 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:58.230041 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1189adb4-1ba3-4cb4-8857-a07d703e9604 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:58.230946 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1189adb4-1ba3-4cb4-8857-a07d703e9604 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:58.231556 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1189adb4-1ba3-4cb4-8857-a07d703e9604 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:58.234848 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1189adb4-1ba3-4cb4-8857-a07d703e9604 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:58.481480 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1189adb4-1ba3-4cb4-8857-a07d703e9604 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a044b3132948fabf926cdd494c2c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75878827878e4ad796216561bf73b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:58.506699 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1189adb4-1ba3-4cb4-8857-a07d703e9604 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] 10.222.0.60 "GET /compute/v2.1/servers/b649575f-a244-45c4-891b-c1fc2f9b4b95" status: 200 len: 1253 microversion: 2.1 time: 0.302619 Oct 18 15:34:58.510373 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1122/2351] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:58 2022] GET /compute/v2.1/servers/b649575f-a244-45c4-891b-c1fc2f9b4b95 => generated 1253 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:58.518797 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ecb62606-4072-467a-a8e6-a3d317482e20 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:58.536045 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ecb62606-4072-467a-a8e6-a3d317482e20 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/201e386f-6cc8-4840-9692-b9d718a8e346" status: 200 len: 1315 microversion: 2.1 time: 0.594138 Oct 18 15:34:58.538377 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1230/2352] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:57 2022] GET /compute/v2.1/servers/201e386f-6cc8-4840-9692-b9d718a8e346 => generated 1315 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:34:58.757313 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-43e839b8-754a-4cfc-8db9-edac53b3dee1 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:58.758214 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-43e839b8-754a-4cfc-8db9-edac53b3dee1 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 0dbbde45-f255-4ac5-8887-1ce8de673fca] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:58.771897 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-43e839b8-754a-4cfc-8db9-edac53b3dee1 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:58.772792 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-43e839b8-754a-4cfc-8db9-edac53b3dee1 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:58.774449 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-43e839b8-754a-4cfc-8db9-edac53b3dee1 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:58.776017 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-43e839b8-754a-4cfc-8db9-edac53b3dee1 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:58.778897 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-43e839b8-754a-4cfc-8db9-edac53b3dee1 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:58.780725 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-43e839b8-754a-4cfc-8db9-edac53b3dee1 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:59.082832 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9a035409-b310-4e7f-9191-aff4b6cf750e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-632181510", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:34:59.194332 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-9a035409-b310-4e7f-9191-aff4b6cf750e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] validate_networks() for None {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:34:59.296976 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-43e839b8-754a-4cfc-8db9-edac53b3dee1 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:59.300948 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=100 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:34:59.310592 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-43e839b8-754a-4cfc-8db9-edac53b3dee1 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca" status: 200 len: 1312 microversion: 2.1 time: 0.559045 Oct 18 15:34:59.320611 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1231/2353] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:58 2022] GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca => generated 1312 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:34:59.537291 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8c9024ea-3b55-44ff-9ea5-36512d7c9fda tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:59.538661 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8c9024ea-3b55-44ff-9ea5-36512d7c9fda tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] [instance: b649575f-a244-45c4-891b-c1fc2f9b4b95] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:59.561072 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c9024ea-3b55-44ff-9ea5-36512d7c9fda tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:59.568925 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c9024ea-3b55-44ff-9ea5-36512d7c9fda tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:59.569602 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c9024ea-3b55-44ff-9ea5-36512d7c9fda tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:59.570555 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c9024ea-3b55-44ff-9ea5-36512d7c9fda tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:59.571203 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c9024ea-3b55-44ff-9ea5-36512d7c9fda tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:59.571862 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c9024ea-3b55-44ff-9ea5-36512d7c9fda tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:59.823427 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:34:59.926138 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8c9024ea-3b55-44ff-9ea5-36512d7c9fda tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a044b3132948fabf926cdd494c2c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75878827878e4ad796216561bf73b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:34:59.937455 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8c9024ea-3b55-44ff-9ea5-36512d7c9fda tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] 10.222.0.60 "GET /compute/v2.1/servers/b649575f-a244-45c4-891b-c1fc2f9b4b95" status: 200 len: 1253 microversion: 2.1 time: 0.404124 Oct 18 15:34:59.938382 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1232/2354] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:59 2022] GET /compute/v2.1/servers/b649575f-a244-45c4-891b-c1fc2f9b4b95 => generated 1253 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:34:59.945667 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fab3f12e-0fee-48ab-8513-bbdf45d46d68 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:34:59.969114 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-fab3f12e-0fee-48ab-8513-bbdf45d46d68 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 201e386f-6cc8-4840-9692-b9d718a8e346] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:34:59.994669 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fab3f12e-0fee-48ab-8513-bbdf45d46d68 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:59.995619 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fab3f12e-0fee-48ab-8513-bbdf45d46d68 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:59.996071 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9a035409-b310-4e7f-9191-aff4b6cf750e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:34:59.996213 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fab3f12e-0fee-48ab-8513-bbdf45d46d68 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:59.996912 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9a035409-b310-4e7f-9191-aff4b6cf750e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:34:59.997044 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fab3f12e-0fee-48ab-8513-bbdf45d46d68 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:34:59.997457 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fab3f12e-0fee-48ab-8513-bbdf45d46d68 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:34:59.998100 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9a035409-b310-4e7f-9191-aff4b6cf750e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:34:59.998517 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fab3f12e-0fee-48ab-8513-bbdf45d46d68 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:34:59.998836 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9a035409-b310-4e7f-9191-aff4b6cf750e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:34:59.999391 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9a035409-b310-4e7f-9191-aff4b6cf750e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:35:00.035659 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a035409-b310-4e7f-9191-aff4b6cf750e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:00.036983 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a035409-b310-4e7f-9191-aff4b6cf750e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:00.039354 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a035409-b310-4e7f-9191-aff4b6cf750e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:00.043097 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a035409-b310-4e7f-9191-aff4b6cf750e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:00.043805 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a035409-b310-4e7f-9191-aff4b6cf750e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:00.047435 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a035409-b310-4e7f-9191-aff4b6cf750e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:00.073283 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-9a035409-b310-4e7f-9191-aff4b6cf750e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Getting quotas for project de91b5fbc5c344019924b5353abf539d. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:35:00.080005 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-9a035409-b310-4e7f-9191-aff4b6cf750e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Getting quotas for user 99c56c556efc4f45b56699afa36e22bc and project de91b5fbc5c344019924b5353abf539d. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:35:00.099051 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9a035409-b310-4e7f-9191-aff4b6cf750e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:35:00.102591 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9a035409-b310-4e7f-9191-aff4b6cf750e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:35:00.186647 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9a035409-b310-4e7f-9191-aff4b6cf750e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.566202 Oct 18 15:35:00.191765 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1123/2355] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:34:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:35:00.193177 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9a035409-b310-4e7f-9191-aff4b6cf750e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:00.196008 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9a035409-b310-4e7f-9191-aff4b6cf750e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003038 Oct 18 15:35:00.216666 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1124/2356] 10.222.0.60 () {56 vars in 886 bytes} [Tue Oct 18 15:35:00 2022] GET /compute/ => generated 377 bytes in 24 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 18 15:35:00.218305 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9a035409-b310-4e7f-9191-aff4b6cf750e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:00.220514 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9a035409-b310-4e7f-9191-aff4b6cf750e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002777 Oct 18 15:35:00.232926 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1125/2357] 10.222.0.60 () {54 vars in 1035 bytes} [Tue Oct 18 15:35:00 2022] GET /compute/v2/ => generated 379 bytes in 15 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Oct 18 15:35:00.243126 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9a035409-b310-4e7f-9191-aff4b6cf750e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:00.245056 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9a035409-b310-4e7f-9191-aff4b6cf750e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.011095 Oct 18 15:35:00.245500 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1126/2358] 10.222.0.60 () {54 vars in 1041 bytes} [Tue Oct 18 15:35:00 2022] GET /compute/v2.1/ => generated 388 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:35:00.257171 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9a035409-b310-4e7f-9191-aff4b6cf750e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:00.258594 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9a035409-b310-4e7f-9191-aff4b6cf750e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001769 Oct 18 15:35:00.271856 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1127/2359] 10.222.0.60 () {56 vars in 886 bytes} [Tue Oct 18 15:35:00 2022] GET /compute/ => generated 377 bytes in 15 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 18 15:35:00.340848 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a3619537-4d18-47fc-9ea4-24b994487964 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:00.341751 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a3619537-4d18-47fc-9ea4-24b994487964 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 0dbbde45-f255-4ac5-8887-1ce8de673fca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:00.365852 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3619537-4d18-47fc-9ea4-24b994487964 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:00.366224 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3619537-4d18-47fc-9ea4-24b994487964 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:00.366727 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3619537-4d18-47fc-9ea4-24b994487964 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:00.368543 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3619537-4d18-47fc-9ea4-24b994487964 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:00.373542 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3619537-4d18-47fc-9ea4-24b994487964 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:00.374217 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3619537-4d18-47fc-9ea4-24b994487964 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:00.481883 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-fab3f12e-0fee-48ab-8513-bbdf45d46d68 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:00.492562 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fab3f12e-0fee-48ab-8513-bbdf45d46d68 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/201e386f-6cc8-4840-9692-b9d718a8e346" status: 200 len: 1315 microversion: 2.1 time: 0.548329 Oct 18 15:35:00.493215 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1233/2360] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:34:59 2022] GET /compute/v2.1/servers/201e386f-6cc8-4840-9692-b9d718a8e346 => generated 1315 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:00.506154 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f4bf0850-4e91-4230-ab36-93f401d9401d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-2016746584", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:35:00.590501 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-f4bf0850-4e91-4230-ab36-93f401d9401d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] validate_networks() for None {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:35:00.946306 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a3619537-4d18-47fc-9ea4-24b994487964 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:00.959236 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a3619537-4d18-47fc-9ea4-24b994487964 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca" status: 200 len: 1461 microversion: 2.1 time: 0.621083 Oct 18 15:35:00.965060 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1128/2361] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:00 2022] GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca => generated 1461 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:35:00.971161 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a9cc839a-4ad6-41d6-9c6c-09c461fa87cd tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:00.976040 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a9cc839a-4ad6-41d6-9c6c-09c461fa87cd tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] [instance: b649575f-a244-45c4-891b-c1fc2f9b4b95] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:00.987780 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9cc839a-4ad6-41d6-9c6c-09c461fa87cd tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:00.988545 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9cc839a-4ad6-41d6-9c6c-09c461fa87cd tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:00.989172 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9cc839a-4ad6-41d6-9c6c-09c461fa87cd tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:00.990735 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9cc839a-4ad6-41d6-9c6c-09c461fa87cd tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:00.996530 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9cc839a-4ad6-41d6-9c6c-09c461fa87cd tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:00.997267 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9cc839a-4ad6-41d6-9c6c-09c461fa87cd tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:01.034980 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-a9cc839a-4ad6-41d6-9c6c-09c461fa87cd tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] HTTP exception thrown: Instance b649575f-a244-45c4-891b-c1fc2f9b4b95 could not be found. Oct 18 15:35:01.039482 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a9cc839a-4ad6-41d6-9c6c-09c461fa87cd tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Request method failure captured: Oct 18 15:35:01.039482 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/b649575f-a244-45c4-891b-c1fc2f9b4b95 HTTP/1.1 Oct 18 15:35:01.039482 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:35:01.039482 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:35:01.039482 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:35:01.039482 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:35:01.039482 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:35:01.039482 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:35:01.039482 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:35:01.039482 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:35:01.039482 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsb95aLluj3u15_8uSCDy_iAvuYw9IYpBwa6-QUAHTyZpGOsQ_DW-3GGw41xUsZU1brXsl0KZ31Dg-0kyIogORydjpWa6I0R-PLoUC4Ep0mIjTqlc569UFq08ajZ1cFP33TN52Zn0yU9SHunR0ZiTy_Bm7tsCiY1_ofVkZcVWglXo6Y Oct 18 15:35:01.039482 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:35:01.039482 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:35:01.039482 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:35:01.039482 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:35:01.039482 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:35:01.039482 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:35:01.039482 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 75878827878e4ad796216561bf73b8c2 Oct 18 15:35:01.039482 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersTestBootFromVolume-196566209 Oct 18 15:35:01.039482 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:35:01.039482 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:35:01.041520 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/75878827878e4ad796216561bf73b8c2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/75878827878e4ad796216561bf73b8c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/75878827878e4ad796216561bf73b8c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_75878827878e4ad796216561bf73b8c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:35:01.041520 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersTestBootFromVolume-196566209 Oct 18 15:35:01.041520 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 75878827878e4ad796216561bf73b8c2 Oct 18 15:35:01.041520 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersTestBootFromVolume-196566209 Oct 18 15:35:01.041520 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersTestBootFromVolume-196566209-project Oct 18 15:35:01.041520 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:35:01.041520 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:35:01.041520 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 28a044b3132948fabf926cdd494c2c16 Oct 18 15:35:01.041520 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersTestBootFromVolume-196566209-project Oct 18 15:35:01.041520 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:35:01.041520 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance b649575f-a244-45c4-891b-c1fc2f9b4b95 could not be found. Oct 18 15:35:01.041520 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'b649575f-a244-45c4-891b-c1fc2f9b4b95'} Oct 18 15:35:01.042376 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:35:01.042376 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:35:01.042376 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:35:01.042376 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:35:01.042376 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:35:01.042376 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:35:01.042376 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:35:01.042376 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:35:01.042376 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:35:01.042376 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:35:01.042376 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b649575f-a244-45c4-891b-c1fc2f9b4b95 could not be found. Oct 18 15:35:01.042376 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:35:01.042376 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:35:01.042376 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:35:01.042376 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:35:01.042376 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:35:01.042376 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:35:01.042376 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:35:01.042376 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:35:01.042376 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:35:01.043725 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:35:01.043725 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:35:01.043725 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:35:01.043725 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:35:01.043725 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:35:01.043725 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:35:01.043725 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:35:01.043725 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b649575f-a244-45c4-891b-c1fc2f9b4b95 could not be found. Oct 18 15:35:01.043725 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:35:01.043725 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:35:01.043725 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:35:01.043725 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:35:01.043725 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:35:01.043725 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:35:01.043725 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:35:01.043725 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:35:01.043725 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b649575f-a244-45c4-891b-c1fc2f9b4b95 could not be found. Oct 18 15:35:01.043725 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:35:01.046564 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a9cc839a-4ad6-41d6-9c6c-09c461fa87cd tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Returning 404 to user: Instance b649575f-a244-45c4-891b-c1fc2f9b4b95 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:35:01.047591 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a9cc839a-4ad6-41d6-9c6c-09c461fa87cd tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] 10.222.0.60 "GET /compute/v2.1/servers/b649575f-a244-45c4-891b-c1fc2f9b4b95" status: 404 len: 111 microversion: 2.1 time: 0.081347 Oct 18 15:35:01.048641 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1129/2362] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:00 2022] GET /compute/v2.1/servers/b649575f-a244-45c4-891b-c1fc2f9b4b95 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:35:01.137304 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-f4bf0850-4e91-4230-ab36-93f401d9401d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:35:01.142021 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-f4bf0850-4e91-4230-ab36-93f401d9401d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:35:01.142974 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-f4bf0850-4e91-4230-ab36-93f401d9401d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:35:01.143747 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-f4bf0850-4e91-4230-ab36-93f401d9401d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:35:01.144493 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-f4bf0850-4e91-4230-ab36-93f401d9401d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:35:01.159295 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f4bf0850-4e91-4230-ab36-93f401d9401d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:01.162734 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f4bf0850-4e91-4230-ab36-93f401d9401d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:01.164150 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f4bf0850-4e91-4230-ab36-93f401d9401d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:01.167047 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f4bf0850-4e91-4230-ab36-93f401d9401d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:01.168076 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f4bf0850-4e91-4230-ab36-93f401d9401d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:01.170404 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f4bf0850-4e91-4230-ab36-93f401d9401d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:01.211513 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-f4bf0850-4e91-4230-ab36-93f401d9401d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Getting quotas for project de91b5fbc5c344019924b5353abf539d. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:35:01.237090 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-f4bf0850-4e91-4230-ab36-93f401d9401d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Getting quotas for user 99c56c556efc4f45b56699afa36e22bc and project de91b5fbc5c344019924b5353abf539d. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:35:01.259679 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f4bf0850-4e91-4230-ab36-93f401d9401d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:35:01.262411 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f4bf0850-4e91-4230-ab36-93f401d9401d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 9e209f2c-f8e3-467a-a1b4-1942972e01ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:35:01.340901 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f4bf0850-4e91-4230-ab36-93f401d9401d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.842726 Oct 18 15:35:01.341665 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1234/2363] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:35:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 848 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:35:01.355689 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e1c7732f-68f3-402e-adaa-adad6bf8cc47 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] Calling method '.version_select at 0x7f7c415bb310>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:01.383029 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e1c7732f-68f3-402e-adaa-adad6bf8cc47 tempest-ServersTestBootFromVolume-196566209 tempest-ServersTestBootFromVolume-196566209-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2031885278" status: 202 len: 0 microversion: 2.1 time: 0.039346 Oct 18 15:35:01.384404 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1235/2364] 10.222.0.60 () {58 vars in 1221 bytes} [Tue Oct 18 15:35:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2031885278 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:35:01.698009 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0c342d42-e927-4b12-885f-52816ead60ef tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-561214182", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "3753d2f9-575a-465c-8cb9-653633a3c310"}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:35:01.758850 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-77ea565d-f25b-4dd2-a7bd-13f725394a44 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:01.762496 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-77ea565d-f25b-4dd2-a7bd-13f725394a44 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] [instance: 0dbbde45-f255-4ac5-8887-1ce8de673fca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:01.787394 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-0c342d42-e927-4b12-885f-52816ead60ef tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] validate_networks() for [('3753d2f9-575a-465c-8cb9-653633a3c310', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:35:01.790517 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77ea565d-f25b-4dd2-a7bd-13f725394a44 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:01.793693 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77ea565d-f25b-4dd2-a7bd-13f725394a44 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:01.795062 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77ea565d-f25b-4dd2-a7bd-13f725394a44 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:01.811432 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77ea565d-f25b-4dd2-a7bd-13f725394a44 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:01.812637 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77ea565d-f25b-4dd2-a7bd-13f725394a44 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:01.816136 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77ea565d-f25b-4dd2-a7bd-13f725394a44 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:03.199325 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-77ea565d-f25b-4dd2-a7bd-13f725394a44 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca" status: 200 len: 1612 microversion: 2.1 time: 2.148224 Oct 18 15:35:03.202665 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1130/2365] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:01 2022] GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca => generated 1612 bytes in 2153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:03.210504 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1b54e81d-f75b-457b-aee2-102a1d15214f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:03.211431 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1b54e81d-f75b-457b-aee2-102a1d15214f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 9e209f2c-f8e3-467a-a1b4-1942972e01ab] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:03.221138 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:35:03.223492 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b54e81d-f75b-457b-aee2-102a1d15214f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:03.225150 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b54e81d-f75b-457b-aee2-102a1d15214f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:03.226397 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b54e81d-f75b-457b-aee2-102a1d15214f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:03.227568 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b54e81d-f75b-457b-aee2-102a1d15214f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:03.229525 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b54e81d-f75b-457b-aee2-102a1d15214f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:03.230319 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b54e81d-f75b-457b-aee2-102a1d15214f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:03.419684 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1b54e81d-f75b-457b-aee2-102a1d15214f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:03.437683 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1b54e81d-f75b-457b-aee2-102a1d15214f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/9e209f2c-f8e3-467a-a1b4-1942972e01ab" status: 200 len: 1266 microversion: 2.1 time: 0.233563 Oct 18 15:35:03.455581 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1131/2366] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:03 2022] GET /compute/v2.1/servers/9e209f2c-f8e3-467a-a1b4-1942972e01ab => generated 1266 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:03.477099 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c17452c6-d286-43d4-8cbb-ad955ddadc20 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:03.477948 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c17452c6-d286-43d4-8cbb-ad955ddadc20 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 201e386f-6cc8-4840-9692-b9d718a8e346] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:03.495182 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c17452c6-d286-43d4-8cbb-ad955ddadc20 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:03.501653 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c17452c6-d286-43d4-8cbb-ad955ddadc20 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:03.502563 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c17452c6-d286-43d4-8cbb-ad955ddadc20 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:03.503533 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c17452c6-d286-43d4-8cbb-ad955ddadc20 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:03.513837 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c17452c6-d286-43d4-8cbb-ad955ddadc20 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:03.515642 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c17452c6-d286-43d4-8cbb-ad955ddadc20 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:04.487604 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-0c342d42-e927-4b12-885f-52816ead60ef tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:35:04.493727 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-0c342d42-e927-4b12-885f-52816ead60ef tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:35:04.497282 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-0c342d42-e927-4b12-885f-52816ead60ef tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:35:04.497715 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-0c342d42-e927-4b12-885f-52816ead60ef tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:35:04.498159 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-0c342d42-e927-4b12-885f-52816ead60ef tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:35:04.501721 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c17452c6-d286-43d4-8cbb-ad955ddadc20 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:04.511236 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c17452c6-d286-43d4-8cbb-ad955ddadc20 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/201e386f-6cc8-4840-9692-b9d718a8e346" status: 200 len: 1315 microversion: 2.1 time: 1.054440 Oct 18 15:35:04.524683 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1132/2367] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:03 2022] GET /compute/v2.1/servers/201e386f-6cc8-4840-9692-b9d718a8e346 => generated 1315 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:04.546614 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-aefa3626-acb4-4ef6-8c29-37ba0ad2fd85 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:35:04.560025 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-aefa3626-acb4-4ef6-8c29-37ba0ad2fd85 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] [instance: 0dbbde45-f255-4ac5-8887-1ce8de673fca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:04.560994 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0c342d42-e927-4b12-885f-52816ead60ef tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:04.561679 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0c342d42-e927-4b12-885f-52816ead60ef tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:04.562148 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0c342d42-e927-4b12-885f-52816ead60ef tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:04.563601 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0c342d42-e927-4b12-885f-52816ead60ef tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:04.563601 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0c342d42-e927-4b12-885f-52816ead60ef tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:04.563834 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0c342d42-e927-4b12-885f-52816ead60ef tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:04.572386 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aefa3626-acb4-4ef6-8c29-37ba0ad2fd85 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:04.572928 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aefa3626-acb4-4ef6-8c29-37ba0ad2fd85 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:04.576348 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aefa3626-acb4-4ef6-8c29-37ba0ad2fd85 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:04.576348 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aefa3626-acb4-4ef6-8c29-37ba0ad2fd85 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:04.576348 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aefa3626-acb4-4ef6-8c29-37ba0ad2fd85 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:04.576348 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aefa3626-acb4-4ef6-8c29-37ba0ad2fd85 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:04.629298 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-0c342d42-e927-4b12-885f-52816ead60ef tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Getting quotas for project ffc684ec2e4d4a6283dbb5566ccb8d60. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:35:04.656258 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-0c342d42-e927-4b12-885f-52816ead60ef tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Getting quotas for user 6ee820071e6e4d2f9c3daa61f23c58e7 and project ffc684ec2e4d4a6283dbb5566ccb8d60. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:35:04.676142 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-aefa3626-acb4-4ef6-8c29-37ba0ad2fd85 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '9b648f2cf13d47eb83430c71cd7737b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda0ca6818f141308683b72cf0c6aac5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:04.676737 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-aefa3626-acb4-4ef6-8c29-37ba0ad2fd85 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] [instance: 0dbbde45-f255-4ac5-8887-1ce8de673fca] flavor_id is None. Assuming migration. {{(pid=120406) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 18 15:35:04.677244 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-aefa3626-acb4-4ef6-8c29-37ba0ad2fd85 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] [instance: 0dbbde45-f255-4ac5-8887-1ce8de673fca] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120406) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 18 15:35:04.704331 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0c342d42-e927-4b12-885f-52816ead60ef tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Going to run 3 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:35:04.727740 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0c342d42-e927-4b12-885f-52816ead60ef tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] [instance: 98c6abbf-732b-4723-89c8-cbb32207414f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:35:04.829278 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0c342d42-e927-4b12-885f-52816ead60ef tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] [instance: c1a558f2-6710-4ab0-92fc-03076dcb4408] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=98c6abbf-732b-4723-89c8-cbb32207414f,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:35:04.949605 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0c342d42-e927-4b12-885f-52816ead60ef tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] [instance: 4df91fe0-82c3-404b-ac29-8da7bdb0ef66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=c1a558f2-6710-4ab0-92fc-03076dcb4408,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:35:05.112135 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0c342d42-e927-4b12-885f-52816ead60ef tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.726386 Oct 18 15:35:05.113243 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1236/2368] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:35:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 3728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:35:05.122370 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-067516ba-e38e-4fc9-83bf-9997060a8b8a tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:05.125629 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-067516ba-e38e-4fc9-83bf-9997060a8b8a tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 9e209f2c-f8e3-467a-a1b4-1942972e01ab] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:05.137049 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-067516ba-e38e-4fc9-83bf-9997060a8b8a tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:05.141165 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-067516ba-e38e-4fc9-83bf-9997060a8b8a tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:05.142667 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-067516ba-e38e-4fc9-83bf-9997060a8b8a tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:05.145662 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-067516ba-e38e-4fc9-83bf-9997060a8b8a tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:05.146352 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-067516ba-e38e-4fc9-83bf-9997060a8b8a tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:05.147040 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-067516ba-e38e-4fc9-83bf-9997060a8b8a tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:05.310489 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-067516ba-e38e-4fc9-83bf-9997060a8b8a tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:05.318681 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-067516ba-e38e-4fc9-83bf-9997060a8b8a tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/9e209f2c-f8e3-467a-a1b4-1942972e01ab" status: 200 len: 1272 microversion: 2.1 time: 0.204129 Oct 18 15:35:05.334347 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1237/2369] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:05 2022] GET /compute/v2.1/servers/9e209f2c-f8e3-467a-a1b4-1942972e01ab => generated 1272 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:05.340680 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-572dd7f1-0465-4e09-bd4b-92b5f9e35b9d tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:05.362441 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-572dd7f1-0465-4e09-bd4b-92b5f9e35b9d tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6ee820071e6e4d2f9c3daa61f23c58e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc684ec2e4d4a6283dbb5566ccb8d60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:05.366072 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-572dd7f1-0465-4e09-bd4b-92b5f9e35b9d tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Searching by: {'deleted': False, 'project_id': 'ffc684ec2e4d4a6283dbb5566ccb8d60'} {{(pid=120405) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 15:35:05.456069 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-572dd7f1-0465-4e09-bd4b-92b5f9e35b9d tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:05.463522 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-572dd7f1-0465-4e09-bd4b-92b5f9e35b9d tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:05.465413 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-572dd7f1-0465-4e09-bd4b-92b5f9e35b9d tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:05.466867 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-572dd7f1-0465-4e09-bd4b-92b5f9e35b9d tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:05.473202 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-572dd7f1-0465-4e09-bd4b-92b5f9e35b9d tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:05.475947 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-572dd7f1-0465-4e09-bd4b-92b5f9e35b9d tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:05.572472 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-aefa3626-acb4-4ef6-8c29-37ba0ad2fd85 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca/action" status: 202 len: 0 microversion: 2.1 time: 1.033262 Oct 18 15:35:05.580413 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-572dd7f1-0465-4e09-bd4b-92b5f9e35b9d tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.244415 Oct 18 15:35:05.582215 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1133/2370] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:35:04 2022] POST /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca/action => generated 0 bytes in 1045 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:35:05.590590 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1238/2371] 10.222.0.60 () {58 vars in 1125 bytes} [Tue Oct 18 15:35:05 2022] GET /compute/v2.1/servers => generated 1015 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:05.615687 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2db2e82b-d4d8-4865-a479-6027db3483ac tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:05.618362 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4845949b-f135-4082-9367-d40663dfa570 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:05.618935 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2db2e82b-d4d8-4865-a479-6027db3483ac tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 201e386f-6cc8-4840-9692-b9d718a8e346] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:05.624655 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4845949b-f135-4082-9367-d40663dfa570 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 0dbbde45-f255-4ac5-8887-1ce8de673fca] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:05.648424 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2db2e82b-d4d8-4865-a479-6027db3483ac tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:05.652600 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4845949b-f135-4082-9367-d40663dfa570 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:05.655173 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2db2e82b-d4d8-4865-a479-6027db3483ac tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:05.657190 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2db2e82b-d4d8-4865-a479-6027db3483ac tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:05.658063 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4845949b-f135-4082-9367-d40663dfa570 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:05.658992 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2db2e82b-d4d8-4865-a479-6027db3483ac tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:05.661521 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4845949b-f135-4082-9367-d40663dfa570 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:05.662102 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2db2e82b-d4d8-4865-a479-6027db3483ac tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:05.663221 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4845949b-f135-4082-9367-d40663dfa570 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:05.664241 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2db2e82b-d4d8-4865-a479-6027db3483ac tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:05.669794 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4845949b-f135-4082-9367-d40663dfa570 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:05.673041 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4845949b-f135-4082-9367-d40663dfa570 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:06.251653 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2db2e82b-d4d8-4865-a479-6027db3483ac tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:06.271779 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2db2e82b-d4d8-4865-a479-6027db3483ac tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/201e386f-6cc8-4840-9692-b9d718a8e346" status: 200 len: 1315 microversion: 2.1 time: 0.684295 Oct 18 15:35:06.276067 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1134/2372] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:05 2022] GET /compute/v2.1/servers/201e386f-6cc8-4840-9692-b9d718a8e346 => generated 1315 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:06.286763 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-083303cb-2df3-4fd6-a3f4-2c9fd24118c7 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:06.287374 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4845949b-f135-4082-9367-d40663dfa570 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:06.287542 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-083303cb-2df3-4fd6-a3f4-2c9fd24118c7 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] [instance: 4df91fe0-82c3-404b-ac29-8da7bdb0ef66] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:06.308747 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4845949b-f135-4082-9367-d40663dfa570 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca" status: 200 len: 1470 microversion: 2.1 time: 0.704024 Oct 18 15:35:06.312268 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1239/2373] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:05 2022] GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca => generated 1470 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:06.356185 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ac2d5884-6ec9-440b-a361-7568774802be tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:06.357016 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ac2d5884-6ec9-440b-a361-7568774802be tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 9e209f2c-f8e3-467a-a1b4-1942972e01ab] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:06.365058 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ac2d5884-6ec9-440b-a361-7568774802be tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:06.371631 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ac2d5884-6ec9-440b-a361-7568774802be tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:06.375038 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ac2d5884-6ec9-440b-a361-7568774802be tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:06.379672 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ac2d5884-6ec9-440b-a361-7568774802be tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:06.381489 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ac2d5884-6ec9-440b-a361-7568774802be tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:06.382732 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ac2d5884-6ec9-440b-a361-7568774802be tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:06.540246 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-083303cb-2df3-4fd6-a3f4-2c9fd24118c7 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee820071e6e4d2f9c3daa61f23c58e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc684ec2e4d4a6283dbb5566ccb8d60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:06.550333 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-083303cb-2df3-4fd6-a3f4-2c9fd24118c7 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] 10.222.0.60 "GET /compute/v2.1/servers/4df91fe0-82c3-404b-ac29-8da7bdb0ef66" status: 200 len: 1222 microversion: 2.1 time: 0.271032 Oct 18 15:35:06.550956 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1135/2374] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:06 2022] GET /compute/v2.1/servers/4df91fe0-82c3-404b-ac29-8da7bdb0ef66 => generated 1222 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:06.774528 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-8ee5757c-0ce6-4096-9213-4f4ec2ed1675 req-d5fc74cb-4f23-431b-a6f6-5760e87cf542 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "201e386f-6cc8-4840-9692-b9d718a8e346", "name": "network-vif-plugged", "status": "completed", "tag": "c27784e9-99d1-4a4c-8101-bf8238d04e69"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:35:06.784520 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ac2d5884-6ec9-440b-a361-7568774802be tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:06.803106 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8ee5757c-0ce6-4096-9213-4f4ec2ed1675 req-d5fc74cb-4f23-431b-a6f6-5760e87cf542 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:06.803601 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8ee5757c-0ce6-4096-9213-4f4ec2ed1675 req-d5fc74cb-4f23-431b-a6f6-5760e87cf542 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:06.804038 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8ee5757c-0ce6-4096-9213-4f4ec2ed1675 req-d5fc74cb-4f23-431b-a6f6-5760e87cf542 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:06.804435 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ac2d5884-6ec9-440b-a361-7568774802be tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/9e209f2c-f8e3-467a-a1b4-1942972e01ab" status: 200 len: 1272 microversion: 2.1 time: 0.452541 Oct 18 15:35:06.809616 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1240/2375] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:06 2022] GET /compute/v2.1/servers/9e209f2c-f8e3-467a-a1b4-1942972e01ab => generated 1272 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:35:06.828213 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-8ee5757c-0ce6-4096-9213-4f4ec2ed1675 req-d5fc74cb-4f23-431b-a6f6-5760e87cf542 service nova] Creating event network-vif-plugged:c27784e9-99d1-4a4c-8101-bf8238d04e69 for instance 201e386f-6cc8-4840-9692-b9d718a8e346 on n-h2-853682-5 Oct 18 15:35:06.835320 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-8ee5757c-0ce6-4096-9213-4f4ec2ed1675 req-d5fc74cb-4f23-431b-a6f6-5760e87cf542 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064291 Oct 18 15:35:06.842405 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1136/2376] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:35:07.308626 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e4012608-6927-4615-9c15-59d375e92be9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:07.309817 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e4012608-6927-4615-9c15-59d375e92be9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 201e386f-6cc8-4840-9692-b9d718a8e346] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:07.345536 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f8b085b7-b43d-4fbe-94d1-d40c3a56cb58 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:07.346239 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f8b085b7-b43d-4fbe-94d1-d40c3a56cb58 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 0dbbde45-f255-4ac5-8887-1ce8de673fca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:07.364549 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4012608-6927-4615-9c15-59d375e92be9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:07.371825 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4012608-6927-4615-9c15-59d375e92be9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:07.373117 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8b085b7-b43d-4fbe-94d1-d40c3a56cb58 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:07.373518 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4012608-6927-4615-9c15-59d375e92be9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:07.374136 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8b085b7-b43d-4fbe-94d1-d40c3a56cb58 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:07.374294 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4012608-6927-4615-9c15-59d375e92be9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:07.374771 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4012608-6927-4615-9c15-59d375e92be9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:07.375199 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4012608-6927-4615-9c15-59d375e92be9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:07.377956 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8b085b7-b43d-4fbe-94d1-d40c3a56cb58 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:07.381509 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8b085b7-b43d-4fbe-94d1-d40c3a56cb58 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:07.385351 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8b085b7-b43d-4fbe-94d1-d40c3a56cb58 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:07.387228 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8b085b7-b43d-4fbe-94d1-d40c3a56cb58 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:08.566627 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f8b085b7-b43d-4fbe-94d1-d40c3a56cb58 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:08.576112 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f8b085b7-b43d-4fbe-94d1-d40c3a56cb58 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca" status: 200 len: 1470 microversion: 2.1 time: 1.239522 Oct 18 15:35:08.581209 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1137/2377] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:07 2022] GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca => generated 1470 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:08.614557 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d5049d9e-7fab-4b35-a340-796dadf2df70 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:08.615572 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d5049d9e-7fab-4b35-a340-796dadf2df70 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] [instance: 4df91fe0-82c3-404b-ac29-8da7bdb0ef66] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:08.633024 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5049d9e-7fab-4b35-a340-796dadf2df70 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:08.645686 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5049d9e-7fab-4b35-a340-796dadf2df70 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:08.646495 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5049d9e-7fab-4b35-a340-796dadf2df70 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:08.647360 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5049d9e-7fab-4b35-a340-796dadf2df70 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:08.647930 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5049d9e-7fab-4b35-a340-796dadf2df70 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:08.648487 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5049d9e-7fab-4b35-a340-796dadf2df70 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:09.111648 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d5049d9e-7fab-4b35-a340-796dadf2df70 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee820071e6e4d2f9c3daa61f23c58e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc684ec2e4d4a6283dbb5566ccb8d60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:09.117088 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e4012608-6927-4615-9c15-59d375e92be9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:09.124687 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d5049d9e-7fab-4b35-a340-796dadf2df70 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] 10.222.0.60 "GET /compute/v2.1/servers/4df91fe0-82c3-404b-ac29-8da7bdb0ef66" status: 200 len: 1218 microversion: 2.1 time: 0.537933 Oct 18 15:35:09.128777 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1138/2378] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:08 2022] GET /compute/v2.1/servers/4df91fe0-82c3-404b-ac29-8da7bdb0ef66 => generated 1218 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:09.135715 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-545960bc-5c8a-4257-b594-b4fe88f12160 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:09.136574 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-545960bc-5c8a-4257-b594-b4fe88f12160 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 9e209f2c-f8e3-467a-a1b4-1942972e01ab] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:09.154542 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e4012608-6927-4615-9c15-59d375e92be9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/201e386f-6cc8-4840-9692-b9d718a8e346" status: 200 len: 1315 microversion: 2.1 time: 1.857184 Oct 18 15:35:09.163474 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-545960bc-5c8a-4257-b594-b4fe88f12160 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:09.164374 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-545960bc-5c8a-4257-b594-b4fe88f12160 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:09.165578 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-545960bc-5c8a-4257-b594-b4fe88f12160 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:09.167442 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-545960bc-5c8a-4257-b594-b4fe88f12160 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:09.168753 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-545960bc-5c8a-4257-b594-b4fe88f12160 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:09.173822 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-545960bc-5c8a-4257-b594-b4fe88f12160 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:09.193052 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1241/2379] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:07 2022] GET /compute/v2.1/servers/201e386f-6cc8-4840-9692-b9d718a8e346 => generated 1315 bytes in 1897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:09.608273 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e388f233-28f9-44dc-aab0-71113e51da0f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:09.609193 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e388f233-28f9-44dc-aab0-71113e51da0f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 0dbbde45-f255-4ac5-8887-1ce8de673fca] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:09.638737 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e388f233-28f9-44dc-aab0-71113e51da0f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:09.640244 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e388f233-28f9-44dc-aab0-71113e51da0f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:09.645127 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e388f233-28f9-44dc-aab0-71113e51da0f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:09.646844 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e388f233-28f9-44dc-aab0-71113e51da0f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:09.649796 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e388f233-28f9-44dc-aab0-71113e51da0f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:09.651645 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e388f233-28f9-44dc-aab0-71113e51da0f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:10.060586 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:35:10.236882 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e388f233-28f9-44dc-aab0-71113e51da0f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:10.260923 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e388f233-28f9-44dc-aab0-71113e51da0f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca" status: 200 len: 1470 microversion: 2.1 time: 0.658126 Oct 18 15:35:10.262069 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1242/2380] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:09 2022] GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca => generated 1470 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:35:10.273765 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-640ab243-bed9-45ff-a18a-47ba40b55e14 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:10.274392 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-640ab243-bed9-45ff-a18a-47ba40b55e14 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] [instance: 4df91fe0-82c3-404b-ac29-8da7bdb0ef66] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:10.299984 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-640ab243-bed9-45ff-a18a-47ba40b55e14 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:10.304041 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-640ab243-bed9-45ff-a18a-47ba40b55e14 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:10.304691 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-640ab243-bed9-45ff-a18a-47ba40b55e14 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:10.306743 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-640ab243-bed9-45ff-a18a-47ba40b55e14 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:10.310051 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-640ab243-bed9-45ff-a18a-47ba40b55e14 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:10.311573 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-640ab243-bed9-45ff-a18a-47ba40b55e14 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:11.000533 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-640ab243-bed9-45ff-a18a-47ba40b55e14 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee820071e6e4d2f9c3daa61f23c58e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc684ec2e4d4a6283dbb5566ccb8d60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:11.023947 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-545960bc-5c8a-4257-b594-b4fe88f12160 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:11.024558 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-640ab243-bed9-45ff-a18a-47ba40b55e14 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] 10.222.0.60 "GET /compute/v2.1/servers/4df91fe0-82c3-404b-ac29-8da7bdb0ef66" status: 200 len: 1274 microversion: 2.1 time: 0.759875 Oct 18 15:35:11.026274 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1243/2381] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:10 2022] GET /compute/v2.1/servers/4df91fe0-82c3-404b-ac29-8da7bdb0ef66 => generated 1274 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:11.036351 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7c01abf8-30cd-4fda-afdb-9018eba9a2c9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:11.039614 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7c01abf8-30cd-4fda-afdb-9018eba9a2c9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 201e386f-6cc8-4840-9692-b9d718a8e346] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:11.047714 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-545960bc-5c8a-4257-b594-b4fe88f12160 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/9e209f2c-f8e3-467a-a1b4-1942972e01ab" status: 200 len: 1314 microversion: 2.1 time: 1.917139 Oct 18 15:35:11.048904 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1139/2382] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:09 2022] GET /compute/v2.1/servers/9e209f2c-f8e3-467a-a1b4-1942972e01ab => generated 1314 bytes in 1919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:11.059910 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7c01abf8-30cd-4fda-afdb-9018eba9a2c9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:11.060600 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7c01abf8-30cd-4fda-afdb-9018eba9a2c9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:11.061376 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7c01abf8-30cd-4fda-afdb-9018eba9a2c9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:11.063151 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7c01abf8-30cd-4fda-afdb-9018eba9a2c9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:11.063778 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7c01abf8-30cd-4fda-afdb-9018eba9a2c9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:11.064442 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7c01abf8-30cd-4fda-afdb-9018eba9a2c9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:11.289649 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ed9c986a-1f83-428c-9e85-16d72f69b763 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:11.292049 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ed9c986a-1f83-428c-9e85-16d72f69b763 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 0dbbde45-f255-4ac5-8887-1ce8de673fca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:11.300711 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed9c986a-1f83-428c-9e85-16d72f69b763 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:11.301562 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed9c986a-1f83-428c-9e85-16d72f69b763 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:11.302390 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed9c986a-1f83-428c-9e85-16d72f69b763 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:11.303528 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed9c986a-1f83-428c-9e85-16d72f69b763 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:11.304209 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed9c986a-1f83-428c-9e85-16d72f69b763 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:11.304865 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed9c986a-1f83-428c-9e85-16d72f69b763 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:11.659722 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7c01abf8-30cd-4fda-afdb-9018eba9a2c9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:11.670206 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7c01abf8-30cd-4fda-afdb-9018eba9a2c9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/201e386f-6cc8-4840-9692-b9d718a8e346" status: 200 len: 1502 microversion: 2.1 time: 0.642461 Oct 18 15:35:11.679603 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1244/2383] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:11 2022] GET /compute/v2.1/servers/201e386f-6cc8-4840-9692-b9d718a8e346 => generated 1502 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:11.707349 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-988e712b-dd72-46f7-9d8d-b07931e08a8e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:11.708298 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-988e712b-dd72-46f7-9d8d-b07931e08a8e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 201e386f-6cc8-4840-9692-b9d718a8e346] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:11.725251 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-988e712b-dd72-46f7-9d8d-b07931e08a8e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:11.728502 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-988e712b-dd72-46f7-9d8d-b07931e08a8e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:11.729289 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-988e712b-dd72-46f7-9d8d-b07931e08a8e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:11.730754 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-988e712b-dd72-46f7-9d8d-b07931e08a8e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:11.732823 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-988e712b-dd72-46f7-9d8d-b07931e08a8e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:11.733534 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-988e712b-dd72-46f7-9d8d-b07931e08a8e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:11.771858 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-988e712b-dd72-46f7-9d8d-b07931e08a8e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 201e386f-6cc8-4840-9692-b9d718a8e346] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:35:11.916437 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-988e712b-dd72-46f7-9d8d-b07931e08a8e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "DELETE /compute/v2.1/servers/201e386f-6cc8-4840-9692-b9d718a8e346" status: 204 len: 0 microversion: 2.1 time: 0.212695 Oct 18 15:35:11.918256 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1245/2384] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:35:11 2022] DELETE /compute/v2.1/servers/201e386f-6cc8-4840-9692-b9d718a8e346 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 15:35:11.923860 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ed9c986a-1f83-428c-9e85-16d72f69b763 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:11.939001 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ed9c986a-1f83-428c-9e85-16d72f69b763 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca" status: 200 len: 1470 microversion: 2.1 time: 0.654650 Oct 18 15:35:11.941060 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1140/2385] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:11 2022] GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca => generated 1470 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:35:11.943760 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3a64d7db-56bb-42c7-8a79-cd911979d258 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:11.944838 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3a64d7db-56bb-42c7-8a79-cd911979d258 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 201e386f-6cc8-4840-9692-b9d718a8e346] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:11.952521 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3a64d7db-56bb-42c7-8a79-cd911979d258 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:11.953662 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3a64d7db-56bb-42c7-8a79-cd911979d258 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:11.954279 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3a64d7db-56bb-42c7-8a79-cd911979d258 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:11.955477 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3a64d7db-56bb-42c7-8a79-cd911979d258 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:11.958394 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3a64d7db-56bb-42c7-8a79-cd911979d258 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:11.958987 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3a64d7db-56bb-42c7-8a79-cd911979d258 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:12.049914 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cfaf0073-1312-4e05-81f0-c56413aa9dbd tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:12.050915 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cfaf0073-1312-4e05-81f0-c56413aa9dbd tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] [instance: 4df91fe0-82c3-404b-ac29-8da7bdb0ef66] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:12.059034 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cfaf0073-1312-4e05-81f0-c56413aa9dbd tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:12.059802 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cfaf0073-1312-4e05-81f0-c56413aa9dbd tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:12.060376 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cfaf0073-1312-4e05-81f0-c56413aa9dbd tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:12.061678 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cfaf0073-1312-4e05-81f0-c56413aa9dbd tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:12.062332 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cfaf0073-1312-4e05-81f0-c56413aa9dbd tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:12.063025 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cfaf0073-1312-4e05-81f0-c56413aa9dbd tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:12.262790 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cfaf0073-1312-4e05-81f0-c56413aa9dbd tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee820071e6e4d2f9c3daa61f23c58e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc684ec2e4d4a6283dbb5566ccb8d60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:12.272425 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cfaf0073-1312-4e05-81f0-c56413aa9dbd tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] 10.222.0.60 "GET /compute/v2.1/servers/4df91fe0-82c3-404b-ac29-8da7bdb0ef66" status: 200 len: 1280 microversion: 2.1 time: 0.228663 Oct 18 15:35:12.289721 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1141/2386] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:12 2022] GET /compute/v2.1/servers/4df91fe0-82c3-404b-ac29-8da7bdb0ef66 => generated 1280 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:35:12.295996 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-09907c27-53de-4608-aa39-8a8410ac7592 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:12.304192 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-09907c27-53de-4608-aa39-8a8410ac7592 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 9e209f2c-f8e3-467a-a1b4-1942972e01ab] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:12.311260 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09907c27-53de-4608-aa39-8a8410ac7592 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:12.312004 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09907c27-53de-4608-aa39-8a8410ac7592 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:12.312599 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09907c27-53de-4608-aa39-8a8410ac7592 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:12.313534 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09907c27-53de-4608-aa39-8a8410ac7592 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:12.314145 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09907c27-53de-4608-aa39-8a8410ac7592 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:12.314726 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09907c27-53de-4608-aa39-8a8410ac7592 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:12.480156 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3a64d7db-56bb-42c7-8a79-cd911979d258 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:12.490090 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3a64d7db-56bb-42c7-8a79-cd911979d258 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/201e386f-6cc8-4840-9692-b9d718a8e346" status: 200 len: 1508 microversion: 2.1 time: 0.557121 Oct 18 15:35:12.495018 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1246/2387] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:11 2022] GET /compute/v2.1/servers/201e386f-6cc8-4840-9692-b9d718a8e346 => generated 1508 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:12.513731 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-a4d64949-ac6c-4623-a4e5-4e1db0681e40 req-62c47933-1d8b-448b-82ba-8feef3f7a563 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35e5cf0e-693b-4930-9665-f1a53983cc1c", "tag": "2ca5d763-fca7-4b76-a60b-8e961f804f14"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:35:12.524083 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-a4d64949-ac6c-4623-a4e5-4e1db0681e40 req-62c47933-1d8b-448b-82ba-8feef3f7a563 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:12.528736 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-a4d64949-ac6c-4623-a4e5-4e1db0681e40 req-62c47933-1d8b-448b-82ba-8feef3f7a563 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:12.529361 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-a4d64949-ac6c-4623-a4e5-4e1db0681e40 req-62c47933-1d8b-448b-82ba-8feef3f7a563 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:12.547387 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-a4d64949-ac6c-4623-a4e5-4e1db0681e40 req-62c47933-1d8b-448b-82ba-8feef3f7a563 service nova] Creating event network-changed:2ca5d763-fca7-4b76-a60b-8e961f804f14 for instance 35e5cf0e-693b-4930-9665-f1a53983cc1c on n-h1-853682-5 Oct 18 15:35:12.553392 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-a4d64949-ac6c-4623-a4e5-4e1db0681e40 req-62c47933-1d8b-448b-82ba-8feef3f7a563 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056678 Oct 18 15:35:12.554465 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1247/2388] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:35:12.655906 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-35d7b2bd-de5c-4094-8508-23231e10cb2d req-403f68ca-8616-45ad-84d8-3b2964b41f1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e209f2c-f8e3-467a-a1b4-1942972e01ab", "tag": "7dbe5c02-8a53-44d0-8afd-137194991306"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:35:12.666990 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-35d7b2bd-de5c-4094-8508-23231e10cb2d req-403f68ca-8616-45ad-84d8-3b2964b41f1d service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:12.667555 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-35d7b2bd-de5c-4094-8508-23231e10cb2d req-403f68ca-8616-45ad-84d8-3b2964b41f1d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:12.667888 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-35d7b2bd-de5c-4094-8508-23231e10cb2d req-403f68ca-8616-45ad-84d8-3b2964b41f1d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:12.703740 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-35d7b2bd-de5c-4094-8508-23231e10cb2d req-403f68ca-8616-45ad-84d8-3b2964b41f1d service nova] Creating event network-changed:7dbe5c02-8a53-44d0-8afd-137194991306 for instance 9e209f2c-f8e3-467a-a1b4-1942972e01ab on n-h1-853682-5 Oct 18 15:35:12.713615 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-35d7b2bd-de5c-4094-8508-23231e10cb2d req-403f68ca-8616-45ad-84d8-3b2964b41f1d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149404 Oct 18 15:35:12.714567 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1248/2389] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:35:12.852245 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-09907c27-53de-4608-aa39-8a8410ac7592 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:12.855611 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:35:12.864515 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-09907c27-53de-4608-aa39-8a8410ac7592 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/9e209f2c-f8e3-467a-a1b4-1942972e01ab" status: 200 len: 1314 microversion: 2.1 time: 0.572425 Oct 18 15:35:12.865678 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1142/2390] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:12 2022] GET /compute/v2.1/servers/9e209f2c-f8e3-467a-a1b4-1942972e01ab => generated 1314 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:12.969771 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7057bb0d-9dba-4faf-a933-9ab07df998e1 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:12.970819 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7057bb0d-9dba-4faf-a933-9ab07df998e1 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 0dbbde45-f255-4ac5-8887-1ce8de673fca] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:12.977962 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7057bb0d-9dba-4faf-a933-9ab07df998e1 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:12.978667 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7057bb0d-9dba-4faf-a933-9ab07df998e1 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:12.979282 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7057bb0d-9dba-4faf-a933-9ab07df998e1 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:12.980159 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7057bb0d-9dba-4faf-a933-9ab07df998e1 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:12.980763 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7057bb0d-9dba-4faf-a933-9ab07df998e1 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:12.981362 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7057bb0d-9dba-4faf-a933-9ab07df998e1 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:13.295511 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-651e3fb1-2a22-4e51-90f2-0591b7703714 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:13.296125 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-651e3fb1-2a22-4e51-90f2-0591b7703714 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] [instance: 4df91fe0-82c3-404b-ac29-8da7bdb0ef66] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:13.321523 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-651e3fb1-2a22-4e51-90f2-0591b7703714 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:13.326754 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-651e3fb1-2a22-4e51-90f2-0591b7703714 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:13.335176 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-651e3fb1-2a22-4e51-90f2-0591b7703714 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:13.337592 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-651e3fb1-2a22-4e51-90f2-0591b7703714 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:13.340052 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-651e3fb1-2a22-4e51-90f2-0591b7703714 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:13.340849 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-651e3fb1-2a22-4e51-90f2-0591b7703714 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:14.038809 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-651e3fb1-2a22-4e51-90f2-0591b7703714 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee820071e6e4d2f9c3daa61f23c58e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc684ec2e4d4a6283dbb5566ccb8d60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:14.049368 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-651e3fb1-2a22-4e51-90f2-0591b7703714 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] 10.222.0.60 "GET /compute/v2.1/servers/4df91fe0-82c3-404b-ac29-8da7bdb0ef66" status: 200 len: 1280 microversion: 2.1 time: 0.757496 Oct 18 15:35:14.055552 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1143/2391] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:13 2022] GET /compute/v2.1/servers/4df91fe0-82c3-404b-ac29-8da7bdb0ef66 => generated 1280 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:35:14.072683 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-47499a48-7ef3-4b58-af28-b3c885b1b299 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:14.075837 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-47499a48-7ef3-4b58-af28-b3c885b1b299 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 201e386f-6cc8-4840-9692-b9d718a8e346] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:14.100786 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47499a48-7ef3-4b58-af28-b3c885b1b299 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:14.101471 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47499a48-7ef3-4b58-af28-b3c885b1b299 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:14.105497 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47499a48-7ef3-4b58-af28-b3c885b1b299 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:14.107553 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47499a48-7ef3-4b58-af28-b3c885b1b299 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:14.110444 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47499a48-7ef3-4b58-af28-b3c885b1b299 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:14.111108 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47499a48-7ef3-4b58-af28-b3c885b1b299 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:14.111701 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7057bb0d-9dba-4faf-a933-9ab07df998e1 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:14.120939 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7057bb0d-9dba-4faf-a933-9ab07df998e1 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca" status: 200 len: 1470 microversion: 2.1 time: 1.155945 Oct 18 15:35:14.141592 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1249/2392] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:12 2022] GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca => generated 1470 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:14.152410 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-02171b26-825b-4076-99cc-c8fa04d96062 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:14.161788 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-02171b26-825b-4076-99cc-c8fa04d96062 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 9e209f2c-f8e3-467a-a1b4-1942972e01ab] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:14.178104 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-02171b26-825b-4076-99cc-c8fa04d96062 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:14.181489 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-02171b26-825b-4076-99cc-c8fa04d96062 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:14.182156 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-02171b26-825b-4076-99cc-c8fa04d96062 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:14.183691 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-02171b26-825b-4076-99cc-c8fa04d96062 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:14.186386 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-02171b26-825b-4076-99cc-c8fa04d96062 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:14.187042 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-02171b26-825b-4076-99cc-c8fa04d96062 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:14.679785 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=12 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:35:15.126984 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-02171b26-825b-4076-99cc-c8fa04d96062 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:15.135966 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-02171b26-825b-4076-99cc-c8fa04d96062 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/9e209f2c-f8e3-467a-a1b4-1942972e01ab" status: 200 len: 1314 microversion: 2.1 time: 0.993038 Oct 18 15:35:15.138571 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1250/2393] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:14 2022] GET /compute/v2.1/servers/9e209f2c-f8e3-467a-a1b4-1942972e01ab => generated 1314 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:15.153070 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-47499a48-7ef3-4b58-af28-b3c885b1b299 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:15.159833 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e3bca0d4-2b95-4d83-80f0-872bcd65852a tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:15.161015 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e3bca0d4-2b95-4d83-80f0-872bcd65852a tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] [instance: 4df91fe0-82c3-404b-ac29-8da7bdb0ef66] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:15.163116 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=12,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:35:15.175797 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-47499a48-7ef3-4b58-af28-b3c885b1b299 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/201e386f-6cc8-4840-9692-b9d718a8e346" status: 200 len: 1508 microversion: 2.1 time: 1.116770 Oct 18 15:35:15.179759 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1144/2394] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:14 2022] GET /compute/v2.1/servers/201e386f-6cc8-4840-9692-b9d718a8e346 => generated 1508 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:15.185915 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e3bca0d4-2b95-4d83-80f0-872bcd65852a tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:15.189443 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e3bca0d4-2b95-4d83-80f0-872bcd65852a tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:15.190079 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e3bca0d4-2b95-4d83-80f0-872bcd65852a tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:15.193177 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e3bca0d4-2b95-4d83-80f0-872bcd65852a tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:15.193890 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e3bca0d4-2b95-4d83-80f0-872bcd65852a tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:15.194476 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e3bca0d4-2b95-4d83-80f0-872bcd65852a tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:15.196022 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b4dc5b28-5e5f-449e-813f-54e1794db705 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:15.198884 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b4dc5b28-5e5f-449e-813f-54e1794db705 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 0dbbde45-f255-4ac5-8887-1ce8de673fca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:15.224929 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b4dc5b28-5e5f-449e-813f-54e1794db705 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:15.228686 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b4dc5b28-5e5f-449e-813f-54e1794db705 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:15.229415 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b4dc5b28-5e5f-449e-813f-54e1794db705 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:15.230329 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b4dc5b28-5e5f-449e-813f-54e1794db705 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:15.230938 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b4dc5b28-5e5f-449e-813f-54e1794db705 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:15.231675 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b4dc5b28-5e5f-449e-813f-54e1794db705 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:15.251797 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:35:15.498039 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e3bca0d4-2b95-4d83-80f0-872bcd65852a tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee820071e6e4d2f9c3daa61f23c58e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc684ec2e4d4a6283dbb5566ccb8d60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:15.508082 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e3bca0d4-2b95-4d83-80f0-872bcd65852a tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] 10.222.0.60 "GET /compute/v2.1/servers/4df91fe0-82c3-404b-ac29-8da7bdb0ef66" status: 200 len: 1280 microversion: 2.1 time: 0.364818 Oct 18 15:35:15.525409 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1251/2395] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:15 2022] GET /compute/v2.1/servers/4df91fe0-82c3-404b-ac29-8da7bdb0ef66 => generated 1280 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:15.651396 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b4dc5b28-5e5f-449e-813f-54e1794db705 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:15.660840 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b4dc5b28-5e5f-449e-813f-54e1794db705 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca" status: 200 len: 1475 microversion: 2.1 time: 0.477026 Oct 18 15:35:15.677489 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1145/2396] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:15 2022] GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca => generated 1475 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:16.162514 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f46e4811-31d3-417a-a965-7c37d613c0a9 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:16.164741 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f46e4811-31d3-417a-a965-7c37d613c0a9 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 9e209f2c-f8e3-467a-a1b4-1942972e01ab] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:16.167510 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=6 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:35:16.180698 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f46e4811-31d3-417a-a965-7c37d613c0a9 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:16.185659 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f46e4811-31d3-417a-a965-7c37d613c0a9 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:16.186553 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f46e4811-31d3-417a-a965-7c37d613c0a9 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:16.187459 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f46e4811-31d3-417a-a965-7c37d613c0a9 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:16.188054 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f46e4811-31d3-417a-a965-7c37d613c0a9 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:16.188757 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f46e4811-31d3-417a-a965-7c37d613c0a9 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:16.207029 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-123c0acc-1e20-414a-9148-6430bb9ec2eb tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:16.207966 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-123c0acc-1e20-414a-9148-6430bb9ec2eb tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 201e386f-6cc8-4840-9692-b9d718a8e346] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:16.230787 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-123c0acc-1e20-414a-9148-6430bb9ec2eb tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:16.232358 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-123c0acc-1e20-414a-9148-6430bb9ec2eb tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:16.233243 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-123c0acc-1e20-414a-9148-6430bb9ec2eb tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:16.238510 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-123c0acc-1e20-414a-9148-6430bb9ec2eb tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:16.239304 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-123c0acc-1e20-414a-9148-6430bb9ec2eb tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:16.240774 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-123c0acc-1e20-414a-9148-6430bb9ec2eb tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:16.545262 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=20 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:35:17.163988 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-123c0acc-1e20-414a-9148-6430bb9ec2eb tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:17.199129 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-123c0acc-1e20-414a-9148-6430bb9ec2eb tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/201e386f-6cc8-4840-9692-b9d718a8e346" status: 200 len: 1508 microversion: 2.1 time: 0.996202 Oct 18 15:35:17.202685 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1146/2397] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:16 2022] GET /compute/v2.1/servers/201e386f-6cc8-4840-9692-b9d718a8e346 => generated 1508 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:35:17.213590 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0f709886-14d1-48c3-b135-783e2684fcf1 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:17.215142 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0f709886-14d1-48c3-b135-783e2684fcf1 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] [instance: 4df91fe0-82c3-404b-ac29-8da7bdb0ef66] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:17.238544 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f709886-14d1-48c3-b135-783e2684fcf1 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:17.239349 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f709886-14d1-48c3-b135-783e2684fcf1 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:17.240016 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f709886-14d1-48c3-b135-783e2684fcf1 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:17.242774 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f709886-14d1-48c3-b135-783e2684fcf1 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:17.245906 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f709886-14d1-48c3-b135-783e2684fcf1 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:17.246703 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f709886-14d1-48c3-b135-783e2684fcf1 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:17.374258 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f46e4811-31d3-417a-a965-7c37d613c0a9 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:17.383977 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f46e4811-31d3-417a-a965-7c37d613c0a9 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/9e209f2c-f8e3-467a-a1b4-1942972e01ab" status: 200 len: 1314 microversion: 2.1 time: 1.225481 Oct 18 15:35:17.401043 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1252/2398] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:16 2022] GET /compute/v2.1/servers/9e209f2c-f8e3-467a-a1b4-1942972e01ab => generated 1314 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:17.411995 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ae8c8fe0-d604-44b8-aa4c-7335106ac64e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:17.413063 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ae8c8fe0-d604-44b8-aa4c-7335106ac64e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 0dbbde45-f255-4ac5-8887-1ce8de673fca] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:17.424751 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae8c8fe0-d604-44b8-aa4c-7335106ac64e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:17.425578 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae8c8fe0-d604-44b8-aa4c-7335106ac64e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:17.426306 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae8c8fe0-d604-44b8-aa4c-7335106ac64e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:17.428168 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae8c8fe0-d604-44b8-aa4c-7335106ac64e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:17.428957 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae8c8fe0-d604-44b8-aa4c-7335106ac64e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:17.429700 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae8c8fe0-d604-44b8-aa4c-7335106ac64e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:17.900336 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0f709886-14d1-48c3-b135-783e2684fcf1 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee820071e6e4d2f9c3daa61f23c58e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc684ec2e4d4a6283dbb5566ccb8d60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:17.922780 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0f709886-14d1-48c3-b135-783e2684fcf1 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] 10.222.0.60 "GET /compute/v2.1/servers/4df91fe0-82c3-404b-ac29-8da7bdb0ef66" status: 200 len: 1322 microversion: 2.1 time: 0.718277 Oct 18 15:35:17.938171 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1147/2399] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:17 2022] GET /compute/v2.1/servers/4df91fe0-82c3-404b-ac29-8da7bdb0ef66 => generated 1322 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:17.954588 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ae8c8fe0-d604-44b8-aa4c-7335106ac64e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:17.960424 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-6e5420c4-647e-41db-918a-4e4f4b7f3c6c req-0a59856e-ee70-4539-894d-9a3c82e32365 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "201e386f-6cc8-4840-9692-b9d718a8e346", "name": "network-vif-deleted", "tag": "c27784e9-99d1-4a4c-8101-bf8238d04e69"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:35:17.966196 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ae8c8fe0-d604-44b8-aa4c-7335106ac64e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca" status: 200 len: 1475 microversion: 2.1 time: 0.563739 Oct 18 15:35:17.971309 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1253/2400] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:17 2022] GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca => generated 1475 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:17.984009 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6e5420c4-647e-41db-918a-4e4f4b7f3c6c req-0a59856e-ee70-4539-894d-9a3c82e32365 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:17.989350 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6e5420c4-647e-41db-918a-4e4f4b7f3c6c req-0a59856e-ee70-4539-894d-9a3c82e32365 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:17.998071 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6e5420c4-647e-41db-918a-4e4f4b7f3c6c req-0a59856e-ee70-4539-894d-9a3c82e32365 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:18.031027 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-6e5420c4-647e-41db-918a-4e4f4b7f3c6c req-0a59856e-ee70-4539-894d-9a3c82e32365 service nova] Creating event network-vif-deleted:c27784e9-99d1-4a4c-8101-bf8238d04e69 for instance 201e386f-6cc8-4840-9692-b9d718a8e346 on n-h2-853682-5 Oct 18 15:35:18.048590 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-6e5420c4-647e-41db-918a-4e4f4b7f3c6c req-0a59856e-ee70-4539-894d-9a3c82e32365 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106580 Oct 18 15:35:18.057390 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1148/2401] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:35:18.229138 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3c860225-8098-4f5c-b940-691117b3a682 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:18.230006 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3c860225-8098-4f5c-b940-691117b3a682 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 201e386f-6cc8-4840-9692-b9d718a8e346] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:18.237292 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3c860225-8098-4f5c-b940-691117b3a682 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:18.238026 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3c860225-8098-4f5c-b940-691117b3a682 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:18.238664 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3c860225-8098-4f5c-b940-691117b3a682 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:18.239541 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3c860225-8098-4f5c-b940-691117b3a682 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:18.240151 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3c860225-8098-4f5c-b940-691117b3a682 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:18.240734 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3c860225-8098-4f5c-b940-691117b3a682 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:18.256397 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-3c860225-8098-4f5c-b940-691117b3a682 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] HTTP exception thrown: Instance 201e386f-6cc8-4840-9692-b9d718a8e346 could not be found. Oct 18 15:35:18.258623 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3c860225-8098-4f5c-b940-691117b3a682 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Request method failure captured: Oct 18 15:35:18.258623 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/201e386f-6cc8-4840-9692-b9d718a8e346 HTTP/1.1 Oct 18 15:35:18.258623 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:35:18.258623 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:35:18.258623 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:35:18.258623 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:35:18.258623 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:35:18.258623 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:35:18.258623 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:35:18.258623 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:35:18.258623 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTseXdqIE6K5VM4s3TEHRLWgMUN4aMRv2NoeIzUdaqo5huhkbfibHS5WTucH_yVgiw-oU86aIdI66etum9zPC1o_Gp8lN1ylUglhXYekmlUb-DCNwOQQTPA7nsDvbxyfFlUPyfZnM9HlX0P4k3Gbrf42L5eihIJ6KOiK__MhWlbfWWoY Oct 18 15:35:18.258623 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:35:18.258623 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:35:18.258623 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:35:18.258623 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:35:18.258623 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:35:18.258623 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:35:18.258623 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 04fd51d598a04ff7a909b3ced951dea8 Oct 18 15:35:18.258623 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-DeleteServersTestJSON-518486720 Oct 18 15:35:18.258623 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:35:18.258623 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:35:18.260112 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:35:18.260112 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-DeleteServersTestJSON-518486720 Oct 18 15:35:18.260112 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 04fd51d598a04ff7a909b3ced951dea8 Oct 18 15:35:18.260112 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-DeleteServersTestJSON-518486720 Oct 18 15:35:18.260112 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-DeleteServersTestJSON-518486720-project Oct 18 15:35:18.260112 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:35:18.260112 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:35:18.260112 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 5309baeeec484df194123d22779b0255 Oct 18 15:35:18.260112 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-DeleteServersTestJSON-518486720-project Oct 18 15:35:18.260112 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:35:18.260112 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 201e386f-6cc8-4840-9692-b9d718a8e346 could not be found. Oct 18 15:35:18.260112 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '201e386f-6cc8-4840-9692-b9d718a8e346'} Oct 18 15:35:18.260957 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:35:18.260957 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:35:18.260957 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:35:18.260957 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:35:18.260957 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:35:18.260957 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:35:18.260957 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:35:18.260957 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:35:18.260957 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:35:18.260957 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:35:18.260957 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 201e386f-6cc8-4840-9692-b9d718a8e346 could not be found. Oct 18 15:35:18.260957 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:35:18.260957 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:35:18.260957 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:35:18.260957 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:35:18.260957 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:35:18.260957 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:35:18.260957 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:35:18.260957 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:35:18.260957 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:35:18.262258 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:35:18.262258 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:35:18.262258 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:35:18.262258 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:35:18.262258 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:35:18.262258 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:35:18.262258 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:35:18.262258 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 201e386f-6cc8-4840-9692-b9d718a8e346 could not be found. Oct 18 15:35:18.262258 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:35:18.262258 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:35:18.262258 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:35:18.262258 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:35:18.262258 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:35:18.262258 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:35:18.262258 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:35:18.262258 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:35:18.262258 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 201e386f-6cc8-4840-9692-b9d718a8e346 could not be found. Oct 18 15:35:18.262258 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:35:18.265054 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3c860225-8098-4f5c-b940-691117b3a682 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Returning 404 to user: Instance 201e386f-6cc8-4840-9692-b9d718a8e346 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:35:18.266594 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3c860225-8098-4f5c-b940-691117b3a682 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/201e386f-6cc8-4840-9692-b9d718a8e346" status: 404 len: 111 microversion: 2.1 time: 0.041970 Oct 18 15:35:18.280328 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1254/2402] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:18 2022] GET /compute/v2.1/servers/201e386f-6cc8-4840-9692-b9d718a8e346 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:35:18.404041 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-57d490f2-d875-4141-9ada-2c098d8ad6ba tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1729800745", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "670a85ee-2ce6-476a-bad3-558d8003ee5a"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:35:18.407234 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-74e6ad07-0b0a-428a-8546-2d379432cbcb tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:18.408463 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-74e6ad07-0b0a-428a-8546-2d379432cbcb tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 9e209f2c-f8e3-467a-a1b4-1942972e01ab] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:18.418747 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-74e6ad07-0b0a-428a-8546-2d379432cbcb tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:18.419424 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-74e6ad07-0b0a-428a-8546-2d379432cbcb tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:18.420010 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-74e6ad07-0b0a-428a-8546-2d379432cbcb tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:18.421251 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-74e6ad07-0b0a-428a-8546-2d379432cbcb tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:18.421866 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-74e6ad07-0b0a-428a-8546-2d379432cbcb tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:18.422518 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-74e6ad07-0b0a-428a-8546-2d379432cbcb tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:18.496118 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-57d490f2-d875-4141-9ada-2c098d8ad6ba tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] validate_networks() for [('670a85ee-2ce6-476a-bad3-558d8003ee5a', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:35:19.393211 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-74e6ad07-0b0a-428a-8546-2d379432cbcb tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:19.442071 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-74e6ad07-0b0a-428a-8546-2d379432cbcb tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/9e209f2c-f8e3-467a-a1b4-1942972e01ab" status: 200 len: 1314 microversion: 2.1 time: 1.017999 Oct 18 15:35:19.444959 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1255/2403] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:18 2022] GET /compute/v2.1/servers/9e209f2c-f8e3-467a-a1b4-1942972e01ab => generated 1314 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:19.457252 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c16dec91-d620-4645-aeef-52fe38a81768 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:19.463313 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c16dec91-d620-4645-aeef-52fe38a81768 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] [instance: 4df91fe0-82c3-404b-ac29-8da7bdb0ef66] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:19.477950 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c16dec91-d620-4645-aeef-52fe38a81768 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:19.479303 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c16dec91-d620-4645-aeef-52fe38a81768 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:19.480025 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c16dec91-d620-4645-aeef-52fe38a81768 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:19.481002 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c16dec91-d620-4645-aeef-52fe38a81768 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:19.481708 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c16dec91-d620-4645-aeef-52fe38a81768 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:19.482398 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c16dec91-d620-4645-aeef-52fe38a81768 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:20.339573 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c16dec91-d620-4645-aeef-52fe38a81768 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee820071e6e4d2f9c3daa61f23c58e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc684ec2e4d4a6283dbb5566ccb8d60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:20.356784 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c16dec91-d620-4645-aeef-52fe38a81768 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] 10.222.0.60 "GET /compute/v2.1/servers/4df91fe0-82c3-404b-ac29-8da7bdb0ef66" status: 200 len: 1322 microversion: 2.1 time: 0.909816 Oct 18 15:35:20.357714 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1256/2404] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:19 2022] GET /compute/v2.1/servers/4df91fe0-82c3-404b-ac29-8da7bdb0ef66 => generated 1322 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:20.362488 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-49b66b83-fc4a-4174-85b5-8558732fc59c req-7943b64a-3405-4dc2-a8b8-57e8b0805d24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1a558f2-6710-4ab0-92fc-03076dcb4408", "tag": "2799e185-c707-4732-964a-3994e3877409"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:35:20.381489 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-49b66b83-fc4a-4174-85b5-8558732fc59c req-7943b64a-3405-4dc2-a8b8-57e8b0805d24 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:20.382329 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-49b66b83-fc4a-4174-85b5-8558732fc59c req-7943b64a-3405-4dc2-a8b8-57e8b0805d24 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:20.382971 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-49b66b83-fc4a-4174-85b5-8558732fc59c req-7943b64a-3405-4dc2-a8b8-57e8b0805d24 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:20.411674 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-49b66b83-fc4a-4174-85b5-8558732fc59c req-7943b64a-3405-4dc2-a8b8-57e8b0805d24 service nova] Creating event network-changed:2799e185-c707-4732-964a-3994e3877409 for instance c1a558f2-6710-4ab0-92fc-03076dcb4408 on n-h1-853682-5 Oct 18 15:35:20.419446 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-49b66b83-fc4a-4174-85b5-8558732fc59c req-7943b64a-3405-4dc2-a8b8-57e8b0805d24 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059732 Oct 18 15:35:20.423681 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1257/2405] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:35:20.430477 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8ccc948d-d451-4217-9cc3-6044b914c096 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:20.431970 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8ccc948d-d451-4217-9cc3-6044b914c096 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 0dbbde45-f255-4ac5-8887-1ce8de673fca] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:20.439815 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8ccc948d-d451-4217-9cc3-6044b914c096 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:20.440637 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8ccc948d-d451-4217-9cc3-6044b914c096 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:20.441376 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8ccc948d-d451-4217-9cc3-6044b914c096 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:20.442792 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8ccc948d-d451-4217-9cc3-6044b914c096 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:20.444093 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8ccc948d-d451-4217-9cc3-6044b914c096 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:20.444707 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8ccc948d-d451-4217-9cc3-6044b914c096 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:21.000323 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-57d490f2-d875-4141-9ada-2c098d8ad6ba tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:35:21.001382 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-57d490f2-d875-4141-9ada-2c098d8ad6ba tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:35:21.002271 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-57d490f2-d875-4141-9ada-2c098d8ad6ba tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:35:21.002914 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-57d490f2-d875-4141-9ada-2c098d8ad6ba tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:35:21.003618 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-57d490f2-d875-4141-9ada-2c098d8ad6ba tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:35:21.019028 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57d490f2-d875-4141-9ada-2c098d8ad6ba tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:21.019819 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57d490f2-d875-4141-9ada-2c098d8ad6ba tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:21.020435 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57d490f2-d875-4141-9ada-2c098d8ad6ba tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:21.022938 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57d490f2-d875-4141-9ada-2c098d8ad6ba tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:21.023683 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57d490f2-d875-4141-9ada-2c098d8ad6ba tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:21.024298 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57d490f2-d875-4141-9ada-2c098d8ad6ba tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:21.030585 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8ccc948d-d451-4217-9cc3-6044b914c096 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:21.040997 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8ccc948d-d451-4217-9cc3-6044b914c096 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca" status: 200 len: 1475 microversion: 2.1 time: 0.613516 Oct 18 15:35:21.051716 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1258/2406] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:20 2022] GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca => generated 1475 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:21.057303 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-eaaa8112-a0d4-4493-9a55-4ec6b90d9389 req-1a33dd9b-663b-42c0-a554-fe349dffea54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35e5cf0e-693b-4930-9665-f1a53983cc1c", "name": "network-vif-plugged", "status": "completed", "tag": "2ca5d763-fca7-4b76-a60b-8e961f804f14"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:35:21.071481 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-57d490f2-d875-4141-9ada-2c098d8ad6ba tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Getting quotas for project 04fd51d598a04ff7a909b3ced951dea8. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:35:21.076177 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-eaaa8112-a0d4-4493-9a55-4ec6b90d9389 req-1a33dd9b-663b-42c0-a554-fe349dffea54 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:21.076667 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-eaaa8112-a0d4-4493-9a55-4ec6b90d9389 req-1a33dd9b-663b-42c0-a554-fe349dffea54 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:21.077294 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-eaaa8112-a0d4-4493-9a55-4ec6b90d9389 req-1a33dd9b-663b-42c0-a554-fe349dffea54 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:21.079690 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-57d490f2-d875-4141-9ada-2c098d8ad6ba tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Getting quotas for user 5309baeeec484df194123d22779b0255 and project 04fd51d598a04ff7a909b3ced951dea8. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:35:21.097081 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-eaaa8112-a0d4-4493-9a55-4ec6b90d9389 req-1a33dd9b-663b-42c0-a554-fe349dffea54 service nova] Creating event network-vif-plugged:2ca5d763-fca7-4b76-a60b-8e961f804f14 for instance 35e5cf0e-693b-4930-9665-f1a53983cc1c on n-h1-853682-5 Oct 18 15:35:21.100666 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-57d490f2-d875-4141-9ada-2c098d8ad6ba tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:35:21.103416 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-57d490f2-d875-4141-9ada-2c098d8ad6ba tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: b7ebc01d-7008-4ca7-a82b-094962216ceb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:35:21.114211 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-eaaa8112-a0d4-4493-9a55-4ec6b90d9389 req-1a33dd9b-663b-42c0-a554-fe349dffea54 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060959 Oct 18 15:35:21.115128 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1259/2407] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:35:21.120753 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-12ebd7fe-0498-4c78-8a57-7e11ade18727 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:21.125782 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-12ebd7fe-0498-4c78-8a57-7e11ade18727 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 9e209f2c-f8e3-467a-a1b4-1942972e01ab] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:21.140462 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12ebd7fe-0498-4c78-8a57-7e11ade18727 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:21.141271 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12ebd7fe-0498-4c78-8a57-7e11ade18727 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:21.141891 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12ebd7fe-0498-4c78-8a57-7e11ade18727 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:21.142763 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12ebd7fe-0498-4c78-8a57-7e11ade18727 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:21.143378 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12ebd7fe-0498-4c78-8a57-7e11ade18727 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:21.144050 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12ebd7fe-0498-4c78-8a57-7e11ade18727 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:21.190507 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-57d490f2-d875-4141-9ada-2c098d8ad6ba tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.793489 Oct 18 15:35:21.192901 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1149/2408] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:35:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:35:21.203842 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-316657d2-ef8a-401e-b407-d3d15530f6bb tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:21.204351 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-316657d2-ef8a-401e-b407-d3d15530f6bb tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: b7ebc01d-7008-4ca7-a82b-094962216ceb] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:22.097074 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-316657d2-ef8a-401e-b407-d3d15530f6bb tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:22.108914 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-316657d2-ef8a-401e-b407-d3d15530f6bb tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/b7ebc01d-7008-4ca7-a82b-094962216ceb" status: 200 len: 1215 microversion: 2.1 time: 0.908840 Oct 18 15:35:22.116296 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1150/2409] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:21 2022] GET /compute/v2.1/servers/b7ebc01d-7008-4ca7-a82b-094962216ceb => generated 1215 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:22.129275 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-12f10cdd-0c3a-422b-9cdc-7b03cfa1e735 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:22.130364 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-12f10cdd-0c3a-422b-9cdc-7b03cfa1e735 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] [instance: 4df91fe0-82c3-404b-ac29-8da7bdb0ef66] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:22.156953 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-12f10cdd-0c3a-422b-9cdc-7b03cfa1e735 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:22.158938 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-12f10cdd-0c3a-422b-9cdc-7b03cfa1e735 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:22.161155 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-12f10cdd-0c3a-422b-9cdc-7b03cfa1e735 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:22.162593 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-12f10cdd-0c3a-422b-9cdc-7b03cfa1e735 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:22.166781 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-12f10cdd-0c3a-422b-9cdc-7b03cfa1e735 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:22.167434 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-12f10cdd-0c3a-422b-9cdc-7b03cfa1e735 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:22.934995 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-12ebd7fe-0498-4c78-8a57-7e11ade18727 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:22.955494 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-12ebd7fe-0498-4c78-8a57-7e11ade18727 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/9e209f2c-f8e3-467a-a1b4-1942972e01ab" status: 200 len: 1314 microversion: 2.1 time: 1.838876 Oct 18 15:35:22.960657 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1260/2410] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:21 2022] GET /compute/v2.1/servers/9e209f2c-f8e3-467a-a1b4-1942972e01ab => generated 1314 bytes in 1844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:22.974509 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e7fa5f61-f487-4f55-976e-612e928737f2 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:22.981678 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e7fa5f61-f487-4f55-976e-612e928737f2 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 0dbbde45-f255-4ac5-8887-1ce8de673fca] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:23.010904 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e7fa5f61-f487-4f55-976e-612e928737f2 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:23.011499 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e7fa5f61-f487-4f55-976e-612e928737f2 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:23.011956 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e7fa5f61-f487-4f55-976e-612e928737f2 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:23.012708 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e7fa5f61-f487-4f55-976e-612e928737f2 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:23.013367 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e7fa5f61-f487-4f55-976e-612e928737f2 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:23.013807 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e7fa5f61-f487-4f55-976e-612e928737f2 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:23.235184 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-12f10cdd-0c3a-422b-9cdc-7b03cfa1e735 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee820071e6e4d2f9c3daa61f23c58e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc684ec2e4d4a6283dbb5566ccb8d60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:23.251557 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-12f10cdd-0c3a-422b-9cdc-7b03cfa1e735 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] 10.222.0.60 "GET /compute/v2.1/servers/4df91fe0-82c3-404b-ac29-8da7bdb0ef66" status: 200 len: 1322 microversion: 2.1 time: 1.132547 Oct 18 15:35:23.256974 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1151/2411] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:22 2022] GET /compute/v2.1/servers/4df91fe0-82c3-404b-ac29-8da7bdb0ef66 => generated 1322 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:23.292693 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-8b9cb82b-5cf4-427f-a3e9-d9cf0596c8f2 req-7bfd9a5b-31c6-45ca-818d-7d7b3dbf25db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4df91fe0-82c3-404b-ac29-8da7bdb0ef66", "tag": "3937e97b-486e-43be-8bfa-74b0972bc6ce"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:35:23.324738 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8b9cb82b-5cf4-427f-a3e9-d9cf0596c8f2 req-7bfd9a5b-31c6-45ca-818d-7d7b3dbf25db service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:23.325249 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8b9cb82b-5cf4-427f-a3e9-d9cf0596c8f2 req-7bfd9a5b-31c6-45ca-818d-7d7b3dbf25db service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:23.335858 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8b9cb82b-5cf4-427f-a3e9-d9cf0596c8f2 req-7bfd9a5b-31c6-45ca-818d-7d7b3dbf25db service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:23.378952 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-8b9cb82b-5cf4-427f-a3e9-d9cf0596c8f2 req-7bfd9a5b-31c6-45ca-818d-7d7b3dbf25db service nova] Creating event network-changed:3937e97b-486e-43be-8bfa-74b0972bc6ce for instance 4df91fe0-82c3-404b-ac29-8da7bdb0ef66 on n-h2-853682-5 Oct 18 15:35:23.396037 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-8b9cb82b-5cf4-427f-a3e9-d9cf0596c8f2 req-7bfd9a5b-31c6-45ca-818d-7d7b3dbf25db service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134871 Oct 18 15:35:23.396037 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1152/2412] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:35:23.416167 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1b5e41a1-268d-4b25-b4a3-d9edd6cacbc9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:23.418424 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1b5e41a1-268d-4b25-b4a3-d9edd6cacbc9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: b7ebc01d-7008-4ca7-a82b-094962216ceb] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:23.455684 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b5e41a1-268d-4b25-b4a3-d9edd6cacbc9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:23.459148 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b5e41a1-268d-4b25-b4a3-d9edd6cacbc9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:23.461010 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b5e41a1-268d-4b25-b4a3-d9edd6cacbc9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:23.463994 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b5e41a1-268d-4b25-b4a3-d9edd6cacbc9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:23.464477 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b5e41a1-268d-4b25-b4a3-d9edd6cacbc9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:23.468669 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b5e41a1-268d-4b25-b4a3-d9edd6cacbc9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:23.912065 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1b5e41a1-268d-4b25-b4a3-d9edd6cacbc9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:23.923394 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1b5e41a1-268d-4b25-b4a3-d9edd6cacbc9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/b7ebc01d-7008-4ca7-a82b-094962216ceb" status: 200 len: 1275 microversion: 2.1 time: 0.517915 Oct 18 15:35:23.923991 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1153/2413] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:23 2022] GET /compute/v2.1/servers/b7ebc01d-7008-4ca7-a82b-094962216ceb => generated 1275 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:23.939541 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-ef4f5b18-b7f7-4ef6-b5cd-4fc79f4664be req-c8919ed3-8214-45ef-901e-6868eb26a6f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98c6abbf-732b-4723-89c8-cbb32207414f", "tag": "ce4cea1b-3055-4168-9a10-61429e48b81f"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:35:23.968366 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ef4f5b18-b7f7-4ef6-b5cd-4fc79f4664be req-c8919ed3-8214-45ef-901e-6868eb26a6f8 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:23.969065 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ef4f5b18-b7f7-4ef6-b5cd-4fc79f4664be req-c8919ed3-8214-45ef-901e-6868eb26a6f8 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:23.969507 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ef4f5b18-b7f7-4ef6-b5cd-4fc79f4664be req-c8919ed3-8214-45ef-901e-6868eb26a6f8 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:24.000235 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-ef4f5b18-b7f7-4ef6-b5cd-4fc79f4664be req-c8919ed3-8214-45ef-901e-6868eb26a6f8 service nova] Creating event network-changed:ce4cea1b-3055-4168-9a10-61429e48b81f for instance 98c6abbf-732b-4723-89c8-cbb32207414f on n-h2-853682-5 Oct 18 15:35:24.006318 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-ef4f5b18-b7f7-4ef6-b5cd-4fc79f4664be req-c8919ed3-8214-45ef-901e-6868eb26a6f8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077708 Oct 18 15:35:24.010091 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1154/2414] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:35:24.141272 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e7fa5f61-f487-4f55-976e-612e928737f2 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:24.151882 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e7fa5f61-f487-4f55-976e-612e928737f2 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca" status: 200 len: 1475 microversion: 2.1 time: 1.189720 Oct 18 15:35:24.160650 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1261/2415] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:22 2022] GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca => generated 1475 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:24.166004 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-26767abc-6bff-4580-8462-08dfdba4249d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:24.176892 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-26767abc-6bff-4580-8462-08dfdba4249d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 9e209f2c-f8e3-467a-a1b4-1942972e01ab] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:24.191720 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26767abc-6bff-4580-8462-08dfdba4249d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:24.193814 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26767abc-6bff-4580-8462-08dfdba4249d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:24.194562 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26767abc-6bff-4580-8462-08dfdba4249d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:24.196121 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26767abc-6bff-4580-8462-08dfdba4249d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:24.198070 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26767abc-6bff-4580-8462-08dfdba4249d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:24.198837 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26767abc-6bff-4580-8462-08dfdba4249d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:24.416496 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ce76679b-0139-4ce7-8e96-1bbf226152de tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Action: 'create', calling method: .version_select at 0x7f7c3d5f7f70>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1120818367", "description": "tempest-description-797415222"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:35:24.828247 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-26767abc-6bff-4580-8462-08dfdba4249d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:24.846461 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-26767abc-6bff-4580-8462-08dfdba4249d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/9e209f2c-f8e3-467a-a1b4-1942972e01ab" status: 200 len: 1314 microversion: 2.1 time: 0.683726 Oct 18 15:35:24.848626 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1262/2416] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:24 2022] GET /compute/v2.1/servers/9e209f2c-f8e3-467a-a1b4-1942972e01ab => generated 1314 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:24.866731 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0b3e80b6-ae84-49eb-8c5e-997d38cc559d tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63146b2a-1e9b-4031-8b18-d6311e50a923"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:35:24.869203 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0b3e80b6-ae84-49eb-8c5e-997d38cc559d tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] [instance: 5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:24.876034 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0b3e80b6-ae84-49eb-8c5e-997d38cc559d tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:24.876882 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0b3e80b6-ae84-49eb-8c5e-997d38cc559d tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:24.877544 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0b3e80b6-ae84-49eb-8c5e-997d38cc559d tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:24.878441 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0b3e80b6-ae84-49eb-8c5e-997d38cc559d tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:24.879050 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0b3e80b6-ae84-49eb-8c5e-997d38cc559d tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:24.879632 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0b3e80b6-ae84-49eb-8c5e-997d38cc559d tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:24.969575 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ce76679b-0139-4ce7-8e96-1bbf226152de tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.957678 Oct 18 15:35:24.971577 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1155/2417] 10.222.0.60 () {60 vars in 1180 bytes} [Tue Oct 18 15:35:24 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:35:24.977622 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0bcf4cfa-af5a-413b-9ef0-ea3bfda49ecd tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:24.978731 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0bcf4cfa-af5a-413b-9ef0-ea3bfda49ecd tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] [instance: 4df91fe0-82c3-404b-ac29-8da7bdb0ef66] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:25.009969 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0bcf4cfa-af5a-413b-9ef0-ea3bfda49ecd tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:25.010466 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0bcf4cfa-af5a-413b-9ef0-ea3bfda49ecd tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:25.010913 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0bcf4cfa-af5a-413b-9ef0-ea3bfda49ecd tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:25.011615 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0bcf4cfa-af5a-413b-9ef0-ea3bfda49ecd tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:25.012065 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0bcf4cfa-af5a-413b-9ef0-ea3bfda49ecd tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:25.012486 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0bcf4cfa-af5a-413b-9ef0-ea3bfda49ecd tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:25.594184 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0b3e80b6-ae84-49eb-8c5e-997d38cc559d tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] 10.222.0.60 "POST /compute/v2.1/servers/5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.744086 Oct 18 15:35:25.594918 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1263/2418] 10.222.0.60 () {60 vars in 1323 bytes} [Tue Oct 18 15:35:24 2022] POST /compute/v2.1/servers/5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e/os-volume_attachments => generated 194 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:35:25.612495 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-63889b04-356e-4694-8db2-87ff3f2388f0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:25.613563 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-63889b04-356e-4694-8db2-87ff3f2388f0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: b7ebc01d-7008-4ca7-a82b-094962216ceb] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:25.629870 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-63889b04-356e-4694-8db2-87ff3f2388f0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:25.631302 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-63889b04-356e-4694-8db2-87ff3f2388f0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:25.633882 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-63889b04-356e-4694-8db2-87ff3f2388f0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:25.637412 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-63889b04-356e-4694-8db2-87ff3f2388f0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:25.638126 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-63889b04-356e-4694-8db2-87ff3f2388f0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:25.639005 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-63889b04-356e-4694-8db2-87ff3f2388f0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:25.753495 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0bcf4cfa-af5a-413b-9ef0-ea3bfda49ecd tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee820071e6e4d2f9c3daa61f23c58e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc684ec2e4d4a6283dbb5566ccb8d60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:25.781055 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0bcf4cfa-af5a-413b-9ef0-ea3bfda49ecd tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] 10.222.0.60 "GET /compute/v2.1/servers/4df91fe0-82c3-404b-ac29-8da7bdb0ef66" status: 200 len: 1322 microversion: 2.1 time: 0.806419 Oct 18 15:35:25.782268 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1156/2419] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:24 2022] GET /compute/v2.1/servers/4df91fe0-82c3-404b-ac29-8da7bdb0ef66 => generated 1322 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:25.830821 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b8aecb16-1bbd-42a6-ab5f-c941aa595366 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Action: 'create', calling method: .version_select at 0x7f7c3cef03a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-417257281", "description": "tempest-description-1425577123"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:35:25.858387 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-63889b04-356e-4694-8db2-87ff3f2388f0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:25.870430 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-63889b04-356e-4694-8db2-87ff3f2388f0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/b7ebc01d-7008-4ca7-a82b-094962216ceb" status: 200 len: 1273 microversion: 2.1 time: 0.270918 Oct 18 15:35:25.872077 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1264/2420] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:25 2022] GET /compute/v2.1/servers/b7ebc01d-7008-4ca7-a82b-094962216ceb => generated 1273 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:25.880842 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a246223e-1e37-48bc-ba34-6ce7878942cd tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:25.884660 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a246223e-1e37-48bc-ba34-6ce7878942cd tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 0dbbde45-f255-4ac5-8887-1ce8de673fca] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:25.899970 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a246223e-1e37-48bc-ba34-6ce7878942cd tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:25.901245 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a246223e-1e37-48bc-ba34-6ce7878942cd tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:25.903864 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a246223e-1e37-48bc-ba34-6ce7878942cd tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:25.907913 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a246223e-1e37-48bc-ba34-6ce7878942cd tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:25.908766 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a246223e-1e37-48bc-ba34-6ce7878942cd tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:25.909468 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a246223e-1e37-48bc-ba34-6ce7878942cd tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:27.333554 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a246223e-1e37-48bc-ba34-6ce7878942cd tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:27.358064 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a246223e-1e37-48bc-ba34-6ce7878942cd tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca" status: 200 len: 1475 microversion: 2.1 time: 1.482236 Oct 18 15:35:27.367395 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1265/2421] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:25 2022] GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca => generated 1475 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:27.373274 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-91050c85-61c9-4faf-b465-00488352e228 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:27.373891 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-91050c85-61c9-4faf-b465-00488352e228 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 9e209f2c-f8e3-467a-a1b4-1942972e01ab] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:27.404641 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-91050c85-61c9-4faf-b465-00488352e228 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:27.405489 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-91050c85-61c9-4faf-b465-00488352e228 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:27.406108 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-91050c85-61c9-4faf-b465-00488352e228 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:27.410120 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-91050c85-61c9-4faf-b465-00488352e228 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:27.410840 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-91050c85-61c9-4faf-b465-00488352e228 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:27.411431 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-91050c85-61c9-4faf-b465-00488352e228 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:27.887883 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b8aecb16-1bbd-42a6-ab5f-c941aa595366 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 2.087068 Oct 18 15:35:27.889361 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1157/2422] 10.222.0.60 () {60 vars in 1180 bytes} [Tue Oct 18 15:35:25 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 2106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:35:27.894454 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-c6c4bc66-b136-41a9-8f82-e2c2f414373a req-2d5bbbe1-9261-4c3b-937f-1c5074a5cc8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e209f2c-f8e3-467a-a1b4-1942972e01ab", "name": "network-vif-plugged", "status": "completed", "tag": "7dbe5c02-8a53-44d0-8afd-137194991306"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:35:27.941404 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c6c4bc66-b136-41a9-8f82-e2c2f414373a req-2d5bbbe1-9261-4c3b-937f-1c5074a5cc8c service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:27.946173 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c6c4bc66-b136-41a9-8f82-e2c2f414373a req-2d5bbbe1-9261-4c3b-937f-1c5074a5cc8c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:27.950175 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c6c4bc66-b136-41a9-8f82-e2c2f414373a req-2d5bbbe1-9261-4c3b-937f-1c5074a5cc8c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:28.004585 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-c6c4bc66-b136-41a9-8f82-e2c2f414373a req-2d5bbbe1-9261-4c3b-937f-1c5074a5cc8c service nova] Creating event network-vif-plugged:7dbe5c02-8a53-44d0-8afd-137194991306 for instance 9e209f2c-f8e3-467a-a1b4-1942972e01ab on n-h1-853682-5 Oct 18 15:35:28.020201 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-c6c4bc66-b136-41a9-8f82-e2c2f414373a req-2d5bbbe1-9261-4c3b-937f-1c5074a5cc8c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129334 Oct 18 15:35:28.023081 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1158/2423] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:35:28.035488 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ad25be3e-d181-44a2-8302-902e70eb92ef tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:28.037892 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ad25be3e-d181-44a2-8302-902e70eb92ef tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] [instance: 4df91fe0-82c3-404b-ac29-8da7bdb0ef66] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:28.057745 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-91050c85-61c9-4faf-b465-00488352e228 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:28.058531 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad25be3e-d181-44a2-8302-902e70eb92ef tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:28.066705 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-91050c85-61c9-4faf-b465-00488352e228 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/9e209f2c-f8e3-467a-a1b4-1942972e01ab" status: 200 len: 1314 microversion: 2.1 time: 0.697814 Oct 18 15:35:28.069544 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1266/2424] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:27 2022] GET /compute/v2.1/servers/9e209f2c-f8e3-467a-a1b4-1942972e01ab => generated 1314 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:28.071215 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad25be3e-d181-44a2-8302-902e70eb92ef tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:28.075338 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad25be3e-d181-44a2-8302-902e70eb92ef tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:28.076141 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad25be3e-d181-44a2-8302-902e70eb92ef tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:28.076648 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad25be3e-d181-44a2-8302-902e70eb92ef tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:28.077137 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad25be3e-d181-44a2-8302-902e70eb92ef tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:28.081090 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b3ca46ab-32bf-4f77-869c-3936289a05c7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:28.085622 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b3ca46ab-32bf-4f77-869c-3936289a05c7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: b7ebc01d-7008-4ca7-a82b-094962216ceb] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:28.108996 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b3ca46ab-32bf-4f77-869c-3936289a05c7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:28.109505 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b3ca46ab-32bf-4f77-869c-3936289a05c7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:28.109953 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b3ca46ab-32bf-4f77-869c-3936289a05c7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:28.110671 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b3ca46ab-32bf-4f77-869c-3936289a05c7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:28.116528 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b3ca46ab-32bf-4f77-869c-3936289a05c7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:28.117249 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b3ca46ab-32bf-4f77-869c-3936289a05c7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:29.085909 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ad25be3e-d181-44a2-8302-902e70eb92ef tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee820071e6e4d2f9c3daa61f23c58e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc684ec2e4d4a6283dbb5566ccb8d60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:29.096095 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ad25be3e-d181-44a2-8302-902e70eb92ef tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] 10.222.0.60 "GET /compute/v2.1/servers/4df91fe0-82c3-404b-ac29-8da7bdb0ef66" status: 200 len: 1322 microversion: 2.1 time: 1.069306 Oct 18 15:35:29.112118 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1159/2425] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:28 2022] GET /compute/v2.1/servers/4df91fe0-82c3-404b-ac29-8da7bdb0ef66 => generated 1322 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:29.127805 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-912b0785-1ffd-4fba-8599-47d3b1c9ee51 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-142454287", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "4f43dce0-3c64-4384-85c2-f93befe9573a"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:35:29.206230 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-912b0785-1ffd-4fba-8599-47d3b1c9ee51 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] validate_networks() for [('4f43dce0-3c64-4384-85c2-f93befe9573a', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:35:29.454368 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b3ca46ab-32bf-4f77-869c-3936289a05c7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:29.464279 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b3ca46ab-32bf-4f77-869c-3936289a05c7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/b7ebc01d-7008-4ca7-a82b-094962216ceb" status: 200 len: 1315 microversion: 2.1 time: 1.391250 Oct 18 15:35:29.468696 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1267/2426] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:28 2022] GET /compute/v2.1/servers/b7ebc01d-7008-4ca7-a82b-094962216ceb => generated 1315 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:29.482087 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-20b091ef-10b4-483c-981e-939946c4f592 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:29.483051 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-20b091ef-10b4-483c-981e-939946c4f592 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 0dbbde45-f255-4ac5-8887-1ce8de673fca] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:29.494610 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-20b091ef-10b4-483c-981e-939946c4f592 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:29.498148 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-20b091ef-10b4-483c-981e-939946c4f592 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:29.498755 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-20b091ef-10b4-483c-981e-939946c4f592 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:29.500987 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-20b091ef-10b4-483c-981e-939946c4f592 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:29.502802 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-20b091ef-10b4-483c-981e-939946c4f592 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:29.504863 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-20b091ef-10b4-483c-981e-939946c4f592 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:29.559569 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:35:30.647200 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-20b091ef-10b4-483c-981e-939946c4f592 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:30.666207 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-20b091ef-10b4-483c-981e-939946c4f592 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca" status: 200 len: 1475 microversion: 2.1 time: 1.196096 Oct 18 15:35:30.667390 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1268/2427] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:29 2022] GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca => generated 1475 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:30.672322 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-565080cf-66cb-49ac-972f-3271cc454341 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:30.673886 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-565080cf-66cb-49ac-972f-3271cc454341 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 9e209f2c-f8e3-467a-a1b4-1942972e01ab] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:30.708948 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-565080cf-66cb-49ac-972f-3271cc454341 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:30.709689 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-565080cf-66cb-49ac-972f-3271cc454341 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:30.715854 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-565080cf-66cb-49ac-972f-3271cc454341 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:30.720903 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-565080cf-66cb-49ac-972f-3271cc454341 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:30.721660 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-565080cf-66cb-49ac-972f-3271cc454341 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:30.722282 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-565080cf-66cb-49ac-972f-3271cc454341 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:31.046995 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:35:31.896490 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-912b0785-1ffd-4fba-8599-47d3b1c9ee51 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:35:31.896947 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-912b0785-1ffd-4fba-8599-47d3b1c9ee51 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:35:31.897425 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-912b0785-1ffd-4fba-8599-47d3b1c9ee51 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:35:31.897838 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-912b0785-1ffd-4fba-8599-47d3b1c9ee51 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:35:31.898503 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-912b0785-1ffd-4fba-8599-47d3b1c9ee51 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:35:31.922107 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-912b0785-1ffd-4fba-8599-47d3b1c9ee51 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:31.922709 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-912b0785-1ffd-4fba-8599-47d3b1c9ee51 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:31.923163 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-912b0785-1ffd-4fba-8599-47d3b1c9ee51 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:31.923989 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-912b0785-1ffd-4fba-8599-47d3b1c9ee51 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:31.924448 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-912b0785-1ffd-4fba-8599-47d3b1c9ee51 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:31.924902 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-912b0785-1ffd-4fba-8599-47d3b1c9ee51 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:31.970329 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-565080cf-66cb-49ac-972f-3271cc454341 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:31.983552 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-565080cf-66cb-49ac-972f-3271cc454341 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/9e209f2c-f8e3-467a-a1b4-1942972e01ab" status: 200 len: 1314 microversion: 2.1 time: 1.314819 Oct 18 15:35:31.985082 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-912b0785-1ffd-4fba-8599-47d3b1c9ee51 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Getting quotas for project 6a52e3135e52493b8ccb2d7342418591. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:35:32.005903 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1269/2428] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:30 2022] GET /compute/v2.1/servers/9e209f2c-f8e3-467a-a1b4-1942972e01ab => generated 1314 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:32.026691 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-81878592-311b-46f5-9b10-db5ba4c1c69b tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:32.027322 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-81878592-311b-46f5-9b10-db5ba4c1c69b tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] [instance: 4df91fe0-82c3-404b-ac29-8da7bdb0ef66] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:32.030596 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-912b0785-1ffd-4fba-8599-47d3b1c9ee51 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Getting quotas for user ee9a7ce3bb784a79b3ac336743b9ae84 and project 6a52e3135e52493b8ccb2d7342418591. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:35:32.040896 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-81878592-311b-46f5-9b10-db5ba4c1c69b tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:32.041399 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-81878592-311b-46f5-9b10-db5ba4c1c69b tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:32.041846 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-81878592-311b-46f5-9b10-db5ba4c1c69b tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:32.042572 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-81878592-311b-46f5-9b10-db5ba4c1c69b tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:32.043042 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-81878592-311b-46f5-9b10-db5ba4c1c69b tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:32.043465 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-81878592-311b-46f5-9b10-db5ba4c1c69b tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:32.062044 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-912b0785-1ffd-4fba-8599-47d3b1c9ee51 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:35:32.075056 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-912b0785-1ffd-4fba-8599-47d3b1c9ee51 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] [instance: 873a3005-fbac-40d0-8919-f138a619f2fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:35:32.209622 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-912b0785-1ffd-4fba-8599-47d3b1c9ee51 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.096056 Oct 18 15:35:32.212746 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1160/2429] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:35:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 3100 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:35:32.223782 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f35b3eea-a57a-4d8e-9a02-02fc9d185d2d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:32.227411 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f35b3eea-a57a-4d8e-9a02-02fc9d185d2d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: b7ebc01d-7008-4ca7-a82b-094962216ceb] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:32.240040 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f35b3eea-a57a-4d8e-9a02-02fc9d185d2d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:32.256879 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f35b3eea-a57a-4d8e-9a02-02fc9d185d2d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:32.257546 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f35b3eea-a57a-4d8e-9a02-02fc9d185d2d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:32.259797 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f35b3eea-a57a-4d8e-9a02-02fc9d185d2d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:32.261900 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f35b3eea-a57a-4d8e-9a02-02fc9d185d2d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:32.262523 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f35b3eea-a57a-4d8e-9a02-02fc9d185d2d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:32.557542 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-81878592-311b-46f5-9b10-db5ba4c1c69b tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee820071e6e4d2f9c3daa61f23c58e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc684ec2e4d4a6283dbb5566ccb8d60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:32.572143 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-81878592-311b-46f5-9b10-db5ba4c1c69b tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] 10.222.0.60 "GET /compute/v2.1/servers/4df91fe0-82c3-404b-ac29-8da7bdb0ef66" status: 200 len: 1322 microversion: 2.1 time: 0.564294 Oct 18 15:35:32.573203 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1270/2430] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:32 2022] GET /compute/v2.1/servers/4df91fe0-82c3-404b-ac29-8da7bdb0ef66 => generated 1322 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:32.776287 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f35b3eea-a57a-4d8e-9a02-02fc9d185d2d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:32.777687 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f3ed3d02-2b9e-4d03-8c9c-bd0c9dff710f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Action: 'create', calling method: .version_select at 0x7f7c41715430>, body: {"keypair": {"name": "tempest-keypair-1774961777", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHv/2bAvFMzXDIk5owxbBjAtRnap63tLIWyLFZeIdwzMhY+i0xdq7AiZy0TGk+94Eo50YwX1TP1T2cPWYGnzL6ojNnwCWGkgcNlC4H6GCUkCF4X/f4RT7zVoGnLmlb7Vng=="}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:35:32.790988 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f35b3eea-a57a-4d8e-9a02-02fc9d185d2d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/b7ebc01d-7008-4ca7-a82b-094962216ceb" status: 200 len: 1315 microversion: 2.1 time: 0.575251 Oct 18 15:35:32.798385 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1161/2431] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:32 2022] GET /compute/v2.1/servers/b7ebc01d-7008-4ca7-a82b-094962216ceb => generated 1315 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:32.816301 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-355c1ed3-e7be-4e5c-8f61-7d8b9cac6a64 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:32.817341 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-355c1ed3-e7be-4e5c-8f61-7d8b9cac6a64 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 0dbbde45-f255-4ac5-8887-1ce8de673fca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:32.840908 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-355c1ed3-e7be-4e5c-8f61-7d8b9cac6a64 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:32.846643 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-355c1ed3-e7be-4e5c-8f61-7d8b9cac6a64 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:32.847430 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-355c1ed3-e7be-4e5c-8f61-7d8b9cac6a64 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:32.848163 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-f3ed3d02-2b9e-4d03-8c9c-bd0c9dff710f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Getting quotas for project a5b55fd6668b481b8c578983dc655785. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:35:32.850079 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-355c1ed3-e7be-4e5c-8f61-7d8b9cac6a64 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:32.852751 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-355c1ed3-e7be-4e5c-8f61-7d8b9cac6a64 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:32.857961 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-355c1ed3-e7be-4e5c-8f61-7d8b9cac6a64 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:32.874129 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-f3ed3d02-2b9e-4d03-8c9c-bd0c9dff710f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Getting quotas for user efec3b4b5b1c46bd9d2c0efa68f86979 and project a5b55fd6668b481b8c578983dc655785. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:35:32.991927 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f3ed3d02-2b9e-4d03-8c9c-bd0c9dff710f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.412156 Oct 18 15:35:33.006067 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1271/2432] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Oct 18 15:35:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:35:33.017913 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-569cdba4-e1f7-46c1-a371-395d62b84c53 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:33.018548 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-569cdba4-e1f7-46c1-a371-395d62b84c53 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] [instance: 873a3005-fbac-40d0-8919-f138a619f2fa] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:33.238880 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-569cdba4-e1f7-46c1-a371-395d62b84c53 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a7ce3bb784a79b3ac336743b9ae84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a52e3135e52493b8ccb2d7342418591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:33.252567 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-355c1ed3-e7be-4e5c-8f61-7d8b9cac6a64 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:33.255750 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-569cdba4-e1f7-46c1-a371-395d62b84c53 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "GET /compute/v2.1/servers/873a3005-fbac-40d0-8919-f138a619f2fa" status: 200 len: 1215 microversion: 2.1 time: 0.240436 Oct 18 15:35:33.257675 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1272/2433] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:33 2022] GET /compute/v2.1/servers/873a3005-fbac-40d0-8919-f138a619f2fa => generated 1215 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:33.265830 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-131f07d4-fb86-42ac-a66d-c524701246b7 req-b12d1998-2361-4808-95a7-eb061c8dafcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7ebc01d-7008-4ca7-a82b-094962216ceb", "tag": "fd8352a3-56cf-42b8-84f4-d06c63e7c5ad"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:35:33.291784 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-355c1ed3-e7be-4e5c-8f61-7d8b9cac6a64 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca" status: 200 len: 1475 microversion: 2.1 time: 0.487020 Oct 18 15:35:33.310387 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-131f07d4-fb86-42ac-a66d-c524701246b7 req-b12d1998-2361-4808-95a7-eb061c8dafcf service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:33.312886 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-131f07d4-fb86-42ac-a66d-c524701246b7 req-b12d1998-2361-4808-95a7-eb061c8dafcf service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:33.314495 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1162/2434] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:32 2022] GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca => generated 1475 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:33.314666 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-131f07d4-fb86-42ac-a66d-c524701246b7 req-b12d1998-2361-4808-95a7-eb061c8dafcf service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:33.344941 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-131f07d4-fb86-42ac-a66d-c524701246b7 req-b12d1998-2361-4808-95a7-eb061c8dafcf service nova] Creating event network-changed:fd8352a3-56cf-42b8-84f4-d06c63e7c5ad for instance b7ebc01d-7008-4ca7-a82b-094962216ceb on n-h2-853682-5 Oct 18 15:35:33.347829 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b5feb24a-69c0-4872-ab12-ad595ea9b79f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:33.348774 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b5feb24a-69c0-4872-ab12-ad595ea9b79f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 9e209f2c-f8e3-467a-a1b4-1942972e01ab] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:33.360512 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:35:33.362469 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-131f07d4-fb86-42ac-a66d-c524701246b7 req-b12d1998-2361-4808-95a7-eb061c8dafcf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099541 Oct 18 15:35:33.364596 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1273/2435] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:35:33.380676 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5feb24a-69c0-4872-ab12-ad595ea9b79f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:33.393591 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5feb24a-69c0-4872-ab12-ad595ea9b79f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:33.395697 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5feb24a-69c0-4872-ab12-ad595ea9b79f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:33.399274 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5feb24a-69c0-4872-ab12-ad595ea9b79f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:33.403936 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5feb24a-69c0-4872-ab12-ad595ea9b79f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:33.407242 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5feb24a-69c0-4872-ab12-ad595ea9b79f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:33.477808 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-be6c2837-b7e6-4a71-9aa8-29ae9c242520 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Action: 'create', calling method: .version_select at 0x7f7c415bb160>, body: {"keypair": {"name": "tempest-keypair-116914274", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAk+Fo8fBQEqJVOoHz/8sn9h9MGJGdTZGJLfb4PY06qtMy4xWTE6mPTgVbQnExJRrLFBcurCwdWSAhuKJSc0rXwEHVGHGfJ7ZoX8GI82Ong5OItNSgJFNBzto0Qld+VQIw=="}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:35:33.538743 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-be6c2837-b7e6-4a71-9aa8-29ae9c242520 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Getting quotas for project 88812dd7c80d47bba192382fccc31e64. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:35:33.553489 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-be6c2837-b7e6-4a71-9aa8-29ae9c242520 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Getting quotas for user 01bc878a0901409684ea58261475b1bc and project 88812dd7c80d47bba192382fccc31e64. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:35:33.611395 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-be6c2837-b7e6-4a71-9aa8-29ae9c242520 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.235308 Oct 18 15:35:33.612663 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1274/2436] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Oct 18 15:35:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:35:33.617876 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ea87e399-e9fd-4179-97c4-48e17ce969d2 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:33.620675 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ea87e399-e9fd-4179-97c4-48e17ce969d2 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] [instance: 4df91fe0-82c3-404b-ac29-8da7bdb0ef66] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:33.635112 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea87e399-e9fd-4179-97c4-48e17ce969d2 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:33.637544 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea87e399-e9fd-4179-97c4-48e17ce969d2 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:33.639927 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea87e399-e9fd-4179-97c4-48e17ce969d2 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:33.641463 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea87e399-e9fd-4179-97c4-48e17ce969d2 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:33.643769 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea87e399-e9fd-4179-97c4-48e17ce969d2 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:33.644461 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea87e399-e9fd-4179-97c4-48e17ce969d2 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:34.177664 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b5feb24a-69c0-4872-ab12-ad595ea9b79f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:34.193034 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b5feb24a-69c0-4872-ab12-ad595ea9b79f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/9e209f2c-f8e3-467a-a1b4-1942972e01ab" status: 200 len: 1463 microversion: 2.1 time: 0.864723 Oct 18 15:35:34.198068 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1163/2437] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:33 2022] GET /compute/v2.1/servers/9e209f2c-f8e3-467a-a1b4-1942972e01ab => generated 1463 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:34.229094 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e37641b3-7ea0-4327-9a16-d3167512127d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:34.230104 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e37641b3-7ea0-4327-9a16-d3167512127d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: b7ebc01d-7008-4ca7-a82b-094962216ceb] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:34.232479 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ea87e399-e9fd-4179-97c4-48e17ce969d2 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee820071e6e4d2f9c3daa61f23c58e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc684ec2e4d4a6283dbb5566ccb8d60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:34.240840 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ea87e399-e9fd-4179-97c4-48e17ce969d2 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] 10.222.0.60 "GET /compute/v2.1/servers/4df91fe0-82c3-404b-ac29-8da7bdb0ef66" status: 200 len: 1322 microversion: 2.1 time: 0.626946 Oct 18 15:35:34.244767 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e37641b3-7ea0-4327-9a16-d3167512127d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:34.245944 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1275/2438] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:33 2022] GET /compute/v2.1/servers/4df91fe0-82c3-404b-ac29-8da7bdb0ef66 => generated 1322 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:34.246161 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e37641b3-7ea0-4327-9a16-d3167512127d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:34.246608 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e37641b3-7ea0-4327-9a16-d3167512127d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:34.247382 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e37641b3-7ea0-4327-9a16-d3167512127d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:34.247768 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e37641b3-7ea0-4327-9a16-d3167512127d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:34.248190 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e37641b3-7ea0-4327-9a16-d3167512127d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:34.252474 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-dd9a33a5-98ae-4052-a109-f4884f56227d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:34.276002 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-dd9a33a5-98ae-4052-a109-f4884f56227d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:34.315504 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dd9a33a5-98ae-4052-a109-f4884f56227d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:34.318043 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dd9a33a5-98ae-4052-a109-f4884f56227d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:34.318496 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dd9a33a5-98ae-4052-a109-f4884f56227d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:34.319236 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dd9a33a5-98ae-4052-a109-f4884f56227d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:34.321830 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dd9a33a5-98ae-4052-a109-f4884f56227d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:34.322302 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dd9a33a5-98ae-4052-a109-f4884f56227d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:34.613751 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e37641b3-7ea0-4327-9a16-d3167512127d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:34.622287 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e37641b3-7ea0-4327-9a16-d3167512127d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/b7ebc01d-7008-4ca7-a82b-094962216ceb" status: 200 len: 1315 microversion: 2.1 time: 0.407688 Oct 18 15:35:34.625266 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1164/2439] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:34 2022] GET /compute/v2.1/servers/b7ebc01d-7008-4ca7-a82b-094962216ceb => generated 1315 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:34.644000 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bf530d51-1190-44e9-b7ad-701986e5700d tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:34.646510 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bf530d51-1190-44e9-b7ad-701986e5700d tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] [instance: 873a3005-fbac-40d0-8919-f138a619f2fa] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:34.666882 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf530d51-1190-44e9-b7ad-701986e5700d tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:34.669142 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf530d51-1190-44e9-b7ad-701986e5700d tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:34.670885 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf530d51-1190-44e9-b7ad-701986e5700d tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:34.671710 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf530d51-1190-44e9-b7ad-701986e5700d tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:34.679032 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf530d51-1190-44e9-b7ad-701986e5700d tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:34.679510 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf530d51-1190-44e9-b7ad-701986e5700d tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:34.700759 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-dd9a33a5-98ae-4052-a109-f4884f56227d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:34.710124 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-dd9a33a5-98ae-4052-a109-f4884f56227d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c" status: 200 len: 1463 microversion: 2.1 time: 0.461899 Oct 18 15:35:34.737367 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1276/2440] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:34 2022] GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c => generated 1463 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:34.768742 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-755cf49e-1e7b-4818-8f92-b357b56ba7cf tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:34.769634 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-755cf49e-1e7b-4818-8f92-b357b56ba7cf tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 0dbbde45-f255-4ac5-8887-1ce8de673fca] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:34.796121 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-755cf49e-1e7b-4818-8f92-b357b56ba7cf tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:34.798529 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-755cf49e-1e7b-4818-8f92-b357b56ba7cf tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:34.802085 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-755cf49e-1e7b-4818-8f92-b357b56ba7cf tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:34.803010 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-755cf49e-1e7b-4818-8f92-b357b56ba7cf tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:34.805414 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-755cf49e-1e7b-4818-8f92-b357b56ba7cf tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:34.809616 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-755cf49e-1e7b-4818-8f92-b357b56ba7cf tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:34.873310 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bf530d51-1190-44e9-b7ad-701986e5700d tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a7ce3bb784a79b3ac336743b9ae84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a52e3135e52493b8ccb2d7342418591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:34.884930 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bf530d51-1190-44e9-b7ad-701986e5700d tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "GET /compute/v2.1/servers/873a3005-fbac-40d0-8919-f138a619f2fa" status: 200 len: 1267 microversion: 2.1 time: 0.258546 Oct 18 15:35:34.888218 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1165/2441] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:34 2022] GET /compute/v2.1/servers/873a3005-fbac-40d0-8919-f138a619f2fa => generated 1267 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:34.926730 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-d569a926-56a7-4e4c-8210-fa48a35c015f req-c513e3de-73ff-4fe7-9189-adab37d826d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98c6abbf-732b-4723-89c8-cbb32207414f", "name": "network-vif-plugged", "status": "completed", "tag": "ce4cea1b-3055-4168-9a10-61429e48b81f"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:35:34.950269 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d569a926-56a7-4e4c-8210-fa48a35c015f req-c513e3de-73ff-4fe7-9189-adab37d826d1 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:34.951761 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d569a926-56a7-4e4c-8210-fa48a35c015f req-c513e3de-73ff-4fe7-9189-adab37d826d1 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:34.956419 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d569a926-56a7-4e4c-8210-fa48a35c015f req-c513e3de-73ff-4fe7-9189-adab37d826d1 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:34.996089 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-d569a926-56a7-4e4c-8210-fa48a35c015f req-c513e3de-73ff-4fe7-9189-adab37d826d1 service nova] Creating event network-vif-plugged:ce4cea1b-3055-4168-9a10-61429e48b81f for instance 98c6abbf-732b-4723-89c8-cbb32207414f on n-h2-853682-5 Oct 18 15:35:35.003753 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-d569a926-56a7-4e4c-8210-fa48a35c015f req-c513e3de-73ff-4fe7-9189-adab37d826d1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080435 Oct 18 15:35:35.006036 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1166/2442] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:35:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:35:35.012449 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-33946c07-dcbe-461c-bafc-a501dc19215d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-32585960", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "35e5cf0e-693b-4930-9665-f1a53983cc1c"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:35:35.096265 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-33946c07-dcbe-461c-bafc-a501dc19215d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] validate_networks() for None {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:35:35.539300 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-755cf49e-1e7b-4818-8f92-b357b56ba7cf tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:35.553467 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-755cf49e-1e7b-4818-8f92-b357b56ba7cf tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca" status: 200 len: 1475 microversion: 2.1 time: 0.814680 Oct 18 15:35:35.553877 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1277/2443] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:34 2022] GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca => generated 1475 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:35.564577 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a9b3e417-9f23-4224-b7d3-c3d99b253e0d tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:35.566040 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a9b3e417-9f23-4224-b7d3-c3d99b253e0d tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] [instance: 4df91fe0-82c3-404b-ac29-8da7bdb0ef66] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:35.572573 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9b3e417-9f23-4224-b7d3-c3d99b253e0d tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:35.575646 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9b3e417-9f23-4224-b7d3-c3d99b253e0d tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:35.576296 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9b3e417-9f23-4224-b7d3-c3d99b253e0d tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:35.577426 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9b3e417-9f23-4224-b7d3-c3d99b253e0d tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:35.597419 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9b3e417-9f23-4224-b7d3-c3d99b253e0d tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:35.597892 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9b3e417-9f23-4224-b7d3-c3d99b253e0d tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:36.096024 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a9b3e417-9f23-4224-b7d3-c3d99b253e0d tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee820071e6e4d2f9c3daa61f23c58e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc684ec2e4d4a6283dbb5566ccb8d60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:36.116135 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-33946c07-dcbe-461c-bafc-a501dc19215d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:35:36.117282 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-33946c07-dcbe-461c-bafc-a501dc19215d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:35:36.118758 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-33946c07-dcbe-461c-bafc-a501dc19215d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:35:36.119332 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-33946c07-dcbe-461c-bafc-a501dc19215d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:35:36.119897 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-33946c07-dcbe-461c-bafc-a501dc19215d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:35:36.124943 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a9b3e417-9f23-4224-b7d3-c3d99b253e0d tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] 10.222.0.60 "GET /compute/v2.1/servers/4df91fe0-82c3-404b-ac29-8da7bdb0ef66" status: 200 len: 1322 microversion: 2.1 time: 0.554631 Oct 18 15:35:36.130332 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1278/2444] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:35 2022] GET /compute/v2.1/servers/4df91fe0-82c3-404b-ac29-8da7bdb0ef66 => generated 1322 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:36.147389 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fdef2502-57c8-4680-b51e-5c661b14a296 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:36.148270 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-fdef2502-57c8-4680-b51e-5c661b14a296 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: b7ebc01d-7008-4ca7-a82b-094962216ceb] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:36.151846 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33946c07-dcbe-461c-bafc-a501dc19215d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:36.153326 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33946c07-dcbe-461c-bafc-a501dc19215d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:36.155044 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33946c07-dcbe-461c-bafc-a501dc19215d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:36.161132 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33946c07-dcbe-461c-bafc-a501dc19215d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:36.161326 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fdef2502-57c8-4680-b51e-5c661b14a296 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:36.162523 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fdef2502-57c8-4680-b51e-5c661b14a296 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:36.162666 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33946c07-dcbe-461c-bafc-a501dc19215d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:36.163262 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fdef2502-57c8-4680-b51e-5c661b14a296 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:36.164124 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33946c07-dcbe-461c-bafc-a501dc19215d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:36.170412 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fdef2502-57c8-4680-b51e-5c661b14a296 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:36.171377 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fdef2502-57c8-4680-b51e-5c661b14a296 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:36.172274 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fdef2502-57c8-4680-b51e-5c661b14a296 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:36.199469 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:35:36.226768 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-33946c07-dcbe-461c-bafc-a501dc19215d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Getting quotas for project de91b5fbc5c344019924b5353abf539d. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:35:36.234681 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-33946c07-dcbe-461c-bafc-a501dc19215d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Getting quotas for user 99c56c556efc4f45b56699afa36e22bc and project de91b5fbc5c344019924b5353abf539d. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:35:36.256170 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-33946c07-dcbe-461c-bafc-a501dc19215d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:35:36.259435 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-33946c07-dcbe-461c-bafc-a501dc19215d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 89919fa6-1fd6-42d0-ab81-d0cdebc3960c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:35:36.330373 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-33946c07-dcbe-461c-bafc-a501dc19215d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.322609 Oct 18 15:35:36.331400 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1167/2445] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:35:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1324 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:35:36.336432 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3d255686-78bf-492e-add4-70422cbf4cc9 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:36.337466 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3d255686-78bf-492e-add4-70422cbf4cc9 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] [instance: 873a3005-fbac-40d0-8919-f138a619f2fa] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:36.345307 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d255686-78bf-492e-add4-70422cbf4cc9 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:36.346073 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d255686-78bf-492e-add4-70422cbf4cc9 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:36.346677 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d255686-78bf-492e-add4-70422cbf4cc9 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:36.347541 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d255686-78bf-492e-add4-70422cbf4cc9 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:36.348302 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d255686-78bf-492e-add4-70422cbf4cc9 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:36.348959 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d255686-78bf-492e-add4-70422cbf4cc9 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:36.511680 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3d255686-78bf-492e-add4-70422cbf4cc9 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a7ce3bb784a79b3ac336743b9ae84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a52e3135e52493b8ccb2d7342418591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:36.527056 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3d255686-78bf-492e-add4-70422cbf4cc9 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "GET /compute/v2.1/servers/873a3005-fbac-40d0-8919-f138a619f2fa" status: 200 len: 1273 microversion: 2.1 time: 0.194282 Oct 18 15:35:36.527894 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1168/2446] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:36 2022] GET /compute/v2.1/servers/873a3005-fbac-40d0-8919-f138a619f2fa => generated 1273 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:36.535275 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7f6203bc-f989-46be-88f7-5e6a09469e60 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:36.536054 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7f6203bc-f989-46be-88f7-5e6a09469e60 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 89919fa6-1fd6-42d0-ab81-d0cdebc3960c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:36.670755 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7f6203bc-f989-46be-88f7-5e6a09469e60 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:36.678811 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-fdef2502-57c8-4680-b51e-5c661b14a296 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:36.679327 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7f6203bc-f989-46be-88f7-5e6a09469e60 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/89919fa6-1fd6-42d0-ab81-d0cdebc3960c" status: 200 len: 1212 microversion: 2.1 time: 0.149716 Oct 18 15:35:36.680132 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1169/2447] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:36 2022] GET /compute/v2.1/servers/89919fa6-1fd6-42d0-ab81-d0cdebc3960c => generated 1212 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:36.687575 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d3ee2ff8-74a1-44da-9119-5fcb20ade26e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:36.688363 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d3ee2ff8-74a1-44da-9119-5fcb20ade26e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 0dbbde45-f255-4ac5-8887-1ce8de673fca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:36.700369 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3ee2ff8-74a1-44da-9119-5fcb20ade26e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:36.701057 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3ee2ff8-74a1-44da-9119-5fcb20ade26e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:36.701706 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3ee2ff8-74a1-44da-9119-5fcb20ade26e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:36.702584 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3ee2ff8-74a1-44da-9119-5fcb20ade26e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:36.703191 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3ee2ff8-74a1-44da-9119-5fcb20ade26e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:36.703770 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3ee2ff8-74a1-44da-9119-5fcb20ade26e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:36.714530 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fdef2502-57c8-4680-b51e-5c661b14a296 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/b7ebc01d-7008-4ca7-a82b-094962216ceb" status: 200 len: 1315 microversion: 2.1 time: 0.581807 Oct 18 15:35:36.715383 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1279/2448] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:36 2022] GET /compute/v2.1/servers/b7ebc01d-7008-4ca7-a82b-094962216ceb => generated 1315 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:37.054923 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-e167c3c8-a768-4bec-a97b-288ee8d3ca29 req-24eacf39-c743-4da5-b195-a90fa5815495 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1a558f2-6710-4ab0-92fc-03076dcb4408", "name": "network-vif-plugged", "status": "completed", "tag": "2799e185-c707-4732-964a-3994e3877409"}, {"server_uuid": "4df91fe0-82c3-404b-ac29-8da7bdb0ef66", "name": "network-vif-plugged", "status": "completed", "tag": "3937e97b-486e-43be-8bfa-74b0972bc6ce"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:35:37.084682 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-e167c3c8-a768-4bec-a97b-288ee8d3ca29 req-24eacf39-c743-4da5-b195-a90fa5815495 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:37.085202 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-e167c3c8-a768-4bec-a97b-288ee8d3ca29 req-24eacf39-c743-4da5-b195-a90fa5815495 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:37.085635 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-e167c3c8-a768-4bec-a97b-288ee8d3ca29 req-24eacf39-c743-4da5-b195-a90fa5815495 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:37.111211 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-e167c3c8-a768-4bec-a97b-288ee8d3ca29 req-24eacf39-c743-4da5-b195-a90fa5815495 service nova] Creating event network-vif-plugged:2799e185-c707-4732-964a-3994e3877409 for instance c1a558f2-6710-4ab0-92fc-03076dcb4408 on n-h1-853682-5 Oct 18 15:35:37.112346 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-e167c3c8-a768-4bec-a97b-288ee8d3ca29 req-24eacf39-c743-4da5-b195-a90fa5815495 service nova] Creating event network-vif-plugged:3937e97b-486e-43be-8bfa-74b0972bc6ce for instance 4df91fe0-82c3-404b-ac29-8da7bdb0ef66 on n-h2-853682-5 Oct 18 15:35:37.126134 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-e167c3c8-a768-4bec-a97b-288ee8d3ca29 req-24eacf39-c743-4da5-b195-a90fa5815495 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.077474 Oct 18 15:35:37.127358 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1280/2449] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:35:37.159246 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-efea7d3f-2972-4087-a486-ebbfe4c7b0bc tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:37.160026 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-efea7d3f-2972-4087-a486-ebbfe4c7b0bc tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] [instance: 4df91fe0-82c3-404b-ac29-8da7bdb0ef66] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:37.174242 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-efea7d3f-2972-4087-a486-ebbfe4c7b0bc tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:37.174767 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-efea7d3f-2972-4087-a486-ebbfe4c7b0bc tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:37.175221 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-efea7d3f-2972-4087-a486-ebbfe4c7b0bc tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:37.175971 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-efea7d3f-2972-4087-a486-ebbfe4c7b0bc tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:37.176434 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-efea7d3f-2972-4087-a486-ebbfe4c7b0bc tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:37.197521 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-efea7d3f-2972-4087-a486-ebbfe4c7b0bc tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:37.940594 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d3ee2ff8-74a1-44da-9119-5fcb20ade26e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:37.949188 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d3ee2ff8-74a1-44da-9119-5fcb20ade26e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca" status: 200 len: 1475 microversion: 2.1 time: 1.267373 Oct 18 15:35:37.949782 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1170/2450] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:36 2022] GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca => generated 1475 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:37.961778 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6be119a6-ef68-46ff-8516-0dd6006c5dfe tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:37.962991 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6be119a6-ef68-46ff-8516-0dd6006c5dfe tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] [instance: 873a3005-fbac-40d0-8919-f138a619f2fa] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:37.980744 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6be119a6-ef68-46ff-8516-0dd6006c5dfe tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:37.981280 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6be119a6-ef68-46ff-8516-0dd6006c5dfe tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:37.981714 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6be119a6-ef68-46ff-8516-0dd6006c5dfe tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:37.982499 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6be119a6-ef68-46ff-8516-0dd6006c5dfe tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:37.982967 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6be119a6-ef68-46ff-8516-0dd6006c5dfe tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:37.983413 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6be119a6-ef68-46ff-8516-0dd6006c5dfe tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:38.202480 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-efea7d3f-2972-4087-a486-ebbfe4c7b0bc tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee820071e6e4d2f9c3daa61f23c58e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc684ec2e4d4a6283dbb5566ccb8d60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:38.221391 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-efea7d3f-2972-4087-a486-ebbfe4c7b0bc tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] 10.222.0.60 "GET /compute/v2.1/servers/4df91fe0-82c3-404b-ac29-8da7bdb0ef66" status: 200 len: 1322 microversion: 2.1 time: 1.067517 Oct 18 15:35:38.236849 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1281/2451] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:37 2022] GET /compute/v2.1/servers/4df91fe0-82c3-404b-ac29-8da7bdb0ef66 => generated 1322 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:35:38.236849 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e1ae180c-d576-4569-b6e3-1928ab49fff5 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:38.237779 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e1ae180c-d576-4569-b6e3-1928ab49fff5 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 89919fa6-1fd6-42d0-ab81-d0cdebc3960c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:38.251774 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e1ae180c-d576-4569-b6e3-1928ab49fff5 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:38.253607 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e1ae180c-d576-4569-b6e3-1928ab49fff5 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:38.256920 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e1ae180c-d576-4569-b6e3-1928ab49fff5 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:38.257816 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e1ae180c-d576-4569-b6e3-1928ab49fff5 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:38.258465 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e1ae180c-d576-4569-b6e3-1928ab49fff5 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:38.264691 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e1ae180c-d576-4569-b6e3-1928ab49fff5 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:38.419575 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e1ae180c-d576-4569-b6e3-1928ab49fff5 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:38.422383 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6be119a6-ef68-46ff-8516-0dd6006c5dfe tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a7ce3bb784a79b3ac336743b9ae84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a52e3135e52493b8ccb2d7342418591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:38.431641 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6be119a6-ef68-46ff-8516-0dd6006c5dfe tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "GET /compute/v2.1/servers/873a3005-fbac-40d0-8919-f138a619f2fa" status: 200 len: 1315 microversion: 2.1 time: 0.473065 Oct 18 15:35:38.433712 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e1ae180c-d576-4569-b6e3-1928ab49fff5 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/89919fa6-1fd6-42d0-ab81-d0cdebc3960c" status: 200 len: 1264 microversion: 2.1 time: 0.205801 Oct 18 15:35:38.434580 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1171/2452] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:37 2022] GET /compute/v2.1/servers/873a3005-fbac-40d0-8919-f138a619f2fa => generated 1315 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:38.448159 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-809d783e-e88c-4517-9c18-585ec4fb300f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:38.451946 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1282/2453] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:38 2022] GET /compute/v2.1/servers/89919fa6-1fd6-42d0-ab81-d0cdebc3960c => generated 1264 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:38.452229 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-809d783e-e88c-4517-9c18-585ec4fb300f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: b7ebc01d-7008-4ca7-a82b-094962216ceb] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:38.465487 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-809d783e-e88c-4517-9c18-585ec4fb300f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:38.469432 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-809d783e-e88c-4517-9c18-585ec4fb300f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:38.471173 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-809d783e-e88c-4517-9c18-585ec4fb300f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:38.473876 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-809d783e-e88c-4517-9c18-585ec4fb300f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:38.475831 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-809d783e-e88c-4517-9c18-585ec4fb300f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:38.478865 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-809d783e-e88c-4517-9c18-585ec4fb300f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:38.655596 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4f9f3d97-d11e-4c6a-9cfe-d9f42d34884a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1744854024", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ccd513cb-fa43-49a2-9672-944a34d86625"}], "security_groups": [{"name": "tempest-securitygroup--249211992"}], "key_name": "tempest-keypair-1774961777", "user_data": "}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:35:38.864966 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-809d783e-e88c-4517-9c18-585ec4fb300f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:38.873459 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-809d783e-e88c-4517-9c18-585ec4fb300f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/b7ebc01d-7008-4ca7-a82b-094962216ceb" status: 200 len: 1315 microversion: 2.1 time: 0.437022 Oct 18 15:35:38.874047 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1172/2454] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:38 2022] GET /compute/v2.1/servers/b7ebc01d-7008-4ca7-a82b-094962216ceb => generated 1315 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:38.938970 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-4f9f3d97-d11e-4c6a-9cfe-d9f42d34884a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] validate_networks() for [('ccd513cb-fa43-49a2-9672-944a34d86625', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:35:38.977416 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-33697a1f-ba1b-4768-b798-2dc763f36846 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:38.978923 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-33697a1f-ba1b-4768-b798-2dc763f36846 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 0dbbde45-f255-4ac5-8887-1ce8de673fca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:38.988722 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33697a1f-ba1b-4768-b798-2dc763f36846 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:38.989799 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33697a1f-ba1b-4768-b798-2dc763f36846 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:38.991128 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33697a1f-ba1b-4768-b798-2dc763f36846 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:38.992856 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33697a1f-ba1b-4768-b798-2dc763f36846 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:38.996434 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33697a1f-ba1b-4768-b798-2dc763f36846 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:38.997553 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33697a1f-ba1b-4768-b798-2dc763f36846 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:39.489140 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-33697a1f-ba1b-4768-b798-2dc763f36846 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:39.506208 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-33697a1f-ba1b-4768-b798-2dc763f36846 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca" status: 200 len: 1474 microversion: 2.1 time: 0.530245 Oct 18 15:35:39.507815 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1173/2455] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:38 2022] GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca => generated 1474 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:39.531836 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-918dfa95-3c18-4ec5-a09e-0aec5c98d6a5 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-787831030", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "d5512764-2785-469e-9ecd-d082f80b703b"}], "security_groups": [{"name": "tempest-securitygroup--272134194"}], "key_name": "tempest-keypair-116914274", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:35:39.901803 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-918dfa95-3c18-4ec5-a09e-0aec5c98d6a5 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] validate_networks() for [('d5512764-2785-469e-9ecd-d082f80b703b', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:35:40.031423 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-4f9f3d97-d11e-4c6a-9cfe-d9f42d34884a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:35:40.033143 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-4f9f3d97-d11e-4c6a-9cfe-d9f42d34884a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:35:40.034251 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-4f9f3d97-d11e-4c6a-9cfe-d9f42d34884a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:35:40.035280 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-4f9f3d97-d11e-4c6a-9cfe-d9f42d34884a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:35:40.035861 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-4f9f3d97-d11e-4c6a-9cfe-d9f42d34884a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:35:40.049436 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4f9f3d97-d11e-4c6a-9cfe-d9f42d34884a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:40.050315 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4f9f3d97-d11e-4c6a-9cfe-d9f42d34884a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:40.050939 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4f9f3d97-d11e-4c6a-9cfe-d9f42d34884a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:40.051963 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4f9f3d97-d11e-4c6a-9cfe-d9f42d34884a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:40.053496 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4f9f3d97-d11e-4c6a-9cfe-d9f42d34884a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:40.054259 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4f9f3d97-d11e-4c6a-9cfe-d9f42d34884a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:40.077423 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-4f9f3d97-d11e-4c6a-9cfe-d9f42d34884a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Getting quotas for project a5b55fd6668b481b8c578983dc655785. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:35:40.084693 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-4f9f3d97-d11e-4c6a-9cfe-d9f42d34884a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Getting quotas for user efec3b4b5b1c46bd9d2c0efa68f86979 and project a5b55fd6668b481b8c578983dc655785. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:35:40.128229 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4f9f3d97-d11e-4c6a-9cfe-d9f42d34884a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:35:40.135152 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4f9f3d97-d11e-4c6a-9cfe-d9f42d34884a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 511cbc18-aef9-4202-9616-decd6651e931] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:35:40.156877 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:35:40.223420 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4f9f3d97-d11e-4c6a-9cfe-d9f42d34884a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.580129 Oct 18 15:35:40.224764 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1283/2456] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:35:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 1583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 15:35:40.230428 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a9cef132-6b8a-47ca-9342-9648c54f5d6a tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:40.233454 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a9cef132-6b8a-47ca-9342-9648c54f5d6a tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] [instance: 4df91fe0-82c3-404b-ac29-8da7bdb0ef66] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:40.244240 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9cef132-6b8a-47ca-9342-9648c54f5d6a tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:40.249823 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9cef132-6b8a-47ca-9342-9648c54f5d6a tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:40.250516 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9cef132-6b8a-47ca-9342-9648c54f5d6a tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:40.251281 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9cef132-6b8a-47ca-9342-9648c54f5d6a tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:40.251896 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9cef132-6b8a-47ca-9342-9648c54f5d6a tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:40.252439 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9cef132-6b8a-47ca-9342-9648c54f5d6a tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:40.611793 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a9cef132-6b8a-47ca-9342-9648c54f5d6a tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee820071e6e4d2f9c3daa61f23c58e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc684ec2e4d4a6283dbb5566ccb8d60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:40.648129 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a9cef132-6b8a-47ca-9342-9648c54f5d6a tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] 10.222.0.60 "GET /compute/v2.1/servers/4df91fe0-82c3-404b-ac29-8da7bdb0ef66" status: 200 len: 1516 microversion: 2.1 time: 0.421993 Oct 18 15:35:40.657676 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1284/2457] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:40 2022] GET /compute/v2.1/servers/4df91fe0-82c3-404b-ac29-8da7bdb0ef66 => generated 1516 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:40.668217 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-734b9c0e-e9ee-4ab1-9ba6-4c5dcdad55c3 req-303a8314-dfe1-484e-9e49-313433ae2876 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "873a3005-fbac-40d0-8919-f138a619f2fa", "tag": "bb5c9526-9ebb-4b59-8df6-40f1393cf4b0"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:35:40.695379 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-734b9c0e-e9ee-4ab1-9ba6-4c5dcdad55c3 req-303a8314-dfe1-484e-9e49-313433ae2876 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:40.695880 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-734b9c0e-e9ee-4ab1-9ba6-4c5dcdad55c3 req-303a8314-dfe1-484e-9e49-313433ae2876 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:40.697974 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-734b9c0e-e9ee-4ab1-9ba6-4c5dcdad55c3 req-303a8314-dfe1-484e-9e49-313433ae2876 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:40.727098 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-734b9c0e-e9ee-4ab1-9ba6-4c5dcdad55c3 req-303a8314-dfe1-484e-9e49-313433ae2876 service nova] Creating event network-changed:bb5c9526-9ebb-4b59-8df6-40f1393cf4b0 for instance 873a3005-fbac-40d0-8919-f138a619f2fa on n-h1-853682-5 Oct 18 15:35:40.736754 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-734b9c0e-e9ee-4ab1-9ba6-4c5dcdad55c3 req-303a8314-dfe1-484e-9e49-313433ae2876 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077017 Oct 18 15:35:40.741091 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1285/2458] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:35:40.754467 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-aa73d2c9-9987-49c8-811a-6b3b9e9d8b6c tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:40.755682 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-aa73d2c9-9987-49c8-811a-6b3b9e9d8b6c tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] [instance: 873a3005-fbac-40d0-8919-f138a619f2fa] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:40.764177 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aa73d2c9-9987-49c8-811a-6b3b9e9d8b6c tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:40.765065 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aa73d2c9-9987-49c8-811a-6b3b9e9d8b6c tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:40.766096 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aa73d2c9-9987-49c8-811a-6b3b9e9d8b6c tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:40.767313 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aa73d2c9-9987-49c8-811a-6b3b9e9d8b6c tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:40.768099 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aa73d2c9-9987-49c8-811a-6b3b9e9d8b6c tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:40.768684 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aa73d2c9-9987-49c8-811a-6b3b9e9d8b6c tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:40.915154 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-918dfa95-3c18-4ec5-a09e-0aec5c98d6a5 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Getting quotas for project 88812dd7c80d47bba192382fccc31e64. Resources: dict_keys(['metadata_items']) {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:35:40.924372 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-918dfa95-3c18-4ec5-a09e-0aec5c98d6a5 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Getting quotas for user 01bc878a0901409684ea58261475b1bc and project 88812dd7c80d47bba192382fccc31e64. Resources: dict_keys(['metadata_items']) {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:35:40.942750 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-918dfa95-3c18-4ec5-a09e-0aec5c98d6a5 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:35:40.943515 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-918dfa95-3c18-4ec5-a09e-0aec5c98d6a5 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:35:40.944257 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-918dfa95-3c18-4ec5-a09e-0aec5c98d6a5 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:35:40.944912 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-918dfa95-3c18-4ec5-a09e-0aec5c98d6a5 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:35:40.945685 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-918dfa95-3c18-4ec5-a09e-0aec5c98d6a5 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:35:40.957418 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-918dfa95-3c18-4ec5-a09e-0aec5c98d6a5 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:40.958605 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-918dfa95-3c18-4ec5-a09e-0aec5c98d6a5 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:40.959306 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-918dfa95-3c18-4ec5-a09e-0aec5c98d6a5 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:40.960526 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-918dfa95-3c18-4ec5-a09e-0aec5c98d6a5 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:40.961400 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-918dfa95-3c18-4ec5-a09e-0aec5c98d6a5 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:40.963819 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-918dfa95-3c18-4ec5-a09e-0aec5c98d6a5 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:41.012522 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-918dfa95-3c18-4ec5-a09e-0aec5c98d6a5 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Getting quotas for project 88812dd7c80d47bba192382fccc31e64. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:35:41.025439 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-918dfa95-3c18-4ec5-a09e-0aec5c98d6a5 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Getting quotas for user 01bc878a0901409684ea58261475b1bc and project 88812dd7c80d47bba192382fccc31e64. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:35:41.061783 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-918dfa95-3c18-4ec5-a09e-0aec5c98d6a5 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:35:41.066793 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-918dfa95-3c18-4ec5-a09e-0aec5c98d6a5 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] [instance: 63a69f32-61bc-41d2-a358-636ae638f654] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:35:41.076114 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-aa73d2c9-9987-49c8-811a-6b3b9e9d8b6c tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a7ce3bb784a79b3ac336743b9ae84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a52e3135e52493b8ccb2d7342418591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:41.084312 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-aa73d2c9-9987-49c8-811a-6b3b9e9d8b6c tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "GET /compute/v2.1/servers/873a3005-fbac-40d0-8919-f138a619f2fa" status: 200 len: 1315 microversion: 2.1 time: 0.340867 Oct 18 15:35:41.099694 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1286/2459] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:40 2022] GET /compute/v2.1/servers/873a3005-fbac-40d0-8919-f138a619f2fa => generated 1315 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:41.106006 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ad260a63-ebfc-4b70-90bf-5fbe3d59bb9b tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:41.106875 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ad260a63-ebfc-4b70-90bf-5fbe3d59bb9b tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 89919fa6-1fd6-42d0-ab81-d0cdebc3960c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:41.115143 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ad260a63-ebfc-4b70-90bf-5fbe3d59bb9b tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:41.115900 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ad260a63-ebfc-4b70-90bf-5fbe3d59bb9b tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:41.116385 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ad260a63-ebfc-4b70-90bf-5fbe3d59bb9b tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:41.117138 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ad260a63-ebfc-4b70-90bf-5fbe3d59bb9b tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:41.117616 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ad260a63-ebfc-4b70-90bf-5fbe3d59bb9b tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:41.120217 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ad260a63-ebfc-4b70-90bf-5fbe3d59bb9b tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:41.138591 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-918dfa95-3c18-4ec5-a09e-0aec5c98d6a5 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.614373 Oct 18 15:35:41.147168 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1174/2460] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:35:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 1635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:35:41.154822 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eccdd160-3a11-42b1-baec-5abcfea17382 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:41.155645 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-eccdd160-3a11-42b1-baec-5abcfea17382 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: b7ebc01d-7008-4ca7-a82b-094962216ceb] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:41.171323 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eccdd160-3a11-42b1-baec-5abcfea17382 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:41.172133 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eccdd160-3a11-42b1-baec-5abcfea17382 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:41.173247 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eccdd160-3a11-42b1-baec-5abcfea17382 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:41.174271 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eccdd160-3a11-42b1-baec-5abcfea17382 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:41.174737 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eccdd160-3a11-42b1-baec-5abcfea17382 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:41.175161 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eccdd160-3a11-42b1-baec-5abcfea17382 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:41.779876 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-eccdd160-3a11-42b1-baec-5abcfea17382 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:41.787644 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-eccdd160-3a11-42b1-baec-5abcfea17382 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/b7ebc01d-7008-4ca7-a82b-094962216ceb" status: 200 len: 1315 microversion: 2.1 time: 0.639300 Oct 18 15:35:41.788789 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1175/2461] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:41 2022] GET /compute/v2.1/servers/b7ebc01d-7008-4ca7-a82b-094962216ceb => generated 1315 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:41.794665 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ad260a63-ebfc-4b70-90bf-5fbe3d59bb9b tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:41.800239 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-07e1be43-53f7-489e-a369-fab14ba65fb3 req-6006cbc0-0d56-4248-9d7d-ab63c8bffd07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dbbde45-f255-4ac5-8887-1ce8de673fca", "name": "network-vif-unplugged", "status": "completed", "tag": "0ad973d8-f2bb-4e15-a985-502b69cec140"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:35:41.808486 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ad260a63-ebfc-4b70-90bf-5fbe3d59bb9b tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/89919fa6-1fd6-42d0-ab81-d0cdebc3960c" status: 200 len: 1312 microversion: 2.1 time: 0.707425 Oct 18 15:35:41.809129 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1287/2462] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:41 2022] GET /compute/v2.1/servers/89919fa6-1fd6-42d0-ab81-d0cdebc3960c => generated 1312 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:41.816188 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-de2f0276-f00f-4a58-bfc1-f74885936570 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:41.825497 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-de2f0276-f00f-4a58-bfc1-f74885936570 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 511cbc18-aef9-4202-9616-decd6651e931] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:41.826913 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-07e1be43-53f7-489e-a369-fab14ba65fb3 req-6006cbc0-0d56-4248-9d7d-ab63c8bffd07 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:41.827630 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-07e1be43-53f7-489e-a369-fab14ba65fb3 req-6006cbc0-0d56-4248-9d7d-ab63c8bffd07 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:41.828333 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-07e1be43-53f7-489e-a369-fab14ba65fb3 req-6006cbc0-0d56-4248-9d7d-ab63c8bffd07 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:41.832856 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de2f0276-f00f-4a58-bfc1-f74885936570 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:41.833563 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de2f0276-f00f-4a58-bfc1-f74885936570 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:41.834195 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de2f0276-f00f-4a58-bfc1-f74885936570 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:41.834889 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de2f0276-f00f-4a58-bfc1-f74885936570 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:41.835500 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de2f0276-f00f-4a58-bfc1-f74885936570 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:41.835919 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de2f0276-f00f-4a58-bfc1-f74885936570 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:41.845286 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-07e1be43-53f7-489e-a369-fab14ba65fb3 req-6006cbc0-0d56-4248-9d7d-ab63c8bffd07 service nova] Creating event network-vif-unplugged:0ad973d8-f2bb-4e15-a985-502b69cec140 for instance 0dbbde45-f255-4ac5-8887-1ce8de673fca on n-h1-853682-5 Oct 18 15:35:41.854810 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [req-07e1be43-53f7-489e-a369-fab14ba65fb3 req-6006cbc0-0d56-4248-9d7d-ab63c8bffd07 service nova] Instance 0dbbde45-f255-4ac5-8887-1ce8de673fca is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853682-5', 'n-h1-853682-5'} {{(pid=120406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 18 15:35:41.867357 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-07e1be43-53f7-489e-a369-fab14ba65fb3 req-6006cbc0-0d56-4248-9d7d-ab63c8bffd07 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077141 Oct 18 15:35:41.868405 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1176/2463] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:35:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:35:41.873873 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9b39285d-0795-4fd0-9fd0-e39e66d4808d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:41.874766 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9b39285d-0795-4fd0-9fd0-e39e66d4808d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 0dbbde45-f255-4ac5-8887-1ce8de673fca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:41.881612 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9b39285d-0795-4fd0-9fd0-e39e66d4808d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:41.882100 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9b39285d-0795-4fd0-9fd0-e39e66d4808d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:41.882715 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9b39285d-0795-4fd0-9fd0-e39e66d4808d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:41.883423 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9b39285d-0795-4fd0-9fd0-e39e66d4808d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:41.884072 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9b39285d-0795-4fd0-9fd0-e39e66d4808d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:41.884500 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9b39285d-0795-4fd0-9fd0-e39e66d4808d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:41.930248 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-de2f0276-f00f-4a58-bfc1-f74885936570 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:41.938721 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-de2f0276-f00f-4a58-bfc1-f74885936570 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/511cbc18-aef9-4202-9616-decd6651e931" status: 200 len: 1294 microversion: 2.1 time: 0.128372 Oct 18 15:35:41.949377 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1288/2464] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:41 2022] GET /compute/v2.1/servers/511cbc18-aef9-4202-9616-decd6651e931 => generated 1294 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:41.955389 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-06541663-8ac0-46d9-b2fc-22f9d0bb7f98 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:41.956521 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-06541663-8ac0-46d9-b2fc-22f9d0bb7f98 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] [instance: c1a558f2-6710-4ab0-92fc-03076dcb4408] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:41.979753 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-06541663-8ac0-46d9-b2fc-22f9d0bb7f98 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:41.980692 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-06541663-8ac0-46d9-b2fc-22f9d0bb7f98 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:41.981521 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-06541663-8ac0-46d9-b2fc-22f9d0bb7f98 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:41.982419 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-06541663-8ac0-46d9-b2fc-22f9d0bb7f98 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:41.982887 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-06541663-8ac0-46d9-b2fc-22f9d0bb7f98 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:41.983320 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-06541663-8ac0-46d9-b2fc-22f9d0bb7f98 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:42.134998 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9b39285d-0795-4fd0-9fd0-e39e66d4808d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:42.147014 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9b39285d-0795-4fd0-9fd0-e39e66d4808d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca" status: 200 len: 1474 microversion: 2.1 time: 0.277187 Oct 18 15:35:42.147535 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1177/2465] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:41 2022] GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca => generated 1474 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:42.154627 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-899241e8-4943-44d0-95ff-849c0cfd84f1 req-cc018078-1edd-445d-8836-8d26b598df31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7ebc01d-7008-4ca7-a82b-094962216ceb", "name": "network-vif-plugged", "status": "completed", "tag": "fd8352a3-56cf-42b8-84f4-d06c63e7c5ad"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:35:42.183747 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-899241e8-4943-44d0-95ff-849c0cfd84f1 req-cc018078-1edd-445d-8836-8d26b598df31 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:42.184227 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-899241e8-4943-44d0-95ff-849c0cfd84f1 req-cc018078-1edd-445d-8836-8d26b598df31 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:42.184656 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-899241e8-4943-44d0-95ff-849c0cfd84f1 req-cc018078-1edd-445d-8836-8d26b598df31 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:42.214387 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-899241e8-4943-44d0-95ff-849c0cfd84f1 req-cc018078-1edd-445d-8836-8d26b598df31 service nova] Creating event network-vif-plugged:fd8352a3-56cf-42b8-84f4-d06c63e7c5ad for instance b7ebc01d-7008-4ca7-a82b-094962216ceb on n-h2-853682-5 Oct 18 15:35:42.241771 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-899241e8-4943-44d0-95ff-849c0cfd84f1 req-cc018078-1edd-445d-8836-8d26b598df31 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078637 Oct 18 15:35:42.242953 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1178/2466] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:35:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:35:42.260262 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3342a739-9bb2-4b20-a48c-da85fdaf7372 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:42.264940 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3342a739-9bb2-4b20-a48c-da85fdaf7372 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] [instance: 63a69f32-61bc-41d2-a358-636ae638f654] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:42.278634 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3342a739-9bb2-4b20-a48c-da85fdaf7372 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:42.279310 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3342a739-9bb2-4b20-a48c-da85fdaf7372 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:42.279891 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3342a739-9bb2-4b20-a48c-da85fdaf7372 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:42.281696 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3342a739-9bb2-4b20-a48c-da85fdaf7372 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:42.283591 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3342a739-9bb2-4b20-a48c-da85fdaf7372 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:42.284278 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3342a739-9bb2-4b20-a48c-da85fdaf7372 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:42.288883 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-06541663-8ac0-46d9-b2fc-22f9d0bb7f98 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee820071e6e4d2f9c3daa61f23c58e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc684ec2e4d4a6283dbb5566ccb8d60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:42.300713 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-06541663-8ac0-46d9-b2fc-22f9d0bb7f98 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] 10.222.0.60 "GET /compute/v2.1/servers/c1a558f2-6710-4ab0-92fc-03076dcb4408" status: 200 len: 1516 microversion: 2.1 time: 0.349883 Oct 18 15:35:42.302490 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1289/2467] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:41 2022] GET /compute/v2.1/servers/c1a558f2-6710-4ab0-92fc-03076dcb4408 => generated 1516 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:42.325621 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4173ba61-8d56-47f0-bbcd-c0f2e40f019b tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:42.332441 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4173ba61-8d56-47f0-bbcd-c0f2e40f019b tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] [instance: 873a3005-fbac-40d0-8919-f138a619f2fa] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:42.345899 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4173ba61-8d56-47f0-bbcd-c0f2e40f019b tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:42.346848 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4173ba61-8d56-47f0-bbcd-c0f2e40f019b tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:42.348907 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4173ba61-8d56-47f0-bbcd-c0f2e40f019b tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:42.350635 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4173ba61-8d56-47f0-bbcd-c0f2e40f019b tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:42.351335 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4173ba61-8d56-47f0-bbcd-c0f2e40f019b tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:42.351978 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4173ba61-8d56-47f0-bbcd-c0f2e40f019b tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:42.415012 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3342a739-9bb2-4b20-a48c-da85fdaf7372 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bc878a0901409684ea58261475b1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88812dd7c80d47bba192382fccc31e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:42.424589 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3342a739-9bb2-4b20-a48c-da85fdaf7372 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] 10.222.0.60 "GET /compute/v2.1/servers/63a69f32-61bc-41d2-a358-636ae638f654" status: 200 len: 1320 microversion: 2.1 time: 0.176888 Oct 18 15:35:42.425385 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1179/2468] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:42 2022] GET /compute/v2.1/servers/63a69f32-61bc-41d2-a358-636ae638f654 => generated 1320 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:42.430844 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d386f260-2a46-4150-954d-d67cbf0a6e8d tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:42.432306 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d386f260-2a46-4150-954d-d67cbf0a6e8d tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] [instance: 98c6abbf-732b-4723-89c8-cbb32207414f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:42.439490 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d386f260-2a46-4150-954d-d67cbf0a6e8d tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:42.440200 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d386f260-2a46-4150-954d-d67cbf0a6e8d tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:42.440934 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d386f260-2a46-4150-954d-d67cbf0a6e8d tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:42.442476 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d386f260-2a46-4150-954d-d67cbf0a6e8d tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:42.443349 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d386f260-2a46-4150-954d-d67cbf0a6e8d tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:42.443987 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d386f260-2a46-4150-954d-d67cbf0a6e8d tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:42.672720 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4173ba61-8d56-47f0-bbcd-c0f2e40f019b tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a7ce3bb784a79b3ac336743b9ae84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a52e3135e52493b8ccb2d7342418591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:42.676726 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=100 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:35:42.682383 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4173ba61-8d56-47f0-bbcd-c0f2e40f019b tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "GET /compute/v2.1/servers/873a3005-fbac-40d0-8919-f138a619f2fa" status: 200 len: 1315 microversion: 2.1 time: 0.362071 Oct 18 15:35:42.683612 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1290/2469] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:42 2022] GET /compute/v2.1/servers/873a3005-fbac-40d0-8919-f138a619f2fa => generated 1315 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:42.698570 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d386f260-2a46-4150-954d-d67cbf0a6e8d tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee820071e6e4d2f9c3daa61f23c58e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc684ec2e4d4a6283dbb5566ccb8d60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:42.707002 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d386f260-2a46-4150-954d-d67cbf0a6e8d tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] 10.222.0.60 "GET /compute/v2.1/servers/98c6abbf-732b-4723-89c8-cbb32207414f" status: 200 len: 1515 microversion: 2.1 time: 0.280409 Oct 18 15:35:42.707603 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1180/2470] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:42 2022] GET /compute/v2.1/servers/98c6abbf-732b-4723-89c8-cbb32207414f => generated 1515 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:42.729821 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-27902e0d-d22a-41e7-8d81-e30b5b7819bd tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:42.730446 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-27902e0d-d22a-41e7-8d81-e30b5b7819bd tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] [instance: 98c6abbf-732b-4723-89c8-cbb32207414f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:42.737539 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-27902e0d-d22a-41e7-8d81-e30b5b7819bd tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:42.738275 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-27902e0d-d22a-41e7-8d81-e30b5b7819bd tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:42.738711 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-27902e0d-d22a-41e7-8d81-e30b5b7819bd tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:42.739413 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-27902e0d-d22a-41e7-8d81-e30b5b7819bd tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:42.740017 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-27902e0d-d22a-41e7-8d81-e30b5b7819bd tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:42.740683 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-27902e0d-d22a-41e7-8d81-e30b5b7819bd tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:42.775862 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-27902e0d-d22a-41e7-8d81-e30b5b7819bd tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] [instance: 98c6abbf-732b-4723-89c8-cbb32207414f] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:35:42.814756 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7315e0cf-6c72-4458-9ef5-6cd9498ccdbf tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:42.815470 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7315e0cf-6c72-4458-9ef5-6cd9498ccdbf tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: b7ebc01d-7008-4ca7-a82b-094962216ceb] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:42.836298 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7315e0cf-6c72-4458-9ef5-6cd9498ccdbf tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:42.843282 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7315e0cf-6c72-4458-9ef5-6cd9498ccdbf tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:42.843740 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7315e0cf-6c72-4458-9ef5-6cd9498ccdbf tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:42.844492 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7315e0cf-6c72-4458-9ef5-6cd9498ccdbf tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:42.844998 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7315e0cf-6c72-4458-9ef5-6cd9498ccdbf tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:42.845425 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7315e0cf-6c72-4458-9ef5-6cd9498ccdbf tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:42.951511 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-27902e0d-d22a-41e7-8d81-e30b5b7819bd tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] 10.222.0.60 "DELETE /compute/v2.1/servers/98c6abbf-732b-4723-89c8-cbb32207414f" status: 204 len: 0 microversion: 2.1 time: 0.225140 Oct 18 15:35:42.955633 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1291/2471] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:35:42 2022] DELETE /compute/v2.1/servers/98c6abbf-732b-4723-89c8-cbb32207414f => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:35:42.964917 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-68885881-2fe1-4002-964d-67d6861a095d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:42.965643 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-68885881-2fe1-4002-964d-67d6861a095d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 89919fa6-1fd6-42d0-ab81-d0cdebc3960c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:42.982348 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-68885881-2fe1-4002-964d-67d6861a095d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:42.983198 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-68885881-2fe1-4002-964d-67d6861a095d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:42.983826 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-68885881-2fe1-4002-964d-67d6861a095d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:42.984744 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-68885881-2fe1-4002-964d-67d6861a095d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:42.985817 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-68885881-2fe1-4002-964d-67d6861a095d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:42.986491 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-68885881-2fe1-4002-964d-67d6861a095d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:43.256154 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7315e0cf-6c72-4458-9ef5-6cd9498ccdbf tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:43.269056 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7315e0cf-6c72-4458-9ef5-6cd9498ccdbf tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/b7ebc01d-7008-4ca7-a82b-094962216ceb" status: 200 len: 1315 microversion: 2.1 time: 0.459821 Oct 18 15:35:43.270025 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1181/2472] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:42 2022] GET /compute/v2.1/servers/b7ebc01d-7008-4ca7-a82b-094962216ceb => generated 1315 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:35:43.276700 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-abfc275f-bf1a-413a-8a76-21d39ab2cedc tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:43.278436 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-abfc275f-bf1a-413a-8a76-21d39ab2cedc tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] [instance: 98c6abbf-732b-4723-89c8-cbb32207414f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:43.288762 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-abfc275f-bf1a-413a-8a76-21d39ab2cedc tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:43.289399 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-abfc275f-bf1a-413a-8a76-21d39ab2cedc tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:43.289847 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-abfc275f-bf1a-413a-8a76-21d39ab2cedc tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:43.290645 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-abfc275f-bf1a-413a-8a76-21d39ab2cedc tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:43.291107 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-abfc275f-bf1a-413a-8a76-21d39ab2cedc tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:43.291567 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-abfc275f-bf1a-413a-8a76-21d39ab2cedc tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:43.295751 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-68885881-2fe1-4002-964d-67d6861a095d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:43.307918 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-68885881-2fe1-4002-964d-67d6861a095d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/89919fa6-1fd6-42d0-ab81-d0cdebc3960c" status: 200 len: 1312 microversion: 2.1 time: 0.350828 Oct 18 15:35:43.309400 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1292/2473] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:42 2022] GET /compute/v2.1/servers/89919fa6-1fd6-42d0-ab81-d0cdebc3960c => generated 1312 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:43.314739 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ba68350c-ea82-40cc-b91a-86f02c709b2d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:43.315440 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ba68350c-ea82-40cc-b91a-86f02c709b2d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 511cbc18-aef9-4202-9616-decd6651e931] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:43.341785 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba68350c-ea82-40cc-b91a-86f02c709b2d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:43.343303 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba68350c-ea82-40cc-b91a-86f02c709b2d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:43.343769 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba68350c-ea82-40cc-b91a-86f02c709b2d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:43.344514 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba68350c-ea82-40cc-b91a-86f02c709b2d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:43.345009 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba68350c-ea82-40cc-b91a-86f02c709b2d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:43.346681 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba68350c-ea82-40cc-b91a-86f02c709b2d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:43.565289 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ba68350c-ea82-40cc-b91a-86f02c709b2d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:43.576553 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ba68350c-ea82-40cc-b91a-86f02c709b2d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/511cbc18-aef9-4202-9616-decd6651e931" status: 200 len: 1300 microversion: 2.1 time: 0.265944 Oct 18 15:35:43.592974 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1293/2474] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:43 2022] GET /compute/v2.1/servers/511cbc18-aef9-4202-9616-decd6651e931 => generated 1300 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:43.601805 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-57977ffc-3eaf-40aa-acf2-e19af1de11bb tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:43.602488 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-57977ffc-3eaf-40aa-acf2-e19af1de11bb tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 0dbbde45-f255-4ac5-8887-1ce8de673fca] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:43.609095 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57977ffc-3eaf-40aa-acf2-e19af1de11bb tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:43.609378 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57977ffc-3eaf-40aa-acf2-e19af1de11bb tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:43.609818 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57977ffc-3eaf-40aa-acf2-e19af1de11bb tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:43.610522 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57977ffc-3eaf-40aa-acf2-e19af1de11bb tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:43.617568 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57977ffc-3eaf-40aa-acf2-e19af1de11bb tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:43.618778 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57977ffc-3eaf-40aa-acf2-e19af1de11bb tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:43.889922 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-abfc275f-bf1a-413a-8a76-21d39ab2cedc tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee820071e6e4d2f9c3daa61f23c58e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc684ec2e4d4a6283dbb5566ccb8d60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:43.898160 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-abfc275f-bf1a-413a-8a76-21d39ab2cedc tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] 10.222.0.60 "GET /compute/v2.1/servers/98c6abbf-732b-4723-89c8-cbb32207414f" status: 200 len: 1521 microversion: 2.1 time: 0.626870 Oct 18 15:35:43.917104 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1182/2475] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:43 2022] GET /compute/v2.1/servers/98c6abbf-732b-4723-89c8-cbb32207414f => generated 1521 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:43.927180 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5d27870c-7782-4ab8-b697-d21b467aa1d8 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:43.930109 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5d27870c-7782-4ab8-b697-d21b467aa1d8 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] [instance: 63a69f32-61bc-41d2-a358-636ae638f654] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:43.945514 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d27870c-7782-4ab8-b697-d21b467aa1d8 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:43.946317 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d27870c-7782-4ab8-b697-d21b467aa1d8 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:43.946919 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d27870c-7782-4ab8-b697-d21b467aa1d8 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:43.948247 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d27870c-7782-4ab8-b697-d21b467aa1d8 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:43.948893 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d27870c-7782-4ab8-b697-d21b467aa1d8 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:43.949483 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d27870c-7782-4ab8-b697-d21b467aa1d8 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:44.041527 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-57977ffc-3eaf-40aa-acf2-e19af1de11bb tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:44.055374 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-57977ffc-3eaf-40aa-acf2-e19af1de11bb tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca" status: 200 len: 1474 microversion: 2.1 time: 0.461246 Oct 18 15:35:44.069189 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1294/2476] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:43 2022] GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca => generated 1474 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:44.075453 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-dc2fddf5-6b6a-49cb-a320-82cc11cd0b87 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:44.076269 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-dc2fddf5-6b6a-49cb-a320-82cc11cd0b87 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] [instance: 873a3005-fbac-40d0-8919-f138a619f2fa] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:44.084010 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dc2fddf5-6b6a-49cb-a320-82cc11cd0b87 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:44.084544 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dc2fddf5-6b6a-49cb-a320-82cc11cd0b87 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:44.085139 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dc2fddf5-6b6a-49cb-a320-82cc11cd0b87 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:44.086348 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dc2fddf5-6b6a-49cb-a320-82cc11cd0b87 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:44.087342 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dc2fddf5-6b6a-49cb-a320-82cc11cd0b87 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:44.087946 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dc2fddf5-6b6a-49cb-a320-82cc11cd0b87 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:44.111639 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5d27870c-7782-4ab8-b697-d21b467aa1d8 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bc878a0901409684ea58261475b1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88812dd7c80d47bba192382fccc31e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:44.123087 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5d27870c-7782-4ab8-b697-d21b467aa1d8 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] 10.222.0.60 "GET /compute/v2.1/servers/63a69f32-61bc-41d2-a358-636ae638f654" status: 200 len: 1338 microversion: 2.1 time: 0.204375 Oct 18 15:35:44.124040 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1183/2477] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:43 2022] GET /compute/v2.1/servers/63a69f32-61bc-41d2-a358-636ae638f654 => generated 1338 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:44.130969 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-4906495f-1b23-4557-b9da-5660940a82ac req-aeb70db1-b01f-4545-b36b-aa7bc4656101 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dbbde45-f255-4ac5-8887-1ce8de673fca", "tag": "0ad973d8-f2bb-4e15-a985-502b69cec140"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:35:44.145755 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4906495f-1b23-4557-b9da-5660940a82ac req-aeb70db1-b01f-4545-b36b-aa7bc4656101 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:44.146848 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4906495f-1b23-4557-b9da-5660940a82ac req-aeb70db1-b01f-4545-b36b-aa7bc4656101 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:44.147402 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4906495f-1b23-4557-b9da-5660940a82ac req-aeb70db1-b01f-4545-b36b-aa7bc4656101 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:44.164014 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-4906495f-1b23-4557-b9da-5660940a82ac req-aeb70db1-b01f-4545-b36b-aa7bc4656101 service nova] Creating event network-changed:0ad973d8-f2bb-4e15-a985-502b69cec140 for instance 0dbbde45-f255-4ac5-8887-1ce8de673fca on n-h1-853682-5 Oct 18 15:35:44.169777 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [req-4906495f-1b23-4557-b9da-5660940a82ac req-aeb70db1-b01f-4545-b36b-aa7bc4656101 service nova] Instance 0dbbde45-f255-4ac5-8887-1ce8de673fca is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853682-5', 'n-h1-853682-5'} {{(pid=120406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 18 15:35:44.180767 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-4906495f-1b23-4557-b9da-5660940a82ac req-aeb70db1-b01f-4545-b36b-aa7bc4656101 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054970 Oct 18 15:35:44.182114 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1184/2478] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:35:44.296575 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5c3fe15f-4222-4f68-9a40-c919ee3d6e82 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:44.297909 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5c3fe15f-4222-4f68-9a40-c919ee3d6e82 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: b7ebc01d-7008-4ca7-a82b-094962216ceb] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:44.329670 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c3fe15f-4222-4f68-9a40-c919ee3d6e82 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:44.330518 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c3fe15f-4222-4f68-9a40-c919ee3d6e82 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:44.330993 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c3fe15f-4222-4f68-9a40-c919ee3d6e82 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:44.335643 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c3fe15f-4222-4f68-9a40-c919ee3d6e82 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:44.336503 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c3fe15f-4222-4f68-9a40-c919ee3d6e82 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:44.337779 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c3fe15f-4222-4f68-9a40-c919ee3d6e82 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:44.671815 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-dc2fddf5-6b6a-49cb-a320-82cc11cd0b87 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a7ce3bb784a79b3ac336743b9ae84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a52e3135e52493b8ccb2d7342418591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:44.681892 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-dc2fddf5-6b6a-49cb-a320-82cc11cd0b87 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "GET /compute/v2.1/servers/873a3005-fbac-40d0-8919-f138a619f2fa" status: 200 len: 1315 microversion: 2.1 time: 0.611258 Oct 18 15:35:44.683026 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1295/2479] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:44 2022] GET /compute/v2.1/servers/873a3005-fbac-40d0-8919-f138a619f2fa => generated 1315 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:44.688946 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3c12a733-bb29-46f5-821a-6b7931d17631 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:44.689899 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3c12a733-bb29-46f5-821a-6b7931d17631 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 89919fa6-1fd6-42d0-ab81-d0cdebc3960c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:44.699112 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3c12a733-bb29-46f5-821a-6b7931d17631 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:44.699842 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3c12a733-bb29-46f5-821a-6b7931d17631 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:44.700502 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3c12a733-bb29-46f5-821a-6b7931d17631 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:44.701465 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3c12a733-bb29-46f5-821a-6b7931d17631 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:44.702115 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3c12a733-bb29-46f5-821a-6b7931d17631 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:44.702729 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3c12a733-bb29-46f5-821a-6b7931d17631 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:44.800735 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5c3fe15f-4222-4f68-9a40-c919ee3d6e82 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:44.813997 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5c3fe15f-4222-4f68-9a40-c919ee3d6e82 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/b7ebc01d-7008-4ca7-a82b-094962216ceb" status: 200 len: 1315 microversion: 2.1 time: 0.522046 Oct 18 15:35:44.817246 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1185/2480] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:44 2022] GET /compute/v2.1/servers/b7ebc01d-7008-4ca7-a82b-094962216ceb => generated 1315 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:35:44.855530 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-ecffe593-3cb1-4f87-b950-bf36f66a1b4e req-e5de1844-69e2-4cb7-9f55-e46667748976 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89919fa6-1fd6-42d0-ab81-d0cdebc3960c", "tag": "82b30c0f-9d62-4ecd-bb2b-b3f207ddc518"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:35:44.870564 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ecffe593-3cb1-4f87-b950-bf36f66a1b4e req-e5de1844-69e2-4cb7-9f55-e46667748976 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:44.871298 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ecffe593-3cb1-4f87-b950-bf36f66a1b4e req-e5de1844-69e2-4cb7-9f55-e46667748976 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:44.871958 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ecffe593-3cb1-4f87-b950-bf36f66a1b4e req-e5de1844-69e2-4cb7-9f55-e46667748976 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:44.884117 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-ecffe593-3cb1-4f87-b950-bf36f66a1b4e req-e5de1844-69e2-4cb7-9f55-e46667748976 service nova] Creating event network-changed:82b30c0f-9d62-4ecd-bb2b-b3f207ddc518 for instance 89919fa6-1fd6-42d0-ab81-d0cdebc3960c on n-h1-853682-5 Oct 18 15:35:44.891420 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-ecffe593-3cb1-4f87-b950-bf36f66a1b4e req-e5de1844-69e2-4cb7-9f55-e46667748976 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055789 Oct 18 15:35:44.892607 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1186/2481] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:35:44.898617 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ef515e2b-449e-47c5-b40b-537e44986c9f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:44.900092 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ef515e2b-449e-47c5-b40b-537e44986c9f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 511cbc18-aef9-4202-9616-decd6651e931] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:44.909650 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ef515e2b-449e-47c5-b40b-537e44986c9f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:44.910493 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ef515e2b-449e-47c5-b40b-537e44986c9f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:44.911297 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ef515e2b-449e-47c5-b40b-537e44986c9f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:44.913080 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ef515e2b-449e-47c5-b40b-537e44986c9f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:44.914216 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ef515e2b-449e-47c5-b40b-537e44986c9f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:44.915099 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ef515e2b-449e-47c5-b40b-537e44986c9f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:45.229483 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3c12a733-bb29-46f5-821a-6b7931d17631 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:45.238597 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3c12a733-bb29-46f5-821a-6b7931d17631 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/89919fa6-1fd6-42d0-ab81-d0cdebc3960c" status: 200 len: 1312 microversion: 2.1 time: 0.554322 Oct 18 15:35:45.239610 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1296/2482] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:44 2022] GET /compute/v2.1/servers/89919fa6-1fd6-42d0-ab81-d0cdebc3960c => generated 1312 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:45.245381 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-20fa2f1c-0d50-4f66-82bd-e703db85d731 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:45.248032 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-20fa2f1c-0d50-4f66-82bd-e703db85d731 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] [instance: 5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:45.254771 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-20fa2f1c-0d50-4f66-82bd-e703db85d731 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:45.255707 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-20fa2f1c-0d50-4f66-82bd-e703db85d731 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:45.256379 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-20fa2f1c-0d50-4f66-82bd-e703db85d731 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:45.257329 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-20fa2f1c-0d50-4f66-82bd-e703db85d731 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:45.257989 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-20fa2f1c-0d50-4f66-82bd-e703db85d731 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:45.258656 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-20fa2f1c-0d50-4f66-82bd-e703db85d731 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:45.291998 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-20fa2f1c-0d50-4f66-82bd-e703db85d731 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] 10.222.0.60 "GET /compute/v2.1/servers/5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051073 Oct 18 15:35:45.292935 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1297/2483] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 15:35:45 2022] GET /compute/v2.1/servers/5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:35:45.298669 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ecc11c71-7661-429c-8575-064c8515b6ed tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:45.299540 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ecc11c71-7661-429c-8575-064c8515b6ed tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] [instance: 98c6abbf-732b-4723-89c8-cbb32207414f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:45.307146 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ecc11c71-7661-429c-8575-064c8515b6ed tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:45.307903 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ecc11c71-7661-429c-8575-064c8515b6ed tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:45.308489 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ecc11c71-7661-429c-8575-064c8515b6ed tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:45.309379 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ecc11c71-7661-429c-8575-064c8515b6ed tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:45.309988 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ecc11c71-7661-429c-8575-064c8515b6ed tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:45.310558 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ecc11c71-7661-429c-8575-064c8515b6ed tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:45.450637 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ef515e2b-449e-47c5-b40b-537e44986c9f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:45.465876 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ef515e2b-449e-47c5-b40b-537e44986c9f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/511cbc18-aef9-4202-9616-decd6651e931" status: 200 len: 1367 microversion: 2.1 time: 0.571610 Oct 18 15:35:45.467776 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1187/2484] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:44 2022] GET /compute/v2.1/servers/511cbc18-aef9-4202-9616-decd6651e931 => generated 1367 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:45.474496 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2e06480d-fbd8-4ba5-8911-0493bb6b17ca tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:45.475402 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2e06480d-fbd8-4ba5-8911-0493bb6b17ca tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 0dbbde45-f255-4ac5-8887-1ce8de673fca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:45.493866 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e06480d-fbd8-4ba5-8911-0493bb6b17ca tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:45.494440 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e06480d-fbd8-4ba5-8911-0493bb6b17ca tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:45.495282 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e06480d-fbd8-4ba5-8911-0493bb6b17ca tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:45.496074 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e06480d-fbd8-4ba5-8911-0493bb6b17ca tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:45.498258 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e06480d-fbd8-4ba5-8911-0493bb6b17ca tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:45.498833 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e06480d-fbd8-4ba5-8911-0493bb6b17ca tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:45.526179 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:35:45.647543 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ecc11c71-7661-429c-8575-064c8515b6ed tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee820071e6e4d2f9c3daa61f23c58e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc684ec2e4d4a6283dbb5566ccb8d60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:45.657153 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ecc11c71-7661-429c-8575-064c8515b6ed tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] 10.222.0.60 "GET /compute/v2.1/servers/98c6abbf-732b-4723-89c8-cbb32207414f" status: 200 len: 1521 microversion: 2.1 time: 0.362898 Oct 18 15:35:45.670399 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1298/2485] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:45 2022] GET /compute/v2.1/servers/98c6abbf-732b-4723-89c8-cbb32207414f => generated 1521 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:45.679866 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a24be7f3-fb13-4c4a-a958-beda75438f99 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:45.681965 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a24be7f3-fb13-4c4a-a958-beda75438f99 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] [instance: 63a69f32-61bc-41d2-a358-636ae638f654] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:45.688499 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a24be7f3-fb13-4c4a-a958-beda75438f99 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:45.689322 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a24be7f3-fb13-4c4a-a958-beda75438f99 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:45.690093 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a24be7f3-fb13-4c4a-a958-beda75438f99 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:45.691014 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a24be7f3-fb13-4c4a-a958-beda75438f99 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:45.691911 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a24be7f3-fb13-4c4a-a958-beda75438f99 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:45.692531 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a24be7f3-fb13-4c4a-a958-beda75438f99 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:45.834374 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a24be7f3-fb13-4c4a-a958-beda75438f99 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bc878a0901409684ea58261475b1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88812dd7c80d47bba192382fccc31e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:45.844386 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a24be7f3-fb13-4c4a-a958-beda75438f99 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] 10.222.0.60 "GET /compute/v2.1/servers/63a69f32-61bc-41d2-a358-636ae638f654" status: 200 len: 1326 microversion: 2.1 time: 0.172338 Oct 18 15:35:45.845297 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1299/2486] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:45 2022] GET /compute/v2.1/servers/63a69f32-61bc-41d2-a358-636ae638f654 => generated 1326 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:45.851697 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ae7ee54c-bcf1-496f-8946-953c87abf022 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:45.852411 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ae7ee54c-bcf1-496f-8946-953c87abf022 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] [instance: 5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:45.864617 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae7ee54c-bcf1-496f-8946-953c87abf022 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:45.866582 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae7ee54c-bcf1-496f-8946-953c87abf022 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:45.867281 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae7ee54c-bcf1-496f-8946-953c87abf022 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:45.869216 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae7ee54c-bcf1-496f-8946-953c87abf022 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:45.870899 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae7ee54c-bcf1-496f-8946-953c87abf022 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:45.871726 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae7ee54c-bcf1-496f-8946-953c87abf022 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:45.978636 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-ae7ee54c-bcf1-496f-8946-953c87abf022 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lazy-loading 'services' on Instance uuid 5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:35:46.083126 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ae7ee54c-bcf1-496f-8946-953c87abf022 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e/os-volume_attachments/63146b2a-1e9b-4031-8b18-d6311e50a923" status: 202 len: 0 microversion: 2.1 time: 0.235675 Oct 18 15:35:46.084061 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1300/2487] 10.222.0.60 () {58 vars in 1416 bytes} [Tue Oct 18 15:35:45 2022] DELETE /compute/v2.1/servers/5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e/os-volume_attachments/63146b2a-1e9b-4031-8b18-d6311e50a923 => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:35:46.116765 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ba4703b1-25dc-4606-9160-816903815924 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:46.124272 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ba4703b1-25dc-4606-9160-816903815924 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] [instance: 873a3005-fbac-40d0-8919-f138a619f2fa] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:46.135618 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba4703b1-25dc-4606-9160-816903815924 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:46.137739 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba4703b1-25dc-4606-9160-816903815924 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:46.138293 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba4703b1-25dc-4606-9160-816903815924 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:46.139182 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba4703b1-25dc-4606-9160-816903815924 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:46.140747 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba4703b1-25dc-4606-9160-816903815924 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:46.141521 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba4703b1-25dc-4606-9160-816903815924 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:46.251141 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2e06480d-fbd8-4ba5-8911-0493bb6b17ca tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:46.263346 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2e06480d-fbd8-4ba5-8911-0493bb6b17ca tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca" status: 200 len: 1472 microversion: 2.1 time: 0.793333 Oct 18 15:35:46.277381 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1188/2488] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:45 2022] GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca => generated 1472 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:46.292346 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-21ff633e-478a-4bd9-9d84-fafc2cc167ec tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:46.294271 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-21ff633e-478a-4bd9-9d84-fafc2cc167ec tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: b7ebc01d-7008-4ca7-a82b-094962216ceb] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:46.302304 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21ff633e-478a-4bd9-9d84-fafc2cc167ec tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:46.302964 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21ff633e-478a-4bd9-9d84-fafc2cc167ec tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:46.303603 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21ff633e-478a-4bd9-9d84-fafc2cc167ec tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:46.304647 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21ff633e-478a-4bd9-9d84-fafc2cc167ec tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:46.305349 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21ff633e-478a-4bd9-9d84-fafc2cc167ec tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:46.306535 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21ff633e-478a-4bd9-9d84-fafc2cc167ec tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:46.696396 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ba4703b1-25dc-4606-9160-816903815924 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a7ce3bb784a79b3ac336743b9ae84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a52e3135e52493b8ccb2d7342418591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:46.705844 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ba4703b1-25dc-4606-9160-816903815924 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "GET /compute/v2.1/servers/873a3005-fbac-40d0-8919-f138a619f2fa" status: 200 len: 1315 microversion: 2.1 time: 0.620327 Oct 18 15:35:46.706571 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1301/2489] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:46 2022] GET /compute/v2.1/servers/873a3005-fbac-40d0-8919-f138a619f2fa => generated 1315 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:46.711990 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f0dfbbbc-adf7-41f6-8ad2-b906b44fd89f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:46.712605 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f0dfbbbc-adf7-41f6-8ad2-b906b44fd89f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 89919fa6-1fd6-42d0-ab81-d0cdebc3960c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:46.718843 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f0dfbbbc-adf7-41f6-8ad2-b906b44fd89f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:46.719322 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f0dfbbbc-adf7-41f6-8ad2-b906b44fd89f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:46.719766 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f0dfbbbc-adf7-41f6-8ad2-b906b44fd89f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:46.720461 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f0dfbbbc-adf7-41f6-8ad2-b906b44fd89f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:46.720962 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f0dfbbbc-adf7-41f6-8ad2-b906b44fd89f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:46.721689 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f0dfbbbc-adf7-41f6-8ad2-b906b44fd89f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:46.746563 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-21ff633e-478a-4bd9-9d84-fafc2cc167ec tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:46.767591 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-21ff633e-478a-4bd9-9d84-fafc2cc167ec tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/b7ebc01d-7008-4ca7-a82b-094962216ceb" status: 200 len: 1502 microversion: 2.1 time: 0.488615 Oct 18 15:35:46.768193 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1189/2490] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:46 2022] GET /compute/v2.1/servers/b7ebc01d-7008-4ca7-a82b-094962216ceb => generated 1502 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:46.783249 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ab7ec8a4-1409-4fe6-8d63-7d65f5d83f62 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:46.784115 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ab7ec8a4-1409-4fe6-8d63-7d65f5d83f62 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 511cbc18-aef9-4202-9616-decd6651e931] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:46.794133 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab7ec8a4-1409-4fe6-8d63-7d65f5d83f62 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:46.794640 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab7ec8a4-1409-4fe6-8d63-7d65f5d83f62 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:46.795082 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab7ec8a4-1409-4fe6-8d63-7d65f5d83f62 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:46.795787 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab7ec8a4-1409-4fe6-8d63-7d65f5d83f62 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:46.796991 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab7ec8a4-1409-4fe6-8d63-7d65f5d83f62 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:46.801225 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab7ec8a4-1409-4fe6-8d63-7d65f5d83f62 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:47.276438 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f0dfbbbc-adf7-41f6-8ad2-b906b44fd89f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:47.285543 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f0dfbbbc-adf7-41f6-8ad2-b906b44fd89f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/89919fa6-1fd6-42d0-ab81-d0cdebc3960c" status: 200 len: 1312 microversion: 2.1 time: 0.576363 Oct 18 15:35:47.287938 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1302/2491] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:46 2022] GET /compute/v2.1/servers/89919fa6-1fd6-42d0-ab81-d0cdebc3960c => generated 1312 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:47.303115 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ab7ec8a4-1409-4fe6-8d63-7d65f5d83f62 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:47.307373 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-670bfbe2-cf43-4396-8b7a-2f680df6f3e3 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:47.308020 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-670bfbe2-cf43-4396-8b7a-2f680df6f3e3 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] [instance: 98c6abbf-732b-4723-89c8-cbb32207414f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:47.318881 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ab7ec8a4-1409-4fe6-8d63-7d65f5d83f62 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/511cbc18-aef9-4202-9616-decd6651e931" status: 200 len: 1367 microversion: 2.1 time: 0.548159 Oct 18 15:35:47.321075 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1190/2492] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:46 2022] GET /compute/v2.1/servers/511cbc18-aef9-4202-9616-decd6651e931 => generated 1367 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:47.329067 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-670bfbe2-cf43-4396-8b7a-2f680df6f3e3 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:47.330442 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-670bfbe2-cf43-4396-8b7a-2f680df6f3e3 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:47.331554 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-670bfbe2-cf43-4396-8b7a-2f680df6f3e3 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:47.333155 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-670bfbe2-cf43-4396-8b7a-2f680df6f3e3 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:47.335317 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-670bfbe2-cf43-4396-8b7a-2f680df6f3e3 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:47.336689 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-670bfbe2-cf43-4396-8b7a-2f680df6f3e3 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:47.340132 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cd83fb2b-4e6b-4319-b8d2-30bf60d4a5d5 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:47.341017 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cd83fb2b-4e6b-4319-b8d2-30bf60d4a5d5 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] [instance: 63a69f32-61bc-41d2-a358-636ae638f654] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:47.354954 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd83fb2b-4e6b-4319-b8d2-30bf60d4a5d5 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:47.355691 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd83fb2b-4e6b-4319-b8d2-30bf60d4a5d5 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:47.357931 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd83fb2b-4e6b-4319-b8d2-30bf60d4a5d5 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:47.358881 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd83fb2b-4e6b-4319-b8d2-30bf60d4a5d5 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:47.361696 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd83fb2b-4e6b-4319-b8d2-30bf60d4a5d5 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:47.363677 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd83fb2b-4e6b-4319-b8d2-30bf60d4a5d5 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:47.376891 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-670bfbe2-cf43-4396-8b7a-2f680df6f3e3 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] HTTP exception thrown: Instance 98c6abbf-732b-4723-89c8-cbb32207414f could not be found. Oct 18 15:35:47.389060 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-670bfbe2-cf43-4396-8b7a-2f680df6f3e3 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Request method failure captured: Oct 18 15:35:47.389060 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/98c6abbf-732b-4723-89c8-cbb32207414f HTTP/1.1 Oct 18 15:35:47.389060 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:35:47.389060 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:35:47.389060 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:35:47.389060 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:35:47.389060 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:35:47.389060 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:35:47.389060 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:35:47.389060 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:35:47.389060 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsekOH3Pn3S8ZVeUzjVp88lwx55TD72QhXDYTTCo8oJTuOkyIbQr8SDgKMEhySJyiX-Gmkd0ybBIXywragPoWfRPJ1IgAMf1ZKJCHv9ITgS5UDJ4XnH20WXWxMxCn5Afyv46OnIgXXeeztnZUfG7cAN_rdF3taqI29os0sYj04Qj3wM Oct 18 15:35:47.389060 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:35:47.389060 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:35:47.389060 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:35:47.389060 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:35:47.389060 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:35:47.389060 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:35:47.389060 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: ffc684ec2e4d4a6283dbb5566ccb8d60 Oct 18 15:35:47.389060 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ListServersNegativeTestJSON-870435735 Oct 18 15:35:47.389060 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:35:47.389060 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:35:47.390334 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ffc684ec2e4d4a6283dbb5566ccb8d60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ffc684ec2e4d4a6283dbb5566ccb8d60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ffc684ec2e4d4a6283dbb5566ccb8d60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ffc684ec2e4d4a6283dbb5566ccb8d60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:35:47.390334 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ListServersNegativeTestJSON-870435735 Oct 18 15:35:47.390334 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: ffc684ec2e4d4a6283dbb5566ccb8d60 Oct 18 15:35:47.390334 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-870435735 Oct 18 15:35:47.390334 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ListServersNegativeTestJSON-870435735-project Oct 18 15:35:47.390334 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:35:47.390334 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:35:47.390334 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 6ee820071e6e4d2f9c3daa61f23c58e7 Oct 18 15:35:47.390334 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ListServersNegativeTestJSON-870435735-project Oct 18 15:35:47.390334 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:35:47.390334 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 98c6abbf-732b-4723-89c8-cbb32207414f could not be found. Oct 18 15:35:47.390334 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '98c6abbf-732b-4723-89c8-cbb32207414f'} Oct 18 15:35:47.391039 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:35:47.391039 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:35:47.391039 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:35:47.391039 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:35:47.391039 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:35:47.391039 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:35:47.391039 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:35:47.391039 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:35:47.391039 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:35:47.391039 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:35:47.391039 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98c6abbf-732b-4723-89c8-cbb32207414f could not be found. Oct 18 15:35:47.391039 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:35:47.391039 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:35:47.391039 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:35:47.391039 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:35:47.391039 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:35:47.391039 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:35:47.391039 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:35:47.391039 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:35:47.391039 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:35:47.392199 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:35:47.392199 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:35:47.392199 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:35:47.392199 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:35:47.392199 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:35:47.392199 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:35:47.392199 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:35:47.392199 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98c6abbf-732b-4723-89c8-cbb32207414f could not be found. Oct 18 15:35:47.392199 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:35:47.392199 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:35:47.392199 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:35:47.392199 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:35:47.392199 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:35:47.392199 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:35:47.392199 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:35:47.392199 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:35:47.392199 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98c6abbf-732b-4723-89c8-cbb32207414f could not be found. Oct 18 15:35:47.392199 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:35:47.393570 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-670bfbe2-cf43-4396-8b7a-2f680df6f3e3 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Returning 404 to user: Instance 98c6abbf-732b-4723-89c8-cbb32207414f could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:35:47.393570 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-670bfbe2-cf43-4396-8b7a-2f680df6f3e3 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] 10.222.0.60 "GET /compute/v2.1/servers/98c6abbf-732b-4723-89c8-cbb32207414f" status: 404 len: 111 microversion: 2.1 time: 0.090388 Oct 18 15:35:47.393570 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1303/2493] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:47 2022] GET /compute/v2.1/servers/98c6abbf-732b-4723-89c8-cbb32207414f => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:35:47.393570 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-65a6c998-bbc8-45ee-ba09-951be3aaf0dc req-1cc0c9a1-0826-4d89-9578-88060bf3daf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98c6abbf-732b-4723-89c8-cbb32207414f", "name": "network-vif-deleted", "tag": "ce4cea1b-3055-4168-9a10-61429e48b81f"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:35:47.406789 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-65a6c998-bbc8-45ee-ba09-951be3aaf0dc req-1cc0c9a1-0826-4d89-9578-88060bf3daf3 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:47.407286 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-65a6c998-bbc8-45ee-ba09-951be3aaf0dc req-1cc0c9a1-0826-4d89-9578-88060bf3daf3 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:47.409035 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-65a6c998-bbc8-45ee-ba09-951be3aaf0dc req-1cc0c9a1-0826-4d89-9578-88060bf3daf3 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:47.422214 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-65a6c998-bbc8-45ee-ba09-951be3aaf0dc req-1cc0c9a1-0826-4d89-9578-88060bf3daf3 service nova] Creating event network-vif-deleted:ce4cea1b-3055-4168-9a10-61429e48b81f for instance 98c6abbf-732b-4723-89c8-cbb32207414f on n-h2-853682-5 Oct 18 15:35:47.427273 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-65a6c998-bbc8-45ee-ba09-951be3aaf0dc req-1cc0c9a1-0826-4d89-9578-88060bf3daf3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038240 Oct 18 15:35:47.428498 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1304/2494] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:35:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:35:47.434870 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-82976e28-73e8-4373-82b1-54df0402a596 req-33939d59-4520-4140-954a-e5e6f620873b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "873a3005-fbac-40d0-8919-f138a619f2fa", "name": "network-vif-plugged", "status": "completed", "tag": "bb5c9526-9ebb-4b59-8df6-40f1393cf4b0"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:35:47.449611 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-82976e28-73e8-4373-82b1-54df0402a596 req-33939d59-4520-4140-954a-e5e6f620873b service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:47.450096 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-82976e28-73e8-4373-82b1-54df0402a596 req-33939d59-4520-4140-954a-e5e6f620873b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:47.450529 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-82976e28-73e8-4373-82b1-54df0402a596 req-33939d59-4520-4140-954a-e5e6f620873b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:47.463722 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-82976e28-73e8-4373-82b1-54df0402a596 req-33939d59-4520-4140-954a-e5e6f620873b service nova] Creating event network-vif-plugged:bb5c9526-9ebb-4b59-8df6-40f1393cf4b0 for instance 873a3005-fbac-40d0-8919-f138a619f2fa on n-h1-853682-5 Oct 18 15:35:47.470355 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-82976e28-73e8-4373-82b1-54df0402a596 req-33939d59-4520-4140-954a-e5e6f620873b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040539 Oct 18 15:35:47.485242 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1305/2495] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:35:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:35:47.494393 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-2893adde-fb3b-49ec-bcc4-e288a8f2b4b8 req-46abdc91-d0b5-440e-b943-8c77d9a4eb63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "511cbc18-aef9-4202-9616-decd6651e931", "tag": "b15f0bdc-90f5-4d7d-aeb4-725da17aace5"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:35:47.505430 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-2893adde-fb3b-49ec-bcc4-e288a8f2b4b8 req-46abdc91-d0b5-440e-b943-8c77d9a4eb63 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:47.506190 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-2893adde-fb3b-49ec-bcc4-e288a8f2b4b8 req-46abdc91-d0b5-440e-b943-8c77d9a4eb63 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:47.507065 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-2893adde-fb3b-49ec-bcc4-e288a8f2b4b8 req-46abdc91-d0b5-440e-b943-8c77d9a4eb63 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:47.522817 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-2893adde-fb3b-49ec-bcc4-e288a8f2b4b8 req-46abdc91-d0b5-440e-b943-8c77d9a4eb63 service nova] Creating event network-changed:b15f0bdc-90f5-4d7d-aeb4-725da17aace5 for instance 511cbc18-aef9-4202-9616-decd6651e931 on n-h2-853682-5 Oct 18 15:35:47.528392 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-2893adde-fb3b-49ec-bcc4-e288a8f2b4b8 req-46abdc91-d0b5-440e-b943-8c77d9a4eb63 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041365 Oct 18 15:35:47.538045 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1306/2496] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:35:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:35:47.545781 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-80d5d38a-1c76-4688-ad44-be9cee35cf09 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:47.546498 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-80d5d38a-1c76-4688-ad44-be9cee35cf09 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 0dbbde45-f255-4ac5-8887-1ce8de673fca] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:47.554425 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-80d5d38a-1c76-4688-ad44-be9cee35cf09 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:47.554930 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-80d5d38a-1c76-4688-ad44-be9cee35cf09 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:47.555380 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-80d5d38a-1c76-4688-ad44-be9cee35cf09 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:47.557143 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-80d5d38a-1c76-4688-ad44-be9cee35cf09 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:47.557624 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-80d5d38a-1c76-4688-ad44-be9cee35cf09 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:47.558063 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-80d5d38a-1c76-4688-ad44-be9cee35cf09 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:47.678269 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cd83fb2b-4e6b-4319-b8d2-30bf60d4a5d5 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bc878a0901409684ea58261475b1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88812dd7c80d47bba192382fccc31e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:47.691473 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cd83fb2b-4e6b-4319-b8d2-30bf60d4a5d5 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] 10.222.0.60 "GET /compute/v2.1/servers/63a69f32-61bc-41d2-a358-636ae638f654" status: 200 len: 1393 microversion: 2.1 time: 0.367112 Oct 18 15:35:47.693205 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1191/2497] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:47 2022] GET /compute/v2.1/servers/63a69f32-61bc-41d2-a358-636ae638f654 => generated 1393 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:47.700036 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c30cc063-6490-40b1-94b7-7b76570129fc tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:47.706153 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c30cc063-6490-40b1-94b7-7b76570129fc tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6ee820071e6e4d2f9c3daa61f23c58e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc684ec2e4d4a6283dbb5566ccb8d60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:47.707040 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c30cc063-6490-40b1-94b7-7b76570129fc tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'ffc684ec2e4d4a6283dbb5566ccb8d60'} {{(pid=120406) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 15:35:47.713736 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c30cc063-6490-40b1-94b7-7b76570129fc tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:47.714225 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c30cc063-6490-40b1-94b7-7b76570129fc tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:47.714653 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c30cc063-6490-40b1-94b7-7b76570129fc tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:47.716956 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c30cc063-6490-40b1-94b7-7b76570129fc tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:47.717588 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c30cc063-6490-40b1-94b7-7b76570129fc tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:47.718189 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c30cc063-6490-40b1-94b7-7b76570129fc tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:47.813139 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c30cc063-6490-40b1-94b7-7b76570129fc tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] 10.222.0.60 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.118393 Oct 18 15:35:47.813970 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1192/2498] 10.222.0.60 () {58 vars in 1230 bytes} [Tue Oct 18 15:35:47 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:35:47.818533 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bd308be4-d33e-4e12-843f-8c48cd380067 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:47.819242 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bd308be4-d33e-4e12-843f-8c48cd380067 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] [instance: 873a3005-fbac-40d0-8919-f138a619f2fa] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:47.820987 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:35:47.826871 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd308be4-d33e-4e12-843f-8c48cd380067 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:47.827356 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd308be4-d33e-4e12-843f-8c48cd380067 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:47.828003 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd308be4-d33e-4e12-843f-8c48cd380067 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:47.828885 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd308be4-d33e-4e12-843f-8c48cd380067 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:47.829488 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd308be4-d33e-4e12-843f-8c48cd380067 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:47.830347 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd308be4-d33e-4e12-843f-8c48cd380067 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:47.999278 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-80d5d38a-1c76-4688-ad44-be9cee35cf09 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:48.002305 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:35:48.009757 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-80d5d38a-1c76-4688-ad44-be9cee35cf09 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca" status: 200 len: 1472 microversion: 2.1 time: 0.469369 Oct 18 15:35:48.025215 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1307/2499] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:47 2022] GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca => generated 1472 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:48.031572 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c7ea56ea-966f-4489-8adf-5aefd7442446 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:48.036184 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c7ea56ea-966f-4489-8adf-5aefd7442446 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Request method failure captured: Oct 18 15:35:48.036184 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 18 15:35:48.036184 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:35:48.036184 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:35:48.036184 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:35:48.036184 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:35:48.036184 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:35:48.036184 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:35:48.036184 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:35:48.036184 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:35:48.036184 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsekOH3Pn3S8ZVeUzjVp88lwx55TD72QhXDYTTCo8oJTuOkyIbQr8SDgKMEhySJyiX-Gmkd0ybBIXywragPoWfRPJ1IgAMf1ZKJCHv9ITgS5UDJ4XnH20WXWxMxCn5Afyv46OnIgXXeeztnZUfG7cAN_rdF3taqI29os0sYj04Qj3wM Oct 18 15:35:48.036184 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:35:48.036184 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:35:48.036184 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:35:48.036184 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:35:48.036184 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:35:48.036184 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:35:48.036184 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: ffc684ec2e4d4a6283dbb5566ccb8d60 Oct 18 15:35:48.036184 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ListServersNegativeTestJSON-870435735 Oct 18 15:35:48.036184 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:35:48.036184 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:35:48.037406 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ffc684ec2e4d4a6283dbb5566ccb8d60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ffc684ec2e4d4a6283dbb5566ccb8d60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ffc684ec2e4d4a6283dbb5566ccb8d60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ffc684ec2e4d4a6283dbb5566ccb8d60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:35:48.037406 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ListServersNegativeTestJSON-870435735 Oct 18 15:35:48.037406 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: ffc684ec2e4d4a6283dbb5566ccb8d60 Oct 18 15:35:48.037406 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-870435735 Oct 18 15:35:48.037406 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ListServersNegativeTestJSON-870435735-project Oct 18 15:35:48.037406 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:35:48.037406 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:35:48.037406 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 6ee820071e6e4d2f9c3daa61f23c58e7 Oct 18 15:35:48.037406 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ListServersNegativeTestJSON-870435735-project Oct 18 15:35:48.037406 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:35:48.037406 n-d-853682-5 devstack@n-api.service[120405]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 18 15:35:48.037406 n-d-853682-5 devstack@n-api.service[120405]: action_args: {} Oct 18 15:35:48.038157 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:35:48.038157 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:35:48.038157 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 15:35:48.038157 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 15:35:48.038157 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 15:35:48.038157 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise error Oct 18 15:35:48.038157 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 18 15:35:48.038157 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:35:48.038157 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 18 15:35:48.038157 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 18 15:35:48.038157 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:35:48.038157 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 18 15:35:48.038157 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 18 15:35:48.038157 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:35:48.038157 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:35:48.038157 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:35:48.038157 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:35:48.038157 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:35:48.038157 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:35:48.038157 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:35:48.038157 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:35:48.038157 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:35:48.038157 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:35:48.039389 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 15:35:48.039389 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:35:48.039389 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 15:35:48.039389 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:35:48.039389 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 15:35:48.039389 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:35:48.039389 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 18 15:35:48.039389 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 18 15:35:48.039389 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 18 15:35:48.039389 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 15:35:48.039389 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 15:35:48.039389 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 15:35:48.039389 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 15:35:48.039389 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 18 15:35:48.039389 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:35:48.039389 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:35:48.039389 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:35:48.039389 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:35:48.039389 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:35:48.039389 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:35:48.040534 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 15:35:48.040534 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 15:35:48.040534 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 18 15:35:48.040534 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:35:48.042260 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c7ea56ea-966f-4489-8adf-5aefd7442446 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:35:48.043339 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c7ea56ea-966f-4489-8adf-5aefd7442446 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] 10.222.0.60 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.016754 Oct 18 15:35:48.044117 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1308/2500] 10.222.0.60 () {58 vars in 1182 bytes} [Tue Oct 18 15:35:48 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:35:48.055037 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8d767962-c48a-41d3-ae6d-20c764518125 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:48.070494 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8d767962-c48a-41d3-ae6d-20c764518125 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6ee820071e6e4d2f9c3daa61f23c58e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc684ec2e4d4a6283dbb5566ccb8d60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:48.072019 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8d767962-c48a-41d3-ae6d-20c764518125 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Searching by: {'deleted': False, 'project_id': 'ffc684ec2e4d4a6283dbb5566ccb8d60'} {{(pid=120405) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 15:35:48.087344 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8d767962-c48a-41d3-ae6d-20c764518125 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:48.088288 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8d767962-c48a-41d3-ae6d-20c764518125 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:48.088801 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8d767962-c48a-41d3-ae6d-20c764518125 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:48.089715 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8d767962-c48a-41d3-ae6d-20c764518125 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:48.090196 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8d767962-c48a-41d3-ae6d-20c764518125 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:48.090796 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8d767962-c48a-41d3-ae6d-20c764518125 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:48.117447 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bd308be4-d33e-4e12-843f-8c48cd380067 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a7ce3bb784a79b3ac336743b9ae84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a52e3135e52493b8ccb2d7342418591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:48.125963 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bd308be4-d33e-4e12-843f-8c48cd380067 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "GET /compute/v2.1/servers/873a3005-fbac-40d0-8919-f138a619f2fa" status: 200 len: 1315 microversion: 2.1 time: 0.310906 Oct 18 15:35:48.127079 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1193/2501] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:47 2022] GET /compute/v2.1/servers/873a3005-fbac-40d0-8919-f138a619f2fa => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:48.143690 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.multi_cell_list [None req-8d767962-c48a-41d3-ae6d-20c764518125 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120405) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 15:35:48.171418 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8d767962-c48a-41d3-ae6d-20c764518125 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.121633 Oct 18 15:35:48.172005 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1309/2502] 10.222.0.60 () {58 vars in 1125 bytes} [Tue Oct 18 15:35:48 2022] GET /compute/v2.1/servers => generated 681 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:35:48.189419 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-af14b698-c997-4f00-81e5-d50cdfcf56ac tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:48.194399 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-af14b698-c997-4f00-81e5-d50cdfcf56ac tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6ee820071e6e4d2f9c3daa61f23c58e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc684ec2e4d4a6283dbb5566ccb8d60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:48.194934 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.compute.servers [None req-af14b698-c997-4f00-81e5-d50cdfcf56ac tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Removing options 'limit' from query {{(pid=120406) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 18 15:35:48.195664 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-af14b698-c997-4f00-81e5-d50cdfcf56ac tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Searching by: {'deleted': False, 'project_id': 'ffc684ec2e4d4a6283dbb5566ccb8d60'} {{(pid=120406) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 15:35:48.201712 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af14b698-c997-4f00-81e5-d50cdfcf56ac tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:48.202287 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af14b698-c997-4f00-81e5-d50cdfcf56ac tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:48.202791 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af14b698-c997-4f00-81e5-d50cdfcf56ac tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:48.203582 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af14b698-c997-4f00-81e5-d50cdfcf56ac tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:48.204125 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af14b698-c997-4f00-81e5-d50cdfcf56ac tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:48.204613 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af14b698-c997-4f00-81e5-d50cdfcf56ac tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:48.232241 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.multi_cell_list [None req-af14b698-c997-4f00-81e5-d50cdfcf56ac tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=120406) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 15:35:48.263515 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-af14b698-c997-4f00-81e5-d50cdfcf56ac tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] 10.222.0.60 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.077923 Oct 18 15:35:48.264111 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1194/2503] 10.222.0.60 () {58 vars in 1144 bytes} [Tue Oct 18 15:35:48 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:35:48.277458 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-873f17c6-8173-435f-8ec4-78ac8f53fe53 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:48.281841 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-873f17c6-8173-435f-8ec4-78ac8f53fe53 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Request method failure captured: Oct 18 15:35:48.281841 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 18 15:35:48.281841 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:35:48.281841 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:35:48.281841 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:35:48.281841 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:35:48.281841 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:35:48.281841 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:35:48.281841 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:35:48.281841 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:35:48.281841 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsekOH3Pn3S8ZVeUzjVp88lwx55TD72QhXDYTTCo8oJTuOkyIbQr8SDgKMEhySJyiX-Gmkd0ybBIXywragPoWfRPJ1IgAMf1ZKJCHv9ITgS5UDJ4XnH20WXWxMxCn5Afyv46OnIgXXeeztnZUfG7cAN_rdF3taqI29os0sYj04Qj3wM Oct 18 15:35:48.281841 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:35:48.281841 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:35:48.281841 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:35:48.281841 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:35:48.281841 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:35:48.281841 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:35:48.281841 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: ffc684ec2e4d4a6283dbb5566ccb8d60 Oct 18 15:35:48.281841 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ListServersNegativeTestJSON-870435735 Oct 18 15:35:48.281841 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:35:48.281841 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:35:48.283286 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ffc684ec2e4d4a6283dbb5566ccb8d60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ffc684ec2e4d4a6283dbb5566ccb8d60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ffc684ec2e4d4a6283dbb5566ccb8d60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ffc684ec2e4d4a6283dbb5566ccb8d60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:35:48.283286 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ListServersNegativeTestJSON-870435735 Oct 18 15:35:48.283286 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: ffc684ec2e4d4a6283dbb5566ccb8d60 Oct 18 15:35:48.283286 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-870435735 Oct 18 15:35:48.283286 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ListServersNegativeTestJSON-870435735-project Oct 18 15:35:48.283286 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:35:48.283286 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:35:48.283286 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 6ee820071e6e4d2f9c3daa61f23c58e7 Oct 18 15:35:48.283286 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ListServersNegativeTestJSON-870435735-project Oct 18 15:35:48.283286 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:35:48.283286 n-d-853682-5 devstack@n-api.service[120405]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 18 15:35:48.283286 n-d-853682-5 devstack@n-api.service[120405]: action_args: {} Oct 18 15:35:48.284093 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:35:48.284093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:35:48.284093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 15:35:48.284093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 15:35:48.284093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 15:35:48.284093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise error Oct 18 15:35:48.284093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 18 15:35:48.284093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:35:48.284093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 18 15:35:48.284093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 18 15:35:48.284093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 18 15:35:48.284093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 18 15:35:48.284093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 18 15:35:48.284093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:35:48.284093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 18 15:35:48.284093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi '-1' Oct 18 15:35:48.284093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:35:48.284093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:35:48.284093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:35:48.284093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:35:48.284093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:35:48.284093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:35:48.284093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:35:48.284093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:35:48.285631 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:35:48.285631 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:35:48.285631 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 15:35:48.285631 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:35:48.285631 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 15:35:48.285631 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:35:48.285631 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 15:35:48.285631 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:35:48.285631 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 18 15:35:48.285631 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 18 15:35:48.285631 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 18 15:35:48.285631 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 15:35:48.285631 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 15:35:48.285631 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 15:35:48.285631 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 15:35:48.285631 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 18 15:35:48.285631 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:35:48.285631 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:35:48.285631 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:35:48.285631 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:35:48.286830 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:35:48.286830 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:35:48.286830 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 15:35:48.286830 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 15:35:48.286830 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 18 15:35:48.286830 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:35:48.286830 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-873f17c6-8173-435f-8ec4-78ac8f53fe53 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:35:48.286830 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-873f17c6-8173-435f-8ec4-78ac8f53fe53 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] 10.222.0.60 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.010362 Oct 18 15:35:48.286830 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1310/2504] 10.222.0.60 () {58 vars in 1142 bytes} [Tue Oct 18 15:35:48 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:35:48.293648 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-151dcfca-b672-476c-bcd1-1ae6a2998b92 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:48.301287 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-151dcfca-b672-476c-bcd1-1ae6a2998b92 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Request method failure captured: Oct 18 15:35:48.301287 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 18 15:35:48.301287 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:35:48.301287 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:35:48.301287 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:35:48.301287 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:35:48.301287 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:35:48.301287 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:35:48.301287 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:35:48.301287 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:35:48.301287 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsekOH3Pn3S8ZVeUzjVp88lwx55TD72QhXDYTTCo8oJTuOkyIbQr8SDgKMEhySJyiX-Gmkd0ybBIXywragPoWfRPJ1IgAMf1ZKJCHv9ITgS5UDJ4XnH20WXWxMxCn5Afyv46OnIgXXeeztnZUfG7cAN_rdF3taqI29os0sYj04Qj3wM Oct 18 15:35:48.301287 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:35:48.301287 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:35:48.301287 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:35:48.301287 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:35:48.301287 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:35:48.301287 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:35:48.301287 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: ffc684ec2e4d4a6283dbb5566ccb8d60 Oct 18 15:35:48.301287 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ListServersNegativeTestJSON-870435735 Oct 18 15:35:48.301287 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:35:48.301287 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:35:48.302861 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ffc684ec2e4d4a6283dbb5566ccb8d60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ffc684ec2e4d4a6283dbb5566ccb8d60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ffc684ec2e4d4a6283dbb5566ccb8d60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ffc684ec2e4d4a6283dbb5566ccb8d60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:35:48.302861 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ListServersNegativeTestJSON-870435735 Oct 18 15:35:48.302861 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: ffc684ec2e4d4a6283dbb5566ccb8d60 Oct 18 15:35:48.302861 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-870435735 Oct 18 15:35:48.302861 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ListServersNegativeTestJSON-870435735-project Oct 18 15:35:48.302861 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:35:48.302861 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:35:48.302861 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 6ee820071e6e4d2f9c3daa61f23c58e7 Oct 18 15:35:48.302861 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ListServersNegativeTestJSON-870435735-project Oct 18 15:35:48.302861 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:35:48.302861 n-d-853682-5 devstack@n-api.service[120406]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 18 15:35:48.302861 n-d-853682-5 devstack@n-api.service[120406]: action_args: {} Oct 18 15:35:48.303607 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:35:48.303607 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:35:48.303607 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 15:35:48.303607 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 15:35:48.303607 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 15:35:48.303607 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise error Oct 18 15:35:48.303607 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 18 15:35:48.303607 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:35:48.303607 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 18 15:35:48.303607 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 18 15:35:48.303607 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 18 15:35:48.303607 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 18 15:35:48.303607 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 18 15:35:48.303607 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:35:48.303607 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 18 15:35:48.303607 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'testing' Oct 18 15:35:48.303607 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:35:48.303607 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:35:48.303607 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:35:48.303607 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:35:48.303607 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:35:48.303607 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:35:48.303607 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:35:48.303607 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:35:48.305015 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:35:48.305015 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:35:48.305015 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 15:35:48.305015 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:35:48.305015 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 15:35:48.305015 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:35:48.305015 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 15:35:48.305015 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:35:48.305015 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 18 15:35:48.305015 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 18 15:35:48.305015 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 18 15:35:48.305015 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 15:35:48.305015 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 15:35:48.305015 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 15:35:48.305015 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 15:35:48.305015 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 18 15:35:48.305015 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:35:48.305015 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:35:48.305015 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:35:48.305015 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:35:48.306842 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:35:48.306842 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:35:48.306842 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 15:35:48.306842 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 15:35:48.306842 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 18 15:35:48.306842 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:35:48.308426 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-151dcfca-b672-476c-bcd1-1ae6a2998b92 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:35:48.310233 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-151dcfca-b672-476c-bcd1-1ae6a2998b92 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] 10.222.0.60 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.020636 Oct 18 15:35:48.310953 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1195/2505] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Oct 18 15:35:48 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:35:48.316922 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-78a04c65-c1f0-41f0-b45e-9eecacfe1938 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:48.317796 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-78a04c65-c1f0-41f0-b45e-9eecacfe1938 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 89919fa6-1fd6-42d0-ab81-d0cdebc3960c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:48.322949 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4bc15a41-5ac1-4df7-a0d9-a7bf3c70f7e2 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:48.326015 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-78a04c65-c1f0-41f0-b45e-9eecacfe1938 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:48.326510 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-78a04c65-c1f0-41f0-b45e-9eecacfe1938 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:48.327349 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-78a04c65-c1f0-41f0-b45e-9eecacfe1938 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:48.328310 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-78a04c65-c1f0-41f0-b45e-9eecacfe1938 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:48.328556 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4bc15a41-5ac1-4df7-a0d9-a7bf3c70f7e2 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6ee820071e6e4d2f9c3daa61f23c58e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc684ec2e4d4a6283dbb5566ccb8d60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:48.329225 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-78a04c65-c1f0-41f0-b45e-9eecacfe1938 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:48.329662 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-78a04c65-c1f0-41f0-b45e-9eecacfe1938 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:48.334514 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4bc15a41-5ac1-4df7-a0d9-a7bf3c70f7e2 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'ffc684ec2e4d4a6283dbb5566ccb8d60'} {{(pid=120406) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 15:35:48.341384 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.compute.servers [None req-4bc15a41-5ac1-4df7-a0d9-a7bf3c70f7e2 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Flavor 'non_existing_flavor' could not be found {{(pid=120406) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 18 15:35:48.346303 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4bc15a41-5ac1-4df7-a0d9-a7bf3c70f7e2 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] 10.222.0.60 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.024045 Oct 18 15:35:48.346303 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1196/2506] 10.222.0.60 () {58 vars in 1178 bytes} [Tue Oct 18 15:35:48 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:35:48.356448 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ef2f2c81-1be8-4614-9e1b-48418a34d6bf tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:48.359301 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ef2f2c81-1be8-4614-9e1b-48418a34d6bf tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 511cbc18-aef9-4202-9616-decd6651e931] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:48.366086 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ef2f2c81-1be8-4614-9e1b-48418a34d6bf tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:48.366765 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ef2f2c81-1be8-4614-9e1b-48418a34d6bf tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:48.367207 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ef2f2c81-1be8-4614-9e1b-48418a34d6bf tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:48.367910 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ef2f2c81-1be8-4614-9e1b-48418a34d6bf tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:48.368968 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ef2f2c81-1be8-4614-9e1b-48418a34d6bf tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:48.369396 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ef2f2c81-1be8-4614-9e1b-48418a34d6bf tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:48.684529 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-78a04c65-c1f0-41f0-b45e-9eecacfe1938 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:48.690024 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ef2f2c81-1be8-4614-9e1b-48418a34d6bf tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:48.693093 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-78a04c65-c1f0-41f0-b45e-9eecacfe1938 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/89919fa6-1fd6-42d0-ab81-d0cdebc3960c" status: 200 len: 1312 microversion: 2.1 time: 0.381825 Oct 18 15:35:48.693679 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1311/2507] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:48 2022] GET /compute/v2.1/servers/89919fa6-1fd6-42d0-ab81-d0cdebc3960c => generated 1312 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:48.698190 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-78a66c54-1245-4528-84e6-fbb2c39b3bce tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:48.699386 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ef2f2c81-1be8-4614-9e1b-48418a34d6bf tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/511cbc18-aef9-4202-9616-decd6651e931" status: 200 len: 1367 microversion: 2.1 time: 0.347428 Oct 18 15:35:48.699966 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1197/2508] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:48 2022] GET /compute/v2.1/servers/511cbc18-aef9-4202-9616-decd6651e931 => generated 1367 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:48.703670 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-78a66c54-1245-4528-84e6-fbb2c39b3bce tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6ee820071e6e4d2f9c3daa61f23c58e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc684ec2e4d4a6283dbb5566ccb8d60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:48.704415 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-78a66c54-1245-4528-84e6-fbb2c39b3bce tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'ffc684ec2e4d4a6283dbb5566ccb8d60'} {{(pid=120405) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 15:35:48.710177 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-78a66c54-1245-4528-84e6-fbb2c39b3bce tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:48.710834 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-78a66c54-1245-4528-84e6-fbb2c39b3bce tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:48.711529 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-78a66c54-1245-4528-84e6-fbb2c39b3bce tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:48.713023 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-78a66c54-1245-4528-84e6-fbb2c39b3bce tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:48.720484 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a8d96bd8-a73e-4aed-b6a4-c54d2c66658e tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:48.721122 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a8d96bd8-a73e-4aed-b6a4-c54d2c66658e tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] [instance: 63a69f32-61bc-41d2-a358-636ae638f654] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:48.722471 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-78a66c54-1245-4528-84e6-fbb2c39b3bce tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:48.723309 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-78a66c54-1245-4528-84e6-fbb2c39b3bce tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:48.728413 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8d96bd8-a73e-4aed-b6a4-c54d2c66658e tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:48.729231 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8d96bd8-a73e-4aed-b6a4-c54d2c66658e tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:48.729870 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8d96bd8-a73e-4aed-b6a4-c54d2c66658e tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:48.730813 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8d96bd8-a73e-4aed-b6a4-c54d2c66658e tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:48.731616 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8d96bd8-a73e-4aed-b6a4-c54d2c66658e tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:48.732274 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8d96bd8-a73e-4aed-b6a4-c54d2c66658e tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:48.850120 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-78a66c54-1245-4528-84e6-fbb2c39b3bce tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] 10.222.0.60 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.155304 Oct 18 15:35:48.859557 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1312/2509] 10.222.0.60 () {58 vars in 1174 bytes} [Tue Oct 18 15:35:48 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:35:48.864754 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-09565c28-b027-4040-8344-6c9b94c5dc8d tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:48.872213 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-09565c28-b027-4040-8344-6c9b94c5dc8d tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6ee820071e6e4d2f9c3daa61f23c58e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc684ec2e4d4a6283dbb5566ccb8d60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:48.873107 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-09565c28-b027-4040-8344-6c9b94c5dc8d tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'ffc684ec2e4d4a6283dbb5566ccb8d60'} {{(pid=120405) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 15:35:48.879484 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09565c28-b027-4040-8344-6c9b94c5dc8d tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:48.880170 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09565c28-b027-4040-8344-6c9b94c5dc8d tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:48.880768 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09565c28-b027-4040-8344-6c9b94c5dc8d tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:48.881668 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09565c28-b027-4040-8344-6c9b94c5dc8d tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:48.882873 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09565c28-b027-4040-8344-6c9b94c5dc8d tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:48.883468 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09565c28-b027-4040-8344-6c9b94c5dc8d tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:48.957652 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a8d96bd8-a73e-4aed-b6a4-c54d2c66658e tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bc878a0901409684ea58261475b1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88812dd7c80d47bba192382fccc31e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:48.969489 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a8d96bd8-a73e-4aed-b6a4-c54d2c66658e tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] 10.222.0.60 "GET /compute/v2.1/servers/63a69f32-61bc-41d2-a358-636ae638f654" status: 200 len: 1393 microversion: 2.1 time: 0.253818 Oct 18 15:35:48.971293 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1198/2510] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:48 2022] GET /compute/v2.1/servers/63a69f32-61bc-41d2-a358-636ae638f654 => generated 1393 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:48.991211 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-09565c28-b027-4040-8344-6c9b94c5dc8d tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] 10.222.0.60 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.130218 Oct 18 15:35:48.991815 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1313/2511] 10.222.0.60 () {58 vars in 1184 bytes} [Tue Oct 18 15:35:48 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:35:49.003833 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b31de37e-8f87-4ba7-bfd6-8b9867167d2c tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:49.009229 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b31de37e-8f87-4ba7-bfd6-8b9867167d2c tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6ee820071e6e4d2f9c3daa61f23c58e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc684ec2e4d4a6283dbb5566ccb8d60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:49.010682 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b31de37e-8f87-4ba7-bfd6-8b9867167d2c tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Searching by: {'deleted': False, 'project_id': 'ffc684ec2e4d4a6283dbb5566ccb8d60'} {{(pid=120406) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 15:35:49.017851 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b31de37e-8f87-4ba7-bfd6-8b9867167d2c tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:49.018428 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b31de37e-8f87-4ba7-bfd6-8b9867167d2c tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:49.019126 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b31de37e-8f87-4ba7-bfd6-8b9867167d2c tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:49.020016 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b31de37e-8f87-4ba7-bfd6-8b9867167d2c tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:49.020579 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b31de37e-8f87-4ba7-bfd6-8b9867167d2c tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:49.021154 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b31de37e-8f87-4ba7-bfd6-8b9867167d2c tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:49.037446 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d940b47b-429d-421e-87cb-a72d165a06db tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:49.038121 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d940b47b-429d-421e-87cb-a72d165a06db tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 0dbbde45-f255-4ac5-8887-1ce8de673fca] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:49.044112 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d940b47b-429d-421e-87cb-a72d165a06db tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:49.044606 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d940b47b-429d-421e-87cb-a72d165a06db tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:49.045069 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d940b47b-429d-421e-87cb-a72d165a06db tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:49.045954 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d940b47b-429d-421e-87cb-a72d165a06db tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:49.046410 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d940b47b-429d-421e-87cb-a72d165a06db tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:49.046839 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d940b47b-429d-421e-87cb-a72d165a06db tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:49.051398 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.multi_cell_list [None req-b31de37e-8f87-4ba7-bfd6-8b9867167d2c tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120406) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 15:35:49.082512 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=33 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:35:49.086454 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b31de37e-8f87-4ba7-bfd6-8b9867167d2c tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee820071e6e4d2f9c3daa61f23c58e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc684ec2e4d4a6283dbb5566ccb8d60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:49.094334 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b31de37e-8f87-4ba7-bfd6-8b9867167d2c tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:49.094820 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b31de37e-8f87-4ba7-bfd6-8b9867167d2c tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:49.095253 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b31de37e-8f87-4ba7-bfd6-8b9867167d2c tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:49.243942 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d940b47b-429d-421e-87cb-a72d165a06db tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:49.251875 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d940b47b-429d-421e-87cb-a72d165a06db tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca" status: 200 len: 1469 microversion: 2.1 time: 0.218521 Oct 18 15:35:49.252483 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1314/2512] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:49 2022] GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca => generated 1469 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:35:49.256994 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-04a8a5f8-31bc-4d92-a8f9-e41400433537 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:49.257604 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-04a8a5f8-31bc-4d92-a8f9-e41400433537 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] [instance: 873a3005-fbac-40d0-8919-f138a619f2fa] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:49.263897 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-04a8a5f8-31bc-4d92-a8f9-e41400433537 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:49.264731 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-04a8a5f8-31bc-4d92-a8f9-e41400433537 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:49.265460 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-04a8a5f8-31bc-4d92-a8f9-e41400433537 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:49.265721 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b31de37e-8f87-4ba7-bfd6-8b9867167d2c tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] 10.222.0.60 "GET /compute/v2.1/servers/detail" status: 200 len: 3025 microversion: 2.1 time: 0.265651 Oct 18 15:35:49.266231 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-04a8a5f8-31bc-4d92-a8f9-e41400433537 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:49.266694 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-04a8a5f8-31bc-4d92-a8f9-e41400433537 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:49.267118 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-04a8a5f8-31bc-4d92-a8f9-e41400433537 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:49.279498 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1199/2513] 10.222.0.60 () {58 vars in 1146 bytes} [Tue Oct 18 15:35:48 2022] GET /compute/v2.1/servers/detail => generated 3025 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:49.284617 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c889b4f2-d191-4fdb-9c02-795919260b6e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:35:49.286453 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c889b4f2-d191-4fdb-9c02-795919260b6e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 0dbbde45-f255-4ac5-8887-1ce8de673fca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:49.292564 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c889b4f2-d191-4fdb-9c02-795919260b6e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:49.293092 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c889b4f2-d191-4fdb-9c02-795919260b6e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:49.293534 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c889b4f2-d191-4fdb-9c02-795919260b6e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:49.294236 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c889b4f2-d191-4fdb-9c02-795919260b6e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:49.294702 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c889b4f2-d191-4fdb-9c02-795919260b6e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:49.295126 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c889b4f2-d191-4fdb-9c02-795919260b6e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:49.360548 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c889b4f2-d191-4fdb-9c02-795919260b6e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "POST /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca/action" status: 204 len: 0 microversion: 2.1 time: 0.079619 Oct 18 15:35:49.362063 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1200/2514] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:35:49 2022] POST /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca/action => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:35:49.367858 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-52c64d6b-df13-48b7-91ff-550de4b3a952 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:49.373349 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-52c64d6b-df13-48b7-91ff-550de4b3a952 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6ee820071e6e4d2f9c3daa61f23c58e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc684ec2e4d4a6283dbb5566ccb8d60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:49.374316 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-52c64d6b-df13-48b7-91ff-550de4b3a952 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] 10.222.0.60 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.010970 Oct 18 15:35:49.375073 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1201/2515] 10.222.0.60 () {58 vars in 1178 bytes} [Tue Oct 18 15:35:49 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:35:49.379208 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a0fabe63-e142-42fb-9fd7-4c1e89c56175 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:49.380343 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a0fabe63-e142-42fb-9fd7-4c1e89c56175 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 0dbbde45-f255-4ac5-8887-1ce8de673fca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:49.388869 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0fabe63-e142-42fb-9fd7-4c1e89c56175 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:49.389359 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0fabe63-e142-42fb-9fd7-4c1e89c56175 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:49.389797 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0fabe63-e142-42fb-9fd7-4c1e89c56175 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:49.390496 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0fabe63-e142-42fb-9fd7-4c1e89c56175 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:49.390951 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0fabe63-e142-42fb-9fd7-4c1e89c56175 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:49.391377 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0fabe63-e142-42fb-9fd7-4c1e89c56175 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:49.407630 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-04a8a5f8-31bc-4d92-a8f9-e41400433537 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a7ce3bb784a79b3ac336743b9ae84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a52e3135e52493b8ccb2d7342418591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:49.417659 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-04a8a5f8-31bc-4d92-a8f9-e41400433537 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "GET /compute/v2.1/servers/873a3005-fbac-40d0-8919-f138a619f2fa" status: 200 len: 1315 microversion: 2.1 time: 0.164151 Oct 18 15:35:49.418245 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1315/2516] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:49 2022] GET /compute/v2.1/servers/873a3005-fbac-40d0-8919-f138a619f2fa => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:49.422622 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a9ad25cd-38eb-4dcf-88bf-14d40323c5c6 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:49.427502 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a9ad25cd-38eb-4dcf-88bf-14d40323c5c6 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6ee820071e6e4d2f9c3daa61f23c58e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc684ec2e4d4a6283dbb5566ccb8d60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:49.428163 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a9ad25cd-38eb-4dcf-88bf-14d40323c5c6 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Searching by: {'deleted': False, 'project_id': 'ffc684ec2e4d4a6283dbb5566ccb8d60'} {{(pid=120405) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 15:35:49.434119 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9ad25cd-38eb-4dcf-88bf-14d40323c5c6 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:49.434704 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9ad25cd-38eb-4dcf-88bf-14d40323c5c6 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:49.435144 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9ad25cd-38eb-4dcf-88bf-14d40323c5c6 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:49.436003 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9ad25cd-38eb-4dcf-88bf-14d40323c5c6 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:49.436483 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9ad25cd-38eb-4dcf-88bf-14d40323c5c6 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:49.436944 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9ad25cd-38eb-4dcf-88bf-14d40323c5c6 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:49.464339 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.multi_cell_list [None req-a9ad25cd-38eb-4dcf-88bf-14d40323c5c6 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120405) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 15:35:49.501035 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a9ad25cd-38eb-4dcf-88bf-14d40323c5c6 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.080509 Oct 18 15:35:49.501035 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1316/2517] 10.222.0.60 () {58 vars in 1125 bytes} [Tue Oct 18 15:35:49 2022] GET /compute/v2.1/servers => generated 681 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:35:49.512695 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-4f0a66a7-a0cf-4ac2-bd6a-0e43c39c77f1 req-db071627-1f10-4053-902b-2aa7fae379d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63a69f32-61bc-41d2-a358-636ae638f654", "tag": "a646ae7c-f2fc-4861-89ce-5b219e36816a"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:35:49.525114 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-4f0a66a7-a0cf-4ac2-bd6a-0e43c39c77f1 req-db071627-1f10-4053-902b-2aa7fae379d9 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:49.525802 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-4f0a66a7-a0cf-4ac2-bd6a-0e43c39c77f1 req-db071627-1f10-4053-902b-2aa7fae379d9 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:49.526907 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-4f0a66a7-a0cf-4ac2-bd6a-0e43c39c77f1 req-db071627-1f10-4053-902b-2aa7fae379d9 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:49.538945 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-4f0a66a7-a0cf-4ac2-bd6a-0e43c39c77f1 req-db071627-1f10-4053-902b-2aa7fae379d9 service nova] Creating event network-changed:a646ae7c-f2fc-4861-89ce-5b219e36816a for instance 63a69f32-61bc-41d2-a358-636ae638f654 on n-h2-853682-5 Oct 18 15:35:49.544913 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-4f0a66a7-a0cf-4ac2-bd6a-0e43c39c77f1 req-db071627-1f10-4053-902b-2aa7fae379d9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043162 Oct 18 15:35:49.545801 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a0fabe63-e142-42fb-9fd7-4c1e89c56175 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:49.549164 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1317/2518] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:35:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:35:49.554590 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f64fc6d5-ff73-4956-84d8-2ee491db513a tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:49.555326 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f64fc6d5-ff73-4956-84d8-2ee491db513a tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] [instance: 98c6abbf-732b-4723-89c8-cbb32207414f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:49.559254 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a0fabe63-e142-42fb-9fd7-4c1e89c56175 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca" status: 200 len: 1469 microversion: 2.1 time: 0.183409 Oct 18 15:35:49.564737 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1202/2519] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:49 2022] GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca => generated 1469 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:49.565010 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f64fc6d5-ff73-4956-84d8-2ee491db513a tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:49.565010 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f64fc6d5-ff73-4956-84d8-2ee491db513a tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:49.565010 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f64fc6d5-ff73-4956-84d8-2ee491db513a tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:49.565010 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f64fc6d5-ff73-4956-84d8-2ee491db513a tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:49.565312 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f64fc6d5-ff73-4956-84d8-2ee491db513a tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:49.565312 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f64fc6d5-ff73-4956-84d8-2ee491db513a tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:49.587998 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-f64fc6d5-ff73-4956-84d8-2ee491db513a tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] HTTP exception thrown: Instance 98c6abbf-732b-4723-89c8-cbb32207414f could not be found. Oct 18 15:35:49.590021 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f64fc6d5-ff73-4956-84d8-2ee491db513a tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Request method failure captured: Oct 18 15:35:49.590021 n-d-853682-5 devstack@n-api.service[120405]: request: DELETE /compute/v2.1/servers/98c6abbf-732b-4723-89c8-cbb32207414f HTTP/1.1 Oct 18 15:35:49.590021 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:35:49.590021 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:35:49.590021 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:35:49.590021 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:35:49.590021 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:35:49.590021 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:35:49.590021 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:35:49.590021 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:35:49.590021 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsekOH3Pn3S8ZVeUzjVp88lwx55TD72QhXDYTTCo8oJTuOkyIbQr8SDgKMEhySJyiX-Gmkd0ybBIXywragPoWfRPJ1IgAMf1ZKJCHv9ITgS5UDJ4XnH20WXWxMxCn5Afyv46OnIgXXeeztnZUfG7cAN_rdF3taqI29os0sYj04Qj3wM Oct 18 15:35:49.590021 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:35:49.590021 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:35:49.590021 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:35:49.590021 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:35:49.590021 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:35:49.590021 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:35:49.590021 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: ffc684ec2e4d4a6283dbb5566ccb8d60 Oct 18 15:35:49.590021 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ListServersNegativeTestJSON-870435735 Oct 18 15:35:49.590021 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:35:49.590021 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:35:49.591227 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ffc684ec2e4d4a6283dbb5566ccb8d60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ffc684ec2e4d4a6283dbb5566ccb8d60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ffc684ec2e4d4a6283dbb5566ccb8d60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ffc684ec2e4d4a6283dbb5566ccb8d60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:35:49.591227 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ListServersNegativeTestJSON-870435735 Oct 18 15:35:49.591227 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: ffc684ec2e4d4a6283dbb5566ccb8d60 Oct 18 15:35:49.591227 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-870435735 Oct 18 15:35:49.591227 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ListServersNegativeTestJSON-870435735-project Oct 18 15:35:49.591227 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:35:49.591227 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:35:49.591227 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 6ee820071e6e4d2f9c3daa61f23c58e7 Oct 18 15:35:49.591227 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ListServersNegativeTestJSON-870435735-project Oct 18 15:35:49.591227 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:35:49.591227 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 98c6abbf-732b-4723-89c8-cbb32207414f could not be found. Oct 18 15:35:49.591227 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '98c6abbf-732b-4723-89c8-cbb32207414f'} Oct 18 15:35:49.592093 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:35:49.592093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:35:49.592093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:35:49.592093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:35:49.592093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:35:49.592093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:35:49.592093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:35:49.592093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:35:49.592093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:35:49.592093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:35:49.592093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98c6abbf-732b-4723-89c8-cbb32207414f could not be found. Oct 18 15:35:49.592093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:35:49.592093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:35:49.592093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:35:49.592093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:35:49.592093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:35:49.592093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:35:49.592093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:35:49.592093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:35:49.592093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:35:49.593290 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:35:49.593290 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 15:35:49.593290 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 15:35:49.593290 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 15:35:49.593290 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 15:35:49.593290 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:35:49.593290 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:35:49.593290 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:35:49.593290 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:35:49.593290 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98c6abbf-732b-4723-89c8-cbb32207414f could not be found. Oct 18 15:35:49.593290 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:35:49.593290 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:35:49.593290 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:35:49.593290 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:35:49.593290 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:35:49.593290 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:35:49.593290 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:35:49.593290 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:35:49.593290 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98c6abbf-732b-4723-89c8-cbb32207414f could not be found. Oct 18 15:35:49.593290 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:35:49.594404 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f64fc6d5-ff73-4956-84d8-2ee491db513a tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Returning 404 to user: Instance 98c6abbf-732b-4723-89c8-cbb32207414f could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:35:49.594404 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f64fc6d5-ff73-4956-84d8-2ee491db513a tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] 10.222.0.60 "DELETE /compute/v2.1/servers/98c6abbf-732b-4723-89c8-cbb32207414f" status: 404 len: 111 microversion: 2.1 time: 0.041052 Oct 18 15:35:49.594404 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1318/2520] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:35:49 2022] DELETE /compute/v2.1/servers/98c6abbf-732b-4723-89c8-cbb32207414f => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:35:49.594581 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e13e783d-2ab9-4250-b9f8-bcdf1a2d44a8 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb22ec6e-f869-45c4-a397-08cf839a2ee8"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:35:49.596293 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e13e783d-2ab9-4250-b9f8-bcdf1a2d44a8 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: b7ebc01d-7008-4ca7-a82b-094962216ceb] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:49.599719 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d3a9204e-30f9-40f2-ac5c-3325d1c15361 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:49.600222 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d3a9204e-30f9-40f2-ac5c-3325d1c15361 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] [instance: c1a558f2-6710-4ab0-92fc-03076dcb4408] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:49.602226 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e13e783d-2ab9-4250-b9f8-bcdf1a2d44a8 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:49.602754 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e13e783d-2ab9-4250-b9f8-bcdf1a2d44a8 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:49.603193 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e13e783d-2ab9-4250-b9f8-bcdf1a2d44a8 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:49.603897 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e13e783d-2ab9-4250-b9f8-bcdf1a2d44a8 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:49.604489 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e13e783d-2ab9-4250-b9f8-bcdf1a2d44a8 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:49.604769 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e13e783d-2ab9-4250-b9f8-bcdf1a2d44a8 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:49.606550 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d3a9204e-30f9-40f2-ac5c-3325d1c15361 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:49.607120 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d3a9204e-30f9-40f2-ac5c-3325d1c15361 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:49.607881 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d3a9204e-30f9-40f2-ac5c-3325d1c15361 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:49.608153 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d3a9204e-30f9-40f2-ac5c-3325d1c15361 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:49.608612 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d3a9204e-30f9-40f2-ac5c-3325d1c15361 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:49.609092 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d3a9204e-30f9-40f2-ac5c-3325d1c15361 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:49.636326 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d3a9204e-30f9-40f2-ac5c-3325d1c15361 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] [instance: c1a558f2-6710-4ab0-92fc-03076dcb4408] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:35:49.718568 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d3a9204e-30f9-40f2-ac5c-3325d1c15361 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c1a558f2-6710-4ab0-92fc-03076dcb4408" status: 204 len: 0 microversion: 2.1 time: 0.122267 Oct 18 15:35:49.719150 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1319/2521] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:35:49 2022] DELETE /compute/v2.1/servers/c1a558f2-6710-4ab0-92fc-03076dcb4408 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 15:35:49.724063 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d51f1b24-eff0-4783-a12b-8320ba77150f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:49.724748 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d51f1b24-eff0-4783-a12b-8320ba77150f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 89919fa6-1fd6-42d0-ab81-d0cdebc3960c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:49.730941 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d51f1b24-eff0-4783-a12b-8320ba77150f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:49.731426 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d51f1b24-eff0-4783-a12b-8320ba77150f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:49.731859 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d51f1b24-eff0-4783-a12b-8320ba77150f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:49.732552 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d51f1b24-eff0-4783-a12b-8320ba77150f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:49.733042 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d51f1b24-eff0-4783-a12b-8320ba77150f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:49.733471 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d51f1b24-eff0-4783-a12b-8320ba77150f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:49.864684 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d51f1b24-eff0-4783-a12b-8320ba77150f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:49.873202 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d51f1b24-eff0-4783-a12b-8320ba77150f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/89919fa6-1fd6-42d0-ab81-d0cdebc3960c" status: 200 len: 1312 microversion: 2.1 time: 0.152929 Oct 18 15:35:49.873769 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1320/2522] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:49 2022] GET /compute/v2.1/servers/89919fa6-1fd6-42d0-ab81-d0cdebc3960c => generated 1312 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:49.878138 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e86ce2af-3d09-45a2-a7c8-c536189ca7d9 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:49.878738 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e86ce2af-3d09-45a2-a7c8-c536189ca7d9 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 511cbc18-aef9-4202-9616-decd6651e931] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:49.884438 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e86ce2af-3d09-45a2-a7c8-c536189ca7d9 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:49.884954 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e86ce2af-3d09-45a2-a7c8-c536189ca7d9 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:49.885391 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e86ce2af-3d09-45a2-a7c8-c536189ca7d9 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:49.886079 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e86ce2af-3d09-45a2-a7c8-c536189ca7d9 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:49.886532 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e86ce2af-3d09-45a2-a7c8-c536189ca7d9 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:49.886954 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e86ce2af-3d09-45a2-a7c8-c536189ca7d9 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:50.110311 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=16 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:35:50.153497 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e13e783d-2ab9-4250-b9f8-bcdf1a2d44a8 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "POST /compute/v2.1/servers/b7ebc01d-7008-4ca7-a82b-094962216ceb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.563513 Oct 18 15:35:50.154541 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1203/2523] 10.222.0.60 () {60 vars in 1323 bytes} [Tue Oct 18 15:35:49 2022] POST /compute/v2.1/servers/b7ebc01d-7008-4ca7-a82b-094962216ceb/os-volume_attachments => generated 194 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:35:50.176799 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ff060b5f-68c6-417f-9840-fa8f5a6a19f5 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:50.178013 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ff060b5f-68c6-417f-9840-fa8f5a6a19f5 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] [instance: 4df91fe0-82c3-404b-ac29-8da7bdb0ef66] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:50.195112 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ff060b5f-68c6-417f-9840-fa8f5a6a19f5 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:50.198675 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ff060b5f-68c6-417f-9840-fa8f5a6a19f5 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:50.199033 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ff060b5f-68c6-417f-9840-fa8f5a6a19f5 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:50.199818 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ff060b5f-68c6-417f-9840-fa8f5a6a19f5 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:50.200231 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ff060b5f-68c6-417f-9840-fa8f5a6a19f5 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:50.200656 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ff060b5f-68c6-417f-9840-fa8f5a6a19f5 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:50.269276 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ff060b5f-68c6-417f-9840-fa8f5a6a19f5 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] [instance: 4df91fe0-82c3-404b-ac29-8da7bdb0ef66] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:35:50.279048 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:35:50.320579 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e86ce2af-3d09-45a2-a7c8-c536189ca7d9 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:50.330324 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e86ce2af-3d09-45a2-a7c8-c536189ca7d9 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/511cbc18-aef9-4202-9616-decd6651e931" status: 200 len: 1367 microversion: 2.1 time: 0.455242 Oct 18 15:35:50.333713 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1321/2524] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:49 2022] GET /compute/v2.1/servers/511cbc18-aef9-4202-9616-decd6651e931 => generated 1367 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:50.341964 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fea06ecb-306c-4154-836b-6134f1c44d53 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:50.342892 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-fea06ecb-306c-4154-836b-6134f1c44d53 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] [instance: 63a69f32-61bc-41d2-a358-636ae638f654] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:50.350386 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fea06ecb-306c-4154-836b-6134f1c44d53 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:50.351165 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fea06ecb-306c-4154-836b-6134f1c44d53 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:50.358077 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fea06ecb-306c-4154-836b-6134f1c44d53 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:50.359674 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fea06ecb-306c-4154-836b-6134f1c44d53 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:50.360370 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fea06ecb-306c-4154-836b-6134f1c44d53 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:50.361035 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fea06ecb-306c-4154-836b-6134f1c44d53 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:50.426809 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ff060b5f-68c6-417f-9840-fa8f5a6a19f5 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4df91fe0-82c3-404b-ac29-8da7bdb0ef66" status: 204 len: 0 microversion: 2.1 time: 0.268724 Oct 18 15:35:50.429480 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1204/2525] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:35:50 2022] DELETE /compute/v2.1/servers/4df91fe0-82c3-404b-ac29-8da7bdb0ef66 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:35:50.441711 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b2c1eff6-c8ad-483a-aa59-77c9131eb3aa tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:50.442432 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b2c1eff6-c8ad-483a-aa59-77c9131eb3aa tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] [instance: 98c6abbf-732b-4723-89c8-cbb32207414f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:50.461192 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2c1eff6-c8ad-483a-aa59-77c9131eb3aa tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:50.466789 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2c1eff6-c8ad-483a-aa59-77c9131eb3aa tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:50.467790 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2c1eff6-c8ad-483a-aa59-77c9131eb3aa tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:50.468889 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2c1eff6-c8ad-483a-aa59-77c9131eb3aa tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:50.469501 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2c1eff6-c8ad-483a-aa59-77c9131eb3aa tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:50.470095 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2c1eff6-c8ad-483a-aa59-77c9131eb3aa tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:50.485490 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-b2c1eff6-c8ad-483a-aa59-77c9131eb3aa tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] HTTP exception thrown: Instance 98c6abbf-732b-4723-89c8-cbb32207414f could not be found. Oct 18 15:35:50.487135 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b2c1eff6-c8ad-483a-aa59-77c9131eb3aa tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Request method failure captured: Oct 18 15:35:50.487135 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/98c6abbf-732b-4723-89c8-cbb32207414f HTTP/1.1 Oct 18 15:35:50.487135 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:35:50.487135 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:35:50.487135 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:35:50.487135 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:35:50.487135 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:35:50.487135 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:35:50.487135 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:35:50.487135 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:35:50.487135 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsekOH3Pn3S8ZVeUzjVp88lwx55TD72QhXDYTTCo8oJTuOkyIbQr8SDgKMEhySJyiX-Gmkd0ybBIXywragPoWfRPJ1IgAMf1ZKJCHv9ITgS5UDJ4XnH20WXWxMxCn5Afyv46OnIgXXeeztnZUfG7cAN_rdF3taqI29os0sYj04Qj3wM Oct 18 15:35:50.487135 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:35:50.487135 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:35:50.487135 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:35:50.487135 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:35:50.487135 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:35:50.487135 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:35:50.487135 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: ffc684ec2e4d4a6283dbb5566ccb8d60 Oct 18 15:35:50.487135 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ListServersNegativeTestJSON-870435735 Oct 18 15:35:50.487135 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:35:50.487135 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:35:50.488561 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ffc684ec2e4d4a6283dbb5566ccb8d60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ffc684ec2e4d4a6283dbb5566ccb8d60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ffc684ec2e4d4a6283dbb5566ccb8d60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ffc684ec2e4d4a6283dbb5566ccb8d60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:35:50.488561 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ListServersNegativeTestJSON-870435735 Oct 18 15:35:50.488561 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: ffc684ec2e4d4a6283dbb5566ccb8d60 Oct 18 15:35:50.488561 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-870435735 Oct 18 15:35:50.488561 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ListServersNegativeTestJSON-870435735-project Oct 18 15:35:50.488561 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:35:50.488561 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:35:50.488561 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 6ee820071e6e4d2f9c3daa61f23c58e7 Oct 18 15:35:50.488561 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ListServersNegativeTestJSON-870435735-project Oct 18 15:35:50.488561 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:35:50.488561 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 98c6abbf-732b-4723-89c8-cbb32207414f could not be found. Oct 18 15:35:50.488561 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '98c6abbf-732b-4723-89c8-cbb32207414f'} Oct 18 15:35:50.489386 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:35:50.489386 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:35:50.489386 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:35:50.489386 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:35:50.489386 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:35:50.489386 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:35:50.489386 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:35:50.489386 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:35:50.489386 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:35:50.489386 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:35:50.489386 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98c6abbf-732b-4723-89c8-cbb32207414f could not be found. Oct 18 15:35:50.489386 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:35:50.489386 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:35:50.489386 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:35:50.489386 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:35:50.489386 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:35:50.489386 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:35:50.489386 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:35:50.489386 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:35:50.489386 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:35:50.493885 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:35:50.493885 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:35:50.493885 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:35:50.493885 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:35:50.493885 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:35:50.493885 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:35:50.493885 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:35:50.493885 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98c6abbf-732b-4723-89c8-cbb32207414f could not be found. Oct 18 15:35:50.493885 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:35:50.493885 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:35:50.493885 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:35:50.493885 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:35:50.493885 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:35:50.493885 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:35:50.493885 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:35:50.493885 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:35:50.493885 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98c6abbf-732b-4723-89c8-cbb32207414f could not be found. Oct 18 15:35:50.493885 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:35:50.495862 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b2c1eff6-c8ad-483a-aa59-77c9131eb3aa tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Returning 404 to user: Instance 98c6abbf-732b-4723-89c8-cbb32207414f could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:35:50.495862 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b2c1eff6-c8ad-483a-aa59-77c9131eb3aa tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] 10.222.0.60 "GET /compute/v2.1/servers/98c6abbf-732b-4723-89c8-cbb32207414f" status: 404 len: 111 microversion: 2.1 time: 0.055386 Oct 18 15:35:50.495862 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1205/2526] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:50 2022] GET /compute/v2.1/servers/98c6abbf-732b-4723-89c8-cbb32207414f => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:35:50.496639 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7d804189-92e6-49c4-b412-c0c6578a24fd tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:50.497292 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7d804189-92e6-49c4-b412-c0c6578a24fd tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] [instance: 873a3005-fbac-40d0-8919-f138a619f2fa] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:50.504530 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d804189-92e6-49c4-b412-c0c6578a24fd tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:50.505064 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d804189-92e6-49c4-b412-c0c6578a24fd tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:50.505496 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d804189-92e6-49c4-b412-c0c6578a24fd tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:50.506966 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d804189-92e6-49c4-b412-c0c6578a24fd tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:50.506966 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d804189-92e6-49c4-b412-c0c6578a24fd tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:50.507186 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d804189-92e6-49c4-b412-c0c6578a24fd tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:50.645451 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-fea06ecb-306c-4154-836b-6134f1c44d53 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bc878a0901409684ea58261475b1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88812dd7c80d47bba192382fccc31e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:50.655342 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fea06ecb-306c-4154-836b-6134f1c44d53 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] 10.222.0.60 "GET /compute/v2.1/servers/63a69f32-61bc-41d2-a358-636ae638f654" status: 200 len: 1393 microversion: 2.1 time: 0.320272 Oct 18 15:35:50.664216 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1322/2527] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:50 2022] GET /compute/v2.1/servers/63a69f32-61bc-41d2-a358-636ae638f654 => generated 1393 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:50.675267 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f3b0abf1-e702-4212-b9a8-fdcfe24035ef tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:50.675975 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f3b0abf1-e702-4212-b9a8-fdcfe24035ef tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] [instance: c1a558f2-6710-4ab0-92fc-03076dcb4408] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:50.683617 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f3b0abf1-e702-4212-b9a8-fdcfe24035ef tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:50.684434 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f3b0abf1-e702-4212-b9a8-fdcfe24035ef tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:50.685137 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f3b0abf1-e702-4212-b9a8-fdcfe24035ef tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:50.686069 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f3b0abf1-e702-4212-b9a8-fdcfe24035ef tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:50.686598 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f3b0abf1-e702-4212-b9a8-fdcfe24035ef tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:50.687095 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f3b0abf1-e702-4212-b9a8-fdcfe24035ef tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:50.701925 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7d804189-92e6-49c4-b412-c0c6578a24fd tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a7ce3bb784a79b3ac336743b9ae84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a52e3135e52493b8ccb2d7342418591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:50.710043 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7d804189-92e6-49c4-b412-c0c6578a24fd tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "GET /compute/v2.1/servers/873a3005-fbac-40d0-8919-f138a619f2fa" status: 200 len: 1315 microversion: 2.1 time: 0.218983 Oct 18 15:35:50.710791 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1206/2528] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:50 2022] GET /compute/v2.1/servers/873a3005-fbac-40d0-8919-f138a619f2fa => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:50.716193 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1d241169-e4f6-48b3-bb62-3520197abfb5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:50.716802 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1d241169-e4f6-48b3-bb62-3520197abfb5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 0dbbde45-f255-4ac5-8887-1ce8de673fca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:50.722732 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d241169-e4f6-48b3-bb62-3520197abfb5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:50.723229 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d241169-e4f6-48b3-bb62-3520197abfb5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:50.723648 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d241169-e4f6-48b3-bb62-3520197abfb5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:50.724347 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d241169-e4f6-48b3-bb62-3520197abfb5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:50.724899 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d241169-e4f6-48b3-bb62-3520197abfb5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:50.725251 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d241169-e4f6-48b3-bb62-3520197abfb5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:50.937227 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f3b0abf1-e702-4212-b9a8-fdcfe24035ef tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee820071e6e4d2f9c3daa61f23c58e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc684ec2e4d4a6283dbb5566ccb8d60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:50.945753 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1d241169-e4f6-48b3-bb62-3520197abfb5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:50.948016 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f3b0abf1-e702-4212-b9a8-fdcfe24035ef tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] 10.222.0.60 "GET /compute/v2.1/servers/c1a558f2-6710-4ab0-92fc-03076dcb4408" status: 200 len: 1522 microversion: 2.1 time: 0.284857 Oct 18 15:35:50.948983 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1323/2529] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:50 2022] GET /compute/v2.1/servers/c1a558f2-6710-4ab0-92fc-03076dcb4408 => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:50.954251 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c5067418-f3e2-48d2-9a26-b78787dcd9fe tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:50.955135 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c5067418-f3e2-48d2-9a26-b78787dcd9fe tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 89919fa6-1fd6-42d0-ab81-d0cdebc3960c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:50.960434 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1d241169-e4f6-48b3-bb62-3520197abfb5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca" status: 200 len: 1469 microversion: 2.1 time: 0.248239 Oct 18 15:35:50.961645 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1207/2530] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:50 2022] GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca => generated 1469 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:50.961756 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c5067418-f3e2-48d2-9a26-b78787dcd9fe tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:50.962464 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c5067418-f3e2-48d2-9a26-b78787dcd9fe tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:50.962910 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c5067418-f3e2-48d2-9a26-b78787dcd9fe tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:50.963710 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c5067418-f3e2-48d2-9a26-b78787dcd9fe tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:50.964277 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c5067418-f3e2-48d2-9a26-b78787dcd9fe tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:50.964695 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c5067418-f3e2-48d2-9a26-b78787dcd9fe tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:51.091475 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-7c410716-8471-4867-b0a8-cd8d3a26d516 req-c1c09997-46ae-4dc9-850b-90939654fb07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dbbde45-f255-4ac5-8887-1ce8de673fca", "name": "network-vif-plugged", "status": "completed", "tag": "0ad973d8-f2bb-4e15-a985-502b69cec140"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:35:51.105748 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7c410716-8471-4867-b0a8-cd8d3a26d516 req-c1c09997-46ae-4dc9-850b-90939654fb07 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:51.106237 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7c410716-8471-4867-b0a8-cd8d3a26d516 req-c1c09997-46ae-4dc9-850b-90939654fb07 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:51.106670 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7c410716-8471-4867-b0a8-cd8d3a26d516 req-c1c09997-46ae-4dc9-850b-90939654fb07 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:51.120217 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c5067418-f3e2-48d2-9a26-b78787dcd9fe tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:51.121453 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-7c410716-8471-4867-b0a8-cd8d3a26d516 req-c1c09997-46ae-4dc9-850b-90939654fb07 service nova] Creating event network-vif-plugged:0ad973d8-f2bb-4e15-a985-502b69cec140 for instance 0dbbde45-f255-4ac5-8887-1ce8de673fca on n-h1-853682-5 Oct 18 15:35:51.128704 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c5067418-f3e2-48d2-9a26-b78787dcd9fe tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/89919fa6-1fd6-42d0-ab81-d0cdebc3960c" status: 200 len: 1312 microversion: 2.1 time: 0.178634 Oct 18 15:35:51.129260 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [req-7c410716-8471-4867-b0a8-cd8d3a26d516 req-c1c09997-46ae-4dc9-850b-90939654fb07 service nova] Instance 0dbbde45-f255-4ac5-8887-1ce8de673fca is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853682-5', 'n-h1-853682-5'} {{(pid=120406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 18 15:35:51.129779 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1324/2531] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:50 2022] GET /compute/v2.1/servers/89919fa6-1fd6-42d0-ab81-d0cdebc3960c => generated 1312 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:51.142531 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-7c410716-8471-4867-b0a8-cd8d3a26d516 req-c1c09997-46ae-4dc9-850b-90939654fb07 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055619 Oct 18 15:35:51.143891 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1208/2532] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:35:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:35:51.359198 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f46453ba-eba1-4c01-be9b-2b354f6127b8 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:51.359821 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f46453ba-eba1-4c01-be9b-2b354f6127b8 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 511cbc18-aef9-4202-9616-decd6651e931] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:51.366055 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f46453ba-eba1-4c01-be9b-2b354f6127b8 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:51.366533 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f46453ba-eba1-4c01-be9b-2b354f6127b8 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:51.366965 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f46453ba-eba1-4c01-be9b-2b354f6127b8 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:51.367656 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f46453ba-eba1-4c01-be9b-2b354f6127b8 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:51.368679 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f46453ba-eba1-4c01-be9b-2b354f6127b8 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:51.369420 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f46453ba-eba1-4c01-be9b-2b354f6127b8 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:51.501044 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f46453ba-eba1-4c01-be9b-2b354f6127b8 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:51.509409 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f46453ba-eba1-4c01-be9b-2b354f6127b8 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/511cbc18-aef9-4202-9616-decd6651e931" status: 200 len: 1367 microversion: 2.1 time: 0.153522 Oct 18 15:35:51.509987 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1325/2533] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:51 2022] GET /compute/v2.1/servers/511cbc18-aef9-4202-9616-decd6651e931 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:51.679986 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2e085381-6490-49b0-88a0-c06ff428a676 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:51.681414 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2e085381-6490-49b0-88a0-c06ff428a676 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] [instance: 63a69f32-61bc-41d2-a358-636ae638f654] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:51.689108 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e085381-6490-49b0-88a0-c06ff428a676 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:51.689732 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e085381-6490-49b0-88a0-c06ff428a676 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:51.690273 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e085381-6490-49b0-88a0-c06ff428a676 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:51.691094 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e085381-6490-49b0-88a0-c06ff428a676 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:51.691763 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e085381-6490-49b0-88a0-c06ff428a676 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:51.692291 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e085381-6490-49b0-88a0-c06ff428a676 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:51.734140 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-55a96f08-52dc-4be5-8d0e-48e40566d40d tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:51.734709 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-55a96f08-52dc-4be5-8d0e-48e40566d40d tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] [instance: 873a3005-fbac-40d0-8919-f138a619f2fa] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:51.741533 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-55a96f08-52dc-4be5-8d0e-48e40566d40d tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:51.745087 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-55a96f08-52dc-4be5-8d0e-48e40566d40d tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:51.745747 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-55a96f08-52dc-4be5-8d0e-48e40566d40d tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:51.746796 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-55a96f08-52dc-4be5-8d0e-48e40566d40d tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:51.747424 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-55a96f08-52dc-4be5-8d0e-48e40566d40d tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:51.748321 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-55a96f08-52dc-4be5-8d0e-48e40566d40d tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:52.421815 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2e085381-6490-49b0-88a0-c06ff428a676 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bc878a0901409684ea58261475b1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88812dd7c80d47bba192382fccc31e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:52.434049 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2e085381-6490-49b0-88a0-c06ff428a676 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] 10.222.0.60 "GET /compute/v2.1/servers/63a69f32-61bc-41d2-a358-636ae638f654" status: 200 len: 1393 microversion: 2.1 time: 0.758539 Oct 18 15:35:52.434872 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1209/2534] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:51 2022] GET /compute/v2.1/servers/63a69f32-61bc-41d2-a358-636ae638f654 => generated 1393 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:52.443593 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0332349b-98bd-41b4-bf9a-2987fac60105 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:52.453759 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0332349b-98bd-41b4-bf9a-2987fac60105 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] [instance: c1a558f2-6710-4ab0-92fc-03076dcb4408] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:52.460226 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0332349b-98bd-41b4-bf9a-2987fac60105 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:52.460717 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0332349b-98bd-41b4-bf9a-2987fac60105 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:52.461192 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0332349b-98bd-41b4-bf9a-2987fac60105 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:52.462434 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0332349b-98bd-41b4-bf9a-2987fac60105 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:52.462894 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0332349b-98bd-41b4-bf9a-2987fac60105 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:52.463323 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0332349b-98bd-41b4-bf9a-2987fac60105 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:52.719431 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-55a96f08-52dc-4be5-8d0e-48e40566d40d tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a7ce3bb784a79b3ac336743b9ae84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a52e3135e52493b8ccb2d7342418591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:52.722962 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:35:52.732193 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-55a96f08-52dc-4be5-8d0e-48e40566d40d tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "GET /compute/v2.1/servers/873a3005-fbac-40d0-8919-f138a619f2fa" status: 200 len: 1315 microversion: 2.1 time: 1.001867 Oct 18 15:35:52.737936 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1326/2535] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:51 2022] GET /compute/v2.1/servers/873a3005-fbac-40d0-8919-f138a619f2fa => generated 1315 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:35:52.754176 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-15a5c355-f36c-4044-bc49-5ffc50658923 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:52.756726 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-15a5c355-f36c-4044-bc49-5ffc50658923 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 0dbbde45-f255-4ac5-8887-1ce8de673fca] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:52.778602 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-15a5c355-f36c-4044-bc49-5ffc50658923 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:52.779887 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-15a5c355-f36c-4044-bc49-5ffc50658923 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:52.785273 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-15a5c355-f36c-4044-bc49-5ffc50658923 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:52.786101 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-15a5c355-f36c-4044-bc49-5ffc50658923 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:52.786641 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-15a5c355-f36c-4044-bc49-5ffc50658923 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:52.787134 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-15a5c355-f36c-4044-bc49-5ffc50658923 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:52.845509 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0332349b-98bd-41b4-bf9a-2987fac60105 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee820071e6e4d2f9c3daa61f23c58e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc684ec2e4d4a6283dbb5566ccb8d60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:52.854592 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0332349b-98bd-41b4-bf9a-2987fac60105 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] 10.222.0.60 "GET /compute/v2.1/servers/c1a558f2-6710-4ab0-92fc-03076dcb4408" status: 200 len: 1522 microversion: 2.1 time: 0.417721 Oct 18 15:35:52.864833 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1210/2536] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:52 2022] GET /compute/v2.1/servers/c1a558f2-6710-4ab0-92fc-03076dcb4408 => generated 1522 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:52.864833 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ed921d54-3c6c-4169-bfab-069b4c1d327e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:52.864833 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ed921d54-3c6c-4169-bfab-069b4c1d327e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 89919fa6-1fd6-42d0-ab81-d0cdebc3960c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:52.875610 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed921d54-3c6c-4169-bfab-069b4c1d327e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:52.875610 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed921d54-3c6c-4169-bfab-069b4c1d327e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:52.875610 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed921d54-3c6c-4169-bfab-069b4c1d327e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:52.875610 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed921d54-3c6c-4169-bfab-069b4c1d327e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:52.876057 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed921d54-3c6c-4169-bfab-069b4c1d327e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:52.876057 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed921d54-3c6c-4169-bfab-069b4c1d327e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:53.103775 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-15a5c355-f36c-4044-bc49-5ffc50658923 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:53.114013 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-15a5c355-f36c-4044-bc49-5ffc50658923 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca" status: 200 len: 1469 microversion: 2.1 time: 0.371878 Oct 18 15:35:53.130367 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1327/2537] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:52 2022] GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca => generated 1469 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:53.140368 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-cc72f5aa-0c38-45dc-9b5c-dc8bc0112c3d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:53.141255 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-cc72f5aa-0c38-45dc-9b5c-dc8bc0112c3d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 511cbc18-aef9-4202-9616-decd6651e931] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:53.143143 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=95,nova_api:UPDATE=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:35:53.155502 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cc72f5aa-0c38-45dc-9b5c-dc8bc0112c3d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:53.156195 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cc72f5aa-0c38-45dc-9b5c-dc8bc0112c3d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:53.156787 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cc72f5aa-0c38-45dc-9b5c-dc8bc0112c3d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:53.157808 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cc72f5aa-0c38-45dc-9b5c-dc8bc0112c3d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:53.158415 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cc72f5aa-0c38-45dc-9b5c-dc8bc0112c3d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:53.158991 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cc72f5aa-0c38-45dc-9b5c-dc8bc0112c3d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:53.187422 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ed921d54-3c6c-4169-bfab-069b4c1d327e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:53.198410 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ed921d54-3c6c-4169-bfab-069b4c1d327e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/89919fa6-1fd6-42d0-ab81-d0cdebc3960c" status: 200 len: 1312 microversion: 2.1 time: 0.341625 Oct 18 15:35:53.199498 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1211/2538] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:52 2022] GET /compute/v2.1/servers/89919fa6-1fd6-42d0-ab81-d0cdebc3960c => generated 1312 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:53.210699 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-30428f75-1101-45d2-a7df-2cf016c21a28 req-22fa5c4b-209f-4cb8-85bd-0253eedf9c39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "511cbc18-aef9-4202-9616-decd6651e931", "name": "network-vif-plugged", "status": "completed", "tag": "b15f0bdc-90f5-4d7d-aeb4-725da17aace5"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:35:53.225093 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-30428f75-1101-45d2-a7df-2cf016c21a28 req-22fa5c4b-209f-4cb8-85bd-0253eedf9c39 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:53.226082 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-30428f75-1101-45d2-a7df-2cf016c21a28 req-22fa5c4b-209f-4cb8-85bd-0253eedf9c39 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:53.226949 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-30428f75-1101-45d2-a7df-2cf016c21a28 req-22fa5c4b-209f-4cb8-85bd-0253eedf9c39 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:53.240173 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-30428f75-1101-45d2-a7df-2cf016c21a28 req-22fa5c4b-209f-4cb8-85bd-0253eedf9c39 service nova] Creating event network-vif-plugged:b15f0bdc-90f5-4d7d-aeb4-725da17aace5 for instance 511cbc18-aef9-4202-9616-decd6651e931 on n-h2-853682-5 Oct 18 15:35:53.248628 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-30428f75-1101-45d2-a7df-2cf016c21a28 req-22fa5c4b-209f-4cb8-85bd-0253eedf9c39 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047677 Oct 18 15:35:53.253583 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1212/2539] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:35:53.447983 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-cc72f5aa-0c38-45dc-9b5c-dc8bc0112c3d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:53.462089 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bbf6bf32-54d3-47a9-a7b6-99d5eb766767 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:53.462792 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bbf6bf32-54d3-47a9-a7b6-99d5eb766767 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] [instance: 63a69f32-61bc-41d2-a358-636ae638f654] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:53.469231 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-cc72f5aa-0c38-45dc-9b5c-dc8bc0112c3d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/511cbc18-aef9-4202-9616-decd6651e931" status: 200 len: 1367 microversion: 2.1 time: 0.337452 Oct 18 15:35:53.479761 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bbf6bf32-54d3-47a9-a7b6-99d5eb766767 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:53.480259 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bbf6bf32-54d3-47a9-a7b6-99d5eb766767 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:53.480715 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1328/2540] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:53 2022] GET /compute/v2.1/servers/511cbc18-aef9-4202-9616-decd6651e931 => generated 1367 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:53.490943 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bbf6bf32-54d3-47a9-a7b6-99d5eb766767 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:53.491729 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bbf6bf32-54d3-47a9-a7b6-99d5eb766767 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:53.496655 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bbf6bf32-54d3-47a9-a7b6-99d5eb766767 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:53.497717 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bbf6bf32-54d3-47a9-a7b6-99d5eb766767 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:53.544887 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-bc984b06-a00c-457a-b63e-e3d5cdbb6d9d req-609ed772-e3c3-4eeb-8035-99d2d484d1c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4df91fe0-82c3-404b-ac29-8da7bdb0ef66", "name": "network-vif-deleted", "tag": "3937e97b-486e-43be-8bfa-74b0972bc6ce"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:35:53.574154 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-bc984b06-a00c-457a-b63e-e3d5cdbb6d9d req-609ed772-e3c3-4eeb-8035-99d2d484d1c2 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:53.582576 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-bc984b06-a00c-457a-b63e-e3d5cdbb6d9d req-609ed772-e3c3-4eeb-8035-99d2d484d1c2 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:53.583906 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-bc984b06-a00c-457a-b63e-e3d5cdbb6d9d req-609ed772-e3c3-4eeb-8035-99d2d484d1c2 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:53.622006 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-bc984b06-a00c-457a-b63e-e3d5cdbb6d9d req-609ed772-e3c3-4eeb-8035-99d2d484d1c2 service nova] Creating event network-vif-deleted:3937e97b-486e-43be-8bfa-74b0972bc6ce for instance 4df91fe0-82c3-404b-ac29-8da7bdb0ef66 on n-h2-853682-5 Oct 18 15:35:53.640858 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-bc984b06-a00c-457a-b63e-e3d5cdbb6d9d req-609ed772-e3c3-4eeb-8035-99d2d484d1c2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099527 Oct 18 15:35:53.642030 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1329/2541] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:35:53.719568 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bbf6bf32-54d3-47a9-a7b6-99d5eb766767 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bc878a0901409684ea58261475b1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88812dd7c80d47bba192382fccc31e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:53.728288 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bbf6bf32-54d3-47a9-a7b6-99d5eb766767 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] 10.222.0.60 "GET /compute/v2.1/servers/63a69f32-61bc-41d2-a358-636ae638f654" status: 200 len: 1393 microversion: 2.1 time: 0.269763 Oct 18 15:35:53.729001 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1213/2542] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:53 2022] GET /compute/v2.1/servers/63a69f32-61bc-41d2-a358-636ae638f654 => generated 1393 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:35:53.758920 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ae552ed0-4b49-4ebd-a741-d47ea2aeea7c tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:53.759618 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ae552ed0-4b49-4ebd-a741-d47ea2aeea7c tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] [instance: 873a3005-fbac-40d0-8919-f138a619f2fa] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:53.765857 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae552ed0-4b49-4ebd-a741-d47ea2aeea7c tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:53.766333 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae552ed0-4b49-4ebd-a741-d47ea2aeea7c tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:53.766768 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae552ed0-4b49-4ebd-a741-d47ea2aeea7c tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:53.767458 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae552ed0-4b49-4ebd-a741-d47ea2aeea7c tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:53.767912 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae552ed0-4b49-4ebd-a741-d47ea2aeea7c tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:53.768331 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae552ed0-4b49-4ebd-a741-d47ea2aeea7c tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:53.885166 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4ee6e6d3-a89a-4651-8ea6-a66c672c97bf tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:53.886432 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4ee6e6d3-a89a-4651-8ea6-a66c672c97bf tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] [instance: c1a558f2-6710-4ab0-92fc-03076dcb4408] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:53.894041 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ee6e6d3-a89a-4651-8ea6-a66c672c97bf tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:53.894555 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ee6e6d3-a89a-4651-8ea6-a66c672c97bf tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:53.894990 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ee6e6d3-a89a-4651-8ea6-a66c672c97bf tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:53.895728 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ee6e6d3-a89a-4651-8ea6-a66c672c97bf tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:53.896197 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ee6e6d3-a89a-4651-8ea6-a66c672c97bf tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:53.896870 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ee6e6d3-a89a-4651-8ea6-a66c672c97bf tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:53.940974 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ae552ed0-4b49-4ebd-a741-d47ea2aeea7c tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a7ce3bb784a79b3ac336743b9ae84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a52e3135e52493b8ccb2d7342418591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:53.951707 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ae552ed0-4b49-4ebd-a741-d47ea2aeea7c tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "GET /compute/v2.1/servers/873a3005-fbac-40d0-8919-f138a619f2fa" status: 200 len: 1315 microversion: 2.1 time: 0.195159 Oct 18 15:35:53.952491 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1330/2543] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:53 2022] GET /compute/v2.1/servers/873a3005-fbac-40d0-8919-f138a619f2fa => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:54.050587 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4ee6e6d3-a89a-4651-8ea6-a66c672c97bf tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee820071e6e4d2f9c3daa61f23c58e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc684ec2e4d4a6283dbb5566ccb8d60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:54.059200 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4ee6e6d3-a89a-4651-8ea6-a66c672c97bf tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] 10.222.0.60 "GET /compute/v2.1/servers/c1a558f2-6710-4ab0-92fc-03076dcb4408" status: 200 len: 1522 microversion: 2.1 time: 0.179479 Oct 18 15:35:54.059834 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1214/2544] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:53 2022] GET /compute/v2.1/servers/c1a558f2-6710-4ab0-92fc-03076dcb4408 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:35:54.143785 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b5f6b211-ab6c-4ec1-af49-9120d2ff19bd tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:54.144398 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b5f6b211-ab6c-4ec1-af49-9120d2ff19bd tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 0dbbde45-f255-4ac5-8887-1ce8de673fca] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:54.151329 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b5f6b211-ab6c-4ec1-af49-9120d2ff19bd tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:54.151809 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b5f6b211-ab6c-4ec1-af49-9120d2ff19bd tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:54.153097 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b5f6b211-ab6c-4ec1-af49-9120d2ff19bd tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:54.153880 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b5f6b211-ab6c-4ec1-af49-9120d2ff19bd tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:54.154317 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b5f6b211-ab6c-4ec1-af49-9120d2ff19bd tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:54.155392 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b5f6b211-ab6c-4ec1-af49-9120d2ff19bd tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:54.222744 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f51def28-1ff4-4df9-b80a-b6ac9d25d62d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:54.223706 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f51def28-1ff4-4df9-b80a-b6ac9d25d62d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 89919fa6-1fd6-42d0-ab81-d0cdebc3960c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:54.230571 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f51def28-1ff4-4df9-b80a-b6ac9d25d62d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:54.231049 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f51def28-1ff4-4df9-b80a-b6ac9d25d62d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:54.231479 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f51def28-1ff4-4df9-b80a-b6ac9d25d62d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:54.232253 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f51def28-1ff4-4df9-b80a-b6ac9d25d62d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:54.232620 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f51def28-1ff4-4df9-b80a-b6ac9d25d62d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:54.233264 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f51def28-1ff4-4df9-b80a-b6ac9d25d62d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:54.338150 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b5f6b211-ab6c-4ec1-af49-9120d2ff19bd tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:54.348527 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b5f6b211-ab6c-4ec1-af49-9120d2ff19bd tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca" status: 200 len: 1461 microversion: 2.1 time: 0.207111 Oct 18 15:35:54.350011 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1331/2545] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:54 2022] GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca => generated 1461 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:54.373598 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4cf2c38a-15c0-4b0f-8f8a-a1a334e1cbe1 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:54.374418 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4cf2c38a-15c0-4b0f-8f8a-a1a334e1cbe1 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] [instance: 0dbbde45-f255-4ac5-8887-1ce8de673fca] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:54.381822 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4cf2c38a-15c0-4b0f-8f8a-a1a334e1cbe1 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:54.382531 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4cf2c38a-15c0-4b0f-8f8a-a1a334e1cbe1 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:54.383128 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4cf2c38a-15c0-4b0f-8f8a-a1a334e1cbe1 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:54.384578 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4cf2c38a-15c0-4b0f-8f8a-a1a334e1cbe1 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:54.385221 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4cf2c38a-15c0-4b0f-8f8a-a1a334e1cbe1 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:54.385801 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4cf2c38a-15c0-4b0f-8f8a-a1a334e1cbe1 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:54.409731 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f51def28-1ff4-4df9-b80a-b6ac9d25d62d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:54.418669 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f51def28-1ff4-4df9-b80a-b6ac9d25d62d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/89919fa6-1fd6-42d0-ab81-d0cdebc3960c" status: 200 len: 1312 microversion: 2.1 time: 0.199573 Oct 18 15:35:54.419538 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1215/2546] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:54 2022] GET /compute/v2.1/servers/89919fa6-1fd6-42d0-ab81-d0cdebc3960c => generated 1312 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:35:54.496565 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-68f0e5a4-4f89-4387-b527-02565a8d9ee5 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:54.497350 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-68f0e5a4-4f89-4387-b527-02565a8d9ee5 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 511cbc18-aef9-4202-9616-decd6651e931] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:54.503363 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68f0e5a4-4f89-4387-b527-02565a8d9ee5 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:54.504108 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68f0e5a4-4f89-4387-b527-02565a8d9ee5 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:54.504639 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68f0e5a4-4f89-4387-b527-02565a8d9ee5 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:54.505450 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68f0e5a4-4f89-4387-b527-02565a8d9ee5 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:54.506014 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68f0e5a4-4f89-4387-b527-02565a8d9ee5 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:54.506536 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68f0e5a4-4f89-4387-b527-02565a8d9ee5 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:54.530634 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4cf2c38a-15c0-4b0f-8f8a-a1a334e1cbe1 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca" status: 200 len: 1612 microversion: 2.1 time: 0.160831 Oct 18 15:35:54.531216 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1332/2547] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:54 2022] GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca => generated 1612 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:35:54.570683 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-dd427ad7-f95d-43b3-bd6d-06f6d7edd660 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] Calling method '.version_select at 0x7f7c3d3bc040>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:54.576087 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dd427ad7-f95d-43b3-bd6d-06f6d7edd660 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:54.576761 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dd427ad7-f95d-43b3-bd6d-06f6d7edd660 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:54.577586 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dd427ad7-f95d-43b3-bd6d-06f6d7edd660 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:54.586466 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-dd427ad7-f95d-43b3-bd6d-06f6d7edd660 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] 10.222.0.60 "GET /compute/v2.1/os-migrations" status: 200 len: 409 microversion: 2.1 time: 0.020283 Oct 18 15:35:54.593444 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1333/2548] 10.222.0.60 () {58 vars in 1143 bytes} [Tue Oct 18 15:35:54 2022] GET /compute/v2.1/os-migrations => generated 409 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:35:54.751762 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-35dfdeb5-74fd-4cd9-8ad9-d1db6fb239ee tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:54.752622 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-35dfdeb5-74fd-4cd9-8ad9-d1db6fb239ee tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] [instance: 63a69f32-61bc-41d2-a358-636ae638f654] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:54.762676 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-35dfdeb5-74fd-4cd9-8ad9-d1db6fb239ee tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:54.763934 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-35dfdeb5-74fd-4cd9-8ad9-d1db6fb239ee tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:54.765335 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-35dfdeb5-74fd-4cd9-8ad9-d1db6fb239ee tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:54.770274 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-35dfdeb5-74fd-4cd9-8ad9-d1db6fb239ee tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:54.772832 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-35dfdeb5-74fd-4cd9-8ad9-d1db6fb239ee tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:54.777330 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-35dfdeb5-74fd-4cd9-8ad9-d1db6fb239ee tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:54.786086 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-68f0e5a4-4f89-4387-b527-02565a8d9ee5 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:54.800451 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-68f0e5a4-4f89-4387-b527-02565a8d9ee5 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/511cbc18-aef9-4202-9616-decd6651e931" status: 200 len: 1367 microversion: 2.1 time: 0.306854 Oct 18 15:35:54.801656 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1216/2549] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:54 2022] GET /compute/v2.1/servers/511cbc18-aef9-4202-9616-decd6651e931 => generated 1367 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:54.844467 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7f178801-4d13-4980-9fb3-55a9ef590d07 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-148299720", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:35:54.939136 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-7f178801-4d13-4980-9fb3-55a9ef590d07 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] validate_networks() for None {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:35:55.188569 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-35dfdeb5-74fd-4cd9-8ad9-d1db6fb239ee tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bc878a0901409684ea58261475b1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88812dd7c80d47bba192382fccc31e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:55.197201 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-35dfdeb5-74fd-4cd9-8ad9-d1db6fb239ee tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] 10.222.0.60 "GET /compute/v2.1/servers/63a69f32-61bc-41d2-a358-636ae638f654" status: 200 len: 1393 microversion: 2.1 time: 0.449445 Oct 18 15:35:55.209214 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1334/2550] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:54 2022] GET /compute/v2.1/servers/63a69f32-61bc-41d2-a358-636ae638f654 => generated 1393 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:35:55.219918 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4bab90e0-1729-4489-91a4-425a9162619c tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:55.220885 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4bab90e0-1729-4489-91a4-425a9162619c tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] [instance: 873a3005-fbac-40d0-8919-f138a619f2fa] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:55.230307 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4bab90e0-1729-4489-91a4-425a9162619c tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:55.231202 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4bab90e0-1729-4489-91a4-425a9162619c tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:55.231878 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4bab90e0-1729-4489-91a4-425a9162619c tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:55.232825 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4bab90e0-1729-4489-91a4-425a9162619c tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:55.233500 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4bab90e0-1729-4489-91a4-425a9162619c tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:55.234142 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4bab90e0-1729-4489-91a4-425a9162619c tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:55.523818 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4bab90e0-1729-4489-91a4-425a9162619c tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a7ce3bb784a79b3ac336743b9ae84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a52e3135e52493b8ccb2d7342418591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:55.549622 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4bab90e0-1729-4489-91a4-425a9162619c tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "GET /compute/v2.1/servers/873a3005-fbac-40d0-8919-f138a619f2fa" status: 200 len: 1503 microversion: 2.1 time: 0.338883 Oct 18 15:35:55.567422 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-7f178801-4d13-4980-9fb3-55a9ef590d07 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:35:55.567422 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-7f178801-4d13-4980-9fb3-55a9ef590d07 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:35:55.567422 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-7f178801-4d13-4980-9fb3-55a9ef590d07 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:35:55.567422 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-7f178801-4d13-4980-9fb3-55a9ef590d07 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:35:55.567422 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-7f178801-4d13-4980-9fb3-55a9ef590d07 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:35:55.569148 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1335/2551] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:55 2022] GET /compute/v2.1/servers/873a3005-fbac-40d0-8919-f138a619f2fa => generated 1503 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:55.575004 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e154499c-4807-4857-b016-4c5dd5216dbf tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:55.576120 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e154499c-4807-4857-b016-4c5dd5216dbf tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] [instance: c1a558f2-6710-4ab0-92fc-03076dcb4408] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:55.583171 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e154499c-4807-4857-b016-4c5dd5216dbf tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:55.583866 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e154499c-4807-4857-b016-4c5dd5216dbf tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:55.584494 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e154499c-4807-4857-b016-4c5dd5216dbf tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:55.586630 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e154499c-4807-4857-b016-4c5dd5216dbf tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:55.587270 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e154499c-4807-4857-b016-4c5dd5216dbf tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:55.587859 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e154499c-4807-4857-b016-4c5dd5216dbf tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:55.623841 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f178801-4d13-4980-9fb3-55a9ef590d07 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:55.624589 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f178801-4d13-4980-9fb3-55a9ef590d07 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:55.625145 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f178801-4d13-4980-9fb3-55a9ef590d07 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:55.626043 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f178801-4d13-4980-9fb3-55a9ef590d07 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:55.626588 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f178801-4d13-4980-9fb3-55a9ef590d07 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:55.627172 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f178801-4d13-4980-9fb3-55a9ef590d07 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:55.654099 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-7f178801-4d13-4980-9fb3-55a9ef590d07 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Getting quotas for project 91719d2b1f1640f391aa0b54c9725d2a. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:35:55.661322 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-7f178801-4d13-4980-9fb3-55a9ef590d07 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Getting quotas for user 926f2a98aa66431fab2a6032f21d5ae7 and project 91719d2b1f1640f391aa0b54c9725d2a. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:35:55.694845 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7f178801-4d13-4980-9fb3-55a9ef590d07 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:35:55.698887 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7f178801-4d13-4980-9fb3-55a9ef590d07 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 1c84f8ca-befc-489e-8068-135af3b766fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:35:55.759230 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7f178801-4d13-4980-9fb3-55a9ef590d07 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.922007 Oct 18 15:35:55.765875 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1217/2552] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:35:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 926 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:35:55.767952 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-f5d31d21-edfb-492f-8a06-6f9843aaa618 req-51a05408-2e0d-47e6-955f-8457fd3dd47e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63a69f32-61bc-41d2-a358-636ae638f654", "name": "network-vif-plugged", "status": "completed", "tag": "a646ae7c-f2fc-4861-89ce-5b219e36816a"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:35:55.785959 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f5d31d21-edfb-492f-8a06-6f9843aaa618 req-51a05408-2e0d-47e6-955f-8457fd3dd47e service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:55.786457 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f5d31d21-edfb-492f-8a06-6f9843aaa618 req-51a05408-2e0d-47e6-955f-8457fd3dd47e service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:55.786909 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f5d31d21-edfb-492f-8a06-6f9843aaa618 req-51a05408-2e0d-47e6-955f-8457fd3dd47e service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:55.813596 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-f5d31d21-edfb-492f-8a06-6f9843aaa618 req-51a05408-2e0d-47e6-955f-8457fd3dd47e service nova] Creating event network-vif-plugged:a646ae7c-f2fc-4861-89ce-5b219e36816a for instance 63a69f32-61bc-41d2-a358-636ae638f654 on n-h2-853682-5 Oct 18 15:35:55.815390 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e154499c-4807-4857-b016-4c5dd5216dbf tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee820071e6e4d2f9c3daa61f23c58e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc684ec2e4d4a6283dbb5566ccb8d60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:55.823819 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-f5d31d21-edfb-492f-8a06-6f9843aaa618 req-51a05408-2e0d-47e6-955f-8457fd3dd47e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057458 Oct 18 15:35:55.824699 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1218/2553] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:35:55.827065 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e154499c-4807-4857-b016-4c5dd5216dbf tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] 10.222.0.60 "GET /compute/v2.1/servers/c1a558f2-6710-4ab0-92fc-03076dcb4408" status: 200 len: 1522 microversion: 2.1 time: 0.256482 Oct 18 15:35:55.828156 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1336/2554] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:55 2022] GET /compute/v2.1/servers/c1a558f2-6710-4ab0-92fc-03076dcb4408 => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:55.834915 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ca321d1b-066e-4e7b-ab88-4893e6839bb1 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1120818367"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:35:55.835809 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ca321d1b-066e-4e7b-ab88-4893e6839bb1 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] [instance: 873a3005-fbac-40d0-8919-f138a619f2fa] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:55.842323 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca321d1b-066e-4e7b-ab88-4893e6839bb1 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:55.845358 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca321d1b-066e-4e7b-ab88-4893e6839bb1 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:55.846857 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca321d1b-066e-4e7b-ab88-4893e6839bb1 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:55.847847 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca321d1b-066e-4e7b-ab88-4893e6839bb1 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:55.848046 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9e38d9d8-a9d3-40cb-b74a-41ab308a6a93 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:55.848732 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca321d1b-066e-4e7b-ab88-4893e6839bb1 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:55.849283 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9e38d9d8-a9d3-40cb-b74a-41ab308a6a93 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 89919fa6-1fd6-42d0-ab81-d0cdebc3960c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:55.849855 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca321d1b-066e-4e7b-ab88-4893e6839bb1 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:55.860502 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e38d9d8-a9d3-40cb-b74a-41ab308a6a93 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:55.861272 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e38d9d8-a9d3-40cb-b74a-41ab308a6a93 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:55.861467 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e38d9d8-a9d3-40cb-b74a-41ab308a6a93 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:55.862221 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e38d9d8-a9d3-40cb-b74a-41ab308a6a93 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:55.862651 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e38d9d8-a9d3-40cb-b74a-41ab308a6a93 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:55.863232 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e38d9d8-a9d3-40cb-b74a-41ab308a6a93 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:56.259216 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.network.security_group_api [None req-ca321d1b-066e-4e7b-ab88-4893e6839bb1 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Adding security group 17ea2ba0-b64e-47a9-8ee4-1a4237ce9745 to port bb5c9526-9ebb-4b59-8df6-40f1393cf4b0 Oct 18 15:35:56.466410 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9e38d9d8-a9d3-40cb-b74a-41ab308a6a93 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:56.475976 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9e38d9d8-a9d3-40cb-b74a-41ab308a6a93 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/89919fa6-1fd6-42d0-ab81-d0cdebc3960c" status: 200 len: 1312 microversion: 2.1 time: 0.646841 Oct 18 15:35:56.476560 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1219/2555] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:55 2022] GET /compute/v2.1/servers/89919fa6-1fd6-42d0-ab81-d0cdebc3960c => generated 1312 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:56.491947 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5358100f-c849-4dbb-ad05-315d511e878c tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:56.492750 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5358100f-c849-4dbb-ad05-315d511e878c tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 1c84f8ca-befc-489e-8068-135af3b766fe] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:56.592832 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5358100f-c849-4dbb-ad05-315d511e878c tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:56.601508 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5358100f-c849-4dbb-ad05-315d511e878c tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe" status: 200 len: 1212 microversion: 2.1 time: 0.113533 Oct 18 15:35:56.602653 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1220/2556] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:56 2022] GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe => generated 1212 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:56.611831 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b29a4a56-63ef-42ee-9194-048665603de2 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:56.616232 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b29a4a56-63ef-42ee-9194-048665603de2 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 511cbc18-aef9-4202-9616-decd6651e931] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:56.629990 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b29a4a56-63ef-42ee-9194-048665603de2 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:56.632076 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b29a4a56-63ef-42ee-9194-048665603de2 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:56.638188 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b29a4a56-63ef-42ee-9194-048665603de2 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:56.642140 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b29a4a56-63ef-42ee-9194-048665603de2 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:56.642654 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b29a4a56-63ef-42ee-9194-048665603de2 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:56.643096 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b29a4a56-63ef-42ee-9194-048665603de2 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:56.882338 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b29a4a56-63ef-42ee-9194-048665603de2 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:56.898276 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b29a4a56-63ef-42ee-9194-048665603de2 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/511cbc18-aef9-4202-9616-decd6651e931" status: 200 len: 1558 microversion: 2.1 time: 0.294227 Oct 18 15:35:56.899166 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1221/2557] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:56 2022] GET /compute/v2.1/servers/511cbc18-aef9-4202-9616-decd6651e931 => generated 1558 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:56.905478 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-ceb88cc9-8041-4037-95c0-9649d65536e4 req-4aab1b08-df82-426d-97ff-f424c3468a36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1a558f2-6710-4ab0-92fc-03076dcb4408", "name": "network-vif-deleted", "tag": "2799e185-c707-4732-964a-3994e3877409"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:35:56.906537 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ca321d1b-066e-4e7b-ab88-4893e6839bb1 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "POST /compute/v2.1/servers/873a3005-fbac-40d0-8919-f138a619f2fa/action" status: 202 len: 0 microversion: 2.1 time: 1.075952 Oct 18 15:35:56.907878 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1337/2558] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:35:55 2022] POST /compute/v2.1/servers/873a3005-fbac-40d0-8919-f138a619f2fa/action => generated 0 bytes in 1079 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:35:56.912968 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0508d389-d20f-48fd-9620-88323eba61d2 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:56.913823 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0508d389-d20f-48fd-9620-88323eba61d2 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] [instance: 63a69f32-61bc-41d2-a358-636ae638f654] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:56.920644 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0508d389-d20f-48fd-9620-88323eba61d2 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:56.920801 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ceb88cc9-8041-4037-95c0-9649d65536e4 req-4aab1b08-df82-426d-97ff-f424c3468a36 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:56.921221 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0508d389-d20f-48fd-9620-88323eba61d2 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:56.921327 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ceb88cc9-8041-4037-95c0-9649d65536e4 req-4aab1b08-df82-426d-97ff-f424c3468a36 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:56.921676 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ceb88cc9-8041-4037-95c0-9649d65536e4 req-4aab1b08-df82-426d-97ff-f424c3468a36 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:56.933342 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0508d389-d20f-48fd-9620-88323eba61d2 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:56.934154 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0508d389-d20f-48fd-9620-88323eba61d2 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:56.934643 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0508d389-d20f-48fd-9620-88323eba61d2 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:56.936956 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0508d389-d20f-48fd-9620-88323eba61d2 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:56.937402 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-ceb88cc9-8041-4037-95c0-9649d65536e4 req-4aab1b08-df82-426d-97ff-f424c3468a36 service nova] Creating event network-vif-deleted:2799e185-c707-4732-964a-3994e3877409 for instance c1a558f2-6710-4ab0-92fc-03076dcb4408 on n-h1-853682-5 Oct 18 15:35:56.944628 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-ceb88cc9-8041-4037-95c0-9649d65536e4 req-4aab1b08-df82-426d-97ff-f424c3468a36 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043711 Oct 18 15:35:56.949706 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1222/2559] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:35:56.959397 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f991d972-43b3-40a8-adae-44da0c9bf9d3 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:56.960683 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f991d972-43b3-40a8-adae-44da0c9bf9d3 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] [instance: c1a558f2-6710-4ab0-92fc-03076dcb4408] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:56.970123 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f991d972-43b3-40a8-adae-44da0c9bf9d3 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:56.970989 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f991d972-43b3-40a8-adae-44da0c9bf9d3 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:56.971881 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f991d972-43b3-40a8-adae-44da0c9bf9d3 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:56.973271 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f991d972-43b3-40a8-adae-44da0c9bf9d3 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:56.973942 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f991d972-43b3-40a8-adae-44da0c9bf9d3 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:56.974582 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f991d972-43b3-40a8-adae-44da0c9bf9d3 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:57.012259 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f991d972-43b3-40a8-adae-44da0c9bf9d3 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:57.013143 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f991d972-43b3-40a8-adae-44da0c9bf9d3 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:57.013907 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f991d972-43b3-40a8-adae-44da0c9bf9d3 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:57.014588 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-f991d972-43b3-40a8-adae-44da0c9bf9d3 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lazy-loading 'fault' on Instance uuid c1a558f2-6710-4ab0-92fc-03076dcb4408 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:35:57.103048 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f991d972-43b3-40a8-adae-44da0c9bf9d3 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ee820071e6e4d2f9c3daa61f23c58e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc684ec2e4d4a6283dbb5566ccb8d60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:57.111283 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f991d972-43b3-40a8-adae-44da0c9bf9d3 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] 10.222.0.60 "GET /compute/v2.1/servers/c1a558f2-6710-4ab0-92fc-03076dcb4408" status: 200 len: 1312 microversion: 2.1 time: 0.160118 Oct 18 15:35:57.117349 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1223/2560] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:56 2022] GET /compute/v2.1/servers/c1a558f2-6710-4ab0-92fc-03076dcb4408 => generated 1312 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:57.124707 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-de01a669-40fb-44ac-a975-8a3d6fe2694f req-a75b4cda-b8a8-428b-857c-aa280ec45f26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "873a3005-fbac-40d0-8919-f138a619f2fa", "tag": "bb5c9526-9ebb-4b59-8df6-40f1393cf4b0"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:35:57.138241 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-de01a669-40fb-44ac-a975-8a3d6fe2694f req-a75b4cda-b8a8-428b-857c-aa280ec45f26 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:57.138830 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-de01a669-40fb-44ac-a975-8a3d6fe2694f req-a75b4cda-b8a8-428b-857c-aa280ec45f26 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:57.139500 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-de01a669-40fb-44ac-a975-8a3d6fe2694f req-a75b4cda-b8a8-428b-857c-aa280ec45f26 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:57.144239 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:35:57.155514 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-de01a669-40fb-44ac-a975-8a3d6fe2694f req-a75b4cda-b8a8-428b-857c-aa280ec45f26 service nova] Creating event network-changed:bb5c9526-9ebb-4b59-8df6-40f1393cf4b0 for instance 873a3005-fbac-40d0-8919-f138a619f2fa on n-h1-853682-5 Oct 18 15:35:57.161173 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-de01a669-40fb-44ac-a975-8a3d6fe2694f req-a75b4cda-b8a8-428b-857c-aa280ec45f26 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043559 Oct 18 15:35:57.162668 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1224/2561] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:35:57.167949 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7baf88e0-21ff-4a98-8806-ce31c24ad5d0 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-417257281"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:35:57.168580 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7baf88e0-21ff-4a98-8806-ce31c24ad5d0 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] [instance: 873a3005-fbac-40d0-8919-f138a619f2fa] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:57.176195 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7baf88e0-21ff-4a98-8806-ce31c24ad5d0 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:57.176685 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7baf88e0-21ff-4a98-8806-ce31c24ad5d0 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:57.177151 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7baf88e0-21ff-4a98-8806-ce31c24ad5d0 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:57.177854 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7baf88e0-21ff-4a98-8806-ce31c24ad5d0 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:57.178317 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7baf88e0-21ff-4a98-8806-ce31c24ad5d0 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:57.178756 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7baf88e0-21ff-4a98-8806-ce31c24ad5d0 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:57.190025 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0508d389-d20f-48fd-9620-88323eba61d2 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bc878a0901409684ea58261475b1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88812dd7c80d47bba192382fccc31e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:57.202495 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0508d389-d20f-48fd-9620-88323eba61d2 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] 10.222.0.60 "GET /compute/v2.1/servers/63a69f32-61bc-41d2-a358-636ae638f654" status: 200 len: 1393 microversion: 2.1 time: 0.292425 Oct 18 15:35:57.203484 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1338/2562] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:56 2022] GET /compute/v2.1/servers/63a69f32-61bc-41d2-a358-636ae638f654 => generated 1393 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:57.222560 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7f60a150-9e5c-4ab2-9f2b-03379595f8ad tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:57.223100 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7f60a150-9e5c-4ab2-9f2b-03379595f8ad tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 511cbc18-aef9-4202-9616-decd6651e931] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:57.233032 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7f60a150-9e5c-4ab2-9f2b-03379595f8ad tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:57.234158 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7f60a150-9e5c-4ab2-9f2b-03379595f8ad tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:57.234758 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7f60a150-9e5c-4ab2-9f2b-03379595f8ad tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:57.235666 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7f60a150-9e5c-4ab2-9f2b-03379595f8ad tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:57.236271 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7f60a150-9e5c-4ab2-9f2b-03379595f8ad tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:57.236891 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7f60a150-9e5c-4ab2-9f2b-03379595f8ad tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:57.358851 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7f60a150-9e5c-4ab2-9f2b-03379595f8ad tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/511cbc18-aef9-4202-9616-decd6651e931/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.154170 Oct 18 15:35:57.359867 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1339/2563] 10.222.0.60 () {58 vars in 1275 bytes} [Tue Oct 18 15:35:57 2022] GET /compute/v2.1/servers/511cbc18-aef9-4202-9616-decd6651e931/os-interface => generated 285 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:35:57.510752 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-762bf3da-32e0-4d00-a956-ab7a075e47cb tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:57.511429 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-762bf3da-32e0-4d00-a956-ab7a075e47cb tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 89919fa6-1fd6-42d0-ab81-d0cdebc3960c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:57.551806 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-762bf3da-32e0-4d00-a956-ab7a075e47cb tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:57.556069 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-762bf3da-32e0-4d00-a956-ab7a075e47cb tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:57.558170 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-762bf3da-32e0-4d00-a956-ab7a075e47cb tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:57.563239 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-762bf3da-32e0-4d00-a956-ab7a075e47cb tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:57.563804 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-762bf3da-32e0-4d00-a956-ab7a075e47cb tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:57.568260 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-762bf3da-32e0-4d00-a956-ab7a075e47cb tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:57.653275 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.network.security_group_api [None req-7baf88e0-21ff-4a98-8806-ce31c24ad5d0 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Adding security group 7dcd6ce8-f2c0-49fb-867a-43d7db3e45e4 to port bb5c9526-9ebb-4b59-8df6-40f1393cf4b0 Oct 18 15:35:57.974852 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-762bf3da-32e0-4d00-a956-ab7a075e47cb tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:57.987414 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-762bf3da-32e0-4d00-a956-ab7a075e47cb tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/89919fa6-1fd6-42d0-ab81-d0cdebc3960c" status: 200 len: 1312 microversion: 2.1 time: 0.489445 Oct 18 15:35:57.988624 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1340/2564] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:57 2022] GET /compute/v2.1/servers/89919fa6-1fd6-42d0-ab81-d0cdebc3960c => generated 1312 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:58.001138 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fbd3d871-38a7-4884-8825-de56b55a34f9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:58.002009 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-fbd3d871-38a7-4884-8825-de56b55a34f9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 1c84f8ca-befc-489e-8068-135af3b766fe] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:58.014416 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fbd3d871-38a7-4884-8825-de56b55a34f9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:58.015204 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fbd3d871-38a7-4884-8825-de56b55a34f9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:58.015841 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fbd3d871-38a7-4884-8825-de56b55a34f9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:58.016722 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fbd3d871-38a7-4884-8825-de56b55a34f9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:58.017352 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fbd3d871-38a7-4884-8825-de56b55a34f9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:58.017969 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fbd3d871-38a7-4884-8825-de56b55a34f9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:58.195779 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-fbd3d871-38a7-4884-8825-de56b55a34f9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:58.207397 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fbd3d871-38a7-4884-8825-de56b55a34f9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe" status: 200 len: 1264 microversion: 2.1 time: 0.216419 Oct 18 15:35:58.220886 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1341/2565] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:57 2022] GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe => generated 1264 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:58.238314 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-306be597-380f-4040-80ed-e97538c52b68 req-df15c92d-c6af-4ea1-88ef-0c67332e1956 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89919fa6-1fd6-42d0-ab81-d0cdebc3960c", "name": "network-vif-plugged", "status": "completed", "tag": "82b30c0f-9d62-4ecd-bb2b-b3f207ddc518"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:35:58.258337 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-306be597-380f-4040-80ed-e97538c52b68 req-df15c92d-c6af-4ea1-88ef-0c67332e1956 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:58.259528 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-306be597-380f-4040-80ed-e97538c52b68 req-df15c92d-c6af-4ea1-88ef-0c67332e1956 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:58.261986 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-306be597-380f-4040-80ed-e97538c52b68 req-df15c92d-c6af-4ea1-88ef-0c67332e1956 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:58.287553 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-306be597-380f-4040-80ed-e97538c52b68 req-df15c92d-c6af-4ea1-88ef-0c67332e1956 service nova] Creating event network-vif-plugged:82b30c0f-9d62-4ecd-bb2b-b3f207ddc518 for instance 89919fa6-1fd6-42d0-ab81-d0cdebc3960c on n-h1-853682-5 Oct 18 15:35:58.303827 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-306be597-380f-4040-80ed-e97538c52b68 req-df15c92d-c6af-4ea1-88ef-0c67332e1956 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077744 Oct 18 15:35:58.304854 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1342/2566] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:35:58.316186 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d64d822e-a929-43c6-9642-0f9b23d0184e tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:58.323355 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d64d822e-a929-43c6-9642-0f9b23d0184e tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] [instance: c1a558f2-6710-4ab0-92fc-03076dcb4408] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:58.333067 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d64d822e-a929-43c6-9642-0f9b23d0184e tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:58.333712 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d64d822e-a929-43c6-9642-0f9b23d0184e tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:58.334256 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d64d822e-a929-43c6-9642-0f9b23d0184e tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:58.335086 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d64d822e-a929-43c6-9642-0f9b23d0184e tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:58.335686 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d64d822e-a929-43c6-9642-0f9b23d0184e tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:58.336214 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d64d822e-a929-43c6-9642-0f9b23d0184e tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:58.373212 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-d64d822e-a929-43c6-9642-0f9b23d0184e tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] HTTP exception thrown: Instance c1a558f2-6710-4ab0-92fc-03076dcb4408 could not be found. Oct 18 15:35:58.375333 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d64d822e-a929-43c6-9642-0f9b23d0184e tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Request method failure captured: Oct 18 15:35:58.375333 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/c1a558f2-6710-4ab0-92fc-03076dcb4408 HTTP/1.1 Oct 18 15:35:58.375333 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:35:58.375333 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:35:58.375333 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:35:58.375333 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:35:58.375333 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:35:58.375333 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:35:58.375333 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:35:58.375333 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:35:58.375333 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsekOH3Pn3S8ZVeUzjVp88lwx55TD72QhXDYTTCo8oJTuOkyIbQr8SDgKMEhySJyiX-Gmkd0ybBIXywragPoWfRPJ1IgAMf1ZKJCHv9ITgS5UDJ4XnH20WXWxMxCn5Afyv46OnIgXXeeztnZUfG7cAN_rdF3taqI29os0sYj04Qj3wM Oct 18 15:35:58.375333 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:35:58.375333 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:35:58.375333 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:35:58.375333 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:35:58.375333 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:35:58.375333 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:35:58.375333 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: ffc684ec2e4d4a6283dbb5566ccb8d60 Oct 18 15:35:58.375333 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ListServersNegativeTestJSON-870435735 Oct 18 15:35:58.375333 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:35:58.375333 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:35:58.376952 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ffc684ec2e4d4a6283dbb5566ccb8d60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ffc684ec2e4d4a6283dbb5566ccb8d60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ffc684ec2e4d4a6283dbb5566ccb8d60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ffc684ec2e4d4a6283dbb5566ccb8d60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:35:58.376952 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ListServersNegativeTestJSON-870435735 Oct 18 15:35:58.376952 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: ffc684ec2e4d4a6283dbb5566ccb8d60 Oct 18 15:35:58.376952 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-870435735 Oct 18 15:35:58.376952 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ListServersNegativeTestJSON-870435735-project Oct 18 15:35:58.376952 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:35:58.376952 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:35:58.376952 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 6ee820071e6e4d2f9c3daa61f23c58e7 Oct 18 15:35:58.376952 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ListServersNegativeTestJSON-870435735-project Oct 18 15:35:58.376952 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:35:58.376952 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance c1a558f2-6710-4ab0-92fc-03076dcb4408 could not be found. Oct 18 15:35:58.376952 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'c1a558f2-6710-4ab0-92fc-03076dcb4408'} Oct 18 15:35:58.377830 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:35:58.377830 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:35:58.377830 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:35:58.377830 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:35:58.377830 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:35:58.377830 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:35:58.377830 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:35:58.377830 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:35:58.377830 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:35:58.377830 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:35:58.377830 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1a558f2-6710-4ab0-92fc-03076dcb4408 could not be found. Oct 18 15:35:58.377830 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:35:58.377830 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:35:58.377830 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:35:58.377830 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:35:58.377830 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:35:58.377830 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:35:58.377830 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:35:58.377830 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:35:58.377830 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:35:58.379327 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:35:58.379327 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:35:58.379327 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:35:58.379327 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:35:58.379327 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:35:58.379327 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:35:58.379327 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:35:58.379327 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1a558f2-6710-4ab0-92fc-03076dcb4408 could not be found. Oct 18 15:35:58.379327 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:35:58.379327 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:35:58.379327 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:35:58.379327 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:35:58.379327 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:35:58.379327 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:35:58.379327 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:35:58.379327 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:35:58.379327 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1a558f2-6710-4ab0-92fc-03076dcb4408 could not be found. Oct 18 15:35:58.379327 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:35:58.380575 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d64d822e-a929-43c6-9642-0f9b23d0184e tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Returning 404 to user: Instance c1a558f2-6710-4ab0-92fc-03076dcb4408 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:35:58.382214 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d64d822e-a929-43c6-9642-0f9b23d0184e tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] 10.222.0.60 "GET /compute/v2.1/servers/c1a558f2-6710-4ab0-92fc-03076dcb4408" status: 404 len: 111 microversion: 2.1 time: 0.075315 Oct 18 15:35:58.384371 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1343/2567] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:58 2022] GET /compute/v2.1/servers/c1a558f2-6710-4ab0-92fc-03076dcb4408 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:35:58.403577 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-89103af5-2495-4184-a02d-2e788688057d tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:58.404202 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-89103af5-2495-4184-a02d-2e788688057d tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] [instance: 63a69f32-61bc-41d2-a358-636ae638f654] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:58.412676 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-89103af5-2495-4184-a02d-2e788688057d tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:58.413689 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-89103af5-2495-4184-a02d-2e788688057d tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:58.414296 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-89103af5-2495-4184-a02d-2e788688057d tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:58.415998 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-89103af5-2495-4184-a02d-2e788688057d tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:58.416625 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-89103af5-2495-4184-a02d-2e788688057d tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:58.417498 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-89103af5-2495-4184-a02d-2e788688057d tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:59.025530 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-89103af5-2495-4184-a02d-2e788688057d tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bc878a0901409684ea58261475b1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88812dd7c80d47bba192382fccc31e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:59.039031 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-89103af5-2495-4184-a02d-2e788688057d tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] 10.222.0.60 "GET /compute/v2.1/servers/63a69f32-61bc-41d2-a358-636ae638f654" status: 200 len: 1575 microversion: 2.1 time: 0.652727 Oct 18 15:35:59.040166 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1344/2568] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:58 2022] GET /compute/v2.1/servers/63a69f32-61bc-41d2-a358-636ae638f654 => generated 1575 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:59.053198 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7baf88e0-21ff-4a98-8806-ce31c24ad5d0 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "POST /compute/v2.1/servers/873a3005-fbac-40d0-8919-f138a619f2fa/action" status: 202 len: 0 microversion: 2.1 time: 1.879279 Oct 18 15:35:59.053198 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1225/2569] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:35:57 2022] POST /compute/v2.1/servers/873a3005-fbac-40d0-8919-f138a619f2fa/action => generated 0 bytes in 1885 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:35:59.054497 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-14812df9-1819-4afa-936c-855e235eaed5 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:59.055954 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-14812df9-1819-4afa-936c-855e235eaed5 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] [instance: 4df91fe0-82c3-404b-ac29-8da7bdb0ef66] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:59.065433 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-56bad371-3a1f-4f4e-a077-1412e850ad3f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:59.066061 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-56bad371-3a1f-4f4e-a077-1412e850ad3f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 89919fa6-1fd6-42d0-ab81-d0cdebc3960c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:59.073281 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-56bad371-3a1f-4f4e-a077-1412e850ad3f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:59.073770 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-56bad371-3a1f-4f4e-a077-1412e850ad3f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:59.074203 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-56bad371-3a1f-4f4e-a077-1412e850ad3f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:59.075187 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-56bad371-3a1f-4f4e-a077-1412e850ad3f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:59.075646 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-56bad371-3a1f-4f4e-a077-1412e850ad3f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:59.076279 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-56bad371-3a1f-4f4e-a077-1412e850ad3f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:59.077539 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14812df9-1819-4afa-936c-855e235eaed5 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:59.078170 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14812df9-1819-4afa-936c-855e235eaed5 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:59.078638 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14812df9-1819-4afa-936c-855e235eaed5 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:59.079373 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14812df9-1819-4afa-936c-855e235eaed5 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:59.080331 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14812df9-1819-4afa-936c-855e235eaed5 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:59.081048 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14812df9-1819-4afa-936c-855e235eaed5 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:59.102069 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-14812df9-1819-4afa-936c-855e235eaed5 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] HTTP exception thrown: Instance 4df91fe0-82c3-404b-ac29-8da7bdb0ef66 could not be found. Oct 18 15:35:59.104441 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-14812df9-1819-4afa-936c-855e235eaed5 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Request method failure captured: Oct 18 15:35:59.104441 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/4df91fe0-82c3-404b-ac29-8da7bdb0ef66 HTTP/1.1 Oct 18 15:35:59.104441 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:35:59.104441 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:35:59.104441 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:35:59.104441 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:35:59.104441 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:35:59.104441 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:35:59.104441 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:35:59.104441 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:35:59.104441 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsekOH3Pn3S8ZVeUzjVp88lwx55TD72QhXDYTTCo8oJTuOkyIbQr8SDgKMEhySJyiX-Gmkd0ybBIXywragPoWfRPJ1IgAMf1ZKJCHv9ITgS5UDJ4XnH20WXWxMxCn5Afyv46OnIgXXeeztnZUfG7cAN_rdF3taqI29os0sYj04Qj3wM Oct 18 15:35:59.104441 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:35:59.104441 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:35:59.104441 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:35:59.104441 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:35:59.104441 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:35:59.104441 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:35:59.104441 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: ffc684ec2e4d4a6283dbb5566ccb8d60 Oct 18 15:35:59.104441 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ListServersNegativeTestJSON-870435735 Oct 18 15:35:59.104441 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:35:59.104441 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:35:59.106809 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ffc684ec2e4d4a6283dbb5566ccb8d60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ffc684ec2e4d4a6283dbb5566ccb8d60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ffc684ec2e4d4a6283dbb5566ccb8d60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ffc684ec2e4d4a6283dbb5566ccb8d60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:35:59.106809 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ListServersNegativeTestJSON-870435735 Oct 18 15:35:59.106809 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: ffc684ec2e4d4a6283dbb5566ccb8d60 Oct 18 15:35:59.106809 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-870435735 Oct 18 15:35:59.106809 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ListServersNegativeTestJSON-870435735-project Oct 18 15:35:59.106809 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:35:59.106809 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:35:59.106809 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 6ee820071e6e4d2f9c3daa61f23c58e7 Oct 18 15:35:59.106809 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ListServersNegativeTestJSON-870435735-project Oct 18 15:35:59.106809 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:35:59.106809 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 4df91fe0-82c3-404b-ac29-8da7bdb0ef66 could not be found. Oct 18 15:35:59.106809 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '4df91fe0-82c3-404b-ac29-8da7bdb0ef66'} Oct 18 15:35:59.110041 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:35:59.110041 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:35:59.110041 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:35:59.110041 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:35:59.110041 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:35:59.110041 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:35:59.110041 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:35:59.110041 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:35:59.110041 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:35:59.110041 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:35:59.110041 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4df91fe0-82c3-404b-ac29-8da7bdb0ef66 could not be found. Oct 18 15:35:59.110041 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:35:59.110041 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:35:59.110041 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:35:59.110041 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:35:59.110041 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:35:59.110041 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:35:59.110041 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:35:59.110041 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:35:59.110041 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:35:59.112134 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:35:59.112134 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:35:59.112134 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:35:59.112134 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:35:59.112134 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:35:59.112134 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:35:59.112134 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:35:59.112134 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4df91fe0-82c3-404b-ac29-8da7bdb0ef66 could not be found. Oct 18 15:35:59.112134 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:35:59.112134 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:35:59.112134 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:35:59.112134 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:35:59.112134 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:35:59.112134 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:35:59.112134 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:35:59.112134 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:35:59.112134 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4df91fe0-82c3-404b-ac29-8da7bdb0ef66 could not be found. Oct 18 15:35:59.112134 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:35:59.114644 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-14812df9-1819-4afa-936c-855e235eaed5 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] Returning 404 to user: Instance 4df91fe0-82c3-404b-ac29-8da7bdb0ef66 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:35:59.115530 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-14812df9-1819-4afa-936c-855e235eaed5 tempest-ListServersNegativeTestJSON-870435735 tempest-ListServersNegativeTestJSON-870435735-project] 10.222.0.60 "GET /compute/v2.1/servers/4df91fe0-82c3-404b-ac29-8da7bdb0ef66" status: 404 len: 111 microversion: 2.1 time: 0.066507 Oct 18 15:35:59.116288 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1226/2570] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:59 2022] GET /compute/v2.1/servers/4df91fe0-82c3-404b-ac29-8da7bdb0ef66 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:35:59.122085 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3e3976e7-ad7a-447f-abae-562da96f4cb1 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:59.122885 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3e3976e7-ad7a-447f-abae-562da96f4cb1 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] [instance: 873a3005-fbac-40d0-8919-f138a619f2fa] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:59.133488 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e3976e7-ad7a-447f-abae-562da96f4cb1 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:59.135965 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e3976e7-ad7a-447f-abae-562da96f4cb1 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:59.136684 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e3976e7-ad7a-447f-abae-562da96f4cb1 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:59.137630 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e3976e7-ad7a-447f-abae-562da96f4cb1 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:59.138336 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e3976e7-ad7a-447f-abae-562da96f4cb1 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:59.138957 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e3976e7-ad7a-447f-abae-562da96f4cb1 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:59.443073 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=10 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:35:59.486902 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-56bad371-3a1f-4f4e-a077-1412e850ad3f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:59.495963 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-56bad371-3a1f-4f4e-a077-1412e850ad3f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/89919fa6-1fd6-42d0-ab81-d0cdebc3960c" status: 200 len: 1312 microversion: 2.1 time: 0.440662 Oct 18 15:35:59.509625 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1345/2571] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:59 2022] GET /compute/v2.1/servers/89919fa6-1fd6-42d0-ab81-d0cdebc3960c => generated 1312 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:59.514984 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e1a376c0-feab-47dc-bf5f-01750976e7e5 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:59.515708 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e1a376c0-feab-47dc-bf5f-01750976e7e5 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] [instance: 63a69f32-61bc-41d2-a358-636ae638f654] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:59.522892 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e1a376c0-feab-47dc-bf5f-01750976e7e5 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:59.530073 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e1a376c0-feab-47dc-bf5f-01750976e7e5 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:59.530916 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e1a376c0-feab-47dc-bf5f-01750976e7e5 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:59.531986 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e1a376c0-feab-47dc-bf5f-01750976e7e5 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:59.532762 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e1a376c0-feab-47dc-bf5f-01750976e7e5 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:59.533382 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e1a376c0-feab-47dc-bf5f-01750976e7e5 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:59.759977 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3e3976e7-ad7a-447f-abae-562da96f4cb1 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "GET /compute/v2.1/servers/873a3005-fbac-40d0-8919-f138a619f2fa/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.642374 Oct 18 15:35:59.761195 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1227/2572] 10.222.0.60 () {58 vars in 1293 bytes} [Tue Oct 18 15:35:59 2022] GET /compute/v2.1/servers/873a3005-fbac-40d0-8919-f138a619f2fa/os-security-groups => generated 1157 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:35:59.766084 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-2176cb00-a456-40d1-ad38-c44086e274be req-ef7cebff-42d7-4f8e-850d-e4428eac2334 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "873a3005-fbac-40d0-8919-f138a619f2fa", "tag": "bb5c9526-9ebb-4b59-8df6-40f1393cf4b0"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:35:59.782920 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2176cb00-a456-40d1-ad38-c44086e274be req-ef7cebff-42d7-4f8e-850d-e4428eac2334 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:59.783690 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2176cb00-a456-40d1-ad38-c44086e274be req-ef7cebff-42d7-4f8e-850d-e4428eac2334 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:59.784295 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2176cb00-a456-40d1-ad38-c44086e274be req-ef7cebff-42d7-4f8e-850d-e4428eac2334 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:59.799680 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-2176cb00-a456-40d1-ad38-c44086e274be req-ef7cebff-42d7-4f8e-850d-e4428eac2334 service nova] Creating event network-changed:bb5c9526-9ebb-4b59-8df6-40f1393cf4b0 for instance 873a3005-fbac-40d0-8919-f138a619f2fa on n-h1-853682-5 Oct 18 15:35:59.809966 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-2176cb00-a456-40d1-ad38-c44086e274be req-ef7cebff-42d7-4f8e-850d-e4428eac2334 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047242 Oct 18 15:35:59.810922 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1228/2573] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:35:59.817292 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-678b9160-455f-4dc4-a31f-714c01ab234a tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:35:59.818374 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-678b9160-455f-4dc4-a31f-714c01ab234a tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 1c84f8ca-befc-489e-8068-135af3b766fe] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:35:59.826315 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-678b9160-455f-4dc4-a31f-714c01ab234a tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:59.827019 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-678b9160-455f-4dc4-a31f-714c01ab234a tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:59.827780 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-678b9160-455f-4dc4-a31f-714c01ab234a tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:59.828933 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-678b9160-455f-4dc4-a31f-714c01ab234a tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:35:59.829544 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-678b9160-455f-4dc4-a31f-714c01ab234a tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:35:59.830412 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-678b9160-455f-4dc4-a31f-714c01ab234a tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:35:59.869000 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e1a376c0-feab-47dc-bf5f-01750976e7e5 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] 10.222.0.60 "GET /compute/v2.1/servers/63a69f32-61bc-41d2-a358-636ae638f654/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.357964 Oct 18 15:35:59.870026 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1346/2574] 10.222.0.60 () {58 vars in 1275 bytes} [Tue Oct 18 15:35:59 2022] GET /compute/v2.1/servers/63a69f32-61bc-41d2-a358-636ae638f654/os-interface => generated 285 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:35:59.875297 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-61a2e9cd-12ec-4d3b-9cf1-8636dceba83b tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Action: 'create', calling method: .version_select at 0x7f7c3d74bb80>, body: {"security_group": {"name": " tempest-securitygroup -865120503 ", "description": "tempest-description-1115212402"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:35:59.962774 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-678b9160-455f-4dc4-a31f-714c01ab234a tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:35:59.977951 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-678b9160-455f-4dc4-a31f-714c01ab234a tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe" status: 200 len: 1270 microversion: 2.1 time: 0.163131 Oct 18 15:35:59.979439 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1229/2575] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:35:59 2022] GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe => generated 1270 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:00.400578 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-61a2e9cd-12ec-4d3b-9cf1-8636dceba83b tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.529395 Oct 18 15:36:00.401217 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1347/2576] 10.222.0.60 () {60 vars in 1180 bytes} [Tue Oct 18 15:35:59 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:36:00.417718 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-57fae148-4027-45d1-8acb-0da595cb2253 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '.version_select at 0x7f7c3d9ff280>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:00.534329 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-156c4be6-cf9c-4f84-9eca-b14dcfb8b269 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:00.535334 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-156c4be6-cf9c-4f84-9eca-b14dcfb8b269 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 89919fa6-1fd6-42d0-ab81-d0cdebc3960c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:00.544099 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-156c4be6-cf9c-4f84-9eca-b14dcfb8b269 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:00.544927 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-156c4be6-cf9c-4f84-9eca-b14dcfb8b269 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:00.545659 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-156c4be6-cf9c-4f84-9eca-b14dcfb8b269 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:00.546530 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-156c4be6-cf9c-4f84-9eca-b14dcfb8b269 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:00.547134 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-156c4be6-cf9c-4f84-9eca-b14dcfb8b269 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:00.547798 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-156c4be6-cf9c-4f84-9eca-b14dcfb8b269 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:00.576087 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=100 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:36:00.616126 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-57fae148-4027-45d1-8acb-0da595cb2253 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups/8111cd8b-860e-429c-aa96-5b5be728c11c" status: 200 len: 223 microversion: 2.1 time: 0.202200 Oct 18 15:36:00.616860 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1230/2577] 10.222.0.60 () {58 vars in 1269 bytes} [Tue Oct 18 15:36:00 2022] GET /compute/v2.1/os-security-groups/8111cd8b-860e-429c-aa96-5b5be728c11c => generated 223 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:36:00.632196 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-89c89fbc-b4d2-43cc-8d2f-151007888eba tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '.version_select at 0x7f7c3d315c10>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:01.025397 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-156c4be6-cf9c-4f84-9eca-b14dcfb8b269 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:01.035492 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-156c4be6-cf9c-4f84-9eca-b14dcfb8b269 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/89919fa6-1fd6-42d0-ab81-d0cdebc3960c" status: 200 len: 1462 microversion: 2.1 time: 0.506876 Oct 18 15:36:01.036685 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1348/2578] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:00 2022] GET /compute/v2.1/servers/89919fa6-1fd6-42d0-ab81-d0cdebc3960c => generated 1462 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:36:01.046894 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6a0f135a-9e3a-4426-9bdb-280d8b502a13 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:01.049789 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6a0f135a-9e3a-4426-9bdb-280d8b502a13 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 1c84f8ca-befc-489e-8068-135af3b766fe] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:01.068355 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6a0f135a-9e3a-4426-9bdb-280d8b502a13 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:01.069385 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6a0f135a-9e3a-4426-9bdb-280d8b502a13 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:01.069986 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6a0f135a-9e3a-4426-9bdb-280d8b502a13 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:01.070948 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6a0f135a-9e3a-4426-9bdb-280d8b502a13 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:01.071569 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6a0f135a-9e3a-4426-9bdb-280d8b502a13 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:01.072156 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6a0f135a-9e3a-4426-9bdb-280d8b502a13 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:01.500689 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6a0f135a-9e3a-4426-9bdb-280d8b502a13 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:01.519842 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6a0f135a-9e3a-4426-9bdb-280d8b502a13 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe" status: 200 len: 1312 microversion: 2.1 time: 0.481728 Oct 18 15:36:01.541352 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1349/2579] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:01 2022] GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe => generated 1312 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:01.565343 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-89c89fbc-b4d2-43cc-8d2f-151007888eba tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/8111cd8b-860e-429c-aa96-5b5be728c11c" status: 202 len: 0 microversion: 2.1 time: 0.938444 Oct 18 15:36:01.570214 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1231/2580] 10.222.0.60 () {58 vars in 1272 bytes} [Tue Oct 18 15:36:00 2022] DELETE /compute/v2.1/os-security-groups/8111cd8b-860e-429c-aa96-5b5be728c11c => generated 0 bytes in 940 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:36:01.577398 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2c7895f0-44d8-4f9b-aaa4-d98c38e7b3eb tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '.version_select at 0x7f7c3d12e550>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:01.632525 n-d-853682-5 devstack@n-api.service[120406]: DEBUG neutronclient.v2_0.client [None req-2c7895f0-44d8-4f9b-aaa4-d98c38e7b3eb tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8111cd8b-860e-429c-aa96-5b5be728c11c does not exist", "detail": ""}} {{(pid=120406) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 15:36:01.633815 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.security_group_api [None req-2c7895f0-44d8-4f9b-aaa4-d98c38e7b3eb tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Neutron security group 8111cd8b-860e-429c-aa96-5b5be728c11c not found {{(pid=120406) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 18 15:36:01.634349 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-2c7895f0-44d8-4f9b-aaa4-d98c38e7b3eb tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] HTTP exception thrown: Security group 8111cd8b-860e-429c-aa96-5b5be728c11c does not exist Oct 18 15:36:01.634349 n-d-853682-5 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-63ae4d74-22f1-406e-9145-aaf1f3dfbfb2'] Oct 18 15:36:01.642995 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2c7895f0-44d8-4f9b-aaa4-d98c38e7b3eb tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Request method failure captured: Oct 18 15:36:01.642995 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/os-security-groups/8111cd8b-860e-429c-aa96-5b5be728c11c HTTP/1.1 Oct 18 15:36:01.642995 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:36:01.642995 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:36:01.642995 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:36:01.642995 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:36:01.642995 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:36:01.642995 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:36:01.642995 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:36:01.642995 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:36:01.642995 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTse7fx2cnRaPoLjX5bcuOlHRsv5T7hjqupUR5Anksomh4sN2LXU4nAUs-nTlixOWx8rLooo7F4iO4MJJqXUn20Cug_7k-y3pRg9Zq_jy4SxiI9MxMze0dh6g1ffY8M4Eh1QOt6Xa2yz2Z8B-7cmZxI0dcYo33xex1kmG4oUGiUJl_0M Oct 18 15:36:01.642995 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:36:01.642995 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:36:01.642995 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:36:01.642995 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:36:01.642995 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:36:01.642995 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:36:01.642995 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 6a52e3135e52493b8ccb2d7342418591 Oct 18 15:36:01.642995 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-SecurityGroupsTestJSON-974652461 Oct 18 15:36:01.642995 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:36:01.642995 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:36:01.644407 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:36:01.644407 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-SecurityGroupsTestJSON-974652461 Oct 18 15:36:01.644407 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 6a52e3135e52493b8ccb2d7342418591 Oct 18 15:36:01.644407 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-974652461 Oct 18 15:36:01.644407 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-SecurityGroupsTestJSON-974652461-project Oct 18 15:36:01.644407 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:36:01.644407 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:36:01.644407 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: ee9a7ce3bb784a79b3ac336743b9ae84 Oct 18 15:36:01.644407 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-SecurityGroupsTestJSON-974652461-project Oct 18 15:36:01.644407 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:36:01.644407 n-d-853682-5 devstack@n-api.service[120406]: exception: Security group 8111cd8b-860e-429c-aa96-5b5be728c11c does not exist Oct 18 15:36:01.644407 n-d-853682-5 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-63ae4d74-22f1-406e-9145-aaf1f3dfbfb2'] Oct 18 15:36:01.644407 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '8111cd8b-860e-429c-aa96-5b5be728c11c'} Oct 18 15:36:01.645331 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:36:01.645331 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:01.645331 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 18 15:36:01.645331 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 18 15:36:01.645331 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:01.645331 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:01.645331 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 18 15:36:01.645331 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 18 15:36:01.645331 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:01.645331 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:01.645331 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 15:36:01.645331 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 15:36:01.645331 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:01.645331 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:01.645331 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 15:36:01.645331 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 15:36:01.645331 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:01.645331 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:01.645331 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 15:36:01.646402 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 15:36:01.646402 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:01.646402 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:01.646402 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 15:36:01.646402 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 15:36:01.646402 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 15:36:01.646402 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 15:36:01.646402 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8111cd8b-860e-429c-aa96-5b5be728c11c does not exist Oct 18 15:36:01.646402 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-63ae4d74-22f1-406e-9145-aaf1f3dfbfb2'] Oct 18 15:36:01.646402 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:01.646402 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:01.646402 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:01.646402 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:01.646402 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 18 15:36:01.646402 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 18 15:36:01.646402 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 18 15:36:01.646402 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 15:36:01.646402 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8111cd8b-860e-429c-aa96-5b5be728c11c does not exist Oct 18 15:36:01.647560 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-63ae4d74-22f1-406e-9145-aaf1f3dfbfb2'] Oct 18 15:36:01.647560 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:01.647560 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:01.647560 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:01.647560 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:01.647560 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:36:01.647560 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:36:01.647560 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:36:01.647560 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:36:01.647560 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:36:01.647560 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:36:01.647560 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:36:01.647560 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:36:01.647560 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 18 15:36:01.647560 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 15:36:01.647560 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8111cd8b-860e-429c-aa96-5b5be728c11c does not exist Oct 18 15:36:01.647560 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-63ae4d74-22f1-406e-9145-aaf1f3dfbfb2'] Oct 18 15:36:01.647560 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:01.647560 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:01.647560 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:01.647560 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:01.648763 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:36:01.648763 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:36:01.648763 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:36:01.648763 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:36:01.648763 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8111cd8b-860e-429c-aa96-5b5be728c11c does not exist Oct 18 15:36:01.648763 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-63ae4d74-22f1-406e-9145-aaf1f3dfbfb2'] Oct 18 15:36:01.648763 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:01.648763 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2c7895f0-44d8-4f9b-aaa4-d98c38e7b3eb tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Returning 404 to user: Security group 8111cd8b-860e-429c-aa96-5b5be728c11c does not exist Oct 18 15:36:01.648763 n-d-853682-5 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-63ae4d74-22f1-406e-9145-aaf1f3dfbfb2'] {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:36:01.648763 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2c7895f0-44d8-4f9b-aaa4-d98c38e7b3eb tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups/8111cd8b-860e-429c-aa96-5b5be728c11c" status: 404 len: 194 microversion: 2.1 time: 0.074249 Oct 18 15:36:01.651685 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1232/2581] 10.222.0.60 () {58 vars in 1269 bytes} [Tue Oct 18 15:36:01 2022] GET /compute/v2.1/os-security-groups/8111cd8b-860e-429c-aa96-5b5be728c11c => generated 194 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:36:01.689005 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-101c9141-34e2-457e-857b-b76853e2fd90 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Action: 'create', calling method: .version_select at 0x7f7c3d0b95e0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-557167701", "description": "tempest-description-697989363"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:36:01.923920 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5cfead64-681e-4f0f-9b1f-7043a92e8b4f tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:01.932741 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5cfead64-681e-4f0f-9b1f-7043a92e8b4f tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Searching by: {'deleted': False, 'project_id': '28af6d5a70984ae8a5a3a0cc72bd8194'} {{(pid=120405) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 15:36:01.943427 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5cfead64-681e-4f0f-9b1f-7043a92e8b4f tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:01.944263 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5cfead64-681e-4f0f-9b1f-7043a92e8b4f tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:01.945040 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5cfead64-681e-4f0f-9b1f-7043a92e8b4f tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:01.946058 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5cfead64-681e-4f0f-9b1f-7043a92e8b4f tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:01.946896 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5cfead64-681e-4f0f-9b1f-7043a92e8b4f tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:01.948328 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5cfead64-681e-4f0f-9b1f-7043a92e8b4f tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:02.102924 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5cfead64-681e-4f0f-9b1f-7043a92e8b4f tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.559412 Oct 18 15:36:02.117454 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1350/2582] 10.222.0.60 () {58 vars in 1146 bytes} [Tue Oct 18 15:36:01 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:36:02.126826 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-9ed48968-8544-4705-9283-54dc87d268ba req-68c50fc8-54fc-4964-bd0e-84cd798fb7c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "511cbc18-aef9-4202-9616-decd6651e931", "tag": "b15f0bdc-90f5-4d7d-aeb4-725da17aace5"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:36:02.139964 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-9ed48968-8544-4705-9283-54dc87d268ba req-68c50fc8-54fc-4964-bd0e-84cd798fb7c5 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:02.140455 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-9ed48968-8544-4705-9283-54dc87d268ba req-68c50fc8-54fc-4964-bd0e-84cd798fb7c5 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:02.140989 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-9ed48968-8544-4705-9283-54dc87d268ba req-68c50fc8-54fc-4964-bd0e-84cd798fb7c5 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:02.154706 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-9ed48968-8544-4705-9283-54dc87d268ba req-68c50fc8-54fc-4964-bd0e-84cd798fb7c5 service nova] Creating event network-changed:b15f0bdc-90f5-4d7d-aeb4-725da17aace5 for instance 511cbc18-aef9-4202-9616-decd6651e931 on n-h2-853682-5 Oct 18 15:36:02.160841 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-9ed48968-8544-4705-9283-54dc87d268ba req-68c50fc8-54fc-4964-bd0e-84cd798fb7c5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041472 Oct 18 15:36:02.161989 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1351/2583] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:36:02.170149 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f3087f83-c639-4760-9a6e-a07f34329b42 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:02.172713 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f3087f83-c639-4760-9a6e-a07f34329b42 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] [instance: 5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:02.181419 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f3087f83-c639-4760-9a6e-a07f34329b42 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:02.181911 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f3087f83-c639-4760-9a6e-a07f34329b42 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:02.182358 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f3087f83-c639-4760-9a6e-a07f34329b42 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:02.183137 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f3087f83-c639-4760-9a6e-a07f34329b42 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:02.184529 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f3087f83-c639-4760-9a6e-a07f34329b42 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:02.185049 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f3087f83-c639-4760-9a6e-a07f34329b42 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:02.247788 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f3087f83-c639-4760-9a6e-a07f34329b42 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] 10.222.0.60 "GET /compute/v2.1/servers/5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.083473 Oct 18 15:36:02.248982 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1352/2584] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 15:36:02 2022] GET /compute/v2.1/servers/5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e/os-volume_attachments => generated 25 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:36:02.254691 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2951a644-7136-4505-9091-dc11eb24c11a tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:02.264569 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2951a644-7136-4505-9091-dc11eb24c11a tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Searching by: {'deleted': False} {{(pid=120405) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 15:36:02.271184 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2951a644-7136-4505-9091-dc11eb24c11a tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:02.272094 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2951a644-7136-4505-9091-dc11eb24c11a tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:02.272538 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2951a644-7136-4505-9091-dc11eb24c11a tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:02.273320 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2951a644-7136-4505-9091-dc11eb24c11a tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:02.274558 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2951a644-7136-4505-9091-dc11eb24c11a tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:02.275167 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2951a644-7136-4505-9091-dc11eb24c11a tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:02.456156 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.multi_cell_list [None req-2951a644-7136-4505-9091-dc11eb24c11a tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Listed batch of 10 results from cell out of 1000 limit. Returned 10 total so far. {{(pid=120405) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 15:36:02.572753 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2951a644-7136-4505-9091-dc11eb24c11a tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:02.573457 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2951a644-7136-4505-9091-dc11eb24c11a tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:02.573940 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2951a644-7136-4505-9091-dc11eb24c11a tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:02.683571 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-101c9141-34e2-457e-857b-b76853e2fd90 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.030170 Oct 18 15:36:02.685168 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1233/2585] 10.222.0.60 () {60 vars in 1180 bytes} [Tue Oct 18 15:36:01 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:36:02.690753 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2d58b811-d1d2-4e56-b08b-048a09271d97 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:02.698266 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2d58b811-d1d2-4e56-b08b-048a09271d97 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] [instance: 5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:02.717075 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d58b811-d1d2-4e56-b08b-048a09271d97 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:02.720883 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d58b811-d1d2-4e56-b08b-048a09271d97 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:02.721587 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d58b811-d1d2-4e56-b08b-048a09271d97 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:02.726865 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d58b811-d1d2-4e56-b08b-048a09271d97 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:02.728832 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d58b811-d1d2-4e56-b08b-048a09271d97 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:02.729461 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d58b811-d1d2-4e56-b08b-048a09271d97 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:02.792004 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2d58b811-d1d2-4e56-b08b-048a09271d97 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] 10.222.0.60 "GET /compute/v2.1/servers/5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.104802 Oct 18 15:36:02.793302 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1234/2586] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 15:36:02 2022] GET /compute/v2.1/servers/5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e/os-volume_attachments => generated 25 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:36:02.800335 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-893b0da8-dcc9-4c5a-a30f-e9cb0deb80d5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:02.802449 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-893b0da8-dcc9-4c5a-a30f-e9cb0deb80d5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 1c84f8ca-befc-489e-8068-135af3b766fe] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:02.811264 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-893b0da8-dcc9-4c5a-a30f-e9cb0deb80d5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:02.812279 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-893b0da8-dcc9-4c5a-a30f-e9cb0deb80d5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:02.812849 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-893b0da8-dcc9-4c5a-a30f-e9cb0deb80d5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:02.814000 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-893b0da8-dcc9-4c5a-a30f-e9cb0deb80d5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:02.815292 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-893b0da8-dcc9-4c5a-a30f-e9cb0deb80d5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:02.816381 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-893b0da8-dcc9-4c5a-a30f-e9cb0deb80d5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:03.315571 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-893b0da8-dcc9-4c5a-a30f-e9cb0deb80d5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:03.327709 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-893b0da8-dcc9-4c5a-a30f-e9cb0deb80d5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe" status: 200 len: 1312 microversion: 2.1 time: 0.532820 Oct 18 15:36:03.328324 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1235/2587] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:02 2022] GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe => generated 1312 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:03.338530 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f0fa8c6a-bc34-4cd6-a731-945aa518c917 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Action: 'create', calling method: .version_select at 0x7f7c3ed28820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-369525031", "description": "tempest-description-501710930"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:36:03.983404 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2951a644-7136-4505-9091-dc11eb24c11a tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 16582 microversion: 2.1 time: 1.732955 Oct 18 15:36:03.983999 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1353/2588] 10.222.0.60 () {58 vars in 1171 bytes} [Tue Oct 18 15:36:02 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 16582 bytes in 1734 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:36:03.988639 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-cfb6eab0-361e-4db2-b2b6-ee8a2f2679cc tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:03.989171 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-cfb6eab0-361e-4db2-b2b6-ee8a2f2679cc tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] [instance: 5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:03.997252 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cfb6eab0-361e-4db2-b2b6-ee8a2f2679cc tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:03.998040 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cfb6eab0-361e-4db2-b2b6-ee8a2f2679cc tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:03.999344 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cfb6eab0-361e-4db2-b2b6-ee8a2f2679cc tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:04.000439 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cfb6eab0-361e-4db2-b2b6-ee8a2f2679cc tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:04.009663 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cfb6eab0-361e-4db2-b2b6-ee8a2f2679cc tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:04.014643 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cfb6eab0-361e-4db2-b2b6-ee8a2f2679cc tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:04.028702 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f0fa8c6a-bc34-4cd6-a731-945aa518c917 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.699197 Oct 18 15:36:04.037859 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1236/2589] 10.222.0.60 () {60 vars in 1180 bytes} [Tue Oct 18 15:36:03 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:36:04.044730 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ecd976d4-f3ac-47b2-82f5-526150c5fbe0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:04.045266 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ecd976d4-f3ac-47b2-82f5-526150c5fbe0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: b7ebc01d-7008-4ca7-a82b-094962216ceb] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:04.047303 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:36:04.062295 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ecd976d4-f3ac-47b2-82f5-526150c5fbe0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:04.062798 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ecd976d4-f3ac-47b2-82f5-526150c5fbe0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:04.063233 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ecd976d4-f3ac-47b2-82f5-526150c5fbe0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:04.063959 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ecd976d4-f3ac-47b2-82f5-526150c5fbe0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:04.066905 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ecd976d4-f3ac-47b2-82f5-526150c5fbe0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:04.068830 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ecd976d4-f3ac-47b2-82f5-526150c5fbe0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:04.116369 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-cfb6eab0-361e-4db2-b2b6-ee8a2f2679cc tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] [instance: 5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:36:04.180578 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ecd976d4-f3ac-47b2-82f5-526150c5fbe0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: b7ebc01d-7008-4ca7-a82b-094962216ceb] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:36:04.281289 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-cfb6eab0-361e-4db2-b2b6-ee8a2f2679cc tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e" status: 204 len: 0 microversion: 2.1 time: 0.291870 Oct 18 15:36:04.289922 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1354/2590] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:36:03 2022] DELETE /compute/v2.1/servers/5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:36:04.303784 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e4cf54d3-aa66-4c30-929a-e1054d0208f1 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:04.305116 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e4cf54d3-aa66-4c30-929a-e1054d0208f1 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] [instance: 63a69f32-61bc-41d2-a358-636ae638f654] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:04.312647 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4cf54d3-aa66-4c30-929a-e1054d0208f1 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:04.313615 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4cf54d3-aa66-4c30-929a-e1054d0208f1 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:04.314339 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4cf54d3-aa66-4c30-929a-e1054d0208f1 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:04.315457 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4cf54d3-aa66-4c30-929a-e1054d0208f1 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:04.316126 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4cf54d3-aa66-4c30-929a-e1054d0208f1 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:04.316950 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4cf54d3-aa66-4c30-929a-e1054d0208f1 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:04.371513 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ecd976d4-f3ac-47b2-82f5-526150c5fbe0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b7ebc01d-7008-4ca7-a82b-094962216ceb" status: 204 len: 0 microversion: 2.1 time: 0.331795 Oct 18 15:36:04.372190 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1237/2591] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:36:04 2022] DELETE /compute/v2.1/servers/b7ebc01d-7008-4ca7-a82b-094962216ceb => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:36:04.379199 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-985bb39b-8a82-43c8-b304-39422d18cd45 req-7fe93125-e1b7-4166-922b-03988f5ac4cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63a69f32-61bc-41d2-a358-636ae638f654", "tag": "a646ae7c-f2fc-4861-89ce-5b219e36816a"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:36:04.390566 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-985bb39b-8a82-43c8-b304-39422d18cd45 req-7fe93125-e1b7-4166-922b-03988f5ac4cd service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:04.392244 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-985bb39b-8a82-43c8-b304-39422d18cd45 req-7fe93125-e1b7-4166-922b-03988f5ac4cd service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:04.393420 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-985bb39b-8a82-43c8-b304-39422d18cd45 req-7fe93125-e1b7-4166-922b-03988f5ac4cd service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:04.416143 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-985bb39b-8a82-43c8-b304-39422d18cd45 req-7fe93125-e1b7-4166-922b-03988f5ac4cd service nova] Creating event network-changed:a646ae7c-f2fc-4861-89ce-5b219e36816a for instance 63a69f32-61bc-41d2-a358-636ae638f654 on n-h2-853682-5 Oct 18 15:36:04.423067 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-985bb39b-8a82-43c8-b304-39422d18cd45 req-7fe93125-e1b7-4166-922b-03988f5ac4cd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049246 Oct 18 15:36:04.424968 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1238/2592] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:36:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:36:04.434308 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4727b5ce-656b-4026-8865-74b96f7639da tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:04.442755 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4727b5ce-656b-4026-8865-74b96f7639da tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Searching by: {'deleted': False, 'project_id': '28af6d5a70984ae8a5a3a0cc72bd8194'} {{(pid=120406) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 15:36:04.456168 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4727b5ce-656b-4026-8865-74b96f7639da tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:04.457073 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4727b5ce-656b-4026-8865-74b96f7639da tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:04.457760 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4727b5ce-656b-4026-8865-74b96f7639da tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:04.458893 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4727b5ce-656b-4026-8865-74b96f7639da tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:04.459600 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4727b5ce-656b-4026-8865-74b96f7639da tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:04.460184 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4727b5ce-656b-4026-8865-74b96f7639da tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:04.473441 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=15 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:36:04.500000 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4727b5ce-656b-4026-8865-74b96f7639da tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/detail?tenant_id=de91b5fbc5c344019924b5353abf539d" status: 200 len: 15 microversion: 2.1 time: 0.073431 Oct 18 15:36:04.513586 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1239/2593] 10.222.0.60 () {58 vars in 1231 bytes} [Tue Oct 18 15:36:04 2022] GET /compute/v2.1/servers/detail?tenant_id=de91b5fbc5c344019924b5353abf539d => generated 15 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:36:04.525928 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e4cf54d3-aa66-4c30-929a-e1054d0208f1 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bc878a0901409684ea58261475b1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88812dd7c80d47bba192382fccc31e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:04.527948 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-617f279d-02a6-4542-b02e-b86670f77e57 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Action: 'create', calling method: .version_select at 0x7f7c3cfd8700>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-403525041", "description": "tempest-description-997988688"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:36:04.534106 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e4cf54d3-aa66-4c30-929a-e1054d0208f1 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] 10.222.0.60 "GET /compute/v2.1/servers/63a69f32-61bc-41d2-a358-636ae638f654" status: 200 len: 1575 microversion: 2.1 time: 0.240942 Oct 18 15:36:04.535927 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1355/2594] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:04 2022] GET /compute/v2.1/servers/63a69f32-61bc-41d2-a358-636ae638f654 => generated 1575 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:04.541338 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-0f84cfb8-20b5-460f-9c85-9b5bc575c98d req-9905535c-e6a6-4748-bd44-1f83ac5124f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c84f8ca-befc-489e-8068-135af3b766fe", "tag": "a6a64478-83ca-4d2d-9c94-d78e137f6782"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:36:04.560778 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-0f84cfb8-20b5-460f-9c85-9b5bc575c98d req-9905535c-e6a6-4748-bd44-1f83ac5124f2 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:04.563216 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-0f84cfb8-20b5-460f-9c85-9b5bc575c98d req-9905535c-e6a6-4748-bd44-1f83ac5124f2 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:04.563491 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-0f84cfb8-20b5-460f-9c85-9b5bc575c98d req-9905535c-e6a6-4748-bd44-1f83ac5124f2 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:04.581394 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-0f84cfb8-20b5-460f-9c85-9b5bc575c98d req-9905535c-e6a6-4748-bd44-1f83ac5124f2 service nova] Creating event network-changed:a6a64478-83ca-4d2d-9c94-d78e137f6782 for instance 1c84f8ca-befc-489e-8068-135af3b766fe on n-h2-853682-5 Oct 18 15:36:04.586638 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-0f84cfb8-20b5-460f-9c85-9b5bc575c98d req-9905535c-e6a6-4748-bd44-1f83ac5124f2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049312 Oct 18 15:36:04.587699 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1356/2595] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:36:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:36:04.594477 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-54d61abe-bb95-4a19-b52a-db66455419ea tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:04.595605 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-54d61abe-bb95-4a19-b52a-db66455419ea tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] [instance: 5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:04.606715 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-54d61abe-bb95-4a19-b52a-db66455419ea tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:04.607584 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-54d61abe-bb95-4a19-b52a-db66455419ea tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:04.609136 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-54d61abe-bb95-4a19-b52a-db66455419ea tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:04.610390 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-54d61abe-bb95-4a19-b52a-db66455419ea tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:04.611273 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-54d61abe-bb95-4a19-b52a-db66455419ea tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:04.612292 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-54d61abe-bb95-4a19-b52a-db66455419ea tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:04.752399 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-617f279d-02a6-4542-b02e-b86670f77e57 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.237576 Oct 18 15:36:04.753598 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1240/2596] 10.222.0.60 () {60 vars in 1180 bytes} [Tue Oct 18 15:36:04 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:36:04.759083 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2723afa4-9015-427f-bed3-ed3e3ab6cfa5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:04.760096 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2723afa4-9015-427f-bed3-ed3e3ab6cfa5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 1c84f8ca-befc-489e-8068-135af3b766fe] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:04.777724 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2723afa4-9015-427f-bed3-ed3e3ab6cfa5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:04.778227 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2723afa4-9015-427f-bed3-ed3e3ab6cfa5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:04.778681 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2723afa4-9015-427f-bed3-ed3e3ab6cfa5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:04.779393 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2723afa4-9015-427f-bed3-ed3e3ab6cfa5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:04.779858 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2723afa4-9015-427f-bed3-ed3e3ab6cfa5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:04.780290 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2723afa4-9015-427f-bed3-ed3e3ab6cfa5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:04.885437 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-54d61abe-bb95-4a19-b52a-db66455419ea tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8769f6ac73af4d8589d9e94175259031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c561322de64f83a8c90d1bdcc833ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:04.895838 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-54d61abe-bb95-4a19-b52a-db66455419ea tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] 10.222.0.60 "GET /compute/v2.1/servers/5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e" status: 200 len: 1683 microversion: 2.1 time: 0.306677 Oct 18 15:36:04.910111 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1357/2597] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:04 2022] GET /compute/v2.1/servers/5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e => generated 1683 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:04.919579 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7320e428-a670-4b95-8b7f-c7c39132e8f7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:04.920324 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7320e428-a670-4b95-8b7f-c7c39132e8f7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: b7ebc01d-7008-4ca7-a82b-094962216ceb] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:04.926774 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7320e428-a670-4b95-8b7f-c7c39132e8f7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:04.927340 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7320e428-a670-4b95-8b7f-c7c39132e8f7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:04.927848 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7320e428-a670-4b95-8b7f-c7c39132e8f7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:04.928780 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7320e428-a670-4b95-8b7f-c7c39132e8f7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:04.929384 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7320e428-a670-4b95-8b7f-c7c39132e8f7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:04.930003 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7320e428-a670-4b95-8b7f-c7c39132e8f7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:05.022707 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2723afa4-9015-427f-bed3-ed3e3ab6cfa5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:05.040734 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2723afa4-9015-427f-bed3-ed3e3ab6cfa5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe" status: 200 len: 1312 microversion: 2.1 time: 0.285458 Oct 18 15:36:05.041428 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1241/2598] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:04 2022] GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe => generated 1312 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:05.060229 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-83b64b79-f776-4572-bebe-1ebbedde28ad tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:05.073761 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-83b64b79-f776-4572-bebe-1ebbedde28ad tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Searching by: {'tenant_id': 'de91b5fbc5c344019924b5353abf539d', 'deleted': False} {{(pid=120406) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 15:36:05.081327 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83b64b79-f776-4572-bebe-1ebbedde28ad tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:05.081813 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83b64b79-f776-4572-bebe-1ebbedde28ad tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:05.082250 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83b64b79-f776-4572-bebe-1ebbedde28ad tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:05.082973 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83b64b79-f776-4572-bebe-1ebbedde28ad tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:05.087127 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83b64b79-f776-4572-bebe-1ebbedde28ad tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:05.087723 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83b64b79-f776-4572-bebe-1ebbedde28ad tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:05.114383 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7320e428-a670-4b95-8b7f-c7c39132e8f7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:05.136239 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7320e428-a670-4b95-8b7f-c7c39132e8f7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/b7ebc01d-7008-4ca7-a82b-094962216ceb" status: 200 len: 1554 microversion: 2.1 time: 0.225060 Oct 18 15:36:05.138215 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1358/2599] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:04 2022] GET /compute/v2.1/servers/b7ebc01d-7008-4ca7-a82b-094962216ceb => generated 1554 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:05.146086 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-40646260-f1a6-402e-99ac-ed9cb3f83b80 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '.version_select at 0x7f7c3d3ea0d0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:05.165669 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.multi_cell_list [None req-83b64b79-f776-4572-bebe-1ebbedde28ad tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120406) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 15:36:05.219960 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83b64b79-f776-4572-bebe-1ebbedde28ad tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:05.220882 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83b64b79-f776-4572-bebe-1ebbedde28ad tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:05.221486 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83b64b79-f776-4572-bebe-1ebbedde28ad tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:05.459368 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-83b64b79-f776-4572-bebe-1ebbedde28ad tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=de91b5fbc5c344019924b5353abf539d" status: 200 len: 4824 microversion: 2.1 time: 0.416908 Oct 18 15:36:05.460616 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1242/2600] 10.222.0.60 () {58 vars in 1257 bytes} [Tue Oct 18 15:36:05 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=de91b5fbc5c344019924b5353abf539d => generated 4824 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:05.467978 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-40646260-f1a6-402e-99ac-ed9cb3f83b80 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups" status: 200 len: 1829 microversion: 2.1 time: 0.328412 Oct 18 15:36:05.468839 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1359/2601] 10.222.0.60 () {58 vars in 1158 bytes} [Tue Oct 18 15:36:05 2022] GET /compute/v2.1/os-security-groups => generated 1829 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:05.483755 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5468c128-07f5-43c4-ade6-05507d49602a tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '.version_select at 0x7f7c3ce97dc0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:05.497442 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1b95f8ca-f044-46e8-9c7c-36f7e2128a7d tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:05.503537 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1b95f8ca-f044-46e8-9c7c-36f7e2128a7d tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Searching by: {'tenant_id': '28af6d5a70984ae8a5a3a0cc72bd8194', 'deleted': False} {{(pid=120405) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 15:36:05.518151 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1b95f8ca-f044-46e8-9c7c-36f7e2128a7d tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:05.518710 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1b95f8ca-f044-46e8-9c7c-36f7e2128a7d tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:05.519133 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1b95f8ca-f044-46e8-9c7c-36f7e2128a7d tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:05.519859 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1b95f8ca-f044-46e8-9c7c-36f7e2128a7d tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:05.520796 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1b95f8ca-f044-46e8-9c7c-36f7e2128a7d tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:05.520796 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1b95f8ca-f044-46e8-9c7c-36f7e2128a7d tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:05.556068 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1b95f8ca-f044-46e8-9c7c-36f7e2128a7d tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=28af6d5a70984ae8a5a3a0cc72bd8194" status: 200 len: 15 microversion: 2.1 time: 0.063505 Oct 18 15:36:05.565314 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1360/2602] 10.222.0.60 () {58 vars in 1257 bytes} [Tue Oct 18 15:36:05 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=28af6d5a70984ae8a5a3a0cc72bd8194 => generated 15 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 18 15:36:05.590769 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f441d5c5-d298-476a-9b10-5adb68ba14f3 tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:05.598800 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f441d5c5-d298-476a-9b10-5adb68ba14f3 tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.015619 Oct 18 15:36:05.600539 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1361/2603] 10.222.0.60 () {58 vars in 1189 bytes} [Tue Oct 18 15:36:05 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:36:05.624499 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0af70cb6-3f78-460c-b3d6-c010323db2ee tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:36:05.627074 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0af70cb6-3f78-460c-b3d6-c010323db2ee tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:05.640988 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0af70cb6-3f78-460c-b3d6-c010323db2ee tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:05.642320 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0af70cb6-3f78-460c-b3d6-c010323db2ee tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:05.642936 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0af70cb6-3f78-460c-b3d6-c010323db2ee tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:05.643853 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0af70cb6-3f78-460c-b3d6-c010323db2ee tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:05.644471 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0af70cb6-3f78-460c-b3d6-c010323db2ee tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:05.645095 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0af70cb6-3f78-460c-b3d6-c010323db2ee tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:05.776610 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0af70cb6-3f78-460c-b3d6-c010323db2ee tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c/action" status: 202 len: 0 microversion: 2.1 time: 0.156320 Oct 18 15:36:05.780438 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1362/2604] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:36:05 2022] POST /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 15:36:05.785392 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7b30eb5e-1950-46df-95fd-a4a5a78c18d3 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:05.791126 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7b30eb5e-1950-46df-95fd-a4a5a78c18d3 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:05.791833 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7b30eb5e-1950-46df-95fd-a4a5a78c18d3 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'de91b5fbc5c344019924b5353abf539d'} {{(pid=120405) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 15:36:05.798144 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7b30eb5e-1950-46df-95fd-a4a5a78c18d3 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:05.798838 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7b30eb5e-1950-46df-95fd-a4a5a78c18d3 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:05.799437 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7b30eb5e-1950-46df-95fd-a4a5a78c18d3 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:05.800307 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7b30eb5e-1950-46df-95fd-a4a5a78c18d3 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:05.800926 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7b30eb5e-1950-46df-95fd-a4a5a78c18d3 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:05.801487 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7b30eb5e-1950-46df-95fd-a4a5a78c18d3 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:05.897132 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.multi_cell_list [None req-7b30eb5e-1950-46df-95fd-a4a5a78c18d3 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120405) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 15:36:05.962306 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7b30eb5e-1950-46df-95fd-a4a5a78c18d3 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.180722 Oct 18 15:36:05.962895 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1363/2605] 10.222.0.60 () {58 vars in 1150 bytes} [Tue Oct 18 15:36:05 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:36:05.967293 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-962dd121-7f06-46bd-a34a-088247c8ad32 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:05.968063 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-962dd121-7f06-46bd-a34a-088247c8ad32 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] [instance: 5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:05.975885 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-962dd121-7f06-46bd-a34a-088247c8ad32 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:05.976574 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-962dd121-7f06-46bd-a34a-088247c8ad32 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:05.977212 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-962dd121-7f06-46bd-a34a-088247c8ad32 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:05.978060 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-962dd121-7f06-46bd-a34a-088247c8ad32 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:05.978800 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-962dd121-7f06-46bd-a34a-088247c8ad32 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:05.979331 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-962dd121-7f06-46bd-a34a-088247c8ad32 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:05.999446 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5468c128-07f5-43c4-ade6-05507d49602a tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/4d9c6df7-a5e1-49e6-baaf-7c5de11062d0" status: 202 len: 0 microversion: 2.1 time: 0.517736 Oct 18 15:36:06.000878 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1243/2606] 10.222.0.60 () {58 vars in 1272 bytes} [Tue Oct 18 15:36:05 2022] DELETE /compute/v2.1/os-security-groups/4d9c6df7-a5e1-49e6-baaf-7c5de11062d0 => generated 0 bytes in 522 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:36:06.009348 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-559f6ab6-11c1-4424-aa74-a7b500850fba tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:36:06.014418 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-559f6ab6-11c1-4424-aa74-a7b500850fba tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:06.024147 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-559f6ab6-11c1-4424-aa74-a7b500850fba tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:06.025736 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-559f6ab6-11c1-4424-aa74-a7b500850fba tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:06.026357 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-559f6ab6-11c1-4424-aa74-a7b500850fba tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:06.027228 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-559f6ab6-11c1-4424-aa74-a7b500850fba tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:06.027835 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-559f6ab6-11c1-4424-aa74-a7b500850fba tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:06.028981 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-559f6ab6-11c1-4424-aa74-a7b500850fba tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:06.136507 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-559f6ab6-11c1-4424-aa74-a7b500850fba tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c/action" status: 202 len: 0 microversion: 2.1 time: 0.134308 Oct 18 15:36:06.139222 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1244/2607] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:36:06 2022] POST /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:36:06.145634 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d0801d75-0084-48bc-90fa-729b392de18c tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '.version_select at 0x7f7c3d0e0940>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:06.241103 n-d-853682-5 devstack@n-api.service[120406]: DEBUG neutronclient.v2_0.client [None req-d0801d75-0084-48bc-90fa-729b392de18c tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4d9c6df7-a5e1-49e6-baaf-7c5de11062d0 does not exist", "detail": ""}} {{(pid=120406) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 15:36:06.243564 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.security_group_api [None req-d0801d75-0084-48bc-90fa-729b392de18c tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Neutron security group 4d9c6df7-a5e1-49e6-baaf-7c5de11062d0 not found {{(pid=120406) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 18 15:36:06.244165 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-d0801d75-0084-48bc-90fa-729b392de18c tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] HTTP exception thrown: Security group 4d9c6df7-a5e1-49e6-baaf-7c5de11062d0 does not exist Oct 18 15:36:06.244165 n-d-853682-5 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-5292e430-67bc-4a02-b7a6-5d50bbf006b9'] Oct 18 15:36:06.247843 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d0801d75-0084-48bc-90fa-729b392de18c tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Request method failure captured: Oct 18 15:36:06.247843 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/os-security-groups/4d9c6df7-a5e1-49e6-baaf-7c5de11062d0 HTTP/1.1 Oct 18 15:36:06.247843 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:36:06.247843 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:36:06.247843 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:36:06.247843 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:36:06.247843 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:36:06.247843 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:36:06.247843 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:36:06.247843 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:36:06.247843 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTse7fx2cnRaPoLjX5bcuOlHRsv5T7hjqupUR5Anksomh4sN2LXU4nAUs-nTlixOWx8rLooo7F4iO4MJJqXUn20Cug_7k-y3pRg9Zq_jy4SxiI9MxMze0dh6g1ffY8M4Eh1QOt6Xa2yz2Z8B-7cmZxI0dcYo33xex1kmG4oUGiUJl_0M Oct 18 15:36:06.247843 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:36:06.247843 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:36:06.247843 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:36:06.247843 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:36:06.247843 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:36:06.247843 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:36:06.247843 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 6a52e3135e52493b8ccb2d7342418591 Oct 18 15:36:06.247843 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-SecurityGroupsTestJSON-974652461 Oct 18 15:36:06.247843 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:36:06.247843 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:36:06.250649 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:36:06.250649 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-SecurityGroupsTestJSON-974652461 Oct 18 15:36:06.250649 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 6a52e3135e52493b8ccb2d7342418591 Oct 18 15:36:06.250649 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-974652461 Oct 18 15:36:06.250649 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-SecurityGroupsTestJSON-974652461-project Oct 18 15:36:06.250649 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:36:06.250649 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:36:06.250649 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: ee9a7ce3bb784a79b3ac336743b9ae84 Oct 18 15:36:06.250649 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-SecurityGroupsTestJSON-974652461-project Oct 18 15:36:06.250649 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:36:06.250649 n-d-853682-5 devstack@n-api.service[120406]: exception: Security group 4d9c6df7-a5e1-49e6-baaf-7c5de11062d0 does not exist Oct 18 15:36:06.250649 n-d-853682-5 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-5292e430-67bc-4a02-b7a6-5d50bbf006b9'] Oct 18 15:36:06.250649 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '4d9c6df7-a5e1-49e6-baaf-7c5de11062d0'} Oct 18 15:36:06.251477 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:36:06.251477 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:06.251477 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 18 15:36:06.251477 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 18 15:36:06.251477 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:06.251477 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:06.251477 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 18 15:36:06.251477 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 18 15:36:06.251477 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:06.251477 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:06.251477 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 15:36:06.251477 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 15:36:06.251477 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:06.251477 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:06.251477 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 15:36:06.251477 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 15:36:06.251477 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:06.251477 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:06.251477 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 15:36:06.252546 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 15:36:06.252546 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:06.252546 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:06.252546 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 15:36:06.252546 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 15:36:06.252546 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 15:36:06.252546 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 15:36:06.252546 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4d9c6df7-a5e1-49e6-baaf-7c5de11062d0 does not exist Oct 18 15:36:06.252546 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5292e430-67bc-4a02-b7a6-5d50bbf006b9'] Oct 18 15:36:06.252546 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:06.252546 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:06.252546 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:06.252546 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:06.252546 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 18 15:36:06.252546 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 18 15:36:06.252546 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 18 15:36:06.252546 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 15:36:06.252546 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4d9c6df7-a5e1-49e6-baaf-7c5de11062d0 does not exist Oct 18 15:36:06.253649 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5292e430-67bc-4a02-b7a6-5d50bbf006b9'] Oct 18 15:36:06.253649 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:06.253649 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:06.253649 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:06.253649 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:06.253649 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:36:06.253649 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:36:06.253649 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:36:06.253649 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:36:06.253649 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:36:06.253649 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:36:06.253649 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:36:06.253649 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:36:06.253649 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 18 15:36:06.253649 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 15:36:06.253649 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4d9c6df7-a5e1-49e6-baaf-7c5de11062d0 does not exist Oct 18 15:36:06.253649 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5292e430-67bc-4a02-b7a6-5d50bbf006b9'] Oct 18 15:36:06.253649 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:06.253649 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:06.253649 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:06.253649 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:06.254899 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:36:06.254899 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:36:06.254899 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:36:06.254899 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:36:06.254899 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4d9c6df7-a5e1-49e6-baaf-7c5de11062d0 does not exist Oct 18 15:36:06.254899 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5292e430-67bc-4a02-b7a6-5d50bbf006b9'] Oct 18 15:36:06.254899 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:06.254899 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d0801d75-0084-48bc-90fa-729b392de18c tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Returning 404 to user: Security group 4d9c6df7-a5e1-49e6-baaf-7c5de11062d0 does not exist Oct 18 15:36:06.254899 n-d-853682-5 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-5292e430-67bc-4a02-b7a6-5d50bbf006b9'] {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:36:06.254899 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d0801d75-0084-48bc-90fa-729b392de18c tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups/4d9c6df7-a5e1-49e6-baaf-7c5de11062d0" status: 404 len: 194 microversion: 2.1 time: 0.109686 Oct 18 15:36:06.254899 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1245/2608] 10.222.0.60 () {58 vars in 1269 bytes} [Tue Oct 18 15:36:06 2022] GET /compute/v2.1/os-security-groups/4d9c6df7-a5e1-49e6-baaf-7c5de11062d0 => generated 194 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:36:06.256707 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-282f255b-2464-437c-8ae9-82c6fd5e45ca tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:06.257272 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-282f255b-2464-437c-8ae9-82c6fd5e45ca tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 1c84f8ca-befc-489e-8068-135af3b766fe] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:06.268679 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-282f255b-2464-437c-8ae9-82c6fd5e45ca tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:06.272273 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-282f255b-2464-437c-8ae9-82c6fd5e45ca tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:06.272737 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-282f255b-2464-437c-8ae9-82c6fd5e45ca tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:06.275928 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-282f255b-2464-437c-8ae9-82c6fd5e45ca tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:06.276533 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-282f255b-2464-437c-8ae9-82c6fd5e45ca tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:06.277045 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-282f255b-2464-437c-8ae9-82c6fd5e45ca tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:06.287338 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-962dd121-7f06-46bd-a34a-088247c8ad32 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8769f6ac73af4d8589d9e94175259031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c561322de64f83a8c90d1bdcc833ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:06.305815 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-962dd121-7f06-46bd-a34a-088247c8ad32 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] 10.222.0.60 "GET /compute/v2.1/servers/5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e" status: 200 len: 1683 microversion: 2.1 time: 0.341877 Oct 18 15:36:06.306733 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1364/2609] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:05 2022] GET /compute/v2.1/servers/5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e => generated 1683 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:06.311245 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5a88c785-47fd-4d97-aaa3-2ad6859fe7e3 tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:06.312414 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5a88c785-47fd-4d97-aaa3-2ad6859fe7e3 tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:06.331023 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5a88c785-47fd-4d97-aaa3-2ad6859fe7e3 tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:06.331712 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5a88c785-47fd-4d97-aaa3-2ad6859fe7e3 tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:06.332328 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5a88c785-47fd-4d97-aaa3-2ad6859fe7e3 tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:06.333251 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5a88c785-47fd-4d97-aaa3-2ad6859fe7e3 tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:06.333871 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5a88c785-47fd-4d97-aaa3-2ad6859fe7e3 tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:06.334474 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5a88c785-47fd-4d97-aaa3-2ad6859fe7e3 tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:06.340523 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:36:06.806235 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5a88c785-47fd-4d97-aaa3-2ad6859fe7e3 tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c" status: 200 len: 1614 microversion: 2.1 time: 0.498415 Oct 18 15:36:06.806831 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1365/2610] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:06 2022] GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c => generated 1614 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:06.837243 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-61a18996-a49e-4eaf-b5d3-2df17342d360 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:06.854173 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-282f255b-2464-437c-8ae9-82c6fd5e45ca tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:06.856186 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-61a18996-a49e-4eaf-b5d3-2df17342d360 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: b7ebc01d-7008-4ca7-a82b-094962216ceb] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:06.868015 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-282f255b-2464-437c-8ae9-82c6fd5e45ca tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe" status: 200 len: 1312 microversion: 2.1 time: 0.615797 Oct 18 15:36:06.874778 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1246/2611] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:06 2022] GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe => generated 1312 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:06.891608 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d1441f83-1916-45e9-9608-eac309774abb tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '.version_select at 0x7f7c3d1521f0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:06.894973 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-61a18996-a49e-4eaf-b5d3-2df17342d360 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:06.895498 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-61a18996-a49e-4eaf-b5d3-2df17342d360 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:06.895952 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-61a18996-a49e-4eaf-b5d3-2df17342d360 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:06.896697 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-61a18996-a49e-4eaf-b5d3-2df17342d360 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:06.897194 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-61a18996-a49e-4eaf-b5d3-2df17342d360 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:06.908449 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-61a18996-a49e-4eaf-b5d3-2df17342d360 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:07.026386 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-61a18996-a49e-4eaf-b5d3-2df17342d360 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:07.041077 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-61a18996-a49e-4eaf-b5d3-2df17342d360 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/b7ebc01d-7008-4ca7-a82b-094962216ceb" status: 200 len: 1512 microversion: 2.1 time: 0.214469 Oct 18 15:36:07.042384 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1366/2612] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:06 2022] GET /compute/v2.1/servers/b7ebc01d-7008-4ca7-a82b-094962216ceb => generated 1512 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:07.047993 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9a928e73-1ef7-4da9-9db9-f3c8f52662ae tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:07.049022 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9a928e73-1ef7-4da9-9db9-f3c8f52662ae tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:07.056662 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9a928e73-1ef7-4da9-9db9-f3c8f52662ae tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:07.057612 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9a928e73-1ef7-4da9-9db9-f3c8f52662ae tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:07.058065 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9a928e73-1ef7-4da9-9db9-f3c8f52662ae tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:07.058910 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9a928e73-1ef7-4da9-9db9-f3c8f52662ae tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:07.065364 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9a928e73-1ef7-4da9-9db9-f3c8f52662ae tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:07.066232 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9a928e73-1ef7-4da9-9db9-f3c8f52662ae tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:07.371769 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9a928e73-1ef7-4da9-9db9-f3c8f52662ae tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c" status: 200 len: 1614 microversion: 2.1 time: 0.328083 Oct 18 15:36:07.372430 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1367/2613] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:07 2022] GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c => generated 1614 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:07.378358 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-3d02d07a-8f76-4ce7-b74a-2cc6050be6ce req-da6598e5-3dd0-4e98-9b4e-af854a17ae7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7ebc01d-7008-4ca7-a82b-094962216ceb", "name": "network-vif-deleted", "tag": "fd8352a3-56cf-42b8-84f4-d06c63e7c5ad"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:36:07.389590 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-3d02d07a-8f76-4ce7-b74a-2cc6050be6ce req-da6598e5-3dd0-4e98-9b4e-af854a17ae7e service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:07.390437 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-3d02d07a-8f76-4ce7-b74a-2cc6050be6ce req-da6598e5-3dd0-4e98-9b4e-af854a17ae7e service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:07.390864 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-3d02d07a-8f76-4ce7-b74a-2cc6050be6ce req-da6598e5-3dd0-4e98-9b4e-af854a17ae7e service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:07.402459 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-3d02d07a-8f76-4ce7-b74a-2cc6050be6ce req-da6598e5-3dd0-4e98-9b4e-af854a17ae7e service nova] Creating event network-vif-deleted:fd8352a3-56cf-42b8-84f4-d06c63e7c5ad for instance b7ebc01d-7008-4ca7-a82b-094962216ceb on n-h2-853682-5 Oct 18 15:36:07.409359 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-3d02d07a-8f76-4ce7-b74a-2cc6050be6ce req-da6598e5-3dd0-4e98-9b4e-af854a17ae7e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035760 Oct 18 15:36:07.410252 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1368/2614] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:36:07.418292 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d1441f83-1916-45e9-9608-eac309774abb tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/abc03c18-25e7-4055-adb7-82ef950c2991" status: 202 len: 0 microversion: 2.1 time: 0.542342 Oct 18 15:36:07.421059 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1247/2615] 10.222.0.60 () {58 vars in 1272 bytes} [Tue Oct 18 15:36:06 2022] DELETE /compute/v2.1/os-security-groups/abc03c18-25e7-4055-adb7-82ef950c2991 => generated 0 bytes in 546 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:36:07.428343 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7a2f99a9-cbd8-4b91-b546-2b6e7a732ed6 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:07.429537 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7a2f99a9-cbd8-4b91-b546-2b6e7a732ed6 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] [instance: 5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:07.437302 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a2f99a9-cbd8-4b91-b546-2b6e7a732ed6 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:07.438539 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a2f99a9-cbd8-4b91-b546-2b6e7a732ed6 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:07.439553 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a2f99a9-cbd8-4b91-b546-2b6e7a732ed6 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:07.440442 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a2f99a9-cbd8-4b91-b546-2b6e7a732ed6 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:07.441091 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a2f99a9-cbd8-4b91-b546-2b6e7a732ed6 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:07.441676 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a2f99a9-cbd8-4b91-b546-2b6e7a732ed6 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:07.557202 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-52cdbfa5-705c-417f-ad1d-25798b8885f2 tempest-MultipleCreateNegativeTestJSON-2035587315 tempest-MultipleCreateNegativeTestJSON-2035587315-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-781664110", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:36:07.560641 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-52cdbfa5-705c-417f-ad1d-25798b8885f2 tempest-MultipleCreateNegativeTestJSON-2035587315 tempest-MultipleCreateNegativeTestJSON-2035587315-project] HTTP exception thrown: min_count must be <= max_count Oct 18 15:36:07.562252 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-52cdbfa5-705c-417f-ad1d-25798b8885f2 tempest-MultipleCreateNegativeTestJSON-2035587315 tempest-MultipleCreateNegativeTestJSON-2035587315-project] Request method failure captured: Oct 18 15:36:07.562252 n-d-853682-5 devstack@n-api.service[120405]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 15:36:07.562252 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:36:07.562252 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:36:07.562252 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:36:07.562252 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 183 Oct 18 15:36:07.562252 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:36:07.562252 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:36:07.562252 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:36:07.562252 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:36:07.562252 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsfnrIVrr8VJiOofBG8A9VVANqyIbrhJqZ7JH1IAKTiPsZs8fBRu2P-G16uDfTiXJIMbjKLfESQAdtXlaSpPHqVvjfb2n-BHram2NJxJQY8aY8w9cS9EAtkic6p4YuFkMLPN97uxLIhSbYraJvj3ej3teKmXIPQ2uIWQYfTBRgBpnYk Oct 18 15:36:07.562252 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:36:07.562252 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:36:07.562252 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:36:07.562252 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:36:07.562252 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:36:07.562252 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:36:07.562252 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: e78ba565fb8347419309ea47d66e4511 Oct 18 15:36:07.562252 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-2035587315 Oct 18 15:36:07.562252 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:36:07.562252 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:36:07.563661 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e78ba565fb8347419309ea47d66e4511"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e78ba565fb8347419309ea47d66e4511"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e78ba565fb8347419309ea47d66e4511"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e78ba565fb8347419309ea47d66e4511"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:36:07.563661 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-2035587315 Oct 18 15:36:07.563661 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: e78ba565fb8347419309ea47d66e4511 Oct 18 15:36:07.563661 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-2035587315 Oct 18 15:36:07.563661 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-MultipleCreateNegativeTestJSON-2035587315-project Oct 18 15:36:07.563661 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:36:07.563661 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:36:07.563661 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 8ae95977876c4ed686378fedd7f07d24 Oct 18 15:36:07.563661 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-2035587315-project Oct 18 15:36:07.563661 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:36:07.563661 n-d-853682-5 devstack@n-api.service[120405]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-781664110", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 18 15:36:07.564696 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:36:07.564696 n-d-853682-5 devstack@n-api.service[120405]: exception: min_count must be <= max_count Oct 18 15:36:07.564696 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-781664110', 'imageRef': '8f4db252-bff6-4685-9c8d-4c5d6bd9f78b', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 18 15:36:07.564696 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:36:07.564696 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:07.564696 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:36:07.564696 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:36:07.564696 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:36:07.564696 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:36:07.564696 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:36:07.564696 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:36:07.564696 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:36:07.564696 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:36:07.564696 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:36:07.564696 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:36:07.564696 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:36:07.564696 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:36:07.564696 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 18 15:36:07.564696 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 18 15:36:07.566160 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 18 15:36:07.566160 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 18 15:36:07.566160 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:07.566160 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:07.566160 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:07.566160 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:07.566160 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:36:07.566160 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:36:07.566160 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:36:07.566160 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:36:07.566160 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 18 15:36:07.566160 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:07.568449 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-52cdbfa5-705c-417f-ad1d-25798b8885f2 tempest-MultipleCreateNegativeTestJSON-2035587315 tempest-MultipleCreateNegativeTestJSON-2035587315-project] Returning 400 to user: min_count must be <= max_count {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:36:07.570278 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-52cdbfa5-705c-417f-ad1d-25798b8885f2 tempest-MultipleCreateNegativeTestJSON-2035587315 tempest-MultipleCreateNegativeTestJSON-2035587315-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.159124 Oct 18 15:36:07.571533 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1369/2616] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:36:07 2022] POST /compute/v2.1/servers => generated 74 bytes in 161 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 18 15:36:07.576927 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b3601a8e-ed98-4772-91e5-a9f030168c98 tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:07.585718 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b3601a8e-ed98-4772-91e5-a9f030168c98 tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Searching by: {'host': 'n-h1-853682-5', 'deleted': False} {{(pid=120405) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 15:36:07.591600 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b3601a8e-ed98-4772-91e5-a9f030168c98 tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:07.594560 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b3601a8e-ed98-4772-91e5-a9f030168c98 tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:07.595271 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b3601a8e-ed98-4772-91e5-a9f030168c98 tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:07.596109 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b3601a8e-ed98-4772-91e5-a9f030168c98 tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:07.596653 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b3601a8e-ed98-4772-91e5-a9f030168c98 tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:07.597172 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b3601a8e-ed98-4772-91e5-a9f030168c98 tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:07.597779 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7a2f99a9-cbd8-4b91-b546-2b6e7a732ed6 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8769f6ac73af4d8589d9e94175259031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c561322de64f83a8c90d1bdcc833ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:07.607892 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7a2f99a9-cbd8-4b91-b546-2b6e7a732ed6 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] 10.222.0.60 "GET /compute/v2.1/servers/5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e" status: 200 len: 1683 microversion: 2.1 time: 0.185021 Oct 18 15:36:07.608998 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1248/2617] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:07 2022] GET /compute/v2.1/servers/5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e => generated 1683 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:07.614361 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6758ffdb-fe85-4d9c-97b0-810655ce6cc6 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '.version_select at 0x7f7c3d1d7940>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:07.645056 n-d-853682-5 devstack@n-api.service[120406]: DEBUG neutronclient.v2_0.client [None req-6758ffdb-fe85-4d9c-97b0-810655ce6cc6 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group abc03c18-25e7-4055-adb7-82ef950c2991 does not exist", "detail": ""}} {{(pid=120406) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 15:36:07.645661 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.security_group_api [None req-6758ffdb-fe85-4d9c-97b0-810655ce6cc6 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Neutron security group abc03c18-25e7-4055-adb7-82ef950c2991 not found {{(pid=120406) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 18 15:36:07.646180 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-6758ffdb-fe85-4d9c-97b0-810655ce6cc6 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] HTTP exception thrown: Security group abc03c18-25e7-4055-adb7-82ef950c2991 does not exist Oct 18 15:36:07.646180 n-d-853682-5 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-f199ac9f-5666-43d7-9155-ac5d96a10072'] Oct 18 15:36:07.648004 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6758ffdb-fe85-4d9c-97b0-810655ce6cc6 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Request method failure captured: Oct 18 15:36:07.648004 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/os-security-groups/abc03c18-25e7-4055-adb7-82ef950c2991 HTTP/1.1 Oct 18 15:36:07.648004 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:36:07.648004 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:36:07.648004 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:36:07.648004 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:36:07.648004 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:36:07.648004 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:36:07.648004 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:36:07.648004 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:36:07.648004 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTse7fx2cnRaPoLjX5bcuOlHRsv5T7hjqupUR5Anksomh4sN2LXU4nAUs-nTlixOWx8rLooo7F4iO4MJJqXUn20Cug_7k-y3pRg9Zq_jy4SxiI9MxMze0dh6g1ffY8M4Eh1QOt6Xa2yz2Z8B-7cmZxI0dcYo33xex1kmG4oUGiUJl_0M Oct 18 15:36:07.648004 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:36:07.648004 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:36:07.648004 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:36:07.648004 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:36:07.648004 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:36:07.648004 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:36:07.648004 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 6a52e3135e52493b8ccb2d7342418591 Oct 18 15:36:07.648004 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-SecurityGroupsTestJSON-974652461 Oct 18 15:36:07.648004 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:36:07.648004 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:36:07.649317 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:36:07.649317 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-SecurityGroupsTestJSON-974652461 Oct 18 15:36:07.649317 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 6a52e3135e52493b8ccb2d7342418591 Oct 18 15:36:07.649317 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-974652461 Oct 18 15:36:07.649317 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-SecurityGroupsTestJSON-974652461-project Oct 18 15:36:07.649317 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:36:07.649317 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:36:07.649317 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: ee9a7ce3bb784a79b3ac336743b9ae84 Oct 18 15:36:07.649317 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-SecurityGroupsTestJSON-974652461-project Oct 18 15:36:07.649317 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:36:07.649317 n-d-853682-5 devstack@n-api.service[120406]: exception: Security group abc03c18-25e7-4055-adb7-82ef950c2991 does not exist Oct 18 15:36:07.649317 n-d-853682-5 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-f199ac9f-5666-43d7-9155-ac5d96a10072'] Oct 18 15:36:07.649317 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'abc03c18-25e7-4055-adb7-82ef950c2991'} Oct 18 15:36:07.650082 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:36:07.650082 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:07.650082 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 18 15:36:07.650082 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 18 15:36:07.650082 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:07.650082 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:07.650082 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 18 15:36:07.650082 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 18 15:36:07.650082 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:07.650082 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:07.650082 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 15:36:07.650082 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 15:36:07.650082 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:07.650082 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:07.650082 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 15:36:07.650082 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 15:36:07.650082 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:07.650082 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:07.650082 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 15:36:07.651134 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 15:36:07.651134 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:07.651134 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:07.651134 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 15:36:07.651134 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 15:36:07.651134 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 15:36:07.651134 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 15:36:07.651134 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group abc03c18-25e7-4055-adb7-82ef950c2991 does not exist Oct 18 15:36:07.651134 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f199ac9f-5666-43d7-9155-ac5d96a10072'] Oct 18 15:36:07.651134 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:07.651134 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:07.651134 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:07.651134 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:07.651134 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 18 15:36:07.651134 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 18 15:36:07.651134 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 18 15:36:07.651134 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 15:36:07.651134 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group abc03c18-25e7-4055-adb7-82ef950c2991 does not exist Oct 18 15:36:07.652241 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f199ac9f-5666-43d7-9155-ac5d96a10072'] Oct 18 15:36:07.652241 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:07.652241 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:07.652241 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:07.652241 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:07.652241 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:36:07.652241 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:36:07.652241 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:36:07.652241 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:36:07.652241 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:36:07.652241 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:36:07.652241 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:36:07.652241 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:36:07.652241 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 18 15:36:07.652241 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 15:36:07.652241 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group abc03c18-25e7-4055-adb7-82ef950c2991 does not exist Oct 18 15:36:07.652241 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f199ac9f-5666-43d7-9155-ac5d96a10072'] Oct 18 15:36:07.652241 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:07.652241 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:07.652241 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:07.652241 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:07.654518 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:36:07.654518 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:36:07.654518 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:36:07.654518 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:36:07.654518 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group abc03c18-25e7-4055-adb7-82ef950c2991 does not exist Oct 18 15:36:07.654518 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f199ac9f-5666-43d7-9155-ac5d96a10072'] Oct 18 15:36:07.654518 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:07.654518 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6758ffdb-fe85-4d9c-97b0-810655ce6cc6 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Returning 404 to user: Security group abc03c18-25e7-4055-adb7-82ef950c2991 does not exist Oct 18 15:36:07.654518 n-d-853682-5 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-f199ac9f-5666-43d7-9155-ac5d96a10072'] {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:36:07.654518 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6758ffdb-fe85-4d9c-97b0-810655ce6cc6 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups/abc03c18-25e7-4055-adb7-82ef950c2991" status: 404 len: 194 microversion: 2.1 time: 0.039112 Oct 18 15:36:07.654518 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1249/2618] 10.222.0.60 () {58 vars in 1269 bytes} [Tue Oct 18 15:36:07 2022] GET /compute/v2.1/os-security-groups/abc03c18-25e7-4055-adb7-82ef950c2991 => generated 194 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:36:07.657951 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-faa1d40c-b446-4456-99b1-37a37c6664a4 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '.version_select at 0x7f7c3d315a60>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:07.748611 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.multi_cell_list [None req-b3601a8e-ed98-4772-91e5-a9f030168c98 tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Listed batch of 6 results from cell out of 1000 limit. Returned 6 total so far. {{(pid=120405) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 15:36:07.822027 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b3601a8e-ed98-4772-91e5-a9f030168c98 tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] 10.222.0.60 "GET /compute/v2.1/servers?host=n-h1-853682-5&all_tenants=1" status: 200 len: 1969 microversion: 2.1 time: 0.249121 Oct 18 15:36:07.822936 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1370/2619] 10.222.0.60 () {58 vars in 1190 bytes} [Tue Oct 18 15:36:07 2022] GET /compute/v2.1/servers?host=n-h1-853682-5&all_tenants=1 => generated 1969 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:07.828570 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1429d92e-7dcf-4599-b333-512ed57d854e tempest-MultipleCreateNegativeTestJSON-2035587315 tempest-MultipleCreateNegativeTestJSON-2035587315-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2038500250", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "max_count": 0}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:36:07.833039 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1429d92e-7dcf-4599-b333-512ed57d854e tempest-MultipleCreateNegativeTestJSON-2035587315 tempest-MultipleCreateNegativeTestJSON-2035587315-project] Request method failure captured: Oct 18 15:36:07.833039 n-d-853682-5 devstack@n-api.service[120405]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 15:36:07.833039 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:36:07.833039 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:36:07.833039 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:36:07.833039 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 168 Oct 18 15:36:07.833039 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:36:07.833039 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:36:07.833039 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:36:07.833039 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:36:07.833039 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsfnrIVrr8VJiOofBG8A9VVANqyIbrhJqZ7JH1IAKTiPsZs8fBRu2P-G16uDfTiXJIMbjKLfESQAdtXlaSpPHqVvjfb2n-BHram2NJxJQY8aY8w9cS9EAtkic6p4YuFkMLPN97uxLIhSbYraJvj3ej3teKmXIPQ2uIWQYfTBRgBpnYk Oct 18 15:36:07.833039 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:36:07.833039 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:36:07.833039 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:36:07.833039 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:36:07.833039 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:36:07.833039 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:36:07.833039 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: e78ba565fb8347419309ea47d66e4511 Oct 18 15:36:07.833039 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-2035587315 Oct 18 15:36:07.833039 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:36:07.833039 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:36:07.834593 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e78ba565fb8347419309ea47d66e4511"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e78ba565fb8347419309ea47d66e4511"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e78ba565fb8347419309ea47d66e4511"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e78ba565fb8347419309ea47d66e4511"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:36:07.834593 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-2035587315 Oct 18 15:36:07.834593 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: e78ba565fb8347419309ea47d66e4511 Oct 18 15:36:07.834593 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-2035587315 Oct 18 15:36:07.834593 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-MultipleCreateNegativeTestJSON-2035587315-project Oct 18 15:36:07.834593 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:36:07.834593 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:36:07.834593 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 8ae95977876c4ed686378fedd7f07d24 Oct 18 15:36:07.834593 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-2035587315-project Oct 18 15:36:07.834593 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:36:07.834593 n-d-853682-5 devstack@n-api.service[120405]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2038500250", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "max_count": 0}} Oct 18 15:36:07.835321 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:36:07.835321 n-d-853682-5 devstack@n-api.service[120405]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 18 15:36:07.835321 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2038500250', 'imageRef': '8f4db252-bff6-4685-9c8d-4c5d6bd9f78b', 'flavorRef': '452', 'max_count': 0}}} Oct 18 15:36:07.835321 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:36:07.835321 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:07.835321 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 15:36:07.835321 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 15:36:07.835321 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 15:36:07.835321 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise error Oct 18 15:36:07.835321 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 18 15:36:07.835321 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:07.835321 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 18 15:36:07.835321 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 18 15:36:07.835321 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 18 15:36:07.835321 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 18 15:36:07.835321 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 18 15:36:07.835321 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:07.835321 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 15:36:07.835321 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi 0 Oct 18 15:36:07.835321 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:07.835321 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:07.835321 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:07.835321 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:07.837046 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:36:07.837046 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:36:07.837046 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:36:07.837046 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:36:07.837046 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:36:07.837046 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:36:07.837046 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:36:07.837046 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:36:07.837046 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 15:36:07.837046 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 15:36:07.837046 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 15:36:07.837046 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 15:36:07.837046 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 15:36:07.837046 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 15:36:07.837046 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 18 15:36:07.837046 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:07.837046 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:07.837046 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:07.837046 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:07.838482 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:36:07.838482 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:36:07.838482 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 15:36:07.838482 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 15:36:07.838482 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 18 15:36:07.838482 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:07.839901 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1429d92e-7dcf-4599-b333-512ed57d854e tempest-MultipleCreateNegativeTestJSON-2035587315 tempest-MultipleCreateNegativeTestJSON-2035587315-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:36:07.840939 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1429d92e-7dcf-4599-b333-512ed57d854e tempest-MultipleCreateNegativeTestJSON-2035587315 tempest-MultipleCreateNegativeTestJSON-2035587315-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.016769 Oct 18 15:36:07.841677 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1371/2620] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:36:07 2022] POST /compute/v2.1/servers => generated 130 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:36:07.846251 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b3c25f53-5d4e-4826-9e79-89e00c714e5b tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:07.856019 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b3c25f53-5d4e-4826-9e79-89e00c714e5b tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=120405) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 15:36:07.863866 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b3c25f53-5d4e-4826-9e79-89e00c714e5b tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:07.864629 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b3c25f53-5d4e-4826-9e79-89e00c714e5b tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:07.865299 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b3c25f53-5d4e-4826-9e79-89e00c714e5b tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:07.866823 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b3c25f53-5d4e-4826-9e79-89e00c714e5b tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:07.867485 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b3c25f53-5d4e-4826-9e79-89e00c714e5b tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:07.868650 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b3c25f53-5d4e-4826-9e79-89e00c714e5b tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:07.880860 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-faa1d40c-b446-4456-99b1-37a37c6664a4 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/4bb02221-240d-45c4-b558-197fffe69ca4" status: 202 len: 0 microversion: 2.1 time: 0.226524 Oct 18 15:36:07.884996 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1250/2621] 10.222.0.60 () {58 vars in 1272 bytes} [Tue Oct 18 15:36:07 2022] DELETE /compute/v2.1/os-security-groups/4bb02221-240d-45c4-b558-197fffe69ca4 => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:36:07.892974 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f7632736-b07a-40f8-b430-8c178092a9cc tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '.version_select at 0x7f7c3d0dd310>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:07.902279 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b3c25f53-5d4e-4826-9e79-89e00c714e5b tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] 10.222.0.60 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.059254 Oct 18 15:36:07.910633 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1372/2622] 10.222.0.60 () {58 vars in 1196 bytes} [Tue Oct 18 15:36:07 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:36:07.910633 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-992a997a-11b3-4f3b-b32d-5f6013da4daa tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:07.910633 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-992a997a-11b3-4f3b-b32d-5f6013da4daa tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 1c84f8ca-befc-489e-8068-135af3b766fe] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:07.916324 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-992a997a-11b3-4f3b-b32d-5f6013da4daa tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:07.916837 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-992a997a-11b3-4f3b-b32d-5f6013da4daa tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:07.917306 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-992a997a-11b3-4f3b-b32d-5f6013da4daa tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:07.918020 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-992a997a-11b3-4f3b-b32d-5f6013da4daa tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:07.918549 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-992a997a-11b3-4f3b-b32d-5f6013da4daa tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:07.919044 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-992a997a-11b3-4f3b-b32d-5f6013da4daa tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:07.946052 n-d-853682-5 devstack@n-api.service[120406]: DEBUG neutronclient.v2_0.client [None req-f7632736-b07a-40f8-b430-8c178092a9cc tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4bb02221-240d-45c4-b558-197fffe69ca4 does not exist", "detail": ""}} {{(pid=120406) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 15:36:07.946641 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.security_group_api [None req-f7632736-b07a-40f8-b430-8c178092a9cc tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Neutron security group 4bb02221-240d-45c4-b558-197fffe69ca4 not found {{(pid=120406) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 18 15:36:07.947149 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-f7632736-b07a-40f8-b430-8c178092a9cc tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] HTTP exception thrown: Security group 4bb02221-240d-45c4-b558-197fffe69ca4 does not exist Oct 18 15:36:07.947149 n-d-853682-5 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-631ab8a6-0715-4392-a58d-fefe380bc96b'] Oct 18 15:36:07.949113 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f7632736-b07a-40f8-b430-8c178092a9cc tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Request method failure captured: Oct 18 15:36:07.949113 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/os-security-groups/4bb02221-240d-45c4-b558-197fffe69ca4 HTTP/1.1 Oct 18 15:36:07.949113 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:36:07.949113 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:36:07.949113 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:36:07.949113 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:36:07.949113 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:36:07.949113 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:36:07.949113 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:36:07.949113 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:36:07.949113 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTse7fx2cnRaPoLjX5bcuOlHRsv5T7hjqupUR5Anksomh4sN2LXU4nAUs-nTlixOWx8rLooo7F4iO4MJJqXUn20Cug_7k-y3pRg9Zq_jy4SxiI9MxMze0dh6g1ffY8M4Eh1QOt6Xa2yz2Z8B-7cmZxI0dcYo33xex1kmG4oUGiUJl_0M Oct 18 15:36:07.949113 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:36:07.949113 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:36:07.949113 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:36:07.949113 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:36:07.949113 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:36:07.949113 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:36:07.949113 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 6a52e3135e52493b8ccb2d7342418591 Oct 18 15:36:07.949113 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-SecurityGroupsTestJSON-974652461 Oct 18 15:36:07.949113 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:36:07.949113 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:36:07.950389 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:36:07.950389 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-SecurityGroupsTestJSON-974652461 Oct 18 15:36:07.950389 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 6a52e3135e52493b8ccb2d7342418591 Oct 18 15:36:07.950389 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-974652461 Oct 18 15:36:07.950389 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-SecurityGroupsTestJSON-974652461-project Oct 18 15:36:07.950389 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:36:07.950389 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:36:07.950389 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: ee9a7ce3bb784a79b3ac336743b9ae84 Oct 18 15:36:07.950389 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-SecurityGroupsTestJSON-974652461-project Oct 18 15:36:07.950389 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:36:07.950389 n-d-853682-5 devstack@n-api.service[120406]: exception: Security group 4bb02221-240d-45c4-b558-197fffe69ca4 does not exist Oct 18 15:36:07.950389 n-d-853682-5 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-631ab8a6-0715-4392-a58d-fefe380bc96b'] Oct 18 15:36:07.950389 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '4bb02221-240d-45c4-b558-197fffe69ca4'} Oct 18 15:36:07.951168 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:36:07.951168 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:07.951168 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 18 15:36:07.951168 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 18 15:36:07.951168 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:07.951168 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:07.951168 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 18 15:36:07.951168 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 18 15:36:07.951168 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:07.951168 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:07.951168 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 15:36:07.951168 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 15:36:07.951168 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:07.951168 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:07.951168 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 15:36:07.951168 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 15:36:07.951168 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:07.951168 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:07.951168 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 15:36:07.952268 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 15:36:07.952268 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:07.952268 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:07.952268 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 15:36:07.952268 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 15:36:07.952268 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 15:36:07.952268 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 15:36:07.952268 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4bb02221-240d-45c4-b558-197fffe69ca4 does not exist Oct 18 15:36:07.952268 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-631ab8a6-0715-4392-a58d-fefe380bc96b'] Oct 18 15:36:07.952268 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:07.952268 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:07.952268 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:07.952268 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:07.952268 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 18 15:36:07.952268 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 18 15:36:07.952268 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 18 15:36:07.952268 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 15:36:07.952268 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4bb02221-240d-45c4-b558-197fffe69ca4 does not exist Oct 18 15:36:07.953418 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-631ab8a6-0715-4392-a58d-fefe380bc96b'] Oct 18 15:36:07.953418 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:07.953418 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:07.953418 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:07.953418 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:07.953418 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:36:07.953418 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:36:07.953418 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:36:07.953418 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:36:07.953418 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:36:07.953418 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:36:07.953418 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:36:07.953418 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:36:07.953418 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 18 15:36:07.953418 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 15:36:07.953418 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4bb02221-240d-45c4-b558-197fffe69ca4 does not exist Oct 18 15:36:07.953418 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-631ab8a6-0715-4392-a58d-fefe380bc96b'] Oct 18 15:36:07.953418 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:07.953418 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:07.953418 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:07.953418 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:07.954567 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:36:07.954567 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:36:07.954567 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:36:07.954567 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:36:07.954567 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4bb02221-240d-45c4-b558-197fffe69ca4 does not exist Oct 18 15:36:07.954567 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-631ab8a6-0715-4392-a58d-fefe380bc96b'] Oct 18 15:36:07.954567 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:07.954567 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f7632736-b07a-40f8-b430-8c178092a9cc tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Returning 404 to user: Security group 4bb02221-240d-45c4-b558-197fffe69ca4 does not exist Oct 18 15:36:07.954567 n-d-853682-5 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-631ab8a6-0715-4392-a58d-fefe380bc96b'] {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:36:07.954567 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f7632736-b07a-40f8-b430-8c178092a9cc tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups/4bb02221-240d-45c4-b558-197fffe69ca4" status: 404 len: 194 microversion: 2.1 time: 0.064557 Oct 18 15:36:07.954567 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1251/2623] 10.222.0.60 () {58 vars in 1269 bytes} [Tue Oct 18 15:36:07 2022] GET /compute/v2.1/os-security-groups/4bb02221-240d-45c4-b558-197fffe69ca4 => generated 194 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:36:07.960233 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-26d439d2-810a-494e-b266-31f07f4d95c2 tempest-MultipleCreateNegativeTestJSON-2035587315 tempest-MultipleCreateNegativeTestJSON-2035587315-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2030561251", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "max_count": 2.5}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:36:07.964855 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-26d439d2-810a-494e-b266-31f07f4d95c2 tempest-MultipleCreateNegativeTestJSON-2035587315 tempest-MultipleCreateNegativeTestJSON-2035587315-project] Request method failure captured: Oct 18 15:36:07.964855 n-d-853682-5 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 15:36:07.964855 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:36:07.964855 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:36:07.964855 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:36:07.964855 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 170 Oct 18 15:36:07.964855 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:36:07.964855 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:36:07.964855 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:36:07.964855 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:36:07.964855 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsfnrIVrr8VJiOofBG8A9VVANqyIbrhJqZ7JH1IAKTiPsZs8fBRu2P-G16uDfTiXJIMbjKLfESQAdtXlaSpPHqVvjfb2n-BHram2NJxJQY8aY8w9cS9EAtkic6p4YuFkMLPN97uxLIhSbYraJvj3ej3teKmXIPQ2uIWQYfTBRgBpnYk Oct 18 15:36:07.964855 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:36:07.964855 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:36:07.964855 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:36:07.964855 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:36:07.964855 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:36:07.964855 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:36:07.964855 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: e78ba565fb8347419309ea47d66e4511 Oct 18 15:36:07.964855 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-2035587315 Oct 18 15:36:07.964855 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:36:07.964855 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:36:07.966718 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e78ba565fb8347419309ea47d66e4511"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e78ba565fb8347419309ea47d66e4511"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e78ba565fb8347419309ea47d66e4511"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e78ba565fb8347419309ea47d66e4511"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:36:07.966718 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-2035587315 Oct 18 15:36:07.966718 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: e78ba565fb8347419309ea47d66e4511 Oct 18 15:36:07.966718 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-2035587315 Oct 18 15:36:07.966718 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-MultipleCreateNegativeTestJSON-2035587315-project Oct 18 15:36:07.966718 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:36:07.966718 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:36:07.966718 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 8ae95977876c4ed686378fedd7f07d24 Oct 18 15:36:07.966718 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-2035587315-project Oct 18 15:36:07.966718 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:36:07.966718 n-d-853682-5 devstack@n-api.service[120406]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2030561251", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "max_count": 2.5}} Oct 18 15:36:07.967361 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:36:07.967361 n-d-853682-5 devstack@n-api.service[120406]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 18 15:36:07.967361 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2030561251', 'imageRef': '8f4db252-bff6-4685-9c8d-4c5d6bd9f78b', 'flavorRef': '452', 'max_count': 2.5}}} Oct 18 15:36:07.967361 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:36:07.967361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:07.967361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 15:36:07.967361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 15:36:07.967361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 15:36:07.967361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise error Oct 18 15:36:07.967361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 18 15:36:07.967361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:07.967361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 18 15:36:07.967361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 18 15:36:07.967361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 18 15:36:07.967361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 18 15:36:07.967361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 18 15:36:07.967361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:07.967361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 15:36:07.967361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 2.5 Oct 18 15:36:07.967361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:07.967361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:07.967361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:07.967361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:07.968677 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:36:07.968677 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:36:07.968677 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:36:07.968677 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:36:07.968677 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:36:07.968677 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:36:07.968677 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:36:07.968677 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:36:07.968677 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 15:36:07.968677 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 15:36:07.968677 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 15:36:07.968677 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 15:36:07.968677 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 15:36:07.968677 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 15:36:07.968677 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 18 15:36:07.968677 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:07.968677 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:07.968677 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:07.968677 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:07.970113 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:36:07.970113 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:36:07.970113 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 15:36:07.970113 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 15:36:07.970113 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 18 15:36:07.970113 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:07.970113 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-26d439d2-810a-494e-b266-31f07f4d95c2 tempest-MultipleCreateNegativeTestJSON-2035587315 tempest-MultipleCreateNegativeTestJSON-2035587315-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:36:07.970774 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-26d439d2-810a-494e-b266-31f07f4d95c2 tempest-MultipleCreateNegativeTestJSON-2035587315 tempest-MultipleCreateNegativeTestJSON-2035587315-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.018017 Oct 18 15:36:07.970967 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1252/2624] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:36:07 2022] POST /compute/v2.1/servers => generated 139 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:36:07.981716 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-976144c9-b9f6-4409-9b00-0c7e57091793 tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:36:07.981716 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-976144c9-b9f6-4409-9b00-0c7e57091793 tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:07.994656 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-976144c9-b9f6-4409-9b00-0c7e57091793 tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:07.995157 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-976144c9-b9f6-4409-9b00-0c7e57091793 tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:07.995596 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-976144c9-b9f6-4409-9b00-0c7e57091793 tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:07.996307 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-976144c9-b9f6-4409-9b00-0c7e57091793 tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:07.996774 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-976144c9-b9f6-4409-9b00-0c7e57091793 tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:07.997225 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-976144c9-b9f6-4409-9b00-0c7e57091793 tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:08.066591 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:36:08.125321 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-976144c9-b9f6-4409-9b00-0c7e57091793 tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c/action" status: 202 len: 0 microversion: 2.1 time: 0.152535 Oct 18 15:36:08.126673 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1253/2625] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:36:07 2022] POST /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:36:08.152008 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7a663142-c260-410d-a841-1fa416941aa3 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '.version_select at 0x7f7c3d1d7040>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:08.175543 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-992a997a-11b3-4f3b-b32d-5f6013da4daa tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:08.207063 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-992a997a-11b3-4f3b-b32d-5f6013da4daa tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe" status: 200 len: 1312 microversion: 2.1 time: 0.298966 Oct 18 15:36:08.209042 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1373/2626] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:07 2022] GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe => generated 1312 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:08.227425 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0b9598a9-37b5-4228-ba5a-9352cba5bcd6 tempest-MultipleCreateNegativeTestJSON-2035587315 tempest-MultipleCreateNegativeTestJSON-2035587315-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1516568543", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "min_count": 0}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:36:08.243706 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0b9598a9-37b5-4228-ba5a-9352cba5bcd6 tempest-MultipleCreateNegativeTestJSON-2035587315 tempest-MultipleCreateNegativeTestJSON-2035587315-project] Request method failure captured: Oct 18 15:36:08.243706 n-d-853682-5 devstack@n-api.service[120405]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 15:36:08.243706 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:36:08.243706 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:36:08.243706 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:36:08.243706 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 168 Oct 18 15:36:08.243706 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:36:08.243706 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:36:08.243706 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:36:08.243706 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:36:08.243706 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsfnrIVrr8VJiOofBG8A9VVANqyIbrhJqZ7JH1IAKTiPsZs8fBRu2P-G16uDfTiXJIMbjKLfESQAdtXlaSpPHqVvjfb2n-BHram2NJxJQY8aY8w9cS9EAtkic6p4YuFkMLPN97uxLIhSbYraJvj3ej3teKmXIPQ2uIWQYfTBRgBpnYk Oct 18 15:36:08.243706 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:36:08.243706 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:36:08.243706 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:36:08.243706 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:36:08.243706 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:36:08.243706 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:36:08.243706 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: e78ba565fb8347419309ea47d66e4511 Oct 18 15:36:08.243706 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-2035587315 Oct 18 15:36:08.243706 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:36:08.243706 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:36:08.245239 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e78ba565fb8347419309ea47d66e4511"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e78ba565fb8347419309ea47d66e4511"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e78ba565fb8347419309ea47d66e4511"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e78ba565fb8347419309ea47d66e4511"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:36:08.245239 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-2035587315 Oct 18 15:36:08.245239 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: e78ba565fb8347419309ea47d66e4511 Oct 18 15:36:08.245239 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-2035587315 Oct 18 15:36:08.245239 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-MultipleCreateNegativeTestJSON-2035587315-project Oct 18 15:36:08.245239 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:36:08.245239 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:36:08.245239 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 8ae95977876c4ed686378fedd7f07d24 Oct 18 15:36:08.245239 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-2035587315-project Oct 18 15:36:08.245239 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:36:08.245239 n-d-853682-5 devstack@n-api.service[120405]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1516568543", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "min_count": 0}} Oct 18 15:36:08.246016 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:36:08.246016 n-d-853682-5 devstack@n-api.service[120405]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 18 15:36:08.246016 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1516568543', 'imageRef': '8f4db252-bff6-4685-9c8d-4c5d6bd9f78b', 'flavorRef': '452', 'min_count': 0}}} Oct 18 15:36:08.246016 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:36:08.246016 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:08.246016 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 15:36:08.246016 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 15:36:08.246016 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 15:36:08.246016 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise error Oct 18 15:36:08.246016 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 18 15:36:08.246016 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:08.246016 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 18 15:36:08.246016 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 18 15:36:08.246016 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 18 15:36:08.246016 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 18 15:36:08.246016 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 18 15:36:08.246016 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:08.246016 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 15:36:08.246016 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi 0 Oct 18 15:36:08.246016 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:08.246016 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:08.246016 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:08.246016 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:08.247656 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:36:08.247656 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:36:08.247656 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:36:08.247656 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:36:08.247656 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:36:08.247656 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:36:08.247656 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:36:08.247656 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:36:08.247656 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 15:36:08.247656 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 15:36:08.247656 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 15:36:08.247656 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 15:36:08.247656 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 15:36:08.247656 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 15:36:08.247656 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 18 15:36:08.247656 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:08.247656 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:08.247656 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:08.247656 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:08.248909 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:36:08.248909 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:36:08.248909 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 15:36:08.248909 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 15:36:08.248909 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 18 15:36:08.248909 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:08.250202 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0b9598a9-37b5-4228-ba5a-9352cba5bcd6 tempest-MultipleCreateNegativeTestJSON-2035587315 tempest-MultipleCreateNegativeTestJSON-2035587315-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:36:08.251058 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0b9598a9-37b5-4228-ba5a-9352cba5bcd6 tempest-MultipleCreateNegativeTestJSON-2035587315 tempest-MultipleCreateNegativeTestJSON-2035587315-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.039155 Oct 18 15:36:08.261062 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1374/2627] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:36:08 2022] POST /compute/v2.1/servers => generated 130 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:36:08.289550 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e5e7933c-8c91-4348-bbfd-d18a0a68b9d7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:08.291851 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e5e7933c-8c91-4348-bbfd-d18a0a68b9d7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: b7ebc01d-7008-4ca7-a82b-094962216ceb] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:08.314771 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e5e7933c-8c91-4348-bbfd-d18a0a68b9d7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:08.315281 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e5e7933c-8c91-4348-bbfd-d18a0a68b9d7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:08.315722 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e5e7933c-8c91-4348-bbfd-d18a0a68b9d7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:08.318817 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e5e7933c-8c91-4348-bbfd-d18a0a68b9d7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:08.319303 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e5e7933c-8c91-4348-bbfd-d18a0a68b9d7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:08.319738 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e5e7933c-8c91-4348-bbfd-d18a0a68b9d7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:08.505965 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e5e7933c-8c91-4348-bbfd-d18a0a68b9d7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:08.522339 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e5e7933c-8c91-4348-bbfd-d18a0a68b9d7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/b7ebc01d-7008-4ca7-a82b-094962216ceb" status: 200 len: 1346 microversion: 2.1 time: 0.257529 Oct 18 15:36:08.523072 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1375/2628] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:08 2022] GET /compute/v2.1/servers/b7ebc01d-7008-4ca7-a82b-094962216ceb => generated 1346 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:08.527978 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-56188adf-95dc-4c51-9165-628d7e851041 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:36:08.531543 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-56188adf-95dc-4c51-9165-628d7e851041 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:08.554576 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-56188adf-95dc-4c51-9165-628d7e851041 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:08.555831 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-56188adf-95dc-4c51-9165-628d7e851041 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:08.556500 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-56188adf-95dc-4c51-9165-628d7e851041 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:08.557514 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-56188adf-95dc-4c51-9165-628d7e851041 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:08.558192 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-56188adf-95dc-4c51-9165-628d7e851041 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:08.558934 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-56188adf-95dc-4c51-9165-628d7e851041 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:08.663886 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-56188adf-95dc-4c51-9165-628d7e851041 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:36:08.665169 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-56188adf-95dc-4c51-9165-628d7e851041 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:36:08.665850 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-56188adf-95dc-4c51-9165-628d7e851041 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:36:08.666258 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-56188adf-95dc-4c51-9165-628d7e851041 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:36:08.666726 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-56188adf-95dc-4c51-9165-628d7e851041 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:36:08.735024 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7a663142-c260-410d-a841-1fa416941aa3 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.606198 Oct 18 15:36:08.735618 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1254/2629] 10.222.0.60 () {58 vars in 1158 bytes} [Tue Oct 18 15:36:08 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:08.741399 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-79ff030e-ffff-4c19-8b72-63ef220830d7 tempest-MultipleCreateNegativeTestJSON-2035587315 tempest-MultipleCreateNegativeTestJSON-2035587315-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-3143536", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "min_count": 2.5}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:36:08.751069 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-79ff030e-ffff-4c19-8b72-63ef220830d7 tempest-MultipleCreateNegativeTestJSON-2035587315 tempest-MultipleCreateNegativeTestJSON-2035587315-project] Request method failure captured: Oct 18 15:36:08.751069 n-d-853682-5 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 15:36:08.751069 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:36:08.751069 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:36:08.751069 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:36:08.751069 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 167 Oct 18 15:36:08.751069 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:36:08.751069 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:36:08.751069 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:36:08.751069 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:36:08.751069 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsfnrIVrr8VJiOofBG8A9VVANqyIbrhJqZ7JH1IAKTiPsZs8fBRu2P-G16uDfTiXJIMbjKLfESQAdtXlaSpPHqVvjfb2n-BHram2NJxJQY8aY8w9cS9EAtkic6p4YuFkMLPN97uxLIhSbYraJvj3ej3teKmXIPQ2uIWQYfTBRgBpnYk Oct 18 15:36:08.751069 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:36:08.751069 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:36:08.751069 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:36:08.751069 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:36:08.751069 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:36:08.751069 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:36:08.751069 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: e78ba565fb8347419309ea47d66e4511 Oct 18 15:36:08.751069 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-2035587315 Oct 18 15:36:08.751069 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:36:08.751069 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:36:08.752362 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e78ba565fb8347419309ea47d66e4511"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e78ba565fb8347419309ea47d66e4511"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e78ba565fb8347419309ea47d66e4511"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e78ba565fb8347419309ea47d66e4511"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:36:08.752362 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-2035587315 Oct 18 15:36:08.752362 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: e78ba565fb8347419309ea47d66e4511 Oct 18 15:36:08.752362 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-2035587315 Oct 18 15:36:08.752362 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-MultipleCreateNegativeTestJSON-2035587315-project Oct 18 15:36:08.752362 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:36:08.752362 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:36:08.752362 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 8ae95977876c4ed686378fedd7f07d24 Oct 18 15:36:08.752362 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-2035587315-project Oct 18 15:36:08.752362 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:36:08.752362 n-d-853682-5 devstack@n-api.service[120406]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-3143536", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "min_count": 2.5}} Oct 18 15:36:08.753042 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:36:08.753042 n-d-853682-5 devstack@n-api.service[120406]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 18 15:36:08.753042 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-3143536', 'imageRef': '8f4db252-bff6-4685-9c8d-4c5d6bd9f78b', 'flavorRef': '452', 'min_count': 2.5}}} Oct 18 15:36:08.753042 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:36:08.753042 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:08.753042 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 15:36:08.753042 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 15:36:08.753042 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 15:36:08.753042 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise error Oct 18 15:36:08.753042 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 18 15:36:08.753042 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:08.753042 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 18 15:36:08.753042 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 18 15:36:08.753042 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 18 15:36:08.753042 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 18 15:36:08.753042 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 18 15:36:08.753042 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:08.753042 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 15:36:08.753042 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 2.5 Oct 18 15:36:08.753042 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:08.753042 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:08.753042 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:08.753042 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:08.754524 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:36:08.754524 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:36:08.754524 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:36:08.754524 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:36:08.754524 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:36:08.754524 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:36:08.754524 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:36:08.754524 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:36:08.754524 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 15:36:08.754524 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 15:36:08.754524 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 15:36:08.754524 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 15:36:08.754524 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 15:36:08.754524 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 15:36:08.754524 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 18 15:36:08.754524 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:08.754524 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:08.754524 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:08.754524 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:08.755854 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:36:08.755854 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:36:08.755854 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 15:36:08.755854 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 15:36:08.755854 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 18 15:36:08.755854 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:08.758007 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-79ff030e-ffff-4c19-8b72-63ef220830d7 tempest-MultipleCreateNegativeTestJSON-2035587315 tempest-MultipleCreateNegativeTestJSON-2035587315-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:36:08.759127 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-79ff030e-ffff-4c19-8b72-63ef220830d7 tempest-MultipleCreateNegativeTestJSON-2035587315 tempest-MultipleCreateNegativeTestJSON-2035587315-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.022067 Oct 18 15:36:08.760254 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1255/2630] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:36:08 2022] POST /compute/v2.1/servers => generated 139 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:36:08.778998 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-56188adf-95dc-4c51-9165-628d7e851041 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:08.792075 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-56188adf-95dc-4c51-9165-628d7e851041 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:08.792579 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-56188adf-95dc-4c51-9165-628d7e851041 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:08.793203 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-56188adf-95dc-4c51-9165-628d7e851041 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:08.794447 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-66d3abef-2613-48de-bd2c-16b55266afc8 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:08.796883 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-66d3abef-2613-48de-bd2c-16b55266afc8 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] [instance: 5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:08.799947 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-56188adf-95dc-4c51-9165-628d7e851041 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:08.800675 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-56188adf-95dc-4c51-9165-628d7e851041 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:08.801172 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-56188adf-95dc-4c51-9165-628d7e851041 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:08.821582 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66d3abef-2613-48de-bd2c-16b55266afc8 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:08.828301 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66d3abef-2613-48de-bd2c-16b55266afc8 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:08.829535 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66d3abef-2613-48de-bd2c-16b55266afc8 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:08.832254 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66d3abef-2613-48de-bd2c-16b55266afc8 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:08.834002 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66d3abef-2613-48de-bd2c-16b55266afc8 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:08.840703 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66d3abef-2613-48de-bd2c-16b55266afc8 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:08.860125 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-56188adf-95dc-4c51-9165-628d7e851041 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "POST /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c/action" status: 202 len: 1067 microversion: 2.1 time: 0.335921 Oct 18 15:36:08.862257 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1376/2631] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:36:08 2022] POST /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c/action => generated 1067 bytes in 338 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 18 15:36:08.875614 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-af5d75cc-00c7-47fc-9853-aff808f28467 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Action: 'create', calling method: .version_select at 0x7f7c3d1c19d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1081977098", "description": "tempest-description-1319590300"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:36:08.926920 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66d3abef-2613-48de-bd2c-16b55266afc8 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:08.928305 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66d3abef-2613-48de-bd2c-16b55266afc8 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:08.928877 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66d3abef-2613-48de-bd2c-16b55266afc8 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:08.930438 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-66d3abef-2613-48de-bd2c-16b55266afc8 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lazy-loading 'fault' on Instance uuid 5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:36:09.079411 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-66d3abef-2613-48de-bd2c-16b55266afc8 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8769f6ac73af4d8589d9e94175259031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c561322de64f83a8c90d1bdcc833ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:09.093731 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-66d3abef-2613-48de-bd2c-16b55266afc8 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] 10.222.0.60 "GET /compute/v2.1/servers/5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e" status: 200 len: 1332 microversion: 2.1 time: 0.327381 Oct 18 15:36:09.112831 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1256/2632] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:08 2022] GET /compute/v2.1/servers/5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e => generated 1332 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:09.112831 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-987df8d5-5628-43e9-8c7a-ab85a3099200 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:09.112831 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-987df8d5-5628-43e9-8c7a-ab85a3099200 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:09.125479 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-987df8d5-5628-43e9-8c7a-ab85a3099200 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:09.126361 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-987df8d5-5628-43e9-8c7a-ab85a3099200 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:09.127184 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-987df8d5-5628-43e9-8c7a-ab85a3099200 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:09.128096 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-987df8d5-5628-43e9-8c7a-ab85a3099200 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:09.128662 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-987df8d5-5628-43e9-8c7a-ab85a3099200 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:09.129376 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-987df8d5-5628-43e9-8c7a-ab85a3099200 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:09.528904 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-af5d75cc-00c7-47fc-9853-aff808f28467 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.665151 Oct 18 15:36:09.530028 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1377/2633] 10.222.0.60 () {60 vars in 1180 bytes} [Tue Oct 18 15:36:08 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:36:09.534283 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-136f5337-aa8a-4cc2-8756-f3105c0a12c7 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:09.534907 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-136f5337-aa8a-4cc2-8756-f3105c0a12c7 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 1c84f8ca-befc-489e-8068-135af3b766fe] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:09.543902 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:36:09.557325 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-136f5337-aa8a-4cc2-8756-f3105c0a12c7 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:09.557840 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-136f5337-aa8a-4cc2-8756-f3105c0a12c7 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:09.558358 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-136f5337-aa8a-4cc2-8756-f3105c0a12c7 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:09.559012 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-136f5337-aa8a-4cc2-8756-f3105c0a12c7 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:09.559424 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-136f5337-aa8a-4cc2-8756-f3105c0a12c7 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:09.573644 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-136f5337-aa8a-4cc2-8756-f3105c0a12c7 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:10.001638 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-987df8d5-5628-43e9-8c7a-ab85a3099200 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:10.015601 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-987df8d5-5628-43e9-8c7a-ab85a3099200 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c" status: 200 len: 1471 microversion: 2.1 time: 0.915162 Oct 18 15:36:10.016635 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1257/2634] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:09 2022] GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c => generated 1471 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:10.021378 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-8e37e1ef-796d-4575-a2cd-7e7b1be4dfdd req-9e9d96b3-0c09-4725-bf8a-720616883578 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e", "name": "network-vif-deleted", "tag": "b9d918b6-52d1-43d5-8681-978c95391cfc"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:36:10.031600 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8e37e1ef-796d-4575-a2cd-7e7b1be4dfdd req-9e9d96b3-0c09-4725-bf8a-720616883578 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:10.032329 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8e37e1ef-796d-4575-a2cd-7e7b1be4dfdd req-9e9d96b3-0c09-4725-bf8a-720616883578 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:10.032938 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8e37e1ef-796d-4575-a2cd-7e7b1be4dfdd req-9e9d96b3-0c09-4725-bf8a-720616883578 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:10.046153 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-8e37e1ef-796d-4575-a2cd-7e7b1be4dfdd req-9e9d96b3-0c09-4725-bf8a-720616883578 service nova] Creating event network-vif-deleted:b9d918b6-52d1-43d5-8681-978c95391cfc for instance 5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e on n-h1-853682-5 Oct 18 15:36:10.052524 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-8e37e1ef-796d-4575-a2cd-7e7b1be4dfdd req-9e9d96b3-0c09-4725-bf8a-720616883578 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033983 Oct 18 15:36:10.053698 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1258/2635] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:36:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:36:10.060127 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3efe3cfb-47bd-4c18-ac65-876d56f5474e tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Action: 'create', calling method: .version_select at 0x7f7c3d1521f0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-105308488", "description": "tempest-description-1989971182"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:36:10.181423 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-136f5337-aa8a-4cc2-8756-f3105c0a12c7 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:10.194443 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-136f5337-aa8a-4cc2-8756-f3105c0a12c7 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe" status: 200 len: 1312 microversion: 2.1 time: 0.663688 Oct 18 15:36:10.195026 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1378/2636] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:09 2022] GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe => generated 1312 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:10.208949 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0e2f5fa8-e4b4-4dcc-aca6-67728e3a258e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:10.210584 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0e2f5fa8-e4b4-4dcc-aca6-67728e3a258e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: b7ebc01d-7008-4ca7-a82b-094962216ceb] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:10.217398 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0e2f5fa8-e4b4-4dcc-aca6-67728e3a258e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:10.218055 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0e2f5fa8-e4b4-4dcc-aca6-67728e3a258e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:10.218645 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0e2f5fa8-e4b4-4dcc-aca6-67728e3a258e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:10.219815 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0e2f5fa8-e4b4-4dcc-aca6-67728e3a258e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:10.220563 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0e2f5fa8-e4b4-4dcc-aca6-67728e3a258e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:10.221162 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0e2f5fa8-e4b4-4dcc-aca6-67728e3a258e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:10.317430 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0e2f5fa8-e4b4-4dcc-aca6-67728e3a258e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:10.328461 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0e2f5fa8-e4b4-4dcc-aca6-67728e3a258e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/b7ebc01d-7008-4ca7-a82b-094962216ceb" status: 200 len: 1346 microversion: 2.1 time: 0.123479 Oct 18 15:36:10.329134 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1379/2637] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:10 2022] GET /compute/v2.1/servers/b7ebc01d-7008-4ca7-a82b-094962216ceb => generated 1346 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:10.356404 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b21c0285-5c77-4c5c-a4f9-cf7db671e637 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:10.369727 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b21c0285-5c77-4c5c-a4f9-cf7db671e637 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] [instance: 5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:10.373953 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3efe3cfb-47bd-4c18-ac65-876d56f5474e tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.318737 Oct 18 15:36:10.374778 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1259/2638] 10.222.0.60 () {60 vars in 1180 bytes} [Tue Oct 18 15:36:10 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:36:10.376715 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b21c0285-5c77-4c5c-a4f9-cf7db671e637 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:10.377235 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b21c0285-5c77-4c5c-a4f9-cf7db671e637 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:10.377670 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b21c0285-5c77-4c5c-a4f9-cf7db671e637 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:10.378372 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b21c0285-5c77-4c5c-a4f9-cf7db671e637 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:10.378820 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b21c0285-5c77-4c5c-a4f9-cf7db671e637 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:10.379240 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b21c0285-5c77-4c5c-a4f9-cf7db671e637 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:10.404046 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-b21c0285-5c77-4c5c-a4f9-cf7db671e637 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] HTTP exception thrown: Instance 5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e could not be found. Oct 18 15:36:10.405877 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b21c0285-5c77-4c5c-a4f9-cf7db671e637 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Request method failure captured: Oct 18 15:36:10.405877 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e HTTP/1.1 Oct 18 15:36:10.405877 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:36:10.405877 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:36:10.405877 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:36:10.405877 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:36:10.405877 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:36:10.405877 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:36:10.405877 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:36:10.405877 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:36:10.405877 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsb5s3fR67FENnucwCnt7ALMT22YEQaRKxxWiqTkt5shk6Vomwm4-O0-rT0Q8sQHNDci6oNsPZ5CLLh2gcLT4TdZCIoQZsS7ppATck0xL54KWTElp4deqARaqZVH0Gcn0hMOwHp1WvPPNw5tp5UmMhqjZReeWsW9HS08F1SKiprc6MQ Oct 18 15:36:10.405877 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:36:10.405877 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:36:10.405877 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:36:10.405877 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:36:10.405877 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:36:10.405877 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:36:10.405877 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 82c561322de64f83a8c90d1bdcc833ea Oct 18 15:36:10.405877 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1276183265 Oct 18 15:36:10.405877 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:36:10.405877 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:36:10.407389 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/82c561322de64f83a8c90d1bdcc833ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/82c561322de64f83a8c90d1bdcc833ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/82c561322de64f83a8c90d1bdcc833ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_82c561322de64f83a8c90d1bdcc833ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:36:10.407389 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1276183265 Oct 18 15:36:10.407389 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 82c561322de64f83a8c90d1bdcc833ea Oct 18 15:36:10.407389 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1276183265 Oct 18 15:36:10.407389 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-AttachSCSIVolumeTestJSON-1276183265-project Oct 18 15:36:10.407389 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:36:10.407389 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:36:10.407389 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 8769f6ac73af4d8589d9e94175259031 Oct 18 15:36:10.407389 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1276183265-project Oct 18 15:36:10.407389 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:36:10.407389 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e could not be found. Oct 18 15:36:10.407389 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e'} Oct 18 15:36:10.408285 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:36:10.408285 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:10.408285 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:36:10.408285 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:36:10.408285 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:36:10.408285 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:36:10.408285 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:36:10.408285 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:36:10.408285 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:36:10.408285 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:36:10.408285 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e could not be found. Oct 18 15:36:10.408285 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:10.408285 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:10.408285 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:10.408285 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:10.408285 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:36:10.408285 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:36:10.408285 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:36:10.408285 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:36:10.408285 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:36:10.409772 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:36:10.409772 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:36:10.409772 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:36:10.409772 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:36:10.409772 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:36:10.409772 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:36:10.409772 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:36:10.409772 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e could not be found. Oct 18 15:36:10.409772 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:10.409772 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:10.409772 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:10.409772 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:10.409772 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:36:10.409772 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:36:10.409772 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:36:10.409772 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:36:10.409772 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e could not be found. Oct 18 15:36:10.409772 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:10.411028 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b21c0285-5c77-4c5c-a4f9-cf7db671e637 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Returning 404 to user: Instance 5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:36:10.411028 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b21c0285-5c77-4c5c-a4f9-cf7db671e637 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] 10.222.0.60 "GET /compute/v2.1/servers/5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e" status: 404 len: 111 microversion: 2.1 time: 0.057568 Oct 18 15:36:10.416331 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1380/2639] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:10 2022] GET /compute/v2.1/servers/5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:36:10.420940 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1b1af4fe-d336-4dcf-a916-f216cad3b0d3 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Calling method '.version_select at 0x7f7c3d315a60>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:10.453697 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1b1af4fe-d336-4dcf-a916-f216cad3b0d3 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1397377738" status: 202 len: 0 microversion: 2.1 time: 0.037042 Oct 18 15:36:10.455873 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1260/2640] 10.222.0.60 () {58 vars in 1221 bytes} [Tue Oct 18 15:36:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1397377738 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:36:10.570568 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-dbc56cea-2463-402c-9131-45990c0788f8 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1654562522", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "4f43dce0-3c64-4384-85c2-f93befe9573a"}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:36:10.640966 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-dbc56cea-2463-402c-9131-45990c0788f8 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] validate_networks() for [('4f43dce0-3c64-4384-85c2-f93befe9573a', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:36:11.042663 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-56f97dc1-d482-4bd6-8bc6-c46bd9526d08 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:11.044861 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-56f97dc1-d482-4bd6-8bc6-c46bd9526d08 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:11.058751 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-56f97dc1-d482-4bd6-8bc6-c46bd9526d08 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:11.062498 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-56f97dc1-d482-4bd6-8bc6-c46bd9526d08 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:11.063135 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-56f97dc1-d482-4bd6-8bc6-c46bd9526d08 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:11.064856 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-56f97dc1-d482-4bd6-8bc6-c46bd9526d08 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:11.065588 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-56f97dc1-d482-4bd6-8bc6-c46bd9526d08 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:11.066333 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-56f97dc1-d482-4bd6-8bc6-c46bd9526d08 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:11.341655 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-56f97dc1-d482-4bd6-8bc6-c46bd9526d08 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:11.354752 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-56f97dc1-d482-4bd6-8bc6-c46bd9526d08 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c" status: 200 len: 1471 microversion: 2.1 time: 0.317052 Oct 18 15:36:11.371416 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1261/2641] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:11 2022] GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c => generated 1471 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:11.381086 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-49aac38f-053b-48df-97b1-487f24947fce tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:11.381956 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-49aac38f-053b-48df-97b1-487f24947fce tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 1c84f8ca-befc-489e-8068-135af3b766fe] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:11.389118 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49aac38f-053b-48df-97b1-487f24947fce tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:11.389914 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49aac38f-053b-48df-97b1-487f24947fce tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:11.390706 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49aac38f-053b-48df-97b1-487f24947fce tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:11.391641 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49aac38f-053b-48df-97b1-487f24947fce tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:11.392319 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49aac38f-053b-48df-97b1-487f24947fce tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:11.392997 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49aac38f-053b-48df-97b1-487f24947fce tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:11.561249 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-dbc56cea-2463-402c-9131-45990c0788f8 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:36:11.561691 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-dbc56cea-2463-402c-9131-45990c0788f8 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:36:11.562334 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-dbc56cea-2463-402c-9131-45990c0788f8 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:36:11.562758 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-dbc56cea-2463-402c-9131-45990c0788f8 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:36:11.563177 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-dbc56cea-2463-402c-9131-45990c0788f8 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:36:11.581574 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dbc56cea-2463-402c-9131-45990c0788f8 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:11.582190 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dbc56cea-2463-402c-9131-45990c0788f8 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:11.584650 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dbc56cea-2463-402c-9131-45990c0788f8 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:11.587881 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dbc56cea-2463-402c-9131-45990c0788f8 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:11.588656 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dbc56cea-2463-402c-9131-45990c0788f8 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:11.593143 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dbc56cea-2463-402c-9131-45990c0788f8 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:11.630980 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-dbc56cea-2463-402c-9131-45990c0788f8 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Getting quotas for project 6a52e3135e52493b8ccb2d7342418591. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:36:11.642693 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-dbc56cea-2463-402c-9131-45990c0788f8 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Getting quotas for user ee9a7ce3bb784a79b3ac336743b9ae84 and project 6a52e3135e52493b8ccb2d7342418591. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:36:11.647289 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-49aac38f-053b-48df-97b1-487f24947fce tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:11.655710 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-49aac38f-053b-48df-97b1-487f24947fce tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe" status: 200 len: 1312 microversion: 2.1 time: 0.283154 Oct 18 15:36:11.659034 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-dbc56cea-2463-402c-9131-45990c0788f8 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:36:11.660085 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1262/2642] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:11 2022] GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe => generated 1312 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:11.661545 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-dbc56cea-2463-402c-9131-45990c0788f8 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] [instance: 82aba568-875e-459c-8bc9-248b4851fc94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:36:11.685167 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f5187d27-c824-4ed9-99a9-4997289103e9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:11.686451 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f5187d27-c824-4ed9-99a9-4997289103e9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: b7ebc01d-7008-4ca7-a82b-094962216ceb] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:11.698866 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f5187d27-c824-4ed9-99a9-4997289103e9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:11.699506 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f5187d27-c824-4ed9-99a9-4997289103e9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:11.700049 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f5187d27-c824-4ed9-99a9-4997289103e9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:11.700902 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f5187d27-c824-4ed9-99a9-4997289103e9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:11.701525 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f5187d27-c824-4ed9-99a9-4997289103e9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:11.702046 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f5187d27-c824-4ed9-99a9-4997289103e9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:11.750694 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-dbc56cea-2463-402c-9131-45990c0788f8 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.183911 Oct 18 15:36:11.751338 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1381/2643] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:36:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1185 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:36:11.762698 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1b2a5834-ba76-4ac4-a7da-402de111bb02 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:11.763347 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1b2a5834-ba76-4ac4-a7da-402de111bb02 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] [instance: 82aba568-875e-459c-8bc9-248b4851fc94] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:11.795220 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f5187d27-c824-4ed9-99a9-4997289103e9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:11.819127 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f5187d27-c824-4ed9-99a9-4997289103e9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/b7ebc01d-7008-4ca7-a82b-094962216ceb" status: 200 len: 1346 microversion: 2.1 time: 0.156349 Oct 18 15:36:11.835988 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1263/2644] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:11 2022] GET /compute/v2.1/servers/b7ebc01d-7008-4ca7-a82b-094962216ceb => generated 1346 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:11.883597 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1b2a5834-ba76-4ac4-a7da-402de111bb02 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a7ce3bb784a79b3ac336743b9ae84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a52e3135e52493b8ccb2d7342418591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:11.891808 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1b2a5834-ba76-4ac4-a7da-402de111bb02 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "GET /compute/v2.1/servers/82aba568-875e-459c-8bc9-248b4851fc94" status: 200 len: 1216 microversion: 2.1 time: 0.133177 Oct 18 15:36:11.893476 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1382/2645] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:11 2022] GET /compute/v2.1/servers/82aba568-875e-459c-8bc9-248b4851fc94 => generated 1216 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:36:12.385264 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6e7ac463-1044-4c73-afe2-97f13668a3b3 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:12.385835 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6e7ac463-1044-4c73-afe2-97f13668a3b3 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:12.403808 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6e7ac463-1044-4c73-afe2-97f13668a3b3 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:12.406055 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6e7ac463-1044-4c73-afe2-97f13668a3b3 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:12.406510 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6e7ac463-1044-4c73-afe2-97f13668a3b3 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:12.407672 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6e7ac463-1044-4c73-afe2-97f13668a3b3 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:12.408150 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6e7ac463-1044-4c73-afe2-97f13668a3b3 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:12.408579 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6e7ac463-1044-4c73-afe2-97f13668a3b3 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:12.684832 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7832842b-4d71-4d92-827d-cec534fd8360 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:12.686174 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7832842b-4d71-4d92-827d-cec534fd8360 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 1c84f8ca-befc-489e-8068-135af3b766fe] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:12.695292 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7832842b-4d71-4d92-827d-cec534fd8360 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:12.700056 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7832842b-4d71-4d92-827d-cec534fd8360 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:12.700729 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7832842b-4d71-4d92-827d-cec534fd8360 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:12.703311 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7832842b-4d71-4d92-827d-cec534fd8360 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:12.704007 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7832842b-4d71-4d92-827d-cec534fd8360 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:12.711927 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7832842b-4d71-4d92-827d-cec534fd8360 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:12.722367 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6e7ac463-1044-4c73-afe2-97f13668a3b3 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:12.734227 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6e7ac463-1044-4c73-afe2-97f13668a3b3 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c" status: 200 len: 1471 microversion: 2.1 time: 0.354613 Oct 18 15:36:12.735151 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1264/2646] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:12 2022] GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c => generated 1471 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:12.844552 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-14a0bd3d-d992-4029-ae1f-411e4ae22d58 req-936b48cd-4b08-4f12-8937-cafde67c14bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c84f8ca-befc-489e-8068-135af3b766fe", "name": "network-vif-plugged", "status": "completed", "tag": "a6a64478-83ca-4d2d-9c94-d78e137f6782"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:36:12.855921 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-14a0bd3d-d992-4029-ae1f-411e4ae22d58 req-936b48cd-4b08-4f12-8937-cafde67c14bc service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:12.856684 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-14a0bd3d-d992-4029-ae1f-411e4ae22d58 req-936b48cd-4b08-4f12-8937-cafde67c14bc service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:12.857944 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-14a0bd3d-d992-4029-ae1f-411e4ae22d58 req-936b48cd-4b08-4f12-8937-cafde67c14bc service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:12.875232 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-14a0bd3d-d992-4029-ae1f-411e4ae22d58 req-936b48cd-4b08-4f12-8937-cafde67c14bc service nova] Creating event network-vif-plugged:a6a64478-83ca-4d2d-9c94-d78e137f6782 for instance 1c84f8ca-befc-489e-8068-135af3b766fe on n-h2-853682-5 Oct 18 15:36:12.882820 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-14a0bd3d-d992-4029-ae1f-411e4ae22d58 req-936b48cd-4b08-4f12-8937-cafde67c14bc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043150 Oct 18 15:36:12.884990 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1265/2647] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:36:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:36:12.890940 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a19058db-b5b9-4ac6-90c1-39d6bbc182cc tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:12.892114 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a19058db-b5b9-4ac6-90c1-39d6bbc182cc tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: b7ebc01d-7008-4ca7-a82b-094962216ceb] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:12.921242 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a19058db-b5b9-4ac6-90c1-39d6bbc182cc tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:12.924317 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a19058db-b5b9-4ac6-90c1-39d6bbc182cc tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:12.925050 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a19058db-b5b9-4ac6-90c1-39d6bbc182cc tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:12.926497 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a19058db-b5b9-4ac6-90c1-39d6bbc182cc tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:12.928406 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a19058db-b5b9-4ac6-90c1-39d6bbc182cc tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:12.931862 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a19058db-b5b9-4ac6-90c1-39d6bbc182cc tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:12.958976 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7832842b-4d71-4d92-827d-cec534fd8360 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:12.998972 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7832842b-4d71-4d92-827d-cec534fd8360 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe" status: 200 len: 1312 microversion: 2.1 time: 0.311032 Oct 18 15:36:13.000307 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1383/2648] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:12 2022] GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe => generated 1312 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:13.005359 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8789dd70-50b6-4cd2-82f5-805f8be7a2dd tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:13.018956 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8789dd70-50b6-4cd2-82f5-805f8be7a2dd tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] [instance: 82aba568-875e-459c-8bc9-248b4851fc94] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:13.025782 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8789dd70-50b6-4cd2-82f5-805f8be7a2dd tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:13.036823 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8789dd70-50b6-4cd2-82f5-805f8be7a2dd tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:13.037654 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8789dd70-50b6-4cd2-82f5-805f8be7a2dd tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:13.038631 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8789dd70-50b6-4cd2-82f5-805f8be7a2dd tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:13.040775 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8789dd70-50b6-4cd2-82f5-805f8be7a2dd tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:13.041518 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8789dd70-50b6-4cd2-82f5-805f8be7a2dd tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:13.075685 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a19058db-b5b9-4ac6-90c1-39d6bbc182cc tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:13.085905 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a19058db-b5b9-4ac6-90c1-39d6bbc182cc tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/b7ebc01d-7008-4ca7-a82b-094962216ceb" status: 200 len: 1346 microversion: 2.1 time: 0.199504 Oct 18 15:36:13.091082 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1266/2649] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:12 2022] GET /compute/v2.1/servers/b7ebc01d-7008-4ca7-a82b-094962216ceb => generated 1346 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:13.211073 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8789dd70-50b6-4cd2-82f5-805f8be7a2dd tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a7ce3bb784a79b3ac336743b9ae84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a52e3135e52493b8ccb2d7342418591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:13.222434 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8789dd70-50b6-4cd2-82f5-805f8be7a2dd tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "GET /compute/v2.1/servers/82aba568-875e-459c-8bc9-248b4851fc94" status: 200 len: 1268 microversion: 2.1 time: 0.220571 Oct 18 15:36:13.238922 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1384/2650] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:13 2022] GET /compute/v2.1/servers/82aba568-875e-459c-8bc9-248b4851fc94 => generated 1268 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:13.757676 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b5fc4e58-238b-4eab-91ad-e5ef2f5b1146 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:13.759171 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b5fc4e58-238b-4eab-91ad-e5ef2f5b1146 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:13.767673 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5fc4e58-238b-4eab-91ad-e5ef2f5b1146 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:13.768459 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5fc4e58-238b-4eab-91ad-e5ef2f5b1146 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:13.769305 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5fc4e58-238b-4eab-91ad-e5ef2f5b1146 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:13.770348 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5fc4e58-238b-4eab-91ad-e5ef2f5b1146 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:13.770875 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5fc4e58-238b-4eab-91ad-e5ef2f5b1146 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:13.771971 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5fc4e58-238b-4eab-91ad-e5ef2f5b1146 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:13.984569 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b5fc4e58-238b-4eab-91ad-e5ef2f5b1146 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:13.994322 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b5fc4e58-238b-4eab-91ad-e5ef2f5b1146 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c" status: 200 len: 1471 microversion: 2.1 time: 0.241024 Oct 18 15:36:13.995166 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1267/2651] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:13 2022] GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c => generated 1471 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:14.024033 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4c363e95-53ca-47b5-bec6-a68d4af4d3b3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:14.024757 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4c363e95-53ca-47b5-bec6-a68d4af4d3b3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 1c84f8ca-befc-489e-8068-135af3b766fe] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:14.040721 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4c363e95-53ca-47b5-bec6-a68d4af4d3b3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:14.041640 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4c363e95-53ca-47b5-bec6-a68d4af4d3b3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:14.042161 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4c363e95-53ca-47b5-bec6-a68d4af4d3b3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:14.042970 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4c363e95-53ca-47b5-bec6-a68d4af4d3b3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:14.043501 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4c363e95-53ca-47b5-bec6-a68d4af4d3b3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:14.044000 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4c363e95-53ca-47b5-bec6-a68d4af4d3b3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:14.123126 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2aaeb7cc-193a-472f-9543-665ae3052b01 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:14.124042 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2aaeb7cc-193a-472f-9543-665ae3052b01 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: b7ebc01d-7008-4ca7-a82b-094962216ceb] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:14.130752 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2aaeb7cc-193a-472f-9543-665ae3052b01 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:14.131600 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2aaeb7cc-193a-472f-9543-665ae3052b01 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:14.132446 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2aaeb7cc-193a-472f-9543-665ae3052b01 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:14.133495 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2aaeb7cc-193a-472f-9543-665ae3052b01 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:14.134184 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2aaeb7cc-193a-472f-9543-665ae3052b01 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:14.134853 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2aaeb7cc-193a-472f-9543-665ae3052b01 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:14.322985 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2aaeb7cc-193a-472f-9543-665ae3052b01 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:14.337622 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2aaeb7cc-193a-472f-9543-665ae3052b01 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/b7ebc01d-7008-4ca7-a82b-094962216ceb" status: 200 len: 1346 microversion: 2.1 time: 0.224362 Oct 18 15:36:14.355432 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1268/2652] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:14 2022] GET /compute/v2.1/servers/b7ebc01d-7008-4ca7-a82b-094962216ceb => generated 1346 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:14.365493 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4586d594-d705-45f1-97c9-b0e32f81566a tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:14.366438 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4586d594-d705-45f1-97c9-b0e32f81566a tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] [instance: 82aba568-875e-459c-8bc9-248b4851fc94] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:14.392372 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4586d594-d705-45f1-97c9-b0e32f81566a tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:14.399583 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4586d594-d705-45f1-97c9-b0e32f81566a tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:14.400468 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4586d594-d705-45f1-97c9-b0e32f81566a tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:14.401465 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4586d594-d705-45f1-97c9-b0e32f81566a tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:14.403903 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4586d594-d705-45f1-97c9-b0e32f81566a tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:14.404980 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4586d594-d705-45f1-97c9-b0e32f81566a tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:14.439005 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4c363e95-53ca-47b5-bec6-a68d4af4d3b3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:14.449144 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4c363e95-53ca-47b5-bec6-a68d4af4d3b3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe" status: 200 len: 1312 microversion: 2.1 time: 0.429421 Oct 18 15:36:14.454248 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1385/2653] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:14 2022] GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe => generated 1312 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:14.520666 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4586d594-d705-45f1-97c9-b0e32f81566a tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a7ce3bb784a79b3ac336743b9ae84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a52e3135e52493b8ccb2d7342418591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:14.536190 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4586d594-d705-45f1-97c9-b0e32f81566a tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "GET /compute/v2.1/servers/82aba568-875e-459c-8bc9-248b4851fc94" status: 200 len: 1286 microversion: 2.1 time: 0.176991 Oct 18 15:36:14.555126 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1269/2654] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:14 2022] GET /compute/v2.1/servers/82aba568-875e-459c-8bc9-248b4851fc94 => generated 1286 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:15.018695 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d437a5ae-8972-4d31-a787-9c2a7e1984ea tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:15.019366 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d437a5ae-8972-4d31-a787-9c2a7e1984ea tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:15.034614 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d437a5ae-8972-4d31-a787-9c2a7e1984ea tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:15.036188 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d437a5ae-8972-4d31-a787-9c2a7e1984ea tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:15.036884 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d437a5ae-8972-4d31-a787-9c2a7e1984ea tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:15.038622 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d437a5ae-8972-4d31-a787-9c2a7e1984ea tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:15.041502 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d437a5ae-8972-4d31-a787-9c2a7e1984ea tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:15.042295 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d437a5ae-8972-4d31-a787-9c2a7e1984ea tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:15.369916 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7b433c6b-c2e1-49f3-8b11-e0f4b41dba8a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:15.371179 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7b433c6b-c2e1-49f3-8b11-e0f4b41dba8a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: b7ebc01d-7008-4ca7-a82b-094962216ceb] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:15.374246 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:36:15.378670 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=11 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:36:15.393660 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b433c6b-c2e1-49f3-8b11-e0f4b41dba8a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:15.394414 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b433c6b-c2e1-49f3-8b11-e0f4b41dba8a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:15.395250 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b433c6b-c2e1-49f3-8b11-e0f4b41dba8a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:15.396124 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b433c6b-c2e1-49f3-8b11-e0f4b41dba8a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:15.396743 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b433c6b-c2e1-49f3-8b11-e0f4b41dba8a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:15.397351 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b433c6b-c2e1-49f3-8b11-e0f4b41dba8a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:15.434381 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-7b433c6b-c2e1-49f3-8b11-e0f4b41dba8a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] HTTP exception thrown: Instance b7ebc01d-7008-4ca7-a82b-094962216ceb could not be found. Oct 18 15:36:15.446927 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7b433c6b-c2e1-49f3-8b11-e0f4b41dba8a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Request method failure captured: Oct 18 15:36:15.446927 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/b7ebc01d-7008-4ca7-a82b-094962216ceb HTTP/1.1 Oct 18 15:36:15.446927 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:36:15.446927 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:36:15.446927 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:36:15.446927 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:36:15.446927 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:36:15.446927 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:36:15.446927 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:36:15.446927 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:36:15.446927 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTseXdqIE6K5VM4s3TEHRLWgMUN4aMRv2NoeIzUdaqo5huhkbfibHS5WTucH_yVgiw-oU86aIdI66etum9zPC1o_Gp8lN1ylUglhXYekmlUb-DCNwOQQTPA7nsDvbxyfFlUPyfZnM9HlX0P4k3Gbrf42L5eihIJ6KOiK__MhWlbfWWoY Oct 18 15:36:15.446927 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:36:15.446927 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:36:15.446927 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:36:15.446927 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:36:15.446927 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:36:15.446927 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:36:15.446927 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 04fd51d598a04ff7a909b3ced951dea8 Oct 18 15:36:15.446927 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-DeleteServersTestJSON-518486720 Oct 18 15:36:15.446927 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:36:15.446927 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:36:15.448562 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:36:15.448562 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-DeleteServersTestJSON-518486720 Oct 18 15:36:15.448562 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 04fd51d598a04ff7a909b3ced951dea8 Oct 18 15:36:15.448562 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-DeleteServersTestJSON-518486720 Oct 18 15:36:15.448562 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-DeleteServersTestJSON-518486720-project Oct 18 15:36:15.448562 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:36:15.448562 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:36:15.448562 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 5309baeeec484df194123d22779b0255 Oct 18 15:36:15.448562 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-DeleteServersTestJSON-518486720-project Oct 18 15:36:15.448562 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:36:15.448562 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance b7ebc01d-7008-4ca7-a82b-094962216ceb could not be found. Oct 18 15:36:15.448562 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'b7ebc01d-7008-4ca7-a82b-094962216ceb'} Oct 18 15:36:15.449524 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:36:15.449524 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:15.449524 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:36:15.449524 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:36:15.449524 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:36:15.449524 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:36:15.449524 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:36:15.449524 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:36:15.449524 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:36:15.449524 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:36:15.449524 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7ebc01d-7008-4ca7-a82b-094962216ceb could not be found. Oct 18 15:36:15.449524 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:15.449524 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:15.449524 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:15.449524 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:15.449524 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:36:15.449524 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:36:15.449524 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:36:15.449524 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:36:15.449524 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:36:15.450907 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:36:15.450907 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:36:15.450907 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:36:15.450907 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:36:15.450907 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:36:15.450907 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:36:15.450907 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:36:15.450907 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7ebc01d-7008-4ca7-a82b-094962216ceb could not be found. Oct 18 15:36:15.450907 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:15.450907 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:15.450907 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:15.450907 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:15.450907 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:36:15.450907 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:36:15.450907 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:36:15.450907 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:36:15.450907 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7ebc01d-7008-4ca7-a82b-094962216ceb could not be found. Oct 18 15:36:15.450907 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:15.452838 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7b433c6b-c2e1-49f3-8b11-e0f4b41dba8a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Returning 404 to user: Instance b7ebc01d-7008-4ca7-a82b-094962216ceb could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:36:15.454545 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7b433c6b-c2e1-49f3-8b11-e0f4b41dba8a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/b7ebc01d-7008-4ca7-a82b-094962216ceb" status: 404 len: 111 microversion: 2.1 time: 0.091375 Oct 18 15:36:15.459095 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1270/2655] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:15 2022] GET /compute/v2.1/servers/b7ebc01d-7008-4ca7-a82b-094962216ceb => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 15:36:15.478595 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9979dd1a-4614-4476-a4f8-5b674dc75458 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:15.479615 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9979dd1a-4614-4476-a4f8-5b674dc75458 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 1c84f8ca-befc-489e-8068-135af3b766fe] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:15.487389 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9979dd1a-4614-4476-a4f8-5b674dc75458 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:15.488160 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9979dd1a-4614-4476-a4f8-5b674dc75458 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:15.488873 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9979dd1a-4614-4476-a4f8-5b674dc75458 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:15.489828 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9979dd1a-4614-4476-a4f8-5b674dc75458 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:15.494120 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d437a5ae-8972-4d31-a787-9c2a7e1984ea tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:15.499745 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9979dd1a-4614-4476-a4f8-5b674dc75458 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:15.504652 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d437a5ae-8972-4d31-a787-9c2a7e1984ea tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c" status: 200 len: 1471 microversion: 2.1 time: 0.490364 Oct 18 15:36:15.505551 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9979dd1a-4614-4476-a4f8-5b674dc75458 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:15.529384 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1386/2656] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:15 2022] GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c => generated 1471 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:15.593182 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-38218121-e5ca-4d00-a4d0-aceab8749722 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:15.593182 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-38218121-e5ca-4d00-a4d0-aceab8749722 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] [instance: 82aba568-875e-459c-8bc9-248b4851fc94] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:15.596414 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-38218121-e5ca-4d00-a4d0-aceab8749722 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:15.597377 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-38218121-e5ca-4d00-a4d0-aceab8749722 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:15.597980 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-38218121-e5ca-4d00-a4d0-aceab8749722 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:15.600628 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-38218121-e5ca-4d00-a4d0-aceab8749722 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:15.607636 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-38218121-e5ca-4d00-a4d0-aceab8749722 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:15.608058 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-38218121-e5ca-4d00-a4d0-aceab8749722 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:15.627414 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:36:16.065825 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-38218121-e5ca-4d00-a4d0-aceab8749722 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a7ce3bb784a79b3ac336743b9ae84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a52e3135e52493b8ccb2d7342418591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:16.077595 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-38218121-e5ca-4d00-a4d0-aceab8749722 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "GET /compute/v2.1/servers/82aba568-875e-459c-8bc9-248b4851fc94" status: 200 len: 1316 microversion: 2.1 time: 0.500730 Oct 18 15:36:16.091319 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1387/2657] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:15 2022] GET /compute/v2.1/servers/82aba568-875e-459c-8bc9-248b4851fc94 => generated 1316 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:36:16.091319 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ffa5cc55-8904-46ff-9988-0df15d58d1c2 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:16.098691 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9979dd1a-4614-4476-a4f8-5b674dc75458 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:16.099760 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ffa5cc55-8904-46ff-9988-0df15d58d1c2 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: b7ebc01d-7008-4ca7-a82b-094962216ceb] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:16.110211 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9979dd1a-4614-4476-a4f8-5b674dc75458 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe" status: 200 len: 1461 microversion: 2.1 time: 0.636221 Oct 18 15:36:16.112840 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ffa5cc55-8904-46ff-9988-0df15d58d1c2 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:16.115469 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ffa5cc55-8904-46ff-9988-0df15d58d1c2 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:16.116256 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ffa5cc55-8904-46ff-9988-0df15d58d1c2 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:16.117857 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ffa5cc55-8904-46ff-9988-0df15d58d1c2 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:16.119850 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ffa5cc55-8904-46ff-9988-0df15d58d1c2 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:16.121317 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ffa5cc55-8904-46ff-9988-0df15d58d1c2 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:16.132865 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1271/2658] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:15 2022] GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe => generated 1461 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:16.148684 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-77e6cbe9-bc36-4d8f-8f38-bd4263da743f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:36:16.152036 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-77e6cbe9-bc36-4d8f-8f38-bd4263da743f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 1c84f8ca-befc-489e-8068-135af3b766fe] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:16.160039 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-ffa5cc55-8904-46ff-9988-0df15d58d1c2 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] HTTP exception thrown: Instance b7ebc01d-7008-4ca7-a82b-094962216ceb could not be found. Oct 18 15:36:16.165352 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ffa5cc55-8904-46ff-9988-0df15d58d1c2 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Request method failure captured: Oct 18 15:36:16.165352 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/b7ebc01d-7008-4ca7-a82b-094962216ceb/os-volume_attachments HTTP/1.1 Oct 18 15:36:16.165352 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:36:16.165352 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:36:16.165352 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:36:16.165352 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:36:16.165352 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:36:16.165352 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:36:16.165352 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:36:16.165352 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:36:16.165352 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTseXdqIE6K5VM4s3TEHRLWgMUN4aMRv2NoeIzUdaqo5huhkbfibHS5WTucH_yVgiw-oU86aIdI66etum9zPC1o_Gp8lN1ylUglhXYekmlUb-DCNwOQQTPA7nsDvbxyfFlUPyfZnM9HlX0P4k3Gbrf42L5eihIJ6KOiK__MhWlbfWWoY Oct 18 15:36:16.165352 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:36:16.165352 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:36:16.165352 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:36:16.165352 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:36:16.165352 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:36:16.165352 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:36:16.165352 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 04fd51d598a04ff7a909b3ced951dea8 Oct 18 15:36:16.165352 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-DeleteServersTestJSON-518486720 Oct 18 15:36:16.165352 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:36:16.165352 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:36:16.166773 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:36:16.166773 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-DeleteServersTestJSON-518486720 Oct 18 15:36:16.166773 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 04fd51d598a04ff7a909b3ced951dea8 Oct 18 15:36:16.166773 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-DeleteServersTestJSON-518486720 Oct 18 15:36:16.166773 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-DeleteServersTestJSON-518486720-project Oct 18 15:36:16.166773 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:36:16.166773 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:36:16.166773 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 5309baeeec484df194123d22779b0255 Oct 18 15:36:16.166773 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-DeleteServersTestJSON-518486720-project Oct 18 15:36:16.166773 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:36:16.166773 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance b7ebc01d-7008-4ca7-a82b-094962216ceb could not be found. Oct 18 15:36:16.166773 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'server_id': 'b7ebc01d-7008-4ca7-a82b-094962216ceb'} Oct 18 15:36:16.167490 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:36:16.167490 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:16.167490 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:36:16.167490 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:36:16.167490 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:36:16.167490 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:36:16.167490 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:36:16.167490 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:36:16.167490 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:36:16.167490 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:36:16.167490 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7ebc01d-7008-4ca7-a82b-094962216ceb could not be found. Oct 18 15:36:16.167490 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:16.167490 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:16.167490 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:16.167490 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:16.167490 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:36:16.167490 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:36:16.167490 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:36:16.167490 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:36:16.167490 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:36:16.168636 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:36:16.168636 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 15:36:16.168636 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:36:16.168636 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 15:36:16.168636 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:36:16.168636 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 18 15:36:16.168636 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 18 15:36:16.168636 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:36:16.168636 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:36:16.168636 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7ebc01d-7008-4ca7-a82b-094962216ceb could not be found. Oct 18 15:36:16.168636 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:16.168636 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:16.168636 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:16.168636 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:16.168636 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:36:16.168636 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:36:16.168636 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:36:16.168636 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:36:16.168636 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7ebc01d-7008-4ca7-a82b-094962216ceb could not be found. Oct 18 15:36:16.168636 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:16.170268 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ffa5cc55-8904-46ff-9988-0df15d58d1c2 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Returning 404 to user: Instance b7ebc01d-7008-4ca7-a82b-094962216ceb could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:36:16.170268 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ffa5cc55-8904-46ff-9988-0df15d58d1c2 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/b7ebc01d-7008-4ca7-a82b-094962216ceb/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.088595 Oct 18 15:36:16.170268 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1388/2659] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 15:36:16 2022] GET /compute/v2.1/servers/b7ebc01d-7008-4ca7-a82b-094962216ceb/os-volume_attachments => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:36:16.171910 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77e6cbe9-bc36-4d8f-8f38-bd4263da743f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:16.172642 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77e6cbe9-bc36-4d8f-8f38-bd4263da743f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:16.173242 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77e6cbe9-bc36-4d8f-8f38-bd4263da743f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:16.174570 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77e6cbe9-bc36-4d8f-8f38-bd4263da743f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:16.175281 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77e6cbe9-bc36-4d8f-8f38-bd4263da743f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:16.176878 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77e6cbe9-bc36-4d8f-8f38-bd4263da743f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:16.480388 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f2492130-d84f-4aa6-a9d1-3e08d9e4f92e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-307111320", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "670a85ee-2ce6-476a-bad3-558d8003ee5a"}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:36:16.497028 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-77e6cbe9-bc36-4d8f-8f38-bd4263da743f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:16.506317 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-77e6cbe9-bc36-4d8f-8f38-bd4263da743f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 1c84f8ca-befc-489e-8068-135af3b766fe] Old instance type m1.heat2, new instance type m1.heat {{(pid=120406) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 18 15:36:16.542414 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-77e6cbe9-bc36-4d8f-8f38-bd4263da743f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:36:16.543057 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-77e6cbe9-bc36-4d8f-8f38-bd4263da743f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:36:16.544362 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-77e6cbe9-bc36-4d8f-8f38-bd4263da743f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:36:16.545850 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-77e6cbe9-bc36-4d8f-8f38-bd4263da743f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:36:16.547446 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-77e6cbe9-bc36-4d8f-8f38-bd4263da743f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:36:16.574629 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-f2492130-d84f-4aa6-a9d1-3e08d9e4f92e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] validate_networks() for [('670a85ee-2ce6-476a-bad3-558d8003ee5a', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:36:16.740281 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-77e6cbe9-bc36-4d8f-8f38-bd4263da743f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "POST /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe/action" status: 202 len: 0 microversion: 2.1 time: 0.604744 Oct 18 15:36:16.748824 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1272/2660] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:36:16 2022] POST /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe/action => generated 0 bytes in 614 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:36:16.759850 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c2b21af1-ba86-4c63-b532-dc635b9449a1 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:16.763631 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c2b21af1-ba86-4c63-b532-dc635b9449a1 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:16.778200 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c2b21af1-ba86-4c63-b532-dc635b9449a1 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:16.778750 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c2b21af1-ba86-4c63-b532-dc635b9449a1 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:16.779200 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c2b21af1-ba86-4c63-b532-dc635b9449a1 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:16.779946 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c2b21af1-ba86-4c63-b532-dc635b9449a1 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:16.780485 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c2b21af1-ba86-4c63-b532-dc635b9449a1 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:16.780951 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c2b21af1-ba86-4c63-b532-dc635b9449a1 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:16.828179 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:36:17.775374 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c2b21af1-ba86-4c63-b532-dc635b9449a1 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:17.786022 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c2b21af1-ba86-4c63-b532-dc635b9449a1 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c" status: 200 len: 1471 microversion: 2.1 time: 1.035856 Oct 18 15:36:17.786862 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1273/2661] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:16 2022] GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c => generated 1471 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:17.798991 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-315460ed-2f31-47ac-8519-632a1837bcda tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:17.799931 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-315460ed-2f31-47ac-8519-632a1837bcda tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 1c84f8ca-befc-489e-8068-135af3b766fe] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:17.810938 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-315460ed-2f31-47ac-8519-632a1837bcda tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:17.817899 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-315460ed-2f31-47ac-8519-632a1837bcda tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:17.818657 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-315460ed-2f31-47ac-8519-632a1837bcda tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:17.819617 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-315460ed-2f31-47ac-8519-632a1837bcda tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:17.823839 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-315460ed-2f31-47ac-8519-632a1837bcda tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:17.824535 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-315460ed-2f31-47ac-8519-632a1837bcda tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:18.226109 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-f2492130-d84f-4aa6-a9d1-3e08d9e4f92e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:36:18.226619 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-f2492130-d84f-4aa6-a9d1-3e08d9e4f92e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:36:18.227257 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-f2492130-d84f-4aa6-a9d1-3e08d9e4f92e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:36:18.227813 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-f2492130-d84f-4aa6-a9d1-3e08d9e4f92e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:36:18.228563 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-f2492130-d84f-4aa6-a9d1-3e08d9e4f92e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:36:18.246577 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f2492130-d84f-4aa6-a9d1-3e08d9e4f92e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:18.248417 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f2492130-d84f-4aa6-a9d1-3e08d9e4f92e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:18.249616 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f2492130-d84f-4aa6-a9d1-3e08d9e4f92e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:18.253081 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f2492130-d84f-4aa6-a9d1-3e08d9e4f92e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:18.261522 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f2492130-d84f-4aa6-a9d1-3e08d9e4f92e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:18.264219 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f2492130-d84f-4aa6-a9d1-3e08d9e4f92e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:18.305899 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-f2492130-d84f-4aa6-a9d1-3e08d9e4f92e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Getting quotas for project 04fd51d598a04ff7a909b3ced951dea8. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:36:18.336545 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-f2492130-d84f-4aa6-a9d1-3e08d9e4f92e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Getting quotas for user 5309baeeec484df194123d22779b0255 and project 04fd51d598a04ff7a909b3ced951dea8. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:36:18.386547 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f2492130-d84f-4aa6-a9d1-3e08d9e4f92e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:36:18.394648 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f2492130-d84f-4aa6-a9d1-3e08d9e4f92e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 2e4fd46f-603d-4866-8bff-1361f1a9c9ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:36:18.436717 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-315460ed-2f31-47ac-8519-632a1837bcda tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:18.447856 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-315460ed-2f31-47ac-8519-632a1837bcda tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe" status: 200 len: 1470 microversion: 2.1 time: 0.659195 Oct 18 15:36:18.474196 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1274/2662] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:17 2022] GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe => generated 1470 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:18.495398 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b0cc0d7d-0b2a-4743-97cd-a30b752b6a1d tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:18.502098 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b0cc0d7d-0b2a-4743-97cd-a30b752b6a1d tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] [instance: 82aba568-875e-459c-8bc9-248b4851fc94] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:18.519183 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b0cc0d7d-0b2a-4743-97cd-a30b752b6a1d tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:18.519845 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b0cc0d7d-0b2a-4743-97cd-a30b752b6a1d tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:18.521059 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b0cc0d7d-0b2a-4743-97cd-a30b752b6a1d tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:18.522520 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b0cc0d7d-0b2a-4743-97cd-a30b752b6a1d tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:18.529835 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b0cc0d7d-0b2a-4743-97cd-a30b752b6a1d tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:18.530444 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b0cc0d7d-0b2a-4743-97cd-a30b752b6a1d tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:18.557972 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f2492130-d84f-4aa6-a9d1-3e08d9e4f92e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.079968 Oct 18 15:36:18.561420 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1389/2663] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:36:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2084 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 15:36:18.575845 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3fa2597c-8da2-41ba-9c5d-f6acf7b01a14 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:18.577563 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3fa2597c-8da2-41ba-9c5d-f6acf7b01a14 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 2e4fd46f-603d-4866-8bff-1361f1a9c9ab] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:18.805884 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3fa2597c-8da2-41ba-9c5d-f6acf7b01a14 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:18.821081 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3fa2597c-8da2-41ba-9c5d-f6acf7b01a14 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/2e4fd46f-603d-4866-8bff-1361f1a9c9ab" status: 200 len: 1214 microversion: 2.1 time: 0.254052 Oct 18 15:36:18.821687 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1390/2664] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:18 2022] GET /compute/v2.1/servers/2e4fd46f-603d-4866-8bff-1361f1a9c9ab => generated 1214 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:18.844175 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-547f03d4-6a2d-47ee-b6bb-cae40517ee81 req-9a3cda7a-7448-40fc-b77a-b7cc0c6c898a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82aba568-875e-459c-8bc9-248b4851fc94", "tag": "ec50c426-5283-46d3-a30f-d9ba968c4452"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:36:18.890067 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-547f03d4-6a2d-47ee-b6bb-cae40517ee81 req-9a3cda7a-7448-40fc-b77a-b7cc0c6c898a service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:18.904641 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-547f03d4-6a2d-47ee-b6bb-cae40517ee81 req-9a3cda7a-7448-40fc-b77a-b7cc0c6c898a service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:18.906306 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-547f03d4-6a2d-47ee-b6bb-cae40517ee81 req-9a3cda7a-7448-40fc-b77a-b7cc0c6c898a service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:18.968297 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-547f03d4-6a2d-47ee-b6bb-cae40517ee81 req-9a3cda7a-7448-40fc-b77a-b7cc0c6c898a service nova] Creating event network-changed:ec50c426-5283-46d3-a30f-d9ba968c4452 for instance 82aba568-875e-459c-8bc9-248b4851fc94 on n-h2-853682-5 Oct 18 15:36:18.991580 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-547f03d4-6a2d-47ee-b6bb-cae40517ee81 req-9a3cda7a-7448-40fc-b77a-b7cc0c6c898a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162512 Oct 18 15:36:18.996077 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1391/2665] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:36:19.006778 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ca3a29cd-0390-4f40-a5fe-6213feb52e15 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:19.011317 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ca3a29cd-0390-4f40-a5fe-6213feb52e15 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:19.027994 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca3a29cd-0390-4f40-a5fe-6213feb52e15 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:19.028497 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca3a29cd-0390-4f40-a5fe-6213feb52e15 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:19.028976 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca3a29cd-0390-4f40-a5fe-6213feb52e15 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:19.029693 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca3a29cd-0390-4f40-a5fe-6213feb52e15 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:19.030152 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca3a29cd-0390-4f40-a5fe-6213feb52e15 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:19.030667 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca3a29cd-0390-4f40-a5fe-6213feb52e15 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:19.545136 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b0cc0d7d-0b2a-4743-97cd-a30b752b6a1d tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a7ce3bb784a79b3ac336743b9ae84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a52e3135e52493b8ccb2d7342418591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:19.553218 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b0cc0d7d-0b2a-4743-97cd-a30b752b6a1d tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "GET /compute/v2.1/servers/82aba568-875e-459c-8bc9-248b4851fc94" status: 200 len: 1316 microversion: 2.1 time: 1.066580 Oct 18 15:36:19.553813 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1275/2666] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:18 2022] GET /compute/v2.1/servers/82aba568-875e-459c-8bc9-248b4851fc94 => generated 1316 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:19.573058 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6a45529e-8e8f-48e2-8069-52c38f944f0c tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:19.573557 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6a45529e-8e8f-48e2-8069-52c38f944f0c tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 2e4fd46f-603d-4866-8bff-1361f1a9c9ab] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:19.579699 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a45529e-8e8f-48e2-8069-52c38f944f0c tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:19.580399 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a45529e-8e8f-48e2-8069-52c38f944f0c tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:19.580869 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a45529e-8e8f-48e2-8069-52c38f944f0c tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:19.581590 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a45529e-8e8f-48e2-8069-52c38f944f0c tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:19.582046 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a45529e-8e8f-48e2-8069-52c38f944f0c tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:19.582473 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a45529e-8e8f-48e2-8069-52c38f944f0c tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:19.609451 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6a45529e-8e8f-48e2-8069-52c38f944f0c tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 2e4fd46f-603d-4866-8bff-1361f1a9c9ab] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:36:19.621096 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a45529e-8e8f-48e2-8069-52c38f944f0c tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:19.621582 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a45529e-8e8f-48e2-8069-52c38f944f0c tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:19.622015 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a45529e-8e8f-48e2-8069-52c38f944f0c tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:19.627171 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ca3a29cd-0390-4f40-a5fe-6213feb52e15 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:19.655903 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ca3a29cd-0390-4f40-a5fe-6213feb52e15 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c" status: 200 len: 1471 microversion: 2.1 time: 0.639842 Oct 18 15:36:19.700865 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1392/2667] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:18 2022] GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c => generated 1471 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:19.701619 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-6a45529e-8e8f-48e2-8069-52c38f944f0c tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lazy-loading 'flavor' on Instance uuid 2e4fd46f-603d-4866-8bff-1361f1a9c9ab {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:36:19.701619 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-6a45529e-8e8f-48e2-8069-52c38f944f0c tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lazy-loading 'system_metadata' on Instance uuid 2e4fd46f-603d-4866-8bff-1361f1a9c9ab {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:36:19.804006 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-6a45529e-8e8f-48e2-8069-52c38f944f0c tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lazy-loading 'metadata' on Instance uuid 2e4fd46f-603d-4866-8bff-1361f1a9c9ab {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:36:19.945261 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-06bfb461-07f6-4394-b15d-b3c4e51dd1dd tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Action: 'create', calling method: .version_select at 0x7f7c3d37a550>, body: {"keypair": {"name": "tempest-keypair-469626577", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDsElvvHEoUeWWvAZJzP0KuIGuHKLYkeQP3hC2ZX3+6T3ut3z5LmDagNQgnUY8eZYBwpFbVuduv6su61CAPmEnAV9gz+bRxueTAsahuXWOWnf1ycBazfKbUfCaVs9nnbmQ=="}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:36:20.006650 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-06bfb461-07f6-4394-b15d-b3c4e51dd1dd tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Getting quotas for project 5cdc7504a1d1424ea34f83f1a6d4bf71. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:36:20.024223 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-06bfb461-07f6-4394-b15d-b3c4e51dd1dd tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Getting quotas for user 304b3248f9db4629943a8b8080a6d22e and project 5cdc7504a1d1424ea34f83f1a6d4bf71. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:36:20.095135 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.scheduler.client.report [None req-6a45529e-8e8f-48e2-8069-52c38f944f0c tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Deleted allocations for instance 2e4fd46f-603d-4866-8bff-1361f1a9c9ab Oct 18 15:36:20.102573 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-06bfb461-07f6-4394-b15d-b3c4e51dd1dd tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.433737 Oct 18 15:36:20.103441 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1393/2668] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Oct 18 15:36:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:36:20.116632 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f3a5f917-8efb-4872-ba03-81bbda6a9ff8 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:20.117306 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f3a5f917-8efb-4872-ba03-81bbda6a9ff8 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 1c84f8ca-befc-489e-8068-135af3b766fe] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:20.134219 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6a45529e-8e8f-48e2-8069-52c38f944f0c tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "DELETE /compute/v2.1/servers/2e4fd46f-603d-4866-8bff-1361f1a9c9ab" status: 204 len: 0 microversion: 2.1 time: 0.564357 Oct 18 15:36:20.134983 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1276/2669] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:36:19 2022] DELETE /compute/v2.1/servers/2e4fd46f-603d-4866-8bff-1361f1a9c9ab => generated 0 bytes in 581 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:36:20.139867 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f3a5f917-8efb-4872-ba03-81bbda6a9ff8 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:20.140405 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f3a5f917-8efb-4872-ba03-81bbda6a9ff8 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:20.142496 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f3a5f917-8efb-4872-ba03-81bbda6a9ff8 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:20.143215 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-50b4c912-556b-4aba-aed9-678e72b114e8 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:20.143850 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-50b4c912-556b-4aba-aed9-678e72b114e8 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 2e4fd46f-603d-4866-8bff-1361f1a9c9ab] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:20.144524 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f3a5f917-8efb-4872-ba03-81bbda6a9ff8 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:20.151215 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50b4c912-556b-4aba-aed9-678e72b114e8 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:20.151664 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f3a5f917-8efb-4872-ba03-81bbda6a9ff8 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:20.152043 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50b4c912-556b-4aba-aed9-678e72b114e8 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:20.152492 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50b4c912-556b-4aba-aed9-678e72b114e8 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:20.152899 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f3a5f917-8efb-4872-ba03-81bbda6a9ff8 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:20.153277 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50b4c912-556b-4aba-aed9-678e72b114e8 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:20.153864 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50b4c912-556b-4aba-aed9-678e72b114e8 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:20.154478 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50b4c912-556b-4aba-aed9-678e72b114e8 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:20.191253 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-50b4c912-556b-4aba-aed9-678e72b114e8 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] HTTP exception thrown: Instance 2e4fd46f-603d-4866-8bff-1361f1a9c9ab could not be found. Oct 18 15:36:20.200644 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-50b4c912-556b-4aba-aed9-678e72b114e8 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Request method failure captured: Oct 18 15:36:20.200644 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/2e4fd46f-603d-4866-8bff-1361f1a9c9ab HTTP/1.1 Oct 18 15:36:20.200644 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:36:20.200644 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:36:20.200644 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:36:20.200644 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:36:20.200644 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:36:20.200644 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:36:20.200644 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:36:20.200644 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:36:20.200644 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTseXdqIE6K5VM4s3TEHRLWgMUN4aMRv2NoeIzUdaqo5huhkbfibHS5WTucH_yVgiw-oU86aIdI66etum9zPC1o_Gp8lN1ylUglhXYekmlUb-DCNwOQQTPA7nsDvbxyfFlUPyfZnM9HlX0P4k3Gbrf42L5eihIJ6KOiK__MhWlbfWWoY Oct 18 15:36:20.200644 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:36:20.200644 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:36:20.200644 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:36:20.200644 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:36:20.200644 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:36:20.200644 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:36:20.200644 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 04fd51d598a04ff7a909b3ced951dea8 Oct 18 15:36:20.200644 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-DeleteServersTestJSON-518486720 Oct 18 15:36:20.200644 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:36:20.200644 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:36:20.202335 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:36:20.202335 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-DeleteServersTestJSON-518486720 Oct 18 15:36:20.202335 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 04fd51d598a04ff7a909b3ced951dea8 Oct 18 15:36:20.202335 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-DeleteServersTestJSON-518486720 Oct 18 15:36:20.202335 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-DeleteServersTestJSON-518486720-project Oct 18 15:36:20.202335 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:36:20.202335 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:36:20.202335 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 5309baeeec484df194123d22779b0255 Oct 18 15:36:20.202335 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-DeleteServersTestJSON-518486720-project Oct 18 15:36:20.202335 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:36:20.202335 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 2e4fd46f-603d-4866-8bff-1361f1a9c9ab could not be found. Oct 18 15:36:20.202335 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '2e4fd46f-603d-4866-8bff-1361f1a9c9ab'} Oct 18 15:36:20.203227 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:36:20.203227 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:20.203227 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:36:20.203227 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:36:20.203227 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:36:20.203227 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:36:20.203227 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:36:20.203227 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:36:20.203227 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:36:20.203227 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:36:20.203227 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e4fd46f-603d-4866-8bff-1361f1a9c9ab could not be found. Oct 18 15:36:20.203227 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:20.203227 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:20.203227 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:20.203227 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:20.203227 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:36:20.203227 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:36:20.203227 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:36:20.203227 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:36:20.203227 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:36:20.204649 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:36:20.204649 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:36:20.204649 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:36:20.204649 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:36:20.204649 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:36:20.204649 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:36:20.204649 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:36:20.204649 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e4fd46f-603d-4866-8bff-1361f1a9c9ab could not be found. Oct 18 15:36:20.204649 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:20.204649 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:20.204649 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:20.204649 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:20.204649 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:36:20.204649 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:36:20.204649 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:36:20.204649 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:36:20.204649 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e4fd46f-603d-4866-8bff-1361f1a9c9ab could not be found. Oct 18 15:36:20.204649 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:20.207072 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-50b4c912-556b-4aba-aed9-678e72b114e8 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Returning 404 to user: Instance 2e4fd46f-603d-4866-8bff-1361f1a9c9ab could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:36:20.208129 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-50b4c912-556b-4aba-aed9-678e72b114e8 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/2e4fd46f-603d-4866-8bff-1361f1a9c9ab" status: 404 len: 111 microversion: 2.1 time: 0.069055 Oct 18 15:36:20.210298 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1277/2670] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:20 2022] GET /compute/v2.1/servers/2e4fd46f-603d-4866-8bff-1361f1a9c9ab => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 15:36:20.314111 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e35354d9-f127-4cb6-928c-eb37180f602b tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1801036871", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "670a85ee-2ce6-476a-bad3-558d8003ee5a"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:36:20.386127 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-e35354d9-f127-4cb6-928c-eb37180f602b tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] validate_networks() for [('670a85ee-2ce6-476a-bad3-558d8003ee5a', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:36:20.796611 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f3a5f917-8efb-4872-ba03-81bbda6a9ff8 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:20.806790 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f3a5f917-8efb-4872-ba03-81bbda6a9ff8 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe" status: 200 len: 1470 microversion: 2.1 time: 0.701217 Oct 18 15:36:20.808090 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1394/2671] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:20 2022] GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe => generated 1470 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:20.814117 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d5fc710d-cbb2-4b24-bea6-f0a042bd20ae tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:20.814986 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d5fc710d-cbb2-4b24-bea6-f0a042bd20ae tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] [instance: 5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:20.822486 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d5fc710d-cbb2-4b24-bea6-f0a042bd20ae tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:20.823428 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d5fc710d-cbb2-4b24-bea6-f0a042bd20ae tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:20.824221 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d5fc710d-cbb2-4b24-bea6-f0a042bd20ae tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:20.825235 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d5fc710d-cbb2-4b24-bea6-f0a042bd20ae tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:20.825797 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d5fc710d-cbb2-4b24-bea6-f0a042bd20ae tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:20.828303 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d5fc710d-cbb2-4b24-bea6-f0a042bd20ae tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:20.855040 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-d5fc710d-cbb2-4b24-bea6-f0a042bd20ae tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] HTTP exception thrown: Instance 5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e could not be found. Oct 18 15:36:20.856854 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d5fc710d-cbb2-4b24-bea6-f0a042bd20ae tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Request method failure captured: Oct 18 15:36:20.856854 n-d-853682-5 devstack@n-api.service[120405]: request: DELETE /compute/v2.1/servers/5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e HTTP/1.1 Oct 18 15:36:20.856854 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:36:20.856854 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:36:20.856854 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:36:20.856854 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:36:20.856854 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:36:20.856854 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:36:20.856854 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:36:20.856854 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:36:20.856854 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsb5s3fR67FENnucwCnt7ALMT22YEQaRKxxWiqTkt5shk6Vomwm4-O0-rT0Q8sQHNDci6oNsPZ5CLLh2gcLT4TdZCIoQZsS7ppATck0xL54KWTElp4deqARaqZVH0Gcn0hMOwHp1WvPPNw5tp5UmMhqjZReeWsW9HS08F1SKiprc6MQ Oct 18 15:36:20.856854 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:36:20.856854 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:36:20.856854 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:36:20.856854 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:36:20.856854 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:36:20.856854 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:36:20.856854 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 82c561322de64f83a8c90d1bdcc833ea Oct 18 15:36:20.856854 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1276183265 Oct 18 15:36:20.856854 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:36:20.856854 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:36:20.858118 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/82c561322de64f83a8c90d1bdcc833ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/82c561322de64f83a8c90d1bdcc833ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/82c561322de64f83a8c90d1bdcc833ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_82c561322de64f83a8c90d1bdcc833ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:36:20.858118 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1276183265 Oct 18 15:36:20.858118 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 82c561322de64f83a8c90d1bdcc833ea Oct 18 15:36:20.858118 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1276183265 Oct 18 15:36:20.858118 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-AttachSCSIVolumeTestJSON-1276183265-project Oct 18 15:36:20.858118 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:36:20.858118 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:36:20.858118 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 8769f6ac73af4d8589d9e94175259031 Oct 18 15:36:20.858118 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1276183265-project Oct 18 15:36:20.858118 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:36:20.858118 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e could not be found. Oct 18 15:36:20.858118 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e'} Oct 18 15:36:20.858861 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:36:20.858861 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:20.858861 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:36:20.858861 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:36:20.858861 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:36:20.858861 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:36:20.858861 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:36:20.858861 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:36:20.858861 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:36:20.858861 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:36:20.858861 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e could not be found. Oct 18 15:36:20.858861 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:20.858861 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:20.858861 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:20.858861 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:20.858861 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:36:20.858861 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:36:20.858861 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:36:20.858861 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:36:20.858861 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:36:20.859967 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:36:20.859967 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 15:36:20.859967 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 15:36:20.859967 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 15:36:20.859967 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 15:36:20.859967 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:36:20.859967 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:36:20.859967 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:36:20.859967 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:36:20.859967 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e could not be found. Oct 18 15:36:20.859967 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:20.859967 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:20.859967 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:20.859967 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:20.859967 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:36:20.859967 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:36:20.859967 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:36:20.859967 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:36:20.859967 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e could not be found. Oct 18 15:36:20.859967 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:20.861140 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d5fc710d-cbb2-4b24-bea6-f0a042bd20ae tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Returning 404 to user: Instance 5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:36:20.861140 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d5fc710d-cbb2-4b24-bea6-f0a042bd20ae tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e" status: 404 len: 111 microversion: 2.1 time: 0.048720 Oct 18 15:36:20.862110 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1395/2672] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:36:20 2022] DELETE /compute/v2.1/servers/5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:36:20.868483 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bfce1269-8928-4816-8eaa-b749e1e0d378 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:20.869139 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-bfce1269-8928-4816-8eaa-b749e1e0d378 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] [instance: 82aba568-875e-459c-8bc9-248b4851fc94] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:20.875581 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bfce1269-8928-4816-8eaa-b749e1e0d378 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:20.876314 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bfce1269-8928-4816-8eaa-b749e1e0d378 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:20.876964 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bfce1269-8928-4816-8eaa-b749e1e0d378 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:20.877970 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bfce1269-8928-4816-8eaa-b749e1e0d378 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:20.878706 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bfce1269-8928-4816-8eaa-b749e1e0d378 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:20.879382 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bfce1269-8928-4816-8eaa-b749e1e0d378 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:21.236341 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-bfce1269-8928-4816-8eaa-b749e1e0d378 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a7ce3bb784a79b3ac336743b9ae84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a52e3135e52493b8ccb2d7342418591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:21.246882 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-bfce1269-8928-4816-8eaa-b749e1e0d378 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "GET /compute/v2.1/servers/82aba568-875e-459c-8bc9-248b4851fc94" status: 200 len: 1316 microversion: 2.1 time: 0.383501 Oct 18 15:36:21.248418 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1396/2673] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:20 2022] GET /compute/v2.1/servers/82aba568-875e-459c-8bc9-248b4851fc94 => generated 1316 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:21.278582 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f5cb2e14-64e6-4bcc-b1f6-ae7d205a1000 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:21.279473 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f5cb2e14-64e6-4bcc-b1f6-ae7d205a1000 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:21.287549 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f5cb2e14-64e6-4bcc-b1f6-ae7d205a1000 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:21.288288 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f5cb2e14-64e6-4bcc-b1f6-ae7d205a1000 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:21.288945 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f5cb2e14-64e6-4bcc-b1f6-ae7d205a1000 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:21.290377 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f5cb2e14-64e6-4bcc-b1f6-ae7d205a1000 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:21.291056 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f5cb2e14-64e6-4bcc-b1f6-ae7d205a1000 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:21.291705 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f5cb2e14-64e6-4bcc-b1f6-ae7d205a1000 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:21.342991 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-e35354d9-f127-4cb6-928c-eb37180f602b tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:36:21.343578 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-e35354d9-f127-4cb6-928c-eb37180f602b tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:36:21.344101 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-e35354d9-f127-4cb6-928c-eb37180f602b tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:36:21.344507 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-e35354d9-f127-4cb6-928c-eb37180f602b tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:36:21.344941 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-e35354d9-f127-4cb6-928c-eb37180f602b tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:36:21.357141 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e35354d9-f127-4cb6-928c-eb37180f602b tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:21.358224 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e35354d9-f127-4cb6-928c-eb37180f602b tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:21.359037 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e35354d9-f127-4cb6-928c-eb37180f602b tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:21.360258 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e35354d9-f127-4cb6-928c-eb37180f602b tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:21.361207 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e35354d9-f127-4cb6-928c-eb37180f602b tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:21.361643 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e35354d9-f127-4cb6-928c-eb37180f602b tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:21.382915 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-e35354d9-f127-4cb6-928c-eb37180f602b tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Getting quotas for project 04fd51d598a04ff7a909b3ced951dea8. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:36:21.390520 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-e35354d9-f127-4cb6-928c-eb37180f602b tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Getting quotas for user 5309baeeec484df194123d22779b0255 and project 04fd51d598a04ff7a909b3ced951dea8. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:36:21.405784 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e35354d9-f127-4cb6-928c-eb37180f602b tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:36:21.408112 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e35354d9-f127-4cb6-928c-eb37180f602b tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: bbd6e88c-1947-4518-9fd4-c17233679336] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:36:21.421182 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:36:21.461182 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e35354d9-f127-4cb6-928c-eb37180f602b tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.158672 Oct 18 15:36:21.462402 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1278/2674] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:36:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1161 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 15:36:21.473560 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4fe172c3-5d4b-4297-9a5a-d052f5caea84 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:21.474265 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4fe172c3-5d4b-4297-9a5a-d052f5caea84 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] [instance: 5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:21.481175 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4fe172c3-5d4b-4297-9a5a-d052f5caea84 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:21.481871 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4fe172c3-5d4b-4297-9a5a-d052f5caea84 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:21.482565 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4fe172c3-5d4b-4297-9a5a-d052f5caea84 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:21.483720 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4fe172c3-5d4b-4297-9a5a-d052f5caea84 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:21.484322 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4fe172c3-5d4b-4297-9a5a-d052f5caea84 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:21.484923 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4fe172c3-5d4b-4297-9a5a-d052f5caea84 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:21.506492 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-4fe172c3-5d4b-4297-9a5a-d052f5caea84 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] HTTP exception thrown: Instance 5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e could not be found. Oct 18 15:36:21.509343 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4fe172c3-5d4b-4297-9a5a-d052f5caea84 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Request method failure captured: Oct 18 15:36:21.509343 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e HTTP/1.1 Oct 18 15:36:21.509343 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:36:21.509343 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:36:21.509343 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:36:21.509343 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:36:21.509343 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:36:21.509343 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:36:21.509343 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:36:21.509343 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:36:21.509343 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsb5s3fR67FENnucwCnt7ALMT22YEQaRKxxWiqTkt5shk6Vomwm4-O0-rT0Q8sQHNDci6oNsPZ5CLLh2gcLT4TdZCIoQZsS7ppATck0xL54KWTElp4deqARaqZVH0Gcn0hMOwHp1WvPPNw5tp5UmMhqjZReeWsW9HS08F1SKiprc6MQ Oct 18 15:36:21.509343 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:36:21.509343 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:36:21.509343 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:36:21.509343 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:36:21.509343 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:36:21.509343 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:36:21.509343 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 82c561322de64f83a8c90d1bdcc833ea Oct 18 15:36:21.509343 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1276183265 Oct 18 15:36:21.509343 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:36:21.509343 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:36:21.510588 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/82c561322de64f83a8c90d1bdcc833ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/82c561322de64f83a8c90d1bdcc833ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/82c561322de64f83a8c90d1bdcc833ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_82c561322de64f83a8c90d1bdcc833ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:36:21.510588 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1276183265 Oct 18 15:36:21.510588 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 82c561322de64f83a8c90d1bdcc833ea Oct 18 15:36:21.510588 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1276183265 Oct 18 15:36:21.510588 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-AttachSCSIVolumeTestJSON-1276183265-project Oct 18 15:36:21.510588 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:36:21.510588 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:36:21.510588 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 8769f6ac73af4d8589d9e94175259031 Oct 18 15:36:21.510588 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1276183265-project Oct 18 15:36:21.510588 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:36:21.510588 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e could not be found. Oct 18 15:36:21.510588 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e'} Oct 18 15:36:21.511279 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:36:21.511279 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:21.511279 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:36:21.511279 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:36:21.511279 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:36:21.511279 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:36:21.511279 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:36:21.511279 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:36:21.511279 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:36:21.511279 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:36:21.511279 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e could not be found. Oct 18 15:36:21.511279 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:21.511279 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:21.511279 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:21.511279 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:21.511279 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:36:21.511279 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:36:21.511279 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:36:21.511279 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:36:21.511279 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:36:21.512408 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:36:21.512408 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:36:21.512408 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:36:21.512408 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:36:21.512408 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:36:21.512408 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:36:21.512408 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:36:21.512408 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e could not be found. Oct 18 15:36:21.512408 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:21.512408 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:21.512408 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:21.512408 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:21.512408 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:36:21.512408 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:36:21.512408 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:36:21.512408 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:36:21.512408 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e could not be found. Oct 18 15:36:21.512408 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:21.513479 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4fe172c3-5d4b-4297-9a5a-d052f5caea84 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] Returning 404 to user: Instance 5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:36:21.513479 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4fe172c3-5d4b-4297-9a5a-d052f5caea84 tempest-AttachSCSIVolumeTestJSON-1276183265 tempest-AttachSCSIVolumeTestJSON-1276183265-project] 10.222.0.60 "GET /compute/v2.1/servers/5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e" status: 404 len: 111 microversion: 2.1 time: 0.041234 Oct 18 15:36:21.515638 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1279/2675] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:21 2022] GET /compute/v2.1/servers/5eb780cb-dd94-4b99-b6e9-ed9ca0d8bd1e => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:36:21.521537 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c63fe61e-e34f-4598-8727-ca6783304014 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:21.522351 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c63fe61e-e34f-4598-8727-ca6783304014 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: bbd6e88c-1947-4518-9fd4-c17233679336] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:21.568564 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f5cb2e14-64e6-4bcc-b1f6-ae7d205a1000 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:21.587009 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f5cb2e14-64e6-4bcc-b1f6-ae7d205a1000 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c" status: 200 len: 1489 microversion: 2.1 time: 0.323884 Oct 18 15:36:21.600917 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1397/2676] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:21 2022] GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c => generated 1489 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:21.611528 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c63fe61e-e34f-4598-8727-ca6783304014 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:21.619749 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c63fe61e-e34f-4598-8727-ca6783304014 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/bbd6e88c-1947-4518-9fd4-c17233679336" status: 200 len: 1215 microversion: 2.1 time: 0.102905 Oct 18 15:36:21.620563 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1280/2677] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:21 2022] GET /compute/v2.1/servers/bbd6e88c-1947-4518-9fd4-c17233679336 => generated 1215 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:21.833006 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-adf38645-267d-4020-be2e-8fa2f79d5983 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:21.833650 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-adf38645-267d-4020-be2e-8fa2f79d5983 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 1c84f8ca-befc-489e-8068-135af3b766fe] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:21.845299 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-adf38645-267d-4020-be2e-8fa2f79d5983 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:21.845814 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-adf38645-267d-4020-be2e-8fa2f79d5983 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:21.846254 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-adf38645-267d-4020-be2e-8fa2f79d5983 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:21.847617 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-adf38645-267d-4020-be2e-8fa2f79d5983 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:21.850885 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-adf38645-267d-4020-be2e-8fa2f79d5983 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:21.866437 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-adf38645-267d-4020-be2e-8fa2f79d5983 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:22.275436 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b261d1b2-8796-4328-94d4-f0b1c185ca5a tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:22.276277 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b261d1b2-8796-4328-94d4-f0b1c185ca5a tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] [instance: 82aba568-875e-459c-8bc9-248b4851fc94] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:22.286021 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b261d1b2-8796-4328-94d4-f0b1c185ca5a tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:22.286896 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b261d1b2-8796-4328-94d4-f0b1c185ca5a tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:22.287525 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b261d1b2-8796-4328-94d4-f0b1c185ca5a tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:22.288557 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b261d1b2-8796-4328-94d4-f0b1c185ca5a tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:22.289960 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b261d1b2-8796-4328-94d4-f0b1c185ca5a tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:22.290743 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b261d1b2-8796-4328-94d4-f0b1c185ca5a tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:22.685667 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-adf38645-267d-4020-be2e-8fa2f79d5983 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:22.694332 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-adf38645-267d-4020-be2e-8fa2f79d5983 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe" status: 200 len: 1470 microversion: 2.1 time: 0.865562 Oct 18 15:36:22.697375 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1398/2678] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:21 2022] GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe => generated 1470 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:22.714182 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-77d9e86c-b814-4d73-b9ef-42cc1cd85ab8 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:22.715063 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-77d9e86c-b814-4d73-b9ef-42cc1cd85ab8 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:22.722312 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-77d9e86c-b814-4d73-b9ef-42cc1cd85ab8 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:22.723096 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-77d9e86c-b814-4d73-b9ef-42cc1cd85ab8 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:22.723773 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-77d9e86c-b814-4d73-b9ef-42cc1cd85ab8 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:22.724942 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-77d9e86c-b814-4d73-b9ef-42cc1cd85ab8 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:22.725760 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-77d9e86c-b814-4d73-b9ef-42cc1cd85ab8 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:22.726412 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-77d9e86c-b814-4d73-b9ef-42cc1cd85ab8 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:22.732717 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b261d1b2-8796-4328-94d4-f0b1c185ca5a tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a7ce3bb784a79b3ac336743b9ae84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a52e3135e52493b8ccb2d7342418591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:22.741132 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b261d1b2-8796-4328-94d4-f0b1c185ca5a tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "GET /compute/v2.1/servers/82aba568-875e-459c-8bc9-248b4851fc94" status: 200 len: 1316 microversion: 2.1 time: 0.469458 Oct 18 15:36:22.748903 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1281/2679] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:22 2022] GET /compute/v2.1/servers/82aba568-875e-459c-8bc9-248b4851fc94 => generated 1316 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:22.765507 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a92a6101-8520-42a4-a15f-0bd55a844e54 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:22.766134 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a92a6101-8520-42a4-a15f-0bd55a844e54 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: bbd6e88c-1947-4518-9fd4-c17233679336] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:22.777609 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a92a6101-8520-42a4-a15f-0bd55a844e54 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:22.778102 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a92a6101-8520-42a4-a15f-0bd55a844e54 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:22.778653 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a92a6101-8520-42a4-a15f-0bd55a844e54 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:22.779370 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a92a6101-8520-42a4-a15f-0bd55a844e54 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:22.779822 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a92a6101-8520-42a4-a15f-0bd55a844e54 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:22.780250 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a92a6101-8520-42a4-a15f-0bd55a844e54 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:23.027754 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a92a6101-8520-42a4-a15f-0bd55a844e54 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:23.037435 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a92a6101-8520-42a4-a15f-0bd55a844e54 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/bbd6e88c-1947-4518-9fd4-c17233679336" status: 200 len: 1267 microversion: 2.1 time: 0.287386 Oct 18 15:36:23.038040 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1282/2680] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:22 2022] GET /compute/v2.1/servers/bbd6e88c-1947-4518-9fd4-c17233679336 => generated 1267 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:23.187603 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-77d9e86c-b814-4d73-b9ef-42cc1cd85ab8 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:23.198319 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-77d9e86c-b814-4d73-b9ef-42cc1cd85ab8 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c" status: 200 len: 1477 microversion: 2.1 time: 0.499631 Oct 18 15:36:23.198912 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1399/2681] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:22 2022] GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c => generated 1477 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:23.733923 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bab716ec-bda5-4d4e-8247-ed5817201ff0 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:23.737803 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bab716ec-bda5-4d4e-8247-ed5817201ff0 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 1c84f8ca-befc-489e-8068-135af3b766fe] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:23.772351 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0e1a7a93-bbcc-4be5-9a13-5a42412498bc tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:23.773016 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0e1a7a93-bbcc-4be5-9a13-5a42412498bc tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] [instance: 82aba568-875e-459c-8bc9-248b4851fc94] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:23.778243 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bab716ec-bda5-4d4e-8247-ed5817201ff0 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:23.778865 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bab716ec-bda5-4d4e-8247-ed5817201ff0 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:23.779314 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bab716ec-bda5-4d4e-8247-ed5817201ff0 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:23.791943 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bab716ec-bda5-4d4e-8247-ed5817201ff0 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:23.793262 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bab716ec-bda5-4d4e-8247-ed5817201ff0 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:23.794416 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bab716ec-bda5-4d4e-8247-ed5817201ff0 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:23.795022 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0e1a7a93-bbcc-4be5-9a13-5a42412498bc tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:23.800704 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0e1a7a93-bbcc-4be5-9a13-5a42412498bc tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:23.801512 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0e1a7a93-bbcc-4be5-9a13-5a42412498bc tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:23.806009 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0e1a7a93-bbcc-4be5-9a13-5a42412498bc tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:23.808176 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0e1a7a93-bbcc-4be5-9a13-5a42412498bc tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:23.808835 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0e1a7a93-bbcc-4be5-9a13-5a42412498bc tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:24.855202 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0e1a7a93-bbcc-4be5-9a13-5a42412498bc tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a7ce3bb784a79b3ac336743b9ae84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a52e3135e52493b8ccb2d7342418591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:24.874655 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bab716ec-bda5-4d4e-8247-ed5817201ff0 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:24.896432 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0e1a7a93-bbcc-4be5-9a13-5a42412498bc tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "GET /compute/v2.1/servers/82aba568-875e-459c-8bc9-248b4851fc94" status: 200 len: 1316 microversion: 2.1 time: 1.129630 Oct 18 15:36:24.902485 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1400/2682] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:23 2022] GET /compute/v2.1/servers/82aba568-875e-459c-8bc9-248b4851fc94 => generated 1316 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:24.910659 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a11f2e53-b447-4f0c-8ee4-804908cefb6d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:24.912055 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a11f2e53-b447-4f0c-8ee4-804908cefb6d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: bbd6e88c-1947-4518-9fd4-c17233679336] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:24.918598 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a11f2e53-b447-4f0c-8ee4-804908cefb6d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:24.919368 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a11f2e53-b447-4f0c-8ee4-804908cefb6d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:24.920148 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a11f2e53-b447-4f0c-8ee4-804908cefb6d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:24.920310 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bab716ec-bda5-4d4e-8247-ed5817201ff0 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe" status: 200 len: 1475 microversion: 2.1 time: 1.204116 Oct 18 15:36:24.921898 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a11f2e53-b447-4f0c-8ee4-804908cefb6d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:24.922523 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a11f2e53-b447-4f0c-8ee4-804908cefb6d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:24.923151 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a11f2e53-b447-4f0c-8ee4-804908cefb6d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:24.931010 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1283/2683] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:23 2022] GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe => generated 1475 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:24.976301 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1854a8e0-0d4e-49d6-98bc-80097b7c6bf1 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:24.977513 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1854a8e0-0d4e-49d6-98bc-80097b7c6bf1 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:24.984479 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1854a8e0-0d4e-49d6-98bc-80097b7c6bf1 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:24.984847 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1854a8e0-0d4e-49d6-98bc-80097b7c6bf1 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:24.985274 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1854a8e0-0d4e-49d6-98bc-80097b7c6bf1 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:24.985975 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1854a8e0-0d4e-49d6-98bc-80097b7c6bf1 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:24.986422 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1854a8e0-0d4e-49d6-98bc-80097b7c6bf1 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:24.986955 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1854a8e0-0d4e-49d6-98bc-80097b7c6bf1 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:25.223327 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a11f2e53-b447-4f0c-8ee4-804908cefb6d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:25.234368 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a11f2e53-b447-4f0c-8ee4-804908cefb6d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/bbd6e88c-1947-4518-9fd4-c17233679336" status: 200 len: 1273 microversion: 2.1 time: 0.327909 Oct 18 15:36:25.235681 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1401/2684] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:24 2022] GET /compute/v2.1/servers/bbd6e88c-1947-4518-9fd4-c17233679336 => generated 1273 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:25.429462 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8eef7199-bb16-4f98-966f-6fe93a8515d0 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-186007938", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "97e5b8d6-e99f-4cb5-8ca9-d5bc9c2a3450"}], "security_groups": [{"name": "tempest-securitygroup--1608531602"}], "key_name": "tempest-keypair-469626577", "user_data": "}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:36:25.473000 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1854a8e0-0d4e-49d6-98bc-80097b7c6bf1 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:25.484302 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1854a8e0-0d4e-49d6-98bc-80097b7c6bf1 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c" status: 200 len: 1477 microversion: 2.1 time: 0.527069 Oct 18 15:36:25.485535 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1284/2685] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:24 2022] GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c => generated 1477 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:25.682522 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-8eef7199-bb16-4f98-966f-6fe93a8515d0 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] validate_networks() for [('97e5b8d6-e99f-4cb5-8ca9-d5bc9c2a3450', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:36:25.738044 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-ad0be8e8-ac92-4f76-b9b4-ec994c1bee6b req-0558eda4-d27d-4187-8e89-a84ee23a8403 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35e5cf0e-693b-4930-9665-f1a53983cc1c", "name": "network-vif-unplugged", "status": "completed", "tag": "2ca5d763-fca7-4b76-a60b-8e961f804f14"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:36:25.757632 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ad0be8e8-ac92-4f76-b9b4-ec994c1bee6b req-0558eda4-d27d-4187-8e89-a84ee23a8403 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:25.770661 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ad0be8e8-ac92-4f76-b9b4-ec994c1bee6b req-0558eda4-d27d-4187-8e89-a84ee23a8403 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:25.772030 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ad0be8e8-ac92-4f76-b9b4-ec994c1bee6b req-0558eda4-d27d-4187-8e89-a84ee23a8403 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:25.801773 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-ad0be8e8-ac92-4f76-b9b4-ec994c1bee6b req-0558eda4-d27d-4187-8e89-a84ee23a8403 service nova] Creating event network-vif-unplugged:2ca5d763-fca7-4b76-a60b-8e961f804f14 for instance 35e5cf0e-693b-4930-9665-f1a53983cc1c on n-h1-853682-5 Oct 18 15:36:25.811128 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-ad0be8e8-ac92-4f76-b9b4-ec994c1bee6b req-0558eda4-d27d-4187-8e89-a84ee23a8403 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075901 Oct 18 15:36:25.812555 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1285/2686] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:36:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:36:25.962925 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-378315ea-e669-4cc5-b520-2131338a0754 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:25.964405 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-378315ea-e669-4cc5-b520-2131338a0754 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] [instance: 82aba568-875e-459c-8bc9-248b4851fc94] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:25.976443 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-378315ea-e669-4cc5-b520-2131338a0754 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:25.981875 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-378315ea-e669-4cc5-b520-2131338a0754 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:25.987306 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-378315ea-e669-4cc5-b520-2131338a0754 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:25.988362 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-378315ea-e669-4cc5-b520-2131338a0754 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:25.989110 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-378315ea-e669-4cc5-b520-2131338a0754 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:25.989762 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-378315ea-e669-4cc5-b520-2131338a0754 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:26.482336 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-378315ea-e669-4cc5-b520-2131338a0754 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a7ce3bb784a79b3ac336743b9ae84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a52e3135e52493b8ccb2d7342418591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:26.498731 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-378315ea-e669-4cc5-b520-2131338a0754 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "GET /compute/v2.1/servers/82aba568-875e-459c-8bc9-248b4851fc94" status: 200 len: 1316 microversion: 2.1 time: 0.543436 Oct 18 15:36:26.502502 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1286/2687] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:25 2022] GET /compute/v2.1/servers/82aba568-875e-459c-8bc9-248b4851fc94 => generated 1316 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:36:26.511793 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-49615d64-5d6d-49ce-ac73-590f4164e5a5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:26.512554 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-49615d64-5d6d-49ce-ac73-590f4164e5a5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 1c84f8ca-befc-489e-8068-135af3b766fe] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:26.525913 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49615d64-5d6d-49ce-ac73-590f4164e5a5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:26.526491 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49615d64-5d6d-49ce-ac73-590f4164e5a5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:26.528526 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49615d64-5d6d-49ce-ac73-590f4164e5a5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:26.529818 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49615d64-5d6d-49ce-ac73-590f4164e5a5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:26.530304 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49615d64-5d6d-49ce-ac73-590f4164e5a5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:26.530740 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49615d64-5d6d-49ce-ac73-590f4164e5a5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:26.796944 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-8eef7199-bb16-4f98-966f-6fe93a8515d0 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:36:26.797448 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-8eef7199-bb16-4f98-966f-6fe93a8515d0 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:36:26.797830 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-8eef7199-bb16-4f98-966f-6fe93a8515d0 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:36:26.798239 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-8eef7199-bb16-4f98-966f-6fe93a8515d0 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:36:26.798646 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-8eef7199-bb16-4f98-966f-6fe93a8515d0 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:36:26.808583 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8eef7199-bb16-4f98-966f-6fe93a8515d0 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:26.809096 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8eef7199-bb16-4f98-966f-6fe93a8515d0 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:26.809532 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8eef7199-bb16-4f98-966f-6fe93a8515d0 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:26.810257 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8eef7199-bb16-4f98-966f-6fe93a8515d0 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:26.810717 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8eef7199-bb16-4f98-966f-6fe93a8515d0 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:26.811169 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8eef7199-bb16-4f98-966f-6fe93a8515d0 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:26.828839 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-8eef7199-bb16-4f98-966f-6fe93a8515d0 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Getting quotas for project 5cdc7504a1d1424ea34f83f1a6d4bf71. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:36:26.834321 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-8eef7199-bb16-4f98-966f-6fe93a8515d0 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Getting quotas for user 304b3248f9db4629943a8b8080a6d22e and project 5cdc7504a1d1424ea34f83f1a6d4bf71. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:36:26.836670 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:36:26.848759 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8eef7199-bb16-4f98-966f-6fe93a8515d0 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:36:26.851096 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8eef7199-bb16-4f98-966f-6fe93a8515d0 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 52d725f3-b4da-4831-9abf-bf7aba8aee0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:36:26.900265 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8eef7199-bb16-4f98-966f-6fe93a8515d0 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.476738 Oct 18 15:36:26.901575 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1402/2688] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:36:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 1479 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:36:26.906726 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4ba9f82c-01d6-4860-9ea2-90745fc91da8 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:26.907923 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4ba9f82c-01d6-4860-9ea2-90745fc91da8 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: bbd6e88c-1947-4518-9fd4-c17233679336] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:26.914455 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ba9f82c-01d6-4860-9ea2-90745fc91da8 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:26.915737 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ba9f82c-01d6-4860-9ea2-90745fc91da8 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:26.916348 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ba9f82c-01d6-4860-9ea2-90745fc91da8 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:26.917236 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ba9f82c-01d6-4860-9ea2-90745fc91da8 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:26.917848 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ba9f82c-01d6-4860-9ea2-90745fc91da8 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:26.918430 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ba9f82c-01d6-4860-9ea2-90745fc91da8 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:26.949242 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-49615d64-5d6d-49ce-ac73-590f4164e5a5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:26.961796 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-49615d64-5d6d-49ce-ac73-590f4164e5a5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe" status: 200 len: 1475 microversion: 2.1 time: 0.456068 Oct 18 15:36:26.964231 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1287/2689] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:26 2022] GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe => generated 1475 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:26.972405 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-787f6f93-5174-4920-9a78-8e143697e96b tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:26.981705 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-787f6f93-5174-4920-9a78-8e143697e96b tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:26.988492 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-787f6f93-5174-4920-9a78-8e143697e96b tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:26.989147 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-787f6f93-5174-4920-9a78-8e143697e96b tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:26.989654 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-787f6f93-5174-4920-9a78-8e143697e96b tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:26.990430 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-787f6f93-5174-4920-9a78-8e143697e96b tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:26.990983 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-787f6f93-5174-4920-9a78-8e143697e96b tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:26.991544 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-787f6f93-5174-4920-9a78-8e143697e96b tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:27.291078 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4ba9f82c-01d6-4860-9ea2-90745fc91da8 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:27.299734 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4ba9f82c-01d6-4860-9ea2-90745fc91da8 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/bbd6e88c-1947-4518-9fd4-c17233679336" status: 200 len: 1315 microversion: 2.1 time: 0.396702 Oct 18 15:36:27.301068 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1403/2690] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:26 2022] GET /compute/v2.1/servers/bbd6e88c-1947-4518-9fd4-c17233679336 => generated 1315 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:27.306124 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-774b1731-6df2-4ae8-a717-d98ad871b4d1 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:27.306859 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-774b1731-6df2-4ae8-a717-d98ad871b4d1 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 52d725f3-b4da-4831-9abf-bf7aba8aee0a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:27.384252 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-787f6f93-5174-4920-9a78-8e143697e96b tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:27.393016 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-787f6f93-5174-4920-9a78-8e143697e96b tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c" status: 200 len: 1477 microversion: 2.1 time: 0.427725 Oct 18 15:36:27.394628 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1288/2691] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:26 2022] GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c => generated 1477 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:27.434665 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-774b1731-6df2-4ae8-a717-d98ad871b4d1 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304b3248f9db4629943a8b8080a6d22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdc7504a1d1424ea34f83f1a6d4bf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:27.441974 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-774b1731-6df2-4ae8-a717-d98ad871b4d1 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a" status: 200 len: 1236 microversion: 2.1 time: 0.139323 Oct 18 15:36:27.442793 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1404/2692] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:27 2022] GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a => generated 1236 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:27.530453 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ceeaf9ed-cc66-4ccd-86e5-8f88a5ffbd7f tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:27.531090 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ceeaf9ed-cc66-4ccd-86e5-8f88a5ffbd7f tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] [instance: 82aba568-875e-459c-8bc9-248b4851fc94] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:27.538131 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ceeaf9ed-cc66-4ccd-86e5-8f88a5ffbd7f tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:27.538617 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ceeaf9ed-cc66-4ccd-86e5-8f88a5ffbd7f tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:27.539050 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ceeaf9ed-cc66-4ccd-86e5-8f88a5ffbd7f tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:27.540054 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ceeaf9ed-cc66-4ccd-86e5-8f88a5ffbd7f tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:27.540662 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ceeaf9ed-cc66-4ccd-86e5-8f88a5ffbd7f tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:27.541260 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ceeaf9ed-cc66-4ccd-86e5-8f88a5ffbd7f tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:27.988052 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3e250161-9424-46ed-80af-329c486263d4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:27.989271 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3e250161-9424-46ed-80af-329c486263d4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 1c84f8ca-befc-489e-8068-135af3b766fe] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:27.996393 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3e250161-9424-46ed-80af-329c486263d4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:27.996911 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3e250161-9424-46ed-80af-329c486263d4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:27.997358 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3e250161-9424-46ed-80af-329c486263d4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:27.998064 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3e250161-9424-46ed-80af-329c486263d4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:27.998770 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3e250161-9424-46ed-80af-329c486263d4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:28.000592 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3e250161-9424-46ed-80af-329c486263d4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:28.300524 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ceeaf9ed-cc66-4ccd-86e5-8f88a5ffbd7f tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a7ce3bb784a79b3ac336743b9ae84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a52e3135e52493b8ccb2d7342418591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:28.302876 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=11,nova_cell1:DELETE=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:36:28.311282 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ceeaf9ed-cc66-4ccd-86e5-8f88a5ffbd7f tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "GET /compute/v2.1/servers/82aba568-875e-459c-8bc9-248b4851fc94" status: 200 len: 1316 microversion: 2.1 time: 0.785069 Oct 18 15:36:28.311888 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1289/2693] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:27 2022] GET /compute/v2.1/servers/82aba568-875e-459c-8bc9-248b4851fc94 => generated 1316 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:28.318003 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-42157072-118a-44cb-8aa1-b14f5fdc2506 req-75396722-a707-424a-822b-afe58fe65cd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82aba568-875e-459c-8bc9-248b4851fc94", "name": "network-vif-plugged", "status": "completed", "tag": "ec50c426-5283-46d3-a30f-d9ba968c4452"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:36:28.329452 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-42157072-118a-44cb-8aa1-b14f5fdc2506 req-75396722-a707-424a-822b-afe58fe65cd9 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:28.330305 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-42157072-118a-44cb-8aa1-b14f5fdc2506 req-75396722-a707-424a-822b-afe58fe65cd9 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:28.330804 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-42157072-118a-44cb-8aa1-b14f5fdc2506 req-75396722-a707-424a-822b-afe58fe65cd9 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:28.344555 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-42157072-118a-44cb-8aa1-b14f5fdc2506 req-75396722-a707-424a-822b-afe58fe65cd9 service nova] Creating event network-vif-plugged:ec50c426-5283-46d3-a30f-d9ba968c4452 for instance 82aba568-875e-459c-8bc9-248b4851fc94 on n-h2-853682-5 Oct 18 15:36:28.350022 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-42157072-118a-44cb-8aa1-b14f5fdc2506 req-75396722-a707-424a-822b-afe58fe65cd9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036220 Oct 18 15:36:28.350821 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1290/2694] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:36:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:36:28.356972 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-832619ef-dbee-49d9-b516-dd323909c1f0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:28.357873 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-832619ef-dbee-49d9-b516-dd323909c1f0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: bbd6e88c-1947-4518-9fd4-c17233679336] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:28.364755 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-832619ef-dbee-49d9-b516-dd323909c1f0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:28.369662 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-832619ef-dbee-49d9-b516-dd323909c1f0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:28.372558 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-832619ef-dbee-49d9-b516-dd323909c1f0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:28.373788 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-832619ef-dbee-49d9-b516-dd323909c1f0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:28.374259 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-832619ef-dbee-49d9-b516-dd323909c1f0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:28.374864 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-832619ef-dbee-49d9-b516-dd323909c1f0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:28.416132 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3e250161-9424-46ed-80af-329c486263d4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:28.426735 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3e250161-9424-46ed-80af-329c486263d4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe" status: 200 len: 1475 microversion: 2.1 time: 0.442711 Oct 18 15:36:28.427507 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1405/2695] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:27 2022] GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe => generated 1475 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:28.433092 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4ba2fd60-e425-482d-b1af-c70dd8b40601 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:28.433698 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4ba2fd60-e425-482d-b1af-c70dd8b40601 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:28.439659 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ba2fd60-e425-482d-b1af-c70dd8b40601 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:28.440257 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ba2fd60-e425-482d-b1af-c70dd8b40601 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:28.440689 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ba2fd60-e425-482d-b1af-c70dd8b40601 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:28.441472 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ba2fd60-e425-482d-b1af-c70dd8b40601 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:28.441994 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ba2fd60-e425-482d-b1af-c70dd8b40601 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:28.442409 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ba2fd60-e425-482d-b1af-c70dd8b40601 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:28.863990 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-832619ef-dbee-49d9-b516-dd323909c1f0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:28.874003 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-832619ef-dbee-49d9-b516-dd323909c1f0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/bbd6e88c-1947-4518-9fd4-c17233679336" status: 200 len: 1315 microversion: 2.1 time: 0.521705 Oct 18 15:36:28.884020 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4ba2fd60-e425-482d-b1af-c70dd8b40601 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:28.885694 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1291/2696] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:28 2022] GET /compute/v2.1/servers/bbd6e88c-1947-4518-9fd4-c17233679336 => generated 1315 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:28.894893 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2aad7392-d3b9-48d1-bece-5d48c9e40dbb tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:28.895287 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4ba2fd60-e425-482d-b1af-c70dd8b40601 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c" status: 200 len: 1477 microversion: 2.1 time: 0.466162 Oct 18 15:36:28.896079 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2aad7392-d3b9-48d1-bece-5d48c9e40dbb tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 52d725f3-b4da-4831-9abf-bf7aba8aee0a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:28.896733 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1406/2697] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:28 2022] GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c => generated 1477 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:28.917878 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2aad7392-d3b9-48d1-bece-5d48c9e40dbb tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:28.918685 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2aad7392-d3b9-48d1-bece-5d48c9e40dbb tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:28.919175 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2aad7392-d3b9-48d1-bece-5d48c9e40dbb tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:28.920072 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2aad7392-d3b9-48d1-bece-5d48c9e40dbb tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:28.920763 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2aad7392-d3b9-48d1-bece-5d48c9e40dbb tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:28.921721 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2aad7392-d3b9-48d1-bece-5d48c9e40dbb tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:28.937820 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-33f75d02-c72b-41f5-aafe-2bc2d9c5260a req-b83445d6-362e-4eab-babf-ac671712841b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbd6e88c-1947-4518-9fd4-c17233679336", "tag": "a4c92f1c-481f-4b18-af7a-d3f75d772a28"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:36:28.948646 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-33f75d02-c72b-41f5-aafe-2bc2d9c5260a req-b83445d6-362e-4eab-babf-ac671712841b service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:28.949486 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-33f75d02-c72b-41f5-aafe-2bc2d9c5260a req-b83445d6-362e-4eab-babf-ac671712841b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:28.950245 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-33f75d02-c72b-41f5-aafe-2bc2d9c5260a req-b83445d6-362e-4eab-babf-ac671712841b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:28.967981 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-33f75d02-c72b-41f5-aafe-2bc2d9c5260a req-b83445d6-362e-4eab-babf-ac671712841b service nova] Creating event network-changed:a4c92f1c-481f-4b18-af7a-d3f75d772a28 for instance bbd6e88c-1947-4518-9fd4-c17233679336 on n-h2-853682-5 Oct 18 15:36:28.973662 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-33f75d02-c72b-41f5-aafe-2bc2d9c5260a req-b83445d6-362e-4eab-babf-ac671712841b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041233 Oct 18 15:36:28.975335 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1407/2698] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:36:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:36:29.031877 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2aad7392-d3b9-48d1-bece-5d48c9e40dbb tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304b3248f9db4629943a8b8080a6d22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdc7504a1d1424ea34f83f1a6d4bf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:29.041691 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2aad7392-d3b9-48d1-bece-5d48c9e40dbb tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a" status: 200 len: 1294 microversion: 2.1 time: 0.154765 Oct 18 15:36:29.052982 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1292/2699] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:28 2022] GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a => generated 1294 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:29.339681 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-357d8dcf-7a14-4637-9ca4-bb0139ab024e tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:29.341304 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-357d8dcf-7a14-4637-9ca4-bb0139ab024e tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] [instance: 82aba568-875e-459c-8bc9-248b4851fc94] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:29.352741 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-357d8dcf-7a14-4637-9ca4-bb0139ab024e tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:29.353524 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-357d8dcf-7a14-4637-9ca4-bb0139ab024e tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:29.354140 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-357d8dcf-7a14-4637-9ca4-bb0139ab024e tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:29.355039 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-357d8dcf-7a14-4637-9ca4-bb0139ab024e tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:29.355678 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-357d8dcf-7a14-4637-9ca4-bb0139ab024e tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:29.356297 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-357d8dcf-7a14-4637-9ca4-bb0139ab024e tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:29.454042 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-001c51e8-c70a-4a6b-8d15-f8ed61e940f4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:29.455727 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-001c51e8-c70a-4a6b-8d15-f8ed61e940f4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 1c84f8ca-befc-489e-8068-135af3b766fe] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:29.464400 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-001c51e8-c70a-4a6b-8d15-f8ed61e940f4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:29.465307 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-001c51e8-c70a-4a6b-8d15-f8ed61e940f4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:29.466251 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-001c51e8-c70a-4a6b-8d15-f8ed61e940f4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:29.467251 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-001c51e8-c70a-4a6b-8d15-f8ed61e940f4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:29.467929 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-001c51e8-c70a-4a6b-8d15-f8ed61e940f4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:29.469029 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-001c51e8-c70a-4a6b-8d15-f8ed61e940f4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:29.913404 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-357d8dcf-7a14-4637-9ca4-bb0139ab024e tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a7ce3bb784a79b3ac336743b9ae84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a52e3135e52493b8ccb2d7342418591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:29.924100 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-357d8dcf-7a14-4637-9ca4-bb0139ab024e tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "GET /compute/v2.1/servers/82aba568-875e-459c-8bc9-248b4851fc94" status: 200 len: 1316 microversion: 2.1 time: 0.590351 Oct 18 15:36:29.924696 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1408/2700] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:29 2022] GET /compute/v2.1/servers/82aba568-875e-459c-8bc9-248b4851fc94 => generated 1316 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:29.931468 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-001c51e8-c70a-4a6b-8d15-f8ed61e940f4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:29.932206 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-77ac0c11-f588-4d70-b3cb-8ba8410aab00 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:29.933069 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-77ac0c11-f588-4d70-b3cb-8ba8410aab00 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: bbd6e88c-1947-4518-9fd4-c17233679336] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:29.941536 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-77ac0c11-f588-4d70-b3cb-8ba8410aab00 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:29.941980 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-001c51e8-c70a-4a6b-8d15-f8ed61e940f4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe" status: 200 len: 1475 microversion: 2.1 time: 0.493703 Oct 18 15:36:29.942114 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-77ac0c11-f588-4d70-b3cb-8ba8410aab00 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:29.942576 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1293/2701] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:29 2022] GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe => generated 1475 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:29.942701 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-77ac0c11-f588-4d70-b3cb-8ba8410aab00 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:29.943469 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-77ac0c11-f588-4d70-b3cb-8ba8410aab00 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:29.944009 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-77ac0c11-f588-4d70-b3cb-8ba8410aab00 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:29.944626 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-77ac0c11-f588-4d70-b3cb-8ba8410aab00 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:29.964800 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-67de7900-b896-46ac-9d2f-515bdf108bd1 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:29.965651 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-67de7900-b896-46ac-9d2f-515bdf108bd1 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:29.972134 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67de7900-b896-46ac-9d2f-515bdf108bd1 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:29.972984 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67de7900-b896-46ac-9d2f-515bdf108bd1 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:29.973643 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67de7900-b896-46ac-9d2f-515bdf108bd1 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:29.974569 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67de7900-b896-46ac-9d2f-515bdf108bd1 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:29.975261 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67de7900-b896-46ac-9d2f-515bdf108bd1 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:29.976188 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67de7900-b896-46ac-9d2f-515bdf108bd1 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:30.504985 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-77ac0c11-f588-4d70-b3cb-8ba8410aab00 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:30.530682 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-67de7900-b896-46ac-9d2f-515bdf108bd1 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:30.540486 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-77ac0c11-f588-4d70-b3cb-8ba8410aab00 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/bbd6e88c-1947-4518-9fd4-c17233679336" status: 200 len: 1315 microversion: 2.1 time: 0.613905 Oct 18 15:36:30.549178 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1409/2702] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:29 2022] GET /compute/v2.1/servers/bbd6e88c-1947-4518-9fd4-c17233679336 => generated 1315 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:30.550733 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-67de7900-b896-46ac-9d2f-515bdf108bd1 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c" status: 200 len: 1477 microversion: 2.1 time: 0.592520 Oct 18 15:36:30.556305 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-67890b91-d295-4aa7-b2f3-564bd315cb53 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:30.557450 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-67890b91-d295-4aa7-b2f3-564bd315cb53 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 52d725f3-b4da-4831-9abf-bf7aba8aee0a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:30.565183 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-67890b91-d295-4aa7-b2f3-564bd315cb53 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:30.566136 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-67890b91-d295-4aa7-b2f3-564bd315cb53 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:30.566738 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-67890b91-d295-4aa7-b2f3-564bd315cb53 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:30.567832 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-67890b91-d295-4aa7-b2f3-564bd315cb53 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:30.568502 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-67890b91-d295-4aa7-b2f3-564bd315cb53 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:30.569162 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-67890b91-d295-4aa7-b2f3-564bd315cb53 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:30.574140 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1294/2703] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:29 2022] GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c => generated 1477 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:30.579308 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-9f945d84-c90d-4a58-b396-399e0984bf33 req-42b7f15b-e511-4084-82d0-1e356de447ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52d725f3-b4da-4831-9abf-bf7aba8aee0a", "tag": "3876fb57-0e44-4236-b433-c1842e0940ff"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:36:30.612958 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9f945d84-c90d-4a58-b396-399e0984bf33 req-42b7f15b-e511-4084-82d0-1e356de447ee service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:30.613838 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9f945d84-c90d-4a58-b396-399e0984bf33 req-42b7f15b-e511-4084-82d0-1e356de447ee service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:30.614470 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9f945d84-c90d-4a58-b396-399e0984bf33 req-42b7f15b-e511-4084-82d0-1e356de447ee service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:30.628050 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-9f945d84-c90d-4a58-b396-399e0984bf33 req-42b7f15b-e511-4084-82d0-1e356de447ee service nova] Creating event network-changed:3876fb57-0e44-4236-b433-c1842e0940ff for instance 52d725f3-b4da-4831-9abf-bf7aba8aee0a on n-h1-853682-5 Oct 18 15:36:30.634783 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-9f945d84-c90d-4a58-b396-399e0984bf33 req-42b7f15b-e511-4084-82d0-1e356de447ee service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059067 Oct 18 15:36:30.636016 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1295/2704] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:36:30.641750 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-5b17b954-610f-4b1a-aa6b-e252d538abf7 req-8c89d96f-60d2-4db8-a316-9b53a461b833 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35e5cf0e-693b-4930-9665-f1a53983cc1c", "name": "network-vif-plugged", "status": "completed", "tag": "2ca5d763-fca7-4b76-a60b-8e961f804f14"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:36:30.651837 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5b17b954-610f-4b1a-aa6b-e252d538abf7 req-8c89d96f-60d2-4db8-a316-9b53a461b833 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:30.652317 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5b17b954-610f-4b1a-aa6b-e252d538abf7 req-8c89d96f-60d2-4db8-a316-9b53a461b833 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:30.652984 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5b17b954-610f-4b1a-aa6b-e252d538abf7 req-8c89d96f-60d2-4db8-a316-9b53a461b833 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:30.667597 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-5b17b954-610f-4b1a-aa6b-e252d538abf7 req-8c89d96f-60d2-4db8-a316-9b53a461b833 service nova] Creating event network-vif-plugged:2ca5d763-fca7-4b76-a60b-8e961f804f14 for instance 35e5cf0e-693b-4930-9665-f1a53983cc1c on n-h1-853682-5 Oct 18 15:36:30.673316 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-5b17b954-610f-4b1a-aa6b-e252d538abf7 req-8c89d96f-60d2-4db8-a316-9b53a461b833 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035566 Oct 18 15:36:30.677238 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1296/2705] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:36:30.950004 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e3d8d171-5adc-4b32-b8b2-d38aa9c5c747 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:30.950993 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e3d8d171-5adc-4b32-b8b2-d38aa9c5c747 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] [instance: 82aba568-875e-459c-8bc9-248b4851fc94] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:30.966854 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3d8d171-5adc-4b32-b8b2-d38aa9c5c747 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:30.967347 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3d8d171-5adc-4b32-b8b2-d38aa9c5c747 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:30.967988 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3d8d171-5adc-4b32-b8b2-d38aa9c5c747 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:30.968923 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3d8d171-5adc-4b32-b8b2-d38aa9c5c747 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:30.969557 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3d8d171-5adc-4b32-b8b2-d38aa9c5c747 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:30.970080 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3d8d171-5adc-4b32-b8b2-d38aa9c5c747 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:31.343520 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-67890b91-d295-4aa7-b2f3-564bd315cb53 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304b3248f9db4629943a8b8080a6d22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdc7504a1d1424ea34f83f1a6d4bf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:31.347363 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=100 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:36:31.353380 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-67890b91-d295-4aa7-b2f3-564bd315cb53 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a" status: 200 len: 1362 microversion: 2.1 time: 0.802535 Oct 18 15:36:31.363989 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1410/2706] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:30 2022] GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a => generated 1362 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:31.363989 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3494f6ec-2eef-450e-a830-75b9e814a57d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:31.363989 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3494f6ec-2eef-450e-a830-75b9e814a57d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 1c84f8ca-befc-489e-8068-135af3b766fe] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:31.370175 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3494f6ec-2eef-450e-a830-75b9e814a57d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:31.370672 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3494f6ec-2eef-450e-a830-75b9e814a57d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:31.371485 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3494f6ec-2eef-450e-a830-75b9e814a57d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:31.371621 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:36:31.371818 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3494f6ec-2eef-450e-a830-75b9e814a57d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:31.372276 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3494f6ec-2eef-450e-a830-75b9e814a57d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:31.372702 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3494f6ec-2eef-450e-a830-75b9e814a57d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:31.532616 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e3d8d171-5adc-4b32-b8b2-d38aa9c5c747 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a7ce3bb784a79b3ac336743b9ae84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a52e3135e52493b8ccb2d7342418591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:31.548365 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e3d8d171-5adc-4b32-b8b2-d38aa9c5c747 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "GET /compute/v2.1/servers/82aba568-875e-459c-8bc9-248b4851fc94" status: 200 len: 1505 microversion: 2.1 time: 0.602966 Oct 18 15:36:31.549149 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1297/2707] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:30 2022] GET /compute/v2.1/servers/82aba568-875e-459c-8bc9-248b4851fc94 => generated 1505 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:36:31.567775 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c58e96a5-89e8-428c-9268-f49cbe26649a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:31.568502 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c58e96a5-89e8-428c-9268-f49cbe26649a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: bbd6e88c-1947-4518-9fd4-c17233679336] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:31.579040 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c58e96a5-89e8-428c-9268-f49cbe26649a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:31.580219 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c58e96a5-89e8-428c-9268-f49cbe26649a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:31.580998 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c58e96a5-89e8-428c-9268-f49cbe26649a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:31.582770 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c58e96a5-89e8-428c-9268-f49cbe26649a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:31.583403 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c58e96a5-89e8-428c-9268-f49cbe26649a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:31.584134 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c58e96a5-89e8-428c-9268-f49cbe26649a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:31.626975 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=8 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:36:31.650182 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3494f6ec-2eef-450e-a830-75b9e814a57d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:31.661660 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3494f6ec-2eef-450e-a830-75b9e814a57d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe" status: 200 len: 1475 microversion: 2.1 time: 0.306051 Oct 18 15:36:31.662674 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1411/2708] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:31 2022] GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe => generated 1475 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:31.670912 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-720b5503-f3d9-4a25-b66c-3eb140f3fbf1 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1081977098"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:36:31.672127 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-720b5503-f3d9-4a25-b66c-3eb140f3fbf1 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] [instance: 82aba568-875e-459c-8bc9-248b4851fc94] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:31.681223 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-720b5503-f3d9-4a25-b66c-3eb140f3fbf1 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:31.681915 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-720b5503-f3d9-4a25-b66c-3eb140f3fbf1 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:31.682513 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-720b5503-f3d9-4a25-b66c-3eb140f3fbf1 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:31.683447 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-720b5503-f3d9-4a25-b66c-3eb140f3fbf1 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:31.684059 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-720b5503-f3d9-4a25-b66c-3eb140f3fbf1 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:31.684638 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-720b5503-f3d9-4a25-b66c-3eb140f3fbf1 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:31.829257 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c58e96a5-89e8-428c-9268-f49cbe26649a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:31.838070 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c58e96a5-89e8-428c-9268-f49cbe26649a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/bbd6e88c-1947-4518-9fd4-c17233679336" status: 200 len: 1315 microversion: 2.1 time: 0.275712 Oct 18 15:36:31.854350 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1298/2709] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:31 2022] GET /compute/v2.1/servers/bbd6e88c-1947-4518-9fd4-c17233679336 => generated 1315 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:36:31.860790 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-37f5e7f4-7113-4fce-ab48-880ea753f5b4 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:31.861711 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-37f5e7f4-7113-4fce-ab48-880ea753f5b4 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:31.869408 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-37f5e7f4-7113-4fce-ab48-880ea753f5b4 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:31.870133 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-37f5e7f4-7113-4fce-ab48-880ea753f5b4 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:31.870714 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-37f5e7f4-7113-4fce-ab48-880ea753f5b4 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:31.871566 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-37f5e7f4-7113-4fce-ab48-880ea753f5b4 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:31.872174 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-37f5e7f4-7113-4fce-ab48-880ea753f5b4 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:31.872773 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-37f5e7f4-7113-4fce-ab48-880ea753f5b4 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:31.898062 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.network.security_group_api [None req-720b5503-f3d9-4a25-b66c-3eb140f3fbf1 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Adding security group 0de7ce2b-ca31-4eec-a602-4fa13c85be0b to port ec50c426-5283-46d3-a30f-d9ba968c4452 Oct 18 15:36:32.133743 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-37f5e7f4-7113-4fce-ab48-880ea753f5b4 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:32.144981 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-37f5e7f4-7113-4fce-ab48-880ea753f5b4 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c" status: 200 len: 1477 microversion: 2.1 time: 0.289230 Oct 18 15:36:32.146052 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1299/2710] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:31 2022] GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c => generated 1477 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:32.339063 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-720b5503-f3d9-4a25-b66c-3eb140f3fbf1 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "POST /compute/v2.1/servers/82aba568-875e-459c-8bc9-248b4851fc94/action" status: 202 len: 0 microversion: 2.1 time: 0.675101 Oct 18 15:36:32.339717 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1412/2711] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:36:31 2022] POST /compute/v2.1/servers/82aba568-875e-459c-8bc9-248b4851fc94/action => generated 0 bytes in 676 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:36:32.355872 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-ecae23e8-dbaa-43b2-a9a0-93362f0ad06d req-836f52ee-d001-48bd-9463-b6b9bac5617d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82aba568-875e-459c-8bc9-248b4851fc94", "tag": "ec50c426-5283-46d3-a30f-d9ba968c4452"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:36:32.356911 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8b111414-eb36-47a8-8074-083b78e8975b tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '.version_select at 0x7f7c414d0670>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:32.367847 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-ecae23e8-dbaa-43b2-a9a0-93362f0ad06d req-836f52ee-d001-48bd-9463-b6b9bac5617d service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:32.368620 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-ecae23e8-dbaa-43b2-a9a0-93362f0ad06d req-836f52ee-d001-48bd-9463-b6b9bac5617d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:32.369549 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-ecae23e8-dbaa-43b2-a9a0-93362f0ad06d req-836f52ee-d001-48bd-9463-b6b9bac5617d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:32.386279 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-ecae23e8-dbaa-43b2-a9a0-93362f0ad06d req-836f52ee-d001-48bd-9463-b6b9bac5617d service nova] Creating event network-changed:ec50c426-5283-46d3-a30f-d9ba968c4452 for instance 82aba568-875e-459c-8bc9-248b4851fc94 on n-h2-853682-5 Oct 18 15:36:32.401963 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-ecae23e8-dbaa-43b2-a9a0-93362f0ad06d req-836f52ee-d001-48bd-9463-b6b9bac5617d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049942 Oct 18 15:36:32.403165 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1413/2712] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:36:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:36:32.408710 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1a9cdf39-359a-45aa-92f5-9a1ba2478719 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:32.409664 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1a9cdf39-359a-45aa-92f5-9a1ba2478719 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 52d725f3-b4da-4831-9abf-bf7aba8aee0a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:32.430935 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1a9cdf39-359a-45aa-92f5-9a1ba2478719 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:32.435624 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1a9cdf39-359a-45aa-92f5-9a1ba2478719 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:32.436272 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1a9cdf39-359a-45aa-92f5-9a1ba2478719 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:32.437397 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1a9cdf39-359a-45aa-92f5-9a1ba2478719 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:32.438019 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1a9cdf39-359a-45aa-92f5-9a1ba2478719 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:32.438632 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1a9cdf39-359a-45aa-92f5-9a1ba2478719 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:32.651861 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1a9cdf39-359a-45aa-92f5-9a1ba2478719 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304b3248f9db4629943a8b8080a6d22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdc7504a1d1424ea34f83f1a6d4bf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:32.652734 n-d-853682-5 devstack@n-api.service[120406]: DEBUG neutronclient.v2_0.client [None req-8b111414-eb36-47a8-8074-083b78e8975b tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 0de7ce2b-ca31-4eec-a602-4fa13c85be0b in use.", "detail": ""}} {{(pid=120406) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 15:36:32.654153 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-8b111414-eb36-47a8-8074-083b78e8975b tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] HTTP exception thrown: Security Group 0de7ce2b-ca31-4eec-a602-4fa13c85be0b in use. Oct 18 15:36:32.654153 n-d-853682-5 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-f3f166c6-306d-48f4-a373-fd0ff1082227'] Oct 18 15:36:32.658474 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8b111414-eb36-47a8-8074-083b78e8975b tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Request method failure captured: Oct 18 15:36:32.658474 n-d-853682-5 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/os-security-groups/0de7ce2b-ca31-4eec-a602-4fa13c85be0b HTTP/1.1 Oct 18 15:36:32.658474 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:36:32.658474 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:36:32.658474 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:36:32.658474 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:36:32.658474 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:36:32.658474 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:36:32.658474 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:36:32.658474 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:36:32.658474 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTse7fx2cnRaPoLjX5bcuOlHRsv5T7hjqupUR5Anksomh4sN2LXU4nAUs-nTlixOWx8rLooo7F4iO4MJJqXUn20Cug_7k-y3pRg9Zq_jy4SxiI9MxMze0dh6g1ffY8M4Eh1QOt6Xa2yz2Z8B-7cmZxI0dcYo33xex1kmG4oUGiUJl_0M Oct 18 15:36:32.658474 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:36:32.658474 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:36:32.658474 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:36:32.658474 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:36:32.658474 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:36:32.658474 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:36:32.658474 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 6a52e3135e52493b8ccb2d7342418591 Oct 18 15:36:32.658474 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-SecurityGroupsTestJSON-974652461 Oct 18 15:36:32.658474 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:36:32.658474 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:36:32.660001 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:36:32.660001 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-SecurityGroupsTestJSON-974652461 Oct 18 15:36:32.660001 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 6a52e3135e52493b8ccb2d7342418591 Oct 18 15:36:32.660001 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-974652461 Oct 18 15:36:32.660001 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-SecurityGroupsTestJSON-974652461-project Oct 18 15:36:32.660001 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:36:32.660001 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:36:32.660001 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: ee9a7ce3bb784a79b3ac336743b9ae84 Oct 18 15:36:32.660001 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-SecurityGroupsTestJSON-974652461-project Oct 18 15:36:32.660001 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:36:32.660001 n-d-853682-5 devstack@n-api.service[120406]: exception: Security Group 0de7ce2b-ca31-4eec-a602-4fa13c85be0b in use. Oct 18 15:36:32.660001 n-d-853682-5 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-f3f166c6-306d-48f4-a373-fd0ff1082227'] Oct 18 15:36:32.660001 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '0de7ce2b-ca31-4eec-a602-4fa13c85be0b'} Oct 18 15:36:32.660836 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:36:32.660836 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:32.660836 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 18 15:36:32.660836 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 18 15:36:32.660836 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:32.660836 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:32.660836 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 18 15:36:32.660836 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 18 15:36:32.660836 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:32.660836 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:32.660836 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 18 15:36:32.660836 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 18 15:36:32.660836 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:32.660836 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:32.660836 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 15:36:32.660836 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 15:36:32.660836 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:32.660836 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:32.660836 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 15:36:32.665086 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 15:36:32.665086 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:32.665086 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:32.665086 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 15:36:32.665086 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 15:36:32.665086 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 15:36:32.665086 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 15:36:32.665086 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 0de7ce2b-ca31-4eec-a602-4fa13c85be0b in use. Oct 18 15:36:32.665086 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f3f166c6-306d-48f4-a373-fd0ff1082227'] Oct 18 15:36:32.665086 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:32.665086 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:32.665086 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:32.665086 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:32.665086 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 18 15:36:32.665086 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 18 15:36:32.665086 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 18 15:36:32.665086 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 18 15:36:32.665086 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 0de7ce2b-ca31-4eec-a602-4fa13c85be0b in use. Oct 18 15:36:32.665086 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f3f166c6-306d-48f4-a373-fd0ff1082227'] Oct 18 15:36:32.666266 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:32.666266 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:32.666266 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:32.666266 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:32.666266 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:36:32.666266 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:36:32.666266 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:36:32.666266 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:36:32.666266 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:36:32.666266 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:36:32.666266 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:36:32.666266 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:36:32.666266 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 18 15:36:32.666266 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 18 15:36:32.666266 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 0de7ce2b-ca31-4eec-a602-4fa13c85be0b in use. Oct 18 15:36:32.666266 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f3f166c6-306d-48f4-a373-fd0ff1082227'] Oct 18 15:36:32.666266 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:32.666266 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:32.666266 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:32.666266 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:32.666266 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:36:32.667594 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:36:32.667594 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:36:32.667594 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:36:32.667594 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 0de7ce2b-ca31-4eec-a602-4fa13c85be0b in use. Oct 18 15:36:32.667594 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f3f166c6-306d-48f4-a373-fd0ff1082227'] Oct 18 15:36:32.667594 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:32.667594 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8b111414-eb36-47a8-8074-083b78e8975b tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Returning 400 to user: Security Group 0de7ce2b-ca31-4eec-a602-4fa13c85be0b in use. Oct 18 15:36:32.667594 n-d-853682-5 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-f3f166c6-306d-48f4-a373-fd0ff1082227'] {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:36:32.668094 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1a9cdf39-359a-45aa-92f5-9a1ba2478719 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a" status: 200 len: 1362 microversion: 2.1 time: 0.256175 Oct 18 15:36:32.668182 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8b111414-eb36-47a8-8074-083b78e8975b tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/0de7ce2b-ca31-4eec-a602-4fa13c85be0b" status: 400 len: 185 microversion: 2.1 time: 0.315333 Oct 18 15:36:32.668182 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1300/2713] 10.222.0.60 () {58 vars in 1272 bytes} [Tue Oct 18 15:36:32 2022] DELETE /compute/v2.1/os-security-groups/0de7ce2b-ca31-4eec-a602-4fa13c85be0b => generated 185 bytes in 317 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:36:32.677365 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1414/2714] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:32 2022] GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a => generated 1362 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:32.686118 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a2290018-fa2d-4f59-895c-f473c60660ea tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:36:32.689990 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a2290018-fa2d-4f59-895c-f473c60660ea tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] [instance: 82aba568-875e-459c-8bc9-248b4851fc94] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:32.696384 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-73365493-cc93-4c95-928e-f98abc2b68f1 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:32.697957 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-73365493-cc93-4c95-928e-f98abc2b68f1 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 1c84f8ca-befc-489e-8068-135af3b766fe] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:32.708367 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2290018-fa2d-4f59-895c-f473c60660ea tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:32.708959 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2290018-fa2d-4f59-895c-f473c60660ea tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:32.709398 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2290018-fa2d-4f59-895c-f473c60660ea tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:32.710115 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2290018-fa2d-4f59-895c-f473c60660ea tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:32.710570 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2290018-fa2d-4f59-895c-f473c60660ea tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:32.711399 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-73365493-cc93-4c95-928e-f98abc2b68f1 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:32.711690 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2290018-fa2d-4f59-895c-f473c60660ea tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:32.712157 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-73365493-cc93-4c95-928e-f98abc2b68f1 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:32.712661 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-73365493-cc93-4c95-928e-f98abc2b68f1 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:32.713503 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-73365493-cc93-4c95-928e-f98abc2b68f1 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:32.714179 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-73365493-cc93-4c95-928e-f98abc2b68f1 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:32.714699 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-73365493-cc93-4c95-928e-f98abc2b68f1 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:32.800075 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a2290018-fa2d-4f59-895c-f473c60660ea tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "POST /compute/v2.1/servers/82aba568-875e-459c-8bc9-248b4851fc94/action" status: 202 len: 0 microversion: 2.1 time: 0.126592 Oct 18 15:36:32.808837 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1301/2715] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:36:32 2022] POST /compute/v2.1/servers/82aba568-875e-459c-8bc9-248b4851fc94/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 15:36:32.815273 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2bda0773-3a52-460c-9de1-2afe528359bf tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:32.816227 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2bda0773-3a52-460c-9de1-2afe528359bf tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] [instance: 82aba568-875e-459c-8bc9-248b4851fc94] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:32.822605 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2bda0773-3a52-460c-9de1-2afe528359bf tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:32.823025 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2bda0773-3a52-460c-9de1-2afe528359bf tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:32.823457 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2bda0773-3a52-460c-9de1-2afe528359bf tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:32.824146 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2bda0773-3a52-460c-9de1-2afe528359bf tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:32.824599 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2bda0773-3a52-460c-9de1-2afe528359bf tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:32.825057 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2bda0773-3a52-460c-9de1-2afe528359bf tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:33.170928 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-73365493-cc93-4c95-928e-f98abc2b68f1 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:33.181914 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-73365493-cc93-4c95-928e-f98abc2b68f1 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe" status: 200 len: 1475 microversion: 2.1 time: 0.490533 Oct 18 15:36:33.183166 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1415/2716] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:32 2022] GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe => generated 1475 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:33.190493 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1576b577-c01b-4afb-8f90-aede66a71481 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:33.192700 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1576b577-c01b-4afb-8f90-aede66a71481 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: bbd6e88c-1947-4518-9fd4-c17233679336] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:33.200660 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1576b577-c01b-4afb-8f90-aede66a71481 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:33.201363 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1576b577-c01b-4afb-8f90-aede66a71481 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:33.201911 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1576b577-c01b-4afb-8f90-aede66a71481 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:33.202745 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1576b577-c01b-4afb-8f90-aede66a71481 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:33.203310 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1576b577-c01b-4afb-8f90-aede66a71481 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:33.203898 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1576b577-c01b-4afb-8f90-aede66a71481 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:33.305392 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2bda0773-3a52-460c-9de1-2afe528359bf tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a7ce3bb784a79b3ac336743b9ae84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a52e3135e52493b8ccb2d7342418591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:33.313402 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2bda0773-3a52-460c-9de1-2afe528359bf tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "GET /compute/v2.1/servers/82aba568-875e-459c-8bc9-248b4851fc94" status: 200 len: 1576 microversion: 2.1 time: 0.503004 Oct 18 15:36:33.328674 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1302/2717] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:32 2022] GET /compute/v2.1/servers/82aba568-875e-459c-8bc9-248b4851fc94 => generated 1576 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:33.340049 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-949e58d9-1e87-4881-9e3e-b168370b8222 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:33.340766 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-949e58d9-1e87-4881-9e3e-b168370b8222 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:33.347989 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-949e58d9-1e87-4881-9e3e-b168370b8222 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:33.348744 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-949e58d9-1e87-4881-9e3e-b168370b8222 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:33.349260 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-949e58d9-1e87-4881-9e3e-b168370b8222 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:33.349965 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-949e58d9-1e87-4881-9e3e-b168370b8222 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:33.350407 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-949e58d9-1e87-4881-9e3e-b168370b8222 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:33.351037 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-949e58d9-1e87-4881-9e3e-b168370b8222 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:33.597029 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1576b577-c01b-4afb-8f90-aede66a71481 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:33.604595 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1576b577-c01b-4afb-8f90-aede66a71481 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/bbd6e88c-1947-4518-9fd4-c17233679336" status: 200 len: 1315 microversion: 2.1 time: 0.420008 Oct 18 15:36:33.605200 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1416/2718] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:33 2022] GET /compute/v2.1/servers/bbd6e88c-1947-4518-9fd4-c17233679336 => generated 1315 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:33.688342 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-648adda8-d3de-43ae-aa55-8deaf367624b tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:33.689328 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-648adda8-d3de-43ae-aa55-8deaf367624b tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 52d725f3-b4da-4831-9abf-bf7aba8aee0a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:33.697626 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-648adda8-d3de-43ae-aa55-8deaf367624b tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:33.698145 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-648adda8-d3de-43ae-aa55-8deaf367624b tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:33.698565 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-648adda8-d3de-43ae-aa55-8deaf367624b tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:33.699310 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-648adda8-d3de-43ae-aa55-8deaf367624b tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:33.699799 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-648adda8-d3de-43ae-aa55-8deaf367624b tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:33.700230 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-648adda8-d3de-43ae-aa55-8deaf367624b tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:33.716360 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-949e58d9-1e87-4881-9e3e-b168370b8222 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:33.725799 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-949e58d9-1e87-4881-9e3e-b168370b8222 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c" status: 200 len: 1477 microversion: 2.1 time: 0.390248 Oct 18 15:36:33.727554 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1303/2719] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:33 2022] GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c => generated 1477 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:34.062949 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-648adda8-d3de-43ae-aa55-8deaf367624b tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304b3248f9db4629943a8b8080a6d22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdc7504a1d1424ea34f83f1a6d4bf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:34.070642 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-648adda8-d3de-43ae-aa55-8deaf367624b tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a" status: 200 len: 1362 microversion: 2.1 time: 0.386490 Oct 18 15:36:34.071226 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1417/2720] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:33 2022] GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a => generated 1362 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:34.207951 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-037671f4-38b9-4a99-8e98-90ab5740d12e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:34.208886 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-037671f4-38b9-4a99-8e98-90ab5740d12e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 1c84f8ca-befc-489e-8068-135af3b766fe] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:34.219650 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-037671f4-38b9-4a99-8e98-90ab5740d12e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:34.222936 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-037671f4-38b9-4a99-8e98-90ab5740d12e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:34.223802 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-037671f4-38b9-4a99-8e98-90ab5740d12e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:34.228065 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-037671f4-38b9-4a99-8e98-90ab5740d12e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:34.231341 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-037671f4-38b9-4a99-8e98-90ab5740d12e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:34.232317 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-037671f4-38b9-4a99-8e98-90ab5740d12e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:34.337044 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fabd91d4-b0e2-47d7-9580-604ecb84ccfd tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:34.338552 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-fabd91d4-b0e2-47d7-9580-604ecb84ccfd tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] [instance: 82aba568-875e-459c-8bc9-248b4851fc94] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:34.346312 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fabd91d4-b0e2-47d7-9580-604ecb84ccfd tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:34.347028 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fabd91d4-b0e2-47d7-9580-604ecb84ccfd tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:34.347626 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fabd91d4-b0e2-47d7-9580-604ecb84ccfd tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:34.348523 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fabd91d4-b0e2-47d7-9580-604ecb84ccfd tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:34.349185 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fabd91d4-b0e2-47d7-9580-604ecb84ccfd tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:34.349609 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fabd91d4-b0e2-47d7-9580-604ecb84ccfd tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:34.645061 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-037671f4-38b9-4a99-8e98-90ab5740d12e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:34.655013 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-037671f4-38b9-4a99-8e98-90ab5740d12e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe" status: 200 len: 1475 microversion: 2.1 time: 0.451677 Oct 18 15:36:34.668844 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1304/2721] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:34 2022] GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe => generated 1475 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:34.669094 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-fabd91d4-b0e2-47d7-9580-604ecb84ccfd tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a7ce3bb784a79b3ac336743b9ae84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a52e3135e52493b8ccb2d7342418591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:34.669199 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-42ba9e55-0266-4a60-af6b-3cfc5db8183b tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:34.669199 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-42ba9e55-0266-4a60-af6b-3cfc5db8183b tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 511cbc18-aef9-4202-9616-decd6651e931] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:34.669825 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fabd91d4-b0e2-47d7-9580-604ecb84ccfd tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "GET /compute/v2.1/servers/82aba568-875e-459c-8bc9-248b4851fc94" status: 200 len: 1576 microversion: 2.1 time: 0.334722 Oct 18 15:36:34.674226 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1418/2722] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:34 2022] GET /compute/v2.1/servers/82aba568-875e-459c-8bc9-248b4851fc94 => generated 1576 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:36:34.684344 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-00996b3f-ef5f-40a5-80d1-bef60994b0ab tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:34.686143 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-00996b3f-ef5f-40a5-80d1-bef60994b0ab tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: bbd6e88c-1947-4518-9fd4-c17233679336] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:34.688924 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42ba9e55-0266-4a60-af6b-3cfc5db8183b tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:34.689924 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42ba9e55-0266-4a60-af6b-3cfc5db8183b tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:34.690378 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42ba9e55-0266-4a60-af6b-3cfc5db8183b tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:34.691307 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42ba9e55-0266-4a60-af6b-3cfc5db8183b tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:34.692655 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42ba9e55-0266-4a60-af6b-3cfc5db8183b tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:34.693305 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42ba9e55-0266-4a60-af6b-3cfc5db8183b tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:34.701662 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-00996b3f-ef5f-40a5-80d1-bef60994b0ab tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:34.702159 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-00996b3f-ef5f-40a5-80d1-bef60994b0ab tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:34.702951 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-00996b3f-ef5f-40a5-80d1-bef60994b0ab tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:34.705291 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-00996b3f-ef5f-40a5-80d1-bef60994b0ab tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:34.706657 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-00996b3f-ef5f-40a5-80d1-bef60994b0ab tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:34.707089 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-00996b3f-ef5f-40a5-80d1-bef60994b0ab tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:34.742137 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-42ba9e55-0266-4a60-af6b-3cfc5db8183b tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/511cbc18-aef9-4202-9616-decd6651e931/ips" status: 200 len: 151 microversion: 2.1 time: 0.084225 Oct 18 15:36:34.743436 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1305/2723] 10.222.0.60 () {58 vars in 1248 bytes} [Tue Oct 18 15:36:34 2022] GET /compute/v2.1/servers/511cbc18-aef9-4202-9616-decd6651e931/ips => generated 151 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:36:34.770919 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3ed2ba46-5297-43ef-b022-48e70b708cdd tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:34.771729 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3ed2ba46-5297-43ef-b022-48e70b708cdd tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:34.780057 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ed2ba46-5297-43ef-b022-48e70b708cdd tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:34.781977 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ed2ba46-5297-43ef-b022-48e70b708cdd tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:34.784383 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ed2ba46-5297-43ef-b022-48e70b708cdd tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:34.785506 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ed2ba46-5297-43ef-b022-48e70b708cdd tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:34.797510 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ed2ba46-5297-43ef-b022-48e70b708cdd tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:34.798192 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ed2ba46-5297-43ef-b022-48e70b708cdd tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:35.476563 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-00996b3f-ef5f-40a5-80d1-bef60994b0ab tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:35.485386 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-00996b3f-ef5f-40a5-80d1-bef60994b0ab tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/bbd6e88c-1947-4518-9fd4-c17233679336" status: 200 len: 1315 microversion: 2.1 time: 0.809857 Oct 18 15:36:35.486499 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1419/2724] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:34 2022] GET /compute/v2.1/servers/bbd6e88c-1947-4518-9fd4-c17233679336 => generated 1315 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:35.491144 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0a1b9af2-4192-474b-a476-410fc1045cd1 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:35.492012 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0a1b9af2-4192-474b-a476-410fc1045cd1 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 52d725f3-b4da-4831-9abf-bf7aba8aee0a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:35.512314 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0a1b9af2-4192-474b-a476-410fc1045cd1 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:35.512858 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0a1b9af2-4192-474b-a476-410fc1045cd1 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:35.513291 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0a1b9af2-4192-474b-a476-410fc1045cd1 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:35.514041 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0a1b9af2-4192-474b-a476-410fc1045cd1 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:35.514502 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0a1b9af2-4192-474b-a476-410fc1045cd1 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:35.514927 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0a1b9af2-4192-474b-a476-410fc1045cd1 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:35.537862 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3ed2ba46-5297-43ef-b022-48e70b708cdd tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:35.546596 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3ed2ba46-5297-43ef-b022-48e70b708cdd tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c" status: 200 len: 1477 microversion: 2.1 time: 0.799894 Oct 18 15:36:35.550038 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1306/2725] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:34 2022] GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c => generated 1477 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:35.698968 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b252f500-cb09-48ae-a525-304aa01d4404 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:35.699804 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b252f500-cb09-48ae-a525-304aa01d4404 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 1c84f8ca-befc-489e-8068-135af3b766fe] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:35.706035 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0a1b9af2-4192-474b-a476-410fc1045cd1 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304b3248f9db4629943a8b8080a6d22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdc7504a1d1424ea34f83f1a6d4bf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:35.707886 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b252f500-cb09-48ae-a525-304aa01d4404 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:35.708856 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b252f500-cb09-48ae-a525-304aa01d4404 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:35.709451 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b252f500-cb09-48ae-a525-304aa01d4404 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:35.710331 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b252f500-cb09-48ae-a525-304aa01d4404 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:35.711661 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b252f500-cb09-48ae-a525-304aa01d4404 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:35.712249 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b252f500-cb09-48ae-a525-304aa01d4404 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:35.718869 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0a1b9af2-4192-474b-a476-410fc1045cd1 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a" status: 200 len: 1362 microversion: 2.1 time: 0.230682 Oct 18 15:36:35.721040 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1420/2726] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:35 2022] GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a => generated 1362 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:35.733399 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b856898d-ffdb-445a-8f0e-2c5aae21301f tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:35.735820 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b856898d-ffdb-445a-8f0e-2c5aae21301f tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] [instance: 82aba568-875e-459c-8bc9-248b4851fc94] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:35.749449 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b856898d-ffdb-445a-8f0e-2c5aae21301f tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:35.751254 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b856898d-ffdb-445a-8f0e-2c5aae21301f tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:35.751974 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b856898d-ffdb-445a-8f0e-2c5aae21301f tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:35.752933 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b856898d-ffdb-445a-8f0e-2c5aae21301f tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:35.753587 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b856898d-ffdb-445a-8f0e-2c5aae21301f tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:35.754225 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b856898d-ffdb-445a-8f0e-2c5aae21301f tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:36.015194 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b252f500-cb09-48ae-a525-304aa01d4404 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:36.023390 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b252f500-cb09-48ae-a525-304aa01d4404 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe" status: 200 len: 1475 microversion: 2.1 time: 0.347135 Oct 18 15:36:36.036835 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1307/2727] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:35 2022] GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe => generated 1475 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:36.037240 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b856898d-ffdb-445a-8f0e-2c5aae21301f tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a7ce3bb784a79b3ac336743b9ae84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a52e3135e52493b8ccb2d7342418591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:36.038430 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b856898d-ffdb-445a-8f0e-2c5aae21301f tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "GET /compute/v2.1/servers/82aba568-875e-459c-8bc9-248b4851fc94" status: 200 len: 1576 microversion: 2.1 time: 0.314952 Oct 18 15:36:36.039174 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1421/2728] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:35 2022] GET /compute/v2.1/servers/82aba568-875e-459c-8bc9-248b4851fc94 => generated 1576 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:36.374664 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-e0c21858-67f3-4e87-84c7-1bf28960b43e req-03b8c832-4a15-467e-b6ba-3da7383f1770 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbd6e88c-1947-4518-9fd4-c17233679336", "name": "network-vif-plugged", "status": "completed", "tag": "a4c92f1c-481f-4b18-af7a-d3f75d772a28"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:36:36.388880 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e0c21858-67f3-4e87-84c7-1bf28960b43e req-03b8c832-4a15-467e-b6ba-3da7383f1770 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:36.389572 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e0c21858-67f3-4e87-84c7-1bf28960b43e req-03b8c832-4a15-467e-b6ba-3da7383f1770 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:36.390517 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e0c21858-67f3-4e87-84c7-1bf28960b43e req-03b8c832-4a15-467e-b6ba-3da7383f1770 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:36.405301 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-e0c21858-67f3-4e87-84c7-1bf28960b43e req-03b8c832-4a15-467e-b6ba-3da7383f1770 service nova] Creating event network-vif-plugged:a4c92f1c-481f-4b18-af7a-d3f75d772a28 for instance bbd6e88c-1947-4518-9fd4-c17233679336 on n-h2-853682-5 Oct 18 15:36:36.410543 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-e0c21858-67f3-4e87-84c7-1bf28960b43e req-03b8c832-4a15-467e-b6ba-3da7383f1770 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039572 Oct 18 15:36:36.411621 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1308/2729] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:36:36.511372 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-aa7bb429-6b49-426a-b19b-4056948158e5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:36.512323 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-aa7bb429-6b49-426a-b19b-4056948158e5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: bbd6e88c-1947-4518-9fd4-c17233679336] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:36.520934 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aa7bb429-6b49-426a-b19b-4056948158e5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:36.521624 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aa7bb429-6b49-426a-b19b-4056948158e5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:36.522176 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aa7bb429-6b49-426a-b19b-4056948158e5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:36.523055 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aa7bb429-6b49-426a-b19b-4056948158e5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:36.524774 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aa7bb429-6b49-426a-b19b-4056948158e5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:36.525301 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aa7bb429-6b49-426a-b19b-4056948158e5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:36.571297 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-da0dad8e-baa2-45c6-9524-9101929fb605 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:36.572348 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-da0dad8e-baa2-45c6-9524-9101929fb605 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:36.580570 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da0dad8e-baa2-45c6-9524-9101929fb605 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:36.581366 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da0dad8e-baa2-45c6-9524-9101929fb605 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:36.581901 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da0dad8e-baa2-45c6-9524-9101929fb605 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:36.582850 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da0dad8e-baa2-45c6-9524-9101929fb605 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:36.583936 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da0dad8e-baa2-45c6-9524-9101929fb605 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:36.584603 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da0dad8e-baa2-45c6-9524-9101929fb605 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:36.600957 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:36:36.728868 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-aa7bb429-6b49-426a-b19b-4056948158e5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:36.738178 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-aa7bb429-6b49-426a-b19b-4056948158e5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/bbd6e88c-1947-4518-9fd4-c17233679336" status: 200 len: 1315 microversion: 2.1 time: 0.232707 Oct 18 15:36:36.739038 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1422/2730] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:36 2022] GET /compute/v2.1/servers/bbd6e88c-1947-4518-9fd4-c17233679336 => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:36.752287 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-89783c2e-5a0c-4be0-8cba-1cfe1085dab9 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:36.753934 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-89783c2e-5a0c-4be0-8cba-1cfe1085dab9 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 52d725f3-b4da-4831-9abf-bf7aba8aee0a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:36.761876 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-89783c2e-5a0c-4be0-8cba-1cfe1085dab9 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:36.762798 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-89783c2e-5a0c-4be0-8cba-1cfe1085dab9 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:36.762935 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-da0dad8e-baa2-45c6-9524-9101929fb605 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:36.763932 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-89783c2e-5a0c-4be0-8cba-1cfe1085dab9 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:36.764746 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-89783c2e-5a0c-4be0-8cba-1cfe1085dab9 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:36.765572 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-89783c2e-5a0c-4be0-8cba-1cfe1085dab9 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:36.766190 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-89783c2e-5a0c-4be0-8cba-1cfe1085dab9 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:36.772467 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-da0dad8e-baa2-45c6-9524-9101929fb605 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c" status: 200 len: 1463 microversion: 2.1 time: 0.205917 Oct 18 15:36:36.773674 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1309/2731] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:36 2022] GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c => generated 1463 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:36:36.797030 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7b425eda-88e2-4f62-9737-1962c5b43c90 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:36.797689 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7b425eda-88e2-4f62-9737-1962c5b43c90 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:36.804442 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b425eda-88e2-4f62-9737-1962c5b43c90 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:36.805685 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b425eda-88e2-4f62-9737-1962c5b43c90 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:36.806106 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b425eda-88e2-4f62-9737-1962c5b43c90 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:36.806799 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b425eda-88e2-4f62-9737-1962c5b43c90 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:36.807258 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b425eda-88e2-4f62-9737-1962c5b43c90 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:36.807688 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b425eda-88e2-4f62-9737-1962c5b43c90 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:36.819943 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=18 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:36:36.969243 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-89783c2e-5a0c-4be0-8cba-1cfe1085dab9 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304b3248f9db4629943a8b8080a6d22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdc7504a1d1424ea34f83f1a6d4bf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:36.978420 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-89783c2e-5a0c-4be0-8cba-1cfe1085dab9 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a" status: 200 len: 1362 microversion: 2.1 time: 0.237675 Oct 18 15:36:36.979448 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1423/2732] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:36 2022] GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a => generated 1362 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:36.998573 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7b425eda-88e2-4f62-9737-1962c5b43c90 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:37.007024 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7b425eda-88e2-4f62-9737-1962c5b43c90 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c" status: 200 len: 1463 microversion: 2.1 time: 0.214298 Oct 18 15:36:37.007710 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1310/2733] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:36 2022] GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c => generated 1463 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:36:37.031295 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c140f82e-b110-4662-9173-51c6d5edcb14 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:36:37.034186 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c140f82e-b110-4662-9173-51c6d5edcb14 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:37.040517 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c140f82e-b110-4662-9173-51c6d5edcb14 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:37.041058 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c140f82e-b110-4662-9173-51c6d5edcb14 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:37.041501 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c140f82e-b110-4662-9173-51c6d5edcb14 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:37.042217 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c140f82e-b110-4662-9173-51c6d5edcb14 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:37.042676 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c140f82e-b110-4662-9173-51c6d5edcb14 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:37.043104 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c140f82e-b110-4662-9173-51c6d5edcb14 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:37.051693 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0d669c08-46cb-4cb8-8142-230e00413cbd tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:37.052304 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0d669c08-46cb-4cb8-8142-230e00413cbd tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 1c84f8ca-befc-489e-8068-135af3b766fe] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:37.059311 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0d669c08-46cb-4cb8-8142-230e00413cbd tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:37.059807 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0d669c08-46cb-4cb8-8142-230e00413cbd tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:37.060241 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0d669c08-46cb-4cb8-8142-230e00413cbd tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:37.060990 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0d669c08-46cb-4cb8-8142-230e00413cbd tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:37.061618 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0d669c08-46cb-4cb8-8142-230e00413cbd tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:37.062044 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0d669c08-46cb-4cb8-8142-230e00413cbd tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:37.129178 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-c140f82e-b110-4662-9173-51c6d5edcb14 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:36:37.129608 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-c140f82e-b110-4662-9173-51c6d5edcb14 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:36:37.130087 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-c140f82e-b110-4662-9173-51c6d5edcb14 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:36:37.130501 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-c140f82e-b110-4662-9173-51c6d5edcb14 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:36:37.130918 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-c140f82e-b110-4662-9173-51c6d5edcb14 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:36:37.215972 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c140f82e-b110-4662-9173-51c6d5edcb14 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:37.230193 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c140f82e-b110-4662-9173-51c6d5edcb14 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:37.230937 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c140f82e-b110-4662-9173-51c6d5edcb14 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:37.231702 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c140f82e-b110-4662-9173-51c6d5edcb14 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:37.232637 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c140f82e-b110-4662-9173-51c6d5edcb14 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:37.233842 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c140f82e-b110-4662-9173-51c6d5edcb14 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:37.235288 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c140f82e-b110-4662-9173-51c6d5edcb14 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:37.237508 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0d669c08-46cb-4cb8-8142-230e00413cbd tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:37.249989 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0d669c08-46cb-4cb8-8142-230e00413cbd tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe" status: 200 len: 1475 microversion: 2.1 time: 0.202211 Oct 18 15:36:37.254022 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1311/2734] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:37 2022] GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe => generated 1475 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:37.271442 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5dbb0593-3a66-4c13-8722-fbb6a8ee7ab5 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:37.273250 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c140f82e-b110-4662-9173-51c6d5edcb14 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "POST /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c/action" status: 202 len: 1067 microversion: 2.1 time: 0.245991 Oct 18 15:36:37.274732 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5dbb0593-3a66-4c13-8722-fbb6a8ee7ab5 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] [instance: 82aba568-875e-459c-8bc9-248b4851fc94] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:37.276987 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1424/2735] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:36:37 2022] POST /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c/action => generated 1067 bytes in 251 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 18 15:36:37.287321 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5dbb0593-3a66-4c13-8722-fbb6a8ee7ab5 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:37.287831 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5dbb0593-3a66-4c13-8722-fbb6a8ee7ab5 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:37.293171 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5dbb0593-3a66-4c13-8722-fbb6a8ee7ab5 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:37.293982 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5dbb0593-3a66-4c13-8722-fbb6a8ee7ab5 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:37.296312 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-79f29542-6a94-4787-b465-e9b4a0a29e42 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:37.297155 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5dbb0593-3a66-4c13-8722-fbb6a8ee7ab5 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:37.297640 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5dbb0593-3a66-4c13-8722-fbb6a8ee7ab5 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:37.310060 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-79f29542-6a94-4787-b465-e9b4a0a29e42 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:37.322616 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-79f29542-6a94-4787-b465-e9b4a0a29e42 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:37.324426 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-79f29542-6a94-4787-b465-e9b4a0a29e42 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:37.326466 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-79f29542-6a94-4787-b465-e9b4a0a29e42 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:37.327842 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-79f29542-6a94-4787-b465-e9b4a0a29e42 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:37.329687 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-79f29542-6a94-4787-b465-e9b4a0a29e42 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:37.330787 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-79f29542-6a94-4787-b465-e9b4a0a29e42 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:37.439855 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=30 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:36:37.684306 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5dbb0593-3a66-4c13-8722-fbb6a8ee7ab5 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a7ce3bb784a79b3ac336743b9ae84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a52e3135e52493b8ccb2d7342418591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:37.688681 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-79f29542-6a94-4787-b465-e9b4a0a29e42 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:37.702514 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-79f29542-6a94-4787-b465-e9b4a0a29e42 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c" status: 200 len: 1472 microversion: 2.1 time: 0.410432 Oct 18 15:36:37.703119 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1425/2736] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:37 2022] GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c => generated 1472 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:36:37.709327 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9e2875cd-5aca-4a33-880c-67364b1d3c59 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b8fc71c-55b7-4099-a893-e4def512fa29"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:36:37.711804 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9e2875cd-5aca-4a33-880c-67364b1d3c59 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 511cbc18-aef9-4202-9616-decd6651e931] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:37.716235 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5dbb0593-3a66-4c13-8722-fbb6a8ee7ab5 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "GET /compute/v2.1/servers/82aba568-875e-459c-8bc9-248b4851fc94" status: 200 len: 1574 microversion: 2.1 time: 0.461105 Oct 18 15:36:37.717211 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1312/2737] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:37 2022] GET /compute/v2.1/servers/82aba568-875e-459c-8bc9-248b4851fc94 => generated 1574 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:37.718340 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9e2875cd-5aca-4a33-880c-67364b1d3c59 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:37.718899 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9e2875cd-5aca-4a33-880c-67364b1d3c59 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:37.719422 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9e2875cd-5aca-4a33-880c-67364b1d3c59 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:37.720189 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9e2875cd-5aca-4a33-880c-67364b1d3c59 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:37.720717 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9e2875cd-5aca-4a33-880c-67364b1d3c59 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:37.721246 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9e2875cd-5aca-4a33-880c-67364b1d3c59 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:37.741769 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1f593d82-54d0-4115-a5be-2bdc9a4ebb85 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-105308488"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:36:37.742871 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:36:37.743736 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1f593d82-54d0-4115-a5be-2bdc9a4ebb85 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] [instance: 82aba568-875e-459c-8bc9-248b4851fc94] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:37.750298 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f593d82-54d0-4115-a5be-2bdc9a4ebb85 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:37.751105 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f593d82-54d0-4115-a5be-2bdc9a4ebb85 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:37.751765 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f593d82-54d0-4115-a5be-2bdc9a4ebb85 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:37.752737 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f593d82-54d0-4115-a5be-2bdc9a4ebb85 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:37.753524 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f593d82-54d0-4115-a5be-2bdc9a4ebb85 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:37.754176 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f593d82-54d0-4115-a5be-2bdc9a4ebb85 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:37.966569 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.network.security_group_api [None req-1f593d82-54d0-4115-a5be-2bdc9a4ebb85 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Adding security group be0ba8d0-373d-467b-91ba-f0c98e674b71 to port ec50c426-5283-46d3-a30f-d9ba968c4452 Oct 18 15:36:38.386497 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1f593d82-54d0-4115-a5be-2bdc9a4ebb85 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "POST /compute/v2.1/servers/82aba568-875e-459c-8bc9-248b4851fc94/action" status: 202 len: 0 microversion: 2.1 time: 0.648603 Oct 18 15:36:38.388674 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1313/2738] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:36:37 2022] POST /compute/v2.1/servers/82aba568-875e-459c-8bc9-248b4851fc94/action => generated 0 bytes in 652 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 15:36:38.399257 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-298f48b9-364c-43fb-a822-813d16490627 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:38.400371 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-298f48b9-364c-43fb-a822-813d16490627 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: bbd6e88c-1947-4518-9fd4-c17233679336] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:38.413366 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-298f48b9-364c-43fb-a822-813d16490627 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:38.415331 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-298f48b9-364c-43fb-a822-813d16490627 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:38.416010 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-298f48b9-364c-43fb-a822-813d16490627 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:38.418702 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-298f48b9-364c-43fb-a822-813d16490627 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:38.419480 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-298f48b9-364c-43fb-a822-813d16490627 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:38.420317 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-298f48b9-364c-43fb-a822-813d16490627 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:38.590059 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-298f48b9-364c-43fb-a822-813d16490627 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:38.601314 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-298f48b9-364c-43fb-a822-813d16490627 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/bbd6e88c-1947-4518-9fd4-c17233679336" status: 200 len: 1502 microversion: 2.1 time: 0.209954 Oct 18 15:36:38.602896 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1314/2739] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:38 2022] GET /compute/v2.1/servers/bbd6e88c-1947-4518-9fd4-c17233679336 => generated 1502 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:38.607653 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7deca1a1-aa99-4534-bdb7-0090b3902eec tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:38.608260 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7deca1a1-aa99-4534-bdb7-0090b3902eec tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 52d725f3-b4da-4831-9abf-bf7aba8aee0a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:38.616552 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7deca1a1-aa99-4534-bdb7-0090b3902eec tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:38.617258 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7deca1a1-aa99-4534-bdb7-0090b3902eec tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:38.618343 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7deca1a1-aa99-4534-bdb7-0090b3902eec tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:38.618877 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7deca1a1-aa99-4534-bdb7-0090b3902eec tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:38.619209 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7deca1a1-aa99-4534-bdb7-0090b3902eec tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:38.619632 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7deca1a1-aa99-4534-bdb7-0090b3902eec tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:38.774640 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7deca1a1-aa99-4534-bdb7-0090b3902eec tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304b3248f9db4629943a8b8080a6d22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdc7504a1d1424ea34f83f1a6d4bf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:38.784594 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7deca1a1-aa99-4534-bdb7-0090b3902eec tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a" status: 200 len: 1362 microversion: 2.1 time: 0.180648 Oct 18 15:36:38.785785 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1315/2740] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:38 2022] GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:38.796251 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bb08cc26-be0a-41b2-a89b-c9f4fb2ac30a tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:38.797362 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bb08cc26-be0a-41b2-a89b-c9f4fb2ac30a tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 1c84f8ca-befc-489e-8068-135af3b766fe] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:38.806113 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb08cc26-be0a-41b2-a89b-c9f4fb2ac30a tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:38.806784 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb08cc26-be0a-41b2-a89b-c9f4fb2ac30a tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:38.807298 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb08cc26-be0a-41b2-a89b-c9f4fb2ac30a tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:38.808346 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb08cc26-be0a-41b2-a89b-c9f4fb2ac30a tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:38.809419 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb08cc26-be0a-41b2-a89b-c9f4fb2ac30a tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:38.810106 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb08cc26-be0a-41b2-a89b-c9f4fb2ac30a tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:38.967505 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bb08cc26-be0a-41b2-a89b-c9f4fb2ac30a tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:38.978434 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bb08cc26-be0a-41b2-a89b-c9f4fb2ac30a tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe" status: 200 len: 1475 microversion: 2.1 time: 0.191336 Oct 18 15:36:38.979021 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1316/2741] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:38 2022] GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe => generated 1475 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:38.986354 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-01c67e1c-17fd-46d5-9f76-4c76f4142f1e req-75fb7ada-7c8b-4283-8cce-d08b97de4754 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82aba568-875e-459c-8bc9-248b4851fc94", "tag": "ec50c426-5283-46d3-a30f-d9ba968c4452"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:36:38.999173 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-01c67e1c-17fd-46d5-9f76-4c76f4142f1e req-75fb7ada-7c8b-4283-8cce-d08b97de4754 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:38.999656 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-01c67e1c-17fd-46d5-9f76-4c76f4142f1e req-75fb7ada-7c8b-4283-8cce-d08b97de4754 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:39.000083 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-01c67e1c-17fd-46d5-9f76-4c76f4142f1e req-75fb7ada-7c8b-4283-8cce-d08b97de4754 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:39.014181 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-01c67e1c-17fd-46d5-9f76-4c76f4142f1e req-75fb7ada-7c8b-4283-8cce-d08b97de4754 service nova] Creating event network-changed:ec50c426-5283-46d3-a30f-d9ba968c4452 for instance 82aba568-875e-459c-8bc9-248b4851fc94 on n-h2-853682-5 Oct 18 15:36:39.019419 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-01c67e1c-17fd-46d5-9f76-4c76f4142f1e req-75fb7ada-7c8b-4283-8cce-d08b97de4754 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038812 Oct 18 15:36:39.020325 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1317/2742] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:36:39.028890 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0b7ebe56-ea29-4287-b078-564274ee978b tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '.version_select at 0x7f7c3c7514c0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:39.152763 n-d-853682-5 devstack@n-api.service[120406]: DEBUG neutronclient.v2_0.client [None req-0b7ebe56-ea29-4287-b078-564274ee978b tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group be0ba8d0-373d-467b-91ba-f0c98e674b71 in use.", "detail": ""}} {{(pid=120406) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 15:36:39.153509 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-0b7ebe56-ea29-4287-b078-564274ee978b tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] HTTP exception thrown: Security Group be0ba8d0-373d-467b-91ba-f0c98e674b71 in use. Oct 18 15:36:39.153509 n-d-853682-5 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-4ea97158-26f7-402f-bf0d-a3050a8eb7f7'] Oct 18 15:36:39.155650 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0b7ebe56-ea29-4287-b078-564274ee978b tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Request method failure captured: Oct 18 15:36:39.155650 n-d-853682-5 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/os-security-groups/be0ba8d0-373d-467b-91ba-f0c98e674b71 HTTP/1.1 Oct 18 15:36:39.155650 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:36:39.155650 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:36:39.155650 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:36:39.155650 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:36:39.155650 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:36:39.155650 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:36:39.155650 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:36:39.155650 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:36:39.155650 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTse7fx2cnRaPoLjX5bcuOlHRsv5T7hjqupUR5Anksomh4sN2LXU4nAUs-nTlixOWx8rLooo7F4iO4MJJqXUn20Cug_7k-y3pRg9Zq_jy4SxiI9MxMze0dh6g1ffY8M4Eh1QOt6Xa2yz2Z8B-7cmZxI0dcYo33xex1kmG4oUGiUJl_0M Oct 18 15:36:39.155650 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:36:39.155650 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:36:39.155650 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:36:39.155650 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:36:39.155650 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:36:39.155650 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:36:39.155650 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 6a52e3135e52493b8ccb2d7342418591 Oct 18 15:36:39.155650 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-SecurityGroupsTestJSON-974652461 Oct 18 15:36:39.155650 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:36:39.155650 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:36:39.157008 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:36:39.157008 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-SecurityGroupsTestJSON-974652461 Oct 18 15:36:39.157008 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 6a52e3135e52493b8ccb2d7342418591 Oct 18 15:36:39.157008 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-974652461 Oct 18 15:36:39.157008 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-SecurityGroupsTestJSON-974652461-project Oct 18 15:36:39.157008 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:36:39.157008 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:36:39.157008 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: ee9a7ce3bb784a79b3ac336743b9ae84 Oct 18 15:36:39.157008 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-SecurityGroupsTestJSON-974652461-project Oct 18 15:36:39.157008 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:36:39.157008 n-d-853682-5 devstack@n-api.service[120406]: exception: Security Group be0ba8d0-373d-467b-91ba-f0c98e674b71 in use. Oct 18 15:36:39.157008 n-d-853682-5 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-4ea97158-26f7-402f-bf0d-a3050a8eb7f7'] Oct 18 15:36:39.157008 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'be0ba8d0-373d-467b-91ba-f0c98e674b71'} Oct 18 15:36:39.157752 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:36:39.157752 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:39.157752 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 18 15:36:39.157752 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 18 15:36:39.157752 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:39.157752 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:39.157752 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 18 15:36:39.157752 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 18 15:36:39.157752 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:39.157752 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:39.157752 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 18 15:36:39.157752 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 18 15:36:39.157752 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:39.157752 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:39.157752 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 15:36:39.157752 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 15:36:39.157752 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:39.157752 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:39.157752 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 15:36:39.158831 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 15:36:39.158831 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:39.158831 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:39.158831 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 15:36:39.158831 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 15:36:39.158831 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 15:36:39.158831 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 15:36:39.158831 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group be0ba8d0-373d-467b-91ba-f0c98e674b71 in use. Oct 18 15:36:39.158831 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4ea97158-26f7-402f-bf0d-a3050a8eb7f7'] Oct 18 15:36:39.158831 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:39.158831 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:39.158831 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:39.158831 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:39.158831 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 18 15:36:39.158831 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 18 15:36:39.158831 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 18 15:36:39.158831 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 18 15:36:39.158831 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group be0ba8d0-373d-467b-91ba-f0c98e674b71 in use. Oct 18 15:36:39.158831 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4ea97158-26f7-402f-bf0d-a3050a8eb7f7'] Oct 18 15:36:39.162012 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:39.162012 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:39.162012 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:39.162012 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:39.162012 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:36:39.162012 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:36:39.162012 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:36:39.162012 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:36:39.162012 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:36:39.162012 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:36:39.162012 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:36:39.162012 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:36:39.162012 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 18 15:36:39.162012 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 18 15:36:39.162012 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group be0ba8d0-373d-467b-91ba-f0c98e674b71 in use. Oct 18 15:36:39.162012 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4ea97158-26f7-402f-bf0d-a3050a8eb7f7'] Oct 18 15:36:39.162012 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:39.162012 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:39.162012 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:39.162012 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:39.162012 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:36:39.165428 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:36:39.165428 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:36:39.165428 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:36:39.165428 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group be0ba8d0-373d-467b-91ba-f0c98e674b71 in use. Oct 18 15:36:39.165428 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4ea97158-26f7-402f-bf0d-a3050a8eb7f7'] Oct 18 15:36:39.165428 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:39.165428 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0b7ebe56-ea29-4287-b078-564274ee978b tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Returning 400 to user: Security Group be0ba8d0-373d-467b-91ba-f0c98e674b71 in use. Oct 18 15:36:39.165428 n-d-853682-5 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-4ea97158-26f7-402f-bf0d-a3050a8eb7f7'] {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:36:39.165428 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0b7ebe56-ea29-4287-b078-564274ee978b tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/be0ba8d0-373d-467b-91ba-f0c98e674b71" status: 400 len: 185 microversion: 2.1 time: 0.133730 Oct 18 15:36:39.165428 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1318/2743] 10.222.0.60 () {58 vars in 1272 bytes} [Tue Oct 18 15:36:39 2022] DELETE /compute/v2.1/os-security-groups/be0ba8d0-373d-467b-91ba-f0c98e674b71 => generated 185 bytes in 141 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:36:39.169028 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ba15c0a9-2ed8-47b0-b596-d03350e1b62f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:36:39.170058 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ba15c0a9-2ed8-47b0-b596-d03350e1b62f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: bbd6e88c-1947-4518-9fd4-c17233679336] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:39.177890 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba15c0a9-2ed8-47b0-b596-d03350e1b62f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:39.178591 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba15c0a9-2ed8-47b0-b596-d03350e1b62f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:39.179027 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba15c0a9-2ed8-47b0-b596-d03350e1b62f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:39.180271 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba15c0a9-2ed8-47b0-b596-d03350e1b62f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:39.180925 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba15c0a9-2ed8-47b0-b596-d03350e1b62f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:39.181385 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba15c0a9-2ed8-47b0-b596-d03350e1b62f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:39.253608 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ba15c0a9-2ed8-47b0-b596-d03350e1b62f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "POST /compute/v2.1/servers/bbd6e88c-1947-4518-9fd4-c17233679336/action" status: 202 len: 0 microversion: 2.1 time: 0.090205 Oct 18 15:36:39.258562 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1319/2744] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:36:39 2022] POST /compute/v2.1/servers/bbd6e88c-1947-4518-9fd4-c17233679336/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:36:39.265508 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-df6e5aee-bfcb-4515-9e22-39afa4fcc1a0 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:39.266595 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-df6e5aee-bfcb-4515-9e22-39afa4fcc1a0 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:39.284161 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df6e5aee-bfcb-4515-9e22-39afa4fcc1a0 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:39.287449 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df6e5aee-bfcb-4515-9e22-39afa4fcc1a0 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:39.293789 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df6e5aee-bfcb-4515-9e22-39afa4fcc1a0 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:39.294858 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df6e5aee-bfcb-4515-9e22-39afa4fcc1a0 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:39.295548 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df6e5aee-bfcb-4515-9e22-39afa4fcc1a0 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:39.295963 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df6e5aee-bfcb-4515-9e22-39afa4fcc1a0 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:39.502489 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9e2875cd-5aca-4a33-880c-67364b1d3c59 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "POST /compute/v2.1/servers/511cbc18-aef9-4202-9616-decd6651e931/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.797863 Oct 18 15:36:39.511499 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1426/2745] 10.222.0.60 () {60 vars in 1323 bytes} [Tue Oct 18 15:36:37 2022] POST /compute/v2.1/servers/511cbc18-aef9-4202-9616-decd6651e931/os-volume_attachments => generated 194 bytes in 1807 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:36:39.522152 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ddaa5e10-ba4c-4edb-8a4d-3091454ee7f5 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:39.532312 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ddaa5e10-ba4c-4edb-8a4d-3091454ee7f5 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '01bc878a0901409684ea58261475b1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88812dd7c80d47bba192382fccc31e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:39.532926 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ddaa5e10-ba4c-4edb-8a4d-3091454ee7f5 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Searching by: {'deleted': False, 'project_id': '88812dd7c80d47bba192382fccc31e64'} {{(pid=120405) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 15:36:39.552876 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ddaa5e10-ba4c-4edb-8a4d-3091454ee7f5 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:39.555775 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ddaa5e10-ba4c-4edb-8a4d-3091454ee7f5 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:39.561767 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ddaa5e10-ba4c-4edb-8a4d-3091454ee7f5 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:39.563863 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ddaa5e10-ba4c-4edb-8a4d-3091454ee7f5 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:39.564621 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ddaa5e10-ba4c-4edb-8a4d-3091454ee7f5 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:39.565721 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ddaa5e10-ba4c-4edb-8a4d-3091454ee7f5 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:39.636082 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.multi_cell_list [None req-ddaa5e10-ba4c-4edb-8a4d-3091454ee7f5 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120405) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 15:36:39.734333 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ddaa5e10-ba4c-4edb-8a4d-3091454ee7f5 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.221498 Oct 18 15:36:39.736005 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1427/2746] 10.222.0.60 () {58 vars in 1125 bytes} [Tue Oct 18 15:36:39 2022] GET /compute/v2.1/servers => generated 333 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:36:39.752751 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-469a031d-d939-4ea3-92cd-093a5d93dec3 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:39.753478 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-469a031d-d939-4ea3-92cd-093a5d93dec3 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] [instance: 82aba568-875e-459c-8bc9-248b4851fc94] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:39.761219 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-469a031d-d939-4ea3-92cd-093a5d93dec3 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:39.762362 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-469a031d-d939-4ea3-92cd-093a5d93dec3 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:39.763029 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-469a031d-d939-4ea3-92cd-093a5d93dec3 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:39.763997 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-469a031d-d939-4ea3-92cd-093a5d93dec3 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:39.764683 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-469a031d-d939-4ea3-92cd-093a5d93dec3 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:39.765345 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-469a031d-d939-4ea3-92cd-093a5d93dec3 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:39.782195 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-df6e5aee-bfcb-4515-9e22-39afa4fcc1a0 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:39.792905 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-df6e5aee-bfcb-4515-9e22-39afa4fcc1a0 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c" status: 200 len: 1472 microversion: 2.1 time: 0.532275 Oct 18 15:36:39.805428 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1320/2747] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:39 2022] GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c => generated 1472 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:39.822145 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-469a031d-d939-4ea3-92cd-093a5d93dec3 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] [instance: 82aba568-875e-459c-8bc9-248b4851fc94] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:36:39.834746 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-17f030fa-984e-4900-9397-787008b420f5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:39.835597 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-17f030fa-984e-4900-9397-787008b420f5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: bbd6e88c-1947-4518-9fd4-c17233679336] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:39.843723 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17f030fa-984e-4900-9397-787008b420f5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:39.844234 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17f030fa-984e-4900-9397-787008b420f5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:39.844690 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17f030fa-984e-4900-9397-787008b420f5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:39.845447 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17f030fa-984e-4900-9397-787008b420f5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:39.846003 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17f030fa-984e-4900-9397-787008b420f5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:39.846320 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17f030fa-984e-4900-9397-787008b420f5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:40.017319 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-469a031d-d939-4ea3-92cd-093a5d93dec3 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "DELETE /compute/v2.1/servers/82aba568-875e-459c-8bc9-248b4851fc94" status: 204 len: 0 microversion: 2.1 time: 0.268800 Oct 18 15:36:40.018210 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1428/2748] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:36:39 2022] DELETE /compute/v2.1/servers/82aba568-875e-459c-8bc9-248b4851fc94 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:36:40.030742 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-68705660-6306-4ae9-be64-578981fb6fa1 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:40.040528 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-68705660-6306-4ae9-be64-578981fb6fa1 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '01bc878a0901409684ea58261475b1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88812dd7c80d47bba192382fccc31e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:40.041860 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-68705660-6306-4ae9-be64-578981fb6fa1 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Searching by: {'deleted': False, 'project_id': '88812dd7c80d47bba192382fccc31e64'} {{(pid=120405) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 15:36:40.050898 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-68705660-6306-4ae9-be64-578981fb6fa1 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:40.051521 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-68705660-6306-4ae9-be64-578981fb6fa1 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:40.052034 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-68705660-6306-4ae9-be64-578981fb6fa1 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:40.052874 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-68705660-6306-4ae9-be64-578981fb6fa1 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:40.054468 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-68705660-6306-4ae9-be64-578981fb6fa1 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:40.055574 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-68705660-6306-4ae9-be64-578981fb6fa1 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:40.092221 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.multi_cell_list [None req-68705660-6306-4ae9-be64-578981fb6fa1 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120405) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 15:36:40.231071 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-68705660-6306-4ae9-be64-578981fb6fa1 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bc878a0901409684ea58261475b1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88812dd7c80d47bba192382fccc31e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:40.243744 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-68705660-6306-4ae9-be64-578981fb6fa1 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:40.245128 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-68705660-6306-4ae9-be64-578981fb6fa1 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:40.246206 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-68705660-6306-4ae9-be64-578981fb6fa1 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:40.312534 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-17f030fa-984e-4900-9397-787008b420f5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:40.320859 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-17f030fa-984e-4900-9397-787008b420f5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/bbd6e88c-1947-4518-9fd4-c17233679336" status: 200 len: 1487 microversion: 2.1 time: 0.514268 Oct 18 15:36:40.329707 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1321/2749] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:39 2022] GET /compute/v2.1/servers/bbd6e88c-1947-4518-9fd4-c17233679336 => generated 1487 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:40.335120 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b687cb8d-2753-4abe-8e3b-0fa67d2b0ef9 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:40.335962 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b687cb8d-2753-4abe-8e3b-0fa67d2b0ef9 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 52d725f3-b4da-4831-9abf-bf7aba8aee0a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:40.354632 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b687cb8d-2753-4abe-8e3b-0fa67d2b0ef9 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:40.355319 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b687cb8d-2753-4abe-8e3b-0fa67d2b0ef9 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:40.355798 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b687cb8d-2753-4abe-8e3b-0fa67d2b0ef9 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:40.356646 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b687cb8d-2753-4abe-8e3b-0fa67d2b0ef9 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:40.357333 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b687cb8d-2753-4abe-8e3b-0fa67d2b0ef9 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:40.357916 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b687cb8d-2753-4abe-8e3b-0fa67d2b0ef9 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:40.520634 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-68705660-6306-4ae9-be64-578981fb6fa1 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] 10.222.0.60 "GET /compute/v2.1/servers/detail" status: 200 len: 1697 microversion: 2.1 time: 0.500777 Oct 18 15:36:40.549214 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1429/2750] 10.222.0.60 () {58 vars in 1146 bytes} [Tue Oct 18 15:36:40 2022] GET /compute/v2.1/servers/detail => generated 1697 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:40.555481 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a479fcc5-c548-4386-af3a-6e2ec98dd4bc tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:40.556783 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a479fcc5-c548-4386-af3a-6e2ec98dd4bc tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 1c84f8ca-befc-489e-8068-135af3b766fe] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:40.563669 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a479fcc5-c548-4386-af3a-6e2ec98dd4bc tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:40.564469 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a479fcc5-c548-4386-af3a-6e2ec98dd4bc tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:40.565152 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a479fcc5-c548-4386-af3a-6e2ec98dd4bc tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:40.566078 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a479fcc5-c548-4386-af3a-6e2ec98dd4bc tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:40.566748 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a479fcc5-c548-4386-af3a-6e2ec98dd4bc tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:40.567405 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a479fcc5-c548-4386-af3a-6e2ec98dd4bc tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:40.569375 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b687cb8d-2753-4abe-8e3b-0fa67d2b0ef9 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304b3248f9db4629943a8b8080a6d22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdc7504a1d1424ea34f83f1a6d4bf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:40.578352 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b687cb8d-2753-4abe-8e3b-0fa67d2b0ef9 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a" status: 200 len: 1362 microversion: 2.1 time: 0.247030 Oct 18 15:36:40.595025 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1322/2751] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:40 2022] GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a => generated 1362 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:40.603626 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-82a35e04-7858-4a55-8663-d3ca8358e22e tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:40.604261 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-82a35e04-7858-4a55-8663-d3ca8358e22e tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] [instance: 82aba568-875e-459c-8bc9-248b4851fc94] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:40.610423 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82a35e04-7858-4a55-8663-d3ca8358e22e tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:40.611136 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82a35e04-7858-4a55-8663-d3ca8358e22e tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:40.611735 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82a35e04-7858-4a55-8663-d3ca8358e22e tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:40.612598 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82a35e04-7858-4a55-8663-d3ca8358e22e tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:40.613697 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82a35e04-7858-4a55-8663-d3ca8358e22e tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:40.614314 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82a35e04-7858-4a55-8663-d3ca8358e22e tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:40.900687 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-82a35e04-7858-4a55-8663-d3ca8358e22e tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a7ce3bb784a79b3ac336743b9ae84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a52e3135e52493b8ccb2d7342418591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:40.910823 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-82a35e04-7858-4a55-8663-d3ca8358e22e tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "GET /compute/v2.1/servers/82aba568-875e-459c-8bc9-248b4851fc94" status: 200 len: 1648 microversion: 2.1 time: 0.314593 Oct 18 15:36:40.913255 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1323/2752] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:40 2022] GET /compute/v2.1/servers/82aba568-875e-459c-8bc9-248b4851fc94 => generated 1648 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:40.930104 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a479fcc5-c548-4386-af3a-6e2ec98dd4bc tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:40.932211 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-cd7f4ade-3a21-4841-b916-e2399785c9d4 req-535d5af2-1c7b-4bc5-883f-c89afea6f76f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52d725f3-b4da-4831-9abf-bf7aba8aee0a", "name": "network-vif-plugged", "status": "completed", "tag": "3876fb57-0e44-4236-b433-c1842e0940ff"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:36:40.946558 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a479fcc5-c548-4386-af3a-6e2ec98dd4bc tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe" status: 200 len: 1474 microversion: 2.1 time: 0.390996 Oct 18 15:36:40.947549 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1430/2753] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:40 2022] GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe => generated 1474 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:40.965669 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-cd7f4ade-3a21-4841-b916-e2399785c9d4 req-535d5af2-1c7b-4bc5-883f-c89afea6f76f service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:40.966200 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-cd7f4ade-3a21-4841-b916-e2399785c9d4 req-535d5af2-1c7b-4bc5-883f-c89afea6f76f service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:40.966635 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-cd7f4ade-3a21-4841-b916-e2399785c9d4 req-535d5af2-1c7b-4bc5-883f-c89afea6f76f service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:40.969564 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f6493431-a3c9-4fdc-8c77-639d58b350a4 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:40.970277 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f6493431-a3c9-4fdc-8c77-639d58b350a4 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: bbd6e88c-1947-4518-9fd4-c17233679336] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:40.979025 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f6493431-a3c9-4fdc-8c77-639d58b350a4 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:40.979721 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f6493431-a3c9-4fdc-8c77-639d58b350a4 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:40.980314 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f6493431-a3c9-4fdc-8c77-639d58b350a4 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:40.981210 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f6493431-a3c9-4fdc-8c77-639d58b350a4 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:40.982184 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f6493431-a3c9-4fdc-8c77-639d58b350a4 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:40.982774 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f6493431-a3c9-4fdc-8c77-639d58b350a4 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:40.996246 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-cd7f4ade-3a21-4841-b916-e2399785c9d4 req-535d5af2-1c7b-4bc5-883f-c89afea6f76f service nova] Creating event network-vif-plugged:3876fb57-0e44-4236-b433-c1842e0940ff for instance 52d725f3-b4da-4831-9abf-bf7aba8aee0a on n-h1-853682-5 Oct 18 15:36:41.006659 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-cd7f4ade-3a21-4841-b916-e2399785c9d4 req-535d5af2-1c7b-4bc5-883f-c89afea6f76f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092044 Oct 18 15:36:41.007508 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1324/2754] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:36:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:36:41.012458 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f6493431-a3c9-4fdc-8c77-639d58b350a4 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: bbd6e88c-1947-4518-9fd4-c17233679336] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:36:41.017236 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c8a5fa24-63de-46a4-a660-3157b0c17032 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:41.034845 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c8a5fa24-63de-46a4-a660-3157b0c17032 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026057 Oct 18 15:36:41.036925 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1325/2755] 10.222.0.60 () {58 vars in 1137 bytes} [Tue Oct 18 15:36:41 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:36:41.047927 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-01e8b3bc-ca64-449b-ba14-d8295c46cb5b tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:41.048687 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-01e8b3bc-ca64-449b-ba14-d8295c46cb5b tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:41.061540 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01e8b3bc-ca64-449b-ba14-d8295c46cb5b tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:41.062975 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01e8b3bc-ca64-449b-ba14-d8295c46cb5b tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:41.063484 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01e8b3bc-ca64-449b-ba14-d8295c46cb5b tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:41.064615 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01e8b3bc-ca64-449b-ba14-d8295c46cb5b tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:41.065080 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01e8b3bc-ca64-449b-ba14-d8295c46cb5b tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:41.065519 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01e8b3bc-ca64-449b-ba14-d8295c46cb5b tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:41.162610 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f6493431-a3c9-4fdc-8c77-639d58b350a4 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "DELETE /compute/v2.1/servers/bbd6e88c-1947-4518-9fd4-c17233679336" status: 204 len: 0 microversion: 2.1 time: 0.199695 Oct 18 15:36:41.171270 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1431/2756] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:36:40 2022] DELETE /compute/v2.1/servers/bbd6e88c-1947-4518-9fd4-c17233679336 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:36:41.188647 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ea9139d3-64c5-40cc-9a37-8e50f3285f25 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:41.190905 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ea9139d3-64c5-40cc-9a37-8e50f3285f25 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: bbd6e88c-1947-4518-9fd4-c17233679336] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:41.206602 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea9139d3-64c5-40cc-9a37-8e50f3285f25 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:41.207103 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea9139d3-64c5-40cc-9a37-8e50f3285f25 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:41.212180 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea9139d3-64c5-40cc-9a37-8e50f3285f25 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:41.216956 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea9139d3-64c5-40cc-9a37-8e50f3285f25 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:41.219488 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea9139d3-64c5-40cc-9a37-8e50f3285f25 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:41.220094 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea9139d3-64c5-40cc-9a37-8e50f3285f25 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:41.467623 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-01e8b3bc-ca64-449b-ba14-d8295c46cb5b tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:41.480730 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-01e8b3bc-ca64-449b-ba14-d8295c46cb5b tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c" status: 200 len: 1472 microversion: 2.1 time: 0.442714 Oct 18 15:36:41.482498 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1326/2757] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:41 2022] GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c => generated 1472 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:41.563940 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ea9139d3-64c5-40cc-9a37-8e50f3285f25 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:41.577461 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ea9139d3-64c5-40cc-9a37-8e50f3285f25 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/bbd6e88c-1947-4518-9fd4-c17233679336" status: 200 len: 1493 microversion: 2.1 time: 0.400646 Oct 18 15:36:41.582122 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1432/2758] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:41 2022] GET /compute/v2.1/servers/bbd6e88c-1947-4518-9fd4-c17233679336 => generated 1493 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:41.613514 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-da6b8a83-8a0d-4041-9ac2-54f518e9c7fe tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:41.614308 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-da6b8a83-8a0d-4041-9ac2-54f518e9c7fe tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 52d725f3-b4da-4831-9abf-bf7aba8aee0a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:41.617203 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ec42ab64-e1da-4a70-bde1-bcb44f1321da tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:41.617950 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ec42ab64-e1da-4a70-bde1-bcb44f1321da tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] [instance: 63a69f32-61bc-41d2-a358-636ae638f654] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:41.622810 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da6b8a83-8a0d-4041-9ac2-54f518e9c7fe tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:41.623534 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da6b8a83-8a0d-4041-9ac2-54f518e9c7fe tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:41.624126 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da6b8a83-8a0d-4041-9ac2-54f518e9c7fe tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:41.625092 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da6b8a83-8a0d-4041-9ac2-54f518e9c7fe tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:41.625702 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da6b8a83-8a0d-4041-9ac2-54f518e9c7fe tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:41.626289 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da6b8a83-8a0d-4041-9ac2-54f518e9c7fe tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:41.630004 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ec42ab64-e1da-4a70-bde1-bcb44f1321da tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:41.630633 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ec42ab64-e1da-4a70-bde1-bcb44f1321da tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:41.630988 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ec42ab64-e1da-4a70-bde1-bcb44f1321da tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:41.634248 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ec42ab64-e1da-4a70-bde1-bcb44f1321da tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:41.635146 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ec42ab64-e1da-4a70-bde1-bcb44f1321da tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:41.635816 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ec42ab64-e1da-4a70-bde1-bcb44f1321da tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:41.692904 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ec42ab64-e1da-4a70-bde1-bcb44f1321da tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] [instance: 63a69f32-61bc-41d2-a358-636ae638f654] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:36:41.841190 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-da6b8a83-8a0d-4041-9ac2-54f518e9c7fe tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304b3248f9db4629943a8b8080a6d22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdc7504a1d1424ea34f83f1a6d4bf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:41.852998 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-da6b8a83-8a0d-4041-9ac2-54f518e9c7fe tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a" status: 200 len: 1362 microversion: 2.1 time: 0.249030 Oct 18 15:36:41.853791 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1327/2759] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:41 2022] GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a => generated 1362 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:41.912983 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ec42ab64-e1da-4a70-bde1-bcb44f1321da tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] 10.222.0.60 "DELETE /compute/v2.1/servers/63a69f32-61bc-41d2-a358-636ae638f654" status: 204 len: 0 microversion: 2.1 time: 0.299788 Oct 18 15:36:41.914245 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1433/2760] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:36:41 2022] DELETE /compute/v2.1/servers/63a69f32-61bc-41d2-a358-636ae638f654 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:36:41.923247 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1d09a7db-6ae6-4a03-aa9d-b1d6990c132e tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:41.923891 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1d09a7db-6ae6-4a03-aa9d-b1d6990c132e tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] [instance: 63a69f32-61bc-41d2-a358-636ae638f654] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:41.935778 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=97 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:36:41.938545 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d09a7db-6ae6-4a03-aa9d-b1d6990c132e tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:41.939955 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d09a7db-6ae6-4a03-aa9d-b1d6990c132e tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:41.940437 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d09a7db-6ae6-4a03-aa9d-b1d6990c132e tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:41.943040 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d09a7db-6ae6-4a03-aa9d-b1d6990c132e tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:41.944095 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c8afe269-a027-4251-86e6-3d4d2bbb61b4 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:41.944687 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d09a7db-6ae6-4a03-aa9d-b1d6990c132e tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:41.945184 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d09a7db-6ae6-4a03-aa9d-b1d6990c132e tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:41.945963 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c8afe269-a027-4251-86e6-3d4d2bbb61b4 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] [instance: 82aba568-875e-459c-8bc9-248b4851fc94] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:41.958010 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c8afe269-a027-4251-86e6-3d4d2bbb61b4 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:41.961292 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c8afe269-a027-4251-86e6-3d4d2bbb61b4 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:41.961783 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c8afe269-a027-4251-86e6-3d4d2bbb61b4 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:41.966493 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c8afe269-a027-4251-86e6-3d4d2bbb61b4 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:41.967726 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c8afe269-a027-4251-86e6-3d4d2bbb61b4 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:41.972231 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c8afe269-a027-4251-86e6-3d4d2bbb61b4 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:42.181630 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1d09a7db-6ae6-4a03-aa9d-b1d6990c132e tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bc878a0901409684ea58261475b1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88812dd7c80d47bba192382fccc31e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:42.184045 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:36:42.200326 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1d09a7db-6ae6-4a03-aa9d-b1d6990c132e tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] 10.222.0.60 "GET /compute/v2.1/servers/63a69f32-61bc-41d2-a358-636ae638f654" status: 200 len: 1700 microversion: 2.1 time: 0.281994 Oct 18 15:36:42.201362 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1328/2761] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:41 2022] GET /compute/v2.1/servers/63a69f32-61bc-41d2-a358-636ae638f654 => generated 1700 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:42.225188 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5c9bc4cc-0c8b-4d9b-b14c-c02635c9ea31 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:42.228864 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5c9bc4cc-0c8b-4d9b-b14c-c02635c9ea31 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 1c84f8ca-befc-489e-8068-135af3b766fe] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:42.254322 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c9bc4cc-0c8b-4d9b-b14c-c02635c9ea31 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:42.256457 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c9bc4cc-0c8b-4d9b-b14c-c02635c9ea31 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:42.257603 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c9bc4cc-0c8b-4d9b-b14c-c02635c9ea31 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:42.260184 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c9bc4cc-0c8b-4d9b-b14c-c02635c9ea31 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:42.261929 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c9bc4cc-0c8b-4d9b-b14c-c02635c9ea31 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:42.262619 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c9bc4cc-0c8b-4d9b-b14c-c02635c9ea31 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:42.359552 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c8afe269-a027-4251-86e6-3d4d2bbb61b4 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a7ce3bb784a79b3ac336743b9ae84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a52e3135e52493b8ccb2d7342418591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:42.372935 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c8afe269-a027-4251-86e6-3d4d2bbb61b4 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "GET /compute/v2.1/servers/82aba568-875e-459c-8bc9-248b4851fc94" status: 200 len: 1648 microversion: 2.1 time: 0.432802 Oct 18 15:36:42.373712 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1434/2762] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:41 2022] GET /compute/v2.1/servers/82aba568-875e-459c-8bc9-248b4851fc94 => generated 1648 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:42.508184 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-54df0557-efa2-452c-a078-8d14918a9a55 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:42.508954 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-54df0557-efa2-452c-a078-8d14918a9a55 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:42.516344 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-54df0557-efa2-452c-a078-8d14918a9a55 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:42.520629 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-54df0557-efa2-452c-a078-8d14918a9a55 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:42.523376 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-54df0557-efa2-452c-a078-8d14918a9a55 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:42.526130 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-54df0557-efa2-452c-a078-8d14918a9a55 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:42.526623 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-54df0557-efa2-452c-a078-8d14918a9a55 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:42.527067 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-54df0557-efa2-452c-a078-8d14918a9a55 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:42.777212 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5c9bc4cc-0c8b-4d9b-b14c-c02635c9ea31 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:42.785541 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5c9bc4cc-0c8b-4d9b-b14c-c02635c9ea31 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe" status: 200 len: 1474 microversion: 2.1 time: 0.564346 Oct 18 15:36:42.796836 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1329/2763] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:42 2022] GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe => generated 1474 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:42.806158 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-865c934a-0cac-49a5-b585-267c5d7a72d0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:42.806158 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-865c934a-0cac-49a5-b585-267c5d7a72d0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: bbd6e88c-1947-4518-9fd4-c17233679336] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:42.813878 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-865c934a-0cac-49a5-b585-267c5d7a72d0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:42.814370 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-865c934a-0cac-49a5-b585-267c5d7a72d0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:42.814808 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-865c934a-0cac-49a5-b585-267c5d7a72d0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:42.815512 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-865c934a-0cac-49a5-b585-267c5d7a72d0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:42.815964 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-865c934a-0cac-49a5-b585-267c5d7a72d0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:42.816385 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-865c934a-0cac-49a5-b585-267c5d7a72d0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:42.864095 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-54df0557-efa2-452c-a078-8d14918a9a55 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:42.869043 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:36:42.888257 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-54df0557-efa2-452c-a078-8d14918a9a55 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c" status: 200 len: 1472 microversion: 2.1 time: 0.382201 Oct 18 15:36:42.889635 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1435/2764] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:42 2022] GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c => generated 1472 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:36:42.898668 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-47f96481-dfbb-4236-823f-d173115a72b2 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:42.899524 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-47f96481-dfbb-4236-823f-d173115a72b2 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 52d725f3-b4da-4831-9abf-bf7aba8aee0a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:42.906978 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:36:42.908912 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-47f96481-dfbb-4236-823f-d173115a72b2 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:42.909644 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-47f96481-dfbb-4236-823f-d173115a72b2 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:42.910239 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-47f96481-dfbb-4236-823f-d173115a72b2 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:42.911352 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-47f96481-dfbb-4236-823f-d173115a72b2 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:42.911976 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-47f96481-dfbb-4236-823f-d173115a72b2 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:42.912734 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-47f96481-dfbb-4236-823f-d173115a72b2 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:43.106817 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-865c934a-0cac-49a5-b585-267c5d7a72d0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:43.118887 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-865c934a-0cac-49a5-b585-267c5d7a72d0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/bbd6e88c-1947-4518-9fd4-c17233679336" status: 200 len: 1493 microversion: 2.1 time: 0.329970 Oct 18 15:36:43.124177 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1330/2765] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:42 2022] GET /compute/v2.1/servers/bbd6e88c-1947-4518-9fd4-c17233679336 => generated 1493 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:43.160778 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-4880818f-9c11-4eff-af60-e8af6f032843 req-fdefb509-6359-4bee-b878-2244a301800f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c84f8ca-befc-489e-8068-135af3b766fe", "name": "network-vif-unplugged", "status": "completed", "tag": "a6a64478-83ca-4d2d-9c94-d78e137f6782"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:36:43.165703 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-47f96481-dfbb-4236-823f-d173115a72b2 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304b3248f9db4629943a8b8080a6d22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdc7504a1d1424ea34f83f1a6d4bf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:43.181623 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-47f96481-dfbb-4236-823f-d173115a72b2 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a" status: 200 len: 1362 microversion: 2.1 time: 0.290146 Oct 18 15:36:43.181873 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4880818f-9c11-4eff-af60-e8af6f032843 req-fdefb509-6359-4bee-b878-2244a301800f service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:43.182598 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4880818f-9c11-4eff-af60-e8af6f032843 req-fdefb509-6359-4bee-b878-2244a301800f service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:43.183901 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4880818f-9c11-4eff-af60-e8af6f032843 req-fdefb509-6359-4bee-b878-2244a301800f service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:43.196786 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1436/2766] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:42 2022] GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a => generated 1362 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:43.205302 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-4880818f-9c11-4eff-af60-e8af6f032843 req-fdefb509-6359-4bee-b878-2244a301800f service nova] Creating event network-vif-unplugged:a6a64478-83ca-4d2d-9c94-d78e137f6782 for instance 1c84f8ca-befc-489e-8068-135af3b766fe on n-h2-853682-5 Oct 18 15:36:43.211648 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [req-4880818f-9c11-4eff-af60-e8af6f032843 req-fdefb509-6359-4bee-b878-2244a301800f service nova] Instance 1c84f8ca-befc-489e-8068-135af3b766fe is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853682-5'} {{(pid=120406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 18 15:36:43.218249 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-4880818f-9c11-4eff-af60-e8af6f032843 req-fdefb509-6359-4bee-b878-2244a301800f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061220 Oct 18 15:36:43.219545 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1331/2767] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:36:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:36:43.224659 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2904c3b7-ae93-4bec-a7cb-cd6a3a08f0cd tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:43.225306 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2904c3b7-ae93-4bec-a7cb-cd6a3a08f0cd tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] [instance: 63a69f32-61bc-41d2-a358-636ae638f654] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:43.232579 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2904c3b7-ae93-4bec-a7cb-cd6a3a08f0cd tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:43.233299 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2904c3b7-ae93-4bec-a7cb-cd6a3a08f0cd tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:43.233886 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2904c3b7-ae93-4bec-a7cb-cd6a3a08f0cd tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:43.234905 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2904c3b7-ae93-4bec-a7cb-cd6a3a08f0cd tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:43.235517 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2904c3b7-ae93-4bec-a7cb-cd6a3a08f0cd tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:43.236171 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2904c3b7-ae93-4bec-a7cb-cd6a3a08f0cd tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:43.398992 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f2e784de-f47e-4a1f-b6bc-2c4183c6600a tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:43.399940 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f2e784de-f47e-4a1f-b6bc-2c4183c6600a tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] [instance: 82aba568-875e-459c-8bc9-248b4851fc94] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:43.408987 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2e784de-f47e-4a1f-b6bc-2c4183c6600a tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:43.413987 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2e784de-f47e-4a1f-b6bc-2c4183c6600a tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:43.414749 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2e784de-f47e-4a1f-b6bc-2c4183c6600a tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:43.415718 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2e784de-f47e-4a1f-b6bc-2c4183c6600a tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:43.416335 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2e784de-f47e-4a1f-b6bc-2c4183c6600a tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:43.417623 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2e784de-f47e-4a1f-b6bc-2c4183c6600a tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:43.420279 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2904c3b7-ae93-4bec-a7cb-cd6a3a08f0cd tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bc878a0901409684ea58261475b1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88812dd7c80d47bba192382fccc31e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:43.430179 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2904c3b7-ae93-4bec-a7cb-cd6a3a08f0cd tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] 10.222.0.60 "GET /compute/v2.1/servers/63a69f32-61bc-41d2-a358-636ae638f654" status: 200 len: 1700 microversion: 2.1 time: 0.208810 Oct 18 15:36:43.432759 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1437/2768] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:43 2022] GET /compute/v2.1/servers/63a69f32-61bc-41d2-a358-636ae638f654 => generated 1700 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:36:43.722054 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-61f31825-79cd-4ea6-8f15-23748f66defc tempest-FloatingIPDetailsNegativeTestJSON-1279033812 tempest-FloatingIPDetailsNegativeTestJSON-1279033812-project] Calling method '.version_select at 0x7f7c415cca60>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:43.787570 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f2e784de-f47e-4a1f-b6bc-2c4183c6600a tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a7ce3bb784a79b3ac336743b9ae84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a52e3135e52493b8ccb2d7342418591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:43.811943 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f2e784de-f47e-4a1f-b6bc-2c4183c6600a tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "GET /compute/v2.1/servers/82aba568-875e-459c-8bc9-248b4851fc94" status: 200 len: 1648 microversion: 2.1 time: 0.419744 Oct 18 15:36:43.829080 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1332/2769] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:43 2022] GET /compute/v2.1/servers/82aba568-875e-459c-8bc9-248b4851fc94 => generated 1648 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:36:43.840900 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-93300590-3b9a-43d6-8629-44f47d4005af tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:43.843146 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-93300590-3b9a-43d6-8629-44f47d4005af tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 1c84f8ca-befc-489e-8068-135af3b766fe] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:43.868386 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-93300590-3b9a-43d6-8629-44f47d4005af tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:43.869984 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-93300590-3b9a-43d6-8629-44f47d4005af tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:43.870536 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-93300590-3b9a-43d6-8629-44f47d4005af tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:43.872649 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-93300590-3b9a-43d6-8629-44f47d4005af tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:43.874513 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-93300590-3b9a-43d6-8629-44f47d4005af tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:43.875148 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-93300590-3b9a-43d6-8629-44f47d4005af tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:43.888521 n-d-853682-5 devstack@n-api.service[120405]: DEBUG neutronclient.v2_0.client [None req-61f31825-79cd-4ea6-8f15-23748f66defc tempest-FloatingIPDetailsNegativeTestJSON-1279033812 tempest-FloatingIPDetailsNegativeTestJSON-1279033812-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP d1e8bc7d-90ee-456e-b756-c2ba35a7f6cc could not be found", "detail": ""}} {{(pid=120405) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 15:36:43.890769 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-61f31825-79cd-4ea6-8f15-23748f66defc tempest-FloatingIPDetailsNegativeTestJSON-1279033812 tempest-FloatingIPDetailsNegativeTestJSON-1279033812-project] HTTP exception thrown: Floating IP not found for ID d1e8bc7d-90ee-456e-b756-c2ba35a7f6cc Oct 18 15:36:43.892721 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-61f31825-79cd-4ea6-8f15-23748f66defc tempest-FloatingIPDetailsNegativeTestJSON-1279033812 tempest-FloatingIPDetailsNegativeTestJSON-1279033812-project] Request method failure captured: Oct 18 15:36:43.892721 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/os-floating-ips/d1e8bc7d-90ee-456e-b756-c2ba35a7f6cc HTTP/1.1 Oct 18 15:36:43.892721 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:36:43.892721 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:36:43.892721 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:36:43.892721 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:36:43.892721 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:36:43.892721 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:36:43.892721 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:36:43.892721 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:36:43.892721 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsgLz5PYWyMBqC8xSi78UT-YAXBTRmk9uBE8CmHRC0BDJ7-SlMKsN_T2XT12duk70WdRz5WYwjeZdx8xTrD4usru9n89-sf-vGes3_mEZ0zlRVrRHQ3JwkvmWz0p6_Z3HxkRJ4pXbrt-fiU7WiweghlbiUCMLFWCmSAElxVwrX_C-oM Oct 18 15:36:43.892721 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:36:43.892721 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:36:43.892721 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:36:43.892721 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:36:43.892721 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:36:43.892721 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:36:43.892721 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 34542b1577c042fba9a65ac0fc8cad66 Oct 18 15:36:43.892721 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1279033812 Oct 18 15:36:43.892721 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:36:43.892721 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:36:43.894171 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/34542b1577c042fba9a65ac0fc8cad66"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/34542b1577c042fba9a65ac0fc8cad66"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/34542b1577c042fba9a65ac0fc8cad66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_34542b1577c042fba9a65ac0fc8cad66"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:36:43.894171 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1279033812 Oct 18 15:36:43.894171 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 34542b1577c042fba9a65ac0fc8cad66 Oct 18 15:36:43.894171 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1279033812 Oct 18 15:36:43.894171 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1279033812-project Oct 18 15:36:43.894171 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:36:43.894171 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:36:43.894171 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: f9fe9f06c5a9453991682b0d81e40206 Oct 18 15:36:43.894171 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1279033812-project Oct 18 15:36:43.894171 n-d-853682-5 devstack@n-api.service[120405]: method: Oct 18 15:36:43.894171 n-d-853682-5 devstack@n-api.service[120405]: exception: Floating IP not found for ID d1e8bc7d-90ee-456e-b756-c2ba35a7f6cc Oct 18 15:36:43.894171 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'd1e8bc7d-90ee-456e-b756-c2ba35a7f6cc'} Oct 18 15:36:43.895031 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:36:43.895031 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:43.895031 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2837, in get_floating_ip Oct 18 15:36:43.895031 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 18 15:36:43.895031 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:43.895031 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:43.895031 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 18 15:36:43.895031 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 18 15:36:43.895031 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:43.895031 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:43.895031 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 15:36:43.895031 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 15:36:43.895031 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:43.895031 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:43.895031 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 15:36:43.895031 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 15:36:43.895031 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:43.895031 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:43.895031 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 15:36:43.900071 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 15:36:43.900071 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:43.900071 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:43.900071 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 15:36:43.900071 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 15:36:43.900071 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 15:36:43.900071 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 15:36:43.900071 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP d1e8bc7d-90ee-456e-b756-c2ba35a7f6cc could not be found Oct 18 15:36:43.900071 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e3071be2-e009-406f-8641-cc2b60f8a5e5'] Oct 18 15:36:43.900071 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:43.900071 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:43.900071 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:43.900071 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:43.900071 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 18 15:36:43.900071 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 18 15:36:43.900071 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2840, in get_floating_ip Oct 18 15:36:43.900071 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 18 15:36:43.900071 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID d1e8bc7d-90ee-456e-b756-c2ba35a7f6cc. Oct 18 15:36:43.900071 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:43.901514 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:43.901514 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:43.901514 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:43.901514 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:36:43.901514 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:36:43.901514 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:36:43.901514 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:36:43.901514 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:36:43.901514 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:36:43.901514 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:36:43.901514 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:36:43.901514 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 18 15:36:43.901514 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 18 15:36:43.901514 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID d1e8bc7d-90ee-456e-b756-c2ba35a7f6cc Oct 18 15:36:43.901514 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:43.901514 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:43.901514 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:43.901514 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:43.901514 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:36:43.901514 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:36:43.901514 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:36:43.902997 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:36:43.902997 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID d1e8bc7d-90ee-456e-b756-c2ba35a7f6cc Oct 18 15:36:43.902997 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:43.902997 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-61f31825-79cd-4ea6-8f15-23748f66defc tempest-FloatingIPDetailsNegativeTestJSON-1279033812 tempest-FloatingIPDetailsNegativeTestJSON-1279033812-project] Returning 404 to user: Floating IP not found for ID d1e8bc7d-90ee-456e-b756-c2ba35a7f6cc {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:36:43.902997 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-61f31825-79cd-4ea6-8f15-23748f66defc tempest-FloatingIPDetailsNegativeTestJSON-1279033812 tempest-FloatingIPDetailsNegativeTestJSON-1279033812-project] 10.222.0.60 "GET /compute/v2.1/os-floating-ips/d1e8bc7d-90ee-456e-b756-c2ba35a7f6cc" status: 404 len: 111 microversion: 2.1 time: 0.362581 Oct 18 15:36:43.909031 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1438/2770] 10.222.0.60 () {58 vars in 1260 bytes} [Tue Oct 18 15:36:43 2022] GET /compute/v2.1/os-floating-ips/d1e8bc7d-90ee-456e-b756-c2ba35a7f6cc => generated 111 bytes in 366 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:36:43.917570 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a9c70add-22c6-403f-a811-9168e3f69b1c tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:43.920201 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a9c70add-22c6-403f-a811-9168e3f69b1c tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:43.951817 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9c70add-22c6-403f-a811-9168e3f69b1c tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:43.952507 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9c70add-22c6-403f-a811-9168e3f69b1c tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:43.953107 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9c70add-22c6-403f-a811-9168e3f69b1c tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:43.953998 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9c70add-22c6-403f-a811-9168e3f69b1c tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:43.954655 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9c70add-22c6-403f-a811-9168e3f69b1c tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:43.964190 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9c70add-22c6-403f-a811-9168e3f69b1c tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:44.487674 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a9c70add-22c6-403f-a811-9168e3f69b1c tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:44.499883 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a9c70add-22c6-403f-a811-9168e3f69b1c tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c" status: 200 len: 1472 microversion: 2.1 time: 0.589828 Oct 18 15:36:44.500489 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1439/2771] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:43 2022] GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c => generated 1472 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:44.512767 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-76332c2d-7f67-49e8-9c46-720abb6dcf3d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:44.513920 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-76332c2d-7f67-49e8-9c46-720abb6dcf3d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: bbd6e88c-1947-4518-9fd4-c17233679336] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:44.531402 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-76332c2d-7f67-49e8-9c46-720abb6dcf3d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:44.533057 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-76332c2d-7f67-49e8-9c46-720abb6dcf3d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:44.534111 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-76332c2d-7f67-49e8-9c46-720abb6dcf3d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:44.536156 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-76332c2d-7f67-49e8-9c46-720abb6dcf3d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:44.536796 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-76332c2d-7f67-49e8-9c46-720abb6dcf3d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:44.539717 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-76332c2d-7f67-49e8-9c46-720abb6dcf3d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:44.540724 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-93300590-3b9a-43d6-8629-44f47d4005af tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:44.589305 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-93300590-3b9a-43d6-8629-44f47d4005af tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe" status: 200 len: 1474 microversion: 2.1 time: 0.758446 Oct 18 15:36:44.590472 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1333/2772] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:43 2022] GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe => generated 1474 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:44.607480 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1efb87b3-897f-401d-862b-6c21ffb5bcd6 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:44.608412 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1efb87b3-897f-401d-862b-6c21ffb5bcd6 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 52d725f3-b4da-4831-9abf-bf7aba8aee0a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:44.633960 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1efb87b3-897f-401d-862b-6c21ffb5bcd6 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:44.645246 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1efb87b3-897f-401d-862b-6c21ffb5bcd6 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:44.652788 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1efb87b3-897f-401d-862b-6c21ffb5bcd6 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:44.653934 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1efb87b3-897f-401d-862b-6c21ffb5bcd6 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:44.654494 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1efb87b3-897f-401d-862b-6c21ffb5bcd6 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:44.655782 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1efb87b3-897f-401d-862b-6c21ffb5bcd6 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:45.336118 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-76332c2d-7f67-49e8-9c46-720abb6dcf3d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:45.355574 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-76332c2d-7f67-49e8-9c46-720abb6dcf3d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/bbd6e88c-1947-4518-9fd4-c17233679336" status: 200 len: 1451 microversion: 2.1 time: 0.853938 Oct 18 15:36:45.359689 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1440/2773] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:44 2022] GET /compute/v2.1/servers/bbd6e88c-1947-4518-9fd4-c17233679336 => generated 1451 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:45.374804 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-40d4c75f-edf7-4e4a-bcda-116dc504ccad tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:45.382570 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-40d4c75f-edf7-4e4a-bcda-116dc504ccad tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] [instance: 63a69f32-61bc-41d2-a358-636ae638f654] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:45.398244 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-40d4c75f-edf7-4e4a-bcda-116dc504ccad tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:45.399694 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-40d4c75f-edf7-4e4a-bcda-116dc504ccad tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:45.402965 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-40d4c75f-edf7-4e4a-bcda-116dc504ccad tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:45.404781 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-40d4c75f-edf7-4e4a-bcda-116dc504ccad tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:45.406406 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-40d4c75f-edf7-4e4a-bcda-116dc504ccad tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:45.407075 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-40d4c75f-edf7-4e4a-bcda-116dc504ccad tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:45.612722 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1efb87b3-897f-401d-862b-6c21ffb5bcd6 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304b3248f9db4629943a8b8080a6d22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdc7504a1d1424ea34f83f1a6d4bf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:45.626321 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1efb87b3-897f-401d-862b-6c21ffb5bcd6 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a" status: 200 len: 1547 microversion: 2.1 time: 1.034501 Oct 18 15:36:45.626914 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1334/2774] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:44 2022] GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a => generated 1547 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:45.644761 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2cc3f0a3-d725-4576-bf60-6061df7f601f tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:45.645769 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2cc3f0a3-d725-4576-bf60-6061df7f601f tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] [instance: 82aba568-875e-459c-8bc9-248b4851fc94] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:45.656799 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2cc3f0a3-d725-4576-bf60-6061df7f601f tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:45.657585 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2cc3f0a3-d725-4576-bf60-6061df7f601f tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:45.658026 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2cc3f0a3-d725-4576-bf60-6061df7f601f tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:45.658747 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2cc3f0a3-d725-4576-bf60-6061df7f601f tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:45.659380 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2cc3f0a3-d725-4576-bf60-6061df7f601f tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:45.659810 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2cc3f0a3-d725-4576-bf60-6061df7f601f tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:45.730503 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2cc3f0a3-d725-4576-bf60-6061df7f601f tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:45.731352 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2cc3f0a3-d725-4576-bf60-6061df7f601f tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:45.732217 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2cc3f0a3-d725-4576-bf60-6061df7f601f tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:45.733153 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-2cc3f0a3-d725-4576-bf60-6061df7f601f tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lazy-loading 'fault' on Instance uuid 82aba568-875e-459c-8bc9-248b4851fc94 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:36:46.065331 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2cc3f0a3-d725-4576-bf60-6061df7f601f tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a7ce3bb784a79b3ac336743b9ae84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a52e3135e52493b8ccb2d7342418591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:46.096283 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2cc3f0a3-d725-4576-bf60-6061df7f601f tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "GET /compute/v2.1/servers/82aba568-875e-459c-8bc9-248b4851fc94" status: 200 len: 1306 microversion: 2.1 time: 0.468069 Oct 18 15:36:46.099946 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1335/2775] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:45 2022] GET /compute/v2.1/servers/82aba568-875e-459c-8bc9-248b4851fc94 => generated 1306 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:46.117727 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-d0acf87e-7f65-4649-929a-dbadc6419ca0 req-8041adc4-bec8-4d35-9d5a-c316544b1443 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82aba568-875e-459c-8bc9-248b4851fc94", "name": "network-vif-deleted", "tag": "ec50c426-5283-46d3-a30f-d9ba968c4452"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:36:46.158243 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d0acf87e-7f65-4649-929a-dbadc6419ca0 req-8041adc4-bec8-4d35-9d5a-c316544b1443 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:46.165258 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d0acf87e-7f65-4649-929a-dbadc6419ca0 req-8041adc4-bec8-4d35-9d5a-c316544b1443 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:46.165710 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d0acf87e-7f65-4649-929a-dbadc6419ca0 req-8041adc4-bec8-4d35-9d5a-c316544b1443 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:46.195290 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-40d4c75f-edf7-4e4a-bcda-116dc504ccad tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bc878a0901409684ea58261475b1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88812dd7c80d47bba192382fccc31e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:46.206407 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-40d4c75f-edf7-4e4a-bcda-116dc504ccad tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] 10.222.0.60 "GET /compute/v2.1/servers/63a69f32-61bc-41d2-a358-636ae638f654" status: 200 len: 1700 microversion: 2.1 time: 0.843035 Oct 18 15:36:46.212454 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-d0acf87e-7f65-4649-929a-dbadc6419ca0 req-8041adc4-bec8-4d35-9d5a-c316544b1443 service nova] Creating event network-vif-deleted:ec50c426-5283-46d3-a30f-d9ba968c4452 for instance 82aba568-875e-459c-8bc9-248b4851fc94 on n-h2-853682-5 Oct 18 15:36:46.223340 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1441/2776] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:45 2022] GET /compute/v2.1/servers/63a69f32-61bc-41d2-a358-636ae638f654 => generated 1700 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:46.233271 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-695087af-7d6f-4610-a5e0-5f7baed56aad tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:46.234189 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-695087af-7d6f-4610-a5e0-5f7baed56aad tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:46.237999 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-d0acf87e-7f65-4649-929a-dbadc6419ca0 req-8041adc4-bec8-4d35-9d5a-c316544b1443 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134549 Oct 18 15:36:46.242742 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-695087af-7d6f-4610-a5e0-5f7baed56aad tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:46.244333 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-695087af-7d6f-4610-a5e0-5f7baed56aad tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:46.245038 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-695087af-7d6f-4610-a5e0-5f7baed56aad tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:46.245216 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1336/2777] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:36:46.246112 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-695087af-7d6f-4610-a5e0-5f7baed56aad tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:46.246791 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-695087af-7d6f-4610-a5e0-5f7baed56aad tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:46.247574 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-695087af-7d6f-4610-a5e0-5f7baed56aad tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:46.254020 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e879c201-ef1e-4569-a5e3-d07ccb3a60fa tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:46.270976 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e879c201-ef1e-4569-a5e3-d07ccb3a60fa tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 1c84f8ca-befc-489e-8068-135af3b766fe] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:46.293028 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e879c201-ef1e-4569-a5e3-d07ccb3a60fa tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:46.294661 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e879c201-ef1e-4569-a5e3-d07ccb3a60fa tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:46.296605 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e879c201-ef1e-4569-a5e3-d07ccb3a60fa tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:46.300144 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e879c201-ef1e-4569-a5e3-d07ccb3a60fa tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:46.301064 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e879c201-ef1e-4569-a5e3-d07ccb3a60fa tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:46.301667 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e879c201-ef1e-4569-a5e3-d07ccb3a60fa tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:46.775484 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-695087af-7d6f-4610-a5e0-5f7baed56aad tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:46.785388 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-695087af-7d6f-4610-a5e0-5f7baed56aad tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c" status: 200 len: 1472 microversion: 2.1 time: 0.560801 Oct 18 15:36:46.785989 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1442/2778] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:46 2022] GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c => generated 1472 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:46.805630 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bd696ad8-53b4-4965-ac47-1e3cb31e387d tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:46.806499 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-bd696ad8-53b4-4965-ac47-1e3cb31e387d tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 52d725f3-b4da-4831-9abf-bf7aba8aee0a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:46.814247 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bd696ad8-53b4-4965-ac47-1e3cb31e387d tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:46.814746 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bd696ad8-53b4-4965-ac47-1e3cb31e387d tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:46.821491 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bd696ad8-53b4-4965-ac47-1e3cb31e387d tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:46.822692 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bd696ad8-53b4-4965-ac47-1e3cb31e387d tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:46.823420 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bd696ad8-53b4-4965-ac47-1e3cb31e387d tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:46.824203 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bd696ad8-53b4-4965-ac47-1e3cb31e387d tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:47.030323 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-bd696ad8-53b4-4965-ac47-1e3cb31e387d tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.243246 Oct 18 15:36:47.031486 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1443/2779] 10.222.0.60 () {58 vars in 1275 bytes} [Tue Oct 18 15:36:46 2022] GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a/os-interface => generated 285 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:36:47.041736 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bc1ee11b-3526-45a4-b575-dc87a1c7006f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:47.042723 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-bc1ee11b-3526-45a4-b575-dc87a1c7006f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: bbd6e88c-1947-4518-9fd4-c17233679336] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:47.053596 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bc1ee11b-3526-45a4-b575-dc87a1c7006f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:47.055655 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bc1ee11b-3526-45a4-b575-dc87a1c7006f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:47.056425 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bc1ee11b-3526-45a4-b575-dc87a1c7006f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:47.057870 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bc1ee11b-3526-45a4-b575-dc87a1c7006f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:47.059519 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bc1ee11b-3526-45a4-b575-dc87a1c7006f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:47.060170 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bc1ee11b-3526-45a4-b575-dc87a1c7006f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:47.081404 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-bc1ee11b-3526-45a4-b575-dc87a1c7006f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] HTTP exception thrown: Instance bbd6e88c-1947-4518-9fd4-c17233679336 could not be found. Oct 18 15:36:47.083488 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bc1ee11b-3526-45a4-b575-dc87a1c7006f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Request method failure captured: Oct 18 15:36:47.083488 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/bbd6e88c-1947-4518-9fd4-c17233679336 HTTP/1.1 Oct 18 15:36:47.083488 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:36:47.083488 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:36:47.083488 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:36:47.083488 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:36:47.083488 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:36:47.083488 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:36:47.083488 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:36:47.083488 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:36:47.083488 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTseXdqIE6K5VM4s3TEHRLWgMUN4aMRv2NoeIzUdaqo5huhkbfibHS5WTucH_yVgiw-oU86aIdI66etum9zPC1o_Gp8lN1ylUglhXYekmlUb-DCNwOQQTPA7nsDvbxyfFlUPyfZnM9HlX0P4k3Gbrf42L5eihIJ6KOiK__MhWlbfWWoY Oct 18 15:36:47.083488 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:36:47.083488 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:36:47.083488 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:36:47.083488 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:36:47.083488 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:36:47.083488 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:36:47.083488 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 04fd51d598a04ff7a909b3ced951dea8 Oct 18 15:36:47.083488 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-DeleteServersTestJSON-518486720 Oct 18 15:36:47.083488 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:36:47.083488 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:36:47.084792 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:36:47.084792 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-DeleteServersTestJSON-518486720 Oct 18 15:36:47.084792 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 04fd51d598a04ff7a909b3ced951dea8 Oct 18 15:36:47.084792 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-DeleteServersTestJSON-518486720 Oct 18 15:36:47.084792 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-DeleteServersTestJSON-518486720-project Oct 18 15:36:47.084792 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:36:47.084792 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:36:47.084792 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 5309baeeec484df194123d22779b0255 Oct 18 15:36:47.084792 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-DeleteServersTestJSON-518486720-project Oct 18 15:36:47.084792 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:36:47.084792 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance bbd6e88c-1947-4518-9fd4-c17233679336 could not be found. Oct 18 15:36:47.084792 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'bbd6e88c-1947-4518-9fd4-c17233679336'} Oct 18 15:36:47.085762 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:36:47.085762 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:47.085762 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:36:47.085762 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:36:47.085762 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:36:47.085762 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:36:47.085762 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:36:47.085762 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:36:47.085762 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:36:47.085762 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:36:47.085762 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbd6e88c-1947-4518-9fd4-c17233679336 could not be found. Oct 18 15:36:47.085762 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:47.085762 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:47.085762 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:47.085762 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:47.085762 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:36:47.085762 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:36:47.085762 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:36:47.085762 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:36:47.085762 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:36:47.086996 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:36:47.086996 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:36:47.086996 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:36:47.086996 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:36:47.086996 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:36:47.086996 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:36:47.086996 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:36:47.086996 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbd6e88c-1947-4518-9fd4-c17233679336 could not be found. Oct 18 15:36:47.086996 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:47.086996 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:47.086996 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:47.086996 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:47.086996 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:36:47.086996 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:36:47.086996 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:36:47.086996 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:36:47.086996 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbd6e88c-1947-4518-9fd4-c17233679336 could not be found. Oct 18 15:36:47.086996 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:47.090158 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bc1ee11b-3526-45a4-b575-dc87a1c7006f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Returning 404 to user: Instance bbd6e88c-1947-4518-9fd4-c17233679336 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:36:47.091274 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-bc1ee11b-3526-45a4-b575-dc87a1c7006f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/bbd6e88c-1947-4518-9fd4-c17233679336" status: 404 len: 111 microversion: 2.1 time: 0.054476 Oct 18 15:36:47.092368 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1444/2780] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:47 2022] GET /compute/v2.1/servers/bbd6e88c-1947-4518-9fd4-c17233679336 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:36:47.124219 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5c7fd2d2-0b24-47fe-9e11-9404073048b6 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:47.124877 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5c7fd2d2-0b24-47fe-9e11-9404073048b6 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] [instance: 82aba568-875e-459c-8bc9-248b4851fc94] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:47.131784 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e879c201-ef1e-4569-a5e3-d07ccb3a60fa tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:47.138576 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5c7fd2d2-0b24-47fe-9e11-9404073048b6 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:47.141147 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5c7fd2d2-0b24-47fe-9e11-9404073048b6 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:47.141602 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5c7fd2d2-0b24-47fe-9e11-9404073048b6 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:47.142222 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e879c201-ef1e-4569-a5e3-d07ccb3a60fa tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe" status: 200 len: 1472 microversion: 2.1 time: 0.895025 Oct 18 15:36:47.142358 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5c7fd2d2-0b24-47fe-9e11-9404073048b6 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:47.142793 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5c7fd2d2-0b24-47fe-9e11-9404073048b6 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:47.143219 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5c7fd2d2-0b24-47fe-9e11-9404073048b6 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:47.162663 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1337/2781] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:46 2022] GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe => generated 1472 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:47.178436 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-5c7fd2d2-0b24-47fe-9e11-9404073048b6 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] HTTP exception thrown: Instance 82aba568-875e-459c-8bc9-248b4851fc94 could not be found. Oct 18 15:36:47.182148 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5c7fd2d2-0b24-47fe-9e11-9404073048b6 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Request method failure captured: Oct 18 15:36:47.182148 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/82aba568-875e-459c-8bc9-248b4851fc94 HTTP/1.1 Oct 18 15:36:47.182148 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:36:47.182148 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:36:47.182148 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:36:47.182148 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:36:47.182148 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:36:47.182148 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:36:47.182148 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:36:47.182148 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:36:47.182148 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTse7fx2cnRaPoLjX5bcuOlHRsv5T7hjqupUR5Anksomh4sN2LXU4nAUs-nTlixOWx8rLooo7F4iO4MJJqXUn20Cug_7k-y3pRg9Zq_jy4SxiI9MxMze0dh6g1ffY8M4Eh1QOt6Xa2yz2Z8B-7cmZxI0dcYo33xex1kmG4oUGiUJl_0M Oct 18 15:36:47.182148 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:36:47.182148 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:36:47.182148 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:36:47.182148 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:36:47.182148 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:36:47.182148 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:36:47.182148 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 6a52e3135e52493b8ccb2d7342418591 Oct 18 15:36:47.182148 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-SecurityGroupsTestJSON-974652461 Oct 18 15:36:47.182148 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:36:47.182148 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:36:47.183506 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:36:47.183506 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-SecurityGroupsTestJSON-974652461 Oct 18 15:36:47.183506 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 6a52e3135e52493b8ccb2d7342418591 Oct 18 15:36:47.183506 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-974652461 Oct 18 15:36:47.183506 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-SecurityGroupsTestJSON-974652461-project Oct 18 15:36:47.183506 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:36:47.183506 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:36:47.183506 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: ee9a7ce3bb784a79b3ac336743b9ae84 Oct 18 15:36:47.183506 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-SecurityGroupsTestJSON-974652461-project Oct 18 15:36:47.183506 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:36:47.183506 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 82aba568-875e-459c-8bc9-248b4851fc94 could not be found. Oct 18 15:36:47.183506 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '82aba568-875e-459c-8bc9-248b4851fc94'} Oct 18 15:36:47.184211 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:36:47.184211 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:47.184211 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:36:47.184211 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:36:47.184211 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:36:47.184211 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:36:47.184211 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:36:47.184211 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:36:47.184211 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:36:47.184211 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:36:47.184211 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82aba568-875e-459c-8bc9-248b4851fc94 could not be found. Oct 18 15:36:47.184211 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:47.184211 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:47.184211 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:47.184211 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:47.184211 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:36:47.184211 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:36:47.184211 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:36:47.184211 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:36:47.184211 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:36:47.185367 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:36:47.185367 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:36:47.185367 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:36:47.185367 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:36:47.185367 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:36:47.185367 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:36:47.185367 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:36:47.185367 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82aba568-875e-459c-8bc9-248b4851fc94 could not be found. Oct 18 15:36:47.185367 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:47.185367 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:47.185367 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:47.185367 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:47.185367 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:36:47.185367 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:36:47.185367 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:36:47.185367 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:36:47.185367 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82aba568-875e-459c-8bc9-248b4851fc94 could not be found. Oct 18 15:36:47.185367 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:47.186408 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5c7fd2d2-0b24-47fe-9e11-9404073048b6 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Returning 404 to user: Instance 82aba568-875e-459c-8bc9-248b4851fc94 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:36:47.186408 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5c7fd2d2-0b24-47fe-9e11-9404073048b6 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "GET /compute/v2.1/servers/82aba568-875e-459c-8bc9-248b4851fc94" status: 404 len: 111 microversion: 2.1 time: 0.063590 Oct 18 15:36:47.186408 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1445/2782] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:47 2022] GET /compute/v2.1/servers/82aba568-875e-459c-8bc9-248b4851fc94 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 15:36:47.192960 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6e80a8c4-e298-4ed9-83f7-fd43236ddecc tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '.version_select at 0x7f7c3c70ff70>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:47.227405 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bf8b0ce9-963b-439e-9b20-820a88eb7ad6 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1156072602", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "670a85ee-2ce6-476a-bad3-558d8003ee5a"}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:36:47.333458 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-bf8b0ce9-963b-439e-9b20-820a88eb7ad6 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] validate_networks() for [('670a85ee-2ce6-476a-bad3-558d8003ee5a', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:36:47.943254 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6e80a8c4-e298-4ed9-83f7-fd43236ddecc tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/0de7ce2b-ca31-4eec-a602-4fa13c85be0b" status: 202 len: 0 microversion: 2.1 time: 0.753451 Oct 18 15:36:47.944859 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1338/2783] 10.222.0.60 () {58 vars in 1272 bytes} [Tue Oct 18 15:36:47 2022] DELETE /compute/v2.1/os-security-groups/0de7ce2b-ca31-4eec-a602-4fa13c85be0b => generated 0 bytes in 756 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:36:47.952851 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-560376b6-8e26-481c-8194-f6db201b6126 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:47.970391 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-560376b6-8e26-481c-8194-f6db201b6126 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] [instance: 63a69f32-61bc-41d2-a358-636ae638f654] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:47.993220 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-560376b6-8e26-481c-8194-f6db201b6126 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:47.994049 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-560376b6-8e26-481c-8194-f6db201b6126 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:47.997569 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-560376b6-8e26-481c-8194-f6db201b6126 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:47.998870 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-560376b6-8e26-481c-8194-f6db201b6126 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:47.999666 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-560376b6-8e26-481c-8194-f6db201b6126 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:48.000948 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-560376b6-8e26-481c-8194-f6db201b6126 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:48.073917 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-560376b6-8e26-481c-8194-f6db201b6126 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:48.074613 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-560376b6-8e26-481c-8194-f6db201b6126 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:48.075291 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-560376b6-8e26-481c-8194-f6db201b6126 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:48.075913 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-560376b6-8e26-481c-8194-f6db201b6126 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lazy-loading 'fault' on Instance uuid 63a69f32-61bc-41d2-a358-636ae638f654 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:36:48.184522 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-560376b6-8e26-481c-8194-f6db201b6126 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bc878a0901409684ea58261475b1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88812dd7c80d47bba192382fccc31e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:48.199712 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-560376b6-8e26-481c-8194-f6db201b6126 tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] 10.222.0.60 "GET /compute/v2.1/servers/63a69f32-61bc-41d2-a358-636ae638f654" status: 200 len: 1358 microversion: 2.1 time: 0.251466 Oct 18 15:36:48.204692 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1339/2784] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:47 2022] GET /compute/v2.1/servers/63a69f32-61bc-41d2-a358-636ae638f654 => generated 1358 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:48.220351 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a5563c9f-24e4-4c5c-bbfc-17c3394a4c8e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:48.221423 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a5563c9f-24e4-4c5c-bbfc-17c3394a4c8e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:48.236770 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5563c9f-24e4-4c5c-bbfc-17c3394a4c8e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:48.237477 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5563c9f-24e4-4c5c-bbfc-17c3394a4c8e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:48.238803 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5563c9f-24e4-4c5c-bbfc-17c3394a4c8e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:48.238803 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5563c9f-24e4-4c5c-bbfc-17c3394a4c8e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:48.239380 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5563c9f-24e4-4c5c-bbfc-17c3394a4c8e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:48.239914 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5563c9f-24e4-4c5c-bbfc-17c3394a4c8e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:48.705263 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a5563c9f-24e4-4c5c-bbfc-17c3394a4c8e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:48.731671 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a5563c9f-24e4-4c5c-bbfc-17c3394a4c8e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c" status: 200 len: 1472 microversion: 2.1 time: 0.523131 Oct 18 15:36:48.736065 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1340/2785] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:48 2022] GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c => generated 1472 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:48.745975 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bd8b8e77-a829-4df2-a61d-32f1c88eb541 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '.version_select at 0x7f7c3c70f280>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:48.926059 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-bf8b0ce9-963b-439e-9b20-820a88eb7ad6 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:36:48.926722 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-bf8b0ce9-963b-439e-9b20-820a88eb7ad6 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:36:48.927543 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-bf8b0ce9-963b-439e-9b20-820a88eb7ad6 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:36:48.928218 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-bf8b0ce9-963b-439e-9b20-820a88eb7ad6 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:36:48.929019 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-bf8b0ce9-963b-439e-9b20-820a88eb7ad6 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:36:48.942080 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bf8b0ce9-963b-439e-9b20-820a88eb7ad6 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:48.942915 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bf8b0ce9-963b-439e-9b20-820a88eb7ad6 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:48.943635 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bf8b0ce9-963b-439e-9b20-820a88eb7ad6 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:48.944573 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bf8b0ce9-963b-439e-9b20-820a88eb7ad6 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:48.945684 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bf8b0ce9-963b-439e-9b20-820a88eb7ad6 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:48.946464 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bf8b0ce9-963b-439e-9b20-820a88eb7ad6 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:48.968068 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-bf8b0ce9-963b-439e-9b20-820a88eb7ad6 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Getting quotas for project 04fd51d598a04ff7a909b3ced951dea8. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:36:48.973778 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-bf8b0ce9-963b-439e-9b20-820a88eb7ad6 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Getting quotas for user 5309baeeec484df194123d22779b0255 and project 04fd51d598a04ff7a909b3ced951dea8. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:36:48.988210 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-bf8b0ce9-963b-439e-9b20-820a88eb7ad6 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:36:48.991009 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-bf8b0ce9-963b-439e-9b20-820a88eb7ad6 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:36:49.048087 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-bf8b0ce9-963b-439e-9b20-820a88eb7ad6 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.825311 Oct 18 15:36:49.049549 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1446/2786] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:36:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1827 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 15:36:49.060927 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0300660c-1a14-4651-9eed-428dbbd25523 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:49.062023 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0300660c-1a14-4651-9eed-428dbbd25523 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 1c84f8ca-befc-489e-8068-135af3b766fe] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:49.070998 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0300660c-1a14-4651-9eed-428dbbd25523 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:49.071674 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0300660c-1a14-4651-9eed-428dbbd25523 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:49.073309 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0300660c-1a14-4651-9eed-428dbbd25523 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:49.074243 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0300660c-1a14-4651-9eed-428dbbd25523 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:49.075013 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0300660c-1a14-4651-9eed-428dbbd25523 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:49.075621 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0300660c-1a14-4651-9eed-428dbbd25523 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:49.335000 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bd8b8e77-a829-4df2-a61d-32f1c88eb541 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/be0ba8d0-373d-467b-91ba-f0c98e674b71" status: 202 len: 0 microversion: 2.1 time: 0.597719 Oct 18 15:36:49.337209 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1341/2787] 10.222.0.60 () {58 vars in 1272 bytes} [Tue Oct 18 15:36:48 2022] DELETE /compute/v2.1/os-security-groups/be0ba8d0-373d-467b-91ba-f0c98e674b71 => generated 0 bytes in 600 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:36:49.354072 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-1d9dc332-5f5b-411e-9b5d-7d9e7f096b49 req-ff2be39f-a800-4ad1-8df6-b03d7ccff259 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbd6e88c-1947-4518-9fd4-c17233679336", "name": "network-vif-deleted", "tag": "a4c92f1c-481f-4b18-af7a-d3f75d772a28"}, {"server_uuid": "63a69f32-61bc-41d2-a358-636ae638f654", "name": "network-vif-deleted", "tag": "a646ae7c-f2fc-4861-89ce-5b219e36816a"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:36:49.372646 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1d9dc332-5f5b-411e-9b5d-7d9e7f096b49 req-ff2be39f-a800-4ad1-8df6-b03d7ccff259 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:49.373602 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1d9dc332-5f5b-411e-9b5d-7d9e7f096b49 req-ff2be39f-a800-4ad1-8df6-b03d7ccff259 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:49.374492 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1d9dc332-5f5b-411e-9b5d-7d9e7f096b49 req-ff2be39f-a800-4ad1-8df6-b03d7ccff259 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:49.390326 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-1d9dc332-5f5b-411e-9b5d-7d9e7f096b49 req-ff2be39f-a800-4ad1-8df6-b03d7ccff259 service nova] Creating event network-vif-deleted:a4c92f1c-481f-4b18-af7a-d3f75d772a28 for instance bbd6e88c-1947-4518-9fd4-c17233679336 on n-h2-853682-5 Oct 18 15:36:49.391096 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-1d9dc332-5f5b-411e-9b5d-7d9e7f096b49 req-ff2be39f-a800-4ad1-8df6-b03d7ccff259 service nova] Creating event network-vif-deleted:a646ae7c-f2fc-4861-89ce-5b219e36816a for instance 63a69f32-61bc-41d2-a358-636ae638f654 on n-h2-853682-5 Oct 18 15:36:49.400890 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-1d9dc332-5f5b-411e-9b5d-7d9e7f096b49 req-ff2be39f-a800-4ad1-8df6-b03d7ccff259 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.059991 Oct 18 15:36:49.402053 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1342/2788] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:36:49.412140 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bb1112dc-4b5d-4218-b128-300068adbf38 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:49.414641 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bb1112dc-4b5d-4218-b128-300068adbf38 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:49.417959 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0300660c-1a14-4651-9eed-428dbbd25523 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:49.434523 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0300660c-1a14-4651-9eed-428dbbd25523 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe" status: 200 len: 1469 microversion: 2.1 time: 0.382591 Oct 18 15:36:49.437420 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1447/2789] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:49 2022] GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe => generated 1469 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:49.443229 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f2ac32bc-1564-40cc-a14f-55a1f07109eb tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:49.444390 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f2ac32bc-1564-40cc-a14f-55a1f07109eb tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] [instance: 63a69f32-61bc-41d2-a358-636ae638f654] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:49.452480 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f2ac32bc-1564-40cc-a14f-55a1f07109eb tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:49.453620 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f2ac32bc-1564-40cc-a14f-55a1f07109eb tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:49.455595 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f2ac32bc-1564-40cc-a14f-55a1f07109eb tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:49.456553 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f2ac32bc-1564-40cc-a14f-55a1f07109eb tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:49.457232 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f2ac32bc-1564-40cc-a14f-55a1f07109eb tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:49.457677 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f2ac32bc-1564-40cc-a14f-55a1f07109eb tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:49.473959 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-f2ac32bc-1564-40cc-a14f-55a1f07109eb tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] HTTP exception thrown: Instance 63a69f32-61bc-41d2-a358-636ae638f654 could not be found. Oct 18 15:36:49.477031 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f2ac32bc-1564-40cc-a14f-55a1f07109eb tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Request method failure captured: Oct 18 15:36:49.477031 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/63a69f32-61bc-41d2-a358-636ae638f654 HTTP/1.1 Oct 18 15:36:49.477031 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:36:49.477031 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:36:49.477031 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:36:49.477031 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:36:49.477031 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:36:49.477031 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:36:49.477031 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:36:49.477031 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:36:49.477031 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsfFVpdWLycI2s9Aa0UnAMilNyz61aEB-y15J3ZI033MxgoMQjJg9gNvk4vC450fxHiHqr4OWmasMRgdWIgJjswisZ6I9pvrGoKq0qumaxrWMNq6f_-ntBtRVpgPzt6it8gnqCYNggMxgQyxXSsgJDQMTf79ENQOqpehNokrPtcfIqo Oct 18 15:36:49.477031 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:36:49.477031 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:36:49.477031 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:36:49.477031 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:36:49.477031 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:36:49.477031 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:36:49.477031 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 88812dd7c80d47bba192382fccc31e64 Oct 18 15:36:49.477031 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServersTestJSON-786679057 Oct 18 15:36:49.477031 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:36:49.477031 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:36:49.478313 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/88812dd7c80d47bba192382fccc31e64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/88812dd7c80d47bba192382fccc31e64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/88812dd7c80d47bba192382fccc31e64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_88812dd7c80d47bba192382fccc31e64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:36:49.478313 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServersTestJSON-786679057 Oct 18 15:36:49.478313 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 88812dd7c80d47bba192382fccc31e64 Oct 18 15:36:49.478313 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServersTestJSON-786679057 Oct 18 15:36:49.478313 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServersTestJSON-786679057-project Oct 18 15:36:49.478313 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:36:49.478313 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:36:49.478313 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 01bc878a0901409684ea58261475b1bc Oct 18 15:36:49.478313 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServersTestJSON-786679057-project Oct 18 15:36:49.478313 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:36:49.478313 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 63a69f32-61bc-41d2-a358-636ae638f654 could not be found. Oct 18 15:36:49.478313 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '63a69f32-61bc-41d2-a358-636ae638f654'} Oct 18 15:36:49.479028 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:36:49.479028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:49.479028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:36:49.479028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:36:49.479028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:36:49.479028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:36:49.479028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:36:49.479028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:36:49.479028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:36:49.479028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:36:49.479028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63a69f32-61bc-41d2-a358-636ae638f654 could not be found. Oct 18 15:36:49.479028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:49.479028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:49.479028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:49.479028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:49.479028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:36:49.479028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:36:49.479028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:36:49.479028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:36:49.479028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:36:49.480189 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:36:49.480189 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:36:49.480189 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:36:49.480189 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:36:49.480189 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:36:49.480189 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:36:49.480189 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:36:49.480189 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63a69f32-61bc-41d2-a358-636ae638f654 could not be found. Oct 18 15:36:49.480189 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:49.480189 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:49.480189 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:49.480189 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:49.480189 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:36:49.480189 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:36:49.480189 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:36:49.480189 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:36:49.480189 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63a69f32-61bc-41d2-a358-636ae638f654 could not be found. Oct 18 15:36:49.480189 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:49.482989 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f2ac32bc-1564-40cc-a14f-55a1f07109eb tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Returning 404 to user: Instance 63a69f32-61bc-41d2-a358-636ae638f654 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:36:49.482989 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f2ac32bc-1564-40cc-a14f-55a1f07109eb tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] 10.222.0.60 "GET /compute/v2.1/servers/63a69f32-61bc-41d2-a358-636ae638f654" status: 404 len: 111 microversion: 2.1 time: 0.039452 Oct 18 15:36:49.482989 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1448/2790] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:49 2022] GET /compute/v2.1/servers/63a69f32-61bc-41d2-a358-636ae638f654 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:36:49.487053 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c448c7c6-b9ca-4c4c-8b3d-c4f4e4ef4bb4 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Action: 'create', calling method: .version_select at 0x7f7c415ccca0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1912149746", "description": "tempest-description-2055319768"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:36:49.533863 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bb1112dc-4b5d-4218-b128-300068adbf38 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:49.543793 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bb1112dc-4b5d-4218-b128-300068adbf38 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca" status: 200 len: 1215 microversion: 2.1 time: 0.139869 Oct 18 15:36:49.557119 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1343/2791] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:49 2022] GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca => generated 1215 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:49.563315 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8ae83ae6-8052-4872-a141-febfb625a6c4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:36:49.564054 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8ae83ae6-8052-4872-a141-febfb625a6c4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 1c84f8ca-befc-489e-8068-135af3b766fe] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:49.571547 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ae83ae6-8052-4872-a141-febfb625a6c4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:49.572170 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ae83ae6-8052-4872-a141-febfb625a6c4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:49.572914 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ae83ae6-8052-4872-a141-febfb625a6c4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:49.573769 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ae83ae6-8052-4872-a141-febfb625a6c4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:49.574738 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ae83ae6-8052-4872-a141-febfb625a6c4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:49.575352 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ae83ae6-8052-4872-a141-febfb625a6c4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:49.655491 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8ae83ae6-8052-4872-a141-febfb625a6c4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "POST /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe/action" status: 204 len: 0 microversion: 2.1 time: 0.098669 Oct 18 15:36:49.656831 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1344/2792] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:36:49 2022] POST /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe/action => generated 0 bytes in 101 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:36:49.680849 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1a02a23e-16f9-4403-8b73-cebad63cfadf tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] Calling method '.version_select at 0x7f7c415c8790>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:49.715840 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1a02a23e-16f9-4403-8b73-cebad63cfadf tempest-ServersTestJSON-786679057 tempest-ServersTestJSON-786679057-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-116914274" status: 202 len: 0 microversion: 2.1 time: 0.057365 Oct 18 15:36:49.716942 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1345/2793] 10.222.0.60 () {58 vars in 1218 bytes} [Tue Oct 18 15:36:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-116914274 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:36:49.729972 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bb632d77-ffe1-4435-a717-321a287bfeb5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:49.732347 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bb632d77-ffe1-4435-a717-321a287bfeb5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 1c84f8ca-befc-489e-8068-135af3b766fe] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:49.751524 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb632d77-ffe1-4435-a717-321a287bfeb5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:49.752135 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb632d77-ffe1-4435-a717-321a287bfeb5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:49.752791 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb632d77-ffe1-4435-a717-321a287bfeb5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:49.753569 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb632d77-ffe1-4435-a717-321a287bfeb5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:49.754014 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb632d77-ffe1-4435-a717-321a287bfeb5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:49.754450 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb632d77-ffe1-4435-a717-321a287bfeb5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:50.389868 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c448c7c6-b9ca-4c4c-8b3d-c4f4e4ef4bb4 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.906196 Oct 18 15:36:50.391943 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1449/2794] 10.222.0.60 () {60 vars in 1180 bytes} [Tue Oct 18 15:36:49 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:36:50.407266 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a6c34a9c-76ca-4e81-833f-a0ab1b71e239 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:50.409034 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a6c34a9c-76ca-4e81-833f-a0ab1b71e239 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:50.415257 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bb632d77-ffe1-4435-a717-321a287bfeb5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:50.423236 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bb632d77-ffe1-4435-a717-321a287bfeb5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe" status: 200 len: 1469 microversion: 2.1 time: 0.703094 Oct 18 15:36:50.423815 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1346/2795] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:49 2022] GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe => generated 1469 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:50.444958 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6ea1af6d-5621-4097-8ab5-abd7bc92b5b0 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Action: 'update', calling method: .version_select at 0x7f7c3d824160>, body: {"security_group": {"name": "tempest-sg-hth-141261199", "description": "tempest-description-hth-677475748"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:36:50.450296 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a6c34a9c-76ca-4e81-833f-a0ab1b71e239 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:50.454069 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a6c34a9c-76ca-4e81-833f-a0ab1b71e239 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:50.454943 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a6c34a9c-76ca-4e81-833f-a0ab1b71e239 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:50.459358 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a6c34a9c-76ca-4e81-833f-a0ab1b71e239 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:50.461437 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a6c34a9c-76ca-4e81-833f-a0ab1b71e239 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:50.462097 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a6c34a9c-76ca-4e81-833f-a0ab1b71e239 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:51.172178 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a6c34a9c-76ca-4e81-833f-a0ab1b71e239 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:51.186739 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a6c34a9c-76ca-4e81-833f-a0ab1b71e239 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c" status: 200 len: 1472 microversion: 2.1 time: 0.792694 Oct 18 15:36:51.187943 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1450/2796] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:50 2022] GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c => generated 1472 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:51.194607 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9ed0834b-eacc-46ad-8ab9-6525a19ae14b tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:51.196468 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9ed0834b-eacc-46ad-8ab9-6525a19ae14b tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:51.207947 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9ed0834b-eacc-46ad-8ab9-6525a19ae14b tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:51.208691 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9ed0834b-eacc-46ad-8ab9-6525a19ae14b tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:51.210050 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9ed0834b-eacc-46ad-8ab9-6525a19ae14b tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:51.212225 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9ed0834b-eacc-46ad-8ab9-6525a19ae14b tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:51.213096 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9ed0834b-eacc-46ad-8ab9-6525a19ae14b tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:51.213686 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9ed0834b-eacc-46ad-8ab9-6525a19ae14b tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:51.413667 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6ea1af6d-5621-4097-8ab5-abd7bc92b5b0 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "PUT /compute/v2.1/os-security-groups/794a2bc5-afcd-4ed3-b632-e94cded119c4" status: 200 len: 216 microversion: 2.1 time: 0.985619 Oct 18 15:36:51.415997 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1347/2797] 10.222.0.60 () {60 vars in 1290 bytes} [Tue Oct 18 15:36:50 2022] PUT /compute/v2.1/os-security-groups/794a2bc5-afcd-4ed3-b632-e94cded119c4 => generated 216 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:36:51.429972 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-1500c93b-fb97-42ab-a3d7-f26b84ebef97 req-f7002264-6f84-4a12-8624-3dac8a21f042 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52d725f3-b4da-4831-9abf-bf7aba8aee0a", "tag": "3876fb57-0e44-4236-b433-c1842e0940ff"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:36:51.443301 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9ed0834b-eacc-46ad-8ab9-6525a19ae14b tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:51.455216 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1500c93b-fb97-42ab-a3d7-f26b84ebef97 req-f7002264-6f84-4a12-8624-3dac8a21f042 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:51.455688 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1500c93b-fb97-42ab-a3d7-f26b84ebef97 req-f7002264-6f84-4a12-8624-3dac8a21f042 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:51.468898 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9ed0834b-eacc-46ad-8ab9-6525a19ae14b tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca" status: 200 len: 1273 microversion: 2.1 time: 0.279582 Oct 18 15:36:51.469808 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1500c93b-fb97-42ab-a3d7-f26b84ebef97 req-f7002264-6f84-4a12-8624-3dac8a21f042 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:51.474779 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1451/2798] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:51 2022] GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca => generated 1273 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:51.483557 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-1500c93b-fb97-42ab-a3d7-f26b84ebef97 req-f7002264-6f84-4a12-8624-3dac8a21f042 service nova] Creating event network-changed:3876fb57-0e44-4236-b433-c1842e0940ff for instance 52d725f3-b4da-4831-9abf-bf7aba8aee0a on n-h1-853682-5 Oct 18 15:36:51.489995 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-1500c93b-fb97-42ab-a3d7-f26b84ebef97 req-f7002264-6f84-4a12-8624-3dac8a21f042 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069297 Oct 18 15:36:51.491250 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1348/2799] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:36:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:36:51.497905 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c9bb09ca-7102-400e-8fcc-fdb5ca7b99f1 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:51.498723 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c9bb09ca-7102-400e-8fcc-fdb5ca7b99f1 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 1c84f8ca-befc-489e-8068-135af3b766fe] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:51.502015 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f326c0b4-0b79-4017-9223-1a45d23e0511 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '.version_select at 0x7f7c4160e820>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:51.505881 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9bb09ca-7102-400e-8fcc-fdb5ca7b99f1 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:51.506478 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9bb09ca-7102-400e-8fcc-fdb5ca7b99f1 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:51.507008 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9bb09ca-7102-400e-8fcc-fdb5ca7b99f1 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:51.508337 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9bb09ca-7102-400e-8fcc-fdb5ca7b99f1 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:51.508946 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9bb09ca-7102-400e-8fcc-fdb5ca7b99f1 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:51.511479 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9bb09ca-7102-400e-8fcc-fdb5ca7b99f1 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:51.997820 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f326c0b4-0b79-4017-9223-1a45d23e0511 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups/794a2bc5-afcd-4ed3-b632-e94cded119c4" status: 200 len: 216 microversion: 2.1 time: 0.521509 Oct 18 15:36:52.009997 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1452/2800] 10.222.0.60 () {58 vars in 1269 bytes} [Tue Oct 18 15:36:51 2022] GET /compute/v2.1/os-security-groups/794a2bc5-afcd-4ed3-b632-e94cded119c4 => generated 216 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:36:52.016196 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-89fe27cf-3321-49db-88b2-9bce5a2bafb4 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '.version_select at 0x7f7c415ccd30>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:52.026666 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c9bb09ca-7102-400e-8fcc-fdb5ca7b99f1 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:52.037903 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c9bb09ca-7102-400e-8fcc-fdb5ca7b99f1 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe" status: 200 len: 1469 microversion: 2.1 time: 0.544430 Oct 18 15:36:52.040939 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1349/2801] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:51 2022] GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe => generated 1469 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:52.209807 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ad36297a-f97d-4434-ac79-c4f6a00e985e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:52.210423 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ad36297a-f97d-4434-ac79-c4f6a00e985e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:52.216759 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad36297a-f97d-4434-ac79-c4f6a00e985e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:52.217285 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad36297a-f97d-4434-ac79-c4f6a00e985e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:52.217806 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad36297a-f97d-4434-ac79-c4f6a00e985e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:52.218531 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad36297a-f97d-4434-ac79-c4f6a00e985e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:52.219168 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad36297a-f97d-4434-ac79-c4f6a00e985e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:52.220114 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad36297a-f97d-4434-ac79-c4f6a00e985e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:52.671770 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ad36297a-f97d-4434-ac79-c4f6a00e985e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:52.693141 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:36:52.702499 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ad36297a-f97d-4434-ac79-c4f6a00e985e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c" status: 200 len: 1472 microversion: 2.1 time: 0.496685 Oct 18 15:36:52.703080 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1350/2802] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:52 2022] GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c => generated 1472 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:36:52.709717 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6f866d77-d54e-4f96-a778-6296cceb96a8 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:52.710678 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6f866d77-d54e-4f96-a778-6296cceb96a8 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:52.718738 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f866d77-d54e-4f96-a778-6296cceb96a8 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:52.719592 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f866d77-d54e-4f96-a778-6296cceb96a8 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:52.720161 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f866d77-d54e-4f96-a778-6296cceb96a8 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:52.720993 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f866d77-d54e-4f96-a778-6296cceb96a8 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:52.721708 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f866d77-d54e-4f96-a778-6296cceb96a8 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:52.722233 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f866d77-d54e-4f96-a778-6296cceb96a8 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:52.866645 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6f866d77-d54e-4f96-a778-6296cceb96a8 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:52.888319 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6f866d77-d54e-4f96-a778-6296cceb96a8 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca" status: 200 len: 1273 microversion: 2.1 time: 0.183922 Oct 18 15:36:52.889551 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1351/2803] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:52 2022] GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca => generated 1273 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:52.900294 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-e1f6aef0-796d-4ada-a3d2-c1df3e7ccf40 req-fc58ec13-5812-4d09-ba58-f2f68ab7ae76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c84f8ca-befc-489e-8068-135af3b766fe", "name": "network-vif-plugged", "status": "completed", "tag": "a6a64478-83ca-4d2d-9c94-d78e137f6782"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:36:52.914888 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e1f6aef0-796d-4ada-a3d2-c1df3e7ccf40 req-fc58ec13-5812-4d09-ba58-f2f68ab7ae76 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:52.915579 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e1f6aef0-796d-4ada-a3d2-c1df3e7ccf40 req-fc58ec13-5812-4d09-ba58-f2f68ab7ae76 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:52.916211 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e1f6aef0-796d-4ada-a3d2-c1df3e7ccf40 req-fc58ec13-5812-4d09-ba58-f2f68ab7ae76 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:52.930687 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-e1f6aef0-796d-4ada-a3d2-c1df3e7ccf40 req-fc58ec13-5812-4d09-ba58-f2f68ab7ae76 service nova] Creating event network-vif-plugged:a6a64478-83ca-4d2d-9c94-d78e137f6782 for instance 1c84f8ca-befc-489e-8068-135af3b766fe on n-h2-853682-5 Oct 18 15:36:52.936847 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-e1f6aef0-796d-4ada-a3d2-c1df3e7ccf40 req-fc58ec13-5812-4d09-ba58-f2f68ab7ae76 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045186 Oct 18 15:36:52.938201 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1352/2804] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:36:52.963865 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-89fe27cf-3321-49db-88b2-9bce5a2bafb4 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/794a2bc5-afcd-4ed3-b632-e94cded119c4" status: 202 len: 0 microversion: 2.1 time: 0.951508 Oct 18 15:36:52.969500 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1453/2805] 10.222.0.60 () {58 vars in 1272 bytes} [Tue Oct 18 15:36:52 2022] DELETE /compute/v2.1/os-security-groups/794a2bc5-afcd-4ed3-b632-e94cded119c4 => generated 0 bytes in 953 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:36:52.981216 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4b1a6eff-d143-4dbd-b148-99db0496d5dd tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:52.982765 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4b1a6eff-d143-4dbd-b148-99db0496d5dd tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] [instance: 82aba568-875e-459c-8bc9-248b4851fc94] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:52.991702 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b1a6eff-d143-4dbd-b148-99db0496d5dd tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:52.993640 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b1a6eff-d143-4dbd-b148-99db0496d5dd tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:52.996293 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b1a6eff-d143-4dbd-b148-99db0496d5dd tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:52.998534 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b1a6eff-d143-4dbd-b148-99db0496d5dd tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:52.999346 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b1a6eff-d143-4dbd-b148-99db0496d5dd tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:53.000005 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b1a6eff-d143-4dbd-b148-99db0496d5dd tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:53.024098 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-4b1a6eff-d143-4dbd-b148-99db0496d5dd tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] HTTP exception thrown: Instance 82aba568-875e-459c-8bc9-248b4851fc94 could not be found. Oct 18 15:36:53.026432 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4b1a6eff-d143-4dbd-b148-99db0496d5dd tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Request method failure captured: Oct 18 15:36:53.026432 n-d-853682-5 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/82aba568-875e-459c-8bc9-248b4851fc94 HTTP/1.1 Oct 18 15:36:53.026432 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:36:53.026432 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:36:53.026432 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:36:53.026432 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:36:53.026432 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:36:53.026432 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:36:53.026432 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:36:53.026432 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:36:53.026432 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTse7fx2cnRaPoLjX5bcuOlHRsv5T7hjqupUR5Anksomh4sN2LXU4nAUs-nTlixOWx8rLooo7F4iO4MJJqXUn20Cug_7k-y3pRg9Zq_jy4SxiI9MxMze0dh6g1ffY8M4Eh1QOt6Xa2yz2Z8B-7cmZxI0dcYo33xex1kmG4oUGiUJl_0M Oct 18 15:36:53.026432 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:36:53.026432 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:36:53.026432 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:36:53.026432 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:36:53.026432 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:36:53.026432 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:36:53.026432 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 6a52e3135e52493b8ccb2d7342418591 Oct 18 15:36:53.026432 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-SecurityGroupsTestJSON-974652461 Oct 18 15:36:53.026432 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:36:53.026432 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:36:53.027724 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:36:53.027724 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-SecurityGroupsTestJSON-974652461 Oct 18 15:36:53.027724 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 6a52e3135e52493b8ccb2d7342418591 Oct 18 15:36:53.027724 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-974652461 Oct 18 15:36:53.027724 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-SecurityGroupsTestJSON-974652461-project Oct 18 15:36:53.027724 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:36:53.027724 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:36:53.027724 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: ee9a7ce3bb784a79b3ac336743b9ae84 Oct 18 15:36:53.027724 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-SecurityGroupsTestJSON-974652461-project Oct 18 15:36:53.027724 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:36:53.027724 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 82aba568-875e-459c-8bc9-248b4851fc94 could not be found. Oct 18 15:36:53.027724 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '82aba568-875e-459c-8bc9-248b4851fc94'} Oct 18 15:36:53.028722 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:36:53.028722 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:53.028722 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:36:53.028722 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:36:53.028722 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:36:53.028722 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:36:53.028722 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:36:53.028722 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:36:53.028722 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:36:53.028722 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:36:53.028722 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82aba568-875e-459c-8bc9-248b4851fc94 could not be found. Oct 18 15:36:53.028722 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:53.028722 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:53.028722 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:53.028722 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:53.028722 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:36:53.028722 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:36:53.028722 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:36:53.028722 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:36:53.028722 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:36:53.029925 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:36:53.029925 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 15:36:53.029925 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 15:36:53.029925 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 15:36:53.029925 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 15:36:53.029925 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:36:53.029925 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:36:53.029925 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:36:53.029925 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:36:53.029925 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82aba568-875e-459c-8bc9-248b4851fc94 could not be found. Oct 18 15:36:53.029925 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:53.029925 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:53.029925 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:53.029925 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:53.029925 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:36:53.029925 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:36:53.029925 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:36:53.029925 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:36:53.029925 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82aba568-875e-459c-8bc9-248b4851fc94 could not be found. Oct 18 15:36:53.029925 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:36:53.041947 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4b1a6eff-d143-4dbd-b148-99db0496d5dd tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Returning 404 to user: Instance 82aba568-875e-459c-8bc9-248b4851fc94 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:36:53.043203 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4b1a6eff-d143-4dbd-b148-99db0496d5dd tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "DELETE /compute/v2.1/servers/82aba568-875e-459c-8bc9-248b4851fc94" status: 404 len: 111 microversion: 2.1 time: 0.071900 Oct 18 15:36:53.044016 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1353/2806] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:36:52 2022] DELETE /compute/v2.1/servers/82aba568-875e-459c-8bc9-248b4851fc94 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:36:53.054976 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e3802d23-e542-4147-917b-b780770ab165 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:53.055940 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e3802d23-e542-4147-917b-b780770ab165 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] [instance: 82aba568-875e-459c-8bc9-248b4851fc94] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:53.062012 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6ac8c6a4-cc46-4938-83a6-7b6565d6dbf7 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:53.062647 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6ac8c6a4-cc46-4938-83a6-7b6565d6dbf7 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 1c84f8ca-befc-489e-8068-135af3b766fe] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:53.069077 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ac8c6a4-cc46-4938-83a6-7b6565d6dbf7 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:53.069579 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ac8c6a4-cc46-4938-83a6-7b6565d6dbf7 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:53.070541 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ac8c6a4-cc46-4938-83a6-7b6565d6dbf7 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:53.072466 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e3802d23-e542-4147-917b-b780770ab165 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:53.072931 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ac8c6a4-cc46-4938-83a6-7b6565d6dbf7 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:53.073416 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ac8c6a4-cc46-4938-83a6-7b6565d6dbf7 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:53.073754 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e3802d23-e542-4147-917b-b780770ab165 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:53.073887 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ac8c6a4-cc46-4938-83a6-7b6565d6dbf7 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:53.075201 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e3802d23-e542-4147-917b-b780770ab165 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:53.076866 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e3802d23-e542-4147-917b-b780770ab165 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:53.077562 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e3802d23-e542-4147-917b-b780770ab165 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:53.078725 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e3802d23-e542-4147-917b-b780770ab165 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:53.115503 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-e3802d23-e542-4147-917b-b780770ab165 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] HTTP exception thrown: Instance 82aba568-875e-459c-8bc9-248b4851fc94 could not be found. Oct 18 15:36:53.130500 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e3802d23-e542-4147-917b-b780770ab165 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Request method failure captured: Oct 18 15:36:53.130500 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/82aba568-875e-459c-8bc9-248b4851fc94 HTTP/1.1 Oct 18 15:36:53.130500 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:36:53.130500 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:36:53.130500 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:36:53.130500 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:36:53.130500 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:36:53.130500 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:36:53.130500 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:36:53.130500 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:36:53.130500 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTse7fx2cnRaPoLjX5bcuOlHRsv5T7hjqupUR5Anksomh4sN2LXU4nAUs-nTlixOWx8rLooo7F4iO4MJJqXUn20Cug_7k-y3pRg9Zq_jy4SxiI9MxMze0dh6g1ffY8M4Eh1QOt6Xa2yz2Z8B-7cmZxI0dcYo33xex1kmG4oUGiUJl_0M Oct 18 15:36:53.130500 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:36:53.130500 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:36:53.130500 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:36:53.130500 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:36:53.130500 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:36:53.130500 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:36:53.130500 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 6a52e3135e52493b8ccb2d7342418591 Oct 18 15:36:53.130500 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-SecurityGroupsTestJSON-974652461 Oct 18 15:36:53.130500 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:36:53.130500 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:36:53.131790 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:36:53.131790 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-SecurityGroupsTestJSON-974652461 Oct 18 15:36:53.131790 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 6a52e3135e52493b8ccb2d7342418591 Oct 18 15:36:53.131790 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-974652461 Oct 18 15:36:53.131790 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-SecurityGroupsTestJSON-974652461-project Oct 18 15:36:53.131790 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:36:53.131790 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:36:53.131790 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: ee9a7ce3bb784a79b3ac336743b9ae84 Oct 18 15:36:53.131790 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-SecurityGroupsTestJSON-974652461-project Oct 18 15:36:53.131790 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:36:53.131790 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 82aba568-875e-459c-8bc9-248b4851fc94 could not be found. Oct 18 15:36:53.131790 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '82aba568-875e-459c-8bc9-248b4851fc94'} Oct 18 15:36:53.133285 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:36:53.133285 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:53.133285 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:36:53.133285 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:36:53.133285 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:36:53.133285 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:36:53.133285 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:36:53.133285 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:36:53.133285 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:36:53.133285 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:36:53.133285 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82aba568-875e-459c-8bc9-248b4851fc94 could not be found. Oct 18 15:36:53.133285 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:53.133285 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:53.133285 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:53.133285 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:53.133285 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:36:53.133285 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:36:53.133285 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:36:53.133285 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:36:53.133285 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:36:53.134934 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:36:53.134934 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:36:53.134934 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:36:53.134934 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:36:53.134934 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:36:53.134934 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:36:53.134934 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:36:53.134934 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82aba568-875e-459c-8bc9-248b4851fc94 could not be found. Oct 18 15:36:53.134934 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:53.134934 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:53.134934 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:53.134934 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:53.134934 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:36:53.134934 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:36:53.134934 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:36:53.134934 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:36:53.134934 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82aba568-875e-459c-8bc9-248b4851fc94 could not be found. Oct 18 15:36:53.134934 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:53.137283 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e3802d23-e542-4147-917b-b780770ab165 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Returning 404 to user: Instance 82aba568-875e-459c-8bc9-248b4851fc94 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:36:53.137283 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e3802d23-e542-4147-917b-b780770ab165 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "GET /compute/v2.1/servers/82aba568-875e-459c-8bc9-248b4851fc94" status: 404 len: 111 microversion: 2.1 time: 0.083442 Oct 18 15:36:53.137283 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1454/2807] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:53 2022] GET /compute/v2.1/servers/82aba568-875e-459c-8bc9-248b4851fc94 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:36:53.149236 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a89cef78-d5e8-494f-882f-caee4bee4ffc tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '.version_select at 0x7f7c415cc700>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:53.221631 n-d-853682-5 devstack@n-api.service[120405]: DEBUG neutronclient.v2_0.client [None req-a89cef78-d5e8-494f-882f-caee4bee4ffc tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group be0ba8d0-373d-467b-91ba-f0c98e674b71 does not exist", "detail": ""}} {{(pid=120405) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 15:36:53.222438 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.security_group_api [None req-a89cef78-d5e8-494f-882f-caee4bee4ffc tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Neutron security group be0ba8d0-373d-467b-91ba-f0c98e674b71 not found {{(pid=120405) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 18 15:36:53.222966 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-a89cef78-d5e8-494f-882f-caee4bee4ffc tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] HTTP exception thrown: Security group be0ba8d0-373d-467b-91ba-f0c98e674b71 does not exist Oct 18 15:36:53.222966 n-d-853682-5 devstack@n-api.service[120405]: Neutron server returns request_ids: ['req-3ba5e022-eb87-430d-a834-ad6deb673f6d'] Oct 18 15:36:53.225766 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a89cef78-d5e8-494f-882f-caee4bee4ffc tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Request method failure captured: Oct 18 15:36:53.225766 n-d-853682-5 devstack@n-api.service[120405]: request: DELETE /compute/v2.1/os-security-groups/be0ba8d0-373d-467b-91ba-f0c98e674b71 HTTP/1.1 Oct 18 15:36:53.225766 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:36:53.225766 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:36:53.225766 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:36:53.225766 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:36:53.225766 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:36:53.225766 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:36:53.225766 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:36:53.225766 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:36:53.225766 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTse7fx2cnRaPoLjX5bcuOlHRsv5T7hjqupUR5Anksomh4sN2LXU4nAUs-nTlixOWx8rLooo7F4iO4MJJqXUn20Cug_7k-y3pRg9Zq_jy4SxiI9MxMze0dh6g1ffY8M4Eh1QOt6Xa2yz2Z8B-7cmZxI0dcYo33xex1kmG4oUGiUJl_0M Oct 18 15:36:53.225766 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:36:53.225766 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:36:53.225766 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:36:53.225766 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:36:53.225766 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:36:53.225766 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:36:53.225766 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 6a52e3135e52493b8ccb2d7342418591 Oct 18 15:36:53.225766 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-SecurityGroupsTestJSON-974652461 Oct 18 15:36:53.225766 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:36:53.225766 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:36:53.227111 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:36:53.227111 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-SecurityGroupsTestJSON-974652461 Oct 18 15:36:53.227111 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 6a52e3135e52493b8ccb2d7342418591 Oct 18 15:36:53.227111 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-974652461 Oct 18 15:36:53.227111 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-SecurityGroupsTestJSON-974652461-project Oct 18 15:36:53.227111 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:36:53.227111 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:36:53.227111 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: ee9a7ce3bb784a79b3ac336743b9ae84 Oct 18 15:36:53.227111 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-SecurityGroupsTestJSON-974652461-project Oct 18 15:36:53.227111 n-d-853682-5 devstack@n-api.service[120405]: method: Oct 18 15:36:53.227111 n-d-853682-5 devstack@n-api.service[120405]: exception: Security group be0ba8d0-373d-467b-91ba-f0c98e674b71 does not exist Oct 18 15:36:53.227111 n-d-853682-5 devstack@n-api.service[120405]: Neutron server returns request_ids: ['req-3ba5e022-eb87-430d-a834-ad6deb673f6d'] Oct 18 15:36:53.227111 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'be0ba8d0-373d-467b-91ba-f0c98e674b71'} Oct 18 15:36:53.227968 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:36:53.227968 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:53.227968 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 18 15:36:53.227968 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 18 15:36:53.227968 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:53.227968 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:53.227968 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 18 15:36:53.227968 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 18 15:36:53.227968 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:53.227968 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:53.227968 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 15:36:53.227968 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 15:36:53.227968 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:53.227968 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:53.227968 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 15:36:53.227968 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 15:36:53.227968 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:53.227968 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:53.227968 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 15:36:53.229196 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 15:36:53.229196 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:53.229196 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:53.229196 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 15:36:53.229196 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 15:36:53.229196 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 15:36:53.229196 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 15:36:53.229196 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group be0ba8d0-373d-467b-91ba-f0c98e674b71 does not exist Oct 18 15:36:53.229196 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3ba5e022-eb87-430d-a834-ad6deb673f6d'] Oct 18 15:36:53.229196 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:53.229196 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:53.229196 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:53.229196 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:53.229196 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 18 15:36:53.229196 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 18 15:36:53.229196 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 18 15:36:53.229196 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 15:36:53.229196 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group be0ba8d0-373d-467b-91ba-f0c98e674b71 does not exist Oct 18 15:36:53.230350 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3ba5e022-eb87-430d-a834-ad6deb673f6d'] Oct 18 15:36:53.230350 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:53.230350 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:53.230350 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:53.230350 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:53.230350 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:36:53.230350 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:36:53.230350 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:36:53.230350 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:36:53.230350 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:36:53.230350 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:36:53.230350 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:36:53.230350 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:36:53.230350 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 18 15:36:53.230350 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 15:36:53.230350 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group be0ba8d0-373d-467b-91ba-f0c98e674b71 does not exist Oct 18 15:36:53.230350 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3ba5e022-eb87-430d-a834-ad6deb673f6d'] Oct 18 15:36:53.230350 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:53.230350 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:53.230350 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:53.230350 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:53.237213 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:36:53.237213 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:36:53.237213 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:36:53.237213 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:36:53.237213 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group be0ba8d0-373d-467b-91ba-f0c98e674b71 does not exist Oct 18 15:36:53.237213 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3ba5e022-eb87-430d-a834-ad6deb673f6d'] Oct 18 15:36:53.237213 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:53.237213 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a89cef78-d5e8-494f-882f-caee4bee4ffc tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Returning 404 to user: Security group be0ba8d0-373d-467b-91ba-f0c98e674b71 does not exist Oct 18 15:36:53.237213 n-d-853682-5 devstack@n-api.service[120405]: Neutron server returns request_ids: ['req-3ba5e022-eb87-430d-a834-ad6deb673f6d'] {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:36:53.237213 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a89cef78-d5e8-494f-882f-caee4bee4ffc tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/be0ba8d0-373d-467b-91ba-f0c98e674b71" status: 404 len: 194 microversion: 2.1 time: 0.090964 Oct 18 15:36:53.237213 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1455/2808] 10.222.0.60 () {58 vars in 1272 bytes} [Tue Oct 18 15:36:53 2022] DELETE /compute/v2.1/os-security-groups/be0ba8d0-373d-467b-91ba-f0c98e674b71 => generated 194 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:36:53.243149 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9b4e2496-e006-405a-8d36-e2bd4bd35fb1 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '.version_select at 0x7f7c4160eee0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:53.302340 n-d-853682-5 devstack@n-api.service[120405]: DEBUG neutronclient.v2_0.client [None req-9b4e2496-e006-405a-8d36-e2bd4bd35fb1 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0de7ce2b-ca31-4eec-a602-4fa13c85be0b does not exist", "detail": ""}} {{(pid=120405) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 15:36:53.303002 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.security_group_api [None req-9b4e2496-e006-405a-8d36-e2bd4bd35fb1 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Neutron security group 0de7ce2b-ca31-4eec-a602-4fa13c85be0b not found {{(pid=120405) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 18 15:36:53.303582 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-9b4e2496-e006-405a-8d36-e2bd4bd35fb1 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] HTTP exception thrown: Security group 0de7ce2b-ca31-4eec-a602-4fa13c85be0b does not exist Oct 18 15:36:53.303582 n-d-853682-5 devstack@n-api.service[120405]: Neutron server returns request_ids: ['req-7ed92843-974b-4bf3-91f4-e2aa8b9056bf'] Oct 18 15:36:53.306050 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9b4e2496-e006-405a-8d36-e2bd4bd35fb1 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Request method failure captured: Oct 18 15:36:53.306050 n-d-853682-5 devstack@n-api.service[120405]: request: DELETE /compute/v2.1/os-security-groups/0de7ce2b-ca31-4eec-a602-4fa13c85be0b HTTP/1.1 Oct 18 15:36:53.306050 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:36:53.306050 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:36:53.306050 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:36:53.306050 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:36:53.306050 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:36:53.306050 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:36:53.306050 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:36:53.306050 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:36:53.306050 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTse7fx2cnRaPoLjX5bcuOlHRsv5T7hjqupUR5Anksomh4sN2LXU4nAUs-nTlixOWx8rLooo7F4iO4MJJqXUn20Cug_7k-y3pRg9Zq_jy4SxiI9MxMze0dh6g1ffY8M4Eh1QOt6Xa2yz2Z8B-7cmZxI0dcYo33xex1kmG4oUGiUJl_0M Oct 18 15:36:53.306050 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:36:53.306050 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:36:53.306050 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:36:53.306050 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:36:53.306050 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:36:53.306050 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:36:53.306050 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 6a52e3135e52493b8ccb2d7342418591 Oct 18 15:36:53.306050 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-SecurityGroupsTestJSON-974652461 Oct 18 15:36:53.306050 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:36:53.306050 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:36:53.307386 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:36:53.307386 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-SecurityGroupsTestJSON-974652461 Oct 18 15:36:53.307386 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 6a52e3135e52493b8ccb2d7342418591 Oct 18 15:36:53.307386 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-974652461 Oct 18 15:36:53.307386 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-SecurityGroupsTestJSON-974652461-project Oct 18 15:36:53.307386 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:36:53.307386 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:36:53.307386 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: ee9a7ce3bb784a79b3ac336743b9ae84 Oct 18 15:36:53.307386 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-SecurityGroupsTestJSON-974652461-project Oct 18 15:36:53.307386 n-d-853682-5 devstack@n-api.service[120405]: method: Oct 18 15:36:53.307386 n-d-853682-5 devstack@n-api.service[120405]: exception: Security group 0de7ce2b-ca31-4eec-a602-4fa13c85be0b does not exist Oct 18 15:36:53.307386 n-d-853682-5 devstack@n-api.service[120405]: Neutron server returns request_ids: ['req-7ed92843-974b-4bf3-91f4-e2aa8b9056bf'] Oct 18 15:36:53.307386 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '0de7ce2b-ca31-4eec-a602-4fa13c85be0b'} Oct 18 15:36:53.308145 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:36:53.308145 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:53.308145 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 18 15:36:53.308145 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 18 15:36:53.308145 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:53.308145 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:53.308145 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 18 15:36:53.308145 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 18 15:36:53.308145 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:53.308145 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:53.308145 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 15:36:53.308145 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 15:36:53.308145 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:53.308145 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:53.308145 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 15:36:53.308145 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 15:36:53.308145 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:53.308145 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:53.308145 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 15:36:53.309273 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 15:36:53.309273 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:53.309273 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:53.309273 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 15:36:53.309273 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 15:36:53.309273 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 15:36:53.309273 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 15:36:53.309273 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0de7ce2b-ca31-4eec-a602-4fa13c85be0b does not exist Oct 18 15:36:53.309273 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ed92843-974b-4bf3-91f4-e2aa8b9056bf'] Oct 18 15:36:53.309273 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:53.309273 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:53.309273 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:53.309273 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:53.309273 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 18 15:36:53.309273 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 18 15:36:53.309273 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 18 15:36:53.309273 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 15:36:53.309273 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0de7ce2b-ca31-4eec-a602-4fa13c85be0b does not exist Oct 18 15:36:53.310363 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ed92843-974b-4bf3-91f4-e2aa8b9056bf'] Oct 18 15:36:53.310363 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:53.310363 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:53.310363 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:53.310363 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:53.310363 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:36:53.310363 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:36:53.310363 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:36:53.310363 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:36:53.310363 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:36:53.310363 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:36:53.310363 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:36:53.310363 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:36:53.310363 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 18 15:36:53.310363 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 15:36:53.310363 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0de7ce2b-ca31-4eec-a602-4fa13c85be0b does not exist Oct 18 15:36:53.310363 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ed92843-974b-4bf3-91f4-e2aa8b9056bf'] Oct 18 15:36:53.310363 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:53.310363 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:53.310363 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:53.310363 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:53.311614 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:36:53.311614 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:36:53.311614 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:36:53.311614 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:36:53.311614 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0de7ce2b-ca31-4eec-a602-4fa13c85be0b does not exist Oct 18 15:36:53.311614 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ed92843-974b-4bf3-91f4-e2aa8b9056bf'] Oct 18 15:36:53.311614 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:53.311614 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9b4e2496-e006-405a-8d36-e2bd4bd35fb1 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Returning 404 to user: Security group 0de7ce2b-ca31-4eec-a602-4fa13c85be0b does not exist Oct 18 15:36:53.311614 n-d-853682-5 devstack@n-api.service[120405]: Neutron server returns request_ids: ['req-7ed92843-974b-4bf3-91f4-e2aa8b9056bf'] {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:36:53.311614 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9b4e2496-e006-405a-8d36-e2bd4bd35fb1 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/0de7ce2b-ca31-4eec-a602-4fa13c85be0b" status: 404 len: 194 microversion: 2.1 time: 0.071102 Oct 18 15:36:53.311614 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1456/2809] 10.222.0.60 () {58 vars in 1272 bytes} [Tue Oct 18 15:36:53 2022] DELETE /compute/v2.1/os-security-groups/0de7ce2b-ca31-4eec-a602-4fa13c85be0b => generated 194 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:36:53.318282 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f35162ee-d120-44e4-ae32-7c50123b8c5e tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '.version_select at 0x7f7c415cc9d0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:53.401156 n-d-853682-5 devstack@n-api.service[120405]: DEBUG neutronclient.v2_0.client [None req-f35162ee-d120-44e4-ae32-7c50123b8c5e tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4bb02221-240d-45c4-b558-197fffe69ca4 does not exist", "detail": ""}} {{(pid=120405) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 15:36:53.401761 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.security_group_api [None req-f35162ee-d120-44e4-ae32-7c50123b8c5e tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Neutron security group 4bb02221-240d-45c4-b558-197fffe69ca4 not found {{(pid=120405) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 18 15:36:53.402278 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-f35162ee-d120-44e4-ae32-7c50123b8c5e tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] HTTP exception thrown: Security group 4bb02221-240d-45c4-b558-197fffe69ca4 does not exist Oct 18 15:36:53.402278 n-d-853682-5 devstack@n-api.service[120405]: Neutron server returns request_ids: ['req-199deb27-f2d6-4d1b-9972-0899e2e5dad0'] Oct 18 15:36:53.404114 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f35162ee-d120-44e4-ae32-7c50123b8c5e tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Request method failure captured: Oct 18 15:36:53.404114 n-d-853682-5 devstack@n-api.service[120405]: request: DELETE /compute/v2.1/os-security-groups/4bb02221-240d-45c4-b558-197fffe69ca4 HTTP/1.1 Oct 18 15:36:53.404114 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:36:53.404114 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:36:53.404114 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:36:53.404114 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:36:53.404114 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:36:53.404114 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:36:53.404114 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:36:53.404114 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:36:53.404114 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTse7fx2cnRaPoLjX5bcuOlHRsv5T7hjqupUR5Anksomh4sN2LXU4nAUs-nTlixOWx8rLooo7F4iO4MJJqXUn20Cug_7k-y3pRg9Zq_jy4SxiI9MxMze0dh6g1ffY8M4Eh1QOt6Xa2yz2Z8B-7cmZxI0dcYo33xex1kmG4oUGiUJl_0M Oct 18 15:36:53.404114 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:36:53.404114 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:36:53.404114 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:36:53.404114 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:36:53.404114 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:36:53.404114 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:36:53.404114 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 6a52e3135e52493b8ccb2d7342418591 Oct 18 15:36:53.404114 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-SecurityGroupsTestJSON-974652461 Oct 18 15:36:53.404114 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:36:53.404114 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:36:53.405420 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:36:53.405420 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-SecurityGroupsTestJSON-974652461 Oct 18 15:36:53.405420 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 6a52e3135e52493b8ccb2d7342418591 Oct 18 15:36:53.405420 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-974652461 Oct 18 15:36:53.405420 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-SecurityGroupsTestJSON-974652461-project Oct 18 15:36:53.405420 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:36:53.405420 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:36:53.405420 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: ee9a7ce3bb784a79b3ac336743b9ae84 Oct 18 15:36:53.405420 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-SecurityGroupsTestJSON-974652461-project Oct 18 15:36:53.405420 n-d-853682-5 devstack@n-api.service[120405]: method: Oct 18 15:36:53.405420 n-d-853682-5 devstack@n-api.service[120405]: exception: Security group 4bb02221-240d-45c4-b558-197fffe69ca4 does not exist Oct 18 15:36:53.405420 n-d-853682-5 devstack@n-api.service[120405]: Neutron server returns request_ids: ['req-199deb27-f2d6-4d1b-9972-0899e2e5dad0'] Oct 18 15:36:53.405420 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '4bb02221-240d-45c4-b558-197fffe69ca4'} Oct 18 15:36:53.406186 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:36:53.406186 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:53.406186 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 18 15:36:53.406186 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 18 15:36:53.406186 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:53.406186 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:53.406186 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 18 15:36:53.406186 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 18 15:36:53.406186 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:53.406186 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:53.406186 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 15:36:53.406186 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 15:36:53.406186 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:53.406186 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:53.406186 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 15:36:53.406186 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 15:36:53.406186 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:53.406186 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:53.406186 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 15:36:53.411504 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 15:36:53.411504 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:53.411504 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:53.411504 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 15:36:53.411504 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 15:36:53.411504 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 15:36:53.411504 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 15:36:53.411504 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4bb02221-240d-45c4-b558-197fffe69ca4 does not exist Oct 18 15:36:53.411504 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-199deb27-f2d6-4d1b-9972-0899e2e5dad0'] Oct 18 15:36:53.411504 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:53.411504 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:53.411504 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:53.411504 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:53.411504 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 18 15:36:53.411504 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 18 15:36:53.411504 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 18 15:36:53.411504 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 15:36:53.411504 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4bb02221-240d-45c4-b558-197fffe69ca4 does not exist Oct 18 15:36:53.412592 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-199deb27-f2d6-4d1b-9972-0899e2e5dad0'] Oct 18 15:36:53.412592 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:53.412592 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:53.412592 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:53.412592 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:53.412592 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:36:53.412592 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:36:53.412592 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:36:53.412592 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:36:53.412592 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:36:53.412592 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:36:53.412592 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:36:53.412592 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:36:53.412592 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 18 15:36:53.412592 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 15:36:53.412592 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4bb02221-240d-45c4-b558-197fffe69ca4 does not exist Oct 18 15:36:53.412592 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-199deb27-f2d6-4d1b-9972-0899e2e5dad0'] Oct 18 15:36:53.412592 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:53.412592 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:53.412592 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:53.412592 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:53.413828 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:36:53.413828 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:36:53.413828 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:36:53.413828 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:36:53.413828 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4bb02221-240d-45c4-b558-197fffe69ca4 does not exist Oct 18 15:36:53.413828 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-199deb27-f2d6-4d1b-9972-0899e2e5dad0'] Oct 18 15:36:53.413828 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:53.413828 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f35162ee-d120-44e4-ae32-7c50123b8c5e tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Returning 404 to user: Security group 4bb02221-240d-45c4-b558-197fffe69ca4 does not exist Oct 18 15:36:53.413828 n-d-853682-5 devstack@n-api.service[120405]: Neutron server returns request_ids: ['req-199deb27-f2d6-4d1b-9972-0899e2e5dad0'] {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:36:53.413828 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f35162ee-d120-44e4-ae32-7c50123b8c5e tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/4bb02221-240d-45c4-b558-197fffe69ca4" status: 404 len: 194 microversion: 2.1 time: 0.092394 Oct 18 15:36:53.413828 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1457/2810] 10.222.0.60 () {58 vars in 1272 bytes} [Tue Oct 18 15:36:53 2022] DELETE /compute/v2.1/os-security-groups/4bb02221-240d-45c4-b558-197fffe69ca4 => generated 194 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:36:53.417569 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d6c9baec-0e11-4de0-81ca-829ea40a44b2 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '.version_select at 0x7f7c4160e040>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:53.497987 n-d-853682-5 devstack@n-api.service[120405]: DEBUG neutronclient.v2_0.client [None req-d6c9baec-0e11-4de0-81ca-829ea40a44b2 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group abc03c18-25e7-4055-adb7-82ef950c2991 does not exist", "detail": ""}} {{(pid=120405) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 15:36:53.498584 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.security_group_api [None req-d6c9baec-0e11-4de0-81ca-829ea40a44b2 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Neutron security group abc03c18-25e7-4055-adb7-82ef950c2991 not found {{(pid=120405) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 18 15:36:53.499274 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-d6c9baec-0e11-4de0-81ca-829ea40a44b2 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] HTTP exception thrown: Security group abc03c18-25e7-4055-adb7-82ef950c2991 does not exist Oct 18 15:36:53.499274 n-d-853682-5 devstack@n-api.service[120405]: Neutron server returns request_ids: ['req-af0270c2-4ca3-4c5e-9a8c-b27b3061f608'] Oct 18 15:36:53.501487 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d6c9baec-0e11-4de0-81ca-829ea40a44b2 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Request method failure captured: Oct 18 15:36:53.501487 n-d-853682-5 devstack@n-api.service[120405]: request: DELETE /compute/v2.1/os-security-groups/abc03c18-25e7-4055-adb7-82ef950c2991 HTTP/1.1 Oct 18 15:36:53.501487 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:36:53.501487 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:36:53.501487 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:36:53.501487 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:36:53.501487 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:36:53.501487 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:36:53.501487 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:36:53.501487 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:36:53.501487 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTse7fx2cnRaPoLjX5bcuOlHRsv5T7hjqupUR5Anksomh4sN2LXU4nAUs-nTlixOWx8rLooo7F4iO4MJJqXUn20Cug_7k-y3pRg9Zq_jy4SxiI9MxMze0dh6g1ffY8M4Eh1QOt6Xa2yz2Z8B-7cmZxI0dcYo33xex1kmG4oUGiUJl_0M Oct 18 15:36:53.501487 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:36:53.501487 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:36:53.501487 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:36:53.501487 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:36:53.501487 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:36:53.501487 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:36:53.501487 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 6a52e3135e52493b8ccb2d7342418591 Oct 18 15:36:53.501487 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-SecurityGroupsTestJSON-974652461 Oct 18 15:36:53.501487 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:36:53.501487 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:36:53.502877 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:36:53.502877 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-SecurityGroupsTestJSON-974652461 Oct 18 15:36:53.502877 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 6a52e3135e52493b8ccb2d7342418591 Oct 18 15:36:53.502877 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-974652461 Oct 18 15:36:53.502877 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-SecurityGroupsTestJSON-974652461-project Oct 18 15:36:53.502877 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:36:53.502877 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:36:53.502877 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: ee9a7ce3bb784a79b3ac336743b9ae84 Oct 18 15:36:53.502877 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-SecurityGroupsTestJSON-974652461-project Oct 18 15:36:53.502877 n-d-853682-5 devstack@n-api.service[120405]: method: Oct 18 15:36:53.502877 n-d-853682-5 devstack@n-api.service[120405]: exception: Security group abc03c18-25e7-4055-adb7-82ef950c2991 does not exist Oct 18 15:36:53.502877 n-d-853682-5 devstack@n-api.service[120405]: Neutron server returns request_ids: ['req-af0270c2-4ca3-4c5e-9a8c-b27b3061f608'] Oct 18 15:36:53.502877 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'abc03c18-25e7-4055-adb7-82ef950c2991'} Oct 18 15:36:53.503707 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:36:53.503707 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:53.503707 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 18 15:36:53.503707 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 18 15:36:53.503707 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:53.503707 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:53.503707 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 18 15:36:53.503707 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 18 15:36:53.503707 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:53.503707 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:53.503707 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 15:36:53.503707 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 15:36:53.503707 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:53.503707 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:53.503707 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 15:36:53.503707 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 15:36:53.503707 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:53.503707 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:53.503707 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 15:36:53.504991 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 15:36:53.504991 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:53.504991 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:53.504991 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 15:36:53.504991 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 15:36:53.504991 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 15:36:53.504991 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 15:36:53.504991 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group abc03c18-25e7-4055-adb7-82ef950c2991 does not exist Oct 18 15:36:53.504991 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-af0270c2-4ca3-4c5e-9a8c-b27b3061f608'] Oct 18 15:36:53.504991 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:53.504991 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:53.504991 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:53.504991 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:53.504991 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 18 15:36:53.504991 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 18 15:36:53.504991 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 18 15:36:53.504991 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 15:36:53.504991 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group abc03c18-25e7-4055-adb7-82ef950c2991 does not exist Oct 18 15:36:53.506050 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-af0270c2-4ca3-4c5e-9a8c-b27b3061f608'] Oct 18 15:36:53.506050 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:53.506050 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:53.506050 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:53.506050 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:53.506050 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:36:53.506050 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:36:53.506050 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:36:53.506050 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:36:53.506050 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:36:53.506050 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:36:53.506050 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:36:53.506050 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:36:53.506050 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 18 15:36:53.506050 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 15:36:53.506050 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group abc03c18-25e7-4055-adb7-82ef950c2991 does not exist Oct 18 15:36:53.506050 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-af0270c2-4ca3-4c5e-9a8c-b27b3061f608'] Oct 18 15:36:53.506050 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:53.506050 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:53.506050 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:53.506050 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:53.510988 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:36:53.510988 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:36:53.510988 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:36:53.510988 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:36:53.510988 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group abc03c18-25e7-4055-adb7-82ef950c2991 does not exist Oct 18 15:36:53.510988 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-af0270c2-4ca3-4c5e-9a8c-b27b3061f608'] Oct 18 15:36:53.510988 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:53.510988 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d6c9baec-0e11-4de0-81ca-829ea40a44b2 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Returning 404 to user: Security group abc03c18-25e7-4055-adb7-82ef950c2991 does not exist Oct 18 15:36:53.510988 n-d-853682-5 devstack@n-api.service[120405]: Neutron server returns request_ids: ['req-af0270c2-4ca3-4c5e-9a8c-b27b3061f608'] {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:36:53.510988 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d6c9baec-0e11-4de0-81ca-829ea40a44b2 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/abc03c18-25e7-4055-adb7-82ef950c2991" status: 404 len: 194 microversion: 2.1 time: 0.092090 Oct 18 15:36:53.510988 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1458/2811] 10.222.0.60 () {58 vars in 1272 bytes} [Tue Oct 18 15:36:53 2022] DELETE /compute/v2.1/os-security-groups/abc03c18-25e7-4055-adb7-82ef950c2991 => generated 194 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:36:53.516799 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6ac8c6a4-cc46-4938-83a6-7b6565d6dbf7 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:53.518154 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-47c276e5-5704-4729-91c7-951cea25d8c2 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '.version_select at 0x7f7c415cc5e0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:53.525760 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6ac8c6a4-cc46-4938-83a6-7b6565d6dbf7 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe" status: 200 len: 1461 microversion: 2.1 time: 0.467014 Oct 18 15:36:53.529117 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1354/2812] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:53 2022] GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe => generated 1461 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:36:53.556762 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cb0ed882-7ff2-42d7-98e9-a007c66d7541 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:53.561333 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cb0ed882-7ff2-42d7-98e9-a007c66d7541 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 1c84f8ca-befc-489e-8068-135af3b766fe] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:53.575426 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb0ed882-7ff2-42d7-98e9-a007c66d7541 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:53.576708 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb0ed882-7ff2-42d7-98e9-a007c66d7541 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:53.577387 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb0ed882-7ff2-42d7-98e9-a007c66d7541 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:53.579152 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb0ed882-7ff2-42d7-98e9-a007c66d7541 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:53.580282 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb0ed882-7ff2-42d7-98e9-a007c66d7541 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:53.581019 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb0ed882-7ff2-42d7-98e9-a007c66d7541 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:53.983152 n-d-853682-5 devstack@n-api.service[120405]: DEBUG neutronclient.v2_0.client [None req-47c276e5-5704-4729-91c7-951cea25d8c2 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4d9c6df7-a5e1-49e6-baaf-7c5de11062d0 does not exist", "detail": ""}} {{(pid=120405) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 15:36:53.987195 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.security_group_api [None req-47c276e5-5704-4729-91c7-951cea25d8c2 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Neutron security group 4d9c6df7-a5e1-49e6-baaf-7c5de11062d0 not found {{(pid=120405) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 18 15:36:53.989112 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-47c276e5-5704-4729-91c7-951cea25d8c2 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] HTTP exception thrown: Security group 4d9c6df7-a5e1-49e6-baaf-7c5de11062d0 does not exist Oct 18 15:36:53.989112 n-d-853682-5 devstack@n-api.service[120405]: Neutron server returns request_ids: ['req-ad94e405-80b5-4c18-9754-71fcb1481526'] Oct 18 15:36:53.994667 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-47c276e5-5704-4729-91c7-951cea25d8c2 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Request method failure captured: Oct 18 15:36:53.994667 n-d-853682-5 devstack@n-api.service[120405]: request: DELETE /compute/v2.1/os-security-groups/4d9c6df7-a5e1-49e6-baaf-7c5de11062d0 HTTP/1.1 Oct 18 15:36:53.994667 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:36:53.994667 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:36:53.994667 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:36:53.994667 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:36:53.994667 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:36:53.994667 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:36:53.994667 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:36:53.994667 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:36:53.994667 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTse7fx2cnRaPoLjX5bcuOlHRsv5T7hjqupUR5Anksomh4sN2LXU4nAUs-nTlixOWx8rLooo7F4iO4MJJqXUn20Cug_7k-y3pRg9Zq_jy4SxiI9MxMze0dh6g1ffY8M4Eh1QOt6Xa2yz2Z8B-7cmZxI0dcYo33xex1kmG4oUGiUJl_0M Oct 18 15:36:53.994667 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:36:53.994667 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:36:53.994667 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:36:53.994667 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:36:53.994667 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:36:53.994667 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:36:53.994667 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 6a52e3135e52493b8ccb2d7342418591 Oct 18 15:36:53.994667 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-SecurityGroupsTestJSON-974652461 Oct 18 15:36:53.994667 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:36:53.994667 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:36:53.996127 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:36:53.996127 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-SecurityGroupsTestJSON-974652461 Oct 18 15:36:53.996127 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 6a52e3135e52493b8ccb2d7342418591 Oct 18 15:36:53.996127 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-974652461 Oct 18 15:36:53.996127 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-SecurityGroupsTestJSON-974652461-project Oct 18 15:36:53.996127 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:36:53.996127 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:36:53.996127 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: ee9a7ce3bb784a79b3ac336743b9ae84 Oct 18 15:36:53.996127 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-SecurityGroupsTestJSON-974652461-project Oct 18 15:36:53.996127 n-d-853682-5 devstack@n-api.service[120405]: method: Oct 18 15:36:53.996127 n-d-853682-5 devstack@n-api.service[120405]: exception: Security group 4d9c6df7-a5e1-49e6-baaf-7c5de11062d0 does not exist Oct 18 15:36:53.996127 n-d-853682-5 devstack@n-api.service[120405]: Neutron server returns request_ids: ['req-ad94e405-80b5-4c18-9754-71fcb1481526'] Oct 18 15:36:53.996127 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '4d9c6df7-a5e1-49e6-baaf-7c5de11062d0'} Oct 18 15:36:53.997212 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:36:53.997212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:53.997212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 18 15:36:53.997212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 18 15:36:53.997212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:53.997212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:53.997212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 18 15:36:53.997212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 18 15:36:53.997212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:53.997212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:53.997212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 15:36:53.997212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 15:36:53.997212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:53.997212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:53.997212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 15:36:53.997212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 15:36:53.997212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:53.997212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:53.997212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 15:36:53.998528 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 15:36:53.998528 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:53.998528 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:53.998528 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 15:36:53.998528 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 15:36:53.998528 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 15:36:53.998528 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 15:36:53.998528 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4d9c6df7-a5e1-49e6-baaf-7c5de11062d0 does not exist Oct 18 15:36:53.998528 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ad94e405-80b5-4c18-9754-71fcb1481526'] Oct 18 15:36:53.998528 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:53.998528 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:53.998528 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:53.998528 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:53.998528 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 18 15:36:53.998528 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 18 15:36:53.998528 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 18 15:36:53.998528 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 15:36:53.998528 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4d9c6df7-a5e1-49e6-baaf-7c5de11062d0 does not exist Oct 18 15:36:53.999766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ad94e405-80b5-4c18-9754-71fcb1481526'] Oct 18 15:36:53.999766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:53.999766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:53.999766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:53.999766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:53.999766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:36:53.999766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:36:53.999766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:36:53.999766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:36:53.999766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:36:53.999766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:36:53.999766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:36:53.999766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:36:53.999766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 18 15:36:53.999766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 15:36:53.999766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4d9c6df7-a5e1-49e6-baaf-7c5de11062d0 does not exist Oct 18 15:36:53.999766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ad94e405-80b5-4c18-9754-71fcb1481526'] Oct 18 15:36:53.999766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:53.999766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:53.999766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:53.999766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:54.001238 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:36:54.001238 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:36:54.001238 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:36:54.001238 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:36:54.001238 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4d9c6df7-a5e1-49e6-baaf-7c5de11062d0 does not exist Oct 18 15:36:54.001238 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ad94e405-80b5-4c18-9754-71fcb1481526'] Oct 18 15:36:54.001238 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:54.001238 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-47c276e5-5704-4729-91c7-951cea25d8c2 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Returning 404 to user: Security group 4d9c6df7-a5e1-49e6-baaf-7c5de11062d0 does not exist Oct 18 15:36:54.001238 n-d-853682-5 devstack@n-api.service[120405]: Neutron server returns request_ids: ['req-ad94e405-80b5-4c18-9754-71fcb1481526'] {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:36:54.005959 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-47c276e5-5704-4729-91c7-951cea25d8c2 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/4d9c6df7-a5e1-49e6-baaf-7c5de11062d0" status: 404 len: 194 microversion: 2.1 time: 0.494198 Oct 18 15:36:54.007362 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1459/2813] 10.222.0.60 () {58 vars in 1272 bytes} [Tue Oct 18 15:36:53 2022] DELETE /compute/v2.1/os-security-groups/4d9c6df7-a5e1-49e6-baaf-7c5de11062d0 => generated 194 bytes in 500 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:36:54.018857 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-305ff98a-1bef-4705-965a-578f2d5386a8 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:54.020352 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-305ff98a-1bef-4705-965a-578f2d5386a8 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:54.029789 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-305ff98a-1bef-4705-965a-578f2d5386a8 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:54.030868 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-305ff98a-1bef-4705-965a-578f2d5386a8 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:54.031314 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-305ff98a-1bef-4705-965a-578f2d5386a8 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:54.032028 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-305ff98a-1bef-4705-965a-578f2d5386a8 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:54.032485 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-305ff98a-1bef-4705-965a-578f2d5386a8 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:54.033815 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-305ff98a-1bef-4705-965a-578f2d5386a8 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:54.315611 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cb0ed882-7ff2-42d7-98e9-a007c66d7541 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:54.324622 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cb0ed882-7ff2-42d7-98e9-a007c66d7541 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe" status: 200 len: 1461 microversion: 2.1 time: 0.775162 Oct 18 15:36:54.325218 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1355/2814] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:53 2022] GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe => generated 1461 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:54.337744 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f42947e9-3a8d-4ffa-b3db-516d49d850c7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:54.340883 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f42947e9-3a8d-4ffa-b3db-516d49d850c7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:54.381197 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f42947e9-3a8d-4ffa-b3db-516d49d850c7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:54.382262 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f42947e9-3a8d-4ffa-b3db-516d49d850c7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:54.383830 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f42947e9-3a8d-4ffa-b3db-516d49d850c7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:54.385302 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f42947e9-3a8d-4ffa-b3db-516d49d850c7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:54.385993 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f42947e9-3a8d-4ffa-b3db-516d49d850c7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:54.386630 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f42947e9-3a8d-4ffa-b3db-516d49d850c7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:54.469583 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-305ff98a-1bef-4705-965a-578f2d5386a8 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:54.478310 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-305ff98a-1bef-4705-965a-578f2d5386a8 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c" status: 200 len: 1472 microversion: 2.1 time: 0.469632 Oct 18 15:36:54.485251 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1460/2815] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:54 2022] GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c => generated 1472 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:54.501185 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ce464b00-87be-4cd4-8781-6626b196bfaa tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '.version_select at 0x7f7c3d138550>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:54.597581 n-d-853682-5 devstack@n-api.service[120405]: DEBUG neutronclient.v2_0.client [None req-ce464b00-87be-4cd4-8781-6626b196bfaa tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8111cd8b-860e-429c-aa96-5b5be728c11c does not exist", "detail": ""}} {{(pid=120405) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 15:36:54.598546 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.security_group_api [None req-ce464b00-87be-4cd4-8781-6626b196bfaa tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Neutron security group 8111cd8b-860e-429c-aa96-5b5be728c11c not found {{(pid=120405) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 18 15:36:54.599298 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-ce464b00-87be-4cd4-8781-6626b196bfaa tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] HTTP exception thrown: Security group 8111cd8b-860e-429c-aa96-5b5be728c11c does not exist Oct 18 15:36:54.599298 n-d-853682-5 devstack@n-api.service[120405]: Neutron server returns request_ids: ['req-d53b4164-3079-4895-bd80-8d7a1a35ef72'] Oct 18 15:36:54.602201 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ce464b00-87be-4cd4-8781-6626b196bfaa tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Request method failure captured: Oct 18 15:36:54.602201 n-d-853682-5 devstack@n-api.service[120405]: request: DELETE /compute/v2.1/os-security-groups/8111cd8b-860e-429c-aa96-5b5be728c11c HTTP/1.1 Oct 18 15:36:54.602201 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:36:54.602201 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:36:54.602201 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:36:54.602201 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:36:54.602201 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:36:54.602201 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:36:54.602201 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:36:54.602201 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:36:54.602201 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTse7fx2cnRaPoLjX5bcuOlHRsv5T7hjqupUR5Anksomh4sN2LXU4nAUs-nTlixOWx8rLooo7F4iO4MJJqXUn20Cug_7k-y3pRg9Zq_jy4SxiI9MxMze0dh6g1ffY8M4Eh1QOt6Xa2yz2Z8B-7cmZxI0dcYo33xex1kmG4oUGiUJl_0M Oct 18 15:36:54.602201 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:36:54.602201 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:36:54.602201 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:36:54.602201 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:36:54.602201 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:36:54.602201 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:36:54.602201 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 6a52e3135e52493b8ccb2d7342418591 Oct 18 15:36:54.602201 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-SecurityGroupsTestJSON-974652461 Oct 18 15:36:54.602201 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:36:54.602201 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:36:54.603720 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:36:54.603720 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-SecurityGroupsTestJSON-974652461 Oct 18 15:36:54.603720 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 6a52e3135e52493b8ccb2d7342418591 Oct 18 15:36:54.603720 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-974652461 Oct 18 15:36:54.603720 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-SecurityGroupsTestJSON-974652461-project Oct 18 15:36:54.603720 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:36:54.603720 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:36:54.603720 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: ee9a7ce3bb784a79b3ac336743b9ae84 Oct 18 15:36:54.603720 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-SecurityGroupsTestJSON-974652461-project Oct 18 15:36:54.603720 n-d-853682-5 devstack@n-api.service[120405]: method: Oct 18 15:36:54.603720 n-d-853682-5 devstack@n-api.service[120405]: exception: Security group 8111cd8b-860e-429c-aa96-5b5be728c11c does not exist Oct 18 15:36:54.603720 n-d-853682-5 devstack@n-api.service[120405]: Neutron server returns request_ids: ['req-d53b4164-3079-4895-bd80-8d7a1a35ef72'] Oct 18 15:36:54.603720 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '8111cd8b-860e-429c-aa96-5b5be728c11c'} Oct 18 15:36:54.604680 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:36:54.604680 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:54.604680 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 18 15:36:54.604680 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 18 15:36:54.604680 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:54.604680 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:54.604680 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 18 15:36:54.604680 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 18 15:36:54.604680 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:54.604680 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:54.604680 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 15:36:54.604680 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 15:36:54.604680 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:54.604680 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:54.604680 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 15:36:54.604680 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 15:36:54.604680 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:54.604680 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:54.604680 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 15:36:54.606025 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 15:36:54.606025 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:36:54.606025 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:36:54.606025 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 15:36:54.606025 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 15:36:54.606025 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 15:36:54.606025 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 15:36:54.606025 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8111cd8b-860e-429c-aa96-5b5be728c11c does not exist Oct 18 15:36:54.606025 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d53b4164-3079-4895-bd80-8d7a1a35ef72'] Oct 18 15:36:54.606025 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:54.606025 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:54.606025 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:54.606025 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:54.606025 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 18 15:36:54.606025 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 18 15:36:54.606025 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 18 15:36:54.606025 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 15:36:54.606025 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8111cd8b-860e-429c-aa96-5b5be728c11c does not exist Oct 18 15:36:54.607284 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d53b4164-3079-4895-bd80-8d7a1a35ef72'] Oct 18 15:36:54.607284 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:54.607284 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:54.607284 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:54.607284 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:54.607284 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:36:54.607284 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:36:54.607284 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:36:54.607284 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:36:54.607284 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:36:54.607284 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:36:54.607284 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:36:54.607284 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:36:54.607284 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 18 15:36:54.607284 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 15:36:54.607284 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8111cd8b-860e-429c-aa96-5b5be728c11c does not exist Oct 18 15:36:54.607284 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d53b4164-3079-4895-bd80-8d7a1a35ef72'] Oct 18 15:36:54.607284 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:54.607284 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:36:54.607284 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:54.607284 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:36:54.608732 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:36:54.608732 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:36:54.608732 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:36:54.608732 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:36:54.608732 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8111cd8b-860e-429c-aa96-5b5be728c11c does not exist Oct 18 15:36:54.608732 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d53b4164-3079-4895-bd80-8d7a1a35ef72'] Oct 18 15:36:54.608732 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:36:54.611744 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ce464b00-87be-4cd4-8781-6626b196bfaa tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Returning 404 to user: Security group 8111cd8b-860e-429c-aa96-5b5be728c11c does not exist Oct 18 15:36:54.611744 n-d-853682-5 devstack@n-api.service[120405]: Neutron server returns request_ids: ['req-d53b4164-3079-4895-bd80-8d7a1a35ef72'] {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:36:54.612901 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ce464b00-87be-4cd4-8781-6626b196bfaa tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/8111cd8b-860e-429c-aa96-5b5be728c11c" status: 404 len: 194 microversion: 2.1 time: 0.126403 Oct 18 15:36:54.616854 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1461/2816] 10.222.0.60 () {58 vars in 1272 bytes} [Tue Oct 18 15:36:54 2022] DELETE /compute/v2.1/os-security-groups/8111cd8b-860e-429c-aa96-5b5be728c11c => generated 194 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:36:54.622588 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1e53f302-65ee-480b-9ba1-0ba7337b6538 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Action: 'create', calling method: .version_select at 0x7f7c3d0530d0>, body: {"keypair": {"name": "tempest-keypair-440635808", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGh8Fuk2UEiPLpThOORc9cC2XSoTniAl24HSYxBfFJyfobvnJE6phnrpHbsZgnf/SPbR6gBituO3om8nyrDBrUhGYvAeQZVsVjm+nZ9fzzCE0jSZxB6V5eleaExY+tIMlg=="}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:36:54.639894 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-1e53f302-65ee-480b-9ba1-0ba7337b6538 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Getting quotas for project a5b55fd6668b481b8c578983dc655785. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:36:54.646429 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-1e53f302-65ee-480b-9ba1-0ba7337b6538 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Getting quotas for user efec3b4b5b1c46bd9d2c0efa68f86979 and project a5b55fd6668b481b8c578983dc655785. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:36:54.680691 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1e53f302-65ee-480b-9ba1-0ba7337b6538 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.061911 Oct 18 15:36:54.688513 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1462/2817] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Oct 18 15:36:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:36:54.702034 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-31cb344a-99a0-4d94-95dc-5e798e89998a tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Action: 'create', calling method: .version_select at 0x7f7c4160e4c0>, body: {"keypair": {"name": "tempest-keypair-598900667", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC8nrNhhUQFmzOglV4gvk3Mclt6D9gKwyk96IWe/G+qwPxqNz5/ZTYtqlR15YXqIPPZIT7Oz/4bVU3HprjJ8LPiWMHwQd3hpJlNQSB3jb6x9CJfhR02KoW8KBa5SLI651A=="}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:36:54.728537 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-31cb344a-99a0-4d94-95dc-5e798e89998a tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Getting quotas for project 91719d2b1f1640f391aa0b54c9725d2a. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:36:54.735862 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-31cb344a-99a0-4d94-95dc-5e798e89998a tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Getting quotas for user 926f2a98aa66431fab2a6032f21d5ae7 and project 91719d2b1f1640f391aa0b54c9725d2a. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:36:54.772599 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-31cb344a-99a0-4d94-95dc-5e798e89998a tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.082057 Oct 18 15:36:54.774776 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1463/2818] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Oct 18 15:36:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:36:54.781086 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-464d3d7a-2d98-4577-a822-14336f86c3a3 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:54.781648 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-464d3d7a-2d98-4577-a822-14336f86c3a3 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] [instance: 873a3005-fbac-40d0-8919-f138a619f2fa] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:54.788726 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-464d3d7a-2d98-4577-a822-14336f86c3a3 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:54.790328 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-464d3d7a-2d98-4577-a822-14336f86c3a3 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:54.791002 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-464d3d7a-2d98-4577-a822-14336f86c3a3 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:54.791975 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-464d3d7a-2d98-4577-a822-14336f86c3a3 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:54.792760 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-464d3d7a-2d98-4577-a822-14336f86c3a3 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:54.794697 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-464d3d7a-2d98-4577-a822-14336f86c3a3 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:54.824426 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f42947e9-3a8d-4ffa-b3db-516d49d850c7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:54.835112 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f42947e9-3a8d-4ffa-b3db-516d49d850c7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca" status: 200 len: 1315 microversion: 2.1 time: 0.504876 Oct 18 15:36:54.836107 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-464d3d7a-2d98-4577-a822-14336f86c3a3 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] [instance: 873a3005-fbac-40d0-8919-f138a619f2fa] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:36:54.837563 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1356/2819] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:54 2022] GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca => generated 1315 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:54.974428 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-464d3d7a-2d98-4577-a822-14336f86c3a3 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "DELETE /compute/v2.1/servers/873a3005-fbac-40d0-8919-f138a619f2fa" status: 204 len: 0 microversion: 2.1 time: 0.196195 Oct 18 15:36:54.975375 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1464/2820] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:36:54 2022] DELETE /compute/v2.1/servers/873a3005-fbac-40d0-8919-f138a619f2fa => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:36:54.984703 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fb264c8e-a7f0-40be-83a9-2e69c0cce7a6 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:54.985359 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fb264c8e-a7f0-40be-83a9-2e69c0cce7a6 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] [instance: 873a3005-fbac-40d0-8919-f138a619f2fa] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:55.002902 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb264c8e-a7f0-40be-83a9-2e69c0cce7a6 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:55.003404 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb264c8e-a7f0-40be-83a9-2e69c0cce7a6 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:55.003834 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb264c8e-a7f0-40be-83a9-2e69c0cce7a6 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:55.004539 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb264c8e-a7f0-40be-83a9-2e69c0cce7a6 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:55.005024 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb264c8e-a7f0-40be-83a9-2e69c0cce7a6 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:55.005445 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb264c8e-a7f0-40be-83a9-2e69c0cce7a6 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:55.503301 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fd1906a4-669d-4ae7-80e0-5d1d8f2061d5 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:55.505728 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-fd1906a4-669d-4ae7-80e0-5d1d8f2061d5 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:55.546972 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fd1906a4-669d-4ae7-80e0-5d1d8f2061d5 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:55.552558 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fd1906a4-669d-4ae7-80e0-5d1d8f2061d5 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:55.553790 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fd1906a4-669d-4ae7-80e0-5d1d8f2061d5 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:55.566305 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fd1906a4-669d-4ae7-80e0-5d1d8f2061d5 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:55.566832 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fd1906a4-669d-4ae7-80e0-5d1d8f2061d5 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:55.575255 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fd1906a4-669d-4ae7-80e0-5d1d8f2061d5 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:55.602136 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fb264c8e-a7f0-40be-83a9-2e69c0cce7a6 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a7ce3bb784a79b3ac336743b9ae84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a52e3135e52493b8ccb2d7342418591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:55.616240 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fb264c8e-a7f0-40be-83a9-2e69c0cce7a6 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "GET /compute/v2.1/servers/873a3005-fbac-40d0-8919-f138a619f2fa" status: 200 len: 1646 microversion: 2.1 time: 0.630876 Oct 18 15:36:55.617615 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1357/2821] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:54 2022] GET /compute/v2.1/servers/873a3005-fbac-40d0-8919-f138a619f2fa => generated 1646 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:55.859934 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dd58c358-b3bf-4481-82ea-c98ebdc67aba tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:55.860563 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dd58c358-b3bf-4481-82ea-c98ebdc67aba tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:55.877744 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd58c358-b3bf-4481-82ea-c98ebdc67aba tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:55.878251 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd58c358-b3bf-4481-82ea-c98ebdc67aba tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:55.878696 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd58c358-b3bf-4481-82ea-c98ebdc67aba tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:55.879432 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd58c358-b3bf-4481-82ea-c98ebdc67aba tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:55.882540 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd58c358-b3bf-4481-82ea-c98ebdc67aba tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:55.883010 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd58c358-b3bf-4481-82ea-c98ebdc67aba tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:56.177786 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-fd1906a4-669d-4ae7-80e0-5d1d8f2061d5 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:56.186924 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fd1906a4-669d-4ae7-80e0-5d1d8f2061d5 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c" status: 200 len: 1472 microversion: 2.1 time: 0.688353 Oct 18 15:36:56.189201 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1465/2822] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:55 2022] GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c => generated 1472 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:56.397335 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dd58c358-b3bf-4481-82ea-c98ebdc67aba tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:56.408279 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dd58c358-b3bf-4481-82ea-c98ebdc67aba tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca" status: 200 len: 1315 microversion: 2.1 time: 0.552378 Oct 18 15:36:56.430020 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1358/2823] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:55 2022] GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca => generated 1315 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:56.646550 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b13edf55-00bb-421a-8340-483bb0c4211f tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:56.648934 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b13edf55-00bb-421a-8340-483bb0c4211f tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] [instance: 873a3005-fbac-40d0-8919-f138a619f2fa] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:56.657250 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b13edf55-00bb-421a-8340-483bb0c4211f tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:56.657825 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b13edf55-00bb-421a-8340-483bb0c4211f tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:56.658608 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b13edf55-00bb-421a-8340-483bb0c4211f tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:56.659502 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b13edf55-00bb-421a-8340-483bb0c4211f tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:56.659964 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b13edf55-00bb-421a-8340-483bb0c4211f tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:56.660390 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b13edf55-00bb-421a-8340-483bb0c4211f tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:56.691839 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:36:56.850650 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-42dd10ac-fa20-4d9a-ab04-9542208465bf req-d4a6c76f-a6ea-4f02-a5a3-f04d211dcc89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5c710aa-e860-4b2c-a59b-c25202c621ca", "tag": "e2a2e036-76b0-46b5-8c98-0566f70d8b58"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:36:56.860785 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-42dd10ac-fa20-4d9a-ab04-9542208465bf req-d4a6c76f-a6ea-4f02-a5a3-f04d211dcc89 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:56.861307 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-42dd10ac-fa20-4d9a-ab04-9542208465bf req-d4a6c76f-a6ea-4f02-a5a3-f04d211dcc89 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:56.861738 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-42dd10ac-fa20-4d9a-ab04-9542208465bf req-d4a6c76f-a6ea-4f02-a5a3-f04d211dcc89 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:56.874525 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-42dd10ac-fa20-4d9a-ab04-9542208465bf req-d4a6c76f-a6ea-4f02-a5a3-f04d211dcc89 service nova] Creating event network-changed:e2a2e036-76b0-46b5-8c98-0566f70d8b58 for instance a5c710aa-e860-4b2c-a59b-c25202c621ca on n-h2-853682-5 Oct 18 15:36:56.879479 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-42dd10ac-fa20-4d9a-ab04-9542208465bf req-d4a6c76f-a6ea-4f02-a5a3-f04d211dcc89 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032469 Oct 18 15:36:56.880584 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1359/2824] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:36:57.217103 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b13edf55-00bb-421a-8340-483bb0c4211f tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a7ce3bb784a79b3ac336743b9ae84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a52e3135e52493b8ccb2d7342418591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:57.227346 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dd69e4df-c8ad-4b67-abb3-317e47fe9f5f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:57.228688 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dd69e4df-c8ad-4b67-abb3-317e47fe9f5f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:57.229796 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b13edf55-00bb-421a-8340-483bb0c4211f tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "GET /compute/v2.1/servers/873a3005-fbac-40d0-8919-f138a619f2fa" status: 200 len: 1646 microversion: 2.1 time: 0.589761 Oct 18 15:36:57.230391 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1466/2825] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:56 2022] GET /compute/v2.1/servers/873a3005-fbac-40d0-8919-f138a619f2fa => generated 1646 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:57.237966 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd69e4df-c8ad-4b67-abb3-317e47fe9f5f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:57.238771 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd69e4df-c8ad-4b67-abb3-317e47fe9f5f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:57.239221 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd69e4df-c8ad-4b67-abb3-317e47fe9f5f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:57.240047 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd69e4df-c8ad-4b67-abb3-317e47fe9f5f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:57.240507 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd69e4df-c8ad-4b67-abb3-317e47fe9f5f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:57.241352 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd69e4df-c8ad-4b67-abb3-317e47fe9f5f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:57.440018 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-255f0b23-5742-499d-92c5-16d822951b8a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:57.440759 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-255f0b23-5742-499d-92c5-16d822951b8a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:57.451426 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-255f0b23-5742-499d-92c5-16d822951b8a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:57.452093 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-255f0b23-5742-499d-92c5-16d822951b8a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:57.456381 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-255f0b23-5742-499d-92c5-16d822951b8a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:57.457710 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-255f0b23-5742-499d-92c5-16d822951b8a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:57.458356 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-255f0b23-5742-499d-92c5-16d822951b8a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:57.459079 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-255f0b23-5742-499d-92c5-16d822951b8a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:57.676135 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dd69e4df-c8ad-4b67-abb3-317e47fe9f5f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:57.692887 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dd69e4df-c8ad-4b67-abb3-317e47fe9f5f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c" status: 200 len: 1472 microversion: 2.1 time: 0.479634 Oct 18 15:36:57.693803 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1360/2826] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:57 2022] GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c => generated 1472 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:36:57.826060 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-255f0b23-5742-499d-92c5-16d822951b8a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:57.845134 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-255f0b23-5742-499d-92c5-16d822951b8a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca" status: 200 len: 1315 microversion: 2.1 time: 0.412947 Oct 18 15:36:57.846064 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1467/2827] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:57 2022] GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca => generated 1315 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:58.247180 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9e664bf3-eb97-4839-b802-49ee93b33d42 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1125656061", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:36:58.265894 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-cee56c92-3797-430e-a888-4f2992d18723 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:58.270964 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-cee56c92-3797-430e-a888-4f2992d18723 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] [instance: 873a3005-fbac-40d0-8919-f138a619f2fa] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:58.299186 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cee56c92-3797-430e-a888-4f2992d18723 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:58.299987 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cee56c92-3797-430e-a888-4f2992d18723 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:58.300446 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cee56c92-3797-430e-a888-4f2992d18723 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:58.301814 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cee56c92-3797-430e-a888-4f2992d18723 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:58.302281 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cee56c92-3797-430e-a888-4f2992d18723 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:58.302895 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cee56c92-3797-430e-a888-4f2992d18723 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:58.323221 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-9e664bf3-eb97-4839-b802-49ee93b33d42 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] validate_networks() for None {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:36:58.428709 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-cee56c92-3797-430e-a888-4f2992d18723 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a7ce3bb784a79b3ac336743b9ae84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a52e3135e52493b8ccb2d7342418591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:58.449667 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-cee56c92-3797-430e-a888-4f2992d18723 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "GET /compute/v2.1/servers/873a3005-fbac-40d0-8919-f138a619f2fa" status: 200 len: 1467 microversion: 2.1 time: 0.196060 Oct 18 15:36:58.450871 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1468/2828] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:58 2022] GET /compute/v2.1/servers/873a3005-fbac-40d0-8919-f138a619f2fa => generated 1467 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:58.518613 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-3fb905d6-0378-4950-a170-885bd32fdbcc req-9029ddbe-4740-4b49-a3f4-5c06c54fdadd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "873a3005-fbac-40d0-8919-f138a619f2fa", "name": "network-vif-deleted", "tag": "bb5c9526-9ebb-4b59-8df6-40f1393cf4b0"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:36:58.545313 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-3fb905d6-0378-4950-a170-885bd32fdbcc req-9029ddbe-4740-4b49-a3f4-5c06c54fdadd service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:58.546864 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-3fb905d6-0378-4950-a170-885bd32fdbcc req-9029ddbe-4740-4b49-a3f4-5c06c54fdadd service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:58.547383 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-3fb905d6-0378-4950-a170-885bd32fdbcc req-9029ddbe-4740-4b49-a3f4-5c06c54fdadd service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:58.560341 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-3fb905d6-0378-4950-a170-885bd32fdbcc req-9029ddbe-4740-4b49-a3f4-5c06c54fdadd service nova] Creating event network-vif-deleted:bb5c9526-9ebb-4b59-8df6-40f1393cf4b0 for instance 873a3005-fbac-40d0-8919-f138a619f2fa on n-h1-853682-5 Oct 18 15:36:58.566050 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-3fb905d6-0378-4950-a170-885bd32fdbcc req-9029ddbe-4740-4b49-a3f4-5c06c54fdadd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051418 Oct 18 15:36:58.566934 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1469/2829] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:36:58.577214 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c0209ae1-4b1a-431a-8a55-a70f786f1063 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1151660769", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ccd513cb-fa43-49a2-9672-944a34d86625"}], "security_groups": [{"name": "tempest-securitygroup--1102683052"}], "key_name": "tempest-keypair-440635808", "user_data": "}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:36:58.955565 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=6 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:36:59.050932 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9e664bf3-eb97-4839-b802-49ee93b33d42 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:36:59.051356 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9e664bf3-eb97-4839-b802-49ee93b33d42 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:36:59.051852 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9e664bf3-eb97-4839-b802-49ee93b33d42 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:36:59.052223 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9e664bf3-eb97-4839-b802-49ee93b33d42 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:36:59.052636 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9e664bf3-eb97-4839-b802-49ee93b33d42 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:36:59.063463 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e664bf3-eb97-4839-b802-49ee93b33d42 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:59.066729 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e664bf3-eb97-4839-b802-49ee93b33d42 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:59.067198 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e664bf3-eb97-4839-b802-49ee93b33d42 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:59.069008 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e664bf3-eb97-4839-b802-49ee93b33d42 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:59.069286 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e664bf3-eb97-4839-b802-49ee93b33d42 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:59.069823 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e664bf3-eb97-4839-b802-49ee93b33d42 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:59.099503 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-9e664bf3-eb97-4839-b802-49ee93b33d42 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Getting quotas for project 68d7770bf1ee4b46a1e4bdf61dc2d711. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:36:59.106902 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-9e664bf3-eb97-4839-b802-49ee93b33d42 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Getting quotas for user f36635345398478eb011416cae492244 and project 68d7770bf1ee4b46a1e4bdf61dc2d711. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:36:59.113275 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-c0209ae1-4b1a-431a-8a55-a70f786f1063 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] validate_networks() for [('ccd513cb-fa43-49a2-9672-944a34d86625', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:36:59.125576 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9e664bf3-eb97-4839-b802-49ee93b33d42 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:36:59.128693 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9e664bf3-eb97-4839-b802-49ee93b33d42 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] [instance: 004539c4-260d-46a9-beed-d9c4b9a76106] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:36:59.188032 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9e664bf3-eb97-4839-b802-49ee93b33d42 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.080018 Oct 18 15:36:59.189288 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1361/2830] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:36:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1082 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 15:36:59.194542 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2e499e68-bdcb-42df-bb55-8b7dc2fcc0cc tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:59.195475 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2e499e68-bdcb-42df-bb55-8b7dc2fcc0cc tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:59.202421 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e499e68-bdcb-42df-bb55-8b7dc2fcc0cc tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:59.203281 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e499e68-bdcb-42df-bb55-8b7dc2fcc0cc tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:59.203955 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e499e68-bdcb-42df-bb55-8b7dc2fcc0cc tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:59.205270 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e499e68-bdcb-42df-bb55-8b7dc2fcc0cc tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:59.205977 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e499e68-bdcb-42df-bb55-8b7dc2fcc0cc tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:59.206949 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e499e68-bdcb-42df-bb55-8b7dc2fcc0cc tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:59.651823 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2e499e68-bdcb-42df-bb55-8b7dc2fcc0cc tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:36:59.660567 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2e499e68-bdcb-42df-bb55-8b7dc2fcc0cc tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c" status: 200 len: 1472 microversion: 2.1 time: 0.469809 Oct 18 15:36:59.666031 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1362/2831] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:59 2022] GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c => generated 1472 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:36:59.677312 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-91a5b680-6172-4eb6-b3d4-7287c369dbcd tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:36:59.677934 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-91a5b680-6172-4eb6-b3d4-7287c369dbcd tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:36:59.690089 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91a5b680-6172-4eb6-b3d4-7287c369dbcd tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:59.690581 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91a5b680-6172-4eb6-b3d4-7287c369dbcd tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:59.691009 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91a5b680-6172-4eb6-b3d4-7287c369dbcd tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:36:59.698760 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91a5b680-6172-4eb6-b3d4-7287c369dbcd tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:36:59.699247 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91a5b680-6172-4eb6-b3d4-7287c369dbcd tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:36:59.700011 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91a5b680-6172-4eb6-b3d4-7287c369dbcd tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:00.018000 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-c0209ae1-4b1a-431a-8a55-a70f786f1063 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:37:00.018517 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-c0209ae1-4b1a-431a-8a55-a70f786f1063 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:37:00.018930 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-c0209ae1-4b1a-431a-8a55-a70f786f1063 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:37:00.019537 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-c0209ae1-4b1a-431a-8a55-a70f786f1063 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:37:00.020133 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-c0209ae1-4b1a-431a-8a55-a70f786f1063 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:37:00.032692 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c0209ae1-4b1a-431a-8a55-a70f786f1063 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:00.034688 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c0209ae1-4b1a-431a-8a55-a70f786f1063 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:00.036117 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c0209ae1-4b1a-431a-8a55-a70f786f1063 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:00.037246 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c0209ae1-4b1a-431a-8a55-a70f786f1063 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:00.037912 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c0209ae1-4b1a-431a-8a55-a70f786f1063 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:00.038449 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c0209ae1-4b1a-431a-8a55-a70f786f1063 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:00.040112 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-91a5b680-6172-4eb6-b3d4-7287c369dbcd tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:00.058741 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-91a5b680-6172-4eb6-b3d4-7287c369dbcd tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca" status: 200 len: 1315 microversion: 2.1 time: 0.391401 Oct 18 15:37:00.065846 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-c0209ae1-4b1a-431a-8a55-a70f786f1063 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Getting quotas for project a5b55fd6668b481b8c578983dc655785. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:37:00.072430 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-c0209ae1-4b1a-431a-8a55-a70f786f1063 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Getting quotas for user efec3b4b5b1c46bd9d2c0efa68f86979 and project a5b55fd6668b481b8c578983dc655785. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:37:00.073962 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1363/2832] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:36:59 2022] GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca => generated 1315 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:00.080789 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-02715a64-a1e4-408c-ad87-7a1df17ae832 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] Calling method '.version_select at 0x7f7c3dbdb790>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:00.082453 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:37:00.089011 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02715a64-a1e4-408c-ad87-7a1df17ae832 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:00.089764 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02715a64-a1e4-408c-ad87-7a1df17ae832 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:00.090748 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c0209ae1-4b1a-431a-8a55-a70f786f1063 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:37:00.091348 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02715a64-a1e4-408c-ad87-7a1df17ae832 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:00.092776 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c0209ae1-4b1a-431a-8a55-a70f786f1063 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 57537212-8816-4122-adbe-264f7035a0e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:37:00.100864 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-02715a64-a1e4-408c-ad87-7a1df17ae832 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] 10.222.0.60 "GET /compute/v2.1/os-migrations" status: 200 len: 803 microversion: 2.1 time: 0.023944 Oct 18 15:37:00.118152 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1364/2833] 10.222.0.60 () {58 vars in 1143 bytes} [Tue Oct 18 15:37:00 2022] GET /compute/v2.1/os-migrations => generated 803 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:37:00.124527 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-80eb6822-741f-4c83-a195-0e010c34eb12 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:00.125907 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-80eb6822-741f-4c83-a195-0e010c34eb12 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] [instance: 004539c4-260d-46a9-beed-d9c4b9a76106] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:00.134175 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80eb6822-741f-4c83-a195-0e010c34eb12 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:00.135089 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80eb6822-741f-4c83-a195-0e010c34eb12 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:00.135746 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80eb6822-741f-4c83-a195-0e010c34eb12 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:00.136627 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80eb6822-741f-4c83-a195-0e010c34eb12 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:00.137362 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80eb6822-741f-4c83-a195-0e010c34eb12 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:00.137943 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80eb6822-741f-4c83-a195-0e010c34eb12 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:00.158766 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c0209ae1-4b1a-431a-8a55-a70f786f1063 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.587300 Oct 18 15:37:00.159418 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1470/2834] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:36:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 1589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:37:00.175902 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-dfb9d64d-3e59-418c-bd1a-8582d12c3b2c tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:00.177203 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-dfb9d64d-3e59-418c-bd1a-8582d12c3b2c tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] [instance: 873a3005-fbac-40d0-8919-f138a619f2fa] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:00.198751 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dfb9d64d-3e59-418c-bd1a-8582d12c3b2c tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:00.202843 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dfb9d64d-3e59-418c-bd1a-8582d12c3b2c tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:00.203344 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dfb9d64d-3e59-418c-bd1a-8582d12c3b2c tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:00.206059 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dfb9d64d-3e59-418c-bd1a-8582d12c3b2c tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:00.207620 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dfb9d64d-3e59-418c-bd1a-8582d12c3b2c tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:00.209623 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dfb9d64d-3e59-418c-bd1a-8582d12c3b2c tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:00.249254 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-dfb9d64d-3e59-418c-bd1a-8582d12c3b2c tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] HTTP exception thrown: Instance 873a3005-fbac-40d0-8919-f138a619f2fa could not be found. Oct 18 15:37:00.251804 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-dfb9d64d-3e59-418c-bd1a-8582d12c3b2c tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Request method failure captured: Oct 18 15:37:00.251804 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/873a3005-fbac-40d0-8919-f138a619f2fa HTTP/1.1 Oct 18 15:37:00.251804 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:37:00.251804 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:37:00.251804 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:37:00.251804 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:37:00.251804 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:37:00.251804 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:37:00.251804 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:37:00.251804 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:37:00.251804 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTse7fx2cnRaPoLjX5bcuOlHRsv5T7hjqupUR5Anksomh4sN2LXU4nAUs-nTlixOWx8rLooo7F4iO4MJJqXUn20Cug_7k-y3pRg9Zq_jy4SxiI9MxMze0dh6g1ffY8M4Eh1QOt6Xa2yz2Z8B-7cmZxI0dcYo33xex1kmG4oUGiUJl_0M Oct 18 15:37:00.251804 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:37:00.251804 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:37:00.251804 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:37:00.251804 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:37:00.251804 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:37:00.251804 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:37:00.251804 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 6a52e3135e52493b8ccb2d7342418591 Oct 18 15:37:00.251804 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-SecurityGroupsTestJSON-974652461 Oct 18 15:37:00.251804 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:37:00.251804 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:37:00.253321 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a52e3135e52493b8ccb2d7342418591"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:37:00.253321 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-SecurityGroupsTestJSON-974652461 Oct 18 15:37:00.253321 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 6a52e3135e52493b8ccb2d7342418591 Oct 18 15:37:00.253321 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-974652461 Oct 18 15:37:00.253321 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-SecurityGroupsTestJSON-974652461-project Oct 18 15:37:00.253321 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:37:00.253321 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:37:00.253321 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: ee9a7ce3bb784a79b3ac336743b9ae84 Oct 18 15:37:00.253321 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-SecurityGroupsTestJSON-974652461-project Oct 18 15:37:00.253321 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:37:00.253321 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 873a3005-fbac-40d0-8919-f138a619f2fa could not be found. Oct 18 15:37:00.253321 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '873a3005-fbac-40d0-8919-f138a619f2fa'} Oct 18 15:37:00.254093 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:37:00.254093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:37:00.254093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:37:00.254093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:37:00.254093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:37:00.254093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:37:00.254093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:37:00.254093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:37:00.254093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:37:00.254093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:37:00.254093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 873a3005-fbac-40d0-8919-f138a619f2fa could not be found. Oct 18 15:37:00.254093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:37:00.254093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:37:00.254093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:37:00.254093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:37:00.254093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:37:00.254093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:37:00.254093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:37:00.254093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:37:00.254093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:37:00.255832 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:37:00.255832 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:37:00.255832 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:37:00.255832 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:37:00.255832 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:37:00.255832 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:37:00.255832 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:37:00.255832 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 873a3005-fbac-40d0-8919-f138a619f2fa could not be found. Oct 18 15:37:00.255832 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:37:00.255832 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:37:00.255832 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:37:00.255832 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:37:00.255832 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:37:00.255832 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:37:00.255832 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:37:00.255832 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:37:00.255832 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 873a3005-fbac-40d0-8919-f138a619f2fa could not be found. Oct 18 15:37:00.255832 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:37:00.258620 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-dfb9d64d-3e59-418c-bd1a-8582d12c3b2c tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Returning 404 to user: Instance 873a3005-fbac-40d0-8919-f138a619f2fa could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:37:00.258620 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-dfb9d64d-3e59-418c-bd1a-8582d12c3b2c tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "GET /compute/v2.1/servers/873a3005-fbac-40d0-8919-f138a619f2fa" status: 404 len: 111 microversion: 2.1 time: 0.089290 Oct 18 15:37:00.258620 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1471/2835] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:00 2022] GET /compute/v2.1/servers/873a3005-fbac-40d0-8919-f138a619f2fa => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:37:00.264049 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-39aa7c48-0ea4-4b43-aff2-0ad385baf527 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:00.272701 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-39aa7c48-0ea4-4b43-aff2-0ad385baf527 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013333 Oct 18 15:37:00.280302 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1472/2836] 10.222.0.60 () {58 vars in 1137 bytes} [Tue Oct 18 15:37:00 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:37:00.280302 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e222efff-43b2-47de-b406-2283efe4b9c5 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:00.281160 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-80eb6822-741f-4c83-a195-0e010c34eb12 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36635345398478eb011416cae492244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d7770bf1ee4b46a1e4bdf61dc2d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:00.281273 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e222efff-43b2-47de-b406-2283efe4b9c5 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 57537212-8816-4122-adbe-264f7035a0e9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:00.295057 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-80eb6822-741f-4c83-a195-0e010c34eb12 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "GET /compute/v2.1/servers/004539c4-260d-46a9-beed-d9c4b9a76106" status: 200 len: 1213 microversion: 2.1 time: 0.174527 Oct 18 15:37:00.308974 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1365/2837] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:00 2022] GET /compute/v2.1/servers/004539c4-260d-46a9-beed-d9c4b9a76106 => generated 1213 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:00.318135 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-489f85c2-a452-4aaa-9b52-cc30d5d8d134 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '.version_select at 0x7f7c3d841550>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:00.384116 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e222efff-43b2-47de-b406-2283efe4b9c5 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:00.400657 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e222efff-43b2-47de-b406-2283efe4b9c5 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9" status: 200 len: 1241 microversion: 2.1 time: 0.125795 Oct 18 15:37:00.401310 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1473/2838] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:00 2022] GET /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9 => generated 1241 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:00.405690 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1779c000-a8f7-463b-b6d3-d6f3b6e5ca92 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1658727702", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:37:00.451846 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1779c000-a8f7-463b-b6d3-d6f3b6e5ca92 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.049455 Oct 18 15:37:00.456935 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1474/2839] 10.222.0.60 () {60 vars in 1146 bytes} [Tue Oct 18 15:37:00 2022] POST /compute/v2.1/flavors => generated 499 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:37:00.464724 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0a066343-4ec4-4c96-b2aa-8126c6fef76d tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:00.484074 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0a066343-4ec4-4c96-b2aa-8126c6fef76d tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.020122 Oct 18 15:37:00.494979 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1475/2840] 10.222.0.60 () {58 vars in 1182 bytes} [Tue Oct 18 15:37:00 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:37:00.681732 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-64712e70-3000-4861-8d10-cddbf5302d44 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1313421891", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "9e5f28fa-4760-4b58-826f-ff77263a4322"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:37:00.771902 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-64712e70-3000-4861-8d10-cddbf5302d44 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] validate_networks() for None {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:37:00.839115 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-489f85c2-a452-4aaa-9b52-cc30d5d8d134 tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/7dcd6ce8-f2c0-49fb-867a-43d7db3e45e4" status: 202 len: 0 microversion: 2.1 time: 0.538336 Oct 18 15:37:00.840168 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1366/2841] 10.222.0.60 () {58 vars in 1272 bytes} [Tue Oct 18 15:37:00 2022] DELETE /compute/v2.1/os-security-groups/7dcd6ce8-f2c0-49fb-867a-43d7db3e45e4 => generated 0 bytes in 541 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:37:00.847111 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2737a02f-d921-4c94-8c3c-e7e19d660412 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:00.848036 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2737a02f-d921-4c94-8c3c-e7e19d660412 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:00.859918 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2737a02f-d921-4c94-8c3c-e7e19d660412 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:00.860441 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2737a02f-d921-4c94-8c3c-e7e19d660412 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:00.860891 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2737a02f-d921-4c94-8c3c-e7e19d660412 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:00.861793 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2737a02f-d921-4c94-8c3c-e7e19d660412 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:00.862259 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2737a02f-d921-4c94-8c3c-e7e19d660412 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:00.862691 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2737a02f-d921-4c94-8c3c-e7e19d660412 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:01.115138 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2737a02f-d921-4c94-8c3c-e7e19d660412 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:01.128763 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2737a02f-d921-4c94-8c3c-e7e19d660412 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c" status: 200 len: 1472 microversion: 2.1 time: 0.287147 Oct 18 15:37:01.135618 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1367/2842] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:00 2022] GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c => generated 1472 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:01.139350 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-64712e70-3000-4861-8d10-cddbf5302d44 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:37:01.139837 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-64712e70-3000-4861-8d10-cddbf5302d44 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:37:01.140495 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-64712e70-3000-4861-8d10-cddbf5302d44 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:37:01.141125 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-64712e70-3000-4861-8d10-cddbf5302d44 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:37:01.141695 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-64712e70-3000-4861-8d10-cddbf5302d44 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:37:01.150818 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-05ae68b4-fc9b-41ee-b7fb-23937f68c84d tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] Calling method '.version_select at 0x7f7c3c798a60>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:01.159374 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-64712e70-3000-4861-8d10-cddbf5302d44 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:01.160280 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-64712e70-3000-4861-8d10-cddbf5302d44 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:01.161003 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-64712e70-3000-4861-8d10-cddbf5302d44 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:01.162086 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-64712e70-3000-4861-8d10-cddbf5302d44 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:01.162536 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-64712e70-3000-4861-8d10-cddbf5302d44 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:01.164028 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-64712e70-3000-4861-8d10-cddbf5302d44 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:01.193108 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-64712e70-3000-4861-8d10-cddbf5302d44 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Getting quotas for project 91719d2b1f1640f391aa0b54c9725d2a. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:37:01.199167 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-64712e70-3000-4861-8d10-cddbf5302d44 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Getting quotas for user 926f2a98aa66431fab2a6032f21d5ae7 and project 91719d2b1f1640f391aa0b54c9725d2a. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:37:01.215477 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-64712e70-3000-4861-8d10-cddbf5302d44 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:37:01.218284 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-64712e70-3000-4861-8d10-cddbf5302d44 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 12e415d7-7c40-41a0-957a-a083dbcf2b43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:37:01.325935 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-64712e70-3000-4861-8d10-cddbf5302d44 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.645351 Oct 18 15:37:01.337146 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1476/2843] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:37:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 15:37:01.347887 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-12ee8f77-3d1b-42b8-8ce3-cee1310a38bd tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:01.348511 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-12ee8f77-3d1b-42b8-8ce3-cee1310a38bd tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:01.386450 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12ee8f77-3d1b-42b8-8ce3-cee1310a38bd tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:01.389824 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12ee8f77-3d1b-42b8-8ce3-cee1310a38bd tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:01.390291 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12ee8f77-3d1b-42b8-8ce3-cee1310a38bd tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:01.391035 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12ee8f77-3d1b-42b8-8ce3-cee1310a38bd tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:01.391507 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12ee8f77-3d1b-42b8-8ce3-cee1310a38bd tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:01.391939 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12ee8f77-3d1b-42b8-8ce3-cee1310a38bd tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:01.418963 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-05ae68b4-fc9b-41ee-b7fb-23937f68c84d tempest-SecurityGroupsTestJSON-974652461 tempest-SecurityGroupsTestJSON-974652461-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/17ea2ba0-b64e-47a9-8ee4-1a4237ce9745" status: 202 len: 0 microversion: 2.1 time: 0.280196 Oct 18 15:37:01.420322 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1368/2844] 10.222.0.60 () {58 vars in 1272 bytes} [Tue Oct 18 15:37:01 2022] DELETE /compute/v2.1/os-security-groups/17ea2ba0-b64e-47a9-8ee4-1a4237ce9745 => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:37:01.430744 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4b0756ca-ebcc-48f2-968a-6b735c757df2 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:01.431657 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4b0756ca-ebcc-48f2-968a-6b735c757df2 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] [instance: 004539c4-260d-46a9-beed-d9c4b9a76106] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:01.441984 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b0756ca-ebcc-48f2-968a-6b735c757df2 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:01.445603 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b0756ca-ebcc-48f2-968a-6b735c757df2 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:01.447065 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b0756ca-ebcc-48f2-968a-6b735c757df2 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:01.458211 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b0756ca-ebcc-48f2-968a-6b735c757df2 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:01.464636 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b0756ca-ebcc-48f2-968a-6b735c757df2 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:01.468009 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b0756ca-ebcc-48f2-968a-6b735c757df2 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:01.664305 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4b0756ca-ebcc-48f2-968a-6b735c757df2 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36635345398478eb011416cae492244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d7770bf1ee4b46a1e4bdf61dc2d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:01.679317 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4b0756ca-ebcc-48f2-968a-6b735c757df2 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "GET /compute/v2.1/servers/004539c4-260d-46a9-beed-d9c4b9a76106" status: 200 len: 1287 microversion: 2.1 time: 0.255600 Oct 18 15:37:01.680494 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1369/2845] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:01 2022] GET /compute/v2.1/servers/004539c4-260d-46a9-beed-d9c4b9a76106 => generated 1287 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:01.690686 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b94ea83b-018a-4599-94f8-290037b528ce tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:01.692799 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b94ea83b-018a-4599-94f8-290037b528ce tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 12e415d7-7c40-41a0-957a-a083dbcf2b43] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:01.792046 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b94ea83b-018a-4599-94f8-290037b528ce tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:01.800010 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-12ee8f77-3d1b-42b8-8ce3-cee1310a38bd tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:01.804852 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b94ea83b-018a-4599-94f8-290037b528ce tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43" status: 200 len: 1279 microversion: 2.1 time: 0.119771 Oct 18 15:37:01.814818 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-12ee8f77-3d1b-42b8-8ce3-cee1310a38bd tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca" status: 200 len: 1315 microversion: 2.1 time: 0.474489 Oct 18 15:37:01.815407 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1477/2846] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:01 2022] GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca => generated 1315 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:01.818177 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1370/2847] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:01 2022] GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43 => generated 1279 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:01.822033 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-41f15bc1-c8d2-4633-b00e-aa8ea3c885a1 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:01.822902 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-41f15bc1-c8d2-4633-b00e-aa8ea3c885a1 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 57537212-8816-4122-adbe-264f7035a0e9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:01.842163 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-41f15bc1-c8d2-4633-b00e-aa8ea3c885a1 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:01.843390 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-41f15bc1-c8d2-4633-b00e-aa8ea3c885a1 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:01.844439 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-41f15bc1-c8d2-4633-b00e-aa8ea3c885a1 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:01.845430 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-41f15bc1-c8d2-4633-b00e-aa8ea3c885a1 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:01.846091 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-41f15bc1-c8d2-4633-b00e-aa8ea3c885a1 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:01.846876 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-41f15bc1-c8d2-4633-b00e-aa8ea3c885a1 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:01.950433 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-41f15bc1-c8d2-4633-b00e-aa8ea3c885a1 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:01.963301 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-41f15bc1-c8d2-4633-b00e-aa8ea3c885a1 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9" status: 200 len: 1293 microversion: 2.1 time: 0.145891 Oct 18 15:37:01.979332 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1478/2848] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:01 2022] GET /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9 => generated 1293 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:02.163218 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a81ea6ec-9618-4895-9867-e4176d74de2b tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:02.164586 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a81ea6ec-9618-4895-9867-e4176d74de2b tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:02.173907 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a81ea6ec-9618-4895-9867-e4176d74de2b tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:02.174688 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a81ea6ec-9618-4895-9867-e4176d74de2b tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:02.175361 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a81ea6ec-9618-4895-9867-e4176d74de2b tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:02.176550 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a81ea6ec-9618-4895-9867-e4176d74de2b tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:02.177335 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a81ea6ec-9618-4895-9867-e4176d74de2b tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:02.178010 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a81ea6ec-9618-4895-9867-e4176d74de2b tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:02.622409 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a81ea6ec-9618-4895-9867-e4176d74de2b tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:02.633560 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a81ea6ec-9618-4895-9867-e4176d74de2b tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c" status: 200 len: 1472 microversion: 2.1 time: 0.474101 Oct 18 15:37:02.635636 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1371/2849] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:02 2022] GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c => generated 1472 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:02.710953 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-c4aaf5f1-486e-4a54-b8ce-5904c06a490e req-257bf7e3-3208-402b-b4e7-a176e6987815 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5c710aa-e860-4b2c-a59b-c25202c621ca", "name": "network-vif-plugged", "status": "completed", "tag": "e2a2e036-76b0-46b5-8c98-0566f70d8b58"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:37:02.712991 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-90a6e6f0-49a5-4c05-983d-b64fd85f8458 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:02.713858 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-90a6e6f0-49a5-4c05-983d-b64fd85f8458 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] [instance: 004539c4-260d-46a9-beed-d9c4b9a76106] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:02.716135 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:37:02.725672 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-c4aaf5f1-486e-4a54-b8ce-5904c06a490e req-257bf7e3-3208-402b-b4e7-a176e6987815 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:02.727274 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-c4aaf5f1-486e-4a54-b8ce-5904c06a490e req-257bf7e3-3208-402b-b4e7-a176e6987815 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:02.727934 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-c4aaf5f1-486e-4a54-b8ce-5904c06a490e req-257bf7e3-3208-402b-b4e7-a176e6987815 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:02.730200 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90a6e6f0-49a5-4c05-983d-b64fd85f8458 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:02.737537 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90a6e6f0-49a5-4c05-983d-b64fd85f8458 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:02.743827 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90a6e6f0-49a5-4c05-983d-b64fd85f8458 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:02.744977 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90a6e6f0-49a5-4c05-983d-b64fd85f8458 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:02.746416 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90a6e6f0-49a5-4c05-983d-b64fd85f8458 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:02.747211 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90a6e6f0-49a5-4c05-983d-b64fd85f8458 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:02.766164 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-c4aaf5f1-486e-4a54-b8ce-5904c06a490e req-257bf7e3-3208-402b-b4e7-a176e6987815 service nova] Creating event network-vif-plugged:e2a2e036-76b0-46b5-8c98-0566f70d8b58 for instance a5c710aa-e860-4b2c-a59b-c25202c621ca on n-h2-853682-5 Oct 18 15:37:02.779919 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-c4aaf5f1-486e-4a54-b8ce-5904c06a490e req-257bf7e3-3208-402b-b4e7-a176e6987815 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107742 Oct 18 15:37:02.781198 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1479/2850] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:37:02.845793 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8fe9c500-cd4d-49be-b19b-c11a49ead198 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:02.847535 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8fe9c500-cd4d-49be-b19b-c11a49ead198 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 12e415d7-7c40-41a0-957a-a083dbcf2b43] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:02.879360 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8fe9c500-cd4d-49be-b19b-c11a49ead198 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:02.882863 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8fe9c500-cd4d-49be-b19b-c11a49ead198 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:02.884430 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8fe9c500-cd4d-49be-b19b-c11a49ead198 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:02.885876 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8fe9c500-cd4d-49be-b19b-c11a49ead198 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:02.886556 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8fe9c500-cd4d-49be-b19b-c11a49ead198 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:02.887222 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8fe9c500-cd4d-49be-b19b-c11a49ead198 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:03.128685 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8fe9c500-cd4d-49be-b19b-c11a49ead198 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:03.147790 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8fe9c500-cd4d-49be-b19b-c11a49ead198 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43" status: 200 len: 1331 microversion: 2.1 time: 0.319384 Oct 18 15:37:03.153457 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1480/2851] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:02 2022] GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43 => generated 1331 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:03.160108 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-641bb06d-4bec-4ef4-99e8-f27165f8d917 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:03.161195 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-641bb06d-4bec-4ef4-99e8-f27165f8d917 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:03.170511 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-641bb06d-4bec-4ef4-99e8-f27165f8d917 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:03.171422 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-641bb06d-4bec-4ef4-99e8-f27165f8d917 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:03.172068 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-641bb06d-4bec-4ef4-99e8-f27165f8d917 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:03.173466 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-641bb06d-4bec-4ef4-99e8-f27165f8d917 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:03.174168 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-641bb06d-4bec-4ef4-99e8-f27165f8d917 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:03.174934 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-641bb06d-4bec-4ef4-99e8-f27165f8d917 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:03.272252 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-90a6e6f0-49a5-4c05-983d-b64fd85f8458 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36635345398478eb011416cae492244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d7770bf1ee4b46a1e4bdf61dc2d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:03.282872 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-90a6e6f0-49a5-4c05-983d-b64fd85f8458 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "GET /compute/v2.1/servers/004539c4-260d-46a9-beed-d9c4b9a76106" status: 200 len: 1317 microversion: 2.1 time: 0.574579 Oct 18 15:37:03.284305 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1372/2852] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:02 2022] GET /compute/v2.1/servers/004539c4-260d-46a9-beed-d9c4b9a76106 => generated 1317 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:03.291965 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-72e0d679-dfe5-4af7-8957-9f3d403490f0 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:03.292928 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-72e0d679-dfe5-4af7-8957-9f3d403490f0 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 57537212-8816-4122-adbe-264f7035a0e9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:03.302384 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-72e0d679-dfe5-4af7-8957-9f3d403490f0 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:03.303401 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-72e0d679-dfe5-4af7-8957-9f3d403490f0 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:03.304047 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-72e0d679-dfe5-4af7-8957-9f3d403490f0 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:03.304851 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-72e0d679-dfe5-4af7-8957-9f3d403490f0 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:03.305276 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-72e0d679-dfe5-4af7-8957-9f3d403490f0 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:03.305708 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-72e0d679-dfe5-4af7-8957-9f3d403490f0 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:03.756643 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-72e0d679-dfe5-4af7-8957-9f3d403490f0 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:03.760949 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:37:03.767550 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-72e0d679-dfe5-4af7-8957-9f3d403490f0 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9" status: 200 len: 1299 microversion: 2.1 time: 0.481860 Oct 18 15:37:03.768386 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1373/2853] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:03 2022] GET /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9 => generated 1299 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:03.786957 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-828d328b-3173-4ec3-8127-afeac652eba0 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:03.787984 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-828d328b-3173-4ec3-8127-afeac652eba0 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:03.796181 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-828d328b-3173-4ec3-8127-afeac652eba0 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:03.796791 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-828d328b-3173-4ec3-8127-afeac652eba0 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:03.797327 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-828d328b-3173-4ec3-8127-afeac652eba0 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:03.803180 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-828d328b-3173-4ec3-8127-afeac652eba0 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:03.803737 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-828d328b-3173-4ec3-8127-afeac652eba0 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:03.805402 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-828d328b-3173-4ec3-8127-afeac652eba0 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:03.851942 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-641bb06d-4bec-4ef4-99e8-f27165f8d917 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:03.868837 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-641bb06d-4bec-4ef4-99e8-f27165f8d917 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca" status: 200 len: 1315 microversion: 2.1 time: 0.713651 Oct 18 15:37:03.869798 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1481/2854] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:03 2022] GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca => generated 1315 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:04.147904 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-828d328b-3173-4ec3-8127-afeac652eba0 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:04.156127 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-828d328b-3173-4ec3-8127-afeac652eba0 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c" status: 200 len: 1472 microversion: 2.1 time: 0.385981 Oct 18 15:37:04.156719 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1374/2855] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:03 2022] GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c => generated 1472 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:04.182429 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a19620b2-c771-4447-9845-c427b1b5c6fb tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:04.183063 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a19620b2-c771-4447-9845-c427b1b5c6fb tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 12e415d7-7c40-41a0-957a-a083dbcf2b43] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:04.195699 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a19620b2-c771-4447-9845-c427b1b5c6fb tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:04.196475 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a19620b2-c771-4447-9845-c427b1b5c6fb tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:04.197102 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a19620b2-c771-4447-9845-c427b1b5c6fb tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:04.197992 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a19620b2-c771-4447-9845-c427b1b5c6fb tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:04.198608 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a19620b2-c771-4447-9845-c427b1b5c6fb tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:04.199207 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a19620b2-c771-4447-9845-c427b1b5c6fb tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:04.307918 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-611dc553-98e3-4413-a776-94f657a811ce tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:04.308546 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-611dc553-98e3-4413-a776-94f657a811ce tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] [instance: 004539c4-260d-46a9-beed-d9c4b9a76106] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:04.327131 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-611dc553-98e3-4413-a776-94f657a811ce tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:04.327648 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-611dc553-98e3-4413-a776-94f657a811ce tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:04.328075 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-611dc553-98e3-4413-a776-94f657a811ce tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:04.328834 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-611dc553-98e3-4413-a776-94f657a811ce tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:04.329298 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-611dc553-98e3-4413-a776-94f657a811ce tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:04.329996 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-611dc553-98e3-4413-a776-94f657a811ce tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:04.378359 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a19620b2-c771-4447-9845-c427b1b5c6fb tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:04.391170 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a19620b2-c771-4447-9845-c427b1b5c6fb tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43" status: 200 len: 1337 microversion: 2.1 time: 0.212716 Oct 18 15:37:04.392409 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1482/2856] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:04 2022] GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43 => generated 1337 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:04.792523 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d31d869e-7902-4728-b556-85aa6c345ed7 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:04.793227 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d31d869e-7902-4728-b556-85aa6c345ed7 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 57537212-8816-4122-adbe-264f7035a0e9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:04.801291 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d31d869e-7902-4728-b556-85aa6c345ed7 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:04.802556 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d31d869e-7902-4728-b556-85aa6c345ed7 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:04.803241 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d31d869e-7902-4728-b556-85aa6c345ed7 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:04.804620 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d31d869e-7902-4728-b556-85aa6c345ed7 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:04.805438 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d31d869e-7902-4728-b556-85aa6c345ed7 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:04.806151 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d31d869e-7902-4728-b556-85aa6c345ed7 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:04.824882 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-611dc553-98e3-4413-a776-94f657a811ce tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36635345398478eb011416cae492244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d7770bf1ee4b46a1e4bdf61dc2d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:04.832896 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-611dc553-98e3-4413-a776-94f657a811ce tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "GET /compute/v2.1/servers/004539c4-260d-46a9-beed-d9c4b9a76106" status: 200 len: 1317 microversion: 2.1 time: 0.529813 Oct 18 15:37:04.833490 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1375/2857] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:04 2022] GET /compute/v2.1/servers/004539c4-260d-46a9-beed-d9c4b9a76106 => generated 1317 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:04.893625 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ca815df0-7cf8-420d-86bc-2ddacf323664 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:04.894240 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ca815df0-7cf8-420d-86bc-2ddacf323664 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:04.904409 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca815df0-7cf8-420d-86bc-2ddacf323664 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:04.904927 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca815df0-7cf8-420d-86bc-2ddacf323664 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:04.905373 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca815df0-7cf8-420d-86bc-2ddacf323664 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:04.906077 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca815df0-7cf8-420d-86bc-2ddacf323664 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:04.906526 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca815df0-7cf8-420d-86bc-2ddacf323664 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:04.906944 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca815df0-7cf8-420d-86bc-2ddacf323664 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:05.483561 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d31d869e-7902-4728-b556-85aa6c345ed7 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:05.500375 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d31d869e-7902-4728-b556-85aa6c345ed7 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9" status: 200 len: 1367 microversion: 2.1 time: 0.712566 Oct 18 15:37:05.516849 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1483/2858] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:04 2022] GET /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9 => generated 1367 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:37:05.518143 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ca815df0-7cf8-420d-86bc-2ddacf323664 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:05.528242 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c4e928a9-9cbf-4eeb-a1bd-082c25350ac3 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:05.530098 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c4e928a9-9cbf-4eeb-a1bd-082c25350ac3 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:05.542523 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ca815df0-7cf8-420d-86bc-2ddacf323664 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca" status: 200 len: 1503 microversion: 2.1 time: 0.652658 Oct 18 15:37:05.543702 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1376/2859] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:04 2022] GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca => generated 1503 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:05.548891 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f41d6158-12fb-4fcf-ac7b-9041f7b522b5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:05.552125 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f41d6158-12fb-4fcf-ac7b-9041f7b522b5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 12e415d7-7c40-41a0-957a-a083dbcf2b43] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:05.563403 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f41d6158-12fb-4fcf-ac7b-9041f7b522b5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:05.563619 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c4e928a9-9cbf-4eeb-a1bd-082c25350ac3 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:05.564199 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c4e928a9-9cbf-4eeb-a1bd-082c25350ac3 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:05.564846 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c4e928a9-9cbf-4eeb-a1bd-082c25350ac3 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:05.565086 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f41d6158-12fb-4fcf-ac7b-9041f7b522b5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:05.565891 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c4e928a9-9cbf-4eeb-a1bd-082c25350ac3 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:05.566353 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f41d6158-12fb-4fcf-ac7b-9041f7b522b5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:05.567773 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f41d6158-12fb-4fcf-ac7b-9041f7b522b5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:05.573527 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f41d6158-12fb-4fcf-ac7b-9041f7b522b5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:05.574871 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c4e928a9-9cbf-4eeb-a1bd-082c25350ac3 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:05.576360 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c4e928a9-9cbf-4eeb-a1bd-082c25350ac3 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:05.583585 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f41d6158-12fb-4fcf-ac7b-9041f7b522b5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:05.926984 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f41d6158-12fb-4fcf-ac7b-9041f7b522b5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:05.942626 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f41d6158-12fb-4fcf-ac7b-9041f7b522b5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43" status: 200 len: 1379 microversion: 2.1 time: 0.397665 Oct 18 15:37:05.958409 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1377/2860] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:05 2022] GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43 => generated 1379 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:05.969500 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-27dab53f-38c1-4798-8f73-9d7305b4cd0b req-9d149b14-3335-4c04-95a5-98cfe8a0d11a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "004539c4-260d-46a9-beed-d9c4b9a76106", "tag": "7e81b5b0-1e7e-436b-84c7-bab9312ea51d"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:37:05.992327 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-27dab53f-38c1-4798-8f73-9d7305b4cd0b req-9d149b14-3335-4c04-95a5-98cfe8a0d11a service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:05.992832 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-27dab53f-38c1-4798-8f73-9d7305b4cd0b req-9d149b14-3335-4c04-95a5-98cfe8a0d11a service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:05.993253 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-27dab53f-38c1-4798-8f73-9d7305b4cd0b req-9d149b14-3335-4c04-95a5-98cfe8a0d11a service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:06.026286 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-27dab53f-38c1-4798-8f73-9d7305b4cd0b req-9d149b14-3335-4c04-95a5-98cfe8a0d11a service nova] Creating event network-changed:7e81b5b0-1e7e-436b-84c7-bab9312ea51d for instance 004539c4-260d-46a9-beed-d9c4b9a76106 on n-h1-853682-5 Oct 18 15:37:06.047779 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-27dab53f-38c1-4798-8f73-9d7305b4cd0b req-9d149b14-3335-4c04-95a5-98cfe8a0d11a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084402 Oct 18 15:37:06.048726 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1378/2861] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:37:06.058445 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5a691c8a-070b-4fa4-980d-90d832c123ab tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:37:06.059259 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5a691c8a-070b-4fa4-980d-90d832c123ab tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:06.068015 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a691c8a-070b-4fa4-980d-90d832c123ab tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:06.068933 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a691c8a-070b-4fa4-980d-90d832c123ab tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:06.069519 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a691c8a-070b-4fa4-980d-90d832c123ab tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:06.072111 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a691c8a-070b-4fa4-980d-90d832c123ab tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:06.072750 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a691c8a-070b-4fa4-980d-90d832c123ab tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:06.073360 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a691c8a-070b-4fa4-980d-90d832c123ab tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:06.127814 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-5a691c8a-070b-4fa4-980d-90d832c123ab tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lazy-loading 'flavor' on Instance uuid a5c710aa-e860-4b2c-a59b-c25202c621ca {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:37:06.471872 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c4e928a9-9cbf-4eeb-a1bd-082c25350ac3 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:06.490227 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c4e928a9-9cbf-4eeb-a1bd-082c25350ac3 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c" status: 200 len: 1472 microversion: 2.1 time: 0.978223 Oct 18 15:37:06.504903 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1484/2862] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:05 2022] GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c => generated 1472 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:06.520369 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3bd0f42e-b8b9-4968-98c8-f3ee3102160a tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:06.522527 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3bd0f42e-b8b9-4968-98c8-f3ee3102160a tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] [instance: 004539c4-260d-46a9-beed-d9c4b9a76106] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:06.543279 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3bd0f42e-b8b9-4968-98c8-f3ee3102160a tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:06.553599 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3bd0f42e-b8b9-4968-98c8-f3ee3102160a tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:06.554269 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3bd0f42e-b8b9-4968-98c8-f3ee3102160a tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:06.555048 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3bd0f42e-b8b9-4968-98c8-f3ee3102160a tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:06.559774 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5a691c8a-070b-4fa4-980d-90d832c123ab tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "POST /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca/action" status: 202 len: 0 microversion: 2.1 time: 0.509208 Oct 18 15:37:06.560746 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1379/2863] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:37:06 2022] POST /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca/action => generated 0 bytes in 511 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:37:06.565873 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3bd0f42e-b8b9-4968-98c8-f3ee3102160a tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:06.566556 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2102d4b1-47a6-4834-876c-fe0d5d4f65a8 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:06.566835 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3bd0f42e-b8b9-4968-98c8-f3ee3102160a tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:06.567281 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2102d4b1-47a6-4834-876c-fe0d5d4f65a8 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 57537212-8816-4122-adbe-264f7035a0e9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:06.590743 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2102d4b1-47a6-4834-876c-fe0d5d4f65a8 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:06.591283 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2102d4b1-47a6-4834-876c-fe0d5d4f65a8 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:06.591733 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2102d4b1-47a6-4834-876c-fe0d5d4f65a8 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:06.592558 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2102d4b1-47a6-4834-876c-fe0d5d4f65a8 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:06.593134 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2102d4b1-47a6-4834-876c-fe0d5d4f65a8 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:06.593560 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2102d4b1-47a6-4834-876c-fe0d5d4f65a8 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:07.469089 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3bd0f42e-b8b9-4968-98c8-f3ee3102160a tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36635345398478eb011416cae492244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d7770bf1ee4b46a1e4bdf61dc2d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:07.486397 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3bd0f42e-b8b9-4968-98c8-f3ee3102160a tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "GET /compute/v2.1/servers/004539c4-260d-46a9-beed-d9c4b9a76106" status: 200 len: 1317 microversion: 2.1 time: 0.983070 Oct 18 15:37:07.487469 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1485/2864] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:06 2022] GET /compute/v2.1/servers/004539c4-260d-46a9-beed-d9c4b9a76106 => generated 1317 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:07.495633 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d9c2c312-72e2-49d7-b7a5-93f44a1cc0d5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:07.498228 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d9c2c312-72e2-49d7-b7a5-93f44a1cc0d5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:07.506490 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d9c2c312-72e2-49d7-b7a5-93f44a1cc0d5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:07.507378 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d9c2c312-72e2-49d7-b7a5-93f44a1cc0d5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:07.508249 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d9c2c312-72e2-49d7-b7a5-93f44a1cc0d5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:07.509380 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d9c2c312-72e2-49d7-b7a5-93f44a1cc0d5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:07.510233 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d9c2c312-72e2-49d7-b7a5-93f44a1cc0d5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:07.510857 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d9c2c312-72e2-49d7-b7a5-93f44a1cc0d5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:07.536338 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2102d4b1-47a6-4834-876c-fe0d5d4f65a8 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:07.546163 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2102d4b1-47a6-4834-876c-fe0d5d4f65a8 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9" status: 200 len: 1367 microversion: 2.1 time: 0.984052 Oct 18 15:37:07.546761 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1380/2865] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:06 2022] GET /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9 => generated 1367 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:07.566909 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-88da6024-aa53-4e1f-bfc8-529991596c37 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:07.568243 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-88da6024-aa53-4e1f-bfc8-529991596c37 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 12e415d7-7c40-41a0-957a-a083dbcf2b43] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:07.574611 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88da6024-aa53-4e1f-bfc8-529991596c37 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:07.575378 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88da6024-aa53-4e1f-bfc8-529991596c37 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:07.575967 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88da6024-aa53-4e1f-bfc8-529991596c37 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:07.576882 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88da6024-aa53-4e1f-bfc8-529991596c37 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:07.577681 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88da6024-aa53-4e1f-bfc8-529991596c37 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:07.578259 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88da6024-aa53-4e1f-bfc8-529991596c37 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:08.056638 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-88da6024-aa53-4e1f-bfc8-529991596c37 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:08.077672 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-88da6024-aa53-4e1f-bfc8-529991596c37 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43" status: 200 len: 1379 microversion: 2.1 time: 0.512505 Oct 18 15:37:08.077847 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1381/2866] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:07 2022] GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43 => generated 1379 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:08.091758 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d9c2c312-72e2-49d7-b7a5-93f44a1cc0d5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:08.106183 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d9c2c312-72e2-49d7-b7a5-93f44a1cc0d5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca" status: 200 len: 1509 microversion: 2.1 time: 0.616949 Oct 18 15:37:08.107105 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1486/2867] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:07 2022] GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca => generated 1509 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:08.112413 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-7edfe3a4-a64a-42fc-ac40-206516b42599 req-a4a1908c-ccad-4e22-b3c4-6a297ab7c2e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57537212-8816-4122-adbe-264f7035a0e9", "tag": "82baf8c1-00b0-44e2-8136-84d45e22d715"}, {"name": "network-changed", "server_uuid": "12e415d7-7c40-41a0-957a-a083dbcf2b43", "tag": "0007790a-c337-4a61-8c95-ee14bba9c445"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:37:08.119203 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-293ae4de-4e67-4393-80d6-95fc6ca9ab40 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:08.120349 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-293ae4de-4e67-4393-80d6-95fc6ca9ab40 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:08.127268 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-7edfe3a4-a64a-42fc-ac40-206516b42599 req-a4a1908c-ccad-4e22-b3c4-6a297ab7c2e5 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:08.128066 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-7edfe3a4-a64a-42fc-ac40-206516b42599 req-a4a1908c-ccad-4e22-b3c4-6a297ab7c2e5 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:08.128560 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-7edfe3a4-a64a-42fc-ac40-206516b42599 req-a4a1908c-ccad-4e22-b3c4-6a297ab7c2e5 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:08.150830 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-7edfe3a4-a64a-42fc-ac40-206516b42599 req-a4a1908c-ccad-4e22-b3c4-6a297ab7c2e5 service nova] Creating event network-changed:82baf8c1-00b0-44e2-8136-84d45e22d715 for instance 57537212-8816-4122-adbe-264f7035a0e9 on n-h1-853682-5 Oct 18 15:37:08.151336 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-7edfe3a4-a64a-42fc-ac40-206516b42599 req-a4a1908c-ccad-4e22-b3c4-6a297ab7c2e5 service nova] Creating event network-changed:0007790a-c337-4a61-8c95-ee14bba9c445 for instance 12e415d7-7c40-41a0-957a-a083dbcf2b43 on n-h2-853682-5 Oct 18 15:37:08.158211 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-293ae4de-4e67-4393-80d6-95fc6ca9ab40 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:08.159121 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-293ae4de-4e67-4393-80d6-95fc6ca9ab40 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:08.161822 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-293ae4de-4e67-4393-80d6-95fc6ca9ab40 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:08.163278 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-293ae4de-4e67-4393-80d6-95fc6ca9ab40 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:08.165876 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-293ae4de-4e67-4393-80d6-95fc6ca9ab40 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:08.169577 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-293ae4de-4e67-4393-80d6-95fc6ca9ab40 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:08.176257 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-7edfe3a4-a64a-42fc-ac40-206516b42599 req-a4a1908c-ccad-4e22-b3c4-6a297ab7c2e5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.067734 Oct 18 15:37:08.177165 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1487/2868] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:37:08.516434 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2db4592a-8c14-4897-9807-41a42d8872f5 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:08.517217 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2db4592a-8c14-4897-9807-41a42d8872f5 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] [instance: 004539c4-260d-46a9-beed-d9c4b9a76106] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:08.532330 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2db4592a-8c14-4897-9807-41a42d8872f5 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:08.533226 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2db4592a-8c14-4897-9807-41a42d8872f5 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:08.534068 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2db4592a-8c14-4897-9807-41a42d8872f5 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:08.534975 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2db4592a-8c14-4897-9807-41a42d8872f5 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:08.535639 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2db4592a-8c14-4897-9807-41a42d8872f5 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:08.537010 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2db4592a-8c14-4897-9807-41a42d8872f5 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:08.639537 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-293ae4de-4e67-4393-80d6-95fc6ca9ab40 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:08.651547 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-293ae4de-4e67-4393-80d6-95fc6ca9ab40 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c" status: 200 len: 1472 microversion: 2.1 time: 0.569794 Oct 18 15:37:08.652482 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1382/2869] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:08 2022] GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c => generated 1472 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:08.672926 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3281e982-b15a-4248-aa2c-170857998722 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:08.673843 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3281e982-b15a-4248-aa2c-170857998722 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 57537212-8816-4122-adbe-264f7035a0e9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:08.683878 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3281e982-b15a-4248-aa2c-170857998722 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:08.684529 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3281e982-b15a-4248-aa2c-170857998722 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:08.685052 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3281e982-b15a-4248-aa2c-170857998722 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:08.685762 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3281e982-b15a-4248-aa2c-170857998722 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:08.686519 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3281e982-b15a-4248-aa2c-170857998722 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:08.687985 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3281e982-b15a-4248-aa2c-170857998722 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:08.972242 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2db4592a-8c14-4897-9807-41a42d8872f5 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36635345398478eb011416cae492244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d7770bf1ee4b46a1e4bdf61dc2d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:08.985460 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2db4592a-8c14-4897-9807-41a42d8872f5 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "GET /compute/v2.1/servers/004539c4-260d-46a9-beed-d9c4b9a76106" status: 200 len: 1317 microversion: 2.1 time: 0.473508 Oct 18 15:37:08.986305 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1488/2870] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:08 2022] GET /compute/v2.1/servers/004539c4-260d-46a9-beed-d9c4b9a76106 => generated 1317 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:37:09.017150 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3281e982-b15a-4248-aa2c-170857998722 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:09.028420 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3281e982-b15a-4248-aa2c-170857998722 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9" status: 200 len: 1367 microversion: 2.1 time: 0.374645 Oct 18 15:37:09.029875 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1383/2871] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:08 2022] GET /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9 => generated 1367 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:09.105785 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-42dfcf23-a6ea-4188-ae04-91c5c1e7a6d9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:09.106798 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-42dfcf23-a6ea-4188-ae04-91c5c1e7a6d9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 12e415d7-7c40-41a0-957a-a083dbcf2b43] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:09.113360 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-42dfcf23-a6ea-4188-ae04-91c5c1e7a6d9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:09.114083 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-42dfcf23-a6ea-4188-ae04-91c5c1e7a6d9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:09.114803 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-42dfcf23-a6ea-4188-ae04-91c5c1e7a6d9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:09.115673 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-42dfcf23-a6ea-4188-ae04-91c5c1e7a6d9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:09.116344 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-42dfcf23-a6ea-4188-ae04-91c5c1e7a6d9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:09.117127 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-42dfcf23-a6ea-4188-ae04-91c5c1e7a6d9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:09.137186 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4ca2344b-8ed1-475f-910d-0074fc05b543 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:09.137783 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4ca2344b-8ed1-475f-910d-0074fc05b543 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:09.139903 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:37:09.149342 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ca2344b-8ed1-475f-910d-0074fc05b543 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:09.151004 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ca2344b-8ed1-475f-910d-0074fc05b543 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:09.151817 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ca2344b-8ed1-475f-910d-0074fc05b543 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:09.153443 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ca2344b-8ed1-475f-910d-0074fc05b543 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:09.164139 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ca2344b-8ed1-475f-910d-0074fc05b543 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:09.164922 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ca2344b-8ed1-475f-910d-0074fc05b543 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:09.590257 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-42dfcf23-a6ea-4188-ae04-91c5c1e7a6d9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:09.604443 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-42dfcf23-a6ea-4188-ae04-91c5c1e7a6d9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43" status: 200 len: 1379 microversion: 2.1 time: 0.504508 Oct 18 15:37:09.605535 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1489/2872] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:09 2022] GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43 => generated 1379 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:09.637607 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4ca2344b-8ed1-475f-910d-0074fc05b543 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:09.651036 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4ca2344b-8ed1-475f-910d-0074fc05b543 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca" status: 200 len: 1509 microversion: 2.1 time: 0.517540 Oct 18 15:37:09.652948 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1384/2873] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:09 2022] GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca => generated 1509 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:09.685945 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4673223c-56d1-4284-8df1-af7d900b5b60 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:09.686885 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4673223c-56d1-4284-8df1-af7d900b5b60 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:09.703269 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4673223c-56d1-4284-8df1-af7d900b5b60 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:09.704544 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4673223c-56d1-4284-8df1-af7d900b5b60 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:09.705427 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4673223c-56d1-4284-8df1-af7d900b5b60 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:09.706869 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4673223c-56d1-4284-8df1-af7d900b5b60 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:09.709254 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4673223c-56d1-4284-8df1-af7d900b5b60 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:09.709797 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4673223c-56d1-4284-8df1-af7d900b5b60 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:10.008711 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-809133fa-4165-41b0-b226-a6863e8db822 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:10.009650 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-809133fa-4165-41b0-b226-a6863e8db822 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] [instance: 004539c4-260d-46a9-beed-d9c4b9a76106] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:10.025139 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-809133fa-4165-41b0-b226-a6863e8db822 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:10.026724 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-809133fa-4165-41b0-b226-a6863e8db822 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:10.027466 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-809133fa-4165-41b0-b226-a6863e8db822 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:10.029469 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-809133fa-4165-41b0-b226-a6863e8db822 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:10.030205 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-809133fa-4165-41b0-b226-a6863e8db822 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:10.034078 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-809133fa-4165-41b0-b226-a6863e8db822 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:10.848270 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4673223c-56d1-4284-8df1-af7d900b5b60 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:10.856594 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4673223c-56d1-4284-8df1-af7d900b5b60 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c" status: 200 len: 1472 microversion: 2.1 time: 1.185252 Oct 18 15:37:10.872415 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-809133fa-4165-41b0-b226-a6863e8db822 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36635345398478eb011416cae492244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d7770bf1ee4b46a1e4bdf61dc2d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:10.872415 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-809133fa-4165-41b0-b226-a6863e8db822 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "GET /compute/v2.1/servers/004539c4-260d-46a9-beed-d9c4b9a76106" status: 200 len: 1317 microversion: 2.1 time: 0.866702 Oct 18 15:37:10.873687 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1490/2874] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:09 2022] GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c => generated 1472 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:10.878773 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-769c434c-6dfb-4d85-b803-f81654690914 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:10.879611 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-769c434c-6dfb-4d85-b803-f81654690914 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 57537212-8816-4122-adbe-264f7035a0e9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:10.885230 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1385/2875] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:10 2022] GET /compute/v2.1/servers/004539c4-260d-46a9-beed-d9c4b9a76106 => generated 1317 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:10.887348 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-769c434c-6dfb-4d85-b803-f81654690914 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:10.888064 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-769c434c-6dfb-4d85-b803-f81654690914 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:10.888697 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-769c434c-6dfb-4d85-b803-f81654690914 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:10.889663 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-769c434c-6dfb-4d85-b803-f81654690914 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:10.890486 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-769c434c-6dfb-4d85-b803-f81654690914 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:10.891107 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-769c434c-6dfb-4d85-b803-f81654690914 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:10.891520 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-63cee528-a7d7-4b02-8415-1e5d357e5421 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:10.892150 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-63cee528-a7d7-4b02-8415-1e5d357e5421 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 12e415d7-7c40-41a0-957a-a083dbcf2b43] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:10.897088 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=100 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:37:10.905732 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63cee528-a7d7-4b02-8415-1e5d357e5421 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:10.909265 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63cee528-a7d7-4b02-8415-1e5d357e5421 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:10.909741 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63cee528-a7d7-4b02-8415-1e5d357e5421 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:10.913209 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63cee528-a7d7-4b02-8415-1e5d357e5421 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:10.913750 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63cee528-a7d7-4b02-8415-1e5d357e5421 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:10.915439 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63cee528-a7d7-4b02-8415-1e5d357e5421 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:11.176200 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=4 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:37:11.206288 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=30 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:37:11.375940 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-769c434c-6dfb-4d85-b803-f81654690914 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:11.387555 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-769c434c-6dfb-4d85-b803-f81654690914 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9" status: 200 len: 1367 microversion: 2.1 time: 0.512482 Oct 18 15:37:11.388915 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1491/2876] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:10 2022] GET /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9 => generated 1367 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:11.392161 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-63cee528-a7d7-4b02-8415-1e5d357e5421 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:11.394435 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b8554c95-23d0-4607-aa80-8a65861b7350 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:11.395496 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b8554c95-23d0-4607-aa80-8a65861b7350 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:11.402607 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b8554c95-23d0-4607-aa80-8a65861b7350 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:11.403457 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b8554c95-23d0-4607-aa80-8a65861b7350 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:11.404281 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b8554c95-23d0-4607-aa80-8a65861b7350 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:11.406031 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b8554c95-23d0-4607-aa80-8a65861b7350 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:11.406742 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b8554c95-23d0-4607-aa80-8a65861b7350 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:11.407398 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b8554c95-23d0-4607-aa80-8a65861b7350 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:11.409343 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-63cee528-a7d7-4b02-8415-1e5d357e5421 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43" status: 200 len: 1379 microversion: 2.1 time: 0.522456 Oct 18 15:37:11.409962 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1386/2877] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:10 2022] GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43 => generated 1379 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:11.804603 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b8554c95-23d0-4607-aa80-8a65861b7350 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:11.825473 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b8554c95-23d0-4607-aa80-8a65861b7350 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca" status: 200 len: 1509 microversion: 2.1 time: 0.435000 Oct 18 15:37:11.841363 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1492/2878] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:11 2022] GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca => generated 1509 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:11.889104 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4d3d1870-7aeb-4408-b056-0377a23a488e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:11.891411 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4d3d1870-7aeb-4408-b056-0377a23a488e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:11.912007 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-26a2b35e-d1dd-444c-8932-ab6fd662205a tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:11.915586 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-26a2b35e-d1dd-444c-8932-ab6fd662205a tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] [instance: 004539c4-260d-46a9-beed-d9c4b9a76106] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:11.922796 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=10 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:37:11.927222 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d3d1870-7aeb-4408-b056-0377a23a488e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:11.933573 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26a2b35e-d1dd-444c-8932-ab6fd662205a tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:11.934181 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26a2b35e-d1dd-444c-8932-ab6fd662205a tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:11.936509 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d3d1870-7aeb-4408-b056-0377a23a488e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:11.938100 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d3d1870-7aeb-4408-b056-0377a23a488e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:11.938225 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26a2b35e-d1dd-444c-8932-ab6fd662205a tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:11.938995 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26a2b35e-d1dd-444c-8932-ab6fd662205a tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:11.939498 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26a2b35e-d1dd-444c-8932-ab6fd662205a tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:11.939942 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26a2b35e-d1dd-444c-8932-ab6fd662205a tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:11.941623 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d3d1870-7aeb-4408-b056-0377a23a488e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:11.946843 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d3d1870-7aeb-4408-b056-0377a23a488e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:11.948497 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d3d1870-7aeb-4408-b056-0377a23a488e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:12.401899 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4d3d1870-7aeb-4408-b056-0377a23a488e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:12.416793 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4d3d1870-7aeb-4408-b056-0377a23a488e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c" status: 200 len: 1478 microversion: 2.1 time: 0.539241 Oct 18 15:37:12.418097 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1387/2879] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:11 2022] GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c => generated 1478 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:12.424948 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-c806c040-8491-4abf-8565-26870dfe8163 req-7a3f52d3-69e4-40bc-a3c9-975383ccf3c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "004539c4-260d-46a9-beed-d9c4b9a76106", "name": "network-vif-plugged", "status": "completed", "tag": "7e81b5b0-1e7e-436b-84c7-bab9312ea51d"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:37:12.431090 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-26a2b35e-d1dd-444c-8932-ab6fd662205a tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36635345398478eb011416cae492244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d7770bf1ee4b46a1e4bdf61dc2d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:12.446922 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-26a2b35e-d1dd-444c-8932-ab6fd662205a tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "GET /compute/v2.1/servers/004539c4-260d-46a9-beed-d9c4b9a76106" status: 200 len: 1317 microversion: 2.1 time: 0.553483 Oct 18 15:37:12.447526 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1493/2880] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:11 2022] GET /compute/v2.1/servers/004539c4-260d-46a9-beed-d9c4b9a76106 => generated 1317 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:12.463347 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c806c040-8491-4abf-8565-26870dfe8163 req-7a3f52d3-69e4-40bc-a3c9-975383ccf3c9 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:12.466677 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c806c040-8491-4abf-8565-26870dfe8163 req-7a3f52d3-69e4-40bc-a3c9-975383ccf3c9 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:12.466677 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c806c040-8491-4abf-8565-26870dfe8163 req-7a3f52d3-69e4-40bc-a3c9-975383ccf3c9 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:12.470348 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b2f611b1-ec89-4f49-8a77-8c2b15a5b78b tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:12.471394 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b2f611b1-ec89-4f49-8a77-8c2b15a5b78b tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 57537212-8816-4122-adbe-264f7035a0e9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:12.480851 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-c806c040-8491-4abf-8565-26870dfe8163 req-7a3f52d3-69e4-40bc-a3c9-975383ccf3c9 service nova] Creating event network-vif-plugged:7e81b5b0-1e7e-436b-84c7-bab9312ea51d for instance 004539c4-260d-46a9-beed-d9c4b9a76106 on n-h1-853682-5 Oct 18 15:37:12.481230 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b2f611b1-ec89-4f49-8a77-8c2b15a5b78b tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:12.481950 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b2f611b1-ec89-4f49-8a77-8c2b15a5b78b tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:12.482770 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b2f611b1-ec89-4f49-8a77-8c2b15a5b78b tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:12.483716 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b2f611b1-ec89-4f49-8a77-8c2b15a5b78b tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:12.484398 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b2f611b1-ec89-4f49-8a77-8c2b15a5b78b tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:12.485130 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b2f611b1-ec89-4f49-8a77-8c2b15a5b78b tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:12.486032 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-c806c040-8491-4abf-8565-26870dfe8163 req-7a3f52d3-69e4-40bc-a3c9-975383ccf3c9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066396 Oct 18 15:37:12.487136 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1388/2881] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:37:12.496059 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-410a12ea-9351-4949-aaab-96133884d052 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:12.496862 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-410a12ea-9351-4949-aaab-96133884d052 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 12e415d7-7c40-41a0-957a-a083dbcf2b43] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:12.512473 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-410a12ea-9351-4949-aaab-96133884d052 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:12.513025 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-410a12ea-9351-4949-aaab-96133884d052 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:12.513492 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-410a12ea-9351-4949-aaab-96133884d052 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:12.518010 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-410a12ea-9351-4949-aaab-96133884d052 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:12.518682 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-410a12ea-9351-4949-aaab-96133884d052 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:12.519130 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-410a12ea-9351-4949-aaab-96133884d052 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:12.882800 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-410a12ea-9351-4949-aaab-96133884d052 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:12.888105 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:37:12.894120 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b2f611b1-ec89-4f49-8a77-8c2b15a5b78b tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:12.912079 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-410a12ea-9351-4949-aaab-96133884d052 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43" status: 200 len: 1379 microversion: 2.1 time: 0.420389 Oct 18 15:37:12.912595 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b2f611b1-ec89-4f49-8a77-8c2b15a5b78b tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9" status: 200 len: 1367 microversion: 2.1 time: 0.449322 Oct 18 15:37:12.914748 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1389/2882] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:12 2022] GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43 => generated 1379 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:12.915222 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1494/2883] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:12 2022] GET /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9 => generated 1367 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:12.925918 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dca20da0-79a5-430e-9090-8decbff60609 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:12.926802 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dca20da0-79a5-430e-9090-8decbff60609 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:12.933839 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dca20da0-79a5-430e-9090-8decbff60609 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:12.934637 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dca20da0-79a5-430e-9090-8decbff60609 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:12.935487 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dca20da0-79a5-430e-9090-8decbff60609 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:12.936997 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dca20da0-79a5-430e-9090-8decbff60609 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:12.938302 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dca20da0-79a5-430e-9090-8decbff60609 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:12.938912 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dca20da0-79a5-430e-9090-8decbff60609 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:13.182315 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dca20da0-79a5-430e-9090-8decbff60609 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:13.192490 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dca20da0-79a5-430e-9090-8decbff60609 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca" status: 200 len: 1509 microversion: 2.1 time: 0.276307 Oct 18 15:37:13.193127 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1390/2884] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:12 2022] GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca => generated 1509 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:13.444665 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a207f7dd-e259-43c8-bf6b-d7bdfd63289d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:13.445463 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a207f7dd-e259-43c8-bf6b-d7bdfd63289d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:13.452265 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a207f7dd-e259-43c8-bf6b-d7bdfd63289d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:13.452882 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a207f7dd-e259-43c8-bf6b-d7bdfd63289d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:13.453407 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a207f7dd-e259-43c8-bf6b-d7bdfd63289d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:13.454326 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a207f7dd-e259-43c8-bf6b-d7bdfd63289d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:13.455244 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a207f7dd-e259-43c8-bf6b-d7bdfd63289d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:13.455877 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a207f7dd-e259-43c8-bf6b-d7bdfd63289d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:13.497639 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-be371483-c888-4122-9e06-f54f70fc22f1 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:13.499697 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-be371483-c888-4122-9e06-f54f70fc22f1 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] [instance: 004539c4-260d-46a9-beed-d9c4b9a76106] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:13.510107 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be371483-c888-4122-9e06-f54f70fc22f1 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:13.510594 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be371483-c888-4122-9e06-f54f70fc22f1 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:13.511196 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be371483-c888-4122-9e06-f54f70fc22f1 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:13.512090 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be371483-c888-4122-9e06-f54f70fc22f1 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:13.512553 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be371483-c888-4122-9e06-f54f70fc22f1 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:13.513067 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be371483-c888-4122-9e06-f54f70fc22f1 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:13.698914 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a207f7dd-e259-43c8-bf6b-d7bdfd63289d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:13.708399 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a207f7dd-e259-43c8-bf6b-d7bdfd63289d tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c" status: 200 len: 1478 microversion: 2.1 time: 0.267495 Oct 18 15:37:13.721416 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1495/2885] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:13 2022] GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c => generated 1478 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:13.772493 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-be371483-c888-4122-9e06-f54f70fc22f1 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36635345398478eb011416cae492244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d7770bf1ee4b46a1e4bdf61dc2d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:13.794514 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-be371483-c888-4122-9e06-f54f70fc22f1 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "GET /compute/v2.1/servers/004539c4-260d-46a9-beed-d9c4b9a76106" status: 200 len: 1317 microversion: 2.1 time: 0.323301 Oct 18 15:37:13.795684 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1391/2886] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:13 2022] GET /compute/v2.1/servers/004539c4-260d-46a9-beed-d9c4b9a76106 => generated 1317 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:37:13.955880 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5d10243b-350e-4a6d-a34c-3b4e9fac614a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:13.957258 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bfe1b195-f076-4fc2-af7d-ce141a30375d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:13.959403 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5d10243b-350e-4a6d-a34c-3b4e9fac614a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 57537212-8816-4122-adbe-264f7035a0e9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:13.960723 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-bfe1b195-f076-4fc2-af7d-ce141a30375d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 12e415d7-7c40-41a0-957a-a083dbcf2b43] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:13.972530 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bfe1b195-f076-4fc2-af7d-ce141a30375d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:13.973365 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bfe1b195-f076-4fc2-af7d-ce141a30375d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:13.974230 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bfe1b195-f076-4fc2-af7d-ce141a30375d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:13.975422 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bfe1b195-f076-4fc2-af7d-ce141a30375d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:13.977046 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bfe1b195-f076-4fc2-af7d-ce141a30375d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:13.977898 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bfe1b195-f076-4fc2-af7d-ce141a30375d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:13.982268 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d10243b-350e-4a6d-a34c-3b4e9fac614a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:13.982781 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d10243b-350e-4a6d-a34c-3b4e9fac614a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:13.983230 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d10243b-350e-4a6d-a34c-3b4e9fac614a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:13.985997 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d10243b-350e-4a6d-a34c-3b4e9fac614a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:13.989401 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d10243b-350e-4a6d-a34c-3b4e9fac614a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:13.990178 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d10243b-350e-4a6d-a34c-3b4e9fac614a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:14.318308 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5d10243b-350e-4a6d-a34c-3b4e9fac614a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:14.335736 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5d10243b-350e-4a6d-a34c-3b4e9fac614a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9" status: 200 len: 1367 microversion: 2.1 time: 0.392827 Oct 18 15:37:14.336479 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1392/2887] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:13 2022] GET /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9 => generated 1367 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:14.359008 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6ce80888-81a1-48b0-bce2-98f514bfffa5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:14.359744 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6ce80888-81a1-48b0-bce2-98f514bfffa5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:14.367189 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ce80888-81a1-48b0-bce2-98f514bfffa5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:14.367772 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ce80888-81a1-48b0-bce2-98f514bfffa5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:14.368209 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ce80888-81a1-48b0-bce2-98f514bfffa5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:14.369148 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ce80888-81a1-48b0-bce2-98f514bfffa5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:14.372165 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ce80888-81a1-48b0-bce2-98f514bfffa5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:14.372954 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ce80888-81a1-48b0-bce2-98f514bfffa5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:14.425525 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-bfe1b195-f076-4fc2-af7d-ce141a30375d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:14.443933 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-bfe1b195-f076-4fc2-af7d-ce141a30375d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43" status: 200 len: 1379 microversion: 2.1 time: 0.505273 Oct 18 15:37:14.446636 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1496/2888] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:13 2022] GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43 => generated 1379 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:14.566656 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-d2b7ef88-5f98-4560-931a-c855ae01309a req-64c276ef-c4f4-446b-bc47-48b3547a9aaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12e415d7-7c40-41a0-957a-a083dbcf2b43", "name": "network-vif-plugged", "status": "completed", "tag": "0007790a-c337-4a61-8c95-ee14bba9c445"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:37:14.582174 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-d2b7ef88-5f98-4560-931a-c855ae01309a req-64c276ef-c4f4-446b-bc47-48b3547a9aaa service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:14.583201 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-d2b7ef88-5f98-4560-931a-c855ae01309a req-64c276ef-c4f4-446b-bc47-48b3547a9aaa service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:14.583861 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-d2b7ef88-5f98-4560-931a-c855ae01309a req-64c276ef-c4f4-446b-bc47-48b3547a9aaa service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:14.612008 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-d2b7ef88-5f98-4560-931a-c855ae01309a req-64c276ef-c4f4-446b-bc47-48b3547a9aaa service nova] Creating event network-vif-plugged:0007790a-c337-4a61-8c95-ee14bba9c445 for instance 12e415d7-7c40-41a0-957a-a083dbcf2b43 on n-h2-853682-5 Oct 18 15:37:14.619865 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-d2b7ef88-5f98-4560-931a-c855ae01309a req-64c276ef-c4f4-446b-bc47-48b3547a9aaa service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060240 Oct 18 15:37:14.625213 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1497/2889] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:37:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:37:14.734109 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6ce80888-81a1-48b0-bce2-98f514bfffa5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:14.735348 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-52e92ac1-bea7-4ff8-8bc3-b1c1d25501ee tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:14.736223 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-52e92ac1-bea7-4ff8-8bc3-b1c1d25501ee tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:14.745580 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-52e92ac1-bea7-4ff8-8bc3-b1c1d25501ee tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:14.746262 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-52e92ac1-bea7-4ff8-8bc3-b1c1d25501ee tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:14.746918 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-52e92ac1-bea7-4ff8-8bc3-b1c1d25501ee tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:14.747648 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6ce80888-81a1-48b0-bce2-98f514bfffa5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca" status: 200 len: 1509 microversion: 2.1 time: 0.392955 Oct 18 15:37:14.748598 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-52e92ac1-bea7-4ff8-8bc3-b1c1d25501ee tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:14.749298 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-52e92ac1-bea7-4ff8-8bc3-b1c1d25501ee tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:14.749940 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-52e92ac1-bea7-4ff8-8bc3-b1c1d25501ee tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:14.750218 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1393/2890] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:14 2022] GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca => generated 1509 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:14.820117 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-323ed181-d4d3-48f3-9820-3965b5e9da94 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:14.820800 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-323ed181-d4d3-48f3-9820-3965b5e9da94 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] [instance: 004539c4-260d-46a9-beed-d9c4b9a76106] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:14.839889 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-323ed181-d4d3-48f3-9820-3965b5e9da94 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:14.849390 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-323ed181-d4d3-48f3-9820-3965b5e9da94 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:14.850738 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-323ed181-d4d3-48f3-9820-3965b5e9da94 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:14.851851 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-323ed181-d4d3-48f3-9820-3965b5e9da94 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:14.852747 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-323ed181-d4d3-48f3-9820-3965b5e9da94 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:14.854044 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-323ed181-d4d3-48f3-9820-3965b5e9da94 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:15.242020 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-52e92ac1-bea7-4ff8-8bc3-b1c1d25501ee tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:15.259639 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-52e92ac1-bea7-4ff8-8bc3-b1c1d25501ee tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c" status: 200 len: 1478 microversion: 2.1 time: 0.529995 Oct 18 15:37:15.261109 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1498/2891] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:14 2022] GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c => generated 1478 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:15.334438 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-323ed181-d4d3-48f3-9820-3965b5e9da94 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36635345398478eb011416cae492244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d7770bf1ee4b46a1e4bdf61dc2d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:15.343362 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-323ed181-d4d3-48f3-9820-3965b5e9da94 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "GET /compute/v2.1/servers/004539c4-260d-46a9-beed-d9c4b9a76106" status: 200 len: 1317 microversion: 2.1 time: 0.529095 Oct 18 15:37:15.344232 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1394/2892] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:14 2022] GET /compute/v2.1/servers/004539c4-260d-46a9-beed-d9c4b9a76106 => generated 1317 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:37:15.362152 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7b879da5-d7c0-43e1-b5bd-a43a24dbdb55 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:15.363197 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7b879da5-d7c0-43e1-b5bd-a43a24dbdb55 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 57537212-8816-4122-adbe-264f7035a0e9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:15.371850 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7b879da5-d7c0-43e1-b5bd-a43a24dbdb55 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:15.372459 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7b879da5-d7c0-43e1-b5bd-a43a24dbdb55 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:15.373055 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7b879da5-d7c0-43e1-b5bd-a43a24dbdb55 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:15.373958 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7b879da5-d7c0-43e1-b5bd-a43a24dbdb55 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:15.374526 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7b879da5-d7c0-43e1-b5bd-a43a24dbdb55 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:15.375714 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7b879da5-d7c0-43e1-b5bd-a43a24dbdb55 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:15.469643 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-76bdd5ba-3bcd-4a7b-9092-0b66d050c9f4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:15.470191 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-76bdd5ba-3bcd-4a7b-9092-0b66d050c9f4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 12e415d7-7c40-41a0-957a-a083dbcf2b43] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:15.482492 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76bdd5ba-3bcd-4a7b-9092-0b66d050c9f4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:15.483464 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76bdd5ba-3bcd-4a7b-9092-0b66d050c9f4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:15.485147 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76bdd5ba-3bcd-4a7b-9092-0b66d050c9f4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:15.486225 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76bdd5ba-3bcd-4a7b-9092-0b66d050c9f4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:15.488917 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76bdd5ba-3bcd-4a7b-9092-0b66d050c9f4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:15.489997 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76bdd5ba-3bcd-4a7b-9092-0b66d050c9f4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:16.083415 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7b879da5-d7c0-43e1-b5bd-a43a24dbdb55 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:16.092200 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7b879da5-d7c0-43e1-b5bd-a43a24dbdb55 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9" status: 200 len: 1367 microversion: 2.1 time: 0.734055 Oct 18 15:37:16.092796 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1499/2893] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:15 2022] GET /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9 => generated 1367 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:16.110016 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8d1deaff-fd2a-4175-ab80-a14ca9e5dd4f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:16.110641 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8d1deaff-fd2a-4175-ab80-a14ca9e5dd4f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:16.126881 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8d1deaff-fd2a-4175-ab80-a14ca9e5dd4f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:16.127644 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8d1deaff-fd2a-4175-ab80-a14ca9e5dd4f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:16.128261 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8d1deaff-fd2a-4175-ab80-a14ca9e5dd4f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:16.129037 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8d1deaff-fd2a-4175-ab80-a14ca9e5dd4f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:16.129510 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8d1deaff-fd2a-4175-ab80-a14ca9e5dd4f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:16.129945 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8d1deaff-fd2a-4175-ab80-a14ca9e5dd4f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:16.157805 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-76bdd5ba-3bcd-4a7b-9092-0b66d050c9f4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:16.171076 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-76bdd5ba-3bcd-4a7b-9092-0b66d050c9f4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43" status: 200 len: 1379 microversion: 2.1 time: 0.704209 Oct 18 15:37:16.171879 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1395/2894] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:15 2022] GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43 => generated 1379 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:37:16.284603 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d3451803-52dd-4b1e-a177-e6447d68ceb0 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:16.285384 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d3451803-52dd-4b1e-a177-e6447d68ceb0 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:16.299687 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3451803-52dd-4b1e-a177-e6447d68ceb0 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:16.300415 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3451803-52dd-4b1e-a177-e6447d68ceb0 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:16.301054 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3451803-52dd-4b1e-a177-e6447d68ceb0 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:16.301941 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3451803-52dd-4b1e-a177-e6447d68ceb0 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:16.303419 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3451803-52dd-4b1e-a177-e6447d68ceb0 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:16.306116 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3451803-52dd-4b1e-a177-e6447d68ceb0 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:16.766349 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8d1deaff-fd2a-4175-ab80-a14ca9e5dd4f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:16.774593 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8d1deaff-fd2a-4175-ab80-a14ca9e5dd4f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca" status: 200 len: 1509 microversion: 2.1 time: 0.669018 Oct 18 15:37:16.775190 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1500/2895] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:16 2022] GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca => generated 1509 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:16.799758 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-88d52876-405c-490a-84e8-450089456d4c tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:16.808144 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-88d52876-405c-490a-84e8-450089456d4c tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] [instance: 004539c4-260d-46a9-beed-d9c4b9a76106] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:16.821601 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-88d52876-405c-490a-84e8-450089456d4c tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:16.833669 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-88d52876-405c-490a-84e8-450089456d4c tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:16.834385 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-88d52876-405c-490a-84e8-450089456d4c tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:16.835376 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-88d52876-405c-490a-84e8-450089456d4c tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:16.836005 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-88d52876-405c-490a-84e8-450089456d4c tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:16.836598 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-88d52876-405c-490a-84e8-450089456d4c tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:16.888471 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d3451803-52dd-4b1e-a177-e6447d68ceb0 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:16.897331 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d3451803-52dd-4b1e-a177-e6447d68ceb0 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c" status: 200 len: 1478 microversion: 2.1 time: 0.617093 Oct 18 15:37:16.907628 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1396/2896] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:16 2022] GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c => generated 1478 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:16.917642 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-4be41b30-b1db-48a4-ad8e-3144c3a06f7c req-9f563f24-89f7-48fa-8482-6abb0cf5f0fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35e5cf0e-693b-4930-9665-f1a53983cc1c", "name": "network-vif-unplugged", "status": "completed", "tag": "2ca5d763-fca7-4b76-a60b-8e961f804f14"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:37:16.932572 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4be41b30-b1db-48a4-ad8e-3144c3a06f7c req-9f563f24-89f7-48fa-8482-6abb0cf5f0fc service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:16.933380 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4be41b30-b1db-48a4-ad8e-3144c3a06f7c req-9f563f24-89f7-48fa-8482-6abb0cf5f0fc service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:16.934026 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4be41b30-b1db-48a4-ad8e-3144c3a06f7c req-9f563f24-89f7-48fa-8482-6abb0cf5f0fc service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:16.957966 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-4be41b30-b1db-48a4-ad8e-3144c3a06f7c req-9f563f24-89f7-48fa-8482-6abb0cf5f0fc service nova] Creating event network-vif-unplugged:2ca5d763-fca7-4b76-a60b-8e961f804f14 for instance 35e5cf0e-693b-4930-9665-f1a53983cc1c on n-h1-853682-5 Oct 18 15:37:16.966727 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-4be41b30-b1db-48a4-ad8e-3144c3a06f7c req-9f563f24-89f7-48fa-8482-6abb0cf5f0fc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057292 Oct 18 15:37:16.968040 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1397/2897] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:37:17.117326 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-999eeb94-6829-43a5-af52-0fa193ee58b6 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:17.118448 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-999eeb94-6829-43a5-af52-0fa193ee58b6 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 57537212-8816-4122-adbe-264f7035a0e9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:17.125456 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-999eeb94-6829-43a5-af52-0fa193ee58b6 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:17.126238 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-999eeb94-6829-43a5-af52-0fa193ee58b6 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:17.126830 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-999eeb94-6829-43a5-af52-0fa193ee58b6 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:17.127726 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-999eeb94-6829-43a5-af52-0fa193ee58b6 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:17.128772 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-999eeb94-6829-43a5-af52-0fa193ee58b6 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:17.130683 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-999eeb94-6829-43a5-af52-0fa193ee58b6 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:17.203398 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-88d52876-405c-490a-84e8-450089456d4c tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36635345398478eb011416cae492244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d7770bf1ee4b46a1e4bdf61dc2d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:17.215629 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-88d52876-405c-490a-84e8-450089456d4c tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "GET /compute/v2.1/servers/004539c4-260d-46a9-beed-d9c4b9a76106" status: 200 len: 1317 microversion: 2.1 time: 0.419631 Oct 18 15:37:17.216918 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1501/2898] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:16 2022] GET /compute/v2.1/servers/004539c4-260d-46a9-beed-d9c4b9a76106 => generated 1317 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:17.223069 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-03de8165-8858-409f-a1b2-eb227d979572 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:17.224031 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-03de8165-8858-409f-a1b2-eb227d979572 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 12e415d7-7c40-41a0-957a-a083dbcf2b43] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:17.231455 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-03de8165-8858-409f-a1b2-eb227d979572 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:17.232247 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-03de8165-8858-409f-a1b2-eb227d979572 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:17.232867 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-03de8165-8858-409f-a1b2-eb227d979572 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:17.233791 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-03de8165-8858-409f-a1b2-eb227d979572 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:17.234407 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-03de8165-8858-409f-a1b2-eb227d979572 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:17.235027 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-03de8165-8858-409f-a1b2-eb227d979572 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:17.604239 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-999eeb94-6829-43a5-af52-0fa193ee58b6 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:17.620318 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-999eeb94-6829-43a5-af52-0fa193ee58b6 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9" status: 200 len: 1367 microversion: 2.1 time: 0.507887 Oct 18 15:37:17.620943 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1398/2899] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:17 2022] GET /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9 => generated 1367 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:17.626243 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-03de8165-8858-409f-a1b2-eb227d979572 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:17.635912 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-03de8165-8858-409f-a1b2-eb227d979572 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43" status: 200 len: 1529 microversion: 2.1 time: 0.417590 Oct 18 15:37:17.637295 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1502/2900] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:17 2022] GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43 => generated 1529 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:17.660024 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fb1e99d6-a145-4053-8d03-efeedbeb22a1 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:17.660850 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fb1e99d6-a145-4053-8d03-efeedbeb22a1 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 12e415d7-7c40-41a0-957a-a083dbcf2b43] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:17.667808 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb1e99d6-a145-4053-8d03-efeedbeb22a1 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:17.668541 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb1e99d6-a145-4053-8d03-efeedbeb22a1 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:17.669204 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb1e99d6-a145-4053-8d03-efeedbeb22a1 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:17.670345 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb1e99d6-a145-4053-8d03-efeedbeb22a1 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:17.670963 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb1e99d6-a145-4053-8d03-efeedbeb22a1 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:17.671552 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb1e99d6-a145-4053-8d03-efeedbeb22a1 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:17.807019 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-07ad0a70-d149-4021-8281-f492fcd8b224 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:17.808392 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-07ad0a70-d149-4021-8281-f492fcd8b224 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:17.833220 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-07ad0a70-d149-4021-8281-f492fcd8b224 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:17.836547 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-07ad0a70-d149-4021-8281-f492fcd8b224 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:17.837485 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-07ad0a70-d149-4021-8281-f492fcd8b224 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:17.839447 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-07ad0a70-d149-4021-8281-f492fcd8b224 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:17.841089 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-07ad0a70-d149-4021-8281-f492fcd8b224 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:17.844492 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-07ad0a70-d149-4021-8281-f492fcd8b224 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:17.921134 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fb1e99d6-a145-4053-8d03-efeedbeb22a1 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:17.929452 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fb1e99d6-a145-4053-8d03-efeedbeb22a1 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43" status: 200 len: 1529 microversion: 2.1 time: 0.273709 Oct 18 15:37:17.930035 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1399/2901] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:17 2022] GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43 => generated 1529 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:37:17.958625 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f77f9e05-57ba-4f00-9eeb-e8b50903526f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:17.967397 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f77f9e05-57ba-4f00-9eeb-e8b50903526f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:17.977534 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f77f9e05-57ba-4f00-9eeb-e8b50903526f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:17.980256 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f77f9e05-57ba-4f00-9eeb-e8b50903526f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:17.981366 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f77f9e05-57ba-4f00-9eeb-e8b50903526f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:17.982297 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f77f9e05-57ba-4f00-9eeb-e8b50903526f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:17.984400 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f77f9e05-57ba-4f00-9eeb-e8b50903526f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:17.985076 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f77f9e05-57ba-4f00-9eeb-e8b50903526f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:18.333676 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-07ad0a70-d149-4021-8281-f492fcd8b224 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:18.345008 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-07ad0a70-d149-4021-8281-f492fcd8b224 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca" status: 200 len: 1509 microversion: 2.1 time: 0.545656 Oct 18 15:37:18.353175 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1503/2902] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:17 2022] GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca => generated 1509 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:18.361416 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5dfbcb6a-bde1-44b8-a8ed-ef57892a91fe tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:18.399741 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5dfbcb6a-bde1-44b8-a8ed-ef57892a91fe tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/9e5f28fa-4760-4b58-826f-ff77263a4322" status: 202 len: 0 microversion: 2.1 time: 0.045015 Oct 18 15:37:18.401049 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1504/2903] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:37:18 2022] DELETE /compute/v2.1/flavors/9e5f28fa-4760-4b58-826f-ff77263a4322 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:37:18.424043 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a32c19bc-4a00-4d37-a087-0ac881fc4ddb tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:18.426598 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a32c19bc-4a00-4d37-a087-0ac881fc4ddb tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] [instance: 004539c4-260d-46a9-beed-d9c4b9a76106] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:18.435367 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a32c19bc-4a00-4d37-a087-0ac881fc4ddb tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:18.450289 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a32c19bc-4a00-4d37-a087-0ac881fc4ddb tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:18.451422 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a32c19bc-4a00-4d37-a087-0ac881fc4ddb tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:18.452292 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a32c19bc-4a00-4d37-a087-0ac881fc4ddb tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:18.452905 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a32c19bc-4a00-4d37-a087-0ac881fc4ddb tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:18.453618 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a32c19bc-4a00-4d37-a087-0ac881fc4ddb tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:18.639349 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f77f9e05-57ba-4f00-9eeb-e8b50903526f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:18.651238 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f77f9e05-57ba-4f00-9eeb-e8b50903526f tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c" status: 200 len: 1478 microversion: 2.1 time: 0.715821 Oct 18 15:37:18.652512 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1400/2904] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:17 2022] GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c => generated 1478 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:18.673731 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b74d7c99-0e48-4136-95e4-eed910afee4f tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:18.728015 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b74d7c99-0e48-4136-95e4-eed910afee4f tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.073018 Oct 18 15:37:18.729501 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1401/2905] 10.222.0.60 () {58 vars in 1146 bytes} [Tue Oct 18 15:37:18 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:18.735463 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9a6dea5a-3435-4ad0-9610-fed8173471b8 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:18.736365 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9a6dea5a-3435-4ad0-9610-fed8173471b8 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 57537212-8816-4122-adbe-264f7035a0e9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:18.745114 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a6dea5a-3435-4ad0-9610-fed8173471b8 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:18.745854 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a6dea5a-3435-4ad0-9610-fed8173471b8 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:18.746606 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a6dea5a-3435-4ad0-9610-fed8173471b8 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:18.747573 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a6dea5a-3435-4ad0-9610-fed8173471b8 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:18.748498 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a6dea5a-3435-4ad0-9610-fed8173471b8 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:18.749205 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a6dea5a-3435-4ad0-9610-fed8173471b8 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:19.121018 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a32c19bc-4a00-4d37-a087-0ac881fc4ddb tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36635345398478eb011416cae492244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d7770bf1ee4b46a1e4bdf61dc2d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:19.134436 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a32c19bc-4a00-4d37-a087-0ac881fc4ddb tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "GET /compute/v2.1/servers/004539c4-260d-46a9-beed-d9c4b9a76106" status: 200 len: 1467 microversion: 2.1 time: 0.729993 Oct 18 15:37:19.136963 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1505/2906] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:18 2022] GET /compute/v2.1/servers/004539c4-260d-46a9-beed-d9c4b9a76106 => generated 1467 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:19.161609 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-524f16cc-8527-4cef-9468-7ca0a607746d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:37:19.174959 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9a6dea5a-3435-4ad0-9610-fed8173471b8 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:19.179312 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-524f16cc-8527-4cef-9468-7ca0a607746d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 12e415d7-7c40-41a0-957a-a083dbcf2b43] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:19.186957 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9a6dea5a-3435-4ad0-9610-fed8173471b8 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9" status: 200 len: 1367 microversion: 2.1 time: 0.455704 Oct 18 15:37:19.205043 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1402/2907] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:18 2022] GET /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9 => generated 1367 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:19.207952 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:37:19.215764 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-524f16cc-8527-4cef-9468-7ca0a607746d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:19.216876 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8326e7e4-e61e-4850-94a0-72736883264c tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-328193748", "metadata": {"image_type": "test"}}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:37:19.217574 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-524f16cc-8527-4cef-9468-7ca0a607746d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:19.220311 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8326e7e4-e61e-4850-94a0-72736883264c tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] [instance: 004539c4-260d-46a9-beed-d9c4b9a76106] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:19.221005 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-524f16cc-8527-4cef-9468-7ca0a607746d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:19.221958 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-524f16cc-8527-4cef-9468-7ca0a607746d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:19.222611 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-524f16cc-8527-4cef-9468-7ca0a607746d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:19.223222 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-524f16cc-8527-4cef-9468-7ca0a607746d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:19.241046 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8326e7e4-e61e-4850-94a0-72736883264c tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:19.242032 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8326e7e4-e61e-4850-94a0-72736883264c tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:19.242663 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8326e7e4-e61e-4850-94a0-72736883264c tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:19.243647 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8326e7e4-e61e-4850-94a0-72736883264c tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:19.244323 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8326e7e4-e61e-4850-94a0-72736883264c tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:19.244969 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8326e7e4-e61e-4850-94a0-72736883264c tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:19.330045 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-8326e7e4-e61e-4850-94a0-72736883264c tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Getting quotas for project 68d7770bf1ee4b46a1e4bdf61dc2d711. Resources: dict_keys(['metadata_items']) {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:37:19.336136 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-8326e7e4-e61e-4850-94a0-72736883264c tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Getting quotas for user f36635345398478eb011416cae492244 and project 68d7770bf1ee4b46a1e4bdf61dc2d711. Resources: dict_keys(['metadata_items']) {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:37:19.781090 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8326e7e4-e61e-4850-94a0-72736883264c tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "POST /compute/v2.1/servers/004539c4-260d-46a9-beed-d9c4b9a76106/action" status: 202 len: 0 microversion: 2.1 time: 0.571400 Oct 18 15:37:19.792555 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1403/2908] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:37:19 2022] POST /compute/v2.1/servers/004539c4-260d-46a9-beed-d9c4b9a76106/action => generated 0 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 18 15:37:19.807576 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2b2279ef-e413-4e74-859e-6f2f12a03bbd tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:19.808696 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2b2279ef-e413-4e74-859e-6f2f12a03bbd tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:19.816721 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b2279ef-e413-4e74-859e-6f2f12a03bbd tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:19.821880 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b2279ef-e413-4e74-859e-6f2f12a03bbd tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:19.823358 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b2279ef-e413-4e74-859e-6f2f12a03bbd tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:19.824855 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b2279ef-e413-4e74-859e-6f2f12a03bbd tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:19.825604 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b2279ef-e413-4e74-859e-6f2f12a03bbd tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:19.826261 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b2279ef-e413-4e74-859e-6f2f12a03bbd tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:19.925822 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-524f16cc-8527-4cef-9468-7ca0a607746d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:19.935933 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-524f16cc-8527-4cef-9468-7ca0a607746d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 12e415d7-7c40-41a0-957a-a083dbcf2b43] Old instance type tempest-test_resize_flavor_-1658727702, new instance type m1.heat {{(pid=120405) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 18 15:37:19.947386 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-524f16cc-8527-4cef-9468-7ca0a607746d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:37:19.951181 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-524f16cc-8527-4cef-9468-7ca0a607746d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:37:19.952030 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-524f16cc-8527-4cef-9468-7ca0a607746d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:37:19.953841 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-524f16cc-8527-4cef-9468-7ca0a607746d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:37:19.954975 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-524f16cc-8527-4cef-9468-7ca0a607746d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:37:20.149366 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-524f16cc-8527-4cef-9468-7ca0a607746d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "POST /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43/action" status: 202 len: 0 microversion: 2.1 time: 1.010298 Oct 18 15:37:20.149999 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1506/2909] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:37:19 2022] POST /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43/action => generated 0 bytes in 1012 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:37:20.163478 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0a95fb43-03e5-4a9a-8c25-6ca49d8763dd tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:20.164574 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0a95fb43-03e5-4a9a-8c25-6ca49d8763dd tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:20.173159 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0a95fb43-03e5-4a9a-8c25-6ca49d8763dd tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:20.174183 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0a95fb43-03e5-4a9a-8c25-6ca49d8763dd tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:20.175315 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0a95fb43-03e5-4a9a-8c25-6ca49d8763dd tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:20.176832 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0a95fb43-03e5-4a9a-8c25-6ca49d8763dd tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:20.177767 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0a95fb43-03e5-4a9a-8c25-6ca49d8763dd tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:20.180403 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0a95fb43-03e5-4a9a-8c25-6ca49d8763dd tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:20.183339 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2b2279ef-e413-4e74-859e-6f2f12a03bbd tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:20.191624 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2b2279ef-e413-4e74-859e-6f2f12a03bbd tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca" status: 200 len: 1509 microversion: 2.1 time: 0.397009 Oct 18 15:37:20.194490 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1404/2910] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:19 2022] GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca => generated 1509 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:20.217791 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3898d7f6-b20d-4975-9077-58383e970ffe tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '.version_select at 0x7f7c3c78fca0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:20.301339 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3898d7f6-b20d-4975-9077-58383e970ffe tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "GET /compute/v2.1/images/8ce4db55-b062-45bf-b0b6-d3fb96c3e2c5" status: 200 len: 1423 microversion: 2.1 time: 0.093564 Oct 18 15:37:20.317104 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1405/2911] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:37:20 2022] GET /compute/v2.1/images/8ce4db55-b062-45bf-b0b6-d3fb96c3e2c5 => generated 1423 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:20.344338 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-97b3ff94-dafd-4420-a505-f72cae099029 req-0f990c2c-0568-4b0b-8f70-ac47a30db66d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35e5cf0e-693b-4930-9665-f1a53983cc1c", "name": "network-vif-plugged", "status": "completed", "tag": "2ca5d763-fca7-4b76-a60b-8e961f804f14"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:37:20.372586 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-97b3ff94-dafd-4420-a505-f72cae099029 req-0f990c2c-0568-4b0b-8f70-ac47a30db66d service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:20.373035 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-97b3ff94-dafd-4420-a505-f72cae099029 req-0f990c2c-0568-4b0b-8f70-ac47a30db66d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:20.377364 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-97b3ff94-dafd-4420-a505-f72cae099029 req-0f990c2c-0568-4b0b-8f70-ac47a30db66d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:20.406750 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-97b3ff94-dafd-4420-a505-f72cae099029 req-0f990c2c-0568-4b0b-8f70-ac47a30db66d service nova] Creating event network-vif-plugged:2ca5d763-fca7-4b76-a60b-8e961f804f14 for instance 35e5cf0e-693b-4930-9665-f1a53983cc1c on n-h1-853682-5 Oct 18 15:37:20.419466 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-97b3ff94-dafd-4420-a505-f72cae099029 req-0f990c2c-0568-4b0b-8f70-ac47a30db66d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094972 Oct 18 15:37:20.420257 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1406/2912] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:37:20.435370 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-85b2dd08-2998-4e50-852e-1a4abc79e4d8 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:20.436100 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-85b2dd08-2998-4e50-852e-1a4abc79e4d8 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 12e415d7-7c40-41a0-957a-a083dbcf2b43] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:20.447623 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85b2dd08-2998-4e50-852e-1a4abc79e4d8 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:20.449948 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85b2dd08-2998-4e50-852e-1a4abc79e4d8 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:20.450507 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85b2dd08-2998-4e50-852e-1a4abc79e4d8 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:20.453024 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85b2dd08-2998-4e50-852e-1a4abc79e4d8 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:20.453517 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85b2dd08-2998-4e50-852e-1a4abc79e4d8 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:20.453954 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85b2dd08-2998-4e50-852e-1a4abc79e4d8 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:21.169063 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0a95fb43-03e5-4a9a-8c25-6ca49d8763dd tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:21.177493 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-85b2dd08-2998-4e50-852e-1a4abc79e4d8 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:21.185346 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:37:21.187172 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0a95fb43-03e5-4a9a-8c25-6ca49d8763dd tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c" status: 200 len: 1478 microversion: 2.1 time: 1.036042 Oct 18 15:37:21.188390 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1507/2913] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:20 2022] GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c => generated 1478 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:21.193375 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fe619dd2-395f-493c-b247-1ba2fb04a250 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:21.194317 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-fe619dd2-395f-493c-b247-1ba2fb04a250 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 57537212-8816-4122-adbe-264f7035a0e9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:21.209463 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fe619dd2-395f-493c-b247-1ba2fb04a250 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:21.210825 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fe619dd2-395f-493c-b247-1ba2fb04a250 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:21.211344 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-85b2dd08-2998-4e50-852e-1a4abc79e4d8 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43" status: 200 len: 1538 microversion: 2.1 time: 0.784282 Oct 18 15:37:21.211815 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fe619dd2-395f-493c-b247-1ba2fb04a250 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:21.214334 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fe619dd2-395f-493c-b247-1ba2fb04a250 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:21.216551 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fe619dd2-395f-493c-b247-1ba2fb04a250 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:21.217777 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1407/2914] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:20 2022] GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43 => generated 1538 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:21.225230 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-89f1a9ad-1a52-4c7a-9bf4-893c6f74f8e5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:21.226441 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-89f1a9ad-1a52-4c7a-9bf4-893c6f74f8e5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:21.233593 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fe619dd2-395f-493c-b247-1ba2fb04a250 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:21.243533 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:37:21.243769 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89f1a9ad-1a52-4c7a-9bf4-893c6f74f8e5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:21.244161 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89f1a9ad-1a52-4c7a-9bf4-893c6f74f8e5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:21.244604 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89f1a9ad-1a52-4c7a-9bf4-893c6f74f8e5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:21.245382 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89f1a9ad-1a52-4c7a-9bf4-893c6f74f8e5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:21.245847 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89f1a9ad-1a52-4c7a-9bf4-893c6f74f8e5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:21.246273 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89f1a9ad-1a52-4c7a-9bf4-893c6f74f8e5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:21.929834 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-fe619dd2-395f-493c-b247-1ba2fb04a250 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:21.942664 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fe619dd2-395f-493c-b247-1ba2fb04a250 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9" status: 200 len: 1367 microversion: 2.1 time: 0.752844 Oct 18 15:37:21.943400 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1508/2915] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:21 2022] GET /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9 => generated 1367 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:21.949606 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-48db19ab-a1ae-443c-bd4e-9c7e49abb149 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '.version_select at 0x7f7c3cff6280>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:21.955933 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-89f1a9ad-1a52-4c7a-9bf4-893c6f74f8e5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:21.969761 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-89f1a9ad-1a52-4c7a-9bf4-893c6f74f8e5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca" status: 200 len: 1509 microversion: 2.1 time: 0.750230 Oct 18 15:37:21.971530 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1408/2916] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:21 2022] GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca => generated 1509 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:22.073306 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-48db19ab-a1ae-443c-bd4e-9c7e49abb149 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "GET /compute/v2.1/images/8ce4db55-b062-45bf-b0b6-d3fb96c3e2c5" status: 200 len: 1423 microversion: 2.1 time: 0.120550 Oct 18 15:37:22.074249 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1509/2917] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:37:21 2022] GET /compute/v2.1/images/8ce4db55-b062-45bf-b0b6-d3fb96c3e2c5 => generated 1423 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:22.218616 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2801bd9a-c395-48bb-8d66-58f0e9d073e3 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:22.220179 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2801bd9a-c395-48bb-8d66-58f0e9d073e3 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:22.234575 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2801bd9a-c395-48bb-8d66-58f0e9d073e3 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:22.236004 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2801bd9a-c395-48bb-8d66-58f0e9d073e3 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:22.237386 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2801bd9a-c395-48bb-8d66-58f0e9d073e3 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:22.239511 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b3a7b9cf-62ee-4c1d-92e0-fab16e33e66f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:22.240135 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b3a7b9cf-62ee-4c1d-92e0-fab16e33e66f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 12e415d7-7c40-41a0-957a-a083dbcf2b43] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:22.241937 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2801bd9a-c395-48bb-8d66-58f0e9d073e3 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:22.245795 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2801bd9a-c395-48bb-8d66-58f0e9d073e3 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:22.247256 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2801bd9a-c395-48bb-8d66-58f0e9d073e3 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:22.265906 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b3a7b9cf-62ee-4c1d-92e0-fab16e33e66f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:22.266409 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b3a7b9cf-62ee-4c1d-92e0-fab16e33e66f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:22.266852 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b3a7b9cf-62ee-4c1d-92e0-fab16e33e66f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:22.267557 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b3a7b9cf-62ee-4c1d-92e0-fab16e33e66f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:22.281709 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b3a7b9cf-62ee-4c1d-92e0-fab16e33e66f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:22.282097 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b3a7b9cf-62ee-4c1d-92e0-fab16e33e66f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:22.851275 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2801bd9a-c395-48bb-8d66-58f0e9d073e3 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:22.862808 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2801bd9a-c395-48bb-8d66-58f0e9d073e3 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c" status: 200 len: 1463 microversion: 2.1 time: 0.649531 Oct 18 15:37:22.869326 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b3a7b9cf-62ee-4c1d-92e0-fab16e33e66f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:22.877518 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1409/2918] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:22 2022] GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c => generated 1463 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:22.887565 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b3a7b9cf-62ee-4c1d-92e0-fab16e33e66f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43" status: 200 len: 1538 microversion: 2.1 time: 0.646136 Oct 18 15:37:22.893363 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1510/2919] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:22 2022] GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43 => generated 1538 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:22.902866 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-391bf698-7115-478e-8f80-5b613ba49a82 tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:37:22.907489 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-391bf698-7115-478e-8f80-5b613ba49a82 tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:22.922377 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-391bf698-7115-478e-8f80-5b613ba49a82 tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:22.923562 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-391bf698-7115-478e-8f80-5b613ba49a82 tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:22.924506 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-391bf698-7115-478e-8f80-5b613ba49a82 tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:22.925353 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-391bf698-7115-478e-8f80-5b613ba49a82 tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:22.928313 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-391bf698-7115-478e-8f80-5b613ba49a82 tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:22.929004 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-391bf698-7115-478e-8f80-5b613ba49a82 tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:22.970457 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-660825fa-3248-4dd7-a8e3-1003a0fa1a1f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:22.971564 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-660825fa-3248-4dd7-a8e3-1003a0fa1a1f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 57537212-8816-4122-adbe-264f7035a0e9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:22.983615 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-660825fa-3248-4dd7-a8e3-1003a0fa1a1f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:22.984488 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-660825fa-3248-4dd7-a8e3-1003a0fa1a1f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:22.985216 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-660825fa-3248-4dd7-a8e3-1003a0fa1a1f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:22.986192 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-660825fa-3248-4dd7-a8e3-1003a0fa1a1f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:22.986930 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-660825fa-3248-4dd7-a8e3-1003a0fa1a1f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:22.987690 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-660825fa-3248-4dd7-a8e3-1003a0fa1a1f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:23.091721 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-391bf698-7115-478e-8f80-5b613ba49a82 tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c/action" status: 202 len: 0 microversion: 2.1 time: 0.192793 Oct 18 15:37:23.092374 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1410/2920] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:37:22 2022] POST /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:37:23.102847 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8ccc1e85-c0a0-4c8e-b3ea-8fc15c511830 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:23.103469 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8ccc1e85-c0a0-4c8e-b3ea-8fc15c511830 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:23.123693 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ccc1e85-c0a0-4c8e-b3ea-8fc15c511830 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:23.124253 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ccc1e85-c0a0-4c8e-b3ea-8fc15c511830 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:23.124683 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ccc1e85-c0a0-4c8e-b3ea-8fc15c511830 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:23.125521 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ccc1e85-c0a0-4c8e-b3ea-8fc15c511830 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:23.125962 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ccc1e85-c0a0-4c8e-b3ea-8fc15c511830 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:23.128272 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ccc1e85-c0a0-4c8e-b3ea-8fc15c511830 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:23.684094 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-660825fa-3248-4dd7-a8e3-1003a0fa1a1f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:23.724672 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-660825fa-3248-4dd7-a8e3-1003a0fa1a1f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9" status: 200 len: 1367 microversion: 2.1 time: 0.758789 Oct 18 15:37:23.749208 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8ccc1e85-c0a0-4c8e-b3ea-8fc15c511830 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:23.749717 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1511/2921] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:22 2022] GET /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9 => generated 1367 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:23.759115 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8ccc1e85-c0a0-4c8e-b3ea-8fc15c511830 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca" status: 200 len: 1509 microversion: 2.1 time: 0.665147 Oct 18 15:37:23.763795 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a61e89d9-b387-4cea-b058-248a7209eebd tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '.version_select at 0x7f7c3d341a60>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:23.772675 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1411/2922] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:23 2022] GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca => generated 1509 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:23.786250 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3a68e8e6-8e98-408f-84ce-d6229d383f29 tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:23.786989 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3a68e8e6-8e98-408f-84ce-d6229d383f29 tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:23.815619 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a68e8e6-8e98-408f-84ce-d6229d383f29 tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:23.824341 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a68e8e6-8e98-408f-84ce-d6229d383f29 tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:23.825082 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a68e8e6-8e98-408f-84ce-d6229d383f29 tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:23.825983 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a68e8e6-8e98-408f-84ce-d6229d383f29 tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:23.826647 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a68e8e6-8e98-408f-84ce-d6229d383f29 tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:23.827178 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a68e8e6-8e98-408f-84ce-d6229d383f29 tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:23.879346 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a61e89d9-b387-4cea-b058-248a7209eebd tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "GET /compute/v2.1/images/8ce4db55-b062-45bf-b0b6-d3fb96c3e2c5" status: 200 len: 1423 microversion: 2.1 time: 0.128019 Oct 18 15:37:23.880615 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1512/2923] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:37:23 2022] GET /compute/v2.1/images/8ce4db55-b062-45bf-b0b6-d3fb96c3e2c5 => generated 1423 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:23.921199 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7f0736a5-a12c-48b0-8a09-859f1cad9b5d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:23.922398 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7f0736a5-a12c-48b0-8a09-859f1cad9b5d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 12e415d7-7c40-41a0-957a-a083dbcf2b43] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:23.923974 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a68e8e6-8e98-408f-84ce-d6229d383f29 tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:23.924829 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a68e8e6-8e98-408f-84ce-d6229d383f29 tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:23.925506 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a68e8e6-8e98-408f-84ce-d6229d383f29 tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:23.926195 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-3a68e8e6-8e98-408f-84ce-d6229d383f29 tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lazy-loading 'fault' on Instance uuid 35e5cf0e-693b-4930-9665-f1a53983cc1c {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:37:23.946190 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7f0736a5-a12c-48b0-8a09-859f1cad9b5d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:23.947104 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7f0736a5-a12c-48b0-8a09-859f1cad9b5d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:23.947712 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7f0736a5-a12c-48b0-8a09-859f1cad9b5d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:23.948654 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7f0736a5-a12c-48b0-8a09-859f1cad9b5d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:23.949419 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7f0736a5-a12c-48b0-8a09-859f1cad9b5d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:23.950093 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7f0736a5-a12c-48b0-8a09-859f1cad9b5d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:24.472481 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3a68e8e6-8e98-408f-84ce-d6229d383f29 tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c" status: 200 len: 1597 microversion: 2.1 time: 0.694836 Oct 18 15:37:24.473166 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1412/2924] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:23 2022] GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c => generated 1597 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:24.475056 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7f0736a5-a12c-48b0-8a09-859f1cad9b5d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:24.496261 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f8a8b792-d6e5-4b9c-95c8-0ac452c039ca tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:37:24.499786 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f8a8b792-d6e5-4b9c-95c8-0ac452c039ca tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:24.504869 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7f0736a5-a12c-48b0-8a09-859f1cad9b5d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43" status: 200 len: 1538 microversion: 2.1 time: 0.587480 Oct 18 15:37:24.507761 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1513/2925] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:23 2022] GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43 => generated 1538 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:37:24.509064 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8a8b792-d6e5-4b9c-95c8-0ac452c039ca tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:24.509811 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8a8b792-d6e5-4b9c-95c8-0ac452c039ca tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:24.510529 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8a8b792-d6e5-4b9c-95c8-0ac452c039ca tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:24.511691 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8a8b792-d6e5-4b9c-95c8-0ac452c039ca tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:24.512416 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8a8b792-d6e5-4b9c-95c8-0ac452c039ca tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:24.513233 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8a8b792-d6e5-4b9c-95c8-0ac452c039ca tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:24.646552 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f8a8b792-d6e5-4b9c-95c8-0ac452c039ca tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c/action" status: 202 len: 0 microversion: 2.1 time: 0.150315 Oct 18 15:37:24.654553 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1413/2926] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:37:24 2022] POST /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 15:37:24.658087 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d0dc9c51-a5d6-42cc-9eed-05af44245c99 tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:24.658716 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d0dc9c51-a5d6-42cc-9eed-05af44245c99 tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:24.672312 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d0dc9c51-a5d6-42cc-9eed-05af44245c99 tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:24.673205 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d0dc9c51-a5d6-42cc-9eed-05af44245c99 tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:24.674483 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d0dc9c51-a5d6-42cc-9eed-05af44245c99 tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:24.675492 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d0dc9c51-a5d6-42cc-9eed-05af44245c99 tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:24.676187 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d0dc9c51-a5d6-42cc-9eed-05af44245c99 tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:24.681712 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d0dc9c51-a5d6-42cc-9eed-05af44245c99 tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:24.763957 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f5118a9e-883f-4ad5-b6b2-e167e295eabb tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:24.764583 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f5118a9e-883f-4ad5-b6b2-e167e295eabb tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 57537212-8816-4122-adbe-264f7035a0e9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:24.780178 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f5118a9e-883f-4ad5-b6b2-e167e295eabb tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:24.780693 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f5118a9e-883f-4ad5-b6b2-e167e295eabb tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:24.781351 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f5118a9e-883f-4ad5-b6b2-e167e295eabb tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:24.782266 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f5118a9e-883f-4ad5-b6b2-e167e295eabb tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:24.787696 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f5118a9e-883f-4ad5-b6b2-e167e295eabb tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:24.788433 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f5118a9e-883f-4ad5-b6b2-e167e295eabb tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:25.466890 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d0dc9c51-a5d6-42cc-9eed-05af44245c99 tempest-ServersAdminTestJSON-583341040 tempest-ServersAdminTestJSON-583341040-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c" status: 200 len: 1614 microversion: 2.1 time: 0.807220 Oct 18 15:37:25.483497 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1514/2927] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:24 2022] GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c => generated 1614 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:25.489920 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6cd33f9f-f6cc-46a0-96d5-7eb5d88592d3 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:25.490882 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6cd33f9f-f6cc-46a0-96d5-7eb5d88592d3 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:25.497913 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6cd33f9f-f6cc-46a0-96d5-7eb5d88592d3 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:25.498764 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6cd33f9f-f6cc-46a0-96d5-7eb5d88592d3 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:25.499580 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6cd33f9f-f6cc-46a0-96d5-7eb5d88592d3 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:25.500563 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6cd33f9f-f6cc-46a0-96d5-7eb5d88592d3 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:25.501272 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6cd33f9f-f6cc-46a0-96d5-7eb5d88592d3 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:25.501928 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6cd33f9f-f6cc-46a0-96d5-7eb5d88592d3 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:25.552204 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f5118a9e-883f-4ad5-b6b2-e167e295eabb tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:25.562537 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f5118a9e-883f-4ad5-b6b2-e167e295eabb tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9" status: 200 len: 1367 microversion: 2.1 time: 0.802415 Oct 18 15:37:25.567670 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1414/2928] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:24 2022] GET /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9 => generated 1367 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:25.573905 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bb94412a-1d91-4c3f-9dda-57cb36e8387d tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '.version_select at 0x7f7c3c78f820>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:25.631897 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bb94412a-1d91-4c3f-9dda-57cb36e8387d tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "GET /compute/v2.1/images/8ce4db55-b062-45bf-b0b6-d3fb96c3e2c5" status: 200 len: 1423 microversion: 2.1 time: 0.062729 Oct 18 15:37:25.642490 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1415/2929] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:37:25 2022] GET /compute/v2.1/images/8ce4db55-b062-45bf-b0b6-d3fb96c3e2c5 => generated 1423 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:25.683274 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f84374c1-ca68-4452-bfa0-66cd6b1ff340 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:25.683965 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f84374c1-ca68-4452-bfa0-66cd6b1ff340 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 89919fa6-1fd6-42d0-ab81-d0cdebc3960c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:25.705223 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f84374c1-ca68-4452-bfa0-66cd6b1ff340 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:25.705726 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f84374c1-ca68-4452-bfa0-66cd6b1ff340 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:25.706160 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f84374c1-ca68-4452-bfa0-66cd6b1ff340 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:25.706869 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f84374c1-ca68-4452-bfa0-66cd6b1ff340 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:25.708148 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f84374c1-ca68-4452-bfa0-66cd6b1ff340 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:25.708637 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f84374c1-ca68-4452-bfa0-66cd6b1ff340 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:25.774170 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f84374c1-ca68-4452-bfa0-66cd6b1ff340 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 89919fa6-1fd6-42d0-ab81-d0cdebc3960c] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:37:25.969123 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:37:25.979141 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f84374c1-ca68-4452-bfa0-66cd6b1ff340 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "DELETE /compute/v2.1/servers/89919fa6-1fd6-42d0-ab81-d0cdebc3960c" status: 204 len: 0 microversion: 2.1 time: 0.333069 Oct 18 15:37:25.983629 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1416/2930] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:37:25 2022] DELETE /compute/v2.1/servers/89919fa6-1fd6-42d0-ab81-d0cdebc3960c => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:37:25.989618 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cd87502e-e878-4066-bcc9-2bd84d78bfbc tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:25.990571 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cd87502e-e878-4066-bcc9-2bd84d78bfbc tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 12e415d7-7c40-41a0-957a-a083dbcf2b43] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:26.002962 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd87502e-e878-4066-bcc9-2bd84d78bfbc tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:26.004216 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd87502e-e878-4066-bcc9-2bd84d78bfbc tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:26.005187 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd87502e-e878-4066-bcc9-2bd84d78bfbc tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:26.006128 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd87502e-e878-4066-bcc9-2bd84d78bfbc tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:26.006786 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd87502e-e878-4066-bcc9-2bd84d78bfbc tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:26.007376 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd87502e-e878-4066-bcc9-2bd84d78bfbc tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:26.111613 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6cd33f9f-f6cc-46a0-96d5-7eb5d88592d3 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:26.121653 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6cd33f9f-f6cc-46a0-96d5-7eb5d88592d3 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca" status: 200 len: 1509 microversion: 2.1 time: 0.635719 Oct 18 15:37:26.123012 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1515/2931] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:25 2022] GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca => generated 1509 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:26.127981 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a5a7a005-1326-486a-8655-c8faecb19819 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:26.128826 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a5a7a005-1326-486a-8655-c8faecb19819 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 89919fa6-1fd6-42d0-ab81-d0cdebc3960c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:26.135230 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a5a7a005-1326-486a-8655-c8faecb19819 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:26.135959 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a5a7a005-1326-486a-8655-c8faecb19819 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:26.136601 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a5a7a005-1326-486a-8655-c8faecb19819 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:26.137551 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a5a7a005-1326-486a-8655-c8faecb19819 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:26.138304 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a5a7a005-1326-486a-8655-c8faecb19819 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:26.138934 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a5a7a005-1326-486a-8655-c8faecb19819 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:26.471578 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cd87502e-e878-4066-bcc9-2bd84d78bfbc tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:26.478635 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a5a7a005-1326-486a-8655-c8faecb19819 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:26.494015 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cd87502e-e878-4066-bcc9-2bd84d78bfbc tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43" status: 200 len: 1538 microversion: 2.1 time: 0.508715 Oct 18 15:37:26.497768 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1417/2932] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:25 2022] GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43 => generated 1538 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:26.499513 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a5a7a005-1326-486a-8655-c8faecb19819 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/89919fa6-1fd6-42d0-ab81-d0cdebc3960c" status: 200 len: 1468 microversion: 2.1 time: 0.372818 Oct 18 15:37:26.500144 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1516/2933] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:26 2022] GET /compute/v2.1/servers/89919fa6-1fd6-42d0-ab81-d0cdebc3960c => generated 1468 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:26.594840 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5890aad4-d5e1-43ad-9918-e1c71e623526 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:26.595474 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5890aad4-d5e1-43ad-9918-e1c71e623526 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 57537212-8816-4122-adbe-264f7035a0e9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:26.608533 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5890aad4-d5e1-43ad-9918-e1c71e623526 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:26.609974 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5890aad4-d5e1-43ad-9918-e1c71e623526 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:26.613177 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5890aad4-d5e1-43ad-9918-e1c71e623526 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:26.614989 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5890aad4-d5e1-43ad-9918-e1c71e623526 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:26.616511 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5890aad4-d5e1-43ad-9918-e1c71e623526 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:26.618394 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5890aad4-d5e1-43ad-9918-e1c71e623526 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:26.649801 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d00b1a99-302e-408f-aefa-af9c4c48d38b tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '.version_select at 0x7f7c3d1383a0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:26.735263 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d00b1a99-302e-408f-aefa-af9c4c48d38b tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "GET /compute/v2.1/images/8ce4db55-b062-45bf-b0b6-d3fb96c3e2c5" status: 200 len: 1423 microversion: 2.1 time: 0.091221 Oct 18 15:37:26.743896 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1517/2934] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:37:26 2022] GET /compute/v2.1/images/8ce4db55-b062-45bf-b0b6-d3fb96c3e2c5 => generated 1423 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:37:26.802087 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5890aad4-d5e1-43ad-9918-e1c71e623526 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:26.812651 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5890aad4-d5e1-43ad-9918-e1c71e623526 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9" status: 200 len: 1367 microversion: 2.1 time: 0.222145 Oct 18 15:37:26.815297 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1418/2935] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:26 2022] GET /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9 => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:26.916262 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e91e0ea0-ec41-4303-8a27-b8e3cf401f51 tempest-SecurityGroupsNegativeTestJSON-490484102 tempest-SecurityGroupsNegativeTestJSON-490484102-project] Calling method '.version_select at 0x7f7c3d1d5700>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:26.942328 n-d-853682-5 devstack@n-api.service[120405]: DEBUG neutronclient.v2_0.client [None req-e91e0ea0-ec41-4303-8a27-b8e3cf401f51 tempest-SecurityGroupsNegativeTestJSON-490484102 tempest-SecurityGroupsNegativeTestJSON-490484102-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4366022d-169c-4c48-8de4-c61f43d3780b does not exist", "detail": ""}} {{(pid=120405) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 15:37:26.942976 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.security_group_api [None req-e91e0ea0-ec41-4303-8a27-b8e3cf401f51 tempest-SecurityGroupsNegativeTestJSON-490484102 tempest-SecurityGroupsNegativeTestJSON-490484102-project] Neutron security group 4366022d-169c-4c48-8de4-c61f43d3780b not found {{(pid=120405) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 18 15:37:26.943570 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-e91e0ea0-ec41-4303-8a27-b8e3cf401f51 tempest-SecurityGroupsNegativeTestJSON-490484102 tempest-SecurityGroupsNegativeTestJSON-490484102-project] HTTP exception thrown: Security group 4366022d-169c-4c48-8de4-c61f43d3780b does not exist Oct 18 15:37:26.943570 n-d-853682-5 devstack@n-api.service[120405]: Neutron server returns request_ids: ['req-95b39c97-54c3-48b2-9980-385809d861d0'] Oct 18 15:37:26.945712 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e91e0ea0-ec41-4303-8a27-b8e3cf401f51 tempest-SecurityGroupsNegativeTestJSON-490484102 tempest-SecurityGroupsNegativeTestJSON-490484102-project] Request method failure captured: Oct 18 15:37:26.945712 n-d-853682-5 devstack@n-api.service[120405]: request: DELETE /compute/v2.1/os-security-groups/4366022d-169c-4c48-8de4-c61f43d3780b HTTP/1.1 Oct 18 15:37:26.945712 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:37:26.945712 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:37:26.945712 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:37:26.945712 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:37:26.945712 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:37:26.945712 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:37:26.945712 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:37:26.945712 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:37:26.945712 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsg2ie1p1AAQJBf4OaQtWk7iEfBcoVUkrazyVZUogOmcZD8wV5KLs2PIxl3wp3y93C2hvvSy5-SBljiHXsSMMERXrzUXkMNlEjEGa3CMonHw8LxDR5lc_qZHlNI-ygULuILtI5wPi0EcFoMA8U0ksLQddLr_L-fxC9MtzgQftIjUJP0 Oct 18 15:37:26.945712 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:37:26.945712 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:37:26.945712 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:37:26.945712 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:37:26.945712 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:37:26.945712 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:37:26.945712 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: a5512441dd9e400389a2339de4da868b Oct 18 15:37:26.945712 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-490484102 Oct 18 15:37:26.945712 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:37:26.945712 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:37:26.947234 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a5512441dd9e400389a2339de4da868b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a5512441dd9e400389a2339de4da868b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a5512441dd9e400389a2339de4da868b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a5512441dd9e400389a2339de4da868b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:37:26.947234 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-490484102 Oct 18 15:37:26.947234 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: a5512441dd9e400389a2339de4da868b Oct 18 15:37:26.947234 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-490484102 Oct 18 15:37:26.947234 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-SecurityGroupsNegativeTestJSON-490484102-project Oct 18 15:37:26.947234 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:37:26.947234 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:37:26.947234 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: f03fcf82048040f7b9bddfcb590e1279 Oct 18 15:37:26.947234 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-490484102-project Oct 18 15:37:26.947234 n-d-853682-5 devstack@n-api.service[120405]: method: Oct 18 15:37:26.947234 n-d-853682-5 devstack@n-api.service[120405]: exception: Security group 4366022d-169c-4c48-8de4-c61f43d3780b does not exist Oct 18 15:37:26.947234 n-d-853682-5 devstack@n-api.service[120405]: Neutron server returns request_ids: ['req-95b39c97-54c3-48b2-9980-385809d861d0'] Oct 18 15:37:26.947234 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '4366022d-169c-4c48-8de4-c61f43d3780b'} Oct 18 15:37:26.948072 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:37:26.948072 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:37:26.948072 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 18 15:37:26.948072 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 18 15:37:26.948072 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:37:26.948072 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:37:26.948072 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 18 15:37:26.948072 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 18 15:37:26.948072 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:37:26.948072 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:37:26.948072 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 15:37:26.948072 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 15:37:26.948072 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:37:26.948072 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:37:26.948072 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 15:37:26.948072 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 15:37:26.948072 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:37:26.948072 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:37:26.948072 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 15:37:26.949331 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 15:37:26.949331 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:37:26.949331 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:37:26.949331 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 15:37:26.949331 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 15:37:26.949331 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 15:37:26.949331 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 15:37:26.949331 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4366022d-169c-4c48-8de4-c61f43d3780b does not exist Oct 18 15:37:26.949331 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-95b39c97-54c3-48b2-9980-385809d861d0'] Oct 18 15:37:26.949331 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:37:26.949331 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:37:26.949331 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:37:26.949331 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:37:26.949331 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 18 15:37:26.949331 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 18 15:37:26.949331 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 18 15:37:26.949331 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 15:37:26.949331 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4366022d-169c-4c48-8de4-c61f43d3780b does not exist Oct 18 15:37:26.950951 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-95b39c97-54c3-48b2-9980-385809d861d0'] Oct 18 15:37:26.950951 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:37:26.950951 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:37:26.950951 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:37:26.950951 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:37:26.950951 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:37:26.950951 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:37:26.950951 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:37:26.950951 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:37:26.950951 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:37:26.950951 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:37:26.950951 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:37:26.950951 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:37:26.950951 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 18 15:37:26.950951 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 15:37:26.950951 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4366022d-169c-4c48-8de4-c61f43d3780b does not exist Oct 18 15:37:26.950951 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-95b39c97-54c3-48b2-9980-385809d861d0'] Oct 18 15:37:26.950951 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:37:26.950951 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:37:26.950951 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:37:26.950951 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:37:26.953002 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:37:26.953002 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:37:26.953002 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:37:26.953002 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:37:26.953002 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4366022d-169c-4c48-8de4-c61f43d3780b does not exist Oct 18 15:37:26.953002 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-95b39c97-54c3-48b2-9980-385809d861d0'] Oct 18 15:37:26.953002 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:37:26.953002 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e91e0ea0-ec41-4303-8a27-b8e3cf401f51 tempest-SecurityGroupsNegativeTestJSON-490484102 tempest-SecurityGroupsNegativeTestJSON-490484102-project] Returning 404 to user: Security group 4366022d-169c-4c48-8de4-c61f43d3780b does not exist Oct 18 15:37:26.953002 n-d-853682-5 devstack@n-api.service[120405]: Neutron server returns request_ids: ['req-95b39c97-54c3-48b2-9980-385809d861d0'] {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:37:26.953002 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e91e0ea0-ec41-4303-8a27-b8e3cf401f51 tempest-SecurityGroupsNegativeTestJSON-490484102 tempest-SecurityGroupsNegativeTestJSON-490484102-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/4366022d-169c-4c48-8de4-c61f43d3780b" status: 404 len: 194 microversion: 2.1 time: 0.202402 Oct 18 15:37:26.953002 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1518/2936] 10.222.0.60 () {58 vars in 1272 bytes} [Tue Oct 18 15:37:26 2022] DELETE /compute/v2.1/os-security-groups/4366022d-169c-4c48-8de4-c61f43d3780b => generated 194 bytes in 203 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:37:26.957749 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1566bdac-acb7-4080-895c-a53b6df9b131 tempest-SecurityGroupsNegativeTestJSON-490484102 tempest-SecurityGroupsNegativeTestJSON-490484102-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.004629 Oct 18 15:37:26.958371 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1419/2937] 10.222.0.60 () {58 vars in 1164 bytes} [Tue Oct 18 15:37:26 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 18 15:37:26.968440 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e91a8ecd-836e-4bea-89bb-0dfad18e266a tempest-SecurityGroupsNegativeTestJSON-490484102 tempest-SecurityGroupsNegativeTestJSON-490484102-project] Calling method '.version_select at 0x7f7c3d1d5700>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:27.146796 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-58d65254-5e1e-4724-8842-f6553428de59 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:27.148074 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-58d65254-5e1e-4724-8842-f6553428de59 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:27.156265 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58d65254-5e1e-4724-8842-f6553428de59 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:27.156760 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58d65254-5e1e-4724-8842-f6553428de59 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:27.157249 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58d65254-5e1e-4724-8842-f6553428de59 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:27.157956 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58d65254-5e1e-4724-8842-f6553428de59 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:27.167822 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58d65254-5e1e-4724-8842-f6553428de59 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:27.168543 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58d65254-5e1e-4724-8842-f6553428de59 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:27.674722 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e91a8ecd-836e-4bea-89bb-0dfad18e266a tempest-SecurityGroupsNegativeTestJSON-490484102 tempest-SecurityGroupsNegativeTestJSON-490484102-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.710696 Oct 18 15:37:27.686061 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1519/2938] 10.222.0.60 () {58 vars in 1158 bytes} [Tue Oct 18 15:37:26 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:37:27.686061 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-c2416f2a-2bfa-4ace-8e7d-04e6c1b9bbdd req-ecda2bb8-6ad1-4eda-b345-e3d73eb46d4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57537212-8816-4122-adbe-264f7035a0e9", "name": "network-vif-plugged", "status": "completed", "tag": "82baf8c1-00b0-44e2-8136-84d45e22d715"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:37:27.708914 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-c2416f2a-2bfa-4ace-8e7d-04e6c1b9bbdd req-ecda2bb8-6ad1-4eda-b345-e3d73eb46d4b service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:27.710349 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-c2416f2a-2bfa-4ace-8e7d-04e6c1b9bbdd req-ecda2bb8-6ad1-4eda-b345-e3d73eb46d4b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:27.710787 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-c2416f2a-2bfa-4ace-8e7d-04e6c1b9bbdd req-ecda2bb8-6ad1-4eda-b345-e3d73eb46d4b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:27.736614 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-c2416f2a-2bfa-4ace-8e7d-04e6c1b9bbdd req-ecda2bb8-6ad1-4eda-b345-e3d73eb46d4b service nova] Creating event network-vif-plugged:82baf8c1-00b0-44e2-8136-84d45e22d715 for instance 57537212-8816-4122-adbe-264f7035a0e9 on n-h1-853682-5 Oct 18 15:37:27.744509 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-c2416f2a-2bfa-4ace-8e7d-04e6c1b9bbdd req-ecda2bb8-6ad1-4eda-b345-e3d73eb46d4b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067170 Oct 18 15:37:27.749790 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1520/2939] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:37:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:37:27.760739 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-58d65254-5e1e-4724-8842-f6553428de59 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:27.766144 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bab00cd2-e4e0-4754-9c5f-4a3c9fba59be tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:27.766334 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-bab00cd2-e4e0-4754-9c5f-4a3c9fba59be tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 12e415d7-7c40-41a0-957a-a083dbcf2b43] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:27.771106 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-58d65254-5e1e-4724-8842-f6553428de59 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca" status: 200 len: 1509 microversion: 2.1 time: 0.628104 Oct 18 15:37:27.771710 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1420/2940] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:27 2022] GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca => generated 1509 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:37:27.779870 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bab00cd2-e4e0-4754-9c5f-4a3c9fba59be tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:27.780635 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bab00cd2-e4e0-4754-9c5f-4a3c9fba59be tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:27.781328 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bab00cd2-e4e0-4754-9c5f-4a3c9fba59be tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:27.781473 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a39e322c-45c3-4f72-9a8c-b186d4651df5 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:27.782110 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a39e322c-45c3-4f72-9a8c-b186d4651df5 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 89919fa6-1fd6-42d0-ab81-d0cdebc3960c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:27.782324 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bab00cd2-e4e0-4754-9c5f-4a3c9fba59be tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:27.782939 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bab00cd2-e4e0-4754-9c5f-4a3c9fba59be tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:27.783364 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bab00cd2-e4e0-4754-9c5f-4a3c9fba59be tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:27.808090 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a39e322c-45c3-4f72-9a8c-b186d4651df5 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:27.809159 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a39e322c-45c3-4f72-9a8c-b186d4651df5 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:27.810159 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a39e322c-45c3-4f72-9a8c-b186d4651df5 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:27.811825 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a39e322c-45c3-4f72-9a8c-b186d4651df5 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:27.812501 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a39e322c-45c3-4f72-9a8c-b186d4651df5 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:27.813228 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a39e322c-45c3-4f72-9a8c-b186d4651df5 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:27.877112 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:37:28.049416 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-bab00cd2-e4e0-4754-9c5f-4a3c9fba59be tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:28.063513 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-bab00cd2-e4e0-4754-9c5f-4a3c9fba59be tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43" status: 200 len: 1543 microversion: 2.1 time: 0.311437 Oct 18 15:37:28.064112 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1521/2941] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:27 2022] GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43 => generated 1543 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:28.075931 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1b15336d-f3ac-4577-a170-bb2c6b614785 tempest-SecurityGroupsNegativeTestJSON-490484102 tempest-SecurityGroupsNegativeTestJSON-490484102-project] Calling method '.version_select at 0x7f7c3d0f6e50>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:28.081089 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a39e322c-45c3-4f72-9a8c-b186d4651df5 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:28.094693 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a39e322c-45c3-4f72-9a8c-b186d4651df5 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/89919fa6-1fd6-42d0-ab81-d0cdebc3960c" status: 200 len: 1468 microversion: 2.1 time: 0.318444 Oct 18 15:37:28.095770 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1421/2942] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:27 2022] GET /compute/v2.1/servers/89919fa6-1fd6-42d0-ab81-d0cdebc3960c => generated 1468 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:28.101976 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f91ad606-1bd6-4818-b4e0-b4cb66866626 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '.version_select at 0x7f7c3d0d3ee0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:28.174192 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f91ad606-1bd6-4818-b4e0-b4cb66866626 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "GET /compute/v2.1/images/8ce4db55-b062-45bf-b0b6-d3fb96c3e2c5" status: 200 len: 1423 microversion: 2.1 time: 0.076143 Oct 18 15:37:28.184697 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1422/2943] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:37:28 2022] GET /compute/v2.1/images/8ce4db55-b062-45bf-b0b6-d3fb96c3e2c5 => generated 1423 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:28.201084 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-52995868-a365-4338-afa4-a65ba804964f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:28.201727 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-52995868-a365-4338-afa4-a65ba804964f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 57537212-8816-4122-adbe-264f7035a0e9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:28.231457 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52995868-a365-4338-afa4-a65ba804964f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:28.236731 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52995868-a365-4338-afa4-a65ba804964f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:28.237499 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52995868-a365-4338-afa4-a65ba804964f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:28.240542 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52995868-a365-4338-afa4-a65ba804964f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:28.242311 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52995868-a365-4338-afa4-a65ba804964f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:28.244438 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52995868-a365-4338-afa4-a65ba804964f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:28.392071 n-d-853682-5 devstack@n-api.service[120405]: DEBUG neutronclient.v2_0.client [None req-1b15336d-f3ac-4577-a170-bb2c6b614785 tempest-SecurityGroupsNegativeTestJSON-490484102 tempest-SecurityGroupsNegativeTestJSON-490484102-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=120405) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 15:37:28.393028 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-1b15336d-f3ac-4577-a170-bb2c6b614785 tempest-SecurityGroupsNegativeTestJSON-490484102 tempest-SecurityGroupsNegativeTestJSON-490484102-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 18 15:37:28.393028 n-d-853682-5 devstack@n-api.service[120405]: Neutron server returns request_ids: ['req-baf667bc-4503-49bb-9222-c851096a2f69'] Oct 18 15:37:28.395572 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1b15336d-f3ac-4577-a170-bb2c6b614785 tempest-SecurityGroupsNegativeTestJSON-490484102 tempest-SecurityGroupsNegativeTestJSON-490484102-project] Request method failure captured: Oct 18 15:37:28.395572 n-d-853682-5 devstack@n-api.service[120405]: request: DELETE /compute/v2.1/os-security-groups/c8cf2e68-6971-498f-97f1-9c92372c43c5 HTTP/1.1 Oct 18 15:37:28.395572 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:37:28.395572 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:37:28.395572 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:37:28.395572 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:37:28.395572 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:37:28.395572 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:37:28.395572 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:37:28.395572 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:37:28.395572 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsg2ie1p1AAQJBf4OaQtWk7iEfBcoVUkrazyVZUogOmcZD8wV5KLs2PIxl3wp3y93C2hvvSy5-SBljiHXsSMMERXrzUXkMNlEjEGa3CMonHw8LxDR5lc_qZHlNI-ygULuILtI5wPi0EcFoMA8U0ksLQddLr_L-fxC9MtzgQftIjUJP0 Oct 18 15:37:28.395572 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:37:28.395572 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:37:28.395572 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:37:28.395572 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:37:28.395572 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:37:28.395572 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:37:28.395572 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: a5512441dd9e400389a2339de4da868b Oct 18 15:37:28.395572 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-490484102 Oct 18 15:37:28.395572 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:37:28.395572 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:37:28.397010 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a5512441dd9e400389a2339de4da868b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a5512441dd9e400389a2339de4da868b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a5512441dd9e400389a2339de4da868b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a5512441dd9e400389a2339de4da868b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:37:28.397010 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-490484102 Oct 18 15:37:28.397010 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: a5512441dd9e400389a2339de4da868b Oct 18 15:37:28.397010 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-490484102 Oct 18 15:37:28.397010 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-SecurityGroupsNegativeTestJSON-490484102-project Oct 18 15:37:28.397010 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:37:28.397010 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:37:28.397010 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: f03fcf82048040f7b9bddfcb590e1279 Oct 18 15:37:28.397010 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-490484102-project Oct 18 15:37:28.397010 n-d-853682-5 devstack@n-api.service[120405]: method: Oct 18 15:37:28.397010 n-d-853682-5 devstack@n-api.service[120405]: exception: Insufficient rights for removing default security group. Oct 18 15:37:28.397010 n-d-853682-5 devstack@n-api.service[120405]: Neutron server returns request_ids: ['req-baf667bc-4503-49bb-9222-c851096a2f69'] Oct 18 15:37:28.397010 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'c8cf2e68-6971-498f-97f1-9c92372c43c5'} Oct 18 15:37:28.398367 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:37:28.398367 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:37:28.398367 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 18 15:37:28.398367 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 18 15:37:28.398367 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:37:28.398367 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:37:28.398367 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 18 15:37:28.398367 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 18 15:37:28.398367 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:37:28.398367 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:37:28.398367 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 18 15:37:28.398367 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 18 15:37:28.398367 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:37:28.398367 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:37:28.398367 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 15:37:28.398367 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 15:37:28.398367 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:37:28.398367 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:37:28.398367 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 15:37:28.399558 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 15:37:28.399558 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:37:28.399558 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:37:28.399558 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 15:37:28.399558 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 15:37:28.399558 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 15:37:28.399558 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 15:37:28.399558 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 18 15:37:28.399558 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-baf667bc-4503-49bb-9222-c851096a2f69'] Oct 18 15:37:28.399558 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:37:28.399558 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:37:28.399558 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:37:28.399558 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:37:28.399558 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 18 15:37:28.399558 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 18 15:37:28.399558 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 18 15:37:28.399558 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 18 15:37:28.399558 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 18 15:37:28.399558 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-baf667bc-4503-49bb-9222-c851096a2f69'] Oct 18 15:37:28.400942 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:37:28.400942 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:37:28.400942 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:37:28.400942 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:37:28.400942 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:37:28.400942 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:37:28.400942 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:37:28.400942 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:37:28.400942 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:37:28.400942 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:37:28.400942 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:37:28.400942 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:37:28.400942 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 18 15:37:28.400942 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 18 15:37:28.400942 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 18 15:37:28.400942 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-baf667bc-4503-49bb-9222-c851096a2f69'] Oct 18 15:37:28.400942 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:37:28.400942 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:37:28.400942 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:37:28.400942 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:37:28.400942 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:37:28.402446 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:37:28.402446 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:37:28.402446 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:37:28.402446 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 18 15:37:28.402446 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-baf667bc-4503-49bb-9222-c851096a2f69'] Oct 18 15:37:28.402446 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:37:28.403812 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1b15336d-f3ac-4577-a170-bb2c6b614785 tempest-SecurityGroupsNegativeTestJSON-490484102 tempest-SecurityGroupsNegativeTestJSON-490484102-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 18 15:37:28.403812 n-d-853682-5 devstack@n-api.service[120405]: Neutron server returns request_ids: ['req-baf667bc-4503-49bb-9222-c851096a2f69'] {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:37:28.405160 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1b15336d-f3ac-4577-a170-bb2c6b614785 tempest-SecurityGroupsNegativeTestJSON-490484102 tempest-SecurityGroupsNegativeTestJSON-490484102-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/c8cf2e68-6971-498f-97f1-9c92372c43c5" status: 400 len: 182 microversion: 2.1 time: 0.339822 Oct 18 15:37:28.405924 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1522/2944] 10.222.0.60 () {58 vars in 1272 bytes} [Tue Oct 18 15:37:28 2022] DELETE /compute/v2.1/os-security-groups/c8cf2e68-6971-498f-97f1-9c92372c43c5 => generated 182 bytes in 341 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:37:28.417983 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-feb73307-fa1c-48b3-ae7e-c3da3cf2b5f7 tempest-SecurityGroupsNegativeTestJSON-490484102 tempest-SecurityGroupsNegativeTestJSON-490484102-project] Calling method '.version_select at 0x7f7c3c850700>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:28.498902 n-d-853682-5 devstack@n-api.service[120405]: DEBUG neutronclient.v2_0.client [None req-feb73307-fa1c-48b3-ae7e-c3da3cf2b5f7 tempest-SecurityGroupsNegativeTestJSON-490484102 tempest-SecurityGroupsNegativeTestJSON-490484102-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a915074e-075b-497a-b34c-a76d58d9cdd2 does not exist", "detail": ""}} {{(pid=120405) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 15:37:28.499507 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.security_group_api [None req-feb73307-fa1c-48b3-ae7e-c3da3cf2b5f7 tempest-SecurityGroupsNegativeTestJSON-490484102 tempest-SecurityGroupsNegativeTestJSON-490484102-project] Neutron security group a915074e-075b-497a-b34c-a76d58d9cdd2 not found {{(pid=120405) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 18 15:37:28.500039 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-feb73307-fa1c-48b3-ae7e-c3da3cf2b5f7 tempest-SecurityGroupsNegativeTestJSON-490484102 tempest-SecurityGroupsNegativeTestJSON-490484102-project] HTTP exception thrown: Security group a915074e-075b-497a-b34c-a76d58d9cdd2 does not exist Oct 18 15:37:28.500039 n-d-853682-5 devstack@n-api.service[120405]: Neutron server returns request_ids: ['req-b5924254-b399-4435-abe4-410656db9a5f'] Oct 18 15:37:28.501913 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-feb73307-fa1c-48b3-ae7e-c3da3cf2b5f7 tempest-SecurityGroupsNegativeTestJSON-490484102 tempest-SecurityGroupsNegativeTestJSON-490484102-project] Request method failure captured: Oct 18 15:37:28.501913 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/os-security-groups/a915074e-075b-497a-b34c-a76d58d9cdd2 HTTP/1.1 Oct 18 15:37:28.501913 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:37:28.501913 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:37:28.501913 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:37:28.501913 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:37:28.501913 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:37:28.501913 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:37:28.501913 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:37:28.501913 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:37:28.501913 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsg2ie1p1AAQJBf4OaQtWk7iEfBcoVUkrazyVZUogOmcZD8wV5KLs2PIxl3wp3y93C2hvvSy5-SBljiHXsSMMERXrzUXkMNlEjEGa3CMonHw8LxDR5lc_qZHlNI-ygULuILtI5wPi0EcFoMA8U0ksLQddLr_L-fxC9MtzgQftIjUJP0 Oct 18 15:37:28.501913 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:37:28.501913 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:37:28.501913 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:37:28.501913 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:37:28.501913 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:37:28.501913 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:37:28.501913 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: a5512441dd9e400389a2339de4da868b Oct 18 15:37:28.501913 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-490484102 Oct 18 15:37:28.501913 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:37:28.501913 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:37:28.503213 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a5512441dd9e400389a2339de4da868b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a5512441dd9e400389a2339de4da868b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a5512441dd9e400389a2339de4da868b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a5512441dd9e400389a2339de4da868b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:37:28.503213 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-490484102 Oct 18 15:37:28.503213 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: a5512441dd9e400389a2339de4da868b Oct 18 15:37:28.503213 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-490484102 Oct 18 15:37:28.503213 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-SecurityGroupsNegativeTestJSON-490484102-project Oct 18 15:37:28.503213 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:37:28.503213 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:37:28.503213 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: f03fcf82048040f7b9bddfcb590e1279 Oct 18 15:37:28.503213 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-490484102-project Oct 18 15:37:28.503213 n-d-853682-5 devstack@n-api.service[120405]: method: Oct 18 15:37:28.503213 n-d-853682-5 devstack@n-api.service[120405]: exception: Security group a915074e-075b-497a-b34c-a76d58d9cdd2 does not exist Oct 18 15:37:28.503213 n-d-853682-5 devstack@n-api.service[120405]: Neutron server returns request_ids: ['req-b5924254-b399-4435-abe4-410656db9a5f'] Oct 18 15:37:28.503213 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'a915074e-075b-497a-b34c-a76d58d9cdd2'} Oct 18 15:37:28.504110 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:37:28.504110 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:37:28.504110 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 18 15:37:28.504110 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 18 15:37:28.504110 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:37:28.504110 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:37:28.504110 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 18 15:37:28.504110 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 18 15:37:28.504110 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:37:28.504110 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:37:28.504110 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 15:37:28.504110 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 15:37:28.504110 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:37:28.504110 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:37:28.504110 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 15:37:28.504110 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 15:37:28.504110 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:37:28.504110 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:37:28.504110 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 15:37:28.506787 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 15:37:28.506787 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:37:28.506787 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:37:28.506787 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 15:37:28.506787 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 15:37:28.506787 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 15:37:28.506787 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 15:37:28.506787 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a915074e-075b-497a-b34c-a76d58d9cdd2 does not exist Oct 18 15:37:28.506787 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b5924254-b399-4435-abe4-410656db9a5f'] Oct 18 15:37:28.506787 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:37:28.506787 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:37:28.506787 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:37:28.506787 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:37:28.506787 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 18 15:37:28.506787 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 18 15:37:28.506787 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 18 15:37:28.506787 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 15:37:28.506787 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a915074e-075b-497a-b34c-a76d58d9cdd2 does not exist Oct 18 15:37:28.507992 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b5924254-b399-4435-abe4-410656db9a5f'] Oct 18 15:37:28.507992 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:37:28.507992 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:37:28.507992 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:37:28.507992 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:37:28.507992 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:37:28.507992 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:37:28.507992 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:37:28.507992 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:37:28.507992 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:37:28.507992 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:37:28.507992 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:37:28.507992 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:37:28.507992 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 18 15:37:28.507992 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 15:37:28.507992 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a915074e-075b-497a-b34c-a76d58d9cdd2 does not exist Oct 18 15:37:28.507992 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b5924254-b399-4435-abe4-410656db9a5f'] Oct 18 15:37:28.507992 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:37:28.507992 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:37:28.507992 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:37:28.507992 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:37:28.510239 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:37:28.510239 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:37:28.510239 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:37:28.510239 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:37:28.510239 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a915074e-075b-497a-b34c-a76d58d9cdd2 does not exist Oct 18 15:37:28.510239 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b5924254-b399-4435-abe4-410656db9a5f'] Oct 18 15:37:28.510239 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:37:28.510239 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-feb73307-fa1c-48b3-ae7e-c3da3cf2b5f7 tempest-SecurityGroupsNegativeTestJSON-490484102 tempest-SecurityGroupsNegativeTestJSON-490484102-project] Returning 404 to user: Security group a915074e-075b-497a-b34c-a76d58d9cdd2 does not exist Oct 18 15:37:28.510239 n-d-853682-5 devstack@n-api.service[120405]: Neutron server returns request_ids: ['req-b5924254-b399-4435-abe4-410656db9a5f'] {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:37:28.510239 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-feb73307-fa1c-48b3-ae7e-c3da3cf2b5f7 tempest-SecurityGroupsNegativeTestJSON-490484102 tempest-SecurityGroupsNegativeTestJSON-490484102-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups/a915074e-075b-497a-b34c-a76d58d9cdd2" status: 404 len: 194 microversion: 2.1 time: 0.090034 Oct 18 15:37:28.510239 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1523/2945] 10.222.0.60 () {58 vars in 1269 bytes} [Tue Oct 18 15:37:28 2022] GET /compute/v2.1/os-security-groups/a915074e-075b-497a-b34c-a76d58d9cdd2 => generated 194 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:37:28.518795 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-40f71c7c-f989-45ea-9ee6-82956d3699c0 tempest-SecurityGroupsNegativeTestJSON-490484102 tempest-SecurityGroupsNegativeTestJSON-490484102-project] Action: 'update', calling method: .version_select at 0x7f7c3d0f6e50>, body: {"security_group": {"name": "tempest-sg-523801424", "description": "tempest-description-2033586442"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:37:28.590681 n-d-853682-5 devstack@n-api.service[120405]: DEBUG neutronclient.v2_0.client [None req-40f71c7c-f989-45ea-9ee6-82956d3699c0 tempest-SecurityGroupsNegativeTestJSON-490484102 tempest-SecurityGroupsNegativeTestJSON-490484102-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1d3ccbc0-22a9-4a5b-81c5-1f3b52199081 does not exist", "detail": ""}} {{(pid=120405) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 15:37:28.592077 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.security_group_api [None req-40f71c7c-f989-45ea-9ee6-82956d3699c0 tempest-SecurityGroupsNegativeTestJSON-490484102 tempest-SecurityGroupsNegativeTestJSON-490484102-project] Neutron security group 1d3ccbc0-22a9-4a5b-81c5-1f3b52199081 not found {{(pid=120405) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 18 15:37:28.593836 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-40f71c7c-f989-45ea-9ee6-82956d3699c0 tempest-SecurityGroupsNegativeTestJSON-490484102 tempest-SecurityGroupsNegativeTestJSON-490484102-project] HTTP exception thrown: Security group 1d3ccbc0-22a9-4a5b-81c5-1f3b52199081 does not exist Oct 18 15:37:28.593836 n-d-853682-5 devstack@n-api.service[120405]: Neutron server returns request_ids: ['req-cf29fcf6-ae3c-4f83-8cb3-c73a46281755'] Oct 18 15:37:28.599710 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-40f71c7c-f989-45ea-9ee6-82956d3699c0 tempest-SecurityGroupsNegativeTestJSON-490484102 tempest-SecurityGroupsNegativeTestJSON-490484102-project] Request method failure captured: Oct 18 15:37:28.599710 n-d-853682-5 devstack@n-api.service[120405]: request: PUT /compute/v2.1/os-security-groups/1d3ccbc0-22a9-4a5b-81c5-1f3b52199081 HTTP/1.1 Oct 18 15:37:28.599710 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:37:28.599710 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:37:28.599710 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:37:28.599710 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 101 Oct 18 15:37:28.599710 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:37:28.599710 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:37:28.599710 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:37:28.599710 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:37:28.599710 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsg2ie1p1AAQJBf4OaQtWk7iEfBcoVUkrazyVZUogOmcZD8wV5KLs2PIxl3wp3y93C2hvvSy5-SBljiHXsSMMERXrzUXkMNlEjEGa3CMonHw8LxDR5lc_qZHlNI-ygULuILtI5wPi0EcFoMA8U0ksLQddLr_L-fxC9MtzgQftIjUJP0 Oct 18 15:37:28.599710 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:37:28.599710 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:37:28.599710 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:37:28.599710 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:37:28.599710 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:37:28.599710 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:37:28.599710 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: a5512441dd9e400389a2339de4da868b Oct 18 15:37:28.599710 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-490484102 Oct 18 15:37:28.599710 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:37:28.599710 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:37:28.601797 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a5512441dd9e400389a2339de4da868b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a5512441dd9e400389a2339de4da868b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a5512441dd9e400389a2339de4da868b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a5512441dd9e400389a2339de4da868b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:37:28.601797 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-490484102 Oct 18 15:37:28.601797 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: a5512441dd9e400389a2339de4da868b Oct 18 15:37:28.601797 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-490484102 Oct 18 15:37:28.601797 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-SecurityGroupsNegativeTestJSON-490484102-project Oct 18 15:37:28.601797 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:37:28.601797 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:37:28.601797 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: f03fcf82048040f7b9bddfcb590e1279 Oct 18 15:37:28.601797 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-490484102-project Oct 18 15:37:28.601797 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:37:28.601797 n-d-853682-5 devstack@n-api.service[120405]: {"security_group": {"name": "tempest-sg-523801424", "description": "tempest-description-2033586442"}} Oct 18 15:37:28.601797 n-d-853682-5 devstack@n-api.service[120405]: method: Oct 18 15:37:28.601797 n-d-853682-5 devstack@n-api.service[120405]: exception: Security group 1d3ccbc0-22a9-4a5b-81c5-1f3b52199081 does not exist Oct 18 15:37:28.602582 n-d-853682-5 devstack@n-api.service[120405]: Neutron server returns request_ids: ['req-cf29fcf6-ae3c-4f83-8cb3-c73a46281755'] Oct 18 15:37:28.602582 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '1d3ccbc0-22a9-4a5b-81c5-1f3b52199081', 'body': {'security_group': {'name': 'tempest-sg-523801424', 'description': 'tempest-description-2033586442'}}} Oct 18 15:37:28.602582 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:37:28.602582 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:37:28.602582 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 18 15:37:28.602582 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 18 15:37:28.602582 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:37:28.602582 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:37:28.602582 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 18 15:37:28.602582 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 18 15:37:28.602582 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:37:28.602582 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:37:28.602582 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 15:37:28.602582 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 15:37:28.602582 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:37:28.602582 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:37:28.602582 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 15:37:28.602582 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 15:37:28.603729 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:37:28.603729 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:37:28.603729 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 15:37:28.603729 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 15:37:28.603729 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:37:28.603729 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:37:28.603729 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 15:37:28.603729 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 15:37:28.603729 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 15:37:28.603729 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 15:37:28.603729 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1d3ccbc0-22a9-4a5b-81c5-1f3b52199081 does not exist Oct 18 15:37:28.603729 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cf29fcf6-ae3c-4f83-8cb3-c73a46281755'] Oct 18 15:37:28.603729 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:37:28.603729 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:37:28.603729 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:37:28.603729 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:37:28.603729 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 18 15:37:28.603729 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 18 15:37:28.603729 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 18 15:37:28.606240 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 15:37:28.606240 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1d3ccbc0-22a9-4a5b-81c5-1f3b52199081 does not exist Oct 18 15:37:28.606240 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cf29fcf6-ae3c-4f83-8cb3-c73a46281755'] Oct 18 15:37:28.606240 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:37:28.606240 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:37:28.606240 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:37:28.606240 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:37:28.606240 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:37:28.606240 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:37:28.606240 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:37:28.606240 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:37:28.606240 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:37:28.606240 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:37:28.606240 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:37:28.606240 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:37:28.606240 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 18 15:37:28.606240 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 15:37:28.606240 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1d3ccbc0-22a9-4a5b-81c5-1f3b52199081 does not exist Oct 18 15:37:28.606240 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cf29fcf6-ae3c-4f83-8cb3-c73a46281755'] Oct 18 15:37:28.606240 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:37:28.608981 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:37:28.608981 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:37:28.608981 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:37:28.608981 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:37:28.608981 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:37:28.608981 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:37:28.608981 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:37:28.608981 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1d3ccbc0-22a9-4a5b-81c5-1f3b52199081 does not exist Oct 18 15:37:28.608981 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cf29fcf6-ae3c-4f83-8cb3-c73a46281755'] Oct 18 15:37:28.608981 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:37:28.608981 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-40f71c7c-f989-45ea-9ee6-82956d3699c0 tempest-SecurityGroupsNegativeTestJSON-490484102 tempest-SecurityGroupsNegativeTestJSON-490484102-project] Returning 404 to user: Security group 1d3ccbc0-22a9-4a5b-81c5-1f3b52199081 does not exist Oct 18 15:37:28.608981 n-d-853682-5 devstack@n-api.service[120405]: Neutron server returns request_ids: ['req-cf29fcf6-ae3c-4f83-8cb3-c73a46281755'] {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:37:28.608981 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-40f71c7c-f989-45ea-9ee6-82956d3699c0 tempest-SecurityGroupsNegativeTestJSON-490484102 tempest-SecurityGroupsNegativeTestJSON-490484102-project] 10.222.0.60 "PUT /compute/v2.1/os-security-groups/1d3ccbc0-22a9-4a5b-81c5-1f3b52199081" status: 404 len: 194 microversion: 2.1 time: 0.089661 Oct 18 15:37:28.611521 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1524/2946] 10.222.0.60 () {60 vars in 1290 bytes} [Tue Oct 18 15:37:28 2022] PUT /compute/v2.1/os-security-groups/1d3ccbc0-22a9-4a5b-81c5-1f3b52199081 => generated 194 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:37:28.614949 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-52995868-a365-4338-afa4-a65ba804964f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:28.634713 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-52995868-a365-4338-afa4-a65ba804964f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9" status: 200 len: 1367 microversion: 2.1 time: 0.448684 Oct 18 15:37:28.636367 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1423/2947] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:28 2022] GET /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9 => generated 1367 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:28.797369 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c3dadc02-d576-4eff-8918-325136d693f9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:28.797983 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c3dadc02-d576-4eff-8918-325136d693f9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:28.808701 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c3dadc02-d576-4eff-8918-325136d693f9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:28.809250 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c3dadc02-d576-4eff-8918-325136d693f9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:28.809698 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c3dadc02-d576-4eff-8918-325136d693f9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:28.810419 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c3dadc02-d576-4eff-8918-325136d693f9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:28.810904 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c3dadc02-d576-4eff-8918-325136d693f9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:28.811329 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c3dadc02-d576-4eff-8918-325136d693f9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:29.043259 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c3dadc02-d576-4eff-8918-325136d693f9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:29.055208 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c3dadc02-d576-4eff-8918-325136d693f9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca" status: 200 len: 1509 microversion: 2.1 time: 0.264028 Oct 18 15:37:29.068229 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1525/2948] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:28 2022] GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca => generated 1509 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:29.092111 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b88e7423-a799-46a1-85ce-68a84dcd9b32 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:29.092990 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b88e7423-a799-46a1-85ce-68a84dcd9b32 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 12e415d7-7c40-41a0-957a-a083dbcf2b43] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:29.101828 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b88e7423-a799-46a1-85ce-68a84dcd9b32 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:29.104171 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b88e7423-a799-46a1-85ce-68a84dcd9b32 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:29.105404 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b88e7423-a799-46a1-85ce-68a84dcd9b32 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:29.106587 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b88e7423-a799-46a1-85ce-68a84dcd9b32 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:29.107286 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b88e7423-a799-46a1-85ce-68a84dcd9b32 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:29.108794 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b88e7423-a799-46a1-85ce-68a84dcd9b32 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:29.123613 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ff80a0d4-239d-4d26-8fd2-e60b12260ba6 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:29.124596 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ff80a0d4-239d-4d26-8fd2-e60b12260ba6 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 89919fa6-1fd6-42d0-ab81-d0cdebc3960c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:29.137063 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ff80a0d4-239d-4d26-8fd2-e60b12260ba6 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:29.141473 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ff80a0d4-239d-4d26-8fd2-e60b12260ba6 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:29.142110 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ff80a0d4-239d-4d26-8fd2-e60b12260ba6 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:29.142963 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ff80a0d4-239d-4d26-8fd2-e60b12260ba6 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:29.143518 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ff80a0d4-239d-4d26-8fd2-e60b12260ba6 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:29.144034 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ff80a0d4-239d-4d26-8fd2-e60b12260ba6 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:29.339906 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ff80a0d4-239d-4d26-8fd2-e60b12260ba6 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:29.355242 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ff80a0d4-239d-4d26-8fd2-e60b12260ba6 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/89919fa6-1fd6-42d0-ab81-d0cdebc3960c" status: 200 len: 1426 microversion: 2.1 time: 0.235498 Oct 18 15:37:29.356102 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1526/2949] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:29 2022] GET /compute/v2.1/servers/89919fa6-1fd6-42d0-ab81-d0cdebc3960c => generated 1426 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:29.376845 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-340ca86c-f9ae-4306-81b8-35e3db153242 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '.version_select at 0x7f7c3c8548b0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:29.461029 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b88e7423-a799-46a1-85ce-68a84dcd9b32 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:29.478141 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-340ca86c-f9ae-4306-81b8-35e3db153242 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "GET /compute/v2.1/images/8ce4db55-b062-45bf-b0b6-d3fb96c3e2c5" status: 200 len: 1423 microversion: 2.1 time: 0.120867 Oct 18 15:37:29.478744 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1527/2950] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:37:29 2022] GET /compute/v2.1/images/8ce4db55-b062-45bf-b0b6-d3fb96c3e2c5 => generated 1423 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:29.488989 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b88e7423-a799-46a1-85ce-68a84dcd9b32 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43" status: 200 len: 1543 microversion: 2.1 time: 0.401144 Oct 18 15:37:29.490434 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1424/2951] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:29 2022] GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43 => generated 1543 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:29.660878 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6fd1c8bc-a80a-4b22-bbcd-ebcd95989a3a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:29.661730 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6fd1c8bc-a80a-4b22-bbcd-ebcd95989a3a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 57537212-8816-4122-adbe-264f7035a0e9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:29.673460 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6fd1c8bc-a80a-4b22-bbcd-ebcd95989a3a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:29.674901 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6fd1c8bc-a80a-4b22-bbcd-ebcd95989a3a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:29.676276 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6fd1c8bc-a80a-4b22-bbcd-ebcd95989a3a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:29.677171 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6fd1c8bc-a80a-4b22-bbcd-ebcd95989a3a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:29.678436 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6fd1c8bc-a80a-4b22-bbcd-ebcd95989a3a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:29.679668 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6fd1c8bc-a80a-4b22-bbcd-ebcd95989a3a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:29.708260 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-ad473fc8-1d84-4c7e-9bc0-535d3dc7eefd req-193a3227-04a6-4f7e-9c36-1a3da0c5548f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89919fa6-1fd6-42d0-ab81-d0cdebc3960c", "name": "network-vif-deleted", "tag": "82b30c0f-9d62-4ecd-bb2b-b3f207ddc518"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:37:29.753994 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ad473fc8-1d84-4c7e-9bc0-535d3dc7eefd req-193a3227-04a6-4f7e-9c36-1a3da0c5548f service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:29.758456 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ad473fc8-1d84-4c7e-9bc0-535d3dc7eefd req-193a3227-04a6-4f7e-9c36-1a3da0c5548f service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:29.759536 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ad473fc8-1d84-4c7e-9bc0-535d3dc7eefd req-193a3227-04a6-4f7e-9c36-1a3da0c5548f service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:29.790172 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-ad473fc8-1d84-4c7e-9bc0-535d3dc7eefd req-193a3227-04a6-4f7e-9c36-1a3da0c5548f service nova] Creating event network-vif-deleted:82b30c0f-9d62-4ecd-bb2b-b3f207ddc518 for instance 89919fa6-1fd6-42d0-ab81-d0cdebc3960c on n-h1-853682-5 Oct 18 15:37:29.806094 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-ad473fc8-1d84-4c7e-9bc0-535d3dc7eefd req-193a3227-04a6-4f7e-9c36-1a3da0c5548f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108125 Oct 18 15:37:29.808403 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1425/2952] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:37:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:37:29.981190 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-fe26cda5-27b5-49d9-8c3d-eda9670a967d req-65adca66-d915-4c97-9dae-19218fcdc2c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "004539c4-260d-46a9-beed-d9c4b9a76106", "name": "network-vif-plugged", "status": "completed", "tag": "7e81b5b0-1e7e-436b-84c7-bab9312ea51d"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:37:30.005833 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-fe26cda5-27b5-49d9-8c3d-eda9670a967d req-65adca66-d915-4c97-9dae-19218fcdc2c4 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:30.007633 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-fe26cda5-27b5-49d9-8c3d-eda9670a967d req-65adca66-d915-4c97-9dae-19218fcdc2c4 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:30.008272 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-fe26cda5-27b5-49d9-8c3d-eda9670a967d req-65adca66-d915-4c97-9dae-19218fcdc2c4 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:30.016465 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6fd1c8bc-a80a-4b22-bbcd-ebcd95989a3a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:30.031458 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6fd1c8bc-a80a-4b22-bbcd-ebcd95989a3a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9" status: 200 len: 1367 microversion: 2.1 time: 0.374602 Oct 18 15:37:30.039750 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1528/2953] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:29 2022] GET /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9 => generated 1367 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:30.052003 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-fe26cda5-27b5-49d9-8c3d-eda9670a967d req-65adca66-d915-4c97-9dae-19218fcdc2c4 service nova] Creating event network-vif-plugged:7e81b5b0-1e7e-436b-84c7-bab9312ea51d for instance 004539c4-260d-46a9-beed-d9c4b9a76106 on n-h1-853682-5 Oct 18 15:37:30.065699 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-fe26cda5-27b5-49d9-8c3d-eda9670a967d req-65adca66-d915-4c97-9dae-19218fcdc2c4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089763 Oct 18 15:37:30.069126 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1426/2954] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:37:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:37:30.080472 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e1b9a1e4-3c63-4001-a93d-008826535868 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:30.081783 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e1b9a1e4-3c63-4001-a93d-008826535868 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:30.093182 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e1b9a1e4-3c63-4001-a93d-008826535868 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:30.095850 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e1b9a1e4-3c63-4001-a93d-008826535868 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:30.096507 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e1b9a1e4-3c63-4001-a93d-008826535868 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:30.097470 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e1b9a1e4-3c63-4001-a93d-008826535868 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:30.098122 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e1b9a1e4-3c63-4001-a93d-008826535868 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:30.098731 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e1b9a1e4-3c63-4001-a93d-008826535868 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:30.380448 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-237fa518-28c1-496a-97e0-a3be0e9a0360 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:30.381643 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-237fa518-28c1-496a-97e0-a3be0e9a0360 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 89919fa6-1fd6-42d0-ab81-d0cdebc3960c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:30.392611 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e1b9a1e4-3c63-4001-a93d-008826535868 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:30.402477 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e1b9a1e4-3c63-4001-a93d-008826535868 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca" status: 200 len: 1509 microversion: 2.1 time: 0.326993 Oct 18 15:37:30.411637 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-237fa518-28c1-496a-97e0-a3be0e9a0360 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:30.412142 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-237fa518-28c1-496a-97e0-a3be0e9a0360 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:30.412596 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-237fa518-28c1-496a-97e0-a3be0e9a0360 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:30.413887 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-237fa518-28c1-496a-97e0-a3be0e9a0360 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:30.415543 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1529/2955] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:30 2022] GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca => generated 1509 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:30.416214 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-237fa518-28c1-496a-97e0-a3be0e9a0360 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:30.416663 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-237fa518-28c1-496a-97e0-a3be0e9a0360 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:30.505454 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9da031cd-dbac-41eb-9733-ce913aa13cf7 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '.version_select at 0x7f7c3da221f0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:30.628112 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-237fa518-28c1-496a-97e0-a3be0e9a0360 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:30.638949 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-237fa518-28c1-496a-97e0-a3be0e9a0360 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/89919fa6-1fd6-42d0-ab81-d0cdebc3960c" status: 200 len: 1297 microversion: 2.1 time: 0.263685 Oct 18 15:37:30.665692 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1427/2956] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:30 2022] GET /compute/v2.1/servers/89919fa6-1fd6-42d0-ab81-d0cdebc3960c => generated 1297 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:30.672393 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f7be319c-7cec-4464-9bd0-626a0d7b9b64 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:30.673279 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f7be319c-7cec-4464-9bd0-626a0d7b9b64 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 12e415d7-7c40-41a0-957a-a083dbcf2b43] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:30.683973 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7be319c-7cec-4464-9bd0-626a0d7b9b64 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:30.685152 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7be319c-7cec-4464-9bd0-626a0d7b9b64 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:30.685784 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7be319c-7cec-4464-9bd0-626a0d7b9b64 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:30.686684 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7be319c-7cec-4464-9bd0-626a0d7b9b64 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:30.687317 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7be319c-7cec-4464-9bd0-626a0d7b9b64 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:30.688598 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7be319c-7cec-4464-9bd0-626a0d7b9b64 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:30.914677 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f7be319c-7cec-4464-9bd0-626a0d7b9b64 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:30.925585 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f7be319c-7cec-4464-9bd0-626a0d7b9b64 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43" status: 200 len: 1543 microversion: 2.1 time: 0.258488 Oct 18 15:37:30.926893 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1428/2957] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:30 2022] GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43 => generated 1543 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:31.065348 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-297db2dc-400b-4688-9a5d-1be0ece55d9d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:31.067406 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-297db2dc-400b-4688-9a5d-1be0ece55d9d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 57537212-8816-4122-adbe-264f7035a0e9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:31.081970 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-297db2dc-400b-4688-9a5d-1be0ece55d9d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:31.086817 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-297db2dc-400b-4688-9a5d-1be0ece55d9d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:31.087482 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-297db2dc-400b-4688-9a5d-1be0ece55d9d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:31.088431 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-297db2dc-400b-4688-9a5d-1be0ece55d9d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:31.088935 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-297db2dc-400b-4688-9a5d-1be0ece55d9d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:31.089376 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-297db2dc-400b-4688-9a5d-1be0ece55d9d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:31.456478 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-297db2dc-400b-4688-9a5d-1be0ece55d9d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:31.527683 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-297db2dc-400b-4688-9a5d-1be0ece55d9d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9" status: 200 len: 1558 microversion: 2.1 time: 0.463811 Oct 18 15:37:31.534758 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1429/2958] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:31 2022] GET /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9 => generated 1558 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:37:31.557916 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3fd916b9-d611-497e-8bb6-800db93a36a4 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:31.560703 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3fd916b9-d611-497e-8bb6-800db93a36a4 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:31.618353 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3fd916b9-d611-497e-8bb6-800db93a36a4 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:31.622384 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3fd916b9-d611-497e-8bb6-800db93a36a4 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:31.622908 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3fd916b9-d611-497e-8bb6-800db93a36a4 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:31.627125 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3fd916b9-d611-497e-8bb6-800db93a36a4 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:31.627853 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3fd916b9-d611-497e-8bb6-800db93a36a4 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:31.628477 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3fd916b9-d611-497e-8bb6-800db93a36a4 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:32.031631 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3fd916b9-d611-497e-8bb6-800db93a36a4 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:32.045006 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3fd916b9-d611-497e-8bb6-800db93a36a4 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca" status: 200 len: 1509 microversion: 2.1 time: 0.508620 Oct 18 15:37:32.047044 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1430/2959] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:31 2022] GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca => generated 1509 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:32.077640 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-73dc3e95-6100-4402-9570-057346c32f2b tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:32.079007 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-73dc3e95-6100-4402-9570-057346c32f2b tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 57537212-8816-4122-adbe-264f7035a0e9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:32.116671 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73dc3e95-6100-4402-9570-057346c32f2b tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:32.117661 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73dc3e95-6100-4402-9570-057346c32f2b tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:32.119895 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73dc3e95-6100-4402-9570-057346c32f2b tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:32.124429 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73dc3e95-6100-4402-9570-057346c32f2b tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:32.125455 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73dc3e95-6100-4402-9570-057346c32f2b tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:32.126264 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73dc3e95-6100-4402-9570-057346c32f2b tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:32.334297 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-73dc3e95-6100-4402-9570-057346c32f2b tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.280421 Oct 18 15:37:32.335286 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1431/2960] 10.222.0.60 () {58 vars in 1275 bytes} [Tue Oct 18 15:37:32 2022] GET /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9/os-interface => generated 285 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:37:32.342349 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1dae63c3-8a8d-4b67-bf34-4085c92ee2b5 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:32.343855 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1dae63c3-8a8d-4b67-bf34-4085c92ee2b5 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 89919fa6-1fd6-42d0-ab81-d0cdebc3960c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:32.357923 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1dae63c3-8a8d-4b67-bf34-4085c92ee2b5 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:32.359596 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1dae63c3-8a8d-4b67-bf34-4085c92ee2b5 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:32.360291 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1dae63c3-8a8d-4b67-bf34-4085c92ee2b5 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:32.361759 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1dae63c3-8a8d-4b67-bf34-4085c92ee2b5 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:32.362434 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1dae63c3-8a8d-4b67-bf34-4085c92ee2b5 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:32.363534 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1dae63c3-8a8d-4b67-bf34-4085c92ee2b5 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:32.460837 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1dae63c3-8a8d-4b67-bf34-4085c92ee2b5 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:32.462346 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1dae63c3-8a8d-4b67-bf34-4085c92ee2b5 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:32.463147 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1dae63c3-8a8d-4b67-bf34-4085c92ee2b5 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:32.463813 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-1dae63c3-8a8d-4b67-bf34-4085c92ee2b5 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lazy-loading 'fault' on Instance uuid 89919fa6-1fd6-42d0-ab81-d0cdebc3960c {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:37:32.530636 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1dae63c3-8a8d-4b67-bf34-4085c92ee2b5 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:32.542954 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1dae63c3-8a8d-4b67-bf34-4085c92ee2b5 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/89919fa6-1fd6-42d0-ab81-d0cdebc3960c" status: 200 len: 1302 microversion: 2.1 time: 0.206080 Oct 18 15:37:32.544470 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1432/2961] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:32 2022] GET /compute/v2.1/servers/89919fa6-1fd6-42d0-ab81-d0cdebc3960c => generated 1302 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:32.550688 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-16429633-ddb6-4aa9-b0e8-b6e64a4fe3ed tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:32.551590 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-16429633-ddb6-4aa9-b0e8-b6e64a4fe3ed tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 12e415d7-7c40-41a0-957a-a083dbcf2b43] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:32.559504 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16429633-ddb6-4aa9-b0e8-b6e64a4fe3ed tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:32.560337 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16429633-ddb6-4aa9-b0e8-b6e64a4fe3ed tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:32.561032 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16429633-ddb6-4aa9-b0e8-b6e64a4fe3ed tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:32.562156 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16429633-ddb6-4aa9-b0e8-b6e64a4fe3ed tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:32.563189 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16429633-ddb6-4aa9-b0e8-b6e64a4fe3ed tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:32.564397 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16429633-ddb6-4aa9-b0e8-b6e64a4fe3ed tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:32.779561 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-16429633-ddb6-4aa9-b0e8-b6e64a4fe3ed tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:32.811634 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-16429633-ddb6-4aa9-b0e8-b6e64a4fe3ed tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43" status: 200 len: 1543 microversion: 2.1 time: 0.260412 Oct 18 15:37:32.816956 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1433/2962] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:32 2022] GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43 => generated 1543 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:33.075051 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d307f320-cf98-4815-bb77-37acc0db7148 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:33.075871 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d307f320-cf98-4815-bb77-37acc0db7148 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:33.102262 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d307f320-cf98-4815-bb77-37acc0db7148 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:33.102772 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d307f320-cf98-4815-bb77-37acc0db7148 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:33.105058 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d307f320-cf98-4815-bb77-37acc0db7148 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:33.105978 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d307f320-cf98-4815-bb77-37acc0db7148 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:33.106367 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d307f320-cf98-4815-bb77-37acc0db7148 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:33.106713 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d307f320-cf98-4815-bb77-37acc0db7148 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:33.462612 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d307f320-cf98-4815-bb77-37acc0db7148 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:33.473901 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d307f320-cf98-4815-bb77-37acc0db7148 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca" status: 200 len: 1509 microversion: 2.1 time: 0.403196 Oct 18 15:37:33.475084 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1434/2963] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:33 2022] GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca => generated 1509 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:33.568212 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3741f2dc-ae9d-4dbc-9166-ba33fce01d2e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:33.569271 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3741f2dc-ae9d-4dbc-9166-ba33fce01d2e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 89919fa6-1fd6-42d0-ab81-d0cdebc3960c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:33.579899 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3741f2dc-ae9d-4dbc-9166-ba33fce01d2e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:33.581230 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3741f2dc-ae9d-4dbc-9166-ba33fce01d2e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:33.581685 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3741f2dc-ae9d-4dbc-9166-ba33fce01d2e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:33.583303 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3741f2dc-ae9d-4dbc-9166-ba33fce01d2e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:33.583783 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3741f2dc-ae9d-4dbc-9166-ba33fce01d2e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:33.584226 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3741f2dc-ae9d-4dbc-9166-ba33fce01d2e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:33.631989 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-3741f2dc-ae9d-4dbc-9166-ba33fce01d2e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] HTTP exception thrown: Instance 89919fa6-1fd6-42d0-ab81-d0cdebc3960c could not be found. Oct 18 15:37:33.633740 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3741f2dc-ae9d-4dbc-9166-ba33fce01d2e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Request method failure captured: Oct 18 15:37:33.633740 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/89919fa6-1fd6-42d0-ab81-d0cdebc3960c HTTP/1.1 Oct 18 15:37:33.633740 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:37:33.633740 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:37:33.633740 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:37:33.633740 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:37:33.633740 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:37:33.633740 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:37:33.633740 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:37:33.633740 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:37:33.633740 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsegotWawPE88WF0UdS2f0hiLSrx9fN4NnCvDKLz9vH601WLwsTJKSu9Wtx5s_xLHFKkPhNH0J5TCat7AsX5NLsIboybqlFUm3xfyaOl2l2m1v5JOfLLXpLJt4O0oH6NDjcOhAJJT9O3QjsBkviVLtPlrG0BYsL-rks9SvXPInpzjDM Oct 18 15:37:33.633740 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:37:33.633740 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:37:33.633740 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:37:33.633740 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:37:33.633740 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:37:33.633740 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:37:33.633740 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: de91b5fbc5c344019924b5353abf539d Oct 18 15:37:33.633740 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersAdminTestJSON-611782913 Oct 18 15:37:33.633740 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:37:33.633740 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:37:33.635366 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/de91b5fbc5c344019924b5353abf539d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/de91b5fbc5c344019924b5353abf539d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/de91b5fbc5c344019924b5353abf539d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_de91b5fbc5c344019924b5353abf539d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:37:33.635366 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersAdminTestJSON-611782913 Oct 18 15:37:33.635366 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: de91b5fbc5c344019924b5353abf539d Oct 18 15:37:33.635366 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersAdminTestJSON-611782913 Oct 18 15:37:33.635366 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersAdminTestJSON-611782913-project Oct 18 15:37:33.635366 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:37:33.635366 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:37:33.635366 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 99c56c556efc4f45b56699afa36e22bc Oct 18 15:37:33.635366 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersAdminTestJSON-611782913-project Oct 18 15:37:33.635366 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:37:33.635366 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 89919fa6-1fd6-42d0-ab81-d0cdebc3960c could not be found. Oct 18 15:37:33.635366 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '89919fa6-1fd6-42d0-ab81-d0cdebc3960c'} Oct 18 15:37:33.636280 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:37:33.636280 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:37:33.636280 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:37:33.636280 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:37:33.636280 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:37:33.636280 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:37:33.636280 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:37:33.636280 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:37:33.636280 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:37:33.636280 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:37:33.636280 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89919fa6-1fd6-42d0-ab81-d0cdebc3960c could not be found. Oct 18 15:37:33.636280 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:37:33.636280 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:37:33.636280 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:37:33.636280 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:37:33.636280 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:37:33.636280 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:37:33.636280 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:37:33.636280 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:37:33.636280 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:37:33.637791 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:37:33.637791 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:37:33.637791 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:37:33.637791 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:37:33.637791 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:37:33.637791 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:37:33.637791 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:37:33.637791 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89919fa6-1fd6-42d0-ab81-d0cdebc3960c could not be found. Oct 18 15:37:33.637791 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:37:33.637791 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:37:33.637791 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:37:33.637791 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:37:33.637791 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:37:33.637791 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:37:33.637791 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:37:33.637791 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:37:33.637791 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89919fa6-1fd6-42d0-ab81-d0cdebc3960c could not be found. Oct 18 15:37:33.637791 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:37:33.643985 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3741f2dc-ae9d-4dbc-9166-ba33fce01d2e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Returning 404 to user: Instance 89919fa6-1fd6-42d0-ab81-d0cdebc3960c could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:37:33.648171 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3741f2dc-ae9d-4dbc-9166-ba33fce01d2e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/89919fa6-1fd6-42d0-ab81-d0cdebc3960c" status: 404 len: 111 microversion: 2.1 time: 0.084054 Oct 18 15:37:33.654898 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1435/2964] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:33 2022] GET /compute/v2.1/servers/89919fa6-1fd6-42d0-ab81-d0cdebc3960c => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:37:33.668708 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4e71d369-4578-4052-b267-2a75f73814f4 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:33.669401 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4e71d369-4578-4052-b267-2a75f73814f4 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 9e209f2c-f8e3-467a-a1b4-1942972e01ab] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:33.680892 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e71d369-4578-4052-b267-2a75f73814f4 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:33.681635 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e71d369-4578-4052-b267-2a75f73814f4 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:33.682366 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e71d369-4578-4052-b267-2a75f73814f4 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:33.688729 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e71d369-4578-4052-b267-2a75f73814f4 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:33.689688 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e71d369-4578-4052-b267-2a75f73814f4 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:33.690350 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e71d369-4578-4052-b267-2a75f73814f4 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:33.766300 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4e71d369-4578-4052-b267-2a75f73814f4 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 9e209f2c-f8e3-467a-a1b4-1942972e01ab] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:37:34.030638 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4e71d369-4578-4052-b267-2a75f73814f4 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9e209f2c-f8e3-467a-a1b4-1942972e01ab" status: 204 len: 0 microversion: 2.1 time: 0.373737 Oct 18 15:37:34.032152 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1436/2965] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:37:33 2022] DELETE /compute/v2.1/servers/9e209f2c-f8e3-467a-a1b4-1942972e01ab => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:37:34.055893 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fcc69580-b9ac-453f-bd94-e53f34f9e21d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:34.062461 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fcc69580-b9ac-453f-bd94-e53f34f9e21d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 12e415d7-7c40-41a0-957a-a083dbcf2b43] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:34.082360 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fcc69580-b9ac-453f-bd94-e53f34f9e21d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:34.085298 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fcc69580-b9ac-453f-bd94-e53f34f9e21d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:34.086022 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fcc69580-b9ac-453f-bd94-e53f34f9e21d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:34.087030 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fcc69580-b9ac-453f-bd94-e53f34f9e21d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:34.091483 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fcc69580-b9ac-453f-bd94-e53f34f9e21d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:34.092284 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fcc69580-b9ac-453f-bd94-e53f34f9e21d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:34.436381 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fcc69580-b9ac-453f-bd94-e53f34f9e21d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:34.445147 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fcc69580-b9ac-453f-bd94-e53f34f9e21d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43" status: 200 len: 1543 microversion: 2.1 time: 0.409828 Oct 18 15:37:34.449103 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1437/2966] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:34 2022] GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43 => generated 1543 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:34.456771 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-722369e2-f8a5-46c2-9317-b0862838d689 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:34.471586 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-722369e2-f8a5-46c2-9317-b0862838d689 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 9e209f2c-f8e3-467a-a1b4-1942972e01ab] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:34.487399 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-722369e2-f8a5-46c2-9317-b0862838d689 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:34.491248 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-722369e2-f8a5-46c2-9317-b0862838d689 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:34.492328 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-722369e2-f8a5-46c2-9317-b0862838d689 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:34.493343 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-722369e2-f8a5-46c2-9317-b0862838d689 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:34.501672 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-722369e2-f8a5-46c2-9317-b0862838d689 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:34.503162 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-722369e2-f8a5-46c2-9317-b0862838d689 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:35.072007 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-722369e2-f8a5-46c2-9317-b0862838d689 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:35.092844 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-722369e2-f8a5-46c2-9317-b0862838d689 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/9e209f2c-f8e3-467a-a1b4-1942972e01ab" status: 200 len: 1469 microversion: 2.1 time: 0.633769 Oct 18 15:37:35.112637 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1438/2967] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:34 2022] GET /compute/v2.1/servers/9e209f2c-f8e3-467a-a1b4-1942972e01ab => generated 1469 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:35.132363 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1f24f74b-15be-446a-afce-b16e6a269d9c tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:35.141464 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1f24f74b-15be-446a-afce-b16e6a269d9c tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:35.161747 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f24f74b-15be-446a-afce-b16e6a269d9c tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:35.163331 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f24f74b-15be-446a-afce-b16e6a269d9c tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:35.171174 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f24f74b-15be-446a-afce-b16e6a269d9c tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:35.173069 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f24f74b-15be-446a-afce-b16e6a269d9c tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:35.174597 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f24f74b-15be-446a-afce-b16e6a269d9c tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:35.176260 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f24f74b-15be-446a-afce-b16e6a269d9c tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:35.284954 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:37:35.947074 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1f24f74b-15be-446a-afce-b16e6a269d9c tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:35.963428 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1f24f74b-15be-446a-afce-b16e6a269d9c tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca" status: 200 len: 1509 microversion: 2.1 time: 0.846126 Oct 18 15:37:35.964071 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1439/2968] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:35 2022] GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca => generated 1509 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:35.983558 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-66a63931-7f25-4c5c-8031-545eb756cb0e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:35.990032 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-66a63931-7f25-4c5c-8031-545eb756cb0e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 12e415d7-7c40-41a0-957a-a083dbcf2b43] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:36.024375 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66a63931-7f25-4c5c-8031-545eb756cb0e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:36.025175 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66a63931-7f25-4c5c-8031-545eb756cb0e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:36.025781 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66a63931-7f25-4c5c-8031-545eb756cb0e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:36.026652 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66a63931-7f25-4c5c-8031-545eb756cb0e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:36.027264 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66a63931-7f25-4c5c-8031-545eb756cb0e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:36.027850 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66a63931-7f25-4c5c-8031-545eb756cb0e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:36.709031 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-66a63931-7f25-4c5c-8031-545eb756cb0e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:36.719309 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-66a63931-7f25-4c5c-8031-545eb756cb0e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43" status: 200 len: 1543 microversion: 2.1 time: 0.754163 Oct 18 15:37:36.737778 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1440/2969] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:35 2022] GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43 => generated 1543 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:36.749412 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e41f5004-6274-47d4-9abd-1ea57bc67bc8 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:36.779668 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e41f5004-6274-47d4-9abd-1ea57bc67bc8 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 9e209f2c-f8e3-467a-a1b4-1942972e01ab] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:36.813021 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e41f5004-6274-47d4-9abd-1ea57bc67bc8 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:36.813617 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e41f5004-6274-47d4-9abd-1ea57bc67bc8 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:36.814184 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e41f5004-6274-47d4-9abd-1ea57bc67bc8 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:36.815009 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e41f5004-6274-47d4-9abd-1ea57bc67bc8 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:36.815639 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e41f5004-6274-47d4-9abd-1ea57bc67bc8 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:36.816859 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e41f5004-6274-47d4-9abd-1ea57bc67bc8 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:37.293568 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e41f5004-6274-47d4-9abd-1ea57bc67bc8 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:37.319613 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e41f5004-6274-47d4-9abd-1ea57bc67bc8 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/9e209f2c-f8e3-467a-a1b4-1942972e01ab" status: 200 len: 1469 microversion: 2.1 time: 0.579871 Oct 18 15:37:37.348547 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1441/2970] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:36 2022] GET /compute/v2.1/servers/9e209f2c-f8e3-467a-a1b4-1942972e01ab => generated 1469 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:37.356370 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-da0df117-3b23-4e76-b93f-7073e5188669 req-4b03d6b9-09d4-4f91-aa4d-c0af5e1635ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57537212-8816-4122-adbe-264f7035a0e9", "tag": "82baf8c1-00b0-44e2-8136-84d45e22d715"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:37:37.416026 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-da0df117-3b23-4e76-b93f-7073e5188669 req-4b03d6b9-09d4-4f91-aa4d-c0af5e1635ee service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:37.416507 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-da0df117-3b23-4e76-b93f-7073e5188669 req-4b03d6b9-09d4-4f91-aa4d-c0af5e1635ee service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:37.425420 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-da0df117-3b23-4e76-b93f-7073e5188669 req-4b03d6b9-09d4-4f91-aa4d-c0af5e1635ee service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:37.503642 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-da0df117-3b23-4e76-b93f-7073e5188669 req-4b03d6b9-09d4-4f91-aa4d-c0af5e1635ee service nova] Creating event network-changed:82baf8c1-00b0-44e2-8136-84d45e22d715 for instance 57537212-8816-4122-adbe-264f7035a0e9 on n-h1-853682-5 Oct 18 15:37:37.525283 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-da0df117-3b23-4e76-b93f-7073e5188669 req-4b03d6b9-09d4-4f91-aa4d-c0af5e1635ee service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.174969 Oct 18 15:37:37.526702 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1442/2971] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:37:37.544300 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8e94a636-668f-4a90-881f-10b4f104ba8e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:37.546843 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8e94a636-668f-4a90-881f-10b4f104ba8e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:37.581632 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e94a636-668f-4a90-881f-10b4f104ba8e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:37.590652 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e94a636-668f-4a90-881f-10b4f104ba8e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:37.591365 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e94a636-668f-4a90-881f-10b4f104ba8e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:37.607048 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e94a636-668f-4a90-881f-10b4f104ba8e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:37.607998 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e94a636-668f-4a90-881f-10b4f104ba8e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:37.608627 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e94a636-668f-4a90-881f-10b4f104ba8e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:38.195127 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8e94a636-668f-4a90-881f-10b4f104ba8e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:38.208077 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8e94a636-668f-4a90-881f-10b4f104ba8e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca" status: 200 len: 1530 microversion: 2.1 time: 0.679368 Oct 18 15:37:38.215464 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1443/2972] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:37 2022] GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca => generated 1530 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:38.227872 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-ab00b64d-f143-4004-b9b5-03e5a2705703 req-d127f521-2606-4fe2-8575-fbad42616374 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e209f2c-f8e3-467a-a1b4-1942972e01ab", "name": "network-vif-deleted", "tag": "7dbe5c02-8a53-44d0-8afd-137194991306"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:37:38.261727 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ab00b64d-f143-4004-b9b5-03e5a2705703 req-d127f521-2606-4fe2-8575-fbad42616374 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:38.262439 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ab00b64d-f143-4004-b9b5-03e5a2705703 req-d127f521-2606-4fe2-8575-fbad42616374 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:38.263041 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ab00b64d-f143-4004-b9b5-03e5a2705703 req-d127f521-2606-4fe2-8575-fbad42616374 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:38.319889 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-ab00b64d-f143-4004-b9b5-03e5a2705703 req-d127f521-2606-4fe2-8575-fbad42616374 service nova] Creating event network-vif-deleted:7dbe5c02-8a53-44d0-8afd-137194991306 for instance 9e209f2c-f8e3-467a-a1b4-1942972e01ab on n-h1-853682-5 Oct 18 15:37:38.328178 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-ab00b64d-f143-4004-b9b5-03e5a2705703 req-d127f521-2606-4fe2-8575-fbad42616374 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109178 Oct 18 15:37:38.330490 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1444/2973] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:37:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:37:38.350513 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-723f964c-b657-4eb0-a4f1-6ee9c4e24896 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:38.355210 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-723f964c-b657-4eb0-a4f1-6ee9c4e24896 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 12e415d7-7c40-41a0-957a-a083dbcf2b43] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:38.371280 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-723f964c-b657-4eb0-a4f1-6ee9c4e24896 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:38.372119 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-723f964c-b657-4eb0-a4f1-6ee9c4e24896 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:38.373131 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-723f964c-b657-4eb0-a4f1-6ee9c4e24896 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:38.376408 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-723f964c-b657-4eb0-a4f1-6ee9c4e24896 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:38.376985 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-723f964c-b657-4eb0-a4f1-6ee9c4e24896 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:38.377503 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-723f964c-b657-4eb0-a4f1-6ee9c4e24896 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:38.592847 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-723f964c-b657-4eb0-a4f1-6ee9c4e24896 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:38.603727 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-723f964c-b657-4eb0-a4f1-6ee9c4e24896 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43" status: 200 len: 1543 microversion: 2.1 time: 0.266419 Oct 18 15:37:38.619652 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1445/2974] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:38 2022] GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43 => generated 1543 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:38.629944 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-40816298-283f-4c4a-af8e-d021c8757094 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:38.630970 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-40816298-283f-4c4a-af8e-d021c8757094 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 9e209f2c-f8e3-467a-a1b4-1942972e01ab] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:38.643091 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40816298-283f-4c4a-af8e-d021c8757094 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:38.643596 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40816298-283f-4c4a-af8e-d021c8757094 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:38.644048 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40816298-283f-4c4a-af8e-d021c8757094 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:38.644767 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40816298-283f-4c4a-af8e-d021c8757094 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:38.645263 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40816298-283f-4c4a-af8e-d021c8757094 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:38.645699 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40816298-283f-4c4a-af8e-d021c8757094 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:38.814249 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40816298-283f-4c4a-af8e-d021c8757094 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:38.815077 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40816298-283f-4c4a-af8e-d021c8757094 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:38.815918 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40816298-283f-4c4a-af8e-d021c8757094 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:38.816605 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-40816298-283f-4c4a-af8e-d021c8757094 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lazy-loading 'fault' on Instance uuid 9e209f2c-f8e3-467a-a1b4-1942972e01ab {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:37:38.902932 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-40816298-283f-4c4a-af8e-d021c8757094 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:38.915932 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-40816298-283f-4c4a-af8e-d021c8757094 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/9e209f2c-f8e3-467a-a1b4-1942972e01ab" status: 200 len: 1304 microversion: 2.1 time: 0.293019 Oct 18 15:37:38.918885 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1446/2975] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:38 2022] GET /compute/v2.1/servers/9e209f2c-f8e3-467a-a1b4-1942972e01ab => generated 1304 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:39.232502 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-73428110-2f7a-4b4b-9db2-d5cdf7de8380 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:39.233577 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-73428110-2f7a-4b4b-9db2-d5cdf7de8380 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:39.254921 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73428110-2f7a-4b4b-9db2-d5cdf7de8380 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:39.256187 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73428110-2f7a-4b4b-9db2-d5cdf7de8380 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:39.259707 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73428110-2f7a-4b4b-9db2-d5cdf7de8380 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:39.262033 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73428110-2f7a-4b4b-9db2-d5cdf7de8380 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:39.264722 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73428110-2f7a-4b4b-9db2-d5cdf7de8380 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:39.266869 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73428110-2f7a-4b4b-9db2-d5cdf7de8380 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:39.595863 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-73428110-2f7a-4b4b-9db2-d5cdf7de8380 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:39.608691 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-73428110-2f7a-4b4b-9db2-d5cdf7de8380 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca" status: 200 len: 1530 microversion: 2.1 time: 0.380175 Oct 18 15:37:39.626842 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1447/2976] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:39 2022] GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca => generated 1530 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:37:39.640231 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-99d792d6-3009-41e2-b5be-c76d566bff3d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:39.643609 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-99d792d6-3009-41e2-b5be-c76d566bff3d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 12e415d7-7c40-41a0-957a-a083dbcf2b43] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:39.673447 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99d792d6-3009-41e2-b5be-c76d566bff3d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:39.676111 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99d792d6-3009-41e2-b5be-c76d566bff3d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:39.683941 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99d792d6-3009-41e2-b5be-c76d566bff3d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:39.690074 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99d792d6-3009-41e2-b5be-c76d566bff3d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:39.691520 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99d792d6-3009-41e2-b5be-c76d566bff3d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:39.691970 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99d792d6-3009-41e2-b5be-c76d566bff3d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:40.096564 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=32 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:37:40.098167 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-99d792d6-3009-41e2-b5be-c76d566bff3d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:40.123444 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-99d792d6-3009-41e2-b5be-c76d566bff3d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43" status: 200 len: 1543 microversion: 2.1 time: 0.491654 Oct 18 15:37:40.127750 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1448/2977] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:39 2022] GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43 => generated 1543 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:40.146122 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1ffcaec1-9ab4-455d-a44f-b107382c36ec tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:40.149474 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1ffcaec1-9ab4-455d-a44f-b107382c36ec tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 9e209f2c-f8e3-467a-a1b4-1942972e01ab] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:40.166583 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ffcaec1-9ab4-455d-a44f-b107382c36ec tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:40.167641 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ffcaec1-9ab4-455d-a44f-b107382c36ec tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:40.168319 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ffcaec1-9ab4-455d-a44f-b107382c36ec tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:40.169421 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ffcaec1-9ab4-455d-a44f-b107382c36ec tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:40.173238 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ffcaec1-9ab4-455d-a44f-b107382c36ec tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:40.173600 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ffcaec1-9ab4-455d-a44f-b107382c36ec tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:40.223234 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-1ffcaec1-9ab4-455d-a44f-b107382c36ec tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] HTTP exception thrown: Instance 9e209f2c-f8e3-467a-a1b4-1942972e01ab could not be found. Oct 18 15:37:40.232327 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1ffcaec1-9ab4-455d-a44f-b107382c36ec tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Request method failure captured: Oct 18 15:37:40.232327 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/9e209f2c-f8e3-467a-a1b4-1942972e01ab HTTP/1.1 Oct 18 15:37:40.232327 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:37:40.232327 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:37:40.232327 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:37:40.232327 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:37:40.232327 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:37:40.232327 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:37:40.232327 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:37:40.232327 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:37:40.232327 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsegotWawPE88WF0UdS2f0hiLSrx9fN4NnCvDKLz9vH601WLwsTJKSu9Wtx5s_xLHFKkPhNH0J5TCat7AsX5NLsIboybqlFUm3xfyaOl2l2m1v5JOfLLXpLJt4O0oH6NDjcOhAJJT9O3QjsBkviVLtPlrG0BYsL-rks9SvXPInpzjDM Oct 18 15:37:40.232327 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:37:40.232327 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:37:40.232327 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:37:40.232327 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:37:40.232327 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:37:40.232327 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:37:40.232327 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: de91b5fbc5c344019924b5353abf539d Oct 18 15:37:40.232327 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersAdminTestJSON-611782913 Oct 18 15:37:40.232327 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:37:40.232327 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:37:40.233862 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/de91b5fbc5c344019924b5353abf539d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/de91b5fbc5c344019924b5353abf539d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/de91b5fbc5c344019924b5353abf539d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_de91b5fbc5c344019924b5353abf539d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:37:40.233862 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersAdminTestJSON-611782913 Oct 18 15:37:40.233862 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: de91b5fbc5c344019924b5353abf539d Oct 18 15:37:40.233862 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersAdminTestJSON-611782913 Oct 18 15:37:40.233862 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersAdminTestJSON-611782913-project Oct 18 15:37:40.233862 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:37:40.233862 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:37:40.233862 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 99c56c556efc4f45b56699afa36e22bc Oct 18 15:37:40.233862 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersAdminTestJSON-611782913-project Oct 18 15:37:40.233862 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:37:40.233862 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 9e209f2c-f8e3-467a-a1b4-1942972e01ab could not be found. Oct 18 15:37:40.233862 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '9e209f2c-f8e3-467a-a1b4-1942972e01ab'} Oct 18 15:37:40.234633 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:37:40.234633 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:37:40.234633 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:37:40.234633 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:37:40.234633 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:37:40.234633 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:37:40.234633 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:37:40.234633 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:37:40.234633 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:37:40.234633 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:37:40.234633 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e209f2c-f8e3-467a-a1b4-1942972e01ab could not be found. Oct 18 15:37:40.234633 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:37:40.234633 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:37:40.234633 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:37:40.234633 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:37:40.234633 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:37:40.234633 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:37:40.234633 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:37:40.234633 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:37:40.234633 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:37:40.235923 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:37:40.235923 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:37:40.235923 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:37:40.235923 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:37:40.235923 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:37:40.235923 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:37:40.235923 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:37:40.235923 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e209f2c-f8e3-467a-a1b4-1942972e01ab could not be found. Oct 18 15:37:40.235923 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:37:40.235923 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:37:40.235923 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:37:40.235923 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:37:40.235923 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:37:40.235923 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:37:40.235923 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:37:40.235923 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:37:40.235923 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e209f2c-f8e3-467a-a1b4-1942972e01ab could not be found. Oct 18 15:37:40.235923 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:37:40.238136 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1ffcaec1-9ab4-455d-a44f-b107382c36ec tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Returning 404 to user: Instance 9e209f2c-f8e3-467a-a1b4-1942972e01ab could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:37:40.238136 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1ffcaec1-9ab4-455d-a44f-b107382c36ec tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/9e209f2c-f8e3-467a-a1b4-1942972e01ab" status: 404 len: 111 microversion: 2.1 time: 0.106872 Oct 18 15:37:40.245884 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1449/2978] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:40 2022] GET /compute/v2.1/servers/9e209f2c-f8e3-467a-a1b4-1942972e01ab => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:37:40.256860 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3e1a43f2-dc9c-4737-a7cf-2f185dbc651e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:40.260150 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3e1a43f2-dc9c-4737-a7cf-2f185dbc651e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:40.297750 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e1a43f2-dc9c-4737-a7cf-2f185dbc651e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:40.298436 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e1a43f2-dc9c-4737-a7cf-2f185dbc651e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:40.298892 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e1a43f2-dc9c-4737-a7cf-2f185dbc651e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:40.299635 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e1a43f2-dc9c-4737-a7cf-2f185dbc651e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:40.300106 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e1a43f2-dc9c-4737-a7cf-2f185dbc651e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:40.305326 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e1a43f2-dc9c-4737-a7cf-2f185dbc651e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:40.361018 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3e1a43f2-dc9c-4737-a7cf-2f185dbc651e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:37:40.400042 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=72 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:37:40.505326 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3e1a43f2-dc9c-4737-a7cf-2f185dbc651e tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "DELETE /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c" status: 204 len: 0 microversion: 2.1 time: 0.257392 Oct 18 15:37:40.511616 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1450/2979] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:37:40 2022] DELETE /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:37:40.522030 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f2b9c219-ceba-4bc6-9e25-6ea4dd1bc212 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:40.523417 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f2b9c219-ceba-4bc6-9e25-6ea4dd1bc212 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:40.541119 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2b9c219-ceba-4bc6-9e25-6ea4dd1bc212 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:40.541714 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2b9c219-ceba-4bc6-9e25-6ea4dd1bc212 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:40.542202 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2b9c219-ceba-4bc6-9e25-6ea4dd1bc212 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:40.543012 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2b9c219-ceba-4bc6-9e25-6ea4dd1bc212 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:40.543908 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2b9c219-ceba-4bc6-9e25-6ea4dd1bc212 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:40.545518 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2b9c219-ceba-4bc6-9e25-6ea4dd1bc212 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:40.737002 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f2b9c219-ceba-4bc6-9e25-6ea4dd1bc212 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:40.747049 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f2b9c219-ceba-4bc6-9e25-6ea4dd1bc212 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c" status: 200 len: 1469 microversion: 2.1 time: 0.231299 Oct 18 15:37:40.748216 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1451/2980] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:40 2022] GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c => generated 1469 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:40.754921 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b8e3af0b-f8bb-449a-bc6f-bc842ba9c439 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:40.755931 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b8e3af0b-f8bb-449a-bc6f-bc842ba9c439 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:40.763440 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8e3af0b-f8bb-449a-bc6f-bc842ba9c439 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:40.764154 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8e3af0b-f8bb-449a-bc6f-bc842ba9c439 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:40.764789 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8e3af0b-f8bb-449a-bc6f-bc842ba9c439 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:40.765724 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8e3af0b-f8bb-449a-bc6f-bc842ba9c439 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:40.766276 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8e3af0b-f8bb-449a-bc6f-bc842ba9c439 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:40.766884 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8e3af0b-f8bb-449a-bc6f-bc842ba9c439 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:40.950402 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b8e3af0b-f8bb-449a-bc6f-bc842ba9c439 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:40.965200 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b8e3af0b-f8bb-449a-bc6f-bc842ba9c439 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca" status: 200 len: 1525 microversion: 2.1 time: 0.214329 Oct 18 15:37:40.966427 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1452/2981] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:40 2022] GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca => generated 1525 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:40.972420 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-a455fc52-bf1a-49ee-add7-c252fe5f9148 req-72f6cd6d-9780-492b-91cb-3c86706657b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5c710aa-e860-4b2c-a59b-c25202c621ca", "name": "network-vif-plugged", "status": "completed", "tag": "e2a2e036-76b0-46b5-8c98-0566f70d8b58"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:37:40.985410 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a455fc52-bf1a-49ee-add7-c252fe5f9148 req-72f6cd6d-9780-492b-91cb-3c86706657b5 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:40.986386 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a455fc52-bf1a-49ee-add7-c252fe5f9148 req-72f6cd6d-9780-492b-91cb-3c86706657b5 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:40.987012 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a455fc52-bf1a-49ee-add7-c252fe5f9148 req-72f6cd6d-9780-492b-91cb-3c86706657b5 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:41.015413 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-a455fc52-bf1a-49ee-add7-c252fe5f9148 req-72f6cd6d-9780-492b-91cb-3c86706657b5 service nova] Creating event network-vif-plugged:e2a2e036-76b0-46b5-8c98-0566f70d8b58 for instance a5c710aa-e860-4b2c-a59b-c25202c621ca on n-h2-853682-5 Oct 18 15:37:41.024838 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-a455fc52-bf1a-49ee-add7-c252fe5f9148 req-72f6cd6d-9780-492b-91cb-3c86706657b5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056993 Oct 18 15:37:41.026932 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1453/2982] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:37:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:37:41.156662 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c3dd9524-ea04-40e5-8489-9a480b5d90c9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:41.157670 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c3dd9524-ea04-40e5-8489-9a480b5d90c9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 12e415d7-7c40-41a0-957a-a083dbcf2b43] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:41.165581 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3dd9524-ea04-40e5-8489-9a480b5d90c9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:41.166442 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3dd9524-ea04-40e5-8489-9a480b5d90c9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:41.166966 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3dd9524-ea04-40e5-8489-9a480b5d90c9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:41.167934 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3dd9524-ea04-40e5-8489-9a480b5d90c9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:41.168623 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3dd9524-ea04-40e5-8489-9a480b5d90c9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:41.169304 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3dd9524-ea04-40e5-8489-9a480b5d90c9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:41.375824 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c3dd9524-ea04-40e5-8489-9a480b5d90c9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:41.385608 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c3dd9524-ea04-40e5-8489-9a480b5d90c9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43" status: 200 len: 1543 microversion: 2.1 time: 0.234890 Oct 18 15:37:41.398533 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1454/2983] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:41 2022] GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43 => generated 1543 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:41.566846 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ea72d48f-0491-42e6-8c2d-e4021936c1e9 tempest-AZV2TestJSON-279132475 tempest-AZV2TestJSON-279132475-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:41.568576 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea72d48f-0491-42e6-8c2d-e4021936c1e9 tempest-AZV2TestJSON-279132475 tempest-AZV2TestJSON-279132475-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:41.569565 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea72d48f-0491-42e6-8c2d-e4021936c1e9 tempest-AZV2TestJSON-279132475 tempest-AZV2TestJSON-279132475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:41.570088 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea72d48f-0491-42e6-8c2d-e4021936c1e9 tempest-AZV2TestJSON-279132475 tempest-AZV2TestJSON-279132475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:41.570901 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea72d48f-0491-42e6-8c2d-e4021936c1e9 tempest-AZV2TestJSON-279132475 tempest-AZV2TestJSON-279132475-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:41.571650 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea72d48f-0491-42e6-8c2d-e4021936c1e9 tempest-AZV2TestJSON-279132475 tempest-AZV2TestJSON-279132475-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:41.572159 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea72d48f-0491-42e6-8c2d-e4021936c1e9 tempest-AZV2TestJSON-279132475 tempest-AZV2TestJSON-279132475-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:41.608708 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ea72d48f-0491-42e6-8c2d-e4021936c1e9 tempest-AZV2TestJSON-279132475 tempest-AZV2TestJSON-279132475-project] 10.222.0.60 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.196189 Oct 18 15:37:41.609549 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1455/2984] 10.222.0.60 () {58 vars in 1164 bytes} [Tue Oct 18 15:37:41 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 18 15:37:41.779069 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-21023096-cf6c-4031-9943-eb851353a6b8 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:41.780009 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-21023096-cf6c-4031-9943-eb851353a6b8 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:41.798899 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21023096-cf6c-4031-9943-eb851353a6b8 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:41.799843 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21023096-cf6c-4031-9943-eb851353a6b8 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:41.800527 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21023096-cf6c-4031-9943-eb851353a6b8 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:41.801567 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21023096-cf6c-4031-9943-eb851353a6b8 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:41.802298 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21023096-cf6c-4031-9943-eb851353a6b8 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:41.803016 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21023096-cf6c-4031-9943-eb851353a6b8 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:42.128789 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-21023096-cf6c-4031-9943-eb851353a6b8 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:42.139014 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-21023096-cf6c-4031-9943-eb851353a6b8 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c" status: 200 len: 1469 microversion: 2.1 time: 0.364741 Oct 18 15:37:42.139930 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1456/2985] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:41 2022] GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c => generated 1469 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:37:42.152391 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fcc30abe-829e-440c-ba85-e7d53d455fb7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:42.153338 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fcc30abe-829e-440c-ba85-e7d53d455fb7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:42.160331 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fcc30abe-829e-440c-ba85-e7d53d455fb7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:42.161141 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fcc30abe-829e-440c-ba85-e7d53d455fb7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:42.161767 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fcc30abe-829e-440c-ba85-e7d53d455fb7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:42.162732 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fcc30abe-829e-440c-ba85-e7d53d455fb7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:42.163897 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fcc30abe-829e-440c-ba85-e7d53d455fb7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:42.164484 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fcc30abe-829e-440c-ba85-e7d53d455fb7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:42.193278 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:37:42.353722 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fcc30abe-829e-440c-ba85-e7d53d455fb7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:42.362899 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fcc30abe-829e-440c-ba85-e7d53d455fb7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca" status: 200 len: 1525 microversion: 2.1 time: 0.221850 Oct 18 15:37:42.382195 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1457/2986] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:42 2022] GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca => generated 1525 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:42.412332 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-014ff297-2a39-4830-8109-e8a7450d9b23 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:42.413033 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-014ff297-2a39-4830-8109-e8a7450d9b23 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 12e415d7-7c40-41a0-957a-a083dbcf2b43] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:42.424009 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-014ff297-2a39-4830-8109-e8a7450d9b23 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:42.424796 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-014ff297-2a39-4830-8109-e8a7450d9b23 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:42.426327 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-014ff297-2a39-4830-8109-e8a7450d9b23 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:42.427254 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-014ff297-2a39-4830-8109-e8a7450d9b23 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:42.427887 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-014ff297-2a39-4830-8109-e8a7450d9b23 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:42.428512 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-014ff297-2a39-4830-8109-e8a7450d9b23 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:42.609601 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-014ff297-2a39-4830-8109-e8a7450d9b23 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:42.634547 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-014ff297-2a39-4830-8109-e8a7450d9b23 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43" status: 200 len: 1543 microversion: 2.1 time: 0.226613 Oct 18 15:37:42.635365 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1458/2987] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:42 2022] GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43 => generated 1543 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:43.168715 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-00f86b9e-77c6-4f8d-bfb5-c3ba99936e24 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:43.171285 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-00f86b9e-77c6-4f8d-bfb5-c3ba99936e24 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:43.183042 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:37:43.186520 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00f86b9e-77c6-4f8d-bfb5-c3ba99936e24 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:43.187255 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00f86b9e-77c6-4f8d-bfb5-c3ba99936e24 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:43.187879 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00f86b9e-77c6-4f8d-bfb5-c3ba99936e24 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:43.190510 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00f86b9e-77c6-4f8d-bfb5-c3ba99936e24 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:43.191560 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00f86b9e-77c6-4f8d-bfb5-c3ba99936e24 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:43.192958 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00f86b9e-77c6-4f8d-bfb5-c3ba99936e24 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:43.481841 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-00f86b9e-77c6-4f8d-bfb5-c3ba99936e24 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:43.491999 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-00f86b9e-77c6-4f8d-bfb5-c3ba99936e24 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c" status: 200 len: 1469 microversion: 2.1 time: 0.333678 Oct 18 15:37:43.493409 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1459/2988] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:43 2022] GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c => generated 1469 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:37:43.499530 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d1fb98a8-3a76-4fdb-85fc-fb6666be40be tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:43.500393 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d1fb98a8-3a76-4fdb-85fc-fb6666be40be tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:43.526468 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1fb98a8-3a76-4fdb-85fc-fb6666be40be tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:43.527132 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1fb98a8-3a76-4fdb-85fc-fb6666be40be tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:43.528118 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1fb98a8-3a76-4fdb-85fc-fb6666be40be tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:43.529381 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1fb98a8-3a76-4fdb-85fc-fb6666be40be tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:43.530039 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1fb98a8-3a76-4fdb-85fc-fb6666be40be tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:43.536278 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1fb98a8-3a76-4fdb-85fc-fb6666be40be tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:43.843585 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d1fb98a8-3a76-4fdb-85fc-fb6666be40be tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:43.857304 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d1fb98a8-3a76-4fdb-85fc-fb6666be40be tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca" status: 200 len: 1525 microversion: 2.1 time: 0.362411 Oct 18 15:37:43.869584 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1460/2989] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:43 2022] GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca => generated 1525 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:43.878321 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-22d3641c-a869-4030-a7e2-10dcfa93946c req-601f12ad-9811-482c-8ac4-4b628e5a00fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35e5cf0e-693b-4930-9665-f1a53983cc1c", "name": "network-vif-deleted", "tag": "2ca5d763-fca7-4b76-a60b-8e961f804f14"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:37:43.894740 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-22d3641c-a869-4030-a7e2-10dcfa93946c req-601f12ad-9811-482c-8ac4-4b628e5a00fe service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:43.895173 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-22d3641c-a869-4030-a7e2-10dcfa93946c req-601f12ad-9811-482c-8ac4-4b628e5a00fe service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:43.895611 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-22d3641c-a869-4030-a7e2-10dcfa93946c req-601f12ad-9811-482c-8ac4-4b628e5a00fe service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:43.935057 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-22d3641c-a869-4030-a7e2-10dcfa93946c req-601f12ad-9811-482c-8ac4-4b628e5a00fe service nova] Creating event network-vif-deleted:2ca5d763-fca7-4b76-a60b-8e961f804f14 for instance 35e5cf0e-693b-4930-9665-f1a53983cc1c on n-h1-853682-5 Oct 18 15:37:43.944313 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-22d3641c-a869-4030-a7e2-10dcfa93946c req-601f12ad-9811-482c-8ac4-4b628e5a00fe service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081720 Oct 18 15:37:43.950147 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1461/2990] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:37:43.958512 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1e040e06-7bcb-4cd5-a262-4424a6ba82b9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:43.959111 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1e040e06-7bcb-4cd5-a262-4424a6ba82b9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 12e415d7-7c40-41a0-957a-a083dbcf2b43] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:43.973513 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e040e06-7bcb-4cd5-a262-4424a6ba82b9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:43.974602 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e040e06-7bcb-4cd5-a262-4424a6ba82b9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:43.975980 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e040e06-7bcb-4cd5-a262-4424a6ba82b9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:43.976935 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e040e06-7bcb-4cd5-a262-4424a6ba82b9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:43.977406 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e040e06-7bcb-4cd5-a262-4424a6ba82b9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:43.978241 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e040e06-7bcb-4cd5-a262-4424a6ba82b9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:44.292045 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1e040e06-7bcb-4cd5-a262-4424a6ba82b9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:44.305835 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1e040e06-7bcb-4cd5-a262-4424a6ba82b9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43" status: 200 len: 1543 microversion: 2.1 time: 0.351861 Oct 18 15:37:44.307341 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1462/2991] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:43 2022] GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43 => generated 1543 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:44.527455 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e74fa6c2-e7f9-4bb5-ba16-576ad56c8c95 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:44.530108 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e74fa6c2-e7f9-4bb5-ba16-576ad56c8c95 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:44.556043 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e74fa6c2-e7f9-4bb5-ba16-576ad56c8c95 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:44.556701 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e74fa6c2-e7f9-4bb5-ba16-576ad56c8c95 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:44.557810 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e74fa6c2-e7f9-4bb5-ba16-576ad56c8c95 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:44.559635 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e74fa6c2-e7f9-4bb5-ba16-576ad56c8c95 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:44.560123 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e74fa6c2-e7f9-4bb5-ba16-576ad56c8c95 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:44.560558 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e74fa6c2-e7f9-4bb5-ba16-576ad56c8c95 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:44.605472 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e74fa6c2-e7f9-4bb5-ba16-576ad56c8c95 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:44.606058 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e74fa6c2-e7f9-4bb5-ba16-576ad56c8c95 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:44.607150 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e74fa6c2-e7f9-4bb5-ba16-576ad56c8c95 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:44.607614 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-e74fa6c2-e7f9-4bb5-ba16-576ad56c8c95 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lazy-loading 'fault' on Instance uuid 35e5cf0e-693b-4930-9665-f1a53983cc1c {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:37:44.700060 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e74fa6c2-e7f9-4bb5-ba16-576ad56c8c95 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c56c556efc4f45b56699afa36e22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de91b5fbc5c344019924b5353abf539d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:44.712000 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e74fa6c2-e7f9-4bb5-ba16-576ad56c8c95 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c" status: 200 len: 1303 microversion: 2.1 time: 0.195626 Oct 18 15:37:44.712950 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1463/2992] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:44 2022] GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c => generated 1303 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:37:44.888530 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-75c44d19-e9e6-4fd4-8053-6a6961109aae tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:44.889315 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-75c44d19-e9e6-4fd4-8053-6a6961109aae tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:44.904605 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-75c44d19-e9e6-4fd4-8053-6a6961109aae tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:44.910065 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-75c44d19-e9e6-4fd4-8053-6a6961109aae tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:44.910644 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-75c44d19-e9e6-4fd4-8053-6a6961109aae tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:44.911463 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-75c44d19-e9e6-4fd4-8053-6a6961109aae tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:44.913272 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-75c44d19-e9e6-4fd4-8053-6a6961109aae tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:44.914513 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-75c44d19-e9e6-4fd4-8053-6a6961109aae tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:45.124157 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9da031cd-dbac-41eb-9733-ce913aa13cf7 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "GET /compute/v2.1/images/8ce4db55-b062-45bf-b0b6-d3fb96c3e2c5" status: 200 len: 1423 microversion: 2.1 time: 14.626629 Oct 18 15:37:45.128093 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1530/2993] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:37:30 2022] GET /compute/v2.1/images/8ce4db55-b062-45bf-b0b6-d3fb96c3e2c5 => generated 1423 bytes in 14631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:45.214587 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-75c44d19-e9e6-4fd4-8053-6a6961109aae tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:45.233191 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-75c44d19-e9e6-4fd4-8053-6a6961109aae tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca" status: 200 len: 1525 microversion: 2.1 time: 0.349710 Oct 18 15:37:45.251021 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1464/2994] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:44 2022] GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca => generated 1525 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:45.330413 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ee522c0a-cf82-43dd-bdab-9e2f561de587 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:45.331185 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ee522c0a-cf82-43dd-bdab-9e2f561de587 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 12e415d7-7c40-41a0-957a-a083dbcf2b43] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:45.339150 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ee522c0a-cf82-43dd-bdab-9e2f561de587 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:45.339635 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ee522c0a-cf82-43dd-bdab-9e2f561de587 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:45.346135 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ee522c0a-cf82-43dd-bdab-9e2f561de587 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:45.349623 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ee522c0a-cf82-43dd-bdab-9e2f561de587 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:45.350111 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ee522c0a-cf82-43dd-bdab-9e2f561de587 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:45.354243 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ee522c0a-cf82-43dd-bdab-9e2f561de587 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:45.596946 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ee522c0a-cf82-43dd-bdab-9e2f561de587 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:45.609977 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ee522c0a-cf82-43dd-bdab-9e2f561de587 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43" status: 200 len: 1543 microversion: 2.1 time: 0.283880 Oct 18 15:37:45.626928 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1531/2995] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:45 2022] GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43 => generated 1543 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:45.736823 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ef0b1ba8-5048-482d-a206-ddc72fea2c44 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:45.738507 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ef0b1ba8-5048-482d-a206-ddc72fea2c44 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] [instance: 35e5cf0e-693b-4930-9665-f1a53983cc1c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:45.747404 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ef0b1ba8-5048-482d-a206-ddc72fea2c44 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:45.748340 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ef0b1ba8-5048-482d-a206-ddc72fea2c44 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:45.748848 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ef0b1ba8-5048-482d-a206-ddc72fea2c44 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:45.749817 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ef0b1ba8-5048-482d-a206-ddc72fea2c44 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:45.750286 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ef0b1ba8-5048-482d-a206-ddc72fea2c44 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:45.750900 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ef0b1ba8-5048-482d-a206-ddc72fea2c44 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:45.779552 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-ef0b1ba8-5048-482d-a206-ddc72fea2c44 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] HTTP exception thrown: Instance 35e5cf0e-693b-4930-9665-f1a53983cc1c could not be found. Oct 18 15:37:45.783899 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ef0b1ba8-5048-482d-a206-ddc72fea2c44 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Request method failure captured: Oct 18 15:37:45.783899 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c HTTP/1.1 Oct 18 15:37:45.783899 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:37:45.783899 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:37:45.783899 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:37:45.783899 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:37:45.783899 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:37:45.783899 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:37:45.783899 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:37:45.783899 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:37:45.783899 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsegotWawPE88WF0UdS2f0hiLSrx9fN4NnCvDKLz9vH601WLwsTJKSu9Wtx5s_xLHFKkPhNH0J5TCat7AsX5NLsIboybqlFUm3xfyaOl2l2m1v5JOfLLXpLJt4O0oH6NDjcOhAJJT9O3QjsBkviVLtPlrG0BYsL-rks9SvXPInpzjDM Oct 18 15:37:45.783899 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:37:45.783899 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:37:45.783899 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:37:45.783899 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:37:45.783899 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:37:45.783899 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:37:45.783899 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: de91b5fbc5c344019924b5353abf539d Oct 18 15:37:45.783899 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersAdminTestJSON-611782913 Oct 18 15:37:45.783899 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:37:45.783899 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:37:45.785520 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/de91b5fbc5c344019924b5353abf539d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/de91b5fbc5c344019924b5353abf539d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/de91b5fbc5c344019924b5353abf539d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_de91b5fbc5c344019924b5353abf539d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:37:45.785520 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersAdminTestJSON-611782913 Oct 18 15:37:45.785520 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: de91b5fbc5c344019924b5353abf539d Oct 18 15:37:45.785520 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersAdminTestJSON-611782913 Oct 18 15:37:45.785520 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersAdminTestJSON-611782913-project Oct 18 15:37:45.785520 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:37:45.785520 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:37:45.785520 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 99c56c556efc4f45b56699afa36e22bc Oct 18 15:37:45.785520 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersAdminTestJSON-611782913-project Oct 18 15:37:45.785520 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:37:45.785520 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 35e5cf0e-693b-4930-9665-f1a53983cc1c could not be found. Oct 18 15:37:45.785520 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '35e5cf0e-693b-4930-9665-f1a53983cc1c'} Oct 18 15:37:45.786408 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:37:45.786408 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:37:45.786408 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:37:45.786408 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:37:45.786408 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:37:45.786408 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:37:45.786408 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:37:45.786408 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:37:45.786408 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:37:45.786408 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:37:45.786408 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35e5cf0e-693b-4930-9665-f1a53983cc1c could not be found. Oct 18 15:37:45.786408 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:37:45.786408 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:37:45.786408 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:37:45.786408 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:37:45.786408 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:37:45.786408 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:37:45.786408 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:37:45.786408 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:37:45.786408 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:37:45.788180 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:37:45.788180 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:37:45.788180 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:37:45.788180 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:37:45.788180 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:37:45.788180 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:37:45.788180 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:37:45.788180 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35e5cf0e-693b-4930-9665-f1a53983cc1c could not be found. Oct 18 15:37:45.788180 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:37:45.788180 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:37:45.788180 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:37:45.788180 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:37:45.788180 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:37:45.788180 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:37:45.788180 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:37:45.788180 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:37:45.788180 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35e5cf0e-693b-4930-9665-f1a53983cc1c could not be found. Oct 18 15:37:45.788180 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:37:45.789837 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ef0b1ba8-5048-482d-a206-ddc72fea2c44 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] Returning 404 to user: Instance 35e5cf0e-693b-4930-9665-f1a53983cc1c could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:37:45.789837 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ef0b1ba8-5048-482d-a206-ddc72fea2c44 tempest-ServersAdminTestJSON-611782913 tempest-ServersAdminTestJSON-611782913-project] 10.222.0.60 "GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c" status: 404 len: 111 microversion: 2.1 time: 0.050129 Oct 18 15:37:45.789837 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1465/2996] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:45 2022] GET /compute/v2.1/servers/35e5cf0e-693b-4930-9665-f1a53983cc1c => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:37:46.142763 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-df5385c7-eef4-4be8-90e8-0aa058d820f3 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '.version_select at 0x7f7c3d22eaf0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:46.259279 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-275d66ff-47cf-46d6-bd10-d994ece2c446 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:46.260209 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-275d66ff-47cf-46d6-bd10-d994ece2c446 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:46.271862 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-275d66ff-47cf-46d6-bd10-d994ece2c446 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:46.274519 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-275d66ff-47cf-46d6-bd10-d994ece2c446 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:46.275971 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-275d66ff-47cf-46d6-bd10-d994ece2c446 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:46.278592 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-275d66ff-47cf-46d6-bd10-d994ece2c446 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:46.279596 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-275d66ff-47cf-46d6-bd10-d994ece2c446 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:46.282162 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-275d66ff-47cf-46d6-bd10-d994ece2c446 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:46.998897 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-275d66ff-47cf-46d6-bd10-d994ece2c446 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:47.018482 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-275d66ff-47cf-46d6-bd10-d994ece2c446 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca" status: 200 len: 1525 microversion: 2.1 time: 0.766010 Oct 18 15:37:47.031674 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1466/2997] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:46 2022] GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca => generated 1525 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:47.037078 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4c3053c1-ebe6-44a2-82ac-18aec271c50d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:47.038257 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4c3053c1-ebe6-44a2-82ac-18aec271c50d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 12e415d7-7c40-41a0-957a-a083dbcf2b43] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:47.059172 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c3053c1-ebe6-44a2-82ac-18aec271c50d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:47.059951 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c3053c1-ebe6-44a2-82ac-18aec271c50d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:47.063337 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c3053c1-ebe6-44a2-82ac-18aec271c50d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:47.064341 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c3053c1-ebe6-44a2-82ac-18aec271c50d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:47.065007 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c3053c1-ebe6-44a2-82ac-18aec271c50d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:47.065932 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c3053c1-ebe6-44a2-82ac-18aec271c50d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:47.401963 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4c3053c1-ebe6-44a2-82ac-18aec271c50d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:47.419491 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4c3053c1-ebe6-44a2-82ac-18aec271c50d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43" status: 200 len: 1543 microversion: 2.1 time: 0.386238 Oct 18 15:37:47.426934 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1467/2998] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:47 2022] GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43 => generated 1543 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:48.062918 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bd282c8f-29e5-495f-bed0-e41dc7d5e44e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:48.064248 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bd282c8f-29e5-495f-bed0-e41dc7d5e44e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:48.084261 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd282c8f-29e5-495f-bed0-e41dc7d5e44e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:48.085984 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd282c8f-29e5-495f-bed0-e41dc7d5e44e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:48.088209 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd282c8f-29e5-495f-bed0-e41dc7d5e44e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:48.091338 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd282c8f-29e5-495f-bed0-e41dc7d5e44e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:48.095057 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd282c8f-29e5-495f-bed0-e41dc7d5e44e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:48.096028 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd282c8f-29e5-495f-bed0-e41dc7d5e44e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:48.725939 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bd282c8f-29e5-495f-bed0-e41dc7d5e44e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:48.735058 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bd282c8f-29e5-495f-bed0-e41dc7d5e44e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca" status: 200 len: 1525 microversion: 2.1 time: 0.677867 Oct 18 15:37:48.741116 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1468/2999] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:48 2022] GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca => generated 1525 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:48.745931 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-03a5bcc5-8f9a-4969-9f8e-c3640265b352 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:48.746548 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-03a5bcc5-8f9a-4969-9f8e-c3640265b352 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 12e415d7-7c40-41a0-957a-a083dbcf2b43] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:48.770306 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03a5bcc5-8f9a-4969-9f8e-c3640265b352 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:48.770853 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03a5bcc5-8f9a-4969-9f8e-c3640265b352 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:48.773981 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03a5bcc5-8f9a-4969-9f8e-c3640265b352 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:48.774956 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03a5bcc5-8f9a-4969-9f8e-c3640265b352 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:48.775579 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03a5bcc5-8f9a-4969-9f8e-c3640265b352 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:48.776758 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03a5bcc5-8f9a-4969-9f8e-c3640265b352 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:49.877945 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-03a5bcc5-8f9a-4969-9f8e-c3640265b352 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:49.887707 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-03a5bcc5-8f9a-4969-9f8e-c3640265b352 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43" status: 200 len: 1543 microversion: 2.1 time: 1.145489 Oct 18 15:37:49.895165 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1469/3000] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:48 2022] GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43 => generated 1543 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:49.913938 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c183810d-5650-49c1-873d-9a12c34610b9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:49.917836 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c183810d-5650-49c1-873d-9a12c34610b9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:49.939003 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c183810d-5650-49c1-873d-9a12c34610b9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:49.939835 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c183810d-5650-49c1-873d-9a12c34610b9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:49.941324 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c183810d-5650-49c1-873d-9a12c34610b9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:49.942883 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c183810d-5650-49c1-873d-9a12c34610b9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:49.943823 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c183810d-5650-49c1-873d-9a12c34610b9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:49.946456 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c183810d-5650-49c1-873d-9a12c34610b9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:50.495132 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c183810d-5650-49c1-873d-9a12c34610b9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:50.510973 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c183810d-5650-49c1-873d-9a12c34610b9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca" status: 200 len: 1525 microversion: 2.1 time: 0.614377 Oct 18 15:37:50.529308 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1470/3001] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:49 2022] GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca => generated 1525 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:50.924373 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ee4d1c7d-7777-42c9-99a2-a199bb6a0438 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:50.925192 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ee4d1c7d-7777-42c9-99a2-a199bb6a0438 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 12e415d7-7c40-41a0-957a-a083dbcf2b43] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:50.937354 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee4d1c7d-7777-42c9-99a2-a199bb6a0438 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:50.938898 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee4d1c7d-7777-42c9-99a2-a199bb6a0438 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:50.941323 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee4d1c7d-7777-42c9-99a2-a199bb6a0438 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:50.945975 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee4d1c7d-7777-42c9-99a2-a199bb6a0438 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:50.956974 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee4d1c7d-7777-42c9-99a2-a199bb6a0438 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:50.966111 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee4d1c7d-7777-42c9-99a2-a199bb6a0438 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:51.356392 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ee4d1c7d-7777-42c9-99a2-a199bb6a0438 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:51.369663 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ee4d1c7d-7777-42c9-99a2-a199bb6a0438 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43" status: 200 len: 1542 microversion: 2.1 time: 0.447364 Oct 18 15:37:51.370467 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1471/3002] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:50 2022] GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43 => generated 1542 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:51.485611 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-afe7a492-75b1-43ea-8507-b1636079be1e req-dfe5f789-0625-42f7-9c16-d013958d8f58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12e415d7-7c40-41a0-957a-a083dbcf2b43", "name": "network-vif-unplugged", "status": "completed", "tag": "0007790a-c337-4a61-8c95-ee14bba9c445"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:37:51.504743 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-afe7a492-75b1-43ea-8507-b1636079be1e req-dfe5f789-0625-42f7-9c16-d013958d8f58 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:51.507615 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-afe7a492-75b1-43ea-8507-b1636079be1e req-dfe5f789-0625-42f7-9c16-d013958d8f58 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:51.508765 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-afe7a492-75b1-43ea-8507-b1636079be1e req-dfe5f789-0625-42f7-9c16-d013958d8f58 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:51.542908 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-afe7a492-75b1-43ea-8507-b1636079be1e req-dfe5f789-0625-42f7-9c16-d013958d8f58 service nova] Creating event network-vif-unplugged:0007790a-c337-4a61-8c95-ee14bba9c445 for instance 12e415d7-7c40-41a0-957a-a083dbcf2b43 on n-h2-853682-5 Oct 18 15:37:51.578604 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [req-afe7a492-75b1-43ea-8507-b1636079be1e req-dfe5f789-0625-42f7-9c16-d013958d8f58 service nova] Instance 12e415d7-7c40-41a0-957a-a083dbcf2b43 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853682-5'} {{(pid=120406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 18 15:37:51.597463 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-afe7a492-75b1-43ea-8507-b1636079be1e req-dfe5f789-0625-42f7-9c16-d013958d8f58 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.119268 Oct 18 15:37:51.600324 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1472/3003] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:37:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:37:51.615469 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:37:51.897023 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-40bae4d1-8024-40f0-81f1-bb4e8626afcc tempest-ServicesAdminTestJSON-1494812423 tempest-ServicesAdminTestJSON-1494812423-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:51.901136 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40bae4d1-8024-40f0-81f1-bb4e8626afcc tempest-ServicesAdminTestJSON-1494812423 tempest-ServicesAdminTestJSON-1494812423-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:51.902276 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40bae4d1-8024-40f0-81f1-bb4e8626afcc tempest-ServicesAdminTestJSON-1494812423 tempest-ServicesAdminTestJSON-1494812423-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:51.902276 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40bae4d1-8024-40f0-81f1-bb4e8626afcc tempest-ServicesAdminTestJSON-1494812423 tempest-ServicesAdminTestJSON-1494812423-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:51.902981 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40bae4d1-8024-40f0-81f1-bb4e8626afcc tempest-ServicesAdminTestJSON-1494812423 tempest-ServicesAdminTestJSON-1494812423-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:51.903523 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40bae4d1-8024-40f0-81f1-bb4e8626afcc tempest-ServicesAdminTestJSON-1494812423 tempest-ServicesAdminTestJSON-1494812423-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:51.904021 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40bae4d1-8024-40f0-81f1-bb4e8626afcc tempest-ServicesAdminTestJSON-1494812423 tempest-ServicesAdminTestJSON-1494812423-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:51.930859 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-40bae4d1-8024-40f0-81f1-bb4e8626afcc tempest-ServicesAdminTestJSON-1494812423 tempest-ServicesAdminTestJSON-1494812423-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.328386 Oct 18 15:37:51.932197 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1473/3004] 10.222.0.60 () {58 vars in 1137 bytes} [Tue Oct 18 15:37:51 2022] GET /compute/v2.1/os-services => generated 944 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:37:51.940689 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e60a57d3-e087-4725-bd53-0f10a651133b tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:51.941922 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e60a57d3-e087-4725-bd53-0f10a651133b tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:51.969524 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e60a57d3-e087-4725-bd53-0f10a651133b tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:51.970457 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e60a57d3-e087-4725-bd53-0f10a651133b tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:51.972569 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e60a57d3-e087-4725-bd53-0f10a651133b tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:51.973413 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e60a57d3-e087-4725-bd53-0f10a651133b tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:51.973873 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e60a57d3-e087-4725-bd53-0f10a651133b tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:51.974292 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e60a57d3-e087-4725-bd53-0f10a651133b tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:52.180977 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e60a57d3-e087-4725-bd53-0f10a651133b tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:52.194119 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e60a57d3-e087-4725-bd53-0f10a651133b tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca" status: 200 len: 1525 microversion: 2.1 time: 0.260203 Oct 18 15:37:52.195873 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1474/3005] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:51 2022] GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca => generated 1525 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:52.202130 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-670a3df0-25b1-41b7-87d7-fb8d67881c57 tempest-ServicesAdminTestJSON-1494812423 tempest-ServicesAdminTestJSON-1494812423-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:52.206928 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-670a3df0-25b1-41b7-87d7-fb8d67881c57 tempest-ServicesAdminTestJSON-1494812423 tempest-ServicesAdminTestJSON-1494812423-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:52.207636 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-670a3df0-25b1-41b7-87d7-fb8d67881c57 tempest-ServicesAdminTestJSON-1494812423 tempest-ServicesAdminTestJSON-1494812423-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:52.208324 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-670a3df0-25b1-41b7-87d7-fb8d67881c57 tempest-ServicesAdminTestJSON-1494812423 tempest-ServicesAdminTestJSON-1494812423-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:52.209306 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-670a3df0-25b1-41b7-87d7-fb8d67881c57 tempest-ServicesAdminTestJSON-1494812423 tempest-ServicesAdminTestJSON-1494812423-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:52.210232 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-670a3df0-25b1-41b7-87d7-fb8d67881c57 tempest-ServicesAdminTestJSON-1494812423 tempest-ServicesAdminTestJSON-1494812423-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:52.211139 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-670a3df0-25b1-41b7-87d7-fb8d67881c57 tempest-ServicesAdminTestJSON-1494812423 tempest-ServicesAdminTestJSON-1494812423-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:52.244441 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-670a3df0-25b1-41b7-87d7-fb8d67881c57 tempest-ServicesAdminTestJSON-1494812423 tempest-ServicesAdminTestJSON-1494812423-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?host=n-d-853682-5" status: 200 len: 578 microversion: 2.1 time: 0.046899 Oct 18 15:37:52.245683 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1475/3006] 10.222.0.60 () {58 vars in 1172 bytes} [Tue Oct 18 15:37:52 2022] GET /compute/v2.1/os-services?host=n-d-853682-5 => generated 578 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:37:52.259300 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9eb12c0e-c1b3-47e9-906b-bb7691f7b673 tempest-ServicesAdminTestJSON-1494812423 tempest-ServicesAdminTestJSON-1494812423-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:52.264782 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9eb12c0e-c1b3-47e9-906b-bb7691f7b673 tempest-ServicesAdminTestJSON-1494812423 tempest-ServicesAdminTestJSON-1494812423-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:52.265369 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9eb12c0e-c1b3-47e9-906b-bb7691f7b673 tempest-ServicesAdminTestJSON-1494812423 tempest-ServicesAdminTestJSON-1494812423-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:52.265901 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9eb12c0e-c1b3-47e9-906b-bb7691f7b673 tempest-ServicesAdminTestJSON-1494812423 tempest-ServicesAdminTestJSON-1494812423-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:52.267143 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9eb12c0e-c1b3-47e9-906b-bb7691f7b673 tempest-ServicesAdminTestJSON-1494812423 tempest-ServicesAdminTestJSON-1494812423-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:52.267821 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9eb12c0e-c1b3-47e9-906b-bb7691f7b673 tempest-ServicesAdminTestJSON-1494812423 tempest-ServicesAdminTestJSON-1494812423-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:52.268480 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9eb12c0e-c1b3-47e9-906b-bb7691f7b673 tempest-ServicesAdminTestJSON-1494812423 tempest-ServicesAdminTestJSON-1494812423-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:52.299471 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9eb12c0e-c1b3-47e9-906b-bb7691f7b673 tempest-ServicesAdminTestJSON-1494812423 tempest-ServicesAdminTestJSON-1494812423-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.044666 Oct 18 15:37:52.300335 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1476/3007] 10.222.0.60 () {58 vars in 1176 bytes} [Tue Oct 18 15:37:52 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:37:52.316895 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3cab3efe-b982-4890-bd60-f8b934a47d93 tempest-ServicesAdminTestJSON-1494812423 tempest-ServicesAdminTestJSON-1494812423-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:52.322586 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3cab3efe-b982-4890-bd60-f8b934a47d93 tempest-ServicesAdminTestJSON-1494812423 tempest-ServicesAdminTestJSON-1494812423-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:52.323372 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3cab3efe-b982-4890-bd60-f8b934a47d93 tempest-ServicesAdminTestJSON-1494812423 tempest-ServicesAdminTestJSON-1494812423-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:52.324827 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3cab3efe-b982-4890-bd60-f8b934a47d93 tempest-ServicesAdminTestJSON-1494812423 tempest-ServicesAdminTestJSON-1494812423-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:52.325816 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3cab3efe-b982-4890-bd60-f8b934a47d93 tempest-ServicesAdminTestJSON-1494812423 tempest-ServicesAdminTestJSON-1494812423-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:52.326670 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3cab3efe-b982-4890-bd60-f8b934a47d93 tempest-ServicesAdminTestJSON-1494812423 tempest-ServicesAdminTestJSON-1494812423-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:52.327379 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3cab3efe-b982-4890-bd60-f8b934a47d93 tempest-ServicesAdminTestJSON-1494812423 tempest-ServicesAdminTestJSON-1494812423-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:52.363758 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3cab3efe-b982-4890-bd60-f8b934a47d93 tempest-ServicesAdminTestJSON-1494812423 tempest-ServicesAdminTestJSON-1494812423-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.053385 Oct 18 15:37:52.364669 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1477/3008] 10.222.0.60 () {58 vars in 1137 bytes} [Tue Oct 18 15:37:52 2022] GET /compute/v2.1/os-services => generated 944 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:37:52.400538 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-70d0d56e-8149-4719-82dd-1cbad83b2830 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:52.401480 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-70d0d56e-8149-4719-82dd-1cbad83b2830 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 12e415d7-7c40-41a0-957a-a083dbcf2b43] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:52.411367 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-df5385c7-eef4-4be8-90e8-0aa058d820f3 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "GET /compute/v2.1/images/8ce4db55-b062-45bf-b0b6-d3fb96c3e2c5" status: 200 len: 1432 microversion: 2.1 time: 6.272511 Oct 18 15:37:52.413209 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1532/3009] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:37:46 2022] GET /compute/v2.1/images/8ce4db55-b062-45bf-b0b6-d3fb96c3e2c5 => generated 1432 bytes in 6274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:52.424196 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70d0d56e-8149-4719-82dd-1cbad83b2830 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:52.425841 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70d0d56e-8149-4719-82dd-1cbad83b2830 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:52.426202 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70d0d56e-8149-4719-82dd-1cbad83b2830 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:52.429143 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-54cd7a9d-07a6-4b1e-9d7d-5df0ca155e60 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '.version_select at 0x7f7c3c854b80>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:52.430030 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70d0d56e-8149-4719-82dd-1cbad83b2830 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:52.430594 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70d0d56e-8149-4719-82dd-1cbad83b2830 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:52.431127 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70d0d56e-8149-4719-82dd-1cbad83b2830 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:52.438565 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:37:52.547020 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-54cd7a9d-07a6-4b1e-9d7d-5df0ca155e60 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "GET /compute/v2.1/images/8ce4db55-b062-45bf-b0b6-d3fb96c3e2c5" status: 200 len: 1432 microversion: 2.1 time: 0.124142 Oct 18 15:37:52.548541 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1533/3010] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:37:52 2022] GET /compute/v2.1/images/8ce4db55-b062-45bf-b0b6-d3fb96c3e2c5 => generated 1432 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:37:52.562004 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-952595ad-a420-40b7-ac34-fc37f150c0c4 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:52.563145 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-952595ad-a420-40b7-ac34-fc37f150c0c4 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] [instance: 004539c4-260d-46a9-beed-d9c4b9a76106] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:52.580202 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-952595ad-a420-40b7-ac34-fc37f150c0c4 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:52.580710 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-952595ad-a420-40b7-ac34-fc37f150c0c4 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:52.581236 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-952595ad-a420-40b7-ac34-fc37f150c0c4 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:52.582152 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-952595ad-a420-40b7-ac34-fc37f150c0c4 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:52.582630 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-952595ad-a420-40b7-ac34-fc37f150c0c4 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:52.583070 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-952595ad-a420-40b7-ac34-fc37f150c0c4 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:52.751912 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-70d0d56e-8149-4719-82dd-1cbad83b2830 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:52.764382 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-70d0d56e-8149-4719-82dd-1cbad83b2830 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43" status: 200 len: 1474 microversion: 2.1 time: 0.368265 Oct 18 15:37:52.765630 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1478/3011] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:52 2022] GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43 => generated 1474 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:52.914755 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-952595ad-a420-40b7-ac34-fc37f150c0c4 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36635345398478eb011416cae492244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d7770bf1ee4b46a1e4bdf61dc2d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:52.923760 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-952595ad-a420-40b7-ac34-fc37f150c0c4 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "GET /compute/v2.1/servers/004539c4-260d-46a9-beed-d9c4b9a76106" status: 200 len: 1480 microversion: 2.1 time: 0.366042 Oct 18 15:37:52.940841 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1534/3012] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:52 2022] GET /compute/v2.1/servers/004539c4-260d-46a9-beed-d9c4b9a76106 => generated 1480 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:53.223479 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f17b7a03-fd97-411a-a557-b104098d728f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:53.225079 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f17b7a03-fd97-411a-a557-b104098d728f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:53.238805 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f17b7a03-fd97-411a-a557-b104098d728f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:53.239511 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f17b7a03-fd97-411a-a557-b104098d728f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:53.240174 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f17b7a03-fd97-411a-a557-b104098d728f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:53.242348 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f17b7a03-fd97-411a-a557-b104098d728f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:53.243163 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f17b7a03-fd97-411a-a557-b104098d728f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:53.243778 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f17b7a03-fd97-411a-a557-b104098d728f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:53.674306 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f17b7a03-fd97-411a-a557-b104098d728f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:53.708017 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f17b7a03-fd97-411a-a557-b104098d728f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca" status: 200 len: 1525 microversion: 2.1 time: 0.488558 Oct 18 15:37:53.721758 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1479/3013] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:53 2022] GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca => generated 1525 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:53.794253 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8bad147c-f94c-4d87-a65b-b451931bdf8e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:53.796094 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8bad147c-f94c-4d87-a65b-b451931bdf8e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 12e415d7-7c40-41a0-957a-a083dbcf2b43] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:53.814548 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8bad147c-f94c-4d87-a65b-b451931bdf8e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:53.815030 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8bad147c-f94c-4d87-a65b-b451931bdf8e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:53.816485 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8bad147c-f94c-4d87-a65b-b451931bdf8e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:53.841275 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8bad147c-f94c-4d87-a65b-b451931bdf8e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:53.842230 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8bad147c-f94c-4d87-a65b-b451931bdf8e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:53.843028 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8bad147c-f94c-4d87-a65b-b451931bdf8e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:53.960366 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dc1d3956-7eff-4af9-ab55-7d3a71dab5f5 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:53.961013 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dc1d3956-7eff-4af9-ab55-7d3a71dab5f5 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] [instance: 004539c4-260d-46a9-beed-d9c4b9a76106] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:53.970866 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc1d3956-7eff-4af9-ab55-7d3a71dab5f5 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:53.971363 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc1d3956-7eff-4af9-ab55-7d3a71dab5f5 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:53.971796 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc1d3956-7eff-4af9-ab55-7d3a71dab5f5 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:53.972504 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc1d3956-7eff-4af9-ab55-7d3a71dab5f5 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:53.972986 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc1d3956-7eff-4af9-ab55-7d3a71dab5f5 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:53.973410 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc1d3956-7eff-4af9-ab55-7d3a71dab5f5 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:54.312118 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8bad147c-f94c-4d87-a65b-b451931bdf8e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:54.329841 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8bad147c-f94c-4d87-a65b-b451931bdf8e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43" status: 200 len: 1471 microversion: 2.1 time: 0.539109 Oct 18 15:37:54.336839 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1535/3014] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:53 2022] GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43 => generated 1471 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:54.368469 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e23ed27d-4590-42a9-94d5-7a35aba7bef4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:37:54.372428 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e23ed27d-4590-42a9-94d5-7a35aba7bef4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 12e415d7-7c40-41a0-957a-a083dbcf2b43] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:54.396722 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e23ed27d-4590-42a9-94d5-7a35aba7bef4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:54.397478 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e23ed27d-4590-42a9-94d5-7a35aba7bef4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:54.399853 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e23ed27d-4590-42a9-94d5-7a35aba7bef4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:54.403452 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e23ed27d-4590-42a9-94d5-7a35aba7bef4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:54.405738 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e23ed27d-4590-42a9-94d5-7a35aba7bef4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:54.407621 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e23ed27d-4590-42a9-94d5-7a35aba7bef4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:54.492777 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dc1d3956-7eff-4af9-ab55-7d3a71dab5f5 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36635345398478eb011416cae492244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d7770bf1ee4b46a1e4bdf61dc2d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:54.507281 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dc1d3956-7eff-4af9-ab55-7d3a71dab5f5 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "GET /compute/v2.1/servers/004539c4-260d-46a9-beed-d9c4b9a76106" status: 200 len: 1467 microversion: 2.1 time: 0.549458 Oct 18 15:37:54.508484 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1480/3015] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:53 2022] GET /compute/v2.1/servers/004539c4-260d-46a9-beed-d9c4b9a76106 => generated 1467 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:54.541474 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3c87c710-17ed-44ba-ad76-203a99a690a5 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '.version_select at 0x7f7c3d5f7f70>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:54.571110 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e23ed27d-4590-42a9-94d5-7a35aba7bef4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:54.572192 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e23ed27d-4590-42a9-94d5-7a35aba7bef4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:54.573605 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e23ed27d-4590-42a9-94d5-7a35aba7bef4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:54.578399 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e23ed27d-4590-42a9-94d5-7a35aba7bef4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:54.580386 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e23ed27d-4590-42a9-94d5-7a35aba7bef4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:54.583311 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e23ed27d-4590-42a9-94d5-7a35aba7bef4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:54.704095 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3c87c710-17ed-44ba-ad76-203a99a690a5 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "GET /compute/v2.1/images/8f4db252-bff6-4685-9c8d-4c5d6bd9f78b" status: 200 len: 784 microversion: 2.1 time: 0.174946 Oct 18 15:37:54.715586 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1481/3016] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:37:54 2022] GET /compute/v2.1/images/8f4db252-bff6-4685-9c8d-4c5d6bd9f78b => generated 784 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:37:54.739185 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-e23ed27d-4590-42a9-94d5-7a35aba7bef4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Getting quotas for project 91719d2b1f1640f391aa0b54c9725d2a. Resources: {'cores', 'ram'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:37:54.754967 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-e23ed27d-4590-42a9-94d5-7a35aba7bef4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Getting quotas for user 926f2a98aa66431fab2a6032f21d5ae7 and project 91719d2b1f1640f391aa0b54c9725d2a. Resources: {'cores', 'ram'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:37:54.768468 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-04acbcb0-a944-4751-9f6d-3bc0b48b28b5 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:54.797723 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-04acbcb0-a944-4751-9f6d-3bc0b48b28b5 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.045474 Oct 18 15:37:54.797876 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1482/3017] 10.222.0.60 () {58 vars in 1137 bytes} [Tue Oct 18 15:37:54 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:37:54.821658 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b5ddc58f-d79e-4a09-9eb5-f6dc4a1f92c5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:54.822298 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b5ddc58f-d79e-4a09-9eb5-f6dc4a1f92c5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:54.864883 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5ddc58f-d79e-4a09-9eb5-f6dc4a1f92c5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:54.866995 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5ddc58f-d79e-4a09-9eb5-f6dc4a1f92c5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:54.869168 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5ddc58f-d79e-4a09-9eb5-f6dc4a1f92c5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:54.872025 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5ddc58f-d79e-4a09-9eb5-f6dc4a1f92c5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:54.874188 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5ddc58f-d79e-4a09-9eb5-f6dc4a1f92c5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:54.874898 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5ddc58f-d79e-4a09-9eb5-f6dc4a1f92c5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:55.145313 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e23ed27d-4590-42a9-94d5-7a35aba7bef4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "POST /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43/action" status: 202 len: 0 microversion: 2.1 time: 0.786894 Oct 18 15:37:55.145907 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1536/3018] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:37:54 2022] POST /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43/action => generated 0 bytes in 788 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:37:55.175451 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-810e9d06-c726-4a84-b0b3-8151ccf8416a tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '.version_select at 0x7f7c3dc269d0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:55.459921 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b5ddc58f-d79e-4a09-9eb5-f6dc4a1f92c5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:55.476249 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b5ddc58f-d79e-4a09-9eb5-f6dc4a1f92c5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca" status: 200 len: 1525 microversion: 2.1 time: 0.673889 Oct 18 15:37:55.477107 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1483/3019] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:54 2022] GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca => generated 1525 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:55.857569 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7e9d0b10-57b7-4e99-af44-a6a2c7530e61 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Action: 'create', calling method: .version_select at 0x7f7c3e017430>, body: {"keypair": {"name": "tempest-keypair-99874084", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGz7bJva2sH1cYiBAiookiBUcgXWDheb7Ub0pQn55wOPIoAdFmBhVnsPhRAAGpGP4xaM4KFHRqovHGnMbFLsnrEkQaRZB/SWFIqlNNulNNtucMELcBJY+a/2jqHkYjX1Q=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:37:55.895340 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-7e9d0b10-57b7-4e99-af44-a6a2c7530e61 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Getting quotas for project e6d20041d87447e2b959a169637c428b. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:37:55.913071 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-7e9d0b10-57b7-4e99-af44-a6a2c7530e61 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Getting quotas for user e520e6eb21fb48958a2e1026be086543 and project e6d20041d87447e2b959a169637c428b. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:37:55.980073 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7e9d0b10-57b7-4e99-af44-a6a2c7530e61 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.496600 Oct 18 15:37:55.994623 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1484/3020] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Oct 18 15:37:55 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:37:56.002427 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b8d3f21d-ef99-4781-be4c-96862a3c488c tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:56.003348 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b8d3f21d-ef99-4781-be4c-96862a3c488c tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 12e415d7-7c40-41a0-957a-a083dbcf2b43] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:56.022915 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8d3f21d-ef99-4781-be4c-96862a3c488c tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:56.027262 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8d3f21d-ef99-4781-be4c-96862a3c488c tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:56.031116 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8d3f21d-ef99-4781-be4c-96862a3c488c tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:56.032261 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8d3f21d-ef99-4781-be4c-96862a3c488c tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:56.033709 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8d3f21d-ef99-4781-be4c-96862a3c488c tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:56.035689 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8d3f21d-ef99-4781-be4c-96862a3c488c tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:56.547189 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b8d3f21d-ef99-4781-be4c-96862a3c488c tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:56.572904 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b8d3f21d-ef99-4781-be4c-96862a3c488c tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43" status: 200 len: 1470 microversion: 2.1 time: 0.571028 Oct 18 15:37:56.597087 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1485/3021] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:55 2022] GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43 => generated 1470 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:56.628796 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-398f02f6-ecf9-44b6-aa88-88f2a7fabe1d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:56.632937 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-398f02f6-ecf9-44b6-aa88-88f2a7fabe1d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:56.651324 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-398f02f6-ecf9-44b6-aa88-88f2a7fabe1d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:56.651893 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-398f02f6-ecf9-44b6-aa88-88f2a7fabe1d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:56.652337 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-398f02f6-ecf9-44b6-aa88-88f2a7fabe1d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:56.664923 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-398f02f6-ecf9-44b6-aa88-88f2a7fabe1d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:56.670900 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-398f02f6-ecf9-44b6-aa88-88f2a7fabe1d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:56.671752 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-398f02f6-ecf9-44b6-aa88-88f2a7fabe1d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:56.844172 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-810e9d06-c726-4a84-b0b3-8151ccf8416a tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "DELETE /compute/v2.1/images/8ce4db55-b062-45bf-b0b6-d3fb96c3e2c5" status: 204 len: 0 microversion: 2.1 time: 1.689796 Oct 18 15:37:56.845079 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1537/3022] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:55 2022] DELETE /compute/v2.1/images/8ce4db55-b062-45bf-b0b6-d3fb96c3e2c5 => generated 0 bytes in 1698 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:37:56.853476 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a50ec101-384e-4972-89e8-1350cb9f411e tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '.version_select at 0x7f7c3d0f6a60>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:56.910883 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-a50ec101-384e-4972-89e8-1350cb9f411e tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] HTTP exception thrown: Image not found. Oct 18 15:37:56.914185 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a50ec101-384e-4972-89e8-1350cb9f411e tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Request method failure captured: Oct 18 15:37:56.914185 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/images/8ce4db55-b062-45bf-b0b6-d3fb96c3e2c5 HTTP/1.1 Oct 18 15:37:56.914185 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:37:56.914185 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:37:56.914185 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:37:56.914185 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:37:56.914185 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:37:56.914185 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:37:56.914185 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:37:56.914185 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:37:56.914185 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsgZIxcsBpIyN12ziKYEdO7XibCyRnIMm8to_2d3DUY0hst7pF3zwBKH3SrCEfyZ1IPKhv0sOmTCzuD5u29MD0_MdUjVA2ChKkvSWhZVMMt68CPj1j24sPqtJXPPO9S7wbdfpH5GLw5R9nyjPOdvZ4muCnpZqkNHUmlN-5YmT1uNIz0 Oct 18 15:37:56.914185 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:37:56.914185 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:37:56.914185 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:37:56.914185 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:37:56.914185 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:37:56.914185 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:37:56.914185 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 68d7770bf1ee4b46a1e4bdf61dc2d711 Oct 18 15:37:56.914185 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ImagesOneServerTestJSON-1874252287 Oct 18 15:37:56.914185 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:37:56.914185 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:37:56.915732 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/68d7770bf1ee4b46a1e4bdf61dc2d711"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/68d7770bf1ee4b46a1e4bdf61dc2d711"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/68d7770bf1ee4b46a1e4bdf61dc2d711"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_68d7770bf1ee4b46a1e4bdf61dc2d711"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:37:56.915732 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ImagesOneServerTestJSON-1874252287 Oct 18 15:37:56.915732 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 68d7770bf1ee4b46a1e4bdf61dc2d711 Oct 18 15:37:56.915732 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1874252287 Oct 18 15:37:56.915732 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ImagesOneServerTestJSON-1874252287-project Oct 18 15:37:56.915732 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:37:56.915732 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:37:56.915732 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: f36635345398478eb011416cae492244 Oct 18 15:37:56.915732 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ImagesOneServerTestJSON-1874252287-project Oct 18 15:37:56.915732 n-d-853682-5 devstack@n-api.service[120405]: method: Oct 18 15:37:56.915732 n-d-853682-5 devstack@n-api.service[120405]: exception: Image not found. Oct 18 15:37:56.915732 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '8ce4db55-b062-45bf-b0b6-d3fb96c3e2c5'} Oct 18 15:37:56.915732 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:37:56.916632 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:37:56.916632 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 15:37:56.916632 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 15:37:56.916632 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 15:37:56.916632 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 15:37:56.916632 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 15:37:56.916632 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 15:37:56.916632 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 15:37:56.916632 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 15:37:56.916632 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 15:37:56.916632 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 15:37:56.916632 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 15:37:56.916632 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 15:37:56.916632 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 15:37:56.916632 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 15:37:56.916632 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 15:37:56.916632 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 15:37:56.916632 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 8ce4db55-b062-45bf-b0b6-d3fb96c3e2c5 Oct 18 15:37:56.917771 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:37:56.917771 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:37:56.917771 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:37:56.917771 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:37:56.917771 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 18 15:37:56.917771 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 18 15:37:56.917771 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 18 15:37:56.917771 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 18 15:37:56.917771 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 18 15:37:56.917771 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 18 15:37:56.917771 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 18 15:37:56.917771 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 18 15:37:56.917771 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 15:37:56.917771 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 15:37:56.917771 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 15:37:56.917771 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 15:37:56.917771 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 15:37:56.917771 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 15:37:56.917771 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 15:37:56.917771 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 15:37:56.921923 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 15:37:56.921923 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 15:37:56.921923 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 15:37:56.921923 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 15:37:56.921923 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 15:37:56.921923 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 15:37:56.921923 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 15:37:56.921923 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 15:37:56.921923 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8ce4db55-b062-45bf-b0b6-d3fb96c3e2c5 could not be found. Oct 18 15:37:56.921923 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:37:56.921923 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:37:56.921923 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:37:56.921923 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:37:56.921923 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:37:56.921923 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:37:56.921923 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:37:56.921923 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:37:56.921923 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:37:56.921923 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:37:56.925511 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:37:56.925511 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:37:56.925511 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 18 15:37:56.925511 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 15:37:56.925511 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 15:37:56.925511 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:37:56.925511 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:37:56.925511 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:37:56.925511 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:37:56.925511 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:37:56.925511 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:37:56.925511 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:37:56.925511 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:37:56.925511 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 15:37:56.925511 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:37:56.930844 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a50ec101-384e-4972-89e8-1350cb9f411e tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Returning 404 to user: Image not found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:37:56.930844 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a50ec101-384e-4972-89e8-1350cb9f411e tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "GET /compute/v2.1/images/8ce4db55-b062-45bf-b0b6-d3fb96c3e2c5" status: 404 len: 62 microversion: 2.1 time: 0.081280 Oct 18 15:37:56.931703 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1538/3023] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:37:56 2022] GET /compute/v2.1/images/8ce4db55-b062-45bf-b0b6-d3fb96c3e2c5 => generated 62 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 15:37:56.947428 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a560aa6b-ac59-49af-862b-27fa7b05b972 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-569567606"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:37:56.955168 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a560aa6b-ac59-49af-862b-27fa7b05b972 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] [instance: 004539c4-260d-46a9-beed-d9c4b9a76106] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:56.972128 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a560aa6b-ac59-49af-862b-27fa7b05b972 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:56.972639 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a560aa6b-ac59-49af-862b-27fa7b05b972 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:56.973138 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a560aa6b-ac59-49af-862b-27fa7b05b972 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:56.976926 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a560aa6b-ac59-49af-862b-27fa7b05b972 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:56.977099 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a560aa6b-ac59-49af-862b-27fa7b05b972 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:56.977951 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a560aa6b-ac59-49af-862b-27fa7b05b972 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:57.293929 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-398f02f6-ecf9-44b6-aa88-88f2a7fabe1d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:57.315220 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-398f02f6-ecf9-44b6-aa88-88f2a7fabe1d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca" status: 200 len: 1525 microversion: 2.1 time: 0.715051 Oct 18 15:37:57.316293 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1486/3024] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:56 2022] GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca => generated 1525 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:57.330729 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-379e220c-441c-40ad-b4ba-0c68056258ee req-ef52c496-0087-4101-81d9-970bb1cfab2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12e415d7-7c40-41a0-957a-a083dbcf2b43", "name": "network-vif-plugged", "status": "completed", "tag": "0007790a-c337-4a61-8c95-ee14bba9c445"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:37:57.363002 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-379e220c-441c-40ad-b4ba-0c68056258ee req-ef52c496-0087-4101-81d9-970bb1cfab2a service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:57.366088 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-379e220c-441c-40ad-b4ba-0c68056258ee req-ef52c496-0087-4101-81d9-970bb1cfab2a service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:57.368488 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-379e220c-441c-40ad-b4ba-0c68056258ee req-ef52c496-0087-4101-81d9-970bb1cfab2a service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:57.401241 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-379e220c-441c-40ad-b4ba-0c68056258ee req-ef52c496-0087-4101-81d9-970bb1cfab2a service nova] Creating event network-vif-plugged:0007790a-c337-4a61-8c95-ee14bba9c445 for instance 12e415d7-7c40-41a0-957a-a083dbcf2b43 on n-h2-853682-5 Oct 18 15:37:57.421138 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [req-379e220c-441c-40ad-b4ba-0c68056258ee req-ef52c496-0087-4101-81d9-970bb1cfab2a service nova] Instance 12e415d7-7c40-41a0-957a-a083dbcf2b43 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853682-5'} {{(pid=120406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 18 15:37:57.446710 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-379e220c-441c-40ad-b4ba-0c68056258ee req-ef52c496-0087-4101-81d9-970bb1cfab2a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126589 Oct 18 15:37:57.447240 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1487/3025] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:37:57.567716 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a560aa6b-ac59-49af-862b-27fa7b05b972 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "POST /compute/v2.1/servers/004539c4-260d-46a9-beed-d9c4b9a76106/action" status: 202 len: 0 microversion: 2.1 time: 0.625595 Oct 18 15:37:57.582803 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1539/3026] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:37:56 2022] POST /compute/v2.1/servers/004539c4-260d-46a9-beed-d9c4b9a76106/action => generated 0 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 18 15:37:57.595368 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dd3a98c8-aa76-45d4-b0c2-66b8d031d31d tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '.version_select at 0x7f7c3d021940>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:57.619635 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-96318350-1d9a-4a23-b2d4-1d025e3bd0ef tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:57.623716 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-96318350-1d9a-4a23-b2d4-1d025e3bd0ef tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 12e415d7-7c40-41a0-957a-a083dbcf2b43] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:57.635542 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-96318350-1d9a-4a23-b2d4-1d025e3bd0ef tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:57.636435 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-96318350-1d9a-4a23-b2d4-1d025e3bd0ef tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:57.637638 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-96318350-1d9a-4a23-b2d4-1d025e3bd0ef tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:57.639100 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-96318350-1d9a-4a23-b2d4-1d025e3bd0ef tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:57.639820 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-96318350-1d9a-4a23-b2d4-1d025e3bd0ef tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:57.640468 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-96318350-1d9a-4a23-b2d4-1d025e3bd0ef tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:57.712125 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dd3a98c8-aa76-45d4-b0c2-66b8d031d31d tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "GET /compute/v2.1/images/8c7b241d-0275-49f6-be6f-40e1e7c6411a" status: 200 len: 1428 microversion: 2.1 time: 0.121114 Oct 18 15:37:57.722266 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1488/3027] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:37:57 2022] GET /compute/v2.1/images/8c7b241d-0275-49f6-be6f-40e1e7c6411a => generated 1428 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:58.057698 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-96318350-1d9a-4a23-b2d4-1d025e3bd0ef tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:58.086086 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-96318350-1d9a-4a23-b2d4-1d025e3bd0ef tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43" status: 200 len: 1470 microversion: 2.1 time: 0.476014 Oct 18 15:37:58.087475 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1540/3028] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:57 2022] GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43 => generated 1470 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:58.345439 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-931945e1-001a-4d2f-bb0e-1795e120c0aa tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:58.347403 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-931945e1-001a-4d2f-bb0e-1795e120c0aa tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:58.365763 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-931945e1-001a-4d2f-bb0e-1795e120c0aa tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:58.366523 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-931945e1-001a-4d2f-bb0e-1795e120c0aa tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:58.369712 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-931945e1-001a-4d2f-bb0e-1795e120c0aa tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:58.370739 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-931945e1-001a-4d2f-bb0e-1795e120c0aa tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:58.371359 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-931945e1-001a-4d2f-bb0e-1795e120c0aa tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:58.371940 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-931945e1-001a-4d2f-bb0e-1795e120c0aa tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:58.727390 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f5a738de-d85d-4a56-a2fb-096d076108db tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '.version_select at 0x7f7c3d0c30d0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:58.797265 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f5a738de-d85d-4a56-a2fb-096d076108db tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "GET /compute/v2.1/images/8c7b241d-0275-49f6-be6f-40e1e7c6411a" status: 200 len: 1428 microversion: 2.1 time: 0.073611 Oct 18 15:37:58.798462 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1541/3029] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:37:58 2022] GET /compute/v2.1/images/8c7b241d-0275-49f6-be6f-40e1e7c6411a => generated 1428 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:59.122330 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b8151b8b-b2c2-495b-8997-183eee22fc41 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:37:59.123666 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b8151b8b-b2c2-495b-8997-183eee22fc41 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 12e415d7-7c40-41a0-957a-a083dbcf2b43] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:37:59.146944 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b8151b8b-b2c2-495b-8997-183eee22fc41 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:59.147696 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b8151b8b-b2c2-495b-8997-183eee22fc41 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:59.148320 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b8151b8b-b2c2-495b-8997-183eee22fc41 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:59.153659 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b8151b8b-b2c2-495b-8997-183eee22fc41 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:59.161604 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b8151b8b-b2c2-495b-8997-183eee22fc41 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:59.162371 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b8151b8b-b2c2-495b-8997-183eee22fc41 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:59.599523 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-931945e1-001a-4d2f-bb0e-1795e120c0aa tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:59.608327 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-931945e1-001a-4d2f-bb0e-1795e120c0aa tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca" status: 200 len: 1525 microversion: 2.1 time: 1.268027 Oct 18 15:37:59.629082 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1489/3030] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:58 2022] GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca => generated 1525 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:37:59.642241 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6d460bc9-21ea-49a6-9913-ce3df6caa0fb tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "95ced33b-7a41-4085-b228-00ccaa1100c2"}], "security_groups": [{"name": "tempest-securitygroup--54310190"}], "key_name": "tempest-keypair-99874084", "user_data": "}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:37:59.825003 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b8151b8b-b2c2-495b-8997-183eee22fc41 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:37:59.841682 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b8151b8b-b2c2-495b-8997-183eee22fc41 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43" status: 200 len: 1470 microversion: 2.1 time: 0.731685 Oct 18 15:37:59.842456 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1542/3031] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:37:59 2022] GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43 => generated 1470 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:37:59.864479 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-443d52ec-cf5c-4457-b8fe-3ffc41d4880f req-21ba2c6f-cb57-44e7-9d45-a6463cf8319d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "004539c4-260d-46a9-beed-d9c4b9a76106", "name": "network-vif-unplugged", "status": "completed", "tag": "7e81b5b0-1e7e-436b-84c7-bab9312ea51d"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:37:59.894893 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-443d52ec-cf5c-4457-b8fe-3ffc41d4880f req-21ba2c6f-cb57-44e7-9d45-a6463cf8319d service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:37:59.897411 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-443d52ec-cf5c-4457-b8fe-3ffc41d4880f req-21ba2c6f-cb57-44e7-9d45-a6463cf8319d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:37:59.904177 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-443d52ec-cf5c-4457-b8fe-3ffc41d4880f req-21ba2c6f-cb57-44e7-9d45-a6463cf8319d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:37:59.948552 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-443d52ec-cf5c-4457-b8fe-3ffc41d4880f req-21ba2c6f-cb57-44e7-9d45-a6463cf8319d service nova] Creating event network-vif-unplugged:7e81b5b0-1e7e-436b-84c7-bab9312ea51d for instance 004539c4-260d-46a9-beed-d9c4b9a76106 on n-h1-853682-5 Oct 18 15:37:59.958520 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-443d52ec-cf5c-4457-b8fe-3ffc41d4880f req-21ba2c6f-cb57-44e7-9d45-a6463cf8319d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114715 Oct 18 15:37:59.959927 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1543/3032] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:37:59.973046 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-6d460bc9-21ea-49a6-9913-ce3df6caa0fb tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] validate_networks() for [('95ced33b-7a41-4085-b228-00ccaa1100c2', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:37:59.981042 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-008371e1-5e68-44ef-a2b8-67e08ff7814d tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '.version_select at 0x7f7c3d0c38b0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:00.119206 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-008371e1-5e68-44ef-a2b8-67e08ff7814d tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "GET /compute/v2.1/images/8c7b241d-0275-49f6-be6f-40e1e7c6411a" status: 200 len: 1428 microversion: 2.1 time: 0.145903 Oct 18 15:38:00.124153 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1544/3033] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:37:59 2022] GET /compute/v2.1/images/8c7b241d-0275-49f6-be6f-40e1e7c6411a => generated 1428 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:00.640730 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f661adf2-58c3-4fc6-9185-7f97efc38584 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:00.642382 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f661adf2-58c3-4fc6-9185-7f97efc38584 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:00.668596 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f661adf2-58c3-4fc6-9185-7f97efc38584 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:00.673674 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f661adf2-58c3-4fc6-9185-7f97efc38584 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:00.674162 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f661adf2-58c3-4fc6-9185-7f97efc38584 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:00.674960 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f661adf2-58c3-4fc6-9185-7f97efc38584 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:00.675441 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f661adf2-58c3-4fc6-9185-7f97efc38584 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:00.681501 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f661adf2-58c3-4fc6-9185-7f97efc38584 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:01.192212 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-6d460bc9-21ea-49a6-9913-ce3df6caa0fb tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:38:01.193215 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-6d460bc9-21ea-49a6-9913-ce3df6caa0fb tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:38:01.195042 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-6d460bc9-21ea-49a6-9913-ce3df6caa0fb tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:38:01.195755 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-6d460bc9-21ea-49a6-9913-ce3df6caa0fb tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:38:01.196428 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-6d460bc9-21ea-49a6-9913-ce3df6caa0fb tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:38:01.231067 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d460bc9-21ea-49a6-9913-ce3df6caa0fb tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:01.231822 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d460bc9-21ea-49a6-9913-ce3df6caa0fb tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:01.232560 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d460bc9-21ea-49a6-9913-ce3df6caa0fb tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:01.234349 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d460bc9-21ea-49a6-9913-ce3df6caa0fb tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:01.236590 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d460bc9-21ea-49a6-9913-ce3df6caa0fb tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:01.237567 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d460bc9-21ea-49a6-9913-ce3df6caa0fb tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:01.286214 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-6d460bc9-21ea-49a6-9913-ce3df6caa0fb tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Getting quotas for project e6d20041d87447e2b959a169637c428b. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:38:01.303870 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-6d460bc9-21ea-49a6-9913-ce3df6caa0fb tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Getting quotas for user e520e6eb21fb48958a2e1026be086543 and project e6d20041d87447e2b959a169637c428b. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:38:01.339531 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6d460bc9-21ea-49a6-9913-ce3df6caa0fb tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:38:01.342392 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6d460bc9-21ea-49a6-9913-ce3df6caa0fb tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] [instance: 994c2ba1-98f1-4d00-8753-00e39d56d433] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:38:01.487831 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6d460bc9-21ea-49a6-9913-ce3df6caa0fb tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.857399 Oct 18 15:38:01.496046 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1490/3034] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:37:59 2022] POST /compute/v2.1/servers => generated 407 bytes in 1866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:38:01.508535 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3ed4823f-a743-470d-b2ed-0a56a684172a tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:01.517035 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3ed4823f-a743-470d-b2ed-0a56a684172a tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 12e415d7-7c40-41a0-957a-a083dbcf2b43] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:01.534463 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f661adf2-58c3-4fc6-9185-7f97efc38584 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:01.547586 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ed4823f-a743-470d-b2ed-0a56a684172a tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:01.548100 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ed4823f-a743-470d-b2ed-0a56a684172a tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:01.548546 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ed4823f-a743-470d-b2ed-0a56a684172a tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:01.549334 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ed4823f-a743-470d-b2ed-0a56a684172a tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:01.549803 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ed4823f-a743-470d-b2ed-0a56a684172a tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:01.551818 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f661adf2-58c3-4fc6-9185-7f97efc38584 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca" status: 200 len: 1525 microversion: 2.1 time: 0.919658 Oct 18 15:38:01.552414 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1545/3035] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:00 2022] GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca => generated 1525 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:01.555183 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ed4823f-a743-470d-b2ed-0a56a684172a tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:01.566706 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3f3d3aec-20b0-468a-9f22-43dba5c6b29b tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '.version_select at 0x7f7c3d3ea280>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:01.655027 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3f3d3aec-20b0-468a-9f22-43dba5c6b29b tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "GET /compute/v2.1/images/8c7b241d-0275-49f6-be6f-40e1e7c6411a" status: 200 len: 1428 microversion: 2.1 time: 0.100316 Oct 18 15:38:01.657032 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1546/3036] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:38:01 2022] GET /compute/v2.1/images/8c7b241d-0275-49f6-be6f-40e1e7c6411a => generated 1428 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:01.679871 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-792cd6a0-7a91-486b-82e8-2a5f61189246 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:01.688092 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-792cd6a0-7a91-486b-82e8-2a5f61189246 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] [instance: 994c2ba1-98f1-4d00-8753-00e39d56d433] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:02.015712 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-792cd6a0-7a91-486b-82e8-2a5f61189246 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e520e6eb21fb48958a2e1026be086543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d20041d87447e2b959a169637c428b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:02.038602 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-792cd6a0-7a91-486b-82e8-2a5f61189246 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] 10.222.0.60 "GET /compute/v2.1/servers/994c2ba1-98f1-4d00-8753-00e39d56d433" status: 200 len: 1224 microversion: 2.1 time: 0.380236 Oct 18 15:38:02.039552 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1547/3037] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:01 2022] GET /compute/v2.1/servers/994c2ba1-98f1-4d00-8753-00e39d56d433 => generated 1224 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:02.206376 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3ed4823f-a743-470d-b2ed-0a56a684172a tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:02.246553 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3ed4823f-a743-470d-b2ed-0a56a684172a tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43" status: 200 len: 1536 microversion: 2.1 time: 0.737489 Oct 18 15:38:02.251101 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1491/3038] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:01 2022] GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43 => generated 1536 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:02.580173 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a387de01-5e0c-4974-b07a-3bcb35fd75c8 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:02.582071 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a387de01-5e0c-4974-b07a-3bcb35fd75c8 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:02.602614 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a387de01-5e0c-4974-b07a-3bcb35fd75c8 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:02.610283 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a387de01-5e0c-4974-b07a-3bcb35fd75c8 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:02.611540 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a387de01-5e0c-4974-b07a-3bcb35fd75c8 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:02.615249 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a387de01-5e0c-4974-b07a-3bcb35fd75c8 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:02.620276 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a387de01-5e0c-4974-b07a-3bcb35fd75c8 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:02.624461 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a387de01-5e0c-4974-b07a-3bcb35fd75c8 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:02.672625 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dfdee021-93d4-46fa-9435-a8e2e74b5dae tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '.version_select at 0x7f7c3d77dca0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:02.800288 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dfdee021-93d4-46fa-9435-a8e2e74b5dae tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "GET /compute/v2.1/images/8c7b241d-0275-49f6-be6f-40e1e7c6411a" status: 200 len: 1428 microversion: 2.1 time: 0.132106 Oct 18 15:38:02.801548 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1492/3039] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:38:02 2022] GET /compute/v2.1/images/8c7b241d-0275-49f6-be6f-40e1e7c6411a => generated 1428 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:03.008512 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-a5c72f47-0e4c-499e-987e-d221e6dfbb6d req-343085c3-71d3-43f3-a88b-83b1d692053e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12e415d7-7c40-41a0-957a-a083dbcf2b43", "name": "network-vif-unplugged", "status": "completed", "tag": "0007790a-c337-4a61-8c95-ee14bba9c445"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:38:03.038694 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a5c72f47-0e4c-499e-987e-d221e6dfbb6d req-343085c3-71d3-43f3-a88b-83b1d692053e service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:03.039850 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a5c72f47-0e4c-499e-987e-d221e6dfbb6d req-343085c3-71d3-43f3-a88b-83b1d692053e service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:03.041513 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a5c72f47-0e4c-499e-987e-d221e6dfbb6d req-343085c3-71d3-43f3-a88b-83b1d692053e service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:03.091798 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-a5c72f47-0e4c-499e-987e-d221e6dfbb6d req-343085c3-71d3-43f3-a88b-83b1d692053e service nova] Creating event network-vif-unplugged:0007790a-c337-4a61-8c95-ee14bba9c445 for instance 12e415d7-7c40-41a0-957a-a083dbcf2b43 on n-h2-853682-5 Oct 18 15:38:03.136105 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [req-a5c72f47-0e4c-499e-987e-d221e6dfbb6d req-343085c3-71d3-43f3-a88b-83b1d692053e service nova] Instance 12e415d7-7c40-41a0-957a-a083dbcf2b43 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853682-5'} {{(pid=120406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 18 15:38:03.160026 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-a5c72f47-0e4c-499e-987e-d221e6dfbb6d req-343085c3-71d3-43f3-a88b-83b1d692053e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.155865 Oct 18 15:38:03.166520 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1493/3040] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:38:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:38:03.187590 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d5bfb2ed-d807-4d0b-a2a3-d6402f70c9f3 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:03.188334 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d5bfb2ed-d807-4d0b-a2a3-d6402f70c9f3 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] [instance: 994c2ba1-98f1-4d00-8753-00e39d56d433] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:03.212913 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:38:03.214623 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5bfb2ed-d807-4d0b-a2a3-d6402f70c9f3 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:03.215125 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5bfb2ed-d807-4d0b-a2a3-d6402f70c9f3 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:03.215568 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5bfb2ed-d807-4d0b-a2a3-d6402f70c9f3 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:03.216349 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5bfb2ed-d807-4d0b-a2a3-d6402f70c9f3 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:03.216740 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5bfb2ed-d807-4d0b-a2a3-d6402f70c9f3 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:03.217197 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5bfb2ed-d807-4d0b-a2a3-d6402f70c9f3 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:03.448777 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d5bfb2ed-d807-4d0b-a2a3-d6402f70c9f3 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e520e6eb21fb48958a2e1026be086543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d20041d87447e2b959a169637c428b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:03.463934 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d5bfb2ed-d807-4d0b-a2a3-d6402f70c9f3 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] 10.222.0.60 "GET /compute/v2.1/servers/994c2ba1-98f1-4d00-8753-00e39d56d433" status: 200 len: 1228 microversion: 2.1 time: 0.293395 Oct 18 15:38:03.467615 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1494/3041] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:03 2022] GET /compute/v2.1/servers/994c2ba1-98f1-4d00-8753-00e39d56d433 => generated 1228 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:03.487696 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1fd2f342-5a6d-4ec2-9411-eb9333719180 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:03.500282 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1fd2f342-5a6d-4ec2-9411-eb9333719180 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 12e415d7-7c40-41a0-957a-a083dbcf2b43] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:03.527787 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1fd2f342-5a6d-4ec2-9411-eb9333719180 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:03.529191 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1fd2f342-5a6d-4ec2-9411-eb9333719180 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:03.531132 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1fd2f342-5a6d-4ec2-9411-eb9333719180 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:03.533744 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1fd2f342-5a6d-4ec2-9411-eb9333719180 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:03.535213 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1fd2f342-5a6d-4ec2-9411-eb9333719180 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:03.536150 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1fd2f342-5a6d-4ec2-9411-eb9333719180 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:03.541660 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a387de01-5e0c-4974-b07a-3bcb35fd75c8 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:03.559226 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a387de01-5e0c-4974-b07a-3bcb35fd75c8 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca" status: 200 len: 1525 microversion: 2.1 time: 0.983671 Oct 18 15:38:03.565140 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1548/3042] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:02 2022] GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca => generated 1525 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:03.768497 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1fd2f342-5a6d-4ec2-9411-eb9333719180 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:03.778131 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1fd2f342-5a6d-4ec2-9411-eb9333719180 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43" status: 200 len: 1536 microversion: 2.1 time: 0.309066 Oct 18 15:38:03.782485 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1495/3043] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:03 2022] GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43 => generated 1536 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:03.796702 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2a45d56d-799f-463a-8a5d-4c941830a36f tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:03.797279 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2a45d56d-799f-463a-8a5d-4c941830a36f tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 52d725f3-b4da-4831-9abf-bf7aba8aee0a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:03.813722 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a45d56d-799f-463a-8a5d-4c941830a36f tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:03.814898 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a45d56d-799f-463a-8a5d-4c941830a36f tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:03.815676 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a45d56d-799f-463a-8a5d-4c941830a36f tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:03.816623 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a45d56d-799f-463a-8a5d-4c941830a36f tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:03.818126 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-61230194-0c83-4755-bbf8-3e9e67a63020 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '.version_select at 0x7f7c3d3a59d0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:03.822039 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a45d56d-799f-463a-8a5d-4c941830a36f tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:03.822526 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a45d56d-799f-463a-8a5d-4c941830a36f tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:03.920048 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2a45d56d-799f-463a-8a5d-4c941830a36f tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a/ips" status: 200 len: 144 microversion: 2.1 time: 0.125075 Oct 18 15:38:03.939793 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-61230194-0c83-4755-bbf8-3e9e67a63020 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "GET /compute/v2.1/images/8c7b241d-0275-49f6-be6f-40e1e7c6411a" status: 200 len: 1428 microversion: 2.1 time: 0.126288 Oct 18 15:38:03.940766 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1496/3044] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:38:03 2022] GET /compute/v2.1/images/8c7b241d-0275-49f6-be6f-40e1e7c6411a => generated 1428 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:38:03.941205 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1549/3045] 10.222.0.60 () {58 vars in 1248 bytes} [Tue Oct 18 15:38:03 2022] GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a/ips => generated 144 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:38:04.491648 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ab083f92-b47b-4ccf-8614-47c4eec79b5c tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:04.493503 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ab083f92-b47b-4ccf-8614-47c4eec79b5c tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] [instance: 994c2ba1-98f1-4d00-8753-00e39d56d433] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:04.516546 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab083f92-b47b-4ccf-8614-47c4eec79b5c tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:04.517101 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab083f92-b47b-4ccf-8614-47c4eec79b5c tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:04.522455 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab083f92-b47b-4ccf-8614-47c4eec79b5c tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:04.528364 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab083f92-b47b-4ccf-8614-47c4eec79b5c tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:04.529653 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab083f92-b47b-4ccf-8614-47c4eec79b5c tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:04.530121 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab083f92-b47b-4ccf-8614-47c4eec79b5c tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:04.595287 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-77e0efd6-7f15-4219-b726-693511a5dfa3 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:04.609503 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-77e0efd6-7f15-4219-b726-693511a5dfa3 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:04.655540 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-77e0efd6-7f15-4219-b726-693511a5dfa3 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:04.658310 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-77e0efd6-7f15-4219-b726-693511a5dfa3 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:04.659110 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-77e0efd6-7f15-4219-b726-693511a5dfa3 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:04.666854 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-77e0efd6-7f15-4219-b726-693511a5dfa3 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:04.667625 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-77e0efd6-7f15-4219-b726-693511a5dfa3 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:04.670203 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-77e0efd6-7f15-4219-b726-693511a5dfa3 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:04.671033 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=3 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:38:04.758640 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ab083f92-b47b-4ccf-8614-47c4eec79b5c tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e520e6eb21fb48958a2e1026be086543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d20041d87447e2b959a169637c428b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:04.772707 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ab083f92-b47b-4ccf-8614-47c4eec79b5c tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] 10.222.0.60 "GET /compute/v2.1/servers/994c2ba1-98f1-4d00-8753-00e39d56d433" status: 200 len: 1220 microversion: 2.1 time: 0.284852 Oct 18 15:38:04.775344 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1497/3046] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:04 2022] GET /compute/v2.1/servers/994c2ba1-98f1-4d00-8753-00e39d56d433 => generated 1220 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:04.810333 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b230e612-6d48-4351-81f5-24539a9eaf16 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:04.811123 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b230e612-6d48-4351-81f5-24539a9eaf16 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 12e415d7-7c40-41a0-957a-a083dbcf2b43] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:04.824226 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b230e612-6d48-4351-81f5-24539a9eaf16 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:04.824918 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b230e612-6d48-4351-81f5-24539a9eaf16 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:04.825474 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b230e612-6d48-4351-81f5-24539a9eaf16 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:04.826318 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b230e612-6d48-4351-81f5-24539a9eaf16 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:04.830762 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b230e612-6d48-4351-81f5-24539a9eaf16 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:04.831355 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b230e612-6d48-4351-81f5-24539a9eaf16 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:05.214388 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-77e0efd6-7f15-4219-b726-693511a5dfa3 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:05.231112 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-77e0efd6-7f15-4219-b726-693511a5dfa3 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca" status: 200 len: 1525 microversion: 2.1 time: 0.641457 Oct 18 15:38:05.232961 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1550/3047] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:04 2022] GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca => generated 1525 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:05.250027 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0502cc0a-7162-4690-ad37-d604b0090491 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '.version_select at 0x7f7c4160e040>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:05.399402 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0502cc0a-7162-4690-ad37-d604b0090491 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "GET /compute/v2.1/images/8c7b241d-0275-49f6-be6f-40e1e7c6411a" status: 200 len: 1428 microversion: 2.1 time: 0.163198 Oct 18 15:38:05.400002 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1551/3048] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:38:05 2022] GET /compute/v2.1/images/8c7b241d-0275-49f6-be6f-40e1e7c6411a => generated 1428 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:05.430733 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b230e612-6d48-4351-81f5-24539a9eaf16 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:05.448276 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b230e612-6d48-4351-81f5-24539a9eaf16 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43" status: 200 len: 1536 microversion: 2.1 time: 0.634163 Oct 18 15:38:05.466873 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1498/3049] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:04 2022] GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43 => generated 1536 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:05.803839 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-91ddc621-1104-43d8-8b0e-45131aac3221 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:05.804979 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-91ddc621-1104-43d8-8b0e-45131aac3221 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] [instance: 994c2ba1-98f1-4d00-8753-00e39d56d433] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:05.825275 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-91ddc621-1104-43d8-8b0e-45131aac3221 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:05.825784 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-91ddc621-1104-43d8-8b0e-45131aac3221 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:05.826227 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-91ddc621-1104-43d8-8b0e-45131aac3221 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:05.844470 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-91ddc621-1104-43d8-8b0e-45131aac3221 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:05.847460 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-91ddc621-1104-43d8-8b0e-45131aac3221 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:05.848947 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-91ddc621-1104-43d8-8b0e-45131aac3221 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:06.094440 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-91ddc621-1104-43d8-8b0e-45131aac3221 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e520e6eb21fb48958a2e1026be086543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d20041d87447e2b959a169637c428b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:06.109485 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-91ddc621-1104-43d8-8b0e-45131aac3221 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] 10.222.0.60 "GET /compute/v2.1/servers/994c2ba1-98f1-4d00-8753-00e39d56d433" status: 200 len: 1294 microversion: 2.1 time: 0.310431 Oct 18 15:38:06.111190 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1552/3050] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:05 2022] GET /compute/v2.1/servers/994c2ba1-98f1-4d00-8753-00e39d56d433 => generated 1294 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:06.260270 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-07fb9f4a-3eb7-48bd-b5da-247a20fbe0c8 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:06.261095 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-07fb9f4a-3eb7-48bd-b5da-247a20fbe0c8 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:06.280912 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-07fb9f4a-3eb7-48bd-b5da-247a20fbe0c8 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:06.281778 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-07fb9f4a-3eb7-48bd-b5da-247a20fbe0c8 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:06.282446 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-07fb9f4a-3eb7-48bd-b5da-247a20fbe0c8 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:06.283387 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-07fb9f4a-3eb7-48bd-b5da-247a20fbe0c8 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:06.284122 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-07fb9f4a-3eb7-48bd-b5da-247a20fbe0c8 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:06.286178 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-07fb9f4a-3eb7-48bd-b5da-247a20fbe0c8 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:06.415913 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d17219f8-c6af-4aa7-82c4-b46a8c2a46f1 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '.version_select at 0x7f7c4160eca0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:06.538274 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d17219f8-c6af-4aa7-82c4-b46a8c2a46f1 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "GET /compute/v2.1/images/8c7b241d-0275-49f6-be6f-40e1e7c6411a" status: 200 len: 1428 microversion: 2.1 time: 0.126433 Oct 18 15:38:06.541115 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1553/3051] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:38:06 2022] GET /compute/v2.1/images/8c7b241d-0275-49f6-be6f-40e1e7c6411a => generated 1428 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:06.560598 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-116d5549-3c18-4350-b091-8e47973c22a3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:06.562560 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-116d5549-3c18-4350-b091-8e47973c22a3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 12e415d7-7c40-41a0-957a-a083dbcf2b43] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:06.583104 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-116d5549-3c18-4350-b091-8e47973c22a3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:06.587401 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-116d5549-3c18-4350-b091-8e47973c22a3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:06.587987 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-116d5549-3c18-4350-b091-8e47973c22a3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:06.588880 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-116d5549-3c18-4350-b091-8e47973c22a3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:06.590522 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-116d5549-3c18-4350-b091-8e47973c22a3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:06.594222 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-116d5549-3c18-4350-b091-8e47973c22a3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:06.614931 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:38:06.699632 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-07fb9f4a-3eb7-48bd-b5da-247a20fbe0c8 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:06.714057 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-07fb9f4a-3eb7-48bd-b5da-247a20fbe0c8 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca" status: 200 len: 1525 microversion: 2.1 time: 0.456780 Oct 18 15:38:06.715591 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1499/3052] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:06 2022] GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca => generated 1525 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:07.007354 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-116d5549-3c18-4350-b091-8e47973c22a3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:07.017192 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-116d5549-3c18-4350-b091-8e47973c22a3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43" status: 200 len: 1529 microversion: 2.1 time: 0.474641 Oct 18 15:38:07.019841 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1554/3053] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:06 2022] GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43 => generated 1529 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:07.048279 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-52f4f32d-0764-44a0-8294-4c6e2aacdefb tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:07.049319 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-52f4f32d-0764-44a0-8294-4c6e2aacdefb tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 12e415d7-7c40-41a0-957a-a083dbcf2b43] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:07.058050 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52f4f32d-0764-44a0-8294-4c6e2aacdefb tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:07.059013 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52f4f32d-0764-44a0-8294-4c6e2aacdefb tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:07.059783 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52f4f32d-0764-44a0-8294-4c6e2aacdefb tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:07.060880 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52f4f32d-0764-44a0-8294-4c6e2aacdefb tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:07.062233 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52f4f32d-0764-44a0-8294-4c6e2aacdefb tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:07.062949 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52f4f32d-0764-44a0-8294-4c6e2aacdefb tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:07.147518 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-53a4308f-b372-44cb-b60e-f2463f6a9a96 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:07.150644 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-53a4308f-b372-44cb-b60e-f2463f6a9a96 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] [instance: 994c2ba1-98f1-4d00-8753-00e39d56d433] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:07.175208 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-53a4308f-b372-44cb-b60e-f2463f6a9a96 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:07.177345 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-53a4308f-b372-44cb-b60e-f2463f6a9a96 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:07.181140 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-53a4308f-b372-44cb-b60e-f2463f6a9a96 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:07.181976 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-53a4308f-b372-44cb-b60e-f2463f6a9a96 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:07.182461 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-53a4308f-b372-44cb-b60e-f2463f6a9a96 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:07.182901 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-53a4308f-b372-44cb-b60e-f2463f6a9a96 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:07.495241 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-53a4308f-b372-44cb-b60e-f2463f6a9a96 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e520e6eb21fb48958a2e1026be086543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d20041d87447e2b959a169637c428b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:07.511795 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-53a4308f-b372-44cb-b60e-f2463f6a9a96 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] 10.222.0.60 "GET /compute/v2.1/servers/994c2ba1-98f1-4d00-8753-00e39d56d433" status: 200 len: 1282 microversion: 2.1 time: 0.379877 Oct 18 15:38:07.529845 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1555/3054] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:07 2022] GET /compute/v2.1/servers/994c2ba1-98f1-4d00-8753-00e39d56d433 => generated 1282 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:07.558766 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8e893db5-3bd1-48d6-9836-759432f50bef tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '.version_select at 0x7f7c3d1c1280>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:07.944717 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-52f4f32d-0764-44a0-8294-4c6e2aacdefb tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:07.956675 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-52f4f32d-0764-44a0-8294-4c6e2aacdefb tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43" status: 200 len: 1529 microversion: 2.1 time: 0.915982 Oct 18 15:38:07.982699 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1500/3055] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:07 2022] GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43 => generated 1529 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:08.004294 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-04a690e9-effd-476a-9df5-9adb6ea979a5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:08.004971 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-04a690e9-effd-476a-9df5-9adb6ea979a5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:08.037324 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04a690e9-effd-476a-9df5-9adb6ea979a5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:08.039907 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04a690e9-effd-476a-9df5-9adb6ea979a5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:08.040665 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04a690e9-effd-476a-9df5-9adb6ea979a5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:08.042942 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04a690e9-effd-476a-9df5-9adb6ea979a5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:08.043482 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04a690e9-effd-476a-9df5-9adb6ea979a5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:08.043926 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04a690e9-effd-476a-9df5-9adb6ea979a5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:08.459693 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-04a690e9-effd-476a-9df5-9adb6ea979a5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:08.477425 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-04a690e9-effd-476a-9df5-9adb6ea979a5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca" status: 200 len: 1525 microversion: 2.1 time: 0.493445 Oct 18 15:38:08.479170 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1501/3056] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:07 2022] GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca => generated 1525 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:08.499940 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-885a0de2-98fb-4d2e-b41f-b3d951587026 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:08.534021 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-885a0de2-98fb-4d2e-b41f-b3d951587026 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] HTTP exception thrown: Flavor 9e5f28fa-4760-4b58-826f-ff77263a4322 could not be found. Oct 18 15:38:08.549039 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-885a0de2-98fb-4d2e-b41f-b3d951587026 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] Request method failure captured: Oct 18 15:38:08.549039 n-d-853682-5 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/flavors/9e5f28fa-4760-4b58-826f-ff77263a4322 HTTP/1.1 Oct 18 15:38:08.549039 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:38:08.549039 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:38:08.549039 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:38:08.549039 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:38:08.549039 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:38:08.549039 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:38:08.549039 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:38:08.549039 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:38:08.549039 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsePNzHzkYlFVpT62Q0B1qXTI6k0kv8NLaIbU2qxD6N1p4k4AiWGD1prqMj936TwkaDlpsMJ2alGrTqsRRrM_TAbFdi2riEHxlbNS1ANljWbQ6lZ3tVp8jiaVM4fHnlDSa4dyDBZQQFHjjbi2PzwupU8Ectsy9kBHu3TXLiR8HlUVtY Oct 18 15:38:08.549039 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:38:08.549039 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:38:08.549039 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:38:08.549039 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:38:08.549039 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:38:08.549039 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:38:08.549039 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: bda0ca6818f141308683b72cf0c6aac5 Oct 18 15:38:08.549039 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-MigrationsAdminTest-1597509491 Oct 18 15:38:08.549039 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,admin,reader Oct 18 15:38:08.549039 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,admin,reader Oct 18 15:38:08.550871 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bda0ca6818f141308683b72cf0c6aac5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bda0ca6818f141308683b72cf0c6aac5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/bda0ca6818f141308683b72cf0c6aac5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_bda0ca6818f141308683b72cf0c6aac5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:38:08.550871 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-MigrationsAdminTest-1597509491 Oct 18 15:38:08.550871 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: bda0ca6818f141308683b72cf0c6aac5 Oct 18 15:38:08.550871 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-MigrationsAdminTest-1597509491 Oct 18 15:38:08.550871 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-MigrationsAdminTest-1597509491-project-admin Oct 18 15:38:08.550871 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:38:08.550871 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:38:08.550871 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 9b648f2cf13d47eb83430c71cd7737b5 Oct 18 15:38:08.550871 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-MigrationsAdminTest-1597509491-project-admin Oct 18 15:38:08.550871 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:38:08.550871 n-d-853682-5 devstack@n-api.service[120406]: exception: Flavor 9e5f28fa-4760-4b58-826f-ff77263a4322 could not be found. Oct 18 15:38:08.550871 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '9e5f28fa-4760-4b58-826f-ff77263a4322'} Oct 18 15:38:08.551687 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:38:08.551687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:38:08.551687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 18 15:38:08.551687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 18 15:38:08.551687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 18 15:38:08.551687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 18 15:38:08.551687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 18 15:38:08.551687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 18 15:38:08.551687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 18 15:38:08.551687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 18 15:38:08.551687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 15:38:08.551687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 15:38:08.551687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 18 15:38:08.551687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 18 15:38:08.551687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 9e5f28fa-4760-4b58-826f-ff77263a4322 could not be found. Oct 18 15:38:08.551687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:38:08.551687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:38:08.551687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:38:08.551687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:38:08.551687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:38:08.554352 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:38:08.554352 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:38:08.554352 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:38:08.554352 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:38:08.554352 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:38:08.554352 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 18 15:38:08.554352 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:38:08.554352 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 9e5f28fa-4760-4b58-826f-ff77263a4322 could not be found. Oct 18 15:38:08.554352 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:38:08.554352 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:38:08.554352 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:38:08.554352 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:38:08.554352 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:38:08.554352 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:38:08.554352 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:38:08.554352 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:38:08.554352 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 9e5f28fa-4760-4b58-826f-ff77263a4322 could not be found. Oct 18 15:38:08.554352 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:38:08.556171 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-885a0de2-98fb-4d2e-b41f-b3d951587026 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] Returning 404 to user: Flavor 9e5f28fa-4760-4b58-826f-ff77263a4322 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:38:08.556972 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-885a0de2-98fb-4d2e-b41f-b3d951587026 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/9e5f28fa-4760-4b58-826f-ff77263a4322" status: 404 len: 109 microversion: 2.1 time: 0.073612 Oct 18 15:38:08.562475 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1502/3057] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:38:08 2022] DELETE /compute/v2.1/flavors/9e5f28fa-4760-4b58-826f-ff77263a4322 => generated 109 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:38:08.567681 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-67aee22c-4fab-411c-a8d0-96b44ef6e636 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:08.595419 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-67aee22c-4fab-411c-a8d0-96b44ef6e636 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] [instance: 994c2ba1-98f1-4d00-8753-00e39d56d433] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:08.639635 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67aee22c-4fab-411c-a8d0-96b44ef6e636 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:08.654002 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67aee22c-4fab-411c-a8d0-96b44ef6e636 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:08.654862 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67aee22c-4fab-411c-a8d0-96b44ef6e636 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:08.655942 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67aee22c-4fab-411c-a8d0-96b44ef6e636 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:08.656764 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67aee22c-4fab-411c-a8d0-96b44ef6e636 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:08.657551 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67aee22c-4fab-411c-a8d0-96b44ef6e636 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:08.663938 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:38:09.567834 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-67aee22c-4fab-411c-a8d0-96b44ef6e636 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e520e6eb21fb48958a2e1026be086543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d20041d87447e2b959a169637c428b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:09.579655 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-67aee22c-4fab-411c-a8d0-96b44ef6e636 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] 10.222.0.60 "GET /compute/v2.1/servers/994c2ba1-98f1-4d00-8753-00e39d56d433" status: 200 len: 1348 microversion: 2.1 time: 1.015416 Oct 18 15:38:09.581875 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1503/3058] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:08 2022] GET /compute/v2.1/servers/994c2ba1-98f1-4d00-8753-00e39d56d433 => generated 1348 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:09.595182 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f26691d3-903b-46af-94d3-62a3afcb9743 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1839748210", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:38:11.261691 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=10 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:38:11.322919 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=10 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:38:12.023191 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:38:12.542105 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8e893db5-3bd1-48d6-9836-759432f50bef tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "GET /compute/v2.1/images/8c7b241d-0275-49f6-be6f-40e1e7c6411a" status: 200 len: 1428 microversion: 2.1 time: 4.988608 Oct 18 15:38:12.542105 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1556/3059] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:38:07 2022] GET /compute/v2.1/images/8c7b241d-0275-49f6-be6f-40e1e7c6411a => generated 1428 bytes in 4990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:12.562668 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d2c606ab-240d-473b-8cb2-5cc9e0597006 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:12.563286 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d2c606ab-240d-473b-8cb2-5cc9e0597006 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:12.574455 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-f26691d3-903b-46af-94d3-62a3afcb9743 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] validate_networks() for None {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:38:12.582659 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:38:12.585221 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d2c606ab-240d-473b-8cb2-5cc9e0597006 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:12.585716 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d2c606ab-240d-473b-8cb2-5cc9e0597006 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:12.589875 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d2c606ab-240d-473b-8cb2-5cc9e0597006 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:12.591609 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d2c606ab-240d-473b-8cb2-5cc9e0597006 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:12.592375 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d2c606ab-240d-473b-8cb2-5cc9e0597006 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:12.594279 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d2c606ab-240d-473b-8cb2-5cc9e0597006 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:12.943800 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d2c606ab-240d-473b-8cb2-5cc9e0597006 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:12.951657 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d2c606ab-240d-473b-8cb2-5cc9e0597006 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca" status: 200 len: 1525 microversion: 2.1 time: 0.398645 Oct 18 15:38:12.956165 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1557/3060] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:12 2022] GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca => generated 1525 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:13.014915 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-f26691d3-903b-46af-94d3-62a3afcb9743 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:38:13.015625 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-f26691d3-903b-46af-94d3-62a3afcb9743 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:38:13.016152 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-f26691d3-903b-46af-94d3-62a3afcb9743 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:38:13.016745 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-f26691d3-903b-46af-94d3-62a3afcb9743 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:38:13.017401 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-f26691d3-903b-46af-94d3-62a3afcb9743 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:38:13.035704 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f26691d3-903b-46af-94d3-62a3afcb9743 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:13.041332 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f26691d3-903b-46af-94d3-62a3afcb9743 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:13.042642 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f26691d3-903b-46af-94d3-62a3afcb9743 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:13.046129 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f26691d3-903b-46af-94d3-62a3afcb9743 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:13.047457 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f26691d3-903b-46af-94d3-62a3afcb9743 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:13.053721 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f26691d3-903b-46af-94d3-62a3afcb9743 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:13.103020 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-f26691d3-903b-46af-94d3-62a3afcb9743 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Getting quotas for project 91719d2b1f1640f391aa0b54c9725d2a. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:38:13.152621 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-f26691d3-903b-46af-94d3-62a3afcb9743 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Getting quotas for user 926f2a98aa66431fab2a6032f21d5ae7 and project 91719d2b1f1640f391aa0b54c9725d2a. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:38:13.205653 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f26691d3-903b-46af-94d3-62a3afcb9743 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:38:13.220312 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f26691d3-903b-46af-94d3-62a3afcb9743 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: d280f396-df42-482a-b0c1-9a8a9b608f57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:38:13.302765 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f97d9fd7-7fa7-47bd-831c-9193edd6ee56 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-782542226", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "1d57134f-a7f7-40a2-9b98-ada13384a5ff"}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:38:13.351037 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f26691d3-903b-46af-94d3-62a3afcb9743 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.766669 Oct 18 15:38:13.352085 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1504/3061] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:38:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 3769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:38:13.357078 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-b0db2d91-f55f-4ba3-a295-32e5c2ccbfb8 req-fbb2b995-8a13-4008-a6a4-8ce509b2ada5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "004539c4-260d-46a9-beed-d9c4b9a76106", "name": "network-vif-plugged", "status": "completed", "tag": "7e81b5b0-1e7e-436b-84c7-bab9312ea51d"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:38:13.368161 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b0db2d91-f55f-4ba3-a295-32e5c2ccbfb8 req-fbb2b995-8a13-4008-a6a4-8ce509b2ada5 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:13.368658 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b0db2d91-f55f-4ba3-a295-32e5c2ccbfb8 req-fbb2b995-8a13-4008-a6a4-8ce509b2ada5 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:13.370078 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b0db2d91-f55f-4ba3-a295-32e5c2ccbfb8 req-fbb2b995-8a13-4008-a6a4-8ce509b2ada5 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:13.383527 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-b0db2d91-f55f-4ba3-a295-32e5c2ccbfb8 req-fbb2b995-8a13-4008-a6a4-8ce509b2ada5 service nova] Creating event network-vif-plugged:7e81b5b0-1e7e-436b-84c7-bab9312ea51d for instance 004539c4-260d-46a9-beed-d9c4b9a76106 on n-h1-853682-5 Oct 18 15:38:13.391151 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-b0db2d91-f55f-4ba3-a295-32e5c2ccbfb8 req-fbb2b995-8a13-4008-a6a4-8ce509b2ada5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037792 Oct 18 15:38:13.399265 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1505/3062] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:38:13.406284 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-60afe5f6-b0f7-4036-bdb8-1f50e5b50ad4 req-c906422c-29bb-43ea-b8b4-4e89b6eeab95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "994c2ba1-98f1-4d00-8753-00e39d56d433", "tag": "220c5574-a181-4443-af0c-350e480aae57"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:38:13.424054 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-60afe5f6-b0f7-4036-bdb8-1f50e5b50ad4 req-c906422c-29bb-43ea-b8b4-4e89b6eeab95 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:13.424791 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-60afe5f6-b0f7-4036-bdb8-1f50e5b50ad4 req-c906422c-29bb-43ea-b8b4-4e89b6eeab95 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:13.425454 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-60afe5f6-b0f7-4036-bdb8-1f50e5b50ad4 req-c906422c-29bb-43ea-b8b4-4e89b6eeab95 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:13.439335 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-60afe5f6-b0f7-4036-bdb8-1f50e5b50ad4 req-c906422c-29bb-43ea-b8b4-4e89b6eeab95 service nova] Creating event network-changed:220c5574-a181-4443-af0c-350e480aae57 for instance 994c2ba1-98f1-4d00-8753-00e39d56d433 on n-h2-853682-5 Oct 18 15:38:13.454284 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-f97d9fd7-7fa7-47bd-831c-9193edd6ee56 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] validate_networks() for [('1d57134f-a7f7-40a2-9b98-ada13384a5ff', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:38:13.462230 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-60afe5f6-b0f7-4036-bdb8-1f50e5b50ad4 req-c906422c-29bb-43ea-b8b4-4e89b6eeab95 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059673 Oct 18 15:38:13.463962 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1506/3063] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:38:13.470313 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-692d1219-5512-49d4-b692-02301b754219 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:13.471124 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-692d1219-5512-49d4-b692-02301b754219 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] [instance: 994c2ba1-98f1-4d00-8753-00e39d56d433] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:13.478716 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-692d1219-5512-49d4-b692-02301b754219 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:13.479453 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-692d1219-5512-49d4-b692-02301b754219 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:13.480071 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-692d1219-5512-49d4-b692-02301b754219 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:13.481205 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-692d1219-5512-49d4-b692-02301b754219 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:13.482104 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-692d1219-5512-49d4-b692-02301b754219 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:13.482759 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-692d1219-5512-49d4-b692-02301b754219 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:14.336364 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-692d1219-5512-49d4-b692-02301b754219 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e520e6eb21fb48958a2e1026be086543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d20041d87447e2b959a169637c428b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:14.353651 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-692d1219-5512-49d4-b692-02301b754219 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] 10.222.0.60 "GET /compute/v2.1/servers/994c2ba1-98f1-4d00-8753-00e39d56d433" status: 200 len: 1348 microversion: 2.1 time: 0.887512 Oct 18 15:38:14.354914 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1507/3064] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:13 2022] GET /compute/v2.1/servers/994c2ba1-98f1-4d00-8753-00e39d56d433 => generated 1348 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:14.368516 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-12e89296-f043-4cc3-ba15-16105a4783ab tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4026a578-7ecb-4e1b-93a9-db1744efc83e"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:38:14.376733 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-12e89296-f043-4cc3-ba15-16105a4783ab tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 52d725f3-b4da-4831-9abf-bf7aba8aee0a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:14.392360 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-12e89296-f043-4cc3-ba15-16105a4783ab tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:14.395376 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-12e89296-f043-4cc3-ba15-16105a4783ab tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:14.396121 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-12e89296-f043-4cc3-ba15-16105a4783ab tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:14.397079 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-12e89296-f043-4cc3-ba15-16105a4783ab tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:14.398632 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-12e89296-f043-4cc3-ba15-16105a4783ab tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:14.400356 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-12e89296-f043-4cc3-ba15-16105a4783ab tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:15.069514 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-12e89296-f043-4cc3-ba15-16105a4783ab tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "POST /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.709815 Oct 18 15:38:15.105023 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1508/3065] 10.222.0.60 () {60 vars in 1323 bytes} [Tue Oct 18 15:38:14 2022] POST /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a/os-volume_attachments => generated 194 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:38:15.120866 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d1a4e1ba-3841-409e-bdfe-5bf1dbd1c8c3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:15.128864 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d1a4e1ba-3841-409e-bdfe-5bf1dbd1c8c3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: d280f396-df42-482a-b0c1-9a8a9b608f57] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:15.164187 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1a4e1ba-3841-409e-bdfe-5bf1dbd1c8c3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:15.164688 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1a4e1ba-3841-409e-bdfe-5bf1dbd1c8c3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:15.165332 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1a4e1ba-3841-409e-bdfe-5bf1dbd1c8c3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:15.166834 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1a4e1ba-3841-409e-bdfe-5bf1dbd1c8c3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:15.167462 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1a4e1ba-3841-409e-bdfe-5bf1dbd1c8c3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:15.174099 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1a4e1ba-3841-409e-bdfe-5bf1dbd1c8c3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:15.359073 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d1a4e1ba-3841-409e-bdfe-5bf1dbd1c8c3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:15.378680 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d1a4e1ba-3841-409e-bdfe-5bf1dbd1c8c3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57" status: 200 len: 1265 microversion: 2.1 time: 0.270620 Oct 18 15:38:15.380621 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1509/3066] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:15 2022] GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57 => generated 1265 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:15.394199 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8b4d4c55-b45c-4975-b7da-726a6d6df8de tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '.version_select at 0x7f7c3d01f3a0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:15.531972 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8b4d4c55-b45c-4975-b7da-726a6d6df8de tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "GET /compute/v2.1/images/8c7b241d-0275-49f6-be6f-40e1e7c6411a" status: 200 len: 1428 microversion: 2.1 time: 0.149645 Oct 18 15:38:15.535313 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1510/3067] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:38:15 2022] GET /compute/v2.1/images/8c7b241d-0275-49f6-be6f-40e1e7c6411a => generated 1428 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:15.546380 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-94503dec-81a1-40ef-8f95-4c43d3f59fc7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:15.550494 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-94503dec-81a1-40ef-8f95-4c43d3f59fc7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:15.582105 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94503dec-81a1-40ef-8f95-4c43d3f59fc7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:15.589165 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94503dec-81a1-40ef-8f95-4c43d3f59fc7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:15.589915 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94503dec-81a1-40ef-8f95-4c43d3f59fc7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:15.591624 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94503dec-81a1-40ef-8f95-4c43d3f59fc7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:15.595438 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94503dec-81a1-40ef-8f95-4c43d3f59fc7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:15.597356 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94503dec-81a1-40ef-8f95-4c43d3f59fc7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:15.762572 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-f97d9fd7-7fa7-47bd-831c-9193edd6ee56 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:38:15.766382 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-f97d9fd7-7fa7-47bd-831c-9193edd6ee56 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:38:15.767373 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-f97d9fd7-7fa7-47bd-831c-9193edd6ee56 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:38:15.768162 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-f97d9fd7-7fa7-47bd-831c-9193edd6ee56 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:38:15.769088 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-f97d9fd7-7fa7-47bd-831c-9193edd6ee56 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:38:15.801217 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f97d9fd7-7fa7-47bd-831c-9193edd6ee56 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:15.802283 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f97d9fd7-7fa7-47bd-831c-9193edd6ee56 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:15.803455 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f97d9fd7-7fa7-47bd-831c-9193edd6ee56 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:15.804552 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f97d9fd7-7fa7-47bd-831c-9193edd6ee56 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:15.805289 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f97d9fd7-7fa7-47bd-831c-9193edd6ee56 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:15.805935 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f97d9fd7-7fa7-47bd-831c-9193edd6ee56 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:15.829300 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-f97d9fd7-7fa7-47bd-831c-9193edd6ee56 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Getting quotas for project c1a84f93ce8049c3a20c3b835f28100f. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:38:15.847731 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-f97d9fd7-7fa7-47bd-831c-9193edd6ee56 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Getting quotas for user 1e7ebe0c265144769931ca6262be8860 and project c1a84f93ce8049c3a20c3b835f28100f. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:38:15.866856 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f97d9fd7-7fa7-47bd-831c-9193edd6ee56 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:38:15.869560 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f97d9fd7-7fa7-47bd-831c-9193edd6ee56 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] [instance: 7ae6ac1e-7345-4096-9816-a53e90d88447] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:38:15.934643 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f97d9fd7-7fa7-47bd-831c-9193edd6ee56 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.977268 Oct 18 15:38:15.936250 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1558/3068] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:38:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2979 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:38:15.942004 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-eaf2fa37-d0bd-4d71-95d6-51f1cdd1d6e2 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:15.943144 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-eaf2fa37-d0bd-4d71-95d6-51f1cdd1d6e2 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] [instance: 994c2ba1-98f1-4d00-8753-00e39d56d433] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:15.951296 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eaf2fa37-d0bd-4d71-95d6-51f1cdd1d6e2 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:15.952317 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eaf2fa37-d0bd-4d71-95d6-51f1cdd1d6e2 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:15.953177 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eaf2fa37-d0bd-4d71-95d6-51f1cdd1d6e2 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:15.954138 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eaf2fa37-d0bd-4d71-95d6-51f1cdd1d6e2 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:15.955208 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eaf2fa37-d0bd-4d71-95d6-51f1cdd1d6e2 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:15.956249 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eaf2fa37-d0bd-4d71-95d6-51f1cdd1d6e2 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:16.520931 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-eaf2fa37-d0bd-4d71-95d6-51f1cdd1d6e2 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e520e6eb21fb48958a2e1026be086543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d20041d87447e2b959a169637c428b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:16.544269 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-eaf2fa37-d0bd-4d71-95d6-51f1cdd1d6e2 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] 10.222.0.60 "GET /compute/v2.1/servers/994c2ba1-98f1-4d00-8753-00e39d56d433" status: 200 len: 1348 microversion: 2.1 time: 0.595271 Oct 18 15:38:16.544966 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1559/3069] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:15 2022] GET /compute/v2.1/servers/994c2ba1-98f1-4d00-8753-00e39d56d433 => generated 1348 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:16.568759 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-ec8632fe-a930-44ae-a52f-2c5c76529280 req-7dc8d097-0d8c-4e4d-9ebd-45c5f50b5a93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12e415d7-7c40-41a0-957a-a083dbcf2b43", "name": "network-vif-plugged", "status": "completed", "tag": "0007790a-c337-4a61-8c95-ee14bba9c445"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:38:16.610069 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-ec8632fe-a930-44ae-a52f-2c5c76529280 req-7dc8d097-0d8c-4e4d-9ebd-45c5f50b5a93 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:16.610570 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-ec8632fe-a930-44ae-a52f-2c5c76529280 req-7dc8d097-0d8c-4e4d-9ebd-45c5f50b5a93 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:16.617663 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-ec8632fe-a930-44ae-a52f-2c5c76529280 req-7dc8d097-0d8c-4e4d-9ebd-45c5f50b5a93 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:16.648000 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-ec8632fe-a930-44ae-a52f-2c5c76529280 req-7dc8d097-0d8c-4e4d-9ebd-45c5f50b5a93 service nova] Creating event network-vif-plugged:0007790a-c337-4a61-8c95-ee14bba9c445 for instance 12e415d7-7c40-41a0-957a-a083dbcf2b43 on n-h2-853682-5 Oct 18 15:38:16.667514 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-ec8632fe-a930-44ae-a52f-2c5c76529280 req-7dc8d097-0d8c-4e4d-9ebd-45c5f50b5a93 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121086 Oct 18 15:38:16.672489 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1560/3070] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:38:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:38:16.677819 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ef249fc5-59da-474e-ba18-818d178a8a83 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:16.678527 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ef249fc5-59da-474e-ba18-818d178a8a83 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] [instance: 7ae6ac1e-7345-4096-9816-a53e90d88447] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:16.816410 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ef249fc5-59da-474e-ba18-818d178a8a83 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7ebe0c265144769931ca6262be8860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a84f93ce8049c3a20c3b835f28100f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:16.832067 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ef249fc5-59da-474e-ba18-818d178a8a83 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] 10.222.0.60 "GET /compute/v2.1/servers/7ae6ac1e-7345-4096-9816-a53e90d88447" status: 200 len: 1223 microversion: 2.1 time: 0.158164 Oct 18 15:38:16.832964 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1561/3071] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:16 2022] GET /compute/v2.1/servers/7ae6ac1e-7345-4096-9816-a53e90d88447 => generated 1223 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:16.838394 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-13c1051c-ef1d-4b41-90ab-a9c4c1be41d9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:16.845490 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-13c1051c-ef1d-4b41-90ab-a9c4c1be41d9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: d280f396-df42-482a-b0c1-9a8a9b608f57] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:16.852834 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-13c1051c-ef1d-4b41-90ab-a9c4c1be41d9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:16.861101 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-13c1051c-ef1d-4b41-90ab-a9c4c1be41d9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:16.861772 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-13c1051c-ef1d-4b41-90ab-a9c4c1be41d9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:16.862705 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-13c1051c-ef1d-4b41-90ab-a9c4c1be41d9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:16.863330 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-13c1051c-ef1d-4b41-90ab-a9c4c1be41d9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:16.863919 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-13c1051c-ef1d-4b41-90ab-a9c4c1be41d9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:16.904583 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-94503dec-81a1-40ef-8f95-4c43d3f59fc7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:16.917879 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-94503dec-81a1-40ef-8f95-4c43d3f59fc7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca" status: 200 len: 1507 microversion: 2.1 time: 1.381429 Oct 18 15:38:16.942326 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1511/3072] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:15 2022] GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca => generated 1507 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:16.975237 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7532ecf4-4934-4f38-a0b2-f89e0ad59606 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '.version_select at 0x7f7c3d679700>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:17.095132 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7532ecf4-4934-4f38-a0b2-f89e0ad59606 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "GET /compute/v2.1/images/8c7b241d-0275-49f6-be6f-40e1e7c6411a" status: 200 len: 1428 microversion: 2.1 time: 0.155075 Oct 18 15:38:17.108215 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1512/3073] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:38:16 2022] GET /compute/v2.1/images/8c7b241d-0275-49f6-be6f-40e1e7c6411a => generated 1428 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:17.528480 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-13c1051c-ef1d-4b41-90ab-a9c4c1be41d9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:17.556242 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-13c1051c-ef1d-4b41-90ab-a9c4c1be41d9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57" status: 200 len: 1271 microversion: 2.1 time: 0.721721 Oct 18 15:38:17.566260 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1562/3074] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:16 2022] GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57 => generated 1271 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:17.572915 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-56a4a3b7-dd76-49d7-83e2-d8e8854d4758 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:17.573532 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-56a4a3b7-dd76-49d7-83e2-d8e8854d4758 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] [instance: 994c2ba1-98f1-4d00-8753-00e39d56d433] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:17.592542 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-56a4a3b7-dd76-49d7-83e2-d8e8854d4758 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:17.598960 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-56a4a3b7-dd76-49d7-83e2-d8e8854d4758 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:17.601085 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-56a4a3b7-dd76-49d7-83e2-d8e8854d4758 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:17.602043 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-56a4a3b7-dd76-49d7-83e2-d8e8854d4758 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:17.606571 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-56a4a3b7-dd76-49d7-83e2-d8e8854d4758 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:17.607311 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-56a4a3b7-dd76-49d7-83e2-d8e8854d4758 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:17.855837 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ee3ff756-a6e3-4df8-81cd-fb385e173a92 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:17.864241 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ee3ff756-a6e3-4df8-81cd-fb385e173a92 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] [instance: 7ae6ac1e-7345-4096-9816-a53e90d88447] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:17.881919 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ee3ff756-a6e3-4df8-81cd-fb385e173a92 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:17.885523 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ee3ff756-a6e3-4df8-81cd-fb385e173a92 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:17.886090 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ee3ff756-a6e3-4df8-81cd-fb385e173a92 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:17.889371 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ee3ff756-a6e3-4df8-81cd-fb385e173a92 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:17.891959 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ee3ff756-a6e3-4df8-81cd-fb385e173a92 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:17.892912 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ee3ff756-a6e3-4df8-81cd-fb385e173a92 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:18.022788 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-56a4a3b7-dd76-49d7-83e2-d8e8854d4758 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e520e6eb21fb48958a2e1026be086543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d20041d87447e2b959a169637c428b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:18.034693 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-56a4a3b7-dd76-49d7-83e2-d8e8854d4758 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] 10.222.0.60 "GET /compute/v2.1/servers/994c2ba1-98f1-4d00-8753-00e39d56d433" status: 200 len: 1348 microversion: 2.1 time: 0.467445 Oct 18 15:38:18.057756 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1513/3075] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:17 2022] GET /compute/v2.1/servers/994c2ba1-98f1-4d00-8753-00e39d56d433 => generated 1348 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:38:18.064248 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a2600f0a-926c-4ac1-9145-f83fed9abc77 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:18.073050 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a2600f0a-926c-4ac1-9145-f83fed9abc77 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:18.089732 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2600f0a-926c-4ac1-9145-f83fed9abc77 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:18.091888 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2600f0a-926c-4ac1-9145-f83fed9abc77 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:18.093864 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2600f0a-926c-4ac1-9145-f83fed9abc77 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:18.094881 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2600f0a-926c-4ac1-9145-f83fed9abc77 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:18.097002 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2600f0a-926c-4ac1-9145-f83fed9abc77 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:18.098045 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2600f0a-926c-4ac1-9145-f83fed9abc77 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:18.163920 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ee3ff756-a6e3-4df8-81cd-fb385e173a92 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7ebe0c265144769931ca6262be8860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a84f93ce8049c3a20c3b835f28100f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:18.178297 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ee3ff756-a6e3-4df8-81cd-fb385e173a92 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] 10.222.0.60 "GET /compute/v2.1/servers/7ae6ac1e-7345-4096-9816-a53e90d88447" status: 200 len: 1275 microversion: 2.1 time: 0.323340 Oct 18 15:38:18.179806 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1563/3076] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:17 2022] GET /compute/v2.1/servers/7ae6ac1e-7345-4096-9816-a53e90d88447 => generated 1275 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:38:18.194016 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e1db4e5c-d7b6-4f57-a211-cf3eaf488995 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '.version_select at 0x7f7c3d37adc0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:18.290806 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e1db4e5c-d7b6-4f57-a211-cf3eaf488995 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "GET /compute/v2.1/images/8c7b241d-0275-49f6-be6f-40e1e7c6411a" status: 200 len: 1428 microversion: 2.1 time: 0.109687 Oct 18 15:38:18.292076 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1564/3077] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:38:18 2022] GET /compute/v2.1/images/8c7b241d-0275-49f6-be6f-40e1e7c6411a => generated 1428 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:18.594691 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c94bd6b2-840f-4159-b798-1adcaf75bc47 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:18.596567 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c94bd6b2-840f-4159-b798-1adcaf75bc47 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: d280f396-df42-482a-b0c1-9a8a9b608f57] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:18.613152 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c94bd6b2-840f-4159-b798-1adcaf75bc47 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:18.617167 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c94bd6b2-840f-4159-b798-1adcaf75bc47 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:18.619488 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c94bd6b2-840f-4159-b798-1adcaf75bc47 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:18.623153 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c94bd6b2-840f-4159-b798-1adcaf75bc47 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:18.625969 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c94bd6b2-840f-4159-b798-1adcaf75bc47 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:18.632063 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c94bd6b2-840f-4159-b798-1adcaf75bc47 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:19.182912 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c94bd6b2-840f-4159-b798-1adcaf75bc47 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:19.192396 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c94bd6b2-840f-4159-b798-1adcaf75bc47 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57" status: 200 len: 1271 microversion: 2.1 time: 0.601882 Oct 18 15:38:19.205845 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1565/3078] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:18 2022] GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57 => generated 1271 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:38:19.225129 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-3bb847d7-501f-4746-be77-99cb7a8fa457 req-0e297760-ce6e-4187-9432-e5e2febd1857 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "994c2ba1-98f1-4d00-8753-00e39d56d433", "name": "network-vif-plugged", "status": "completed", "tag": "220c5574-a181-4443-af0c-350e480aae57"}, {"server_uuid": "a5c710aa-e860-4b2c-a59b-c25202c621ca", "name": "network-vif-unplugged", "status": "completed", "tag": "e2a2e036-76b0-46b5-8c98-0566f70d8b58"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:38:19.285188 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-3bb847d7-501f-4746-be77-99cb7a8fa457 req-0e297760-ce6e-4187-9432-e5e2febd1857 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:19.285720 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-3bb847d7-501f-4746-be77-99cb7a8fa457 req-0e297760-ce6e-4187-9432-e5e2febd1857 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:19.286178 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-3bb847d7-501f-4746-be77-99cb7a8fa457 req-0e297760-ce6e-4187-9432-e5e2febd1857 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:19.359947 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-3bb847d7-501f-4746-be77-99cb7a8fa457 req-0e297760-ce6e-4187-9432-e5e2febd1857 service nova] Creating event network-vif-plugged:220c5574-a181-4443-af0c-350e480aae57 for instance 994c2ba1-98f1-4d00-8753-00e39d56d433 on n-h2-853682-5 Oct 18 15:38:19.361545 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-3bb847d7-501f-4746-be77-99cb7a8fa457 req-0e297760-ce6e-4187-9432-e5e2febd1857 service nova] Creating event network-vif-unplugged:e2a2e036-76b0-46b5-8c98-0566f70d8b58 for instance a5c710aa-e860-4b2c-a59b-c25202c621ca on n-h2-853682-5 Oct 18 15:38:19.387211 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-3bb847d7-501f-4746-be77-99cb7a8fa457 req-0e297760-ce6e-4187-9432-e5e2febd1857 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.185108 Oct 18 15:38:19.388437 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1566/3079] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:38:19.399731 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-49d3c340-595e-41e0-804c-942b336e08d0 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:19.409944 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-49d3c340-595e-41e0-804c-942b336e08d0 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] [instance: 994c2ba1-98f1-4d00-8753-00e39d56d433] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:19.425340 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-49d3c340-595e-41e0-804c-942b336e08d0 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:19.433299 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-49d3c340-595e-41e0-804c-942b336e08d0 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:19.437538 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-49d3c340-595e-41e0-804c-942b336e08d0 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:19.441784 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-49d3c340-595e-41e0-804c-942b336e08d0 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:19.445693 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-49d3c340-595e-41e0-804c-942b336e08d0 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:19.446443 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-49d3c340-595e-41e0-804c-942b336e08d0 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:19.510811 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a2600f0a-926c-4ac1-9145-f83fed9abc77 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:19.525047 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a2600f0a-926c-4ac1-9145-f83fed9abc77 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca" status: 200 len: 1507 microversion: 2.1 time: 1.465675 Oct 18 15:38:19.544363 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1514/3080] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:18 2022] GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca => generated 1507 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:19.560181 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b6ce7e61-766c-4395-938e-dd5da1f796a2 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:19.562954 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b6ce7e61-766c-4395-938e-dd5da1f796a2 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] [instance: 7ae6ac1e-7345-4096-9816-a53e90d88447] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:19.580365 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b6ce7e61-766c-4395-938e-dd5da1f796a2 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:19.581738 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b6ce7e61-766c-4395-938e-dd5da1f796a2 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:19.582189 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b6ce7e61-766c-4395-938e-dd5da1f796a2 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:19.582906 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b6ce7e61-766c-4395-938e-dd5da1f796a2 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:19.585987 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b6ce7e61-766c-4395-938e-dd5da1f796a2 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:19.586446 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b6ce7e61-766c-4395-938e-dd5da1f796a2 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:19.803797 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b6ce7e61-766c-4395-938e-dd5da1f796a2 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7ebe0c265144769931ca6262be8860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a84f93ce8049c3a20c3b835f28100f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:19.846538 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b6ce7e61-766c-4395-938e-dd5da1f796a2 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] 10.222.0.60 "GET /compute/v2.1/servers/7ae6ac1e-7345-4096-9816-a53e90d88447" status: 200 len: 1281 microversion: 2.1 time: 0.283281 Oct 18 15:38:19.872535 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1515/3081] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:19 2022] GET /compute/v2.1/servers/7ae6ac1e-7345-4096-9816-a53e90d88447 => generated 1281 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:19.890055 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-90b97861-a4e2-4349-a92c-db19e52b27ce tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '.version_select at 0x7f7c3d5c18b0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:20.048697 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-90b97861-a4e2-4349-a92c-db19e52b27ce tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "GET /compute/v2.1/images/8c7b241d-0275-49f6-be6f-40e1e7c6411a" status: 200 len: 1428 microversion: 2.1 time: 0.171831 Oct 18 15:38:20.051062 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1516/3082] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:38:19 2022] GET /compute/v2.1/images/8c7b241d-0275-49f6-be6f-40e1e7c6411a => generated 1428 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:20.220096 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-230b9197-ddc4-466c-bd45-fa7e220e6025 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:20.220731 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-230b9197-ddc4-466c-bd45-fa7e220e6025 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: d280f396-df42-482a-b0c1-9a8a9b608f57] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:20.251232 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-230b9197-ddc4-466c-bd45-fa7e220e6025 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:20.258708 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-230b9197-ddc4-466c-bd45-fa7e220e6025 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:20.259831 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-230b9197-ddc4-466c-bd45-fa7e220e6025 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:20.261705 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-230b9197-ddc4-466c-bd45-fa7e220e6025 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:20.265489 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-230b9197-ddc4-466c-bd45-fa7e220e6025 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:20.266946 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-230b9197-ddc4-466c-bd45-fa7e220e6025 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:20.601813 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-49d3c340-595e-41e0-804c-942b336e08d0 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e520e6eb21fb48958a2e1026be086543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d20041d87447e2b959a169637c428b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:20.612609 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-49d3c340-595e-41e0-804c-942b336e08d0 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] 10.222.0.60 "GET /compute/v2.1/servers/994c2ba1-98f1-4d00-8753-00e39d56d433" status: 200 len: 1348 microversion: 2.1 time: 1.222715 Oct 18 15:38:20.613236 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1567/3083] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:19 2022] GET /compute/v2.1/servers/994c2ba1-98f1-4d00-8753-00e39d56d433 => generated 1348 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:20.628452 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d8b48f54-5330-4cab-8434-5251d392b63d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:20.629113 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d8b48f54-5330-4cab-8434-5251d392b63d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:20.653826 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d8b48f54-5330-4cab-8434-5251d392b63d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:20.654322 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d8b48f54-5330-4cab-8434-5251d392b63d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:20.657773 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d8b48f54-5330-4cab-8434-5251d392b63d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:20.658594 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d8b48f54-5330-4cab-8434-5251d392b63d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:20.659081 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d8b48f54-5330-4cab-8434-5251d392b63d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:20.659524 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d8b48f54-5330-4cab-8434-5251d392b63d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:21.257435 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-230b9197-ddc4-466c-bd45-fa7e220e6025 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:21.270589 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-230b9197-ddc4-466c-bd45-fa7e220e6025 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57" status: 200 len: 1313 microversion: 2.1 time: 1.054796 Oct 18 15:38:21.276488 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1517/3084] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:20 2022] GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57 => generated 1313 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:21.291946 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3e90d2b1-2ac2-4597-9274-c6236c3968e9 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:21.294493 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3e90d2b1-2ac2-4597-9274-c6236c3968e9 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] [instance: 7ae6ac1e-7345-4096-9816-a53e90d88447] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:21.309463 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e90d2b1-2ac2-4597-9274-c6236c3968e9 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:21.310237 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e90d2b1-2ac2-4597-9274-c6236c3968e9 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:21.310845 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e90d2b1-2ac2-4597-9274-c6236c3968e9 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:21.319486 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e90d2b1-2ac2-4597-9274-c6236c3968e9 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:21.321231 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e90d2b1-2ac2-4597-9274-c6236c3968e9 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:21.323209 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e90d2b1-2ac2-4597-9274-c6236c3968e9 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:21.619310 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d8b48f54-5330-4cab-8434-5251d392b63d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:21.633775 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d8b48f54-5330-4cab-8434-5251d392b63d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca" status: 200 len: 1507 microversion: 2.1 time: 1.019485 Oct 18 15:38:21.651680 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1568/3085] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:20 2022] GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca => generated 1507 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:21.663423 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-30dce522-6659-4686-9a50-b5bec48187f1 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '.version_select at 0x7f7c3d3ea4c0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:21.748756 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-30dce522-6659-4686-9a50-b5bec48187f1 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "GET /compute/v2.1/images/8c7b241d-0275-49f6-be6f-40e1e7c6411a" status: 200 len: 1428 microversion: 2.1 time: 0.090191 Oct 18 15:38:21.755420 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1569/3086] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:38:21 2022] GET /compute/v2.1/images/8c7b241d-0275-49f6-be6f-40e1e7c6411a => generated 1428 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:21.759703 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3e90d2b1-2ac2-4597-9274-c6236c3968e9 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7ebe0c265144769931ca6262be8860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a84f93ce8049c3a20c3b835f28100f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:21.771782 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-879f1552-388f-4d15-8273-6575d95b7cda req-c31e2905-e068-4389-b089-0ac9c6dbbfa1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5c710aa-e860-4b2c-a59b-c25202c621ca", "tag": "e2a2e036-76b0-46b5-8c98-0566f70d8b58"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:38:21.772458 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3e90d2b1-2ac2-4597-9274-c6236c3968e9 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] 10.222.0.60 "GET /compute/v2.1/servers/7ae6ac1e-7345-4096-9816-a53e90d88447" status: 200 len: 1281 microversion: 2.1 time: 0.489797 Oct 18 15:38:21.794530 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1518/3087] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:21 2022] GET /compute/v2.1/servers/7ae6ac1e-7345-4096-9816-a53e90d88447 => generated 1281 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:21.816189 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b280c906-6b06-47bc-8d6a-a30e940a4125 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:21.817096 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b280c906-6b06-47bc-8d6a-a30e940a4125 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] [instance: 994c2ba1-98f1-4d00-8753-00e39d56d433] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:21.822970 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-879f1552-388f-4d15-8273-6575d95b7cda req-c31e2905-e068-4389-b089-0ac9c6dbbfa1 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:21.826329 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-879f1552-388f-4d15-8273-6575d95b7cda req-c31e2905-e068-4389-b089-0ac9c6dbbfa1 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:21.833915 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-879f1552-388f-4d15-8273-6575d95b7cda req-c31e2905-e068-4389-b089-0ac9c6dbbfa1 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:21.846521 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b280c906-6b06-47bc-8d6a-a30e940a4125 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:21.850768 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b280c906-6b06-47bc-8d6a-a30e940a4125 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:21.851565 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b280c906-6b06-47bc-8d6a-a30e940a4125 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:21.855344 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b280c906-6b06-47bc-8d6a-a30e940a4125 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:21.855994 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b280c906-6b06-47bc-8d6a-a30e940a4125 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:21.859903 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b280c906-6b06-47bc-8d6a-a30e940a4125 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:21.887200 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-879f1552-388f-4d15-8273-6575d95b7cda req-c31e2905-e068-4389-b089-0ac9c6dbbfa1 service nova] Creating event network-changed:e2a2e036-76b0-46b5-8c98-0566f70d8b58 for instance a5c710aa-e860-4b2c-a59b-c25202c621ca on n-h2-853682-5 Oct 18 15:38:21.899407 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-879f1552-388f-4d15-8273-6575d95b7cda req-c31e2905-e068-4389-b089-0ac9c6dbbfa1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141872 Oct 18 15:38:21.909124 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1570/3088] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:38:22.319925 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b5619830-7d5e-467f-9acb-3649148364b3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:22.320790 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b5619830-7d5e-467f-9acb-3649148364b3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: d280f396-df42-482a-b0c1-9a8a9b608f57] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:22.338668 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b5619830-7d5e-467f-9acb-3649148364b3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:22.339603 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b5619830-7d5e-467f-9acb-3649148364b3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:22.340418 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b5619830-7d5e-467f-9acb-3649148364b3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:22.343738 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b5619830-7d5e-467f-9acb-3649148364b3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:22.345858 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b5619830-7d5e-467f-9acb-3649148364b3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:22.348122 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b5619830-7d5e-467f-9acb-3649148364b3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:22.430117 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b280c906-6b06-47bc-8d6a-a30e940a4125 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e520e6eb21fb48958a2e1026be086543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d20041d87447e2b959a169637c428b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:22.443435 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b280c906-6b06-47bc-8d6a-a30e940a4125 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] 10.222.0.60 "GET /compute/v2.1/servers/994c2ba1-98f1-4d00-8753-00e39d56d433" status: 200 len: 1348 microversion: 2.1 time: 0.647370 Oct 18 15:38:22.445117 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1519/3089] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:21 2022] GET /compute/v2.1/servers/994c2ba1-98f1-4d00-8753-00e39d56d433 => generated 1348 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:22.682776 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e9ac3af7-e49a-4d79-b5fe-6077a8ff5468 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:22.683398 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e9ac3af7-e49a-4d79-b5fe-6077a8ff5468 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:22.694940 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e9ac3af7-e49a-4d79-b5fe-6077a8ff5468 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:22.695426 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e9ac3af7-e49a-4d79-b5fe-6077a8ff5468 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:22.695857 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e9ac3af7-e49a-4d79-b5fe-6077a8ff5468 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:22.721188 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e9ac3af7-e49a-4d79-b5fe-6077a8ff5468 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:22.722029 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e9ac3af7-e49a-4d79-b5fe-6077a8ff5468 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:22.722657 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e9ac3af7-e49a-4d79-b5fe-6077a8ff5468 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:22.976739 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b5619830-7d5e-467f-9acb-3649148364b3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:22.987227 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b5619830-7d5e-467f-9acb-3649148364b3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57" status: 200 len: 1313 microversion: 2.1 time: 0.683301 Oct 18 15:38:22.990042 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1571/3090] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:22 2022] GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57 => generated 1313 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:22.997444 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f6943c3a-f739-48e0-a9a3-674536337a3a tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '.version_select at 0x7f7c3d3b6280>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:23.070113 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:38:23.112143 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f6943c3a-f739-48e0-a9a3-674536337a3a tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "GET /compute/v2.1/images/8c7b241d-0275-49f6-be6f-40e1e7c6411a" status: 200 len: 1428 microversion: 2.1 time: 0.119994 Oct 18 15:38:23.113612 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1572/3091] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:38:22 2022] GET /compute/v2.1/images/8c7b241d-0275-49f6-be6f-40e1e7c6411a => generated 1428 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:23.143052 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-b3a979e0-ca0d-42fd-961c-d5e757812093 req-366ed542-836c-4b43-91a6-7e4188703563 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d280f396-df42-482a-b0c1-9a8a9b608f57", "tag": "f518ff61-30b3-4c0b-a3c2-3c35a22e45aa"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:38:23.171373 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:38:23.178770 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e9ac3af7-e49a-4d79-b5fe-6077a8ff5468 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:23.185159 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-b3a979e0-ca0d-42fd-961c-d5e757812093 req-366ed542-836c-4b43-91a6-7e4188703563 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:23.189307 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-b3a979e0-ca0d-42fd-961c-d5e757812093 req-366ed542-836c-4b43-91a6-7e4188703563 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:23.190286 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-b3a979e0-ca0d-42fd-961c-d5e757812093 req-366ed542-836c-4b43-91a6-7e4188703563 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:23.205539 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e9ac3af7-e49a-4d79-b5fe-6077a8ff5468 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca" status: 200 len: 1507 microversion: 2.1 time: 0.527076 Oct 18 15:38:23.206515 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1520/3092] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:22 2022] GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca => generated 1507 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:23.219067 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-b3a979e0-ca0d-42fd-961c-d5e757812093 req-366ed542-836c-4b43-91a6-7e4188703563 service nova] Creating event network-changed:f518ff61-30b3-4c0b-a3c2-3c35a22e45aa for instance d280f396-df42-482a-b0c1-9a8a9b608f57 on n-h1-853682-5 Oct 18 15:38:23.221135 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-278a216d-9561-4f83-92aa-5f3436c67e0e tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:23.221757 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-278a216d-9561-4f83-92aa-5f3436c67e0e tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] [instance: 7ae6ac1e-7345-4096-9816-a53e90d88447] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:23.234834 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-b3a979e0-ca0d-42fd-961c-d5e757812093 req-366ed542-836c-4b43-91a6-7e4188703563 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119762 Oct 18 15:38:23.236198 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1573/3093] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:38:23.255206 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-278a216d-9561-4f83-92aa-5f3436c67e0e tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:23.255837 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-278a216d-9561-4f83-92aa-5f3436c67e0e tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:23.258960 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-278a216d-9561-4f83-92aa-5f3436c67e0e tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:23.261828 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-278a216d-9561-4f83-92aa-5f3436c67e0e tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:23.263924 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-278a216d-9561-4f83-92aa-5f3436c67e0e tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:23.265052 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-278a216d-9561-4f83-92aa-5f3436c67e0e tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:23.472248 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2f071135-923f-40bd-be11-0e3e77417a93 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:23.473263 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2f071135-923f-40bd-be11-0e3e77417a93 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] [instance: 994c2ba1-98f1-4d00-8753-00e39d56d433] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:23.494242 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2f071135-923f-40bd-be11-0e3e77417a93 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:23.498216 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2f071135-923f-40bd-be11-0e3e77417a93 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:23.499038 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2f071135-923f-40bd-be11-0e3e77417a93 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:23.499963 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2f071135-923f-40bd-be11-0e3e77417a93 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:23.502387 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2f071135-923f-40bd-be11-0e3e77417a93 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:23.502832 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2f071135-923f-40bd-be11-0e3e77417a93 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:24.536166 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2f071135-923f-40bd-be11-0e3e77417a93 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e520e6eb21fb48958a2e1026be086543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d20041d87447e2b959a169637c428b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:24.549894 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2f071135-923f-40bd-be11-0e3e77417a93 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] 10.222.0.60 "GET /compute/v2.1/servers/994c2ba1-98f1-4d00-8753-00e39d56d433" status: 200 len: 1538 microversion: 2.1 time: 1.081983 Oct 18 15:38:24.550831 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1574/3094] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:23 2022] GET /compute/v2.1/servers/994c2ba1-98f1-4d00-8753-00e39d56d433 => generated 1538 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:38:24.562391 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-49fb40a9-3aa3-4f5d-9d8c-477141ac3d89 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:24.563288 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-49fb40a9-3aa3-4f5d-9d8c-477141ac3d89 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: d280f396-df42-482a-b0c1-9a8a9b608f57] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:24.581124 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-49fb40a9-3aa3-4f5d-9d8c-477141ac3d89 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:24.581924 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-49fb40a9-3aa3-4f5d-9d8c-477141ac3d89 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:24.582538 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-49fb40a9-3aa3-4f5d-9d8c-477141ac3d89 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:24.585601 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-49fb40a9-3aa3-4f5d-9d8c-477141ac3d89 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:24.587123 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-49fb40a9-3aa3-4f5d-9d8c-477141ac3d89 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:24.588934 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-49fb40a9-3aa3-4f5d-9d8c-477141ac3d89 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:25.231878 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-278a216d-9561-4f83-92aa-5f3436c67e0e tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7ebe0c265144769931ca6262be8860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a84f93ce8049c3a20c3b835f28100f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:25.252182 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-278a216d-9561-4f83-92aa-5f3436c67e0e tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] 10.222.0.60 "GET /compute/v2.1/servers/7ae6ac1e-7345-4096-9816-a53e90d88447" status: 200 len: 1323 microversion: 2.1 time: 2.044400 Oct 18 15:38:25.267313 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1521/3095] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:23 2022] GET /compute/v2.1/servers/7ae6ac1e-7345-4096-9816-a53e90d88447 => generated 1323 bytes in 2060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:25.288694 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-34e19e7f-0028-4e88-978d-eced706d8c7b tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '.version_select at 0x7f7c3cfd8e50>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:25.293277 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-49fb40a9-3aa3-4f5d-9d8c-477141ac3d89 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:25.304236 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-49fb40a9-3aa3-4f5d-9d8c-477141ac3d89 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57" status: 200 len: 1313 microversion: 2.1 time: 0.751217 Oct 18 15:38:25.307876 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1575/3096] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:24 2022] GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57 => generated 1313 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:25.332119 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3c3e0086-3d24-4b7e-bf3b-93fc889e786a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:25.333275 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3c3e0086-3d24-4b7e-bf3b-93fc889e786a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:25.372259 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3c3e0086-3d24-4b7e-bf3b-93fc889e786a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:25.373293 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3c3e0086-3d24-4b7e-bf3b-93fc889e786a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:25.373769 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3c3e0086-3d24-4b7e-bf3b-93fc889e786a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:25.374522 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3c3e0086-3d24-4b7e-bf3b-93fc889e786a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:25.374999 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3c3e0086-3d24-4b7e-bf3b-93fc889e786a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:25.375434 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3c3e0086-3d24-4b7e-bf3b-93fc889e786a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:25.399864 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-34e19e7f-0028-4e88-978d-eced706d8c7b tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "GET /compute/v2.1/images/8c7b241d-0275-49f6-be6f-40e1e7c6411a" status: 200 len: 1428 microversion: 2.1 time: 0.131268 Oct 18 15:38:25.409234 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1522/3097] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:38:25 2022] GET /compute/v2.1/images/8c7b241d-0275-49f6-be6f-40e1e7c6411a => generated 1428 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:25.432895 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f4fc6c0c-574b-424a-8413-e7d4efe2be31 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:25.435500 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f4fc6c0c-574b-424a-8413-e7d4efe2be31 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] [instance: 994c2ba1-98f1-4d00-8753-00e39d56d433] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:25.478427 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4fc6c0c-574b-424a-8413-e7d4efe2be31 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:25.479065 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4fc6c0c-574b-424a-8413-e7d4efe2be31 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:25.479591 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4fc6c0c-574b-424a-8413-e7d4efe2be31 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:25.481145 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4fc6c0c-574b-424a-8413-e7d4efe2be31 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:25.483381 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4fc6c0c-574b-424a-8413-e7d4efe2be31 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:25.484109 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4fc6c0c-574b-424a-8413-e7d4efe2be31 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:25.754347 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f4fc6c0c-574b-424a-8413-e7d4efe2be31 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] 10.222.0.60 "GET /compute/v2.1/servers/994c2ba1-98f1-4d00-8753-00e39d56d433/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.343604 Oct 18 15:38:25.756139 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1523/3098] 10.222.0.60 () {58 vars in 1275 bytes} [Tue Oct 18 15:38:25 2022] GET /compute/v2.1/servers/994c2ba1-98f1-4d00-8753-00e39d56d433/os-interface => generated 285 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:38:25.771460 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-c347435f-be5c-46d7-9dc9-04567a36b1f0 req-b593919c-c03b-44ea-b711-9da87028d651 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ae6ac1e-7345-4096-9816-a53e90d88447", "tag": "860075d2-73a1-49ad-a68a-e236bf779147"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:38:25.811448 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c347435f-be5c-46d7-9dc9-04567a36b1f0 req-b593919c-c03b-44ea-b711-9da87028d651 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:25.813942 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c347435f-be5c-46d7-9dc9-04567a36b1f0 req-b593919c-c03b-44ea-b711-9da87028d651 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:25.814655 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c347435f-be5c-46d7-9dc9-04567a36b1f0 req-b593919c-c03b-44ea-b711-9da87028d651 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:25.819021 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:38:25.857293 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-c347435f-be5c-46d7-9dc9-04567a36b1f0 req-b593919c-c03b-44ea-b711-9da87028d651 service nova] Creating event network-changed:860075d2-73a1-49ad-a68a-e236bf779147 for instance 7ae6ac1e-7345-4096-9816-a53e90d88447 on n-h2-853682-5 Oct 18 15:38:25.881577 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-c347435f-be5c-46d7-9dc9-04567a36b1f0 req-b593919c-c03b-44ea-b711-9da87028d651 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117369 Oct 18 15:38:25.882398 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1524/3099] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:38:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:38:25.898317 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3c3e0086-3d24-4b7e-bf3b-93fc889e786a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:25.907344 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3c3e0086-3d24-4b7e-bf3b-93fc889e786a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca" status: 200 len: 1450 microversion: 2.1 time: 0.594090 Oct 18 15:38:25.907942 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1576/3100] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:25 2022] GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca => generated 1450 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:25.935488 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9a14f1c1-1aed-4ebe-95a5-d9e4e5113bdd tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:25.936242 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9a14f1c1-1aed-4ebe-95a5-d9e4e5113bdd tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:25.946762 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a14f1c1-1aed-4ebe-95a5-d9e4e5113bdd tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:25.948446 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a14f1c1-1aed-4ebe-95a5-d9e4e5113bdd tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:25.951979 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a14f1c1-1aed-4ebe-95a5-d9e4e5113bdd tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:25.953419 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a14f1c1-1aed-4ebe-95a5-d9e4e5113bdd tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:25.954006 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a14f1c1-1aed-4ebe-95a5-d9e4e5113bdd tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:25.954798 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a14f1c1-1aed-4ebe-95a5-d9e4e5113bdd tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:26.012673 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:38:26.017806 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9a14f1c1-1aed-4ebe-95a5-d9e4e5113bdd tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:38:26.035821 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.compute.api [None req-9a14f1c1-1aed-4ebe-95a5-d9e4e5113bdd tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] Working on deleting snapshot 271de848-535b-4a33-b077-c1aed7c4a280 from shelved instance... Oct 18 15:38:26.295869 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-cea76c7f-6c37-4d97-bcc9-db1c9844dce0 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:26.300203 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-cea76c7f-6c37-4d97-bcc9-db1c9844dce0 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] [instance: 7ae6ac1e-7345-4096-9816-a53e90d88447] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:26.325780 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cea76c7f-6c37-4d97-bcc9-db1c9844dce0 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:26.328974 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cea76c7f-6c37-4d97-bcc9-db1c9844dce0 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:26.329890 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cea76c7f-6c37-4d97-bcc9-db1c9844dce0 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:26.345434 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cea76c7f-6c37-4d97-bcc9-db1c9844dce0 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:26.346187 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cea76c7f-6c37-4d97-bcc9-db1c9844dce0 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:26.346641 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cea76c7f-6c37-4d97-bcc9-db1c9844dce0 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:26.821549 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=8 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:38:27.398825 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9a14f1c1-1aed-4ebe-95a5-d9e4e5113bdd tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] Doing local delete in cell 8ab54c98-adc3-429d-89a9-d68fdb0f782a(cell1) {{(pid=120406) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 18 15:38:27.402594 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-cea76c7f-6c37-4d97-bcc9-db1c9844dce0 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7ebe0c265144769931ca6262be8860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a84f93ce8049c3a20c3b835f28100f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:27.412847 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a14f1c1-1aed-4ebe-95a5-d9e4e5113bdd tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:27.414183 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-cea76c7f-6c37-4d97-bcc9-db1c9844dce0 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] 10.222.0.60 "GET /compute/v2.1/servers/7ae6ac1e-7345-4096-9816-a53e90d88447" status: 200 len: 1323 microversion: 2.1 time: 1.128209 Oct 18 15:38:27.415389 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a14f1c1-1aed-4ebe-95a5-d9e4e5113bdd tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:27.417444 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a14f1c1-1aed-4ebe-95a5-d9e4e5113bdd tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:27.418581 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1577/3101] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:26 2022] GET /compute/v2.1/servers/7ae6ac1e-7345-4096-9816-a53e90d88447 => generated 1323 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:38:27.421258 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.compute.api [None req-9a14f1c1-1aed-4ebe-95a5-d9e4e5113bdd tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 18 15:38:27.432709 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-eeb81d88-d699-4913-b4da-990cd294b8e9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:27.438266 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-9a14f1c1-1aed-4ebe-95a5-d9e4e5113bdd tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] deallocate_for_instance() {{(pid=120406) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}} Oct 18 15:38:27.449131 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-eeb81d88-d699-4913-b4da-990cd294b8e9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: d280f396-df42-482a-b0c1-9a8a9b608f57] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:27.460264 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eeb81d88-d699-4913-b4da-990cd294b8e9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:27.461801 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eeb81d88-d699-4913-b4da-990cd294b8e9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:27.462411 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eeb81d88-d699-4913-b4da-990cd294b8e9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:27.463306 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eeb81d88-d699-4913-b4da-990cd294b8e9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:27.463932 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eeb81d88-d699-4913-b4da-990cd294b8e9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:27.464524 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eeb81d88-d699-4913-b4da-990cd294b8e9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:28.363413 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-eeb81d88-d699-4913-b4da-990cd294b8e9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:28.384305 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-eeb81d88-d699-4913-b4da-990cd294b8e9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57" status: 200 len: 1313 microversion: 2.1 time: 0.951536 Oct 18 15:38:28.385830 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1578/3102] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:27 2022] GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57 => generated 1313 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:28.418728 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5210d02c-98a7-4ace-8690-35622ac81fee tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '.version_select at 0x7f7c3d2a8670>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:28.485824 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5210d02c-98a7-4ace-8690-35622ac81fee tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "GET /compute/v2.1/images/8c7b241d-0275-49f6-be6f-40e1e7c6411a" status: 200 len: 1428 microversion: 2.1 time: 0.090933 Oct 18 15:38:28.486773 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1579/3103] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:38:28 2022] GET /compute/v2.1/images/8c7b241d-0275-49f6-be6f-40e1e7c6411a => generated 1428 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:28.498278 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-751c6d0f-9357-4af0-9edd-436cb13a8054 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Action: 'create', calling method: .version_select at 0x7f7c3d0f69d0>, body: {"keypair": {"name": "tempest-keypair-1784807893", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDC6BYH4aJprjyXeaovK78JQJpaF/3/cwVNLTObAHY1RF63pMfGRNHlhWXTGb6dUeXfYnSa91SYeoc90RcYlkO63pcYvy0RgbvjDwlXeFVlr0gJ5zMfH5dHz9+wJO/pWVg=="}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:38:28.540019 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-751c6d0f-9357-4af0-9edd-436cb13a8054 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Getting quotas for project 1a67d76e7f824ee99302b9efb7d36e2f. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:38:28.555400 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-751c6d0f-9357-4af0-9edd-436cb13a8054 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Getting quotas for user ccc5106861284e12aa81c7a28e024a1b and project 1a67d76e7f824ee99302b9efb7d36e2f. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:38:28.615182 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-751c6d0f-9357-4af0-9edd-436cb13a8054 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.126777 Oct 18 15:38:28.616158 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1580/3104] 10.222.0.60 () {62 vars in 1200 bytes} [Tue Oct 18 15:38:28 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 129 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 18 15:38:28.621415 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e23bcf8f-92f4-4083-8cb4-01743fb82745 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:28.622047 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e23bcf8f-92f4-4083-8cb4-01743fb82745 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] [instance: 7ae6ac1e-7345-4096-9816-a53e90d88447] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:28.640610 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e23bcf8f-92f4-4083-8cb4-01743fb82745 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:28.641481 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e23bcf8f-92f4-4083-8cb4-01743fb82745 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:28.642315 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e23bcf8f-92f4-4083-8cb4-01743fb82745 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:28.646768 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e23bcf8f-92f4-4083-8cb4-01743fb82745 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:28.648628 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e23bcf8f-92f4-4083-8cb4-01743fb82745 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:28.649283 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e23bcf8f-92f4-4083-8cb4-01743fb82745 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:28.707626 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=100 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:38:29.332367 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e23bcf8f-92f4-4083-8cb4-01743fb82745 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7ebe0c265144769931ca6262be8860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a84f93ce8049c3a20c3b835f28100f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:29.345222 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e23bcf8f-92f4-4083-8cb4-01743fb82745 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] 10.222.0.60 "GET /compute/v2.1/servers/7ae6ac1e-7345-4096-9816-a53e90d88447" status: 200 len: 1323 microversion: 2.1 time: 0.727764 Oct 18 15:38:29.346092 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1581/3105] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:28 2022] GET /compute/v2.1/servers/7ae6ac1e-7345-4096-9816-a53e90d88447 => generated 1323 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:29.409862 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0d7477bb-cc38-4648-94d3-750d18daa84c tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:29.411152 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0d7477bb-cc38-4648-94d3-750d18daa84c tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: d280f396-df42-482a-b0c1-9a8a9b608f57] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:29.418901 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0d7477bb-cc38-4648-94d3-750d18daa84c tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:29.419702 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0d7477bb-cc38-4648-94d3-750d18daa84c tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:29.420296 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0d7477bb-cc38-4648-94d3-750d18daa84c tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:29.421234 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0d7477bb-cc38-4648-94d3-750d18daa84c tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:29.421896 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0d7477bb-cc38-4648-94d3-750d18daa84c tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:29.422531 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0d7477bb-cc38-4648-94d3-750d18daa84c tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:30.123302 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0d7477bb-cc38-4648-94d3-750d18daa84c tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:30.143351 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0d7477bb-cc38-4648-94d3-750d18daa84c tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57" status: 200 len: 1313 microversion: 2.1 time: 0.735774 Oct 18 15:38:30.147306 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1582/3106] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:29 2022] GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57 => generated 1313 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:30.157940 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-631ebb28-33c1-43ac-a346-ba3032a84812 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '.version_select at 0x7f7c3d86ae50>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:30.244661 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-9a14f1c1-1aed-4ebe-95a5-d9e4e5113bdd tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] Updating instance_info_cache with network_info: [] {{(pid=120406) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 18 15:38:30.328726 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-631ebb28-33c1-43ac-a346-ba3032a84812 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "GET /compute/v2.1/images/8c7b241d-0275-49f6-be6f-40e1e7c6411a" status: 200 len: 1428 microversion: 2.1 time: 0.179797 Oct 18 15:38:30.329618 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1583/3107] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:38:30 2022] GET /compute/v2.1/images/8c7b241d-0275-49f6-be6f-40e1e7c6411a => generated 1428 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:30.354497 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-5bee23b3-29c6-46a9-b6b4-1a917da35e1d req-22f31770-4e32-48bc-942f-f59606506c89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "994c2ba1-98f1-4d00-8753-00e39d56d433", "tag": "220c5574-a181-4443-af0c-350e480aae57"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:38:30.387189 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-5bee23b3-29c6-46a9-b6b4-1a917da35e1d req-22f31770-4e32-48bc-942f-f59606506c89 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:30.387680 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-5bee23b3-29c6-46a9-b6b4-1a917da35e1d req-22f31770-4e32-48bc-942f-f59606506c89 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:30.388128 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-5bee23b3-29c6-46a9-b6b4-1a917da35e1d req-22f31770-4e32-48bc-942f-f59606506c89 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:30.421828 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-5bee23b3-29c6-46a9-b6b4-1a917da35e1d req-22f31770-4e32-48bc-942f-f59606506c89 service nova] Creating event network-changed:220c5574-a181-4443-af0c-350e480aae57 for instance 994c2ba1-98f1-4d00-8753-00e39d56d433 on n-h2-853682-5 Oct 18 15:38:30.433755 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-5bee23b3-29c6-46a9-b6b4-1a917da35e1d req-22f31770-4e32-48bc-942f-f59606506c89 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096622 Oct 18 15:38:30.449903 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1584/3108] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:38:30.459478 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7cd04813-3a39-4ea0-8051-2529247e8f82 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:30.460629 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7cd04813-3a39-4ea0-8051-2529247e8f82 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] [instance: 7ae6ac1e-7345-4096-9816-a53e90d88447] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:30.497469 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7cd04813-3a39-4ea0-8051-2529247e8f82 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:30.498305 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7cd04813-3a39-4ea0-8051-2529247e8f82 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:30.499217 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7cd04813-3a39-4ea0-8051-2529247e8f82 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:30.500140 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7cd04813-3a39-4ea0-8051-2529247e8f82 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:30.502813 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7cd04813-3a39-4ea0-8051-2529247e8f82 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:30.503453 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7cd04813-3a39-4ea0-8051-2529247e8f82 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:30.611857 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9a14f1c1-1aed-4ebe-95a5-d9e4e5113bdd tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca" status: 204 len: 0 microversion: 2.1 time: 4.680635 Oct 18 15:38:30.613627 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1525/3109] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:38:25 2022] DELETE /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca => generated 0 bytes in 4683 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:38:30.622114 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-abba9bdd-c1ab-4011-b92e-716c7c173f5e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:30.622738 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-abba9bdd-c1ab-4011-b92e-716c7c173f5e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:30.640715 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-abba9bdd-c1ab-4011-b92e-716c7c173f5e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:30.641548 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-abba9bdd-c1ab-4011-b92e-716c7c173f5e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:30.642146 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-abba9bdd-c1ab-4011-b92e-716c7c173f5e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:30.643069 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-abba9bdd-c1ab-4011-b92e-716c7c173f5e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:30.643707 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-abba9bdd-c1ab-4011-b92e-716c7c173f5e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:30.644304 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-abba9bdd-c1ab-4011-b92e-716c7c173f5e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:30.663585 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-abba9bdd-c1ab-4011-b92e-716c7c173f5e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] HTTP exception thrown: Instance a5c710aa-e860-4b2c-a59b-c25202c621ca could not be found. Oct 18 15:38:30.665310 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-abba9bdd-c1ab-4011-b92e-716c7c173f5e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Request method failure captured: Oct 18 15:38:30.665310 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca HTTP/1.1 Oct 18 15:38:30.665310 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:38:30.665310 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:38:30.665310 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:38:30.665310 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:38:30.665310 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:38:30.665310 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:38:30.665310 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:38:30.665310 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:38:30.665310 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTseXdqIE6K5VM4s3TEHRLWgMUN4aMRv2NoeIzUdaqo5huhkbfibHS5WTucH_yVgiw-oU86aIdI66etum9zPC1o_Gp8lN1ylUglhXYekmlUb-DCNwOQQTPA7nsDvbxyfFlUPyfZnM9HlX0P4k3Gbrf42L5eihIJ6KOiK__MhWlbfWWoY Oct 18 15:38:30.665310 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:38:30.665310 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:38:30.665310 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:38:30.665310 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:38:30.665310 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:38:30.665310 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:38:30.665310 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 04fd51d598a04ff7a909b3ced951dea8 Oct 18 15:38:30.665310 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-DeleteServersTestJSON-518486720 Oct 18 15:38:30.665310 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:38:30.665310 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:38:30.666995 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:38:30.666995 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-DeleteServersTestJSON-518486720 Oct 18 15:38:30.666995 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 04fd51d598a04ff7a909b3ced951dea8 Oct 18 15:38:30.666995 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-DeleteServersTestJSON-518486720 Oct 18 15:38:30.666995 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-DeleteServersTestJSON-518486720-project Oct 18 15:38:30.666995 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:38:30.666995 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:38:30.666995 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 5309baeeec484df194123d22779b0255 Oct 18 15:38:30.666995 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-DeleteServersTestJSON-518486720-project Oct 18 15:38:30.666995 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:38:30.666995 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance a5c710aa-e860-4b2c-a59b-c25202c621ca could not be found. Oct 18 15:38:30.666995 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'a5c710aa-e860-4b2c-a59b-c25202c621ca'} Oct 18 15:38:30.667903 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:38:30.667903 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:38:30.667903 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:38:30.667903 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:38:30.667903 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:38:30.667903 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:38:30.667903 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:38:30.667903 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:38:30.667903 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:38:30.667903 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:38:30.667903 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5c710aa-e860-4b2c-a59b-c25202c621ca could not be found. Oct 18 15:38:30.667903 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:38:30.667903 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:38:30.667903 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:38:30.667903 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:38:30.667903 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:38:30.667903 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:38:30.667903 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:38:30.667903 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:38:30.667903 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:38:30.669467 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:38:30.669467 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:38:30.669467 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:38:30.669467 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:38:30.669467 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:38:30.669467 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:38:30.669467 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:38:30.669467 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5c710aa-e860-4b2c-a59b-c25202c621ca could not be found. Oct 18 15:38:30.669467 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:38:30.669467 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:38:30.669467 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:38:30.669467 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:38:30.669467 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:38:30.669467 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:38:30.669467 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:38:30.669467 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:38:30.669467 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5c710aa-e860-4b2c-a59b-c25202c621ca could not be found. Oct 18 15:38:30.669467 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:38:30.671737 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-abba9bdd-c1ab-4011-b92e-716c7c173f5e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Returning 404 to user: Instance a5c710aa-e860-4b2c-a59b-c25202c621ca could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:38:30.672772 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-abba9bdd-c1ab-4011-b92e-716c7c173f5e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca" status: 404 len: 111 microversion: 2.1 time: 0.054726 Oct 18 15:38:30.675371 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1526/3110] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:30 2022] GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 15:38:30.847305 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7cd04813-3a39-4ea0-8051-2529247e8f82 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7ebe0c265144769931ca6262be8860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a84f93ce8049c3a20c3b835f28100f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:30.859341 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7cd04813-3a39-4ea0-8051-2529247e8f82 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] 10.222.0.60 "GET /compute/v2.1/servers/7ae6ac1e-7345-4096-9816-a53e90d88447" status: 200 len: 1323 microversion: 2.1 time: 0.408049 Oct 18 15:38:30.860451 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1585/3111] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:30 2022] GET /compute/v2.1/servers/7ae6ac1e-7345-4096-9816-a53e90d88447 => generated 1323 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:30.862613 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3a470db9-097d-4c6c-962e-4952d7e8316a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1544367122", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "670a85ee-2ce6-476a-bad3-558d8003ee5a"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:38:30.941505 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-3a470db9-097d-4c6c-962e-4952d7e8316a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] validate_networks() for [('670a85ee-2ce6-476a-bad3-558d8003ee5a', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:38:31.169522 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4202ce40-e524-46ec-b5a4-0988fd02498e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:31.170406 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4202ce40-e524-46ec-b5a4-0988fd02498e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: d280f396-df42-482a-b0c1-9a8a9b608f57] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:31.189961 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4202ce40-e524-46ec-b5a4-0988fd02498e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:31.190769 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4202ce40-e524-46ec-b5a4-0988fd02498e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:31.191366 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4202ce40-e524-46ec-b5a4-0988fd02498e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:31.192248 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4202ce40-e524-46ec-b5a4-0988fd02498e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:31.192911 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4202ce40-e524-46ec-b5a4-0988fd02498e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:31.193492 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4202ce40-e524-46ec-b5a4-0988fd02498e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:31.627841 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4202ce40-e524-46ec-b5a4-0988fd02498e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:31.642273 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4202ce40-e524-46ec-b5a4-0988fd02498e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57" status: 200 len: 1313 microversion: 2.1 time: 0.476716 Oct 18 15:38:31.643126 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1586/3112] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:31 2022] GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57 => generated 1313 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:31.654378 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6c8f5496-0bf8-4de2-b19e-8ed89ea099e6 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '.version_select at 0x7f7c3d0f6550>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:31.746513 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6c8f5496-0bf8-4de2-b19e-8ed89ea099e6 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "GET /compute/v2.1/images/8c7b241d-0275-49f6-be6f-40e1e7c6411a" status: 200 len: 1428 microversion: 2.1 time: 0.102062 Oct 18 15:38:31.748055 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1587/3113] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:38:31 2022] GET /compute/v2.1/images/8c7b241d-0275-49f6-be6f-40e1e7c6411a => generated 1428 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:31.858161 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-3a470db9-097d-4c6c-962e-4952d7e8316a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:38:31.858723 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-3a470db9-097d-4c6c-962e-4952d7e8316a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:38:31.859050 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-3a470db9-097d-4c6c-962e-4952d7e8316a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:38:31.859461 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-3a470db9-097d-4c6c-962e-4952d7e8316a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:38:31.860134 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-3a470db9-097d-4c6c-962e-4952d7e8316a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:38:31.878987 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a470db9-097d-4c6c-962e-4952d7e8316a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:31.879494 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a470db9-097d-4c6c-962e-4952d7e8316a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:31.879939 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a470db9-097d-4c6c-962e-4952d7e8316a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:31.881300 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a470db9-097d-4c6c-962e-4952d7e8316a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:31.881958 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a470db9-097d-4c6c-962e-4952d7e8316a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:31.882598 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a470db9-097d-4c6c-962e-4952d7e8316a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:31.890655 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ba5c39c6-d87c-4e2c-9712-6a56c485e6ec tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:31.891289 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ba5c39c6-d87c-4e2c-9712-6a56c485e6ec tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] [instance: 7ae6ac1e-7345-4096-9816-a53e90d88447] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:31.907064 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba5c39c6-d87c-4e2c-9712-6a56c485e6ec tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:31.908446 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba5c39c6-d87c-4e2c-9712-6a56c485e6ec tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:31.909336 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba5c39c6-d87c-4e2c-9712-6a56c485e6ec tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:31.910467 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba5c39c6-d87c-4e2c-9712-6a56c485e6ec tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:31.911413 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba5c39c6-d87c-4e2c-9712-6a56c485e6ec tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:31.912132 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba5c39c6-d87c-4e2c-9712-6a56c485e6ec tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:31.943792 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-3a470db9-097d-4c6c-962e-4952d7e8316a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Getting quotas for project 04fd51d598a04ff7a909b3ced951dea8. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:38:31.970137 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-3a470db9-097d-4c6c-962e-4952d7e8316a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Getting quotas for user 5309baeeec484df194123d22779b0255 and project 04fd51d598a04ff7a909b3ced951dea8. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:38:32.019046 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3a470db9-097d-4c6c-962e-4952d7e8316a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:38:32.021590 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3a470db9-097d-4c6c-962e-4952d7e8316a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 2059ec7e-ef9b-4eb6-af19-34b2bd09e44a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:38:32.129919 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3a470db9-097d-4c6c-962e-4952d7e8316a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.271576 Oct 18 15:38:32.131630 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1527/3114] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:38:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1274 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:38:32.144503 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ba5c39c6-d87c-4e2c-9712-6a56c485e6ec tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7ebe0c265144769931ca6262be8860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a84f93ce8049c3a20c3b835f28100f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:32.163620 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-32811d5f-218a-43df-811a-6f20bc8f3071 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:32.166980 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-32811d5f-218a-43df-811a-6f20bc8f3071 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 2059ec7e-ef9b-4eb6-af19-34b2bd09e44a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:32.169602 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ba5c39c6-d87c-4e2c-9712-6a56c485e6ec tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] 10.222.0.60 "GET /compute/v2.1/servers/7ae6ac1e-7345-4096-9816-a53e90d88447" status: 200 len: 1323 microversion: 2.1 time: 0.281740 Oct 18 15:38:32.190489 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1588/3115] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:31 2022] GET /compute/v2.1/servers/7ae6ac1e-7345-4096-9816-a53e90d88447 => generated 1323 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:32.263206 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-32811d5f-218a-43df-811a-6f20bc8f3071 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:32.272521 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-32811d5f-218a-43df-811a-6f20bc8f3071 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a" status: 200 len: 1215 microversion: 2.1 time: 0.131882 Oct 18 15:38:32.273209 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1528/3116] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:32 2022] GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a => generated 1215 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:32.418772 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-14b6bfb5-6498-467a-8b52-e658c92a1ea3 req-716dc475-985b-41d8-ac1e-10b6a9bc763a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ae6ac1e-7345-4096-9816-a53e90d88447", "name": "network-vif-plugged", "status": "completed", "tag": "860075d2-73a1-49ad-a68a-e236bf779147"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:38:32.456831 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-d3a805fd-1811-4480-af27-97405f4f70ff req-07a61a29-2dbe-4630-ae16-a2775e39836c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5c710aa-e860-4b2c-a59b-c25202c621ca", "name": "network-vif-deleted", "tag": "e2a2e036-76b0-46b5-8c98-0566f70d8b58"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:38:32.481672 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-14b6bfb5-6498-467a-8b52-e658c92a1ea3 req-716dc475-985b-41d8-ac1e-10b6a9bc763a service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:32.482170 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-14b6bfb5-6498-467a-8b52-e658c92a1ea3 req-716dc475-985b-41d8-ac1e-10b6a9bc763a service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:32.482613 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-14b6bfb5-6498-467a-8b52-e658c92a1ea3 req-716dc475-985b-41d8-ac1e-10b6a9bc763a service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:32.496992 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d3a805fd-1811-4480-af27-97405f4f70ff req-07a61a29-2dbe-4630-ae16-a2775e39836c service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:32.497643 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d3a805fd-1811-4480-af27-97405f4f70ff req-07a61a29-2dbe-4630-ae16-a2775e39836c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:32.498190 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d3a805fd-1811-4480-af27-97405f4f70ff req-07a61a29-2dbe-4630-ae16-a2775e39836c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:32.527396 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.compute.server_external_events [req-d3a805fd-1811-4480-af27-97405f4f70ff req-07a61a29-2dbe-4630-ae16-a2775e39836c service nova] Unable to find a host for instance a5c710aa-e860-4b2c-a59b-c25202c621ca. Dropping event network-vif-deleted {{(pid=120406) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 18 15:38:32.536144 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-d3a805fd-1811-4480-af27-97405f4f70ff req-07a61a29-2dbe-4630-ae16-a2775e39836c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.083794 Oct 18 15:38:32.538843 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1529/3117] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 87 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 18 15:38:32.565109 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-14b6bfb5-6498-467a-8b52-e658c92a1ea3 req-716dc475-985b-41d8-ac1e-10b6a9bc763a service nova] Creating event network-vif-plugged:860075d2-73a1-49ad-a68a-e236bf779147 for instance 7ae6ac1e-7345-4096-9816-a53e90d88447 on n-h2-853682-5 Oct 18 15:38:32.577838 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-14b6bfb5-6498-467a-8b52-e658c92a1ea3 req-716dc475-985b-41d8-ac1e-10b6a9bc763a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162517 Oct 18 15:38:32.580575 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1589/3118] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:38:32.698967 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-77d737d8-e3cb-42bb-bf63-7a52d3d4fa0f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:32.699595 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-77d737d8-e3cb-42bb-bf63-7a52d3d4fa0f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: d280f396-df42-482a-b0c1-9a8a9b608f57] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:32.712687 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:38:32.715148 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77d737d8-e3cb-42bb-bf63-7a52d3d4fa0f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:32.715653 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77d737d8-e3cb-42bb-bf63-7a52d3d4fa0f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:32.716100 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77d737d8-e3cb-42bb-bf63-7a52d3d4fa0f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:32.716859 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77d737d8-e3cb-42bb-bf63-7a52d3d4fa0f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:32.717293 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77d737d8-e3cb-42bb-bf63-7a52d3d4fa0f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:32.718065 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77d737d8-e3cb-42bb-bf63-7a52d3d4fa0f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:32.765155 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6a27826c-4947-4ec4-81cd-c974f06d2482 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '.version_select at 0x7f7c3dc6c3a0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:32.843781 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6a27826c-4947-4ec4-81cd-c974f06d2482 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "GET /compute/v2.1/images/8c7b241d-0275-49f6-be6f-40e1e7c6411a" status: 200 len: 1428 microversion: 2.1 time: 0.082734 Oct 18 15:38:32.853626 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1590/3119] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:38:32 2022] GET /compute/v2.1/images/8c7b241d-0275-49f6-be6f-40e1e7c6411a => generated 1428 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:32.996398 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-38a41e09-fdf9-4056-97c9-afe3241be6b3 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1001149755", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "22d851e4-af56-43db-a609-4236efe81404"}, {"port": "a2d084e8-8af5-402d-b5a9-a5e9b2e30a21", "tag": "port-1"}, {"port": "728b9ef4-fe70-49aa-a715-30bd7cc7b07b", "tag": "port-2"}, {"uuid": "fe754276-a831-47b9-b440-084df56835f4", "tag": "net-1"}, {"uuid": "fe754276-a831-47b9-b440-084df56835f4"}, {"uuid": "7d751aab-5a4d-4153-8fee-1e8087541bdd", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "7d751aab-5a4d-4153-8fee-1e8087541bdd", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "7f25a653-ca17-46ac-a4b8-a1a2761aacdf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "d11d63e1-d4bc-4395-9ad6-fdc9bd359b8d", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "3cf9b60e-bb97-4520-b0f2-42ae86a3530c", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1165233837"}], "key_name": "tempest-keypair-1784807893", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:38:33.048150 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-77d737d8-e3cb-42bb-bf63-7a52d3d4fa0f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:33.074734 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-77d737d8-e3cb-42bb-bf63-7a52d3d4fa0f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57" status: 200 len: 1313 microversion: 2.1 time: 0.406675 Oct 18 15:38:33.075709 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1530/3120] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:32 2022] GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57 => generated 1313 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:33.183014 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-38a41e09-fdf9-4056-97c9-afe3241be6b3 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] validate_networks() for [('22d851e4-af56-43db-a609-4236efe81404', None, None, None, None, None), (None, None, 'a2d084e8-8af5-402d-b5a9-a5e9b2e30a21', None, None, None), (None, None, '728b9ef4-fe70-49aa-a715-30bd7cc7b07b', None, None, None), ('fe754276-a831-47b9-b440-084df56835f4', None, None, None, None, None), ('fe754276-a831-47b9-b440-084df56835f4', None, None, None, None, None), ('7d751aab-5a4d-4153-8fee-1e8087541bdd', '10.2.2.100', None, None, None, None), ('7d751aab-5a4d-4153-8fee-1e8087541bdd', '10.2.2.200', None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:38:33.192446 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-835b337f-0115-45e3-8737-8bd11630635c tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:33.194076 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-835b337f-0115-45e3-8737-8bd11630635c tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] [instance: 7ae6ac1e-7345-4096-9816-a53e90d88447] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:33.201111 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-835b337f-0115-45e3-8737-8bd11630635c tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:33.201893 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-835b337f-0115-45e3-8737-8bd11630635c tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:33.202330 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-835b337f-0115-45e3-8737-8bd11630635c tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:33.203208 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-835b337f-0115-45e3-8737-8bd11630635c tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:33.203821 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-835b337f-0115-45e3-8737-8bd11630635c tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:33.204678 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-835b337f-0115-45e3-8737-8bd11630635c tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:33.485501 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-835b337f-0115-45e3-8737-8bd11630635c tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7ebe0c265144769931ca6262be8860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a84f93ce8049c3a20c3b835f28100f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:33.503578 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-835b337f-0115-45e3-8737-8bd11630635c tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] 10.222.0.60 "GET /compute/v2.1/servers/7ae6ac1e-7345-4096-9816-a53e90d88447" status: 200 len: 1323 microversion: 2.1 time: 0.313845 Oct 18 15:38:33.514778 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1531/3121] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:33 2022] GET /compute/v2.1/servers/7ae6ac1e-7345-4096-9816-a53e90d88447 => generated 1323 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:33.523895 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7b71f02a-a7df-4667-9f00-3155a8ce5269 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:33.524919 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7b71f02a-a7df-4667-9f00-3155a8ce5269 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 2059ec7e-ef9b-4eb6-af19-34b2bd09e44a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:33.544535 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b71f02a-a7df-4667-9f00-3155a8ce5269 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:33.545063 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b71f02a-a7df-4667-9f00-3155a8ce5269 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:33.545505 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b71f02a-a7df-4667-9f00-3155a8ce5269 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:33.546465 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b71f02a-a7df-4667-9f00-3155a8ce5269 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:33.546925 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b71f02a-a7df-4667-9f00-3155a8ce5269 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:33.548521 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b71f02a-a7df-4667-9f00-3155a8ce5269 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:33.649867 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7b71f02a-a7df-4667-9f00-3155a8ce5269 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:33.677734 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7b71f02a-a7df-4667-9f00-3155a8ce5269 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a" status: 200 len: 1267 microversion: 2.1 time: 0.160318 Oct 18 15:38:33.687111 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1532/3122] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:33 2022] GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:33.860440 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c4aca99e-db1a-4039-85ff-789f386fab63 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '.version_select at 0x7f7c3cfd88b0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:33.945646 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c4aca99e-db1a-4039-85ff-789f386fab63 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "GET /compute/v2.1/images/8c7b241d-0275-49f6-be6f-40e1e7c6411a" status: 200 len: 1428 microversion: 2.1 time: 0.089620 Oct 18 15:38:33.946780 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1533/3123] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:38:33 2022] GET /compute/v2.1/images/8c7b241d-0275-49f6-be6f-40e1e7c6411a => generated 1428 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:34.105239 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c952ccb6-e02a-47fd-a91e-62dcaf9af4ee tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:34.105849 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c952ccb6-e02a-47fd-a91e-62dcaf9af4ee tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: d280f396-df42-482a-b0c1-9a8a9b608f57] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:34.112656 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c952ccb6-e02a-47fd-a91e-62dcaf9af4ee tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:34.113243 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c952ccb6-e02a-47fd-a91e-62dcaf9af4ee tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:34.113628 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c952ccb6-e02a-47fd-a91e-62dcaf9af4ee tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:34.114385 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c952ccb6-e02a-47fd-a91e-62dcaf9af4ee tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:34.116598 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c952ccb6-e02a-47fd-a91e-62dcaf9af4ee tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:34.117137 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c952ccb6-e02a-47fd-a91e-62dcaf9af4ee tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:34.345973 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c952ccb6-e02a-47fd-a91e-62dcaf9af4ee tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:34.354340 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c952ccb6-e02a-47fd-a91e-62dcaf9af4ee tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57" status: 200 len: 1313 microversion: 2.1 time: 0.257013 Oct 18 15:38:34.355013 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1534/3124] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:34 2022] GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57 => generated 1313 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:38:34.531466 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-85e5b885-99a1-4bd3-84ca-a31d18ffd3f6 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:34.532254 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-85e5b885-99a1-4bd3-84ca-a31d18ffd3f6 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] [instance: 7ae6ac1e-7345-4096-9816-a53e90d88447] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:34.539827 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85e5b885-99a1-4bd3-84ca-a31d18ffd3f6 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:34.540474 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85e5b885-99a1-4bd3-84ca-a31d18ffd3f6 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:34.541016 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85e5b885-99a1-4bd3-84ca-a31d18ffd3f6 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:34.541842 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85e5b885-99a1-4bd3-84ca-a31d18ffd3f6 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:34.542395 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85e5b885-99a1-4bd3-84ca-a31d18ffd3f6 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:34.542816 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85e5b885-99a1-4bd3-84ca-a31d18ffd3f6 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:34.805446 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-85e5b885-99a1-4bd3-84ca-a31d18ffd3f6 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7ebe0c265144769931ca6262be8860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a84f93ce8049c3a20c3b835f28100f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:34.815881 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-85e5b885-99a1-4bd3-84ca-a31d18ffd3f6 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] 10.222.0.60 "GET /compute/v2.1/servers/7ae6ac1e-7345-4096-9816-a53e90d88447" status: 200 len: 1519 microversion: 2.1 time: 0.292649 Oct 18 15:38:34.816666 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1535/3125] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:34 2022] GET /compute/v2.1/servers/7ae6ac1e-7345-4096-9816-a53e90d88447 => generated 1519 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:38:34.823388 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-dd8eb0c2-a0a5-4d8f-b483-8b080c176d2c req-70cf20b8-06a0-44ed-aaac-268b25edc756 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d280f396-df42-482a-b0c1-9a8a9b608f57", "name": "network-vif-plugged", "status": "completed", "tag": "f518ff61-30b3-4c0b-a3c2-3c35a22e45aa"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:38:34.837035 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-dd8eb0c2-a0a5-4d8f-b483-8b080c176d2c req-70cf20b8-06a0-44ed-aaac-268b25edc756 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:34.837604 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-dd8eb0c2-a0a5-4d8f-b483-8b080c176d2c req-70cf20b8-06a0-44ed-aaac-268b25edc756 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:34.838181 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-dd8eb0c2-a0a5-4d8f-b483-8b080c176d2c req-70cf20b8-06a0-44ed-aaac-268b25edc756 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:34.873662 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-dd8eb0c2-a0a5-4d8f-b483-8b080c176d2c req-70cf20b8-06a0-44ed-aaac-268b25edc756 service nova] Creating event network-vif-plugged:f518ff61-30b3-4c0b-a3c2-3c35a22e45aa for instance d280f396-df42-482a-b0c1-9a8a9b608f57 on n-h1-853682-5 Oct 18 15:38:34.885209 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-dd8eb0c2-a0a5-4d8f-b483-8b080c176d2c req-70cf20b8-06a0-44ed-aaac-268b25edc756 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061125 Oct 18 15:38:34.885209 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1536/3126] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:38:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:38:34.888009 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3b6be239-086c-4719-b33e-bce56e857618 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:34.888751 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3b6be239-086c-4719-b33e-bce56e857618 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 2059ec7e-ef9b-4eb6-af19-34b2bd09e44a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:34.898181 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b6be239-086c-4719-b33e-bce56e857618 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:34.898708 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b6be239-086c-4719-b33e-bce56e857618 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:34.899670 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b6be239-086c-4719-b33e-bce56e857618 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:34.900007 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b6be239-086c-4719-b33e-bce56e857618 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:34.900511 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b6be239-086c-4719-b33e-bce56e857618 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:34.900945 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b6be239-086c-4719-b33e-bce56e857618 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:34.977125 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3b6be239-086c-4719-b33e-bce56e857618 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:34.985001 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3b6be239-086c-4719-b33e-bce56e857618 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a" status: 200 len: 1275 microversion: 2.1 time: 0.101817 Oct 18 15:38:34.985586 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1537/3127] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:34 2022] GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a => generated 1275 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:34.990102 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7f1cb623-657e-4c23-8940-d4be0224b7ee tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Action: 'create', calling method: .version_select at 0x7f7c3d5c1310>, body: {"pool": null} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:38:36.977378 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-38a41e09-fdf9-4056-97c9-afe3241be6b3 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:38:36.977875 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-38a41e09-fdf9-4056-97c9-afe3241be6b3 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:38:36.978297 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-38a41e09-fdf9-4056-97c9-afe3241be6b3 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:38:36.978707 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-38a41e09-fdf9-4056-97c9-afe3241be6b3 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:38:36.979136 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-38a41e09-fdf9-4056-97c9-afe3241be6b3 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:38:36.988513 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-38a41e09-fdf9-4056-97c9-afe3241be6b3 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:36.988967 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-38a41e09-fdf9-4056-97c9-afe3241be6b3 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:36.989409 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-38a41e09-fdf9-4056-97c9-afe3241be6b3 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:36.990172 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-38a41e09-fdf9-4056-97c9-afe3241be6b3 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:36.990628 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-38a41e09-fdf9-4056-97c9-afe3241be6b3 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:36.991053 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-38a41e09-fdf9-4056-97c9-afe3241be6b3 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:37.009199 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-38a41e09-fdf9-4056-97c9-afe3241be6b3 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Getting quotas for project 1a67d76e7f824ee99302b9efb7d36e2f. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:38:37.014924 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-38a41e09-fdf9-4056-97c9-afe3241be6b3 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Getting quotas for user ccc5106861284e12aa81c7a28e024a1b and project 1a67d76e7f824ee99302b9efb7d36e2f. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:38:37.180076 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-38a41e09-fdf9-4056-97c9-afe3241be6b3 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:38:37.183235 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-38a41e09-fdf9-4056-97c9-afe3241be6b3 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='7f25a653-ca17-46ac-a4b8-a1a2761aacdf',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='d11d63e1-d4bc-4395-9ad6-fdc9bd359b8d',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3cf9b60e-bb97-4520-b0f2-42ae86a3530c',volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:38:37.599705 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-38a41e09-fdf9-4056-97c9-afe3241be6b3 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 4.606702 Oct 18 15:38:37.601016 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1591/3128] 10.222.0.60 () {62 vars in 1189 bytes} [Tue Oct 18 15:38:32 2022] POST /compute/v2.1/servers => generated 406 bytes in 4609 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 18 15:38:37.606922 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-851fc974-9a0d-4f7c-9c88-06875d0673f5 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '.version_select at 0x7f7c3d68d670>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:37.669367 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-851fc974-9a0d-4f7c-9c88-06875d0673f5 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "GET /compute/v2.1/images/8c7b241d-0275-49f6-be6f-40e1e7c6411a" status: 200 len: 1437 microversion: 2.1 time: 0.066933 Oct 18 15:38:37.669977 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1592/3129] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:38:37 2022] GET /compute/v2.1/images/8c7b241d-0275-49f6-be6f-40e1e7c6411a => generated 1437 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:37.675899 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-26d9eaa5-6178-4d23-a41e-316b0402b827 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:37.676532 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-26d9eaa5-6178-4d23-a41e-316b0402b827 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: d280f396-df42-482a-b0c1-9a8a9b608f57] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:37.685185 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26d9eaa5-6178-4d23-a41e-316b0402b827 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:37.688067 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26d9eaa5-6178-4d23-a41e-316b0402b827 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:37.689180 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26d9eaa5-6178-4d23-a41e-316b0402b827 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:37.689312 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26d9eaa5-6178-4d23-a41e-316b0402b827 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:37.689779 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26d9eaa5-6178-4d23-a41e-316b0402b827 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:37.690207 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26d9eaa5-6178-4d23-a41e-316b0402b827 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:37.741472 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7f1cb623-657e-4c23-8940-d4be0224b7ee tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] 10.222.0.60 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.754767 Oct 18 15:38:37.742488 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1538/3130] 10.222.0.60 () {60 vars in 1170 bytes} [Tue Oct 18 15:38:34 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2756 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:38:37.754041 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-92c86e81-b888-4b16-9fb8-4975a34c53b6 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:37.754786 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-92c86e81-b888-4b16-9fb8-4975a34c53b6 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 2059ec7e-ef9b-4eb6-af19-34b2bd09e44a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:37.766472 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92c86e81-b888-4b16-9fb8-4975a34c53b6 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:37.767333 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92c86e81-b888-4b16-9fb8-4975a34c53b6 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:37.768187 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92c86e81-b888-4b16-9fb8-4975a34c53b6 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:37.769969 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92c86e81-b888-4b16-9fb8-4975a34c53b6 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:37.770720 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92c86e81-b888-4b16-9fb8-4975a34c53b6 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:37.771370 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92c86e81-b888-4b16-9fb8-4975a34c53b6 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:37.988201 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-26d9eaa5-6178-4d23-a41e-316b0402b827 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:37.996780 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-26d9eaa5-6178-4d23-a41e-316b0402b827 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57" status: 200 len: 1463 microversion: 2.1 time: 0.325348 Oct 18 15:38:37.997341 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1593/3131] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:37 2022] GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57 => generated 1463 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:38.010220 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ca952215-7ed2-482d-8fb6-93e96a348a80 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:38:38.014314 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:38:38.023239 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca952215-7ed2-482d-8fb6-93e96a348a80 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:38.023664 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca952215-7ed2-482d-8fb6-93e96a348a80 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:38.024108 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca952215-7ed2-482d-8fb6-93e96a348a80 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:38.041323 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-92c86e81-b888-4b16-9fb8-4975a34c53b6 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:38.049387 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-92c86e81-b888-4b16-9fb8-4975a34c53b6 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a" status: 200 len: 1315 microversion: 2.1 time: 0.305933 Oct 18 15:38:38.055383 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1539/3132] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:37 2022] GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a => generated 1315 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:38.061069 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-27f89cf3-44b9-4f16-9838-b801ce638006 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:38.061697 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-27f89cf3-44b9-4f16-9838-b801ce638006 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:38.065821 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ca952215-7ed2-482d-8fb6-93e96a348a80 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 52d725f3-b4da-4831-9abf-bf7aba8aee0a] Going to try to stop instance {{(pid=120405) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 18 15:38:38.132978 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ca952215-7ed2-482d-8fb6-93e96a348a80 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "POST /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a/action" status: 202 len: 0 microversion: 2.1 time: 0.133952 Oct 18 15:38:38.138437 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1594/3133] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:38:37 2022] POST /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:38:38.146325 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4e417d09-d5ee-4a7a-ae1b-3cab3f472d46 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '.version_select at 0x7f7c3d33dca0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:38.154514 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-27f89cf3-44b9-4f16-9838-b801ce638006 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:38.167259 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-27f89cf3-44b9-4f16-9838-b801ce638006 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:38.169456 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-27f89cf3-44b9-4f16-9838-b801ce638006 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:38.170983 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-27f89cf3-44b9-4f16-9838-b801ce638006 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 200 len: 1286 microversion: 2.32 time: 0.120105 Oct 18 15:38:38.172062 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1540/3134] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:38:38 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 1286 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:38:38.179366 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ee67661a-109b-46bd-813c-72acf5cf864a tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1722564081", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "1d57134f-a7f7-40a2-9b98-ada13384a5ff"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:38:38.245473 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4e417d09-d5ee-4a7a-ae1b-3cab3f472d46 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "GET /compute/v2.1/images/8c7b241d-0275-49f6-be6f-40e1e7c6411a" status: 200 len: 1437 microversion: 2.1 time: 0.095829 Oct 18 15:38:38.246441 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-ee67661a-109b-46bd-813c-72acf5cf864a tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] validate_networks() for [('1d57134f-a7f7-40a2-9b98-ada13384a5ff', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:38:38.258599 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1595/3135] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:38:38 2022] GET /compute/v2.1/images/8c7b241d-0275-49f6-be6f-40e1e7c6411a => generated 1437 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:38.272947 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-230b83f7-09f6-4727-9115-81e52b3b42f1 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:38.274101 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-230b83f7-09f6-4727-9115-81e52b3b42f1 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] [instance: d280f396-df42-482a-b0c1-9a8a9b608f57] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:38.283080 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-230b83f7-09f6-4727-9115-81e52b3b42f1 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:38.284129 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-230b83f7-09f6-4727-9115-81e52b3b42f1 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:38.284290 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-230b83f7-09f6-4727-9115-81e52b3b42f1 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:38.285209 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-230b83f7-09f6-4727-9115-81e52b3b42f1 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:38.285957 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-230b83f7-09f6-4727-9115-81e52b3b42f1 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:38.286586 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-230b83f7-09f6-4727-9115-81e52b3b42f1 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:38.564495 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-230b83f7-09f6-4727-9115-81e52b3b42f1 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57" status: 200 len: 1614 microversion: 2.1 time: 0.304816 Oct 18 15:38:38.565545 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1596/3136] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:38 2022] GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57 => generated 1614 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:38.582832 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-76b850e1-bbfc-4df4-947a-b29ccc0d33b0 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:38.583690 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-76b850e1-bbfc-4df4-947a-b29ccc0d33b0 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 52d725f3-b4da-4831-9abf-bf7aba8aee0a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:38.594511 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-76b850e1-bbfc-4df4-947a-b29ccc0d33b0 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:38.595066 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-76b850e1-bbfc-4df4-947a-b29ccc0d33b0 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:38.595512 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-76b850e1-bbfc-4df4-947a-b29ccc0d33b0 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:38.596228 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-76b850e1-bbfc-4df4-947a-b29ccc0d33b0 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:38.596691 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-76b850e1-bbfc-4df4-947a-b29ccc0d33b0 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:38.597175 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-76b850e1-bbfc-4df4-947a-b29ccc0d33b0 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:38.935539 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-76b850e1-bbfc-4df4-947a-b29ccc0d33b0 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304b3248f9db4629943a8b8080a6d22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdc7504a1d1424ea34f83f1a6d4bf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:38.944734 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-76b850e1-bbfc-4df4-947a-b29ccc0d33b0 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a" status: 200 len: 1721 microversion: 2.1 time: 0.369151 Oct 18 15:38:38.947470 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1597/3137] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:38 2022] GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a => generated 1721 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:38.951287 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-20854768-c7dc-46a0-82b5-98b2ea9f4113 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:38.951823 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-20854768-c7dc-46a0-82b5-98b2ea9f4113 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] [instance: 004539c4-260d-46a9-beed-d9c4b9a76106] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:38.958812 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-20854768-c7dc-46a0-82b5-98b2ea9f4113 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:38.959315 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-20854768-c7dc-46a0-82b5-98b2ea9f4113 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:38.961200 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-20854768-c7dc-46a0-82b5-98b2ea9f4113 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:38.961200 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-20854768-c7dc-46a0-82b5-98b2ea9f4113 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:38.961402 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-20854768-c7dc-46a0-82b5-98b2ea9f4113 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:38.961796 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-20854768-c7dc-46a0-82b5-98b2ea9f4113 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:39.180336 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-ee67661a-109b-46bd-813c-72acf5cf864a tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:38:39.180877 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-ee67661a-109b-46bd-813c-72acf5cf864a tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:38:39.181293 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-ee67661a-109b-46bd-813c-72acf5cf864a tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:38:39.181639 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-ee67661a-109b-46bd-813c-72acf5cf864a tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:38:39.182078 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-ee67661a-109b-46bd-813c-72acf5cf864a tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:38:39.191263 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee67661a-109b-46bd-813c-72acf5cf864a tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:39.191742 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee67661a-109b-46bd-813c-72acf5cf864a tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:39.192171 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee67661a-109b-46bd-813c-72acf5cf864a tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:39.194354 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee67661a-109b-46bd-813c-72acf5cf864a tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:39.196761 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee67661a-109b-46bd-813c-72acf5cf864a tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:39.197282 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee67661a-109b-46bd-813c-72acf5cf864a tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:39.220356 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-ee67661a-109b-46bd-813c-72acf5cf864a tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Getting quotas for project c1a84f93ce8049c3a20c3b835f28100f. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:38:39.226014 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-ee67661a-109b-46bd-813c-72acf5cf864a tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Getting quotas for user 1e7ebe0c265144769931ca6262be8860 and project c1a84f93ce8049c3a20c3b835f28100f. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:38:39.234936 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-20854768-c7dc-46a0-82b5-98b2ea9f4113 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36635345398478eb011416cae492244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d7770bf1ee4b46a1e4bdf61dc2d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:39.243765 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-20854768-c7dc-46a0-82b5-98b2ea9f4113 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "GET /compute/v2.1/servers/004539c4-260d-46a9-beed-d9c4b9a76106" status: 200 len: 1467 microversion: 2.1 time: 0.296834 Oct 18 15:38:39.244555 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1598/3138] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:38 2022] GET /compute/v2.1/servers/004539c4-260d-46a9-beed-d9c4b9a76106 => generated 1467 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:39.245118 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ee67661a-109b-46bd-813c-72acf5cf864a tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:38:39.247976 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ee67661a-109b-46bd-813c-72acf5cf864a tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] [instance: 64730348-4d42-40d3-aeac-a4aad6c10d67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:38:39.249937 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-6b55088c-e33b-4232-bf19-9dc570b455cb req-efaf20b3-1589-4c18-b4a8-ded626cd588b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "004539c4-260d-46a9-beed-d9c4b9a76106", "name": "network-vif-unplugged", "status": "completed", "tag": "7e81b5b0-1e7e-436b-84c7-bab9312ea51d"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:38:39.260271 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-6b55088c-e33b-4232-bf19-9dc570b455cb req-efaf20b3-1589-4c18-b4a8-ded626cd588b service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:39.261270 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-6b55088c-e33b-4232-bf19-9dc570b455cb req-efaf20b3-1589-4c18-b4a8-ded626cd588b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:39.261865 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-6b55088c-e33b-4232-bf19-9dc570b455cb req-efaf20b3-1589-4c18-b4a8-ded626cd588b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:39.280841 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-6b55088c-e33b-4232-bf19-9dc570b455cb req-efaf20b3-1589-4c18-b4a8-ded626cd588b service nova] Creating event network-vif-unplugged:7e81b5b0-1e7e-436b-84c7-bab9312ea51d for instance 004539c4-260d-46a9-beed-d9c4b9a76106 on n-h1-853682-5 Oct 18 15:38:39.293489 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-6b55088c-e33b-4232-bf19-9dc570b455cb req-efaf20b3-1589-4c18-b4a8-ded626cd588b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042416 Oct 18 15:38:39.294153 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1599/3139] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:38:39.300017 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-183422a0-283c-4298-99f6-0bee7a5f9059 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:38:39.300700 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-183422a0-283c-4298-99f6-0bee7a5f9059 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] [instance: d280f396-df42-482a-b0c1-9a8a9b608f57] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:39.304177 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ee67661a-109b-46bd-813c-72acf5cf864a tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.130734 Oct 18 15:38:39.305190 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1541/3140] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:38:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1132 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:38:39.308196 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-183422a0-283c-4298-99f6-0bee7a5f9059 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:39.308918 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-183422a0-283c-4298-99f6-0bee7a5f9059 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:39.309530 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-183422a0-283c-4298-99f6-0bee7a5f9059 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:39.310394 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-183422a0-283c-4298-99f6-0bee7a5f9059 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:39.310544 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-7f94812f-c4df-4037-9e3c-fd996d9fe523 req-67c3d41f-67df-4d25-a3b9-4057df997d2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2059ec7e-ef9b-4eb6-af19-34b2bd09e44a", "tag": "b98e9e22-f73c-442c-91b4-ae56414e19d7"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:38:39.311184 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-183422a0-283c-4298-99f6-0bee7a5f9059 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:39.311987 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-183422a0-283c-4298-99f6-0bee7a5f9059 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:39.321851 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7f94812f-c4df-4037-9e3c-fd996d9fe523 req-67c3d41f-67df-4d25-a3b9-4057df997d2c service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:39.322332 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7f94812f-c4df-4037-9e3c-fd996d9fe523 req-67c3d41f-67df-4d25-a3b9-4057df997d2c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:39.322948 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7f94812f-c4df-4037-9e3c-fd996d9fe523 req-67c3d41f-67df-4d25-a3b9-4057df997d2c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:39.335615 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-7f94812f-c4df-4037-9e3c-fd996d9fe523 req-67c3d41f-67df-4d25-a3b9-4057df997d2c service nova] Creating event network-changed:b98e9e22-f73c-442c-91b4-ae56414e19d7 for instance 2059ec7e-ef9b-4eb6-af19-34b2bd09e44a on n-h1-853682-5 Oct 18 15:38:39.341665 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-7f94812f-c4df-4037-9e3c-fd996d9fe523 req-67c3d41f-67df-4d25-a3b9-4057df997d2c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035004 Oct 18 15:38:39.342598 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1542/3141] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:38:39.348968 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-74f74d7d-cd00-4617-a722-8ddac54e65d6 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:39.350494 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-74f74d7d-cd00-4617-a722-8ddac54e65d6 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 2059ec7e-ef9b-4eb6-af19-34b2bd09e44a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:39.357173 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-74f74d7d-cd00-4617-a722-8ddac54e65d6 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:39.357888 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-74f74d7d-cd00-4617-a722-8ddac54e65d6 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:39.358519 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-74f74d7d-cd00-4617-a722-8ddac54e65d6 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:39.359383 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-74f74d7d-cd00-4617-a722-8ddac54e65d6 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:39.360073 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-74f74d7d-cd00-4617-a722-8ddac54e65d6 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:39.360661 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-74f74d7d-cd00-4617-a722-8ddac54e65d6 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:39.386993 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-183422a0-283c-4298-99f6-0bee7a5f9059 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '9b648f2cf13d47eb83430c71cd7737b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda0ca6818f141308683b72cf0c6aac5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:39.389757 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-183422a0-283c-4298-99f6-0bee7a5f9059 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] [instance: d280f396-df42-482a-b0c1-9a8a9b608f57] flavor_id is None. Assuming migration. {{(pid=120405) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 18 15:38:39.390390 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-183422a0-283c-4298-99f6-0bee7a5f9059 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] [instance: d280f396-df42-482a-b0c1-9a8a9b608f57] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120405) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 18 15:38:39.766020 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-183422a0-283c-4298-99f6-0bee7a5f9059 tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57/action" status: 202 len: 0 microversion: 2.1 time: 0.470196 Oct 18 15:38:39.770535 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1600/3142] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:38:39 2022] POST /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57/action => generated 0 bytes in 475 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:38:39.776230 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-436cca56-9ed8-4295-8061-8d4268baa303 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:39.777302 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-436cca56-9ed8-4295-8061-8d4268baa303 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:39.785455 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-436cca56-9ed8-4295-8061-8d4268baa303 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:39.785958 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-436cca56-9ed8-4295-8061-8d4268baa303 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:39.786452 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-436cca56-9ed8-4295-8061-8d4268baa303 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:39.787360 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-436cca56-9ed8-4295-8061-8d4268baa303 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:39.787832 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-436cca56-9ed8-4295-8061-8d4268baa303 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:39.788266 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-436cca56-9ed8-4295-8061-8d4268baa303 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:40.002198 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-436cca56-9ed8-4295-8061-8d4268baa303 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:40.013683 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-436cca56-9ed8-4295-8061-8d4268baa303 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:40.015437 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-436cca56-9ed8-4295-8061-8d4268baa303 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:40.017059 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-436cca56-9ed8-4295-8061-8d4268baa303 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 200 len: 1594 microversion: 2.32 time: 0.245249 Oct 18 15:38:40.017845 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1601/3143] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:38:39 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 1594 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:38:40.034194 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-80591b4f-fce2-4695-b018-1b64f86dafd0 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '.version_select at 0x7f7c3d3bc700>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:40.154924 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-74f74d7d-cd00-4617-a722-8ddac54e65d6 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:40.161204 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:38:40.173287 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-74f74d7d-cd00-4617-a722-8ddac54e65d6 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a" status: 200 len: 1315 microversion: 2.1 time: 0.828760 Oct 18 15:38:40.174149 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1543/3144] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:39 2022] GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a => generated 1315 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:40.181095 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a96e5c15-b54e-4f3c-b78f-32b0021bfaf8 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:40.182363 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a96e5c15-b54e-4f3c-b78f-32b0021bfaf8 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] [instance: 64730348-4d42-40d3-aeac-a4aad6c10d67] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:40.190135 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a96e5c15-b54e-4f3c-b78f-32b0021bfaf8 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:40.191257 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a96e5c15-b54e-4f3c-b78f-32b0021bfaf8 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:40.191866 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a96e5c15-b54e-4f3c-b78f-32b0021bfaf8 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:40.193126 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a96e5c15-b54e-4f3c-b78f-32b0021bfaf8 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:40.193862 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a96e5c15-b54e-4f3c-b78f-32b0021bfaf8 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:40.194543 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a96e5c15-b54e-4f3c-b78f-32b0021bfaf8 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:40.383684 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a96e5c15-b54e-4f3c-b78f-32b0021bfaf8 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7ebe0c265144769931ca6262be8860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a84f93ce8049c3a20c3b835f28100f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:40.399638 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a96e5c15-b54e-4f3c-b78f-32b0021bfaf8 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] 10.222.0.60 "GET /compute/v2.1/servers/64730348-4d42-40d3-aeac-a4aad6c10d67" status: 200 len: 1220 microversion: 2.1 time: 0.224114 Oct 18 15:38:40.409418 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1544/3145] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:40 2022] GET /compute/v2.1/servers/64730348-4d42-40d3-aeac-a4aad6c10d67 => generated 1220 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:40.409418 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b0842660-5db8-4dab-b5cd-b117bddc1371 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:40.409418 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b0842660-5db8-4dab-b5cd-b117bddc1371 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: d280f396-df42-482a-b0c1-9a8a9b608f57] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:40.429033 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b0842660-5db8-4dab-b5cd-b117bddc1371 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:40.429538 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b0842660-5db8-4dab-b5cd-b117bddc1371 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:40.429983 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b0842660-5db8-4dab-b5cd-b117bddc1371 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:40.430746 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b0842660-5db8-4dab-b5cd-b117bddc1371 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:40.431165 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b0842660-5db8-4dab-b5cd-b117bddc1371 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:40.431598 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b0842660-5db8-4dab-b5cd-b117bddc1371 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:40.823050 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-80591b4f-fce2-4695-b018-1b64f86dafd0 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "DELETE /compute/v2.1/images/8c7b241d-0275-49f6-be6f-40e1e7c6411a" status: 204 len: 0 microversion: 2.1 time: 0.803770 Oct 18 15:38:40.823732 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b0842660-5db8-4dab-b5cd-b117bddc1371 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:40.823855 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1602/3146] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:40 2022] DELETE /compute/v2.1/images/8c7b241d-0275-49f6-be6f-40e1e7c6411a => generated 0 bytes in 805 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:38:40.830729 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3cc05322-6335-4f01-b176-b242c24d84d7 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:40.831571 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3cc05322-6335-4f01-b176-b242c24d84d7 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 52d725f3-b4da-4831-9abf-bf7aba8aee0a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:40.832430 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b0842660-5db8-4dab-b5cd-b117bddc1371 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57" status: 200 len: 1472 microversion: 2.1 time: 0.430244 Oct 18 15:38:40.839473 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3cc05322-6335-4f01-b176-b242c24d84d7 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:40.840202 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3cc05322-6335-4f01-b176-b242c24d84d7 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:40.841772 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3cc05322-6335-4f01-b176-b242c24d84d7 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:40.842676 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3cc05322-6335-4f01-b176-b242c24d84d7 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:40.843306 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3cc05322-6335-4f01-b176-b242c24d84d7 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:40.852846 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1545/3147] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:40 2022] GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57 => generated 1472 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:40.852846 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5929a68d-25ea-4d84-8563-1164229e27b9 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '.version_select at 0x7f7c3cf5a670>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:40.860989 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3cc05322-6335-4f01-b176-b242c24d84d7 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:40.887460 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-5929a68d-25ea-4d84-8563-1164229e27b9 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] HTTP exception thrown: Image not found. Oct 18 15:38:40.889619 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5929a68d-25ea-4d84-8563-1164229e27b9 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Request method failure captured: Oct 18 15:38:40.889619 n-d-853682-5 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/images/8ce4db55-b062-45bf-b0b6-d3fb96c3e2c5 HTTP/1.1 Oct 18 15:38:40.889619 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:38:40.889619 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:38:40.889619 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:38:40.889619 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:38:40.889619 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:38:40.889619 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:38:40.889619 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:38:40.889619 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:38:40.889619 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsgZIxcsBpIyN12ziKYEdO7XibCyRnIMm8to_2d3DUY0hst7pF3zwBKH3SrCEfyZ1IPKhv0sOmTCzuD5u29MD0_MdUjVA2ChKkvSWhZVMMt68CPj1j24sPqtJXPPO9S7wbdfpH5GLw5R9nyjPOdvZ4muCnpZqkNHUmlN-5YmT1uNIz0 Oct 18 15:38:40.889619 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:38:40.889619 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:38:40.889619 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:38:40.889619 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:38:40.889619 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:38:40.889619 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:38:40.889619 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 68d7770bf1ee4b46a1e4bdf61dc2d711 Oct 18 15:38:40.889619 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ImagesOneServerTestJSON-1874252287 Oct 18 15:38:40.889619 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:38:40.889619 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:38:40.891217 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/68d7770bf1ee4b46a1e4bdf61dc2d711"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/68d7770bf1ee4b46a1e4bdf61dc2d711"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/68d7770bf1ee4b46a1e4bdf61dc2d711"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_68d7770bf1ee4b46a1e4bdf61dc2d711"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:38:40.891217 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ImagesOneServerTestJSON-1874252287 Oct 18 15:38:40.891217 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 68d7770bf1ee4b46a1e4bdf61dc2d711 Oct 18 15:38:40.891217 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1874252287 Oct 18 15:38:40.891217 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ImagesOneServerTestJSON-1874252287-project Oct 18 15:38:40.891217 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:38:40.891217 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:38:40.891217 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: f36635345398478eb011416cae492244 Oct 18 15:38:40.891217 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ImagesOneServerTestJSON-1874252287-project Oct 18 15:38:40.891217 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:38:40.891217 n-d-853682-5 devstack@n-api.service[120406]: exception: Image not found. Oct 18 15:38:40.891217 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '8ce4db55-b062-45bf-b0b6-d3fb96c3e2c5'} Oct 18 15:38:40.891217 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:38:40.892246 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:38:40.892246 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 18 15:38:40.892246 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 18 15:38:40.892246 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 15:38:40.892246 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 15:38:40.892246 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 15:38:40.892246 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 15:38:40.892246 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 18 15:38:40.892246 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 18 15:38:40.892246 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 18 15:38:40.892246 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 18 15:38:40.892246 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 15:38:40.892246 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 15:38:40.892246 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 15:38:40.892246 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 15:38:40.892246 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8ce4db55-b062-45bf-b0b6-d3fb96c3e2c5 to delete Oct 18 15:38:40.892246 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:38:40.892246 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:38:40.892246 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:38:40.893702 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:38:40.893702 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 18 15:38:40.893702 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 18 15:38:40.893702 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 18 15:38:40.893702 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 18 15:38:40.893702 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 18 15:38:40.893702 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 18 15:38:40.893702 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8ce4db55-b062-45bf-b0b6-d3fb96c3e2c5 could not be found. Oct 18 15:38:40.893702 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:38:40.893702 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:38:40.893702 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:38:40.893702 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:38:40.893702 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:38:40.893702 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:38:40.893702 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:38:40.893702 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:38:40.893702 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:38:40.893702 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:38:40.893702 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:38:40.893702 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:38:40.895574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 18 15:38:40.895574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 15:38:40.895574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 15:38:40.895574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:38:40.895574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:38:40.895574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:38:40.895574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:38:40.895574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:38:40.895574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:38:40.895574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:38:40.895574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:38:40.895574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 15:38:40.895574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:38:40.895574 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5929a68d-25ea-4d84-8563-1164229e27b9 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Returning 404 to user: Image not found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:38:40.895574 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5929a68d-25ea-4d84-8563-1164229e27b9 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "DELETE /compute/v2.1/images/8ce4db55-b062-45bf-b0b6-d3fb96c3e2c5" status: 404 len: 62 microversion: 2.1 time: 0.048544 Oct 18 15:38:40.905374 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1546/3148] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:40 2022] DELETE /compute/v2.1/images/8ce4db55-b062-45bf-b0b6-d3fb96c3e2c5 => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 15:38:40.906615 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c834ea08-98e5-4124-9df9-5b621830f41f tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:40.907293 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c834ea08-98e5-4124-9df9-5b621830f41f tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] [instance: 004539c4-260d-46a9-beed-d9c4b9a76106] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:40.919643 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c834ea08-98e5-4124-9df9-5b621830f41f tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:40.920256 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c834ea08-98e5-4124-9df9-5b621830f41f tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:40.920778 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c834ea08-98e5-4124-9df9-5b621830f41f tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:40.921601 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c834ea08-98e5-4124-9df9-5b621830f41f tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:40.922175 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c834ea08-98e5-4124-9df9-5b621830f41f tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:40.922911 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c834ea08-98e5-4124-9df9-5b621830f41f tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:40.959589 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c834ea08-98e5-4124-9df9-5b621830f41f tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] [instance: 004539c4-260d-46a9-beed-d9c4b9a76106] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:38:41.066024 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c834ea08-98e5-4124-9df9-5b621830f41f tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "DELETE /compute/v2.1/servers/004539c4-260d-46a9-beed-d9c4b9a76106" status: 204 len: 0 microversion: 2.1 time: 0.165207 Oct 18 15:38:41.067636 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1547/3149] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:38:40 2022] DELETE /compute/v2.1/servers/004539c4-260d-46a9-beed-d9c4b9a76106 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 15:38:41.077755 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6388f3d3-eee1-42eb-9b23-0245ecd5d3d9 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:41.078735 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6388f3d3-eee1-42eb-9b23-0245ecd5d3d9 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:41.086652 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6388f3d3-eee1-42eb-9b23-0245ecd5d3d9 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:41.087332 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6388f3d3-eee1-42eb-9b23-0245ecd5d3d9 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:41.087930 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6388f3d3-eee1-42eb-9b23-0245ecd5d3d9 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:41.089320 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6388f3d3-eee1-42eb-9b23-0245ecd5d3d9 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:41.091949 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6388f3d3-eee1-42eb-9b23-0245ecd5d3d9 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:41.092426 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6388f3d3-eee1-42eb-9b23-0245ecd5d3d9 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:41.128970 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3cc05322-6335-4f01-b176-b242c24d84d7 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304b3248f9db4629943a8b8080a6d22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdc7504a1d1424ea34f83f1a6d4bf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:41.133795 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:38:41.144420 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3cc05322-6335-4f01-b176-b242c24d84d7 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a" status: 200 len: 1721 microversion: 2.1 time: 0.319534 Oct 18 15:38:41.145897 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1603/3150] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:40 2022] GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a => generated 1721 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:41.152599 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-cd3f15ab-71e5-4f10-9e81-085cd6bc0143 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:41.153559 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-cd3f15ab-71e5-4f10-9e81-085cd6bc0143 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] [instance: 004539c4-260d-46a9-beed-d9c4b9a76106] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:41.162862 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cd3f15ab-71e5-4f10-9e81-085cd6bc0143 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:41.164067 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cd3f15ab-71e5-4f10-9e81-085cd6bc0143 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:41.164718 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cd3f15ab-71e5-4f10-9e81-085cd6bc0143 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:41.165734 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cd3f15ab-71e5-4f10-9e81-085cd6bc0143 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:41.166398 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cd3f15ab-71e5-4f10-9e81-085cd6bc0143 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:41.167435 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cd3f15ab-71e5-4f10-9e81-085cd6bc0143 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:41.183694 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6388f3d3-eee1-42eb-9b23-0245ecd5d3d9 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:41.199014 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6388f3d3-eee1-42eb-9b23-0245ecd5d3d9 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:41.201025 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6388f3d3-eee1-42eb-9b23-0245ecd5d3d9 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:41.202764 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6388f3d3-eee1-42eb-9b23-0245ecd5d3d9 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 200 len: 1594 microversion: 2.32 time: 0.132711 Oct 18 15:38:41.203993 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1548/3151] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:38:41 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 1594 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:38:41.216565 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2984ce73-b39d-4fd4-9fe5-4c6b2cb576e0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:41.217288 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2984ce73-b39d-4fd4-9fe5-4c6b2cb576e0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 2059ec7e-ef9b-4eb6-af19-34b2bd09e44a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:41.234084 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2984ce73-b39d-4fd4-9fe5-4c6b2cb576e0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:41.234753 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2984ce73-b39d-4fd4-9fe5-4c6b2cb576e0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:41.235308 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2984ce73-b39d-4fd4-9fe5-4c6b2cb576e0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:41.236150 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2984ce73-b39d-4fd4-9fe5-4c6b2cb576e0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:41.236723 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2984ce73-b39d-4fd4-9fe5-4c6b2cb576e0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:41.237265 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2984ce73-b39d-4fd4-9fe5-4c6b2cb576e0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:41.503566 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-cd3f15ab-71e5-4f10-9e81-085cd6bc0143 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36635345398478eb011416cae492244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d7770bf1ee4b46a1e4bdf61dc2d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:41.512882 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-cd3f15ab-71e5-4f10-9e81-085cd6bc0143 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "GET /compute/v2.1/servers/004539c4-260d-46a9-beed-d9c4b9a76106" status: 200 len: 1473 microversion: 2.1 time: 0.364601 Oct 18 15:38:41.513571 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1604/3152] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:41 2022] GET /compute/v2.1/servers/004539c4-260d-46a9-beed-d9c4b9a76106 => generated 1473 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:41.518566 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-43f14881-6c06-4ddd-8137-0c28b20028a8 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:41.519449 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-43f14881-6c06-4ddd-8137-0c28b20028a8 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] [instance: 64730348-4d42-40d3-aeac-a4aad6c10d67] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:41.525773 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-43f14881-6c06-4ddd-8137-0c28b20028a8 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:41.526581 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-43f14881-6c06-4ddd-8137-0c28b20028a8 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:41.527246 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-43f14881-6c06-4ddd-8137-0c28b20028a8 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:41.528178 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-43f14881-6c06-4ddd-8137-0c28b20028a8 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:41.528902 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-43f14881-6c06-4ddd-8137-0c28b20028a8 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:41.529561 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-43f14881-6c06-4ddd-8137-0c28b20028a8 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:41.557758 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2984ce73-b39d-4fd4-9fe5-4c6b2cb576e0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:41.568052 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2984ce73-b39d-4fd4-9fe5-4c6b2cb576e0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a" status: 200 len: 1315 microversion: 2.1 time: 0.362347 Oct 18 15:38:41.568845 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1549/3153] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:41 2022] GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a => generated 1315 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:41.644162 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-43f14881-6c06-4ddd-8137-0c28b20028a8 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7ebe0c265144769931ca6262be8860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a84f93ce8049c3a20c3b835f28100f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:41.655652 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-43f14881-6c06-4ddd-8137-0c28b20028a8 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] 10.222.0.60 "GET /compute/v2.1/servers/64730348-4d42-40d3-aeac-a4aad6c10d67" status: 200 len: 1276 microversion: 2.1 time: 0.140163 Oct 18 15:38:41.658734 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1605/3154] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:41 2022] GET /compute/v2.1/servers/64730348-4d42-40d3-aeac-a4aad6c10d67 => generated 1276 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:41.870340 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-193cc4f0-f38c-4873-9354-67b467c5f1f7 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:41.872768 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-193cc4f0-f38c-4873-9354-67b467c5f1f7 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: d280f396-df42-482a-b0c1-9a8a9b608f57] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:41.879397 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-193cc4f0-f38c-4873-9354-67b467c5f1f7 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:41.880620 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-193cc4f0-f38c-4873-9354-67b467c5f1f7 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:41.881236 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-193cc4f0-f38c-4873-9354-67b467c5f1f7 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:41.883070 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-193cc4f0-f38c-4873-9354-67b467c5f1f7 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:41.883776 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-193cc4f0-f38c-4873-9354-67b467c5f1f7 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:41.884103 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-193cc4f0-f38c-4873-9354-67b467c5f1f7 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:42.112507 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-193cc4f0-f38c-4873-9354-67b467c5f1f7 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:42.121934 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-193cc4f0-f38c-4873-9354-67b467c5f1f7 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57" status: 200 len: 1472 microversion: 2.1 time: 0.258116 Oct 18 15:38:42.122638 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1550/3155] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:41 2022] GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57 => generated 1472 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:42.182631 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1d457d40-9f2a-41a0-afa2-acc58a6c2f17 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:42.185392 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1d457d40-9f2a-41a0-afa2-acc58a6c2f17 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 52d725f3-b4da-4831-9abf-bf7aba8aee0a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:42.199908 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1d457d40-9f2a-41a0-afa2-acc58a6c2f17 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:42.200407 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1d457d40-9f2a-41a0-afa2-acc58a6c2f17 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:42.200869 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1d457d40-9f2a-41a0-afa2-acc58a6c2f17 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:42.202959 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1d457d40-9f2a-41a0-afa2-acc58a6c2f17 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:42.203440 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1d457d40-9f2a-41a0-afa2-acc58a6c2f17 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:42.203875 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1d457d40-9f2a-41a0-afa2-acc58a6c2f17 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:42.235405 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-729632a4-ecd4-40f5-9d23-ba6f529b19d2 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:42.236137 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-729632a4-ecd4-40f5-9d23-ba6f529b19d2 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:42.244310 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-729632a4-ecd4-40f5-9d23-ba6f529b19d2 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:42.244937 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-729632a4-ecd4-40f5-9d23-ba6f529b19d2 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:42.245799 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-729632a4-ecd4-40f5-9d23-ba6f529b19d2 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:42.246674 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-729632a4-ecd4-40f5-9d23-ba6f529b19d2 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:42.247286 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-729632a4-ecd4-40f5-9d23-ba6f529b19d2 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:42.247867 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-729632a4-ecd4-40f5-9d23-ba6f529b19d2 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:42.517258 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1d457d40-9f2a-41a0-afa2-acc58a6c2f17 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304b3248f9db4629943a8b8080a6d22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdc7504a1d1424ea34f83f1a6d4bf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:42.526991 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1d457d40-9f2a-41a0-afa2-acc58a6c2f17 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a" status: 200 len: 1721 microversion: 2.1 time: 0.357363 Oct 18 15:38:42.528065 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1606/3156] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:42 2022] GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a => generated 1721 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:42.533678 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-729632a4-ecd4-40f5-9d23-ba6f529b19d2 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:42.545607 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bfe2dccc-6109-4f39-a286-d8b517e3fa57 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:42.546250 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-bfe2dccc-6109-4f39-a286-d8b517e3fa57 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] [instance: 004539c4-260d-46a9-beed-d9c4b9a76106] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:42.553274 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bfe2dccc-6109-4f39-a286-d8b517e3fa57 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:42.553763 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bfe2dccc-6109-4f39-a286-d8b517e3fa57 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:42.554193 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bfe2dccc-6109-4f39-a286-d8b517e3fa57 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:42.554897 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bfe2dccc-6109-4f39-a286-d8b517e3fa57 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:42.555349 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bfe2dccc-6109-4f39-a286-d8b517e3fa57 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:42.555770 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bfe2dccc-6109-4f39-a286-d8b517e3fa57 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:42.561437 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-729632a4-ecd4-40f5-9d23-ba6f529b19d2 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:42.563275 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-729632a4-ecd4-40f5-9d23-ba6f529b19d2 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:42.564626 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-729632a4-ecd4-40f5-9d23-ba6f529b19d2 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 200 len: 1662 microversion: 2.32 time: 0.333694 Oct 18 15:38:42.565213 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1551/3157] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:38:42 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 1662 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:38:42.592659 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-44ae6635-54dc-473b-8d15-073ef6363ffa tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:42.593828 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-44ae6635-54dc-473b-8d15-073ef6363ffa tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 2059ec7e-ef9b-4eb6-af19-34b2bd09e44a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:42.601116 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44ae6635-54dc-473b-8d15-073ef6363ffa tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:42.601571 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44ae6635-54dc-473b-8d15-073ef6363ffa tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:42.602003 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44ae6635-54dc-473b-8d15-073ef6363ffa tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:42.602878 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44ae6635-54dc-473b-8d15-073ef6363ffa tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:42.603190 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44ae6635-54dc-473b-8d15-073ef6363ffa tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:42.603855 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44ae6635-54dc-473b-8d15-073ef6363ffa tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:42.884125 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-bfe2dccc-6109-4f39-a286-d8b517e3fa57 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36635345398478eb011416cae492244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d7770bf1ee4b46a1e4bdf61dc2d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:42.896609 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-bfe2dccc-6109-4f39-a286-d8b517e3fa57 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "GET /compute/v2.1/servers/004539c4-260d-46a9-beed-d9c4b9a76106" status: 200 len: 1473 microversion: 2.1 time: 0.363426 Oct 18 15:38:42.899163 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1607/3158] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:42 2022] GET /compute/v2.1/servers/004539c4-260d-46a9-beed-d9c4b9a76106 => generated 1473 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:42.906933 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-44ae6635-54dc-473b-8d15-073ef6363ffa tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:42.908116 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ee95b526-383c-40f7-a531-faa26b9c13ae tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:42.908750 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ee95b526-383c-40f7-a531-faa26b9c13ae tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] [instance: 64730348-4d42-40d3-aeac-a4aad6c10d67] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:42.919404 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ee95b526-383c-40f7-a531-faa26b9c13ae tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:42.919639 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-44ae6635-54dc-473b-8d15-073ef6363ffa tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a" status: 200 len: 1315 microversion: 2.1 time: 0.328885 Oct 18 15:38:42.920556 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1552/3159] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:42 2022] GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a => generated 1315 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:38:42.920829 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ee95b526-383c-40f7-a531-faa26b9c13ae tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:42.922354 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ee95b526-383c-40f7-a531-faa26b9c13ae tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:42.923320 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ee95b526-383c-40f7-a531-faa26b9c13ae tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:42.923999 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ee95b526-383c-40f7-a531-faa26b9c13ae tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:42.924656 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ee95b526-383c-40f7-a531-faa26b9c13ae tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:43.016626 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ee95b526-383c-40f7-a531-faa26b9c13ae tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7ebe0c265144769931ca6262be8860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a84f93ce8049c3a20c3b835f28100f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:43.029190 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ee95b526-383c-40f7-a531-faa26b9c13ae tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] 10.222.0.60 "GET /compute/v2.1/servers/64730348-4d42-40d3-aeac-a4aad6c10d67" status: 200 len: 1276 microversion: 2.1 time: 0.130813 Oct 18 15:38:43.030132 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1608/3160] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:42 2022] GET /compute/v2.1/servers/64730348-4d42-40d3-aeac-a4aad6c10d67 => generated 1276 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:43.145733 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e7d2026f-5708-4975-9cbc-cd0b7870c2b0 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:43.147131 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e7d2026f-5708-4975-9cbc-cd0b7870c2b0 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: d280f396-df42-482a-b0c1-9a8a9b608f57] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:43.155371 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7d2026f-5708-4975-9cbc-cd0b7870c2b0 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:43.155862 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7d2026f-5708-4975-9cbc-cd0b7870c2b0 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:43.156302 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7d2026f-5708-4975-9cbc-cd0b7870c2b0 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:43.163649 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7d2026f-5708-4975-9cbc-cd0b7870c2b0 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:43.164144 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7d2026f-5708-4975-9cbc-cd0b7870c2b0 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:43.164763 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7d2026f-5708-4975-9cbc-cd0b7870c2b0 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:43.388892 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e7d2026f-5708-4975-9cbc-cd0b7870c2b0 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:43.397797 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e7d2026f-5708-4975-9cbc-cd0b7870c2b0 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57" status: 200 len: 1472 microversion: 2.1 time: 0.256298 Oct 18 15:38:43.398389 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1553/3161] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:43 2022] GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57 => generated 1472 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:43.551278 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2758c282-a0a4-43cd-8533-6e4c1a2e23ce tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:43.551894 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2758c282-a0a4-43cd-8533-6e4c1a2e23ce tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 52d725f3-b4da-4831-9abf-bf7aba8aee0a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:43.560029 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2758c282-a0a4-43cd-8533-6e4c1a2e23ce tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:43.560683 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2758c282-a0a4-43cd-8533-6e4c1a2e23ce tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:43.561414 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2758c282-a0a4-43cd-8533-6e4c1a2e23ce tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:43.562263 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2758c282-a0a4-43cd-8533-6e4c1a2e23ce tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:43.562825 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2758c282-a0a4-43cd-8533-6e4c1a2e23ce tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:43.563321 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2758c282-a0a4-43cd-8533-6e4c1a2e23ce tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:43.591265 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1e5a6930-cc88-449a-9f1f-05f2a02942bc tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:43.592109 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1e5a6930-cc88-449a-9f1f-05f2a02942bc tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:43.606202 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e5a6930-cc88-449a-9f1f-05f2a02942bc tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:43.611577 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e5a6930-cc88-449a-9f1f-05f2a02942bc tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:43.612236 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e5a6930-cc88-449a-9f1f-05f2a02942bc tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:43.613058 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e5a6930-cc88-449a-9f1f-05f2a02942bc tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:43.613643 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e5a6930-cc88-449a-9f1f-05f2a02942bc tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:43.614068 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e5a6930-cc88-449a-9f1f-05f2a02942bc tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:43.907037 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2758c282-a0a4-43cd-8533-6e4c1a2e23ce tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304b3248f9db4629943a8b8080a6d22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdc7504a1d1424ea34f83f1a6d4bf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:43.917063 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2758c282-a0a4-43cd-8533-6e4c1a2e23ce tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a" status: 200 len: 1721 microversion: 2.1 time: 0.369734 Oct 18 15:38:43.918222 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1609/3162] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:43 2022] GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a => generated 1721 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:43.939560 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-23eec8fb-95a4-45e3-9529-095307f0e1b8 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:43.940343 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-23eec8fb-95a4-45e3-9529-095307f0e1b8 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] [instance: 004539c4-260d-46a9-beed-d9c4b9a76106] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:43.947164 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-23eec8fb-95a4-45e3-9529-095307f0e1b8 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:43.947865 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-23eec8fb-95a4-45e3-9529-095307f0e1b8 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:43.948409 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-23eec8fb-95a4-45e3-9529-095307f0e1b8 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:43.949288 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-23eec8fb-95a4-45e3-9529-095307f0e1b8 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:43.949856 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-23eec8fb-95a4-45e3-9529-095307f0e1b8 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:43.950389 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-23eec8fb-95a4-45e3-9529-095307f0e1b8 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:43.964745 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1e5a6930-cc88-449a-9f1f-05f2a02942bc tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:43.990488 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1e5a6930-cc88-449a-9f1f-05f2a02942bc tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:43.993979 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1e5a6930-cc88-449a-9f1f-05f2a02942bc tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:43.995304 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1e5a6930-cc88-449a-9f1f-05f2a02942bc tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 200 len: 1756 microversion: 2.32 time: 0.408595 Oct 18 15:38:43.995879 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1554/3163] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:38:43 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 1756 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:38:44.011255 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1bca5b89-928c-4ed6-be88-9cc38e1c4d9d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:44.011255 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1bca5b89-928c-4ed6-be88-9cc38e1c4d9d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 2059ec7e-ef9b-4eb6-af19-34b2bd09e44a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:44.021539 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1bca5b89-928c-4ed6-be88-9cc38e1c4d9d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:44.021888 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1bca5b89-928c-4ed6-be88-9cc38e1c4d9d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:44.023002 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1bca5b89-928c-4ed6-be88-9cc38e1c4d9d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:44.023721 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1bca5b89-928c-4ed6-be88-9cc38e1c4d9d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:44.024170 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1bca5b89-928c-4ed6-be88-9cc38e1c4d9d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:44.024592 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1bca5b89-928c-4ed6-be88-9cc38e1c4d9d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:44.266544 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-23eec8fb-95a4-45e3-9529-095307f0e1b8 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36635345398478eb011416cae492244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d7770bf1ee4b46a1e4bdf61dc2d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:44.276274 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-23eec8fb-95a4-45e3-9529-095307f0e1b8 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "GET /compute/v2.1/servers/004539c4-260d-46a9-beed-d9c4b9a76106" status: 200 len: 1473 microversion: 2.1 time: 0.342200 Oct 18 15:38:44.276608 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1610/3164] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:43 2022] GET /compute/v2.1/servers/004539c4-260d-46a9-beed-d9c4b9a76106 => generated 1473 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:38:44.282744 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1e1c6ec6-2adb-4243-87e0-14601ea977f8 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:44.283661 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1e1c6ec6-2adb-4243-87e0-14601ea977f8 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] [instance: 64730348-4d42-40d3-aeac-a4aad6c10d67] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:44.292036 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1e1c6ec6-2adb-4243-87e0-14601ea977f8 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:44.292860 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1e1c6ec6-2adb-4243-87e0-14601ea977f8 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:44.293532 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1e1c6ec6-2adb-4243-87e0-14601ea977f8 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:44.295063 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1e1c6ec6-2adb-4243-87e0-14601ea977f8 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:44.295642 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1e1c6ec6-2adb-4243-87e0-14601ea977f8 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:44.296179 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1e1c6ec6-2adb-4243-87e0-14601ea977f8 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:44.307483 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1bca5b89-928c-4ed6-be88-9cc38e1c4d9d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:44.317804 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1bca5b89-928c-4ed6-be88-9cc38e1c4d9d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a" status: 200 len: 1315 microversion: 2.1 time: 0.320861 Oct 18 15:38:44.320215 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1555/3165] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:43 2022] GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:44.393305 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1e1c6ec6-2adb-4243-87e0-14601ea977f8 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7ebe0c265144769931ca6262be8860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a84f93ce8049c3a20c3b835f28100f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:44.402152 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1e1c6ec6-2adb-4243-87e0-14601ea977f8 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] 10.222.0.60 "GET /compute/v2.1/servers/64730348-4d42-40d3-aeac-a4aad6c10d67" status: 200 len: 1276 microversion: 2.1 time: 0.124257 Oct 18 15:38:44.402884 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1611/3166] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:44 2022] GET /compute/v2.1/servers/64730348-4d42-40d3-aeac-a4aad6c10d67 => generated 1276 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:44.422183 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d1edb722-8efa-4c02-804c-d639efddec10 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:44.422962 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d1edb722-8efa-4c02-804c-d639efddec10 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: d280f396-df42-482a-b0c1-9a8a9b608f57] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:44.429201 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1edb722-8efa-4c02-804c-d639efddec10 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:44.429805 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1edb722-8efa-4c02-804c-d639efddec10 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:44.430386 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1edb722-8efa-4c02-804c-d639efddec10 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:44.431310 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1edb722-8efa-4c02-804c-d639efddec10 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:44.432180 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1edb722-8efa-4c02-804c-d639efddec10 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:44.432371 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1edb722-8efa-4c02-804c-d639efddec10 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:44.635239 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d1edb722-8efa-4c02-804c-d639efddec10 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:44.643539 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d1edb722-8efa-4c02-804c-d639efddec10 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57" status: 200 len: 1472 microversion: 2.1 time: 0.225401 Oct 18 15:38:44.644050 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1556/3167] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:44 2022] GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57 => generated 1472 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:44.942720 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3dc7ddd9-c281-417f-bd28-bbdcfc14ec66 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:44.944095 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3dc7ddd9-c281-417f-bd28-bbdcfc14ec66 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 52d725f3-b4da-4831-9abf-bf7aba8aee0a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:44.956108 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3dc7ddd9-c281-417f-bd28-bbdcfc14ec66 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:44.956944 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3dc7ddd9-c281-417f-bd28-bbdcfc14ec66 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:44.957654 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3dc7ddd9-c281-417f-bd28-bbdcfc14ec66 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:44.959149 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3dc7ddd9-c281-417f-bd28-bbdcfc14ec66 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:44.965675 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3dc7ddd9-c281-417f-bd28-bbdcfc14ec66 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:44.966348 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3dc7ddd9-c281-417f-bd28-bbdcfc14ec66 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:45.024643 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-63fbf3ea-6a6a-4c38-9799-a08c85d45807 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:45.026572 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-63fbf3ea-6a6a-4c38-9799-a08c85d45807 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:45.035855 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63fbf3ea-6a6a-4c38-9799-a08c85d45807 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:45.037167 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63fbf3ea-6a6a-4c38-9799-a08c85d45807 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:45.037761 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63fbf3ea-6a6a-4c38-9799-a08c85d45807 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:45.038657 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63fbf3ea-6a6a-4c38-9799-a08c85d45807 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:45.039274 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63fbf3ea-6a6a-4c38-9799-a08c85d45807 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:45.039869 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63fbf3ea-6a6a-4c38-9799-a08c85d45807 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:45.246326 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3dc7ddd9-c281-417f-bd28-bbdcfc14ec66 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304b3248f9db4629943a8b8080a6d22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdc7504a1d1424ea34f83f1a6d4bf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:45.270926 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3dc7ddd9-c281-417f-bd28-bbdcfc14ec66 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a" status: 200 len: 1721 microversion: 2.1 time: 0.332503 Oct 18 15:38:45.272346 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1612/3168] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:44 2022] GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a => generated 1721 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:45.305349 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fd508927-b069-44cc-a5a2-019cc37bc46a tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:45.306067 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-fd508927-b069-44cc-a5a2-019cc37bc46a tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] [instance: 004539c4-260d-46a9-beed-d9c4b9a76106] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:45.314355 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fd508927-b069-44cc-a5a2-019cc37bc46a tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:45.314967 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fd508927-b069-44cc-a5a2-019cc37bc46a tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:45.315489 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fd508927-b069-44cc-a5a2-019cc37bc46a tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:45.316284 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fd508927-b069-44cc-a5a2-019cc37bc46a tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:45.316838 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fd508927-b069-44cc-a5a2-019cc37bc46a tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:45.317351 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fd508927-b069-44cc-a5a2-019cc37bc46a tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:45.788368 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-63fbf3ea-6a6a-4c38-9799-a08c85d45807 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:45.798609 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-63fbf3ea-6a6a-4c38-9799-a08c85d45807 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:45.800096 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-63fbf3ea-6a6a-4c38-9799-a08c85d45807 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:45.801300 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-63fbf3ea-6a6a-4c38-9799-a08c85d45807 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 200 len: 1803 microversion: 2.32 time: 0.781699 Oct 18 15:38:45.801866 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1557/3169] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:38:45 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 1803 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:38:45.812311 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eb46795f-d1aa-4f29-b445-54b4b37595d1 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:45.813062 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-eb46795f-d1aa-4f29-b445-54b4b37595d1 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 2059ec7e-ef9b-4eb6-af19-34b2bd09e44a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:45.820035 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb46795f-d1aa-4f29-b445-54b4b37595d1 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:45.820863 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb46795f-d1aa-4f29-b445-54b4b37595d1 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:45.821524 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb46795f-d1aa-4f29-b445-54b4b37595d1 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:45.822239 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb46795f-d1aa-4f29-b445-54b4b37595d1 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:45.822717 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb46795f-d1aa-4f29-b445-54b4b37595d1 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:45.823141 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb46795f-d1aa-4f29-b445-54b4b37595d1 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:46.152726 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-fd508927-b069-44cc-a5a2-019cc37bc46a tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36635345398478eb011416cae492244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d7770bf1ee4b46a1e4bdf61dc2d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:46.171125 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fd508927-b069-44cc-a5a2-019cc37bc46a tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "GET /compute/v2.1/servers/004539c4-260d-46a9-beed-d9c4b9a76106" status: 200 len: 1473 microversion: 2.1 time: 0.873649 Oct 18 15:38:46.188622 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1613/3170] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:45 2022] GET /compute/v2.1/servers/004539c4-260d-46a9-beed-d9c4b9a76106 => generated 1473 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:46.195938 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a9d4edd2-419a-4c3c-9a09-7dd8b93b03d3 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:46.196896 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a9d4edd2-419a-4c3c-9a09-7dd8b93b03d3 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] [instance: 64730348-4d42-40d3-aeac-a4aad6c10d67] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:46.205410 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9d4edd2-419a-4c3c-9a09-7dd8b93b03d3 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:46.206162 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9d4edd2-419a-4c3c-9a09-7dd8b93b03d3 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:46.206802 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9d4edd2-419a-4c3c-9a09-7dd8b93b03d3 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:46.209120 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9d4edd2-419a-4c3c-9a09-7dd8b93b03d3 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:46.209791 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9d4edd2-419a-4c3c-9a09-7dd8b93b03d3 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:46.210422 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9d4edd2-419a-4c3c-9a09-7dd8b93b03d3 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:46.357793 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-eb46795f-d1aa-4f29-b445-54b4b37595d1 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:46.357947 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a9d4edd2-419a-4c3c-9a09-7dd8b93b03d3 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7ebe0c265144769931ca6262be8860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a84f93ce8049c3a20c3b835f28100f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:46.375971 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a9d4edd2-419a-4c3c-9a09-7dd8b93b03d3 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] 10.222.0.60 "GET /compute/v2.1/servers/64730348-4d42-40d3-aeac-a4aad6c10d67" status: 200 len: 1282 microversion: 2.1 time: 0.185002 Oct 18 15:38:46.389900 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1614/3171] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:46 2022] GET /compute/v2.1/servers/64730348-4d42-40d3-aeac-a4aad6c10d67 => generated 1282 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:46.398730 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b7fb4b0e-abcf-4bf0-b9f9-1beca4baac36 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:46.399594 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b7fb4b0e-abcf-4bf0-b9f9-1beca4baac36 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: d280f396-df42-482a-b0c1-9a8a9b608f57] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:46.401446 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-eb46795f-d1aa-4f29-b445-54b4b37595d1 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a" status: 200 len: 1315 microversion: 2.1 time: 0.566780 Oct 18 15:38:46.402127 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1558/3172] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:45 2022] GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a => generated 1315 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:46.406342 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b7fb4b0e-abcf-4bf0-b9f9-1beca4baac36 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:46.407022 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b7fb4b0e-abcf-4bf0-b9f9-1beca4baac36 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:46.407634 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b7fb4b0e-abcf-4bf0-b9f9-1beca4baac36 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:46.408488 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b7fb4b0e-abcf-4bf0-b9f9-1beca4baac36 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:46.409148 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b7fb4b0e-abcf-4bf0-b9f9-1beca4baac36 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:46.409755 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b7fb4b0e-abcf-4bf0-b9f9-1beca4baac36 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:46.416484 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-142f355f-60a8-4a76-a98f-e569ae114441 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:46.417381 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-142f355f-60a8-4a76-a98f-e569ae114441 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 52d725f3-b4da-4831-9abf-bf7aba8aee0a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:46.438179 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-142f355f-60a8-4a76-a98f-e569ae114441 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:46.438928 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-142f355f-60a8-4a76-a98f-e569ae114441 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:46.439570 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-142f355f-60a8-4a76-a98f-e569ae114441 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:46.440449 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-142f355f-60a8-4a76-a98f-e569ae114441 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:46.441096 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-142f355f-60a8-4a76-a98f-e569ae114441 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:46.441681 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-142f355f-60a8-4a76-a98f-e569ae114441 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:46.983977 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b7fb4b0e-abcf-4bf0-b9f9-1beca4baac36 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:46.994409 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b7fb4b0e-abcf-4bf0-b9f9-1beca4baac36 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57" status: 200 len: 1472 microversion: 2.1 time: 0.603089 Oct 18 15:38:46.996116 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1615/3173] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:46 2022] GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57 => generated 1472 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:47.001326 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-028de70c-9dc2-47c5-9a58-18409a431052 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:47.002226 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-028de70c-9dc2-47c5-9a58-18409a431052 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:47.010753 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:38:47.013819 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-028de70c-9dc2-47c5-9a58-18409a431052 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:47.015129 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-028de70c-9dc2-47c5-9a58-18409a431052 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:47.016602 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-028de70c-9dc2-47c5-9a58-18409a431052 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:47.018415 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-028de70c-9dc2-47c5-9a58-18409a431052 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:47.019118 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-028de70c-9dc2-47c5-9a58-18409a431052 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:47.019774 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-028de70c-9dc2-47c5-9a58-18409a431052 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:47.020471 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-142f355f-60a8-4a76-a98f-e569ae114441 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304b3248f9db4629943a8b8080a6d22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdc7504a1d1424ea34f83f1a6d4bf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:47.027901 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=10 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:38:47.037688 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:38:47.041825 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-142f355f-60a8-4a76-a98f-e569ae114441 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a" status: 200 len: 1721 microversion: 2.1 time: 0.638598 Oct 18 15:38:47.042450 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1559/3174] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:46 2022] GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a => generated 1721 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:47.201934 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4d9243a7-5561-42f4-853c-783f911081e3 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:47.203115 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4d9243a7-5561-42f4-853c-783f911081e3 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] [instance: 004539c4-260d-46a9-beed-d9c4b9a76106] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:47.219790 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d9243a7-5561-42f4-853c-783f911081e3 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:47.220536 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d9243a7-5561-42f4-853c-783f911081e3 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:47.221208 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d9243a7-5561-42f4-853c-783f911081e3 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:47.222317 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d9243a7-5561-42f4-853c-783f911081e3 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:47.233658 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d9243a7-5561-42f4-853c-783f911081e3 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:47.234408 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d9243a7-5561-42f4-853c-783f911081e3 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:47.594664 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-028de70c-9dc2-47c5-9a58-18409a431052 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:47.610112 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-028de70c-9dc2-47c5-9a58-18409a431052 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:47.614433 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-028de70c-9dc2-47c5-9a58-18409a431052 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:47.618766 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-028de70c-9dc2-47c5-9a58-18409a431052 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 200 len: 1803 microversion: 2.32 time: 0.620589 Oct 18 15:38:47.619601 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1616/3175] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:38:46 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 1803 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:38:47.634604 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1b337e01-f7d7-4846-ae65-6d99c9a4e814 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:47.636705 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1b337e01-f7d7-4846-ae65-6d99c9a4e814 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] [instance: 64730348-4d42-40d3-aeac-a4aad6c10d67] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:47.665907 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1b337e01-f7d7-4846-ae65-6d99c9a4e814 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:47.666430 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1b337e01-f7d7-4846-ae65-6d99c9a4e814 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:47.670818 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1b337e01-f7d7-4846-ae65-6d99c9a4e814 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:47.671623 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1b337e01-f7d7-4846-ae65-6d99c9a4e814 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:47.672114 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1b337e01-f7d7-4846-ae65-6d99c9a4e814 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:47.674604 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1b337e01-f7d7-4846-ae65-6d99c9a4e814 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:47.930207 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4d9243a7-5561-42f4-853c-783f911081e3 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36635345398478eb011416cae492244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d7770bf1ee4b46a1e4bdf61dc2d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:47.947030 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4d9243a7-5561-42f4-853c-783f911081e3 tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "GET /compute/v2.1/servers/004539c4-260d-46a9-beed-d9c4b9a76106" status: 200 len: 1473 microversion: 2.1 time: 0.750125 Oct 18 15:38:47.947741 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1560/3176] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:47 2022] GET /compute/v2.1/servers/004539c4-260d-46a9-beed-d9c4b9a76106 => generated 1473 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:38:47.962348 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7711eac1-f108-4293-ae75-5a4614f1066d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:47.963083 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7711eac1-f108-4293-ae75-5a4614f1066d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 2059ec7e-ef9b-4eb6-af19-34b2bd09e44a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:47.975787 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7711eac1-f108-4293-ae75-5a4614f1066d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:47.976410 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7711eac1-f108-4293-ae75-5a4614f1066d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:47.977050 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7711eac1-f108-4293-ae75-5a4614f1066d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:47.977832 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7711eac1-f108-4293-ae75-5a4614f1066d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:47.983413 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7711eac1-f108-4293-ae75-5a4614f1066d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:47.983898 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7711eac1-f108-4293-ae75-5a4614f1066d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:48.266249 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1b337e01-f7d7-4846-ae65-6d99c9a4e814 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7ebe0c265144769931ca6262be8860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a84f93ce8049c3a20c3b835f28100f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:48.299036 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1b337e01-f7d7-4846-ae65-6d99c9a4e814 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] 10.222.0.60 "GET /compute/v2.1/servers/64730348-4d42-40d3-aeac-a4aad6c10d67" status: 200 len: 1324 microversion: 2.1 time: 0.674421 Oct 18 15:38:48.303451 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1617/3177] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:47 2022] GET /compute/v2.1/servers/64730348-4d42-40d3-aeac-a4aad6c10d67 => generated 1324 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:48.303582 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7711eac1-f108-4293-ae75-5a4614f1066d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:48.311852 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7711eac1-f108-4293-ae75-5a4614f1066d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a" status: 200 len: 1315 microversion: 2.1 time: 0.363010 Oct 18 15:38:48.312406 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1561/3178] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:47 2022] GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a => generated 1315 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:48.315599 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-d7867dd2-33de-4f02-b42f-1980dd191444 req-3ed681c3-beee-4d24-9934-3694fa9be43f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "004539c4-260d-46a9-beed-d9c4b9a76106", "name": "network-vif-deleted", "tag": "7e81b5b0-1e7e-436b-84c7-bab9312ea51d"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:38:48.321088 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6601a372-01e4-4d8c-8577-63287a2a5f02 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:48.321700 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6601a372-01e4-4d8c-8577-63287a2a5f02 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: d280f396-df42-482a-b0c1-9a8a9b608f57] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:48.329622 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-d7867dd2-33de-4f02-b42f-1980dd191444 req-3ed681c3-beee-4d24-9934-3694fa9be43f service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:48.330542 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-d7867dd2-33de-4f02-b42f-1980dd191444 req-3ed681c3-beee-4d24-9934-3694fa9be43f service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:48.331211 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-d7867dd2-33de-4f02-b42f-1980dd191444 req-3ed681c3-beee-4d24-9934-3694fa9be43f service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:48.339392 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6601a372-01e4-4d8c-8577-63287a2a5f02 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:48.339881 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6601a372-01e4-4d8c-8577-63287a2a5f02 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:48.340310 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6601a372-01e4-4d8c-8577-63287a2a5f02 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:48.341034 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6601a372-01e4-4d8c-8577-63287a2a5f02 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:48.341487 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6601a372-01e4-4d8c-8577-63287a2a5f02 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:48.341908 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6601a372-01e4-4d8c-8577-63287a2a5f02 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:48.349348 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-d7867dd2-33de-4f02-b42f-1980dd191444 req-3ed681c3-beee-4d24-9934-3694fa9be43f service nova] Creating event network-vif-deleted:7e81b5b0-1e7e-436b-84c7-bab9312ea51d for instance 004539c4-260d-46a9-beed-d9c4b9a76106 on n-h1-853682-5 Oct 18 15:38:48.355111 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-d7867dd2-33de-4f02-b42f-1980dd191444 req-3ed681c3-beee-4d24-9934-3694fa9be43f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049711 Oct 18 15:38:48.356024 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1618/3179] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:38:48.362818 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-27f21cd1-dc08-4815-81ce-634935f0173d tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:48.363665 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-27f21cd1-dc08-4815-81ce-634935f0173d tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 52d725f3-b4da-4831-9abf-bf7aba8aee0a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:48.371476 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-27f21cd1-dc08-4815-81ce-634935f0173d tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:48.371977 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-27f21cd1-dc08-4815-81ce-634935f0173d tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:48.372423 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-27f21cd1-dc08-4815-81ce-634935f0173d tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:48.373536 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-27f21cd1-dc08-4815-81ce-634935f0173d tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:48.374486 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-27f21cd1-dc08-4815-81ce-634935f0173d tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:48.374931 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-27f21cd1-dc08-4815-81ce-634935f0173d tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:48.742746 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-27f21cd1-dc08-4815-81ce-634935f0173d tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304b3248f9db4629943a8b8080a6d22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdc7504a1d1424ea34f83f1a6d4bf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:48.748139 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6601a372-01e4-4d8c-8577-63287a2a5f02 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:48.753135 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-27f21cd1-dc08-4815-81ce-634935f0173d tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a" status: 200 len: 1721 microversion: 2.1 time: 0.395871 Oct 18 15:38:48.759018 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6601a372-01e4-4d8c-8577-63287a2a5f02 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57" status: 200 len: 1477 microversion: 2.1 time: 0.445405 Oct 18 15:38:48.760524 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1562/3180] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:48 2022] GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57 => generated 1477 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:48.767778 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-27570b9e-f6aa-4727-a48e-eb5753365996 req-48111159-dbfe-4b68-b2c8-e9c3e8c09d68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64730348-4d42-40d3-aeac-a4aad6c10d67", "tag": "42d6883c-79d0-4365-9b09-db97e4ac7a74"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:38:48.774112 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1619/3181] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:48 2022] GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a => generated 1721 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:48.779985 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-27570b9e-f6aa-4727-a48e-eb5753365996 req-48111159-dbfe-4b68-b2c8-e9c3e8c09d68 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:48.780535 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-27570b9e-f6aa-4727-a48e-eb5753365996 req-48111159-dbfe-4b68-b2c8-e9c3e8c09d68 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:48.781205 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-27570b9e-f6aa-4727-a48e-eb5753365996 req-48111159-dbfe-4b68-b2c8-e9c3e8c09d68 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:48.783429 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ca9f0f15-3951-478a-a9b8-847e6215ce24 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:48.784099 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ca9f0f15-3951-478a-a9b8-847e6215ce24 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:48.793063 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca9f0f15-3951-478a-a9b8-847e6215ce24 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:48.793603 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca9f0f15-3951-478a-a9b8-847e6215ce24 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:48.794056 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca9f0f15-3951-478a-a9b8-847e6215ce24 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:48.794784 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca9f0f15-3951-478a-a9b8-847e6215ce24 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:48.795252 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca9f0f15-3951-478a-a9b8-847e6215ce24 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:48.795689 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca9f0f15-3951-478a-a9b8-847e6215ce24 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:48.795809 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-27570b9e-f6aa-4727-a48e-eb5753365996 req-48111159-dbfe-4b68-b2c8-e9c3e8c09d68 service nova] Creating event network-changed:42d6883c-79d0-4365-9b09-db97e4ac7a74 for instance 64730348-4d42-40d3-aeac-a4aad6c10d67 on n-h1-853682-5 Oct 18 15:38:48.801588 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-27570b9e-f6aa-4727-a48e-eb5753365996 req-48111159-dbfe-4b68-b2c8-e9c3e8c09d68 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037873 Oct 18 15:38:48.802431 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1563/3182] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:38:48.978380 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ac3883c7-0365-476a-8359-279b5275662b tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:48.979091 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ac3883c7-0365-476a-8359-279b5275662b tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] [instance: 004539c4-260d-46a9-beed-d9c4b9a76106] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:49.003570 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac3883c7-0365-476a-8359-279b5275662b tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:49.005868 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac3883c7-0365-476a-8359-279b5275662b tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:49.006522 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac3883c7-0365-476a-8359-279b5275662b tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:49.013138 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac3883c7-0365-476a-8359-279b5275662b tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:49.015170 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac3883c7-0365-476a-8359-279b5275662b tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:49.016137 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac3883c7-0365-476a-8359-279b5275662b tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:49.069583 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac3883c7-0365-476a-8359-279b5275662b tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:49.070296 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac3883c7-0365-476a-8359-279b5275662b tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:49.072348 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac3883c7-0365-476a-8359-279b5275662b tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:49.073187 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-ac3883c7-0365-476a-8359-279b5275662b tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lazy-loading 'fault' on Instance uuid 004539c4-260d-46a9-beed-d9c4b9a76106 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:38:49.200321 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ac3883c7-0365-476a-8359-279b5275662b tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36635345398478eb011416cae492244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d7770bf1ee4b46a1e4bdf61dc2d711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:49.213498 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:38:49.218410 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ac3883c7-0365-476a-8359-279b5275662b tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "GET /compute/v2.1/servers/004539c4-260d-46a9-beed-d9c4b9a76106" status: 200 len: 1307 microversion: 2.1 time: 0.246694 Oct 18 15:38:49.233039 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ca9f0f15-3951-478a-a9b8-847e6215ce24 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:49.237447 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1564/3183] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:48 2022] GET /compute/v2.1/servers/004539c4-260d-46a9-beed-d9c4b9a76106 => generated 1307 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:49.245203 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-85a088e1-6443-409f-8c13-dcea777f26f5 req-621271ba-c5ac-4b82-baf4-c470cc801aed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2059ec7e-ef9b-4eb6-af19-34b2bd09e44a", "name": "network-vif-plugged", "status": "completed", "tag": "b98e9e22-f73c-442c-91b4-ae56414e19d7"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:38:49.256853 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=16 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:38:49.260645 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ca9f0f15-3951-478a-a9b8-847e6215ce24 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:49.262504 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-85a088e1-6443-409f-8c13-dcea777f26f5 req-621271ba-c5ac-4b82-baf4-c470cc801aed service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:49.263870 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-85a088e1-6443-409f-8c13-dcea777f26f5 req-621271ba-c5ac-4b82-baf4-c470cc801aed service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:49.264573 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-85a088e1-6443-409f-8c13-dcea777f26f5 req-621271ba-c5ac-4b82-baf4-c470cc801aed service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:49.271974 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ca9f0f15-3951-478a-a9b8-847e6215ce24 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:49.273296 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ca9f0f15-3951-478a-a9b8-847e6215ce24 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 200 len: 1850 microversion: 2.32 time: 0.498114 Oct 18 15:38:49.273941 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1620/3184] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:38:48 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 1850 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:38:49.281764 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-85a088e1-6443-409f-8c13-dcea777f26f5 req-621271ba-c5ac-4b82-baf4-c470cc801aed service nova] Creating event network-vif-plugged:b98e9e22-f73c-442c-91b4-ae56414e19d7 for instance 2059ec7e-ef9b-4eb6-af19-34b2bd09e44a on n-h1-853682-5 Oct 18 15:38:49.289265 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-85a088e1-6443-409f-8c13-dcea777f26f5 req-621271ba-c5ac-4b82-baf4-c470cc801aed service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049624 Oct 18 15:38:49.290602 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1565/3185] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:38:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:38:49.323267 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-cf83d5aa-73f6-48ec-8a25-27fc34195ce0 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:49.324263 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-cf83d5aa-73f6-48ec-8a25-27fc34195ce0 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] [instance: 64730348-4d42-40d3-aeac-a4aad6c10d67] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:49.331380 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cf83d5aa-73f6-48ec-8a25-27fc34195ce0 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:49.332231 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cf83d5aa-73f6-48ec-8a25-27fc34195ce0 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:49.332944 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cf83d5aa-73f6-48ec-8a25-27fc34195ce0 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:49.333950 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cf83d5aa-73f6-48ec-8a25-27fc34195ce0 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:49.334630 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cf83d5aa-73f6-48ec-8a25-27fc34195ce0 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:49.335302 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cf83d5aa-73f6-48ec-8a25-27fc34195ce0 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:49.340614 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=100 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:38:49.348194 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3a2135c6-0610-46bf-822f-451ac94480ae tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:49.353514 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3a2135c6-0610-46bf-822f-451ac94480ae tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 2059ec7e-ef9b-4eb6-af19-34b2bd09e44a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:49.371181 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a2135c6-0610-46bf-822f-451ac94480ae tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:49.372639 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a2135c6-0610-46bf-822f-451ac94480ae tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:49.374121 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a2135c6-0610-46bf-822f-451ac94480ae tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:49.377294 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a2135c6-0610-46bf-822f-451ac94480ae tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:49.378081 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a2135c6-0610-46bf-822f-451ac94480ae tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:49.378684 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a2135c6-0610-46bf-822f-451ac94480ae tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:49.683530 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-cf83d5aa-73f6-48ec-8a25-27fc34195ce0 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7ebe0c265144769931ca6262be8860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a84f93ce8049c3a20c3b835f28100f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:49.694138 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-cf83d5aa-73f6-48ec-8a25-27fc34195ce0 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] 10.222.0.60 "GET /compute/v2.1/servers/64730348-4d42-40d3-aeac-a4aad6c10d67" status: 200 len: 1324 microversion: 2.1 time: 0.374679 Oct 18 15:38:49.695566 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1621/3186] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:49 2022] GET /compute/v2.1/servers/64730348-4d42-40d3-aeac-a4aad6c10d67 => generated 1324 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:49.772664 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3a2135c6-0610-46bf-822f-451ac94480ae tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:49.780416 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-449189da-cdf6-4582-8277-0dba61cf7f8e tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:49.782519 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-449189da-cdf6-4582-8277-0dba61cf7f8e tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 52d725f3-b4da-4831-9abf-bf7aba8aee0a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:49.783276 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3a2135c6-0610-46bf-822f-451ac94480ae tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a" status: 200 len: 1315 microversion: 2.1 time: 0.450582 Oct 18 15:38:49.784060 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1566/3187] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:49 2022] GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a => generated 1315 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:49.789003 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f106b670-4f8f-4f76-9271-b37236b94360 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:49.789613 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f106b670-4f8f-4f76-9271-b37236b94360 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: d280f396-df42-482a-b0c1-9a8a9b608f57] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:49.792469 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-449189da-cdf6-4582-8277-0dba61cf7f8e tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:49.793276 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-449189da-cdf6-4582-8277-0dba61cf7f8e tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:49.796172 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f106b670-4f8f-4f76-9271-b37236b94360 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:49.796671 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f106b670-4f8f-4f76-9271-b37236b94360 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:49.797120 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-449189da-cdf6-4582-8277-0dba61cf7f8e tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:49.797261 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f106b670-4f8f-4f76-9271-b37236b94360 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:49.797906 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f106b670-4f8f-4f76-9271-b37236b94360 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:49.798365 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f106b670-4f8f-4f76-9271-b37236b94360 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:49.798903 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f106b670-4f8f-4f76-9271-b37236b94360 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:49.800844 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-449189da-cdf6-4582-8277-0dba61cf7f8e tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:49.801548 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-449189da-cdf6-4582-8277-0dba61cf7f8e tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:49.803330 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-449189da-cdf6-4582-8277-0dba61cf7f8e tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:50.176708 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-449189da-cdf6-4582-8277-0dba61cf7f8e tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304b3248f9db4629943a8b8080a6d22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdc7504a1d1424ea34f83f1a6d4bf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:50.184452 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f106b670-4f8f-4f76-9271-b37236b94360 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:50.186840 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-449189da-cdf6-4582-8277-0dba61cf7f8e tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a" status: 200 len: 1721 microversion: 2.1 time: 0.411048 Oct 18 15:38:50.196284 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1622/3188] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:49 2022] GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a => generated 1721 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:50.203015 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f106b670-4f8f-4f76-9271-b37236b94360 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57" status: 200 len: 1477 microversion: 2.1 time: 0.418084 Oct 18 15:38:50.204362 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1567/3189] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:49 2022] GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57 => generated 1477 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:50.259863 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-880a3464-9efb-48ef-a520-07f9a9de576b tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:50.260729 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-880a3464-9efb-48ef-a520-07f9a9de576b tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] [instance: 004539c4-260d-46a9-beed-d9c4b9a76106] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:50.267295 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-880a3464-9efb-48ef-a520-07f9a9de576b tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:50.268020 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-880a3464-9efb-48ef-a520-07f9a9de576b tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:50.268252 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-880a3464-9efb-48ef-a520-07f9a9de576b tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:50.269057 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-880a3464-9efb-48ef-a520-07f9a9de576b tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:50.269661 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-880a3464-9efb-48ef-a520-07f9a9de576b tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:50.270094 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-880a3464-9efb-48ef-a520-07f9a9de576b tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:50.293508 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-880a3464-9efb-48ef-a520-07f9a9de576b tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] HTTP exception thrown: Instance 004539c4-260d-46a9-beed-d9c4b9a76106 could not be found. Oct 18 15:38:50.295607 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-880a3464-9efb-48ef-a520-07f9a9de576b tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Request method failure captured: Oct 18 15:38:50.295607 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/004539c4-260d-46a9-beed-d9c4b9a76106 HTTP/1.1 Oct 18 15:38:50.295607 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:38:50.295607 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:38:50.295607 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:38:50.295607 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:38:50.295607 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:38:50.295607 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:38:50.295607 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:38:50.295607 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:38:50.295607 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsgZIxcsBpIyN12ziKYEdO7XibCyRnIMm8to_2d3DUY0hst7pF3zwBKH3SrCEfyZ1IPKhv0sOmTCzuD5u29MD0_MdUjVA2ChKkvSWhZVMMt68CPj1j24sPqtJXPPO9S7wbdfpH5GLw5R9nyjPOdvZ4muCnpZqkNHUmlN-5YmT1uNIz0 Oct 18 15:38:50.295607 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:38:50.295607 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:38:50.295607 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:38:50.295607 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:38:50.295607 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:38:50.295607 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:38:50.295607 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 68d7770bf1ee4b46a1e4bdf61dc2d711 Oct 18 15:38:50.295607 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ImagesOneServerTestJSON-1874252287 Oct 18 15:38:50.295607 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:38:50.295607 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:38:50.297287 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/68d7770bf1ee4b46a1e4bdf61dc2d711"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/68d7770bf1ee4b46a1e4bdf61dc2d711"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/68d7770bf1ee4b46a1e4bdf61dc2d711"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_68d7770bf1ee4b46a1e4bdf61dc2d711"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:38:50.297287 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ImagesOneServerTestJSON-1874252287 Oct 18 15:38:50.297287 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 68d7770bf1ee4b46a1e4bdf61dc2d711 Oct 18 15:38:50.297287 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1874252287 Oct 18 15:38:50.297287 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ImagesOneServerTestJSON-1874252287-project Oct 18 15:38:50.297287 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:38:50.297287 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:38:50.297287 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: f36635345398478eb011416cae492244 Oct 18 15:38:50.297287 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ImagesOneServerTestJSON-1874252287-project Oct 18 15:38:50.297287 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:38:50.297287 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 004539c4-260d-46a9-beed-d9c4b9a76106 could not be found. Oct 18 15:38:50.297287 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '004539c4-260d-46a9-beed-d9c4b9a76106'} Oct 18 15:38:50.298446 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:38:50.298446 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:38:50.298446 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:38:50.298446 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:38:50.298446 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:38:50.298446 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:38:50.298446 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:38:50.298446 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:38:50.298446 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:38:50.298446 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:38:50.298446 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 004539c4-260d-46a9-beed-d9c4b9a76106 could not be found. Oct 18 15:38:50.298446 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:38:50.298446 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:38:50.298446 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:38:50.298446 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:38:50.298446 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:38:50.298446 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:38:50.298446 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:38:50.298446 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:38:50.298446 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:38:50.300270 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:38:50.300270 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:38:50.300270 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:38:50.300270 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:38:50.300270 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:38:50.300270 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:38:50.300270 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:38:50.300270 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 004539c4-260d-46a9-beed-d9c4b9a76106 could not be found. Oct 18 15:38:50.300270 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:38:50.300270 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:38:50.300270 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:38:50.300270 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:38:50.300270 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:38:50.300270 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:38:50.300270 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:38:50.300270 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:38:50.300270 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 004539c4-260d-46a9-beed-d9c4b9a76106 could not be found. Oct 18 15:38:50.300270 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:38:50.303337 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-880a3464-9efb-48ef-a520-07f9a9de576b tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] Returning 404 to user: Instance 004539c4-260d-46a9-beed-d9c4b9a76106 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:38:50.303337 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-880a3464-9efb-48ef-a520-07f9a9de576b tempest-ImagesOneServerTestJSON-1874252287 tempest-ImagesOneServerTestJSON-1874252287-project] 10.222.0.60 "GET /compute/v2.1/servers/004539c4-260d-46a9-beed-d9c4b9a76106" status: 404 len: 111 microversion: 2.1 time: 0.043304 Oct 18 15:38:50.307834 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1623/3190] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:50 2022] GET /compute/v2.1/servers/004539c4-260d-46a9-beed-d9c4b9a76106 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:38:50.310261 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-004c5a5d-e20b-4079-92b2-3576d8bb62bc tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:50.311218 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-004c5a5d-e20b-4079-92b2-3576d8bb62bc tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:50.320011 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-004c5a5d-e20b-4079-92b2-3576d8bb62bc tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:50.320956 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-004c5a5d-e20b-4079-92b2-3576d8bb62bc tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:50.321736 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-004c5a5d-e20b-4079-92b2-3576d8bb62bc tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:50.323447 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-004c5a5d-e20b-4079-92b2-3576d8bb62bc tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:50.324132 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-004c5a5d-e20b-4079-92b2-3576d8bb62bc tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:50.324943 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-004c5a5d-e20b-4079-92b2-3576d8bb62bc tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:50.400488 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-209eb911-0aca-4eee-86fe-00c63d0d4952 req-8f1560a2-3b64-43ef-9b4a-2fba28d4760c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf8f81da-4aa0-498d-af1e-c036238f065d", "tag": "6804cdcb-ecb6-4eec-8de0-cc16a6d64f70"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:38:50.413398 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-209eb911-0aca-4eee-86fe-00c63d0d4952 req-8f1560a2-3b64-43ef-9b4a-2fba28d4760c service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:50.414497 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-209eb911-0aca-4eee-86fe-00c63d0d4952 req-8f1560a2-3b64-43ef-9b4a-2fba28d4760c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:50.416154 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-209eb911-0aca-4eee-86fe-00c63d0d4952 req-8f1560a2-3b64-43ef-9b4a-2fba28d4760c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:50.435576 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-209eb911-0aca-4eee-86fe-00c63d0d4952 req-8f1560a2-3b64-43ef-9b4a-2fba28d4760c service nova] Creating event network-changed:6804cdcb-ecb6-4eec-8de0-cc16a6d64f70 for instance cf8f81da-4aa0-498d-af1e-c036238f065d on n-h2-853682-5 Oct 18 15:38:50.442160 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-209eb911-0aca-4eee-86fe-00c63d0d4952 req-8f1560a2-3b64-43ef-9b4a-2fba28d4760c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048860 Oct 18 15:38:50.443983 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1624/3191] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:38:50.719671 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b318e239-9cb8-4a2e-9b0d-5314cad5934a tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:50.720633 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b318e239-9cb8-4a2e-9b0d-5314cad5934a tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] [instance: 64730348-4d42-40d3-aeac-a4aad6c10d67] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:50.732652 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b318e239-9cb8-4a2e-9b0d-5314cad5934a tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:50.733629 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b318e239-9cb8-4a2e-9b0d-5314cad5934a tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:50.734367 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b318e239-9cb8-4a2e-9b0d-5314cad5934a tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:50.736630 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b318e239-9cb8-4a2e-9b0d-5314cad5934a tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:50.737364 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b318e239-9cb8-4a2e-9b0d-5314cad5934a tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:50.739115 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b318e239-9cb8-4a2e-9b0d-5314cad5934a tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:51.146737 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-004c5a5d-e20b-4079-92b2-3576d8bb62bc tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:51.158742 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-004c5a5d-e20b-4079-92b2-3576d8bb62bc tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:51.160192 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-004c5a5d-e20b-4079-92b2-3576d8bb62bc tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:51.170297 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-004c5a5d-e20b-4079-92b2-3576d8bb62bc tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 200 len: 1871 microversion: 2.32 time: 0.856246 Oct 18 15:38:51.185295 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1568/3192] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:38:50 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 1871 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:38:51.207012 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3534623c-4443-4374-9ff4-58526f73f414 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:51.207633 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3534623c-4443-4374-9ff4-58526f73f414 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 2059ec7e-ef9b-4eb6-af19-34b2bd09e44a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:51.209315 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b318e239-9cb8-4a2e-9b0d-5314cad5934a tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7ebe0c265144769931ca6262be8860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a84f93ce8049c3a20c3b835f28100f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:51.215122 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3534623c-4443-4374-9ff4-58526f73f414 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:51.215846 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3534623c-4443-4374-9ff4-58526f73f414 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:51.216445 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3534623c-4443-4374-9ff4-58526f73f414 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:51.217359 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3534623c-4443-4374-9ff4-58526f73f414 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:51.217987 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3534623c-4443-4374-9ff4-58526f73f414 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:51.218570 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3534623c-4443-4374-9ff4-58526f73f414 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:51.221116 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b318e239-9cb8-4a2e-9b0d-5314cad5934a tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] 10.222.0.60 "GET /compute/v2.1/servers/64730348-4d42-40d3-aeac-a4aad6c10d67" status: 200 len: 1324 microversion: 2.1 time: 0.505904 Oct 18 15:38:51.222331 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1625/3193] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:50 2022] GET /compute/v2.1/servers/64730348-4d42-40d3-aeac-a4aad6c10d67 => generated 1324 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:51.230995 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a32f523e-c3d5-44aa-b555-7e4d5ad54a69 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:51.231963 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a32f523e-c3d5-44aa-b555-7e4d5ad54a69 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 52d725f3-b4da-4831-9abf-bf7aba8aee0a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:51.252680 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a32f523e-c3d5-44aa-b555-7e4d5ad54a69 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:51.256035 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a32f523e-c3d5-44aa-b555-7e4d5ad54a69 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:51.256487 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a32f523e-c3d5-44aa-b555-7e4d5ad54a69 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:51.258331 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a32f523e-c3d5-44aa-b555-7e4d5ad54a69 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:51.258877 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a32f523e-c3d5-44aa-b555-7e4d5ad54a69 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:51.259776 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a32f523e-c3d5-44aa-b555-7e4d5ad54a69 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:51.658977 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3534623c-4443-4374-9ff4-58526f73f414 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:51.669199 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3534623c-4443-4374-9ff4-58526f73f414 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a" status: 200 len: 1503 microversion: 2.1 time: 0.482251 Oct 18 15:38:51.702393 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1569/3194] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:51 2022] GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a => generated 1503 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:51.709230 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-09caa11e-3693-4471-b7b3-ce88e256973a tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:51.710065 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-09caa11e-3693-4471-b7b3-ce88e256973a tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: d280f396-df42-482a-b0c1-9a8a9b608f57] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:51.717041 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09caa11e-3693-4471-b7b3-ce88e256973a tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:51.717748 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09caa11e-3693-4471-b7b3-ce88e256973a tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:51.718350 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09caa11e-3693-4471-b7b3-ce88e256973a tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:51.719210 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09caa11e-3693-4471-b7b3-ce88e256973a tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:51.719818 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09caa11e-3693-4471-b7b3-ce88e256973a tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:51.720392 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09caa11e-3693-4471-b7b3-ce88e256973a tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:51.748119 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a32f523e-c3d5-44aa-b555-7e4d5ad54a69 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304b3248f9db4629943a8b8080a6d22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdc7504a1d1424ea34f83f1a6d4bf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:51.760561 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a32f523e-c3d5-44aa-b555-7e4d5ad54a69 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a" status: 200 len: 1721 microversion: 2.1 time: 0.536014 Oct 18 15:38:51.761844 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1626/3195] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:51 2022] GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a => generated 1721 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:51.772246 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-17241914-c7fb-41c5-b580-0a25ba90a8d7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:38:51.782471 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-17241914-c7fb-41c5-b580-0a25ba90a8d7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:51.783571 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-17241914-c7fb-41c5-b580-0a25ba90a8d7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:51.784182 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-17241914-c7fb-41c5-b580-0a25ba90a8d7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:51.812932 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-17241914-c7fb-41c5-b580-0a25ba90a8d7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 2059ec7e-ef9b-4eb6-af19-34b2bd09e44a] Going to try to stop instance {{(pid=120405) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 18 15:38:51.876078 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-17241914-c7fb-41c5-b580-0a25ba90a8d7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "POST /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a/action" status: 202 len: 0 microversion: 2.1 time: 0.111467 Oct 18 15:38:51.886997 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1627/3196] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:38:51 2022] POST /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:38:51.899912 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fbcf121f-1610-4b02-91d1-a8b09e0770e7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:51.903723 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-fbcf121f-1610-4b02-91d1-a8b09e0770e7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 2059ec7e-ef9b-4eb6-af19-34b2bd09e44a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:51.912798 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fbcf121f-1610-4b02-91d1-a8b09e0770e7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:51.913328 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fbcf121f-1610-4b02-91d1-a8b09e0770e7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:51.913793 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fbcf121f-1610-4b02-91d1-a8b09e0770e7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:51.914590 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fbcf121f-1610-4b02-91d1-a8b09e0770e7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:51.915112 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fbcf121f-1610-4b02-91d1-a8b09e0770e7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:51.915500 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fbcf121f-1610-4b02-91d1-a8b09e0770e7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:52.244108 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-09caa11e-3693-4471-b7b3-ce88e256973a tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:52.255886 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-09caa11e-3693-4471-b7b3-ce88e256973a tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57" status: 200 len: 1477 microversion: 2.1 time: 0.550761 Oct 18 15:38:52.257036 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1570/3197] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:51 2022] GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57 => generated 1477 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:52.267593 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-fbcf121f-1610-4b02-91d1-a8b09e0770e7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:52.276283 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fbcf121f-1610-4b02-91d1-a8b09e0770e7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a" status: 200 len: 1513 microversion: 2.1 time: 0.383050 Oct 18 15:38:52.289161 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1628/3198] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:51 2022] GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a => generated 1513 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:52.297480 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3419d24b-c48c-46c6-911d-cd95a41ebf01 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:52.298398 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3419d24b-c48c-46c6-911d-cd95a41ebf01 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:52.305591 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3419d24b-c48c-46c6-911d-cd95a41ebf01 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:52.306365 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3419d24b-c48c-46c6-911d-cd95a41ebf01 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:52.307023 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3419d24b-c48c-46c6-911d-cd95a41ebf01 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:52.307962 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3419d24b-c48c-46c6-911d-cd95a41ebf01 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:52.308621 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3419d24b-c48c-46c6-911d-cd95a41ebf01 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:52.309270 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3419d24b-c48c-46c6-911d-cd95a41ebf01 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:52.402784 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e48d5d2f-9e93-44bb-b727-f838a99bd97b tempest-ListImagesTestJSON-274513941 tempest-ListImagesTestJSON-274513941-project] Calling method '.version_select at 0x7f7c414d0040>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:52.452217 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e48d5d2f-9e93-44bb-b727-f838a99bd97b tempest-ListImagesTestJSON-274513941 tempest-ListImagesTestJSON-274513941-project] 10.222.0.60 "GET /compute/v2.1/images/8f4db252-bff6-4685-9c8d-4c5d6bd9f78b" status: 200 len: 784 microversion: 2.1 time: 0.193804 Oct 18 15:38:52.452904 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1571/3199] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:38:52 2022] GET /compute/v2.1/images/8f4db252-bff6-4685-9c8d-4c5d6bd9f78b => generated 784 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:38:52.458008 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c4b8e94f-0fe0-402c-9007-cb2ba2650f40 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:52.459215 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c4b8e94f-0fe0-402c-9007-cb2ba2650f40 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] [instance: 64730348-4d42-40d3-aeac-a4aad6c10d67] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:52.465897 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:38:52.467615 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4b8e94f-0fe0-402c-9007-cb2ba2650f40 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:52.468271 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4b8e94f-0fe0-402c-9007-cb2ba2650f40 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:52.468784 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4b8e94f-0fe0-402c-9007-cb2ba2650f40 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:52.469675 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4b8e94f-0fe0-402c-9007-cb2ba2650f40 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:52.470195 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4b8e94f-0fe0-402c-9007-cb2ba2650f40 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:52.470681 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4b8e94f-0fe0-402c-9007-cb2ba2650f40 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:52.653033 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3419d24b-c48c-46c6-911d-cd95a41ebf01 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:52.663270 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3419d24b-c48c-46c6-911d-cd95a41ebf01 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:52.664745 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3419d24b-c48c-46c6-911d-cd95a41ebf01 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:52.666096 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3419d24b-c48c-46c6-911d-cd95a41ebf01 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 200 len: 1871 microversion: 2.32 time: 0.375550 Oct 18 15:38:52.666647 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1629/3200] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:38:52 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 1871 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:38:52.682912 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e0fa01d4-4b47-4bab-954a-c736c53cfa53 tempest-ListImagesTestJSON-274513941 tempest-ListImagesTestJSON-274513941-project] Calling method '.version_select at 0x7f7c3d68dd30>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:52.763948 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c4b8e94f-0fe0-402c-9007-cb2ba2650f40 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7ebe0c265144769931ca6262be8860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a84f93ce8049c3a20c3b835f28100f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:52.771902 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e0fa01d4-4b47-4bab-954a-c736c53cfa53 tempest-ListImagesTestJSON-274513941 tempest-ListImagesTestJSON-274513941-project] 10.222.0.60 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.104029 Oct 18 15:38:52.780091 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c4b8e94f-0fe0-402c-9007-cb2ba2650f40 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] 10.222.0.60 "GET /compute/v2.1/servers/64730348-4d42-40d3-aeac-a4aad6c10d67" status: 200 len: 1324 microversion: 2.1 time: 0.325654 Oct 18 15:38:52.780670 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1572/3201] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:52 2022] GET /compute/v2.1/servers/64730348-4d42-40d3-aeac-a4aad6c10d67 => generated 1324 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:52.782636 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1630/3202] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Oct 18 15:38:52 2022] GET /compute/v2.1/images => generated 445 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:38:52.788102 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3550f6ae-adfc-46f0-ba0b-5ad4cd66560a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:52.788967 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3550f6ae-adfc-46f0-ba0b-5ad4cd66560a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 52d725f3-b4da-4831-9abf-bf7aba8aee0a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:52.797787 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-189f82bc-7a58-4350-8736-45d1f1d621e2 tempest-ListImagesTestJSON-274513941 tempest-ListImagesTestJSON-274513941-project] Calling method '.version_select at 0x7f7c3d01fa60>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:52.808879 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3550f6ae-adfc-46f0-ba0b-5ad4cd66560a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:52.809236 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3550f6ae-adfc-46f0-ba0b-5ad4cd66560a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:52.809688 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3550f6ae-adfc-46f0-ba0b-5ad4cd66560a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:52.810442 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3550f6ae-adfc-46f0-ba0b-5ad4cd66560a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:52.810901 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3550f6ae-adfc-46f0-ba0b-5ad4cd66560a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:52.811333 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3550f6ae-adfc-46f0-ba0b-5ad4cd66560a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:52.857397 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-189f82bc-7a58-4350-8736-45d1f1d621e2 tempest-ListImagesTestJSON-274513941 tempest-ListImagesTestJSON-274513941-project] 10.222.0.60 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.063333 Oct 18 15:38:52.858011 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1573/3203] 10.222.0.60 () {58 vars in 1143 bytes} [Tue Oct 18 15:38:52 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:38:52.875452 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-2387db0d-3d40-4b4b-8dee-686638d45d8b req-9516ce0b-e60b-4d38-b450-63c441527364 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf8f81da-4aa0-498d-af1e-c036238f065d", "tag": "a2d084e8-8af5-402d-b5a9-a5e9b2e30a21"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:38:52.885853 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2387db0d-3d40-4b4b-8dee-686638d45d8b req-9516ce0b-e60b-4d38-b450-63c441527364 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:52.886440 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2387db0d-3d40-4b4b-8dee-686638d45d8b req-9516ce0b-e60b-4d38-b450-63c441527364 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:52.886892 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2387db0d-3d40-4b4b-8dee-686638d45d8b req-9516ce0b-e60b-4d38-b450-63c441527364 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:52.900786 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-2387db0d-3d40-4b4b-8dee-686638d45d8b req-9516ce0b-e60b-4d38-b450-63c441527364 service nova] Creating event network-changed:a2d084e8-8af5-402d-b5a9-a5e9b2e30a21 for instance cf8f81da-4aa0-498d-af1e-c036238f065d on n-h2-853682-5 Oct 18 15:38:52.905935 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-2387db0d-3d40-4b4b-8dee-686638d45d8b req-9516ce0b-e60b-4d38-b450-63c441527364 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035084 Oct 18 15:38:52.906933 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1574/3204] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:38:53.041937 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3550f6ae-adfc-46f0-ba0b-5ad4cd66560a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304b3248f9db4629943a8b8080a6d22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdc7504a1d1424ea34f83f1a6d4bf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:53.054630 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3550f6ae-adfc-46f0-ba0b-5ad4cd66560a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a" status: 200 len: 1721 microversion: 2.1 time: 0.270683 Oct 18 15:38:53.064902 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1631/3205] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:52 2022] GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a => generated 1721 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:53.290426 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f4ce4800-237d-421e-b04f-77e3cbee4df9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:53.291171 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f4ce4800-237d-421e-b04f-77e3cbee4df9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: d280f396-df42-482a-b0c1-9a8a9b608f57] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:53.305157 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4ce4800-237d-421e-b04f-77e3cbee4df9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:53.305754 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4ce4800-237d-421e-b04f-77e3cbee4df9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:53.306215 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4ce4800-237d-421e-b04f-77e3cbee4df9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:53.306965 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4ce4800-237d-421e-b04f-77e3cbee4df9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:53.307587 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4ce4800-237d-421e-b04f-77e3cbee4df9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:53.308045 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4ce4800-237d-421e-b04f-77e3cbee4df9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:53.309532 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2c07caa6-6aca-48f9-aefb-cf4dd396adcf tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:53.312432 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2c07caa6-6aca-48f9-aefb-cf4dd396adcf tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 2059ec7e-ef9b-4eb6-af19-34b2bd09e44a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:53.326971 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c07caa6-6aca-48f9-aefb-cf4dd396adcf tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:53.327908 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c07caa6-6aca-48f9-aefb-cf4dd396adcf tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:53.328755 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c07caa6-6aca-48f9-aefb-cf4dd396adcf tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:53.331129 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c07caa6-6aca-48f9-aefb-cf4dd396adcf tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:53.332620 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c07caa6-6aca-48f9-aefb-cf4dd396adcf tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:53.334643 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c07caa6-6aca-48f9-aefb-cf4dd396adcf tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:53.646515 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f4ce4800-237d-421e-b04f-77e3cbee4df9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:53.655781 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f4ce4800-237d-421e-b04f-77e3cbee4df9 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57" status: 200 len: 1477 microversion: 2.1 time: 0.378713 Oct 18 15:38:53.669042 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2c07caa6-6aca-48f9-aefb-cf4dd396adcf tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:53.669917 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1575/3206] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:53 2022] GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57 => generated 1477 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:53.678488 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2c07caa6-6aca-48f9-aefb-cf4dd396adcf tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a" status: 200 len: 1513 microversion: 2.1 time: 0.378689 Oct 18 15:38:53.679381 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1632/3207] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:53 2022] GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a => generated 1513 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:38:53.694440 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-045f286e-ebdb-4092-a60a-18e0daece4bf tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:53.697481 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-045f286e-ebdb-4092-a60a-18e0daece4bf tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:53.706164 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-045f286e-ebdb-4092-a60a-18e0daece4bf tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:53.706876 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-045f286e-ebdb-4092-a60a-18e0daece4bf tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:53.708107 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-045f286e-ebdb-4092-a60a-18e0daece4bf tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:53.709544 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-045f286e-ebdb-4092-a60a-18e0daece4bf tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:53.710654 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-045f286e-ebdb-4092-a60a-18e0daece4bf tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:53.711284 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-045f286e-ebdb-4092-a60a-18e0daece4bf tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:53.805231 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3f5d827a-ed20-402e-ae10-11cbf231ff0c tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:53.806304 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3f5d827a-ed20-402e-ae10-11cbf231ff0c tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] [instance: 64730348-4d42-40d3-aeac-a4aad6c10d67] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:53.817033 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3f5d827a-ed20-402e-ae10-11cbf231ff0c tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:53.818101 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3f5d827a-ed20-402e-ae10-11cbf231ff0c tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:53.818549 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3f5d827a-ed20-402e-ae10-11cbf231ff0c tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:53.819452 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3f5d827a-ed20-402e-ae10-11cbf231ff0c tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:53.819786 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3f5d827a-ed20-402e-ae10-11cbf231ff0c tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:53.820221 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3f5d827a-ed20-402e-ae10-11cbf231ff0c tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:54.209971 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-045f286e-ebdb-4092-a60a-18e0daece4bf tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:54.220486 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-045f286e-ebdb-4092-a60a-18e0daece4bf tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:54.222170 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-045f286e-ebdb-4092-a60a-18e0daece4bf tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:54.223533 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-045f286e-ebdb-4092-a60a-18e0daece4bf tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 200 len: 1892 microversion: 2.32 time: 0.533785 Oct 18 15:38:54.225117 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1576/3208] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:38:53 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 1892 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:38:54.230982 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3f5d827a-ed20-402e-ae10-11cbf231ff0c tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7ebe0c265144769931ca6262be8860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a84f93ce8049c3a20c3b835f28100f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:54.240302 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-18fb56ea-a969-4ca4-9faf-ce50a1e03a72 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:54.240958 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-18fb56ea-a969-4ca4-9faf-ce50a1e03a72 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 52d725f3-b4da-4831-9abf-bf7aba8aee0a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:54.243315 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3f5d827a-ed20-402e-ae10-11cbf231ff0c tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] 10.222.0.60 "GET /compute/v2.1/servers/64730348-4d42-40d3-aeac-a4aad6c10d67" status: 200 len: 1324 microversion: 2.1 time: 0.442545 Oct 18 15:38:54.243926 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1633/3209] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:53 2022] GET /compute/v2.1/servers/64730348-4d42-40d3-aeac-a4aad6c10d67 => generated 1324 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:38:54.263264 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18fb56ea-a969-4ca4-9faf-ce50a1e03a72 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:54.263755 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18fb56ea-a969-4ca4-9faf-ce50a1e03a72 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:54.264191 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18fb56ea-a969-4ca4-9faf-ce50a1e03a72 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:54.266624 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18fb56ea-a969-4ca4-9faf-ce50a1e03a72 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:54.267371 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18fb56ea-a969-4ca4-9faf-ce50a1e03a72 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:54.267704 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18fb56ea-a969-4ca4-9faf-ce50a1e03a72 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:54.465676 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-18fb56ea-a969-4ca4-9faf-ce50a1e03a72 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304b3248f9db4629943a8b8080a6d22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdc7504a1d1424ea34f83f1a6d4bf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:54.482767 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-18fb56ea-a969-4ca4-9faf-ce50a1e03a72 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a" status: 200 len: 1721 microversion: 2.1 time: 0.256572 Oct 18 15:38:54.501810 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1577/3210] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:54 2022] GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a => generated 1721 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:54.683992 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4d4e6a9f-72bf-490b-b6f9-a952dd3f561c tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:54.685002 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4d4e6a9f-72bf-490b-b6f9-a952dd3f561c tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: d280f396-df42-482a-b0c1-9a8a9b608f57] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:54.692161 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d4e6a9f-72bf-490b-b6f9-a952dd3f561c tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:54.694226 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d4e6a9f-72bf-490b-b6f9-a952dd3f561c tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:54.694916 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d4e6a9f-72bf-490b-b6f9-a952dd3f561c tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:54.696095 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d4e6a9f-72bf-490b-b6f9-a952dd3f561c tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:54.697023 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d4e6a9f-72bf-490b-b6f9-a952dd3f561c tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:54.697742 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d4e6a9f-72bf-490b-b6f9-a952dd3f561c tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:54.833023 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-29b907c5-0fc3-49a9-b2a5-47f9b3b76939 tempest-KeyPairsNegativeTestJSON-1144959541 tempest-KeyPairsNegativeTestJSON-1144959541-project] Action: 'create', calling method: .version_select at 0x7f7c3d76c550>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFJTvd8vBg8iyjdq4wIibPY5ZtzQpFWhjbGzv+0W1ar+L+99O3gmLJvoquErkIszJy/b0M/I/NgWQX2TsELijX8ylTcZKqiW17GpSl9CENu5WP/Ywos5XewSfbVn1WPOw=="}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:38:54.838327 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-29b907c5-0fc3-49a9-b2a5-47f9b3b76939 tempest-KeyPairsNegativeTestJSON-1144959541 tempest-KeyPairsNegativeTestJSON-1144959541-project] Request method failure captured: Oct 18 15:38:54.838327 n-d-853682-5 devstack@n-api.service[120405]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 18 15:38:54.838327 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:38:54.838327 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:38:54.838327 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:38:54.838327 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 257 Oct 18 15:38:54.838327 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:38:54.838327 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:38:54.838327 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:38:54.838327 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:38:54.838327 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsiOh9uuBOHxjB2QXxZp2088qtXqDteJnqieM8UkXV22IagCCmMlTbzRn_b4aznofGIG1cJLPKYXa0n-kI_ehp-nlU-ncAZ4bHH0WtVfNNRIfDHSUSFaFsOy8mh5y4K_T0vx8KZFnxaQHP2q_Xk8JiC4gbvtj751u9FQhvz1fD_dgKo Oct 18 15:38:54.838327 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:38:54.838327 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:38:54.838327 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:38:54.838327 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:38:54.838327 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:38:54.838327 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:38:54.838327 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 40143e4c280f4745961b2eb0725bf94e Oct 18 15:38:54.838327 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1144959541 Oct 18 15:38:54.838327 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:38:54.838327 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:38:54.839766 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/40143e4c280f4745961b2eb0725bf94e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/40143e4c280f4745961b2eb0725bf94e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/40143e4c280f4745961b2eb0725bf94e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_40143e4c280f4745961b2eb0725bf94e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:38:54.839766 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1144959541 Oct 18 15:38:54.839766 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 40143e4c280f4745961b2eb0725bf94e Oct 18 15:38:54.839766 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1144959541 Oct 18 15:38:54.839766 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-KeyPairsNegativeTestJSON-1144959541-project Oct 18 15:38:54.839766 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:38:54.839766 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:38:54.839766 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 88f254af6362425abc17bd766b05a50e Oct 18 15:38:54.839766 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1144959541-project Oct 18 15:38:54.839766 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:38:54.839766 n-d-853682-5 devstack@n-api.service[120405]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFJTvd8vBg8iyjdq4wIibPY5ZtzQpFWhjbGzv+0W1ar+L+99O3gmLJvoquErkIszJy/b0M/I/NgWQX2TsELijX8ylTcZKqiW17GpSl9CENu5WP/Ywos5XewSfbVn1WPOw=="}} Oct 18 15:38:54.840487 n-d-853682-5 devstack@n-api.service[120405]: method: Oct 18 15:38:54.840487 n-d-853682-5 devstack@n-api.service[120405]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 18 15:38:54.840487 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFJTvd8vBg8iyjdq4wIibPY5ZtzQpFWhjbGzv+0W1ar+L+99O3gmLJvoquErkIszJy/b0M/I/NgWQX2TsELijX8ylTcZKqiW17GpSl9CENu5WP/Ywos5XewSfbVn1WPOw=='}}} Oct 18 15:38:54.840487 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:38:54.840487 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:38:54.840487 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 18 15:38:54.840487 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 18 15:38:54.840487 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 18 15:38:54.840487 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 18 15:38:54.840487 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 18 15:38:54.840487 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 18 15:38:54.840487 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 18 15:38:54.840487 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:38:54.840487 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 18 15:38:54.840487 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:38:54.840487 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:38:54.840487 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 15:38:54.841619 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 15:38:54.841619 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 15:38:54.841619 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise error Oct 18 15:38:54.841619 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 18 15:38:54.841619 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:38:54.841619 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 18 15:38:54.841619 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 18 15:38:54.841619 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 18 15:38:54.841619 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 18 15:38:54.841619 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 18 15:38:54.841619 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:38:54.841619 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 18 15:38:54.841619 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 18 15:38:54.841619 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:38:54.841619 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:38:54.841619 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:38:54.841619 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:38:54.841619 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:38:54.841619 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:38:54.841619 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:38:54.841619 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:38:54.841619 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:38:54.841619 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:38:54.843008 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:38:54.843008 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:38:54.843008 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:38:54.843008 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:38:54.843008 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 15:38:54.843008 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 15:38:54.843008 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 15:38:54.843008 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 15:38:54.843008 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 15:38:54.843008 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 15:38:54.843008 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 18 15:38:54.843008 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:38:54.843008 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:38:54.843008 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:38:54.843008 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:38:54.843008 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:38:54.843008 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:38:54.843008 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 15:38:54.843008 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 15:38:54.844185 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 18 15:38:54.844185 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:38:54.846362 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-29b907c5-0fc3-49a9-b2a5-47f9b3b76939 tempest-KeyPairsNegativeTestJSON-1144959541 tempest-KeyPairsNegativeTestJSON-1144959541-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:38:54.847462 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-29b907c5-0fc3-49a9-b2a5-47f9b3b76939 tempest-KeyPairsNegativeTestJSON-1144959541 tempest-KeyPairsNegativeTestJSON-1144959541-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.187534 Oct 18 15:38:54.861812 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1634/3211] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Oct 18 15:38:54 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 198 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:38:54.863847 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b99710f1-eece-45f1-a2ce-6de8012e1cf4 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:54.865174 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b99710f1-eece-45f1-a2ce-6de8012e1cf4 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 2059ec7e-ef9b-4eb6-af19-34b2bd09e44a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:54.880780 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b99710f1-eece-45f1-a2ce-6de8012e1cf4 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:54.881299 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b99710f1-eece-45f1-a2ce-6de8012e1cf4 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:54.881744 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b99710f1-eece-45f1-a2ce-6de8012e1cf4 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:54.882464 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b99710f1-eece-45f1-a2ce-6de8012e1cf4 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:54.882922 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b99710f1-eece-45f1-a2ce-6de8012e1cf4 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:54.883346 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b99710f1-eece-45f1-a2ce-6de8012e1cf4 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:54.987770 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4d4e6a9f-72bf-490b-b6f9-a952dd3f561c tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:55.001318 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4d4e6a9f-72bf-490b-b6f9-a952dd3f561c tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57" status: 200 len: 1477 microversion: 2.1 time: 0.322922 Oct 18 15:38:55.002569 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1578/3212] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:54 2022] GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57 => generated 1477 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:38:55.010253 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-844c7f2b-b1d9-4a36-8c2d-ebed2012ca48 tempest-KeyPairsNegativeTestJSON-1144959541 tempest-KeyPairsNegativeTestJSON-1144959541-project] Action: 'create', calling method: .version_select at 0x7f7c3d023670>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-350264697", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:38:55.031466 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-844c7f2b-b1d9-4a36-8c2d-ebed2012ca48 tempest-KeyPairsNegativeTestJSON-1144959541 tempest-KeyPairsNegativeTestJSON-1144959541-project] Getting quotas for project 40143e4c280f4745961b2eb0725bf94e. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:38:55.039418 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-844c7f2b-b1d9-4a36-8c2d-ebed2012ca48 tempest-KeyPairsNegativeTestJSON-1144959541 tempest-KeyPairsNegativeTestJSON-1144959541-project] Getting quotas for user 88f254af6362425abc17bd766b05a50e and project 40143e4c280f4745961b2eb0725bf94e. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:38:55.064729 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-844c7f2b-b1d9-4a36-8c2d-ebed2012ca48 tempest-KeyPairsNegativeTestJSON-1144959541 tempest-KeyPairsNegativeTestJSON-1144959541-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 18 15:38:55.080365 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-844c7f2b-b1d9-4a36-8c2d-ebed2012ca48 tempest-KeyPairsNegativeTestJSON-1144959541 tempest-KeyPairsNegativeTestJSON-1144959541-project] Request method failure captured: Oct 18 15:38:55.080365 n-d-853682-5 devstack@n-api.service[120406]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 18 15:38:55.080365 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:38:55.080365 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:38:55.080365 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:38:55.080365 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 2166 Oct 18 15:38:55.080365 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:38:55.080365 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:38:55.080365 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:38:55.080365 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:38:55.080365 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsiOh9uuBOHxjB2QXxZp2088qtXqDteJnqieM8UkXV22IagCCmMlTbzRn_b4aznofGIG1cJLPKYXa0n-kI_ehp-nlU-ncAZ4bHH0WtVfNNRIfDHSUSFaFsOy8mh5y4K_T0vx8KZFnxaQHP2q_Xk8JiC4gbvtj751u9FQhvz1fD_dgKo Oct 18 15:38:55.080365 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:38:55.080365 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:38:55.080365 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:38:55.080365 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:38:55.080365 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:38:55.080365 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:38:55.080365 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 40143e4c280f4745961b2eb0725bf94e Oct 18 15:38:55.080365 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1144959541 Oct 18 15:38:55.080365 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:38:55.080365 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:38:55.080365 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/40143e4c280f4745961b2eb0725bf94e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/40143e4c280f4745961b2eb0725bf94e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/40143e4c280f4745961b2eb0725bf94e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_40143e4c280f4745961b2eb0725bf94e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:38:55.080365 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1144959541 Oct 18 15:38:55.080365 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 40143e4c280f4745961b2eb0725bf94e Oct 18 15:38:55.080365 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1144959541 Oct 18 15:38:55.080365 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-KeyPairsNegativeTestJSON-1144959541-project Oct 18 15:38:55.080365 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:38:55.080365 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:38:55.080365 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 88f254af6362425abc17bd766b05a50e Oct 18 15:38:55.080365 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1144959541-project Oct 18 15:38:55.080365 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:38:55.080365 n-d-853682-5 devstack@n-api.service[120406]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-350264697", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 18 15:38:55.080365 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:38:55.080365 n-d-853682-5 devstack@n-api.service[120406]: exception: Keypair data is invalid: failed to generate fingerprint Oct 18 15:38:55.083460 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-350264697', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 18 15:38:55.083460 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:38:55.083460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:38:55.083460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 18 15:38:55.083460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 18 15:38:55.083460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 18 15:38:55.083460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 18 15:38:55.083460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 18 15:38:55.083460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:38:55.083460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:38:55.083460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:38:55.083460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:38:55.083460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 18 15:38:55.083460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 18 15:38:55.083460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 15:38:55.083460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 15:38:55.083460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 15:38:55.083460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 15:38:55.083460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 15:38:55.083460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 15:38:55.083460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 15:38:55.083460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 15:38:55.083460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 18 15:38:55.083460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 18 15:38:55.083460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 18 15:38:55.083460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 18 15:38:55.083460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 18 15:38:55.083460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 18 15:38:55.083460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 18 15:38:55.083460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:38:55.083460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:38:55.083460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:38:55.083460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:38:55.083460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:38:55.083460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:38:55.083460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:38:55.083460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:38:55.083460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:38:55.083460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:38:55.083460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:38:55.083460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:38:55.088246 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:38:55.088246 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:38:55.088246 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:38:55.088246 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:38:55.088246 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 18 15:38:55.088246 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 18 15:38:55.088246 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 18 15:38:55.088246 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 18 15:38:55.088246 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 18 15:38:55.088246 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:38:55.088246 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:38:55.088246 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:38:55.088246 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:38:55.088246 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:38:55.088246 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:38:55.088246 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:38:55.088246 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:38:55.088246 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 18 15:38:55.088246 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:38:55.094181 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-844c7f2b-b1d9-4a36-8c2d-ebed2012ca48 tempest-KeyPairsNegativeTestJSON-1144959541 tempest-KeyPairsNegativeTestJSON-1144959541-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:38:55.094316 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b99710f1-eece-45f1-a2ce-6de8012e1cf4 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:55.096604 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-844c7f2b-b1d9-4a36-8c2d-ebed2012ca48 tempest-KeyPairsNegativeTestJSON-1144959541 tempest-KeyPairsNegativeTestJSON-1144959541-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.091604 Oct 18 15:38:55.099095 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1579/3213] 10.222.0.60 () {60 vars in 1160 bytes} [Tue Oct 18 15:38:55 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 94 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 18 15:38:55.106871 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b99710f1-eece-45f1-a2ce-6de8012e1cf4 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a" status: 200 len: 1513 microversion: 2.1 time: 0.246230 Oct 18 15:38:55.107575 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1635/3214] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:54 2022] GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a => generated 1513 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:55.110883 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-c6587ad1-b3e7-41ee-a892-c032ee09ed14 req-389955e6-2c79-46f0-8af5-b2b83eceebcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf8f81da-4aa0-498d-af1e-c036238f065d", "tag": "728b9ef4-fe70-49aa-a715-30bd7cc7b07b"}, {"name": "network-changed", "server_uuid": "cf8f81da-4aa0-498d-af1e-c036238f065d", "tag": "c4a0dc0d-0a7d-4afc-aa10-4271ba62b220"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:38:55.123205 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9c7f7ec8-db73-4961-8122-d0104b725ab2 tempest-KeyPairsNegativeTestJSON-1144959541 tempest-KeyPairsNegativeTestJSON-1144959541-project] Action: 'create', calling method: .version_select at 0x7f7c3d76caf0>, body: {"keypair": {"name": "tempest-keypair-842687260", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrmoHF6nEWRVgJ8WM8DTr1PrNKwcOy0FJQH4YkjEWywOuZYe9QHDIHnoXduvSOoyc24VqP/FsRaZPXnpi/9KRt66eJc/O/gqk5gJcicI8GT4BwPVWzA1jesySZaEsQPoA=="}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:38:55.129735 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c6587ad1-b3e7-41ee-a892-c032ee09ed14 req-389955e6-2c79-46f0-8af5-b2b83eceebcd service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:55.130772 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c6587ad1-b3e7-41ee-a892-c032ee09ed14 req-389955e6-2c79-46f0-8af5-b2b83eceebcd service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:55.131210 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c6587ad1-b3e7-41ee-a892-c032ee09ed14 req-389955e6-2c79-46f0-8af5-b2b83eceebcd service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:55.145047 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-c6587ad1-b3e7-41ee-a892-c032ee09ed14 req-389955e6-2c79-46f0-8af5-b2b83eceebcd service nova] Creating event network-changed:728b9ef4-fe70-49aa-a715-30bd7cc7b07b for instance cf8f81da-4aa0-498d-af1e-c036238f065d on n-h2-853682-5 Oct 18 15:38:55.147017 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-c6587ad1-b3e7-41ee-a892-c032ee09ed14 req-389955e6-2c79-46f0-8af5-b2b83eceebcd service nova] Creating event network-changed:c4a0dc0d-0a7d-4afc-aa10-4271ba62b220 for instance cf8f81da-4aa0-498d-af1e-c036238f065d on n-h2-853682-5 Oct 18 15:38:55.158618 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-c6587ad1-b3e7-41ee-a892-c032ee09ed14 req-389955e6-2c79-46f0-8af5-b2b83eceebcd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.057175 Oct 18 15:38:55.159929 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1580/3215] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:38:55.161240 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-9c7f7ec8-db73-4961-8122-d0104b725ab2 tempest-KeyPairsNegativeTestJSON-1144959541 tempest-KeyPairsNegativeTestJSON-1144959541-project] Getting quotas for project 40143e4c280f4745961b2eb0725bf94e. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:38:55.169476 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-9c7f7ec8-db73-4961-8122-d0104b725ab2 tempest-KeyPairsNegativeTestJSON-1144959541 tempest-KeyPairsNegativeTestJSON-1144959541-project] Getting quotas for user 88f254af6362425abc17bd766b05a50e and project 40143e4c280f4745961b2eb0725bf94e. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:38:55.245313 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9c7f7ec8-db73-4961-8122-d0104b725ab2 tempest-KeyPairsNegativeTestJSON-1144959541 tempest-KeyPairsNegativeTestJSON-1144959541-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.136419 Oct 18 15:38:55.254023 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b8b4a3a2-ece1-4c0c-9147-ad6f4f6ae889 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:55.255415 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b8b4a3a2-ece1-4c0c-9147-ad6f4f6ae889 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:55.262484 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1636/3216] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Oct 18 15:38:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:38:55.265744 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8b4a3a2-ece1-4c0c-9147-ad6f4f6ae889 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:55.266454 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8b4a3a2-ece1-4c0c-9147-ad6f4f6ae889 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:55.267088 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8b4a3a2-ece1-4c0c-9147-ad6f4f6ae889 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:55.268346 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8b4a3a2-ece1-4c0c-9147-ad6f4f6ae889 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:55.269265 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8b4a3a2-ece1-4c0c-9147-ad6f4f6ae889 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:55.271350 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8b4a3a2-ece1-4c0c-9147-ad6f4f6ae889 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:55.272749 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b122b8ad-3640-43b5-8a2b-40919c54040e tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:55.273302 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b122b8ad-3640-43b5-8a2b-40919c54040e tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] [instance: 64730348-4d42-40d3-aeac-a4aad6c10d67] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:55.290656 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b122b8ad-3640-43b5-8a2b-40919c54040e tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:55.291186 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b122b8ad-3640-43b5-8a2b-40919c54040e tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:55.291752 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b122b8ad-3640-43b5-8a2b-40919c54040e tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:55.292486 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b122b8ad-3640-43b5-8a2b-40919c54040e tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:55.294223 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b122b8ad-3640-43b5-8a2b-40919c54040e tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:55.294670 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b122b8ad-3640-43b5-8a2b-40919c54040e tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:55.968117 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b122b8ad-3640-43b5-8a2b-40919c54040e tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7ebe0c265144769931ca6262be8860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a84f93ce8049c3a20c3b835f28100f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:55.977469 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b122b8ad-3640-43b5-8a2b-40919c54040e tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] 10.222.0.60 "GET /compute/v2.1/servers/64730348-4d42-40d3-aeac-a4aad6c10d67" status: 200 len: 1324 microversion: 2.1 time: 0.712236 Oct 18 15:38:55.990282 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1637/3217] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:55 2022] GET /compute/v2.1/servers/64730348-4d42-40d3-aeac-a4aad6c10d67 => generated 1324 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:55.999787 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-403426af-93ed-4186-a65c-dfb3884f1523 tempest-KeyPairsNegativeTestJSON-1144959541 tempest-KeyPairsNegativeTestJSON-1144959541-project] Action: 'create', calling method: .version_select at 0x7f7c3cfeb790>, body: {"keypair": {"name": "tempest-keypair-842687260", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHdSijaPNerePzZPEC4/fpCnjPdb5wK5jzLv1QSW45v3L8VyUPht3bSOt5nxRnMHhMycNWmZ0UDfJtMCIjcJ7N4z28dBPLmGTeTUy6PUCBIHN+b8wpKnTRN5bPmoXXwF9w=="}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:38:56.000980 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b8b4a3a2-ece1-4c0c-9147-ad6f4f6ae889 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:56.004498 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:38:56.018946 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b8b4a3a2-ece1-4c0c-9147-ad6f4f6ae889 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:56.022303 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-403426af-93ed-4186-a65c-dfb3884f1523 tempest-KeyPairsNegativeTestJSON-1144959541 tempest-KeyPairsNegativeTestJSON-1144959541-project] Getting quotas for project 40143e4c280f4745961b2eb0725bf94e. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:38:56.022570 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b8b4a3a2-ece1-4c0c-9147-ad6f4f6ae889 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:56.024388 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b8b4a3a2-ece1-4c0c-9147-ad6f4f6ae889 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 200 len: 1892 microversion: 2.32 time: 0.774904 Oct 18 15:38:56.025761 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1581/3218] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:38:55 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 1892 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:38:56.029660 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-403426af-93ed-4186-a65c-dfb3884f1523 tempest-KeyPairsNegativeTestJSON-1144959541 tempest-KeyPairsNegativeTestJSON-1144959541-project] Getting quotas for user 88f254af6362425abc17bd766b05a50e and project 40143e4c280f4745961b2eb0725bf94e. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:38:56.044586 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6612f847-5b5a-433a-8c25-88799ed215d1 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:56.045366 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:38:56.046043 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6612f847-5b5a-433a-8c25-88799ed215d1 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 52d725f3-b4da-4831-9abf-bf7aba8aee0a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:56.060008 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6612f847-5b5a-433a-8c25-88799ed215d1 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:56.060593 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6612f847-5b5a-433a-8c25-88799ed215d1 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:56.061134 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6612f847-5b5a-433a-8c25-88799ed215d1 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:56.061954 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6612f847-5b5a-433a-8c25-88799ed215d1 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:56.062658 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6612f847-5b5a-433a-8c25-88799ed215d1 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:56.063329 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6612f847-5b5a-433a-8c25-88799ed215d1 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:56.065238 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-403426af-93ed-4186-a65c-dfb3884f1523 tempest-KeyPairsNegativeTestJSON-1144959541 tempest-KeyPairsNegativeTestJSON-1144959541-project] HTTP exception thrown: Key pair 'tempest-keypair-842687260' already exists. Oct 18 15:38:56.079378 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-403426af-93ed-4186-a65c-dfb3884f1523 tempest-KeyPairsNegativeTestJSON-1144959541 tempest-KeyPairsNegativeTestJSON-1144959541-project] Request method failure captured: Oct 18 15:38:56.079378 n-d-853682-5 devstack@n-api.service[120405]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 18 15:38:56.079378 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:38:56.079378 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:38:56.079378 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:38:56.079378 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 272 Oct 18 15:38:56.079378 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:38:56.079378 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:38:56.079378 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:38:56.079378 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:38:56.079378 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsiOh9uuBOHxjB2QXxZp2088qtXqDteJnqieM8UkXV22IagCCmMlTbzRn_b4aznofGIG1cJLPKYXa0n-kI_ehp-nlU-ncAZ4bHH0WtVfNNRIfDHSUSFaFsOy8mh5y4K_T0vx8KZFnxaQHP2q_Xk8JiC4gbvtj751u9FQhvz1fD_dgKo Oct 18 15:38:56.079378 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:38:56.079378 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:38:56.079378 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:38:56.079378 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:38:56.079378 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:38:56.079378 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:38:56.079378 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 40143e4c280f4745961b2eb0725bf94e Oct 18 15:38:56.079378 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1144959541 Oct 18 15:38:56.079378 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:38:56.079378 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:38:56.079378 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/40143e4c280f4745961b2eb0725bf94e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/40143e4c280f4745961b2eb0725bf94e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/40143e4c280f4745961b2eb0725bf94e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_40143e4c280f4745961b2eb0725bf94e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:38:56.079378 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1144959541 Oct 18 15:38:56.079378 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 40143e4c280f4745961b2eb0725bf94e Oct 18 15:38:56.079378 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1144959541 Oct 18 15:38:56.079378 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-KeyPairsNegativeTestJSON-1144959541-project Oct 18 15:38:56.079378 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:38:56.079378 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:38:56.079378 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 88f254af6362425abc17bd766b05a50e Oct 18 15:38:56.079378 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1144959541-project Oct 18 15:38:56.079378 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:38:56.079378 n-d-853682-5 devstack@n-api.service[120405]: {"keypair": {"name": "tempest-keypair-842687260", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHdSijaPNerePzZPEC4/fpCnjPdb5wK5jzLv1QSW45v3L8VyUPht3bSOt5nxRnMHhMycNWmZ0UDfJtMCIjcJ7N4z28dBPLmGTeTUy6PUCBIHN+b8wpKnTRN5bPmoXXwF9w=="}} Oct 18 15:38:56.079378 n-d-853682-5 devstack@n-api.service[120405]: method: Oct 18 15:38:56.079378 n-d-853682-5 devstack@n-api.service[120405]: exception: Key pair 'tempest-keypair-842687260' already exists. Oct 18 15:38:56.079378 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-842687260', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHdSijaPNerePzZPEC4/fpCnjPdb5wK5jzLv1QSW45v3L8VyUPht3bSOt5nxRnMHhMycNWmZ0UDfJtMCIjcJ7N4z28dBPLmGTeTUy6PUCBIHN+b8wpKnTRN5bPmoXXwF9w=='}}} Oct 18 15:38:56.079378 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:38:56.079378 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:38:56.079378 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 15:38:56.079378 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 18 15:38:56.079378 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 15:38:56.079378 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 18 15:38:56.079378 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 15:38:56.079378 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 18 15:38:56.079378 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 15:38:56.079378 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 18 15:38:56.079378 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 15:38:56.079378 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 15:38:56.079378 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 15:38:56.079378 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi result.read() Oct 18 15:38:56.079378 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 15:38:56.079378 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 18 15:38:56.079378 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 15:38:56.079378 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 18 15:38:56.079378 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 15:38:56.079378 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 18 15:38:56.079378 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 15:38:56.079378 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 18 15:38:56.079378 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '88f254af6362425abc17bd766b05a50e-tempest-keypair-842687260' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 18 15:38:56.079378 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:38:56.084634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 18 15:38:56.084634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:38:56.084634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:38:56.084634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 18 15:38:56.084634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 18 15:38:56.084634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 18 15:38:56.084634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi session.flush() Oct 18 15:38:56.084634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 18 15:38:56.084634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 18 15:38:56.084634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 18 15:38:56.084634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 18 15:38:56.084634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 18 15:38:56.084634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 18 15:38:56.084634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 15:38:56.084634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception Oct 18 15:38:56.084634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 18 15:38:56.084634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 18 15:38:56.084634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 18 15:38:56.084634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 18 15:38:56.084634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 18 15:38:56.084634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 18 15:38:56.084634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 18 15:38:56.084634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 18 15:38:56.084634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 18 15:38:56.084634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 18 15:38:56.084634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 18 15:38:56.084634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 18 15:38:56.084634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 18 15:38:56.084634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 18 15:38:56.084634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 18 15:38:56.084634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 18 15:38:56.084634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 18 15:38:56.084634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 18 15:38:56.084634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 18 15:38:56.084634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 18 15:38:56.084634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 15:38:56.084634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception Oct 18 15:38:56.084634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 15:38:56.084634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 18 15:38:56.084634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 15:38:56.084634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 18 15:38:56.084634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 15:38:56.084634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 18 15:38:56.084634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 15:38:56.084634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 18 15:38:56.084634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 15:38:56.084634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 15:38:56.084634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 15:38:56.084634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi result.read() Oct 18 15:38:56.084634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 15:38:56.084634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 18 15:38:56.084634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 15:38:56.084634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 18 15:38:56.084634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 15:38:56.084634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 18 15:38:56.084634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 15:38:56.090813 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 18 15:38:56.090813 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '88f254af6362425abc17bd766b05a50e-tempest-keypair-842687260' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 18 15:38:56.090813 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 18 15:38:56.090813 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 18, 15, 38, 56, 51620), 'updated_at': None, 'name': 'tempest-keypair-842687260', 'user_id': '88f254af6362425abc17bd766b05a50e', 'fingerprint': '3b:b1:06:42:a2:12:f7:9c:55:0f:c1:ce:ae:83:8a:06', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHdSijaPNerePzZPEC4/fpCnjPdb5wK5jzLv1QSW45v3L8VyUPht3bSOt5nxRnMHhMycNWmZ0UDfJtMCIjcJ7N4z28dBPLmGTeTUy6PUCBIHN+b8wpKnTRN5bPmoXXwF9w==', 'type': 'ssh'}] Oct 18 15:38:56.090813 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 18 15:38:56.090813 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:38:56.090813 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:38:56.090813 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:38:56.090813 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:38:56.090813 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 18 15:38:56.090813 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 18 15:38:56.090813 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 15:38:56.090813 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 15:38:56.090813 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 15:38:56.090813 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 15:38:56.090813 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 15:38:56.090813 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 15:38:56.090813 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 15:38:56.090813 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 15:38:56.090813 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 18 15:38:56.090813 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi keypair.create() Oct 18 15:38:56.090813 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 18 15:38:56.090813 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 18 15:38:56.090813 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 18 15:38:56.090813 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._create() Oct 18 15:38:56.090813 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 18 15:38:56.090813 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 18 15:38:56.090813 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 18 15:38:56.090813 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 18 15:38:56.090813 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 15:38:56.090813 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 15:38:56.090813 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 18 15:38:56.090813 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 18 15:38:56.090813 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-842687260' already exists. Oct 18 15:38:56.090813 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:38:56.090813 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:38:56.090813 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:38:56.090813 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:38:56.090813 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:38:56.090813 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:38:56.090813 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:38:56.090813 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:38:56.090813 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:38:56.090813 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:38:56.090813 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:38:56.090813 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:38:56.090813 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:38:56.090813 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:38:56.090813 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:38:56.090813 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:38:56.090813 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 18 15:38:56.090813 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 18 15:38:56.090813 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 18 15:38:56.090813 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 18 15:38:56.090813 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-842687260' already exists. Oct 18 15:38:56.096404 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:38:56.096404 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:38:56.096404 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:38:56.096404 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:38:56.096404 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:38:56.096404 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:38:56.096404 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:38:56.096404 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:38:56.096404 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-842687260' already exists. Oct 18 15:38:56.096404 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:38:56.096404 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-403426af-93ed-4186-a65c-dfb3884f1523 tempest-KeyPairsNegativeTestJSON-1144959541 tempest-KeyPairsNegativeTestJSON-1144959541-project] Returning 409 to user: Key pair 'tempest-keypair-842687260' already exists. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:38:56.098852 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-403426af-93ed-4186-a65c-dfb3884f1523 tempest-KeyPairsNegativeTestJSON-1144959541 tempest-KeyPairsNegativeTestJSON-1144959541-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.106621 Oct 18 15:38:56.109607 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1638/3219] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Oct 18 15:38:55 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 118 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 15:38:56.117999 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-befc923d-8667-4db4-acd3-a5ac7c595115 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:56.118621 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-befc923d-8667-4db4-acd3-a5ac7c595115 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: d280f396-df42-482a-b0c1-9a8a9b608f57] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:56.125526 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-befc923d-8667-4db4-acd3-a5ac7c595115 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:56.125719 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-befc923d-8667-4db4-acd3-a5ac7c595115 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:56.126078 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-befc923d-8667-4db4-acd3-a5ac7c595115 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:56.126971 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-befc923d-8667-4db4-acd3-a5ac7c595115 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:56.127602 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-befc923d-8667-4db4-acd3-a5ac7c595115 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:56.128034 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-befc923d-8667-4db4-acd3-a5ac7c595115 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:56.410035 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6612f847-5b5a-433a-8c25-88799ed215d1 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304b3248f9db4629943a8b8080a6d22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdc7504a1d1424ea34f83f1a6d4bf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:56.418403 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-befc923d-8667-4db4-acd3-a5ac7c595115 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:56.420082 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6612f847-5b5a-433a-8c25-88799ed215d1 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a" status: 200 len: 1698 microversion: 2.1 time: 0.385680 Oct 18 15:38:56.433659 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1582/3220] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:56 2022] GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a => generated 1698 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:56.447052 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-befc923d-8667-4db4-acd3-a5ac7c595115 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57" status: 200 len: 1477 microversion: 2.1 time: 0.334722 Oct 18 15:38:56.448223 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1639/3221] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:56 2022] GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57 => generated 1477 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:56.452425 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4c709029-7ee2-4b26-897c-913b8ecfd2e0 tempest-KeyPairsNegativeTestJSON-1144959541 tempest-KeyPairsNegativeTestJSON-1144959541-project] Calling method '.version_select at 0x7f7c3c723a60>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:56.456020 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e17a6155-1b7e-484f-a4f1-699aedddf7d4 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:56.460936 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e17a6155-1b7e-484f-a4f1-699aedddf7d4 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 2059ec7e-ef9b-4eb6-af19-34b2bd09e44a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:56.468851 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e17a6155-1b7e-484f-a4f1-699aedddf7d4 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:56.469583 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e17a6155-1b7e-484f-a4f1-699aedddf7d4 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:56.470219 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e17a6155-1b7e-484f-a4f1-699aedddf7d4 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:56.471276 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e17a6155-1b7e-484f-a4f1-699aedddf7d4 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:56.471979 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e17a6155-1b7e-484f-a4f1-699aedddf7d4 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:56.472572 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e17a6155-1b7e-484f-a4f1-699aedddf7d4 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:56.487227 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4c709029-7ee2-4b26-897c-913b8ecfd2e0 tempest-KeyPairsNegativeTestJSON-1144959541 tempest-KeyPairsNegativeTestJSON-1144959541-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-842687260" status: 202 len: 0 microversion: 2.1 time: 0.052058 Oct 18 15:38:56.487767 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1583/3222] 10.222.0.60 () {58 vars in 1218 bytes} [Tue Oct 18 15:38:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-842687260 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:38:56.498025 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-266f8102-54e7-4def-bbfe-0e59a973c195 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:38:56.504708 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-266f8102-54e7-4def-bbfe-0e59a973c195 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:56.505999 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-266f8102-54e7-4def-bbfe-0e59a973c195 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:56.506647 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-266f8102-54e7-4def-bbfe-0e59a973c195 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:56.575061 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-266f8102-54e7-4def-bbfe-0e59a973c195 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 52d725f3-b4da-4831-9abf-bf7aba8aee0a] Going to try to start instance {{(pid=120406) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 18 15:38:56.623361 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-266f8102-54e7-4def-bbfe-0e59a973c195 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "POST /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a/action" status: 202 len: 0 microversion: 2.1 time: 0.134283 Oct 18 15:38:56.624333 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1584/3223] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:38:56 2022] POST /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:38:56.630785 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-75a8dc59-a8c1-4492-a79b-3750e9b0517e tempest-KeyPairsNegativeTestJSON-1144959541 tempest-KeyPairsNegativeTestJSON-1144959541-project] Action: 'create', calling method: .version_select at 0x7f7c414d09d0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBxPwmGU7WdD1xLjEpa10e90Jna/OZcrnCp1FND1NFmszBHU/KpVJuk8nWcb5Iy6/R7VFima0xLkoV3hQjRfbUUZ7NgE99xGSnM+1KH6vALWPH6tzgKIyZmuS68lr1Dhg=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-75a8dc59-a8c1-4492-a79b-3750e9b0517e tempest-KeyPairsNegativeTestJSON-1144959541 tempest-KeyPairsNegativeTestJSON-1144959541-project] Request method failure captured: Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 247 Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsiOh9uuBOHxjB2QXxZp2088qtXqDteJnqieM8UkXV22IagCCmMlTbzRn_b4aznofGIG1cJLPKYXa0n-kI_ehp-nlU-ncAZ4bHH0WtVfNNRIfDHSUSFaFsOy8mh5y4K_T0vx8KZFnxaQHP2q_Xk8JiC4gbvtj751u9FQhvz1fD_dgKo Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 40143e4c280f4745961b2eb0725bf94e Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1144959541 Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/40143e4c280f4745961b2eb0725bf94e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/40143e4c280f4745961b2eb0725bf94e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/40143e4c280f4745961b2eb0725bf94e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_40143e4c280f4745961b2eb0725bf94e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1144959541 Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 40143e4c280f4745961b2eb0725bf94e Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1144959541 Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-KeyPairsNegativeTestJSON-1144959541-project Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 88f254af6362425abc17bd766b05a50e Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1144959541-project Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBxPwmGU7WdD1xLjEpa10e90Jna/OZcrnCp1FND1NFmszBHU/KpVJuk8nWcb5Iy6/R7VFima0xLkoV3hQjRfbUUZ7NgE99xGSnM+1KH6vALWPH6tzgKIyZmuS68lr1Dhg=="}} Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBxPwmGU7WdD1xLjEpa10e90Jna/OZcrnCp1FND1NFmszBHU/KpVJuk8nWcb5Iy6/R7VFima0xLkoV3hQjRfbUUZ7NgE99xGSnM+1KH6vALWPH6tzgKIyZmuS68lr1Dhg=='}}} Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise error Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi '' Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 15:38:56.637170 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 15:38:56.642064 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 15:38:56.642064 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 15:38:56.642064 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 15:38:56.642064 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 15:38:56.642064 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 18 15:38:56.642064 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:38:56.642064 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:38:56.642064 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:38:56.642064 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:38:56.642064 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:38:56.642064 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:38:56.642064 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 15:38:56.642064 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 15:38:56.642064 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 18 15:38:56.642064 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:38:56.642064 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-75a8dc59-a8c1-4492-a79b-3750e9b0517e tempest-KeyPairsNegativeTestJSON-1144959541 tempest-KeyPairsNegativeTestJSON-1144959541-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:38:56.644058 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-75a8dc59-a8c1-4492-a79b-3750e9b0517e tempest-KeyPairsNegativeTestJSON-1144959541 tempest-KeyPairsNegativeTestJSON-1144959541-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.018070 Oct 18 15:38:56.645160 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1585/3224] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Oct 18 15:38:56 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:38:56.650335 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-06142c52-4117-47b2-8dad-759da4d61024 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:56.651064 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-06142c52-4117-47b2-8dad-759da4d61024 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 52d725f3-b4da-4831-9abf-bf7aba8aee0a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:56.660908 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06142c52-4117-47b2-8dad-759da4d61024 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:56.662064 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06142c52-4117-47b2-8dad-759da4d61024 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:56.662653 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06142c52-4117-47b2-8dad-759da4d61024 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:56.663558 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06142c52-4117-47b2-8dad-759da4d61024 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:56.664201 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06142c52-4117-47b2-8dad-759da4d61024 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:56.664726 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06142c52-4117-47b2-8dad-759da4d61024 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:56.738655 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e17a6155-1b7e-484f-a4f1-699aedddf7d4 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:56.749924 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e17a6155-1b7e-484f-a4f1-699aedddf7d4 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a" status: 200 len: 1513 microversion: 2.1 time: 0.300395 Oct 18 15:38:56.750698 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1640/3225] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:56 2022] GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a => generated 1513 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:56.756604 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-095b05db-36d6-4ec5-98f8-8d2e9688a9a5 tempest-KeyPairsNegativeTestJSON-1144959541 tempest-KeyPairsNegativeTestJSON-1144959541-project] Action: 'create', calling method: .version_select at 0x7f7c3d66f430>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1316586421", "public_key": " "}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:38:56.777363 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-095b05db-36d6-4ec5-98f8-8d2e9688a9a5 tempest-KeyPairsNegativeTestJSON-1144959541 tempest-KeyPairsNegativeTestJSON-1144959541-project] Getting quotas for project 40143e4c280f4745961b2eb0725bf94e. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:38:56.782921 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-095b05db-36d6-4ec5-98f8-8d2e9688a9a5 tempest-KeyPairsNegativeTestJSON-1144959541 tempest-KeyPairsNegativeTestJSON-1144959541-project] Getting quotas for user 88f254af6362425abc17bd766b05a50e and project 40143e4c280f4745961b2eb0725bf94e. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:38:56.808495 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-095b05db-36d6-4ec5-98f8-8d2e9688a9a5 tempest-KeyPairsNegativeTestJSON-1144959541 tempest-KeyPairsNegativeTestJSON-1144959541-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-095b05db-36d6-4ec5-98f8-8d2e9688a9a5 tempest-KeyPairsNegativeTestJSON-1144959541 tempest-KeyPairsNegativeTestJSON-1144959541-project] Request method failure captured: Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 95 Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsiOh9uuBOHxjB2QXxZp2088qtXqDteJnqieM8UkXV22IagCCmMlTbzRn_b4aznofGIG1cJLPKYXa0n-kI_ehp-nlU-ncAZ4bHH0WtVfNNRIfDHSUSFaFsOy8mh5y4K_T0vx8KZFnxaQHP2q_Xk8JiC4gbvtj751u9FQhvz1fD_dgKo Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 40143e4c280f4745961b2eb0725bf94e Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1144959541 Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/40143e4c280f4745961b2eb0725bf94e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/40143e4c280f4745961b2eb0725bf94e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/40143e4c280f4745961b2eb0725bf94e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_40143e4c280f4745961b2eb0725bf94e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1144959541 Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 40143e4c280f4745961b2eb0725bf94e Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1144959541 Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-KeyPairsNegativeTestJSON-1144959541-project Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 88f254af6362425abc17bd766b05a50e Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1144959541-project Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1316586421", "public_key": " "}} Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: method: Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: exception: Keypair data is invalid: failed to generate fingerprint Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1316586421', 'public_key': ' '}}} Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:38:56.815326 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:38:56.821222 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:38:56.821222 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:38:56.821222 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:38:56.821222 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:38:56.821222 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:38:56.821222 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:38:56.821222 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:38:56.821222 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:38:56.821222 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:38:56.821222 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:38:56.821222 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:38:56.821222 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:38:56.821222 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:38:56.821222 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 18 15:38:56.821222 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 18 15:38:56.821222 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 18 15:38:56.821222 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 18 15:38:56.821222 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 18 15:38:56.821222 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:38:56.821222 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:38:56.821222 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:38:56.821222 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:38:56.821222 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:38:56.821222 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:38:56.821222 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:38:56.821222 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:38:56.821222 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 18 15:38:56.821222 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:38:56.821222 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-095b05db-36d6-4ec5-98f8-8d2e9688a9a5 tempest-KeyPairsNegativeTestJSON-1144959541 tempest-KeyPairsNegativeTestJSON-1144959541-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:38:56.821222 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-095b05db-36d6-4ec5-98f8-8d2e9688a9a5 tempest-KeyPairsNegativeTestJSON-1144959541 tempest-KeyPairsNegativeTestJSON-1144959541-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.065061 Oct 18 15:38:56.825599 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1641/3226] 10.222.0.60 () {60 vars in 1158 bytes} [Tue Oct 18 15:38:56 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 74 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 18 15:38:56.841949 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c0d4be3e-5e91-44f7-953d-272a2b1006c3 tempest-KeyPairsNegativeTestJSON-1144959541 tempest-KeyPairsNegativeTestJSON-1144959541-project] Action: 'create', calling method: .version_select at 0x7f7c3d1c1dc0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPPwOzWvcGsJKe/PR1GergDigH1QRm80+kp4AwCVEXu+3YKcqQ9ULaAarsjBB2PAafsW8tUP6MXqiiIHbZ358c/mw2BpTiwm5FGCzlCbrThGyZKiy2jPxY4ZkmJKLnMOKQ=="}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:38:56.848040 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c0d4be3e-5e91-44f7-953d-272a2b1006c3 tempest-KeyPairsNegativeTestJSON-1144959541 tempest-KeyPairsNegativeTestJSON-1144959541-project] Request method failure captured: Oct 18 15:38:56.848040 n-d-853682-5 devstack@n-api.service[120405]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 18 15:38:56.848040 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:38:56.848040 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:38:56.848040 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:38:56.848040 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 507 Oct 18 15:38:56.848040 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:38:56.848040 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:38:56.848040 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:38:56.848040 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:38:56.848040 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsiOh9uuBOHxjB2QXxZp2088qtXqDteJnqieM8UkXV22IagCCmMlTbzRn_b4aznofGIG1cJLPKYXa0n-kI_ehp-nlU-ncAZ4bHH0WtVfNNRIfDHSUSFaFsOy8mh5y4K_T0vx8KZFnxaQHP2q_Xk8JiC4gbvtj751u9FQhvz1fD_dgKo Oct 18 15:38:56.848040 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:38:56.848040 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:38:56.848040 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:38:56.848040 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:38:56.848040 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:38:56.848040 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:38:56.848040 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 40143e4c280f4745961b2eb0725bf94e Oct 18 15:38:56.848040 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1144959541 Oct 18 15:38:56.848040 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:38:56.848040 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:38:56.848040 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/40143e4c280f4745961b2eb0725bf94e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/40143e4c280f4745961b2eb0725bf94e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/40143e4c280f4745961b2eb0725bf94e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_40143e4c280f4745961b2eb0725bf94e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:38:56.848040 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1144959541 Oct 18 15:38:56.848040 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 40143e4c280f4745961b2eb0725bf94e Oct 18 15:38:56.848040 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1144959541 Oct 18 15:38:56.848040 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-KeyPairsNegativeTestJSON-1144959541-project Oct 18 15:38:56.848040 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:38:56.848040 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:38:56.848040 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 88f254af6362425abc17bd766b05a50e Oct 18 15:38:56.848040 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1144959541-project Oct 18 15:38:56.848040 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:38:56.848040 n-d-853682-5 devstack@n-api.service[120405]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPPwOzWvcGsJKe/PR1GergDigH1QRm80+kp4AwCVEXu+3YKcqQ9ULaAarsjBB2PAafsW8tUP6MXqiiIHbZ358c/mw2BpTiwm5FGCzlCbrThGyZKiy2jPxY4ZkmJKLnMOKQ=="}} Oct 18 15:38:56.848040 n-d-853682-5 devstack@n-api.service[120405]: method: Oct 18 15:38:56.848040 n-d-853682-5 devstack@n-api.service[120405]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 18 15:38:56.848040 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPPwOzWvcGsJKe/PR1GergDigH1QRm80+kp4AwCVEXu+3YKcqQ9ULaAarsjBB2PAafsW8tUP6MXqiiIHbZ358c/mw2BpTiwm5FGCzlCbrThGyZKiy2jPxY4ZkmJKLnMOKQ=='}}} Oct 18 15:38:56.848040 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:38:56.848040 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:38:56.848040 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 15:38:56.848040 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 15:38:56.848040 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 15:38:56.848040 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise error Oct 18 15:38:56.848040 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 18 15:38:56.848040 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:38:56.848040 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 18 15:38:56.848040 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 18 15:38:56.848040 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:38:56.848040 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 18 15:38:56.848040 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 18 15:38:56.852093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:38:56.852093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:38:56.852093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:38:56.852093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:38:56.852093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:38:56.852093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:38:56.852093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:38:56.852093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:38:56.852093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:38:56.852093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:38:56.852093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:38:56.852093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:38:56.852093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:38:56.852093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:38:56.852093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 15:38:56.852093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 15:38:56.852093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 15:38:56.852093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 15:38:56.852093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 15:38:56.852093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 15:38:56.852093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 18 15:38:56.852093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:38:56.852093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:38:56.852093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:38:56.852093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:38:56.852093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:38:56.852093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:38:56.852093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 15:38:56.852093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 15:38:56.852093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 18 15:38:56.852093 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:38:56.852093 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c0d4be3e-5e91-44f7-953d-272a2b1006c3 tempest-KeyPairsNegativeTestJSON-1144959541 tempest-KeyPairsNegativeTestJSON-1144959541-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:38:56.852093 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c0d4be3e-5e91-44f7-953d-272a2b1006c3 tempest-KeyPairsNegativeTestJSON-1144959541 tempest-KeyPairsNegativeTestJSON-1144959541-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.012416 Oct 18 15:38:56.856858 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1642/3227] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Oct 18 15:38:56 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 18 15:38:56.859991 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-69ffaf6b-e520-4da4-b26b-2e930bf0b4f0 tempest-KeyPairsNegativeTestJSON-1144959541 tempest-KeyPairsNegativeTestJSON-1144959541-project] Action: 'create', calling method: .version_select at 0x7f7c3d0070d0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1458234636", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:38:56.876994 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-69ffaf6b-e520-4da4-b26b-2e930bf0b4f0 tempest-KeyPairsNegativeTestJSON-1144959541 tempest-KeyPairsNegativeTestJSON-1144959541-project] Getting quotas for project 40143e4c280f4745961b2eb0725bf94e. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:38:56.882187 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-69ffaf6b-e520-4da4-b26b-2e930bf0b4f0 tempest-KeyPairsNegativeTestJSON-1144959541 tempest-KeyPairsNegativeTestJSON-1144959541-project] Getting quotas for user 88f254af6362425abc17bd766b05a50e and project 40143e4c280f4745961b2eb0725bf94e. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:38:56.900188 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-69ffaf6b-e520-4da4-b26b-2e930bf0b4f0 tempest-KeyPairsNegativeTestJSON-1144959541 tempest-KeyPairsNegativeTestJSON-1144959541-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-69ffaf6b-e520-4da4-b26b-2e930bf0b4f0 tempest-KeyPairsNegativeTestJSON-1144959541 tempest-KeyPairsNegativeTestJSON-1144959541-project] Request method failure captured: Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 118 Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsiOh9uuBOHxjB2QXxZp2088qtXqDteJnqieM8UkXV22IagCCmMlTbzRn_b4aznofGIG1cJLPKYXa0n-kI_ehp-nlU-ncAZ4bHH0WtVfNNRIfDHSUSFaFsOy8mh5y4K_T0vx8KZFnxaQHP2q_Xk8JiC4gbvtj751u9FQhvz1fD_dgKo Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 40143e4c280f4745961b2eb0725bf94e Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1144959541 Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/40143e4c280f4745961b2eb0725bf94e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/40143e4c280f4745961b2eb0725bf94e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/40143e4c280f4745961b2eb0725bf94e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_40143e4c280f4745961b2eb0725bf94e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1144959541 Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 40143e4c280f4745961b2eb0725bf94e Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1144959541 Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-KeyPairsNegativeTestJSON-1144959541-project Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 88f254af6362425abc17bd766b05a50e Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1144959541-project Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1458234636", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: method: Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: exception: Keypair data is invalid: failed to generate fingerprint Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1458234636', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 18 15:38:56.902360 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 18 15:38:56.910248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 18 15:38:56.910248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 18 15:38:56.910248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 18 15:38:56.910248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:38:56.910248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:38:56.910248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:38:56.910248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:38:56.910248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:38:56.910248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:38:56.910248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:38:56.910248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:38:56.910248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:38:56.910248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:38:56.910248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:38:56.910248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:38:56.910248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:38:56.910248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:38:56.910248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:38:56.910248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:38:56.910248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 18 15:38:56.910248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 18 15:38:56.910248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 18 15:38:56.910248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 18 15:38:56.910248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 18 15:38:56.910248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:38:56.910248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:38:56.910248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:38:56.910248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:38:56.910248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:38:56.910248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:38:56.910248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:38:56.910248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:38:56.910248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 18 15:38:56.910248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:38:56.910248 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-69ffaf6b-e520-4da4-b26b-2e930bf0b4f0 tempest-KeyPairsNegativeTestJSON-1144959541 tempest-KeyPairsNegativeTestJSON-1144959541-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:38:56.910248 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-69ffaf6b-e520-4da4-b26b-2e930bf0b4f0 tempest-KeyPairsNegativeTestJSON-1144959541 tempest-KeyPairsNegativeTestJSON-1144959541-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.047522 Oct 18 15:38:56.910248 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1643/3228] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Oct 18 15:38:56 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 18 15:38:56.916923 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-90ebed55-2e6b-4923-975a-af467352a112 tempest-KeyPairsNegativeTestJSON-1144959541 tempest-KeyPairsNegativeTestJSON-1144959541-project] Calling method '.version_select at 0x7f7c3d3bcee0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:56.930413 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-90ebed55-2e6b-4923-975a-af467352a112 tempest-KeyPairsNegativeTestJSON-1144959541 tempest-KeyPairsNegativeTestJSON-1144959541-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1494165343 not found for user 88f254af6362425abc17bd766b05a50e Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-90ebed55-2e6b-4923-975a-af467352a112 tempest-KeyPairsNegativeTestJSON-1144959541 tempest-KeyPairsNegativeTestJSON-1144959541-project] Request method failure captured: Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1494165343 HTTP/1.1 Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsiOh9uuBOHxjB2QXxZp2088qtXqDteJnqieM8UkXV22IagCCmMlTbzRn_b4aznofGIG1cJLPKYXa0n-kI_ehp-nlU-ncAZ4bHH0WtVfNNRIfDHSUSFaFsOy8mh5y4K_T0vx8KZFnxaQHP2q_Xk8JiC4gbvtj751u9FQhvz1fD_dgKo Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 40143e4c280f4745961b2eb0725bf94e Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1144959541 Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/40143e4c280f4745961b2eb0725bf94e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/40143e4c280f4745961b2eb0725bf94e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/40143e4c280f4745961b2eb0725bf94e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_40143e4c280f4745961b2eb0725bf94e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1144959541 Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 40143e4c280f4745961b2eb0725bf94e Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1144959541 Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-KeyPairsNegativeTestJSON-1144959541-project Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 88f254af6362425abc17bd766b05a50e Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1144959541-project Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: method: Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: exception: Keypair tempest-keypair-non-existent-1494165343 not found for user 88f254af6362425abc17bd766b05a50e Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'tempest-keypair-non-existent-1494165343'} Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1494165343 not found for user 88f254af6362425abc17bd766b05a50e Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:38:56.933020 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:38:56.936877 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:38:56.936877 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:38:56.936877 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:38:56.936877 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:38:56.936877 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:38:56.936877 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:38:56.936877 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:38:56.936877 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:38:56.936877 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 15:38:56.936877 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:38:56.936877 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:38:56.936877 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:38:56.936877 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 18 15:38:56.936877 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 18 15:38:56.936877 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 18 15:38:56.936877 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 18 15:38:56.936877 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1494165343 not found for user 88f254af6362425abc17bd766b05a50e Oct 18 15:38:56.936877 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:38:56.936877 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:38:56.936877 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:38:56.936877 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:38:56.936877 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:38:56.936877 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:38:56.936877 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:38:56.936877 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:38:56.936877 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1494165343 not found for user 88f254af6362425abc17bd766b05a50e Oct 18 15:38:56.936877 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:38:56.936877 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-90ebed55-2e6b-4923-975a-af467352a112 tempest-KeyPairsNegativeTestJSON-1144959541 tempest-KeyPairsNegativeTestJSON-1144959541-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1494165343 not found for user 88f254af6362425abc17bd766b05a50e {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:38:56.936877 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-90ebed55-2e6b-4923-975a-af467352a112 tempest-KeyPairsNegativeTestJSON-1144959541 tempest-KeyPairsNegativeTestJSON-1144959541-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1494165343" status: 404 len: 145 microversion: 2.1 time: 0.024960 Oct 18 15:38:56.939187 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1644/3229] 10.222.0.60 () {58 vars in 1260 bytes} [Tue Oct 18 15:38:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1494165343 => generated 145 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:38:57.003768 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ca72fb66-7abc-4df2-9abb-63b2b138a0cb tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:57.004754 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ca72fb66-7abc-4df2-9abb-63b2b138a0cb tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] [instance: 64730348-4d42-40d3-aeac-a4aad6c10d67] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:57.019614 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca72fb66-7abc-4df2-9abb-63b2b138a0cb tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:57.020114 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca72fb66-7abc-4df2-9abb-63b2b138a0cb tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:57.021116 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca72fb66-7abc-4df2-9abb-63b2b138a0cb tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:57.021836 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca72fb66-7abc-4df2-9abb-63b2b138a0cb tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:57.030486 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca72fb66-7abc-4df2-9abb-63b2b138a0cb tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:57.032381 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca72fb66-7abc-4df2-9abb-63b2b138a0cb tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:57.084550 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-06142c52-4117-47b2-8dad-759da4d61024 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304b3248f9db4629943a8b8080a6d22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdc7504a1d1424ea34f83f1a6d4bf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:57.095903 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-06142c52-4117-47b2-8dad-759da4d61024 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a" status: 200 len: 1707 microversion: 2.1 time: 0.449493 Oct 18 15:38:57.096556 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1586/3230] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:56 2022] GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a => generated 1707 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:57.111596 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-25231944-175e-4ebd-831c-fcda79d55d2d tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:57.112272 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-25231944-175e-4ebd-831c-fcda79d55d2d tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:57.120932 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25231944-175e-4ebd-831c-fcda79d55d2d tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:57.122703 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25231944-175e-4ebd-831c-fcda79d55d2d tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:57.123421 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25231944-175e-4ebd-831c-fcda79d55d2d tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:57.124375 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25231944-175e-4ebd-831c-fcda79d55d2d tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:57.125181 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25231944-175e-4ebd-831c-fcda79d55d2d tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:57.125838 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25231944-175e-4ebd-831c-fcda79d55d2d tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:57.458747 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ca72fb66-7abc-4df2-9abb-63b2b138a0cb tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7ebe0c265144769931ca6262be8860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a84f93ce8049c3a20c3b835f28100f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:57.470391 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ca72fb66-7abc-4df2-9abb-63b2b138a0cb tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] 10.222.0.60 "GET /compute/v2.1/servers/64730348-4d42-40d3-aeac-a4aad6c10d67" status: 200 len: 1324 microversion: 2.1 time: 0.473999 Oct 18 15:38:57.471768 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1645/3231] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:56 2022] GET /compute/v2.1/servers/64730348-4d42-40d3-aeac-a4aad6c10d67 => generated 1324 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:57.476927 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-c62b0ae2-1136-4a81-b4fe-bbf62f3c4385 req-5b29fcc5-c940-441f-810e-4f872a70f119 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64730348-4d42-40d3-aeac-a4aad6c10d67", "name": "network-vif-plugged", "status": "completed", "tag": "42d6883c-79d0-4365-9b09-db97e4ac7a74"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:38:57.487270 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-c62b0ae2-1136-4a81-b4fe-bbf62f3c4385 req-5b29fcc5-c940-441f-810e-4f872a70f119 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:57.487749 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-c62b0ae2-1136-4a81-b4fe-bbf62f3c4385 req-5b29fcc5-c940-441f-810e-4f872a70f119 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:57.488177 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-c62b0ae2-1136-4a81-b4fe-bbf62f3c4385 req-5b29fcc5-c940-441f-810e-4f872a70f119 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:57.492664 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:38:57.501377 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-c62b0ae2-1136-4a81-b4fe-bbf62f3c4385 req-5b29fcc5-c940-441f-810e-4f872a70f119 service nova] Creating event network-vif-plugged:42d6883c-79d0-4365-9b09-db97e4ac7a74 for instance 64730348-4d42-40d3-aeac-a4aad6c10d67 on n-h1-853682-5 Oct 18 15:38:57.507618 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-c62b0ae2-1136-4a81-b4fe-bbf62f3c4385 req-5b29fcc5-c940-441f-810e-4f872a70f119 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034002 Oct 18 15:38:57.508776 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1646/3232] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:38:57.514376 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-1cab02d0-7f1c-4a72-89f2-4f9fe95d11c1 req-edd66f3d-2d7b-470d-816e-f89ec2c58fcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf8f81da-4aa0-498d-af1e-c036238f065d", "tag": "56a32c33-244b-49a6-ab44-eb8dae785efb"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:38:57.527955 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-1cab02d0-7f1c-4a72-89f2-4f9fe95d11c1 req-edd66f3d-2d7b-470d-816e-f89ec2c58fcc service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:57.528689 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-1cab02d0-7f1c-4a72-89f2-4f9fe95d11c1 req-edd66f3d-2d7b-470d-816e-f89ec2c58fcc service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:57.529896 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-1cab02d0-7f1c-4a72-89f2-4f9fe95d11c1 req-edd66f3d-2d7b-470d-816e-f89ec2c58fcc service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:57.545374 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-1cab02d0-7f1c-4a72-89f2-4f9fe95d11c1 req-edd66f3d-2d7b-470d-816e-f89ec2c58fcc service nova] Creating event network-changed:56a32c33-244b-49a6-ab44-eb8dae785efb for instance cf8f81da-4aa0-498d-af1e-c036238f065d on n-h2-853682-5 Oct 18 15:38:57.551888 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-1cab02d0-7f1c-4a72-89f2-4f9fe95d11c1 req-edd66f3d-2d7b-470d-816e-f89ec2c58fcc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041492 Oct 18 15:38:57.552742 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1647/3233] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:38:57.560349 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f680f15f-9736-41c5-80e7-70b615cfa457 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:57.561303 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f680f15f-9736-41c5-80e7-70b615cfa457 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: d280f396-df42-482a-b0c1-9a8a9b608f57] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:57.573663 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-25231944-175e-4ebd-831c-fcda79d55d2d tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:57.585509 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f680f15f-9736-41c5-80e7-70b615cfa457 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:57.586000 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f680f15f-9736-41c5-80e7-70b615cfa457 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:57.586618 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f680f15f-9736-41c5-80e7-70b615cfa457 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:57.587807 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f680f15f-9736-41c5-80e7-70b615cfa457 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:57.588436 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f680f15f-9736-41c5-80e7-70b615cfa457 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:57.590194 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f680f15f-9736-41c5-80e7-70b615cfa457 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:57.600015 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-25231944-175e-4ebd-831c-fcda79d55d2d tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:57.606900 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-25231944-175e-4ebd-831c-fcda79d55d2d tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:57.611573 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-25231944-175e-4ebd-831c-fcda79d55d2d tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 200 len: 1880 microversion: 2.32 time: 0.514004 Oct 18 15:38:57.613156 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1587/3234] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:38:57 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 1880 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:38:57.773300 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-083d17a2-eabd-480b-9c84-5c82d94dae99 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:57.773981 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-083d17a2-eabd-480b-9c84-5c82d94dae99 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 2059ec7e-ef9b-4eb6-af19-34b2bd09e44a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:57.780411 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-083d17a2-eabd-480b-9c84-5c82d94dae99 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:57.781185 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-083d17a2-eabd-480b-9c84-5c82d94dae99 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:57.781655 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-083d17a2-eabd-480b-9c84-5c82d94dae99 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:57.782382 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-083d17a2-eabd-480b-9c84-5c82d94dae99 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:57.782834 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-083d17a2-eabd-480b-9c84-5c82d94dae99 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:57.783501 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-083d17a2-eabd-480b-9c84-5c82d94dae99 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:58.019005 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f680f15f-9736-41c5-80e7-70b615cfa457 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:58.034114 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f680f15f-9736-41c5-80e7-70b615cfa457 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57" status: 200 len: 1477 microversion: 2.1 time: 0.478085 Oct 18 15:38:58.038418 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1648/3235] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:57 2022] GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57 => generated 1477 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:58.119416 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c09cfd69-c486-4faf-bfab-7b1d240edcfe tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:58.120328 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c09cfd69-c486-4faf-bfab-7b1d240edcfe tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 52d725f3-b4da-4831-9abf-bf7aba8aee0a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:58.126960 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c09cfd69-c486-4faf-bfab-7b1d240edcfe tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:58.127673 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c09cfd69-c486-4faf-bfab-7b1d240edcfe tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:58.128352 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c09cfd69-c486-4faf-bfab-7b1d240edcfe tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:58.129172 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c09cfd69-c486-4faf-bfab-7b1d240edcfe tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:58.129714 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c09cfd69-c486-4faf-bfab-7b1d240edcfe tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:58.130609 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c09cfd69-c486-4faf-bfab-7b1d240edcfe tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:58.141896 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-083d17a2-eabd-480b-9c84-5c82d94dae99 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:58.152631 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-083d17a2-eabd-480b-9c84-5c82d94dae99 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a" status: 200 len: 1513 microversion: 2.1 time: 0.383158 Oct 18 15:38:58.154285 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1588/3236] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:57 2022] GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a => generated 1513 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:38:58.435369 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c09cfd69-c486-4faf-bfab-7b1d240edcfe tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304b3248f9db4629943a8b8080a6d22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdc7504a1d1424ea34f83f1a6d4bf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:58.444410 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c09cfd69-c486-4faf-bfab-7b1d240edcfe tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a" status: 200 len: 1707 microversion: 2.1 time: 0.329743 Oct 18 15:38:58.454515 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1649/3237] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:58 2022] GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a => generated 1707 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:38:58.493698 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-29d5b68c-7eb3-4803-bf4e-aacd016c2567 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:58.494309 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-29d5b68c-7eb3-4803-bf4e-aacd016c2567 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] [instance: 64730348-4d42-40d3-aeac-a4aad6c10d67] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:58.501176 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29d5b68c-7eb3-4803-bf4e-aacd016c2567 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:58.501657 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29d5b68c-7eb3-4803-bf4e-aacd016c2567 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:58.502085 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29d5b68c-7eb3-4803-bf4e-aacd016c2567 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:58.502977 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29d5b68c-7eb3-4803-bf4e-aacd016c2567 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:58.503418 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29d5b68c-7eb3-4803-bf4e-aacd016c2567 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:58.503832 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29d5b68c-7eb3-4803-bf4e-aacd016c2567 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:58.714405 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1e8051d7-ab76-43f5-b3b8-56c39f9507c3 tempest-AbsoluteLimitsNegativeTestJSON-1392810872 tempest-AbsoluteLimitsNegativeTestJSON-1392810872-project] Calling method '.version_select at 0x7f7c3d0a0430>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:58.726590 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1e8051d7-ab76-43f5-b3b8-56c39f9507c3 tempest-AbsoluteLimitsNegativeTestJSON-1392810872 tempest-AbsoluteLimitsNegativeTestJSON-1392810872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:58.727082 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1e8051d7-ab76-43f5-b3b8-56c39f9507c3 tempest-AbsoluteLimitsNegativeTestJSON-1392810872 tempest-AbsoluteLimitsNegativeTestJSON-1392810872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:58.727523 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1e8051d7-ab76-43f5-b3b8-56c39f9507c3 tempest-AbsoluteLimitsNegativeTestJSON-1392810872 tempest-AbsoluteLimitsNegativeTestJSON-1392810872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:58.728289 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1e8051d7-ab76-43f5-b3b8-56c39f9507c3 tempest-AbsoluteLimitsNegativeTestJSON-1392810872 tempest-AbsoluteLimitsNegativeTestJSON-1392810872-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:58.728953 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1e8051d7-ab76-43f5-b3b8-56c39f9507c3 tempest-AbsoluteLimitsNegativeTestJSON-1392810872 tempest-AbsoluteLimitsNegativeTestJSON-1392810872-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:58.729398 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1e8051d7-ab76-43f5-b3b8-56c39f9507c3 tempest-AbsoluteLimitsNegativeTestJSON-1392810872 tempest-AbsoluteLimitsNegativeTestJSON-1392810872-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:58.749685 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1e8051d7-ab76-43f5-b3b8-56c39f9507c3 tempest-AbsoluteLimitsNegativeTestJSON-1392810872 tempest-AbsoluteLimitsNegativeTestJSON-1392810872-project] 10.222.0.60 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.163398 Oct 18 15:38:58.750283 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1650/3238] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Oct 18 15:38:58 2022] GET /compute/v2.1/limits => generated 511 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:38:58.761082 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-526694e6-c1a1-4b3b-beb4-88e5f92c4a21 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:58.761082 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-526694e6-c1a1-4b3b-beb4-88e5f92c4a21 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:58.761396 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-29d5b68c-7eb3-4803-bf4e-aacd016c2567 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7ebe0c265144769931ca6262be8860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a84f93ce8049c3a20c3b835f28100f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:58.762764 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-526694e6-c1a1-4b3b-beb4-88e5f92c4a21 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:58.763959 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-526694e6-c1a1-4b3b-beb4-88e5f92c4a21 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:58.764586 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-526694e6-c1a1-4b3b-beb4-88e5f92c4a21 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:58.765489 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-526694e6-c1a1-4b3b-beb4-88e5f92c4a21 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:58.766137 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-526694e6-c1a1-4b3b-beb4-88e5f92c4a21 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:58.767499 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-526694e6-c1a1-4b3b-beb4-88e5f92c4a21 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:58.770175 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-29d5b68c-7eb3-4803-bf4e-aacd016c2567 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] 10.222.0.60 "GET /compute/v2.1/servers/64730348-4d42-40d3-aeac-a4aad6c10d67" status: 200 len: 1324 microversion: 2.1 time: 0.279945 Oct 18 15:38:58.786186 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1589/3239] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:58 2022] GET /compute/v2.1/servers/64730348-4d42-40d3-aeac-a4aad6c10d67 => generated 1324 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:58.814163 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9e36e29f-3f85-489f-8f4b-d5c1b59981ca tempest-AbsoluteLimitsNegativeTestJSON-1392810872 tempest-AbsoluteLimitsNegativeTestJSON-1392810872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1811333586", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:38:58.879009 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-9e36e29f-3f85-489f-8f4b-d5c1b59981ca tempest-AbsoluteLimitsNegativeTestJSON-1392810872 tempest-AbsoluteLimitsNegativeTestJSON-1392810872-project] validate_networks() for None {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:38:59.114942 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-526694e6-c1a1-4b3b-beb4-88e5f92c4a21 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:59.126545 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-526694e6-c1a1-4b3b-beb4-88e5f92c4a21 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:59.128115 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-526694e6-c1a1-4b3b-beb4-88e5f92c4a21 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:59.129423 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-526694e6-c1a1-4b3b-beb4-88e5f92c4a21 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 200 len: 1880 microversion: 2.32 time: 0.378132 Oct 18 15:38:59.130633 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1651/3240] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:38:58 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 1880 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:38:59.135674 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f2570988-0430-4d56-b65e-aef98c5a1ea3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:59.136291 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f2570988-0430-4d56-b65e-aef98c5a1ea3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: d280f396-df42-482a-b0c1-9a8a9b608f57] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:59.142433 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f2570988-0430-4d56-b65e-aef98c5a1ea3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:59.142929 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f2570988-0430-4d56-b65e-aef98c5a1ea3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:59.143498 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f2570988-0430-4d56-b65e-aef98c5a1ea3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:59.144205 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f2570988-0430-4d56-b65e-aef98c5a1ea3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:59.144869 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f2570988-0430-4d56-b65e-aef98c5a1ea3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:59.145308 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f2570988-0430-4d56-b65e-aef98c5a1ea3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:59.318850 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-9e36e29f-3f85-489f-8f4b-d5c1b59981ca tempest-AbsoluteLimitsNegativeTestJSON-1392810872 tempest-AbsoluteLimitsNegativeTestJSON-1392810872-project] Getting quotas for project 110f9d37fa3043c59395f017acad6225. Resources: dict_keys(['metadata_items']) {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:38:59.324155 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-9e36e29f-3f85-489f-8f4b-d5c1b59981ca tempest-AbsoluteLimitsNegativeTestJSON-1392810872 tempest-AbsoluteLimitsNegativeTestJSON-1392810872-project] Getting quotas for user dd42be7b031941948bb24a15afbc3bcb and project 110f9d37fa3043c59395f017acad6225. Resources: dict_keys(['metadata_items']) {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:38:59.337317 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-9e36e29f-3f85-489f-8f4b-d5c1b59981ca tempest-AbsoluteLimitsNegativeTestJSON-1392810872 tempest-AbsoluteLimitsNegativeTestJSON-1392810872-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 18 15:38:59.339254 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9e36e29f-3f85-489f-8f4b-d5c1b59981ca tempest-AbsoluteLimitsNegativeTestJSON-1392810872 tempest-AbsoluteLimitsNegativeTestJSON-1392810872-project] Request method failure captured: Oct 18 15:38:59.339254 n-d-853682-5 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 15:38:59.339254 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:38:59.339254 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:38:59.339254 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:38:59.339254 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 1752 Oct 18 15:38:59.339254 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:38:59.339254 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:38:59.339254 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:38:59.339254 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:38:59.339254 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsiSJRAsxh51RgOkliR1cuEH3ClzRa_1pH8N8tpUVfl9xqbMeh9L6UY3IyqKyOSYU8tq5EFkBnWJS3SS7Bsp7zQLRvGg2pvZ2pv1VNjN6kX330NWXikCCeWp1Z8gkeLrvAKXbQQP19JDYkyd_5eYNoeDGfMr7UZ2_E0ulgwyL3QWp8Y Oct 18 15:38:59.339254 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:38:59.339254 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:38:59.339254 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:38:59.339254 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:38:59.339254 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:38:59.339254 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:38:59.339254 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 110f9d37fa3043c59395f017acad6225 Oct 18 15:38:59.339254 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1392810872 Oct 18 15:38:59.339254 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:38:59.339254 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:38:59.339254 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/110f9d37fa3043c59395f017acad6225"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/110f9d37fa3043c59395f017acad6225"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/110f9d37fa3043c59395f017acad6225"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_110f9d37fa3043c59395f017acad6225"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:38:59.339254 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1392810872 Oct 18 15:38:59.339254 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 110f9d37fa3043c59395f017acad6225 Oct 18 15:38:59.339254 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1392810872 Oct 18 15:38:59.339254 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1392810872-project Oct 18 15:38:59.339254 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:38:59.339254 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:38:59.339254 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: dd42be7b031941948bb24a15afbc3bcb Oct 18 15:38:59.339254 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1392810872-project Oct 18 15:38:59.339254 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:38:59.339254 n-d-853682-5 devstack@n-api.service[120406]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1811333586", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 18 15:38:59.339254 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:38:59.339254 n-d-853682-5 devstack@n-api.service[120406]: exception: Maximum number of metadata items exceeds 128 Oct 18 15:38:59.341898 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1811333586', 'imageRef': '8f4db252-bff6-4685-9c8d-4c5d6bd9f78b', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 18 15:38:59.341898 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:38:59.341898 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:38:59.341898 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 18 15:38:59.341898 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 18 15:38:59.341898 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 15:38:59.341898 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 15:38:59.341898 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 18 15:38:59.341898 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 18 15:38:59.341898 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 18 15:38:59.341898 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 18 15:38:59.341898 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 18 15:38:59.341898 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 18 15:38:59.341898 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 18 15:38:59.341898 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:38:59.341898 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:38:59.341898 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:38:59.341898 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:38:59.341898 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 18 15:38:59.341898 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 18 15:38:59.341898 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 18 15:38:59.341898 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 18 15:38:59.341898 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 18 15:38:59.341898 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 18 15:38:59.341898 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 18 15:38:59.341898 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 18 15:38:59.341898 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 18 15:38:59.341898 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 18 15:38:59.341898 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 18 15:38:59.341898 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:38:59.341898 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:38:59.341898 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:38:59.341898 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:38:59.341898 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:38:59.341898 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:38:59.341898 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:38:59.341898 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:38:59.341898 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:38:59.341898 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:38:59.341898 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:38:59.341898 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:38:59.341898 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:38:59.341898 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:38:59.341898 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:38:59.344545 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:38:59.344545 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 18 15:38:59.344545 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 18 15:38:59.344545 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 18 15:38:59.344545 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 18 15:38:59.344545 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:38:59.344545 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:38:59.344545 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:38:59.344545 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:38:59.344545 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:38:59.344545 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:38:59.344545 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:38:59.344545 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:38:59.344545 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 18 15:38:59.344545 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:38:59.344545 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9e36e29f-3f85-489f-8f4b-d5c1b59981ca tempest-AbsoluteLimitsNegativeTestJSON-1392810872 tempest-AbsoluteLimitsNegativeTestJSON-1392810872-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:38:59.344545 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9e36e29f-3f85-489f-8f4b-d5c1b59981ca tempest-AbsoluteLimitsNegativeTestJSON-1392810872 tempest-AbsoluteLimitsNegativeTestJSON-1392810872-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.530521 Oct 18 15:38:59.344545 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1590/3241] 10.222.0.60 () {60 vars in 1148 bytes} [Tue Oct 18 15:38:58 2022] POST /compute/v2.1/servers => generated 87 bytes in 532 msecs (HTTP/1.1 403) 9 headers in 378 bytes (2 switches on core 0) Oct 18 15:38:59.349798 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1be7d40b-db38-405f-9c0e-d9309cef4696 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:59.350413 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1be7d40b-db38-405f-9c0e-d9309cef4696 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 2059ec7e-ef9b-4eb6-af19-34b2bd09e44a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:59.356635 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1be7d40b-db38-405f-9c0e-d9309cef4696 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:59.357163 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1be7d40b-db38-405f-9c0e-d9309cef4696 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:59.357582 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1be7d40b-db38-405f-9c0e-d9309cef4696 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:59.358461 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1be7d40b-db38-405f-9c0e-d9309cef4696 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:59.359062 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1be7d40b-db38-405f-9c0e-d9309cef4696 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:59.359639 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1be7d40b-db38-405f-9c0e-d9309cef4696 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:59.482780 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f2570988-0430-4d56-b65e-aef98c5a1ea3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:59.493081 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f2570988-0430-4d56-b65e-aef98c5a1ea3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57" status: 200 len: 1477 microversion: 2.1 time: 0.361159 Oct 18 15:38:59.494497 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1652/3242] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:59 2022] GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57 => generated 1477 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:59.499963 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-21545083-c600-43fd-a5e5-c6b89e8c0e7a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:38:59.500579 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-21545083-c600-43fd-a5e5-c6b89e8c0e7a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 52d725f3-b4da-4831-9abf-bf7aba8aee0a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:38:59.507400 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-21545083-c600-43fd-a5e5-c6b89e8c0e7a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:59.507888 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-21545083-c600-43fd-a5e5-c6b89e8c0e7a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:59.508412 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-21545083-c600-43fd-a5e5-c6b89e8c0e7a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:59.509319 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-21545083-c600-43fd-a5e5-c6b89e8c0e7a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:38:59.509776 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-21545083-c600-43fd-a5e5-c6b89e8c0e7a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:38:59.510383 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-21545083-c600-43fd-a5e5-c6b89e8c0e7a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:38:59.975143 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1be7d40b-db38-405f-9c0e-d9309cef4696 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:38:59.984723 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1be7d40b-db38-405f-9c0e-d9309cef4696 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a" status: 200 len: 1513 microversion: 2.1 time: 0.642480 Oct 18 15:38:59.988930 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1591/3243] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:59 2022] GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a => generated 1513 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:38:59.991249 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-a1ce8ee9-0b9e-413f-abbc-46530a6c6b3e req-84a97f1c-28d2-4b08-b34e-69b54bf4dce7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf8f81da-4aa0-498d-af1e-c036238f065d", "tag": "f0425d60-0a1e-42b2-b227-5934c9fcdf26"}, {"name": "network-changed", "server_uuid": "cf8f81da-4aa0-498d-af1e-c036238f065d", "tag": "9959fd2b-3b15-4847-9dc1-507d84d0b4df"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:39:00.001996 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a1ce8ee9-0b9e-413f-abbc-46530a6c6b3e req-84a97f1c-28d2-4b08-b34e-69b54bf4dce7 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:00.002476 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a1ce8ee9-0b9e-413f-abbc-46530a6c6b3e req-84a97f1c-28d2-4b08-b34e-69b54bf4dce7 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:00.002910 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a1ce8ee9-0b9e-413f-abbc-46530a6c6b3e req-84a97f1c-28d2-4b08-b34e-69b54bf4dce7 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:00.015936 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-a1ce8ee9-0b9e-413f-abbc-46530a6c6b3e req-84a97f1c-28d2-4b08-b34e-69b54bf4dce7 service nova] Creating event network-changed:f0425d60-0a1e-42b2-b227-5934c9fcdf26 for instance cf8f81da-4aa0-498d-af1e-c036238f065d on n-h2-853682-5 Oct 18 15:39:00.016436 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-a1ce8ee9-0b9e-413f-abbc-46530a6c6b3e req-84a97f1c-28d2-4b08-b34e-69b54bf4dce7 service nova] Creating event network-changed:9959fd2b-3b15-4847-9dc1-507d84d0b4df for instance cf8f81da-4aa0-498d-af1e-c036238f065d on n-h2-853682-5 Oct 18 15:39:00.022204 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-a1ce8ee9-0b9e-413f-abbc-46530a6c6b3e req-84a97f1c-28d2-4b08-b34e-69b54bf4dce7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.034629 Oct 18 15:39:00.022814 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1592/3244] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:39:00.028149 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ebc7ab73-dd21-4434-91a4-944848006457 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:00.028938 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ebc7ab73-dd21-4434-91a4-944848006457 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] [instance: 64730348-4d42-40d3-aeac-a4aad6c10d67] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:00.034955 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ebc7ab73-dd21-4434-91a4-944848006457 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:00.035446 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ebc7ab73-dd21-4434-91a4-944848006457 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:00.035881 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ebc7ab73-dd21-4434-91a4-944848006457 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:00.036799 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ebc7ab73-dd21-4434-91a4-944848006457 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:00.038451 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ebc7ab73-dd21-4434-91a4-944848006457 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:00.038913 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ebc7ab73-dd21-4434-91a4-944848006457 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:00.081119 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-21545083-c600-43fd-a5e5-c6b89e8c0e7a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304b3248f9db4629943a8b8080a6d22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdc7504a1d1424ea34f83f1a6d4bf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:00.090192 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-21545083-c600-43fd-a5e5-c6b89e8c0e7a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a" status: 200 len: 1707 microversion: 2.1 time: 0.594243 Oct 18 15:39:00.091031 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1653/3245] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:38:59 2022] GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a => generated 1707 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:00.158547 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-cbebcc67-9c6a-43c7-a04d-8d5c2d10284d tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:00.159943 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-cbebcc67-9c6a-43c7-a04d-8d5c2d10284d tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:00.166569 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cbebcc67-9c6a-43c7-a04d-8d5c2d10284d tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:00.167882 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cbebcc67-9c6a-43c7-a04d-8d5c2d10284d tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:00.168386 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cbebcc67-9c6a-43c7-a04d-8d5c2d10284d tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:00.169476 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cbebcc67-9c6a-43c7-a04d-8d5c2d10284d tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:00.170677 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cbebcc67-9c6a-43c7-a04d-8d5c2d10284d tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:00.171157 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cbebcc67-9c6a-43c7-a04d-8d5c2d10284d tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:00.309522 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ebc7ab73-dd21-4434-91a4-944848006457 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7ebe0c265144769931ca6262be8860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a84f93ce8049c3a20c3b835f28100f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:00.320727 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ebc7ab73-dd21-4434-91a4-944848006457 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] 10.222.0.60 "GET /compute/v2.1/servers/64730348-4d42-40d3-aeac-a4aad6c10d67" status: 200 len: 1520 microversion: 2.1 time: 0.296482 Oct 18 15:39:00.321377 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1593/3246] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:00 2022] GET /compute/v2.1/servers/64730348-4d42-40d3-aeac-a4aad6c10d67 => generated 1520 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:00.344581 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fb9ead75-16b8-4a58-ba28-957c18ba594b tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Action: 'action', calling method: .version_select at 0x7f7c3f05bdc0>, body: {"addFloatingIp": {"address": "172.25.4.50"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:39:00.347804 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fb9ead75-16b8-4a58-ba28-957c18ba594b tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] [instance: 7ae6ac1e-7345-4096-9816-a53e90d88447] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:00.355384 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb9ead75-16b8-4a58-ba28-957c18ba594b tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:00.355987 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb9ead75-16b8-4a58-ba28-957c18ba594b tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:00.356526 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb9ead75-16b8-4a58-ba28-957c18ba594b tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:00.357626 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb9ead75-16b8-4a58-ba28-957c18ba594b tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:00.358168 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb9ead75-16b8-4a58-ba28-957c18ba594b tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:00.358673 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb9ead75-16b8-4a58-ba28-957c18ba594b tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:00.433107 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb9ead75-16b8-4a58-ba28-957c18ba594b tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "refresh_cache-7ae6ac1e-7345-4096-9816-a53e90d88447" {{(pid=120406) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 18 15:39:00.433448 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb9ead75-16b8-4a58-ba28-957c18ba594b tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquired lock "refresh_cache-7ae6ac1e-7345-4096-9816-a53e90d88447" {{(pid=120406) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 18 15:39:00.545155 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-cbebcc67-9c6a-43c7-a04d-8d5c2d10284d tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:00.555258 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-cbebcc67-9c6a-43c7-a04d-8d5c2d10284d tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:00.556724 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-cbebcc67-9c6a-43c7-a04d-8d5c2d10284d tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:00.557931 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-cbebcc67-9c6a-43c7-a04d-8d5c2d10284d tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 200 len: 1880 microversion: 2.32 time: 0.405299 Oct 18 15:39:00.558541 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1654/3247] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:39:00 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 1880 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:39:00.573002 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bf89603a-bf00-4442-b32d-bfc117407d2f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:00.574118 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-bf89603a-bf00-4442-b32d-bfc117407d2f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: d280f396-df42-482a-b0c1-9a8a9b608f57] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:00.581629 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bf89603a-bf00-4442-b32d-bfc117407d2f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:00.582176 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bf89603a-bf00-4442-b32d-bfc117407d2f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:00.582615 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bf89603a-bf00-4442-b32d-bfc117407d2f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:00.583719 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bf89603a-bf00-4442-b32d-bfc117407d2f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:00.585216 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bf89603a-bf00-4442-b32d-bfc117407d2f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:00.585793 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bf89603a-bf00-4442-b32d-bfc117407d2f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:00.938300 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-bf89603a-bf00-4442-b32d-bfc117407d2f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:00.948179 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-bf89603a-bf00-4442-b32d-bfc117407d2f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57" status: 200 len: 1477 microversion: 2.1 time: 0.388085 Oct 18 15:39:00.949013 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1655/3248] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:00 2022] GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57 => generated 1477 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:01.009374 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fae2e645-f861-452f-932c-dcdf0194d94a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:01.010224 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-fae2e645-f861-452f-932c-dcdf0194d94a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 2059ec7e-ef9b-4eb6-af19-34b2bd09e44a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:01.017280 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fae2e645-f861-452f-932c-dcdf0194d94a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:01.017812 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fae2e645-f861-452f-932c-dcdf0194d94a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:01.018247 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fae2e645-f861-452f-932c-dcdf0194d94a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:01.019142 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fae2e645-f861-452f-932c-dcdf0194d94a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:01.019906 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fae2e645-f861-452f-932c-dcdf0194d94a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:01.020371 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fae2e645-f861-452f-932c-dcdf0194d94a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:01.431919 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-fae2e645-f861-452f-932c-dcdf0194d94a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:01.440796 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fae2e645-f861-452f-932c-dcdf0194d94a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a" status: 200 len: 1513 microversion: 2.1 time: 0.436006 Oct 18 15:39:01.442154 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1656/3249] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:01 2022] GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a => generated 1513 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:39:01.448644 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2a9308b8-abf6-4438-aa3d-b1a37a692d7e tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:01.449450 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2a9308b8-abf6-4438-aa3d-b1a37a692d7e tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 52d725f3-b4da-4831-9abf-bf7aba8aee0a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:01.456283 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a9308b8-abf6-4438-aa3d-b1a37a692d7e tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:01.457192 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a9308b8-abf6-4438-aa3d-b1a37a692d7e tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:01.457980 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a9308b8-abf6-4438-aa3d-b1a37a692d7e tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:01.458921 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a9308b8-abf6-4438-aa3d-b1a37a692d7e tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:01.459590 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a9308b8-abf6-4438-aa3d-b1a37a692d7e tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:01.460222 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a9308b8-abf6-4438-aa3d-b1a37a692d7e tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:01.813028 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2a9308b8-abf6-4438-aa3d-b1a37a692d7e tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304b3248f9db4629943a8b8080a6d22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdc7504a1d1424ea34f83f1a6d4bf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:01.830524 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2a9308b8-abf6-4438-aa3d-b1a37a692d7e tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a" status: 200 len: 1711 microversion: 2.1 time: 0.386446 Oct 18 15:39:01.844832 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1657/3250] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:01 2022] GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a => generated 1711 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:01.848972 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-cc71fbb2-13df-4141-a341-319845e0ad38 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:01.853403 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-cc71fbb2-13df-4141-a341-319845e0ad38 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 57537212-8816-4122-adbe-264f7035a0e9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:01.860516 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cc71fbb2-13df-4141-a341-319845e0ad38 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:01.861203 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cc71fbb2-13df-4141-a341-319845e0ad38 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:01.861711 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cc71fbb2-13df-4141-a341-319845e0ad38 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:01.862433 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cc71fbb2-13df-4141-a341-319845e0ad38 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:01.862893 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cc71fbb2-13df-4141-a341-319845e0ad38 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:01.863326 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cc71fbb2-13df-4141-a341-319845e0ad38 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:01.902843 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-cc71fbb2-13df-4141-a341-319845e0ad38 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9/ips" status: 200 len: 151 microversion: 2.1 time: 0.060569 Oct 18 15:39:01.903787 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1658/3251] 10.222.0.60 () {58 vars in 1248 bytes} [Tue Oct 18 15:39:01 2022] GET /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9/ips => generated 151 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:39:01.908588 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e8a9ff75-d498-4d67-8b95-73ab3ad711bf tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:01.909429 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e8a9ff75-d498-4d67-8b95-73ab3ad711bf tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:01.918336 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e8a9ff75-d498-4d67-8b95-73ab3ad711bf tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:01.919419 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e8a9ff75-d498-4d67-8b95-73ab3ad711bf tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:01.920068 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e8a9ff75-d498-4d67-8b95-73ab3ad711bf tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:01.921716 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e8a9ff75-d498-4d67-8b95-73ab3ad711bf tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:01.922359 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e8a9ff75-d498-4d67-8b95-73ab3ad711bf tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:01.922960 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e8a9ff75-d498-4d67-8b95-73ab3ad711bf tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:02.368772 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e8a9ff75-d498-4d67-8b95-73ab3ad711bf tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:02.379513 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e8a9ff75-d498-4d67-8b95-73ab3ad711bf tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:02.381373 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e8a9ff75-d498-4d67-8b95-73ab3ad711bf tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:02.382952 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e8a9ff75-d498-4d67-8b95-73ab3ad711bf tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 200 len: 1880 microversion: 2.32 time: 0.478215 Oct 18 15:39:02.384345 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1659/3252] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:39:01 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 1880 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:39:02.401248 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e33dd2dd-a5e2-420a-bb7d-1f8a1e7fcf55 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b8fc71c-55b7-4099-a893-e4def512fa29"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:39:02.405140 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e33dd2dd-a5e2-420a-bb7d-1f8a1e7fcf55 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 57537212-8816-4122-adbe-264f7035a0e9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:02.415132 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e33dd2dd-a5e2-420a-bb7d-1f8a1e7fcf55 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:02.416444 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e33dd2dd-a5e2-420a-bb7d-1f8a1e7fcf55 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:02.417085 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e33dd2dd-a5e2-420a-bb7d-1f8a1e7fcf55 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:02.417979 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e33dd2dd-a5e2-420a-bb7d-1f8a1e7fcf55 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:02.418896 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e33dd2dd-a5e2-420a-bb7d-1f8a1e7fcf55 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:02.419488 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e33dd2dd-a5e2-420a-bb7d-1f8a1e7fcf55 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:02.568434 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-e33dd2dd-a5e2-420a-bb7d-1f8a1e7fcf55 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] HTTP exception thrown: Invalid volume: volume 7b8fc71c-55b7-4099-a893-e4def512fa29 is already attached to instances: 511cbc18-aef9-4202-9616-decd6651e931 Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e33dd2dd-a5e2-420a-bb7d-1f8a1e7fcf55 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Request method failure captured: Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: request: POST /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9/os-volume_attachments HTTP/1.1 Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 74 Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsfD3tyC5zBBCs3PM6SgagJOA9ytEd34lT9my352h69qxn0wNQWvVVVEceKNcLlE8Cld2E1ewLfFQUA6X-zyH4NCgXE9isdDnVpnJB5BT1ljNdC07pganRFql9FpScM1-Xjt5su1w2IBkP6ZVV1NsRclcY3oY_ScUp2DhZs2W7X1y8Y Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: a5b55fd6668b481b8c578983dc655785 Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-AttachVolumeNegativeTest-1298357771 Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a5b55fd6668b481b8c578983dc655785"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a5b55fd6668b481b8c578983dc655785"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a5b55fd6668b481b8c578983dc655785"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a5b55fd6668b481b8c578983dc655785"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-AttachVolumeNegativeTest-1298357771 Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: a5b55fd6668b481b8c578983dc655785 Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1298357771 Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-AttachVolumeNegativeTest-1298357771-project Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: efec3b4b5b1c46bd9d2c0efa68f86979 Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-AttachVolumeNegativeTest-1298357771-project Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: {"volumeAttachment": {"volumeId": "7b8fc71c-55b7-4099-a893-e4def512fa29"}} Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: exception: Invalid volume: volume 7b8fc71c-55b7-4099-a893-e4def512fa29 is already attached to instances: 511cbc18-aef9-4202-9616-decd6651e931 Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'server_id': '57537212-8816-4122-adbe-264f7035a0e9', 'body': {'volumeAttachment': {'volumeId': '7b8fc71c-55b7-4099-a893-e4def512fa29'}}} Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7b8fc71c-55b7-4099-a893-e4def512fa29 is already attached to instances: 511cbc18-aef9-4202-9616-decd6651e931 Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:39:02.572263 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:39:02.576262 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:39:02.576262 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:39:02.576262 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 18 15:39:02.576262 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 18 15:39:02.576262 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7b8fc71c-55b7-4099-a893-e4def512fa29 is already attached to instances: 511cbc18-aef9-4202-9616-decd6651e931 Oct 18 15:39:02.576262 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:39:02.576262 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:39:02.576262 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:39:02.576262 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:39:02.576262 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:39:02.576262 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:39:02.576262 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:39:02.576262 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:39:02.576262 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7b8fc71c-55b7-4099-a893-e4def512fa29 is already attached to instances: 511cbc18-aef9-4202-9616-decd6651e931 Oct 18 15:39:02.576262 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:39:02.579813 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e33dd2dd-a5e2-420a-bb7d-1f8a1e7fcf55 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Returning 400 to user: Invalid volume: volume 7b8fc71c-55b7-4099-a893-e4def512fa29 is already attached to instances: 511cbc18-aef9-4202-9616-decd6651e931 {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:39:02.581923 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e33dd2dd-a5e2-420a-bb7d-1f8a1e7fcf55 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "POST /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.194608 Oct 18 15:39:02.583710 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1660/3253] 10.222.0.60 () {60 vars in 1323 bytes} [Tue Oct 18 15:39:02 2022] POST /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9/os-volume_attachments => generated 174 bytes in 199 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:39:02.589316 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-73317cda-b37a-483d-96f3-d3780a0f8034 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:02.590312 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-73317cda-b37a-483d-96f3-d3780a0f8034 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: d280f396-df42-482a-b0c1-9a8a9b608f57] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:02.597979 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-73317cda-b37a-483d-96f3-d3780a0f8034 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:02.598906 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-73317cda-b37a-483d-96f3-d3780a0f8034 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:02.599553 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-73317cda-b37a-483d-96f3-d3780a0f8034 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:02.600484 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-73317cda-b37a-483d-96f3-d3780a0f8034 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:02.601181 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-73317cda-b37a-483d-96f3-d3780a0f8034 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:02.602500 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-73317cda-b37a-483d-96f3-d3780a0f8034 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:02.998653 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-73317cda-b37a-483d-96f3-d3780a0f8034 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:03.007197 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-73317cda-b37a-483d-96f3-d3780a0f8034 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57" status: 200 len: 1477 microversion: 2.1 time: 0.422119 Oct 18 15:39:03.008022 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1661/3254] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:02 2022] GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57 => generated 1477 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:03.017352 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6ebbbf4e-bbe9-4050-ba3a-61aad711f460 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:03.018335 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6ebbbf4e-bbe9-4050-ba3a-61aad711f460 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 2059ec7e-ef9b-4eb6-af19-34b2bd09e44a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:03.030235 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ebbbf4e-bbe9-4050-ba3a-61aad711f460 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:03.031004 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ebbbf4e-bbe9-4050-ba3a-61aad711f460 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:03.031451 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ebbbf4e-bbe9-4050-ba3a-61aad711f460 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:03.032331 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ebbbf4e-bbe9-4050-ba3a-61aad711f460 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:03.033020 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ebbbf4e-bbe9-4050-ba3a-61aad711f460 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:03.033454 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ebbbf4e-bbe9-4050-ba3a-61aad711f460 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:03.195003 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-fb9ead75-16b8-4a58-ba28-957c18ba594b tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] [instance: 7ae6ac1e-7345-4096-9816-a53e90d88447] Building network info cache for instance {{(pid=120406) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}} Oct 18 15:39:03.402128 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6ebbbf4e-bbe9-4050-ba3a-61aad711f460 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:03.410495 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6ebbbf4e-bbe9-4050-ba3a-61aad711f460 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a" status: 200 len: 1513 microversion: 2.1 time: 0.397802 Oct 18 15:39:03.411123 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1662/3255] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:03 2022] GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a => generated 1513 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:03.420763 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-da404e34-f8aa-41ec-8972-7b5548d76c86 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:03.423394 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-da404e34-f8aa-41ec-8972-7b5548d76c86 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 57537212-8816-4122-adbe-264f7035a0e9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:03.440572 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-da404e34-f8aa-41ec-8972-7b5548d76c86 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:03.441097 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-da404e34-f8aa-41ec-8972-7b5548d76c86 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:03.441549 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-da404e34-f8aa-41ec-8972-7b5548d76c86 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:03.444886 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-da404e34-f8aa-41ec-8972-7b5548d76c86 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:03.445429 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-da404e34-f8aa-41ec-8972-7b5548d76c86 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:03.445881 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-da404e34-f8aa-41ec-8972-7b5548d76c86 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:03.512822 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-da404e34-f8aa-41ec-8972-7b5548d76c86 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 57537212-8816-4122-adbe-264f7035a0e9] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:39:03.589361 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:39:03.635430 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-da404e34-f8aa-41ec-8972-7b5548d76c86 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "DELETE /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9" status: 204 len: 0 microversion: 2.1 time: 0.218016 Oct 18 15:39:03.639182 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1663/3256] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:39:03 2022] DELETE /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:39:03.649799 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-cd75e1cb-df1d-496c-b51e-5a59523d59ce tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:03.656088 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-cd75e1cb-df1d-496c-b51e-5a59523d59ce tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] [instance: 994c2ba1-98f1-4d00-8753-00e39d56d433] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:03.663543 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cd75e1cb-df1d-496c-b51e-5a59523d59ce tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:03.664290 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cd75e1cb-df1d-496c-b51e-5a59523d59ce tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:03.664946 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cd75e1cb-df1d-496c-b51e-5a59523d59ce tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:03.665815 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cd75e1cb-df1d-496c-b51e-5a59523d59ce tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:03.667615 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cd75e1cb-df1d-496c-b51e-5a59523d59ce tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:03.668240 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cd75e1cb-df1d-496c-b51e-5a59523d59ce tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:03.717073 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-cd75e1cb-df1d-496c-b51e-5a59523d59ce tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] [instance: 994c2ba1-98f1-4d00-8753-00e39d56d433] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:39:03.889337 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-cd75e1cb-df1d-496c-b51e-5a59523d59ce tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] 10.222.0.60 "DELETE /compute/v2.1/servers/994c2ba1-98f1-4d00-8753-00e39d56d433" status: 204 len: 0 microversion: 2.1 time: 0.248783 Oct 18 15:39:03.891121 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1664/3257] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:39:03 2022] DELETE /compute/v2.1/servers/994c2ba1-98f1-4d00-8753-00e39d56d433 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:39:03.900160 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-325747aa-ee75-4f99-ad71-e4e1090f9867 req-a633ed09-e546-4b05-9583-b090740d41c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ae6ac1e-7345-4096-9816-a53e90d88447", "tag": "860075d2-73a1-49ad-a68a-e236bf779147"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:39:03.914755 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-325747aa-ee75-4f99-ad71-e4e1090f9867 req-a633ed09-e546-4b05-9583-b090740d41c8 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:03.915419 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-325747aa-ee75-4f99-ad71-e4e1090f9867 req-a633ed09-e546-4b05-9583-b090740d41c8 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:03.916224 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-325747aa-ee75-4f99-ad71-e4e1090f9867 req-a633ed09-e546-4b05-9583-b090740d41c8 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:03.941953 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-325747aa-ee75-4f99-ad71-e4e1090f9867 req-a633ed09-e546-4b05-9583-b090740d41c8 service nova] Creating event network-changed:860075d2-73a1-49ad-a68a-e236bf779147 for instance 7ae6ac1e-7345-4096-9816-a53e90d88447 on n-h2-853682-5 Oct 18 15:39:03.960613 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-325747aa-ee75-4f99-ad71-e4e1090f9867 req-a633ed09-e546-4b05-9583-b090740d41c8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067590 Oct 18 15:39:03.961631 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1665/3258] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:39:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:39:03.970475 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a4299b89-5aa2-42ca-9e79-c18b0b9877d7 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:03.971801 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a4299b89-5aa2-42ca-9e79-c18b0b9877d7 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:03.980762 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a4299b89-5aa2-42ca-9e79-c18b0b9877d7 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:03.982099 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a4299b89-5aa2-42ca-9e79-c18b0b9877d7 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:03.982711 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a4299b89-5aa2-42ca-9e79-c18b0b9877d7 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:03.983949 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a4299b89-5aa2-42ca-9e79-c18b0b9877d7 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:03.984737 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a4299b89-5aa2-42ca-9e79-c18b0b9877d7 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:03.985352 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a4299b89-5aa2-42ca-9e79-c18b0b9877d7 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:04.318345 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a4299b89-5aa2-42ca-9e79-c18b0b9877d7 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:04.333691 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a4299b89-5aa2-42ca-9e79-c18b0b9877d7 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:04.335237 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a4299b89-5aa2-42ca-9e79-c18b0b9877d7 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:04.336446 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a4299b89-5aa2-42ca-9e79-c18b0b9877d7 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 200 len: 1880 microversion: 2.32 time: 0.373702 Oct 18 15:39:04.341494 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1666/3259] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:39:03 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 1880 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:39:04.346323 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-19f5682d-3830-4887-8c6d-454d49610f1b tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:04.346951 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-19f5682d-3830-4887-8c6d-454d49610f1b tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 57537212-8816-4122-adbe-264f7035a0e9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:04.366690 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-19f5682d-3830-4887-8c6d-454d49610f1b tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:04.367195 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-19f5682d-3830-4887-8c6d-454d49610f1b tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:04.367639 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-19f5682d-3830-4887-8c6d-454d49610f1b tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:04.368519 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-19f5682d-3830-4887-8c6d-454d49610f1b tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:04.368910 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-19f5682d-3830-4887-8c6d-454d49610f1b tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:04.369360 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-19f5682d-3830-4887-8c6d-454d49610f1b tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:04.386681 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-fb9ead75-16b8-4a58-ba28-957c18ba594b tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] [instance: 7ae6ac1e-7345-4096-9816-a53e90d88447] Updating instance_info_cache with network_info: [{"id": "860075d2-73a1-49ad-a68a-e236bf779147", "address": "fa:16:3e:cc:d7:e2", "network": {"id": "1d57134f-a7f7-40a2-9b98-ada13384a5ff", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-955016413-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c1a84f93ce8049c3a20c3b835f28100f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap860075d2-73", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120406) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 18 15:39:04.408609 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb9ead75-16b8-4a58-ba28-957c18ba594b tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Releasing lock "refresh_cache-7ae6ac1e-7345-4096-9816-a53e90d88447" {{(pid=120406) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 18 15:39:04.412782 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fb9ead75-16b8-4a58-ba28-957c18ba594b tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] 10.222.0.60 "POST /compute/v2.1/servers/7ae6ac1e-7345-4096-9816-a53e90d88447/action" status: 202 len: 0 microversion: 2.1 time: 4.072157 Oct 18 15:39:04.418116 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1594/3260] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:39:00 2022] POST /compute/v2.1/servers/7ae6ac1e-7345-4096-9816-a53e90d88447/action => generated 0 bytes in 4078 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Oct 18 15:39:04.423263 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dd4edf62-055e-4ebe-903f-1a173b18c036 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:04.424096 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dd4edf62-055e-4ebe-903f-1a173b18c036 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] [instance: 994c2ba1-98f1-4d00-8753-00e39d56d433] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:04.435627 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd4edf62-055e-4ebe-903f-1a173b18c036 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:04.436396 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd4edf62-055e-4ebe-903f-1a173b18c036 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:04.437621 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd4edf62-055e-4ebe-903f-1a173b18c036 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:04.439175 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd4edf62-055e-4ebe-903f-1a173b18c036 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:04.439937 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd4edf62-055e-4ebe-903f-1a173b18c036 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:04.441087 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd4edf62-055e-4ebe-903f-1a173b18c036 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:04.718289 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dd4edf62-055e-4ebe-903f-1a173b18c036 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e520e6eb21fb48958a2e1026be086543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d20041d87447e2b959a169637c428b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:04.735234 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dd4edf62-055e-4ebe-903f-1a173b18c036 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] 10.222.0.60 "GET /compute/v2.1/servers/994c2ba1-98f1-4d00-8753-00e39d56d433" status: 200 len: 1663 microversion: 2.1 time: 0.315556 Oct 18 15:39:04.735852 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1595/3261] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:04 2022] GET /compute/v2.1/servers/994c2ba1-98f1-4d00-8753-00e39d56d433 => generated 1663 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:04.743602 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bb545e04-bf04-44e3-97df-499d9a25d395 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:04.744467 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bb545e04-bf04-44e3-97df-499d9a25d395 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: d280f396-df42-482a-b0c1-9a8a9b608f57] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:04.778942 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb545e04-bf04-44e3-97df-499d9a25d395 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:04.781351 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb545e04-bf04-44e3-97df-499d9a25d395 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:04.781987 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb545e04-bf04-44e3-97df-499d9a25d395 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:04.782740 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb545e04-bf04-44e3-97df-499d9a25d395 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:04.783320 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb545e04-bf04-44e3-97df-499d9a25d395 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:04.783873 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb545e04-bf04-44e3-97df-499d9a25d395 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:04.830842 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-19f5682d-3830-4887-8c6d-454d49610f1b tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:04.842464 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-19f5682d-3830-4887-8c6d-454d49610f1b tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9" status: 200 len: 1683 microversion: 2.1 time: 0.499551 Oct 18 15:39:04.843830 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1667/3262] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:04 2022] GET /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9 => generated 1683 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:04.868286 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9b8a7951-c109-4aaf-823c-a3a3d868ad3f tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Action: 'action', calling method: .version_select at 0x7f7c3f062700>, body: {"addFloatingIp": {"address": "172.25.4.50"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:39:04.875566 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9b8a7951-c109-4aaf-823c-a3a3d868ad3f tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] [instance: 64730348-4d42-40d3-aeac-a4aad6c10d67] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:04.891336 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9b8a7951-c109-4aaf-823c-a3a3d868ad3f tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:04.892084 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9b8a7951-c109-4aaf-823c-a3a3d868ad3f tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:04.893044 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9b8a7951-c109-4aaf-823c-a3a3d868ad3f tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:04.893444 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9b8a7951-c109-4aaf-823c-a3a3d868ad3f tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:04.893913 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9b8a7951-c109-4aaf-823c-a3a3d868ad3f tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:04.894344 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9b8a7951-c109-4aaf-823c-a3a3d868ad3f tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:04.993160 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9b8a7951-c109-4aaf-823c-a3a3d868ad3f tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "refresh_cache-64730348-4d42-40d3-aeac-a4aad6c10d67" {{(pid=120405) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 18 15:39:04.993783 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9b8a7951-c109-4aaf-823c-a3a3d868ad3f tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquired lock "refresh_cache-64730348-4d42-40d3-aeac-a4aad6c10d67" {{(pid=120405) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 18 15:39:05.503749 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bb545e04-bf04-44e3-97df-499d9a25d395 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:05.553320 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bb545e04-bf04-44e3-97df-499d9a25d395 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57" status: 200 len: 1477 microversion: 2.1 time: 0.814667 Oct 18 15:39:05.557322 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1596/3263] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:04 2022] GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57 => generated 1477 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:05.583510 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-77f229fb-66bb-42dd-92df-362c87bc0d4a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:05.584351 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-77f229fb-66bb-42dd-92df-362c87bc0d4a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 2059ec7e-ef9b-4eb6-af19-34b2bd09e44a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:05.596263 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77f229fb-66bb-42dd-92df-362c87bc0d4a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:05.598020 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77f229fb-66bb-42dd-92df-362c87bc0d4a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:05.598696 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77f229fb-66bb-42dd-92df-362c87bc0d4a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:05.600497 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77f229fb-66bb-42dd-92df-362c87bc0d4a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:05.601829 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77f229fb-66bb-42dd-92df-362c87bc0d4a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:05.602637 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77f229fb-66bb-42dd-92df-362c87bc0d4a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:06.679312 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-77f229fb-66bb-42dd-92df-362c87bc0d4a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:06.690222 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-77f229fb-66bb-42dd-92df-362c87bc0d4a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a" status: 200 len: 1513 microversion: 2.1 time: 1.128600 Oct 18 15:39:06.695788 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1597/3264] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:05 2022] GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a => generated 1513 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:06.713150 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-aba062c4-6f82-4c1f-8d20-0bec565c2952 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:06.713789 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-aba062c4-6f82-4c1f-8d20-0bec565c2952 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:06.720191 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aba062c4-6f82-4c1f-8d20-0bec565c2952 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:06.722012 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aba062c4-6f82-4c1f-8d20-0bec565c2952 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:06.722646 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aba062c4-6f82-4c1f-8d20-0bec565c2952 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:06.723578 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aba062c4-6f82-4c1f-8d20-0bec565c2952 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:06.724736 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aba062c4-6f82-4c1f-8d20-0bec565c2952 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:06.725381 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aba062c4-6f82-4c1f-8d20-0bec565c2952 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:07.516097 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-aba062c4-6f82-4c1f-8d20-0bec565c2952 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:07.525817 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-aba062c4-6f82-4c1f-8d20-0bec565c2952 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:07.527380 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-aba062c4-6f82-4c1f-8d20-0bec565c2952 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:07.528776 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-aba062c4-6f82-4c1f-8d20-0bec565c2952 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 200 len: 1880 microversion: 2.32 time: 0.831803 Oct 18 15:39:07.529950 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1598/3265] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:39:06 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 1880 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:39:07.534284 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cd634ac1-dbd6-4323-b2c6-dc95c866f054 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:07.534886 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cd634ac1-dbd6-4323-b2c6-dc95c866f054 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] [instance: 994c2ba1-98f1-4d00-8753-00e39d56d433] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:07.541880 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd634ac1-dbd6-4323-b2c6-dc95c866f054 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:07.542521 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd634ac1-dbd6-4323-b2c6-dc95c866f054 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:07.542949 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd634ac1-dbd6-4323-b2c6-dc95c866f054 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:07.543966 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd634ac1-dbd6-4323-b2c6-dc95c866f054 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:07.544791 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd634ac1-dbd6-4323-b2c6-dc95c866f054 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:07.545498 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd634ac1-dbd6-4323-b2c6-dc95c866f054 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:08.117992 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cd634ac1-dbd6-4323-b2c6-dc95c866f054 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e520e6eb21fb48958a2e1026be086543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d20041d87447e2b959a169637c428b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:08.127015 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cd634ac1-dbd6-4323-b2c6-dc95c866f054 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] 10.222.0.60 "GET /compute/v2.1/servers/994c2ba1-98f1-4d00-8753-00e39d56d433" status: 200 len: 1663 microversion: 2.1 time: 0.596179 Oct 18 15:39:08.127866 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1599/3266] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:07 2022] GET /compute/v2.1/servers/994c2ba1-98f1-4d00-8753-00e39d56d433 => generated 1663 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:08.133003 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7f77dacd-da4a-4968-8e72-1dc97ca1934e tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:08.133782 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7f77dacd-da4a-4968-8e72-1dc97ca1934e tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 57537212-8816-4122-adbe-264f7035a0e9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:08.146511 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f77dacd-da4a-4968-8e72-1dc97ca1934e tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:08.146997 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f77dacd-da4a-4968-8e72-1dc97ca1934e tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:08.147461 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f77dacd-da4a-4968-8e72-1dc97ca1934e tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:08.148707 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f77dacd-da4a-4968-8e72-1dc97ca1934e tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:08.149211 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f77dacd-da4a-4968-8e72-1dc97ca1934e tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:08.149783 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f77dacd-da4a-4968-8e72-1dc97ca1934e tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:08.167817 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:39:08.725157 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=18 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:39:08.738537 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:39:08.924904 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7f77dacd-da4a-4968-8e72-1dc97ca1934e tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:08.940042 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7f77dacd-da4a-4968-8e72-1dc97ca1934e tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9" status: 200 len: 1683 microversion: 2.1 time: 0.810546 Oct 18 15:39:08.940985 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1600/3267] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:08 2022] GET /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9 => generated 1683 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:08.949760 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fdaa53ab-bd2f-4e71-9ba5-a09c52647348 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:08.952558 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fdaa53ab-bd2f-4e71-9ba5-a09c52647348 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: d280f396-df42-482a-b0c1-9a8a9b608f57] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:08.961247 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fdaa53ab-bd2f-4e71-9ba5-a09c52647348 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:08.962198 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fdaa53ab-bd2f-4e71-9ba5-a09c52647348 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:08.962839 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fdaa53ab-bd2f-4e71-9ba5-a09c52647348 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:08.963741 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fdaa53ab-bd2f-4e71-9ba5-a09c52647348 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:08.964373 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fdaa53ab-bd2f-4e71-9ba5-a09c52647348 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:08.965672 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fdaa53ab-bd2f-4e71-9ba5-a09c52647348 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:09.331203 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=8 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:39:09.475789 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fdaa53ab-bd2f-4e71-9ba5-a09c52647348 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:09.486081 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fdaa53ab-bd2f-4e71-9ba5-a09c52647348 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57" status: 200 len: 1477 microversion: 2.1 time: 0.543474 Oct 18 15:39:09.508499 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1601/3268] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:08 2022] GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57 => generated 1477 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:09.652261 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b1e09b91-5e36-4745-bed9-8957d136780c tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Action: 'create', calling method: .version_select at 0x7f7c3c723e50>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1604106695", "policies": ["affinity"]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:39:09.677765 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-b1e09b91-5e36-4745-bed9-8957d136780c tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Getting quotas for project 504166c44064437ca4e25acd180bea8f. Resources: {'server_groups'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:39:09.705452 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-b1e09b91-5e36-4745-bed9-8957d136780c tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Getting quotas for user 9b5a4b02c2a74519baa305e3b7659519 and project 504166c44064437ca4e25acd180bea8f. Resources: {'server_groups'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:39:09.773847 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-b1e09b91-5e36-4745-bed9-8957d136780c tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Getting quotas for project 504166c44064437ca4e25acd180bea8f. Resources: {'server_groups'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:39:09.781110 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-b1e09b91-5e36-4745-bed9-8957d136780c tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Getting quotas for user 9b5a4b02c2a74519baa305e3b7659519 and project 504166c44064437ca4e25acd180bea8f. Resources: {'server_groups'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:39:09.799581 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:INSERT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:39:09.803171 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b1e09b91-5e36-4745-bed9-8957d136780c tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] 10.222.0.60 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.293046 Oct 18 15:39:09.812687 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1602/3269] 10.222.0.60 () {60 vars in 1174 bytes} [Tue Oct 18 15:39:09 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:39:09.816972 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-01c43224-e7d8-43b0-90fb-68bf0c4b8a36 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:09.818511 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-01c43224-e7d8-43b0-90fb-68bf0c4b8a36 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 2059ec7e-ef9b-4eb6-af19-34b2bd09e44a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:09.825720 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01c43224-e7d8-43b0-90fb-68bf0c4b8a36 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:09.826455 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01c43224-e7d8-43b0-90fb-68bf0c4b8a36 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:09.827197 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01c43224-e7d8-43b0-90fb-68bf0c4b8a36 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:09.829467 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01c43224-e7d8-43b0-90fb-68bf0c4b8a36 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:09.830082 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01c43224-e7d8-43b0-90fb-68bf0c4b8a36 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:09.830680 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01c43224-e7d8-43b0-90fb-68bf0c4b8a36 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:10.468299 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-01c43224-e7d8-43b0-90fb-68bf0c4b8a36 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:10.484693 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-01c43224-e7d8-43b0-90fb-68bf0c4b8a36 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a" status: 200 len: 1513 microversion: 2.1 time: 0.678710 Oct 18 15:39:10.488224 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1603/3270] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:09 2022] GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a => generated 1513 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:10.510641 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b504b53d-3485-493b-b73a-21962f47668a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:10.511587 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b504b53d-3485-493b-b73a-21962f47668a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:10.519434 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b504b53d-3485-493b-b73a-21962f47668a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:10.520354 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b504b53d-3485-493b-b73a-21962f47668a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:10.521135 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b504b53d-3485-493b-b73a-21962f47668a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:10.522051 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b504b53d-3485-493b-b73a-21962f47668a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:10.522676 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b504b53d-3485-493b-b73a-21962f47668a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:10.523261 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b504b53d-3485-493b-b73a-21962f47668a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:10.957787 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b504b53d-3485-493b-b73a-21962f47668a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:10.992194 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b504b53d-3485-493b-b73a-21962f47668a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:11.001585 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b504b53d-3485-493b-b73a-21962f47668a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:11.005217 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b504b53d-3485-493b-b73a-21962f47668a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 200 len: 1880 microversion: 2.32 time: 0.515015 Oct 18 15:39:11.016148 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1604/3271] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:39:10 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 1880 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:39:11.032057 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2731cade-2965-467b-b6a7-cd06745661c5 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:11.033833 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2731cade-2965-467b-b6a7-cd06745661c5 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] [instance: 994c2ba1-98f1-4d00-8753-00e39d56d433] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:11.040656 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2731cade-2965-467b-b6a7-cd06745661c5 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:11.041486 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2731cade-2965-467b-b6a7-cd06745661c5 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:11.042969 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2731cade-2965-467b-b6a7-cd06745661c5 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:11.043897 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2731cade-2965-467b-b6a7-cd06745661c5 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:11.044571 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2731cade-2965-467b-b6a7-cd06745661c5 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:11.045238 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2731cade-2965-467b-b6a7-cd06745661c5 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:11.061778 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-2731cade-2965-467b-b6a7-cd06745661c5 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] HTTP exception thrown: Instance 994c2ba1-98f1-4d00-8753-00e39d56d433 could not be found. Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2731cade-2965-467b-b6a7-cd06745661c5 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Request method failure captured: Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/994c2ba1-98f1-4d00-8753-00e39d56d433 HTTP/1.1 Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTshSS4iYQ_l63TV08Y3oBGDbhWP4uwC8ZB2YxIkywNNAX-YN2g-K8rMY4bSZNBcMj9TvD1dYjXZAJafdc4nUpXeSFFdGYA7PJRN3E_MuMfkCtXKbWGRonaMDZ9DgbPhOjkoz-LpUtSORALcXxvFSkrhtoYo-zDpXJ2l4HpP19mDHRrM Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: e6d20041d87447e2b959a169637c428b Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersTestFqdnHostnames-90794513 Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e6d20041d87447e2b959a169637c428b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e6d20041d87447e2b959a169637c428b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e6d20041d87447e2b959a169637c428b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e6d20041d87447e2b959a169637c428b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersTestFqdnHostnames-90794513 Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: e6d20041d87447e2b959a169637c428b Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-90794513 Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersTestFqdnHostnames-90794513-project Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: e520e6eb21fb48958a2e1026be086543 Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersTestFqdnHostnames-90794513-project Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 994c2ba1-98f1-4d00-8753-00e39d56d433 could not be found. Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '994c2ba1-98f1-4d00-8753-00e39d56d433'} Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 994c2ba1-98f1-4d00-8753-00e39d56d433 could not be found. Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 994c2ba1-98f1-4d00-8753-00e39d56d433 could not be found. Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:39:11.064346 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:39:11.069200 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:39:11.069200 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:39:11.069200 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:39:11.069200 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:39:11.069200 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:39:11.069200 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 994c2ba1-98f1-4d00-8753-00e39d56d433 could not be found. Oct 18 15:39:11.069200 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:39:11.069200 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2731cade-2965-467b-b6a7-cd06745661c5 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Returning 404 to user: Instance 994c2ba1-98f1-4d00-8753-00e39d56d433 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:39:11.070618 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2731cade-2965-467b-b6a7-cd06745661c5 tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] 10.222.0.60 "GET /compute/v2.1/servers/994c2ba1-98f1-4d00-8753-00e39d56d433" status: 404 len: 111 microversion: 2.1 time: 0.048839 Oct 18 15:39:11.072400 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1605/3272] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:11 2022] GET /compute/v2.1/servers/994c2ba1-98f1-4d00-8753-00e39d56d433 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:39:11.077333 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f10af9b9-d0eb-4151-86f7-7143fd92ae8f tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Action: 'create', calling method: .version_select at 0x7f7c3c727310>, body: {"server_group": {"name": "tempest-server-group-1026916222", "policies": ["affinity"]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:39:11.099380 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-f10af9b9-d0eb-4151-86f7-7143fd92ae8f tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Getting quotas for project 504166c44064437ca4e25acd180bea8f. Resources: {'server_groups'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:39:11.107645 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-f10af9b9-d0eb-4151-86f7-7143fd92ae8f tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Getting quotas for user 9b5a4b02c2a74519baa305e3b7659519 and project 504166c44064437ca4e25acd180bea8f. Resources: {'server_groups'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:39:11.173118 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-f10af9b9-d0eb-4151-86f7-7143fd92ae8f tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Getting quotas for project 504166c44064437ca4e25acd180bea8f. Resources: {'server_groups'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:39:11.179517 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-f10af9b9-d0eb-4151-86f7-7143fd92ae8f tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Getting quotas for user 9b5a4b02c2a74519baa305e3b7659519 and project 504166c44064437ca4e25acd180bea8f. Resources: {'server_groups'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:39:11.193307 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f10af9b9-d0eb-4151-86f7-7143fd92ae8f tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] 10.222.0.60 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.119500 Oct 18 15:39:11.199428 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1606/3273] 10.222.0.60 () {60 vars in 1173 bytes} [Tue Oct 18 15:39:11 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:39:11.205259 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-075a622e-b888-431d-9207-085a083574ca req-67d319b7-1a8a-48ae-b8ca-b300084d5448 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "994c2ba1-98f1-4d00-8753-00e39d56d433", "name": "network-vif-deleted", "tag": "220c5574-a181-4443-af0c-350e480aae57"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:39:11.216533 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-075a622e-b888-431d-9207-085a083574ca req-67d319b7-1a8a-48ae-b8ca-b300084d5448 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:11.217276 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-075a622e-b888-431d-9207-085a083574ca req-67d319b7-1a8a-48ae-b8ca-b300084d5448 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:11.218254 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-075a622e-b888-431d-9207-085a083574ca req-67d319b7-1a8a-48ae-b8ca-b300084d5448 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:11.231526 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-075a622e-b888-431d-9207-085a083574ca req-67d319b7-1a8a-48ae-b8ca-b300084d5448 service nova] Creating event network-vif-deleted:220c5574-a181-4443-af0c-350e480aae57 for instance 994c2ba1-98f1-4d00-8753-00e39d56d433 on n-h2-853682-5 Oct 18 15:39:11.238188 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-075a622e-b888-431d-9207-085a083574ca req-67d319b7-1a8a-48ae-b8ca-b300084d5448 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042555 Oct 18 15:39:11.239224 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1607/3274] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:39:11.245037 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-db1d5e42-1bfe-49c0-bb0c-0b2e7245e77d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:11.245844 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-db1d5e42-1bfe-49c0-bb0c-0b2e7245e77d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 57537212-8816-4122-adbe-264f7035a0e9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:11.253109 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db1d5e42-1bfe-49c0-bb0c-0b2e7245e77d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:11.253618 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db1d5e42-1bfe-49c0-bb0c-0b2e7245e77d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:11.254916 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db1d5e42-1bfe-49c0-bb0c-0b2e7245e77d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:11.255774 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db1d5e42-1bfe-49c0-bb0c-0b2e7245e77d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:11.256311 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db1d5e42-1bfe-49c0-bb0c-0b2e7245e77d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:11.256831 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db1d5e42-1bfe-49c0-bb0c-0b2e7245e77d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:11.341924 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db1d5e42-1bfe-49c0-bb0c-0b2e7245e77d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:11.342448 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db1d5e42-1bfe-49c0-bb0c-0b2e7245e77d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:11.342951 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db1d5e42-1bfe-49c0-bb0c-0b2e7245e77d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:11.343925 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-db1d5e42-1bfe-49c0-bb0c-0b2e7245e77d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lazy-loading 'fault' on Instance uuid 57537212-8816-4122-adbe-264f7035a0e9 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:39:11.557206 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-db1d5e42-1bfe-49c0-bb0c-0b2e7245e77d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:11.567689 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-db1d5e42-1bfe-49c0-bb0c-0b2e7245e77d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9" status: 200 len: 1331 microversion: 2.1 time: 0.326491 Oct 18 15:39:11.569897 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1608/3275] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:11 2022] GET /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9 => generated 1331 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:11.576703 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-19edcfd6-6d1c-45f5-b961-54accf67c73e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:11.577668 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-19edcfd6-6d1c-45f5-b961-54accf67c73e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: d280f396-df42-482a-b0c1-9a8a9b608f57] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:11.594052 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-19edcfd6-6d1c-45f5-b961-54accf67c73e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:11.594937 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-19edcfd6-6d1c-45f5-b961-54accf67c73e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:11.595478 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-19edcfd6-6d1c-45f5-b961-54accf67c73e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:11.596290 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-19edcfd6-6d1c-45f5-b961-54accf67c73e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:11.597735 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-19edcfd6-6d1c-45f5-b961-54accf67c73e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:11.598437 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-19edcfd6-6d1c-45f5-b961-54accf67c73e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:11.929469 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-19edcfd6-6d1c-45f5-b961-54accf67c73e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:11.941183 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-19edcfd6-6d1c-45f5-b961-54accf67c73e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57" status: 200 len: 1477 microversion: 2.1 time: 0.369791 Oct 18 15:39:11.949998 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1609/3276] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:11 2022] GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57 => generated 1477 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:11.949998 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7a676f67-d2d7-4916-9951-72b92686aa2c tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] Calling method '.version_select at 0x7f7c3c60a9d0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:11.987625 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7a676f67-d2d7-4916-9951-72b92686aa2c tempest-ServersTestFqdnHostnames-90794513 tempest-ServersTestFqdnHostnames-90794513-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-99874084" status: 202 len: 0 microversion: 2.1 time: 0.042573 Oct 18 15:39:11.992279 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1610/3277] 10.222.0.60 () {58 vars in 1215 bytes} [Tue Oct 18 15:39:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-99874084 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:39:12.000312 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2ba98b2d-ec14-4f39-9ff0-7971b71c2819 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Action: 'create', calling method: .version_select at 0x7f7c3c6cc160>, body: {"server_group": {"name": "tempest-server-group-1026916222", "policies": ["affinity"]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:39:12.059250 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-2ba98b2d-ec14-4f39-9ff0-7971b71c2819 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Getting quotas for project 504166c44064437ca4e25acd180bea8f. Resources: {'server_groups'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:39:12.068670 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-2ba98b2d-ec14-4f39-9ff0-7971b71c2819 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Getting quotas for user 9b5a4b02c2a74519baa305e3b7659519 and project 504166c44064437ca4e25acd180bea8f. Resources: {'server_groups'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:39:12.078523 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.network.neutron [None req-9b8a7951-c109-4aaf-823c-a3a3d868ad3f tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] [instance: 64730348-4d42-40d3-aeac-a4aad6c10d67] re-assign floating IP 172.25.4.50 from instance 7ae6ac1e-7345-4096-9816-a53e90d88447 Oct 18 15:39:12.190432 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-9b8a7951-c109-4aaf-823c-a3a3d868ad3f tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] [instance: 7ae6ac1e-7345-4096-9816-a53e90d88447] Building network info cache for instance {{(pid=120405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}} Oct 18 15:39:12.195726 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-2ba98b2d-ec14-4f39-9ff0-7971b71c2819 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Getting quotas for project 504166c44064437ca4e25acd180bea8f. Resources: {'server_groups'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:39:12.204964 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-2ba98b2d-ec14-4f39-9ff0-7971b71c2819 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Getting quotas for user 9b5a4b02c2a74519baa305e3b7659519 and project 504166c44064437ca4e25acd180bea8f. Resources: {'server_groups'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:39:12.249126 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2ba98b2d-ec14-4f39-9ff0-7971b71c2819 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] 10.222.0.60 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.254816 Oct 18 15:39:12.257509 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1611/3278] 10.222.0.60 () {60 vars in 1173 bytes} [Tue Oct 18 15:39:11 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:39:12.267697 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b0efaee4-fa8d-440e-bcfd-640fe41a2838 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:12.269162 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b0efaee4-fa8d-440e-bcfd-640fe41a2838 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 2059ec7e-ef9b-4eb6-af19-34b2bd09e44a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:12.278371 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b0efaee4-fa8d-440e-bcfd-640fe41a2838 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:12.278857 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b0efaee4-fa8d-440e-bcfd-640fe41a2838 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:12.279297 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b0efaee4-fa8d-440e-bcfd-640fe41a2838 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:12.280451 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b0efaee4-fa8d-440e-bcfd-640fe41a2838 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:12.280451 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b0efaee4-fa8d-440e-bcfd-640fe41a2838 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:12.280942 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b0efaee4-fa8d-440e-bcfd-640fe41a2838 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:12.906555 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b0efaee4-fa8d-440e-bcfd-640fe41a2838 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:12.916610 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b0efaee4-fa8d-440e-bcfd-640fe41a2838 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a" status: 200 len: 1513 microversion: 2.1 time: 0.657880 Oct 18 15:39:12.917608 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1612/3279] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:12 2022] GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a => generated 1513 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:12.922720 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-898f187a-e139-4783-9889-85676d29b4e5 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:12.923491 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-898f187a-e139-4783-9889-85676d29b4e5 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:12.937741 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-898f187a-e139-4783-9889-85676d29b4e5 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:12.938536 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-898f187a-e139-4783-9889-85676d29b4e5 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:12.939086 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-898f187a-e139-4783-9889-85676d29b4e5 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:12.939897 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-898f187a-e139-4783-9889-85676d29b4e5 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:12.942311 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-898f187a-e139-4783-9889-85676d29b4e5 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:12.943676 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-898f187a-e139-4783-9889-85676d29b4e5 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:13.340023 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-898f187a-e139-4783-9889-85676d29b4e5 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:13.350887 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-898f187a-e139-4783-9889-85676d29b4e5 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:13.352794 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-898f187a-e139-4783-9889-85676d29b4e5 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:13.354879 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-898f187a-e139-4783-9889-85676d29b4e5 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 200 len: 1880 microversion: 2.32 time: 0.436045 Oct 18 15:39:13.369256 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1613/3280] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:39:12 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 1880 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:39:13.378325 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e9bbd49f-a352-4ca4-97b0-dc75a254825e tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:13.416320 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e9bbd49f-a352-4ca4-97b0-dc75a254825e tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/1c06ae3b-2fb6-4d4e-966f-6d7043ccbdb5" status: 204 len: 0 microversion: 2.1 time: 0.043368 Oct 18 15:39:13.418295 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1614/3281] 10.222.0.60 () {58 vars in 1266 bytes} [Tue Oct 18 15:39:13 2022] DELETE /compute/v2.1/os-server-groups/1c06ae3b-2fb6-4d4e-966f-6d7043ccbdb5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:39:13.424273 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-70ad3cfc-48d4-4fb1-808f-0ab3ca859b63 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:13.425504 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-70ad3cfc-48d4-4fb1-808f-0ab3ca859b63 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 57537212-8816-4122-adbe-264f7035a0e9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:13.433233 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70ad3cfc-48d4-4fb1-808f-0ab3ca859b63 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:13.434084 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70ad3cfc-48d4-4fb1-808f-0ab3ca859b63 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:13.434750 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70ad3cfc-48d4-4fb1-808f-0ab3ca859b63 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:13.435576 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70ad3cfc-48d4-4fb1-808f-0ab3ca859b63 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:13.436128 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70ad3cfc-48d4-4fb1-808f-0ab3ca859b63 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:13.436784 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70ad3cfc-48d4-4fb1-808f-0ab3ca859b63 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:13.465573 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-9b8a7951-c109-4aaf-823c-a3a3d868ad3f tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] [instance: 7ae6ac1e-7345-4096-9816-a53e90d88447] Updating instance_info_cache with network_info: [{"id": "860075d2-73a1-49ad-a68a-e236bf779147", "address": "fa:16:3e:cc:d7:e2", "network": {"id": "1d57134f-a7f7-40a2-9b98-ada13384a5ff", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-955016413-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c1a84f93ce8049c3a20c3b835f28100f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap860075d2-73", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 18 15:39:13.476124 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-70ad3cfc-48d4-4fb1-808f-0ab3ca859b63 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] HTTP exception thrown: Instance 57537212-8816-4122-adbe-264f7035a0e9 could not be found. Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-70ad3cfc-48d4-4fb1-808f-0ab3ca859b63 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Request method failure captured: Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9 HTTP/1.1 Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsfD3tyC5zBBCs3PM6SgagJOA9ytEd34lT9my352h69qxn0wNQWvVVVEceKNcLlE8Cld2E1ewLfFQUA6X-zyH4NCgXE9isdDnVpnJB5BT1ljNdC07pganRFql9FpScM1-Xjt5su1w2IBkP6ZVV1NsRclcY3oY_ScUp2DhZs2W7X1y8Y Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: a5b55fd6668b481b8c578983dc655785 Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-AttachVolumeNegativeTest-1298357771 Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a5b55fd6668b481b8c578983dc655785"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a5b55fd6668b481b8c578983dc655785"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a5b55fd6668b481b8c578983dc655785"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a5b55fd6668b481b8c578983dc655785"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-AttachVolumeNegativeTest-1298357771 Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: a5b55fd6668b481b8c578983dc655785 Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1298357771 Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-AttachVolumeNegativeTest-1298357771-project Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: efec3b4b5b1c46bd9d2c0efa68f86979 Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-AttachVolumeNegativeTest-1298357771-project Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 57537212-8816-4122-adbe-264f7035a0e9 could not be found. Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '57537212-8816-4122-adbe-264f7035a0e9'} Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57537212-8816-4122-adbe-264f7035a0e9 could not be found. Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57537212-8816-4122-adbe-264f7035a0e9 could not be found. Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:39:13.479254 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:39:13.483982 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:39:13.483982 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:39:13.483982 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:39:13.483982 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:39:13.483982 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:39:13.483982 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57537212-8816-4122-adbe-264f7035a0e9 could not be found. Oct 18 15:39:13.483982 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:39:13.483982 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-70ad3cfc-48d4-4fb1-808f-0ab3ca859b63 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Returning 404 to user: Instance 57537212-8816-4122-adbe-264f7035a0e9 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:39:13.484578 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-9b8a7951-c109-4aaf-823c-a3a3d868ad3f tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] [instance: 64730348-4d42-40d3-aeac-a4aad6c10d67] Building network info cache for instance {{(pid=120405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}} Oct 18 15:39:13.484686 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-70ad3cfc-48d4-4fb1-808f-0ab3ca859b63 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9" status: 404 len: 111 microversion: 2.1 time: 0.063753 Oct 18 15:39:13.484686 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1615/3282] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:13 2022] GET /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:39:13.488182 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cbdb548c-c432-4d82-8217-28f068647f1f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:13.488885 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cbdb548c-c432-4d82-8217-28f068647f1f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: d280f396-df42-482a-b0c1-9a8a9b608f57] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:13.494873 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbdb548c-c432-4d82-8217-28f068647f1f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:13.495359 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbdb548c-c432-4d82-8217-28f068647f1f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:13.495978 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbdb548c-c432-4d82-8217-28f068647f1f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:13.496987 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbdb548c-c432-4d82-8217-28f068647f1f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:13.497614 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbdb548c-c432-4d82-8217-28f068647f1f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:13.498041 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbdb548c-c432-4d82-8217-28f068647f1f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:13.710178 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cbdb548c-c432-4d82-8217-28f068647f1f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:13.722128 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cbdb548c-c432-4d82-8217-28f068647f1f tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57" status: 200 len: 1477 microversion: 2.1 time: 0.237333 Oct 18 15:39:13.733950 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1616/3283] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:13 2022] GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57 => generated 1477 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:13.733950 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9aa41bd0-4b71-44fd-96a6-015e778a421f tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:13.756427 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9aa41bd0-4b71-44fd-96a6-015e778a421f tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] 10.222.0.60 "GET /compute/v2.1/os-server-groups" status: 200 len: 335 microversion: 2.1 time: 0.026657 Oct 18 15:39:13.757180 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1617/3284] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Oct 18 15:39:13 2022] GET /compute/v2.1/os-server-groups => generated 335 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:39:13.762186 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-2418ee0b-e965-4c65-8fde-db81cf91a51a req-35498950-df52-4505-aba7-6c51817b23ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57537212-8816-4122-adbe-264f7035a0e9", "name": "network-vif-deleted", "tag": "82baf8c1-00b0-44e2-8136-84d45e22d715"}, {"name": "network-changed", "server_uuid": "7ae6ac1e-7345-4096-9816-a53e90d88447", "tag": "860075d2-73a1-49ad-a68a-e236bf779147"}, {"name": "network-changed", "server_uuid": "64730348-4d42-40d3-aeac-a4aad6c10d67", "tag": "42d6883c-79d0-4365-9b09-db97e4ac7a74"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:39:13.775436 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2418ee0b-e965-4c65-8fde-db81cf91a51a req-35498950-df52-4505-aba7-6c51817b23ee service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:13.776019 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2418ee0b-e965-4c65-8fde-db81cf91a51a req-35498950-df52-4505-aba7-6c51817b23ee service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:13.776518 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2418ee0b-e965-4c65-8fde-db81cf91a51a req-35498950-df52-4505-aba7-6c51817b23ee service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:13.792563 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-2418ee0b-e965-4c65-8fde-db81cf91a51a req-35498950-df52-4505-aba7-6c51817b23ee service nova] Creating event network-vif-deleted:82baf8c1-00b0-44e2-8136-84d45e22d715 for instance 57537212-8816-4122-adbe-264f7035a0e9 on n-h1-853682-5 Oct 18 15:39:13.793217 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-2418ee0b-e965-4c65-8fde-db81cf91a51a req-35498950-df52-4505-aba7-6c51817b23ee service nova] Creating event network-changed:860075d2-73a1-49ad-a68a-e236bf779147 for instance 7ae6ac1e-7345-4096-9816-a53e90d88447 on n-h2-853682-5 Oct 18 15:39:13.793804 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-2418ee0b-e965-4c65-8fde-db81cf91a51a req-35498950-df52-4505-aba7-6c51817b23ee service nova] Creating event network-changed:42d6883c-79d0-4365-9b09-db97e4ac7a74 for instance 64730348-4d42-40d3-aeac-a4aad6c10d67 on n-h1-853682-5 Oct 18 15:39:13.806378 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-2418ee0b-e965-4c65-8fde-db81cf91a51a req-35498950-df52-4505-aba7-6c51817b23ee service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.047407 Oct 18 15:39:13.807834 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1618/3285] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:39:13.816700 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a8be7e70-67d7-4c95-8e16-e851ab573b3c tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '.version_select at 0x7f7c414d0a60>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:13.843276 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a8be7e70-67d7-4c95-8e16-e851ab573b3c tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-440635808" status: 202 len: 0 microversion: 2.1 time: 0.033739 Oct 18 15:39:13.844529 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1619/3286] 10.222.0.60 () {58 vars in 1218 bytes} [Tue Oct 18 15:39:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-440635808 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:39:13.850605 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-16133ab9-3ecd-4368-bd64-5e871338c0f9 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:13.878563 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4,nova_api:DELETE=5 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:39:13.906484 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-16133ab9-3ecd-4368-bd64-5e871338c0f9 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/cb4759cd-e724-44a6-922a-dbb29846e575" status: 204 len: 0 microversion: 2.1 time: 0.060513 Oct 18 15:39:13.907519 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1620/3287] 10.222.0.60 () {58 vars in 1266 bytes} [Tue Oct 18 15:39:13 2022] DELETE /compute/v2.1/os-server-groups/cb4759cd-e724-44a6-922a-dbb29846e575 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:39:13.916270 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eb2029df-804a-47a2-b27e-271b2ed3562d tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:13.928633 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-eb2029df-804a-47a2-b27e-271b2ed3562d tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] 10.222.0.60 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.016309 Oct 18 15:39:13.930415 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1621/3288] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Oct 18 15:39:13 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:39:13.942959 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-584e143d-ed8b-45ef-9f89-4e357308f0ef tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Action: 'create', calling method: .version_select at 0x7f7c3c6cc550>, body: {"server_group": {"name": "tempest-server-group-348737868", "policies": ["affinity"]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:39:13.961051 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-584e143d-ed8b-45ef-9f89-4e357308f0ef tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Getting quotas for project 504166c44064437ca4e25acd180bea8f. Resources: {'server_groups'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:39:13.966437 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-584e143d-ed8b-45ef-9f89-4e357308f0ef tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Getting quotas for user 9b5a4b02c2a74519baa305e3b7659519 and project 504166c44064437ca4e25acd180bea8f. Resources: {'server_groups'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:39:14.008377 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-584e143d-ed8b-45ef-9f89-4e357308f0ef tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Getting quotas for project 504166c44064437ca4e25acd180bea8f. Resources: {'server_groups'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:39:14.015217 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-584e143d-ed8b-45ef-9f89-4e357308f0ef tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Getting quotas for user 9b5a4b02c2a74519baa305e3b7659519 and project 504166c44064437ca4e25acd180bea8f. Resources: {'server_groups'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:39:14.031525 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-584e143d-ed8b-45ef-9f89-4e357308f0ef tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] 10.222.0.60 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.092826 Oct 18 15:39:14.032672 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1622/3289] 10.222.0.60 () {60 vars in 1173 bytes} [Tue Oct 18 15:39:13 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:39:14.038635 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b2cd8cd8-73b0-4cdb-936e-e976befcd1c9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:14.039578 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b2cd8cd8-73b0-4cdb-936e-e976befcd1c9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 2059ec7e-ef9b-4eb6-af19-34b2bd09e44a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:14.046316 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2cd8cd8-73b0-4cdb-936e-e976befcd1c9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:14.047157 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2cd8cd8-73b0-4cdb-936e-e976befcd1c9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:14.047752 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2cd8cd8-73b0-4cdb-936e-e976befcd1c9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:14.048847 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2cd8cd8-73b0-4cdb-936e-e976befcd1c9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:14.049469 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2cd8cd8-73b0-4cdb-936e-e976befcd1c9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:14.050060 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2cd8cd8-73b0-4cdb-936e-e976befcd1c9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:14.544404 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b2cd8cd8-73b0-4cdb-936e-e976befcd1c9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:14.557034 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b2cd8cd8-73b0-4cdb-936e-e976befcd1c9 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a" status: 200 len: 1513 microversion: 2.1 time: 0.522778 Oct 18 15:39:14.558406 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1623/3290] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:14 2022] GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a => generated 1513 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:14.566197 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-55379161-4a18-4dbc-b43f-c2656959bd17 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:14.616112 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-55379161-4a18-4dbc-b43f-c2656959bd17 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/4071f4c2-6f52-4b1e-afa3-253424405f69" status: 204 len: 0 microversion: 2.1 time: 0.052441 Oct 18 15:39:14.616852 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1624/3291] 10.222.0.60 () {58 vars in 1266 bytes} [Tue Oct 18 15:39:14 2022] DELETE /compute/v2.1/os-server-groups/4071f4c2-6f52-4b1e-afa3-253424405f69 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:39:14.624570 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-080bb2c7-96f5-4342-a6a4-e22aec64ce6d tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:14.625313 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-080bb2c7-96f5-4342-a6a4-e22aec64ce6d tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:14.633827 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-080bb2c7-96f5-4342-a6a4-e22aec64ce6d tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:14.634367 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-080bb2c7-96f5-4342-a6a4-e22aec64ce6d tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:14.634801 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-080bb2c7-96f5-4342-a6a4-e22aec64ce6d tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:14.635692 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-080bb2c7-96f5-4342-a6a4-e22aec64ce6d tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:14.636592 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-080bb2c7-96f5-4342-a6a4-e22aec64ce6d tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:14.637218 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-080bb2c7-96f5-4342-a6a4-e22aec64ce6d tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:14.888388 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:39:14.892198 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-9b8a7951-c109-4aaf-823c-a3a3d868ad3f tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] [instance: 64730348-4d42-40d3-aeac-a4aad6c10d67] Updating instance_info_cache with network_info: [{"id": "42d6883c-79d0-4365-9b09-db97e4ac7a74", "address": "fa:16:3e:0c:6a:b2", "network": {"id": "1d57134f-a7f7-40a2-9b98-ada13384a5ff", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-955016413-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c1a84f93ce8049c3a20c3b835f28100f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap42d6883c-79", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 18 15:39:14.923065 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9b8a7951-c109-4aaf-823c-a3a3d868ad3f tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Releasing lock "refresh_cache-64730348-4d42-40d3-aeac-a4aad6c10d67" {{(pid=120405) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 18 15:39:14.924421 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9b8a7951-c109-4aaf-823c-a3a3d868ad3f tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] 10.222.0.60 "POST /compute/v2.1/servers/64730348-4d42-40d3-aeac-a4aad6c10d67/action" status: 202 len: 0 microversion: 2.1 time: 10.077104 Oct 18 15:39:14.929886 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1668/3292] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:39:04 2022] POST /compute/v2.1/servers/64730348-4d42-40d3-aeac-a4aad6c10d67/action => generated 0 bytes in 10083 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 18 15:39:14.935017 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-71cbf8b3-e271-4be2-9f28-e0c13bc6ebc9 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:14.951794 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-71cbf8b3-e271-4be2-9f28-e0c13bc6ebc9 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] 10.222.0.60 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.020512 Oct 18 15:39:14.960538 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1669/3293] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Oct 18 15:39:14 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:39:14.965715 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f1e82c6d-2ae9-42c9-96df-bdf77867affb tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:14.966544 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f1e82c6d-2ae9-42c9-96df-bdf77867affb tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: d280f396-df42-482a-b0c1-9a8a9b608f57] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:14.980640 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f1e82c6d-2ae9-42c9-96df-bdf77867affb tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:14.983608 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f1e82c6d-2ae9-42c9-96df-bdf77867affb tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:14.984067 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f1e82c6d-2ae9-42c9-96df-bdf77867affb tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:14.984848 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f1e82c6d-2ae9-42c9-96df-bdf77867affb tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:14.985819 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f1e82c6d-2ae9-42c9-96df-bdf77867affb tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:14.985819 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f1e82c6d-2ae9-42c9-96df-bdf77867affb tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:15.498233 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-080bb2c7-96f5-4342-a6a4-e22aec64ce6d tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:15.520676 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-080bb2c7-96f5-4342-a6a4-e22aec64ce6d tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:15.523815 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-080bb2c7-96f5-4342-a6a4-e22aec64ce6d tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:15.525896 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-080bb2c7-96f5-4342-a6a4-e22aec64ce6d tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 200 len: 1880 microversion: 2.32 time: 0.906740 Oct 18 15:39:15.540848 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1625/3294] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:39:14 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 1880 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:39:15.540848 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-29b8cfae-ef5b-48a5-bb75-f461c14873c3 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Action: 'action', calling method: .version_select at 0x7f7c3f05bf70>, body: {"removeFloatingIp": {"address": "172.25.4.50"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:39:15.788725 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f1e82c6d-2ae9-42c9-96df-bdf77867affb tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:15.804912 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f1e82c6d-2ae9-42c9-96df-bdf77867affb tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57" status: 200 len: 1477 microversion: 2.1 time: 0.842911 Oct 18 15:39:15.827533 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1670/3295] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:14 2022] GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57 => generated 1477 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:15.838965 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2ba76d35-416f-4077-830f-2150f4e1f5ee tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Action: 'create', calling method: .version_select at 0x7f7c3d128700>, body: {"server_group": {"name": "tempest-server-group-207883958", "policies": ["anti-affinity"]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:39:15.865053 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-2ba76d35-416f-4077-830f-2150f4e1f5ee tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Getting quotas for project 504166c44064437ca4e25acd180bea8f. Resources: {'server_groups'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:39:15.882061 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-2ba76d35-416f-4077-830f-2150f4e1f5ee tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Getting quotas for user 9b5a4b02c2a74519baa305e3b7659519 and project 504166c44064437ca4e25acd180bea8f. Resources: {'server_groups'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:39:15.978564 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-2ba76d35-416f-4077-830f-2150f4e1f5ee tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Getting quotas for project 504166c44064437ca4e25acd180bea8f. Resources: {'server_groups'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:39:15.987289 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-2ba76d35-416f-4077-830f-2150f4e1f5ee tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Getting quotas for user 9b5a4b02c2a74519baa305e3b7659519 and project 504166c44064437ca4e25acd180bea8f. Resources: {'server_groups'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:39:16.005568 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2ba76d35-416f-4077-830f-2150f4e1f5ee tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] 10.222.0.60 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.175811 Oct 18 15:39:16.012069 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1671/3296] 10.222.0.60 () {60 vars in 1173 bytes} [Tue Oct 18 15:39:15 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:39:16.017362 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e2575c98-4706-4662-826b-d544f3c6ba04 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:16.018000 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e2575c98-4706-4662-826b-d544f3c6ba04 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 2059ec7e-ef9b-4eb6-af19-34b2bd09e44a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:16.024239 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e2575c98-4706-4662-826b-d544f3c6ba04 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:16.024752 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e2575c98-4706-4662-826b-d544f3c6ba04 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:16.025219 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e2575c98-4706-4662-826b-d544f3c6ba04 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:16.026117 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e2575c98-4706-4662-826b-d544f3c6ba04 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:16.026609 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e2575c98-4706-4662-826b-d544f3c6ba04 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:16.027091 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e2575c98-4706-4662-826b-d544f3c6ba04 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:16.038405 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-29b8cfae-ef5b-48a5-bb75-f461c14873c3 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] [instance: 64730348-4d42-40d3-aeac-a4aad6c10d67] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:16.045110 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29b8cfae-ef5b-48a5-bb75-f461c14873c3 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:16.045827 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29b8cfae-ef5b-48a5-bb75-f461c14873c3 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:16.046435 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29b8cfae-ef5b-48a5-bb75-f461c14873c3 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:16.047312 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29b8cfae-ef5b-48a5-bb75-f461c14873c3 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:16.049841 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29b8cfae-ef5b-48a5-bb75-f461c14873c3 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:16.058108 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29b8cfae-ef5b-48a5-bb75-f461c14873c3 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:16.843174 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e2575c98-4706-4662-826b-d544f3c6ba04 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:16.857615 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e2575c98-4706-4662-826b-d544f3c6ba04 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a" status: 200 len: 1513 microversion: 2.1 time: 0.843940 Oct 18 15:39:16.859420 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1672/3297] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:16 2022] GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a => generated 1513 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:16.866267 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c63e6a35-7f37-4a2e-bb23-8607697b9f06 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:16.866994 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c63e6a35-7f37-4a2e-bb23-8607697b9f06 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 511cbc18-aef9-4202-9616-decd6651e931] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:16.873779 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c63e6a35-7f37-4a2e-bb23-8607697b9f06 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:16.874755 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c63e6a35-7f37-4a2e-bb23-8607697b9f06 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:16.875226 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c63e6a35-7f37-4a2e-bb23-8607697b9f06 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:16.876075 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c63e6a35-7f37-4a2e-bb23-8607697b9f06 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:16.876697 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c63e6a35-7f37-4a2e-bb23-8607697b9f06 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:16.877310 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c63e6a35-7f37-4a2e-bb23-8607697b9f06 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:16.925977 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-29b8cfae-ef5b-48a5-bb75-f461c14873c3 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] HTTP exception thrown: Floating IP 172.25.4.50 is not associated with instance 7ae6ac1e-7345-4096-9816-a53e90d88447. Oct 18 15:39:16.928176 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-29b8cfae-ef5b-48a5-bb75-f461c14873c3 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Request method failure captured: Oct 18 15:39:16.928176 n-d-853682-5 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers/7ae6ac1e-7345-4096-9816-a53e90d88447/action HTTP/1.1 Oct 18 15:39:16.928176 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:39:16.928176 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:39:16.928176 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:39:16.928176 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 48 Oct 18 15:39:16.928176 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:39:16.928176 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:39:16.928176 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:39:16.928176 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:39:16.928176 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTshh4shgJRRUGfl054dCP92HNXD-3AuBQVLlkCdoDcg4dEMB_etKwqWffO785IBt6x2gtCFDm8GKYIDSnlaC59ZTog8Zltp6V1yZhuNY9smHKUeoq9I0E61kG6JhA1CA-eUuBZFnJO4JZLSzO3M0NBbAacDi_4S6L8ZfqGjaPSuVUN4 Oct 18 15:39:16.928176 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:39:16.928176 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:39:16.928176 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:39:16.928176 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:39:16.928176 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:39:16.928176 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:39:16.928176 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: c1a84f93ce8049c3a20c3b835f28100f Oct 18 15:39:16.928176 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-2136196464 Oct 18 15:39:16.928176 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:39:16.928176 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:39:16.928176 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c1a84f93ce8049c3a20c3b835f28100f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c1a84f93ce8049c3a20c3b835f28100f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c1a84f93ce8049c3a20c3b835f28100f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c1a84f93ce8049c3a20c3b835f28100f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:39:16.928176 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-2136196464 Oct 18 15:39:16.928176 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: c1a84f93ce8049c3a20c3b835f28100f Oct 18 15:39:16.928176 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-2136196464 Oct 18 15:39:16.928176 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-FloatingIPsAssociationTestJSON-2136196464-project Oct 18 15:39:16.928176 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:39:16.928176 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:39:16.928176 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 1e7ebe0c265144769931ca6262be8860 Oct 18 15:39:16.928176 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-2136196464-project Oct 18 15:39:16.928176 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:39:16.928176 n-d-853682-5 devstack@n-api.service[120406]: {"removeFloatingIp": {"address": "172.25.4.50"}} Oct 18 15:39:16.928176 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:39:16.928176 n-d-853682-5 devstack@n-api.service[120406]: exception: Floating IP 172.25.4.50 is not associated with instance 7ae6ac1e-7345-4096-9816-a53e90d88447. Oct 18 15:39:16.928176 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '7ae6ac1e-7345-4096-9816-a53e90d88447', 'body': {'removeFloatingIp': {'address': '172.25.4.50'}}} Oct 18 15:39:16.928176 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:39:16.928176 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:39:16.928176 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:39:16.928176 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:39:16.928176 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:39:16.928176 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:39:16.928176 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:39:16.928176 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:39:16.928176 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:39:16.928176 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:39:16.928176 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:39:16.928176 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:39:16.928176 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 18 15:39:16.928176 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 15:39:16.928176 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.4.50 is not associated with instance 7ae6ac1e-7345-4096-9816-a53e90d88447. Oct 18 15:39:16.928176 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:39:16.928176 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:39:16.928176 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:39:16.928176 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:39:16.928176 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:39:16.928176 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:39:16.928176 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:39:16.928176 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:39:16.928176 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.4.50 is not associated with instance 7ae6ac1e-7345-4096-9816-a53e90d88447. Oct 18 15:39:16.928176 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:39:16.932734 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-29b8cfae-ef5b-48a5-bb75-f461c14873c3 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Returning 409 to user: Floating IP 172.25.4.50 is not associated with instance 7ae6ac1e-7345-4096-9816-a53e90d88447. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:39:16.932734 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-29b8cfae-ef5b-48a5-bb75-f461c14873c3 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] 10.222.0.60 "POST /compute/v2.1/servers/7ae6ac1e-7345-4096-9816-a53e90d88447/action" status: 409 len: 145 microversion: 2.1 time: 1.401614 Oct 18 15:39:16.932734 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1626/3298] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:39:15 2022] POST /compute/v2.1/servers/7ae6ac1e-7345-4096-9816-a53e90d88447/action => generated 145 bytes in 1403 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 15:39:16.937697 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7688f5f0-c770-4809-aae6-1e9d97f29923 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:16.994353 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7688f5f0-c770-4809-aae6-1e9d97f29923 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/eda0aefe-7bea-4d80-8102-116d8587829b" status: 204 len: 0 microversion: 2.1 time: 0.061181 Oct 18 15:39:16.998017 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1627/3299] 10.222.0.60 () {58 vars in 1266 bytes} [Tue Oct 18 15:39:16 2022] DELETE /compute/v2.1/os-server-groups/eda0aefe-7bea-4d80-8102-116d8587829b => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:39:17.002659 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2abc51d9-5224-49c2-9ae6-8a254adfc08c tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:17.003282 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2abc51d9-5224-49c2-9ae6-8a254adfc08c tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:17.019840 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-c63e6a35-7f37-4a2e-bb23-8607697b9f06 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lazy-loading 'services' on Instance uuid 511cbc18-aef9-4202-9616-decd6651e931 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:39:17.032419 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2abc51d9-5224-49c2-9ae6-8a254adfc08c tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:17.033232 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2abc51d9-5224-49c2-9ae6-8a254adfc08c tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:17.033507 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2abc51d9-5224-49c2-9ae6-8a254adfc08c tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:17.034083 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2abc51d9-5224-49c2-9ae6-8a254adfc08c tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:17.041211 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2abc51d9-5224-49c2-9ae6-8a254adfc08c tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:17.041774 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2abc51d9-5224-49c2-9ae6-8a254adfc08c tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:17.174933 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c63e6a35-7f37-4a2e-bb23-8607697b9f06 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "DELETE /compute/v2.1/servers/511cbc18-aef9-4202-9616-decd6651e931/os-volume_attachments/7b8fc71c-55b7-4099-a893-e4def512fa29" status: 202 len: 0 microversion: 2.1 time: 0.312150 Oct 18 15:39:17.184177 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1673/3300] 10.222.0.60 () {58 vars in 1416 bytes} [Tue Oct 18 15:39:16 2022] DELETE /compute/v2.1/servers/511cbc18-aef9-4202-9616-decd6651e931/os-volume_attachments/7b8fc71c-55b7-4099-a893-e4def512fa29 => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:39:17.226426 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8477dcd5-6b12-436c-bc52-bc71402e2539 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:17.227411 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8477dcd5-6b12-436c-bc52-bc71402e2539 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: d280f396-df42-482a-b0c1-9a8a9b608f57] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:17.245804 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8477dcd5-6b12-436c-bc52-bc71402e2539 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:17.246492 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8477dcd5-6b12-436c-bc52-bc71402e2539 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:17.251863 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8477dcd5-6b12-436c-bc52-bc71402e2539 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:17.252978 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8477dcd5-6b12-436c-bc52-bc71402e2539 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:17.253620 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8477dcd5-6b12-436c-bc52-bc71402e2539 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:17.255047 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8477dcd5-6b12-436c-bc52-bc71402e2539 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:17.521784 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2abc51d9-5224-49c2-9ae6-8a254adfc08c tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:17.533465 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8477dcd5-6b12-436c-bc52-bc71402e2539 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:17.541805 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8477dcd5-6b12-436c-bc52-bc71402e2539 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57" status: 200 len: 1477 microversion: 2.1 time: 0.343405 Oct 18 15:39:17.553849 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1674/3301] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:17 2022] GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57 => generated 1477 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:17.553993 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2abc51d9-5224-49c2-9ae6-8a254adfc08c tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:17.553993 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2abc51d9-5224-49c2-9ae6-8a254adfc08c tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:17.553993 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2abc51d9-5224-49c2-9ae6-8a254adfc08c tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 200 len: 1880 microversion: 2.32 time: 0.550234 Oct 18 15:39:17.554236 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2cc763c0-4143-4f70-ab1d-f068409bfaaf tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Action: 'action', calling method: .version_select at 0x7f7c3f062a60>, body: {"removeFloatingIp": {"address": "172.25.4.50"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:39:17.554331 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1628/3302] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:39:16 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 1880 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:39:17.563114 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5f34cc66-ee7d-4f59-b807-cc8339ad6163 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:17.588098 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5f34cc66-ee7d-4f59-b807-cc8339ad6163 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] 10.222.0.60 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.035797 Oct 18 15:39:17.596322 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1629/3303] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Oct 18 15:39:17 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:39:17.601412 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b44a241a-2023-4854-ab4f-4064d57bdbad tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:17.606923 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b44a241a-2023-4854-ab4f-4064d57bdbad tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 511cbc18-aef9-4202-9616-decd6651e931] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:17.624711 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b44a241a-2023-4854-ab4f-4064d57bdbad tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:17.625251 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b44a241a-2023-4854-ab4f-4064d57bdbad tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:17.625697 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b44a241a-2023-4854-ab4f-4064d57bdbad tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:17.626421 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b44a241a-2023-4854-ab4f-4064d57bdbad tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:17.626879 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b44a241a-2023-4854-ab4f-4064d57bdbad tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:17.627304 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b44a241a-2023-4854-ab4f-4064d57bdbad tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:17.725291 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b44a241a-2023-4854-ab4f-4064d57bdbad tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/511cbc18-aef9-4202-9616-decd6651e931/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127667 Oct 18 15:39:17.726114 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1630/3304] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 15:39:17 2022] GET /compute/v2.1/servers/511cbc18-aef9-4202-9616-decd6651e931/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:39:17.738370 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-588e7676-b6d5-40fa-ba35-3f91e6d2cf9c tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1436305498", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "4f7bf6d4-f6e4-45d6-bd7f-8ed7d2a36f92"}]}, "os:scheduler_hints": {"group": "57496904-0426-40af-b581-96f66ac2e236"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:39:17.766422 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2cc763c0-4143-4f70-ab1d-f068409bfaaf tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] [instance: 64730348-4d42-40d3-aeac-a4aad6c10d67] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:17.773945 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2cc763c0-4143-4f70-ab1d-f068409bfaaf tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:17.774445 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2cc763c0-4143-4f70-ab1d-f068409bfaaf tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:17.776685 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2cc763c0-4143-4f70-ab1d-f068409bfaaf tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:17.780828 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2cc763c0-4143-4f70-ab1d-f068409bfaaf tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:17.780828 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2cc763c0-4143-4f70-ab1d-f068409bfaaf tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:17.781116 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2cc763c0-4143-4f70-ab1d-f068409bfaaf tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:17.876929 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-588e7676-b6d5-40fa-ba35-3f91e6d2cf9c tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] validate_networks() for [('4f7bf6d4-f6e4-45d6-bd7f-8ed7d2a36f92', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:39:18.238495 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2cc763c0-4143-4f70-ab1d-f068409bfaaf tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "refresh_cache-64730348-4d42-40d3-aeac-a4aad6c10d67" {{(pid=120405) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 18 15:39:18.239502 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2cc763c0-4143-4f70-ab1d-f068409bfaaf tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquired lock "refresh_cache-64730348-4d42-40d3-aeac-a4aad6c10d67" {{(pid=120405) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 18 15:39:18.743944 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-588e7676-b6d5-40fa-ba35-3f91e6d2cf9c tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:39:18.744475 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-588e7676-b6d5-40fa-ba35-3f91e6d2cf9c tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:39:18.745055 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-588e7676-b6d5-40fa-ba35-3f91e6d2cf9c tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:39:18.745598 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-588e7676-b6d5-40fa-ba35-3f91e6d2cf9c tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:39:18.746247 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-588e7676-b6d5-40fa-ba35-3f91e6d2cf9c tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:39:18.762821 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-588e7676-b6d5-40fa-ba35-3f91e6d2cf9c tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:18.763442 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-588e7676-b6d5-40fa-ba35-3f91e6d2cf9c tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:18.763990 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-588e7676-b6d5-40fa-ba35-3f91e6d2cf9c tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:18.764859 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-588e7676-b6d5-40fa-ba35-3f91e6d2cf9c tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:18.765433 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-588e7676-b6d5-40fa-ba35-3f91e6d2cf9c tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:18.765959 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-588e7676-b6d5-40fa-ba35-3f91e6d2cf9c tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:18.786398 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-588e7676-b6d5-40fa-ba35-3f91e6d2cf9c tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Getting quotas for project 504166c44064437ca4e25acd180bea8f. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:39:18.793045 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-588e7676-b6d5-40fa-ba35-3f91e6d2cf9c tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Getting quotas for user 9b5a4b02c2a74519baa305e3b7659519 and project 504166c44064437ca4e25acd180bea8f. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:39:18.808516 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-588e7676-b6d5-40fa-ba35-3f91e6d2cf9c tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:39:18.811493 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-588e7676-b6d5-40fa-ba35-3f91e6d2cf9c tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] [instance: a7f435f2-096a-4c79-b5f4-378c1e8b4e3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:39:18.854616 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-588e7676-b6d5-40fa-ba35-3f91e6d2cf9c tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=120406) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 18 15:39:18.875549 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-588e7676-b6d5-40fa-ba35-3f91e6d2cf9c tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Getting quotas for project 504166c44064437ca4e25acd180bea8f. Resources: {'server_group_members'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:39:18.882582 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-588e7676-b6d5-40fa-ba35-3f91e6d2cf9c tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Getting quotas for user 9b5a4b02c2a74519baa305e3b7659519 and project 504166c44064437ca4e25acd180bea8f. Resources: {'server_group_members'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:39:18.936461 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-588e7676-b6d5-40fa-ba35-3f91e6d2cf9c tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Getting quotas for project 504166c44064437ca4e25acd180bea8f. Resources: {'server_group_members'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:39:18.941895 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=9,nova_api:INSERT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:39:18.943801 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-588e7676-b6d5-40fa-ba35-3f91e6d2cf9c tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Getting quotas for user 9b5a4b02c2a74519baa305e3b7659519 and project 504166c44064437ca4e25acd180bea8f. Resources: {'server_group_members'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:39:18.975910 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-588e7676-b6d5-40fa-ba35-3f91e6d2cf9c tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.245794 Oct 18 15:39:18.980145 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1631/3305] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:39:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1250 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:39:18.990247 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6efa2227-969f-4b2d-bc44-8a82662b42c7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:18.992180 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6efa2227-969f-4b2d-bc44-8a82662b42c7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 2059ec7e-ef9b-4eb6-af19-34b2bd09e44a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:19.006855 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6efa2227-969f-4b2d-bc44-8a82662b42c7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:19.007537 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6efa2227-969f-4b2d-bc44-8a82662b42c7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:19.007984 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6efa2227-969f-4b2d-bc44-8a82662b42c7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:19.008699 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6efa2227-969f-4b2d-bc44-8a82662b42c7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:19.009203 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6efa2227-969f-4b2d-bc44-8a82662b42c7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:19.009631 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6efa2227-969f-4b2d-bc44-8a82662b42c7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:19.617074 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6efa2227-969f-4b2d-bc44-8a82662b42c7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:19.629286 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6efa2227-969f-4b2d-bc44-8a82662b42c7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a" status: 200 len: 1513 microversion: 2.1 time: 0.647809 Oct 18 15:39:19.641502 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1632/3306] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:18 2022] GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a => generated 1513 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:19.641502 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a91e43d5-0820-476c-a232-9a8754947ac0 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:19.641502 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a91e43d5-0820-476c-a232-9a8754947ac0 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: d280f396-df42-482a-b0c1-9a8a9b608f57] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:19.667055 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a91e43d5-0820-476c-a232-9a8754947ac0 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:19.667589 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a91e43d5-0820-476c-a232-9a8754947ac0 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:19.669526 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a91e43d5-0820-476c-a232-9a8754947ac0 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:19.672514 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a91e43d5-0820-476c-a232-9a8754947ac0 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:19.673040 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a91e43d5-0820-476c-a232-9a8754947ac0 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:19.673582 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a91e43d5-0820-476c-a232-9a8754947ac0 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:19.735845 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:39:19.864344 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-2cc763c0-4143-4f70-ab1d-f068409bfaaf tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] [instance: 64730348-4d42-40d3-aeac-a4aad6c10d67] Building network info cache for instance {{(pid=120405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}} Oct 18 15:39:19.968277 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a91e43d5-0820-476c-a232-9a8754947ac0 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:19.977649 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a91e43d5-0820-476c-a232-9a8754947ac0 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57" status: 200 len: 1477 microversion: 2.1 time: 0.343267 Oct 18 15:39:19.978816 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1633/3307] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:19 2022] GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57 => generated 1477 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:19.983592 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-138effe8-c2bf-4b91-a33b-e7f190b5e845 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:19.984521 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-138effe8-c2bf-4b91-a33b-e7f190b5e845 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:19.993179 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-138effe8-c2bf-4b91-a33b-e7f190b5e845 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:19.993976 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-138effe8-c2bf-4b91-a33b-e7f190b5e845 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:19.994697 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-138effe8-c2bf-4b91-a33b-e7f190b5e845 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:19.995696 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-138effe8-c2bf-4b91-a33b-e7f190b5e845 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:19.996613 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-138effe8-c2bf-4b91-a33b-e7f190b5e845 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:19.998681 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-138effe8-c2bf-4b91-a33b-e7f190b5e845 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:20.601949 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-138effe8-c2bf-4b91-a33b-e7f190b5e845 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:20.619122 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-138effe8-c2bf-4b91-a33b-e7f190b5e845 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:20.622688 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-138effe8-c2bf-4b91-a33b-e7f190b5e845 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:20.624151 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-138effe8-c2bf-4b91-a33b-e7f190b5e845 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 200 len: 1880 microversion: 2.32 time: 0.644168 Oct 18 15:39:20.639047 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1634/3308] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:39:19 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 1880 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:39:20.655524 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b17ec46f-220e-4f1c-8aa3-f6c4e5686918 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:20.658326 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b17ec46f-220e-4f1c-8aa3-f6c4e5686918 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 511cbc18-aef9-4202-9616-decd6651e931] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:20.664746 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b17ec46f-220e-4f1c-8aa3-f6c4e5686918 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:20.667069 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b17ec46f-220e-4f1c-8aa3-f6c4e5686918 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:20.667668 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b17ec46f-220e-4f1c-8aa3-f6c4e5686918 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:20.668535 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b17ec46f-220e-4f1c-8aa3-f6c4e5686918 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:20.669176 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b17ec46f-220e-4f1c-8aa3-f6c4e5686918 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:20.669807 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b17ec46f-220e-4f1c-8aa3-f6c4e5686918 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:20.718031 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b17ec46f-220e-4f1c-8aa3-f6c4e5686918 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/511cbc18-aef9-4202-9616-decd6651e931/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067106 Oct 18 15:39:20.724094 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1635/3309] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 15:39:20 2022] GET /compute/v2.1/servers/511cbc18-aef9-4202-9616-decd6651e931/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:39:20.730650 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-82c8ceb6-344d-44c9-89db-041185a86981 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:20.731264 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-82c8ceb6-344d-44c9-89db-041185a86981 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] [instance: a7f435f2-096a-4c79-b5f4-378c1e8b4e3e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:20.745816 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82c8ceb6-344d-44c9-89db-041185a86981 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:20.746302 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82c8ceb6-344d-44c9-89db-041185a86981 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:20.746733 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82c8ceb6-344d-44c9-89db-041185a86981 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:20.747427 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82c8ceb6-344d-44c9-89db-041185a86981 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:20.751447 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82c8ceb6-344d-44c9-89db-041185a86981 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:20.753804 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82c8ceb6-344d-44c9-89db-041185a86981 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:20.934447 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-82c8ceb6-344d-44c9-89db-041185a86981 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5a4b02c2a74519baa305e3b7659519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504166c44064437ca4e25acd180bea8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:20.951895 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-82c8ceb6-344d-44c9-89db-041185a86981 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] 10.222.0.60 "GET /compute/v2.1/servers/a7f435f2-096a-4c79-b5f4-378c1e8b4e3e" status: 200 len: 1265 microversion: 2.1 time: 0.226635 Oct 18 15:39:20.966885 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1636/3310] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:20 2022] GET /compute/v2.1/servers/a7f435f2-096a-4c79-b5f4-378c1e8b4e3e => generated 1265 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:20.984787 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-3a579511-cd50-4765-8f6f-d7387b7b5687 req-0d94b158-48fe-444a-94fb-97de6663b4dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64730348-4d42-40d3-aeac-a4aad6c10d67", "tag": "42d6883c-79d0-4365-9b09-db97e4ac7a74"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:39:20.998658 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3a579511-cd50-4765-8f6f-d7387b7b5687 req-0d94b158-48fe-444a-94fb-97de6663b4dc service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:20.999592 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3a579511-cd50-4765-8f6f-d7387b7b5687 req-0d94b158-48fe-444a-94fb-97de6663b4dc service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:21.000283 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3a579511-cd50-4765-8f6f-d7387b7b5687 req-0d94b158-48fe-444a-94fb-97de6663b4dc service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:21.017744 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-3a579511-cd50-4765-8f6f-d7387b7b5687 req-0d94b158-48fe-444a-94fb-97de6663b4dc service nova] Creating event network-changed:42d6883c-79d0-4365-9b09-db97e4ac7a74 for instance 64730348-4d42-40d3-aeac-a4aad6c10d67 on n-h1-853682-5 Oct 18 15:39:21.024343 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-3a579511-cd50-4765-8f6f-d7387b7b5687 req-0d94b158-48fe-444a-94fb-97de6663b4dc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043577 Oct 18 15:39:21.025929 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1637/3311] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:39:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:39:21.039362 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-765f933e-55b3-4a01-ab1a-5b1c0b9d8cfa tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:21.040363 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-765f933e-55b3-4a01-ab1a-5b1c0b9d8cfa tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 2059ec7e-ef9b-4eb6-af19-34b2bd09e44a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:21.064318 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-765f933e-55b3-4a01-ab1a-5b1c0b9d8cfa tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:21.065140 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-765f933e-55b3-4a01-ab1a-5b1c0b9d8cfa tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:21.066050 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-765f933e-55b3-4a01-ab1a-5b1c0b9d8cfa tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:21.067759 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-765f933e-55b3-4a01-ab1a-5b1c0b9d8cfa tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:21.068378 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-765f933e-55b3-4a01-ab1a-5b1c0b9d8cfa tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:21.069451 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-765f933e-55b3-4a01-ab1a-5b1c0b9d8cfa tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:21.343122 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-2cc763c0-4143-4f70-ab1d-f068409bfaaf tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] [instance: 64730348-4d42-40d3-aeac-a4aad6c10d67] Updating instance_info_cache with network_info: [{"id": "42d6883c-79d0-4365-9b09-db97e4ac7a74", "address": "fa:16:3e:0c:6a:b2", "network": {"id": "1d57134f-a7f7-40a2-9b98-ada13384a5ff", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-955016413-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c1a84f93ce8049c3a20c3b835f28100f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap42d6883c-79", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 18 15:39:21.378803 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2cc763c0-4143-4f70-ab1d-f068409bfaaf tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Releasing lock "refresh_cache-64730348-4d42-40d3-aeac-a4aad6c10d67" {{(pid=120405) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 18 15:39:21.380492 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2cc763c0-4143-4f70-ab1d-f068409bfaaf tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] 10.222.0.60 "POST /compute/v2.1/servers/64730348-4d42-40d3-aeac-a4aad6c10d67/action" status: 202 len: 0 microversion: 2.1 time: 3.835843 Oct 18 15:39:21.381927 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1675/3312] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:39:17 2022] POST /compute/v2.1/servers/64730348-4d42-40d3-aeac-a4aad6c10d67/action => generated 0 bytes in 3838 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 18 15:39:21.404244 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ad53e527-9d0b-4344-bbec-95966299015e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:21.416998 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ad53e527-9d0b-4344-bbec-95966299015e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: d280f396-df42-482a-b0c1-9a8a9b608f57] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:21.437762 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ad53e527-9d0b-4344-bbec-95966299015e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:21.439773 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ad53e527-9d0b-4344-bbec-95966299015e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:21.440372 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ad53e527-9d0b-4344-bbec-95966299015e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:21.445551 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ad53e527-9d0b-4344-bbec-95966299015e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:21.447848 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ad53e527-9d0b-4344-bbec-95966299015e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:21.448856 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ad53e527-9d0b-4344-bbec-95966299015e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:22.063580 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-765f933e-55b3-4a01-ab1a-5b1c0b9d8cfa tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:22.077731 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-765f933e-55b3-4a01-ab1a-5b1c0b9d8cfa tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a" status: 200 len: 1513 microversion: 2.1 time: 1.050373 Oct 18 15:39:22.078332 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1638/3313] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:21 2022] GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a => generated 1513 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:22.083183 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dc72f7ce-7494-4a40-a22d-6301a8b6ceb3 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:22.083676 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dc72f7ce-7494-4a40-a22d-6301a8b6ceb3 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] [instance: 64730348-4d42-40d3-aeac-a4aad6c10d67] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:22.102655 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc72f7ce-7494-4a40-a22d-6301a8b6ceb3 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:22.103387 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc72f7ce-7494-4a40-a22d-6301a8b6ceb3 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:22.104199 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc72f7ce-7494-4a40-a22d-6301a8b6ceb3 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:22.105320 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc72f7ce-7494-4a40-a22d-6301a8b6ceb3 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:22.105935 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc72f7ce-7494-4a40-a22d-6301a8b6ceb3 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:22.106539 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc72f7ce-7494-4a40-a22d-6301a8b6ceb3 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:22.150846 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dc72f7ce-7494-4a40-a22d-6301a8b6ceb3 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] [instance: 64730348-4d42-40d3-aeac-a4aad6c10d67] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:39:22.264466 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dc72f7ce-7494-4a40-a22d-6301a8b6ceb3 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] 10.222.0.60 "DELETE /compute/v2.1/servers/64730348-4d42-40d3-aeac-a4aad6c10d67" status: 204 len: 0 microversion: 2.1 time: 0.184858 Oct 18 15:39:22.265481 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1639/3314] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:39:22 2022] DELETE /compute/v2.1/servers/64730348-4d42-40d3-aeac-a4aad6c10d67 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:39:22.270711 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ad53e527-9d0b-4344-bbec-95966299015e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:22.278214 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-45aac8e2-5e06-41dc-9fb4-0e788b7688f9 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:22.284462 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-45aac8e2-5e06-41dc-9fb4-0e788b7688f9 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:22.292343 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45aac8e2-5e06-41dc-9fb4-0e788b7688f9 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:22.292853 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45aac8e2-5e06-41dc-9fb4-0e788b7688f9 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:22.293475 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45aac8e2-5e06-41dc-9fb4-0e788b7688f9 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:22.294359 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45aac8e2-5e06-41dc-9fb4-0e788b7688f9 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:22.294488 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ad53e527-9d0b-4344-bbec-95966299015e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57" status: 200 len: 1476 microversion: 2.1 time: 0.910867 Oct 18 15:39:22.295109 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45aac8e2-5e06-41dc-9fb4-0e788b7688f9 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:22.295705 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45aac8e2-5e06-41dc-9fb4-0e788b7688f9 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:22.321000 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1676/3315] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:21 2022] GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57 => generated 1476 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:22.331541 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ed4491c4-445c-440a-81c3-8a7375c6f9a5 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:22.334218 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ed4491c4-445c-440a-81c3-8a7375c6f9a5 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 511cbc18-aef9-4202-9616-decd6651e931] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:22.349871 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ed4491c4-445c-440a-81c3-8a7375c6f9a5 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:22.351008 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ed4491c4-445c-440a-81c3-8a7375c6f9a5 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:22.351649 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ed4491c4-445c-440a-81c3-8a7375c6f9a5 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:22.354057 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ed4491c4-445c-440a-81c3-8a7375c6f9a5 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:22.357505 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ed4491c4-445c-440a-81c3-8a7375c6f9a5 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:22.358272 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ed4491c4-445c-440a-81c3-8a7375c6f9a5 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:22.430521 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=3,nova_cell1:UPDATE=4,nova_cell1:SAVEPOINT=3,nova_cell1:RELEASE=3 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:39:22.455886 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ed4491c4-445c-440a-81c3-8a7375c6f9a5 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/511cbc18-aef9-4202-9616-decd6651e931/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133021 Oct 18 15:39:22.458044 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1677/3316] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 15:39:22 2022] GET /compute/v2.1/servers/511cbc18-aef9-4202-9616-decd6651e931/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:39:22.471565 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-24e2bc38-cf9e-4089-aab2-e06820090c94 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:22.472693 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-24e2bc38-cf9e-4089-aab2-e06820090c94 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] [instance: a7f435f2-096a-4c79-b5f4-378c1e8b4e3e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:22.482872 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-24e2bc38-cf9e-4089-aab2-e06820090c94 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:22.483587 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-24e2bc38-cf9e-4089-aab2-e06820090c94 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:22.485006 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-24e2bc38-cf9e-4089-aab2-e06820090c94 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:22.485776 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-24e2bc38-cf9e-4089-aab2-e06820090c94 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:22.486962 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-24e2bc38-cf9e-4089-aab2-e06820090c94 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:22.487475 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-24e2bc38-cf9e-4089-aab2-e06820090c94 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:22.623211 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-24e2bc38-cf9e-4089-aab2-e06820090c94 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5a4b02c2a74519baa305e3b7659519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504166c44064437ca4e25acd180bea8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:22.634754 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-24e2bc38-cf9e-4089-aab2-e06820090c94 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] 10.222.0.60 "GET /compute/v2.1/servers/a7f435f2-096a-4c79-b5f4-378c1e8b4e3e" status: 200 len: 1271 microversion: 2.1 time: 0.170708 Oct 18 15:39:22.649573 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1678/3317] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:22 2022] GET /compute/v2.1/servers/a7f435f2-096a-4c79-b5f4-378c1e8b4e3e => generated 1271 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:22.658254 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-06685de3-c524-4d2f-8a9a-fe236b5943ac tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.4.50"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:39:22.661588 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-06685de3-c524-4d2f-8a9a-fe236b5943ac tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] [instance: 7ae6ac1e-7345-4096-9816-a53e90d88447] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:22.668335 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-06685de3-c524-4d2f-8a9a-fe236b5943ac tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:22.669332 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-06685de3-c524-4d2f-8a9a-fe236b5943ac tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:22.670043 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-06685de3-c524-4d2f-8a9a-fe236b5943ac tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:22.670975 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-06685de3-c524-4d2f-8a9a-fe236b5943ac tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:22.671656 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-06685de3-c524-4d2f-8a9a-fe236b5943ac tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:22.672551 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-06685de3-c524-4d2f-8a9a-fe236b5943ac tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:22.717066 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-06685de3-c524-4d2f-8a9a-fe236b5943ac tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "refresh_cache-7ae6ac1e-7345-4096-9816-a53e90d88447" {{(pid=120405) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 18 15:39:22.717846 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-06685de3-c524-4d2f-8a9a-fe236b5943ac tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquired lock "refresh_cache-7ae6ac1e-7345-4096-9816-a53e90d88447" {{(pid=120405) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 18 15:39:22.897445 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-45aac8e2-5e06-41dc-9fb4-0e788b7688f9 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:22.907965 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-45aac8e2-5e06-41dc-9fb4-0e788b7688f9 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:22.909543 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-45aac8e2-5e06-41dc-9fb4-0e788b7688f9 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:22.911122 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-45aac8e2-5e06-41dc-9fb4-0e788b7688f9 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 200 len: 1880 microversion: 2.32 time: 0.644915 Oct 18 15:39:22.911978 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1640/3318] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:39:22 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 1880 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:39:23.066045 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-dccaacaf-f6e6-4efc-978c-6451bbf557a8 req-6b13e102-f228-4abc-aaad-43f385ffeb6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d280f396-df42-482a-b0c1-9a8a9b608f57", "name": "network-vif-unplugged", "status": "completed", "tag": "f518ff61-30b3-4c0b-a3c2-3c35a22e45aa"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:39:23.084538 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-dccaacaf-f6e6-4efc-978c-6451bbf557a8 req-6b13e102-f228-4abc-aaad-43f385ffeb6f service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:23.091205 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-dccaacaf-f6e6-4efc-978c-6451bbf557a8 req-6b13e102-f228-4abc-aaad-43f385ffeb6f service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:23.093147 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-dccaacaf-f6e6-4efc-978c-6451bbf557a8 req-6b13e102-f228-4abc-aaad-43f385ffeb6f service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:23.123982 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-dccaacaf-f6e6-4efc-978c-6451bbf557a8 req-6b13e102-f228-4abc-aaad-43f385ffeb6f service nova] Creating event network-vif-unplugged:f518ff61-30b3-4c0b-a3c2-3c35a22e45aa for instance d280f396-df42-482a-b0c1-9a8a9b608f57 on n-h2-853682-5 Oct 18 15:39:23.135881 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [req-dccaacaf-f6e6-4efc-978c-6451bbf557a8 req-6b13e102-f228-4abc-aaad-43f385ffeb6f service nova] Instance d280f396-df42-482a-b0c1-9a8a9b608f57 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853682-5', 'n-h1-853682-5'} {{(pid=120406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 18 15:39:23.154026 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-dccaacaf-f6e6-4efc-978c-6451bbf557a8 req-6b13e102-f228-4abc-aaad-43f385ffeb6f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092166 Oct 18 15:39:23.155249 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1641/3319] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:39:23.165654 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4179711b-7ee1-45e2-ba81-f61be7c55dac tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:23.171539 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4179711b-7ee1-45e2-ba81-f61be7c55dac tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 2059ec7e-ef9b-4eb6-af19-34b2bd09e44a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:23.184522 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4179711b-7ee1-45e2-ba81-f61be7c55dac tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:23.185329 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4179711b-7ee1-45e2-ba81-f61be7c55dac tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:23.185934 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4179711b-7ee1-45e2-ba81-f61be7c55dac tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:23.186824 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4179711b-7ee1-45e2-ba81-f61be7c55dac tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:23.187445 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4179711b-7ee1-45e2-ba81-f61be7c55dac tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:23.188034 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4179711b-7ee1-45e2-ba81-f61be7c55dac tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:24.194282 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4179711b-7ee1-45e2-ba81-f61be7c55dac tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:24.221489 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4179711b-7ee1-45e2-ba81-f61be7c55dac tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a" status: 200 len: 1490 microversion: 2.1 time: 1.059809 Oct 18 15:39:24.237723 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1642/3320] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:23 2022] GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a => generated 1490 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:24.242833 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-367dda50-1594-49d4-b57b-484d9bebf202 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:24.248516 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-367dda50-1594-49d4-b57b-484d9bebf202 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: d280f396-df42-482a-b0c1-9a8a9b608f57] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:24.256018 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-367dda50-1594-49d4-b57b-484d9bebf202 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:24.257401 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-367dda50-1594-49d4-b57b-484d9bebf202 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:24.257935 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-367dda50-1594-49d4-b57b-484d9bebf202 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:24.258733 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-367dda50-1594-49d4-b57b-484d9bebf202 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:24.259265 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-367dda50-1594-49d4-b57b-484d9bebf202 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:24.259772 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-367dda50-1594-49d4-b57b-484d9bebf202 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:24.878733 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-367dda50-1594-49d4-b57b-484d9bebf202 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:24.887805 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-367dda50-1594-49d4-b57b-484d9bebf202 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57" status: 200 len: 1476 microversion: 2.1 time: 0.653837 Oct 18 15:39:24.888745 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1643/3321] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:24 2022] GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57 => generated 1476 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:24.893684 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fd47f1d1-fba2-488c-b26c-54246e04bcc0 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:24.906861 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fd47f1d1-fba2-488c-b26c-54246e04bcc0 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 511cbc18-aef9-4202-9616-decd6651e931] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:24.919771 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd47f1d1-fba2-488c-b26c-54246e04bcc0 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:24.921741 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd47f1d1-fba2-488c-b26c-54246e04bcc0 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:24.922391 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd47f1d1-fba2-488c-b26c-54246e04bcc0 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:24.923404 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd47f1d1-fba2-488c-b26c-54246e04bcc0 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:24.924073 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd47f1d1-fba2-488c-b26c-54246e04bcc0 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:24.924724 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd47f1d1-fba2-488c-b26c-54246e04bcc0 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:24.962830 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fd47f1d1-fba2-488c-b26c-54246e04bcc0 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/511cbc18-aef9-4202-9616-decd6651e931/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.072759 Oct 18 15:39:24.965005 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1644/3322] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 15:39:24 2022] GET /compute/v2.1/servers/511cbc18-aef9-4202-9616-decd6651e931/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:39:24.975007 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9ee0f89d-22ac-4bef-bbc9-d5d05c07c98e tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:24.977974 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9ee0f89d-22ac-4bef-bbc9-d5d05c07c98e tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] [instance: a7f435f2-096a-4c79-b5f4-378c1e8b4e3e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:24.986665 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ee0f89d-22ac-4bef-bbc9-d5d05c07c98e tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:24.991073 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ee0f89d-22ac-4bef-bbc9-d5d05c07c98e tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:24.991576 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ee0f89d-22ac-4bef-bbc9-d5d05c07c98e tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:24.992291 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ee0f89d-22ac-4bef-bbc9-d5d05c07c98e tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:24.992756 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ee0f89d-22ac-4bef-bbc9-d5d05c07c98e tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:24.993215 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ee0f89d-22ac-4bef-bbc9-d5d05c07c98e tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:25.530302 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9ee0f89d-22ac-4bef-bbc9-d5d05c07c98e tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5a4b02c2a74519baa305e3b7659519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504166c44064437ca4e25acd180bea8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:25.556603 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9ee0f89d-22ac-4bef-bbc9-d5d05c07c98e tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] 10.222.0.60 "GET /compute/v2.1/servers/a7f435f2-096a-4c79-b5f4-378c1e8b4e3e" status: 200 len: 1313 microversion: 2.1 time: 0.585779 Oct 18 15:39:25.572840 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1645/3323] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:24 2022] GET /compute/v2.1/servers/a7f435f2-096a-4c79-b5f4-378c1e8b4e3e => generated 1313 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:25.572840 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-601853f9-eba7-48dd-a04a-3a095d03ba03 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:25.572840 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-601853f9-eba7-48dd-a04a-3a095d03ba03 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:25.584768 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-601853f9-eba7-48dd-a04a-3a095d03ba03 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:25.590607 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-601853f9-eba7-48dd-a04a-3a095d03ba03 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:25.591382 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-601853f9-eba7-48dd-a04a-3a095d03ba03 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:25.592163 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-601853f9-eba7-48dd-a04a-3a095d03ba03 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:25.594738 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-601853f9-eba7-48dd-a04a-3a095d03ba03 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:25.596949 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-601853f9-eba7-48dd-a04a-3a095d03ba03 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:25.967955 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-601853f9-eba7-48dd-a04a-3a095d03ba03 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:25.984084 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-601853f9-eba7-48dd-a04a-3a095d03ba03 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:25.985679 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-601853f9-eba7-48dd-a04a-3a095d03ba03 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:25.989503 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-601853f9-eba7-48dd-a04a-3a095d03ba03 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 200 len: 1880 microversion: 2.32 time: 0.425391 Oct 18 15:39:25.992352 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1646/3324] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:39:25 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 1880 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:39:25.999009 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=8 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:39:26.018863 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3b99800e-6c6d-4b7b-97b9-44c2d88165fb tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:26.019774 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3b99800e-6c6d-4b7b-97b9-44c2d88165fb tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 2059ec7e-ef9b-4eb6-af19-34b2bd09e44a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:26.033359 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b99800e-6c6d-4b7b-97b9-44c2d88165fb tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:26.034391 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b99800e-6c6d-4b7b-97b9-44c2d88165fb tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:26.035076 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b99800e-6c6d-4b7b-97b9-44c2d88165fb tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:26.036554 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b99800e-6c6d-4b7b-97b9-44c2d88165fb tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:26.037263 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b99800e-6c6d-4b7b-97b9-44c2d88165fb tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:26.037933 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b99800e-6c6d-4b7b-97b9-44c2d88165fb tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:26.095110 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3b99800e-6c6d-4b7b-97b9-44c2d88165fb tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 2059ec7e-ef9b-4eb6-af19-34b2bd09e44a] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:39:26.200745 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:39:26.284686 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3b99800e-6c6d-4b7b-97b9-44c2d88165fb tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "DELETE /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a" status: 204 len: 0 microversion: 2.1 time: 0.290599 Oct 18 15:39:26.287831 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1647/3325] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:39:25 2022] DELETE /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:39:26.302171 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-20b11d96-7d6a-42b9-b57a-b05995a32d43 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:26.303014 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-20b11d96-7d6a-42b9-b57a-b05995a32d43 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 511cbc18-aef9-4202-9616-decd6651e931] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:26.313913 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20b11d96-7d6a-42b9-b57a-b05995a32d43 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:26.314583 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20b11d96-7d6a-42b9-b57a-b05995a32d43 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:26.315188 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20b11d96-7d6a-42b9-b57a-b05995a32d43 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:26.316069 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20b11d96-7d6a-42b9-b57a-b05995a32d43 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:26.316715 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20b11d96-7d6a-42b9-b57a-b05995a32d43 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:26.317315 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20b11d96-7d6a-42b9-b57a-b05995a32d43 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:26.349304 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-20b11d96-7d6a-42b9-b57a-b05995a32d43 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 511cbc18-aef9-4202-9616-decd6651e931] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:39:26.495600 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-20b11d96-7d6a-42b9-b57a-b05995a32d43 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "DELETE /compute/v2.1/servers/511cbc18-aef9-4202-9616-decd6651e931" status: 204 len: 0 microversion: 2.1 time: 0.203593 Oct 18 15:39:26.500470 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1648/3326] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:39:26 2022] DELETE /compute/v2.1/servers/511cbc18-aef9-4202-9616-decd6651e931 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:39:26.508458 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-335acc9b-535e-4335-bb5d-f251c9a7f7c0 req-8c3b52c0-1256-4561-a4b7-517174cdeb6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d280f396-df42-482a-b0c1-9a8a9b608f57", "tag": "f518ff61-30b3-4c0b-a3c2-3c35a22e45aa"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:39:26.522315 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-335acc9b-535e-4335-bb5d-f251c9a7f7c0 req-8c3b52c0-1256-4561-a4b7-517174cdeb6d service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:26.522785 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-335acc9b-535e-4335-bb5d-f251c9a7f7c0 req-8c3b52c0-1256-4561-a4b7-517174cdeb6d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:26.523211 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-335acc9b-535e-4335-bb5d-f251c9a7f7c0 req-8c3b52c0-1256-4561-a4b7-517174cdeb6d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:26.535458 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-335acc9b-535e-4335-bb5d-f251c9a7f7c0 req-8c3b52c0-1256-4561-a4b7-517174cdeb6d service nova] Creating event network-changed:f518ff61-30b3-4c0b-a3c2-3c35a22e45aa for instance d280f396-df42-482a-b0c1-9a8a9b608f57 on n-h2-853682-5 Oct 18 15:39:26.546260 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [req-335acc9b-535e-4335-bb5d-f251c9a7f7c0 req-8c3b52c0-1256-4561-a4b7-517174cdeb6d service nova] Instance d280f396-df42-482a-b0c1-9a8a9b608f57 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853682-5', 'n-h1-853682-5'} {{(pid=120406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 18 15:39:26.563514 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-335acc9b-535e-4335-bb5d-f251c9a7f7c0 req-8c3b52c0-1256-4561-a4b7-517174cdeb6d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060849 Oct 18 15:39:26.565477 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1649/3327] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:39:26.571359 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-1dc5b0c2-78f8-40ba-b6db-98e73666a694 req-106b0018-ada0-48e9-889e-7ecb2e0b612c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64730348-4d42-40d3-aeac-a4aad6c10d67", "name": "network-vif-deleted", "tag": "42d6883c-79d0-4365-9b09-db97e4ac7a74"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:39:26.583216 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1dc5b0c2-78f8-40ba-b6db-98e73666a694 req-106b0018-ada0-48e9-889e-7ecb2e0b612c service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:26.583811 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1dc5b0c2-78f8-40ba-b6db-98e73666a694 req-106b0018-ada0-48e9-889e-7ecb2e0b612c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:26.584293 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1dc5b0c2-78f8-40ba-b6db-98e73666a694 req-106b0018-ada0-48e9-889e-7ecb2e0b612c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:26.598752 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-1dc5b0c2-78f8-40ba-b6db-98e73666a694 req-106b0018-ada0-48e9-889e-7ecb2e0b612c service nova] Creating event network-vif-deleted:42d6883c-79d0-4365-9b09-db97e4ac7a74 for instance 64730348-4d42-40d3-aeac-a4aad6c10d67 on n-h1-853682-5 Oct 18 15:39:26.603975 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-1dc5b0c2-78f8-40ba-b6db-98e73666a694 req-106b0018-ada0-48e9-889e-7ecb2e0b612c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036987 Oct 18 15:39:26.604571 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1650/3328] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:39:26.609584 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7e11929b-7770-4d7c-a20e-6d8ef6f5c1f6 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:26.610344 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7e11929b-7770-4d7c-a20e-6d8ef6f5c1f6 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: d280f396-df42-482a-b0c1-9a8a9b608f57] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:26.616764 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e11929b-7770-4d7c-a20e-6d8ef6f5c1f6 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:26.617380 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e11929b-7770-4d7c-a20e-6d8ef6f5c1f6 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:26.617810 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e11929b-7770-4d7c-a20e-6d8ef6f5c1f6 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:26.618563 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e11929b-7770-4d7c-a20e-6d8ef6f5c1f6 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:26.619121 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e11929b-7770-4d7c-a20e-6d8ef6f5c1f6 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:26.619387 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e11929b-7770-4d7c-a20e-6d8ef6f5c1f6 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:27.168256 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-06685de3-c524-4d2f-8a9a-fe236b5943ac tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] [instance: 7ae6ac1e-7345-4096-9816-a53e90d88447] Building network info cache for instance {{(pid=120405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}} Oct 18 15:39:27.591161 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7e11929b-7770-4d7c-a20e-6d8ef6f5c1f6 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:27.619867 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7e11929b-7770-4d7c-a20e-6d8ef6f5c1f6 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57" status: 200 len: 1476 microversion: 2.1 time: 1.013893 Oct 18 15:39:27.638663 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1651/3329] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:26 2022] GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57 => generated 1476 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:27.650434 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-adeb1604-9d35-474b-b673-7483e88150b7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:27.652572 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-adeb1604-9d35-474b-b673-7483e88150b7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 2059ec7e-ef9b-4eb6-af19-34b2bd09e44a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:27.669469 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-adeb1604-9d35-474b-b673-7483e88150b7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:27.671574 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-adeb1604-9d35-474b-b673-7483e88150b7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:27.671574 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-adeb1604-9d35-474b-b673-7483e88150b7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:27.674187 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-adeb1604-9d35-474b-b673-7483e88150b7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:27.677730 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-adeb1604-9d35-474b-b673-7483e88150b7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:27.678456 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-adeb1604-9d35-474b-b673-7483e88150b7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:28.667344 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-adeb1604-9d35-474b-b673-7483e88150b7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:28.680214 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-adeb1604-9d35-474b-b673-7483e88150b7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a" status: 200 len: 1496 microversion: 2.1 time: 1.039950 Oct 18 15:39:28.682599 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1652/3330] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:27 2022] GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a => generated 1496 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:28.697708 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eb6ca295-680d-4eeb-befc-635bc394aa70 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:28.698554 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-eb6ca295-680d-4eeb-befc-635bc394aa70 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 511cbc18-aef9-4202-9616-decd6651e931] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:28.710267 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb6ca295-680d-4eeb-befc-635bc394aa70 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:28.716641 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb6ca295-680d-4eeb-befc-635bc394aa70 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:28.717402 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb6ca295-680d-4eeb-befc-635bc394aa70 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:28.718352 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb6ca295-680d-4eeb-befc-635bc394aa70 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:28.718975 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb6ca295-680d-4eeb-befc-635bc394aa70 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:28.719592 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb6ca295-680d-4eeb-befc-635bc394aa70 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:28.785738 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:39:28.951530 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=46 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:39:29.069386 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-eb6ca295-680d-4eeb-befc-635bc394aa70 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:29.083663 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-eb6ca295-680d-4eeb-befc-635bc394aa70 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/511cbc18-aef9-4202-9616-decd6651e931" status: 200 len: 1683 microversion: 2.1 time: 0.393664 Oct 18 15:39:29.085741 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1653/3331] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:28 2022] GET /compute/v2.1/servers/511cbc18-aef9-4202-9616-decd6651e931 => generated 1683 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:29.096343 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0c961033-5ce2-4c2b-bc2b-4dce551db86a tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:29.099831 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0c961033-5ce2-4c2b-bc2b-4dce551db86a tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] [instance: a7f435f2-096a-4c79-b5f4-378c1e8b4e3e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:29.125260 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c961033-5ce2-4c2b-bc2b-4dce551db86a tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:29.126141 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c961033-5ce2-4c2b-bc2b-4dce551db86a tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:29.126841 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c961033-5ce2-4c2b-bc2b-4dce551db86a tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:29.128082 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c961033-5ce2-4c2b-bc2b-4dce551db86a tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:29.128754 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c961033-5ce2-4c2b-bc2b-4dce551db86a tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:29.129993 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c961033-5ce2-4c2b-bc2b-4dce551db86a tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:29.608529 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-06685de3-c524-4d2f-8a9a-fe236b5943ac tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] [instance: 7ae6ac1e-7345-4096-9816-a53e90d88447] Updating instance_info_cache with network_info: [{"id": "860075d2-73a1-49ad-a68a-e236bf779147", "address": "fa:16:3e:cc:d7:e2", "network": {"id": "1d57134f-a7f7-40a2-9b98-ada13384a5ff", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-955016413-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c1a84f93ce8049c3a20c3b835f28100f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap860075d2-73", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 18 15:39:29.630767 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-06685de3-c524-4d2f-8a9a-fe236b5943ac tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Releasing lock "refresh_cache-7ae6ac1e-7345-4096-9816-a53e90d88447" {{(pid=120405) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 18 15:39:29.631701 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-06685de3-c524-4d2f-8a9a-fe236b5943ac tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] 10.222.0.60 "POST /compute/v2.1/servers/7ae6ac1e-7345-4096-9816-a53e90d88447/action" status: 202 len: 0 microversion: 2.1 time: 6.980772 Oct 18 15:39:29.632382 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1679/3332] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:39:22 2022] POST /compute/v2.1/servers/7ae6ac1e-7345-4096-9816-a53e90d88447/action => generated 0 bytes in 6982 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 18 15:39:29.731601 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0c961033-5ce2-4c2b-bc2b-4dce551db86a tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5a4b02c2a74519baa305e3b7659519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504166c44064437ca4e25acd180bea8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:29.753763 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0c961033-5ce2-4c2b-bc2b-4dce551db86a tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] 10.222.0.60 "GET /compute/v2.1/servers/a7f435f2-096a-4c79-b5f4-378c1e8b4e3e" status: 200 len: 1313 microversion: 2.1 time: 0.666417 Oct 18 15:39:29.758450 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1654/3333] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:29 2022] GET /compute/v2.1/servers/a7f435f2-096a-4c79-b5f4-378c1e8b4e3e => generated 1313 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:29.764928 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f96615f1-f4a8-46d8-a9fd-af03714a0187 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:29.765807 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f96615f1-f4a8-46d8-a9fd-af03714a0187 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:29.770375 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bb01b806-b0fc-467a-9557-883283b7be4d tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-838895190", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "b3aceec0-9baa-46ba-aa26-b4379c855adf"}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:39:29.774060 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f96615f1-f4a8-46d8-a9fd-af03714a0187 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:29.774875 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f96615f1-f4a8-46d8-a9fd-af03714a0187 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:29.775845 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f96615f1-f4a8-46d8-a9fd-af03714a0187 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:29.777651 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f96615f1-f4a8-46d8-a9fd-af03714a0187 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:29.778563 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f96615f1-f4a8-46d8-a9fd-af03714a0187 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:29.779479 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f96615f1-f4a8-46d8-a9fd-af03714a0187 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:30.167517 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-bb01b806-b0fc-467a-9557-883283b7be4d tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] validate_networks() for [('b3aceec0-9baa-46ba-aa26-b4379c855adf', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:39:30.874252 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f96615f1-f4a8-46d8-a9fd-af03714a0187 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:30.891684 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f96615f1-f4a8-46d8-a9fd-af03714a0187 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:30.894028 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f96615f1-f4a8-46d8-a9fd-af03714a0187 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:30.896105 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f96615f1-f4a8-46d8-a9fd-af03714a0187 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 200 len: 1880 microversion: 2.32 time: 1.136173 Oct 18 15:39:30.898049 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1655/3334] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:39:29 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 1880 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:39:30.916833 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-3c81e843-c64c-4e96-86e3-9a9ad41ca50c req-e57b6af5-63da-4d9d-8d88-29c1cdeb5d57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ae6ac1e-7345-4096-9816-a53e90d88447", "tag": "860075d2-73a1-49ad-a68a-e236bf779147"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:39:30.929283 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3c81e843-c64c-4e96-86e3-9a9ad41ca50c req-e57b6af5-63da-4d9d-8d88-29c1cdeb5d57 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:30.930082 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3c81e843-c64c-4e96-86e3-9a9ad41ca50c req-e57b6af5-63da-4d9d-8d88-29c1cdeb5d57 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:30.930792 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3c81e843-c64c-4e96-86e3-9a9ad41ca50c req-e57b6af5-63da-4d9d-8d88-29c1cdeb5d57 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:30.946856 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-3c81e843-c64c-4e96-86e3-9a9ad41ca50c req-e57b6af5-63da-4d9d-8d88-29c1cdeb5d57 service nova] Creating event network-changed:860075d2-73a1-49ad-a68a-e236bf779147 for instance 7ae6ac1e-7345-4096-9816-a53e90d88447 on n-h2-853682-5 Oct 18 15:39:30.954332 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-3c81e843-c64c-4e96-86e3-9a9ad41ca50c req-e57b6af5-63da-4d9d-8d88-29c1cdeb5d57 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054424 Oct 18 15:39:30.956640 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1656/3335] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:39:30.968366 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c534dc83-757b-489a-9d77-a5ce1741cd1d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:30.969156 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c534dc83-757b-489a-9d77-a5ce1741cd1d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: d280f396-df42-482a-b0c1-9a8a9b608f57] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:30.977113 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c534dc83-757b-489a-9d77-a5ce1741cd1d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:30.977834 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c534dc83-757b-489a-9d77-a5ce1741cd1d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:30.978494 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c534dc83-757b-489a-9d77-a5ce1741cd1d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:30.979394 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c534dc83-757b-489a-9d77-a5ce1741cd1d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:30.980051 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c534dc83-757b-489a-9d77-a5ce1741cd1d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:30.980671 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c534dc83-757b-489a-9d77-a5ce1741cd1d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:31.945947 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c534dc83-757b-489a-9d77-a5ce1741cd1d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:31.960046 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c534dc83-757b-489a-9d77-a5ce1741cd1d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57" status: 200 len: 1471 microversion: 2.1 time: 1.000685 Oct 18 15:39:31.963279 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1657/3336] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:30 2022] GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57 => generated 1471 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:31.969627 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5ef127a4-7908-404c-b2f5-983c92c73132 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Calling method '.version_select at 0x7f7c3c5aa820>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:32.096683 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-bb01b806-b0fc-467a-9557-883283b7be4d tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:39:32.098910 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-bb01b806-b0fc-467a-9557-883283b7be4d tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:39:32.099749 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-bb01b806-b0fc-467a-9557-883283b7be4d tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:39:32.101228 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-bb01b806-b0fc-467a-9557-883283b7be4d tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:39:32.102496 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-bb01b806-b0fc-467a-9557-883283b7be4d tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:39:32.120585 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bb01b806-b0fc-467a-9557-883283b7be4d tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:32.121417 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bb01b806-b0fc-467a-9557-883283b7be4d tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:32.124887 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bb01b806-b0fc-467a-9557-883283b7be4d tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:32.126156 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bb01b806-b0fc-467a-9557-883283b7be4d tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:32.127072 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bb01b806-b0fc-467a-9557-883283b7be4d tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:32.128753 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bb01b806-b0fc-467a-9557-883283b7be4d tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:32.167470 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-bb01b806-b0fc-467a-9557-883283b7be4d tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Getting quotas for project 0e75e5c7ef1b48cfb696da32fa30b845. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:39:32.176313 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-bb01b806-b0fc-467a-9557-883283b7be4d tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Getting quotas for user 386f58c6593d43d2829e08fbdb9ed769 and project 0e75e5c7ef1b48cfb696da32fa30b845. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:39:32.191820 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-bb01b806-b0fc-467a-9557-883283b7be4d tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:39:32.194942 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-bb01b806-b0fc-467a-9557-883283b7be4d tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] [instance: 6c2ed037-84ac-463b-a42d-01a03532cc43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:39:32.290016 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-bb01b806-b0fc-467a-9557-883283b7be4d tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.656189 Oct 18 15:39:32.292461 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1680/3337] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:39:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:39:32.311909 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-58c894e1-cd8c-4617-b1ca-abef87e7a3a4 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:32.312901 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-58c894e1-cd8c-4617-b1ca-abef87e7a3a4 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 2059ec7e-ef9b-4eb6-af19-34b2bd09e44a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:32.331231 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-58c894e1-cd8c-4617-b1ca-abef87e7a3a4 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:32.331938 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-58c894e1-cd8c-4617-b1ca-abef87e7a3a4 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:32.333125 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-58c894e1-cd8c-4617-b1ca-abef87e7a3a4 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:32.334004 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-58c894e1-cd8c-4617-b1ca-abef87e7a3a4 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:32.336218 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-58c894e1-cd8c-4617-b1ca-abef87e7a3a4 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:32.338136 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-58c894e1-cd8c-4617-b1ca-abef87e7a3a4 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:32.369018 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5ef127a4-7908-404c-b2f5-983c92c73132 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] 10.222.0.60 "GET /compute/v2.1/os-floating-ips/a00264ad-6e1f-4351-9b56-b10d2c2fbcf5" status: 200 len: 184 microversion: 2.1 time: 0.404245 Oct 18 15:39:32.377607 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1658/3338] 10.222.0.60 () {58 vars in 1260 bytes} [Tue Oct 18 15:39:31 2022] GET /compute/v2.1/os-floating-ips/a00264ad-6e1f-4351-9b56-b10d2c2fbcf5 => generated 184 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:39:32.382597 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-463f7a37-5f42-420d-bffc-71a9e1678140 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:32.383222 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-463f7a37-5f42-420d-bffc-71a9e1678140 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 511cbc18-aef9-4202-9616-decd6651e931] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:32.398603 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-58c894e1-cd8c-4617-b1ca-abef87e7a3a4 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] HTTP exception thrown: Instance 2059ec7e-ef9b-4eb6-af19-34b2bd09e44a could not be found. Oct 18 15:39:32.400710 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-463f7a37-5f42-420d-bffc-71a9e1678140 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:32.402636 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-463f7a37-5f42-420d-bffc-71a9e1678140 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-58c894e1-cd8c-4617-b1ca-abef87e7a3a4 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Request method failure captured: Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a HTTP/1.1 Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTseXdqIE6K5VM4s3TEHRLWgMUN4aMRv2NoeIzUdaqo5huhkbfibHS5WTucH_yVgiw-oU86aIdI66etum9zPC1o_Gp8lN1ylUglhXYekmlUb-DCNwOQQTPA7nsDvbxyfFlUPyfZnM9HlX0P4k3Gbrf42L5eihIJ6KOiK__MhWlbfWWoY Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 04fd51d598a04ff7a909b3ced951dea8 Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-DeleteServersTestJSON-518486720 Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-DeleteServersTestJSON-518486720 Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 04fd51d598a04ff7a909b3ced951dea8 Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-DeleteServersTestJSON-518486720 Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-DeleteServersTestJSON-518486720-project Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 5309baeeec484df194123d22779b0255 Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-DeleteServersTestJSON-518486720-project Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 2059ec7e-ef9b-4eb6-af19-34b2bd09e44a could not be found. Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '2059ec7e-ef9b-4eb6-af19-34b2bd09e44a'} Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2059ec7e-ef9b-4eb6-af19-34b2bd09e44a could not be found. Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2059ec7e-ef9b-4eb6-af19-34b2bd09e44a could not be found. Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:39:32.403492 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:39:32.407826 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:39:32.407826 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:39:32.407826 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:39:32.407826 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:39:32.407826 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:39:32.407826 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2059ec7e-ef9b-4eb6-af19-34b2bd09e44a could not be found. Oct 18 15:39:32.407826 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:39:32.411651 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-58c894e1-cd8c-4617-b1ca-abef87e7a3a4 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Returning 404 to user: Instance 2059ec7e-ef9b-4eb6-af19-34b2bd09e44a could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:39:32.412130 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-463f7a37-5f42-420d-bffc-71a9e1678140 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:32.413027 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-463f7a37-5f42-420d-bffc-71a9e1678140 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:32.413733 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-463f7a37-5f42-420d-bffc-71a9e1678140 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:32.414933 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-463f7a37-5f42-420d-bffc-71a9e1678140 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:32.418881 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-58c894e1-cd8c-4617-b1ca-abef87e7a3a4 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a" status: 404 len: 111 microversion: 2.1 time: 0.112974 Oct 18 15:39:32.420349 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1681/3339] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:32 2022] GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:39:32.429041 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-42349367-c0c2-4d6b-8e18-fbf5b798e780 req-e5dd2ec5-1412-47cd-aaf1-b16a537b6e6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "511cbc18-aef9-4202-9616-decd6651e931", "name": "network-vif-deleted", "tag": "b15f0bdc-90f5-4d7d-aeb4-725da17aace5"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:39:32.461775 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-463f7a37-5f42-420d-bffc-71a9e1678140 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] HTTP exception thrown: Instance 511cbc18-aef9-4202-9616-decd6651e931 could not be found. Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-463f7a37-5f42-420d-bffc-71a9e1678140 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Request method failure captured: Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/511cbc18-aef9-4202-9616-decd6651e931 HTTP/1.1 Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsfD3tyC5zBBCs3PM6SgagJOA9ytEd34lT9my352h69qxn0wNQWvVVVEceKNcLlE8Cld2E1ewLfFQUA6X-zyH4NCgXE9isdDnVpnJB5BT1ljNdC07pganRFql9FpScM1-Xjt5su1w2IBkP6ZVV1NsRclcY3oY_ScUp2DhZs2W7X1y8Y Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: a5b55fd6668b481b8c578983dc655785 Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-AttachVolumeNegativeTest-1298357771 Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a5b55fd6668b481b8c578983dc655785"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a5b55fd6668b481b8c578983dc655785"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a5b55fd6668b481b8c578983dc655785"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a5b55fd6668b481b8c578983dc655785"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-AttachVolumeNegativeTest-1298357771 Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: a5b55fd6668b481b8c578983dc655785 Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1298357771 Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-AttachVolumeNegativeTest-1298357771-project Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: efec3b4b5b1c46bd9d2c0efa68f86979 Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-AttachVolumeNegativeTest-1298357771-project Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 511cbc18-aef9-4202-9616-decd6651e931 could not be found. Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '511cbc18-aef9-4202-9616-decd6651e931'} Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 511cbc18-aef9-4202-9616-decd6651e931 could not be found. Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 511cbc18-aef9-4202-9616-decd6651e931 could not be found. Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:39:32.470771 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:39:32.475587 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:39:32.475587 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:39:32.475587 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:39:32.475587 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:39:32.475587 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:39:32.475587 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 511cbc18-aef9-4202-9616-decd6651e931 could not be found. Oct 18 15:39:32.475587 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:39:32.475587 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-463f7a37-5f42-420d-bffc-71a9e1678140 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Returning 404 to user: Instance 511cbc18-aef9-4202-9616-decd6651e931 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:39:32.477785 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-42349367-c0c2-4d6b-8e18-fbf5b798e780 req-e5dd2ec5-1412-47cd-aaf1-b16a537b6e6a service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:32.478269 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-42349367-c0c2-4d6b-8e18-fbf5b798e780 req-e5dd2ec5-1412-47cd-aaf1-b16a537b6e6a service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:32.478706 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-42349367-c0c2-4d6b-8e18-fbf5b798e780 req-e5dd2ec5-1412-47cd-aaf1-b16a537b6e6a service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:32.479531 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-463f7a37-5f42-420d-bffc-71a9e1678140 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/511cbc18-aef9-4202-9616-decd6651e931" status: 404 len: 111 microversion: 2.1 time: 0.093576 Oct 18 15:39:32.480191 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1659/3340] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:32 2022] GET /compute/v2.1/servers/511cbc18-aef9-4202-9616-decd6651e931 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:39:32.495312 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bb290090-22c7-4a9a-ab34-89dc5727e983 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:32.499317 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bb290090-22c7-4a9a-ab34-89dc5727e983 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] [instance: a7f435f2-096a-4c79-b5f4-378c1e8b4e3e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:32.510459 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb290090-22c7-4a9a-ab34-89dc5727e983 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:32.526562 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb290090-22c7-4a9a-ab34-89dc5727e983 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:32.527463 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb290090-22c7-4a9a-ab34-89dc5727e983 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:32.528435 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb290090-22c7-4a9a-ab34-89dc5727e983 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:32.530401 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-42349367-c0c2-4d6b-8e18-fbf5b798e780 req-e5dd2ec5-1412-47cd-aaf1-b16a537b6e6a service nova] Creating event network-vif-deleted:b15f0bdc-90f5-4d7d-aeb4-725da17aace5 for instance 511cbc18-aef9-4202-9616-decd6651e931 on n-h2-853682-5 Oct 18 15:39:32.531164 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb290090-22c7-4a9a-ab34-89dc5727e983 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:32.531848 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb290090-22c7-4a9a-ab34-89dc5727e983 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:32.549504 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-42349367-c0c2-4d6b-8e18-fbf5b798e780 req-e5dd2ec5-1412-47cd-aaf1-b16a537b6e6a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126805 Oct 18 15:39:32.551493 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1682/3341] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:39:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:39:32.573373 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-97719190-21ed-4337-9601-6fe70d142d8b tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:32.582623 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-97719190-21ed-4337-9601-6fe70d142d8b tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:32.592675 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97719190-21ed-4337-9601-6fe70d142d8b tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:32.593690 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97719190-21ed-4337-9601-6fe70d142d8b tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:32.601466 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97719190-21ed-4337-9601-6fe70d142d8b tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:32.602365 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97719190-21ed-4337-9601-6fe70d142d8b tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:32.603218 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97719190-21ed-4337-9601-6fe70d142d8b tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:32.603861 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97719190-21ed-4337-9601-6fe70d142d8b tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:33.030598 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bb290090-22c7-4a9a-ab34-89dc5727e983 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5a4b02c2a74519baa305e3b7659519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504166c44064437ca4e25acd180bea8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:33.048664 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bb290090-22c7-4a9a-ab34-89dc5727e983 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] 10.222.0.60 "GET /compute/v2.1/servers/a7f435f2-096a-4c79-b5f4-378c1e8b4e3e" status: 200 len: 1313 microversion: 2.1 time: 0.565763 Oct 18 15:39:33.050041 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1660/3342] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:32 2022] GET /compute/v2.1/servers/a7f435f2-096a-4c79-b5f4-378c1e8b4e3e => generated 1313 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:33.058379 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-92056b42-9d21-4c62-8067-9280443b44b4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:39:33.059333 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-92056b42-9d21-4c62-8067-9280443b44b4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: d280f396-df42-482a-b0c1-9a8a9b608f57] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:33.070109 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92056b42-9d21-4c62-8067-9280443b44b4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:33.071197 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92056b42-9d21-4c62-8067-9280443b44b4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:33.072523 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92056b42-9d21-4c62-8067-9280443b44b4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:33.074539 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92056b42-9d21-4c62-8067-9280443b44b4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:33.075275 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92056b42-9d21-4c62-8067-9280443b44b4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:33.076701 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92056b42-9d21-4c62-8067-9280443b44b4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:33.091685 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-97719190-21ed-4337-9601-6fe70d142d8b tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:33.106108 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-97719190-21ed-4337-9601-6fe70d142d8b tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:33.107843 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-97719190-21ed-4337-9601-6fe70d142d8b tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:33.114488 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-97719190-21ed-4337-9601-6fe70d142d8b tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 200 len: 1880 microversion: 2.32 time: 0.559026 Oct 18 15:39:33.115425 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1683/3343] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:39:32 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 1880 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:39:33.120124 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b7872a90-bf1e-43a6-91d7-66bf5b028b12 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:33.120744 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b7872a90-bf1e-43a6-91d7-66bf5b028b12 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] [instance: 6c2ed037-84ac-463b-a42d-01a03532cc43] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:33.224389 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b7872a90-bf1e-43a6-91d7-66bf5b028b12 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386f58c6593d43d2829e08fbdb9ed769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e75e5c7ef1b48cfb696da32fa30b845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:33.232634 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b7872a90-bf1e-43a6-91d7-66bf5b028b12 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] 10.222.0.60 "GET /compute/v2.1/servers/6c2ed037-84ac-463b-a42d-01a03532cc43" status: 200 len: 1216 microversion: 2.1 time: 0.116036 Oct 18 15:39:33.235982 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1684/3344] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:33 2022] GET /compute/v2.1/servers/6c2ed037-84ac-463b-a42d-01a03532cc43 => generated 1216 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:33.246614 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f69cb70a-6a47-4a6c-87aa-ca03c4d6f98a tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.4.50"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:39:33.306221 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-92056b42-9d21-4c62-8067-9280443b44b4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "POST /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57/action" status: 202 len: 0 microversion: 2.1 time: 0.253770 Oct 18 15:39:33.307736 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1661/3345] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:39:33 2022] POST /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:39:33.314972 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-33b56abd-0ce1-4deb-a9b0-960e78846690 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '.version_select at 0x7f7c3c5ff430>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:33.342521 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-33b56abd-0ce1-4deb-a9b0-960e78846690 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1774961777" status: 202 len: 0 microversion: 2.1 time: 0.033193 Oct 18 15:39:33.359077 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1662/3346] 10.222.0.60 () {58 vars in 1221 bytes} [Tue Oct 18 15:39:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1774961777 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:39:33.371846 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-98bffc84-f271-45b8-bcd4-6195c1eaca40 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1707877175", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "670a85ee-2ce6-476a-bad3-558d8003ee5a"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:39:33.514331 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-98bffc84-f271-45b8-bcd4-6195c1eaca40 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] validate_networks() for [('670a85ee-2ce6-476a-bad3-558d8003ee5a', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:39:33.550635 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f69cb70a-6a47-4a6c-87aa-ca03c4d6f98a tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] [instance: 7ae6ac1e-7345-4096-9816-a53e90d88447] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:33.575308 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f69cb70a-6a47-4a6c-87aa-ca03c4d6f98a tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:33.575916 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f69cb70a-6a47-4a6c-87aa-ca03c4d6f98a tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:33.576548 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f69cb70a-6a47-4a6c-87aa-ca03c4d6f98a tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:33.579210 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f69cb70a-6a47-4a6c-87aa-ca03c4d6f98a tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:33.580027 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f69cb70a-6a47-4a6c-87aa-ca03c4d6f98a tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:33.580641 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f69cb70a-6a47-4a6c-87aa-ca03c4d6f98a tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:34.248603 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f69cb70a-6a47-4a6c-87aa-ca03c4d6f98a tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "refresh_cache-7ae6ac1e-7345-4096-9816-a53e90d88447" {{(pid=120405) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 18 15:39:34.250292 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f69cb70a-6a47-4a6c-87aa-ca03c4d6f98a tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquired lock "refresh_cache-7ae6ac1e-7345-4096-9816-a53e90d88447" {{(pid=120405) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 18 15:39:34.835583 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-98bffc84-f271-45b8-bcd4-6195c1eaca40 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:39:34.836151 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-98bffc84-f271-45b8-bcd4-6195c1eaca40 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:39:34.836479 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-98bffc84-f271-45b8-bcd4-6195c1eaca40 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:39:34.837204 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-98bffc84-f271-45b8-bcd4-6195c1eaca40 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:39:34.837802 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-98bffc84-f271-45b8-bcd4-6195c1eaca40 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:39:34.848077 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98bffc84-f271-45b8-bcd4-6195c1eaca40 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:34.848874 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98bffc84-f271-45b8-bcd4-6195c1eaca40 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:34.849003 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98bffc84-f271-45b8-bcd4-6195c1eaca40 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:34.849725 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98bffc84-f271-45b8-bcd4-6195c1eaca40 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:34.850426 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98bffc84-f271-45b8-bcd4-6195c1eaca40 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:34.851128 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98bffc84-f271-45b8-bcd4-6195c1eaca40 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:34.876454 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-98bffc84-f271-45b8-bcd4-6195c1eaca40 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Getting quotas for project 04fd51d598a04ff7a909b3ced951dea8. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:39:34.883460 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-98bffc84-f271-45b8-bcd4-6195c1eaca40 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Getting quotas for user 5309baeeec484df194123d22779b0255 and project 04fd51d598a04ff7a909b3ced951dea8. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:39:34.893434 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:39:34.898682 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-98bffc84-f271-45b8-bcd4-6195c1eaca40 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:39:34.907950 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-98bffc84-f271-45b8-bcd4-6195c1eaca40 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 60621af7-3f40-45ac-8e96-2a2f7444d372] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:39:35.000658 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-98bffc84-f271-45b8-bcd4-6195c1eaca40 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.640243 Oct 18 15:39:35.006492 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1663/3347] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:39:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:39:35.014854 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-21dc8b27-651a-4615-bd7f-c1f0687d867c req-721f0b00-ed77-4532-9705-cec14f024b3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7f435f2-096a-4c79-b5f4-378c1e8b4e3e", "tag": "a0ae55c0-7832-4d00-a7a4-ef21a021e818"}, {"server_uuid": "2059ec7e-ef9b-4eb6-af19-34b2bd09e44a", "name": "network-vif-deleted", "tag": "b98e9e22-f73c-442c-91b4-ae56414e19d7"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:39:35.030097 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-21dc8b27-651a-4615-bd7f-c1f0687d867c req-721f0b00-ed77-4532-9705-cec14f024b3d service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:35.031094 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-21dc8b27-651a-4615-bd7f-c1f0687d867c req-721f0b00-ed77-4532-9705-cec14f024b3d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:35.031094 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-21dc8b27-651a-4615-bd7f-c1f0687d867c req-721f0b00-ed77-4532-9705-cec14f024b3d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:35.045920 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-21dc8b27-651a-4615-bd7f-c1f0687d867c req-721f0b00-ed77-4532-9705-cec14f024b3d service nova] Creating event network-changed:a0ae55c0-7832-4d00-a7a4-ef21a021e818 for instance a7f435f2-096a-4c79-b5f4-378c1e8b4e3e on n-h2-853682-5 Oct 18 15:39:35.046603 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-21dc8b27-651a-4615-bd7f-c1f0687d867c req-721f0b00-ed77-4532-9705-cec14f024b3d service nova] Creating event network-vif-deleted:b98e9e22-f73c-442c-91b4-ae56414e19d7 for instance 2059ec7e-ef9b-4eb6-af19-34b2bd09e44a on n-h1-853682-5 Oct 18 15:39:35.058454 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-21dc8b27-651a-4615-bd7f-c1f0687d867c req-721f0b00-ed77-4532-9705-cec14f024b3d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.050438 Oct 18 15:39:35.059369 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1664/3348] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:39:35.064937 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4d8615ef-726e-46d5-bc52-fce8baada79c tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:35.065764 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4d8615ef-726e-46d5-bc52-fce8baada79c tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: d280f396-df42-482a-b0c1-9a8a9b608f57] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:35.082131 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d8615ef-726e-46d5-bc52-fce8baada79c tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:35.083167 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d8615ef-726e-46d5-bc52-fce8baada79c tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:35.083779 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d8615ef-726e-46d5-bc52-fce8baada79c tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:35.085151 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d8615ef-726e-46d5-bc52-fce8baada79c tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:35.086455 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d8615ef-726e-46d5-bc52-fce8baada79c tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:35.088222 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d8615ef-726e-46d5-bc52-fce8baada79c tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:35.919927 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4d8615ef-726e-46d5-bc52-fce8baada79c tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:35.928369 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4d8615ef-726e-46d5-bc52-fce8baada79c tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57" status: 200 len: 1470 microversion: 2.1 time: 0.867858 Oct 18 15:39:35.929254 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1665/3349] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:35 2022] GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57 => generated 1470 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:35.933529 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-10b746ac-139d-4ab9-90b0-4241bbee5dfb tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:35.934133 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-10b746ac-139d-4ab9-90b0-4241bbee5dfb tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] [instance: a7f435f2-096a-4c79-b5f4-378c1e8b4e3e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:35.940087 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10b746ac-139d-4ab9-90b0-4241bbee5dfb tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:35.940737 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10b746ac-139d-4ab9-90b0-4241bbee5dfb tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:35.942672 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10b746ac-139d-4ab9-90b0-4241bbee5dfb tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:35.943585 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10b746ac-139d-4ab9-90b0-4241bbee5dfb tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:35.944210 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10b746ac-139d-4ab9-90b0-4241bbee5dfb tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:35.944638 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10b746ac-139d-4ab9-90b0-4241bbee5dfb tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:35.963498 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=94,nova_cell1:UPDATE=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:39:36.205024 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-10b746ac-139d-4ab9-90b0-4241bbee5dfb tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5a4b02c2a74519baa305e3b7659519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504166c44064437ca4e25acd180bea8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:36.216170 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-10b746ac-139d-4ab9-90b0-4241bbee5dfb tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] 10.222.0.60 "GET /compute/v2.1/servers/a7f435f2-096a-4c79-b5f4-378c1e8b4e3e" status: 200 len: 1313 microversion: 2.1 time: 0.286019 Oct 18 15:39:36.217077 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1666/3350] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:35 2022] GET /compute/v2.1/servers/a7f435f2-096a-4c79-b5f4-378c1e8b4e3e => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:36.223584 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ce999b4e-8ec1-446e-8fdf-2cae03ea4f11 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:36.224201 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ce999b4e-8ec1-446e-8fdf-2cae03ea4f11 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:36.230360 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce999b4e-8ec1-446e-8fdf-2cae03ea4f11 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:36.231622 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce999b4e-8ec1-446e-8fdf-2cae03ea4f11 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:36.232211 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce999b4e-8ec1-446e-8fdf-2cae03ea4f11 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:36.232974 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce999b4e-8ec1-446e-8fdf-2cae03ea4f11 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:36.233440 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce999b4e-8ec1-446e-8fdf-2cae03ea4f11 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:36.233868 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce999b4e-8ec1-446e-8fdf-2cae03ea4f11 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:36.472787 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-f69cb70a-6a47-4a6c-87aa-ca03c4d6f98a tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] [instance: 7ae6ac1e-7345-4096-9816-a53e90d88447] Building network info cache for instance {{(pid=120405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}} Oct 18 15:39:36.689022 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ce999b4e-8ec1-446e-8fdf-2cae03ea4f11 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:36.705727 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ce999b4e-8ec1-446e-8fdf-2cae03ea4f11 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:36.707607 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ce999b4e-8ec1-446e-8fdf-2cae03ea4f11 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:36.709184 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ce999b4e-8ec1-446e-8fdf-2cae03ea4f11 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 200 len: 1880 microversion: 2.32 time: 0.489580 Oct 18 15:39:36.710574 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1667/3351] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:39:36 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 1880 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:39:36.715323 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a65e4fde-5660-435f-bd59-069cdb388777 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:36.716105 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a65e4fde-5660-435f-bd59-069cdb388777 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] [instance: 6c2ed037-84ac-463b-a42d-01a03532cc43] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:36.723351 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a65e4fde-5660-435f-bd59-069cdb388777 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:36.723907 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a65e4fde-5660-435f-bd59-069cdb388777 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:36.724398 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a65e4fde-5660-435f-bd59-069cdb388777 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:36.725387 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a65e4fde-5660-435f-bd59-069cdb388777 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:36.725678 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a65e4fde-5660-435f-bd59-069cdb388777 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:36.726169 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a65e4fde-5660-435f-bd59-069cdb388777 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:36.851568 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a65e4fde-5660-435f-bd59-069cdb388777 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386f58c6593d43d2829e08fbdb9ed769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e75e5c7ef1b48cfb696da32fa30b845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:36.859819 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a65e4fde-5660-435f-bd59-069cdb388777 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] 10.222.0.60 "GET /compute/v2.1/servers/6c2ed037-84ac-463b-a42d-01a03532cc43" status: 200 len: 1274 microversion: 2.1 time: 0.147943 Oct 18 15:39:36.874107 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1668/3352] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:36 2022] GET /compute/v2.1/servers/6c2ed037-84ac-463b-a42d-01a03532cc43 => generated 1274 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:36.881349 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ec16781a-1d21-45e6-b337-dfd1031965c3 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Action: 'create', calling method: .version_select at 0x7f7c3c53eb80>, body: {"keypair": {"name": "tempest-keypair-1024316650", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEK6AdeCFXxjxGCaW2onmlId8E6FWrCCSlMWLKfkjgDbJzRy0SRRkPpi0IX5PIlfu09y18saP85cP/1VFiK4YEHd/2VBszyz/gPTt/Rtk2JQUKiM6g3mrTbJXYgWz8ToAQ=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:39:36.898844 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-ec16781a-1d21-45e6-b337-dfd1031965c3 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Getting quotas for project a5b55fd6668b481b8c578983dc655785. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:39:36.904849 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-ec16781a-1d21-45e6-b337-dfd1031965c3 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Getting quotas for user efec3b4b5b1c46bd9d2c0efa68f86979 and project a5b55fd6668b481b8c578983dc655785. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:39:36.941573 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ec16781a-1d21-45e6-b337-dfd1031965c3 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.065317 Oct 18 15:39:36.941573 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1669/3353] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Oct 18 15:39:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:39:36.948903 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4c7b89a1-f695-4247-9933-0e1c5ee7474c tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:36.949651 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4c7b89a1-f695-4247-9933-0e1c5ee7474c tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 60621af7-3f40-45ac-8e96-2a2f7444d372] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:36.958065 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c7b89a1-f695-4247-9933-0e1c5ee7474c tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:36.958482 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c7b89a1-f695-4247-9933-0e1c5ee7474c tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:36.959040 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c7b89a1-f695-4247-9933-0e1c5ee7474c tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:36.959753 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c7b89a1-f695-4247-9933-0e1c5ee7474c tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:36.960286 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c7b89a1-f695-4247-9933-0e1c5ee7474c tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:36.960735 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c7b89a1-f695-4247-9933-0e1c5ee7474c tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:37.715076 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4c7b89a1-f695-4247-9933-0e1c5ee7474c tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:37.723281 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4c7b89a1-f695-4247-9933-0e1c5ee7474c tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/60621af7-3f40-45ac-8e96-2a2f7444d372" status: 200 len: 1315 microversion: 2.1 time: 0.780851 Oct 18 15:39:37.727793 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1670/3354] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:36 2022] GET /compute/v2.1/servers/60621af7-3f40-45ac-8e96-2a2f7444d372 => generated 1315 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:37.734293 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-68a7eb08-e5b4-4a3e-94a6-297dc877902a tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:37.738694 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-68a7eb08-e5b4-4a3e-94a6-297dc877902a tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: d280f396-df42-482a-b0c1-9a8a9b608f57] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:37.756322 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68a7eb08-e5b4-4a3e-94a6-297dc877902a tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:37.757123 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68a7eb08-e5b4-4a3e-94a6-297dc877902a tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:37.757736 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68a7eb08-e5b4-4a3e-94a6-297dc877902a tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:37.759173 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68a7eb08-e5b4-4a3e-94a6-297dc877902a tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:37.759812 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68a7eb08-e5b4-4a3e-94a6-297dc877902a tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:37.760393 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68a7eb08-e5b4-4a3e-94a6-297dc877902a tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:38.527213 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-68a7eb08-e5b4-4a3e-94a6-297dc877902a tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:38.542086 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-68a7eb08-e5b4-4a3e-94a6-297dc877902a tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57" status: 200 len: 1470 microversion: 2.1 time: 0.813166 Oct 18 15:39:38.543473 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1671/3355] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:37 2022] GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57 => generated 1470 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:38.549930 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-30419a6f-fa8b-4f60-90f1-9b3e9a1a9630 req-ff37d57e-cde4-4fc3-8bfc-86facc9ab6f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ae6ac1e-7345-4096-9816-a53e90d88447", "tag": "860075d2-73a1-49ad-a68a-e236bf779147"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:39:38.552099 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-f69cb70a-6a47-4a6c-87aa-ca03c4d6f98a tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] [instance: 7ae6ac1e-7345-4096-9816-a53e90d88447] Updating instance_info_cache with network_info: [{"id": "860075d2-73a1-49ad-a68a-e236bf779147", "address": "fa:16:3e:cc:d7:e2", "network": {"id": "1d57134f-a7f7-40a2-9b98-ada13384a5ff", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-955016413-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c1a84f93ce8049c3a20c3b835f28100f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap860075d2-73", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 18 15:39:38.564047 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-30419a6f-fa8b-4f60-90f1-9b3e9a1a9630 req-ff37d57e-cde4-4fc3-8bfc-86facc9ab6f9 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:38.565183 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-30419a6f-fa8b-4f60-90f1-9b3e9a1a9630 req-ff37d57e-cde4-4fc3-8bfc-86facc9ab6f9 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:38.566071 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-30419a6f-fa8b-4f60-90f1-9b3e9a1a9630 req-ff37d57e-cde4-4fc3-8bfc-86facc9ab6f9 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:38.578419 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f69cb70a-6a47-4a6c-87aa-ca03c4d6f98a tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Releasing lock "refresh_cache-7ae6ac1e-7345-4096-9816-a53e90d88447" {{(pid=120405) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 18 15:39:38.579634 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f69cb70a-6a47-4a6c-87aa-ca03c4d6f98a tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] 10.222.0.60 "POST /compute/v2.1/servers/7ae6ac1e-7345-4096-9816-a53e90d88447/action" status: 202 len: 0 microversion: 2.1 time: 5.342593 Oct 18 15:39:38.584830 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1685/3356] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:39:33 2022] POST /compute/v2.1/servers/7ae6ac1e-7345-4096-9816-a53e90d88447/action => generated 0 bytes in 5347 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 18 15:39:38.585658 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-30419a6f-fa8b-4f60-90f1-9b3e9a1a9630 req-ff37d57e-cde4-4fc3-8bfc-86facc9ab6f9 service nova] Creating event network-changed:860075d2-73a1-49ad-a68a-e236bf779147 for instance 7ae6ac1e-7345-4096-9816-a53e90d88447 on n-h2-853682-5 Oct 18 15:39:38.592319 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-30419a6f-fa8b-4f60-90f1-9b3e9a1a9630 req-ff37d57e-cde4-4fc3-8bfc-86facc9ab6f9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046956 Oct 18 15:39:38.593644 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1672/3357] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:39:38.594524 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b62f133a-883d-46df-b5ee-6bfb2f5e2d4e tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:38.595153 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b62f133a-883d-46df-b5ee-6bfb2f5e2d4e tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] [instance: a7f435f2-096a-4c79-b5f4-378c1e8b4e3e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:38.606165 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fafa1933-0460-4ce2-9125-7955a5ac83cb tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:38.606968 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fafa1933-0460-4ce2-9125-7955a5ac83cb tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:38.617596 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fafa1933-0460-4ce2-9125-7955a5ac83cb tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:38.618450 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fafa1933-0460-4ce2-9125-7955a5ac83cb tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:38.619205 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fafa1933-0460-4ce2-9125-7955a5ac83cb tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:38.621423 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fafa1933-0460-4ce2-9125-7955a5ac83cb tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:38.622428 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fafa1933-0460-4ce2-9125-7955a5ac83cb tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:38.623349 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fafa1933-0460-4ce2-9125-7955a5ac83cb tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:38.625450 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b62f133a-883d-46df-b5ee-6bfb2f5e2d4e tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:38.626483 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b62f133a-883d-46df-b5ee-6bfb2f5e2d4e tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:38.627166 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b62f133a-883d-46df-b5ee-6bfb2f5e2d4e tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:38.628078 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b62f133a-883d-46df-b5ee-6bfb2f5e2d4e tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:38.629679 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b62f133a-883d-46df-b5ee-6bfb2f5e2d4e tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:38.630322 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b62f133a-883d-46df-b5ee-6bfb2f5e2d4e tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:39.281128 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b62f133a-883d-46df-b5ee-6bfb2f5e2d4e tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5a4b02c2a74519baa305e3b7659519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504166c44064437ca4e25acd180bea8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:39.283099 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fafa1933-0460-4ce2-9125-7955a5ac83cb tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:39.309577 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b62f133a-883d-46df-b5ee-6bfb2f5e2d4e tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] 10.222.0.60 "GET /compute/v2.1/servers/a7f435f2-096a-4c79-b5f4-378c1e8b4e3e" status: 200 len: 1313 microversion: 2.1 time: 0.723630 Oct 18 15:39:39.330321 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1686/3358] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:38 2022] GET /compute/v2.1/servers/a7f435f2-096a-4c79-b5f4-378c1e8b4e3e => generated 1313 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:39.330568 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fafa1933-0460-4ce2-9125-7955a5ac83cb tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:39.330568 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fafa1933-0460-4ce2-9125-7955a5ac83cb tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:39.330756 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2a5942e5-70cb-4d1f-8e64-ad0298844e0b tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:39.330756 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2a5942e5-70cb-4d1f-8e64-ad0298844e0b tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] [instance: 6c2ed037-84ac-463b-a42d-01a03532cc43] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:39.330931 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fafa1933-0460-4ce2-9125-7955a5ac83cb tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 200 len: 1880 microversion: 2.32 time: 0.730042 Oct 18 15:39:39.330931 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1673/3359] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:39:38 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 1880 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:39:39.339524 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a5942e5-70cb-4d1f-8e64-ad0298844e0b tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:39.340025 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a5942e5-70cb-4d1f-8e64-ad0298844e0b tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:39.340465 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a5942e5-70cb-4d1f-8e64-ad0298844e0b tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:39.342752 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-3ab39071-f66a-4555-8a3e-483bbb66d4a5 req-90891244-e228-4b65-bded-45830511e679 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60621af7-3f40-45ac-8e96-2a2f7444d372", "tag": "c2c6823d-9a8e-4529-bfd0-b37f8897ffd8"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:39:39.348381 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a5942e5-70cb-4d1f-8e64-ad0298844e0b tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:39.349041 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a5942e5-70cb-4d1f-8e64-ad0298844e0b tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:39.349489 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a5942e5-70cb-4d1f-8e64-ad0298844e0b tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:39.367305 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3ab39071-f66a-4555-8a3e-483bbb66d4a5 req-90891244-e228-4b65-bded-45830511e679 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:39.367792 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3ab39071-f66a-4555-8a3e-483bbb66d4a5 req-90891244-e228-4b65-bded-45830511e679 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:39.370881 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3ab39071-f66a-4555-8a3e-483bbb66d4a5 req-90891244-e228-4b65-bded-45830511e679 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:39.400064 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-3ab39071-f66a-4555-8a3e-483bbb66d4a5 req-90891244-e228-4b65-bded-45830511e679 service nova] Creating event network-changed:c2c6823d-9a8e-4529-bfd0-b37f8897ffd8 for instance 60621af7-3f40-45ac-8e96-2a2f7444d372 on n-h1-853682-5 Oct 18 15:39:39.410581 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-3ab39071-f66a-4555-8a3e-483bbb66d4a5 req-90891244-e228-4b65-bded-45830511e679 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080514 Oct 18 15:39:39.412216 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1674/3360] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:39:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:39:39.421656 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-28fa22b8-701d-42e1-a8d9-0f47f2f0dab0 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:39.423357 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-28fa22b8-701d-42e1-a8d9-0f47f2f0dab0 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] [instance: 64730348-4d42-40d3-aeac-a4aad6c10d67] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:39.439302 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-28fa22b8-701d-42e1-a8d9-0f47f2f0dab0 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:39.440154 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-28fa22b8-701d-42e1-a8d9-0f47f2f0dab0 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:39.442450 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-28fa22b8-701d-42e1-a8d9-0f47f2f0dab0 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:39.443387 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-28fa22b8-701d-42e1-a8d9-0f47f2f0dab0 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:39.444230 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-28fa22b8-701d-42e1-a8d9-0f47f2f0dab0 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:39.445526 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-28fa22b8-701d-42e1-a8d9-0f47f2f0dab0 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:39.479535 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-28fa22b8-701d-42e1-a8d9-0f47f2f0dab0 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] HTTP exception thrown: Instance 64730348-4d42-40d3-aeac-a4aad6c10d67 could not be found. Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-28fa22b8-701d-42e1-a8d9-0f47f2f0dab0 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Request method failure captured: Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/64730348-4d42-40d3-aeac-a4aad6c10d67 HTTP/1.1 Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTshh4shgJRRUGfl054dCP92HNXD-3AuBQVLlkCdoDcg4dEMB_etKwqWffO785IBt6x2gtCFDm8GKYIDSnlaC59ZTog8Zltp6V1yZhuNY9smHKUeoq9I0E61kG6JhA1CA-eUuBZFnJO4JZLSzO3M0NBbAacDi_4S6L8ZfqGjaPSuVUN4 Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: c1a84f93ce8049c3a20c3b835f28100f Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-2136196464 Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c1a84f93ce8049c3a20c3b835f28100f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c1a84f93ce8049c3a20c3b835f28100f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c1a84f93ce8049c3a20c3b835f28100f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c1a84f93ce8049c3a20c3b835f28100f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-2136196464 Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: c1a84f93ce8049c3a20c3b835f28100f Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-2136196464 Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-FloatingIPsAssociationTestJSON-2136196464-project Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 1e7ebe0c265144769931ca6262be8860 Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-2136196464-project Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 64730348-4d42-40d3-aeac-a4aad6c10d67 could not be found. Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '64730348-4d42-40d3-aeac-a4aad6c10d67'} Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64730348-4d42-40d3-aeac-a4aad6c10d67 could not be found. Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:39:39.484630 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:39:39.493829 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64730348-4d42-40d3-aeac-a4aad6c10d67 could not be found. Oct 18 15:39:39.493829 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:39:39.493829 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:39:39.493829 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:39:39.493829 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:39:39.493829 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:39:39.493829 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:39:39.493829 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:39:39.493829 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:39:39.493829 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64730348-4d42-40d3-aeac-a4aad6c10d67 could not be found. Oct 18 15:39:39.493829 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:39:39.498383 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-28fa22b8-701d-42e1-a8d9-0f47f2f0dab0 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Returning 404 to user: Instance 64730348-4d42-40d3-aeac-a4aad6c10d67 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:39:39.499506 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-28fa22b8-701d-42e1-a8d9-0f47f2f0dab0 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] 10.222.0.60 "DELETE /compute/v2.1/servers/64730348-4d42-40d3-aeac-a4aad6c10d67" status: 404 len: 111 microversion: 2.1 time: 0.085957 Oct 18 15:39:39.501939 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1675/3361] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:39:39 2022] DELETE /compute/v2.1/servers/64730348-4d42-40d3-aeac-a4aad6c10d67 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:39:39.510426 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7d7a6a8b-f023-44ef-a374-64566c97ee4e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:39.511550 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7d7a6a8b-f023-44ef-a374-64566c97ee4e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 60621af7-3f40-45ac-8e96-2a2f7444d372] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:39.524118 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d7a6a8b-f023-44ef-a374-64566c97ee4e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:39.525425 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d7a6a8b-f023-44ef-a374-64566c97ee4e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:39.527462 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d7a6a8b-f023-44ef-a374-64566c97ee4e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:39.530020 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d7a6a8b-f023-44ef-a374-64566c97ee4e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:39.530880 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d7a6a8b-f023-44ef-a374-64566c97ee4e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:39.531530 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d7a6a8b-f023-44ef-a374-64566c97ee4e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:39.877580 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2a5942e5-70cb-4d1f-8e64-ad0298844e0b tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386f58c6593d43d2829e08fbdb9ed769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e75e5c7ef1b48cfb696da32fa30b845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:39.886281 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2a5942e5-70cb-4d1f-8e64-ad0298844e0b tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] 10.222.0.60 "GET /compute/v2.1/servers/6c2ed037-84ac-463b-a42d-01a03532cc43" status: 200 len: 1316 microversion: 2.1 time: 0.569705 Oct 18 15:39:39.887394 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1687/3362] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:39 2022] GET /compute/v2.1/servers/6c2ed037-84ac-463b-a42d-01a03532cc43 => generated 1316 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:39.892140 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-9258984e-ce5d-498f-ac81-346b4db35cb6 req-df194e3a-da18-44ee-b38c-8da1acc52e14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf8f81da-4aa0-498d-af1e-c036238f065d", "name": "network-vif-plugged", "status": "completed", "tag": "728b9ef4-fe70-49aa-a715-30bd7cc7b07b"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:39:39.902802 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-9258984e-ce5d-498f-ac81-346b4db35cb6 req-df194e3a-da18-44ee-b38c-8da1acc52e14 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:39.903489 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-9258984e-ce5d-498f-ac81-346b4db35cb6 req-df194e3a-da18-44ee-b38c-8da1acc52e14 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:39.904125 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-9258984e-ce5d-498f-ac81-346b4db35cb6 req-df194e3a-da18-44ee-b38c-8da1acc52e14 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:39.919359 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-9258984e-ce5d-498f-ac81-346b4db35cb6 req-df194e3a-da18-44ee-b38c-8da1acc52e14 service nova] Creating event network-vif-plugged:728b9ef4-fe70-49aa-a715-30bd7cc7b07b for instance cf8f81da-4aa0-498d-af1e-c036238f065d on n-h2-853682-5 Oct 18 15:39:39.936415 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-9258984e-ce5d-498f-ac81-346b4db35cb6 req-df194e3a-da18-44ee-b38c-8da1acc52e14 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047127 Oct 18 15:39:39.937721 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1688/3363] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:39:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:39:39.945906 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d39a7982-627e-4a26-95f1-4fa569c5e498 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:39.946841 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d39a7982-627e-4a26-95f1-4fa569c5e498 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] [instance: 64730348-4d42-40d3-aeac-a4aad6c10d67] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:39.965990 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d39a7982-627e-4a26-95f1-4fa569c5e498 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:39.966618 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d39a7982-627e-4a26-95f1-4fa569c5e498 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:39.967616 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d39a7982-627e-4a26-95f1-4fa569c5e498 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:39.969432 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d39a7982-627e-4a26-95f1-4fa569c5e498 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:39.970433 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d39a7982-627e-4a26-95f1-4fa569c5e498 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:39.971539 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d39a7982-627e-4a26-95f1-4fa569c5e498 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:39.990044 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-d39a7982-627e-4a26-95f1-4fa569c5e498 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] HTTP exception thrown: Instance 64730348-4d42-40d3-aeac-a4aad6c10d67 could not be found. Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d39a7982-627e-4a26-95f1-4fa569c5e498 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Request method failure captured: Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/64730348-4d42-40d3-aeac-a4aad6c10d67 HTTP/1.1 Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTshh4shgJRRUGfl054dCP92HNXD-3AuBQVLlkCdoDcg4dEMB_etKwqWffO785IBt6x2gtCFDm8GKYIDSnlaC59ZTog8Zltp6V1yZhuNY9smHKUeoq9I0E61kG6JhA1CA-eUuBZFnJO4JZLSzO3M0NBbAacDi_4S6L8ZfqGjaPSuVUN4 Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: c1a84f93ce8049c3a20c3b835f28100f Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-2136196464 Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c1a84f93ce8049c3a20c3b835f28100f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c1a84f93ce8049c3a20c3b835f28100f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c1a84f93ce8049c3a20c3b835f28100f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c1a84f93ce8049c3a20c3b835f28100f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-2136196464 Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: c1a84f93ce8049c3a20c3b835f28100f Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-2136196464 Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-FloatingIPsAssociationTestJSON-2136196464-project Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 1e7ebe0c265144769931ca6262be8860 Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-2136196464-project Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 64730348-4d42-40d3-aeac-a4aad6c10d67 could not be found. Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '64730348-4d42-40d3-aeac-a4aad6c10d67'} Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64730348-4d42-40d3-aeac-a4aad6c10d67 could not be found. Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64730348-4d42-40d3-aeac-a4aad6c10d67 could not be found. Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:39:39.992017 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:39:39.996940 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:39:39.996940 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:39:39.996940 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:39:39.996940 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:39:39.996940 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:39:39.996940 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:39:39.996940 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64730348-4d42-40d3-aeac-a4aad6c10d67 could not be found. Oct 18 15:39:39.996940 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:39:39.998701 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d39a7982-627e-4a26-95f1-4fa569c5e498 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Returning 404 to user: Instance 64730348-4d42-40d3-aeac-a4aad6c10d67 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:39:39.999727 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d39a7982-627e-4a26-95f1-4fa569c5e498 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] 10.222.0.60 "GET /compute/v2.1/servers/64730348-4d42-40d3-aeac-a4aad6c10d67" status: 404 len: 111 microversion: 2.1 time: 0.060402 Oct 18 15:39:40.000833 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1689/3364] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:39 2022] GET /compute/v2.1/servers/64730348-4d42-40d3-aeac-a4aad6c10d67 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:39:40.141158 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8af6fc32-c747-45cf-aa92-12d553dd2521 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:40.141793 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8af6fc32-c747-45cf-aa92-12d553dd2521 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: d280f396-df42-482a-b0c1-9a8a9b608f57] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:40.147815 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8af6fc32-c747-45cf-aa92-12d553dd2521 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:40.148505 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8af6fc32-c747-45cf-aa92-12d553dd2521 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:40.149164 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8af6fc32-c747-45cf-aa92-12d553dd2521 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:40.150052 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8af6fc32-c747-45cf-aa92-12d553dd2521 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:40.150688 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8af6fc32-c747-45cf-aa92-12d553dd2521 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:40.151430 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8af6fc32-c747-45cf-aa92-12d553dd2521 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:40.189346 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7d7a6a8b-f023-44ef-a374-64566c97ee4e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:40.199094 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7d7a6a8b-f023-44ef-a374-64566c97ee4e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/60621af7-3f40-45ac-8e96-2a2f7444d372" status: 200 len: 1315 microversion: 2.1 time: 0.695895 Oct 18 15:39:40.200325 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1676/3365] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:39 2022] GET /compute/v2.1/servers/60621af7-3f40-45ac-8e96-2a2f7444d372 => generated 1315 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:40.206883 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0760b650-d4d5-4edb-846a-888b0438bf4f tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Calling method '.version_select at 0x7f7c3c65faf0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:40.640906 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8af6fc32-c747-45cf-aa92-12d553dd2521 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:40.648619 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8af6fc32-c747-45cf-aa92-12d553dd2521 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57" status: 200 len: 1470 microversion: 2.1 time: 0.646483 Oct 18 15:39:40.649216 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1690/3366] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:40 2022] GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57 => generated 1470 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:40.671210 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-eebedf48-d8c0-4d84-9587-d4a7a7abb004 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-474510983", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ccd513cb-fa43-49a2-9672-944a34d86625"}], "security_groups": [{"name": "tempest-securitygroup--1430508111"}], "key_name": "tempest-keypair-1024316650", "user_data": "}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:39:40.957722 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-eebedf48-d8c0-4d84-9587-d4a7a7abb004 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] validate_networks() for [('ccd513cb-fa43-49a2-9672-944a34d86625', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:39:42.153153 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:39:42.350272 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-eebedf48-d8c0-4d84-9587-d4a7a7abb004 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:39:42.350896 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-eebedf48-d8c0-4d84-9587-d4a7a7abb004 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:39:42.351545 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-eebedf48-d8c0-4d84-9587-d4a7a7abb004 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:39:42.351961 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-eebedf48-d8c0-4d84-9587-d4a7a7abb004 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:39:42.352410 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-eebedf48-d8c0-4d84-9587-d4a7a7abb004 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:39:42.365231 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eebedf48-d8c0-4d84-9587-d4a7a7abb004 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:42.365725 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eebedf48-d8c0-4d84-9587-d4a7a7abb004 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:42.366387 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eebedf48-d8c0-4d84-9587-d4a7a7abb004 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:42.367214 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eebedf48-d8c0-4d84-9587-d4a7a7abb004 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:42.367674 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eebedf48-d8c0-4d84-9587-d4a7a7abb004 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:42.368104 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eebedf48-d8c0-4d84-9587-d4a7a7abb004 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:42.386566 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-eebedf48-d8c0-4d84-9587-d4a7a7abb004 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Getting quotas for project a5b55fd6668b481b8c578983dc655785. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:39:42.392147 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-eebedf48-d8c0-4d84-9587-d4a7a7abb004 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Getting quotas for user efec3b4b5b1c46bd9d2c0efa68f86979 and project a5b55fd6668b481b8c578983dc655785. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:39:42.405714 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-eebedf48-d8c0-4d84-9587-d4a7a7abb004 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:39:42.408088 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-eebedf48-d8c0-4d84-9587-d4a7a7abb004 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 4a23be5e-9334-4385-9476-4bbd81995002] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:39:42.421007 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:39:42.428413 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0760b650-d4d5-4edb-846a-888b0438bf4f tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] 10.222.0.60 "DELETE /compute/v2.1/os-floating-ips/a00264ad-6e1f-4351-9b56-b10d2c2fbcf5" status: 202 len: 0 microversion: 2.1 time: 2.226640 Oct 18 15:39:42.433531 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1677/3367] 10.222.0.60 () {58 vars in 1263 bytes} [Tue Oct 18 15:39:40 2022] DELETE /compute/v2.1/os-floating-ips/a00264ad-6e1f-4351-9b56-b10d2c2fbcf5 => generated 0 bytes in 2232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:39:42.440674 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6927bc66-a04f-41aa-bf20-fc2033879983 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:42.442085 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6927bc66-a04f-41aa-bf20-fc2033879983 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] [instance: a7f435f2-096a-4c79-b5f4-378c1e8b4e3e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:42.451893 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6927bc66-a04f-41aa-bf20-fc2033879983 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:42.452377 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6927bc66-a04f-41aa-bf20-fc2033879983 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:42.452834 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6927bc66-a04f-41aa-bf20-fc2033879983 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:42.453540 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6927bc66-a04f-41aa-bf20-fc2033879983 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:42.454245 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6927bc66-a04f-41aa-bf20-fc2033879983 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:42.454852 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6927bc66-a04f-41aa-bf20-fc2033879983 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:42.463423 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-eebedf48-d8c0-4d84-9587-d4a7a7abb004 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.800723 Oct 18 15:39:42.464422 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1691/3368] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:39:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 1802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:39:42.474760 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-151d7850-8e34-4c90-a313-c1d88e7681e3 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:42.475374 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-151d7850-8e34-4c90-a313-c1d88e7681e3 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:42.482088 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-151d7850-8e34-4c90-a313-c1d88e7681e3 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:42.482647 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-151d7850-8e34-4c90-a313-c1d88e7681e3 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:42.483088 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-151d7850-8e34-4c90-a313-c1d88e7681e3 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:42.483793 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-151d7850-8e34-4c90-a313-c1d88e7681e3 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:42.484251 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-151d7850-8e34-4c90-a313-c1d88e7681e3 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:42.484677 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-151d7850-8e34-4c90-a313-c1d88e7681e3 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:42.719150 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6927bc66-a04f-41aa-bf20-fc2033879983 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5a4b02c2a74519baa305e3b7659519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504166c44064437ca4e25acd180bea8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:42.727715 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6927bc66-a04f-41aa-bf20-fc2033879983 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] 10.222.0.60 "GET /compute/v2.1/servers/a7f435f2-096a-4c79-b5f4-378c1e8b4e3e" status: 200 len: 1313 microversion: 2.1 time: 0.292800 Oct 18 15:39:42.728644 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1678/3369] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:42 2022] GET /compute/v2.1/servers/a7f435f2-096a-4c79-b5f4-378c1e8b4e3e => generated 1313 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:42.733640 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3860e759-3888-47e2-bcfe-f5a5d1f4109a tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:42.734553 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3860e759-3888-47e2-bcfe-f5a5d1f4109a tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] [instance: 6c2ed037-84ac-463b-a42d-01a03532cc43] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:42.741379 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3860e759-3888-47e2-bcfe-f5a5d1f4109a tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:42.742088 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3860e759-3888-47e2-bcfe-f5a5d1f4109a tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:42.742960 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3860e759-3888-47e2-bcfe-f5a5d1f4109a tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:42.743816 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3860e759-3888-47e2-bcfe-f5a5d1f4109a tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:42.744139 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-151d7850-8e34-4c90-a313-c1d88e7681e3 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:42.744834 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3860e759-3888-47e2-bcfe-f5a5d1f4109a tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:42.745393 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3860e759-3888-47e2-bcfe-f5a5d1f4109a tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:42.753779 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-151d7850-8e34-4c90-a313-c1d88e7681e3 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:42.755952 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-151d7850-8e34-4c90-a313-c1d88e7681e3 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:42.757144 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-151d7850-8e34-4c90-a313-c1d88e7681e3 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 200 len: 1880 microversion: 2.32 time: 0.291792 Oct 18 15:39:42.757910 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1692/3370] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:39:42 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 1880 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:39:42.762499 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2f50fa8c-d690-4382-94eb-7870b2452535 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:42.763121 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2f50fa8c-d690-4382-94eb-7870b2452535 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 60621af7-3f40-45ac-8e96-2a2f7444d372] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:42.768954 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2f50fa8c-d690-4382-94eb-7870b2452535 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:42.769478 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2f50fa8c-d690-4382-94eb-7870b2452535 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:42.769917 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2f50fa8c-d690-4382-94eb-7870b2452535 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:42.770618 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2f50fa8c-d690-4382-94eb-7870b2452535 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:42.771070 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2f50fa8c-d690-4382-94eb-7870b2452535 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:42.771507 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2f50fa8c-d690-4382-94eb-7870b2452535 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:42.971438 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3860e759-3888-47e2-bcfe-f5a5d1f4109a tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386f58c6593d43d2829e08fbdb9ed769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e75e5c7ef1b48cfb696da32fa30b845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:42.976164 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2f50fa8c-d690-4382-94eb-7870b2452535 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:42.979985 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3860e759-3888-47e2-bcfe-f5a5d1f4109a tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] 10.222.0.60 "GET /compute/v2.1/servers/6c2ed037-84ac-463b-a42d-01a03532cc43" status: 200 len: 1316 microversion: 2.1 time: 0.250041 Oct 18 15:39:42.981175 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1679/3371] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:42 2022] GET /compute/v2.1/servers/6c2ed037-84ac-463b-a42d-01a03532cc43 => generated 1316 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:42.986038 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-0ef919f2-9d94-448c-999d-314f04cc691b req-fdcbbb2d-8392-4214-badd-fd8170351d29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c2ed037-84ac-463b-a42d-01a03532cc43", "tag": "6e6a8be2-7d56-46b4-83cf-fafcac566b7c"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:39:42.996072 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0ef919f2-9d94-448c-999d-314f04cc691b req-fdcbbb2d-8392-4214-badd-fd8170351d29 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:42.996867 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0ef919f2-9d94-448c-999d-314f04cc691b req-fdcbbb2d-8392-4214-badd-fd8170351d29 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:42.997025 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0ef919f2-9d94-448c-999d-314f04cc691b req-fdcbbb2d-8392-4214-badd-fd8170351d29 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:43.000187 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2f50fa8c-d690-4382-94eb-7870b2452535 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/60621af7-3f40-45ac-8e96-2a2f7444d372" status: 200 len: 1315 microversion: 2.1 time: 0.241234 Oct 18 15:39:43.001549 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1693/3372] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:42 2022] GET /compute/v2.1/servers/60621af7-3f40-45ac-8e96-2a2f7444d372 => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:43.006791 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5a3cbba2-f3c0-4c30-94eb-b334ca54d4a1 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:43.007409 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5a3cbba2-f3c0-4c30-94eb-b334ca54d4a1 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: d280f396-df42-482a-b0c1-9a8a9b608f57] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:43.014021 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5a3cbba2-f3c0-4c30-94eb-b334ca54d4a1 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:43.014547 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5a3cbba2-f3c0-4c30-94eb-b334ca54d4a1 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:43.014988 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5a3cbba2-f3c0-4c30-94eb-b334ca54d4a1 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:43.015689 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5a3cbba2-f3c0-4c30-94eb-b334ca54d4a1 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:43.016344 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5a3cbba2-f3c0-4c30-94eb-b334ca54d4a1 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:43.016776 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5a3cbba2-f3c0-4c30-94eb-b334ca54d4a1 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:43.019295 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-0ef919f2-9d94-448c-999d-314f04cc691b req-fdcbbb2d-8392-4214-badd-fd8170351d29 service nova] Creating event network-changed:6e6a8be2-7d56-46b4-83cf-fafcac566b7c for instance 6c2ed037-84ac-463b-a42d-01a03532cc43 on n-h1-853682-5 Oct 18 15:39:43.026399 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-0ef919f2-9d94-448c-999d-314f04cc691b req-fdcbbb2d-8392-4214-badd-fd8170351d29 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043599 Oct 18 15:39:43.027111 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1680/3373] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:39:43.043682 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-1da76bed-2fd1-4461-bd89-9e96077e2357 req-f945afb9-ec64-44b9-8afa-5971e5125056 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf8f81da-4aa0-498d-af1e-c036238f065d", "name": "network-vif-plugged", "status": "completed", "tag": "9959fd2b-3b15-4847-9dc1-507d84d0b4df"}, {"server_uuid": "cf8f81da-4aa0-498d-af1e-c036238f065d", "name": "network-vif-plugged", "status": "completed", "tag": "c4a0dc0d-0a7d-4afc-aa10-4271ba62b220"}, {"server_uuid": "cf8f81da-4aa0-498d-af1e-c036238f065d", "name": "network-vif-plugged", "status": "completed", "tag": "a2d084e8-8af5-402d-b5a9-a5e9b2e30a21"}, {"server_uuid": "cf8f81da-4aa0-498d-af1e-c036238f065d", "name": "network-vif-plugged", "status": "completed", "tag": "6804cdcb-ecb6-4eec-8de0-cc16a6d64f70"}, {"server_uuid": "cf8f81da-4aa0-498d-af1e-c036238f065d", "name": "network-vif-plugged", "status": "completed", "tag": "f0425d60-0a1e-42b2-b227-5934c9fcdf26"}, {"server_uuid": "cf8f81da-4aa0-498d-af1e-c036238f065d", "name": "network-vif-plugged", "status": "completed", "tag": "56a32c33-244b-49a6-ab44-eb8dae785efb"}, {"server_uuid": "a7f435f2-096a-4c79-b5f4-378c1e8b4e3e", "name": "network-vif-plugged", "status": "completed", "tag": "a0ae55c0-7832-4d00-a7a4-ef21a021e818"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:39:43.058243 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1da76bed-2fd1-4461-bd89-9e96077e2357 req-f945afb9-ec64-44b9-8afa-5971e5125056 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:43.058727 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1da76bed-2fd1-4461-bd89-9e96077e2357 req-f945afb9-ec64-44b9-8afa-5971e5125056 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:43.059158 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1da76bed-2fd1-4461-bd89-9e96077e2357 req-f945afb9-ec64-44b9-8afa-5971e5125056 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:43.072827 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-1da76bed-2fd1-4461-bd89-9e96077e2357 req-f945afb9-ec64-44b9-8afa-5971e5125056 service nova] Creating event network-vif-plugged:9959fd2b-3b15-4847-9dc1-507d84d0b4df for instance cf8f81da-4aa0-498d-af1e-c036238f065d on n-h2-853682-5 Oct 18 15:39:43.073578 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-1da76bed-2fd1-4461-bd89-9e96077e2357 req-f945afb9-ec64-44b9-8afa-5971e5125056 service nova] Creating event network-vif-plugged:c4a0dc0d-0a7d-4afc-aa10-4271ba62b220 for instance cf8f81da-4aa0-498d-af1e-c036238f065d on n-h2-853682-5 Oct 18 15:39:43.074412 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-1da76bed-2fd1-4461-bd89-9e96077e2357 req-f945afb9-ec64-44b9-8afa-5971e5125056 service nova] Creating event network-vif-plugged:a2d084e8-8af5-402d-b5a9-a5e9b2e30a21 for instance cf8f81da-4aa0-498d-af1e-c036238f065d on n-h2-853682-5 Oct 18 15:39:43.074919 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-1da76bed-2fd1-4461-bd89-9e96077e2357 req-f945afb9-ec64-44b9-8afa-5971e5125056 service nova] Creating event network-vif-plugged:6804cdcb-ecb6-4eec-8de0-cc16a6d64f70 for instance cf8f81da-4aa0-498d-af1e-c036238f065d on n-h2-853682-5 Oct 18 15:39:43.075419 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-1da76bed-2fd1-4461-bd89-9e96077e2357 req-f945afb9-ec64-44b9-8afa-5971e5125056 service nova] Creating event network-vif-plugged:f0425d60-0a1e-42b2-b227-5934c9fcdf26 for instance cf8f81da-4aa0-498d-af1e-c036238f065d on n-h2-853682-5 Oct 18 15:39:43.075913 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-1da76bed-2fd1-4461-bd89-9e96077e2357 req-f945afb9-ec64-44b9-8afa-5971e5125056 service nova] Creating event network-vif-plugged:56a32c33-244b-49a6-ab44-eb8dae785efb for instance cf8f81da-4aa0-498d-af1e-c036238f065d on n-h2-853682-5 Oct 18 15:39:43.076404 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-1da76bed-2fd1-4461-bd89-9e96077e2357 req-f945afb9-ec64-44b9-8afa-5971e5125056 service nova] Creating event network-vif-plugged:a0ae55c0-7832-4d00-a7a4-ef21a021e818 for instance a7f435f2-096a-4c79-b5f4-378c1e8b4e3e on n-h2-853682-5 Oct 18 15:39:43.084994 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-1da76bed-2fd1-4461-bd89-9e96077e2357 req-f945afb9-ec64-44b9-8afa-5971e5125056 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1209 microversion: 2.1 time: 0.056270 Oct 18 15:39:43.086475 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1681/3374] 10.222.0.60 () {64 vars in 1318 bytes} [Tue Oct 18 15:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 1209 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:43.091747 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c9832c60-f846-4e4d-b9bf-b9bdb8665d6a tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:43.092338 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c9832c60-f846-4e4d-b9bf-b9bdb8665d6a tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] [instance: 7ae6ac1e-7345-4096-9816-a53e90d88447] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:43.099381 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9832c60-f846-4e4d-b9bf-b9bdb8665d6a tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:43.099875 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9832c60-f846-4e4d-b9bf-b9bdb8665d6a tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:43.100312 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9832c60-f846-4e4d-b9bf-b9bdb8665d6a tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:43.101234 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9832c60-f846-4e4d-b9bf-b9bdb8665d6a tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:43.101698 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9832c60-f846-4e4d-b9bf-b9bdb8665d6a tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:43.102131 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9832c60-f846-4e4d-b9bf-b9bdb8665d6a tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:43.144349 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c9832c60-f846-4e4d-b9bf-b9bdb8665d6a tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] [instance: 7ae6ac1e-7345-4096-9816-a53e90d88447] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:39:43.173270 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5a3cbba2-f3c0-4c30-94eb-b334ca54d4a1 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:43.192486 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5a3cbba2-f3c0-4c30-94eb-b334ca54d4a1 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57" status: 200 len: 1470 microversion: 2.1 time: 0.187943 Oct 18 15:39:43.193668 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1694/3375] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:43 2022] GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57 => generated 1470 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:43.200962 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-78e77d8e-afc2-455b-993e-ff56b5e85f4e tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:43.201995 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-78e77d8e-afc2-455b-993e-ff56b5e85f4e tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 4a23be5e-9334-4385-9476-4bbd81995002] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:43.212378 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-78e77d8e-afc2-455b-993e-ff56b5e85f4e tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:43.213737 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-78e77d8e-afc2-455b-993e-ff56b5e85f4e tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:43.214395 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-78e77d8e-afc2-455b-993e-ff56b5e85f4e tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:43.215571 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-78e77d8e-afc2-455b-993e-ff56b5e85f4e tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:43.216185 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-78e77d8e-afc2-455b-993e-ff56b5e85f4e tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:43.216960 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-78e77d8e-afc2-455b-993e-ff56b5e85f4e tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:43.267318 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c9832c60-f846-4e4d-b9bf-b9bdb8665d6a tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7ae6ac1e-7345-4096-9816-a53e90d88447" status: 204 len: 0 microversion: 2.1 time: 0.179148 Oct 18 15:39:43.272594 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1682/3376] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:39:43 2022] DELETE /compute/v2.1/servers/7ae6ac1e-7345-4096-9816-a53e90d88447 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:39:43.282869 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-73e1ddcd-dee4-4111-96ad-67b50ad9c93e tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:43.283921 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-73e1ddcd-dee4-4111-96ad-67b50ad9c93e tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] [instance: 7ae6ac1e-7345-4096-9816-a53e90d88447] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:43.292095 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73e1ddcd-dee4-4111-96ad-67b50ad9c93e tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:43.292592 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73e1ddcd-dee4-4111-96ad-67b50ad9c93e tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:43.293065 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73e1ddcd-dee4-4111-96ad-67b50ad9c93e tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:43.293777 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73e1ddcd-dee4-4111-96ad-67b50ad9c93e tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:43.294231 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73e1ddcd-dee4-4111-96ad-67b50ad9c93e tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:43.294656 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73e1ddcd-dee4-4111-96ad-67b50ad9c93e tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:43.323643 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-78e77d8e-afc2-455b-993e-ff56b5e85f4e tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:43.332794 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-78e77d8e-afc2-455b-993e-ff56b5e85f4e tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002" status: 200 len: 1293 microversion: 2.1 time: 0.136679 Oct 18 15:39:43.333512 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1695/3377] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:43 2022] GET /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002 => generated 1293 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:43.436794 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-73e1ddcd-dee4-4111-96ad-67b50ad9c93e tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7ebe0c265144769931ca6262be8860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a84f93ce8049c3a20c3b835f28100f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:43.445475 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-73e1ddcd-dee4-4111-96ad-67b50ad9c93e tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] 10.222.0.60 "GET /compute/v2.1/servers/7ae6ac1e-7345-4096-9816-a53e90d88447" status: 200 len: 1525 microversion: 2.1 time: 0.170772 Oct 18 15:39:43.446389 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1683/3378] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:43 2022] GET /compute/v2.1/servers/7ae6ac1e-7345-4096-9816-a53e90d88447 => generated 1525 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:43.750555 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-053dc086-5c62-4f78-ab66-cbaf175aa427 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:43.751173 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-053dc086-5c62-4f78-ab66-cbaf175aa427 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] [instance: a7f435f2-096a-4c79-b5f4-378c1e8b4e3e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:43.758317 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-053dc086-5c62-4f78-ab66-cbaf175aa427 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:43.758802 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-053dc086-5c62-4f78-ab66-cbaf175aa427 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:43.759239 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-053dc086-5c62-4f78-ab66-cbaf175aa427 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:43.759933 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-053dc086-5c62-4f78-ab66-cbaf175aa427 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:43.760394 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-053dc086-5c62-4f78-ab66-cbaf175aa427 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:43.760847 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-053dc086-5c62-4f78-ab66-cbaf175aa427 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:43.783065 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f4778a70-428a-4433-b0d5-535eea3dfc04 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:43.783902 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f4778a70-428a-4433-b0d5-535eea3dfc04 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:43.790778 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4778a70-428a-4433-b0d5-535eea3dfc04 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:43.791251 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4778a70-428a-4433-b0d5-535eea3dfc04 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:43.791679 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4778a70-428a-4433-b0d5-535eea3dfc04 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:43.792362 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4778a70-428a-4433-b0d5-535eea3dfc04 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:43.792833 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4778a70-428a-4433-b0d5-535eea3dfc04 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:43.793254 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4778a70-428a-4433-b0d5-535eea3dfc04 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:43.980296 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-053dc086-5c62-4f78-ab66-cbaf175aa427 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5a4b02c2a74519baa305e3b7659519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504166c44064437ca4e25acd180bea8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:43.987939 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-053dc086-5c62-4f78-ab66-cbaf175aa427 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] 10.222.0.60 "GET /compute/v2.1/servers/a7f435f2-096a-4c79-b5f4-378c1e8b4e3e" status: 200 len: 1313 microversion: 2.1 time: 0.241288 Oct 18 15:39:43.989587 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1696/3379] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:43 2022] GET /compute/v2.1/servers/a7f435f2-096a-4c79-b5f4-378c1e8b4e3e => generated 1313 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:44.003682 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-64cb8157-c561-4f73-acd4-5ca7bffc2a18 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:44.004318 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-64cb8157-c561-4f73-acd4-5ca7bffc2a18 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] [instance: 6c2ed037-84ac-463b-a42d-01a03532cc43] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:44.010167 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-64cb8157-c561-4f73-acd4-5ca7bffc2a18 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:44.010664 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-64cb8157-c561-4f73-acd4-5ca7bffc2a18 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:44.011085 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-64cb8157-c561-4f73-acd4-5ca7bffc2a18 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:44.011770 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-64cb8157-c561-4f73-acd4-5ca7bffc2a18 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:44.012226 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-64cb8157-c561-4f73-acd4-5ca7bffc2a18 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:44.012704 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-64cb8157-c561-4f73-acd4-5ca7bffc2a18 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:44.019075 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f4778a70-428a-4433-b0d5-535eea3dfc04 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:44.027369 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:39:44.029047 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f4778a70-428a-4433-b0d5-535eea3dfc04 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:44.030651 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f4778a70-428a-4433-b0d5-535eea3dfc04 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:44.031794 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f4778a70-428a-4433-b0d5-535eea3dfc04 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 200 len: 1880 microversion: 2.32 time: 0.252661 Oct 18 15:39:44.032418 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1684/3380] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:39:43 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 1880 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:39:44.037363 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0bddd000-2a37-4a3a-a3ce-9c034b8d5c9e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:44.037977 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0bddd000-2a37-4a3a-a3ce-9c034b8d5c9e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 60621af7-3f40-45ac-8e96-2a2f7444d372] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:44.043877 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0bddd000-2a37-4a3a-a3ce-9c034b8d5c9e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:44.044371 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0bddd000-2a37-4a3a-a3ce-9c034b8d5c9e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:44.044836 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0bddd000-2a37-4a3a-a3ce-9c034b8d5c9e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:44.045539 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0bddd000-2a37-4a3a-a3ce-9c034b8d5c9e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:44.046179 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0bddd000-2a37-4a3a-a3ce-9c034b8d5c9e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:44.046609 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0bddd000-2a37-4a3a-a3ce-9c034b8d5c9e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:44.201866 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-64cb8157-c561-4f73-acd4-5ca7bffc2a18 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386f58c6593d43d2829e08fbdb9ed769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e75e5c7ef1b48cfb696da32fa30b845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:44.210361 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-64cb8157-c561-4f73-acd4-5ca7bffc2a18 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] 10.222.0.60 "GET /compute/v2.1/servers/6c2ed037-84ac-463b-a42d-01a03532cc43" status: 200 len: 1316 microversion: 2.1 time: 0.210739 Oct 18 15:39:44.210942 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1697/3381] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:43 2022] GET /compute/v2.1/servers/6c2ed037-84ac-463b-a42d-01a03532cc43 => generated 1316 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:39:44.217621 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7873ce3b-ef87-4628-ae35-ca9f6c179b00 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:44.218481 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7873ce3b-ef87-4628-ae35-ca9f6c179b00 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: d280f396-df42-482a-b0c1-9a8a9b608f57] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:44.225194 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7873ce3b-ef87-4628-ae35-ca9f6c179b00 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:44.225681 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7873ce3b-ef87-4628-ae35-ca9f6c179b00 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:44.226118 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7873ce3b-ef87-4628-ae35-ca9f6c179b00 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:44.226811 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7873ce3b-ef87-4628-ae35-ca9f6c179b00 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:44.227267 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7873ce3b-ef87-4628-ae35-ca9f6c179b00 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:44.227688 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7873ce3b-ef87-4628-ae35-ca9f6c179b00 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:44.227847 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0bddd000-2a37-4a3a-a3ce-9c034b8d5c9e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:44.236864 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0bddd000-2a37-4a3a-a3ce-9c034b8d5c9e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/60621af7-3f40-45ac-8e96-2a2f7444d372" status: 200 len: 1315 microversion: 2.1 time: 0.203398 Oct 18 15:39:44.237442 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1685/3382] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:44 2022] GET /compute/v2.1/servers/60621af7-3f40-45ac-8e96-2a2f7444d372 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:44.358093 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c86f84f7-353b-467c-aa43-ea601f18196f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:44.358706 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c86f84f7-353b-467c-aa43-ea601f18196f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 4a23be5e-9334-4385-9476-4bbd81995002] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:44.375656 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c86f84f7-353b-467c-aa43-ea601f18196f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:44.376134 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c86f84f7-353b-467c-aa43-ea601f18196f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:44.376564 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c86f84f7-353b-467c-aa43-ea601f18196f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:44.377297 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c86f84f7-353b-467c-aa43-ea601f18196f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:44.377750 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c86f84f7-353b-467c-aa43-ea601f18196f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:44.378603 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c86f84f7-353b-467c-aa43-ea601f18196f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:44.544247 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c86f84f7-353b-467c-aa43-ea601f18196f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:44.571596 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:39:44.575071 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c86f84f7-353b-467c-aa43-ea601f18196f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002" status: 200 len: 1293 microversion: 2.1 time: 0.220997 Oct 18 15:39:44.577808 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1686/3383] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:44 2022] GET /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002 => generated 1293 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:39:44.583419 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7873ce3b-ef87-4628-ae35-ca9f6c179b00 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:44.584120 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-09fe3290-bf5c-4632-838c-e50b3e95a818 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:44.584962 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-09fe3290-bf5c-4632-838c-e50b3e95a818 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] [instance: 7ae6ac1e-7345-4096-9816-a53e90d88447] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:44.593623 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09fe3290-bf5c-4632-838c-e50b3e95a818 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:44.594338 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09fe3290-bf5c-4632-838c-e50b3e95a818 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:44.595138 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09fe3290-bf5c-4632-838c-e50b3e95a818 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:44.596008 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09fe3290-bf5c-4632-838c-e50b3e95a818 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:44.596622 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09fe3290-bf5c-4632-838c-e50b3e95a818 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:44.598160 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09fe3290-bf5c-4632-838c-e50b3e95a818 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:44.600837 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7873ce3b-ef87-4628-ae35-ca9f6c179b00 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57" status: 200 len: 1470 microversion: 2.1 time: 0.386860 Oct 18 15:39:44.604876 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1698/3384] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:44 2022] GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57 => generated 1470 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:39:44.860614 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:39:44.941585 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-09fe3290-bf5c-4632-838c-e50b3e95a818 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7ebe0c265144769931ca6262be8860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a84f93ce8049c3a20c3b835f28100f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:44.949657 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-09fe3290-bf5c-4632-838c-e50b3e95a818 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] 10.222.0.60 "GET /compute/v2.1/servers/7ae6ac1e-7345-4096-9816-a53e90d88447" status: 200 len: 1525 microversion: 2.1 time: 0.370820 Oct 18 15:39:44.950235 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1687/3385] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:44 2022] GET /compute/v2.1/servers/7ae6ac1e-7345-4096-9816-a53e90d88447 => generated 1525 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:45.010481 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e0451851-5ea5-4f91-acfb-5c42576113fb tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:45.011132 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e0451851-5ea5-4f91-acfb-5c42576113fb tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] [instance: a7f435f2-096a-4c79-b5f4-378c1e8b4e3e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:45.017971 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e0451851-5ea5-4f91-acfb-5c42576113fb tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:45.018454 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e0451851-5ea5-4f91-acfb-5c42576113fb tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:45.018890 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e0451851-5ea5-4f91-acfb-5c42576113fb tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:45.020079 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e0451851-5ea5-4f91-acfb-5c42576113fb tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:45.020533 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e0451851-5ea5-4f91-acfb-5c42576113fb tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:45.020990 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e0451851-5ea5-4f91-acfb-5c42576113fb tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:45.056956 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-66697849-f76c-4859-bb00-62a3ce92a4a6 req-983e2cce-9ef4-4c44-9ea8-2fb8e22ea940 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d280f396-df42-482a-b0c1-9a8a9b608f57", "tag": "f518ff61-30b3-4c0b-a3c2-3c35a22e45aa"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:39:45.067783 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-66697849-f76c-4859-bb00-62a3ce92a4a6 req-983e2cce-9ef4-4c44-9ea8-2fb8e22ea940 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:45.068347 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-66697849-f76c-4859-bb00-62a3ce92a4a6 req-983e2cce-9ef4-4c44-9ea8-2fb8e22ea940 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:45.068879 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-66697849-f76c-4859-bb00-62a3ce92a4a6 req-983e2cce-9ef4-4c44-9ea8-2fb8e22ea940 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:45.082409 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-66697849-f76c-4859-bb00-62a3ce92a4a6 req-983e2cce-9ef4-4c44-9ea8-2fb8e22ea940 service nova] Creating event network-changed:f518ff61-30b3-4c0b-a3c2-3c35a22e45aa for instance d280f396-df42-482a-b0c1-9a8a9b608f57 on n-h1-853682-5 Oct 18 15:39:45.087930 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [req-66697849-f76c-4859-bb00-62a3ce92a4a6 req-983e2cce-9ef4-4c44-9ea8-2fb8e22ea940 service nova] Instance d280f396-df42-482a-b0c1-9a8a9b608f57 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853682-5', 'n-h1-853682-5'} {{(pid=120406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 18 15:39:45.099271 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-66697849-f76c-4859-bb00-62a3ce92a4a6 req-983e2cce-9ef4-4c44-9ea8-2fb8e22ea940 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046572 Oct 18 15:39:45.100197 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1688/3386] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:39:45.105129 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-11961be5-43f2-4aa6-a9e9-3d3399d67a95 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:45.105828 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-11961be5-43f2-4aa6-a9e9-3d3399d67a95 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:45.112630 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-11961be5-43f2-4aa6-a9e9-3d3399d67a95 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:45.113778 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-11961be5-43f2-4aa6-a9e9-3d3399d67a95 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:45.114636 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-11961be5-43f2-4aa6-a9e9-3d3399d67a95 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:45.115136 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-11961be5-43f2-4aa6-a9e9-3d3399d67a95 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:45.115656 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-11961be5-43f2-4aa6-a9e9-3d3399d67a95 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:45.116225 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-11961be5-43f2-4aa6-a9e9-3d3399d67a95 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:45.309978 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e0451851-5ea5-4f91-acfb-5c42576113fb tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5a4b02c2a74519baa305e3b7659519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504166c44064437ca4e25acd180bea8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:45.317723 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e0451851-5ea5-4f91-acfb-5c42576113fb tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] 10.222.0.60 "GET /compute/v2.1/servers/a7f435f2-096a-4c79-b5f4-378c1e8b4e3e" status: 200 len: 1313 microversion: 2.1 time: 0.311200 Oct 18 15:39:45.318392 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1699/3387] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:45 2022] GET /compute/v2.1/servers/a7f435f2-096a-4c79-b5f4-378c1e8b4e3e => generated 1313 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:45.322882 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-a72ed5cf-0b31-4602-a8d0-07d43bc9ba3c req-cbc7fad7-d229-4b98-a53c-fc29f8b2e0ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60621af7-3f40-45ac-8e96-2a2f7444d372", "name": "network-vif-plugged", "status": "completed", "tag": "c2c6823d-9a8e-4529-bfd0-b37f8897ffd8"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:39:45.332792 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-a72ed5cf-0b31-4602-a8d0-07d43bc9ba3c req-cbc7fad7-d229-4b98-a53c-fc29f8b2e0ba service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:45.333330 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-a72ed5cf-0b31-4602-a8d0-07d43bc9ba3c req-cbc7fad7-d229-4b98-a53c-fc29f8b2e0ba service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:45.333759 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-a72ed5cf-0b31-4602-a8d0-07d43bc9ba3c req-cbc7fad7-d229-4b98-a53c-fc29f8b2e0ba service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:45.344370 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-a72ed5cf-0b31-4602-a8d0-07d43bc9ba3c req-cbc7fad7-d229-4b98-a53c-fc29f8b2e0ba service nova] Creating event network-vif-plugged:c2c6823d-9a8e-4529-bfd0-b37f8897ffd8 for instance 60621af7-3f40-45ac-8e96-2a2f7444d372 on n-h1-853682-5 Oct 18 15:39:45.349918 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-a72ed5cf-0b31-4602-a8d0-07d43bc9ba3c req-cbc7fad7-d229-4b98-a53c-fc29f8b2e0ba service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030324 Oct 18 15:39:45.350536 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1700/3388] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:39:45.351796 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-11961be5-43f2-4aa6-a9e9-3d3399d67a95 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:45.355446 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ac217c20-7ebd-4784-9aa9-17c6ef27bf39 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:45.356352 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ac217c20-7ebd-4784-9aa9-17c6ef27bf39 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] [instance: 6c2ed037-84ac-463b-a42d-01a03532cc43] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:45.361922 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-11961be5-43f2-4aa6-a9e9-3d3399d67a95 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:45.362395 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ac217c20-7ebd-4784-9aa9-17c6ef27bf39 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:45.362876 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ac217c20-7ebd-4784-9aa9-17c6ef27bf39 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:45.364187 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-11961be5-43f2-4aa6-a9e9-3d3399d67a95 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:45.365628 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-11961be5-43f2-4aa6-a9e9-3d3399d67a95 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 200 len: 1880 microversion: 2.32 time: 0.264541 Oct 18 15:39:45.366175 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ac217c20-7ebd-4784-9aa9-17c6ef27bf39 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:45.366486 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ac217c20-7ebd-4784-9aa9-17c6ef27bf39 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:45.367154 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ac217c20-7ebd-4784-9aa9-17c6ef27bf39 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:45.367591 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ac217c20-7ebd-4784-9aa9-17c6ef27bf39 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:45.367740 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1689/3389] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:39:45 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 1880 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:39:45.376313 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-398f9055-dc32-4c6b-9547-24b52d17b983 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:45.377254 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-398f9055-dc32-4c6b-9547-24b52d17b983 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 60621af7-3f40-45ac-8e96-2a2f7444d372] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:45.384184 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-398f9055-dc32-4c6b-9547-24b52d17b983 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:45.385033 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-398f9055-dc32-4c6b-9547-24b52d17b983 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:45.385683 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-398f9055-dc32-4c6b-9547-24b52d17b983 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:45.386466 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-398f9055-dc32-4c6b-9547-24b52d17b983 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:45.387005 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-398f9055-dc32-4c6b-9547-24b52d17b983 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:45.387434 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-398f9055-dc32-4c6b-9547-24b52d17b983 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:45.646888 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ac217c20-7ebd-4784-9aa9-17c6ef27bf39 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386f58c6593d43d2829e08fbdb9ed769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e75e5c7ef1b48cfb696da32fa30b845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:45.654560 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ac217c20-7ebd-4784-9aa9-17c6ef27bf39 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] 10.222.0.60 "GET /compute/v2.1/servers/6c2ed037-84ac-463b-a42d-01a03532cc43" status: 200 len: 1316 microversion: 2.1 time: 0.302897 Oct 18 15:39:45.654736 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-398f9055-dc32-4c6b-9547-24b52d17b983 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:45.657026 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1701/3390] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:45 2022] GET /compute/v2.1/servers/6c2ed037-84ac-463b-a42d-01a03532cc43 => generated 1316 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:45.662392 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-56084289-d1e0-4fdd-a1de-56ec2190d627 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:45.663239 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-56084289-d1e0-4fdd-a1de-56ec2190d627 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 4a23be5e-9334-4385-9476-4bbd81995002] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:45.663671 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-398f9055-dc32-4c6b-9547-24b52d17b983 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/60621af7-3f40-45ac-8e96-2a2f7444d372" status: 200 len: 1315 microversion: 2.1 time: 0.294634 Oct 18 15:39:45.664456 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1690/3391] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:45 2022] GET /compute/v2.1/servers/60621af7-3f40-45ac-8e96-2a2f7444d372 => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:45.669944 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-56084289-d1e0-4fdd-a1de-56ec2190d627 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:45.670535 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-56084289-d1e0-4fdd-a1de-56ec2190d627 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:45.671105 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-56084289-d1e0-4fdd-a1de-56ec2190d627 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:45.671917 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-56084289-d1e0-4fdd-a1de-56ec2190d627 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:45.672475 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-56084289-d1e0-4fdd-a1de-56ec2190d627 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:45.673227 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-56084289-d1e0-4fdd-a1de-56ec2190d627 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:45.673370 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9121be8a-6ddc-40f4-8e8c-26347209fb0d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:45.673896 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9121be8a-6ddc-40f4-8e8c-26347209fb0d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: d280f396-df42-482a-b0c1-9a8a9b608f57] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:45.681173 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9121be8a-6ddc-40f4-8e8c-26347209fb0d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:45.681665 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9121be8a-6ddc-40f4-8e8c-26347209fb0d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:45.682102 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9121be8a-6ddc-40f4-8e8c-26347209fb0d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:45.682804 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9121be8a-6ddc-40f4-8e8c-26347209fb0d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:45.683264 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9121be8a-6ddc-40f4-8e8c-26347209fb0d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:45.683689 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9121be8a-6ddc-40f4-8e8c-26347209fb0d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:45.746125 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-56084289-d1e0-4fdd-a1de-56ec2190d627 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:45.754624 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-56084289-d1e0-4fdd-a1de-56ec2190d627 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002" status: 200 len: 1293 microversion: 2.1 time: 0.095927 Oct 18 15:39:45.755132 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1702/3392] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:45 2022] GET /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002 => generated 1293 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:45.829139 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9121be8a-6ddc-40f4-8e8c-26347209fb0d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:45.836800 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9121be8a-6ddc-40f4-8e8c-26347209fb0d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57" status: 200 len: 1470 microversion: 2.1 time: 0.171124 Oct 18 15:39:45.837386 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1691/3393] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:45 2022] GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57 => generated 1470 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:45.973486 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c8dfe051-9a83-41e4-b5fe-e306aadb6c08 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:45.974101 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c8dfe051-9a83-41e4-b5fe-e306aadb6c08 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] [instance: 7ae6ac1e-7345-4096-9816-a53e90d88447] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:45.980086 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c8dfe051-9a83-41e4-b5fe-e306aadb6c08 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:45.980561 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c8dfe051-9a83-41e4-b5fe-e306aadb6c08 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:45.981027 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c8dfe051-9a83-41e4-b5fe-e306aadb6c08 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:45.981707 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c8dfe051-9a83-41e4-b5fe-e306aadb6c08 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:45.982162 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c8dfe051-9a83-41e4-b5fe-e306aadb6c08 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:45.982584 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c8dfe051-9a83-41e4-b5fe-e306aadb6c08 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:46.139878 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c8dfe051-9a83-41e4-b5fe-e306aadb6c08 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7ebe0c265144769931ca6262be8860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a84f93ce8049c3a20c3b835f28100f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:46.149190 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c8dfe051-9a83-41e4-b5fe-e306aadb6c08 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] 10.222.0.60 "GET /compute/v2.1/servers/7ae6ac1e-7345-4096-9816-a53e90d88447" status: 200 len: 1525 microversion: 2.1 time: 0.179308 Oct 18 15:39:46.150122 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1703/3394] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:45 2022] GET /compute/v2.1/servers/7ae6ac1e-7345-4096-9816-a53e90d88447 => generated 1525 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:46.341386 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a859237b-d443-479f-a6c1-33706659860a tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:46.342037 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a859237b-d443-479f-a6c1-33706659860a tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] [instance: a7f435f2-096a-4c79-b5f4-378c1e8b4e3e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:46.350299 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a859237b-d443-479f-a6c1-33706659860a tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:46.350884 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a859237b-d443-479f-a6c1-33706659860a tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:46.351561 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a859237b-d443-479f-a6c1-33706659860a tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:46.352343 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a859237b-d443-479f-a6c1-33706659860a tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:46.352905 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a859237b-d443-479f-a6c1-33706659860a tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:46.353401 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a859237b-d443-479f-a6c1-33706659860a tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:46.397730 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-54e626d8-4bf0-4224-9c93-02c7df997790 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:46.399080 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-54e626d8-4bf0-4224-9c93-02c7df997790 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:46.408125 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-54e626d8-4bf0-4224-9c93-02c7df997790 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:46.409008 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-54e626d8-4bf0-4224-9c93-02c7df997790 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:46.409947 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-54e626d8-4bf0-4224-9c93-02c7df997790 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:46.411206 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-54e626d8-4bf0-4224-9c93-02c7df997790 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:46.411961 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-54e626d8-4bf0-4224-9c93-02c7df997790 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:46.412492 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-54e626d8-4bf0-4224-9c93-02c7df997790 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:46.912761 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=10 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:39:46.987400 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a859237b-d443-479f-a6c1-33706659860a tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5a4b02c2a74519baa305e3b7659519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504166c44064437ca4e25acd180bea8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:46.995975 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a859237b-d443-479f-a6c1-33706659860a tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] 10.222.0.60 "GET /compute/v2.1/servers/a7f435f2-096a-4c79-b5f4-378c1e8b4e3e" status: 200 len: 1498 microversion: 2.1 time: 0.659224 Oct 18 15:39:47.009045 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1692/3395] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:46 2022] GET /compute/v2.1/servers/a7f435f2-096a-4c79-b5f4-378c1e8b4e3e => generated 1498 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:47.016403 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-67196af5-5994-4c33-9192-4a8814866321 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:47.017134 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-67196af5-5994-4c33-9192-4a8814866321 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] [instance: 6c2ed037-84ac-463b-a42d-01a03532cc43] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:47.023936 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67196af5-5994-4c33-9192-4a8814866321 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:47.024673 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67196af5-5994-4c33-9192-4a8814866321 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:47.025151 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67196af5-5994-4c33-9192-4a8814866321 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:47.025910 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67196af5-5994-4c33-9192-4a8814866321 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:47.026375 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67196af5-5994-4c33-9192-4a8814866321 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:47.026800 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67196af5-5994-4c33-9192-4a8814866321 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:47.044734 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-54e626d8-4bf0-4224-9c93-02c7df997790 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:47.057645 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-54e626d8-4bf0-4224-9c93-02c7df997790 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:47.059576 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-54e626d8-4bf0-4224-9c93-02c7df997790 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:47.062349 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-54e626d8-4bf0-4224-9c93-02c7df997790 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 200 len: 2831 microversion: 2.32 time: 0.669945 Oct 18 15:39:47.063476 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1704/3396] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:39:46 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 2831 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:39:47.138448 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-22b81f15-c278-41c8-b207-44b26df4df6a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:47.139416 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-22b81f15-c278-41c8-b207-44b26df4df6a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 60621af7-3f40-45ac-8e96-2a2f7444d372] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:47.146714 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-22b81f15-c278-41c8-b207-44b26df4df6a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:47.147507 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-22b81f15-c278-41c8-b207-44b26df4df6a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:47.148168 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-22b81f15-c278-41c8-b207-44b26df4df6a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:47.149152 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-22b81f15-c278-41c8-b207-44b26df4df6a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:47.149833 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-22b81f15-c278-41c8-b207-44b26df4df6a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:47.150723 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-22b81f15-c278-41c8-b207-44b26df4df6a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:47.405422 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-67196af5-5994-4c33-9192-4a8814866321 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386f58c6593d43d2829e08fbdb9ed769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e75e5c7ef1b48cfb696da32fa30b845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:47.417653 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-67196af5-5994-4c33-9192-4a8814866321 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] 10.222.0.60 "GET /compute/v2.1/servers/6c2ed037-84ac-463b-a42d-01a03532cc43" status: 200 len: 1316 microversion: 2.1 time: 0.419538 Oct 18 15:39:47.418587 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1693/3397] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:46 2022] GET /compute/v2.1/servers/6c2ed037-84ac-463b-a42d-01a03532cc43 => generated 1316 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:47.426619 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bfe500f3-6464-487a-8c6c-bca99f7b47cf tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:47.427895 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bfe500f3-6464-487a-8c6c-bca99f7b47cf tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 4a23be5e-9334-4385-9476-4bbd81995002] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:47.435667 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bfe500f3-6464-487a-8c6c-bca99f7b47cf tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:47.436163 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bfe500f3-6464-487a-8c6c-bca99f7b47cf tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:47.437343 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bfe500f3-6464-487a-8c6c-bca99f7b47cf tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:47.438063 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bfe500f3-6464-487a-8c6c-bca99f7b47cf tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:47.439104 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bfe500f3-6464-487a-8c6c-bca99f7b47cf tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:47.439695 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bfe500f3-6464-487a-8c6c-bca99f7b47cf tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:47.487541 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-22b81f15-c278-41c8-b207-44b26df4df6a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:47.501670 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-22b81f15-c278-41c8-b207-44b26df4df6a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/60621af7-3f40-45ac-8e96-2a2f7444d372" status: 200 len: 1315 microversion: 2.1 time: 0.434587 Oct 18 15:39:47.503663 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1705/3398] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:47 2022] GET /compute/v2.1/servers/60621af7-3f40-45ac-8e96-2a2f7444d372 => generated 1315 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:47.510640 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f004981b-e0b5-4d1b-a6a3-0c9b7c814311 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:47.512698 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f004981b-e0b5-4d1b-a6a3-0c9b7c814311 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: d280f396-df42-482a-b0c1-9a8a9b608f57] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:47.520110 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f004981b-e0b5-4d1b-a6a3-0c9b7c814311 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:47.520798 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f004981b-e0b5-4d1b-a6a3-0c9b7c814311 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:47.521452 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f004981b-e0b5-4d1b-a6a3-0c9b7c814311 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:47.523311 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f004981b-e0b5-4d1b-a6a3-0c9b7c814311 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:47.523942 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f004981b-e0b5-4d1b-a6a3-0c9b7c814311 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:47.524534 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f004981b-e0b5-4d1b-a6a3-0c9b7c814311 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:47.915954 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bfe500f3-6464-487a-8c6c-bca99f7b47cf tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:47.933323 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bfe500f3-6464-487a-8c6c-bca99f7b47cf tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002" status: 200 len: 1367 microversion: 2.1 time: 0.508840 Oct 18 15:39:47.934530 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1694/3399] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:47 2022] GET /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002 => generated 1367 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:47.942120 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4b3a74c9-c004-4a3b-831a-9ae46a9068a2 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:48.001101 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.compute.server_groups [None req-4b3a74c9-c004-4a3b-831a-9ae46a9068a2 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Querying cell 8ab54c98-adc3-429d-89a9-d68fdb0f782a(cell1) for 1 instances {{(pid=120406) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 18 15:39:48.002064 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b3a74c9-c004-4a3b-831a-9ae46a9068a2 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:48.002657 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b3a74c9-c004-4a3b-831a-9ae46a9068a2 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:48.004500 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b3a74c9-c004-4a3b-831a-9ae46a9068a2 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:48.047748 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4b3a74c9-c004-4a3b-831a-9ae46a9068a2 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] 10.222.0.60 "GET /compute/v2.1/os-server-groups/57496904-0426-40af-b581-96f66ac2e236" status: 200 len: 222 microversion: 2.1 time: 0.111661 Oct 18 15:39:48.048755 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1695/3400] 10.222.0.60 () {58 vars in 1263 bytes} [Tue Oct 18 15:39:47 2022] GET /compute/v2.1/os-server-groups/57496904-0426-40af-b581-96f66ac2e236 => generated 222 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:39:48.061051 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d904483f-3855-415b-8969-2726572c0a00 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:48.061763 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d904483f-3855-415b-8969-2726572c0a00 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:48.072339 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d904483f-3855-415b-8969-2726572c0a00 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:48.073254 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d904483f-3855-415b-8969-2726572c0a00 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:48.073978 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d904483f-3855-415b-8969-2726572c0a00 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:48.074560 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d904483f-3855-415b-8969-2726572c0a00 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:48.075928 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d904483f-3855-415b-8969-2726572c0a00 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:48.077087 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d904483f-3855-415b-8969-2726572c0a00 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:48.134550 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f004981b-e0b5-4d1b-a6a3-0c9b7c814311 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:48.143220 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f004981b-e0b5-4d1b-a6a3-0c9b7c814311 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57" status: 200 len: 1470 microversion: 2.1 time: 0.637381 Oct 18 15:39:48.144493 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1706/3401] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:47 2022] GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57 => generated 1470 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:48.156717 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-515d76ad-49aa-49fc-99fc-f663272adc6e tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:48.157736 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-515d76ad-49aa-49fc-99fc-f663272adc6e tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] [instance: 7ae6ac1e-7345-4096-9816-a53e90d88447] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:48.163991 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-515d76ad-49aa-49fc-99fc-f663272adc6e tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:48.168238 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-515d76ad-49aa-49fc-99fc-f663272adc6e tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:48.168866 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-515d76ad-49aa-49fc-99fc-f663272adc6e tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:48.170938 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-515d76ad-49aa-49fc-99fc-f663272adc6e tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:48.175201 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-515d76ad-49aa-49fc-99fc-f663272adc6e tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:48.176984 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-515d76ad-49aa-49fc-99fc-f663272adc6e tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:48.222511 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-515d76ad-49aa-49fc-99fc-f663272adc6e tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:48.223264 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-515d76ad-49aa-49fc-99fc-f663272adc6e tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:48.223727 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-515d76ad-49aa-49fc-99fc-f663272adc6e tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:48.224250 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-515d76ad-49aa-49fc-99fc-f663272adc6e tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lazy-loading 'fault' on Instance uuid 7ae6ac1e-7345-4096-9816-a53e90d88447 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:39:48.242836 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d904483f-3855-415b-8969-2726572c0a00 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.192875 Oct 18 15:39:48.243804 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1696/3402] 10.222.0.60 () {60 vars in 1316 bytes} [Tue Oct 18 15:39:48 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d/os-interface => generated 1831 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:39:48.248971 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-d2ff4ce4-8984-42bf-9f86-54749103e391 req-f29d3858-a3c5-42ee-a1a8-138d37fb4451 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ae6ac1e-7345-4096-9816-a53e90d88447", "name": "network-vif-deleted", "tag": "860075d2-73a1-49ad-a68a-e236bf779147"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:39:48.262906 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d2ff4ce4-8984-42bf-9f86-54749103e391 req-f29d3858-a3c5-42ee-a1a8-138d37fb4451 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:48.263673 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d2ff4ce4-8984-42bf-9f86-54749103e391 req-f29d3858-a3c5-42ee-a1a8-138d37fb4451 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:48.264272 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d2ff4ce4-8984-42bf-9f86-54749103e391 req-f29d3858-a3c5-42ee-a1a8-138d37fb4451 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:48.283414 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-d2ff4ce4-8984-42bf-9f86-54749103e391 req-f29d3858-a3c5-42ee-a1a8-138d37fb4451 service nova] Creating event network-vif-deleted:860075d2-73a1-49ad-a68a-e236bf779147 for instance 7ae6ac1e-7345-4096-9816-a53e90d88447 on n-h2-853682-5 Oct 18 15:39:48.288997 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-d2ff4ce4-8984-42bf-9f86-54749103e391 req-f29d3858-a3c5-42ee-a1a8-138d37fb4451 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043778 Oct 18 15:39:48.289611 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1697/3403] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:39:48.296101 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-a8a2ee7b-c422-41de-848e-1c8a8267d2c0 req-4a7ee9a5-1a18-45c2-bc8b-a3ca7532789d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c2ed037-84ac-463b-a42d-01a03532cc43", "name": "network-vif-plugged", "status": "completed", "tag": "6e6a8be2-7d56-46b4-83cf-fafcac566b7c"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:39:48.306863 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a8a2ee7b-c422-41de-848e-1c8a8267d2c0 req-4a7ee9a5-1a18-45c2-bc8b-a3ca7532789d service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:48.307346 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a8a2ee7b-c422-41de-848e-1c8a8267d2c0 req-4a7ee9a5-1a18-45c2-bc8b-a3ca7532789d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:48.307781 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a8a2ee7b-c422-41de-848e-1c8a8267d2c0 req-4a7ee9a5-1a18-45c2-bc8b-a3ca7532789d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:48.323268 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-a8a2ee7b-c422-41de-848e-1c8a8267d2c0 req-4a7ee9a5-1a18-45c2-bc8b-a3ca7532789d service nova] Creating event network-vif-plugged:6e6a8be2-7d56-46b4-83cf-fafcac566b7c for instance 6c2ed037-84ac-463b-a42d-01a03532cc43 on n-h1-853682-5 Oct 18 15:39:48.328621 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-a8a2ee7b-c422-41de-848e-1c8a8267d2c0 req-4a7ee9a5-1a18-45c2-bc8b-a3ca7532789d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037089 Oct 18 15:39:48.329884 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1698/3404] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:39:48.330362 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-515d76ad-49aa-49fc-99fc-f663272adc6e tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e7ebe0c265144769931ca6262be8860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a84f93ce8049c3a20c3b835f28100f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:48.335297 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-125980d2-20cf-4141-b335-0aa60325dbfb tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:48.335890 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-125980d2-20cf-4141-b335-0aa60325dbfb tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] [instance: a7f435f2-096a-4c79-b5f4-378c1e8b4e3e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:48.341359 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-515d76ad-49aa-49fc-99fc-f663272adc6e tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] 10.222.0.60 "GET /compute/v2.1/servers/7ae6ac1e-7345-4096-9816-a53e90d88447" status: 200 len: 1313 microversion: 2.1 time: 0.195537 Oct 18 15:39:48.342268 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-125980d2-20cf-4141-b335-0aa60325dbfb tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:48.342416 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1707/3405] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:48 2022] GET /compute/v2.1/servers/7ae6ac1e-7345-4096-9816-a53e90d88447 => generated 1313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:48.343119 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-125980d2-20cf-4141-b335-0aa60325dbfb tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:48.343721 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-125980d2-20cf-4141-b335-0aa60325dbfb tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:48.344667 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-125980d2-20cf-4141-b335-0aa60325dbfb tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:48.345359 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-125980d2-20cf-4141-b335-0aa60325dbfb tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:48.345945 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-125980d2-20cf-4141-b335-0aa60325dbfb tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:48.390623 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-125980d2-20cf-4141-b335-0aa60325dbfb tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] [instance: a7f435f2-096a-4c79-b5f4-378c1e8b4e3e] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:39:48.469968 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-c05f336a-7b9c-4ff7-af5a-ec124c30d6f7 req-91b17238-25c8-4d9d-9a0c-8542891bfbe4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a23be5e-9334-4385-9476-4bbd81995002", "tag": "4c591361-ce3f-4d4a-acbd-c51f7d0da6dc"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:39:48.487204 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-c05f336a-7b9c-4ff7-af5a-ec124c30d6f7 req-91b17238-25c8-4d9d-9a0c-8542891bfbe4 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:48.489048 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-c05f336a-7b9c-4ff7-af5a-ec124c30d6f7 req-91b17238-25c8-4d9d-9a0c-8542891bfbe4 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:48.490436 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-c05f336a-7b9c-4ff7-af5a-ec124c30d6f7 req-91b17238-25c8-4d9d-9a0c-8542891bfbe4 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:48.505991 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-c05f336a-7b9c-4ff7-af5a-ec124c30d6f7 req-91b17238-25c8-4d9d-9a0c-8542891bfbe4 service nova] Creating event network-changed:4c591361-ce3f-4d4a-acbd-c51f7d0da6dc for instance 4a23be5e-9334-4385-9476-4bbd81995002 on n-h2-853682-5 Oct 18 15:39:48.512287 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-c05f336a-7b9c-4ff7-af5a-ec124c30d6f7 req-91b17238-25c8-4d9d-9a0c-8542891bfbe4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168365 Oct 18 15:39:48.513786 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1708/3406] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:39:48.522058 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6b1cc5d5-f0e4-4f8c-bcfb-20c9bbd11aeb tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:48.523306 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6b1cc5d5-f0e4-4f8c-bcfb-20c9bbd11aeb tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] [instance: 6c2ed037-84ac-463b-a42d-01a03532cc43] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:48.532690 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6b1cc5d5-f0e4-4f8c-bcfb-20c9bbd11aeb tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:48.534328 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6b1cc5d5-f0e4-4f8c-bcfb-20c9bbd11aeb tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:48.535716 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6b1cc5d5-f0e4-4f8c-bcfb-20c9bbd11aeb tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:48.536854 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6b1cc5d5-f0e4-4f8c-bcfb-20c9bbd11aeb tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:48.537686 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6b1cc5d5-f0e4-4f8c-bcfb-20c9bbd11aeb tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:48.538343 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6b1cc5d5-f0e4-4f8c-bcfb-20c9bbd11aeb tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:48.540437 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-125980d2-20cf-4141-b335-0aa60325dbfb tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a7f435f2-096a-4c79-b5f4-378c1e8b4e3e" status: 204 len: 0 microversion: 2.1 time: 0.208238 Oct 18 15:39:48.541095 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1699/3407] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:39:48 2022] DELETE /compute/v2.1/servers/a7f435f2-096a-4c79-b5f4-378c1e8b4e3e => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:39:48.557398 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-700d5bd0-b959-4465-90ee-739e96170f8d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:48.559601 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-700d5bd0-b959-4465-90ee-739e96170f8d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 60621af7-3f40-45ac-8e96-2a2f7444d372] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:48.573852 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:39:48.583298 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-700d5bd0-b959-4465-90ee-739e96170f8d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:48.583799 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-700d5bd0-b959-4465-90ee-739e96170f8d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:48.584236 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-700d5bd0-b959-4465-90ee-739e96170f8d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:48.584969 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-700d5bd0-b959-4465-90ee-739e96170f8d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:48.589237 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-700d5bd0-b959-4465-90ee-739e96170f8d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:48.589800 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-700d5bd0-b959-4465-90ee-739e96170f8d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:48.897756 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6b1cc5d5-f0e4-4f8c-bcfb-20c9bbd11aeb tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386f58c6593d43d2829e08fbdb9ed769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e75e5c7ef1b48cfb696da32fa30b845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:48.905541 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6b1cc5d5-f0e4-4f8c-bcfb-20c9bbd11aeb tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] 10.222.0.60 "GET /compute/v2.1/servers/6c2ed037-84ac-463b-a42d-01a03532cc43" status: 200 len: 1316 microversion: 2.1 time: 0.390234 Oct 18 15:39:48.906121 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1709/3408] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:48 2022] GET /compute/v2.1/servers/6c2ed037-84ac-463b-a42d-01a03532cc43 => generated 1316 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:48.920576 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6e74ae8c-fd5c-41f0-ac42-6366bd20ba08 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:48.920576 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6e74ae8c-fd5c-41f0-ac42-6366bd20ba08 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] [instance: a7f435f2-096a-4c79-b5f4-378c1e8b4e3e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:48.920576 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6e74ae8c-fd5c-41f0-ac42-6366bd20ba08 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:48.920576 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6e74ae8c-fd5c-41f0-ac42-6366bd20ba08 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:48.920576 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6e74ae8c-fd5c-41f0-ac42-6366bd20ba08 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:48.920576 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6e74ae8c-fd5c-41f0-ac42-6366bd20ba08 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:48.920576 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6e74ae8c-fd5c-41f0-ac42-6366bd20ba08 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:48.920576 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6e74ae8c-fd5c-41f0-ac42-6366bd20ba08 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:48.931022 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-700d5bd0-b959-4465-90ee-739e96170f8d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:48.942171 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-700d5bd0-b959-4465-90ee-739e96170f8d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/60621af7-3f40-45ac-8e96-2a2f7444d372" status: 200 len: 1315 microversion: 2.1 time: 0.395141 Oct 18 15:39:48.943196 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1700/3409] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:48 2022] GET /compute/v2.1/servers/60621af7-3f40-45ac-8e96-2a2f7444d372 => generated 1315 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:48.958669 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e1bb14bc-452f-49d7-ba5f-4d5f7b390a6e tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:48.959644 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e1bb14bc-452f-49d7-ba5f-4d5f7b390a6e tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 4a23be5e-9334-4385-9476-4bbd81995002] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:48.965978 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e1bb14bc-452f-49d7-ba5f-4d5f7b390a6e tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:48.966758 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e1bb14bc-452f-49d7-ba5f-4d5f7b390a6e tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:48.967465 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e1bb14bc-452f-49d7-ba5f-4d5f7b390a6e tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:48.968417 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e1bb14bc-452f-49d7-ba5f-4d5f7b390a6e tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:48.969143 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e1bb14bc-452f-49d7-ba5f-4d5f7b390a6e tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:48.969794 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e1bb14bc-452f-49d7-ba5f-4d5f7b390a6e tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:49.276961 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6e74ae8c-fd5c-41f0-ac42-6366bd20ba08 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5a4b02c2a74519baa305e3b7659519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504166c44064437ca4e25acd180bea8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:49.285933 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6e74ae8c-fd5c-41f0-ac42-6366bd20ba08 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] 10.222.0.60 "GET /compute/v2.1/servers/a7f435f2-096a-4c79-b5f4-378c1e8b4e3e" status: 200 len: 1504 microversion: 2.1 time: 0.378763 Oct 18 15:39:49.286523 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1710/3410] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:48 2022] GET /compute/v2.1/servers/a7f435f2-096a-4c79-b5f4-378c1e8b4e3e => generated 1504 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:49.291147 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e1bb14bc-452f-49d7-ba5f-4d5f7b390a6e tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:49.291658 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a484a04a-b53e-4b87-9085-fffd3ad03275 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:49.295861 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a484a04a-b53e-4b87-9085-fffd3ad03275 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: d280f396-df42-482a-b0c1-9a8a9b608f57] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:49.302935 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e1bb14bc-452f-49d7-ba5f-4d5f7b390a6e tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002" status: 200 len: 1367 microversion: 2.1 time: 0.347906 Oct 18 15:39:49.303722 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1701/3411] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:48 2022] GET /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002 => generated 1367 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:39:49.307459 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a484a04a-b53e-4b87-9085-fffd3ad03275 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:49.307950 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a484a04a-b53e-4b87-9085-fffd3ad03275 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:49.308420 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a484a04a-b53e-4b87-9085-fffd3ad03275 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:49.309162 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a484a04a-b53e-4b87-9085-fffd3ad03275 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:49.309642 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a484a04a-b53e-4b87-9085-fffd3ad03275 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:49.310037 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a484a04a-b53e-4b87-9085-fffd3ad03275 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:49.365735 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-44e4305f-b686-473b-9974-043bb08df502 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:49.366388 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-44e4305f-b686-473b-9974-043bb08df502 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] [instance: 7ae6ac1e-7345-4096-9816-a53e90d88447] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:49.372968 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44e4305f-b686-473b-9974-043bb08df502 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:49.373457 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44e4305f-b686-473b-9974-043bb08df502 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:49.373893 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44e4305f-b686-473b-9974-043bb08df502 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:49.374590 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44e4305f-b686-473b-9974-043bb08df502 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:49.375045 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44e4305f-b686-473b-9974-043bb08df502 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:49.375473 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44e4305f-b686-473b-9974-043bb08df502 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:49.393878 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-44e4305f-b686-473b-9974-043bb08df502 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] HTTP exception thrown: Instance 7ae6ac1e-7345-4096-9816-a53e90d88447 could not be found. Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-44e4305f-b686-473b-9974-043bb08df502 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Request method failure captured: Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/7ae6ac1e-7345-4096-9816-a53e90d88447 HTTP/1.1 Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTshh4shgJRRUGfl054dCP92HNXD-3AuBQVLlkCdoDcg4dEMB_etKwqWffO785IBt6x2gtCFDm8GKYIDSnlaC59ZTog8Zltp6V1yZhuNY9smHKUeoq9I0E61kG6JhA1CA-eUuBZFnJO4JZLSzO3M0NBbAacDi_4S6L8ZfqGjaPSuVUN4 Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: c1a84f93ce8049c3a20c3b835f28100f Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-2136196464 Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c1a84f93ce8049c3a20c3b835f28100f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c1a84f93ce8049c3a20c3b835f28100f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c1a84f93ce8049c3a20c3b835f28100f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c1a84f93ce8049c3a20c3b835f28100f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-2136196464 Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: c1a84f93ce8049c3a20c3b835f28100f Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-2136196464 Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-FloatingIPsAssociationTestJSON-2136196464-project Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 1e7ebe0c265144769931ca6262be8860 Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-2136196464-project Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 7ae6ac1e-7345-4096-9816-a53e90d88447 could not be found. Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '7ae6ac1e-7345-4096-9816-a53e90d88447'} Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ae6ac1e-7345-4096-9816-a53e90d88447 could not be found. Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ae6ac1e-7345-4096-9816-a53e90d88447 could not be found. Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:39:49.396060 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:39:49.400214 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:39:49.400214 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:39:49.400214 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:39:49.400214 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:39:49.400214 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:39:49.400214 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:39:49.400214 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ae6ac1e-7345-4096-9816-a53e90d88447 could not be found. Oct 18 15:39:49.400214 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:39:49.400214 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-44e4305f-b686-473b-9974-043bb08df502 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] Returning 404 to user: Instance 7ae6ac1e-7345-4096-9816-a53e90d88447 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:39:49.400214 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-44e4305f-b686-473b-9974-043bb08df502 tempest-FloatingIPsAssociationTestJSON-2136196464 tempest-FloatingIPsAssociationTestJSON-2136196464-project] 10.222.0.60 "GET /compute/v2.1/servers/7ae6ac1e-7345-4096-9816-a53e90d88447" status: 404 len: 111 microversion: 2.1 time: 0.036530 Oct 18 15:39:49.400214 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1702/3412] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:49 2022] GET /compute/v2.1/servers/7ae6ac1e-7345-4096-9816-a53e90d88447 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 15:39:49.636060 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a484a04a-b53e-4b87-9085-fffd3ad03275 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:49.646811 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a484a04a-b53e-4b87-9085-fffd3ad03275 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57" status: 200 len: 1463 microversion: 2.1 time: 0.358977 Oct 18 15:39:49.647750 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1711/3413] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:49 2022] GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57 => generated 1463 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:49.672745 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-701ec784-bb53-446d-bd7b-09f57072d8bd tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:49.673584 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-701ec784-bb53-446d-bd7b-09f57072d8bd tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] [instance: d280f396-df42-482a-b0c1-9a8a9b608f57] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:49.680196 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-701ec784-bb53-446d-bd7b-09f57072d8bd tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:49.680687 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-701ec784-bb53-446d-bd7b-09f57072d8bd tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:49.681158 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-701ec784-bb53-446d-bd7b-09f57072d8bd tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:49.682040 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-701ec784-bb53-446d-bd7b-09f57072d8bd tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:49.682507 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-701ec784-bb53-446d-bd7b-09f57072d8bd tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:49.682933 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-701ec784-bb53-446d-bd7b-09f57072d8bd tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:49.928250 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7dd12831-2723-4e34-a3e4-7267f3324021 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:49.929067 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7dd12831-2723-4e34-a3e4-7267f3324021 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] [instance: 6c2ed037-84ac-463b-a42d-01a03532cc43] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:49.936777 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7dd12831-2723-4e34-a3e4-7267f3324021 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:49.937454 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7dd12831-2723-4e34-a3e4-7267f3324021 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:49.938003 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7dd12831-2723-4e34-a3e4-7267f3324021 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:49.938914 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7dd12831-2723-4e34-a3e4-7267f3324021 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:49.940125 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7dd12831-2723-4e34-a3e4-7267f3324021 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:49.940125 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7dd12831-2723-4e34-a3e4-7267f3324021 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:50.426102 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-701ec784-bb53-446d-bd7b-09f57072d8bd tempest-MigrationsAdminTest-1597509491 tempest-MigrationsAdminTest-1597509491-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57" status: 200 len: 1614 microversion: 2.1 time: 0.758096 Oct 18 15:39:50.427244 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1703/3414] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:49 2022] GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57 => generated 1614 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:50.450153 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ab3886e0-18b7-4d5f-87c4-25562d7b31b0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:50.451015 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ab3886e0-18b7-4d5f-87c4-25562d7b31b0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 60621af7-3f40-45ac-8e96-2a2f7444d372] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:50.457370 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7dd12831-2723-4e34-a3e4-7267f3324021 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386f58c6593d43d2829e08fbdb9ed769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e75e5c7ef1b48cfb696da32fa30b845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:50.464506 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab3886e0-18b7-4d5f-87c4-25562d7b31b0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:50.465269 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab3886e0-18b7-4d5f-87c4-25562d7b31b0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:50.465870 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab3886e0-18b7-4d5f-87c4-25562d7b31b0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:50.467209 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab3886e0-18b7-4d5f-87c4-25562d7b31b0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:50.467585 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7dd12831-2723-4e34-a3e4-7267f3324021 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] 10.222.0.60 "GET /compute/v2.1/servers/6c2ed037-84ac-463b-a42d-01a03532cc43" status: 200 len: 1316 microversion: 2.1 time: 0.543621 Oct 18 15:39:50.468025 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab3886e0-18b7-4d5f-87c4-25562d7b31b0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:50.468377 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1712/3415] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:49 2022] GET /compute/v2.1/servers/6c2ed037-84ac-463b-a42d-01a03532cc43 => generated 1316 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:50.469021 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab3886e0-18b7-4d5f-87c4-25562d7b31b0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:50.476487 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-97fc672c-0c9a-4197-a383-0b1e5901949a tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:50.477531 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-97fc672c-0c9a-4197-a383-0b1e5901949a tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] [instance: a7f435f2-096a-4c79-b5f4-378c1e8b4e3e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:50.485282 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97fc672c-0c9a-4197-a383-0b1e5901949a tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:50.486827 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97fc672c-0c9a-4197-a383-0b1e5901949a tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:50.487225 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97fc672c-0c9a-4197-a383-0b1e5901949a tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:50.488525 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97fc672c-0c9a-4197-a383-0b1e5901949a tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:50.489654 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97fc672c-0c9a-4197-a383-0b1e5901949a tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:50.489654 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97fc672c-0c9a-4197-a383-0b1e5901949a tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:50.843966 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ab3886e0-18b7-4d5f-87c4-25562d7b31b0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:50.848921 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:39:50.864129 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ab3886e0-18b7-4d5f-87c4-25562d7b31b0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/60621af7-3f40-45ac-8e96-2a2f7444d372" status: 200 len: 1502 microversion: 2.1 time: 0.415650 Oct 18 15:39:50.872866 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1704/3416] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:50 2022] GET /compute/v2.1/servers/60621af7-3f40-45ac-8e96-2a2f7444d372 => generated 1502 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:50.877983 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c35b3161-b392-4c8c-943e-1457e8decccd tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:50.878821 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c35b3161-b392-4c8c-943e-1457e8decccd tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 4a23be5e-9334-4385-9476-4bbd81995002] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:50.898142 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c35b3161-b392-4c8c-943e-1457e8decccd tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:50.898647 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c35b3161-b392-4c8c-943e-1457e8decccd tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:50.899090 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c35b3161-b392-4c8c-943e-1457e8decccd tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:50.899818 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c35b3161-b392-4c8c-943e-1457e8decccd tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:50.900273 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c35b3161-b392-4c8c-943e-1457e8decccd tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:50.902642 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c35b3161-b392-4c8c-943e-1457e8decccd tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:50.907841 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-97fc672c-0c9a-4197-a383-0b1e5901949a tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5a4b02c2a74519baa305e3b7659519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504166c44064437ca4e25acd180bea8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:50.922370 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-97fc672c-0c9a-4197-a383-0b1e5901949a tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] 10.222.0.60 "GET /compute/v2.1/servers/a7f435f2-096a-4c79-b5f4-378c1e8b4e3e" status: 200 len: 1504 microversion: 2.1 time: 0.451119 Oct 18 15:39:50.925180 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1713/3417] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:50 2022] GET /compute/v2.1/servers/a7f435f2-096a-4c79-b5f4-378c1e8b4e3e => generated 1504 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:50.931347 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6b0d626a-f0b7-492b-8f71-79b350cf6578 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:50.931838 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6b0d626a-f0b7-492b-8f71-79b350cf6578 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: d280f396-df42-482a-b0c1-9a8a9b608f57] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:50.948052 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6b0d626a-f0b7-492b-8f71-79b350cf6578 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:50.948941 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6b0d626a-f0b7-492b-8f71-79b350cf6578 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:50.949611 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6b0d626a-f0b7-492b-8f71-79b350cf6578 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:50.950982 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6b0d626a-f0b7-492b-8f71-79b350cf6578 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:50.951855 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6b0d626a-f0b7-492b-8f71-79b350cf6578 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:50.967051 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6b0d626a-f0b7-492b-8f71-79b350cf6578 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:51.004331 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6b0d626a-f0b7-492b-8f71-79b350cf6578 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: d280f396-df42-482a-b0c1-9a8a9b608f57] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:39:51.025085 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=100 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:39:51.132358 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6b0d626a-f0b7-492b-8f71-79b350cf6578 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57" status: 204 len: 0 microversion: 2.1 time: 0.204655 Oct 18 15:39:51.136931 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1714/3418] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:39:50 2022] DELETE /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:39:51.149428 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-93baa622-70ce-49b8-820e-4bac6bb2c3a6 req-df4ef74b-81a5-4707-9c76-bca019b2dbe9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf8f81da-4aa0-498d-af1e-c036238f065d", "tag": "6804cdcb-ecb6-4eec-8de0-cc16a6d64f70"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:39:51.163224 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-93baa622-70ce-49b8-820e-4bac6bb2c3a6 req-df4ef74b-81a5-4707-9c76-bca019b2dbe9 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:51.163998 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-93baa622-70ce-49b8-820e-4bac6bb2c3a6 req-df4ef74b-81a5-4707-9c76-bca019b2dbe9 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:51.165461 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-93baa622-70ce-49b8-820e-4bac6bb2c3a6 req-df4ef74b-81a5-4707-9c76-bca019b2dbe9 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:51.184596 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-93baa622-70ce-49b8-820e-4bac6bb2c3a6 req-df4ef74b-81a5-4707-9c76-bca019b2dbe9 service nova] Creating event network-changed:6804cdcb-ecb6-4eec-8de0-cc16a6d64f70 for instance cf8f81da-4aa0-498d-af1e-c036238f065d on n-h2-853682-5 Oct 18 15:39:51.187373 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c35b3161-b392-4c8c-943e-1457e8decccd tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:51.192486 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-93baa622-70ce-49b8-820e-4bac6bb2c3a6 req-df4ef74b-81a5-4707-9c76-bca019b2dbe9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052934 Oct 18 15:39:51.193902 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1715/3419] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:39:51.200488 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c35b3161-b392-4c8c-943e-1457e8decccd tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002" status: 200 len: 1367 microversion: 2.1 time: 0.332184 Oct 18 15:39:51.202238 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1705/3420] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:50 2022] GET /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002 => generated 1367 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:51.205892 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-174ee84e-0527-4ee0-a256-8cbae8be3560 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:39:51.207586 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-174ee84e-0527-4ee0-a256-8cbae8be3560 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 60621af7-3f40-45ac-8e96-2a2f7444d372] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:51.215473 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-174ee84e-0527-4ee0-a256-8cbae8be3560 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:51.216148 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-26087a0f-a0b6-4a2e-8ff5-5fb02311b23d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:51.216307 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-174ee84e-0527-4ee0-a256-8cbae8be3560 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:51.216797 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-26087a0f-a0b6-4a2e-8ff5-5fb02311b23d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: d280f396-df42-482a-b0c1-9a8a9b608f57] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:51.216947 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-174ee84e-0527-4ee0-a256-8cbae8be3560 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:51.217559 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-174ee84e-0527-4ee0-a256-8cbae8be3560 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:51.218157 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-174ee84e-0527-4ee0-a256-8cbae8be3560 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:51.220942 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-174ee84e-0527-4ee0-a256-8cbae8be3560 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:51.226536 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26087a0f-a0b6-4a2e-8ff5-5fb02311b23d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:51.227402 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26087a0f-a0b6-4a2e-8ff5-5fb02311b23d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:51.228206 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26087a0f-a0b6-4a2e-8ff5-5fb02311b23d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:51.229710 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26087a0f-a0b6-4a2e-8ff5-5fb02311b23d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:51.230340 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26087a0f-a0b6-4a2e-8ff5-5fb02311b23d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:51.231004 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26087a0f-a0b6-4a2e-8ff5-5fb02311b23d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:51.254244 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-174ee84e-0527-4ee0-a256-8cbae8be3560 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lazy-loading 'flavor' on Instance uuid 60621af7-3f40-45ac-8e96-2a2f7444d372 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:39:51.348381 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-174ee84e-0527-4ee0-a256-8cbae8be3560 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "POST /compute/v2.1/servers/60621af7-3f40-45ac-8e96-2a2f7444d372/action" status: 202 len: 0 microversion: 2.1 time: 0.152598 Oct 18 15:39:51.352037 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1716/3421] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:39:51 2022] POST /compute/v2.1/servers/60621af7-3f40-45ac-8e96-2a2f7444d372/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:39:51.359687 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-da63f9ef-14be-4e8f-a935-089643ea0a65 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:51.361085 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-da63f9ef-14be-4e8f-a935-089643ea0a65 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 60621af7-3f40-45ac-8e96-2a2f7444d372] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:51.375629 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-da63f9ef-14be-4e8f-a935-089643ea0a65 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:51.376147 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-da63f9ef-14be-4e8f-a935-089643ea0a65 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:51.376711 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-da63f9ef-14be-4e8f-a935-089643ea0a65 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:51.378190 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-da63f9ef-14be-4e8f-a935-089643ea0a65 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:51.379478 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-da63f9ef-14be-4e8f-a935-089643ea0a65 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:51.381316 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-da63f9ef-14be-4e8f-a935-089643ea0a65 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:51.895469 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-26087a0f-a0b6-4a2e-8ff5-5fb02311b23d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:51.903840 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-26087a0f-a0b6-4a2e-8ff5-5fb02311b23d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57" status: 200 len: 1469 microversion: 2.1 time: 0.699365 Oct 18 15:39:51.907731 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1706/3422] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:51 2022] GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57 => generated 1469 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:51.912766 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9408849a-a89e-4399-a957-e997f73e7e70 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:51.919501 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9408849a-a89e-4399-a957-e997f73e7e70 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] [instance: 6c2ed037-84ac-463b-a42d-01a03532cc43] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:51.933568 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9408849a-a89e-4399-a957-e997f73e7e70 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:51.934370 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9408849a-a89e-4399-a957-e997f73e7e70 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:51.940988 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9408849a-a89e-4399-a957-e997f73e7e70 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:51.942514 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9408849a-a89e-4399-a957-e997f73e7e70 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:51.943139 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9408849a-a89e-4399-a957-e997f73e7e70 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:51.943716 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9408849a-a89e-4399-a957-e997f73e7e70 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:51.959725 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-da63f9ef-14be-4e8f-a935-089643ea0a65 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:51.986680 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-da63f9ef-14be-4e8f-a935-089643ea0a65 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/60621af7-3f40-45ac-8e96-2a2f7444d372" status: 200 len: 1510 microversion: 2.1 time: 0.631706 Oct 18 15:39:52.001913 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1717/3423] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:51 2022] GET /compute/v2.1/servers/60621af7-3f40-45ac-8e96-2a2f7444d372 => generated 1510 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:52.013485 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fb7c8b44-39f8-4861-99e5-811538a2fc1e tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:52.014110 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-fb7c8b44-39f8-4861-99e5-811538a2fc1e tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] [instance: a7f435f2-096a-4c79-b5f4-378c1e8b4e3e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:52.048690 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fb7c8b44-39f8-4861-99e5-811538a2fc1e tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:52.049335 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fb7c8b44-39f8-4861-99e5-811538a2fc1e tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:52.049790 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fb7c8b44-39f8-4861-99e5-811538a2fc1e tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:52.051735 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fb7c8b44-39f8-4861-99e5-811538a2fc1e tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:52.052207 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fb7c8b44-39f8-4861-99e5-811538a2fc1e tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:52.052634 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fb7c8b44-39f8-4861-99e5-811538a2fc1e tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:52.293015 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-fb7c8b44-39f8-4861-99e5-811538a2fc1e tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5a4b02c2a74519baa305e3b7659519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504166c44064437ca4e25acd180bea8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:52.310197 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fb7c8b44-39f8-4861-99e5-811538a2fc1e tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] 10.222.0.60 "GET /compute/v2.1/servers/a7f435f2-096a-4c79-b5f4-378c1e8b4e3e" status: 200 len: 1298 microversion: 2.1 time: 0.306978 Oct 18 15:39:52.322090 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1718/3424] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:52 2022] GET /compute/v2.1/servers/a7f435f2-096a-4c79-b5f4-378c1e8b4e3e => generated 1298 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:52.334140 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7f24c900-7a7d-4dbb-85b5-d72461a8b89d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:52.334767 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7f24c900-7a7d-4dbb-85b5-d72461a8b89d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 4a23be5e-9334-4385-9476-4bbd81995002] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:52.341487 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7f24c900-7a7d-4dbb-85b5-d72461a8b89d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:52.341884 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7f24c900-7a7d-4dbb-85b5-d72461a8b89d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:52.342323 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7f24c900-7a7d-4dbb-85b5-d72461a8b89d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:52.343544 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7f24c900-7a7d-4dbb-85b5-d72461a8b89d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:52.344027 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7f24c900-7a7d-4dbb-85b5-d72461a8b89d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:52.344457 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7f24c900-7a7d-4dbb-85b5-d72461a8b89d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:52.381221 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:39:52.402708 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=14 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:39:52.585939 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9408849a-a89e-4399-a957-e997f73e7e70 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386f58c6593d43d2829e08fbdb9ed769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e75e5c7ef1b48cfb696da32fa30b845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:52.607885 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9408849a-a89e-4399-a957-e997f73e7e70 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] 10.222.0.60 "GET /compute/v2.1/servers/6c2ed037-84ac-463b-a42d-01a03532cc43" status: 200 len: 1506 microversion: 2.1 time: 0.698825 Oct 18 15:39:52.612564 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1707/3425] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:51 2022] GET /compute/v2.1/servers/6c2ed037-84ac-463b-a42d-01a03532cc43 => generated 1506 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:52.622161 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-cd3bf94d-a55c-4326-9ebc-376ece1e0890 req-257f185c-9c4e-4795-9c9e-897ff7e94183 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d280f396-df42-482a-b0c1-9a8a9b608f57", "name": "network-vif-plugged", "status": "completed", "tag": "f518ff61-30b3-4c0b-a3c2-3c35a22e45aa"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:39:52.653271 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-cd3bf94d-a55c-4326-9ebc-376ece1e0890 req-257f185c-9c4e-4795-9c9e-897ff7e94183 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:52.653884 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-cd3bf94d-a55c-4326-9ebc-376ece1e0890 req-257f185c-9c4e-4795-9c9e-897ff7e94183 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:52.654605 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-cd3bf94d-a55c-4326-9ebc-376ece1e0890 req-257f185c-9c4e-4795-9c9e-897ff7e94183 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:52.681068 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-cd3bf94d-a55c-4326-9ebc-376ece1e0890 req-257f185c-9c4e-4795-9c9e-897ff7e94183 service nova] Creating event network-vif-plugged:f518ff61-30b3-4c0b-a3c2-3c35a22e45aa for instance d280f396-df42-482a-b0c1-9a8a9b608f57 on n-h1-853682-5 Oct 18 15:39:52.692034 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7f24c900-7a7d-4dbb-85b5-d72461a8b89d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:52.702729 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7f24c900-7a7d-4dbb-85b5-d72461a8b89d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002" status: 200 len: 1367 microversion: 2.1 time: 0.378828 Oct 18 15:39:52.702729 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1719/3426] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:52 2022] GET /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002 => generated 1367 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:52.713167 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-cd3bf94d-a55c-4326-9ebc-376ece1e0890 req-257f185c-9c4e-4795-9c9e-897ff7e94183 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090993 Oct 18 15:39:52.713167 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1708/3427] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:39:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:39:52.716302 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a5a63c3f-a569-4156-83f3-70118cf5357a tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:52.716869 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a5a63c3f-a569-4156-83f3-70118cf5357a tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] [instance: 6c2ed037-84ac-463b-a42d-01a03532cc43] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:52.725634 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a5a63c3f-a569-4156-83f3-70118cf5357a tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:52.726134 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a5a63c3f-a569-4156-83f3-70118cf5357a tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:52.726575 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a5a63c3f-a569-4156-83f3-70118cf5357a tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:52.727298 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a5a63c3f-a569-4156-83f3-70118cf5357a tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:52.727765 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a5a63c3f-a569-4156-83f3-70118cf5357a tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:52.728542 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a5a63c3f-a569-4156-83f3-70118cf5357a tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:52.771516 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a5a63c3f-a569-4156-83f3-70118cf5357a tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '386f58c6593d43d2829e08fbdb9ed769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e75e5c7ef1b48cfb696da32fa30b845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:52.772510 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a5a63c3f-a569-4156-83f3-70118cf5357a tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] 10.222.0.60 "GET /compute/v2.1/servers/6c2ed037-84ac-463b-a42d-01a03532cc43/os-instance-actions/req-bb01b806-b0fc-467a-9557-883283b7be4d" status: 200 len: 313 microversion: 2.1 time: 0.060579 Oct 18 15:39:52.782226 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1720/3428] 10.222.0.60 () {58 vars in 1419 bytes} [Tue Oct 18 15:39:52 2022] GET /compute/v2.1/servers/6c2ed037-84ac-463b-a42d-01a03532cc43/os-instance-actions/req-bb01b806-b0fc-467a-9557-883283b7be4d => generated 313 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:39:52.789242 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5f1eb45b-65d5-4886-80cd-d4667ddd5cee tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:39:52.791642 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5f1eb45b-65d5-4886-80cd-d4667ddd5cee tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] [instance: 6c2ed037-84ac-463b-a42d-01a03532cc43] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:52.805291 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f1eb45b-65d5-4886-80cd-d4667ddd5cee tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:52.805893 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f1eb45b-65d5-4886-80cd-d4667ddd5cee tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:52.806251 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f1eb45b-65d5-4886-80cd-d4667ddd5cee tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:52.812010 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f1eb45b-65d5-4886-80cd-d4667ddd5cee tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:52.812494 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f1eb45b-65d5-4886-80cd-d4667ddd5cee tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:52.813230 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f1eb45b-65d5-4886-80cd-d4667ddd5cee tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:52.931048 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ad4e5677-f58c-4d36-898f-d73a5a600bf0 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:52.931955 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ad4e5677-f58c-4d36-898f-d73a5a600bf0 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: d280f396-df42-482a-b0c1-9a8a9b608f57] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:52.949624 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ad4e5677-f58c-4d36-898f-d73a5a600bf0 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:52.952043 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ad4e5677-f58c-4d36-898f-d73a5a600bf0 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:52.954851 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ad4e5677-f58c-4d36-898f-d73a5a600bf0 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:52.959502 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ad4e5677-f58c-4d36-898f-d73a5a600bf0 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:52.961680 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ad4e5677-f58c-4d36-898f-d73a5a600bf0 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:52.963723 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ad4e5677-f58c-4d36-898f-d73a5a600bf0 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:53.043009 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5f1eb45b-65d5-4886-80cd-d4667ddd5cee tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] 10.222.0.60 "POST /compute/v2.1/servers/6c2ed037-84ac-463b-a42d-01a03532cc43/action" status: 202 len: 0 microversion: 2.1 time: 0.258868 Oct 18 15:39:53.043921 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1709/3429] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:39:52 2022] POST /compute/v2.1/servers/6c2ed037-84ac-463b-a42d-01a03532cc43/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:39:53.056307 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5d2ab850-60fe-4cc8-9115-bc8f11079aeb tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:53.057672 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5d2ab850-60fe-4cc8-9115-bc8f11079aeb tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 60621af7-3f40-45ac-8e96-2a2f7444d372] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:53.074996 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d2ab850-60fe-4cc8-9115-bc8f11079aeb tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:53.077099 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d2ab850-60fe-4cc8-9115-bc8f11079aeb tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:53.077874 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d2ab850-60fe-4cc8-9115-bc8f11079aeb tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:53.079924 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d2ab850-60fe-4cc8-9115-bc8f11079aeb tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:53.082543 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d2ab850-60fe-4cc8-9115-bc8f11079aeb tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:53.083767 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d2ab850-60fe-4cc8-9115-bc8f11079aeb tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:53.708582 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ad4e5677-f58c-4d36-898f-d73a5a600bf0 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:53.718934 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ad4e5677-f58c-4d36-898f-d73a5a600bf0 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57" status: 200 len: 1469 microversion: 2.1 time: 0.792017 Oct 18 15:39:53.720271 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1721/3430] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:52 2022] GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57 => generated 1469 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:39:53.726307 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9e0e398b-3f4e-4cce-ae1a-9b29e39ec194 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:53.727445 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9e0e398b-3f4e-4cce-ae1a-9b29e39ec194 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] [instance: 6c2ed037-84ac-463b-a42d-01a03532cc43] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:53.740848 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9e0e398b-3f4e-4cce-ae1a-9b29e39ec194 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:53.741640 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9e0e398b-3f4e-4cce-ae1a-9b29e39ec194 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:53.742252 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9e0e398b-3f4e-4cce-ae1a-9b29e39ec194 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:53.743125 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9e0e398b-3f4e-4cce-ae1a-9b29e39ec194 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:53.743742 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9e0e398b-3f4e-4cce-ae1a-9b29e39ec194 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:53.744328 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9e0e398b-3f4e-4cce-ae1a-9b29e39ec194 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:53.748891 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5d2ab850-60fe-4cc8-9115-bc8f11079aeb tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:53.759359 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5d2ab850-60fe-4cc8-9115-bc8f11079aeb tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/60621af7-3f40-45ac-8e96-2a2f7444d372" status: 200 len: 1510 microversion: 2.1 time: 0.713922 Oct 18 15:39:53.759947 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1710/3431] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:53 2022] GET /compute/v2.1/servers/60621af7-3f40-45ac-8e96-2a2f7444d372 => generated 1510 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:53.767467 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-1505ec59-b0fc-4d1b-a30e-24747e531ad6 req-6243f9e4-13d5-411d-8eba-d390bc262180 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7f435f2-096a-4c79-b5f4-378c1e8b4e3e", "name": "network-vif-deleted", "tag": "a0ae55c0-7832-4d00-a7a4-ef21a021e818"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:39:53.793423 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1505ec59-b0fc-4d1b-a30e-24747e531ad6 req-6243f9e4-13d5-411d-8eba-d390bc262180 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:53.794287 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1505ec59-b0fc-4d1b-a30e-24747e531ad6 req-6243f9e4-13d5-411d-8eba-d390bc262180 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:53.797409 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1505ec59-b0fc-4d1b-a30e-24747e531ad6 req-6243f9e4-13d5-411d-8eba-d390bc262180 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:53.823685 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-1505ec59-b0fc-4d1b-a30e-24747e531ad6 req-6243f9e4-13d5-411d-8eba-d390bc262180 service nova] Creating event network-vif-deleted:a0ae55c0-7832-4d00-a7a4-ef21a021e818 for instance a7f435f2-096a-4c79-b5f4-378c1e8b4e3e on n-h2-853682-5 Oct 18 15:39:53.830254 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-1505ec59-b0fc-4d1b-a30e-24747e531ad6 req-6243f9e4-13d5-411d-8eba-d390bc262180 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066066 Oct 18 15:39:53.831645 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1711/3432] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:39:53.838037 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-81d10376-39a0-44af-a941-a8f0cf41d66a tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:53.839137 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-81d10376-39a0-44af-a941-a8f0cf41d66a tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] [instance: a7f435f2-096a-4c79-b5f4-378c1e8b4e3e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:53.848861 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81d10376-39a0-44af-a941-a8f0cf41d66a tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:53.849600 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81d10376-39a0-44af-a941-a8f0cf41d66a tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:53.850258 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81d10376-39a0-44af-a941-a8f0cf41d66a tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:53.852496 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81d10376-39a0-44af-a941-a8f0cf41d66a tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:53.853831 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81d10376-39a0-44af-a941-a8f0cf41d66a tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:53.854500 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81d10376-39a0-44af-a941-a8f0cf41d66a tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:53.873935 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-81d10376-39a0-44af-a941-a8f0cf41d66a tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] HTTP exception thrown: Instance a7f435f2-096a-4c79-b5f4-378c1e8b4e3e could not be found. Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-81d10376-39a0-44af-a941-a8f0cf41d66a tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Request method failure captured: Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/a7f435f2-096a-4c79-b5f4-378c1e8b4e3e HTTP/1.1 Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsiaYE3_gb0hyqeZVwlcsXCpltKxLKTUvx7s2j3wKMR7UTSFQjkB6JdLDQzqq1uY7FF-Qf6K_7IRfG2uGkznzpreHhn2Uwdg5_Ix6uVO4CkrMBT_bFHcq6kzhq9hoxcFZTM6neGmMVgnyPSqdvHh5bg5x5-QY-tPQ6OT5CNTlV3OFWc Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 504166c44064437ca4e25acd180bea8f Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerGroupTestJSON-287122153 Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/504166c44064437ca4e25acd180bea8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/504166c44064437ca4e25acd180bea8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/504166c44064437ca4e25acd180bea8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_504166c44064437ca4e25acd180bea8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServerGroupTestJSON-287122153 Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 504166c44064437ca4e25acd180bea8f Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerGroupTestJSON-287122153 Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServerGroupTestJSON-287122153-project Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 9b5a4b02c2a74519baa305e3b7659519 Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServerGroupTestJSON-287122153-project Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance a7f435f2-096a-4c79-b5f4-378c1e8b4e3e could not be found. Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'a7f435f2-096a-4c79-b5f4-378c1e8b4e3e'} Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7f435f2-096a-4c79-b5f4-378c1e8b4e3e could not be found. Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7f435f2-096a-4c79-b5f4-378c1e8b4e3e could not be found. Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:39:53.876288 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:39:53.883605 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:39:53.883605 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:39:53.883605 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:39:53.883605 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:39:53.883605 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:39:53.883605 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7f435f2-096a-4c79-b5f4-378c1e8b4e3e could not be found. Oct 18 15:39:53.883605 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:39:53.886606 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-81d10376-39a0-44af-a941-a8f0cf41d66a tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Returning 404 to user: Instance a7f435f2-096a-4c79-b5f4-378c1e8b4e3e could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:39:53.888878 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-81d10376-39a0-44af-a941-a8f0cf41d66a tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] 10.222.0.60 "GET /compute/v2.1/servers/a7f435f2-096a-4c79-b5f4-378c1e8b4e3e" status: 404 len: 111 microversion: 2.1 time: 0.054436 Oct 18 15:39:53.900115 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1712/3433] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:53 2022] GET /compute/v2.1/servers/a7f435f2-096a-4c79-b5f4-378c1e8b4e3e => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:39:53.903309 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ea60ff23-f628-4bab-8fc6-b36fe83054cf tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:53.904272 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ea60ff23-f628-4bab-8fc6-b36fe83054cf tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 4a23be5e-9334-4385-9476-4bbd81995002] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:53.912480 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea60ff23-f628-4bab-8fc6-b36fe83054cf tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:53.913230 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea60ff23-f628-4bab-8fc6-b36fe83054cf tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:53.913766 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea60ff23-f628-4bab-8fc6-b36fe83054cf tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:53.914784 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea60ff23-f628-4bab-8fc6-b36fe83054cf tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:53.915600 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea60ff23-f628-4bab-8fc6-b36fe83054cf tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:53.916185 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea60ff23-f628-4bab-8fc6-b36fe83054cf tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:54.276310 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ea60ff23-f628-4bab-8fc6-b36fe83054cf tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:54.289438 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ea60ff23-f628-4bab-8fc6-b36fe83054cf tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002" status: 200 len: 1367 microversion: 2.1 time: 0.386339 Oct 18 15:39:54.304623 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1713/3434] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:53 2022] GET /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002 => generated 1367 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:54.310095 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-13a5b4cb-99eb-4971-b9c6-75e89e80eb04 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:54.332516 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.compute.server_groups [None req-13a5b4cb-99eb-4971-b9c6-75e89e80eb04 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Querying cell 8ab54c98-adc3-429d-89a9-d68fdb0f782a(cell1) for 1 instances {{(pid=120406) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 18 15:39:54.334410 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9e0e398b-3f4e-4cce-ae1a-9b29e39ec194 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386f58c6593d43d2829e08fbdb9ed769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e75e5c7ef1b48cfb696da32fa30b845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:54.334929 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13a5b4cb-99eb-4971-b9c6-75e89e80eb04 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:54.335459 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13a5b4cb-99eb-4971-b9c6-75e89e80eb04 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:54.335993 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13a5b4cb-99eb-4971-b9c6-75e89e80eb04 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:54.349237 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-13a5b4cb-99eb-4971-b9c6-75e89e80eb04 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] 10.222.0.60 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.042851 Oct 18 15:39:54.350573 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9e0e398b-3f4e-4cce-ae1a-9b29e39ec194 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] 10.222.0.60 "GET /compute/v2.1/servers/6c2ed037-84ac-463b-a42d-01a03532cc43" status: 200 len: 1508 microversion: 2.1 time: 0.628756 Oct 18 15:39:54.351799 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1714/3435] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Oct 18 15:39:54 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:39:54.353301 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1722/3436] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:53 2022] GET /compute/v2.1/servers/6c2ed037-84ac-463b-a42d-01a03532cc43 => generated 1508 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:54.368956 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-90abb00c-f849-49d0-bd51-e158adba0eb7 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:54.400978 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.compute.server_groups [None req-90abb00c-f849-49d0-bd51-e158adba0eb7 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Querying cell 8ab54c98-adc3-429d-89a9-d68fdb0f782a(cell1) for 1 instances {{(pid=120406) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 18 15:39:54.402284 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90abb00c-f849-49d0-bd51-e158adba0eb7 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:54.402763 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90abb00c-f849-49d0-bd51-e158adba0eb7 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:54.403195 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90abb00c-f849-49d0-bd51-e158adba0eb7 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:54.414816 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-90abb00c-f849-49d0-bd51-e158adba0eb7 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] 10.222.0.60 "GET /compute/v2.1/os-server-groups/57496904-0426-40af-b581-96f66ac2e236" status: 200 len: 184 microversion: 2.1 time: 0.051898 Oct 18 15:39:54.416126 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1715/3437] 10.222.0.60 () {58 vars in 1263 bytes} [Tue Oct 18 15:39:54 2022] GET /compute/v2.1/os-server-groups/57496904-0426-40af-b581-96f66ac2e236 => generated 184 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:39:54.430014 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9b177b51-efe1-4dcf-9fa4-4f99aa258d60 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:54.430548 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9b177b51-efe1-4dcf-9fa4-4f99aa258d60 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] [instance: a7f435f2-096a-4c79-b5f4-378c1e8b4e3e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:54.437607 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9b177b51-efe1-4dcf-9fa4-4f99aa258d60 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:54.438422 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9b177b51-efe1-4dcf-9fa4-4f99aa258d60 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:54.439015 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9b177b51-efe1-4dcf-9fa4-4f99aa258d60 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:54.440033 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9b177b51-efe1-4dcf-9fa4-4f99aa258d60 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:54.440642 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9b177b51-efe1-4dcf-9fa4-4f99aa258d60 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:54.441289 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9b177b51-efe1-4dcf-9fa4-4f99aa258d60 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:54.456682 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-9b177b51-efe1-4dcf-9fa4-4f99aa258d60 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] HTTP exception thrown: Instance a7f435f2-096a-4c79-b5f4-378c1e8b4e3e could not be found. Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9b177b51-efe1-4dcf-9fa4-4f99aa258d60 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Request method failure captured: Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: request: DELETE /compute/v2.1/servers/a7f435f2-096a-4c79-b5f4-378c1e8b4e3e HTTP/1.1 Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsiaYE3_gb0hyqeZVwlcsXCpltKxLKTUvx7s2j3wKMR7UTSFQjkB6JdLDQzqq1uY7FF-Qf6K_7IRfG2uGkznzpreHhn2Uwdg5_Ix6uVO4CkrMBT_bFHcq6kzhq9hoxcFZTM6neGmMVgnyPSqdvHh5bg5x5-QY-tPQ6OT5CNTlV3OFWc Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 504166c44064437ca4e25acd180bea8f Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServerGroupTestJSON-287122153 Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/504166c44064437ca4e25acd180bea8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/504166c44064437ca4e25acd180bea8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/504166c44064437ca4e25acd180bea8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_504166c44064437ca4e25acd180bea8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServerGroupTestJSON-287122153 Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 504166c44064437ca4e25acd180bea8f Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServerGroupTestJSON-287122153 Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServerGroupTestJSON-287122153-project Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 9b5a4b02c2a74519baa305e3b7659519 Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServerGroupTestJSON-287122153-project Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance a7f435f2-096a-4c79-b5f4-378c1e8b4e3e could not be found. Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'a7f435f2-096a-4c79-b5f4-378c1e8b4e3e'} Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7f435f2-096a-4c79-b5f4-378c1e8b4e3e could not be found. Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:39:54.458707 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:39:54.462828 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7f435f2-096a-4c79-b5f4-378c1e8b4e3e could not be found. Oct 18 15:39:54.462828 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:39:54.462828 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:39:54.462828 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:39:54.462828 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:39:54.462828 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:39:54.462828 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:39:54.462828 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:39:54.462828 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:39:54.462828 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7f435f2-096a-4c79-b5f4-378c1e8b4e3e could not be found. Oct 18 15:39:54.462828 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:39:54.465132 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9b177b51-efe1-4dcf-9fa4-4f99aa258d60 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Returning 404 to user: Instance a7f435f2-096a-4c79-b5f4-378c1e8b4e3e could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:39:54.466224 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9b177b51-efe1-4dcf-9fa4-4f99aa258d60 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a7f435f2-096a-4c79-b5f4-378c1e8b4e3e" status: 404 len: 111 microversion: 2.1 time: 0.040871 Oct 18 15:39:54.466998 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1723/3438] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:39:54 2022] DELETE /compute/v2.1/servers/a7f435f2-096a-4c79-b5f4-378c1e8b4e3e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:39:54.476795 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a4a7c2f8-a051-4a5e-9653-509df44228e4 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:54.477931 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a4a7c2f8-a051-4a5e-9653-509df44228e4 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] [instance: a7f435f2-096a-4c79-b5f4-378c1e8b4e3e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:54.485599 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4a7c2f8-a051-4a5e-9653-509df44228e4 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:54.486316 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4a7c2f8-a051-4a5e-9653-509df44228e4 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:54.486822 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4a7c2f8-a051-4a5e-9653-509df44228e4 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:54.487601 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4a7c2f8-a051-4a5e-9653-509df44228e4 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:54.488639 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4a7c2f8-a051-4a5e-9653-509df44228e4 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:54.489196 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4a7c2f8-a051-4a5e-9653-509df44228e4 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:54.503705 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-a4a7c2f8-a051-4a5e-9653-509df44228e4 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] HTTP exception thrown: Instance a7f435f2-096a-4c79-b5f4-378c1e8b4e3e could not be found. Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a4a7c2f8-a051-4a5e-9653-509df44228e4 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Request method failure captured: Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/a7f435f2-096a-4c79-b5f4-378c1e8b4e3e HTTP/1.1 Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsiaYE3_gb0hyqeZVwlcsXCpltKxLKTUvx7s2j3wKMR7UTSFQjkB6JdLDQzqq1uY7FF-Qf6K_7IRfG2uGkznzpreHhn2Uwdg5_Ix6uVO4CkrMBT_bFHcq6kzhq9hoxcFZTM6neGmMVgnyPSqdvHh5bg5x5-QY-tPQ6OT5CNTlV3OFWc Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 504166c44064437ca4e25acd180bea8f Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerGroupTestJSON-287122153 Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/504166c44064437ca4e25acd180bea8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/504166c44064437ca4e25acd180bea8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/504166c44064437ca4e25acd180bea8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_504166c44064437ca4e25acd180bea8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServerGroupTestJSON-287122153 Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 504166c44064437ca4e25acd180bea8f Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerGroupTestJSON-287122153 Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServerGroupTestJSON-287122153-project Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 9b5a4b02c2a74519baa305e3b7659519 Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServerGroupTestJSON-287122153-project Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance a7f435f2-096a-4c79-b5f4-378c1e8b4e3e could not be found. Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'a7f435f2-096a-4c79-b5f4-378c1e8b4e3e'} Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7f435f2-096a-4c79-b5f4-378c1e8b4e3e could not be found. Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7f435f2-096a-4c79-b5f4-378c1e8b4e3e could not be found. Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:39:54.505683 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:39:54.509716 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:39:54.509716 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:39:54.509716 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:39:54.509716 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:39:54.509716 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:39:54.509716 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7f435f2-096a-4c79-b5f4-378c1e8b4e3e could not be found. Oct 18 15:39:54.509716 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:39:54.509716 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a4a7c2f8-a051-4a5e-9653-509df44228e4 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Returning 404 to user: Instance a7f435f2-096a-4c79-b5f4-378c1e8b4e3e could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:39:54.509716 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a4a7c2f8-a051-4a5e-9653-509df44228e4 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] 10.222.0.60 "GET /compute/v2.1/servers/a7f435f2-096a-4c79-b5f4-378c1e8b4e3e" status: 404 len: 111 microversion: 2.1 time: 0.035850 Oct 18 15:39:54.509716 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1716/3439] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:54 2022] GET /compute/v2.1/servers/a7f435f2-096a-4c79-b5f4-378c1e8b4e3e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:39:54.516401 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-84ab01ed-1495-4a60-9568-336a4f8ce8c8 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:54.522809 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-84ab01ed-1495-4a60-9568-336a4f8ce8c8 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] HTTP exception thrown: Instance group eda0aefe-7bea-4d80-8102-116d8587829b could not be found. Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-84ab01ed-1495-4a60-9568-336a4f8ce8c8 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Request method failure captured: Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: request: DELETE /compute/v2.1/os-server-groups/eda0aefe-7bea-4d80-8102-116d8587829b HTTP/1.1 Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsiaYE3_gb0hyqeZVwlcsXCpltKxLKTUvx7s2j3wKMR7UTSFQjkB6JdLDQzqq1uY7FF-Qf6K_7IRfG2uGkznzpreHhn2Uwdg5_Ix6uVO4CkrMBT_bFHcq6kzhq9hoxcFZTM6neGmMVgnyPSqdvHh5bg5x5-QY-tPQ6OT5CNTlV3OFWc Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 504166c44064437ca4e25acd180bea8f Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServerGroupTestJSON-287122153 Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/504166c44064437ca4e25acd180bea8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/504166c44064437ca4e25acd180bea8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/504166c44064437ca4e25acd180bea8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_504166c44064437ca4e25acd180bea8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServerGroupTestJSON-287122153 Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 504166c44064437ca4e25acd180bea8f Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServerGroupTestJSON-287122153 Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServerGroupTestJSON-287122153-project Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 9b5a4b02c2a74519baa305e3b7659519 Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServerGroupTestJSON-287122153-project Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance group eda0aefe-7bea-4d80-8102-116d8587829b could not be found. Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'eda0aefe-7bea-4d80-8102-116d8587829b'} Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group eda0aefe-7bea-4d80-8102-116d8587829b could not be found. Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group eda0aefe-7bea-4d80-8102-116d8587829b could not be found. Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:39:54.532032 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:39:54.539116 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:39:54.539116 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:39:54.539116 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:39:54.539116 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:39:54.539116 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group eda0aefe-7bea-4d80-8102-116d8587829b could not be found. Oct 18 15:39:54.539116 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:39:54.539116 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-84ab01ed-1495-4a60-9568-336a4f8ce8c8 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Returning 404 to user: Instance group eda0aefe-7bea-4d80-8102-116d8587829b could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:39:54.539116 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-84ab01ed-1495-4a60-9568-336a4f8ce8c8 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/eda0aefe-7bea-4d80-8102-116d8587829b" status: 404 len: 117 microversion: 2.1 time: 0.022206 Oct 18 15:39:54.539116 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1724/3440] 10.222.0.60 () {58 vars in 1266 bytes} [Tue Oct 18 15:39:54 2022] DELETE /compute/v2.1/os-server-groups/eda0aefe-7bea-4d80-8102-116d8587829b => generated 117 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 15:39:54.544086 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5abb1e99-f48e-49b0-be83-f61910fd38bf tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:54.551744 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-5abb1e99-f48e-49b0-be83-f61910fd38bf tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] HTTP exception thrown: Instance group 4071f4c2-6f52-4b1e-afa3-253424405f69 could not be found. Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5abb1e99-f48e-49b0-be83-f61910fd38bf tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Request method failure captured: Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/os-server-groups/4071f4c2-6f52-4b1e-afa3-253424405f69 HTTP/1.1 Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsiaYE3_gb0hyqeZVwlcsXCpltKxLKTUvx7s2j3wKMR7UTSFQjkB6JdLDQzqq1uY7FF-Qf6K_7IRfG2uGkznzpreHhn2Uwdg5_Ix6uVO4CkrMBT_bFHcq6kzhq9hoxcFZTM6neGmMVgnyPSqdvHh5bg5x5-QY-tPQ6OT5CNTlV3OFWc Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 504166c44064437ca4e25acd180bea8f Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerGroupTestJSON-287122153 Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/504166c44064437ca4e25acd180bea8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/504166c44064437ca4e25acd180bea8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/504166c44064437ca4e25acd180bea8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_504166c44064437ca4e25acd180bea8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServerGroupTestJSON-287122153 Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 504166c44064437ca4e25acd180bea8f Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerGroupTestJSON-287122153 Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServerGroupTestJSON-287122153-project Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 9b5a4b02c2a74519baa305e3b7659519 Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServerGroupTestJSON-287122153-project Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance group 4071f4c2-6f52-4b1e-afa3-253424405f69 could not be found. Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '4071f4c2-6f52-4b1e-afa3-253424405f69'} Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 4071f4c2-6f52-4b1e-afa3-253424405f69 could not be found. Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 4071f4c2-6f52-4b1e-afa3-253424405f69 could not be found. Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:39:54.554716 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:39:54.560146 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:39:54.560146 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:39:54.560146 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:39:54.560146 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:39:54.560146 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 4071f4c2-6f52-4b1e-afa3-253424405f69 could not be found. Oct 18 15:39:54.560146 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:39:54.560146 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5abb1e99-f48e-49b0-be83-f61910fd38bf tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Returning 404 to user: Instance group 4071f4c2-6f52-4b1e-afa3-253424405f69 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:39:54.560146 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5abb1e99-f48e-49b0-be83-f61910fd38bf tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/4071f4c2-6f52-4b1e-afa3-253424405f69" status: 404 len: 117 microversion: 2.1 time: 0.016159 Oct 18 15:39:54.560146 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1717/3441] 10.222.0.60 () {58 vars in 1266 bytes} [Tue Oct 18 15:39:54 2022] DELETE /compute/v2.1/os-server-groups/4071f4c2-6f52-4b1e-afa3-253424405f69 => generated 117 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:39:54.567362 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7783defd-fda8-4668-99d5-00ee903bac8c tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:54.576022 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-7783defd-fda8-4668-99d5-00ee903bac8c tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] HTTP exception thrown: Instance group cb4759cd-e724-44a6-922a-dbb29846e575 could not be found. Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7783defd-fda8-4668-99d5-00ee903bac8c tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Request method failure captured: Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: request: DELETE /compute/v2.1/os-server-groups/cb4759cd-e724-44a6-922a-dbb29846e575 HTTP/1.1 Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsiaYE3_gb0hyqeZVwlcsXCpltKxLKTUvx7s2j3wKMR7UTSFQjkB6JdLDQzqq1uY7FF-Qf6K_7IRfG2uGkznzpreHhn2Uwdg5_Ix6uVO4CkrMBT_bFHcq6kzhq9hoxcFZTM6neGmMVgnyPSqdvHh5bg5x5-QY-tPQ6OT5CNTlV3OFWc Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 504166c44064437ca4e25acd180bea8f Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServerGroupTestJSON-287122153 Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/504166c44064437ca4e25acd180bea8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/504166c44064437ca4e25acd180bea8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/504166c44064437ca4e25acd180bea8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_504166c44064437ca4e25acd180bea8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServerGroupTestJSON-287122153 Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 504166c44064437ca4e25acd180bea8f Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServerGroupTestJSON-287122153 Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServerGroupTestJSON-287122153-project Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 9b5a4b02c2a74519baa305e3b7659519 Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServerGroupTestJSON-287122153-project Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance group cb4759cd-e724-44a6-922a-dbb29846e575 could not be found. Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'cb4759cd-e724-44a6-922a-dbb29846e575'} Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group cb4759cd-e724-44a6-922a-dbb29846e575 could not be found. Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group cb4759cd-e724-44a6-922a-dbb29846e575 could not be found. Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:39:54.577654 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:39:54.583455 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:39:54.583455 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:39:54.583455 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:39:54.583455 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:39:54.583455 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group cb4759cd-e724-44a6-922a-dbb29846e575 could not be found. Oct 18 15:39:54.583455 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:39:54.583455 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7783defd-fda8-4668-99d5-00ee903bac8c tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Returning 404 to user: Instance group cb4759cd-e724-44a6-922a-dbb29846e575 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:39:54.583455 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7783defd-fda8-4668-99d5-00ee903bac8c tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/cb4759cd-e724-44a6-922a-dbb29846e575" status: 404 len: 117 microversion: 2.1 time: 0.016824 Oct 18 15:39:54.583455 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1725/3442] 10.222.0.60 () {58 vars in 1266 bytes} [Tue Oct 18 15:39:54 2022] DELETE /compute/v2.1/os-server-groups/cb4759cd-e724-44a6-922a-dbb29846e575 => generated 117 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:39:54.590648 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9209cc01-f60a-42ee-a657-f84ac4d0957f tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:54.600408 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-9209cc01-f60a-42ee-a657-f84ac4d0957f tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] HTTP exception thrown: Instance group 1c06ae3b-2fb6-4d4e-966f-6d7043ccbdb5 could not be found. Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9209cc01-f60a-42ee-a657-f84ac4d0957f tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Request method failure captured: Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/os-server-groups/1c06ae3b-2fb6-4d4e-966f-6d7043ccbdb5 HTTP/1.1 Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsiaYE3_gb0hyqeZVwlcsXCpltKxLKTUvx7s2j3wKMR7UTSFQjkB6JdLDQzqq1uY7FF-Qf6K_7IRfG2uGkznzpreHhn2Uwdg5_Ix6uVO4CkrMBT_bFHcq6kzhq9hoxcFZTM6neGmMVgnyPSqdvHh5bg5x5-QY-tPQ6OT5CNTlV3OFWc Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 504166c44064437ca4e25acd180bea8f Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerGroupTestJSON-287122153 Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/504166c44064437ca4e25acd180bea8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/504166c44064437ca4e25acd180bea8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/504166c44064437ca4e25acd180bea8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_504166c44064437ca4e25acd180bea8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServerGroupTestJSON-287122153 Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 504166c44064437ca4e25acd180bea8f Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerGroupTestJSON-287122153 Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServerGroupTestJSON-287122153-project Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 9b5a4b02c2a74519baa305e3b7659519 Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServerGroupTestJSON-287122153-project Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance group 1c06ae3b-2fb6-4d4e-966f-6d7043ccbdb5 could not be found. Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '1c06ae3b-2fb6-4d4e-966f-6d7043ccbdb5'} Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 1c06ae3b-2fb6-4d4e-966f-6d7043ccbdb5 could not be found. Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 1c06ae3b-2fb6-4d4e-966f-6d7043ccbdb5 could not be found. Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:39:54.601458 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:39:54.606979 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:39:54.606979 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:39:54.606979 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:39:54.606979 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:39:54.606979 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 1c06ae3b-2fb6-4d4e-966f-6d7043ccbdb5 could not be found. Oct 18 15:39:54.606979 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:39:54.608609 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9209cc01-f60a-42ee-a657-f84ac4d0957f tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Returning 404 to user: Instance group 1c06ae3b-2fb6-4d4e-966f-6d7043ccbdb5 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:39:54.609698 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9209cc01-f60a-42ee-a657-f84ac4d0957f tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/1c06ae3b-2fb6-4d4e-966f-6d7043ccbdb5" status: 404 len: 117 microversion: 2.1 time: 0.023204 Oct 18 15:39:54.610442 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1718/3443] 10.222.0.60 () {58 vars in 1266 bytes} [Tue Oct 18 15:39:54 2022] DELETE /compute/v2.1/os-server-groups/1c06ae3b-2fb6-4d4e-966f-6d7043ccbdb5 => generated 117 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:39:54.620508 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8e13e91b-f4da-453d-bdb9-fda3c6ce3de2 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:54.664028 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8e13e91b-f4da-453d-bdb9-fda3c6ce3de2 tempest-ServerGroupTestJSON-287122153 tempest-ServerGroupTestJSON-287122153-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/57496904-0426-40af-b581-96f66ac2e236" status: 204 len: 0 microversion: 2.1 time: 0.047979 Oct 18 15:39:54.665387 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1726/3444] 10.222.0.60 () {58 vars in 1266 bytes} [Tue Oct 18 15:39:54 2022] DELETE /compute/v2.1/os-server-groups/57496904-0426-40af-b581-96f66ac2e236 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:39:54.742562 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e3d1f8f1-6400-45eb-9c78-4ebc38d8e2a2 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:54.743108 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e3d1f8f1-6400-45eb-9c78-4ebc38d8e2a2 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: d280f396-df42-482a-b0c1-9a8a9b608f57] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:54.753732 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3d1f8f1-6400-45eb-9c78-4ebc38d8e2a2 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:54.754200 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3d1f8f1-6400-45eb-9c78-4ebc38d8e2a2 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:54.771106 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3d1f8f1-6400-45eb-9c78-4ebc38d8e2a2 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:54.771106 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3d1f8f1-6400-45eb-9c78-4ebc38d8e2a2 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:54.771106 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3d1f8f1-6400-45eb-9c78-4ebc38d8e2a2 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:54.771106 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3d1f8f1-6400-45eb-9c78-4ebc38d8e2a2 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:54.786334 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-134c571d-efdc-41b6-8ce2-7db438131604 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:54.787309 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-134c571d-efdc-41b6-8ce2-7db438131604 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 60621af7-3f40-45ac-8e96-2a2f7444d372] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:54.802950 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-134c571d-efdc-41b6-8ce2-7db438131604 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:54.804006 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-134c571d-efdc-41b6-8ce2-7db438131604 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:54.804909 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-134c571d-efdc-41b6-8ce2-7db438131604 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:54.806130 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-134c571d-efdc-41b6-8ce2-7db438131604 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:54.806734 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-134c571d-efdc-41b6-8ce2-7db438131604 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:54.807302 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-134c571d-efdc-41b6-8ce2-7db438131604 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:55.232731 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-134c571d-efdc-41b6-8ce2-7db438131604 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:55.254594 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e3d1f8f1-6400-45eb-9c78-4ebc38d8e2a2 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:55.266106 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e3d1f8f1-6400-45eb-9c78-4ebc38d8e2a2 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57" status: 200 len: 1469 microversion: 2.1 time: 0.527624 Oct 18 15:39:55.269608 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1719/3445] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:54 2022] GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57 => generated 1469 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:55.286763 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-134c571d-efdc-41b6-8ce2-7db438131604 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/60621af7-3f40-45ac-8e96-2a2f7444d372" status: 200 len: 1493 microversion: 2.1 time: 0.504684 Oct 18 15:39:55.293168 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1727/3446] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:54 2022] GET /compute/v2.1/servers/60621af7-3f40-45ac-8e96-2a2f7444d372 => generated 1493 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:55.311579 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d5eb2e67-4730-429b-9e44-80c5ac9bfef5 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:55.312195 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d5eb2e67-4730-429b-9e44-80c5ac9bfef5 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 4a23be5e-9334-4385-9476-4bbd81995002] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:55.319256 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5eb2e67-4730-429b-9e44-80c5ac9bfef5 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:55.319756 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5eb2e67-4730-429b-9e44-80c5ac9bfef5 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:55.320190 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5eb2e67-4730-429b-9e44-80c5ac9bfef5 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:55.320935 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5eb2e67-4730-429b-9e44-80c5ac9bfef5 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:55.321383 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5eb2e67-4730-429b-9e44-80c5ac9bfef5 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:55.321806 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5eb2e67-4730-429b-9e44-80c5ac9bfef5 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:55.329507 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ed2b4e87-b73b-4fe4-a887-06930149e0a6 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:55.330149 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ed2b4e87-b73b-4fe4-a887-06930149e0a6 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 60621af7-3f40-45ac-8e96-2a2f7444d372] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:55.354297 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ed2b4e87-b73b-4fe4-a887-06930149e0a6 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:55.356597 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ed2b4e87-b73b-4fe4-a887-06930149e0a6 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:55.357308 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ed2b4e87-b73b-4fe4-a887-06930149e0a6 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:55.358210 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ed2b4e87-b73b-4fe4-a887-06930149e0a6 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:55.359282 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ed2b4e87-b73b-4fe4-a887-06930149e0a6 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:55.360281 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ed2b4e87-b73b-4fe4-a887-06930149e0a6 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:55.391022 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ed2b4e87-b73b-4fe4-a887-06930149e0a6 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 60621af7-3f40-45ac-8e96-2a2f7444d372] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:39:55.550083 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ed2b4e87-b73b-4fe4-a887-06930149e0a6 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "DELETE /compute/v2.1/servers/60621af7-3f40-45ac-8e96-2a2f7444d372" status: 204 len: 0 microversion: 2.1 time: 0.233692 Oct 18 15:39:55.551396 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1728/3447] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:39:55 2022] DELETE /compute/v2.1/servers/60621af7-3f40-45ac-8e96-2a2f7444d372 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:39:55.557864 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-816fd75d-062f-4ae4-936b-426c5b2cd793 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:55.559560 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-816fd75d-062f-4ae4-936b-426c5b2cd793 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] [instance: 6c2ed037-84ac-463b-a42d-01a03532cc43] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:55.566697 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-816fd75d-062f-4ae4-936b-426c5b2cd793 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:55.568186 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-816fd75d-062f-4ae4-936b-426c5b2cd793 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:55.569033 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-816fd75d-062f-4ae4-936b-426c5b2cd793 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:55.570458 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-816fd75d-062f-4ae4-936b-426c5b2cd793 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:55.571342 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-816fd75d-062f-4ae4-936b-426c5b2cd793 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:55.571941 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-816fd75d-062f-4ae4-936b-426c5b2cd793 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:55.756560 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d5eb2e67-4730-429b-9e44-80c5ac9bfef5 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:55.773197 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d5eb2e67-4730-429b-9e44-80c5ac9bfef5 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002" status: 200 len: 1367 microversion: 2.1 time: 0.464892 Oct 18 15:39:55.774639 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1720/3448] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:55 2022] GET /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002 => generated 1367 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:55.784288 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9e651eb9-72b6-427f-916e-4ee72e7135e7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:55.786233 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9e651eb9-72b6-427f-916e-4ee72e7135e7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 60621af7-3f40-45ac-8e96-2a2f7444d372] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:55.798466 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e651eb9-72b6-427f-916e-4ee72e7135e7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:55.799330 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e651eb9-72b6-427f-916e-4ee72e7135e7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:55.799938 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e651eb9-72b6-427f-916e-4ee72e7135e7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:55.801127 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e651eb9-72b6-427f-916e-4ee72e7135e7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:55.802121 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-816fd75d-062f-4ae4-936b-426c5b2cd793 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386f58c6593d43d2829e08fbdb9ed769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e75e5c7ef1b48cfb696da32fa30b845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:55.802475 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e651eb9-72b6-427f-916e-4ee72e7135e7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:55.803140 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e651eb9-72b6-427f-916e-4ee72e7135e7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:55.811028 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-816fd75d-062f-4ae4-936b-426c5b2cd793 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] 10.222.0.60 "GET /compute/v2.1/servers/6c2ed037-84ac-463b-a42d-01a03532cc43" status: 200 len: 1508 microversion: 2.1 time: 0.258099 Oct 18 15:39:55.818484 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1729/3449] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:55 2022] GET /compute/v2.1/servers/6c2ed037-84ac-463b-a42d-01a03532cc43 => generated 1508 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:55.826618 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-af785782-e6e7-461e-8555-49acfad5e51f req-a391f7d4-acf8-4373-a405-bdfcc2db2ed0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a23be5e-9334-4385-9476-4bbd81995002", "name": "network-vif-plugged", "status": "completed", "tag": "4c591361-ce3f-4d4a-acbd-c51f7d0da6dc"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:39:55.836106 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:39:55.839393 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-af785782-e6e7-461e-8555-49acfad5e51f req-a391f7d4-acf8-4373-a405-bdfcc2db2ed0 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:55.840002 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-af785782-e6e7-461e-8555-49acfad5e51f req-a391f7d4-acf8-4373-a405-bdfcc2db2ed0 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:55.840604 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-af785782-e6e7-461e-8555-49acfad5e51f req-a391f7d4-acf8-4373-a405-bdfcc2db2ed0 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:55.859096 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-af785782-e6e7-461e-8555-49acfad5e51f req-a391f7d4-acf8-4373-a405-bdfcc2db2ed0 service nova] Creating event network-vif-plugged:4c591361-ce3f-4d4a-acbd-c51f7d0da6dc for instance 4a23be5e-9334-4385-9476-4bbd81995002 on n-h2-853682-5 Oct 18 15:39:55.865445 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-af785782-e6e7-461e-8555-49acfad5e51f req-a391f7d4-acf8-4373-a405-bdfcc2db2ed0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045252 Oct 18 15:39:55.866624 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1730/3450] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:39:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:39:55.874998 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-f88bb034-d448-4fd5-9954-9a5843fc2d08 req-9a86b0f7-59f9-41e9-91bb-1d3f1a62f8ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d280f396-df42-482a-b0c1-9a8a9b608f57", "name": "network-vif-deleted", "tag": "f518ff61-30b3-4c0b-a3c2-3c35a22e45aa"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:39:55.899134 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-f88bb034-d448-4fd5-9954-9a5843fc2d08 req-9a86b0f7-59f9-41e9-91bb-1d3f1a62f8ab service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:55.899740 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-f88bb034-d448-4fd5-9954-9a5843fc2d08 req-9a86b0f7-59f9-41e9-91bb-1d3f1a62f8ab service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:55.903079 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-f88bb034-d448-4fd5-9954-9a5843fc2d08 req-9a86b0f7-59f9-41e9-91bb-1d3f1a62f8ab service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:55.926741 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-f88bb034-d448-4fd5-9954-9a5843fc2d08 req-9a86b0f7-59f9-41e9-91bb-1d3f1a62f8ab service nova] Creating event network-vif-deleted:f518ff61-30b3-4c0b-a3c2-3c35a22e45aa for instance d280f396-df42-482a-b0c1-9a8a9b608f57 on n-h1-853682-5 Oct 18 15:39:55.932163 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-f88bb034-d448-4fd5-9954-9a5843fc2d08 req-9a86b0f7-59f9-41e9-91bb-1d3f1a62f8ab service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063510 Oct 18 15:39:55.933075 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1731/3451] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:39:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:39:56.111134 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9e651eb9-72b6-427f-916e-4ee72e7135e7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:56.122040 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9e651eb9-72b6-427f-916e-4ee72e7135e7 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/60621af7-3f40-45ac-8e96-2a2f7444d372" status: 200 len: 1499 microversion: 2.1 time: 0.344389 Oct 18 15:39:56.122829 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1721/3452] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:55 2022] GET /compute/v2.1/servers/60621af7-3f40-45ac-8e96-2a2f7444d372 => generated 1499 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:56.295622 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9b591005-60ea-4042-8987-2158c74a4e2e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:56.296592 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9b591005-60ea-4042-8987-2158c74a4e2e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: d280f396-df42-482a-b0c1-9a8a9b608f57] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:56.307037 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9b591005-60ea-4042-8987-2158c74a4e2e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:56.307755 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9b591005-60ea-4042-8987-2158c74a4e2e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:56.308362 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9b591005-60ea-4042-8987-2158c74a4e2e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:56.309258 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9b591005-60ea-4042-8987-2158c74a4e2e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:56.310174 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9b591005-60ea-4042-8987-2158c74a4e2e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:56.311250 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9b591005-60ea-4042-8987-2158c74a4e2e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:56.333331 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:39:56.383708 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9b591005-60ea-4042-8987-2158c74a4e2e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:56.384352 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9b591005-60ea-4042-8987-2158c74a4e2e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:56.384682 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9b591005-60ea-4042-8987-2158c74a4e2e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:56.385175 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-9b591005-60ea-4042-8987-2158c74a4e2e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lazy-loading 'fault' on Instance uuid d280f396-df42-482a-b0c1-9a8a9b608f57 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:39:56.475925 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9b591005-60ea-4042-8987-2158c74a4e2e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:56.499631 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9b591005-60ea-4042-8987-2158c74a4e2e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57" status: 200 len: 1303 microversion: 2.1 time: 0.210970 Oct 18 15:39:56.508865 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1732/3453] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:56 2022] GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57 => generated 1303 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:56.797914 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-25f1c912-65f3-43ec-b16e-26a3e117f587 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:56.799132 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-25f1c912-65f3-43ec-b16e-26a3e117f587 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 4a23be5e-9334-4385-9476-4bbd81995002] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:56.810746 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25f1c912-65f3-43ec-b16e-26a3e117f587 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:56.811499 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25f1c912-65f3-43ec-b16e-26a3e117f587 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:56.812140 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25f1c912-65f3-43ec-b16e-26a3e117f587 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:56.817368 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25f1c912-65f3-43ec-b16e-26a3e117f587 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:56.818218 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25f1c912-65f3-43ec-b16e-26a3e117f587 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:56.818892 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25f1c912-65f3-43ec-b16e-26a3e117f587 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:56.837192 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-46358f30-62e6-4673-a576-28373b2acfce tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:56.839999 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-46358f30-62e6-4673-a576-28373b2acfce tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] [instance: 6c2ed037-84ac-463b-a42d-01a03532cc43] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:56.867924 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-46358f30-62e6-4673-a576-28373b2acfce tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:56.868617 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-46358f30-62e6-4673-a576-28373b2acfce tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:56.869203 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-46358f30-62e6-4673-a576-28373b2acfce tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:56.870141 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-46358f30-62e6-4673-a576-28373b2acfce tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:56.870841 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-46358f30-62e6-4673-a576-28373b2acfce tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:56.873674 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-46358f30-62e6-4673-a576-28373b2acfce tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:57.153190 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-25f1c912-65f3-43ec-b16e-26a3e117f587 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:57.161578 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-25f1c912-65f3-43ec-b16e-26a3e117f587 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002" status: 200 len: 1367 microversion: 2.1 time: 0.367628 Oct 18 15:39:57.177273 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1722/3454] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:56 2022] GET /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002 => generated 1367 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:57.183783 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3e528737-767a-473e-b4ad-61bfe2bdd9fc tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:57.184668 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3e528737-767a-473e-b4ad-61bfe2bdd9fc tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 60621af7-3f40-45ac-8e96-2a2f7444d372] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:57.191821 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e528737-767a-473e-b4ad-61bfe2bdd9fc tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:57.192254 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e528737-767a-473e-b4ad-61bfe2bdd9fc tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:57.192762 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e528737-767a-473e-b4ad-61bfe2bdd9fc tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:57.193562 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e528737-767a-473e-b4ad-61bfe2bdd9fc tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:57.194086 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e528737-767a-473e-b4ad-61bfe2bdd9fc tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:57.194581 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e528737-767a-473e-b4ad-61bfe2bdd9fc tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:57.307799 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-46358f30-62e6-4673-a576-28373b2acfce tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386f58c6593d43d2829e08fbdb9ed769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e75e5c7ef1b48cfb696da32fa30b845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:57.319810 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-46358f30-62e6-4673-a576-28373b2acfce tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] 10.222.0.60 "GET /compute/v2.1/servers/6c2ed037-84ac-463b-a42d-01a03532cc43" status: 200 len: 1508 microversion: 2.1 time: 0.489264 Oct 18 15:39:57.323968 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1733/3455] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:56 2022] GET /compute/v2.1/servers/6c2ed037-84ac-463b-a42d-01a03532cc43 => generated 1508 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:39:57.342546 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1b0b3362-8128-4324-885b-1f83911d55a1 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:57.348377 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1b0b3362-8128-4324-885b-1f83911d55a1 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 52d725f3-b4da-4831-9abf-bf7aba8aee0a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:57.365546 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1b0b3362-8128-4324-885b-1f83911d55a1 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:57.366308 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1b0b3362-8128-4324-885b-1f83911d55a1 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:57.366969 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1b0b3362-8128-4324-885b-1f83911d55a1 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:57.368122 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1b0b3362-8128-4324-885b-1f83911d55a1 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:57.368967 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1b0b3362-8128-4324-885b-1f83911d55a1 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:57.369566 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1b0b3362-8128-4324-885b-1f83911d55a1 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:57.586017 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3e528737-767a-473e-b4ad-61bfe2bdd9fc tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:57.602063 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3e528737-767a-473e-b4ad-61bfe2bdd9fc tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/60621af7-3f40-45ac-8e96-2a2f7444d372" status: 200 len: 1499 microversion: 2.1 time: 0.419121 Oct 18 15:39:57.602722 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1723/3456] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:57 2022] GET /compute/v2.1/servers/60621af7-3f40-45ac-8e96-2a2f7444d372 => generated 1499 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:57.611255 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-1b0b3362-8128-4324-885b-1f83911d55a1 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lazy-loading 'services' on Instance uuid 52d725f3-b4da-4831-9abf-bf7aba8aee0a {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:39:57.622904 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3277326b-3df3-47aa-a986-9e3cbe854540 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:57.623938 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3277326b-3df3-47aa-a986-9e3cbe854540 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: d280f396-df42-482a-b0c1-9a8a9b608f57] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:57.633917 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3277326b-3df3-47aa-a986-9e3cbe854540 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:57.634554 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3277326b-3df3-47aa-a986-9e3cbe854540 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:57.636012 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3277326b-3df3-47aa-a986-9e3cbe854540 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:57.641745 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3277326b-3df3-47aa-a986-9e3cbe854540 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:57.642372 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3277326b-3df3-47aa-a986-9e3cbe854540 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:57.644079 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3277326b-3df3-47aa-a986-9e3cbe854540 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:57.671649 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-3277326b-3df3-47aa-a986-9e3cbe854540 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] HTTP exception thrown: Instance d280f396-df42-482a-b0c1-9a8a9b608f57 could not be found. Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3277326b-3df3-47aa-a986-9e3cbe854540 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Request method failure captured: Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57 HTTP/1.1 Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTseN65N0qApJvDDMMfddXqpMfI7xWk1J5atOQp_Oeywx-wkHlI8ZA5AFhWDOL-TOcTqefH8iJHBUi1wG_27-LimwpRNcjd7RH9WE1nw3iqd2OcUy6wl8jGrd6jyzRfMfF-cj8C5ZKSk7xaNBJ2yV8gtnNGSyvPwvzRZ0cXHrMymh7pY Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 91719d2b1f1640f391aa0b54c9725d2a Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-MigrationsAdminTest-2103704262 Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/91719d2b1f1640f391aa0b54c9725d2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/91719d2b1f1640f391aa0b54c9725d2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/91719d2b1f1640f391aa0b54c9725d2a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_91719d2b1f1640f391aa0b54c9725d2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-MigrationsAdminTest-2103704262 Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 91719d2b1f1640f391aa0b54c9725d2a Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-MigrationsAdminTest-2103704262 Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-MigrationsAdminTest-2103704262-project Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 926f2a98aa66431fab2a6032f21d5ae7 Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-MigrationsAdminTest-2103704262-project Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance d280f396-df42-482a-b0c1-9a8a9b608f57 could not be found. Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'd280f396-df42-482a-b0c1-9a8a9b608f57'} Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d280f396-df42-482a-b0c1-9a8a9b608f57 could not be found. Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d280f396-df42-482a-b0c1-9a8a9b608f57 could not be found. Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:39:57.676840 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:39:57.681015 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:39:57.681015 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:39:57.681015 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:39:57.681015 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:39:57.681015 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:39:57.681015 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d280f396-df42-482a-b0c1-9a8a9b608f57 could not be found. Oct 18 15:39:57.681015 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:39:57.681015 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3277326b-3df3-47aa-a986-9e3cbe854540 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Returning 404 to user: Instance d280f396-df42-482a-b0c1-9a8a9b608f57 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:39:57.681015 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3277326b-3df3-47aa-a986-9e3cbe854540 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57" status: 404 len: 111 microversion: 2.1 time: 0.075475 Oct 18 15:39:57.688932 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1724/3457] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:57 2022] GET /compute/v2.1/servers/d280f396-df42-482a-b0c1-9a8a9b608f57 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:39:57.696372 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3a80a309-1929-4344-9f92-383e7da665ba tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:57.696907 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3a80a309-1929-4344-9f92-383e7da665ba tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 12e415d7-7c40-41a0-957a-a083dbcf2b43] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:57.711218 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a80a309-1929-4344-9f92-383e7da665ba tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:57.712466 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a80a309-1929-4344-9f92-383e7da665ba tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:57.713142 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a80a309-1929-4344-9f92-383e7da665ba tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:57.714025 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a80a309-1929-4344-9f92-383e7da665ba tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:57.714650 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a80a309-1929-4344-9f92-383e7da665ba tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:57.715245 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a80a309-1929-4344-9f92-383e7da665ba tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:57.744098 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1b0b3362-8128-4324-885b-1f83911d55a1 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "DELETE /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a/os-volume_attachments/4026a578-7ecb-4e1b-93a9-db1744efc83e" status: 202 len: 0 microversion: 2.1 time: 0.405224 Oct 18 15:39:57.763183 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1734/3458] 10.222.0.60 () {58 vars in 1416 bytes} [Tue Oct 18 15:39:57 2022] DELETE /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a/os-volume_attachments/4026a578-7ecb-4e1b-93a9-db1744efc83e => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:39:57.790182 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3a80a309-1929-4344-9f92-383e7da665ba tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 12e415d7-7c40-41a0-957a-a083dbcf2b43] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:39:57.902052 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:39:57.977152 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3a80a309-1929-4344-9f92-383e7da665ba tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "DELETE /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43" status: 204 len: 0 microversion: 2.1 time: 0.286231 Oct 18 15:39:57.978427 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1725/3459] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:39:57 2022] DELETE /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:39:57.987208 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-81792d2b-39f6-41ae-9b49-520bc5a83f24 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:57.987965 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-81792d2b-39f6-41ae-9b49-520bc5a83f24 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 12e415d7-7c40-41a0-957a-a083dbcf2b43] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:58.002969 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-81792d2b-39f6-41ae-9b49-520bc5a83f24 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:58.004199 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-81792d2b-39f6-41ae-9b49-520bc5a83f24 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:58.011712 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-81792d2b-39f6-41ae-9b49-520bc5a83f24 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:58.012822 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-81792d2b-39f6-41ae-9b49-520bc5a83f24 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:58.013480 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-81792d2b-39f6-41ae-9b49-520bc5a83f24 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:58.014087 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-81792d2b-39f6-41ae-9b49-520bc5a83f24 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:58.198700 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b57da74a-b5cc-4bfd-9265-d1c64dbb9064 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:58.199625 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b57da74a-b5cc-4bfd-9265-d1c64dbb9064 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 4a23be5e-9334-4385-9476-4bbd81995002] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:58.212424 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b57da74a-b5cc-4bfd-9265-d1c64dbb9064 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:58.213338 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b57da74a-b5cc-4bfd-9265-d1c64dbb9064 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:58.214885 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b57da74a-b5cc-4bfd-9265-d1c64dbb9064 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:58.217741 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b57da74a-b5cc-4bfd-9265-d1c64dbb9064 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:58.218433 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b57da74a-b5cc-4bfd-9265-d1c64dbb9064 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:58.219106 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b57da74a-b5cc-4bfd-9265-d1c64dbb9064 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:58.508052 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-81792d2b-39f6-41ae-9b49-520bc5a83f24 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:58.514618 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-81792d2b-39f6-41ae-9b49-520bc5a83f24 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43" status: 200 len: 1535 microversion: 2.1 time: 0.532255 Oct 18 15:39:58.525243 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1735/3460] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:57 2022] GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43 => generated 1535 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:58.536727 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2a41fe5c-3c03-49d6-b7f9-7f63a0dac152 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:58.537405 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2a41fe5c-3c03-49d6-b7f9-7f63a0dac152 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] [instance: 6c2ed037-84ac-463b-a42d-01a03532cc43] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:58.543572 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a41fe5c-3c03-49d6-b7f9-7f63a0dac152 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:58.544121 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a41fe5c-3c03-49d6-b7f9-7f63a0dac152 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:58.544506 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a41fe5c-3c03-49d6-b7f9-7f63a0dac152 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:58.545254 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a41fe5c-3c03-49d6-b7f9-7f63a0dac152 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:58.545714 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a41fe5c-3c03-49d6-b7f9-7f63a0dac152 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:58.546145 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a41fe5c-3c03-49d6-b7f9-7f63a0dac152 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:58.729231 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b57da74a-b5cc-4bfd-9265-d1c64dbb9064 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:58.737754 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b57da74a-b5cc-4bfd-9265-d1c64dbb9064 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002" status: 200 len: 1557 microversion: 2.1 time: 0.551464 Oct 18 15:39:58.754103 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1726/3461] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:58 2022] GET /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002 => generated 1557 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:58.765371 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f45a11dd-11c0-4b62-84f9-f086e053d432 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:58.766245 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f45a11dd-11c0-4b62-84f9-f086e053d432 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 60621af7-3f40-45ac-8e96-2a2f7444d372] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:58.776309 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f45a11dd-11c0-4b62-84f9-f086e053d432 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:58.777202 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f45a11dd-11c0-4b62-84f9-f086e053d432 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:58.777871 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f45a11dd-11c0-4b62-84f9-f086e053d432 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:58.778764 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f45a11dd-11c0-4b62-84f9-f086e053d432 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:58.779418 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f45a11dd-11c0-4b62-84f9-f086e053d432 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:58.779998 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f45a11dd-11c0-4b62-84f9-f086e053d432 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:59.104985 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2a41fe5c-3c03-49d6-b7f9-7f63a0dac152 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386f58c6593d43d2829e08fbdb9ed769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e75e5c7ef1b48cfb696da32fa30b845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:59.117824 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2a41fe5c-3c03-49d6-b7f9-7f63a0dac152 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] 10.222.0.60 "GET /compute/v2.1/servers/6c2ed037-84ac-463b-a42d-01a03532cc43" status: 200 len: 1506 microversion: 2.1 time: 0.591030 Oct 18 15:39:59.118951 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1736/3462] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:58 2022] GET /compute/v2.1/servers/6c2ed037-84ac-463b-a42d-01a03532cc43 => generated 1506 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:59.125682 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-03acd09a-6413-498a-a608-4de6d4d48ec6 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:59.126383 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-03acd09a-6413-498a-a608-4de6d4d48ec6 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 4a23be5e-9334-4385-9476-4bbd81995002] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:59.137116 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-03acd09a-6413-498a-a608-4de6d4d48ec6 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:59.137969 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-03acd09a-6413-498a-a608-4de6d4d48ec6 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:59.138692 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-03acd09a-6413-498a-a608-4de6d4d48ec6 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:59.139602 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-03acd09a-6413-498a-a608-4de6d4d48ec6 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:59.140065 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-03acd09a-6413-498a-a608-4de6d4d48ec6 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:59.140546 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-03acd09a-6413-498a-a608-4de6d4d48ec6 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:59.311477 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f45a11dd-11c0-4b62-84f9-f086e053d432 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:39:59.324976 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f45a11dd-11c0-4b62-84f9-f086e053d432 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/60621af7-3f40-45ac-8e96-2a2f7444d372" status: 200 len: 1499 microversion: 2.1 time: 0.566999 Oct 18 15:39:59.325863 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1727/3463] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:58 2022] GET /compute/v2.1/servers/60621af7-3f40-45ac-8e96-2a2f7444d372 => generated 1499 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:39:59.340963 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-59f4051f-8ce7-412a-affb-3e5ebc7c31a8 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Calling method '.version_select at 0x7f7c3c5ff4c0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:59.341889 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-59f4051f-8ce7-412a-affb-3e5ebc7c31a8 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] [instance: 6c2ed037-84ac-463b-a42d-01a03532cc43] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:59.355116 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-03acd09a-6413-498a-a608-4de6d4d48ec6 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.232424 Oct 18 15:39:59.360558 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1737/3464] 10.222.0.60 () {58 vars in 1275 bytes} [Tue Oct 18 15:39:59 2022] GET /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002/os-interface => generated 284 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:39:59.369581 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-59f4051f-8ce7-412a-affb-3e5ebc7c31a8 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:59.370346 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-59f4051f-8ce7-412a-affb-3e5ebc7c31a8 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:59.371385 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-59f4051f-8ce7-412a-affb-3e5ebc7c31a8 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:59.373496 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-59f4051f-8ce7-412a-affb-3e5ebc7c31a8 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:59.374832 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-59f4051f-8ce7-412a-affb-3e5ebc7c31a8 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:59.375943 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-59f4051f-8ce7-412a-affb-3e5ebc7c31a8 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:59.433590 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-59f4051f-8ce7-412a-affb-3e5ebc7c31a8 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] 10.222.0.60 "GET /compute/v2.1/servers/6c2ed037-84ac-463b-a42d-01a03532cc43/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.105469 Oct 18 15:39:59.447774 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1728/3465] 10.222.0.60 () {58 vars in 1296 bytes} [Tue Oct 18 15:39:59 2022] GET /compute/v2.1/servers/6c2ed037-84ac-463b-a42d-01a03532cc43/os-instance-actions => generated 611 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:39:59.448002 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0e1156d1-6611-46e7-884a-a2bfd04e7abf tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:59.448868 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0e1156d1-6611-46e7-884a-a2bfd04e7abf tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] [instance: 6c2ed037-84ac-463b-a42d-01a03532cc43] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:59.461048 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0e1156d1-6611-46e7-884a-a2bfd04e7abf tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:59.462819 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0e1156d1-6611-46e7-884a-a2bfd04e7abf tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:59.464952 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0e1156d1-6611-46e7-884a-a2bfd04e7abf tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:59.465942 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0e1156d1-6611-46e7-884a-a2bfd04e7abf tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:59.467851 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0e1156d1-6611-46e7-884a-a2bfd04e7abf tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:59.468403 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0e1156d1-6611-46e7-884a-a2bfd04e7abf tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:59.510641 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0e1156d1-6611-46e7-884a-a2bfd04e7abf tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] [instance: 6c2ed037-84ac-463b-a42d-01a03532cc43] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:39:59.542416 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-82b1c46f-2e93-4988-9c39-625aa848645b tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:59.543246 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-82b1c46f-2e93-4988-9c39-625aa848645b tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 12e415d7-7c40-41a0-957a-a083dbcf2b43] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:59.566372 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82b1c46f-2e93-4988-9c39-625aa848645b tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:59.568349 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82b1c46f-2e93-4988-9c39-625aa848645b tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:59.569126 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82b1c46f-2e93-4988-9c39-625aa848645b tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:59.570102 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82b1c46f-2e93-4988-9c39-625aa848645b tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:59.570717 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82b1c46f-2e93-4988-9c39-625aa848645b tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:59.571742 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82b1c46f-2e93-4988-9c39-625aa848645b tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:59.778384 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0e1156d1-6611-46e7-884a-a2bfd04e7abf tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6c2ed037-84ac-463b-a42d-01a03532cc43" status: 204 len: 0 microversion: 2.1 time: 0.334240 Oct 18 15:39:59.782077 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1738/3466] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:39:59 2022] DELETE /compute/v2.1/servers/6c2ed037-84ac-463b-a42d-01a03532cc43 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:39:59.802813 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-69db8b4d-6292-471c-9f4b-1390549c0230 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:39:59.803988 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-69db8b4d-6292-471c-9f4b-1390549c0230 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] [instance: 6c2ed037-84ac-463b-a42d-01a03532cc43] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:39:59.813682 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-69db8b4d-6292-471c-9f4b-1390549c0230 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:59.814553 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-69db8b4d-6292-471c-9f4b-1390549c0230 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:59.815465 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-69db8b4d-6292-471c-9f4b-1390549c0230 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:39:59.817384 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-69db8b4d-6292-471c-9f4b-1390549c0230 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:39:59.818029 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-69db8b4d-6292-471c-9f4b-1390549c0230 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:39:59.818694 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-69db8b4d-6292-471c-9f4b-1390549c0230 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:00.511640 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-69db8b4d-6292-471c-9f4b-1390549c0230 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386f58c6593d43d2829e08fbdb9ed769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e75e5c7ef1b48cfb696da32fa30b845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:00.524034 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-69db8b4d-6292-471c-9f4b-1390549c0230 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] 10.222.0.60 "GET /compute/v2.1/servers/6c2ed037-84ac-463b-a42d-01a03532cc43" status: 200 len: 1512 microversion: 2.1 time: 0.736544 Oct 18 15:40:00.527459 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1739/3467] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:59 2022] GET /compute/v2.1/servers/6c2ed037-84ac-463b-a42d-01a03532cc43 => generated 1512 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:00.541093 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f0978720-0039-4eb0-a644-abeaef594257 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:00.541093 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f0978720-0039-4eb0-a644-abeaef594257 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 60621af7-3f40-45ac-8e96-2a2f7444d372] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:00.555841 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f0978720-0039-4eb0-a644-abeaef594257 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:00.556357 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f0978720-0039-4eb0-a644-abeaef594257 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:00.556827 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f0978720-0039-4eb0-a644-abeaef594257 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:00.558988 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f0978720-0039-4eb0-a644-abeaef594257 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:00.559459 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f0978720-0039-4eb0-a644-abeaef594257 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:00.563805 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f0978720-0039-4eb0-a644-abeaef594257 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:01.027016 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-82b1c46f-2e93-4988-9c39-625aa848645b tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:01.041503 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-82b1c46f-2e93-4988-9c39-625aa848645b tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43" status: 200 len: 1535 microversion: 2.1 time: 1.505572 Oct 18 15:40:01.042868 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1729/3468] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:39:59 2022] GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43 => generated 1535 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:01.061769 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-218ffa1c-6f21-4f4a-a631-85e9643223cc req-f300a2bc-0db8-4b01-a3b0-27c68bd373a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60621af7-3f40-45ac-8e96-2a2f7444d372", "name": "network-vif-deleted", "tag": "c2c6823d-9a8e-4529-bfd0-b37f8897ffd8"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:40:01.076311 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-218ffa1c-6f21-4f4a-a631-85e9643223cc req-f300a2bc-0db8-4b01-a3b0-27c68bd373a1 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:01.078969 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-218ffa1c-6f21-4f4a-a631-85e9643223cc req-f300a2bc-0db8-4b01-a3b0-27c68bd373a1 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:01.079786 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-218ffa1c-6f21-4f4a-a631-85e9643223cc req-f300a2bc-0db8-4b01-a3b0-27c68bd373a1 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:01.099668 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-218ffa1c-6f21-4f4a-a631-85e9643223cc req-f300a2bc-0db8-4b01-a3b0-27c68bd373a1 service nova] Creating event network-vif-deleted:c2c6823d-9a8e-4529-bfd0-b37f8897ffd8 for instance 60621af7-3f40-45ac-8e96-2a2f7444d372 on n-h1-853682-5 Oct 18 15:40:01.112506 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-218ffa1c-6f21-4f4a-a631-85e9643223cc req-f300a2bc-0db8-4b01-a3b0-27c68bd373a1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066194 Oct 18 15:40:01.115172 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1730/3469] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:40:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:40:01.126810 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f0978720-0039-4eb0-a644-abeaef594257 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5309baeeec484df194123d22779b0255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04fd51d598a04ff7a909b3ced951dea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:01.143006 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f0978720-0039-4eb0-a644-abeaef594257 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/60621af7-3f40-45ac-8e96-2a2f7444d372" status: 200 len: 1457 microversion: 2.1 time: 0.614347 Oct 18 15:40:01.145220 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1740/3470] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:00 2022] GET /compute/v2.1/servers/60621af7-3f40-45ac-8e96-2a2f7444d372 => generated 1457 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:01.555699 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a73bf52f-f75a-4ec6-97d2-4999c06c13c6 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:01.556730 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a73bf52f-f75a-4ec6-97d2-4999c06c13c6 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] [instance: 6c2ed037-84ac-463b-a42d-01a03532cc43] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:01.577838 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a73bf52f-f75a-4ec6-97d2-4999c06c13c6 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:01.580210 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a73bf52f-f75a-4ec6-97d2-4999c06c13c6 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:01.587719 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a73bf52f-f75a-4ec6-97d2-4999c06c13c6 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:01.589389 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a73bf52f-f75a-4ec6-97d2-4999c06c13c6 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:01.589900 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a73bf52f-f75a-4ec6-97d2-4999c06c13c6 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:01.590339 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a73bf52f-f75a-4ec6-97d2-4999c06c13c6 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:02.081986 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-56e01541-d95f-4f47-a541-efb105474587 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:02.082627 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-56e01541-d95f-4f47-a541-efb105474587 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 12e415d7-7c40-41a0-957a-a083dbcf2b43] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:02.140664 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-56e01541-d95f-4f47-a541-efb105474587 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:02.142370 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-56e01541-d95f-4f47-a541-efb105474587 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:02.158299 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-56e01541-d95f-4f47-a541-efb105474587 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:02.160773 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-56e01541-d95f-4f47-a541-efb105474587 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:02.162274 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-56e01541-d95f-4f47-a541-efb105474587 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:02.164019 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-56e01541-d95f-4f47-a541-efb105474587 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:02.404858 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a73bf52f-f75a-4ec6-97d2-4999c06c13c6 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386f58c6593d43d2829e08fbdb9ed769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e75e5c7ef1b48cfb696da32fa30b845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:02.422351 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a73bf52f-f75a-4ec6-97d2-4999c06c13c6 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] 10.222.0.60 "GET /compute/v2.1/servers/6c2ed037-84ac-463b-a42d-01a03532cc43" status: 200 len: 1512 microversion: 2.1 time: 0.872252 Oct 18 15:40:02.422781 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1731/3471] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:01 2022] GET /compute/v2.1/servers/6c2ed037-84ac-463b-a42d-01a03532cc43 => generated 1512 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:02.435728 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-67046a66-531d-410b-b015-b05fd9b5cbe5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:02.436349 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-67046a66-531d-410b-b015-b05fd9b5cbe5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 60621af7-3f40-45ac-8e96-2a2f7444d372] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:02.462176 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67046a66-531d-410b-b015-b05fd9b5cbe5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:02.478069 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67046a66-531d-410b-b015-b05fd9b5cbe5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:02.479641 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67046a66-531d-410b-b015-b05fd9b5cbe5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:02.482560 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67046a66-531d-410b-b015-b05fd9b5cbe5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:02.491719 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67046a66-531d-410b-b015-b05fd9b5cbe5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:02.493100 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67046a66-531d-410b-b015-b05fd9b5cbe5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:02.561699 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-67046a66-531d-410b-b015-b05fd9b5cbe5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] HTTP exception thrown: Instance 60621af7-3f40-45ac-8e96-2a2f7444d372 could not be found. Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-67046a66-531d-410b-b015-b05fd9b5cbe5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Request method failure captured: Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/60621af7-3f40-45ac-8e96-2a2f7444d372 HTTP/1.1 Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTseXdqIE6K5VM4s3TEHRLWgMUN4aMRv2NoeIzUdaqo5huhkbfibHS5WTucH_yVgiw-oU86aIdI66etum9zPC1o_Gp8lN1ylUglhXYekmlUb-DCNwOQQTPA7nsDvbxyfFlUPyfZnM9HlX0P4k3Gbrf42L5eihIJ6KOiK__MhWlbfWWoY Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 04fd51d598a04ff7a909b3ced951dea8 Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-DeleteServersTestJSON-518486720 Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-DeleteServersTestJSON-518486720 Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 04fd51d598a04ff7a909b3ced951dea8 Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-DeleteServersTestJSON-518486720 Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-DeleteServersTestJSON-518486720-project Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 5309baeeec484df194123d22779b0255 Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-DeleteServersTestJSON-518486720-project Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 60621af7-3f40-45ac-8e96-2a2f7444d372 could not be found. Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '60621af7-3f40-45ac-8e96-2a2f7444d372'} Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60621af7-3f40-45ac-8e96-2a2f7444d372 could not be found. Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60621af7-3f40-45ac-8e96-2a2f7444d372 could not be found. Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:40:02.567817 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:40:02.574266 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:40:02.574266 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:40:02.574266 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:40:02.574266 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:40:02.574266 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:40:02.574266 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60621af7-3f40-45ac-8e96-2a2f7444d372 could not be found. Oct 18 15:40:02.574266 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:40:02.576820 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-67046a66-531d-410b-b015-b05fd9b5cbe5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Returning 404 to user: Instance 60621af7-3f40-45ac-8e96-2a2f7444d372 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:40:02.580038 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-67046a66-531d-410b-b015-b05fd9b5cbe5 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/60621af7-3f40-45ac-8e96-2a2f7444d372" status: 404 len: 111 microversion: 2.1 time: 0.156251 Oct 18 15:40:02.582567 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1732/3472] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:02 2022] GET /compute/v2.1/servers/60621af7-3f40-45ac-8e96-2a2f7444d372 => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:40:02.595059 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fe4d43aa-729c-4697-a56f-c2062a3a8615 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:02.596393 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fe4d43aa-729c-4697-a56f-c2062a3a8615 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 60621af7-3f40-45ac-8e96-2a2f7444d372] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:02.616990 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe4d43aa-729c-4697-a56f-c2062a3a8615 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:02.617817 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe4d43aa-729c-4697-a56f-c2062a3a8615 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:02.618667 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe4d43aa-729c-4697-a56f-c2062a3a8615 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:02.619657 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe4d43aa-729c-4697-a56f-c2062a3a8615 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:02.620396 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe4d43aa-729c-4697-a56f-c2062a3a8615 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:02.621180 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe4d43aa-729c-4697-a56f-c2062a3a8615 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:02.660134 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-fe4d43aa-729c-4697-a56f-c2062a3a8615 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] HTTP exception thrown: Instance 60621af7-3f40-45ac-8e96-2a2f7444d372 could not be found. Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fe4d43aa-729c-4697-a56f-c2062a3a8615 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Request method failure captured: Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/60621af7-3f40-45ac-8e96-2a2f7444d372 HTTP/1.1 Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTseXdqIE6K5VM4s3TEHRLWgMUN4aMRv2NoeIzUdaqo5huhkbfibHS5WTucH_yVgiw-oU86aIdI66etum9zPC1o_Gp8lN1ylUglhXYekmlUb-DCNwOQQTPA7nsDvbxyfFlUPyfZnM9HlX0P4k3Gbrf42L5eihIJ6KOiK__MhWlbfWWoY Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 04fd51d598a04ff7a909b3ced951dea8 Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-DeleteServersTestJSON-518486720 Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-DeleteServersTestJSON-518486720 Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 04fd51d598a04ff7a909b3ced951dea8 Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-DeleteServersTestJSON-518486720 Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-DeleteServersTestJSON-518486720-project Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 5309baeeec484df194123d22779b0255 Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-DeleteServersTestJSON-518486720-project Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 60621af7-3f40-45ac-8e96-2a2f7444d372 could not be found. Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '60621af7-3f40-45ac-8e96-2a2f7444d372'} Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60621af7-3f40-45ac-8e96-2a2f7444d372 could not be found. Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:40:02.662107 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:40:02.666895 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60621af7-3f40-45ac-8e96-2a2f7444d372 could not be found. Oct 18 15:40:02.666895 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:40:02.666895 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:40:02.666895 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:40:02.666895 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:40:02.666895 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:40:02.666895 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:40:02.666895 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:40:02.666895 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:40:02.666895 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60621af7-3f40-45ac-8e96-2a2f7444d372 could not be found. Oct 18 15:40:02.666895 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:40:02.666895 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fe4d43aa-729c-4697-a56f-c2062a3a8615 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Returning 404 to user: Instance 60621af7-3f40-45ac-8e96-2a2f7444d372 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:40:02.672614 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fe4d43aa-729c-4697-a56f-c2062a3a8615 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "DELETE /compute/v2.1/servers/60621af7-3f40-45ac-8e96-2a2f7444d372" status: 404 len: 111 microversion: 2.1 time: 0.080288 Oct 18 15:40:02.672833 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1733/3473] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:40:02 2022] DELETE /compute/v2.1/servers/60621af7-3f40-45ac-8e96-2a2f7444d372 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:40:02.808713 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-56e01541-d95f-4f47-a541-efb105474587 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:02.820723 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-56e01541-d95f-4f47-a541-efb105474587 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43" status: 200 len: 1493 microversion: 2.1 time: 0.755527 Oct 18 15:40:02.824037 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1741/3474] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:02 2022] GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43 => generated 1493 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:02.841457 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f6b97837-e2ac-4667-9835-e4ab5f0305f0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:02.842258 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f6b97837-e2ac-4667-9835-e4ab5f0305f0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 60621af7-3f40-45ac-8e96-2a2f7444d372] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:02.897898 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f6b97837-e2ac-4667-9835-e4ab5f0305f0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:02.901716 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f6b97837-e2ac-4667-9835-e4ab5f0305f0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:02.903498 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f6b97837-e2ac-4667-9835-e4ab5f0305f0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:02.905913 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f6b97837-e2ac-4667-9835-e4ab5f0305f0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:02.906824 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f6b97837-e2ac-4667-9835-e4ab5f0305f0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:02.907698 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f6b97837-e2ac-4667-9835-e4ab5f0305f0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:02.928693 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-f6b97837-e2ac-4667-9835-e4ab5f0305f0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] HTTP exception thrown: Instance 60621af7-3f40-45ac-8e96-2a2f7444d372 could not be found. Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f6b97837-e2ac-4667-9835-e4ab5f0305f0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Request method failure captured: Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/60621af7-3f40-45ac-8e96-2a2f7444d372 HTTP/1.1 Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTseXdqIE6K5VM4s3TEHRLWgMUN4aMRv2NoeIzUdaqo5huhkbfibHS5WTucH_yVgiw-oU86aIdI66etum9zPC1o_Gp8lN1ylUglhXYekmlUb-DCNwOQQTPA7nsDvbxyfFlUPyfZnM9HlX0P4k3Gbrf42L5eihIJ6KOiK__MhWlbfWWoY Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 04fd51d598a04ff7a909b3ced951dea8 Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-DeleteServersTestJSON-518486720 Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-DeleteServersTestJSON-518486720 Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 04fd51d598a04ff7a909b3ced951dea8 Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-DeleteServersTestJSON-518486720 Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-DeleteServersTestJSON-518486720-project Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 5309baeeec484df194123d22779b0255 Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-DeleteServersTestJSON-518486720-project Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 60621af7-3f40-45ac-8e96-2a2f7444d372 could not be found. Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '60621af7-3f40-45ac-8e96-2a2f7444d372'} Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60621af7-3f40-45ac-8e96-2a2f7444d372 could not be found. Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60621af7-3f40-45ac-8e96-2a2f7444d372 could not be found. Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:40:02.930858 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:40:02.936078 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:40:02.936078 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:40:02.936078 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:40:02.936078 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:40:02.936078 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:40:02.936078 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60621af7-3f40-45ac-8e96-2a2f7444d372 could not be found. Oct 18 15:40:02.936078 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:40:02.940131 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f6b97837-e2ac-4667-9835-e4ab5f0305f0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Returning 404 to user: Instance 60621af7-3f40-45ac-8e96-2a2f7444d372 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:40:02.941369 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f6b97837-e2ac-4667-9835-e4ab5f0305f0 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/60621af7-3f40-45ac-8e96-2a2f7444d372" status: 404 len: 111 microversion: 2.1 time: 0.116018 Oct 18 15:40:02.943052 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1742/3475] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:02 2022] GET /compute/v2.1/servers/60621af7-3f40-45ac-8e96-2a2f7444d372 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:40:02.951608 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5e9c10b1-71f3-45bd-b661-4b5849e3ab02 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:02.952438 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5e9c10b1-71f3-45bd-b661-4b5849e3ab02 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 2059ec7e-ef9b-4eb6-af19-34b2bd09e44a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:02.962335 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5e9c10b1-71f3-45bd-b661-4b5849e3ab02 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:02.963315 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5e9c10b1-71f3-45bd-b661-4b5849e3ab02 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:02.964376 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5e9c10b1-71f3-45bd-b661-4b5849e3ab02 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:02.965653 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5e9c10b1-71f3-45bd-b661-4b5849e3ab02 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:02.966361 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5e9c10b1-71f3-45bd-b661-4b5849e3ab02 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:02.967722 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5e9c10b1-71f3-45bd-b661-4b5849e3ab02 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:02.977523 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-be428f15-82a9-4394-8dc4-eec4adb641c7 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1120969288", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": "none"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:40:03.024104 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-5e9c10b1-71f3-45bd-b661-4b5849e3ab02 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] HTTP exception thrown: Instance 2059ec7e-ef9b-4eb6-af19-34b2bd09e44a could not be found. Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5e9c10b1-71f3-45bd-b661-4b5849e3ab02 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Request method failure captured: Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: request: DELETE /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a HTTP/1.1 Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTseXdqIE6K5VM4s3TEHRLWgMUN4aMRv2NoeIzUdaqo5huhkbfibHS5WTucH_yVgiw-oU86aIdI66etum9zPC1o_Gp8lN1ylUglhXYekmlUb-DCNwOQQTPA7nsDvbxyfFlUPyfZnM9HlX0P4k3Gbrf42L5eihIJ6KOiK__MhWlbfWWoY Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 04fd51d598a04ff7a909b3ced951dea8 Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-DeleteServersTestJSON-518486720 Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-DeleteServersTestJSON-518486720 Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 04fd51d598a04ff7a909b3ced951dea8 Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-DeleteServersTestJSON-518486720 Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-DeleteServersTestJSON-518486720-project Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 5309baeeec484df194123d22779b0255 Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-DeleteServersTestJSON-518486720-project Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 2059ec7e-ef9b-4eb6-af19-34b2bd09e44a could not be found. Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '2059ec7e-ef9b-4eb6-af19-34b2bd09e44a'} Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2059ec7e-ef9b-4eb6-af19-34b2bd09e44a could not be found. Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:40:03.025967 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:40:03.032526 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2059ec7e-ef9b-4eb6-af19-34b2bd09e44a could not be found. Oct 18 15:40:03.032526 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:40:03.032526 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:40:03.032526 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:40:03.032526 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:40:03.032526 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:40:03.032526 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:40:03.032526 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:40:03.032526 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:40:03.032526 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2059ec7e-ef9b-4eb6-af19-34b2bd09e44a could not be found. Oct 18 15:40:03.032526 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:40:03.036921 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5e9c10b1-71f3-45bd-b661-4b5849e3ab02 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Returning 404 to user: Instance 2059ec7e-ef9b-4eb6-af19-34b2bd09e44a could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:40:03.038227 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5e9c10b1-71f3-45bd-b661-4b5849e3ab02 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "DELETE /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a" status: 404 len: 111 microversion: 2.1 time: 0.091880 Oct 18 15:40:03.039491 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1743/3476] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:40:02 2022] DELETE /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:40:03.055014 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e9d059f4-cea3-4547-9ba7-f90343a401fb tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:03.056747 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e9d059f4-cea3-4547-9ba7-f90343a401fb tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 2059ec7e-ef9b-4eb6-af19-34b2bd09e44a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:03.063401 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-be428f15-82a9-4394-8dc4-eec4adb641c7 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:40:03.064003 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-be428f15-82a9-4394-8dc4-eec4adb641c7 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:40:03.064644 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-be428f15-82a9-4394-8dc4-eec4adb641c7 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:40:03.065224 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-be428f15-82a9-4394-8dc4-eec4adb641c7 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:40:03.066404 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-be428f15-82a9-4394-8dc4-eec4adb641c7 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:40:03.076230 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e9d059f4-cea3-4547-9ba7-f90343a401fb tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:03.077622 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e9d059f4-cea3-4547-9ba7-f90343a401fb tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:03.078220 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e9d059f4-cea3-4547-9ba7-f90343a401fb tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:03.079328 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e9d059f4-cea3-4547-9ba7-f90343a401fb tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:03.080002 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e9d059f4-cea3-4547-9ba7-f90343a401fb tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:03.084338 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e9d059f4-cea3-4547-9ba7-f90343a401fb tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:03.092456 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be428f15-82a9-4394-8dc4-eec4adb641c7 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:03.093260 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be428f15-82a9-4394-8dc4-eec4adb641c7 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:03.093849 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be428f15-82a9-4394-8dc4-eec4adb641c7 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:03.102387 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be428f15-82a9-4394-8dc4-eec4adb641c7 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:03.103046 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be428f15-82a9-4394-8dc4-eec4adb641c7 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:03.103716 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be428f15-82a9-4394-8dc4-eec4adb641c7 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:03.121120 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-e9d059f4-cea3-4547-9ba7-f90343a401fb tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] HTTP exception thrown: Instance 2059ec7e-ef9b-4eb6-af19-34b2bd09e44a could not be found. Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e9d059f4-cea3-4547-9ba7-f90343a401fb tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Request method failure captured: Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a HTTP/1.1 Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTseXdqIE6K5VM4s3TEHRLWgMUN4aMRv2NoeIzUdaqo5huhkbfibHS5WTucH_yVgiw-oU86aIdI66etum9zPC1o_Gp8lN1ylUglhXYekmlUb-DCNwOQQTPA7nsDvbxyfFlUPyfZnM9HlX0P4k3Gbrf42L5eihIJ6KOiK__MhWlbfWWoY Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 04fd51d598a04ff7a909b3ced951dea8 Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-DeleteServersTestJSON-518486720 Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-DeleteServersTestJSON-518486720 Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 04fd51d598a04ff7a909b3ced951dea8 Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-DeleteServersTestJSON-518486720 Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-DeleteServersTestJSON-518486720-project Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 5309baeeec484df194123d22779b0255 Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-DeleteServersTestJSON-518486720-project Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 2059ec7e-ef9b-4eb6-af19-34b2bd09e44a could not be found. Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '2059ec7e-ef9b-4eb6-af19-34b2bd09e44a'} Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2059ec7e-ef9b-4eb6-af19-34b2bd09e44a could not be found. Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2059ec7e-ef9b-4eb6-af19-34b2bd09e44a could not be found. Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:40:03.125034 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:40:03.132340 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:40:03.132340 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:40:03.132340 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:40:03.132340 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:40:03.132340 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:40:03.132340 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2059ec7e-ef9b-4eb6-af19-34b2bd09e44a could not be found. Oct 18 15:40:03.132340 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:40:03.136697 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e9d059f4-cea3-4547-9ba7-f90343a401fb tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Returning 404 to user: Instance 2059ec7e-ef9b-4eb6-af19-34b2bd09e44a could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:40:03.139429 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e9d059f4-cea3-4547-9ba7-f90343a401fb tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a" status: 404 len: 111 microversion: 2.1 time: 0.095474 Oct 18 15:40:03.142030 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1744/3477] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:03 2022] GET /compute/v2.1/servers/2059ec7e-ef9b-4eb6-af19-34b2bd09e44a => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:40:03.145508 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-be428f15-82a9-4394-8dc4-eec4adb641c7 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Getting quotas for project 6a5421df89db4d36a164f2d9f5c27803. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:40:03.149588 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-25cefb08-7939-4de7-bfb5-79996408d03b tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:03.155997 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-25cefb08-7939-4de7-bfb5-79996408d03b tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:03.157536 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-be428f15-82a9-4394-8dc4-eec4adb641c7 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Getting quotas for user 0253081420d048b9bacbaa3ae30ae331 and project 6a5421df89db4d36a164f2d9f5c27803. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:40:03.174742 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-25cefb08-7939-4de7-bfb5-79996408d03b tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:03.176309 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-25cefb08-7939-4de7-bfb5-79996408d03b tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:03.176898 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-25cefb08-7939-4de7-bfb5-79996408d03b tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:03.182696 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-25cefb08-7939-4de7-bfb5-79996408d03b tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:03.183376 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-25cefb08-7939-4de7-bfb5-79996408d03b tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:03.183937 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-25cefb08-7939-4de7-bfb5-79996408d03b tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:03.191562 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-be428f15-82a9-4394-8dc4-eec4adb641c7 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:40:03.199701 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-be428f15-82a9-4394-8dc4-eec4adb641c7 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] [instance: 2e17d230-cb8b-4fc8-a10c-abed2322ed3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:40:03.220562 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-25cefb08-7939-4de7-bfb5-79996408d03b tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] HTTP exception thrown: Instance a5c710aa-e860-4b2c-a59b-c25202c621ca could not be found. Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-25cefb08-7939-4de7-bfb5-79996408d03b tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Request method failure captured: Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: request: DELETE /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca HTTP/1.1 Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTseXdqIE6K5VM4s3TEHRLWgMUN4aMRv2NoeIzUdaqo5huhkbfibHS5WTucH_yVgiw-oU86aIdI66etum9zPC1o_Gp8lN1ylUglhXYekmlUb-DCNwOQQTPA7nsDvbxyfFlUPyfZnM9HlX0P4k3Gbrf42L5eihIJ6KOiK__MhWlbfWWoY Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 04fd51d598a04ff7a909b3ced951dea8 Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-DeleteServersTestJSON-518486720 Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-DeleteServersTestJSON-518486720 Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 04fd51d598a04ff7a909b3ced951dea8 Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-DeleteServersTestJSON-518486720 Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-DeleteServersTestJSON-518486720-project Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 5309baeeec484df194123d22779b0255 Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-DeleteServersTestJSON-518486720-project Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance a5c710aa-e860-4b2c-a59b-c25202c621ca could not be found. Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'a5c710aa-e860-4b2c-a59b-c25202c621ca'} Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5c710aa-e860-4b2c-a59b-c25202c621ca could not be found. Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:40:03.222902 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:40:03.227199 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5c710aa-e860-4b2c-a59b-c25202c621ca could not be found. Oct 18 15:40:03.227199 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:40:03.227199 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:40:03.227199 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:40:03.227199 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:40:03.227199 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:40:03.227199 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:40:03.227199 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:40:03.227199 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:40:03.227199 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5c710aa-e860-4b2c-a59b-c25202c621ca could not be found. Oct 18 15:40:03.227199 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:40:03.227199 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-25cefb08-7939-4de7-bfb5-79996408d03b tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Returning 404 to user: Instance a5c710aa-e860-4b2c-a59b-c25202c621ca could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:40:03.227199 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-25cefb08-7939-4de7-bfb5-79996408d03b tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca" status: 404 len: 111 microversion: 2.1 time: 0.080763 Oct 18 15:40:03.232146 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1745/3478] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:40:03 2022] DELETE /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:40:03.242262 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-55f482c0-1d97-4f66-b830-08f4febd6a63 req-eb9898d1-523c-4d80-831c-18a4fbec1048 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12e415d7-7c40-41a0-957a-a083dbcf2b43", "name": "network-vif-deleted", "tag": "0007790a-c337-4a61-8c95-ee14bba9c445"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:40:03.267329 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-55f482c0-1d97-4f66-b830-08f4febd6a63 req-eb9898d1-523c-4d80-831c-18a4fbec1048 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:03.268661 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-55f482c0-1d97-4f66-b830-08f4febd6a63 req-eb9898d1-523c-4d80-831c-18a4fbec1048 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:03.270685 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-55f482c0-1d97-4f66-b830-08f4febd6a63 req-eb9898d1-523c-4d80-831c-18a4fbec1048 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:03.312319 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-55f482c0-1d97-4f66-b830-08f4febd6a63 req-eb9898d1-523c-4d80-831c-18a4fbec1048 service nova] Creating event network-vif-deleted:0007790a-c337-4a61-8c95-ee14bba9c445 for instance 12e415d7-7c40-41a0-957a-a083dbcf2b43 on n-h2-853682-5 Oct 18 15:40:03.317394 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-be428f15-82a9-4394-8dc4-eec4adb641c7 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.643309 Oct 18 15:40:03.321114 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1734/3479] 10.222.0.60 () {62 vars in 1188 bytes} [Tue Oct 18 15:40:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 18 15:40:03.329800 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-55f482c0-1d97-4f66-b830-08f4febd6a63 req-eb9898d1-523c-4d80-831c-18a4fbec1048 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097408 Oct 18 15:40:03.333129 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1746/3480] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:40:03.333680 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b0d23c18-6738-4313-a3d3-854fb2122c6d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:03.334314 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b0d23c18-6738-4313-a3d3-854fb2122c6d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: a5c710aa-e860-4b2c-a59b-c25202c621ca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:03.345535 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b0d23c18-6738-4313-a3d3-854fb2122c6d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:03.346029 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b0d23c18-6738-4313-a3d3-854fb2122c6d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:03.346464 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b0d23c18-6738-4313-a3d3-854fb2122c6d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:03.347690 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0c8c541f-7bc9-4fc8-bbb0-4acdbcb04d02 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:03.351087 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b0d23c18-6738-4313-a3d3-854fb2122c6d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:03.351632 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b0d23c18-6738-4313-a3d3-854fb2122c6d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:03.351821 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0c8c541f-7bc9-4fc8-bbb0-4acdbcb04d02 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] [instance: 2e17d230-cb8b-4fc8-a10c-abed2322ed3b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:03.352108 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b0d23c18-6738-4313-a3d3-854fb2122c6d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:03.385813 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-b0d23c18-6738-4313-a3d3-854fb2122c6d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] HTTP exception thrown: Instance a5c710aa-e860-4b2c-a59b-c25202c621ca could not be found. Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b0d23c18-6738-4313-a3d3-854fb2122c6d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Request method failure captured: Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca HTTP/1.1 Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTseXdqIE6K5VM4s3TEHRLWgMUN4aMRv2NoeIzUdaqo5huhkbfibHS5WTucH_yVgiw-oU86aIdI66etum9zPC1o_Gp8lN1ylUglhXYekmlUb-DCNwOQQTPA7nsDvbxyfFlUPyfZnM9HlX0P4k3Gbrf42L5eihIJ6KOiK__MhWlbfWWoY Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 04fd51d598a04ff7a909b3ced951dea8 Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-DeleteServersTestJSON-518486720 Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-DeleteServersTestJSON-518486720 Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 04fd51d598a04ff7a909b3ced951dea8 Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-DeleteServersTestJSON-518486720 Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-DeleteServersTestJSON-518486720-project Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 5309baeeec484df194123d22779b0255 Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-DeleteServersTestJSON-518486720-project Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance a5c710aa-e860-4b2c-a59b-c25202c621ca could not be found. Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'a5c710aa-e860-4b2c-a59b-c25202c621ca'} Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5c710aa-e860-4b2c-a59b-c25202c621ca could not be found. Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5c710aa-e860-4b2c-a59b-c25202c621ca could not be found. Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:40:03.387379 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:40:03.395055 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:40:03.395055 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:40:03.395055 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:40:03.395055 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:40:03.395055 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:40:03.395055 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5c710aa-e860-4b2c-a59b-c25202c621ca could not be found. Oct 18 15:40:03.395055 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:40:03.395055 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b0d23c18-6738-4313-a3d3-854fb2122c6d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Returning 404 to user: Instance a5c710aa-e860-4b2c-a59b-c25202c621ca could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:40:03.395055 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b0d23c18-6738-4313-a3d3-854fb2122c6d tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca" status: 404 len: 111 microversion: 2.1 time: 0.066684 Oct 18 15:40:03.395055 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1735/3481] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:03 2022] GET /compute/v2.1/servers/a5c710aa-e860-4b2c-a59b-c25202c621ca => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:40:03.400603 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1dbdc6f6-af4f-4f92-a48e-5cf5a03bb328 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:03.409295 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1dbdc6f6-af4f-4f92-a48e-5cf5a03bb328 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: bbd6e88c-1947-4518-9fd4-c17233679336] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:03.439637 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1dbdc6f6-af4f-4f92-a48e-5cf5a03bb328 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:03.440135 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1dbdc6f6-af4f-4f92-a48e-5cf5a03bb328 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:03.446166 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1dbdc6f6-af4f-4f92-a48e-5cf5a03bb328 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:03.454084 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1dbdc6f6-af4f-4f92-a48e-5cf5a03bb328 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:03.454756 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1dbdc6f6-af4f-4f92-a48e-5cf5a03bb328 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:03.455733 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1dbdc6f6-af4f-4f92-a48e-5cf5a03bb328 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:03.516564 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-1dbdc6f6-af4f-4f92-a48e-5cf5a03bb328 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] HTTP exception thrown: Instance bbd6e88c-1947-4518-9fd4-c17233679336 could not be found. Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1dbdc6f6-af4f-4f92-a48e-5cf5a03bb328 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Request method failure captured: Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/bbd6e88c-1947-4518-9fd4-c17233679336 HTTP/1.1 Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTseXdqIE6K5VM4s3TEHRLWgMUN4aMRv2NoeIzUdaqo5huhkbfibHS5WTucH_yVgiw-oU86aIdI66etum9zPC1o_Gp8lN1ylUglhXYekmlUb-DCNwOQQTPA7nsDvbxyfFlUPyfZnM9HlX0P4k3Gbrf42L5eihIJ6KOiK__MhWlbfWWoY Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 04fd51d598a04ff7a909b3ced951dea8 Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-DeleteServersTestJSON-518486720 Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-DeleteServersTestJSON-518486720 Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 04fd51d598a04ff7a909b3ced951dea8 Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-DeleteServersTestJSON-518486720 Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-DeleteServersTestJSON-518486720-project Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 5309baeeec484df194123d22779b0255 Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-DeleteServersTestJSON-518486720-project Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance bbd6e88c-1947-4518-9fd4-c17233679336 could not be found. Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'bbd6e88c-1947-4518-9fd4-c17233679336'} Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbd6e88c-1947-4518-9fd4-c17233679336 could not be found. Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:40:03.531010 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:40:03.535051 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbd6e88c-1947-4518-9fd4-c17233679336 could not be found. Oct 18 15:40:03.535051 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:40:03.535051 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:40:03.535051 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:40:03.535051 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:40:03.535051 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:40:03.535051 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:40:03.535051 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:40:03.535051 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:40:03.535051 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbd6e88c-1947-4518-9fd4-c17233679336 could not be found. Oct 18 15:40:03.535051 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:40:03.535051 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1dbdc6f6-af4f-4f92-a48e-5cf5a03bb328 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Returning 404 to user: Instance bbd6e88c-1947-4518-9fd4-c17233679336 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:40:03.535051 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1dbdc6f6-af4f-4f92-a48e-5cf5a03bb328 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "DELETE /compute/v2.1/servers/bbd6e88c-1947-4518-9fd4-c17233679336" status: 404 len: 111 microversion: 2.1 time: 0.135784 Oct 18 15:40:03.539566 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1736/3482] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:40:03 2022] DELETE /compute/v2.1/servers/bbd6e88c-1947-4518-9fd4-c17233679336 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 15:40:03.544763 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f46922e1-d29f-4b82-9d74-fe39f3417935 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:03.545657 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f46922e1-d29f-4b82-9d74-fe39f3417935 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] [instance: 6c2ed037-84ac-463b-a42d-01a03532cc43] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:03.549977 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0c8c541f-7bc9-4fc8-bbb0-4acdbcb04d02 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:03.552648 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f46922e1-d29f-4b82-9d74-fe39f3417935 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:03.553373 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f46922e1-d29f-4b82-9d74-fe39f3417935 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:03.554012 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f46922e1-d29f-4b82-9d74-fe39f3417935 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:03.554922 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f46922e1-d29f-4b82-9d74-fe39f3417935 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:03.555687 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f46922e1-d29f-4b82-9d74-fe39f3417935 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:03.556339 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f46922e1-d29f-4b82-9d74-fe39f3417935 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:03.562519 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0c8c541f-7bc9-4fc8-bbb0-4acdbcb04d02 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:03.569928 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0c8c541f-7bc9-4fc8-bbb0-4acdbcb04d02 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:03.572134 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0c8c541f-7bc9-4fc8-bbb0-4acdbcb04d02 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] 10.222.0.60 "GET /compute/v2.1/servers/2e17d230-cb8b-4fc8-a10c-abed2322ed3b" status: 200 len: 1278 microversion: 2.47 time: 0.237202 Oct 18 15:40:03.573119 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1747/3483] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:40:03 2022] GET /compute/v2.1/servers/2e17d230-cb8b-4fc8-a10c-abed2322ed3b => generated 1278 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:40:03.587975 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-58613ee1-d176-4e12-baed-7c00d67aae7e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:03.589447 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-58613ee1-d176-4e12-baed-7c00d67aae7e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: bbd6e88c-1947-4518-9fd4-c17233679336] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:03.628014 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-58613ee1-d176-4e12-baed-7c00d67aae7e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:03.631665 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-58613ee1-d176-4e12-baed-7c00d67aae7e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:03.632121 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-58613ee1-d176-4e12-baed-7c00d67aae7e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:03.632917 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-58613ee1-d176-4e12-baed-7c00d67aae7e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:03.639723 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-58613ee1-d176-4e12-baed-7c00d67aae7e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:03.640694 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-58613ee1-d176-4e12-baed-7c00d67aae7e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:03.669278 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-58613ee1-d176-4e12-baed-7c00d67aae7e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] HTTP exception thrown: Instance bbd6e88c-1947-4518-9fd4-c17233679336 could not be found. Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-58613ee1-d176-4e12-baed-7c00d67aae7e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Request method failure captured: Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/bbd6e88c-1947-4518-9fd4-c17233679336 HTTP/1.1 Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTseXdqIE6K5VM4s3TEHRLWgMUN4aMRv2NoeIzUdaqo5huhkbfibHS5WTucH_yVgiw-oU86aIdI66etum9zPC1o_Gp8lN1ylUglhXYekmlUb-DCNwOQQTPA7nsDvbxyfFlUPyfZnM9HlX0P4k3Gbrf42L5eihIJ6KOiK__MhWlbfWWoY Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 04fd51d598a04ff7a909b3ced951dea8 Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-DeleteServersTestJSON-518486720 Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-DeleteServersTestJSON-518486720 Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 04fd51d598a04ff7a909b3ced951dea8 Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-DeleteServersTestJSON-518486720 Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-DeleteServersTestJSON-518486720-project Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 5309baeeec484df194123d22779b0255 Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-DeleteServersTestJSON-518486720-project Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance bbd6e88c-1947-4518-9fd4-c17233679336 could not be found. Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'bbd6e88c-1947-4518-9fd4-c17233679336'} Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbd6e88c-1947-4518-9fd4-c17233679336 could not be found. Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbd6e88c-1947-4518-9fd4-c17233679336 could not be found. Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:40:03.671067 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:40:03.676472 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:40:03.676472 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:40:03.676472 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:40:03.676472 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:40:03.676472 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:40:03.676472 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbd6e88c-1947-4518-9fd4-c17233679336 could not be found. Oct 18 15:40:03.676472 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:40:03.676472 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-58613ee1-d176-4e12-baed-7c00d67aae7e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Returning 404 to user: Instance bbd6e88c-1947-4518-9fd4-c17233679336 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:40:03.676472 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-58613ee1-d176-4e12-baed-7c00d67aae7e tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/bbd6e88c-1947-4518-9fd4-c17233679336" status: 404 len: 111 microversion: 2.1 time: 0.095230 Oct 18 15:40:03.676472 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1748/3484] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:03 2022] GET /compute/v2.1/servers/bbd6e88c-1947-4518-9fd4-c17233679336 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:40:03.686275 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-dc9d459e-c8d2-4546-98dd-e36754fd6472 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:03.686275 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-dc9d459e-c8d2-4546-98dd-e36754fd6472 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 2e4fd46f-603d-4866-8bff-1361f1a9c9ab] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:03.690519 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dc9d459e-c8d2-4546-98dd-e36754fd6472 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:03.692564 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dc9d459e-c8d2-4546-98dd-e36754fd6472 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:03.693650 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dc9d459e-c8d2-4546-98dd-e36754fd6472 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:03.694968 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dc9d459e-c8d2-4546-98dd-e36754fd6472 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:03.695661 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dc9d459e-c8d2-4546-98dd-e36754fd6472 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:03.696309 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dc9d459e-c8d2-4546-98dd-e36754fd6472 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:03.723266 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-dc9d459e-c8d2-4546-98dd-e36754fd6472 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] HTTP exception thrown: Instance 2e4fd46f-603d-4866-8bff-1361f1a9c9ab could not be found. Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-dc9d459e-c8d2-4546-98dd-e36754fd6472 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Request method failure captured: Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: request: DELETE /compute/v2.1/servers/2e4fd46f-603d-4866-8bff-1361f1a9c9ab HTTP/1.1 Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTseXdqIE6K5VM4s3TEHRLWgMUN4aMRv2NoeIzUdaqo5huhkbfibHS5WTucH_yVgiw-oU86aIdI66etum9zPC1o_Gp8lN1ylUglhXYekmlUb-DCNwOQQTPA7nsDvbxyfFlUPyfZnM9HlX0P4k3Gbrf42L5eihIJ6KOiK__MhWlbfWWoY Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 04fd51d598a04ff7a909b3ced951dea8 Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-DeleteServersTestJSON-518486720 Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-DeleteServersTestJSON-518486720 Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 04fd51d598a04ff7a909b3ced951dea8 Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-DeleteServersTestJSON-518486720 Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-DeleteServersTestJSON-518486720-project Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 5309baeeec484df194123d22779b0255 Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-DeleteServersTestJSON-518486720-project Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 2e4fd46f-603d-4866-8bff-1361f1a9c9ab could not be found. Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '2e4fd46f-603d-4866-8bff-1361f1a9c9ab'} Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e4fd46f-603d-4866-8bff-1361f1a9c9ab could not be found. Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:40:03.726970 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:40:03.732564 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e4fd46f-603d-4866-8bff-1361f1a9c9ab could not be found. Oct 18 15:40:03.732564 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:40:03.732564 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:40:03.732564 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:40:03.732564 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:40:03.732564 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:40:03.732564 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:40:03.732564 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:40:03.732564 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:40:03.732564 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e4fd46f-603d-4866-8bff-1361f1a9c9ab could not be found. Oct 18 15:40:03.732564 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:40:03.738976 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-dc9d459e-c8d2-4546-98dd-e36754fd6472 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Returning 404 to user: Instance 2e4fd46f-603d-4866-8bff-1361f1a9c9ab could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:40:03.740209 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-dc9d459e-c8d2-4546-98dd-e36754fd6472 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "DELETE /compute/v2.1/servers/2e4fd46f-603d-4866-8bff-1361f1a9c9ab" status: 404 len: 111 microversion: 2.1 time: 0.061845 Oct 18 15:40:03.741757 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1749/3485] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:40:03 2022] DELETE /compute/v2.1/servers/2e4fd46f-603d-4866-8bff-1361f1a9c9ab => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 15:40:03.750043 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7b85dc6a-798e-4311-9f7f-30eac45655e7 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-111529490", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": "none"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:40:03.838389 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-7b85dc6a-798e-4311-9f7f-30eac45655e7 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:40:03.838820 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-7b85dc6a-798e-4311-9f7f-30eac45655e7 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:40:03.839300 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-7b85dc6a-798e-4311-9f7f-30eac45655e7 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:40:03.839715 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-7b85dc6a-798e-4311-9f7f-30eac45655e7 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:40:03.840131 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-7b85dc6a-798e-4311-9f7f-30eac45655e7 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:40:03.869320 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7b85dc6a-798e-4311-9f7f-30eac45655e7 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:03.869779 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7b85dc6a-798e-4311-9f7f-30eac45655e7 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:03.870834 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7b85dc6a-798e-4311-9f7f-30eac45655e7 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:03.871741 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7b85dc6a-798e-4311-9f7f-30eac45655e7 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:03.872210 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7b85dc6a-798e-4311-9f7f-30eac45655e7 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:03.872641 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7b85dc6a-798e-4311-9f7f-30eac45655e7 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:03.898967 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-7b85dc6a-798e-4311-9f7f-30eac45655e7 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Getting quotas for project 6a5421df89db4d36a164f2d9f5c27803. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:40:03.905947 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-7b85dc6a-798e-4311-9f7f-30eac45655e7 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Getting quotas for user 0253081420d048b9bacbaa3ae30ae331 and project 6a5421df89db4d36a164f2d9f5c27803. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:40:03.942399 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7b85dc6a-798e-4311-9f7f-30eac45655e7 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:40:03.946547 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7b85dc6a-798e-4311-9f7f-30eac45655e7 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] [instance: 0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:40:04.061840 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7b85dc6a-798e-4311-9f7f-30eac45655e7 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.318305 Oct 18 15:40:04.063111 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1750/3486] 10.222.0.60 () {62 vars in 1188 bytes} [Tue Oct 18 15:40:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 320 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 18 15:40:04.075215 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-dae7aeb2-eae0-4a89-ab98-445bd7aaa68c tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:04.076154 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-dae7aeb2-eae0-4a89-ab98-445bd7aaa68c tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 2e4fd46f-603d-4866-8bff-1361f1a9c9ab] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:04.083824 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dae7aeb2-eae0-4a89-ab98-445bd7aaa68c tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:04.084601 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dae7aeb2-eae0-4a89-ab98-445bd7aaa68c tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:04.085675 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dae7aeb2-eae0-4a89-ab98-445bd7aaa68c tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:04.099872 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dae7aeb2-eae0-4a89-ab98-445bd7aaa68c tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:04.100998 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dae7aeb2-eae0-4a89-ab98-445bd7aaa68c tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:04.101641 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dae7aeb2-eae0-4a89-ab98-445bd7aaa68c tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:04.130192 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-dae7aeb2-eae0-4a89-ab98-445bd7aaa68c tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] HTTP exception thrown: Instance 2e4fd46f-603d-4866-8bff-1361f1a9c9ab could not be found. Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-dae7aeb2-eae0-4a89-ab98-445bd7aaa68c tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Request method failure captured: Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/2e4fd46f-603d-4866-8bff-1361f1a9c9ab HTTP/1.1 Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTseXdqIE6K5VM4s3TEHRLWgMUN4aMRv2NoeIzUdaqo5huhkbfibHS5WTucH_yVgiw-oU86aIdI66etum9zPC1o_Gp8lN1ylUglhXYekmlUb-DCNwOQQTPA7nsDvbxyfFlUPyfZnM9HlX0P4k3Gbrf42L5eihIJ6KOiK__MhWlbfWWoY Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 04fd51d598a04ff7a909b3ced951dea8 Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-DeleteServersTestJSON-518486720 Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-DeleteServersTestJSON-518486720 Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 04fd51d598a04ff7a909b3ced951dea8 Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-DeleteServersTestJSON-518486720 Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-DeleteServersTestJSON-518486720-project Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 5309baeeec484df194123d22779b0255 Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-DeleteServersTestJSON-518486720-project Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 2e4fd46f-603d-4866-8bff-1361f1a9c9ab could not be found. Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '2e4fd46f-603d-4866-8bff-1361f1a9c9ab'} Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e4fd46f-603d-4866-8bff-1361f1a9c9ab could not be found. Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e4fd46f-603d-4866-8bff-1361f1a9c9ab could not be found. Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:40:04.132535 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:40:04.137549 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:40:04.137549 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:40:04.137549 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:40:04.137549 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:40:04.137549 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:40:04.137549 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e4fd46f-603d-4866-8bff-1361f1a9c9ab could not be found. Oct 18 15:40:04.137549 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:40:04.143193 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-dae7aeb2-eae0-4a89-ab98-445bd7aaa68c tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Returning 404 to user: Instance 2e4fd46f-603d-4866-8bff-1361f1a9c9ab could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:40:04.145172 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-dae7aeb2-eae0-4a89-ab98-445bd7aaa68c tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/2e4fd46f-603d-4866-8bff-1361f1a9c9ab" status: 404 len: 111 microversion: 2.1 time: 0.080810 Oct 18 15:40:04.147421 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1751/3487] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:04 2022] GET /compute/v2.1/servers/2e4fd46f-603d-4866-8bff-1361f1a9c9ab => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:40:04.160675 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-59c910d3-6905-4353-84c4-ca3ba639d157 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:04.163240 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-59c910d3-6905-4353-84c4-ca3ba639d157 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 12e415d7-7c40-41a0-957a-a083dbcf2b43] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:04.189364 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-59c910d3-6905-4353-84c4-ca3ba639d157 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:04.194168 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-59c910d3-6905-4353-84c4-ca3ba639d157 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:04.194663 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-59c910d3-6905-4353-84c4-ca3ba639d157 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:04.199721 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-59c910d3-6905-4353-84c4-ca3ba639d157 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:04.200333 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-59c910d3-6905-4353-84c4-ca3ba639d157 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:04.204964 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-59c910d3-6905-4353-84c4-ca3ba639d157 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:04.263297 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-59c910d3-6905-4353-84c4-ca3ba639d157 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] HTTP exception thrown: Instance 12e415d7-7c40-41a0-957a-a083dbcf2b43 could not be found. Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-59c910d3-6905-4353-84c4-ca3ba639d157 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Request method failure captured: Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43 HTTP/1.1 Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTseN65N0qApJvDDMMfddXqpMfI7xWk1J5atOQp_Oeywx-wkHlI8ZA5AFhWDOL-TOcTqefH8iJHBUi1wG_27-LimwpRNcjd7RH9WE1nw3iqd2OcUy6wl8jGrd6jyzRfMfF-cj8C5ZKSk7xaNBJ2yV8gtnNGSyvPwvzRZ0cXHrMymh7pY Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 91719d2b1f1640f391aa0b54c9725d2a Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-MigrationsAdminTest-2103704262 Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/91719d2b1f1640f391aa0b54c9725d2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/91719d2b1f1640f391aa0b54c9725d2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/91719d2b1f1640f391aa0b54c9725d2a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_91719d2b1f1640f391aa0b54c9725d2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-MigrationsAdminTest-2103704262 Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 91719d2b1f1640f391aa0b54c9725d2a Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-MigrationsAdminTest-2103704262 Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-MigrationsAdminTest-2103704262-project Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 926f2a98aa66431fab2a6032f21d5ae7 Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-MigrationsAdminTest-2103704262-project Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 12e415d7-7c40-41a0-957a-a083dbcf2b43 could not be found. Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '12e415d7-7c40-41a0-957a-a083dbcf2b43'} Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12e415d7-7c40-41a0-957a-a083dbcf2b43 could not be found. Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12e415d7-7c40-41a0-957a-a083dbcf2b43 could not be found. Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:40:04.267841 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:40:04.273137 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:40:04.273137 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:40:04.273137 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:40:04.273137 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:40:04.273137 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:40:04.273137 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12e415d7-7c40-41a0-957a-a083dbcf2b43 could not be found. Oct 18 15:40:04.273137 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:40:04.275967 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-59c910d3-6905-4353-84c4-ca3ba639d157 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Returning 404 to user: Instance 12e415d7-7c40-41a0-957a-a083dbcf2b43 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:40:04.279056 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-59c910d3-6905-4353-84c4-ca3ba639d157 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43" status: 404 len: 111 microversion: 2.1 time: 0.128418 Oct 18 15:40:04.282005 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1752/3488] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:04 2022] GET /compute/v2.1/servers/12e415d7-7c40-41a0-957a-a083dbcf2b43 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:40:04.307835 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0df8c5aa-df59-470f-8336-c5da6bc91150 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:40:04.321721 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0df8c5aa-df59-470f-8336-c5da6bc91150 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] [instance: 0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:04.326748 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f46922e1-d29f-4b82-9d74-fe39f3417935 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386f58c6593d43d2829e08fbdb9ed769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e75e5c7ef1b48cfb696da32fa30b845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:04.351358 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f46922e1-d29f-4b82-9d74-fe39f3417935 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] 10.222.0.60 "GET /compute/v2.1/servers/6c2ed037-84ac-463b-a42d-01a03532cc43" status: 200 len: 1512 microversion: 2.1 time: 0.799060 Oct 18 15:40:04.353095 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1737/3489] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:03 2022] GET /compute/v2.1/servers/6c2ed037-84ac-463b-a42d-01a03532cc43 => generated 1512 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:04.365939 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9fe7a0a0-d321-4052-b5b6-3cce71fa7b1d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '.version_select at 0x7f7c3c509670>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:04.396368 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:40:04.422280 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9fe7a0a0-d321-4052-b5b6-3cce71fa7b1d tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-598900667" status: 202 len: 0 microversion: 2.1 time: 0.067700 Oct 18 15:40:04.425773 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1738/3490] 10.222.0.60 () {58 vars in 1218 bytes} [Tue Oct 18 15:40:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-598900667 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:40:04.515701 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0df8c5aa-df59-470f-8336-c5da6bc91150 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] 10.222.0.60 "PUT /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1" status: 200 len: 991 microversion: 2.47 time: 0.232326 Oct 18 15:40:04.516373 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1753/3491] 10.222.0.60 () {62 vars in 1297 bytes} [Tue Oct 18 15:40:04 2022] PUT /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1 => generated 991 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:40:04.536904 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5dc5283e-8f40-42dd-9eb6-f7a832d1e53a tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:04.537949 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5dc5283e-8f40-42dd-9eb6-f7a832d1e53a tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] [instance: 0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:04.810476 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5dc5283e-8f40-42dd-9eb6-f7a832d1e53a tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:04.821010 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5dc5283e-8f40-42dd-9eb6-f7a832d1e53a tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:04.827607 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5dc5283e-8f40-42dd-9eb6-f7a832d1e53a tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:04.829438 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5dc5283e-8f40-42dd-9eb6-f7a832d1e53a tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] 10.222.0.60 "GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1" status: 200 len: 1277 microversion: 2.47 time: 0.297196 Oct 18 15:40:04.838051 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1739/3492] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:40:04 2022] GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1 => generated 1277 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:40:05.381598 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-512d34eb-3ce0-4b40-ae2b-c00b752dae03 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:05.381598 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-512d34eb-3ce0-4b40-ae2b-c00b752dae03 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] [instance: 6c2ed037-84ac-463b-a42d-01a03532cc43] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:05.400264 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-512d34eb-3ce0-4b40-ae2b-c00b752dae03 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:05.401069 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-512d34eb-3ce0-4b40-ae2b-c00b752dae03 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:05.401709 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-512d34eb-3ce0-4b40-ae2b-c00b752dae03 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:05.402606 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-512d34eb-3ce0-4b40-ae2b-c00b752dae03 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:05.403238 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-512d34eb-3ce0-4b40-ae2b-c00b752dae03 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:05.403955 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-512d34eb-3ce0-4b40-ae2b-c00b752dae03 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:05.472507 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-512d34eb-3ce0-4b40-ae2b-c00b752dae03 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:05.473301 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-512d34eb-3ce0-4b40-ae2b-c00b752dae03 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:05.473913 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-512d34eb-3ce0-4b40-ae2b-c00b752dae03 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:05.474551 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-512d34eb-3ce0-4b40-ae2b-c00b752dae03 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lazy-loading 'fault' on Instance uuid 6c2ed037-84ac-463b-a42d-01a03532cc43 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:40:05.534807 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-d2046762-f3ca-4e0b-bfc2-57fa465bec22 req-1bf99681-e0cb-40c0-8c23-f3069d9c8b07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a23be5e-9334-4385-9476-4bbd81995002", "tag": "4c591361-ce3f-4d4a-acbd-c51f7d0da6dc"}, {"server_uuid": "6c2ed037-84ac-463b-a42d-01a03532cc43", "name": "network-vif-deleted", "tag": "6e6a8be2-7d56-46b4-83cf-fafcac566b7c"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:40:05.556680 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d2046762-f3ca-4e0b-bfc2-57fa465bec22 req-1bf99681-e0cb-40c0-8c23-f3069d9c8b07 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:05.557204 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d2046762-f3ca-4e0b-bfc2-57fa465bec22 req-1bf99681-e0cb-40c0-8c23-f3069d9c8b07 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:05.557634 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d2046762-f3ca-4e0b-bfc2-57fa465bec22 req-1bf99681-e0cb-40c0-8c23-f3069d9c8b07 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:05.588467 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-d2046762-f3ca-4e0b-bfc2-57fa465bec22 req-1bf99681-e0cb-40c0-8c23-f3069d9c8b07 service nova] Creating event network-changed:4c591361-ce3f-4d4a-acbd-c51f7d0da6dc for instance 4a23be5e-9334-4385-9476-4bbd81995002 on n-h2-853682-5 Oct 18 15:40:05.589027 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-d2046762-f3ca-4e0b-bfc2-57fa465bec22 req-1bf99681-e0cb-40c0-8c23-f3069d9c8b07 service nova] Creating event network-vif-deleted:6e6a8be2-7d56-46b4-83cf-fafcac566b7c for instance 6c2ed037-84ac-463b-a42d-01a03532cc43 on n-h1-853682-5 Oct 18 15:40:05.605692 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-d2046762-f3ca-4e0b-bfc2-57fa465bec22 req-1bf99681-e0cb-40c0-8c23-f3069d9c8b07 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.075051 Oct 18 15:40:05.614101 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1740/3493] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:40:05.695608 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-512d34eb-3ce0-4b40-ae2b-c00b752dae03 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386f58c6593d43d2829e08fbdb9ed769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e75e5c7ef1b48cfb696da32fa30b845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:05.719588 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-512d34eb-3ce0-4b40-ae2b-c00b752dae03 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] 10.222.0.60 "GET /compute/v2.1/servers/6c2ed037-84ac-463b-a42d-01a03532cc43" status: 200 len: 1306 microversion: 2.1 time: 0.344671 Oct 18 15:40:05.720190 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1754/3494] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:05 2022] GET /compute/v2.1/servers/6c2ed037-84ac-463b-a42d-01a03532cc43 => generated 1306 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:05.872446 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1be5d1fc-d8f4-4b15-922e-2fb949cb7747 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:05.873235 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1be5d1fc-d8f4-4b15-922e-2fb949cb7747 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] [instance: 0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:05.888235 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1be5d1fc-d8f4-4b15-922e-2fb949cb7747 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:05.888736 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1be5d1fc-d8f4-4b15-922e-2fb949cb7747 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:05.889223 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1be5d1fc-d8f4-4b15-922e-2fb949cb7747 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:05.889940 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1be5d1fc-d8f4-4b15-922e-2fb949cb7747 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:05.890406 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1be5d1fc-d8f4-4b15-922e-2fb949cb7747 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:05.904750 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1be5d1fc-d8f4-4b15-922e-2fb949cb7747 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:06.314543 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1be5d1fc-d8f4-4b15-922e-2fb949cb7747 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:06.327950 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1be5d1fc-d8f4-4b15-922e-2fb949cb7747 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:06.333465 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1be5d1fc-d8f4-4b15-922e-2fb949cb7747 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:06.334958 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1be5d1fc-d8f4-4b15-922e-2fb949cb7747 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] 10.222.0.60 "GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1" status: 200 len: 1281 microversion: 2.47 time: 0.467926 Oct 18 15:40:06.335724 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1741/3495] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:40:05 2022] GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1 => generated 1281 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:40:06.743204 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2d8a759b-d4f0-463d-a087-775909dd876a tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:06.744569 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2d8a759b-d4f0-463d-a087-775909dd876a tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] [instance: 6c2ed037-84ac-463b-a42d-01a03532cc43] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:06.755986 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d8a759b-d4f0-463d-a087-775909dd876a tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:06.767395 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d8a759b-d4f0-463d-a087-775909dd876a tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:06.768071 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d8a759b-d4f0-463d-a087-775909dd876a tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:06.769589 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d8a759b-d4f0-463d-a087-775909dd876a tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:06.774125 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d8a759b-d4f0-463d-a087-775909dd876a tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:06.774584 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d8a759b-d4f0-463d-a087-775909dd876a tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:06.862641 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:40:06.917431 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d8a759b-d4f0-463d-a087-775909dd876a tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:06.918468 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d8a759b-d4f0-463d-a087-775909dd876a tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:06.918923 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d8a759b-d4f0-463d-a087-775909dd876a tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:06.919397 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-2d8a759b-d4f0-463d-a087-775909dd876a tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lazy-loading 'fault' on Instance uuid 6c2ed037-84ac-463b-a42d-01a03532cc43 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:40:07.015168 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2d8a759b-d4f0-463d-a087-775909dd876a tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386f58c6593d43d2829e08fbdb9ed769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e75e5c7ef1b48cfb696da32fa30b845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:07.027120 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2d8a759b-d4f0-463d-a087-775909dd876a tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] 10.222.0.60 "GET /compute/v2.1/servers/6c2ed037-84ac-463b-a42d-01a03532cc43" status: 200 len: 1306 microversion: 2.1 time: 0.287914 Oct 18 15:40:07.034216 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1755/3496] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:06 2022] GET /compute/v2.1/servers/6c2ed037-84ac-463b-a42d-01a03532cc43 => generated 1306 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:40:07.366675 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8b4050fd-f468-4062-90a3-0529b5a36204 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:07.367385 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8b4050fd-f468-4062-90a3-0529b5a36204 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] [instance: 0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:07.381090 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b4050fd-f468-4062-90a3-0529b5a36204 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:07.381587 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b4050fd-f468-4062-90a3-0529b5a36204 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:07.382025 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b4050fd-f468-4062-90a3-0529b5a36204 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:07.382738 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b4050fd-f468-4062-90a3-0529b5a36204 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:07.383413 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b4050fd-f468-4062-90a3-0529b5a36204 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:07.383626 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b4050fd-f468-4062-90a3-0529b5a36204 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:07.406304 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-26b2734e-44a6-48e7-9c73-e02907ed7d57 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:07.406849 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-26b2734e-44a6-48e7-9c73-e02907ed7d57 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 1c84f8ca-befc-489e-8068-135af3b766fe] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:07.419125 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26b2734e-44a6-48e7-9c73-e02907ed7d57 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:07.419628 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26b2734e-44a6-48e7-9c73-e02907ed7d57 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:07.420078 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26b2734e-44a6-48e7-9c73-e02907ed7d57 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:07.420847 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26b2734e-44a6-48e7-9c73-e02907ed7d57 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:07.421298 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26b2734e-44a6-48e7-9c73-e02907ed7d57 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:07.421737 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26b2734e-44a6-48e7-9c73-e02907ed7d57 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:07.486668 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-26b2734e-44a6-48e7-9c73-e02907ed7d57 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 1c84f8ca-befc-489e-8068-135af3b766fe] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:40:07.556784 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8b4050fd-f468-4062-90a3-0529b5a36204 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:07.566697 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8b4050fd-f468-4062-90a3-0529b5a36204 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:07.570499 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8b4050fd-f468-4062-90a3-0529b5a36204 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:07.573517 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8b4050fd-f468-4062-90a3-0529b5a36204 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] 10.222.0.60 "GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1" status: 200 len: 1329 microversion: 2.47 time: 0.211005 Oct 18 15:40:07.574774 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1742/3497] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:40:07 2022] GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1 => generated 1329 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:40:07.646122 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-26b2734e-44a6-48e7-9c73-e02907ed7d57 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe" status: 204 len: 0 microversion: 2.1 time: 0.243420 Oct 18 15:40:07.670491 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-20841dd3-2c90-427f-8f9d-c443b2d32997 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:07.671445 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-20841dd3-2c90-427f-8f9d-c443b2d32997 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 1c84f8ca-befc-489e-8068-135af3b766fe] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:07.671657 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1756/3498] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:40:07 2022] DELETE /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 15:40:07.685957 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20841dd3-2c90-427f-8f9d-c443b2d32997 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:07.687363 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20841dd3-2c90-427f-8f9d-c443b2d32997 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:07.687998 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20841dd3-2c90-427f-8f9d-c443b2d32997 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:07.689025 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20841dd3-2c90-427f-8f9d-c443b2d32997 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:07.689707 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20841dd3-2c90-427f-8f9d-c443b2d32997 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:07.690300 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20841dd3-2c90-427f-8f9d-c443b2d32997 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:07.899818 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-20841dd3-2c90-427f-8f9d-c443b2d32997 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:07.910237 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-20841dd3-2c90-427f-8f9d-c443b2d32997 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe" status: 200 len: 1467 microversion: 2.1 time: 0.253361 Oct 18 15:40:07.911424 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1743/3499] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:07 2022] GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe => generated 1467 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:07.930774 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-88190868-ae64-4ef1-9167-819e5b3819a1 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Action: 'create', calling method: .version_select at 0x7f7c3d025ee0>, body: {"keypair": {"name": "tempest-keypair-1297654325", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB03ZQsiiGd3NKnAA2rZr0NvIFiUaoT9Q4igguL+t1FkBMSj8jE7lfrqKSRA+wdvcSD4hgQVaX1y45sfMVL6TJI+YiFajRY/vHTSABZ9P4rNWiS2iZcG680XW3qxtPl9/g=="}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:40:07.948286 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-88190868-ae64-4ef1-9167-819e5b3819a1 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Getting quotas for project 863e54dfc6654672a9423c9de5be3e03. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:40:07.954139 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-88190868-ae64-4ef1-9167-819e5b3819a1 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Getting quotas for user e4287d8ca081403289857f84e3d0c3f8 and project 863e54dfc6654672a9423c9de5be3e03. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:40:07.955839 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:40:07.997827 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-88190868-ae64-4ef1-9167-819e5b3819a1 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.150962 Oct 18 15:40:07.999161 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1757/3500] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Oct 18 15:40:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:40:08.011727 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-91b854f8-2339-4b45-af34-bfaed314afdb tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:40:08.018091 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91b854f8-2339-4b45-af34-bfaed314afdb tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:08.018671 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91b854f8-2339-4b45-af34-bfaed314afdb tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:08.019588 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91b854f8-2339-4b45-af34-bfaed314afdb tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:08.050073 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-91b854f8-2339-4b45-af34-bfaed314afdb tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 52d725f3-b4da-4831-9abf-bf7aba8aee0a] Going to try to stop instance {{(pid=120406) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 18 15:40:08.126797 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-91b854f8-2339-4b45-af34-bfaed314afdb tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "POST /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a/action" status: 202 len: 0 microversion: 2.1 time: 0.118606 Oct 18 15:40:08.127510 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1744/3501] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:40:08 2022] POST /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:40:08.136183 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a407c527-a88e-4f81-8ec0-bc5df4251477 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:08.137344 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a407c527-a88e-4f81-8ec0-bc5df4251477 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 52d725f3-b4da-4831-9abf-bf7aba8aee0a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:08.146606 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a407c527-a88e-4f81-8ec0-bc5df4251477 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:08.147557 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a407c527-a88e-4f81-8ec0-bc5df4251477 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:08.148181 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a407c527-a88e-4f81-8ec0-bc5df4251477 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:08.149155 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a407c527-a88e-4f81-8ec0-bc5df4251477 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:08.149885 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a407c527-a88e-4f81-8ec0-bc5df4251477 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:08.150489 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a407c527-a88e-4f81-8ec0-bc5df4251477 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:08.151614 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-81cf61a7-4e3f-4113-ba8d-b629fb1f22e9 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:08.152468 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-81cf61a7-4e3f-4113-ba8d-b629fb1f22e9 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] [instance: 6c2ed037-84ac-463b-a42d-01a03532cc43] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:08.161337 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81cf61a7-4e3f-4113-ba8d-b629fb1f22e9 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:08.161915 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81cf61a7-4e3f-4113-ba8d-b629fb1f22e9 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:08.162472 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81cf61a7-4e3f-4113-ba8d-b629fb1f22e9 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:08.163330 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81cf61a7-4e3f-4113-ba8d-b629fb1f22e9 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:08.163986 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81cf61a7-4e3f-4113-ba8d-b629fb1f22e9 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:08.164461 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81cf61a7-4e3f-4113-ba8d-b629fb1f22e9 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:08.190845 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-81cf61a7-4e3f-4113-ba8d-b629fb1f22e9 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] HTTP exception thrown: Instance 6c2ed037-84ac-463b-a42d-01a03532cc43 could not be found. Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-81cf61a7-4e3f-4113-ba8d-b629fb1f22e9 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Request method failure captured: Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/6c2ed037-84ac-463b-a42d-01a03532cc43 HTTP/1.1 Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsiuKbtSKW-zyvZlLL90ZFAYg5Gp90nrGUzmqf5YZTbSPew1USWmd3epr0bY_rKnZ7Jqp30okVXkIgbL3U-1k9wW5K44lUooZIFg8vbjfT7n4-6GSJqBHj7xxqF7evBx8IUd7KCY1vbzWiaXd1KEuvW1Yo3kcIgcEfRMxWUxjpM-ivk Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 0e75e5c7ef1b48cfb696da32fa30b845 Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-InstanceActionsTestJSON-2079255092 Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0e75e5c7ef1b48cfb696da32fa30b845"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0e75e5c7ef1b48cfb696da32fa30b845"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0e75e5c7ef1b48cfb696da32fa30b845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0e75e5c7ef1b48cfb696da32fa30b845"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-InstanceActionsTestJSON-2079255092 Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 0e75e5c7ef1b48cfb696da32fa30b845 Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-InstanceActionsTestJSON-2079255092 Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-InstanceActionsTestJSON-2079255092-project Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 386f58c6593d43d2829e08fbdb9ed769 Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-InstanceActionsTestJSON-2079255092-project Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 6c2ed037-84ac-463b-a42d-01a03532cc43 could not be found. Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '6c2ed037-84ac-463b-a42d-01a03532cc43'} Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c2ed037-84ac-463b-a42d-01a03532cc43 could not be found. Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c2ed037-84ac-463b-a42d-01a03532cc43 could not be found. Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:40:08.193401 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:40:08.198507 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:40:08.198507 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:40:08.198507 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:40:08.198507 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:40:08.198507 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:40:08.198507 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c2ed037-84ac-463b-a42d-01a03532cc43 could not be found. Oct 18 15:40:08.198507 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:40:08.198507 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-81cf61a7-4e3f-4113-ba8d-b629fb1f22e9 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] Returning 404 to user: Instance 6c2ed037-84ac-463b-a42d-01a03532cc43 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:40:08.198507 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-81cf61a7-4e3f-4113-ba8d-b629fb1f22e9 tempest-InstanceActionsTestJSON-2079255092 tempest-InstanceActionsTestJSON-2079255092-project] 10.222.0.60 "GET /compute/v2.1/servers/6c2ed037-84ac-463b-a42d-01a03532cc43" status: 404 len: 111 microversion: 2.1 time: 0.052788 Oct 18 15:40:08.199806 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1745/3502] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:08 2022] GET /compute/v2.1/servers/6c2ed037-84ac-463b-a42d-01a03532cc43 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:40:08.545456 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a407c527-a88e-4f81-8ec0-bc5df4251477 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304b3248f9db4629943a8b8080a6d22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdc7504a1d1424ea34f83f1a6d4bf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:08.560406 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a407c527-a88e-4f81-8ec0-bc5df4251477 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a" status: 200 len: 1721 microversion: 2.1 time: 0.428292 Oct 18 15:40:08.561040 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1758/3503] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:08 2022] GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a => generated 1721 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:08.609627 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2d61a155-6a9e-4ed1-a93d-b90097e04eb7 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:08.609627 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2d61a155-6a9e-4ed1-a93d-b90097e04eb7 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] [instance: 0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:08.624760 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d61a155-6a9e-4ed1-a93d-b90097e04eb7 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:08.627020 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d61a155-6a9e-4ed1-a93d-b90097e04eb7 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:08.627611 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d61a155-6a9e-4ed1-a93d-b90097e04eb7 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:08.632267 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d61a155-6a9e-4ed1-a93d-b90097e04eb7 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:08.633426 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d61a155-6a9e-4ed1-a93d-b90097e04eb7 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:08.634755 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d61a155-6a9e-4ed1-a93d-b90097e04eb7 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:08.794935 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2d61a155-6a9e-4ed1-a93d-b90097e04eb7 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:08.805113 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2d61a155-6a9e-4ed1-a93d-b90097e04eb7 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:08.808700 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2d61a155-6a9e-4ed1-a93d-b90097e04eb7 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:08.810689 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2d61a155-6a9e-4ed1-a93d-b90097e04eb7 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] 10.222.0.60 "GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1" status: 200 len: 1329 microversion: 2.47 time: 0.207561 Oct 18 15:40:08.811740 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1746/3504] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:40:08 2022] GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1 => generated 1329 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:40:08.939943 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-66647e65-73e2-49d6-b9f7-05abe45957ff tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:08.940942 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-66647e65-73e2-49d6-b9f7-05abe45957ff tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 1c84f8ca-befc-489e-8068-135af3b766fe] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:08.962790 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-66647e65-73e2-49d6-b9f7-05abe45957ff tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:08.963284 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-66647e65-73e2-49d6-b9f7-05abe45957ff tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:08.963716 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-66647e65-73e2-49d6-b9f7-05abe45957ff tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:08.964422 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-66647e65-73e2-49d6-b9f7-05abe45957ff tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:08.965108 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-66647e65-73e2-49d6-b9f7-05abe45957ff tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:08.965534 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-66647e65-73e2-49d6-b9f7-05abe45957ff tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:09.585637 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f8ef0172-edd7-49e2-9c21-ac9fa39cdce5 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:09.586269 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f8ef0172-edd7-49e2-9c21-ac9fa39cdce5 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 52d725f3-b4da-4831-9abf-bf7aba8aee0a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:09.600782 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8ef0172-edd7-49e2-9c21-ac9fa39cdce5 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:09.601292 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8ef0172-edd7-49e2-9c21-ac9fa39cdce5 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:09.601724 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8ef0172-edd7-49e2-9c21-ac9fa39cdce5 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:09.602853 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8ef0172-edd7-49e2-9c21-ac9fa39cdce5 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:09.603314 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8ef0172-edd7-49e2-9c21-ac9fa39cdce5 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:09.603731 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8ef0172-edd7-49e2-9c21-ac9fa39cdce5 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:09.715329 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-66647e65-73e2-49d6-b9f7-05abe45957ff tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:09.726677 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-66647e65-73e2-49d6-b9f7-05abe45957ff tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe" status: 200 len: 1467 microversion: 2.1 time: 0.790572 Oct 18 15:40:09.727891 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1759/3505] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:08 2022] GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe => generated 1467 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:09.838012 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c4ef4bde-9689-48d9-8601-4c11b3f30ca5 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:09.838641 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c4ef4bde-9689-48d9-8601-4c11b3f30ca5 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] [instance: 0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:09.848328 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c4ef4bde-9689-48d9-8601-4c11b3f30ca5 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:09.849213 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c4ef4bde-9689-48d9-8601-4c11b3f30ca5 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:09.849920 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c4ef4bde-9689-48d9-8601-4c11b3f30ca5 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:09.850831 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c4ef4bde-9689-48d9-8601-4c11b3f30ca5 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:09.851826 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c4ef4bde-9689-48d9-8601-4c11b3f30ca5 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:09.858159 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c4ef4bde-9689-48d9-8601-4c11b3f30ca5 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:10.166343 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c4ef4bde-9689-48d9-8601-4c11b3f30ca5 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:10.185451 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c4ef4bde-9689-48d9-8601-4c11b3f30ca5 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:10.187425 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c4ef4bde-9689-48d9-8601-4c11b3f30ca5 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:10.189619 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c4ef4bde-9689-48d9-8601-4c11b3f30ca5 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] 10.222.0.60 "GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1" status: 200 len: 1335 microversion: 2.47 time: 0.355459 Oct 18 15:40:10.191563 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1760/3506] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:40:09 2022] GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1 => generated 1335 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:40:10.553360 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f8ef0172-edd7-49e2-9c21-ac9fa39cdce5 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304b3248f9db4629943a8b8080a6d22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdc7504a1d1424ea34f83f1a6d4bf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:10.565181 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f8ef0172-edd7-49e2-9c21-ac9fa39cdce5 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a" status: 200 len: 1675 microversion: 2.1 time: 0.983394 Oct 18 15:40:10.569761 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1747/3507] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:09 2022] GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a => generated 1675 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:10.758729 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5c08f13e-9387-47e1-a9b7-bd72b3274dcc tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:10.761375 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5c08f13e-9387-47e1-a9b7-bd72b3274dcc tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 1c84f8ca-befc-489e-8068-135af3b766fe] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:10.775935 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5c08f13e-9387-47e1-a9b7-bd72b3274dcc tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:10.776439 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5c08f13e-9387-47e1-a9b7-bd72b3274dcc tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:10.776924 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5c08f13e-9387-47e1-a9b7-bd72b3274dcc tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:10.788227 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5c08f13e-9387-47e1-a9b7-bd72b3274dcc tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:10.792017 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5c08f13e-9387-47e1-a9b7-bd72b3274dcc tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:10.793626 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5c08f13e-9387-47e1-a9b7-bd72b3274dcc tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:11.011578 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-2b2548bc-924f-48db-924a-22ff685eb5cc req-e51539f0-1fe4-43bc-bc7a-608f9ec35ac2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c84f8ca-befc-489e-8068-135af3b766fe", "name": "network-vif-deleted", "tag": "a6a64478-83ca-4d2d-9c94-d78e137f6782"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:40:11.040233 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2b2548bc-924f-48db-924a-22ff685eb5cc req-e51539f0-1fe4-43bc-bc7a-608f9ec35ac2 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:11.041790 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2b2548bc-924f-48db-924a-22ff685eb5cc req-e51539f0-1fe4-43bc-bc7a-608f9ec35ac2 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:11.042423 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2b2548bc-924f-48db-924a-22ff685eb5cc req-e51539f0-1fe4-43bc-bc7a-608f9ec35ac2 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:11.077776 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-2b2548bc-924f-48db-924a-22ff685eb5cc req-e51539f0-1fe4-43bc-bc7a-608f9ec35ac2 service nova] Creating event network-vif-deleted:a6a64478-83ca-4d2d-9c94-d78e137f6782 for instance 1c84f8ca-befc-489e-8068-135af3b766fe on n-h2-853682-5 Oct 18 15:40:11.089769 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-2b2548bc-924f-48db-924a-22ff685eb5cc req-e51539f0-1fe4-43bc-bc7a-608f9ec35ac2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088277 Oct 18 15:40:11.092496 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1748/3508] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:40:11.107005 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1d5e44ed-6e12-4b90-9142-2038582fdd13 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:11.109662 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1d5e44ed-6e12-4b90-9142-2038582fdd13 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: b7ebc01d-7008-4ca7-a82b-094962216ceb] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:11.124405 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d5e44ed-6e12-4b90-9142-2038582fdd13 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:11.125686 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d5e44ed-6e12-4b90-9142-2038582fdd13 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:11.126466 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d5e44ed-6e12-4b90-9142-2038582fdd13 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:11.127393 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d5e44ed-6e12-4b90-9142-2038582fdd13 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:11.128108 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d5e44ed-6e12-4b90-9142-2038582fdd13 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:11.134163 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d5e44ed-6e12-4b90-9142-2038582fdd13 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:11.142690 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:40:11.170941 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-1d5e44ed-6e12-4b90-9142-2038582fdd13 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] HTTP exception thrown: Instance b7ebc01d-7008-4ca7-a82b-094962216ceb could not be found. Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1d5e44ed-6e12-4b90-9142-2038582fdd13 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Request method failure captured: Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/b7ebc01d-7008-4ca7-a82b-094962216ceb HTTP/1.1 Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTseXdqIE6K5VM4s3TEHRLWgMUN4aMRv2NoeIzUdaqo5huhkbfibHS5WTucH_yVgiw-oU86aIdI66etum9zPC1o_Gp8lN1ylUglhXYekmlUb-DCNwOQQTPA7nsDvbxyfFlUPyfZnM9HlX0P4k3Gbrf42L5eihIJ6KOiK__MhWlbfWWoY Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 04fd51d598a04ff7a909b3ced951dea8 Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-DeleteServersTestJSON-518486720 Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-DeleteServersTestJSON-518486720 Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 04fd51d598a04ff7a909b3ced951dea8 Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-DeleteServersTestJSON-518486720 Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-DeleteServersTestJSON-518486720-project Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 5309baeeec484df194123d22779b0255 Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-DeleteServersTestJSON-518486720-project Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance b7ebc01d-7008-4ca7-a82b-094962216ceb could not be found. Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'b7ebc01d-7008-4ca7-a82b-094962216ceb'} Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7ebc01d-7008-4ca7-a82b-094962216ceb could not be found. Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:40:11.173132 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:40:11.177535 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7ebc01d-7008-4ca7-a82b-094962216ceb could not be found. Oct 18 15:40:11.177535 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:40:11.177535 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:40:11.177535 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:40:11.177535 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:40:11.177535 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:40:11.177535 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:40:11.177535 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:40:11.177535 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:40:11.177535 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7ebc01d-7008-4ca7-a82b-094962216ceb could not be found. Oct 18 15:40:11.177535 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:40:11.181260 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1d5e44ed-6e12-4b90-9142-2038582fdd13 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Returning 404 to user: Instance b7ebc01d-7008-4ca7-a82b-094962216ceb could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:40:11.187133 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1d5e44ed-6e12-4b90-9142-2038582fdd13 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b7ebc01d-7008-4ca7-a82b-094962216ceb" status: 404 len: 111 microversion: 2.1 time: 0.084490 Oct 18 15:40:11.188774 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1749/3509] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:40:11 2022] DELETE /compute/v2.1/servers/b7ebc01d-7008-4ca7-a82b-094962216ceb => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 15:40:11.197609 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7bbe54df-efe3-492a-8550-f39e3c9ff04f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:11.203801 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7bbe54df-efe3-492a-8550-f39e3c9ff04f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: b7ebc01d-7008-4ca7-a82b-094962216ceb] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:11.224503 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7bbe54df-efe3-492a-8550-f39e3c9ff04f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:11.227134 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7bbe54df-efe3-492a-8550-f39e3c9ff04f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:11.227827 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7bbe54df-efe3-492a-8550-f39e3c9ff04f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:11.228845 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7bbe54df-efe3-492a-8550-f39e3c9ff04f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:11.231457 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7bbe54df-efe3-492a-8550-f39e3c9ff04f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:11.232176 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7bbe54df-efe3-492a-8550-f39e3c9ff04f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:11.265068 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-7bbe54df-efe3-492a-8550-f39e3c9ff04f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] HTTP exception thrown: Instance b7ebc01d-7008-4ca7-a82b-094962216ceb could not be found. Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7bbe54df-efe3-492a-8550-f39e3c9ff04f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Request method failure captured: Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/b7ebc01d-7008-4ca7-a82b-094962216ceb HTTP/1.1 Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTseXdqIE6K5VM4s3TEHRLWgMUN4aMRv2NoeIzUdaqo5huhkbfibHS5WTucH_yVgiw-oU86aIdI66etum9zPC1o_Gp8lN1ylUglhXYekmlUb-DCNwOQQTPA7nsDvbxyfFlUPyfZnM9HlX0P4k3Gbrf42L5eihIJ6KOiK__MhWlbfWWoY Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 04fd51d598a04ff7a909b3ced951dea8 Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-DeleteServersTestJSON-518486720 Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-DeleteServersTestJSON-518486720 Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 04fd51d598a04ff7a909b3ced951dea8 Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-DeleteServersTestJSON-518486720 Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-DeleteServersTestJSON-518486720-project Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 5309baeeec484df194123d22779b0255 Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-DeleteServersTestJSON-518486720-project Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance b7ebc01d-7008-4ca7-a82b-094962216ceb could not be found. Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'b7ebc01d-7008-4ca7-a82b-094962216ceb'} Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7ebc01d-7008-4ca7-a82b-094962216ceb could not be found. Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7ebc01d-7008-4ca7-a82b-094962216ceb could not be found. Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:40:11.273574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:40:11.278650 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:40:11.278650 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:40:11.278650 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:40:11.278650 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:40:11.278650 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:40:11.278650 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7ebc01d-7008-4ca7-a82b-094962216ceb could not be found. Oct 18 15:40:11.278650 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:40:11.281387 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7bbe54df-efe3-492a-8550-f39e3c9ff04f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Returning 404 to user: Instance b7ebc01d-7008-4ca7-a82b-094962216ceb could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:40:11.283572 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7bbe54df-efe3-492a-8550-f39e3c9ff04f tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/b7ebc01d-7008-4ca7-a82b-094962216ceb" status: 404 len: 111 microversion: 2.1 time: 0.090430 Oct 18 15:40:11.287433 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1750/3510] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:11 2022] GET /compute/v2.1/servers/b7ebc01d-7008-4ca7-a82b-094962216ceb => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:40:11.293685 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5c08f13e-9387-47e1-a9b7-bd72b3274dcc tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:11.299748 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9462b48f-7aac-47a6-aad5-0d78dd539bb6 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:11.301454 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9462b48f-7aac-47a6-aad5-0d78dd539bb6 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] [instance: 0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:11.313608 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9462b48f-7aac-47a6-aad5-0d78dd539bb6 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:11.315135 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5c08f13e-9387-47e1-a9b7-bd72b3274dcc tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe" status: 200 len: 1425 microversion: 2.1 time: 0.564538 Oct 18 15:40:11.319300 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1761/3511] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:10 2022] GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe => generated 1425 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:11.331916 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-92844692-0147-409c-8ba6-745ca2e09ef3 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:11.334473 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-92844692-0147-409c-8ba6-745ca2e09ef3 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 201e386f-6cc8-4840-9692-b9d718a8e346] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:11.336609 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9462b48f-7aac-47a6-aad5-0d78dd539bb6 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:11.339742 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9462b48f-7aac-47a6-aad5-0d78dd539bb6 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:11.341474 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9462b48f-7aac-47a6-aad5-0d78dd539bb6 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:11.342126 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9462b48f-7aac-47a6-aad5-0d78dd539bb6 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:11.345237 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9462b48f-7aac-47a6-aad5-0d78dd539bb6 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:11.353918 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-92844692-0147-409c-8ba6-745ca2e09ef3 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:11.354529 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-92844692-0147-409c-8ba6-745ca2e09ef3 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:11.355727 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-92844692-0147-409c-8ba6-745ca2e09ef3 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:11.359611 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-92844692-0147-409c-8ba6-745ca2e09ef3 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:11.363330 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-92844692-0147-409c-8ba6-745ca2e09ef3 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:11.364104 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-92844692-0147-409c-8ba6-745ca2e09ef3 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:11.400465 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-92844692-0147-409c-8ba6-745ca2e09ef3 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] HTTP exception thrown: Instance 201e386f-6cc8-4840-9692-b9d718a8e346 could not be found. Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-92844692-0147-409c-8ba6-745ca2e09ef3 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Request method failure captured: Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: request: DELETE /compute/v2.1/servers/201e386f-6cc8-4840-9692-b9d718a8e346 HTTP/1.1 Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTseXdqIE6K5VM4s3TEHRLWgMUN4aMRv2NoeIzUdaqo5huhkbfibHS5WTucH_yVgiw-oU86aIdI66etum9zPC1o_Gp8lN1ylUglhXYekmlUb-DCNwOQQTPA7nsDvbxyfFlUPyfZnM9HlX0P4k3Gbrf42L5eihIJ6KOiK__MhWlbfWWoY Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 04fd51d598a04ff7a909b3ced951dea8 Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-DeleteServersTestJSON-518486720 Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-DeleteServersTestJSON-518486720 Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 04fd51d598a04ff7a909b3ced951dea8 Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-DeleteServersTestJSON-518486720 Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-DeleteServersTestJSON-518486720-project Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 5309baeeec484df194123d22779b0255 Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-DeleteServersTestJSON-518486720-project Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 201e386f-6cc8-4840-9692-b9d718a8e346 could not be found. Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '201e386f-6cc8-4840-9692-b9d718a8e346'} Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 201e386f-6cc8-4840-9692-b9d718a8e346 could not be found. Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:40:11.405099 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:40:11.409928 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 201e386f-6cc8-4840-9692-b9d718a8e346 could not be found. Oct 18 15:40:11.409928 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:40:11.409928 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:40:11.409928 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:40:11.409928 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:40:11.409928 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:40:11.409928 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:40:11.409928 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:40:11.409928 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:40:11.409928 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 201e386f-6cc8-4840-9692-b9d718a8e346 could not be found. Oct 18 15:40:11.409928 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:40:11.414304 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-92844692-0147-409c-8ba6-745ca2e09ef3 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Returning 404 to user: Instance 201e386f-6cc8-4840-9692-b9d718a8e346 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:40:11.415684 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-92844692-0147-409c-8ba6-745ca2e09ef3 tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "DELETE /compute/v2.1/servers/201e386f-6cc8-4840-9692-b9d718a8e346" status: 404 len: 111 microversion: 2.1 time: 0.094196 Oct 18 15:40:11.417893 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1762/3512] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:40:11 2022] DELETE /compute/v2.1/servers/201e386f-6cc8-4840-9692-b9d718a8e346 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:40:11.432777 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-32e2e5cf-5e4d-48d4-b748-e7423e00965a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:11.434809 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-32e2e5cf-5e4d-48d4-b748-e7423e00965a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] [instance: 201e386f-6cc8-4840-9692-b9d718a8e346] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:11.454992 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-32e2e5cf-5e4d-48d4-b748-e7423e00965a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:11.455839 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-32e2e5cf-5e4d-48d4-b748-e7423e00965a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:11.457280 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-32e2e5cf-5e4d-48d4-b748-e7423e00965a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:11.458187 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-32e2e5cf-5e4d-48d4-b748-e7423e00965a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:11.458880 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-32e2e5cf-5e4d-48d4-b748-e7423e00965a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:11.459473 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-32e2e5cf-5e4d-48d4-b748-e7423e00965a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:11.481827 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-32e2e5cf-5e4d-48d4-b748-e7423e00965a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] HTTP exception thrown: Instance 201e386f-6cc8-4840-9692-b9d718a8e346 could not be found. Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-32e2e5cf-5e4d-48d4-b748-e7423e00965a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Request method failure captured: Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/201e386f-6cc8-4840-9692-b9d718a8e346 HTTP/1.1 Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTseXdqIE6K5VM4s3TEHRLWgMUN4aMRv2NoeIzUdaqo5huhkbfibHS5WTucH_yVgiw-oU86aIdI66etum9zPC1o_Gp8lN1ylUglhXYekmlUb-DCNwOQQTPA7nsDvbxyfFlUPyfZnM9HlX0P4k3Gbrf42L5eihIJ6KOiK__MhWlbfWWoY Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 04fd51d598a04ff7a909b3ced951dea8 Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-DeleteServersTestJSON-518486720 Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_04fd51d598a04ff7a909b3ced951dea8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-DeleteServersTestJSON-518486720 Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 04fd51d598a04ff7a909b3ced951dea8 Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-DeleteServersTestJSON-518486720 Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-DeleteServersTestJSON-518486720-project Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 5309baeeec484df194123d22779b0255 Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-DeleteServersTestJSON-518486720-project Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 201e386f-6cc8-4840-9692-b9d718a8e346 could not be found. Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '201e386f-6cc8-4840-9692-b9d718a8e346'} Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 201e386f-6cc8-4840-9692-b9d718a8e346 could not be found. Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 201e386f-6cc8-4840-9692-b9d718a8e346 could not be found. Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:40:11.484165 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:40:11.490666 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:40:11.490666 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:40:11.490666 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:40:11.490666 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:40:11.490666 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:40:11.490666 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 201e386f-6cc8-4840-9692-b9d718a8e346 could not be found. Oct 18 15:40:11.490666 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:40:11.494016 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-32e2e5cf-5e4d-48d4-b748-e7423e00965a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] Returning 404 to user: Instance 201e386f-6cc8-4840-9692-b9d718a8e346 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:40:11.495120 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-32e2e5cf-5e4d-48d4-b748-e7423e00965a tempest-DeleteServersTestJSON-518486720 tempest-DeleteServersTestJSON-518486720-project] 10.222.0.60 "GET /compute/v2.1/servers/201e386f-6cc8-4840-9692-b9d718a8e346" status: 404 len: 111 microversion: 2.1 time: 0.071569 Oct 18 15:40:11.496358 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1763/3513] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:11 2022] GET /compute/v2.1/servers/201e386f-6cc8-4840-9692-b9d718a8e346 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:40:11.594952 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8c3cba8e-7c75-47f4-9633-596ff5271f96 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:11.595903 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8c3cba8e-7c75-47f4-9633-596ff5271f96 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 52d725f3-b4da-4831-9abf-bf7aba8aee0a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:11.609391 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c3cba8e-7c75-47f4-9633-596ff5271f96 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:11.610392 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c3cba8e-7c75-47f4-9633-596ff5271f96 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:11.612069 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c3cba8e-7c75-47f4-9633-596ff5271f96 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:11.613350 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c3cba8e-7c75-47f4-9633-596ff5271f96 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:11.614048 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c3cba8e-7c75-47f4-9633-596ff5271f96 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:11.614752 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c3cba8e-7c75-47f4-9633-596ff5271f96 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:11.862223 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9462b48f-7aac-47a6-aad5-0d78dd539bb6 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:11.882898 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9462b48f-7aac-47a6-aad5-0d78dd539bb6 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:11.891844 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9462b48f-7aac-47a6-aad5-0d78dd539bb6 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:11.899199 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9462b48f-7aac-47a6-aad5-0d78dd539bb6 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] 10.222.0.60 "GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1" status: 200 len: 1335 microversion: 2.47 time: 0.605922 Oct 18 15:40:11.901806 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1751/3514] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:40:11 2022] GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1 => generated 1335 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:40:12.229941 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8c3cba8e-7c75-47f4-9633-596ff5271f96 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304b3248f9db4629943a8b8080a6d22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdc7504a1d1424ea34f83f1a6d4bf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:12.243657 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8c3cba8e-7c75-47f4-9633-596ff5271f96 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a" status: 200 len: 1675 microversion: 2.1 time: 0.652285 Oct 18 15:40:12.248449 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1764/3515] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:11 2022] GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a => generated 1675 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:40:12.348843 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fe861edc-6ac9-4397-9475-af2fb005bdc3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:12.350116 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fe861edc-6ac9-4397-9475-af2fb005bdc3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 1c84f8ca-befc-489e-8068-135af3b766fe] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:12.367877 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe861edc-6ac9-4397-9475-af2fb005bdc3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:12.375912 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe861edc-6ac9-4397-9475-af2fb005bdc3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:12.378771 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe861edc-6ac9-4397-9475-af2fb005bdc3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:12.383745 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe861edc-6ac9-4397-9475-af2fb005bdc3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:12.385893 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe861edc-6ac9-4397-9475-af2fb005bdc3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:12.386975 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe861edc-6ac9-4397-9475-af2fb005bdc3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:12.429870 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-259e9359-9836-4c1d-bd3a-e258356fe1d7 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-2026332245", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "712f739f-8c77-4c3c-9f5b-7712e969aaa4"}], "security_groups": [{"name": "tempest-securitygroup--361142583"}], "key_name": "tempest-keypair-1297654325", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:40:12.439899 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-fe861edc-6ac9-4397-9475-af2fb005bdc3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] HTTP exception thrown: Instance 1c84f8ca-befc-489e-8068-135af3b766fe could not be found. Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fe861edc-6ac9-4397-9475-af2fb005bdc3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Request method failure captured: Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe HTTP/1.1 Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTseN65N0qApJvDDMMfddXqpMfI7xWk1J5atOQp_Oeywx-wkHlI8ZA5AFhWDOL-TOcTqefH8iJHBUi1wG_27-LimwpRNcjd7RH9WE1nw3iqd2OcUy6wl8jGrd6jyzRfMfF-cj8C5ZKSk7xaNBJ2yV8gtnNGSyvPwvzRZ0cXHrMymh7pY Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 91719d2b1f1640f391aa0b54c9725d2a Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-MigrationsAdminTest-2103704262 Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/91719d2b1f1640f391aa0b54c9725d2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/91719d2b1f1640f391aa0b54c9725d2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/91719d2b1f1640f391aa0b54c9725d2a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_91719d2b1f1640f391aa0b54c9725d2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-MigrationsAdminTest-2103704262 Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 91719d2b1f1640f391aa0b54c9725d2a Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-MigrationsAdminTest-2103704262 Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-MigrationsAdminTest-2103704262-project Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 926f2a98aa66431fab2a6032f21d5ae7 Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-MigrationsAdminTest-2103704262-project Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 1c84f8ca-befc-489e-8068-135af3b766fe could not be found. Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '1c84f8ca-befc-489e-8068-135af3b766fe'} Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c84f8ca-befc-489e-8068-135af3b766fe could not be found. Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c84f8ca-befc-489e-8068-135af3b766fe could not be found. Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:40:12.443036 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:40:12.452454 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:40:12.452454 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:40:12.452454 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:40:12.452454 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:40:12.452454 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:40:12.452454 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c84f8ca-befc-489e-8068-135af3b766fe could not be found. Oct 18 15:40:12.452454 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:40:12.452454 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fe861edc-6ac9-4397-9475-af2fb005bdc3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Returning 404 to user: Instance 1c84f8ca-befc-489e-8068-135af3b766fe could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:40:12.452454 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fe861edc-6ac9-4397-9475-af2fb005bdc3 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe" status: 404 len: 111 microversion: 2.1 time: 0.101543 Oct 18 15:40:12.452454 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1752/3516] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:12 2022] GET /compute/v2.1/servers/1c84f8ca-befc-489e-8068-135af3b766fe => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:40:12.458484 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8fde8f80-242f-4689-afb9-f0f22ab3efca tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:12.467388 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8fde8f80-242f-4689-afb9-f0f22ab3efca tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 0dbbde45-f255-4ac5-8887-1ce8de673fca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:12.477214 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8fde8f80-242f-4689-afb9-f0f22ab3efca tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:12.478469 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8fde8f80-242f-4689-afb9-f0f22ab3efca tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:12.478913 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8fde8f80-242f-4689-afb9-f0f22ab3efca tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:12.483213 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8fde8f80-242f-4689-afb9-f0f22ab3efca tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:12.483698 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8fde8f80-242f-4689-afb9-f0f22ab3efca tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:12.484109 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8fde8f80-242f-4689-afb9-f0f22ab3efca tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:12.546987 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8fde8f80-242f-4689-afb9-f0f22ab3efca tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 0dbbde45-f255-4ac5-8887-1ce8de673fca] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:40:12.682532 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-259e9359-9836-4c1d-bd3a-e258356fe1d7 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] validate_networks() for [('712f739f-8c77-4c3c-9f5b-7712e969aaa4', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:40:12.690268 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8fde8f80-242f-4689-afb9-f0f22ab3efca tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "DELETE /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca" status: 204 len: 0 microversion: 2.1 time: 0.235328 Oct 18 15:40:12.691810 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1753/3517] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:40:12 2022] DELETE /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:40:12.704268 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d77b06b2-18e0-4e30-ab6f-c2be918699a5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:12.705958 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d77b06b2-18e0-4e30-ab6f-c2be918699a5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 0dbbde45-f255-4ac5-8887-1ce8de673fca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:12.723557 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d77b06b2-18e0-4e30-ab6f-c2be918699a5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:12.724755 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d77b06b2-18e0-4e30-ab6f-c2be918699a5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:12.725522 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d77b06b2-18e0-4e30-ab6f-c2be918699a5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:12.726868 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d77b06b2-18e0-4e30-ab6f-c2be918699a5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:12.727633 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d77b06b2-18e0-4e30-ab6f-c2be918699a5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:12.728236 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d77b06b2-18e0-4e30-ab6f-c2be918699a5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:13.105000 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d77b06b2-18e0-4e30-ab6f-c2be918699a5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:13.118531 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d77b06b2-18e0-4e30-ab6f-c2be918699a5 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca" status: 200 len: 1467 microversion: 2.1 time: 0.421693 Oct 18 15:40:13.123160 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1754/3518] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:12 2022] GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca => generated 1467 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:13.129920 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e4fb276d-4c73-4a2a-a554-328360f586a4 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:13.130539 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e4fb276d-4c73-4a2a-a554-328360f586a4 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] [instance: 0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:13.132519 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:40:13.147394 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4fb276d-4c73-4a2a-a554-328360f586a4 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:13.147901 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4fb276d-4c73-4a2a-a554-328360f586a4 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:13.148348 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4fb276d-4c73-4a2a-a554-328360f586a4 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:13.149095 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4fb276d-4c73-4a2a-a554-328360f586a4 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:13.149557 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4fb276d-4c73-4a2a-a554-328360f586a4 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:13.149986 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4fb276d-4c73-4a2a-a554-328360f586a4 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:13.354633 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e4fb276d-4c73-4a2a-a554-328360f586a4 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:13.397297 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e4fb276d-4c73-4a2a-a554-328360f586a4 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:13.401818 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e4fb276d-4c73-4a2a-a554-328360f586a4 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:13.403528 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e4fb276d-4c73-4a2a-a554-328360f586a4 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] 10.222.0.60 "GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1" status: 200 len: 1335 microversion: 2.47 time: 0.279268 Oct 18 15:40:13.404418 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1755/3519] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:40:13 2022] GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1 => generated 1335 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:40:13.420218 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c67d5698-7fa1-434f-995a-57e8cb00768c tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:13.423793 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c67d5698-7fa1-434f-995a-57e8cb00768c tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 52d725f3-b4da-4831-9abf-bf7aba8aee0a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:13.440689 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c67d5698-7fa1-434f-995a-57e8cb00768c tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:13.441814 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c67d5698-7fa1-434f-995a-57e8cb00768c tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:13.447852 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c67d5698-7fa1-434f-995a-57e8cb00768c tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:13.449073 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c67d5698-7fa1-434f-995a-57e8cb00768c tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:13.449794 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c67d5698-7fa1-434f-995a-57e8cb00768c tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:13.450486 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c67d5698-7fa1-434f-995a-57e8cb00768c tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:13.881215 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:40:14.000902 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c67d5698-7fa1-434f-995a-57e8cb00768c tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304b3248f9db4629943a8b8080a6d22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdc7504a1d1424ea34f83f1a6d4bf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:14.013980 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c67d5698-7fa1-434f-995a-57e8cb00768c tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a" status: 200 len: 1675 microversion: 2.1 time: 0.608235 Oct 18 15:40:14.025423 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1756/3520] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:13 2022] GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a => generated 1675 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:14.152645 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4cfbdccd-3157-49cf-9af2-d984bce2eaf4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:14.153409 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4cfbdccd-3157-49cf-9af2-d984bce2eaf4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 0dbbde45-f255-4ac5-8887-1ce8de673fca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:14.169087 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4cfbdccd-3157-49cf-9af2-d984bce2eaf4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:14.169454 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4cfbdccd-3157-49cf-9af2-d984bce2eaf4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:14.169897 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4cfbdccd-3157-49cf-9af2-d984bce2eaf4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:14.170626 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4cfbdccd-3157-49cf-9af2-d984bce2eaf4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:14.171084 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4cfbdccd-3157-49cf-9af2-d984bce2eaf4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:14.171508 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4cfbdccd-3157-49cf-9af2-d984bce2eaf4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:14.342530 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-259e9359-9836-4c1d-bd3a-e258356fe1d7 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Getting quotas for project 863e54dfc6654672a9423c9de5be3e03. Resources: dict_keys(['metadata_items']) {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:40:14.355386 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-259e9359-9836-4c1d-bd3a-e258356fe1d7 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Getting quotas for user e4287d8ca081403289857f84e3d0c3f8 and project 863e54dfc6654672a9423c9de5be3e03. Resources: dict_keys(['metadata_items']) {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:40:14.394797 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-259e9359-9836-4c1d-bd3a-e258356fe1d7 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:40:14.395709 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-259e9359-9836-4c1d-bd3a-e258356fe1d7 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:40:14.397814 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-259e9359-9836-4c1d-bd3a-e258356fe1d7 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:40:14.398763 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-259e9359-9836-4c1d-bd3a-e258356fe1d7 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:40:14.399460 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-259e9359-9836-4c1d-bd3a-e258356fe1d7 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:40:14.435166 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-259e9359-9836-4c1d-bd3a-e258356fe1d7 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:14.437014 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-259e9359-9836-4c1d-bd3a-e258356fe1d7 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:14.440551 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-259e9359-9836-4c1d-bd3a-e258356fe1d7 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:14.442092 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-259e9359-9836-4c1d-bd3a-e258356fe1d7 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:14.442559 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-259e9359-9836-4c1d-bd3a-e258356fe1d7 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:14.442992 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-259e9359-9836-4c1d-bd3a-e258356fe1d7 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:14.492350 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-259e9359-9836-4c1d-bd3a-e258356fe1d7 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Getting quotas for project 863e54dfc6654672a9423c9de5be3e03. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:40:14.505766 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-259e9359-9836-4c1d-bd3a-e258356fe1d7 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Getting quotas for user e4287d8ca081403289857f84e3d0c3f8 and project 863e54dfc6654672a9423c9de5be3e03. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:40:14.536685 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-259e9359-9836-4c1d-bd3a-e258356fe1d7 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:40:14.540930 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-259e9359-9836-4c1d-bd3a-e258356fe1d7 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] [instance: 2e52e036-3ac0-4bbd-abe3-4c0b1957734f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:40:14.653220 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-259e9359-9836-4c1d-bd3a-e258356fe1d7 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.226926 Oct 18 15:40:14.657937 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1765/3521] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:40:12 2022] POST /compute/v2.1/servers => generated 408 bytes in 2235 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 15:40:14.702632 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3b4caf38-6e40-4b0b-aaf1-17412a758e25 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:14.703359 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3b4caf38-6e40-4b0b-aaf1-17412a758e25 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] [instance: 0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:14.714632 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3b4caf38-6e40-4b0b-aaf1-17412a758e25 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:14.716377 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3b4caf38-6e40-4b0b-aaf1-17412a758e25 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:14.717313 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3b4caf38-6e40-4b0b-aaf1-17412a758e25 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:14.718276 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3b4caf38-6e40-4b0b-aaf1-17412a758e25 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:14.719448 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3b4caf38-6e40-4b0b-aaf1-17412a758e25 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:14.720611 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3b4caf38-6e40-4b0b-aaf1-17412a758e25 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:14.816823 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=8 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:40:14.940449 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3b4caf38-6e40-4b0b-aaf1-17412a758e25 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:14.960021 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3b4caf38-6e40-4b0b-aaf1-17412a758e25 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:14.965698 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3b4caf38-6e40-4b0b-aaf1-17412a758e25 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:14.969722 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3b4caf38-6e40-4b0b-aaf1-17412a758e25 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] 10.222.0.60 "GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1" status: 200 len: 1335 microversion: 2.47 time: 0.281925 Oct 18 15:40:14.973700 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1766/3522] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:40:14 2022] GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1 => generated 1335 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:40:14.987188 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f5cb7366-3199-41f9-869d-a6fbad805a2c tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:14.989673 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f5cb7366-3199-41f9-869d-a6fbad805a2c tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] [instance: 2e52e036-3ac0-4bbd-abe3-4c0b1957734f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:15.109796 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4cfbdccd-3157-49cf-9af2-d984bce2eaf4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:15.121511 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4cfbdccd-3157-49cf-9af2-d984bce2eaf4 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca" status: 200 len: 1467 microversion: 2.1 time: 0.972609 Oct 18 15:40:15.124111 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1757/3523] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:14 2022] GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca => generated 1467 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:15.129864 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-63791974-a397-49a2-90a9-e0dabe74340b tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:15.137045 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-63791974-a397-49a2-90a9-e0dabe74340b tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 52d725f3-b4da-4831-9abf-bf7aba8aee0a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:15.160352 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63791974-a397-49a2-90a9-e0dabe74340b tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:15.161056 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63791974-a397-49a2-90a9-e0dabe74340b tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:15.161833 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63791974-a397-49a2-90a9-e0dabe74340b tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:15.163130 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63791974-a397-49a2-90a9-e0dabe74340b tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:15.163981 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63791974-a397-49a2-90a9-e0dabe74340b tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:15.164666 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63791974-a397-49a2-90a9-e0dabe74340b tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:15.214120 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f5cb7366-3199-41f9-869d-a6fbad805a2c tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4287d8ca081403289857f84e3d0c3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e54dfc6654672a9423c9de5be3e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:15.228110 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f5cb7366-3199-41f9-869d-a6fbad805a2c tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] 10.222.0.60 "GET /compute/v2.1/servers/2e52e036-3ac0-4bbd-abe3-4c0b1957734f" status: 200 len: 1278 microversion: 2.1 time: 0.246635 Oct 18 15:40:15.245994 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1767/3524] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:14 2022] GET /compute/v2.1/servers/2e52e036-3ac0-4bbd-abe3-4c0b1957734f => generated 1278 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:15.539033 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-63791974-a397-49a2-90a9-e0dabe74340b tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304b3248f9db4629943a8b8080a6d22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdc7504a1d1424ea34f83f1a6d4bf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:15.550786 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-63791974-a397-49a2-90a9-e0dabe74340b tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a" status: 200 len: 1675 microversion: 2.1 time: 0.425310 Oct 18 15:40:15.553880 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1758/3525] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:15 2022] GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a => generated 1675 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:16.012083 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-140fe9c9-9944-4395-b0dc-d4d52c162a1f tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:16.013811 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-140fe9c9-9944-4395-b0dc-d4d52c162a1f tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] [instance: 0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:16.029923 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-140fe9c9-9944-4395-b0dc-d4d52c162a1f tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:16.033635 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-140fe9c9-9944-4395-b0dc-d4d52c162a1f tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:16.034199 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-140fe9c9-9944-4395-b0dc-d4d52c162a1f tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:16.035087 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-140fe9c9-9944-4395-b0dc-d4d52c162a1f tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:16.035553 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-140fe9c9-9944-4395-b0dc-d4d52c162a1f tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:16.036230 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-140fe9c9-9944-4395-b0dc-d4d52c162a1f tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:16.158963 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-58fd8763-4f39-4a21-a427-7a094b96031e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:16.159996 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-58fd8763-4f39-4a21-a427-7a094b96031e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 0dbbde45-f255-4ac5-8887-1ce8de673fca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:16.166885 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58fd8763-4f39-4a21-a427-7a094b96031e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:16.167513 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58fd8763-4f39-4a21-a427-7a094b96031e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:16.168064 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58fd8763-4f39-4a21-a427-7a094b96031e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:16.169127 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58fd8763-4f39-4a21-a427-7a094b96031e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:16.170714 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58fd8763-4f39-4a21-a427-7a094b96031e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:16.171405 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58fd8763-4f39-4a21-a427-7a094b96031e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:16.241847 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-140fe9c9-9944-4395-b0dc-d4d52c162a1f tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:16.252589 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-140fe9c9-9944-4395-b0dc-d4d52c162a1f tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:16.254398 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-140fe9c9-9944-4395-b0dc-d4d52c162a1f tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:16.256151 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-140fe9c9-9944-4395-b0dc-d4d52c162a1f tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] 10.222.0.60 "GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1" status: 200 len: 1356 microversion: 2.47 time: 0.249695 Oct 18 15:40:16.257267 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1768/3526] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:40:16 2022] GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1 => generated 1356 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:40:16.262062 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e171dc7c-5b3e-4133-af17-c76f38d5e6a3 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:16.262671 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e171dc7c-5b3e-4133-af17-c76f38d5e6a3 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] [instance: 2e52e036-3ac0-4bbd-abe3-4c0b1957734f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:16.269587 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e171dc7c-5b3e-4133-af17-c76f38d5e6a3 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:16.270128 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e171dc7c-5b3e-4133-af17-c76f38d5e6a3 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:16.270513 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e171dc7c-5b3e-4133-af17-c76f38d5e6a3 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:16.271436 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e171dc7c-5b3e-4133-af17-c76f38d5e6a3 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:16.271957 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e171dc7c-5b3e-4133-af17-c76f38d5e6a3 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:16.272422 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e171dc7c-5b3e-4133-af17-c76f38d5e6a3 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:16.447943 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e171dc7c-5b3e-4133-af17-c76f38d5e6a3 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4287d8ca081403289857f84e3d0c3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e54dfc6654672a9423c9de5be3e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:16.460883 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e171dc7c-5b3e-4133-af17-c76f38d5e6a3 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] 10.222.0.60 "GET /compute/v2.1/servers/2e52e036-3ac0-4bbd-abe3-4c0b1957734f" status: 200 len: 1330 microversion: 2.1 time: 0.201472 Oct 18 15:40:16.462240 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1769/3527] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:16 2022] GET /compute/v2.1/servers/2e52e036-3ac0-4bbd-abe3-4c0b1957734f => generated 1330 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:16.478221 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bc55bf7e-0ab9-4560-b0ca-06d57fe80fd2 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:40:16.481787 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-bc55bf7e-0ab9-4560-b0ca-06d57fe80fd2 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] [instance: 0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:16.499251 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bc55bf7e-0ab9-4560-b0ca-06d57fe80fd2 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:16.500089 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bc55bf7e-0ab9-4560-b0ca-06d57fe80fd2 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:16.500611 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bc55bf7e-0ab9-4560-b0ca-06d57fe80fd2 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:16.502742 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bc55bf7e-0ab9-4560-b0ca-06d57fe80fd2 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:16.503353 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bc55bf7e-0ab9-4560-b0ca-06d57fe80fd2 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:16.506327 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bc55bf7e-0ab9-4560-b0ca-06d57fe80fd2 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:16.629988 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-bc55bf7e-0ab9-4560-b0ca-06d57fe80fd2 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:40:16.630356 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-bc55bf7e-0ab9-4560-b0ca-06d57fe80fd2 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:40:16.630951 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-bc55bf7e-0ab9-4560-b0ca-06d57fe80fd2 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:40:16.631395 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-bc55bf7e-0ab9-4560-b0ca-06d57fe80fd2 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:40:16.631918 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-bc55bf7e-0ab9-4560-b0ca-06d57fe80fd2 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:40:16.652771 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-58fd8763-4f39-4a21-a427-7a094b96031e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:16.665113 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-58fd8763-4f39-4a21-a427-7a094b96031e tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca" status: 200 len: 1467 microversion: 2.1 time: 0.510664 Oct 18 15:40:16.666308 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1759/3528] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:16 2022] GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca => generated 1467 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:40:16.680213 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-af8be53b-5fa7-44b5-8f4c-75b617ed3a6b tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:16.680857 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-af8be53b-5fa7-44b5-8f4c-75b617ed3a6b tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 52d725f3-b4da-4831-9abf-bf7aba8aee0a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:16.699196 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af8be53b-5fa7-44b5-8f4c-75b617ed3a6b tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:16.700855 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af8be53b-5fa7-44b5-8f4c-75b617ed3a6b tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:16.701370 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af8be53b-5fa7-44b5-8f4c-75b617ed3a6b tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:16.703314 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af8be53b-5fa7-44b5-8f4c-75b617ed3a6b tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:16.705212 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af8be53b-5fa7-44b5-8f4c-75b617ed3a6b tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:16.705655 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af8be53b-5fa7-44b5-8f4c-75b617ed3a6b tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:16.770901 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-bc55bf7e-0ab9-4560-b0ca-06d57fe80fd2 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] [instance: 0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:16.783248 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bc55bf7e-0ab9-4560-b0ca-06d57fe80fd2 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:16.783919 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bc55bf7e-0ab9-4560-b0ca-06d57fe80fd2 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:16.785077 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bc55bf7e-0ab9-4560-b0ca-06d57fe80fd2 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:16.786043 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bc55bf7e-0ab9-4560-b0ca-06d57fe80fd2 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:16.786860 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bc55bf7e-0ab9-4560-b0ca-06d57fe80fd2 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:16.787704 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bc55bf7e-0ab9-4560-b0ca-06d57fe80fd2 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:16.831021 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-bc55bf7e-0ab9-4560-b0ca-06d57fe80fd2 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] 10.222.0.60 "POST /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1/action" status: 202 len: 1078 microversion: 2.47 time: 0.366065 Oct 18 15:40:16.832337 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1770/3529] 10.222.0.60 () {62 vars in 1319 bytes} [Tue Oct 18 15:40:16 2022] POST /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1/action => generated 1078 bytes in 368 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 18 15:40:16.853637 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-95147131-62fd-4b15-b69d-b1a27be826a0 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:16.854401 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-95147131-62fd-4b15-b69d-b1a27be826a0 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] [instance: 0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:16.872313 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-95147131-62fd-4b15-b69d-b1a27be826a0 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:16.875087 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-95147131-62fd-4b15-b69d-b1a27be826a0 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:16.875636 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-95147131-62fd-4b15-b69d-b1a27be826a0 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:16.876434 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-95147131-62fd-4b15-b69d-b1a27be826a0 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:16.881696 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-95147131-62fd-4b15-b69d-b1a27be826a0 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:16.882548 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-95147131-62fd-4b15-b69d-b1a27be826a0 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:17.144331 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-95147131-62fd-4b15-b69d-b1a27be826a0 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:17.148393 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:40:17.161103 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-95147131-62fd-4b15-b69d-b1a27be826a0 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:17.168742 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-95147131-62fd-4b15-b69d-b1a27be826a0 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:17.170284 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-95147131-62fd-4b15-b69d-b1a27be826a0 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] 10.222.0.60 "GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1" status: 200 len: 1365 microversion: 2.47 time: 0.320755 Oct 18 15:40:17.189125 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1771/3530] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:40:16 2022] GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1 => generated 1365 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:40:17.392363 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-af8be53b-5fa7-44b5-8f4c-75b617ed3a6b tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304b3248f9db4629943a8b8080a6d22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdc7504a1d1424ea34f83f1a6d4bf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:17.405040 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-af8be53b-5fa7-44b5-8f4c-75b617ed3a6b tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a" status: 200 len: 1675 microversion: 2.1 time: 0.737253 Oct 18 15:40:17.407005 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1760/3531] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:16 2022] GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a => generated 1675 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:17.491504 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bb21dda8-78aa-4a20-a754-e677f0e517d8 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:17.492333 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-bb21dda8-78aa-4a20-a754-e677f0e517d8 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] [instance: 2e52e036-3ac0-4bbd-abe3-4c0b1957734f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:17.513239 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bb21dda8-78aa-4a20-a754-e677f0e517d8 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:17.524745 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bb21dda8-78aa-4a20-a754-e677f0e517d8 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:17.525410 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bb21dda8-78aa-4a20-a754-e677f0e517d8 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:17.526387 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bb21dda8-78aa-4a20-a754-e677f0e517d8 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:17.527178 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bb21dda8-78aa-4a20-a754-e677f0e517d8 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:17.528002 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bb21dda8-78aa-4a20-a754-e677f0e517d8 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:17.692104 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-15fbde4b-d911-4505-893d-fdadf977a1bc tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:17.693043 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-15fbde4b-d911-4505-893d-fdadf977a1bc tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 0dbbde45-f255-4ac5-8887-1ce8de673fca] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:17.704046 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15fbde4b-d911-4505-893d-fdadf977a1bc tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:17.708003 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15fbde4b-d911-4505-893d-fdadf977a1bc tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:17.708988 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15fbde4b-d911-4505-893d-fdadf977a1bc tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:17.712208 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15fbde4b-d911-4505-893d-fdadf977a1bc tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:17.712909 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15fbde4b-d911-4505-893d-fdadf977a1bc tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:17.713352 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15fbde4b-d911-4505-893d-fdadf977a1bc tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:17.727129 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-bb21dda8-78aa-4a20-a754-e677f0e517d8 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4287d8ca081403289857f84e3d0c3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e54dfc6654672a9423c9de5be3e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:17.746191 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-bb21dda8-78aa-4a20-a754-e677f0e517d8 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] 10.222.0.60 "GET /compute/v2.1/servers/2e52e036-3ac0-4bbd-abe3-4c0b1957734f" status: 200 len: 1336 microversion: 2.1 time: 0.259222 Oct 18 15:40:17.770463 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1772/3532] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:17 2022] GET /compute/v2.1/servers/2e52e036-3ac0-4bbd-abe3-4c0b1957734f => generated 1336 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:17.867879 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-15fbde4b-d911-4505-893d-fdadf977a1bc tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926f2a98aa66431fab2a6032f21d5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91719d2b1f1640f391aa0b54c9725d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:17.885370 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-15fbde4b-d911-4505-893d-fdadf977a1bc tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca" status: 200 len: 1425 microversion: 2.1 time: 0.197459 Oct 18 15:40:17.886234 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1761/3533] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:17 2022] GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca => generated 1425 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:40:17.966992 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-c85eb6fa-9ef4-46d9-b780-ab787d464f4f req-79b6aca9-21dd-4b57-9695-ec2179235470 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dbbde45-f255-4ac5-8887-1ce8de673fca", "name": "network-vif-deleted", "tag": "0ad973d8-f2bb-4e15-a985-502b69cec140"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:40:17.983011 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-c85eb6fa-9ef4-46d9-b780-ab787d464f4f req-79b6aca9-21dd-4b57-9695-ec2179235470 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:17.983742 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-c85eb6fa-9ef4-46d9-b780-ab787d464f4f req-79b6aca9-21dd-4b57-9695-ec2179235470 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:17.984410 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-c85eb6fa-9ef4-46d9-b780-ab787d464f4f req-79b6aca9-21dd-4b57-9695-ec2179235470 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:18.000879 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-c85eb6fa-9ef4-46d9-b780-ab787d464f4f req-79b6aca9-21dd-4b57-9695-ec2179235470 service nova] Creating event network-vif-deleted:0ad973d8-f2bb-4e15-a985-502b69cec140 for instance 0dbbde45-f255-4ac5-8887-1ce8de673fca on n-h1-853682-5 Oct 18 15:40:18.007969 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-c85eb6fa-9ef4-46d9-b780-ab787d464f4f req-79b6aca9-21dd-4b57-9695-ec2179235470 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.235559 Oct 18 15:40:18.008979 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1773/3534] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:40:18.202060 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-24ed0ded-86ed-4f25-b796-695ee7df9439 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:18.203320 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-24ed0ded-86ed-4f25-b796-695ee7df9439 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] [instance: 0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:18.215303 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24ed0ded-86ed-4f25-b796-695ee7df9439 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:18.215823 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24ed0ded-86ed-4f25-b796-695ee7df9439 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:18.217235 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24ed0ded-86ed-4f25-b796-695ee7df9439 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:18.218497 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24ed0ded-86ed-4f25-b796-695ee7df9439 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:18.219309 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24ed0ded-86ed-4f25-b796-695ee7df9439 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:18.220015 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24ed0ded-86ed-4f25-b796-695ee7df9439 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:18.416136 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-24ed0ded-86ed-4f25-b796-695ee7df9439 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:18.435564 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-07b9e56c-7b98-46d2-8465-248c8eb76031 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:18.436400 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-07b9e56c-7b98-46d2-8465-248c8eb76031 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 52d725f3-b4da-4831-9abf-bf7aba8aee0a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:18.446689 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-24ed0ded-86ed-4f25-b796-695ee7df9439 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:18.456956 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-24ed0ded-86ed-4f25-b796-695ee7df9439 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:18.465877 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-24ed0ded-86ed-4f25-b796-695ee7df9439 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] 10.222.0.60 "GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1" status: 200 len: 1365 microversion: 2.47 time: 0.263452 Oct 18 15:40:18.471489 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1762/3535] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:40:18 2022] GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1 => generated 1365 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:40:18.472306 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-07b9e56c-7b98-46d2-8465-248c8eb76031 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:18.472831 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-07b9e56c-7b98-46d2-8465-248c8eb76031 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:18.473277 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-07b9e56c-7b98-46d2-8465-248c8eb76031 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:18.476020 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-07b9e56c-7b98-46d2-8465-248c8eb76031 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:18.476499 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-07b9e56c-7b98-46d2-8465-248c8eb76031 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:18.482024 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-07b9e56c-7b98-46d2-8465-248c8eb76031 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:18.778798 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c4ddb070-45fb-42e9-addc-342177ae4bbc tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:18.779487 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c4ddb070-45fb-42e9-addc-342177ae4bbc tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] [instance: 2e52e036-3ac0-4bbd-abe3-4c0b1957734f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:18.789622 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4ddb070-45fb-42e9-addc-342177ae4bbc tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:18.790121 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4ddb070-45fb-42e9-addc-342177ae4bbc tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:18.790551 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4ddb070-45fb-42e9-addc-342177ae4bbc tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:18.799767 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4ddb070-45fb-42e9-addc-342177ae4bbc tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:18.800322 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4ddb070-45fb-42e9-addc-342177ae4bbc tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:18.800774 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4ddb070-45fb-42e9-addc-342177ae4bbc tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:18.913765 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-07b9e56c-7b98-46d2-8465-248c8eb76031 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304b3248f9db4629943a8b8080a6d22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdc7504a1d1424ea34f83f1a6d4bf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:18.949954 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-07b9e56c-7b98-46d2-8465-248c8eb76031 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a" status: 200 len: 1675 microversion: 2.1 time: 0.519556 Oct 18 15:40:18.954943 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1774/3536] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:18 2022] GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a => generated 1675 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:18.963067 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c4ddb070-45fb-42e9-addc-342177ae4bbc tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4287d8ca081403289857f84e3d0c3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e54dfc6654672a9423c9de5be3e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:18.970396 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4c68f87e-6c68-43b8-97b7-1cc07d8e7f49 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:18.971125 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c4ddb070-45fb-42e9-addc-342177ae4bbc tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] 10.222.0.60 "GET /compute/v2.1/servers/2e52e036-3ac0-4bbd-abe3-4c0b1957734f" status: 200 len: 1336 microversion: 2.1 time: 0.198091 Oct 18 15:40:18.980233 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4c68f87e-6c68-43b8-97b7-1cc07d8e7f49 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] [instance: 0dbbde45-f255-4ac5-8887-1ce8de673fca] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:18.980548 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1763/3537] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:18 2022] GET /compute/v2.1/servers/2e52e036-3ac0-4bbd-abe3-4c0b1957734f => generated 1336 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:19.010860 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4c68f87e-6c68-43b8-97b7-1cc07d8e7f49 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:19.011356 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4c68f87e-6c68-43b8-97b7-1cc07d8e7f49 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:19.016425 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4c68f87e-6c68-43b8-97b7-1cc07d8e7f49 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:19.016624 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4c68f87e-6c68-43b8-97b7-1cc07d8e7f49 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:19.017138 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4c68f87e-6c68-43b8-97b7-1cc07d8e7f49 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:19.017576 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4c68f87e-6c68-43b8-97b7-1cc07d8e7f49 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:19.068889 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-4c68f87e-6c68-43b8-97b7-1cc07d8e7f49 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] HTTP exception thrown: Instance 0dbbde45-f255-4ac5-8887-1ce8de673fca could not be found. Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4c68f87e-6c68-43b8-97b7-1cc07d8e7f49 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Request method failure captured: Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca HTTP/1.1 Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTseN65N0qApJvDDMMfddXqpMfI7xWk1J5atOQp_Oeywx-wkHlI8ZA5AFhWDOL-TOcTqefH8iJHBUi1wG_27-LimwpRNcjd7RH9WE1nw3iqd2OcUy6wl8jGrd6jyzRfMfF-cj8C5ZKSk7xaNBJ2yV8gtnNGSyvPwvzRZ0cXHrMymh7pY Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 91719d2b1f1640f391aa0b54c9725d2a Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-MigrationsAdminTest-2103704262 Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/91719d2b1f1640f391aa0b54c9725d2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/91719d2b1f1640f391aa0b54c9725d2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/91719d2b1f1640f391aa0b54c9725d2a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_91719d2b1f1640f391aa0b54c9725d2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-MigrationsAdminTest-2103704262 Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 91719d2b1f1640f391aa0b54c9725d2a Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-MigrationsAdminTest-2103704262 Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-MigrationsAdminTest-2103704262-project Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 926f2a98aa66431fab2a6032f21d5ae7 Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-MigrationsAdminTest-2103704262-project Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 0dbbde45-f255-4ac5-8887-1ce8de673fca could not be found. Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '0dbbde45-f255-4ac5-8887-1ce8de673fca'} Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dbbde45-f255-4ac5-8887-1ce8de673fca could not be found. Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dbbde45-f255-4ac5-8887-1ce8de673fca could not be found. Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:40:19.071190 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:40:19.077542 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:40:19.077542 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:40:19.077542 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:40:19.077542 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:40:19.077542 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:40:19.077542 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dbbde45-f255-4ac5-8887-1ce8de673fca could not be found. Oct 18 15:40:19.077542 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:40:19.077542 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4c68f87e-6c68-43b8-97b7-1cc07d8e7f49 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] Returning 404 to user: Instance 0dbbde45-f255-4ac5-8887-1ce8de673fca could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:40:19.077542 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4c68f87e-6c68-43b8-97b7-1cc07d8e7f49 tempest-MigrationsAdminTest-2103704262 tempest-MigrationsAdminTest-2103704262-project] 10.222.0.60 "GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca" status: 404 len: 111 microversion: 2.1 time: 0.115697 Oct 18 15:40:19.085758 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1775/3538] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:18 2022] GET /compute/v2.1/servers/0dbbde45-f255-4ac5-8887-1ce8de673fca => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:40:19.496965 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ef3ae9d3-e9eb-4588-8b79-a2c3189c2b26 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:19.497584 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ef3ae9d3-e9eb-4588-8b79-a2c3189c2b26 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] [instance: 0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:19.516532 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ef3ae9d3-e9eb-4588-8b79-a2c3189c2b26 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:19.525767 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ef3ae9d3-e9eb-4588-8b79-a2c3189c2b26 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:19.526459 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ef3ae9d3-e9eb-4588-8b79-a2c3189c2b26 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:19.528003 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ef3ae9d3-e9eb-4588-8b79-a2c3189c2b26 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:19.530180 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ef3ae9d3-e9eb-4588-8b79-a2c3189c2b26 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:19.530809 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ef3ae9d3-e9eb-4588-8b79-a2c3189c2b26 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:19.981024 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-14084afb-885c-48af-9594-148af2ff9c3a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:19.982248 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-14084afb-885c-48af-9594-148af2ff9c3a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 52d725f3-b4da-4831-9abf-bf7aba8aee0a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:19.993114 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-14084afb-885c-48af-9594-148af2ff9c3a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:19.993917 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-14084afb-885c-48af-9594-148af2ff9c3a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:19.994533 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-14084afb-885c-48af-9594-148af2ff9c3a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:20.000252 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-14084afb-885c-48af-9594-148af2ff9c3a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:20.001280 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-14084afb-885c-48af-9594-148af2ff9c3a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:20.002064 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-14084afb-885c-48af-9594-148af2ff9c3a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:20.113553 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ef3ae9d3-e9eb-4588-8b79-a2c3189c2b26 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:20.125728 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ef3ae9d3-e9eb-4588-8b79-a2c3189c2b26 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:20.142488 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ef3ae9d3-e9eb-4588-8b79-a2c3189c2b26 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:20.147906 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ef3ae9d3-e9eb-4588-8b79-a2c3189c2b26 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] 10.222.0.60 "GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1" status: 200 len: 1365 microversion: 2.47 time: 0.653088 Oct 18 15:40:20.153746 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1764/3539] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:40:19 2022] GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1 => generated 1365 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:40:20.162342 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-791ad1aa-86e6-4021-a893-58d48e8745ff tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:20.165144 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-791ad1aa-86e6-4021-a893-58d48e8745ff tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] [instance: 2e52e036-3ac0-4bbd-abe3-4c0b1957734f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:20.174803 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-791ad1aa-86e6-4021-a893-58d48e8745ff tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:20.176704 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-791ad1aa-86e6-4021-a893-58d48e8745ff tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:20.177280 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-791ad1aa-86e6-4021-a893-58d48e8745ff tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:20.178078 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-791ad1aa-86e6-4021-a893-58d48e8745ff tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:20.178608 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-791ad1aa-86e6-4021-a893-58d48e8745ff tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:20.179108 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-791ad1aa-86e6-4021-a893-58d48e8745ff tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:20.556412 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-14084afb-885c-48af-9594-148af2ff9c3a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304b3248f9db4629943a8b8080a6d22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdc7504a1d1424ea34f83f1a6d4bf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:20.565952 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-14084afb-885c-48af-9594-148af2ff9c3a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a" status: 200 len: 1652 microversion: 2.1 time: 0.589133 Oct 18 15:40:20.566564 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1776/3540] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:19 2022] GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a => generated 1652 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:20.597986 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-26db9f0e-026e-4784-8e8b-6341023e2349 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:40:20.604393 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26db9f0e-026e-4784-8e8b-6341023e2349 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:20.605016 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26db9f0e-026e-4784-8e8b-6341023e2349 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:20.605942 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26db9f0e-026e-4784-8e8b-6341023e2349 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:20.637754 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-26db9f0e-026e-4784-8e8b-6341023e2349 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 52d725f3-b4da-4831-9abf-bf7aba8aee0a] Going to try to start instance {{(pid=120405) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 18 15:40:20.719828 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-26db9f0e-026e-4784-8e8b-6341023e2349 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "POST /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a/action" status: 202 len: 0 microversion: 2.1 time: 0.133630 Oct 18 15:40:20.721083 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1777/3541] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:40:20 2022] POST /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:40:20.735207 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ed29a027-de55-45ac-a9e5-973986d49f94 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:20.738956 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ed29a027-de55-45ac-a9e5-973986d49f94 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 52d725f3-b4da-4831-9abf-bf7aba8aee0a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:20.752327 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ed29a027-de55-45ac-a9e5-973986d49f94 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:20.755766 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ed29a027-de55-45ac-a9e5-973986d49f94 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:20.756506 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ed29a027-de55-45ac-a9e5-973986d49f94 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:20.760144 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ed29a027-de55-45ac-a9e5-973986d49f94 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:20.760930 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ed29a027-de55-45ac-a9e5-973986d49f94 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:20.761532 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ed29a027-de55-45ac-a9e5-973986d49f94 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:20.855799 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-791ad1aa-86e6-4021-a893-58d48e8745ff tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4287d8ca081403289857f84e3d0c3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e54dfc6654672a9423c9de5be3e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:20.887344 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-791ad1aa-86e6-4021-a893-58d48e8745ff tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] 10.222.0.60 "GET /compute/v2.1/servers/2e52e036-3ac0-4bbd-abe3-4c0b1957734f" status: 200 len: 1403 microversion: 2.1 time: 0.732087 Oct 18 15:40:20.888837 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1765/3542] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:20 2022] GET /compute/v2.1/servers/2e52e036-3ac0-4bbd-abe3-4c0b1957734f => generated 1403 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:21.179273 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e092f133-bdcc-4f41-a346-1f74f8b0a2cc tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:21.180672 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e092f133-bdcc-4f41-a346-1f74f8b0a2cc tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] [instance: 0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:21.200509 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e092f133-bdcc-4f41-a346-1f74f8b0a2cc tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:21.202985 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e092f133-bdcc-4f41-a346-1f74f8b0a2cc tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:21.203718 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e092f133-bdcc-4f41-a346-1f74f8b0a2cc tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:21.204439 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e092f133-bdcc-4f41-a346-1f74f8b0a2cc tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:21.204985 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e092f133-bdcc-4f41-a346-1f74f8b0a2cc tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:21.205408 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e092f133-bdcc-4f41-a346-1f74f8b0a2cc tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:21.216723 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:40:21.414003 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e092f133-bdcc-4f41-a346-1f74f8b0a2cc tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:21.426990 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e092f133-bdcc-4f41-a346-1f74f8b0a2cc tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:21.428409 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e092f133-bdcc-4f41-a346-1f74f8b0a2cc tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:21.429843 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e092f133-bdcc-4f41-a346-1f74f8b0a2cc tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] 10.222.0.60 "GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1" status: 200 len: 1365 microversion: 2.47 time: 0.254715 Oct 18 15:40:21.446351 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1766/3543] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:40:21 2022] GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1 => generated 1365 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:40:21.479030 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ed29a027-de55-45ac-a9e5-973986d49f94 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304b3248f9db4629943a8b8080a6d22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdc7504a1d1424ea34f83f1a6d4bf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:21.487985 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ed29a027-de55-45ac-a9e5-973986d49f94 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a" status: 200 len: 1661 microversion: 2.1 time: 0.761102 Oct 18 15:40:21.489095 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1778/3544] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:20 2022] GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a => generated 1661 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:40:21.915395 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-357e03f8-102d-49db-9b30-9d7877842b55 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:21.918294 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-357e03f8-102d-49db-9b30-9d7877842b55 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] [instance: 2e52e036-3ac0-4bbd-abe3-4c0b1957734f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:21.932083 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-357e03f8-102d-49db-9b30-9d7877842b55 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:21.933003 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-357e03f8-102d-49db-9b30-9d7877842b55 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:21.934414 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-357e03f8-102d-49db-9b30-9d7877842b55 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:21.936097 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-357e03f8-102d-49db-9b30-9d7877842b55 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:21.936878 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-357e03f8-102d-49db-9b30-9d7877842b55 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:21.937631 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-357e03f8-102d-49db-9b30-9d7877842b55 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:22.458931 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-800cca05-0410-48eb-a3f5-9b3fd860a119 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:22.459537 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-800cca05-0410-48eb-a3f5-9b3fd860a119 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] [instance: 0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:22.471013 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-800cca05-0410-48eb-a3f5-9b3fd860a119 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:22.474711 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-800cca05-0410-48eb-a3f5-9b3fd860a119 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:22.475795 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-800cca05-0410-48eb-a3f5-9b3fd860a119 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:22.480036 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-800cca05-0410-48eb-a3f5-9b3fd860a119 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:22.480639 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-800cca05-0410-48eb-a3f5-9b3fd860a119 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:22.481015 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-800cca05-0410-48eb-a3f5-9b3fd860a119 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:22.662609 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-800cca05-0410-48eb-a3f5-9b3fd860a119 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:22.677547 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-800cca05-0410-48eb-a3f5-9b3fd860a119 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:22.681440 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-800cca05-0410-48eb-a3f5-9b3fd860a119 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:22.685390 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-800cca05-0410-48eb-a3f5-9b3fd860a119 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] 10.222.0.60 "GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1" status: 200 len: 1365 microversion: 2.47 time: 0.227671 Oct 18 15:40:22.685390 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1779/3545] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:40:22 2022] GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1 => generated 1365 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:40:22.707380 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-357e03f8-102d-49db-9b30-9d7877842b55 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4287d8ca081403289857f84e3d0c3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e54dfc6654672a9423c9de5be3e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:22.709096 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-52998f91-1813-44cc-b215-f635c24cd7f2 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:22.709727 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-52998f91-1813-44cc-b215-f635c24cd7f2 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 52d725f3-b4da-4831-9abf-bf7aba8aee0a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:22.735670 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-52998f91-1813-44cc-b215-f635c24cd7f2 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:22.736464 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-52998f91-1813-44cc-b215-f635c24cd7f2 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:22.736930 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-52998f91-1813-44cc-b215-f635c24cd7f2 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:22.738170 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-52998f91-1813-44cc-b215-f635c24cd7f2 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:22.741064 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-52998f91-1813-44cc-b215-f635c24cd7f2 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:22.742462 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-357e03f8-102d-49db-9b30-9d7877842b55 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] 10.222.0.60 "GET /compute/v2.1/servers/2e52e036-3ac0-4bbd-abe3-4c0b1957734f" status: 200 len: 1403 microversion: 2.1 time: 0.834555 Oct 18 15:40:22.743563 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1767/3546] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:21 2022] GET /compute/v2.1/servers/2e52e036-3ac0-4bbd-abe3-4c0b1957734f => generated 1403 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:22.746396 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-52998f91-1813-44cc-b215-f635c24cd7f2 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:22.925524 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-3ecd5404-44a3-41ec-9444-7ba79fdb6fa0 req-290e562b-5597-469c-9e11-2f466bf92e80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e52e036-3ac0-4bbd-abe3-4c0b1957734f", "tag": "0c969268-8769-4c5b-900a-67fbcb9e9532"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:40:22.950411 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3ecd5404-44a3-41ec-9444-7ba79fdb6fa0 req-290e562b-5597-469c-9e11-2f466bf92e80 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:22.964501 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3ecd5404-44a3-41ec-9444-7ba79fdb6fa0 req-290e562b-5597-469c-9e11-2f466bf92e80 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:22.967094 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3ecd5404-44a3-41ec-9444-7ba79fdb6fa0 req-290e562b-5597-469c-9e11-2f466bf92e80 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:22.983973 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-3ecd5404-44a3-41ec-9444-7ba79fdb6fa0 req-290e562b-5597-469c-9e11-2f466bf92e80 service nova] Creating event network-changed:0c969268-8769-4c5b-900a-67fbcb9e9532 for instance 2e52e036-3ac0-4bbd-abe3-4c0b1957734f on n-h2-853682-5 Oct 18 15:40:22.991211 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-3ecd5404-44a3-41ec-9444-7ba79fdb6fa0 req-290e562b-5597-469c-9e11-2f466bf92e80 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069901 Oct 18 15:40:22.992628 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1768/3547] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:40:23.033579 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-52998f91-1813-44cc-b215-f635c24cd7f2 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304b3248f9db4629943a8b8080a6d22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdc7504a1d1424ea34f83f1a6d4bf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:23.045415 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-52998f91-1813-44cc-b215-f635c24cd7f2 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a" status: 200 len: 1661 microversion: 2.1 time: 0.349807 Oct 18 15:40:23.063068 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1780/3548] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:22 2022] GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a => generated 1661 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:23.714464 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6f8cdb67-32d1-4ec2-8bbd-2d248c20d71a tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:23.715176 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6f8cdb67-32d1-4ec2-8bbd-2d248c20d71a tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] [instance: 0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:23.723788 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f8cdb67-32d1-4ec2-8bbd-2d248c20d71a tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:23.724282 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f8cdb67-32d1-4ec2-8bbd-2d248c20d71a tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:23.724721 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f8cdb67-32d1-4ec2-8bbd-2d248c20d71a tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:23.725451 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f8cdb67-32d1-4ec2-8bbd-2d248c20d71a tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:23.725909 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f8cdb67-32d1-4ec2-8bbd-2d248c20d71a tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:23.726332 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f8cdb67-32d1-4ec2-8bbd-2d248c20d71a tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:23.789824 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e7584c94-0c95-46ad-a33e-18c7e3878ec6 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:23.806090 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e7584c94-0c95-46ad-a33e-18c7e3878ec6 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] [instance: 2e52e036-3ac0-4bbd-abe3-4c0b1957734f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:23.832698 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e7584c94-0c95-46ad-a33e-18c7e3878ec6 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:23.834077 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e7584c94-0c95-46ad-a33e-18c7e3878ec6 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:23.835915 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e7584c94-0c95-46ad-a33e-18c7e3878ec6 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:23.841571 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e7584c94-0c95-46ad-a33e-18c7e3878ec6 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:23.845644 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e7584c94-0c95-46ad-a33e-18c7e3878ec6 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:23.846930 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e7584c94-0c95-46ad-a33e-18c7e3878ec6 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:23.893872 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6f8cdb67-32d1-4ec2-8bbd-2d248c20d71a tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:23.903649 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6f8cdb67-32d1-4ec2-8bbd-2d248c20d71a tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:23.905299 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6f8cdb67-32d1-4ec2-8bbd-2d248c20d71a tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:23.906600 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6f8cdb67-32d1-4ec2-8bbd-2d248c20d71a tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] 10.222.0.60 "GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1" status: 200 len: 1365 microversion: 2.47 time: 0.197296 Oct 18 15:40:23.907253 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1769/3549] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:40:23 2022] GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1 => generated 1365 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:40:24.083635 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e7584c94-0c95-46ad-a33e-18c7e3878ec6 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4287d8ca081403289857f84e3d0c3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e54dfc6654672a9423c9de5be3e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:24.092035 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e7584c94-0c95-46ad-a33e-18c7e3878ec6 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] 10.222.0.60 "GET /compute/v2.1/servers/2e52e036-3ac0-4bbd-abe3-4c0b1957734f" status: 200 len: 1403 microversion: 2.1 time: 0.309269 Oct 18 15:40:24.093087 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1781/3550] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:23 2022] GET /compute/v2.1/servers/2e52e036-3ac0-4bbd-abe3-4c0b1957734f => generated 1403 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:40:24.104081 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-556b5b8b-aeb3-4355-b6b1-925ce1e21eab tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:24.104742 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-556b5b8b-aeb3-4355-b6b1-925ce1e21eab tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 52d725f3-b4da-4831-9abf-bf7aba8aee0a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:24.111478 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-556b5b8b-aeb3-4355-b6b1-925ce1e21eab tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:24.113001 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-556b5b8b-aeb3-4355-b6b1-925ce1e21eab tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:24.113609 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-556b5b8b-aeb3-4355-b6b1-925ce1e21eab tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:24.114775 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-556b5b8b-aeb3-4355-b6b1-925ce1e21eab tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:24.115390 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-556b5b8b-aeb3-4355-b6b1-925ce1e21eab tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:24.116151 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-556b5b8b-aeb3-4355-b6b1-925ce1e21eab tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:24.139316 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e01e82bc-7d9e-4911-b265-a63a8914ff40 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Action: 'create', calling method: .version_select at 0x7f7c3c4ca9d0>, body: {"keypair": {"name": "tempest-keypair-2075174212", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGGnOEv9dLwp/xgZI9taQHMx750nmKnBb4EfmnIX+GZFiyi01oHcl0W9erPSpzgqtpmRg5TTNZG/4nAzf/Ajl5hpYva7xqcdYkR8E9pmsE7rzBdAJ3amRI519UVgKwjEw=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:40:24.170722 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-e01e82bc-7d9e-4911-b265-a63a8914ff40 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Getting quotas for project 2a2cdc778bd54f209d70f5b8703dc068. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:40:24.180081 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-e01e82bc-7d9e-4911-b265-a63a8914ff40 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Getting quotas for user 2aa0148a4a43466da619ea9843b3f78c and project 2a2cdc778bd54f209d70f5b8703dc068. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:40:24.215340 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e01e82bc-7d9e-4911-b265-a63a8914ff40 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.306748 Oct 18 15:40:24.216697 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1770/3551] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Oct 18 15:40:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:40:24.456912 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-556b5b8b-aeb3-4355-b6b1-925ce1e21eab tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304b3248f9db4629943a8b8080a6d22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdc7504a1d1424ea34f83f1a6d4bf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:24.470098 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-556b5b8b-aeb3-4355-b6b1-925ce1e21eab tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a" status: 200 len: 1665 microversion: 2.1 time: 0.374446 Oct 18 15:40:24.472191 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1782/3552] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:24 2022] GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a => generated 1665 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:24.944623 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5582ae7f-34b7-4fb6-bebf-e2f5ff18fb8d tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:24.948715 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5582ae7f-34b7-4fb6-bebf-e2f5ff18fb8d tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] [instance: 0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:24.966779 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5582ae7f-34b7-4fb6-bebf-e2f5ff18fb8d tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:24.968020 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5582ae7f-34b7-4fb6-bebf-e2f5ff18fb8d tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:24.968763 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5582ae7f-34b7-4fb6-bebf-e2f5ff18fb8d tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:24.970102 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5582ae7f-34b7-4fb6-bebf-e2f5ff18fb8d tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:24.970882 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5582ae7f-34b7-4fb6-bebf-e2f5ff18fb8d tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:24.971915 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5582ae7f-34b7-4fb6-bebf-e2f5ff18fb8d tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:25.116584 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c1fcb25c-1a5f-4be6-95f8-5f12b7fed9c7 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:25.118098 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c1fcb25c-1a5f-4be6-95f8-5f12b7fed9c7 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] [instance: 2e52e036-3ac0-4bbd-abe3-4c0b1957734f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:25.125620 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5582ae7f-34b7-4fb6-bebf-e2f5ff18fb8d tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:25.131642 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:40:25.136622 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c1fcb25c-1a5f-4be6-95f8-5f12b7fed9c7 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:25.141284 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c1fcb25c-1a5f-4be6-95f8-5f12b7fed9c7 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:25.141841 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c1fcb25c-1a5f-4be6-95f8-5f12b7fed9c7 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:25.142677 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c1fcb25c-1a5f-4be6-95f8-5f12b7fed9c7 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:25.143938 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5582ae7f-34b7-4fb6-bebf-e2f5ff18fb8d tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:25.147791 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5582ae7f-34b7-4fb6-bebf-e2f5ff18fb8d tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:25.148620 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c1fcb25c-1a5f-4be6-95f8-5f12b7fed9c7 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:25.149705 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5582ae7f-34b7-4fb6-bebf-e2f5ff18fb8d tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] 10.222.0.60 "GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1" status: 200 len: 1365 microversion: 2.47 time: 0.218480 Oct 18 15:40:25.150559 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c1fcb25c-1a5f-4be6-95f8-5f12b7fed9c7 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:25.177217 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1771/3553] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:40:24 2022] GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1 => generated 1365 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:40:25.219350 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=24 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:40:25.512724 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c1fcb25c-1a5f-4be6-95f8-5f12b7fed9c7 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4287d8ca081403289857f84e3d0c3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e54dfc6654672a9423c9de5be3e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:25.529768 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c1fcb25c-1a5f-4be6-95f8-5f12b7fed9c7 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] 10.222.0.60 "GET /compute/v2.1/servers/2e52e036-3ac0-4bbd-abe3-4c0b1957734f" status: 200 len: 1403 microversion: 2.1 time: 0.416734 Oct 18 15:40:25.534130 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1783/3554] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:25 2022] GET /compute/v2.1/servers/2e52e036-3ac0-4bbd-abe3-4c0b1957734f => generated 1403 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:40:26.187787 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-acfcceae-0af4-467e-a4ea-71555ae5ae07 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:26.189451 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-acfcceae-0af4-467e-a4ea-71555ae5ae07 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] [instance: 0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:26.203677 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-acfcceae-0af4-467e-a4ea-71555ae5ae07 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:26.204397 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-acfcceae-0af4-467e-a4ea-71555ae5ae07 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:26.205166 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-acfcceae-0af4-467e-a4ea-71555ae5ae07 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:26.206095 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-acfcceae-0af4-467e-a4ea-71555ae5ae07 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:26.206771 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-acfcceae-0af4-467e-a4ea-71555ae5ae07 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:26.207384 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-acfcceae-0af4-467e-a4ea-71555ae5ae07 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:26.353544 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-acfcceae-0af4-467e-a4ea-71555ae5ae07 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:26.393090 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-acfcceae-0af4-467e-a4ea-71555ae5ae07 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:26.396691 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-acfcceae-0af4-467e-a4ea-71555ae5ae07 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:26.400732 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-acfcceae-0af4-467e-a4ea-71555ae5ae07 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] 10.222.0.60 "GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1" status: 200 len: 1365 microversion: 2.47 time: 0.219432 Oct 18 15:40:26.416852 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1772/3555] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:40:26 2022] GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1 => generated 1365 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:40:26.560033 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e40ead1b-85db-4536-a5de-a9f6d72123a0 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:26.560966 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e40ead1b-85db-4536-a5de-a9f6d72123a0 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] [instance: 2e52e036-3ac0-4bbd-abe3-4c0b1957734f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:26.581997 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e40ead1b-85db-4536-a5de-a9f6d72123a0 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:26.583561 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e40ead1b-85db-4536-a5de-a9f6d72123a0 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:26.584026 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e40ead1b-85db-4536-a5de-a9f6d72123a0 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:26.588299 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e40ead1b-85db-4536-a5de-a9f6d72123a0 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:26.588843 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e40ead1b-85db-4536-a5de-a9f6d72123a0 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:26.595077 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e40ead1b-85db-4536-a5de-a9f6d72123a0 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:26.925263 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e40ead1b-85db-4536-a5de-a9f6d72123a0 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4287d8ca081403289857f84e3d0c3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e54dfc6654672a9423c9de5be3e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:26.936935 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e40ead1b-85db-4536-a5de-a9f6d72123a0 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] 10.222.0.60 "GET /compute/v2.1/servers/2e52e036-3ac0-4bbd-abe3-4c0b1957734f" status: 200 len: 1403 microversion: 2.1 time: 0.382069 Oct 18 15:40:26.940990 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1784/3556] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:26 2022] GET /compute/v2.1/servers/2e52e036-3ac0-4bbd-abe3-4c0b1957734f => generated 1403 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:27.429741 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b5887e0d-6d4a-4453-9f59-af710c34c628 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:27.430464 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b5887e0d-6d4a-4453-9f59-af710c34c628 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] [instance: 0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:27.446908 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5887e0d-6d4a-4453-9f59-af710c34c628 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:27.447759 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5887e0d-6d4a-4453-9f59-af710c34c628 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:27.448415 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5887e0d-6d4a-4453-9f59-af710c34c628 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:27.449865 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5887e0d-6d4a-4453-9f59-af710c34c628 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:27.450627 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5887e0d-6d4a-4453-9f59-af710c34c628 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:27.451306 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5887e0d-6d4a-4453-9f59-af710c34c628 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:27.628277 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b5887e0d-6d4a-4453-9f59-af710c34c628 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:27.640921 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b5887e0d-6d4a-4453-9f59-af710c34c628 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:27.642659 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b5887e0d-6d4a-4453-9f59-af710c34c628 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:27.644173 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b5887e0d-6d4a-4453-9f59-af710c34c628 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] 10.222.0.60 "GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1" status: 200 len: 1365 microversion: 2.47 time: 0.218466 Oct 18 15:40:27.646774 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1773/3557] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:40:27 2022] GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1 => generated 1365 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:40:27.779747 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-586af5a6-116a-4c9a-9ef2-d1be31ef83cb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1071738787", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f7f357f0-b7b8-48ee-8cbb-a57289af59df"}], "security_groups": [{"name": "tempest-securitygroup--691321206"}], "key_name": "tempest-keypair-2075174212", "user_data": "}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:40:27.933646 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-586af5a6-116a-4c9a-9ef2-d1be31ef83cb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] validate_networks() for [('f7f357f0-b7b8-48ee-8cbb-a57289af59df', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:40:27.966688 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5d1d1e9a-97f3-4aac-bd2b-1aef10f8dcc5 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:27.967713 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5d1d1e9a-97f3-4aac-bd2b-1aef10f8dcc5 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] [instance: 2e52e036-3ac0-4bbd-abe3-4c0b1957734f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:27.978049 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d1d1e9a-97f3-4aac-bd2b-1aef10f8dcc5 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:27.978871 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d1d1e9a-97f3-4aac-bd2b-1aef10f8dcc5 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:27.980925 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d1d1e9a-97f3-4aac-bd2b-1aef10f8dcc5 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:27.983474 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d1d1e9a-97f3-4aac-bd2b-1aef10f8dcc5 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:27.984160 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d1d1e9a-97f3-4aac-bd2b-1aef10f8dcc5 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:27.986084 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d1d1e9a-97f3-4aac-bd2b-1aef10f8dcc5 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:28.798214 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5d1d1e9a-97f3-4aac-bd2b-1aef10f8dcc5 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4287d8ca081403289857f84e3d0c3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e54dfc6654672a9423c9de5be3e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:28.810009 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5d1d1e9a-97f3-4aac-bd2b-1aef10f8dcc5 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] 10.222.0.60 "GET /compute/v2.1/servers/2e52e036-3ac0-4bbd-abe3-4c0b1957734f" status: 200 len: 1403 microversion: 2.1 time: 0.850010 Oct 18 15:40:28.813206 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1774/3558] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:27 2022] GET /compute/v2.1/servers/2e52e036-3ac0-4bbd-abe3-4c0b1957734f => generated 1403 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:40:28.833102 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-96346078-8c8f-410e-b838-22579374f43e tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:28.835098 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-96346078-8c8f-410e-b838-22579374f43e tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] [instance: 0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:28.856867 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96346078-8c8f-410e-b838-22579374f43e tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:28.857445 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96346078-8c8f-410e-b838-22579374f43e tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:28.857884 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96346078-8c8f-410e-b838-22579374f43e tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:28.860462 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96346078-8c8f-410e-b838-22579374f43e tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:28.861439 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96346078-8c8f-410e-b838-22579374f43e tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:28.863966 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96346078-8c8f-410e-b838-22579374f43e tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:29.021289 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-96346078-8c8f-410e-b838-22579374f43e tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:29.038550 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-96346078-8c8f-410e-b838-22579374f43e tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:29.042529 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-96346078-8c8f-410e-b838-22579374f43e tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:29.044705 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-96346078-8c8f-410e-b838-22579374f43e tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] 10.222.0.60 "GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1" status: 200 len: 1365 microversion: 2.47 time: 0.230235 Oct 18 15:40:29.048855 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1775/3559] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:40:28 2022] GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1 => generated 1365 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:40:29.314079 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b28c98c3-61b6-44b4-88f9-3ae63dd62631 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1592337757", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "72620dc3-521c-48cc-8608-bed4bd93f10a"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:40:29.429269 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-586af5a6-116a-4c9a-9ef2-d1be31ef83cb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:40:29.429817 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-586af5a6-116a-4c9a-9ef2-d1be31ef83cb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:40:29.429938 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-b28c98c3-61b6-44b4-88f9-3ae63dd62631 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] validate_networks() for [('72620dc3-521c-48cc-8608-bed4bd93f10a', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:40:29.430465 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-586af5a6-116a-4c9a-9ef2-d1be31ef83cb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:40:29.431047 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-586af5a6-116a-4c9a-9ef2-d1be31ef83cb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:40:29.431882 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-586af5a6-116a-4c9a-9ef2-d1be31ef83cb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:40:29.442082 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-586af5a6-116a-4c9a-9ef2-d1be31ef83cb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:29.442768 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-586af5a6-116a-4c9a-9ef2-d1be31ef83cb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:29.443365 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-586af5a6-116a-4c9a-9ef2-d1be31ef83cb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:29.444476 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-586af5a6-116a-4c9a-9ef2-d1be31ef83cb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:29.445175 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-586af5a6-116a-4c9a-9ef2-d1be31ef83cb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:29.445948 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-586af5a6-116a-4c9a-9ef2-d1be31ef83cb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:29.480009 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-586af5a6-116a-4c9a-9ef2-d1be31ef83cb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Getting quotas for project 2a2cdc778bd54f209d70f5b8703dc068. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:40:29.487365 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-586af5a6-116a-4c9a-9ef2-d1be31ef83cb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Getting quotas for user 2aa0148a4a43466da619ea9843b3f78c and project 2a2cdc778bd54f209d70f5b8703dc068. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:40:29.492186 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:40:29.506776 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-586af5a6-116a-4c9a-9ef2-d1be31ef83cb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:40:29.509817 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-586af5a6-116a-4c9a-9ef2-d1be31ef83cb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:40:29.572485 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-586af5a6-116a-4c9a-9ef2-d1be31ef83cb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.796751 Oct 18 15:40:29.580833 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1785/3560] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:40:27 2022] POST /compute/v2.1/servers => generated 408 bytes in 1806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:40:29.587137 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a33859f7-24a1-4387-9e78-471898d18743 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:29.588021 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a33859f7-24a1-4387-9e78-471898d18743 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:29.743915 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a33859f7-24a1-4387-9e78-471898d18743 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:29.752994 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a33859f7-24a1-4387-9e78-471898d18743 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1239 microversion: 2.1 time: 0.169577 Oct 18 15:40:29.766780 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1786/3561] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:29 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1239 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:29.839778 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8c50d1df-b5e9-4611-8429-0eea6242a884 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:29.840619 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8c50d1df-b5e9-4611-8429-0eea6242a884 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] [instance: 2e52e036-3ac0-4bbd-abe3-4c0b1957734f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:29.856490 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c50d1df-b5e9-4611-8429-0eea6242a884 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:29.858011 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c50d1df-b5e9-4611-8429-0eea6242a884 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:29.859993 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c50d1df-b5e9-4611-8429-0eea6242a884 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:29.860744 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c50d1df-b5e9-4611-8429-0eea6242a884 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:29.864108 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c50d1df-b5e9-4611-8429-0eea6242a884 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:29.865349 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c50d1df-b5e9-4611-8429-0eea6242a884 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:30.224698 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8c50d1df-b5e9-4611-8429-0eea6242a884 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4287d8ca081403289857f84e3d0c3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e54dfc6654672a9423c9de5be3e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:30.236433 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8c50d1df-b5e9-4611-8429-0eea6242a884 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] 10.222.0.60 "GET /compute/v2.1/servers/2e52e036-3ac0-4bbd-abe3-4c0b1957734f" status: 200 len: 1403 microversion: 2.1 time: 0.403016 Oct 18 15:40:30.238572 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1787/3562] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:29 2022] GET /compute/v2.1/servers/2e52e036-3ac0-4bbd-abe3-4c0b1957734f => generated 1403 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:40:30.259755 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0b046261-8c77-4b44-bc01-e2aa2e73ccbd tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:30.260380 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0b046261-8c77-4b44-bc01-e2aa2e73ccbd tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] [instance: 0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:30.276210 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0b046261-8c77-4b44-bc01-e2aa2e73ccbd tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:30.277121 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0b046261-8c77-4b44-bc01-e2aa2e73ccbd tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:30.277802 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0b046261-8c77-4b44-bc01-e2aa2e73ccbd tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:30.278936 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0b046261-8c77-4b44-bc01-e2aa2e73ccbd tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:30.279684 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0b046261-8c77-4b44-bc01-e2aa2e73ccbd tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:30.280305 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0b046261-8c77-4b44-bc01-e2aa2e73ccbd tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:30.326715 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-b28c98c3-61b6-44b4-88f9-3ae63dd62631 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:40:30.327861 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-b28c98c3-61b6-44b4-88f9-3ae63dd62631 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:40:30.328908 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-b28c98c3-61b6-44b4-88f9-3ae63dd62631 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:40:30.329615 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-b28c98c3-61b6-44b4-88f9-3ae63dd62631 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:40:30.330376 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-b28c98c3-61b6-44b4-88f9-3ae63dd62631 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:40:30.356680 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b28c98c3-61b6-44b4-88f9-3ae63dd62631 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:30.357242 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b28c98c3-61b6-44b4-88f9-3ae63dd62631 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:30.357685 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b28c98c3-61b6-44b4-88f9-3ae63dd62631 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:30.358424 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b28c98c3-61b6-44b4-88f9-3ae63dd62631 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:30.358882 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b28c98c3-61b6-44b4-88f9-3ae63dd62631 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:30.359360 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b28c98c3-61b6-44b4-88f9-3ae63dd62631 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:30.389131 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:40:30.396100 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-b28c98c3-61b6-44b4-88f9-3ae63dd62631 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Getting quotas for project a699a53b28b247c69921a0d3435ee9a1. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:40:30.402604 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-b28c98c3-61b6-44b4-88f9-3ae63dd62631 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Getting quotas for user a97a371515534f3f95e68537715feadc and project a699a53b28b247c69921a0d3435ee9a1. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:40:30.421851 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b28c98c3-61b6-44b4-88f9-3ae63dd62631 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:40:30.429474 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b28c98c3-61b6-44b4-88f9-3ae63dd62631 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] [instance: bea3a8ec-d421-45b4-b6d8-397ac80c920d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:40:30.464406 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0b046261-8c77-4b44-bc01-e2aa2e73ccbd tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:30.476981 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0b046261-8c77-4b44-bc01-e2aa2e73ccbd tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:30.485894 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0b046261-8c77-4b44-bc01-e2aa2e73ccbd tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:30.487946 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0b046261-8c77-4b44-bc01-e2aa2e73ccbd tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] 10.222.0.60 "GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1" status: 200 len: 1365 microversion: 2.47 time: 0.248120 Oct 18 15:40:30.488716 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1788/3563] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:40:30 2022] GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1 => generated 1365 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:40:30.572956 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b28c98c3-61b6-44b4-88f9-3ae63dd62631 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.520478 Oct 18 15:40:30.586155 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1776/3564] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:40:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1534 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:40:30.673194 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-44347c04-0ee3-4981-add9-c71f45ffc3d6 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-154442562", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "72620dc3-521c-48cc-8608-bed4bd93f10a"}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:40:30.781502 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-44347c04-0ee3-4981-add9-c71f45ffc3d6 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] validate_networks() for [('72620dc3-521c-48cc-8608-bed4bd93f10a', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:40:30.783120 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a9d7b149-03a4-4b18-a0f8-4ba78fcf3326 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:30.784046 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a9d7b149-03a4-4b18-a0f8-4ba78fcf3326 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:30.796247 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9d7b149-03a4-4b18-a0f8-4ba78fcf3326 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:30.796869 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9d7b149-03a4-4b18-a0f8-4ba78fcf3326 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:30.797447 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9d7b149-03a4-4b18-a0f8-4ba78fcf3326 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:30.800309 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9d7b149-03a4-4b18-a0f8-4ba78fcf3326 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:30.804552 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9d7b149-03a4-4b18-a0f8-4ba78fcf3326 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:30.805166 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9d7b149-03a4-4b18-a0f8-4ba78fcf3326 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:30.996088 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a9d7b149-03a4-4b18-a0f8-4ba78fcf3326 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:31.016683 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a9d7b149-03a4-4b18-a0f8-4ba78fcf3326 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1235 microversion: 2.1 time: 0.236232 Oct 18 15:40:31.032914 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1777/3565] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:30 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1235 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:31.265163 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-843f3f18-a9ef-458a-9353-138fe7243412 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:31.265777 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-843f3f18-a9ef-458a-9353-138fe7243412 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] [instance: 2e52e036-3ac0-4bbd-abe3-4c0b1957734f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:31.279872 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-843f3f18-a9ef-458a-9353-138fe7243412 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:31.280366 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-843f3f18-a9ef-458a-9353-138fe7243412 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:31.280799 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-843f3f18-a9ef-458a-9353-138fe7243412 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:31.281526 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-843f3f18-a9ef-458a-9353-138fe7243412 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:31.281982 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-843f3f18-a9ef-458a-9353-138fe7243412 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:31.282400 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-843f3f18-a9ef-458a-9353-138fe7243412 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:31.607897 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-843f3f18-a9ef-458a-9353-138fe7243412 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4287d8ca081403289857f84e3d0c3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e54dfc6654672a9423c9de5be3e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:31.618716 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-843f3f18-a9ef-458a-9353-138fe7243412 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] 10.222.0.60 "GET /compute/v2.1/servers/2e52e036-3ac0-4bbd-abe3-4c0b1957734f" status: 200 len: 1403 microversion: 2.1 time: 0.358753 Oct 18 15:40:31.620162 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1778/3566] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:31 2022] GET /compute/v2.1/servers/2e52e036-3ac0-4bbd-abe3-4c0b1957734f => generated 1403 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:31.638742 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fc070905-3ad2-4d65-9073-59eff5ef1307 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:31.641426 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fc070905-3ad2-4d65-9073-59eff5ef1307 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] [instance: 0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:31.670489 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc070905-3ad2-4d65-9073-59eff5ef1307 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:31.672183 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc070905-3ad2-4d65-9073-59eff5ef1307 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:31.672996 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc070905-3ad2-4d65-9073-59eff5ef1307 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:31.674069 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc070905-3ad2-4d65-9073-59eff5ef1307 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:31.675370 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc070905-3ad2-4d65-9073-59eff5ef1307 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:31.676467 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc070905-3ad2-4d65-9073-59eff5ef1307 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:31.989827 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fc070905-3ad2-4d65-9073-59eff5ef1307 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:32.015154 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fc070905-3ad2-4d65-9073-59eff5ef1307 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:32.017023 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fc070905-3ad2-4d65-9073-59eff5ef1307 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:32.021794 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fc070905-3ad2-4d65-9073-59eff5ef1307 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] 10.222.0.60 "GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1" status: 200 len: 1365 microversion: 2.47 time: 0.399024 Oct 18 15:40:32.024511 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1779/3567] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:40:31 2022] GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1 => generated 1365 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:40:32.194314 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-44347c04-0ee3-4981-add9-c71f45ffc3d6 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:40:32.194933 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-44347c04-0ee3-4981-add9-c71f45ffc3d6 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:40:32.195238 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-44347c04-0ee3-4981-add9-c71f45ffc3d6 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:40:32.196225 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-44347c04-0ee3-4981-add9-c71f45ffc3d6 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:40:32.196662 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-44347c04-0ee3-4981-add9-c71f45ffc3d6 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:40:32.209758 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-544d7f36-c8dd-462a-a80a-0abea62a2137 req-8268e525-ef38-41e4-982e-409bf8eb34b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e52e036-3ac0-4bbd-abe3-4c0b1957734f", "name": "network-vif-plugged", "status": "completed", "tag": "0c969268-8769-4c5b-900a-67fbcb9e9532"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:40:32.212481 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-44347c04-0ee3-4981-add9-c71f45ffc3d6 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:32.213269 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-44347c04-0ee3-4981-add9-c71f45ffc3d6 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:32.214082 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-44347c04-0ee3-4981-add9-c71f45ffc3d6 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:32.215365 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-44347c04-0ee3-4981-add9-c71f45ffc3d6 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:32.216369 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-44347c04-0ee3-4981-add9-c71f45ffc3d6 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:32.218424 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-44347c04-0ee3-4981-add9-c71f45ffc3d6 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:32.232102 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-544d7f36-c8dd-462a-a80a-0abea62a2137 req-8268e525-ef38-41e4-982e-409bf8eb34b0 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:32.245343 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-544d7f36-c8dd-462a-a80a-0abea62a2137 req-8268e525-ef38-41e4-982e-409bf8eb34b0 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:32.245837 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-544d7f36-c8dd-462a-a80a-0abea62a2137 req-8268e525-ef38-41e4-982e-409bf8eb34b0 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:32.263043 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-44347c04-0ee3-4981-add9-c71f45ffc3d6 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Getting quotas for project a699a53b28b247c69921a0d3435ee9a1. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:40:32.272472 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-44347c04-0ee3-4981-add9-c71f45ffc3d6 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Getting quotas for user a97a371515534f3f95e68537715feadc and project a699a53b28b247c69921a0d3435ee9a1. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:40:32.299110 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-544d7f36-c8dd-462a-a80a-0abea62a2137 req-8268e525-ef38-41e4-982e-409bf8eb34b0 service nova] Creating event network-vif-plugged:0c969268-8769-4c5b-900a-67fbcb9e9532 for instance 2e52e036-3ac0-4bbd-abe3-4c0b1957734f on n-h2-853682-5 Oct 18 15:40:32.303536 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-44347c04-0ee3-4981-add9-c71f45ffc3d6 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:40:32.307012 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-44347c04-0ee3-4981-add9-c71f45ffc3d6 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] [instance: 568f29d6-ddaf-4515-84dd-7cdab0922c97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:40:32.316157 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-544d7f36-c8dd-462a-a80a-0abea62a2137 req-8268e525-ef38-41e4-982e-409bf8eb34b0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.288717 Oct 18 15:40:32.316786 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1780/3568] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:40:32.322317 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-93128350-3a91-4ad7-9556-55e8b95eec88 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:32.323031 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-93128350-3a91-4ad7-9556-55e8b95eec88 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:32.360736 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-93128350-3a91-4ad7-9556-55e8b95eec88 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:32.367147 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-93128350-3a91-4ad7-9556-55e8b95eec88 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:32.368587 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-93128350-3a91-4ad7-9556-55e8b95eec88 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:32.372010 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-93128350-3a91-4ad7-9556-55e8b95eec88 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:32.372717 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-93128350-3a91-4ad7-9556-55e8b95eec88 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:32.373478 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-93128350-3a91-4ad7-9556-55e8b95eec88 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:32.390478 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-44347c04-0ee3-4981-add9-c71f45ffc3d6 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.721805 Oct 18 15:40:32.391472 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1789/3569] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:40:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:40:32.463980 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-db841994-d32e-4444-8e69-55c1d329e165 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1276557723", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "451", "networks": [{"uuid": "72620dc3-521c-48cc-8608-bed4bd93f10a"}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:40:32.570230 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-db841994-d32e-4444-8e69-55c1d329e165 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] validate_networks() for [('72620dc3-521c-48cc-8608-bed4bd93f10a', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:40:32.596917 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-93128350-3a91-4ad7-9556-55e8b95eec88 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:32.609544 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-93128350-3a91-4ad7-9556-55e8b95eec88 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1297 microversion: 2.1 time: 0.289937 Oct 18 15:40:32.610792 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1781/3570] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:32 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1297 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:32.643423 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-832aefea-fd90-45cd-91c4-008c4d1d2a6b tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:32.645262 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-832aefea-fd90-45cd-91c4-008c4d1d2a6b tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] [instance: 2e52e036-3ac0-4bbd-abe3-4c0b1957734f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:32.655847 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-832aefea-fd90-45cd-91c4-008c4d1d2a6b tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:32.660418 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-832aefea-fd90-45cd-91c4-008c4d1d2a6b tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:32.666652 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-832aefea-fd90-45cd-91c4-008c4d1d2a6b tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:32.669029 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-832aefea-fd90-45cd-91c4-008c4d1d2a6b tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:32.678377 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-832aefea-fd90-45cd-91c4-008c4d1d2a6b tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:32.679542 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-832aefea-fd90-45cd-91c4-008c4d1d2a6b tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:33.320235 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-832aefea-fd90-45cd-91c4-008c4d1d2a6b tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4287d8ca081403289857f84e3d0c3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e54dfc6654672a9423c9de5be3e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:33.339535 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-832aefea-fd90-45cd-91c4-008c4d1d2a6b tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] 10.222.0.60 "GET /compute/v2.1/servers/2e52e036-3ac0-4bbd-abe3-4c0b1957734f" status: 200 len: 1403 microversion: 2.1 time: 0.699991 Oct 18 15:40:33.340343 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1782/3571] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:32 2022] GET /compute/v2.1/servers/2e52e036-3ac0-4bbd-abe3-4c0b1957734f => generated 1403 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:33.513784 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9e5b000c-b778-4ab6-804d-ca64f6638bd7 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-615495788", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "c4c769f1-83e0-43c5-9669-9ee0cf4f730a"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:40:33.625652 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-9e5b000c-b778-4ab6-804d-ca64f6638bd7 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] validate_networks() for [('c4c769f1-83e0-43c5-9669-9ee0cf4f730a', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:40:33.749564 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-db841994-d32e-4444-8e69-55c1d329e165 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:40:33.751072 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-db841994-d32e-4444-8e69-55c1d329e165 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:40:33.751802 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-db841994-d32e-4444-8e69-55c1d329e165 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:40:33.752512 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-db841994-d32e-4444-8e69-55c1d329e165 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:40:33.753641 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-db841994-d32e-4444-8e69-55c1d329e165 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:40:33.780487 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-db841994-d32e-4444-8e69-55c1d329e165 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:33.784703 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-db841994-d32e-4444-8e69-55c1d329e165 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:33.785472 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-db841994-d32e-4444-8e69-55c1d329e165 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:33.786482 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-db841994-d32e-4444-8e69-55c1d329e165 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:33.787571 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-db841994-d32e-4444-8e69-55c1d329e165 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:33.788227 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-db841994-d32e-4444-8e69-55c1d329e165 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:33.843015 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-db841994-d32e-4444-8e69-55c1d329e165 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Getting quotas for project a699a53b28b247c69921a0d3435ee9a1. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:40:33.860045 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-db841994-d32e-4444-8e69-55c1d329e165 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Getting quotas for user a97a371515534f3f95e68537715feadc and project a699a53b28b247c69921a0d3435ee9a1. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:40:33.902413 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-db841994-d32e-4444-8e69-55c1d329e165 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:40:33.907895 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-db841994-d32e-4444-8e69-55c1d329e165 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] [instance: f9620891-182f-40dd-8abe-42b8b0e1b758] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:40:34.053809 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-db841994-d32e-4444-8e69-55c1d329e165 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.594021 Oct 18 15:40:34.061355 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1790/3572] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:40:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:40:34.082525 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4d00f479-dc59-4f9a-83c4-0bbcdb69d9ea tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:34.084661 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4d00f479-dc59-4f9a-83c4-0bbcdb69d9ea tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] [instance: 0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:34.094660 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4d00f479-dc59-4f9a-83c4-0bbcdb69d9ea tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:34.095329 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4d00f479-dc59-4f9a-83c4-0bbcdb69d9ea tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:34.095777 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4d00f479-dc59-4f9a-83c4-0bbcdb69d9ea tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:34.098316 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4d00f479-dc59-4f9a-83c4-0bbcdb69d9ea tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:34.099126 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4d00f479-dc59-4f9a-83c4-0bbcdb69d9ea tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:34.099756 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4d00f479-dc59-4f9a-83c4-0bbcdb69d9ea tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:34.363958 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4d00f479-dc59-4f9a-83c4-0bbcdb69d9ea tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:34.367314 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:40:34.390539 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4d00f479-dc59-4f9a-83c4-0bbcdb69d9ea tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:34.393318 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4d00f479-dc59-4f9a-83c4-0bbcdb69d9ea tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:34.398446 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4d00f479-dc59-4f9a-83c4-0bbcdb69d9ea tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] 10.222.0.60 "GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1" status: 200 len: 1365 microversion: 2.47 time: 0.333484 Oct 18 15:40:34.399068 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1791/3573] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:40:34 2022] GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1 => generated 1365 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:40:34.408621 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1cc5ad05-a8ce-4397-9f0b-b08fc5754059 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:34.409680 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1cc5ad05-a8ce-4397-9f0b-b08fc5754059 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:34.422033 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1cc5ad05-a8ce-4397-9f0b-b08fc5754059 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:34.422526 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1cc5ad05-a8ce-4397-9f0b-b08fc5754059 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:34.422965 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1cc5ad05-a8ce-4397-9f0b-b08fc5754059 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:34.423673 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1cc5ad05-a8ce-4397-9f0b-b08fc5754059 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:34.424131 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1cc5ad05-a8ce-4397-9f0b-b08fc5754059 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:34.425276 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1cc5ad05-a8ce-4397-9f0b-b08fc5754059 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:34.669322 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9e5b000c-b778-4ab6-804d-ca64f6638bd7 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:40:34.674776 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9e5b000c-b778-4ab6-804d-ca64f6638bd7 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:40:34.676180 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9e5b000c-b778-4ab6-804d-ca64f6638bd7 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:40:34.677607 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9e5b000c-b778-4ab6-804d-ca64f6638bd7 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:40:34.679507 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9e5b000c-b778-4ab6-804d-ca64f6638bd7 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:40:34.701012 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e5b000c-b778-4ab6-804d-ca64f6638bd7 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:34.701821 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e5b000c-b778-4ab6-804d-ca64f6638bd7 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:34.702498 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e5b000c-b778-4ab6-804d-ca64f6638bd7 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:34.710192 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e5b000c-b778-4ab6-804d-ca64f6638bd7 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:34.711132 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e5b000c-b778-4ab6-804d-ca64f6638bd7 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:34.711858 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e5b000c-b778-4ab6-804d-ca64f6638bd7 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:34.809147 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-9e5b000c-b778-4ab6-804d-ca64f6638bd7 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Getting quotas for project 2760d2db59084862abaedcc0a6a75046. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:40:34.826623 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-9e5b000c-b778-4ab6-804d-ca64f6638bd7 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Getting quotas for user dcb28fb6643847148fef67c0c775bf37 and project 2760d2db59084862abaedcc0a6a75046. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:40:34.864165 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9e5b000c-b778-4ab6-804d-ca64f6638bd7 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:40:34.870037 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9e5b000c-b778-4ab6-804d-ca64f6638bd7 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] [instance: e63557bf-fd6b-4440-99ea-2cf6068000bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:40:35.025805 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9e5b000c-b778-4ab6-804d-ca64f6638bd7 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.682550 Oct 18 15:40:35.040199 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1783/3574] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:40:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:40:35.046031 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-59e82a8e-09ea-4dfd-838e-8f95cf3de64c tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:35.048866 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-59e82a8e-09ea-4dfd-838e-8f95cf3de64c tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] [instance: f9620891-182f-40dd-8abe-42b8b0e1b758] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:36.172388 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-59e82a8e-09ea-4dfd-838e-8f95cf3de64c tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:36.194430 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-59e82a8e-09ea-4dfd-838e-8f95cf3de64c tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers/f9620891-182f-40dd-8abe-42b8b0e1b758" status: 200 len: 1221 microversion: 2.1 time: 1.152723 Oct 18 15:40:36.198194 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1784/3575] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:35 2022] GET /compute/v2.1/servers/f9620891-182f-40dd-8abe-42b8b0e1b758 => generated 1221 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:36.208252 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-937bfead-6db8-4957-a6c9-50463250b5ee tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:36.209281 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-937bfead-6db8-4957-a6c9-50463250b5ee tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] [instance: 2e52e036-3ac0-4bbd-abe3-4c0b1957734f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:36.217699 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-937bfead-6db8-4957-a6c9-50463250b5ee tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:36.218725 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-937bfead-6db8-4957-a6c9-50463250b5ee tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:36.219620 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-937bfead-6db8-4957-a6c9-50463250b5ee tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:36.220635 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-937bfead-6db8-4957-a6c9-50463250b5ee tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:36.221485 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-937bfead-6db8-4957-a6c9-50463250b5ee tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:36.222141 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-937bfead-6db8-4957-a6c9-50463250b5ee tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:36.289455 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1cc5ad05-a8ce-4397-9f0b-b08fc5754059 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:36.302659 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1cc5ad05-a8ce-4397-9f0b-b08fc5754059 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1364 microversion: 2.1 time: 1.901481 Oct 18 15:40:36.303285 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1792/3576] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:34 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1364 bytes in 1904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:36.322923 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a689a0f1-6249-47cc-aa2c-e35e78c07e2b tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:36.323541 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a689a0f1-6249-47cc-aa2c-e35e78c07e2b tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] [instance: e63557bf-fd6b-4440-99ea-2cf6068000bb] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:36.334202 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a689a0f1-6249-47cc-aa2c-e35e78c07e2b tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:36.334692 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a689a0f1-6249-47cc-aa2c-e35e78c07e2b tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:36.335125 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a689a0f1-6249-47cc-aa2c-e35e78c07e2b tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:36.335821 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a689a0f1-6249-47cc-aa2c-e35e78c07e2b tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:36.336521 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a689a0f1-6249-47cc-aa2c-e35e78c07e2b tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:36.337002 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a689a0f1-6249-47cc-aa2c-e35e78c07e2b tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:36.619772 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a689a0f1-6249-47cc-aa2c-e35e78c07e2b tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb28fb6643847148fef67c0c775bf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2760d2db59084862abaedcc0a6a75046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:36.632907 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a689a0f1-6249-47cc-aa2c-e35e78c07e2b tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] 10.222.0.60 "GET /compute/v2.1/servers/e63557bf-fd6b-4440-99ea-2cf6068000bb" status: 200 len: 1227 microversion: 2.1 time: 0.326224 Oct 18 15:40:36.634586 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1793/3577] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:36 2022] GET /compute/v2.1/servers/e63557bf-fd6b-4440-99ea-2cf6068000bb => generated 1227 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:36.656135 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3543d81c-13ce-4841-aa3a-0dca3030ac3e tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:36.682506 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3543d81c-13ce-4841-aa3a-0dca3030ac3e tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] [instance: 0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:36.734224 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3543d81c-13ce-4841-aa3a-0dca3030ac3e tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:36.737278 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3543d81c-13ce-4841-aa3a-0dca3030ac3e tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:36.737739 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3543d81c-13ce-4841-aa3a-0dca3030ac3e tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:36.740911 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3543d81c-13ce-4841-aa3a-0dca3030ac3e tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:36.741387 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3543d81c-13ce-4841-aa3a-0dca3030ac3e tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:36.741843 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3543d81c-13ce-4841-aa3a-0dca3030ac3e tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:36.865860 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-937bfead-6db8-4957-a6c9-50463250b5ee tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4287d8ca081403289857f84e3d0c3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e54dfc6654672a9423c9de5be3e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:36.878809 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-937bfead-6db8-4957-a6c9-50463250b5ee tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] 10.222.0.60 "GET /compute/v2.1/servers/2e52e036-3ac0-4bbd-abe3-4c0b1957734f" status: 200 len: 1588 microversion: 2.1 time: 0.674818 Oct 18 15:40:36.880868 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1785/3578] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:36 2022] GET /compute/v2.1/servers/2e52e036-3ac0-4bbd-abe3-4c0b1957734f => generated 1588 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:36.892005 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-a05b4210-ba04-4271-8663-05a6b6d34b50 req-41889dd4-9021-434e-8609-276e2064c1cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bea3a8ec-d421-45b4-b6d8-397ac80c920d", "tag": "109ec8d2-d5cf-4fb1-a792-7805e9d7d81b"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:40:36.911932 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a05b4210-ba04-4271-8663-05a6b6d34b50 req-41889dd4-9021-434e-8609-276e2064c1cd service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:36.912587 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a05b4210-ba04-4271-8663-05a6b6d34b50 req-41889dd4-9021-434e-8609-276e2064c1cd service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:36.913286 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a05b4210-ba04-4271-8663-05a6b6d34b50 req-41889dd4-9021-434e-8609-276e2064c1cd service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:36.926404 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-a05b4210-ba04-4271-8663-05a6b6d34b50 req-41889dd4-9021-434e-8609-276e2064c1cd service nova] Creating event network-changed:109ec8d2-d5cf-4fb1-a792-7805e9d7d81b for instance bea3a8ec-d421-45b4-b6d8-397ac80c920d on n-h2-853682-5 Oct 18 15:40:36.931966 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-a05b4210-ba04-4271-8663-05a6b6d34b50 req-41889dd4-9021-434e-8609-276e2064c1cd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048447 Oct 18 15:40:36.933198 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1786/3579] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:40:36.939296 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6a458d7d-7f6d-46cb-af7a-3c6bceb09451 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:36.940158 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6a458d7d-7f6d-46cb-af7a-3c6bceb09451 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] [instance: 2e52e036-3ac0-4bbd-abe3-4c0b1957734f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:36.948052 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a458d7d-7f6d-46cb-af7a-3c6bceb09451 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:36.950056 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a458d7d-7f6d-46cb-af7a-3c6bceb09451 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:36.950809 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a458d7d-7f6d-46cb-af7a-3c6bceb09451 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:36.951700 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a458d7d-7f6d-46cb-af7a-3c6bceb09451 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:36.974111 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a458d7d-7f6d-46cb-af7a-3c6bceb09451 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:36.975789 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a458d7d-7f6d-46cb-af7a-3c6bceb09451 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:37.220702 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3543d81c-13ce-4841-aa3a-0dca3030ac3e tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:37.239221 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3543d81c-13ce-4841-aa3a-0dca3030ac3e tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:37.240865 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3543d81c-13ce-4841-aa3a-0dca3030ac3e tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:37.242164 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3543d81c-13ce-4841-aa3a-0dca3030ac3e tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] 10.222.0.60 "GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1" status: 200 len: 1365 microversion: 2.47 time: 0.606279 Oct 18 15:40:37.242953 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1794/3580] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:40:36 2022] GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1 => generated 1365 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:40:37.247352 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-83ee02d0-f7c7-4f14-93a6-2dbf0fc48721 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:37.247958 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-83ee02d0-f7c7-4f14-93a6-2dbf0fc48721 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] [instance: f9620891-182f-40dd-8abe-42b8b0e1b758] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:37.270169 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-83ee02d0-f7c7-4f14-93a6-2dbf0fc48721 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:37.271381 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-83ee02d0-f7c7-4f14-93a6-2dbf0fc48721 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:37.272724 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-83ee02d0-f7c7-4f14-93a6-2dbf0fc48721 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:37.288916 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-83ee02d0-f7c7-4f14-93a6-2dbf0fc48721 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:37.291757 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-83ee02d0-f7c7-4f14-93a6-2dbf0fc48721 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:37.292742 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6a458d7d-7f6d-46cb-af7a-3c6bceb09451 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] 10.222.0.60 "GET /compute/v2.1/servers/2e52e036-3ac0-4bbd-abe3-4c0b1957734f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.358027 Oct 18 15:40:37.293934 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-83ee02d0-f7c7-4f14-93a6-2dbf0fc48721 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:37.294114 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1787/3581] 10.222.0.60 () {58 vars in 1275 bytes} [Tue Oct 18 15:40:36 2022] GET /compute/v2.1/servers/2e52e036-3ac0-4bbd-abe3-4c0b1957734f/os-interface => generated 284 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:40:37.326136 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-35801057-8255-4eb8-b606-a36dcaf68576 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:37.326766 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-35801057-8255-4eb8-b606-a36dcaf68576 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:37.341821 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-35801057-8255-4eb8-b606-a36dcaf68576 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:37.342585 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-35801057-8255-4eb8-b606-a36dcaf68576 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:37.343952 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-35801057-8255-4eb8-b606-a36dcaf68576 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:37.346812 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-35801057-8255-4eb8-b606-a36dcaf68576 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:37.347495 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-35801057-8255-4eb8-b606-a36dcaf68576 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:37.350944 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-35801057-8255-4eb8-b606-a36dcaf68576 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:37.396028 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:40:37.576302 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-83ee02d0-f7c7-4f14-93a6-2dbf0fc48721 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:37.587470 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-83ee02d0-f7c7-4f14-93a6-2dbf0fc48721 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers/f9620891-182f-40dd-8abe-42b8b0e1b758" status: 200 len: 1279 microversion: 2.1 time: 0.343564 Oct 18 15:40:37.604238 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1795/3582] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:37 2022] GET /compute/v2.1/servers/f9620891-182f-40dd-8abe-42b8b0e1b758 => generated 1279 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:37.664229 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ac0f7bb1-2c6d-4062-a05d-b61458358963 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:37.666352 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ac0f7bb1-2c6d-4062-a05d-b61458358963 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] [instance: e63557bf-fd6b-4440-99ea-2cf6068000bb] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:37.700914 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ac0f7bb1-2c6d-4062-a05d-b61458358963 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:37.701879 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ac0f7bb1-2c6d-4062-a05d-b61458358963 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:37.702730 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ac0f7bb1-2c6d-4062-a05d-b61458358963 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:37.705684 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ac0f7bb1-2c6d-4062-a05d-b61458358963 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:37.706383 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ac0f7bb1-2c6d-4062-a05d-b61458358963 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:37.707704 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ac0f7bb1-2c6d-4062-a05d-b61458358963 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:37.891834 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ac0f7bb1-2c6d-4062-a05d-b61458358963 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb28fb6643847148fef67c0c775bf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2760d2db59084862abaedcc0a6a75046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:37.907307 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ac0f7bb1-2c6d-4062-a05d-b61458358963 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] 10.222.0.60 "GET /compute/v2.1/servers/e63557bf-fd6b-4440-99ea-2cf6068000bb" status: 200 len: 1301 microversion: 2.1 time: 0.249536 Oct 18 15:40:37.926314 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1796/3583] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:37 2022] GET /compute/v2.1/servers/e63557bf-fd6b-4440-99ea-2cf6068000bb => generated 1301 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:40:38.105414 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-35801057-8255-4eb8-b606-a36dcaf68576 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:38.114341 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-35801057-8255-4eb8-b606-a36dcaf68576 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1364 microversion: 2.1 time: 0.792288 Oct 18 15:40:38.118015 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1788/3584] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:37 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1364 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:40:38.270977 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d96c74a2-a3fa-4d0f-acad-336d9b59f85c tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:38.271893 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d96c74a2-a3fa-4d0f-acad-336d9b59f85c tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] [instance: 0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:38.279109 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d96c74a2-a3fa-4d0f-acad-336d9b59f85c tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:38.279605 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d96c74a2-a3fa-4d0f-acad-336d9b59f85c tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:38.280146 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d96c74a2-a3fa-4d0f-acad-336d9b59f85c tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:38.282235 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d96c74a2-a3fa-4d0f-acad-336d9b59f85c tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:38.282746 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d96c74a2-a3fa-4d0f-acad-336d9b59f85c tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:38.284305 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d96c74a2-a3fa-4d0f-acad-336d9b59f85c tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:38.541054 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d96c74a2-a3fa-4d0f-acad-336d9b59f85c tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:38.551769 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d96c74a2-a3fa-4d0f-acad-336d9b59f85c tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:38.553552 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d96c74a2-a3fa-4d0f-acad-336d9b59f85c tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:38.555779 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d96c74a2-a3fa-4d0f-acad-336d9b59f85c tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] 10.222.0.60 "GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1" status: 200 len: 1365 microversion: 2.47 time: 0.288736 Oct 18 15:40:38.569471 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-acff3162-f25e-4172-b704-f091900dae80 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:38.570507 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-acff3162-f25e-4172-b704-f091900dae80 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 4a23be5e-9334-4385-9476-4bbd81995002] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:38.574773 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1797/3585] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:40:38 2022] GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1 => generated 1365 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:40:38.586923 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-acff3162-f25e-4172-b704-f091900dae80 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:38.587638 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-acff3162-f25e-4172-b704-f091900dae80 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:38.588142 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-acff3162-f25e-4172-b704-f091900dae80 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:38.589111 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-acff3162-f25e-4172-b704-f091900dae80 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:38.589880 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-acff3162-f25e-4172-b704-f091900dae80 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:38.590374 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-acff3162-f25e-4172-b704-f091900dae80 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:38.615042 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fde141d7-de83-400b-8127-6e95c055c352 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:38.616002 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-fde141d7-de83-400b-8127-6e95c055c352 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] [instance: f9620891-182f-40dd-8abe-42b8b0e1b758] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:38.626391 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fde141d7-de83-400b-8127-6e95c055c352 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:38.627805 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fde141d7-de83-400b-8127-6e95c055c352 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:38.629922 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fde141d7-de83-400b-8127-6e95c055c352 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:38.631993 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fde141d7-de83-400b-8127-6e95c055c352 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:38.632317 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-acff3162-f25e-4172-b704-f091900dae80 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002/ips" status: 200 len: 149 microversion: 2.1 time: 0.227040 Oct 18 15:40:38.633079 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fde141d7-de83-400b-8127-6e95c055c352 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:38.636422 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1789/3586] 10.222.0.60 () {58 vars in 1248 bytes} [Tue Oct 18 15:40:38 2022] GET /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002/ips => generated 149 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:40:38.637118 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fde141d7-de83-400b-8127-6e95c055c352 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:38.934096 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b8b645e9-c06b-40df-8aac-c1683e90fc20 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:38.935117 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b8b645e9-c06b-40df-8aac-c1683e90fc20 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] [instance: e63557bf-fd6b-4440-99ea-2cf6068000bb] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:38.945989 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8b645e9-c06b-40df-8aac-c1683e90fc20 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:38.946711 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8b645e9-c06b-40df-8aac-c1683e90fc20 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:38.948250 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8b645e9-c06b-40df-8aac-c1683e90fc20 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:38.949594 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8b645e9-c06b-40df-8aac-c1683e90fc20 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:38.951650 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8b645e9-c06b-40df-8aac-c1683e90fc20 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:38.952089 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8b645e9-c06b-40df-8aac-c1683e90fc20 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:38.993368 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-fde141d7-de83-400b-8127-6e95c055c352 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:39.014280 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fde141d7-de83-400b-8127-6e95c055c352 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers/f9620891-182f-40dd-8abe-42b8b0e1b758" status: 200 len: 1279 microversion: 2.1 time: 0.403731 Oct 18 15:40:39.017088 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1798/3587] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:38 2022] GET /compute/v2.1/servers/f9620891-182f-40dd-8abe-42b8b0e1b758 => generated 1279 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:40:39.141090 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-998f1d3d-af6a-4435-98af-b5ba4bb1442b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:39.142082 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-998f1d3d-af6a-4435-98af-b5ba4bb1442b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:39.150508 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-998f1d3d-af6a-4435-98af-b5ba4bb1442b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:39.151218 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-998f1d3d-af6a-4435-98af-b5ba4bb1442b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:39.152221 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-998f1d3d-af6a-4435-98af-b5ba4bb1442b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:39.153370 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-998f1d3d-af6a-4435-98af-b5ba4bb1442b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:39.154077 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-998f1d3d-af6a-4435-98af-b5ba4bb1442b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:39.154834 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-998f1d3d-af6a-4435-98af-b5ba4bb1442b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:40.466467 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-998f1d3d-af6a-4435-98af-b5ba4bb1442b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:40.500345 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-998f1d3d-af6a-4435-98af-b5ba4bb1442b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1364 microversion: 2.1 time: 1.364607 Oct 18 15:40:40.501853 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b8b645e9-c06b-40df-8aac-c1683e90fc20 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb28fb6643847148fef67c0c775bf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2760d2db59084862abaedcc0a6a75046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:40.530488 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1799/3588] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:39 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1364 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:40:40.541357 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b8b645e9-c06b-40df-8aac-c1683e90fc20 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] 10.222.0.60 "GET /compute/v2.1/servers/e63557bf-fd6b-4440-99ea-2cf6068000bb" status: 200 len: 1331 microversion: 2.1 time: 1.611158 Oct 18 15:40:40.546120 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-34a5290f-171b-41bb-9615-e86dc69e1055 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:40.549616 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-34a5290f-171b-41bb-9615-e86dc69e1055 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] [instance: 0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:40.553235 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1790/3589] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:38 2022] GET /compute/v2.1/servers/e63557bf-fd6b-4440-99ea-2cf6068000bb => generated 1331 bytes in 1624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:40:40.570807 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-34a5290f-171b-41bb-9615-e86dc69e1055 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:40.571946 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-34a5290f-171b-41bb-9615-e86dc69e1055 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:40.572729 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-34a5290f-171b-41bb-9615-e86dc69e1055 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:40.573690 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-34a5290f-171b-41bb-9615-e86dc69e1055 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:40.573994 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9e474ac5-90ad-4711-b2d1-bf5c24659fa8 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:40.574416 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9e474ac5-90ad-4711-b2d1-bf5c24659fa8 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] [instance: f9620891-182f-40dd-8abe-42b8b0e1b758] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:40.575311 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-34a5290f-171b-41bb-9615-e86dc69e1055 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:40.585951 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-34a5290f-171b-41bb-9615-e86dc69e1055 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:40.592628 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e474ac5-90ad-4711-b2d1-bf5c24659fa8 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:40.593488 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e474ac5-90ad-4711-b2d1-bf5c24659fa8 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:40.594284 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e474ac5-90ad-4711-b2d1-bf5c24659fa8 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:40.595291 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e474ac5-90ad-4711-b2d1-bf5c24659fa8 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:40.596025 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e474ac5-90ad-4711-b2d1-bf5c24659fa8 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:40.598320 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e474ac5-90ad-4711-b2d1-bf5c24659fa8 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:40.792377 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-34a5290f-171b-41bb-9615-e86dc69e1055 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:40.812688 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-34a5290f-171b-41bb-9615-e86dc69e1055 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:40.823157 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-34a5290f-171b-41bb-9615-e86dc69e1055 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:40.826774 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-34a5290f-171b-41bb-9615-e86dc69e1055 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] 10.222.0.60 "GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1" status: 200 len: 1365 microversion: 2.47 time: 0.294358 Oct 18 15:40:40.829867 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1800/3590] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:40:40 2022] GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1 => generated 1365 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:40:40.894658 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-f5a7e491-94ae-4efa-86bb-b9fd66321a27 req-cfd8f482-da49-413e-8948-cd4b92a075c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e63557bf-fd6b-4440-99ea-2cf6068000bb", "tag": "78218976-d29b-4087-9660-b6926a2369ec"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:40:40.902539 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9e474ac5-90ad-4711-b2d1-bf5c24659fa8 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:40.917037 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9e474ac5-90ad-4711-b2d1-bf5c24659fa8 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers/f9620891-182f-40dd-8abe-42b8b0e1b758" status: 200 len: 1279 microversion: 2.1 time: 0.347385 Oct 18 15:40:40.917844 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1791/3591] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:40 2022] GET /compute/v2.1/servers/f9620891-182f-40dd-8abe-42b8b0e1b758 => generated 1279 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:40.939207 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-f5a7e491-94ae-4efa-86bb-b9fd66321a27 req-cfd8f482-da49-413e-8948-cd4b92a075c5 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:40.940302 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-f5a7e491-94ae-4efa-86bb-b9fd66321a27 req-cfd8f482-da49-413e-8948-cd4b92a075c5 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:40.940932 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-f5a7e491-94ae-4efa-86bb-b9fd66321a27 req-cfd8f482-da49-413e-8948-cd4b92a075c5 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:40.971123 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-f5a7e491-94ae-4efa-86bb-b9fd66321a27 req-cfd8f482-da49-413e-8948-cd4b92a075c5 service nova] Creating event network-changed:78218976-d29b-4087-9660-b6926a2369ec for instance e63557bf-fd6b-4440-99ea-2cf6068000bb on n-h1-853682-5 Oct 18 15:40:40.985743 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-f5a7e491-94ae-4efa-86bb-b9fd66321a27 req-cfd8f482-da49-413e-8948-cd4b92a075c5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094532 Oct 18 15:40:40.986383 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1801/3592] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:40:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:40:41.055519 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-c4090cc5-9d20-4aae-ada3-3d2c0b49fbb8 req-0caa22ff-d41c-409f-b4a7-f62318e0e7b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79212b18-bfd6-4a94-9d58-80c535525aa8", "tag": "65ddf63c-d787-42eb-bb1d-c107c1fe8b2f"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:40:41.069746 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c4090cc5-9d20-4aae-ada3-3d2c0b49fbb8 req-0caa22ff-d41c-409f-b4a7-f62318e0e7b0 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:41.070233 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c4090cc5-9d20-4aae-ada3-3d2c0b49fbb8 req-0caa22ff-d41c-409f-b4a7-f62318e0e7b0 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:41.070663 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c4090cc5-9d20-4aae-ada3-3d2c0b49fbb8 req-0caa22ff-d41c-409f-b4a7-f62318e0e7b0 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:41.086770 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-c4090cc5-9d20-4aae-ada3-3d2c0b49fbb8 req-0caa22ff-d41c-409f-b4a7-f62318e0e7b0 service nova] Creating event network-changed:65ddf63c-d787-42eb-bb1d-c107c1fe8b2f for instance 79212b18-bfd6-4a94-9d58-80c535525aa8 on n-h2-853682-5 Oct 18 15:40:41.093315 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-c4090cc5-9d20-4aae-ada3-3d2c0b49fbb8 req-0caa22ff-d41c-409f-b4a7-f62318e0e7b0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043502 Oct 18 15:40:41.094549 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1792/3593] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:40:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:40:41.378617 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ec2c2999-11f4-4fa9-9e3e-82b1d7379def tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca81b459-dcbb-429f-a2f4-3a7cfcb81802"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:40:41.384161 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ec2c2999-11f4-4fa9-9e3e-82b1d7379def tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 4a23be5e-9334-4385-9476-4bbd81995002] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:41.390917 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ec2c2999-11f4-4fa9-9e3e-82b1d7379def tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:41.391658 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ec2c2999-11f4-4fa9-9e3e-82b1d7379def tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:41.392117 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ec2c2999-11f4-4fa9-9e3e-82b1d7379def tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:41.394400 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ec2c2999-11f4-4fa9-9e3e-82b1d7379def tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:41.395083 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ec2c2999-11f4-4fa9-9e3e-82b1d7379def tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:41.395695 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ec2c2999-11f4-4fa9-9e3e-82b1d7379def tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:41.535094 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d8ab687b-5ec3-4a8c-9002-2f84469ca9de tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:41.536464 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d8ab687b-5ec3-4a8c-9002-2f84469ca9de tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:41.560630 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8ab687b-5ec3-4a8c-9002-2f84469ca9de tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:41.565811 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8ab687b-5ec3-4a8c-9002-2f84469ca9de tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:41.572404 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8ab687b-5ec3-4a8c-9002-2f84469ca9de tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:41.573396 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8ab687b-5ec3-4a8c-9002-2f84469ca9de tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:41.574114 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8ab687b-5ec3-4a8c-9002-2f84469ca9de tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:41.574704 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8ab687b-5ec3-4a8c-9002-2f84469ca9de tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:41.813344 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ec2c2999-11f4-4fa9-9e3e-82b1d7379def tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "POST /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.439002 Oct 18 15:40:41.814264 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1802/3594] 10.222.0.60 () {60 vars in 1323 bytes} [Tue Oct 18 15:40:41 2022] POST /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002/os-volume_attachments => generated 194 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:40:41.832757 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c71d64c6-8239-498b-936d-feafbe8b685f tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:41.835993 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c71d64c6-8239-498b-936d-feafbe8b685f tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] [instance: e63557bf-fd6b-4440-99ea-2cf6068000bb] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:41.850499 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c71d64c6-8239-498b-936d-feafbe8b685f tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:41.852448 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c71d64c6-8239-498b-936d-feafbe8b685f tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:41.854345 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c71d64c6-8239-498b-936d-feafbe8b685f tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:41.856420 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c71d64c6-8239-498b-936d-feafbe8b685f tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:41.857012 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c71d64c6-8239-498b-936d-feafbe8b685f tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:41.858159 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c71d64c6-8239-498b-936d-feafbe8b685f tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:42.079952 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d8ab687b-5ec3-4a8c-9002-2f84469ca9de tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:42.095335 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d8ab687b-5ec3-4a8c-9002-2f84469ca9de tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1364 microversion: 2.1 time: 0.566638 Oct 18 15:40:42.110183 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1793/3595] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:41 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1364 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:40:42.121101 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a809d263-5471-4f36-9331-d9b20b61b8eb tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:42.122187 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a809d263-5471-4f36-9331-d9b20b61b8eb tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] [instance: 0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:42.132383 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a809d263-5471-4f36-9331-d9b20b61b8eb tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:42.133229 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a809d263-5471-4f36-9331-d9b20b61b8eb tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:42.133882 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a809d263-5471-4f36-9331-d9b20b61b8eb tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:42.134803 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a809d263-5471-4f36-9331-d9b20b61b8eb tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:42.136122 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a809d263-5471-4f36-9331-d9b20b61b8eb tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:42.136796 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a809d263-5471-4f36-9331-d9b20b61b8eb tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:42.294521 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a809d263-5471-4f36-9331-d9b20b61b8eb tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:42.313005 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a809d263-5471-4f36-9331-d9b20b61b8eb tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:42.318440 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a809d263-5471-4f36-9331-d9b20b61b8eb tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:42.320098 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a809d263-5471-4f36-9331-d9b20b61b8eb tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] 10.222.0.60 "GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1" status: 200 len: 1365 microversion: 2.47 time: 0.208136 Oct 18 15:40:42.333565 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c71d64c6-8239-498b-936d-feafbe8b685f tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb28fb6643847148fef67c0c775bf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2760d2db59084862abaedcc0a6a75046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:42.338951 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1794/3596] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:40:42 2022] GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1 => generated 1365 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:40:42.343766 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4bfd74b1-3c35-4131-b24c-0e8ac0de00e1 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:42.344375 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4bfd74b1-3c35-4131-b24c-0e8ac0de00e1 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] [instance: f9620891-182f-40dd-8abe-42b8b0e1b758] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:42.345369 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c71d64c6-8239-498b-936d-feafbe8b685f tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] 10.222.0.60 "GET /compute/v2.1/servers/e63557bf-fd6b-4440-99ea-2cf6068000bb" status: 200 len: 1331 microversion: 2.1 time: 0.528252 Oct 18 15:40:42.346880 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1803/3597] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:41 2022] GET /compute/v2.1/servers/e63557bf-fd6b-4440-99ea-2cf6068000bb => generated 1331 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:42.357270 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4bfd74b1-3c35-4131-b24c-0e8ac0de00e1 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:42.357270 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4bfd74b1-3c35-4131-b24c-0e8ac0de00e1 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:42.357270 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4bfd74b1-3c35-4131-b24c-0e8ac0de00e1 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:42.357270 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4bfd74b1-3c35-4131-b24c-0e8ac0de00e1 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:42.357270 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4bfd74b1-3c35-4131-b24c-0e8ac0de00e1 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:42.357270 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4bfd74b1-3c35-4131-b24c-0e8ac0de00e1 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:42.646328 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3ac923ab-4714-418e-bb98-36781773dc3a tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:42.647388 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3ac923ab-4714-418e-bb98-36781773dc3a tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] [instance: 2e52e036-3ac0-4bbd-abe3-4c0b1957734f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:42.654188 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ac923ab-4714-418e-bb98-36781773dc3a tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:42.655355 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ac923ab-4714-418e-bb98-36781773dc3a tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:42.656026 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ac923ab-4714-418e-bb98-36781773dc3a tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:42.657004 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ac923ab-4714-418e-bb98-36781773dc3a tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:42.657716 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ac923ab-4714-418e-bb98-36781773dc3a tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:42.658396 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ac923ab-4714-418e-bb98-36781773dc3a tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:43.083700 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4bfd74b1-3c35-4131-b24c-0e8ac0de00e1 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:43.121614 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4bfd74b1-3c35-4131-b24c-0e8ac0de00e1 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers/f9620891-182f-40dd-8abe-42b8b0e1b758" status: 200 len: 1321 microversion: 2.1 time: 0.780472 Oct 18 15:40:43.122718 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1795/3598] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:42 2022] GET /compute/v2.1/servers/f9620891-182f-40dd-8abe-42b8b0e1b758 => generated 1321 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:43.133443 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cf00c2bb-dc34-4ca2-8237-8e83f4960fb5 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:43.135754 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cf00c2bb-dc34-4ca2-8237-8e83f4960fb5 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:43.160919 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf00c2bb-dc34-4ca2-8237-8e83f4960fb5 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:43.162007 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf00c2bb-dc34-4ca2-8237-8e83f4960fb5 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:43.163959 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf00c2bb-dc34-4ca2-8237-8e83f4960fb5 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:43.165539 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf00c2bb-dc34-4ca2-8237-8e83f4960fb5 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:43.166233 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf00c2bb-dc34-4ca2-8237-8e83f4960fb5 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:43.168401 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf00c2bb-dc34-4ca2-8237-8e83f4960fb5 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:43.307887 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3ac923ab-4714-418e-bb98-36781773dc3a tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4287d8ca081403289857f84e3d0c3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e54dfc6654672a9423c9de5be3e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:43.316594 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3ac923ab-4714-418e-bb98-36781773dc3a tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] 10.222.0.60 "GET /compute/v2.1/servers/2e52e036-3ac0-4bbd-abe3-4c0b1957734f" status: 200 len: 1588 microversion: 2.1 time: 0.674809 Oct 18 15:40:43.329748 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1804/3599] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:42 2022] GET /compute/v2.1/servers/2e52e036-3ac0-4bbd-abe3-4c0b1957734f => generated 1588 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:43.342247 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7715c840-05a9-4355-969d-6b1ca195c8d0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:43.343165 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7715c840-05a9-4355-969d-6b1ca195c8d0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:43.350690 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7715c840-05a9-4355-969d-6b1ca195c8d0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:43.351693 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7715c840-05a9-4355-969d-6b1ca195c8d0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:43.352384 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7715c840-05a9-4355-969d-6b1ca195c8d0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:43.353371 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7715c840-05a9-4355-969d-6b1ca195c8d0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:43.353893 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7715c840-05a9-4355-969d-6b1ca195c8d0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:43.354526 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7715c840-05a9-4355-969d-6b1ca195c8d0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:43.550915 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cf00c2bb-dc34-4ca2-8237-8e83f4960fb5 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:43.577087 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cf00c2bb-dc34-4ca2-8237-8e83f4960fb5 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:43.579778 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cf00c2bb-dc34-4ca2-8237-8e83f4960fb5 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:43.582203 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cf00c2bb-dc34-4ca2-8237-8e83f4960fb5 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 200 len: 2950 microversion: 2.32 time: 0.453564 Oct 18 15:40:43.583005 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1796/3600] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:40:43 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 2950 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:40:43.615581 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-6ebae9a1-491f-4723-ba3e-7cdce07aa054 req-7faf5fb9-dbfa-4680-8b8d-60407fb11cea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e52e036-3ac0-4bbd-abe3-4c0b1957734f", "tag": "0c969268-8769-4c5b-900a-67fbcb9e9532"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:40:43.623871 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7715c840-05a9-4355-969d-6b1ca195c8d0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:43.635824 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7715c840-05a9-4355-969d-6b1ca195c8d0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1364 microversion: 2.1 time: 0.304508 Oct 18 15:40:43.638397 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1805/3601] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:43 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1364 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:43.638563 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6ebae9a1-491f-4723-ba3e-7cdce07aa054 req-7faf5fb9-dbfa-4680-8b8d-60407fb11cea service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:43.639215 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6ebae9a1-491f-4723-ba3e-7cdce07aa054 req-7faf5fb9-dbfa-4680-8b8d-60407fb11cea service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:43.639808 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6ebae9a1-491f-4723-ba3e-7cdce07aa054 req-7faf5fb9-dbfa-4680-8b8d-60407fb11cea service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:43.646474 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-35e1fdd2-efe7-4cc7-8e9e-a19e1ee76a07 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:43.647105 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-35e1fdd2-efe7-4cc7-8e9e-a19e1ee76a07 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] [instance: 0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:43.654315 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-6ebae9a1-491f-4723-ba3e-7cdce07aa054 req-7faf5fb9-dbfa-4680-8b8d-60407fb11cea service nova] Creating event network-changed:0c969268-8769-4c5b-900a-67fbcb9e9532 for instance 2e52e036-3ac0-4bbd-abe3-4c0b1957734f on n-h2-853682-5 Oct 18 15:40:43.655796 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-35e1fdd2-efe7-4cc7-8e9e-a19e1ee76a07 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:43.656305 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-35e1fdd2-efe7-4cc7-8e9e-a19e1ee76a07 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:43.659379 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-35e1fdd2-efe7-4cc7-8e9e-a19e1ee76a07 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:43.662923 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-6ebae9a1-491f-4723-ba3e-7cdce07aa054 req-7faf5fb9-dbfa-4680-8b8d-60407fb11cea service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054420 Oct 18 15:40:43.664400 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1797/3602] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:40:43.668588 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-35e1fdd2-efe7-4cc7-8e9e-a19e1ee76a07 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:43.669529 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-35e1fdd2-efe7-4cc7-8e9e-a19e1ee76a07 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:43.669676 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-35e1fdd2-efe7-4cc7-8e9e-a19e1ee76a07 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:43.670597 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0b8779fb-65d6-4002-ba5d-b4fad73430c5 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:43.671296 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0b8779fb-65d6-4002-ba5d-b4fad73430c5 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] [instance: e63557bf-fd6b-4440-99ea-2cf6068000bb] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:43.686324 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b8779fb-65d6-4002-ba5d-b4fad73430c5 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:43.687103 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b8779fb-65d6-4002-ba5d-b4fad73430c5 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:43.688020 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b8779fb-65d6-4002-ba5d-b4fad73430c5 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:43.689036 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b8779fb-65d6-4002-ba5d-b4fad73430c5 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:43.689746 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b8779fb-65d6-4002-ba5d-b4fad73430c5 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:43.692252 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b8779fb-65d6-4002-ba5d-b4fad73430c5 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:43.770041 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-35e1fdd2-efe7-4cc7-8e9e-a19e1ee76a07 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:43.782126 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-35e1fdd2-efe7-4cc7-8e9e-a19e1ee76a07 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:43.787052 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-35e1fdd2-efe7-4cc7-8e9e-a19e1ee76a07 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:43.789773 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-35e1fdd2-efe7-4cc7-8e9e-a19e1ee76a07 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] 10.222.0.60 "GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1" status: 200 len: 1365 microversion: 2.47 time: 0.148721 Oct 18 15:40:43.790654 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1806/3603] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:40:43 2022] GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:40:43.806200 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a6fc05cd-ff26-4760-845b-e7c056e6b992 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:43.807060 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a6fc05cd-ff26-4760-845b-e7c056e6b992 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:43.815674 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=6 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:40:43.824872 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a6fc05cd-ff26-4760-845b-e7c056e6b992 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:43.825293 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a6fc05cd-ff26-4760-845b-e7c056e6b992 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:43.825735 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a6fc05cd-ff26-4760-845b-e7c056e6b992 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:43.827514 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a6fc05cd-ff26-4760-845b-e7c056e6b992 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:43.827975 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a6fc05cd-ff26-4760-845b-e7c056e6b992 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:43.830863 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a6fc05cd-ff26-4760-845b-e7c056e6b992 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:43.898327 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=20 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:40:44.041307 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0b8779fb-65d6-4002-ba5d-b4fad73430c5 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb28fb6643847148fef67c0c775bf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2760d2db59084862abaedcc0a6a75046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:44.052082 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0b8779fb-65d6-4002-ba5d-b4fad73430c5 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] 10.222.0.60 "GET /compute/v2.1/servers/e63557bf-fd6b-4440-99ea-2cf6068000bb" status: 200 len: 1331 microversion: 2.1 time: 0.386350 Oct 18 15:40:44.057847 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1798/3604] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:43 2022] GET /compute/v2.1/servers/e63557bf-fd6b-4440-99ea-2cf6068000bb => generated 1331 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:44.067175 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-457fa24b-259d-486c-b52f-c30bde0a8a11 req-dcab8ae1-8dd9-4932-9eb9-46e36f3d1c85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bea3a8ec-d421-45b4-b6d8-397ac80c920d", "name": "network-vif-plugged", "status": "completed", "tag": "109ec8d2-d5cf-4fb1-a792-7805e9d7d81b"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:40:44.089470 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-457fa24b-259d-486c-b52f-c30bde0a8a11 req-dcab8ae1-8dd9-4932-9eb9-46e36f3d1c85 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:44.093375 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-457fa24b-259d-486c-b52f-c30bde0a8a11 req-dcab8ae1-8dd9-4932-9eb9-46e36f3d1c85 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:44.094027 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-457fa24b-259d-486c-b52f-c30bde0a8a11 req-dcab8ae1-8dd9-4932-9eb9-46e36f3d1c85 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:44.159197 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a6fc05cd-ff26-4760-845b-e7c056e6b992 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.365310 Oct 18 15:40:44.160423 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1807/3605] 10.222.0.60 () {60 vars in 1316 bytes} [Tue Oct 18 15:40:43 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d/os-interface => generated 1831 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:40:44.165486 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-352b444a-51dd-4a49-87a3-7d36c51dcadc tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:44.166503 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-352b444a-51dd-4a49-87a3-7d36c51dcadc tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] [instance: f9620891-182f-40dd-8abe-42b8b0e1b758] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:44.186713 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-352b444a-51dd-4a49-87a3-7d36c51dcadc tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:44.187219 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-352b444a-51dd-4a49-87a3-7d36c51dcadc tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:44.187685 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-352b444a-51dd-4a49-87a3-7d36c51dcadc tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:44.188440 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-352b444a-51dd-4a49-87a3-7d36c51dcadc tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:44.188939 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-352b444a-51dd-4a49-87a3-7d36c51dcadc tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:44.189377 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-352b444a-51dd-4a49-87a3-7d36c51dcadc tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:44.244985 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:40:44.446794 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-457fa24b-259d-486c-b52f-c30bde0a8a11 req-dcab8ae1-8dd9-4932-9eb9-46e36f3d1c85 service nova] Creating event network-vif-plugged:109ec8d2-d5cf-4fb1-a792-7805e9d7d81b for instance bea3a8ec-d421-45b4-b6d8-397ac80c920d on n-h2-853682-5 Oct 18 15:40:44.452140 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-457fa24b-259d-486c-b52f-c30bde0a8a11 req-dcab8ae1-8dd9-4932-9eb9-46e36f3d1c85 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.392683 Oct 18 15:40:44.456602 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1799/3606] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:40:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:40:44.667852 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b388fab0-bca3-4297-8d66-d18668d5a386 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:44.669571 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b388fab0-bca3-4297-8d66-d18668d5a386 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:44.680554 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b388fab0-bca3-4297-8d66-d18668d5a386 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:44.681536 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b388fab0-bca3-4297-8d66-d18668d5a386 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:44.682888 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b388fab0-bca3-4297-8d66-d18668d5a386 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:44.683905 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b388fab0-bca3-4297-8d66-d18668d5a386 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:44.684854 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b388fab0-bca3-4297-8d66-d18668d5a386 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:44.685632 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b388fab0-bca3-4297-8d66-d18668d5a386 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:44.726750 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-352b444a-51dd-4a49-87a3-7d36c51dcadc tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:44.741019 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-352b444a-51dd-4a49-87a3-7d36c51dcadc tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers/f9620891-182f-40dd-8abe-42b8b0e1b758" status: 200 len: 1321 microversion: 2.1 time: 0.578680 Oct 18 15:40:44.754828 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:40:44.759531 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1808/3607] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:44 2022] GET /compute/v2.1/servers/f9620891-182f-40dd-8abe-42b8b0e1b758 => generated 1321 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:44.821860 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ef235367-f746-4a36-8abe-ac7cb843ff8e tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:44.822930 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ef235367-f746-4a36-8abe-ac7cb843ff8e tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] [instance: 0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:44.833840 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ef235367-f746-4a36-8abe-ac7cb843ff8e tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:44.835682 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ef235367-f746-4a36-8abe-ac7cb843ff8e tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:44.836475 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ef235367-f746-4a36-8abe-ac7cb843ff8e tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:44.838441 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ef235367-f746-4a36-8abe-ac7cb843ff8e tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:44.841143 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ef235367-f746-4a36-8abe-ac7cb843ff8e tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:44.841874 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ef235367-f746-4a36-8abe-ac7cb843ff8e tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:45.056452 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ef235367-f746-4a36-8abe-ac7cb843ff8e tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:45.066310 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ef235367-f746-4a36-8abe-ac7cb843ff8e tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:45.067813 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ef235367-f746-4a36-8abe-ac7cb843ff8e tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:45.069044 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ef235367-f746-4a36-8abe-ac7cb843ff8e tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] 10.222.0.60 "GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1" status: 200 len: 1365 microversion: 2.47 time: 0.254463 Oct 18 15:40:45.069804 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1809/3608] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:40:44 2022] GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1 => generated 1365 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:40:45.093452 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-75eeb215-56a9-42d0-9b20-42df5f9c887c tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:45.094252 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-75eeb215-56a9-42d0-9b20-42df5f9c887c tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] [instance: e63557bf-fd6b-4440-99ea-2cf6068000bb] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:45.103187 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-75eeb215-56a9-42d0-9b20-42df5f9c887c tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:45.103996 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-75eeb215-56a9-42d0-9b20-42df5f9c887c tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:45.104661 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-75eeb215-56a9-42d0-9b20-42df5f9c887c tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:45.106531 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-75eeb215-56a9-42d0-9b20-42df5f9c887c tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:45.108080 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-75eeb215-56a9-42d0-9b20-42df5f9c887c tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:45.108834 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-75eeb215-56a9-42d0-9b20-42df5f9c887c tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:45.144988 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b388fab0-bca3-4297-8d66-d18668d5a386 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:45.153973 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b388fab0-bca3-4297-8d66-d18668d5a386 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1364 microversion: 2.1 time: 0.493402 Oct 18 15:40:45.159197 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1800/3609] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:44 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1364 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:40:45.400147 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-75eeb215-56a9-42d0-9b20-42df5f9c887c tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb28fb6643847148fef67c0c775bf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2760d2db59084862abaedcc0a6a75046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:45.408375 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-75eeb215-56a9-42d0-9b20-42df5f9c887c tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] 10.222.0.60 "GET /compute/v2.1/servers/e63557bf-fd6b-4440-99ea-2cf6068000bb" status: 200 len: 1331 microversion: 2.1 time: 0.321637 Oct 18 15:40:45.424911 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1810/3610] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:45 2022] GET /compute/v2.1/servers/e63557bf-fd6b-4440-99ea-2cf6068000bb => generated 1331 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:40:45.696606 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-620f0939-554f-4e14-88f7-0044f1041f02 req-e4c8758c-facc-4373-9090-e9e71633cc2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "568f29d6-ddaf-4515-84dd-7cdab0922c97", "tag": "4be806d3-350c-4b58-a904-3633416f11d1"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:40:45.716081 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-620f0939-554f-4e14-88f7-0044f1041f02 req-e4c8758c-facc-4373-9090-e9e71633cc2a service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:45.716322 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-620f0939-554f-4e14-88f7-0044f1041f02 req-e4c8758c-facc-4373-9090-e9e71633cc2a service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:45.716714 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-620f0939-554f-4e14-88f7-0044f1041f02 req-e4c8758c-facc-4373-9090-e9e71633cc2a service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:45.742960 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-620f0939-554f-4e14-88f7-0044f1041f02 req-e4c8758c-facc-4373-9090-e9e71633cc2a service nova] Creating event network-changed:4be806d3-350c-4b58-a904-3633416f11d1 for instance 568f29d6-ddaf-4515-84dd-7cdab0922c97 on n-h1-853682-5 Oct 18 15:40:45.757073 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-620f0939-554f-4e14-88f7-0044f1041f02 req-e4c8758c-facc-4373-9090-e9e71633cc2a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057459 Oct 18 15:40:45.761031 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1801/3611] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:40:45.770256 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f0ca44e2-8653-46cc-b154-8f566bf382da tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:45.771642 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f0ca44e2-8653-46cc-b154-8f566bf382da tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] [instance: f9620891-182f-40dd-8abe-42b8b0e1b758] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:45.786771 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f0ca44e2-8653-46cc-b154-8f566bf382da tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:45.787640 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f0ca44e2-8653-46cc-b154-8f566bf382da tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:45.788263 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f0ca44e2-8653-46cc-b154-8f566bf382da tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:45.789235 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f0ca44e2-8653-46cc-b154-8f566bf382da tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:45.789870 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f0ca44e2-8653-46cc-b154-8f566bf382da tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:45.790492 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f0ca44e2-8653-46cc-b154-8f566bf382da tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:46.088376 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f0ca44e2-8653-46cc-b154-8f566bf382da tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:46.099028 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-47d625a3-d051-48c1-bd28-c85b0bfb8ba6 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:46.100219 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-47d625a3-d051-48c1-bd28-c85b0bfb8ba6 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] [instance: 0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:46.106412 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f0ca44e2-8653-46cc-b154-8f566bf382da tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers/f9620891-182f-40dd-8abe-42b8b0e1b758" status: 200 len: 1321 microversion: 2.1 time: 0.340460 Oct 18 15:40:46.106751 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47d625a3-d051-48c1-bd28-c85b0bfb8ba6 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:46.107235 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47d625a3-d051-48c1-bd28-c85b0bfb8ba6 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:46.107624 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1811/3612] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:45 2022] GET /compute/v2.1/servers/f9620891-182f-40dd-8abe-42b8b0e1b758 => generated 1321 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:46.107789 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47d625a3-d051-48c1-bd28-c85b0bfb8ba6 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:46.108572 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47d625a3-d051-48c1-bd28-c85b0bfb8ba6 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:46.109053 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47d625a3-d051-48c1-bd28-c85b0bfb8ba6 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:46.109544 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47d625a3-d051-48c1-bd28-c85b0bfb8ba6 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:46.179448 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=18 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:40:46.181811 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f1565179-4b4d-466a-8d2c-5c3d7a86a714 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:46.182436 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f1565179-4b4d-466a-8d2c-5c3d7a86a714 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:46.188640 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f1565179-4b4d-466a-8d2c-5c3d7a86a714 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:46.189152 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f1565179-4b4d-466a-8d2c-5c3d7a86a714 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:46.189615 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f1565179-4b4d-466a-8d2c-5c3d7a86a714 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:46.190515 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f1565179-4b4d-466a-8d2c-5c3d7a86a714 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:46.190964 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f1565179-4b4d-466a-8d2c-5c3d7a86a714 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:46.191383 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f1565179-4b4d-466a-8d2c-5c3d7a86a714 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:46.192283 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-47d625a3-d051-48c1-bd28-c85b0bfb8ba6 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:46.201019 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-47d625a3-d051-48c1-bd28-c85b0bfb8ba6 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:46.202585 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-47d625a3-d051-48c1-bd28-c85b0bfb8ba6 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:46.204062 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-47d625a3-d051-48c1-bd28-c85b0bfb8ba6 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] 10.222.0.60 "GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1" status: 200 len: 1365 microversion: 2.47 time: 0.112167 Oct 18 15:40:46.204621 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1802/3613] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:40:46 2022] GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1 => generated 1365 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:40:46.339940 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f1565179-4b4d-466a-8d2c-5c3d7a86a714 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:46.348685 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f1565179-4b4d-466a-8d2c-5c3d7a86a714 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1364 microversion: 2.1 time: 0.170916 Oct 18 15:40:46.349317 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1812/3614] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:46 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:46.430777 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e41a185f-de20-4f8f-ba75-cb012f613526 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:46.431662 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e41a185f-de20-4f8f-ba75-cb012f613526 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] [instance: e63557bf-fd6b-4440-99ea-2cf6068000bb] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:46.438102 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e41a185f-de20-4f8f-ba75-cb012f613526 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:46.438592 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e41a185f-de20-4f8f-ba75-cb012f613526 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:46.439240 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e41a185f-de20-4f8f-ba75-cb012f613526 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:46.439975 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e41a185f-de20-4f8f-ba75-cb012f613526 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:46.440427 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e41a185f-de20-4f8f-ba75-cb012f613526 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:46.441072 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e41a185f-de20-4f8f-ba75-cb012f613526 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:46.575480 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e41a185f-de20-4f8f-ba75-cb012f613526 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb28fb6643847148fef67c0c775bf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2760d2db59084862abaedcc0a6a75046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:46.584702 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e41a185f-de20-4f8f-ba75-cb012f613526 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] 10.222.0.60 "GET /compute/v2.1/servers/e63557bf-fd6b-4440-99ea-2cf6068000bb" status: 200 len: 1331 microversion: 2.1 time: 0.157680 Oct 18 15:40:46.587178 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1803/3615] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:46 2022] GET /compute/v2.1/servers/e63557bf-fd6b-4440-99ea-2cf6068000bb => generated 1331 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:47.130178 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-940940c6-e95a-4cee-9838-6170e6334d71 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:47.130786 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-940940c6-e95a-4cee-9838-6170e6334d71 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] [instance: f9620891-182f-40dd-8abe-42b8b0e1b758] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:47.137648 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-940940c6-e95a-4cee-9838-6170e6334d71 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:47.138126 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-940940c6-e95a-4cee-9838-6170e6334d71 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:47.138557 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-940940c6-e95a-4cee-9838-6170e6334d71 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:47.139236 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-940940c6-e95a-4cee-9838-6170e6334d71 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:47.139686 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-940940c6-e95a-4cee-9838-6170e6334d71 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:47.140103 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-940940c6-e95a-4cee-9838-6170e6334d71 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:47.234284 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4fd0c264-5580-46e4-8d8c-6e5205ed7f5c tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:47.235072 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4fd0c264-5580-46e4-8d8c-6e5205ed7f5c tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] [instance: 0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:47.244998 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4fd0c264-5580-46e4-8d8c-6e5205ed7f5c tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:47.245547 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4fd0c264-5580-46e4-8d8c-6e5205ed7f5c tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:47.245990 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4fd0c264-5580-46e4-8d8c-6e5205ed7f5c tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:47.246755 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4fd0c264-5580-46e4-8d8c-6e5205ed7f5c tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:47.247220 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4fd0c264-5580-46e4-8d8c-6e5205ed7f5c tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:47.247944 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4fd0c264-5580-46e4-8d8c-6e5205ed7f5c tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:47.379695 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4fd0c264-5580-46e4-8d8c-6e5205ed7f5c tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:47.388857 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4fd0c264-5580-46e4-8d8c-6e5205ed7f5c tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:47.390557 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4fd0c264-5580-46e4-8d8c-6e5205ed7f5c tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:47.392150 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4fd0c264-5580-46e4-8d8c-6e5205ed7f5c tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] 10.222.0.60 "GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1" status: 200 len: 1365 microversion: 2.47 time: 0.162081 Oct 18 15:40:47.408838 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1804/3616] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:40:47 2022] GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:40:47.408838 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1b400cb9-e61a-4d35-829e-c170ed71b30a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:47.408838 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1b400cb9-e61a-4d35-829e-c170ed71b30a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:47.408838 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b400cb9-e61a-4d35-829e-c170ed71b30a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:47.408838 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b400cb9-e61a-4d35-829e-c170ed71b30a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:47.408838 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b400cb9-e61a-4d35-829e-c170ed71b30a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:47.408838 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b400cb9-e61a-4d35-829e-c170ed71b30a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:47.410079 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b400cb9-e61a-4d35-829e-c170ed71b30a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:47.410079 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b400cb9-e61a-4d35-829e-c170ed71b30a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:47.439389 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-940940c6-e95a-4cee-9838-6170e6334d71 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:47.448460 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-940940c6-e95a-4cee-9838-6170e6334d71 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers/f9620891-182f-40dd-8abe-42b8b0e1b758" status: 200 len: 1321 microversion: 2.1 time: 0.322052 Oct 18 15:40:47.449140 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1813/3617] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:47 2022] GET /compute/v2.1/servers/f9620891-182f-40dd-8abe-42b8b0e1b758 => generated 1321 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:47.609825 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5f37ff81-29a0-40c5-97e2-caa262c49a80 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:47.614016 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5f37ff81-29a0-40c5-97e2-caa262c49a80 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] [instance: e63557bf-fd6b-4440-99ea-2cf6068000bb] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:47.623428 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5f37ff81-29a0-40c5-97e2-caa262c49a80 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:47.625299 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5f37ff81-29a0-40c5-97e2-caa262c49a80 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:47.626307 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5f37ff81-29a0-40c5-97e2-caa262c49a80 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:47.627607 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5f37ff81-29a0-40c5-97e2-caa262c49a80 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:47.628325 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5f37ff81-29a0-40c5-97e2-caa262c49a80 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:47.629038 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5f37ff81-29a0-40c5-97e2-caa262c49a80 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:47.752588 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1b400cb9-e61a-4d35-829e-c170ed71b30a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:47.761356 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1b400cb9-e61a-4d35-829e-c170ed71b30a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1364 microversion: 2.1 time: 0.366372 Oct 18 15:40:47.762658 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1805/3618] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:47 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1364 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:47.805629 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5f37ff81-29a0-40c5-97e2-caa262c49a80 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb28fb6643847148fef67c0c775bf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2760d2db59084862abaedcc0a6a75046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:47.813861 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5f37ff81-29a0-40c5-97e2-caa262c49a80 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] 10.222.0.60 "GET /compute/v2.1/servers/e63557bf-fd6b-4440-99ea-2cf6068000bb" status: 200 len: 1331 microversion: 2.1 time: 0.210195 Oct 18 15:40:47.814441 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1814/3619] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:47 2022] GET /compute/v2.1/servers/e63557bf-fd6b-4440-99ea-2cf6068000bb => generated 1331 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:40:47.835748 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-0bb761dd-76af-411d-846a-d82bcf08bc87 req-98068ef6-9b70-40e4-a396-adf77b85e694 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9620891-182f-40dd-8abe-42b8b0e1b758", "tag": "6177bb79-9152-412b-b0d6-f6e1d447d283"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:40:47.847442 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0bb761dd-76af-411d-846a-d82bcf08bc87 req-98068ef6-9b70-40e4-a396-adf77b85e694 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:47.848071 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0bb761dd-76af-411d-846a-d82bcf08bc87 req-98068ef6-9b70-40e4-a396-adf77b85e694 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:47.848663 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0bb761dd-76af-411d-846a-d82bcf08bc87 req-98068ef6-9b70-40e4-a396-adf77b85e694 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:47.864906 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-0bb761dd-76af-411d-846a-d82bcf08bc87 req-98068ef6-9b70-40e4-a396-adf77b85e694 service nova] Creating event network-changed:6177bb79-9152-412b-b0d6-f6e1d447d283 for instance f9620891-182f-40dd-8abe-42b8b0e1b758 on n-h1-853682-5 Oct 18 15:40:47.869916 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-0bb761dd-76af-411d-846a-d82bcf08bc87 req-98068ef6-9b70-40e4-a396-adf77b85e694 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037877 Oct 18 15:40:47.870901 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1806/3620] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:40:47.910993 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-bb304491-7c3f-4f60-8a24-9fc7760aa21f req-da7de5fb-aec1-440a-bf00-faae6cf676ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e63557bf-fd6b-4440-99ea-2cf6068000bb", "name": "network-vif-plugged", "status": "completed", "tag": "78218976-d29b-4087-9660-b6926a2369ec"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:40:47.921753 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-bb304491-7c3f-4f60-8a24-9fc7760aa21f req-da7de5fb-aec1-440a-bf00-faae6cf676ed service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:47.922176 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-bb304491-7c3f-4f60-8a24-9fc7760aa21f req-da7de5fb-aec1-440a-bf00-faae6cf676ed service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:47.922608 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-bb304491-7c3f-4f60-8a24-9fc7760aa21f req-da7de5fb-aec1-440a-bf00-faae6cf676ed service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:47.934645 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-bb304491-7c3f-4f60-8a24-9fc7760aa21f req-da7de5fb-aec1-440a-bf00-faae6cf676ed service nova] Creating event network-vif-plugged:78218976-d29b-4087-9660-b6926a2369ec for instance e63557bf-fd6b-4440-99ea-2cf6068000bb on n-h1-853682-5 Oct 18 15:40:47.939464 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-bb304491-7c3f-4f60-8a24-9fc7760aa21f req-da7de5fb-aec1-440a-bf00-faae6cf676ed service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033124 Oct 18 15:40:47.940081 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1815/3621] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:40:48.422034 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f978040f-2e9e-4486-a612-c4cc01ccee93 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:48.422802 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f978040f-2e9e-4486-a612-c4cc01ccee93 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] [instance: 0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:48.429842 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f978040f-2e9e-4486-a612-c4cc01ccee93 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:48.430313 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f978040f-2e9e-4486-a612-c4cc01ccee93 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:48.430736 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f978040f-2e9e-4486-a612-c4cc01ccee93 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:48.431419 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f978040f-2e9e-4486-a612-c4cc01ccee93 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:48.431863 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f978040f-2e9e-4486-a612-c4cc01ccee93 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:48.432277 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f978040f-2e9e-4486-a612-c4cc01ccee93 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:48.472864 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2ed115eb-80de-4b81-98f1-84979084840a tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:48.473662 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2ed115eb-80de-4b81-98f1-84979084840a tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] [instance: f9620891-182f-40dd-8abe-42b8b0e1b758] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:48.480085 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2ed115eb-80de-4b81-98f1-84979084840a tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:48.480643 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2ed115eb-80de-4b81-98f1-84979084840a tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:48.481171 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2ed115eb-80de-4b81-98f1-84979084840a tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:48.481997 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2ed115eb-80de-4b81-98f1-84979084840a tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:48.482559 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2ed115eb-80de-4b81-98f1-84979084840a tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:48.483216 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2ed115eb-80de-4b81-98f1-84979084840a tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:48.496726 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f978040f-2e9e-4486-a612-c4cc01ccee93 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:48.505569 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f978040f-2e9e-4486-a612-c4cc01ccee93 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:48.507019 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f978040f-2e9e-4486-a612-c4cc01ccee93 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:48.508209 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f978040f-2e9e-4486-a612-c4cc01ccee93 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] 10.222.0.60 "GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1" status: 200 len: 1365 microversion: 2.47 time: 0.090417 Oct 18 15:40:48.508759 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1807/3622] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:40:48 2022] GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1 => generated 1365 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:40:48.617661 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2ed115eb-80de-4b81-98f1-84979084840a tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:48.625673 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2ed115eb-80de-4b81-98f1-84979084840a tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers/f9620891-182f-40dd-8abe-42b8b0e1b758" status: 200 len: 1321 microversion: 2.1 time: 0.157867 Oct 18 15:40:48.626289 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1816/3623] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:48 2022] GET /compute/v2.1/servers/f9620891-182f-40dd-8abe-42b8b0e1b758 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:40:48.783755 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bcb457cc-3a06-4eda-8186-c10097f84878 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:48.785036 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bcb457cc-3a06-4eda-8186-c10097f84878 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:48.791574 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bcb457cc-3a06-4eda-8186-c10097f84878 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:48.792927 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bcb457cc-3a06-4eda-8186-c10097f84878 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:48.793510 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bcb457cc-3a06-4eda-8186-c10097f84878 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:48.794629 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bcb457cc-3a06-4eda-8186-c10097f84878 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:48.795191 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bcb457cc-3a06-4eda-8186-c10097f84878 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:48.795727 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bcb457cc-3a06-4eda-8186-c10097f84878 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:48.838287 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-37a14f10-951b-405d-963a-f3092ba4dc33 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:48.838904 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-37a14f10-951b-405d-963a-f3092ba4dc33 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] [instance: e63557bf-fd6b-4440-99ea-2cf6068000bb] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:48.844555 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:40:48.846893 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37a14f10-951b-405d-963a-f3092ba4dc33 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:48.847755 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37a14f10-951b-405d-963a-f3092ba4dc33 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:48.848562 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37a14f10-951b-405d-963a-f3092ba4dc33 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:48.849473 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37a14f10-951b-405d-963a-f3092ba4dc33 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:48.850699 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37a14f10-951b-405d-963a-f3092ba4dc33 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:48.851550 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37a14f10-951b-405d-963a-f3092ba4dc33 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:49.338399 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bcb457cc-3a06-4eda-8186-c10097f84878 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:49.341998 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:40:49.347822 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bcb457cc-3a06-4eda-8186-c10097f84878 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1364 microversion: 2.1 time: 0.568046 Oct 18 15:40:49.348399 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1808/3624] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:48 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1364 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:49.382564 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-37a14f10-951b-405d-963a-f3092ba4dc33 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb28fb6643847148fef67c0c775bf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2760d2db59084862abaedcc0a6a75046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:49.390188 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-37a14f10-951b-405d-963a-f3092ba4dc33 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] 10.222.0.60 "GET /compute/v2.1/servers/e63557bf-fd6b-4440-99ea-2cf6068000bb" status: 200 len: 1331 microversion: 2.1 time: 0.555898 Oct 18 15:40:49.390757 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1817/3625] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:48 2022] GET /compute/v2.1/servers/e63557bf-fd6b-4440-99ea-2cf6068000bb => generated 1331 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:40:49.535382 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0a64274d-dc2a-46ff-98cd-f001d2a98256 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:49.536007 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0a64274d-dc2a-46ff-98cd-f001d2a98256 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] [instance: 0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:49.542897 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a64274d-dc2a-46ff-98cd-f001d2a98256 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:49.543385 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a64274d-dc2a-46ff-98cd-f001d2a98256 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:49.543820 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a64274d-dc2a-46ff-98cd-f001d2a98256 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:49.544521 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a64274d-dc2a-46ff-98cd-f001d2a98256 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:49.545194 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a64274d-dc2a-46ff-98cd-f001d2a98256 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:49.545622 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a64274d-dc2a-46ff-98cd-f001d2a98256 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:49.613140 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0a64274d-dc2a-46ff-98cd-f001d2a98256 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:49.621555 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0a64274d-dc2a-46ff-98cd-f001d2a98256 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:49.623562 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0a64274d-dc2a-46ff-98cd-f001d2a98256 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:49.624756 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0a64274d-dc2a-46ff-98cd-f001d2a98256 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] 10.222.0.60 "GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1" status: 200 len: 1371 microversion: 2.47 time: 0.094387 Oct 18 15:40:49.625348 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1809/3626] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:40:49 2022] GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1 => generated 1371 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:40:49.648623 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0d313fea-b18e-44bb-9f87-1bdf59a3b810 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:49.649258 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0d313fea-b18e-44bb-9f87-1bdf59a3b810 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] [instance: f9620891-182f-40dd-8abe-42b8b0e1b758] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:49.656216 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0d313fea-b18e-44bb-9f87-1bdf59a3b810 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:49.656706 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0d313fea-b18e-44bb-9f87-1bdf59a3b810 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:49.657218 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0d313fea-b18e-44bb-9f87-1bdf59a3b810 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:49.657914 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0d313fea-b18e-44bb-9f87-1bdf59a3b810 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:49.658483 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0d313fea-b18e-44bb-9f87-1bdf59a3b810 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:49.658941 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0d313fea-b18e-44bb-9f87-1bdf59a3b810 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:49.789340 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0d313fea-b18e-44bb-9f87-1bdf59a3b810 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:49.797306 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0d313fea-b18e-44bb-9f87-1bdf59a3b810 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers/f9620891-182f-40dd-8abe-42b8b0e1b758" status: 200 len: 1321 microversion: 2.1 time: 0.152498 Oct 18 15:40:49.797881 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1818/3627] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:49 2022] GET /compute/v2.1/servers/f9620891-182f-40dd-8abe-42b8b0e1b758 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:49.955808 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-f9a9f388-6e0e-45c1-914c-3a799beb0cc3 req-7f23d16a-0ad2-47cb-904c-76f781f0058c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79212b18-bfd6-4a94-9d58-80c535525aa8", "name": "network-vif-plugged", "status": "completed", "tag": "65ddf63c-d787-42eb-bb1d-c107c1fe8b2f"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:40:49.965199 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f9a9f388-6e0e-45c1-914c-3a799beb0cc3 req-7f23d16a-0ad2-47cb-904c-76f781f0058c service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:49.965672 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f9a9f388-6e0e-45c1-914c-3a799beb0cc3 req-7f23d16a-0ad2-47cb-904c-76f781f0058c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:49.966103 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f9a9f388-6e0e-45c1-914c-3a799beb0cc3 req-7f23d16a-0ad2-47cb-904c-76f781f0058c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:49.976885 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-f9a9f388-6e0e-45c1-914c-3a799beb0cc3 req-7f23d16a-0ad2-47cb-904c-76f781f0058c service nova] Creating event network-vif-plugged:65ddf63c-d787-42eb-bb1d-c107c1fe8b2f for instance 79212b18-bfd6-4a94-9d58-80c535525aa8 on n-h2-853682-5 Oct 18 15:40:49.981707 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-f9a9f388-6e0e-45c1-914c-3a799beb0cc3 req-7f23d16a-0ad2-47cb-904c-76f781f0058c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030607 Oct 18 15:40:49.982358 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1810/3628] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:40:50.371226 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0db1a05c-b803-415d-b800-ab8e4a338ec8 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:50.371749 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0db1a05c-b803-415d-b800-ab8e4a338ec8 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:50.378560 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0db1a05c-b803-415d-b800-ab8e4a338ec8 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:50.379044 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0db1a05c-b803-415d-b800-ab8e4a338ec8 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:50.379477 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0db1a05c-b803-415d-b800-ab8e4a338ec8 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:50.380166 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0db1a05c-b803-415d-b800-ab8e4a338ec8 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:50.380624 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0db1a05c-b803-415d-b800-ab8e4a338ec8 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:50.381075 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0db1a05c-b803-415d-b800-ab8e4a338ec8 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:50.416025 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-807f58ff-b4b7-4e3f-b25c-f82fd1c6ea0a tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:50.416719 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-807f58ff-b4b7-4e3f-b25c-f82fd1c6ea0a tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] [instance: e63557bf-fd6b-4440-99ea-2cf6068000bb] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:50.422933 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-807f58ff-b4b7-4e3f-b25c-f82fd1c6ea0a tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:50.423420 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-807f58ff-b4b7-4e3f-b25c-f82fd1c6ea0a tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:50.424357 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-807f58ff-b4b7-4e3f-b25c-f82fd1c6ea0a tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:50.425083 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-807f58ff-b4b7-4e3f-b25c-f82fd1c6ea0a tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:50.425538 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-807f58ff-b4b7-4e3f-b25c-f82fd1c6ea0a tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:50.425960 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-807f58ff-b4b7-4e3f-b25c-f82fd1c6ea0a tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:50.579892 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0db1a05c-b803-415d-b800-ab8e4a338ec8 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:50.587689 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0db1a05c-b803-415d-b800-ab8e4a338ec8 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1364 microversion: 2.1 time: 0.220435 Oct 18 15:40:50.588274 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1819/3629] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:50 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1364 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:50.613134 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-807f58ff-b4b7-4e3f-b25c-f82fd1c6ea0a tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb28fb6643847148fef67c0c775bf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2760d2db59084862abaedcc0a6a75046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:50.621708 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-807f58ff-b4b7-4e3f-b25c-f82fd1c6ea0a tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] 10.222.0.60 "GET /compute/v2.1/servers/e63557bf-fd6b-4440-99ea-2cf6068000bb" status: 200 len: 1331 microversion: 2.1 time: 0.209862 Oct 18 15:40:50.622216 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1811/3630] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:50 2022] GET /compute/v2.1/servers/e63557bf-fd6b-4440-99ea-2cf6068000bb => generated 1331 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:40:50.650789 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-79ad352f-5508-4e53-bf63-e483508f636a tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:50.651408 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-79ad352f-5508-4e53-bf63-e483508f636a tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] [instance: 0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:50.657872 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-79ad352f-5508-4e53-bf63-e483508f636a tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:50.658905 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-79ad352f-5508-4e53-bf63-e483508f636a tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:50.659345 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-79ad352f-5508-4e53-bf63-e483508f636a tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:50.660027 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-79ad352f-5508-4e53-bf63-e483508f636a tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:50.660480 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-79ad352f-5508-4e53-bf63-e483508f636a tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:50.660935 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-79ad352f-5508-4e53-bf63-e483508f636a tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:50.730041 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-79ad352f-5508-4e53-bf63-e483508f636a tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:50.738809 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-79ad352f-5508-4e53-bf63-e483508f636a tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:50.740257 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-79ad352f-5508-4e53-bf63-e483508f636a tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:50.741468 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-79ad352f-5508-4e53-bf63-e483508f636a tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] 10.222.0.60 "GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1" status: 200 len: 1371 microversion: 2.47 time: 0.094606 Oct 18 15:40:50.742035 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1820/3631] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:40:50 2022] GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1 => generated 1371 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:40:50.819733 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f52da237-a6c0-4133-8ee4-5afb6409eef2 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:50.820458 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f52da237-a6c0-4133-8ee4-5afb6409eef2 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] [instance: f9620891-182f-40dd-8abe-42b8b0e1b758] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:50.826504 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f52da237-a6c0-4133-8ee4-5afb6409eef2 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:50.827017 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f52da237-a6c0-4133-8ee4-5afb6409eef2 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:50.827457 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f52da237-a6c0-4133-8ee4-5afb6409eef2 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:50.828443 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f52da237-a6c0-4133-8ee4-5afb6409eef2 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:50.828941 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f52da237-a6c0-4133-8ee4-5afb6409eef2 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:50.829375 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f52da237-a6c0-4133-8ee4-5afb6409eef2 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:50.958663 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f52da237-a6c0-4133-8ee4-5afb6409eef2 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:50.966538 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f52da237-a6c0-4133-8ee4-5afb6409eef2 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers/f9620891-182f-40dd-8abe-42b8b0e1b758" status: 200 len: 1321 microversion: 2.1 time: 0.150941 Oct 18 15:40:50.967101 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1812/3632] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:50 2022] GET /compute/v2.1/servers/f9620891-182f-40dd-8abe-42b8b0e1b758 => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:51.609634 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2ff5c3c9-2107-448b-8085-d5b5cf94dbac tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:51.610251 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2ff5c3c9-2107-448b-8085-d5b5cf94dbac tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:51.617357 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2ff5c3c9-2107-448b-8085-d5b5cf94dbac tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:51.617839 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2ff5c3c9-2107-448b-8085-d5b5cf94dbac tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:51.618277 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2ff5c3c9-2107-448b-8085-d5b5cf94dbac tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:51.618971 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2ff5c3c9-2107-448b-8085-d5b5cf94dbac tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:51.619426 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2ff5c3c9-2107-448b-8085-d5b5cf94dbac tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:51.619852 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2ff5c3c9-2107-448b-8085-d5b5cf94dbac tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:51.644027 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3ec0f3e1-6e25-4a29-bbde-8e08170e4de9 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:51.644636 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3ec0f3e1-6e25-4a29-bbde-8e08170e4de9 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] [instance: e63557bf-fd6b-4440-99ea-2cf6068000bb] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:51.647595 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:40:51.652783 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ec0f3e1-6e25-4a29-bbde-8e08170e4de9 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:51.653303 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ec0f3e1-6e25-4a29-bbde-8e08170e4de9 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:51.653738 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ec0f3e1-6e25-4a29-bbde-8e08170e4de9 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:51.654429 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ec0f3e1-6e25-4a29-bbde-8e08170e4de9 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:51.654888 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ec0f3e1-6e25-4a29-bbde-8e08170e4de9 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:51.655296 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ec0f3e1-6e25-4a29-bbde-8e08170e4de9 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:51.808726 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2ff5c3c9-2107-448b-8085-d5b5cf94dbac tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:51.818449 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2ff5c3c9-2107-448b-8085-d5b5cf94dbac tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1552 microversion: 2.1 time: 0.212463 Oct 18 15:40:51.833027 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1821/3633] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:51 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1552 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:51.833027 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e4ee8f39-7dd9-4103-ba79-1f1ad5adce6b tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:51.833027 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e4ee8f39-7dd9-4103-ba79-1f1ad5adce6b tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] [instance: 0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:51.833027 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4ee8f39-7dd9-4103-ba79-1f1ad5adce6b tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:51.833557 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4ee8f39-7dd9-4103-ba79-1f1ad5adce6b tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:51.833874 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4ee8f39-7dd9-4103-ba79-1f1ad5adce6b tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:51.834894 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4ee8f39-7dd9-4103-ba79-1f1ad5adce6b tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:51.835546 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4ee8f39-7dd9-4103-ba79-1f1ad5adce6b tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:51.836145 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4ee8f39-7dd9-4103-ba79-1f1ad5adce6b tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:51.914903 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3ec0f3e1-6e25-4a29-bbde-8e08170e4de9 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb28fb6643847148fef67c0c775bf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2760d2db59084862abaedcc0a6a75046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:51.923801 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3ec0f3e1-6e25-4a29-bbde-8e08170e4de9 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] 10.222.0.60 "GET /compute/v2.1/servers/e63557bf-fd6b-4440-99ea-2cf6068000bb" status: 200 len: 1331 microversion: 2.1 time: 0.283162 Oct 18 15:40:51.924411 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1813/3634] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:51 2022] GET /compute/v2.1/servers/e63557bf-fd6b-4440-99ea-2cf6068000bb => generated 1331 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:51.931460 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5b950258-e095-46bb-8fc4-909994b31653 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:51.932848 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5b950258-e095-46bb-8fc4-909994b31653 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:51.937455 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e4ee8f39-7dd9-4103-ba79-1f1ad5adce6b tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:51.947221 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5b950258-e095-46bb-8fc4-909994b31653 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:51.947484 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e4ee8f39-7dd9-4103-ba79-1f1ad5adce6b tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:51.947626 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5b950258-e095-46bb-8fc4-909994b31653 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:51.948067 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5b950258-e095-46bb-8fc4-909994b31653 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:51.948781 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5b950258-e095-46bb-8fc4-909994b31653 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:51.949277 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5b950258-e095-46bb-8fc4-909994b31653 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:51.949710 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5b950258-e095-46bb-8fc4-909994b31653 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:51.950214 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e4ee8f39-7dd9-4103-ba79-1f1ad5adce6b tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:51.951796 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e4ee8f39-7dd9-4103-ba79-1f1ad5adce6b tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] 10.222.0.60 "GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1" status: 200 len: 1371 microversion: 2.47 time: 0.131604 Oct 18 15:40:51.953587 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1822/3635] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:40:51 2022] GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1 => generated 1371 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:40:51.990123 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f3efd4c5-f0ba-42c3-b25e-b7399ab2dce7 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:51.990984 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f3efd4c5-f0ba-42c3-b25e-b7399ab2dce7 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] [instance: f9620891-182f-40dd-8abe-42b8b0e1b758] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:51.997070 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f3efd4c5-f0ba-42c3-b25e-b7399ab2dce7 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:51.997850 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f3efd4c5-f0ba-42c3-b25e-b7399ab2dce7 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:51.998292 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f3efd4c5-f0ba-42c3-b25e-b7399ab2dce7 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:51.999003 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f3efd4c5-f0ba-42c3-b25e-b7399ab2dce7 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:51.999463 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f3efd4c5-f0ba-42c3-b25e-b7399ab2dce7 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:51.999895 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f3efd4c5-f0ba-42c3-b25e-b7399ab2dce7 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:52.033078 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5b950258-e095-46bb-8fc4-909994b31653 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.107018 Oct 18 15:40:52.042010 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1814/3636] 10.222.0.60 () {58 vars in 1275 bytes} [Tue Oct 18 15:40:51 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8/os-interface => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:40:52.058508 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-76750550-1159-4d77-8011-5297dac648d0 req-ba6b6356-ae7a-4577-b263-59ee3b4bb236 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "568f29d6-ddaf-4515-84dd-7cdab0922c97", "name": "network-vif-plugged", "status": "completed", "tag": "4be806d3-350c-4b58-a904-3633416f11d1"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:40:52.088984 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-76750550-1159-4d77-8011-5297dac648d0 req-ba6b6356-ae7a-4577-b263-59ee3b4bb236 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:52.089432 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-76750550-1159-4d77-8011-5297dac648d0 req-ba6b6356-ae7a-4577-b263-59ee3b4bb236 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:52.089861 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-76750550-1159-4d77-8011-5297dac648d0 req-ba6b6356-ae7a-4577-b263-59ee3b4bb236 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:52.118256 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-76750550-1159-4d77-8011-5297dac648d0 req-ba6b6356-ae7a-4577-b263-59ee3b4bb236 service nova] Creating event network-vif-plugged:4be806d3-350c-4b58-a904-3633416f11d1 for instance 568f29d6-ddaf-4515-84dd-7cdab0922c97 on n-h1-853682-5 Oct 18 15:40:52.126452 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-76750550-1159-4d77-8011-5297dac648d0 req-ba6b6356-ae7a-4577-b263-59ee3b4bb236 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073897 Oct 18 15:40:52.127069 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1815/3637] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:40:52.151694 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f3efd4c5-f0ba-42c3-b25e-b7399ab2dce7 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:52.160775 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f3efd4c5-f0ba-42c3-b25e-b7399ab2dce7 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers/f9620891-182f-40dd-8abe-42b8b0e1b758" status: 200 len: 1321 microversion: 2.1 time: 0.174495 Oct 18 15:40:52.161409 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1823/3638] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:51 2022] GET /compute/v2.1/servers/f9620891-182f-40dd-8abe-42b8b0e1b758 => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:40:52.948315 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0a08f74c-9304-4846-b183-2ae10f8b3bd8 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:52.949100 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0a08f74c-9304-4846-b183-2ae10f8b3bd8 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] [instance: e63557bf-fd6b-4440-99ea-2cf6068000bb] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:52.956499 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a08f74c-9304-4846-b183-2ae10f8b3bd8 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:52.957574 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a08f74c-9304-4846-b183-2ae10f8b3bd8 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:52.958020 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a08f74c-9304-4846-b183-2ae10f8b3bd8 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:52.958700 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a08f74c-9304-4846-b183-2ae10f8b3bd8 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:52.959149 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a08f74c-9304-4846-b183-2ae10f8b3bd8 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:52.959567 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a08f74c-9304-4846-b183-2ae10f8b3bd8 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:52.979271 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b908de39-98e0-4200-82d8-bd9eab30bf3b tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:52.980999 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b908de39-98e0-4200-82d8-bd9eab30bf3b tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] [instance: 0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:52.988192 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b908de39-98e0-4200-82d8-bd9eab30bf3b tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:52.988779 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b908de39-98e0-4200-82d8-bd9eab30bf3b tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:52.989317 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b908de39-98e0-4200-82d8-bd9eab30bf3b tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:52.990215 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b908de39-98e0-4200-82d8-bd9eab30bf3b tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:52.990829 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b908de39-98e0-4200-82d8-bd9eab30bf3b tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:52.991258 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b908de39-98e0-4200-82d8-bd9eab30bf3b tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:53.076525 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b908de39-98e0-4200-82d8-bd9eab30bf3b tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:53.086072 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b908de39-98e0-4200-82d8-bd9eab30bf3b tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:53.087899 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b908de39-98e0-4200-82d8-bd9eab30bf3b tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:53.089513 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b908de39-98e0-4200-82d8-bd9eab30bf3b tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] 10.222.0.60 "GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1" status: 200 len: 1371 microversion: 2.47 time: 0.115646 Oct 18 15:40:53.090169 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1824/3639] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:40:52 2022] GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1 => generated 1371 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:40:53.124143 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0a08f74c-9304-4846-b183-2ae10f8b3bd8 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb28fb6643847148fef67c0c775bf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2760d2db59084862abaedcc0a6a75046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:53.132760 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0a08f74c-9304-4846-b183-2ae10f8b3bd8 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] 10.222.0.60 "GET /compute/v2.1/servers/e63557bf-fd6b-4440-99ea-2cf6068000bb" status: 200 len: 1331 microversion: 2.1 time: 0.188547 Oct 18 15:40:53.133350 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1816/3640] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:52 2022] GET /compute/v2.1/servers/e63557bf-fd6b-4440-99ea-2cf6068000bb => generated 1331 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:53.183568 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-cca444c6-17f5-4047-8cd7-76efe9d1fee3 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:53.184186 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-cca444c6-17f5-4047-8cd7-76efe9d1fee3 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] [instance: f9620891-182f-40dd-8abe-42b8b0e1b758] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:53.190170 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cca444c6-17f5-4047-8cd7-76efe9d1fee3 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:53.190658 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cca444c6-17f5-4047-8cd7-76efe9d1fee3 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:53.191160 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cca444c6-17f5-4047-8cd7-76efe9d1fee3 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:53.192384 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cca444c6-17f5-4047-8cd7-76efe9d1fee3 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:53.192861 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cca444c6-17f5-4047-8cd7-76efe9d1fee3 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:53.193298 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cca444c6-17f5-4047-8cd7-76efe9d1fee3 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:53.208656 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=100 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:40:53.335562 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-cca444c6-17f5-4047-8cd7-76efe9d1fee3 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:53.342958 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-18e3df23-b15b-4beb-ad68-23cb0105bd06 req-91190dca-691f-4461-977e-fc08bab63738 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79212b18-bfd6-4a94-9d58-80c535525aa8", "tag": "65ddf63c-d787-42eb-bb1d-c107c1fe8b2f"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:40:53.343757 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-cca444c6-17f5-4047-8cd7-76efe9d1fee3 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers/f9620891-182f-40dd-8abe-42b8b0e1b758" status: 200 len: 1321 microversion: 2.1 time: 0.164014 Oct 18 15:40:53.351739 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1825/3641] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:53 2022] GET /compute/v2.1/servers/f9620891-182f-40dd-8abe-42b8b0e1b758 => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:53.359599 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-18e3df23-b15b-4beb-ad68-23cb0105bd06 req-91190dca-691f-4461-977e-fc08bab63738 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:53.360165 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-18e3df23-b15b-4beb-ad68-23cb0105bd06 req-91190dca-691f-4461-977e-fc08bab63738 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:53.360595 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-18e3df23-b15b-4beb-ad68-23cb0105bd06 req-91190dca-691f-4461-977e-fc08bab63738 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:53.374270 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-18e3df23-b15b-4beb-ad68-23cb0105bd06 req-91190dca-691f-4461-977e-fc08bab63738 service nova] Creating event network-changed:65ddf63c-d787-42eb-bb1d-c107c1fe8b2f for instance 79212b18-bfd6-4a94-9d58-80c535525aa8 on n-h2-853682-5 Oct 18 15:40:53.380757 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-18e3df23-b15b-4beb-ad68-23cb0105bd06 req-91190dca-691f-4461-977e-fc08bab63738 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041557 Oct 18 15:40:53.381149 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1817/3642] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:40:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:40:53.817764 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-046d9a0e-c9d0-4e03-8f1c-3279c1fcb4fa tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca81b459-dcbb-429f-a2f4-3a7cfcb81802"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:40:53.820421 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-046d9a0e-c9d0-4e03-8f1c-3279c1fcb4fa tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 4a23be5e-9334-4385-9476-4bbd81995002] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:53.826857 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-046d9a0e-c9d0-4e03-8f1c-3279c1fcb4fa tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:53.827117 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-046d9a0e-c9d0-4e03-8f1c-3279c1fcb4fa tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:53.827679 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-046d9a0e-c9d0-4e03-8f1c-3279c1fcb4fa tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:53.828735 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-046d9a0e-c9d0-4e03-8f1c-3279c1fcb4fa tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:53.829286 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-046d9a0e-c9d0-4e03-8f1c-3279c1fcb4fa tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:53.829780 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-046d9a0e-c9d0-4e03-8f1c-3279c1fcb4fa tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:53.916328 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-046d9a0e-c9d0-4e03-8f1c-3279c1fcb4fa tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] HTTP exception thrown: Invalid volume: volume ca81b459-dcbb-429f-a2f4-3a7cfcb81802 is already attached to instances: 4a23be5e-9334-4385-9476-4bbd81995002 Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-046d9a0e-c9d0-4e03-8f1c-3279c1fcb4fa tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Request method failure captured: Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: request: POST /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002/os-volume_attachments HTTP/1.1 Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 74 Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsfD3tyC5zBBCs3PM6SgagJOA9ytEd34lT9my352h69qxn0wNQWvVVVEceKNcLlE8Cld2E1ewLfFQUA6X-zyH4NCgXE9isdDnVpnJB5BT1ljNdC07pganRFql9FpScM1-Xjt5su1w2IBkP6ZVV1NsRclcY3oY_ScUp2DhZs2W7X1y8Y Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: a5b55fd6668b481b8c578983dc655785 Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-AttachVolumeNegativeTest-1298357771 Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a5b55fd6668b481b8c578983dc655785"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a5b55fd6668b481b8c578983dc655785"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a5b55fd6668b481b8c578983dc655785"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a5b55fd6668b481b8c578983dc655785"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-AttachVolumeNegativeTest-1298357771 Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: a5b55fd6668b481b8c578983dc655785 Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1298357771 Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-AttachVolumeNegativeTest-1298357771-project Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: efec3b4b5b1c46bd9d2c0efa68f86979 Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-AttachVolumeNegativeTest-1298357771-project Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: {"volumeAttachment": {"volumeId": "ca81b459-dcbb-429f-a2f4-3a7cfcb81802"}} Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: exception: Invalid volume: volume ca81b459-dcbb-429f-a2f4-3a7cfcb81802 is already attached to instances: 4a23be5e-9334-4385-9476-4bbd81995002 Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'server_id': '4a23be5e-9334-4385-9476-4bbd81995002', 'body': {'volumeAttachment': {'volumeId': 'ca81b459-dcbb-429f-a2f4-3a7cfcb81802'}}} Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ca81b459-dcbb-429f-a2f4-3a7cfcb81802 is already attached to instances: 4a23be5e-9334-4385-9476-4bbd81995002 Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:40:53.918402 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:40:53.925266 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:40:53.925266 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:40:53.925266 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 18 15:40:53.925266 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 18 15:40:53.925266 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ca81b459-dcbb-429f-a2f4-3a7cfcb81802 is already attached to instances: 4a23be5e-9334-4385-9476-4bbd81995002 Oct 18 15:40:53.925266 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:40:53.925266 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:40:53.925266 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:40:53.925266 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:40:53.925266 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:40:53.925266 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:40:53.925266 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:40:53.925266 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:40:53.925266 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ca81b459-dcbb-429f-a2f4-3a7cfcb81802 is already attached to instances: 4a23be5e-9334-4385-9476-4bbd81995002 Oct 18 15:40:53.925266 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:40:53.925266 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-046d9a0e-c9d0-4e03-8f1c-3279c1fcb4fa tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Returning 400 to user: Invalid volume: volume ca81b459-dcbb-429f-a2f4-3a7cfcb81802 is already attached to instances: 4a23be5e-9334-4385-9476-4bbd81995002 {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:40:53.925266 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-046d9a0e-c9d0-4e03-8f1c-3279c1fcb4fa tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "POST /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106108 Oct 18 15:40:53.925266 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1826/3643] 10.222.0.60 () {60 vars in 1323 bytes} [Tue Oct 18 15:40:53 2022] POST /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002/os-volume_attachments => generated 174 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:40:53.992876 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eb5c2da0-60ad-497f-9048-0d683bf20801 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:53.994116 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-eb5c2da0-60ad-497f-9048-0d683bf20801 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 4a23be5e-9334-4385-9476-4bbd81995002] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:54.001168 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb5c2da0-60ad-497f-9048-0d683bf20801 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:54.001660 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb5c2da0-60ad-497f-9048-0d683bf20801 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:54.002100 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb5c2da0-60ad-497f-9048-0d683bf20801 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:54.002801 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb5c2da0-60ad-497f-9048-0d683bf20801 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:54.003266 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb5c2da0-60ad-497f-9048-0d683bf20801 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:54.003736 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb5c2da0-60ad-497f-9048-0d683bf20801 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:54.087724 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-eb5c2da0-60ad-497f-9048-0d683bf20801 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lazy-loading 'services' on Instance uuid 4a23be5e-9334-4385-9476-4bbd81995002 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:40:54.115728 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5dde876e-8d58-4bb9-bc78-886e6c15cf4f tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:54.116436 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5dde876e-8d58-4bb9-bc78-886e6c15cf4f tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] [instance: 0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:54.124836 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5dde876e-8d58-4bb9-bc78-886e6c15cf4f tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:54.125660 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5dde876e-8d58-4bb9-bc78-886e6c15cf4f tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:54.126193 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5dde876e-8d58-4bb9-bc78-886e6c15cf4f tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:54.127010 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5dde876e-8d58-4bb9-bc78-886e6c15cf4f tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:54.127563 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5dde876e-8d58-4bb9-bc78-886e6c15cf4f tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:54.128079 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5dde876e-8d58-4bb9-bc78-886e6c15cf4f tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:54.172047 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-eb5c2da0-60ad-497f-9048-0d683bf20801 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002/os-volume_attachments/ca81b459-dcbb-429f-a2f4-3a7cfcb81802" status: 202 len: 0 microversion: 2.1 time: 0.183237 Oct 18 15:40:54.172898 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1818/3644] 10.222.0.60 () {58 vars in 1416 bytes} [Tue Oct 18 15:40:53 2022] DELETE /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002/os-volume_attachments/ca81b459-dcbb-429f-a2f4-3a7cfcb81802 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:40:54.189761 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cb7df703-085b-447a-8246-f3caa81cce0e tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:54.190548 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cb7df703-085b-447a-8246-f3caa81cce0e tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] [instance: e63557bf-fd6b-4440-99ea-2cf6068000bb] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:54.198694 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb7df703-085b-447a-8246-f3caa81cce0e tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:54.199188 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb7df703-085b-447a-8246-f3caa81cce0e tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:54.199678 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb7df703-085b-447a-8246-f3caa81cce0e tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:54.200592 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb7df703-085b-447a-8246-f3caa81cce0e tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:54.201262 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb7df703-085b-447a-8246-f3caa81cce0e tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:54.201856 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb7df703-085b-447a-8246-f3caa81cce0e tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:54.211695 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5dde876e-8d58-4bb9-bc78-886e6c15cf4f tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:54.224687 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5dde876e-8d58-4bb9-bc78-886e6c15cf4f tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:54.226241 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5dde876e-8d58-4bb9-bc78-886e6c15cf4f tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:54.228244 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5dde876e-8d58-4bb9-bc78-886e6c15cf4f tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] 10.222.0.60 "GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1" status: 200 len: 1371 microversion: 2.47 time: 0.117143 Oct 18 15:40:54.229184 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1827/3645] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:40:54 2022] GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1 => generated 1371 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:40:54.242946 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9c8ffc0d-0edb-451a-9338-3fda8059408d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:54.245594 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9c8ffc0d-0edb-451a-9338-3fda8059408d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 4a23be5e-9334-4385-9476-4bbd81995002] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:54.252720 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9c8ffc0d-0edb-451a-9338-3fda8059408d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:54.253147 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9c8ffc0d-0edb-451a-9338-3fda8059408d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:54.254134 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9c8ffc0d-0edb-451a-9338-3fda8059408d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:54.254998 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9c8ffc0d-0edb-451a-9338-3fda8059408d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:54.255464 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9c8ffc0d-0edb-451a-9338-3fda8059408d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:54.255896 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9c8ffc0d-0edb-451a-9338-3fda8059408d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:54.295500 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9c8ffc0d-0edb-451a-9338-3fda8059408d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064613 Oct 18 15:40:54.296544 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1828/3646] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 15:40:54 2022] GET /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:40:54.367852 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e4bd5863-1557-428b-8e77-0f38ec3bc4ff tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:54.368473 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e4bd5863-1557-428b-8e77-0f38ec3bc4ff tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] [instance: f9620891-182f-40dd-8abe-42b8b0e1b758] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:54.374741 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4bd5863-1557-428b-8e77-0f38ec3bc4ff tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:54.375229 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4bd5863-1557-428b-8e77-0f38ec3bc4ff tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:54.375671 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4bd5863-1557-428b-8e77-0f38ec3bc4ff tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:54.376374 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4bd5863-1557-428b-8e77-0f38ec3bc4ff tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:54.376888 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4bd5863-1557-428b-8e77-0f38ec3bc4ff tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:54.377318 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4bd5863-1557-428b-8e77-0f38ec3bc4ff tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:54.385335 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cb7df703-085b-447a-8246-f3caa81cce0e tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb28fb6643847148fef67c0c775bf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2760d2db59084862abaedcc0a6a75046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:54.393072 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cb7df703-085b-447a-8246-f3caa81cce0e tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] 10.222.0.60 "GET /compute/v2.1/servers/e63557bf-fd6b-4440-99ea-2cf6068000bb" status: 200 len: 1331 microversion: 2.1 time: 0.218776 Oct 18 15:40:54.393652 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1819/3647] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:54 2022] GET /compute/v2.1/servers/e63557bf-fd6b-4440-99ea-2cf6068000bb => generated 1331 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:54.518862 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e4bd5863-1557-428b-8e77-0f38ec3bc4ff tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:54.532525 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e4bd5863-1557-428b-8e77-0f38ec3bc4ff tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers/f9620891-182f-40dd-8abe-42b8b0e1b758" status: 200 len: 1321 microversion: 2.1 time: 0.169528 Oct 18 15:40:54.533175 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1829/3648] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:54 2022] GET /compute/v2.1/servers/f9620891-182f-40dd-8abe-42b8b0e1b758 => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:55.257082 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4d7b82d0-3d97-4c91-806f-245994b3c2d4 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:55.257625 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4d7b82d0-3d97-4c91-806f-245994b3c2d4 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] [instance: 0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:55.264661 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d7b82d0-3d97-4c91-806f-245994b3c2d4 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:55.265169 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d7b82d0-3d97-4c91-806f-245994b3c2d4 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:55.265600 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d7b82d0-3d97-4c91-806f-245994b3c2d4 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:55.266311 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d7b82d0-3d97-4c91-806f-245994b3c2d4 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:55.266759 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d7b82d0-3d97-4c91-806f-245994b3c2d4 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:55.267172 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d7b82d0-3d97-4c91-806f-245994b3c2d4 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:55.308575 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-eadc3099-2991-4960-8bf6-38fd6e706efa tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:55.311163 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-eadc3099-2991-4960-8bf6-38fd6e706efa tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 4a23be5e-9334-4385-9476-4bbd81995002] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:55.319548 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eadc3099-2991-4960-8bf6-38fd6e706efa tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:55.320588 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eadc3099-2991-4960-8bf6-38fd6e706efa tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:55.321714 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eadc3099-2991-4960-8bf6-38fd6e706efa tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:55.322463 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eadc3099-2991-4960-8bf6-38fd6e706efa tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:55.322922 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eadc3099-2991-4960-8bf6-38fd6e706efa tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:55.323473 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eadc3099-2991-4960-8bf6-38fd6e706efa tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:55.335275 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4d7b82d0-3d97-4c91-806f-245994b3c2d4 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:55.343978 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4d7b82d0-3d97-4c91-806f-245994b3c2d4 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:55.345469 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4d7b82d0-3d97-4c91-806f-245994b3c2d4 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:55.346651 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4d7b82d0-3d97-4c91-806f-245994b3c2d4 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] 10.222.0.60 "GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1" status: 200 len: 1371 microversion: 2.47 time: 0.093771 Oct 18 15:40:55.347737 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1820/3649] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:40:55 2022] GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1 => generated 1371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:40:55.357976 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-eadc3099-2991-4960-8bf6-38fd6e706efa tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053561 Oct 18 15:40:55.359108 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1830/3650] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 15:40:55 2022] GET /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:40:55.416765 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-68ada126-5fc8-41b4-bc3c-6ef7e2ec318c tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:55.417415 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-68ada126-5fc8-41b4-bc3c-6ef7e2ec318c tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] [instance: e63557bf-fd6b-4440-99ea-2cf6068000bb] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:55.423460 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68ada126-5fc8-41b4-bc3c-6ef7e2ec318c tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:55.423939 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68ada126-5fc8-41b4-bc3c-6ef7e2ec318c tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:55.424474 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68ada126-5fc8-41b4-bc3c-6ef7e2ec318c tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:55.425203 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68ada126-5fc8-41b4-bc3c-6ef7e2ec318c tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:55.425657 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68ada126-5fc8-41b4-bc3c-6ef7e2ec318c tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:55.426112 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68ada126-5fc8-41b4-bc3c-6ef7e2ec318c tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:55.555687 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8237b908-0ce1-432d-8a1f-d64eac5779f0 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:55.556638 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8237b908-0ce1-432d-8a1f-d64eac5779f0 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] [instance: f9620891-182f-40dd-8abe-42b8b0e1b758] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:55.563118 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8237b908-0ce1-432d-8a1f-d64eac5779f0 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:55.563595 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8237b908-0ce1-432d-8a1f-d64eac5779f0 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:55.564024 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8237b908-0ce1-432d-8a1f-d64eac5779f0 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:55.564954 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8237b908-0ce1-432d-8a1f-d64eac5779f0 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:55.565575 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8237b908-0ce1-432d-8a1f-d64eac5779f0 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:55.566001 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8237b908-0ce1-432d-8a1f-d64eac5779f0 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:55.566718 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-68ada126-5fc8-41b4-bc3c-6ef7e2ec318c tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb28fb6643847148fef67c0c775bf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2760d2db59084862abaedcc0a6a75046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:55.583869 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-68ada126-5fc8-41b4-bc3c-6ef7e2ec318c tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] 10.222.0.60 "GET /compute/v2.1/servers/e63557bf-fd6b-4440-99ea-2cf6068000bb" status: 200 len: 1534 microversion: 2.1 time: 0.171585 Oct 18 15:40:55.584567 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1821/3651] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:55 2022] GET /compute/v2.1/servers/e63557bf-fd6b-4440-99ea-2cf6068000bb => generated 1534 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:55.608275 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-37fe953c-2be9-4a0a-ac39-e8396c824db2 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Action: 'create', calling method: .version_select at 0x7f7c3c509310>, body: {"pool": "4e112f97-3f36-4641-bc49-22bf222d8b0f"} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:40:55.941022 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8237b908-0ce1-432d-8a1f-d64eac5779f0 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:55.950604 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8237b908-0ce1-432d-8a1f-d64eac5779f0 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers/f9620891-182f-40dd-8abe-42b8b0e1b758" status: 200 len: 1321 microversion: 2.1 time: 0.398909 Oct 18 15:40:55.960959 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1831/3652] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:55 2022] GET /compute/v2.1/servers/f9620891-182f-40dd-8abe-42b8b0e1b758 => generated 1321 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:40:55.966587 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-e1b54f74-e9e3-4119-9dea-e82938c2615f req-d810c9e0-b80f-4e43-8c25-4fac07cf86b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9620891-182f-40dd-8abe-42b8b0e1b758", "name": "network-vif-plugged", "status": "completed", "tag": "6177bb79-9152-412b-b0d6-f6e1d447d283"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:40:55.980651 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-e1b54f74-e9e3-4119-9dea-e82938c2615f req-d810c9e0-b80f-4e43-8c25-4fac07cf86b0 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:55.981535 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-e1b54f74-e9e3-4119-9dea-e82938c2615f req-d810c9e0-b80f-4e43-8c25-4fac07cf86b0 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:55.982132 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-e1b54f74-e9e3-4119-9dea-e82938c2615f req-d810c9e0-b80f-4e43-8c25-4fac07cf86b0 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:55.994625 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-e1b54f74-e9e3-4119-9dea-e82938c2615f req-d810c9e0-b80f-4e43-8c25-4fac07cf86b0 service nova] Creating event network-vif-plugged:6177bb79-9152-412b-b0d6-f6e1d447d283 for instance f9620891-182f-40dd-8abe-42b8b0e1b758 on n-h1-853682-5 Oct 18 15:40:55.999504 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-e1b54f74-e9e3-4119-9dea-e82938c2615f req-d810c9e0-b80f-4e43-8c25-4fac07cf86b0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037099 Oct 18 15:40:56.000180 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1832/3653] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:40:56.372887 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d8707dda-9843-45a1-b7d8-490fea6ce9de tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:56.375878 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d8707dda-9843-45a1-b7d8-490fea6ce9de tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 4a23be5e-9334-4385-9476-4bbd81995002] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:56.382332 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d8707dda-9843-45a1-b7d8-490fea6ce9de tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:56.382845 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d8707dda-9843-45a1-b7d8-490fea6ce9de tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:56.383241 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d8707dda-9843-45a1-b7d8-490fea6ce9de tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:56.384124 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d8707dda-9843-45a1-b7d8-490fea6ce9de tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:56.384579 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d8707dda-9843-45a1-b7d8-490fea6ce9de tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:56.385012 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d8707dda-9843-45a1-b7d8-490fea6ce9de tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:56.417739 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d8707dda-9843-45a1-b7d8-490fea6ce9de tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050326 Oct 18 15:40:56.418545 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1833/3654] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 15:40:56 2022] GET /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:40:56.427879 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5e40c874-e52a-4b06-b683-674c0d84dcd9 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:56.428496 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5e40c874-e52a-4b06-b683-674c0d84dcd9 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] [instance: 0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:56.434726 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5e40c874-e52a-4b06-b683-674c0d84dcd9 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:56.435209 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5e40c874-e52a-4b06-b683-674c0d84dcd9 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:56.435641 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5e40c874-e52a-4b06-b683-674c0d84dcd9 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:56.436333 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5e40c874-e52a-4b06-b683-674c0d84dcd9 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:56.436782 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5e40c874-e52a-4b06-b683-674c0d84dcd9 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:56.437230 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5e40c874-e52a-4b06-b683-674c0d84dcd9 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:56.519061 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5e40c874-e52a-4b06-b683-674c0d84dcd9 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:56.529538 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5e40c874-e52a-4b06-b683-674c0d84dcd9 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:56.530978 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5e40c874-e52a-4b06-b683-674c0d84dcd9 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:56.532157 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5e40c874-e52a-4b06-b683-674c0d84dcd9 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] 10.222.0.60 "GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1" status: 200 len: 1371 microversion: 2.47 time: 0.108292 Oct 18 15:40:56.532711 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1834/3655] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:40:56 2022] GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1 => generated 1371 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:40:56.976875 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b953a404-59a3-4433-bed2-82e3f93bffbd tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:56.977688 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b953a404-59a3-4433-bed2-82e3f93bffbd tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] [instance: f9620891-182f-40dd-8abe-42b8b0e1b758] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:56.985910 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b953a404-59a3-4433-bed2-82e3f93bffbd tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:56.986542 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b953a404-59a3-4433-bed2-82e3f93bffbd tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:56.987271 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b953a404-59a3-4433-bed2-82e3f93bffbd tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:56.988592 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b953a404-59a3-4433-bed2-82e3f93bffbd tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:56.989435 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b953a404-59a3-4433-bed2-82e3f93bffbd tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:56.990392 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b953a404-59a3-4433-bed2-82e3f93bffbd tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:57.048847 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-37fe953c-2be9-4a0a-ac39-e8396c824db2 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] 10.222.0.60 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.444351 Oct 18 15:40:57.054856 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1822/3656] 10.222.0.60 () {60 vars in 1170 bytes} [Tue Oct 18 15:40:55 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:40:57.061816 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-99dd2daf-b150-469f-aeac-4e11282f771d tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.4.85"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:40:57.064611 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-99dd2daf-b150-469f-aeac-4e11282f771d tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] [instance: e63557bf-fd6b-4440-99ea-2cf6068000bb] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:57.073247 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99dd2daf-b150-469f-aeac-4e11282f771d tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:57.073744 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99dd2daf-b150-469f-aeac-4e11282f771d tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:57.074210 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99dd2daf-b150-469f-aeac-4e11282f771d tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:57.075170 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99dd2daf-b150-469f-aeac-4e11282f771d tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:57.075772 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99dd2daf-b150-469f-aeac-4e11282f771d tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:57.076217 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99dd2daf-b150-469f-aeac-4e11282f771d tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:57.103302 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99dd2daf-b150-469f-aeac-4e11282f771d tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Acquiring lock "refresh_cache-e63557bf-fd6b-4440-99ea-2cf6068000bb" {{(pid=120406) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 18 15:40:57.103620 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99dd2daf-b150-469f-aeac-4e11282f771d tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Acquired lock "refresh_cache-e63557bf-fd6b-4440-99ea-2cf6068000bb" {{(pid=120406) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 18 15:40:57.183407 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b953a404-59a3-4433-bed2-82e3f93bffbd tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:57.192755 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b953a404-59a3-4433-bed2-82e3f93bffbd tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers/f9620891-182f-40dd-8abe-42b8b0e1b758" status: 200 len: 1321 microversion: 2.1 time: 0.222005 Oct 18 15:40:57.193555 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1835/3657] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:56 2022] GET /compute/v2.1/servers/f9620891-182f-40dd-8abe-42b8b0e1b758 => generated 1321 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:40:57.431868 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-037ce97b-260c-42ab-abbe-1296cae1ca29 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:57.435482 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-037ce97b-260c-42ab-abbe-1296cae1ca29 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 4a23be5e-9334-4385-9476-4bbd81995002] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:57.445520 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-037ce97b-260c-42ab-abbe-1296cae1ca29 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:57.446368 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-037ce97b-260c-42ab-abbe-1296cae1ca29 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:57.447197 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-037ce97b-260c-42ab-abbe-1296cae1ca29 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:57.449045 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-037ce97b-260c-42ab-abbe-1296cae1ca29 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:57.449825 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-037ce97b-260c-42ab-abbe-1296cae1ca29 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:57.450270 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-037ce97b-260c-42ab-abbe-1296cae1ca29 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:57.491958 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-037ce97b-260c-42ab-abbe-1296cae1ca29 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065174 Oct 18 15:40:57.492557 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1836/3658] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 15:40:57 2022] GET /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:40:57.560094 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2d5b1a5e-1b38-4829-9aa3-723e8d81cd23 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:57.560698 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2d5b1a5e-1b38-4829-9aa3-723e8d81cd23 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] [instance: 0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:57.568798 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d5b1a5e-1b38-4829-9aa3-723e8d81cd23 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:57.569499 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d5b1a5e-1b38-4829-9aa3-723e8d81cd23 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:57.570146 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d5b1a5e-1b38-4829-9aa3-723e8d81cd23 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:57.570869 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d5b1a5e-1b38-4829-9aa3-723e8d81cd23 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:57.571332 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d5b1a5e-1b38-4829-9aa3-723e8d81cd23 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:57.571763 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d5b1a5e-1b38-4829-9aa3-723e8d81cd23 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:57.905781 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2d5b1a5e-1b38-4829-9aa3-723e8d81cd23 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:57.918010 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2d5b1a5e-1b38-4829-9aa3-723e8d81cd23 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:57.926888 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2d5b1a5e-1b38-4829-9aa3-723e8d81cd23 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:57.928218 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2d5b1a5e-1b38-4829-9aa3-723e8d81cd23 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] 10.222.0.60 "GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1" status: 200 len: 1371 microversion: 2.47 time: 0.373161 Oct 18 15:40:57.931971 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1837/3659] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:40:57 2022] GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1 => generated 1371 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:40:58.215934 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8d64e1d2-3977-4ce7-8cb0-c9342853cff3 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:58.216470 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8d64e1d2-3977-4ce7-8cb0-c9342853cff3 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] [instance: f9620891-182f-40dd-8abe-42b8b0e1b758] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:58.224288 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8d64e1d2-3977-4ce7-8cb0-c9342853cff3 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:58.224780 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8d64e1d2-3977-4ce7-8cb0-c9342853cff3 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:58.225456 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8d64e1d2-3977-4ce7-8cb0-c9342853cff3 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:58.225977 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8d64e1d2-3977-4ce7-8cb0-c9342853cff3 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:58.226433 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8d64e1d2-3977-4ce7-8cb0-c9342853cff3 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:58.226883 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8d64e1d2-3977-4ce7-8cb0-c9342853cff3 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:58.460520 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8d64e1d2-3977-4ce7-8cb0-c9342853cff3 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:58.470374 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8d64e1d2-3977-4ce7-8cb0-c9342853cff3 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers/f9620891-182f-40dd-8abe-42b8b0e1b758" status: 200 len: 1321 microversion: 2.1 time: 0.258460 Oct 18 15:40:58.470918 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1838/3660] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:58 2022] GET /compute/v2.1/servers/f9620891-182f-40dd-8abe-42b8b0e1b758 => generated 1321 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:40:58.503566 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f8f76d6c-aced-4ca4-9acd-1abda6abb792 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:58.505791 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f8f76d6c-aced-4ca4-9acd-1abda6abb792 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 4a23be5e-9334-4385-9476-4bbd81995002] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:58.512128 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f8f76d6c-aced-4ca4-9acd-1abda6abb792 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:58.512620 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f8f76d6c-aced-4ca4-9acd-1abda6abb792 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:58.513082 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f8f76d6c-aced-4ca4-9acd-1abda6abb792 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:58.513779 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f8f76d6c-aced-4ca4-9acd-1abda6abb792 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:58.514233 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f8f76d6c-aced-4ca4-9acd-1abda6abb792 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:58.514659 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f8f76d6c-aced-4ca4-9acd-1abda6abb792 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:58.547336 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f8f76d6c-aced-4ca4-9acd-1abda6abb792 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047648 Oct 18 15:40:58.547915 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1839/3661] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 15:40:58 2022] GET /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:40:58.852212 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-99dd2daf-b150-469f-aeac-4e11282f771d tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] [instance: e63557bf-fd6b-4440-99ea-2cf6068000bb] Building network info cache for instance {{(pid=120406) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}} Oct 18 15:40:58.860201 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-0f1dac69-9def-4a95-8484-9b5a693562d6 req-965570f4-218a-4eed-9888-843651a10cf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e63557bf-fd6b-4440-99ea-2cf6068000bb", "tag": "78218976-d29b-4087-9660-b6926a2369ec"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:40:58.871831 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-0f1dac69-9def-4a95-8484-9b5a693562d6 req-965570f4-218a-4eed-9888-843651a10cf8 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:58.872312 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-0f1dac69-9def-4a95-8484-9b5a693562d6 req-965570f4-218a-4eed-9888-843651a10cf8 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:58.872743 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-0f1dac69-9def-4a95-8484-9b5a693562d6 req-965570f4-218a-4eed-9888-843651a10cf8 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:58.887802 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-0f1dac69-9def-4a95-8484-9b5a693562d6 req-965570f4-218a-4eed-9888-843651a10cf8 service nova] Creating event network-changed:78218976-d29b-4087-9660-b6926a2369ec for instance e63557bf-fd6b-4440-99ea-2cf6068000bb on n-h1-853682-5 Oct 18 15:40:58.893012 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-0f1dac69-9def-4a95-8484-9b5a693562d6 req-965570f4-218a-4eed-9888-843651a10cf8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036328 Oct 18 15:40:58.893944 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1840/3662] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:40:58.957677 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-06259be7-2964-4678-8e6f-1b1d11924c7b tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:58.958582 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-06259be7-2964-4678-8e6f-1b1d11924c7b tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] [instance: 0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:58.966898 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-06259be7-2964-4678-8e6f-1b1d11924c7b tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:58.967541 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-06259be7-2964-4678-8e6f-1b1d11924c7b tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:58.968449 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-06259be7-2964-4678-8e6f-1b1d11924c7b tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:58.969349 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-06259be7-2964-4678-8e6f-1b1d11924c7b tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:58.969915 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-06259be7-2964-4678-8e6f-1b1d11924c7b tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:58.970445 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-06259be7-2964-4678-8e6f-1b1d11924c7b tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:59.057770 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-06259be7-2964-4678-8e6f-1b1d11924c7b tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:59.069580 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-06259be7-2964-4678-8e6f-1b1d11924c7b tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:59.071745 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-06259be7-2964-4678-8e6f-1b1d11924c7b tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:59.073082 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-06259be7-2964-4678-8e6f-1b1d11924c7b tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] 10.222.0.60 "GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1" status: 200 len: 1356 microversion: 2.47 time: 0.121161 Oct 18 15:40:59.081098 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1841/3663] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:40:58 2022] GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1 => generated 1356 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:40:59.105700 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4477e9e9-337d-4a0e-9de7-82f7c8ea8367 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:59.111989 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4477e9e9-337d-4a0e-9de7-82f7c8ea8367 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:59.114118 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4477e9e9-337d-4a0e-9de7-82f7c8ea8367 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Searching by: {'deleted': False, 'project_id': '6a5421df89db4d36a164f2d9f5c27803'} {{(pid=120405) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 15:40:59.120637 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4477e9e9-337d-4a0e-9de7-82f7c8ea8367 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:59.121299 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4477e9e9-337d-4a0e-9de7-82f7c8ea8367 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:59.122874 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4477e9e9-337d-4a0e-9de7-82f7c8ea8367 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:59.123475 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4477e9e9-337d-4a0e-9de7-82f7c8ea8367 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:59.124460 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4477e9e9-337d-4a0e-9de7-82f7c8ea8367 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:59.125097 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4477e9e9-337d-4a0e-9de7-82f7c8ea8367 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:59.248788 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.multi_cell_list [None req-4477e9e9-337d-4a0e-9de7-82f7c8ea8367 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120405) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 15:40:59.329510 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4477e9e9-337d-4a0e-9de7-82f7c8ea8367 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:59.336300 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4477e9e9-337d-4a0e-9de7-82f7c8ea8367 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:59.336911 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4477e9e9-337d-4a0e-9de7-82f7c8ea8367 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:59.337247 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4477e9e9-337d-4a0e-9de7-82f7c8ea8367 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:59.339309 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=100 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:40:59.349955 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4477e9e9-337d-4a0e-9de7-82f7c8ea8367 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:59.351408 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4477e9e9-337d-4a0e-9de7-82f7c8ea8367 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:40:59.406445 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4477e9e9-337d-4a0e-9de7-82f7c8ea8367 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] 10.222.0.60 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.305478 Oct 18 15:40:59.407261 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1842/3664] 10.222.0.60 () {60 vars in 1187 bytes} [Tue Oct 18 15:40:59 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:40:59.443198 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0a717b0c-05ed-4766-bec7-5d7fc24aa13a tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:59.443700 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0a717b0c-05ed-4766-bec7-5d7fc24aa13a tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] [instance: 0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:59.450986 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0a717b0c-05ed-4766-bec7-5d7fc24aa13a tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:59.451990 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0a717b0c-05ed-4766-bec7-5d7fc24aa13a tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:59.452432 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0a717b0c-05ed-4766-bec7-5d7fc24aa13a tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:59.454438 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0a717b0c-05ed-4766-bec7-5d7fc24aa13a tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:59.455090 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0a717b0c-05ed-4766-bec7-5d7fc24aa13a tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:59.455521 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0a717b0c-05ed-4766-bec7-5d7fc24aa13a tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:59.483056 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0a717b0c-05ed-4766-bec7-5d7fc24aa13a tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] [instance: 0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:40:59.570615 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0a717b0c-05ed-4766-bec7-5d7fc24aa13a tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] 10.222.0.60 "DELETE /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1" status: 204 len: 0 microversion: 2.47 time: 0.133264 Oct 18 15:40:59.571480 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1843/3665] 10.222.0.60 () {60 vars in 1280 bytes} [Tue Oct 18 15:40:59 2022] DELETE /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 18 15:40:59.579113 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-90774008-06e3-4ed6-a524-45e0bf532aa1 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:59.580362 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-90774008-06e3-4ed6-a524-45e0bf532aa1 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] [instance: f9620891-182f-40dd-8abe-42b8b0e1b758] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:59.587067 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-90774008-06e3-4ed6-a524-45e0bf532aa1 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:59.587852 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-90774008-06e3-4ed6-a524-45e0bf532aa1 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:59.593347 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-90774008-06e3-4ed6-a524-45e0bf532aa1 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:59.594384 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-90774008-06e3-4ed6-a524-45e0bf532aa1 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:59.594865 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-90774008-06e3-4ed6-a524-45e0bf532aa1 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:59.595304 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-90774008-06e3-4ed6-a524-45e0bf532aa1 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:59.911224 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-99dd2daf-b150-469f-aeac-4e11282f771d tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] [instance: e63557bf-fd6b-4440-99ea-2cf6068000bb] Updating instance_info_cache with network_info: [{"id": "78218976-d29b-4087-9660-b6926a2369ec", "address": "fa:16:3e:40:83:19", "network": {"id": "c4c769f1-83e0-43c5-9669-9ee0cf4f730a", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-632061887-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "2760d2db59084862abaedcc0a6a75046", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap78218976-d2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120406) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 18 15:40:59.929674 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99dd2daf-b150-469f-aeac-4e11282f771d tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Releasing lock "refresh_cache-e63557bf-fd6b-4440-99ea-2cf6068000bb" {{(pid=120406) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 18 15:40:59.930839 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-99dd2daf-b150-469f-aeac-4e11282f771d tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] 10.222.0.60 "POST /compute/v2.1/servers/e63557bf-fd6b-4440-99ea-2cf6068000bb/action" status: 202 len: 0 microversion: 2.1 time: 2.873008 Oct 18 15:40:59.931633 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1823/3666] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:40:57 2022] POST /compute/v2.1/servers/e63557bf-fd6b-4440-99ea-2cf6068000bb/action => generated 0 bytes in 2874 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 18 15:40:59.937096 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c63b42ac-ed09-4af8-a60b-ec9e8bcd11cd tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:40:59.939533 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c63b42ac-ed09-4af8-a60b-ec9e8bcd11cd tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 4a23be5e-9334-4385-9476-4bbd81995002] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:40:59.946122 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c63b42ac-ed09-4af8-a60b-ec9e8bcd11cd tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:59.946839 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c63b42ac-ed09-4af8-a60b-ec9e8bcd11cd tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:59.947445 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c63b42ac-ed09-4af8-a60b-ec9e8bcd11cd tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:59.948350 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c63b42ac-ed09-4af8-a60b-ec9e8bcd11cd tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:40:59.949280 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c63b42ac-ed09-4af8-a60b-ec9e8bcd11cd tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:40:59.949874 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c63b42ac-ed09-4af8-a60b-ec9e8bcd11cd tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:40:59.987436 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c63b42ac-ed09-4af8-a60b-ec9e8bcd11cd tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054542 Oct 18 15:40:59.988231 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1824/3667] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 15:40:59 2022] GET /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:41:00.001254 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a21dc392-642a-45b7-b28f-979cbeb5828b tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:00.001927 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a21dc392-642a-45b7-b28f-979cbeb5828b tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] [instance: 0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:00.009798 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a21dc392-642a-45b7-b28f-979cbeb5828b tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:00.010293 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a21dc392-642a-45b7-b28f-979cbeb5828b tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:00.010729 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a21dc392-642a-45b7-b28f-979cbeb5828b tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:00.011468 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a21dc392-642a-45b7-b28f-979cbeb5828b tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:00.011928 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a21dc392-642a-45b7-b28f-979cbeb5828b tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:00.012367 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a21dc392-642a-45b7-b28f-979cbeb5828b tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:00.038821 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-90774008-06e3-4ed6-a524-45e0bf532aa1 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:00.046656 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-90774008-06e3-4ed6-a524-45e0bf532aa1 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers/f9620891-182f-40dd-8abe-42b8b0e1b758" status: 200 len: 1321 microversion: 2.1 time: 0.472526 Oct 18 15:41:00.047458 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1844/3668] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:40:59 2022] GET /compute/v2.1/servers/f9620891-182f-40dd-8abe-42b8b0e1b758 => generated 1321 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:00.068022 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-155a73c2-2258-4fd5-8b3a-c9159a71f6ee tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Action: 'create', calling method: .version_select at 0x7f7c3d005550>, body: {"pool": "4e112f97-3f36-4641-bc49-22bf222d8b0f"} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:41:00.155747 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a21dc392-642a-45b7-b28f-979cbeb5828b tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:00.165408 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a21dc392-642a-45b7-b28f-979cbeb5828b tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:00.166830 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a21dc392-642a-45b7-b28f-979cbeb5828b tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:00.168031 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a21dc392-642a-45b7-b28f-979cbeb5828b tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] 10.222.0.60 "GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1" status: 200 len: 1362 microversion: 2.47 time: 0.178530 Oct 18 15:41:00.168604 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1825/3669] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:40:59 2022] GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1 => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:41:00.179229 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3710e354-1f94-49c0-b4e7-77e3c43b2916 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:00.179742 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3710e354-1f94-49c0-b4e7-77e3c43b2916 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 4a23be5e-9334-4385-9476-4bbd81995002] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:00.190752 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3710e354-1f94-49c0-b4e7-77e3c43b2916 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:00.191245 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3710e354-1f94-49c0-b4e7-77e3c43b2916 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:00.191729 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3710e354-1f94-49c0-b4e7-77e3c43b2916 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:00.192437 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3710e354-1f94-49c0-b4e7-77e3c43b2916 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:00.192951 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3710e354-1f94-49c0-b4e7-77e3c43b2916 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:00.193374 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3710e354-1f94-49c0-b4e7-77e3c43b2916 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:00.222523 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3710e354-1f94-49c0-b4e7-77e3c43b2916 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 4a23be5e-9334-4385-9476-4bbd81995002] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:41:00.273585 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:41:00.323610 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3710e354-1f94-49c0-b4e7-77e3c43b2916 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002" status: 204 len: 0 microversion: 2.1 time: 0.153192 Oct 18 15:41:00.324288 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1826/3670] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:41:00 2022] DELETE /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:41:00.334707 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-01ebba26-f1a9-49c2-86a5-b432ccfaa877 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:00.335431 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-01ebba26-f1a9-49c2-86a5-b432ccfaa877 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 4a23be5e-9334-4385-9476-4bbd81995002] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:00.341425 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01ebba26-f1a9-49c2-86a5-b432ccfaa877 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:00.341919 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01ebba26-f1a9-49c2-86a5-b432ccfaa877 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:00.342355 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01ebba26-f1a9-49c2-86a5-b432ccfaa877 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:00.343058 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01ebba26-f1a9-49c2-86a5-b432ccfaa877 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:00.343519 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01ebba26-f1a9-49c2-86a5-b432ccfaa877 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:00.343948 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01ebba26-f1a9-49c2-86a5-b432ccfaa877 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:00.589481 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-01ebba26-f1a9-49c2-86a5-b432ccfaa877 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:00.597232 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-01ebba26-f1a9-49c2-86a5-b432ccfaa877 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002" status: 200 len: 1681 microversion: 2.1 time: 0.267558 Oct 18 15:41:00.597801 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1827/3671] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:00 2022] GET /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002 => generated 1681 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:01.070470 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f4093b30-704d-49f0-8af3-492af4b6e5c4 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:01.071083 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f4093b30-704d-49f0-8af3-492af4b6e5c4 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] [instance: f9620891-182f-40dd-8abe-42b8b0e1b758] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:01.077018 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4093b30-704d-49f0-8af3-492af4b6e5c4 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:01.077500 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4093b30-704d-49f0-8af3-492af4b6e5c4 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:01.077932 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4093b30-704d-49f0-8af3-492af4b6e5c4 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:01.078884 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4093b30-704d-49f0-8af3-492af4b6e5c4 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:01.079336 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4093b30-704d-49f0-8af3-492af4b6e5c4 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:01.079758 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4093b30-704d-49f0-8af3-492af4b6e5c4 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:01.306822 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f4093b30-704d-49f0-8af3-492af4b6e5c4 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:01.314587 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f4093b30-704d-49f0-8af3-492af4b6e5c4 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers/f9620891-182f-40dd-8abe-42b8b0e1b758" status: 200 len: 1513 microversion: 2.1 time: 0.248141 Oct 18 15:41:01.315227 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1828/3672] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:01 2022] GET /compute/v2.1/servers/f9620891-182f-40dd-8abe-42b8b0e1b758 => generated 1513 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:01.320001 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-63b16a0d-54b7-44f1-8bb2-032701b4c896 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:01.320845 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-63b16a0d-54b7-44f1-8bb2-032701b4c896 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] [instance: 0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:01.326637 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63b16a0d-54b7-44f1-8bb2-032701b4c896 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:01.327121 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63b16a0d-54b7-44f1-8bb2-032701b4c896 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:01.327555 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63b16a0d-54b7-44f1-8bb2-032701b4c896 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:01.328513 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63b16a0d-54b7-44f1-8bb2-032701b4c896 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:01.329130 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63b16a0d-54b7-44f1-8bb2-032701b4c896 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:01.329566 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63b16a0d-54b7-44f1-8bb2-032701b4c896 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:01.420113 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-63b16a0d-54b7-44f1-8bb2-032701b4c896 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:01.428621 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-63b16a0d-54b7-44f1-8bb2-032701b4c896 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:01.430088 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-63b16a0d-54b7-44f1-8bb2-032701b4c896 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:01.431259 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-63b16a0d-54b7-44f1-8bb2-032701b4c896 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] 10.222.0.60 "GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1" status: 200 len: 1362 microversion: 2.47 time: 0.115120 Oct 18 15:41:01.431826 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1829/3673] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:41:01 2022] GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1 => generated 1362 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:41:01.436232 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4afa68bd-8e9e-4924-9573-5566ae921dad tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:01.436846 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4afa68bd-8e9e-4924-9573-5566ae921dad tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] [instance: bea3a8ec-d421-45b4-b6d8-397ac80c920d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:01.442622 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4afa68bd-8e9e-4924-9573-5566ae921dad tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:01.443131 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4afa68bd-8e9e-4924-9573-5566ae921dad tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:01.443563 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4afa68bd-8e9e-4924-9573-5566ae921dad tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:01.444250 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4afa68bd-8e9e-4924-9573-5566ae921dad tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:01.444701 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4afa68bd-8e9e-4924-9573-5566ae921dad tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:01.445150 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4afa68bd-8e9e-4924-9573-5566ae921dad tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:01.666982 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4afa68bd-8e9e-4924-9573-5566ae921dad tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:01.674767 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4afa68bd-8e9e-4924-9573-5566ae921dad tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers/bea3a8ec-d421-45b4-b6d8-397ac80c920d" status: 200 len: 1512 microversion: 2.1 time: 0.241952 Oct 18 15:41:01.675350 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1830/3674] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:01 2022] GET /compute/v2.1/servers/bea3a8ec-d421-45b4-b6d8-397ac80c920d => generated 1512 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:01.696277 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2369bc85-43e3-483d-a3ef-4cf99391e255 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:01.696920 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2369bc85-43e3-483d-a3ef-4cf99391e255 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 4a23be5e-9334-4385-9476-4bbd81995002] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:01.703350 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2369bc85-43e3-483d-a3ef-4cf99391e255 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:01.703998 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2369bc85-43e3-483d-a3ef-4cf99391e255 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:01.704436 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2369bc85-43e3-483d-a3ef-4cf99391e255 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:01.705166 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2369bc85-43e3-483d-a3ef-4cf99391e255 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:01.705616 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2369bc85-43e3-483d-a3ef-4cf99391e255 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:01.706039 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2369bc85-43e3-483d-a3ef-4cf99391e255 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:01.969824 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2369bc85-43e3-483d-a3ef-4cf99391e255 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:01.978630 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2369bc85-43e3-483d-a3ef-4cf99391e255 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002" status: 200 len: 1681 microversion: 2.1 time: 0.286128 Oct 18 15:41:01.979270 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1831/3675] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:01 2022] GET /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002 => generated 1681 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:01.979448 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-155a73c2-2258-4fd5-8b3a-c9159a71f6ee tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] 10.222.0.60 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 1.915892 Oct 18 15:41:01.980724 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1845/3676] 10.222.0.60 () {60 vars in 1170 bytes} [Tue Oct 18 15:41:00 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 1933 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:41:01.993467 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-85bf3232-430d-4b33-8b7a-a2ed3665e531 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:01.994088 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-85bf3232-430d-4b33-8b7a-a2ed3665e531 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] [instance: 568f29d6-ddaf-4515-84dd-7cdab0922c97] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:01.998528 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-31811296-e274-494d-9017-5ec10730cecd tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.4.7"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:41:02.000620 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85bf3232-430d-4b33-8b7a-a2ed3665e531 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:02.001146 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85bf3232-430d-4b33-8b7a-a2ed3665e531 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:02.001367 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-31811296-e274-494d-9017-5ec10730cecd tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] [instance: e63557bf-fd6b-4440-99ea-2cf6068000bb] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:02.001577 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85bf3232-430d-4b33-8b7a-a2ed3665e531 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:02.002284 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85bf3232-430d-4b33-8b7a-a2ed3665e531 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:02.002745 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85bf3232-430d-4b33-8b7a-a2ed3665e531 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:02.003176 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85bf3232-430d-4b33-8b7a-a2ed3665e531 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:02.010028 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-31811296-e274-494d-9017-5ec10730cecd tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:02.010773 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-31811296-e274-494d-9017-5ec10730cecd tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:02.011275 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-31811296-e274-494d-9017-5ec10730cecd tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:02.012008 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-31811296-e274-494d-9017-5ec10730cecd tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:02.012464 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-31811296-e274-494d-9017-5ec10730cecd tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:02.013077 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-31811296-e274-494d-9017-5ec10730cecd tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:02.040066 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-31811296-e274-494d-9017-5ec10730cecd tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Acquiring lock "refresh_cache-e63557bf-fd6b-4440-99ea-2cf6068000bb" {{(pid=120405) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 18 15:41:02.040471 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-31811296-e274-494d-9017-5ec10730cecd tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Acquired lock "refresh_cache-e63557bf-fd6b-4440-99ea-2cf6068000bb" {{(pid=120405) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 18 15:41:02.310028 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-85bf3232-430d-4b33-8b7a-a2ed3665e531 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:02.320033 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-85bf3232-430d-4b33-8b7a-a2ed3665e531 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers/568f29d6-ddaf-4515-84dd-7cdab0922c97" status: 200 len: 1511 microversion: 2.1 time: 0.339718 Oct 18 15:41:02.320621 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1832/3677] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:01 2022] GET /compute/v2.1/servers/568f29d6-ddaf-4515-84dd-7cdab0922c97 => generated 1511 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:02.342764 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-391eca1d-4014-4daa-9dd0-a87315605239 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:02.348004 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-391eca1d-4014-4daa-9dd0-a87315605239 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:02.349004 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-391eca1d-4014-4daa-9dd0-a87315605239 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1'} {{(pid=120406) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 15:41:02.360549 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-391eca1d-4014-4daa-9dd0-a87315605239 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:02.361063 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-391eca1d-4014-4daa-9dd0-a87315605239 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:02.361530 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-391eca1d-4014-4daa-9dd0-a87315605239 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:02.362242 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-391eca1d-4014-4daa-9dd0-a87315605239 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:02.362691 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-391eca1d-4014-4daa-9dd0-a87315605239 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:02.363675 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-391eca1d-4014-4daa-9dd0-a87315605239 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:02.462783 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.multi_cell_list [None req-391eca1d-4014-4daa-9dd0-a87315605239 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120406) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 15:41:02.551667 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-391eca1d-4014-4daa-9dd0-a87315605239 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:02.562940 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-391eca1d-4014-4daa-9dd0-a87315605239 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:02.563394 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-391eca1d-4014-4daa-9dd0-a87315605239 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:02.563839 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-391eca1d-4014-4daa-9dd0-a87315605239 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:02.792331 n-d-853682-5 devstack@n-api.service[120405]: DEBUG neutronclient.v2_0.client [None req-31811296-e274-494d-9017-5ec10730cecd tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.4.7 (6c7d06c1-8e54-4acf-87d5-939fdd1b75f5) with port 78218976-d29b-4087-9660-b6926a2369ec using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 4e112f97-3f36-4641-bc49-22bf222d8b0f.", "detail": ""}} {{(pid=120405) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 15:41:02.792957 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-31811296-e274-494d-9017-5ec10730cecd tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Releasing lock "refresh_cache-e63557bf-fd6b-4440-99ea-2cf6068000bb" {{(pid=120405) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 18 15:41:02.793542 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-31811296-e274-494d-9017-5ec10730cecd tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] HTTP exception thrown: Cannot associate floating IP 172.25.4.7 (6c7d06c1-8e54-4acf-87d5-939fdd1b75f5) with port 78218976-d29b-4087-9660-b6926a2369ec using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 4e112f97-3f36-4641-bc49-22bf222d8b0f. Oct 18 15:41:02.793542 n-d-853682-5 devstack@n-api.service[120405]: Neutron server returns request_ids: ['req-a62ea8a7-db69-445b-93ed-2fac546b71c1'] Oct 18 15:41:02.795594 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-31811296-e274-494d-9017-5ec10730cecd tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Request method failure captured: Oct 18 15:41:02.795594 n-d-853682-5 devstack@n-api.service[120405]: request: POST /compute/v2.1/servers/e63557bf-fd6b-4440-99ea-2cf6068000bb/action HTTP/1.1 Oct 18 15:41:02.795594 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:41:02.795594 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:41:02.795594 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:41:02.795594 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 44 Oct 18 15:41:02.795594 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:41:02.795594 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:41:02.795594 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:41:02.795594 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:41:02.795594 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsjwQYkwCZOtmsqREzdw15yNvjO7LuDj1bNyNyIxzBYlRVv_xi1-2iq9mk0NVvpoXwrrZ-Mahl0d9IMayafE3OTZLW1nAuHfUmWJ_OxY-orJhFZYZu1g9r5smf1P6VtsKG676Qd7u-jv4J7kaekwT3blQF7sHB-dgabz1rC79FUmwvA Oct 18 15:41:02.795594 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:41:02.795594 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:41:02.795594 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:41:02.795594 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:41:02.795594 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:41:02.795594 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:41:02.795594 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 2760d2db59084862abaedcc0a6a75046 Oct 18 15:41:02.795594 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 Oct 18 15:41:02.795594 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:41:02.795594 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:41:02.795594 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2760d2db59084862abaedcc0a6a75046"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2760d2db59084862abaedcc0a6a75046"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2760d2db59084862abaedcc0a6a75046"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2760d2db59084862abaedcc0a6a75046"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:41:02.795594 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 Oct 18 15:41:02.795594 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 2760d2db59084862abaedcc0a6a75046 Oct 18 15:41:02.795594 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 Oct 18 15:41:02.795594 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project Oct 18 15:41:02.795594 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:41:02.795594 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:41:02.795594 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: dcb28fb6643847148fef67c0c775bf37 Oct 18 15:41:02.795594 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project Oct 18 15:41:02.795594 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:41:02.795594 n-d-853682-5 devstack@n-api.service[120405]: {"addFloatingIp": {"address": "172.25.4.7"}} Oct 18 15:41:02.795594 n-d-853682-5 devstack@n-api.service[120405]: method: Oct 18 15:41:02.795594 n-d-853682-5 devstack@n-api.service[120405]: exception: Cannot associate floating IP 172.25.4.7 (6c7d06c1-8e54-4acf-87d5-939fdd1b75f5) with port 78218976-d29b-4087-9660-b6926a2369ec using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 4e112f97-3f36-4641-bc49-22bf222d8b0f. Oct 18 15:41:02.795594 n-d-853682-5 devstack@n-api.service[120405]: Neutron server returns request_ids: ['req-a62ea8a7-db69-445b-93ed-2fac546b71c1'] Oct 18 15:41:02.795594 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'e63557bf-fd6b-4440-99ea-2cf6068000bb', 'body': {'addFloatingIp': {'address': '172.25.4.7'}}} Oct 18 15:41:02.795594 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:41:02.795594 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:02.795594 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2716, in associate_floating_ip Oct 18 15:41:02.795594 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 18 15:41:02.795594 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:41:02.795594 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:41:02.795594 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 18 15:41:02.795594 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 18 15:41:02.795594 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:41:02.795594 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:41:02.795594 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 18 15:41:02.795594 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 18 15:41:02.795594 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:41:02.795594 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:41:02.795594 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 18 15:41:02.795594 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 18 15:41:02.795594 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:41:02.795594 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:41:02.795594 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 15:41:02.795594 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 15:41:02.795594 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:41:02.795594 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:41:02.795594 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 15:41:02.795594 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 15:41:02.801075 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:41:02.801075 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:41:02.801075 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 15:41:02.801075 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 15:41:02.801075 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 15:41:02.801075 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 15:41:02.801075 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.4.7 (6c7d06c1-8e54-4acf-87d5-939fdd1b75f5) with port 78218976-d29b-4087-9660-b6926a2369ec using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 4e112f97-3f36-4641-bc49-22bf222d8b0f. Oct 18 15:41:02.801075 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a62ea8a7-db69-445b-93ed-2fac546b71c1'] Oct 18 15:41:02.801075 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:41:02.801075 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:41:02.801075 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:41:02.801075 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:02.801075 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 18 15:41:02.801075 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 18 15:41:02.801075 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 18 15:41:02.801075 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 18 15:41:02.801075 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2718, in associate_floating_ip Oct 18 15:41:02.801075 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 18 15:41:02.801075 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.4.7 (6c7d06c1-8e54-4acf-87d5-939fdd1b75f5) with port 78218976-d29b-4087-9660-b6926a2369ec using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 4e112f97-3f36-4641-bc49-22bf222d8b0f. Oct 18 15:41:02.801075 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a62ea8a7-db69-445b-93ed-2fac546b71c1'] Oct 18 15:41:02.801075 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:41:02.801075 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:41:02.801075 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:41:02.801075 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:02.801075 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:41:02.801075 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:41:02.801075 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:41:02.801075 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:41:02.801075 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:41:02.801075 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:41:02.801075 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:41:02.801075 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:41:02.801075 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:41:02.801075 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:41:02.801075 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 18 15:41:02.801075 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 18 15:41:02.801075 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.4.7 (6c7d06c1-8e54-4acf-87d5-939fdd1b75f5) with port 78218976-d29b-4087-9660-b6926a2369ec using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 4e112f97-3f36-4641-bc49-22bf222d8b0f. Oct 18 15:41:02.801075 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a62ea8a7-db69-445b-93ed-2fac546b71c1'] Oct 18 15:41:02.801075 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:41:02.801075 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:41:02.801075 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:41:02.801075 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:02.801075 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:41:02.801075 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:41:02.801075 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:41:02.801075 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:41:02.801075 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.4.7 (6c7d06c1-8e54-4acf-87d5-939fdd1b75f5) with port 78218976-d29b-4087-9660-b6926a2369ec using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 4e112f97-3f36-4641-bc49-22bf222d8b0f. Oct 18 15:41:02.801075 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a62ea8a7-db69-445b-93ed-2fac546b71c1'] Oct 18 15:41:02.801075 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:41:02.805105 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-31811296-e274-494d-9017-5ec10730cecd tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Returning 400 to user: Cannot associate floating IP 172.25.4.7 (6c7d06c1-8e54-4acf-87d5-939fdd1b75f5) with port 78218976-d29b-4087-9660-b6926a2369ec using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 4e112f97-3f36-4641-bc49-22bf222d8b0f. Oct 18 15:41:02.805105 n-d-853682-5 devstack@n-api.service[120405]: Neutron server returns request_ids: ['req-a62ea8a7-db69-445b-93ed-2fac546b71c1'] {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:41:02.805105 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-31811296-e274-494d-9017-5ec10730cecd tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] 10.222.0.60 "POST /compute/v2.1/servers/e63557bf-fd6b-4440-99ea-2cf6068000bb/action" status: 400 len: 379 microversion: 2.1 time: 0.807862 Oct 18 15:41:02.805105 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1846/3678] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:41:01 2022] POST /compute/v2.1/servers/e63557bf-fd6b-4440-99ea-2cf6068000bb/action => generated 379 bytes in 812 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:41:02.805474 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-52fd4412-cb94-43f3-a4c8-02c35406396f tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:02.806046 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-52fd4412-cb94-43f3-a4c8-02c35406396f tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] [instance: 0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:02.813266 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-52fd4412-cb94-43f3-a4c8-02c35406396f tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:02.813748 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-52fd4412-cb94-43f3-a4c8-02c35406396f tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:02.814180 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-52fd4412-cb94-43f3-a4c8-02c35406396f tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:02.814873 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-52fd4412-cb94-43f3-a4c8-02c35406396f tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:02.815322 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-52fd4412-cb94-43f3-a4c8-02c35406396f tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:02.815739 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-52fd4412-cb94-43f3-a4c8-02c35406396f tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:02.830077 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-52fd4412-cb94-43f3-a4c8-02c35406396f tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] HTTP exception thrown: Instance 0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1 could not be found. Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-52fd4412-cb94-43f3-a4c8-02c35406396f tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Request method failure captured: Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1 HTTP/1.1 Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsjSts0G7z5rIze_-SMAA-YmnDtb_5QbkMnk9QnLaPUtKte-8nqPDgR_eJCYrSCbMG8tei2Y4xNHMDQLVSEnzGd1uE0wFsZ2TSZbkdLzntu8WWj8s8c4eQA_XCm3Os_TvsvuTkqRz_2afhziptwR8fhGxKH-4Qb8ugCZr2WCTVXutYI Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: X-Openstack-Nova-Api-Version: 2.47 Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 6a5421df89db4d36a164f2d9f5c27803 Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServerShowV247Test-359106451 Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a5421df89db4d36a164f2d9f5c27803"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a5421df89db4d36a164f2d9f5c27803"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a5421df89db4d36a164f2d9f5c27803"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a5421df89db4d36a164f2d9f5c27803"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServerShowV247Test-359106451 Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 6a5421df89db4d36a164f2d9f5c27803 Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServerShowV247Test-359106451 Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServerShowV247Test-359106451-project Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 0253081420d048b9bacbaa3ae30ae331 Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServerShowV247Test-359106451-project Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1 could not be found. Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1'} Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1 could not be found. Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1 could not be found. Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:41:02.831613 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:41:02.837659 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:02.837659 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:41:02.837659 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:41:02.837659 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:41:02.837659 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:41:02.837659 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1 could not be found. Oct 18 15:41:02.837659 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:41:02.837659 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-52fd4412-cb94-43f3-a4c8-02c35406396f tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Returning 404 to user: Instance 0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:41:02.837659 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-52fd4412-cb94-43f3-a4c8-02c35406396f tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] 10.222.0.60 "GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1" status: 404 len: 111 microversion: 2.47 time: 0.031774 Oct 18 15:41:02.837659 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1847/3679] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:41:02 2022] GET /compute/v2.1/servers/0d17c1bc-e5d9-4819-a08b-2cf6f2be5fa1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:41:02.838504 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-038915cb-3656-4c05-a252-63d2aac1291d tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Calling method '.version_select at 0x7f7c3c610ee0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:02.860670 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-391eca1d-4014-4daa-9dd0-a87315605239 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1516 microversion: 2.1 time: 0.521688 Oct 18 15:41:02.861380 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1833/3680] 10.222.0.60 () {58 vars in 1167 bytes} [Tue Oct 18 15:41:02 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1516 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:41:02.866712 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-70ef72ec-5d1c-4f42-a0fb-59fef42714b6 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:02.867423 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-70ef72ec-5d1c-4f42-a0fb-59fef42714b6 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] [instance: 2e17d230-cb8b-4fc8-a10c-abed2322ed3b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:02.873621 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70ef72ec-5d1c-4f42-a0fb-59fef42714b6 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:02.874187 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70ef72ec-5d1c-4f42-a0fb-59fef42714b6 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:02.874726 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70ef72ec-5d1c-4f42-a0fb-59fef42714b6 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:02.875575 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70ef72ec-5d1c-4f42-a0fb-59fef42714b6 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:02.876102 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70ef72ec-5d1c-4f42-a0fb-59fef42714b6 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:02.876637 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70ef72ec-5d1c-4f42-a0fb-59fef42714b6 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:02.903212 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-70ef72ec-5d1c-4f42-a0fb-59fef42714b6 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] [instance: 2e17d230-cb8b-4fc8-a10c-abed2322ed3b] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:41:02.980882 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-70ef72ec-5d1c-4f42-a0fb-59fef42714b6 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] 10.222.0.60 "DELETE /compute/v2.1/servers/2e17d230-cb8b-4fc8-a10c-abed2322ed3b" status: 204 len: 0 microversion: 2.47 time: 0.118113 Oct 18 15:41:02.981682 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1834/3681] 10.222.0.60 () {60 vars in 1280 bytes} [Tue Oct 18 15:41:02 2022] DELETE /compute/v2.1/servers/2e17d230-cb8b-4fc8-a10c-abed2322ed3b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 15:41:02.986974 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7d79d0c6-12ba-48a2-a9e7-67f1d53d3d28 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:02.992908 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7d79d0c6-12ba-48a2-a9e7-67f1d53d3d28 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:02.993904 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7d79d0c6-12ba-48a2-a9e7-67f1d53d3d28 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1592337757', 'deleted': False, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1'} {{(pid=120406) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 15:41:02.999550 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d79d0c6-12ba-48a2-a9e7-67f1d53d3d28 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:03.000148 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d79d0c6-12ba-48a2-a9e7-67f1d53d3d28 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:03.000683 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d79d0c6-12ba-48a2-a9e7-67f1d53d3d28 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:03.001528 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d79d0c6-12ba-48a2-a9e7-67f1d53d3d28 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:03.002103 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d79d0c6-12ba-48a2-a9e7-67f1d53d3d28 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:03.002630 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d79d0c6-12ba-48a2-a9e7-67f1d53d3d28 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:03.095922 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.multi_cell_list [None req-7d79d0c6-12ba-48a2-a9e7-67f1d53d3d28 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120406) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 15:41:03.168870 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7d79d0c6-12ba-48a2-a9e7-67f1d53d3d28 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:03.174661 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d79d0c6-12ba-48a2-a9e7-67f1d53d3d28 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:03.175148 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d79d0c6-12ba-48a2-a9e7-67f1d53d3d28 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:03.175619 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d79d0c6-12ba-48a2-a9e7-67f1d53d3d28 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:03.613228 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7d79d0c6-12ba-48a2-a9e7-67f1d53d3d28 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1592337757" status: 200 len: 1515 microversion: 2.1 time: 0.629994 Oct 18 15:41:03.614125 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1835/3682] 10.222.0.60 () {58 vars in 1263 bytes} [Tue Oct 18 15:41:02 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1592337757 => generated 1515 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:03.620025 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b81f0c4d-170d-4e73-b0f5-9e23a16f1f2a tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:03.621167 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b81f0c4d-170d-4e73-b0f5-9e23a16f1f2a tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] [instance: 2e17d230-cb8b-4fc8-a10c-abed2322ed3b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:03.627538 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b81f0c4d-170d-4e73-b0f5-9e23a16f1f2a tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:03.628405 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b81f0c4d-170d-4e73-b0f5-9e23a16f1f2a tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:03.628926 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b81f0c4d-170d-4e73-b0f5-9e23a16f1f2a tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:03.629869 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b81f0c4d-170d-4e73-b0f5-9e23a16f1f2a tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:03.637790 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b81f0c4d-170d-4e73-b0f5-9e23a16f1f2a tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:03.638403 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b81f0c4d-170d-4e73-b0f5-9e23a16f1f2a tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:03.748645 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b81f0c4d-170d-4e73-b0f5-9e23a16f1f2a tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:03.757137 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b81f0c4d-170d-4e73-b0f5-9e23a16f1f2a tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:03.758632 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b81f0c4d-170d-4e73-b0f5-9e23a16f1f2a tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:03.759826 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b81f0c4d-170d-4e73-b0f5-9e23a16f1f2a tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] 10.222.0.60 "GET /compute/v2.1/servers/2e17d230-cb8b-4fc8-a10c-abed2322ed3b" status: 200 len: 1363 microversion: 2.47 time: 0.144563 Oct 18 15:41:03.760383 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1836/3683] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:41:03 2022] GET /compute/v2.1/servers/2e17d230-cb8b-4fc8-a10c-abed2322ed3b => generated 1363 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:41:03.764955 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5b7d183d-fb34-4995-a46f-74decc0a900b tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:03.765630 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5b7d183d-fb34-4995-a46f-74decc0a900b tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 4a23be5e-9334-4385-9476-4bbd81995002] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:03.773528 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5b7d183d-fb34-4995-a46f-74decc0a900b tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:03.774079 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5b7d183d-fb34-4995-a46f-74decc0a900b tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:03.774525 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5b7d183d-fb34-4995-a46f-74decc0a900b tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:03.775238 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5b7d183d-fb34-4995-a46f-74decc0a900b tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:03.775702 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5b7d183d-fb34-4995-a46f-74decc0a900b tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:03.776555 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5b7d183d-fb34-4995-a46f-74decc0a900b tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:03.865321 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5b7d183d-fb34-4995-a46f-74decc0a900b tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:03.873088 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5b7d183d-fb34-4995-a46f-74decc0a900b tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002" status: 200 len: 1613 microversion: 2.1 time: 0.111656 Oct 18 15:41:03.884587 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1837/3684] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:03 2022] GET /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002 => generated 1613 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:03.884587 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-641597c3-4394-480e-900b-a0796e034567 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:03.884587 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-641597c3-4394-480e-900b-a0796e034567 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:03.885129 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-641597c3-4394-480e-900b-a0796e034567 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1'} {{(pid=120406) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 15:41:03.893156 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-641597c3-4394-480e-900b-a0796e034567 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:03.893645 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-641597c3-4394-480e-900b-a0796e034567 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:03.894087 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-641597c3-4394-480e-900b-a0796e034567 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:03.895333 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-641597c3-4394-480e-900b-a0796e034567 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:03.895788 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-641597c3-4394-480e-900b-a0796e034567 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:03.896224 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-641597c3-4394-480e-900b-a0796e034567 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:03.997274 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.multi_cell_list [None req-641597c3-4394-480e-900b-a0796e034567 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120406) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 15:41:04.072744 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-641597c3-4394-480e-900b-a0796e034567 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:04.081488 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-641597c3-4394-480e-900b-a0796e034567 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:04.082572 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-641597c3-4394-480e-900b-a0796e034567 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:04.083029 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-641597c3-4394-480e-900b-a0796e034567 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:04.085483 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:41:04.531646 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-641597c3-4394-480e-900b-a0796e034567 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4519 microversion: 2.1 time: 0.656871 Oct 18 15:41:04.532291 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1838/3685] 10.222.0.60 () {58 vars in 1173 bytes} [Tue Oct 18 15:41:03 2022] GET /compute/v2.1/servers/detail?status=active => generated 4519 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:04.561524 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ceb9283f-2c2c-49fc-82d4-197417f4b962 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:04.567681 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ceb9283f-2c2c-49fc-82d4-197417f4b962 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:04.568487 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.compute.servers [None req-ceb9283f-2c2c-49fc-82d4-197417f4b962 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Removing options 'limit' from query {{(pid=120406) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 18 15:41:04.569466 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ceb9283f-2c2c-49fc-82d4-197417f4b962 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Searching by: {'deleted': False, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1'} {{(pid=120406) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 15:41:04.575083 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ceb9283f-2c2c-49fc-82d4-197417f4b962 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:04.575847 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ceb9283f-2c2c-49fc-82d4-197417f4b962 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:04.576282 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ceb9283f-2c2c-49fc-82d4-197417f4b962 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:04.577083 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ceb9283f-2c2c-49fc-82d4-197417f4b962 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:04.577715 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ceb9283f-2c2c-49fc-82d4-197417f4b962 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:04.578399 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ceb9283f-2c2c-49fc-82d4-197417f4b962 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:04.633893 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ceb9283f-2c2c-49fc-82d4-197417f4b962 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:04.639991 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ceb9283f-2c2c-49fc-82d4-197417f4b962 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:04.640475 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ceb9283f-2c2c-49fc-82d4-197417f4b962 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:04.640948 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ceb9283f-2c2c-49fc-82d4-197417f4b962 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:04.730640 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-038915cb-3656-4c05-a252-63d2aac1291d tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] 10.222.0.60 "DELETE /compute/v2.1/os-floating-ips/6c7d06c1-8e54-4acf-87d5-939fdd1b75f5" status: 202 len: 0 microversion: 2.1 time: 1.894090 Oct 18 15:41:04.731481 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1848/3686] 10.222.0.60 () {58 vars in 1263 bytes} [Tue Oct 18 15:41:02 2022] DELETE /compute/v2.1/os-floating-ips/6c7d06c1-8e54-4acf-87d5-939fdd1b75f5 => generated 0 bytes in 1897 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:41:04.738152 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-81580f7f-14f2-49e4-bf54-cb72913f1bf4 req-9a51a080-98b3-495e-bf8b-868b3332e366 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a23be5e-9334-4385-9476-4bbd81995002", "name": "network-vif-deleted", "tag": "4c591361-ce3f-4d4a-acbd-c51f7d0da6dc"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:41:04.750956 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-81580f7f-14f2-49e4-bf54-cb72913f1bf4 req-9a51a080-98b3-495e-bf8b-868b3332e366 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:04.751786 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-81580f7f-14f2-49e4-bf54-cb72913f1bf4 req-9a51a080-98b3-495e-bf8b-868b3332e366 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:04.752440 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-81580f7f-14f2-49e4-bf54-cb72913f1bf4 req-9a51a080-98b3-495e-bf8b-868b3332e366 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:04.765880 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-81580f7f-14f2-49e4-bf54-cb72913f1bf4 req-9a51a080-98b3-495e-bf8b-868b3332e366 service nova] Creating event network-vif-deleted:4c591361-ce3f-4d4a-acbd-c51f7d0da6dc for instance 4a23be5e-9334-4385-9476-4bbd81995002 on n-h2-853682-5 Oct 18 15:41:04.771627 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-81580f7f-14f2-49e4-bf54-cb72913f1bf4 req-9a51a080-98b3-495e-bf8b-868b3332e366 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037784 Oct 18 15:41:04.772317 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1849/3687] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:41:04.779961 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-97c09fa1-53f5-43df-aaf7-bc6040afd064 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.4.85"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:41:04.822559 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ceb9283f-2c2c-49fc-82d4-197417f4b962 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1662 microversion: 2.1 time: 0.265768 Oct 18 15:41:04.823616 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1839/3688] 10.222.0.60 () {58 vars in 1161 bytes} [Tue Oct 18 15:41:04 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1662 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:04.829682 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-afd6ec24-0e44-49c7-a364-08cef723e845 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:04.830646 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-afd6ec24-0e44-49c7-a364-08cef723e845 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] [instance: 2e17d230-cb8b-4fc8-a10c-abed2322ed3b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:04.842318 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-afd6ec24-0e44-49c7-a364-08cef723e845 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:04.843045 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-afd6ec24-0e44-49c7-a364-08cef723e845 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:04.843604 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-afd6ec24-0e44-49c7-a364-08cef723e845 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:04.845278 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-afd6ec24-0e44-49c7-a364-08cef723e845 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:04.845818 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-afd6ec24-0e44-49c7-a364-08cef723e845 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:04.846329 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-afd6ec24-0e44-49c7-a364-08cef723e845 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:04.931841 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-afd6ec24-0e44-49c7-a364-08cef723e845 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:04.943526 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-afd6ec24-0e44-49c7-a364-08cef723e845 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:04.945499 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-afd6ec24-0e44-49c7-a364-08cef723e845 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:04.946757 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-afd6ec24-0e44-49c7-a364-08cef723e845 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] 10.222.0.60 "GET /compute/v2.1/servers/2e17d230-cb8b-4fc8-a10c-abed2322ed3b" status: 200 len: 1363 microversion: 2.47 time: 0.121666 Oct 18 15:41:04.947399 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1840/3689] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:41:04 2022] GET /compute/v2.1/servers/2e17d230-cb8b-4fc8-a10c-abed2322ed3b => generated 1363 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:41:04.952230 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-13a89872-42a3-4d58-8a2a-d2d3cf696f23 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:04.959102 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-13a89872-42a3-4d58-8a2a-d2d3cf696f23 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:04.959895 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-13a89872-42a3-4d58-8a2a-d2d3cf696f23 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1'} {{(pid=120406) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 15:41:04.967526 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13a89872-42a3-4d58-8a2a-d2d3cf696f23 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:04.968287 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13a89872-42a3-4d58-8a2a-d2d3cf696f23 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:04.969183 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13a89872-42a3-4d58-8a2a-d2d3cf696f23 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:04.970212 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13a89872-42a3-4d58-8a2a-d2d3cf696f23 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:04.970776 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13a89872-42a3-4d58-8a2a-d2d3cf696f23 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:04.971334 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13a89872-42a3-4d58-8a2a-d2d3cf696f23 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:05.014360 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-97c09fa1-53f5-43df-aaf7-bc6040afd064 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] [instance: e63557bf-fd6b-4440-99ea-2cf6068000bb] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:05.021931 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97c09fa1-53f5-43df-aaf7-bc6040afd064 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:05.022477 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97c09fa1-53f5-43df-aaf7-bc6040afd064 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:05.022926 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97c09fa1-53f5-43df-aaf7-bc6040afd064 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:05.023644 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97c09fa1-53f5-43df-aaf7-bc6040afd064 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:05.024086 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97c09fa1-53f5-43df-aaf7-bc6040afd064 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:05.024506 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97c09fa1-53f5-43df-aaf7-bc6040afd064 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:05.068358 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.multi_cell_list [None req-13a89872-42a3-4d58-8a2a-d2d3cf696f23 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120406) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 15:41:05.129373 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-13a89872-42a3-4d58-8a2a-d2d3cf696f23 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.180483 Oct 18 15:41:05.130245 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1841/3690] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Oct 18 15:41:04 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:05.135309 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5c9c8a11-0f55-4037-92d8-cf0adbd54d60 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:05.136046 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5c9c8a11-0f55-4037-92d8-cf0adbd54d60 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 4a23be5e-9334-4385-9476-4bbd81995002] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:05.142554 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c9c8a11-0f55-4037-92d8-cf0adbd54d60 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:05.143044 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c9c8a11-0f55-4037-92d8-cf0adbd54d60 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:05.143765 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c9c8a11-0f55-4037-92d8-cf0adbd54d60 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:05.145193 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c9c8a11-0f55-4037-92d8-cf0adbd54d60 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:05.145488 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c9c8a11-0f55-4037-92d8-cf0adbd54d60 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:05.145916 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c9c8a11-0f55-4037-92d8-cf0adbd54d60 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:05.182294 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c9c8a11-0f55-4037-92d8-cf0adbd54d60 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:05.182294 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c9c8a11-0f55-4037-92d8-cf0adbd54d60 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:05.182753 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c9c8a11-0f55-4037-92d8-cf0adbd54d60 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:05.183223 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-5c9c8a11-0f55-4037-92d8-cf0adbd54d60 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lazy-loading 'fault' on Instance uuid 4a23be5e-9334-4385-9476-4bbd81995002 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:41:05.246703 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5c9c8a11-0f55-4037-92d8-cf0adbd54d60 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:05.268721 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5c9c8a11-0f55-4037-92d8-cf0adbd54d60 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002" status: 200 len: 1331 microversion: 2.1 time: 0.137381 Oct 18 15:41:05.271538 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1842/3691] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:05 2022] GET /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002 => generated 1331 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:05.279625 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c3004f3c-d819-41ae-8a5b-67626bff17f4 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:05.284914 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c3004f3c-d819-41ae-8a5b-67626bff17f4 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:05.285836 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.compute.servers [None req-c3004f3c-d819-41ae-8a5b-67626bff17f4 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Removing options 'limit' from query {{(pid=120406) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 18 15:41:05.286678 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c3004f3c-d819-41ae-8a5b-67626bff17f4 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Searching by: {'deleted': False, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1'} {{(pid=120406) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 15:41:05.301953 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3004f3c-d819-41ae-8a5b-67626bff17f4 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:05.302447 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3004f3c-d819-41ae-8a5b-67626bff17f4 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:05.302886 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3004f3c-d819-41ae-8a5b-67626bff17f4 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:05.303871 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3004f3c-d819-41ae-8a5b-67626bff17f4 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:05.304396 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3004f3c-d819-41ae-8a5b-67626bff17f4 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:05.304768 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3004f3c-d819-41ae-8a5b-67626bff17f4 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:05.331312 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97c09fa1-53f5-43df-aaf7-bc6040afd064 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Acquiring lock "refresh_cache-e63557bf-fd6b-4440-99ea-2cf6068000bb" {{(pid=120405) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 18 15:41:05.332267 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97c09fa1-53f5-43df-aaf7-bc6040afd064 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Acquired lock "refresh_cache-e63557bf-fd6b-4440-99ea-2cf6068000bb" {{(pid=120405) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 18 15:41:05.348849 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.multi_cell_list [None req-c3004f3c-d819-41ae-8a5b-67626bff17f4 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120406) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 15:41:05.385666 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c3004f3c-d819-41ae-8a5b-67626bff17f4 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.112052 Oct 18 15:41:05.393853 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1843/3692] 10.222.0.60 () {58 vars in 1150 bytes} [Tue Oct 18 15:41:05 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:05.399951 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3c676f8b-c845-4b4e-83b7-17e250cfe902 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:05.406024 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3c676f8b-c845-4b4e-83b7-17e250cfe902 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:05.406692 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3c676f8b-c845-4b4e-83b7-17e250cfe902 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Searching by: {'deleted': False, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1'} {{(pid=120406) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 15:41:05.412066 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c676f8b-c845-4b4e-83b7-17e250cfe902 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:05.412544 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c676f8b-c845-4b4e-83b7-17e250cfe902 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:05.413268 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c676f8b-c845-4b4e-83b7-17e250cfe902 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:05.414187 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c676f8b-c845-4b4e-83b7-17e250cfe902 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:05.414944 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c676f8b-c845-4b4e-83b7-17e250cfe902 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:05.415549 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c676f8b-c845-4b4e-83b7-17e250cfe902 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:05.453594 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.multi_cell_list [None req-3c676f8b-c845-4b4e-83b7-17e250cfe902 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120406) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 15:41:05.483626 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3c676f8b-c845-4b4e-83b7-17e250cfe902 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.087646 Oct 18 15:41:05.484126 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1844/3693] 10.222.0.60 () {58 vars in 1125 bytes} [Tue Oct 18 15:41:05 2022] GET /compute/v2.1/servers => generated 1011 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:05.497244 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-58271867-dbc7-4e9d-9f1b-580fdfc6795f tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:05.503102 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-58271867-dbc7-4e9d-9f1b-580fdfc6795f tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:05.505296 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-58271867-dbc7-4e9d-9f1b-580fdfc6795f tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1'} {{(pid=120406) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 15:41:05.518775 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58271867-dbc7-4e9d-9f1b-580fdfc6795f tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:05.519439 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58271867-dbc7-4e9d-9f1b-580fdfc6795f tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:05.519979 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58271867-dbc7-4e9d-9f1b-580fdfc6795f tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:05.520773 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58271867-dbc7-4e9d-9f1b-580fdfc6795f tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:05.521251 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58271867-dbc7-4e9d-9f1b-580fdfc6795f tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:05.521717 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58271867-dbc7-4e9d-9f1b-580fdfc6795f tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:05.616117 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.multi_cell_list [None req-58271867-dbc7-4e9d-9f1b-580fdfc6795f tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120406) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 15:41:05.683279 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-58271867-dbc7-4e9d-9f1b-580fdfc6795f tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.188337 Oct 18 15:41:05.689019 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1845/3694] 10.222.0.60 () {58 vars in 1146 bytes} [Tue Oct 18 15:41:05 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:41:05.703339 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-aadbd604-6055-49af-a4b7-7e899dd3decd tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:05.713920 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-aadbd604-6055-49af-a4b7-7e899dd3decd tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:05.714502 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.compute.servers [None req-aadbd604-6055-49af-a4b7-7e899dd3decd tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Removing options 'limit' from query {{(pid=120406) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 18 15:41:05.715206 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-aadbd604-6055-49af-a4b7-7e899dd3decd tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Searching by: {'deleted': False, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1'} {{(pid=120406) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 15:41:05.720485 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aadbd604-6055-49af-a4b7-7e899dd3decd tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:05.721075 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aadbd604-6055-49af-a4b7-7e899dd3decd tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:05.721511 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aadbd604-6055-49af-a4b7-7e899dd3decd tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:05.722231 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aadbd604-6055-49af-a4b7-7e899dd3decd tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:05.723387 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aadbd604-6055-49af-a4b7-7e899dd3decd tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:05.723818 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aadbd604-6055-49af-a4b7-7e899dd3decd tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:05.749248 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-aadbd604-6055-49af-a4b7-7e899dd3decd tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.054203 Oct 18 15:41:05.749936 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1846/3695] 10.222.0.60 () {58 vars in 1140 bytes} [Tue Oct 18 15:41:05 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:41:05.762410 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1f904a97-e693-4974-b59a-b3c158c2076f tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:05.767220 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1f904a97-e693-4974-b59a-b3c158c2076f tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:05.767901 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1f904a97-e693-4974-b59a-b3c158c2076f tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1592337757', 'deleted': False, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1'} {{(pid=120406) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 15:41:05.773335 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f904a97-e693-4974-b59a-b3c158c2076f tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:05.773813 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f904a97-e693-4974-b59a-b3c158c2076f tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:05.774248 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f904a97-e693-4974-b59a-b3c158c2076f tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:05.774979 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f904a97-e693-4974-b59a-b3c158c2076f tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:05.775420 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f904a97-e693-4974-b59a-b3c158c2076f tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:05.775839 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f904a97-e693-4974-b59a-b3c158c2076f tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:05.864968 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.multi_cell_list [None req-1f904a97-e693-4974-b59a-b3c158c2076f tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120406) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 15:41:05.922672 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1f904a97-e693-4974-b59a-b3c158c2076f tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1592337757" status: 200 len: 346 microversion: 2.1 time: 0.163943 Oct 18 15:41:05.923283 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1847/3696] 10.222.0.60 () {58 vars in 1242 bytes} [Tue Oct 18 15:41:05 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1592337757 => generated 346 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:41:05.936557 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-272f6f07-1fc7-4417-9110-c05dda8e321b tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:41:05.943341 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-272f6f07-1fc7-4417-9110-c05dda8e321b tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:05.943828 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-272f6f07-1fc7-4417-9110-c05dda8e321b tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:05.944266 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-272f6f07-1fc7-4417-9110-c05dda8e321b tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:05.967128 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-272f6f07-1fc7-4417-9110-c05dda8e321b tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] [instance: bea3a8ec-d421-45b4-b6d8-397ac80c920d] Going to try to stop instance {{(pid=120406) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 18 15:41:06.012676 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-272f6f07-1fc7-4417-9110-c05dda8e321b tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "POST /compute/v2.1/servers/bea3a8ec-d421-45b4-b6d8-397ac80c920d/action" status: 202 len: 0 microversion: 2.1 time: 0.079754 Oct 18 15:41:06.016406 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1848/3697] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:41:05 2022] POST /compute/v2.1/servers/bea3a8ec-d421-45b4-b6d8-397ac80c920d/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 15:41:06.018490 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-14150e59-a307-466e-b10e-76d9c4545d43 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:06.019200 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-14150e59-a307-466e-b10e-76d9c4545d43 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] [instance: 2e17d230-cb8b-4fc8-a10c-abed2322ed3b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:06.026258 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14150e59-a307-466e-b10e-76d9c4545d43 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:06.026754 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14150e59-a307-466e-b10e-76d9c4545d43 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:06.027191 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14150e59-a307-466e-b10e-76d9c4545d43 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:06.028462 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14150e59-a307-466e-b10e-76d9c4545d43 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:06.028741 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14150e59-a307-466e-b10e-76d9c4545d43 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:06.029220 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14150e59-a307-466e-b10e-76d9c4545d43 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:06.068152 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14150e59-a307-466e-b10e-76d9c4545d43 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:06.068644 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14150e59-a307-466e-b10e-76d9c4545d43 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:06.069107 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14150e59-a307-466e-b10e-76d9c4545d43 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:06.069557 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-14150e59-a307-466e-b10e-76d9c4545d43 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lazy-loading 'fault' on Instance uuid 2e17d230-cb8b-4fc8-a10c-abed2322ed3b {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:41:06.142032 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-14150e59-a307-466e-b10e-76d9c4545d43 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:06.146277 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-97c09fa1-53f5-43df-aaf7-bc6040afd064 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] [instance: e63557bf-fd6b-4440-99ea-2cf6068000bb] Building network info cache for instance {{(pid=120405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}} Oct 18 15:41:06.150193 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-14150e59-a307-466e-b10e-76d9c4545d43 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:06.151979 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-14150e59-a307-466e-b10e-76d9c4545d43 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0253081420d048b9bacbaa3ae30ae331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5421df89db4d36a164f2d9f5c27803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:06.153294 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-14150e59-a307-466e-b10e-76d9c4545d43 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] 10.222.0.60 "GET /compute/v2.1/servers/2e17d230-cb8b-4fc8-a10c-abed2322ed3b" status: 200 len: 1368 microversion: 2.47 time: 0.138758 Oct 18 15:41:06.153915 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1849/3698] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:41:06 2022] GET /compute/v2.1/servers/2e17d230-cb8b-4fc8-a10c-abed2322ed3b => generated 1368 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:41:06.158616 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0ce0b7b3-ca04-4c31-b9f2-d66ccaf31d01 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:06.159226 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0ce0b7b3-ca04-4c31-b9f2-d66ccaf31d01 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] [instance: bea3a8ec-d421-45b4-b6d8-397ac80c920d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:06.165217 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:41:06.167193 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ce0b7b3-ca04-4c31-b9f2-d66ccaf31d01 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:06.167330 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ce0b7b3-ca04-4c31-b9f2-d66ccaf31d01 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:06.167738 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ce0b7b3-ca04-4c31-b9f2-d66ccaf31d01 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:06.168441 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ce0b7b3-ca04-4c31-b9f2-d66ccaf31d01 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:06.168921 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ce0b7b3-ca04-4c31-b9f2-d66ccaf31d01 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:06.169517 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ce0b7b3-ca04-4c31-b9f2-d66ccaf31d01 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:06.384673 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0ce0b7b3-ca04-4c31-b9f2-d66ccaf31d01 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:06.392339 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0ce0b7b3-ca04-4c31-b9f2-d66ccaf31d01 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers/bea3a8ec-d421-45b4-b6d8-397ac80c920d" status: 200 len: 1522 microversion: 2.1 time: 0.237421 Oct 18 15:41:06.406870 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1850/3699] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:06 2022] GET /compute/v2.1/servers/bea3a8ec-d421-45b4-b6d8-397ac80c920d => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:06.406870 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1373a40a-8cf6-45b6-a74f-ab6e840e9b6a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:06.406870 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1373a40a-8cf6-45b6-a74f-ab6e840e9b6a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 4a23be5e-9334-4385-9476-4bbd81995002] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:06.406870 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1373a40a-8cf6-45b6-a74f-ab6e840e9b6a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:06.406870 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1373a40a-8cf6-45b6-a74f-ab6e840e9b6a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:06.406870 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1373a40a-8cf6-45b6-a74f-ab6e840e9b6a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:06.406870 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1373a40a-8cf6-45b6-a74f-ab6e840e9b6a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:06.406870 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1373a40a-8cf6-45b6-a74f-ab6e840e9b6a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:06.406870 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1373a40a-8cf6-45b6-a74f-ab6e840e9b6a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:06.423549 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-1373a40a-8cf6-45b6-a74f-ab6e840e9b6a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] HTTP exception thrown: Instance 4a23be5e-9334-4385-9476-4bbd81995002 could not be found. Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1373a40a-8cf6-45b6-a74f-ab6e840e9b6a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Request method failure captured: Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002 HTTP/1.1 Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsfD3tyC5zBBCs3PM6SgagJOA9ytEd34lT9my352h69qxn0wNQWvVVVEceKNcLlE8Cld2E1ewLfFQUA6X-zyH4NCgXE9isdDnVpnJB5BT1ljNdC07pganRFql9FpScM1-Xjt5su1w2IBkP6ZVV1NsRclcY3oY_ScUp2DhZs2W7X1y8Y Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: a5b55fd6668b481b8c578983dc655785 Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-AttachVolumeNegativeTest-1298357771 Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a5b55fd6668b481b8c578983dc655785"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a5b55fd6668b481b8c578983dc655785"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a5b55fd6668b481b8c578983dc655785"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a5b55fd6668b481b8c578983dc655785"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-AttachVolumeNegativeTest-1298357771 Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: a5b55fd6668b481b8c578983dc655785 Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1298357771 Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-AttachVolumeNegativeTest-1298357771-project Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: efec3b4b5b1c46bd9d2c0efa68f86979 Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-AttachVolumeNegativeTest-1298357771-project Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 4a23be5e-9334-4385-9476-4bbd81995002 could not be found. Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '4a23be5e-9334-4385-9476-4bbd81995002'} Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a23be5e-9334-4385-9476-4bbd81995002 could not be found. Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a23be5e-9334-4385-9476-4bbd81995002 could not be found. Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:41:06.425247 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:06.430939 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:06.430939 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:41:06.430939 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:41:06.430939 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:41:06.430939 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:41:06.430939 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a23be5e-9334-4385-9476-4bbd81995002 could not be found. Oct 18 15:41:06.430939 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:06.432386 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1373a40a-8cf6-45b6-a74f-ab6e840e9b6a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Returning 404 to user: Instance 4a23be5e-9334-4385-9476-4bbd81995002 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:41:06.433267 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1373a40a-8cf6-45b6-a74f-ab6e840e9b6a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002" status: 404 len: 111 microversion: 2.1 time: 0.039414 Oct 18 15:41:06.433826 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1851/3700] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:06 2022] GET /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:41:06.442491 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ced99fea-ba61-4bc9-881d-a77b3f5614f6 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '.version_select at 0x7f7c3cdbec10>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:06.471597 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ced99fea-ba61-4bc9-881d-a77b3f5614f6 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1024316650" status: 202 len: 0 microversion: 2.1 time: 0.032856 Oct 18 15:41:06.472276 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1852/3701] 10.222.0.60 () {58 vars in 1221 bytes} [Tue Oct 18 15:41:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1024316650 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:41:06.815568 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-fda7a6e6-13ec-44e9-8dcb-aad55493e945 req-1af2836a-40a9-4d57-817d-9effb05ef925 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e63557bf-fd6b-4440-99ea-2cf6068000bb", "tag": "78218976-d29b-4087-9660-b6926a2369ec"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:41:06.827022 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-fda7a6e6-13ec-44e9-8dcb-aad55493e945 req-1af2836a-40a9-4d57-817d-9effb05ef925 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:06.827502 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-fda7a6e6-13ec-44e9-8dcb-aad55493e945 req-1af2836a-40a9-4d57-817d-9effb05ef925 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:06.828441 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-fda7a6e6-13ec-44e9-8dcb-aad55493e945 req-1af2836a-40a9-4d57-817d-9effb05ef925 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:06.839065 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-fda7a6e6-13ec-44e9-8dcb-aad55493e945 req-1af2836a-40a9-4d57-817d-9effb05ef925 service nova] Creating event network-changed:78218976-d29b-4087-9660-b6926a2369ec for instance e63557bf-fd6b-4440-99ea-2cf6068000bb on n-h1-853682-5 Oct 18 15:41:06.843915 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-fda7a6e6-13ec-44e9-8dcb-aad55493e945 req-1af2836a-40a9-4d57-817d-9effb05ef925 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032105 Oct 18 15:41:06.844511 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1853/3702] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:41:06.953835 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-97c09fa1-53f5-43df-aaf7-bc6040afd064 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] [instance: e63557bf-fd6b-4440-99ea-2cf6068000bb] Updating instance_info_cache with network_info: [{"id": "78218976-d29b-4087-9660-b6926a2369ec", "address": "fa:16:3e:40:83:19", "network": {"id": "c4c769f1-83e0-43c5-9669-9ee0cf4f730a", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-632061887-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "2760d2db59084862abaedcc0a6a75046", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap78218976-d2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 18 15:41:06.969071 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97c09fa1-53f5-43df-aaf7-bc6040afd064 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Releasing lock "refresh_cache-e63557bf-fd6b-4440-99ea-2cf6068000bb" {{(pid=120405) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 18 15:41:06.970380 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-97c09fa1-53f5-43df-aaf7-bc6040afd064 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] 10.222.0.60 "POST /compute/v2.1/servers/e63557bf-fd6b-4440-99ea-2cf6068000bb/action" status: 202 len: 0 microversion: 2.1 time: 2.196237 Oct 18 15:41:06.971071 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1850/3703] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:41:04 2022] POST /compute/v2.1/servers/e63557bf-fd6b-4440-99ea-2cf6068000bb/action => generated 0 bytes in 2198 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 18 15:41:06.980093 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-954f104f-649b-4aaa-897e-7044c96bcfc7 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Calling method '.version_select at 0x7f7c3cf5ac10>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:07.183493 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1dc34fa6-f1f1-4cb6-becd-2f74a1f39234 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:07.184171 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1dc34fa6-f1f1-4cb6-becd-2f74a1f39234 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] [instance: 2e17d230-cb8b-4fc8-a10c-abed2322ed3b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:07.190271 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1dc34fa6-f1f1-4cb6-becd-2f74a1f39234 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:07.190978 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1dc34fa6-f1f1-4cb6-becd-2f74a1f39234 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:07.191915 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1dc34fa6-f1f1-4cb6-becd-2f74a1f39234 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:07.192618 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1dc34fa6-f1f1-4cb6-becd-2f74a1f39234 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:07.193101 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1dc34fa6-f1f1-4cb6-becd-2f74a1f39234 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:07.193524 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1dc34fa6-f1f1-4cb6-becd-2f74a1f39234 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:07.209532 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-1dc34fa6-f1f1-4cb6-becd-2f74a1f39234 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] HTTP exception thrown: Instance 2e17d230-cb8b-4fc8-a10c-abed2322ed3b could not be found. Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1dc34fa6-f1f1-4cb6-becd-2f74a1f39234 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Request method failure captured: Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/2e17d230-cb8b-4fc8-a10c-abed2322ed3b HTTP/1.1 Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsjSts0G7z5rIze_-SMAA-YmnDtb_5QbkMnk9QnLaPUtKte-8nqPDgR_eJCYrSCbMG8tei2Y4xNHMDQLVSEnzGd1uE0wFsZ2TSZbkdLzntu8WWj8s8c4eQA_XCm3Os_TvsvuTkqRz_2afhziptwR8fhGxKH-4Qb8ugCZr2WCTVXutYI Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: X-Openstack-Nova-Api-Version: 2.47 Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 6a5421df89db4d36a164f2d9f5c27803 Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServerShowV247Test-359106451 Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a5421df89db4d36a164f2d9f5c27803"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a5421df89db4d36a164f2d9f5c27803"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a5421df89db4d36a164f2d9f5c27803"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a5421df89db4d36a164f2d9f5c27803"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServerShowV247Test-359106451 Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 6a5421df89db4d36a164f2d9f5c27803 Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServerShowV247Test-359106451 Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServerShowV247Test-359106451-project Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 0253081420d048b9bacbaa3ae30ae331 Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServerShowV247Test-359106451-project Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 2e17d230-cb8b-4fc8-a10c-abed2322ed3b could not be found. Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '2e17d230-cb8b-4fc8-a10c-abed2322ed3b'} Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e17d230-cb8b-4fc8-a10c-abed2322ed3b could not be found. Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e17d230-cb8b-4fc8-a10c-abed2322ed3b could not be found. Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:41:07.212118 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:41:07.217209 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:07.217209 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:41:07.217209 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:41:07.217209 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:41:07.217209 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:41:07.217209 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e17d230-cb8b-4fc8-a10c-abed2322ed3b could not be found. Oct 18 15:41:07.217209 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:41:07.218532 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1dc34fa6-f1f1-4cb6-becd-2f74a1f39234 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] Returning 404 to user: Instance 2e17d230-cb8b-4fc8-a10c-abed2322ed3b could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:41:07.219340 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1dc34fa6-f1f1-4cb6-becd-2f74a1f39234 tempest-ServerShowV247Test-359106451 tempest-ServerShowV247Test-359106451-project] 10.222.0.60 "GET /compute/v2.1/servers/2e17d230-cb8b-4fc8-a10c-abed2322ed3b" status: 404 len: 111 microversion: 2.47 time: 0.039751 Oct 18 15:41:07.220084 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1851/3704] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:41:07 2022] GET /compute/v2.1/servers/2e17d230-cb8b-4fc8-a10c-abed2322ed3b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 18 15:41:07.419321 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6219a3ba-4a27-4ebe-8c64-a1f34b57877e tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:07.420173 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6219a3ba-4a27-4ebe-8c64-a1f34b57877e tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] [instance: bea3a8ec-d421-45b4-b6d8-397ac80c920d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:07.426417 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6219a3ba-4a27-4ebe-8c64-a1f34b57877e tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:07.427181 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6219a3ba-4a27-4ebe-8c64-a1f34b57877e tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:07.427838 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6219a3ba-4a27-4ebe-8c64-a1f34b57877e tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:07.428735 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6219a3ba-4a27-4ebe-8c64-a1f34b57877e tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:07.429446 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6219a3ba-4a27-4ebe-8c64-a1f34b57877e tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:07.430111 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6219a3ba-4a27-4ebe-8c64-a1f34b57877e tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:08.226547 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6219a3ba-4a27-4ebe-8c64-a1f34b57877e tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:08.237376 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6219a3ba-4a27-4ebe-8c64-a1f34b57877e tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers/bea3a8ec-d421-45b4-b6d8-397ac80c920d" status: 200 len: 1522 microversion: 2.1 time: 0.821613 Oct 18 15:41:08.238535 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1852/3705] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:07 2022] GET /compute/v2.1/servers/bea3a8ec-d421-45b4-b6d8-397ac80c920d => generated 1522 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:08.264680 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4f1c35da-c19a-4170-b981-b33f8d1e0aac tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Action: 'create', calling method: .version_select at 0x7f7c3c4d1ca0>, body: {"keypair": {"name": "tempest-keypair-807278262", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHShQXTE0Qa1N0bXUcGZs/DXd0/USzL0l7QrjYOP+cM1f4ao7TkULTcM1+4Fh2k6EJattAl66k5o3lgVU8lknQXWTSUrvG+uhzCqxVumLXxKn/5q/LF36rV8e3ATRxy2Yw=="}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:41:08.282870 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-4f1c35da-c19a-4170-b981-b33f8d1e0aac tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Getting quotas for project a5b55fd6668b481b8c578983dc655785. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:41:08.289149 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-4f1c35da-c19a-4170-b981-b33f8d1e0aac tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Getting quotas for user efec3b4b5b1c46bd9d2c0efa68f86979 and project a5b55fd6668b481b8c578983dc655785. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:41:08.314265 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4f1c35da-c19a-4170-b981-b33f8d1e0aac tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.054213 Oct 18 15:41:08.316946 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1853/3706] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Oct 18 15:41:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:41:08.755031 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-954f104f-649b-4aaa-897e-7044c96bcfc7 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] 10.222.0.60 "DELETE /compute/v2.1/os-floating-ips/23839423-0f65-44af-858e-0ed231e344e0" status: 202 len: 0 microversion: 2.1 time: 1.779219 Oct 18 15:41:08.755932 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1854/3707] 10.222.0.60 () {58 vars in 1263 bytes} [Tue Oct 18 15:41:06 2022] DELETE /compute/v2.1/os-floating-ips/23839423-0f65-44af-858e-0ed231e344e0 => generated 0 bytes in 1781 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:41:08.765514 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1aeef3bf-6d2e-41eb-8984-4f939be475ef tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1aeef3bf-6d2e-41eb-8984-4f939be475ef tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Request method failure captured: Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers/e63557bf-fd6b-4440-99ea-2cf6068000bb/action HTTP/1.1 Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 34 Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsjwQYkwCZOtmsqREzdw15yNvjO7LuDj1bNyNyIxzBYlRVv_xi1-2iq9mk0NVvpoXwrrZ-Mahl0d9IMayafE3OTZLW1nAuHfUmWJ_OxY-orJhFZYZu1g9r5smf1P6VtsKG676Qd7u-jv4J7kaekwT3blQF7sHB-dgabz1rC79FUmwvA Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 2760d2db59084862abaedcc0a6a75046 Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2760d2db59084862abaedcc0a6a75046"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2760d2db59084862abaedcc0a6a75046"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2760d2db59084862abaedcc0a6a75046"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2760d2db59084862abaedcc0a6a75046"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 2760d2db59084862abaedcc0a6a75046 Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: dcb28fb6643847148fef67c0c775bf37 Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: {"addFloatingIp": {"address": ""}} Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'e63557bf-fd6b-4440-99ea-2cf6068000bb', 'body': {'addFloatingIp': {'address': ''}}} Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise error Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi '' Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 15:41:08.770452 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 15:41:08.775255 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 15:41:08.775255 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 18 15:41:08.775255 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:08.775255 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:41:08.775255 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:08.775255 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:08.775255 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:41:08.775255 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:41:08.775255 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 15:41:08.775255 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 15:41:08.775255 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 18 15:41:08.775255 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:08.778160 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1aeef3bf-6d2e-41eb-8984-4f939be475ef tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:41:08.778966 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1aeef3bf-6d2e-41eb-8984-4f939be475ef tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] 10.222.0.60 "POST /compute/v2.1/servers/e63557bf-fd6b-4440-99ea-2cf6068000bb/action" status: 400 len: 142 microversion: 2.1 time: 0.017658 Oct 18 15:41:08.784667 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1855/3708] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:41:08 2022] POST /compute/v2.1/servers/e63557bf-fd6b-4440-99ea-2cf6068000bb/action => generated 142 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 18 15:41:08.790983 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0e734553-1325-4fb6-8a6d-918339d8b953 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:41:08.793696 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0e734553-1325-4fb6-8a6d-918339d8b953 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] [instance: e63557bf-fd6b-4440-99ea-2cf6068000bb] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:08.800543 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e734553-1325-4fb6-8a6d-918339d8b953 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:08.801675 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e734553-1325-4fb6-8a6d-918339d8b953 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:08.802158 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e734553-1325-4fb6-8a6d-918339d8b953 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:08.802943 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e734553-1325-4fb6-8a6d-918339d8b953 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:08.803472 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e734553-1325-4fb6-8a6d-918339d8b953 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:08.803986 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e734553-1325-4fb6-8a6d-918339d8b953 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:08.830376 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-cdbd7655-c94b-4b5a-b019-f5b807ad6402 tempest-QuotasTestJSON-1118277667 tempest-QuotasTestJSON-1118277667-project] Calling method '.version_select at 0x7f7c3c4e4b80>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:08.832929 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e734553-1325-4fb6-8a6d-918339d8b953 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Acquiring lock "refresh_cache-e63557bf-fd6b-4440-99ea-2cf6068000bb" {{(pid=120406) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 18 15:41:08.833416 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e734553-1325-4fb6-8a6d-918339d8b953 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Acquired lock "refresh_cache-e63557bf-fd6b-4440-99ea-2cf6068000bb" {{(pid=120406) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 18 15:41:08.890616 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-cdbd7655-c94b-4b5a-b019-f5b807ad6402 tempest-QuotasTestJSON-1118277667 tempest-QuotasTestJSON-1118277667-project] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/0f01817a3a96421e99e66a5df5a2878a/defaults" status: 200 len: 371 microversion: 2.1 time: 0.246765 Oct 18 15:41:08.891462 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1854/3709] 10.222.0.60 () {58 vars in 1269 bytes} [Tue Oct 18 15:41:08 2022] GET /compute/v2.1/os-quota-sets/0f01817a3a96421e99e66a5df5a2878a/defaults => generated 371 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:41:08.903880 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ebd8a39e-73b9-48e5-a27b-5dd7ccb28302 tempest-QuotasTestJSON-1118277667 tempest-QuotasTestJSON-1118277667-project] Calling method '.version_select at 0x7f7c3c46c4c0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:08.973953 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ebd8a39e-73b9-48e5-a27b-5dd7ccb28302 tempest-QuotasTestJSON-1118277667 tempest-QuotasTestJSON-1118277667-project] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/0f01817a3a96421e99e66a5df5a2878a" status: 200 len: 371 microversion: 2.1 time: 0.073804 Oct 18 15:41:08.974536 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1855/3710] 10.222.0.60 () {58 vars in 1242 bytes} [Tue Oct 18 15:41:08 2022] GET /compute/v2.1/os-quota-sets/0f01817a3a96421e99e66a5df5a2878a => generated 371 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:41:08.992244 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e734553-1325-4fb6-8a6d-918339d8b953 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Releasing lock "refresh_cache-e63557bf-fd6b-4440-99ea-2cf6068000bb" {{(pid=120406) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 18 15:41:08.993115 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-0e734553-1325-4fb6-8a6d-918339d8b953 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] HTTP exception thrown: floating IP not found Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0e734553-1325-4fb6-8a6d-918339d8b953 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Request method failure captured: Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers/e63557bf-fd6b-4440-99ea-2cf6068000bb/action HTTP/1.1 Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 41 Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsjwQYkwCZOtmsqREzdw15yNvjO7LuDj1bNyNyIxzBYlRVv_xi1-2iq9mk0NVvpoXwrrZ-Mahl0d9IMayafE3OTZLW1nAuHfUmWJ_OxY-orJhFZYZu1g9r5smf1P6VtsKG676Qd7u-jv4J7kaekwT3blQF7sHB-dgabz1rC79FUmwvA Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 2760d2db59084862abaedcc0a6a75046 Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2760d2db59084862abaedcc0a6a75046"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2760d2db59084862abaedcc0a6a75046"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2760d2db59084862abaedcc0a6a75046"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2760d2db59084862abaedcc0a6a75046"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 2760d2db59084862abaedcc0a6a75046 Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: dcb28fb6643847148fef67c0c775bf37 Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: exception: floating IP not found Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'e63557bf-fd6b-4440-99ea-2cf6068000bb', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2712, in associate_floating_ip Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3024, in _get_floating_ip_by_address Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 18 15:41:08.995384 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:09.000858 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:41:09.000858 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:09.000858 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:09.000858 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:41:09.000858 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:41:09.000858 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:41:09.000858 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:41:09.000858 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 18 15:41:09.000858 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:09.002691 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0e734553-1325-4fb6-8a6d-918339d8b953 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Returning 404 to user: floating IP not found {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:41:09.004001 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0e734553-1325-4fb6-8a6d-918339d8b953 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] 10.222.0.60 "POST /compute/v2.1/servers/e63557bf-fd6b-4440-99ea-2cf6068000bb/action" status: 404 len: 67 microversion: 2.1 time: 0.217318 Oct 18 15:41:09.004867 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f815aef4-46b6-429c-b253-4108054b8763 tempest-QuotasTestJSON-1118277667 tempest-QuotasTestJSON-1118277667-project] Calling method '.version_select at 0x7f7c3d0258b0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:09.005267 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1856/3711] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:41:08 2022] POST /compute/v2.1/servers/e63557bf-fd6b-4440-99ea-2cf6068000bb/action => generated 67 bytes in 219 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 15:41:09.015983 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9694cb87-fc61-4d59-a9e4-dfa8d83ad6e8 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:41:09.078174 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f815aef4-46b6-429c-b253-4108054b8763 tempest-QuotasTestJSON-1118277667 tempest-QuotasTestJSON-1118277667-project] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/0f01817a3a96421e99e66a5df5a2878a/defaults" status: 200 len: 371 microversion: 2.1 time: 0.083606 Oct 18 15:41:09.078867 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1856/3712] 10.222.0.60 () {58 vars in 1269 bytes} [Tue Oct 18 15:41:08 2022] GET /compute/v2.1/os-quota-sets/0f01817a3a96421e99e66a5df5a2878a/defaults => generated 371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:41:09.089485 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-9694cb87-fc61-4d59-a9e4-dfa8d83ad6e8 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9694cb87-fc61-4d59-a9e4-dfa8d83ad6e8 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Request method failure captured: Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers/e63557bf-fd6b-4440-99ea-2cf6068000bb/action HTTP/1.1 Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 44 Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsjwQYkwCZOtmsqREzdw15yNvjO7LuDj1bNyNyIxzBYlRVv_xi1-2iq9mk0NVvpoXwrrZ-Mahl0d9IMayafE3OTZLW1nAuHfUmWJ_OxY-orJhFZYZu1g9r5smf1P6VtsKG676Qd7u-jv4J7kaekwT3blQF7sHB-dgabz1rC79FUmwvA Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 2760d2db59084862abaedcc0a6a75046 Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2760d2db59084862abaedcc0a6a75046"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2760d2db59084862abaedcc0a6a75046"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2760d2db59084862abaedcc0a6a75046"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2760d2db59084862abaedcc0a6a75046"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 2760d2db59084862abaedcc0a6a75046 Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: dcb28fb6643847148fef67c0c775bf37 Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: exception: Floating IP not found for address 0.0.0.0. Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'e63557bf-fd6b-4440-99ea-2cf6068000bb', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2940, in get_instance_id_by_floating_address Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3024, in _get_floating_ip_by_address Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 18 15:41:09.091356 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 18 15:41:09.096218 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 18 15:41:09.096218 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:09.096218 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:41:09.096218 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:09.096218 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:09.096218 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:41:09.096218 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:41:09.096218 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:41:09.096218 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:41:09.096218 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 18 15:41:09.096218 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:09.097120 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8d6621e0-6162-4f28-beb1-7efef488166f tempest-QuotasTestJSON-1118277667 tempest-QuotasTestJSON-1118277667-project] Calling method '.version_select at 0x7f7c3c610160>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:09.099139 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9694cb87-fc61-4d59-a9e4-dfa8d83ad6e8 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:41:09.100224 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9694cb87-fc61-4d59-a9e4-dfa8d83ad6e8 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] 10.222.0.60 "POST /compute/v2.1/servers/e63557bf-fd6b-4440-99ea-2cf6068000bb/action" status: 404 len: 88 microversion: 2.1 time: 0.088072 Oct 18 15:41:09.100944 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1857/3713] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:41:09 2022] POST /compute/v2.1/servers/e63557bf-fd6b-4440-99ea-2cf6068000bb/action => generated 88 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 18 15:41:09.109996 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c1c707cf-c658-4f00-a096-ca7dd1db2366 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:09.110501 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c1c707cf-c658-4f00-a096-ca7dd1db2366 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] [instance: e63557bf-fd6b-4440-99ea-2cf6068000bb] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:09.117932 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1c707cf-c658-4f00-a096-ca7dd1db2366 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:09.118442 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1c707cf-c658-4f00-a096-ca7dd1db2366 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:09.118864 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1c707cf-c658-4f00-a096-ca7dd1db2366 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:09.119809 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1c707cf-c658-4f00-a096-ca7dd1db2366 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:09.120260 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1c707cf-c658-4f00-a096-ca7dd1db2366 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:09.120689 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1c707cf-c658-4f00-a096-ca7dd1db2366 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:09.136272 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:41:09.148711 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c1c707cf-c658-4f00-a096-ca7dd1db2366 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] [instance: e63557bf-fd6b-4440-99ea-2cf6068000bb] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:41:09.182477 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8d6621e0-6162-4f28-beb1-7efef488166f tempest-QuotasTestJSON-1118277667 tempest-QuotasTestJSON-1118277667-project] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/0f01817a3a96421e99e66a5df5a2878a" status: 200 len: 371 microversion: 2.1 time: 0.092696 Oct 18 15:41:09.184213 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1857/3714] 10.222.0.60 () {58 vars in 1242 bytes} [Tue Oct 18 15:41:09 2022] GET /compute/v2.1/os-quota-sets/0f01817a3a96421e99e66a5df5a2878a => generated 371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:41:09.196285 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5a9918af-f747-4af8-b2b0-e1b80d9ba5a2 tempest-QuotasTestJSON-1118277667 tempest-QuotasTestJSON-1118277667-project] Calling method '.version_select at 0x7f7c3d005550>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:09.204246 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:41:09.243892 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c1c707cf-c658-4f00-a096-ca7dd1db2366 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e63557bf-fd6b-4440-99ea-2cf6068000bb" status: 204 len: 0 microversion: 2.1 time: 0.137334 Oct 18 15:41:09.244480 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1858/3715] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:41:09 2022] DELETE /compute/v2.1/servers/e63557bf-fd6b-4440-99ea-2cf6068000bb => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 15:41:09.255299 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2660d519-0551-4acd-87e9-1e29d0498a25 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:09.256012 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2660d519-0551-4acd-87e9-1e29d0498a25 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] [instance: e63557bf-fd6b-4440-99ea-2cf6068000bb] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:09.262831 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2660d519-0551-4acd-87e9-1e29d0498a25 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:09.263355 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2660d519-0551-4acd-87e9-1e29d0498a25 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:09.263933 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2660d519-0551-4acd-87e9-1e29d0498a25 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:09.264879 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2660d519-0551-4acd-87e9-1e29d0498a25 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:09.265462 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2660d519-0551-4acd-87e9-1e29d0498a25 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:09.265761 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2660d519-0551-4acd-87e9-1e29d0498a25 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:09.271575 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:41:09.296329 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5a9918af-f747-4af8-b2b0-e1b80d9ba5a2 tempest-QuotasTestJSON-1118277667 tempest-QuotasTestJSON-1118277667-project] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/0f01817a3a96421e99e66a5df5a2878a?user_id=bfaca7be0a76477692e3e014fb1e9cc3" status: 200 len: 371 microversion: 2.1 time: 0.103983 Oct 18 15:41:09.296940 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1858/3716] 10.222.0.60 () {58 vars in 1323 bytes} [Tue Oct 18 15:41:09 2022] GET /compute/v2.1/os-quota-sets/0f01817a3a96421e99e66a5df5a2878a?user_id=bfaca7be0a76477692e3e014fb1e9cc3 => generated 371 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:41:09.305961 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0ed9e69f-263a-477e-84be-a5c48a1f0ae3 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:09.306846 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0ed9e69f-263a-477e-84be-a5c48a1f0ae3 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] [instance: bea3a8ec-d421-45b4-b6d8-397ac80c920d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:09.317841 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0ed9e69f-263a-477e-84be-a5c48a1f0ae3 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:09.318336 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0ed9e69f-263a-477e-84be-a5c48a1f0ae3 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:09.318776 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0ed9e69f-263a-477e-84be-a5c48a1f0ae3 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:09.319484 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0ed9e69f-263a-477e-84be-a5c48a1f0ae3 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:09.319948 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0ed9e69f-263a-477e-84be-a5c48a1f0ae3 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:09.320371 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0ed9e69f-263a-477e-84be-a5c48a1f0ae3 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:09.566898 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2660d519-0551-4acd-87e9-1e29d0498a25 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb28fb6643847148fef67c0c775bf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2760d2db59084862abaedcc0a6a75046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:09.575297 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2660d519-0551-4acd-87e9-1e29d0498a25 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] 10.222.0.60 "GET /compute/v2.1/servers/e63557bf-fd6b-4440-99ea-2cf6068000bb" status: 200 len: 1540 microversion: 2.1 time: 0.326416 Oct 18 15:41:09.576049 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1859/3717] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:09 2022] GET /compute/v2.1/servers/e63557bf-fd6b-4440-99ea-2cf6068000bb => generated 1540 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:09.605121 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0ed9e69f-263a-477e-84be-a5c48a1f0ae3 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:09.614364 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0ed9e69f-263a-477e-84be-a5c48a1f0ae3 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers/bea3a8ec-d421-45b4-b6d8-397ac80c920d" status: 200 len: 1522 microversion: 2.1 time: 0.316232 Oct 18 15:41:09.614986 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1859/3718] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:09 2022] GET /compute/v2.1/servers/bea3a8ec-d421-45b4-b6d8-397ac80c920d => generated 1522 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:10.046333 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7256dc93-bfea-4c1c-8094-4afb825ee0c7 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-912877254", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ccd513cb-fa43-49a2-9672-944a34d86625"}], "security_groups": [{"name": "tempest-securitygroup--517990225"}], "key_name": "tempest-keypair-807278262", "user_data": "}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:41:10.156127 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-7256dc93-bfea-4c1c-8094-4afb825ee0c7 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] validate_networks() for [('ccd513cb-fa43-49a2-9672-944a34d86625', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:41:10.550401 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-7256dc93-bfea-4c1c-8094-4afb825ee0c7 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:41:10.550865 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-7256dc93-bfea-4c1c-8094-4afb825ee0c7 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:41:10.551364 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-7256dc93-bfea-4c1c-8094-4afb825ee0c7 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:41:10.551777 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-7256dc93-bfea-4c1c-8094-4afb825ee0c7 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:41:10.552189 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-7256dc93-bfea-4c1c-8094-4afb825ee0c7 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:41:10.563562 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7256dc93-bfea-4c1c-8094-4afb825ee0c7 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:10.564006 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7256dc93-bfea-4c1c-8094-4afb825ee0c7 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:10.564446 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7256dc93-bfea-4c1c-8094-4afb825ee0c7 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:10.565207 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7256dc93-bfea-4c1c-8094-4afb825ee0c7 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:10.565711 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7256dc93-bfea-4c1c-8094-4afb825ee0c7 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:10.566233 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7256dc93-bfea-4c1c-8094-4afb825ee0c7 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:10.584701 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-7256dc93-bfea-4c1c-8094-4afb825ee0c7 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Getting quotas for project a5b55fd6668b481b8c578983dc655785. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:41:10.590009 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-7256dc93-bfea-4c1c-8094-4afb825ee0c7 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Getting quotas for user efec3b4b5b1c46bd9d2c0efa68f86979 and project a5b55fd6668b481b8c578983dc655785. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:41:10.602126 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-373a691a-3172-44be-a79f-bfbee3e32ead tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:10.602836 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-373a691a-3172-44be-a79f-bfbee3e32ead tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] [instance: e63557bf-fd6b-4440-99ea-2cf6068000bb] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:10.603298 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7256dc93-bfea-4c1c-8094-4afb825ee0c7 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:41:10.605943 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7256dc93-bfea-4c1c-8094-4afb825ee0c7 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 47ee1803-1ce0-4cbc-879e-d39cfe8576aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:41:10.610856 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-373a691a-3172-44be-a79f-bfbee3e32ead tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:10.611641 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-373a691a-3172-44be-a79f-bfbee3e32ead tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:10.612156 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-373a691a-3172-44be-a79f-bfbee3e32ead tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:10.613128 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-373a691a-3172-44be-a79f-bfbee3e32ead tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:10.614073 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-373a691a-3172-44be-a79f-bfbee3e32ead tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:10.614957 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-373a691a-3172-44be-a79f-bfbee3e32ead tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:10.656438 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7256dc93-bfea-4c1c-8094-4afb825ee0c7 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.614605 Oct 18 15:41:10.657132 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1860/3719] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:41:10 2022] POST /compute/v2.1/servers => generated 401 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:41:10.662650 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-543d89a5-04e7-4c46-a8d7-21bf39d2efd2 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:10.663269 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-543d89a5-04e7-4c46-a8d7-21bf39d2efd2 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] [instance: bea3a8ec-d421-45b4-b6d8-397ac80c920d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:10.670222 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-543d89a5-04e7-4c46-a8d7-21bf39d2efd2 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:10.670949 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-543d89a5-04e7-4c46-a8d7-21bf39d2efd2 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:10.671580 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-543d89a5-04e7-4c46-a8d7-21bf39d2efd2 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:10.672462 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-543d89a5-04e7-4c46-a8d7-21bf39d2efd2 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:10.672948 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-543d89a5-04e7-4c46-a8d7-21bf39d2efd2 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:10.673380 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-543d89a5-04e7-4c46-a8d7-21bf39d2efd2 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:10.846068 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-373a691a-3172-44be-a79f-bfbee3e32ead tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb28fb6643847148fef67c0c775bf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2760d2db59084862abaedcc0a6a75046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:10.870375 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-543d89a5-04e7-4c46-a8d7-21bf39d2efd2 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:10.878199 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-543d89a5-04e7-4c46-a8d7-21bf39d2efd2 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers/bea3a8ec-d421-45b4-b6d8-397ac80c920d" status: 200 len: 1522 microversion: 2.1 time: 0.219454 Oct 18 15:41:10.879023 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1861/3720] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:10 2022] GET /compute/v2.1/servers/bea3a8ec-d421-45b4-b6d8-397ac80c920d => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:10.879984 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-373a691a-3172-44be-a79f-bfbee3e32ead tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] 10.222.0.60 "GET /compute/v2.1/servers/e63557bf-fd6b-4440-99ea-2cf6068000bb" status: 200 len: 1540 microversion: 2.1 time: 0.283357 Oct 18 15:41:10.880565 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1860/3721] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:10 2022] GET /compute/v2.1/servers/e63557bf-fd6b-4440-99ea-2cf6068000bb => generated 1540 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:41:10.885129 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-65243446-40ae-4fde-85c9-fff17c1f346b tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:10.885735 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-65243446-40ae-4fde-85c9-fff17c1f346b tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 47ee1803-1ce0-4cbc-879e-d39cfe8576aa] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:10.948575 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-65243446-40ae-4fde-85c9-fff17c1f346b tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:10.955795 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-65243446-40ae-4fde-85c9-fff17c1f346b tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee1803-1ce0-4cbc-879e-d39cfe8576aa" status: 200 len: 1240 microversion: 2.1 time: 0.074183 Oct 18 15:41:10.956712 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1861/3722] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:10 2022] GET /compute/v2.1/servers/47ee1803-1ce0-4cbc-879e-d39cfe8576aa => generated 1240 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:11.022203 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-03d6a909-a80f-434d-80ba-726db029e076 tempest-VolumesNegativeTest-204996012 tempest-VolumesNegativeTest-204996012-project] Action: 'create', calling method: .version_select at 0x7f7c3cf2d4c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1601769069", "metadata": {"Type": "work"}}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-03d6a909-a80f-434d-80ba-726db029e076 tempest-VolumesNegativeTest-204996012 tempest-VolumesNegativeTest-204996012-project] Request method failure captured: Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 122 Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTskWnV-qrPq_2apmlQzx2YsNuNGTJvwowv-P17bbOCGDTj-dEnX7HlsojnIbrgXrVxnFMUC19b0G9xichBdxL0Ll0uAWvVJTntKOSETqzzjjAKqIqmnWbBqOMEyMbGEbj4kgvWnyA85rsy5Shp36haKEmSPXzxU62lumrBolKxNIc28 Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 6ed9c072f8354accbec027e8856e4605 Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-VolumesNegativeTest-204996012 Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ed9c072f8354accbec027e8856e4605"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ed9c072f8354accbec027e8856e4605"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6ed9c072f8354accbec027e8856e4605"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6ed9c072f8354accbec027e8856e4605"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-VolumesNegativeTest-204996012 Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 6ed9c072f8354accbec027e8856e4605 Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-VolumesNegativeTest-204996012 Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-VolumesNegativeTest-204996012-project Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: fa4bb75657af462d8487745f90d5d810 Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-VolumesNegativeTest-204996012-project Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1601769069", "metadata": {"Type": "work"}}} Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1601769069', 'metadata': {'Type': 'work'}}}} Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise error Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi '#$%' Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 15:41:11.025978 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 15:41:11.036837 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 18 15:41:11.036837 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:11.036837 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:41:11.036837 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:11.036837 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:11.036837 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:41:11.036837 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:41:11.036837 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 15:41:11.036837 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 15:41:11.036837 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 18 15:41:11.036837 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:11.036837 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-03d6a909-a80f-434d-80ba-726db029e076 tempest-VolumesNegativeTest-204996012 tempest-VolumesNegativeTest-204996012-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:41:11.036837 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-03d6a909-a80f-434d-80ba-726db029e076 tempest-VolumesNegativeTest-204996012 tempest-VolumesNegativeTest-204996012-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.139839 Oct 18 15:41:11.036837 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1862/3723] 10.222.0.60 () {60 vars in 1156 bytes} [Tue Oct 18 15:41:10 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 141 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:41:11.038934 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-58a0db77-8357-499e-bbfe-66e6f987742b tempest-VolumesNegativeTest-204996012 tempest-VolumesNegativeTest-204996012-project] Action: 'create', calling method: .version_select at 0x7f7c3c6039d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1294659307", "metadata": {"Type": "work"}}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-58a0db77-8357-499e-bbfe-66e6f987742b tempest-VolumesNegativeTest-204996012 tempest-VolumesNegativeTest-204996012-project] Request method failure captured: Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 120 Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTskWnV-qrPq_2apmlQzx2YsNuNGTJvwowv-P17bbOCGDTj-dEnX7HlsojnIbrgXrVxnFMUC19b0G9xichBdxL0Ll0uAWvVJTntKOSETqzzjjAKqIqmnWbBqOMEyMbGEbj4kgvWnyA85rsy5Shp36haKEmSPXzxU62lumrBolKxNIc28 Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 6ed9c072f8354accbec027e8856e4605 Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-VolumesNegativeTest-204996012 Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ed9c072f8354accbec027e8856e4605"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ed9c072f8354accbec027e8856e4605"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6ed9c072f8354accbec027e8856e4605"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6ed9c072f8354accbec027e8856e4605"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-VolumesNegativeTest-204996012 Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 6ed9c072f8354accbec027e8856e4605 Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-VolumesNegativeTest-204996012 Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-VolumesNegativeTest-204996012-project Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: fa4bb75657af462d8487745f90d5d810 Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-VolumesNegativeTest-204996012-project Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1294659307", "metadata": {"Type": "work"}}} Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: method: Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1294659307', 'metadata': {'Type': 'work'}}}} Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise error Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi '0' Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 15:41:11.041497 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 15:41:11.051407 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 18 15:41:11.051407 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:41:11.051407 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:41:11.051407 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:41:11.051407 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:11.051407 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:41:11.051407 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:41:11.051407 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 15:41:11.051407 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 15:41:11.051407 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 18 15:41:11.051407 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:41:11.051407 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-58a0db77-8357-499e-bbfe-66e6f987742b tempest-VolumesNegativeTest-204996012 tempest-VolumesNegativeTest-204996012-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:41:11.051407 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-58a0db77-8357-499e-bbfe-66e6f987742b tempest-VolumesNegativeTest-204996012 tempest-VolumesNegativeTest-204996012-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009762 Oct 18 15:41:11.054205 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1862/3724] 10.222.0.60 () {60 vars in 1156 bytes} [Tue Oct 18 15:41:11 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:41:11.054371 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-db1a1f7e-50d3-491c-b272-198945616ee7 tempest-VolumesNegativeTest-204996012 tempest-VolumesNegativeTest-204996012-project] Action: 'create', calling method: .version_select at 0x7f7c3cdbeee0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1341938584", "metadata": {"Type": "work"}}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-db1a1f7e-50d3-491c-b272-198945616ee7 tempest-VolumesNegativeTest-204996012 tempest-VolumesNegativeTest-204996012-project] Request method failure captured: Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 119 Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTskWnV-qrPq_2apmlQzx2YsNuNGTJvwowv-P17bbOCGDTj-dEnX7HlsojnIbrgXrVxnFMUC19b0G9xichBdxL0Ll0uAWvVJTntKOSETqzzjjAKqIqmnWbBqOMEyMbGEbj4kgvWnyA85rsy5Shp36haKEmSPXzxU62lumrBolKxNIc28 Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 6ed9c072f8354accbec027e8856e4605 Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-VolumesNegativeTest-204996012 Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ed9c072f8354accbec027e8856e4605"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ed9c072f8354accbec027e8856e4605"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6ed9c072f8354accbec027e8856e4605"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6ed9c072f8354accbec027e8856e4605"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-VolumesNegativeTest-204996012 Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 6ed9c072f8354accbec027e8856e4605 Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-VolumesNegativeTest-204996012 Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-VolumesNegativeTest-204996012-project Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: fa4bb75657af462d8487745f90d5d810 Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-VolumesNegativeTest-204996012-project Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1341938584", "metadata": {"Type": "work"}}} Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1341938584', 'metadata': {'Type': 'work'}}}} Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise error Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi '' Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 15:41:11.056912 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 15:41:11.067033 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 18 15:41:11.067033 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:11.067033 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:41:11.067033 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:11.067033 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:11.067033 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:41:11.067033 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:41:11.067033 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 15:41:11.067033 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 15:41:11.067033 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 18 15:41:11.067033 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:11.067033 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-db1a1f7e-50d3-491c-b272-198945616ee7 tempest-VolumesNegativeTest-204996012 tempest-VolumesNegativeTest-204996012-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:41:11.067033 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-db1a1f7e-50d3-491c-b272-198945616ee7 tempest-VolumesNegativeTest-204996012 tempest-VolumesNegativeTest-204996012-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008929 Oct 18 15:41:11.068944 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-20b6607f-46b9-4b9a-8192-21cf3ac2261f tempest-VolumesNegativeTest-204996012 tempest-VolumesNegativeTest-204996012-project] Calling method '.version_select at 0x7f7c3c858e50>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:11.075647 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1863/3725] 10.222.0.60 () {60 vars in 1156 bytes} [Tue Oct 18 15:41:11 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:41:11.101167 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-20b6607f-46b9-4b9a-8192-21cf3ac2261f tempest-VolumesNegativeTest-204996012 tempest-VolumesNegativeTest-204996012-project] HTTP exception thrown: Volume tempest-invalid-1581015285 could not be found. Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-20b6607f-46b9-4b9a-8192-21cf3ac2261f tempest-VolumesNegativeTest-204996012 tempest-VolumesNegativeTest-204996012-project] Request method failure captured: Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1581015285 HTTP/1.1 Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTskWnV-qrPq_2apmlQzx2YsNuNGTJvwowv-P17bbOCGDTj-dEnX7HlsojnIbrgXrVxnFMUC19b0G9xichBdxL0Ll0uAWvVJTntKOSETqzzjjAKqIqmnWbBqOMEyMbGEbj4kgvWnyA85rsy5Shp36haKEmSPXzxU62lumrBolKxNIc28 Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 6ed9c072f8354accbec027e8856e4605 Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-VolumesNegativeTest-204996012 Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ed9c072f8354accbec027e8856e4605"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ed9c072f8354accbec027e8856e4605"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6ed9c072f8354accbec027e8856e4605"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6ed9c072f8354accbec027e8856e4605"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-VolumesNegativeTest-204996012 Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 6ed9c072f8354accbec027e8856e4605 Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-VolumesNegativeTest-204996012 Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-VolumesNegativeTest-204996012-project Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: fa4bb75657af462d8487745f90d5d810 Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-VolumesNegativeTest-204996012-project Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: method: Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: exception: Volume tempest-invalid-1581015285 could not be found. Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'tempest-invalid-1581015285'} Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1581015285 could not be found. (HTTP 404) (Request-ID: req-705487c1-8f68-4173-8384-74bc6ff1572f) Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 18 15:41:11.103249 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 15:41:11.108304 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 15:41:11.108304 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 18 15:41:11.108304 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 18 15:41:11.108304 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 18 15:41:11.108304 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 18 15:41:11.108304 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 18 15:41:11.108304 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 18 15:41:11.108304 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 18 15:41:11.108304 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 18 15:41:11.108304 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 15:41:11.108304 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 15:41:11.108304 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 15:41:11.108304 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 15:41:11.108304 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1581015285 could not be found. Oct 18 15:41:11.108304 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:41:11.108304 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:41:11.108304 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:41:11.108304 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:11.108304 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:41:11.108304 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:41:11.108304 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:41:11.108304 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:41:11.108304 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:41:11.108304 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:41:11.108304 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:41:11.108304 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:41:11.108304 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 18 15:41:11.108304 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:41:11.108304 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1581015285 could not be found. Oct 18 15:41:11.108304 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:41:11.108304 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:41:11.108304 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:41:11.108304 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:11.108304 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:41:11.108304 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:41:11.108304 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:41:11.108304 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:41:11.108304 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1581015285 could not be found. Oct 18 15:41:11.108304 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:41:11.108304 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-20b6607f-46b9-4b9a-8192-21cf3ac2261f tempest-VolumesNegativeTest-204996012 tempest-VolumesNegativeTest-204996012-project] Returning 404 to user: Volume tempest-invalid-1581015285 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:41:11.108304 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-20b6607f-46b9-4b9a-8192-21cf3ac2261f tempest-VolumesNegativeTest-204996012 tempest-VolumesNegativeTest-204996012-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1581015285" status: 404 len: 99 microversion: 2.1 time: 0.040970 Oct 18 15:41:11.108304 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1863/3726] 10.222.0.60 () {58 vars in 1218 bytes} [Tue Oct 18 15:41:11 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1581015285 => generated 99 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 15:41:11.116131 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-69ac70b3-70bf-469b-9618-57843812459a tempest-VolumesNegativeTest-204996012 tempest-VolumesNegativeTest-204996012-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005308 Oct 18 15:41:11.116645 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1864/3727] 10.222.0.60 () {58 vars in 1140 bytes} [Tue Oct 18 15:41:11 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 18 15:41:11.125790 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b9f55392-9c49-49bd-ab98-511a35e54aa9 tempest-VolumesNegativeTest-204996012 tempest-VolumesNegativeTest-204996012-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003823 Oct 18 15:41:11.126478 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1864/3728] 10.222.0.60 () {58 vars in 1137 bytes} [Tue Oct 18 15:41:11 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 18 15:41:11.136017 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6be64567-9dbd-486d-a24e-b631d28b7606 tempest-VolumesNegativeTest-204996012 tempest-VolumesNegativeTest-204996012-project] Calling method '.version_select at 0x7f7c3c6235e0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:11.164728 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-6be64567-9dbd-486d-a24e-b631d28b7606 tempest-VolumesNegativeTest-204996012 tempest-VolumesNegativeTest-204996012-project] HTTP exception thrown: Volume 54b73e31-1c14-4e45-b7a2-7b0dda8f915d could not be found. Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6be64567-9dbd-486d-a24e-b631d28b7606 tempest-VolumesNegativeTest-204996012 tempest-VolumesNegativeTest-204996012-project] Request method failure captured: Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/os-volumes/54b73e31-1c14-4e45-b7a2-7b0dda8f915d HTTP/1.1 Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTskWnV-qrPq_2apmlQzx2YsNuNGTJvwowv-P17bbOCGDTj-dEnX7HlsojnIbrgXrVxnFMUC19b0G9xichBdxL0Ll0uAWvVJTntKOSETqzzjjAKqIqmnWbBqOMEyMbGEbj4kgvWnyA85rsy5Shp36haKEmSPXzxU62lumrBolKxNIc28 Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 6ed9c072f8354accbec027e8856e4605 Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-VolumesNegativeTest-204996012 Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ed9c072f8354accbec027e8856e4605"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ed9c072f8354accbec027e8856e4605"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6ed9c072f8354accbec027e8856e4605"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6ed9c072f8354accbec027e8856e4605"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-VolumesNegativeTest-204996012 Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 6ed9c072f8354accbec027e8856e4605 Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-VolumesNegativeTest-204996012 Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-VolumesNegativeTest-204996012-project Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: fa4bb75657af462d8487745f90d5d810 Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-VolumesNegativeTest-204996012-project Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: exception: Volume 54b73e31-1c14-4e45-b7a2-7b0dda8f915d could not be found. Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '54b73e31-1c14-4e45-b7a2-7b0dda8f915d'} Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 54b73e31-1c14-4e45-b7a2-7b0dda8f915d could not be found. (HTTP 404) (Request-ID: req-ebfe1fe1-d177-468c-8d4a-50fa34985086) Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 18 15:41:11.188461 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 15:41:11.194395 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 15:41:11.194395 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 18 15:41:11.194395 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 18 15:41:11.194395 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 18 15:41:11.194395 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 18 15:41:11.194395 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 18 15:41:11.194395 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 18 15:41:11.194395 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 18 15:41:11.194395 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 18 15:41:11.194395 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 15:41:11.194395 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 15:41:11.194395 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 15:41:11.194395 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 15:41:11.194395 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 54b73e31-1c14-4e45-b7a2-7b0dda8f915d could not be found. Oct 18 15:41:11.194395 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:11.194395 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:41:11.194395 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:11.194395 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:11.194395 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:41:11.194395 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:41:11.194395 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:41:11.194395 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:41:11.194395 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:41:11.194395 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:41:11.194395 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:41:11.194395 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:41:11.194395 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 18 15:41:11.194395 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:41:11.194395 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 54b73e31-1c14-4e45-b7a2-7b0dda8f915d could not be found. Oct 18 15:41:11.194395 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:11.194395 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:41:11.194395 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:11.194395 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:11.194395 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:41:11.194395 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:41:11.194395 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:41:11.194395 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:41:11.194395 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 54b73e31-1c14-4e45-b7a2-7b0dda8f915d could not be found. Oct 18 15:41:11.194395 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:11.194395 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6be64567-9dbd-486d-a24e-b631d28b7606 tempest-VolumesNegativeTest-204996012 tempest-VolumesNegativeTest-204996012-project] Returning 404 to user: Volume 54b73e31-1c14-4e45-b7a2-7b0dda8f915d could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:41:11.194395 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6be64567-9dbd-486d-a24e-b631d28b7606 tempest-VolumesNegativeTest-204996012 tempest-VolumesNegativeTest-204996012-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/54b73e31-1c14-4e45-b7a2-7b0dda8f915d" status: 404 len: 109 microversion: 2.1 time: 0.057941 Oct 18 15:41:11.194395 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1865/3729] 10.222.0.60 () {58 vars in 1248 bytes} [Tue Oct 18 15:41:11 2022] DELETE /compute/v2.1/os-volumes/54b73e31-1c14-4e45-b7a2-7b0dda8f915d => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:41:11.199998 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c3a32624-2ea6-4d92-96cd-54d652f527da tempest-VolumesNegativeTest-204996012 tempest-VolumesNegativeTest-204996012-project] Calling method '.version_select at 0x7f7c3d025700>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:11.230335 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-c3a32624-2ea6-4d92-96cd-54d652f527da tempest-VolumesNegativeTest-204996012 tempest-VolumesNegativeTest-204996012-project] HTTP exception thrown: Volume 4b0954e3-35f9-4484-a9d5-3b903e63e7f7 could not be found. Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c3a32624-2ea6-4d92-96cd-54d652f527da tempest-VolumesNegativeTest-204996012 tempest-VolumesNegativeTest-204996012-project] Request method failure captured: Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/os-volumes/4b0954e3-35f9-4484-a9d5-3b903e63e7f7 HTTP/1.1 Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTskWnV-qrPq_2apmlQzx2YsNuNGTJvwowv-P17bbOCGDTj-dEnX7HlsojnIbrgXrVxnFMUC19b0G9xichBdxL0Ll0uAWvVJTntKOSETqzzjjAKqIqmnWbBqOMEyMbGEbj4kgvWnyA85rsy5Shp36haKEmSPXzxU62lumrBolKxNIc28 Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 6ed9c072f8354accbec027e8856e4605 Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-VolumesNegativeTest-204996012 Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ed9c072f8354accbec027e8856e4605"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ed9c072f8354accbec027e8856e4605"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6ed9c072f8354accbec027e8856e4605"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6ed9c072f8354accbec027e8856e4605"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-VolumesNegativeTest-204996012 Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 6ed9c072f8354accbec027e8856e4605 Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-VolumesNegativeTest-204996012 Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-VolumesNegativeTest-204996012-project Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: fa4bb75657af462d8487745f90d5d810 Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-VolumesNegativeTest-204996012-project Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: method: Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: exception: Volume 4b0954e3-35f9-4484-a9d5-3b903e63e7f7 could not be found. Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '4b0954e3-35f9-4484-a9d5-3b903e63e7f7'} Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4b0954e3-35f9-4484-a9d5-3b903e63e7f7 could not be found. (HTTP 404) (Request-ID: req-ef597dd5-0720-42b0-908e-82b5dd6a7d99) Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 18 15:41:11.232330 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 15:41:11.239708 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 15:41:11.239708 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 18 15:41:11.239708 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 18 15:41:11.239708 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 18 15:41:11.239708 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 18 15:41:11.239708 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 15:41:11.239708 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 15:41:11.239708 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 15:41:11.239708 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 15:41:11.239708 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 15:41:11.239708 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 15:41:11.239708 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 15:41:11.239708 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 15:41:11.239708 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4b0954e3-35f9-4484-a9d5-3b903e63e7f7 could not be found. Oct 18 15:41:11.239708 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:41:11.239708 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:41:11.239708 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:41:11.239708 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:11.239708 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:41:11.239708 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:41:11.239708 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:41:11.239708 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:41:11.239708 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:41:11.239708 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:41:11.239708 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:41:11.239708 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:41:11.239708 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 18 15:41:11.239708 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:41:11.239708 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4b0954e3-35f9-4484-a9d5-3b903e63e7f7 could not be found. Oct 18 15:41:11.239708 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:41:11.239708 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:41:11.239708 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:41:11.239708 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:11.239708 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:41:11.239708 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:41:11.239708 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:41:11.239708 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:41:11.239708 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4b0954e3-35f9-4484-a9d5-3b903e63e7f7 could not be found. Oct 18 15:41:11.239708 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:41:11.239708 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c3a32624-2ea6-4d92-96cd-54d652f527da tempest-VolumesNegativeTest-204996012 tempest-VolumesNegativeTest-204996012-project] Returning 404 to user: Volume 4b0954e3-35f9-4484-a9d5-3b903e63e7f7 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:41:11.239708 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c3a32624-2ea6-4d92-96cd-54d652f527da tempest-VolumesNegativeTest-204996012 tempest-VolumesNegativeTest-204996012-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/4b0954e3-35f9-4484-a9d5-3b903e63e7f7" status: 404 len: 109 microversion: 2.1 time: 0.037663 Oct 18 15:41:11.239708 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1865/3730] 10.222.0.60 () {58 vars in 1245 bytes} [Tue Oct 18 15:41:11 2022] GET /compute/v2.1/os-volumes/4b0954e3-35f9-4484-a9d5-3b903e63e7f7 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 15:41:11.762118 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-0ef7ab20-620d-4511-8dac-eed030540ee4 req-1780dc5d-a6de-45c3-a87c-7fecc5bbba4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e63557bf-fd6b-4440-99ea-2cf6068000bb", "name": "network-vif-deleted", "tag": "78218976-d29b-4087-9660-b6926a2369ec"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:41:11.772568 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0ef7ab20-620d-4511-8dac-eed030540ee4 req-1780dc5d-a6de-45c3-a87c-7fecc5bbba4c service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:11.773081 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0ef7ab20-620d-4511-8dac-eed030540ee4 req-1780dc5d-a6de-45c3-a87c-7fecc5bbba4c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:11.773619 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0ef7ab20-620d-4511-8dac-eed030540ee4 req-1780dc5d-a6de-45c3-a87c-7fecc5bbba4c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:11.785447 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-0ef7ab20-620d-4511-8dac-eed030540ee4 req-1780dc5d-a6de-45c3-a87c-7fecc5bbba4c service nova] Creating event network-vif-deleted:78218976-d29b-4087-9660-b6926a2369ec for instance e63557bf-fd6b-4440-99ea-2cf6068000bb on n-h1-853682-5 Oct 18 15:41:11.791173 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-0ef7ab20-620d-4511-8dac-eed030540ee4 req-1780dc5d-a6de-45c3-a87c-7fecc5bbba4c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033648 Oct 18 15:41:11.792045 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1866/3731] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:41:11.904433 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e1bd89ba-0ad4-4347-baee-a9175df0cd0a tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:11.905017 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-02e438bf-c7b5-4fcd-83b6-de7c52496d89 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:11.905446 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-02e438bf-c7b5-4fcd-83b6-de7c52496d89 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] [instance: e63557bf-fd6b-4440-99ea-2cf6068000bb] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:11.905796 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e1bd89ba-0ad4-4347-baee-a9175df0cd0a tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] [instance: bea3a8ec-d421-45b4-b6d8-397ac80c920d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:11.916291 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02e438bf-c7b5-4fcd-83b6-de7c52496d89 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:11.917167 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02e438bf-c7b5-4fcd-83b6-de7c52496d89 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:11.917743 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e1bd89ba-0ad4-4347-baee-a9175df0cd0a tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:11.917905 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02e438bf-c7b5-4fcd-83b6-de7c52496d89 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:11.918573 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e1bd89ba-0ad4-4347-baee-a9175df0cd0a tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:11.919008 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e1bd89ba-0ad4-4347-baee-a9175df0cd0a tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:11.919481 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02e438bf-c7b5-4fcd-83b6-de7c52496d89 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:11.919724 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e1bd89ba-0ad4-4347-baee-a9175df0cd0a tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:11.920139 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02e438bf-c7b5-4fcd-83b6-de7c52496d89 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:11.920575 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02e438bf-c7b5-4fcd-83b6-de7c52496d89 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:11.920898 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e1bd89ba-0ad4-4347-baee-a9175df0cd0a tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:11.921676 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e1bd89ba-0ad4-4347-baee-a9175df0cd0a tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:12.016130 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-02e438bf-c7b5-4fcd-83b6-de7c52496d89 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb28fb6643847148fef67c0c775bf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2760d2db59084862abaedcc0a6a75046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:12.031153 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-02e438bf-c7b5-4fcd-83b6-de7c52496d89 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] 10.222.0.60 "GET /compute/v2.1/servers/e63557bf-fd6b-4440-99ea-2cf6068000bb" status: 200 len: 1498 microversion: 2.1 time: 0.129709 Oct 18 15:41:12.041293 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1867/3732] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:11 2022] GET /compute/v2.1/servers/e63557bf-fd6b-4440-99ea-2cf6068000bb => generated 1498 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:41:12.048660 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-50430a62-1d91-4277-b133-191fa63f7d5d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:12.049603 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-50430a62-1d91-4277-b133-191fa63f7d5d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 47ee1803-1ce0-4cbc-879e-d39cfe8576aa] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:12.068539 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50430a62-1d91-4277-b133-191fa63f7d5d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:12.069469 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50430a62-1d91-4277-b133-191fa63f7d5d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:12.070554 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50430a62-1d91-4277-b133-191fa63f7d5d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:12.072568 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50430a62-1d91-4277-b133-191fa63f7d5d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:12.073511 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50430a62-1d91-4277-b133-191fa63f7d5d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:12.074155 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50430a62-1d91-4277-b133-191fa63f7d5d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:12.184732 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-50430a62-1d91-4277-b133-191fa63f7d5d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:12.194888 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-50430a62-1d91-4277-b133-191fa63f7d5d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee1803-1ce0-4cbc-879e-d39cfe8576aa" status: 200 len: 1292 microversion: 2.1 time: 0.152030 Oct 18 15:41:12.214110 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1868/3733] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:12 2022] GET /compute/v2.1/servers/47ee1803-1ce0-4cbc-879e-d39cfe8576aa => generated 1292 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:12.286307 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e1bd89ba-0ad4-4347-baee-a9175df0cd0a tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:12.295194 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e1bd89ba-0ad4-4347-baee-a9175df0cd0a tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers/bea3a8ec-d421-45b4-b6d8-397ac80c920d" status: 200 len: 1499 microversion: 2.1 time: 0.396079 Oct 18 15:41:12.296348 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1866/3734] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:11 2022] GET /compute/v2.1/servers/bea3a8ec-d421-45b4-b6d8-397ac80c920d => generated 1499 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:12.330085 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4c5574d5-4215-4cc3-8a99-da24f5dfc06b tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:12.337235 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4c5574d5-4215-4cc3-8a99-da24f5dfc06b tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:12.340549 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4c5574d5-4215-4cc3-8a99-da24f5dfc06b tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1'} {{(pid=120406) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 15:41:12.352436 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c5574d5-4215-4cc3-8a99-da24f5dfc06b tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:12.353410 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c5574d5-4215-4cc3-8a99-da24f5dfc06b tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:12.354133 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c5574d5-4215-4cc3-8a99-da24f5dfc06b tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:12.356122 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c5574d5-4215-4cc3-8a99-da24f5dfc06b tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:12.356796 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c5574d5-4215-4cc3-8a99-da24f5dfc06b tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:12.357396 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c5574d5-4215-4cc3-8a99-da24f5dfc06b tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:12.406815 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.multi_cell_list [None req-4c5574d5-4215-4cc3-8a99-da24f5dfc06b tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120406) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 15:41:12.449123 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4c5574d5-4215-4cc3-8a99-da24f5dfc06b tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.126300 Oct 18 15:41:12.450205 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1869/3735] 10.222.0.60 () {58 vars in 1154 bytes} [Tue Oct 18 15:41:12 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:41:12.464791 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8db9956d-84f1-4bbd-b6e6-47e382355afd tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:41:12.470961 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8db9956d-84f1-4bbd-b6e6-47e382355afd tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:12.471449 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8db9956d-84f1-4bbd-b6e6-47e382355afd tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:12.471892 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8db9956d-84f1-4bbd-b6e6-47e382355afd tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:12.495421 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8db9956d-84f1-4bbd-b6e6-47e382355afd tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] [instance: bea3a8ec-d421-45b4-b6d8-397ac80c920d] Going to try to start instance {{(pid=120405) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 18 15:41:12.546434 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8db9956d-84f1-4bbd-b6e6-47e382355afd tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "POST /compute/v2.1/servers/bea3a8ec-d421-45b4-b6d8-397ac80c920d/action" status: 202 len: 0 microversion: 2.1 time: 0.085542 Oct 18 15:41:12.547655 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1867/3736] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:41:12 2022] POST /compute/v2.1/servers/bea3a8ec-d421-45b4-b6d8-397ac80c920d/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:41:12.566637 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-67ec39b2-b725-4fab-88cc-5e6c8f8cc150 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:12.568040 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-67ec39b2-b725-4fab-88cc-5e6c8f8cc150 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] [instance: bea3a8ec-d421-45b4-b6d8-397ac80c920d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:12.576986 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67ec39b2-b725-4fab-88cc-5e6c8f8cc150 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:12.578113 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67ec39b2-b725-4fab-88cc-5e6c8f8cc150 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:12.578894 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67ec39b2-b725-4fab-88cc-5e6c8f8cc150 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:12.591761 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67ec39b2-b725-4fab-88cc-5e6c8f8cc150 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:12.597012 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67ec39b2-b725-4fab-88cc-5e6c8f8cc150 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:12.597845 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67ec39b2-b725-4fab-88cc-5e6c8f8cc150 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:12.930723 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-67ec39b2-b725-4fab-88cc-5e6c8f8cc150 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:12.949332 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-67ec39b2-b725-4fab-88cc-5e6c8f8cc150 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers/bea3a8ec-d421-45b4-b6d8-397ac80c920d" status: 200 len: 1508 microversion: 2.1 time: 0.397245 Oct 18 15:41:12.950314 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1870/3737] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:12 2022] GET /compute/v2.1/servers/bea3a8ec-d421-45b4-b6d8-397ac80c920d => generated 1508 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:13.075667 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-66d92f0d-7d4c-420a-82e9-6160997a6f0e tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:13.077137 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-66d92f0d-7d4c-420a-82e9-6160997a6f0e tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] [instance: e63557bf-fd6b-4440-99ea-2cf6068000bb] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:13.089119 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-66d92f0d-7d4c-420a-82e9-6160997a6f0e tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:13.089605 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-66d92f0d-7d4c-420a-82e9-6160997a6f0e tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:13.090035 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-66d92f0d-7d4c-420a-82e9-6160997a6f0e tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:13.090916 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-66d92f0d-7d4c-420a-82e9-6160997a6f0e tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:13.091600 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-66d92f0d-7d4c-420a-82e9-6160997a6f0e tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:13.092381 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-66d92f0d-7d4c-420a-82e9-6160997a6f0e tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:13.114148 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-66d92f0d-7d4c-420a-82e9-6160997a6f0e tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] HTTP exception thrown: Instance e63557bf-fd6b-4440-99ea-2cf6068000bb could not be found. Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-66d92f0d-7d4c-420a-82e9-6160997a6f0e tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Request method failure captured: Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/e63557bf-fd6b-4440-99ea-2cf6068000bb HTTP/1.1 Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsjwQYkwCZOtmsqREzdw15yNvjO7LuDj1bNyNyIxzBYlRVv_xi1-2iq9mk0NVvpoXwrrZ-Mahl0d9IMayafE3OTZLW1nAuHfUmWJ_OxY-orJhFZYZu1g9r5smf1P6VtsKG676Qd7u-jv4J7kaekwT3blQF7sHB-dgabz1rC79FUmwvA Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 2760d2db59084862abaedcc0a6a75046 Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2760d2db59084862abaedcc0a6a75046"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2760d2db59084862abaedcc0a6a75046"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2760d2db59084862abaedcc0a6a75046"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2760d2db59084862abaedcc0a6a75046"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 2760d2db59084862abaedcc0a6a75046 Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: dcb28fb6643847148fef67c0c775bf37 Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance e63557bf-fd6b-4440-99ea-2cf6068000bb could not be found. Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'e63557bf-fd6b-4440-99ea-2cf6068000bb'} Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e63557bf-fd6b-4440-99ea-2cf6068000bb could not be found. Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e63557bf-fd6b-4440-99ea-2cf6068000bb could not be found. Oct 18 15:41:13.116954 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:41:13.122451 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:41:13.122451 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:41:13.122451 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:13.122451 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:41:13.122451 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:41:13.122451 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:41:13.122451 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:41:13.122451 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e63557bf-fd6b-4440-99ea-2cf6068000bb could not be found. Oct 18 15:41:13.122451 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:41:13.124182 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-66d92f0d-7d4c-420a-82e9-6160997a6f0e tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] Returning 404 to user: Instance e63557bf-fd6b-4440-99ea-2cf6068000bb could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:41:13.125185 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-66d92f0d-7d4c-420a-82e9-6160997a6f0e tempest-FloatingIPsAssociationNegativeTestJSON-1295484176 tempest-FloatingIPsAssociationNegativeTestJSON-1295484176-project] 10.222.0.60 "GET /compute/v2.1/servers/e63557bf-fd6b-4440-99ea-2cf6068000bb" status: 404 len: 111 microversion: 2.1 time: 0.062765 Oct 18 15:41:13.125764 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1868/3738] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:13 2022] GET /compute/v2.1/servers/e63557bf-fd6b-4440-99ea-2cf6068000bb => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:41:13.229206 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dc93c86a-c97a-4027-8dad-1cb35c27ba5e tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:13.230913 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dc93c86a-c97a-4027-8dad-1cb35c27ba5e tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 47ee1803-1ce0-4cbc-879e-d39cfe8576aa] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:13.243451 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc93c86a-c97a-4027-8dad-1cb35c27ba5e tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:13.244640 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc93c86a-c97a-4027-8dad-1cb35c27ba5e tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:13.245507 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc93c86a-c97a-4027-8dad-1cb35c27ba5e tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:13.247321 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc93c86a-c97a-4027-8dad-1cb35c27ba5e tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:13.248115 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc93c86a-c97a-4027-8dad-1cb35c27ba5e tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:13.249788 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc93c86a-c97a-4027-8dad-1cb35c27ba5e tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:13.390590 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dc93c86a-c97a-4027-8dad-1cb35c27ba5e tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:13.403203 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dc93c86a-c97a-4027-8dad-1cb35c27ba5e tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee1803-1ce0-4cbc-879e-d39cfe8576aa" status: 200 len: 1298 microversion: 2.1 time: 0.182960 Oct 18 15:41:13.406890 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1871/3739] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:13 2022] GET /compute/v2.1/servers/47ee1803-1ce0-4cbc-879e-d39cfe8576aa => generated 1298 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:13.983636 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7483b1bd-5e0c-4581-bb18-d996e33eacda tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:13.984602 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7483b1bd-5e0c-4581-bb18-d996e33eacda tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] [instance: bea3a8ec-d421-45b4-b6d8-397ac80c920d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:13.993296 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7483b1bd-5e0c-4581-bb18-d996e33eacda tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:13.993993 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7483b1bd-5e0c-4581-bb18-d996e33eacda tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:13.994613 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7483b1bd-5e0c-4581-bb18-d996e33eacda tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:13.995779 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7483b1bd-5e0c-4581-bb18-d996e33eacda tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:13.996597 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7483b1bd-5e0c-4581-bb18-d996e33eacda tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:13.999190 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7483b1bd-5e0c-4581-bb18-d996e33eacda tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:14.228222 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7483b1bd-5e0c-4581-bb18-d996e33eacda tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:14.239503 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7483b1bd-5e0c-4581-bb18-d996e33eacda tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers/bea3a8ec-d421-45b4-b6d8-397ac80c920d" status: 200 len: 1508 microversion: 2.1 time: 0.265733 Oct 18 15:41:14.242876 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1869/3740] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:13 2022] GET /compute/v2.1/servers/bea3a8ec-d421-45b4-b6d8-397ac80c920d => generated 1508 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:14.430584 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-aff75185-0358-4d48-8446-bdb1e9616f22 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:14.431396 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-aff75185-0358-4d48-8446-bdb1e9616f22 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 47ee1803-1ce0-4cbc-879e-d39cfe8576aa] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:14.442058 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aff75185-0358-4d48-8446-bdb1e9616f22 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:14.459245 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aff75185-0358-4d48-8446-bdb1e9616f22 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:14.459708 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aff75185-0358-4d48-8446-bdb1e9616f22 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:14.460675 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aff75185-0358-4d48-8446-bdb1e9616f22 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:14.461253 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aff75185-0358-4d48-8446-bdb1e9616f22 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:14.463210 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aff75185-0358-4d48-8446-bdb1e9616f22 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:14.758768 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-aff75185-0358-4d48-8446-bdb1e9616f22 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:14.766613 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-aff75185-0358-4d48-8446-bdb1e9616f22 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee1803-1ce0-4cbc-879e-d39cfe8576aa" status: 200 len: 1365 microversion: 2.1 time: 0.340322 Oct 18 15:41:14.771067 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1872/3741] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:14 2022] GET /compute/v2.1/servers/47ee1803-1ce0-4cbc-879e-d39cfe8576aa => generated 1365 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:14.807971 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-94d57180-8d98-4a0c-944c-a82785de782c req-2da9d5bf-be9c-4755-ba6b-6cd2c315001f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47ee1803-1ce0-4cbc-879e-d39cfe8576aa", "tag": "6255b173-b912-4205-9fcd-434867d970a5"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:41:14.825296 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-94d57180-8d98-4a0c-944c-a82785de782c req-2da9d5bf-be9c-4755-ba6b-6cd2c315001f service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:14.829122 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-94d57180-8d98-4a0c-944c-a82785de782c req-2da9d5bf-be9c-4755-ba6b-6cd2c315001f service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:14.829939 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-94d57180-8d98-4a0c-944c-a82785de782c req-2da9d5bf-be9c-4755-ba6b-6cd2c315001f service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:14.855572 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-94d57180-8d98-4a0c-944c-a82785de782c req-2da9d5bf-be9c-4755-ba6b-6cd2c315001f service nova] Creating event network-changed:6255b173-b912-4205-9fcd-434867d970a5 for instance 47ee1803-1ce0-4cbc-879e-d39cfe8576aa on n-h1-853682-5 Oct 18 15:41:14.866513 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-94d57180-8d98-4a0c-944c-a82785de782c req-2da9d5bf-be9c-4755-ba6b-6cd2c315001f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062107 Oct 18 15:41:14.870943 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1870/3742] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:41:15.270944 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f8df65bc-3a10-418f-9706-3a0018d8adeb tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:15.271512 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f8df65bc-3a10-418f-9706-3a0018d8adeb tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] [instance: bea3a8ec-d421-45b4-b6d8-397ac80c920d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:15.281454 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8df65bc-3a10-418f-9706-3a0018d8adeb tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:15.281957 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8df65bc-3a10-418f-9706-3a0018d8adeb tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:15.282400 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8df65bc-3a10-418f-9706-3a0018d8adeb tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:15.283471 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8df65bc-3a10-418f-9706-3a0018d8adeb tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:15.285420 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8df65bc-3a10-418f-9706-3a0018d8adeb tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:15.285870 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8df65bc-3a10-418f-9706-3a0018d8adeb tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:15.800034 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-27ff22c8-3f60-42ab-9740-ba46137d3390 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:15.801180 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-27ff22c8-3f60-42ab-9740-ba46137d3390 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 47ee1803-1ce0-4cbc-879e-d39cfe8576aa] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:15.819733 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-27ff22c8-3f60-42ab-9740-ba46137d3390 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:15.820506 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-27ff22c8-3f60-42ab-9740-ba46137d3390 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:15.825443 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-27ff22c8-3f60-42ab-9740-ba46137d3390 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:15.826393 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-27ff22c8-3f60-42ab-9740-ba46137d3390 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:15.827028 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-27ff22c8-3f60-42ab-9740-ba46137d3390 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:15.827618 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-27ff22c8-3f60-42ab-9740-ba46137d3390 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:16.247339 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-27ff22c8-3f60-42ab-9740-ba46137d3390 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:16.259898 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f8df65bc-3a10-418f-9706-3a0018d8adeb tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:16.269083 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-27ff22c8-3f60-42ab-9740-ba46137d3390 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee1803-1ce0-4cbc-879e-d39cfe8576aa" status: 200 len: 1365 microversion: 2.1 time: 0.474232 Oct 18 15:41:16.274307 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f8df65bc-3a10-418f-9706-3a0018d8adeb tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers/bea3a8ec-d421-45b4-b6d8-397ac80c920d" status: 200 len: 1512 microversion: 2.1 time: 1.008085 Oct 18 15:41:16.284694 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1871/3743] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:15 2022] GET /compute/v2.1/servers/47ee1803-1ce0-4cbc-879e-d39cfe8576aa => generated 1365 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:41:16.296715 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1873/3744] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:15 2022] GET /compute/v2.1/servers/bea3a8ec-d421-45b4-b6d8-397ac80c920d => generated 1512 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:16.305183 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5b4747b8-32f2-47a0-80dc-715dd9ff8fb3 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:16.311232 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5b4747b8-32f2-47a0-80dc-715dd9ff8fb3 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:16.315738 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.compute.servers [None req-5b4747b8-32f2-47a0-80dc-715dd9ff8fb3 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Removing options 'limit' from query {{(pid=120405) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 18 15:41:16.317571 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5b4747b8-32f2-47a0-80dc-715dd9ff8fb3 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Searching by: {'deleted': False, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1'} {{(pid=120405) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 15:41:16.320419 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5b4747b8-32f2-47a0-80dc-715dd9ff8fb3 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:16.321022 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5b4747b8-32f2-47a0-80dc-715dd9ff8fb3 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:16.321713 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5b4747b8-32f2-47a0-80dc-715dd9ff8fb3 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:16.322734 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5b4747b8-32f2-47a0-80dc-715dd9ff8fb3 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:16.323298 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5b4747b8-32f2-47a0-80dc-715dd9ff8fb3 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:16.323716 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5b4747b8-32f2-47a0-80dc-715dd9ff8fb3 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:16.325617 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5b4747b8-32f2-47a0-80dc-715dd9ff8fb3 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.024482 Oct 18 15:41:16.327308 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1872/3745] 10.222.0.60 () {58 vars in 1140 bytes} [Tue Oct 18 15:41:16 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:41:16.347542 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2f189564-50d2-41e9-9d8a-1cfe09eaf7f8 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:16.348433 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2f189564-50d2-41e9-9d8a-1cfe09eaf7f8 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] [instance: bea3a8ec-d421-45b4-b6d8-397ac80c920d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:16.360699 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f189564-50d2-41e9-9d8a-1cfe09eaf7f8 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:16.363801 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f189564-50d2-41e9-9d8a-1cfe09eaf7f8 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:16.368754 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f189564-50d2-41e9-9d8a-1cfe09eaf7f8 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:16.369839 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f189564-50d2-41e9-9d8a-1cfe09eaf7f8 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:16.370460 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f189564-50d2-41e9-9d8a-1cfe09eaf7f8 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:16.372392 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f189564-50d2-41e9-9d8a-1cfe09eaf7f8 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:16.658380 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2f189564-50d2-41e9-9d8a-1cfe09eaf7f8 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:16.669699 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2f189564-50d2-41e9-9d8a-1cfe09eaf7f8 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers/bea3a8ec-d421-45b4-b6d8-397ac80c920d" status: 200 len: 1512 microversion: 2.1 time: 0.330860 Oct 18 15:41:16.676056 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1874/3746] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:16 2022] GET /compute/v2.1/servers/bea3a8ec-d421-45b4-b6d8-397ac80c920d => generated 1512 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:16.693098 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-394adb9d-8e70-4326-ab2e-c97f7b455b23 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:16.695017 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-394adb9d-8e70-4326-ab2e-c97f7b455b23 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] [instance: 568f29d6-ddaf-4515-84dd-7cdab0922c97] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:16.702462 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-394adb9d-8e70-4326-ab2e-c97f7b455b23 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:16.704074 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-394adb9d-8e70-4326-ab2e-c97f7b455b23 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:16.704523 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-394adb9d-8e70-4326-ab2e-c97f7b455b23 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:16.705271 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-394adb9d-8e70-4326-ab2e-c97f7b455b23 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:16.705754 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-394adb9d-8e70-4326-ab2e-c97f7b455b23 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:16.706673 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-394adb9d-8e70-4326-ab2e-c97f7b455b23 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:16.727491 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:41:16.747658 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b1aaa10b-55b1-43bb-8709-4366065ad199 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:16.752387 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b1aaa10b-55b1-43bb-8709-4366065ad199 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e4287d8ca081403289857f84e3d0c3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e54dfc6654672a9423c9de5be3e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:16.753079 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b1aaa10b-55b1-43bb-8709-4366065ad199 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Searching by: {'deleted': False, 'project_id': '863e54dfc6654672a9423c9de5be3e03'} {{(pid=120406) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 15:41:16.758623 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1aaa10b-55b1-43bb-8709-4366065ad199 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:16.759270 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1aaa10b-55b1-43bb-8709-4366065ad199 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:16.759893 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1aaa10b-55b1-43bb-8709-4366065ad199 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:16.760627 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1aaa10b-55b1-43bb-8709-4366065ad199 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:16.761128 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1aaa10b-55b1-43bb-8709-4366065ad199 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:16.761800 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1aaa10b-55b1-43bb-8709-4366065ad199 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:16.792273 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.multi_cell_list [None req-b1aaa10b-55b1-43bb-8709-4366065ad199 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120406) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 15:41:16.828974 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b1aaa10b-55b1-43bb-8709-4366065ad199 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.085201 Oct 18 15:41:16.833021 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1875/3747] 10.222.0.60 () {58 vars in 1125 bytes} [Tue Oct 18 15:41:16 2022] GET /compute/v2.1/servers => generated 340 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:41:16.859026 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2fcedde1-9289-4ca3-9a32-1ba9a76940e3 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:16.865944 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2fcedde1-9289-4ca3-9a32-1ba9a76940e3 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e4287d8ca081403289857f84e3d0c3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e54dfc6654672a9423c9de5be3e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:16.867319 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2fcedde1-9289-4ca3-9a32-1ba9a76940e3 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Searching by: {'deleted': False, 'project_id': '863e54dfc6654672a9423c9de5be3e03'} {{(pid=120406) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 15:41:16.876092 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2fcedde1-9289-4ca3-9a32-1ba9a76940e3 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:16.877279 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2fcedde1-9289-4ca3-9a32-1ba9a76940e3 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:16.877943 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2fcedde1-9289-4ca3-9a32-1ba9a76940e3 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:16.879157 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2fcedde1-9289-4ca3-9a32-1ba9a76940e3 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:16.880146 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2fcedde1-9289-4ca3-9a32-1ba9a76940e3 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:16.880836 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2fcedde1-9289-4ca3-9a32-1ba9a76940e3 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:16.931964 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-394adb9d-8e70-4326-ab2e-c97f7b455b23 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:16.962760 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-394adb9d-8e70-4326-ab2e-c97f7b455b23 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers/568f29d6-ddaf-4515-84dd-7cdab0922c97" status: 200 len: 1511 microversion: 2.1 time: 0.269071 Oct 18 15:41:16.963516 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1873/3748] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:16 2022] GET /compute/v2.1/servers/568f29d6-ddaf-4515-84dd-7cdab0922c97 => generated 1511 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:16.993687 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-807b4b71-f4c2-4ffe-810c-d69aa2d6ee91 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:16.997062 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-807b4b71-f4c2-4ffe-810c-d69aa2d6ee91 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] [instance: f9620891-182f-40dd-8abe-42b8b0e1b758] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:16.997901 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.multi_cell_list [None req-2fcedde1-9289-4ca3-9a32-1ba9a76940e3 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120406) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 15:41:17.020828 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-807b4b71-f4c2-4ffe-810c-d69aa2d6ee91 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:17.021479 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-807b4b71-f4c2-4ffe-810c-d69aa2d6ee91 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:17.023312 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-807b4b71-f4c2-4ffe-810c-d69aa2d6ee91 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:17.028661 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-807b4b71-f4c2-4ffe-810c-d69aa2d6ee91 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:17.030022 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-807b4b71-f4c2-4ffe-810c-d69aa2d6ee91 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:17.031627 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-807b4b71-f4c2-4ffe-810c-d69aa2d6ee91 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:17.048041 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2fcedde1-9289-4ca3-9a32-1ba9a76940e3 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4287d8ca081403289857f84e3d0c3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e54dfc6654672a9423c9de5be3e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:17.061024 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2fcedde1-9289-4ca3-9a32-1ba9a76940e3 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:17.062644 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2fcedde1-9289-4ca3-9a32-1ba9a76940e3 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:17.063564 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2fcedde1-9289-4ca3-9a32-1ba9a76940e3 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:17.364944 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-807b4b71-f4c2-4ffe-810c-d69aa2d6ee91 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:17.384673 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-807b4b71-f4c2-4ffe-810c-d69aa2d6ee91 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers/f9620891-182f-40dd-8abe-42b8b0e1b758" status: 200 len: 1513 microversion: 2.1 time: 0.397878 Oct 18 15:41:17.393739 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1874/3749] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:16 2022] GET /compute/v2.1/servers/f9620891-182f-40dd-8abe-42b8b0e1b758 => generated 1513 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:41:17.399462 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0a8d101b-3749-4d63-9df7-c22cbd00e7d1 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:17.402457 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0a8d101b-3749-4d63-9df7-c22cbd00e7d1 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 47ee1803-1ce0-4cbc-879e-d39cfe8576aa] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:17.416495 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0a8d101b-3749-4d63-9df7-c22cbd00e7d1 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:17.417025 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0a8d101b-3749-4d63-9df7-c22cbd00e7d1 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:17.417460 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0a8d101b-3749-4d63-9df7-c22cbd00e7d1 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:17.418164 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0a8d101b-3749-4d63-9df7-c22cbd00e7d1 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:17.421785 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0a8d101b-3749-4d63-9df7-c22cbd00e7d1 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:17.422228 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0a8d101b-3749-4d63-9df7-c22cbd00e7d1 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:17.544937 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2fcedde1-9289-4ca3-9a32-1ba9a76940e3 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] 10.222.0.60 "GET /compute/v2.1/servers/detail" status: 200 len: 1710 microversion: 2.1 time: 0.697313 Oct 18 15:41:17.545552 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1876/3750] 10.222.0.60 () {58 vars in 1146 bytes} [Tue Oct 18 15:41:16 2022] GET /compute/v2.1/servers/detail => generated 1710 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:17.550507 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-492298e9-255e-42cb-a305-377e143be049 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:17.556652 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-492298e9-255e-42cb-a305-377e143be049 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:17.557314 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-492298e9-255e-42cb-a305-377e143be049 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Searching by: {'ip': '172.20.0.12', 'deleted': False, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1'} {{(pid=120406) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 15:41:17.743876 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-492298e9-255e-42cb-a305-377e143be049 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:17.744729 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-492298e9-255e-42cb-a305-377e143be049 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:17.745567 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-492298e9-255e-42cb-a305-377e143be049 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:17.746507 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-492298e9-255e-42cb-a305-377e143be049 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:17.747267 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-492298e9-255e-42cb-a305-377e143be049 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:17.748079 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-492298e9-255e-42cb-a305-377e143be049 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:17.799374 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0a8d101b-3749-4d63-9df7-c22cbd00e7d1 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:17.817966 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0a8d101b-3749-4d63-9df7-c22cbd00e7d1 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee1803-1ce0-4cbc-879e-d39cfe8576aa" status: 200 len: 1365 microversion: 2.1 time: 0.422260 Oct 18 15:41:17.819802 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1875/3751] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:17 2022] GET /compute/v2.1/servers/47ee1803-1ce0-4cbc-879e-d39cfe8576aa => generated 1365 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:17.830603 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1de07962-a6b4-4113-a894-6fe7ee67a408 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:17.842148 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1de07962-a6b4-4113-a894-6fe7ee67a408 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021030 Oct 18 15:41:17.851645 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1876/3752] 10.222.0.60 () {58 vars in 1137 bytes} [Tue Oct 18 15:41:17 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:41:17.890201 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:41:17.894868 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.multi_cell_list [None req-492298e9-255e-42cb-a305-377e143be049 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120406) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 15:41:17.974576 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-492298e9-255e-42cb-a305-377e143be049 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers?ip=172.20.0.12" status: 200 len: 346 microversion: 2.1 time: 0.427972 Oct 18 15:41:17.975640 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1877/3753] 10.222.0.60 () {58 vars in 1154 bytes} [Tue Oct 18 15:41:17 2022] GET /compute/v2.1/servers?ip=172.20.0.12 => generated 346 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:41:17.988319 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ccc47336-a563-44bd-8270-017a349a6504 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:17.989040 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ccc47336-a563-44bd-8270-017a349a6504 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] [instance: bea3a8ec-d421-45b4-b6d8-397ac80c920d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:17.996946 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ccc47336-a563-44bd-8270-017a349a6504 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:17.997434 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ccc47336-a563-44bd-8270-017a349a6504 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:17.997867 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ccc47336-a563-44bd-8270-017a349a6504 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:17.998564 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ccc47336-a563-44bd-8270-017a349a6504 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:17.999017 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ccc47336-a563-44bd-8270-017a349a6504 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:17.999443 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ccc47336-a563-44bd-8270-017a349a6504 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:18.187298 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8d8792d1-6b90-46e3-8fa5-9634a88ccf82 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:18.187889 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8d8792d1-6b90-46e3-8fa5-9634a88ccf82 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] [instance: 2e52e036-3ac0-4bbd-abe3-4c0b1957734f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:18.195007 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d8792d1-6b90-46e3-8fa5-9634a88ccf82 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:18.195504 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d8792d1-6b90-46e3-8fa5-9634a88ccf82 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:18.195956 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d8792d1-6b90-46e3-8fa5-9634a88ccf82 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:18.196657 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d8792d1-6b90-46e3-8fa5-9634a88ccf82 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:18.197153 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d8792d1-6b90-46e3-8fa5-9634a88ccf82 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:18.197649 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d8792d1-6b90-46e3-8fa5-9634a88ccf82 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:18.228412 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8d8792d1-6b90-46e3-8fa5-9634a88ccf82 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] [instance: 2e52e036-3ac0-4bbd-abe3-4c0b1957734f] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:41:18.322717 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ccc47336-a563-44bd-8270-017a349a6504 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:18.332348 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8d8792d1-6b90-46e3-8fa5-9634a88ccf82 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] 10.222.0.60 "DELETE /compute/v2.1/servers/2e52e036-3ac0-4bbd-abe3-4c0b1957734f" status: 204 len: 0 microversion: 2.1 time: 0.149177 Oct 18 15:41:18.334063 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1878/3754] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:41:18 2022] DELETE /compute/v2.1/servers/2e52e036-3ac0-4bbd-abe3-4c0b1957734f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:41:18.342900 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ccc47336-a563-44bd-8270-017a349a6504 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers/bea3a8ec-d421-45b4-b6d8-397ac80c920d" status: 200 len: 1512 microversion: 2.1 time: 0.358058 Oct 18 15:41:18.344162 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1877/3755] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:17 2022] GET /compute/v2.1/servers/bea3a8ec-d421-45b4-b6d8-397ac80c920d => generated 1512 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:18.347442 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ddf424c3-3bea-41f9-8b4e-8099e4317ca5 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:18.348528 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ddf424c3-3bea-41f9-8b4e-8099e4317ca5 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] [instance: 2e52e036-3ac0-4bbd-abe3-4c0b1957734f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:18.356667 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ddf424c3-3bea-41f9-8b4e-8099e4317ca5 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:18.357848 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ddf424c3-3bea-41f9-8b4e-8099e4317ca5 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:18.358543 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ddf424c3-3bea-41f9-8b4e-8099e4317ca5 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:18.359703 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ddf424c3-3bea-41f9-8b4e-8099e4317ca5 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:18.360583 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ddf424c3-3bea-41f9-8b4e-8099e4317ca5 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:18.361312 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ddf424c3-3bea-41f9-8b4e-8099e4317ca5 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:18.372044 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c6a13237-17b9-4cdb-8710-e0e1430d13cf tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:18.372786 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c6a13237-17b9-4cdb-8710-e0e1430d13cf tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] [instance: 568f29d6-ddaf-4515-84dd-7cdab0922c97] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:18.382322 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c6a13237-17b9-4cdb-8710-e0e1430d13cf tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:18.383096 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c6a13237-17b9-4cdb-8710-e0e1430d13cf tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:18.384190 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c6a13237-17b9-4cdb-8710-e0e1430d13cf tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:18.385865 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c6a13237-17b9-4cdb-8710-e0e1430d13cf tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:18.386556 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c6a13237-17b9-4cdb-8710-e0e1430d13cf tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:18.387211 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c6a13237-17b9-4cdb-8710-e0e1430d13cf tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:18.748568 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ddf424c3-3bea-41f9-8b4e-8099e4317ca5 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4287d8ca081403289857f84e3d0c3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e54dfc6654672a9423c9de5be3e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:18.759743 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c6a13237-17b9-4cdb-8710-e0e1430d13cf tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:18.766721 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ddf424c3-3bea-41f9-8b4e-8099e4317ca5 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] 10.222.0.60 "GET /compute/v2.1/servers/2e52e036-3ac0-4bbd-abe3-4c0b1957734f" status: 200 len: 1713 microversion: 2.1 time: 0.427012 Oct 18 15:41:18.768930 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1879/3756] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:18 2022] GET /compute/v2.1/servers/2e52e036-3ac0-4bbd-abe3-4c0b1957734f => generated 1713 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:41:18.784549 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c6a13237-17b9-4cdb-8710-e0e1430d13cf tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers/568f29d6-ddaf-4515-84dd-7cdab0922c97" status: 200 len: 1511 microversion: 2.1 time: 0.419896 Oct 18 15:41:18.786759 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1878/3757] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:18 2022] GET /compute/v2.1/servers/568f29d6-ddaf-4515-84dd-7cdab0922c97 => generated 1511 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:18.812571 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d65a0b9e-394a-42c7-8d56-35e825264450 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:18.813320 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d65a0b9e-394a-42c7-8d56-35e825264450 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] [instance: f9620891-182f-40dd-8abe-42b8b0e1b758] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:18.825454 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d65a0b9e-394a-42c7-8d56-35e825264450 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:18.827358 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d65a0b9e-394a-42c7-8d56-35e825264450 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:18.829405 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d65a0b9e-394a-42c7-8d56-35e825264450 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:18.831205 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d65a0b9e-394a-42c7-8d56-35e825264450 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:18.832225 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d65a0b9e-394a-42c7-8d56-35e825264450 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:18.833072 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d65a0b9e-394a-42c7-8d56-35e825264450 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:18.843649 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-572c21b4-0ad0-4bde-a854-2bafd422d44f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:18.844601 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-572c21b4-0ad0-4bde-a854-2bafd422d44f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 47ee1803-1ce0-4cbc-879e-d39cfe8576aa] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:18.854974 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-572c21b4-0ad0-4bde-a854-2bafd422d44f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:18.855733 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-572c21b4-0ad0-4bde-a854-2bafd422d44f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:18.856391 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-572c21b4-0ad0-4bde-a854-2bafd422d44f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:18.857728 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-572c21b4-0ad0-4bde-a854-2bafd422d44f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:18.858349 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-572c21b4-0ad0-4bde-a854-2bafd422d44f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:18.859790 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-572c21b4-0ad0-4bde-a854-2bafd422d44f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:19.163653 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d65a0b9e-394a-42c7-8d56-35e825264450 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:19.178150 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d65a0b9e-394a-42c7-8d56-35e825264450 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers/f9620891-182f-40dd-8abe-42b8b0e1b758" status: 200 len: 1513 microversion: 2.1 time: 0.368972 Oct 18 15:41:19.179623 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1880/3758] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:18 2022] GET /compute/v2.1/servers/f9620891-182f-40dd-8abe-42b8b0e1b758 => generated 1513 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:19.193791 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-572c21b4-0ad0-4bde-a854-2bafd422d44f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:19.203432 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0b000f61-9b5f-4140-8d20-8b9387914eea tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:19.204826 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-572c21b4-0ad0-4bde-a854-2bafd422d44f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee1803-1ce0-4cbc-879e-d39cfe8576aa" status: 200 len: 1365 microversion: 2.1 time: 0.365177 Oct 18 15:41:19.205760 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1879/3759] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:18 2022] GET /compute/v2.1/servers/47ee1803-1ce0-4cbc-879e-d39cfe8576aa => generated 1365 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:41:19.215273 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0b000f61-9b5f-4140-8d20-8b9387914eea tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:19.216433 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0b000f61-9b5f-4140-8d20-8b9387914eea tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Searching by: {'deleted': False, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1'} {{(pid=120406) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 15:41:19.227074 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b000f61-9b5f-4140-8d20-8b9387914eea tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:19.227794 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b000f61-9b5f-4140-8d20-8b9387914eea tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:19.228401 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b000f61-9b5f-4140-8d20-8b9387914eea tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:19.229325 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b000f61-9b5f-4140-8d20-8b9387914eea tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:19.230148 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b000f61-9b5f-4140-8d20-8b9387914eea tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:19.230742 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b000f61-9b5f-4140-8d20-8b9387914eea tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:19.265583 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.multi_cell_list [None req-0b000f61-9b5f-4140-8d20-8b9387914eea tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120406) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 15:41:19.302377 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0b000f61-9b5f-4140-8d20-8b9387914eea tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:19.312206 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b000f61-9b5f-4140-8d20-8b9387914eea tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:19.313031 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b000f61-9b5f-4140-8d20-8b9387914eea tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:19.313643 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b000f61-9b5f-4140-8d20-8b9387914eea tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:19.553621 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0b000f61-9b5f-4140-8d20-8b9387914eea tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers/detail" status: 200 len: 4519 microversion: 2.1 time: 0.354599 Oct 18 15:41:19.554748 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1881/3760] 10.222.0.60 () {58 vars in 1146 bytes} [Tue Oct 18 15:41:19 2022] GET /compute/v2.1/servers/detail => generated 4519 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:19.582261 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-285551e0-56e4-4f28-8465-2175f5006a85 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:19.587496 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-285551e0-56e4-4f28-8465-2175f5006a85 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:19.588165 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-285551e0-56e4-4f28-8465-2175f5006a85 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1'} {{(pid=120405) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 15:41:19.708298 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-285551e0-56e4-4f28-8465-2175f5006a85 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:19.709178 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-285551e0-56e4-4f28-8465-2175f5006a85 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:19.709916 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-285551e0-56e4-4f28-8465-2175f5006a85 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:19.711381 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-285551e0-56e4-4f28-8465-2175f5006a85 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:19.713638 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-285551e0-56e4-4f28-8465-2175f5006a85 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:19.714436 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-285551e0-56e4-4f28-8465-2175f5006a85 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:19.794772 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-08d85c9f-f773-4a1c-8bea-e4ae1497ba76 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:19.795401 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-08d85c9f-f773-4a1c-8bea-e4ae1497ba76 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] [instance: 2e52e036-3ac0-4bbd-abe3-4c0b1957734f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:19.804632 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-08d85c9f-f773-4a1c-8bea-e4ae1497ba76 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:19.805147 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-08d85c9f-f773-4a1c-8bea-e4ae1497ba76 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:19.805579 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-08d85c9f-f773-4a1c-8bea-e4ae1497ba76 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:19.807405 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-08d85c9f-f773-4a1c-8bea-e4ae1497ba76 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:19.809487 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-08d85c9f-f773-4a1c-8bea-e4ae1497ba76 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:19.810314 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-08d85c9f-f773-4a1c-8bea-e4ae1497ba76 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:19.812458 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.multi_cell_list [None req-285551e0-56e4-4f28-8465-2175f5006a85 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120405) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 15:41:19.888591 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-285551e0-56e4-4f28-8465-2175f5006a85 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.310004 Oct 18 15:41:19.889739 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1880/3761] 10.222.0.60 () {58 vars in 1150 bytes} [Tue Oct 18 15:41:19 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:19.916727 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-49aefe77-70b4-4808-8f65-c38f3492f765 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:19.935171 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-49aefe77-70b4-4808-8f65-c38f3492f765 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:19.937655 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-49aefe77-70b4-4808-8f65-c38f3492f765 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1'} {{(pid=120405) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 15:41:19.949512 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-49aefe77-70b4-4808-8f65-c38f3492f765 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:19.950312 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-49aefe77-70b4-4808-8f65-c38f3492f765 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:19.950745 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-49aefe77-70b4-4808-8f65-c38f3492f765 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:19.951474 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-49aefe77-70b4-4808-8f65-c38f3492f765 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:19.953259 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-49aefe77-70b4-4808-8f65-c38f3492f765 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:19.953764 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-49aefe77-70b4-4808-8f65-c38f3492f765 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:20.123590 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.multi_cell_list [None req-49aefe77-70b4-4808-8f65-c38f3492f765 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120405) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 15:41:20.201477 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-08d85c9f-f773-4a1c-8bea-e4ae1497ba76 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4287d8ca081403289857f84e3d0c3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e54dfc6654672a9423c9de5be3e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:20.211668 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-08d85c9f-f773-4a1c-8bea-e4ae1497ba76 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] 10.222.0.60 "GET /compute/v2.1/servers/2e52e036-3ac0-4bbd-abe3-4c0b1957734f" status: 200 len: 1713 microversion: 2.1 time: 0.424469 Oct 18 15:41:20.212248 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1882/3762] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:19 2022] GET /compute/v2.1/servers/2e52e036-3ac0-4bbd-abe3-4c0b1957734f => generated 1713 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:41:20.224979 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-49aefe77-70b4-4808-8f65-c38f3492f765 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.312539 Oct 18 15:41:20.224979 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1881/3763] 10.222.0.60 () {58 vars in 1212 bytes} [Tue Oct 18 15:41:19 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:20.233418 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-030e1b37-5817-4a03-8a29-f204d0a82fc7 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:20.234429 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-030e1b37-5817-4a03-8a29-f204d0a82fc7 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 47ee1803-1ce0-4cbc-879e-d39cfe8576aa] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:20.242136 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-030e1b37-5817-4a03-8a29-f204d0a82fc7 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:20.242888 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-030e1b37-5817-4a03-8a29-f204d0a82fc7 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:20.243500 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-030e1b37-5817-4a03-8a29-f204d0a82fc7 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:20.245339 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-030e1b37-5817-4a03-8a29-f204d0a82fc7 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:20.246105 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-030e1b37-5817-4a03-8a29-f204d0a82fc7 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:20.246698 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-030e1b37-5817-4a03-8a29-f204d0a82fc7 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:20.532963 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e241adca-eef3-4715-8ddd-7ada1dedb758 tempest-ImagesDeleteNegativeTestJSON-260230290 tempest-ImagesDeleteNegativeTestJSON-260230290-project] 10.222.0.60 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.313694 Oct 18 15:41:20.539250 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1882/3764] 10.222.0.60 () {58 vars in 1128 bytes} [Tue Oct 18 15:41:20 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 18 15:41:20.542118 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9fa8179d-85df-468b-8086-ce6950a74579 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:20.547512 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9fa8179d-85df-468b-8086-ce6950a74579 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:20.548236 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9fa8179d-85df-468b-8086-ce6950a74579 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1'} {{(pid=120405) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 15:41:20.554871 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9fa8179d-85df-468b-8086-ce6950a74579 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:20.555632 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9fa8179d-85df-468b-8086-ce6950a74579 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:20.556436 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9fa8179d-85df-468b-8086-ce6950a74579 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:20.557926 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9fa8179d-85df-468b-8086-ce6950a74579 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:20.558575 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9fa8179d-85df-468b-8086-ce6950a74579 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:20.559300 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9fa8179d-85df-468b-8086-ce6950a74579 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:20.562812 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-030e1b37-5817-4a03-8a29-f204d0a82fc7 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:20.575649 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-030e1b37-5817-4a03-8a29-f204d0a82fc7 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee1803-1ce0-4cbc-879e-d39cfe8576aa" status: 200 len: 1365 microversion: 2.1 time: 0.346478 Oct 18 15:41:20.580723 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1883/3765] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:20 2022] GET /compute/v2.1/servers/47ee1803-1ce0-4cbc-879e-d39cfe8576aa => generated 1365 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:20.592518 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8f1ddb81-e904-40f8-aefc-0b39cef1e738 tempest-ImagesDeleteNegativeTestJSON-260230290 tempest-ImagesDeleteNegativeTestJSON-260230290-project] Calling method '.version_select at 0x7f7c3d0241f0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:20.624294 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-8f1ddb81-e904-40f8-aefc-0b39cef1e738 tempest-ImagesDeleteNegativeTestJSON-260230290 tempest-ImagesDeleteNegativeTestJSON-260230290-project] HTTP exception thrown: Image not found. Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8f1ddb81-e904-40f8-aefc-0b39cef1e738 tempest-ImagesDeleteNegativeTestJSON-260230290 tempest-ImagesDeleteNegativeTestJSON-260230290-project] Request method failure captured: Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTskgFOZ9fmVXoDHCFVj3bbzVT3UtxuT32kE7hVqqwt0aC4zONfE_nGtcl_xRkkzhDb_M5aTzi0LKcydGluRLYtBguKlyR7GNP2hUJMN9muUSihbaUAdju2YPq0hinEk_VkJXHJuxcW2ZK2puc_zVI_IvRXyipGKJ-uHTIZ9Tdl2Ozvg Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 11fc9e6f9ea64e409e406ae1d1a0b796 Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-260230290 Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/11fc9e6f9ea64e409e406ae1d1a0b796"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/11fc9e6f9ea64e409e406ae1d1a0b796"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/11fc9e6f9ea64e409e406ae1d1a0b796"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_11fc9e6f9ea64e409e406ae1d1a0b796"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-260230290 Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 11fc9e6f9ea64e409e406ae1d1a0b796 Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-260230290 Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ImagesDeleteNegativeTestJSON-260230290-project Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 9af511deb6aa4b1e858f7899d01efe19 Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-260230290-project Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: exception: Image not found. Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '-1'} Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:20.628250 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:20.633931 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:41:20.633931 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:41:20.633931 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:41:20.633931 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:41:20.633931 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:41:20.633931 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:41:20.633931 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:41:20.633931 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:41:20.633931 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 18 15:41:20.633931 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 15:41:20.633931 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 15:41:20.633931 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:20.633931 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:41:20.633931 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:20.633931 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:20.633931 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:41:20.633931 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:41:20.633931 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:41:20.633931 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:41:20.633931 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 15:41:20.633931 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:20.633931 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8f1ddb81-e904-40f8-aefc-0b39cef1e738 tempest-ImagesDeleteNegativeTestJSON-260230290 tempest-ImagesDeleteNegativeTestJSON-260230290-project] Returning 404 to user: Image not found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:41:20.633931 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8f1ddb81-e904-40f8-aefc-0b39cef1e738 tempest-ImagesDeleteNegativeTestJSON-260230290 tempest-ImagesDeleteNegativeTestJSON-260230290-project] 10.222.0.60 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.049067 Oct 18 15:41:20.633931 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1884/3766] 10.222.0.60 () {58 vars in 1134 bytes} [Tue Oct 18 15:41:20 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 15:41:20.642263 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-96817bf9-a85a-4e64-b576-a954e4bef115 tempest-ImagesDeleteNegativeTestJSON-260230290 tempest-ImagesDeleteNegativeTestJSON-260230290-project] Calling method '.version_select at 0x7f7c3d01f940>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:20.665770 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-96817bf9-a85a-4e64-b576-a954e4bef115 tempest-ImagesDeleteNegativeTestJSON-260230290 tempest-ImagesDeleteNegativeTestJSON-260230290-project] HTTP exception thrown: Image not found. Oct 18 15:41:20.666481 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.multi_cell_list [None req-9fa8179d-85df-468b-8086-ce6950a74579 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120405) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-96817bf9-a85a-4e64-b576-a954e4bef115 tempest-ImagesDeleteNegativeTestJSON-260230290 tempest-ImagesDeleteNegativeTestJSON-260230290-project] Request method failure captured: Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/images/99e4561f-aca6-4cf3-a167-7a58e2e9e05j HTTP/1.1 Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTskgFOZ9fmVXoDHCFVj3bbzVT3UtxuT32kE7hVqqwt0aC4zONfE_nGtcl_xRkkzhDb_M5aTzi0LKcydGluRLYtBguKlyR7GNP2hUJMN9muUSihbaUAdju2YPq0hinEk_VkJXHJuxcW2ZK2puc_zVI_IvRXyipGKJ-uHTIZ9Tdl2Ozvg Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 11fc9e6f9ea64e409e406ae1d1a0b796 Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-260230290 Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/11fc9e6f9ea64e409e406ae1d1a0b796"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/11fc9e6f9ea64e409e406ae1d1a0b796"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/11fc9e6f9ea64e409e406ae1d1a0b796"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_11fc9e6f9ea64e409e406ae1d1a0b796"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-260230290 Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 11fc9e6f9ea64e409e406ae1d1a0b796 Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-260230290 Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ImagesDeleteNegativeTestJSON-260230290-project Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 9af511deb6aa4b1e858f7899d01efe19 Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-260230290-project Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: exception: Image not found. Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '99e4561f-aca6-4cf3-a167-7a58e2e9e05j'} Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 99e4561f-aca6-4cf3-a167-7a58e2e9e05j to delete Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 99e4561f-aca6-4cf3-a167-7a58e2e9e05j could not be found. Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:41:20.668366 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:20.673037 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:20.673037 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:41:20.673037 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:41:20.673037 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:41:20.673037 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:41:20.673037 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:41:20.673037 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:41:20.673037 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:41:20.673037 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:41:20.673037 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 18 15:41:20.673037 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 15:41:20.673037 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 15:41:20.673037 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:20.673037 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:41:20.673037 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:20.673037 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:20.673037 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:41:20.673037 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:41:20.673037 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:41:20.673037 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:41:20.673037 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 15:41:20.673037 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:20.673037 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-96817bf9-a85a-4e64-b576-a954e4bef115 tempest-ImagesDeleteNegativeTestJSON-260230290 tempest-ImagesDeleteNegativeTestJSON-260230290-project] Returning 404 to user: Image not found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:41:20.674633 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-96817bf9-a85a-4e64-b576-a954e4bef115 tempest-ImagesDeleteNegativeTestJSON-260230290 tempest-ImagesDeleteNegativeTestJSON-260230290-project] 10.222.0.60 "DELETE /compute/v2.1/images/99e4561f-aca6-4cf3-a167-7a58e2e9e05j" status: 404 len: 62 microversion: 2.1 time: 0.034077 Oct 18 15:41:20.674633 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1885/3767] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:20 2022] DELETE /compute/v2.1/images/99e4561f-aca6-4cf3-a167-7a58e2e9e05j => generated 62 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 15:41:20.691636 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c1686185-732b-4de8-874d-825062bfe330 tempest-ImagesDeleteNegativeTestJSON-260230290 tempest-ImagesDeleteNegativeTestJSON-260230290-project] Calling method '.version_select at 0x7f7c3cf2d820>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:20.716316 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-c1686185-732b-4de8-874d-825062bfe330 tempest-ImagesDeleteNegativeTestJSON-260230290 tempest-ImagesDeleteNegativeTestJSON-260230290-project] HTTP exception thrown: Image not found. Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c1686185-732b-4de8-874d-825062bfe330 tempest-ImagesDeleteNegativeTestJSON-260230290 tempest-ImagesDeleteNegativeTestJSON-260230290-project] Request method failure captured: Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/images/cae4acf3-e34c-43cd-953c-0cc9f3e540a91 HTTP/1.1 Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTskgFOZ9fmVXoDHCFVj3bbzVT3UtxuT32kE7hVqqwt0aC4zONfE_nGtcl_xRkkzhDb_M5aTzi0LKcydGluRLYtBguKlyR7GNP2hUJMN9muUSihbaUAdju2YPq0hinEk_VkJXHJuxcW2ZK2puc_zVI_IvRXyipGKJ-uHTIZ9Tdl2Ozvg Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 11fc9e6f9ea64e409e406ae1d1a0b796 Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-260230290 Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/11fc9e6f9ea64e409e406ae1d1a0b796"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/11fc9e6f9ea64e409e406ae1d1a0b796"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/11fc9e6f9ea64e409e406ae1d1a0b796"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_11fc9e6f9ea64e409e406ae1d1a0b796"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-260230290 Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 11fc9e6f9ea64e409e406ae1d1a0b796 Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-260230290 Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ImagesDeleteNegativeTestJSON-260230290-project Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 9af511deb6aa4b1e858f7899d01efe19 Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-260230290-project Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: exception: Image not found. Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'cae4acf3-e34c-43cd-953c-0cc9f3e540a91'} Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image cae4acf3-e34c-43cd-953c-0cc9f3e540a91 to delete Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cae4acf3-e34c-43cd-953c-0cc9f3e540a91 could not be found. Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:41:20.718321 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:20.726003 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:20.726003 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:41:20.726003 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:41:20.726003 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:41:20.726003 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:41:20.726003 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:41:20.726003 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:41:20.726003 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:41:20.726003 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:41:20.726003 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 18 15:41:20.726003 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 15:41:20.726003 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 15:41:20.726003 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:20.726003 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:41:20.726003 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:20.726003 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:20.726003 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:41:20.726003 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:41:20.726003 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:41:20.726003 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:41:20.726003 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 15:41:20.726003 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:20.737724 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c1686185-732b-4de8-874d-825062bfe330 tempest-ImagesDeleteNegativeTestJSON-260230290 tempest-ImagesDeleteNegativeTestJSON-260230290-project] Returning 404 to user: Image not found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:41:20.744174 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c1686185-732b-4de8-874d-825062bfe330 tempest-ImagesDeleteNegativeTestJSON-260230290 tempest-ImagesDeleteNegativeTestJSON-260230290-project] 10.222.0.60 "DELETE /compute/v2.1/images/cae4acf3-e34c-43cd-953c-0cc9f3e540a91" status: 404 len: 62 microversion: 2.1 time: 0.063221 Oct 18 15:41:20.751876 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1886/3768] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:41:20 2022] DELETE /compute/v2.1/images/cae4acf3-e34c-43cd-953c-0cc9f3e540a91 => generated 62 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 15:41:20.760621 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5944f374-89d2-458a-a89b-a216100a0900 tempest-ImagesDeleteNegativeTestJSON-260230290 tempest-ImagesDeleteNegativeTestJSON-260230290-project] Calling method '.version_select at 0x7f7c3cdbe1f0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:20.792749 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-5944f374-89d2-458a-a89b-a216100a0900 tempest-ImagesDeleteNegativeTestJSON-260230290 tempest-ImagesDeleteNegativeTestJSON-260230290-project] HTTP exception thrown: Image not found. Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5944f374-89d2-458a-a89b-a216100a0900 tempest-ImagesDeleteNegativeTestJSON-260230290 tempest-ImagesDeleteNegativeTestJSON-260230290-project] Request method failure captured: Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/images/tempest-invalid-1152003633 HTTP/1.1 Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTskgFOZ9fmVXoDHCFVj3bbzVT3UtxuT32kE7hVqqwt0aC4zONfE_nGtcl_xRkkzhDb_M5aTzi0LKcydGluRLYtBguKlyR7GNP2hUJMN9muUSihbaUAdju2YPq0hinEk_VkJXHJuxcW2ZK2puc_zVI_IvRXyipGKJ-uHTIZ9Tdl2Ozvg Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 11fc9e6f9ea64e409e406ae1d1a0b796 Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-260230290 Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/11fc9e6f9ea64e409e406ae1d1a0b796"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/11fc9e6f9ea64e409e406ae1d1a0b796"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/11fc9e6f9ea64e409e406ae1d1a0b796"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_11fc9e6f9ea64e409e406ae1d1a0b796"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-260230290 Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 11fc9e6f9ea64e409e406ae1d1a0b796 Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-260230290 Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ImagesDeleteNegativeTestJSON-260230290-project Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 9af511deb6aa4b1e858f7899d01efe19 Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-260230290-project Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: exception: Image not found. Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'tempest-invalid-1152003633'} Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1152003633 to delete Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1152003633 could not be found. Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:20.795670 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:20.802847 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:41:20.802847 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:41:20.802847 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:41:20.802847 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:41:20.802847 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:41:20.802847 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:41:20.802847 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:41:20.802847 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:41:20.802847 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 18 15:41:20.802847 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 15:41:20.802847 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 15:41:20.802847 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:20.802847 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:41:20.802847 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:20.802847 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:20.802847 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:41:20.802847 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:41:20.802847 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:41:20.802847 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:41:20.802847 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 15:41:20.802847 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:20.808903 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5944f374-89d2-458a-a89b-a216100a0900 tempest-ImagesDeleteNegativeTestJSON-260230290 tempest-ImagesDeleteNegativeTestJSON-260230290-project] Returning 404 to user: Image not found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:41:20.808903 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5944f374-89d2-458a-a89b-a216100a0900 tempest-ImagesDeleteNegativeTestJSON-260230290 tempest-ImagesDeleteNegativeTestJSON-260230290-project] 10.222.0.60 "DELETE /compute/v2.1/images/tempest-invalid-1152003633" status: 404 len: 62 microversion: 2.1 time: 0.054140 Oct 18 15:41:20.808903 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1887/3769] 10.222.0.60 () {58 vars in 1206 bytes} [Tue Oct 18 15:41:20 2022] DELETE /compute/v2.1/images/tempest-invalid-1152003633 => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 15:41:20.819754 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f326dbd1-cf64-4c0f-86b4-e652a4c10480 tempest-ImagesDeleteNegativeTestJSON-260230290 tempest-ImagesDeleteNegativeTestJSON-260230290-project] Calling method '.version_select at 0x7f7c3cf2d8b0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:20.849200 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-f326dbd1-cf64-4c0f-86b4-e652a4c10480 tempest-ImagesDeleteNegativeTestJSON-260230290 tempest-ImagesDeleteNegativeTestJSON-260230290-project] HTTP exception thrown: Image not found. Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f326dbd1-cf64-4c0f-86b4-e652a4c10480 tempest-ImagesDeleteNegativeTestJSON-260230290 tempest-ImagesDeleteNegativeTestJSON-260230290-project] Request method failure captured: Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/images/ce7b071e-e766-4d92-b1dd-913c21aafb89 HTTP/1.1 Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTskgFOZ9fmVXoDHCFVj3bbzVT3UtxuT32kE7hVqqwt0aC4zONfE_nGtcl_xRkkzhDb_M5aTzi0LKcydGluRLYtBguKlyR7GNP2hUJMN9muUSihbaUAdju2YPq0hinEk_VkJXHJuxcW2ZK2puc_zVI_IvRXyipGKJ-uHTIZ9Tdl2Ozvg Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 11fc9e6f9ea64e409e406ae1d1a0b796 Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-260230290 Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/11fc9e6f9ea64e409e406ae1d1a0b796"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/11fc9e6f9ea64e409e406ae1d1a0b796"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/11fc9e6f9ea64e409e406ae1d1a0b796"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_11fc9e6f9ea64e409e406ae1d1a0b796"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-260230290 Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 11fc9e6f9ea64e409e406ae1d1a0b796 Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-260230290 Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ImagesDeleteNegativeTestJSON-260230290-project Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 9af511deb6aa4b1e858f7899d01efe19 Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-260230290-project Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: exception: Image not found. Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'ce7b071e-e766-4d92-b1dd-913c21aafb89'} Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ce7b071e-e766-4d92-b1dd-913c21aafb89 to delete Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ce7b071e-e766-4d92-b1dd-913c21aafb89 could not be found. Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:41:20.851927 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:20.857363 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:20.857363 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:41:20.857363 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:41:20.857363 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:41:20.857363 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:41:20.857363 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:41:20.857363 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:41:20.857363 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:41:20.857363 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:41:20.857363 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 18 15:41:20.857363 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 15:41:20.857363 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 15:41:20.857363 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:20.857363 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:41:20.857363 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:20.857363 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:20.857363 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:41:20.857363 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:41:20.857363 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:41:20.857363 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:41:20.857363 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 15:41:20.857363 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:20.861259 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f326dbd1-cf64-4c0f-86b4-e652a4c10480 tempest-ImagesDeleteNegativeTestJSON-260230290 tempest-ImagesDeleteNegativeTestJSON-260230290-project] Returning 404 to user: Image not found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:41:20.863514 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f326dbd1-cf64-4c0f-86b4-e652a4c10480 tempest-ImagesDeleteNegativeTestJSON-260230290 tempest-ImagesDeleteNegativeTestJSON-260230290-project] 10.222.0.60 "DELETE /compute/v2.1/images/ce7b071e-e766-4d92-b1dd-913c21aafb89" status: 404 len: 62 microversion: 2.1 time: 0.048960 Oct 18 15:41:20.867456 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1888/3770] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:20 2022] DELETE /compute/v2.1/images/ce7b071e-e766-4d92-b1dd-913c21aafb89 => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 15:41:21.077198 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=16 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:41:21.095449 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9fa8179d-85df-468b-8086-ce6950a74579 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.560550 Oct 18 15:41:21.096363 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1883/3771] 10.222.0.60 () {58 vars in 1196 bytes} [Tue Oct 18 15:41:20 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:21.110639 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4204d345-933c-4262-bf27-dbc4f4637be1 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:21.116769 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4204d345-933c-4262-bf27-dbc4f4637be1 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:21.118290 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4204d345-933c-4262-bf27-dbc4f4637be1 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Searching by: {'name': '1592337757', 'deleted': False, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1'} {{(pid=120406) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 15:41:21.124205 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4204d345-933c-4262-bf27-dbc4f4637be1 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:21.125038 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4204d345-933c-4262-bf27-dbc4f4637be1 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:21.127225 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4204d345-933c-4262-bf27-dbc4f4637be1 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:21.129502 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4204d345-933c-4262-bf27-dbc4f4637be1 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:21.130510 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4204d345-933c-4262-bf27-dbc4f4637be1 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:21.130959 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4204d345-933c-4262-bf27-dbc4f4637be1 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:21.236614 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.multi_cell_list [None req-4204d345-933c-4262-bf27-dbc4f4637be1 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120406) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 15:41:21.239408 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-36fa45c5-7a10-4027-ac6b-e89a09361814 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:21.240186 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-36fa45c5-7a10-4027-ac6b-e89a09361814 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] [instance: 2e52e036-3ac0-4bbd-abe3-4c0b1957734f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:21.250174 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-36fa45c5-7a10-4027-ac6b-e89a09361814 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:21.251416 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-36fa45c5-7a10-4027-ac6b-e89a09361814 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:21.251959 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-36fa45c5-7a10-4027-ac6b-e89a09361814 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:21.253042 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-36fa45c5-7a10-4027-ac6b-e89a09361814 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:21.253657 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-36fa45c5-7a10-4027-ac6b-e89a09361814 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:21.254182 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-36fa45c5-7a10-4027-ac6b-e89a09361814 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:21.316024 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4204d345-933c-4262-bf27-dbc4f4637be1 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers?name=1592337757" status: 200 len: 346 microversion: 2.1 time: 0.209633 Oct 18 15:41:21.317389 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1889/3772] 10.222.0.60 () {58 vars in 1156 bytes} [Tue Oct 18 15:41:21 2022] GET /compute/v2.1/servers?name=1592337757 => generated 346 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:41:21.334590 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0823eace-d237-44ff-991d-9c07c5323360 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:21.340441 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0823eace-d237-44ff-991d-9c07c5323360 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:21.341318 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0823eace-d237-44ff-991d-9c07c5323360 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1'} {{(pid=120406) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 15:41:21.347898 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0823eace-d237-44ff-991d-9c07c5323360 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:21.348852 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0823eace-d237-44ff-991d-9c07c5323360 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:21.349709 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0823eace-d237-44ff-991d-9c07c5323360 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:21.350492 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0823eace-d237-44ff-991d-9c07c5323360 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:21.351152 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0823eace-d237-44ff-991d-9c07c5323360 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:21.351631 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0823eace-d237-44ff-991d-9c07c5323360 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:21.474678 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.multi_cell_list [None req-0823eace-d237-44ff-991d-9c07c5323360 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120406) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 15:41:21.555902 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0823eace-d237-44ff-991d-9c07c5323360 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.223901 Oct 18 15:41:21.555902 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1890/3773] 10.222.0.60 () {58 vars in 1154 bytes} [Tue Oct 18 15:41:21 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:41:21.566712 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-17875aa9-0c78-41b5-9973-e9daf529bc3e tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:21.573751 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-17875aa9-0c78-41b5-9973-e9daf529bc3e tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:21.575213 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-17875aa9-0c78-41b5-9973-e9daf529bc3e tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-159233775', 'deleted': False, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1'} {{(pid=120406) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 15:41:21.583020 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17875aa9-0c78-41b5-9973-e9daf529bc3e tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:21.583810 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17875aa9-0c78-41b5-9973-e9daf529bc3e tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:21.584508 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17875aa9-0c78-41b5-9973-e9daf529bc3e tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:21.586585 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17875aa9-0c78-41b5-9973-e9daf529bc3e tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:21.587682 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17875aa9-0c78-41b5-9973-e9daf529bc3e tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:21.588356 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17875aa9-0c78-41b5-9973-e9daf529bc3e tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:21.685065 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.multi_cell_list [None req-17875aa9-0c78-41b5-9973-e9daf529bc3e tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120406) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 15:41:21.719148 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-36fa45c5-7a10-4027-ac6b-e89a09361814 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4287d8ca081403289857f84e3d0c3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e54dfc6654672a9423c9de5be3e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:21.728255 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-36fa45c5-7a10-4027-ac6b-e89a09361814 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] 10.222.0.60 "GET /compute/v2.1/servers/2e52e036-3ac0-4bbd-abe3-4c0b1957734f" status: 200 len: 1713 microversion: 2.1 time: 0.496462 Oct 18 15:41:21.729755 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1884/3774] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:21 2022] GET /compute/v2.1/servers/2e52e036-3ac0-4bbd-abe3-4c0b1957734f => generated 1713 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:41:21.735046 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-de02b438-8c60-46d4-8264-799c50710673 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:21.735876 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-de02b438-8c60-46d4-8264-799c50710673 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 47ee1803-1ce0-4cbc-879e-d39cfe8576aa] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:21.743561 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de02b438-8c60-46d4-8264-799c50710673 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:21.744724 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de02b438-8c60-46d4-8264-799c50710673 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:21.745493 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de02b438-8c60-46d4-8264-799c50710673 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:21.746465 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de02b438-8c60-46d4-8264-799c50710673 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:21.747928 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de02b438-8c60-46d4-8264-799c50710673 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:21.748539 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de02b438-8c60-46d4-8264-799c50710673 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:21.779061 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-17875aa9-0c78-41b5-9973-e9daf529bc3e tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-159233775" status: 200 len: 346 microversion: 2.1 time: 0.213998 Oct 18 15:41:21.780364 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1891/3775] 10.222.0.60 () {58 vars in 1228 bytes} [Tue Oct 18 15:41:21 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-159233775 => generated 346 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:41:21.802783 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b44e9bc8-45f9-4f5e-bb21-158ba877cd36 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:21.805426 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b44e9bc8-45f9-4f5e-bb21-158ba877cd36 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] [instance: f9620891-182f-40dd-8abe-42b8b0e1b758] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:21.818494 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b44e9bc8-45f9-4f5e-bb21-158ba877cd36 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:21.819503 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b44e9bc8-45f9-4f5e-bb21-158ba877cd36 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:21.819939 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b44e9bc8-45f9-4f5e-bb21-158ba877cd36 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:21.820645 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b44e9bc8-45f9-4f5e-bb21-158ba877cd36 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:21.821127 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b44e9bc8-45f9-4f5e-bb21-158ba877cd36 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:21.821540 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b44e9bc8-45f9-4f5e-bb21-158ba877cd36 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:21.873750 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b44e9bc8-45f9-4f5e-bb21-158ba877cd36 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] [instance: f9620891-182f-40dd-8abe-42b8b0e1b758] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:41:22.017113 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b44e9bc8-45f9-4f5e-bb21-158ba877cd36 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f9620891-182f-40dd-8abe-42b8b0e1b758" status: 204 len: 0 microversion: 2.1 time: 0.224181 Oct 18 15:41:22.019674 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1892/3776] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:41:21 2022] DELETE /compute/v2.1/servers/f9620891-182f-40dd-8abe-42b8b0e1b758 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:41:22.041071 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9f8fb705-5f82-492b-8503-2cb97ae721ad tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:22.042519 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9f8fb705-5f82-492b-8503-2cb97ae721ad tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] [instance: f9620891-182f-40dd-8abe-42b8b0e1b758] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:22.051223 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:41:22.053127 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f8fb705-5f82-492b-8503-2cb97ae721ad tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:22.053831 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f8fb705-5f82-492b-8503-2cb97ae721ad tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:22.055026 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f8fb705-5f82-492b-8503-2cb97ae721ad tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:22.056573 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f8fb705-5f82-492b-8503-2cb97ae721ad tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:22.057267 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f8fb705-5f82-492b-8503-2cb97ae721ad tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:22.062443 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f8fb705-5f82-492b-8503-2cb97ae721ad tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:22.208648 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-de02b438-8c60-46d4-8264-799c50710673 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:22.217205 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-de02b438-8c60-46d4-8264-799c50710673 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee1803-1ce0-4cbc-879e-d39cfe8576aa" status: 200 len: 1365 microversion: 2.1 time: 0.486115 Oct 18 15:41:22.229671 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1885/3777] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:21 2022] GET /compute/v2.1/servers/47ee1803-1ce0-4cbc-879e-d39cfe8576aa => generated 1365 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:22.240767 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-540b43ec-92ff-4dd7-b0ea-13e6cc6c175b req-7eaa460c-28fc-429c-a9e9-379178ef22d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47ee1803-1ce0-4cbc-879e-d39cfe8576aa", "name": "network-vif-plugged", "status": "completed", "tag": "6255b173-b912-4205-9fcd-434867d970a5"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:41:22.261809 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-540b43ec-92ff-4dd7-b0ea-13e6cc6c175b req-7eaa460c-28fc-429c-a9e9-379178ef22d7 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:22.262309 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-540b43ec-92ff-4dd7-b0ea-13e6cc6c175b req-7eaa460c-28fc-429c-a9e9-379178ef22d7 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:22.262841 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-540b43ec-92ff-4dd7-b0ea-13e6cc6c175b req-7eaa460c-28fc-429c-a9e9-379178ef22d7 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:22.283781 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-540b43ec-92ff-4dd7-b0ea-13e6cc6c175b req-7eaa460c-28fc-429c-a9e9-379178ef22d7 service nova] Creating event network-vif-plugged:6255b173-b912-4205-9fcd-434867d970a5 for instance 47ee1803-1ce0-4cbc-879e-d39cfe8576aa on n-h1-853682-5 Oct 18 15:41:22.289945 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-540b43ec-92ff-4dd7-b0ea-13e6cc6c175b req-7eaa460c-28fc-429c-a9e9-379178ef22d7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059119 Oct 18 15:41:22.291261 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1886/3778] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:41:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:41:22.504481 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9f8fb705-5f82-492b-8503-2cb97ae721ad tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:22.513514 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:41:22.582816 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9f8fb705-5f82-492b-8503-2cb97ae721ad tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers/f9620891-182f-40dd-8abe-42b8b0e1b758" status: 200 len: 1519 microversion: 2.1 time: 0.547413 Oct 18 15:41:22.585578 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1893/3779] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:22 2022] GET /compute/v2.1/servers/f9620891-182f-40dd-8abe-42b8b0e1b758 => generated 1519 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:41:22.756740 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0d7d4a5d-20c4-4a88-9b24-bbaa52c05e44 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:22.757715 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0d7d4a5d-20c4-4a88-9b24-bbaa52c05e44 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] [instance: 2e52e036-3ac0-4bbd-abe3-4c0b1957734f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:22.770840 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0d7d4a5d-20c4-4a88-9b24-bbaa52c05e44 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:22.774333 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0d7d4a5d-20c4-4a88-9b24-bbaa52c05e44 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:22.774806 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0d7d4a5d-20c4-4a88-9b24-bbaa52c05e44 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:22.775527 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0d7d4a5d-20c4-4a88-9b24-bbaa52c05e44 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:22.775994 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0d7d4a5d-20c4-4a88-9b24-bbaa52c05e44 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:22.776421 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0d7d4a5d-20c4-4a88-9b24-bbaa52c05e44 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:22.789871 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-e03ad010-cca7-42b7-ab06-6734af7092a3 req-777dd950-4f8c-4796-9611-15c75b5b8137 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e52e036-3ac0-4bbd-abe3-4c0b1957734f", "name": "network-vif-deleted", "tag": "0c969268-8769-4c5b-900a-67fbcb9e9532"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:41:22.829811 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e03ad010-cca7-42b7-ab06-6734af7092a3 req-777dd950-4f8c-4796-9611-15c75b5b8137 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:22.830337 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e03ad010-cca7-42b7-ab06-6734af7092a3 req-777dd950-4f8c-4796-9611-15c75b5b8137 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:22.830731 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e03ad010-cca7-42b7-ab06-6734af7092a3 req-777dd950-4f8c-4796-9611-15c75b5b8137 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:22.856899 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-e03ad010-cca7-42b7-ab06-6734af7092a3 req-777dd950-4f8c-4796-9611-15c75b5b8137 service nova] Creating event network-vif-deleted:0c969268-8769-4c5b-900a-67fbcb9e9532 for instance 2e52e036-3ac0-4bbd-abe3-4c0b1957734f on n-h2-853682-5 Oct 18 15:41:22.869533 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-e03ad010-cca7-42b7-ab06-6734af7092a3 req-777dd950-4f8c-4796-9611-15c75b5b8137 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084724 Oct 18 15:41:22.871821 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1894/3780] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:41:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:41:22.953368 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0d7d4a5d-20c4-4a88-9b24-bbaa52c05e44 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4287d8ca081403289857f84e3d0c3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e54dfc6654672a9423c9de5be3e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:22.964241 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0d7d4a5d-20c4-4a88-9b24-bbaa52c05e44 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] 10.222.0.60 "GET /compute/v2.1/servers/2e52e036-3ac0-4bbd-abe3-4c0b1957734f" status: 200 len: 1646 microversion: 2.1 time: 0.211822 Oct 18 15:41:22.968445 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1887/3781] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:22 2022] GET /compute/v2.1/servers/2e52e036-3ac0-4bbd-abe3-4c0b1957734f => generated 1646 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:23.108300 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-84e1df21-372c-4ba9-b791-df36ca077341 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:23.110593 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-84e1df21-372c-4ba9-b791-df36ca077341 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 52d725f3-b4da-4831-9abf-bf7aba8aee0a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:23.133278 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84e1df21-372c-4ba9-b791-df36ca077341 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:23.134484 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84e1df21-372c-4ba9-b791-df36ca077341 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:23.135110 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84e1df21-372c-4ba9-b791-df36ca077341 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:23.136057 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84e1df21-372c-4ba9-b791-df36ca077341 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:23.138888 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84e1df21-372c-4ba9-b791-df36ca077341 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:23.141819 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84e1df21-372c-4ba9-b791-df36ca077341 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:23.189892 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-84e1df21-372c-4ba9-b791-df36ca077341 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.085758 Oct 18 15:41:23.197560 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1895/3782] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 15:41:23 2022] GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a/os-volume_attachments => generated 25 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:41:23.257459 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-88bb6e58-10c3-4776-ba76-4103b48fa0ee tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:23.257459 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-88bb6e58-10c3-4776-ba76-4103b48fa0ee tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 47ee1803-1ce0-4cbc-879e-d39cfe8576aa] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:23.270490 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6f2200f5-7365-4817-92b5-b702b88d649f tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:23.271221 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6f2200f5-7365-4817-92b5-b702b88d649f tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 52d725f3-b4da-4831-9abf-bf7aba8aee0a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:23.274749 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-88bb6e58-10c3-4776-ba76-4103b48fa0ee tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:23.276434 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-88bb6e58-10c3-4776-ba76-4103b48fa0ee tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:23.278627 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-88bb6e58-10c3-4776-ba76-4103b48fa0ee tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:23.281294 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f2200f5-7365-4817-92b5-b702b88d649f tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:23.282074 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-88bb6e58-10c3-4776-ba76-4103b48fa0ee tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:23.282355 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f2200f5-7365-4817-92b5-b702b88d649f tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:23.282565 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-88bb6e58-10c3-4776-ba76-4103b48fa0ee tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:23.283246 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f2200f5-7365-4817-92b5-b702b88d649f tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:23.283376 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-88bb6e58-10c3-4776-ba76-4103b48fa0ee tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:23.285247 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f2200f5-7365-4817-92b5-b702b88d649f tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:23.285911 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f2200f5-7365-4817-92b5-b702b88d649f tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:23.286704 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f2200f5-7365-4817-92b5-b702b88d649f tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:23.320951 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6f2200f5-7365-4817-92b5-b702b88d649f tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 52d725f3-b4da-4831-9abf-bf7aba8aee0a] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:41:23.447088 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6f2200f5-7365-4817-92b5-b702b88d649f tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "DELETE /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a" status: 204 len: 0 microversion: 2.1 time: 0.177112 Oct 18 15:41:23.448104 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1896/3783] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:41:23 2022] DELETE /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:41:23.459951 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-05c1b5b8-569d-4348-8505-11d7193ed433 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:23.464186 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-05c1b5b8-569d-4348-8505-11d7193ed433 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 52d725f3-b4da-4831-9abf-bf7aba8aee0a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:23.479255 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-05c1b5b8-569d-4348-8505-11d7193ed433 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:23.480918 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-05c1b5b8-569d-4348-8505-11d7193ed433 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:23.481551 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-05c1b5b8-569d-4348-8505-11d7193ed433 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:23.482511 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-05c1b5b8-569d-4348-8505-11d7193ed433 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:23.483444 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-05c1b5b8-569d-4348-8505-11d7193ed433 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:23.484124 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-05c1b5b8-569d-4348-8505-11d7193ed433 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:23.759561 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-88bb6e58-10c3-4776-ba76-4103b48fa0ee tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:23.768683 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-88bb6e58-10c3-4776-ba76-4103b48fa0ee tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee1803-1ce0-4cbc-879e-d39cfe8576aa" status: 200 len: 1365 microversion: 2.1 time: 0.517063 Oct 18 15:41:23.769869 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1888/3784] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:23 2022] GET /compute/v2.1/servers/47ee1803-1ce0-4cbc-879e-d39cfe8576aa => generated 1365 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:23.786801 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-18a566da-a667-4ae9-89d0-3c7ce19b8ec2 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:23.787966 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-18a566da-a667-4ae9-89d0-3c7ce19b8ec2 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] [instance: f9620891-182f-40dd-8abe-42b8b0e1b758] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:23.800240 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-18a566da-a667-4ae9-89d0-3c7ce19b8ec2 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:23.808003 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-18a566da-a667-4ae9-89d0-3c7ce19b8ec2 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:23.808766 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-18a566da-a667-4ae9-89d0-3c7ce19b8ec2 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:23.809751 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-18a566da-a667-4ae9-89d0-3c7ce19b8ec2 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:23.810432 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-18a566da-a667-4ae9-89d0-3c7ce19b8ec2 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:23.811158 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-18a566da-a667-4ae9-89d0-3c7ce19b8ec2 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:23.982186 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-05c1b5b8-569d-4348-8505-11d7193ed433 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304b3248f9db4629943a8b8080a6d22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdc7504a1d1424ea34f83f1a6d4bf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:23.998271 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-05c1b5b8-569d-4348-8505-11d7193ed433 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a" status: 200 len: 1671 microversion: 2.1 time: 0.544361 Oct 18 15:41:23.998974 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1897/3785] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:23 2022] GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a => generated 1671 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:24.009293 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f4524b38-816b-49e0-9245-211456b3ba95 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:24.013308 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f4524b38-816b-49e0-9245-211456b3ba95 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] [instance: 2e52e036-3ac0-4bbd-abe3-4c0b1957734f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:24.025763 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4524b38-816b-49e0-9245-211456b3ba95 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:24.026525 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4524b38-816b-49e0-9245-211456b3ba95 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:24.027263 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4524b38-816b-49e0-9245-211456b3ba95 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:24.028323 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4524b38-816b-49e0-9245-211456b3ba95 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:24.028971 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4524b38-816b-49e0-9245-211456b3ba95 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:24.035490 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4524b38-816b-49e0-9245-211456b3ba95 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:24.075416 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-f4524b38-816b-49e0-9245-211456b3ba95 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] HTTP exception thrown: Instance 2e52e036-3ac0-4bbd-abe3-4c0b1957734f could not be found. Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f4524b38-816b-49e0-9245-211456b3ba95 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Request method failure captured: Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/2e52e036-3ac0-4bbd-abe3-4c0b1957734f HTTP/1.1 Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsjXiFaQNmXoeRy4OZUzHnH5CXak3_UNKPP1CeWMfdjQz1DRgmRgxuJnfTY7Ejr5fOcqQj1fjY9h9myFdv8b0xVZle7LRXwfGLF9KMlf4vu0cN81rxB94LbBtMFgDqa3gH_lgezFeCL1Y4iUk9bpWSL6dcpnq7GORMkWX__5cWGoZoM Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 863e54dfc6654672a9423c9de5be3e03 Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersTestManualDisk-531931501 Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/863e54dfc6654672a9423c9de5be3e03"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/863e54dfc6654672a9423c9de5be3e03"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/863e54dfc6654672a9423c9de5be3e03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_863e54dfc6654672a9423c9de5be3e03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersTestManualDisk-531931501 Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 863e54dfc6654672a9423c9de5be3e03 Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersTestManualDisk-531931501 Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersTestManualDisk-531931501-project Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: e4287d8ca081403289857f84e3d0c3f8 Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersTestManualDisk-531931501-project Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 2e52e036-3ac0-4bbd-abe3-4c0b1957734f could not be found. Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '2e52e036-3ac0-4bbd-abe3-4c0b1957734f'} Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e52e036-3ac0-4bbd-abe3-4c0b1957734f could not be found. Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e52e036-3ac0-4bbd-abe3-4c0b1957734f could not be found. Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:41:24.079057 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:24.086774 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:24.086774 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:41:24.086774 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:41:24.086774 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:41:24.086774 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:41:24.086774 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e52e036-3ac0-4bbd-abe3-4c0b1957734f could not be found. Oct 18 15:41:24.086774 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:24.086774 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f4524b38-816b-49e0-9245-211456b3ba95 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Returning 404 to user: Instance 2e52e036-3ac0-4bbd-abe3-4c0b1957734f could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:41:24.086774 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f4524b38-816b-49e0-9245-211456b3ba95 tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] 10.222.0.60 "GET /compute/v2.1/servers/2e52e036-3ac0-4bbd-abe3-4c0b1957734f" status: 404 len: 111 microversion: 2.1 time: 0.082744 Oct 18 15:41:24.096081 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1898/3786] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:23 2022] GET /compute/v2.1/servers/2e52e036-3ac0-4bbd-abe3-4c0b1957734f => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:41:24.103418 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-60dc8446-6772-4b33-916d-6dd2f490577c tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] Calling method '.version_select at 0x7f7c3e017040>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:24.142591 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-60dc8446-6772-4b33-916d-6dd2f490577c tempest-ServersTestManualDisk-531931501 tempest-ServersTestManualDisk-531931501-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1297654325" status: 202 len: 0 microversion: 2.1 time: 0.042842 Oct 18 15:41:24.143457 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1899/3787] 10.222.0.60 () {58 vars in 1221 bytes} [Tue Oct 18 15:41:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1297654325 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:41:24.173388 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-18a566da-a667-4ae9-89d0-3c7ce19b8ec2 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:24.187172 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-18a566da-a667-4ae9-89d0-3c7ce19b8ec2 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers/f9620891-182f-40dd-8abe-42b8b0e1b758" status: 200 len: 1519 microversion: 2.1 time: 0.404443 Oct 18 15:41:24.187765 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1889/3788] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:23 2022] GET /compute/v2.1/servers/f9620891-182f-40dd-8abe-42b8b0e1b758 => generated 1519 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:24.795882 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5a777d64-0ff8-486c-8986-0fe5715d7d8a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:24.796524 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5a777d64-0ff8-486c-8986-0fe5715d7d8a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 47ee1803-1ce0-4cbc-879e-d39cfe8576aa] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:24.812113 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a777d64-0ff8-486c-8986-0fe5715d7d8a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:24.812752 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a777d64-0ff8-486c-8986-0fe5715d7d8a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:24.813214 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a777d64-0ff8-486c-8986-0fe5715d7d8a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:24.813919 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a777d64-0ff8-486c-8986-0fe5715d7d8a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:24.814371 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a777d64-0ff8-486c-8986-0fe5715d7d8a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:24.814792 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a777d64-0ff8-486c-8986-0fe5715d7d8a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:25.030160 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ed7efdd2-0be1-40fe-b24e-1a249598de6c tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:25.030760 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ed7efdd2-0be1-40fe-b24e-1a249598de6c tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 52d725f3-b4da-4831-9abf-bf7aba8aee0a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:25.044347 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ed7efdd2-0be1-40fe-b24e-1a249598de6c tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:25.044347 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ed7efdd2-0be1-40fe-b24e-1a249598de6c tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:25.048913 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ed7efdd2-0be1-40fe-b24e-1a249598de6c tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:25.049694 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ed7efdd2-0be1-40fe-b24e-1a249598de6c tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:25.050215 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ed7efdd2-0be1-40fe-b24e-1a249598de6c tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:25.050653 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ed7efdd2-0be1-40fe-b24e-1a249598de6c tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:25.451314 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5a777d64-0ff8-486c-8986-0fe5715d7d8a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:25.484516 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5a777d64-0ff8-486c-8986-0fe5715d7d8a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee1803-1ce0-4cbc-879e-d39cfe8576aa" status: 200 len: 1365 microversion: 2.1 time: 0.692192 Oct 18 15:41:25.485375 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1900/3789] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:24 2022] GET /compute/v2.1/servers/47ee1803-1ce0-4cbc-879e-d39cfe8576aa => generated 1365 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:25.492613 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-28c0d4d3-dbde-4ba5-abff-2e9fd479ef77 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:25.494317 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-28c0d4d3-dbde-4ba5-abff-2e9fd479ef77 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] [instance: f9620891-182f-40dd-8abe-42b8b0e1b758] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:25.508485 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-28c0d4d3-dbde-4ba5-abff-2e9fd479ef77 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:25.509219 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-28c0d4d3-dbde-4ba5-abff-2e9fd479ef77 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:25.510732 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-28c0d4d3-dbde-4ba5-abff-2e9fd479ef77 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:25.517670 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-28c0d4d3-dbde-4ba5-abff-2e9fd479ef77 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:25.518354 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-28c0d4d3-dbde-4ba5-abff-2e9fd479ef77 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:25.519548 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-28c0d4d3-dbde-4ba5-abff-2e9fd479ef77 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:26.192470 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ed7efdd2-0be1-40fe-b24e-1a249598de6c tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304b3248f9db4629943a8b8080a6d22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdc7504a1d1424ea34f83f1a6d4bf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:26.223852 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ed7efdd2-0be1-40fe-b24e-1a249598de6c tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a" status: 200 len: 1671 microversion: 2.1 time: 1.199909 Oct 18 15:41:26.225160 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1890/3790] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:25 2022] GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a => generated 1671 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:41:26.373904 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-28c0d4d3-dbde-4ba5-abff-2e9fd479ef77 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:26.381793 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-28c0d4d3-dbde-4ba5-abff-2e9fd479ef77 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers/f9620891-182f-40dd-8abe-42b8b0e1b758" status: 200 len: 1519 microversion: 2.1 time: 0.895363 Oct 18 15:41:26.397194 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1901/3791] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:25 2022] GET /compute/v2.1/servers/f9620891-182f-40dd-8abe-42b8b0e1b758 => generated 1519 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:26.511121 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9a860ccc-9ad3-4ab9-bf4f-eca20fb986ac tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:26.515233 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9a860ccc-9ad3-4ab9-bf4f-eca20fb986ac tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 47ee1803-1ce0-4cbc-879e-d39cfe8576aa] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:26.526160 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9a860ccc-9ad3-4ab9-bf4f-eca20fb986ac tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:26.527059 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9a860ccc-9ad3-4ab9-bf4f-eca20fb986ac tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:26.527695 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9a860ccc-9ad3-4ab9-bf4f-eca20fb986ac tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:26.529368 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9a860ccc-9ad3-4ab9-bf4f-eca20fb986ac tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:26.530262 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9a860ccc-9ad3-4ab9-bf4f-eca20fb986ac tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:26.530873 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9a860ccc-9ad3-4ab9-bf4f-eca20fb986ac tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:27.076171 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9a860ccc-9ad3-4ab9-bf4f-eca20fb986ac tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:27.085894 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=100 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:41:27.088485 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9a860ccc-9ad3-4ab9-bf4f-eca20fb986ac tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee1803-1ce0-4cbc-879e-d39cfe8576aa" status: 200 len: 1365 microversion: 2.1 time: 0.583105 Oct 18 15:41:27.090010 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1891/3792] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:26 2022] GET /compute/v2.1/servers/47ee1803-1ce0-4cbc-879e-d39cfe8576aa => generated 1365 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:27.247662 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a2b917a1-7c24-4617-aa9f-c6173d25302e tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:27.249026 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a2b917a1-7c24-4617-aa9f-c6173d25302e tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 52d725f3-b4da-4831-9abf-bf7aba8aee0a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:27.272552 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2b917a1-7c24-4617-aa9f-c6173d25302e tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:27.273092 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2b917a1-7c24-4617-aa9f-c6173d25302e tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:27.274053 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2b917a1-7c24-4617-aa9f-c6173d25302e tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:27.274784 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2b917a1-7c24-4617-aa9f-c6173d25302e tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:27.275244 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2b917a1-7c24-4617-aa9f-c6173d25302e tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:27.275672 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2b917a1-7c24-4617-aa9f-c6173d25302e tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:27.411424 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1be0b53a-faf5-4cb8-b387-39274a84555c tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:27.412906 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1be0b53a-faf5-4cb8-b387-39274a84555c tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] [instance: f9620891-182f-40dd-8abe-42b8b0e1b758] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:27.419066 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1be0b53a-faf5-4cb8-b387-39274a84555c tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:27.419822 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1be0b53a-faf5-4cb8-b387-39274a84555c tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:27.420464 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1be0b53a-faf5-4cb8-b387-39274a84555c tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:27.421395 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1be0b53a-faf5-4cb8-b387-39274a84555c tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:27.422163 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1be0b53a-faf5-4cb8-b387-39274a84555c tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:27.422916 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1be0b53a-faf5-4cb8-b387-39274a84555c tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:27.432416 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a2b917a1-7c24-4617-aa9f-c6173d25302e tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304b3248f9db4629943a8b8080a6d22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdc7504a1d1424ea34f83f1a6d4bf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:27.447020 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a2b917a1-7c24-4617-aa9f-c6173d25302e tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a" status: 200 len: 1603 microversion: 2.1 time: 0.199521 Oct 18 15:41:27.452058 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1902/3793] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:27 2022] GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a => generated 1603 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:27.827340 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1be0b53a-faf5-4cb8-b387-39274a84555c tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:27.844254 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1be0b53a-faf5-4cb8-b387-39274a84555c tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers/f9620891-182f-40dd-8abe-42b8b0e1b758" status: 200 len: 1519 microversion: 2.1 time: 0.437730 Oct 18 15:41:27.848911 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1892/3794] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:27 2022] GET /compute/v2.1/servers/f9620891-182f-40dd-8abe-42b8b0e1b758 => generated 1519 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:41:28.022386 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-15864a5f-a027-4f63-836d-cdb4854534b7 req-7709237c-03d1-4937-bbf9-8cabc1c10fa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9620891-182f-40dd-8abe-42b8b0e1b758", "name": "network-vif-deleted", "tag": "6177bb79-9152-412b-b0d6-f6e1d447d283"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:41:28.032715 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-15864a5f-a027-4f63-836d-cdb4854534b7 req-7709237c-03d1-4937-bbf9-8cabc1c10fa4 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:28.033642 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-15864a5f-a027-4f63-836d-cdb4854534b7 req-7709237c-03d1-4937-bbf9-8cabc1c10fa4 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:28.033642 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-15864a5f-a027-4f63-836d-cdb4854534b7 req-7709237c-03d1-4937-bbf9-8cabc1c10fa4 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:28.046026 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-15864a5f-a027-4f63-836d-cdb4854534b7 req-7709237c-03d1-4937-bbf9-8cabc1c10fa4 service nova] Creating event network-vif-deleted:6177bb79-9152-412b-b0d6-f6e1d447d283 for instance f9620891-182f-40dd-8abe-42b8b0e1b758 on n-h1-853682-5 Oct 18 15:41:28.052120 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-15864a5f-a027-4f63-836d-cdb4854534b7 req-7709237c-03d1-4937-bbf9-8cabc1c10fa4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034431 Oct 18 15:41:28.053985 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1903/3795] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:41:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:41:28.115714 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-57c94bac-9151-46cb-87d6-5e62160d6593 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:28.116241 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-57c94bac-9151-46cb-87d6-5e62160d6593 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 47ee1803-1ce0-4cbc-879e-d39cfe8576aa] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:28.127035 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57c94bac-9151-46cb-87d6-5e62160d6593 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:28.133150 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57c94bac-9151-46cb-87d6-5e62160d6593 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:28.133865 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57c94bac-9151-46cb-87d6-5e62160d6593 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:28.134783 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57c94bac-9151-46cb-87d6-5e62160d6593 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:28.135405 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57c94bac-9151-46cb-87d6-5e62160d6593 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:28.140316 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57c94bac-9151-46cb-87d6-5e62160d6593 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:28.360612 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-5de8ff1c-92f0-4160-ab63-44a206e9b24f req-8486e33b-3cee-45ad-a10c-acb6ed53a6f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52d725f3-b4da-4831-9abf-bf7aba8aee0a", "name": "network-vif-deleted", "tag": "3876fb57-0e44-4236-b433-c1842e0940ff"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:41:28.397467 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5de8ff1c-92f0-4160-ab63-44a206e9b24f req-8486e33b-3cee-45ad-a10c-acb6ed53a6f1 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:28.398146 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5de8ff1c-92f0-4160-ab63-44a206e9b24f req-8486e33b-3cee-45ad-a10c-acb6ed53a6f1 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:28.398693 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5de8ff1c-92f0-4160-ab63-44a206e9b24f req-8486e33b-3cee-45ad-a10c-acb6ed53a6f1 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:28.438517 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-5de8ff1c-92f0-4160-ab63-44a206e9b24f req-8486e33b-3cee-45ad-a10c-acb6ed53a6f1 service nova] Creating event network-vif-deleted:3876fb57-0e44-4236-b433-c1842e0940ff for instance 52d725f3-b4da-4831-9abf-bf7aba8aee0a on n-h1-853682-5 Oct 18 15:41:28.456528 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-5de8ff1c-92f0-4160-ab63-44a206e9b24f req-8486e33b-3cee-45ad-a10c-acb6ed53a6f1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108780 Oct 18 15:41:28.467455 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1904/3796] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:41:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:41:28.490966 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a4ad6506-701c-4175-94fc-8e4a2f93507a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:28.491703 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a4ad6506-701c-4175-94fc-8e4a2f93507a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 52d725f3-b4da-4831-9abf-bf7aba8aee0a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:28.510351 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4ad6506-701c-4175-94fc-8e4a2f93507a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:28.511235 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4ad6506-701c-4175-94fc-8e4a2f93507a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:28.513206 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4ad6506-701c-4175-94fc-8e4a2f93507a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:28.516266 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4ad6506-701c-4175-94fc-8e4a2f93507a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:28.517561 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4ad6506-701c-4175-94fc-8e4a2f93507a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:28.519254 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4ad6506-701c-4175-94fc-8e4a2f93507a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:28.596827 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4ad6506-701c-4175-94fc-8e4a2f93507a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:28.597696 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4ad6506-701c-4175-94fc-8e4a2f93507a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:28.598291 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4ad6506-701c-4175-94fc-8e4a2f93507a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:28.598912 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-a4ad6506-701c-4175-94fc-8e4a2f93507a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lazy-loading 'fault' on Instance uuid 52d725f3-b4da-4831-9abf-bf7aba8aee0a {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:41:28.681347 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-57c94bac-9151-46cb-87d6-5e62160d6593 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:28.685292 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a4ad6506-701c-4175-94fc-8e4a2f93507a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304b3248f9db4629943a8b8080a6d22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdc7504a1d1424ea34f83f1a6d4bf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:28.689790 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-57c94bac-9151-46cb-87d6-5e62160d6593 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee1803-1ce0-4cbc-879e-d39cfe8576aa" status: 200 len: 1555 microversion: 2.1 time: 0.578070 Oct 18 15:41:28.699145 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a4ad6506-701c-4175-94fc-8e4a2f93507a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a" status: 200 len: 1326 microversion: 2.1 time: 0.222786 Oct 18 15:41:28.705608 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1905/3797] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:28 2022] GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a => generated 1326 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:28.711488 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1893/3798] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:28 2022] GET /compute/v2.1/servers/47ee1803-1ce0-4cbc-879e-d39cfe8576aa => generated 1555 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:28.717816 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-85d5b06d-601b-4188-b494-d359601ee9de tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:28.720150 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-85d5b06d-601b-4188-b494-d359601ee9de tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 47ee1803-1ce0-4cbc-879e-d39cfe8576aa] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:28.732508 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85d5b06d-601b-4188-b494-d359601ee9de tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:28.733044 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85d5b06d-601b-4188-b494-d359601ee9de tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:28.733480 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85d5b06d-601b-4188-b494-d359601ee9de tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:28.734182 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85d5b06d-601b-4188-b494-d359601ee9de tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:28.734635 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85d5b06d-601b-4188-b494-d359601ee9de tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:28.738308 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85d5b06d-601b-4188-b494-d359601ee9de tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:28.870150 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-98341dbe-146c-495b-93b4-af21b8d6742c tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:28.871053 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-98341dbe-146c-495b-93b4-af21b8d6742c tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] [instance: f9620891-182f-40dd-8abe-42b8b0e1b758] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:28.883249 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-98341dbe-146c-495b-93b4-af21b8d6742c tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:28.889386 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-98341dbe-146c-495b-93b4-af21b8d6742c tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:28.889872 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-98341dbe-146c-495b-93b4-af21b8d6742c tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:28.890614 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-98341dbe-146c-495b-93b4-af21b8d6742c tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:28.891152 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-98341dbe-146c-495b-93b4-af21b8d6742c tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:28.891598 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-98341dbe-146c-495b-93b4-af21b8d6742c tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:28.975425 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-98341dbe-146c-495b-93b4-af21b8d6742c tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:28.977033 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-98341dbe-146c-495b-93b4-af21b8d6742c tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:28.978073 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-98341dbe-146c-495b-93b4-af21b8d6742c tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:28.979867 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-98341dbe-146c-495b-93b4-af21b8d6742c tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lazy-loading 'fault' on Instance uuid f9620891-182f-40dd-8abe-42b8b0e1b758 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:41:29.020245 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-85d5b06d-601b-4188-b494-d359601ee9de tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee1803-1ce0-4cbc-879e-d39cfe8576aa/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.306233 Oct 18 15:41:29.021404 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1906/3799] 10.222.0.60 () {58 vars in 1275 bytes} [Tue Oct 18 15:41:28 2022] GET /compute/v2.1/servers/47ee1803-1ce0-4cbc-879e-d39cfe8576aa/os-interface => generated 284 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:41:29.155930 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-98341dbe-146c-495b-93b4-af21b8d6742c tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:29.166596 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-98341dbe-146c-495b-93b4-af21b8d6742c tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers/f9620891-182f-40dd-8abe-42b8b0e1b758" status: 200 len: 1311 microversion: 2.1 time: 0.300893 Oct 18 15:41:29.169359 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1894/3800] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:28 2022] GET /compute/v2.1/servers/f9620891-182f-40dd-8abe-42b8b0e1b758 => generated 1311 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:41:29.663827 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=18 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:41:29.670068 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-88e4055e-36e7-4431-8c1f-102dbb54afa9 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:29.671199 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-88e4055e-36e7-4431-8c1f-102dbb54afa9 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:29.699784 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88e4055e-36e7-4431-8c1f-102dbb54afa9 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:29.700904 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88e4055e-36e7-4431-8c1f-102dbb54afa9 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:29.707043 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88e4055e-36e7-4431-8c1f-102dbb54afa9 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:29.708303 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88e4055e-36e7-4431-8c1f-102dbb54afa9 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:29.709058 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88e4055e-36e7-4431-8c1f-102dbb54afa9 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:29.709769 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88e4055e-36e7-4431-8c1f-102dbb54afa9 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:29.731423 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-05d1724a-d247-457a-941c-6a39cafb6a93 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:29.733189 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-05d1724a-d247-457a-941c-6a39cafb6a93 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 52d725f3-b4da-4831-9abf-bf7aba8aee0a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:29.760278 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-05d1724a-d247-457a-941c-6a39cafb6a93 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:29.763827 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-05d1724a-d247-457a-941c-6a39cafb6a93 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:29.765163 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-05d1724a-d247-457a-941c-6a39cafb6a93 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:29.771038 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-05d1724a-d247-457a-941c-6a39cafb6a93 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:29.771684 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-05d1724a-d247-457a-941c-6a39cafb6a93 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:29.773700 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-05d1724a-d247-457a-941c-6a39cafb6a93 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:29.815335 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-05d1724a-d247-457a-941c-6a39cafb6a93 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] HTTP exception thrown: Instance 52d725f3-b4da-4831-9abf-bf7aba8aee0a could not be found. Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-05d1724a-d247-457a-941c-6a39cafb6a93 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Request method failure captured: Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a HTTP/1.1 Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsfyIMGIKagHv42ZclZ4vV2nv2V6nMSERSYUm2Mguo48uB1D-ahUCWeUqiHW9JgJsyPUV5imS5Kzt6x9jVdiWnieLXTUxS42GPIQC9hxY0ofBX9DPB_tJyBl5NRSQZ-hKgea7JbasC3ojhutPkE2I4dYri-1lJplB76bieoISb7z3CE Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 5cdc7504a1d1424ea34f83f1a6d4bf71 Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-AttachVolumeTestJSON-1787080058 Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5cdc7504a1d1424ea34f83f1a6d4bf71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5cdc7504a1d1424ea34f83f1a6d4bf71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5cdc7504a1d1424ea34f83f1a6d4bf71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5cdc7504a1d1424ea34f83f1a6d4bf71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-AttachVolumeTestJSON-1787080058 Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 5cdc7504a1d1424ea34f83f1a6d4bf71 Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1787080058 Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-AttachVolumeTestJSON-1787080058-project Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 304b3248f9db4629943a8b8080a6d22e Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-AttachVolumeTestJSON-1787080058-project Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 52d725f3-b4da-4831-9abf-bf7aba8aee0a could not be found. Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '52d725f3-b4da-4831-9abf-bf7aba8aee0a'} Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52d725f3-b4da-4831-9abf-bf7aba8aee0a could not be found. Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52d725f3-b4da-4831-9abf-bf7aba8aee0a could not be found. Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:41:29.821049 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:41:29.826484 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:29.826484 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:41:29.826484 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:41:29.826484 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:41:29.826484 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:41:29.826484 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52d725f3-b4da-4831-9abf-bf7aba8aee0a could not be found. Oct 18 15:41:29.826484 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:41:29.828432 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-05d1724a-d247-457a-941c-6a39cafb6a93 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Returning 404 to user: Instance 52d725f3-b4da-4831-9abf-bf7aba8aee0a could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:41:29.832548 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-05d1724a-d247-457a-941c-6a39cafb6a93 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a" status: 404 len: 111 microversion: 2.1 time: 0.105079 Oct 18 15:41:29.833296 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1895/3801] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:29 2022] GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 15:41:29.849313 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ce7f29c3-cf97-41d2-ae44-8dbaaf6063fa tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '.version_select at 0x7f7c3d10e280>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:29.898489 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ce7f29c3-cf97-41d2-ae44-8dbaaf6063fa tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-469626577" status: 202 len: 0 microversion: 2.1 time: 0.055585 Oct 18 15:41:29.903883 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1896/3802] 10.222.0.60 () {58 vars in 1218 bytes} [Tue Oct 18 15:41:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-469626577 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:41:30.193767 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-724f7c42-693f-4515-a237-f8da58d50a19 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:30.194554 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-724f7c42-693f-4515-a237-f8da58d50a19 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] [instance: f9620891-182f-40dd-8abe-42b8b0e1b758] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:30.213070 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-724f7c42-693f-4515-a237-f8da58d50a19 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:30.213929 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-724f7c42-693f-4515-a237-f8da58d50a19 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:30.219697 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-724f7c42-693f-4515-a237-f8da58d50a19 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:30.221470 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-724f7c42-693f-4515-a237-f8da58d50a19 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:30.222773 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-724f7c42-693f-4515-a237-f8da58d50a19 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:30.223431 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-724f7c42-693f-4515-a237-f8da58d50a19 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:30.268014 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-724f7c42-693f-4515-a237-f8da58d50a19 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] HTTP exception thrown: Instance f9620891-182f-40dd-8abe-42b8b0e1b758 could not be found. Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-724f7c42-693f-4515-a237-f8da58d50a19 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Request method failure captured: Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/f9620891-182f-40dd-8abe-42b8b0e1b758 HTTP/1.1 Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsjskNT6AsaiCCQOJV1aiEIHP4xqXOyR40LtRs9k9m58TaVa3fEBPheglHdg28A2OGNNNXWPq0EgTgG6oXIpdamjilmjpHU4kKcSPyGpVEp3cvObcy-4lkaZQOz2owSjp1acIrnyFrrTiluuGYg0ITF36KmmacL5EDYFPEN4QkpfOn4 Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: a699a53b28b247c69921a0d3435ee9a1 Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ListServerFiltersTestJSON-1208105714 Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a699a53b28b247c69921a0d3435ee9a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a699a53b28b247c69921a0d3435ee9a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a699a53b28b247c69921a0d3435ee9a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a699a53b28b247c69921a0d3435ee9a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ListServerFiltersTestJSON-1208105714 Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: a699a53b28b247c69921a0d3435ee9a1 Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1208105714 Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ListServerFiltersTestJSON-1208105714-project Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: a97a371515534f3f95e68537715feadc Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ListServerFiltersTestJSON-1208105714-project Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance f9620891-182f-40dd-8abe-42b8b0e1b758 could not be found. Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'f9620891-182f-40dd-8abe-42b8b0e1b758'} Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9620891-182f-40dd-8abe-42b8b0e1b758 could not be found. Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9620891-182f-40dd-8abe-42b8b0e1b758 could not be found. Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:41:30.275007 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:41:30.280629 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:30.280629 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:41:30.280629 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:41:30.280629 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:41:30.280629 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:41:30.280629 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9620891-182f-40dd-8abe-42b8b0e1b758 could not be found. Oct 18 15:41:30.280629 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:41:30.285437 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-724f7c42-693f-4515-a237-f8da58d50a19 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Returning 404 to user: Instance f9620891-182f-40dd-8abe-42b8b0e1b758 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:41:30.285437 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-724f7c42-693f-4515-a237-f8da58d50a19 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers/f9620891-182f-40dd-8abe-42b8b0e1b758" status: 404 len: 111 microversion: 2.1 time: 0.093262 Oct 18 15:41:30.285437 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1897/3803] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:30 2022] GET /compute/v2.1/servers/f9620891-182f-40dd-8abe-42b8b0e1b758 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:41:30.300690 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8ae440d8-f58a-40c7-9220-7fcadbdce6cf tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:30.301227 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8ae440d8-f58a-40c7-9220-7fcadbdce6cf tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] [instance: 568f29d6-ddaf-4515-84dd-7cdab0922c97] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:30.326216 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8ae440d8-f58a-40c7-9220-7fcadbdce6cf tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:30.329014 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8ae440d8-f58a-40c7-9220-7fcadbdce6cf tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:30.333324 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8ae440d8-f58a-40c7-9220-7fcadbdce6cf tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:30.334317 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8ae440d8-f58a-40c7-9220-7fcadbdce6cf tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:30.334965 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8ae440d8-f58a-40c7-9220-7fcadbdce6cf tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:30.335566 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8ae440d8-f58a-40c7-9220-7fcadbdce6cf tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:30.394993 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8ae440d8-f58a-40c7-9220-7fcadbdce6cf tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] [instance: 568f29d6-ddaf-4515-84dd-7cdab0922c97] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:41:30.602279 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8ae440d8-f58a-40c7-9220-7fcadbdce6cf tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "DELETE /compute/v2.1/servers/568f29d6-ddaf-4515-84dd-7cdab0922c97" status: 204 len: 0 microversion: 2.1 time: 0.304975 Oct 18 15:41:30.603675 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1898/3804] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:41:30 2022] DELETE /compute/v2.1/servers/568f29d6-ddaf-4515-84dd-7cdab0922c97 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:41:30.618630 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e39859af-df5e-43ad-8591-4e4bd82706b0 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:30.622325 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e39859af-df5e-43ad-8591-4e4bd82706b0 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] [instance: 568f29d6-ddaf-4515-84dd-7cdab0922c97] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:30.629082 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=6 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:41:30.646307 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e39859af-df5e-43ad-8591-4e4bd82706b0 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:30.649205 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e39859af-df5e-43ad-8591-4e4bd82706b0 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:30.649944 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e39859af-df5e-43ad-8591-4e4bd82706b0 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:30.650879 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e39859af-df5e-43ad-8591-4e4bd82706b0 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:30.652752 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e39859af-df5e-43ad-8591-4e4bd82706b0 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:30.654513 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e39859af-df5e-43ad-8591-4e4bd82706b0 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:30.870636 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-88e4055e-36e7-4431-8c1f-102dbb54afa9 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:30.886673 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-88e4055e-36e7-4431-8c1f-102dbb54afa9 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1671 microversion: 2.1 time: 1.223650 Oct 18 15:41:30.887679 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1907/3805] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:29 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1671 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:30.913575 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bea213b3-222f-4e82-9bdf-17d6fd71b013 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:30.914196 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bea213b3-222f-4e82-9bdf-17d6fd71b013 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:30.923535 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bea213b3-222f-4e82-9bdf-17d6fd71b013 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:30.924035 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bea213b3-222f-4e82-9bdf-17d6fd71b013 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:30.925630 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bea213b3-222f-4e82-9bdf-17d6fd71b013 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:30.937863 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bea213b3-222f-4e82-9bdf-17d6fd71b013 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:30.938691 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bea213b3-222f-4e82-9bdf-17d6fd71b013 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:30.938993 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bea213b3-222f-4e82-9bdf-17d6fd71b013 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:31.062639 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e39859af-df5e-43ad-8591-4e4bd82706b0 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:31.074152 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e39859af-df5e-43ad-8591-4e4bd82706b0 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers/568f29d6-ddaf-4515-84dd-7cdab0922c97" status: 200 len: 1517 microversion: 2.1 time: 0.464772 Oct 18 15:41:31.075044 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1899/3806] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:30 2022] GET /compute/v2.1/servers/568f29d6-ddaf-4515-84dd-7cdab0922c97 => generated 1517 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:41:31.281358 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bea213b3-222f-4e82-9bdf-17d6fd71b013 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:31.315110 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bea213b3-222f-4e82-9bdf-17d6fd71b013 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1671 microversion: 2.1 time: 0.405464 Oct 18 15:41:31.332463 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1908/3807] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:30 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1671 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:41:31.339558 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d985c1ed-8973-4876-a9b3-f3fc1b6e3e15 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:31.340341 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d985c1ed-8973-4876-a9b3-f3fc1b6e3e15 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:31.351549 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d985c1ed-8973-4876-a9b3-f3fc1b6e3e15 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:31.352609 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d985c1ed-8973-4876-a9b3-f3fc1b6e3e15 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:31.353322 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d985c1ed-8973-4876-a9b3-f3fc1b6e3e15 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:31.354344 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d985c1ed-8973-4876-a9b3-f3fc1b6e3e15 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:31.355040 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d985c1ed-8973-4876-a9b3-f3fc1b6e3e15 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:31.355695 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d985c1ed-8973-4876-a9b3-f3fc1b6e3e15 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:31.585974 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-bc61a868-ee80-4492-bcc6-3bd821c63633 req-b15ce1d4-9730-43d4-8197-41025cc38887 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47ee1803-1ce0-4cbc-879e-d39cfe8576aa", "tag": "6255b173-b912-4205-9fcd-434867d970a5"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:41:31.605527 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-bc61a868-ee80-4492-bcc6-3bd821c63633 req-b15ce1d4-9730-43d4-8197-41025cc38887 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:31.606422 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-bc61a868-ee80-4492-bcc6-3bd821c63633 req-b15ce1d4-9730-43d4-8197-41025cc38887 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:31.607085 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-bc61a868-ee80-4492-bcc6-3bd821c63633 req-b15ce1d4-9730-43d4-8197-41025cc38887 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:31.641262 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-bc61a868-ee80-4492-bcc6-3bd821c63633 req-b15ce1d4-9730-43d4-8197-41025cc38887 service nova] Creating event network-changed:6255b173-b912-4205-9fcd-434867d970a5 for instance 47ee1803-1ce0-4cbc-879e-d39cfe8576aa on n-h1-853682-5 Oct 18 15:41:31.649856 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=38 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:41:31.660195 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-bc61a868-ee80-4492-bcc6-3bd821c63633 req-b15ce1d4-9730-43d4-8197-41025cc38887 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071765 Oct 18 15:41:31.661244 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1909/3808] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:41:32.004511 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d985c1ed-8973-4876-a9b3-f3fc1b6e3e15 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:32.017058 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d985c1ed-8973-4876-a9b3-f3fc1b6e3e15 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1671 microversion: 2.1 time: 0.681102 Oct 18 15:41:32.044789 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-deb8589c-45b0-428e-9c5b-8e0433993fd6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-624634703"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:41:32.048091 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-deb8589c-45b0-428e-9c5b-8e0433993fd6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:32.050363 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1900/3809] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:31 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1671 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:32.065346 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-deb8589c-45b0-428e-9c5b-8e0433993fd6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:32.067772 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-deb8589c-45b0-428e-9c5b-8e0433993fd6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:32.069242 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-deb8589c-45b0-428e-9c5b-8e0433993fd6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:32.072145 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-deb8589c-45b0-428e-9c5b-8e0433993fd6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:32.072899 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-deb8589c-45b0-428e-9c5b-8e0433993fd6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:32.073559 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-deb8589c-45b0-428e-9c5b-8e0433993fd6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:32.099945 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9b5ac156-1007-43b2-a297-2f542e5e1640 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:32.100727 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9b5ac156-1007-43b2-a297-2f542e5e1640 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] [instance: 568f29d6-ddaf-4515-84dd-7cdab0922c97] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:32.113827 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9b5ac156-1007-43b2-a297-2f542e5e1640 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:32.114746 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9b5ac156-1007-43b2-a297-2f542e5e1640 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:32.125571 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9b5ac156-1007-43b2-a297-2f542e5e1640 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:32.126753 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9b5ac156-1007-43b2-a297-2f542e5e1640 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:32.127468 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9b5ac156-1007-43b2-a297-2f542e5e1640 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:32.128770 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9b5ac156-1007-43b2-a297-2f542e5e1640 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:32.536040 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-deb8589c-45b0-428e-9c5b-8e0433993fd6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "POST /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8/action" status: 202 len: 0 microversion: 2.1 time: 0.486404 Oct 18 15:41:32.542683 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1910/3810] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:41:32 2022] POST /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8/action => generated 0 bytes in 503 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 18 15:41:32.564509 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1fc58885-920b-42cb-813d-04f089acaef1 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Action: 'create', calling method: .version_select at 0x7f7c3d6fdb80>, body: {"keypair": {"name": "tempest-keypair-571736896", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHYuhdATfuhB3yBrNYzhsoWWsUh2y/cksfxCK2wxsKOM4Nk2M6jCgErCzx5i1BHWlNuSWWDmqFKsqwy4mQtrh6r4653KKhYdIlYeb14f0OkVxCoVMbj4Gn0Ye4kEFeIY7w=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:41:32.619202 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-1fc58885-920b-42cb-813d-04f089acaef1 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Getting quotas for project 5cdc7504a1d1424ea34f83f1a6d4bf71. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:41:32.633183 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-1fc58885-920b-42cb-813d-04f089acaef1 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Getting quotas for user 304b3248f9db4629943a8b8080a6d22e and project 5cdc7504a1d1424ea34f83f1a6d4bf71. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:41:32.718348 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1fc58885-920b-42cb-813d-04f089acaef1 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.171115 Oct 18 15:41:32.719468 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1911/3811] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Oct 18 15:41:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:41:32.951515 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9b5ac156-1007-43b2-a297-2f542e5e1640 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:32.986074 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9b5ac156-1007-43b2-a297-2f542e5e1640 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers/568f29d6-ddaf-4515-84dd-7cdab0922c97" status: 200 len: 1517 microversion: 2.1 time: 0.889825 Oct 18 15:41:32.996956 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1901/3812] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:32 2022] GET /compute/v2.1/servers/568f29d6-ddaf-4515-84dd-7cdab0922c97 => generated 1517 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:41:34.013957 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1b439814-a44c-4dec-99ef-db1ff83f7a7c tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:34.014860 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1b439814-a44c-4dec-99ef-db1ff83f7a7c tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] [instance: 568f29d6-ddaf-4515-84dd-7cdab0922c97] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:34.022698 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b439814-a44c-4dec-99ef-db1ff83f7a7c tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:34.023192 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b439814-a44c-4dec-99ef-db1ff83f7a7c tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:34.023628 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b439814-a44c-4dec-99ef-db1ff83f7a7c tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:34.024443 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b439814-a44c-4dec-99ef-db1ff83f7a7c tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:34.024919 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b439814-a44c-4dec-99ef-db1ff83f7a7c tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:34.025353 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b439814-a44c-4dec-99ef-db1ff83f7a7c tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:34.765771 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-94172391-0fe2-40a1-a0ca-ea66ff62a768 req-0f680f6e-5431-4b3b-b789-3625979459b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "568f29d6-ddaf-4515-84dd-7cdab0922c97", "name": "network-vif-deleted", "tag": "4be806d3-350c-4b58-a904-3633416f11d1"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:41:34.797263 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-94172391-0fe2-40a1-a0ca-ea66ff62a768 req-0f680f6e-5431-4b3b-b789-3625979459b9 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:34.797775 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-94172391-0fe2-40a1-a0ca-ea66ff62a768 req-0f680f6e-5431-4b3b-b789-3625979459b9 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:34.798429 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-94172391-0fe2-40a1-a0ca-ea66ff62a768 req-0f680f6e-5431-4b3b-b789-3625979459b9 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:34.825329 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-94172391-0fe2-40a1-a0ca-ea66ff62a768 req-0f680f6e-5431-4b3b-b789-3625979459b9 service nova] Creating event network-vif-deleted:4be806d3-350c-4b58-a904-3633416f11d1 for instance 568f29d6-ddaf-4515-84dd-7cdab0922c97 on n-h1-853682-5 Oct 18 15:41:34.840490 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-94172391-0fe2-40a1-a0ca-ea66ff62a768 req-0f680f6e-5431-4b3b-b789-3625979459b9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080210 Oct 18 15:41:34.841415 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1902/3813] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 18 15:41:34.849781 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1b439814-a44c-4dec-99ef-db1ff83f7a7c tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:34.853673 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:41:34.862353 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1b439814-a44c-4dec-99ef-db1ff83f7a7c tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers/568f29d6-ddaf-4515-84dd-7cdab0922c97" status: 200 len: 1517 microversion: 2.1 time: 0.853086 Oct 18 15:41:34.903120 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1912/3814] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:34 2022] GET /compute/v2.1/servers/568f29d6-ddaf-4515-84dd-7cdab0922c97 => generated 1517 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:35.896010 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0880a0ef-3bd4-47d7-b068-c203f4c26174 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:35.897533 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0880a0ef-3bd4-47d7-b068-c203f4c26174 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] [instance: 568f29d6-ddaf-4515-84dd-7cdab0922c97] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:35.906814 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0880a0ef-3bd4-47d7-b068-c203f4c26174 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:35.908365 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0880a0ef-3bd4-47d7-b068-c203f4c26174 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:35.909213 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0880a0ef-3bd4-47d7-b068-c203f4c26174 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:35.910807 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0880a0ef-3bd4-47d7-b068-c203f4c26174 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:35.911663 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0880a0ef-3bd4-47d7-b068-c203f4c26174 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:35.912383 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0880a0ef-3bd4-47d7-b068-c203f4c26174 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:35.938362 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-0880a0ef-3bd4-47d7-b068-c203f4c26174 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] HTTP exception thrown: Instance 568f29d6-ddaf-4515-84dd-7cdab0922c97 could not be found. Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0880a0ef-3bd4-47d7-b068-c203f4c26174 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Request method failure captured: Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/568f29d6-ddaf-4515-84dd-7cdab0922c97 HTTP/1.1 Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsjskNT6AsaiCCQOJV1aiEIHP4xqXOyR40LtRs9k9m58TaVa3fEBPheglHdg28A2OGNNNXWPq0EgTgG6oXIpdamjilmjpHU4kKcSPyGpVEp3cvObcy-4lkaZQOz2owSjp1acIrnyFrrTiluuGYg0ITF36KmmacL5EDYFPEN4QkpfOn4 Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: a699a53b28b247c69921a0d3435ee9a1 Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ListServerFiltersTestJSON-1208105714 Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a699a53b28b247c69921a0d3435ee9a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a699a53b28b247c69921a0d3435ee9a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a699a53b28b247c69921a0d3435ee9a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a699a53b28b247c69921a0d3435ee9a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ListServerFiltersTestJSON-1208105714 Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: a699a53b28b247c69921a0d3435ee9a1 Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1208105714 Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ListServerFiltersTestJSON-1208105714-project Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: a97a371515534f3f95e68537715feadc Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ListServerFiltersTestJSON-1208105714-project Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 568f29d6-ddaf-4515-84dd-7cdab0922c97 could not be found. Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '568f29d6-ddaf-4515-84dd-7cdab0922c97'} Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 568f29d6-ddaf-4515-84dd-7cdab0922c97 could not be found. Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 568f29d6-ddaf-4515-84dd-7cdab0922c97 could not be found. Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:41:35.948168 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:41:35.953852 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:35.953852 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:41:35.953852 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:41:35.953852 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:41:35.953852 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:41:35.953852 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 568f29d6-ddaf-4515-84dd-7cdab0922c97 could not be found. Oct 18 15:41:35.953852 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:41:35.954799 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0880a0ef-3bd4-47d7-b068-c203f4c26174 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Returning 404 to user: Instance 568f29d6-ddaf-4515-84dd-7cdab0922c97 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:41:35.955859 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0880a0ef-3bd4-47d7-b068-c203f4c26174 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers/568f29d6-ddaf-4515-84dd-7cdab0922c97" status: 404 len: 111 microversion: 2.1 time: 0.067912 Oct 18 15:41:35.961374 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1903/3815] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:35 2022] GET /compute/v2.1/servers/568f29d6-ddaf-4515-84dd-7cdab0922c97 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:41:35.966327 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-49ddf165-0e8f-4059-b2bc-198f4e260eef tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:35.967135 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-49ddf165-0e8f-4059-b2bc-198f4e260eef tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] [instance: bea3a8ec-d421-45b4-b6d8-397ac80c920d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:35.976104 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49ddf165-0e8f-4059-b2bc-198f4e260eef tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:35.976730 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49ddf165-0e8f-4059-b2bc-198f4e260eef tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:35.977567 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49ddf165-0e8f-4059-b2bc-198f4e260eef tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:35.978544 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49ddf165-0e8f-4059-b2bc-198f4e260eef tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:35.979254 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49ddf165-0e8f-4059-b2bc-198f4e260eef tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:35.979916 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49ddf165-0e8f-4059-b2bc-198f4e260eef tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:36.013980 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-49ddf165-0e8f-4059-b2bc-198f4e260eef tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] [instance: bea3a8ec-d421-45b4-b6d8-397ac80c920d] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:41:36.171663 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-49ddf165-0e8f-4059-b2bc-198f4e260eef tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "DELETE /compute/v2.1/servers/bea3a8ec-d421-45b4-b6d8-397ac80c920d" status: 204 len: 0 microversion: 2.1 time: 0.208805 Oct 18 15:41:36.172468 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1913/3816] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:41:35 2022] DELETE /compute/v2.1/servers/bea3a8ec-d421-45b4-b6d8-397ac80c920d => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:41:36.181802 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-dc55e4c7-0414-4745-bfb7-84270b2862bf tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:36.182428 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-dc55e4c7-0414-4745-bfb7-84270b2862bf tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] [instance: bea3a8ec-d421-45b4-b6d8-397ac80c920d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:36.192146 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dc55e4c7-0414-4745-bfb7-84270b2862bf tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:36.192652 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dc55e4c7-0414-4745-bfb7-84270b2862bf tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:36.197299 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dc55e4c7-0414-4745-bfb7-84270b2862bf tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:36.198050 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dc55e4c7-0414-4745-bfb7-84270b2862bf tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:36.198528 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dc55e4c7-0414-4745-bfb7-84270b2862bf tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:36.198968 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dc55e4c7-0414-4745-bfb7-84270b2862bf tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:36.569766 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-dc55e4c7-0414-4745-bfb7-84270b2862bf tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:36.582271 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-dc55e4c7-0414-4745-bfb7-84270b2862bf tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers/bea3a8ec-d421-45b4-b6d8-397ac80c920d" status: 200 len: 1518 microversion: 2.1 time: 0.405123 Oct 18 15:41:36.584877 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1904/3817] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:36 2022] GET /compute/v2.1/servers/bea3a8ec-d421-45b4-b6d8-397ac80c920d => generated 1518 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:36.814886 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e25c3b5b-b19b-4752-baa6-cf419e8febb3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-962404239", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "271f146d-5c28-4347-b10b-09aca0da6649"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:41:36.912504 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-e25c3b5b-b19b-4752-baa6-cf419e8febb3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] validate_networks() for [('271f146d-5c28-4347-b10b-09aca0da6649', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:41:37.051773 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-55992563-eec4-413f-99c9-3dc120950456 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-608835568", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "97e5b8d6-e99f-4cb5-8ca9-d5bc9c2a3450"}], "security_groups": [{"name": "tempest-securitygroup--933360414"}], "key_name": "tempest-keypair-571736896", "user_data": "}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:41:37.625190 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-55992563-eec4-413f-99c9-3dc120950456 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] validate_networks() for [('97e5b8d6-e99f-4cb5-8ca9-d5bc9c2a3450', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:41:38.422169 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-e25c3b5b-b19b-4752-baa6-cf419e8febb3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:41:38.422704 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-e25c3b5b-b19b-4752-baa6-cf419e8febb3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:41:38.423054 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-e25c3b5b-b19b-4752-baa6-cf419e8febb3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:41:38.423462 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-e25c3b5b-b19b-4752-baa6-cf419e8febb3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:41:38.423871 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-e25c3b5b-b19b-4752-baa6-cf419e8febb3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:41:38.438677 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e25c3b5b-b19b-4752-baa6-cf419e8febb3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:38.439168 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e25c3b5b-b19b-4752-baa6-cf419e8febb3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:38.443802 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e25c3b5b-b19b-4752-baa6-cf419e8febb3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:38.447223 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e25c3b5b-b19b-4752-baa6-cf419e8febb3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:38.448905 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e25c3b5b-b19b-4752-baa6-cf419e8febb3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:38.448905 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e25c3b5b-b19b-4752-baa6-cf419e8febb3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:38.491698 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-e25c3b5b-b19b-4752-baa6-cf419e8febb3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Getting quotas for project 38b4cd4b884c4456866052a4969dc138. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:41:38.498143 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-e25c3b5b-b19b-4752-baa6-cf419e8febb3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Getting quotas for user a2e9e9bbf3d94d77a236e43f019d316a and project 38b4cd4b884c4456866052a4969dc138. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:41:38.552319 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e25c3b5b-b19b-4752-baa6-cf419e8febb3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:41:38.558271 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e25c3b5b-b19b-4752-baa6-cf419e8febb3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 68a3c952-31f5-42a5-a8b9-698785c5c01f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:41:38.744226 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e25c3b5b-b19b-4752-baa6-cf419e8febb3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.152170 Oct 18 15:41:38.746456 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1914/3818] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:41:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2185 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:41:38.760393 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8ceadcae-02d7-445a-a206-96b7773ce31b tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:38.780017 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8ceadcae-02d7-445a-a206-96b7773ce31b tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] [instance: bea3a8ec-d421-45b4-b6d8-397ac80c920d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:38.797141 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ceadcae-02d7-445a-a206-96b7773ce31b tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:38.798986 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ceadcae-02d7-445a-a206-96b7773ce31b tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:38.800076 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ceadcae-02d7-445a-a206-96b7773ce31b tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:38.801065 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ceadcae-02d7-445a-a206-96b7773ce31b tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:38.803859 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ceadcae-02d7-445a-a206-96b7773ce31b tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:38.806069 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ceadcae-02d7-445a-a206-96b7773ce31b tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:39.330043 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8ceadcae-02d7-445a-a206-96b7773ce31b tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:39.343593 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8ceadcae-02d7-445a-a206-96b7773ce31b tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers/bea3a8ec-d421-45b4-b6d8-397ac80c920d" status: 200 len: 1518 microversion: 2.1 time: 0.593877 Oct 18 15:41:39.344205 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1915/3819] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:38 2022] GET /compute/v2.1/servers/bea3a8ec-d421-45b4-b6d8-397ac80c920d => generated 1518 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:39.354096 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-bac858da-1cbe-4f91-ab3b-e7af00ef329c req-9ae2ed3f-9e6a-43fa-9453-e845ce091474 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79212b18-bfd6-4a94-9d58-80c535525aa8", "name": "network-vif-plugged", "status": "completed", "tag": "65ddf63c-d787-42eb-bb1d-c107c1fe8b2f"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:41:39.381528 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-bac858da-1cbe-4f91-ab3b-e7af00ef329c req-9ae2ed3f-9e6a-43fa-9453-e845ce091474 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:39.382001 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-bac858da-1cbe-4f91-ab3b-e7af00ef329c req-9ae2ed3f-9e6a-43fa-9453-e845ce091474 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:39.382428 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-bac858da-1cbe-4f91-ab3b-e7af00ef329c req-9ae2ed3f-9e6a-43fa-9453-e845ce091474 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:39.399523 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-bac858da-1cbe-4f91-ab3b-e7af00ef329c req-9ae2ed3f-9e6a-43fa-9453-e845ce091474 service nova] Creating event network-vif-plugged:65ddf63c-d787-42eb-bb1d-c107c1fe8b2f for instance 79212b18-bfd6-4a94-9d58-80c535525aa8 on n-h2-853682-5 Oct 18 15:41:39.405993 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-bac858da-1cbe-4f91-ab3b-e7af00ef329c req-9ae2ed3f-9e6a-43fa-9453-e845ce091474 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059958 Oct 18 15:41:39.406743 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1916/3820] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:41:39.416152 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d2eea767-89e3-477a-aa69-3f9c631ef7c2 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:39.418688 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d2eea767-89e3-477a-aa69-3f9c631ef7c2 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 68a3c952-31f5-42a5-a8b9-698785c5c01f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:39.531229 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d2eea767-89e3-477a-aa69-3f9c631ef7c2 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:39.541849 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d2eea767-89e3-477a-aa69-3f9c631ef7c2 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f" status: 200 len: 1224 microversion: 2.1 time: 0.133563 Oct 18 15:41:39.566673 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1917/3821] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:39 2022] GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f => generated 1224 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:39.773843 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-55992563-eec4-413f-99c9-3dc120950456 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:41:39.774371 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-55992563-eec4-413f-99c9-3dc120950456 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:41:39.774753 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-55992563-eec4-413f-99c9-3dc120950456 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:41:39.775174 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-55992563-eec4-413f-99c9-3dc120950456 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:41:39.775591 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-55992563-eec4-413f-99c9-3dc120950456 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:41:39.778135 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:41:39.786320 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-f20a1c9b-2071-478a-bcd1-ad4b08ba209e req-28f6a775-be8f-4f55-973c-241ec2ca2f2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bea3a8ec-d421-45b4-b6d8-397ac80c920d", "name": "network-vif-deleted", "tag": "109ec8d2-d5cf-4fb1-a792-7805e9d7d81b"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:41:39.801318 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f20a1c9b-2071-478a-bcd1-ad4b08ba209e req-28f6a775-be8f-4f55-973c-241ec2ca2f2b service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:39.802222 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f20a1c9b-2071-478a-bcd1-ad4b08ba209e req-28f6a775-be8f-4f55-973c-241ec2ca2f2b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:39.803036 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f20a1c9b-2071-478a-bcd1-ad4b08ba209e req-28f6a775-be8f-4f55-973c-241ec2ca2f2b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:39.804968 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-55992563-eec4-413f-99c9-3dc120950456 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:39.805564 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-55992563-eec4-413f-99c9-3dc120950456 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:39.806020 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-55992563-eec4-413f-99c9-3dc120950456 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:39.813593 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-55992563-eec4-413f-99c9-3dc120950456 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:39.814204 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-55992563-eec4-413f-99c9-3dc120950456 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:39.814665 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-55992563-eec4-413f-99c9-3dc120950456 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:39.850968 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-f20a1c9b-2071-478a-bcd1-ad4b08ba209e req-28f6a775-be8f-4f55-973c-241ec2ca2f2b service nova] Creating event network-vif-deleted:109ec8d2-d5cf-4fb1-a792-7805e9d7d81b for instance bea3a8ec-d421-45b4-b6d8-397ac80c920d on n-h2-853682-5 Oct 18 15:41:39.873250 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-f20a1c9b-2071-478a-bcd1-ad4b08ba209e req-28f6a775-be8f-4f55-973c-241ec2ca2f2b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090336 Oct 18 15:41:39.876768 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1918/3822] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:41:39.933722 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-55992563-eec4-413f-99c9-3dc120950456 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Getting quotas for project 5cdc7504a1d1424ea34f83f1a6d4bf71. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:41:39.977863 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-55992563-eec4-413f-99c9-3dc120950456 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Getting quotas for user 304b3248f9db4629943a8b8080a6d22e and project 5cdc7504a1d1424ea34f83f1a6d4bf71. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:41:40.024941 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-55992563-eec4-413f-99c9-3dc120950456 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:41:40.033095 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-55992563-eec4-413f-99c9-3dc120950456 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 55179126-a629-4bb3-82f5-14606ec63426] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:41:40.206628 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-55992563-eec4-413f-99c9-3dc120950456 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.158508 Oct 18 15:41:40.209062 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1905/3823] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:41:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 3164 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:41:40.221293 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-96d9c626-126c-4561-bc82-10f5a25c6781 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:40.222450 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-96d9c626-126c-4561-bc82-10f5a25c6781 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 55179126-a629-4bb3-82f5-14606ec63426] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:40.373465 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-757ab258-1561-4c82-b31f-0eb0ba463ee6 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:40.374085 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-757ab258-1561-4c82-b31f-0eb0ba463ee6 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] [instance: bea3a8ec-d421-45b4-b6d8-397ac80c920d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:40.386797 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-757ab258-1561-4c82-b31f-0eb0ba463ee6 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:40.395577 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-757ab258-1561-4c82-b31f-0eb0ba463ee6 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:40.396276 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-757ab258-1561-4c82-b31f-0eb0ba463ee6 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:40.397100 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-757ab258-1561-4c82-b31f-0eb0ba463ee6 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:40.399767 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-757ab258-1561-4c82-b31f-0eb0ba463ee6 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:40.403809 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-757ab258-1561-4c82-b31f-0eb0ba463ee6 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:40.429784 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-96d9c626-126c-4561-bc82-10f5a25c6781 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304b3248f9db4629943a8b8080a6d22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdc7504a1d1424ea34f83f1a6d4bf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:40.446226 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-96d9c626-126c-4561-bc82-10f5a25c6781 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426" status: 200 len: 1236 microversion: 2.1 time: 0.225751 Oct 18 15:41:40.449772 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1919/3824] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:40 2022] GET /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426 => generated 1236 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:40.540756 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-757ab258-1561-4c82-b31f-0eb0ba463ee6 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:40.544616 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-757ab258-1561-4c82-b31f-0eb0ba463ee6 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:40.546070 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-757ab258-1561-4c82-b31f-0eb0ba463ee6 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:40.547755 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-757ab258-1561-4c82-b31f-0eb0ba463ee6 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lazy-loading 'fault' on Instance uuid bea3a8ec-d421-45b4-b6d8-397ac80c920d {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:41:40.578274 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d03fe00a-14a7-4b10-9687-695bb98f4f3f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:40.578901 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d03fe00a-14a7-4b10-9687-695bb98f4f3f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 68a3c952-31f5-42a5-a8b9-698785c5c01f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:40.611256 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d03fe00a-14a7-4b10-9687-695bb98f4f3f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:40.612014 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d03fe00a-14a7-4b10-9687-695bb98f4f3f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:40.629024 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d03fe00a-14a7-4b10-9687-695bb98f4f3f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:40.632832 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d03fe00a-14a7-4b10-9687-695bb98f4f3f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:40.635969 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d03fe00a-14a7-4b10-9687-695bb98f4f3f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:40.636360 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d03fe00a-14a7-4b10-9687-695bb98f4f3f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:40.748955 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-757ab258-1561-4c82-b31f-0eb0ba463ee6 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97a371515534f3f95e68537715feadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a699a53b28b247c69921a0d3435ee9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:40.765298 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-757ab258-1561-4c82-b31f-0eb0ba463ee6 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers/bea3a8ec-d421-45b4-b6d8-397ac80c920d" status: 200 len: 1311 microversion: 2.1 time: 0.391490 Oct 18 15:41:40.779336 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1906/3825] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:40 2022] GET /compute/v2.1/servers/bea3a8ec-d421-45b4-b6d8-397ac80c920d => generated 1311 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:40.899100 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d03fe00a-14a7-4b10-9687-695bb98f4f3f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:40.910644 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d03fe00a-14a7-4b10-9687-695bb98f4f3f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f" status: 200 len: 1276 microversion: 2.1 time: 0.338890 Oct 18 15:41:40.913950 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1920/3826] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:40 2022] GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f => generated 1276 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:41.469907 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-866b1a90-eae8-4161-a6d3-b7290b1abe56 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:41.470541 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-866b1a90-eae8-4161-a6d3-b7290b1abe56 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 55179126-a629-4bb3-82f5-14606ec63426] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:41.485358 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-866b1a90-eae8-4161-a6d3-b7290b1abe56 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:41.485866 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-866b1a90-eae8-4161-a6d3-b7290b1abe56 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:41.486312 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-866b1a90-eae8-4161-a6d3-b7290b1abe56 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:41.487117 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-866b1a90-eae8-4161-a6d3-b7290b1abe56 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:41.488109 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-866b1a90-eae8-4161-a6d3-b7290b1abe56 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:41.488576 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-866b1a90-eae8-4161-a6d3-b7290b1abe56 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:41.772007 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-866b1a90-eae8-4161-a6d3-b7290b1abe56 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304b3248f9db4629943a8b8080a6d22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdc7504a1d1424ea34f83f1a6d4bf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:41.793234 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-866b1a90-eae8-4161-a6d3-b7290b1abe56 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426" status: 200 len: 1240 microversion: 2.1 time: 0.328277 Oct 18 15:41:41.795371 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6cedb1da-9de0-4b6c-86f0-70c4c6a84fb4 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:41.808139 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6cedb1da-9de0-4b6c-86f0-70c4c6a84fb4 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] [instance: bea3a8ec-d421-45b4-b6d8-397ac80c920d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:41.808274 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1907/3827] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:41 2022] GET /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426 => generated 1240 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:41:41.812622 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:41:41.821856 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6cedb1da-9de0-4b6c-86f0-70c4c6a84fb4 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:41.824981 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6cedb1da-9de0-4b6c-86f0-70c4c6a84fb4 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:41.827847 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6cedb1da-9de0-4b6c-86f0-70c4c6a84fb4 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:41.828775 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6cedb1da-9de0-4b6c-86f0-70c4c6a84fb4 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:41.829309 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6cedb1da-9de0-4b6c-86f0-70c4c6a84fb4 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:41.831881 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6cedb1da-9de0-4b6c-86f0-70c4c6a84fb4 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:41.874755 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-6cedb1da-9de0-4b6c-86f0-70c4c6a84fb4 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] HTTP exception thrown: Instance bea3a8ec-d421-45b4-b6d8-397ac80c920d could not be found. Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6cedb1da-9de0-4b6c-86f0-70c4c6a84fb4 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Request method failure captured: Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/bea3a8ec-d421-45b4-b6d8-397ac80c920d HTTP/1.1 Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsjskNT6AsaiCCQOJV1aiEIHP4xqXOyR40LtRs9k9m58TaVa3fEBPheglHdg28A2OGNNNXWPq0EgTgG6oXIpdamjilmjpHU4kKcSPyGpVEp3cvObcy-4lkaZQOz2owSjp1acIrnyFrrTiluuGYg0ITF36KmmacL5EDYFPEN4QkpfOn4 Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: a699a53b28b247c69921a0d3435ee9a1 Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ListServerFiltersTestJSON-1208105714 Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a699a53b28b247c69921a0d3435ee9a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a699a53b28b247c69921a0d3435ee9a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a699a53b28b247c69921a0d3435ee9a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a699a53b28b247c69921a0d3435ee9a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ListServerFiltersTestJSON-1208105714 Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: a699a53b28b247c69921a0d3435ee9a1 Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1208105714 Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ListServerFiltersTestJSON-1208105714-project Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: a97a371515534f3f95e68537715feadc Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ListServerFiltersTestJSON-1208105714-project Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance bea3a8ec-d421-45b4-b6d8-397ac80c920d could not be found. Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'bea3a8ec-d421-45b4-b6d8-397ac80c920d'} Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bea3a8ec-d421-45b4-b6d8-397ac80c920d could not be found. Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bea3a8ec-d421-45b4-b6d8-397ac80c920d could not be found. Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:41:41.878603 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:41.883780 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:41:41.883780 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:41:41.883780 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:41:41.883780 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:41:41.883780 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:41:41.883780 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bea3a8ec-d421-45b4-b6d8-397ac80c920d could not be found. Oct 18 15:41:41.883780 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:41:41.887666 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6cedb1da-9de0-4b6c-86f0-70c4c6a84fb4 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] Returning 404 to user: Instance bea3a8ec-d421-45b4-b6d8-397ac80c920d could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:41:41.889513 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6cedb1da-9de0-4b6c-86f0-70c4c6a84fb4 tempest-ListServerFiltersTestJSON-1208105714 tempest-ListServerFiltersTestJSON-1208105714-project] 10.222.0.60 "GET /compute/v2.1/servers/bea3a8ec-d421-45b4-b6d8-397ac80c920d" status: 404 len: 111 microversion: 2.1 time: 0.101170 Oct 18 15:41:41.901114 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1921/3828] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:41 2022] GET /compute/v2.1/servers/bea3a8ec-d421-45b4-b6d8-397ac80c920d => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 15:41:41.939233 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-24a59333-571b-4bee-9590-84423dffde94 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:41.939922 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-24a59333-571b-4bee-9590-84423dffde94 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 68a3c952-31f5-42a5-a8b9-698785c5c01f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:41.951258 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-24a59333-571b-4bee-9590-84423dffde94 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:41.951768 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-24a59333-571b-4bee-9590-84423dffde94 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:41.952253 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-24a59333-571b-4bee-9590-84423dffde94 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:41.953251 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-24a59333-571b-4bee-9590-84423dffde94 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:41.953896 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-24a59333-571b-4bee-9590-84423dffde94 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:41.954634 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-24a59333-571b-4bee-9590-84423dffde94 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:42.387474 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-24a59333-571b-4bee-9590-84423dffde94 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:42.398865 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-24a59333-571b-4bee-9590-84423dffde94 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f" status: 200 len: 1282 microversion: 2.1 time: 0.463503 Oct 18 15:41:42.422999 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1908/3829] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:41 2022] GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f => generated 1282 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:42.823516 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4afba96d-fe1d-4e1d-bbd4-c6db6dcd2d82 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:42.824117 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4afba96d-fe1d-4e1d-bbd4-c6db6dcd2d82 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 55179126-a629-4bb3-82f5-14606ec63426] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:42.849045 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4afba96d-fe1d-4e1d-bbd4-c6db6dcd2d82 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:42.852294 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4afba96d-fe1d-4e1d-bbd4-c6db6dcd2d82 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:42.853343 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4afba96d-fe1d-4e1d-bbd4-c6db6dcd2d82 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:42.854339 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4afba96d-fe1d-4e1d-bbd4-c6db6dcd2d82 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:42.855065 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4afba96d-fe1d-4e1d-bbd4-c6db6dcd2d82 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:42.857779 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4afba96d-fe1d-4e1d-bbd4-c6db6dcd2d82 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:43.325971 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4afba96d-fe1d-4e1d-bbd4-c6db6dcd2d82 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304b3248f9db4629943a8b8080a6d22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdc7504a1d1424ea34f83f1a6d4bf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:43.348836 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4afba96d-fe1d-4e1d-bbd4-c6db6dcd2d82 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426" status: 200 len: 1296 microversion: 2.1 time: 0.529617 Oct 18 15:41:43.356903 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1922/3830] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:42 2022] GET /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426 => generated 1296 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:43.427710 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-25e70682-8e32-40db-a0f0-5006e1d36645 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:43.430172 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-25e70682-8e32-40db-a0f0-5006e1d36645 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 68a3c952-31f5-42a5-a8b9-698785c5c01f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:43.455746 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-25e70682-8e32-40db-a0f0-5006e1d36645 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:43.457252 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-25e70682-8e32-40db-a0f0-5006e1d36645 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:43.460955 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-25e70682-8e32-40db-a0f0-5006e1d36645 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:43.464770 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-25e70682-8e32-40db-a0f0-5006e1d36645 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:43.469849 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-25e70682-8e32-40db-a0f0-5006e1d36645 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:43.470456 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-25e70682-8e32-40db-a0f0-5006e1d36645 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:43.921887 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-25e70682-8e32-40db-a0f0-5006e1d36645 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:43.965118 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-25e70682-8e32-40db-a0f0-5006e1d36645 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f" status: 200 len: 1282 microversion: 2.1 time: 0.539154 Oct 18 15:41:43.988397 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1909/3831] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:43 2022] GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f => generated 1282 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:41:44.379655 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c457407e-4449-461a-8236-ac16193d34ab tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:44.381009 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c457407e-4449-461a-8236-ac16193d34ab tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 55179126-a629-4bb3-82f5-14606ec63426] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:44.400516 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c457407e-4449-461a-8236-ac16193d34ab tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:44.402417 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c457407e-4449-461a-8236-ac16193d34ab tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:44.403243 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c457407e-4449-461a-8236-ac16193d34ab tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:44.406549 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c457407e-4449-461a-8236-ac16193d34ab tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:44.407769 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c457407e-4449-461a-8236-ac16193d34ab tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:44.411012 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c457407e-4449-461a-8236-ac16193d34ab tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:44.737378 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c457407e-4449-461a-8236-ac16193d34ab tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304b3248f9db4629943a8b8080a6d22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdc7504a1d1424ea34f83f1a6d4bf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:44.754866 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c457407e-4449-461a-8236-ac16193d34ab tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426" status: 200 len: 1294 microversion: 2.1 time: 0.380474 Oct 18 15:41:44.758068 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1923/3832] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:44 2022] GET /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426 => generated 1294 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:45.007125 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6e34f438-9961-410c-bbeb-d29a757d358c tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:45.008426 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6e34f438-9961-410c-bbeb-d29a757d358c tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 68a3c952-31f5-42a5-a8b9-698785c5c01f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:45.024179 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6e34f438-9961-410c-bbeb-d29a757d358c tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:45.024723 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6e34f438-9961-410c-bbeb-d29a757d358c tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:45.025181 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6e34f438-9961-410c-bbeb-d29a757d358c tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:45.026145 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6e34f438-9961-410c-bbeb-d29a757d358c tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:45.026792 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6e34f438-9961-410c-bbeb-d29a757d358c tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:45.027243 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6e34f438-9961-410c-bbeb-d29a757d358c tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:45.074056 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:41:45.666555 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6e34f438-9961-410c-bbeb-d29a757d358c tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:45.679571 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6e34f438-9961-410c-bbeb-d29a757d358c tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f" status: 200 len: 1324 microversion: 2.1 time: 0.676920 Oct 18 15:41:45.684269 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1910/3833] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:45 2022] GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f => generated 1324 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:45.789094 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fcf11bad-7827-4a3b-ae81-9cd7d962f208 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:45.789713 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fcf11bad-7827-4a3b-ae81-9cd7d962f208 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 55179126-a629-4bb3-82f5-14606ec63426] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:45.805322 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fcf11bad-7827-4a3b-ae81-9cd7d962f208 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:45.805696 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fcf11bad-7827-4a3b-ae81-9cd7d962f208 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:45.806198 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fcf11bad-7827-4a3b-ae81-9cd7d962f208 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:45.810144 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fcf11bad-7827-4a3b-ae81-9cd7d962f208 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:45.810572 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fcf11bad-7827-4a3b-ae81-9cd7d962f208 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:45.816354 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fcf11bad-7827-4a3b-ae81-9cd7d962f208 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:46.244168 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fcf11bad-7827-4a3b-ae81-9cd7d962f208 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304b3248f9db4629943a8b8080a6d22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdc7504a1d1424ea34f83f1a6d4bf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:46.268306 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fcf11bad-7827-4a3b-ae81-9cd7d962f208 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426" status: 200 len: 1361 microversion: 2.1 time: 0.481952 Oct 18 15:41:46.269924 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1924/3834] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:45 2022] GET /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426 => generated 1361 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:46.710726 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-19406d50-4abe-4fbb-a597-40e87157bba3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:46.711348 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-19406d50-4abe-4fbb-a597-40e87157bba3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 68a3c952-31f5-42a5-a8b9-698785c5c01f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:46.728787 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-19406d50-4abe-4fbb-a597-40e87157bba3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:46.738553 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-19406d50-4abe-4fbb-a597-40e87157bba3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:46.738938 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-19406d50-4abe-4fbb-a597-40e87157bba3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:46.740339 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-19406d50-4abe-4fbb-a597-40e87157bba3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:46.741074 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-19406d50-4abe-4fbb-a597-40e87157bba3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:46.741515 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-19406d50-4abe-4fbb-a597-40e87157bba3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:47.088297 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-19406d50-4abe-4fbb-a597-40e87157bba3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:47.105297 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-19406d50-4abe-4fbb-a597-40e87157bba3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f" status: 200 len: 1324 microversion: 2.1 time: 0.392502 Oct 18 15:41:47.105954 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1911/3835] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:46 2022] GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f => generated 1324 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:47.264964 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-cccb17cc-dcc0-451b-8485-1f25139136d1 req-f41306b1-f42b-414c-8d94-63b98f93ca77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68a3c952-31f5-42a5-a8b9-698785c5c01f", "tag": "3f868e1b-cc07-458b-a0b9-b89c7f817858"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:41:47.285033 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-cccb17cc-dcc0-451b-8485-1f25139136d1 req-f41306b1-f42b-414c-8d94-63b98f93ca77 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:47.285814 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-cccb17cc-dcc0-451b-8485-1f25139136d1 req-f41306b1-f42b-414c-8d94-63b98f93ca77 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:47.286419 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-cccb17cc-dcc0-451b-8485-1f25139136d1 req-f41306b1-f42b-414c-8d94-63b98f93ca77 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:47.300117 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ea62aa66-0c24-442a-8a4c-784d1cdb2bdf tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:47.301135 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ea62aa66-0c24-442a-8a4c-784d1cdb2bdf tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 55179126-a629-4bb3-82f5-14606ec63426] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:47.311576 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea62aa66-0c24-442a-8a4c-784d1cdb2bdf tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:47.317091 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea62aa66-0c24-442a-8a4c-784d1cdb2bdf tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:47.317738 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea62aa66-0c24-442a-8a4c-784d1cdb2bdf tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:47.325820 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea62aa66-0c24-442a-8a4c-784d1cdb2bdf tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:47.327842 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea62aa66-0c24-442a-8a4c-784d1cdb2bdf tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:47.331819 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea62aa66-0c24-442a-8a4c-784d1cdb2bdf tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:47.336180 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-cccb17cc-dcc0-451b-8485-1f25139136d1 req-f41306b1-f42b-414c-8d94-63b98f93ca77 service nova] Creating event network-changed:3f868e1b-cc07-458b-a0b9-b89c7f817858 for instance 68a3c952-31f5-42a5-a8b9-698785c5c01f on n-h1-853682-5 Oct 18 15:41:47.347852 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-cccb17cc-dcc0-451b-8485-1f25139136d1 req-f41306b1-f42b-414c-8d94-63b98f93ca77 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086401 Oct 18 15:41:47.352489 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1925/3836] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:41:48.006085 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ea62aa66-0c24-442a-8a4c-784d1cdb2bdf tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304b3248f9db4629943a8b8080a6d22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdc7504a1d1424ea34f83f1a6d4bf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:48.019186 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ea62aa66-0c24-442a-8a4c-784d1cdb2bdf tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426" status: 200 len: 1361 microversion: 2.1 time: 0.719803 Oct 18 15:41:48.037335 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1912/3837] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:47 2022] GET /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426 => generated 1361 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:48.133206 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d3591949-2cca-407b-9f5c-06ced05b8ba4 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:48.134122 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d3591949-2cca-407b-9f5c-06ced05b8ba4 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 68a3c952-31f5-42a5-a8b9-698785c5c01f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:48.146407 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3591949-2cca-407b-9f5c-06ced05b8ba4 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:48.146920 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3591949-2cca-407b-9f5c-06ced05b8ba4 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:48.147343 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3591949-2cca-407b-9f5c-06ced05b8ba4 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:48.159387 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3591949-2cca-407b-9f5c-06ced05b8ba4 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:48.159887 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3591949-2cca-407b-9f5c-06ced05b8ba4 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:48.161216 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3591949-2cca-407b-9f5c-06ced05b8ba4 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:48.480136 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:41:48.735539 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d3591949-2cca-407b-9f5c-06ced05b8ba4 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:48.771749 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d3591949-2cca-407b-9f5c-06ced05b8ba4 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f" status: 200 len: 1324 microversion: 2.1 time: 0.632802 Oct 18 15:41:48.784834 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1926/3838] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:48 2022] GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f => generated 1324 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:48.944125 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-36380b56-f1e8-4dec-ac07-fb91ca7724b7 req-a0a0924f-7120-4992-b8ba-3f44db360c88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55179126-a629-4bb3-82f5-14606ec63426", "tag": "4a427a75-becb-49f1-943f-d4357e1f1e68"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:41:48.979840 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-36380b56-f1e8-4dec-ac07-fb91ca7724b7 req-a0a0924f-7120-4992-b8ba-3f44db360c88 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:48.982298 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-36380b56-f1e8-4dec-ac07-fb91ca7724b7 req-a0a0924f-7120-4992-b8ba-3f44db360c88 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:48.982924 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-36380b56-f1e8-4dec-ac07-fb91ca7724b7 req-a0a0924f-7120-4992-b8ba-3f44db360c88 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:49.025921 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-36380b56-f1e8-4dec-ac07-fb91ca7724b7 req-a0a0924f-7120-4992-b8ba-3f44db360c88 service nova] Creating event network-changed:4a427a75-becb-49f1-943f-d4357e1f1e68 for instance 55179126-a629-4bb3-82f5-14606ec63426 on n-h1-853682-5 Oct 18 15:41:49.040790 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-36380b56-f1e8-4dec-ac07-fb91ca7724b7 req-a0a0924f-7120-4992-b8ba-3f44db360c88 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100224 Oct 18 15:41:49.044507 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1913/3839] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:41:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:41:49.046129 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-78ba05cb-5538-4822-918c-f158a9e1880f tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:49.046817 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-78ba05cb-5538-4822-918c-f158a9e1880f tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 55179126-a629-4bb3-82f5-14606ec63426] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:49.071799 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-78ba05cb-5538-4822-918c-f158a9e1880f tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:49.072315 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-78ba05cb-5538-4822-918c-f158a9e1880f tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:49.079481 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-78ba05cb-5538-4822-918c-f158a9e1880f tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:49.081678 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-78ba05cb-5538-4822-918c-f158a9e1880f tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:49.091810 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-78ba05cb-5538-4822-918c-f158a9e1880f tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:49.093862 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-78ba05cb-5538-4822-918c-f158a9e1880f tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:49.434210 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-78ba05cb-5538-4822-918c-f158a9e1880f tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304b3248f9db4629943a8b8080a6d22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdc7504a1d1424ea34f83f1a6d4bf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:49.444726 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-78ba05cb-5538-4822-918c-f158a9e1880f tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426" status: 200 len: 1361 microversion: 2.1 time: 0.402874 Oct 18 15:41:49.446190 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1927/3840] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:49 2022] GET /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426 => generated 1361 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:49.809938 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4f3eaa4f-97a8-43e2-ad72-226e69919da3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:49.810952 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4f3eaa4f-97a8-43e2-ad72-226e69919da3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 68a3c952-31f5-42a5-a8b9-698785c5c01f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:49.828072 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4f3eaa4f-97a8-43e2-ad72-226e69919da3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:49.828913 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4f3eaa4f-97a8-43e2-ad72-226e69919da3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:49.831965 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4f3eaa4f-97a8-43e2-ad72-226e69919da3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:49.833634 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4f3eaa4f-97a8-43e2-ad72-226e69919da3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:49.834462 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4f3eaa4f-97a8-43e2-ad72-226e69919da3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:49.835939 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4f3eaa4f-97a8-43e2-ad72-226e69919da3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:49.861855 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:41:50.000438 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=6 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:41:50.176636 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-18a9a6d9-3754-4593-be46-0b67939c7cc1 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1627047740", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "1c97576d-2160-403f-86fb-2ba4504a2ed5"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:41:50.257922 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-18a9a6d9-3754-4593-be46-0b67939c7cc1 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] validate_networks() for [('1c97576d-2160-403f-86fb-2ba4504a2ed5', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:41:50.436603 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=14 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:41:50.745448 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4f3eaa4f-97a8-43e2-ad72-226e69919da3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:50.766635 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4f3eaa4f-97a8-43e2-ad72-226e69919da3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f" status: 200 len: 1324 microversion: 2.1 time: 0.965457 Oct 18 15:41:50.770544 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1914/3841] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:49 2022] GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f => generated 1324 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:50.788607 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1bda93fb-2f27-4e23-9a59-73ae4098f0b0 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:50.793023 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1bda93fb-2f27-4e23-9a59-73ae4098f0b0 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 55179126-a629-4bb3-82f5-14606ec63426] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:50.805952 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1bda93fb-2f27-4e23-9a59-73ae4098f0b0 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:50.806449 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1bda93fb-2f27-4e23-9a59-73ae4098f0b0 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:50.809282 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1bda93fb-2f27-4e23-9a59-73ae4098f0b0 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:50.811878 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1bda93fb-2f27-4e23-9a59-73ae4098f0b0 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:50.812659 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1bda93fb-2f27-4e23-9a59-73ae4098f0b0 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:50.814256 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1bda93fb-2f27-4e23-9a59-73ae4098f0b0 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:51.601180 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1bda93fb-2f27-4e23-9a59-73ae4098f0b0 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304b3248f9db4629943a8b8080a6d22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdc7504a1d1424ea34f83f1a6d4bf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:51.613218 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1bda93fb-2f27-4e23-9a59-73ae4098f0b0 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426" status: 200 len: 1361 microversion: 2.1 time: 0.840598 Oct 18 15:41:51.621950 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1915/3842] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:50 2022] GET /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426 => generated 1361 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:51.796548 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1518b63d-aa9e-4c75-adf8-3f3e4aeaf263 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:51.797311 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1518b63d-aa9e-4c75-adf8-3f3e4aeaf263 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 68a3c952-31f5-42a5-a8b9-698785c5c01f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:51.823404 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1518b63d-aa9e-4c75-adf8-3f3e4aeaf263 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:51.823917 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1518b63d-aa9e-4c75-adf8-3f3e4aeaf263 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:51.834114 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1518b63d-aa9e-4c75-adf8-3f3e4aeaf263 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:51.835307 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1518b63d-aa9e-4c75-adf8-3f3e4aeaf263 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:51.836130 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1518b63d-aa9e-4c75-adf8-3f3e4aeaf263 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:51.836764 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1518b63d-aa9e-4c75-adf8-3f3e4aeaf263 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:51.953199 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-18a9a6d9-3754-4593-be46-0b67939c7cc1 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:41:51.953781 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-18a9a6d9-3754-4593-be46-0b67939c7cc1 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:41:51.954885 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-18a9a6d9-3754-4593-be46-0b67939c7cc1 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:41:51.955667 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-18a9a6d9-3754-4593-be46-0b67939c7cc1 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:41:51.956322 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-18a9a6d9-3754-4593-be46-0b67939c7cc1 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:41:51.975437 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18a9a6d9-3754-4593-be46-0b67939c7cc1 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:51.979019 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18a9a6d9-3754-4593-be46-0b67939c7cc1 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:51.980362 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18a9a6d9-3754-4593-be46-0b67939c7cc1 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:51.982015 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18a9a6d9-3754-4593-be46-0b67939c7cc1 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:51.983848 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18a9a6d9-3754-4593-be46-0b67939c7cc1 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:51.985339 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18a9a6d9-3754-4593-be46-0b67939c7cc1 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:52.050861 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-18a9a6d9-3754-4593-be46-0b67939c7cc1 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Getting quotas for project 88cd85218f8c40728c12b94cd6e37e10. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:41:52.061304 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-18a9a6d9-3754-4593-be46-0b67939c7cc1 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Getting quotas for user a1870f65339d43cb88462266db6073b8 and project 88cd85218f8c40728c12b94cd6e37e10. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:41:52.098662 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-18a9a6d9-3754-4593-be46-0b67939c7cc1 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:41:52.101055 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-18a9a6d9-3754-4593-be46-0b67939c7cc1 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] [instance: 342275a0-eca4-4c88-8c84-7d7bb1febf67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:41:52.231993 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-18a9a6d9-3754-4593-be46-0b67939c7cc1 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.248085 Oct 18 15:41:52.233011 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1928/3843] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:41:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2250 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 15:41:52.244755 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6bd89621-08b4-426d-b751-4cc87fd87a90 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:52.245500 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6bd89621-08b4-426d-b751-4cc87fd87a90 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] [instance: 342275a0-eca4-4c88-8c84-7d7bb1febf67] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:52.417869 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1518b63d-aa9e-4c75-adf8-3f3e4aeaf263 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:52.423804 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6bd89621-08b4-426d-b751-4cc87fd87a90 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1870f65339d43cb88462266db6073b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cd85218f8c40728c12b94cd6e37e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:52.426537 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1518b63d-aa9e-4c75-adf8-3f3e4aeaf263 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f" status: 200 len: 1324 microversion: 2.1 time: 0.635154 Oct 18 15:41:52.433431 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6bd89621-08b4-426d-b751-4cc87fd87a90 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] 10.222.0.60 "GET /compute/v2.1/servers/342275a0-eca4-4c88-8c84-7d7bb1febf67" status: 200 len: 1225 microversion: 2.1 time: 0.192587 Oct 18 15:41:52.444839 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1929/3844] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:52 2022] GET /compute/v2.1/servers/342275a0-eca4-4c88-8c84-7d7bb1febf67 => generated 1225 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:41:52.445260 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1916/3845] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:51 2022] GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f => generated 1324 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:52.648273 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c73f33f0-15b8-4b1c-a6bd-59d9acef6194 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:52.649084 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c73f33f0-15b8-4b1c-a6bd-59d9acef6194 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 55179126-a629-4bb3-82f5-14606ec63426] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:52.666241 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c73f33f0-15b8-4b1c-a6bd-59d9acef6194 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:52.670236 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c73f33f0-15b8-4b1c-a6bd-59d9acef6194 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:52.671001 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c73f33f0-15b8-4b1c-a6bd-59d9acef6194 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:52.675726 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c73f33f0-15b8-4b1c-a6bd-59d9acef6194 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:52.676525 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c73f33f0-15b8-4b1c-a6bd-59d9acef6194 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:52.677455 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c73f33f0-15b8-4b1c-a6bd-59d9acef6194 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:53.097131 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c73f33f0-15b8-4b1c-a6bd-59d9acef6194 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304b3248f9db4629943a8b8080a6d22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdc7504a1d1424ea34f83f1a6d4bf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:53.131059 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c73f33f0-15b8-4b1c-a6bd-59d9acef6194 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426" status: 200 len: 1361 microversion: 2.1 time: 0.468628 Oct 18 15:41:53.134665 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1917/3846] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:52 2022] GET /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426 => generated 1361 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:53.457393 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a4b1d382-aa8b-436f-9c39-b289e855a060 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:53.461613 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a4b1d382-aa8b-436f-9c39-b289e855a060 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] [instance: 342275a0-eca4-4c88-8c84-7d7bb1febf67] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:53.463752 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-918e8f7a-28a0-48e9-98da-d697b14008d5 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:53.464550 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-918e8f7a-28a0-48e9-98da-d697b14008d5 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 68a3c952-31f5-42a5-a8b9-698785c5c01f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:53.474032 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-918e8f7a-28a0-48e9-98da-d697b14008d5 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:53.475554 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-918e8f7a-28a0-48e9-98da-d697b14008d5 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:53.477877 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-918e8f7a-28a0-48e9-98da-d697b14008d5 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:53.479107 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-918e8f7a-28a0-48e9-98da-d697b14008d5 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:53.479828 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-918e8f7a-28a0-48e9-98da-d697b14008d5 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:53.480506 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-918e8f7a-28a0-48e9-98da-d697b14008d5 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:53.481240 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4b1d382-aa8b-436f-9c39-b289e855a060 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:53.482777 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4b1d382-aa8b-436f-9c39-b289e855a060 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:53.483230 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4b1d382-aa8b-436f-9c39-b289e855a060 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:53.486475 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4b1d382-aa8b-436f-9c39-b289e855a060 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:53.487067 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4b1d382-aa8b-436f-9c39-b289e855a060 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:53.505361 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4b1d382-aa8b-436f-9c39-b289e855a060 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:53.857370 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a4b1d382-aa8b-436f-9c39-b289e855a060 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1870f65339d43cb88462266db6073b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cd85218f8c40728c12b94cd6e37e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:53.871274 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a4b1d382-aa8b-436f-9c39-b289e855a060 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] 10.222.0.60 "GET /compute/v2.1/servers/342275a0-eca4-4c88-8c84-7d7bb1febf67" status: 200 len: 1221 microversion: 2.1 time: 0.419002 Oct 18 15:41:53.871877 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1930/3847] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:53 2022] GET /compute/v2.1/servers/342275a0-eca4-4c88-8c84-7d7bb1febf67 => generated 1221 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:53.968159 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-918e8f7a-28a0-48e9-98da-d697b14008d5 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:53.984188 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-918e8f7a-28a0-48e9-98da-d697b14008d5 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f" status: 200 len: 1324 microversion: 2.1 time: 0.525538 Oct 18 15:41:53.985688 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1918/3848] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:53 2022] GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f => generated 1324 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:54.170882 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-308d0234-1b7b-4ca3-9cbe-131bedfffead tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:54.175456 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-308d0234-1b7b-4ca3-9cbe-131bedfffead tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 55179126-a629-4bb3-82f5-14606ec63426] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:54.214845 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-308d0234-1b7b-4ca3-9cbe-131bedfffead tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:54.215347 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-308d0234-1b7b-4ca3-9cbe-131bedfffead tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:54.218531 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-308d0234-1b7b-4ca3-9cbe-131bedfffead tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:54.223338 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-308d0234-1b7b-4ca3-9cbe-131bedfffead tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:54.226656 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-308d0234-1b7b-4ca3-9cbe-131bedfffead tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:54.227119 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-308d0234-1b7b-4ca3-9cbe-131bedfffead tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:54.901286 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d4eb3ff6-a649-4c07-8c25-86001791b52c tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:54.903643 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d4eb3ff6-a649-4c07-8c25-86001791b52c tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] [instance: 342275a0-eca4-4c88-8c84-7d7bb1febf67] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:54.926112 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4eb3ff6-a649-4c07-8c25-86001791b52c tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:54.929082 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4eb3ff6-a649-4c07-8c25-86001791b52c tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:54.929657 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4eb3ff6-a649-4c07-8c25-86001791b52c tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:54.931227 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4eb3ff6-a649-4c07-8c25-86001791b52c tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:54.933211 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4eb3ff6-a649-4c07-8c25-86001791b52c tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:54.933910 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4eb3ff6-a649-4c07-8c25-86001791b52c tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:55.551163 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d4eb3ff6-a649-4c07-8c25-86001791b52c tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1870f65339d43cb88462266db6073b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cd85218f8c40728c12b94cd6e37e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:55.590651 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d4eb3ff6-a649-4c07-8c25-86001791b52c tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] 10.222.0.60 "GET /compute/v2.1/servers/342275a0-eca4-4c88-8c84-7d7bb1febf67" status: 200 len: 1283 microversion: 2.1 time: 0.695416 Oct 18 15:41:55.593039 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1919/3849] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:54 2022] GET /compute/v2.1/servers/342275a0-eca4-4c88-8c84-7d7bb1febf67 => generated 1283 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:55.611143 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a627b623-dc33-4941-8839-00d1149a4899 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:55.613530 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a627b623-dc33-4941-8839-00d1149a4899 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 68a3c952-31f5-42a5-a8b9-698785c5c01f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:55.643627 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a627b623-dc33-4941-8839-00d1149a4899 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:55.649870 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a627b623-dc33-4941-8839-00d1149a4899 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:55.651131 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a627b623-dc33-4941-8839-00d1149a4899 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:55.653475 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a627b623-dc33-4941-8839-00d1149a4899 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:55.657358 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a627b623-dc33-4941-8839-00d1149a4899 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:55.658595 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a627b623-dc33-4941-8839-00d1149a4899 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:55.791341 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-308d0234-1b7b-4ca3-9cbe-131bedfffead tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304b3248f9db4629943a8b8080a6d22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdc7504a1d1424ea34f83f1a6d4bf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:55.820579 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-308d0234-1b7b-4ca3-9cbe-131bedfffead tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426" status: 200 len: 1361 microversion: 2.1 time: 1.668415 Oct 18 15:41:55.823078 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1931/3850] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:54 2022] GET /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426 => generated 1361 bytes in 1672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:56.541956 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a627b623-dc33-4941-8839-00d1149a4899 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:56.551963 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a627b623-dc33-4941-8839-00d1149a4899 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f" status: 200 len: 1324 microversion: 2.1 time: 0.956394 Oct 18 15:41:56.553372 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1920/3851] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:55 2022] GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f => generated 1324 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:56.637286 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-57ac18a6-09b8-45bb-b490-3296d3d408e0 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:56.638296 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-57ac18a6-09b8-45bb-b490-3296d3d408e0 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] [instance: 342275a0-eca4-4c88-8c84-7d7bb1febf67] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:56.668420 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57ac18a6-09b8-45bb-b490-3296d3d408e0 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:56.671701 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57ac18a6-09b8-45bb-b490-3296d3d408e0 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:56.672335 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57ac18a6-09b8-45bb-b490-3296d3d408e0 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:56.673979 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57ac18a6-09b8-45bb-b490-3296d3d408e0 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:56.675181 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57ac18a6-09b8-45bb-b490-3296d3d408e0 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:56.675809 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57ac18a6-09b8-45bb-b490-3296d3d408e0 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:56.863010 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6515e6cb-5723-4cf8-95ae-7427992809c7 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:56.863630 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6515e6cb-5723-4cf8-95ae-7427992809c7 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 55179126-a629-4bb3-82f5-14606ec63426] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:56.873644 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6515e6cb-5723-4cf8-95ae-7427992809c7 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:56.875790 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6515e6cb-5723-4cf8-95ae-7427992809c7 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:56.877149 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6515e6cb-5723-4cf8-95ae-7427992809c7 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:56.881412 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6515e6cb-5723-4cf8-95ae-7427992809c7 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:56.882155 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6515e6cb-5723-4cf8-95ae-7427992809c7 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:56.882803 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6515e6cb-5723-4cf8-95ae-7427992809c7 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:56.981130 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-57ac18a6-09b8-45bb-b490-3296d3d408e0 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1870f65339d43cb88462266db6073b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cd85218f8c40728c12b94cd6e37e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:56.995261 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-57ac18a6-09b8-45bb-b490-3296d3d408e0 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] 10.222.0.60 "GET /compute/v2.1/servers/342275a0-eca4-4c88-8c84-7d7bb1febf67" status: 200 len: 1283 microversion: 2.1 time: 0.363272 Oct 18 15:41:56.999355 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1932/3852] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:56 2022] GET /compute/v2.1/servers/342275a0-eca4-4c88-8c84-7d7bb1febf67 => generated 1283 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:57.579535 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9e639c3e-2ae1-4ca2-95d6-3e13f3118d69 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:57.580224 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9e639c3e-2ae1-4ca2-95d6-3e13f3118d69 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 68a3c952-31f5-42a5-a8b9-698785c5c01f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:57.600611 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e639c3e-2ae1-4ca2-95d6-3e13f3118d69 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:57.601481 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e639c3e-2ae1-4ca2-95d6-3e13f3118d69 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:57.613293 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e639c3e-2ae1-4ca2-95d6-3e13f3118d69 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:57.616889 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e639c3e-2ae1-4ca2-95d6-3e13f3118d69 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:57.617738 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e639c3e-2ae1-4ca2-95d6-3e13f3118d69 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:57.623086 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e639c3e-2ae1-4ca2-95d6-3e13f3118d69 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:58.597587 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6515e6cb-5723-4cf8-95ae-7427992809c7 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304b3248f9db4629943a8b8080a6d22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdc7504a1d1424ea34f83f1a6d4bf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:58.599864 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9e639c3e-2ae1-4ca2-95d6-3e13f3118d69 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:58.610605 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9e639c3e-2ae1-4ca2-95d6-3e13f3118d69 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f" status: 200 len: 1324 microversion: 2.1 time: 1.035805 Oct 18 15:41:58.613636 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6515e6cb-5723-4cf8-95ae-7427992809c7 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426" status: 200 len: 1361 microversion: 2.1 time: 1.754156 Oct 18 15:41:58.621796 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1933/3853] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:57 2022] GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f => generated 1324 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:58.638562 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1921/3854] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:56 2022] GET /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426 => generated 1361 bytes in 1780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:58.646848 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-05f56341-4c00-433c-bd9d-ab76bb4bf688 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:58.648652 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-c4bf30ff-1f70-44b8-935e-c9209e6cb4d6 req-0f92d039-4b10-4d9f-8295-df9d9aca3002 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68a3c952-31f5-42a5-a8b9-698785c5c01f", "name": "network-vif-plugged", "status": "completed", "tag": "3f868e1b-cc07-458b-a0b9-b89c7f817858"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:41:58.653954 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-05f56341-4c00-433c-bd9d-ab76bb4bf688 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] [instance: 342275a0-eca4-4c88-8c84-7d7bb1febf67] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:58.685615 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-05f56341-4c00-433c-bd9d-ab76bb4bf688 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:58.686121 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-05f56341-4c00-433c-bd9d-ab76bb4bf688 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:58.686575 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-05f56341-4c00-433c-bd9d-ab76bb4bf688 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:58.691444 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c4bf30ff-1f70-44b8-935e-c9209e6cb4d6 req-0f92d039-4b10-4d9f-8295-df9d9aca3002 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:58.694123 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-05f56341-4c00-433c-bd9d-ab76bb4bf688 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:58.696130 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-05f56341-4c00-433c-bd9d-ab76bb4bf688 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:58.699222 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-05f56341-4c00-433c-bd9d-ab76bb4bf688 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:58.700085 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c4bf30ff-1f70-44b8-935e-c9209e6cb4d6 req-0f92d039-4b10-4d9f-8295-df9d9aca3002 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:58.702248 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c4bf30ff-1f70-44b8-935e-c9209e6cb4d6 req-0f92d039-4b10-4d9f-8295-df9d9aca3002 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:58.734067 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-c4bf30ff-1f70-44b8-935e-c9209e6cb4d6 req-0f92d039-4b10-4d9f-8295-df9d9aca3002 service nova] Creating event network-vif-plugged:3f868e1b-cc07-458b-a0b9-b89c7f817858 for instance 68a3c952-31f5-42a5-a8b9-698785c5c01f on n-h1-853682-5 Oct 18 15:41:58.747376 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-c4bf30ff-1f70-44b8-935e-c9209e6cb4d6 req-0f92d039-4b10-4d9f-8295-df9d9aca3002 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121823 Oct 18 15:41:58.748365 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1934/3855] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:41:59.251264 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-05f56341-4c00-433c-bd9d-ab76bb4bf688 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1870f65339d43cb88462266db6073b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cd85218f8c40728c12b94cd6e37e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:41:59.265698 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-05f56341-4c00-433c-bd9d-ab76bb4bf688 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] 10.222.0.60 "GET /compute/v2.1/servers/342275a0-eca4-4c88-8c84-7d7bb1febf67" status: 200 len: 1325 microversion: 2.1 time: 0.623960 Oct 18 15:41:59.275007 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1922/3856] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:58 2022] GET /compute/v2.1/servers/342275a0-eca4-4c88-8c84-7d7bb1febf67 => generated 1325 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:41:59.645139 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-601589dd-902c-4b73-9219-ef881250c241 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:59.645820 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-601589dd-902c-4b73-9219-ef881250c241 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 68a3c952-31f5-42a5-a8b9-698785c5c01f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:59.648287 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eda826e1-3dba-4f61-a628-4eddd4bb9f45 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:41:59.649016 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-eda826e1-3dba-4f61-a628-4eddd4bb9f45 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 55179126-a629-4bb3-82f5-14606ec63426] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:41:59.666292 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-601589dd-902c-4b73-9219-ef881250c241 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:59.666789 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-601589dd-902c-4b73-9219-ef881250c241 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:59.679228 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eda826e1-3dba-4f61-a628-4eddd4bb9f45 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:59.679627 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eda826e1-3dba-4f61-a628-4eddd4bb9f45 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:59.680058 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eda826e1-3dba-4f61-a628-4eddd4bb9f45 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:59.680652 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-601589dd-902c-4b73-9219-ef881250c241 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:59.682319 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-601589dd-902c-4b73-9219-ef881250c241 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:59.682980 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-601589dd-902c-4b73-9219-ef881250c241 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:59.683565 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-601589dd-902c-4b73-9219-ef881250c241 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:59.684501 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eda826e1-3dba-4f61-a628-4eddd4bb9f45 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:41:59.690543 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eda826e1-3dba-4f61-a628-4eddd4bb9f45 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:41:59.691294 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eda826e1-3dba-4f61-a628-4eddd4bb9f45 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:41:59.751991 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:42:00.134539 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-eda826e1-3dba-4f61-a628-4eddd4bb9f45 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304b3248f9db4629943a8b8080a6d22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdc7504a1d1424ea34f83f1a6d4bf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:00.152659 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-eda826e1-3dba-4f61-a628-4eddd4bb9f45 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426" status: 200 len: 1361 microversion: 2.1 time: 0.512988 Oct 18 15:42:00.153539 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1935/3857] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:59 2022] GET /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426 => generated 1361 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:00.173284 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-601589dd-902c-4b73-9219-ef881250c241 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:00.183153 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-601589dd-902c-4b73-9219-ef881250c241 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f" status: 200 len: 1324 microversion: 2.1 time: 0.541780 Oct 18 15:42:00.183739 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1923/3858] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:41:59 2022] GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f => generated 1324 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:42:00.306720 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-06855d91-a57c-4060-9d31-c1038e9810cf tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:00.308096 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-06855d91-a57c-4060-9d31-c1038e9810cf tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] [instance: 342275a0-eca4-4c88-8c84-7d7bb1febf67] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:00.321721 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06855d91-a57c-4060-9d31-c1038e9810cf tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:00.322372 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06855d91-a57c-4060-9d31-c1038e9810cf tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:00.322833 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06855d91-a57c-4060-9d31-c1038e9810cf tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:00.324231 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06855d91-a57c-4060-9d31-c1038e9810cf tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:00.324726 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06855d91-a57c-4060-9d31-c1038e9810cf tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:00.325278 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06855d91-a57c-4060-9d31-c1038e9810cf tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:00.764586 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-0c61fb14-b50d-47bf-a81b-2e0bd4d980c6 req-12c5a74c-3973-4304-aa01-187c1052ffc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55179126-a629-4bb3-82f5-14606ec63426", "name": "network-vif-plugged", "status": "completed", "tag": "4a427a75-becb-49f1-943f-d4357e1f1e68"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:42:00.786909 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-0c61fb14-b50d-47bf-a81b-2e0bd4d980c6 req-12c5a74c-3973-4304-aa01-187c1052ffc8 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:00.787760 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-0c61fb14-b50d-47bf-a81b-2e0bd4d980c6 req-12c5a74c-3973-4304-aa01-187c1052ffc8 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:00.789338 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-0c61fb14-b50d-47bf-a81b-2e0bd4d980c6 req-12c5a74c-3973-4304-aa01-187c1052ffc8 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:00.816863 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-0c61fb14-b50d-47bf-a81b-2e0bd4d980c6 req-12c5a74c-3973-4304-aa01-187c1052ffc8 service nova] Creating event network-vif-plugged:4a427a75-becb-49f1-943f-d4357e1f1e68 for instance 55179126-a629-4bb3-82f5-14606ec63426 on n-h1-853682-5 Oct 18 15:42:00.830927 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-0c61fb14-b50d-47bf-a81b-2e0bd4d980c6 req-12c5a74c-3973-4304-aa01-187c1052ffc8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069894 Oct 18 15:42:00.841242 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1924/3859] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:42:00.945484 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-06855d91-a57c-4060-9d31-c1038e9810cf tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1870f65339d43cb88462266db6073b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cd85218f8c40728c12b94cd6e37e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:00.964240 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-06855d91-a57c-4060-9d31-c1038e9810cf tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] 10.222.0.60 "GET /compute/v2.1/servers/342275a0-eca4-4c88-8c84-7d7bb1febf67" status: 200 len: 1325 microversion: 2.1 time: 0.662458 Oct 18 15:42:00.964871 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1936/3860] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:00 2022] GET /compute/v2.1/servers/342275a0-eca4-4c88-8c84-7d7bb1febf67 => generated 1325 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:01.181065 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7cf6213a-b4d8-418a-8c6c-7cf9d86afa68 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:01.182177 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7cf6213a-b4d8-418a-8c6c-7cf9d86afa68 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 55179126-a629-4bb3-82f5-14606ec63426] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:01.199049 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7cf6213a-b4d8-418a-8c6c-7cf9d86afa68 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:01.202641 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7cf6213a-b4d8-418a-8c6c-7cf9d86afa68 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:01.203303 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7cf6213a-b4d8-418a-8c6c-7cf9d86afa68 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:01.205909 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7cf6213a-b4d8-418a-8c6c-7cf9d86afa68 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:01.207213 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7cf6213a-b4d8-418a-8c6c-7cf9d86afa68 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:01.207847 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-495ac240-0e92-4532-913d-f254d1969a0a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:01.208859 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-495ac240-0e92-4532-913d-f254d1969a0a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 68a3c952-31f5-42a5-a8b9-698785c5c01f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:01.209692 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7cf6213a-b4d8-418a-8c6c-7cf9d86afa68 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:01.222239 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-495ac240-0e92-4532-913d-f254d1969a0a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:01.224884 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-495ac240-0e92-4532-913d-f254d1969a0a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:01.226697 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-495ac240-0e92-4532-913d-f254d1969a0a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:01.229389 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-495ac240-0e92-4532-913d-f254d1969a0a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:01.234017 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-495ac240-0e92-4532-913d-f254d1969a0a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:01.235377 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-495ac240-0e92-4532-913d-f254d1969a0a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:02.015896 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:42:02.222223 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-495ac240-0e92-4532-913d-f254d1969a0a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:02.233818 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-495ac240-0e92-4532-913d-f254d1969a0a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f" status: 200 len: 1520 microversion: 2.1 time: 1.031639 Oct 18 15:42:02.238487 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1937/3861] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:01 2022] GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f => generated 1520 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:02.250851 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7cf6213a-b4d8-418a-8c6c-7cf9d86afa68 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304b3248f9db4629943a8b8080a6d22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdc7504a1d1424ea34f83f1a6d4bf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:02.256618 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-e1ef46ad-053c-4318-99c0-643d3711eee5 req-5608e2e0-2372-4b71-b21a-1e032897d52f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "342275a0-eca4-4c88-8c84-7d7bb1febf67", "tag": "08d99f3b-f981-4a5d-b4a1-2a2110b34c6f"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:42:02.268665 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7cf6213a-b4d8-418a-8c6c-7cf9d86afa68 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426" status: 200 len: 1361 microversion: 2.1 time: 1.092869 Oct 18 15:42:02.272089 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1925/3862] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:01 2022] GET /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426 => generated 1361 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:02.283144 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c974d4be-95c6-4b4c-acfc-4bdcff3fb726 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:02.284495 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c974d4be-95c6-4b4c-acfc-4bdcff3fb726 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] [instance: 342275a0-eca4-4c88-8c84-7d7bb1febf67] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:02.296986 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e1ef46ad-053c-4318-99c0-643d3711eee5 req-5608e2e0-2372-4b71-b21a-1e032897d52f service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:02.298109 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e1ef46ad-053c-4318-99c0-643d3711eee5 req-5608e2e0-2372-4b71-b21a-1e032897d52f service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:02.298547 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e1ef46ad-053c-4318-99c0-643d3711eee5 req-5608e2e0-2372-4b71-b21a-1e032897d52f service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:02.300216 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c974d4be-95c6-4b4c-acfc-4bdcff3fb726 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:02.304293 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c974d4be-95c6-4b4c-acfc-4bdcff3fb726 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:02.305123 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c974d4be-95c6-4b4c-acfc-4bdcff3fb726 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:02.306184 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c974d4be-95c6-4b4c-acfc-4bdcff3fb726 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:02.309191 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c974d4be-95c6-4b4c-acfc-4bdcff3fb726 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:02.309985 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c974d4be-95c6-4b4c-acfc-4bdcff3fb726 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:02.340323 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-e1ef46ad-053c-4318-99c0-643d3711eee5 req-5608e2e0-2372-4b71-b21a-1e032897d52f service nova] Creating event network-changed:08d99f3b-f981-4a5d-b4a1-2a2110b34c6f for instance 342275a0-eca4-4c88-8c84-7d7bb1febf67 on n-h2-853682-5 Oct 18 15:42:02.367973 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-e1ef46ad-053c-4318-99c0-643d3711eee5 req-5608e2e0-2372-4b71-b21a-1e032897d52f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117395 Oct 18 15:42:02.371765 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1938/3863] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:42:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:42:02.383225 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6d00ddf9-44b6-453e-aa13-02affece2fed tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:02.383990 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6d00ddf9-44b6-453e-aa13-02affece2fed tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 68a3c952-31f5-42a5-a8b9-698785c5c01f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:02.401952 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d00ddf9-44b6-453e-aa13-02affece2fed tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:02.402500 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d00ddf9-44b6-453e-aa13-02affece2fed tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:02.405516 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d00ddf9-44b6-453e-aa13-02affece2fed tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:02.406616 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d00ddf9-44b6-453e-aa13-02affece2fed tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:02.407183 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d00ddf9-44b6-453e-aa13-02affece2fed tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:02.407524 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d00ddf9-44b6-453e-aa13-02affece2fed tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:02.451591 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=8 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:42:02.976915 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c974d4be-95c6-4b4c-acfc-4bdcff3fb726 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1870f65339d43cb88462266db6073b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cd85218f8c40728c12b94cd6e37e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:02.989517 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c974d4be-95c6-4b4c-acfc-4bdcff3fb726 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] 10.222.0.60 "GET /compute/v2.1/servers/342275a0-eca4-4c88-8c84-7d7bb1febf67" status: 200 len: 1325 microversion: 2.1 time: 0.716001 Oct 18 15:42:02.992658 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6d00ddf9-44b6-453e-aa13-02affece2fed tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:03.001459 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6d00ddf9-44b6-453e-aa13-02affece2fed tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f" status: 200 len: 1520 microversion: 2.1 time: 0.627413 Oct 18 15:42:03.005363 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1926/3864] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:02 2022] GET /compute/v2.1/servers/342275a0-eca4-4c88-8c84-7d7bb1febf67 => generated 1325 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:03.006033 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1939/3865] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:02 2022] GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f => generated 1520 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:03.034600 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a767c5b5-750b-4c18-b1cb-3f2e4be3cf84 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-664013797", "metadata": {"": ""}}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a767c5b5-750b-4c18-b1cb-3f2e4be3cf84 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Request method failure captured: Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: request: POST /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f/action HTTP/1.1 Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 106 Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTskwmwAKtfJxRtfmFCexrRganirG5QxP3o41FeBWoidL-rUG8x8GL16JQLrOge4bbPRk8j9ZKsrTawjOywht8BMU6xpPPkLcF_Tvsxd_4ddRByYVxCCr1OvdQRZ3S_CoRUmp2shw5GPVxRCyE1gWYjx_sxIK_OIs6piyKG80707p5j0 Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 38b4cd4b884c4456866052a4969dc138 Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1849835039 Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/38b4cd4b884c4456866052a4969dc138"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/38b4cd4b884c4456866052a4969dc138"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/38b4cd4b884c4456866052a4969dc138"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_38b4cd4b884c4456866052a4969dc138"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1849835039 Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 38b4cd4b884c4456866052a4969dc138 Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1849835039 Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ImagesOneServerNegativeTestJSON-1849835039-project Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: a2e9e9bbf3d94d77a236e43f019d316a Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1849835039-project Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-664013797", "metadata": {"": ""}}} Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '68a3c952-31f5-42a5-a8b9-698785c5c01f', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-664013797', 'metadata': {'': ''}}}} Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise error Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi {'': ''} Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:42:03.046973 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 15:42:03.054952 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 15:42:03.054952 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 15:42:03.054952 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 15:42:03.054952 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 15:42:03.054952 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 15:42:03.054952 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 15:42:03.054952 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:42:03.054952 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:42:03.054952 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:42:03.054952 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:42:03.054952 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:42:03.054952 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:42:03.054952 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 15:42:03.054952 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 15:42:03.054952 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 15:42:03.054952 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:42:03.054952 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a767c5b5-750b-4c18-b1cb-3f2e4be3cf84 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:42:03.054952 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a767c5b5-750b-4c18-b1cb-3f2e4be3cf84 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "POST /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f/action" status: 400 len: 170 microversion: 2.1 time: 0.028190 Oct 18 15:42:03.056470 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1927/3866] 10.222.0.60 () {60 vars in 1279 bytes} [Tue Oct 18 15:42:03 2022] POST /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f/action => generated 170 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:42:03.065680 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1709d78b-8b39-4e56-b7ee-012137407ced tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:03.066435 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1709d78b-8b39-4e56-b7ee-012137407ced tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 68a3c952-31f5-42a5-a8b9-698785c5c01f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:03.083233 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1709d78b-8b39-4e56-b7ee-012137407ced tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:03.083845 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1709d78b-8b39-4e56-b7ee-012137407ced tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:03.086237 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1709d78b-8b39-4e56-b7ee-012137407ced tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:03.087236 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1709d78b-8b39-4e56-b7ee-012137407ced tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:03.087934 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1709d78b-8b39-4e56-b7ee-012137407ced tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:03.088561 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1709d78b-8b39-4e56-b7ee-012137407ced tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:03.298372 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-078c28a6-d8c1-48f0-88e6-7143440e23c8 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:03.299694 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-078c28a6-d8c1-48f0-88e6-7143440e23c8 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 55179126-a629-4bb3-82f5-14606ec63426] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:03.331953 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-078c28a6-d8c1-48f0-88e6-7143440e23c8 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:03.332727 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-078c28a6-d8c1-48f0-88e6-7143440e23c8 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:03.333770 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-078c28a6-d8c1-48f0-88e6-7143440e23c8 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:03.335448 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-078c28a6-d8c1-48f0-88e6-7143440e23c8 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:03.336300 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-078c28a6-d8c1-48f0-88e6-7143440e23c8 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:03.337084 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-078c28a6-d8c1-48f0-88e6-7143440e23c8 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:03.513278 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1709d78b-8b39-4e56-b7ee-012137407ced tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:03.531167 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1709d78b-8b39-4e56-b7ee-012137407ced tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f" status: 200 len: 1520 microversion: 2.1 time: 0.469809 Oct 18 15:42:03.543268 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1940/3867] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:03 2022] GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f => generated 1520 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:03.582892 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0c6daf67-c9d4-40ee-a521-9db9b1b2358f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:03.584177 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0c6daf67-c9d4-40ee-a521-9db9b1b2358f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 68a3c952-31f5-42a5-a8b9-698785c5c01f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:03.614797 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c6daf67-c9d4-40ee-a521-9db9b1b2358f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:03.617232 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c6daf67-c9d4-40ee-a521-9db9b1b2358f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:03.617816 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c6daf67-c9d4-40ee-a521-9db9b1b2358f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:03.618827 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c6daf67-c9d4-40ee-a521-9db9b1b2358f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:03.619850 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c6daf67-c9d4-40ee-a521-9db9b1b2358f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:03.621938 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c6daf67-c9d4-40ee-a521-9db9b1b2358f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:03.889040 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-078c28a6-d8c1-48f0-88e6-7143440e23c8 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304b3248f9db4629943a8b8080a6d22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdc7504a1d1424ea34f83f1a6d4bf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:03.907347 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-078c28a6-d8c1-48f0-88e6-7143440e23c8 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426" status: 200 len: 1545 microversion: 2.1 time: 0.613484 Oct 18 15:42:03.909898 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1928/3868] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:03 2022] GET /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426 => generated 1545 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:42:03.933296 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-cbd4e047-7caf-4e8f-a427-7fdc43b4b311 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:03.933824 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-cbd4e047-7caf-4e8f-a427-7fdc43b4b311 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 55179126-a629-4bb3-82f5-14606ec63426] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:03.956452 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cbd4e047-7caf-4e8f-a427-7fdc43b4b311 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:03.958281 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cbd4e047-7caf-4e8f-a427-7fdc43b4b311 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:03.960831 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cbd4e047-7caf-4e8f-a427-7fdc43b4b311 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:03.961929 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cbd4e047-7caf-4e8f-a427-7fdc43b4b311 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:03.962651 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cbd4e047-7caf-4e8f-a427-7fdc43b4b311 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:03.963332 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cbd4e047-7caf-4e8f-a427-7fdc43b4b311 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:03.988427 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=100 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:42:04.088457 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0c6daf67-c9d4-40ee-a521-9db9b1b2358f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:04.096448 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0c6daf67-c9d4-40ee-a521-9db9b1b2358f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f" status: 200 len: 1520 microversion: 2.1 time: 0.528777 Oct 18 15:42:04.105199 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1941/3869] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:03 2022] GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f => generated 1520 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:04.111594 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9e02dd2c-290b-4af9-8cc4-de3da2966f09 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:04.112371 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9e02dd2c-290b-4af9-8cc4-de3da2966f09 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] [instance: 342275a0-eca4-4c88-8c84-7d7bb1febf67] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:04.122895 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e02dd2c-290b-4af9-8cc4-de3da2966f09 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:04.123775 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e02dd2c-290b-4af9-8cc4-de3da2966f09 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:04.124221 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e02dd2c-290b-4af9-8cc4-de3da2966f09 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:04.124994 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e02dd2c-290b-4af9-8cc4-de3da2966f09 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:04.125486 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e02dd2c-290b-4af9-8cc4-de3da2966f09 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:04.126012 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e02dd2c-290b-4af9-8cc4-de3da2966f09 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:04.156658 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-cbd4e047-7caf-4e8f-a427-7fdc43b4b311 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.227353 Oct 18 15:42:04.157283 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1929/3870] 10.222.0.60 () {58 vars in 1275 bytes} [Tue Oct 18 15:42:03 2022] GET /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426/os-interface => generated 284 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:42:04.179290 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a2ababe3-032a-40c6-85d3-0595c0624233 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1472196601", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:42:04.184869 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a2ababe3-032a-40c6-85d3-0595c0624233 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Request method failure captured: Oct 18 15:42:04.184869 n-d-853682-5 devstack@n-api.service[120405]: request: POST /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f/action HTTP/1.1 Oct 18 15:42:04.184869 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:42:04.184869 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:42:04.184869 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:42:04.184869 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 619 Oct 18 15:42:04.184869 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:42:04.184869 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:42:04.184869 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:42:04.184869 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:42:04.184869 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTskwmwAKtfJxRtfmFCexrRganirG5QxP3o41FeBWoidL-rUG8x8GL16JQLrOge4bbPRk8j9ZKsrTawjOywht8BMU6xpPPkLcF_Tvsxd_4ddRByYVxCCr1OvdQRZ3S_CoRUmp2shw5GPVxRCyE1gWYjx_sxIK_OIs6piyKG80707p5j0 Oct 18 15:42:04.184869 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:42:04.184869 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:42:04.184869 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:42:04.184869 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:42:04.184869 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:42:04.184869 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:42:04.184869 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 38b4cd4b884c4456866052a4969dc138 Oct 18 15:42:04.184869 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1849835039 Oct 18 15:42:04.184869 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:42:04.184869 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:42:04.184869 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/38b4cd4b884c4456866052a4969dc138"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/38b4cd4b884c4456866052a4969dc138"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/38b4cd4b884c4456866052a4969dc138"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_38b4cd4b884c4456866052a4969dc138"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:42:04.184869 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1849835039 Oct 18 15:42:04.184869 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 38b4cd4b884c4456866052a4969dc138 Oct 18 15:42:04.184869 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1849835039 Oct 18 15:42:04.184869 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ImagesOneServerNegativeTestJSON-1849835039-project Oct 18 15:42:04.184869 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:42:04.184869 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:42:04.184869 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: a2e9e9bbf3d94d77a236e43f019d316a Oct 18 15:42:04.184869 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1849835039-project Oct 18 15:42:04.184869 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:42:04.184869 n-d-853682-5 devstack@n-api.service[120405]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1472196601", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 18 15:42:04.184869 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:42:04.184869 n-d-853682-5 devstack@n-api.service[120405]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 15:42:04.184869 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '68a3c952-31f5-42a5-a8b9-698785c5c01f', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1472196601', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 18 15:42:04.184869 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:42:04.184869 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:42:04.184869 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 15:42:04.184869 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 15:42:04.184869 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 15:42:04.184869 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise error Oct 18 15:42:04.189056 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 15:42:04.189056 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:42:04.189056 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 18 15:42:04.189056 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 18 15:42:04.189056 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 18 15:42:04.189056 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 18 15:42:04.189056 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 18 15:42:04.189056 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:42:04.189056 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 18 15:42:04.189056 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 18 15:42:04.189056 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:42:04.189056 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:42:04.189056 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:42:04.189056 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:42:04.189056 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:42:04.189056 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:42:04.189056 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:42:04.189056 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:42:04.189056 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:42:04.189056 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:42:04.189056 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:42:04.189056 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:42:04.189056 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 15:42:04.189056 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 15:42:04.189056 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 15:42:04.189056 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 15:42:04.189056 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 15:42:04.189056 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 15:42:04.189056 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 15:42:04.189056 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:42:04.189056 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:42:04.189056 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:42:04.189056 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:42:04.189056 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:42:04.189056 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:42:04.189056 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 15:42:04.189056 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 15:42:04.189056 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 15:42:04.189056 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:42:04.196934 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a2ababe3-032a-40c6-85d3-0595c0624233 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:42:04.196934 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a2ababe3-032a-40c6-85d3-0595c0624233 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "POST /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f/action" status: 400 len: 938 microversion: 2.1 time: 0.020720 Oct 18 15:42:04.196934 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1930/3871] 10.222.0.60 () {60 vars in 1279 bytes} [Tue Oct 18 15:42:04 2022] POST /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f/action => generated 938 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:42:04.199889 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0eb531f1-929b-43b1-827a-35cc0c831c8c tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:04.200566 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0eb531f1-929b-43b1-827a-35cc0c831c8c tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 68a3c952-31f5-42a5-a8b9-698785c5c01f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:04.219790 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0eb531f1-929b-43b1-827a-35cc0c831c8c tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:04.220343 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0eb531f1-929b-43b1-827a-35cc0c831c8c tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:04.221107 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0eb531f1-929b-43b1-827a-35cc0c831c8c tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:04.222104 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0eb531f1-929b-43b1-827a-35cc0c831c8c tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:04.222572 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0eb531f1-929b-43b1-827a-35cc0c831c8c tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:04.223003 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0eb531f1-929b-43b1-827a-35cc0c831c8c tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:04.614038 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9e02dd2c-290b-4af9-8cc4-de3da2966f09 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1870f65339d43cb88462266db6073b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cd85218f8c40728c12b94cd6e37e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:04.626539 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9e02dd2c-290b-4af9-8cc4-de3da2966f09 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] 10.222.0.60 "GET /compute/v2.1/servers/342275a0-eca4-4c88-8c84-7d7bb1febf67" status: 200 len: 1325 microversion: 2.1 time: 0.519764 Oct 18 15:42:04.630436 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1942/3872] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:04 2022] GET /compute/v2.1/servers/342275a0-eca4-4c88-8c84-7d7bb1febf67 => generated 1325 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:04.680118 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-20eadefa-f304-47f0-ba54-b52dd5dc23d4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:04.680739 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-20eadefa-f304-47f0-ba54-b52dd5dc23d4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:04.689243 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20eadefa-f304-47f0-ba54-b52dd5dc23d4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:04.690310 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20eadefa-f304-47f0-ba54-b52dd5dc23d4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:04.690745 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20eadefa-f304-47f0-ba54-b52dd5dc23d4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:04.691452 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20eadefa-f304-47f0-ba54-b52dd5dc23d4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:04.692018 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20eadefa-f304-47f0-ba54-b52dd5dc23d4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:04.692633 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20eadefa-f304-47f0-ba54-b52dd5dc23d4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:04.699328 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0eb531f1-929b-43b1-827a-35cc0c831c8c tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:04.708360 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0eb531f1-929b-43b1-827a-35cc0c831c8c tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f" status: 200 len: 1520 microversion: 2.1 time: 0.514782 Oct 18 15:42:04.709683 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1931/3873] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:04 2022] GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f => generated 1520 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:42:04.750097 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0b87671d-07e8-4f80-bdda-16b12155637c tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:04.750943 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0b87671d-07e8-4f80-bdda-16b12155637c tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 68a3c952-31f5-42a5-a8b9-698785c5c01f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:04.763976 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0b87671d-07e8-4f80-bdda-16b12155637c tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:04.779852 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0b87671d-07e8-4f80-bdda-16b12155637c tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:04.780424 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0b87671d-07e8-4f80-bdda-16b12155637c tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:04.781979 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0b87671d-07e8-4f80-bdda-16b12155637c tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:04.784272 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0b87671d-07e8-4f80-bdda-16b12155637c tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:04.784778 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0b87671d-07e8-4f80-bdda-16b12155637c tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:05.637275 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-20eadefa-f304-47f0-ba54-b52dd5dc23d4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:05.645546 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-20eadefa-f304-47f0-ba54-b52dd5dc23d4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1684 microversion: 2.1 time: 0.973542 Oct 18 15:42:05.661153 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1943/3874] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:04 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1684 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:05.668457 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6e03e19b-4043-4361-8b08-8d7c8cd76d1d tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:05.669347 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6e03e19b-4043-4361-8b08-8d7c8cd76d1d tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] [instance: 342275a0-eca4-4c88-8c84-7d7bb1febf67] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:05.676768 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6e03e19b-4043-4361-8b08-8d7c8cd76d1d tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:05.677280 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6e03e19b-4043-4361-8b08-8d7c8cd76d1d tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:05.677708 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6e03e19b-4043-4361-8b08-8d7c8cd76d1d tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:05.678396 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6e03e19b-4043-4361-8b08-8d7c8cd76d1d tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:05.678844 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6e03e19b-4043-4361-8b08-8d7c8cd76d1d tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:05.679259 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6e03e19b-4043-4361-8b08-8d7c8cd76d1d tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:05.739356 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0b87671d-07e8-4f80-bdda-16b12155637c tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:05.750975 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0b87671d-07e8-4f80-bdda-16b12155637c tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f" status: 200 len: 1520 microversion: 2.1 time: 1.020549 Oct 18 15:42:05.751561 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1932/3875] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:04 2022] GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f => generated 1520 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:05.775804 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-116bbb2e-a154-4e82-a5c4-11d4239930d8 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:42:05.780070 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-116bbb2e-a154-4e82-a5c4-11d4239930d8 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Request method failure captured: Oct 18 15:42:05.780070 n-d-853682-5 devstack@n-api.service[120405]: request: POST /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f/action HTTP/1.1 Oct 18 15:42:05.780070 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:42:05.780070 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:42:05.780070 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:42:05.780070 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 285 Oct 18 15:42:05.780070 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:42:05.780070 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:42:05.780070 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:42:05.780070 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:42:05.780070 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTskwmwAKtfJxRtfmFCexrRganirG5QxP3o41FeBWoidL-rUG8x8GL16JQLrOge4bbPRk8j9ZKsrTawjOywht8BMU6xpPPkLcF_Tvsxd_4ddRByYVxCCr1OvdQRZ3S_CoRUmp2shw5GPVxRCyE1gWYjx_sxIK_OIs6piyKG80707p5j0 Oct 18 15:42:05.780070 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:42:05.780070 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:42:05.780070 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:42:05.780070 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:42:05.780070 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:42:05.780070 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:42:05.780070 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 38b4cd4b884c4456866052a4969dc138 Oct 18 15:42:05.780070 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1849835039 Oct 18 15:42:05.780070 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:42:05.780070 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:42:05.780070 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/38b4cd4b884c4456866052a4969dc138"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/38b4cd4b884c4456866052a4969dc138"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/38b4cd4b884c4456866052a4969dc138"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_38b4cd4b884c4456866052a4969dc138"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:42:05.780070 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1849835039 Oct 18 15:42:05.780070 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 38b4cd4b884c4456866052a4969dc138 Oct 18 15:42:05.780070 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1849835039 Oct 18 15:42:05.780070 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ImagesOneServerNegativeTestJSON-1849835039-project Oct 18 15:42:05.780070 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:42:05.780070 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:42:05.780070 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: a2e9e9bbf3d94d77a236e43f019d316a Oct 18 15:42:05.780070 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1849835039-project Oct 18 15:42:05.780070 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:42:05.780070 n-d-853682-5 devstack@n-api.service[120405]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 18 15:42:05.780070 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:42:05.780070 n-d-853682-5 devstack@n-api.service[120405]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 15:42:05.780070 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '68a3c952-31f5-42a5-a8b9-698785c5c01f', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 18 15:42:05.780070 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:42:05.780070 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:42:05.780070 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 15:42:05.780070 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 15:42:05.780070 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 15:42:05.780070 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise error Oct 18 15:42:05.780070 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 15:42:05.780070 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:42:05.780070 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 18 15:42:05.780070 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 18 15:42:05.780070 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:42:05.780070 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 18 15:42:05.780070 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 18 15:42:05.780070 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:42:05.780070 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:42:05.780070 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:42:05.784546 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:42:05.784546 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:42:05.784546 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:42:05.784546 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:42:05.784546 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:42:05.784546 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:42:05.784546 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:42:05.784546 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:42:05.784546 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:42:05.784546 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 15:42:05.784546 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 15:42:05.784546 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 15:42:05.784546 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 15:42:05.784546 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 15:42:05.784546 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 15:42:05.784546 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 15:42:05.784546 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:42:05.784546 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:42:05.784546 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:42:05.784546 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:42:05.784546 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:42:05.784546 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:42:05.784546 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 15:42:05.784546 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 15:42:05.784546 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 15:42:05.784546 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:42:05.784546 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-116bbb2e-a154-4e82-a5c4-11d4239930d8 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:42:05.784546 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-116bbb2e-a154-4e82-a5c4-11d4239930d8 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "POST /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f/action" status: 400 len: 619 microversion: 2.1 time: 0.010921 Oct 18 15:42:05.784546 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1933/3876] 10.222.0.60 () {60 vars in 1279 bytes} [Tue Oct 18 15:42:05 2022] POST /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f/action => generated 619 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:42:05.790592 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f6d7ed08-ee5e-4d46-81df-b842338dae32 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:05.791224 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f6d7ed08-ee5e-4d46-81df-b842338dae32 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 68a3c952-31f5-42a5-a8b9-698785c5c01f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:05.798185 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f6d7ed08-ee5e-4d46-81df-b842338dae32 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:05.798607 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f6d7ed08-ee5e-4d46-81df-b842338dae32 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:05.799794 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f6d7ed08-ee5e-4d46-81df-b842338dae32 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:05.800721 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f6d7ed08-ee5e-4d46-81df-b842338dae32 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:05.801211 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f6d7ed08-ee5e-4d46-81df-b842338dae32 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:05.801653 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f6d7ed08-ee5e-4d46-81df-b842338dae32 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:06.194595 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6e03e19b-4043-4361-8b08-8d7c8cd76d1d tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1870f65339d43cb88462266db6073b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cd85218f8c40728c12b94cd6e37e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:06.204009 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6e03e19b-4043-4361-8b08-8d7c8cd76d1d tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] 10.222.0.60 "GET /compute/v2.1/servers/342275a0-eca4-4c88-8c84-7d7bb1febf67" status: 200 len: 1325 microversion: 2.1 time: 0.541410 Oct 18 15:42:06.205882 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1944/3877] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:05 2022] GET /compute/v2.1/servers/342275a0-eca4-4c88-8c84-7d7bb1febf67 => generated 1325 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:06.297238 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f6d7ed08-ee5e-4d46-81df-b842338dae32 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:06.305261 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f6d7ed08-ee5e-4d46-81df-b842338dae32 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f" status: 200 len: 1520 microversion: 2.1 time: 0.518244 Oct 18 15:42:06.306270 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1934/3878] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:05 2022] GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f => generated 1520 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:42:06.334192 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-92cb50bf-0f98-406e-91ff-cfc7a51b7eb2 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:06.334724 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-92cb50bf-0f98-406e-91ff-cfc7a51b7eb2 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 68a3c952-31f5-42a5-a8b9-698785c5c01f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:06.340898 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92cb50bf-0f98-406e-91ff-cfc7a51b7eb2 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:06.341394 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92cb50bf-0f98-406e-91ff-cfc7a51b7eb2 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:06.341978 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92cb50bf-0f98-406e-91ff-cfc7a51b7eb2 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:06.342691 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92cb50bf-0f98-406e-91ff-cfc7a51b7eb2 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:06.343149 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92cb50bf-0f98-406e-91ff-cfc7a51b7eb2 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:06.343583 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92cb50bf-0f98-406e-91ff-cfc7a51b7eb2 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:06.674429 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-44861baf-fefe-4987-91eb-abb14098f2e3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:06.675988 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-44861baf-fefe-4987-91eb-abb14098f2e3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:06.701669 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-44861baf-fefe-4987-91eb-abb14098f2e3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:06.702686 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-44861baf-fefe-4987-91eb-abb14098f2e3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:06.703297 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-44861baf-fefe-4987-91eb-abb14098f2e3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:06.704220 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-44861baf-fefe-4987-91eb-abb14098f2e3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:06.704898 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-44861baf-fefe-4987-91eb-abb14098f2e3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:06.705533 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-44861baf-fefe-4987-91eb-abb14098f2e3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:06.981925 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-92cb50bf-0f98-406e-91ff-cfc7a51b7eb2 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:06.991854 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-92cb50bf-0f98-406e-91ff-cfc7a51b7eb2 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f" status: 200 len: 1520 microversion: 2.1 time: 0.662699 Oct 18 15:42:07.008892 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1945/3879] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:06 2022] GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f => generated 1520 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:07.015684 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fa7ffc59-ff77-456d-99e7-ab915872f6db tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1619253376"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:42:07.020597 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fa7ffc59-ff77-456d-99e7-ab915872f6db tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 68a3c952-31f5-42a5-a8b9-698785c5c01f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:07.027820 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fa7ffc59-ff77-456d-99e7-ab915872f6db tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:07.028656 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fa7ffc59-ff77-456d-99e7-ab915872f6db tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:07.030053 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fa7ffc59-ff77-456d-99e7-ab915872f6db tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:07.030836 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fa7ffc59-ff77-456d-99e7-ab915872f6db tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:07.032171 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fa7ffc59-ff77-456d-99e7-ab915872f6db tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:07.032671 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fa7ffc59-ff77-456d-99e7-ab915872f6db tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:07.177156 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-44861baf-fefe-4987-91eb-abb14098f2e3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:07.187622 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-44861baf-fefe-4987-91eb-abb14098f2e3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1671 microversion: 2.1 time: 0.517514 Oct 18 15:42:07.201152 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1935/3880] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:06 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1671 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:07.235022 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7a525ea6-948a-4d8a-a2a1-ff5410a3e96d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1332373883"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:42:07.239442 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7a525ea6-948a-4d8a-a2a1-ff5410a3e96d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:07.248294 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7a525ea6-948a-4d8a-a2a1-ff5410a3e96d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:07.249179 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7a525ea6-948a-4d8a-a2a1-ff5410a3e96d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:07.250300 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7a525ea6-948a-4d8a-a2a1-ff5410a3e96d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:07.251756 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7a525ea6-948a-4d8a-a2a1-ff5410a3e96d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:07.252833 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7a525ea6-948a-4d8a-a2a1-ff5410a3e96d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:07.253495 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7a525ea6-948a-4d8a-a2a1-ff5410a3e96d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:07.287635 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fa7ffc59-ff77-456d-99e7-ab915872f6db tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "POST /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f/action" status: 202 len: 0 microversion: 2.1 time: 0.276084 Oct 18 15:42:07.290257 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1946/3881] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:42:07 2022] POST /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f/action => generated 0 bytes in 280 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 18 15:42:07.301409 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1a1d493b-a6ae-4a1d-8359-cca2cd1c8372 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:07.303147 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1a1d493b-a6ae-4a1d-8359-cca2cd1c8372 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] [instance: 342275a0-eca4-4c88-8c84-7d7bb1febf67] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:07.319171 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1a1d493b-a6ae-4a1d-8359-cca2cd1c8372 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:07.321298 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1a1d493b-a6ae-4a1d-8359-cca2cd1c8372 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:07.321996 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1a1d493b-a6ae-4a1d-8359-cca2cd1c8372 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:07.337392 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1a1d493b-a6ae-4a1d-8359-cca2cd1c8372 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:07.337999 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1a1d493b-a6ae-4a1d-8359-cca2cd1c8372 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:07.338451 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1a1d493b-a6ae-4a1d-8359-cca2cd1c8372 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:07.590275 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7a525ea6-948a-4d8a-a2a1-ff5410a3e96d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "POST /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8/action" status: 202 len: 0 microversion: 2.1 time: 0.371890 Oct 18 15:42:07.597145 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1936/3882] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:42:07 2022] POST /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8/action => generated 0 bytes in 386 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 18 15:42:07.608635 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-533983ae-1883-4958-8f32-500bbf4be4d3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1871009967"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:42:07.614608 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-533983ae-1883-4958-8f32-500bbf4be4d3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 68a3c952-31f5-42a5-a8b9-698785c5c01f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:07.629321 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-533983ae-1883-4958-8f32-500bbf4be4d3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:07.629827 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-533983ae-1883-4958-8f32-500bbf4be4d3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:07.637707 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-533983ae-1883-4958-8f32-500bbf4be4d3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:07.638923 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-533983ae-1883-4958-8f32-500bbf4be4d3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:07.639431 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-533983ae-1883-4958-8f32-500bbf4be4d3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:07.640133 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-533983ae-1883-4958-8f32-500bbf4be4d3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:07.678743 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-533983ae-1883-4958-8f32-500bbf4be4d3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] HTTP exception thrown: Cannot 'createImage' instance 68a3c952-31f5-42a5-a8b9-698785c5c01f while it is in task_state image_snapshot Oct 18 15:42:07.681069 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-533983ae-1883-4958-8f32-500bbf4be4d3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Request method failure captured: Oct 18 15:42:07.681069 n-d-853682-5 devstack@n-api.service[120405]: request: POST /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f/action HTTP/1.1 Oct 18 15:42:07.681069 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:42:07.681069 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:42:07.681069 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:42:07.681069 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 85 Oct 18 15:42:07.681069 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:42:07.681069 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:42:07.681069 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:42:07.681069 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:42:07.681069 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTskwmwAKtfJxRtfmFCexrRganirG5QxP3o41FeBWoidL-rUG8x8GL16JQLrOge4bbPRk8j9ZKsrTawjOywht8BMU6xpPPkLcF_Tvsxd_4ddRByYVxCCr1OvdQRZ3S_CoRUmp2shw5GPVxRCyE1gWYjx_sxIK_OIs6piyKG80707p5j0 Oct 18 15:42:07.681069 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:42:07.681069 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:42:07.681069 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:42:07.681069 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:42:07.681069 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:42:07.681069 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:42:07.681069 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 38b4cd4b884c4456866052a4969dc138 Oct 18 15:42:07.681069 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1849835039 Oct 18 15:42:07.681069 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:42:07.681069 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:42:07.681069 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/38b4cd4b884c4456866052a4969dc138"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/38b4cd4b884c4456866052a4969dc138"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/38b4cd4b884c4456866052a4969dc138"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_38b4cd4b884c4456866052a4969dc138"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:42:07.681069 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1849835039 Oct 18 15:42:07.681069 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 38b4cd4b884c4456866052a4969dc138 Oct 18 15:42:07.681069 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1849835039 Oct 18 15:42:07.681069 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ImagesOneServerNegativeTestJSON-1849835039-project Oct 18 15:42:07.681069 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:42:07.681069 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:42:07.681069 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: a2e9e9bbf3d94d77a236e43f019d316a Oct 18 15:42:07.681069 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1849835039-project Oct 18 15:42:07.681069 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:42:07.681069 n-d-853682-5 devstack@n-api.service[120405]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1871009967"}} Oct 18 15:42:07.681069 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:42:07.681069 n-d-853682-5 devstack@n-api.service[120405]: exception: Cannot 'createImage' instance 68a3c952-31f5-42a5-a8b9-698785c5c01f while it is in task_state image_snapshot Oct 18 15:42:07.681069 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '68a3c952-31f5-42a5-a8b9-698785c5c01f', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1871009967'}}} Oct 18 15:42:07.681069 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:42:07.681069 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:42:07.681069 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 18 15:42:07.681069 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 18 15:42:07.681069 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 18 15:42:07.681069 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 15:42:07.681069 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 68a3c952-31f5-42a5-a8b9-698785c5c01f in task_state image_snapshot. Cannot snapshot while the instance is in this state. Oct 18 15:42:07.681069 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:42:07.681069 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:42:07.681069 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:42:07.681069 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:42:07.681069 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:42:07.681069 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:42:07.681069 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:42:07.681069 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:42:07.681069 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:42:07.681069 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:42:07.681069 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:42:07.681069 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:42:07.681069 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:42:07.681069 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:42:07.681069 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 18 15:42:07.681069 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 18 15:42:07.681069 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 15:42:07.681069 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 15:42:07.681069 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 68a3c952-31f5-42a5-a8b9-698785c5c01f while it is in task_state image_snapshot Oct 18 15:42:07.686748 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:42:07.686748 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:42:07.686748 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:42:07.686748 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:42:07.686748 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:42:07.686748 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:42:07.686748 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:42:07.686748 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:42:07.686748 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 68a3c952-31f5-42a5-a8b9-698785c5c01f while it is in task_state image_snapshot Oct 18 15:42:07.686748 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:42:07.689456 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-533983ae-1883-4958-8f32-500bbf4be4d3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Returning 409 to user: Cannot 'createImage' instance 68a3c952-31f5-42a5-a8b9-698785c5c01f while it is in task_state image_snapshot {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:42:07.690752 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-533983ae-1883-4958-8f32-500bbf4be4d3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "POST /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f/action" status: 409 len: 159 microversion: 2.1 time: 0.092043 Oct 18 15:42:07.694906 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1937/3883] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:42:07 2022] POST /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f/action => generated 159 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 15:42:07.754247 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1a1d493b-a6ae-4a1d-8359-cca2cd1c8372 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1870f65339d43cb88462266db6073b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cd85218f8c40728c12b94cd6e37e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:07.769098 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1a1d493b-a6ae-4a1d-8359-cca2cd1c8372 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] 10.222.0.60 "GET /compute/v2.1/servers/342275a0-eca4-4c88-8c84-7d7bb1febf67" status: 200 len: 1325 microversion: 2.1 time: 0.477150 Oct 18 15:42:07.787863 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1947/3884] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:07 2022] GET /compute/v2.1/servers/342275a0-eca4-4c88-8c84-7d7bb1febf67 => generated 1325 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:07.798192 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5faba7f1-77f1-44c7-888c-69d39e5c6db8 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '.version_select at 0x7f7c3d5c95e0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:08.007561 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5faba7f1-77f1-44c7-888c-69d39e5c6db8 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "DELETE /compute/v2.1/images/0f425c54-be6a-4a95-b0cd-34449c1d0ad4" status: 204 len: 0 microversion: 2.1 time: 0.218477 Oct 18 15:42:08.008586 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1948/3885] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:07 2022] DELETE /compute/v2.1/images/0f425c54-be6a-4a95-b0cd-34449c1d0ad4 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:42:08.015103 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-a3f735fe-3729-44ff-bc71-7e2e4346842f req-3daca9e0-fcbd-4e53-84e6-040ad400dc78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55179126-a629-4bb3-82f5-14606ec63426", "tag": "4a427a75-becb-49f1-943f-d4357e1f1e68"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:42:08.017413 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-85bb22e1-5766-495c-ba26-1bf2e5cef41d tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-262034849", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "c0e5858e-dabf-4ffa-8248-b017189fcb11"}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:42:08.028040 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a3f735fe-3729-44ff-bc71-7e2e4346842f req-3daca9e0-fcbd-4e53-84e6-040ad400dc78 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:08.028909 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a3f735fe-3729-44ff-bc71-7e2e4346842f req-3daca9e0-fcbd-4e53-84e6-040ad400dc78 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:08.029515 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a3f735fe-3729-44ff-bc71-7e2e4346842f req-3daca9e0-fcbd-4e53-84e6-040ad400dc78 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:08.041624 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-a3f735fe-3729-44ff-bc71-7e2e4346842f req-3daca9e0-fcbd-4e53-84e6-040ad400dc78 service nova] Creating event network-changed:4a427a75-becb-49f1-943f-d4357e1f1e68 for instance 55179126-a629-4bb3-82f5-14606ec63426 on n-h1-853682-5 Oct 18 15:42:08.048018 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-a3f735fe-3729-44ff-bc71-7e2e4346842f req-3daca9e0-fcbd-4e53-84e6-040ad400dc78 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037492 Oct 18 15:42:08.049348 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1949/3886] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:42:08.056709 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5a9c179b-b619-4fb2-8d86-f19b3e2234a1 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:08.057724 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5a9c179b-b619-4fb2-8d86-f19b3e2234a1 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 68a3c952-31f5-42a5-a8b9-698785c5c01f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:08.066109 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a9c179b-b619-4fb2-8d86-f19b3e2234a1 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:08.067086 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a9c179b-b619-4fb2-8d86-f19b3e2234a1 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:08.067910 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a9c179b-b619-4fb2-8d86-f19b3e2234a1 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:08.069448 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a9c179b-b619-4fb2-8d86-f19b3e2234a1 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:08.070167 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a9c179b-b619-4fb2-8d86-f19b3e2234a1 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:08.070815 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a9c179b-b619-4fb2-8d86-f19b3e2234a1 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:08.093570 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-85bb22e1-5766-495c-ba26-1bf2e5cef41d tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] validate_networks() for [('c0e5858e-dabf-4ffa-8248-b017189fcb11', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:42:08.475253 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5a9c179b-b619-4fb2-8d86-f19b3e2234a1 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:08.485066 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5a9c179b-b619-4fb2-8d86-f19b3e2234a1 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f" status: 200 len: 1532 microversion: 2.1 time: 0.434208 Oct 18 15:42:08.511249 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1950/3887] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:08 2022] GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f => generated 1532 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:08.527449 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-f22a8a40-3c9d-43a7-af2e-5a019978183d req-63888f8b-31d6-446c-8801-73b9232b0e75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "342275a0-eca4-4c88-8c84-7d7bb1febf67", "name": "network-vif-plugged", "status": "completed", "tag": "08d99f3b-f981-4a5d-b4a1-2a2110b34c6f"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:42:08.547290 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f22a8a40-3c9d-43a7-af2e-5a019978183d req-63888f8b-31d6-446c-8801-73b9232b0e75 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:08.548266 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f22a8a40-3c9d-43a7-af2e-5a019978183d req-63888f8b-31d6-446c-8801-73b9232b0e75 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:08.549520 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f22a8a40-3c9d-43a7-af2e-5a019978183d req-63888f8b-31d6-446c-8801-73b9232b0e75 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:08.592993 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-f22a8a40-3c9d-43a7-af2e-5a019978183d req-63888f8b-31d6-446c-8801-73b9232b0e75 service nova] Creating event network-vif-plugged:08d99f3b-f981-4a5d-b4a1-2a2110b34c6f for instance 342275a0-eca4-4c88-8c84-7d7bb1febf67 on n-h2-853682-5 Oct 18 15:42:08.608249 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-f22a8a40-3c9d-43a7-af2e-5a019978183d req-63888f8b-31d6-446c-8801-73b9232b0e75 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095113 Oct 18 15:42:08.609877 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1951/3888] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:42:08.794364 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4e2fd23c-2892-46fc-9c42-579247b29533 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:08.795141 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4e2fd23c-2892-46fc-9c42-579247b29533 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] [instance: 342275a0-eca4-4c88-8c84-7d7bb1febf67] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:08.806001 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e2fd23c-2892-46fc-9c42-579247b29533 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:08.806740 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e2fd23c-2892-46fc-9c42-579247b29533 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:08.807403 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e2fd23c-2892-46fc-9c42-579247b29533 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:08.808319 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e2fd23c-2892-46fc-9c42-579247b29533 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:08.809165 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e2fd23c-2892-46fc-9c42-579247b29533 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:08.809808 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e2fd23c-2892-46fc-9c42-579247b29533 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:09.613679 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4e2fd23c-2892-46fc-9c42-579247b29533 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1870f65339d43cb88462266db6073b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cd85218f8c40728c12b94cd6e37e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:09.621971 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4e2fd23c-2892-46fc-9c42-579247b29533 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] 10.222.0.60 "GET /compute/v2.1/servers/342275a0-eca4-4c88-8c84-7d7bb1febf67" status: 200 len: 1325 microversion: 2.1 time: 0.832329 Oct 18 15:42:09.622811 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1952/3889] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:08 2022] GET /compute/v2.1/servers/342275a0-eca4-4c88-8c84-7d7bb1febf67 => generated 1325 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:42:09.631917 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a7d13cac-149d-4f42-a47e-a72a93b9a005 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:09.632956 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a7d13cac-149d-4f42-a47e-a72a93b9a005 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 68a3c952-31f5-42a5-a8b9-698785c5c01f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:09.639402 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7d13cac-149d-4f42-a47e-a72a93b9a005 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:09.639964 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7d13cac-149d-4f42-a47e-a72a93b9a005 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:09.640475 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7d13cac-149d-4f42-a47e-a72a93b9a005 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:09.641375 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7d13cac-149d-4f42-a47e-a72a93b9a005 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:09.642022 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7d13cac-149d-4f42-a47e-a72a93b9a005 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:09.642989 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7d13cac-149d-4f42-a47e-a72a93b9a005 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:09.740717 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-85bb22e1-5766-495c-ba26-1bf2e5cef41d tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:42:09.741282 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-85bb22e1-5766-495c-ba26-1bf2e5cef41d tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:42:09.742258 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-85bb22e1-5766-495c-ba26-1bf2e5cef41d tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:42:09.742684 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-85bb22e1-5766-495c-ba26-1bf2e5cef41d tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:42:09.743110 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-85bb22e1-5766-495c-ba26-1bf2e5cef41d tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:42:09.754006 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-85bb22e1-5766-495c-ba26-1bf2e5cef41d tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:09.754534 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-85bb22e1-5766-495c-ba26-1bf2e5cef41d tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:09.755053 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-85bb22e1-5766-495c-ba26-1bf2e5cef41d tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:09.755826 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-85bb22e1-5766-495c-ba26-1bf2e5cef41d tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:09.756315 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-85bb22e1-5766-495c-ba26-1bf2e5cef41d tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:09.757190 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-85bb22e1-5766-495c-ba26-1bf2e5cef41d tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:09.777640 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-85bb22e1-5766-495c-ba26-1bf2e5cef41d tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Getting quotas for project 4c931ca6c2284e2f81c84b35db7192e7. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:42:09.783760 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-85bb22e1-5766-495c-ba26-1bf2e5cef41d tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Getting quotas for user ea7cb4b4f1da48e3908b9aa55e8d4b70 and project 4c931ca6c2284e2f81c84b35db7192e7. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:42:09.797182 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-85bb22e1-5766-495c-ba26-1bf2e5cef41d tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:42:09.800112 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-85bb22e1-5766-495c-ba26-1bf2e5cef41d tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] [instance: 169ae6e5-bfce-46d4-a3d3-8878a214e0e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:42:09.855022 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-85bb22e1-5766-495c-ba26-1bf2e5cef41d tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.158691 Oct 18 15:42:09.856165 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1938/3890] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:42:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2160 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:42:09.869789 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6af7a024-ec5c-4566-8f15-7c26ddc04847 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:09.870593 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6af7a024-ec5c-4566-8f15-7c26ddc04847 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] [instance: 169ae6e5-bfce-46d4-a3d3-8878a214e0e4] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:09.876120 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=6 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:42:09.943257 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a7d13cac-149d-4f42-a47e-a72a93b9a005 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:09.949534 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:42:09.956353 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a7d13cac-149d-4f42-a47e-a72a93b9a005 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f" status: 200 len: 1538 microversion: 2.1 time: 0.331762 Oct 18 15:42:09.968326 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6af7a024-ec5c-4566-8f15-7c26ddc04847 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7cb4b4f1da48e3908b9aa55e8d4b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c931ca6c2284e2f81c84b35db7192e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:09.972914 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1953/3891] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:09 2022] GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f => generated 1538 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:09.984302 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6af7a024-ec5c-4566-8f15-7c26ddc04847 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] 10.222.0.60 "GET /compute/v2.1/servers/169ae6e5-bfce-46d4-a3d3-8878a214e0e4" status: 200 len: 1224 microversion: 2.1 time: 0.119330 Oct 18 15:42:09.985210 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1939/3892] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:09 2022] GET /compute/v2.1/servers/169ae6e5-bfce-46d4-a3d3-8878a214e0e4 => generated 1224 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:42:10.625899 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-56b9f745-ee3e-400d-98d6-685da21577e1 req-721654ca-a51e-4af3-87f4-6bc3c31c31f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79212b18-bfd6-4a94-9d58-80c535525aa8", "name": "network-vif-unplugged", "status": "completed", "tag": "65ddf63c-d787-42eb-bb1d-c107c1fe8b2f"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:42:10.647329 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4ce4321f-33cb-4a5d-b897-854c012e79e0 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:10.647947 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4ce4321f-33cb-4a5d-b897-854c012e79e0 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] [instance: 342275a0-eca4-4c88-8c84-7d7bb1febf67] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:10.656985 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-56b9f745-ee3e-400d-98d6-685da21577e1 req-721654ca-a51e-4af3-87f4-6bc3c31c31f6 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:10.659635 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ce4321f-33cb-4a5d-b897-854c012e79e0 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:10.660458 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-56b9f745-ee3e-400d-98d6-685da21577e1 req-721654ca-a51e-4af3-87f4-6bc3c31c31f6 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:10.661075 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-56b9f745-ee3e-400d-98d6-685da21577e1 req-721654ca-a51e-4af3-87f4-6bc3c31c31f6 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:10.664277 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ce4321f-33cb-4a5d-b897-854c012e79e0 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:10.664731 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ce4321f-33cb-4a5d-b897-854c012e79e0 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:10.665486 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ce4321f-33cb-4a5d-b897-854c012e79e0 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:10.665946 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ce4321f-33cb-4a5d-b897-854c012e79e0 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:10.666372 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ce4321f-33cb-4a5d-b897-854c012e79e0 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:10.683921 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-56b9f745-ee3e-400d-98d6-685da21577e1 req-721654ca-a51e-4af3-87f4-6bc3c31c31f6 service nova] Creating event network-vif-unplugged:65ddf63c-d787-42eb-bb1d-c107c1fe8b2f for instance 79212b18-bfd6-4a94-9d58-80c535525aa8 on n-h2-853682-5 Oct 18 15:42:10.694178 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-56b9f745-ee3e-400d-98d6-685da21577e1 req-721654ca-a51e-4af3-87f4-6bc3c31c31f6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072005 Oct 18 15:42:10.695923 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1954/3893] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:42:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:42:10.980268 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4ce4321f-33cb-4a5d-b897-854c012e79e0 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1870f65339d43cb88462266db6073b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cd85218f8c40728c12b94cd6e37e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:10.989412 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7723eafe-601b-4f17-b7e1-1731ab543eb2 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:10.990297 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7723eafe-601b-4f17-b7e1-1731ab543eb2 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 68a3c952-31f5-42a5-a8b9-698785c5c01f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:10.997417 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4ce4321f-33cb-4a5d-b897-854c012e79e0 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] 10.222.0.60 "GET /compute/v2.1/servers/342275a0-eca4-4c88-8c84-7d7bb1febf67" status: 200 len: 1325 microversion: 2.1 time: 0.355034 Oct 18 15:42:10.997634 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7723eafe-601b-4f17-b7e1-1731ab543eb2 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:10.998167 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7723eafe-601b-4f17-b7e1-1731ab543eb2 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:10.998937 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1940/3894] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:10 2022] GET /compute/v2.1/servers/342275a0-eca4-4c88-8c84-7d7bb1febf67 => generated 1325 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:11.009600 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c44e48ff-2a88-46fe-8bfd-89285729d383 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:11.010346 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7723eafe-601b-4f17-b7e1-1731ab543eb2 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:11.011979 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c44e48ff-2a88-46fe-8bfd-89285729d383 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] [instance: 169ae6e5-bfce-46d4-a3d3-8878a214e0e4] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:11.016935 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7723eafe-601b-4f17-b7e1-1731ab543eb2 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:11.018434 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7723eafe-601b-4f17-b7e1-1731ab543eb2 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:11.019115 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7723eafe-601b-4f17-b7e1-1731ab543eb2 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:11.025915 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c44e48ff-2a88-46fe-8bfd-89285729d383 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:11.028106 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c44e48ff-2a88-46fe-8bfd-89285729d383 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:11.028745 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c44e48ff-2a88-46fe-8bfd-89285729d383 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:11.030380 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c44e48ff-2a88-46fe-8bfd-89285729d383 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:11.031172 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c44e48ff-2a88-46fe-8bfd-89285729d383 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:11.031980 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c44e48ff-2a88-46fe-8bfd-89285729d383 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:11.130654 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c44e48ff-2a88-46fe-8bfd-89285729d383 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7cb4b4f1da48e3908b9aa55e8d4b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c931ca6c2284e2f81c84b35db7192e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:11.138534 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c44e48ff-2a88-46fe-8bfd-89285729d383 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] 10.222.0.60 "GET /compute/v2.1/servers/169ae6e5-bfce-46d4-a3d3-8878a214e0e4" status: 200 len: 1276 microversion: 2.1 time: 0.134432 Oct 18 15:42:11.139126 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1941/3895] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:11 2022] GET /compute/v2.1/servers/169ae6e5-bfce-46d4-a3d3-8878a214e0e4 => generated 1276 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:42:11.295391 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7723eafe-601b-4f17-b7e1-1731ab543eb2 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:11.306913 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7723eafe-601b-4f17-b7e1-1731ab543eb2 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f" status: 200 len: 1538 microversion: 2.1 time: 0.325107 Oct 18 15:42:11.308950 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1955/3896] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:10 2022] GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f => generated 1538 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:12.022768 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-937d5dae-e9af-46ee-800c-db9a14e036e1 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:12.033856 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-937d5dae-e9af-46ee-800c-db9a14e036e1 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] [instance: 342275a0-eca4-4c88-8c84-7d7bb1febf67] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:12.053952 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-937d5dae-e9af-46ee-800c-db9a14e036e1 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:12.055574 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-937d5dae-e9af-46ee-800c-db9a14e036e1 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:12.056043 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-937d5dae-e9af-46ee-800c-db9a14e036e1 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:12.057569 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-937d5dae-e9af-46ee-800c-db9a14e036e1 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:12.058061 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-937d5dae-e9af-46ee-800c-db9a14e036e1 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:12.058698 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-937d5dae-e9af-46ee-800c-db9a14e036e1 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:12.165426 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2274dfd0-223c-4f3b-8099-3ae6cdb75a8a tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:12.166808 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2274dfd0-223c-4f3b-8099-3ae6cdb75a8a tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] [instance: 169ae6e5-bfce-46d4-a3d3-8878a214e0e4] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:12.179220 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2274dfd0-223c-4f3b-8099-3ae6cdb75a8a tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:12.181800 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2274dfd0-223c-4f3b-8099-3ae6cdb75a8a tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:12.182471 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2274dfd0-223c-4f3b-8099-3ae6cdb75a8a tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:12.184896 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2274dfd0-223c-4f3b-8099-3ae6cdb75a8a tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:12.185546 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2274dfd0-223c-4f3b-8099-3ae6cdb75a8a tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:12.186996 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2274dfd0-223c-4f3b-8099-3ae6cdb75a8a tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:12.354164 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2274dfd0-223c-4f3b-8099-3ae6cdb75a8a tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7cb4b4f1da48e3908b9aa55e8d4b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c931ca6c2284e2f81c84b35db7192e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:12.390578 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2274dfd0-223c-4f3b-8099-3ae6cdb75a8a tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] 10.222.0.60 "GET /compute/v2.1/servers/169ae6e5-bfce-46d4-a3d3-8878a214e0e4" status: 200 len: 1282 microversion: 2.1 time: 0.229477 Oct 18 15:42:12.396846 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1956/3897] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:12 2022] GET /compute/v2.1/servers/169ae6e5-bfce-46d4-a3d3-8878a214e0e4 => generated 1282 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:42:12.416279 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e67a062d-087f-4cf2-bb0b-502bf8fe6729 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:12.417276 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e67a062d-087f-4cf2-bb0b-502bf8fe6729 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 68a3c952-31f5-42a5-a8b9-698785c5c01f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:12.432012 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e67a062d-087f-4cf2-bb0b-502bf8fe6729 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:12.432835 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e67a062d-087f-4cf2-bb0b-502bf8fe6729 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:12.434660 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e67a062d-087f-4cf2-bb0b-502bf8fe6729 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:12.436112 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e67a062d-087f-4cf2-bb0b-502bf8fe6729 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:12.436746 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e67a062d-087f-4cf2-bb0b-502bf8fe6729 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:12.437954 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e67a062d-087f-4cf2-bb0b-502bf8fe6729 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:12.459926 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-937d5dae-e9af-46ee-800c-db9a14e036e1 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1870f65339d43cb88462266db6073b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cd85218f8c40728c12b94cd6e37e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:12.476544 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-937d5dae-e9af-46ee-800c-db9a14e036e1 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] 10.222.0.60 "GET /compute/v2.1/servers/342275a0-eca4-4c88-8c84-7d7bb1febf67" status: 200 len: 1522 microversion: 2.1 time: 0.457535 Oct 18 15:42:12.477484 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1942/3898] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:12 2022] GET /compute/v2.1/servers/342275a0-eca4-4c88-8c84-7d7bb1febf67 => generated 1522 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:12.500613 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-60132db9-65b7-49a7-a16d-ceb297626800 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:12.501339 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-60132db9-65b7-49a7-a16d-ceb297626800 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] [instance: 342275a0-eca4-4c88-8c84-7d7bb1febf67] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:12.519148 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-60132db9-65b7-49a7-a16d-ceb297626800 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:12.522901 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-60132db9-65b7-49a7-a16d-ceb297626800 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:12.526922 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-60132db9-65b7-49a7-a16d-ceb297626800 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:12.532526 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-60132db9-65b7-49a7-a16d-ceb297626800 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:12.534058 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-60132db9-65b7-49a7-a16d-ceb297626800 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:12.542269 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-60132db9-65b7-49a7-a16d-ceb297626800 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:12.638359 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-60132db9-65b7-49a7-a16d-ceb297626800 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] HTTP exception thrown: Action 999 not found Oct 18 15:42:12.651912 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-60132db9-65b7-49a7-a16d-ceb297626800 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Request method failure captured: Oct 18 15:42:12.651912 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/342275a0-eca4-4c88-8c84-7d7bb1febf67/os-instance-actions/999 HTTP/1.1 Oct 18 15:42:12.651912 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:42:12.651912 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:42:12.651912 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:42:12.651912 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:42:12.651912 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:42:12.651912 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:42:12.651912 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:42:12.651912 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:42:12.651912 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsk9dFxwuRKHR2Utl4LEmVwtyFcaJQ7i_-pacs3Dm9QeEEnx6ck0ZwGlb0fKGQ6S05hmbGiufKb7tTXKrEWbUMK3Py53KUsQfwdM516C8EWnLUgXTm2ns4vi0h0ZO9asJnCFT0bRf6_PhB0mrRQap_gHGVLP8DW6hJiwfdDAbEc03Gw Oct 18 15:42:12.651912 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:42:12.651912 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:42:12.651912 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:42:12.651912 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:42:12.651912 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:42:12.651912 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:42:12.651912 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 88cd85218f8c40728c12b94cd6e37e10 Oct 18 15:42:12.651912 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-31129279 Oct 18 15:42:12.651912 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:42:12.651912 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:42:12.651912 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/88cd85218f8c40728c12b94cd6e37e10"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/88cd85218f8c40728c12b94cd6e37e10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/88cd85218f8c40728c12b94cd6e37e10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_88cd85218f8c40728c12b94cd6e37e10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:42:12.651912 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-31129279 Oct 18 15:42:12.651912 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 88cd85218f8c40728c12b94cd6e37e10 Oct 18 15:42:12.651912 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-31129279 Oct 18 15:42:12.651912 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-InstanceActionsNegativeTestJSON-31129279-project Oct 18 15:42:12.651912 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:42:12.651912 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:42:12.651912 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: a1870f65339d43cb88462266db6073b8 Oct 18 15:42:12.651912 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-31129279-project Oct 18 15:42:12.651912 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:42:12.651912 n-d-853682-5 devstack@n-api.service[120405]: exception: Action 999 not found Oct 18 15:42:12.651912 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'server_id': '342275a0-eca4-4c88-8c84-7d7bb1febf67', 'id': '999'} Oct 18 15:42:12.651912 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:42:12.651912 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:42:12.651912 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:42:12.651912 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:42:12.651912 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:42:12.651912 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:42:12.651912 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:42:12.651912 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:42:12.651912 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 18 15:42:12.651912 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 18 15:42:12.651912 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 18 15:42:12.651912 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:42:12.651912 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:42:12.651912 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:42:12.651912 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:42:12.651912 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:42:12.651912 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:42:12.651912 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:42:12.651912 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:42:12.651912 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 18 15:42:12.651912 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:42:12.656769 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-60132db9-65b7-49a7-a16d-ceb297626800 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Returning 404 to user: Action 999 not found {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:42:12.657656 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-60132db9-65b7-49a7-a16d-ceb297626800 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] 10.222.0.60 "GET /compute/v2.1/servers/342275a0-eca4-4c88-8c84-7d7bb1febf67/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.161686 Oct 18 15:42:12.663208 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1943/3899] 10.222.0.60 () {58 vars in 1308 bytes} [Tue Oct 18 15:42:12 2022] GET /compute/v2.1/servers/342275a0-eca4-4c88-8c84-7d7bb1febf67/os-instance-actions/999 => generated 66 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 15:42:12.668670 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5e8aa548-fcdd-4478-bf16-3b893c0c748e tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Calling method '.version_select at 0x7f7c41715c10>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:12.672085 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5e8aa548-fcdd-4478-bf16-3b893c0c748e tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] [instance: 2bb09566-d5b7-4643-857e-e272755888d3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:12.682483 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-5e8aa548-fcdd-4478-bf16-3b893c0c748e tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] HTTP exception thrown: Instance 2bb09566-d5b7-4643-857e-e272755888d3 could not be found. Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5e8aa548-fcdd-4478-bf16-3b893c0c748e tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Request method failure captured: Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/2bb09566-d5b7-4643-857e-e272755888d3/os-instance-actions HTTP/1.1 Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsk9dFxwuRKHR2Utl4LEmVwtyFcaJQ7i_-pacs3Dm9QeEEnx6ck0ZwGlb0fKGQ6S05hmbGiufKb7tTXKrEWbUMK3Py53KUsQfwdM516C8EWnLUgXTm2ns4vi0h0ZO9asJnCFT0bRf6_PhB0mrRQap_gHGVLP8DW6hJiwfdDAbEc03Gw Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 88cd85218f8c40728c12b94cd6e37e10 Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-31129279 Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/88cd85218f8c40728c12b94cd6e37e10"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/88cd85218f8c40728c12b94cd6e37e10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/88cd85218f8c40728c12b94cd6e37e10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_88cd85218f8c40728c12b94cd6e37e10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-31129279 Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 88cd85218f8c40728c12b94cd6e37e10 Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-31129279 Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-InstanceActionsNegativeTestJSON-31129279-project Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: a1870f65339d43cb88462266db6073b8 Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-31129279-project Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: method: Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 2bb09566-d5b7-4643-857e-e272755888d3 could not be found. Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'server_id': '2bb09566-d5b7-4643-857e-e272755888d3'} Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bb09566-d5b7-4643-857e-e272755888d3 could not be found. Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:42:12.696450 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:42:12.702033 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bb09566-d5b7-4643-857e-e272755888d3 could not be found. Oct 18 15:42:12.702033 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:42:12.702033 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:42:12.702033 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:42:12.702033 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:42:12.702033 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:42:12.702033 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:42:12.702033 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:42:12.702033 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:42:12.702033 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bb09566-d5b7-4643-857e-e272755888d3 could not be found. Oct 18 15:42:12.702033 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:42:12.704652 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5e8aa548-fcdd-4478-bf16-3b893c0c748e tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Returning 404 to user: Instance 2bb09566-d5b7-4643-857e-e272755888d3 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:42:12.706663 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5e8aa548-fcdd-4478-bf16-3b893c0c748e tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] 10.222.0.60 "GET /compute/v2.1/servers/2bb09566-d5b7-4643-857e-e272755888d3/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.041492 Oct 18 15:42:12.707498 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1944/3900] 10.222.0.60 () {58 vars in 1296 bytes} [Tue Oct 18 15:42:12 2022] GET /compute/v2.1/servers/2bb09566-d5b7-4643-857e-e272755888d3/os-instance-actions => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:42:12.718537 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7302e401-6528-41b5-933f-aff6d28fe5dd tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:12.721342 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7302e401-6528-41b5-933f-aff6d28fe5dd tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] [instance: 342275a0-eca4-4c88-8c84-7d7bb1febf67] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:12.735918 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7302e401-6528-41b5-933f-aff6d28fe5dd tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:12.738851 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7302e401-6528-41b5-933f-aff6d28fe5dd tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:12.739639 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7302e401-6528-41b5-933f-aff6d28fe5dd tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:12.740612 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7302e401-6528-41b5-933f-aff6d28fe5dd tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:12.743065 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7302e401-6528-41b5-933f-aff6d28fe5dd tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:12.743737 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7302e401-6528-41b5-933f-aff6d28fe5dd tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:12.815339 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7302e401-6528-41b5-933f-aff6d28fe5dd tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] [instance: 342275a0-eca4-4c88-8c84-7d7bb1febf67] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:42:13.004143 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7302e401-6528-41b5-933f-aff6d28fe5dd tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] 10.222.0.60 "DELETE /compute/v2.1/servers/342275a0-eca4-4c88-8c84-7d7bb1febf67" status: 204 len: 0 microversion: 2.1 time: 0.290352 Oct 18 15:42:13.009576 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1945/3901] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:42:12 2022] DELETE /compute/v2.1/servers/342275a0-eca4-4c88-8c84-7d7bb1febf67 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 15:42:13.023295 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f25af862-5053-47f7-85c5-c6a38b5d11d9 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:13.027755 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f25af862-5053-47f7-85c5-c6a38b5d11d9 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] [instance: 342275a0-eca4-4c88-8c84-7d7bb1febf67] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:13.045720 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f25af862-5053-47f7-85c5-c6a38b5d11d9 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:13.046568 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f25af862-5053-47f7-85c5-c6a38b5d11d9 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:13.047182 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f25af862-5053-47f7-85c5-c6a38b5d11d9 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:13.048108 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f25af862-5053-47f7-85c5-c6a38b5d11d9 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:13.053656 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f25af862-5053-47f7-85c5-c6a38b5d11d9 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:13.054386 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f25af862-5053-47f7-85c5-c6a38b5d11d9 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:13.187647 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e67a062d-087f-4cf2-bb0b-502bf8fe6729 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:13.199747 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e67a062d-087f-4cf2-bb0b-502bf8fe6729 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f" status: 200 len: 1538 microversion: 2.1 time: 0.796778 Oct 18 15:42:13.200335 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1957/3902] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:12 2022] GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f => generated 1538 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:13.339680 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-5891468b-a326-4507-b2e6-a9bb23b75e12 req-96b2ca5c-55d1-45c9-b3cd-ce4d4ccc945b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68a3c952-31f5-42a5-a8b9-698785c5c01f", "name": "network-vif-plugged", "status": "completed", "tag": "3f868e1b-cc07-458b-a0b9-b89c7f817858"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:42:13.353915 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:42:13.391565 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5891468b-a326-4507-b2e6-a9bb23b75e12 req-96b2ca5c-55d1-45c9-b3cd-ce4d4ccc945b service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:13.391901 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f25af862-5053-47f7-85c5-c6a38b5d11d9 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1870f65339d43cb88462266db6073b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cd85218f8c40728c12b94cd6e37e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:13.392391 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5891468b-a326-4507-b2e6-a9bb23b75e12 req-96b2ca5c-55d1-45c9-b3cd-ce4d4ccc945b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:13.393725 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5891468b-a326-4507-b2e6-a9bb23b75e12 req-96b2ca5c-55d1-45c9-b3cd-ce4d4ccc945b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:13.405828 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f25af862-5053-47f7-85c5-c6a38b5d11d9 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] 10.222.0.60 "GET /compute/v2.1/servers/342275a0-eca4-4c88-8c84-7d7bb1febf67" status: 200 len: 1528 microversion: 2.1 time: 0.391695 Oct 18 15:42:13.406469 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1946/3903] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:13 2022] GET /compute/v2.1/servers/342275a0-eca4-4c88-8c84-7d7bb1febf67 => generated 1528 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:13.422870 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-94f35efc-9ab2-47a4-9413-abe15127daeb tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:13.425727 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-94f35efc-9ab2-47a4-9413-abe15127daeb tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] [instance: 169ae6e5-bfce-46d4-a3d3-8878a214e0e4] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:13.434102 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-5891468b-a326-4507-b2e6-a9bb23b75e12 req-96b2ca5c-55d1-45c9-b3cd-ce4d4ccc945b service nova] Creating event network-vif-plugged:3f868e1b-cc07-458b-a0b9-b89c7f817858 for instance 68a3c952-31f5-42a5-a8b9-698785c5c01f on n-h1-853682-5 Oct 18 15:42:13.439707 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-94f35efc-9ab2-47a4-9413-abe15127daeb tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:13.440210 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-94f35efc-9ab2-47a4-9413-abe15127daeb tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:13.440650 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-94f35efc-9ab2-47a4-9413-abe15127daeb tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:13.448424 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-5891468b-a326-4507-b2e6-a9bb23b75e12 req-96b2ca5c-55d1-45c9-b3cd-ce4d4ccc945b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113494 Oct 18 15:42:13.449352 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1958/3904] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:42:13.450503 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-94f35efc-9ab2-47a4-9413-abe15127daeb tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:13.451153 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-94f35efc-9ab2-47a4-9413-abe15127daeb tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:13.451615 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-94f35efc-9ab2-47a4-9413-abe15127daeb tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:13.771886 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-94f35efc-9ab2-47a4-9413-abe15127daeb tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7cb4b4f1da48e3908b9aa55e8d4b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c931ca6c2284e2f81c84b35db7192e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:13.780010 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-94f35efc-9ab2-47a4-9413-abe15127daeb tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] 10.222.0.60 "GET /compute/v2.1/servers/169ae6e5-bfce-46d4-a3d3-8878a214e0e4" status: 200 len: 1324 microversion: 2.1 time: 0.364283 Oct 18 15:42:13.799739 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1947/3905] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:13 2022] GET /compute/v2.1/servers/169ae6e5-bfce-46d4-a3d3-8878a214e0e4 => generated 1324 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:42:14.229789 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b0766f6b-3e44-4d3f-9dc7-1542c8de884a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:14.231263 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b0766f6b-3e44-4d3f-9dc7-1542c8de884a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 68a3c952-31f5-42a5-a8b9-698785c5c01f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:14.248063 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b0766f6b-3e44-4d3f-9dc7-1542c8de884a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:14.250168 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b0766f6b-3e44-4d3f-9dc7-1542c8de884a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:14.252738 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b0766f6b-3e44-4d3f-9dc7-1542c8de884a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:14.259400 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b0766f6b-3e44-4d3f-9dc7-1542c8de884a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:14.266282 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b0766f6b-3e44-4d3f-9dc7-1542c8de884a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:14.269024 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b0766f6b-3e44-4d3f-9dc7-1542c8de884a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:14.434015 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0cd6b7e3-ec1b-459d-9c96-f315226cadb2 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:14.435078 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0cd6b7e3-ec1b-459d-9c96-f315226cadb2 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] [instance: 342275a0-eca4-4c88-8c84-7d7bb1febf67] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:14.450498 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0cd6b7e3-ec1b-459d-9c96-f315226cadb2 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:14.454344 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0cd6b7e3-ec1b-459d-9c96-f315226cadb2 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:14.457681 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0cd6b7e3-ec1b-459d-9c96-f315226cadb2 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:14.458829 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0cd6b7e3-ec1b-459d-9c96-f315226cadb2 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:14.459619 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0cd6b7e3-ec1b-459d-9c96-f315226cadb2 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:14.461343 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0cd6b7e3-ec1b-459d-9c96-f315226cadb2 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:14.487827 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:42:14.712240 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b0766f6b-3e44-4d3f-9dc7-1542c8de884a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:14.720339 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b0766f6b-3e44-4d3f-9dc7-1542c8de884a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f" status: 200 len: 1538 microversion: 2.1 time: 0.497142 Oct 18 15:42:14.738002 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1959/3906] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:14 2022] GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f => generated 1538 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:14.809161 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-52165517-f547-4f1a-a7c1-3832e8060f68 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:14.810394 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-52165517-f547-4f1a-a7c1-3832e8060f68 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] [instance: 169ae6e5-bfce-46d4-a3d3-8878a214e0e4] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:14.823820 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52165517-f547-4f1a-a7c1-3832e8060f68 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:14.827651 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52165517-f547-4f1a-a7c1-3832e8060f68 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:14.828503 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52165517-f547-4f1a-a7c1-3832e8060f68 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:14.834615 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52165517-f547-4f1a-a7c1-3832e8060f68 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:14.835757 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52165517-f547-4f1a-a7c1-3832e8060f68 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:14.836417 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52165517-f547-4f1a-a7c1-3832e8060f68 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:14.902490 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0cd6b7e3-ec1b-459d-9c96-f315226cadb2 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1870f65339d43cb88462266db6073b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cd85218f8c40728c12b94cd6e37e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:14.921574 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0cd6b7e3-ec1b-459d-9c96-f315226cadb2 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] 10.222.0.60 "GET /compute/v2.1/servers/342275a0-eca4-4c88-8c84-7d7bb1febf67" status: 200 len: 1528 microversion: 2.1 time: 0.489675 Oct 18 15:42:14.926731 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1948/3907] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:14 2022] GET /compute/v2.1/servers/342275a0-eca4-4c88-8c84-7d7bb1febf67 => generated 1528 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:15.530338 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-41131901-f03a-48aa-b4eb-5f418763a05e req-9f398867-184e-4a3d-8dee-d077de3fb83e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79212b18-bfd6-4a94-9d58-80c535525aa8", "name": "network-vif-plugged", "status": "completed", "tag": "65ddf63c-d787-42eb-bb1d-c107c1fe8b2f"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:42:15.560107 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-41131901-f03a-48aa-b4eb-5f418763a05e req-9f398867-184e-4a3d-8dee-d077de3fb83e service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:15.560912 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-41131901-f03a-48aa-b4eb-5f418763a05e req-9f398867-184e-4a3d-8dee-d077de3fb83e service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:15.561513 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-41131901-f03a-48aa-b4eb-5f418763a05e req-9f398867-184e-4a3d-8dee-d077de3fb83e service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:15.587093 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-41131901-f03a-48aa-b4eb-5f418763a05e req-9f398867-184e-4a3d-8dee-d077de3fb83e service nova] Creating event network-vif-plugged:65ddf63c-d787-42eb-bb1d-c107c1fe8b2f for instance 79212b18-bfd6-4a94-9d58-80c535525aa8 on n-h2-853682-5 Oct 18 15:42:15.605733 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-41131901-f03a-48aa-b4eb-5f418763a05e req-9f398867-184e-4a3d-8dee-d077de3fb83e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073376 Oct 18 15:42:15.617247 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1949/3908] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:42:15.739002 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-52165517-f547-4f1a-a7c1-3832e8060f68 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7cb4b4f1da48e3908b9aa55e8d4b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c931ca6c2284e2f81c84b35db7192e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:15.749474 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-52165517-f547-4f1a-a7c1-3832e8060f68 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] 10.222.0.60 "GET /compute/v2.1/servers/169ae6e5-bfce-46d4-a3d3-8878a214e0e4" status: 200 len: 1324 microversion: 2.1 time: 0.946109 Oct 18 15:42:15.751261 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1dc6b84e-37aa-40a4-8cbd-30a6a2ed9cee tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:15.752544 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1dc6b84e-37aa-40a4-8cbd-30a6a2ed9cee tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 68a3c952-31f5-42a5-a8b9-698785c5c01f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:15.757359 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1960/3909] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:14 2022] GET /compute/v2.1/servers/169ae6e5-bfce-46d4-a3d3-8878a214e0e4 => generated 1324 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:42:15.790943 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1dc6b84e-37aa-40a4-8cbd-30a6a2ed9cee tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:15.791484 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1dc6b84e-37aa-40a4-8cbd-30a6a2ed9cee tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:15.792134 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1dc6b84e-37aa-40a4-8cbd-30a6a2ed9cee tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:15.793701 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1dc6b84e-37aa-40a4-8cbd-30a6a2ed9cee tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:15.795334 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1dc6b84e-37aa-40a4-8cbd-30a6a2ed9cee tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:15.795968 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1dc6b84e-37aa-40a4-8cbd-30a6a2ed9cee tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:15.950290 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c5cf3145-84cc-45c4-ae71-9d307e995d50 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:15.950916 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c5cf3145-84cc-45c4-ae71-9d307e995d50 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] [instance: 342275a0-eca4-4c88-8c84-7d7bb1febf67] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:15.962716 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5cf3145-84cc-45c4-ae71-9d307e995d50 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:15.963453 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5cf3145-84cc-45c4-ae71-9d307e995d50 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:15.964104 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5cf3145-84cc-45c4-ae71-9d307e995d50 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:15.966448 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5cf3145-84cc-45c4-ae71-9d307e995d50 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:15.967158 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5cf3145-84cc-45c4-ae71-9d307e995d50 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:15.986736 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5cf3145-84cc-45c4-ae71-9d307e995d50 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:16.235723 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1dc6b84e-37aa-40a4-8cbd-30a6a2ed9cee tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:16.247905 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1dc6b84e-37aa-40a4-8cbd-30a6a2ed9cee tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f" status: 200 len: 1520 microversion: 2.1 time: 0.501879 Oct 18 15:42:16.266369 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1950/3910] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:15 2022] GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f => generated 1520 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:16.279620 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-dfa65023-a207-49bd-a480-0ae3bb343b20 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:16.281634 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-dfa65023-a207-49bd-a480-0ae3bb343b20 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 68a3c952-31f5-42a5-a8b9-698785c5c01f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:16.291131 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dfa65023-a207-49bd-a480-0ae3bb343b20 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:16.291860 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dfa65023-a207-49bd-a480-0ae3bb343b20 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:16.292413 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dfa65023-a207-49bd-a480-0ae3bb343b20 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:16.293283 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dfa65023-a207-49bd-a480-0ae3bb343b20 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:16.293914 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dfa65023-a207-49bd-a480-0ae3bb343b20 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:16.294457 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dfa65023-a207-49bd-a480-0ae3bb343b20 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:16.341573 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-dfa65023-a207-49bd-a480-0ae3bb343b20 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 68a3c952-31f5-42a5-a8b9-698785c5c01f] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:42:16.504494 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-dfa65023-a207-49bd-a480-0ae3bb343b20 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "DELETE /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f" status: 204 len: 0 microversion: 2.1 time: 0.231694 Oct 18 15:42:16.505742 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1951/3911] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:42:16 2022] DELETE /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:42:16.526771 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-43104c8a-2f7d-443b-b76b-ea8547adf6a7 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:16.529326 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-43104c8a-2f7d-443b-b76b-ea8547adf6a7 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 68a3c952-31f5-42a5-a8b9-698785c5c01f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:16.550269 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-43104c8a-2f7d-443b-b76b-ea8547adf6a7 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:16.551793 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-43104c8a-2f7d-443b-b76b-ea8547adf6a7 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:16.552540 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-43104c8a-2f7d-443b-b76b-ea8547adf6a7 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:16.554294 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-43104c8a-2f7d-443b-b76b-ea8547adf6a7 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:16.554926 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-43104c8a-2f7d-443b-b76b-ea8547adf6a7 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:16.555615 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-43104c8a-2f7d-443b-b76b-ea8547adf6a7 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:16.694957 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c5cf3145-84cc-45c4-ae71-9d307e995d50 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1870f65339d43cb88462266db6073b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cd85218f8c40728c12b94cd6e37e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:16.708064 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c5cf3145-84cc-45c4-ae71-9d307e995d50 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] 10.222.0.60 "GET /compute/v2.1/servers/342275a0-eca4-4c88-8c84-7d7bb1febf67" status: 200 len: 1528 microversion: 2.1 time: 0.762059 Oct 18 15:42:16.711312 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1961/3912] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:15 2022] GET /compute/v2.1/servers/342275a0-eca4-4c88-8c84-7d7bb1febf67 => generated 1528 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:16.716111 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-d18cec4d-29ae-48da-95ad-ce4933cde714 req-2a311dbc-d08c-4fda-8b92-45ef958be7c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "342275a0-eca4-4c88-8c84-7d7bb1febf67", "name": "network-vif-deleted", "tag": "08d99f3b-f981-4a5d-b4a1-2a2110b34c6f"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:42:16.755545 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d18cec4d-29ae-48da-95ad-ce4933cde714 req-2a311dbc-d08c-4fda-8b92-45ef958be7c3 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:16.756258 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d18cec4d-29ae-48da-95ad-ce4933cde714 req-2a311dbc-d08c-4fda-8b92-45ef958be7c3 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:16.770018 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d18cec4d-29ae-48da-95ad-ce4933cde714 req-2a311dbc-d08c-4fda-8b92-45ef958be7c3 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:16.810946 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-d18cec4d-29ae-48da-95ad-ce4933cde714 req-2a311dbc-d08c-4fda-8b92-45ef958be7c3 service nova] Creating event network-vif-deleted:08d99f3b-f981-4a5d-b4a1-2a2110b34c6f for instance 342275a0-eca4-4c88-8c84-7d7bb1febf67 on n-h2-853682-5 Oct 18 15:42:16.825123 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-d18cec4d-29ae-48da-95ad-ce4933cde714 req-2a311dbc-d08c-4fda-8b92-45ef958be7c3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112365 Oct 18 15:42:16.826088 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1962/3913] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:42:16.838853 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-36f0d0d9-3ed1-48aa-bd36-086f1d492f29 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:16.840693 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-36f0d0d9-3ed1-48aa-bd36-086f1d492f29 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] [instance: 169ae6e5-bfce-46d4-a3d3-8878a214e0e4] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:16.848859 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36f0d0d9-3ed1-48aa-bd36-086f1d492f29 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:16.849715 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36f0d0d9-3ed1-48aa-bd36-086f1d492f29 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:16.850419 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36f0d0d9-3ed1-48aa-bd36-086f1d492f29 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:16.851542 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36f0d0d9-3ed1-48aa-bd36-086f1d492f29 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:16.852375 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36f0d0d9-3ed1-48aa-bd36-086f1d492f29 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:16.853198 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36f0d0d9-3ed1-48aa-bd36-086f1d492f29 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:16.983195 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-43104c8a-2f7d-443b-b76b-ea8547adf6a7 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:16.994176 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-43104c8a-2f7d-443b-b76b-ea8547adf6a7 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f" status: 200 len: 1526 microversion: 2.1 time: 0.483760 Oct 18 15:42:16.994768 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1952/3914] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:16 2022] GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f => generated 1526 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:17.335078 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-36f0d0d9-3ed1-48aa-bd36-086f1d492f29 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7cb4b4f1da48e3908b9aa55e8d4b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c931ca6c2284e2f81c84b35db7192e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:17.345285 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-36f0d0d9-3ed1-48aa-bd36-086f1d492f29 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] 10.222.0.60 "GET /compute/v2.1/servers/169ae6e5-bfce-46d4-a3d3-8878a214e0e4" status: 200 len: 1324 microversion: 2.1 time: 0.517255 Oct 18 15:42:17.349707 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1963/3915] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:16 2022] GET /compute/v2.1/servers/169ae6e5-bfce-46d4-a3d3-8878a214e0e4 => generated 1324 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:17.734414 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-06a8f01b-a823-4e78-bcaf-0673f7ac53ed tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:17.735398 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-06a8f01b-a823-4e78-bcaf-0673f7ac53ed tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] [instance: 342275a0-eca4-4c88-8c84-7d7bb1febf67] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:17.750504 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-06a8f01b-a823-4e78-bcaf-0673f7ac53ed tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:17.751329 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-06a8f01b-a823-4e78-bcaf-0673f7ac53ed tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:17.753195 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-06a8f01b-a823-4e78-bcaf-0673f7ac53ed tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:17.755024 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-06a8f01b-a823-4e78-bcaf-0673f7ac53ed tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:17.755801 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-06a8f01b-a823-4e78-bcaf-0673f7ac53ed tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:17.763171 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-06a8f01b-a823-4e78-bcaf-0673f7ac53ed tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:17.824999 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-06a8f01b-a823-4e78-bcaf-0673f7ac53ed tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:17.831210 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-06a8f01b-a823-4e78-bcaf-0673f7ac53ed tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:17.833304 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-06a8f01b-a823-4e78-bcaf-0673f7ac53ed tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:17.839446 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-06a8f01b-a823-4e78-bcaf-0673f7ac53ed tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lazy-loading 'fault' on Instance uuid 342275a0-eca4-4c88-8c84-7d7bb1febf67 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:42:17.971321 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-06a8f01b-a823-4e78-bcaf-0673f7ac53ed tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1870f65339d43cb88462266db6073b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cd85218f8c40728c12b94cd6e37e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:17.979206 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-06a8f01b-a823-4e78-bcaf-0673f7ac53ed tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] 10.222.0.60 "GET /compute/v2.1/servers/342275a0-eca4-4c88-8c84-7d7bb1febf67" status: 200 len: 1315 microversion: 2.1 time: 0.249295 Oct 18 15:42:17.995961 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1953/3916] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:17 2022] GET /compute/v2.1/servers/342275a0-eca4-4c88-8c84-7d7bb1febf67 => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:18.019889 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-03e48524-beb9-4385-9daf-5e2736e36fa1 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:18.020913 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-03e48524-beb9-4385-9daf-5e2736e36fa1 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 68a3c952-31f5-42a5-a8b9-698785c5c01f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:18.038497 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03e48524-beb9-4385-9daf-5e2736e36fa1 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:18.041881 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03e48524-beb9-4385-9daf-5e2736e36fa1 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:18.045180 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03e48524-beb9-4385-9daf-5e2736e36fa1 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:18.047513 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03e48524-beb9-4385-9daf-5e2736e36fa1 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:18.051723 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03e48524-beb9-4385-9daf-5e2736e36fa1 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:18.052421 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03e48524-beb9-4385-9daf-5e2736e36fa1 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:18.248075 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-03e48524-beb9-4385-9daf-5e2736e36fa1 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:18.261596 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-03e48524-beb9-4385-9daf-5e2736e36fa1 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f" status: 200 len: 1526 microversion: 2.1 time: 0.247418 Oct 18 15:42:18.262222 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1964/3917] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:18 2022] GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f => generated 1526 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:18.372757 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b42a2826-3026-4012-b5d4-e5962e876acf tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:18.374028 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b42a2826-3026-4012-b5d4-e5962e876acf tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] [instance: 169ae6e5-bfce-46d4-a3d3-8878a214e0e4] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:18.382221 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b42a2826-3026-4012-b5d4-e5962e876acf tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:18.383304 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b42a2826-3026-4012-b5d4-e5962e876acf tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:18.385059 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b42a2826-3026-4012-b5d4-e5962e876acf tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:18.387198 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b42a2826-3026-4012-b5d4-e5962e876acf tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:18.388289 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b42a2826-3026-4012-b5d4-e5962e876acf tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:18.389129 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b42a2826-3026-4012-b5d4-e5962e876acf tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:18.570539 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b42a2826-3026-4012-b5d4-e5962e876acf tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7cb4b4f1da48e3908b9aa55e8d4b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c931ca6c2284e2f81c84b35db7192e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:18.588628 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b42a2826-3026-4012-b5d4-e5962e876acf tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] 10.222.0.60 "GET /compute/v2.1/servers/169ae6e5-bfce-46d4-a3d3-8878a214e0e4" status: 200 len: 1324 microversion: 2.1 time: 0.211272 Oct 18 15:42:18.589762 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1954/3918] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:18 2022] GET /compute/v2.1/servers/169ae6e5-bfce-46d4-a3d3-8878a214e0e4 => generated 1324 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:18.852762 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-ac77e527-3789-467c-8a65-1707e8b126a3 req-2b293594-9296-4cea-b7c2-cf06263db22b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "169ae6e5-bfce-46d4-a3d3-8878a214e0e4", "tag": "0ef129dc-f174-4622-be33-0d97cf2b314b"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:42:18.864301 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ac77e527-3789-467c-8a65-1707e8b126a3 req-2b293594-9296-4cea-b7c2-cf06263db22b service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:18.864779 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ac77e527-3789-467c-8a65-1707e8b126a3 req-2b293594-9296-4cea-b7c2-cf06263db22b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:18.865252 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ac77e527-3789-467c-8a65-1707e8b126a3 req-2b293594-9296-4cea-b7c2-cf06263db22b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:18.877955 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-ac77e527-3789-467c-8a65-1707e8b126a3 req-2b293594-9296-4cea-b7c2-cf06263db22b service nova] Creating event network-changed:0ef129dc-f174-4622-be33-0d97cf2b314b for instance 169ae6e5-bfce-46d4-a3d3-8878a214e0e4 on n-h2-853682-5 Oct 18 15:42:18.883212 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-ac77e527-3789-467c-8a65-1707e8b126a3 req-2b293594-9296-4cea-b7c2-cf06263db22b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034345 Oct 18 15:42:18.884013 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1965/3919] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:42:19.003810 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f6b92f18-9d0d-48e7-8aba-b6a7108925e3 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:19.005364 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f6b92f18-9d0d-48e7-8aba-b6a7108925e3 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] [instance: 342275a0-eca4-4c88-8c84-7d7bb1febf67] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:19.017806 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f6b92f18-9d0d-48e7-8aba-b6a7108925e3 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:19.019022 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f6b92f18-9d0d-48e7-8aba-b6a7108925e3 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:19.020436 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f6b92f18-9d0d-48e7-8aba-b6a7108925e3 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:19.022904 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f6b92f18-9d0d-48e7-8aba-b6a7108925e3 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:19.024852 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f6b92f18-9d0d-48e7-8aba-b6a7108925e3 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:19.025531 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f6b92f18-9d0d-48e7-8aba-b6a7108925e3 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:19.045421 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-f6b92f18-9d0d-48e7-8aba-b6a7108925e3 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] HTTP exception thrown: Instance 342275a0-eca4-4c88-8c84-7d7bb1febf67 could not be found. Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f6b92f18-9d0d-48e7-8aba-b6a7108925e3 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Request method failure captured: Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/342275a0-eca4-4c88-8c84-7d7bb1febf67 HTTP/1.1 Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsk9dFxwuRKHR2Utl4LEmVwtyFcaJQ7i_-pacs3Dm9QeEEnx6ck0ZwGlb0fKGQ6S05hmbGiufKb7tTXKrEWbUMK3Py53KUsQfwdM516C8EWnLUgXTm2ns4vi0h0ZO9asJnCFT0bRf6_PhB0mrRQap_gHGVLP8DW6hJiwfdDAbEc03Gw Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 88cd85218f8c40728c12b94cd6e37e10 Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-31129279 Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/88cd85218f8c40728c12b94cd6e37e10"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/88cd85218f8c40728c12b94cd6e37e10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/88cd85218f8c40728c12b94cd6e37e10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_88cd85218f8c40728c12b94cd6e37e10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-31129279 Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 88cd85218f8c40728c12b94cd6e37e10 Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-31129279 Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-InstanceActionsNegativeTestJSON-31129279-project Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: a1870f65339d43cb88462266db6073b8 Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-31129279-project Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 342275a0-eca4-4c88-8c84-7d7bb1febf67 could not be found. Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '342275a0-eca4-4c88-8c84-7d7bb1febf67'} Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 342275a0-eca4-4c88-8c84-7d7bb1febf67 could not be found. Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 342275a0-eca4-4c88-8c84-7d7bb1febf67 could not be found. Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:42:19.051502 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:42:19.058831 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:42:19.058831 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:42:19.058831 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:42:19.058831 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:42:19.058831 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:42:19.058831 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:42:19.058831 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 342275a0-eca4-4c88-8c84-7d7bb1febf67 could not be found. Oct 18 15:42:19.058831 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:42:19.062031 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f6b92f18-9d0d-48e7-8aba-b6a7108925e3 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] Returning 404 to user: Instance 342275a0-eca4-4c88-8c84-7d7bb1febf67 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:42:19.063120 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f6b92f18-9d0d-48e7-8aba-b6a7108925e3 tempest-InstanceActionsNegativeTestJSON-31129279 tempest-InstanceActionsNegativeTestJSON-31129279-project] 10.222.0.60 "GET /compute/v2.1/servers/342275a0-eca4-4c88-8c84-7d7bb1febf67" status: 404 len: 111 microversion: 2.1 time: 0.065369 Oct 18 15:42:19.067341 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1955/3920] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:18 2022] GET /compute/v2.1/servers/342275a0-eca4-4c88-8c84-7d7bb1febf67 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:42:19.290696 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d35d520c-825d-43cd-aa86-5a6f7d32dffa tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:19.291400 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d35d520c-825d-43cd-aa86-5a6f7d32dffa tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 68a3c952-31f5-42a5-a8b9-698785c5c01f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:19.302096 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d35d520c-825d-43cd-aa86-5a6f7d32dffa tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:19.302675 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d35d520c-825d-43cd-aa86-5a6f7d32dffa tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:19.303345 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d35d520c-825d-43cd-aa86-5a6f7d32dffa tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:19.305152 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d35d520c-825d-43cd-aa86-5a6f7d32dffa tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:19.305930 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d35d520c-825d-43cd-aa86-5a6f7d32dffa tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:19.306570 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d35d520c-825d-43cd-aa86-5a6f7d32dffa tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:19.520299 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d35d520c-825d-43cd-aa86-5a6f7d32dffa tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:19.537707 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d35d520c-825d-43cd-aa86-5a6f7d32dffa tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f" status: 200 len: 1484 microversion: 2.1 time: 0.250079 Oct 18 15:42:19.541915 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1966/3921] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:19 2022] GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f => generated 1484 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:19.612244 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-22f3c25f-7ed7-4c5d-8e06-36e46f562be4 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:19.612892 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-22f3c25f-7ed7-4c5d-8e06-36e46f562be4 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] [instance: 169ae6e5-bfce-46d4-a3d3-8878a214e0e4] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:19.623968 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-22f3c25f-7ed7-4c5d-8e06-36e46f562be4 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:19.626970 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-22f3c25f-7ed7-4c5d-8e06-36e46f562be4 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:19.628622 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-22f3c25f-7ed7-4c5d-8e06-36e46f562be4 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:19.629597 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-22f3c25f-7ed7-4c5d-8e06-36e46f562be4 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:19.635344 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-22f3c25f-7ed7-4c5d-8e06-36e46f562be4 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:19.636015 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-22f3c25f-7ed7-4c5d-8e06-36e46f562be4 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:19.735754 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-77b4d3d6-619f-47c0-8d37-9ad58e56092a req-50f287b7-09ba-44cd-bf8d-230a59ff0781 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68a3c952-31f5-42a5-a8b9-698785c5c01f", "name": "network-vif-deleted", "tag": "3f868e1b-cc07-458b-a0b9-b89c7f817858"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:42:19.749551 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-77b4d3d6-619f-47c0-8d37-9ad58e56092a req-50f287b7-09ba-44cd-bf8d-230a59ff0781 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:19.750242 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-77b4d3d6-619f-47c0-8d37-9ad58e56092a req-50f287b7-09ba-44cd-bf8d-230a59ff0781 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:19.751385 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-77b4d3d6-619f-47c0-8d37-9ad58e56092a req-50f287b7-09ba-44cd-bf8d-230a59ff0781 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:19.769041 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:42:19.780473 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-77b4d3d6-619f-47c0-8d37-9ad58e56092a req-50f287b7-09ba-44cd-bf8d-230a59ff0781 service nova] Creating event network-vif-deleted:3f868e1b-cc07-458b-a0b9-b89c7f817858 for instance 68a3c952-31f5-42a5-a8b9-698785c5c01f on n-h1-853682-5 Oct 18 15:42:19.790206 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-77b4d3d6-619f-47c0-8d37-9ad58e56092a req-50f287b7-09ba-44cd-bf8d-230a59ff0781 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058820 Oct 18 15:42:19.794416 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1967/3922] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:42:19.973344 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=8 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:42:20.294204 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-22f3c25f-7ed7-4c5d-8e06-36e46f562be4 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7cb4b4f1da48e3908b9aa55e8d4b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c931ca6c2284e2f81c84b35db7192e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:20.305597 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-22f3c25f-7ed7-4c5d-8e06-36e46f562be4 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] 10.222.0.60 "GET /compute/v2.1/servers/169ae6e5-bfce-46d4-a3d3-8878a214e0e4" status: 200 len: 1324 microversion: 2.1 time: 0.696691 Oct 18 15:42:20.351825 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1956/3923] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:19 2022] GET /compute/v2.1/servers/169ae6e5-bfce-46d4-a3d3-8878a214e0e4 => generated 1324 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:20.572600 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-09b56c8f-ce2e-401a-9c32-7372cf35cbec tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:20.574019 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-09b56c8f-ce2e-401a-9c32-7372cf35cbec tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 68a3c952-31f5-42a5-a8b9-698785c5c01f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:20.587882 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09b56c8f-ce2e-401a-9c32-7372cf35cbec tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:20.591276 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09b56c8f-ce2e-401a-9c32-7372cf35cbec tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:20.591984 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09b56c8f-ce2e-401a-9c32-7372cf35cbec tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:20.592953 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09b56c8f-ce2e-401a-9c32-7372cf35cbec tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:20.593613 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09b56c8f-ce2e-401a-9c32-7372cf35cbec tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:20.596619 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09b56c8f-ce2e-401a-9c32-7372cf35cbec tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:20.672062 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09b56c8f-ce2e-401a-9c32-7372cf35cbec tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:20.674885 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09b56c8f-ce2e-401a-9c32-7372cf35cbec tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:20.678391 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09b56c8f-ce2e-401a-9c32-7372cf35cbec tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:20.697797 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-09b56c8f-ce2e-401a-9c32-7372cf35cbec tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lazy-loading 'fault' on Instance uuid 68a3c952-31f5-42a5-a8b9-698785c5c01f {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:42:20.787954 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-09b56c8f-ce2e-401a-9c32-7372cf35cbec tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:20.795988 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-09b56c8f-ce2e-401a-9c32-7372cf35cbec tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f" status: 200 len: 1314 microversion: 2.1 time: 0.230973 Oct 18 15:42:20.800742 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1968/3924] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:20 2022] GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:21.335254 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-01010fb5-9744-44ff-80da-871feb1c7525 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:21.337463 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-01010fb5-9744-44ff-80da-871feb1c7525 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] [instance: 169ae6e5-bfce-46d4-a3d3-8878a214e0e4] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:21.346251 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-01010fb5-9744-44ff-80da-871feb1c7525 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:21.348713 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-01010fb5-9744-44ff-80da-871feb1c7525 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:21.351257 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-01010fb5-9744-44ff-80da-871feb1c7525 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:21.352285 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-01010fb5-9744-44ff-80da-871feb1c7525 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:21.353656 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-01010fb5-9744-44ff-80da-871feb1c7525 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:21.357847 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-01010fb5-9744-44ff-80da-871feb1c7525 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:21.823915 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dea78aa7-eaf0-46ea-9cff-4752055a56f8 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:21.824546 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dea78aa7-eaf0-46ea-9cff-4752055a56f8 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 68a3c952-31f5-42a5-a8b9-698785c5c01f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:21.837959 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dea78aa7-eaf0-46ea-9cff-4752055a56f8 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:21.838458 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dea78aa7-eaf0-46ea-9cff-4752055a56f8 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:21.838896 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dea78aa7-eaf0-46ea-9cff-4752055a56f8 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:21.850120 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dea78aa7-eaf0-46ea-9cff-4752055a56f8 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:21.853053 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dea78aa7-eaf0-46ea-9cff-4752055a56f8 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:21.853053 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dea78aa7-eaf0-46ea-9cff-4752055a56f8 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:21.866208 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-dea78aa7-eaf0-46ea-9cff-4752055a56f8 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] HTTP exception thrown: Instance 68a3c952-31f5-42a5-a8b9-698785c5c01f could not be found. Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dea78aa7-eaf0-46ea-9cff-4752055a56f8 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Request method failure captured: Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f HTTP/1.1 Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTskwmwAKtfJxRtfmFCexrRganirG5QxP3o41FeBWoidL-rUG8x8GL16JQLrOge4bbPRk8j9ZKsrTawjOywht8BMU6xpPPkLcF_Tvsxd_4ddRByYVxCCr1OvdQRZ3S_CoRUmp2shw5GPVxRCyE1gWYjx_sxIK_OIs6piyKG80707p5j0 Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 38b4cd4b884c4456866052a4969dc138 Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1849835039 Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/38b4cd4b884c4456866052a4969dc138"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/38b4cd4b884c4456866052a4969dc138"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/38b4cd4b884c4456866052a4969dc138"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_38b4cd4b884c4456866052a4969dc138"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1849835039 Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 38b4cd4b884c4456866052a4969dc138 Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1849835039 Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ImagesOneServerNegativeTestJSON-1849835039-project Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: a2e9e9bbf3d94d77a236e43f019d316a Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1849835039-project Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 68a3c952-31f5-42a5-a8b9-698785c5c01f could not be found. Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '68a3c952-31f5-42a5-a8b9-698785c5c01f'} Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68a3c952-31f5-42a5-a8b9-698785c5c01f could not be found. Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68a3c952-31f5-42a5-a8b9-698785c5c01f could not be found. Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:42:21.867882 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:42:21.879803 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:42:21.879803 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:42:21.879803 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:42:21.879803 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:42:21.879803 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:42:21.879803 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:42:21.879803 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68a3c952-31f5-42a5-a8b9-698785c5c01f could not be found. Oct 18 15:42:21.879803 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:42:21.879803 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dea78aa7-eaf0-46ea-9cff-4752055a56f8 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Returning 404 to user: Instance 68a3c952-31f5-42a5-a8b9-698785c5c01f could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:42:21.879803 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dea78aa7-eaf0-46ea-9cff-4752055a56f8 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f" status: 404 len: 111 microversion: 2.1 time: 0.049361 Oct 18 15:42:21.879803 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1969/3925] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:21 2022] GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:42:21.881336 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cf638aef-aed7-4794-871b-cf2354f75784 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Action: 'create', calling method: .version_select at 0x7f7c3d0b9e50>, body: {"keypair": {"name": "tempest-keypair-1602625935", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK61Gg02XGbbq3YnH/sS93Ok4vYP2dqJYPHwwOBvVd49nQWn2Losj8e0uOkM34O/VdOlN2sFFL8QlGLKC3Qw9s3CTxjznE1Qu73WGYR5oTLEc2Gm+5GQBQf20Vbu0lNScw=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:42:21.906723 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-cf638aef-aed7-4794-871b-cf2354f75784 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Getting quotas for project 38b4cd4b884c4456866052a4969dc138. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:42:21.915148 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-cf638aef-aed7-4794-871b-cf2354f75784 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Getting quotas for user a2e9e9bbf3d94d77a236e43f019d316a and project 38b4cd4b884c4456866052a4969dc138. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:42:21.956795 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cf638aef-aed7-4794-871b-cf2354f75784 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.079195 Oct 18 15:42:21.962412 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1970/3926] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Oct 18 15:42:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:42:22.101772 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-01010fb5-9744-44ff-80da-871feb1c7525 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7cb4b4f1da48e3908b9aa55e8d4b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c931ca6c2284e2f81c84b35db7192e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:22.113437 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-01010fb5-9744-44ff-80da-871feb1c7525 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] 10.222.0.60 "GET /compute/v2.1/servers/169ae6e5-bfce-46d4-a3d3-8878a214e0e4" status: 200 len: 1324 microversion: 2.1 time: 0.783228 Oct 18 15:42:22.131415 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1957/3927] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:21 2022] GET /compute/v2.1/servers/169ae6e5-bfce-46d4-a3d3-8878a214e0e4 => generated 1324 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:23.140857 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b258b865-2fa2-40f0-a53e-4db470f3e1a6 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:23.142647 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b258b865-2fa2-40f0-a53e-4db470f3e1a6 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] [instance: 169ae6e5-bfce-46d4-a3d3-8878a214e0e4] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:23.156659 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b258b865-2fa2-40f0-a53e-4db470f3e1a6 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:23.159562 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b258b865-2fa2-40f0-a53e-4db470f3e1a6 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:23.160433 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b258b865-2fa2-40f0-a53e-4db470f3e1a6 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:23.163010 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b258b865-2fa2-40f0-a53e-4db470f3e1a6 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:23.164159 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b258b865-2fa2-40f0-a53e-4db470f3e1a6 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:23.165345 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b258b865-2fa2-40f0-a53e-4db470f3e1a6 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:23.565636 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b258b865-2fa2-40f0-a53e-4db470f3e1a6 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7cb4b4f1da48e3908b9aa55e8d4b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c931ca6c2284e2f81c84b35db7192e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:23.585004 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b258b865-2fa2-40f0-a53e-4db470f3e1a6 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] 10.222.0.60 "GET /compute/v2.1/servers/169ae6e5-bfce-46d4-a3d3-8878a214e0e4" status: 200 len: 1324 microversion: 2.1 time: 0.447834 Oct 18 15:42:23.586015 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1971/3928] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:23 2022] GET /compute/v2.1/servers/169ae6e5-bfce-46d4-a3d3-8878a214e0e4 => generated 1324 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:24.418488 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-336d7c63-15af-405a-96c0-431d4eace95d req-9e492e89-f81d-4ea1-833f-554b1b44b6b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "169ae6e5-bfce-46d4-a3d3-8878a214e0e4", "name": "network-vif-plugged", "status": "completed", "tag": "0ef129dc-f174-4622-be33-0d97cf2b314b"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:42:24.442701 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-336d7c63-15af-405a-96c0-431d4eace95d req-9e492e89-f81d-4ea1-833f-554b1b44b6b0 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:24.443194 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-336d7c63-15af-405a-96c0-431d4eace95d req-9e492e89-f81d-4ea1-833f-554b1b44b6b0 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:24.443635 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-336d7c63-15af-405a-96c0-431d4eace95d req-9e492e89-f81d-4ea1-833f-554b1b44b6b0 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:24.472242 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-336d7c63-15af-405a-96c0-431d4eace95d req-9e492e89-f81d-4ea1-833f-554b1b44b6b0 service nova] Creating event network-vif-plugged:0ef129dc-f174-4622-be33-0d97cf2b314b for instance 169ae6e5-bfce-46d4-a3d3-8878a214e0e4 on n-h2-853682-5 Oct 18 15:42:24.483091 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-336d7c63-15af-405a-96c0-431d4eace95d req-9e492e89-f81d-4ea1-833f-554b1b44b6b0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065494 Oct 18 15:42:24.485262 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1958/3929] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:42:24.612183 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-36cb69ce-0432-41e3-8fd2-ee02935a40b9 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:24.613035 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-36cb69ce-0432-41e3-8fd2-ee02935a40b9 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] [instance: 169ae6e5-bfce-46d4-a3d3-8878a214e0e4] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:24.627174 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36cb69ce-0432-41e3-8fd2-ee02935a40b9 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:24.630378 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36cb69ce-0432-41e3-8fd2-ee02935a40b9 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:24.630970 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36cb69ce-0432-41e3-8fd2-ee02935a40b9 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:24.631969 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36cb69ce-0432-41e3-8fd2-ee02935a40b9 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:24.637481 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36cb69ce-0432-41e3-8fd2-ee02935a40b9 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:24.638821 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36cb69ce-0432-41e3-8fd2-ee02935a40b9 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:25.092680 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-36cb69ce-0432-41e3-8fd2-ee02935a40b9 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7cb4b4f1da48e3908b9aa55e8d4b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c931ca6c2284e2f81c84b35db7192e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:25.106186 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-36cb69ce-0432-41e3-8fd2-ee02935a40b9 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] 10.222.0.60 "GET /compute/v2.1/servers/169ae6e5-bfce-46d4-a3d3-8878a214e0e4" status: 200 len: 1324 microversion: 2.1 time: 0.498730 Oct 18 15:42:25.107690 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1972/3930] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:24 2022] GET /compute/v2.1/servers/169ae6e5-bfce-46d4-a3d3-8878a214e0e4 => generated 1324 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:26.137099 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-66312149-1717-4d0a-b485-5ebd5099b750 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:26.137881 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-66312149-1717-4d0a-b485-5ebd5099b750 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] [instance: 169ae6e5-bfce-46d4-a3d3-8878a214e0e4] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:26.157708 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-66312149-1717-4d0a-b485-5ebd5099b750 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:26.163605 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-66312149-1717-4d0a-b485-5ebd5099b750 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:26.164138 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-66312149-1717-4d0a-b485-5ebd5099b750 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:26.164931 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-66312149-1717-4d0a-b485-5ebd5099b750 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:26.165414 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-66312149-1717-4d0a-b485-5ebd5099b750 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:26.169465 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-66312149-1717-4d0a-b485-5ebd5099b750 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:26.327907 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-73eb63c5-587d-40e4-a0a7-72ed0b326568 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1274212318", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:42:26.452616 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-73eb63c5-587d-40e4-a0a7-72ed0b326568 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] validate_networks() for [('271f146d-5c28-4347-b10b-09aca0da6649', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:42:26.904133 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-66312149-1717-4d0a-b485-5ebd5099b750 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7cb4b4f1da48e3908b9aa55e8d4b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c931ca6c2284e2f81c84b35db7192e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:26.925294 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-66312149-1717-4d0a-b485-5ebd5099b750 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] 10.222.0.60 "GET /compute/v2.1/servers/169ae6e5-bfce-46d4-a3d3-8878a214e0e4" status: 200 len: 1521 microversion: 2.1 time: 0.784288 Oct 18 15:42:26.926155 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1959/3931] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:26 2022] GET /compute/v2.1/servers/169ae6e5-bfce-46d4-a3d3-8878a214e0e4 => generated 1521 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:26.956059 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-91c17a3e-af59-436b-ad7d-a89101233529 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:26.956655 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-91c17a3e-af59-436b-ad7d-a89101233529 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] [instance: 169ae6e5-bfce-46d4-a3d3-8878a214e0e4] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:26.966284 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-91c17a3e-af59-436b-ad7d-a89101233529 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:26.969848 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-91c17a3e-af59-436b-ad7d-a89101233529 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:26.970635 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-91c17a3e-af59-436b-ad7d-a89101233529 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:26.971633 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-91c17a3e-af59-436b-ad7d-a89101233529 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:26.981696 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-91c17a3e-af59-436b-ad7d-a89101233529 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:26.982531 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-91c17a3e-af59-436b-ad7d-a89101233529 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:27.018199 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-91c17a3e-af59-436b-ad7d-a89101233529 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] HTTP exception thrown: Instance is not a member of specified network Oct 18 15:42:27.034129 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-91c17a3e-af59-436b-ad7d-a89101233529 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Request method failure captured: Oct 18 15:42:27.034129 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/169ae6e5-bfce-46d4-a3d3-8878a214e0e4/ips/invalid HTTP/1.1 Oct 18 15:42:27.034129 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:42:27.034129 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:42:27.034129 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:42:27.034129 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:42:27.034129 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:42:27.034129 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:42:27.034129 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:42:27.034129 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:42:27.034129 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTslPqPxeqxGjDkrJBgBq3iUWima-iLVwI7XYU2YdUF72pg6HOt8i20yUjfQeNopo6c-tQAjBP5_c45UcoYF-wYFb4fjdm2kyNqz_j6vGLPL_Jkk7wajuv6vh-IOfcxV_e5bUNYyjhfG030VUO9b2GgkVNPBPQdIi6aMg8HHNBAnHs7Y Oct 18 15:42:27.034129 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:42:27.034129 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:42:27.034129 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:42:27.034129 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:42:27.034129 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:42:27.034129 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:42:27.034129 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 4c931ca6c2284e2f81c84b35db7192e7 Oct 18 15:42:27.034129 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-2098401334 Oct 18 15:42:27.034129 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:42:27.034129 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:42:27.034129 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4c931ca6c2284e2f81c84b35db7192e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4c931ca6c2284e2f81c84b35db7192e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4c931ca6c2284e2f81c84b35db7192e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4c931ca6c2284e2f81c84b35db7192e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:42:27.034129 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-2098401334 Oct 18 15:42:27.034129 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 4c931ca6c2284e2f81c84b35db7192e7 Oct 18 15:42:27.034129 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-2098401334 Oct 18 15:42:27.034129 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServerAddressesNegativeTestJSON-2098401334-project Oct 18 15:42:27.034129 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:42:27.034129 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:42:27.034129 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: ea7cb4b4f1da48e3908b9aa55e8d4b70 Oct 18 15:42:27.034129 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-2098401334-project Oct 18 15:42:27.034129 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:42:27.034129 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance is not a member of specified network Oct 18 15:42:27.034129 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'server_id': '169ae6e5-bfce-46d4-a3d3-8878a214e0e4', 'id': 'invalid'} Oct 18 15:42:27.034129 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:42:27.034129 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:42:27.034129 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:42:27.034129 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:42:27.034129 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:42:27.034129 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:42:27.034129 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:42:27.034129 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:42:27.034129 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 18 15:42:27.034129 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 18 15:42:27.034129 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 18 15:42:27.034129 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:42:27.034129 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:42:27.034129 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:42:27.034129 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:42:27.034129 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:42:27.034129 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:42:27.034129 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:42:27.034129 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:42:27.034129 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 18 15:42:27.034129 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:42:27.041854 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-91c17a3e-af59-436b-ad7d-a89101233529 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Returning 404 to user: Instance is not a member of specified network {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:42:27.041854 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-91c17a3e-af59-436b-ad7d-a89101233529 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] 10.222.0.60 "GET /compute/v2.1/servers/169ae6e5-bfce-46d4-a3d3-8878a214e0e4/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.083922 Oct 18 15:42:27.041854 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1960/3932] 10.222.0.60 () {58 vars in 1272 bytes} [Tue Oct 18 15:42:26 2022] GET /compute/v2.1/servers/169ae6e5-bfce-46d4-a3d3-8878a214e0e4/ips/invalid => generated 91 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 18 15:42:27.048933 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-872f409a-824b-46a9-a8ef-5c7fb6ef921e tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:27.049414 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-872f409a-824b-46a9-a8ef-5c7fb6ef921e tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Failed to fetch instance by id 999 {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 18 15:42:27.050377 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-872f409a-824b-46a9-a8ef-5c7fb6ef921e tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] HTTP exception thrown: Instance 999 could not be found. Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-872f409a-824b-46a9-a8ef-5c7fb6ef921e tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Request method failure captured: Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTslPqPxeqxGjDkrJBgBq3iUWima-iLVwI7XYU2YdUF72pg6HOt8i20yUjfQeNopo6c-tQAjBP5_c45UcoYF-wYFb4fjdm2kyNqz_j6vGLPL_Jkk7wajuv6vh-IOfcxV_e5bUNYyjhfG030VUO9b2GgkVNPBPQdIi6aMg8HHNBAnHs7Y Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 4c931ca6c2284e2f81c84b35db7192e7 Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-2098401334 Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4c931ca6c2284e2f81c84b35db7192e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4c931ca6c2284e2f81c84b35db7192e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4c931ca6c2284e2f81c84b35db7192e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4c931ca6c2284e2f81c84b35db7192e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-2098401334 Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 4c931ca6c2284e2f81c84b35db7192e7 Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-2098401334 Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServerAddressesNegativeTestJSON-2098401334-project Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: ea7cb4b4f1da48e3908b9aa55e8d4b70 Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-2098401334-project Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 999 could not be found. Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'server_id': '999'} Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 18 15:42:27.054985 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:42:27.062731 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-872f409a-824b-46a9-a8ef-5c7fb6ef921e tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Returning 404 to user: Instance 999 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:42:27.068889 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-872f409a-824b-46a9-a8ef-5c7fb6ef921e tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] 10.222.0.60 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.024680 Oct 18 15:42:27.069825 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1961/3933] 10.222.0.60 () {58 vars in 1149 bytes} [Tue Oct 18 15:42:27 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 18 15:42:27.079618 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-04bdb74b-e051-4819-9ecd-2fcc2be576d5 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:27.080447 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-04bdb74b-e051-4819-9ecd-2fcc2be576d5 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] [instance: 169ae6e5-bfce-46d4-a3d3-8878a214e0e4] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:27.103063 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-04bdb74b-e051-4819-9ecd-2fcc2be576d5 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:27.108010 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-04bdb74b-e051-4819-9ecd-2fcc2be576d5 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:27.108643 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-04bdb74b-e051-4819-9ecd-2fcc2be576d5 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:27.112549 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-04bdb74b-e051-4819-9ecd-2fcc2be576d5 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:27.112912 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-04bdb74b-e051-4819-9ecd-2fcc2be576d5 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:27.147825 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-04bdb74b-e051-4819-9ecd-2fcc2be576d5 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:27.202331 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-04bdb74b-e051-4819-9ecd-2fcc2be576d5 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] [instance: 169ae6e5-bfce-46d4-a3d3-8878a214e0e4] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:42:27.349583 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-04bdb74b-e051-4819-9ecd-2fcc2be576d5 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] 10.222.0.60 "DELETE /compute/v2.1/servers/169ae6e5-bfce-46d4-a3d3-8878a214e0e4" status: 204 len: 0 microversion: 2.1 time: 0.273596 Oct 18 15:42:27.350197 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1962/3934] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:42:27 2022] DELETE /compute/v2.1/servers/169ae6e5-bfce-46d4-a3d3-8878a214e0e4 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 15:42:27.362492 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e637363b-0827-4cd4-bd98-aa75365a2662 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:27.363555 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e637363b-0827-4cd4-bd98-aa75365a2662 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] [instance: 169ae6e5-bfce-46d4-a3d3-8878a214e0e4] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:27.371939 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e637363b-0827-4cd4-bd98-aa75365a2662 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:27.372645 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e637363b-0827-4cd4-bd98-aa75365a2662 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:27.373134 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e637363b-0827-4cd4-bd98-aa75365a2662 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:27.373912 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e637363b-0827-4cd4-bd98-aa75365a2662 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:27.374819 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e637363b-0827-4cd4-bd98-aa75365a2662 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:27.375070 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e637363b-0827-4cd4-bd98-aa75365a2662 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:27.765415 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e637363b-0827-4cd4-bd98-aa75365a2662 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7cb4b4f1da48e3908b9aa55e8d4b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c931ca6c2284e2f81c84b35db7192e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:27.805943 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e637363b-0827-4cd4-bd98-aa75365a2662 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] 10.222.0.60 "GET /compute/v2.1/servers/169ae6e5-bfce-46d4-a3d3-8878a214e0e4" status: 200 len: 1527 microversion: 2.1 time: 0.450078 Oct 18 15:42:27.830458 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1963/3935] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:27 2022] GET /compute/v2.1/servers/169ae6e5-bfce-46d4-a3d3-8878a214e0e4 => generated 1527 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:27.844322 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-73eb63c5-587d-40e4-a0a7-72ed0b326568 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:42:27.844322 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-73eb63c5-587d-40e4-a0a7-72ed0b326568 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:42:27.844322 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-73eb63c5-587d-40e4-a0a7-72ed0b326568 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:42:27.844322 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-73eb63c5-587d-40e4-a0a7-72ed0b326568 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:42:27.844322 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-73eb63c5-587d-40e4-a0a7-72ed0b326568 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:42:27.860504 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73eb63c5-587d-40e4-a0a7-72ed0b326568 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:27.861277 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73eb63c5-587d-40e4-a0a7-72ed0b326568 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:27.861884 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73eb63c5-587d-40e4-a0a7-72ed0b326568 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:27.862726 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73eb63c5-587d-40e4-a0a7-72ed0b326568 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:27.863362 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73eb63c5-587d-40e4-a0a7-72ed0b326568 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:27.863864 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73eb63c5-587d-40e4-a0a7-72ed0b326568 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:27.892599 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-73eb63c5-587d-40e4-a0a7-72ed0b326568 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Getting quotas for project 38b4cd4b884c4456866052a4969dc138. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:42:27.900800 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-73eb63c5-587d-40e4-a0a7-72ed0b326568 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Getting quotas for user a2e9e9bbf3d94d77a236e43f019d316a and project 38b4cd4b884c4456866052a4969dc138. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:42:27.938941 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-73eb63c5-587d-40e4-a0a7-72ed0b326568 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:42:27.945528 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-73eb63c5-587d-40e4-a0a7-72ed0b326568 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 9e93e324-b274-4803-92d3-ee509e0a06d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:42:28.027604 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-73eb63c5-587d-40e4-a0a7-72ed0b326568 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.704000 Oct 18 15:42:28.028858 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1973/3936] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:42:26 2022] POST /compute/v2.1/servers => generated 383 bytes in 1706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 15:42:28.044335 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c8cdec53-3f8b-458e-91c6-0999b806f3cb tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:28.045316 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c8cdec53-3f8b-458e-91c6-0999b806f3cb tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 9e93e324-b274-4803-92d3-ee509e0a06d5] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:28.140495 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c8cdec53-3f8b-458e-91c6-0999b806f3cb tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:28.152613 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c8cdec53-3f8b-458e-91c6-0999b806f3cb tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/9e93e324-b274-4803-92d3-ee509e0a06d5" status: 200 len: 1225 microversion: 2.1 time: 0.115480 Oct 18 15:42:28.172029 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1964/3937] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:28 2022] GET /compute/v2.1/servers/9e93e324-b274-4803-92d3-ee509e0a06d5 => generated 1225 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:28.844394 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bc3d2d62-f383-426d-8579-563e23e0fb68 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:28.846158 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bc3d2d62-f383-426d-8579-563e23e0fb68 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] [instance: 169ae6e5-bfce-46d4-a3d3-8878a214e0e4] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:28.860520 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc3d2d62-f383-426d-8579-563e23e0fb68 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:28.864671 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc3d2d62-f383-426d-8579-563e23e0fb68 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:28.865422 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc3d2d62-f383-426d-8579-563e23e0fb68 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:28.866436 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc3d2d62-f383-426d-8579-563e23e0fb68 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:28.868439 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc3d2d62-f383-426d-8579-563e23e0fb68 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:28.870740 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc3d2d62-f383-426d-8579-563e23e0fb68 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:29.134263 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bc3d2d62-f383-426d-8579-563e23e0fb68 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7cb4b4f1da48e3908b9aa55e8d4b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c931ca6c2284e2f81c84b35db7192e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:29.158854 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bc3d2d62-f383-426d-8579-563e23e0fb68 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] 10.222.0.60 "GET /compute/v2.1/servers/169ae6e5-bfce-46d4-a3d3-8878a214e0e4" status: 200 len: 1527 microversion: 2.1 time: 0.315693 Oct 18 15:42:29.160220 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1974/3938] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:28 2022] GET /compute/v2.1/servers/169ae6e5-bfce-46d4-a3d3-8878a214e0e4 => generated 1527 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:29.185347 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-64645481-b9a8-4d15-b259-a5dc66d8e6a4 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:29.186061 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-64645481-b9a8-4d15-b259-a5dc66d8e6a4 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 9e93e324-b274-4803-92d3-ee509e0a06d5] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:29.204939 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-64645481-b9a8-4d15-b259-a5dc66d8e6a4 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:29.205464 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-64645481-b9a8-4d15-b259-a5dc66d8e6a4 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:29.205909 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-64645481-b9a8-4d15-b259-a5dc66d8e6a4 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:29.209336 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-64645481-b9a8-4d15-b259-a5dc66d8e6a4 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:29.209856 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-64645481-b9a8-4d15-b259-a5dc66d8e6a4 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:29.210307 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-64645481-b9a8-4d15-b259-a5dc66d8e6a4 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:29.255356 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:42:29.325237 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-64645481-b9a8-4d15-b259-a5dc66d8e6a4 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:29.364879 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-64645481-b9a8-4d15-b259-a5dc66d8e6a4 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/9e93e324-b274-4803-92d3-ee509e0a06d5" status: 200 len: 1277 microversion: 2.1 time: 0.183441 Oct 18 15:42:29.366442 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1965/3939] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:29 2022] GET /compute/v2.1/servers/9e93e324-b274-4803-92d3-ee509e0a06d5 => generated 1277 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:29.655925 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-0a2e7d5a-7273-4bc1-b824-21d552f7e076 req-9bad9a7a-a6e1-4006-a51f-56f41bd220b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "169ae6e5-bfce-46d4-a3d3-8878a214e0e4", "name": "network-vif-deleted", "tag": "0ef129dc-f174-4622-be33-0d97cf2b314b"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:42:29.669285 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0a2e7d5a-7273-4bc1-b824-21d552f7e076 req-9bad9a7a-a6e1-4006-a51f-56f41bd220b8 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:29.673611 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0a2e7d5a-7273-4bc1-b824-21d552f7e076 req-9bad9a7a-a6e1-4006-a51f-56f41bd220b8 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:29.674388 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0a2e7d5a-7273-4bc1-b824-21d552f7e076 req-9bad9a7a-a6e1-4006-a51f-56f41bd220b8 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:29.686390 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7461dcc0-57f8-4e15-9ab3-6390cb42886b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:29.690736 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7461dcc0-57f8-4e15-9ab3-6390cb42886b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:29.703330 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-0a2e7d5a-7273-4bc1-b824-21d552f7e076 req-9bad9a7a-a6e1-4006-a51f-56f41bd220b8 service nova] Creating event network-vif-deleted:0ef129dc-f174-4622-be33-0d97cf2b314b for instance 169ae6e5-bfce-46d4-a3d3-8878a214e0e4 on n-h2-853682-5 Oct 18 15:42:29.707162 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7461dcc0-57f8-4e15-9ab3-6390cb42886b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:29.708124 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7461dcc0-57f8-4e15-9ab3-6390cb42886b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:29.709409 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7461dcc0-57f8-4e15-9ab3-6390cb42886b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:29.711653 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7461dcc0-57f8-4e15-9ab3-6390cb42886b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:29.712326 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-0a2e7d5a-7273-4bc1-b824-21d552f7e076 req-9bad9a7a-a6e1-4006-a51f-56f41bd220b8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061773 Oct 18 15:42:29.717441 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7461dcc0-57f8-4e15-9ab3-6390cb42886b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:29.718011 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7461dcc0-57f8-4e15-9ab3-6390cb42886b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:29.718534 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1975/3940] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:42:30.034424 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7461dcc0-57f8-4e15-9ab3-6390cb42886b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:30.055690 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7461dcc0-57f8-4e15-9ab3-6390cb42886b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1684 microversion: 2.1 time: 0.374347 Oct 18 15:42:30.070604 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1966/3941] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:29 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1684 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:42:30.200006 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0dc80537-5dbc-4194-9c48-5f8ac788f953 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:30.201060 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0dc80537-5dbc-4194-9c48-5f8ac788f953 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] [instance: 169ae6e5-bfce-46d4-a3d3-8878a214e0e4] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:30.208671 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0dc80537-5dbc-4194-9c48-5f8ac788f953 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:30.209261 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0dc80537-5dbc-4194-9c48-5f8ac788f953 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:30.209752 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0dc80537-5dbc-4194-9c48-5f8ac788f953 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:30.211157 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0dc80537-5dbc-4194-9c48-5f8ac788f953 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:30.212593 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0dc80537-5dbc-4194-9c48-5f8ac788f953 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:30.213430 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0dc80537-5dbc-4194-9c48-5f8ac788f953 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:30.238956 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:42:30.262965 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0dc80537-5dbc-4194-9c48-5f8ac788f953 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:30.263756 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0dc80537-5dbc-4194-9c48-5f8ac788f953 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:30.265068 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0dc80537-5dbc-4194-9c48-5f8ac788f953 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:30.265848 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-0dc80537-5dbc-4194-9c48-5f8ac788f953 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lazy-loading 'fault' on Instance uuid 169ae6e5-bfce-46d4-a3d3-8878a214e0e4 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:42:30.343114 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0dc80537-5dbc-4194-9c48-5f8ac788f953 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7cb4b4f1da48e3908b9aa55e8d4b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c931ca6c2284e2f81c84b35db7192e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:30.353954 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0dc80537-5dbc-4194-9c48-5f8ac788f953 tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] 10.222.0.60 "GET /compute/v2.1/servers/169ae6e5-bfce-46d4-a3d3-8878a214e0e4" status: 200 len: 1314 microversion: 2.1 time: 0.166738 Oct 18 15:42:30.355004 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1976/3942] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:30 2022] GET /compute/v2.1/servers/169ae6e5-bfce-46d4-a3d3-8878a214e0e4 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:30.393523 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bbcea3b3-fdec-4e1b-b301-e5ece1661bf3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:30.394977 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-bbcea3b3-fdec-4e1b-b301-e5ece1661bf3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 9e93e324-b274-4803-92d3-ee509e0a06d5] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:30.411755 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bbcea3b3-fdec-4e1b-b301-e5ece1661bf3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:30.412568 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bbcea3b3-fdec-4e1b-b301-e5ece1661bf3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:30.413260 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bbcea3b3-fdec-4e1b-b301-e5ece1661bf3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:30.414287 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bbcea3b3-fdec-4e1b-b301-e5ece1661bf3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:30.414952 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bbcea3b3-fdec-4e1b-b301-e5ece1661bf3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:30.415737 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bbcea3b3-fdec-4e1b-b301-e5ece1661bf3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:30.520158 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-bbcea3b3-fdec-4e1b-b301-e5ece1661bf3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:30.533871 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-bbcea3b3-fdec-4e1b-b301-e5ece1661bf3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/9e93e324-b274-4803-92d3-ee509e0a06d5" status: 200 len: 1283 microversion: 2.1 time: 0.145046 Oct 18 15:42:30.534793 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1967/3943] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:30 2022] GET /compute/v2.1/servers/9e93e324-b274-4803-92d3-ee509e0a06d5 => generated 1283 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:31.084465 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-953a6b99-affa-401c-b0b8-cc3a91302211 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:31.085833 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-953a6b99-affa-401c-b0b8-cc3a91302211 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:31.095468 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-953a6b99-affa-401c-b0b8-cc3a91302211 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:31.095972 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-953a6b99-affa-401c-b0b8-cc3a91302211 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:31.096410 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-953a6b99-affa-401c-b0b8-cc3a91302211 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:31.097151 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-953a6b99-affa-401c-b0b8-cc3a91302211 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:31.097614 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-953a6b99-affa-401c-b0b8-cc3a91302211 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:31.098255 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-953a6b99-affa-401c-b0b8-cc3a91302211 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:31.378850 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-63df716e-ad7c-4af0-ac10-b5a3fb2900ab tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:31.379903 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-63df716e-ad7c-4af0-ac10-b5a3fb2900ab tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] [instance: 169ae6e5-bfce-46d4-a3d3-8878a214e0e4] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:31.387664 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-63df716e-ad7c-4af0-ac10-b5a3fb2900ab tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:31.389311 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-63df716e-ad7c-4af0-ac10-b5a3fb2900ab tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:31.389976 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-63df716e-ad7c-4af0-ac10-b5a3fb2900ab tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:31.391230 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-63df716e-ad7c-4af0-ac10-b5a3fb2900ab tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:31.392641 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-63df716e-ad7c-4af0-ac10-b5a3fb2900ab tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:31.393385 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-63df716e-ad7c-4af0-ac10-b5a3fb2900ab tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:31.409208 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-63df716e-ad7c-4af0-ac10-b5a3fb2900ab tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] HTTP exception thrown: Instance 169ae6e5-bfce-46d4-a3d3-8878a214e0e4 could not be found. Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-63df716e-ad7c-4af0-ac10-b5a3fb2900ab tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Request method failure captured: Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/169ae6e5-bfce-46d4-a3d3-8878a214e0e4 HTTP/1.1 Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTslPqPxeqxGjDkrJBgBq3iUWima-iLVwI7XYU2YdUF72pg6HOt8i20yUjfQeNopo6c-tQAjBP5_c45UcoYF-wYFb4fjdm2kyNqz_j6vGLPL_Jkk7wajuv6vh-IOfcxV_e5bUNYyjhfG030VUO9b2GgkVNPBPQdIi6aMg8HHNBAnHs7Y Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 4c931ca6c2284e2f81c84b35db7192e7 Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-2098401334 Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4c931ca6c2284e2f81c84b35db7192e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4c931ca6c2284e2f81c84b35db7192e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4c931ca6c2284e2f81c84b35db7192e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4c931ca6c2284e2f81c84b35db7192e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-2098401334 Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 4c931ca6c2284e2f81c84b35db7192e7 Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-2098401334 Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServerAddressesNegativeTestJSON-2098401334-project Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: ea7cb4b4f1da48e3908b9aa55e8d4b70 Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-2098401334-project Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 169ae6e5-bfce-46d4-a3d3-8878a214e0e4 could not be found. Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '169ae6e5-bfce-46d4-a3d3-8878a214e0e4'} Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 169ae6e5-bfce-46d4-a3d3-8878a214e0e4 could not be found. Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 169ae6e5-bfce-46d4-a3d3-8878a214e0e4 could not be found. Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:42:31.412448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:42:31.418098 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:42:31.418098 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:42:31.418098 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:42:31.418098 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:42:31.418098 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:42:31.418098 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:42:31.418098 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 169ae6e5-bfce-46d4-a3d3-8878a214e0e4 could not be found. Oct 18 15:42:31.418098 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:42:31.420576 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-63df716e-ad7c-4af0-ac10-b5a3fb2900ab tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] Returning 404 to user: Instance 169ae6e5-bfce-46d4-a3d3-8878a214e0e4 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:42:31.422226 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-63df716e-ad7c-4af0-ac10-b5a3fb2900ab tempest-ServerAddressesNegativeTestJSON-2098401334 tempest-ServerAddressesNegativeTestJSON-2098401334-project] 10.222.0.60 "GET /compute/v2.1/servers/169ae6e5-bfce-46d4-a3d3-8878a214e0e4" status: 404 len: 111 microversion: 2.1 time: 0.047423 Oct 18 15:42:31.423961 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1968/3944] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:31 2022] GET /compute/v2.1/servers/169ae6e5-bfce-46d4-a3d3-8878a214e0e4 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 15:42:31.562898 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fb567766-e3d8-4769-a190-0324b4b4ed3f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:31.563768 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-fb567766-e3d8-4769-a190-0324b4b4ed3f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 9e93e324-b274-4803-92d3-ee509e0a06d5] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:31.578738 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fb567766-e3d8-4769-a190-0324b4b4ed3f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:31.579436 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fb567766-e3d8-4769-a190-0324b4b4ed3f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:31.581966 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fb567766-e3d8-4769-a190-0324b4b4ed3f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:31.583057 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fb567766-e3d8-4769-a190-0324b4b4ed3f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:31.585397 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fb567766-e3d8-4769-a190-0324b4b4ed3f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:31.586023 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fb567766-e3d8-4769-a190-0324b4b4ed3f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:31.730961 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-953a6b99-affa-401c-b0b8-cc3a91302211 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:31.757477 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-953a6b99-affa-401c-b0b8-cc3a91302211 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1671 microversion: 2.1 time: 0.677891 Oct 18 15:42:31.758695 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1977/3945] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:31 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1671 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:31.797411 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1209e18e-6492-4692-97a6-5f8ac253138f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-172253522"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:42:31.801648 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1209e18e-6492-4692-97a6-5f8ac253138f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:31.814581 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1209e18e-6492-4692-97a6-5f8ac253138f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:31.815076 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1209e18e-6492-4692-97a6-5f8ac253138f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:31.821202 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1209e18e-6492-4692-97a6-5f8ac253138f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:31.822056 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1209e18e-6492-4692-97a6-5f8ac253138f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:31.822544 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1209e18e-6492-4692-97a6-5f8ac253138f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:31.822983 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1209e18e-6492-4692-97a6-5f8ac253138f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:31.845799 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-fb567766-e3d8-4769-a190-0324b4b4ed3f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:31.857304 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fb567766-e3d8-4769-a190-0324b4b4ed3f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/9e93e324-b274-4803-92d3-ee509e0a06d5" status: 200 len: 1325 microversion: 2.1 time: 0.301336 Oct 18 15:42:31.885655 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1969/3946] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:31 2022] GET /compute/v2.1/servers/9e93e324-b274-4803-92d3-ee509e0a06d5 => generated 1325 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:32.234455 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-e6df1ba9-1678-46fc-bf9c-f3929ef1b35c req-36f07b41-56c7-4813-9991-99baa9cb36b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79212b18-bfd6-4a94-9d58-80c535525aa8", "name": "network-vif-unplugged", "status": "completed", "tag": "65ddf63c-d787-42eb-bb1d-c107c1fe8b2f"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:42:32.258559 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-e6df1ba9-1678-46fc-bf9c-f3929ef1b35c req-36f07b41-56c7-4813-9991-99baa9cb36b2 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:32.259408 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-e6df1ba9-1678-46fc-bf9c-f3929ef1b35c req-36f07b41-56c7-4813-9991-99baa9cb36b2 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:32.259860 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-e6df1ba9-1678-46fc-bf9c-f3929ef1b35c req-36f07b41-56c7-4813-9991-99baa9cb36b2 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:32.276269 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1209e18e-6492-4692-97a6-5f8ac253138f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "POST /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8/action" status: 202 len: 0 microversion: 2.1 time: 0.493819 Oct 18 15:42:32.280133 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1978/3947] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:42:31 2022] POST /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8/action => generated 0 bytes in 496 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 18 15:42:32.292744 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7c1110c0-26fe-4a26-8289-0528106f1655 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:32.295024 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7c1110c0-26fe-4a26-8289-0528106f1655 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:32.298880 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-e6df1ba9-1678-46fc-bf9c-f3929ef1b35c req-36f07b41-56c7-4813-9991-99baa9cb36b2 service nova] Creating event network-vif-unplugged:65ddf63c-d787-42eb-bb1d-c107c1fe8b2f for instance 79212b18-bfd6-4a94-9d58-80c535525aa8 on n-h2-853682-5 Oct 18 15:42:32.312669 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c1110c0-26fe-4a26-8289-0528106f1655 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:32.314861 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-e6df1ba9-1678-46fc-bf9c-f3929ef1b35c req-36f07b41-56c7-4813-9991-99baa9cb36b2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086077 Oct 18 15:42:32.315458 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c1110c0-26fe-4a26-8289-0528106f1655 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:32.315955 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c1110c0-26fe-4a26-8289-0528106f1655 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:32.316682 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c1110c0-26fe-4a26-8289-0528106f1655 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:32.317620 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1970/3948] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:42:32.318696 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c1110c0-26fe-4a26-8289-0528106f1655 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:32.319160 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c1110c0-26fe-4a26-8289-0528106f1655 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:32.578039 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7c1110c0-26fe-4a26-8289-0528106f1655 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:32.590548 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7c1110c0-26fe-4a26-8289-0528106f1655 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1681 microversion: 2.1 time: 0.308304 Oct 18 15:42:32.592560 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1979/3949] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:32 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1681 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:32.884422 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1903f6ee-c0d6-4613-a9c3-f418fd82477a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:32.885281 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1903f6ee-c0d6-4613-a9c3-f418fd82477a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 9e93e324-b274-4803-92d3-ee509e0a06d5] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:32.898194 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1903f6ee-c0d6-4613-a9c3-f418fd82477a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:32.898674 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1903f6ee-c0d6-4613-a9c3-f418fd82477a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:32.903616 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1903f6ee-c0d6-4613-a9c3-f418fd82477a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:32.905007 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1903f6ee-c0d6-4613-a9c3-f418fd82477a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:32.905663 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1903f6ee-c0d6-4613-a9c3-f418fd82477a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:32.908202 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1903f6ee-c0d6-4613-a9c3-f418fd82477a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:33.127518 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1903f6ee-c0d6-4613-a9c3-f418fd82477a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:33.138764 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1903f6ee-c0d6-4613-a9c3-f418fd82477a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/9e93e324-b274-4803-92d3-ee509e0a06d5" status: 200 len: 1325 microversion: 2.1 time: 0.259315 Oct 18 15:42:33.154330 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1971/3950] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:32 2022] GET /compute/v2.1/servers/9e93e324-b274-4803-92d3-ee509e0a06d5 => generated 1325 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:33.616589 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c26950e6-1cc9-4eb0-b73e-502157fef083 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:33.617906 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c26950e6-1cc9-4eb0-b73e-502157fef083 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:33.628739 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c26950e6-1cc9-4eb0-b73e-502157fef083 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:33.630054 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c26950e6-1cc9-4eb0-b73e-502157fef083 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:33.630783 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c26950e6-1cc9-4eb0-b73e-502157fef083 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:33.632065 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c26950e6-1cc9-4eb0-b73e-502157fef083 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:33.633250 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c26950e6-1cc9-4eb0-b73e-502157fef083 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:33.635385 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c26950e6-1cc9-4eb0-b73e-502157fef083 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:33.843820 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c26950e6-1cc9-4eb0-b73e-502157fef083 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:33.852164 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c26950e6-1cc9-4eb0-b73e-502157fef083 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1689 microversion: 2.1 time: 0.239723 Oct 18 15:42:33.852751 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1980/3951] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:33 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1689 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:34.164394 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5e8ca2d9-7d0e-4acc-b925-e32f5ce4ed1c tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:34.165615 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5e8ca2d9-7d0e-4acc-b925-e32f5ce4ed1c tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 9e93e324-b274-4803-92d3-ee509e0a06d5] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:34.175889 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5e8ca2d9-7d0e-4acc-b925-e32f5ce4ed1c tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:34.176396 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5e8ca2d9-7d0e-4acc-b925-e32f5ce4ed1c tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:34.177141 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5e8ca2d9-7d0e-4acc-b925-e32f5ce4ed1c tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:34.177874 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5e8ca2d9-7d0e-4acc-b925-e32f5ce4ed1c tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:34.178336 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5e8ca2d9-7d0e-4acc-b925-e32f5ce4ed1c tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:34.179274 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5e8ca2d9-7d0e-4acc-b925-e32f5ce4ed1c tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:34.435706 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5e8ca2d9-7d0e-4acc-b925-e32f5ce4ed1c tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:34.447110 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5e8ca2d9-7d0e-4acc-b925-e32f5ce4ed1c tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/9e93e324-b274-4803-92d3-ee509e0a06d5" status: 200 len: 1325 microversion: 2.1 time: 0.287059 Oct 18 15:42:34.448560 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1972/3952] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:34 2022] GET /compute/v2.1/servers/9e93e324-b274-4803-92d3-ee509e0a06d5 => generated 1325 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:34.599385 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-34376c2b-d1c0-401d-ac1b-3710723930a1 req-1ebce43b-8603-4ad6-a8a4-6e00aa2d1e75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e93e324-b274-4803-92d3-ee509e0a06d5", "tag": "b79ec16f-f483-4b30-af6f-e7fb99854c98"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:42:34.617506 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-34376c2b-d1c0-401d-ac1b-3710723930a1 req-1ebce43b-8603-4ad6-a8a4-6e00aa2d1e75 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:34.618161 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-34376c2b-d1c0-401d-ac1b-3710723930a1 req-1ebce43b-8603-4ad6-a8a4-6e00aa2d1e75 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:34.623663 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-34376c2b-d1c0-401d-ac1b-3710723930a1 req-1ebce43b-8603-4ad6-a8a4-6e00aa2d1e75 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:34.640986 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-34376c2b-d1c0-401d-ac1b-3710723930a1 req-1ebce43b-8603-4ad6-a8a4-6e00aa2d1e75 service nova] Creating event network-changed:b79ec16f-f483-4b30-af6f-e7fb99854c98 for instance 9e93e324-b274-4803-92d3-ee509e0a06d5 on n-h1-853682-5 Oct 18 15:42:34.652361 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-34376c2b-d1c0-401d-ac1b-3710723930a1 req-1ebce43b-8603-4ad6-a8a4-6e00aa2d1e75 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057757 Oct 18 15:42:34.652998 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1981/3953] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:42:34.876661 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8b05fbab-255c-4008-ba67-5a3c4026cc44 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:34.877383 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8b05fbab-255c-4008-ba67-5a3c4026cc44 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:34.895863 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8b05fbab-255c-4008-ba67-5a3c4026cc44 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:34.898899 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8b05fbab-255c-4008-ba67-5a3c4026cc44 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:34.899395 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8b05fbab-255c-4008-ba67-5a3c4026cc44 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:34.900149 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8b05fbab-255c-4008-ba67-5a3c4026cc44 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:34.905467 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8b05fbab-255c-4008-ba67-5a3c4026cc44 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:34.906558 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8b05fbab-255c-4008-ba67-5a3c4026cc44 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:35.225726 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8b05fbab-255c-4008-ba67-5a3c4026cc44 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:35.241915 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8b05fbab-255c-4008-ba67-5a3c4026cc44 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1689 microversion: 2.1 time: 0.369655 Oct 18 15:42:35.244258 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1973/3954] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:34 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1689 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:42:35.473598 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-01f0f35c-30fb-43f9-904f-21fc81d4ce01 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:35.474905 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-01f0f35c-30fb-43f9-904f-21fc81d4ce01 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 9e93e324-b274-4803-92d3-ee509e0a06d5] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:35.481390 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01f0f35c-30fb-43f9-904f-21fc81d4ce01 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:35.482175 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01f0f35c-30fb-43f9-904f-21fc81d4ce01 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:35.482906 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01f0f35c-30fb-43f9-904f-21fc81d4ce01 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:35.483699 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01f0f35c-30fb-43f9-904f-21fc81d4ce01 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:35.484363 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01f0f35c-30fb-43f9-904f-21fc81d4ce01 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:35.485067 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01f0f35c-30fb-43f9-904f-21fc81d4ce01 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:35.685917 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-01f0f35c-30fb-43f9-904f-21fc81d4ce01 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:35.708325 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-01f0f35c-30fb-43f9-904f-21fc81d4ce01 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/9e93e324-b274-4803-92d3-ee509e0a06d5" status: 200 len: 1325 microversion: 2.1 time: 0.238130 Oct 18 15:42:35.709847 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1982/3955] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:35 2022] GET /compute/v2.1/servers/9e93e324-b274-4803-92d3-ee509e0a06d5 => generated 1325 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:36.266270 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a98d952d-6c85-40b5-af8b-2e36e07e96d2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:36.266993 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a98d952d-6c85-40b5-af8b-2e36e07e96d2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:36.275845 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a98d952d-6c85-40b5-af8b-2e36e07e96d2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:36.282034 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a98d952d-6c85-40b5-af8b-2e36e07e96d2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:36.283246 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a98d952d-6c85-40b5-af8b-2e36e07e96d2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:36.284175 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a98d952d-6c85-40b5-af8b-2e36e07e96d2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:36.299798 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a98d952d-6c85-40b5-af8b-2e36e07e96d2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:36.300607 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a98d952d-6c85-40b5-af8b-2e36e07e96d2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:36.735064 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a0b78919-3069-4683-91ca-cfdaf19f143f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:36.735970 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a0b78919-3069-4683-91ca-cfdaf19f143f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 9e93e324-b274-4803-92d3-ee509e0a06d5] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:36.748135 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0b78919-3069-4683-91ca-cfdaf19f143f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:36.749782 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0b78919-3069-4683-91ca-cfdaf19f143f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:36.751373 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a98d952d-6c85-40b5-af8b-2e36e07e96d2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:36.751534 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0b78919-3069-4683-91ca-cfdaf19f143f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:36.753775 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0b78919-3069-4683-91ca-cfdaf19f143f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:36.755849 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0b78919-3069-4683-91ca-cfdaf19f143f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:36.756580 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0b78919-3069-4683-91ca-cfdaf19f143f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:36.759067 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a98d952d-6c85-40b5-af8b-2e36e07e96d2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1689 microversion: 2.1 time: 0.496842 Oct 18 15:42:36.761220 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1974/3956] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:36 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1689 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:37.421530 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a0b78919-3069-4683-91ca-cfdaf19f143f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:37.430394 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a0b78919-3069-4683-91ca-cfdaf19f143f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/9e93e324-b274-4803-92d3-ee509e0a06d5" status: 200 len: 1325 microversion: 2.1 time: 0.700060 Oct 18 15:42:37.442193 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1983/3957] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:36 2022] GET /compute/v2.1/servers/9e93e324-b274-4803-92d3-ee509e0a06d5 => generated 1325 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:37.790631 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0061841f-fd02-4e0c-910f-3bde79febcaf tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:37.792188 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0061841f-fd02-4e0c-910f-3bde79febcaf tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:37.807017 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0061841f-fd02-4e0c-910f-3bde79febcaf tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:37.809303 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0061841f-fd02-4e0c-910f-3bde79febcaf tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:37.810019 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0061841f-fd02-4e0c-910f-3bde79febcaf tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:37.813203 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0061841f-fd02-4e0c-910f-3bde79febcaf tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:37.814231 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0061841f-fd02-4e0c-910f-3bde79febcaf tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:37.817160 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0061841f-fd02-4e0c-910f-3bde79febcaf tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:38.149064 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:42:38.445980 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0061841f-fd02-4e0c-910f-3bde79febcaf tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:38.460461 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0061841f-fd02-4e0c-910f-3bde79febcaf tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1684 microversion: 2.1 time: 0.674863 Oct 18 15:42:38.461845 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1975/3958] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:37 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1684 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:38.486356 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-92ccb2c4-44a0-4776-84bd-5564b854f13e tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:38.486982 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-92ccb2c4-44a0-4776-84bd-5564b854f13e tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 9e93e324-b274-4803-92d3-ee509e0a06d5] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:38.491593 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:42:38.495215 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=10 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:42:38.503995 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92ccb2c4-44a0-4776-84bd-5564b854f13e tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:38.504451 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92ccb2c4-44a0-4776-84bd-5564b854f13e tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:38.504904 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92ccb2c4-44a0-4776-84bd-5564b854f13e tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:38.511710 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92ccb2c4-44a0-4776-84bd-5564b854f13e tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:38.512207 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92ccb2c4-44a0-4776-84bd-5564b854f13e tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:38.512656 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92ccb2c4-44a0-4776-84bd-5564b854f13e tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:39.026194 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-92ccb2c4-44a0-4776-84bd-5564b854f13e tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:39.037554 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-92ccb2c4-44a0-4776-84bd-5564b854f13e tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/9e93e324-b274-4803-92d3-ee509e0a06d5" status: 200 len: 1325 microversion: 2.1 time: 0.555841 Oct 18 15:42:39.045297 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1984/3959] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:38 2022] GET /compute/v2.1/servers/9e93e324-b274-4803-92d3-ee509e0a06d5 => generated 1325 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:39.487818 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e90bcf0b-2fe8-44ed-9da9-f6d9c0cabe05 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:39.489125 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e90bcf0b-2fe8-44ed-9da9-f6d9c0cabe05 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:39.503827 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e90bcf0b-2fe8-44ed-9da9-f6d9c0cabe05 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:39.506194 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e90bcf0b-2fe8-44ed-9da9-f6d9c0cabe05 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:39.507812 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e90bcf0b-2fe8-44ed-9da9-f6d9c0cabe05 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:39.513650 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e90bcf0b-2fe8-44ed-9da9-f6d9c0cabe05 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:39.516222 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e90bcf0b-2fe8-44ed-9da9-f6d9c0cabe05 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:39.517476 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e90bcf0b-2fe8-44ed-9da9-f6d9c0cabe05 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:39.723766 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-9b2076c9-84f8-4a0e-84f7-cc66f3849227 req-0d37ac7e-bf4e-4f67-af7a-09bea3933977 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79212b18-bfd6-4a94-9d58-80c535525aa8", "name": "network-vif-plugged", "status": "completed", "tag": "65ddf63c-d787-42eb-bb1d-c107c1fe8b2f"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:42:39.751321 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9b2076c9-84f8-4a0e-84f7-cc66f3849227 req-0d37ac7e-bf4e-4f67-af7a-09bea3933977 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:39.751803 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9b2076c9-84f8-4a0e-84f7-cc66f3849227 req-0d37ac7e-bf4e-4f67-af7a-09bea3933977 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:39.767921 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9b2076c9-84f8-4a0e-84f7-cc66f3849227 req-0d37ac7e-bf4e-4f67-af7a-09bea3933977 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:39.812772 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-9b2076c9-84f8-4a0e-84f7-cc66f3849227 req-0d37ac7e-bf4e-4f67-af7a-09bea3933977 service nova] Creating event network-vif-plugged:65ddf63c-d787-42eb-bb1d-c107c1fe8b2f for instance 79212b18-bfd6-4a94-9d58-80c535525aa8 on n-h2-853682-5 Oct 18 15:42:39.829215 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-9b2076c9-84f8-4a0e-84f7-cc66f3849227 req-0d37ac7e-bf4e-4f67-af7a-09bea3933977 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109663 Oct 18 15:42:39.832966 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1985/3960] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:42:40.074600 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9375025e-d9f6-451e-aebf-89a308f271f5 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:40.075313 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9375025e-d9f6-451e-aebf-89a308f271f5 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 9e93e324-b274-4803-92d3-ee509e0a06d5] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:40.090343 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9375025e-d9f6-451e-aebf-89a308f271f5 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:40.090855 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9375025e-d9f6-451e-aebf-89a308f271f5 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:40.091296 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9375025e-d9f6-451e-aebf-89a308f271f5 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:40.092020 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9375025e-d9f6-451e-aebf-89a308f271f5 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:40.093213 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9375025e-d9f6-451e-aebf-89a308f271f5 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:40.094022 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9375025e-d9f6-451e-aebf-89a308f271f5 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:40.867256 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e90bcf0b-2fe8-44ed-9da9-f6d9c0cabe05 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:40.876742 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e90bcf0b-2fe8-44ed-9da9-f6d9c0cabe05 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1684 microversion: 2.1 time: 1.392329 Oct 18 15:42:40.884945 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1976/3961] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:39 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1684 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:40.998950 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9375025e-d9f6-451e-aebf-89a308f271f5 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:41.014283 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9375025e-d9f6-451e-aebf-89a308f271f5 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/9e93e324-b274-4803-92d3-ee509e0a06d5" status: 200 len: 1325 microversion: 2.1 time: 0.940518 Oct 18 15:42:41.014931 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1986/3962] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:40 2022] GET /compute/v2.1/servers/9e93e324-b274-4803-92d3-ee509e0a06d5 => generated 1325 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:42:41.559993 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d8f06d64-ce09-4b3a-9c43-beff2fa739ee tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1416183564", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "b55b6f02-72e3-4b31-a708-98b6291bed4c"}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:42:41.572994 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:42:41.694755 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-d8f06d64-ce09-4b3a-9c43-beff2fa739ee tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] validate_networks() for [('b55b6f02-72e3-4b31-a708-98b6291bed4c', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:42:41.913068 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6d017830-f03c-4d5e-b1be-6c692d9cefa6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:41.913691 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6d017830-f03c-4d5e-b1be-6c692d9cefa6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:41.929316 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d017830-f03c-4d5e-b1be-6c692d9cefa6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:41.929929 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d017830-f03c-4d5e-b1be-6c692d9cefa6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:41.931811 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d017830-f03c-4d5e-b1be-6c692d9cefa6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:41.932611 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d017830-f03c-4d5e-b1be-6c692d9cefa6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:41.942651 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d017830-f03c-4d5e-b1be-6c692d9cefa6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:41.943274 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d017830-f03c-4d5e-b1be-6c692d9cefa6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:42.587847 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6d017830-f03c-4d5e-b1be-6c692d9cefa6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:42.600184 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6d017830-f03c-4d5e-b1be-6c692d9cefa6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1684 microversion: 2.1 time: 0.691666 Oct 18 15:42:42.601685 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1987/3963] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:41 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1684 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:42.613872 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-70c51580-74dd-42eb-8f18-3694af328d93 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:42.616350 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-70c51580-74dd-42eb-8f18-3694af328d93 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 9e93e324-b274-4803-92d3-ee509e0a06d5] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:42.631227 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70c51580-74dd-42eb-8f18-3694af328d93 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:42.639207 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70c51580-74dd-42eb-8f18-3694af328d93 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:42.641288 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70c51580-74dd-42eb-8f18-3694af328d93 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:42.642379 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70c51580-74dd-42eb-8f18-3694af328d93 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:42.643406 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70c51580-74dd-42eb-8f18-3694af328d93 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:42.644049 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70c51580-74dd-42eb-8f18-3694af328d93 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:43.215061 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-d8f06d64-ce09-4b3a-9c43-beff2fa739ee tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:42:43.215637 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-d8f06d64-ce09-4b3a-9c43-beff2fa739ee tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:42:43.215943 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-d8f06d64-ce09-4b3a-9c43-beff2fa739ee tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:42:43.217346 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-d8f06d64-ce09-4b3a-9c43-beff2fa739ee tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:42:43.217983 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-d8f06d64-ce09-4b3a-9c43-beff2fa739ee tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:42:43.242700 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d8f06d64-ce09-4b3a-9c43-beff2fa739ee tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:43.246161 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d8f06d64-ce09-4b3a-9c43-beff2fa739ee tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:43.250952 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d8f06d64-ce09-4b3a-9c43-beff2fa739ee tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:43.255784 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d8f06d64-ce09-4b3a-9c43-beff2fa739ee tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:43.257151 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d8f06d64-ce09-4b3a-9c43-beff2fa739ee tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:43.261298 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d8f06d64-ce09-4b3a-9c43-beff2fa739ee tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:43.299023 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-d8f06d64-ce09-4b3a-9c43-beff2fa739ee tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Getting quotas for project f85a1afa85674bc39dbce30ed8792cb0. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:42:43.307822 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-d8f06d64-ce09-4b3a-9c43-beff2fa739ee tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Getting quotas for user 96c4378d52d1489bb2d50e84cabf95eb and project f85a1afa85674bc39dbce30ed8792cb0. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:42:43.330182 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d8f06d64-ce09-4b3a-9c43-beff2fa739ee tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:42:43.333148 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d8f06d64-ce09-4b3a-9c43-beff2fa739ee tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:42:43.463879 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d8f06d64-ce09-4b3a-9c43-beff2fa739ee tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.132058 Oct 18 15:42:43.470804 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1977/3964] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:42:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2140 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:42:43.487628 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b373d102-f0e8-4ec2-83ea-baf6c9e2aebd tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:43.488162 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b373d102-f0e8-4ec2-83ea-baf6c9e2aebd tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 47ee1803-1ce0-4cbc-879e-d39cfe8576aa] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:43.519472 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b373d102-f0e8-4ec2-83ea-baf6c9e2aebd tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:43.520435 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b373d102-f0e8-4ec2-83ea-baf6c9e2aebd tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:43.523329 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b373d102-f0e8-4ec2-83ea-baf6c9e2aebd tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:43.526435 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b373d102-f0e8-4ec2-83ea-baf6c9e2aebd tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:43.528049 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b373d102-f0e8-4ec2-83ea-baf6c9e2aebd tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:43.529178 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b373d102-f0e8-4ec2-83ea-baf6c9e2aebd tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:43.587874 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-70c51580-74dd-42eb-8f18-3694af328d93 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:43.596615 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-70c51580-74dd-42eb-8f18-3694af328d93 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/9e93e324-b274-4803-92d3-ee509e0a06d5" status: 200 len: 1325 microversion: 2.1 time: 0.992126 Oct 18 15:42:43.607294 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1988/3965] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:42 2022] GET /compute/v2.1/servers/9e93e324-b274-4803-92d3-ee509e0a06d5 => generated 1325 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:43.626909 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b373d102-f0e8-4ec2-83ea-baf6c9e2aebd tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee1803-1ce0-4cbc-879e-d39cfe8576aa/ips" status: 200 len: 149 microversion: 2.1 time: 0.152079 Oct 18 15:42:43.628940 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1978/3966] 10.222.0.60 () {58 vars in 1248 bytes} [Tue Oct 18 15:42:43 2022] GET /compute/v2.1/servers/47ee1803-1ce0-4cbc-879e-d39cfe8576aa/ips => generated 149 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:42:43.645209 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c57e0fed-5c2f-428b-a4b4-8fe2d97f7304 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:43.645892 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6ec0e5a9-4164-4d39-a968-4aea9abb1e76 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:43.646061 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c57e0fed-5c2f-428b-a4b4-8fe2d97f7304 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:43.649183 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6ec0e5a9-4164-4d39-a968-4aea9abb1e76 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:43.654074 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:42:43.669605 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ec0e5a9-4164-4d39-a968-4aea9abb1e76 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:43.670754 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ec0e5a9-4164-4d39-a968-4aea9abb1e76 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:43.673034 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ec0e5a9-4164-4d39-a968-4aea9abb1e76 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:43.674619 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ec0e5a9-4164-4d39-a968-4aea9abb1e76 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:43.679038 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ec0e5a9-4164-4d39-a968-4aea9abb1e76 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:43.679942 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ec0e5a9-4164-4d39-a968-4aea9abb1e76 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:43.856902 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c57e0fed-5c2f-428b-a4b4-8fe2d97f7304 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:43.869788 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c57e0fed-5c2f-428b-a4b4-8fe2d97f7304 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1217 microversion: 2.1 time: 0.258740 Oct 18 15:42:43.891172 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1989/3967] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:43 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1217 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:44.049390 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6ec0e5a9-4164-4d39-a968-4aea9abb1e76 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:44.061808 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6ec0e5a9-4164-4d39-a968-4aea9abb1e76 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1684 microversion: 2.1 time: 0.430705 Oct 18 15:42:44.062773 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1979/3968] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:43 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1684 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:44.528975 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-d6770a32-f2d1-42c4-8c17-7ea261e2ae71 req-6af658e4-752a-4c3e-a0c6-846e28f2e63d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e93e324-b274-4803-92d3-ee509e0a06d5", "name": "network-vif-plugged", "status": "completed", "tag": "b79ec16f-f483-4b30-af6f-e7fb99854c98"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:42:44.563429 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d6770a32-f2d1-42c4-8c17-7ea261e2ae71 req-6af658e4-752a-4c3e-a0c6-846e28f2e63d service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:44.565887 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d6770a32-f2d1-42c4-8c17-7ea261e2ae71 req-6af658e4-752a-4c3e-a0c6-846e28f2e63d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:44.567362 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d6770a32-f2d1-42c4-8c17-7ea261e2ae71 req-6af658e4-752a-4c3e-a0c6-846e28f2e63d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:44.592603 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-d6770a32-f2d1-42c4-8c17-7ea261e2ae71 req-6af658e4-752a-4c3e-a0c6-846e28f2e63d service nova] Creating event network-vif-plugged:b79ec16f-f483-4b30-af6f-e7fb99854c98 for instance 9e93e324-b274-4803-92d3-ee509e0a06d5 on n-h1-853682-5 Oct 18 15:42:44.624472 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-d6770a32-f2d1-42c4-8c17-7ea261e2ae71 req-6af658e4-752a-4c3e-a0c6-846e28f2e63d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111079 Oct 18 15:42:44.624662 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ebd517a1-5748-4563-9727-ff9bc738b384 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:44.625976 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ebd517a1-5748-4563-9727-ff9bc738b384 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 9e93e324-b274-4803-92d3-ee509e0a06d5] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:44.626821 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1990/3969] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:42:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:42:44.640254 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ebd517a1-5748-4563-9727-ff9bc738b384 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:44.641825 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ebd517a1-5748-4563-9727-ff9bc738b384 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:44.642801 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ebd517a1-5748-4563-9727-ff9bc738b384 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:44.644862 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ebd517a1-5748-4563-9727-ff9bc738b384 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:44.646554 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ebd517a1-5748-4563-9727-ff9bc738b384 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:44.647060 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ebd517a1-5748-4563-9727-ff9bc738b384 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:44.899162 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3d84c218-b62e-4e7b-82a4-b2cee9c433ba tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:44.901472 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3d84c218-b62e-4e7b-82a4-b2cee9c433ba tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:44.918711 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d84c218-b62e-4e7b-82a4-b2cee9c433ba tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:44.921452 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d84c218-b62e-4e7b-82a4-b2cee9c433ba tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:44.924210 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d84c218-b62e-4e7b-82a4-b2cee9c433ba tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:44.925253 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d84c218-b62e-4e7b-82a4-b2cee9c433ba tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:44.929508 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d84c218-b62e-4e7b-82a4-b2cee9c433ba tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:44.930842 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d84c218-b62e-4e7b-82a4-b2cee9c433ba tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:45.244568 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3d84c218-b62e-4e7b-82a4-b2cee9c433ba tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:45.267415 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3d84c218-b62e-4e7b-82a4-b2cee9c433ba tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1213 microversion: 2.1 time: 0.366116 Oct 18 15:42:45.288344 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1991/3970] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:44 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1213 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:42:45.309912 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-383630f9-d570-4de5-b479-b9184bbaaa37 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:45.310904 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-383630f9-d570-4de5-b479-b9184bbaaa37 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:45.334197 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-383630f9-d570-4de5-b479-b9184bbaaa37 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:45.339845 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-383630f9-d570-4de5-b479-b9184bbaaa37 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:45.340647 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-383630f9-d570-4de5-b479-b9184bbaaa37 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:45.341808 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-383630f9-d570-4de5-b479-b9184bbaaa37 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:45.342508 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-383630f9-d570-4de5-b479-b9184bbaaa37 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:45.343283 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-383630f9-d570-4de5-b479-b9184bbaaa37 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:45.676934 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ebd517a1-5748-4563-9727-ff9bc738b384 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:45.688196 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ebd517a1-5748-4563-9727-ff9bc738b384 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/9e93e324-b274-4803-92d3-ee509e0a06d5" status: 200 len: 1325 microversion: 2.1 time: 1.070612 Oct 18 15:42:45.690042 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1980/3971] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:44 2022] GET /compute/v2.1/servers/9e93e324-b274-4803-92d3-ee509e0a06d5 => generated 1325 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:45.816436 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-383630f9-d570-4de5-b479-b9184bbaaa37 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:45.833526 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-383630f9-d570-4de5-b479-b9184bbaaa37 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1684 microversion: 2.1 time: 0.543352 Oct 18 15:42:45.833914 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1992/3972] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:45 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1684 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:46.295028 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2ba74515-8dc7-4933-bfde-bdc9152b837c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:46.295803 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2ba74515-8dc7-4933-bfde-bdc9152b837c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:46.318086 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2ba74515-8dc7-4933-bfde-bdc9152b837c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:46.318382 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2ba74515-8dc7-4933-bfde-bdc9152b837c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:46.318822 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2ba74515-8dc7-4933-bfde-bdc9152b837c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:46.320889 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2ba74515-8dc7-4933-bfde-bdc9152b837c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:46.324903 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2ba74515-8dc7-4933-bfde-bdc9152b837c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:46.328644 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2ba74515-8dc7-4933-bfde-bdc9152b837c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:46.608840 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2ba74515-8dc7-4933-bfde-bdc9152b837c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:46.623464 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2ba74515-8dc7-4933-bfde-bdc9152b837c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1275 microversion: 2.1 time: 0.332149 Oct 18 15:42:46.643209 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1981/3973] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:46 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1275 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:46.714009 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-316cd1fe-5f4f-475d-b207-6d80867ccd72 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:46.714901 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-316cd1fe-5f4f-475d-b207-6d80867ccd72 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 9e93e324-b274-4803-92d3-ee509e0a06d5] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:46.736408 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-316cd1fe-5f4f-475d-b207-6d80867ccd72 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:46.736791 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-316cd1fe-5f4f-475d-b207-6d80867ccd72 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:46.737256 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-316cd1fe-5f4f-475d-b207-6d80867ccd72 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:46.740255 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-316cd1fe-5f4f-475d-b207-6d80867ccd72 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:46.754322 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-316cd1fe-5f4f-475d-b207-6d80867ccd72 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:46.756316 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-316cd1fe-5f4f-475d-b207-6d80867ccd72 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:46.856745 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a97e0e7a-42ee-4ec2-a90a-5f725ab7cc57 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:46.857417 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a97e0e7a-42ee-4ec2-a90a-5f725ab7cc57 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:46.878704 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a97e0e7a-42ee-4ec2-a90a-5f725ab7cc57 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:46.879206 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a97e0e7a-42ee-4ec2-a90a-5f725ab7cc57 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:46.879646 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a97e0e7a-42ee-4ec2-a90a-5f725ab7cc57 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:46.880367 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a97e0e7a-42ee-4ec2-a90a-5f725ab7cc57 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:46.880840 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a97e0e7a-42ee-4ec2-a90a-5f725ab7cc57 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:46.881265 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a97e0e7a-42ee-4ec2-a90a-5f725ab7cc57 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:47.334246 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-316cd1fe-5f4f-475d-b207-6d80867ccd72 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:47.345615 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-316cd1fe-5f4f-475d-b207-6d80867ccd72 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/9e93e324-b274-4803-92d3-ee509e0a06d5" status: 200 len: 1325 microversion: 2.1 time: 0.637068 Oct 18 15:42:47.362224 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1993/3974] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:46 2022] GET /compute/v2.1/servers/9e93e324-b274-4803-92d3-ee509e0a06d5 => generated 1325 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:47.592511 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a97e0e7a-42ee-4ec2-a90a-5f725ab7cc57 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:47.617609 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a97e0e7a-42ee-4ec2-a90a-5f725ab7cc57 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1684 microversion: 2.1 time: 0.764583 Oct 18 15:42:47.638806 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1982/3975] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:46 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1684 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:42:47.651449 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6c300e8d-fde8-42e6-ba67-2005fb901b43 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:47.652496 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6c300e8d-fde8-42e6-ba67-2005fb901b43 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:47.666041 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6c300e8d-fde8-42e6-ba67-2005fb901b43 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:47.670467 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6c300e8d-fde8-42e6-ba67-2005fb901b43 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:47.671733 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6c300e8d-fde8-42e6-ba67-2005fb901b43 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:47.678545 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6c300e8d-fde8-42e6-ba67-2005fb901b43 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:47.681092 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6c300e8d-fde8-42e6-ba67-2005fb901b43 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:47.681813 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6c300e8d-fde8-42e6-ba67-2005fb901b43 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:47.717928 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:42:47.820160 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ba44b5a3-3a78-41f9-9810-e68824fa2598 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "18041b8b-3e42-47d7-9f78-cfff45393a8b"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:42:47.823252 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ba44b5a3-3a78-41f9-9810-e68824fa2598 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 47ee1803-1ce0-4cbc-879e-d39cfe8576aa] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:47.832576 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba44b5a3-3a78-41f9-9810-e68824fa2598 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:47.833174 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba44b5a3-3a78-41f9-9810-e68824fa2598 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:47.833983 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba44b5a3-3a78-41f9-9810-e68824fa2598 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:47.835407 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba44b5a3-3a78-41f9-9810-e68824fa2598 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:47.836048 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba44b5a3-3a78-41f9-9810-e68824fa2598 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:47.836646 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba44b5a3-3a78-41f9-9810-e68824fa2598 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:48.320992 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:42:48.390033 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ba44b5a3-3a78-41f9-9810-e68824fa2598 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "POST /compute/v2.1/servers/47ee1803-1ce0-4cbc-879e-d39cfe8576aa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.577506 Oct 18 15:42:48.393500 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1983/3976] 10.222.0.60 () {60 vars in 1323 bytes} [Tue Oct 18 15:42:47 2022] POST /compute/v2.1/servers/47ee1803-1ce0-4cbc-879e-d39cfe8576aa/os-volume_attachments => generated 194 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:42:48.636596 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6c300e8d-fde8-42e6-ba67-2005fb901b43 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:48.652216 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6c300e8d-fde8-42e6-ba67-2005fb901b43 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1317 microversion: 2.1 time: 1.002175 Oct 18 15:42:48.666463 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1994/3977] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:47 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1317 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:48.691776 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1dfd88d2-2f8c-4212-87c5-dc089d85a255 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:48.692766 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1dfd88d2-2f8c-4212-87c5-dc089d85a255 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 9e93e324-b274-4803-92d3-ee509e0a06d5] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:48.711711 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1dfd88d2-2f8c-4212-87c5-dc089d85a255 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:48.718835 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1dfd88d2-2f8c-4212-87c5-dc089d85a255 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:48.719442 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1dfd88d2-2f8c-4212-87c5-dc089d85a255 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:48.722859 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1dfd88d2-2f8c-4212-87c5-dc089d85a255 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:48.723498 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1dfd88d2-2f8c-4212-87c5-dc089d85a255 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:48.725465 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1dfd88d2-2f8c-4212-87c5-dc089d85a255 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:48.929905 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f4ea3bd4-64e6-4347-bcbf-edf39a226415 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:48.930502 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f4ea3bd4-64e6-4347-bcbf-edf39a226415 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:48.947821 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f4ea3bd4-64e6-4347-bcbf-edf39a226415 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:48.954977 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f4ea3bd4-64e6-4347-bcbf-edf39a226415 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:48.961068 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f4ea3bd4-64e6-4347-bcbf-edf39a226415 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:48.962204 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f4ea3bd4-64e6-4347-bcbf-edf39a226415 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:48.966223 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f4ea3bd4-64e6-4347-bcbf-edf39a226415 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:48.978970 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f4ea3bd4-64e6-4347-bcbf-edf39a226415 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:49.038262 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f4ea3bd4-64e6-4347-bcbf-edf39a226415 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:42:49.067216 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1dfd88d2-2f8c-4212-87c5-dc089d85a255 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:49.086159 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1dfd88d2-2f8c-4212-87c5-dc089d85a255 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/9e93e324-b274-4803-92d3-ee509e0a06d5" status: 200 len: 1521 microversion: 2.1 time: 0.418374 Oct 18 15:42:49.089083 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1995/3978] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:48 2022] GET /compute/v2.1/servers/9e93e324-b274-4803-92d3-ee509e0a06d5 => generated 1521 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:49.109775 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-826f9f2d-ef65-480c-a5fe-bab4eeae2afa tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:49.113102 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-826f9f2d-ef65-480c-a5fe-bab4eeae2afa tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:49.135065 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-826f9f2d-ef65-480c-a5fe-bab4eeae2afa tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:49.135698 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-826f9f2d-ef65-480c-a5fe-bab4eeae2afa tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:49.136343 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-826f9f2d-ef65-480c-a5fe-bab4eeae2afa tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:49.137373 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-826f9f2d-ef65-480c-a5fe-bab4eeae2afa tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:49.138090 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-826f9f2d-ef65-480c-a5fe-bab4eeae2afa tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:49.138761 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-826f9f2d-ef65-480c-a5fe-bab4eeae2afa tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:49.226959 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f4ea3bd4-64e6-4347-bcbf-edf39a226415 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "DELETE /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 204 len: 0 microversion: 2.32 time: 0.831847 Oct 18 15:42:49.228329 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1984/3979] 10.222.0.60 () {60 vars in 1280 bytes} [Tue Oct 18 15:42:48 2022] DELETE /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 0 bytes in 834 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 15:42:49.238425 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d4625b0f-490d-4d78-91d4-731a30831186 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:49.243838 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d4625b0f-490d-4d78-91d4-731a30831186 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 9e93e324-b274-4803-92d3-ee509e0a06d5] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:49.260468 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4625b0f-490d-4d78-91d4-731a30831186 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:49.261493 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4625b0f-490d-4d78-91d4-731a30831186 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:49.263000 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4625b0f-490d-4d78-91d4-731a30831186 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:49.263209 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4625b0f-490d-4d78-91d4-731a30831186 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:49.263903 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4625b0f-490d-4d78-91d4-731a30831186 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:49.264573 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4625b0f-490d-4d78-91d4-731a30831186 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:49.742202 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-826f9f2d-ef65-480c-a5fe-bab4eeae2afa tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:49.753877 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-826f9f2d-ef65-480c-a5fe-bab4eeae2afa tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1684 microversion: 2.1 time: 0.662006 Oct 18 15:42:49.754736 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1996/3980] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:49 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1684 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:49.772397 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d4625b0f-490d-4d78-91d4-731a30831186 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:49.776478 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b90d1b73-fbac-4632-9b6b-b809e293ab5a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:49.780940 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b90d1b73-fbac-4632-9b6b-b809e293ab5a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:49.784732 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d4625b0f-490d-4d78-91d4-731a30831186 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/9e93e324-b274-4803-92d3-ee509e0a06d5" status: 200 len: 1521 microversion: 2.1 time: 0.552705 Oct 18 15:42:49.793159 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1985/3981] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:49 2022] GET /compute/v2.1/servers/9e93e324-b274-4803-92d3-ee509e0a06d5 => generated 1521 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:49.799051 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c175c22f-dd5b-40c3-b317-9f70ff199fe4 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:49.806698 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b90d1b73-fbac-4632-9b6b-b809e293ab5a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:49.807510 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b90d1b73-fbac-4632-9b6b-b809e293ab5a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:49.808265 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b90d1b73-fbac-4632-9b6b-b809e293ab5a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:49.808394 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c175c22f-dd5b-40c3-b317-9f70ff199fe4 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:49.809350 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b90d1b73-fbac-4632-9b6b-b809e293ab5a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:49.810219 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b90d1b73-fbac-4632-9b6b-b809e293ab5a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:49.810877 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b90d1b73-fbac-4632-9b6b-b809e293ab5a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:49.832003 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c175c22f-dd5b-40c3-b317-9f70ff199fe4 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:49.832548 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c175c22f-dd5b-40c3-b317-9f70ff199fe4 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:49.832989 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c175c22f-dd5b-40c3-b317-9f70ff199fe4 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:49.833720 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c175c22f-dd5b-40c3-b317-9f70ff199fe4 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:49.834187 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c175c22f-dd5b-40c3-b317-9f70ff199fe4 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:49.834620 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c175c22f-dd5b-40c3-b317-9f70ff199fe4 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:50.354666 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b90d1b73-fbac-4632-9b6b-b809e293ab5a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:50.369954 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b90d1b73-fbac-4632-9b6b-b809e293ab5a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:50.371380 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b90d1b73-fbac-4632-9b6b-b809e293ab5a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:50.378444 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b90d1b73-fbac-4632-9b6b-b809e293ab5a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 200 len: 2956 microversion: 2.32 time: 0.621777 Oct 18 15:42:50.393997 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1997/3982] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:42:49 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 2956 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:42:50.405682 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ddab488a-3d25-4547-81c4-e76d764f0d88 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1450169080"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:42:50.408502 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ddab488a-3d25-4547-81c4-e76d764f0d88 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 9e93e324-b274-4803-92d3-ee509e0a06d5] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:50.414971 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ddab488a-3d25-4547-81c4-e76d764f0d88 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:50.415715 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ddab488a-3d25-4547-81c4-e76d764f0d88 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:50.416386 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ddab488a-3d25-4547-81c4-e76d764f0d88 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:50.417316 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ddab488a-3d25-4547-81c4-e76d764f0d88 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:50.417961 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ddab488a-3d25-4547-81c4-e76d764f0d88 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:50.418581 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ddab488a-3d25-4547-81c4-e76d764f0d88 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:50.806139 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ddab488a-3d25-4547-81c4-e76d764f0d88 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "POST /compute/v2.1/servers/9e93e324-b274-4803-92d3-ee509e0a06d5/action" status: 202 len: 0 microversion: 2.1 time: 0.410484 Oct 18 15:42:50.815123 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1998/3983] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:42:50 2022] POST /compute/v2.1/servers/9e93e324-b274-4803-92d3-ee509e0a06d5/action => generated 0 bytes in 420 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 18 15:42:50.845449 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0aeea65e-3c0f-49b0-881c-496dc32e920e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:50.846500 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0aeea65e-3c0f-49b0-881c-496dc32e920e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:50.876798 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0aeea65e-3c0f-49b0-881c-496dc32e920e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:50.877881 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0aeea65e-3c0f-49b0-881c-496dc32e920e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:50.881161 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0aeea65e-3c0f-49b0-881c-496dc32e920e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:50.882572 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0aeea65e-3c0f-49b0-881c-496dc32e920e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:50.885306 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0aeea65e-3c0f-49b0-881c-496dc32e920e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:50.888192 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0aeea65e-3c0f-49b0-881c-496dc32e920e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:50.919481 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c175c22f-dd5b-40c3-b317-9f70ff199fe4 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:50.936992 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c175c22f-dd5b-40c3-b317-9f70ff199fe4 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1317 microversion: 2.1 time: 1.141266 Oct 18 15:42:50.938025 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1986/3984] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:49 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1317 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:50.954459 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e59f244f-e7cc-41ae-a64f-a499cfb7a4a3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '.version_select at 0x7f7c3cfeb700>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:51.252067 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e59f244f-e7cc-41ae-a64f-a499cfb7a4a3 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "DELETE /compute/v2.1/images/9550efcb-fee7-47c8-8e6c-05d2c941a5df" status: 204 len: 0 microversion: 2.1 time: 0.310212 Oct 18 15:42:51.252667 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1987/3985] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:50 2022] DELETE /compute/v2.1/images/9550efcb-fee7-47c8-8e6c-05d2c941a5df => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:42:51.261027 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8a585dfd-1ee8-4f9a-8c9c-086bbf681f3e tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '.version_select at 0x7f7c3c600670>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:51.297192 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-8a585dfd-1ee8-4f9a-8c9c-086bbf681f3e tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] HTTP exception thrown: Image not found. Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8a585dfd-1ee8-4f9a-8c9c-086bbf681f3e tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Request method failure captured: Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/images/9550efcb-fee7-47c8-8e6c-05d2c941a5df HTTP/1.1 Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTskwmwAKtfJxRtfmFCexrRganirG5QxP3o41FeBWoidL-rUG8x8GL16JQLrOge4bbPRk8j9ZKsrTawjOywht8BMU6xpPPkLcF_Tvsxd_4ddRByYVxCCr1OvdQRZ3S_CoRUmp2shw5GPVxRCyE1gWYjx_sxIK_OIs6piyKG80707p5j0 Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 38b4cd4b884c4456866052a4969dc138 Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1849835039 Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/38b4cd4b884c4456866052a4969dc138"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/38b4cd4b884c4456866052a4969dc138"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/38b4cd4b884c4456866052a4969dc138"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_38b4cd4b884c4456866052a4969dc138"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1849835039 Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 38b4cd4b884c4456866052a4969dc138 Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1849835039 Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ImagesOneServerNegativeTestJSON-1849835039-project Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: a2e9e9bbf3d94d77a236e43f019d316a Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1849835039-project Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: method: Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: exception: Image not found. Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '9550efcb-fee7-47c8-8e6c-05d2c941a5df'} Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9550efcb-fee7-47c8-8e6c-05d2c941a5df Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 18 15:42:51.306552 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 18 15:42:51.314612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 18 15:42:51.314612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 15:42:51.314612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 15:42:51.314612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 15:42:51.314612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 15:42:51.314612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 15:42:51.314612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 15:42:51.314612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 15:42:51.314612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 15:42:51.314612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 15:42:51.314612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 15:42:51.314612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 15:42:51.314612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 15:42:51.314612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 15:42:51.314612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 15:42:51.314612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 15:42:51.314612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 15:42:51.314612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9550efcb-fee7-47c8-8e6c-05d2c941a5df could not be found. Oct 18 15:42:51.314612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:42:51.314612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:42:51.314612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:42:51.314612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:42:51.314612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:42:51.314612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:42:51.314612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:42:51.314612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:42:51.314612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:42:51.314612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:42:51.314612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:42:51.314612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:42:51.314612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 18 15:42:51.314612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 15:42:51.314612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 15:42:51.314612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:42:51.314612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:42:51.314612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:42:51.314612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:42:51.314612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:42:51.314612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:42:51.314612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:42:51.314612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:42:51.314612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 15:42:51.314612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:42:51.323310 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8a585dfd-1ee8-4f9a-8c9c-086bbf681f3e tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Returning 404 to user: Image not found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:42:51.324188 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8a585dfd-1ee8-4f9a-8c9c-086bbf681f3e tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/images/9550efcb-fee7-47c8-8e6c-05d2c941a5df" status: 404 len: 62 microversion: 2.1 time: 0.067369 Oct 18 15:42:51.325330 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1988/3986] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Oct 18 15:42:51 2022] GET /compute/v2.1/images/9550efcb-fee7-47c8-8e6c-05d2c941a5df => generated 62 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 15:42:51.337022 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6ae67160-eee9-4702-a084-c119f80a0b33 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:51.337948 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6ae67160-eee9-4702-a084-c119f80a0b33 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 9e93e324-b274-4803-92d3-ee509e0a06d5] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:51.350226 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ae67160-eee9-4702-a084-c119f80a0b33 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:51.353569 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ae67160-eee9-4702-a084-c119f80a0b33 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:51.354339 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ae67160-eee9-4702-a084-c119f80a0b33 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:51.355434 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ae67160-eee9-4702-a084-c119f80a0b33 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:51.356155 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ae67160-eee9-4702-a084-c119f80a0b33 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:51.357116 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ae67160-eee9-4702-a084-c119f80a0b33 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:52.595333 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0aeea65e-3c0f-49b0-881c-496dc32e920e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:52.609523 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0aeea65e-3c0f-49b0-881c-496dc32e920e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1684 microversion: 2.1 time: 1.789600 Oct 18 15:42:52.610369 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1999/3987] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:50 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1684 bytes in 1792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:52.632649 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e88230f6-74c1-4147-baaf-15356eceb415 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:52.633696 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e88230f6-74c1-4147-baaf-15356eceb415 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:52.640697 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e88230f6-74c1-4147-baaf-15356eceb415 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:52.642104 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e88230f6-74c1-4147-baaf-15356eceb415 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:52.642735 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e88230f6-74c1-4147-baaf-15356eceb415 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:52.643675 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e88230f6-74c1-4147-baaf-15356eceb415 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:52.644445 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e88230f6-74c1-4147-baaf-15356eceb415 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:52.645093 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e88230f6-74c1-4147-baaf-15356eceb415 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:53.275747 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6ae67160-eee9-4702-a084-c119f80a0b33 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:53.281978 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:42:53.289745 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6ae67160-eee9-4702-a084-c119f80a0b33 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/9e93e324-b274-4803-92d3-ee509e0a06d5" status: 200 len: 1533 microversion: 2.1 time: 1.956849 Oct 18 15:42:53.306289 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1989/3988] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:51 2022] GET /compute/v2.1/servers/9e93e324-b274-4803-92d3-ee509e0a06d5 => generated 1533 bytes in 1974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:53.311271 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ebd37f13-6165-4659-b37d-4549fc5df528 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:53.324322 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ebd37f13-6165-4659-b37d-4549fc5df528 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:53.330575 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=6 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:42:53.371282 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ebd37f13-6165-4659-b37d-4549fc5df528 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:53.377740 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ebd37f13-6165-4659-b37d-4549fc5df528 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:53.378204 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ebd37f13-6165-4659-b37d-4549fc5df528 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:53.388471 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ebd37f13-6165-4659-b37d-4549fc5df528 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:53.389149 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ebd37f13-6165-4659-b37d-4549fc5df528 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:53.389597 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ebd37f13-6165-4659-b37d-4549fc5df528 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:53.847179 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e88230f6-74c1-4147-baaf-15356eceb415 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:53.860522 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e88230f6-74c1-4147-baaf-15356eceb415 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:53.862317 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e88230f6-74c1-4147-baaf-15356eceb415 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:53.866330 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e88230f6-74c1-4147-baaf-15356eceb415 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 200 len: 2956 microversion: 2.32 time: 1.238588 Oct 18 15:42:53.870212 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2000/3989] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:42:52 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 2956 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:42:53.875659 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4b7cdc9f-0050-47c4-a544-20a60beeaedd tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:53.876564 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4b7cdc9f-0050-47c4-a544-20a60beeaedd tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:53.884963 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:42:53.887420 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b7cdc9f-0050-47c4-a544-20a60beeaedd tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:53.888218 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b7cdc9f-0050-47c4-a544-20a60beeaedd tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:53.888935 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b7cdc9f-0050-47c4-a544-20a60beeaedd tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:53.889892 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b7cdc9f-0050-47c4-a544-20a60beeaedd tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:53.890582 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b7cdc9f-0050-47c4-a544-20a60beeaedd tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:53.895315 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b7cdc9f-0050-47c4-a544-20a60beeaedd tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:54.276946 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4b7cdc9f-0050-47c4-a544-20a60beeaedd tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:54.289995 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4b7cdc9f-0050-47c4-a544-20a60beeaedd tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1684 microversion: 2.1 time: 0.417251 Oct 18 15:42:54.306976 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2001/3990] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:53 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1684 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:54.320721 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-a20e6f4d-9d34-41ec-aee8-fd0782e07648 req-b3242b97-46b2-4389-afc2-143f30cead9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cc69e2e-cb26-42d6-b887-31e0afaa69fc", "tag": "c9ee9ae4-c0ad-4fa3-a68e-56018fcf2c7f"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:42:54.345270 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a20e6f4d-9d34-41ec-aee8-fd0782e07648 req-b3242b97-46b2-4389-afc2-143f30cead9e service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:54.352598 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a20e6f4d-9d34-41ec-aee8-fd0782e07648 req-b3242b97-46b2-4389-afc2-143f30cead9e service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:54.353337 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a20e6f4d-9d34-41ec-aee8-fd0782e07648 req-b3242b97-46b2-4389-afc2-143f30cead9e service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:54.378943 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-a20e6f4d-9d34-41ec-aee8-fd0782e07648 req-b3242b97-46b2-4389-afc2-143f30cead9e service nova] Creating event network-changed:c9ee9ae4-c0ad-4fa3-a68e-56018fcf2c7f for instance 2cc69e2e-cb26-42d6-b887-31e0afaa69fc on n-h2-853682-5 Oct 18 15:42:54.394260 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-a20e6f4d-9d34-41ec-aee8-fd0782e07648 req-b3242b97-46b2-4389-afc2-143f30cead9e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085713 Oct 18 15:42:54.395223 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2002/3991] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:42:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:42:54.410139 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-038aede6-44c3-4a26-a5ee-48b1c026e085 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:54.410858 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-038aede6-44c3-4a26-a5ee-48b1c026e085 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 9e93e324-b274-4803-92d3-ee509e0a06d5] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:54.425251 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-038aede6-44c3-4a26-a5ee-48b1c026e085 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:54.427489 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-038aede6-44c3-4a26-a5ee-48b1c026e085 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:54.427958 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-038aede6-44c3-4a26-a5ee-48b1c026e085 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:54.428680 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-038aede6-44c3-4a26-a5ee-48b1c026e085 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:54.433642 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-038aede6-44c3-4a26-a5ee-48b1c026e085 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:54.434134 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-038aede6-44c3-4a26-a5ee-48b1c026e085 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:54.478304 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ebd37f13-6165-4659-b37d-4549fc5df528 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:54.487433 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ebd37f13-6165-4659-b37d-4549fc5df528 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1317 microversion: 2.1 time: 1.179857 Oct 18 15:42:54.515059 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1990/3992] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:53 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1317 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:54.899634 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e568b000-7a48-4e46-bd50-8c1adfa62680 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:54.904343 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e568b000-7a48-4e46-bd50-8c1adfa62680 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:54.914341 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e568b000-7a48-4e46-bd50-8c1adfa62680 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:54.915102 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e568b000-7a48-4e46-bd50-8c1adfa62680 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:54.915734 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e568b000-7a48-4e46-bd50-8c1adfa62680 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:54.917098 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e568b000-7a48-4e46-bd50-8c1adfa62680 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:54.917762 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e568b000-7a48-4e46-bd50-8c1adfa62680 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:54.918366 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e568b000-7a48-4e46-bd50-8c1adfa62680 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:55.365447 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e568b000-7a48-4e46-bd50-8c1adfa62680 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:55.414015 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e568b000-7a48-4e46-bd50-8c1adfa62680 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:55.419600 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e568b000-7a48-4e46-bd50-8c1adfa62680 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:55.425388 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e568b000-7a48-4e46-bd50-8c1adfa62680 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 200 len: 2956 microversion: 2.32 time: 0.530804 Oct 18 15:42:55.426578 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1991/3993] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:42:54 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 2956 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:42:55.440499 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a88fa472-72c6-42d7-ba0a-0ac8869a0fcc tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:55.442893 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a88fa472-72c6-42d7-ba0a-0ac8869a0fcc tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:55.467596 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a88fa472-72c6-42d7-ba0a-0ac8869a0fcc tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:55.502677 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a88fa472-72c6-42d7-ba0a-0ac8869a0fcc tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.039s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:55.508107 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a88fa472-72c6-42d7-ba0a-0ac8869a0fcc tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:55.509090 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a88fa472-72c6-42d7-ba0a-0ac8869a0fcc tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:55.511109 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a88fa472-72c6-42d7-ba0a-0ac8869a0fcc tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:55.511745 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a88fa472-72c6-42d7-ba0a-0ac8869a0fcc tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:56.051377 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-038aede6-44c3-4a26-a5ee-48b1c026e085 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:56.061107 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-038aede6-44c3-4a26-a5ee-48b1c026e085 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/9e93e324-b274-4803-92d3-ee509e0a06d5" status: 200 len: 1539 microversion: 2.1 time: 1.664137 Oct 18 15:42:56.068181 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2003/3994] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:54 2022] GET /compute/v2.1/servers/9e93e324-b274-4803-92d3-ee509e0a06d5 => generated 1539 bytes in 1672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:56.075040 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f80e70c6-35b7-4fb2-952d-80d31fc943be tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:56.081451 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f80e70c6-35b7-4fb2-952d-80d31fc943be tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:56.094940 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f80e70c6-35b7-4fb2-952d-80d31fc943be tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:56.096134 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f80e70c6-35b7-4fb2-952d-80d31fc943be tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:56.096759 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f80e70c6-35b7-4fb2-952d-80d31fc943be tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:56.099995 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f80e70c6-35b7-4fb2-952d-80d31fc943be tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:56.100668 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f80e70c6-35b7-4fb2-952d-80d31fc943be tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:56.101704 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f80e70c6-35b7-4fb2-952d-80d31fc943be tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:56.513832 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a88fa472-72c6-42d7-ba0a-0ac8869a0fcc tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:56.529757 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a88fa472-72c6-42d7-ba0a-0ac8869a0fcc tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1684 microversion: 2.1 time: 1.101851 Oct 18 15:42:56.533678 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1992/3995] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:55 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1684 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:56.562236 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-32271627-1215-4624-a84a-b2ffc3b3cffc req-c6a47774-0ef7-47ca-ab68-66ebb24e9caa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e93e324-b274-4803-92d3-ee509e0a06d5", "name": "network-vif-plugged", "status": "completed", "tag": "b79ec16f-f483-4b30-af6f-e7fb99854c98"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:42:56.611061 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-32271627-1215-4624-a84a-b2ffc3b3cffc req-c6a47774-0ef7-47ca-ab68-66ebb24e9caa service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:56.613155 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-32271627-1215-4624-a84a-b2ffc3b3cffc req-c6a47774-0ef7-47ca-ab68-66ebb24e9caa service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:56.614972 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-32271627-1215-4624-a84a-b2ffc3b3cffc req-c6a47774-0ef7-47ca-ab68-66ebb24e9caa service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:56.643344 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-32271627-1215-4624-a84a-b2ffc3b3cffc req-c6a47774-0ef7-47ca-ab68-66ebb24e9caa service nova] Creating event network-vif-plugged:b79ec16f-f483-4b30-af6f-e7fb99854c98 for instance 9e93e324-b274-4803-92d3-ee509e0a06d5 on n-h1-853682-5 Oct 18 15:42:56.685957 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-32271627-1215-4624-a84a-b2ffc3b3cffc req-c6a47774-0ef7-47ca-ab68-66ebb24e9caa service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124577 Oct 18 15:42:56.687015 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1993/3996] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:42:56.687862 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f80e70c6-35b7-4fb2-952d-80d31fc943be tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:56.703394 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e50d1265-f616-4801-8408-6127c23cc9df tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:56.709728 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e50d1265-f616-4801-8408-6127c23cc9df tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:56.722833 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e50d1265-f616-4801-8408-6127c23cc9df tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:56.723343 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e50d1265-f616-4801-8408-6127c23cc9df tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:56.723789 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e50d1265-f616-4801-8408-6127c23cc9df tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:56.724509 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e50d1265-f616-4801-8408-6127c23cc9df tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:56.729212 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e50d1265-f616-4801-8408-6127c23cc9df tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:56.729756 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e50d1265-f616-4801-8408-6127c23cc9df tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:56.756196 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f80e70c6-35b7-4fb2-952d-80d31fc943be tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1317 microversion: 2.1 time: 0.686402 Oct 18 15:42:56.801761 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2004/3997] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:56 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1317 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:57.105890 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8b6531f8-fc37-4d5d-9aa3-a68f87bde9ef tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:57.115631 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8b6531f8-fc37-4d5d-9aa3-a68f87bde9ef tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 9e93e324-b274-4803-92d3-ee509e0a06d5] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:57.157947 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b6531f8-fc37-4d5d-9aa3-a68f87bde9ef tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:57.158572 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b6531f8-fc37-4d5d-9aa3-a68f87bde9ef tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:57.161347 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b6531f8-fc37-4d5d-9aa3-a68f87bde9ef tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:57.162244 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b6531f8-fc37-4d5d-9aa3-a68f87bde9ef tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:57.162856 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b6531f8-fc37-4d5d-9aa3-a68f87bde9ef tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:57.170482 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b6531f8-fc37-4d5d-9aa3-a68f87bde9ef tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:58.205358 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e50d1265-f616-4801-8408-6127c23cc9df tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:58.224005 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e50d1265-f616-4801-8408-6127c23cc9df tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:58.225935 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e50d1265-f616-4801-8408-6127c23cc9df tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:58.227682 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e50d1265-f616-4801-8408-6127c23cc9df tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 200 len: 2935 microversion: 2.32 time: 1.539534 Oct 18 15:42:58.228508 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1994/3998] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:42:56 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 2935 bytes in 1541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:42:58.240395 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f988f9b2-ce89-433f-ab1f-3aa0b85b6dd1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:58.241398 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f988f9b2-ce89-433f-ab1f-3aa0b85b6dd1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:58.255033 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f988f9b2-ce89-433f-ab1f-3aa0b85b6dd1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:58.257644 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f988f9b2-ce89-433f-ab1f-3aa0b85b6dd1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:58.265766 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f988f9b2-ce89-433f-ab1f-3aa0b85b6dd1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:58.267508 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f988f9b2-ce89-433f-ab1f-3aa0b85b6dd1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:58.268216 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f988f9b2-ce89-433f-ab1f-3aa0b85b6dd1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:58.268900 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f988f9b2-ce89-433f-ab1f-3aa0b85b6dd1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:58.486824 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8b6531f8-fc37-4d5d-9aa3-a68f87bde9ef tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:58.496515 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8b6531f8-fc37-4d5d-9aa3-a68f87bde9ef tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/9e93e324-b274-4803-92d3-ee509e0a06d5" status: 200 len: 1534 microversion: 2.1 time: 1.403315 Oct 18 15:42:58.513523 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2005/3999] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:57 2022] GET /compute/v2.1/servers/9e93e324-b274-4803-92d3-ee509e0a06d5 => generated 1534 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:42:58.518715 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cd101d9d-0471-42ec-8a33-6d625926d45e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:58.519667 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cd101d9d-0471-42ec-8a33-6d625926d45e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:58.550910 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd101d9d-0471-42ec-8a33-6d625926d45e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:58.553072 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd101d9d-0471-42ec-8a33-6d625926d45e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:58.553810 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd101d9d-0471-42ec-8a33-6d625926d45e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:58.554804 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd101d9d-0471-42ec-8a33-6d625926d45e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:58.555475 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd101d9d-0471-42ec-8a33-6d625926d45e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:58.556121 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd101d9d-0471-42ec-8a33-6d625926d45e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:59.446363 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f988f9b2-ce89-433f-ab1f-3aa0b85b6dd1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:42:59.461988 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f988f9b2-ce89-433f-ab1f-3aa0b85b6dd1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1684 microversion: 2.1 time: 1.232151 Oct 18 15:42:59.462589 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1995/4000] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:58 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1684 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:42:59.481024 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-2e6ff5d9-9f7e-478f-823f-e3bfae693995 req-0a433391-acf7-4cda-83e7-cabf9c1ec742 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf8f81da-4aa0-498d-af1e-c036238f065d", "name": "network-vif-unplugged", "status": "completed", "tag": "728b9ef4-fe70-49aa-a715-30bd7cc7b07b"}, {"server_uuid": "cf8f81da-4aa0-498d-af1e-c036238f065d", "name": "network-vif-unplugged", "status": "completed", "tag": "9959fd2b-3b15-4847-9dc1-507d84d0b4df"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:42:59.509509 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-2e6ff5d9-9f7e-478f-823f-e3bfae693995 req-0a433391-acf7-4cda-83e7-cabf9c1ec742 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:59.509985 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-2e6ff5d9-9f7e-478f-823f-e3bfae693995 req-0a433391-acf7-4cda-83e7-cabf9c1ec742 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:59.510412 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-2e6ff5d9-9f7e-478f-823f-e3bfae693995 req-0a433391-acf7-4cda-83e7-cabf9c1ec742 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:59.539572 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-2e6ff5d9-9f7e-478f-823f-e3bfae693995 req-0a433391-acf7-4cda-83e7-cabf9c1ec742 service nova] Creating event network-vif-unplugged:728b9ef4-fe70-49aa-a715-30bd7cc7b07b for instance cf8f81da-4aa0-498d-af1e-c036238f065d on n-h2-853682-5 Oct 18 15:42:59.550134 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-2e6ff5d9-9f7e-478f-823f-e3bfae693995 req-0a433391-acf7-4cda-83e7-cabf9c1ec742 service nova] Creating event network-vif-unplugged:9959fd2b-3b15-4847-9dc1-507d84d0b4df for instance cf8f81da-4aa0-498d-af1e-c036238f065d on n-h2-853682-5 Oct 18 15:42:59.566645 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-2e6ff5d9-9f7e-478f-823f-e3bfae693995 req-0a433391-acf7-4cda-83e7-cabf9c1ec742 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.102796 Oct 18 15:42:59.567854 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1996/4001] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:42:59 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:42:59.638366 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-83185ea2-455a-4db7-b480-c86b7fa6fb27 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:42:59.638366 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-83185ea2-455a-4db7-b480-c86b7fa6fb27 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:42:59.638366 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-83185ea2-455a-4db7-b480-c86b7fa6fb27 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:59.638366 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-83185ea2-455a-4db7-b480-c86b7fa6fb27 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:59.638366 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-83185ea2-455a-4db7-b480-c86b7fa6fb27 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:42:59.638366 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-83185ea2-455a-4db7-b480-c86b7fa6fb27 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:42:59.638366 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-83185ea2-455a-4db7-b480-c86b7fa6fb27 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:42:59.638366 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-83185ea2-455a-4db7-b480-c86b7fa6fb27 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:00.427502 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cd101d9d-0471-42ec-8a33-6d625926d45e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:00.440537 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cd101d9d-0471-42ec-8a33-6d625926d45e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1317 microversion: 2.1 time: 1.924382 Oct 18 15:43:00.443814 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2006/4002] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:42:58 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1317 bytes in 1929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:00.467131 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-16e7655f-2091-480e-b815-fb02d729a591 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:00.470052 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-16e7655f-2091-480e-b815-fb02d729a591 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 9e93e324-b274-4803-92d3-ee509e0a06d5] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:00.505542 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16e7655f-2091-480e-b815-fb02d729a591 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:00.507170 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16e7655f-2091-480e-b815-fb02d729a591 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:00.507785 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16e7655f-2091-480e-b815-fb02d729a591 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:00.511762 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16e7655f-2091-480e-b815-fb02d729a591 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:00.514591 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16e7655f-2091-480e-b815-fb02d729a591 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:00.515340 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16e7655f-2091-480e-b815-fb02d729a591 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:00.909708 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-83185ea2-455a-4db7-b480-c86b7fa6fb27 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:00.942265 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-83185ea2-455a-4db7-b480-c86b7fa6fb27 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:00.947532 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-83185ea2-455a-4db7-b480-c86b7fa6fb27 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:00.952780 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-83185ea2-455a-4db7-b480-c86b7fa6fb27 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 200 len: 2935 microversion: 2.32 time: 1.380575 Oct 18 15:43:00.958454 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1997/4003] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:42:59 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 2935 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:43:00.972589 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2eba4393-2019-40d1-9766-f542df7af8ad tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:00.974299 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2eba4393-2019-40d1-9766-f542df7af8ad tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:00.987313 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2eba4393-2019-40d1-9766-f542df7af8ad tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:00.988921 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2eba4393-2019-40d1-9766-f542df7af8ad tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:00.989870 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2eba4393-2019-40d1-9766-f542df7af8ad tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:00.990969 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2eba4393-2019-40d1-9766-f542df7af8ad tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:00.992111 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2eba4393-2019-40d1-9766-f542df7af8ad tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:00.992696 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2eba4393-2019-40d1-9766-f542df7af8ad tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:01.278543 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-16e7655f-2091-480e-b815-fb02d729a591 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:01.291112 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-16e7655f-2091-480e-b815-fb02d729a591 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/9e93e324-b274-4803-92d3-ee509e0a06d5" status: 200 len: 1521 microversion: 2.1 time: 0.842847 Oct 18 15:43:01.297175 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2007/4004] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:00 2022] GET /compute/v2.1/servers/9e93e324-b274-4803-92d3-ee509e0a06d5 => generated 1521 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:01.320464 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d042defa-3ee9-4559-9639-9eb08449ec56 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:01.325848 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d042defa-3ee9-4559-9639-9eb08449ec56 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 9e93e324-b274-4803-92d3-ee509e0a06d5] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:01.337769 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d042defa-3ee9-4559-9639-9eb08449ec56 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:01.338487 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d042defa-3ee9-4559-9639-9eb08449ec56 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:01.339138 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d042defa-3ee9-4559-9639-9eb08449ec56 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:01.340074 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d042defa-3ee9-4559-9639-9eb08449ec56 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:01.348353 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d042defa-3ee9-4559-9639-9eb08449ec56 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:01.350993 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d042defa-3ee9-4559-9639-9eb08449ec56 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:01.409105 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d042defa-3ee9-4559-9639-9eb08449ec56 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 9e93e324-b274-4803-92d3-ee509e0a06d5] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:43:01.504518 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:43:01.592469 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d042defa-3ee9-4559-9639-9eb08449ec56 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9e93e324-b274-4803-92d3-ee509e0a06d5" status: 204 len: 0 microversion: 2.1 time: 0.273078 Oct 18 15:43:01.593394 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2008/4005] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:43:01 2022] DELETE /compute/v2.1/servers/9e93e324-b274-4803-92d3-ee509e0a06d5 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:43:01.595494 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2eba4393-2019-40d1-9766-f542df7af8ad tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:01.602149 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6430ef20-dfaa-4d21-9469-ccefb36cbe69 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:01.603288 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6430ef20-dfaa-4d21-9469-ccefb36cbe69 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:01.612693 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6430ef20-dfaa-4d21-9469-ccefb36cbe69 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:01.613524 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6430ef20-dfaa-4d21-9469-ccefb36cbe69 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:01.614162 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6430ef20-dfaa-4d21-9469-ccefb36cbe69 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:01.615096 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6430ef20-dfaa-4d21-9469-ccefb36cbe69 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:01.615797 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6430ef20-dfaa-4d21-9469-ccefb36cbe69 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:01.616426 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6430ef20-dfaa-4d21-9469-ccefb36cbe69 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:01.625398 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2eba4393-2019-40d1-9766-f542df7af8ad tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1684 microversion: 2.1 time: 0.658944 Oct 18 15:43:01.632897 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1998/4006] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:00 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1684 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:01.640342 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f5ffd49a-d201-43e1-91d9-e20c6ab758bc tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:01.641886 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f5ffd49a-d201-43e1-91d9-e20c6ab758bc tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 9e93e324-b274-4803-92d3-ee509e0a06d5] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:01.662621 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f5ffd49a-d201-43e1-91d9-e20c6ab758bc tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:01.665204 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f5ffd49a-d201-43e1-91d9-e20c6ab758bc tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:01.668645 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f5ffd49a-d201-43e1-91d9-e20c6ab758bc tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:01.669938 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f5ffd49a-d201-43e1-91d9-e20c6ab758bc tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:01.671547 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f5ffd49a-d201-43e1-91d9-e20c6ab758bc tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:01.673125 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f5ffd49a-d201-43e1-91d9-e20c6ab758bc tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:02.071607 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6430ef20-dfaa-4d21-9469-ccefb36cbe69 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:02.083617 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6430ef20-dfaa-4d21-9469-ccefb36cbe69 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1317 microversion: 2.1 time: 0.486590 Oct 18 15:43:02.104760 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2009/4007] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:01 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1317 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:02.111879 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-eb487b55-5177-4fc8-962d-68f927f4ceda req-9097c5e8-472d-4a21-a562-6bcc90abf0d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf8f81da-4aa0-498d-af1e-c036238f065d", "name": "network-vif-unplugged", "status": "completed", "tag": "c4a0dc0d-0a7d-4afc-aa10-4271ba62b220"}, {"server_uuid": "cf8f81da-4aa0-498d-af1e-c036238f065d", "name": "network-vif-unplugged", "status": "completed", "tag": "6804cdcb-ecb6-4eec-8de0-cc16a6d64f70"}, {"server_uuid": "cf8f81da-4aa0-498d-af1e-c036238f065d", "name": "network-vif-unplugged", "status": "completed", "tag": "f0425d60-0a1e-42b2-b227-5934c9fcdf26"}, {"server_uuid": "cf8f81da-4aa0-498d-af1e-c036238f065d", "name": "network-vif-unplugged", "status": "completed", "tag": "56a32c33-244b-49a6-ab44-eb8dae785efb"}, {"server_uuid": "9e93e324-b274-4803-92d3-ee509e0a06d5", "name": "network-vif-unplugged", "status": "completed", "tag": "b79ec16f-f483-4b30-af6f-e7fb99854c98"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:43:02.125716 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-eb487b55-5177-4fc8-962d-68f927f4ceda req-9097c5e8-472d-4a21-a562-6bcc90abf0d7 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:02.126370 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-eb487b55-5177-4fc8-962d-68f927f4ceda req-9097c5e8-472d-4a21-a562-6bcc90abf0d7 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:02.127078 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-eb487b55-5177-4fc8-962d-68f927f4ceda req-9097c5e8-472d-4a21-a562-6bcc90abf0d7 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:02.131800 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f5ffd49a-d201-43e1-91d9-e20c6ab758bc tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:02.142105 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f5ffd49a-d201-43e1-91d9-e20c6ab758bc tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/9e93e324-b274-4803-92d3-ee509e0a06d5" status: 200 len: 1527 microversion: 2.1 time: 0.506788 Oct 18 15:43:02.143002 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 1999/4008] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:01 2022] GET /compute/v2.1/servers/9e93e324-b274-4803-92d3-ee509e0a06d5 => generated 1527 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:02.148968 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2f1ac61a-a7b4-451b-8123-3d00fafecb77 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:02.149784 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2f1ac61a-a7b4-451b-8123-3d00fafecb77 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:02.149909 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-eb487b55-5177-4fc8-962d-68f927f4ceda req-9097c5e8-472d-4a21-a562-6bcc90abf0d7 service nova] Creating event network-vif-unplugged:c4a0dc0d-0a7d-4afc-aa10-4271ba62b220 for instance cf8f81da-4aa0-498d-af1e-c036238f065d on n-h2-853682-5 Oct 18 15:43:02.152433 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-eb487b55-5177-4fc8-962d-68f927f4ceda req-9097c5e8-472d-4a21-a562-6bcc90abf0d7 service nova] Creating event network-vif-unplugged:6804cdcb-ecb6-4eec-8de0-cc16a6d64f70 for instance cf8f81da-4aa0-498d-af1e-c036238f065d on n-h2-853682-5 Oct 18 15:43:02.153522 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-eb487b55-5177-4fc8-962d-68f927f4ceda req-9097c5e8-472d-4a21-a562-6bcc90abf0d7 service nova] Creating event network-vif-unplugged:f0425d60-0a1e-42b2-b227-5934c9fcdf26 for instance cf8f81da-4aa0-498d-af1e-c036238f065d on n-h2-853682-5 Oct 18 15:43:02.154283 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-eb487b55-5177-4fc8-962d-68f927f4ceda req-9097c5e8-472d-4a21-a562-6bcc90abf0d7 service nova] Creating event network-vif-unplugged:56a32c33-244b-49a6-ab44-eb8dae785efb for instance cf8f81da-4aa0-498d-af1e-c036238f065d on n-h2-853682-5 Oct 18 15:43:02.155883 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-eb487b55-5177-4fc8-962d-68f927f4ceda req-9097c5e8-472d-4a21-a562-6bcc90abf0d7 service nova] Creating event network-vif-unplugged:b79ec16f-f483-4b30-af6f-e7fb99854c98 for instance 9e93e324-b274-4803-92d3-ee509e0a06d5 on n-h1-853682-5 Oct 18 15:43:02.159133 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2f1ac61a-a7b4-451b-8123-3d00fafecb77 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:02.160285 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2f1ac61a-a7b4-451b-8123-3d00fafecb77 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:02.160881 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2f1ac61a-a7b4-451b-8123-3d00fafecb77 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:02.161718 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2f1ac61a-a7b4-451b-8123-3d00fafecb77 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:02.162298 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2f1ac61a-a7b4-451b-8123-3d00fafecb77 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:02.163351 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2f1ac61a-a7b4-451b-8123-3d00fafecb77 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:02.166921 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-eb487b55-5177-4fc8-962d-68f927f4ceda req-9097c5e8-472d-4a21-a562-6bcc90abf0d7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 877 microversion: 2.1 time: 0.060658 Oct 18 15:43:02.167911 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2010/4009] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:43:02 2022] POST /compute/v2.1/os-server-external-events => generated 877 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:43:02.709945 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4d4136df-6c9a-40eb-9159-fc96e769228e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:02.711679 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4d4136df-6c9a-40eb-9159-fc96e769228e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:02.735757 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d4136df-6c9a-40eb-9159-fc96e769228e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:02.741571 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d4136df-6c9a-40eb-9159-fc96e769228e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:02.742370 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d4136df-6c9a-40eb-9159-fc96e769228e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:02.745259 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d4136df-6c9a-40eb-9159-fc96e769228e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:02.746113 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d4136df-6c9a-40eb-9159-fc96e769228e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:02.748144 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d4136df-6c9a-40eb-9159-fc96e769228e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:03.016546 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2f1ac61a-a7b4-451b-8123-3d00fafecb77 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:03.030586 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2f1ac61a-a7b4-451b-8123-3d00fafecb77 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:03.033627 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2f1ac61a-a7b4-451b-8123-3d00fafecb77 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:03.037603 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2f1ac61a-a7b4-451b-8123-3d00fafecb77 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 200 len: 2914 microversion: 2.32 time: 0.893506 Oct 18 15:43:03.053232 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2000/4010] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:43:02 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 2914 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:43:03.076111 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-6436b4d2-a77e-40a7-a2b2-8afd46be144d req-ef0c1a0b-d139-487b-8398-7dc396c7f8cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf8f81da-4aa0-498d-af1e-c036238f065d", "name": "network-vif-deleted", "tag": "9959fd2b-3b15-4847-9dc1-507d84d0b4df"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:43:03.091418 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-6436b4d2-a77e-40a7-a2b2-8afd46be144d req-ef0c1a0b-d139-487b-8398-7dc396c7f8cc service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:03.092670 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-6436b4d2-a77e-40a7-a2b2-8afd46be144d req-ef0c1a0b-d139-487b-8398-7dc396c7f8cc service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:03.093989 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-6436b4d2-a77e-40a7-a2b2-8afd46be144d req-ef0c1a0b-d139-487b-8398-7dc396c7f8cc service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:03.118722 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-6436b4d2-a77e-40a7-a2b2-8afd46be144d req-ef0c1a0b-d139-487b-8398-7dc396c7f8cc service nova] Creating event network-vif-deleted:9959fd2b-3b15-4847-9dc1-507d84d0b4df for instance cf8f81da-4aa0-498d-af1e-c036238f065d on n-h2-853682-5 Oct 18 15:43:03.133100 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-6436b4d2-a77e-40a7-a2b2-8afd46be144d req-ef0c1a0b-d139-487b-8398-7dc396c7f8cc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076892 Oct 18 15:43:03.135172 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2001/4011] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:43:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:43:03.155810 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0d09fb4d-7cf3-4d31-9ce0-0d2854938391 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:03.159673 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0d09fb4d-7cf3-4d31-9ce0-0d2854938391 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:03.183089 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0d09fb4d-7cf3-4d31-9ce0-0d2854938391 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:03.185651 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0d09fb4d-7cf3-4d31-9ce0-0d2854938391 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:03.186416 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0d09fb4d-7cf3-4d31-9ce0-0d2854938391 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:03.188501 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0d09fb4d-7cf3-4d31-9ce0-0d2854938391 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:03.189553 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0d09fb4d-7cf3-4d31-9ce0-0d2854938391 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:03.191469 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0d09fb4d-7cf3-4d31-9ce0-0d2854938391 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:03.233849 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:43:03.955608 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4d4136df-6c9a-40eb-9159-fc96e769228e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:03.975889 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4d4136df-6c9a-40eb-9159-fc96e769228e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1684 microversion: 2.1 time: 1.278078 Oct 18 15:43:03.977268 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2011/4012] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:02 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1684 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:03.983487 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fd05537f-3f1f-479c-adf6-9b9fda52146f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:03.984351 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fd05537f-3f1f-479c-adf6-9b9fda52146f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 9e93e324-b274-4803-92d3-ee509e0a06d5] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:03.992646 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd05537f-3f1f-479c-adf6-9b9fda52146f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:03.993444 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd05537f-3f1f-479c-adf6-9b9fda52146f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:03.994085 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd05537f-3f1f-479c-adf6-9b9fda52146f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:03.994792 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd05537f-3f1f-479c-adf6-9b9fda52146f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:03.995250 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd05537f-3f1f-479c-adf6-9b9fda52146f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:03.995676 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd05537f-3f1f-479c-adf6-9b9fda52146f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:04.779648 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fd05537f-3f1f-479c-adf6-9b9fda52146f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:04.798898 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fd05537f-3f1f-479c-adf6-9b9fda52146f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/9e93e324-b274-4803-92d3-ee509e0a06d5" status: 200 len: 1527 microversion: 2.1 time: 0.820213 Oct 18 15:43:04.812840 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2012/4013] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:03 2022] GET /compute/v2.1/servers/9e93e324-b274-4803-92d3-ee509e0a06d5 => generated 1527 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:04.812840 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e4a5f21b-41b8-4552-b803-c96da3bb80fa tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:04.812840 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e4a5f21b-41b8-4552-b803-c96da3bb80fa tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:04.818018 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0d09fb4d-7cf3-4d31-9ce0-0d2854938391 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:04.827010 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4a5f21b-41b8-4552-b803-c96da3bb80fa tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:04.827669 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4a5f21b-41b8-4552-b803-c96da3bb80fa tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:04.828177 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4a5f21b-41b8-4552-b803-c96da3bb80fa tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:04.829055 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4a5f21b-41b8-4552-b803-c96da3bb80fa tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:04.829519 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4a5f21b-41b8-4552-b803-c96da3bb80fa tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:04.830007 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4a5f21b-41b8-4552-b803-c96da3bb80fa tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:04.831850 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0d09fb4d-7cf3-4d31-9ce0-0d2854938391 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1317 microversion: 2.1 time: 1.694797 Oct 18 15:43:04.839051 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2002/4014] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:03 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1317 bytes in 1702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:04.847762 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-fb259494-22fd-445a-b187-b3aa89d9069c req-fd52c5e0-5dd1-4148-8e20-141b4e61d61d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cc69e2e-cb26-42d6-b887-31e0afaa69fc", "name": "network-vif-plugged", "status": "completed", "tag": "c9ee9ae4-c0ad-4fa3-a68e-56018fcf2c7f"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:43:04.871902 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-fb259494-22fd-445a-b187-b3aa89d9069c req-fd52c5e0-5dd1-4148-8e20-141b4e61d61d service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:04.873955 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-fb259494-22fd-445a-b187-b3aa89d9069c req-fd52c5e0-5dd1-4148-8e20-141b4e61d61d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:04.875316 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-fb259494-22fd-445a-b187-b3aa89d9069c req-fd52c5e0-5dd1-4148-8e20-141b4e61d61d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:04.895866 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-fb259494-22fd-445a-b187-b3aa89d9069c req-fd52c5e0-5dd1-4148-8e20-141b4e61d61d service nova] Creating event network-vif-plugged:c9ee9ae4-c0ad-4fa3-a68e-56018fcf2c7f for instance 2cc69e2e-cb26-42d6-b887-31e0afaa69fc on n-h2-853682-5 Oct 18 15:43:04.931609 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-fb259494-22fd-445a-b187-b3aa89d9069c req-fd52c5e0-5dd1-4148-8e20-141b4e61d61d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088457 Oct 18 15:43:04.932478 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2003/4015] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:43:05.001914 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-553f2261-5bfc-4a3e-8e1b-84810b4f39b2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:05.002726 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-553f2261-5bfc-4a3e-8e1b-84810b4f39b2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:05.012344 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-553f2261-5bfc-4a3e-8e1b-84810b4f39b2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:05.013056 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-553f2261-5bfc-4a3e-8e1b-84810b4f39b2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:05.013747 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-553f2261-5bfc-4a3e-8e1b-84810b4f39b2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:05.014724 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-553f2261-5bfc-4a3e-8e1b-84810b4f39b2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:05.015189 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-553f2261-5bfc-4a3e-8e1b-84810b4f39b2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:05.016626 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-553f2261-5bfc-4a3e-8e1b-84810b4f39b2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:06.124200 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-553f2261-5bfc-4a3e-8e1b-84810b4f39b2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:06.148909 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-553f2261-5bfc-4a3e-8e1b-84810b4f39b2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1684 microversion: 2.1 time: 1.151182 Oct 18 15:43:06.150086 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2004/4016] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:04 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1684 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:06.157442 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-196a96c1-d545-424a-a884-3f5e07c40eba req-f3cd5ede-40f1-4070-bac2-402697faa03f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf8f81da-4aa0-498d-af1e-c036238f065d", "name": "network-vif-deleted", "tag": "f0425d60-0a1e-42b2-b227-5934c9fcdf26"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:43:06.174029 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-196a96c1-d545-424a-a884-3f5e07c40eba req-f3cd5ede-40f1-4070-bac2-402697faa03f service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:06.174748 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-196a96c1-d545-424a-a884-3f5e07c40eba req-f3cd5ede-40f1-4070-bac2-402697faa03f service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:06.175547 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-196a96c1-d545-424a-a884-3f5e07c40eba req-f3cd5ede-40f1-4070-bac2-402697faa03f service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:06.189583 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-196a96c1-d545-424a-a884-3f5e07c40eba req-f3cd5ede-40f1-4070-bac2-402697faa03f service nova] Creating event network-vif-deleted:f0425d60-0a1e-42b2-b227-5934c9fcdf26 for instance cf8f81da-4aa0-498d-af1e-c036238f065d on n-h2-853682-5 Oct 18 15:43:06.195537 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-196a96c1-d545-424a-a884-3f5e07c40eba req-f3cd5ede-40f1-4070-bac2-402697faa03f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043957 Oct 18 15:43:06.196866 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2005/4017] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:43:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:43:06.202724 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b4dd01a2-4f9d-49d8-ac20-116da6fbbfd2 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:06.204780 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b4dd01a2-4f9d-49d8-ac20-116da6fbbfd2 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 9e93e324-b274-4803-92d3-ee509e0a06d5] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:06.222473 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b4dd01a2-4f9d-49d8-ac20-116da6fbbfd2 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:06.223048 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b4dd01a2-4f9d-49d8-ac20-116da6fbbfd2 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:06.223548 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b4dd01a2-4f9d-49d8-ac20-116da6fbbfd2 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:06.224268 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b4dd01a2-4f9d-49d8-ac20-116da6fbbfd2 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:06.224920 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b4dd01a2-4f9d-49d8-ac20-116da6fbbfd2 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:06.225555 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b4dd01a2-4f9d-49d8-ac20-116da6fbbfd2 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:06.226360 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e4a5f21b-41b8-4552-b803-c96da3bb80fa tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:06.235925 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e4a5f21b-41b8-4552-b803-c96da3bb80fa tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:06.237499 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e4a5f21b-41b8-4552-b803-c96da3bb80fa tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:06.238758 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e4a5f21b-41b8-4552-b803-c96da3bb80fa tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 200 len: 2706 microversion: 2.32 time: 1.437907 Oct 18 15:43:06.255305 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2013/4018] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:43:04 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 2706 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:43:06.260364 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8f1a7abc-5635-497b-90c7-f828ba7583b5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:06.261114 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8f1a7abc-5635-497b-90c7-f828ba7583b5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:06.293416 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f1a7abc-5635-497b-90c7-f828ba7583b5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:06.293918 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f1a7abc-5635-497b-90c7-f828ba7583b5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:06.294666 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f1a7abc-5635-497b-90c7-f828ba7583b5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:06.295446 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f1a7abc-5635-497b-90c7-f828ba7583b5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:06.295941 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f1a7abc-5635-497b-90c7-f828ba7583b5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:06.296384 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f1a7abc-5635-497b-90c7-f828ba7583b5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:06.460590 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b4dd01a2-4f9d-49d8-ac20-116da6fbbfd2 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:06.468721 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b4dd01a2-4f9d-49d8-ac20-116da6fbbfd2 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/9e93e324-b274-4803-92d3-ee509e0a06d5" status: 200 len: 1485 microversion: 2.1 time: 0.270483 Oct 18 15:43:06.473812 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2006/4019] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:06 2022] GET /compute/v2.1/servers/9e93e324-b274-4803-92d3-ee509e0a06d5 => generated 1485 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:06.482678 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-76ce7eea-2b51-48e3-9fb8-aa625ded3e70 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:06.483184 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-76ce7eea-2b51-48e3-9fb8-aa625ded3e70 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 47ee1803-1ce0-4cbc-879e-d39cfe8576aa] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:06.501101 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-76ce7eea-2b51-48e3-9fb8-aa625ded3e70 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:06.502013 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-76ce7eea-2b51-48e3-9fb8-aa625ded3e70 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:06.503103 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-76ce7eea-2b51-48e3-9fb8-aa625ded3e70 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:06.504055 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-76ce7eea-2b51-48e3-9fb8-aa625ded3e70 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:06.504568 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-76ce7eea-2b51-48e3-9fb8-aa625ded3e70 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:06.506422 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-76ce7eea-2b51-48e3-9fb8-aa625ded3e70 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:06.701998 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-76ce7eea-2b51-48e3-9fb8-aa625ded3e70 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lazy-loading 'services' on Instance uuid 47ee1803-1ce0-4cbc-879e-d39cfe8576aa {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:43:06.749492 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8f1a7abc-5635-497b-90c7-f828ba7583b5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:06.761110 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8f1a7abc-5635-497b-90c7-f828ba7583b5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1317 microversion: 2.1 time: 0.502435 Oct 18 15:43:06.764937 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2014/4020] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:06 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1317 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:06.838656 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-76ce7eea-2b51-48e3-9fb8-aa625ded3e70 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "DELETE /compute/v2.1/servers/47ee1803-1ce0-4cbc-879e-d39cfe8576aa/os-volume_attachments/18041b8b-3e42-47d7-9f78-cfff45393a8b" status: 202 len: 0 microversion: 2.1 time: 0.363463 Oct 18 15:43:06.839442 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2007/4021] 10.222.0.60 () {58 vars in 1416 bytes} [Tue Oct 18 15:43:06 2022] DELETE /compute/v2.1/servers/47ee1803-1ce0-4cbc-879e-d39cfe8576aa/os-volume_attachments/18041b8b-3e42-47d7-9f78-cfff45393a8b => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:43:06.848730 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-61978c4a-3459-4116-9658-31629aa837b7 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:06.851192 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-61978c4a-3459-4116-9658-31629aa837b7 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 47ee1803-1ce0-4cbc-879e-d39cfe8576aa] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:06.866594 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-61978c4a-3459-4116-9658-31629aa837b7 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:06.869244 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-61978c4a-3459-4116-9658-31629aa837b7 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:06.869706 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-61978c4a-3459-4116-9658-31629aa837b7 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:06.870599 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-61978c4a-3459-4116-9658-31629aa837b7 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:06.872235 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-61978c4a-3459-4116-9658-31629aa837b7 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:06.872677 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-61978c4a-3459-4116-9658-31629aa837b7 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:06.951302 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-61978c4a-3459-4116-9658-31629aa837b7 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee1803-1ce0-4cbc-879e-d39cfe8576aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104896 Oct 18 15:43:06.958871 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2015/4022] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 15:43:06 2022] GET /compute/v2.1/servers/47ee1803-1ce0-4cbc-879e-d39cfe8576aa/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:43:07.180286 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b943a23b-3fd1-43bd-aeb0-fce5065b8d69 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:07.181103 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b943a23b-3fd1-43bd-aeb0-fce5065b8d69 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:07.190584 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b943a23b-3fd1-43bd-aeb0-fce5065b8d69 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:07.193126 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b943a23b-3fd1-43bd-aeb0-fce5065b8d69 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:07.194650 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b943a23b-3fd1-43bd-aeb0-fce5065b8d69 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:07.196049 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b943a23b-3fd1-43bd-aeb0-fce5065b8d69 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:07.196876 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b943a23b-3fd1-43bd-aeb0-fce5065b8d69 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:07.199652 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b943a23b-3fd1-43bd-aeb0-fce5065b8d69 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:07.279065 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-76695af9-6006-47a7-b3e1-b601a9062f7c tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:07.279758 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-76695af9-6006-47a7-b3e1-b601a9062f7c tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:07.287869 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76695af9-6006-47a7-b3e1-b601a9062f7c tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:07.288884 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76695af9-6006-47a7-b3e1-b601a9062f7c tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:07.289474 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76695af9-6006-47a7-b3e1-b601a9062f7c tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:07.290343 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76695af9-6006-47a7-b3e1-b601a9062f7c tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:07.291088 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76695af9-6006-47a7-b3e1-b601a9062f7c tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:07.291665 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76695af9-6006-47a7-b3e1-b601a9062f7c tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:07.695378 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-76695af9-6006-47a7-b3e1-b601a9062f7c tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:07.708604 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-76695af9-6006-47a7-b3e1-b601a9062f7c tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:07.710118 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-76695af9-6006-47a7-b3e1-b601a9062f7c tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:07.711364 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-76695af9-6006-47a7-b3e1-b601a9062f7c tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 200 len: 2502 microversion: 2.32 time: 0.438084 Oct 18 15:43:07.725269 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2016/4023] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:43:07 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 2502 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:43:07.730400 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-89e96b41-f4eb-49ba-9fd0-44665a070cc9 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:07.731214 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-89e96b41-f4eb-49ba-9fd0-44665a070cc9 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 9e93e324-b274-4803-92d3-ee509e0a06d5] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:07.741373 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89e96b41-f4eb-49ba-9fd0-44665a070cc9 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:07.741867 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89e96b41-f4eb-49ba-9fd0-44665a070cc9 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:07.742295 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89e96b41-f4eb-49ba-9fd0-44665a070cc9 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:07.743153 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89e96b41-f4eb-49ba-9fd0-44665a070cc9 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:07.743747 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89e96b41-f4eb-49ba-9fd0-44665a070cc9 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:07.745051 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89e96b41-f4eb-49ba-9fd0-44665a070cc9 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:07.789655 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89e96b41-f4eb-49ba-9fd0-44665a070cc9 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:07.790356 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89e96b41-f4eb-49ba-9fd0-44665a070cc9 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:07.790967 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89e96b41-f4eb-49ba-9fd0-44665a070cc9 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:07.792147 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-89e96b41-f4eb-49ba-9fd0-44665a070cc9 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lazy-loading 'fault' on Instance uuid 9e93e324-b274-4803-92d3-ee509e0a06d5 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:43:07.801060 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b943a23b-3fd1-43bd-aeb0-fce5065b8d69 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:07.809299 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b943a23b-3fd1-43bd-aeb0-fce5065b8d69 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1671 microversion: 2.1 time: 0.635141 Oct 18 15:43:07.810485 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2008/4024] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:07 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1671 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:07.816058 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-23d7c334-1cbc-46ed-b500-acea138b6350 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:07.816887 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-23d7c334-1cbc-46ed-b500-acea138b6350 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:07.827178 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-23d7c334-1cbc-46ed-b500-acea138b6350 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:07.828051 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-23d7c334-1cbc-46ed-b500-acea138b6350 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:07.829640 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-23d7c334-1cbc-46ed-b500-acea138b6350 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:07.831785 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-23d7c334-1cbc-46ed-b500-acea138b6350 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:07.832844 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-23d7c334-1cbc-46ed-b500-acea138b6350 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:07.834110 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-23d7c334-1cbc-46ed-b500-acea138b6350 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:07.883534 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-89e96b41-f4eb-49ba-9fd0-44665a070cc9 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:07.901618 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-89e96b41-f4eb-49ba-9fd0-44665a070cc9 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/9e93e324-b274-4803-92d3-ee509e0a06d5" status: 200 len: 1315 microversion: 2.1 time: 0.174923 Oct 18 15:43:07.910175 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2017/4025] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:07 2022] GET /compute/v2.1/servers/9e93e324-b274-4803-92d3-ee509e0a06d5 => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:07.970735 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3946deda-3c2f-44ad-bd4a-5e63a74c968d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:07.971260 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3946deda-3c2f-44ad-bd4a-5e63a74c968d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 47ee1803-1ce0-4cbc-879e-d39cfe8576aa] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:07.984594 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3946deda-3c2f-44ad-bd4a-5e63a74c968d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:07.985354 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3946deda-3c2f-44ad-bd4a-5e63a74c968d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:07.987836 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3946deda-3c2f-44ad-bd4a-5e63a74c968d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:07.989307 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3946deda-3c2f-44ad-bd4a-5e63a74c968d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:07.990475 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3946deda-3c2f-44ad-bd4a-5e63a74c968d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:07.991056 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3946deda-3c2f-44ad-bd4a-5e63a74c968d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:08.030760 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3946deda-3c2f-44ad-bd4a-5e63a74c968d tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee1803-1ce0-4cbc-879e-d39cfe8576aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067352 Oct 18 15:43:08.031342 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2018/4026] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 15:43:07 2022] GET /compute/v2.1/servers/47ee1803-1ce0-4cbc-879e-d39cfe8576aa/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:43:08.037201 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8e8a1247-2f20-4113-b7d7-6fdab6c2b869 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:08.038573 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8e8a1247-2f20-4113-b7d7-6fdab6c2b869 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:08.046266 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e8a1247-2f20-4113-b7d7-6fdab6c2b869 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:08.046955 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e8a1247-2f20-4113-b7d7-6fdab6c2b869 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:08.047572 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e8a1247-2f20-4113-b7d7-6fdab6c2b869 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:08.048510 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e8a1247-2f20-4113-b7d7-6fdab6c2b869 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:08.048996 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e8a1247-2f20-4113-b7d7-6fdab6c2b869 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:08.049588 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e8a1247-2f20-4113-b7d7-6fdab6c2b869 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:08.461480 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-23d7c334-1cbc-46ed-b500-acea138b6350 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:08.479674 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-23d7c334-1cbc-46ed-b500-acea138b6350 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.667886 Oct 18 15:43:08.486126 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2009/4027] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:07 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:08.492141 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-bc4831d9-f028-4b32-ab7a-876d5a9f9700 req-502df22f-7b85-4b1d-8195-f33fc8c39a15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e93e324-b274-4803-92d3-ee509e0a06d5", "name": "network-vif-deleted", "tag": "b79ec16f-f483-4b30-af6f-e7fb99854c98"}, {"server_uuid": "cf8f81da-4aa0-498d-af1e-c036238f065d", "name": "network-vif-deleted", "tag": "56a32c33-244b-49a6-ab44-eb8dae785efb"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:43:08.519577 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-bc4831d9-f028-4b32-ab7a-876d5a9f9700 req-502df22f-7b85-4b1d-8195-f33fc8c39a15 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:08.521362 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-bc4831d9-f028-4b32-ab7a-876d5a9f9700 req-502df22f-7b85-4b1d-8195-f33fc8c39a15 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:08.522008 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-bc4831d9-f028-4b32-ab7a-876d5a9f9700 req-502df22f-7b85-4b1d-8195-f33fc8c39a15 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:08.550384 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-bc4831d9-f028-4b32-ab7a-876d5a9f9700 req-502df22f-7b85-4b1d-8195-f33fc8c39a15 service nova] Creating event network-vif-deleted:b79ec16f-f483-4b30-af6f-e7fb99854c98 for instance 9e93e324-b274-4803-92d3-ee509e0a06d5 on n-h1-853682-5 Oct 18 15:43:08.550767 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-bc4831d9-f028-4b32-ab7a-876d5a9f9700 req-502df22f-7b85-4b1d-8195-f33fc8c39a15 service nova] Creating event network-vif-deleted:56a32c33-244b-49a6-ab44-eb8dae785efb for instance cf8f81da-4aa0-498d-af1e-c036238f065d on n-h2-853682-5 Oct 18 15:43:08.571071 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-bc4831d9-f028-4b32-ab7a-876d5a9f9700 req-502df22f-7b85-4b1d-8195-f33fc8c39a15 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.083219 Oct 18 15:43:08.574057 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2010/4028] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:43:08 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:43:08.636008 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2301e92d-d791-4a8c-a243-14fddbc893f7 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-424638224", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "b55b6f02-72e3-4b31-a708-98b6291bed4c"}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:43:08.716399 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-2301e92d-d791-4a8c-a243-14fddbc893f7 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] validate_networks() for [('b55b6f02-72e3-4b31-a708-98b6291bed4c', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:43:09.107425 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8e8a1247-2f20-4113-b7d7-6fdab6c2b869 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:09.116665 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8e8a1247-2f20-4113-b7d7-6fdab6c2b869 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1671 microversion: 2.1 time: 1.083520 Oct 18 15:43:09.117707 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2019/4029] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:08 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1671 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:09.127815 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-9514eb76-bb27-4e75-8bf2-20c80abef7e3 req-cb31bbb4-427a-4ee0-85c6-ec1d35544965 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79212b18-bfd6-4a94-9d58-80c535525aa8", "name": "network-vif-unplugged", "status": "completed", "tag": "65ddf63c-d787-42eb-bb1d-c107c1fe8b2f"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:43:09.140679 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9514eb76-bb27-4e75-8bf2-20c80abef7e3 req-cb31bbb4-427a-4ee0-85c6-ec1d35544965 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:09.141807 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9514eb76-bb27-4e75-8bf2-20c80abef7e3 req-cb31bbb4-427a-4ee0-85c6-ec1d35544965 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:09.142528 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9514eb76-bb27-4e75-8bf2-20c80abef7e3 req-cb31bbb4-427a-4ee0-85c6-ec1d35544965 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:09.157309 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-9514eb76-bb27-4e75-8bf2-20c80abef7e3 req-cb31bbb4-427a-4ee0-85c6-ec1d35544965 service nova] Creating event network-vif-unplugged:65ddf63c-d787-42eb-bb1d-c107c1fe8b2f for instance 79212b18-bfd6-4a94-9d58-80c535525aa8 on n-h2-853682-5 Oct 18 15:43:09.163031 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-9514eb76-bb27-4e75-8bf2-20c80abef7e3 req-cb31bbb4-427a-4ee0-85c6-ec1d35544965 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043772 Oct 18 15:43:09.173168 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2020/4030] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:43:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:43:09.178453 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d70cbfb6-e31a-453a-83cf-6a9695401ac1 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:09.179153 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d70cbfb6-e31a-453a-83cf-6a9695401ac1 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:09.190849 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d70cbfb6-e31a-453a-83cf-6a9695401ac1 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:09.191965 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d70cbfb6-e31a-453a-83cf-6a9695401ac1 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:09.192605 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d70cbfb6-e31a-453a-83cf-6a9695401ac1 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:09.194523 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d70cbfb6-e31a-453a-83cf-6a9695401ac1 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:09.195123 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d70cbfb6-e31a-453a-83cf-6a9695401ac1 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:09.197498 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d70cbfb6-e31a-453a-83cf-6a9695401ac1 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:09.665254 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d70cbfb6-e31a-453a-83cf-6a9695401ac1 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:09.690694 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d70cbfb6-e31a-453a-83cf-6a9695401ac1 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:09.692396 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d70cbfb6-e31a-453a-83cf-6a9695401ac1 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:09.694187 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d70cbfb6-e31a-453a-83cf-6a9695401ac1 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 200 len: 2341 microversion: 2.32 time: 0.519950 Oct 18 15:43:09.705878 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2021/4031] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:43:09 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 2341 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:43:09.711061 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e4ab27f4-6406-404f-8862-172fca6aedab tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:09.713837 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e4ab27f4-6406-404f-8862-172fca6aedab tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 9e93e324-b274-4803-92d3-ee509e0a06d5] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:09.720987 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4ab27f4-6406-404f-8862-172fca6aedab tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:09.721735 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4ab27f4-6406-404f-8862-172fca6aedab tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:09.722369 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4ab27f4-6406-404f-8862-172fca6aedab tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:09.723281 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4ab27f4-6406-404f-8862-172fca6aedab tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:09.723936 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4ab27f4-6406-404f-8862-172fca6aedab tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:09.724529 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4ab27f4-6406-404f-8862-172fca6aedab tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:09.781152 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-e4ab27f4-6406-404f-8862-172fca6aedab tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] HTTP exception thrown: Instance 9e93e324-b274-4803-92d3-ee509e0a06d5 could not be found. Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e4ab27f4-6406-404f-8862-172fca6aedab tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Request method failure captured: Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/9e93e324-b274-4803-92d3-ee509e0a06d5 HTTP/1.1 Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTskwmwAKtfJxRtfmFCexrRganirG5QxP3o41FeBWoidL-rUG8x8GL16JQLrOge4bbPRk8j9ZKsrTawjOywht8BMU6xpPPkLcF_Tvsxd_4ddRByYVxCCr1OvdQRZ3S_CoRUmp2shw5GPVxRCyE1gWYjx_sxIK_OIs6piyKG80707p5j0 Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 38b4cd4b884c4456866052a4969dc138 Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1849835039 Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/38b4cd4b884c4456866052a4969dc138"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/38b4cd4b884c4456866052a4969dc138"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/38b4cd4b884c4456866052a4969dc138"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_38b4cd4b884c4456866052a4969dc138"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1849835039 Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 38b4cd4b884c4456866052a4969dc138 Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1849835039 Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ImagesOneServerNegativeTestJSON-1849835039-project Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: a2e9e9bbf3d94d77a236e43f019d316a Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1849835039-project Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 9e93e324-b274-4803-92d3-ee509e0a06d5 could not be found. Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '9e93e324-b274-4803-92d3-ee509e0a06d5'} Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e93e324-b274-4803-92d3-ee509e0a06d5 could not be found. Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e93e324-b274-4803-92d3-ee509e0a06d5 could not be found. Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:09.783273 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:43:09.786744 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:09.786744 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:09.786744 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:43:09.786744 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:43:09.786744 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:43:09.786744 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:43:09.786744 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e93e324-b274-4803-92d3-ee509e0a06d5 could not be found. Oct 18 15:43:09.786744 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:09.788065 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e4ab27f4-6406-404f-8862-172fca6aedab tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Returning 404 to user: Instance 9e93e324-b274-4803-92d3-ee509e0a06d5 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:43:09.789264 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e4ab27f4-6406-404f-8862-172fca6aedab tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/9e93e324-b274-4803-92d3-ee509e0a06d5" status: 404 len: 111 microversion: 2.1 time: 0.082014 Oct 18 15:43:09.790036 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2022/4032] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:09 2022] GET /compute/v2.1/servers/9e93e324-b274-4803-92d3-ee509e0a06d5 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:43:09.801438 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-71db1694-68b8-4b5b-8ecb-47e0d36f5b25 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:09.816436 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-71db1694-68b8-4b5b-8ecb-47e0d36f5b25 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 47ee1803-1ce0-4cbc-879e-d39cfe8576aa] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:09.831701 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71db1694-68b8-4b5b-8ecb-47e0d36f5b25 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:09.832558 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71db1694-68b8-4b5b-8ecb-47e0d36f5b25 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:09.833030 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71db1694-68b8-4b5b-8ecb-47e0d36f5b25 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:09.833977 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71db1694-68b8-4b5b-8ecb-47e0d36f5b25 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:09.834726 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71db1694-68b8-4b5b-8ecb-47e0d36f5b25 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:09.835301 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71db1694-68b8-4b5b-8ecb-47e0d36f5b25 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:09.902155 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-71db1694-68b8-4b5b-8ecb-47e0d36f5b25 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee1803-1ce0-4cbc-879e-d39cfe8576aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110777 Oct 18 15:43:09.911526 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2023/4033] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 15:43:09 2022] GET /compute/v2.1/servers/47ee1803-1ce0-4cbc-879e-d39cfe8576aa/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:43:10.015464 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-009b823e-40f5-44ae-ae06-b61b12c6d1df tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-429937236", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:43:10.090903 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-009b823e-40f5-44ae-ae06-b61b12c6d1df tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] validate_networks() for [('271f146d-5c28-4347-b10b-09aca0da6649', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:43:10.764430 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-2301e92d-d791-4a8c-a243-14fddbc893f7 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:43:10.767135 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-2301e92d-d791-4a8c-a243-14fddbc893f7 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:43:10.768578 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-2301e92d-d791-4a8c-a243-14fddbc893f7 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:43:10.769943 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-2301e92d-d791-4a8c-a243-14fddbc893f7 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:43:10.771146 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-2301e92d-d791-4a8c-a243-14fddbc893f7 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:43:10.810906 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2301e92d-d791-4a8c-a243-14fddbc893f7 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:10.811804 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2301e92d-d791-4a8c-a243-14fddbc893f7 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:10.815588 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2301e92d-d791-4a8c-a243-14fddbc893f7 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:10.818786 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2301e92d-d791-4a8c-a243-14fddbc893f7 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:10.820019 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2301e92d-d791-4a8c-a243-14fddbc893f7 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:10.821557 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2301e92d-d791-4a8c-a243-14fddbc893f7 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:10.879481 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-2301e92d-d791-4a8c-a243-14fddbc893f7 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Getting quotas for project f85a1afa85674bc39dbce30ed8792cb0. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:43:10.894614 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-2301e92d-d791-4a8c-a243-14fddbc893f7 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Getting quotas for user 96c4378d52d1489bb2d50e84cabf95eb and project f85a1afa85674bc39dbce30ed8792cb0. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:43:10.929646 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2301e92d-d791-4a8c-a243-14fddbc893f7 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:43:10.932824 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2301e92d-d791-4a8c-a243-14fddbc893f7 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 28223cad-bdfe-40ba-905e-56488b5119be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:43:11.049714 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2301e92d-d791-4a8c-a243-14fddbc893f7 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.418207 Oct 18 15:43:11.058752 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2011/4034] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:43:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2428 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:43:11.065973 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bf8fc45f-7ab3-4eb4-ae6f-b480d89c04fd tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:11.073455 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-bf8fc45f-7ab3-4eb4-ae6f-b480d89c04fd tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:11.088768 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:43:11.093865 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bf8fc45f-7ab3-4eb4-ae6f-b480d89c04fd tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:11.095391 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bf8fc45f-7ab3-4eb4-ae6f-b480d89c04fd tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:11.095995 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bf8fc45f-7ab3-4eb4-ae6f-b480d89c04fd tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:11.098872 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bf8fc45f-7ab3-4eb4-ae6f-b480d89c04fd tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:11.100685 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bf8fc45f-7ab3-4eb4-ae6f-b480d89c04fd tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:11.101347 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bf8fc45f-7ab3-4eb4-ae6f-b480d89c04fd tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:11.225510 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-009b823e-40f5-44ae-ae06-b61b12c6d1df tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:43:11.225972 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-009b823e-40f5-44ae-ae06-b61b12c6d1df tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:43:11.226391 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-009b823e-40f5-44ae-ae06-b61b12c6d1df tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:43:11.226794 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-009b823e-40f5-44ae-ae06-b61b12c6d1df tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:43:11.227196 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-009b823e-40f5-44ae-ae06-b61b12c6d1df tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:43:11.243808 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-009b823e-40f5-44ae-ae06-b61b12c6d1df tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:11.244304 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-009b823e-40f5-44ae-ae06-b61b12c6d1df tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:11.244728 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-009b823e-40f5-44ae-ae06-b61b12c6d1df tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:11.245642 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-009b823e-40f5-44ae-ae06-b61b12c6d1df tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:11.246107 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-009b823e-40f5-44ae-ae06-b61b12c6d1df tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:11.246528 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-009b823e-40f5-44ae-ae06-b61b12c6d1df tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:11.295535 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-009b823e-40f5-44ae-ae06-b61b12c6d1df tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Getting quotas for project 38b4cd4b884c4456866052a4969dc138. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:43:11.312774 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-009b823e-40f5-44ae-ae06-b61b12c6d1df tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Getting quotas for user a2e9e9bbf3d94d77a236e43f019d316a and project 38b4cd4b884c4456866052a4969dc138. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:43:11.356756 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-009b823e-40f5-44ae-ae06-b61b12c6d1df tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:43:11.359114 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-009b823e-40f5-44ae-ae06-b61b12c6d1df tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: da74a6b9-5e80-4113-bf1d-dfb5a9c13023] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:43:11.446454 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-009b823e-40f5-44ae-ae06-b61b12c6d1df tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.435911 Oct 18 15:43:11.447891 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2024/4035] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:43:10 2022] POST /compute/v2.1/servers => generated 383 bytes in 1438 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:43:11.454707 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d69f2ccc-6ecf-4329-b370-3deacd460ce3 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:11.455337 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d69f2ccc-6ecf-4329-b370-3deacd460ce3 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:11.462280 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d69f2ccc-6ecf-4329-b370-3deacd460ce3 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:11.462977 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d69f2ccc-6ecf-4329-b370-3deacd460ce3 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:11.463547 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d69f2ccc-6ecf-4329-b370-3deacd460ce3 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:11.464440 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d69f2ccc-6ecf-4329-b370-3deacd460ce3 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:11.465200 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d69f2ccc-6ecf-4329-b370-3deacd460ce3 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:11.465799 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d69f2ccc-6ecf-4329-b370-3deacd460ce3 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:11.627727 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-bf8fc45f-7ab3-4eb4-ae6f-b480d89c04fd tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:11.643440 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-bf8fc45f-7ab3-4eb4-ae6f-b480d89c04fd tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1671 microversion: 2.1 time: 0.583309 Oct 18 15:43:11.656831 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2012/4036] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:11 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1671 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:11.657892 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7f63f6e2-6784-4d8b-a4dd-9bbe376efb58 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:11.662956 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7f63f6e2-6784-4d8b-a4dd-9bbe376efb58 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 47ee1803-1ce0-4cbc-879e-d39cfe8576aa] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:11.679682 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7f63f6e2-6784-4d8b-a4dd-9bbe376efb58 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:11.680278 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7f63f6e2-6784-4d8b-a4dd-9bbe376efb58 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:11.680837 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7f63f6e2-6784-4d8b-a4dd-9bbe376efb58 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:11.683777 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7f63f6e2-6784-4d8b-a4dd-9bbe376efb58 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:11.684333 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7f63f6e2-6784-4d8b-a4dd-9bbe376efb58 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:11.684879 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7f63f6e2-6784-4d8b-a4dd-9bbe376efb58 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:11.733900 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d69f2ccc-6ecf-4329-b370-3deacd460ce3 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:11.749240 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d69f2ccc-6ecf-4329-b370-3deacd460ce3 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:11.754603 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d69f2ccc-6ecf-4329-b370-3deacd460ce3 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:11.768697 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d69f2ccc-6ecf-4329-b370-3deacd460ce3 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 200 len: 2273 microversion: 2.32 time: 0.308052 Oct 18 15:43:11.773058 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2025/4037] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:43:11 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 2273 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:43:11.791140 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-1502ec76-5d98-4795-8e42-546ef9675279 req-3b60afd5-6a21-4d00-8182-1eb9d5dd1cc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf8f81da-4aa0-498d-af1e-c036238f065d", "name": "network-vif-deleted", "tag": "c4a0dc0d-0a7d-4afc-aa10-4271ba62b220"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:43:11.805131 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7f63f6e2-6784-4d8b-a4dd-9bbe376efb58 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee1803-1ce0-4cbc-879e-d39cfe8576aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.156995 Oct 18 15:43:11.810832 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2013/4038] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 15:43:11 2022] GET /compute/v2.1/servers/47ee1803-1ce0-4cbc-879e-d39cfe8576aa/os-volume_attachments => generated 197 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:43:11.825523 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1502ec76-5d98-4795-8e42-546ef9675279 req-3b60afd5-6a21-4d00-8182-1eb9d5dd1cc7 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:11.826007 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1502ec76-5d98-4795-8e42-546ef9675279 req-3b60afd5-6a21-4d00-8182-1eb9d5dd1cc7 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:11.827763 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-84d3093c-86ba-46d0-bfa6-f2de46f0fa84 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:11.833320 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-84d3093c-86ba-46d0-bfa6-f2de46f0fa84 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 28223cad-bdfe-40ba-905e-56488b5119be] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:11.834388 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1502ec76-5d98-4795-8e42-546ef9675279 req-3b60afd5-6a21-4d00-8182-1eb9d5dd1cc7 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:11.861030 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-84d3093c-86ba-46d0-bfa6-f2de46f0fa84 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:11.861548 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-84d3093c-86ba-46d0-bfa6-f2de46f0fa84 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:11.870401 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-84d3093c-86ba-46d0-bfa6-f2de46f0fa84 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:11.871430 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-84d3093c-86ba-46d0-bfa6-f2de46f0fa84 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:11.871958 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-84d3093c-86ba-46d0-bfa6-f2de46f0fa84 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:11.872365 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-84d3093c-86ba-46d0-bfa6-f2de46f0fa84 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:11.878818 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-1502ec76-5d98-4795-8e42-546ef9675279 req-3b60afd5-6a21-4d00-8182-1eb9d5dd1cc7 service nova] Creating event network-vif-deleted:c4a0dc0d-0a7d-4afc-aa10-4271ba62b220 for instance cf8f81da-4aa0-498d-af1e-c036238f065d on n-h2-853682-5 Oct 18 15:43:11.892856 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-1502ec76-5d98-4795-8e42-546ef9675279 req-3b60afd5-6a21-4d00-8182-1eb9d5dd1cc7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115312 Oct 18 15:43:11.896688 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2026/4039] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:43:12.035979 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-84d3093c-86ba-46d0-bfa6-f2de46f0fa84 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:12.050972 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-84d3093c-86ba-46d0-bfa6-f2de46f0fa84 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/28223cad-bdfe-40ba-905e-56488b5119be" status: 200 len: 1220 microversion: 2.1 time: 0.234723 Oct 18 15:43:12.053443 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2014/4040] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:11 2022] GET /compute/v2.1/servers/28223cad-bdfe-40ba-905e-56488b5119be => generated 1220 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:12.063810 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a486de91-88a4-4b63-8012-a01c0ac062bb tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:12.065531 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a486de91-88a4-4b63-8012-a01c0ac062bb tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: da74a6b9-5e80-4113-bf1d-dfb5a9c13023] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:12.357641 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a486de91-88a4-4b63-8012-a01c0ac062bb tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:12.370711 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a486de91-88a4-4b63-8012-a01c0ac062bb tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/da74a6b9-5e80-4113-bf1d-dfb5a9c13023" status: 200 len: 1224 microversion: 2.1 time: 0.313864 Oct 18 15:43:12.371610 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2015/4041] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:12 2022] GET /compute/v2.1/servers/da74a6b9-5e80-4113-bf1d-dfb5a9c13023 => generated 1224 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:12.381490 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4595fe80-c8c5-4775-b0fe-9e36155cdf13 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:12.383370 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4595fe80-c8c5-4775-b0fe-9e36155cdf13 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:12.409115 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4595fe80-c8c5-4775-b0fe-9e36155cdf13 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:12.410193 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4595fe80-c8c5-4775-b0fe-9e36155cdf13 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:12.410893 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4595fe80-c8c5-4775-b0fe-9e36155cdf13 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:12.411829 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4595fe80-c8c5-4775-b0fe-9e36155cdf13 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:12.413808 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4595fe80-c8c5-4775-b0fe-9e36155cdf13 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:12.415154 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4595fe80-c8c5-4775-b0fe-9e36155cdf13 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:12.611936 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d0142d79-cdad-44bb-b1f8-1512d81a8a83 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1969265023", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:43:12.745745 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:43:12.765600 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4595fe80-c8c5-4775-b0fe-9e36155cdf13 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:12.777005 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4595fe80-c8c5-4775-b0fe-9e36155cdf13 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1671 microversion: 2.1 time: 0.401760 Oct 18 15:43:12.778222 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2016/4042] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:12 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1671 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:12.819851 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d65bf737-cec1-4c85-bde8-d3efc8be6d2f tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:12.821219 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d65bf737-cec1-4c85-bde8-d3efc8be6d2f tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:12.822680 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-d0142d79-cdad-44bb-b1f8-1512d81a8a83 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] validate_networks() for [('2d5f3fc6-85c5-4721-8b46-c2233a05f92e', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:43:12.850937 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d65bf737-cec1-4c85-bde8-d3efc8be6d2f tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:12.852602 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d65bf737-cec1-4c85-bde8-d3efc8be6d2f tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:12.853096 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d65bf737-cec1-4c85-bde8-d3efc8be6d2f tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:12.854862 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d65bf737-cec1-4c85-bde8-d3efc8be6d2f tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:12.860035 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d65bf737-cec1-4c85-bde8-d3efc8be6d2f tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:12.862408 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d65bf737-cec1-4c85-bde8-d3efc8be6d2f tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:13.646145 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d65bf737-cec1-4c85-bde8-d3efc8be6d2f tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:13.665090 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d65bf737-cec1-4c85-bde8-d3efc8be6d2f tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:13.666897 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d65bf737-cec1-4c85-bde8-d3efc8be6d2f tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:13.668568 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d65bf737-cec1-4c85-bde8-d3efc8be6d2f tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 200 len: 1605 microversion: 2.32 time: 0.865148 Oct 18 15:43:13.694220 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2017/4043] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:43:12 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 1605 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:43:13.722077 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-97789df5-b56e-4da8-9ea6-f2329bee07b7 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:13.723167 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-97789df5-b56e-4da8-9ea6-f2329bee07b7 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:13.730400 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97789df5-b56e-4da8-9ea6-f2329bee07b7 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:13.731104 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97789df5-b56e-4da8-9ea6-f2329bee07b7 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:13.731932 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97789df5-b56e-4da8-9ea6-f2329bee07b7 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:13.733116 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97789df5-b56e-4da8-9ea6-f2329bee07b7 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:13.733790 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97789df5-b56e-4da8-9ea6-f2329bee07b7 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:13.734445 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97789df5-b56e-4da8-9ea6-f2329bee07b7 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:14.423585 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-97789df5-b56e-4da8-9ea6-f2329bee07b7 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:14.440718 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-97789df5-b56e-4da8-9ea6-f2329bee07b7 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1671 microversion: 2.1 time: 0.743649 Oct 18 15:43:14.443151 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2018/4044] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:13 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1671 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:14.458323 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9f380c0b-e195-4b9e-9370-03915e7ab01a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:14.461225 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9f380c0b-e195-4b9e-9370-03915e7ab01a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 47ee1803-1ce0-4cbc-879e-d39cfe8576aa] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:14.492026 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9f380c0b-e195-4b9e-9370-03915e7ab01a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:14.493961 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9f380c0b-e195-4b9e-9370-03915e7ab01a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:14.501227 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9f380c0b-e195-4b9e-9370-03915e7ab01a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:14.505290 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9f380c0b-e195-4b9e-9370-03915e7ab01a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:14.506102 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9f380c0b-e195-4b9e-9370-03915e7ab01a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:14.509318 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9f380c0b-e195-4b9e-9370-03915e7ab01a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:14.565229 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9f380c0b-e195-4b9e-9370-03915e7ab01a tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee1803-1ce0-4cbc-879e-d39cfe8576aa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.119524 Oct 18 15:43:14.566557 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2019/4045] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 15:43:14 2022] GET /compute/v2.1/servers/47ee1803-1ce0-4cbc-879e-d39cfe8576aa/os-volume_attachments => generated 25 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:43:14.586930 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d971a2f0-b890-43b6-aa89-324cc7a1681a tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:14.589251 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d971a2f0-b890-43b6-aa89-324cc7a1681a tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 28223cad-bdfe-40ba-905e-56488b5119be] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:14.617213 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d971a2f0-b890-43b6-aa89-324cc7a1681a tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:14.623751 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d971a2f0-b890-43b6-aa89-324cc7a1681a tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:14.626820 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d971a2f0-b890-43b6-aa89-324cc7a1681a tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:14.628628 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d971a2f0-b890-43b6-aa89-324cc7a1681a tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:14.629843 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d971a2f0-b890-43b6-aa89-324cc7a1681a tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:14.632892 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d971a2f0-b890-43b6-aa89-324cc7a1681a tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:14.927094 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d971a2f0-b890-43b6-aa89-324cc7a1681a tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:14.947429 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d971a2f0-b890-43b6-aa89-324cc7a1681a tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/28223cad-bdfe-40ba-905e-56488b5119be" status: 200 len: 1274 microversion: 2.1 time: 0.379488 Oct 18 15:43:14.959564 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2020/4046] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:14 2022] GET /compute/v2.1/servers/28223cad-bdfe-40ba-905e-56488b5119be => generated 1274 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:14.980471 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5c0d5c94-9992-4d26-84ed-c46270351ca1 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:14.983297 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5c0d5c94-9992-4d26-84ed-c46270351ca1 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: da74a6b9-5e80-4113-bf1d-dfb5a9c13023] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:14.997215 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5c0d5c94-9992-4d26-84ed-c46270351ca1 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:14.997728 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5c0d5c94-9992-4d26-84ed-c46270351ca1 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:14.998147 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5c0d5c94-9992-4d26-84ed-c46270351ca1 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:14.998863 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5c0d5c94-9992-4d26-84ed-c46270351ca1 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:15.007574 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5c0d5c94-9992-4d26-84ed-c46270351ca1 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:15.008310 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5c0d5c94-9992-4d26-84ed-c46270351ca1 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:15.267517 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5c0d5c94-9992-4d26-84ed-c46270351ca1 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:15.272002 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:43:15.290192 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5c0d5c94-9992-4d26-84ed-c46270351ca1 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/da74a6b9-5e80-4113-bf1d-dfb5a9c13023" status: 200 len: 1282 microversion: 2.1 time: 0.325349 Oct 18 15:43:15.291935 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2021/4047] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:14 2022] GET /compute/v2.1/servers/da74a6b9-5e80-4113-bf1d-dfb5a9c13023 => generated 1282 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:15.297955 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-07fd1f0d-f26b-43d4-ab47-216867dd0cb3 req-8e7c1d1a-2d70-4ce7-a328-52f616eaf2be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf8f81da-4aa0-498d-af1e-c036238f065d", "name": "network-vif-deleted", "tag": "6804cdcb-ecb6-4eec-8de0-cc16a6d64f70"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:43:15.313211 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-07fd1f0d-f26b-43d4-ab47-216867dd0cb3 req-8e7c1d1a-2d70-4ce7-a328-52f616eaf2be service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:15.314219 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-07fd1f0d-f26b-43d4-ab47-216867dd0cb3 req-8e7c1d1a-2d70-4ce7-a328-52f616eaf2be service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:15.314918 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-07fd1f0d-f26b-43d4-ab47-216867dd0cb3 req-8e7c1d1a-2d70-4ce7-a328-52f616eaf2be service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:15.333784 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-07fd1f0d-f26b-43d4-ab47-216867dd0cb3 req-8e7c1d1a-2d70-4ce7-a328-52f616eaf2be service nova] Creating event network-vif-deleted:6804cdcb-ecb6-4eec-8de0-cc16a6d64f70 for instance cf8f81da-4aa0-498d-af1e-c036238f065d on n-h2-853682-5 Oct 18 15:43:15.340246 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-07fd1f0d-f26b-43d4-ab47-216867dd0cb3 req-8e7c1d1a-2d70-4ce7-a328-52f616eaf2be service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046556 Oct 18 15:43:15.341573 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2022/4048] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:43:15.348626 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a1955996-a79e-4c55-bee0-2532f8633f21 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:43:15.351773 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a1955996-a79e-4c55-bee0-2532f8633f21 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:15.362408 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a1955996-a79e-4c55-bee0-2532f8633f21 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:15.363423 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a1955996-a79e-4c55-bee0-2532f8633f21 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:15.364209 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a1955996-a79e-4c55-bee0-2532f8633f21 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:15.365211 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a1955996-a79e-4c55-bee0-2532f8633f21 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:15.365935 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a1955996-a79e-4c55-bee0-2532f8633f21 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:15.366567 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a1955996-a79e-4c55-bee0-2532f8633f21 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:15.525936 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a1955996-a79e-4c55-bee0-2532f8633f21 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "POST /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8/action" status: 202 len: 0 microversion: 2.1 time: 0.179757 Oct 18 15:43:15.534898 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2023/4049] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:43:15 2022] POST /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:43:15.590361 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-77385220-2ae5-48ca-ab72-89bb71536a1f tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:15.595374 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-77385220-2ae5-48ca-ab72-89bb71536a1f tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:15.598337 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-d0142d79-cdad-44bb-b1f8-1512d81a8a83 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:43:15.599268 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-d0142d79-cdad-44bb-b1f8-1512d81a8a83 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:43:15.600014 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-d0142d79-cdad-44bb-b1f8-1512d81a8a83 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:43:15.600608 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-d0142d79-cdad-44bb-b1f8-1512d81a8a83 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:43:15.602248 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-d0142d79-cdad-44bb-b1f8-1512d81a8a83 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:43:15.614891 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-77385220-2ae5-48ca-ab72-89bb71536a1f tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:15.615417 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-77385220-2ae5-48ca-ab72-89bb71536a1f tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:15.615858 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-77385220-2ae5-48ca-ab72-89bb71536a1f tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:15.616632 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-77385220-2ae5-48ca-ab72-89bb71536a1f tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:15.617549 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-77385220-2ae5-48ca-ab72-89bb71536a1f tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:15.617973 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-77385220-2ae5-48ca-ab72-89bb71536a1f tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:15.645820 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0142d79-cdad-44bb-b1f8-1512d81a8a83 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:15.646844 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0142d79-cdad-44bb-b1f8-1512d81a8a83 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:15.647504 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0142d79-cdad-44bb-b1f8-1512d81a8a83 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:15.648432 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0142d79-cdad-44bb-b1f8-1512d81a8a83 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:15.652784 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0142d79-cdad-44bb-b1f8-1512d81a8a83 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:15.652784 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0142d79-cdad-44bb-b1f8-1512d81a8a83 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:15.729432 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-d0142d79-cdad-44bb-b1f8-1512d81a8a83 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Getting quotas for project 224ca1f734c14bc8bf31e1826faf8e71. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:43:15.739892 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-d0142d79-cdad-44bb-b1f8-1512d81a8a83 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Getting quotas for user 646fb4652c164c1dab5672d33d9fb295 and project 224ca1f734c14bc8bf31e1826faf8e71. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:43:15.774256 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d0142d79-cdad-44bb-b1f8-1512d81a8a83 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:43:15.776638 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d0142d79-cdad-44bb-b1f8-1512d81a8a83 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 19226472-0c76-46f8-a4ba-7d32931341a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:43:15.850025 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-77385220-2ae5-48ca-ab72-89bb71536a1f tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:15.871573 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-77385220-2ae5-48ca-ab72-89bb71536a1f tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:15.873616 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d0142d79-cdad-44bb-b1f8-1512d81a8a83 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.975356 Oct 18 15:43:15.876505 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-77385220-2ae5-48ca-ab72-89bb71536a1f tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:15.877274 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2027/4050] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:43:11 2022] POST /compute/v2.1/servers => generated 383 bytes in 3980 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:43:15.881971 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-77385220-2ae5-48ca-ab72-89bb71536a1f tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 200 len: 1605 microversion: 2.32 time: 0.344945 Oct 18 15:43:15.883001 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2024/4051] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:43:15 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 1605 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:43:15.887816 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ddfcd282-1684-4de7-aadd-82be44f985f8 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:15.892997 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ddfcd282-1684-4de7-aadd-82be44f985f8 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:15.908122 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-87a918f4-16d2-4cb7-be7e-5e72d54cad44 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:15.909438 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-87a918f4-16d2-4cb7-be7e-5e72d54cad44 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 47ee1803-1ce0-4cbc-879e-d39cfe8576aa] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:15.922567 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87a918f4-16d2-4cb7-be7e-5e72d54cad44 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:15.925182 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ddfcd282-1684-4de7-aadd-82be44f985f8 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:15.926303 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ddfcd282-1684-4de7-aadd-82be44f985f8 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:15.927386 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ddfcd282-1684-4de7-aadd-82be44f985f8 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:15.928718 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ddfcd282-1684-4de7-aadd-82be44f985f8 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:15.929484 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ddfcd282-1684-4de7-aadd-82be44f985f8 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:15.929764 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87a918f4-16d2-4cb7-be7e-5e72d54cad44 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:15.930348 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ddfcd282-1684-4de7-aadd-82be44f985f8 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:15.938502 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87a918f4-16d2-4cb7-be7e-5e72d54cad44 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:15.939641 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87a918f4-16d2-4cb7-be7e-5e72d54cad44 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:15.940273 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87a918f4-16d2-4cb7-be7e-5e72d54cad44 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:15.940880 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87a918f4-16d2-4cb7-be7e-5e72d54cad44 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:15.993350 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-87a918f4-16d2-4cb7-be7e-5e72d54cad44 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 47ee1803-1ce0-4cbc-879e-d39cfe8576aa] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:43:16.031713 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:43:16.133446 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-87a918f4-16d2-4cb7-be7e-5e72d54cad44 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "DELETE /compute/v2.1/servers/47ee1803-1ce0-4cbc-879e-d39cfe8576aa" status: 204 len: 0 microversion: 2.1 time: 0.253340 Oct 18 15:43:16.136934 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2028/4052] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:43:15 2022] DELETE /compute/v2.1/servers/47ee1803-1ce0-4cbc-879e-d39cfe8576aa => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:43:16.148947 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8012688f-3490-47f8-95a8-898aae021a45 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:16.149887 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8012688f-3490-47f8-95a8-898aae021a45 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 19226472-0c76-46f8-a4ba-7d32931341a2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:16.445568 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8012688f-3490-47f8-95a8-898aae021a45 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:16.469729 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8012688f-3490-47f8-95a8-898aae021a45 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2" status: 200 len: 1222 microversion: 2.1 time: 0.330631 Oct 18 15:43:16.472502 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2029/4053] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:16 2022] GET /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2 => generated 1222 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:16.486707 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cd8da8d5-9099-4756-a546-9e6b32f03cb6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:16.487542 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cd8da8d5-9099-4756-a546-9e6b32f03cb6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 28223cad-bdfe-40ba-905e-56488b5119be] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:16.514951 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd8da8d5-9099-4756-a546-9e6b32f03cb6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:16.515592 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd8da8d5-9099-4756-a546-9e6b32f03cb6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:16.515906 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd8da8d5-9099-4756-a546-9e6b32f03cb6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:16.516618 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd8da8d5-9099-4756-a546-9e6b32f03cb6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:16.526565 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd8da8d5-9099-4756-a546-9e6b32f03cb6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:16.527090 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd8da8d5-9099-4756-a546-9e6b32f03cb6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:16.874868 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cd8da8d5-9099-4756-a546-9e6b32f03cb6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:16.889066 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cd8da8d5-9099-4756-a546-9e6b32f03cb6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/28223cad-bdfe-40ba-905e-56488b5119be" status: 200 len: 1274 microversion: 2.1 time: 0.415507 Oct 18 15:43:16.894522 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2030/4054] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:16 2022] GET /compute/v2.1/servers/28223cad-bdfe-40ba-905e-56488b5119be => generated 1274 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:16.902879 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-57fc31f5-334a-481d-a418-ab5999b17810 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:16.907965 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-57fc31f5-334a-481d-a418-ab5999b17810 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 47ee1803-1ce0-4cbc-879e-d39cfe8576aa] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:16.925700 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ddfcd282-1684-4de7-aadd-82be44f985f8 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:16.931439 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57fc31f5-334a-481d-a418-ab5999b17810 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:16.933200 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57fc31f5-334a-481d-a418-ab5999b17810 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:16.933807 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57fc31f5-334a-481d-a418-ab5999b17810 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:16.936142 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ddfcd282-1684-4de7-aadd-82be44f985f8 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1673 microversion: 2.1 time: 1.051889 Oct 18 15:43:16.936376 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57fc31f5-334a-481d-a418-ab5999b17810 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:16.936901 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57fc31f5-334a-481d-a418-ab5999b17810 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:16.940918 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57fc31f5-334a-481d-a418-ab5999b17810 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:16.941903 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2025/4055] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:15 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1673 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:16.951192 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7feab9a7-4ee0-49c0-8570-0ca225e57356 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:16.952332 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7feab9a7-4ee0-49c0-8570-0ca225e57356 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: da74a6b9-5e80-4113-bf1d-dfb5a9c13023] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:16.964297 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7feab9a7-4ee0-49c0-8570-0ca225e57356 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:16.967301 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7feab9a7-4ee0-49c0-8570-0ca225e57356 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:16.967951 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7feab9a7-4ee0-49c0-8570-0ca225e57356 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:16.973891 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7feab9a7-4ee0-49c0-8570-0ca225e57356 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:16.974724 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7feab9a7-4ee0-49c0-8570-0ca225e57356 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:16.975352 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7feab9a7-4ee0-49c0-8570-0ca225e57356 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:17.577375 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-57fc31f5-334a-481d-a418-ab5999b17810 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:17.595566 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-57fc31f5-334a-481d-a418-ab5999b17810 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee1803-1ce0-4cbc-879e-d39cfe8576aa" status: 200 len: 1679 microversion: 2.1 time: 0.699424 Oct 18 15:43:17.597769 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2031/4056] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:16 2022] GET /compute/v2.1/servers/47ee1803-1ce0-4cbc-879e-d39cfe8576aa => generated 1679 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:17.609862 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5f27f78e-cfa0-4853-b166-0dda92272082 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2005075529", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:43:17.723640 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-5f27f78e-cfa0-4853-b166-0dda92272082 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] validate_networks() for [('2d5f3fc6-85c5-4721-8b46-c2233a05f92e', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:43:17.765110 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7feab9a7-4ee0-49c0-8570-0ca225e57356 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:17.779131 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7feab9a7-4ee0-49c0-8570-0ca225e57356 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/da74a6b9-5e80-4113-bf1d-dfb5a9c13023" status: 200 len: 1324 microversion: 2.1 time: 0.835923 Oct 18 15:43:17.779735 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2026/4057] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:16 2022] GET /compute/v2.1/servers/da74a6b9-5e80-4113-bf1d-dfb5a9c13023 => generated 1324 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:17.792271 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-33bea31f-7b5e-480d-9ed2-4c05bb3970fc tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:17.793188 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-33bea31f-7b5e-480d-9ed2-4c05bb3970fc tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:17.813520 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-33bea31f-7b5e-480d-9ed2-4c05bb3970fc tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:17.815854 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-33bea31f-7b5e-480d-9ed2-4c05bb3970fc tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:17.816493 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-33bea31f-7b5e-480d-9ed2-4c05bb3970fc tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:17.817447 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-33bea31f-7b5e-480d-9ed2-4c05bb3970fc tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:17.821431 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-33bea31f-7b5e-480d-9ed2-4c05bb3970fc tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:17.822529 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-33bea31f-7b5e-480d-9ed2-4c05bb3970fc tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:18.009249 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-33bea31f-7b5e-480d-9ed2-4c05bb3970fc tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:18.025999 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-33bea31f-7b5e-480d-9ed2-4c05bb3970fc tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:18.028645 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-33bea31f-7b5e-480d-9ed2-4c05bb3970fc tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:18.031685 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-33bea31f-7b5e-480d-9ed2-4c05bb3970fc tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 200 len: 1605 microversion: 2.32 time: 0.248888 Oct 18 15:43:18.061711 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2027/4058] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:43:17 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 1605 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:43:18.068247 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-18f46956-d5d3-4051-8fd8-f25e54ff63ae tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:18.069012 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-18f46956-d5d3-4051-8fd8-f25e54ff63ae tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 55179126-a629-4bb3-82f5-14606ec63426] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:18.079306 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-18f46956-d5d3-4051-8fd8-f25e54ff63ae tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:18.081138 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-18f46956-d5d3-4051-8fd8-f25e54ff63ae tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:18.081823 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-18f46956-d5d3-4051-8fd8-f25e54ff63ae tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:18.082909 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-18f46956-d5d3-4051-8fd8-f25e54ff63ae tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:18.083788 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-18f46956-d5d3-4051-8fd8-f25e54ff63ae tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:18.084408 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-18f46956-d5d3-4051-8fd8-f25e54ff63ae tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:18.132061 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-18f46956-d5d3-4051-8fd8-f25e54ff63ae tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426/ips" status: 200 len: 143 microversion: 2.1 time: 0.067731 Oct 18 15:43:18.137255 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2028/4059] 10.222.0.60 () {58 vars in 1248 bytes} [Tue Oct 18 15:43:18 2022] GET /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426/ips => generated 143 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:43:18.143470 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-33d570e7-7921-4a22-9cfc-526abef1fa9c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:18.144438 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-33d570e7-7921-4a22-9cfc-526abef1fa9c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 28223cad-bdfe-40ba-905e-56488b5119be] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:18.157703 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-33d570e7-7921-4a22-9cfc-526abef1fa9c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:18.158573 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-33d570e7-7921-4a22-9cfc-526abef1fa9c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:18.159555 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-33d570e7-7921-4a22-9cfc-526abef1fa9c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:18.160721 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-33d570e7-7921-4a22-9cfc-526abef1fa9c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:18.162652 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-33d570e7-7921-4a22-9cfc-526abef1fa9c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:18.164046 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-33d570e7-7921-4a22-9cfc-526abef1fa9c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:19.531768 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-33d570e7-7921-4a22-9cfc-526abef1fa9c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:19.561162 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-33d570e7-7921-4a22-9cfc-526abef1fa9c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/28223cad-bdfe-40ba-905e-56488b5119be" status: 200 len: 1316 microversion: 2.1 time: 1.419289 Oct 18 15:43:19.561982 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2029/4060] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:18 2022] GET /compute/v2.1/servers/28223cad-bdfe-40ba-905e-56488b5119be => generated 1316 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:19.580574 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a26f4522-0eed-4a2c-99d4-a4593c69a463 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:19.582041 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a26f4522-0eed-4a2c-99d4-a4593c69a463 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:19.590566 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a26f4522-0eed-4a2c-99d4-a4593c69a463 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:19.591642 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a26f4522-0eed-4a2c-99d4-a4593c69a463 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:19.592239 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a26f4522-0eed-4a2c-99d4-a4593c69a463 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:19.593135 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a26f4522-0eed-4a2c-99d4-a4593c69a463 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:19.593800 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a26f4522-0eed-4a2c-99d4-a4593c69a463 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:19.594376 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a26f4522-0eed-4a2c-99d4-a4593c69a463 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:20.295350 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a26f4522-0eed-4a2c-99d4-a4593c69a463 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:20.303180 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a26f4522-0eed-4a2c-99d4-a4593c69a463 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1673 microversion: 2.1 time: 0.739391 Oct 18 15:43:20.303779 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2030/4061] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:19 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1673 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:20.323468 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-15f8f1c1-6f4b-4fe4-99e4-92639eb8de5f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:20.324514 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-15f8f1c1-6f4b-4fe4-99e4-92639eb8de5f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 47ee1803-1ce0-4cbc-879e-d39cfe8576aa] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:20.332328 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-15f8f1c1-6f4b-4fe4-99e4-92639eb8de5f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:20.333173 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-15f8f1c1-6f4b-4fe4-99e4-92639eb8de5f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:20.333814 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-15f8f1c1-6f4b-4fe4-99e4-92639eb8de5f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:20.334835 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-15f8f1c1-6f4b-4fe4-99e4-92639eb8de5f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:20.335612 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-15f8f1c1-6f4b-4fe4-99e4-92639eb8de5f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:20.336248 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-15f8f1c1-6f4b-4fe4-99e4-92639eb8de5f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:20.547342 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-5f27f78e-cfa0-4853-b166-0dda92272082 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:43:20.547984 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-5f27f78e-cfa0-4853-b166-0dda92272082 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:43:20.549272 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-5f27f78e-cfa0-4853-b166-0dda92272082 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:43:20.549718 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-5f27f78e-cfa0-4853-b166-0dda92272082 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:43:20.550174 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-5f27f78e-cfa0-4853-b166-0dda92272082 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:43:20.588744 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f27f78e-cfa0-4853-b166-0dda92272082 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:20.589456 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f27f78e-cfa0-4853-b166-0dda92272082 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:20.589921 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f27f78e-cfa0-4853-b166-0dda92272082 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:20.591932 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f27f78e-cfa0-4853-b166-0dda92272082 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:20.592939 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f27f78e-cfa0-4853-b166-0dda92272082 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:20.595455 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f27f78e-cfa0-4853-b166-0dda92272082 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:20.643890 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-5f27f78e-cfa0-4853-b166-0dda92272082 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Getting quotas for project 224ca1f734c14bc8bf31e1826faf8e71. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:43:20.650724 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-5f27f78e-cfa0-4853-b166-0dda92272082 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Getting quotas for user 646fb4652c164c1dab5672d33d9fb295 and project 224ca1f734c14bc8bf31e1826faf8e71. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:43:20.683235 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5f27f78e-cfa0-4853-b166-0dda92272082 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:43:20.686621 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5f27f78e-cfa0-4853-b166-0dda92272082 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: a49f5b92-61e2-44bd-92a9-2bbaa1fb8975] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:43:20.787057 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5f27f78e-cfa0-4853-b166-0dda92272082 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.187986 Oct 18 15:43:20.793142 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2032/4062] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:43:17 2022] POST /compute/v2.1/servers => generated 383 bytes in 3194 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:43:20.804153 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-99a1ccf6-4a93-4e13-a8ac-23f147e6dc60 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:20.807325 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-99a1ccf6-4a93-4e13-a8ac-23f147e6dc60 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: da74a6b9-5e80-4113-bf1d-dfb5a9c13023] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:20.826231 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99a1ccf6-4a93-4e13-a8ac-23f147e6dc60 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:20.831871 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99a1ccf6-4a93-4e13-a8ac-23f147e6dc60 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:20.832624 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99a1ccf6-4a93-4e13-a8ac-23f147e6dc60 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:20.837365 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99a1ccf6-4a93-4e13-a8ac-23f147e6dc60 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:20.838045 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99a1ccf6-4a93-4e13-a8ac-23f147e6dc60 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:20.841110 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99a1ccf6-4a93-4e13-a8ac-23f147e6dc60 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:20.852416 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:43:20.877241 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-15f8f1c1-6f4b-4fe4-99e4-92639eb8de5f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:20.889042 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-15f8f1c1-6f4b-4fe4-99e4-92639eb8de5f tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee1803-1ce0-4cbc-879e-d39cfe8576aa" status: 200 len: 1679 microversion: 2.1 time: 0.569233 Oct 18 15:43:20.892990 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2031/4063] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:20 2022] GET /compute/v2.1/servers/47ee1803-1ce0-4cbc-879e-d39cfe8576aa => generated 1679 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:20.897916 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-98176a8c-d4a4-46e2-90d5-f067d29ec743 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:20.899744 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-98176a8c-d4a4-46e2-90d5-f067d29ec743 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:20.917607 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-98176a8c-d4a4-46e2-90d5-f067d29ec743 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:20.918343 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-98176a8c-d4a4-46e2-90d5-f067d29ec743 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:20.920576 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-98176a8c-d4a4-46e2-90d5-f067d29ec743 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:20.921493 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-98176a8c-d4a4-46e2-90d5-f067d29ec743 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:20.926520 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-98176a8c-d4a4-46e2-90d5-f067d29ec743 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:20.927201 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-98176a8c-d4a4-46e2-90d5-f067d29ec743 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:21.060102 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-98176a8c-d4a4-46e2-90d5-f067d29ec743 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:21.081696 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-98176a8c-d4a4-46e2-90d5-f067d29ec743 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:21.089176 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-98176a8c-d4a4-46e2-90d5-f067d29ec743 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:21.093177 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-98176a8c-d4a4-46e2-90d5-f067d29ec743 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 200 len: 1605 microversion: 2.32 time: 0.198463 Oct 18 15:43:21.097216 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2032/4064] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:43:20 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 1605 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:43:21.104114 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-355bc331-769f-4f46-9464-bf039b3b356e req-b33ca2b5-8346-40c0-9f1a-bd2f72552225 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da74a6b9-5e80-4113-bf1d-dfb5a9c13023", "tag": "282cfd8e-c6e6-4d3a-98ee-d1ce91c32d4c"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:43:21.118618 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-355bc331-769f-4f46-9464-bf039b3b356e req-b33ca2b5-8346-40c0-9f1a-bd2f72552225 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:21.119409 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-355bc331-769f-4f46-9464-bf039b3b356e req-b33ca2b5-8346-40c0-9f1a-bd2f72552225 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:21.120006 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-355bc331-769f-4f46-9464-bf039b3b356e req-b33ca2b5-8346-40c0-9f1a-bd2f72552225 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:21.139103 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-355bc331-769f-4f46-9464-bf039b3b356e req-b33ca2b5-8346-40c0-9f1a-bd2f72552225 service nova] Creating event network-changed:282cfd8e-c6e6-4d3a-98ee-d1ce91c32d4c for instance da74a6b9-5e80-4113-bf1d-dfb5a9c13023 on n-h1-853682-5 Oct 18 15:43:21.149024 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-355bc331-769f-4f46-9464-bf039b3b356e req-b33ca2b5-8346-40c0-9f1a-bd2f72552225 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049137 Oct 18 15:43:21.150844 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2033/4065] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:43:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:43:21.158799 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-aeb30b72-5479-47df-b2b4-cb834ea4aa59 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:21.159792 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-aeb30b72-5479-47df-b2b4-cb834ea4aa59 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 28223cad-bdfe-40ba-905e-56488b5119be] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:21.168117 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aeb30b72-5479-47df-b2b4-cb834ea4aa59 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:21.168947 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aeb30b72-5479-47df-b2b4-cb834ea4aa59 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:21.169633 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aeb30b72-5479-47df-b2b4-cb834ea4aa59 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:21.170940 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aeb30b72-5479-47df-b2b4-cb834ea4aa59 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:21.171195 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aeb30b72-5479-47df-b2b4-cb834ea4aa59 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:21.173314 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aeb30b72-5479-47df-b2b4-cb834ea4aa59 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:21.184561 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-99a1ccf6-4a93-4e13-a8ac-23f147e6dc60 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:21.199466 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-99a1ccf6-4a93-4e13-a8ac-23f147e6dc60 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/da74a6b9-5e80-4113-bf1d-dfb5a9c13023" status: 200 len: 1324 microversion: 2.1 time: 0.404816 Oct 18 15:43:21.200572 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2033/4066] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:20 2022] GET /compute/v2.1/servers/da74a6b9-5e80-4113-bf1d-dfb5a9c13023 => generated 1324 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:21.216598 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a999aa90-5458-4c46-934c-a284f82b82c8 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:21.219482 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a999aa90-5458-4c46-934c-a284f82b82c8 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: a49f5b92-61e2-44bd-92a9-2bbaa1fb8975] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:21.380968 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a999aa90-5458-4c46-934c-a284f82b82c8 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:21.394374 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a999aa90-5458-4c46-934c-a284f82b82c8 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975" status: 200 len: 1222 microversion: 2.1 time: 0.190994 Oct 18 15:43:21.394897 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2034/4067] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:21 2022] GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975 => generated 1222 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:21.407965 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-72c88833-4457-4336-934d-9c89b10b0342 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ea9584b-82af-4b4e-ae12-2544834fe35b"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:43:21.415396 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-72c88833-4457-4336-934d-9c89b10b0342 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 55179126-a629-4bb3-82f5-14606ec63426] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:21.428405 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-72c88833-4457-4336-934d-9c89b10b0342 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:21.428928 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-72c88833-4457-4336-934d-9c89b10b0342 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:21.429713 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-72c88833-4457-4336-934d-9c89b10b0342 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:21.431068 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-72c88833-4457-4336-934d-9c89b10b0342 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:21.431686 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-72c88833-4457-4336-934d-9c89b10b0342 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:21.432657 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-72c88833-4457-4336-934d-9c89b10b0342 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:21.470522 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-aeb30b72-5479-47df-b2b4-cb834ea4aa59 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:21.480208 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-aeb30b72-5479-47df-b2b4-cb834ea4aa59 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/28223cad-bdfe-40ba-905e-56488b5119be" status: 200 len: 1316 microversion: 2.1 time: 0.326643 Oct 18 15:43:21.480795 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2034/4068] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:21 2022] GET /compute/v2.1/servers/28223cad-bdfe-40ba-905e-56488b5119be => generated 1316 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:21.495525 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fdce4c2e-9dfa-4d2d-bb0b-13d8e1d26b48 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:21.496389 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-fdce4c2e-9dfa-4d2d-bb0b-13d8e1d26b48 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:21.515524 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fdce4c2e-9dfa-4d2d-bb0b-13d8e1d26b48 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:21.516031 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fdce4c2e-9dfa-4d2d-bb0b-13d8e1d26b48 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:21.516568 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fdce4c2e-9dfa-4d2d-bb0b-13d8e1d26b48 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:21.517932 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fdce4c2e-9dfa-4d2d-bb0b-13d8e1d26b48 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:21.518604 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fdce4c2e-9dfa-4d2d-bb0b-13d8e1d26b48 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:21.519018 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fdce4c2e-9dfa-4d2d-bb0b-13d8e1d26b48 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:22.054479 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-fdce4c2e-9dfa-4d2d-bb0b-13d8e1d26b48 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:22.066549 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fdce4c2e-9dfa-4d2d-bb0b-13d8e1d26b48 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1671 microversion: 2.1 time: 0.573534 Oct 18 15:43:22.088540 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2035/4069] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:21 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1671 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:22.103027 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d1a2d61f-c243-429a-b1f5-cd10d116bb36 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:22.103934 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d1a2d61f-c243-429a-b1f5-cd10d116bb36 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 47ee1803-1ce0-4cbc-879e-d39cfe8576aa] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:22.112932 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d1a2d61f-c243-429a-b1f5-cd10d116bb36 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:22.113442 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d1a2d61f-c243-429a-b1f5-cd10d116bb36 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:22.113889 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d1a2d61f-c243-429a-b1f5-cd10d116bb36 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:22.114610 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d1a2d61f-c243-429a-b1f5-cd10d116bb36 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:22.117804 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d1a2d61f-c243-429a-b1f5-cd10d116bb36 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:22.118453 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d1a2d61f-c243-429a-b1f5-cd10d116bb36 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:22.292729 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d1a2d61f-c243-429a-b1f5-cd10d116bb36 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec3b4b5b1c46bd9d2c0efa68f86979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55fd6668b481b8c578983dc655785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:22.318948 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d1a2d61f-c243-429a-b1f5-cd10d116bb36 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee1803-1ce0-4cbc-879e-d39cfe8576aa" status: 200 len: 1612 microversion: 2.1 time: 0.219810 Oct 18 15:43:22.321174 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2036/4070] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:22 2022] GET /compute/v2.1/servers/47ee1803-1ce0-4cbc-879e-d39cfe8576aa => generated 1612 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:22.339173 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-abaac225-8cb8-44fe-8615-7a8d99a1cee2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:43:22.350213 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-abaac225-8cb8-44fe-8615-7a8d99a1cee2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:22.357770 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-abaac225-8cb8-44fe-8615-7a8d99a1cee2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:22.358523 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-abaac225-8cb8-44fe-8615-7a8d99a1cee2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:22.359718 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-abaac225-8cb8-44fe-8615-7a8d99a1cee2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:22.361142 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-abaac225-8cb8-44fe-8615-7a8d99a1cee2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:22.361829 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-abaac225-8cb8-44fe-8615-7a8d99a1cee2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:22.363039 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-abaac225-8cb8-44fe-8615-7a8d99a1cee2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:22.368393 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=8 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:43:22.465095 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-abaac225-8cb8-44fe-8615-7a8d99a1cee2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "POST /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8/action" status: 200 len: 322 microversion: 2.1 time: 0.142256 Oct 18 15:43:22.466372 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2037/4071] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:43:22 2022] POST /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8/action => generated 322 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:43:22.471849 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3c2192a5-f73e-4bdc-b454-9b1f6c044626 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:22.473141 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3c2192a5-f73e-4bdc-b454-9b1f6c044626 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:22.487307 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3c2192a5-f73e-4bdc-b454-9b1f6c044626 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:22.487806 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3c2192a5-f73e-4bdc-b454-9b1f6c044626 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:22.488243 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3c2192a5-f73e-4bdc-b454-9b1f6c044626 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:22.489000 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3c2192a5-f73e-4bdc-b454-9b1f6c044626 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:22.489443 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3c2192a5-f73e-4bdc-b454-9b1f6c044626 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:22.496376 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3c2192a5-f73e-4bdc-b454-9b1f6c044626 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:22.909694 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3c2192a5-f73e-4bdc-b454-9b1f6c044626 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:22.928722 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3c2192a5-f73e-4bdc-b454-9b1f6c044626 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:22.933509 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3c2192a5-f73e-4bdc-b454-9b1f6c044626 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:22.934517 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-72c88833-4457-4336-934d-9c89b10b0342 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "POST /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.538344 Oct 18 15:43:22.935720 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2035/4072] 10.222.0.60 () {60 vars in 1323 bytes} [Tue Oct 18 15:43:21 2022] POST /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426/os-volume_attachments => generated 194 bytes in 1540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:43:22.938955 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3c2192a5-f73e-4bdc-b454-9b1f6c044626 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 200 len: 1605 microversion: 2.32 time: 0.470064 Oct 18 15:43:22.944314 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-308c1cbc-98fd-419e-a232-eda79eabcc0a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:22.945081 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-308c1cbc-98fd-419e-a232-eda79eabcc0a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: da74a6b9-5e80-4113-bf1d-dfb5a9c13023] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:22.963365 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-308c1cbc-98fd-419e-a232-eda79eabcc0a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:22.964139 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-308c1cbc-98fd-419e-a232-eda79eabcc0a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:22.966614 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-308c1cbc-98fd-419e-a232-eda79eabcc0a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:22.967644 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-308c1cbc-98fd-419e-a232-eda79eabcc0a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:22.968324 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-308c1cbc-98fd-419e-a232-eda79eabcc0a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:22.971602 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-308c1cbc-98fd-419e-a232-eda79eabcc0a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:22.981675 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2038/4073] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:43:22 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 1605 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:43:22.998671 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7aeb83a0-3b67-468f-9796-e7c14991e15e tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:22.999354 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7aeb83a0-3b67-468f-9796-e7c14991e15e tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: a49f5b92-61e2-44bd-92a9-2bbaa1fb8975] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:23.024221 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7aeb83a0-3b67-468f-9796-e7c14991e15e tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:23.024725 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7aeb83a0-3b67-468f-9796-e7c14991e15e tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:23.034924 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7aeb83a0-3b67-468f-9796-e7c14991e15e tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:23.035740 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7aeb83a0-3b67-468f-9796-e7c14991e15e tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:23.036236 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7aeb83a0-3b67-468f-9796-e7c14991e15e tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:23.036677 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7aeb83a0-3b67-468f-9796-e7c14991e15e tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:23.106748 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:43:23.882067 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7aeb83a0-3b67-468f-9796-e7c14991e15e tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:23.901049 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7aeb83a0-3b67-468f-9796-e7c14991e15e tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975" status: 200 len: 1280 microversion: 2.1 time: 0.914582 Oct 18 15:43:23.901676 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2039/4074] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:22 2022] GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975 => generated 1280 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:23.940382 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-75dc82c4-cd7a-4c3b-9b50-b489c02fe202 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:23.943202 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-75dc82c4-cd7a-4c3b-9b50-b489c02fe202 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:23.971662 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-75dc82c4-cd7a-4c3b-9b50-b489c02fe202 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:23.972960 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-75dc82c4-cd7a-4c3b-9b50-b489c02fe202 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:23.975224 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-75dc82c4-cd7a-4c3b-9b50-b489c02fe202 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:23.977018 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-75dc82c4-cd7a-4c3b-9b50-b489c02fe202 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:23.977519 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-75dc82c4-cd7a-4c3b-9b50-b489c02fe202 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:23.980148 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-75dc82c4-cd7a-4c3b-9b50-b489c02fe202 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:24.284332 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-308c1cbc-98fd-419e-a232-eda79eabcc0a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:24.295116 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-308c1cbc-98fd-419e-a232-eda79eabcc0a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/da74a6b9-5e80-4113-bf1d-dfb5a9c13023" status: 200 len: 1324 microversion: 2.1 time: 1.358009 Oct 18 15:43:24.300049 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2036/4075] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:22 2022] GET /compute/v2.1/servers/da74a6b9-5e80-4113-bf1d-dfb5a9c13023 => generated 1324 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:24.324949 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-14f020bc-7cb0-437d-a258-a90b093b9cf3 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:24.327436 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-14f020bc-7cb0-437d-a258-a90b093b9cf3 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 28223cad-bdfe-40ba-905e-56488b5119be] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:24.340699 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14f020bc-7cb0-437d-a258-a90b093b9cf3 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:24.344031 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14f020bc-7cb0-437d-a258-a90b093b9cf3 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:24.345920 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14f020bc-7cb0-437d-a258-a90b093b9cf3 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:24.351526 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14f020bc-7cb0-437d-a258-a90b093b9cf3 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:24.352307 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14f020bc-7cb0-437d-a258-a90b093b9cf3 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:24.352996 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14f020bc-7cb0-437d-a258-a90b093b9cf3 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:24.685936 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-75dc82c4-cd7a-4c3b-9b50-b489c02fe202 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:24.703714 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-75dc82c4-cd7a-4c3b-9b50-b489c02fe202 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1671 microversion: 2.1 time: 0.775530 Oct 18 15:43:24.704310 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2040/4076] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:23 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1671 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:24.725870 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-a2d47dde-610c-4d61-a9a5-ed43c2ccbd20 req-9af95466-34d4-4e98-81cf-df4633d90a6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47ee1803-1ce0-4cbc-879e-d39cfe8576aa", "name": "network-vif-deleted", "tag": "6255b173-b912-4205-9fcd-434867d970a5"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:43:24.749080 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-a2d47dde-610c-4d61-a9a5-ed43c2ccbd20 req-9af95466-34d4-4e98-81cf-df4633d90a6d service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:24.749846 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-a2d47dde-610c-4d61-a9a5-ed43c2ccbd20 req-9af95466-34d4-4e98-81cf-df4633d90a6d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:24.750454 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-a2d47dde-610c-4d61-a9a5-ed43c2ccbd20 req-9af95466-34d4-4e98-81cf-df4633d90a6d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:24.771628 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-a2d47dde-610c-4d61-a9a5-ed43c2ccbd20 req-9af95466-34d4-4e98-81cf-df4633d90a6d service nova] Creating event network-vif-deleted:6255b173-b912-4205-9fcd-434867d970a5 for instance 47ee1803-1ce0-4cbc-879e-d39cfe8576aa on n-h1-853682-5 Oct 18 15:43:24.778806 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-a2d47dde-610c-4d61-a9a5-ed43c2ccbd20 req-9af95466-34d4-4e98-81cf-df4633d90a6d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065925 Oct 18 15:43:24.784493 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2041/4077] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:43:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:43:24.794803 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ff904666-b6ed-4afd-b55d-a411d6173f07 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:24.795468 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ff904666-b6ed-4afd-b55d-a411d6173f07 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 47ee1803-1ce0-4cbc-879e-d39cfe8576aa] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:24.829422 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ff904666-b6ed-4afd-b55d-a411d6173f07 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:24.829847 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ff904666-b6ed-4afd-b55d-a411d6173f07 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:24.830288 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ff904666-b6ed-4afd-b55d-a411d6173f07 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:24.831194 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ff904666-b6ed-4afd-b55d-a411d6173f07 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:24.831810 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ff904666-b6ed-4afd-b55d-a411d6173f07 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:24.832384 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ff904666-b6ed-4afd-b55d-a411d6173f07 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:24.865426 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-ff904666-b6ed-4afd-b55d-a411d6173f07 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] HTTP exception thrown: Instance 47ee1803-1ce0-4cbc-879e-d39cfe8576aa could not be found. Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ff904666-b6ed-4afd-b55d-a411d6173f07 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Request method failure captured: Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/47ee1803-1ce0-4cbc-879e-d39cfe8576aa HTTP/1.1 Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsfD3tyC5zBBCs3PM6SgagJOA9ytEd34lT9my352h69qxn0wNQWvVVVEceKNcLlE8Cld2E1ewLfFQUA6X-zyH4NCgXE9isdDnVpnJB5BT1ljNdC07pganRFql9FpScM1-Xjt5su1w2IBkP6ZVV1NsRclcY3oY_ScUp2DhZs2W7X1y8Y Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: a5b55fd6668b481b8c578983dc655785 Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-AttachVolumeNegativeTest-1298357771 Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a5b55fd6668b481b8c578983dc655785"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a5b55fd6668b481b8c578983dc655785"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a5b55fd6668b481b8c578983dc655785"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a5b55fd6668b481b8c578983dc655785"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-AttachVolumeNegativeTest-1298357771 Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: a5b55fd6668b481b8c578983dc655785 Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1298357771 Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-AttachVolumeNegativeTest-1298357771-project Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: efec3b4b5b1c46bd9d2c0efa68f86979 Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-AttachVolumeNegativeTest-1298357771-project Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 47ee1803-1ce0-4cbc-879e-d39cfe8576aa could not be found. Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '47ee1803-1ce0-4cbc-879e-d39cfe8576aa'} Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47ee1803-1ce0-4cbc-879e-d39cfe8576aa could not be found. Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47ee1803-1ce0-4cbc-879e-d39cfe8576aa could not be found. Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:43:24.867148 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:24.875036 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:24.875036 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:43:24.875036 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:43:24.875036 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:43:24.875036 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:43:24.875036 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47ee1803-1ce0-4cbc-879e-d39cfe8576aa could not be found. Oct 18 15:43:24.875036 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:24.875036 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ff904666-b6ed-4afd-b55d-a411d6173f07 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Returning 404 to user: Instance 47ee1803-1ce0-4cbc-879e-d39cfe8576aa could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:43:24.875036 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ff904666-b6ed-4afd-b55d-a411d6173f07 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee1803-1ce0-4cbc-879e-d39cfe8576aa" status: 404 len: 111 microversion: 2.1 time: 0.082638 Oct 18 15:43:24.875036 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2042/4078] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:24 2022] GET /compute/v2.1/servers/47ee1803-1ce0-4cbc-879e-d39cfe8576aa => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:43:24.891241 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-714e39a8-19c7-4081-a075-9cb6b24c830b tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:24.892375 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-714e39a8-19c7-4081-a075-9cb6b24c830b tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:24.899952 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-714e39a8-19c7-4081-a075-9cb6b24c830b tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:24.900668 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-714e39a8-19c7-4081-a075-9cb6b24c830b tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:24.901385 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-714e39a8-19c7-4081-a075-9cb6b24c830b tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:24.902932 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-714e39a8-19c7-4081-a075-9cb6b24c830b tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:24.903548 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-714e39a8-19c7-4081-a075-9cb6b24c830b tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:24.904129 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-714e39a8-19c7-4081-a075-9cb6b24c830b tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:25.074684 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-714e39a8-19c7-4081-a075-9cb6b24c830b tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:25.092690 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-714e39a8-19c7-4081-a075-9cb6b24c830b tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:25.094792 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-714e39a8-19c7-4081-a075-9cb6b24c830b tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:25.096492 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-714e39a8-19c7-4081-a075-9cb6b24c830b tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 200 len: 1605 microversion: 2.32 time: 0.226338 Oct 18 15:43:25.097312 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-14f020bc-7cb0-437d-a258-a90b093b9cf3 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:25.097612 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2043/4079] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:43:24 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 1605 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:43:25.104036 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-911bc445-d420-4e87-8b9f-ec005e802a7d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:25.105016 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-911bc445-d420-4e87-8b9f-ec005e802a7d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:25.108673 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-14f020bc-7cb0-437d-a258-a90b093b9cf3 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/28223cad-bdfe-40ba-905e-56488b5119be" status: 200 len: 1316 microversion: 2.1 time: 0.793676 Oct 18 15:43:25.109842 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2037/4080] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:24 2022] GET /compute/v2.1/servers/28223cad-bdfe-40ba-905e-56488b5119be => generated 1316 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:25.125877 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4315d1d0-bc04-408c-a01e-17ec1165d182 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '.version_select at 0x7f7c3da0a3a0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:25.143077 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-911bc445-d420-4e87-8b9f-ec005e802a7d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:25.143945 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-911bc445-d420-4e87-8b9f-ec005e802a7d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:25.145156 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-911bc445-d420-4e87-8b9f-ec005e802a7d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:25.146384 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-911bc445-d420-4e87-8b9f-ec005e802a7d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:25.147025 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-911bc445-d420-4e87-8b9f-ec005e802a7d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:25.147654 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-911bc445-d420-4e87-8b9f-ec005e802a7d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:25.162669 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4315d1d0-bc04-408c-a01e-17ec1165d182 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-807278262" status: 202 len: 0 microversion: 2.1 time: 0.050761 Oct 18 15:43:25.163581 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2038/4081] 10.222.0.60 () {58 vars in 1218 bytes} [Tue Oct 18 15:43:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-807278262 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:43:25.172611 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-26fa6e46-fca7-47fd-80c2-ce6e4be03c12 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:25.176280 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-26fa6e46-fca7-47fd-80c2-ce6e4be03c12 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: a49f5b92-61e2-44bd-92a9-2bbaa1fb8975] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:25.188635 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26fa6e46-fca7-47fd-80c2-ce6e4be03c12 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:25.199311 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26fa6e46-fca7-47fd-80c2-ce6e4be03c12 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:25.200056 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26fa6e46-fca7-47fd-80c2-ce6e4be03c12 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:25.200848 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26fa6e46-fca7-47fd-80c2-ce6e4be03c12 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:25.201571 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26fa6e46-fca7-47fd-80c2-ce6e4be03c12 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:25.202201 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26fa6e46-fca7-47fd-80c2-ce6e4be03c12 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:25.482730 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-26fa6e46-fca7-47fd-80c2-ce6e4be03c12 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:25.499494 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-26fa6e46-fca7-47fd-80c2-ce6e4be03c12 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975" status: 200 len: 1280 microversion: 2.1 time: 0.334344 Oct 18 15:43:25.505445 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2039/4082] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:25 2022] GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975 => generated 1280 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:25.512219 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-01dca32f-52cb-41f8-bd4e-e27ab63bfba2 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:25.516433 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-01dca32f-52cb-41f8-bd4e-e27ab63bfba2 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: da74a6b9-5e80-4113-bf1d-dfb5a9c13023] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:25.530298 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01dca32f-52cb-41f8-bd4e-e27ab63bfba2 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:25.531375 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01dca32f-52cb-41f8-bd4e-e27ab63bfba2 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:25.531966 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01dca32f-52cb-41f8-bd4e-e27ab63bfba2 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:25.534467 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01dca32f-52cb-41f8-bd4e-e27ab63bfba2 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:25.535851 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01dca32f-52cb-41f8-bd4e-e27ab63bfba2 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:25.538022 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01dca32f-52cb-41f8-bd4e-e27ab63bfba2 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:25.898022 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-911bc445-d420-4e87-8b9f-ec005e802a7d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:25.913248 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-911bc445-d420-4e87-8b9f-ec005e802a7d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1671 microversion: 2.1 time: 0.814058 Oct 18 15:43:25.929728 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2044/4083] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:25 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1671 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:25.943825 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8f3ae58d-e17f-43a5-8286-3af50d0ed5a4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:25.944673 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8f3ae58d-e17f-43a5-8286-3af50d0ed5a4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:25.958468 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8f3ae58d-e17f-43a5-8286-3af50d0ed5a4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:25.961249 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8f3ae58d-e17f-43a5-8286-3af50d0ed5a4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:25.965348 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8f3ae58d-e17f-43a5-8286-3af50d0ed5a4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:25.966308 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8f3ae58d-e17f-43a5-8286-3af50d0ed5a4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:25.966933 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8f3ae58d-e17f-43a5-8286-3af50d0ed5a4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:25.967519 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8f3ae58d-e17f-43a5-8286-3af50d0ed5a4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:26.335564 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-01dca32f-52cb-41f8-bd4e-e27ab63bfba2 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:26.353973 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-01dca32f-52cb-41f8-bd4e-e27ab63bfba2 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/da74a6b9-5e80-4113-bf1d-dfb5a9c13023" status: 200 len: 1324 microversion: 2.1 time: 0.845980 Oct 18 15:43:26.354621 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2040/4084] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:25 2022] GET /compute/v2.1/servers/da74a6b9-5e80-4113-bf1d-dfb5a9c13023 => generated 1324 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:26.370451 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7b9f6cf2-5e61-4039-ace3-cadba2abc864 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:26.373312 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7b9f6cf2-5e61-4039-ace3-cadba2abc864 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:26.395887 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b9f6cf2-5e61-4039-ace3-cadba2abc864 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:26.399303 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b9f6cf2-5e61-4039-ace3-cadba2abc864 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:26.401479 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b9f6cf2-5e61-4039-ace3-cadba2abc864 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:26.403498 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b9f6cf2-5e61-4039-ace3-cadba2abc864 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:26.403498 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b9f6cf2-5e61-4039-ace3-cadba2abc864 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:26.403498 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b9f6cf2-5e61-4039-ace3-cadba2abc864 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:26.619285 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7b9f6cf2-5e61-4039-ace3-cadba2abc864 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:26.636530 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7b9f6cf2-5e61-4039-ace3-cadba2abc864 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:26.639432 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7b9f6cf2-5e61-4039-ace3-cadba2abc864 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:26.641650 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7b9f6cf2-5e61-4039-ace3-cadba2abc864 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 200 len: 1605 microversion: 2.32 time: 0.284674 Oct 18 15:43:26.643004 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2041/4085] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:43:26 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 1605 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:43:26.648522 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-71b0ffbd-c001-49eb-8464-4c1c6b617e1f tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:26.649733 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-71b0ffbd-c001-49eb-8464-4c1c6b617e1f tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 28223cad-bdfe-40ba-905e-56488b5119be] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:26.657741 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71b0ffbd-c001-49eb-8464-4c1c6b617e1f tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:26.658559 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71b0ffbd-c001-49eb-8464-4c1c6b617e1f tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:26.659440 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71b0ffbd-c001-49eb-8464-4c1c6b617e1f tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:26.660543 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71b0ffbd-c001-49eb-8464-4c1c6b617e1f tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:26.661239 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71b0ffbd-c001-49eb-8464-4c1c6b617e1f tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:26.661845 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71b0ffbd-c001-49eb-8464-4c1c6b617e1f tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:26.758605 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8f3ae58d-e17f-43a5-8286-3af50d0ed5a4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:26.773089 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8f3ae58d-e17f-43a5-8286-3af50d0ed5a4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1671 microversion: 2.1 time: 0.832487 Oct 18 15:43:26.774988 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2045/4086] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:25 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1671 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:43:26.781152 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4a0bcbc9-ca91-4965-a007-0bc539576894 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:26.783680 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4a0bcbc9-ca91-4965-a007-0bc539576894 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: a49f5b92-61e2-44bd-92a9-2bbaa1fb8975] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:26.791250 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4a0bcbc9-ca91-4965-a007-0bc539576894 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:26.792411 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4a0bcbc9-ca91-4965-a007-0bc539576894 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:26.793667 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4a0bcbc9-ca91-4965-a007-0bc539576894 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:26.794677 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4a0bcbc9-ca91-4965-a007-0bc539576894 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:26.796942 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4a0bcbc9-ca91-4965-a007-0bc539576894 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:26.798042 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4a0bcbc9-ca91-4965-a007-0bc539576894 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:26.955331 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4a0bcbc9-ca91-4965-a007-0bc539576894 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:26.972079 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4a0bcbc9-ca91-4965-a007-0bc539576894 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975" status: 200 len: 1280 microversion: 2.1 time: 0.195544 Oct 18 15:43:26.976504 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2046/4087] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:26 2022] GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975 => generated 1280 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:26.988403 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9b94c0ea-ced4-46ba-a53d-f84aa2954498 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:26.997806 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9b94c0ea-ced4-46ba-a53d-f84aa2954498 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:27.015790 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9b94c0ea-ced4-46ba-a53d-f84aa2954498 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:27.016299 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9b94c0ea-ced4-46ba-a53d-f84aa2954498 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:27.016752 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9b94c0ea-ced4-46ba-a53d-f84aa2954498 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:27.017620 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9b94c0ea-ced4-46ba-a53d-f84aa2954498 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:27.018091 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9b94c0ea-ced4-46ba-a53d-f84aa2954498 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:27.028629 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9b94c0ea-ced4-46ba-a53d-f84aa2954498 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:27.549795 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-71b0ffbd-c001-49eb-8464-4c1c6b617e1f tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:27.562510 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-71b0ffbd-c001-49eb-8464-4c1c6b617e1f tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/28223cad-bdfe-40ba-905e-56488b5119be" status: 200 len: 1316 microversion: 2.1 time: 0.917982 Oct 18 15:43:27.563694 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2042/4088] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:26 2022] GET /compute/v2.1/servers/28223cad-bdfe-40ba-905e-56488b5119be => generated 1316 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:27.581887 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-d0f7ed2e-9ece-489f-abec-008ae7086fec req-966f41e2-c8f6-424e-b4a0-e3e2881dd165 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28223cad-bdfe-40ba-905e-56488b5119be", "tag": "b1722f5a-1373-4cc7-a352-49bccad122e7"}, {"name": "network-changed", "server_uuid": "19226472-0c76-46f8-a4ba-7d32931341a2", "tag": "b7515f7b-6a3a-4506-9e92-d62882ce4d5f"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:43:27.599407 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d0f7ed2e-9ece-489f-abec-008ae7086fec req-966f41e2-c8f6-424e-b4a0-e3e2881dd165 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:27.600262 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d0f7ed2e-9ece-489f-abec-008ae7086fec req-966f41e2-c8f6-424e-b4a0-e3e2881dd165 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:27.601069 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d0f7ed2e-9ece-489f-abec-008ae7086fec req-966f41e2-c8f6-424e-b4a0-e3e2881dd165 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:27.626699 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-d0f7ed2e-9ece-489f-abec-008ae7086fec req-966f41e2-c8f6-424e-b4a0-e3e2881dd165 service nova] Creating event network-changed:b1722f5a-1373-4cc7-a352-49bccad122e7 for instance 28223cad-bdfe-40ba-905e-56488b5119be on n-h1-853682-5 Oct 18 15:43:27.627306 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-d0f7ed2e-9ece-489f-abec-008ae7086fec req-966f41e2-c8f6-424e-b4a0-e3e2881dd165 service nova] Creating event network-changed:b7515f7b-6a3a-4506-9e92-d62882ce4d5f for instance 19226472-0c76-46f8-a4ba-7d32931341a2 on n-h2-853682-5 Oct 18 15:43:27.647978 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-d0f7ed2e-9ece-489f-abec-008ae7086fec req-966f41e2-c8f6-424e-b4a0-e3e2881dd165 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.083044 Oct 18 15:43:27.649008 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2043/4089] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:43:27.655412 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-10c0f6da-078a-4674-b94a-54a9e73d4a6c req-360f7280-42e3-4848-b6cb-0898f8d30341 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da74a6b9-5e80-4113-bf1d-dfb5a9c13023", "name": "network-vif-plugged", "status": "completed", "tag": "282cfd8e-c6e6-4d3a-98ee-d1ce91c32d4c"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:43:27.673998 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-10c0f6da-078a-4674-b94a-54a9e73d4a6c req-360f7280-42e3-4848-b6cb-0898f8d30341 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:27.674759 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-10c0f6da-078a-4674-b94a-54a9e73d4a6c req-360f7280-42e3-4848-b6cb-0898f8d30341 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:27.675424 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-10c0f6da-078a-4674-b94a-54a9e73d4a6c req-360f7280-42e3-4848-b6cb-0898f8d30341 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:27.690091 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-10c0f6da-078a-4674-b94a-54a9e73d4a6c req-360f7280-42e3-4848-b6cb-0898f8d30341 service nova] Creating event network-vif-plugged:282cfd8e-c6e6-4d3a-98ee-d1ce91c32d4c for instance da74a6b9-5e80-4113-bf1d-dfb5a9c13023 on n-h1-853682-5 Oct 18 15:43:27.696656 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-10c0f6da-078a-4674-b94a-54a9e73d4a6c req-360f7280-42e3-4848-b6cb-0898f8d30341 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045706 Oct 18 15:43:27.698033 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2044/4090] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:43:27.707369 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b1c99c0b-cc7c-4386-b790-6690963c3f40 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:27.708369 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b1c99c0b-cc7c-4386-b790-6690963c3f40 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: da74a6b9-5e80-4113-bf1d-dfb5a9c13023] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:27.716567 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1c99c0b-cc7c-4386-b790-6690963c3f40 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:27.717402 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1c99c0b-cc7c-4386-b790-6690963c3f40 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:27.718056 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1c99c0b-cc7c-4386-b790-6690963c3f40 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:27.719585 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1c99c0b-cc7c-4386-b790-6690963c3f40 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:27.720296 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1c99c0b-cc7c-4386-b790-6690963c3f40 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:27.720792 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1c99c0b-cc7c-4386-b790-6690963c3f40 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:28.167757 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9b94c0ea-ced4-46ba-a53d-f84aa2954498 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:28.179821 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9b94c0ea-ced4-46ba-a53d-f84aa2954498 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1671 microversion: 2.1 time: 1.201576 Oct 18 15:43:28.180693 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2047/4091] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:26 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1671 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:28.192801 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c96474f0-3f9b-4d83-b667-7af35ae599a3 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:28.193449 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c96474f0-3f9b-4d83-b667-7af35ae599a3 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:28.208480 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c96474f0-3f9b-4d83-b667-7af35ae599a3 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:28.211717 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c96474f0-3f9b-4d83-b667-7af35ae599a3 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:28.212383 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c96474f0-3f9b-4d83-b667-7af35ae599a3 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:28.213317 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c96474f0-3f9b-4d83-b667-7af35ae599a3 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:28.216796 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c96474f0-3f9b-4d83-b667-7af35ae599a3 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:28.217519 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c96474f0-3f9b-4d83-b667-7af35ae599a3 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:28.402130 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b1c99c0b-cc7c-4386-b790-6690963c3f40 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:28.414392 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b1c99c0b-cc7c-4386-b790-6690963c3f40 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/da74a6b9-5e80-4113-bf1d-dfb5a9c13023" status: 200 len: 1324 microversion: 2.1 time: 0.713645 Oct 18 15:43:28.425459 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2045/4092] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:27 2022] GET /compute/v2.1/servers/da74a6b9-5e80-4113-bf1d-dfb5a9c13023 => generated 1324 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:28.432930 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d410fd3f-ee44-4e1c-928a-75b8b22183b9 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:28.432930 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d410fd3f-ee44-4e1c-928a-75b8b22183b9 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: a49f5b92-61e2-44bd-92a9-2bbaa1fb8975] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:28.446073 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d410fd3f-ee44-4e1c-928a-75b8b22183b9 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:28.448066 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d410fd3f-ee44-4e1c-928a-75b8b22183b9 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:28.449245 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d410fd3f-ee44-4e1c-928a-75b8b22183b9 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:28.451696 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d410fd3f-ee44-4e1c-928a-75b8b22183b9 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:28.453384 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d410fd3f-ee44-4e1c-928a-75b8b22183b9 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:28.454555 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d410fd3f-ee44-4e1c-928a-75b8b22183b9 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:28.625328 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c96474f0-3f9b-4d83-b667-7af35ae599a3 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:28.635195 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c96474f0-3f9b-4d83-b667-7af35ae599a3 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:28.643577 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c96474f0-3f9b-4d83-b667-7af35ae599a3 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:28.646546 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c96474f0-3f9b-4d83-b667-7af35ae599a3 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 200 len: 1605 microversion: 2.32 time: 0.464693 Oct 18 15:43:28.660837 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2048/4093] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:43:28 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 1605 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:43:28.660837 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7a628674-59f8-43c8-90fb-3b03311d92ad tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-70374558", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "f7f357f0-b7b8-48ee-8cbb-a57289af59df"}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:43:28.757349 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-7a628674-59f8-43c8-90fb-3b03311d92ad tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] validate_networks() for [('f7f357f0-b7b8-48ee-8cbb-a57289af59df', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:43:29.099705 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d410fd3f-ee44-4e1c-928a-75b8b22183b9 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:29.110535 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d410fd3f-ee44-4e1c-928a-75b8b22183b9 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975" status: 200 len: 1322 microversion: 2.1 time: 0.693232 Oct 18 15:43:29.111468 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2046/4094] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:28 2022] GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975 => generated 1322 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:29.116218 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5e641d58-3dda-4002-8056-ac317b5724e9 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:29.116843 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5e641d58-3dda-4002-8056-ac317b5724e9 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 28223cad-bdfe-40ba-905e-56488b5119be] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:29.158522 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e641d58-3dda-4002-8056-ac317b5724e9 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:29.159263 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e641d58-3dda-4002-8056-ac317b5724e9 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:29.159700 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e641d58-3dda-4002-8056-ac317b5724e9 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:29.160419 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e641d58-3dda-4002-8056-ac317b5724e9 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:29.160902 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e641d58-3dda-4002-8056-ac317b5724e9 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:29.161324 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e641d58-3dda-4002-8056-ac317b5724e9 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:29.663869 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5e641d58-3dda-4002-8056-ac317b5724e9 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:29.666289 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:43:29.673455 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5e641d58-3dda-4002-8056-ac317b5724e9 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/28223cad-bdfe-40ba-905e-56488b5119be" status: 200 len: 1316 microversion: 2.1 time: 0.560721 Oct 18 15:43:29.674070 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2047/4095] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:29 2022] GET /compute/v2.1/servers/28223cad-bdfe-40ba-905e-56488b5119be => generated 1316 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:29.712132 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5f1a53e6-d685-41fa-bf00-b3b0cef7253f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:29.712759 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5f1a53e6-d685-41fa-bf00-b3b0cef7253f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: da74a6b9-5e80-4113-bf1d-dfb5a9c13023] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:29.720486 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f1a53e6-d685-41fa-bf00-b3b0cef7253f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:29.721185 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f1a53e6-d685-41fa-bf00-b3b0cef7253f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:29.722867 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f1a53e6-d685-41fa-bf00-b3b0cef7253f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:29.723599 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f1a53e6-d685-41fa-bf00-b3b0cef7253f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:29.724066 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f1a53e6-d685-41fa-bf00-b3b0cef7253f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:29.724496 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f1a53e6-d685-41fa-bf00-b3b0cef7253f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:30.102258 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-7a628674-59f8-43c8-90fb-3b03311d92ad tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:43:30.102675 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-7a628674-59f8-43c8-90fb-3b03311d92ad tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:43:30.103281 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-7a628674-59f8-43c8-90fb-3b03311d92ad tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:43:30.103868 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-7a628674-59f8-43c8-90fb-3b03311d92ad tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:43:30.104292 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-7a628674-59f8-43c8-90fb-3b03311d92ad tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:43:30.114554 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7a628674-59f8-43c8-90fb-3b03311d92ad tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:30.115416 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7a628674-59f8-43c8-90fb-3b03311d92ad tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:30.116098 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7a628674-59f8-43c8-90fb-3b03311d92ad tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:30.117087 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7a628674-59f8-43c8-90fb-3b03311d92ad tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:30.117768 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7a628674-59f8-43c8-90fb-3b03311d92ad tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:30.118371 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7a628674-59f8-43c8-90fb-3b03311d92ad tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:30.165257 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-7a628674-59f8-43c8-90fb-3b03311d92ad tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Getting quotas for project 2a2cdc778bd54f209d70f5b8703dc068. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:43:30.182895 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-7a628674-59f8-43c8-90fb-3b03311d92ad tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Getting quotas for user 2aa0148a4a43466da619ea9843b3f78c and project 2a2cdc778bd54f209d70f5b8703dc068. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:43:30.217871 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7a628674-59f8-43c8-90fb-3b03311d92ad tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:43:30.221366 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7a628674-59f8-43c8-90fb-3b03311d92ad tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: e6019a42-1115-4a7b-bfab-badb33cafed8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:43:30.365816 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7a628674-59f8-43c8-90fb-3b03311d92ad tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.715891 Oct 18 15:43:30.369735 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2049/4096] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:43:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:43:30.399587 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2ef2fce4-a4af-45c1-90cc-8bee30bcbe9a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:30.415388 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2ef2fce4-a4af-45c1-90cc-8bee30bcbe9a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:30.436168 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2ef2fce4-a4af-45c1-90cc-8bee30bcbe9a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:30.437122 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2ef2fce4-a4af-45c1-90cc-8bee30bcbe9a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:30.437828 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2ef2fce4-a4af-45c1-90cc-8bee30bcbe9a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:30.438760 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2ef2fce4-a4af-45c1-90cc-8bee30bcbe9a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:30.439770 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2ef2fce4-a4af-45c1-90cc-8bee30bcbe9a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:30.440551 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2ef2fce4-a4af-45c1-90cc-8bee30bcbe9a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:30.619963 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:43:30.921503 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2ef2fce4-a4af-45c1-90cc-8bee30bcbe9a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:30.939473 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2ef2fce4-a4af-45c1-90cc-8bee30bcbe9a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:30.943740 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2ef2fce4-a4af-45c1-90cc-8bee30bcbe9a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:30.945172 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2ef2fce4-a4af-45c1-90cc-8bee30bcbe9a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 200 len: 1605 microversion: 2.32 time: 0.565943 Oct 18 15:43:30.947269 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2050/4097] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:43:30 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 1605 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:43:30.959540 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e6460619-040b-402f-a5dc-e7504d4a8f4a tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:30.961332 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e6460619-040b-402f-a5dc-e7504d4a8f4a tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: a49f5b92-61e2-44bd-92a9-2bbaa1fb8975] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:30.977358 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e6460619-040b-402f-a5dc-e7504d4a8f4a tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:30.977905 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e6460619-040b-402f-a5dc-e7504d4a8f4a tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:30.978358 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e6460619-040b-402f-a5dc-e7504d4a8f4a tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:30.979714 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e6460619-040b-402f-a5dc-e7504d4a8f4a tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:30.986664 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e6460619-040b-402f-a5dc-e7504d4a8f4a tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:30.988377 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e6460619-040b-402f-a5dc-e7504d4a8f4a tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:31.091269 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5f1a53e6-d685-41fa-bf00-b3b0cef7253f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:31.117530 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5f1a53e6-d685-41fa-bf00-b3b0cef7253f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/da74a6b9-5e80-4113-bf1d-dfb5a9c13023" status: 200 len: 1324 microversion: 2.1 time: 1.413772 Oct 18 15:43:31.120123 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2048/4098] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:29 2022] GET /compute/v2.1/servers/da74a6b9-5e80-4113-bf1d-dfb5a9c13023 => generated 1324 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:31.138700 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9d12d0a5-c916-400f-b7f4-1a52d35b214b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:31.140984 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9d12d0a5-c916-400f-b7f4-1a52d35b214b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: e6019a42-1115-4a7b-bfab-badb33cafed8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:31.371154 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9d12d0a5-c916-400f-b7f4-1a52d35b214b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:31.379576 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9d12d0a5-c916-400f-b7f4-1a52d35b214b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8" status: 200 len: 1213 microversion: 2.1 time: 0.258382 Oct 18 15:43:31.387020 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2049/4099] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:31 2022] GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8 => generated 1213 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:31.406561 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5833ac27-3e1b-4f00-82d9-29ac2b429367 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:31.407303 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5833ac27-3e1b-4f00-82d9-29ac2b429367 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 28223cad-bdfe-40ba-905e-56488b5119be] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:31.414350 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5833ac27-3e1b-4f00-82d9-29ac2b429367 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:31.415031 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5833ac27-3e1b-4f00-82d9-29ac2b429367 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:31.415580 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5833ac27-3e1b-4f00-82d9-29ac2b429367 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:31.416438 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5833ac27-3e1b-4f00-82d9-29ac2b429367 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:31.417038 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5833ac27-3e1b-4f00-82d9-29ac2b429367 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:31.417589 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5833ac27-3e1b-4f00-82d9-29ac2b429367 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:31.936009 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e6460619-040b-402f-a5dc-e7504d4a8f4a tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:31.945442 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e6460619-040b-402f-a5dc-e7504d4a8f4a tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975" status: 200 len: 1322 microversion: 2.1 time: 0.997077 Oct 18 15:43:31.965260 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2051/4100] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:30 2022] GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975 => generated 1322 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:31.977038 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2b9ea77d-3039-4604-9be8-9dbf6db64a46 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:31.977929 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2b9ea77d-3039-4604-9be8-9dbf6db64a46 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:31.992851 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2b9ea77d-3039-4604-9be8-9dbf6db64a46 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:31.993605 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2b9ea77d-3039-4604-9be8-9dbf6db64a46 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:31.994318 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2b9ea77d-3039-4604-9be8-9dbf6db64a46 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:31.995463 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2b9ea77d-3039-4604-9be8-9dbf6db64a46 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:31.996358 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2b9ea77d-3039-4604-9be8-9dbf6db64a46 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:31.997050 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2b9ea77d-3039-4604-9be8-9dbf6db64a46 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:32.141085 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5833ac27-3e1b-4f00-82d9-29ac2b429367 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:32.154092 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5833ac27-3e1b-4f00-82d9-29ac2b429367 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/28223cad-bdfe-40ba-905e-56488b5119be" status: 200 len: 1316 microversion: 2.1 time: 0.751919 Oct 18 15:43:32.157126 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2050/4101] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:31 2022] GET /compute/v2.1/servers/28223cad-bdfe-40ba-905e-56488b5119be => generated 1316 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:32.164248 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5f349988-0a84-4f7c-b814-3b95ee66d83f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:32.168452 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5f349988-0a84-4f7c-b814-3b95ee66d83f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: da74a6b9-5e80-4113-bf1d-dfb5a9c13023] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:32.184682 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f349988-0a84-4f7c-b814-3b95ee66d83f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:32.185459 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f349988-0a84-4f7c-b814-3b95ee66d83f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:32.186238 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f349988-0a84-4f7c-b814-3b95ee66d83f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:32.187192 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f349988-0a84-4f7c-b814-3b95ee66d83f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:32.187857 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f349988-0a84-4f7c-b814-3b95ee66d83f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:32.188675 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f349988-0a84-4f7c-b814-3b95ee66d83f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:32.592119 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2b9ea77d-3039-4604-9be8-9dbf6db64a46 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:32.612768 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2b9ea77d-3039-4604-9be8-9dbf6db64a46 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:32.615874 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2b9ea77d-3039-4604-9be8-9dbf6db64a46 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:32.618362 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2b9ea77d-3039-4604-9be8-9dbf6db64a46 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 200 len: 1605 microversion: 2.32 time: 0.646313 Oct 18 15:43:32.619168 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2052/4102] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:43:31 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 1605 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:43:32.625206 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-02f48de3-f659-42c4-b81c-3d756c6f8735 req-f7c6f35b-bd29-48df-bc36-93dc4c3ca9b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28223cad-bdfe-40ba-905e-56488b5119be", "name": "network-vif-plugged", "status": "completed", "tag": "b1722f5a-1373-4cc7-a352-49bccad122e7"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:43:32.639325 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-02f48de3-f659-42c4-b81c-3d756c6f8735 req-f7c6f35b-bd29-48df-bc36-93dc4c3ca9b9 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:32.640698 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-02f48de3-f659-42c4-b81c-3d756c6f8735 req-f7c6f35b-bd29-48df-bc36-93dc4c3ca9b9 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:32.641528 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-02f48de3-f659-42c4-b81c-3d756c6f8735 req-f7c6f35b-bd29-48df-bc36-93dc4c3ca9b9 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:32.681980 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-02f48de3-f659-42c4-b81c-3d756c6f8735 req-f7c6f35b-bd29-48df-bc36-93dc4c3ca9b9 service nova] Creating event network-vif-plugged:b1722f5a-1373-4cc7-a352-49bccad122e7 for instance 28223cad-bdfe-40ba-905e-56488b5119be on n-h1-853682-5 Oct 18 15:43:32.698335 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-02f48de3-f659-42c4-b81c-3d756c6f8735 req-f7c6f35b-bd29-48df-bc36-93dc4c3ca9b9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072891 Oct 18 15:43:32.700933 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2053/4103] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:43:32.714469 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bbe05c6b-10fa-4f55-82ff-2ffdd8b23108 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:32.719124 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-bbe05c6b-10fa-4f55-82ff-2ffdd8b23108 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: e6019a42-1115-4a7b-bfab-badb33cafed8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:32.737090 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:43:32.747262 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bbe05c6b-10fa-4f55-82ff-2ffdd8b23108 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:32.750695 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bbe05c6b-10fa-4f55-82ff-2ffdd8b23108 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:32.752855 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bbe05c6b-10fa-4f55-82ff-2ffdd8b23108 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:32.753767 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bbe05c6b-10fa-4f55-82ff-2ffdd8b23108 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:32.758636 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bbe05c6b-10fa-4f55-82ff-2ffdd8b23108 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:32.759369 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bbe05c6b-10fa-4f55-82ff-2ffdd8b23108 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:32.950071 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-bbe05c6b-10fa-4f55-82ff-2ffdd8b23108 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:32.965676 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-bbe05c6b-10fa-4f55-82ff-2ffdd8b23108 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8" status: 200 len: 1283 microversion: 2.1 time: 0.260481 Oct 18 15:43:32.985075 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2054/4104] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:32 2022] GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8 => generated 1283 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:32.991216 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1d49a80f-9f53-4103-9c79-e0a6e8ad924e tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:32.993038 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1d49a80f-9f53-4103-9c79-e0a6e8ad924e tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: a49f5b92-61e2-44bd-92a9-2bbaa1fb8975] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:33.001573 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1d49a80f-9f53-4103-9c79-e0a6e8ad924e tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:33.002436 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1d49a80f-9f53-4103-9c79-e0a6e8ad924e tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:33.003097 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1d49a80f-9f53-4103-9c79-e0a6e8ad924e tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:33.007896 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1d49a80f-9f53-4103-9c79-e0a6e8ad924e tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:33.008595 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1d49a80f-9f53-4103-9c79-e0a6e8ad924e tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:33.009397 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1d49a80f-9f53-4103-9c79-e0a6e8ad924e tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:33.021458 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5f349988-0a84-4f7c-b814-3b95ee66d83f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:33.033401 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5f349988-0a84-4f7c-b814-3b95ee66d83f tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/da74a6b9-5e80-4113-bf1d-dfb5a9c13023" status: 200 len: 1520 microversion: 2.1 time: 0.874351 Oct 18 15:43:33.034715 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2051/4105] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:32 2022] GET /compute/v2.1/servers/da74a6b9-5e80-4113-bf1d-dfb5a9c13023 => generated 1520 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:33.062639 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6bb35359-8250-49c4-85e9-a886ecd06a0c tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:33.063630 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6bb35359-8250-49c4-85e9-a886ecd06a0c tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: da74a6b9-5e80-4113-bf1d-dfb5a9c13023] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:33.072971 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6bb35359-8250-49c4-85e9-a886ecd06a0c tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:33.083266 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6bb35359-8250-49c4-85e9-a886ecd06a0c tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:33.086379 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6bb35359-8250-49c4-85e9-a886ecd06a0c tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:33.087292 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6bb35359-8250-49c4-85e9-a886ecd06a0c tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:33.087874 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6bb35359-8250-49c4-85e9-a886ecd06a0c tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:33.089264 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6bb35359-8250-49c4-85e9-a886ecd06a0c tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:33.152974 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6bb35359-8250-49c4-85e9-a886ecd06a0c tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: da74a6b9-5e80-4113-bf1d-dfb5a9c13023] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:43:33.306669 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6bb35359-8250-49c4-85e9-a886ecd06a0c tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "DELETE /compute/v2.1/servers/da74a6b9-5e80-4113-bf1d-dfb5a9c13023" status: 204 len: 0 microversion: 2.1 time: 0.247817 Oct 18 15:43:33.308033 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2052/4106] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:43:33 2022] DELETE /compute/v2.1/servers/da74a6b9-5e80-4113-bf1d-dfb5a9c13023 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 15:43:33.317182 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-76a9df4b-bba9-41dd-a7c2-796c7c21dfb6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:33.319406 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-76a9df4b-bba9-41dd-a7c2-796c7c21dfb6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 28223cad-bdfe-40ba-905e-56488b5119be] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:33.341547 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:43:33.347607 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76a9df4b-bba9-41dd-a7c2-796c7c21dfb6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:33.362919 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1d49a80f-9f53-4103-9c79-e0a6e8ad924e tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:33.375209 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76a9df4b-bba9-41dd-a7c2-796c7c21dfb6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:33.376032 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76a9df4b-bba9-41dd-a7c2-796c7c21dfb6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:33.379330 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1d49a80f-9f53-4103-9c79-e0a6e8ad924e tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975" status: 200 len: 1322 microversion: 2.1 time: 0.396532 Oct 18 15:43:33.380361 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2055/4107] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:32 2022] GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975 => generated 1322 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:33.382440 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76a9df4b-bba9-41dd-a7c2-796c7c21dfb6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:33.385020 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6ff1f586-582d-43ef-8380-0925bdf223cd tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:33.385649 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6ff1f586-582d-43ef-8380-0925bdf223cd tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: da74a6b9-5e80-4113-bf1d-dfb5a9c13023] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:33.396083 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76a9df4b-bba9-41dd-a7c2-796c7c21dfb6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:33.397013 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ff1f586-582d-43ef-8380-0925bdf223cd tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:33.397512 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ff1f586-582d-43ef-8380-0925bdf223cd tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:33.397956 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ff1f586-582d-43ef-8380-0925bdf223cd tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:33.398671 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ff1f586-582d-43ef-8380-0925bdf223cd tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:33.399851 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76a9df4b-bba9-41dd-a7c2-796c7c21dfb6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:33.403097 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ff1f586-582d-43ef-8380-0925bdf223cd tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:33.403443 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ff1f586-582d-43ef-8380-0925bdf223cd tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:33.914601 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6ff1f586-582d-43ef-8380-0925bdf223cd tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:33.922960 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6ff1f586-582d-43ef-8380-0925bdf223cd tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/da74a6b9-5e80-4113-bf1d-dfb5a9c13023" status: 200 len: 1526 microversion: 2.1 time: 0.541479 Oct 18 15:43:33.929266 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2056/4108] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:33 2022] GET /compute/v2.1/servers/da74a6b9-5e80-4113-bf1d-dfb5a9c13023 => generated 1526 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:33.938931 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-95b1cf20-7d81-4736-b1e4-7eb4105060cf req-2ac40005-b8b3-4217-8776-eeb12cbd59bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a49f5b92-61e2-44bd-92a9-2bbaa1fb8975", "tag": "896b942f-5533-44f6-8cb3-97209dd77612"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:43:33.957045 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-76a9df4b-bba9-41dd-a7c2-796c7c21dfb6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:33.962762 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-95b1cf20-7d81-4736-b1e4-7eb4105060cf req-2ac40005-b8b3-4217-8776-eeb12cbd59bb service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:33.963235 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-95b1cf20-7d81-4736-b1e4-7eb4105060cf req-2ac40005-b8b3-4217-8776-eeb12cbd59bb service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:33.963678 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-95b1cf20-7d81-4736-b1e4-7eb4105060cf req-2ac40005-b8b3-4217-8776-eeb12cbd59bb service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:33.966604 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-76a9df4b-bba9-41dd-a7c2-796c7c21dfb6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/28223cad-bdfe-40ba-905e-56488b5119be" status: 200 len: 1316 microversion: 2.1 time: 0.656720 Oct 18 15:43:33.984299 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-95b1cf20-7d81-4736-b1e4-7eb4105060cf req-2ac40005-b8b3-4217-8776-eeb12cbd59bb service nova] Creating event network-changed:896b942f-5533-44f6-8cb3-97209dd77612 for instance a49f5b92-61e2-44bd-92a9-2bbaa1fb8975 on n-h2-853682-5 Oct 18 15:43:33.987824 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2053/4109] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:33 2022] GET /compute/v2.1/servers/28223cad-bdfe-40ba-905e-56488b5119be => generated 1316 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:33.995393 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b99b9b9b-27da-4e7d-ae44-7bf2c07d4c20 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:33.998659 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-95b1cf20-7d81-4736-b1e4-7eb4105060cf req-2ac40005-b8b3-4217-8776-eeb12cbd59bb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068047 Oct 18 15:43:34.000132 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2057/4110] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:43:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:43:34.001039 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b99b9b9b-27da-4e7d-ae44-7bf2c07d4c20 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:34.005326 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9d70adca-bd67-462d-ac23-4a25dc8516e5 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:34.006042 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9d70adca-bd67-462d-ac23-4a25dc8516e5 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: e6019a42-1115-4a7b-bfab-badb33cafed8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:34.015015 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b99b9b9b-27da-4e7d-ae44-7bf2c07d4c20 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:34.018152 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b99b9b9b-27da-4e7d-ae44-7bf2c07d4c20 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:34.019569 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b99b9b9b-27da-4e7d-ae44-7bf2c07d4c20 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:34.022484 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b99b9b9b-27da-4e7d-ae44-7bf2c07d4c20 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:34.023803 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b99b9b9b-27da-4e7d-ae44-7bf2c07d4c20 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:34.024504 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b99b9b9b-27da-4e7d-ae44-7bf2c07d4c20 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:34.030988 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9d70adca-bd67-462d-ac23-4a25dc8516e5 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:34.031498 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9d70adca-bd67-462d-ac23-4a25dc8516e5 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:34.031938 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9d70adca-bd67-462d-ac23-4a25dc8516e5 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:34.032874 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9d70adca-bd67-462d-ac23-4a25dc8516e5 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:34.033521 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9d70adca-bd67-462d-ac23-4a25dc8516e5 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:34.034249 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9d70adca-bd67-462d-ac23-4a25dc8516e5 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:34.194331 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b99b9b9b-27da-4e7d-ae44-7bf2c07d4c20 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:34.208724 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9d70adca-bd67-462d-ac23-4a25dc8516e5 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:34.210116 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b99b9b9b-27da-4e7d-ae44-7bf2c07d4c20 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:34.211605 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b99b9b9b-27da-4e7d-ae44-7bf2c07d4c20 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:34.217804 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b99b9b9b-27da-4e7d-ae44-7bf2c07d4c20 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 200 len: 1605 microversion: 2.32 time: 0.228548 Oct 18 15:43:34.232839 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2054/4111] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:43:33 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 1605 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:43:34.233045 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9d70adca-bd67-462d-ac23-4a25dc8516e5 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8" status: 200 len: 1271 microversion: 2.1 time: 0.218094 Oct 18 15:43:34.233045 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2058/4112] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:34 2022] GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8 => generated 1271 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:34.405951 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d5efc71a-5015-4f30-8fa0-852524f29b6d tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:34.406646 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d5efc71a-5015-4f30-8fa0-852524f29b6d tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: a49f5b92-61e2-44bd-92a9-2bbaa1fb8975] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:34.416002 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5efc71a-5015-4f30-8fa0-852524f29b6d tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:34.418335 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5efc71a-5015-4f30-8fa0-852524f29b6d tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:34.421180 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5efc71a-5015-4f30-8fa0-852524f29b6d tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:34.422344 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5efc71a-5015-4f30-8fa0-852524f29b6d tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:34.425509 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5efc71a-5015-4f30-8fa0-852524f29b6d tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:34.426170 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5efc71a-5015-4f30-8fa0-852524f29b6d tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:34.727699 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-066b46a5-e0fc-4208-9bb0-a7bb651f7e53 req-fb64a87b-e689-4ae8-ae48-3b2f5b641585 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19226472-0c76-46f8-a4ba-7d32931341a2", "name": "network-vif-plugged", "status": "completed", "tag": "b7515f7b-6a3a-4506-9e92-d62882ce4d5f"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:43:34.742976 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-066b46a5-e0fc-4208-9bb0-a7bb651f7e53 req-fb64a87b-e689-4ae8-ae48-3b2f5b641585 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:34.744046 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-066b46a5-e0fc-4208-9bb0-a7bb651f7e53 req-fb64a87b-e689-4ae8-ae48-3b2f5b641585 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:34.744743 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-066b46a5-e0fc-4208-9bb0-a7bb651f7e53 req-fb64a87b-e689-4ae8-ae48-3b2f5b641585 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:34.768753 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-066b46a5-e0fc-4208-9bb0-a7bb651f7e53 req-fb64a87b-e689-4ae8-ae48-3b2f5b641585 service nova] Creating event network-vif-plugged:b7515f7b-6a3a-4506-9e92-d62882ce4d5f for instance 19226472-0c76-46f8-a4ba-7d32931341a2 on n-h2-853682-5 Oct 18 15:43:34.773852 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-066b46a5-e0fc-4208-9bb0-a7bb651f7e53 req-fb64a87b-e689-4ae8-ae48-3b2f5b641585 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049794 Oct 18 15:43:34.774825 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2059/4113] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:43:34.958471 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-02797a32-f829-4be9-96d0-f98781bfd30a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:34.959624 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-02797a32-f829-4be9-96d0-f98781bfd30a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: da74a6b9-5e80-4113-bf1d-dfb5a9c13023] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:34.977022 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-02797a32-f829-4be9-96d0-f98781bfd30a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:34.978411 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-02797a32-f829-4be9-96d0-f98781bfd30a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:34.979237 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-02797a32-f829-4be9-96d0-f98781bfd30a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:34.980175 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-02797a32-f829-4be9-96d0-f98781bfd30a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:34.981009 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-02797a32-f829-4be9-96d0-f98781bfd30a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:34.981641 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-02797a32-f829-4be9-96d0-f98781bfd30a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:35.036067 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=100 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:43:35.096113 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d5efc71a-5015-4f30-8fa0-852524f29b6d tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:35.105480 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d5efc71a-5015-4f30-8fa0-852524f29b6d tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975" status: 200 len: 1322 microversion: 2.1 time: 0.703701 Oct 18 15:43:35.121590 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2055/4114] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:34 2022] GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975 => generated 1322 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:35.141535 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2b0da9c2-3ce2-4805-80d7-908520ab7274 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:35.142340 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2b0da9c2-3ce2-4805-80d7-908520ab7274 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 28223cad-bdfe-40ba-905e-56488b5119be] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:35.158832 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b0da9c2-3ce2-4805-80d7-908520ab7274 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:35.159672 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b0da9c2-3ce2-4805-80d7-908520ab7274 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:35.160327 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b0da9c2-3ce2-4805-80d7-908520ab7274 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:35.161272 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b0da9c2-3ce2-4805-80d7-908520ab7274 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:35.161915 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b0da9c2-3ce2-4805-80d7-908520ab7274 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:35.162523 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b0da9c2-3ce2-4805-80d7-908520ab7274 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:35.439073 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-02797a32-f829-4be9-96d0-f98781bfd30a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:35.457302 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-02797a32-f829-4be9-96d0-f98781bfd30a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/da74a6b9-5e80-4113-bf1d-dfb5a9c13023" status: 200 len: 1526 microversion: 2.1 time: 0.501086 Oct 18 15:43:35.458009 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2060/4115] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:34 2022] GET /compute/v2.1/servers/da74a6b9-5e80-4113-bf1d-dfb5a9c13023 => generated 1526 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:35.479333 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-21a8db9c-5291-463f-8e08-43a083858208 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:35.479883 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-21a8db9c-5291-463f-8e08-43a083858208 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:35.493318 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-21a8db9c-5291-463f-8e08-43a083858208 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:35.495047 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-21a8db9c-5291-463f-8e08-43a083858208 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:35.495559 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-21a8db9c-5291-463f-8e08-43a083858208 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:35.497788 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-21a8db9c-5291-463f-8e08-43a083858208 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:35.498377 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-21a8db9c-5291-463f-8e08-43a083858208 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:35.498822 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-21a8db9c-5291-463f-8e08-43a083858208 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:35.509156 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2b0da9c2-3ce2-4805-80d7-908520ab7274 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:35.524194 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2b0da9c2-3ce2-4805-80d7-908520ab7274 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/28223cad-bdfe-40ba-905e-56488b5119be" status: 200 len: 1316 microversion: 2.1 time: 0.401011 Oct 18 15:43:35.524984 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2056/4116] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:35 2022] GET /compute/v2.1/servers/28223cad-bdfe-40ba-905e-56488b5119be => generated 1316 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:35.551037 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d21b4d43-f0c1-419a-b7ac-68a7c97babc1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:35.551850 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d21b4d43-f0c1-419a-b7ac-68a7c97babc1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: e6019a42-1115-4a7b-bfab-badb33cafed8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:35.561507 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d21b4d43-f0c1-419a-b7ac-68a7c97babc1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:35.562075 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d21b4d43-f0c1-419a-b7ac-68a7c97babc1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:35.562512 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d21b4d43-f0c1-419a-b7ac-68a7c97babc1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:35.563356 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d21b4d43-f0c1-419a-b7ac-68a7c97babc1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:35.563872 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d21b4d43-f0c1-419a-b7ac-68a7c97babc1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:35.564299 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d21b4d43-f0c1-419a-b7ac-68a7c97babc1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:35.624378 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-21a8db9c-5291-463f-8e08-43a083858208 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:35.634297 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-21a8db9c-5291-463f-8e08-43a083858208 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:35.635969 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-21a8db9c-5291-463f-8e08-43a083858208 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:35.637186 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-21a8db9c-5291-463f-8e08-43a083858208 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 200 len: 1605 microversion: 2.32 time: 0.162092 Oct 18 15:43:35.637952 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2061/4117] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:43:35 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 1605 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:43:35.971311 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d21b4d43-f0c1-419a-b7ac-68a7c97babc1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:35.984238 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d21b4d43-f0c1-419a-b7ac-68a7c97babc1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8" status: 200 len: 1313 microversion: 2.1 time: 0.445542 Oct 18 15:43:35.985543 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2057/4118] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:35 2022] GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8 => generated 1313 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:36.136444 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8bd04dcf-fc91-4834-b800-64489c2562cd tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:36.137122 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8bd04dcf-fc91-4834-b800-64489c2562cd tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: a49f5b92-61e2-44bd-92a9-2bbaa1fb8975] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:36.147816 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8bd04dcf-fc91-4834-b800-64489c2562cd tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:36.152136 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8bd04dcf-fc91-4834-b800-64489c2562cd tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:36.152844 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8bd04dcf-fc91-4834-b800-64489c2562cd tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:36.153818 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8bd04dcf-fc91-4834-b800-64489c2562cd tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:36.154423 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8bd04dcf-fc91-4834-b800-64489c2562cd tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:36.157014 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8bd04dcf-fc91-4834-b800-64489c2562cd tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:36.481637 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8990501f-cbd3-4e4e-89d7-ea32ff9daa61 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:36.489741 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8990501f-cbd3-4e4e-89d7-ea32ff9daa61 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: da74a6b9-5e80-4113-bf1d-dfb5a9c13023] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:36.505433 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8990501f-cbd3-4e4e-89d7-ea32ff9daa61 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:36.509307 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8990501f-cbd3-4e4e-89d7-ea32ff9daa61 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:36.510435 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8990501f-cbd3-4e4e-89d7-ea32ff9daa61 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:36.513177 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8990501f-cbd3-4e4e-89d7-ea32ff9daa61 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:36.517711 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8990501f-cbd3-4e4e-89d7-ea32ff9daa61 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:36.518493 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8990501f-cbd3-4e4e-89d7-ea32ff9daa61 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:36.566460 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8bd04dcf-fc91-4834-b800-64489c2562cd tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:36.585503 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8bd04dcf-fc91-4834-b800-64489c2562cd tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975" status: 200 len: 1322 microversion: 2.1 time: 0.452874 Oct 18 15:43:36.586595 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2062/4119] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:36 2022] GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975 => generated 1322 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:36.596618 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-076b498d-80e8-4fb8-b252-7b90779c70a4 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:36.597631 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-076b498d-80e8-4fb8-b252-7b90779c70a4 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 28223cad-bdfe-40ba-905e-56488b5119be] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:36.611799 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-076b498d-80e8-4fb8-b252-7b90779c70a4 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:36.613675 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-076b498d-80e8-4fb8-b252-7b90779c70a4 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:36.621760 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-076b498d-80e8-4fb8-b252-7b90779c70a4 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:36.622963 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-076b498d-80e8-4fb8-b252-7b90779c70a4 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:36.623388 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-076b498d-80e8-4fb8-b252-7b90779c70a4 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:36.623992 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-076b498d-80e8-4fb8-b252-7b90779c70a4 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:36.723256 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8990501f-cbd3-4e4e-89d7-ea32ff9daa61 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9e9bbf3d94d77a236e43f019d316a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b4cd4b884c4456866052a4969dc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:36.739420 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8990501f-cbd3-4e4e-89d7-ea32ff9daa61 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/da74a6b9-5e80-4113-bf1d-dfb5a9c13023" status: 200 len: 1484 microversion: 2.1 time: 0.261259 Oct 18 15:43:36.741849 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2058/4120] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:36 2022] GET /compute/v2.1/servers/da74a6b9-5e80-4113-bf1d-dfb5a9c13023 => generated 1484 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:36.758438 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-317c2f59-8227-45e9-a7a3-6d482cfae35c tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:36.759586 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-317c2f59-8227-45e9-a7a3-6d482cfae35c tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:36.771756 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-317c2f59-8227-45e9-a7a3-6d482cfae35c tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:36.772475 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-317c2f59-8227-45e9-a7a3-6d482cfae35c tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:36.773096 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-317c2f59-8227-45e9-a7a3-6d482cfae35c tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:36.774486 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-317c2f59-8227-45e9-a7a3-6d482cfae35c tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:36.784263 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-317c2f59-8227-45e9-a7a3-6d482cfae35c tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:36.784908 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-317c2f59-8227-45e9-a7a3-6d482cfae35c tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:37.061629 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-317c2f59-8227-45e9-a7a3-6d482cfae35c tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:37.079743 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-317c2f59-8227-45e9-a7a3-6d482cfae35c tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:37.081697 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-317c2f59-8227-45e9-a7a3-6d482cfae35c tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:37.082935 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-317c2f59-8227-45e9-a7a3-6d482cfae35c tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 200 len: 1605 microversion: 2.32 time: 0.338362 Oct 18 15:43:37.086201 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2059/4121] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:43:36 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 1605 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:43:37.100844 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-1ea23d47-b1f2-459e-b50c-fbcb5c55c442 req-188e804c-31a0-436a-a125-c14508faaef9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da74a6b9-5e80-4113-bf1d-dfb5a9c13023", "name": "network-vif-deleted", "tag": "282cfd8e-c6e6-4d3a-98ee-d1ce91c32d4c"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:43:37.121418 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1ea23d47-b1f2-459e-b50c-fbcb5c55c442 req-188e804c-31a0-436a-a125-c14508faaef9 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:37.122750 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1ea23d47-b1f2-459e-b50c-fbcb5c55c442 req-188e804c-31a0-436a-a125-c14508faaef9 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:37.128106 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1ea23d47-b1f2-459e-b50c-fbcb5c55c442 req-188e804c-31a0-436a-a125-c14508faaef9 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:37.152096 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-1ea23d47-b1f2-459e-b50c-fbcb5c55c442 req-188e804c-31a0-436a-a125-c14508faaef9 service nova] Creating event network-vif-deleted:282cfd8e-c6e6-4d3a-98ee-d1ce91c32d4c for instance da74a6b9-5e80-4113-bf1d-dfb5a9c13023 on n-h1-853682-5 Oct 18 15:43:37.166135 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-1ea23d47-b1f2-459e-b50c-fbcb5c55c442 req-188e804c-31a0-436a-a125-c14508faaef9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078699 Oct 18 15:43:37.172909 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2060/4122] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:43:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:43:37.183030 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3761609d-8d04-4ec2-b673-f9a232e9c4b1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:37.188322 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3761609d-8d04-4ec2-b673-f9a232e9c4b1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: e6019a42-1115-4a7b-bfab-badb33cafed8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:37.202575 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3761609d-8d04-4ec2-b673-f9a232e9c4b1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:37.205939 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3761609d-8d04-4ec2-b673-f9a232e9c4b1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:37.206554 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3761609d-8d04-4ec2-b673-f9a232e9c4b1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:37.210490 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3761609d-8d04-4ec2-b673-f9a232e9c4b1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:37.211279 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3761609d-8d04-4ec2-b673-f9a232e9c4b1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:37.211882 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3761609d-8d04-4ec2-b673-f9a232e9c4b1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:37.363587 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-076b498d-80e8-4fb8-b252-7b90779c70a4 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:37.381524 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-076b498d-80e8-4fb8-b252-7b90779c70a4 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/28223cad-bdfe-40ba-905e-56488b5119be" status: 200 len: 1506 microversion: 2.1 time: 0.785529 Oct 18 15:43:37.382306 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2063/4123] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:36 2022] GET /compute/v2.1/servers/28223cad-bdfe-40ba-905e-56488b5119be => generated 1506 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:37.408962 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-442520fe-c295-426f-8480-2c8d4ff662a6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:37.409734 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-442520fe-c295-426f-8480-2c8d4ff662a6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 28223cad-bdfe-40ba-905e-56488b5119be] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:37.416141 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-442520fe-c295-426f-8480-2c8d4ff662a6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:37.416641 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-442520fe-c295-426f-8480-2c8d4ff662a6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:37.424164 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-442520fe-c295-426f-8480-2c8d4ff662a6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:37.425632 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-442520fe-c295-426f-8480-2c8d4ff662a6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:37.426614 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-442520fe-c295-426f-8480-2c8d4ff662a6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:37.427357 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-442520fe-c295-426f-8480-2c8d4ff662a6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:37.508592 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-442520fe-c295-426f-8480-2c8d4ff662a6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 28223cad-bdfe-40ba-905e-56488b5119be] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:43:37.677575 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-442520fe-c295-426f-8480-2c8d4ff662a6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "DELETE /compute/v2.1/servers/28223cad-bdfe-40ba-905e-56488b5119be" status: 204 len: 0 microversion: 2.1 time: 0.272864 Oct 18 15:43:37.678817 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2064/4124] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:43:37 2022] DELETE /compute/v2.1/servers/28223cad-bdfe-40ba-905e-56488b5119be => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 15:43:37.685861 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4d100d03-2ff5-45c2-ad18-39db7d62cb67 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:37.692896 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4d100d03-2ff5-45c2-ad18-39db7d62cb67 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: a49f5b92-61e2-44bd-92a9-2bbaa1fb8975] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:37.702361 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4d100d03-2ff5-45c2-ad18-39db7d62cb67 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:37.704559 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4d100d03-2ff5-45c2-ad18-39db7d62cb67 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:37.707431 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4d100d03-2ff5-45c2-ad18-39db7d62cb67 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:37.709216 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4d100d03-2ff5-45c2-ad18-39db7d62cb67 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:37.709877 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4d100d03-2ff5-45c2-ad18-39db7d62cb67 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:37.710488 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4d100d03-2ff5-45c2-ad18-39db7d62cb67 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:37.845289 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3761609d-8d04-4ec2-b673-f9a232e9c4b1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:37.861939 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3761609d-8d04-4ec2-b673-f9a232e9c4b1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8" status: 200 len: 1313 microversion: 2.1 time: 0.686999 Oct 18 15:43:37.862735 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2061/4125] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:37 2022] GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8 => generated 1313 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:37.867556 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b418f9f7-720c-4e3a-a5b3-c9d91362dd7d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:37.868172 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b418f9f7-720c-4e3a-a5b3-c9d91362dd7d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 28223cad-bdfe-40ba-905e-56488b5119be] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:37.884416 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b418f9f7-720c-4e3a-a5b3-c9d91362dd7d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:37.884961 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b418f9f7-720c-4e3a-a5b3-c9d91362dd7d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:37.885406 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b418f9f7-720c-4e3a-a5b3-c9d91362dd7d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:37.886122 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b418f9f7-720c-4e3a-a5b3-c9d91362dd7d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:37.886588 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b418f9f7-720c-4e3a-a5b3-c9d91362dd7d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:37.887017 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b418f9f7-720c-4e3a-a5b3-c9d91362dd7d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:38.094682 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4d100d03-2ff5-45c2-ad18-39db7d62cb67 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:38.104555 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4d100d03-2ff5-45c2-ad18-39db7d62cb67 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975" status: 200 len: 1322 microversion: 2.1 time: 0.424276 Oct 18 15:43:38.107980 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2065/4126] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:37 2022] GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975 => generated 1322 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:38.113928 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-97602cc2-d1c1-4928-b9bc-cbc731f22629 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:38.114740 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-97602cc2-d1c1-4928-b9bc-cbc731f22629 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: da74a6b9-5e80-4113-bf1d-dfb5a9c13023] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:38.121997 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97602cc2-d1c1-4928-b9bc-cbc731f22629 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:38.122734 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97602cc2-d1c1-4928-b9bc-cbc731f22629 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:38.123329 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97602cc2-d1c1-4928-b9bc-cbc731f22629 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:38.124161 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97602cc2-d1c1-4928-b9bc-cbc731f22629 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:38.125532 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97602cc2-d1c1-4928-b9bc-cbc731f22629 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:38.126112 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97602cc2-d1c1-4928-b9bc-cbc731f22629 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:38.146774 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-97602cc2-d1c1-4928-b9bc-cbc731f22629 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] HTTP exception thrown: Instance da74a6b9-5e80-4113-bf1d-dfb5a9c13023 could not be found. Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-97602cc2-d1c1-4928-b9bc-cbc731f22629 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Request method failure captured: Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/da74a6b9-5e80-4113-bf1d-dfb5a9c13023 HTTP/1.1 Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTskwmwAKtfJxRtfmFCexrRganirG5QxP3o41FeBWoidL-rUG8x8GL16JQLrOge4bbPRk8j9ZKsrTawjOywht8BMU6xpPPkLcF_Tvsxd_4ddRByYVxCCr1OvdQRZ3S_CoRUmp2shw5GPVxRCyE1gWYjx_sxIK_OIs6piyKG80707p5j0 Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 38b4cd4b884c4456866052a4969dc138 Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1849835039 Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/38b4cd4b884c4456866052a4969dc138"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/38b4cd4b884c4456866052a4969dc138"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/38b4cd4b884c4456866052a4969dc138"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_38b4cd4b884c4456866052a4969dc138"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1849835039 Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 38b4cd4b884c4456866052a4969dc138 Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1849835039 Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ImagesOneServerNegativeTestJSON-1849835039-project Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: a2e9e9bbf3d94d77a236e43f019d316a Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1849835039-project Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance da74a6b9-5e80-4113-bf1d-dfb5a9c13023 could not be found. Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'da74a6b9-5e80-4113-bf1d-dfb5a9c13023'} Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da74a6b9-5e80-4113-bf1d-dfb5a9c13023 could not be found. Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da74a6b9-5e80-4113-bf1d-dfb5a9c13023 could not be found. Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:38.149719 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:43:38.154914 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:38.154914 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:38.154914 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:43:38.154914 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:43:38.154914 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:43:38.154914 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:43:38.154914 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da74a6b9-5e80-4113-bf1d-dfb5a9c13023 could not be found. Oct 18 15:43:38.154914 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:38.157889 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-97602cc2-d1c1-4928-b9bc-cbc731f22629 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Returning 404 to user: Instance da74a6b9-5e80-4113-bf1d-dfb5a9c13023 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:43:38.159128 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-97602cc2-d1c1-4928-b9bc-cbc731f22629 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/da74a6b9-5e80-4113-bf1d-dfb5a9c13023" status: 404 len: 111 microversion: 2.1 time: 0.049026 Oct 18 15:43:38.163331 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2066/4127] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:38 2022] GET /compute/v2.1/servers/da74a6b9-5e80-4113-bf1d-dfb5a9c13023 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:43:38.170247 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-f8cac239-8f7f-4c18-9e19-8432a1ac31ab req-88a6745b-a9bc-48d0-bc67-c25e8cd2676b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6019a42-1115-4a7b-bfab-badb33cafed8", "tag": "ff5f4986-3641-402a-91e4-0dc5291f11fe"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:43:38.184490 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-f8cac239-8f7f-4c18-9e19-8432a1ac31ab req-88a6745b-a9bc-48d0-bc67-c25e8cd2676b service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:38.185193 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-f8cac239-8f7f-4c18-9e19-8432a1ac31ab req-88a6745b-a9bc-48d0-bc67-c25e8cd2676b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:38.185796 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-f8cac239-8f7f-4c18-9e19-8432a1ac31ab req-88a6745b-a9bc-48d0-bc67-c25e8cd2676b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:38.190430 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b418f9f7-720c-4e3a-a5b3-c9d91362dd7d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:38.200055 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-f8cac239-8f7f-4c18-9e19-8432a1ac31ab req-88a6745b-a9bc-48d0-bc67-c25e8cd2676b service nova] Creating event network-changed:ff5f4986-3641-402a-91e4-0dc5291f11fe for instance e6019a42-1115-4a7b-bfab-badb33cafed8 on n-h1-853682-5 Oct 18 15:43:38.203075 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b418f9f7-720c-4e3a-a5b3-c9d91362dd7d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/28223cad-bdfe-40ba-905e-56488b5119be" status: 200 len: 1512 microversion: 2.1 time: 0.339013 Oct 18 15:43:38.204101 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2062/4128] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:37 2022] GET /compute/v2.1/servers/28223cad-bdfe-40ba-905e-56488b5119be => generated 1512 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:38.211036 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6a9a0d12-3e25-4bfa-9154-bca31e7a83bf tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:38.211319 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-f8cac239-8f7f-4c18-9e19-8432a1ac31ab req-88a6745b-a9bc-48d0-bc67-c25e8cd2676b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046529 Oct 18 15:43:38.212141 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6a9a0d12-3e25-4bfa-9154-bca31e7a83bf tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:38.215440 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2067/4129] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:43:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:43:38.220434 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a9a0d12-3e25-4bfa-9154-bca31e7a83bf tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:38.221362 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a9a0d12-3e25-4bfa-9154-bca31e7a83bf tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:38.221478 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c7f85cae-b007-448d-a03b-cbd4906e81b0 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '.version_select at 0x7f7c3d138160>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:38.221976 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a9a0d12-3e25-4bfa-9154-bca31e7a83bf tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:38.223061 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a9a0d12-3e25-4bfa-9154-bca31e7a83bf tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:38.223581 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a9a0d12-3e25-4bfa-9154-bca31e7a83bf tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:38.224275 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a9a0d12-3e25-4bfa-9154-bca31e7a83bf tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:38.263079 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-c7f85cae-b007-448d-a03b-cbd4906e81b0 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] HTTP exception thrown: Image not found. Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c7f85cae-b007-448d-a03b-cbd4906e81b0 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Request method failure captured: Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: request: DELETE /compute/v2.1/images/9550efcb-fee7-47c8-8e6c-05d2c941a5df HTTP/1.1 Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTskwmwAKtfJxRtfmFCexrRganirG5QxP3o41FeBWoidL-rUG8x8GL16JQLrOge4bbPRk8j9ZKsrTawjOywht8BMU6xpPPkLcF_Tvsxd_4ddRByYVxCCr1OvdQRZ3S_CoRUmp2shw5GPVxRCyE1gWYjx_sxIK_OIs6piyKG80707p5j0 Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 38b4cd4b884c4456866052a4969dc138 Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1849835039 Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/38b4cd4b884c4456866052a4969dc138"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/38b4cd4b884c4456866052a4969dc138"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/38b4cd4b884c4456866052a4969dc138"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_38b4cd4b884c4456866052a4969dc138"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1849835039 Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 38b4cd4b884c4456866052a4969dc138 Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1849835039 Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ImagesOneServerNegativeTestJSON-1849835039-project Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: a2e9e9bbf3d94d77a236e43f019d316a Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1849835039-project Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: method: Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: exception: Image not found. Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '9550efcb-fee7-47c8-8e6c-05d2c941a5df'} Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 9550efcb-fee7-47c8-8e6c-05d2c941a5df to delete Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9550efcb-fee7-47c8-8e6c-05d2c941a5df could not be found. Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:43:38.265037 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:38.268439 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:38.268439 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:43:38.268439 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:43:38.268439 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:43:38.268439 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:43:38.268439 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:43:38.268439 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:43:38.268439 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:43:38.268439 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:43:38.268439 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 18 15:43:38.268439 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 15:43:38.268439 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 15:43:38.268439 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:38.268439 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:43:38.268439 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:38.268439 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:38.268439 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:43:38.268439 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:43:38.268439 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:43:38.268439 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:43:38.268439 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 15:43:38.268439 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:38.268439 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c7f85cae-b007-448d-a03b-cbd4906e81b0 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Returning 404 to user: Image not found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:43:38.268439 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c7f85cae-b007-448d-a03b-cbd4906e81b0 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "DELETE /compute/v2.1/images/9550efcb-fee7-47c8-8e6c-05d2c941a5df" status: 404 len: 62 microversion: 2.1 time: 0.049854 Oct 18 15:43:38.268439 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2068/4130] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:38 2022] DELETE /compute/v2.1/images/9550efcb-fee7-47c8-8e6c-05d2c941a5df => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 15:43:38.278208 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2440889b-e758-4ed5-9a40-9e7742a73132 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:38.278943 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2440889b-e758-4ed5-9a40-9e7742a73132 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 9e93e324-b274-4803-92d3-ee509e0a06d5] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:38.287929 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2440889b-e758-4ed5-9a40-9e7742a73132 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:38.288556 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2440889b-e758-4ed5-9a40-9e7742a73132 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:38.289137 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2440889b-e758-4ed5-9a40-9e7742a73132 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:38.289972 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2440889b-e758-4ed5-9a40-9e7742a73132 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:38.290829 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2440889b-e758-4ed5-9a40-9e7742a73132 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:38.291363 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2440889b-e758-4ed5-9a40-9e7742a73132 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:38.308574 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-2440889b-e758-4ed5-9a40-9e7742a73132 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] HTTP exception thrown: Instance 9e93e324-b274-4803-92d3-ee509e0a06d5 could not be found. Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2440889b-e758-4ed5-9a40-9e7742a73132 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Request method failure captured: Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: request: DELETE /compute/v2.1/servers/9e93e324-b274-4803-92d3-ee509e0a06d5 HTTP/1.1 Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTskwmwAKtfJxRtfmFCexrRganirG5QxP3o41FeBWoidL-rUG8x8GL16JQLrOge4bbPRk8j9ZKsrTawjOywht8BMU6xpPPkLcF_Tvsxd_4ddRByYVxCCr1OvdQRZ3S_CoRUmp2shw5GPVxRCyE1gWYjx_sxIK_OIs6piyKG80707p5j0 Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 38b4cd4b884c4456866052a4969dc138 Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1849835039 Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/38b4cd4b884c4456866052a4969dc138"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/38b4cd4b884c4456866052a4969dc138"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/38b4cd4b884c4456866052a4969dc138"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_38b4cd4b884c4456866052a4969dc138"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1849835039 Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 38b4cd4b884c4456866052a4969dc138 Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1849835039 Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ImagesOneServerNegativeTestJSON-1849835039-project Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: a2e9e9bbf3d94d77a236e43f019d316a Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1849835039-project Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 9e93e324-b274-4803-92d3-ee509e0a06d5 could not be found. Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '9e93e324-b274-4803-92d3-ee509e0a06d5'} Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e93e324-b274-4803-92d3-ee509e0a06d5 could not be found. Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:43:38.310244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:43:38.314345 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e93e324-b274-4803-92d3-ee509e0a06d5 could not be found. Oct 18 15:43:38.314345 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:38.314345 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:43:38.314345 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:38.314345 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:38.314345 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:43:38.314345 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:43:38.314345 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:43:38.314345 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:43:38.314345 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e93e324-b274-4803-92d3-ee509e0a06d5 could not be found. Oct 18 15:43:38.314345 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:38.314345 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2440889b-e758-4ed5-9a40-9e7742a73132 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Returning 404 to user: Instance 9e93e324-b274-4803-92d3-ee509e0a06d5 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:43:38.314345 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2440889b-e758-4ed5-9a40-9e7742a73132 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9e93e324-b274-4803-92d3-ee509e0a06d5" status: 404 len: 111 microversion: 2.1 time: 0.039702 Oct 18 15:43:38.316330 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2069/4131] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:43:38 2022] DELETE /compute/v2.1/servers/9e93e324-b274-4803-92d3-ee509e0a06d5 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 15:43:38.321563 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-388b945d-cc89-40d7-8327-ae42fedb586a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:38.323198 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-388b945d-cc89-40d7-8327-ae42fedb586a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 9e93e324-b274-4803-92d3-ee509e0a06d5] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:38.323708 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6a9a0d12-3e25-4bfa-9154-bca31e7a83bf tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:38.333249 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-388b945d-cc89-40d7-8327-ae42fedb586a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:38.333752 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-388b945d-cc89-40d7-8327-ae42fedb586a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:38.334502 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-388b945d-cc89-40d7-8327-ae42fedb586a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:38.335222 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-388b945d-cc89-40d7-8327-ae42fedb586a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:38.335615 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6a9a0d12-3e25-4bfa-9154-bca31e7a83bf tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:38.335735 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-388b945d-cc89-40d7-8327-ae42fedb586a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:38.336097 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-388b945d-cc89-40d7-8327-ae42fedb586a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:38.338419 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6a9a0d12-3e25-4bfa-9154-bca31e7a83bf tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:38.340221 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6a9a0d12-3e25-4bfa-9154-bca31e7a83bf tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 200 len: 1605 microversion: 2.32 time: 0.134909 Oct 18 15:43:38.342481 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2063/4132] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:43:38 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 1605 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:43:38.354122 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-388b945d-cc89-40d7-8327-ae42fedb586a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] HTTP exception thrown: Instance 9e93e324-b274-4803-92d3-ee509e0a06d5 could not be found. Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-388b945d-cc89-40d7-8327-ae42fedb586a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Request method failure captured: Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/9e93e324-b274-4803-92d3-ee509e0a06d5 HTTP/1.1 Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTskwmwAKtfJxRtfmFCexrRganirG5QxP3o41FeBWoidL-rUG8x8GL16JQLrOge4bbPRk8j9ZKsrTawjOywht8BMU6xpPPkLcF_Tvsxd_4ddRByYVxCCr1OvdQRZ3S_CoRUmp2shw5GPVxRCyE1gWYjx_sxIK_OIs6piyKG80707p5j0 Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 38b4cd4b884c4456866052a4969dc138 Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1849835039 Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/38b4cd4b884c4456866052a4969dc138"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/38b4cd4b884c4456866052a4969dc138"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/38b4cd4b884c4456866052a4969dc138"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_38b4cd4b884c4456866052a4969dc138"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1849835039 Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 38b4cd4b884c4456866052a4969dc138 Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1849835039 Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ImagesOneServerNegativeTestJSON-1849835039-project Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: a2e9e9bbf3d94d77a236e43f019d316a Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1849835039-project Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 9e93e324-b274-4803-92d3-ee509e0a06d5 could not be found. Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '9e93e324-b274-4803-92d3-ee509e0a06d5'} Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e93e324-b274-4803-92d3-ee509e0a06d5 could not be found. Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e93e324-b274-4803-92d3-ee509e0a06d5 could not be found. Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:38.356202 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:43:38.361052 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:38.361052 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:38.361052 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:43:38.361052 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:43:38.361052 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:43:38.361052 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:43:38.361052 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e93e324-b274-4803-92d3-ee509e0a06d5 could not be found. Oct 18 15:43:38.361052 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:38.361052 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-388b945d-cc89-40d7-8327-ae42fedb586a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Returning 404 to user: Instance 9e93e324-b274-4803-92d3-ee509e0a06d5 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:43:38.361052 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-388b945d-cc89-40d7-8327-ae42fedb586a tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/9e93e324-b274-4803-92d3-ee509e0a06d5" status: 404 len: 111 microversion: 2.1 time: 0.040546 Oct 18 15:43:38.361052 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2070/4133] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:38 2022] GET /compute/v2.1/servers/9e93e324-b274-4803-92d3-ee509e0a06d5 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:43:38.367669 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-096d57b3-ae22-4a8f-b74a-23e169b14669 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '.version_select at 0x7f7c3c7988b0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:38.390099 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-096d57b3-ae22-4a8f-b74a-23e169b14669 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1602625935" status: 202 len: 0 microversion: 2.1 time: 0.026086 Oct 18 15:43:38.390697 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2064/4134] 10.222.0.60 () {58 vars in 1221 bytes} [Tue Oct 18 15:43:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1602625935 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:43:38.891181 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-23222732-d6c2-47f4-a533-46833a28c008 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:38.895137 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-23222732-d6c2-47f4-a533-46833a28c008 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: e6019a42-1115-4a7b-bfab-badb33cafed8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:38.907675 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-23222732-d6c2-47f4-a533-46833a28c008 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:38.908184 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-23222732-d6c2-47f4-a533-46833a28c008 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:38.908631 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-23222732-d6c2-47f4-a533-46833a28c008 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:38.912712 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-23222732-d6c2-47f4-a533-46833a28c008 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:38.913312 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-23222732-d6c2-47f4-a533-46833a28c008 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:38.913772 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-23222732-d6c2-47f4-a533-46833a28c008 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:39.134408 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-917cf970-c293-40bd-9fa7-619b374dfa75 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:39.135596 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-917cf970-c293-40bd-9fa7-619b374dfa75 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: a49f5b92-61e2-44bd-92a9-2bbaa1fb8975] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:39.147875 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-917cf970-c293-40bd-9fa7-619b374dfa75 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:39.149803 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-917cf970-c293-40bd-9fa7-619b374dfa75 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:39.150798 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-917cf970-c293-40bd-9fa7-619b374dfa75 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:39.154122 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-917cf970-c293-40bd-9fa7-619b374dfa75 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:39.155168 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-917cf970-c293-40bd-9fa7-619b374dfa75 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:39.156552 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-917cf970-c293-40bd-9fa7-619b374dfa75 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:39.174272 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:43:39.774692 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-917cf970-c293-40bd-9fa7-619b374dfa75 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:39.786332 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-917cf970-c293-40bd-9fa7-619b374dfa75 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975" status: 200 len: 1322 microversion: 2.1 time: 0.657183 Oct 18 15:43:39.788272 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2065/4135] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:39 2022] GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975 => generated 1322 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:43:39.807770 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a3b515e7-5d3f-470b-b1fa-d94196728be8 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:39.809098 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a3b515e7-5d3f-470b-b1fa-d94196728be8 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 28223cad-bdfe-40ba-905e-56488b5119be] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:39.813236 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-23222732-d6c2-47f4-a533-46833a28c008 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:39.832359 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-23222732-d6c2-47f4-a533-46833a28c008 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8" status: 200 len: 1313 microversion: 2.1 time: 0.947661 Oct 18 15:43:39.836837 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2071/4136] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:38 2022] GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8 => generated 1313 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:39.848353 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-97944258-0c00-4024-a4b6-c88a95aa9081 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:39.849707 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-97944258-0c00-4024-a4b6-c88a95aa9081 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 47ee1803-1ce0-4cbc-879e-d39cfe8576aa] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:39.858377 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3b515e7-5d3f-470b-b1fa-d94196728be8 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:39.859790 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3b515e7-5d3f-470b-b1fa-d94196728be8 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:39.862977 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3b515e7-5d3f-470b-b1fa-d94196728be8 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:39.863926 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3b515e7-5d3f-470b-b1fa-d94196728be8 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:39.866466 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97944258-0c00-4024-a4b6-c88a95aa9081 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:39.867733 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97944258-0c00-4024-a4b6-c88a95aa9081 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:39.869313 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97944258-0c00-4024-a4b6-c88a95aa9081 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:39.872629 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97944258-0c00-4024-a4b6-c88a95aa9081 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:39.874156 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3b515e7-5d3f-470b-b1fa-d94196728be8 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:39.874654 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3b515e7-5d3f-470b-b1fa-d94196728be8 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:39.875085 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97944258-0c00-4024-a4b6-c88a95aa9081 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:39.878414 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97944258-0c00-4024-a4b6-c88a95aa9081 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:39.926429 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-97944258-0c00-4024-a4b6-c88a95aa9081 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] HTTP exception thrown: Instance 47ee1803-1ce0-4cbc-879e-d39cfe8576aa could not be found. Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-97944258-0c00-4024-a4b6-c88a95aa9081 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Request method failure captured: Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: request: DELETE /compute/v2.1/servers/47ee1803-1ce0-4cbc-879e-d39cfe8576aa HTTP/1.1 Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsfD3tyC5zBBCs3PM6SgagJOA9ytEd34lT9my352h69qxn0wNQWvVVVEceKNcLlE8Cld2E1ewLfFQUA6X-zyH4NCgXE9isdDnVpnJB5BT1ljNdC07pganRFql9FpScM1-Xjt5su1w2IBkP6ZVV1NsRclcY3oY_ScUp2DhZs2W7X1y8Y Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: a5b55fd6668b481b8c578983dc655785 Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-AttachVolumeNegativeTest-1298357771 Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a5b55fd6668b481b8c578983dc655785"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a5b55fd6668b481b8c578983dc655785"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a5b55fd6668b481b8c578983dc655785"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a5b55fd6668b481b8c578983dc655785"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-AttachVolumeNegativeTest-1298357771 Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: a5b55fd6668b481b8c578983dc655785 Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1298357771 Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-AttachVolumeNegativeTest-1298357771-project Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: efec3b4b5b1c46bd9d2c0efa68f86979 Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-AttachVolumeNegativeTest-1298357771-project Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 47ee1803-1ce0-4cbc-879e-d39cfe8576aa could not be found. Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '47ee1803-1ce0-4cbc-879e-d39cfe8576aa'} Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47ee1803-1ce0-4cbc-879e-d39cfe8576aa could not be found. Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:43:39.929837 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:43:39.933701 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47ee1803-1ce0-4cbc-879e-d39cfe8576aa could not be found. Oct 18 15:43:39.933701 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:39.933701 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:43:39.933701 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:39.933701 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:39.933701 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:43:39.933701 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:43:39.933701 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:43:39.933701 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:43:39.933701 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47ee1803-1ce0-4cbc-879e-d39cfe8576aa could not be found. Oct 18 15:43:39.933701 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:39.933701 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-97944258-0c00-4024-a4b6-c88a95aa9081 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Returning 404 to user: Instance 47ee1803-1ce0-4cbc-879e-d39cfe8576aa could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:43:39.933701 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-97944258-0c00-4024-a4b6-c88a95aa9081 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "DELETE /compute/v2.1/servers/47ee1803-1ce0-4cbc-879e-d39cfe8576aa" status: 404 len: 111 microversion: 2.1 time: 0.093353 Oct 18 15:43:39.933701 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2072/4137] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:43:39 2022] DELETE /compute/v2.1/servers/47ee1803-1ce0-4cbc-879e-d39cfe8576aa => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:43:39.944526 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ac243d2b-f46e-4c4b-bc31-0bf33ce3478a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:39.947259 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ac243d2b-f46e-4c4b-bc31-0bf33ce3478a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:39.959220 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ac243d2b-f46e-4c4b-bc31-0bf33ce3478a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:39.959957 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ac243d2b-f46e-4c4b-bc31-0bf33ce3478a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:39.960623 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ac243d2b-f46e-4c4b-bc31-0bf33ce3478a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:39.961545 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ac243d2b-f46e-4c4b-bc31-0bf33ce3478a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:39.962216 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ac243d2b-f46e-4c4b-bc31-0bf33ce3478a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:39.962813 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ac243d2b-f46e-4c4b-bc31-0bf33ce3478a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:40.043728 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ac243d2b-f46e-4c4b-bc31-0bf33ce3478a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:40.044469 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ac243d2b-f46e-4c4b-bc31-0bf33ce3478a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:40.045245 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ac243d2b-f46e-4c4b-bc31-0bf33ce3478a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:40.045814 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-ac243d2b-f46e-4c4b-bc31-0bf33ce3478a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lazy-loading 'fault' on Instance uuid cf8f81da-4aa0-498d-af1e-c036238f065d {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:43:40.140874 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:43:40.165586 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ac243d2b-f46e-4c4b-bc31-0bf33ce3478a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:40.178829 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ac243d2b-f46e-4c4b-bc31-0bf33ce3478a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:40.181218 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ac243d2b-f46e-4c4b-bc31-0bf33ce3478a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccc5106861284e12aa81c7a28e024a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a67d76e7f824ee99302b9efb7d36e2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:40.184648 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ac243d2b-f46e-4c4b-bc31-0bf33ce3478a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 200 len: 1372 microversion: 2.32 time: 0.247763 Oct 18 15:43:40.186713 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2073/4138] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:43:39 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 1372 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:43:40.207755 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c82b12d1-1f39-48c2-991a-e7e6a7eab191 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '.version_select at 0x7f7c3d77eee0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:40.225393 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=6 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:43:40.256929 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-c82b12d1-1f39-48c2-991a-e7e6a7eab191 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] HTTP exception thrown: Image not found. Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c82b12d1-1f39-48c2-991a-e7e6a7eab191 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Request method failure captured: Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: request: DELETE /compute/v2.1/images/0f425c54-be6a-4a95-b0cd-34449c1d0ad4 HTTP/1.1 Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTskwmwAKtfJxRtfmFCexrRganirG5QxP3o41FeBWoidL-rUG8x8GL16JQLrOge4bbPRk8j9ZKsrTawjOywht8BMU6xpPPkLcF_Tvsxd_4ddRByYVxCCr1OvdQRZ3S_CoRUmp2shw5GPVxRCyE1gWYjx_sxIK_OIs6piyKG80707p5j0 Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 38b4cd4b884c4456866052a4969dc138 Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1849835039 Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/38b4cd4b884c4456866052a4969dc138"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/38b4cd4b884c4456866052a4969dc138"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/38b4cd4b884c4456866052a4969dc138"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_38b4cd4b884c4456866052a4969dc138"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1849835039 Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 38b4cd4b884c4456866052a4969dc138 Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1849835039 Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ImagesOneServerNegativeTestJSON-1849835039-project Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: a2e9e9bbf3d94d77a236e43f019d316a Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1849835039-project Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: method: Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: exception: Image not found. Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '0f425c54-be6a-4a95-b0cd-34449c1d0ad4'} Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 0f425c54-be6a-4a95-b0cd-34449c1d0ad4 to delete Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0f425c54-be6a-4a95-b0cd-34449c1d0ad4 could not be found. Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:43:40.259710 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:40.263348 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:40.263348 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:43:40.263348 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:43:40.263348 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:43:40.263348 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:43:40.263348 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:43:40.263348 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:43:40.263348 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:43:40.263348 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:43:40.263348 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 18 15:43:40.263348 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 15:43:40.263348 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 15:43:40.263348 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:40.263348 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:43:40.263348 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:40.263348 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:40.263348 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:43:40.263348 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:43:40.263348 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:43:40.263348 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:43:40.263348 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 15:43:40.263348 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:40.266649 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c82b12d1-1f39-48c2-991a-e7e6a7eab191 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Returning 404 to user: Image not found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:43:40.268051 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c82b12d1-1f39-48c2-991a-e7e6a7eab191 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "DELETE /compute/v2.1/images/0f425c54-be6a-4a95-b0cd-34449c1d0ad4" status: 404 len: 62 microversion: 2.1 time: 0.078516 Oct 18 15:43:40.269310 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2074/4139] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:40 2022] DELETE /compute/v2.1/images/0f425c54-be6a-4a95-b0cd-34449c1d0ad4 => generated 62 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 15:43:40.283136 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7e760c4c-605e-47b5-b1f0-07b0a9bcac6c tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:40.284799 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7e760c4c-605e-47b5-b1f0-07b0a9bcac6c tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 47ee1803-1ce0-4cbc-879e-d39cfe8576aa] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:40.287693 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a3b515e7-5d3f-470b-b1fa-d94196728be8 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:40.295751 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7e760c4c-605e-47b5-b1f0-07b0a9bcac6c tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:40.297864 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7e760c4c-605e-47b5-b1f0-07b0a9bcac6c tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:40.298278 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a3b515e7-5d3f-470b-b1fa-d94196728be8 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/28223cad-bdfe-40ba-905e-56488b5119be" status: 200 len: 1512 microversion: 2.1 time: 0.508705 Oct 18 15:43:40.298789 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7e760c4c-605e-47b5-b1f0-07b0a9bcac6c tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:40.299732 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7e760c4c-605e-47b5-b1f0-07b0a9bcac6c tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:40.300857 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7e760c4c-605e-47b5-b1f0-07b0a9bcac6c tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:40.301847 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7e760c4c-605e-47b5-b1f0-07b0a9bcac6c tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:40.306182 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2066/4140] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:39 2022] GET /compute/v2.1/servers/28223cad-bdfe-40ba-905e-56488b5119be => generated 1512 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:40.328165 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-0c4145d5-af1c-4a8e-a4f1-661a67c0f26b req-6e80fc8e-0549-4dcb-a4b2-0e27c5c6a38b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28223cad-bdfe-40ba-905e-56488b5119be", "name": "network-vif-deleted", "tag": "b1722f5a-1373-4cc7-a352-49bccad122e7"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:43:40.344548 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-7e760c4c-605e-47b5-b1f0-07b0a9bcac6c tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] HTTP exception thrown: Instance 47ee1803-1ce0-4cbc-879e-d39cfe8576aa could not be found. Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7e760c4c-605e-47b5-b1f0-07b0a9bcac6c tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Request method failure captured: Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/47ee1803-1ce0-4cbc-879e-d39cfe8576aa HTTP/1.1 Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsfD3tyC5zBBCs3PM6SgagJOA9ytEd34lT9my352h69qxn0wNQWvVVVEceKNcLlE8Cld2E1ewLfFQUA6X-zyH4NCgXE9isdDnVpnJB5BT1ljNdC07pganRFql9FpScM1-Xjt5su1w2IBkP6ZVV1NsRclcY3oY_ScUp2DhZs2W7X1y8Y Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: a5b55fd6668b481b8c578983dc655785 Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-AttachVolumeNegativeTest-1298357771 Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a5b55fd6668b481b8c578983dc655785"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a5b55fd6668b481b8c578983dc655785"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a5b55fd6668b481b8c578983dc655785"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a5b55fd6668b481b8c578983dc655785"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-AttachVolumeNegativeTest-1298357771 Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: a5b55fd6668b481b8c578983dc655785 Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1298357771 Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-AttachVolumeNegativeTest-1298357771-project Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: efec3b4b5b1c46bd9d2c0efa68f86979 Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-AttachVolumeNegativeTest-1298357771-project Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 47ee1803-1ce0-4cbc-879e-d39cfe8576aa could not be found. Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '47ee1803-1ce0-4cbc-879e-d39cfe8576aa'} Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47ee1803-1ce0-4cbc-879e-d39cfe8576aa could not be found. Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47ee1803-1ce0-4cbc-879e-d39cfe8576aa could not be found. Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:43:40.347248 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:40.351634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:40.351634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:43:40.351634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:43:40.351634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:43:40.351634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:43:40.351634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47ee1803-1ce0-4cbc-879e-d39cfe8576aa could not be found. Oct 18 15:43:40.351634 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:40.357176 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7e760c4c-605e-47b5-b1f0-07b0a9bcac6c tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Returning 404 to user: Instance 47ee1803-1ce0-4cbc-879e-d39cfe8576aa could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:43:40.358266 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7e760c4c-605e-47b5-b1f0-07b0a9bcac6c tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee1803-1ce0-4cbc-879e-d39cfe8576aa" status: 404 len: 111 microversion: 2.1 time: 0.086178 Oct 18 15:43:40.365445 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2075/4141] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:40 2022] GET /compute/v2.1/servers/47ee1803-1ce0-4cbc-879e-d39cfe8576aa => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:43:40.374741 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ce870939-56e6-4a75-907d-6c222c4cc969 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:40.375422 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ce870939-56e6-4a75-907d-6c222c4cc969 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 68a3c952-31f5-42a5-a8b9-698785c5c01f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:40.378824 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0c4145d5-af1c-4a8e-a4f1-661a67c0f26b req-6e80fc8e-0549-4dcb-a4b2-0e27c5c6a38b service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:40.384417 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0c4145d5-af1c-4a8e-a4f1-661a67c0f26b req-6e80fc8e-0549-4dcb-a4b2-0e27c5c6a38b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:40.385662 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0c4145d5-af1c-4a8e-a4f1-661a67c0f26b req-6e80fc8e-0549-4dcb-a4b2-0e27c5c6a38b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:40.405155 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ce870939-56e6-4a75-907d-6c222c4cc969 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:40.406278 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ce870939-56e6-4a75-907d-6c222c4cc969 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:40.406723 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ce870939-56e6-4a75-907d-6c222c4cc969 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:40.407459 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ce870939-56e6-4a75-907d-6c222c4cc969 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:40.414834 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ce870939-56e6-4a75-907d-6c222c4cc969 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:40.416564 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ce870939-56e6-4a75-907d-6c222c4cc969 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:40.453394 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-0c4145d5-af1c-4a8e-a4f1-661a67c0f26b req-6e80fc8e-0549-4dcb-a4b2-0e27c5c6a38b service nova] Creating event network-vif-deleted:b1722f5a-1373-4cc7-a352-49bccad122e7 for instance 28223cad-bdfe-40ba-905e-56488b5119be on n-h1-853682-5 Oct 18 15:43:40.467498 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-ce870939-56e6-4a75-907d-6c222c4cc969 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] HTTP exception thrown: Instance 68a3c952-31f5-42a5-a8b9-698785c5c01f could not be found. Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ce870939-56e6-4a75-907d-6c222c4cc969 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Request method failure captured: Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: request: DELETE /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f HTTP/1.1 Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTskwmwAKtfJxRtfmFCexrRganirG5QxP3o41FeBWoidL-rUG8x8GL16JQLrOge4bbPRk8j9ZKsrTawjOywht8BMU6xpPPkLcF_Tvsxd_4ddRByYVxCCr1OvdQRZ3S_CoRUmp2shw5GPVxRCyE1gWYjx_sxIK_OIs6piyKG80707p5j0 Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 38b4cd4b884c4456866052a4969dc138 Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1849835039 Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/38b4cd4b884c4456866052a4969dc138"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/38b4cd4b884c4456866052a4969dc138"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/38b4cd4b884c4456866052a4969dc138"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_38b4cd4b884c4456866052a4969dc138"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1849835039 Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 38b4cd4b884c4456866052a4969dc138 Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1849835039 Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ImagesOneServerNegativeTestJSON-1849835039-project Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: a2e9e9bbf3d94d77a236e43f019d316a Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1849835039-project Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 68a3c952-31f5-42a5-a8b9-698785c5c01f could not be found. Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '68a3c952-31f5-42a5-a8b9-698785c5c01f'} Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68a3c952-31f5-42a5-a8b9-698785c5c01f could not be found. Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:43:40.470403 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:43:40.478538 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68a3c952-31f5-42a5-a8b9-698785c5c01f could not be found. Oct 18 15:43:40.478538 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:40.478538 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:43:40.478538 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:40.478538 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:40.478538 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:43:40.478538 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:43:40.478538 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:43:40.478538 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:43:40.478538 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68a3c952-31f5-42a5-a8b9-698785c5c01f could not be found. Oct 18 15:43:40.478538 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:40.479686 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-0c4145d5-af1c-4a8e-a4f1-661a67c0f26b req-6e80fc8e-0549-4dcb-a4b2-0e27c5c6a38b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159538 Oct 18 15:43:40.479850 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ce870939-56e6-4a75-907d-6c222c4cc969 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Returning 404 to user: Instance 68a3c952-31f5-42a5-a8b9-698785c5c01f could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:43:40.479850 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ce870939-56e6-4a75-907d-6c222c4cc969 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "DELETE /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f" status: 404 len: 111 microversion: 2.1 time: 0.105122 Oct 18 15:43:40.479850 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2076/4142] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:43:40 2022] DELETE /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:43:40.480187 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2067/4143] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:43:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:43:40.493344 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0479aa64-9e0b-45d3-b08a-90893af1baf7 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:40.494365 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0479aa64-9e0b-45d3-b08a-90893af1baf7 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] [instance: 68a3c952-31f5-42a5-a8b9-698785c5c01f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:40.516749 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0479aa64-9e0b-45d3-b08a-90893af1baf7 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:40.519852 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0479aa64-9e0b-45d3-b08a-90893af1baf7 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:40.521835 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0479aa64-9e0b-45d3-b08a-90893af1baf7 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:40.524745 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0479aa64-9e0b-45d3-b08a-90893af1baf7 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:40.525479 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0479aa64-9e0b-45d3-b08a-90893af1baf7 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:40.528798 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0479aa64-9e0b-45d3-b08a-90893af1baf7 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:40.568871 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-0479aa64-9e0b-45d3-b08a-90893af1baf7 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] HTTP exception thrown: Instance 68a3c952-31f5-42a5-a8b9-698785c5c01f could not be found. Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0479aa64-9e0b-45d3-b08a-90893af1baf7 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Request method failure captured: Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f HTTP/1.1 Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTskwmwAKtfJxRtfmFCexrRganirG5QxP3o41FeBWoidL-rUG8x8GL16JQLrOge4bbPRk8j9ZKsrTawjOywht8BMU6xpPPkLcF_Tvsxd_4ddRByYVxCCr1OvdQRZ3S_CoRUmp2shw5GPVxRCyE1gWYjx_sxIK_OIs6piyKG80707p5j0 Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 38b4cd4b884c4456866052a4969dc138 Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1849835039 Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/38b4cd4b884c4456866052a4969dc138"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/38b4cd4b884c4456866052a4969dc138"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/38b4cd4b884c4456866052a4969dc138"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_38b4cd4b884c4456866052a4969dc138"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1849835039 Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 38b4cd4b884c4456866052a4969dc138 Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1849835039 Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ImagesOneServerNegativeTestJSON-1849835039-project Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: a2e9e9bbf3d94d77a236e43f019d316a Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1849835039-project Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 68a3c952-31f5-42a5-a8b9-698785c5c01f could not be found. Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '68a3c952-31f5-42a5-a8b9-698785c5c01f'} Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68a3c952-31f5-42a5-a8b9-698785c5c01f could not be found. Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68a3c952-31f5-42a5-a8b9-698785c5c01f could not be found. Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:40.570459 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:43:40.573833 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:40.573833 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:40.573833 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:43:40.573833 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:43:40.573833 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:43:40.573833 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:43:40.573833 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68a3c952-31f5-42a5-a8b9-698785c5c01f could not be found. Oct 18 15:43:40.573833 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:40.573833 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0479aa64-9e0b-45d3-b08a-90893af1baf7 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] Returning 404 to user: Instance 68a3c952-31f5-42a5-a8b9-698785c5c01f could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:43:40.573833 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0479aa64-9e0b-45d3-b08a-90893af1baf7 tempest-ImagesOneServerNegativeTestJSON-1849835039 tempest-ImagesOneServerNegativeTestJSON-1849835039-project] 10.222.0.60 "GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f" status: 404 len: 111 microversion: 2.1 time: 0.085908 Oct 18 15:43:40.578787 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2077/4144] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:40 2022] GET /compute/v2.1/servers/68a3c952-31f5-42a5-a8b9-698785c5c01f => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:43:40.812680 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8d1aa9b0-786b-4b78-a695-0a6fd7313645 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:40.813778 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8d1aa9b0-786b-4b78-a695-0a6fd7313645 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: a49f5b92-61e2-44bd-92a9-2bbaa1fb8975] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:40.829725 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d1aa9b0-786b-4b78-a695-0a6fd7313645 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:40.830507 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d1aa9b0-786b-4b78-a695-0a6fd7313645 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:40.833100 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d1aa9b0-786b-4b78-a695-0a6fd7313645 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:40.834088 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d1aa9b0-786b-4b78-a695-0a6fd7313645 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:40.843932 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d1aa9b0-786b-4b78-a695-0a6fd7313645 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:40.845878 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d1aa9b0-786b-4b78-a695-0a6fd7313645 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:40.863757 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-26df51df-bb3e-44d9-9b76-a36a49175a6a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:40.864380 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-26df51df-bb3e-44d9-9b76-a36a49175a6a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: e6019a42-1115-4a7b-bfab-badb33cafed8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:40.881455 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26df51df-bb3e-44d9-9b76-a36a49175a6a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:40.883439 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26df51df-bb3e-44d9-9b76-a36a49175a6a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:40.884502 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26df51df-bb3e-44d9-9b76-a36a49175a6a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:40.886246 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26df51df-bb3e-44d9-9b76-a36a49175a6a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:40.887156 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26df51df-bb3e-44d9-9b76-a36a49175a6a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:40.887818 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26df51df-bb3e-44d9-9b76-a36a49175a6a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:41.360751 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8d1aa9b0-786b-4b78-a695-0a6fd7313645 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:41.370916 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8d1aa9b0-786b-4b78-a695-0a6fd7313645 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975" status: 200 len: 1322 microversion: 2.1 time: 0.564727 Oct 18 15:43:41.386278 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2068/4145] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:40 2022] GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975 => generated 1322 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:41.396656 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-26df51df-bb3e-44d9-9b76-a36a49175a6a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:41.405469 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-26df51df-bb3e-44d9-9b76-a36a49175a6a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8" status: 200 len: 1313 microversion: 2.1 time: 0.545874 Oct 18 15:43:41.406411 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-331b5436-2133-42a3-b6d4-c52b6741c845 req-3705addb-4a1b-4ff5-b55e-1b47e0703f78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a49f5b92-61e2-44bd-92a9-2bbaa1fb8975", "name": "network-vif-plugged", "status": "completed", "tag": "896b942f-5533-44f6-8cb3-97209dd77612"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:43:41.411937 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2078/4146] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:40 2022] GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8 => generated 1313 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:41.419173 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=24 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:43:41.425363 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6f87812c-3b8a-4b8e-8939-b69788fa6104 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:41.426405 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6f87812c-3b8a-4b8e-8939-b69788fa6104 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:41.433857 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-331b5436-2133-42a3-b6d4-c52b6741c845 req-3705addb-4a1b-4ff5-b55e-1b47e0703f78 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:41.436419 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-331b5436-2133-42a3-b6d4-c52b6741c845 req-3705addb-4a1b-4ff5-b55e-1b47e0703f78 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:41.438476 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-331b5436-2133-42a3-b6d4-c52b6741c845 req-3705addb-4a1b-4ff5-b55e-1b47e0703f78 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:41.446271 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6f87812c-3b8a-4b8e-8939-b69788fa6104 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:41.447109 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6f87812c-3b8a-4b8e-8939-b69788fa6104 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:41.447762 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6f87812c-3b8a-4b8e-8939-b69788fa6104 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:41.449590 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6f87812c-3b8a-4b8e-8939-b69788fa6104 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:41.452984 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6f87812c-3b8a-4b8e-8939-b69788fa6104 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:41.453589 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6f87812c-3b8a-4b8e-8939-b69788fa6104 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:41.459222 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-331b5436-2133-42a3-b6d4-c52b6741c845 req-3705addb-4a1b-4ff5-b55e-1b47e0703f78 service nova] Creating event network-vif-plugged:896b942f-5533-44f6-8cb3-97209dd77612 for instance a49f5b92-61e2-44bd-92a9-2bbaa1fb8975 on n-h2-853682-5 Oct 18 15:43:41.469108 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-331b5436-2133-42a3-b6d4-c52b6741c845 req-3705addb-4a1b-4ff5-b55e-1b47e0703f78 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079431 Oct 18 15:43:41.470246 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-6f87812c-3b8a-4b8e-8939-b69788fa6104 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] HTTP exception thrown: Instance cf8f81da-4aa0-498d-af1e-c036238f065d could not be found. Oct 18 15:43:41.470942 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2069/4147] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:43:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6f87812c-3b8a-4b8e-8939-b69788fa6104 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Request method failure captured: Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d HTTP/1.1 Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsgpmW1nRLv2ldegpMEiqyvhmI_h11cRUxAU83yp9iCJZEEiUJ9NEmO3aMb5ICfxfLcu5x9IUh4Ze6tqcUucvaYXl8-OM3DqhAXbxh7Yfus4CG68HAGEMQeFfoX58DdYP6Tt4-7t8pDwuClxmIsR5tOrridVHyiweY1UXXU_oCFTyTM Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: X-Openstack-Nova-Api-Version: 2.32 Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 1a67d76e7f824ee99302b9efb7d36e2f Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-TaggedBootDevicesTest-1462456838 Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1a67d76e7f824ee99302b9efb7d36e2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1a67d76e7f824ee99302b9efb7d36e2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1a67d76e7f824ee99302b9efb7d36e2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1a67d76e7f824ee99302b9efb7d36e2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-TaggedBootDevicesTest-1462456838 Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 1a67d76e7f824ee99302b9efb7d36e2f Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1462456838 Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-TaggedBootDevicesTest-1462456838-project Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: ccc5106861284e12aa81c7a28e024a1b Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-TaggedBootDevicesTest-1462456838-project Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance cf8f81da-4aa0-498d-af1e-c036238f065d could not be found. Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'cf8f81da-4aa0-498d-af1e-c036238f065d'} Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf8f81da-4aa0-498d-af1e-c036238f065d could not be found. Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf8f81da-4aa0-498d-af1e-c036238f065d could not be found. Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:41.473676 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:43:41.477401 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:41.477401 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:41.477401 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:43:41.477401 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:43:41.477401 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:43:41.477401 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:43:41.477401 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf8f81da-4aa0-498d-af1e-c036238f065d could not be found. Oct 18 15:43:41.477401 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:41.478607 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ac4b1854-d385-4a38-b759-e76f7d20bca2 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:41.479121 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6f87812c-3b8a-4b8e-8939-b69788fa6104 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Returning 404 to user: Instance cf8f81da-4aa0-498d-af1e-c036238f065d could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:43:41.479920 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ac4b1854-d385-4a38-b759-e76f7d20bca2 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 28223cad-bdfe-40ba-905e-56488b5119be] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:41.480438 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6f87812c-3b8a-4b8e-8939-b69788fa6104 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 404 len: 111 microversion: 2.32 time: 0.063999 Oct 18 15:43:41.481646 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2079/4148] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:43:41 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:43:41.493372 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac4b1854-d385-4a38-b759-e76f7d20bca2 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:41.494141 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac4b1854-d385-4a38-b759-e76f7d20bca2 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:41.494757 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac4b1854-d385-4a38-b759-e76f7d20bca2 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:41.495649 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac4b1854-d385-4a38-b759-e76f7d20bca2 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:41.496302 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac4b1854-d385-4a38-b759-e76f7d20bca2 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:41.496421 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9064b6cd-42c4-44cf-8162-30460de86304 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '.version_select at 0x7f7c3d3bc550>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:41.497012 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac4b1854-d385-4a38-b759-e76f7d20bca2 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:41.504697 n-d-853682-5 devstack@n-api.service[120405]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9064b6cd-42c4-44cf-8162-30460de86304 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [261cbdb9-2eb5-48c9-b9c4-f39c963233ba] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 15:43:41.526986 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-ac4b1854-d385-4a38-b759-e76f7d20bca2 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] HTTP exception thrown: Instance 28223cad-bdfe-40ba-905e-56488b5119be could not be found. Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ac4b1854-d385-4a38-b759-e76f7d20bca2 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Request method failure captured: Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/28223cad-bdfe-40ba-905e-56488b5119be HTTP/1.1 Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTslxbnvpe5yiGf5CWZMgShC81OiGKrcSLYZFSWKOLbaqqF5kNJvh8cijdldsPo1OHjHXDcbdPuhTuFRNRswVq0HwpXLNCfOWcF3GU1M8LHkZwXu6ScaOEIHyQ8ewFnAFL7TXd1O14t3atsv_uM6Xc9ZHSfefERCjuehdw5SJuAn7MMs Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 96c4378d52d1489bb2d50e84cabf95eb Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 28223cad-bdfe-40ba-905e-56488b5119be could not be found. Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '28223cad-bdfe-40ba-905e-56488b5119be'} Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28223cad-bdfe-40ba-905e-56488b5119be could not be found. Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28223cad-bdfe-40ba-905e-56488b5119be could not be found. Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:43:41.528655 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:41.533522 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:41.533522 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:43:41.533522 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:43:41.533522 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:43:41.533522 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:43:41.533522 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28223cad-bdfe-40ba-905e-56488b5119be could not be found. Oct 18 15:43:41.533522 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:41.533522 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ac4b1854-d385-4a38-b759-e76f7d20bca2 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Returning 404 to user: Instance 28223cad-bdfe-40ba-905e-56488b5119be could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:43:41.533522 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ac4b1854-d385-4a38-b759-e76f7d20bca2 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/28223cad-bdfe-40ba-905e-56488b5119be" status: 404 len: 111 microversion: 2.1 time: 0.058039 Oct 18 15:43:41.535437 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2070/4149] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:41 2022] GET /compute/v2.1/servers/28223cad-bdfe-40ba-905e-56488b5119be => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:43:41.541528 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ba649bed-e8c2-4971-9ed7-11735c8647da tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:41.542155 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ba649bed-e8c2-4971-9ed7-11735c8647da tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:41.549096 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba649bed-e8c2-4971-9ed7-11735c8647da tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:41.549592 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba649bed-e8c2-4971-9ed7-11735c8647da tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:41.550030 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba649bed-e8c2-4971-9ed7-11735c8647da tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:41.550735 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba649bed-e8c2-4971-9ed7-11735c8647da tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:41.551195 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba649bed-e8c2-4971-9ed7-11735c8647da tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:41.551623 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba649bed-e8c2-4971-9ed7-11735c8647da tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:41.854986 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ba649bed-e8c2-4971-9ed7-11735c8647da tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:41.867204 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ba649bed-e8c2-4971-9ed7-11735c8647da tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.330634 Oct 18 15:43:41.871858 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2071/4150] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:41 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:42.010638 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1baaad9c-f903-4c5f-b396-935bc660d5e7 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "b55b6f02-72e3-4b31-a708-98b6291bed4c"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1baaad9c-f903-4c5f-b396-935bc660d5e7 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Request method failure captured: Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 163 Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTslxbnvpe5yiGf5CWZMgShC81OiGKrcSLYZFSWKOLbaqqF5kNJvh8cijdldsPo1OHjHXDcbdPuhTuFRNRswVq0HwpXLNCfOWcF3GU1M8LHkZwXu6ScaOEIHyQ8ewFnAFL7TXd1O14t3atsv_uM6Xc9ZHSfefERCjuehdw5SJuAn7MMs Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 96c4378d52d1489bb2d50e84cabf95eb Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: {"server": {"name": 12345, "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "b55b6f02-72e3-4b31-a708-98b6291bed4c"}]}} Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '8f4db252-bff6-4685-9c8d-4c5d6bd9f78b', 'flavorRef': '452', 'networks': [{'uuid': 'b55b6f02-72e3-4b31-a708-98b6291bed4c'}]}}} Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise error Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 12345 Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 15:43:42.016795 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 15:43:42.020266 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 15:43:42.020266 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 18 15:43:42.020266 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:42.020266 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:43:42.020266 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:42.020266 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:42.020266 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:43:42.020266 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:43:42.020266 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 15:43:42.020266 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 15:43:42.020266 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 18 15:43:42.020266 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:42.020266 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1baaad9c-f903-4c5f-b396-935bc660d5e7 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:43:42.020266 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1baaad9c-f903-4c5f-b396-935bc660d5e7 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.014409 Oct 18 15:43:42.021210 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2072/4151] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:43:42 2022] POST /compute/v2.1/servers => generated 127 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 18 15:43:42.029260 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-db64e55d-3db8-42ef-ba18-1e8db82e6286 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:42.030035 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-db64e55d-3db8-42ef-ba18-1e8db82e6286 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:42.038974 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db64e55d-3db8-42ef-ba18-1e8db82e6286 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:42.039619 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db64e55d-3db8-42ef-ba18-1e8db82e6286 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:42.040160 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db64e55d-3db8-42ef-ba18-1e8db82e6286 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:42.041512 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db64e55d-3db8-42ef-ba18-1e8db82e6286 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:42.042175 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db64e55d-3db8-42ef-ba18-1e8db82e6286 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:42.042991 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db64e55d-3db8-42ef-ba18-1e8db82e6286 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:42.299599 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-db64e55d-3db8-42ef-ba18-1e8db82e6286 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:42.312665 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-db64e55d-3db8-42ef-ba18-1e8db82e6286 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.287017 Oct 18 15:43:42.313945 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2073/4152] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:42 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:42.338284 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7f67d085-3f8d-4c8a-9295-fdac07c253c7 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:42.339354 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7f67d085-3f8d-4c8a-9295-fdac07c253c7 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:42.346324 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f67d085-3f8d-4c8a-9295-fdac07c253c7 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:42.347088 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f67d085-3f8d-4c8a-9295-fdac07c253c7 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:42.347753 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f67d085-3f8d-4c8a-9295-fdac07c253c7 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:42.348640 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f67d085-3f8d-4c8a-9295-fdac07c253c7 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:42.349466 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f67d085-3f8d-4c8a-9295-fdac07c253c7 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:42.350049 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f67d085-3f8d-4c8a-9295-fdac07c253c7 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:42.512108 n-d-853682-5 devstack@n-api.service[120405]: INFO oslo.messaging._drivers.impl_rabbit [None req-9064b6cd-42c4-44cf-8162-30460de86304 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [261cbdb9-2eb5-48c9-b9c4-f39c963233ba] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 52966. Oct 18 15:43:42.545497 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9064b6cd-42c4-44cf-8162-30460de86304 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1784807893" status: 204 len: 0 microversion: 2.32 time: 1.058054 Oct 18 15:43:42.546787 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2080/4153] 10.222.0.60 () {60 vars in 1262 bytes} [Tue Oct 18 15:43:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1784807893 => generated 0 bytes in 1060 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 15:43:42.562742 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-71694267-98a1-4208-93a4-b3991c0ed32f tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:42.563707 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-71694267-98a1-4208-93a4-b3991c0ed32f tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: a49f5b92-61e2-44bd-92a9-2bbaa1fb8975] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:42.572232 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-71694267-98a1-4208-93a4-b3991c0ed32f tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:42.572971 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-71694267-98a1-4208-93a4-b3991c0ed32f tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:42.573651 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-71694267-98a1-4208-93a4-b3991c0ed32f tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:42.575255 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-71694267-98a1-4208-93a4-b3991c0ed32f tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:42.575887 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-71694267-98a1-4208-93a4-b3991c0ed32f tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:42.576741 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-71694267-98a1-4208-93a4-b3991c0ed32f tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:42.790648 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7f67d085-3f8d-4c8a-9295-fdac07c253c7 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:42.799478 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7f67d085-3f8d-4c8a-9295-fdac07c253c7 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.465285 Oct 18 15:43:42.803180 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2074/4154] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:42 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:42.816850 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ec766c2c-87ce-4797-acab-582b306846ef tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:42.817411 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ec766c2c-87ce-4797-acab-582b306846ef tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: e6019a42-1115-4a7b-bfab-badb33cafed8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:42.851570 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec766c2c-87ce-4797-acab-582b306846ef tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:42.851988 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec766c2c-87ce-4797-acab-582b306846ef tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:42.852436 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec766c2c-87ce-4797-acab-582b306846ef tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:42.853186 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec766c2c-87ce-4797-acab-582b306846ef tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:42.853651 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec766c2c-87ce-4797-acab-582b306846ef tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:42.854085 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec766c2c-87ce-4797-acab-582b306846ef tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:43.156890 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-71694267-98a1-4208-93a4-b3991c0ed32f tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:43.167670 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-71694267-98a1-4208-93a4-b3991c0ed32f tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975" status: 200 len: 1322 microversion: 2.1 time: 0.619374 Oct 18 15:43:43.168842 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2081/4155] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:42 2022] GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975 => generated 1322 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:43.580033 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ec766c2c-87ce-4797-acab-582b306846ef tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:43.591755 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ec766c2c-87ce-4797-acab-582b306846ef tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8" status: 200 len: 1313 microversion: 2.1 time: 0.781526 Oct 18 15:43:43.592553 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2075/4156] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:42 2022] GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8 => generated 1313 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:44.191255 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fa54822d-44b2-49fe-b111-4d010a148124 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:44.192038 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-fa54822d-44b2-49fe-b111-4d010a148124 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: a49f5b92-61e2-44bd-92a9-2bbaa1fb8975] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:44.207267 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fa54822d-44b2-49fe-b111-4d010a148124 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:44.210346 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fa54822d-44b2-49fe-b111-4d010a148124 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:44.210998 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fa54822d-44b2-49fe-b111-4d010a148124 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:44.211868 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fa54822d-44b2-49fe-b111-4d010a148124 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:44.213833 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fa54822d-44b2-49fe-b111-4d010a148124 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:44.217869 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fa54822d-44b2-49fe-b111-4d010a148124 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:44.617493 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dffc146a-ebcd-4d34-83b0-42bde191d4e2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:44.618302 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dffc146a-ebcd-4d34-83b0-42bde191d4e2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: e6019a42-1115-4a7b-bfab-badb33cafed8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:44.631391 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dffc146a-ebcd-4d34-83b0-42bde191d4e2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:44.635205 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dffc146a-ebcd-4d34-83b0-42bde191d4e2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:44.637278 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dffc146a-ebcd-4d34-83b0-42bde191d4e2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:44.638576 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dffc146a-ebcd-4d34-83b0-42bde191d4e2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:44.642028 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dffc146a-ebcd-4d34-83b0-42bde191d4e2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:44.643304 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dffc146a-ebcd-4d34-83b0-42bde191d4e2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:45.748410 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-fa54822d-44b2-49fe-b111-4d010a148124 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:45.757272 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fa54822d-44b2-49fe-b111-4d010a148124 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975" status: 200 len: 1517 microversion: 2.1 time: 1.570376 Oct 18 15:43:45.757810 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2082/4157] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:44 2022] GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975 => generated 1517 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:45.766904 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dffc146a-ebcd-4d34-83b0-42bde191d4e2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:45.785088 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-35a4a7ae-b895-48d7-be5a-2ebcb577bbad tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:43:45.788180 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-35a4a7ae-b895-48d7-be5a-2ebcb577bbad tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: a49f5b92-61e2-44bd-92a9-2bbaa1fb8975] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:45.794809 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dffc146a-ebcd-4d34-83b0-42bde191d4e2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8" status: 200 len: 1313 microversion: 2.1 time: 1.181096 Oct 18 15:43:45.795439 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-35a4a7ae-b895-48d7-be5a-2ebcb577bbad tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:45.796264 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-35a4a7ae-b895-48d7-be5a-2ebcb577bbad tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:45.796798 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2076/4158] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:44 2022] GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8 => generated 1313 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:45.809627 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-35a4a7ae-b895-48d7-be5a-2ebcb577bbad tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:45.810704 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-35a4a7ae-b895-48d7-be5a-2ebcb577bbad tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:45.811349 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-35a4a7ae-b895-48d7-be5a-2ebcb577bbad tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:45.811829 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-35a4a7ae-b895-48d7-be5a-2ebcb577bbad tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:45.842728 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-35a4a7ae-b895-48d7-be5a-2ebcb577bbad tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lazy-loading 'flavor' on Instance uuid a49f5b92-61e2-44bd-92a9-2bbaa1fb8975 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:43:45.847396 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:43:45.949785 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-35a4a7ae-b895-48d7-be5a-2ebcb577bbad tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "POST /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975/action" status: 200 len: 32 microversion: 2.1 time: 0.171201 Oct 18 15:43:45.951574 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2083/4159] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:43:45 2022] POST /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975/action => generated 32 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 18 15:43:45.957776 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-af012996-7743-4f4e-964f-ef290d1a153b tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1813645148", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "6841167f-f8d7-4669-a9ea-cc4f48b5edd1", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "b55b6f02-72e3-4b31-a708-98b6291bed4c"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:43:45.964261 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-17a136dc-71de-4610-9bb9-25372cb247cc tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:45.968701 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-17a136dc-71de-4610-9bb9-25372cb247cc tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: a49f5b92-61e2-44bd-92a9-2bbaa1fb8975] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:45.984784 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-17a136dc-71de-4610-9bb9-25372cb247cc tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:45.989246 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-17a136dc-71de-4610-9bb9-25372cb247cc tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:45.989705 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-17a136dc-71de-4610-9bb9-25372cb247cc tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:45.990530 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-17a136dc-71de-4610-9bb9-25372cb247cc tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:45.991196 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-17a136dc-71de-4610-9bb9-25372cb247cc tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:45.991838 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-17a136dc-71de-4610-9bb9-25372cb247cc tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:46.150276 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-af012996-7743-4f4e-964f-ef290d1a153b tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] HTTP exception thrown: Block Device 6841167f-f8d7-4669-a9ea-cc4f48b5edd1 is not bootable. Oct 18 15:43:46.166240 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-af012996-7743-4f4e-964f-ef290d1a153b tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Request method failure captured: Oct 18 15:43:46.166240 n-d-853682-5 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 15:43:46.166240 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:43:46.166240 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:43:46.166240 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:43:46.166240 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 358 Oct 18 15:43:46.166240 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:43:46.166240 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:43:46.166240 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:43:46.166240 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:43:46.166240 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTslxbnvpe5yiGf5CWZMgShC81OiGKrcSLYZFSWKOLbaqqF5kNJvh8cijdldsPo1OHjHXDcbdPuhTuFRNRswVq0HwpXLNCfOWcF3GU1M8LHkZwXu6ScaOEIHyQ8ewFnAFL7TXd1O14t3atsv_uM6Xc9ZHSfefERCjuehdw5SJuAn7MMs Oct 18 15:43:46.166240 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:43:46.166240 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:43:46.166240 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:43:46.166240 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:43:46.166240 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:43:46.166240 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:43:46.166240 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:43:46.166240 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:43:46.166240 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:43:46.166240 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:43:46.166240 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:43:46.166240 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:43:46.166240 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:43:46.166240 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:43:46.166240 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:43:46.166240 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:43:46.166240 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:43:46.166240 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 96c4378d52d1489bb2d50e84cabf95eb Oct 18 15:43:46.166240 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:43:46.166240 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:43:46.166240 n-d-853682-5 devstack@n-api.service[120406]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1813645148", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "6841167f-f8d7-4669-a9ea-cc4f48b5edd1", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "b55b6f02-72e3-4b31-a708-98b6291bed4c"}]}} Oct 18 15:43:46.166240 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:43:46.166240 n-d-853682-5 devstack@n-api.service[120406]: exception: Block Device 6841167f-f8d7-4669-a9ea-cc4f48b5edd1 is not bootable. Oct 18 15:43:46.166240 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1813645148', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '6841167f-f8d7-4669-a9ea-cc4f48b5edd1'}], 'networks': [{'uuid': 'b55b6f02-72e3-4b31-a708-98b6291bed4c'}]}}} Oct 18 15:43:46.166240 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:43:46.166240 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:46.166240 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 18 15:43:46.166240 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 18 15:43:46.166240 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 18 15:43:46.166240 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 18 15:43:46.166240 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 18 15:43:46.166240 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 18 15:43:46.166240 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 18 15:43:46.166240 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 18 15:43:46.166240 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 6841167f-f8d7-4669-a9ea-cc4f48b5edd1 is not bootable. Oct 18 15:43:46.166240 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:46.166240 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:43:46.166240 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:46.166240 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:46.166240 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:43:46.166240 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:43:46.166240 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:43:46.166240 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:43:46.166240 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:43:46.166240 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:43:46.166240 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:43:46.166240 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:43:46.166240 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:43:46.170254 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:43:46.170254 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:43:46.170254 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:43:46.170254 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 18 15:43:46.170254 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 18 15:43:46.170254 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 18 15:43:46.170254 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 6841167f-f8d7-4669-a9ea-cc4f48b5edd1 is not bootable. Oct 18 15:43:46.170254 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:46.170254 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:43:46.170254 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:46.170254 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:46.170254 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:43:46.170254 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:43:46.170254 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:43:46.170254 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:43:46.170254 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 6841167f-f8d7-4669-a9ea-cc4f48b5edd1 is not bootable. Oct 18 15:43:46.170254 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:46.170254 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-af012996-7743-4f4e-964f-ef290d1a153b tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Returning 400 to user: Block Device 6841167f-f8d7-4669-a9ea-cc4f48b5edd1 is not bootable. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:43:46.170254 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-af012996-7743-4f4e-964f-ef290d1a153b tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.214424 Oct 18 15:43:46.172583 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2077/4160] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:43:45 2022] POST /compute/v2.1/servers => generated 110 bytes in 221 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 18 15:43:46.189706 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e6743892-2821-44a2-8aca-1d7ab343a79e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:46.191504 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e6743892-2821-44a2-8aca-1d7ab343a79e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:46.207265 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6743892-2821-44a2-8aca-1d7ab343a79e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:46.208666 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6743892-2821-44a2-8aca-1d7ab343a79e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:46.209140 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6743892-2821-44a2-8aca-1d7ab343a79e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:46.209859 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6743892-2821-44a2-8aca-1d7ab343a79e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:46.210318 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6743892-2821-44a2-8aca-1d7ab343a79e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:46.210744 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6743892-2821-44a2-8aca-1d7ab343a79e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:46.567666 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-17a136dc-71de-4610-9bb9-25372cb247cc tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:46.576266 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-17a136dc-71de-4610-9bb9-25372cb247cc tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975" status: 200 len: 1523 microversion: 2.1 time: 0.616637 Oct 18 15:43:46.577486 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2084/4161] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:45 2022] GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975 => generated 1523 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:46.583670 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-b9daac48-bb94-442b-be73-280aab7425a3 req-2470ec9c-ebb9-4e0f-9766-4bfbc1561e9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6019a42-1115-4a7b-bfab-badb33cafed8", "name": "network-vif-plugged", "status": "completed", "tag": "ff5f4986-3641-402a-91e4-0dc5291f11fe"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:43:46.594976 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-b9daac48-bb94-442b-be73-280aab7425a3 req-2470ec9c-ebb9-4e0f-9766-4bfbc1561e9c service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:46.595662 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-b9daac48-bb94-442b-be73-280aab7425a3 req-2470ec9c-ebb9-4e0f-9766-4bfbc1561e9c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:46.596636 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-b9daac48-bb94-442b-be73-280aab7425a3 req-2470ec9c-ebb9-4e0f-9766-4bfbc1561e9c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:46.613526 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-b9daac48-bb94-442b-be73-280aab7425a3 req-2470ec9c-ebb9-4e0f-9766-4bfbc1561e9c service nova] Creating event network-vif-plugged:ff5f4986-3641-402a-91e4-0dc5291f11fe for instance e6019a42-1115-4a7b-bfab-badb33cafed8 on n-h1-853682-5 Oct 18 15:43:46.620753 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-b9daac48-bb94-442b-be73-280aab7425a3 req-2470ec9c-ebb9-4e0f-9766-4bfbc1561e9c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041627 Oct 18 15:43:46.622076 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2085/4162] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:43:46.824937 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b0335c03-ec69-471c-8431-6384c29291ee tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:46.827090 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b0335c03-ec69-471c-8431-6384c29291ee tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: e6019a42-1115-4a7b-bfab-badb33cafed8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:46.835229 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b0335c03-ec69-471c-8431-6384c29291ee tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:46.835980 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b0335c03-ec69-471c-8431-6384c29291ee tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:46.837266 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b0335c03-ec69-471c-8431-6384c29291ee tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:46.838187 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b0335c03-ec69-471c-8431-6384c29291ee tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:46.838800 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b0335c03-ec69-471c-8431-6384c29291ee tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:46.839379 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b0335c03-ec69-471c-8431-6384c29291ee tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:46.941679 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e6743892-2821-44a2-8aca-1d7ab343a79e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:46.956912 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e6743892-2821-44a2-8aca-1d7ab343a79e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.783572 Oct 18 15:43:46.957731 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2078/4163] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:46 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:46.981462 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-27632f91-81ee-4643-958c-99043fe74ce7 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:46.982333 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-27632f91-81ee-4643-958c-99043fe74ce7 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:46.990967 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-27632f91-81ee-4643-958c-99043fe74ce7 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:46.998609 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-27632f91-81ee-4643-958c-99043fe74ce7 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:46.999142 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-27632f91-81ee-4643-958c-99043fe74ce7 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:47.000639 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-27632f91-81ee-4643-958c-99043fe74ce7 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:47.001156 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-27632f91-81ee-4643-958c-99043fe74ce7 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:47.001705 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-27632f91-81ee-4643-958c-99043fe74ce7 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:47.382843 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b0335c03-ec69-471c-8431-6384c29291ee tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:47.394486 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b0335c03-ec69-471c-8431-6384c29291ee tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8" status: 200 len: 1313 microversion: 2.1 time: 0.574159 Oct 18 15:43:47.395878 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2086/4164] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:46 2022] GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8 => generated 1313 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:43:47.411266 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f1cc9223-59de-4ae0-80bb-f4430e8719f6 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:47.412013 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f1cc9223-59de-4ae0-80bb-f4430e8719f6 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 4a23be5e-9334-4385-9476-4bbd81995002] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:47.419119 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f1cc9223-59de-4ae0-80bb-f4430e8719f6 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:47.421229 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f1cc9223-59de-4ae0-80bb-f4430e8719f6 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:47.421889 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f1cc9223-59de-4ae0-80bb-f4430e8719f6 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:47.422840 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f1cc9223-59de-4ae0-80bb-f4430e8719f6 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:47.423514 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f1cc9223-59de-4ae0-80bb-f4430e8719f6 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:47.424162 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f1cc9223-59de-4ae0-80bb-f4430e8719f6 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:47.451406 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-f1cc9223-59de-4ae0-80bb-f4430e8719f6 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] HTTP exception thrown: Instance 4a23be5e-9334-4385-9476-4bbd81995002 could not be found. Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f1cc9223-59de-4ae0-80bb-f4430e8719f6 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Request method failure captured: Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: request: DELETE /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002 HTTP/1.1 Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsfD3tyC5zBBCs3PM6SgagJOA9ytEd34lT9my352h69qxn0wNQWvVVVEceKNcLlE8Cld2E1ewLfFQUA6X-zyH4NCgXE9isdDnVpnJB5BT1ljNdC07pganRFql9FpScM1-Xjt5su1w2IBkP6ZVV1NsRclcY3oY_ScUp2DhZs2W7X1y8Y Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: a5b55fd6668b481b8c578983dc655785 Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-AttachVolumeNegativeTest-1298357771 Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a5b55fd6668b481b8c578983dc655785"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a5b55fd6668b481b8c578983dc655785"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a5b55fd6668b481b8c578983dc655785"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a5b55fd6668b481b8c578983dc655785"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-AttachVolumeNegativeTest-1298357771 Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: a5b55fd6668b481b8c578983dc655785 Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1298357771 Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-AttachVolumeNegativeTest-1298357771-project Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: efec3b4b5b1c46bd9d2c0efa68f86979 Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-AttachVolumeNegativeTest-1298357771-project Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 4a23be5e-9334-4385-9476-4bbd81995002 could not be found. Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '4a23be5e-9334-4385-9476-4bbd81995002'} Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a23be5e-9334-4385-9476-4bbd81995002 could not be found. Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:43:47.454652 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:43:47.458779 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a23be5e-9334-4385-9476-4bbd81995002 could not be found. Oct 18 15:43:47.458779 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:47.458779 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:43:47.458779 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:47.458779 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:47.458779 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:43:47.458779 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:43:47.458779 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:43:47.458779 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:43:47.458779 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a23be5e-9334-4385-9476-4bbd81995002 could not be found. Oct 18 15:43:47.458779 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:47.462171 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f1cc9223-59de-4ae0-80bb-f4430e8719f6 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Returning 404 to user: Instance 4a23be5e-9334-4385-9476-4bbd81995002 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:43:47.463330 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f1cc9223-59de-4ae0-80bb-f4430e8719f6 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002" status: 404 len: 111 microversion: 2.1 time: 0.065728 Oct 18 15:43:47.469108 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2087/4165] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:43:47 2022] DELETE /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:43:47.477198 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c371fe1e-117f-4cc5-9ddd-76c5d46ba377 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:47.489804 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c371fe1e-117f-4cc5-9ddd-76c5d46ba377 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 4a23be5e-9334-4385-9476-4bbd81995002] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:47.496210 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c371fe1e-117f-4cc5-9ddd-76c5d46ba377 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:47.497041 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c371fe1e-117f-4cc5-9ddd-76c5d46ba377 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:47.497697 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c371fe1e-117f-4cc5-9ddd-76c5d46ba377 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:47.498639 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c371fe1e-117f-4cc5-9ddd-76c5d46ba377 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:47.499869 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c371fe1e-117f-4cc5-9ddd-76c5d46ba377 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:47.500625 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c371fe1e-117f-4cc5-9ddd-76c5d46ba377 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:47.510590 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-27632f91-81ee-4643-958c-99043fe74ce7 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:47.523044 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-27632f91-81ee-4643-958c-99043fe74ce7 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.545687 Oct 18 15:43:47.525154 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2079/4166] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:46 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:43:47.533529 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-c371fe1e-117f-4cc5-9ddd-76c5d46ba377 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] HTTP exception thrown: Instance 4a23be5e-9334-4385-9476-4bbd81995002 could not be found. Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c371fe1e-117f-4cc5-9ddd-76c5d46ba377 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Request method failure captured: Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002 HTTP/1.1 Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsfD3tyC5zBBCs3PM6SgagJOA9ytEd34lT9my352h69qxn0wNQWvVVVEceKNcLlE8Cld2E1ewLfFQUA6X-zyH4NCgXE9isdDnVpnJB5BT1ljNdC07pganRFql9FpScM1-Xjt5su1w2IBkP6ZVV1NsRclcY3oY_ScUp2DhZs2W7X1y8Y Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: a5b55fd6668b481b8c578983dc655785 Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-AttachVolumeNegativeTest-1298357771 Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a5b55fd6668b481b8c578983dc655785"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a5b55fd6668b481b8c578983dc655785"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a5b55fd6668b481b8c578983dc655785"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a5b55fd6668b481b8c578983dc655785"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-AttachVolumeNegativeTest-1298357771 Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: a5b55fd6668b481b8c578983dc655785 Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1298357771 Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-AttachVolumeNegativeTest-1298357771-project Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: efec3b4b5b1c46bd9d2c0efa68f86979 Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-AttachVolumeNegativeTest-1298357771-project Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 4a23be5e-9334-4385-9476-4bbd81995002 could not be found. Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '4a23be5e-9334-4385-9476-4bbd81995002'} Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a23be5e-9334-4385-9476-4bbd81995002 could not be found. Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a23be5e-9334-4385-9476-4bbd81995002 could not be found. Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:43:47.535421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:47.538832 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:47.538832 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:43:47.538832 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:43:47.538832 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:43:47.538832 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:43:47.538832 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a23be5e-9334-4385-9476-4bbd81995002 could not be found. Oct 18 15:43:47.538832 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:47.541925 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c371fe1e-117f-4cc5-9ddd-76c5d46ba377 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Returning 404 to user: Instance 4a23be5e-9334-4385-9476-4bbd81995002 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:43:47.544219 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c371fe1e-117f-4cc5-9ddd-76c5d46ba377 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002" status: 404 len: 111 microversion: 2.1 time: 0.071099 Oct 18 15:43:47.547169 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2088/4167] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:47 2022] GET /compute/v2.1/servers/4a23be5e-9334-4385-9476-4bbd81995002 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 15:43:47.557856 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c14a1632-e951-412d-9738-7e5d2fd868b6 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:47.558381 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c14a1632-e951-412d-9738-7e5d2fd868b6 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 57537212-8816-4122-adbe-264f7035a0e9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:47.569334 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c14a1632-e951-412d-9738-7e5d2fd868b6 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:47.571463 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c14a1632-e951-412d-9738-7e5d2fd868b6 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:47.572082 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c14a1632-e951-412d-9738-7e5d2fd868b6 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:47.572883 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c14a1632-e951-412d-9738-7e5d2fd868b6 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:47.573322 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c14a1632-e951-412d-9738-7e5d2fd868b6 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:47.578511 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c14a1632-e951-412d-9738-7e5d2fd868b6 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:47.600651 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-c14a1632-e951-412d-9738-7e5d2fd868b6 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] HTTP exception thrown: Instance 57537212-8816-4122-adbe-264f7035a0e9 could not be found. Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c14a1632-e951-412d-9738-7e5d2fd868b6 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Request method failure captured: Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9 HTTP/1.1 Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsfD3tyC5zBBCs3PM6SgagJOA9ytEd34lT9my352h69qxn0wNQWvVVVEceKNcLlE8Cld2E1ewLfFQUA6X-zyH4NCgXE9isdDnVpnJB5BT1ljNdC07pganRFql9FpScM1-Xjt5su1w2IBkP6ZVV1NsRclcY3oY_ScUp2DhZs2W7X1y8Y Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: a5b55fd6668b481b8c578983dc655785 Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-AttachVolumeNegativeTest-1298357771 Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a5b55fd6668b481b8c578983dc655785"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a5b55fd6668b481b8c578983dc655785"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a5b55fd6668b481b8c578983dc655785"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a5b55fd6668b481b8c578983dc655785"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-AttachVolumeNegativeTest-1298357771 Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: a5b55fd6668b481b8c578983dc655785 Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1298357771 Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-AttachVolumeNegativeTest-1298357771-project Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: efec3b4b5b1c46bd9d2c0efa68f86979 Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-AttachVolumeNegativeTest-1298357771-project Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 57537212-8816-4122-adbe-264f7035a0e9 could not be found. Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '57537212-8816-4122-adbe-264f7035a0e9'} Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57537212-8816-4122-adbe-264f7035a0e9 could not be found. Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:43:47.602520 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:43:47.606302 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57537212-8816-4122-adbe-264f7035a0e9 could not be found. Oct 18 15:43:47.606302 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:47.606302 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:43:47.606302 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:47.606302 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:47.606302 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:43:47.606302 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:43:47.606302 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:43:47.606302 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:43:47.606302 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57537212-8816-4122-adbe-264f7035a0e9 could not be found. Oct 18 15:43:47.606302 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:47.608188 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a4c2c34c-5ab3-4b88-892c-28ceea41d2ea tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:47.608188 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a4c2c34c-5ab3-4b88-892c-28ceea41d2ea tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: a49f5b92-61e2-44bd-92a9-2bbaa1fb8975] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:47.609448 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c14a1632-e951-412d-9738-7e5d2fd868b6 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Returning 404 to user: Instance 57537212-8816-4122-adbe-264f7035a0e9 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:43:47.610689 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c14a1632-e951-412d-9738-7e5d2fd868b6 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "DELETE /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9" status: 404 len: 111 microversion: 2.1 time: 0.059009 Oct 18 15:43:47.611798 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2080/4168] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:43:47 2022] DELETE /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:43:47.616539 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a4c2c34c-5ab3-4b88-892c-28ceea41d2ea tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:47.617067 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a4c2c34c-5ab3-4b88-892c-28ceea41d2ea tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:47.617516 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a4c2c34c-5ab3-4b88-892c-28ceea41d2ea tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:47.618245 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a4c2c34c-5ab3-4b88-892c-28ceea41d2ea tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:47.618911 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a4c2c34c-5ab3-4b88-892c-28ceea41d2ea tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:47.620080 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a4c2c34c-5ab3-4b88-892c-28ceea41d2ea tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:47.629033 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0af3ca92-a945-4751-b22c-4fa9d47682ab tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:47.630144 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0af3ca92-a945-4751-b22c-4fa9d47682ab tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 57537212-8816-4122-adbe-264f7035a0e9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:47.642622 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0af3ca92-a945-4751-b22c-4fa9d47682ab tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:47.650563 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0af3ca92-a945-4751-b22c-4fa9d47682ab tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:47.651460 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0af3ca92-a945-4751-b22c-4fa9d47682ab tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:47.652427 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0af3ca92-a945-4751-b22c-4fa9d47682ab tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:47.653174 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0af3ca92-a945-4751-b22c-4fa9d47682ab tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:47.654092 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0af3ca92-a945-4751-b22c-4fa9d47682ab tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:47.675996 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-0af3ca92-a945-4751-b22c-4fa9d47682ab tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] HTTP exception thrown: Instance 57537212-8816-4122-adbe-264f7035a0e9 could not be found. Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0af3ca92-a945-4751-b22c-4fa9d47682ab tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Request method failure captured: Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9 HTTP/1.1 Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsfD3tyC5zBBCs3PM6SgagJOA9ytEd34lT9my352h69qxn0wNQWvVVVEceKNcLlE8Cld2E1ewLfFQUA6X-zyH4NCgXE9isdDnVpnJB5BT1ljNdC07pganRFql9FpScM1-Xjt5su1w2IBkP6ZVV1NsRclcY3oY_ScUp2DhZs2W7X1y8Y Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: a5b55fd6668b481b8c578983dc655785 Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-AttachVolumeNegativeTest-1298357771 Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a5b55fd6668b481b8c578983dc655785"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a5b55fd6668b481b8c578983dc655785"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a5b55fd6668b481b8c578983dc655785"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a5b55fd6668b481b8c578983dc655785"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-AttachVolumeNegativeTest-1298357771 Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: a5b55fd6668b481b8c578983dc655785 Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1298357771 Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-AttachVolumeNegativeTest-1298357771-project Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: efec3b4b5b1c46bd9d2c0efa68f86979 Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-AttachVolumeNegativeTest-1298357771-project Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 57537212-8816-4122-adbe-264f7035a0e9 could not be found. Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '57537212-8816-4122-adbe-264f7035a0e9'} Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57537212-8816-4122-adbe-264f7035a0e9 could not be found. Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57537212-8816-4122-adbe-264f7035a0e9 could not be found. Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:43:47.677882 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:47.681764 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:47.681764 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:43:47.681764 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:43:47.681764 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:43:47.681764 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:43:47.681764 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57537212-8816-4122-adbe-264f7035a0e9 could not be found. Oct 18 15:43:47.681764 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:47.683722 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0af3ca92-a945-4751-b22c-4fa9d47682ab tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Returning 404 to user: Instance 57537212-8816-4122-adbe-264f7035a0e9 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:43:47.685001 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0af3ca92-a945-4751-b22c-4fa9d47682ab tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9" status: 404 len: 111 microversion: 2.1 time: 0.066593 Oct 18 15:43:47.686080 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2081/4169] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:47 2022] GET /compute/v2.1/servers/57537212-8816-4122-adbe-264f7035a0e9 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:43:48.427632 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1ad55d60-c15e-471d-8061-28e93cf8d38a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:48.430674 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1ad55d60-c15e-471d-8061-28e93cf8d38a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: e6019a42-1115-4a7b-bfab-badb33cafed8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:48.446725 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ad55d60-c15e-471d-8061-28e93cf8d38a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:48.447611 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ad55d60-c15e-471d-8061-28e93cf8d38a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:48.448246 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ad55d60-c15e-471d-8061-28e93cf8d38a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:48.449207 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ad55d60-c15e-471d-8061-28e93cf8d38a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:48.449901 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ad55d60-c15e-471d-8061-28e93cf8d38a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:48.451425 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ad55d60-c15e-471d-8061-28e93cf8d38a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:48.685837 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a4c2c34c-5ab3-4b88-892c-28ceea41d2ea tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:48.695733 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a4c2c34c-5ab3-4b88-892c-28ceea41d2ea tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975" status: 200 len: 1523 microversion: 2.1 time: 1.095206 Oct 18 15:43:48.696330 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2089/4170] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:47 2022] GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975 => generated 1523 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:48.763621 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1ad55d60-c15e-471d-8061-28e93cf8d38a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:48.781048 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1ad55d60-c15e-471d-8061-28e93cf8d38a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8" status: 200 len: 1501 microversion: 2.1 time: 0.362592 Oct 18 15:43:48.784708 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2082/4171] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:48 2022] GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8 => generated 1501 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:48.813715 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ee0ed7a5-dfff-4020-bb27-8c5706a9a69f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:43:48.830249 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ee0ed7a5-dfff-4020-bb27-8c5706a9a69f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:48.844181 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ee0ed7a5-dfff-4020-bb27-8c5706a9a69f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:48.845124 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ee0ed7a5-dfff-4020-bb27-8c5706a9a69f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:48.926317 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ee0ed7a5-dfff-4020-bb27-8c5706a9a69f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: e6019a42-1115-4a7b-bfab-badb33cafed8] Going to try to stop instance {{(pid=120405) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 18 15:43:49.081563 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ee0ed7a5-dfff-4020-bb27-8c5706a9a69f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "POST /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8/action" status: 202 len: 0 microversion: 2.1 time: 0.279182 Oct 18 15:43:49.088890 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2090/4172] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:43:48 2022] POST /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8/action => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:43:49.101823 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7e0b2715-b921-40ba-ad54-4028d9f6540a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:49.102645 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7e0b2715-b921-40ba-ad54-4028d9f6540a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: e6019a42-1115-4a7b-bfab-badb33cafed8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:49.129308 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e0b2715-b921-40ba-ad54-4028d9f6540a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:49.130180 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e0b2715-b921-40ba-ad54-4028d9f6540a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:49.131443 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e0b2715-b921-40ba-ad54-4028d9f6540a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:49.132840 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e0b2715-b921-40ba-ad54-4028d9f6540a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:49.133544 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e0b2715-b921-40ba-ad54-4028d9f6540a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:49.134242 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e0b2715-b921-40ba-ad54-4028d9f6540a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:49.425195 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7e0b2715-b921-40ba-ad54-4028d9f6540a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:49.435538 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7e0b2715-b921-40ba-ad54-4028d9f6540a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8" status: 200 len: 1511 microversion: 2.1 time: 0.345436 Oct 18 15:43:49.438030 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2083/4173] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:49 2022] GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8 => generated 1511 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:49.724882 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4eba40cd-fda0-49bc-bb20-7b7abc6f58a5 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:49.725221 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bcf6b61b-e6dd-459d-96e9-e4d8c429736e tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:49.726928 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4eba40cd-fda0-49bc-bb20-7b7abc6f58a5 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: a49f5b92-61e2-44bd-92a9-2bbaa1fb8975] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:49.731334 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-bcf6b61b-e6dd-459d-96e9-e4d8c429736e tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 55179126-a629-4bb3-82f5-14606ec63426] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:49.763856 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4eba40cd-fda0-49bc-bb20-7b7abc6f58a5 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:49.764485 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4eba40cd-fda0-49bc-bb20-7b7abc6f58a5 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:49.765115 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4eba40cd-fda0-49bc-bb20-7b7abc6f58a5 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:49.768972 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bcf6b61b-e6dd-459d-96e9-e4d8c429736e tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:49.770457 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4eba40cd-fda0-49bc-bb20-7b7abc6f58a5 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:49.773175 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bcf6b61b-e6dd-459d-96e9-e4d8c429736e tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:49.773693 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4eba40cd-fda0-49bc-bb20-7b7abc6f58a5 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:49.774435 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bcf6b61b-e6dd-459d-96e9-e4d8c429736e tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:49.775287 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bcf6b61b-e6dd-459d-96e9-e4d8c429736e tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:49.775765 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bcf6b61b-e6dd-459d-96e9-e4d8c429736e tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:49.776604 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bcf6b61b-e6dd-459d-96e9-e4d8c429736e tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:49.785227 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4eba40cd-fda0-49bc-bb20-7b7abc6f58a5 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:49.849200 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-bcf6b61b-e6dd-459d-96e9-e4d8c429736e tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137019 Oct 18 15:43:49.850464 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2091/4174] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 15:43:49 2022] GET /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:43:49.863160 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b9e3a6c3-b1d3-411f-9eac-c96d39cca46c tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:49.864231 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b9e3a6c3-b1d3-411f-9eac-c96d39cca46c tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 55179126-a629-4bb3-82f5-14606ec63426] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:49.872328 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b9e3a6c3-b1d3-411f-9eac-c96d39cca46c tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:49.873075 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b9e3a6c3-b1d3-411f-9eac-c96d39cca46c tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:49.873702 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b9e3a6c3-b1d3-411f-9eac-c96d39cca46c tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:49.875996 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b9e3a6c3-b1d3-411f-9eac-c96d39cca46c tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:49.876737 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b9e3a6c3-b1d3-411f-9eac-c96d39cca46c tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:49.877394 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b9e3a6c3-b1d3-411f-9eac-c96d39cca46c tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:49.948234 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b9e3a6c3-b1d3-411f-9eac-c96d39cca46c tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426/os-volume_attachments/2ea9584b-82af-4b4e-ae12-2544834fe35b" status: 200 len: 194 microversion: 2.1 time: 0.090968 Oct 18 15:43:49.950061 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2092/4175] 10.222.0.60 () {58 vars in 1413 bytes} [Tue Oct 18 15:43:49 2022] GET /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426/os-volume_attachments/2ea9584b-82af-4b4e-ae12-2544834fe35b => generated 194 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:43:50.464534 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-849ef826-2855-40b2-86c0-e63994b36aac tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:50.465329 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-849ef826-2855-40b2-86c0-e63994b36aac tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: e6019a42-1115-4a7b-bfab-badb33cafed8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:50.480692 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-849ef826-2855-40b2-86c0-e63994b36aac tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:50.481385 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-849ef826-2855-40b2-86c0-e63994b36aac tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:50.481934 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-849ef826-2855-40b2-86c0-e63994b36aac tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:50.482753 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-849ef826-2855-40b2-86c0-e63994b36aac tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:50.483756 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-849ef826-2855-40b2-86c0-e63994b36aac tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:50.485279 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-849ef826-2855-40b2-86c0-e63994b36aac tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:50.671740 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4eba40cd-fda0-49bc-bb20-7b7abc6f58a5 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:50.692517 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4eba40cd-fda0-49bc-bb20-7b7abc6f58a5 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975" status: 200 len: 1523 microversion: 2.1 time: 0.974624 Oct 18 15:43:50.706410 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2084/4176] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:49 2022] GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975 => generated 1523 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:50.729478 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-65735d91-328d-428e-be83-18c99293cd9f tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-401821408", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "destination_type": "local"}, {"source_type": "volume", "uuid": "52423695-dbf9-41e5-ae40-138eac66f2ba", "destination_type": "invalid"}], "networks": [{"uuid": "b55b6f02-72e3-4b31-a708-98b6291bed4c"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:43:50.750307 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-65735d91-328d-428e-be83-18c99293cd9f tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Request method failure captured: Oct 18 15:43:50.750307 n-d-853682-5 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 15:43:50.750307 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:43:50.750307 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:43:50.750307 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:43:50.750307 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 494 Oct 18 15:43:50.750307 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:43:50.750307 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:43:50.750307 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:43:50.750307 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:43:50.750307 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTslxbnvpe5yiGf5CWZMgShC81OiGKrcSLYZFSWKOLbaqqF5kNJvh8cijdldsPo1OHjHXDcbdPuhTuFRNRswVq0HwpXLNCfOWcF3GU1M8LHkZwXu6ScaOEIHyQ8ewFnAFL7TXd1O14t3atsv_uM6Xc9ZHSfefERCjuehdw5SJuAn7MMs Oct 18 15:43:50.750307 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:43:50.750307 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:43:50.750307 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:43:50.750307 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:43:50.750307 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:43:50.750307 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:43:50.750307 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:43:50.750307 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:43:50.750307 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:43:50.750307 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:43:50.750307 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:43:50.750307 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:43:50.750307 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:43:50.750307 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:43:50.750307 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:43:50.750307 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:43:50.750307 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:43:50.750307 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 96c4378d52d1489bb2d50e84cabf95eb Oct 18 15:43:50.750307 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:43:50.750307 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:43:50.750307 n-d-853682-5 devstack@n-api.service[120406]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-401821408", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "destination_type": "local"}, {"source_type": "volume", "uuid": "52423695-dbf9-41e5-ae40-138eac66f2ba", "destination_type": "invalid"}], "networks": [{"uuid": "b55b6f02-72e3-4b31-a708-98b6291bed4c"}]}} Oct 18 15:43:50.750307 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:43:50.750307 n-d-853682-5 devstack@n-api.service[120406]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 18 15:43:50.750307 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-401821408', 'imageRef': '8f4db252-bff6-4685-9c8d-4c5d6bd9f78b', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '8f4db252-bff6-4685-9c8d-4c5d6bd9f78b', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '52423695-dbf9-41e5-ae40-138eac66f2ba', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'b55b6f02-72e3-4b31-a708-98b6291bed4c'}]}}} Oct 18 15:43:50.750307 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:43:50.750307 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:50.750307 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 15:43:50.750307 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 15:43:50.750307 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 15:43:50.750307 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise error Oct 18 15:43:50.750307 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 18 15:43:50.750307 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:50.750307 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 18 15:43:50.750307 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 18 15:43:50.750307 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:50.750307 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 18 15:43:50.750307 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'invalid' Oct 18 15:43:50.750307 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:50.750307 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:43:50.750307 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:50.750307 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:50.750307 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:43:50.750307 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:43:50.750307 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:43:50.750307 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:43:50.750307 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:43:50.750307 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:43:50.754127 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:43:50.754127 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:43:50.754127 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 15:43:50.754127 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 15:43:50.754127 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 15:43:50.754127 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 15:43:50.754127 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 15:43:50.754127 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 15:43:50.754127 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 18 15:43:50.754127 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:50.754127 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:43:50.754127 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:50.754127 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:50.754127 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:43:50.754127 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:43:50.754127 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 15:43:50.754127 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 15:43:50.754127 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 18 15:43:50.754127 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:50.759637 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-65735d91-328d-428e-be83-18c99293cd9f tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:43:50.760696 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-65735d91-328d-428e-be83-18c99293cd9f tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.050051 Oct 18 15:43:50.761528 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2085/4177] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:43:50 2022] POST /compute/v2.1/servers => generated 155 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:43:50.781508 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c3f1dd13-2864-48fb-a9ff-595bf2fe3b2f tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:50.785049 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c3f1dd13-2864-48fb-a9ff-595bf2fe3b2f tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:50.808779 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3f1dd13-2864-48fb-a9ff-595bf2fe3b2f tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:50.810281 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3f1dd13-2864-48fb-a9ff-595bf2fe3b2f tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:50.811971 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3f1dd13-2864-48fb-a9ff-595bf2fe3b2f tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:50.814402 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3f1dd13-2864-48fb-a9ff-595bf2fe3b2f tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:50.829725 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3f1dd13-2864-48fb-a9ff-595bf2fe3b2f tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:50.830326 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3f1dd13-2864-48fb-a9ff-595bf2fe3b2f tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:50.967441 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-849ef826-2855-40b2-86c0-e63994b36aac tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:50.984248 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-849ef826-2855-40b2-86c0-e63994b36aac tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8" status: 200 len: 1511 microversion: 2.1 time: 0.521565 Oct 18 15:43:50.984893 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2093/4178] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:50 2022] GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8 => generated 1511 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:43:51.306943 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c3f1dd13-2864-48fb-a9ff-595bf2fe3b2f tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:51.315906 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c3f1dd13-2864-48fb-a9ff-595bf2fe3b2f tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.546312 Oct 18 15:43:51.316487 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2086/4179] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:50 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:51.342089 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-db22d91b-8455-4f80-a1b1-cc70bcd5bfc9 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:51.342805 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-db22d91b-8455-4f80-a1b1-cc70bcd5bfc9 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:51.355188 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-db22d91b-8455-4f80-a1b1-cc70bcd5bfc9 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:51.355678 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-db22d91b-8455-4f80-a1b1-cc70bcd5bfc9 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:51.357387 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-db22d91b-8455-4f80-a1b1-cc70bcd5bfc9 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:51.358303 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-db22d91b-8455-4f80-a1b1-cc70bcd5bfc9 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:51.358908 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-db22d91b-8455-4f80-a1b1-cc70bcd5bfc9 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:51.360489 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-db22d91b-8455-4f80-a1b1-cc70bcd5bfc9 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:51.732907 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-254bf816-f7e6-4086-888d-7e0b7db5eb31 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:51.734721 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-254bf816-f7e6-4086-888d-7e0b7db5eb31 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: a49f5b92-61e2-44bd-92a9-2bbaa1fb8975] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:51.745139 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-254bf816-f7e6-4086-888d-7e0b7db5eb31 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:51.746114 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-254bf816-f7e6-4086-888d-7e0b7db5eb31 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:51.748497 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-254bf816-f7e6-4086-888d-7e0b7db5eb31 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:51.751655 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-254bf816-f7e6-4086-888d-7e0b7db5eb31 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:51.753857 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-254bf816-f7e6-4086-888d-7e0b7db5eb31 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:51.754730 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-254bf816-f7e6-4086-888d-7e0b7db5eb31 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:52.133854 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-db22d91b-8455-4f80-a1b1-cc70bcd5bfc9 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:52.146302 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-db22d91b-8455-4f80-a1b1-cc70bcd5bfc9 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.808493 Oct 18 15:43:52.147013 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2094/4180] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:51 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:52.159585 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b0a8f538-5b5a-4106-9ef5-582e5658d2b6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:52.160215 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b0a8f538-5b5a-4106-9ef5-582e5658d2b6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: e6019a42-1115-4a7b-bfab-badb33cafed8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:52.175299 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b0a8f538-5b5a-4106-9ef5-582e5658d2b6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:52.175712 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b0a8f538-5b5a-4106-9ef5-582e5658d2b6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:52.176159 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b0a8f538-5b5a-4106-9ef5-582e5658d2b6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:52.176904 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b0a8f538-5b5a-4106-9ef5-582e5658d2b6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:52.177374 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b0a8f538-5b5a-4106-9ef5-582e5658d2b6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:52.177815 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b0a8f538-5b5a-4106-9ef5-582e5658d2b6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:52.271810 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-254bf816-f7e6-4086-888d-7e0b7db5eb31 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:52.282346 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-254bf816-f7e6-4086-888d-7e0b7db5eb31 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975" status: 200 len: 1523 microversion: 2.1 time: 0.553354 Oct 18 15:43:52.287085 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2087/4181] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:51 2022] GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975 => generated 1523 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:52.447172 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2c356c4c-e774-46f7-9e6b-1e01f2f8213c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-164997326", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "b55b6f02-72e3-4b31-a708-98b6291bed4c"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:43:52.456048 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2c356c4c-e774-46f7-9e6b-1e01f2f8213c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Request method failure captured: Oct 18 15:43:52.456048 n-d-853682-5 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 15:43:52.456048 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:43:52.456048 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:43:52.456048 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:43:52.456048 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 491 Oct 18 15:43:52.456048 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:43:52.456048 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:43:52.456048 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:43:52.456048 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:43:52.456048 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTslxbnvpe5yiGf5CWZMgShC81OiGKrcSLYZFSWKOLbaqqF5kNJvh8cijdldsPo1OHjHXDcbdPuhTuFRNRswVq0HwpXLNCfOWcF3GU1M8LHkZwXu6ScaOEIHyQ8ewFnAFL7TXd1O14t3atsv_uM6Xc9ZHSfefERCjuehdw5SJuAn7MMs Oct 18 15:43:52.456048 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:43:52.456048 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:43:52.456048 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:43:52.456048 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:43:52.456048 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:43:52.456048 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:43:52.456048 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:43:52.456048 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:43:52.456048 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:43:52.456048 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:43:52.456048 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:43:52.456048 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:43:52.456048 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:43:52.456048 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:43:52.456048 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:43:52.456048 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:43:52.456048 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:43:52.456048 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 96c4378d52d1489bb2d50e84cabf95eb Oct 18 15:43:52.456048 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:43:52.456048 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:43:52.456048 n-d-853682-5 devstack@n-api.service[120406]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-164997326", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "b55b6f02-72e3-4b31-a708-98b6291bed4c"}]}} Oct 18 15:43:52.456048 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:43:52.456048 n-d-853682-5 devstack@n-api.service[120406]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 18 15:43:52.456048 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-164997326', 'imageRef': '8f4db252-bff6-4685-9c8d-4c5d6bd9f78b', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': 'b55b6f02-72e3-4b31-a708-98b6291bed4c'}]}}} Oct 18 15:43:52.456048 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:43:52.456048 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:52.456048 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 15:43:52.456048 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 15:43:52.456048 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 15:43:52.456048 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise error Oct 18 15:43:52.456048 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 18 15:43:52.456048 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:52.456048 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 18 15:43:52.456048 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 18 15:43:52.456048 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:52.456048 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 18 15:43:52.462163 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 18 15:43:52.462163 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:52.462163 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:43:52.462163 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:52.462163 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:52.462163 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:43:52.462163 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:43:52.462163 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:43:52.462163 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:43:52.462163 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:43:52.462163 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:43:52.462163 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:43:52.462163 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:43:52.462163 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 15:43:52.462163 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 15:43:52.462163 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 15:43:52.462163 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 15:43:52.462163 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 15:43:52.462163 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 15:43:52.462163 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 18 15:43:52.462163 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:52.462163 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:43:52.462163 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:52.462163 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:52.462163 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:43:52.462163 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:43:52.462163 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 15:43:52.462163 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 15:43:52.462163 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 18 15:43:52.462163 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:52.462163 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2c356c4c-e774-46f7-9e6b-1e01f2f8213c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:43:52.462163 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2c356c4c-e774-46f7-9e6b-1e01f2f8213c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.014913 Oct 18 15:43:52.462163 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2088/4182] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:43:52 2022] POST /compute/v2.1/servers => generated 624 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:43:52.484189 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b0a8f538-5b5a-4106-9ef5-582e5658d2b6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:52.487360 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-052b7aa5-54fc-486b-831c-dbe55d3c5eaa tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:52.487996 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-052b7aa5-54fc-486b-831c-dbe55d3c5eaa tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:52.502695 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b0a8f538-5b5a-4106-9ef5-582e5658d2b6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8" status: 200 len: 1511 microversion: 2.1 time: 0.354462 Oct 18 15:43:52.505173 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2095/4183] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:52 2022] GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8 => generated 1511 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:52.506250 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-052b7aa5-54fc-486b-831c-dbe55d3c5eaa tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:52.507109 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-052b7aa5-54fc-486b-831c-dbe55d3c5eaa tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:52.520972 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-052b7aa5-54fc-486b-831c-dbe55d3c5eaa tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:52.520972 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-052b7aa5-54fc-486b-831c-dbe55d3c5eaa tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:52.520972 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-052b7aa5-54fc-486b-831c-dbe55d3c5eaa tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:52.520972 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-052b7aa5-54fc-486b-831c-dbe55d3c5eaa tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:52.533812 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:43:52.821785 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-96fccde9-e212-459e-a218-ceb4c56a2c16 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f3125de0-86fe-4b6f-9de6-798cd8427ae7"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:43:52.824901 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-96fccde9-e212-459e-a218-ceb4c56a2c16 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 55179126-a629-4bb3-82f5-14606ec63426] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:52.834099 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-96fccde9-e212-459e-a218-ceb4c56a2c16 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:52.834946 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-96fccde9-e212-459e-a218-ceb4c56a2c16 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:52.835693 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-96fccde9-e212-459e-a218-ceb4c56a2c16 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:52.836556 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-96fccde9-e212-459e-a218-ceb4c56a2c16 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:52.837220 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-96fccde9-e212-459e-a218-ceb4c56a2c16 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:52.837816 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-96fccde9-e212-459e-a218-ceb4c56a2c16 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:53.206854 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-052b7aa5-54fc-486b-831c-dbe55d3c5eaa tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:53.217305 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-052b7aa5-54fc-486b-831c-dbe55d3c5eaa tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.754645 Oct 18 15:43:53.217934 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2089/4184] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:52 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:53.253285 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0a79c839-c57c-44ae-a486-50a4cc1b07ef tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:53.254347 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0a79c839-c57c-44ae-a486-50a4cc1b07ef tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:53.260999 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a79c839-c57c-44ae-a486-50a4cc1b07ef tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:53.261780 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a79c839-c57c-44ae-a486-50a4cc1b07ef tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:53.262411 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a79c839-c57c-44ae-a486-50a4cc1b07ef tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:53.268301 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a79c839-c57c-44ae-a486-50a4cc1b07ef tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:53.269112 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a79c839-c57c-44ae-a486-50a4cc1b07ef tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:53.269768 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a79c839-c57c-44ae-a486-50a4cc1b07ef tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:53.299710 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-96fccde9-e212-459e-a218-ceb4c56a2c16 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "POST /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.483878 Oct 18 15:43:53.300997 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2096/4185] 10.222.0.60 () {60 vars in 1323 bytes} [Tue Oct 18 15:43:52 2022] POST /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426/os-volume_attachments => generated 194 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:43:53.345239 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-220f2059-030d-4ad3-9000-9a05a2d4626a tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:53.346841 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-220f2059-030d-4ad3-9000-9a05a2d4626a tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: a49f5b92-61e2-44bd-92a9-2bbaa1fb8975] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:53.362783 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-220f2059-030d-4ad3-9000-9a05a2d4626a tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:53.363281 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-220f2059-030d-4ad3-9000-9a05a2d4626a tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:53.363722 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-220f2059-030d-4ad3-9000-9a05a2d4626a tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:53.369931 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-220f2059-030d-4ad3-9000-9a05a2d4626a tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:53.370437 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-220f2059-030d-4ad3-9000-9a05a2d4626a tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:53.370890 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-220f2059-030d-4ad3-9000-9a05a2d4626a tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:53.752339 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0a79c839-c57c-44ae-a486-50a4cc1b07ef tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:53.762508 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0a79c839-c57c-44ae-a486-50a4cc1b07ef tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.524236 Oct 18 15:43:53.766059 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2090/4186] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:53 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:53.778412 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-68f5c12e-3fb1-4945-9243-14d952954700 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:53.783551 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-68f5c12e-3fb1-4945-9243-14d952954700 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 511cbc18-aef9-4202-9616-decd6651e931] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:53.802094 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68f5c12e-3fb1-4945-9243-14d952954700 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:53.803091 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68f5c12e-3fb1-4945-9243-14d952954700 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:53.804695 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68f5c12e-3fb1-4945-9243-14d952954700 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:53.806205 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68f5c12e-3fb1-4945-9243-14d952954700 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:53.807956 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68f5c12e-3fb1-4945-9243-14d952954700 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:53.809709 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68f5c12e-3fb1-4945-9243-14d952954700 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:53.860018 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-68f5c12e-3fb1-4945-9243-14d952954700 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] HTTP exception thrown: Instance 511cbc18-aef9-4202-9616-decd6651e931 could not be found. Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-68f5c12e-3fb1-4945-9243-14d952954700 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Request method failure captured: Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/511cbc18-aef9-4202-9616-decd6651e931 HTTP/1.1 Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsfD3tyC5zBBCs3PM6SgagJOA9ytEd34lT9my352h69qxn0wNQWvVVVEceKNcLlE8Cld2E1ewLfFQUA6X-zyH4NCgXE9isdDnVpnJB5BT1ljNdC07pganRFql9FpScM1-Xjt5su1w2IBkP6ZVV1NsRclcY3oY_ScUp2DhZs2W7X1y8Y Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: a5b55fd6668b481b8c578983dc655785 Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-AttachVolumeNegativeTest-1298357771 Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a5b55fd6668b481b8c578983dc655785"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a5b55fd6668b481b8c578983dc655785"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a5b55fd6668b481b8c578983dc655785"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a5b55fd6668b481b8c578983dc655785"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-AttachVolumeNegativeTest-1298357771 Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: a5b55fd6668b481b8c578983dc655785 Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1298357771 Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-AttachVolumeNegativeTest-1298357771-project Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: efec3b4b5b1c46bd9d2c0efa68f86979 Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-AttachVolumeNegativeTest-1298357771-project Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 511cbc18-aef9-4202-9616-decd6651e931 could not be found. Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '511cbc18-aef9-4202-9616-decd6651e931'} Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 511cbc18-aef9-4202-9616-decd6651e931 could not be found. Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:43:53.866894 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:43:53.872223 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 511cbc18-aef9-4202-9616-decd6651e931 could not be found. Oct 18 15:43:53.872223 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:53.872223 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:43:53.872223 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:53.872223 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:53.872223 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:43:53.872223 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:43:53.872223 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:43:53.872223 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:43:53.872223 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 511cbc18-aef9-4202-9616-decd6651e931 could not be found. Oct 18 15:43:53.872223 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:53.872223 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-68f5c12e-3fb1-4945-9243-14d952954700 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Returning 404 to user: Instance 511cbc18-aef9-4202-9616-decd6651e931 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:43:53.872927 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-68f5c12e-3fb1-4945-9243-14d952954700 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "DELETE /compute/v2.1/servers/511cbc18-aef9-4202-9616-decd6651e931" status: 404 len: 111 microversion: 2.1 time: 0.102674 Oct 18 15:43:53.877816 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2091/4187] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:43:53 2022] DELETE /compute/v2.1/servers/511cbc18-aef9-4202-9616-decd6651e931 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:43:53.886235 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-256941a1-58c5-4c72-8eb6-e8da6ad9fe53 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:53.887215 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-256941a1-58c5-4c72-8eb6-e8da6ad9fe53 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: e6019a42-1115-4a7b-bfab-badb33cafed8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:53.897192 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-256941a1-58c5-4c72-8eb6-e8da6ad9fe53 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:53.897937 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-256941a1-58c5-4c72-8eb6-e8da6ad9fe53 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:53.899556 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-256941a1-58c5-4c72-8eb6-e8da6ad9fe53 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:53.900495 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-256941a1-58c5-4c72-8eb6-e8da6ad9fe53 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:53.901145 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-256941a1-58c5-4c72-8eb6-e8da6ad9fe53 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:53.902338 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-256941a1-58c5-4c72-8eb6-e8da6ad9fe53 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:53.905793 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-220f2059-030d-4ad3-9000-9a05a2d4626a tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:53.914153 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-220f2059-030d-4ad3-9000-9a05a2d4626a tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975" status: 200 len: 1523 microversion: 2.1 time: 0.591866 Oct 18 15:43:53.916195 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2097/4188] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:53 2022] GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975 => generated 1523 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:53.924630 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-40d51b92-4631-47a5-b6b6-e2227ea0f10a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:53.929814 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-40d51b92-4631-47a5-b6b6-e2227ea0f10a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:53.942759 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-40d51b92-4631-47a5-b6b6-e2227ea0f10a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:53.943564 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-40d51b92-4631-47a5-b6b6-e2227ea0f10a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:53.944160 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-40d51b92-4631-47a5-b6b6-e2227ea0f10a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:53.945913 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-40d51b92-4631-47a5-b6b6-e2227ea0f10a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:53.947325 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-40d51b92-4631-47a5-b6b6-e2227ea0f10a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:53.948118 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-40d51b92-4631-47a5-b6b6-e2227ea0f10a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:53.955335 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:43:53.977510 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-40d51b92-4631-47a5-b6b6-e2227ea0f10a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] HTTP exception thrown: Instance cf8f81da-4aa0-498d-af1e-c036238f065d could not be found. Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-40d51b92-4631-47a5-b6b6-e2227ea0f10a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Request method failure captured: Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: request: DELETE /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d HTTP/1.1 Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsgpmW1nRLv2ldegpMEiqyvhmI_h11cRUxAU83yp9iCJZEEiUJ9NEmO3aMb5ICfxfLcu5x9IUh4Ze6tqcUucvaYXl8-OM3DqhAXbxh7Yfus4CG68HAGEMQeFfoX58DdYP6Tt4-7t8pDwuClxmIsR5tOrridVHyiweY1UXXU_oCFTyTM Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: X-Openstack-Nova-Api-Version: 2.32 Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 1a67d76e7f824ee99302b9efb7d36e2f Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-TaggedBootDevicesTest-1462456838 Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1a67d76e7f824ee99302b9efb7d36e2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1a67d76e7f824ee99302b9efb7d36e2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1a67d76e7f824ee99302b9efb7d36e2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1a67d76e7f824ee99302b9efb7d36e2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-TaggedBootDevicesTest-1462456838 Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 1a67d76e7f824ee99302b9efb7d36e2f Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1462456838 Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-TaggedBootDevicesTest-1462456838-project Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: ccc5106861284e12aa81c7a28e024a1b Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-TaggedBootDevicesTest-1462456838-project Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance cf8f81da-4aa0-498d-af1e-c036238f065d could not be found. Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'cf8f81da-4aa0-498d-af1e-c036238f065d'} Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf8f81da-4aa0-498d-af1e-c036238f065d could not be found. Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:43:53.979637 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:43:53.983494 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf8f81da-4aa0-498d-af1e-c036238f065d could not be found. Oct 18 15:43:53.983494 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:53.983494 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:43:53.983494 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:53.983494 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:53.983494 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:43:53.983494 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:43:53.983494 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:43:53.983494 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:43:53.983494 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf8f81da-4aa0-498d-af1e-c036238f065d could not be found. Oct 18 15:43:53.983494 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:53.985505 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-40d51b92-4631-47a5-b6b6-e2227ea0f10a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Returning 404 to user: Instance cf8f81da-4aa0-498d-af1e-c036238f065d could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:43:53.986384 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-40d51b92-4631-47a5-b6b6-e2227ea0f10a tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "DELETE /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 404 len: 111 microversion: 2.32 time: 0.065574 Oct 18 15:43:53.989875 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2098/4189] 10.222.0.60 () {60 vars in 1280 bytes} [Tue Oct 18 15:43:53 2022] DELETE /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:43:53.991805 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6e9b30a1-1c82-4e08-8778-57fb76b8a884 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:53.992419 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6e9b30a1-1c82-4e08-8778-57fb76b8a884 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] [instance: 511cbc18-aef9-4202-9616-decd6651e931] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:53.999833 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6e9b30a1-1c82-4e08-8778-57fb76b8a884 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:54.000333 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6e9b30a1-1c82-4e08-8778-57fb76b8a884 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:54.000777 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6e9b30a1-1c82-4e08-8778-57fb76b8a884 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:54.001534 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6e9b30a1-1c82-4e08-8778-57fb76b8a884 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:54.002055 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6e9b30a1-1c82-4e08-8778-57fb76b8a884 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:54.002491 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6e9b30a1-1c82-4e08-8778-57fb76b8a884 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:54.018694 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-6e9b30a1-1c82-4e08-8778-57fb76b8a884 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] HTTP exception thrown: Instance 511cbc18-aef9-4202-9616-decd6651e931 could not be found. Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6e9b30a1-1c82-4e08-8778-57fb76b8a884 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Request method failure captured: Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/511cbc18-aef9-4202-9616-decd6651e931 HTTP/1.1 Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsfD3tyC5zBBCs3PM6SgagJOA9ytEd34lT9my352h69qxn0wNQWvVVVEceKNcLlE8Cld2E1ewLfFQUA6X-zyH4NCgXE9isdDnVpnJB5BT1ljNdC07pganRFql9FpScM1-Xjt5su1w2IBkP6ZVV1NsRclcY3oY_ScUp2DhZs2W7X1y8Y Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: a5b55fd6668b481b8c578983dc655785 Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-AttachVolumeNegativeTest-1298357771 Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a5b55fd6668b481b8c578983dc655785"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a5b55fd6668b481b8c578983dc655785"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a5b55fd6668b481b8c578983dc655785"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a5b55fd6668b481b8c578983dc655785"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-AttachVolumeNegativeTest-1298357771 Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: a5b55fd6668b481b8c578983dc655785 Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1298357771 Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-AttachVolumeNegativeTest-1298357771-project Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: efec3b4b5b1c46bd9d2c0efa68f86979 Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-AttachVolumeNegativeTest-1298357771-project Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 511cbc18-aef9-4202-9616-decd6651e931 could not be found. Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '511cbc18-aef9-4202-9616-decd6651e931'} Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 511cbc18-aef9-4202-9616-decd6651e931 could not be found. Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 511cbc18-aef9-4202-9616-decd6651e931 could not be found. Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:43:54.020265 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:54.025120 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:54.025120 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:43:54.025120 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:43:54.025120 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:43:54.025120 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:43:54.025120 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 511cbc18-aef9-4202-9616-decd6651e931 could not be found. Oct 18 15:43:54.025120 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:54.025120 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6e9b30a1-1c82-4e08-8778-57fb76b8a884 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] Returning 404 to user: Instance 511cbc18-aef9-4202-9616-decd6651e931 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:43:54.025120 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6e9b30a1-1c82-4e08-8778-57fb76b8a884 tempest-AttachVolumeNegativeTest-1298357771 tempest-AttachVolumeNegativeTest-1298357771-project] 10.222.0.60 "GET /compute/v2.1/servers/511cbc18-aef9-4202-9616-decd6651e931" status: 404 len: 111 microversion: 2.1 time: 0.033490 Oct 18 15:43:54.025120 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2099/4190] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:53 2022] GET /compute/v2.1/servers/511cbc18-aef9-4202-9616-decd6651e931 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:43:54.208656 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-256941a1-58c5-4c72-8eb6-e8da6ad9fe53 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:54.223220 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-256941a1-58c5-4c72-8eb6-e8da6ad9fe53 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8" status: 200 len: 1511 microversion: 2.1 time: 0.343195 Oct 18 15:43:54.223897 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2092/4191] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:53 2022] GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8 => generated 1511 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:54.241931 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-48949fd3-1ac9-4b3b-88fd-77af104b75a8 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "b55b6f02-72e3-4b31-a708-98b6291bed4c"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:43:54.246455 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-48949fd3-1ac9-4b3b-88fd-77af104b75a8 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Request method failure captured: Oct 18 15:43:54.246455 n-d-853682-5 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 15:43:54.246455 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:43:54.246455 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:43:54.246455 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:43:54.246455 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 416 Oct 18 15:43:54.246455 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:43:54.246455 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:43:54.246455 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:43:54.246455 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:43:54.246455 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTslxbnvpe5yiGf5CWZMgShC81OiGKrcSLYZFSWKOLbaqqF5kNJvh8cijdldsPo1OHjHXDcbdPuhTuFRNRswVq0HwpXLNCfOWcF3GU1M8LHkZwXu6ScaOEIHyQ8ewFnAFL7TXd1O14t3atsv_uM6Xc9ZHSfefERCjuehdw5SJuAn7MMs Oct 18 15:43:54.246455 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:43:54.246455 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:43:54.246455 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:43:54.246455 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:43:54.246455 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:43:54.246455 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:43:54.246455 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:43:54.246455 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:43:54.246455 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:43:54.246455 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:43:54.246455 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:43:54.246455 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:43:54.246455 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:43:54.246455 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:43:54.246455 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:43:54.246455 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:43:54.246455 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:43:54.246455 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 96c4378d52d1489bb2d50e84cabf95eb Oct 18 15:43:54.246455 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:43:54.246455 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:43:54.246455 n-d-853682-5 devstack@n-api.service[120406]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "b55b6f02-72e3-4b31-a708-98b6291bed4c"}]}} Oct 18 15:43:54.246455 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:43:54.246455 n-d-853682-5 devstack@n-api.service[120406]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 15:43:54.246455 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '8f4db252-bff6-4685-9c8d-4c5d6bd9f78b', 'flavorRef': '452', 'networks': [{'uuid': 'b55b6f02-72e3-4b31-a708-98b6291bed4c'}]}}} Oct 18 15:43:54.246455 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:43:54.246455 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:54.246455 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 15:43:54.246455 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 15:43:54.246455 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 15:43:54.246455 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise error Oct 18 15:43:54.246455 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 15:43:54.246455 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:54.246455 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 18 15:43:54.246455 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 18 15:43:54.246455 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:54.246455 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 15:43:54.246455 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 18 15:43:54.246455 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:54.246455 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:43:54.250292 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:54.250292 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:54.250292 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:43:54.250292 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:43:54.250292 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:43:54.250292 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:43:54.250292 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:43:54.250292 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:43:54.250292 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:43:54.250292 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:43:54.250292 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 15:43:54.250292 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 15:43:54.250292 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 15:43:54.250292 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 15:43:54.250292 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 15:43:54.250292 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 15:43:54.250292 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 15:43:54.250292 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:54.250292 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:43:54.250292 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:54.250292 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:54.250292 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:43:54.250292 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:43:54.250292 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 15:43:54.250292 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 15:43:54.250292 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 15:43:54.250292 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:54.250292 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-48949fd3-1ac9-4b3b-88fd-77af104b75a8 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:43:54.250292 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-48949fd3-1ac9-4b3b-88fd-77af104b75a8 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.023081 Oct 18 15:43:54.253224 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2093/4192] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:43:54 2022] POST /compute/v2.1/servers => generated 619 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:43:54.259490 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bb068637-4861-4a08-beef-47839749eb13 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:54.260156 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bb068637-4861-4a08-beef-47839749eb13 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] [instance: cf8f81da-4aa0-498d-af1e-c036238f065d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:54.267819 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-31812b9a-fe8c-4a34-a40d-d4a44f393a66 tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] Action: 'create', calling method: .version_select at 0x7f7c3cff6a60>, body: {"keypair": {"name": "tempest-keypair-1707296570", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP+usvFLC4WMHAYWm3hNo3KbZ3xANCyixWoz+qme4o/9zZhHeQ1T7XQZJTbSPYWR3coQNGRHOtXB3ZqwTHB9eUQsUUz7ZTCrWK+zDidgnSzVteQ2OYhJi1ZOGzstKNEilw=="}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:43:54.268405 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb068637-4861-4a08-beef-47839749eb13 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:54.269195 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb068637-4861-4a08-beef-47839749eb13 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:54.269870 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb068637-4861-4a08-beef-47839749eb13 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:54.271265 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb068637-4861-4a08-beef-47839749eb13 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:54.271935 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb068637-4861-4a08-beef-47839749eb13 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:54.273677 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb068637-4861-4a08-beef-47839749eb13 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:54.283162 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:43:54.289769 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-31812b9a-fe8c-4a34-a40d-d4a44f393a66 tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] Getting quotas for project e4c328c15a3548b1be839863deb8b066. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:43:54.299488 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-31812b9a-fe8c-4a34-a40d-d4a44f393a66 tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] Getting quotas for user a0205ba9f0ef46989f99cffabffe663e and project e4c328c15a3548b1be839863deb8b066. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:43:54.312341 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-bb068637-4861-4a08-beef-47839749eb13 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] HTTP exception thrown: Instance cf8f81da-4aa0-498d-af1e-c036238f065d could not be found. Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bb068637-4861-4a08-beef-47839749eb13 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Request method failure captured: Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d HTTP/1.1 Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsgpmW1nRLv2ldegpMEiqyvhmI_h11cRUxAU83yp9iCJZEEiUJ9NEmO3aMb5ICfxfLcu5x9IUh4Ze6tqcUucvaYXl8-OM3DqhAXbxh7Yfus4CG68HAGEMQeFfoX58DdYP6Tt4-7t8pDwuClxmIsR5tOrridVHyiweY1UXXU_oCFTyTM Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: X-Openstack-Nova-Api-Version: 2.32 Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 1a67d76e7f824ee99302b9efb7d36e2f Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-TaggedBootDevicesTest-1462456838 Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1a67d76e7f824ee99302b9efb7d36e2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1a67d76e7f824ee99302b9efb7d36e2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1a67d76e7f824ee99302b9efb7d36e2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1a67d76e7f824ee99302b9efb7d36e2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-TaggedBootDevicesTest-1462456838 Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 1a67d76e7f824ee99302b9efb7d36e2f Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1462456838 Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-TaggedBootDevicesTest-1462456838-project Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: ccc5106861284e12aa81c7a28e024a1b Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-TaggedBootDevicesTest-1462456838-project Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance cf8f81da-4aa0-498d-af1e-c036238f065d could not be found. Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'cf8f81da-4aa0-498d-af1e-c036238f065d'} Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf8f81da-4aa0-498d-af1e-c036238f065d could not be found. Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf8f81da-4aa0-498d-af1e-c036238f065d could not be found. Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:54.315365 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:43:54.319313 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:54.319313 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:54.319313 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:43:54.319313 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:43:54.319313 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:43:54.319313 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:43:54.319313 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf8f81da-4aa0-498d-af1e-c036238f065d could not be found. Oct 18 15:43:54.319313 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:54.321609 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bb068637-4861-4a08-beef-47839749eb13 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] Returning 404 to user: Instance cf8f81da-4aa0-498d-af1e-c036238f065d could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:43:54.322652 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bb068637-4861-4a08-beef-47839749eb13 tempest-TaggedBootDevicesTest-1462456838 tempest-TaggedBootDevicesTest-1462456838-project] 10.222.0.60 "GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d" status: 404 len: 111 microversion: 2.32 time: 0.068455 Oct 18 15:43:54.323310 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2094/4193] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:43:54 2022] GET /compute/v2.1/servers/cf8f81da-4aa0-498d-af1e-c036238f065d => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:43:54.332181 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2ea022ac-a4fa-48af-ae53-4d3303100150 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:54.332802 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2ea022ac-a4fa-48af-ae53-4d3303100150 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:54.336185 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-31812b9a-fe8c-4a34-a40d-d4a44f393a66 tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.311838 Oct 18 15:43:54.337716 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2100/4194] 10.222.0.60 () {62 vars in 1199 bytes} [Tue Oct 18 15:43:54 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 315 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 18 15:43:54.348916 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2ea022ac-a4fa-48af-ae53-4d3303100150 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:54.349426 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2ea022ac-a4fa-48af-ae53-4d3303100150 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:54.349873 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2ea022ac-a4fa-48af-ae53-4d3303100150 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:54.350571 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2ea022ac-a4fa-48af-ae53-4d3303100150 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:54.356259 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-07e1ac53-2a65-4d07-a151-e510769ab67e tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] Calling method '.version_select at 0x7f7c3d15cb80>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:54.357289 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2ea022ac-a4fa-48af-ae53-4d3303100150 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:54.357760 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2ea022ac-a4fa-48af-ae53-4d3303100150 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:54.368420 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-07e1ac53-2a65-4d07-a151-e510769ab67e tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] 10.222.0.60 "GET /compute/v2.1/os-keypairs/tempest-keypair-1707296570" status: 200 len: 513 microversion: 2.2 time: 0.016572 Oct 18 15:43:54.369901 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2101/4195] 10.222.0.60 () {60 vars in 1258 bytes} [Tue Oct 18 15:43:54 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1707296570 => generated 513 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:43:54.391256 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-45b54ff7-b612-4457-9e82-78317538b8dc tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] Calling method '.version_select at 0x7f7c3d0a05e0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:54.444013 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-45b54ff7-b612-4457-9e82-78317538b8dc tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1707296570" status: 204 len: 0 microversion: 2.2 time: 0.064930 Oct 18 15:43:54.453819 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2102/4196] 10.222.0.60 () {60 vars in 1261 bytes} [Tue Oct 18 15:43:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1707296570 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:43:54.459138 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c2dfdf6f-b093-4d8d-a7e5-e16700624f75 tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] Action: 'create', calling method: .version_select at 0x7f7c3d3b6790>, body: {"keypair": {"name": "tempest-keypair-602141928", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEoXwUbhcEnDTvQvc3xk5ir7NbMAH6s2fke/6YtG9ZpI25mnGggahDw6jez2RE547FHSsc7zeUg6HRbwBKTMC46MVU2WoTYHnzGl9yUd+ZAQSKGoAYQJEUMecG4uIbLZ3Q=="}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:43:54.510396 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-c2dfdf6f-b093-4d8d-a7e5-e16700624f75 tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] Getting quotas for project e4c328c15a3548b1be839863deb8b066. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:43:54.517248 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-c2dfdf6f-b093-4d8d-a7e5-e16700624f75 tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] Getting quotas for user a0205ba9f0ef46989f99cffabffe663e and project e4c328c15a3548b1be839863deb8b066. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:43:54.571412 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c2dfdf6f-b093-4d8d-a7e5-e16700624f75 tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.116280 Oct 18 15:43:54.572251 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2103/4197] 10.222.0.60 () {62 vars in 1199 bytes} [Tue Oct 18 15:43:54 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 118 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 18 15:43:54.590528 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2ea022ac-a4fa-48af-ae53-4d3303100150 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:54.592086 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d33bcf14-5530-4caa-9faa-fc056a34ad33 tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] Calling method '.version_select at 0x7f7c3d2994c0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:54.601084 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2ea022ac-a4fa-48af-ae53-4d3303100150 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.273519 Oct 18 15:43:54.601740 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2095/4198] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:54 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:54.629201 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d33bcf14-5530-4caa-9faa-fc056a34ad33 tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-602141928" status: 204 len: 0 microversion: 2.2 time: 0.047171 Oct 18 15:43:54.629808 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2104/4199] 10.222.0.60 () {60 vars in 1258 bytes} [Tue Oct 18 15:43:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-602141928 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 15:43:54.633552 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-73ebad61-3d93-436f-8d4a-9c869ce14515 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:54.636119 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-73ebad61-3d93-436f-8d4a-9c869ce14515 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:54.639220 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5f8e9fd4-d3a1-4e8a-8225-ce00fcda940b tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] Action: 'create', calling method: .version_select at 0x7f7c3d138670>, body: {"keypair": {"name": "tempest-keypair-1994085631", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:43:54.649023 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73ebad61-3d93-436f-8d4a-9c869ce14515 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:54.655565 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73ebad61-3d93-436f-8d4a-9c869ce14515 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:54.656235 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73ebad61-3d93-436f-8d4a-9c869ce14515 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:54.657193 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73ebad61-3d93-436f-8d4a-9c869ce14515 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:54.657838 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73ebad61-3d93-436f-8d4a-9c869ce14515 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:54.658453 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73ebad61-3d93-436f-8d4a-9c869ce14515 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:54.667424 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-5f8e9fd4-d3a1-4e8a-8225-ce00fcda940b tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] Getting quotas for project e4c328c15a3548b1be839863deb8b066. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:43:54.693919 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-5f8e9fd4-d3a1-4e8a-8225-ce00fcda940b tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] Getting quotas for user a0205ba9f0ef46989f99cffabffe663e and project e4c328c15a3548b1be839863deb8b066. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:43:54.740249 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5f8e9fd4-d3a1-4e8a-8225-ce00fcda940b tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.104888 Oct 18 15:43:54.741973 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2105/4200] 10.222.0.60 () {62 vars in 1199 bytes} [Tue Oct 18 15:43:54 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 107 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 18 15:43:54.752823 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-21caea0d-f43c-44ff-8990-903a62b9bc4a tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] Calling method '.version_select at 0x7f7c3d0c30d0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:54.787038 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-21caea0d-f43c-44ff-8990-903a62b9bc4a tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1994085631" status: 204 len: 0 microversion: 2.2 time: 0.038960 Oct 18 15:43:54.787770 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2106/4201] 10.222.0.60 () {60 vars in 1261 bytes} [Tue Oct 18 15:43:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1994085631 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 15:43:54.801908 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f8ad3c2d-b6da-4236-b50c-0d8b7914256d tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] Action: 'create', calling method: .version_select at 0x7f7c3d3b6ee0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1700214987", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEl8kLU5TcVh2kv7hGq24vWX/vtSxkdt3wWzfS2qXFh+73CfMb8e5Zwwpmpvytx9+PBpJG0Lxs1tzej2OcaSETCNP2fj8zaf/U+bB9p9WAPFV5k7clhlp/WT/ZeSC3nuYQ=="}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:43:54.841840 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-f8ad3c2d-b6da-4236-b50c-0d8b7914256d tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] Getting quotas for project e4c328c15a3548b1be839863deb8b066. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:43:54.857111 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-f8ad3c2d-b6da-4236-b50c-0d8b7914256d tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] Getting quotas for user a0205ba9f0ef46989f99cffabffe663e and project e4c328c15a3548b1be839863deb8b066. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:43:54.910154 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f8ad3c2d-b6da-4236-b50c-0d8b7914256d tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.114331 Oct 18 15:43:54.911446 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2107/4202] 10.222.0.60 () {62 vars in 1199 bytes} [Tue Oct 18 15:43:54 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 116 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 18 15:43:54.925969 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-05815ebf-c139-450f-9b9b-e7147b27de55 tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] Action: 'create', calling method: .version_select at 0x7f7c3d33ddc0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-587629692", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHGwF3q+tXZl9GqeoMctq/oIW8mmkv7D5rP2+0Vc8UAcFiYHEuu8VUn0WulHK1lt/arulCRKuTlfQ+PrpdEihWs8mQ75qUOyAhy/wJ5XlcWVFlfuSlEeAgyqJY8hPHkqw=="}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:43:54.958319 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-73ebad61-3d93-436f-8d4a-9c869ce14515 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:54.960648 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-05815ebf-c139-450f-9b9b-e7147b27de55 tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] Getting quotas for project e4c328c15a3548b1be839863deb8b066. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:43:54.971216 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-73ebad61-3d93-436f-8d4a-9c869ce14515 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.340542 Oct 18 15:43:54.986666 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2096/4203] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:54 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:54.986906 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-05815ebf-c139-450f-9b9b-e7147b27de55 tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] Getting quotas for user a0205ba9f0ef46989f99cffabffe663e and project e4c328c15a3548b1be839863deb8b066. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:43:55.011115 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a3bcf4ce-204b-4bee-a51c-1057d61766f1 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:55.012689 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a3bcf4ce-204b-4bee-a51c-1057d61766f1 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: a49f5b92-61e2-44bd-92a9-2bbaa1fb8975] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:55.028042 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3bcf4ce-204b-4bee-a51c-1057d61766f1 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:55.029931 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3bcf4ce-204b-4bee-a51c-1057d61766f1 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:55.031209 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3bcf4ce-204b-4bee-a51c-1057d61766f1 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:55.033339 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3bcf4ce-204b-4bee-a51c-1057d61766f1 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:55.034702 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3bcf4ce-204b-4bee-a51c-1057d61766f1 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:55.035583 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3bcf4ce-204b-4bee-a51c-1057d61766f1 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:55.037094 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-05815ebf-c139-450f-9b9b-e7147b27de55 tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.116284 Oct 18 15:43:55.038037 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2108/4204] 10.222.0.60 () {62 vars in 1199 bytes} [Tue Oct 18 15:43:54 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 118 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 18 15:43:55.054651 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ab779ba7-a05a-4a40-8df9-9a18c050385d tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] Action: 'create', calling method: .version_select at 0x7f7c3d2ae940>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-2142505930", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPAFI2rapejeg03lkzvBurF6vxRUp+6Xl6R0SO+efuEc+246gA27OvRUCVu/nwD76ihCxhsYh8sNb5yJ529z7Q39bjHvyUsnltzrKipEBzYIUoFjolPjWfFJqrSK4z2Ew=="}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:43:55.087973 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-ab779ba7-a05a-4a40-8df9-9a18c050385d tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] Getting quotas for project e4c328c15a3548b1be839863deb8b066. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:43:55.099032 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-ab779ba7-a05a-4a40-8df9-9a18c050385d tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] Getting quotas for user a0205ba9f0ef46989f99cffabffe663e and project e4c328c15a3548b1be839863deb8b066. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:43:55.142835 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ab779ba7-a05a-4a40-8df9-9a18c050385d tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.091916 Oct 18 15:43:55.149583 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2109/4205] 10.222.0.60 () {62 vars in 1199 bytes} [Tue Oct 18 15:43:55 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 100 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 18 15:43:55.154873 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-25e40e18-4fe2-4af0-9f3a-fe4a5793e083 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-14256121", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": -1, "networks": [{"uuid": "b55b6f02-72e3-4b31-a708-98b6291bed4c"}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:43:55.168746 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-25e40e18-4fe2-4af0-9f3a-fe4a5793e083 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] HTTP exception thrown: Flavor -1 could not be found. Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-25e40e18-4fe2-4af0-9f3a-fe4a5793e083 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Request method failure captured: Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 204 Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTslxbnvpe5yiGf5CWZMgShC81OiGKrcSLYZFSWKOLbaqqF5kNJvh8cijdldsPo1OHjHXDcbdPuhTuFRNRswVq0HwpXLNCfOWcF3GU1M8LHkZwXu6ScaOEIHyQ8ewFnAFL7TXd1O14t3atsv_uM6Xc9ZHSfefERCjuehdw5SJuAn7MMs Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 96c4378d52d1489bb2d50e84cabf95eb Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-14256121", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": -1, "networks": [{"uuid": "b55b6f02-72e3-4b31-a708-98b6291bed4c"}]}} Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: exception: Flavor -1 could not be found. Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-14256121', 'imageRef': '8f4db252-bff6-4685-9c8d-4c5d6bd9f78b', 'flavorRef': -1, 'networks': [{'uuid': 'b55b6f02-72e3-4b31-a708-98b6291bed4c'}]}}} Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:43:55.172494 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:43:55.175978 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:43:55.175978 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:43:55.175978 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:43:55.175978 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:43:55.175978 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 18 15:43:55.175978 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 18 15:43:55.175978 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 18 15:43:55.175978 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 18 15:43:55.175978 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:55.175978 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:43:55.175978 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:55.175978 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:55.175978 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:43:55.175978 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:43:55.175978 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:43:55.175978 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:43:55.175978 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 18 15:43:55.175978 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:55.178723 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-25e40e18-4fe2-4af0-9f3a-fe4a5793e083 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:43:55.180217 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-25e40e18-4fe2-4af0-9f3a-fe4a5793e083 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.029274 Oct 18 15:43:55.181502 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2110/4206] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:43:55 2022] POST /compute/v2.1/servers => generated 73 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 18 15:43:55.188879 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-73a1bb12-24cd-450a-9ba3-f8a80b0b7fda tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] Calling method '.version_select at 0x7f7c3da22d30>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:55.195002 n-d-853682-5 devstack@n-api.service[120405]: WARNING oslo_db.sqlalchemy.utils [None req-73a1bb12-24cd-450a-9ba3-f8a80b0b7fda tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 18 15:43:55.202073 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-73a1bb12-24cd-450a-9ba3-f8a80b0b7fda tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] 10.222.0.60 "GET /compute/v2.1/os-keypairs" status: 200 len: 1141 microversion: 2.2 time: 0.019299 Oct 18 15:43:55.202929 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2111/4207] 10.222.0.60 () {60 vars in 1177 bytes} [Tue Oct 18 15:43:55 2022] GET /compute/v2.1/os-keypairs => generated 1141 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:55.214191 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7299811c-dbf0-4bb1-adb9-232665430e7e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:55.215363 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7299811c-dbf0-4bb1-adb9-232665430e7e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:55.223526 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7299811c-dbf0-4bb1-adb9-232665430e7e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:55.224232 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7299811c-dbf0-4bb1-adb9-232665430e7e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:55.224891 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7299811c-dbf0-4bb1-adb9-232665430e7e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:55.226456 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7299811c-dbf0-4bb1-adb9-232665430e7e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:55.227600 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7299811c-dbf0-4bb1-adb9-232665430e7e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:55.228231 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7299811c-dbf0-4bb1-adb9-232665430e7e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:55.499510 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a3bcf4ce-204b-4bee-a51c-1057d61766f1 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:55.513314 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a3bcf4ce-204b-4bee-a51c-1057d61766f1 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975" status: 200 len: 1523 microversion: 2.1 time: 0.524234 Oct 18 15:43:55.514310 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2097/4208] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:54 2022] GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975 => generated 1523 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:55.526347 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f25bdf1b-b3d3-4065-809a-e86389e24b7b tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] Calling method '.version_select at 0x7f7c3d0ddaf0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:55.554006 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f25bdf1b-b3d3-4065-809a-e86389e24b7b tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2142505930" status: 204 len: 0 microversion: 2.2 time: 0.037282 Oct 18 15:43:55.555392 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2098/4209] 10.222.0.60 () {60 vars in 1321 bytes} [Tue Oct 18 15:43:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2142505930 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:43:55.561627 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1e91872b-5e73-4f30-9723-77fe9ee955c0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:55.562464 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1e91872b-5e73-4f30-9723-77fe9ee955c0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: e6019a42-1115-4a7b-bfab-badb33cafed8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:55.570319 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e91872b-5e73-4f30-9723-77fe9ee955c0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:55.570892 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e91872b-5e73-4f30-9723-77fe9ee955c0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:55.571472 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e91872b-5e73-4f30-9723-77fe9ee955c0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:55.572316 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e91872b-5e73-4f30-9723-77fe9ee955c0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:55.572871 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e91872b-5e73-4f30-9723-77fe9ee955c0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:55.573455 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e91872b-5e73-4f30-9723-77fe9ee955c0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:55.599035 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7299811c-dbf0-4bb1-adb9-232665430e7e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:55.610933 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7299811c-dbf0-4bb1-adb9-232665430e7e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.406265 Oct 18 15:43:55.613708 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2112/4210] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:55 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:55.619236 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4b409b56-a7c4-43f1-ae19-e52eef2e10a4 tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] Calling method '.version_select at 0x7f7c41684af0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:55.675711 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4b409b56-a7c4-43f1-ae19-e52eef2e10a4 tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-587629692" status: 204 len: 0 microversion: 2.2 time: 0.061248 Oct 18 15:43:55.676604 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2113/4211] 10.222.0.60 () {60 vars in 1318 bytes} [Tue Oct 18 15:43:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-587629692 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:43:55.683468 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-887711ef-9a79-4119-9249-1aa49838b6f5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:55.683468 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-887711ef-9a79-4119-9249-1aa49838b6f5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:55.704728 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-887711ef-9a79-4119-9249-1aa49838b6f5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:55.707083 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-887711ef-9a79-4119-9249-1aa49838b6f5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:55.707537 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-887711ef-9a79-4119-9249-1aa49838b6f5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:55.708359 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-887711ef-9a79-4119-9249-1aa49838b6f5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:55.708766 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-887711ef-9a79-4119-9249-1aa49838b6f5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:55.709282 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-887711ef-9a79-4119-9249-1aa49838b6f5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:55.798496 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1e91872b-5e73-4f30-9723-77fe9ee955c0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:55.807747 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1e91872b-5e73-4f30-9723-77fe9ee955c0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8" status: 200 len: 1511 microversion: 2.1 time: 0.251023 Oct 18 15:43:55.808697 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2099/4212] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:55 2022] GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8 => generated 1511 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:55.824842 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6193029f-7c08-4caa-8054-1573d765bbc5 tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] Calling method '.version_select at 0x7f7c3d315820>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:55.856161 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6193029f-7c08-4caa-8054-1573d765bbc5 tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1700214987" status: 204 len: 0 microversion: 2.2 time: 0.045805 Oct 18 15:43:55.865505 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2100/4213] 10.222.0.60 () {60 vars in 1321 bytes} [Tue Oct 18 15:43:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1700214987 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:43:55.883012 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3b2842bc-c2fc-4274-b553-f6f6c1e0d0a1 tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] Action: 'create', calling method: .version_select at 0x7f7c3d73c9d0>, body: {"keypair": {"name": "tempest-keypair-894398065", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDHuPIViOfnralNgLIdt99UoB9Ox9m5T7VVaKeBaEDtrOb0YJjdtTmkifzB1EQ3R9qXv9SscrXubQ1+6fvomH7+0QSV0ja231Qpx4mDtW0fdVkRc+L5X9ZlWt5IygDlq0A=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:43:55.906195 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-3b2842bc-c2fc-4274-b553-f6f6c1e0d0a1 tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] Getting quotas for project e4c328c15a3548b1be839863deb8b066. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:43:55.912925 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-3b2842bc-c2fc-4274-b553-f6f6c1e0d0a1 tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] Getting quotas for user a0205ba9f0ef46989f99cffabffe663e and project e4c328c15a3548b1be839863deb8b066. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:43:55.917419 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:43:55.926290 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-887711ef-9a79-4119-9249-1aa49838b6f5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:55.936942 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-887711ef-9a79-4119-9249-1aa49838b6f5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.257486 Oct 18 15:43:55.937928 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2114/4214] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:55 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:55.975321 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3b2842bc-c2fc-4274-b553-f6f6c1e0d0a1 tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.105777 Oct 18 15:43:55.981337 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2101/4215] 10.222.0.60 () {62 vars in 1199 bytes} [Tue Oct 18 15:43:55 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 115 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 18 15:43:55.987320 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c307a214-ce1a-481b-97fc-e023155e4d60 tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] Calling method '.version_select at 0x7f7c3ec93670>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:56.007343 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c307a214-ce1a-481b-97fc-e023155e4d60 tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] 10.222.0.60 "GET /compute/v2.1/os-keypairs/tempest-keypair-894398065" status: 200 len: 512 microversion: 2.2 time: 0.023958 Oct 18 15:43:56.008597 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2115/4216] 10.222.0.60 () {60 vars in 1255 bytes} [Tue Oct 18 15:43:55 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-894398065 => generated 512 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:43:56.023712 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-34c2d276-9d38-481f-9288-f207c71c9208 tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] Calling method '.version_select at 0x7f7c3d0d8790>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:56.029141 n-d-853682-5 devstack@n-api.service[120406]: WARNING oslo_db.sqlalchemy.utils [None req-34c2d276-9d38-481f-9288-f207c71c9208 tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 18 15:43:56.035658 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-34c2d276-9d38-481f-9288-f207c71c9208 tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] 10.222.0.60 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.017237 Oct 18 15:43:56.043126 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2102/4217] 10.222.0.60 () {60 vars in 1177 bytes} [Tue Oct 18 15:43:56 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:43:56.047810 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1cdfd8a4-6bfa-4a4a-beee-77587d5e73ac tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] Calling method '.version_select at 0x7f7c3d0c39d0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:56.074405 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:DELETE=4 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:43:56.089193 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1cdfd8a4-6bfa-4a4a-beee-77587d5e73ac tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-894398065" status: 204 len: 0 microversion: 2.2 time: 0.045532 Oct 18 15:43:56.092515 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2116/4218] 10.222.0.60 () {60 vars in 1258 bytes} [Tue Oct 18 15:43:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-894398065 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:43:56.102940 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6d31bf2a-e658-4c69-8759-072bb475bc0b tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] Action: 'create', calling method: .version_select at 0x7f7c3ce1e700>, body: {"keypair": {"name": "tempest-keypair-842418078", "type": "x509"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:43:56.139892 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-6d31bf2a-e658-4c69-8759-072bb475bc0b tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] Getting quotas for project e4c328c15a3548b1be839863deb8b066. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:43:56.145601 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fc108c16-8ffd-443d-b687-07dad31833b0 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1690563609", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "b55b6f02-72e3-4b31-a708-98b6291bed4c"}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fc108c16-8ffd-443d-b687-07dad31833b0 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Request method failure captured: Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 173 Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTslxbnvpe5yiGf5CWZMgShC81OiGKrcSLYZFSWKOLbaqqF5kNJvh8cijdldsPo1OHjHXDcbdPuhTuFRNRswVq0HwpXLNCfOWcF3GU1M8LHkZwXu6ScaOEIHyQ8ewFnAFL7TXd1O14t3atsv_uM6Xc9ZHSfefERCjuehdw5SJuAn7MMs Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 96c4378d52d1489bb2d50e84cabf95eb Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1690563609", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "b55b6f02-72e3-4b31-a708-98b6291bed4c"}]}} Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1690563609', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': 'b55b6f02-72e3-4b31-a708-98b6291bed4c'}]}}} Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise error Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi -1 Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 15:43:56.152488 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 15:43:56.157140 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 15:43:56.157140 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 15:43:56.157140 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 18 15:43:56.157140 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:56.157140 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:43:56.157140 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:56.157140 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:56.157140 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:43:56.157140 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:43:56.157140 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 15:43:56.157140 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 15:43:56.157140 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 18 15:43:56.157140 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:43:56.157140 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fc108c16-8ffd-443d-b687-07dad31833b0 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:43:56.158249 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-6d31bf2a-e658-4c69-8759-072bb475bc0b tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] Getting quotas for user a0205ba9f0ef46989f99cffabffe663e and project e4c328c15a3548b1be839863deb8b066. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:43:56.158344 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fc108c16-8ffd-443d-b687-07dad31833b0 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.016551 Oct 18 15:43:56.162442 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2117/4219] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:43:56 2022] POST /compute/v2.1/servers => generated 145 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:43:56.169448 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4b77231b-c16a-46fe-9f82-d0b27ea8cd51 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:56.170446 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4b77231b-c16a-46fe-9f82-d0b27ea8cd51 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:56.177484 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4b77231b-c16a-46fe-9f82-d0b27ea8cd51 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:56.178487 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4b77231b-c16a-46fe-9f82-d0b27ea8cd51 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:56.179716 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4b77231b-c16a-46fe-9f82-d0b27ea8cd51 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:56.181048 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4b77231b-c16a-46fe-9f82-d0b27ea8cd51 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:56.181048 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4b77231b-c16a-46fe-9f82-d0b27ea8cd51 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:56.181514 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4b77231b-c16a-46fe-9f82-d0b27ea8cd51 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:56.194276 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.processutils [None req-6d31bf2a-e658-4c69-8759-072bb475bc0b tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmplg4_pty5/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmplg4_pty5/temp.key -subj /CN=a0205ba9f0ef46989f99cffabffe663e -extensions v3_req_client {{(pid=120406) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 18 15:43:56.340764 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4b77231b-c16a-46fe-9f82-d0b27ea8cd51 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:56.351529 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4b77231b-c16a-46fe-9f82-d0b27ea8cd51 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.186929 Oct 18 15:43:56.352198 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2118/4220] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:56 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:56.376343 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5c9b611f-d5d1-49ce-a0a0-ac6136a1769c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:56.377347 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5c9b611f-d5d1-49ce-a0a0-ac6136a1769c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:56.384345 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5c9b611f-d5d1-49ce-a0a0-ac6136a1769c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:56.385248 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5c9b611f-d5d1-49ce-a0a0-ac6136a1769c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:56.385907 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5c9b611f-d5d1-49ce-a0a0-ac6136a1769c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:56.386890 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5c9b611f-d5d1-49ce-a0a0-ac6136a1769c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:56.387588 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5c9b611f-d5d1-49ce-a0a0-ac6136a1769c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:56.388205 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5c9b611f-d5d1-49ce-a0a0-ac6136a1769c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:56.643617 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5c9b611f-d5d1-49ce-a0a0-ac6136a1769c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:56.653916 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5c9b611f-d5d1-49ce-a0a0-ac6136a1769c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.282212 Oct 18 15:43:56.656752 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2119/4221] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:56 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:43:56.663722 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0172a3ef-7efa-41ce-971f-1eee665d8e9f tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:56.664624 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0172a3ef-7efa-41ce-971f-1eee665d8e9f tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: a49f5b92-61e2-44bd-92a9-2bbaa1fb8975] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:56.674436 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0172a3ef-7efa-41ce-971f-1eee665d8e9f tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:56.675243 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0172a3ef-7efa-41ce-971f-1eee665d8e9f tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:56.676164 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0172a3ef-7efa-41ce-971f-1eee665d8e9f tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:56.677504 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0172a3ef-7efa-41ce-971f-1eee665d8e9f tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:56.678428 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0172a3ef-7efa-41ce-971f-1eee665d8e9f tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:56.679252 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0172a3ef-7efa-41ce-971f-1eee665d8e9f tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:56.946162 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.processutils [None req-6d31bf2a-e658-4c69-8759-072bb475bc0b tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmplg4_pty5/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmplg4_pty5/temp.key -subj /CN=a0205ba9f0ef46989f99cffabffe663e -extensions v3_req_client" returned: 0 in 0.751s {{(pid=120406) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 18 15:43:56.948476 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.processutils [None req-6d31bf2a-e658-4c69-8759-072bb475bc0b tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmplg4_pty5/temp.key -password pass: {{(pid=120406) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 18 15:43:57.007060 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0172a3ef-7efa-41ce-971f-1eee665d8e9f tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:57.018395 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0172a3ef-7efa-41ce-971f-1eee665d8e9f tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975" status: 200 len: 1523 microversion: 2.1 time: 0.360116 Oct 18 15:43:57.019366 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2120/4222] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:56 2022] GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975 => generated 1523 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:57.034206 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.processutils [None req-6d31bf2a-e658-4c69-8759-072bb475bc0b tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] CMD "openssl pkcs12 -export -inkey /tmp/tmplg4_pty5/temp.key -password pass:" returned: 0 in 0.085s {{(pid=120406) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 18 15:43:57.036587 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2a46ae1c-f6be-476f-ac27-6e147212c4ce tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:57.037375 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2a46ae1c-f6be-476f-ac27-6e147212c4ce tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: e6019a42-1115-4a7b-bfab-badb33cafed8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:57.046422 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a46ae1c-f6be-476f-ac27-6e147212c4ce tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:57.046929 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a46ae1c-f6be-476f-ac27-6e147212c4ce tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:57.047488 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a46ae1c-f6be-476f-ac27-6e147212c4ce tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:57.048831 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a46ae1c-f6be-476f-ac27-6e147212c4ce tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:57.049474 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a46ae1c-f6be-476f-ac27-6e147212c4ce tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:57.050256 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a46ae1c-f6be-476f-ac27-6e147212c4ce tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:57.121778 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-6d31bf2a-e658-4c69-8759-072bb475bc0b tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] Getting quotas for project e4c328c15a3548b1be839863deb8b066. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:43:57.135392 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-6d31bf2a-e658-4c69-8759-072bb475bc0b tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] Getting quotas for user a0205ba9f0ef46989f99cffabffe663e and project e4c328c15a3548b1be839863deb8b066. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:43:57.158296 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6d31bf2a-e658-4c69-8759-072bb475bc0b tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 1.059695 Oct 18 15:43:57.165920 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2103/4223] 10.222.0.60 () {62 vars in 1198 bytes} [Tue Oct 18 15:43:56 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 1068 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:43:57.180972 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1c9f3d5e-06bb-4c99-a60c-ee94cb2686f4 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-763050181", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:43:57.188288 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-1c9f3d5e-06bb-4c99-a60c-ee94cb2686f4 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1c9f3d5e-06bb-4c99-a60c-ee94cb2686f4 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Request method failure captured: Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 215 Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTslxbnvpe5yiGf5CWZMgShC81OiGKrcSLYZFSWKOLbaqqF5kNJvh8cijdldsPo1OHjHXDcbdPuhTuFRNRswVq0HwpXLNCfOWcF3GU1M8LHkZwXu6ScaOEIHyQ8ewFnAFL7TXd1O14t3atsv_uM6Xc9ZHSfefERCjuehdw5SJuAn7MMs Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 96c4378d52d1489bb2d50e84cabf95eb Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-763050181", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-763050181', 'imageRef': '8f4db252-bff6-4685-9c8d-4c5d6bd9f78b', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:43:57.190566 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:57.194739 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:57.194739 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:43:57.194739 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:43:57.194739 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:43:57.194739 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:43:57.194739 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 18 15:43:57.194739 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:57.196701 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1c9f3d5e-06bb-4c99-a60c-ee94cb2686f4 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:43:57.197807 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1c9f3d5e-06bb-4c99-a60c-ee94cb2686f4 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.030557 Oct 18 15:43:57.202878 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2104/4224] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:43:57 2022] POST /compute/v2.1/servers => generated 123 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:43:57.209012 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b38c9dda-460e-479a-9302-1524b5c88ecc tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] Calling method '.version_select at 0x7f7c3d7d1e50>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:57.221170 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b38c9dda-460e-479a-9302-1524b5c88ecc tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] 10.222.0.60 "GET /compute/v2.1/os-keypairs/tempest-keypair-842418078" status: 200 len: 1533 microversion: 2.2 time: 0.016805 Oct 18 15:43:57.230330 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2105/4225] 10.222.0.60 () {60 vars in 1255 bytes} [Tue Oct 18 15:43:57 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-842418078 => generated 1533 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:57.235475 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8397afde-473a-4a5e-afd8-901047ff55a6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:57.236166 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8397afde-473a-4a5e-afd8-901047ff55a6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:57.243666 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8397afde-473a-4a5e-afd8-901047ff55a6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:57.244320 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8397afde-473a-4a5e-afd8-901047ff55a6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:57.244648 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8397afde-473a-4a5e-afd8-901047ff55a6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:57.245438 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8397afde-473a-4a5e-afd8-901047ff55a6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:57.245911 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8397afde-473a-4a5e-afd8-901047ff55a6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:57.246339 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8397afde-473a-4a5e-afd8-901047ff55a6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:57.457395 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2a46ae1c-f6be-476f-ac27-6e147212c4ce tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:57.484605 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2a46ae1c-f6be-476f-ac27-6e147212c4ce tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8" status: 200 len: 1511 microversion: 2.1 time: 0.450689 Oct 18 15:43:57.485449 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2121/4226] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:57 2022] GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8 => generated 1511 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:57.502010 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ef598401-2aca-4eef-9d3f-ceb78a80b896 tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] Calling method '.version_select at 0x7f7c3d8738b0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:57.508027 n-d-853682-5 devstack@n-api.service[120405]: WARNING oslo_db.sqlalchemy.utils [None req-ef598401-2aca-4eef-9d3f-ceb78a80b896 tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 18 15:43:57.521887 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ef598401-2aca-4eef-9d3f-ceb78a80b896 tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] 10.222.0.60 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.033530 Oct 18 15:43:57.523067 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2122/4227] 10.222.0.60 () {60 vars in 1177 bytes} [Tue Oct 18 15:43:57 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:57.540484 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3970f2ba-02a6-4d93-8798-659463a3d989 tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] Calling method '.version_select at 0x7f7c3d15c940>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:57.563702 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8397afde-473a-4a5e-afd8-901047ff55a6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:57.577563 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8397afde-473a-4a5e-afd8-901047ff55a6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.345301 Oct 18 15:43:57.578192 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2106/4228] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:57 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:57.605021 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-05aef956-27a0-4af9-acd8-c14fbb147726 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:57.605807 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-05aef956-27a0-4af9-acd8-c14fbb147726 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:57.614304 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3970f2ba-02a6-4d93-8798-659463a3d989 tempest-KeyPairsV22TestJSON-881792094 tempest-KeyPairsV22TestJSON-881792094-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-842418078" status: 204 len: 0 microversion: 2.2 time: 0.081226 Oct 18 15:43:57.615032 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2123/4229] 10.222.0.60 () {60 vars in 1258 bytes} [Tue Oct 18 15:43:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-842418078 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:43:57.621712 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-05aef956-27a0-4af9-acd8-c14fbb147726 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:57.622967 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-05aef956-27a0-4af9-acd8-c14fbb147726 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:57.623587 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-05aef956-27a0-4af9-acd8-c14fbb147726 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:57.625707 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-05aef956-27a0-4af9-acd8-c14fbb147726 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:57.626337 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-05aef956-27a0-4af9-acd8-c14fbb147726 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:57.626948 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-05aef956-27a0-4af9-acd8-c14fbb147726 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:58.022624 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-05aef956-27a0-4af9-acd8-c14fbb147726 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:58.038519 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-05aef956-27a0-4af9-acd8-c14fbb147726 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.436488 Oct 18 15:43:58.040074 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2107/4230] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:57 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:58.058483 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-879340d5-e611-4094-99df-3292fa0a2cad tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:58.059701 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-879340d5-e611-4094-99df-3292fa0a2cad tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: a49f5b92-61e2-44bd-92a9-2bbaa1fb8975] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:58.070805 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-879340d5-e611-4094-99df-3292fa0a2cad tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:58.071377 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-879340d5-e611-4094-99df-3292fa0a2cad tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:58.071832 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-879340d5-e611-4094-99df-3292fa0a2cad tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:58.072570 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-879340d5-e611-4094-99df-3292fa0a2cad tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:58.073190 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-879340d5-e611-4094-99df-3292fa0a2cad tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:58.074403 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-879340d5-e611-4094-99df-3292fa0a2cad tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:58.305537 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-879340d5-e611-4094-99df-3292fa0a2cad tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:58.316984 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-879340d5-e611-4094-99df-3292fa0a2cad tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975" status: 200 len: 1523 microversion: 2.1 time: 0.268353 Oct 18 15:43:58.318236 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2124/4231] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:58 2022] GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975 => generated 1523 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:58.353378 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c3b50063-a6a1-4750-a6af-6db97cca50db tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-129188347", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "key_name": "tempest-key-1223885094", "networks": [{"uuid": "b55b6f02-72e3-4b31-a708-98b6291bed4c"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:43:58.434328 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-c3b50063-a6a1-4750-a6af-6db97cca50db tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] validate_networks() for [('b55b6f02-72e3-4b31-a708-98b6291bed4c', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:43:58.511107 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4ccc499e-f36a-42d4-8562-722f6d8c18da tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:58.511912 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4ccc499e-f36a-42d4-8562-722f6d8c18da tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: e6019a42-1115-4a7b-bfab-badb33cafed8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:58.529242 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ccc499e-f36a-42d4-8562-722f6d8c18da tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:58.532340 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ccc499e-f36a-42d4-8562-722f6d8c18da tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:58.533907 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ccc499e-f36a-42d4-8562-722f6d8c18da tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:58.534952 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ccc499e-f36a-42d4-8562-722f6d8c18da tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:58.538454 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ccc499e-f36a-42d4-8562-722f6d8c18da tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:58.539074 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ccc499e-f36a-42d4-8562-722f6d8c18da tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:58.882804 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-c3b50063-a6a1-4750-a6af-6db97cca50db tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] HTTP exception thrown: Invalid key_name provided. Oct 18 15:43:58.885176 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c3b50063-a6a1-4750-a6af-6db97cca50db tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Request method failure captured: Oct 18 15:43:58.885176 n-d-853682-5 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 15:43:58.885176 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:43:58.885176 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:43:58.885176 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:43:58.885176 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 246 Oct 18 15:43:58.885176 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:43:58.885176 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:43:58.885176 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:43:58.885176 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:43:58.885176 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTslxbnvpe5yiGf5CWZMgShC81OiGKrcSLYZFSWKOLbaqqF5kNJvh8cijdldsPo1OHjHXDcbdPuhTuFRNRswVq0HwpXLNCfOWcF3GU1M8LHkZwXu6ScaOEIHyQ8ewFnAFL7TXd1O14t3atsv_uM6Xc9ZHSfefERCjuehdw5SJuAn7MMs Oct 18 15:43:58.885176 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:43:58.885176 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:43:58.885176 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:43:58.885176 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:43:58.885176 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:43:58.885176 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:43:58.885176 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:43:58.885176 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:43:58.885176 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:43:58.885176 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:43:58.885176 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:43:58.885176 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:43:58.885176 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:43:58.885176 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:43:58.885176 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:43:58.885176 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:43:58.885176 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:43:58.885176 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 96c4378d52d1489bb2d50e84cabf95eb Oct 18 15:43:58.885176 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:43:58.885176 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:43:58.885176 n-d-853682-5 devstack@n-api.service[120406]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-129188347", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "key_name": "tempest-key-1223885094", "networks": [{"uuid": "b55b6f02-72e3-4b31-a708-98b6291bed4c"}]}} Oct 18 15:43:58.885176 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:43:58.885176 n-d-853682-5 devstack@n-api.service[120406]: exception: Invalid key_name provided. Oct 18 15:43:58.885176 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-129188347', 'imageRef': '8f4db252-bff6-4685-9c8d-4c5d6bd9f78b', 'flavorRef': '452', 'key_name': 'tempest-key-1223885094', 'networks': [{'uuid': 'b55b6f02-72e3-4b31-a708-98b6291bed4c'}]}}} Oct 18 15:43:58.885176 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:43:58.885176 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:58.885176 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 18 15:43:58.885176 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 18 15:43:58.885176 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 18 15:43:58.885176 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 18 15:43:58.885176 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 18 15:43:58.885176 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 18 15:43:58.885176 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 18 15:43:58.885176 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 18 15:43:58.885176 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 15:43:58.885176 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 15:43:58.885176 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 18 15:43:58.885176 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 18 15:43:58.885176 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 18 15:43:58.885176 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 18 15:43:58.885176 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 15:43:58.885176 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 15:43:58.885176 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 18 15:43:58.885176 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 18 15:43:58.885176 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1223885094 not found for user 96c4378d52d1489bb2d50e84cabf95eb Oct 18 15:43:58.885176 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:58.885176 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:43:58.885176 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:58.885176 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:58.885176 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:43:58.888995 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:43:58.888995 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:43:58.888995 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:43:58.888995 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:43:58.888995 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:43:58.888995 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:43:58.888995 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:43:58.888995 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:43:58.888995 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:43:58.888995 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:43:58.888995 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:43:58.888995 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 18 15:43:58.888995 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 18 15:43:58.888995 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 18 15:43:58.888995 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 18 15:43:58.888995 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:58.888995 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:43:58.888995 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:58.888995 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:43:58.888995 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:43:58.888995 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:43:58.888995 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:43:58.888995 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:43:58.888995 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 18 15:43:58.888995 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:43:58.888995 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c3b50063-a6a1-4750-a6af-6db97cca50db tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Returning 400 to user: Invalid key_name provided. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:43:58.888995 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c3b50063-a6a1-4750-a6af-6db97cca50db tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.537242 Oct 18 15:43:58.893062 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2108/4232] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:43:58 2022] POST /compute/v2.1/servers => generated 70 bytes in 542 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 18 15:43:58.900876 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cf28b02e-5bda-4361-907a-88307c30fa7d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:58.902307 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cf28b02e-5bda-4361-907a-88307c30fa7d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:58.923215 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4ccc499e-f36a-42d4-8562-722f6d8c18da tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:58.933473 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf28b02e-5bda-4361-907a-88307c30fa7d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:58.934037 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf28b02e-5bda-4361-907a-88307c30fa7d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:58.934482 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf28b02e-5bda-4361-907a-88307c30fa7d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:58.935209 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf28b02e-5bda-4361-907a-88307c30fa7d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:58.935669 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf28b02e-5bda-4361-907a-88307c30fa7d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:58.936095 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf28b02e-5bda-4361-907a-88307c30fa7d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:58.942520 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4ccc499e-f36a-42d4-8562-722f6d8c18da tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8" status: 200 len: 1511 microversion: 2.1 time: 0.427559 Oct 18 15:43:58.942875 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2125/4233] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:58 2022] GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8 => generated 1511 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:59.235212 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cf28b02e-5bda-4361-907a-88307c30fa7d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:59.244380 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cf28b02e-5bda-4361-907a-88307c30fa7d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.351903 Oct 18 15:43:59.247373 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2109/4234] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:58 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:59.274989 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3534d413-5a64-4838-b27b-3754faf33257 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:59.276196 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3534d413-5a64-4838-b27b-3754faf33257 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:59.287888 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3534d413-5a64-4838-b27b-3754faf33257 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:59.288384 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3534d413-5a64-4838-b27b-3754faf33257 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:59.288847 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3534d413-5a64-4838-b27b-3754faf33257 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:59.289575 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3534d413-5a64-4838-b27b-3754faf33257 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:59.290036 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3534d413-5a64-4838-b27b-3754faf33257 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:59.290466 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3534d413-5a64-4838-b27b-3754faf33257 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:59.345630 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e8558a29-9e64-4a29-9619-8fe8360f56e2 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:59.346406 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e8558a29-9e64-4a29-9619-8fe8360f56e2 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: a49f5b92-61e2-44bd-92a9-2bbaa1fb8975] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:43:59.362518 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8558a29-9e64-4a29-9619-8fe8360f56e2 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:59.363139 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8558a29-9e64-4a29-9619-8fe8360f56e2 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:59.363594 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8558a29-9e64-4a29-9619-8fe8360f56e2 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:59.364318 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8558a29-9e64-4a29-9619-8fe8360f56e2 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:43:59.364772 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8558a29-9e64-4a29-9619-8fe8360f56e2 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:43:59.365417 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8558a29-9e64-4a29-9619-8fe8360f56e2 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:43:59.822293 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e8558a29-9e64-4a29-9619-8fe8360f56e2 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:59.836382 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3534d413-5a64-4838-b27b-3754faf33257 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:43:59.846367 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e8558a29-9e64-4a29-9619-8fe8360f56e2 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975" status: 200 len: 1523 microversion: 2.1 time: 0.505292 Oct 18 15:43:59.846961 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2110/4235] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:59 2022] GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975 => generated 1523 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:43:59.847252 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3534d413-5a64-4838-b27b-3754faf33257 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.574014 Oct 18 15:43:59.847986 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2126/4236] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:59 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:43:59.966624 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-64a152e6-2ce0-448c-95c5-0c32a2925682 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:43:59.967391 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-64a152e6-2ce0-448c-95c5-0c32a2925682 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: e6019a42-1115-4a7b-bfab-badb33cafed8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:00.000554 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64a152e6-2ce0-448c-95c5-0c32a2925682 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:00.001285 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64a152e6-2ce0-448c-95c5-0c32a2925682 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:00.002077 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64a152e6-2ce0-448c-95c5-0c32a2925682 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:00.009805 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64a152e6-2ce0-448c-95c5-0c32a2925682 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:00.010308 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64a152e6-2ce0-448c-95c5-0c32a2925682 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:00.010752 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64a152e6-2ce0-448c-95c5-0c32a2925682 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:00.316923 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2f06d1ab-8c60-414e-91fa-e648bb2a4fc8 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-400674", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "b55b6f02-72e3-4b31-a708-98b6291bed4c"}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:44:00.383019 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-64a152e6-2ce0-448c-95c5-0c32a2925682 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:00.410253 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-64a152e6-2ce0-448c-95c5-0c32a2925682 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8" status: 200 len: 1511 microversion: 2.1 time: 0.430464 Oct 18 15:44:00.411130 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2111/4237] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:43:59 2022] GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8 => generated 1511 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:00.640848 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.security_group_api [None req-2f06d1ab-8c60-414e-91fa-e648bb2a4fc8 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Neutron security group does_not_exist not found {{(pid=120405) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 18 15:44:00.641367 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-2f06d1ab-8c60-414e-91fa-e648bb2a4fc8 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 18 15:44:00.649600 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2f06d1ab-8c60-414e-91fa-e648bb2a4fc8 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Request method failure captured: Oct 18 15:44:00.649600 n-d-853682-5 devstack@n-api.service[120405]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 15:44:00.649600 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:44:00.649600 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:44:00.649600 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:44:00.649600 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 254 Oct 18 15:44:00.649600 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:44:00.649600 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:44:00.649600 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:44:00.649600 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:44:00.649600 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTslxbnvpe5yiGf5CWZMgShC81OiGKrcSLYZFSWKOLbaqqF5kNJvh8cijdldsPo1OHjHXDcbdPuhTuFRNRswVq0HwpXLNCfOWcF3GU1M8LHkZwXu6ScaOEIHyQ8ewFnAFL7TXd1O14t3atsv_uM6Xc9ZHSfefERCjuehdw5SJuAn7MMs Oct 18 15:44:00.649600 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:44:00.649600 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:44:00.649600 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:44:00.649600 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:44:00.649600 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:44:00.649600 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:44:00.649600 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:44:00.649600 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:00.649600 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:44:00.649600 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:44:00.649600 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:44:00.649600 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:00.649600 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:44:00.649600 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:00.649600 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:44:00.649600 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:44:00.649600 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:44:00.649600 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 96c4378d52d1489bb2d50e84cabf95eb Oct 18 15:44:00.649600 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:44:00.649600 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:44:00.649600 n-d-853682-5 devstack@n-api.service[120405]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-400674", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "b55b6f02-72e3-4b31-a708-98b6291bed4c"}]}} Oct 18 15:44:00.649600 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:44:00.649600 n-d-853682-5 devstack@n-api.service[120405]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 18 15:44:00.649600 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-400674', 'imageRef': '8f4db252-bff6-4685-9c8d-4c5d6bd9f78b', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': 'b55b6f02-72e3-4b31-a708-98b6291bed4c'}]}}} Oct 18 15:44:00.649600 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:44:00.649600 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:00.649600 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 18 15:44:00.649600 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 18 15:44:00.649600 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:44:00.649600 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:44:00.649600 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 18 15:44:00.649600 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 18 15:44:00.649600 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 18 15:44:00.649600 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:00.649600 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:44:00.649600 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:00.649600 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:00.649600 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 18 15:44:00.649600 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 18 15:44:00.649600 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:44:00.649600 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:44:00.649600 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 18 15:44:00.649600 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 18 15:44:00.649600 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 18 15:44:00.649600 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:00.649600 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:44:00.649600 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:00.649600 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:00.649600 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 18 15:44:00.649600 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 18 15:44:00.656422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 18 15:44:00.656422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 18 15:44:00.656422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 18 15:44:00.656422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 18 15:44:00.656422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:44:00.656422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:44:00.656422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 18 15:44:00.656422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 18 15:44:00.656422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 18 15:44:00.656422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:00.656422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:44:00.656422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:00.656422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:00.656422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 18 15:44:00.656422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 18 15:44:00.656422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 18 15:44:00.656422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 18 15:44:00.656422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 18 15:44:00.656422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 18 15:44:00.656422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 18 15:44:00.656422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 18 15:44:00.656422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 18 15:44:00.656422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 18 15:44:00.656422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 18 15:44:00.656422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 15:44:00.656422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 18 15:44:00.656422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:00.656422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:44:00.656422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:00.656422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:00.656422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:44:00.656422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:44:00.656422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:44:00.656422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:44:00.656422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:44:00.656422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:44:00.656422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:44:00.656422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:44:00.656422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:44:00.656422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:44:00.656422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:44:00.656422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:44:00.656422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 18 15:44:00.656422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 18 15:44:00.656422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 18 15:44:00.656422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 18 15:44:00.656422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:00.656422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:44:00.656422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:00.656422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:00.656422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:44:00.656422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:44:00.656422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:44:00.656422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:44:00.656422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 18 15:44:00.656422 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:00.656422 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2f06d1ab-8c60-414e-91fa-e648bb2a4fc8 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:44:00.665156 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2f06d1ab-8c60-414e-91fa-e648bb2a4fc8 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.338893 Oct 18 15:44:00.665156 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2127/4238] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:44:00 2022] POST /compute/v2.1/servers => generated 106 bytes in 341 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:44:00.685483 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d1421c2d-8e54-418f-b6cc-f0dbec57ef27 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:00.687374 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d1421c2d-8e54-418f-b6cc-f0dbec57ef27 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:00.719136 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1421c2d-8e54-418f-b6cc-f0dbec57ef27 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:00.728526 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1421c2d-8e54-418f-b6cc-f0dbec57ef27 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:00.729395 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1421c2d-8e54-418f-b6cc-f0dbec57ef27 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:00.730616 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1421c2d-8e54-418f-b6cc-f0dbec57ef27 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:00.731416 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1421c2d-8e54-418f-b6cc-f0dbec57ef27 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:00.732145 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1421c2d-8e54-418f-b6cc-f0dbec57ef27 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:00.895095 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b86924a4-2f0c-453f-af26-804407b23c98 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:00.896457 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b86924a4-2f0c-453f-af26-804407b23c98 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: a49f5b92-61e2-44bd-92a9-2bbaa1fb8975] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:00.925325 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b86924a4-2f0c-453f-af26-804407b23c98 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:00.925825 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b86924a4-2f0c-453f-af26-804407b23c98 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:00.926279 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b86924a4-2f0c-453f-af26-804407b23c98 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:00.927009 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b86924a4-2f0c-453f-af26-804407b23c98 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:00.927474 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b86924a4-2f0c-453f-af26-804407b23c98 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:00.927986 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b86924a4-2f0c-453f-af26-804407b23c98 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:01.266630 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d1421c2d-8e54-418f-b6cc-f0dbec57ef27 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:01.278336 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d1421c2d-8e54-418f-b6cc-f0dbec57ef27 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.619408 Oct 18 15:44:01.304790 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2112/4239] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:00 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:01.317765 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e755b908-598f-4f7e-90f2-23c3e499032e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:01.318518 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e755b908-598f-4f7e-90f2-23c3e499032e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:01.327762 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e755b908-598f-4f7e-90f2-23c3e499032e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:01.328645 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e755b908-598f-4f7e-90f2-23c3e499032e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:01.330261 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e755b908-598f-4f7e-90f2-23c3e499032e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:01.331160 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e755b908-598f-4f7e-90f2-23c3e499032e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:01.331900 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e755b908-598f-4f7e-90f2-23c3e499032e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:01.332490 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e755b908-598f-4f7e-90f2-23c3e499032e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:01.523292 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b86924a4-2f0c-453f-af26-804407b23c98 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:01.562191 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b86924a4-2f0c-453f-af26-804407b23c98 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975" status: 200 len: 1523 microversion: 2.1 time: 0.674731 Oct 18 15:44:01.569873 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2128/4240] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:00 2022] GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975 => generated 1523 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:01.585400 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-11bcb1e2-d145-4a32-8b81-3b201df0e8f5 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:01.586480 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-11bcb1e2-d145-4a32-8b81-3b201df0e8f5 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: e6019a42-1115-4a7b-bfab-badb33cafed8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:01.631682 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-11bcb1e2-d145-4a32-8b81-3b201df0e8f5 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:01.632517 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-11bcb1e2-d145-4a32-8b81-3b201df0e8f5 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:01.633299 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-11bcb1e2-d145-4a32-8b81-3b201df0e8f5 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:01.643405 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-11bcb1e2-d145-4a32-8b81-3b201df0e8f5 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:01.644254 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-11bcb1e2-d145-4a32-8b81-3b201df0e8f5 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:01.645046 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-11bcb1e2-d145-4a32-8b81-3b201df0e8f5 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:01.645411 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e755b908-598f-4f7e-90f2-23c3e499032e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:01.658885 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e755b908-598f-4f7e-90f2-23c3e499032e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.345218 Oct 18 15:44:01.680541 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2113/4241] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:01 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:01.704738 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-99093fa7-8a4b-4fc7-824b-ef363f4c95f3 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:01.740477 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-99093fa7-8a4b-4fc7-824b-ef363f4c95f3 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 7590858e-2139-4e12-b197-675912185ab7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:01.758693 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-99093fa7-8a4b-4fc7-824b-ef363f4c95f3 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] HTTP exception thrown: Instance 7590858e-2139-4e12-b197-675912185ab7 could not be found. Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-99093fa7-8a4b-4fc7-824b-ef363f4c95f3 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Request method failure captured: Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/7590858e-2139-4e12-b197-675912185ab7 HTTP/1.1 Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTslxbnvpe5yiGf5CWZMgShC81OiGKrcSLYZFSWKOLbaqqF5kNJvh8cijdldsPo1OHjHXDcbdPuhTuFRNRswVq0HwpXLNCfOWcF3GU1M8LHkZwXu6ScaOEIHyQ8ewFnAFL7TXd1O14t3atsv_uM6Xc9ZHSfefERCjuehdw5SJuAn7MMs Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 96c4378d52d1489bb2d50e84cabf95eb Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 7590858e-2139-4e12-b197-675912185ab7 could not be found. Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '7590858e-2139-4e12-b197-675912185ab7'} Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7590858e-2139-4e12-b197-675912185ab7 could not be found. Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7590858e-2139-4e12-b197-675912185ab7 could not be found. Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:01.765005 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:44:01.771765 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:01.771765 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:01.771765 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:44:01.771765 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:44:01.771765 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:44:01.771765 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:44:01.771765 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7590858e-2139-4e12-b197-675912185ab7 could not be found. Oct 18 15:44:01.771765 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:01.778309 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-99093fa7-8a4b-4fc7-824b-ef363f4c95f3 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Returning 404 to user: Instance 7590858e-2139-4e12-b197-675912185ab7 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:44:01.781389 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-99093fa7-8a4b-4fc7-824b-ef363f4c95f3 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7590858e-2139-4e12-b197-675912185ab7" status: 404 len: 111 microversion: 2.1 time: 0.094828 Oct 18 15:44:01.785415 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2114/4242] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:44:01 2022] DELETE /compute/v2.1/servers/7590858e-2139-4e12-b197-675912185ab7 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:44:01.798786 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e4e9ac7d-3dc9-4959-8bf4-c1773b1ad599 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:01.800325 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e4e9ac7d-3dc9-4959-8bf4-c1773b1ad599 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:01.819148 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4e9ac7d-3dc9-4959-8bf4-c1773b1ad599 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:01.820254 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4e9ac7d-3dc9-4959-8bf4-c1773b1ad599 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:01.821123 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4e9ac7d-3dc9-4959-8bf4-c1773b1ad599 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:01.822532 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4e9ac7d-3dc9-4959-8bf4-c1773b1ad599 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:01.823534 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4e9ac7d-3dc9-4959-8bf4-c1773b1ad599 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:01.824521 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4e9ac7d-3dc9-4959-8bf4-c1773b1ad599 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:02.012772 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-11bcb1e2-d145-4a32-8b81-3b201df0e8f5 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:02.034765 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-11bcb1e2-d145-4a32-8b81-3b201df0e8f5 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8" status: 200 len: 1511 microversion: 2.1 time: 0.462832 Oct 18 15:44:02.039161 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2129/4243] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:01 2022] GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8 => generated 1511 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:02.189849 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e4e9ac7d-3dc9-4959-8bf4-c1773b1ad599 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:02.203065 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e4e9ac7d-3dc9-4959-8bf4-c1773b1ad599 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.412496 Oct 18 15:44:02.204093 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2115/4244] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:01 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:02.234815 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dd5528fc-de79-4e4f-ae69-efea640844c8 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:02.235791 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dd5528fc-de79-4e4f-ae69-efea640844c8 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:02.247331 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd5528fc-de79-4e4f-ae69-efea640844c8 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:02.251794 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd5528fc-de79-4e4f-ae69-efea640844c8 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:02.252688 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd5528fc-de79-4e4f-ae69-efea640844c8 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:02.254442 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd5528fc-de79-4e4f-ae69-efea640844c8 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:02.257109 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd5528fc-de79-4e4f-ae69-efea640844c8 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:02.258833 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd5528fc-de79-4e4f-ae69-efea640844c8 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:02.472870 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dd5528fc-de79-4e4f-ae69-efea640844c8 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:02.502936 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dd5528fc-de79-4e4f-ae69-efea640844c8 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.272956 Oct 18 15:44:02.503500 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2116/4245] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:02 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:44:02.534879 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-415b060a-e383-4c69-8f26-4fa4e05ddb87 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:02.535453 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-415b060a-e383-4c69-8f26-4fa4e05ddb87 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Failed to fetch instance by id 9223372036854775808 {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 18 15:44:02.536390 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-415b060a-e383-4c69-8f26-4fa4e05ddb87 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-415b060a-e383-4c69-8f26-4fa4e05ddb87 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Request method failure captured: Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTslxbnvpe5yiGf5CWZMgShC81OiGKrcSLYZFSWKOLbaqqF5kNJvh8cijdldsPo1OHjHXDcbdPuhTuFRNRswVq0HwpXLNCfOWcF3GU1M8LHkZwXu6ScaOEIHyQ8ewFnAFL7TXd1O14t3atsv_uM6Xc9ZHSfefERCjuehdw5SJuAn7MMs Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 96c4378d52d1489bb2d50e84cabf95eb Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 9223372036854775808 could not be found. Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '9223372036854775808'} Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:02.539073 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:44:02.546891 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:44:02.546891 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:44:02.546891 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:44:02.546891 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 18 15:44:02.546891 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:02.546891 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-415b060a-e383-4c69-8f26-4fa4e05ddb87 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:44:02.546891 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-415b060a-e383-4c69-8f26-4fa4e05ddb87 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.012605 Oct 18 15:44:02.546891 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2117/4246] 10.222.0.60 () {58 vars in 1188 bytes} [Tue Oct 18 15:44:02 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 15:44:02.552732 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1c4d73e4-480d-41f5-bda5-3fb7323dea37 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:02.554217 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1c4d73e4-480d-41f5-bda5-3fb7323dea37 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:02.562533 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f75c2229-d95d-4dbf-8339-272cbc4a7a05 tempest-AbsoluteLimitsTestJSON-39889594 tempest-AbsoluteLimitsTestJSON-39889594-project] Calling method '.version_select at 0x7f7c3d33d0d0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:02.563007 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1c4d73e4-480d-41f5-bda5-3fb7323dea37 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:02.563556 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1c4d73e4-480d-41f5-bda5-3fb7323dea37 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:02.564130 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1c4d73e4-480d-41f5-bda5-3fb7323dea37 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:02.565199 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1c4d73e4-480d-41f5-bda5-3fb7323dea37 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:02.565779 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1c4d73e4-480d-41f5-bda5-3fb7323dea37 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:02.566774 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1c4d73e4-480d-41f5-bda5-3fb7323dea37 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:02.590667 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:44:02.607099 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f75c2229-d95d-4dbf-8339-272cbc4a7a05 tempest-AbsoluteLimitsTestJSON-39889594 tempest-AbsoluteLimitsTestJSON-39889594-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:02.607797 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f75c2229-d95d-4dbf-8339-272cbc4a7a05 tempest-AbsoluteLimitsTestJSON-39889594 tempest-AbsoluteLimitsTestJSON-39889594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:02.609414 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f75c2229-d95d-4dbf-8339-272cbc4a7a05 tempest-AbsoluteLimitsTestJSON-39889594 tempest-AbsoluteLimitsTestJSON-39889594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:02.610201 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f75c2229-d95d-4dbf-8339-272cbc4a7a05 tempest-AbsoluteLimitsTestJSON-39889594 tempest-AbsoluteLimitsTestJSON-39889594-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:02.610680 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f75c2229-d95d-4dbf-8339-272cbc4a7a05 tempest-AbsoluteLimitsTestJSON-39889594 tempest-AbsoluteLimitsTestJSON-39889594-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:02.614349 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f75c2229-d95d-4dbf-8339-272cbc4a7a05 tempest-AbsoluteLimitsTestJSON-39889594 tempest-AbsoluteLimitsTestJSON-39889594-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:02.704851 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f75c2229-d95d-4dbf-8339-272cbc4a7a05 tempest-AbsoluteLimitsTestJSON-39889594 tempest-AbsoluteLimitsTestJSON-39889594-project] 10.222.0.60 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.663788 Oct 18 15:44:02.707225 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2130/4247] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Oct 18 15:44:02 2022] GET /compute/v2.1/limits => generated 511 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:44:02.721009 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c8e1e82d-6255-4e6c-b7c1-201445ccbf83 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:02.721636 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c8e1e82d-6255-4e6c-b7c1-201445ccbf83 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: a49f5b92-61e2-44bd-92a9-2bbaa1fb8975] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:02.744376 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c8e1e82d-6255-4e6c-b7c1-201445ccbf83 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:02.744924 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c8e1e82d-6255-4e6c-b7c1-201445ccbf83 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:02.748179 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c8e1e82d-6255-4e6c-b7c1-201445ccbf83 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:02.749078 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c8e1e82d-6255-4e6c-b7c1-201445ccbf83 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:02.749573 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c8e1e82d-6255-4e6c-b7c1-201445ccbf83 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:02.750022 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c8e1e82d-6255-4e6c-b7c1-201445ccbf83 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:02.884792 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1c4d73e4-480d-41f5-bda5-3fb7323dea37 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:02.901005 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1c4d73e4-480d-41f5-bda5-3fb7323dea37 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.354187 Oct 18 15:44:02.904675 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2118/4248] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:02 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:02.929495 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f94ccfb7-56cc-463d-a5e7-322be169b083 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:02.930123 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f94ccfb7-56cc-463d-a5e7-322be169b083 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:02.937800 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f94ccfb7-56cc-463d-a5e7-322be169b083 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:02.938296 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f94ccfb7-56cc-463d-a5e7-322be169b083 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:02.938978 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f94ccfb7-56cc-463d-a5e7-322be169b083 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:02.939930 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f94ccfb7-56cc-463d-a5e7-322be169b083 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:02.941616 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f94ccfb7-56cc-463d-a5e7-322be169b083 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:02.942239 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f94ccfb7-56cc-463d-a5e7-322be169b083 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:03.090912 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c8e1e82d-6255-4e6c-b7c1-201445ccbf83 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:03.102949 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c8e1e82d-6255-4e6c-b7c1-201445ccbf83 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975" status: 200 len: 1523 microversion: 2.1 time: 0.392971 Oct 18 15:44:03.106872 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2131/4249] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:02 2022] GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975 => generated 1523 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:03.115867 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f638f586-2f60-484a-9895-a669e0e361d4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:03.116860 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f638f586-2f60-484a-9895-a669e0e361d4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: e6019a42-1115-4a7b-bfab-badb33cafed8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:03.140287 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f638f586-2f60-484a-9895-a669e0e361d4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:03.140991 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f638f586-2f60-484a-9895-a669e0e361d4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:03.141510 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f638f586-2f60-484a-9895-a669e0e361d4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:03.149671 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f638f586-2f60-484a-9895-a669e0e361d4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:03.150351 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f638f586-2f60-484a-9895-a669e0e361d4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:03.152338 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f638f586-2f60-484a-9895-a669e0e361d4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:03.218794 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f94ccfb7-56cc-463d-a5e7-322be169b083 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:03.228286 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f94ccfb7-56cc-463d-a5e7-322be169b083 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.302758 Oct 18 15:44:03.232144 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2119/4250] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:02 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:03.265476 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ad508ed6-a8ff-49eb-860e-0859078dbaac tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:03.266228 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ad508ed6-a8ff-49eb-860e-0859078dbaac tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Failed to fetch instance by id -1 {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 18 15:44:03.266897 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-ad508ed6-a8ff-49eb-860e-0859078dbaac tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] HTTP exception thrown: Instance -1 could not be found. Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ad508ed6-a8ff-49eb-860e-0859078dbaac tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Request method failure captured: Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTslxbnvpe5yiGf5CWZMgShC81OiGKrcSLYZFSWKOLbaqqF5kNJvh8cijdldsPo1OHjHXDcbdPuhTuFRNRswVq0HwpXLNCfOWcF3GU1M8LHkZwXu6ScaOEIHyQ8ewFnAFL7TXd1O14t3atsv_uM6Xc9ZHSfefERCjuehdw5SJuAn7MMs Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 96c4378d52d1489bb2d50e84cabf95eb Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance -1 could not be found. Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '-1'} Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:44:03.268659 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:44:03.273208 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:44:03.273208 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:44:03.273208 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 18 15:44:03.273208 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:03.274123 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ad508ed6-a8ff-49eb-860e-0859078dbaac tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Returning 404 to user: Instance -1 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:44:03.279310 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ad508ed6-a8ff-49eb-860e-0859078dbaac tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.019477 Oct 18 15:44:03.280159 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2120/4251] 10.222.0.60 () {58 vars in 1137 bytes} [Tue Oct 18 15:44:03 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 18 15:44:03.291968 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8b6257d1-6a86-4e1c-857c-6ace88424fe9 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:03.294491 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8b6257d1-6a86-4e1c-857c-6ace88424fe9 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:03.312933 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b6257d1-6a86-4e1c-857c-6ace88424fe9 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:03.313425 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b6257d1-6a86-4e1c-857c-6ace88424fe9 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:03.313865 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b6257d1-6a86-4e1c-857c-6ace88424fe9 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:03.314584 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b6257d1-6a86-4e1c-857c-6ace88424fe9 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:03.315034 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b6257d1-6a86-4e1c-857c-6ace88424fe9 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:03.315454 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b6257d1-6a86-4e1c-857c-6ace88424fe9 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:03.556916 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8b6257d1-6a86-4e1c-857c-6ace88424fe9 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:03.558889 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f638f586-2f60-484a-9895-a669e0e361d4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:03.568506 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f638f586-2f60-484a-9895-a669e0e361d4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8" status: 200 len: 1511 microversion: 2.1 time: 0.458675 Oct 18 15:44:03.572783 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8b6257d1-6a86-4e1c-857c-6ace88424fe9 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.285473 Oct 18 15:44:03.573958 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2121/4253] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:03 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:03.581253 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2132/4253] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:03 2022] GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8 => generated 1511 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:03.598442 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2137832a-9a0b-43c3-9b43-7d29f4e43fd6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:03.599151 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2137832a-9a0b-43c3-9b43-7d29f4e43fd6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:03.606086 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2137832a-9a0b-43c3-9b43-7d29f4e43fd6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:03.606986 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2137832a-9a0b-43c3-9b43-7d29f4e43fd6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:03.607693 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2137832a-9a0b-43c3-9b43-7d29f4e43fd6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:03.609319 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2137832a-9a0b-43c3-9b43-7d29f4e43fd6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:03.610077 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2137832a-9a0b-43c3-9b43-7d29f4e43fd6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:03.610730 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2137832a-9a0b-43c3-9b43-7d29f4e43fd6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:03.833313 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2137832a-9a0b-43c3-9b43-7d29f4e43fd6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:03.844954 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2137832a-9a0b-43c3-9b43-7d29f4e43fd6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.250616 Oct 18 15:44:03.845705 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2122/4254] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:03 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:03.871676 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e696f2ca-a7a1-44ee-9b80-830f1e8a9b7d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:44:03.872467 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e696f2ca-a7a1-44ee-9b80-830f1e8a9b7d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 624da941-8df6-43c6-9862-c56fa44e2c9d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:03.883904 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-e696f2ca-a7a1-44ee-9b80-830f1e8a9b7d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] HTTP exception thrown: Instance 624da941-8df6-43c6-9862-c56fa44e2c9d could not be found. Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e696f2ca-a7a1-44ee-9b80-830f1e8a9b7d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Request method failure captured: Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: request: POST /compute/v2.1/servers/624da941-8df6-43c6-9862-c56fa44e2c9d/action HTTP/1.1 Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 19 Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTslxbnvpe5yiGf5CWZMgShC81OiGKrcSLYZFSWKOLbaqqF5kNJvh8cijdldsPo1OHjHXDcbdPuhTuFRNRswVq0HwpXLNCfOWcF3GU1M8LHkZwXu6ScaOEIHyQ8ewFnAFL7TXd1O14t3atsv_uM6Xc9ZHSfefERCjuehdw5SJuAn7MMs Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 96c4378d52d1489bb2d50e84cabf95eb Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: {"forceDelete": {}} Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 624da941-8df6-43c6-9862-c56fa44e2c9d could not be found. Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '624da941-8df6-43c6-9862-c56fa44e2c9d', 'body': {'forceDelete': {}}} Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 624da941-8df6-43c6-9862-c56fa44e2c9d could not be found. Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 624da941-8df6-43c6-9862-c56fa44e2c9d could not be found. Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:44:03.895616 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:44:03.899325 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:44:03.899325 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:44:03.899325 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 624da941-8df6-43c6-9862-c56fa44e2c9d could not be found. Oct 18 15:44:03.899325 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:03.899325 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e696f2ca-a7a1-44ee-9b80-830f1e8a9b7d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Returning 404 to user: Instance 624da941-8df6-43c6-9862-c56fa44e2c9d could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:44:03.899325 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e696f2ca-a7a1-44ee-9b80-830f1e8a9b7d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "POST /compute/v2.1/servers/624da941-8df6-43c6-9862-c56fa44e2c9d/action" status: 404 len: 111 microversion: 2.1 time: 0.032287 Oct 18 15:44:03.899325 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2133/4255] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:44:03 2022] POST /compute/v2.1/servers/624da941-8df6-43c6-9862-c56fa44e2c9d/action => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:44:03.905946 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9f0dbb7f-bd39-434e-98b2-db5bc6e8aa98 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:03.906571 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9f0dbb7f-bd39-434e-98b2-db5bc6e8aa98 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:03.914470 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f0dbb7f-bd39-434e-98b2-db5bc6e8aa98 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:03.914973 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f0dbb7f-bd39-434e-98b2-db5bc6e8aa98 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:03.915408 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f0dbb7f-bd39-434e-98b2-db5bc6e8aa98 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:03.916113 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f0dbb7f-bd39-434e-98b2-db5bc6e8aa98 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:03.916559 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f0dbb7f-bd39-434e-98b2-db5bc6e8aa98 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:03.922955 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f0dbb7f-bd39-434e-98b2-db5bc6e8aa98 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:04.130232 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5a518f46-cb76-4d0c-be48-dac9baa71bb3 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:04.132001 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5a518f46-cb76-4d0c-be48-dac9baa71bb3 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: a49f5b92-61e2-44bd-92a9-2bbaa1fb8975] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:04.148663 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5a518f46-cb76-4d0c-be48-dac9baa71bb3 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:04.149780 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5a518f46-cb76-4d0c-be48-dac9baa71bb3 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:04.151975 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5a518f46-cb76-4d0c-be48-dac9baa71bb3 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:04.152964 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5a518f46-cb76-4d0c-be48-dac9baa71bb3 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:04.154042 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5a518f46-cb76-4d0c-be48-dac9baa71bb3 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:04.172377 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5a518f46-cb76-4d0c-be48-dac9baa71bb3 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:04.189325 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9f0dbb7f-bd39-434e-98b2-db5bc6e8aa98 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:04.198683 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9f0dbb7f-bd39-434e-98b2-db5bc6e8aa98 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.296509 Oct 18 15:44:04.205945 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2123/4256] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:03 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:04.227928 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4a966c3c-fabf-43dc-bd44-833e3ff188a5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:04.229051 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4a966c3c-fabf-43dc-bd44-833e3ff188a5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:04.237117 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a966c3c-fabf-43dc-bd44-833e3ff188a5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:04.237620 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a966c3c-fabf-43dc-bd44-833e3ff188a5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:04.238064 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a966c3c-fabf-43dc-bd44-833e3ff188a5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:04.238771 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a966c3c-fabf-43dc-bd44-833e3ff188a5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:04.246189 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a966c3c-fabf-43dc-bd44-833e3ff188a5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:04.246551 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a966c3c-fabf-43dc-bd44-833e3ff188a5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:04.669937 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4a966c3c-fabf-43dc-bd44-833e3ff188a5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:04.683843 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4a966c3c-fabf-43dc-bd44-833e3ff188a5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.459317 Oct 18 15:44:04.692382 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2124/4257] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:04 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:44:04.713024 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5a518f46-cb76-4d0c-be48-dac9baa71bb3 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:04.721515 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e7f93787-e7fc-4e47-b205-cc28bd33b7f4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:04.724151 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e7f93787-e7fc-4e47-b205-cc28bd33b7f4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: e6019a42-1115-4a7b-bfab-badb33cafed8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:04.732145 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5a518f46-cb76-4d0c-be48-dac9baa71bb3 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975" status: 200 len: 1523 microversion: 2.1 time: 0.604330 Oct 18 15:44:04.732145 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2134/4258] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:04 2022] GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975 => generated 1523 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:04.744672 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-55e5addb-0a99-4b3b-bea0-e9b5953e4f1a tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:44:04.749228 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-55e5addb-0a99-4b3b-bea0-e9b5953e4f1a tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: ef0cd4f7-f88b-409c-b037-222819feaa7c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:04.756659 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-55e5addb-0a99-4b3b-bea0-e9b5953e4f1a tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] HTTP exception thrown: Instance ef0cd4f7-f88b-409c-b037-222819feaa7c could not be found. Oct 18 15:44:04.761768 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7f93787-e7fc-4e47-b205-cc28bd33b7f4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:04.762277 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7f93787-e7fc-4e47-b205-cc28bd33b7f4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:04.762717 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7f93787-e7fc-4e47-b205-cc28bd33b7f4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-55e5addb-0a99-4b3b-bea0-e9b5953e4f1a tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Request method failure captured: Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: request: POST /compute/v2.1/servers/ef0cd4f7-f88b-409c-b037-222819feaa7c/action HTTP/1.1 Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 39 Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTslxbnvpe5yiGf5CWZMgShC81OiGKrcSLYZFSWKOLbaqqF5kNJvh8cijdldsPo1OHjHXDcbdPuhTuFRNRswVq0HwpXLNCfOWcF3GU1M8LHkZwXu6ScaOEIHyQ8ewFnAFL7TXd1O14t3atsv_uM6Xc9ZHSfefERCjuehdw5SJuAn7MMs Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 96c4378d52d1489bb2d50e84cabf95eb Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: {"os-getConsoleOutput": {"length": 10}} Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance ef0cd4f7-f88b-409c-b037-222819feaa7c could not be found. Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'ef0cd4f7-f88b-409c-b037-222819feaa7c', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef0cd4f7-f88b-409c-b037-222819feaa7c could not be found. Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef0cd4f7-f88b-409c-b037-222819feaa7c could not be found. Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:04.763787 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:04.768829 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:44:04.768829 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:44:04.768829 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:44:04.768829 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:44:04.768829 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef0cd4f7-f88b-409c-b037-222819feaa7c could not be found. Oct 18 15:44:04.768829 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:04.769254 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7f93787-e7fc-4e47-b205-cc28bd33b7f4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:04.769254 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7f93787-e7fc-4e47-b205-cc28bd33b7f4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:04.769254 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7f93787-e7fc-4e47-b205-cc28bd33b7f4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:04.774692 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-55e5addb-0a99-4b3b-bea0-e9b5953e4f1a tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Returning 404 to user: Instance ef0cd4f7-f88b-409c-b037-222819feaa7c could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:44:04.776159 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-55e5addb-0a99-4b3b-bea0-e9b5953e4f1a tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0cd4f7-f88b-409c-b037-222819feaa7c/action" status: 404 len: 111 microversion: 2.1 time: 0.041354 Oct 18 15:44:04.777155 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2135/4259] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:44:04 2022] POST /compute/v2.1/servers/ef0cd4f7-f88b-409c-b037-222819feaa7c/action => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:44:04.785881 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5816bd76-e2d7-4db2-8ede-4bd66da71f3c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:04.791127 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5816bd76-e2d7-4db2-8ede-4bd66da71f3c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:04.807775 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5816bd76-e2d7-4db2-8ede-4bd66da71f3c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:04.808278 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5816bd76-e2d7-4db2-8ede-4bd66da71f3c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:04.808717 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5816bd76-e2d7-4db2-8ede-4bd66da71f3c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:04.809463 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5816bd76-e2d7-4db2-8ede-4bd66da71f3c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:04.809920 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5816bd76-e2d7-4db2-8ede-4bd66da71f3c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:04.810346 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5816bd76-e2d7-4db2-8ede-4bd66da71f3c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:05.195158 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5816bd76-e2d7-4db2-8ede-4bd66da71f3c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:05.210500 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5816bd76-e2d7-4db2-8ede-4bd66da71f3c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.428444 Oct 18 15:44:05.212647 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2136/4260] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:04 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:05.242650 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5db08759-0f60-4ff6-b5e7-84fd6df7f290 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:05.243623 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5db08759-0f60-4ff6-b5e7-84fd6df7f290 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:05.261541 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5db08759-0f60-4ff6-b5e7-84fd6df7f290 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:05.262533 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5db08759-0f60-4ff6-b5e7-84fd6df7f290 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:05.265263 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5db08759-0f60-4ff6-b5e7-84fd6df7f290 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:05.266466 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5db08759-0f60-4ff6-b5e7-84fd6df7f290 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:05.267011 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e7f93787-e7fc-4e47-b205-cc28bd33b7f4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:05.269938 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5db08759-0f60-4ff6-b5e7-84fd6df7f290 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:05.270734 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5db08759-0f60-4ff6-b5e7-84fd6df7f290 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:05.275301 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e7f93787-e7fc-4e47-b205-cc28bd33b7f4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8" status: 200 len: 1511 microversion: 2.1 time: 0.581450 Oct 18 15:44:05.282153 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2125/4261] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:04 2022] GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8 => generated 1511 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:05.630034 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5db08759-0f60-4ff6-b5e7-84fd6df7f290 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:05.636990 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=100 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:44:05.644381 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5db08759-0f60-4ff6-b5e7-84fd6df7f290 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.407639 Oct 18 15:44:05.646003 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2137/4262] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:05 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:44:05.674726 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-94074ac3-02a4-4a50-b2e1-5d61b7a3de63 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:05.675344 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-94074ac3-02a4-4a50-b2e1-5d61b7a3de63 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: abb589ab-4fd2-4392-84fb-64908f58b36f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:05.687912 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-94074ac3-02a4-4a50-b2e1-5d61b7a3de63 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] HTTP exception thrown: Instance abb589ab-4fd2-4392-84fb-64908f58b36f could not be found. Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-94074ac3-02a4-4a50-b2e1-5d61b7a3de63 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Request method failure captured: Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/abb589ab-4fd2-4392-84fb-64908f58b36f HTTP/1.1 Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTslxbnvpe5yiGf5CWZMgShC81OiGKrcSLYZFSWKOLbaqqF5kNJvh8cijdldsPo1OHjHXDcbdPuhTuFRNRswVq0HwpXLNCfOWcF3GU1M8LHkZwXu6ScaOEIHyQ8ewFnAFL7TXd1O14t3atsv_uM6Xc9ZHSfefERCjuehdw5SJuAn7MMs Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 96c4378d52d1489bb2d50e84cabf95eb Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance abb589ab-4fd2-4392-84fb-64908f58b36f could not be found. Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'abb589ab-4fd2-4392-84fb-64908f58b36f'} Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abb589ab-4fd2-4392-84fb-64908f58b36f could not be found. Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abb589ab-4fd2-4392-84fb-64908f58b36f could not be found. Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:05.689510 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:44:05.697082 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:44:05.697082 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:44:05.697082 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:44:05.697082 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abb589ab-4fd2-4392-84fb-64908f58b36f could not be found. Oct 18 15:44:05.697082 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:05.697082 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-94074ac3-02a4-4a50-b2e1-5d61b7a3de63 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Returning 404 to user: Instance abb589ab-4fd2-4392-84fb-64908f58b36f could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:44:05.697082 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-94074ac3-02a4-4a50-b2e1-5d61b7a3de63 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/abb589ab-4fd2-4392-84fb-64908f58b36f" status: 404 len: 111 microversion: 2.1 time: 0.021729 Oct 18 15:44:05.697082 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2126/4263] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:05 2022] GET /compute/v2.1/servers/abb589ab-4fd2-4392-84fb-64908f58b36f => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:44:05.701670 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6a12d9af-4b9a-4ac8-92c7-a104498f9fcc tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:05.701847 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6a12d9af-4b9a-4ac8-92c7-a104498f9fcc tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:05.719198 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6a12d9af-4b9a-4ac8-92c7-a104498f9fcc tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:05.719751 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6a12d9af-4b9a-4ac8-92c7-a104498f9fcc tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:05.720124 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6a12d9af-4b9a-4ac8-92c7-a104498f9fcc tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:05.720862 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6a12d9af-4b9a-4ac8-92c7-a104498f9fcc tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:05.721326 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6a12d9af-4b9a-4ac8-92c7-a104498f9fcc tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:05.721760 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6a12d9af-4b9a-4ac8-92c7-a104498f9fcc tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:05.759616 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e2b97e1e-fbe3-4348-95d9-2b416f9f0420 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:05.760243 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e2b97e1e-fbe3-4348-95d9-2b416f9f0420 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: a49f5b92-61e2-44bd-92a9-2bbaa1fb8975] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:05.771569 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2b97e1e-fbe3-4348-95d9-2b416f9f0420 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:05.772318 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2b97e1e-fbe3-4348-95d9-2b416f9f0420 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:05.772958 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2b97e1e-fbe3-4348-95d9-2b416f9f0420 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:05.785829 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2b97e1e-fbe3-4348-95d9-2b416f9f0420 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:05.786574 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2b97e1e-fbe3-4348-95d9-2b416f9f0420 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:05.787165 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2b97e1e-fbe3-4348-95d9-2b416f9f0420 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:06.122791 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e2b97e1e-fbe3-4348-95d9-2b416f9f0420 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:06.123317 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6a12d9af-4b9a-4ac8-92c7-a104498f9fcc tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:06.133209 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e2b97e1e-fbe3-4348-95d9-2b416f9f0420 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975" status: 200 len: 1523 microversion: 2.1 time: 0.377908 Oct 18 15:44:06.135821 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6a12d9af-4b9a-4ac8-92c7-a104498f9fcc tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.439156 Oct 18 15:44:06.136743 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2127/4264] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:05 2022] GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975 => generated 1523 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:44:06.149355 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2138/4265] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:05 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:06.169834 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0db012f2-a19b-4b3c-9120-47cad9889101 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:06.171300 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0db012f2-a19b-4b3c-9120-47cad9889101 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:06.178211 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0db012f2-a19b-4b3c-9120-47cad9889101 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:06.178987 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0db012f2-a19b-4b3c-9120-47cad9889101 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:06.179574 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0db012f2-a19b-4b3c-9120-47cad9889101 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:06.180432 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0db012f2-a19b-4b3c-9120-47cad9889101 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:06.181225 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0db012f2-a19b-4b3c-9120-47cad9889101 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:06.182106 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0db012f2-a19b-4b3c-9120-47cad9889101 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:06.308718 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4be3234f-4177-45c9-8a50-2b360ce1966d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:06.309376 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4be3234f-4177-45c9-8a50-2b360ce1966d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: e6019a42-1115-4a7b-bfab-badb33cafed8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:06.322538 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4be3234f-4177-45c9-8a50-2b360ce1966d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:06.323410 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4be3234f-4177-45c9-8a50-2b360ce1966d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:06.323894 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4be3234f-4177-45c9-8a50-2b360ce1966d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:06.324696 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4be3234f-4177-45c9-8a50-2b360ce1966d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:06.325468 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4be3234f-4177-45c9-8a50-2b360ce1966d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:06.329473 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4be3234f-4177-45c9-8a50-2b360ce1966d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:06.455153 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0db012f2-a19b-4b3c-9120-47cad9889101 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:06.467820 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0db012f2-a19b-4b3c-9120-47cad9889101 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.301955 Oct 18 15:44:06.471453 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2128/4266] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:06 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:06.636016 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4be3234f-4177-45c9-8a50-2b360ce1966d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:06.639333 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f69b7ee7-2e1a-459a-80cf-9c739f370352 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1327042941", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "b55b6f02-72e3-4b31-a708-98b6291bed4c"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:44:06.646762 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4be3234f-4177-45c9-8a50-2b360ce1966d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8" status: 200 len: 1511 microversion: 2.1 time: 0.342936 Oct 18 15:44:06.647351 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2139/4267] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:06 2022] GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8 => generated 1511 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f69b7ee7-2e1a-459a-80cf-9c739f370352 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Request method failure captured: Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 238 Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTslxbnvpe5yiGf5CWZMgShC81OiGKrcSLYZFSWKOLbaqqF5kNJvh8cijdldsPo1OHjHXDcbdPuhTuFRNRswVq0HwpXLNCfOWcF3GU1M8LHkZwXu6ScaOEIHyQ8ewFnAFL7TXd1O14t3atsv_uM6Xc9ZHSfefERCjuehdw5SJuAn7MMs Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 96c4378d52d1489bb2d50e84cabf95eb Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1327042941", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "b55b6f02-72e3-4b31-a708-98b6291bed4c"}]}} Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1327042941', 'imageRef': '8f4db252-bff6-4685-9c8d-4c5d6bd9f78b', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': 'b55b6f02-72e3-4b31-a708-98b6291bed4c'}]}}} Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise error Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:06.660559 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:06.665435 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:44:06.665435 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:44:06.665435 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:44:06.665435 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:44:06.665435 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:44:06.665435 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:44:06.665435 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:44:06.665435 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:44:06.665435 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 15:44:06.665435 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 15:44:06.665435 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 15:44:06.665435 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 15:44:06.665435 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 15:44:06.665435 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 15:44:06.665435 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 18 15:44:06.665435 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:06.665435 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:44:06.665435 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:06.665435 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:06.665435 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:44:06.665435 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:44:06.665435 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 15:44:06.665435 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 15:44:06.665435 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 18 15:44:06.665435 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:06.665435 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f69b7ee7-2e1a-459a-80cf-9c739f370352 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:44:06.665435 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f69b7ee7-2e1a-459a-80cf-9c739f370352 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.028727 Oct 18 15:44:06.669038 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2129/4268] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:44:06 2022] POST /compute/v2.1/servers => generated 139 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 18 15:44:06.675270 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a2546a8e-eaae-4545-9978-49efbc4ffeb2 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:06.676691 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a2546a8e-eaae-4545-9978-49efbc4ffeb2 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:06.701336 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a2546a8e-eaae-4545-9978-49efbc4ffeb2 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:06.702116 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a2546a8e-eaae-4545-9978-49efbc4ffeb2 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:06.702739 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a2546a8e-eaae-4545-9978-49efbc4ffeb2 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:06.704241 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a2546a8e-eaae-4545-9978-49efbc4ffeb2 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:06.704905 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a2546a8e-eaae-4545-9978-49efbc4ffeb2 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:06.705491 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a2546a8e-eaae-4545-9978-49efbc4ffeb2 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:06.850451 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-13a5ce23-e47c-4db1-893e-f06fd434bfc6 tempest-VolumesTestJSON-300614846 tempest-VolumesTestJSON-300614846-project] Calling method '.version_select at 0x7f7c3d702160>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:06.906649 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a2546a8e-eaae-4545-9978-49efbc4ffeb2 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:06.926679 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a2546a8e-eaae-4545-9978-49efbc4ffeb2 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.256638 Oct 18 15:44:06.927287 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2140/4269] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:06 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:06.950506 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ef89d2d4-5069-4462-ae9c-8c674c326d93 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:06.951640 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ef89d2d4-5069-4462-ae9c-8c674c326d93 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:06.958992 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-13a5ce23-e47c-4db1-893e-f06fd434bfc6 tempest-VolumesTestJSON-300614846 tempest-VolumesTestJSON-300614846-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/90da64f2-316e-4208-ad32-28208df8dbe8" status: 200 len: 350 microversion: 2.1 time: 0.119592 Oct 18 15:44:06.959996 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2130/4270] 10.222.0.60 () {58 vars in 1245 bytes} [Tue Oct 18 15:44:06 2022] GET /compute/v2.1/os-volumes/90da64f2-316e-4208-ad32-28208df8dbe8 => generated 350 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:44:06.962110 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ef89d2d4-5069-4462-ae9c-8c674c326d93 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:06.962932 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ef89d2d4-5069-4462-ae9c-8c674c326d93 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:06.963508 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ef89d2d4-5069-4462-ae9c-8c674c326d93 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:06.964375 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ef89d2d4-5069-4462-ae9c-8c674c326d93 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:06.965008 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ef89d2d4-5069-4462-ae9c-8c674c326d93 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:06.965777 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ef89d2d4-5069-4462-ae9c-8c674c326d93 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:07.161048 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=12 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:44:07.172146 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-47bb6fb6-6fed-40bc-a791-b202c082e77b tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:07.173039 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-47bb6fb6-6fed-40bc-a791-b202c082e77b tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: a49f5b92-61e2-44bd-92a9-2bbaa1fb8975] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:07.196735 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47bb6fb6-6fed-40bc-a791-b202c082e77b tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:07.197261 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47bb6fb6-6fed-40bc-a791-b202c082e77b tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:07.199691 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47bb6fb6-6fed-40bc-a791-b202c082e77b tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:07.202209 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47bb6fb6-6fed-40bc-a791-b202c082e77b tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:07.202694 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47bb6fb6-6fed-40bc-a791-b202c082e77b tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:07.203134 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47bb6fb6-6fed-40bc-a791-b202c082e77b tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:07.700169 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ef89d2d4-5069-4462-ae9c-8c674c326d93 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:07.713584 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ef89d2d4-5069-4462-ae9c-8c674c326d93 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.766320 Oct 18 15:44:07.715010 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-47bb6fb6-6fed-40bc-a791-b202c082e77b tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:07.715880 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2141/4271] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:06 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:44:07.723294 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-36a57fea-503f-41bf-a828-4565c7b4efed tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:07.727589 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-47bb6fb6-6fed-40bc-a791-b202c082e77b tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975" status: 200 len: 1523 microversion: 2.1 time: 0.569365 Oct 18 15:44:07.729038 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2131/4272] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:07 2022] GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975 => generated 1523 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:07.729938 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-36a57fea-503f-41bf-a828-4565c7b4efed tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: e6019a42-1115-4a7b-bfab-badb33cafed8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:07.743343 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-36a57fea-503f-41bf-a828-4565c7b4efed tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:07.743845 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-36a57fea-503f-41bf-a828-4565c7b4efed tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:07.744233 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-36a57fea-503f-41bf-a828-4565c7b4efed tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:07.744998 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-36a57fea-503f-41bf-a828-4565c7b4efed tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:07.745468 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-36a57fea-503f-41bf-a828-4565c7b4efed tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:07.754725 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-36a57fea-503f-41bf-a828-4565c7b4efed tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:07.970193 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bcbce0dd-3d2d-48cb-9a9b-b843fa4be8fd tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-124791245", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "b55b6f02-72e3-4b31-a708-98b6291bed4c"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bcbce0dd-3d2d-48cb-9a9b-b843fa4be8fd tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Request method failure captured: Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 234 Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTslxbnvpe5yiGf5CWZMgShC81OiGKrcSLYZFSWKOLbaqqF5kNJvh8cijdldsPo1OHjHXDcbdPuhTuFRNRswVq0HwpXLNCfOWcF3GU1M8LHkZwXu6ScaOEIHyQ8ewFnAFL7TXd1O14t3atsv_uM6Xc9ZHSfefERCjuehdw5SJuAn7MMs Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 96c4378d52d1489bb2d50e84cabf95eb Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-124791245", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "b55b6f02-72e3-4b31-a708-98b6291bed4c"}]}} Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-124791245', 'imageRef': '8f4db252-bff6-4685-9c8d-4c5d6bd9f78b', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': 'b55b6f02-72e3-4b31-a708-98b6291bed4c'}]}}} Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise error Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:07.977205 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:07.981760 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:44:07.981760 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:44:07.981760 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:44:07.981760 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:44:07.981760 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:44:07.981760 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:44:07.981760 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:44:07.981760 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:44:07.981760 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 15:44:07.981760 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 15:44:07.981760 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 15:44:07.981760 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 15:44:07.981760 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 15:44:07.981760 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 15:44:07.981760 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 18 15:44:07.981760 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:07.981760 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:44:07.981760 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:07.981760 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:07.981760 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:44:07.981760 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:44:07.981760 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 15:44:07.981760 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 15:44:07.981760 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 18 15:44:07.981760 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:07.984114 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bcbce0dd-3d2d-48cb-9a9b-b843fa4be8fd tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:44:07.986881 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bcbce0dd-3d2d-48cb-9a9b-b843fa4be8fd tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.021704 Oct 18 15:44:07.990235 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-36a57fea-503f-41bf-a828-4565c7b4efed tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:07.991306 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2132/4273] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:44:07 2022] POST /compute/v2.1/servers => generated 133 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 18 15:44:08.006693 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-36a57fea-503f-41bf-a828-4565c7b4efed tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8" status: 200 len: 1511 microversion: 2.1 time: 0.288115 Oct 18 15:44:08.008108 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5436ff11-9968-4087-a2f8-8be126f79ff5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:08.009671 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5436ff11-9968-4087-a2f8-8be126f79ff5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:08.011453 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2142/4274] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:07 2022] GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8 => generated 1511 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:08.040185 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5436ff11-9968-4087-a2f8-8be126f79ff5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:08.040730 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5436ff11-9968-4087-a2f8-8be126f79ff5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:08.041169 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5436ff11-9968-4087-a2f8-8be126f79ff5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:08.042102 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5436ff11-9968-4087-a2f8-8be126f79ff5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:08.042784 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5436ff11-9968-4087-a2f8-8be126f79ff5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:08.044957 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5436ff11-9968-4087-a2f8-8be126f79ff5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:08.330006 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5436ff11-9968-4087-a2f8-8be126f79ff5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:08.342791 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5436ff11-9968-4087-a2f8-8be126f79ff5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.344719 Oct 18 15:44:08.345661 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2133/4275] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:07 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:08.373069 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-38573fda-fb04-4ef4-a186-cd82b2310466 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:08.374275 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-38573fda-fb04-4ef4-a186-cd82b2310466 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:08.383866 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-38573fda-fb04-4ef4-a186-cd82b2310466 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:08.384369 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-38573fda-fb04-4ef4-a186-cd82b2310466 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:08.387988 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-38573fda-fb04-4ef4-a186-cd82b2310466 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:08.388916 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-38573fda-fb04-4ef4-a186-cd82b2310466 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:08.389636 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-38573fda-fb04-4ef4-a186-cd82b2310466 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:08.392684 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-38573fda-fb04-4ef4-a186-cd82b2310466 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:08.755842 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-51d621e4-308b-4316-a59a-1d9bb5b433af tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:08.756478 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-51d621e4-308b-4316-a59a-1d9bb5b433af tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: a49f5b92-61e2-44bd-92a9-2bbaa1fb8975] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:08.782119 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51d621e4-308b-4316-a59a-1d9bb5b433af tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:08.787184 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51d621e4-308b-4316-a59a-1d9bb5b433af tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:08.791226 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51d621e4-308b-4316-a59a-1d9bb5b433af tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:08.793720 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51d621e4-308b-4316-a59a-1d9bb5b433af tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:08.796895 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51d621e4-308b-4316-a59a-1d9bb5b433af tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:08.798426 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51d621e4-308b-4316-a59a-1d9bb5b433af tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:08.855910 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-38573fda-fb04-4ef4-a186-cd82b2310466 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:08.867748 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-38573fda-fb04-4ef4-a186-cd82b2310466 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.499031 Oct 18 15:44:08.868363 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2143/4276] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:08 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:44:08.897795 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-acaa4256-bf37-403e-bd3b-bcb40769c09e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:44:08.898358 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-acaa4256-bf37-403e-bd3b-bcb40769c09e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2bbdad87-f8d1-417f-a396-8cd47193c4fb] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:08.932350 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-acaa4256-bf37-403e-bd3b-bcb40769c09e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] HTTP exception thrown: Instance 2bbdad87-f8d1-417f-a396-8cd47193c4fb could not be found. Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-acaa4256-bf37-403e-bd3b-bcb40769c09e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Request method failure captured: Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: request: POST /compute/v2.1/servers/2bbdad87-f8d1-417f-a396-8cd47193c4fb/action HTTP/1.1 Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 13 Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTslxbnvpe5yiGf5CWZMgShC81OiGKrcSLYZFSWKOLbaqqF5kNJvh8cijdldsPo1OHjHXDcbdPuhTuFRNRswVq0HwpXLNCfOWcF3GU1M8LHkZwXu6ScaOEIHyQ8ewFnAFL7TXd1O14t3atsv_uM6Xc9ZHSfefERCjuehdw5SJuAn7MMs Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 96c4378d52d1489bb2d50e84cabf95eb Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: {"pause": {}} Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 2bbdad87-f8d1-417f-a396-8cd47193c4fb could not be found. Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '2bbdad87-f8d1-417f-a396-8cd47193c4fb', 'body': {'pause': {}}} Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bbdad87-f8d1-417f-a396-8cd47193c4fb could not be found. Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bbdad87-f8d1-417f-a396-8cd47193c4fb could not be found. Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:44:08.943505 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:44:08.948064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:44:08.948064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:44:08.948064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bbdad87-f8d1-417f-a396-8cd47193c4fb could not be found. Oct 18 15:44:08.948064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:08.950500 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-acaa4256-bf37-403e-bd3b-bcb40769c09e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Returning 404 to user: Instance 2bbdad87-f8d1-417f-a396-8cd47193c4fb could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:44:08.954416 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-acaa4256-bf37-403e-bd3b-bcb40769c09e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "POST /compute/v2.1/servers/2bbdad87-f8d1-417f-a396-8cd47193c4fb/action" status: 404 len: 111 microversion: 2.1 time: 0.060572 Oct 18 15:44:08.955082 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2144/4277] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:44:08 2022] POST /compute/v2.1/servers/2bbdad87-f8d1-417f-a396-8cd47193c4fb/action => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 15:44:08.963528 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5da390b0-31fd-4c29-ad13-fa99a64cab22 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:08.964154 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5da390b0-31fd-4c29-ad13-fa99a64cab22 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:08.978683 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5da390b0-31fd-4c29-ad13-fa99a64cab22 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:08.979465 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5da390b0-31fd-4c29-ad13-fa99a64cab22 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:08.980062 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5da390b0-31fd-4c29-ad13-fa99a64cab22 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:08.980973 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5da390b0-31fd-4c29-ad13-fa99a64cab22 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:08.981589 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5da390b0-31fd-4c29-ad13-fa99a64cab22 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:08.982179 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5da390b0-31fd-4c29-ad13-fa99a64cab22 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:09.111785 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-51d621e4-308b-4316-a59a-1d9bb5b433af tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:09.120374 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-51d621e4-308b-4316-a59a-1d9bb5b433af tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975" status: 200 len: 1523 microversion: 2.1 time: 0.369103 Oct 18 15:44:09.123670 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2134/4278] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:08 2022] GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975 => generated 1523 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:09.133298 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fe916d48-9403-401c-b369-170fd021d028 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:09.133933 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fe916d48-9403-401c-b369-170fd021d028 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: e6019a42-1115-4a7b-bfab-badb33cafed8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:09.157789 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe916d48-9403-401c-b369-170fd021d028 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:09.158743 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe916d48-9403-401c-b369-170fd021d028 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:09.159261 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe916d48-9403-401c-b369-170fd021d028 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:09.160085 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe916d48-9403-401c-b369-170fd021d028 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:09.163037 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe916d48-9403-401c-b369-170fd021d028 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:09.163492 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe916d48-9403-401c-b369-170fd021d028 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:09.241212 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5da390b0-31fd-4c29-ad13-fa99a64cab22 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:09.255503 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5da390b0-31fd-4c29-ad13-fa99a64cab22 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.295735 Oct 18 15:44:09.258307 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2145/4279] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:08 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:44:09.292965 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9288e162-e093-4cf0-9b65-e95f124f6cb6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:09.298279 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9288e162-e093-4cf0-9b65-e95f124f6cb6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:09.324835 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9288e162-e093-4cf0-9b65-e95f124f6cb6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:09.325877 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9288e162-e093-4cf0-9b65-e95f124f6cb6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:09.326347 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9288e162-e093-4cf0-9b65-e95f124f6cb6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:09.329860 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9288e162-e093-4cf0-9b65-e95f124f6cb6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:09.335242 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9288e162-e093-4cf0-9b65-e95f124f6cb6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:09.336590 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9288e162-e093-4cf0-9b65-e95f124f6cb6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:09.472720 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fe916d48-9403-401c-b369-170fd021d028 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:09.482375 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fe916d48-9403-401c-b369-170fd021d028 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8" status: 200 len: 1511 microversion: 2.1 time: 0.357612 Oct 18 15:44:09.489110 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2135/4280] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:09 2022] GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8 => generated 1511 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:09.657851 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9288e162-e093-4cf0-9b65-e95f124f6cb6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:09.669161 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9288e162-e093-4cf0-9b65-e95f124f6cb6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.385667 Oct 18 15:44:09.669782 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2146/4281] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:09 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:09.698699 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ac9b83b1-0a30-4b6f-8918-d74f40cceb58 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:44:09.699279 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ac9b83b1-0a30-4b6f-8918-d74f40cceb58 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:09.706341 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac9b83b1-0a30-4b6f-8918-d74f40cceb58 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:09.706835 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac9b83b1-0a30-4b6f-8918-d74f40cceb58 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:09.707271 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac9b83b1-0a30-4b6f-8918-d74f40cceb58 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:09.713812 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac9b83b1-0a30-4b6f-8918-d74f40cceb58 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:09.714317 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac9b83b1-0a30-4b6f-8918-d74f40cceb58 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:09.715511 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac9b83b1-0a30-4b6f-8918-d74f40cceb58 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:09.793087 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7b9a590d-8473-472c-927f-3f766c246cc9 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:09.797870 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7b9a590d-8473-472c-927f-3f766c246cc9 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 55179126-a629-4bb3-82f5-14606ec63426] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:09.817468 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7b9a590d-8473-472c-927f-3f766c246cc9 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:09.818285 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7b9a590d-8473-472c-927f-3f766c246cc9 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:09.818906 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7b9a590d-8473-472c-927f-3f766c246cc9 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:09.820372 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7b9a590d-8473-472c-927f-3f766c246cc9 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:09.824354 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7b9a590d-8473-472c-927f-3f766c246cc9 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:09.825860 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7b9a590d-8473-472c-927f-3f766c246cc9 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:09.826007 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ac9b83b1-0a30-4b6f-8918-d74f40cceb58 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "POST /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc/action" status: 202 len: 0 microversion: 2.1 time: 0.130733 Oct 18 15:44:09.830374 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2136/4282] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:44:09 2022] POST /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:44:09.840480 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2bede8e9-e601-49f6-a8ac-fa580f74e712 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:09.841570 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2bede8e9-e601-49f6-a8ac-fa580f74e712 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:09.862705 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2bede8e9-e601-49f6-a8ac-fa580f74e712 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:09.864406 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2bede8e9-e601-49f6-a8ac-fa580f74e712 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:09.865110 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2bede8e9-e601-49f6-a8ac-fa580f74e712 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:09.866757 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2bede8e9-e601-49f6-a8ac-fa580f74e712 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:09.868197 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2bede8e9-e601-49f6-a8ac-fa580f74e712 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:09.870188 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2bede8e9-e601-49f6-a8ac-fa580f74e712 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:09.955931 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7b9a590d-8473-472c-927f-3f766c246cc9 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.162538 Oct 18 15:44:09.966849 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2147/4283] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 15:44:09 2022] GET /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426/os-volume_attachments => generated 371 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:44:09.981569 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c30fb6bf-eef6-40cf-a2d7-618bbf1f8a81 tempest-VolumesTestJSON-300614846 tempest-VolumesTestJSON-300614846-project] Calling method '.version_select at 0x7f7c3d3ea3a0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:10.093768 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2bede8e9-e601-49f6-a8ac-fa580f74e712 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:10.106402 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2bede8e9-e601-49f6-a8ac-fa580f74e712 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1512 microversion: 2.1 time: 0.271073 Oct 18 15:44:10.107508 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2137/4284] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:09 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1512 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:10.117913 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f91c9a95-3d84-4c12-bd3a-3f98f6f7ccb9 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:10.119150 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f91c9a95-3d84-4c12-bd3a-3f98f6f7ccb9 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 55179126-a629-4bb3-82f5-14606ec63426] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:10.128978 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f91c9a95-3d84-4c12-bd3a-3f98f6f7ccb9 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:10.129966 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f91c9a95-3d84-4c12-bd3a-3f98f6f7ccb9 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:10.131574 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f91c9a95-3d84-4c12-bd3a-3f98f6f7ccb9 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:10.132857 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f91c9a95-3d84-4c12-bd3a-3f98f6f7ccb9 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:10.133635 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f91c9a95-3d84-4c12-bd3a-3f98f6f7ccb9 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:10.134628 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f91c9a95-3d84-4c12-bd3a-3f98f6f7ccb9 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:10.169164 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c30fb6bf-eef6-40cf-a2d7-618bbf1f8a81 tempest-VolumesTestJSON-300614846 tempest-VolumesTestJSON-300614846-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/cdc19443-aa40-4314-8c77-6601f8be7a1c" status: 200 len: 351 microversion: 2.1 time: 0.182688 Oct 18 15:44:10.185596 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2148/4285] 10.222.0.60 () {58 vars in 1245 bytes} [Tue Oct 18 15:44:09 2022] GET /compute/v2.1/os-volumes/cdc19443-aa40-4314-8c77-6601f8be7a1c => generated 351 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:44:10.201052 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-99b1a70b-d679-498e-8f66-98248862ab36 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:10.203895 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-99b1a70b-d679-498e-8f66-98248862ab36 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: a49f5b92-61e2-44bd-92a9-2bbaa1fb8975] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:10.227264 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-99b1a70b-d679-498e-8f66-98248862ab36 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:10.227989 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-99b1a70b-d679-498e-8f66-98248862ab36 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:10.229775 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-99b1a70b-d679-498e-8f66-98248862ab36 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:10.237357 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-99b1a70b-d679-498e-8f66-98248862ab36 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:10.242214 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-99b1a70b-d679-498e-8f66-98248862ab36 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:10.243428 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-99b1a70b-d679-498e-8f66-98248862ab36 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:10.290814 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f91c9a95-3d84-4c12-bd3a-3f98f6f7ccb9 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426/os-volume_attachments/2ea9584b-82af-4b4e-ae12-2544834fe35b" status: 200 len: 194 microversion: 2.1 time: 0.179072 Oct 18 15:44:10.301192 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2138/4286] 10.222.0.60 () {58 vars in 1413 bytes} [Tue Oct 18 15:44:10 2022] GET /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426/os-volume_attachments/2ea9584b-82af-4b4e-ae12-2544834fe35b => generated 194 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:44:10.322018 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0fcba7c1-6461-40d0-9a91-1b4ab646a8e2 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:10.324675 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0fcba7c1-6461-40d0-9a91-1b4ab646a8e2 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 55179126-a629-4bb3-82f5-14606ec63426] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:10.353235 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0fcba7c1-6461-40d0-9a91-1b4ab646a8e2 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:10.354307 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0fcba7c1-6461-40d0-9a91-1b4ab646a8e2 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:10.357679 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0fcba7c1-6461-40d0-9a91-1b4ab646a8e2 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:10.357679 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0fcba7c1-6461-40d0-9a91-1b4ab646a8e2 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:10.359335 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0fcba7c1-6461-40d0-9a91-1b4ab646a8e2 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:10.373873 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0fcba7c1-6461-40d0-9a91-1b4ab646a8e2 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:10.378561 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:44:10.539865 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-0fcba7c1-6461-40d0-9a91-1b4ab646a8e2 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lazy-loading 'services' on Instance uuid 55179126-a629-4bb3-82f5-14606ec63426 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:44:10.609493 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-99b1a70b-d679-498e-8f66-98248862ab36 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:10.621691 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-99b1a70b-d679-498e-8f66-98248862ab36 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975" status: 200 len: 1523 microversion: 2.1 time: 0.434805 Oct 18 15:44:10.625302 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2149/4287] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:10 2022] GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975 => generated 1523 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:10.632514 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ced897e8-d2e2-4491-b52c-44154f7b4c8f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:10.633438 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ced897e8-d2e2-4491-b52c-44154f7b4c8f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: e6019a42-1115-4a7b-bfab-badb33cafed8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:10.652952 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ced897e8-d2e2-4491-b52c-44154f7b4c8f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:10.654436 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ced897e8-d2e2-4491-b52c-44154f7b4c8f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:10.657214 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ced897e8-d2e2-4491-b52c-44154f7b4c8f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:10.659224 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ced897e8-d2e2-4491-b52c-44154f7b4c8f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:10.660235 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ced897e8-d2e2-4491-b52c-44154f7b4c8f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:10.661766 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ced897e8-d2e2-4491-b52c-44154f7b4c8f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:10.667632 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0fcba7c1-6461-40d0-9a91-1b4ab646a8e2 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "DELETE /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426/os-volume_attachments/2ea9584b-82af-4b4e-ae12-2544834fe35b" status: 202 len: 0 microversion: 2.1 time: 0.364624 Oct 18 15:44:10.671756 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2139/4288] 10.222.0.60 () {58 vars in 1416 bytes} [Tue Oct 18 15:44:10 2022] DELETE /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426/os-volume_attachments/2ea9584b-82af-4b4e-ae12-2544834fe35b => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:44:11.139182 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-da8e187b-adf0-4a00-92d4-c698528c807d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:11.140691 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-da8e187b-adf0-4a00-92d4-c698528c807d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:11.155636 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da8e187b-adf0-4a00-92d4-c698528c807d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:11.158141 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da8e187b-adf0-4a00-92d4-c698528c807d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:11.160548 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da8e187b-adf0-4a00-92d4-c698528c807d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:11.161550 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da8e187b-adf0-4a00-92d4-c698528c807d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:11.163606 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da8e187b-adf0-4a00-92d4-c698528c807d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:11.164947 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da8e187b-adf0-4a00-92d4-c698528c807d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:11.771425 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ced897e8-d2e2-4491-b52c-44154f7b4c8f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:11.781296 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ced897e8-d2e2-4491-b52c-44154f7b4c8f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8" status: 200 len: 1511 microversion: 2.1 time: 1.154611 Oct 18 15:44:11.785951 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2150/4289] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:10 2022] GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8 => generated 1511 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:11.797005 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fbc5a5f1-1cb0-4489-bf6d-9c1e4e2b4619 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:11.801212 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-fbc5a5f1-1cb0-4489-bf6d-9c1e4e2b4619 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: a49f5b92-61e2-44bd-92a9-2bbaa1fb8975] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:11.815690 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fbc5a5f1-1cb0-4489-bf6d-9c1e4e2b4619 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:11.822324 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fbc5a5f1-1cb0-4489-bf6d-9c1e4e2b4619 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:11.823430 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fbc5a5f1-1cb0-4489-bf6d-9c1e4e2b4619 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:11.824403 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fbc5a5f1-1cb0-4489-bf6d-9c1e4e2b4619 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:11.825126 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fbc5a5f1-1cb0-4489-bf6d-9c1e4e2b4619 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:11.826065 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fbc5a5f1-1cb0-4489-bf6d-9c1e4e2b4619 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:11.857434 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-da8e187b-adf0-4a00-92d4-c698528c807d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:11.870750 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-da8e187b-adf0-4a00-92d4-c698528c807d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1492 microversion: 2.1 time: 0.733294 Oct 18 15:44:11.872021 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2140/4290] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:11 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1492 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:11.899041 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-375f42a4-a16d-4b7b-95e5-80c3a082b071 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:44:11.899596 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-375f42a4-a16d-4b7b-95e5-80c3a082b071 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:11.919230 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-375f42a4-a16d-4b7b-95e5-80c3a082b071 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:11.919753 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-375f42a4-a16d-4b7b-95e5-80c3a082b071 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:11.920216 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-375f42a4-a16d-4b7b-95e5-80c3a082b071 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:11.925271 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-375f42a4-a16d-4b7b-95e5-80c3a082b071 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:11.925800 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-375f42a4-a16d-4b7b-95e5-80c3a082b071 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:11.926248 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-375f42a4-a16d-4b7b-95e5-80c3a082b071 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:11.960445 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-375f42a4-a16d-4b7b-95e5-80c3a082b071 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] HTTP exception thrown: Cannot 'pause' instance 2cc69e2e-cb26-42d6-b887-31e0afaa69fc while it is in vm_state paused Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-375f42a4-a16d-4b7b-95e5-80c3a082b071 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Request method failure captured: Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc/action HTTP/1.1 Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 13 Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTslxbnvpe5yiGf5CWZMgShC81OiGKrcSLYZFSWKOLbaqqF5kNJvh8cijdldsPo1OHjHXDcbdPuhTuFRNRswVq0HwpXLNCfOWcF3GU1M8LHkZwXu6ScaOEIHyQ8ewFnAFL7TXd1O14t3atsv_uM6Xc9ZHSfefERCjuehdw5SJuAn7MMs Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 96c4378d52d1489bb2d50e84cabf95eb Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: {"pause": {}} Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: exception: Cannot 'pause' instance 2cc69e2e-cb26-42d6-b887-31e0afaa69fc while it is in vm_state paused Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '2cc69e2e-cb26-42d6-b887-31e0afaa69fc', 'body': {'pause': {}}} Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2cc69e2e-cb26-42d6-b887-31e0afaa69fc in vm_state paused. Cannot pause while the instance is in this state. Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 2cc69e2e-cb26-42d6-b887-31e0afaa69fc while it is in vm_state paused Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:11.961780 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:44:11.966585 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:44:11.966585 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:44:11.966585 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:44:11.966585 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 2cc69e2e-cb26-42d6-b887-31e0afaa69fc while it is in vm_state paused Oct 18 15:44:11.966585 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:11.966585 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-375f42a4-a16d-4b7b-95e5-80c3a082b071 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Returning 409 to user: Cannot 'pause' instance 2cc69e2e-cb26-42d6-b887-31e0afaa69fc while it is in vm_state paused {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:44:11.966585 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-375f42a4-a16d-4b7b-95e5-80c3a082b071 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "POST /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc/action" status: 409 len: 143 microversion: 2.1 time: 0.069562 Oct 18 15:44:11.966585 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2141/4291] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:44:11 2022] POST /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc/action => generated 143 bytes in 71 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 15:44:11.990023 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1532b055-9937-4bbc-a263-187a918927b9 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:44:11.994946 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1532b055-9937-4bbc-a263-187a918927b9 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:12.023947 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1532b055-9937-4bbc-a263-187a918927b9 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:12.031317 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1532b055-9937-4bbc-a263-187a918927b9 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:12.032003 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1532b055-9937-4bbc-a263-187a918927b9 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:12.032938 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1532b055-9937-4bbc-a263-187a918927b9 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:12.035502 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1532b055-9937-4bbc-a263-187a918927b9 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:12.036127 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1532b055-9937-4bbc-a263-187a918927b9 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:12.194973 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1532b055-9937-4bbc-a263-187a918927b9 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "POST /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc/action" status: 202 len: 0 microversion: 2.1 time: 0.222914 Oct 18 15:44:12.196662 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2142/4292] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:44:11 2022] POST /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:44:12.212183 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5c12869b-35cd-4df2-ad00-c68187c88f4b tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:12.214559 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5c12869b-35cd-4df2-ad00-c68187c88f4b tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:12.229835 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c12869b-35cd-4df2-ad00-c68187c88f4b tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:12.233194 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c12869b-35cd-4df2-ad00-c68187c88f4b tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:12.233869 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c12869b-35cd-4df2-ad00-c68187c88f4b tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:12.234817 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c12869b-35cd-4df2-ad00-c68187c88f4b tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:12.238949 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c12869b-35cd-4df2-ad00-c68187c88f4b tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:12.239638 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c12869b-35cd-4df2-ad00-c68187c88f4b tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:12.548859 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-fbc5a5f1-1cb0-4489-bf6d-9c1e4e2b4619 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:12.563102 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fbc5a5f1-1cb0-4489-bf6d-9c1e4e2b4619 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975" status: 200 len: 1523 microversion: 2.1 time: 0.773833 Oct 18 15:44:12.563880 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2151/4293] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:11 2022] GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975 => generated 1523 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:12.803485 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5c12869b-35cd-4df2-ad00-c68187c88f4b tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:12.822258 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-76f193c6-da3d-40a6-9918-633b16f38611 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:12.827786 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-76f193c6-da3d-40a6-9918-633b16f38611 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: e6019a42-1115-4a7b-bfab-badb33cafed8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:12.833748 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=26 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:44:12.838894 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:44:12.847893 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5c12869b-35cd-4df2-ad00-c68187c88f4b tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1499 microversion: 2.1 time: 0.644835 Oct 18 15:44:12.869100 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2143/4294] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:12 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1499 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:44:12.875021 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-76f193c6-da3d-40a6-9918-633b16f38611 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:12.877546 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-76f193c6-da3d-40a6-9918-633b16f38611 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:12.878746 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-76f193c6-da3d-40a6-9918-633b16f38611 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:12.882350 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-76f193c6-da3d-40a6-9918-633b16f38611 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:12.884068 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-76f193c6-da3d-40a6-9918-633b16f38611 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:12.886082 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-76f193c6-da3d-40a6-9918-633b16f38611 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:13.437715 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-76f193c6-da3d-40a6-9918-633b16f38611 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:13.450366 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-76f193c6-da3d-40a6-9918-633b16f38611 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8" status: 200 len: 1511 microversion: 2.1 time: 0.635139 Oct 18 15:44:13.455437 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2152/4295] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:12 2022] GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8 => generated 1511 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:13.593317 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-31e039af-415c-4d10-8349-7c76e061f0aa tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:13.594037 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-31e039af-415c-4d10-8349-7c76e061f0aa tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: a49f5b92-61e2-44bd-92a9-2bbaa1fb8975] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:13.597488 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:44:13.610660 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31e039af-415c-4d10-8349-7c76e061f0aa tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:13.611587 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31e039af-415c-4d10-8349-7c76e061f0aa tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:13.612375 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31e039af-415c-4d10-8349-7c76e061f0aa tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:13.631130 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31e039af-415c-4d10-8349-7c76e061f0aa tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:13.632118 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31e039af-415c-4d10-8349-7c76e061f0aa tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:13.632855 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31e039af-415c-4d10-8349-7c76e061f0aa tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:13.888322 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c88a4d01-02a4-458a-afa6-46ca2054adea tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:13.890016 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c88a4d01-02a4-458a-afa6-46ca2054adea tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:13.897921 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c88a4d01-02a4-458a-afa6-46ca2054adea tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:13.899934 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c88a4d01-02a4-458a-afa6-46ca2054adea tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:13.900594 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c88a4d01-02a4-458a-afa6-46ca2054adea tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:13.901599 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c88a4d01-02a4-458a-afa6-46ca2054adea tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:13.907963 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c88a4d01-02a4-458a-afa6-46ca2054adea tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:13.908753 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c88a4d01-02a4-458a-afa6-46ca2054adea tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:14.588626 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-31e039af-415c-4d10-8349-7c76e061f0aa tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:14.598199 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-31e039af-415c-4d10-8349-7c76e061f0aa tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975" status: 200 len: 1523 microversion: 2.1 time: 1.010036 Oct 18 15:44:14.608008 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c88a4d01-02a4-458a-afa6-46ca2054adea tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:14.612592 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2144/4296] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:13 2022] GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975 => generated 1523 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:14.622714 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c88a4d01-02a4-458a-afa6-46ca2054adea tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.738450 Oct 18 15:44:14.622983 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d026cea6-7b5f-43c5-8156-76b346b2a2c3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:14.624603 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2153/4297] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:13 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:44:14.630058 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3d22afcc-46f1-40a6-94f3-363f68cba542 tempest-VolumesTestJSON-300614846 tempest-VolumesTestJSON-300614846-project] Calling method '.version_select at 0x7f7c3d873820>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:14.641081 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d026cea6-7b5f-43c5-8156-76b346b2a2c3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: e6019a42-1115-4a7b-bfab-badb33cafed8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:14.652241 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d026cea6-7b5f-43c5-8156-76b346b2a2c3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:14.652743 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d026cea6-7b5f-43c5-8156-76b346b2a2c3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:14.653372 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d026cea6-7b5f-43c5-8156-76b346b2a2c3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:14.654254 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d026cea6-7b5f-43c5-8156-76b346b2a2c3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:14.654882 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d026cea6-7b5f-43c5-8156-76b346b2a2c3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:14.655451 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d026cea6-7b5f-43c5-8156-76b346b2a2c3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:14.737582 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3d22afcc-46f1-40a6-94f3-363f68cba542 tempest-VolumesTestJSON-300614846 tempest-VolumesTestJSON-300614846-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/6dafb18e-49cc-4bac-9716-45e90b2f2749" status: 200 len: 350 microversion: 2.1 time: 0.111682 Oct 18 15:44:14.738171 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2154/4298] 10.222.0.60 () {58 vars in 1245 bytes} [Tue Oct 18 15:44:14 2022] GET /compute/v2.1/os-volumes/6dafb18e-49cc-4bac-9716-45e90b2f2749 => generated 350 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:44:14.744177 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2e83eee8-9dd7-46b2-b88d-6d978f54a3bb tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:14.745072 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2e83eee8-9dd7-46b2-b88d-6d978f54a3bb tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:14.776143 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2e83eee8-9dd7-46b2-b88d-6d978f54a3bb tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:14.776567 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2e83eee8-9dd7-46b2-b88d-6d978f54a3bb tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:14.778856 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2e83eee8-9dd7-46b2-b88d-6d978f54a3bb tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:14.779621 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2e83eee8-9dd7-46b2-b88d-6d978f54a3bb tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:14.780317 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2e83eee8-9dd7-46b2-b88d-6d978f54a3bb tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:14.780750 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2e83eee8-9dd7-46b2-b88d-6d978f54a3bb tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:15.253643 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d026cea6-7b5f-43c5-8156-76b346b2a2c3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:15.266978 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d026cea6-7b5f-43c5-8156-76b346b2a2c3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8" status: 200 len: 1511 microversion: 2.1 time: 0.653016 Oct 18 15:44:15.272166 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2145/4299] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:14 2022] GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8 => generated 1511 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:15.280253 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a7dae8cb-c298-4f1f-a99f-d6186364da40 tempest-VolumesTestJSON-300614846 tempest-VolumesTestJSON-300614846-project] Calling method '.version_select at 0x7f7c3dc03f70>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:15.366387 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2e83eee8-9dd7-46b2-b88d-6d978f54a3bb tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:15.376644 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2e83eee8-9dd7-46b2-b88d-6d978f54a3bb tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.636490 Oct 18 15:44:15.377273 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2155/4300] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:14 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:15.402938 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8e669368-2573-49ae-a862-1cfe24908d33 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:44:15.406730 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8e669368-2573-49ae-a862-1cfe24908d33 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 28223cad-bdfe-40ba-905e-56488b5119be] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:15.413376 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8e669368-2573-49ae-a862-1cfe24908d33 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:15.413928 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8e669368-2573-49ae-a862-1cfe24908d33 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:15.414379 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8e669368-2573-49ae-a862-1cfe24908d33 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:15.415090 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8e669368-2573-49ae-a862-1cfe24908d33 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:15.415549 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8e669368-2573-49ae-a862-1cfe24908d33 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:15.415978 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8e669368-2573-49ae-a862-1cfe24908d33 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:15.440065 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-8e669368-2573-49ae-a862-1cfe24908d33 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] HTTP exception thrown: Instance 28223cad-bdfe-40ba-905e-56488b5119be could not be found. Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8e669368-2573-49ae-a862-1cfe24908d33 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Request method failure captured: Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: request: POST /compute/v2.1/servers/28223cad-bdfe-40ba-905e-56488b5119be/action HTTP/1.1 Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 28 Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTslxbnvpe5yiGf5CWZMgShC81OiGKrcSLYZFSWKOLbaqqF5kNJvh8cijdldsPo1OHjHXDcbdPuhTuFRNRswVq0HwpXLNCfOWcF3GU1M8LHkZwXu6ScaOEIHyQ8ewFnAFL7TXd1O14t3atsv_uM6Xc9ZHSfefERCjuehdw5SJuAn7MMs Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 96c4378d52d1489bb2d50e84cabf95eb Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: {"reboot": {"type": "SOFT"}} Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 28223cad-bdfe-40ba-905e-56488b5119be could not be found. Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '28223cad-bdfe-40ba-905e-56488b5119be', 'body': {'reboot': {'type': 'SOFT'}}} Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28223cad-bdfe-40ba-905e-56488b5119be could not be found. Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:44:15.442012 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:44:15.446304 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28223cad-bdfe-40ba-905e-56488b5119be could not be found. Oct 18 15:44:15.446304 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:15.446304 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:44:15.446304 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:15.446304 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:15.446304 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:44:15.446304 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:44:15.446304 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:44:15.446304 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:44:15.446304 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28223cad-bdfe-40ba-905e-56488b5119be could not be found. Oct 18 15:44:15.446304 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:15.450461 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8e669368-2573-49ae-a862-1cfe24908d33 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Returning 404 to user: Instance 28223cad-bdfe-40ba-905e-56488b5119be could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:44:15.452583 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8e669368-2573-49ae-a862-1cfe24908d33 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "POST /compute/v2.1/servers/28223cad-bdfe-40ba-905e-56488b5119be/action" status: 404 len: 111 microversion: 2.1 time: 0.055230 Oct 18 15:44:15.458231 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2156/4301] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:44:15 2022] POST /compute/v2.1/servers/28223cad-bdfe-40ba-905e-56488b5119be/action => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 15:44:15.463203 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-362967dd-4de5-497c-9e21-9a880ffe8b4a tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:15.463832 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-362967dd-4de5-497c-9e21-9a880ffe8b4a tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:15.479457 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-362967dd-4de5-497c-9e21-9a880ffe8b4a tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:15.479961 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-362967dd-4de5-497c-9e21-9a880ffe8b4a tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:15.480398 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-362967dd-4de5-497c-9e21-9a880ffe8b4a tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:15.481150 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-362967dd-4de5-497c-9e21-9a880ffe8b4a tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:15.481610 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-362967dd-4de5-497c-9e21-9a880ffe8b4a tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:15.482042 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-362967dd-4de5-497c-9e21-9a880ffe8b4a tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:15.564935 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a7dae8cb-c298-4f1f-a99f-d6186364da40 tempest-VolumesTestJSON-300614846 tempest-VolumesTestJSON-300614846-project] 10.222.0.60 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.291237 Oct 18 15:44:15.574933 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2146/4302] 10.222.0.60 () {58 vars in 1134 bytes} [Tue Oct 18 15:44:15 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:15.581886 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-09b6d740-358b-4d50-a40e-57d3382b3e2e tempest-VolumesTestJSON-300614846 tempest-VolumesTestJSON-300614846-project] Calling method '.version_select at 0x7f7c3d9a9c10>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:15.930302 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-09b6d740-358b-4d50-a40e-57d3382b3e2e tempest-VolumesTestJSON-300614846 tempest-VolumesTestJSON-300614846-project] 10.222.0.60 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.352558 Oct 18 15:44:15.940373 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2147/4303] 10.222.0.60 () {58 vars in 1149 bytes} [Tue Oct 18 15:44:15 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:44:15.945973 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2cf9ecb2-3ae4-4151-9bef-77c3b0b16f80 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:15.946600 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2cf9ecb2-3ae4-4151-9bef-77c3b0b16f80 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: a49f5b92-61e2-44bd-92a9-2bbaa1fb8975] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:15.954075 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2cf9ecb2-3ae4-4151-9bef-77c3b0b16f80 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:15.954569 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2cf9ecb2-3ae4-4151-9bef-77c3b0b16f80 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:15.955009 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2cf9ecb2-3ae4-4151-9bef-77c3b0b16f80 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:15.955722 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2cf9ecb2-3ae4-4151-9bef-77c3b0b16f80 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:15.956186 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2cf9ecb2-3ae4-4151-9bef-77c3b0b16f80 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:15.956623 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2cf9ecb2-3ae4-4151-9bef-77c3b0b16f80 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:16.075095 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-362967dd-4de5-497c-9e21-9a880ffe8b4a tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:16.084661 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-362967dd-4de5-497c-9e21-9a880ffe8b4a tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.625243 Oct 18 15:44:16.086417 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2157/4304] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:15 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:16.097035 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-76820777-a888-4c54-ac43-c1ff631b972f tempest-VolumesTestJSON-300614846 tempest-VolumesTestJSON-300614846-project] Calling method '.version_select at 0x7f7c3c4c9c10>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:16.242301 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-76820777-a888-4c54-ac43-c1ff631b972f tempest-VolumesTestJSON-300614846 tempest-VolumesTestJSON-300614846-project] 10.222.0.60 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.152858 Oct 18 15:44:16.243080 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2158/4305] 10.222.0.60 () {58 vars in 1134 bytes} [Tue Oct 18 15:44:16 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:16.247745 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-11626c75-bf17-4d36-af9c-b6db3a80314d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:16.249214 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-11626c75-bf17-4d36-af9c-b6db3a80314d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:16.279106 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-11626c75-bf17-4d36-af9c-b6db3a80314d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:16.282255 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-11626c75-bf17-4d36-af9c-b6db3a80314d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:16.282926 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-11626c75-bf17-4d36-af9c-b6db3a80314d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:16.283836 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-11626c75-bf17-4d36-af9c-b6db3a80314d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:16.286116 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-11626c75-bf17-4d36-af9c-b6db3a80314d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:16.290314 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-11626c75-bf17-4d36-af9c-b6db3a80314d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:16.307565 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=100 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:44:16.398887 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2cf9ecb2-3ae4-4151-9bef-77c3b0b16f80 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:16.416303 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2cf9ecb2-3ae4-4151-9bef-77c3b0b16f80 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975" status: 200 len: 1523 microversion: 2.1 time: 0.474578 Oct 18 15:44:16.417635 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2148/4306] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:15 2022] GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975 => generated 1523 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:16.428137 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-18e297da-0a76-49bc-8b24-9ca9751326f0 tempest-VolumesTestJSON-300614846 tempest-VolumesTestJSON-300614846-project] Calling method '.version_select at 0x7f7c3d7328b0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:16.611332 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-18e297da-0a76-49bc-8b24-9ca9751326f0 tempest-VolumesTestJSON-300614846 tempest-VolumesTestJSON-300614846-project] 10.222.0.60 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.192197 Oct 18 15:44:16.612055 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2149/4307] 10.222.0.60 () {58 vars in 1167 bytes} [Tue Oct 18 15:44:16 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:44:16.631793 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2aea1518-bba0-4f46-8f91-0f7dd17eee68 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:16.632548 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2aea1518-bba0-4f46-8f91-0f7dd17eee68 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: e6019a42-1115-4a7b-bfab-badb33cafed8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:16.648490 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2aea1518-bba0-4f46-8f91-0f7dd17eee68 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:16.654344 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2aea1518-bba0-4f46-8f91-0f7dd17eee68 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:16.654792 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2aea1518-bba0-4f46-8f91-0f7dd17eee68 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:16.655566 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2aea1518-bba0-4f46-8f91-0f7dd17eee68 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:16.656044 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2aea1518-bba0-4f46-8f91-0f7dd17eee68 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:16.656482 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2aea1518-bba0-4f46-8f91-0f7dd17eee68 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:17.066504 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-11626c75-bf17-4d36-af9c-b6db3a80314d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:17.075324 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-11626c75-bf17-4d36-af9c-b6db3a80314d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.831089 Oct 18 15:44:17.097355 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2159/4308] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:16 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:17.120922 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-20c31ca7-7fa5-4d06-9ef9-9ee7cfa3a2db tempest-VolumesTestJSON-300614846 tempest-VolumesTestJSON-300614846-project] Calling method '.version_select at 0x7f7c3c7fa820>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:17.318825 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-20c31ca7-7fa5-4d06-9ef9-9ee7cfa3a2db tempest-VolumesTestJSON-300614846 tempest-VolumesTestJSON-300614846-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.220086 Oct 18 15:44:17.319394 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2160/4309] 10.222.0.60 () {58 vars in 1170 bytes} [Tue Oct 18 15:44:17 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:44:17.324246 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-127531b0-72a8-4569-93d9-217e7b252b01 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:44:17.331989 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-127531b0-72a8-4569-93d9-217e7b252b01 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 6e990b2e-6fdb-470d-8049-115a035dfaf2] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:17.351204 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-127531b0-72a8-4569-93d9-217e7b252b01 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] HTTP exception thrown: Instance 6e990b2e-6fdb-470d-8049-115a035dfaf2 could not be found. Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-127531b0-72a8-4569-93d9-217e7b252b01 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Request method failure captured: Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: request: POST /compute/v2.1/servers/6e990b2e-6fdb-470d-8049-115a035dfaf2/action HTTP/1.1 Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 28 Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTslxbnvpe5yiGf5CWZMgShC81OiGKrcSLYZFSWKOLbaqqF5kNJvh8cijdldsPo1OHjHXDcbdPuhTuFRNRswVq0HwpXLNCfOWcF3GU1M8LHkZwXu6ScaOEIHyQ8ewFnAFL7TXd1O14t3atsv_uM6Xc9ZHSfefERCjuehdw5SJuAn7MMs Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 96c4378d52d1489bb2d50e84cabf95eb Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: {"reboot": {"type": "SOFT"}} Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 6e990b2e-6fdb-470d-8049-115a035dfaf2 could not be found. Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '6e990b2e-6fdb-470d-8049-115a035dfaf2', 'body': {'reboot': {'type': 'SOFT'}}} Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e990b2e-6fdb-470d-8049-115a035dfaf2 could not be found. Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e990b2e-6fdb-470d-8049-115a035dfaf2 could not be found. Oct 18 15:44:17.353097 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:17.357308 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:44:17.357308 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:17.357308 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:17.357308 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:44:17.357308 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:44:17.357308 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:44:17.357308 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:44:17.357308 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e990b2e-6fdb-470d-8049-115a035dfaf2 could not be found. Oct 18 15:44:17.357308 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:17.359041 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-127531b0-72a8-4569-93d9-217e7b252b01 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Returning 404 to user: Instance 6e990b2e-6fdb-470d-8049-115a035dfaf2 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:44:17.360108 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-127531b0-72a8-4569-93d9-217e7b252b01 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "POST /compute/v2.1/servers/6e990b2e-6fdb-470d-8049-115a035dfaf2/action" status: 404 len: 111 microversion: 2.1 time: 0.039605 Oct 18 15:44:17.360914 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2161/4310] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:44:17 2022] POST /compute/v2.1/servers/6e990b2e-6fdb-470d-8049-115a035dfaf2/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:44:17.373939 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e9e189f0-bf35-4c2e-abc5-1cf37a1f3090 tempest-VolumesTestJSON-300614846 tempest-VolumesTestJSON-300614846-project] Calling method '.version_select at 0x7f7c3d3ea4c0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:17.476134 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2aea1518-bba0-4f46-8f91-0f7dd17eee68 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:17.511749 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2aea1518-bba0-4f46-8f91-0f7dd17eee68 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8" status: 200 len: 1511 microversion: 2.1 time: 0.888463 Oct 18 15:44:17.517852 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2150/4311] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:16 2022] GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8 => generated 1511 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:17.527552 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7069fb64-c98d-4ceb-a43f-a9d3802c8d08 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:17.528398 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7069fb64-c98d-4ceb-a43f-a9d3802c8d08 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:17.535663 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7069fb64-c98d-4ceb-a43f-a9d3802c8d08 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:17.536495 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7069fb64-c98d-4ceb-a43f-a9d3802c8d08 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:17.537206 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7069fb64-c98d-4ceb-a43f-a9d3802c8d08 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:17.538271 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7069fb64-c98d-4ceb-a43f-a9d3802c8d08 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:17.538948 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7069fb64-c98d-4ceb-a43f-a9d3802c8d08 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:17.539604 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7069fb64-c98d-4ceb-a43f-a9d3802c8d08 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:17.876344 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7069fb64-c98d-4ceb-a43f-a9d3802c8d08 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:17.885464 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7069fb64-c98d-4ceb-a43f-a9d3802c8d08 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.366176 Oct 18 15:44:17.921303 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2151/4312] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:17 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:17.935937 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-282e2b78-823b-49ce-afcd-02d10b6d30ec tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:17.936514 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-282e2b78-823b-49ce-afcd-02d10b6d30ec tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: a49f5b92-61e2-44bd-92a9-2bbaa1fb8975] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:17.940880 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e9e189f0-bf35-4c2e-abc5-1cf37a1f3090 tempest-VolumesTestJSON-300614846 tempest-VolumesTestJSON-300614846-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.575374 Oct 18 15:44:17.941677 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2162/4313] 10.222.0.60 () {58 vars in 1155 bytes} [Tue Oct 18 15:44:17 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:17.955443 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-282e2b78-823b-49ce-afcd-02d10b6d30ec tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:17.955943 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-282e2b78-823b-49ce-afcd-02d10b6d30ec tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:17.956395 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-282e2b78-823b-49ce-afcd-02d10b6d30ec tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:17.957832 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-282e2b78-823b-49ce-afcd-02d10b6d30ec tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:17.959308 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-282e2b78-823b-49ce-afcd-02d10b6d30ec tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:17.959754 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-282e2b78-823b-49ce-afcd-02d10b6d30ec tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:18.231800 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-282e2b78-823b-49ce-afcd-02d10b6d30ec tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:18.242423 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-282e2b78-823b-49ce-afcd-02d10b6d30ec tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975" status: 200 len: 1503 microversion: 2.1 time: 0.319679 Oct 18 15:44:18.242986 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c5eff3ef-02e5-4511-92f6-06e4ef28000b tempest-SecurityGroupRulesTestJSON-1152099622 tempest-SecurityGroupRulesTestJSON-1152099622-project] Action: 'create', calling method: .version_select at 0x7f7c3d76c4c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1739147273", "description": "tempest-description-764446269"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:44:18.256844 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2152/4314] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:17 2022] GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975 => generated 1503 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:18.262476 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f8eae735-5e61-4803-b0e4-3e1f28b3b9cf tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:18.263091 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f8eae735-5e61-4803-b0e4-3e1f28b3b9cf tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:18.279359 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8eae735-5e61-4803-b0e4-3e1f28b3b9cf tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:18.281534 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8eae735-5e61-4803-b0e4-3e1f28b3b9cf tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:18.282037 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8eae735-5e61-4803-b0e4-3e1f28b3b9cf tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:18.282806 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8eae735-5e61-4803-b0e4-3e1f28b3b9cf tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:18.283288 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8eae735-5e61-4803-b0e4-3e1f28b3b9cf tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:18.283723 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8eae735-5e61-4803-b0e4-3e1f28b3b9cf tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:18.652263 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c5eff3ef-02e5-4511-92f6-06e4ef28000b tempest-SecurityGroupRulesTestJSON-1152099622 tempest-SecurityGroupRulesTestJSON-1152099622-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.709318 Oct 18 15:44:18.660778 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2163/4315] 10.222.0.60 () {60 vars in 1180 bytes} [Tue Oct 18 15:44:17 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:44:18.660778 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-30b92df4-144c-48b2-81c0-a2b9dc9091f6 tempest-VolumesTestJSON-300614846 tempest-VolumesTestJSON-300614846-project] Calling method '.version_select at 0x7f7c3d33daf0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:18.817723 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f8eae735-5e61-4803-b0e4-3e1f28b3b9cf tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:18.827020 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f8eae735-5e61-4803-b0e4-3e1f28b3b9cf tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.580146 Oct 18 15:44:18.839006 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-30b92df4-144c-48b2-81c0-a2b9dc9091f6 tempest-VolumesTestJSON-300614846 tempest-VolumesTestJSON-300614846-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.184256 Oct 18 15:44:18.839385 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2153/4316] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:18 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:18.855000 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2164/4317] 10.222.0.60 () {58 vars in 1188 bytes} [Tue Oct 18 15:44:18 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:44:18.863190 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-29476487-08bd-4b01-9e09-a303f67cd6f9 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:18.864210 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-29476487-08bd-4b01-9e09-a303f67cd6f9 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 19226472-0c76-46f8-a4ba-7d32931341a2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:18.866127 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-71715ddb-2a5e-4530-b89d-898c4479d844 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:18.866973 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-71715ddb-2a5e-4530-b89d-898c4479d844 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: e6019a42-1115-4a7b-bfab-badb33cafed8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:18.884753 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-71715ddb-2a5e-4530-b89d-898c4479d844 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:18.887004 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29476487-08bd-4b01-9e09-a303f67cd6f9 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:18.887683 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29476487-08bd-4b01-9e09-a303f67cd6f9 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:18.890511 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29476487-08bd-4b01-9e09-a303f67cd6f9 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:18.893722 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29476487-08bd-4b01-9e09-a303f67cd6f9 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:18.897449 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-71715ddb-2a5e-4530-b89d-898c4479d844 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:18.898160 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-71715ddb-2a5e-4530-b89d-898c4479d844 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:18.898502 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29476487-08bd-4b01-9e09-a303f67cd6f9 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:18.898936 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-71715ddb-2a5e-4530-b89d-898c4479d844 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:18.899417 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-71715ddb-2a5e-4530-b89d-898c4479d844 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:18.899646 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29476487-08bd-4b01-9e09-a303f67cd6f9 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:18.899845 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-71715ddb-2a5e-4530-b89d-898c4479d844 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:19.245137 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-29476487-08bd-4b01-9e09-a303f67cd6f9 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:19.262431 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-29476487-08bd-4b01-9e09-a303f67cd6f9 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2" status: 200 len: 1516 microversion: 2.1 time: 0.408167 Oct 18 15:44:19.264325 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2154/4318] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:18 2022] GET /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2 => generated 1516 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:19.272854 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c096cd7e-3841-451b-8d6c-5b74fbeb3ac1 tempest-SecurityGroupRulesTestJSON-1152099622 tempest-SecurityGroupRulesTestJSON-1152099622-project] Action: 'create', calling method: .version_select at 0x7f7c3d5c98b0>, body: {"security_group_rule": {"parent_group_id": "fe4b576f-29a5-45ec-8e74-83c3bfd75d69", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:44:19.344489 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-71715ddb-2a5e-4530-b89d-898c4479d844 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:19.361067 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-71715ddb-2a5e-4530-b89d-898c4479d844 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8" status: 200 len: 1511 microversion: 2.1 time: 0.504210 Oct 18 15:44:19.361675 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2165/4319] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:18 2022] GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8 => generated 1511 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:19.384723 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3a105b17-8555-4972-aefa-6c284cc6d3b5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:44:19.396485 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3a105b17-8555-4972-aefa-6c284cc6d3b5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 28223cad-bdfe-40ba-905e-56488b5119be] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:19.428932 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3a105b17-8555-4972-aefa-6c284cc6d3b5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:19.431719 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3a105b17-8555-4972-aefa-6c284cc6d3b5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:19.432676 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3a105b17-8555-4972-aefa-6c284cc6d3b5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:19.434881 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3a105b17-8555-4972-aefa-6c284cc6d3b5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:19.436503 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3a105b17-8555-4972-aefa-6c284cc6d3b5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:19.440093 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3a105b17-8555-4972-aefa-6c284cc6d3b5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:19.480220 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-3a105b17-8555-4972-aefa-6c284cc6d3b5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] HTTP exception thrown: Instance 28223cad-bdfe-40ba-905e-56488b5119be could not be found. Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3a105b17-8555-4972-aefa-6c284cc6d3b5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Request method failure captured: Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: request: POST /compute/v2.1/servers/28223cad-bdfe-40ba-905e-56488b5119be/action HTTP/1.1 Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 65 Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTslxbnvpe5yiGf5CWZMgShC81OiGKrcSLYZFSWKOLbaqqF5kNJvh8cijdldsPo1OHjHXDcbdPuhTuFRNRswVq0HwpXLNCfOWcF3GU1M8LHkZwXu6ScaOEIHyQ8ewFnAFL7TXd1O14t3atsv_uM6Xc9ZHSfefERCjuehdw5SJuAn7MMs Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 96c4378d52d1489bb2d50e84cabf95eb Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: {"rebuild": {"imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b"}} Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 28223cad-bdfe-40ba-905e-56488b5119be could not be found. Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '28223cad-bdfe-40ba-905e-56488b5119be', 'body': {'rebuild': {'imageRef': '8f4db252-bff6-4685-9c8d-4c5d6bd9f78b'}}} Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28223cad-bdfe-40ba-905e-56488b5119be could not be found. Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 18 15:44:19.486060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 18 15:44:19.492115 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 18 15:44:19.492115 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:44:19.492115 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:44:19.492115 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:44:19.492115 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:44:19.492115 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28223cad-bdfe-40ba-905e-56488b5119be could not be found. Oct 18 15:44:19.492115 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:19.492115 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:44:19.492115 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:19.492115 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:19.492115 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:44:19.492115 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:44:19.492115 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:44:19.492115 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:44:19.492115 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28223cad-bdfe-40ba-905e-56488b5119be could not be found. Oct 18 15:44:19.492115 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:19.492115 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3a105b17-8555-4972-aefa-6c284cc6d3b5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Returning 404 to user: Instance 28223cad-bdfe-40ba-905e-56488b5119be could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:44:19.492115 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3a105b17-8555-4972-aefa-6c284cc6d3b5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "POST /compute/v2.1/servers/28223cad-bdfe-40ba-905e-56488b5119be/action" status: 404 len: 111 microversion: 2.1 time: 0.106805 Oct 18 15:44:19.492115 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2166/4320] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:44:19 2022] POST /compute/v2.1/servers/28223cad-bdfe-40ba-905e-56488b5119be/action => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:44:19.518045 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4a54b801-a4b4-42bd-94d3-e0e762d55872 tempest-VolumesTestJSON-300614846 tempest-VolumesTestJSON-300614846-project] Calling method '.version_select at 0x7f7c3d299ee0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:19.641702 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4a54b801-a4b4-42bd-94d3-e0e762d55872 tempest-VolumesTestJSON-300614846 tempest-VolumesTestJSON-300614846-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.152428 Oct 18 15:44:19.643939 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2167/4321] 10.222.0.60 () {58 vars in 1155 bytes} [Tue Oct 18 15:44:19 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:19.649321 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6f0b812d-e27a-42af-8bc4-29f799d9c1ac tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:44:19.656157 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6f0b812d-e27a-42af-8bc4-29f799d9c1ac tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: f27063e6-25a6-482b-bdb0-8147d5e82728] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:19.682436 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c096cd7e-3841-451b-8d6c-5b74fbeb3ac1 tempest-SecurityGroupRulesTestJSON-1152099622 tempest-SecurityGroupRulesTestJSON-1152099622-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.414355 Oct 18 15:44:19.684591 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2155/4322] 10.222.0.60 () {60 vars in 1195 bytes} [Tue Oct 18 15:44:19 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:44:19.693745 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d50641ca-168e-468c-8bd9-899b3a9ae457 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:19.694770 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d50641ca-168e-468c-8bd9-899b3a9ae457 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:19.700311 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-6f0b812d-e27a-42af-8bc4-29f799d9c1ac tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] HTTP exception thrown: Instance f27063e6-25a6-482b-bdb0-8147d5e82728 could not be found. Oct 18 15:44:19.705526 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d50641ca-168e-468c-8bd9-899b3a9ae457 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:19.706200 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d50641ca-168e-468c-8bd9-899b3a9ae457 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:19.707186 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d50641ca-168e-468c-8bd9-899b3a9ae457 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:19.708160 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d50641ca-168e-468c-8bd9-899b3a9ae457 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:19.709754 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d50641ca-168e-468c-8bd9-899b3a9ae457 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:19.710417 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d50641ca-168e-468c-8bd9-899b3a9ae457 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6f0b812d-e27a-42af-8bc4-29f799d9c1ac tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Request method failure captured: Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: request: POST /compute/v2.1/servers/f27063e6-25a6-482b-bdb0-8147d5e82728/action HTTP/1.1 Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 14 Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsmOlfJjna__aWkkHZgCFMOd2DpNqn_dr-IEPGuxkqNqAVs7tN5T268nd09vhRJnPU2g5DJC-yqBSq_x2HTDX86g3yOFixR2PbozSJNAuQoWzOe1hqzQDBztCsy4gcfQ635XTPjGuAISQPn4_b-3rgJ6h45QPHOVHclQC7dNdVcnHno Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 224ca1f734c14bc8bf31e1826faf8e71 Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1233761615 Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/224ca1f734c14bc8bf31e1826faf8e71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/224ca1f734c14bc8bf31e1826faf8e71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/224ca1f734c14bc8bf31e1826faf8e71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_224ca1f734c14bc8bf31e1826faf8e71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1233761615 Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 224ca1f734c14bc8bf31e1826faf8e71 Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1233761615 Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServerRescueNegativeTestJSON-1233761615-project Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 646fb4652c164c1dab5672d33d9fb295 Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1233761615-project Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: {"rescue": {}} Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance f27063e6-25a6-482b-bdb0-8147d5e82728 could not be found. Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'f27063e6-25a6-482b-bdb0-8147d5e82728', 'body': {'rescue': {}}} Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f27063e6-25a6-482b-bdb0-8147d5e82728 could not be found. Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f27063e6-25a6-482b-bdb0-8147d5e82728 could not be found. Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:19.717914 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:19.721827 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:44:19.721827 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:44:19.721827 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:44:19.721827 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:44:19.721827 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f27063e6-25a6-482b-bdb0-8147d5e82728 could not be found. Oct 18 15:44:19.721827 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:19.721827 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6f0b812d-e27a-42af-8bc4-29f799d9c1ac tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Returning 404 to user: Instance f27063e6-25a6-482b-bdb0-8147d5e82728 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:44:19.721827 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6f0b812d-e27a-42af-8bc4-29f799d9c1ac tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "POST /compute/v2.1/servers/f27063e6-25a6-482b-bdb0-8147d5e82728/action" status: 404 len: 111 microversion: 2.1 time: 0.074330 Oct 18 15:44:19.724939 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2168/4323] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:44:19 2022] POST /compute/v2.1/servers/f27063e6-25a6-482b-bdb0-8147d5e82728/action => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:44:19.729000 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ccd6f054-983a-4712-abbf-4afcefb99cf9 tempest-SecurityGroupRulesTestJSON-1152099622 tempest-SecurityGroupRulesTestJSON-1152099622-project] Action: 'create', calling method: .version_select at 0x7f7c3dfd8790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-854935039", "description": "tempest-description-1164579191"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:44:20.311319 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d50641ca-168e-468c-8bd9-899b3a9ae457 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:20.321259 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d50641ca-168e-468c-8bd9-899b3a9ae457 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.635263 Oct 18 15:44:20.325006 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2156/4324] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:19 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:20.336293 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8f2806aa-0cab-4bfc-abc6-09edac58f97d tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:44:20.342928 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8f2806aa-0cab-4bfc-abc6-09edac58f97d tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 19226472-0c76-46f8-a4ba-7d32931341a2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:20.361634 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f2806aa-0cab-4bfc-abc6-09edac58f97d tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:20.363179 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f2806aa-0cab-4bfc-abc6-09edac58f97d tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:20.363876 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f2806aa-0cab-4bfc-abc6-09edac58f97d tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:20.365036 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f2806aa-0cab-4bfc-abc6-09edac58f97d tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:20.365799 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f2806aa-0cab-4bfc-abc6-09edac58f97d tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:20.366451 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f2806aa-0cab-4bfc-abc6-09edac58f97d tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:20.529240 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:44:20.613902 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8f2806aa-0cab-4bfc-abc6-09edac58f97d tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "POST /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2/action" status: 202 len: 0 microversion: 2.1 time: 0.286146 Oct 18 15:44:20.618799 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2157/4325] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:44:20 2022] POST /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:44:20.629483 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-62192a74-6391-4af2-9757-25a48f988bac tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:20.631081 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-62192a74-6391-4af2-9757-25a48f988bac tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:20.643097 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62192a74-6391-4af2-9757-25a48f988bac tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:20.643969 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62192a74-6391-4af2-9757-25a48f988bac tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:20.644566 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62192a74-6391-4af2-9757-25a48f988bac tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:20.646208 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62192a74-6391-4af2-9757-25a48f988bac tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:20.646881 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62192a74-6391-4af2-9757-25a48f988bac tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:20.647478 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62192a74-6391-4af2-9757-25a48f988bac tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:21.170392 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ccd6f054-983a-4712-abbf-4afcefb99cf9 tempest-SecurityGroupRulesTestJSON-1152099622 tempest-SecurityGroupRulesTestJSON-1152099622-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.444669 Oct 18 15:44:21.170991 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2169/4326] 10.222.0.60 () {60 vars in 1180 bytes} [Tue Oct 18 15:44:19 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:44:21.180867 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-cdd84479-edf8-447d-9117-aadf90f015a2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:21.180867 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-cdd84479-edf8-447d-9117-aadf90f015a2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: e6019a42-1115-4a7b-bfab-badb33cafed8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:21.204114 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cdd84479-edf8-447d-9117-aadf90f015a2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:21.204621 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cdd84479-edf8-447d-9117-aadf90f015a2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:21.225316 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cdd84479-edf8-447d-9117-aadf90f015a2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:21.228987 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cdd84479-edf8-447d-9117-aadf90f015a2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:21.229493 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cdd84479-edf8-447d-9117-aadf90f015a2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:21.229937 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cdd84479-edf8-447d-9117-aadf90f015a2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:21.796155 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-62192a74-6391-4af2-9757-25a48f988bac tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:21.812205 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-62192a74-6391-4af2-9757-25a48f988bac tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 1.190530 Oct 18 15:44:21.818422 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2158/4327] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:20 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:21.844263 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-11f5d76b-b901-4428-b905-010931c6ea49 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:21.846863 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-11f5d76b-b901-4428-b905-010931c6ea49 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 19226472-0c76-46f8-a4ba-7d32931341a2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:21.887912 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-11f5d76b-b901-4428-b905-010931c6ea49 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:21.893877 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-11f5d76b-b901-4428-b905-010931c6ea49 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:21.905253 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-11f5d76b-b901-4428-b905-010931c6ea49 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:21.911070 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-11f5d76b-b901-4428-b905-010931c6ea49 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:21.912265 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-11f5d76b-b901-4428-b905-010931c6ea49 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:21.916670 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-11f5d76b-b901-4428-b905-010931c6ea49 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:22.779766 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-11f5d76b-b901-4428-b905-010931c6ea49 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:22.798218 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-11f5d76b-b901-4428-b905-010931c6ea49 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2" status: 200 len: 1501 microversion: 2.1 time: 0.968404 Oct 18 15:44:22.809837 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2159/4328] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:21 2022] GET /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2 => generated 1501 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:22.828777 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6f971557-80c4-41ab-8374-a536d809f83f tempest-SecurityGroupRulesTestJSON-1152099622 tempest-SecurityGroupRulesTestJSON-1152099622-project] Action: 'create', calling method: .version_select at 0x7f7c3cfbf820>, body: {"security_group_rule": {"parent_group_id": "f9b57947-3c2b-4adf-bea3-564680e0446e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:44:23.197636 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-cdd84479-edf8-447d-9117-aadf90f015a2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:23.214606 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-cdd84479-edf8-447d-9117-aadf90f015a2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8" status: 200 len: 1488 microversion: 2.1 time: 2.042468 Oct 18 15:44:23.223528 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2170/4329] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:21 2022] GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8 => generated 1488 bytes in 2044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:23.223528 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3a13b97b-6cd8-4d44-a97e-df5f03684d26 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:44:23.229734 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3a13b97b-6cd8-4d44-a97e-df5f03684d26 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: eb0ce226-0924-49a0-b4e0-68829e4df43a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:23.244218 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-3a13b97b-6cd8-4d44-a97e-df5f03684d26 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] HTTP exception thrown: Instance eb0ce226-0924-49a0-b4e0-68829e4df43a could not be found. Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3a13b97b-6cd8-4d44-a97e-df5f03684d26 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Request method failure captured: Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: request: POST /compute/v2.1/servers/eb0ce226-0924-49a0-b4e0-68829e4df43a/action HTTP/1.1 Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 65 Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTslxbnvpe5yiGf5CWZMgShC81OiGKrcSLYZFSWKOLbaqqF5kNJvh8cijdldsPo1OHjHXDcbdPuhTuFRNRswVq0HwpXLNCfOWcF3GU1M8LHkZwXu6ScaOEIHyQ8ewFnAFL7TXd1O14t3atsv_uM6Xc9ZHSfefERCjuehdw5SJuAn7MMs Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 96c4378d52d1489bb2d50e84cabf95eb Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: {"rebuild": {"imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b"}} Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance eb0ce226-0924-49a0-b4e0-68829e4df43a could not be found. Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'eb0ce226-0924-49a0-b4e0-68829e4df43a', 'body': {'rebuild': {'imageRef': '8f4db252-bff6-4685-9c8d-4c5d6bd9f78b'}}} Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb0ce226-0924-49a0-b4e0-68829e4df43a could not be found. Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 18 15:44:23.249563 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:44:23.253257 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:44:23.253257 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:44:23.253257 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:44:23.253257 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb0ce226-0924-49a0-b4e0-68829e4df43a could not be found. Oct 18 15:44:23.253257 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:23.253257 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:44:23.253257 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:23.253257 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:23.253257 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:44:23.253257 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:44:23.253257 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:44:23.253257 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:44:23.253257 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb0ce226-0924-49a0-b4e0-68829e4df43a could not be found. Oct 18 15:44:23.253257 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:23.253257 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3a13b97b-6cd8-4d44-a97e-df5f03684d26 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Returning 404 to user: Instance eb0ce226-0924-49a0-b4e0-68829e4df43a could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:44:23.253257 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3a13b97b-6cd8-4d44-a97e-df5f03684d26 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "POST /compute/v2.1/servers/eb0ce226-0924-49a0-b4e0-68829e4df43a/action" status: 404 len: 111 microversion: 2.1 time: 0.034431 Oct 18 15:44:23.253257 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2171/4330] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:44:23 2022] POST /compute/v2.1/servers/eb0ce226-0924-49a0-b4e0-68829e4df43a/action => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:44:23.288780 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-471fcb3c-1421-4c59-b40c-3465708cb4bf tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:44:23.294287 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-471fcb3c-1421-4c59-b40c-3465708cb4bf tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 19226472-0c76-46f8-a4ba-7d32931341a2] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:23.302308 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-471fcb3c-1421-4c59-b40c-3465708cb4bf tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:23.302857 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-471fcb3c-1421-4c59-b40c-3465708cb4bf tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:23.303299 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-471fcb3c-1421-4c59-b40c-3465708cb4bf tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:23.304253 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-471fcb3c-1421-4c59-b40c-3465708cb4bf tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:23.305050 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-471fcb3c-1421-4c59-b40c-3465708cb4bf tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:23.305665 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-471fcb3c-1421-4c59-b40c-3465708cb4bf tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:23.354731 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-471fcb3c-1421-4c59-b40c-3465708cb4bf tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lazy-loading 'flavor' on Instance uuid 19226472-0c76-46f8-a4ba-7d32931341a2 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:44:23.389428 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-471fcb3c-1421-4c59-b40c-3465708cb4bf tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] HTTP exception thrown: Cannot 'rescue' instance 19226472-0c76-46f8-a4ba-7d32931341a2 while it is in vm_state paused Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-471fcb3c-1421-4c59-b40c-3465708cb4bf tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Request method failure captured: Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: request: POST /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2/action HTTP/1.1 Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 14 Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsmOlfJjna__aWkkHZgCFMOd2DpNqn_dr-IEPGuxkqNqAVs7tN5T268nd09vhRJnPU2g5DJC-yqBSq_x2HTDX86g3yOFixR2PbozSJNAuQoWzOe1hqzQDBztCsy4gcfQ635XTPjGuAISQPn4_b-3rgJ6h45QPHOVHclQC7dNdVcnHno Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 224ca1f734c14bc8bf31e1826faf8e71 Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1233761615 Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/224ca1f734c14bc8bf31e1826faf8e71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/224ca1f734c14bc8bf31e1826faf8e71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/224ca1f734c14bc8bf31e1826faf8e71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_224ca1f734c14bc8bf31e1826faf8e71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1233761615 Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 224ca1f734c14bc8bf31e1826faf8e71 Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1233761615 Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServerRescueNegativeTestJSON-1233761615-project Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 646fb4652c164c1dab5672d33d9fb295 Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1233761615-project Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: {"rescue": {}} Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: exception: Cannot 'rescue' instance 19226472-0c76-46f8-a4ba-7d32931341a2 while it is in vm_state paused Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '19226472-0c76-46f8-a4ba-7d32931341a2', 'body': {'rescue': {}}} Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 19226472-0c76-46f8-a4ba-7d32931341a2 in vm_state paused. Cannot rescue while the instance is in this state. Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 19226472-0c76-46f8-a4ba-7d32931341a2 while it is in vm_state paused Oct 18 15:44:23.394524 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:23.402207 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:44:23.402207 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:23.402207 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:23.402207 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:44:23.402207 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:44:23.402207 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:44:23.402207 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:44:23.402207 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 19226472-0c76-46f8-a4ba-7d32931341a2 while it is in vm_state paused Oct 18 15:44:23.402207 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:23.402207 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-471fcb3c-1421-4c59-b40c-3465708cb4bf tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Returning 409 to user: Cannot 'rescue' instance 19226472-0c76-46f8-a4ba-7d32931341a2 while it is in vm_state paused {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:44:23.405206 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-471fcb3c-1421-4c59-b40c-3465708cb4bf tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "POST /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2/action" status: 409 len: 144 microversion: 2.1 time: 0.139334 Oct 18 15:44:23.406912 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2172/4331] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:44:23 2022] POST /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2/action => generated 144 bytes in 154 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 15:44:23.446867 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6f971557-80c4-41ab-8374-a536d809f83f tempest-SecurityGroupRulesTestJSON-1152099622 tempest-SecurityGroupRulesTestJSON-1152099622-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.634294 Oct 18 15:44:23.447007 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f62153d3-f0b7-431f-925b-fac1e78b1b8d tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:23.447848 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f62153d3-f0b7-431f-925b-fac1e78b1b8d tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 55179126-a629-4bb3-82f5-14606ec63426] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:23.457062 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2160/4332] 10.222.0.60 () {60 vars in 1195 bytes} [Tue Oct 18 15:44:22 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:44:23.460338 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:DELETE=2,nova_api:SELECT=98 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:44:23.468003 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f62153d3-f0b7-431f-925b-fac1e78b1b8d tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:23.468512 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f62153d3-f0b7-431f-925b-fac1e78b1b8d tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:23.468999 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f62153d3-f0b7-431f-925b-fac1e78b1b8d tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:23.469309 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2aa7d54c-d31b-4299-8981-b4013b69403e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:44:23.469719 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f62153d3-f0b7-431f-925b-fac1e78b1b8d tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:23.470184 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f62153d3-f0b7-431f-925b-fac1e78b1b8d tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:23.470781 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f62153d3-f0b7-431f-925b-fac1e78b1b8d tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:23.491560 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2aa7d54c-d31b-4299-8981-b4013b69403e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:23.510601 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2aa7d54c-d31b-4299-8981-b4013b69403e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:23.512283 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2aa7d54c-d31b-4299-8981-b4013b69403e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:23.513237 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2aa7d54c-d31b-4299-8981-b4013b69403e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:23.517271 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2aa7d54c-d31b-4299-8981-b4013b69403e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:23.518178 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2aa7d54c-d31b-4299-8981-b4013b69403e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:23.521462 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2aa7d54c-d31b-4299-8981-b4013b69403e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:23.543829 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f62153d3-f0b7-431f-925b-fac1e78b1b8d tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426/os-volume_attachments/f3125de0-86fe-4b6f-9de6-798cd8427ae7" status: 200 len: 194 microversion: 2.1 time: 0.135329 Oct 18 15:44:23.544475 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2173/4333] 10.222.0.60 () {58 vars in 1413 bytes} [Tue Oct 18 15:44:23 2022] GET /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426/os-volume_attachments/f3125de0-86fe-4b6f-9de6-798cd8427ae7 => generated 194 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:44:23.574078 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f9aac177-1af5-4cec-8b0a-f8b6c256e362 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:23.574999 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f9aac177-1af5-4cec-8b0a-f8b6c256e362 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:23.583752 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f9aac177-1af5-4cec-8b0a-f8b6c256e362 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:23.584546 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f9aac177-1af5-4cec-8b0a-f8b6c256e362 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:23.585245 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f9aac177-1af5-4cec-8b0a-f8b6c256e362 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:23.586110 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f9aac177-1af5-4cec-8b0a-f8b6c256e362 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:23.586740 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f9aac177-1af5-4cec-8b0a-f8b6c256e362 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:23.587368 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f9aac177-1af5-4cec-8b0a-f8b6c256e362 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:23.599544 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2aa7d54c-d31b-4299-8981-b4013b69403e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "POST /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8/action" status: 200 len: 125 microversion: 2.1 time: 0.149158 Oct 18 15:44:23.602805 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2161/4334] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:44:23 2022] POST /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8/action => generated 125 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:44:23.613222 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-49b3a7c5-dcb1-45a6-b839-99c9f8596715 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:44:23.614051 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-49b3a7c5-dcb1-45a6-b839-99c9f8596715 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 19226472-0c76-46f8-a4ba-7d32931341a2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:23.638226 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49b3a7c5-dcb1-45a6-b839-99c9f8596715 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:23.641669 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49b3a7c5-dcb1-45a6-b839-99c9f8596715 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:23.642301 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49b3a7c5-dcb1-45a6-b839-99c9f8596715 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:23.643259 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49b3a7c5-dcb1-45a6-b839-99c9f8596715 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:23.643862 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49b3a7c5-dcb1-45a6-b839-99c9f8596715 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:23.645175 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49b3a7c5-dcb1-45a6-b839-99c9f8596715 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:23.847674 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-49b3a7c5-dcb1-45a6-b839-99c9f8596715 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "POST /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2/action" status: 202 len: 0 microversion: 2.1 time: 0.241824 Oct 18 15:44:23.849938 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2162/4335] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:44:23 2022] POST /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:44:23.858632 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-022e7f18-d418-43e5-aa63-6387cfd42290 tempest-SecurityGroupRulesTestJSON-1152099622 tempest-SecurityGroupRulesTestJSON-1152099622-project] Action: 'create', calling method: .version_select at 0x7f7c3d0069d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1052064241", "description": "tempest-description-219715537"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:44:23.952841 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f9aac177-1af5-4cec-8b0a-f8b6c256e362 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:23.965414 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f9aac177-1af5-4cec-8b0a-f8b6c256e362 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.401998 Oct 18 15:44:23.966389 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2174/4336] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:23 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:23.971869 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2848f7c3-2fb9-40cd-9123-5739d3019822 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:23.981233 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2848f7c3-2fb9-40cd-9123-5739d3019822 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 55179126-a629-4bb3-82f5-14606ec63426] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:24.010682 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2848f7c3-2fb9-40cd-9123-5739d3019822 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:24.011602 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2848f7c3-2fb9-40cd-9123-5739d3019822 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:24.012225 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2848f7c3-2fb9-40cd-9123-5739d3019822 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:24.013401 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2848f7c3-2fb9-40cd-9123-5739d3019822 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:24.016244 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2848f7c3-2fb9-40cd-9123-5739d3019822 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:24.016980 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2848f7c3-2fb9-40cd-9123-5739d3019822 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:24.230767 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-2848f7c3-2fb9-40cd-9123-5739d3019822 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lazy-loading 'services' on Instance uuid 55179126-a629-4bb3-82f5-14606ec63426 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:44:24.384910 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-022e7f18-d418-43e5-aa63-6387cfd42290 tempest-SecurityGroupRulesTestJSON-1152099622 tempest-SecurityGroupRulesTestJSON-1152099622-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.533131 Oct 18 15:44:24.386106 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2163/4337] 10.222.0.60 () {60 vars in 1180 bytes} [Tue Oct 18 15:44:23 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:44:24.396302 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8dec7e7e-78e4-47ce-957f-76cbdc104e1e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:24.407365 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8dec7e7e-78e4-47ce-957f-76cbdc104e1e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:24.420242 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8dec7e7e-78e4-47ce-957f-76cbdc104e1e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:24.422381 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2848f7c3-2fb9-40cd-9123-5739d3019822 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "DELETE /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426/os-volume_attachments/f3125de0-86fe-4b6f-9de6-798cd8427ae7" status: 202 len: 0 microversion: 2.1 time: 0.451650 Oct 18 15:44:24.423033 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2175/4338] 10.222.0.60 () {58 vars in 1416 bytes} [Tue Oct 18 15:44:23 2022] DELETE /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426/os-volume_attachments/f3125de0-86fe-4b6f-9de6-798cd8427ae7 => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:44:24.429764 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8dec7e7e-78e4-47ce-957f-76cbdc104e1e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:24.431722 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8dec7e7e-78e4-47ce-957f-76cbdc104e1e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:24.432795 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8dec7e7e-78e4-47ce-957f-76cbdc104e1e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:24.437392 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8dec7e7e-78e4-47ce-957f-76cbdc104e1e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:24.438138 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8dec7e7e-78e4-47ce-957f-76cbdc104e1e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:24.453442 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-dec72c29-6b04-44e5-8f28-37716b79db2e tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:24.457878 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-dec72c29-6b04-44e5-8f28-37716b79db2e tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 19226472-0c76-46f8-a4ba-7d32931341a2] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:24.483900 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dec72c29-6b04-44e5-8f28-37716b79db2e tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:24.486253 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dec72c29-6b04-44e5-8f28-37716b79db2e tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:24.488095 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dec72c29-6b04-44e5-8f28-37716b79db2e tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:24.491007 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dec72c29-6b04-44e5-8f28-37716b79db2e tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:24.491551 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dec72c29-6b04-44e5-8f28-37716b79db2e tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:24.492011 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dec72c29-6b04-44e5-8f28-37716b79db2e tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:24.789133 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8dec7e7e-78e4-47ce-957f-76cbdc104e1e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:24.799923 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8dec7e7e-78e4-47ce-957f-76cbdc104e1e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1671 microversion: 2.1 time: 0.412445 Oct 18 15:44:24.807259 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2164/4339] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:24 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1671 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:24.814624 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a95eca59-91d3-46b5-8804-1dc500324c7c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:24.815388 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a95eca59-91d3-46b5-8804-1dc500324c7c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:24.822451 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a95eca59-91d3-46b5-8804-1dc500324c7c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:24.823202 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a95eca59-91d3-46b5-8804-1dc500324c7c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:24.823896 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a95eca59-91d3-46b5-8804-1dc500324c7c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:24.824998 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a95eca59-91d3-46b5-8804-1dc500324c7c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:24.826422 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a95eca59-91d3-46b5-8804-1dc500324c7c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:24.827287 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a95eca59-91d3-46b5-8804-1dc500324c7c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:25.139754 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-dec72c29-6b04-44e5-8f28-37716b79db2e tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:25.148556 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-dec72c29-6b04-44e5-8f28-37716b79db2e tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2" status: 200 len: 1516 microversion: 2.1 time: 0.721903 Oct 18 15:44:25.165600 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2176/4340] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:24 2022] GET /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2 => generated 1516 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:25.174027 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-97fac374-6c17-4e78-a5f0-76216085b9ba tempest-SecurityGroupRulesTestJSON-1152099622 tempest-SecurityGroupRulesTestJSON-1152099622-project] Action: 'create', calling method: .version_select at 0x7f7c3c4d8040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-892640726", "description": "tempest-description-387175303"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:44:25.544097 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a95eca59-91d3-46b5-8804-1dc500324c7c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:25.558603 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a95eca59-91d3-46b5-8804-1dc500324c7c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.748053 Oct 18 15:44:25.568852 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2165/4341] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:24 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:25.579873 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3e284f90-9e83-4462-b64f-834ba57cfb9b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:25.579873 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3e284f90-9e83-4462-b64f-834ba57cfb9b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:25.599340 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e284f90-9e83-4462-b64f-834ba57cfb9b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:25.604533 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e284f90-9e83-4462-b64f-834ba57cfb9b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:25.608966 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e284f90-9e83-4462-b64f-834ba57cfb9b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:25.609836 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e284f90-9e83-4462-b64f-834ba57cfb9b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:25.610327 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e284f90-9e83-4462-b64f-834ba57cfb9b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:25.613793 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e284f90-9e83-4462-b64f-834ba57cfb9b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:26.226927 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-97fac374-6c17-4e78-a5f0-76216085b9ba tempest-SecurityGroupRulesTestJSON-1152099622 tempest-SecurityGroupRulesTestJSON-1152099622-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.059970 Oct 18 15:44:26.228518 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2177/4342] 10.222.0.60 () {60 vars in 1180 bytes} [Tue Oct 18 15:44:25 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:44:26.234617 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d8fc01fe-8f1e-4164-b378-83c5dc5149cb tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:44:26.235451 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d8fc01fe-8f1e-4164-b378-83c5dc5149cb tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 8cb186e1-d979-4294-8b1f-b6b377c8ca5c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:26.246777 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-d8fc01fe-8f1e-4164-b378-83c5dc5149cb tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] HTTP exception thrown: Instance 8cb186e1-d979-4294-8b1f-b6b377c8ca5c could not be found. Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d8fc01fe-8f1e-4164-b378-83c5dc5149cb tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Request method failure captured: Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: request: POST /compute/v2.1/servers/8cb186e1-d979-4294-8b1f-b6b377c8ca5c/action HTTP/1.1 Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 15 Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTslxbnvpe5yiGf5CWZMgShC81OiGKrcSLYZFSWKOLbaqqF5kNJvh8cijdldsPo1OHjHXDcbdPuhTuFRNRswVq0HwpXLNCfOWcF3GU1M8LHkZwXu6ScaOEIHyQ8ewFnAFL7TXd1O14t3atsv_uM6Xc9ZHSfefERCjuehdw5SJuAn7MMs Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 96c4378d52d1489bb2d50e84cabf95eb Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: {"restore": {}} Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 8cb186e1-d979-4294-8b1f-b6b377c8ca5c could not be found. Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '8cb186e1-d979-4294-8b1f-b6b377c8ca5c', 'body': {'restore': {}}} Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cb186e1-d979-4294-8b1f-b6b377c8ca5c could not be found. Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cb186e1-d979-4294-8b1f-b6b377c8ca5c could not be found. Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:44:26.252067 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:44:26.256540 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:44:26.256540 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:44:26.256540 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cb186e1-d979-4294-8b1f-b6b377c8ca5c could not be found. Oct 18 15:44:26.256540 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:26.258900 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d8fc01fe-8f1e-4164-b378-83c5dc5149cb tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Returning 404 to user: Instance 8cb186e1-d979-4294-8b1f-b6b377c8ca5c could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:44:26.260253 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d8fc01fe-8f1e-4164-b378-83c5dc5149cb tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "POST /compute/v2.1/servers/8cb186e1-d979-4294-8b1f-b6b377c8ca5c/action" status: 404 len: 111 microversion: 2.1 time: 0.030259 Oct 18 15:44:26.261253 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2178/4343] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:44:26 2022] POST /compute/v2.1/servers/8cb186e1-d979-4294-8b1f-b6b377c8ca5c/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:44:26.266425 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-63ee7295-cb5a-4194-ab80-982218dae042 tempest-SecurityGroupRulesTestJSON-1152099622 tempest-SecurityGroupRulesTestJSON-1152099622-project] Action: 'create', calling method: .version_select at 0x7f7c3c7fa700>, body: {"security_group_rule": {"parent_group_id": "c554a69f-04e3-4c13-b5aa-eb7b7446044a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "27d2ff5b-d383-4920-a822-5a8ce0c9762e"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:44:26.369571 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3e284f90-9e83-4462-b64f-834ba57cfb9b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:26.381363 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3e284f90-9e83-4462-b64f-834ba57cfb9b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1671 microversion: 2.1 time: 0.819273 Oct 18 15:44:26.398354 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2166/4344] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:25 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1671 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:26.403871 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9f8083dc-07e5-4218-98f6-2d978ec4f0fa tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:26.413131 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9f8083dc-07e5-4218-98f6-2d978ec4f0fa tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:26.437187 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f8083dc-07e5-4218-98f6-2d978ec4f0fa tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:26.438124 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f8083dc-07e5-4218-98f6-2d978ec4f0fa tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:26.438788 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f8083dc-07e5-4218-98f6-2d978ec4f0fa tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:26.439748 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f8083dc-07e5-4218-98f6-2d978ec4f0fa tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:26.442189 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f8083dc-07e5-4218-98f6-2d978ec4f0fa tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:26.442882 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f8083dc-07e5-4218-98f6-2d978ec4f0fa tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:26.872505 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9f8083dc-07e5-4218-98f6-2d978ec4f0fa tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:26.886620 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9f8083dc-07e5-4218-98f6-2d978ec4f0fa tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.483469 Oct 18 15:44:26.888207 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2167/4345] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:26 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:26.909388 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a44ea10b-139b-4d3a-add0-089a6f99305a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:26.911963 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a44ea10b-139b-4d3a-add0-089a6f99305a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:26.929492 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a44ea10b-139b-4d3a-add0-089a6f99305a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:26.940940 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a44ea10b-139b-4d3a-add0-089a6f99305a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:26.942678 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a44ea10b-139b-4d3a-add0-089a6f99305a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:26.944663 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a44ea10b-139b-4d3a-add0-089a6f99305a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:26.952661 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a44ea10b-139b-4d3a-add0-089a6f99305a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:26.953289 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a44ea10b-139b-4d3a-add0-089a6f99305a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:27.044145 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-63ee7295-cb5a-4194-ab80-982218dae042 tempest-SecurityGroupRulesTestJSON-1152099622 tempest-SecurityGroupRulesTestJSON-1152099622-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.781275 Oct 18 15:44:27.045237 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2179/4346] 10.222.0.60 () {60 vars in 1195 bytes} [Tue Oct 18 15:44:26 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:44:27.050426 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-595303a1-f97a-4ec9-89b3-3546bb8e5607 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:27.051271 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-595303a1-f97a-4ec9-89b3-3546bb8e5607 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:27.067886 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-595303a1-f97a-4ec9-89b3-3546bb8e5607 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:27.071022 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-595303a1-f97a-4ec9-89b3-3546bb8e5607 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:27.072787 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-595303a1-f97a-4ec9-89b3-3546bb8e5607 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:27.073722 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-595303a1-f97a-4ec9-89b3-3546bb8e5607 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:27.074343 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-595303a1-f97a-4ec9-89b3-3546bb8e5607 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:27.074932 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-595303a1-f97a-4ec9-89b3-3546bb8e5607 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:27.406233 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-595303a1-f97a-4ec9-89b3-3546bb8e5607 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:27.425545 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-595303a1-f97a-4ec9-89b3-3546bb8e5607 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.378940 Oct 18 15:44:27.428545 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2180/4347] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:27 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:27.437109 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6c2b3488-3800-450d-b700-1afa55f55348 tempest-SecurityGroupRulesTestJSON-1152099622 tempest-SecurityGroupRulesTestJSON-1152099622-project] Action: 'create', calling method: .version_select at 0x7f7c3d3d5280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1742783072", "description": "tempest-description-2134259809"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:44:27.535172 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a44ea10b-139b-4d3a-add0-089a6f99305a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:27.547179 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a44ea10b-139b-4d3a-add0-089a6f99305a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1671 microversion: 2.1 time: 0.656074 Oct 18 15:44:27.554753 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2168/4348] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:26 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1671 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:27.560952 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-32d6e17e-9699-4193-b0a6-81a6faec7cde tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:44:27.563343 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-32d6e17e-9699-4193-b0a6-81a6faec7cde tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:27.570432 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32d6e17e-9699-4193-b0a6-81a6faec7cde tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:27.571174 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32d6e17e-9699-4193-b0a6-81a6faec7cde tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:27.571772 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32d6e17e-9699-4193-b0a6-81a6faec7cde tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:27.573477 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32d6e17e-9699-4193-b0a6-81a6faec7cde tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:27.574114 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32d6e17e-9699-4193-b0a6-81a6faec7cde tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:27.574796 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32d6e17e-9699-4193-b0a6-81a6faec7cde tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:27.603761 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-32d6e17e-9699-4193-b0a6-81a6faec7cde tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] HTTP exception thrown: Cannot 'restore' instance 2cc69e2e-cb26-42d6-b887-31e0afaa69fc while it is in vm_state active Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-32d6e17e-9699-4193-b0a6-81a6faec7cde tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Request method failure captured: Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc/action HTTP/1.1 Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 15 Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTslxbnvpe5yiGf5CWZMgShC81OiGKrcSLYZFSWKOLbaqqF5kNJvh8cijdldsPo1OHjHXDcbdPuhTuFRNRswVq0HwpXLNCfOWcF3GU1M8LHkZwXu6ScaOEIHyQ8ewFnAFL7TXd1O14t3atsv_uM6Xc9ZHSfefERCjuehdw5SJuAn7MMs Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 96c4378d52d1489bb2d50e84cabf95eb Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: {"restore": {}} Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: exception: Cannot 'restore' instance 2cc69e2e-cb26-42d6-b887-31e0afaa69fc while it is in vm_state active Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '2cc69e2e-cb26-42d6-b887-31e0afaa69fc', 'body': {'restore': {}}} Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2cc69e2e-cb26-42d6-b887-31e0afaa69fc in vm_state active. Cannot restore while the instance is in this state. Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 2cc69e2e-cb26-42d6-b887-31e0afaa69fc while it is in vm_state active Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:27.606557 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:44:27.613076 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:44:27.613076 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:44:27.613076 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:44:27.613076 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 2cc69e2e-cb26-42d6-b887-31e0afaa69fc while it is in vm_state active Oct 18 15:44:27.613076 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:27.615084 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-32d6e17e-9699-4193-b0a6-81a6faec7cde tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Returning 409 to user: Cannot 'restore' instance 2cc69e2e-cb26-42d6-b887-31e0afaa69fc while it is in vm_state active {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:44:27.618047 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-32d6e17e-9699-4193-b0a6-81a6faec7cde tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "POST /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc/action" status: 409 len: 145 microversion: 2.1 time: 0.060776 Oct 18 15:44:27.619431 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2169/4349] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:44:27 2022] POST /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc/action => generated 145 bytes in 64 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 15:44:27.625594 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-120cd5db-9866-4f3b-8351-585500dd5889 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:27.626372 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-120cd5db-9866-4f3b-8351-585500dd5889 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:27.637797 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-120cd5db-9866-4f3b-8351-585500dd5889 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:27.642335 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-120cd5db-9866-4f3b-8351-585500dd5889 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:27.645159 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-120cd5db-9866-4f3b-8351-585500dd5889 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:27.646103 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-120cd5db-9866-4f3b-8351-585500dd5889 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:27.649879 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-120cd5db-9866-4f3b-8351-585500dd5889 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:27.650508 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-120cd5db-9866-4f3b-8351-585500dd5889 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:27.917796 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6c2b3488-3800-450d-b700-1afa55f55348 tempest-SecurityGroupRulesTestJSON-1152099622 tempest-SecurityGroupRulesTestJSON-1152099622-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.487848 Oct 18 15:44:27.929482 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2181/4350] 10.222.0.60 () {60 vars in 1180 bytes} [Tue Oct 18 15:44:27 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:44:27.934894 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-64cfe106-b06a-4c0a-ab27-53d2fc3e0bb5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:27.936105 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-64cfe106-b06a-4c0a-ab27-53d2fc3e0bb5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:27.967602 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-64cfe106-b06a-4c0a-ab27-53d2fc3e0bb5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:27.974312 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-64cfe106-b06a-4c0a-ab27-53d2fc3e0bb5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:27.974948 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-64cfe106-b06a-4c0a-ab27-53d2fc3e0bb5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:27.975837 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-64cfe106-b06a-4c0a-ab27-53d2fc3e0bb5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:27.976431 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-64cfe106-b06a-4c0a-ab27-53d2fc3e0bb5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:27.977028 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-64cfe106-b06a-4c0a-ab27-53d2fc3e0bb5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:28.005907 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-120cd5db-9866-4f3b-8351-585500dd5889 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:28.017916 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-120cd5db-9866-4f3b-8351-585500dd5889 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1671 microversion: 2.1 time: 0.397063 Oct 18 15:44:28.019877 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2170/4351] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:27 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1671 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:28.026424 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8a9bc2d2-a2dc-45fe-ac6f-dbefc25877f5 tempest-SecurityGroupRulesTestJSON-1152099622 tempest-SecurityGroupRulesTestJSON-1152099622-project] Action: 'create', calling method: .version_select at 0x7f7c3d7d1d30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1156728783", "description": "tempest-description-186586490"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:44:28.414601 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-64cfe106-b06a-4c0a-ab27-53d2fc3e0bb5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:28.435840 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-64cfe106-b06a-4c0a-ab27-53d2fc3e0bb5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.504942 Oct 18 15:44:28.441552 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2182/4352] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:27 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:28.474996 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2f864304-959e-44de-8d4f-af4740001c41 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:44:28.479654 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2f864304-959e-44de-8d4f-af4740001c41 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 19226472-0c76-46f8-a4ba-7d32931341a2] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:28.505482 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2f864304-959e-44de-8d4f-af4740001c41 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:28.515336 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2f864304-959e-44de-8d4f-af4740001c41 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:28.515953 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2f864304-959e-44de-8d4f-af4740001c41 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:28.516894 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2f864304-959e-44de-8d4f-af4740001c41 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:28.518311 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2f864304-959e-44de-8d4f-af4740001c41 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:28.519814 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2f864304-959e-44de-8d4f-af4740001c41 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:28.591526 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-2f864304-959e-44de-8d4f-af4740001c41 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lazy-loading 'flavor' on Instance uuid 19226472-0c76-46f8-a4ba-7d32931341a2 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:44:28.620938 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8a9bc2d2-a2dc-45fe-ac6f-dbefc25877f5 tempest-SecurityGroupRulesTestJSON-1152099622 tempest-SecurityGroupRulesTestJSON-1152099622-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.599710 Oct 18 15:44:28.625969 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2171/4353] 10.222.0.60 () {60 vars in 1180 bytes} [Tue Oct 18 15:44:28 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:44:28.651028 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2c65d6cc-04ac-4734-b8ef-2cd7cf0a8e7a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1554546320", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "f7f357f0-b7b8-48ee-8cbb-a57289af59df"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:44:28.755089 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-2c65d6cc-04ac-4734-b8ef-2cd7cf0a8e7a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] validate_networks() for [('f7f357f0-b7b8-48ee-8cbb-a57289af59df', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:44:28.788279 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2f864304-959e-44de-8d4f-af4740001c41 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "POST /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2/action" status: 200 len: 32 microversion: 2.1 time: 0.340632 Oct 18 15:44:28.793896 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2183/4354] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:44:28 2022] POST /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2/action => generated 32 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:44:28.800302 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ec346a99-619a-41fa-b4c4-e527ef0bd21e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:28.801299 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ec346a99-619a-41fa-b4c4-e527ef0bd21e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:28.807956 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ec346a99-619a-41fa-b4c4-e527ef0bd21e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:28.808702 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ec346a99-619a-41fa-b4c4-e527ef0bd21e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:28.809328 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ec346a99-619a-41fa-b4c4-e527ef0bd21e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:28.810261 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ec346a99-619a-41fa-b4c4-e527ef0bd21e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:28.810978 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ec346a99-619a-41fa-b4c4-e527ef0bd21e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:28.811634 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ec346a99-619a-41fa-b4c4-e527ef0bd21e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:31.103900 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ec346a99-619a-41fa-b4c4-e527ef0bd21e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:31.117002 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ec346a99-619a-41fa-b4c4-e527ef0bd21e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 2.316925 Oct 18 15:44:31.120088 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2184/4355] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:28 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 2325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:31.134588 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3f051090-1970-404a-bc3a-95de69526f1b tempest-SecurityGroupRulesTestJSON-1152099622 tempest-SecurityGroupRulesTestJSON-1152099622-project] Action: 'create', calling method: .version_select at 0x7f7c3c4d8160>, body: {"security_group_rule": {"parent_group_id": "114f81cd-bfb0-4efa-baec-a1fe270e4e6d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "8bcde268-e838-479b-b5e8-7bab99c02f9f"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:44:31.324055 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-2c65d6cc-04ac-4734-b8ef-2cd7cf0a8e7a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:44:31.325263 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-2c65d6cc-04ac-4734-b8ef-2cd7cf0a8e7a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:44:31.326742 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-2c65d6cc-04ac-4734-b8ef-2cd7cf0a8e7a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:44:31.327334 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-2c65d6cc-04ac-4734-b8ef-2cd7cf0a8e7a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:44:31.327912 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-2c65d6cc-04ac-4734-b8ef-2cd7cf0a8e7a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:44:31.351760 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c65d6cc-04ac-4734-b8ef-2cd7cf0a8e7a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:31.354274 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c65d6cc-04ac-4734-b8ef-2cd7cf0a8e7a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:31.354886 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c65d6cc-04ac-4734-b8ef-2cd7cf0a8e7a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:31.361430 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c65d6cc-04ac-4734-b8ef-2cd7cf0a8e7a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:31.362116 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c65d6cc-04ac-4734-b8ef-2cd7cf0a8e7a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:31.375887 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c65d6cc-04ac-4734-b8ef-2cd7cf0a8e7a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:31.438134 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-2c65d6cc-04ac-4734-b8ef-2cd7cf0a8e7a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Getting quotas for project 2a2cdc778bd54f209d70f5b8703dc068. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:44:31.453194 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-2c65d6cc-04ac-4734-b8ef-2cd7cf0a8e7a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Getting quotas for user 2aa0148a4a43466da619ea9843b3f78c and project 2a2cdc778bd54f209d70f5b8703dc068. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:44:31.511232 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2c65d6cc-04ac-4734-b8ef-2cd7cf0a8e7a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:44:31.517989 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2c65d6cc-04ac-4734-b8ef-2cd7cf0a8e7a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 25eb309d-2add-4b63-96b9-f78966b9f3b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:44:31.618897 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2c65d6cc-04ac-4734-b8ef-2cd7cf0a8e7a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.990606 Oct 18 15:44:31.620947 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2172/4356] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:44:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2994 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:44:31.632734 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2a7ad9d6-44ae-4e48-98fb-2659debc804a tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:31.633586 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2a7ad9d6-44ae-4e48-98fb-2659debc804a tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 19226472-0c76-46f8-a4ba-7d32931341a2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:31.695562 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a7ad9d6-44ae-4e48-98fb-2659debc804a tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:31.696426 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a7ad9d6-44ae-4e48-98fb-2659debc804a tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:31.698211 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a7ad9d6-44ae-4e48-98fb-2659debc804a tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:31.699737 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a7ad9d6-44ae-4e48-98fb-2659debc804a tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:31.702782 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a7ad9d6-44ae-4e48-98fb-2659debc804a tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:31.706324 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a7ad9d6-44ae-4e48-98fb-2659debc804a tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:31.943766 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3f051090-1970-404a-bc3a-95de69526f1b tempest-SecurityGroupRulesTestJSON-1152099622 tempest-SecurityGroupRulesTestJSON-1152099622-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.822527 Oct 18 15:44:31.946162 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2185/4357] 10.222.0.60 () {60 vars in 1195 bytes} [Tue Oct 18 15:44:31 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:44:31.953984 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a8feca65-a524-4e9f-a047-422e6d0f796b tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:44:31.954697 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a8feca65-a524-4e9f-a047-422e6d0f796b tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 4e5bdcf3-8333-4d88-8cc3-93d9327711b6] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:31.984404 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-a8feca65-a524-4e9f-a047-422e6d0f796b tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] HTTP exception thrown: Instance 4e5bdcf3-8333-4d88-8cc3-93d9327711b6 could not be found. Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a8feca65-a524-4e9f-a047-422e6d0f796b tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Request method failure captured: Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: request: POST /compute/v2.1/servers/4e5bdcf3-8333-4d88-8cc3-93d9327711b6/action HTTP/1.1 Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 14 Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTslxbnvpe5yiGf5CWZMgShC81OiGKrcSLYZFSWKOLbaqqF5kNJvh8cijdldsPo1OHjHXDcbdPuhTuFRNRswVq0HwpXLNCfOWcF3GU1M8LHkZwXu6ScaOEIHyQ8ewFnAFL7TXd1O14t3atsv_uM6Xc9ZHSfefERCjuehdw5SJuAn7MMs Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 96c4378d52d1489bb2d50e84cabf95eb Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: {"resume": {}} Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 4e5bdcf3-8333-4d88-8cc3-93d9327711b6 could not be found. Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '4e5bdcf3-8333-4d88-8cc3-93d9327711b6', 'body': {'resume': {}}} Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e5bdcf3-8333-4d88-8cc3-93d9327711b6 could not be found. Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e5bdcf3-8333-4d88-8cc3-93d9327711b6 could not be found. Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:44:31.995277 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:44:32.002973 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:44:32.002973 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:44:32.002973 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e5bdcf3-8333-4d88-8cc3-93d9327711b6 could not be found. Oct 18 15:44:32.002973 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:32.002973 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a8feca65-a524-4e9f-a047-422e6d0f796b tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Returning 404 to user: Instance 4e5bdcf3-8333-4d88-8cc3-93d9327711b6 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:44:32.002973 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a8feca65-a524-4e9f-a047-422e6d0f796b tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "POST /compute/v2.1/servers/4e5bdcf3-8333-4d88-8cc3-93d9327711b6/action" status: 404 len: 111 microversion: 2.1 time: 0.051434 Oct 18 15:44:32.002973 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2186/4358] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:44:31 2022] POST /compute/v2.1/servers/4e5bdcf3-8333-4d88-8cc3-93d9327711b6/action => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:44:32.005921 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-113bb42a-bf73-4aeb-9c89-63512386876f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:32.006549 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-113bb42a-bf73-4aeb-9c89-63512386876f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 25eb309d-2add-4b63-96b9-f78966b9f3b6] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:32.136420 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-113bb42a-bf73-4aeb-9c89-63512386876f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:32.160607 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-113bb42a-bf73-4aeb-9c89-63512386876f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/25eb309d-2add-4b63-96b9-f78966b9f3b6" status: 200 len: 1215 microversion: 2.1 time: 0.159668 Oct 18 15:44:32.177808 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2187/4359] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:31 2022] GET /compute/v2.1/servers/25eb309d-2add-4b63-96b9-f78966b9f3b6 => generated 1215 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:32.186105 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c4c85030-7f12-4dcd-962a-598f58485eb5 tempest-SecurityGroupRulesTestJSON-1152099622 tempest-SecurityGroupRulesTestJSON-1152099622-project] Calling method '.version_select at 0x7f7c3c4d84c0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:32.428239 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2a7ad9d6-44ae-4e48-98fb-2659debc804a tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:32.436354 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2a7ad9d6-44ae-4e48-98fb-2659debc804a tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2" status: 200 len: 1522 microversion: 2.1 time: 0.814178 Oct 18 15:44:32.436954 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2173/4360] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:31 2022] GET /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2 => generated 1522 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:32.454152 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-633990df-1814-4989-b87f-28de90818f68 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:32.460030 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-633990df-1814-4989-b87f-28de90818f68 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:32.478151 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-633990df-1814-4989-b87f-28de90818f68 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:32.478658 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-633990df-1814-4989-b87f-28de90818f68 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:32.479089 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-633990df-1814-4989-b87f-28de90818f68 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:32.483525 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-633990df-1814-4989-b87f-28de90818f68 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:32.484201 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-633990df-1814-4989-b87f-28de90818f68 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:32.484840 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-633990df-1814-4989-b87f-28de90818f68 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:33.124773 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-633990df-1814-4989-b87f-28de90818f68 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:33.142095 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-633990df-1814-4989-b87f-28de90818f68 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.691180 Oct 18 15:44:33.143114 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2174/4361] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:32 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:33.170188 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-591a270c-e317-4746-b0a4-fe0e2a2c7fd5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:33.170815 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-591a270c-e317-4746-b0a4-fe0e2a2c7fd5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:33.196414 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-591a270c-e317-4746-b0a4-fe0e2a2c7fd5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:33.203200 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-591a270c-e317-4746-b0a4-fe0e2a2c7fd5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:33.204002 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-591a270c-e317-4746-b0a4-fe0e2a2c7fd5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:33.205127 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-591a270c-e317-4746-b0a4-fe0e2a2c7fd5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:33.205613 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-591a270c-e317-4746-b0a4-fe0e2a2c7fd5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:33.206046 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-591a270c-e317-4746-b0a4-fe0e2a2c7fd5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:33.786317 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c4c85030-7f12-4dcd-962a-598f58485eb5 tempest-SecurityGroupRulesTestJSON-1152099622 tempest-SecurityGroupRulesTestJSON-1152099622-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/8bcde268-e838-479b-b5e8-7bab99c02f9f" status: 202 len: 0 microversion: 2.1 time: 1.606990 Oct 18 15:44:33.787138 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2188/4362] 10.222.0.60 () {58 vars in 1272 bytes} [Tue Oct 18 15:44:32 2022] DELETE /compute/v2.1/os-security-groups/8bcde268-e838-479b-b5e8-7bab99c02f9f => generated 0 bytes in 1608 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:44:33.791987 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-04a50654-a9ad-4b20-9b0f-5a0bb0028ae3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:33.792605 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-04a50654-a9ad-4b20-9b0f-5a0bb0028ae3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 25eb309d-2add-4b63-96b9-f78966b9f3b6] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:33.800124 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-04a50654-a9ad-4b20-9b0f-5a0bb0028ae3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:33.800610 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-04a50654-a9ad-4b20-9b0f-5a0bb0028ae3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:33.803864 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-04a50654-a9ad-4b20-9b0f-5a0bb0028ae3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:33.805207 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-04a50654-a9ad-4b20-9b0f-5a0bb0028ae3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:33.805899 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-04a50654-a9ad-4b20-9b0f-5a0bb0028ae3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:33.806542 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-04a50654-a9ad-4b20-9b0f-5a0bb0028ae3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:33.827274 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-591a270c-e317-4746-b0a4-fe0e2a2c7fd5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:33.862223 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-591a270c-e317-4746-b0a4-fe0e2a2c7fd5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.697461 Oct 18 15:44:33.862965 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2175/4363] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:33 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:44:33.868772 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f45d4f5a-3142-4a69-ade6-24dd0f54c042 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:33.870140 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f45d4f5a-3142-4a69-ade6-24dd0f54c042 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 19226472-0c76-46f8-a4ba-7d32931341a2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:33.885393 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f45d4f5a-3142-4a69-ade6-24dd0f54c042 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:33.886263 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f45d4f5a-3142-4a69-ade6-24dd0f54c042 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:33.886924 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f45d4f5a-3142-4a69-ade6-24dd0f54c042 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:33.887968 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f45d4f5a-3142-4a69-ade6-24dd0f54c042 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:33.888851 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f45d4f5a-3142-4a69-ade6-24dd0f54c042 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:33.889497 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f45d4f5a-3142-4a69-ade6-24dd0f54c042 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:33.960173 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-04a50654-a9ad-4b20-9b0f-5a0bb0028ae3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:33.974387 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-04a50654-a9ad-4b20-9b0f-5a0bb0028ae3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/25eb309d-2add-4b63-96b9-f78966b9f3b6" status: 200 len: 1267 microversion: 2.1 time: 0.185565 Oct 18 15:44:33.989877 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2189/4364] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:33 2022] GET /compute/v2.1/servers/25eb309d-2add-4b63-96b9-f78966b9f3b6 => generated 1267 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:34.030872 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7e4661af-5e88-416c-9dcd-67a7c41a2f6a tempest-SecurityGroupRulesTestJSON-1152099622 tempest-SecurityGroupRulesTestJSON-1152099622-project] Calling method '.version_select at 0x7f7c3c7fa820>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:34.175646 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7e4661af-5e88-416c-9dcd-67a7c41a2f6a tempest-SecurityGroupRulesTestJSON-1152099622 tempest-SecurityGroupRulesTestJSON-1152099622-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups/114f81cd-bfb0-4efa-baec-a1fe270e4e6d" status: 200 len: 248 microversion: 2.1 time: 0.179438 Oct 18 15:44:34.176245 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2190/4365] 10.222.0.60 () {58 vars in 1269 bytes} [Tue Oct 18 15:44:33 2022] GET /compute/v2.1/os-security-groups/114f81cd-bfb0-4efa-baec-a1fe270e4e6d => generated 248 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:44:34.186432 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8e513c60-e52d-4555-bfc2-2fdf261a838a tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:44:34.186432 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8e513c60-e52d-4555-bfc2-2fdf261a838a tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:34.197972 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8e513c60-e52d-4555-bfc2-2fdf261a838a tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:34.198483 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8e513c60-e52d-4555-bfc2-2fdf261a838a tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:34.198965 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8e513c60-e52d-4555-bfc2-2fdf261a838a tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:34.199850 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8e513c60-e52d-4555-bfc2-2fdf261a838a tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:34.200754 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8e513c60-e52d-4555-bfc2-2fdf261a838a tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:34.201353 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8e513c60-e52d-4555-bfc2-2fdf261a838a tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:34.254605 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-8e513c60-e52d-4555-bfc2-2fdf261a838a tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] HTTP exception thrown: Cannot 'resume' instance 2cc69e2e-cb26-42d6-b887-31e0afaa69fc while it is in vm_state active Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8e513c60-e52d-4555-bfc2-2fdf261a838a tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Request method failure captured: Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: request: POST /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc/action HTTP/1.1 Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 14 Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTslxbnvpe5yiGf5CWZMgShC81OiGKrcSLYZFSWKOLbaqqF5kNJvh8cijdldsPo1OHjHXDcbdPuhTuFRNRswVq0HwpXLNCfOWcF3GU1M8LHkZwXu6ScaOEIHyQ8ewFnAFL7TXd1O14t3atsv_uM6Xc9ZHSfefERCjuehdw5SJuAn7MMs Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 96c4378d52d1489bb2d50e84cabf95eb Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: {"resume": {}} Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: exception: Cannot 'resume' instance 2cc69e2e-cb26-42d6-b887-31e0afaa69fc while it is in vm_state active Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '2cc69e2e-cb26-42d6-b887-31e0afaa69fc', 'body': {'resume': {}}} Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2cc69e2e-cb26-42d6-b887-31e0afaa69fc in vm_state active. Cannot resume while the instance is in this state. Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 2cc69e2e-cb26-42d6-b887-31e0afaa69fc while it is in vm_state active Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:44:34.256476 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:34.261714 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:34.261714 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:44:34.261714 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:44:34.261714 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:44:34.261714 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:44:34.261714 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 2cc69e2e-cb26-42d6-b887-31e0afaa69fc while it is in vm_state active Oct 18 15:44:34.261714 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:34.261714 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8e513c60-e52d-4555-bfc2-2fdf261a838a tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Returning 409 to user: Cannot 'resume' instance 2cc69e2e-cb26-42d6-b887-31e0afaa69fc while it is in vm_state active {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:44:34.261714 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8e513c60-e52d-4555-bfc2-2fdf261a838a tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "POST /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc/action" status: 409 len: 144 microversion: 2.1 time: 0.080815 Oct 18 15:44:34.261714 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2191/4366] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:44:34 2022] POST /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc/action => generated 144 bytes in 82 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 15:44:34.265406 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bb5fb0ab-a120-48e4-867c-ec3f0cd14b0e tempest-SecurityGroupRulesTestJSON-1152099622 tempest-SecurityGroupRulesTestJSON-1152099622-project] Action: 'create', calling method: .version_select at 0x7f7c3c8d79d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-133469886", "description": "tempest-description-659388467"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:44:34.272965 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f45d4f5a-3142-4a69-ade6-24dd0f54c042 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:34.282791 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f45d4f5a-3142-4a69-ade6-24dd0f54c042 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2" status: 200 len: 1522 microversion: 2.1 time: 0.418160 Oct 18 15:44:34.283845 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2176/4367] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:33 2022] GET /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2 => generated 1522 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:34.289529 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-65c2959b-9298-4d22-afcf-edfa24a86095 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:34.290352 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-65c2959b-9298-4d22-afcf-edfa24a86095 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:34.298378 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65c2959b-9298-4d22-afcf-edfa24a86095 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:34.299106 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65c2959b-9298-4d22-afcf-edfa24a86095 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:34.300432 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65c2959b-9298-4d22-afcf-edfa24a86095 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:34.301362 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65c2959b-9298-4d22-afcf-edfa24a86095 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:34.301985 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65c2959b-9298-4d22-afcf-edfa24a86095 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:34.302576 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65c2959b-9298-4d22-afcf-edfa24a86095 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:34.329239 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:44:34.663782 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-65c2959b-9298-4d22-afcf-edfa24a86095 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:34.673810 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-65c2959b-9298-4d22-afcf-edfa24a86095 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.386954 Oct 18 15:44:34.677540 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2177/4368] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:34 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:34.705210 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-89062d84-4cab-447e-a562-5bace7458c46 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:34.709059 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-89062d84-4cab-447e-a562-5bace7458c46 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:34.720753 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89062d84-4cab-447e-a562-5bace7458c46 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:34.724112 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89062d84-4cab-447e-a562-5bace7458c46 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:34.724829 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89062d84-4cab-447e-a562-5bace7458c46 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:34.726013 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89062d84-4cab-447e-a562-5bace7458c46 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:34.731692 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89062d84-4cab-447e-a562-5bace7458c46 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:34.732577 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89062d84-4cab-447e-a562-5bace7458c46 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:34.818952 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-bb5fb0ab-a120-48e4-867c-ec3f0cd14b0e tempest-SecurityGroupRulesTestJSON-1152099622 tempest-SecurityGroupRulesTestJSON-1152099622-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.558896 Oct 18 15:44:34.820614 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2192/4369] 10.222.0.60 () {60 vars in 1180 bytes} [Tue Oct 18 15:44:34 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:44:34.836508 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-96351885-9ce8-40f3-b53f-d58b355a78e2 tempest-SecurityGroupRulesTestJSON-1152099622 tempest-SecurityGroupRulesTestJSON-1152099622-project] Action: 'create', calling method: .version_select at 0x7f7c3d37a670>, body: {"security_group_rule": {"parent_group_id": "8bf0e727-be74-4752-bab5-850de277773f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:44:35.373434 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-89062d84-4cab-447e-a562-5bace7458c46 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:35.385488 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-89062d84-4cab-447e-a562-5bace7458c46 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.689161 Oct 18 15:44:35.405738 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2178/4370] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:34 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:35.428135 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-97e426ad-28cf-4da9-81cb-2d4dde16411d tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:35.435633 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-97e426ad-28cf-4da9-81cb-2d4dde16411d tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 55179126-a629-4bb3-82f5-14606ec63426] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:35.450730 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-97e426ad-28cf-4da9-81cb-2d4dde16411d tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:35.451383 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-97e426ad-28cf-4da9-81cb-2d4dde16411d tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:35.452248 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-97e426ad-28cf-4da9-81cb-2d4dde16411d tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:35.453290 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-97e426ad-28cf-4da9-81cb-2d4dde16411d tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:35.453894 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-97e426ad-28cf-4da9-81cb-2d4dde16411d tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:35.454645 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-97e426ad-28cf-4da9-81cb-2d4dde16411d tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:35.522105 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-97e426ad-28cf-4da9-81cb-2d4dde16411d tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.114763 Oct 18 15:44:35.529379 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2179/4371] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 15:44:35 2022] GET /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426/os-volume_attachments => generated 25 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:44:35.534799 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ebf146b1-8096-44e6-a722-697d71871340 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:35.535591 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ebf146b1-8096-44e6-a722-697d71871340 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 25eb309d-2add-4b63-96b9-f78966b9f3b6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:35.547801 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ebf146b1-8096-44e6-a722-697d71871340 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:35.548304 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ebf146b1-8096-44e6-a722-697d71871340 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:35.548745 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ebf146b1-8096-44e6-a722-697d71871340 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:35.549479 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ebf146b1-8096-44e6-a722-697d71871340 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:35.549936 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ebf146b1-8096-44e6-a722-697d71871340 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:35.550357 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ebf146b1-8096-44e6-a722-697d71871340 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:35.710609 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-96351885-9ce8-40f3-b53f-d58b355a78e2 tempest-SecurityGroupRulesTestJSON-1152099622 tempest-SecurityGroupRulesTestJSON-1152099622-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.880051 Oct 18 15:44:35.712382 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2193/4372] 10.222.0.60 () {60 vars in 1195 bytes} [Tue Oct 18 15:44:34 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:44:35.719557 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e4259546-d62a-4cf1-adac-2a4ede73f8b8 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:35.720439 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e4259546-d62a-4cf1-adac-2a4ede73f8b8 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 19226472-0c76-46f8-a4ba-7d32931341a2] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:35.734673 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4259546-d62a-4cf1-adac-2a4ede73f8b8 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:35.735473 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4259546-d62a-4cf1-adac-2a4ede73f8b8 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:35.738769 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4259546-d62a-4cf1-adac-2a4ede73f8b8 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:35.739977 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4259546-d62a-4cf1-adac-2a4ede73f8b8 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:35.740613 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4259546-d62a-4cf1-adac-2a4ede73f8b8 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:35.741250 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4259546-d62a-4cf1-adac-2a4ede73f8b8 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:35.816108 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:44:36.164015 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ebf146b1-8096-44e6-a722-697d71871340 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:36.175955 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ebf146b1-8096-44e6-a722-697d71871340 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/25eb309d-2add-4b63-96b9-f78966b9f3b6" status: 200 len: 1315 microversion: 2.1 time: 0.642256 Oct 18 15:44:36.176995 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2180/4373] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:35 2022] GET /compute/v2.1/servers/25eb309d-2add-4b63-96b9-f78966b9f3b6 => generated 1315 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:36.185004 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-84624b69-9285-4e94-9fd7-fbe554312b49 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "b55b6f02-72e3-4b31-a708-98b6291bed4c"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-84624b69-9285-4e94-9fd7-fbe554312b49 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Request method failure captured: Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 160 Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTslxbnvpe5yiGf5CWZMgShC81OiGKrcSLYZFSWKOLbaqqF5kNJvh8cijdldsPo1OHjHXDcbdPuhTuFRNRswVq0HwpXLNCfOWcF3GU1M8LHkZwXu6ScaOEIHyQ8ewFnAFL7TXd1O14t3atsv_uM6Xc9ZHSfefERCjuehdw5SJuAn7MMs Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 96c4378d52d1489bb2d50e84cabf95eb Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: {"server": {"name": "", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "b55b6f02-72e3-4b31-a708-98b6291bed4c"}]}} Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'body': {'server': {'name': '', 'imageRef': '8f4db252-bff6-4685-9c8d-4c5d6bd9f78b', 'flavorRef': '452', 'networks': [{'uuid': 'b55b6f02-72e3-4b31-a708-98b6291bed4c'}]}}} Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise error Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi '' Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 15:44:36.205175 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 15:44:36.210912 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 15:44:36.210912 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 18 15:44:36.210912 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:36.210912 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:44:36.210912 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:36.210912 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:36.210912 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:44:36.210912 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:44:36.210912 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 15:44:36.210912 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 15:44:36.210912 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 18 15:44:36.210912 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:36.216023 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-84624b69-9285-4e94-9fd7-fbe554312b49 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:44:36.217943 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-84624b69-9285-4e94-9fd7-fbe554312b49 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.039604 Oct 18 15:44:36.222599 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2181/4374] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:44:36 2022] POST /compute/v2.1/servers => generated 108 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:44:36.237531 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a49fe67d-dd0a-4756-a370-f803b0bcf179 tempest-SecurityGroupRulesTestJSON-1152099622 tempest-SecurityGroupRulesTestJSON-1152099622-project] Action: 'create', calling method: .version_select at 0x7f7c3ce1e550>, body: {"security_group_rule": {"parent_group_id": "8bf0e727-be74-4752-bab5-850de277773f", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:44:36.401103 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e4259546-d62a-4cf1-adac-2a4ede73f8b8 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:36.409722 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e4259546-d62a-4cf1-adac-2a4ede73f8b8 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2" status: 200 len: 1522 microversion: 2.1 time: 0.695660 Oct 18 15:44:36.418198 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2194/4375] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:35 2022] GET /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2 => generated 1522 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:36.427283 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-be0ce455-3b13-43ce-b37f-dd5792cce433 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:36.438087 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-be0ce455-3b13-43ce-b37f-dd5792cce433 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 55179126-a629-4bb3-82f5-14606ec63426] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:36.462153 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-be0ce455-3b13-43ce-b37f-dd5792cce433 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:36.462650 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-be0ce455-3b13-43ce-b37f-dd5792cce433 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:36.464399 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-be0ce455-3b13-43ce-b37f-dd5792cce433 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:36.465537 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-be0ce455-3b13-43ce-b37f-dd5792cce433 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:36.467945 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-be0ce455-3b13-43ce-b37f-dd5792cce433 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:36.469140 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-be0ce455-3b13-43ce-b37f-dd5792cce433 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:36.552154 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-be0ce455-3b13-43ce-b37f-dd5792cce433 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.132630 Oct 18 15:44:36.559342 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2195/4376] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 15:44:36 2022] GET /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426/os-volume_attachments => generated 25 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:44:36.567385 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b3710d5b-cc99-4b94-9caf-40d55ef5c372 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:36.572337 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b3710d5b-cc99-4b94-9caf-40d55ef5c372 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:36.587711 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b3710d5b-cc99-4b94-9caf-40d55ef5c372 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:36.595239 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b3710d5b-cc99-4b94-9caf-40d55ef5c372 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:36.596287 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b3710d5b-cc99-4b94-9caf-40d55ef5c372 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:36.597244 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b3710d5b-cc99-4b94-9caf-40d55ef5c372 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:36.597861 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b3710d5b-cc99-4b94-9caf-40d55ef5c372 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:36.598462 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b3710d5b-cc99-4b94-9caf-40d55ef5c372 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:36.719249 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a49fe67d-dd0a-4756-a370-f803b0bcf179 tempest-SecurityGroupRulesTestJSON-1152099622 tempest-SecurityGroupRulesTestJSON-1152099622-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.493978 Oct 18 15:44:36.730173 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2182/4377] 10.222.0.60 () {60 vars in 1195 bytes} [Tue Oct 18 15:44:36 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:44:36.744655 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d5dd6ff3-eaf7-416b-99ab-5fd64bfaf39a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:36.751633 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d5dd6ff3-eaf7-416b-99ab-5fd64bfaf39a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 55179126-a629-4bb3-82f5-14606ec63426] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:36.766278 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5dd6ff3-eaf7-416b-99ab-5fd64bfaf39a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:36.768713 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5dd6ff3-eaf7-416b-99ab-5fd64bfaf39a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:36.769720 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5dd6ff3-eaf7-416b-99ab-5fd64bfaf39a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:36.771831 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5dd6ff3-eaf7-416b-99ab-5fd64bfaf39a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:36.773546 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5dd6ff3-eaf7-416b-99ab-5fd64bfaf39a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:36.774252 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5dd6ff3-eaf7-416b-99ab-5fd64bfaf39a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:36.838465 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d5dd6ff3-eaf7-416b-99ab-5fd64bfaf39a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 55179126-a629-4bb3-82f5-14606ec63426] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:44:37.025630 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d5dd6ff3-eaf7-416b-99ab-5fd64bfaf39a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "DELETE /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426" status: 204 len: 0 microversion: 2.1 time: 0.290102 Oct 18 15:44:37.026918 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2183/4378] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:44:36 2022] DELETE /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:44:37.037536 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a5b33184-d45b-4a28-8084-add43b053f9f tempest-SecurityGroupRulesTestJSON-1152099622 tempest-SecurityGroupRulesTestJSON-1152099622-project] Calling method '.version_select at 0x7f7c3d0214c0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:37.043487 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b3710d5b-cc99-4b94-9caf-40d55ef5c372 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:37.056830 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b3710d5b-cc99-4b94-9caf-40d55ef5c372 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.495305 Oct 18 15:44:37.059502 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2196/4379] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:36 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:37.082714 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4f7c8c2d-cf8c-4562-a631-9cfa6de1b047 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:37.083439 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4f7c8c2d-cf8c-4562-a631-9cfa6de1b047 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 55179126-a629-4bb3-82f5-14606ec63426] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:37.090254 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4f7c8c2d-cf8c-4562-a631-9cfa6de1b047 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:37.090746 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4f7c8c2d-cf8c-4562-a631-9cfa6de1b047 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:37.091715 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4f7c8c2d-cf8c-4562-a631-9cfa6de1b047 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:37.092678 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4f7c8c2d-cf8c-4562-a631-9cfa6de1b047 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:37.093466 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4f7c8c2d-cf8c-4562-a631-9cfa6de1b047 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:37.094048 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4f7c8c2d-cf8c-4562-a631-9cfa6de1b047 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:37.148049 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a5b33184-d45b-4a28-8084-add43b053f9f tempest-SecurityGroupRulesTestJSON-1152099622 tempest-SecurityGroupRulesTestJSON-1152099622-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups/8bf0e727-be74-4752-bab5-850de277773f" status: 200 len: 663 microversion: 2.1 time: 0.119272 Oct 18 15:44:37.149137 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2184/4380] 10.222.0.60 () {58 vars in 1269 bytes} [Tue Oct 18 15:44:37 2022] GET /compute/v2.1/os-security-groups/8bf0e727-be74-4752-bab5-850de277773f => generated 663 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:44:37.157169 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b1a36a0d-77ac-47cb-8cfb-34543cbb593e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:37.157925 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b1a36a0d-77ac-47cb-8cfb-34543cbb593e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:37.169188 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1a36a0d-77ac-47cb-8cfb-34543cbb593e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:37.169972 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1a36a0d-77ac-47cb-8cfb-34543cbb593e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:37.170639 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1a36a0d-77ac-47cb-8cfb-34543cbb593e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:37.171873 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1a36a0d-77ac-47cb-8cfb-34543cbb593e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:37.172884 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1a36a0d-77ac-47cb-8cfb-34543cbb593e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:37.173662 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1a36a0d-77ac-47cb-8cfb-34543cbb593e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:37.478853 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b1a36a0d-77ac-47cb-8cfb-34543cbb593e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:37.493523 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b1a36a0d-77ac-47cb-8cfb-34543cbb593e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.343513 Oct 18 15:44:37.509034 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2185/4381] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:37 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:37.525990 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4f7c8c2d-cf8c-4562-a631-9cfa6de1b047 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304b3248f9db4629943a8b8080a6d22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdc7504a1d1424ea34f83f1a6d4bf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:37.533685 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b58c9bd8-c04d-4079-a01a-324d43b846a6 tempest-SecurityGroupRulesTestJSON-1152099622 tempest-SecurityGroupRulesTestJSON-1152099622-project] Calling method '.version_select at 0x7f7c3d8819d0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:37.534561 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4f7c8c2d-cf8c-4562-a631-9cfa6de1b047 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426" status: 200 len: 1669 microversion: 2.1 time: 0.471368 Oct 18 15:44:37.536431 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2197/4382] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:37 2022] GET /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426 => generated 1669 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:37.542769 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2d1aefc6-5b6e-49be-b9dd-312688a006e6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:37.543391 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2d1aefc6-5b6e-49be-b9dd-312688a006e6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 25eb309d-2add-4b63-96b9-f78966b9f3b6] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:37.550774 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d1aefc6-5b6e-49be-b9dd-312688a006e6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:37.551271 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d1aefc6-5b6e-49be-b9dd-312688a006e6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:37.551715 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d1aefc6-5b6e-49be-b9dd-312688a006e6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:37.552427 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d1aefc6-5b6e-49be-b9dd-312688a006e6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:37.555844 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d1aefc6-5b6e-49be-b9dd-312688a006e6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:37.555844 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d1aefc6-5b6e-49be-b9dd-312688a006e6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:37.851744 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2d1aefc6-5b6e-49be-b9dd-312688a006e6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:37.866676 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2d1aefc6-5b6e-49be-b9dd-312688a006e6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/25eb309d-2add-4b63-96b9-f78966b9f3b6" status: 200 len: 1315 microversion: 2.1 time: 0.327450 Oct 18 15:44:37.870588 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2198/4383] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:37 2022] GET /compute/v2.1/servers/25eb309d-2add-4b63-96b9-f78966b9f3b6 => generated 1315 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:37.896017 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4aeae781-2c1f-422c-bdcb-d616550e8328 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:37.898581 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4aeae781-2c1f-422c-bdcb-d616550e8328 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 19226472-0c76-46f8-a4ba-7d32931341a2] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:37.901106 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b58c9bd8-c04d-4079-a01a-324d43b846a6 tempest-SecurityGroupRulesTestJSON-1152099622 tempest-SecurityGroupRulesTestJSON-1152099622-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-group-rules/5cc4f2ba-75bc-4424-90cb-0e24bde24048" status: 202 len: 0 microversion: 2.1 time: 0.390627 Oct 18 15:44:37.906663 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2186/4384] 10.222.0.60 () {58 vars in 1287 bytes} [Tue Oct 18 15:44:37 2022] DELETE /compute/v2.1/os-security-group-rules/5cc4f2ba-75bc-4424-90cb-0e24bde24048 => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:44:37.910642 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-2e400d4b-72e2-48f0-a9ba-31b9ba4d5a1c req-9c3d5169-1cd2-4625-ad68-c990b35bd2c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25eb309d-2add-4b63-96b9-f78966b9f3b6", "tag": "c5682ba2-35a4-41c4-b0c6-b5675c138586"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:44:37.911760 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4aeae781-2c1f-422c-bdcb-d616550e8328 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:37.913608 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4aeae781-2c1f-422c-bdcb-d616550e8328 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:37.914294 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4aeae781-2c1f-422c-bdcb-d616550e8328 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:37.915910 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4aeae781-2c1f-422c-bdcb-d616550e8328 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:37.916800 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4aeae781-2c1f-422c-bdcb-d616550e8328 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:37.917792 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4aeae781-2c1f-422c-bdcb-d616550e8328 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:37.951532 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2e400d4b-72e2-48f0-a9ba-31b9ba4d5a1c req-9c3d5169-1cd2-4625-ad68-c990b35bd2c2 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:37.952882 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2e400d4b-72e2-48f0-a9ba-31b9ba4d5a1c req-9c3d5169-1cd2-4625-ad68-c990b35bd2c2 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:37.954239 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2e400d4b-72e2-48f0-a9ba-31b9ba4d5a1c req-9c3d5169-1cd2-4625-ad68-c990b35bd2c2 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:37.991658 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-2e400d4b-72e2-48f0-a9ba-31b9ba4d5a1c req-9c3d5169-1cd2-4625-ad68-c990b35bd2c2 service nova] Creating event network-changed:c5682ba2-35a4-41c4-b0c6-b5675c138586 for instance 25eb309d-2add-4b63-96b9-f78966b9f3b6 on n-h1-853682-5 Oct 18 15:44:37.996798 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-2e400d4b-72e2-48f0-a9ba-31b9ba4d5a1c req-9c3d5169-1cd2-4625-ad68-c990b35bd2c2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092650 Oct 18 15:44:37.998042 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2187/4385] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:44:38.003484 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-21e246df-452d-4cd4-9daf-6bef893e0bc3 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:44:38.009356 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-21e246df-452d-4cd4-9daf-6bef893e0bc3 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 8b1dba1f-2fea-444a-ba59-f25612fc999b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:38.024292 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-21e246df-452d-4cd4-9daf-6bef893e0bc3 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] HTTP exception thrown: Instance 8b1dba1f-2fea-444a-ba59-f25612fc999b could not be found. Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-21e246df-452d-4cd4-9daf-6bef893e0bc3 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Request method failure captured: Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers/8b1dba1f-2fea-444a-ba59-f25612fc999b/action HTTP/1.1 Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 14 Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTslxbnvpe5yiGf5CWZMgShC81OiGKrcSLYZFSWKOLbaqqF5kNJvh8cijdldsPo1OHjHXDcbdPuhTuFRNRswVq0HwpXLNCfOWcF3GU1M8LHkZwXu6ScaOEIHyQ8ewFnAFL7TXd1O14t3atsv_uM6Xc9ZHSfefERCjuehdw5SJuAn7MMs Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 96c4378d52d1489bb2d50e84cabf95eb Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: {"shelve": {}} Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 8b1dba1f-2fea-444a-ba59-f25612fc999b could not be found. Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '8b1dba1f-2fea-444a-ba59-f25612fc999b', 'body': {'shelve': {}}} Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b1dba1f-2fea-444a-ba59-f25612fc999b could not be found. Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b1dba1f-2fea-444a-ba59-f25612fc999b could not be found. Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:44:38.030899 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:44:38.036167 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:44:38.036167 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:44:38.036167 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b1dba1f-2fea-444a-ba59-f25612fc999b could not be found. Oct 18 15:44:38.036167 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:38.037566 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-21e246df-452d-4cd4-9daf-6bef893e0bc3 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Returning 404 to user: Instance 8b1dba1f-2fea-444a-ba59-f25612fc999b could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:44:38.038770 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-21e246df-452d-4cd4-9daf-6bef893e0bc3 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "POST /compute/v2.1/servers/8b1dba1f-2fea-444a-ba59-f25612fc999b/action" status: 404 len: 111 microversion: 2.1 time: 0.039382 Oct 18 15:44:38.039341 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2188/4386] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:44:37 2022] POST /compute/v2.1/servers/8b1dba1f-2fea-444a-ba59-f25612fc999b/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:44:38.046010 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9d5b665f-7d69-43d5-a1f1-c455bffd8315 tempest-SecurityGroupRulesTestJSON-1152099622 tempest-SecurityGroupRulesTestJSON-1152099622-project] Calling method '.version_select at 0x7f7c3d6799d0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:38.311576 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4aeae781-2c1f-422c-bdcb-d616550e8328 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:38.326910 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4aeae781-2c1f-422c-bdcb-d616550e8328 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2" status: 200 len: 1522 microversion: 2.1 time: 0.449232 Oct 18 15:44:38.328943 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2199/4387] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:37 2022] GET /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2 => generated 1522 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:38.341215 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2decc1fd-e5d9-4f3d-8674-d86d70c9391d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:38.345355 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2decc1fd-e5d9-4f3d-8674-d86d70c9391d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:38.359329 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2decc1fd-e5d9-4f3d-8674-d86d70c9391d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:38.362271 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2decc1fd-e5d9-4f3d-8674-d86d70c9391d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:38.362905 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2decc1fd-e5d9-4f3d-8674-d86d70c9391d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:38.365978 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2decc1fd-e5d9-4f3d-8674-d86d70c9391d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:38.366653 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2decc1fd-e5d9-4f3d-8674-d86d70c9391d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:38.369299 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2decc1fd-e5d9-4f3d-8674-d86d70c9391d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:38.433712 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9d5b665f-7d69-43d5-a1f1-c455bffd8315 tempest-SecurityGroupRulesTestJSON-1152099622 tempest-SecurityGroupRulesTestJSON-1152099622-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/8bf0e727-be74-4752-bab5-850de277773f" status: 202 len: 0 microversion: 2.1 time: 0.392777 Oct 18 15:44:38.438271 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2189/4388] 10.222.0.60 () {58 vars in 1272 bytes} [Tue Oct 18 15:44:38 2022] DELETE /compute/v2.1/os-security-groups/8bf0e727-be74-4752-bab5-850de277773f => generated 0 bytes in 398 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:44:38.443956 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-48d9e9e8-1527-414c-8a07-736f2723c321 tempest-SecurityGroupRulesTestJSON-1152099622 tempest-SecurityGroupRulesTestJSON-1152099622-project] Calling method '.version_select at 0x7f7c3ce1e430>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:38.663249 n-d-853682-5 devstack@n-api.service[120406]: DEBUG neutronclient.v2_0.client [None req-48d9e9e8-1527-414c-8a07-736f2723c321 tempest-SecurityGroupRulesTestJSON-1152099622 tempest-SecurityGroupRulesTestJSON-1152099622-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8bcde268-e838-479b-b5e8-7bab99c02f9f does not exist", "detail": ""}} {{(pid=120406) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 15:44:38.664086 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.security_group_api [None req-48d9e9e8-1527-414c-8a07-736f2723c321 tempest-SecurityGroupRulesTestJSON-1152099622 tempest-SecurityGroupRulesTestJSON-1152099622-project] Neutron security group 8bcde268-e838-479b-b5e8-7bab99c02f9f not found {{(pid=120406) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 18 15:44:38.664875 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-48d9e9e8-1527-414c-8a07-736f2723c321 tempest-SecurityGroupRulesTestJSON-1152099622 tempest-SecurityGroupRulesTestJSON-1152099622-project] HTTP exception thrown: Security group 8bcde268-e838-479b-b5e8-7bab99c02f9f does not exist Oct 18 15:44:38.664875 n-d-853682-5 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-27a92878-7b6a-460a-b881-12d5474dc686'] Oct 18 15:44:38.667264 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-48d9e9e8-1527-414c-8a07-736f2723c321 tempest-SecurityGroupRulesTestJSON-1152099622 tempest-SecurityGroupRulesTestJSON-1152099622-project] Request method failure captured: Oct 18 15:44:38.667264 n-d-853682-5 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/os-security-groups/8bcde268-e838-479b-b5e8-7bab99c02f9f HTTP/1.1 Oct 18 15:44:38.667264 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:44:38.667264 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:44:38.667264 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:44:38.667264 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:44:38.667264 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:44:38.667264 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:44:38.667264 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:44:38.667264 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:44:38.667264 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsnRS-DiVzEAJYJMzvEmvTwwy12EnuWFCgvFQXs2qqm6nOi6PkMZsf9EqnMgfDRBjPx2hN1UCrCpIVYbxc57YS9fPmHoAYSjf3fn7NSGED75dQzlroq68RT7NBELTptB-YJHDkUqyaetepiQOeZdI1pFttKm-JBXPsQ14zaN-WJxXyg Oct 18 15:44:38.667264 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:44:38.667264 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:44:38.667264 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:44:38.667264 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:44:38.667264 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:44:38.667264 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:44:38.667264 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 0bf8ed85e77c4ad1bc1579bd26d6e582 Oct 18 15:44:38.667264 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1152099622 Oct 18 15:44:38.667264 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:44:38.667264 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:44:38.667264 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0bf8ed85e77c4ad1bc1579bd26d6e582"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0bf8ed85e77c4ad1bc1579bd26d6e582"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0bf8ed85e77c4ad1bc1579bd26d6e582"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0bf8ed85e77c4ad1bc1579bd26d6e582"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:44:38.667264 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1152099622 Oct 18 15:44:38.667264 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 0bf8ed85e77c4ad1bc1579bd26d6e582 Oct 18 15:44:38.667264 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1152099622 Oct 18 15:44:38.667264 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-SecurityGroupRulesTestJSON-1152099622-project Oct 18 15:44:38.667264 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:44:38.667264 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:44:38.667264 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: d80f0869b339448fbf66ab8eededee17 Oct 18 15:44:38.667264 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1152099622-project Oct 18 15:44:38.667264 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:44:38.667264 n-d-853682-5 devstack@n-api.service[120406]: exception: Security group 8bcde268-e838-479b-b5e8-7bab99c02f9f does not exist Oct 18 15:44:38.667264 n-d-853682-5 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-27a92878-7b6a-460a-b881-12d5474dc686'] Oct 18 15:44:38.667264 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '8bcde268-e838-479b-b5e8-7bab99c02f9f'} Oct 18 15:44:38.667264 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:44:38.667264 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:38.667264 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 18 15:44:38.667264 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 18 15:44:38.667264 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:44:38.667264 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:44:38.667264 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 18 15:44:38.667264 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 18 15:44:38.667264 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:44:38.667264 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:44:38.667264 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 15:44:38.667264 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 15:44:38.667264 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:44:38.667264 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:44:38.667264 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 15:44:38.667264 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 15:44:38.667264 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:44:38.667264 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:44:38.667264 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 15:44:38.667264 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 15:44:38.667264 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 15:44:38.667264 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 15:44:38.667264 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 15:44:38.667264 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 15:44:38.667264 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 15:44:38.667264 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 15:44:38.667264 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8bcde268-e838-479b-b5e8-7bab99c02f9f does not exist Oct 18 15:44:38.671730 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-27a92878-7b6a-460a-b881-12d5474dc686'] Oct 18 15:44:38.671730 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:38.671730 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:44:38.671730 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:38.671730 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:38.671730 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 18 15:44:38.671730 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 18 15:44:38.671730 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 18 15:44:38.671730 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 15:44:38.671730 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8bcde268-e838-479b-b5e8-7bab99c02f9f does not exist Oct 18 15:44:38.671730 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-27a92878-7b6a-460a-b881-12d5474dc686'] Oct 18 15:44:38.671730 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:38.671730 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:44:38.671730 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:38.671730 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:38.671730 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:44:38.671730 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:44:38.671730 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:44:38.671730 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:44:38.671730 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:44:38.671730 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:44:38.671730 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:44:38.671730 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:44:38.671730 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 18 15:44:38.671730 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 15:44:38.671730 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8bcde268-e838-479b-b5e8-7bab99c02f9f does not exist Oct 18 15:44:38.671730 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-27a92878-7b6a-460a-b881-12d5474dc686'] Oct 18 15:44:38.671730 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:38.671730 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:44:38.671730 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:38.671730 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:38.671730 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:44:38.671730 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:44:38.671730 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:44:38.671730 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:44:38.671730 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8bcde268-e838-479b-b5e8-7bab99c02f9f does not exist Oct 18 15:44:38.671730 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-27a92878-7b6a-460a-b881-12d5474dc686'] Oct 18 15:44:38.671730 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:44:38.676721 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-48d9e9e8-1527-414c-8a07-736f2723c321 tempest-SecurityGroupRulesTestJSON-1152099622 tempest-SecurityGroupRulesTestJSON-1152099622-project] Returning 404 to user: Security group 8bcde268-e838-479b-b5e8-7bab99c02f9f does not exist Oct 18 15:44:38.676721 n-d-853682-5 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-27a92878-7b6a-460a-b881-12d5474dc686'] {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:44:38.677859 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-48d9e9e8-1527-414c-8a07-736f2723c321 tempest-SecurityGroupRulesTestJSON-1152099622 tempest-SecurityGroupRulesTestJSON-1152099622-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/8bcde268-e838-479b-b5e8-7bab99c02f9f" status: 404 len: 194 microversion: 2.1 time: 0.238607 Oct 18 15:44:38.681866 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2190/4389] 10.222.0.60 () {58 vars in 1272 bytes} [Tue Oct 18 15:44:38 2022] DELETE /compute/v2.1/os-security-groups/8bcde268-e838-479b-b5e8-7bab99c02f9f => generated 194 bytes in 243 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:44:38.693512 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2b3f1572-ddc7-4643-a59f-dcaa98ec2b14 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:38.694179 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2b3f1572-ddc7-4643-a59f-dcaa98ec2b14 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 55179126-a629-4bb3-82f5-14606ec63426] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:38.710216 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b3f1572-ddc7-4643-a59f-dcaa98ec2b14 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:38.710711 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b3f1572-ddc7-4643-a59f-dcaa98ec2b14 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:38.712076 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b3f1572-ddc7-4643-a59f-dcaa98ec2b14 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:38.712826 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b3f1572-ddc7-4643-a59f-dcaa98ec2b14 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:38.713292 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b3f1572-ddc7-4643-a59f-dcaa98ec2b14 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:38.714278 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b3f1572-ddc7-4643-a59f-dcaa98ec2b14 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:38.856609 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2decc1fd-e5d9-4f3d-8674-d86d70c9391d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:38.870057 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2decc1fd-e5d9-4f3d-8674-d86d70c9391d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.539852 Oct 18 15:44:38.885219 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2200/4390] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:38 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:38.898314 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-88108205-2661-43e3-a276-900fb564acf3 tempest-SecurityGroupRulesTestJSON-1152099622 tempest-SecurityGroupRulesTestJSON-1152099622-project] Calling method '.version_select at 0x7f7c3c4e40d0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:39.251658 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2b3f1572-ddc7-4643-a59f-dcaa98ec2b14 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304b3248f9db4629943a8b8080a6d22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdc7504a1d1424ea34f83f1a6d4bf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:39.265159 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2b3f1572-ddc7-4643-a59f-dcaa98ec2b14 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426" status: 200 len: 1669 microversion: 2.1 time: 0.577933 Oct 18 15:44:39.288755 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2191/4391] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:38 2022] GET /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426 => generated 1669 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:39.303321 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bcd5c840-abc3-4907-b8f2-96b56c2b489c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:39.304540 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bcd5c840-abc3-4907-b8f2-96b56c2b489c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 25eb309d-2add-4b63-96b9-f78966b9f3b6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:39.315602 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bcd5c840-abc3-4907-b8f2-96b56c2b489c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:39.321865 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bcd5c840-abc3-4907-b8f2-96b56c2b489c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:39.322517 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bcd5c840-abc3-4907-b8f2-96b56c2b489c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:39.323475 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bcd5c840-abc3-4907-b8f2-96b56c2b489c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:39.324130 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bcd5c840-abc3-4907-b8f2-96b56c2b489c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:39.325552 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bcd5c840-abc3-4907-b8f2-96b56c2b489c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:40.291872 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bcd5c840-abc3-4907-b8f2-96b56c2b489c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:40.315383 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-88108205-2661-43e3-a276-900fb564acf3 tempest-SecurityGroupRulesTestJSON-1152099622 tempest-SecurityGroupRulesTestJSON-1152099622-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/114f81cd-bfb0-4efa-baec-a1fe270e4e6d" status: 202 len: 0 microversion: 2.1 time: 1.428989 Oct 18 15:44:40.315883 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bcd5c840-abc3-4907-b8f2-96b56c2b489c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/25eb309d-2add-4b63-96b9-f78966b9f3b6" status: 200 len: 1315 microversion: 2.1 time: 1.024644 Oct 18 15:44:40.317980 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2192/4392] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:39 2022] GET /compute/v2.1/servers/25eb309d-2add-4b63-96b9-f78966b9f3b6 => generated 1315 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:40.318717 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2201/4393] 10.222.0.60 () {58 vars in 1272 bytes} [Tue Oct 18 15:44:38 2022] DELETE /compute/v2.1/os-security-groups/114f81cd-bfb0-4efa-baec-a1fe270e4e6d => generated 0 bytes in 1433 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:44:40.324206 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9118c459-080f-4634-bbf8-a9d6a4b04571 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:40.325386 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9118c459-080f-4634-bbf8-a9d6a4b04571 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 19226472-0c76-46f8-a4ba-7d32931341a2] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:40.329468 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dfcab10c-19ce-423f-89d9-06880bd04754 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:40.330112 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dfcab10c-19ce-423f-89d9-06880bd04754 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:40.334147 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9118c459-080f-4634-bbf8-a9d6a4b04571 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:40.341226 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9118c459-080f-4634-bbf8-a9d6a4b04571 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:40.341815 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9118c459-080f-4634-bbf8-a9d6a4b04571 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:40.342647 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9118c459-080f-4634-bbf8-a9d6a4b04571 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:40.343348 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9118c459-080f-4634-bbf8-a9d6a4b04571 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:40.344173 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9118c459-080f-4634-bbf8-a9d6a4b04571 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:40.354267 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfcab10c-19ce-423f-89d9-06880bd04754 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:40.354884 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfcab10c-19ce-423f-89d9-06880bd04754 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:40.356703 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfcab10c-19ce-423f-89d9-06880bd04754 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:40.363001 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfcab10c-19ce-423f-89d9-06880bd04754 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:40.363801 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfcab10c-19ce-423f-89d9-06880bd04754 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:40.367167 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfcab10c-19ce-423f-89d9-06880bd04754 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:40.876685 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9118c459-080f-4634-bbf8-a9d6a4b04571 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:40.890002 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9118c459-080f-4634-bbf8-a9d6a4b04571 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2" status: 200 len: 1522 microversion: 2.1 time: 0.566776 Oct 18 15:44:40.890646 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2202/4394] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:40 2022] GET /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2 => generated 1522 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:40.900549 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7da1044d-0f9c-49a4-8c6d-a0473de2e123 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:40.901215 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7da1044d-0f9c-49a4-8c6d-a0473de2e123 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 55179126-a629-4bb3-82f5-14606ec63426] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:40.921281 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7da1044d-0f9c-49a4-8c6d-a0473de2e123 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:40.922198 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7da1044d-0f9c-49a4-8c6d-a0473de2e123 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:40.922882 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7da1044d-0f9c-49a4-8c6d-a0473de2e123 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:40.923852 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7da1044d-0f9c-49a4-8c6d-a0473de2e123 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:40.924481 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7da1044d-0f9c-49a4-8c6d-a0473de2e123 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:40.924948 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7da1044d-0f9c-49a4-8c6d-a0473de2e123 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:40.981221 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dfcab10c-19ce-423f-89d9-06880bd04754 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:40.995124 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dfcab10c-19ce-423f-89d9-06880bd04754 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.674642 Oct 18 15:44:40.995748 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2193/4395] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:40 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:41.006257 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-351ccb1c-c625-49ec-ac28-41baa401a6dc tempest-SecurityGroupRulesTestJSON-1152099622 tempest-SecurityGroupRulesTestJSON-1152099622-project] Calling method '.version_select at 0x7f7c3ce014c0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:41.408148 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:44:41.468739 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7da1044d-0f9c-49a4-8c6d-a0473de2e123 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304b3248f9db4629943a8b8080a6d22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdc7504a1d1424ea34f83f1a6d4bf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:41.480443 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7da1044d-0f9c-49a4-8c6d-a0473de2e123 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426" status: 200 len: 1669 microversion: 2.1 time: 0.588090 Oct 18 15:44:41.481486 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2203/4396] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:40 2022] GET /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426 => generated 1669 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:41.486901 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ca3dc308-5a03-43e0-bd29-422d77979ab2 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:44:41.487591 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ca3dc308-5a03-43e0-bd29-422d77979ab2 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:41.494484 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:44:41.496640 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca3dc308-5a03-43e0-bd29-422d77979ab2 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:41.497607 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca3dc308-5a03-43e0-bd29-422d77979ab2 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:41.498519 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca3dc308-5a03-43e0-bd29-422d77979ab2 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:41.500852 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca3dc308-5a03-43e0-bd29-422d77979ab2 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:41.501743 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca3dc308-5a03-43e0-bd29-422d77979ab2 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:41.502403 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca3dc308-5a03-43e0-bd29-422d77979ab2 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:41.531958 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-ca3dc308-5a03-43e0-bd29-422d77979ab2 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lazy-loading 'flavor' on Instance uuid 2cc69e2e-cb26-42d6-b887-31e0afaa69fc {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:44:41.813361 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ca3dc308-5a03-43e0-bd29-422d77979ab2 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "POST /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc/action" status: 202 len: 0 microversion: 2.1 time: 0.329808 Oct 18 15:44:41.813984 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2204/4397] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:44:41 2022] POST /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc/action => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:44:41.822587 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-20115757-c06c-4364-b844-86130d5a7f15 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:41.827673 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-20115757-c06c-4364-b844-86130d5a7f15 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 25eb309d-2add-4b63-96b9-f78966b9f3b6] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:41.836003 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-20115757-c06c-4364-b844-86130d5a7f15 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:41.836507 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-20115757-c06c-4364-b844-86130d5a7f15 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:41.836981 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-20115757-c06c-4364-b844-86130d5a7f15 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:41.837923 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-20115757-c06c-4364-b844-86130d5a7f15 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:41.839196 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-20115757-c06c-4364-b844-86130d5a7f15 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:41.839785 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-20115757-c06c-4364-b844-86130d5a7f15 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:42.156149 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:44:42.381655 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-351ccb1c-c625-49ec-ac28-41baa401a6dc tempest-SecurityGroupRulesTestJSON-1152099622 tempest-SecurityGroupRulesTestJSON-1152099622-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/27d2ff5b-d383-4920-a822-5a8ce0c9762e" status: 202 len: 0 microversion: 2.1 time: 1.381566 Oct 18 15:44:42.382287 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2194/4398] 10.222.0.60 () {58 vars in 1272 bytes} [Tue Oct 18 15:44:40 2022] DELETE /compute/v2.1/os-security-groups/27d2ff5b-d383-4920-a822-5a8ce0c9762e => generated 0 bytes in 1383 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:44:42.388634 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-114289e5-9288-4e12-aa9f-2a69c689b477 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:42.389469 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-114289e5-9288-4e12-aa9f-2a69c689b477 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:42.410537 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-114289e5-9288-4e12-aa9f-2a69c689b477 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:42.411164 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-114289e5-9288-4e12-aa9f-2a69c689b477 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:42.411616 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-114289e5-9288-4e12-aa9f-2a69c689b477 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:42.412692 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-114289e5-9288-4e12-aa9f-2a69c689b477 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:42.413195 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-114289e5-9288-4e12-aa9f-2a69c689b477 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:42.413883 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-114289e5-9288-4e12-aa9f-2a69c689b477 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:42.414754 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-20115757-c06c-4364-b844-86130d5a7f15 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:42.433703 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-20115757-c06c-4364-b844-86130d5a7f15 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/25eb309d-2add-4b63-96b9-f78966b9f3b6" status: 200 len: 1315 microversion: 2.1 time: 0.618224 Oct 18 15:44:42.434509 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2205/4399] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:41 2022] GET /compute/v2.1/servers/25eb309d-2add-4b63-96b9-f78966b9f3b6 => generated 1315 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:42.462218 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ea3a12c0-bd3d-402c-8341-7bcaa9088148 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:42.463450 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ea3a12c0-bd3d-402c-8341-7bcaa9088148 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 19226472-0c76-46f8-a4ba-7d32931341a2] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:42.473428 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea3a12c0-bd3d-402c-8341-7bcaa9088148 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:42.474745 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea3a12c0-bd3d-402c-8341-7bcaa9088148 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:42.475400 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea3a12c0-bd3d-402c-8341-7bcaa9088148 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:42.476458 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea3a12c0-bd3d-402c-8341-7bcaa9088148 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:42.477399 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea3a12c0-bd3d-402c-8341-7bcaa9088148 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:42.478077 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea3a12c0-bd3d-402c-8341-7bcaa9088148 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:43.519177 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-114289e5-9288-4e12-aa9f-2a69c689b477 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:43.533486 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-114289e5-9288-4e12-aa9f-2a69c689b477 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1513 microversion: 2.1 time: 1.148105 Oct 18 15:44:43.536774 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2195/4400] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:42 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1513 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:43.565968 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1b59d2dc-4cf4-4b80-b056-ce04369f5c9e tempest-SecurityGroupRulesTestJSON-1152099622 tempest-SecurityGroupRulesTestJSON-1152099622-project] Calling method '.version_select at 0x7f7c3ce01f70>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:43.794759 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ea3a12c0-bd3d-402c-8341-7bcaa9088148 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:43.806916 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ea3a12c0-bd3d-402c-8341-7bcaa9088148 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2" status: 200 len: 1522 microversion: 2.1 time: 1.359598 Oct 18 15:44:43.810683 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2206/4401] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:42 2022] GET /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2 => generated 1522 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:43.830866 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7b3a04b9-e325-4d5b-b422-de2a772d1fb0 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:43.831973 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7b3a04b9-e325-4d5b-b422-de2a772d1fb0 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 55179126-a629-4bb3-82f5-14606ec63426] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:43.839665 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7b3a04b9-e325-4d5b-b422-de2a772d1fb0 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:43.844377 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7b3a04b9-e325-4d5b-b422-de2a772d1fb0 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:43.844852 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7b3a04b9-e325-4d5b-b422-de2a772d1fb0 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:43.846032 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7b3a04b9-e325-4d5b-b422-de2a772d1fb0 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:43.846650 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7b3a04b9-e325-4d5b-b422-de2a772d1fb0 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:43.847230 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7b3a04b9-e325-4d5b-b422-de2a772d1fb0 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:44.038611 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7b3a04b9-e325-4d5b-b422-de2a772d1fb0 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304b3248f9db4629943a8b8080a6d22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdc7504a1d1424ea34f83f1a6d4bf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:44.057293 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7b3a04b9-e325-4d5b-b422-de2a772d1fb0 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426" status: 200 len: 1321 microversion: 2.1 time: 0.243722 Oct 18 15:44:44.072849 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2207/4402] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:43 2022] GET /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426 => generated 1321 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:44.072849 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8571b70c-e930-47c2-ba4a-bd84a5c162f8 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:44.073430 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8571b70c-e930-47c2-ba4a-bd84a5c162f8 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 25eb309d-2add-4b63-96b9-f78966b9f3b6] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:44.095183 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8571b70c-e930-47c2-ba4a-bd84a5c162f8 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:44.095701 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8571b70c-e930-47c2-ba4a-bd84a5c162f8 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:44.096209 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8571b70c-e930-47c2-ba4a-bd84a5c162f8 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:44.098740 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8571b70c-e930-47c2-ba4a-bd84a5c162f8 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:44.101191 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8571b70c-e930-47c2-ba4a-bd84a5c162f8 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:44.101652 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8571b70c-e930-47c2-ba4a-bd84a5c162f8 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:44.573020 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8571b70c-e930-47c2-ba4a-bd84a5c162f8 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:44.589452 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8571b70c-e930-47c2-ba4a-bd84a5c162f8 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/25eb309d-2add-4b63-96b9-f78966b9f3b6" status: 200 len: 1315 microversion: 2.1 time: 0.525352 Oct 18 15:44:44.592514 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2208/4403] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:44 2022] GET /compute/v2.1/servers/25eb309d-2add-4b63-96b9-f78966b9f3b6 => generated 1315 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:44.604220 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-cac02267-345d-441f-8f39-84354a8e81cc req-bec773a1-4208-41d8-af8b-46704690f185 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55179126-a629-4bb3-82f5-14606ec63426", "name": "network-vif-deleted", "tag": "4a427a75-becb-49f1-943f-d4357e1f1e68"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:44:44.635427 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-cac02267-345d-441f-8f39-84354a8e81cc req-bec773a1-4208-41d8-af8b-46704690f185 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:44.638816 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-cac02267-345d-441f-8f39-84354a8e81cc req-bec773a1-4208-41d8-af8b-46704690f185 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:44.639261 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-cac02267-345d-441f-8f39-84354a8e81cc req-bec773a1-4208-41d8-af8b-46704690f185 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:44.656021 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-cac02267-345d-441f-8f39-84354a8e81cc req-bec773a1-4208-41d8-af8b-46704690f185 service nova] Creating event network-vif-deleted:4a427a75-becb-49f1-943f-d4357e1f1e68 for instance 55179126-a629-4bb3-82f5-14606ec63426 on n-h1-853682-5 Oct 18 15:44:44.662671 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-cac02267-345d-441f-8f39-84354a8e81cc req-bec773a1-4208-41d8-af8b-46704690f185 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068397 Oct 18 15:44:44.663538 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2209/4404] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:44:44.670439 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ff9bce86-4643-42e5-8810-cfc7b091553d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:44.671395 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ff9bce86-4643-42e5-8810-cfc7b091553d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:44.679962 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ff9bce86-4643-42e5-8810-cfc7b091553d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:44.680849 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ff9bce86-4643-42e5-8810-cfc7b091553d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:44.681630 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ff9bce86-4643-42e5-8810-cfc7b091553d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:44.682608 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ff9bce86-4643-42e5-8810-cfc7b091553d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:44.683273 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ff9bce86-4643-42e5-8810-cfc7b091553d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:44.683914 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ff9bce86-4643-42e5-8810-cfc7b091553d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:44.715318 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:44:44.824273 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1b59d2dc-4cf4-4b80-b056-ce04369f5c9e tempest-SecurityGroupRulesTestJSON-1152099622 tempest-SecurityGroupRulesTestJSON-1152099622-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/c554a69f-04e3-4c13-b5aa-eb7b7446044a" status: 202 len: 0 microversion: 2.1 time: 1.267217 Oct 18 15:44:44.832099 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2196/4405] 10.222.0.60 () {58 vars in 1272 bytes} [Tue Oct 18 15:44:43 2022] DELETE /compute/v2.1/os-security-groups/c554a69f-04e3-4c13-b5aa-eb7b7446044a => generated 0 bytes in 1277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:44:44.838449 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9279b697-8bdd-4619-97c0-ed4212a23023 tempest-SecurityGroupRulesTestJSON-1152099622 tempest-SecurityGroupRulesTestJSON-1152099622-project] Calling method '.version_select at 0x7f7c3cf5ac10>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:45.098628 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ff9bce86-4643-42e5-8810-cfc7b091553d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:45.109520 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ff9bce86-4643-42e5-8810-cfc7b091553d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1513 microversion: 2.1 time: 0.442319 Oct 18 15:44:45.109520 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2210/4406] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:44 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1513 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:45.138928 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a34908ac-9280-45aa-bd5a-1ca162b73d37 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:45.142178 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a34908ac-9280-45aa-bd5a-1ca162b73d37 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 19226472-0c76-46f8-a4ba-7d32931341a2] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:45.159251 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a34908ac-9280-45aa-bd5a-1ca162b73d37 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:45.160048 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a34908ac-9280-45aa-bd5a-1ca162b73d37 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:45.162054 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a34908ac-9280-45aa-bd5a-1ca162b73d37 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:45.164891 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a34908ac-9280-45aa-bd5a-1ca162b73d37 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:45.165605 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a34908ac-9280-45aa-bd5a-1ca162b73d37 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:45.167072 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a34908ac-9280-45aa-bd5a-1ca162b73d37 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:45.769438 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a34908ac-9280-45aa-bd5a-1ca162b73d37 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:45.777323 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a34908ac-9280-45aa-bd5a-1ca162b73d37 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2" status: 200 len: 1522 microversion: 2.1 time: 0.668420 Oct 18 15:44:45.783285 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2211/4407] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:45 2022] GET /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2 => generated 1522 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:45.788495 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-cab3e566-1020-4067-90e5-45a714274f32 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:45.789139 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-cab3e566-1020-4067-90e5-45a714274f32 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 55179126-a629-4bb3-82f5-14606ec63426] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:45.809520 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cab3e566-1020-4067-90e5-45a714274f32 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:45.810466 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cab3e566-1020-4067-90e5-45a714274f32 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:45.810939 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cab3e566-1020-4067-90e5-45a714274f32 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:45.811663 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cab3e566-1020-4067-90e5-45a714274f32 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:45.812130 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cab3e566-1020-4067-90e5-45a714274f32 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:45.812564 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cab3e566-1020-4067-90e5-45a714274f32 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:45.831910 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-cab3e566-1020-4067-90e5-45a714274f32 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] HTTP exception thrown: Instance 55179126-a629-4bb3-82f5-14606ec63426 could not be found. Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-cab3e566-1020-4067-90e5-45a714274f32 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Request method failure captured: Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426 HTTP/1.1 Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsfyIMGIKagHv42ZclZ4vV2nv2V6nMSERSYUm2Mguo48uB1D-ahUCWeUqiHW9JgJsyPUV5imS5Kzt6x9jVdiWnieLXTUxS42GPIQC9hxY0ofBX9DPB_tJyBl5NRSQZ-hKgea7JbasC3ojhutPkE2I4dYri-1lJplB76bieoISb7z3CE Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 5cdc7504a1d1424ea34f83f1a6d4bf71 Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-AttachVolumeTestJSON-1787080058 Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5cdc7504a1d1424ea34f83f1a6d4bf71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5cdc7504a1d1424ea34f83f1a6d4bf71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5cdc7504a1d1424ea34f83f1a6d4bf71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5cdc7504a1d1424ea34f83f1a6d4bf71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-AttachVolumeTestJSON-1787080058 Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 5cdc7504a1d1424ea34f83f1a6d4bf71 Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1787080058 Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-AttachVolumeTestJSON-1787080058-project Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 304b3248f9db4629943a8b8080a6d22e Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-AttachVolumeTestJSON-1787080058-project Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 55179126-a629-4bb3-82f5-14606ec63426 could not be found. Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '55179126-a629-4bb3-82f5-14606ec63426'} Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55179126-a629-4bb3-82f5-14606ec63426 could not be found. Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55179126-a629-4bb3-82f5-14606ec63426 could not be found. Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:44:45.833804 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:45.839307 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:45.839307 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:44:45.839307 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:44:45.839307 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:44:45.839307 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:44:45.839307 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55179126-a629-4bb3-82f5-14606ec63426 could not be found. Oct 18 15:44:45.839307 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:45.841279 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-cab3e566-1020-4067-90e5-45a714274f32 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Returning 404 to user: Instance 55179126-a629-4bb3-82f5-14606ec63426 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:44:45.842345 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-cab3e566-1020-4067-90e5-45a714274f32 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426" status: 404 len: 111 microversion: 2.1 time: 0.058002 Oct 18 15:44:45.843495 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2212/4408] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:45 2022] GET /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:44:45.848689 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-7d30a7f1-5f4e-405a-b6b0-543eff54a2ea req-83121c7f-edd2-4bb2-a4d7-c113f6ec6b28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25eb309d-2add-4b63-96b9-f78966b9f3b6", "name": "network-vif-plugged", "status": "completed", "tag": "c5682ba2-35a4-41c4-b0c6-b5675c138586"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:44:45.865418 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-7d30a7f1-5f4e-405a-b6b0-543eff54a2ea req-83121c7f-edd2-4bb2-a4d7-c113f6ec6b28 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:45.865845 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-7d30a7f1-5f4e-405a-b6b0-543eff54a2ea req-83121c7f-edd2-4bb2-a4d7-c113f6ec6b28 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:45.866764 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-7d30a7f1-5f4e-405a-b6b0-543eff54a2ea req-83121c7f-edd2-4bb2-a4d7-c113f6ec6b28 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:45.884612 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-7d30a7f1-5f4e-405a-b6b0-543eff54a2ea req-83121c7f-edd2-4bb2-a4d7-c113f6ec6b28 service nova] Creating event network-vif-plugged:c5682ba2-35a4-41c4-b0c6-b5675c138586 for instance 25eb309d-2add-4b63-96b9-f78966b9f3b6 on n-h1-853682-5 Oct 18 15:44:45.890594 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-7d30a7f1-5f4e-405a-b6b0-543eff54a2ea req-83121c7f-edd2-4bb2-a4d7-c113f6ec6b28 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045582 Oct 18 15:44:45.891792 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2213/4409] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:44:45.899244 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9d5b6155-3911-41ca-a832-36e6fed03f56 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:45.900227 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9d5b6155-3911-41ca-a832-36e6fed03f56 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 25eb309d-2add-4b63-96b9-f78966b9f3b6] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:45.907314 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9d5b6155-3911-41ca-a832-36e6fed03f56 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:45.908057 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9d5b6155-3911-41ca-a832-36e6fed03f56 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:45.908734 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9d5b6155-3911-41ca-a832-36e6fed03f56 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:45.909916 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9d5b6155-3911-41ca-a832-36e6fed03f56 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:45.910820 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9d5b6155-3911-41ca-a832-36e6fed03f56 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:45.911513 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9d5b6155-3911-41ca-a832-36e6fed03f56 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:45.912164 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9279b697-8bdd-4619-97c0-ed4212a23023 tempest-SecurityGroupRulesTestJSON-1152099622 tempest-SecurityGroupRulesTestJSON-1152099622-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/f9b57947-3c2b-4adf-bea3-564680e0446e" status: 202 len: 0 microversion: 2.1 time: 1.078577 Oct 18 15:44:45.917049 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2197/4410] 10.222.0.60 () {58 vars in 1272 bytes} [Tue Oct 18 15:44:44 2022] DELETE /compute/v2.1/os-security-groups/f9b57947-3c2b-4adf-bea3-564680e0446e => generated 0 bytes in 1084 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:44:45.925139 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dc0ef17c-2721-4cf2-9d83-2ebb7f378731 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '.version_select at 0x7f7c3c60aca0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:45.988222 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:44:46.027455 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dc0ef17c-2721-4cf2-9d83-2ebb7f378731 tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-571736896" status: 202 len: 0 microversion: 2.1 time: 0.107079 Oct 18 15:44:46.028075 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2198/4411] 10.222.0.60 () {58 vars in 1218 bytes} [Tue Oct 18 15:44:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-571736896 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:44:46.043239 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a8b652ae-231f-4203-bf97-67e3f88fd55c tempest-SecurityGroupRulesTestJSON-1152099622 tempest-SecurityGroupRulesTestJSON-1152099622-project] Calling method '.version_select at 0x7f7c3d9a1ca0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:46.251651 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9d5b6155-3911-41ca-a832-36e6fed03f56 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:46.270467 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9d5b6155-3911-41ca-a832-36e6fed03f56 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/25eb309d-2add-4b63-96b9-f78966b9f3b6" status: 200 len: 1315 microversion: 2.1 time: 0.377101 Oct 18 15:44:46.271619 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2214/4412] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:45 2022] GET /compute/v2.1/servers/25eb309d-2add-4b63-96b9-f78966b9f3b6 => generated 1315 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:46.276761 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c5982740-0e56-4110-b6fa-fa69344c8514 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:46.277412 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c5982740-0e56-4110-b6fa-fa69344c8514 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:46.295880 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c5982740-0e56-4110-b6fa-fa69344c8514 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:46.296840 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c5982740-0e56-4110-b6fa-fa69344c8514 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:46.297359 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c5982740-0e56-4110-b6fa-fa69344c8514 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:46.298133 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c5982740-0e56-4110-b6fa-fa69344c8514 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:46.298779 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c5982740-0e56-4110-b6fa-fa69344c8514 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:46.299287 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c5982740-0e56-4110-b6fa-fa69344c8514 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:46.708283 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c5982740-0e56-4110-b6fa-fa69344c8514 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:46.723732 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c5982740-0e56-4110-b6fa-fa69344c8514 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1513 microversion: 2.1 time: 0.450598 Oct 18 15:44:46.724831 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2215/4413] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:46 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1513 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:46.812214 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-da540a87-8c4c-482d-a6ac-81884f49d9f3 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:46.813103 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-da540a87-8c4c-482d-a6ac-81884f49d9f3 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 19226472-0c76-46f8-a4ba-7d32931341a2] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:46.830111 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-da540a87-8c4c-482d-a6ac-81884f49d9f3 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:46.830675 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-da540a87-8c4c-482d-a6ac-81884f49d9f3 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:46.831180 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-da540a87-8c4c-482d-a6ac-81884f49d9f3 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:46.832146 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-da540a87-8c4c-482d-a6ac-81884f49d9f3 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:46.833178 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-da540a87-8c4c-482d-a6ac-81884f49d9f3 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:46.833830 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-da540a87-8c4c-482d-a6ac-81884f49d9f3 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:46.852077 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a8b652ae-231f-4203-bf97-67e3f88fd55c tempest-SecurityGroupRulesTestJSON-1152099622 tempest-SecurityGroupRulesTestJSON-1152099622-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/fe4b576f-29a5-45ec-8e74-83c3bfd75d69" status: 202 len: 0 microversion: 2.1 time: 0.819273 Oct 18 15:44:46.854105 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2199/4414] 10.222.0.60 () {58 vars in 1272 bytes} [Tue Oct 18 15:44:46 2022] DELETE /compute/v2.1/os-security-groups/fe4b576f-29a5-45ec-8e74-83c3bfd75d69 => generated 0 bytes in 822 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:44:47.286497 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-da540a87-8c4c-482d-a6ac-81884f49d9f3 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:47.295525 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e757791f-6120-4937-8c5f-ed859eedb220 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:47.296297 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e757791f-6120-4937-8c5f-ed859eedb220 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 25eb309d-2add-4b63-96b9-f78966b9f3b6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:47.297589 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-da540a87-8c4c-482d-a6ac-81884f49d9f3 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2" status: 200 len: 1522 microversion: 2.1 time: 0.492003 Oct 18 15:44:47.313661 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2216/4415] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:46 2022] GET /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2 => generated 1522 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:47.321937 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e757791f-6120-4937-8c5f-ed859eedb220 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:47.322773 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e757791f-6120-4937-8c5f-ed859eedb220 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:47.323670 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e757791f-6120-4937-8c5f-ed859eedb220 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:47.324637 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e757791f-6120-4937-8c5f-ed859eedb220 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:47.332872 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e757791f-6120-4937-8c5f-ed859eedb220 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:47.333638 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e757791f-6120-4937-8c5f-ed859eedb220 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:47.625964 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e757791f-6120-4937-8c5f-ed859eedb220 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:47.639661 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e757791f-6120-4937-8c5f-ed859eedb220 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/25eb309d-2add-4b63-96b9-f78966b9f3b6" status: 200 len: 1315 microversion: 2.1 time: 0.345434 Oct 18 15:44:47.644854 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2200/4416] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:47 2022] GET /compute/v2.1/servers/25eb309d-2add-4b63-96b9-f78966b9f3b6 => generated 1315 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:47.751228 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3b4db084-12ae-4105-9270-565c02f1f6cb tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:47.752004 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3b4db084-12ae-4105-9270-565c02f1f6cb tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:47.762561 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3b4db084-12ae-4105-9270-565c02f1f6cb tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:47.766135 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3b4db084-12ae-4105-9270-565c02f1f6cb tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:47.766754 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3b4db084-12ae-4105-9270-565c02f1f6cb tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:47.767729 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3b4db084-12ae-4105-9270-565c02f1f6cb tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:47.771937 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3b4db084-12ae-4105-9270-565c02f1f6cb tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:47.772395 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3b4db084-12ae-4105-9270-565c02f1f6cb tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:48.326550 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f5148c99-dffd-480a-b29a-107f26200599 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:48.327753 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f5148c99-dffd-480a-b29a-107f26200599 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 19226472-0c76-46f8-a4ba-7d32931341a2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:48.340243 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f5148c99-dffd-480a-b29a-107f26200599 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:48.345575 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f5148c99-dffd-480a-b29a-107f26200599 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:48.346407 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f5148c99-dffd-480a-b29a-107f26200599 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:48.347417 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f5148c99-dffd-480a-b29a-107f26200599 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:48.348103 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f5148c99-dffd-480a-b29a-107f26200599 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:48.350492 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f5148c99-dffd-480a-b29a-107f26200599 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:48.778049 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3b4db084-12ae-4105-9270-565c02f1f6cb tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:48.792477 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3b4db084-12ae-4105-9270-565c02f1f6cb tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1513 microversion: 2.1 time: 1.042615 Oct 18 15:44:48.794568 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2217/4417] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:47 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1513 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:48.801070 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-623fbec2-4735-439b-8aef-f794976b51c1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:48.801837 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-623fbec2-4735-439b-8aef-f794976b51c1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 25eb309d-2add-4b63-96b9-f78966b9f3b6] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:48.811966 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-623fbec2-4735-439b-8aef-f794976b51c1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:48.812728 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-623fbec2-4735-439b-8aef-f794976b51c1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:48.813252 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-623fbec2-4735-439b-8aef-f794976b51c1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:48.814432 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-623fbec2-4735-439b-8aef-f794976b51c1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:48.814967 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-623fbec2-4735-439b-8aef-f794976b51c1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:48.815396 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-623fbec2-4735-439b-8aef-f794976b51c1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:48.908825 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f5148c99-dffd-480a-b29a-107f26200599 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:48.917017 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f5148c99-dffd-480a-b29a-107f26200599 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2" status: 200 len: 1522 microversion: 2.1 time: 0.595421 Oct 18 15:44:48.929156 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2201/4418] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:48 2022] GET /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2 => generated 1522 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:49.394918 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-623fbec2-4735-439b-8aef-f794976b51c1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:49.406219 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-623fbec2-4735-439b-8aef-f794976b51c1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/25eb309d-2add-4b63-96b9-f78966b9f3b6" status: 200 len: 1502 microversion: 2.1 time: 0.610179 Oct 18 15:44:49.409936 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2218/4419] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:48 2022] GET /compute/v2.1/servers/25eb309d-2add-4b63-96b9-f78966b9f3b6 => generated 1502 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:49.434564 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cd2d069c-dd8c-41e0-84c7-bd4744724091 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:44:49.438884 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cd2d069c-dd8c-41e0-84c7-bd4744724091 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 25eb309d-2add-4b63-96b9-f78966b9f3b6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:49.462393 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd2d069c-dd8c-41e0-84c7-bd4744724091 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:49.463438 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd2d069c-dd8c-41e0-84c7-bd4744724091 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:49.484555 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd2d069c-dd8c-41e0-84c7-bd4744724091 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:49.486496 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd2d069c-dd8c-41e0-84c7-bd4744724091 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:49.486984 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd2d069c-dd8c-41e0-84c7-bd4744724091 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:49.489422 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd2d069c-dd8c-41e0-84c7-bd4744724091 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:49.587138 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cd2d069c-dd8c-41e0-84c7-bd4744724091 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "POST /compute/v2.1/servers/25eb309d-2add-4b63-96b9-f78966b9f3b6/action" status: 200 len: 14 microversion: 2.1 time: 0.157687 Oct 18 15:44:49.587811 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2202/4420] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:44:49 2022] POST /compute/v2.1/servers/25eb309d-2add-4b63-96b9-f78966b9f3b6/action => generated 14 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:44:49.819646 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8049fe4e-3b9a-42d8-ab82-ba55e4dda28d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:49.820148 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8049fe4e-3b9a-42d8-ab82-ba55e4dda28d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:49.834515 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8049fe4e-3b9a-42d8-ab82-ba55e4dda28d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:49.836639 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8049fe4e-3b9a-42d8-ab82-ba55e4dda28d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:49.838582 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8049fe4e-3b9a-42d8-ab82-ba55e4dda28d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:49.841150 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8049fe4e-3b9a-42d8-ab82-ba55e4dda28d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:49.845709 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8049fe4e-3b9a-42d8-ab82-ba55e4dda28d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:49.846303 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8049fe4e-3b9a-42d8-ab82-ba55e4dda28d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:49.946500 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c2b82d7b-4614-422c-87bf-1bd329cb2009 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:49.948047 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c2b82d7b-4614-422c-87bf-1bd329cb2009 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 19226472-0c76-46f8-a4ba-7d32931341a2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:49.964012 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c2b82d7b-4614-422c-87bf-1bd329cb2009 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:49.967128 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c2b82d7b-4614-422c-87bf-1bd329cb2009 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:49.984307 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c2b82d7b-4614-422c-87bf-1bd329cb2009 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:49.985618 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c2b82d7b-4614-422c-87bf-1bd329cb2009 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:49.986759 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c2b82d7b-4614-422c-87bf-1bd329cb2009 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:49.988757 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c2b82d7b-4614-422c-87bf-1bd329cb2009 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:50.493323 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8049fe4e-3b9a-42d8-ab82-ba55e4dda28d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:50.510526 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8049fe4e-3b9a-42d8-ab82-ba55e4dda28d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1513 microversion: 2.1 time: 0.696330 Oct 18 15:44:50.539501 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2219/4421] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:49 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1513 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:50.602148 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e54ac728-4a76-4b46-a254-9b1e09e33b78 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:44:50.605010 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e54ac728-4a76-4b46-a254-9b1e09e33b78 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 25eb309d-2add-4b63-96b9-f78966b9f3b6] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:50.619879 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e54ac728-4a76-4b46-a254-9b1e09e33b78 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:50.621626 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e54ac728-4a76-4b46-a254-9b1e09e33b78 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:50.624163 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e54ac728-4a76-4b46-a254-9b1e09e33b78 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:50.625075 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e54ac728-4a76-4b46-a254-9b1e09e33b78 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:50.626373 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e54ac728-4a76-4b46-a254-9b1e09e33b78 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:50.627435 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e54ac728-4a76-4b46-a254-9b1e09e33b78 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:50.744869 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e54ac728-4a76-4b46-a254-9b1e09e33b78 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "POST /compute/v2.1/servers/25eb309d-2add-4b63-96b9-f78966b9f3b6/action" status: 200 len: 14 microversion: 2.1 time: 0.149489 Oct 18 15:44:50.749403 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2220/4422] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:44:50 2022] POST /compute/v2.1/servers/25eb309d-2add-4b63-96b9-f78966b9f3b6/action => generated 14 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:44:50.804456 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c2b82d7b-4614-422c-87bf-1bd329cb2009 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:50.814253 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c2b82d7b-4614-422c-87bf-1bd329cb2009 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2" status: 200 len: 1522 microversion: 2.1 time: 0.873515 Oct 18 15:44:50.843112 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2203/4423] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:49 2022] GET /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2 => generated 1522 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:44:51.547913 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9a78ebb9-5c61-4c9c-92af-ef625607f441 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:51.548912 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9a78ebb9-5c61-4c9c-92af-ef625607f441 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:51.563277 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9a78ebb9-5c61-4c9c-92af-ef625607f441 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:51.565766 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9a78ebb9-5c61-4c9c-92af-ef625607f441 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:51.567865 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9a78ebb9-5c61-4c9c-92af-ef625607f441 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:51.571785 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9a78ebb9-5c61-4c9c-92af-ef625607f441 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:51.572744 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9a78ebb9-5c61-4c9c-92af-ef625607f441 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:51.573511 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9a78ebb9-5c61-4c9c-92af-ef625607f441 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:51.761697 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ecf42554-7fab-4abf-8219-1d93013e8538 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:44:51.764207 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ecf42554-7fab-4abf-8219-1d93013e8538 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 25eb309d-2add-4b63-96b9-f78966b9f3b6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:51.785981 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ecf42554-7fab-4abf-8219-1d93013e8538 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:51.786677 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ecf42554-7fab-4abf-8219-1d93013e8538 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:51.787398 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ecf42554-7fab-4abf-8219-1d93013e8538 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:51.789501 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ecf42554-7fab-4abf-8219-1d93013e8538 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:51.790098 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ecf42554-7fab-4abf-8219-1d93013e8538 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:51.791505 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ecf42554-7fab-4abf-8219-1d93013e8538 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:51.913349 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ecf42554-7fab-4abf-8219-1d93013e8538 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "POST /compute/v2.1/servers/25eb309d-2add-4b63-96b9-f78966b9f3b6/action" status: 200 len: 14 microversion: 2.1 time: 0.159683 Oct 18 15:44:51.914164 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2204/4424] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:44:51 2022] POST /compute/v2.1/servers/25eb309d-2add-4b63-96b9-f78966b9f3b6/action => generated 14 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 18 15:44:51.920900 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7d2cf810-0772-4790-9d8d-2a125d6e0571 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:51.925983 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7d2cf810-0772-4790-9d8d-2a125d6e0571 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 19226472-0c76-46f8-a4ba-7d32931341a2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:51.973609 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d2cf810-0772-4790-9d8d-2a125d6e0571 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:51.976016 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d2cf810-0772-4790-9d8d-2a125d6e0571 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:51.976615 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d2cf810-0772-4790-9d8d-2a125d6e0571 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:51.977595 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d2cf810-0772-4790-9d8d-2a125d6e0571 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:51.983139 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d2cf810-0772-4790-9d8d-2a125d6e0571 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:51.983756 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d2cf810-0772-4790-9d8d-2a125d6e0571 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:52.645499 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9a78ebb9-5c61-4c9c-92af-ef625607f441 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:52.678001 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9a78ebb9-5c61-4c9c-92af-ef625607f441 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1513 microversion: 2.1 time: 1.135300 Oct 18 15:44:52.707403 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2221/4425] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:51 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1513 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:44:52.917530 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7d2cf810-0772-4790-9d8d-2a125d6e0571 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:52.926807 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fa355560-e5c6-47f9-8dcb-08043734518a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:44:52.927190 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:44:52.929209 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-fa355560-e5c6-47f9-8dcb-08043734518a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 25eb309d-2add-4b63-96b9-f78966b9f3b6] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:52.937327 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7d2cf810-0772-4790-9d8d-2a125d6e0571 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2" status: 200 len: 1502 microversion: 2.1 time: 1.021273 Oct 18 15:44:52.937938 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2205/4426] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:51 2022] GET /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2 => generated 1502 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:52.941649 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fa355560-e5c6-47f9-8dcb-08043734518a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:52.942424 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fa355560-e5c6-47f9-8dcb-08043734518a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:52.943083 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fa355560-e5c6-47f9-8dcb-08043734518a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:52.944973 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fa355560-e5c6-47f9-8dcb-08043734518a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:52.948121 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fa355560-e5c6-47f9-8dcb-08043734518a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:52.948684 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fa355560-e5c6-47f9-8dcb-08043734518a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:53.082573 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fa355560-e5c6-47f9-8dcb-08043734518a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "POST /compute/v2.1/servers/25eb309d-2add-4b63-96b9-f78966b9f3b6/action" status: 200 len: 14 microversion: 2.1 time: 0.161510 Oct 18 15:44:53.090163 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2222/4427] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:44:52 2022] POST /compute/v2.1/servers/25eb309d-2add-4b63-96b9-f78966b9f3b6/action => generated 14 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:44:53.098184 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d145c08c-3ca7-4c2c-9abc-53e1b3a41917 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7020db75-73ad-4cef-b6ed-22da332b44ce"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:44:53.119011 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d145c08c-3ca7-4c2c-9abc-53e1b3a41917 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 19226472-0c76-46f8-a4ba-7d32931341a2] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:53.142549 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d145c08c-3ca7-4c2c-9abc-53e1b3a41917 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:53.151923 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d145c08c-3ca7-4c2c-9abc-53e1b3a41917 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:53.153211 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d145c08c-3ca7-4c2c-9abc-53e1b3a41917 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:53.155582 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d145c08c-3ca7-4c2c-9abc-53e1b3a41917 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:53.160647 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d145c08c-3ca7-4c2c-9abc-53e1b3a41917 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:53.164267 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d145c08c-3ca7-4c2c-9abc-53e1b3a41917 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:53.276338 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-d145c08c-3ca7-4c2c-9abc-53e1b3a41917 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] HTTP exception thrown: Cannot 'attach_volume' instance 19226472-0c76-46f8-a4ba-7d32931341a2 while it is in vm_state rescued Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d145c08c-3ca7-4c2c-9abc-53e1b3a41917 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Request method failure captured: Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: request: POST /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2/os-volume_attachments HTTP/1.1 Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 74 Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsmOlfJjna__aWkkHZgCFMOd2DpNqn_dr-IEPGuxkqNqAVs7tN5T268nd09vhRJnPU2g5DJC-yqBSq_x2HTDX86g3yOFixR2PbozSJNAuQoWzOe1hqzQDBztCsy4gcfQ635XTPjGuAISQPn4_b-3rgJ6h45QPHOVHclQC7dNdVcnHno Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 224ca1f734c14bc8bf31e1826faf8e71 Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1233761615 Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/224ca1f734c14bc8bf31e1826faf8e71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/224ca1f734c14bc8bf31e1826faf8e71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/224ca1f734c14bc8bf31e1826faf8e71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_224ca1f734c14bc8bf31e1826faf8e71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1233761615 Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 224ca1f734c14bc8bf31e1826faf8e71 Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1233761615 Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServerRescueNegativeTestJSON-1233761615-project Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 646fb4652c164c1dab5672d33d9fb295 Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1233761615-project Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: {"volumeAttachment": {"volumeId": "7020db75-73ad-4cef-b6ed-22da332b44ce"}} Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: exception: Cannot 'attach_volume' instance 19226472-0c76-46f8-a4ba-7d32931341a2 while it is in vm_state rescued Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'server_id': '19226472-0c76-46f8-a4ba-7d32931341a2', 'body': {'volumeAttachment': {'volumeId': '7020db75-73ad-4cef-b6ed-22da332b44ce'}}} Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 19226472-0c76-46f8-a4ba-7d32931341a2 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 18 15:44:53.292039 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 18 15:44:53.296198 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 15:44:53.296198 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 15:44:53.296198 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 19226472-0c76-46f8-a4ba-7d32931341a2 while it is in vm_state rescued Oct 18 15:44:53.296198 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:53.296198 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:44:53.296198 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:53.296198 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:44:53.296198 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:44:53.296198 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:44:53.296198 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:44:53.296198 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:44:53.296198 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 19226472-0c76-46f8-a4ba-7d32931341a2 while it is in vm_state rescued Oct 18 15:44:53.296198 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:44:53.302851 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d145c08c-3ca7-4c2c-9abc-53e1b3a41917 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Returning 409 to user: Cannot 'attach_volume' instance 19226472-0c76-46f8-a4ba-7d32931341a2 while it is in vm_state rescued {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:44:53.305157 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d145c08c-3ca7-4c2c-9abc-53e1b3a41917 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "POST /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.213614 Oct 18 15:44:53.307022 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2223/4428] 10.222.0.60 () {60 vars in 1323 bytes} [Tue Oct 18 15:44:53 2022] POST /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2/os-volume_attachments => generated 152 bytes in 216 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 15:44:53.323327 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-37e9e755-5da9-4e22-bd58-737668609f12 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:44:53.331513 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-37e9e755-5da9-4e22-bd58-737668609f12 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 19226472-0c76-46f8-a4ba-7d32931341a2] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:53.352033 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37e9e755-5da9-4e22-bd58-737668609f12 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:53.353085 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37e9e755-5da9-4e22-bd58-737668609f12 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:53.353725 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37e9e755-5da9-4e22-bd58-737668609f12 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:53.354943 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37e9e755-5da9-4e22-bd58-737668609f12 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:53.355599 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37e9e755-5da9-4e22-bd58-737668609f12 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:53.356221 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37e9e755-5da9-4e22-bd58-737668609f12 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:53.361172 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e0bb87e1-8a5b-4ceb-ab18-091d983314af tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-656260009", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "555b266f-a669-4b15-ac01-9eefa267ee33"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:44:53.516941 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-e0bb87e1-8a5b-4ceb-ab18-091d983314af tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] validate_networks() for [('555b266f-a669-4b15-ac01-9eefa267ee33', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:44:53.535636 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-37e9e755-5da9-4e22-bd58-737668609f12 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "POST /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2/action" status: 202 len: 0 microversion: 2.1 time: 0.219970 Oct 18 15:44:53.539782 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2224/4429] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:44:53 2022] POST /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:44:53.548790 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9e4d3bf0-2267-4d44-98e5-dbbb0c9350ed tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:53.553800 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9e4d3bf0-2267-4d44-98e5-dbbb0c9350ed tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 19226472-0c76-46f8-a4ba-7d32931341a2] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:53.567401 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=88 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:44:53.570069 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9e4d3bf0-2267-4d44-98e5-dbbb0c9350ed tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:53.573689 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9e4d3bf0-2267-4d44-98e5-dbbb0c9350ed tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:53.574467 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9e4d3bf0-2267-4d44-98e5-dbbb0c9350ed tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:53.575880 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9e4d3bf0-2267-4d44-98e5-dbbb0c9350ed tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:53.581982 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9e4d3bf0-2267-4d44-98e5-dbbb0c9350ed tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:53.583032 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9e4d3bf0-2267-4d44-98e5-dbbb0c9350ed tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:55.046841 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9e4d3bf0-2267-4d44-98e5-dbbb0c9350ed tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:55.063227 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9e4d3bf0-2267-4d44-98e5-dbbb0c9350ed tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2" status: 200 len: 1510 microversion: 2.1 time: 1.520197 Oct 18 15:44:55.063935 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2225/4430] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:53 2022] GET /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2 => generated 1510 bytes in 1523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:55.077940 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a0fbeeb3-6b5c-4151-ba58-a2a35449dbc4 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:55.081095 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a0fbeeb3-6b5c-4151-ba58-a2a35449dbc4 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:55.097231 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a0fbeeb3-6b5c-4151-ba58-a2a35449dbc4 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:55.097944 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a0fbeeb3-6b5c-4151-ba58-a2a35449dbc4 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:55.099156 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a0fbeeb3-6b5c-4151-ba58-a2a35449dbc4 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:55.103212 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a0fbeeb3-6b5c-4151-ba58-a2a35449dbc4 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:55.105150 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a0fbeeb3-6b5c-4151-ba58-a2a35449dbc4 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:55.105850 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a0fbeeb3-6b5c-4151-ba58-a2a35449dbc4 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:56.815108 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a0fbeeb3-6b5c-4151-ba58-a2a35449dbc4 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:56.824860 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a0fbeeb3-6b5c-4151-ba58-a2a35449dbc4 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1513 microversion: 2.1 time: 1.758327 Oct 18 15:44:56.827693 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2226/4431] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:55 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1513 bytes in 1762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:56.839571 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e1fe1e0a-1ff2-43fc-be0a-39c6f521463f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:44:56.848779 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e1fe1e0a-1ff2-43fc-be0a-39c6f521463f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 25eb309d-2add-4b63-96b9-f78966b9f3b6] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:56.876157 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e1fe1e0a-1ff2-43fc-be0a-39c6f521463f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:56.876667 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e1fe1e0a-1ff2-43fc-be0a-39c6f521463f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:56.880165 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e1fe1e0a-1ff2-43fc-be0a-39c6f521463f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:56.880999 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e1fe1e0a-1ff2-43fc-be0a-39c6f521463f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:56.884617 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e1fe1e0a-1ff2-43fc-be0a-39c6f521463f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:56.885082 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e1fe1e0a-1ff2-43fc-be0a-39c6f521463f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:56.923668 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-e0bb87e1-8a5b-4ceb-ab18-091d983314af tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:44:56.924208 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-e0bb87e1-8a5b-4ceb-ab18-091d983314af tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:44:56.924909 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-e0bb87e1-8a5b-4ceb-ab18-091d983314af tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:44:56.925561 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-e0bb87e1-8a5b-4ceb-ab18-091d983314af tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:44:56.926100 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-e0bb87e1-8a5b-4ceb-ab18-091d983314af tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:44:56.945255 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e0bb87e1-8a5b-4ceb-ab18-091d983314af tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:56.945979 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e0bb87e1-8a5b-4ceb-ab18-091d983314af tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:56.947169 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e0bb87e1-8a5b-4ceb-ab18-091d983314af tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:56.948949 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e0bb87e1-8a5b-4ceb-ab18-091d983314af tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:56.949538 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e0bb87e1-8a5b-4ceb-ab18-091d983314af tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:56.950904 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e0bb87e1-8a5b-4ceb-ab18-091d983314af tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:56.995841 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e1fe1e0a-1ff2-43fc-be0a-39c6f521463f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "POST /compute/v2.1/servers/25eb309d-2add-4b63-96b9-f78966b9f3b6/action" status: 200 len: 14 microversion: 2.1 time: 0.163810 Oct 18 15:44:56.996496 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2227/4432] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:44:56 2022] POST /compute/v2.1/servers/25eb309d-2add-4b63-96b9-f78966b9f3b6/action => generated 14 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:44:57.009531 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fd0aba5d-25ba-4a8a-982e-f1b50aa953d5 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:57.010244 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-fd0aba5d-25ba-4a8a-982e-f1b50aa953d5 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 19226472-0c76-46f8-a4ba-7d32931341a2] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:57.026114 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fd0aba5d-25ba-4a8a-982e-f1b50aa953d5 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:57.027905 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fd0aba5d-25ba-4a8a-982e-f1b50aa953d5 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:57.028389 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fd0aba5d-25ba-4a8a-982e-f1b50aa953d5 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:57.029427 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-e0bb87e1-8a5b-4ceb-ab18-091d983314af tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Getting quotas for project 8c8478562c2e4f8fab01a9667d9b6b05. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:44:57.031874 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fd0aba5d-25ba-4a8a-982e-f1b50aa953d5 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:57.032565 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fd0aba5d-25ba-4a8a-982e-f1b50aa953d5 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:57.034504 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fd0aba5d-25ba-4a8a-982e-f1b50aa953d5 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:57.045356 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-e0bb87e1-8a5b-4ceb-ab18-091d983314af tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Getting quotas for user 3c91f91c89b648c8b099dbedf7c822b8 and project 8c8478562c2e4f8fab01a9667d9b6b05. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:44:57.087713 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e0bb87e1-8a5b-4ceb-ab18-091d983314af tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:44:57.097417 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e0bb87e1-8a5b-4ceb-ab18-091d983314af tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 50e19888-f65b-4eaa-8a40-47733d990b8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:44:57.224560 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e0bb87e1-8a5b-4ceb-ab18-091d983314af tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.283218 Oct 18 15:44:57.226796 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2206/4433] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:44:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 4286 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:44:57.244002 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3b5b6505-d633-4cc9-9546-1dd5f7b29fcf tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:57.248760 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3b5b6505-d633-4cc9-9546-1dd5f7b29fcf tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 50e19888-f65b-4eaa-8a40-47733d990b8e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:57.491214 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3b5b6505-d633-4cc9-9546-1dd5f7b29fcf tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:57.514573 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3b5b6505-d633-4cc9-9546-1dd5f7b29fcf tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e" status: 200 len: 1217 microversion: 2.1 time: 0.274985 Oct 18 15:44:57.519931 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2207/4434] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:57 2022] GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e => generated 1217 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:57.755551 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-fd0aba5d-25ba-4a8a-982e-f1b50aa953d5 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:57.759063 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:44:57.767925 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fd0aba5d-25ba-4a8a-982e-f1b50aa953d5 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2" status: 200 len: 1510 microversion: 2.1 time: 0.762921 Oct 18 15:44:57.772117 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2228/4435] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:57 2022] GET /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2 => generated 1510 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:57.855306 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9476fc2d-238c-4151-b484-b01c61f10c07 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:57.857719 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9476fc2d-238c-4151-b484-b01c61f10c07 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:57.868111 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9476fc2d-238c-4151-b484-b01c61f10c07 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:57.879279 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9476fc2d-238c-4151-b484-b01c61f10c07 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:57.881273 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9476fc2d-238c-4151-b484-b01c61f10c07 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:57.883265 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9476fc2d-238c-4151-b484-b01c61f10c07 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:57.884221 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9476fc2d-238c-4151-b484-b01c61f10c07 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:57.885686 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9476fc2d-238c-4151-b484-b01c61f10c07 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:58.013108 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-eb1e9db5-21d1-4262-a506-c91fd03fa886 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:44:58.015626 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-eb1e9db5-21d1-4262-a506-c91fd03fa886 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 25eb309d-2add-4b63-96b9-f78966b9f3b6] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:58.050040 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eb1e9db5-21d1-4262-a506-c91fd03fa886 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:58.050689 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eb1e9db5-21d1-4262-a506-c91fd03fa886 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:58.054642 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eb1e9db5-21d1-4262-a506-c91fd03fa886 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:58.056140 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eb1e9db5-21d1-4262-a506-c91fd03fa886 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:58.061316 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eb1e9db5-21d1-4262-a506-c91fd03fa886 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:58.063642 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eb1e9db5-21d1-4262-a506-c91fd03fa886 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:58.198411 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-eb1e9db5-21d1-4262-a506-c91fd03fa886 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "POST /compute/v2.1/servers/25eb309d-2add-4b63-96b9-f78966b9f3b6/action" status: 200 len: 14 microversion: 2.1 time: 0.193486 Oct 18 15:44:58.200217 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2229/4436] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:44:58 2022] POST /compute/v2.1/servers/25eb309d-2add-4b63-96b9-f78966b9f3b6/action => generated 14 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 18 15:44:58.430704 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9476fc2d-238c-4151-b484-b01c61f10c07 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:58.444430 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9476fc2d-238c-4151-b484-b01c61f10c07 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1534 microversion: 2.1 time: 0.594406 Oct 18 15:44:58.446721 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2208/4437] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:57 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1534 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:58.543302 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e0d9a2c0-8f45-4ec3-8994-c1651e1dbf10 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:58.547440 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e0d9a2c0-8f45-4ec3-8994-c1651e1dbf10 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 50e19888-f65b-4eaa-8a40-47733d990b8e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:58.555593 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e0d9a2c0-8f45-4ec3-8994-c1651e1dbf10 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:58.556469 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e0d9a2c0-8f45-4ec3-8994-c1651e1dbf10 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:58.557189 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e0d9a2c0-8f45-4ec3-8994-c1651e1dbf10 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:58.558137 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e0d9a2c0-8f45-4ec3-8994-c1651e1dbf10 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:58.558934 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e0d9a2c0-8f45-4ec3-8994-c1651e1dbf10 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:58.560513 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e0d9a2c0-8f45-4ec3-8994-c1651e1dbf10 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:58.737604 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e0d9a2c0-8f45-4ec3-8994-c1651e1dbf10 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:58.755107 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e0d9a2c0-8f45-4ec3-8994-c1651e1dbf10 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e" status: 200 len: 1221 microversion: 2.1 time: 0.214285 Oct 18 15:44:58.768600 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2230/4438] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:58 2022] GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e => generated 1221 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:58.798603 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-09712008-fab6-4195-84bd-944d3c5315c5 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:58.799156 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-09712008-fab6-4195-84bd-944d3c5315c5 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 19226472-0c76-46f8-a4ba-7d32931341a2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:58.813055 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09712008-fab6-4195-84bd-944d3c5315c5 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:58.816708 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09712008-fab6-4195-84bd-944d3c5315c5 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:58.820050 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09712008-fab6-4195-84bd-944d3c5315c5 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:58.821691 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09712008-fab6-4195-84bd-944d3c5315c5 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:58.822388 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09712008-fab6-4195-84bd-944d3c5315c5 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:58.823883 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09712008-fab6-4195-84bd-944d3c5315c5 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:59.212315 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-092d8445-4d27-42de-837b-7e8aa3dd4f69 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:44:59.216638 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-092d8445-4d27-42de-837b-7e8aa3dd4f69 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 25eb309d-2add-4b63-96b9-f78966b9f3b6] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:59.236260 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-092d8445-4d27-42de-837b-7e8aa3dd4f69 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:59.239905 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-092d8445-4d27-42de-837b-7e8aa3dd4f69 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:59.241723 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-092d8445-4d27-42de-837b-7e8aa3dd4f69 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:59.245050 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-092d8445-4d27-42de-837b-7e8aa3dd4f69 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:59.245546 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-092d8445-4d27-42de-837b-7e8aa3dd4f69 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:59.245993 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-092d8445-4d27-42de-837b-7e8aa3dd4f69 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:59.385499 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-09712008-fab6-4195-84bd-944d3c5315c5 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:44:59.397368 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-092d8445-4d27-42de-837b-7e8aa3dd4f69 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "POST /compute/v2.1/servers/25eb309d-2add-4b63-96b9-f78966b9f3b6/action" status: 200 len: 14 microversion: 2.1 time: 0.189997 Oct 18 15:44:59.398391 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2231/4439] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:44:59 2022] POST /compute/v2.1/servers/25eb309d-2add-4b63-96b9-f78966b9f3b6/action => generated 14 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 18 15:44:59.408171 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-09712008-fab6-4195-84bd-944d3c5315c5 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2" status: 200 len: 1510 microversion: 2.1 time: 0.616850 Oct 18 15:44:59.415027 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2209/4440] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:58 2022] GET /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2 => generated 1510 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:44:59.473640 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-49712aa0-b02b-4155-a466-6408d63c9eb5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:59.474772 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-49712aa0-b02b-4155-a466-6408d63c9eb5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:59.492849 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-49712aa0-b02b-4155-a466-6408d63c9eb5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:59.494132 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-49712aa0-b02b-4155-a466-6408d63c9eb5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:59.495350 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-49712aa0-b02b-4155-a466-6408d63c9eb5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:59.501836 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-49712aa0-b02b-4155-a466-6408d63c9eb5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:59.502684 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-49712aa0-b02b-4155-a466-6408d63c9eb5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:59.503340 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-49712aa0-b02b-4155-a466-6408d63c9eb5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:59.791195 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ee72a00a-4f50-468c-965a-7060b59f618c tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:44:59.799339 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ee72a00a-4f50-468c-965a-7060b59f618c tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 50e19888-f65b-4eaa-8a40-47733d990b8e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:44:59.820959 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee72a00a-4f50-468c-965a-7060b59f618c tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:59.821464 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee72a00a-4f50-468c-965a-7060b59f618c tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:59.823391 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee72a00a-4f50-468c-965a-7060b59f618c tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:44:59.829462 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee72a00a-4f50-468c-965a-7060b59f618c tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:44:59.831427 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee72a00a-4f50-468c-965a-7060b59f618c tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:44:59.832208 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee72a00a-4f50-468c-965a-7060b59f618c tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:00.016499 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-49712aa0-b02b-4155-a466-6408d63c9eb5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:00.029042 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-49712aa0-b02b-4155-a466-6408d63c9eb5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1534 microversion: 2.1 time: 0.558585 Oct 18 15:45:00.035466 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2232/4441] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:59 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1534 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:45:00.108743 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ee72a00a-4f50-468c-965a-7060b59f618c tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:00.120771 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ee72a00a-4f50-468c-965a-7060b59f618c tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e" status: 200 len: 1269 microversion: 2.1 time: 0.341565 Oct 18 15:45:00.140222 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2210/4442] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:44:59 2022] GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e => generated 1269 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:00.428537 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ee8f7547-2fc6-4251-aabe-63e77a6e6aff tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:45:00.435871 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ee8f7547-2fc6-4251-aabe-63e77a6e6aff tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 25eb309d-2add-4b63-96b9-f78966b9f3b6] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:00.446823 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8d179235-1f61-4342-835d-35cc1d9cbc39 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:00.449362 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8d179235-1f61-4342-835d-35cc1d9cbc39 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 19226472-0c76-46f8-a4ba-7d32931341a2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:00.459479 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ee8f7547-2fc6-4251-aabe-63e77a6e6aff tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:00.460638 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ee8f7547-2fc6-4251-aabe-63e77a6e6aff tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:00.463086 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ee8f7547-2fc6-4251-aabe-63e77a6e6aff tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:00.465277 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ee8f7547-2fc6-4251-aabe-63e77a6e6aff tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:00.467700 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ee8f7547-2fc6-4251-aabe-63e77a6e6aff tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:00.468499 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ee8f7547-2fc6-4251-aabe-63e77a6e6aff tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:00.470898 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d179235-1f61-4342-835d-35cc1d9cbc39 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:00.471476 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d179235-1f61-4342-835d-35cc1d9cbc39 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:00.473897 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d179235-1f61-4342-835d-35cc1d9cbc39 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:00.478242 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d179235-1f61-4342-835d-35cc1d9cbc39 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:00.480962 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d179235-1f61-4342-835d-35cc1d9cbc39 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:00.483251 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d179235-1f61-4342-835d-35cc1d9cbc39 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:00.573533 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ee8f7547-2fc6-4251-aabe-63e77a6e6aff tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "POST /compute/v2.1/servers/25eb309d-2add-4b63-96b9-f78966b9f3b6/action" status: 200 len: 8208 microversion: 2.1 time: 0.167207 Oct 18 15:45:00.580357 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2233/4443] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:45:00 2022] POST /compute/v2.1/servers/25eb309d-2add-4b63-96b9-f78966b9f3b6/action => generated 8208 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:00.586670 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4b792109-a517-4fda-983c-d94254ba09b1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:00.591825 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4b792109-a517-4fda-983c-d94254ba09b1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:00.626125 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4b792109-a517-4fda-983c-d94254ba09b1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:00.629169 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4b792109-a517-4fda-983c-d94254ba09b1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:00.629877 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4b792109-a517-4fda-983c-d94254ba09b1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:00.630824 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4b792109-a517-4fda-983c-d94254ba09b1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:00.633176 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4b792109-a517-4fda-983c-d94254ba09b1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:00.639040 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4b792109-a517-4fda-983c-d94254ba09b1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:02.209136 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4b792109-a517-4fda-983c-d94254ba09b1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:02.221888 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4b792109-a517-4fda-983c-d94254ba09b1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1671 microversion: 2.1 time: 1.639553 Oct 18 15:45:02.222490 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2234/4444] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:00 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1671 bytes in 1641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:02.252313 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8d179235-1f61-4342-835d-35cc1d9cbc39 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:02.254938 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9f313432-543f-4fe9-92aa-5f285c9d6d67 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:02.258123 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9f313432-543f-4fe9-92aa-5f285c9d6d67 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:02.264252 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8d179235-1f61-4342-835d-35cc1d9cbc39 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2" status: 200 len: 1516 microversion: 2.1 time: 1.829562 Oct 18 15:45:02.284424 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9f313432-543f-4fe9-92aa-5f285c9d6d67 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:02.284905 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2211/4445] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:00 2022] GET /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2 => generated 1516 bytes in 1840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:02.288783 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9f313432-543f-4fe9-92aa-5f285c9d6d67 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:02.298359 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9f313432-543f-4fe9-92aa-5f285c9d6d67 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:02.298718 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7e89632a-54ac-4e6e-9cad-08a50ee4d6dd tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:02.298718 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7e89632a-54ac-4e6e-9cad-08a50ee4d6dd tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 50e19888-f65b-4eaa-8a40-47733d990b8e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:02.306921 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9f313432-543f-4fe9-92aa-5f285c9d6d67 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:02.310657 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9f313432-543f-4fe9-92aa-5f285c9d6d67 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:02.311797 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9f313432-543f-4fe9-92aa-5f285c9d6d67 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:02.316352 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e89632a-54ac-4e6e-9cad-08a50ee4d6dd tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:02.324220 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e89632a-54ac-4e6e-9cad-08a50ee4d6dd tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:02.326099 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e89632a-54ac-4e6e-9cad-08a50ee4d6dd tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:02.327284 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e89632a-54ac-4e6e-9cad-08a50ee4d6dd tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:02.330239 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e89632a-54ac-4e6e-9cad-08a50ee4d6dd tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:02.335298 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e89632a-54ac-4e6e-9cad-08a50ee4d6dd tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:02.674534 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7e89632a-54ac-4e6e-9cad-08a50ee4d6dd tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:02.689733 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7e89632a-54ac-4e6e-9cad-08a50ee4d6dd tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e" status: 200 len: 1275 microversion: 2.1 time: 0.413470 Oct 18 15:45:02.690829 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2212/4446] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:02 2022] GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e => generated 1275 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:03.240062 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9f313432-543f-4fe9-92aa-5f285c9d6d67 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:03.256205 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9f313432-543f-4fe9-92aa-5f285c9d6d67 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1529 microversion: 2.1 time: 1.009502 Oct 18 15:45:03.277051 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2235/4447] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:02 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1529 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:03.296918 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5d6a146a-9010-4a3b-af2a-b96a01bcfe1d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:03.301212 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5d6a146a-9010-4a3b-af2a-b96a01bcfe1d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:03.337582 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5d6a146a-9010-4a3b-af2a-b96a01bcfe1d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:03.338160 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5d6a146a-9010-4a3b-af2a-b96a01bcfe1d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:03.338606 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5d6a146a-9010-4a3b-af2a-b96a01bcfe1d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:03.344167 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5d6a146a-9010-4a3b-af2a-b96a01bcfe1d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:03.344671 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5d6a146a-9010-4a3b-af2a-b96a01bcfe1d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:03.350320 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5d6a146a-9010-4a3b-af2a-b96a01bcfe1d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:03.431630 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3583c4aa-eeb1-4915-b182-a053f1d772e4 tempest-TestAggregatesBasicOps-1272156563 tempest-TestAggregatesBasicOps-1272156563-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1260455990", "availability_zone": "foo_zone"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:45:03.454337 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.aggregate [None req-3583c4aa-eeb1-4915-b182-a053f1d772e4 tempest-TestAggregatesBasicOps-1272156563 tempest-TestAggregatesBasicOps-1272156563-project-admin] Generated uuid 9c6c3311-0c9c-43b0-b131-d1d1db73ef73 for aggregate {{(pid=120406) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 15:45:03.658149 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3583c4aa-eeb1-4915-b182-a053f1d772e4 tempest-TestAggregatesBasicOps-1272156563 tempest-TestAggregatesBasicOps-1272156563-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.955633 Oct 18 15:45:03.660348 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2213/4448] 10.222.0.60 () {60 vars in 1164 bytes} [Tue Oct 18 15:45:02 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:45:03.683694 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-82445322-b83d-4c35-9db5-5f271d817a3b tempest-TestAggregatesBasicOps-1272156563 tempest-TestAggregatesBasicOps-1272156563-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:45:03.782404 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-82445322-b83d-4c35-9db5-5f271d817a3b tempest-TestAggregatesBasicOps-1272156563 tempest-TestAggregatesBasicOps-1272156563-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.105833 Oct 18 15:45:03.783355 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2214/4449] 10.222.0.60 () {60 vars in 1194 bytes} [Tue Oct 18 15:45:03 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:45:03.802258 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-57d6701c-6c73-4836-a3e9-f3e67a91908b tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:03.806282 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-57d6701c-6c73-4836-a3e9-f3e67a91908b tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 55179126-a629-4bb3-82f5-14606ec63426] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:03.832697 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57d6701c-6c73-4836-a3e9-f3e67a91908b tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:03.840995 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57d6701c-6c73-4836-a3e9-f3e67a91908b tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:03.842078 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57d6701c-6c73-4836-a3e9-f3e67a91908b tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:03.844064 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57d6701c-6c73-4836-a3e9-f3e67a91908b tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:03.851044 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57d6701c-6c73-4836-a3e9-f3e67a91908b tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:03.851748 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57d6701c-6c73-4836-a3e9-f3e67a91908b tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:03.913724 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-57d6701c-6c73-4836-a3e9-f3e67a91908b tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] HTTP exception thrown: Instance 55179126-a629-4bb3-82f5-14606ec63426 could not be found. Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-57d6701c-6c73-4836-a3e9-f3e67a91908b tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Request method failure captured: Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426 HTTP/1.1 Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsfyIMGIKagHv42ZclZ4vV2nv2V6nMSERSYUm2Mguo48uB1D-ahUCWeUqiHW9JgJsyPUV5imS5Kzt6x9jVdiWnieLXTUxS42GPIQC9hxY0ofBX9DPB_tJyBl5NRSQZ-hKgea7JbasC3ojhutPkE2I4dYri-1lJplB76bieoISb7z3CE Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 5cdc7504a1d1424ea34f83f1a6d4bf71 Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-AttachVolumeTestJSON-1787080058 Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5cdc7504a1d1424ea34f83f1a6d4bf71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5cdc7504a1d1424ea34f83f1a6d4bf71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5cdc7504a1d1424ea34f83f1a6d4bf71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5cdc7504a1d1424ea34f83f1a6d4bf71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-AttachVolumeTestJSON-1787080058 Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 5cdc7504a1d1424ea34f83f1a6d4bf71 Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1787080058 Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-AttachVolumeTestJSON-1787080058-project Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 304b3248f9db4629943a8b8080a6d22e Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-AttachVolumeTestJSON-1787080058-project Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 55179126-a629-4bb3-82f5-14606ec63426 could not be found. Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '55179126-a629-4bb3-82f5-14606ec63426'} Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55179126-a629-4bb3-82f5-14606ec63426 could not be found. Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:45:03.930875 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:45:03.936626 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55179126-a629-4bb3-82f5-14606ec63426 could not be found. Oct 18 15:45:03.936626 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:45:03.936626 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:45:03.936626 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:45:03.936626 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:45:03.936626 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:45:03.936626 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:45:03.936626 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:45:03.936626 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:45:03.936626 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55179126-a629-4bb3-82f5-14606ec63426 could not be found. Oct 18 15:45:03.936626 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:45:03.941142 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-57d6701c-6c73-4836-a3e9-f3e67a91908b tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Returning 404 to user: Instance 55179126-a629-4bb3-82f5-14606ec63426 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:45:03.948271 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-57d6701c-6c73-4836-a3e9-f3e67a91908b tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "DELETE /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426" status: 404 len: 111 microversion: 2.1 time: 0.159861 Oct 18 15:45:03.950664 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2215/4450] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:45:03 2022] DELETE /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426 => generated 111 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:45:03.965884 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0cd4a27c-f2de-4aeb-89c2-4dfb149e87a0 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:03.971820 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0cd4a27c-f2de-4aeb-89c2-4dfb149e87a0 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 50e19888-f65b-4eaa-8a40-47733d990b8e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:04.033903 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0cd4a27c-f2de-4aeb-89c2-4dfb149e87a0 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:04.034604 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0cd4a27c-f2de-4aeb-89c2-4dfb149e87a0 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:04.034929 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0cd4a27c-f2de-4aeb-89c2-4dfb149e87a0 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:04.042151 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0cd4a27c-f2de-4aeb-89c2-4dfb149e87a0 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:04.042664 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0cd4a27c-f2de-4aeb-89c2-4dfb149e87a0 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:04.043113 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0cd4a27c-f2de-4aeb-89c2-4dfb149e87a0 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:04.379539 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0cd4a27c-f2de-4aeb-89c2-4dfb149e87a0 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:04.401053 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0cd4a27c-f2de-4aeb-89c2-4dfb149e87a0 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e" status: 200 len: 1275 microversion: 2.1 time: 0.446969 Oct 18 15:45:04.404759 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2216/4451] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:03 2022] GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e => generated 1275 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:04.424837 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f2697e3c-a8a3-4cc9-b729-ce0972932ec8 tempest-TestAggregatesBasicOps-1272156563 tempest-TestAggregatesBasicOps-1272156563-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:04.438851 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2697e3c-a8a3-4cc9-b729-ce0972932ec8 tempest-TestAggregatesBasicOps-1272156563 tempest-TestAggregatesBasicOps-1272156563-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:04.439521 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2697e3c-a8a3-4cc9-b729-ce0972932ec8 tempest-TestAggregatesBasicOps-1272156563 tempest-TestAggregatesBasicOps-1272156563-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:04.439775 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2697e3c-a8a3-4cc9-b729-ce0972932ec8 tempest-TestAggregatesBasicOps-1272156563 tempest-TestAggregatesBasicOps-1272156563-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:04.440514 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2697e3c-a8a3-4cc9-b729-ce0972932ec8 tempest-TestAggregatesBasicOps-1272156563 tempest-TestAggregatesBasicOps-1272156563-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:04.454990 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2697e3c-a8a3-4cc9-b729-ce0972932ec8 tempest-TestAggregatesBasicOps-1272156563 tempest-TestAggregatesBasicOps-1272156563-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:04.455451 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2697e3c-a8a3-4cc9-b729-ce0972932ec8 tempest-TestAggregatesBasicOps-1272156563 tempest-TestAggregatesBasicOps-1272156563-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:04.597425 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5d6a146a-9010-4a3b-af2a-b96a01bcfe1d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:04.600386 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f2697e3c-a8a3-4cc9-b729-ce0972932ec8 tempest-TestAggregatesBasicOps-1272156563 tempest-TestAggregatesBasicOps-1272156563-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.194491 Oct 18 15:45:04.601053 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2217/4452] 10.222.0.60 () {58 vars in 1176 bytes} [Tue Oct 18 15:45:04 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:45:04.614804 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5d6a146a-9010-4a3b-af2a-b96a01bcfe1d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1671 microversion: 2.1 time: 1.338788 Oct 18 15:45:04.628842 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2236/4453] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:03 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1671 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:04.629989 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-96da9b92-010c-4724-bd5e-c405198488cc tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:04.633370 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-96da9b92-010c-4724-bd5e-c405198488cc tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:04.642746 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3911e61c-7c7e-4d43-9f0d-77555ed2ceda tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:04.643456 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3911e61c-7c7e-4d43-9f0d-77555ed2ceda tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 55179126-a629-4bb3-82f5-14606ec63426] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:04.664479 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3911e61c-7c7e-4d43-9f0d-77555ed2ceda tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:04.665016 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3911e61c-7c7e-4d43-9f0d-77555ed2ceda tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:04.665460 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3911e61c-7c7e-4d43-9f0d-77555ed2ceda tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:04.667143 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-96da9b92-010c-4724-bd5e-c405198488cc tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:04.669278 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-96da9b92-010c-4724-bd5e-c405198488cc tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:04.674594 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3911e61c-7c7e-4d43-9f0d-77555ed2ceda tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:04.675776 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3911e61c-7c7e-4d43-9f0d-77555ed2ceda tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:04.677409 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3911e61c-7c7e-4d43-9f0d-77555ed2ceda tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:04.678175 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-96da9b92-010c-4724-bd5e-c405198488cc tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:04.679035 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-96da9b92-010c-4724-bd5e-c405198488cc tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:04.680044 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-96da9b92-010c-4724-bd5e-c405198488cc tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:04.680503 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-96da9b92-010c-4724-bd5e-c405198488cc tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:04.737615 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-3911e61c-7c7e-4d43-9f0d-77555ed2ceda tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] HTTP exception thrown: Instance 55179126-a629-4bb3-82f5-14606ec63426 could not be found. Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3911e61c-7c7e-4d43-9f0d-77555ed2ceda tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Request method failure captured: Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426 HTTP/1.1 Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsfyIMGIKagHv42ZclZ4vV2nv2V6nMSERSYUm2Mguo48uB1D-ahUCWeUqiHW9JgJsyPUV5imS5Kzt6x9jVdiWnieLXTUxS42GPIQC9hxY0ofBX9DPB_tJyBl5NRSQZ-hKgea7JbasC3ojhutPkE2I4dYri-1lJplB76bieoISb7z3CE Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 5cdc7504a1d1424ea34f83f1a6d4bf71 Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-AttachVolumeTestJSON-1787080058 Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5cdc7504a1d1424ea34f83f1a6d4bf71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5cdc7504a1d1424ea34f83f1a6d4bf71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5cdc7504a1d1424ea34f83f1a6d4bf71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5cdc7504a1d1424ea34f83f1a6d4bf71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-AttachVolumeTestJSON-1787080058 Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 5cdc7504a1d1424ea34f83f1a6d4bf71 Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1787080058 Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-AttachVolumeTestJSON-1787080058-project Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 304b3248f9db4629943a8b8080a6d22e Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-AttachVolumeTestJSON-1787080058-project Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 55179126-a629-4bb3-82f5-14606ec63426 could not be found. Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '55179126-a629-4bb3-82f5-14606ec63426'} Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55179126-a629-4bb3-82f5-14606ec63426 could not be found. Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55179126-a629-4bb3-82f5-14606ec63426 could not be found. Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:45:04.743326 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:45:04.748333 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:45:04.748333 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:45:04.748333 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:45:04.748333 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:45:04.748333 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:45:04.748333 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55179126-a629-4bb3-82f5-14606ec63426 could not be found. Oct 18 15:45:04.748333 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:45:04.750873 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3911e61c-7c7e-4d43-9f0d-77555ed2ceda tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Returning 404 to user: Instance 55179126-a629-4bb3-82f5-14606ec63426 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:45:04.753911 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3911e61c-7c7e-4d43-9f0d-77555ed2ceda tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426" status: 404 len: 111 microversion: 2.1 time: 0.142944 Oct 18 15:45:04.756963 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2218/4454] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:04 2022] GET /compute/v2.1/servers/55179126-a629-4bb3-82f5-14606ec63426 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:45:04.775605 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-54f10ad0-7ca8-42e9-b599-e8e47df768b8 tempest-TestAggregatesBasicOps-1272156563 tempest-TestAggregatesBasicOps-1272156563-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:04.820042 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-54f10ad0-7ca8-42e9-b599-e8e47df768b8 tempest-TestAggregatesBasicOps-1272156563 tempest-TestAggregatesBasicOps-1272156563-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.048939 Oct 18 15:45:04.843580 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2219/4455] 10.222.0.60 () {58 vars in 1143 bytes} [Tue Oct 18 15:45:04 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:45:04.852754 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4fbeed15-330b-4819-83cd-50df91dacb4e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:04.860857 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4fbeed15-330b-4819-83cd-50df91dacb4e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:04.888520 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4fbeed15-330b-4819-83cd-50df91dacb4e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:04.897678 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4fbeed15-330b-4819-83cd-50df91dacb4e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:04.900593 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4fbeed15-330b-4819-83cd-50df91dacb4e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:04.912038 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4fbeed15-330b-4819-83cd-50df91dacb4e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:04.915621 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4fbeed15-330b-4819-83cd-50df91dacb4e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:04.924546 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4fbeed15-330b-4819-83cd-50df91dacb4e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:05.105183 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-96da9b92-010c-4724-bd5e-c405198488cc tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:05.127361 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-96da9b92-010c-4724-bd5e-c405198488cc tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1529 microversion: 2.1 time: 0.508705 Oct 18 15:45:05.128192 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2237/4456] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:04 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1529 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:05.154974 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-dc833071-95d2-424c-a392-28fa913e7e8f tempest-TestAggregatesBasicOps-1272156563 tempest-TestAggregatesBasicOps-1272156563-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-853682-5"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:45:05.203721 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dc833071-95d2-424c-a392-28fa913e7e8f tempest-TestAggregatesBasicOps-1272156563 tempest-TestAggregatesBasicOps-1272156563-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:05.204496 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dc833071-95d2-424c-a392-28fa913e7e8f tempest-TestAggregatesBasicOps-1272156563 tempest-TestAggregatesBasicOps-1272156563-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:05.205256 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dc833071-95d2-424c-a392-28fa913e7e8f tempest-TestAggregatesBasicOps-1272156563 tempest-TestAggregatesBasicOps-1272156563-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:05.751477 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4fbeed15-330b-4819-83cd-50df91dacb4e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:05.768087 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4fbeed15-330b-4819-83cd-50df91dacb4e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1671 microversion: 2.1 time: 0.923023 Oct 18 15:45:05.768939 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2220/4457] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:04 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1671 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:05.789812 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0693c51d-b1df-4a1c-842f-f7660c05bf7b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:05.791921 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0693c51d-b1df-4a1c-842f-f7660c05bf7b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 50e19888-f65b-4eaa-8a40-47733d990b8e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:05.818712 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0693c51d-b1df-4a1c-842f-f7660c05bf7b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:05.823518 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0693c51d-b1df-4a1c-842f-f7660c05bf7b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:05.825356 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0693c51d-b1df-4a1c-842f-f7660c05bf7b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:05.835142 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0693c51d-b1df-4a1c-842f-f7660c05bf7b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:05.835766 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0693c51d-b1df-4a1c-842f-f7660c05bf7b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:05.836759 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0693c51d-b1df-4a1c-842f-f7660c05bf7b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:06.093617 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-dc833071-95d2-424c-a392-28fa913e7e8f tempest-TestAggregatesBasicOps-1272156563 tempest-TestAggregatesBasicOps-1272156563-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.940877 Oct 18 15:45:06.105015 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2238/4458] 10.222.0.60 () {60 vars in 1194 bytes} [Tue Oct 18 15:45:05 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:45:06.128225 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b9d53b10-f45e-4cc7-a966-3387b8b0733a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:06.131559 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b9d53b10-f45e-4cc7-a966-3387b8b0733a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:06.156467 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b9d53b10-f45e-4cc7-a966-3387b8b0733a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:06.157010 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b9d53b10-f45e-4cc7-a966-3387b8b0733a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:06.157456 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b9d53b10-f45e-4cc7-a966-3387b8b0733a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:06.158180 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b9d53b10-f45e-4cc7-a966-3387b8b0733a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:06.158641 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b9d53b10-f45e-4cc7-a966-3387b8b0733a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:06.166855 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b9d53b10-f45e-4cc7-a966-3387b8b0733a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:06.493190 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0693c51d-b1df-4a1c-842f-f7660c05bf7b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:06.536677 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0693c51d-b1df-4a1c-842f-f7660c05bf7b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e" status: 200 len: 1317 microversion: 2.1 time: 0.764284 Oct 18 15:45:06.555568 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2221/4459] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:05 2022] GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e => generated 1317 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:06.589005 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c90eb699-178e-4724-b10d-f9318587a048 tempest-TestAggregatesBasicOps-1272156563 tempest-TestAggregatesBasicOps-1272156563-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:06.639542 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c90eb699-178e-4724-b10d-f9318587a048 tempest-TestAggregatesBasicOps-1272156563 tempest-TestAggregatesBasicOps-1272156563-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.077775 Oct 18 15:45:06.641284 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2222/4460] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Oct 18 15:45:06 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:45:06.648862 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b7ace991-3bec-47d0-ab0a-698c353e2296 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:06.649888 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b7ace991-3bec-47d0-ab0a-698c353e2296 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:06.672120 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b7ace991-3bec-47d0-ab0a-698c353e2296 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:06.675732 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b7ace991-3bec-47d0-ab0a-698c353e2296 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:06.677378 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b7ace991-3bec-47d0-ab0a-698c353e2296 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:06.733302 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b7ace991-3bec-47d0-ab0a-698c353e2296 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:06.736993 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b7ace991-3bec-47d0-ab0a-698c353e2296 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:06.744289 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b7ace991-3bec-47d0-ab0a-698c353e2296 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:07.389531 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b9d53b10-f45e-4cc7-a966-3387b8b0733a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:07.401573 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b9d53b10-f45e-4cc7-a966-3387b8b0733a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1675 microversion: 2.1 time: 1.294264 Oct 18 15:45:07.412993 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2239/4461] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:06 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1675 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:07.418931 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-611385b6-f63c-447e-aaa0-c45db0e6a371 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Action: 'create', calling method: .version_select at 0x7f7c3d3ea4c0>, body: {"keypair": {"name": "tempest-keypair-1611082033", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNyP35lYoUsGBK0nlv2wVCpCvpJ/SAurqVY7MHBqZK2lM3ZPXxOoCxhGRHMa7wfHIsY/hYlLTTSqIUMd5lIMUhkJUTeSaAovf5qx/YBiq6C5/Vv8s9W7p+TOUbBsJiukSg=="}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:45:07.498076 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=8 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:07.513156 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-611385b6-f63c-447e-aaa0-c45db0e6a371 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Getting quotas for project 224ca1f734c14bc8bf31e1826faf8e71. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:45:07.536948 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-611385b6-f63c-447e-aaa0-c45db0e6a371 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Getting quotas for user 646fb4652c164c1dab5672d33d9fb295 and project 224ca1f734c14bc8bf31e1826faf8e71. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:45:07.596985 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-611385b6-f63c-447e-aaa0-c45db0e6a371 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.182505 Oct 18 15:45:07.597611 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2240/4462] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Oct 18 15:45:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:45:07.610065 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b61d26fb-4fa5-4131-b590-2fa34aae5ba5 tempest-TestAggregatesBasicOps-1272156563 tempest-TestAggregatesBasicOps-1272156563-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-424745773", "availability_zone": "foo_zone"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:45:07.860085 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b7ace991-3bec-47d0-ab0a-698c353e2296 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:07.868432 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b7ace991-3bec-47d0-ab0a-698c353e2296 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1533 microversion: 2.1 time: 1.225723 Oct 18 15:45:07.869061 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2223/4463] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:06 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1533 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:07.910133 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9816986f-7115-47bd-8094-2a4a0cf1ad1e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:45:07.917719 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9816986f-7115-47bd-8094-2a4a0cf1ad1e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:07.958885 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9816986f-7115-47bd-8094-2a4a0cf1ad1e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:07.963082 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9816986f-7115-47bd-8094-2a4a0cf1ad1e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:07.970832 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9816986f-7115-47bd-8094-2a4a0cf1ad1e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:07.974196 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9816986f-7115-47bd-8094-2a4a0cf1ad1e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:07.980314 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9816986f-7115-47bd-8094-2a4a0cf1ad1e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:07.985767 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9816986f-7115-47bd-8094-2a4a0cf1ad1e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:08.173911 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b61d26fb-4fa5-4131-b590-2fa34aae5ba5 tempest-TestAggregatesBasicOps-1272156563 tempest-TestAggregatesBasicOps-1272156563-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.570691 Oct 18 15:45:08.176420 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2241/4464] 10.222.0.60 () {60 vars in 1173 bytes} [Tue Oct 18 15:45:07 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:45:08.191673 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-b3661270-cd13-4977-9fd5-69d174d89c8d req-6858895e-ee4e-4792-9c19-965f53a4315d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cc69e2e-cb26-42d6-b887-31e0afaa69fc", "name": "network-vif-plugged", "status": "completed", "tag": "c9ee9ae4-c0ad-4fa3-a68e-56018fcf2c7f"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:45:08.218176 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9816986f-7115-47bd-8094-2a4a0cf1ad1e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Locking {{(pid=120406) lock /opt/stack/nova/nova/compute/api.py:4845}} Oct 18 15:45:08.233619 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-b3661270-cd13-4977-9fd5-69d174d89c8d req-6858895e-ee4e-4792-9c19-965f53a4315d service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:08.238404 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-b3661270-cd13-4977-9fd5-69d174d89c8d req-6858895e-ee4e-4792-9c19-965f53a4315d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:08.240484 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-b3661270-cd13-4977-9fd5-69d174d89c8d req-6858895e-ee4e-4792-9c19-965f53a4315d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:08.285456 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-b3661270-cd13-4977-9fd5-69d174d89c8d req-6858895e-ee4e-4792-9c19-965f53a4315d service nova] Creating event network-vif-plugged:c9ee9ae4-c0ad-4fa3-a68e-56018fcf2c7f for instance 2cc69e2e-cb26-42d6-b887-31e0afaa69fc on n-h2-853682-5 Oct 18 15:45:08.292192 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-b3661270-cd13-4977-9fd5-69d174d89c8d req-6858895e-ee4e-4792-9c19-965f53a4315d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113669 Oct 18 15:45:08.295482 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2242/4465] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:45:08.308796 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-59f2da02-8ed5-4126-b497-dd7e6517aa3e tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:08.310608 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-59f2da02-8ed5-4126-b497-dd7e6517aa3e tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 50e19888-f65b-4eaa-8a40-47733d990b8e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:08.326309 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-59f2da02-8ed5-4126-b497-dd7e6517aa3e tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:08.327721 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-59f2da02-8ed5-4126-b497-dd7e6517aa3e tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:08.329318 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-59f2da02-8ed5-4126-b497-dd7e6517aa3e tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:08.346758 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-59f2da02-8ed5-4126-b497-dd7e6517aa3e tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:08.348145 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-59f2da02-8ed5-4126-b497-dd7e6517aa3e tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:08.349514 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-59f2da02-8ed5-4126-b497-dd7e6517aa3e tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:08.382866 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9816986f-7115-47bd-8094-2a4a0cf1ad1e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "POST /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8/action" status: 202 len: 0 microversion: 2.1 time: 0.496180 Oct 18 15:45:08.386957 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2224/4466] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:45:07 2022] POST /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8/action => generated 0 bytes in 504 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:45:08.401592 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5adaafa3-9b88-465e-8c57-5b5365a355b0 tempest-TestAggregatesBasicOps-1272156563 tempest-TestAggregatesBasicOps-1272156563-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:45:08.553760 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5adaafa3-9b88-465e-8c57-5b5365a355b0 tempest-TestAggregatesBasicOps-1272156563 tempest-TestAggregatesBasicOps-1272156563-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.164640 Oct 18 15:45:08.570688 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2225/4467] 10.222.0.60 () {60 vars in 1194 bytes} [Tue Oct 18 15:45:08 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:45:08.595671 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f7de3545-71b6-499c-a122-dfa1359ea018 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:08.596994 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f7de3545-71b6-499c-a122-dfa1359ea018 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:08.609332 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7de3545-71b6-499c-a122-dfa1359ea018 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:08.610581 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7de3545-71b6-499c-a122-dfa1359ea018 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:08.611187 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7de3545-71b6-499c-a122-dfa1359ea018 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:08.612069 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7de3545-71b6-499c-a122-dfa1359ea018 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:08.612680 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7de3545-71b6-499c-a122-dfa1359ea018 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:08.613293 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7de3545-71b6-499c-a122-dfa1359ea018 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:09.261568 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f7de3545-71b6-499c-a122-dfa1359ea018 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:09.289516 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f7de3545-71b6-499c-a122-dfa1359ea018 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1675 microversion: 2.1 time: 0.713832 Oct 18 15:45:09.291433 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2226/4468] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:08 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1675 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:09.303411 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e1be3692-2637-4b7d-949d-c27da186d1ce tempest-TestAggregatesBasicOps-1272156563 tempest-TestAggregatesBasicOps-1272156563-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:09.328675 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e1be3692-2637-4b7d-949d-c27da186d1ce tempest-TestAggregatesBasicOps-1272156563 tempest-TestAggregatesBasicOps-1272156563-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.034604 Oct 18 15:45:09.332744 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2227/4469] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Oct 18 15:45:09 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:45:09.350231 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-18738833-cb3b-42e6-970a-5bf2c3f6161e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:09.353399 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-18738833-cb3b-42e6-970a-5bf2c3f6161e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:09.374158 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18738833-cb3b-42e6-970a-5bf2c3f6161e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:09.375049 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18738833-cb3b-42e6-970a-5bf2c3f6161e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:09.380081 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18738833-cb3b-42e6-970a-5bf2c3f6161e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:09.381224 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18738833-cb3b-42e6-970a-5bf2c3f6161e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:09.381936 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18738833-cb3b-42e6-970a-5bf2c3f6161e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:09.382582 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18738833-cb3b-42e6-970a-5bf2c3f6161e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:09.396106 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-59f2da02-8ed5-4126-b497-dd7e6517aa3e tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:09.407054 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-59f2da02-8ed5-4126-b497-dd7e6517aa3e tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e" status: 200 len: 1321 microversion: 2.1 time: 1.109811 Oct 18 15:45:09.412934 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2243/4470] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:08 2022] GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e => generated 1321 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:09.432893 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-168c43a3-5522-4ec3-9172-fb8920b6535f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:45:09.482296 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-168c43a3-5522-4ec3-9172-fb8920b6535f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:09.483159 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-168c43a3-5522-4ec3-9172-fb8920b6535f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:09.489563 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-168c43a3-5522-4ec3-9172-fb8920b6535f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:09.579771 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-168c43a3-5522-4ec3-9172-fb8920b6535f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] HTTP exception thrown: Instance 79212b18-bfd6-4a94-9d58-80c535525aa8 is locked Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-168c43a3-5522-4ec3-9172-fb8920b6535f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Request method failure captured: Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: request: POST /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8/action HTTP/1.1 Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 15 Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsjnRdctCp-8YpJETZx5RBXsp0tk0P-jTGcQMSIsNH2GEBs8Wg82Po84gRYEjmY4OarQGWuT5THqpHI7_-hfhGBlYj8sHI1l4vQlE5R8BdhWWvvol61i38spuPGOi5m1Vnr-duJeNWVp2-6eOy-UohsCpTw7z-IjZzPv-4bQM_LgFXg Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 2a2cdc778bd54f209d70f5b8703dc068 Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServerActionsTestJSON-1828367688 Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2a2cdc778bd54f209d70f5b8703dc068"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2a2cdc778bd54f209d70f5b8703dc068"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2a2cdc778bd54f209d70f5b8703dc068"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2a2cdc778bd54f209d70f5b8703dc068"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServerActionsTestJSON-1828367688 Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 2a2cdc778bd54f209d70f5b8703dc068 Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServerActionsTestJSON-1828367688 Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServerActionsTestJSON-1828367688-project Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 2aa0148a4a43466da619ea9843b3f78c Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServerActionsTestJSON-1828367688-project Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: {"os-stop": {}} Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 79212b18-bfd6-4a94-9d58-80c535525aa8 is locked Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '79212b18-bfd6-4a94-9d58-80c535525aa8', 'body': {'os-stop': {}}} Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 79212b18-bfd6-4a94-9d58-80c535525aa8 is locked Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 79212b18-bfd6-4a94-9d58-80c535525aa8 is locked Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79212b18-bfd6-4a94-9d58-80c535525aa8 is locked Oct 18 15:45:09.586753 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:45:09.593244 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-168c43a3-5522-4ec3-9172-fb8920b6535f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Returning 409 to user: Instance 79212b18-bfd6-4a94-9d58-80c535525aa8 is locked {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:45:09.593244 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-168c43a3-5522-4ec3-9172-fb8920b6535f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "POST /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8/action" status: 409 len: 107 microversion: 2.1 time: 0.177514 Oct 18 15:45:09.593244 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2244/4471] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:45:09 2022] POST /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8/action => generated 107 bytes in 179 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 15:45:09.603927 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-dc2fd931-67c7-4e91-b16e-f8bc63285d92 tempest-TestAggregatesBasicOps-1272156563 tempest-TestAggregatesBasicOps-1272156563-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-853682-5"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:45:09.622747 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dc2fd931-67c7-4e91-b16e-f8bc63285d92 tempest-TestAggregatesBasicOps-1272156563 tempest-TestAggregatesBasicOps-1272156563-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:09.624570 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dc2fd931-67c7-4e91-b16e-f8bc63285d92 tempest-TestAggregatesBasicOps-1272156563 tempest-TestAggregatesBasicOps-1272156563-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:09.627473 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dc2fd931-67c7-4e91-b16e-f8bc63285d92 tempest-TestAggregatesBasicOps-1272156563 tempest-TestAggregatesBasicOps-1272156563-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:09.887906 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-18738833-cb3b-42e6-970a-5bf2c3f6161e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:09.927834 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-18738833-cb3b-42e6-970a-5bf2c3f6161e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1533 microversion: 2.1 time: 0.567137 Oct 18 15:45:09.955609 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2228/4472] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:09 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1533 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:09.963408 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cb2bdb4d-f87c-46b9-b178-c27ac21a07f4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:45:09.974023 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cb2bdb4d-f87c-46b9-b178-c27ac21a07f4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:09.995120 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb2bdb4d-f87c-46b9-b178-c27ac21a07f4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:09.997428 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb2bdb4d-f87c-46b9-b178-c27ac21a07f4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:10.000875 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb2bdb4d-f87c-46b9-b178-c27ac21a07f4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:10.001915 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb2bdb4d-f87c-46b9-b178-c27ac21a07f4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:10.009339 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb2bdb4d-f87c-46b9-b178-c27ac21a07f4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:10.013006 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb2bdb4d-f87c-46b9-b178-c27ac21a07f4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:10.048613 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:10.105639 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-dc2fd931-67c7-4e91-b16e-f8bc63285d92 tempest-TestAggregatesBasicOps-1272156563 tempest-TestAggregatesBasicOps-1272156563-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.508156 Oct 18 15:45:10.107152 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2245/4473] 10.222.0.60 () {60 vars in 1194 bytes} [Tue Oct 18 15:45:09 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:45:10.120630 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cb2bdb4d-f87c-46b9-b178-c27ac21a07f4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Unlocking {{(pid=120406) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 18 15:45:10.127774 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4503ce16-4120-44ca-ae21-74cb9c0f007c tempest-TestAggregatesBasicOps-1272156563 tempest-TestAggregatesBasicOps-1272156563-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:10.204467 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4503ce16-4120-44ca-ae21-74cb9c0f007c tempest-TestAggregatesBasicOps-1272156563 tempest-TestAggregatesBasicOps-1272156563-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.087168 Oct 18 15:45:10.209609 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2246/4474] 10.222.0.60 () {58 vars in 1155 bytes} [Tue Oct 18 15:45:10 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 15:45:10.303428 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cb2bdb4d-f87c-46b9-b178-c27ac21a07f4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "POST /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8/action" status: 202 len: 0 microversion: 2.1 time: 0.345900 Oct 18 15:45:10.305006 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2229/4475] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:45:09 2022] POST /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8/action => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:45:10.313845 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-df1b3832-56b9-48d0-a655-d68b2d856634 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:45:10.328583 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-df1b3832-56b9-48d0-a655-d68b2d856634 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:10.329259 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-df1b3832-56b9-48d0-a655-d68b2d856634 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:10.332002 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-df1b3832-56b9-48d0-a655-d68b2d856634 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:10.436835 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-df1b3832-56b9-48d0-a655-d68b2d856634 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Going to try to stop instance {{(pid=120405) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 18 15:45:10.445160 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3e5a7819-385d-4968-9051-6d14beb026dd tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:10.452304 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3e5a7819-385d-4968-9051-6d14beb026dd tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 50e19888-f65b-4eaa-8a40-47733d990b8e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:10.466704 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=7 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:10.487061 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e5a7819-385d-4968-9051-6d14beb026dd tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:10.489570 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e5a7819-385d-4968-9051-6d14beb026dd tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:10.490289 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e5a7819-385d-4968-9051-6d14beb026dd tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:10.500938 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e5a7819-385d-4968-9051-6d14beb026dd tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:10.502584 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e5a7819-385d-4968-9051-6d14beb026dd tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:10.503590 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e5a7819-385d-4968-9051-6d14beb026dd tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:10.614824 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-df1b3832-56b9-48d0-a655-d68b2d856634 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "POST /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8/action" status: 202 len: 0 microversion: 2.1 time: 0.306160 Oct 18 15:45:10.639596 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2247/4476] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:45:10 2022] POST /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8/action => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:45:10.672748 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4599b349-69a1-4665-94a4-c6b69ec8b08b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:10.686284 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4599b349-69a1-4665-94a4-c6b69ec8b08b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:10.732747 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4599b349-69a1-4665-94a4-c6b69ec8b08b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:10.733285 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4599b349-69a1-4665-94a4-c6b69ec8b08b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:10.733734 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4599b349-69a1-4665-94a4-c6b69ec8b08b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:10.734469 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4599b349-69a1-4665-94a4-c6b69ec8b08b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:10.734931 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4599b349-69a1-4665-94a4-c6b69ec8b08b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:10.735369 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4599b349-69a1-4665-94a4-c6b69ec8b08b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:13.098789 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3e5a7819-385d-4968-9051-6d14beb026dd tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:13.118522 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3e5a7819-385d-4968-9051-6d14beb026dd tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e" status: 200 len: 1317 microversion: 2.1 time: 2.686345 Oct 18 15:45:13.119627 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2230/4477] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:10 2022] GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e => generated 1317 bytes in 2690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:13.133426 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-65566d91-bbee-4b23-ba59-fcf62f96c62d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:13.135132 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-65566d91-bbee-4b23-ba59-fcf62f96c62d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:13.147351 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65566d91-bbee-4b23-ba59-fcf62f96c62d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:13.148066 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65566d91-bbee-4b23-ba59-fcf62f96c62d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:13.148517 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65566d91-bbee-4b23-ba59-fcf62f96c62d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:13.149458 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65566d91-bbee-4b23-ba59-fcf62f96c62d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:13.150022 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65566d91-bbee-4b23-ba59-fcf62f96c62d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:13.150471 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65566d91-bbee-4b23-ba59-fcf62f96c62d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:13.467343 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4599b349-69a1-4665-94a4-c6b69ec8b08b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:13.478839 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4599b349-69a1-4665-94a4-c6b69ec8b08b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1681 microversion: 2.1 time: 2.831955 Oct 18 15:45:13.482065 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2248/4478] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:10 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1681 bytes in 2838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:13.494177 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-24f1ac41-2b21-4995-8019-0432cab042bd req-453271ea-7675-4d9a-a0e1-42b5b7a16325 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50e19888-f65b-4eaa-8a40-47733d990b8e", "tag": "e9e62ab9-78c2-4cf9-a44c-7b0b834cfaf3"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:45:13.525663 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-24f1ac41-2b21-4995-8019-0432cab042bd req-453271ea-7675-4d9a-a0e1-42b5b7a16325 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:13.529447 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-24f1ac41-2b21-4995-8019-0432cab042bd req-453271ea-7675-4d9a-a0e1-42b5b7a16325 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:13.529900 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-24f1ac41-2b21-4995-8019-0432cab042bd req-453271ea-7675-4d9a-a0e1-42b5b7a16325 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:13.556732 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-24f1ac41-2b21-4995-8019-0432cab042bd req-453271ea-7675-4d9a-a0e1-42b5b7a16325 service nova] Creating event network-changed:e9e62ab9-78c2-4cf9-a44c-7b0b834cfaf3 for instance 50e19888-f65b-4eaa-8a40-47733d990b8e on n-h2-853682-5 Oct 18 15:45:13.569402 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-24f1ac41-2b21-4995-8019-0432cab042bd req-453271ea-7675-4d9a-a0e1-42b5b7a16325 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085766 Oct 18 15:45:13.575327 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2249/4479] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:45:13.581536 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-aa374857-c40a-4f49-b441-af9443f2825b tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:13.586936 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-aa374857-c40a-4f49-b441-af9443f2825b tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 52d725f3-b4da-4831-9abf-bf7aba8aee0a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:13.606859 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aa374857-c40a-4f49-b441-af9443f2825b tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:13.622493 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aa374857-c40a-4f49-b441-af9443f2825b tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:13.624001 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aa374857-c40a-4f49-b441-af9443f2825b tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:13.624964 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aa374857-c40a-4f49-b441-af9443f2825b tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:13.625587 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aa374857-c40a-4f49-b441-af9443f2825b tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:13.626852 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aa374857-c40a-4f49-b441-af9443f2825b tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:13.661305 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-aa374857-c40a-4f49-b441-af9443f2825b tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] HTTP exception thrown: Instance 52d725f3-b4da-4831-9abf-bf7aba8aee0a could not be found. Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-aa374857-c40a-4f49-b441-af9443f2825b tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Request method failure captured: Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: request: DELETE /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a HTTP/1.1 Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsfyIMGIKagHv42ZclZ4vV2nv2V6nMSERSYUm2Mguo48uB1D-ahUCWeUqiHW9JgJsyPUV5imS5Kzt6x9jVdiWnieLXTUxS42GPIQC9hxY0ofBX9DPB_tJyBl5NRSQZ-hKgea7JbasC3ojhutPkE2I4dYri-1lJplB76bieoISb7z3CE Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 5cdc7504a1d1424ea34f83f1a6d4bf71 Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-AttachVolumeTestJSON-1787080058 Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5cdc7504a1d1424ea34f83f1a6d4bf71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5cdc7504a1d1424ea34f83f1a6d4bf71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5cdc7504a1d1424ea34f83f1a6d4bf71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5cdc7504a1d1424ea34f83f1a6d4bf71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-AttachVolumeTestJSON-1787080058 Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 5cdc7504a1d1424ea34f83f1a6d4bf71 Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1787080058 Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-AttachVolumeTestJSON-1787080058-project Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 304b3248f9db4629943a8b8080a6d22e Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-AttachVolumeTestJSON-1787080058-project Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 52d725f3-b4da-4831-9abf-bf7aba8aee0a could not be found. Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '52d725f3-b4da-4831-9abf-bf7aba8aee0a'} Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52d725f3-b4da-4831-9abf-bf7aba8aee0a could not be found. Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:45:13.670663 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:45:13.675225 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52d725f3-b4da-4831-9abf-bf7aba8aee0a could not be found. Oct 18 15:45:13.675225 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:45:13.675225 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:45:13.675225 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:45:13.675225 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:45:13.675225 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:45:13.675225 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:45:13.675225 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:45:13.675225 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:45:13.675225 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52d725f3-b4da-4831-9abf-bf7aba8aee0a could not be found. Oct 18 15:45:13.675225 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:45:13.677191 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-aa374857-c40a-4f49-b441-af9443f2825b tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Returning 404 to user: Instance 52d725f3-b4da-4831-9abf-bf7aba8aee0a could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:45:13.678386 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-aa374857-c40a-4f49-b441-af9443f2825b tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "DELETE /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a" status: 404 len: 111 microversion: 2.1 time: 0.101118 Oct 18 15:45:13.679124 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2250/4480] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:45:13 2022] DELETE /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:45:13.689177 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6aa5029f-a291-40cc-8d81-d5496714dfdd tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-230657065", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2d5f3fc6-85c5-4721-8b46-c2233a05f92e"}], "security_groups": [{"name": "tempest-securitygroup--980708567"}], "key_name": "tempest-keypair-1611082033", "user_data": "}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:45:14.250962 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-65566d91-bbee-4b23-ba59-fcf62f96c62d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:14.263628 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-65566d91-bbee-4b23-ba59-fcf62f96c62d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1529 microversion: 2.1 time: 1.142917 Oct 18 15:45:14.272934 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2231/4481] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:13 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1529 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:14.283654 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e6445ad4-d3b7-46d2-bc52-fd22de62606a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:14.284667 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e6445ad4-d3b7-46d2-bc52-fd22de62606a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] [instance: 52d725f3-b4da-4831-9abf-bf7aba8aee0a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:14.292667 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6445ad4-d3b7-46d2-bc52-fd22de62606a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:14.293932 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6445ad4-d3b7-46d2-bc52-fd22de62606a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:14.294878 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6445ad4-d3b7-46d2-bc52-fd22de62606a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:14.295834 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6445ad4-d3b7-46d2-bc52-fd22de62606a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:14.296722 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6445ad4-d3b7-46d2-bc52-fd22de62606a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:14.297408 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6445ad4-d3b7-46d2-bc52-fd22de62606a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:14.326035 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-e6445ad4-d3b7-46d2-bc52-fd22de62606a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] HTTP exception thrown: Instance 52d725f3-b4da-4831-9abf-bf7aba8aee0a could not be found. Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e6445ad4-d3b7-46d2-bc52-fd22de62606a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Request method failure captured: Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a HTTP/1.1 Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsfyIMGIKagHv42ZclZ4vV2nv2V6nMSERSYUm2Mguo48uB1D-ahUCWeUqiHW9JgJsyPUV5imS5Kzt6x9jVdiWnieLXTUxS42GPIQC9hxY0ofBX9DPB_tJyBl5NRSQZ-hKgea7JbasC3ojhutPkE2I4dYri-1lJplB76bieoISb7z3CE Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 5cdc7504a1d1424ea34f83f1a6d4bf71 Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-AttachVolumeTestJSON-1787080058 Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5cdc7504a1d1424ea34f83f1a6d4bf71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5cdc7504a1d1424ea34f83f1a6d4bf71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5cdc7504a1d1424ea34f83f1a6d4bf71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5cdc7504a1d1424ea34f83f1a6d4bf71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-AttachVolumeTestJSON-1787080058 Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 5cdc7504a1d1424ea34f83f1a6d4bf71 Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1787080058 Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-AttachVolumeTestJSON-1787080058-project Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 304b3248f9db4629943a8b8080a6d22e Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-AttachVolumeTestJSON-1787080058-project Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 52d725f3-b4da-4831-9abf-bf7aba8aee0a could not be found. Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '52d725f3-b4da-4831-9abf-bf7aba8aee0a'} Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52d725f3-b4da-4831-9abf-bf7aba8aee0a could not be found. Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52d725f3-b4da-4831-9abf-bf7aba8aee0a could not be found. Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:45:14.328448 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:45:14.332228 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:45:14.332228 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:45:14.332228 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:45:14.332228 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:45:14.332228 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:45:14.332228 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52d725f3-b4da-4831-9abf-bf7aba8aee0a could not be found. Oct 18 15:45:14.332228 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:45:14.337938 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e6445ad4-d3b7-46d2-bc52-fd22de62606a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] Returning 404 to user: Instance 52d725f3-b4da-4831-9abf-bf7aba8aee0a could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:45:14.339057 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e6445ad4-d3b7-46d2-bc52-fd22de62606a tempest-AttachVolumeTestJSON-1787080058 tempest-AttachVolumeTestJSON-1787080058-project] 10.222.0.60 "GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a" status: 404 len: 111 microversion: 2.1 time: 0.064777 Oct 18 15:45:14.340763 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2232/4482] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:14 2022] GET /compute/v2.1/servers/52d725f3-b4da-4831-9abf-bf7aba8aee0a => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:45:14.347004 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-140820c5-98da-4cf2-bd59-e8768cb5da07 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:14.348054 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-140820c5-98da-4cf2-bd59-e8768cb5da07 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 50e19888-f65b-4eaa-8a40-47733d990b8e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:14.356958 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-140820c5-98da-4cf2-bd59-e8768cb5da07 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:14.357872 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-140820c5-98da-4cf2-bd59-e8768cb5da07 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:14.358536 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-140820c5-98da-4cf2-bd59-e8768cb5da07 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:14.359482 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-140820c5-98da-4cf2-bd59-e8768cb5da07 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:14.360193 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-140820c5-98da-4cf2-bd59-e8768cb5da07 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:14.360877 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-140820c5-98da-4cf2-bd59-e8768cb5da07 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:14.481424 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:14.595754 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-6aa5029f-a291-40cc-8d81-d5496714dfdd tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] validate_networks() for [('2d5f3fc6-85c5-4721-8b46-c2233a05f92e', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:45:15.959193 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-140820c5-98da-4cf2-bd59-e8768cb5da07 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:15.969587 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-140820c5-98da-4cf2-bd59-e8768cb5da07 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e" status: 200 len: 1317 microversion: 2.1 time: 1.627308 Oct 18 15:45:15.970145 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2233/4483] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:14 2022] GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e => generated 1317 bytes in 1628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:15.987607 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1d32273b-a23b-4672-8d73-8ad64090ef25 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:15.988525 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1d32273b-a23b-4672-8d73-8ad64090ef25 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:15.998201 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d32273b-a23b-4672-8d73-8ad64090ef25 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:16.005664 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d32273b-a23b-4672-8d73-8ad64090ef25 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:16.006293 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d32273b-a23b-4672-8d73-8ad64090ef25 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:16.007197 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d32273b-a23b-4672-8d73-8ad64090ef25 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:16.007817 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d32273b-a23b-4672-8d73-8ad64090ef25 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:16.008430 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d32273b-a23b-4672-8d73-8ad64090ef25 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:16.905540 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1d32273b-a23b-4672-8d73-8ad64090ef25 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:16.918375 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1d32273b-a23b-4672-8d73-8ad64090ef25 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1681 microversion: 2.1 time: 0.946875 Oct 18 15:45:16.929341 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2234/4484] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:15 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1681 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:16.939762 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2d83a8f9-8024-4b3b-a6c4-e3b6a260237e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:16.940393 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2d83a8f9-8024-4b3b-a6c4-e3b6a260237e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:16.961449 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d83a8f9-8024-4b3b-a6c4-e3b6a260237e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:16.962119 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d83a8f9-8024-4b3b-a6c4-e3b6a260237e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:16.975647 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d83a8f9-8024-4b3b-a6c4-e3b6a260237e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:16.978202 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d83a8f9-8024-4b3b-a6c4-e3b6a260237e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:16.978998 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d83a8f9-8024-4b3b-a6c4-e3b6a260237e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:16.985492 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d83a8f9-8024-4b3b-a6c4-e3b6a260237e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:17.554283 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=4 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:18.692970 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-6aa5029f-a291-40cc-8d81-d5496714dfdd tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:45:18.694155 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-6aa5029f-a291-40cc-8d81-d5496714dfdd tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:45:18.695039 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-6aa5029f-a291-40cc-8d81-d5496714dfdd tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:45:18.695919 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-6aa5029f-a291-40cc-8d81-d5496714dfdd tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:45:18.696508 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-6aa5029f-a291-40cc-8d81-d5496714dfdd tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:45:18.707129 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6aa5029f-a291-40cc-8d81-d5496714dfdd tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:18.707884 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6aa5029f-a291-40cc-8d81-d5496714dfdd tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:18.708489 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6aa5029f-a291-40cc-8d81-d5496714dfdd tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:18.709443 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6aa5029f-a291-40cc-8d81-d5496714dfdd tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:18.710082 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6aa5029f-a291-40cc-8d81-d5496714dfdd tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:18.710698 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6aa5029f-a291-40cc-8d81-d5496714dfdd tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:18.730730 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=2,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:18.743212 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-6aa5029f-a291-40cc-8d81-d5496714dfdd tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Getting quotas for project 224ca1f734c14bc8bf31e1826faf8e71. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:45:18.753963 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-6aa5029f-a291-40cc-8d81-d5496714dfdd tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Getting quotas for user 646fb4652c164c1dab5672d33d9fb295 and project 224ca1f734c14bc8bf31e1826faf8e71. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:45:18.779721 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6aa5029f-a291-40cc-8d81-d5496714dfdd tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:45:18.787962 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6aa5029f-a291-40cc-8d81-d5496714dfdd tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 5e83c779-c8f8-4ebd-84ab-7f144ab8552a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:45:18.886064 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6aa5029f-a291-40cc-8d81-d5496714dfdd tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 5.205675 Oct 18 15:45:18.888251 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2251/4485] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:45:13 2022] POST /compute/v2.1/servers => generated 408 bytes in 5208 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:45:18.900802 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c63c44cb-7413-474e-a6b2-71537bda71ca tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:18.901774 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c63c44cb-7413-474e-a6b2-71537bda71ca tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 50e19888-f65b-4eaa-8a40-47733d990b8e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:18.916444 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c63c44cb-7413-474e-a6b2-71537bda71ca tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:18.917333 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c63c44cb-7413-474e-a6b2-71537bda71ca tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:18.918022 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c63c44cb-7413-474e-a6b2-71537bda71ca tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:18.923609 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c63c44cb-7413-474e-a6b2-71537bda71ca tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:18.924316 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c63c44cb-7413-474e-a6b2-71537bda71ca tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:18.925307 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c63c44cb-7413-474e-a6b2-71537bda71ca tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:18.984068 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:19.332236 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2d83a8f9-8024-4b3b-a6c4-e3b6a260237e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:19.344770 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2d83a8f9-8024-4b3b-a6c4-e3b6a260237e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1529 microversion: 2.1 time: 2.416323 Oct 18 15:45:19.348413 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2235/4486] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:16 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1529 bytes in 2422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:19.372255 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fd761e2c-a9cc-4da0-a415-cdaf590c61d3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:19.374638 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fd761e2c-a9cc-4da0-a415-cdaf590c61d3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:19.391285 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd761e2c-a9cc-4da0-a415-cdaf590c61d3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:19.392377 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd761e2c-a9cc-4da0-a415-cdaf590c61d3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:19.393080 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd761e2c-a9cc-4da0-a415-cdaf590c61d3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:19.395104 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd761e2c-a9cc-4da0-a415-cdaf590c61d3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:19.399630 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd761e2c-a9cc-4da0-a415-cdaf590c61d3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:19.400322 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd761e2c-a9cc-4da0-a415-cdaf590c61d3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:19.681056 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c63c44cb-7413-474e-a6b2-71537bda71ca tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:19.724590 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c63c44cb-7413-474e-a6b2-71537bda71ca tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e" status: 200 len: 1317 microversion: 2.1 time: 0.829019 Oct 18 15:45:19.728155 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2252/4487] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:18 2022] GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e => generated 1317 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:19.748389 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-72853822-e07c-43d7-b650-5fadfa84a103 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:19.752064 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-72853822-e07c-43d7-b650-5fadfa84a103 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 5e83c779-c8f8-4ebd-84ab-7f144ab8552a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:19.829962 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fd761e2c-a9cc-4da0-a415-cdaf590c61d3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:19.839095 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fd761e2c-a9cc-4da0-a415-cdaf590c61d3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1681 microversion: 2.1 time: 0.487580 Oct 18 15:45:19.846429 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2236/4488] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:19 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1681 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:20.031279 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-72853822-e07c-43d7-b650-5fadfa84a103 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:20.083726 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-72853822-e07c-43d7-b650-5fadfa84a103 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a" status: 200 len: 1245 microversion: 2.1 time: 0.346256 Oct 18 15:45:20.086463 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2253/4489] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:19 2022] GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a => generated 1245 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:20.379982 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-57f393a4-310d-4aa7-9dd6-0d094bba450e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:20.380764 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-57f393a4-310d-4aa7-9dd6-0d094bba450e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:20.409728 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57f393a4-310d-4aa7-9dd6-0d094bba450e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:20.410219 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57f393a4-310d-4aa7-9dd6-0d094bba450e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:20.421769 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57f393a4-310d-4aa7-9dd6-0d094bba450e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:20.423559 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57f393a4-310d-4aa7-9dd6-0d094bba450e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:20.429480 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57f393a4-310d-4aa7-9dd6-0d094bba450e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:20.430161 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57f393a4-310d-4aa7-9dd6-0d094bba450e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:20.794198 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c9caa59e-5aea-41dd-9fe3-530471c97afa tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:20.800088 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c9caa59e-5aea-41dd-9fe3-530471c97afa tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 50e19888-f65b-4eaa-8a40-47733d990b8e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:20.846970 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c9caa59e-5aea-41dd-9fe3-530471c97afa tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:20.848594 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c9caa59e-5aea-41dd-9fe3-530471c97afa tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:20.850267 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c9caa59e-5aea-41dd-9fe3-530471c97afa tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:20.852631 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c9caa59e-5aea-41dd-9fe3-530471c97afa tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:20.856833 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c9caa59e-5aea-41dd-9fe3-530471c97afa tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:20.858386 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c9caa59e-5aea-41dd-9fe3-530471c97afa tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:22.032065 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-57f393a4-310d-4aa7-9dd6-0d094bba450e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:22.053119 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-57f393a4-310d-4aa7-9dd6-0d094bba450e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1529 microversion: 2.1 time: 1.679854 Oct 18 15:45:22.054260 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2237/4490] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:20 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1529 bytes in 1687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:22.066062 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c9caa59e-5aea-41dd-9fe3-530471c97afa tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:22.068009 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c0521f34-99ad-4407-b123-f048d62215fb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:22.069602 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c0521f34-99ad-4407-b123-f048d62215fb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:22.080334 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c9caa59e-5aea-41dd-9fe3-530471c97afa tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e" status: 200 len: 1317 microversion: 2.1 time: 1.304752 Oct 18 15:45:22.080973 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2254/4491] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:20 2022] GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e => generated 1317 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:22.094283 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0521f34-99ad-4407-b123-f048d62215fb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:22.096742 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0521f34-99ad-4407-b123-f048d62215fb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:22.098599 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0521f34-99ad-4407-b123-f048d62215fb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:22.103069 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0521f34-99ad-4407-b123-f048d62215fb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:22.103905 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0521f34-99ad-4407-b123-f048d62215fb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:22.105000 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0521f34-99ad-4407-b123-f048d62215fb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:22.105645 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6668ee6b-0cdb-431c-9cdd-ee341612c321 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:22.106301 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6668ee6b-0cdb-431c-9cdd-ee341612c321 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 5e83c779-c8f8-4ebd-84ab-7f144ab8552a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:22.157066 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6668ee6b-0cdb-431c-9cdd-ee341612c321 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:22.157860 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6668ee6b-0cdb-431c-9cdd-ee341612c321 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:22.158512 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6668ee6b-0cdb-431c-9cdd-ee341612c321 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:22.161091 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6668ee6b-0cdb-431c-9cdd-ee341612c321 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:22.161743 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6668ee6b-0cdb-431c-9cdd-ee341612c321 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:22.162408 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6668ee6b-0cdb-431c-9cdd-ee341612c321 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:22.600062 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6668ee6b-0cdb-431c-9cdd-ee341612c321 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:22.615982 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6668ee6b-0cdb-431c-9cdd-ee341612c321 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a" status: 200 len: 1315 microversion: 2.1 time: 0.527323 Oct 18 15:45:22.620299 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2255/4492] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:22 2022] GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a => generated 1315 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:22.941220 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c0521f34-99ad-4407-b123-f048d62215fb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:22.997828 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c0521f34-99ad-4407-b123-f048d62215fb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1658 microversion: 2.1 time: 0.941298 Oct 18 15:45:22.998724 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2238/4493] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:22 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1658 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:23.023302 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f07a7681-cf43-484f-a9b2-f3966f15fed3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:45:23.042190 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f07a7681-cf43-484f-a9b2-f3966f15fed3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:23.047102 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f07a7681-cf43-484f-a9b2-f3966f15fed3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:23.047680 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f07a7681-cf43-484f-a9b2-f3966f15fed3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:23.085600 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9d4f6212-c112-4016-85d3-22b7b8dfecc8 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:23.086326 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9d4f6212-c112-4016-85d3-22b7b8dfecc8 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:23.104951 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d4f6212-c112-4016-85d3-22b7b8dfecc8 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:23.108475 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d4f6212-c112-4016-85d3-22b7b8dfecc8 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:23.116756 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d4f6212-c112-4016-85d3-22b7b8dfecc8 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:23.119866 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d4f6212-c112-4016-85d3-22b7b8dfecc8 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:23.122270 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d4f6212-c112-4016-85d3-22b7b8dfecc8 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:23.125151 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d4f6212-c112-4016-85d3-22b7b8dfecc8 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:23.177512 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f07a7681-cf43-484f-a9b2-f3966f15fed3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Going to try to start instance {{(pid=120405) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 18 15:45:23.303444 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f07a7681-cf43-484f-a9b2-f3966f15fed3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "POST /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8/action" status: 202 len: 0 microversion: 2.1 time: 0.281922 Oct 18 15:45:23.306845 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2256/4494] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:45:23 2022] POST /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:45:23.323334 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d4b29621-eb0f-424c-938a-e498b35149bb tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:23.328970 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d4b29621-eb0f-424c-938a-e498b35149bb tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 50e19888-f65b-4eaa-8a40-47733d990b8e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:23.348013 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4b29621-eb0f-424c-938a-e498b35149bb tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:23.351872 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4b29621-eb0f-424c-938a-e498b35149bb tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:23.351872 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4b29621-eb0f-424c-938a-e498b35149bb tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:23.356718 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4b29621-eb0f-424c-938a-e498b35149bb tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:23.357668 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4b29621-eb0f-424c-938a-e498b35149bb tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:23.358247 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4b29621-eb0f-424c-938a-e498b35149bb tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:24.364714 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9d4f6212-c112-4016-85d3-22b7b8dfecc8 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:24.374301 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9d4f6212-c112-4016-85d3-22b7b8dfecc8 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1529 microversion: 2.1 time: 1.295970 Oct 18 15:45:24.378962 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2239/4495] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:23 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1529 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:24.529049 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d4b29621-eb0f-424c-938a-e498b35149bb tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:24.542898 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d4b29621-eb0f-424c-938a-e498b35149bb tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e" status: 200 len: 1317 microversion: 2.1 time: 1.227494 Oct 18 15:45:24.544054 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2257/4496] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:23 2022] GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e => generated 1317 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:24.554630 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-d3b1c7ab-66c9-4e03-8bba-d3438985e569 req-51fff079-6cd8-41dc-9c70-59af9de1ee20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50e19888-f65b-4eaa-8a40-47733d990b8e", "name": "network-vif-plugged", "status": "completed", "tag": "e9e62ab9-78c2-4cf9-a44c-7b0b834cfaf3"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:45:24.580975 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-d3b1c7ab-66c9-4e03-8bba-d3438985e569 req-51fff079-6cd8-41dc-9c70-59af9de1ee20 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:24.581470 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-d3b1c7ab-66c9-4e03-8bba-d3438985e569 req-51fff079-6cd8-41dc-9c70-59af9de1ee20 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:24.581888 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-d3b1c7ab-66c9-4e03-8bba-d3438985e569 req-51fff079-6cd8-41dc-9c70-59af9de1ee20 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:24.617537 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-d3b1c7ab-66c9-4e03-8bba-d3438985e569 req-51fff079-6cd8-41dc-9c70-59af9de1ee20 service nova] Creating event network-vif-plugged:e9e62ab9-78c2-4cf9-a44c-7b0b834cfaf3 for instance 50e19888-f65b-4eaa-8a40-47733d990b8e on n-h2-853682-5 Oct 18 15:45:24.631119 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-d3b1c7ab-66c9-4e03-8bba-d3438985e569 req-51fff079-6cd8-41dc-9c70-59af9de1ee20 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085657 Oct 18 15:45:24.631749 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2258/4497] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:45:24.642800 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e43923b5-7c8d-47b1-af6b-d360edef1f89 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:24.643051 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e43923b5-7c8d-47b1-af6b-d360edef1f89 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 5e83c779-c8f8-4ebd-84ab-7f144ab8552a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:24.662587 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e43923b5-7c8d-47b1-af6b-d360edef1f89 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:24.663081 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e43923b5-7c8d-47b1-af6b-d360edef1f89 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:24.663521 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e43923b5-7c8d-47b1-af6b-d360edef1f89 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:24.664299 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e43923b5-7c8d-47b1-af6b-d360edef1f89 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:24.664681 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e43923b5-7c8d-47b1-af6b-d360edef1f89 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:24.665155 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e43923b5-7c8d-47b1-af6b-d360edef1f89 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:24.673771 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2a8431cd-3764-4f1c-9396-e1febe7bdbab tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:24.674710 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2a8431cd-3764-4f1c-9396-e1febe7bdbab tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:24.688412 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a8431cd-3764-4f1c-9396-e1febe7bdbab tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:24.689991 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a8431cd-3764-4f1c-9396-e1febe7bdbab tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:24.690689 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a8431cd-3764-4f1c-9396-e1febe7bdbab tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:24.691656 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a8431cd-3764-4f1c-9396-e1febe7bdbab tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:24.693320 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a8431cd-3764-4f1c-9396-e1febe7bdbab tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:24.695991 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a8431cd-3764-4f1c-9396-e1febe7bdbab tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:24.985248 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e43923b5-7c8d-47b1-af6b-d360edef1f89 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:24.994345 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e43923b5-7c8d-47b1-af6b-d360edef1f89 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a" status: 200 len: 1303 microversion: 2.1 time: 0.361391 Oct 18 15:45:25.009177 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2259/4498] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:24 2022] GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a => generated 1303 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:25.097054 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2a8431cd-3764-4f1c-9396-e1febe7bdbab tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:25.105225 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2a8431cd-3764-4f1c-9396-e1febe7bdbab tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1667 microversion: 2.1 time: 0.724815 Oct 18 15:45:25.115878 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2240/4499] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:24 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1667 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:25.405120 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-86a0a1eb-b4a2-4f2f-9ef7-ff0f3e4cd378 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:25.407156 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a351273b-a267-46a0-861b-b29209c59b5c tempest-VolumesSnapshotsTestJSON-1284785160 tempest-VolumesSnapshotsTestJSON-1284785160-project] Action: 'create', calling method: .version_select at 0x7f7c3d15c280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1953954593"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:45:25.408148 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-86a0a1eb-b4a2-4f2f-9ef7-ff0f3e4cd378 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:25.430061 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86a0a1eb-b4a2-4f2f-9ef7-ff0f3e4cd378 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:25.430768 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86a0a1eb-b4a2-4f2f-9ef7-ff0f3e4cd378 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:25.432671 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86a0a1eb-b4a2-4f2f-9ef7-ff0f3e4cd378 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:25.434258 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86a0a1eb-b4a2-4f2f-9ef7-ff0f3e4cd378 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:25.436288 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86a0a1eb-b4a2-4f2f-9ef7-ff0f3e4cd378 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:25.437828 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86a0a1eb-b4a2-4f2f-9ef7-ff0f3e4cd378 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:25.929908 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-86a0a1eb-b4a2-4f2f-9ef7-ff0f3e4cd378 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:25.941899 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-86a0a1eb-b4a2-4f2f-9ef7-ff0f3e4cd378 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1529 microversion: 2.1 time: 0.541117 Oct 18 15:45:25.944621 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2241/4500] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:25 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1529 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:25.958502 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-57b293f5-e60d-4b8e-b61f-a7a041085f0d tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:25.959295 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-57b293f5-e60d-4b8e-b61f-a7a041085f0d tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 50e19888-f65b-4eaa-8a40-47733d990b8e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:25.982519 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57b293f5-e60d-4b8e-b61f-a7a041085f0d tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:25.986528 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57b293f5-e60d-4b8e-b61f-a7a041085f0d tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:25.989697 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57b293f5-e60d-4b8e-b61f-a7a041085f0d tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:25.999418 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57b293f5-e60d-4b8e-b61f-a7a041085f0d tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:26.000563 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57b293f5-e60d-4b8e-b61f-a7a041085f0d tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:26.005150 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57b293f5-e60d-4b8e-b61f-a7a041085f0d tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:26.495512 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a351273b-a267-46a0-861b-b29209c59b5c tempest-VolumesSnapshotsTestJSON-1284785160 tempest-VolumesSnapshotsTestJSON-1284785160-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.484693 Oct 18 15:45:26.497986 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2260/4501] 10.222.0.60 () {60 vars in 1155 bytes} [Tue Oct 18 15:45:25 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1488 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 18 15:45:26.504047 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-84db373f-82f0-4955-b3db-71da18adc5c7 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:26.505102 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-84db373f-82f0-4955-b3db-71da18adc5c7 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 5e83c779-c8f8-4ebd-84ab-7f144ab8552a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:26.540036 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-84db373f-82f0-4955-b3db-71da18adc5c7 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:26.542134 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-84db373f-82f0-4955-b3db-71da18adc5c7 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:26.548465 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-84db373f-82f0-4955-b3db-71da18adc5c7 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:26.551727 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-84db373f-82f0-4955-b3db-71da18adc5c7 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:26.555669 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-84db373f-82f0-4955-b3db-71da18adc5c7 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:26.558740 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-84db373f-82f0-4955-b3db-71da18adc5c7 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:27.222442 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-57b293f5-e60d-4b8e-b61f-a7a041085f0d tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:27.231953 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-57b293f5-e60d-4b8e-b61f-a7a041085f0d tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e" status: 200 len: 1317 microversion: 2.1 time: 1.286036 Oct 18 15:45:27.236562 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2242/4502] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:25 2022] GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e => generated 1317 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:27.252764 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8925606a-6428-4f2d-ba67-4fefc421e163 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:27.254924 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8925606a-6428-4f2d-ba67-4fefc421e163 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:27.264041 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8925606a-6428-4f2d-ba67-4fefc421e163 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:27.264852 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8925606a-6428-4f2d-ba67-4fefc421e163 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:27.265459 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8925606a-6428-4f2d-ba67-4fefc421e163 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:27.266420 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8925606a-6428-4f2d-ba67-4fefc421e163 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:27.267059 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8925606a-6428-4f2d-ba67-4fefc421e163 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:27.267797 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8925606a-6428-4f2d-ba67-4fefc421e163 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:28.035648 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-84db373f-82f0-4955-b3db-71da18adc5c7 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:28.058454 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-84db373f-82f0-4955-b3db-71da18adc5c7 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a" status: 200 len: 1370 microversion: 2.1 time: 1.558949 Oct 18 15:45:28.061948 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2261/4503] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:26 2022] GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a => generated 1370 bytes in 1563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:28.087183 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1325a908-0f2f-4d7d-9d19-eabc14c8684f tempest-VolumesSnapshotsTestJSON-1284785160 tempest-VolumesSnapshotsTestJSON-1284785160-project] Calling method '.version_select at 0x7f7c3dfd8790>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:28.234449 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1325a908-0f2f-4d7d-9d19-eabc14c8684f tempest-VolumesSnapshotsTestJSON-1284785160 tempest-VolumesSnapshotsTestJSON-1284785160-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/c81cc4e5-4fcc-46ca-83bd-cf02ff0a248c" status: 200 len: 345 microversion: 2.1 time: 0.171293 Oct 18 15:45:28.235033 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2262/4504] 10.222.0.60 () {58 vars in 1245 bytes} [Tue Oct 18 15:45:28 2022] GET /compute/v2.1/os-volumes/c81cc4e5-4fcc-46ca-83bd-cf02ff0a248c => generated 345 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:45:28.240013 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d6d1014b-781c-415c-952d-694dd49afa58 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:28.240799 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d6d1014b-781c-415c-952d-694dd49afa58 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:28.284959 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d6d1014b-781c-415c-952d-694dd49afa58 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:28.286470 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d6d1014b-781c-415c-952d-694dd49afa58 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:28.287119 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d6d1014b-781c-415c-952d-694dd49afa58 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:28.289985 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d6d1014b-781c-415c-952d-694dd49afa58 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:28.292335 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d6d1014b-781c-415c-952d-694dd49afa58 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:28.293576 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d6d1014b-781c-415c-952d-694dd49afa58 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:28.301933 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8925606a-6428-4f2d-ba67-4fefc421e163 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:28.333031 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8925606a-6428-4f2d-ba67-4fefc421e163 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1667 microversion: 2.1 time: 1.094774 Oct 18 15:45:28.338140 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2243/4505] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:27 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1667 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:28.359672 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5e2cb3c4-ee4a-4799-b183-dd483a359698 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:28.364702 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5e2cb3c4-ee4a-4799-b183-dd483a359698 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 50e19888-f65b-4eaa-8a40-47733d990b8e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:28.400238 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e2cb3c4-ee4a-4799-b183-dd483a359698 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:28.404536 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e2cb3c4-ee4a-4799-b183-dd483a359698 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:28.405251 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e2cb3c4-ee4a-4799-b183-dd483a359698 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:28.408711 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e2cb3c4-ee4a-4799-b183-dd483a359698 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:28.410825 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e2cb3c4-ee4a-4799-b183-dd483a359698 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:28.412554 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e2cb3c4-ee4a-4799-b183-dd483a359698 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:28.487705 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:28.733580 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:29.011716 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5e2cb3c4-ee4a-4799-b183-dd483a359698 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:29.023332 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5e2cb3c4-ee4a-4799-b183-dd483a359698 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e" status: 200 len: 1506 microversion: 2.1 time: 0.683770 Oct 18 15:45:29.031705 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2244/4506] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:28 2022] GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e => generated 1506 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:29.056634 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-029275f7-761c-4fdc-af19-9b0778d0a36c tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:29.057549 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-029275f7-761c-4fdc-af19-9b0778d0a36c tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 50e19888-f65b-4eaa-8a40-47733d990b8e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:29.076242 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-029275f7-761c-4fdc-af19-9b0778d0a36c tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:29.077000 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-029275f7-761c-4fdc-af19-9b0778d0a36c tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:29.077875 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-029275f7-761c-4fdc-af19-9b0778d0a36c tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:29.079544 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-029275f7-761c-4fdc-af19-9b0778d0a36c tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:29.080171 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-029275f7-761c-4fdc-af19-9b0778d0a36c tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:29.080969 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-029275f7-761c-4fdc-af19-9b0778d0a36c tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:29.226124 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d6d1014b-781c-415c-952d-694dd49afa58 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:29.235348 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d6d1014b-781c-415c-952d-694dd49afa58 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1529 microversion: 2.1 time: 0.998832 Oct 18 15:45:29.242242 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2263/4507] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:28 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1529 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:29.264078 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ecf4baea-3f05-42a2-a23c-208eec1fe49c tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:29.265855 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ecf4baea-3f05-42a2-a23c-208eec1fe49c tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 5e83c779-c8f8-4ebd-84ab-7f144ab8552a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:29.276055 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ecf4baea-3f05-42a2-a23c-208eec1fe49c tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:29.276559 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ecf4baea-3f05-42a2-a23c-208eec1fe49c tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:29.277161 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ecf4baea-3f05-42a2-a23c-208eec1fe49c tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:29.278341 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ecf4baea-3f05-42a2-a23c-208eec1fe49c tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:29.278810 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ecf4baea-3f05-42a2-a23c-208eec1fe49c tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:29.279251 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ecf4baea-3f05-42a2-a23c-208eec1fe49c tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:30.044544 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=8 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:30.110819 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-029275f7-761c-4fdc-af19-9b0778d0a36c tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:30.124292 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-029275f7-761c-4fdc-af19-9b0778d0a36c tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e" status: 200 len: 1506 microversion: 2.1 time: 1.070031 Oct 18 15:45:30.125734 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2245/4508] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:29 2022] GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e => generated 1506 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:30.132998 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4c36f1d6-28a1-41ee-960d-63a810add5eb tempest-VolumesSnapshotsTestJSON-1284785160 tempest-VolumesSnapshotsTestJSON-1284785160-project] Calling method '.version_select at 0x7f7c3c655dc0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:30.236713 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4c36f1d6-28a1-41ee-960d-63a810add5eb tempest-VolumesSnapshotsTestJSON-1284785160 tempest-VolumesSnapshotsTestJSON-1284785160-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/c81cc4e5-4fcc-46ca-83bd-cf02ff0a248c" status: 200 len: 346 microversion: 2.1 time: 0.109663 Oct 18 15:45:30.237443 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2246/4509] 10.222.0.60 () {58 vars in 1245 bytes} [Tue Oct 18 15:45:30 2022] GET /compute/v2.1/os-volumes/c81cc4e5-4fcc-46ca-83bd-cf02ff0a248c => generated 346 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:45:30.242148 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-532835d0-ae7a-4722-8eb0-5c3063bf00e7 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:30.243751 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-532835d0-ae7a-4722-8eb0-5c3063bf00e7 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:30.264958 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-532835d0-ae7a-4722-8eb0-5c3063bf00e7 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:30.266322 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-532835d0-ae7a-4722-8eb0-5c3063bf00e7 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:30.267597 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-532835d0-ae7a-4722-8eb0-5c3063bf00e7 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:30.270498 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-532835d0-ae7a-4722-8eb0-5c3063bf00e7 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:30.271286 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-532835d0-ae7a-4722-8eb0-5c3063bf00e7 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:30.273865 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-532835d0-ae7a-4722-8eb0-5c3063bf00e7 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:30.317175 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ecf4baea-3f05-42a2-a23c-208eec1fe49c tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:30.326430 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ecf4baea-3f05-42a2-a23c-208eec1fe49c tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a" status: 200 len: 1370 microversion: 2.1 time: 1.082852 Oct 18 15:45:30.339229 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2264/4510] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:29 2022] GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a => generated 1370 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:30.357503 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-488af9a8-c1dd-4964-b32c-b8725b398927 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "OS-DCF:diskConfig": "AUTO"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:45:30.363238 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-488af9a8-c1dd-4964-b32c-b8725b398927 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 50e19888-f65b-4eaa-8a40-47733d990b8e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:30.384236 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-488af9a8-c1dd-4964-b32c-b8725b398927 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:30.385032 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-488af9a8-c1dd-4964-b32c-b8725b398927 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:30.389472 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-488af9a8-c1dd-4964-b32c-b8725b398927 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:30.390583 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-488af9a8-c1dd-4964-b32c-b8725b398927 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:30.391176 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-488af9a8-c1dd-4964-b32c-b8725b398927 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:30.391741 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-488af9a8-c1dd-4964-b32c-b8725b398927 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:30.555755 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-488af9a8-c1dd-4964-b32c-b8725b398927 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:45:30.556491 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-488af9a8-c1dd-4964-b32c-b8725b398927 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:45:30.557278 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-488af9a8-c1dd-4964-b32c-b8725b398927 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:45:30.557856 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-488af9a8-c1dd-4964-b32c-b8725b398927 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:45:30.558475 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-488af9a8-c1dd-4964-b32c-b8725b398927 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:45:30.693637 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-488af9a8-c1dd-4964-b32c-b8725b398927 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 50e19888-f65b-4eaa-8a40-47733d990b8e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:30.715377 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-488af9a8-c1dd-4964-b32c-b8725b398927 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:30.716733 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-488af9a8-c1dd-4964-b32c-b8725b398927 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:30.717202 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-488af9a8-c1dd-4964-b32c-b8725b398927 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:30.717954 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-488af9a8-c1dd-4964-b32c-b8725b398927 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:30.718418 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-488af9a8-c1dd-4964-b32c-b8725b398927 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:30.718851 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-488af9a8-c1dd-4964-b32c-b8725b398927 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:30.789002 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-488af9a8-c1dd-4964-b32c-b8725b398927 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "POST /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e/action" status: 202 len: 1108 microversion: 2.1 time: 0.445962 Oct 18 15:45:30.790032 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2265/4511] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:45:30 2022] POST /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e/action => generated 1108 bytes in 450 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 18 15:45:30.803530 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-209bd1fb-7988-445a-bf20-481a788ec4ca tempest-VolumesSnapshotsTestJSON-1284785160 tempest-VolumesSnapshotsTestJSON-1284785160-project] Action: 'create', calling method: .version_select at 0x7f7c3c6105e0>, body: {"snapshot": {"volume_id": "c81cc4e5-4fcc-46ca-83bd-cf02ff0a248c", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1611079902"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:45:30.988858 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-532835d0-ae7a-4722-8eb0-5c3063bf00e7 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:31.022043 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-532835d0-ae7a-4722-8eb0-5c3063bf00e7 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1671 microversion: 2.1 time: 0.782960 Oct 18 15:45:31.044965 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2247/4512] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:30 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1671 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:31.071502 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6daa04b4-b5e0-4599-b6d7-3c1f0ca8718b tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:31.077057 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6daa04b4-b5e0-4599-b6d7-3c1f0ca8718b tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:31.112861 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6daa04b4-b5e0-4599-b6d7-3c1f0ca8718b tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:31.118733 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6daa04b4-b5e0-4599-b6d7-3c1f0ca8718b tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:31.119839 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6daa04b4-b5e0-4599-b6d7-3c1f0ca8718b tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:31.126512 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6daa04b4-b5e0-4599-b6d7-3c1f0ca8718b tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:31.132136 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6daa04b4-b5e0-4599-b6d7-3c1f0ca8718b tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:31.135980 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6daa04b4-b5e0-4599-b6d7-3c1f0ca8718b tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:31.459227 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-209bd1fb-7988-445a-bf20-481a788ec4ca tempest-VolumesSnapshotsTestJSON-1284785160 tempest-VolumesSnapshotsTestJSON-1284785160-project] 10.222.0.60 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.666675 Oct 18 15:45:31.460857 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2266/4513] 10.222.0.60 () {60 vars in 1162 bytes} [Tue Oct 18 15:45:30 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:45:31.479291 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6af83cba-cf21-4361-b567-f6c4cf3b2803 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:31.481305 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6af83cba-cf21-4361-b567-f6c4cf3b2803 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 50e19888-f65b-4eaa-8a40-47733d990b8e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:31.508381 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6af83cba-cf21-4361-b567-f6c4cf3b2803 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:31.510372 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6af83cba-cf21-4361-b567-f6c4cf3b2803 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:31.511049 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6af83cba-cf21-4361-b567-f6c4cf3b2803 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:31.515782 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6af83cba-cf21-4361-b567-f6c4cf3b2803 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:31.517439 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6af83cba-cf21-4361-b567-f6c4cf3b2803 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:31.518151 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6af83cba-cf21-4361-b567-f6c4cf3b2803 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:32.046683 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6daa04b4-b5e0-4599-b6d7-3c1f0ca8718b tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:32.069812 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6daa04b4-b5e0-4599-b6d7-3c1f0ca8718b tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1529 microversion: 2.1 time: 1.037097 Oct 18 15:45:32.070450 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2248/4514] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:31 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1529 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:32.125838 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2bf51451-6236-4252-a956-22d4f6d05388 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:32.126592 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2bf51451-6236-4252-a956-22d4f6d05388 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:32.165500 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2bf51451-6236-4252-a956-22d4f6d05388 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:32.166012 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2bf51451-6236-4252-a956-22d4f6d05388 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:32.177577 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2bf51451-6236-4252-a956-22d4f6d05388 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:32.178355 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2bf51451-6236-4252-a956-22d4f6d05388 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:32.178835 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2bf51451-6236-4252-a956-22d4f6d05388 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:32.179272 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2bf51451-6236-4252-a956-22d4f6d05388 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:32.727621 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6af83cba-cf21-4361-b567-f6c4cf3b2803 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:32.739811 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6af83cba-cf21-4361-b567-f6c4cf3b2803 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e" status: 200 len: 1513 microversion: 2.1 time: 1.277589 Oct 18 15:45:32.743535 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2267/4515] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:31 2022] GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e => generated 1513 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:32.772320 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-20c16ef9-c6a4-45c6-8f91-501f2199a304 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:32.782707 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-20c16ef9-c6a4-45c6-8f91-501f2199a304 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 5e83c779-c8f8-4ebd-84ab-7f144ab8552a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:32.802344 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-20c16ef9-c6a4-45c6-8f91-501f2199a304 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:32.812752 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-20c16ef9-c6a4-45c6-8f91-501f2199a304 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:32.815400 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-20c16ef9-c6a4-45c6-8f91-501f2199a304 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:32.816631 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-20c16ef9-c6a4-45c6-8f91-501f2199a304 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:32.818116 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-20c16ef9-c6a4-45c6-8f91-501f2199a304 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:32.818950 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-20c16ef9-c6a4-45c6-8f91-501f2199a304 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:33.320038 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2bf51451-6236-4252-a956-22d4f6d05388 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:33.328988 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2bf51451-6236-4252-a956-22d4f6d05388 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1671 microversion: 2.1 time: 1.257406 Oct 18 15:45:33.341753 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2249/4516] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:32 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1671 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:33.365536 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ec6a35d1-8558-42ea-ab8f-679700e08257 tempest-VolumesSnapshotsTestJSON-1284785160 tempest-VolumesSnapshotsTestJSON-1284785160-project] Calling method '.version_select at 0x7f7c3c4e2550>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:33.438659 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ec6a35d1-8558-42ea-ab8f-679700e08257 tempest-VolumesSnapshotsTestJSON-1284785160 tempest-VolumesSnapshotsTestJSON-1284785160-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/3e2a4adf-8919-4b81-83fd-0dc25a2b44b8" status: 200 len: 287 microversion: 2.1 time: 0.083969 Oct 18 15:45:33.439778 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2250/4517] 10.222.0.60 () {58 vars in 1251 bytes} [Tue Oct 18 15:45:33 2022] GET /compute/v2.1/os-snapshots/3e2a4adf-8919-4b81-83fd-0dc25a2b44b8 => generated 287 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:45:33.444982 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-aeb9d9a2-daa9-40ce-b6c5-6c0c3b903bb9 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:33.446149 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-aeb9d9a2-daa9-40ce-b6c5-6c0c3b903bb9 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:33.454251 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aeb9d9a2-daa9-40ce-b6c5-6c0c3b903bb9 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:33.458098 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aeb9d9a2-daa9-40ce-b6c5-6c0c3b903bb9 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:33.458745 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aeb9d9a2-daa9-40ce-b6c5-6c0c3b903bb9 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:33.459782 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aeb9d9a2-daa9-40ce-b6c5-6c0c3b903bb9 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:33.468630 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aeb9d9a2-daa9-40ce-b6c5-6c0c3b903bb9 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:33.469138 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aeb9d9a2-daa9-40ce-b6c5-6c0c3b903bb9 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:33.894552 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-20c16ef9-c6a4-45c6-8f91-501f2199a304 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:33.911992 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-20c16ef9-c6a4-45c6-8f91-501f2199a304 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a" status: 200 len: 1370 microversion: 2.1 time: 1.143443 Oct 18 15:45:33.922806 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2268/4518] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:32 2022] GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a => generated 1370 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:33.942134 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-06b44737-165e-4439-8e76-9228630d0e68 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:45:33.943384 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-06b44737-165e-4439-8e76-9228630d0e68 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:33.953093 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-06b44737-165e-4439-8e76-9228630d0e68 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:33.954096 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-06b44737-165e-4439-8e76-9228630d0e68 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:33.954927 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-06b44737-165e-4439-8e76-9228630d0e68 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:33.955949 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-06b44737-165e-4439-8e76-9228630d0e68 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:33.964327 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-06b44737-165e-4439-8e76-9228630d0e68 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:33.966225 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-06b44737-165e-4439-8e76-9228630d0e68 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:34.081822 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:34.092936 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-06b44737-165e-4439-8e76-9228630d0e68 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Unlocking {{(pid=120405) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 18 15:45:34.187517 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-06b44737-165e-4439-8e76-9228630d0e68 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "POST /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8/action" status: 202 len: 0 microversion: 2.1 time: 0.258985 Oct 18 15:45:34.189290 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2269/4519] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:45:33 2022] POST /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:45:34.200309 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6bd1f263-40b7-4aa3-b053-8d88bdb9c02e tempest-VolumesSnapshotsTestJSON-1284785160 tempest-VolumesSnapshotsTestJSON-1284785160-project] Calling method '.version_select at 0x7f7c3c232040>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:34.256988 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-aeb9d9a2-daa9-40ce-b6c5-6c0c3b903bb9 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:34.274508 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-aeb9d9a2-daa9-40ce-b6c5-6c0c3b903bb9 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1529 microversion: 2.1 time: 0.823871 Oct 18 15:45:34.279292 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2251/4520] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:33 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1529 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:34.280342 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6bd1f263-40b7-4aa3-b053-8d88bdb9c02e tempest-VolumesSnapshotsTestJSON-1284785160 tempest-VolumesSnapshotsTestJSON-1284785160-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.089601 Oct 18 15:45:34.287502 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2270/4521] 10.222.0.60 () {58 vars in 1140 bytes} [Tue Oct 18 15:45:34 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:45:34.289859 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-99889c0e-ef2e-4399-ba10-959c47df3a73 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:34.290491 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-99889c0e-ef2e-4399-ba10-959c47df3a73 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 50e19888-f65b-4eaa-8a40-47733d990b8e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:34.305448 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99889c0e-ef2e-4399-ba10-959c47df3a73 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:34.306193 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99889c0e-ef2e-4399-ba10-959c47df3a73 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:34.306633 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99889c0e-ef2e-4399-ba10-959c47df3a73 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:34.307678 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99889c0e-ef2e-4399-ba10-959c47df3a73 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:34.308529 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99889c0e-ef2e-4399-ba10-959c47df3a73 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:34.309128 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99889c0e-ef2e-4399-ba10-959c47df3a73 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:34.642721 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-2b6e79a5-711f-4562-837e-b838b3c90d0d req-6d3a8608-c170-4f39-8483-2cd65058cc3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e83c779-c8f8-4ebd-84ab-7f144ab8552a", "tag": "6427e7c0-691b-4a13-83be-346caf570d9c"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:45:34.674568 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-2b6e79a5-711f-4562-837e-b838b3c90d0d req-6d3a8608-c170-4f39-8483-2cd65058cc3d service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:34.675443 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-2b6e79a5-711f-4562-837e-b838b3c90d0d req-6d3a8608-c170-4f39-8483-2cd65058cc3d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:34.676316 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-2b6e79a5-711f-4562-837e-b838b3c90d0d req-6d3a8608-c170-4f39-8483-2cd65058cc3d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:34.709223 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-2b6e79a5-711f-4562-837e-b838b3c90d0d req-6d3a8608-c170-4f39-8483-2cd65058cc3d service nova] Creating event network-changed:6427e7c0-691b-4a13-83be-346caf570d9c for instance 5e83c779-c8f8-4ebd-84ab-7f144ab8552a on n-h1-853682-5 Oct 18 15:45:34.722574 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-2b6e79a5-711f-4562-837e-b838b3c90d0d req-6d3a8608-c170-4f39-8483-2cd65058cc3d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.439527 Oct 18 15:45:34.725356 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2271/4522] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:45:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:45:34.737787 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-560abf09-e114-42f4-be1c-451b82b78c47 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:34.746304 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-560abf09-e114-42f4-be1c-451b82b78c47 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:34.753153 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-560abf09-e114-42f4-be1c-451b82b78c47 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:34.753650 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-560abf09-e114-42f4-be1c-451b82b78c47 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:34.754090 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-560abf09-e114-42f4-be1c-451b82b78c47 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:34.754797 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-560abf09-e114-42f4-be1c-451b82b78c47 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:34.755256 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-560abf09-e114-42f4-be1c-451b82b78c47 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:34.755684 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-560abf09-e114-42f4-be1c-451b82b78c47 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:35.782629 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-99889c0e-ef2e-4399-ba10-959c47df3a73 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:35.796461 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-99889c0e-ef2e-4399-ba10-959c47df3a73 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e" status: 200 len: 1513 microversion: 2.1 time: 1.515964 Oct 18 15:45:35.797347 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2252/4523] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:34 2022] GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e => generated 1513 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:35.816648 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-560abf09-e114-42f4-be1c-451b82b78c47 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:35.831054 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-560abf09-e114-42f4-be1c-451b82b78c47 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1671 microversion: 2.1 time: 1.102558 Oct 18 15:45:35.831707 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2272/4524] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:34 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1671 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:35.834347 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-28eb0d94-cf1b-4532-a8f6-6519265c9f40 tempest-VolumesSnapshotsTestJSON-1284785160 tempest-VolumesSnapshotsTestJSON-1284785160-project] Calling method '.version_select at 0x7f7c3c585ee0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:35.845296 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1735cbd6-0860-473b-a4fb-39f5f4440b01 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:35.845916 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1735cbd6-0860-473b-a4fb-39f5f4440b01 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 5e83c779-c8f8-4ebd-84ab-7f144ab8552a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:35.872071 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1735cbd6-0860-473b-a4fb-39f5f4440b01 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:35.872850 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1735cbd6-0860-473b-a4fb-39f5f4440b01 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:35.873490 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1735cbd6-0860-473b-a4fb-39f5f4440b01 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:35.874377 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1735cbd6-0860-473b-a4fb-39f5f4440b01 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:35.875327 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1735cbd6-0860-473b-a4fb-39f5f4440b01 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:35.878054 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1735cbd6-0860-473b-a4fb-39f5f4440b01 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:35.891762 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-28eb0d94-cf1b-4532-a8f6-6519265c9f40 tempest-VolumesSnapshotsTestJSON-1284785160 tempest-VolumesSnapshotsTestJSON-1284785160-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/3e2a4adf-8919-4b81-83fd-0dc25a2b44b8" status: 200 len: 288 microversion: 2.1 time: 0.078092 Oct 18 15:45:35.892866 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2253/4525] 10.222.0.60 () {58 vars in 1251 bytes} [Tue Oct 18 15:45:35 2022] GET /compute/v2.1/os-snapshots/3e2a4adf-8919-4b81-83fd-0dc25a2b44b8 => generated 288 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:45:35.898111 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-65253646-4ddb-4b2f-a768-e52610d67798 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:35.898903 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-65253646-4ddb-4b2f-a768-e52610d67798 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:35.922724 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65253646-4ddb-4b2f-a768-e52610d67798 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:35.926014 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65253646-4ddb-4b2f-a768-e52610d67798 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:35.927366 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65253646-4ddb-4b2f-a768-e52610d67798 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:35.928261 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65253646-4ddb-4b2f-a768-e52610d67798 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:35.930904 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65253646-4ddb-4b2f-a768-e52610d67798 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:35.931793 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65253646-4ddb-4b2f-a768-e52610d67798 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:36.557811 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1735cbd6-0860-473b-a4fb-39f5f4440b01 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:36.571332 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1735cbd6-0860-473b-a4fb-39f5f4440b01 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a" status: 200 len: 1370 microversion: 2.1 time: 0.734723 Oct 18 15:45:36.571991 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-65253646-4ddb-4b2f-a768-e52610d67798 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:36.572789 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2273/4526] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:35 2022] GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a => generated 1370 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:36.588209 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-65253646-4ddb-4b2f-a768-e52610d67798 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1511 microversion: 2.1 time: 0.691814 Oct 18 15:45:36.596794 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5eb28e26-01ec-4e17-8b25-5fbecf3f8e56 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:36.598009 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5eb28e26-01ec-4e17-8b25-5fbecf3f8e56 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:36.605954 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5eb28e26-01ec-4e17-8b25-5fbecf3f8e56 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:36.608082 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5eb28e26-01ec-4e17-8b25-5fbecf3f8e56 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:36.608945 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2254/4527] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:35 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1511 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:36.609250 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5eb28e26-01ec-4e17-8b25-5fbecf3f8e56 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:36.610533 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5eb28e26-01ec-4e17-8b25-5fbecf3f8e56 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:36.611465 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5eb28e26-01ec-4e17-8b25-5fbecf3f8e56 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:36.612586 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5eb28e26-01ec-4e17-8b25-5fbecf3f8e56 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:36.617883 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b13668cb-20a6-493f-99b4-74f425e4d9cb tempest-VolumesSnapshotsTestJSON-1284785160 tempest-VolumesSnapshotsTestJSON-1284785160-project] Calling method '.version_select at 0x7f7c3c65f280>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:36.708175 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b13668cb-20a6-493f-99b4-74f425e4d9cb tempest-VolumesSnapshotsTestJSON-1284785160 tempest-VolumesSnapshotsTestJSON-1284785160-project] 10.222.0.60 "DELETE /compute/v2.1/os-snapshots/3e2a4adf-8919-4b81-83fd-0dc25a2b44b8" status: 202 len: 0 microversion: 2.1 time: 0.098002 Oct 18 15:45:36.713048 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2255/4528] 10.222.0.60 () {58 vars in 1254 bytes} [Tue Oct 18 15:45:36 2022] DELETE /compute/v2.1/os-snapshots/3e2a4adf-8919-4b81-83fd-0dc25a2b44b8 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:45:36.723078 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-51313a6f-8648-45ee-b5d2-1673a719ef83 tempest-VolumesSnapshotsTestJSON-1284785160 tempest-VolumesSnapshotsTestJSON-1284785160-project] Calling method '.version_select at 0x7f7c3c4e2940>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:36.770724 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-51313a6f-8648-45ee-b5d2-1673a719ef83 tempest-VolumesSnapshotsTestJSON-1284785160 tempest-VolumesSnapshotsTestJSON-1284785160-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/3e2a4adf-8919-4b81-83fd-0dc25a2b44b8" status: 200 len: 287 microversion: 2.1 time: 0.054040 Oct 18 15:45:36.776387 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2256/4529] 10.222.0.60 () {58 vars in 1251 bytes} [Tue Oct 18 15:45:36 2022] GET /compute/v2.1/os-snapshots/3e2a4adf-8919-4b81-83fd-0dc25a2b44b8 => generated 287 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:45:36.820238 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0ccebbb3-e6df-4afa-b18a-0204a67f912f tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:36.821984 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0ccebbb3-e6df-4afa-b18a-0204a67f912f tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 50e19888-f65b-4eaa-8a40-47733d990b8e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:36.834165 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ccebbb3-e6df-4afa-b18a-0204a67f912f tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:36.836257 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ccebbb3-e6df-4afa-b18a-0204a67f912f tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:36.836908 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ccebbb3-e6df-4afa-b18a-0204a67f912f tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:36.839949 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ccebbb3-e6df-4afa-b18a-0204a67f912f tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:36.841883 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ccebbb3-e6df-4afa-b18a-0204a67f912f tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:36.842432 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ccebbb3-e6df-4afa-b18a-0204a67f912f tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:37.383681 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5eb28e26-01ec-4e17-8b25-5fbecf3f8e56 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:37.395689 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5eb28e26-01ec-4e17-8b25-5fbecf3f8e56 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1671 microversion: 2.1 time: 0.808229 Oct 18 15:45:37.415209 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2274/4530] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:36 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1671 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:37.426198 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0ccebbb3-e6df-4afa-b18a-0204a67f912f tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:37.437500 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0ccebbb3-e6df-4afa-b18a-0204a67f912f tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e" status: 200 len: 1513 microversion: 2.1 time: 0.619756 Oct 18 15:45:37.438555 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2257/4531] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:36 2022] GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e => generated 1513 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:37.451254 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b27b2076-3ce3-44d0-b4ef-89fe1daad489 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:37.452236 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b27b2076-3ce3-44d0-b4ef-89fe1daad489 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:37.460413 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b27b2076-3ce3-44d0-b4ef-89fe1daad489 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:37.470068 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b27b2076-3ce3-44d0-b4ef-89fe1daad489 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:37.471022 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b27b2076-3ce3-44d0-b4ef-89fe1daad489 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:37.471987 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b27b2076-3ce3-44d0-b4ef-89fe1daad489 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:37.472746 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b27b2076-3ce3-44d0-b4ef-89fe1daad489 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:37.473406 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b27b2076-3ce3-44d0-b4ef-89fe1daad489 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:37.875635 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-eab406dd-380b-48fd-93fb-bb624426478a req-2467a55a-8118-4c28-9587-53a84ed4fdb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cc69e2e-cb26-42d6-b887-31e0afaa69fc", "name": "network-vif-unplugged", "status": "completed", "tag": "c9ee9ae4-c0ad-4fa3-a68e-56018fcf2c7f"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:45:37.898967 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-eab406dd-380b-48fd-93fb-bb624426478a req-2467a55a-8118-4c28-9587-53a84ed4fdb6 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:37.899459 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-eab406dd-380b-48fd-93fb-bb624426478a req-2467a55a-8118-4c28-9587-53a84ed4fdb6 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:37.899893 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-eab406dd-380b-48fd-93fb-bb624426478a req-2467a55a-8118-4c28-9587-53a84ed4fdb6 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:37.943822 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-eab406dd-380b-48fd-93fb-bb624426478a req-2467a55a-8118-4c28-9587-53a84ed4fdb6 service nova] Creating event network-vif-unplugged:c9ee9ae4-c0ad-4fa3-a68e-56018fcf2c7f for instance 2cc69e2e-cb26-42d6-b887-31e0afaa69fc on n-h2-853682-5 Oct 18 15:45:37.965420 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-eab406dd-380b-48fd-93fb-bb624426478a req-2467a55a-8118-4c28-9587-53a84ed4fdb6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.548975 Oct 18 15:45:37.970966 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2275/4532] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:45:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:45:37.980100 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bc7c8ea9-fcb2-4398-894e-1a66f1f86fbb tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:37.981392 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-bc7c8ea9-fcb2-4398-894e-1a66f1f86fbb tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 5e83c779-c8f8-4ebd-84ab-7f144ab8552a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:37.989261 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bc7c8ea9-fcb2-4398-894e-1a66f1f86fbb tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:37.990253 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bc7c8ea9-fcb2-4398-894e-1a66f1f86fbb tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:37.991074 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bc7c8ea9-fcb2-4398-894e-1a66f1f86fbb tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:37.992051 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bc7c8ea9-fcb2-4398-894e-1a66f1f86fbb tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:37.992728 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bc7c8ea9-fcb2-4398-894e-1a66f1f86fbb tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:37.993894 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bc7c8ea9-fcb2-4398-894e-1a66f1f86fbb tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:38.454780 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b27b2076-3ce3-44d0-b4ef-89fe1daad489 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:38.470239 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b27b2076-3ce3-44d0-b4ef-89fe1daad489 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1671 microversion: 2.1 time: 1.029639 Oct 18 15:45:38.472379 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2258/4533] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:37 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1671 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:38.496330 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-27383fd5-59cc-4b0d-98f7-cab07a9dcff2 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:38.497532 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-27383fd5-59cc-4b0d-98f7-cab07a9dcff2 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:38.510372 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-27383fd5-59cc-4b0d-98f7-cab07a9dcff2 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:38.513430 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-27383fd5-59cc-4b0d-98f7-cab07a9dcff2 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:38.515025 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-27383fd5-59cc-4b0d-98f7-cab07a9dcff2 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:38.516042 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-27383fd5-59cc-4b0d-98f7-cab07a9dcff2 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:38.529055 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-27383fd5-59cc-4b0d-98f7-cab07a9dcff2 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:38.529528 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-27383fd5-59cc-4b0d-98f7-cab07a9dcff2 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:38.617933 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-bc7c8ea9-fcb2-4398-894e-1a66f1f86fbb tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:38.641941 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-bc7c8ea9-fcb2-4398-894e-1a66f1f86fbb tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a" status: 200 len: 1370 microversion: 2.1 time: 0.668727 Oct 18 15:45:38.642611 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2276/4534] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:37 2022] GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a => generated 1370 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:38.650890 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ad4b5896-c690-41cc-b10d-790116d5d3d2 tempest-VolumesSnapshotsTestJSON-1284785160 tempest-VolumesSnapshotsTestJSON-1284785160-project] Calling method '.version_select at 0x7f7c3c255040>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:38.731401 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ad4b5896-c690-41cc-b10d-790116d5d3d2 tempest-VolumesSnapshotsTestJSON-1284785160 tempest-VolumesSnapshotsTestJSON-1284785160-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/3e2a4adf-8919-4b81-83fd-0dc25a2b44b8" status: 200 len: 287 microversion: 2.1 time: 0.084638 Oct 18 15:45:38.736716 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2277/4535] 10.222.0.60 () {58 vars in 1251 bytes} [Tue Oct 18 15:45:38 2022] GET /compute/v2.1/os-snapshots/3e2a4adf-8919-4b81-83fd-0dc25a2b44b8 => generated 287 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:45:38.868307 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-27383fd5-59cc-4b0d-98f7-cab07a9dcff2 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:38.884974 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-27383fd5-59cc-4b0d-98f7-cab07a9dcff2 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1511 microversion: 2.1 time: 0.409332 Oct 18 15:45:38.885573 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2259/4536] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:38 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1511 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:38.891385 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-03c52444-2657-4602-a979-3fed18023ee7 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:38.892314 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-03c52444-2657-4602-a979-3fed18023ee7 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 50e19888-f65b-4eaa-8a40-47733d990b8e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:38.899853 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03c52444-2657-4602-a979-3fed18023ee7 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:38.900680 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03c52444-2657-4602-a979-3fed18023ee7 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:38.901349 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03c52444-2657-4602-a979-3fed18023ee7 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:38.902945 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03c52444-2657-4602-a979-3fed18023ee7 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:38.903684 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03c52444-2657-4602-a979-3fed18023ee7 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:38.904318 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03c52444-2657-4602-a979-3fed18023ee7 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:38.963487 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-67e1fd3d-0a07-408a-ba6a-01c705b86a5f tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1190319127", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "e2e3131e-c670-4c84-ab0a-c197a28d5df9"}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:45:39.068051 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-67e1fd3d-0a07-408a-ba6a-01c705b86a5f tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] validate_networks() for [('e2e3131e-c670-4c84-ab0a-c197a28d5df9', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:45:39.654939 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-03c52444-2657-4602-a979-3fed18023ee7 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:39.666360 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-03c52444-2657-4602-a979-3fed18023ee7 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e" status: 200 len: 1513 microversion: 2.1 time: 0.777514 Oct 18 15:45:39.670585 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2260/4537] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:38 2022] GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e => generated 1513 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:39.677292 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1287e8d1-49e5-4622-ad6f-6f8c12b2cc64 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:45:39.678358 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1287e8d1-49e5-4622-ad6f-6f8c12b2cc64 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:39.691703 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1287e8d1-49e5-4622-ad6f-6f8c12b2cc64 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:39.692666 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1287e8d1-49e5-4622-ad6f-6f8c12b2cc64 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:39.696973 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1287e8d1-49e5-4622-ad6f-6f8c12b2cc64 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:39.701627 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1287e8d1-49e5-4622-ad6f-6f8c12b2cc64 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:39.702996 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1287e8d1-49e5-4622-ad6f-6f8c12b2cc64 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:39.703554 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1287e8d1-49e5-4622-ad6f-6f8c12b2cc64 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:39.801268 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1287e8d1-49e5-4622-ad6f-6f8c12b2cc64 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "POST /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8/action" status: 202 len: 0 microversion: 2.1 time: 0.127771 Oct 18 15:45:39.802428 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2261/4538] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:45:39 2022] POST /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:45:39.814424 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-bcfc27bc-8c7b-40d7-83dc-e22db35836d7 req-60491b07-980d-4a15-b145-54cd4dfcb6c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cc69e2e-cb26-42d6-b887-31e0afaa69fc", "tag": "c9ee9ae4-c0ad-4fa3-a68e-56018fcf2c7f"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:45:39.828611 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-bcfc27bc-8c7b-40d7-83dc-e22db35836d7 req-60491b07-980d-4a15-b145-54cd4dfcb6c7 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:39.829285 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-bcfc27bc-8c7b-40d7-83dc-e22db35836d7 req-60491b07-980d-4a15-b145-54cd4dfcb6c7 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:39.830116 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-bcfc27bc-8c7b-40d7-83dc-e22db35836d7 req-60491b07-980d-4a15-b145-54cd4dfcb6c7 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:39.845443 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-bcfc27bc-8c7b-40d7-83dc-e22db35836d7 req-60491b07-980d-4a15-b145-54cd4dfcb6c7 service nova] Creating event network-changed:c9ee9ae4-c0ad-4fa3-a68e-56018fcf2c7f for instance 2cc69e2e-cb26-42d6-b887-31e0afaa69fc on n-h2-853682-5 Oct 18 15:45:39.854638 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-bcfc27bc-8c7b-40d7-83dc-e22db35836d7 req-60491b07-980d-4a15-b145-54cd4dfcb6c7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049186 Oct 18 15:45:39.856699 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2262/4539] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:45:39.864715 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-be5ff763-dc2d-4b74-9620-08000c87b4ce tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:39.865760 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-be5ff763-dc2d-4b74-9620-08000c87b4ce tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 5e83c779-c8f8-4ebd-84ab-7f144ab8552a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:39.878402 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be5ff763-dc2d-4b74-9620-08000c87b4ce tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:39.880009 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be5ff763-dc2d-4b74-9620-08000c87b4ce tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:39.880750 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be5ff763-dc2d-4b74-9620-08000c87b4ce tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:39.881652 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be5ff763-dc2d-4b74-9620-08000c87b4ce tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:39.882263 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be5ff763-dc2d-4b74-9620-08000c87b4ce tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:39.883091 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be5ff763-dc2d-4b74-9620-08000c87b4ce tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:39.913325 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-67e1fd3d-0a07-408a-ba6a-01c705b86a5f tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:45:39.913833 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-67e1fd3d-0a07-408a-ba6a-01c705b86a5f tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:45:39.914215 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-67e1fd3d-0a07-408a-ba6a-01c705b86a5f tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:45:39.914696 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-67e1fd3d-0a07-408a-ba6a-01c705b86a5f tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:45:39.915120 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-67e1fd3d-0a07-408a-ba6a-01c705b86a5f tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:45:39.936304 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-67e1fd3d-0a07-408a-ba6a-01c705b86a5f tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:39.936846 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-67e1fd3d-0a07-408a-ba6a-01c705b86a5f tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:39.942879 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-67e1fd3d-0a07-408a-ba6a-01c705b86a5f tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:39.943997 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-67e1fd3d-0a07-408a-ba6a-01c705b86a5f tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:39.944661 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-67e1fd3d-0a07-408a-ba6a-01c705b86a5f tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:39.945300 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-67e1fd3d-0a07-408a-ba6a-01c705b86a5f tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:39.991157 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-67e1fd3d-0a07-408a-ba6a-01c705b86a5f tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Getting quotas for project ec6dc7d1281249f9a7156d78cfe6ea34. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:45:40.001918 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-67e1fd3d-0a07-408a-ba6a-01c705b86a5f tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Getting quotas for user 186666f2b025405980f87dee46e405f3 and project ec6dc7d1281249f9a7156d78cfe6ea34. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:45:40.037960 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-67e1fd3d-0a07-408a-ba6a-01c705b86a5f tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:45:40.045983 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-67e1fd3d-0a07-408a-ba6a-01c705b86a5f tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] [instance: 021c8f29-b243-4253-9c83-0d970376acd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:45:40.163745 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-67e1fd3d-0a07-408a-ba6a-01c705b86a5f tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.430156 Oct 18 15:45:40.165955 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2278/4540] 10.222.0.60 () {62 vars in 1188 bytes} [Tue Oct 18 15:45:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1433 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 18 15:45:40.177713 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-083b5f6c-e71f-424c-b338-30eda2f3dbb9 tempest-VolumesSnapshotsTestJSON-1284785160 tempest-VolumesSnapshotsTestJSON-1284785160-project] Calling method '.version_select at 0x7f7c3c1f78b0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:40.222655 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-083b5f6c-e71f-424c-b338-30eda2f3dbb9 tempest-VolumesSnapshotsTestJSON-1284785160 tempest-VolumesSnapshotsTestJSON-1284785160-project] HTTP exception thrown: Snapshot 3e2a4adf-8919-4b81-83fd-0dc25a2b44b8 could not be found. Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-083b5f6c-e71f-424c-b338-30eda2f3dbb9 tempest-VolumesSnapshotsTestJSON-1284785160 tempest-VolumesSnapshotsTestJSON-1284785160-project] Request method failure captured: Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/os-snapshots/3e2a4adf-8919-4b81-83fd-0dc25a2b44b8 HTTP/1.1 Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsoUk_sDGpxi4-x5FoiASqce_d0B1Tgiu6zmuaN7fL_dgf-JCS-Iqn2JFsINGwv9z79CvvMsxf1CX-Go02y3gyw1Ynqde96jyq9Grx2lk8qEQIhsZSdutW3dMfKb3IKR2DKN9QhJ1lfWqSd2UtLuxrCwh4bzDFt9aY9ckF88DbZlufQ Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 870632e1a4e949318298f43dece168f1 Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1284785160 Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/870632e1a4e949318298f43dece168f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/870632e1a4e949318298f43dece168f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/870632e1a4e949318298f43dece168f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_870632e1a4e949318298f43dece168f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1284785160 Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 870632e1a4e949318298f43dece168f1 Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1284785160 Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-VolumesSnapshotsTestJSON-1284785160-project Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: eca1ef4e123f410c9c41d99acbda1cef Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1284785160-project Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: method: Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: exception: Snapshot 3e2a4adf-8919-4b81-83fd-0dc25a2b44b8 could not be found. Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '3e2a4adf-8919-4b81-83fd-0dc25a2b44b8'} Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 3e2a4adf-8919-4b81-83fd-0dc25a2b44b8 could not be found. (HTTP 404) (Request-ID: req-d16acab1-9c0f-401d-8cfd-6ca2d9913a13) Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 18 15:45:40.237603 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 18 15:45:40.243381 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 18 15:45:40.243381 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 18 15:45:40.243381 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 18 15:45:40.243381 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 18 15:45:40.243381 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 18 15:45:40.243381 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 18 15:45:40.243381 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 15:45:40.243381 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 15:45:40.243381 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 15:45:40.243381 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 15:45:40.243381 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 15:45:40.243381 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 15:45:40.243381 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 15:45:40.243381 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 15:45:40.243381 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 3e2a4adf-8919-4b81-83fd-0dc25a2b44b8 could not be found. Oct 18 15:45:40.243381 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:45:40.243381 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:45:40.243381 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:45:40.243381 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:45:40.243381 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:45:40.243381 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:45:40.243381 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:45:40.243381 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:45:40.243381 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:45:40.243381 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:45:40.243381 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:45:40.243381 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:45:40.243381 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 18 15:45:40.243381 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:45:40.243381 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 3e2a4adf-8919-4b81-83fd-0dc25a2b44b8 could not be found. Oct 18 15:45:40.243381 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:45:40.243381 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:45:40.243381 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:45:40.243381 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:45:40.243381 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:45:40.243381 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:45:40.243381 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:45:40.243381 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:45:40.243381 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 3e2a4adf-8919-4b81-83fd-0dc25a2b44b8 could not be found. Oct 18 15:45:40.243381 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:45:40.243381 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-083b5f6c-e71f-424c-b338-30eda2f3dbb9 tempest-VolumesSnapshotsTestJSON-1284785160 tempest-VolumesSnapshotsTestJSON-1284785160-project] Returning 404 to user: Snapshot 3e2a4adf-8919-4b81-83fd-0dc25a2b44b8 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:45:40.243381 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-083b5f6c-e71f-424c-b338-30eda2f3dbb9 tempest-VolumesSnapshotsTestJSON-1284785160 tempest-VolumesSnapshotsTestJSON-1284785160-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/3e2a4adf-8919-4b81-83fd-0dc25a2b44b8" status: 404 len: 111 microversion: 2.1 time: 0.073601 Oct 18 15:45:40.243381 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2279/4541] 10.222.0.60 () {58 vars in 1251 bytes} [Tue Oct 18 15:45:40 2022] GET /compute/v2.1/os-snapshots/3e2a4adf-8919-4b81-83fd-0dc25a2b44b8 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:45:40.262117 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a0fc6712-815a-4004-a303-08bd0915dcd0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:40.262904 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a0fc6712-815a-4004-a303-08bd0915dcd0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:40.280207 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a0fc6712-815a-4004-a303-08bd0915dcd0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:40.281223 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a0fc6712-815a-4004-a303-08bd0915dcd0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:40.281853 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a0fc6712-815a-4004-a303-08bd0915dcd0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:40.282917 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a0fc6712-815a-4004-a303-08bd0915dcd0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:40.283514 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a0fc6712-815a-4004-a303-08bd0915dcd0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:40.284112 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a0fc6712-815a-4004-a303-08bd0915dcd0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:41.039368 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-be5ff763-dc2d-4b74-9620-08000c87b4ce tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:41.053125 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-be5ff763-dc2d-4b74-9620-08000c87b4ce tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a" status: 200 len: 1370 microversion: 2.1 time: 1.192882 Oct 18 15:45:41.070610 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2263/4542] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:39 2022] GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a => generated 1370 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:41.079827 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9891a262-2687-484c-ad98-3f6b8075d477 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:41.079827 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9891a262-2687-484c-ad98-3f6b8075d477 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:41.095979 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=58 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:41.100482 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9891a262-2687-484c-ad98-3f6b8075d477 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:41.101264 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9891a262-2687-484c-ad98-3f6b8075d477 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:41.106226 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9891a262-2687-484c-ad98-3f6b8075d477 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:41.107232 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9891a262-2687-484c-ad98-3f6b8075d477 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:41.107995 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9891a262-2687-484c-ad98-3f6b8075d477 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:41.108672 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9891a262-2687-484c-ad98-3f6b8075d477 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:41.305884 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a0fc6712-815a-4004-a303-08bd0915dcd0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:41.319760 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a0fc6712-815a-4004-a303-08bd0915dcd0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1676 microversion: 2.1 time: 1.071186 Oct 18 15:45:41.320390 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2280/4543] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:40 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1676 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:41.350508 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a30587f0-431c-48e4-8161-e19a9e0f87b3 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:41.351136 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a30587f0-431c-48e4-8161-e19a9e0f87b3 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] [instance: 021c8f29-b243-4253-9c83-0d970376acd5] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:41.385284 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a30587f0-431c-48e4-8161-e19a9e0f87b3 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:41.388931 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a30587f0-431c-48e4-8161-e19a9e0f87b3 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:41.391743 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a30587f0-431c-48e4-8161-e19a9e0f87b3 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:41.392957 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a30587f0-431c-48e4-8161-e19a9e0f87b3 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:41.393351 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a30587f0-431c-48e4-8161-e19a9e0f87b3 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:41.398237 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a30587f0-431c-48e4-8161-e19a9e0f87b3 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:41.609671 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a30587f0-431c-48e4-8161-e19a9e0f87b3 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186666f2b025405980f87dee46e405f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dc7d1281249f9a7156d78cfe6ea34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:41.622291 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a30587f0-431c-48e4-8161-e19a9e0f87b3 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '186666f2b025405980f87dee46e405f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dc7d1281249f9a7156d78cfe6ea34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:41.626278 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a30587f0-431c-48e4-8161-e19a9e0f87b3 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '186666f2b025405980f87dee46e405f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dc7d1281249f9a7156d78cfe6ea34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:41.631105 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a30587f0-431c-48e4-8161-e19a9e0f87b3 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] 10.222.0.60 "GET /compute/v2.1/servers/021c8f29-b243-4253-9c83-0d970376acd5" status: 200 len: 1263 microversion: 2.21 time: 0.308427 Oct 18 15:45:41.635434 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2281/4544] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:45:41 2022] GET /compute/v2.1/servers/021c8f29-b243-4253-9c83-0d970376acd5 => generated 1263 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:45:41.650539 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3695b8c7-e427-46f8-8e73-8fd266c6847a tempest-VolumesSnapshotsTestJSON-1284785160 tempest-VolumesSnapshotsTestJSON-1284785160-project] Calling method '.version_select at 0x7f7c3c255820>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:41.781234 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3695b8c7-e427-46f8-8e73-8fd266c6847a tempest-VolumesSnapshotsTestJSON-1284785160 tempest-VolumesSnapshotsTestJSON-1284785160-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/c81cc4e5-4fcc-46ca-83bd-cf02ff0a248c" status: 202 len: 0 microversion: 2.1 time: 0.143079 Oct 18 15:45:41.782111 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2282/4545] 10.222.0.60 () {58 vars in 1248 bytes} [Tue Oct 18 15:45:41 2022] DELETE /compute/v2.1/os-volumes/c81cc4e5-4fcc-46ca-83bd-cf02ff0a248c => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:45:41.790376 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3547d352-87e0-49c8-85a1-b9cbc865bd94 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:41.791016 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3547d352-87e0-49c8-85a1-b9cbc865bd94 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 50e19888-f65b-4eaa-8a40-47733d990b8e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:41.810362 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3547d352-87e0-49c8-85a1-b9cbc865bd94 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:41.818535 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3547d352-87e0-49c8-85a1-b9cbc865bd94 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:41.819469 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3547d352-87e0-49c8-85a1-b9cbc865bd94 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:41.821059 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3547d352-87e0-49c8-85a1-b9cbc865bd94 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:41.822097 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3547d352-87e0-49c8-85a1-b9cbc865bd94 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:41.823167 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9891a262-2687-484c-ad98-3f6b8075d477 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:41.826454 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3547d352-87e0-49c8-85a1-b9cbc865bd94 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:41.834994 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9891a262-2687-484c-ad98-3f6b8075d477 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1514 microversion: 2.1 time: 0.763183 Oct 18 15:45:41.838600 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2264/4546] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:41 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1514 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:41.854480 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-49a92d96-1bb4-49bc-91f2-3718e0b47db4 tempest-VolumesSnapshotsTestJSON-1284785160 tempest-VolumesSnapshotsTestJSON-1284785160-project] Calling method '.version_select at 0x7f7c3d01fb80>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:41.993230 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-49a92d96-1bb4-49bc-91f2-3718e0b47db4 tempest-VolumesSnapshotsTestJSON-1284785160 tempest-VolumesSnapshotsTestJSON-1284785160-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/c81cc4e5-4fcc-46ca-83bd-cf02ff0a248c" status: 200 len: 345 microversion: 2.1 time: 0.151168 Oct 18 15:45:41.994813 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2265/4547] 10.222.0.60 () {58 vars in 1245 bytes} [Tue Oct 18 15:45:41 2022] GET /compute/v2.1/os-volumes/c81cc4e5-4fcc-46ca-83bd-cf02ff0a248c => generated 345 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:45:42.001168 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-92353a6f-9f45-46de-85c5-d63600ed2a7c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:42.002048 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-92353a6f-9f45-46de-85c5-d63600ed2a7c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:42.015640 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92353a6f-9f45-46de-85c5-d63600ed2a7c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:42.017020 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92353a6f-9f45-46de-85c5-d63600ed2a7c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:42.018486 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92353a6f-9f45-46de-85c5-d63600ed2a7c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:42.019368 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92353a6f-9f45-46de-85c5-d63600ed2a7c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:42.021632 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92353a6f-9f45-46de-85c5-d63600ed2a7c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:42.022305 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92353a6f-9f45-46de-85c5-d63600ed2a7c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:42.435422 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3547d352-87e0-49c8-85a1-b9cbc865bd94 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:42.449971 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3547d352-87e0-49c8-85a1-b9cbc865bd94 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e" status: 200 len: 1513 microversion: 2.1 time: 0.665781 Oct 18 15:45:42.450901 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2283/4548] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:41 2022] GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e => generated 1513 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:42.465075 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-47cf95fa-90a2-4dc3-ae79-1d7a5825700f tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:42.466045 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-47cf95fa-90a2-4dc3-ae79-1d7a5825700f tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 5e83c779-c8f8-4ebd-84ab-7f144ab8552a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:42.470506 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-92353a6f-9f45-46de-85c5-d63600ed2a7c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:42.473585 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:42.493785 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-47cf95fa-90a2-4dc3-ae79-1d7a5825700f tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:42.494785 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-92353a6f-9f45-46de-85c5-d63600ed2a7c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1454 microversion: 2.1 time: 0.498622 Oct 18 15:45:42.495941 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-47cf95fa-90a2-4dc3-ae79-1d7a5825700f tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:42.498303 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-47cf95fa-90a2-4dc3-ae79-1d7a5825700f tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:42.499084 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-47cf95fa-90a2-4dc3-ae79-1d7a5825700f tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:42.499570 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-47cf95fa-90a2-4dc3-ae79-1d7a5825700f tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:42.499695 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2266/4549] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:41 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1454 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:42.515422 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f4c282ac-3082-454d-9501-55f1beb66ae7 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:42.516062 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f4c282ac-3082-454d-9501-55f1beb66ae7 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:42.523722 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-47cf95fa-90a2-4dc3-ae79-1d7a5825700f tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:42.538806 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4c282ac-3082-454d-9501-55f1beb66ae7 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:42.540368 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4c282ac-3082-454d-9501-55f1beb66ae7 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:42.541955 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4c282ac-3082-454d-9501-55f1beb66ae7 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:42.544567 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4c282ac-3082-454d-9501-55f1beb66ae7 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:42.546364 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4c282ac-3082-454d-9501-55f1beb66ae7 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:42.548530 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4c282ac-3082-454d-9501-55f1beb66ae7 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:43.029704 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-47cf95fa-90a2-4dc3-ae79-1d7a5825700f tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:43.061521 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-47cf95fa-90a2-4dc3-ae79-1d7a5825700f tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a" status: 200 len: 1370 microversion: 2.1 time: 0.609164 Oct 18 15:45:43.062135 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2284/4550] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:42 2022] GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a => generated 1370 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:43.072325 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f4c282ac-3082-454d-9501-55f1beb66ae7 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:43.080679 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f4c282ac-3082-454d-9501-55f1beb66ae7 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1656 microversion: 2.1 time: 0.577936 Oct 18 15:45:43.086032 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ab8f32b5-1cfc-4171-acb9-3ab4369e3aee tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:45:43.086586 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ab8f32b5-1cfc-4171-acb9-3ab4369e3aee tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:43.099824 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2267/4551] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:42 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1656 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:43.099824 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-99a20c15-a2fb-4cb8-980e-77557df1226d tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:43.099824 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-99a20c15-a2fb-4cb8-980e-77557df1226d tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] [instance: 021c8f29-b243-4253-9c83-0d970376acd5] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:43.109832 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ab8f32b5-1cfc-4171-acb9-3ab4369e3aee tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:43.110331 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ab8f32b5-1cfc-4171-acb9-3ab4369e3aee tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:43.110781 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ab8f32b5-1cfc-4171-acb9-3ab4369e3aee tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:43.111510 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ab8f32b5-1cfc-4171-acb9-3ab4369e3aee tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:43.111974 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ab8f32b5-1cfc-4171-acb9-3ab4369e3aee tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:43.112404 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ab8f32b5-1cfc-4171-acb9-3ab4369e3aee tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:43.118562 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99a20c15-a2fb-4cb8-980e-77557df1226d tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:43.123205 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99a20c15-a2fb-4cb8-980e-77557df1226d tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:43.125060 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99a20c15-a2fb-4cb8-980e-77557df1226d tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:43.125901 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99a20c15-a2fb-4cb8-980e-77557df1226d tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:43.128893 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99a20c15-a2fb-4cb8-980e-77557df1226d tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:43.129316 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99a20c15-a2fb-4cb8-980e-77557df1226d tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:43.195898 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-ab8f32b5-1cfc-4171-acb9-3ab4369e3aee tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lazy-loading 'flavor' on Instance uuid 2cc69e2e-cb26-42d6-b887-31e0afaa69fc {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:45:43.241280 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-ab8f32b5-1cfc-4171-acb9-3ab4369e3aee tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] HTTP exception thrown: Cannot 'shelve' instance 2cc69e2e-cb26-42d6-b887-31e0afaa69fc while it is in vm_state shelved_offloaded Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ab8f32b5-1cfc-4171-acb9-3ab4369e3aee tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Request method failure captured: Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: request: POST /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc/action HTTP/1.1 Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 14 Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTslxbnvpe5yiGf5CWZMgShC81OiGKrcSLYZFSWKOLbaqqF5kNJvh8cijdldsPo1OHjHXDcbdPuhTuFRNRswVq0HwpXLNCfOWcF3GU1M8LHkZwXu6ScaOEIHyQ8ewFnAFL7TXd1O14t3atsv_uM6Xc9ZHSfefERCjuehdw5SJuAn7MMs Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 96c4378d52d1489bb2d50e84cabf95eb Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: {"shelve": {}} Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: exception: Cannot 'shelve' instance 2cc69e2e-cb26-42d6-b887-31e0afaa69fc while it is in vm_state shelved_offloaded Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '2cc69e2e-cb26-42d6-b887-31e0afaa69fc', 'body': {'shelve': {}}} Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2cc69e2e-cb26-42d6-b887-31e0afaa69fc in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 15:45:43.246064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 15:45:43.250400 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 2cc69e2e-cb26-42d6-b887-31e0afaa69fc while it is in vm_state shelved_offloaded Oct 18 15:45:43.250400 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:45:43.250400 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:45:43.250400 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:45:43.250400 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:45:43.250400 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:45:43.250400 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:45:43.250400 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:45:43.250400 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:45:43.250400 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 2cc69e2e-cb26-42d6-b887-31e0afaa69fc while it is in vm_state shelved_offloaded Oct 18 15:45:43.250400 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:45:43.250400 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ab8f32b5-1cfc-4171-acb9-3ab4369e3aee tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Returning 409 to user: Cannot 'shelve' instance 2cc69e2e-cb26-42d6-b887-31e0afaa69fc while it is in vm_state shelved_offloaded {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:45:43.253927 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ab8f32b5-1cfc-4171-acb9-3ab4369e3aee tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "POST /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc/action" status: 409 len: 155 microversion: 2.1 time: 0.171623 Oct 18 15:45:43.257603 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2285/4552] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:45:43 2022] POST /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc/action => generated 155 bytes in 173 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 15:45:43.266713 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-17a551c5-f663-49a4-814e-17333ee399d7 tempest-VolumesSnapshotsTestJSON-1284785160 tempest-VolumesSnapshotsTestJSON-1284785160-project] Calling method '.version_select at 0x7f7c3c1b01f0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:43.272731 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-99a20c15-a2fb-4cb8-980e-77557df1226d tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186666f2b025405980f87dee46e405f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dc7d1281249f9a7156d78cfe6ea34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:43.283637 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-99a20c15-a2fb-4cb8-980e-77557df1226d tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '186666f2b025405980f87dee46e405f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dc7d1281249f9a7156d78cfe6ea34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:43.287774 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-99a20c15-a2fb-4cb8-980e-77557df1226d tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '186666f2b025405980f87dee46e405f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dc7d1281249f9a7156d78cfe6ea34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:43.296167 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-99a20c15-a2fb-4cb8-980e-77557df1226d tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] 10.222.0.60 "GET /compute/v2.1/servers/021c8f29-b243-4253-9c83-0d970376acd5" status: 200 len: 1317 microversion: 2.21 time: 0.198478 Oct 18 15:45:43.296859 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2268/4553] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:45:43 2022] GET /compute/v2.1/servers/021c8f29-b243-4253-9c83-0d970376acd5 => generated 1317 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:45:43.314208 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-76c1507d-dfde-4eab-8c3f-a94fc09a3113 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:45:43.315018 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-76c1507d-dfde-4eab-8c3f-a94fc09a3113 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:43.326034 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76c1507d-dfde-4eab-8c3f-a94fc09a3113 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:43.326806 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76c1507d-dfde-4eab-8c3f-a94fc09a3113 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:43.327440 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76c1507d-dfde-4eab-8c3f-a94fc09a3113 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:43.333436 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76c1507d-dfde-4eab-8c3f-a94fc09a3113 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:43.334186 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76c1507d-dfde-4eab-8c3f-a94fc09a3113 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:43.335124 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76c1507d-dfde-4eab-8c3f-a94fc09a3113 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:43.415047 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-17a551c5-f663-49a4-814e-17333ee399d7 tempest-VolumesSnapshotsTestJSON-1284785160 tempest-VolumesSnapshotsTestJSON-1284785160-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/c81cc4e5-4fcc-46ca-83bd-cf02ff0a248c" status: 200 len: 345 microversion: 2.1 time: 0.158637 Oct 18 15:45:43.415641 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2286/4554] 10.222.0.60 () {58 vars in 1245 bytes} [Tue Oct 18 15:45:43 2022] GET /compute/v2.1/os-volumes/c81cc4e5-4fcc-46ca-83bd-cf02ff0a248c => generated 345 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:45:43.425575 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-904b6d02-7b6b-4689-9528-3ba58136596a req-a2882868-d6e4-40e3-8e00-267c911dbd71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e83c779-c8f8-4ebd-84ab-7f144ab8552a", "name": "network-vif-plugged", "status": "completed", "tag": "6427e7c0-691b-4a13-83be-346caf570d9c"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:45:43.458501 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-904b6d02-7b6b-4689-9528-3ba58136596a req-a2882868-d6e4-40e3-8e00-267c911dbd71 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:43.460088 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-904b6d02-7b6b-4689-9528-3ba58136596a req-a2882868-d6e4-40e3-8e00-267c911dbd71 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:43.460753 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-904b6d02-7b6b-4689-9528-3ba58136596a req-a2882868-d6e4-40e3-8e00-267c911dbd71 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:43.479353 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-76c1507d-dfde-4eab-8c3f-a94fc09a3113 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "POST /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8/action" status: 202 len: 0 microversion: 2.1 time: 0.180613 Oct 18 15:45:43.480993 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2269/4555] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:45:43 2022] POST /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:45:43.489154 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d312eb6e-b6d2-4c4f-9b2b-9b61fbaa0d9e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:45:43.489924 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d312eb6e-b6d2-4c4f-9b2b-9b61fbaa0d9e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:43.503516 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-904b6d02-7b6b-4689-9528-3ba58136596a req-a2882868-d6e4-40e3-8e00-267c911dbd71 service nova] Creating event network-vif-plugged:6427e7c0-691b-4a13-83be-346caf570d9c for instance 5e83c779-c8f8-4ebd-84ab-7f144ab8552a on n-h1-853682-5 Oct 18 15:45:43.514531 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d312eb6e-b6d2-4c4f-9b2b-9b61fbaa0d9e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:43.515766 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d312eb6e-b6d2-4c4f-9b2b-9b61fbaa0d9e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:43.517430 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d312eb6e-b6d2-4c4f-9b2b-9b61fbaa0d9e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:43.519015 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-904b6d02-7b6b-4689-9528-3ba58136596a req-a2882868-d6e4-40e3-8e00-267c911dbd71 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101640 Oct 18 15:45:43.520259 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d312eb6e-b6d2-4c4f-9b2b-9b61fbaa0d9e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:43.522547 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2287/4556] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:45:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:45:43.522960 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d312eb6e-b6d2-4c4f-9b2b-9b61fbaa0d9e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:43.523675 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d312eb6e-b6d2-4c4f-9b2b-9b61fbaa0d9e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:43.535011 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-36356afe-ea7c-472d-b1d8-52287f76a924 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:43.536337 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-36356afe-ea7c-472d-b1d8-52287f76a924 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 50e19888-f65b-4eaa-8a40-47733d990b8e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:43.551304 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-36356afe-ea7c-472d-b1d8-52287f76a924 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:43.552850 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-36356afe-ea7c-472d-b1d8-52287f76a924 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:43.553856 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-36356afe-ea7c-472d-b1d8-52287f76a924 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:43.556761 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-36356afe-ea7c-472d-b1d8-52287f76a924 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:43.557597 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-36356afe-ea7c-472d-b1d8-52287f76a924 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:43.559373 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-36356afe-ea7c-472d-b1d8-52287f76a924 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:43.630019 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d312eb6e-b6d2-4c4f-9b2b-9b61fbaa0d9e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120406) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 18 15:45:43.763386 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d312eb6e-b6d2-4c4f-9b2b-9b61fbaa0d9e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "POST /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc/action" status: 202 len: 0 microversion: 2.1 time: 0.280812 Oct 18 15:45:43.763977 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2270/4557] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:45:43 2022] POST /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:45:43.773418 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a58c86ea-2221-4f5c-bd61-e29e92123c7a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:43.780445 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a58c86ea-2221-4f5c-bd61-e29e92123c7a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:43.798302 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a58c86ea-2221-4f5c-bd61-e29e92123c7a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:43.799155 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a58c86ea-2221-4f5c-bd61-e29e92123c7a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:43.799799 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a58c86ea-2221-4f5c-bd61-e29e92123c7a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:43.800919 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a58c86ea-2221-4f5c-bd61-e29e92123c7a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:43.801609 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a58c86ea-2221-4f5c-bd61-e29e92123c7a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:43.802528 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a58c86ea-2221-4f5c-bd61-e29e92123c7a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:44.303110 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-36356afe-ea7c-472d-b1d8-52287f76a924 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:44.316479 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-36356afe-ea7c-472d-b1d8-52287f76a924 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e" status: 200 len: 1513 microversion: 2.1 time: 0.792554 Oct 18 15:45:44.317734 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2288/4558] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:43 2022] GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e => generated 1513 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:44.330901 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7c1dc49e-6789-41fd-aa28-ca640b157369 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:44.332832 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7c1dc49e-6789-41fd-aa28-ca640b157369 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:44.350969 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7c1dc49e-6789-41fd-aa28-ca640b157369 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:44.351801 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7c1dc49e-6789-41fd-aa28-ca640b157369 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:44.354244 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7c1dc49e-6789-41fd-aa28-ca640b157369 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:44.355919 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7c1dc49e-6789-41fd-aa28-ca640b157369 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:44.361247 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7c1dc49e-6789-41fd-aa28-ca640b157369 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:44.361890 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7c1dc49e-6789-41fd-aa28-ca640b157369 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:44.388791 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a58c86ea-2221-4f5c-bd61-e29e92123c7a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:44.397560 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a58c86ea-2221-4f5c-bd61-e29e92123c7a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1671 microversion: 2.1 time: 0.632255 Oct 18 15:45:44.403650 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2271/4559] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:43 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1671 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:44.411899 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-574bce9c-c81f-48aa-b700-edfa97570c52 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:44.412794 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-574bce9c-c81f-48aa-b700-edfa97570c52 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 5e83c779-c8f8-4ebd-84ab-7f144ab8552a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:44.428292 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-574bce9c-c81f-48aa-b700-edfa97570c52 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:44.429049 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-574bce9c-c81f-48aa-b700-edfa97570c52 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:44.429660 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-574bce9c-c81f-48aa-b700-edfa97570c52 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:44.430693 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-574bce9c-c81f-48aa-b700-edfa97570c52 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:44.438811 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-574bce9c-c81f-48aa-b700-edfa97570c52 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:44.439584 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-574bce9c-c81f-48aa-b700-edfa97570c52 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:44.645677 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7c1dc49e-6789-41fd-aa28-ca640b157369 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:44.657941 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7c1dc49e-6789-41fd-aa28-ca640b157369 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1462 microversion: 2.1 time: 0.338988 Oct 18 15:45:44.661249 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2289/4560] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:44 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1462 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:44.669958 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-46c3bf50-3d1f-475f-9708-adffe81d9007 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:44.672169 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-46c3bf50-3d1f-475f-9708-adffe81d9007 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] [instance: 021c8f29-b243-4253-9c83-0d970376acd5] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:44.686640 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-46c3bf50-3d1f-475f-9708-adffe81d9007 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:44.687357 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-46c3bf50-3d1f-475f-9708-adffe81d9007 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:44.689332 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-46c3bf50-3d1f-475f-9708-adffe81d9007 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:44.690217 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-46c3bf50-3d1f-475f-9708-adffe81d9007 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:44.691943 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-46c3bf50-3d1f-475f-9708-adffe81d9007 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:44.693470 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-46c3bf50-3d1f-475f-9708-adffe81d9007 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:44.813304 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-46c3bf50-3d1f-475f-9708-adffe81d9007 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186666f2b025405980f87dee46e405f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dc7d1281249f9a7156d78cfe6ea34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:44.829186 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-46c3bf50-3d1f-475f-9708-adffe81d9007 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '186666f2b025405980f87dee46e405f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dc7d1281249f9a7156d78cfe6ea34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:44.831214 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-46c3bf50-3d1f-475f-9708-adffe81d9007 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '186666f2b025405980f87dee46e405f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dc7d1281249f9a7156d78cfe6ea34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:44.831837 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-46c3bf50-3d1f-475f-9708-adffe81d9007 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] 10.222.0.60 "GET /compute/v2.1/servers/021c8f29-b243-4253-9c83-0d970376acd5" status: 200 len: 1317 microversion: 2.21 time: 0.169446 Oct 18 15:45:44.832748 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2290/4561] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:45:44 2022] GET /compute/v2.1/servers/021c8f29-b243-4253-9c83-0d970376acd5 => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:45:44.842996 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ce3dad5b-0716-4d92-9746-00dbac4f7dec tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:44.843643 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ce3dad5b-0716-4d92-9746-00dbac4f7dec tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:44.850956 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-574bce9c-c81f-48aa-b700-edfa97570c52 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:44.859227 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-574bce9c-c81f-48aa-b700-edfa97570c52 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a" status: 200 len: 1370 microversion: 2.1 time: 0.454263 Oct 18 15:45:44.863443 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2272/4562] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:44 2022] GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a => generated 1370 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:44.867179 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ce3dad5b-0716-4d92-9746-00dbac4f7dec tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:44.867686 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ce3dad5b-0716-4d92-9746-00dbac4f7dec tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:44.868650 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ce3dad5b-0716-4d92-9746-00dbac4f7dec tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:44.869646 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ce3dad5b-0716-4d92-9746-00dbac4f7dec tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:44.877097 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2351ce38-032e-4c52-842e-8a625e5376f2 tempest-VolumesSnapshotsTestJSON-1284785160 tempest-VolumesSnapshotsTestJSON-1284785160-project] Calling method '.version_select at 0x7f7c3d2f0ee0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:44.878804 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ce3dad5b-0716-4d92-9746-00dbac4f7dec tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:44.880991 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ce3dad5b-0716-4d92-9746-00dbac4f7dec tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:45.021337 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2351ce38-032e-4c52-842e-8a625e5376f2 tempest-VolumesSnapshotsTestJSON-1284785160 tempest-VolumesSnapshotsTestJSON-1284785160-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/c81cc4e5-4fcc-46ca-83bd-cf02ff0a248c" status: 200 len: 345 microversion: 2.1 time: 0.156393 Oct 18 15:45:45.021883 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2273/4563] 10.222.0.60 () {58 vars in 1245 bytes} [Tue Oct 18 15:45:44 2022] GET /compute/v2.1/os-volumes/c81cc4e5-4fcc-46ca-83bd-cf02ff0a248c => generated 345 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:45:45.244161 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ce3dad5b-0716-4d92-9746-00dbac4f7dec tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:45.255586 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ce3dad5b-0716-4d92-9746-00dbac4f7dec tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1671 microversion: 2.1 time: 0.421742 Oct 18 15:45:45.256978 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2291/4564] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:44 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1671 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:45.281284 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b5dc5f5d-92dc-4d31-8333-62810cc1ebfc tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:45.282139 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b5dc5f5d-92dc-4d31-8333-62810cc1ebfc tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:45.288713 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5dc5f5d-92dc-4d31-8333-62810cc1ebfc tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:45.289454 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5dc5f5d-92dc-4d31-8333-62810cc1ebfc tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:45.291252 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5dc5f5d-92dc-4d31-8333-62810cc1ebfc tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:45.292321 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5dc5f5d-92dc-4d31-8333-62810cc1ebfc tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:45.293136 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5dc5f5d-92dc-4d31-8333-62810cc1ebfc tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:45.293743 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5dc5f5d-92dc-4d31-8333-62810cc1ebfc tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:45.341726 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bf3bc0df-88fd-4e4a-8f6a-0357bebb458a tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:45.342347 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-bf3bc0df-88fd-4e4a-8f6a-0357bebb458a tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 50e19888-f65b-4eaa-8a40-47733d990b8e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:45.350168 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bf3bc0df-88fd-4e4a-8f6a-0357bebb458a tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:45.350656 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bf3bc0df-88fd-4e4a-8f6a-0357bebb458a tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:45.351090 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bf3bc0df-88fd-4e4a-8f6a-0357bebb458a tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:45.370122 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bf3bc0df-88fd-4e4a-8f6a-0357bebb458a tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:45.374540 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bf3bc0df-88fd-4e4a-8f6a-0357bebb458a tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:45.377557 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bf3bc0df-88fd-4e4a-8f6a-0357bebb458a tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:45.442342 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=3 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:46.249997 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b5dc5f5d-92dc-4d31-8333-62810cc1ebfc tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:46.265534 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b5dc5f5d-92dc-4d31-8333-62810cc1ebfc tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1671 microversion: 2.1 time: 0.988425 Oct 18 15:45:46.274824 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2274/4565] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:45 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1671 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:46.298609 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5e5ba0ba-6a55-4b9c-be29-c8932f3b721b tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:46.300635 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5e5ba0ba-6a55-4b9c-be29-c8932f3b721b tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:46.321818 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e5ba0ba-6a55-4b9c-be29-c8932f3b721b tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:46.322579 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e5ba0ba-6a55-4b9c-be29-c8932f3b721b tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:46.323180 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e5ba0ba-6a55-4b9c-be29-c8932f3b721b tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:46.326658 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e5ba0ba-6a55-4b9c-be29-c8932f3b721b tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:46.330967 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e5ba0ba-6a55-4b9c-be29-c8932f3b721b tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:46.331924 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e5ba0ba-6a55-4b9c-be29-c8932f3b721b tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:46.446536 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-bf3bc0df-88fd-4e4a-8f6a-0357bebb458a tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:46.466406 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-bf3bc0df-88fd-4e4a-8f6a-0357bebb458a tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e" status: 200 len: 1513 microversion: 2.1 time: 1.128412 Oct 18 15:45:46.468467 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2292/4566] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:45 2022] GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e => generated 1513 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:46.487243 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-90af4e8b-3e50-4cf1-9083-57943ed8222b tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:46.488200 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-90af4e8b-3e50-4cf1-9083-57943ed8222b tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] [instance: 021c8f29-b243-4253-9c83-0d970376acd5] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:46.501844 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-90af4e8b-3e50-4cf1-9083-57943ed8222b tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:46.502504 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-90af4e8b-3e50-4cf1-9083-57943ed8222b tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:46.503066 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-90af4e8b-3e50-4cf1-9083-57943ed8222b tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:46.503828 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-90af4e8b-3e50-4cf1-9083-57943ed8222b tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:46.504295 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-90af4e8b-3e50-4cf1-9083-57943ed8222b tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:46.504729 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-90af4e8b-3e50-4cf1-9083-57943ed8222b tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:46.947338 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-90af4e8b-3e50-4cf1-9083-57943ed8222b tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186666f2b025405980f87dee46e405f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dc7d1281249f9a7156d78cfe6ea34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:46.964058 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-90af4e8b-3e50-4cf1-9083-57943ed8222b tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '186666f2b025405980f87dee46e405f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dc7d1281249f9a7156d78cfe6ea34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:46.969538 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-90af4e8b-3e50-4cf1-9083-57943ed8222b tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '186666f2b025405980f87dee46e405f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dc7d1281249f9a7156d78cfe6ea34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:46.970737 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-90af4e8b-3e50-4cf1-9083-57943ed8222b tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] 10.222.0.60 "GET /compute/v2.1/servers/021c8f29-b243-4253-9c83-0d970376acd5" status: 200 len: 1359 microversion: 2.21 time: 0.500461 Oct 18 15:45:46.971327 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2293/4567] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:45:46 2022] GET /compute/v2.1/servers/021c8f29-b243-4253-9c83-0d970376acd5 => generated 1359 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:45:46.982160 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5e5ba0ba-6a55-4b9c-be29-c8932f3b721b tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:46.983844 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-41b6d332-df17-4ecd-8735-bfe3a7bd4744 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:46.984466 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-41b6d332-df17-4ecd-8735-bfe3a7bd4744 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 5e83c779-c8f8-4ebd-84ab-7f144ab8552a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:46.996666 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5e5ba0ba-6a55-4b9c-be29-c8932f3b721b tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1462 microversion: 2.1 time: 0.714394 Oct 18 15:45:46.997842 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2275/4568] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:46 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1462 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:47.013113 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:47.017970 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-41b6d332-df17-4ecd-8735-bfe3a7bd4744 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:47.018767 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-41b6d332-df17-4ecd-8735-bfe3a7bd4744 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:47.019214 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-41b6d332-df17-4ecd-8735-bfe3a7bd4744 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:47.019919 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-41b6d332-df17-4ecd-8735-bfe3a7bd4744 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:47.027090 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-41b6d332-df17-4ecd-8735-bfe3a7bd4744 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:47.027470 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5528bf40-5c1e-4328-beeb-b865592c02e7 tempest-VolumesSnapshotsTestJSON-1284785160 tempest-VolumesSnapshotsTestJSON-1284785160-project] Calling method '.version_select at 0x7f7c3dc03f70>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:47.028105 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-41b6d332-df17-4ecd-8735-bfe3a7bd4744 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:47.079541 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-5528bf40-5c1e-4328-beeb-b865592c02e7 tempest-VolumesSnapshotsTestJSON-1284785160 tempest-VolumesSnapshotsTestJSON-1284785160-project] HTTP exception thrown: Volume c81cc4e5-4fcc-46ca-83bd-cf02ff0a248c could not be found. Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5528bf40-5c1e-4328-beeb-b865592c02e7 tempest-VolumesSnapshotsTestJSON-1284785160 tempest-VolumesSnapshotsTestJSON-1284785160-project] Request method failure captured: Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/os-volumes/c81cc4e5-4fcc-46ca-83bd-cf02ff0a248c HTTP/1.1 Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsoUk_sDGpxi4-x5FoiASqce_d0B1Tgiu6zmuaN7fL_dgf-JCS-Iqn2JFsINGwv9z79CvvMsxf1CX-Go02y3gyw1Ynqde96jyq9Grx2lk8qEQIhsZSdutW3dMfKb3IKR2DKN9QhJ1lfWqSd2UtLuxrCwh4bzDFt9aY9ckF88DbZlufQ Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 870632e1a4e949318298f43dece168f1 Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1284785160 Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/870632e1a4e949318298f43dece168f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/870632e1a4e949318298f43dece168f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/870632e1a4e949318298f43dece168f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_870632e1a4e949318298f43dece168f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1284785160 Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 870632e1a4e949318298f43dece168f1 Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1284785160 Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-VolumesSnapshotsTestJSON-1284785160-project Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: eca1ef4e123f410c9c41d99acbda1cef Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1284785160-project Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: exception: Volume c81cc4e5-4fcc-46ca-83bd-cf02ff0a248c could not be found. Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'c81cc4e5-4fcc-46ca-83bd-cf02ff0a248c'} Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c81cc4e5-4fcc-46ca-83bd-cf02ff0a248c could not be found. (HTTP 404) (Request-ID: req-e14eebfd-a502-418d-aa4f-6c5e7699a478) Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 18 15:45:47.081814 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 15:45:47.086515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 15:45:47.086515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 18 15:45:47.086515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 18 15:45:47.086515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 18 15:45:47.086515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 18 15:45:47.086515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 15:45:47.086515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 15:45:47.086515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 15:45:47.086515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 15:45:47.086515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 15:45:47.086515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 15:45:47.086515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 15:45:47.086515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 15:45:47.086515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c81cc4e5-4fcc-46ca-83bd-cf02ff0a248c could not be found. Oct 18 15:45:47.086515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:45:47.086515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:45:47.086515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:45:47.086515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:45:47.086515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:45:47.086515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:45:47.086515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:45:47.086515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:45:47.086515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:45:47.086515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:45:47.086515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:45:47.086515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:45:47.086515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 18 15:45:47.086515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:45:47.086515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c81cc4e5-4fcc-46ca-83bd-cf02ff0a248c could not be found. Oct 18 15:45:47.086515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:45:47.086515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:45:47.086515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:45:47.086515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:45:47.086515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:45:47.086515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:45:47.086515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:45:47.086515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:45:47.086515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c81cc4e5-4fcc-46ca-83bd-cf02ff0a248c could not be found. Oct 18 15:45:47.086515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:45:47.091264 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5528bf40-5c1e-4328-beeb-b865592c02e7 tempest-VolumesSnapshotsTestJSON-1284785160 tempest-VolumesSnapshotsTestJSON-1284785160-project] Returning 404 to user: Volume c81cc4e5-4fcc-46ca-83bd-cf02ff0a248c could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:45:47.092416 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5528bf40-5c1e-4328-beeb-b865592c02e7 tempest-VolumesSnapshotsTestJSON-1284785160 tempest-VolumesSnapshotsTestJSON-1284785160-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/c81cc4e5-4fcc-46ca-83bd-cf02ff0a248c" status: 404 len: 109 microversion: 2.1 time: 0.092870 Oct 18 15:45:47.097987 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2276/4569] 10.222.0.60 () {58 vars in 1245 bytes} [Tue Oct 18 15:45:46 2022] GET /compute/v2.1/os-volumes/c81cc4e5-4fcc-46ca-83bd-cf02ff0a248c => generated 109 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:45:47.103956 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e734291a-cbb7-4ca0-89ac-1ef7c131e783 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:47.105363 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e734291a-cbb7-4ca0-89ac-1ef7c131e783 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:47.116664 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e734291a-cbb7-4ca0-89ac-1ef7c131e783 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:47.117389 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e734291a-cbb7-4ca0-89ac-1ef7c131e783 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:47.118202 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e734291a-cbb7-4ca0-89ac-1ef7c131e783 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:47.119119 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e734291a-cbb7-4ca0-89ac-1ef7c131e783 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:47.119761 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e734291a-cbb7-4ca0-89ac-1ef7c131e783 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:47.121084 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e734291a-cbb7-4ca0-89ac-1ef7c131e783 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:47.626149 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e734291a-cbb7-4ca0-89ac-1ef7c131e783 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:47.642843 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e734291a-cbb7-4ca0-89ac-1ef7c131e783 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1671 microversion: 2.1 time: 0.543508 Oct 18 15:45:47.645909 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2277/4570] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:47 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1671 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:47.681764 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e5a04d9b-83ae-4fb5-bdd0-11c5d19f18cf tempest-VolumesSnapshotsTestJSON-1284785160 tempest-VolumesSnapshotsTestJSON-1284785160-project] Calling method '.version_select at 0x7f7c3ddf9dc0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:47.720789 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-41b6d332-df17-4ecd-8735-bfe3a7bd4744 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:47.733129 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-41b6d332-df17-4ecd-8735-bfe3a7bd4744 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a" status: 200 len: 1565 microversion: 2.1 time: 0.760589 Oct 18 15:45:47.733763 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2294/4571] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:46 2022] GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a => generated 1565 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:47.800330 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-e5a04d9b-83ae-4fb5-bdd0-11c5d19f18cf tempest-VolumesSnapshotsTestJSON-1284785160 tempest-VolumesSnapshotsTestJSON-1284785160-project] HTTP exception thrown: Volume c81cc4e5-4fcc-46ca-83bd-cf02ff0a248c could not be found. Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e5a04d9b-83ae-4fb5-bdd0-11c5d19f18cf tempest-VolumesSnapshotsTestJSON-1284785160 tempest-VolumesSnapshotsTestJSON-1284785160-project] Request method failure captured: Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/os-volumes/c81cc4e5-4fcc-46ca-83bd-cf02ff0a248c HTTP/1.1 Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsoUk_sDGpxi4-x5FoiASqce_d0B1Tgiu6zmuaN7fL_dgf-JCS-Iqn2JFsINGwv9z79CvvMsxf1CX-Go02y3gyw1Ynqde96jyq9Grx2lk8qEQIhsZSdutW3dMfKb3IKR2DKN9QhJ1lfWqSd2UtLuxrCwh4bzDFt9aY9ckF88DbZlufQ Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 870632e1a4e949318298f43dece168f1 Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1284785160 Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/870632e1a4e949318298f43dece168f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/870632e1a4e949318298f43dece168f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/870632e1a4e949318298f43dece168f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_870632e1a4e949318298f43dece168f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1284785160 Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 870632e1a4e949318298f43dece168f1 Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1284785160 Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-VolumesSnapshotsTestJSON-1284785160-project Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: eca1ef4e123f410c9c41d99acbda1cef Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1284785160-project Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: method: Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: exception: Volume c81cc4e5-4fcc-46ca-83bd-cf02ff0a248c could not be found. Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'c81cc4e5-4fcc-46ca-83bd-cf02ff0a248c'} Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c81cc4e5-4fcc-46ca-83bd-cf02ff0a248c could not be found. (HTTP 404) (Request-ID: req-5cff30e9-293d-4fb6-be26-2c8adad789b2) Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 18 15:45:47.802474 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 15:45:47.807857 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 15:45:47.807857 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 18 15:45:47.807857 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 18 15:45:47.807857 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 18 15:45:47.807857 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 18 15:45:47.807857 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 18 15:45:47.807857 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 18 15:45:47.807857 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 18 15:45:47.807857 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 18 15:45:47.807857 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 15:45:47.807857 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 15:45:47.807857 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 15:45:47.807857 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 15:45:47.807857 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c81cc4e5-4fcc-46ca-83bd-cf02ff0a248c could not be found. Oct 18 15:45:47.807857 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:45:47.807857 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:45:47.807857 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:45:47.807857 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:45:47.807857 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:45:47.807857 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:45:47.807857 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:45:47.807857 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:45:47.807857 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:45:47.807857 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:45:47.807857 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:45:47.807857 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:45:47.807857 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 18 15:45:47.807857 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:45:47.807857 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c81cc4e5-4fcc-46ca-83bd-cf02ff0a248c could not be found. Oct 18 15:45:47.807857 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:45:47.807857 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:45:47.807857 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:45:47.807857 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:45:47.807857 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:45:47.807857 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:45:47.807857 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:45:47.807857 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:45:47.807857 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c81cc4e5-4fcc-46ca-83bd-cf02ff0a248c could not be found. Oct 18 15:45:47.807857 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:45:47.807857 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e5a04d9b-83ae-4fb5-bdd0-11c5d19f18cf tempest-VolumesSnapshotsTestJSON-1284785160 tempest-VolumesSnapshotsTestJSON-1284785160-project] Returning 404 to user: Volume c81cc4e5-4fcc-46ca-83bd-cf02ff0a248c could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:45:47.807857 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e5a04d9b-83ae-4fb5-bdd0-11c5d19f18cf tempest-VolumesSnapshotsTestJSON-1284785160 tempest-VolumesSnapshotsTestJSON-1284785160-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/c81cc4e5-4fcc-46ca-83bd-cf02ff0a248c" status: 404 len: 109 microversion: 2.1 time: 0.151098 Oct 18 15:45:47.807857 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2278/4572] 10.222.0.60 () {58 vars in 1248 bytes} [Tue Oct 18 15:45:47 2022] DELETE /compute/v2.1/os-volumes/c81cc4e5-4fcc-46ca-83bd-cf02ff0a248c => generated 109 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:45:47.816493 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1f34685c-e846-4ca1-9c11-74b90199ce68 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:47.816493 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1f34685c-e846-4ca1-9c11-74b90199ce68 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 50e19888-f65b-4eaa-8a40-47733d990b8e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:47.846660 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f34685c-e846-4ca1-9c11-74b90199ce68 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:47.847766 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f34685c-e846-4ca1-9c11-74b90199ce68 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:47.848514 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f34685c-e846-4ca1-9c11-74b90199ce68 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:47.853190 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f34685c-e846-4ca1-9c11-74b90199ce68 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:47.854745 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f34685c-e846-4ca1-9c11-74b90199ce68 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:47.855194 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f34685c-e846-4ca1-9c11-74b90199ce68 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:48.032464 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-541fb7dc-7938-4933-a44c-6c25e406cb3e req-bf6d9f77-4ee8-41bd-bdb1-b16b13097d96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "021c8f29-b243-4253-9c83-0d970376acd5", "tag": "eea23ea0-f0a5-446d-991d-74a012a6ca33"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:45:48.044347 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-541fb7dc-7938-4933-a44c-6c25e406cb3e req-bf6d9f77-4ee8-41bd-bdb1-b16b13097d96 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:48.045435 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-541fb7dc-7938-4933-a44c-6c25e406cb3e req-bf6d9f77-4ee8-41bd-bdb1-b16b13097d96 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:48.046231 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-541fb7dc-7938-4933-a44c-6c25e406cb3e req-bf6d9f77-4ee8-41bd-bdb1-b16b13097d96 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:48.062148 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-541fb7dc-7938-4933-a44c-6c25e406cb3e req-bf6d9f77-4ee8-41bd-bdb1-b16b13097d96 service nova] Creating event network-changed:eea23ea0-f0a5-446d-991d-74a012a6ca33 for instance 021c8f29-b243-4253-9c83-0d970376acd5 on n-h1-853682-5 Oct 18 15:45:48.069013 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-541fb7dc-7938-4933-a44c-6c25e406cb3e req-bf6d9f77-4ee8-41bd-bdb1-b16b13097d96 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.330876 Oct 18 15:45:48.069996 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2295/4573] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:45:48.081854 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8d0b4c64-4157-4bde-b9ba-b64af906529e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:48.083421 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8d0b4c64-4157-4bde-b9ba-b64af906529e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:48.093208 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8d0b4c64-4157-4bde-b9ba-b64af906529e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:48.094004 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8d0b4c64-4157-4bde-b9ba-b64af906529e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:48.095336 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8d0b4c64-4157-4bde-b9ba-b64af906529e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:48.096555 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8d0b4c64-4157-4bde-b9ba-b64af906529e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:48.097810 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8d0b4c64-4157-4bde-b9ba-b64af906529e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:48.098478 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8d0b4c64-4157-4bde-b9ba-b64af906529e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:48.909477 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1f34685c-e846-4ca1-9c11-74b90199ce68 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:48.923213 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1f34685c-e846-4ca1-9c11-74b90199ce68 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e" status: 200 len: 1513 microversion: 2.1 time: 1.114934 Oct 18 15:45:48.923213 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2279/4574] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:47 2022] GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e => generated 1513 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:48.939694 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-aeb6ed11-9bc0-45ff-b17b-721189512b99 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:48.939694 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-aeb6ed11-9bc0-45ff-b17b-721189512b99 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 5e83c779-c8f8-4ebd-84ab-7f144ab8552a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:48.939882 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8d0b4c64-4157-4bde-b9ba-b64af906529e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:48.940310 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aeb6ed11-9bc0-45ff-b17b-721189512b99 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:48.940310 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aeb6ed11-9bc0-45ff-b17b-721189512b99 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:48.940310 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aeb6ed11-9bc0-45ff-b17b-721189512b99 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:48.940310 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aeb6ed11-9bc0-45ff-b17b-721189512b99 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:48.940310 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aeb6ed11-9bc0-45ff-b17b-721189512b99 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:48.940310 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aeb6ed11-9bc0-45ff-b17b-721189512b99 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:48.940731 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8d0b4c64-4157-4bde-b9ba-b64af906529e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1671 microversion: 2.1 time: 0.868586 Oct 18 15:45:48.940731 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2296/4575] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:48 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1671 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:48.945429 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-00a1c310-5cd0-4905-9c14-d595c74e1c03 tempest-VolumesSnapshotsTestJSON-1284785160 tempest-VolumesSnapshotsTestJSON-1284785160-project] Calling method '.version_select at 0x7f7c3c1f7160>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:48.978059 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-00a1c310-5cd0-4905-9c14-d595c74e1c03 tempest-VolumesSnapshotsTestJSON-1284785160 tempest-VolumesSnapshotsTestJSON-1284785160-project] HTTP exception thrown: Volume c81cc4e5-4fcc-46ca-83bd-cf02ff0a248c could not be found. Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-00a1c310-5cd0-4905-9c14-d595c74e1c03 tempest-VolumesSnapshotsTestJSON-1284785160 tempest-VolumesSnapshotsTestJSON-1284785160-project] Request method failure captured: Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/os-volumes/c81cc4e5-4fcc-46ca-83bd-cf02ff0a248c HTTP/1.1 Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsoUk_sDGpxi4-x5FoiASqce_d0B1Tgiu6zmuaN7fL_dgf-JCS-Iqn2JFsINGwv9z79CvvMsxf1CX-Go02y3gyw1Ynqde96jyq9Grx2lk8qEQIhsZSdutW3dMfKb3IKR2DKN9QhJ1lfWqSd2UtLuxrCwh4bzDFt9aY9ckF88DbZlufQ Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 870632e1a4e949318298f43dece168f1 Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1284785160 Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/870632e1a4e949318298f43dece168f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/870632e1a4e949318298f43dece168f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/870632e1a4e949318298f43dece168f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_870632e1a4e949318298f43dece168f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1284785160 Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 870632e1a4e949318298f43dece168f1 Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1284785160 Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-VolumesSnapshotsTestJSON-1284785160-project Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: eca1ef4e123f410c9c41d99acbda1cef Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1284785160-project Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: method: Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: exception: Volume c81cc4e5-4fcc-46ca-83bd-cf02ff0a248c could not be found. Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'c81cc4e5-4fcc-46ca-83bd-cf02ff0a248c'} Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c81cc4e5-4fcc-46ca-83bd-cf02ff0a248c could not be found. (HTTP 404) (Request-ID: req-4011a996-f605-41bd-83c8-4684e343ded7) Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 18 15:45:48.981062 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 15:45:48.984994 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 15:45:48.984994 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 18 15:45:48.984994 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 18 15:45:48.984994 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 18 15:45:48.984994 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 18 15:45:48.984994 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 15:45:48.984994 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 15:45:48.984994 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 15:45:48.984994 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 15:45:48.984994 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 15:45:48.984994 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 15:45:48.984994 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 15:45:48.984994 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 15:45:48.984994 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c81cc4e5-4fcc-46ca-83bd-cf02ff0a248c could not be found. Oct 18 15:45:48.984994 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:45:48.984994 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:45:48.984994 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:45:48.984994 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:45:48.984994 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:45:48.984994 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:45:48.984994 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:45:48.984994 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:45:48.984994 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:45:48.984994 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:45:48.984994 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:45:48.984994 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:45:48.984994 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 18 15:45:48.984994 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:45:48.984994 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c81cc4e5-4fcc-46ca-83bd-cf02ff0a248c could not be found. Oct 18 15:45:48.984994 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:45:48.984994 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:45:48.984994 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:45:48.984994 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:45:48.984994 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:45:48.984994 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:45:48.984994 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:45:48.984994 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:45:48.984994 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c81cc4e5-4fcc-46ca-83bd-cf02ff0a248c could not be found. Oct 18 15:45:48.984994 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:45:48.988200 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-00a1c310-5cd0-4905-9c14-d595c74e1c03 tempest-VolumesSnapshotsTestJSON-1284785160 tempest-VolumesSnapshotsTestJSON-1284785160-project] Returning 404 to user: Volume c81cc4e5-4fcc-46ca-83bd-cf02ff0a248c could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:45:48.989255 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-00a1c310-5cd0-4905-9c14-d595c74e1c03 tempest-VolumesSnapshotsTestJSON-1284785160 tempest-VolumesSnapshotsTestJSON-1284785160-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/c81cc4e5-4fcc-46ca-83bd-cf02ff0a248c" status: 404 len: 109 microversion: 2.1 time: 0.047538 Oct 18 15:45:48.990073 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2297/4576] 10.222.0.60 () {58 vars in 1245 bytes} [Tue Oct 18 15:45:48 2022] GET /compute/v2.1/os-volumes/c81cc4e5-4fcc-46ca-83bd-cf02ff0a248c => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:45:48.995766 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b40f5be0-bd1e-4763-8ea0-8291c20d4284 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:48.997996 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b40f5be0-bd1e-4763-8ea0-8291c20d4284 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] [instance: 021c8f29-b243-4253-9c83-0d970376acd5] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:49.005054 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b40f5be0-bd1e-4763-8ea0-8291c20d4284 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:49.005884 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b40f5be0-bd1e-4763-8ea0-8291c20d4284 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:49.006500 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b40f5be0-bd1e-4763-8ea0-8291c20d4284 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:49.007429 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b40f5be0-bd1e-4763-8ea0-8291c20d4284 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:49.008125 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b40f5be0-bd1e-4763-8ea0-8291c20d4284 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:49.008565 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b40f5be0-bd1e-4763-8ea0-8291c20d4284 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:49.153390 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-aeb6ed11-9bc0-45ff-b17b-721189512b99 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.228737 Oct 18 15:45:49.154027 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2280/4577] 10.222.0.60 () {58 vars in 1275 bytes} [Tue Oct 18 15:45:48 2022] GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a/os-interface => generated 285 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:45:49.159682 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-42ddaec1-f940-4637-9711-4e79ed1b36e3 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:49.160535 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-42ddaec1-f940-4637-9711-4e79ed1b36e3 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:49.175068 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42ddaec1-f940-4637-9711-4e79ed1b36e3 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:49.177834 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42ddaec1-f940-4637-9711-4e79ed1b36e3 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:49.179571 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42ddaec1-f940-4637-9711-4e79ed1b36e3 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:49.180510 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42ddaec1-f940-4637-9711-4e79ed1b36e3 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:49.182378 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42ddaec1-f940-4637-9711-4e79ed1b36e3 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:49.183789 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42ddaec1-f940-4637-9711-4e79ed1b36e3 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:49.485613 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b40f5be0-bd1e-4763-8ea0-8291c20d4284 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186666f2b025405980f87dee46e405f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dc7d1281249f9a7156d78cfe6ea34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:49.500061 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b40f5be0-bd1e-4763-8ea0-8291c20d4284 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '186666f2b025405980f87dee46e405f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dc7d1281249f9a7156d78cfe6ea34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:49.504084 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b40f5be0-bd1e-4763-8ea0-8291c20d4284 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '186666f2b025405980f87dee46e405f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dc7d1281249f9a7156d78cfe6ea34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:49.505586 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b40f5be0-bd1e-4763-8ea0-8291c20d4284 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] 10.222.0.60 "GET /compute/v2.1/servers/021c8f29-b243-4253-9c83-0d970376acd5" status: 200 len: 1359 microversion: 2.21 time: 0.514427 Oct 18 15:45:49.522866 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2298/4578] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:45:48 2022] GET /compute/v2.1/servers/021c8f29-b243-4253-9c83-0d970376acd5 => generated 1359 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:45:49.532941 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a19a5fc7-79d0-464c-a3de-ba451de141b0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:49.534046 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a19a5fc7-79d0-464c-a3de-ba451de141b0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:49.554268 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a19a5fc7-79d0-464c-a3de-ba451de141b0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:49.556933 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a19a5fc7-79d0-464c-a3de-ba451de141b0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:49.559752 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a19a5fc7-79d0-464c-a3de-ba451de141b0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:49.561021 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a19a5fc7-79d0-464c-a3de-ba451de141b0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:49.561714 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a19a5fc7-79d0-464c-a3de-ba451de141b0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:49.562555 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a19a5fc7-79d0-464c-a3de-ba451de141b0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:49.680384 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-42ddaec1-f940-4637-9711-4e79ed1b36e3 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:49.691303 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-42ddaec1-f940-4637-9711-4e79ed1b36e3 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1520 microversion: 2.1 time: 0.536019 Oct 18 15:45:49.691905 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2281/4579] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:49 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1520 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:49.946803 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-41bba7e7-b48e-4cb9-b1f7-571cb0fee491 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:49.948185 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-41bba7e7-b48e-4cb9-b1f7-571cb0fee491 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 50e19888-f65b-4eaa-8a40-47733d990b8e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:49.955887 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-41bba7e7-b48e-4cb9-b1f7-571cb0fee491 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:49.956686 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-41bba7e7-b48e-4cb9-b1f7-571cb0fee491 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:49.957338 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:49.958123 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-41bba7e7-b48e-4cb9-b1f7-571cb0fee491 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:49.959316 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-41bba7e7-b48e-4cb9-b1f7-571cb0fee491 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:49.959996 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-41bba7e7-b48e-4cb9-b1f7-571cb0fee491 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:49.960607 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-41bba7e7-b48e-4cb9-b1f7-571cb0fee491 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:50.027413 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=6 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:50.059546 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a19a5fc7-79d0-464c-a3de-ba451de141b0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:50.067760 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a19a5fc7-79d0-464c-a3de-ba451de141b0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1671 microversion: 2.1 time: 0.543301 Oct 18 15:45:50.081550 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2299/4580] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:49 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1671 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:50.402708 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-41bba7e7-b48e-4cb9-b1f7-571cb0fee491 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:50.422753 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-41bba7e7-b48e-4cb9-b1f7-571cb0fee491 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e" status: 200 len: 1513 microversion: 2.1 time: 0.478392 Oct 18 15:45:50.424446 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2282/4581] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:49 2022] GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e => generated 1513 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:50.505900 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-66d07d68-5291-4ad1-a73f-cf0cb26978e2 req-013bc59e-c087-4f02-a97a-094b1f907625 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e83c779-c8f8-4ebd-84ab-7f144ab8552a", "tag": "6427e7c0-691b-4a13-83be-346caf570d9c"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:45:50.538189 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1ef2165f-770e-4cd2-b0f3-34dd941cfa40 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:50.539954 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1ef2165f-770e-4cd2-b0f3-34dd941cfa40 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] [instance: 021c8f29-b243-4253-9c83-0d970376acd5] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:50.554532 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-66d07d68-5291-4ad1-a73f-cf0cb26978e2 req-013bc59e-c087-4f02-a97a-094b1f907625 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:50.562796 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-66d07d68-5291-4ad1-a73f-cf0cb26978e2 req-013bc59e-c087-4f02-a97a-094b1f907625 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:50.565659 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-66d07d68-5291-4ad1-a73f-cf0cb26978e2 req-013bc59e-c087-4f02-a97a-094b1f907625 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:50.567718 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ef2165f-770e-4cd2-b0f3-34dd941cfa40 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:50.570498 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ef2165f-770e-4cd2-b0f3-34dd941cfa40 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:50.578700 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ef2165f-770e-4cd2-b0f3-34dd941cfa40 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:50.579480 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ef2165f-770e-4cd2-b0f3-34dd941cfa40 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:50.581590 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ef2165f-770e-4cd2-b0f3-34dd941cfa40 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:50.582998 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ef2165f-770e-4cd2-b0f3-34dd941cfa40 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:50.584889 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-66d07d68-5291-4ad1-a73f-cf0cb26978e2 req-013bc59e-c087-4f02-a97a-094b1f907625 service nova] Creating event network-changed:6427e7c0-691b-4a13-83be-346caf570d9c for instance 5e83c779-c8f8-4ebd-84ab-7f144ab8552a on n-h1-853682-5 Oct 18 15:45:50.598620 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-66d07d68-5291-4ad1-a73f-cf0cb26978e2 req-013bc59e-c087-4f02-a97a-094b1f907625 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099102 Oct 18 15:45:50.599772 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2300/4582] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:45:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:45:50.614558 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-7f1078ed-3213-43a6-8fb9-7f9a80c6df37 req-fc3aa479-bd48-408a-bcb0-5618de7383dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cc69e2e-cb26-42d6-b887-31e0afaa69fc", "tag": "c9ee9ae4-c0ad-4fa3-a68e-56018fcf2c7f"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:45:50.648558 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-7f1078ed-3213-43a6-8fb9-7f9a80c6df37 req-fc3aa479-bd48-408a-bcb0-5618de7383dc service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:50.650000 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-7f1078ed-3213-43a6-8fb9-7f9a80c6df37 req-fc3aa479-bd48-408a-bcb0-5618de7383dc service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:50.650649 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-7f1078ed-3213-43a6-8fb9-7f9a80c6df37 req-fc3aa479-bd48-408a-bcb0-5618de7383dc service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:50.674263 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-7f1078ed-3213-43a6-8fb9-7f9a80c6df37 req-fc3aa479-bd48-408a-bcb0-5618de7383dc service nova] Creating event network-changed:c9ee9ae4-c0ad-4fa3-a68e-56018fcf2c7f for instance 2cc69e2e-cb26-42d6-b887-31e0afaa69fc on n-h2-853682-5 Oct 18 15:45:50.688398 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-7f1078ed-3213-43a6-8fb9-7f9a80c6df37 req-fc3aa479-bd48-408a-bcb0-5618de7383dc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080438 Oct 18 15:45:50.689868 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2301/4583] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:45:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:45:50.724098 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-866faa10-a1f5-458f-beb8-ff674d47c0d5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:50.725089 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-866faa10-a1f5-458f-beb8-ff674d47c0d5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:50.736303 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-866faa10-a1f5-458f-beb8-ff674d47c0d5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:50.738044 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-866faa10-a1f5-458f-beb8-ff674d47c0d5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:50.739023 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-866faa10-a1f5-458f-beb8-ff674d47c0d5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:50.740273 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-866faa10-a1f5-458f-beb8-ff674d47c0d5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:50.740968 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-866faa10-a1f5-458f-beb8-ff674d47c0d5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:50.741714 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-866faa10-a1f5-458f-beb8-ff674d47c0d5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:51.766432 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1ef2165f-770e-4cd2-b0f3-34dd941cfa40 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186666f2b025405980f87dee46e405f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dc7d1281249f9a7156d78cfe6ea34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:51.782857 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1ef2165f-770e-4cd2-b0f3-34dd941cfa40 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '186666f2b025405980f87dee46e405f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dc7d1281249f9a7156d78cfe6ea34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:51.786152 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1ef2165f-770e-4cd2-b0f3-34dd941cfa40 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '186666f2b025405980f87dee46e405f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dc7d1281249f9a7156d78cfe6ea34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:51.787775 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1ef2165f-770e-4cd2-b0f3-34dd941cfa40 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] 10.222.0.60 "GET /compute/v2.1/servers/021c8f29-b243-4253-9c83-0d970376acd5" status: 200 len: 1359 microversion: 2.21 time: 1.254896 Oct 18 15:45:51.790397 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2283/4584] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:45:50 2022] GET /compute/v2.1/servers/021c8f29-b243-4253-9c83-0d970376acd5 => generated 1359 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:45:51.813148 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bc56d6c4-728c-44bc-b3a1-334d90b57353 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:51.814228 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bc56d6c4-728c-44bc-b3a1-334d90b57353 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 50e19888-f65b-4eaa-8a40-47733d990b8e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:51.822033 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc56d6c4-728c-44bc-b3a1-334d90b57353 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:51.822964 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc56d6c4-728c-44bc-b3a1-334d90b57353 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:51.823774 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc56d6c4-728c-44bc-b3a1-334d90b57353 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:51.825424 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc56d6c4-728c-44bc-b3a1-334d90b57353 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:51.826666 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc56d6c4-728c-44bc-b3a1-334d90b57353 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:51.828578 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc56d6c4-728c-44bc-b3a1-334d90b57353 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:52.109334 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-866faa10-a1f5-458f-beb8-ff674d47c0d5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:52.119547 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-866faa10-a1f5-458f-beb8-ff674d47c0d5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1520 microversion: 2.1 time: 1.401716 Oct 18 15:45:52.120172 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2302/4585] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:50 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1520 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:52.297269 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bc56d6c4-728c-44bc-b3a1-334d90b57353 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:52.300279 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:52.314261 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bc56d6c4-728c-44bc-b3a1-334d90b57353 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e" status: 200 len: 1513 microversion: 2.1 time: 0.514477 Oct 18 15:45:52.315596 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2284/4586] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:51 2022] GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e => generated 1513 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:52.405343 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b4030ba5-6b14-41a0-9c47-c7c86d0bdd8d tempest-VolumesGetTestJSON-1071018540 tempest-VolumesGetTestJSON-1071018540-project] Action: 'create', calling method: .version_select at 0x7f7c3c1b2700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1645038220", "metadata": {"Type": "work"}}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:45:52.818948 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eca1bf67-d796-4e64-9a24-0ef6c90992c9 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:52.820235 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-eca1bf67-d796-4e64-9a24-0ef6c90992c9 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] [instance: 021c8f29-b243-4253-9c83-0d970376acd5] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:52.836714 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eca1bf67-d796-4e64-9a24-0ef6c90992c9 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:52.837593 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eca1bf67-d796-4e64-9a24-0ef6c90992c9 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:52.838214 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eca1bf67-d796-4e64-9a24-0ef6c90992c9 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:52.839132 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eca1bf67-d796-4e64-9a24-0ef6c90992c9 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:52.839801 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eca1bf67-d796-4e64-9a24-0ef6c90992c9 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:52.840397 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eca1bf67-d796-4e64-9a24-0ef6c90992c9 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:52.915686 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b4030ba5-6b14-41a0-9c47-c7c86d0bdd8d tempest-VolumesGetTestJSON-1071018540 tempest-VolumesGetTestJSON-1071018540-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.724005 Oct 18 15:45:52.916538 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2303/4587] 10.222.0.60 () {60 vars in 1156 bytes} [Tue Oct 18 15:45:52 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 726 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Oct 18 15:45:52.929637 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-04806bb6-d7ea-4c59-8cde-6012035eaa41 tempest-VolumesGetTestJSON-1071018540 tempest-VolumesGetTestJSON-1071018540-project] Calling method '.version_select at 0x7f7c3d3b2b80>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:52.999778 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-04806bb6-d7ea-4c59-8cde-6012035eaa41 tempest-VolumesGetTestJSON-1071018540 tempest-VolumesGetTestJSON-1071018540-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/1cb94968-9d7b-4a7b-9a50-6d86a258469e" status: 200 len: 353 microversion: 2.1 time: 0.074187 Oct 18 15:45:53.000686 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2304/4588] 10.222.0.60 () {58 vars in 1245 bytes} [Tue Oct 18 15:45:52 2022] GET /compute/v2.1/os-volumes/1cb94968-9d7b-4a7b-9a50-6d86a258469e => generated 353 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:45:53.143607 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-49e9d0fb-541a-4297-b54a-ae4608aeaa62 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:53.144349 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-49e9d0fb-541a-4297-b54a-ae4608aeaa62 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:53.146600 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-eca1bf67-d796-4e64-9a24-0ef6c90992c9 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186666f2b025405980f87dee46e405f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dc7d1281249f9a7156d78cfe6ea34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:53.159387 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-eca1bf67-d796-4e64-9a24-0ef6c90992c9 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '186666f2b025405980f87dee46e405f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dc7d1281249f9a7156d78cfe6ea34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:53.159861 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-49e9d0fb-541a-4297-b54a-ae4608aeaa62 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:53.160541 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-49e9d0fb-541a-4297-b54a-ae4608aeaa62 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:53.161121 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-49e9d0fb-541a-4297-b54a-ae4608aeaa62 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:53.162488 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-49e9d0fb-541a-4297-b54a-ae4608aeaa62 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:53.164385 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-49e9d0fb-541a-4297-b54a-ae4608aeaa62 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:53.164558 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-eca1bf67-d796-4e64-9a24-0ef6c90992c9 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '186666f2b025405980f87dee46e405f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dc7d1281249f9a7156d78cfe6ea34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:53.165049 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-49e9d0fb-541a-4297-b54a-ae4608aeaa62 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:53.169362 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-eca1bf67-d796-4e64-9a24-0ef6c90992c9 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] 10.222.0.60 "GET /compute/v2.1/servers/021c8f29-b243-4253-9c83-0d970376acd5" status: 200 len: 1359 microversion: 2.21 time: 0.354836 Oct 18 15:45:53.180856 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2285/4589] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:45:52 2022] GET /compute/v2.1/servers/021c8f29-b243-4253-9c83-0d970376acd5 => generated 1359 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:45:53.341681 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-43247b3a-9b2c-444f-8e41-9cba8538599b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:53.342311 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-43247b3a-9b2c-444f-8e41-9cba8538599b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 50e19888-f65b-4eaa-8a40-47733d990b8e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:53.354501 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-43247b3a-9b2c-444f-8e41-9cba8538599b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:53.357636 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-43247b3a-9b2c-444f-8e41-9cba8538599b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:53.358634 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-43247b3a-9b2c-444f-8e41-9cba8538599b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:53.359388 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-43247b3a-9b2c-444f-8e41-9cba8538599b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:53.359860 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-43247b3a-9b2c-444f-8e41-9cba8538599b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:53.363157 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-43247b3a-9b2c-444f-8e41-9cba8538599b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:53.646935 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-49e9d0fb-541a-4297-b54a-ae4608aeaa62 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:53.660203 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-49e9d0fb-541a-4297-b54a-ae4608aeaa62 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1520 microversion: 2.1 time: 0.521159 Oct 18 15:45:53.669509 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2305/4590] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:53 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1520 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:45:53.766592 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-43247b3a-9b2c-444f-8e41-9cba8538599b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:53.788552 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-43247b3a-9b2c-444f-8e41-9cba8538599b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e" status: 200 len: 1513 microversion: 2.1 time: 0.452573 Oct 18 15:45:53.794990 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2286/4591] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:53 2022] GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e => generated 1513 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:54.017036 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6e577039-316d-4fe3-b11e-be7e73b7b544 tempest-VolumesGetTestJSON-1071018540 tempest-VolumesGetTestJSON-1071018540-project] Calling method '.version_select at 0x7f7c3c1b0940>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:54.172209 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6e577039-316d-4fe3-b11e-be7e73b7b544 tempest-VolumesGetTestJSON-1071018540 tempest-VolumesGetTestJSON-1071018540-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/1cb94968-9d7b-4a7b-9a50-6d86a258469e" status: 200 len: 353 microversion: 2.1 time: 0.160442 Oct 18 15:45:54.175408 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2306/4592] 10.222.0.60 () {58 vars in 1245 bytes} [Tue Oct 18 15:45:54 2022] GET /compute/v2.1/os-volumes/1cb94968-9d7b-4a7b-9a50-6d86a258469e => generated 353 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:45:54.196051 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4e9598ec-d1b6-4738-8999-31a978fd5d5c tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:54.196748 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4e9598ec-d1b6-4738-8999-31a978fd5d5c tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] [instance: 021c8f29-b243-4253-9c83-0d970376acd5] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:54.217750 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e9598ec-d1b6-4738-8999-31a978fd5d5c tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:54.222555 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e9598ec-d1b6-4738-8999-31a978fd5d5c tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:54.223272 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e9598ec-d1b6-4738-8999-31a978fd5d5c tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:54.227531 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e9598ec-d1b6-4738-8999-31a978fd5d5c tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:54.231077 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e9598ec-d1b6-4738-8999-31a978fd5d5c tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:54.233417 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e9598ec-d1b6-4738-8999-31a978fd5d5c tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:54.542145 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-e250a1cd-d35e-44f4-ba8a-d74f7acab114 req-d9ec7b95-6549-441a-af9e-82799ef9484b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "021c8f29-b243-4253-9c83-0d970376acd5", "name": "network-vif-plugged", "status": "completed", "tag": "eea23ea0-f0a5-446d-991d-74a012a6ca33"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:45:54.562640 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-e250a1cd-d35e-44f4-ba8a-d74f7acab114 req-d9ec7b95-6549-441a-af9e-82799ef9484b service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:54.563628 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-e250a1cd-d35e-44f4-ba8a-d74f7acab114 req-d9ec7b95-6549-441a-af9e-82799ef9484b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:54.564596 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-e250a1cd-d35e-44f4-ba8a-d74f7acab114 req-d9ec7b95-6549-441a-af9e-82799ef9484b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:54.581746 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-e250a1cd-d35e-44f4-ba8a-d74f7acab114 req-d9ec7b95-6549-441a-af9e-82799ef9484b service nova] Creating event network-vif-plugged:eea23ea0-f0a5-446d-991d-74a012a6ca33 for instance 021c8f29-b243-4253-9c83-0d970376acd5 on n-h1-853682-5 Oct 18 15:45:54.588953 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-e250a1cd-d35e-44f4-ba8a-d74f7acab114 req-d9ec7b95-6549-441a-af9e-82799ef9484b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053455 Oct 18 15:45:54.590644 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2307/4593] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:45:54.691797 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-037630f4-1fcc-4dd7-bbf2-860c75785166 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:54.692781 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-037630f4-1fcc-4dd7-bbf2-860c75785166 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:54.703627 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-037630f4-1fcc-4dd7-bbf2-860c75785166 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:54.704141 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-037630f4-1fcc-4dd7-bbf2-860c75785166 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:54.704642 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-037630f4-1fcc-4dd7-bbf2-860c75785166 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:54.706703 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-037630f4-1fcc-4dd7-bbf2-860c75785166 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:54.707202 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-037630f4-1fcc-4dd7-bbf2-860c75785166 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:54.707620 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-037630f4-1fcc-4dd7-bbf2-860c75785166 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:54.737460 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4e9598ec-d1b6-4738-8999-31a978fd5d5c tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186666f2b025405980f87dee46e405f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dc7d1281249f9a7156d78cfe6ea34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:54.762815 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4e9598ec-d1b6-4738-8999-31a978fd5d5c tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '186666f2b025405980f87dee46e405f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dc7d1281249f9a7156d78cfe6ea34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:54.764538 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4e9598ec-d1b6-4738-8999-31a978fd5d5c tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '186666f2b025405980f87dee46e405f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dc7d1281249f9a7156d78cfe6ea34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:54.778362 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4e9598ec-d1b6-4738-8999-31a978fd5d5c tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] 10.222.0.60 "GET /compute/v2.1/servers/021c8f29-b243-4253-9c83-0d970376acd5" status: 200 len: 1359 microversion: 2.21 time: 0.586452 Oct 18 15:45:54.797506 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2287/4594] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:45:54 2022] GET /compute/v2.1/servers/021c8f29-b243-4253-9c83-0d970376acd5 => generated 1359 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:45:54.827378 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a2bf04d7-839b-43c4-b1ee-04a157ef6aa9 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:54.841033 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a2bf04d7-839b-43c4-b1ee-04a157ef6aa9 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 50e19888-f65b-4eaa-8a40-47733d990b8e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:54.851142 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2bf04d7-839b-43c4-b1ee-04a157ef6aa9 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:54.865547 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2bf04d7-839b-43c4-b1ee-04a157ef6aa9 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:54.866240 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2bf04d7-839b-43c4-b1ee-04a157ef6aa9 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:54.867512 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2bf04d7-839b-43c4-b1ee-04a157ef6aa9 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:54.868019 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2bf04d7-839b-43c4-b1ee-04a157ef6aa9 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:54.868461 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2bf04d7-839b-43c4-b1ee-04a157ef6aa9 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:55.152099 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-037630f4-1fcc-4dd7-bbf2-860c75785166 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:55.165977 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-037630f4-1fcc-4dd7-bbf2-860c75785166 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1520 microversion: 2.1 time: 0.483681 Oct 18 15:45:55.167699 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2308/4595] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:54 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1520 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:55.191207 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-abbb2b4f-677a-4634-b7ea-f52682b6e52b tempest-VolumesGetTestJSON-1071018540 tempest-VolumesGetTestJSON-1071018540-project] Calling method '.version_select at 0x7f7c3c858430>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:55.219984 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a2bf04d7-839b-43c4-b1ee-04a157ef6aa9 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:55.229565 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a2bf04d7-839b-43c4-b1ee-04a157ef6aa9 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e" status: 200 len: 1513 microversion: 2.1 time: 0.406796 Oct 18 15:45:55.245844 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2288/4596] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:54 2022] GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e => generated 1513 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:55.303195 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-abbb2b4f-677a-4634-b7ea-f52682b6e52b tempest-VolumesGetTestJSON-1071018540 tempest-VolumesGetTestJSON-1071018540-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/1cb94968-9d7b-4a7b-9a50-6d86a258469e" status: 200 len: 354 microversion: 2.1 time: 0.117305 Oct 18 15:45:55.304456 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2309/4597] 10.222.0.60 () {58 vars in 1245 bytes} [Tue Oct 18 15:45:55 2022] GET /compute/v2.1/os-volumes/1cb94968-9d7b-4a7b-9a50-6d86a258469e => generated 354 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:45:55.331956 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dcca77c5-e43e-43a2-abb2-450b24cf93b4 tempest-VolumesGetTestJSON-1071018540 tempest-VolumesGetTestJSON-1071018540-project] Calling method '.version_select at 0x7f7c3cfa00d0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:55.486610 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dcca77c5-e43e-43a2-abb2-450b24cf93b4 tempest-VolumesGetTestJSON-1071018540 tempest-VolumesGetTestJSON-1071018540-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/1cb94968-9d7b-4a7b-9a50-6d86a258469e" status: 200 len: 354 microversion: 2.1 time: 0.162064 Oct 18 15:45:55.487538 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2289/4598] 10.222.0.60 () {58 vars in 1245 bytes} [Tue Oct 18 15:45:55 2022] GET /compute/v2.1/os-volumes/1cb94968-9d7b-4a7b-9a50-6d86a258469e => generated 354 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:45:55.502510 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-aa6f49b9-cf4b-4a32-a4cb-567af00a2f71 tempest-VolumesGetTestJSON-1071018540 tempest-VolumesGetTestJSON-1071018540-project] Calling method '.version_select at 0x7f7c3c229820>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:55.674992 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-aa6f49b9-cf4b-4a32-a4cb-567af00a2f71 tempest-VolumesGetTestJSON-1071018540 tempest-VolumesGetTestJSON-1071018540-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/1cb94968-9d7b-4a7b-9a50-6d86a258469e" status: 202 len: 0 microversion: 2.1 time: 0.176608 Oct 18 15:45:55.675575 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2310/4599] 10.222.0.60 () {58 vars in 1248 bytes} [Tue Oct 18 15:45:55 2022] DELETE /compute/v2.1/os-volumes/1cb94968-9d7b-4a7b-9a50-6d86a258469e => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:45:55.683511 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a1f0deee-ee86-4756-8478-ade604f5760d tempest-VolumesGetTestJSON-1071018540 tempest-VolumesGetTestJSON-1071018540-project] Calling method '.version_select at 0x7f7c3c5295e0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:55.810283 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-64b261b6-ce5e-4d40-b1a9-ac448a9258d6 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:55.811045 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-64b261b6-ce5e-4d40-b1a9-ac448a9258d6 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] [instance: 021c8f29-b243-4253-9c83-0d970376acd5] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:55.818690 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a1f0deee-ee86-4756-8478-ade604f5760d tempest-VolumesGetTestJSON-1071018540 tempest-VolumesGetTestJSON-1071018540-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/1cb94968-9d7b-4a7b-9a50-6d86a258469e" status: 200 len: 353 microversion: 2.1 time: 0.138347 Oct 18 15:45:55.819800 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2290/4600] 10.222.0.60 () {58 vars in 1245 bytes} [Tue Oct 18 15:45:55 2022] GET /compute/v2.1/os-volumes/1cb94968-9d7b-4a7b-9a50-6d86a258469e => generated 353 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:45:55.842436 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-64b261b6-ce5e-4d40-b1a9-ac448a9258d6 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:55.845047 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-64b261b6-ce5e-4d40-b1a9-ac448a9258d6 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:55.845751 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-64b261b6-ce5e-4d40-b1a9-ac448a9258d6 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:55.846934 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-64b261b6-ce5e-4d40-b1a9-ac448a9258d6 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:55.847769 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-64b261b6-ce5e-4d40-b1a9-ac448a9258d6 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:55.848530 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-64b261b6-ce5e-4d40-b1a9-ac448a9258d6 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:56.197704 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-64b261b6-ce5e-4d40-b1a9-ac448a9258d6 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186666f2b025405980f87dee46e405f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dc7d1281249f9a7156d78cfe6ea34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:56.202210 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-665e2f59-5675-419d-b0fc-eb869da3e1df tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:56.205506 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-665e2f59-5675-419d-b0fc-eb869da3e1df tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:56.225006 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-64b261b6-ce5e-4d40-b1a9-ac448a9258d6 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '186666f2b025405980f87dee46e405f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dc7d1281249f9a7156d78cfe6ea34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:56.241614 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-665e2f59-5675-419d-b0fc-eb869da3e1df tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:56.242239 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-665e2f59-5675-419d-b0fc-eb869da3e1df tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:56.243842 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-64b261b6-ce5e-4d40-b1a9-ac448a9258d6 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '186666f2b025405980f87dee46e405f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dc7d1281249f9a7156d78cfe6ea34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:56.253229 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-64b261b6-ce5e-4d40-b1a9-ac448a9258d6 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] 10.222.0.60 "GET /compute/v2.1/servers/021c8f29-b243-4253-9c83-0d970376acd5" status: 200 len: 1359 microversion: 2.21 time: 0.441542 Oct 18 15:45:56.255006 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-665e2f59-5675-419d-b0fc-eb869da3e1df tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:56.269464 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2311/4601] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:45:55 2022] GET /compute/v2.1/servers/021c8f29-b243-4253-9c83-0d970376acd5 => generated 1359 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:45:56.269639 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-665e2f59-5675-419d-b0fc-eb869da3e1df tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:56.269639 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-665e2f59-5675-419d-b0fc-eb869da3e1df tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:56.269898 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e118c4e7-8c51-441b-9288-2c40e685d1ce tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:56.270252 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e118c4e7-8c51-441b-9288-2c40e685d1ce tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 50e19888-f65b-4eaa-8a40-47733d990b8e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:56.272350 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-665e2f59-5675-419d-b0fc-eb869da3e1df tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:56.282530 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e118c4e7-8c51-441b-9288-2c40e685d1ce tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:56.283557 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e118c4e7-8c51-441b-9288-2c40e685d1ce tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:56.284085 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e118c4e7-8c51-441b-9288-2c40e685d1ce tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:56.284937 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e118c4e7-8c51-441b-9288-2c40e685d1ce tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:56.286276 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e118c4e7-8c51-441b-9288-2c40e685d1ce tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:56.286777 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e118c4e7-8c51-441b-9288-2c40e685d1ce tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:56.564429 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e118c4e7-8c51-441b-9288-2c40e685d1ce tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:56.584942 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e118c4e7-8c51-441b-9288-2c40e685d1ce tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e" status: 200 len: 1513 microversion: 2.1 time: 0.326704 Oct 18 15:45:56.586311 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2312/4602] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:56 2022] GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e => generated 1513 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:56.814315 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-665e2f59-5675-419d-b0fc-eb869da3e1df tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:56.833934 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b9e5dc42-30a9-4789-ac6f-1915069aac60 tempest-VolumesGetTestJSON-1071018540 tempest-VolumesGetTestJSON-1071018540-project] Calling method '.version_select at 0x7f7c3c2559d0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:56.850023 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-665e2f59-5675-419d-b0fc-eb869da3e1df tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1520 microversion: 2.1 time: 0.655973 Oct 18 15:45:56.871629 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2291/4603] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:56 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1520 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:56.945405 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b9e5dc42-30a9-4789-ac6f-1915069aac60 tempest-VolumesGetTestJSON-1071018540 tempest-VolumesGetTestJSON-1071018540-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/1cb94968-9d7b-4a7b-9a50-6d86a258469e" status: 200 len: 353 microversion: 2.1 time: 0.115094 Oct 18 15:45:56.946955 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2313/4604] 10.222.0.60 () {58 vars in 1245 bytes} [Tue Oct 18 15:45:56 2022] GET /compute/v2.1/os-volumes/1cb94968-9d7b-4a7b-9a50-6d86a258469e => generated 353 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:45:57.286639 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-62cd5efd-5721-4b0d-a18d-83d3d03f11a8 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:57.287514 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-62cd5efd-5721-4b0d-a18d-83d3d03f11a8 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] [instance: 021c8f29-b243-4253-9c83-0d970376acd5] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:57.301583 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62cd5efd-5721-4b0d-a18d-83d3d03f11a8 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:57.305894 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62cd5efd-5721-4b0d-a18d-83d3d03f11a8 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:57.308120 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62cd5efd-5721-4b0d-a18d-83d3d03f11a8 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:57.310021 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62cd5efd-5721-4b0d-a18d-83d3d03f11a8 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:57.311213 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62cd5efd-5721-4b0d-a18d-83d3d03f11a8 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:57.313165 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62cd5efd-5721-4b0d-a18d-83d3d03f11a8 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:57.516271 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-62cd5efd-5721-4b0d-a18d-83d3d03f11a8 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186666f2b025405980f87dee46e405f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dc7d1281249f9a7156d78cfe6ea34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:57.526300 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-62cd5efd-5721-4b0d-a18d-83d3d03f11a8 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '186666f2b025405980f87dee46e405f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dc7d1281249f9a7156d78cfe6ea34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:57.540860 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-62cd5efd-5721-4b0d-a18d-83d3d03f11a8 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '186666f2b025405980f87dee46e405f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dc7d1281249f9a7156d78cfe6ea34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:57.546337 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-62cd5efd-5721-4b0d-a18d-83d3d03f11a8 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] 10.222.0.60 "GET /compute/v2.1/servers/021c8f29-b243-4253-9c83-0d970376acd5" status: 200 len: 1552 microversion: 2.21 time: 0.264707 Oct 18 15:45:57.550489 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2292/4605] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:45:57 2022] GET /compute/v2.1/servers/021c8f29-b243-4253-9c83-0d970376acd5 => generated 1552 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:45:57.578542 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5969831f-290e-4c14-bdca-8730549a0695 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:57.579700 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5969831f-290e-4c14-bdca-8730549a0695 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] [instance: 021c8f29-b243-4253-9c83-0d970376acd5] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:57.587739 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5969831f-290e-4c14-bdca-8730549a0695 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:57.588442 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5969831f-290e-4c14-bdca-8730549a0695 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:57.589309 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5969831f-290e-4c14-bdca-8730549a0695 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:57.590519 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5969831f-290e-4c14-bdca-8730549a0695 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:57.591197 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5969831f-290e-4c14-bdca-8730549a0695 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:57.591846 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5969831f-290e-4c14-bdca-8730549a0695 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:57.609383 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1eac4a7d-9381-4763-9153-0f99fd489683 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:57.610592 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1eac4a7d-9381-4763-9153-0f99fd489683 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 50e19888-f65b-4eaa-8a40-47733d990b8e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:57.638704 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1eac4a7d-9381-4763-9153-0f99fd489683 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:57.639263 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1eac4a7d-9381-4763-9153-0f99fd489683 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:57.639704 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1eac4a7d-9381-4763-9153-0f99fd489683 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:57.645446 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1eac4a7d-9381-4763-9153-0f99fd489683 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:57.646079 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1eac4a7d-9381-4763-9153-0f99fd489683 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:57.646638 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1eac4a7d-9381-4763-9153-0f99fd489683 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:57.651237 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5969831f-290e-4c14-bdca-8730549a0695 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] [instance: 021c8f29-b243-4253-9c83-0d970376acd5] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:45:57.824304 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5969831f-290e-4c14-bdca-8730549a0695 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] 10.222.0.60 "DELETE /compute/v2.1/servers/021c8f29-b243-4253-9c83-0d970376acd5" status: 204 len: 0 microversion: 2.21 time: 0.251771 Oct 18 15:45:57.829243 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2314/4606] 10.222.0.60 () {60 vars in 1280 bytes} [Tue Oct 18 15:45:57 2022] DELETE /compute/v2.1/servers/021c8f29-b243-4253-9c83-0d970376acd5 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 15:45:57.842620 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-691ad87d-fb7e-49b9-95e4-f17a59c135fc tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:57.844194 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-691ad87d-fb7e-49b9-95e4-f17a59c135fc tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] [instance: 021c8f29-b243-4253-9c83-0d970376acd5] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:57.854975 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-691ad87d-fb7e-49b9-95e4-f17a59c135fc tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:57.865374 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-691ad87d-fb7e-49b9-95e4-f17a59c135fc tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:57.867117 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-691ad87d-fb7e-49b9-95e4-f17a59c135fc tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:57.869016 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-691ad87d-fb7e-49b9-95e4-f17a59c135fc tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:57.872087 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-691ad87d-fb7e-49b9-95e4-f17a59c135fc tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:57.872716 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-691ad87d-fb7e-49b9-95e4-f17a59c135fc tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:58.008369 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1eac4a7d-9381-4763-9153-0f99fd489683 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:58.019821 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1eac4a7d-9381-4763-9153-0f99fd489683 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e" status: 200 len: 1513 microversion: 2.1 time: 0.414483 Oct 18 15:45:58.038843 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2293/4607] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:57 2022] GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e => generated 1513 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:45:58.045559 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-15df475c-3376-41f5-9b12-552f85038d6b tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:58.046567 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-15df475c-3376-41f5-9b12-552f85038d6b tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:58.054571 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15df475c-3376-41f5-9b12-552f85038d6b tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:58.055539 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15df475c-3376-41f5-9b12-552f85038d6b tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:58.056232 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15df475c-3376-41f5-9b12-552f85038d6b tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:58.057570 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15df475c-3376-41f5-9b12-552f85038d6b tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:58.058789 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15df475c-3376-41f5-9b12-552f85038d6b tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:58.059446 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15df475c-3376-41f5-9b12-552f85038d6b tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:58.174851 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-691ad87d-fb7e-49b9-95e4-f17a59c135fc tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186666f2b025405980f87dee46e405f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dc7d1281249f9a7156d78cfe6ea34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:58.187136 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-691ad87d-fb7e-49b9-95e4-f17a59c135fc tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '186666f2b025405980f87dee46e405f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dc7d1281249f9a7156d78cfe6ea34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:58.189081 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-691ad87d-fb7e-49b9-95e4-f17a59c135fc tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '186666f2b025405980f87dee46e405f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dc7d1281249f9a7156d78cfe6ea34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:58.195976 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-691ad87d-fb7e-49b9-95e4-f17a59c135fc tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] 10.222.0.60 "GET /compute/v2.1/servers/021c8f29-b243-4253-9c83-0d970376acd5" status: 200 len: 1558 microversion: 2.21 time: 0.361846 Oct 18 15:45:58.197132 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2315/4608] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:45:57 2022] GET /compute/v2.1/servers/021c8f29-b243-4253-9c83-0d970376acd5 => generated 1558 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:45:58.203161 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ed0d4611-2e79-4949-a7d4-9ffda5caa91a tempest-VolumesGetTestJSON-1071018540 tempest-VolumesGetTestJSON-1071018540-project] Calling method '.version_select at 0x7f7c3c255dc0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:58.318979 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ed0d4611-2e79-4949-a7d4-9ffda5caa91a tempest-VolumesGetTestJSON-1071018540 tempest-VolumesGetTestJSON-1071018540-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/1cb94968-9d7b-4a7b-9a50-6d86a258469e" status: 200 len: 353 microversion: 2.1 time: 0.120453 Oct 18 15:45:58.320112 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2316/4609] 10.222.0.60 () {58 vars in 1245 bytes} [Tue Oct 18 15:45:58 2022] GET /compute/v2.1/os-volumes/1cb94968-9d7b-4a7b-9a50-6d86a258469e => generated 353 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:45:58.444518 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-15df475c-3376-41f5-9b12-552f85038d6b tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:58.466894 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-15df475c-3376-41f5-9b12-552f85038d6b tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1520 microversion: 2.1 time: 0.426304 Oct 18 15:45:58.473209 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2294/4610] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:58 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1520 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:59.050380 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-520088a4-53ac-4c6f-8201-e1f0040f1318 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:59.050999 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-520088a4-53ac-4c6f-8201-e1f0040f1318 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 50e19888-f65b-4eaa-8a40-47733d990b8e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:59.067517 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-520088a4-53ac-4c6f-8201-e1f0040f1318 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:59.068025 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-520088a4-53ac-4c6f-8201-e1f0040f1318 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:59.068472 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-520088a4-53ac-4c6f-8201-e1f0040f1318 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:59.069347 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-520088a4-53ac-4c6f-8201-e1f0040f1318 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:59.069825 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-520088a4-53ac-4c6f-8201-e1f0040f1318 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:59.070260 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-520088a4-53ac-4c6f-8201-e1f0040f1318 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:59.222849 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-94fc5838-2643-425f-a277-b1de1a5ca72c tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:59.223475 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-94fc5838-2643-425f-a277-b1de1a5ca72c tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] [instance: 021c8f29-b243-4253-9c83-0d970376acd5] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:59.232705 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94fc5838-2643-425f-a277-b1de1a5ca72c tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:59.233577 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94fc5838-2643-425f-a277-b1de1a5ca72c tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:59.242130 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94fc5838-2643-425f-a277-b1de1a5ca72c tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:59.243355 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94fc5838-2643-425f-a277-b1de1a5ca72c tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:59.247964 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94fc5838-2643-425f-a277-b1de1a5ca72c tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:59.248638 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94fc5838-2643-425f-a277-b1de1a5ca72c tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:59.598918 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-520088a4-53ac-4c6f-8201-e1f0040f1318 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:59.614291 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-520088a4-53ac-4c6f-8201-e1f0040f1318 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e" status: 200 len: 1519 microversion: 2.1 time: 0.568736 Oct 18 15:45:59.614934 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2317/4611] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:59 2022] GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e => generated 1519 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:59.635708 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d3c12f60-b6b0-4ccd-8bc0-89da25df3c0c tempest-VolumesGetTestJSON-1071018540 tempest-VolumesGetTestJSON-1071018540-project] Calling method '.version_select at 0x7f7c3d77eee0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:59.710626 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-d3c12f60-b6b0-4ccd-8bc0-89da25df3c0c tempest-VolumesGetTestJSON-1071018540 tempest-VolumesGetTestJSON-1071018540-project] HTTP exception thrown: Volume 1cb94968-9d7b-4a7b-9a50-6d86a258469e could not be found. Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d3c12f60-b6b0-4ccd-8bc0-89da25df3c0c tempest-VolumesGetTestJSON-1071018540 tempest-VolumesGetTestJSON-1071018540-project] Request method failure captured: Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/os-volumes/1cb94968-9d7b-4a7b-9a50-6d86a258469e HTTP/1.1 Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsowDrqa4hvU5UGsYXXIFIQFcC1Q4lVz2jDPGV1PVjVIKA7QOSrz96xuT_WYH5DmfFypErBNLIEgHrQeby7bTXauGLRD_axVu1rCsP3a22ijID80k7JtD7quDbRt9vdXeXNgBNACpqCnrIsQuXEowqGG2ihO6LUM03Uiz8NiVZyfRZ0 Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 751a3cc137eb4ebc969d2b4336fea27c Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-VolumesGetTestJSON-1071018540 Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/751a3cc137eb4ebc969d2b4336fea27c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/751a3cc137eb4ebc969d2b4336fea27c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/751a3cc137eb4ebc969d2b4336fea27c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_751a3cc137eb4ebc969d2b4336fea27c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-VolumesGetTestJSON-1071018540 Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 751a3cc137eb4ebc969d2b4336fea27c Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-VolumesGetTestJSON-1071018540 Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-VolumesGetTestJSON-1071018540-project Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: b4119f4800cb4c87b2ee27099fae5f96 Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-VolumesGetTestJSON-1071018540-project Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: method: Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: exception: Volume 1cb94968-9d7b-4a7b-9a50-6d86a258469e could not be found. Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '1cb94968-9d7b-4a7b-9a50-6d86a258469e'} Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1cb94968-9d7b-4a7b-9a50-6d86a258469e could not be found. (HTTP 404) (Request-ID: req-379e0ac4-bdb9-4f69-b9cd-a0bfef0522a8) Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 18 15:45:59.714734 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 15:45:59.719230 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 15:45:59.719230 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 18 15:45:59.719230 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 18 15:45:59.719230 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 18 15:45:59.719230 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 18 15:45:59.719230 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 15:45:59.719230 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 15:45:59.719230 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 15:45:59.719230 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 15:45:59.719230 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 15:45:59.719230 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 15:45:59.719230 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 15:45:59.719230 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 15:45:59.719230 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1cb94968-9d7b-4a7b-9a50-6d86a258469e could not be found. Oct 18 15:45:59.719230 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:45:59.719230 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:45:59.719230 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:45:59.719230 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:45:59.719230 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:45:59.719230 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:45:59.719230 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:45:59.719230 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:45:59.719230 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 15:45:59.719230 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 15:45:59.719230 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:45:59.719230 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:45:59.719230 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 18 15:45:59.719230 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:45:59.719230 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1cb94968-9d7b-4a7b-9a50-6d86a258469e could not be found. Oct 18 15:45:59.719230 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:45:59.719230 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:45:59.719230 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:45:59.719230 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:45:59.719230 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:45:59.719230 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:45:59.719230 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:45:59.719230 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:45:59.719230 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1cb94968-9d7b-4a7b-9a50-6d86a258469e could not be found. Oct 18 15:45:59.719230 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:45:59.722937 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d3c12f60-b6b0-4ccd-8bc0-89da25df3c0c tempest-VolumesGetTestJSON-1071018540 tempest-VolumesGetTestJSON-1071018540-project] Returning 404 to user: Volume 1cb94968-9d7b-4a7b-9a50-6d86a258469e could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:45:59.723961 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d3c12f60-b6b0-4ccd-8bc0-89da25df3c0c tempest-VolumesGetTestJSON-1071018540 tempest-VolumesGetTestJSON-1071018540-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/1cb94968-9d7b-4a7b-9a50-6d86a258469e" status: 404 len: 109 microversion: 2.1 time: 0.097324 Oct 18 15:45:59.725568 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2318/4612] 10.222.0.60 () {58 vars in 1245 bytes} [Tue Oct 18 15:45:59 2022] GET /compute/v2.1/os-volumes/1cb94968-9d7b-4a7b-9a50-6d86a258469e => generated 109 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:45:59.735332 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7d1e5595-2632-43a3-a7e8-768f5f0c625c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:45:59.736178 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7d1e5595-2632-43a3-a7e8-768f5f0c625c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:45:59.754371 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7d1e5595-2632-43a3-a7e8-768f5f0c625c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:59.755108 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7d1e5595-2632-43a3-a7e8-768f5f0c625c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:59.755719 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7d1e5595-2632-43a3-a7e8-768f5f0c625c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:59.756612 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7d1e5595-2632-43a3-a7e8-768f5f0c625c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:45:59.757258 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7d1e5595-2632-43a3-a7e8-768f5f0c625c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:45:59.761314 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7d1e5595-2632-43a3-a7e8-768f5f0c625c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:45:59.770989 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:59.940673 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-94fc5838-2643-425f-a277-b1de1a5ca72c tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186666f2b025405980f87dee46e405f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dc7d1281249f9a7156d78cfe6ea34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:59.956503 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-94fc5838-2643-425f-a277-b1de1a5ca72c tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '186666f2b025405980f87dee46e405f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dc7d1281249f9a7156d78cfe6ea34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:59.960687 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-94fc5838-2643-425f-a277-b1de1a5ca72c tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '186666f2b025405980f87dee46e405f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dc7d1281249f9a7156d78cfe6ea34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:45:59.965713 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-94fc5838-2643-425f-a277-b1de1a5ca72c tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] 10.222.0.60 "GET /compute/v2.1/servers/021c8f29-b243-4253-9c83-0d970376acd5" status: 200 len: 1558 microversion: 2.21 time: 0.745027 Oct 18 15:45:59.985768 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2295/4613] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:45:59 2022] GET /compute/v2.1/servers/021c8f29-b243-4253-9c83-0d970376acd5 => generated 1558 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:46:00.170924 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7d1e5595-2632-43a3-a7e8-768f5f0c625c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:00.179973 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7d1e5595-2632-43a3-a7e8-768f5f0c625c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1520 microversion: 2.1 time: 0.453084 Oct 18 15:46:00.185919 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2319/4614] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:45:59 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1520 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:00.643849 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8abb5b39-5597-4b99-96b3-0fa6b0a29fd6 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:00.645191 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8abb5b39-5597-4b99-96b3-0fa6b0a29fd6 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 50e19888-f65b-4eaa-8a40-47733d990b8e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:00.668396 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8abb5b39-5597-4b99-96b3-0fa6b0a29fd6 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:00.670745 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8abb5b39-5597-4b99-96b3-0fa6b0a29fd6 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:00.671438 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8abb5b39-5597-4b99-96b3-0fa6b0a29fd6 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:00.678977 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8abb5b39-5597-4b99-96b3-0fa6b0a29fd6 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:00.679829 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8abb5b39-5597-4b99-96b3-0fa6b0a29fd6 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:00.682093 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8abb5b39-5597-4b99-96b3-0fa6b0a29fd6 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:00.994200 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ae184690-86b3-443a-bc06-24d4745d2341 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:00.994875 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ae184690-86b3-443a-bc06-24d4745d2341 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] [instance: 021c8f29-b243-4253-9c83-0d970376acd5] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:01.011358 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae184690-86b3-443a-bc06-24d4745d2341 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:01.012136 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae184690-86b3-443a-bc06-24d4745d2341 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:01.012845 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae184690-86b3-443a-bc06-24d4745d2341 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:01.013754 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae184690-86b3-443a-bc06-24d4745d2341 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:01.014427 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae184690-86b3-443a-bc06-24d4745d2341 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:01.015024 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae184690-86b3-443a-bc06-24d4745d2341 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:01.181830 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ae184690-86b3-443a-bc06-24d4745d2341 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186666f2b025405980f87dee46e405f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dc7d1281249f9a7156d78cfe6ea34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:01.206894 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ae184690-86b3-443a-bc06-24d4745d2341 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '186666f2b025405980f87dee46e405f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dc7d1281249f9a7156d78cfe6ea34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:01.221205 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ae184690-86b3-443a-bc06-24d4745d2341 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '186666f2b025405980f87dee46e405f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dc7d1281249f9a7156d78cfe6ea34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:01.228532 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ae184690-86b3-443a-bc06-24d4745d2341 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] 10.222.0.60 "GET /compute/v2.1/servers/021c8f29-b243-4253-9c83-0d970376acd5" status: 200 len: 1516 microversion: 2.21 time: 0.239398 Oct 18 15:46:01.252633 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2320/4615] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:46:00 2022] GET /compute/v2.1/servers/021c8f29-b243-4253-9c83-0d970376acd5 => generated 1516 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:46:01.262822 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-a91dee99-af3a-401d-a5e1-39f8365cbf84 req-29dced21-fad5-4080-ba70-e1465532ba4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "021c8f29-b243-4253-9c83-0d970376acd5", "name": "network-vif-deleted", "tag": "eea23ea0-f0a5-446d-991d-74a012a6ca33"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:46:01.302235 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-a91dee99-af3a-401d-a5e1-39f8365cbf84 req-29dced21-fad5-4080-ba70-e1465532ba4a service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:01.302820 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-a91dee99-af3a-401d-a5e1-39f8365cbf84 req-29dced21-fad5-4080-ba70-e1465532ba4a service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:01.303322 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-a91dee99-af3a-401d-a5e1-39f8365cbf84 req-29dced21-fad5-4080-ba70-e1465532ba4a service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:01.341484 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-a91dee99-af3a-401d-a5e1-39f8365cbf84 req-29dced21-fad5-4080-ba70-e1465532ba4a service nova] Creating event network-vif-deleted:eea23ea0-f0a5-446d-991d-74a012a6ca33 for instance 021c8f29-b243-4253-9c83-0d970376acd5 on n-h1-853682-5 Oct 18 15:46:01.348791 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-a91dee99-af3a-401d-a5e1-39f8365cbf84 req-29dced21-fad5-4080-ba70-e1465532ba4a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094362 Oct 18 15:46:01.353360 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2321/4616] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:46:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:46:01.364602 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-dd784e0c-5b18-4abd-b486-e86ed293c62e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:01.373971 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-dd784e0c-5b18-4abd-b486-e86ed293c62e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:01.381006 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dd784e0c-5b18-4abd-b486-e86ed293c62e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:01.381766 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dd784e0c-5b18-4abd-b486-e86ed293c62e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:01.382374 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dd784e0c-5b18-4abd-b486-e86ed293c62e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:01.384377 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dd784e0c-5b18-4abd-b486-e86ed293c62e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:01.385151 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dd784e0c-5b18-4abd-b486-e86ed293c62e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:01.386479 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dd784e0c-5b18-4abd-b486-e86ed293c62e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:01.588161 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8abb5b39-5597-4b99-96b3-0fa6b0a29fd6 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:01.604099 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8abb5b39-5597-4b99-96b3-0fa6b0a29fd6 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e" status: 200 len: 1519 microversion: 2.1 time: 0.964606 Oct 18 15:46:01.609882 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2296/4617] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:00 2022] GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e => generated 1519 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:01.991392 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-dd784e0c-5b18-4abd-b486-e86ed293c62e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:02.003303 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-dd784e0c-5b18-4abd-b486-e86ed293c62e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1520 microversion: 2.1 time: 0.648528 Oct 18 15:46:02.008017 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2322/4618] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:01 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1520 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:02.256116 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-04655d8d-2d00-48e8-acc8-f4e6f6477300 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:02.257266 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-04655d8d-2d00-48e8-acc8-f4e6f6477300 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] [instance: 021c8f29-b243-4253-9c83-0d970376acd5] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:02.267965 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-5ac48797-83db-4cd0-aa64-53a751259da7 req-ffa5d418-0aac-4280-9f72-4cc7000c84a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50e19888-f65b-4eaa-8a40-47733d990b8e", "name": "network-vif-unplugged", "status": "completed", "tag": "e9e62ab9-78c2-4cf9-a44c-7b0b834cfaf3"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:46:02.284269 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04655d8d-2d00-48e8-acc8-f4e6f6477300 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:02.287965 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04655d8d-2d00-48e8-acc8-f4e6f6477300 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:02.295912 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-5ac48797-83db-4cd0-aa64-53a751259da7 req-ffa5d418-0aac-4280-9f72-4cc7000c84a3 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:02.296320 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04655d8d-2d00-48e8-acc8-f4e6f6477300 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:02.297413 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04655d8d-2d00-48e8-acc8-f4e6f6477300 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:02.298235 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04655d8d-2d00-48e8-acc8-f4e6f6477300 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:02.298839 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04655d8d-2d00-48e8-acc8-f4e6f6477300 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:02.302089 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-5ac48797-83db-4cd0-aa64-53a751259da7 req-ffa5d418-0aac-4280-9f72-4cc7000c84a3 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:02.305890 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-5ac48797-83db-4cd0-aa64-53a751259da7 req-ffa5d418-0aac-4280-9f72-4cc7000c84a3 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:02.347576 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-5ac48797-83db-4cd0-aa64-53a751259da7 req-ffa5d418-0aac-4280-9f72-4cc7000c84a3 service nova] Creating event network-vif-unplugged:e9e62ab9-78c2-4cf9-a44c-7b0b834cfaf3 for instance 50e19888-f65b-4eaa-8a40-47733d990b8e on n-h2-853682-5 Oct 18 15:46:02.349808 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-04655d8d-2d00-48e8-acc8-f4e6f6477300 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] HTTP exception thrown: Instance 021c8f29-b243-4253-9c83-0d970376acd5 could not be found. Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-04655d8d-2d00-48e8-acc8-f4e6f6477300 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Request method failure captured: Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/021c8f29-b243-4253-9c83-0d970376acd5 HTTP/1.1 Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsohP3Kd2tTMG4eWAG__xkif-jiTTP-YzEERy6DEATAJE6WG1WMOcW4RPUbPtA65gsKibpvGeprjPGzRIkzgh2kkRqSMUkndOiEzMff59I_-9lgPdhn8Dhskz4xfY05ZlFjtOKShk42mbTbEA2bHkTDbSMqCT1fcUbASqcYEzO_APDw Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: X-Openstack-Nova-Api-Version: 2.21 Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: ec6dc7d1281249f9a7156d78cfe6ea34 Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-InstanceActionsV221TestJSON-983419320 Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ec6dc7d1281249f9a7156d78cfe6ea34"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ec6dc7d1281249f9a7156d78cfe6ea34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ec6dc7d1281249f9a7156d78cfe6ea34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ec6dc7d1281249f9a7156d78cfe6ea34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-InstanceActionsV221TestJSON-983419320 Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: ec6dc7d1281249f9a7156d78cfe6ea34 Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-983419320 Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-InstanceActionsV221TestJSON-983419320-project Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 186666f2b025405980f87dee46e405f3 Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-InstanceActionsV221TestJSON-983419320-project Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 021c8f29-b243-4253-9c83-0d970376acd5 could not be found. Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '021c8f29-b243-4253-9c83-0d970376acd5'} Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 021c8f29-b243-4253-9c83-0d970376acd5 could not be found. Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 021c8f29-b243-4253-9c83-0d970376acd5 could not be found. Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:46:02.352330 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:46:02.358445 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:46:02.358445 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:02.358445 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:46:02.358445 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:46:02.358445 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:46:02.358445 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:46:02.358445 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 021c8f29-b243-4253-9c83-0d970376acd5 could not be found. Oct 18 15:46:02.358445 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:46:02.362057 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-04655d8d-2d00-48e8-acc8-f4e6f6477300 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Returning 404 to user: Instance 021c8f29-b243-4253-9c83-0d970376acd5 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:46:02.364622 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-04655d8d-2d00-48e8-acc8-f4e6f6477300 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] 10.222.0.60 "GET /compute/v2.1/servers/021c8f29-b243-4253-9c83-0d970376acd5" status: 404 len: 111 microversion: 2.21 time: 0.112940 Oct 18 15:46:02.367913 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2297/4619] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:46:02 2022] GET /compute/v2.1/servers/021c8f29-b243-4253-9c83-0d970376acd5 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:46:02.368658 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-5ac48797-83db-4cd0-aa64-53a751259da7 req-ffa5d418-0aac-4280-9f72-4cc7000c84a3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104077 Oct 18 15:46:02.369869 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2323/4620] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:46:02.377299 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d27561a8-252d-4abc-b3ca-8f30be2a4c3a tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Calling method '.version_select at 0x7f7c3da0a5e0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:02.378199 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d27561a8-252d-4abc-b3ca-8f30be2a4c3a tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] [instance: 021c8f29-b243-4253-9c83-0d970376acd5] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:02.385292 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d27561a8-252d-4abc-b3ca-8f30be2a4c3a tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:02.386128 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d27561a8-252d-4abc-b3ca-8f30be2a4c3a tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:02.386766 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d27561a8-252d-4abc-b3ca-8f30be2a4c3a tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:02.387681 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d27561a8-252d-4abc-b3ca-8f30be2a4c3a tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:02.388441 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d27561a8-252d-4abc-b3ca-8f30be2a4c3a tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:02.389253 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d27561a8-252d-4abc-b3ca-8f30be2a4c3a tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:02.473538 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d27561a8-252d-4abc-b3ca-8f30be2a4c3a tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] 10.222.0.60 "GET /compute/v2.1/servers/021c8f29-b243-4253-9c83-0d970376acd5/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.100873 Oct 18 15:46:02.474842 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2298/4621] 10.222.0.60 () {60 vars in 1337 bytes} [Tue Oct 18 15:46:02 2022] GET /compute/v2.1/servers/021c8f29-b243-4253-9c83-0d970376acd5/os-instance-actions => generated 611 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:46:02.495382 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1846656c-5ced-4d41-828d-488d0f275b50 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:02.497361 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1846656c-5ced-4d41-828d-488d0f275b50 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] [instance: 021c8f29-b243-4253-9c83-0d970376acd5] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:02.511337 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1846656c-5ced-4d41-828d-488d0f275b50 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:02.511746 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1846656c-5ced-4d41-828d-488d0f275b50 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:02.512190 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1846656c-5ced-4d41-828d-488d0f275b50 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:02.518017 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1846656c-5ced-4d41-828d-488d0f275b50 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:02.518727 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1846656c-5ced-4d41-828d-488d0f275b50 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:02.519379 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1846656c-5ced-4d41-828d-488d0f275b50 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:02.572284 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-1846656c-5ced-4d41-828d-488d0f275b50 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] HTTP exception thrown: Instance 021c8f29-b243-4253-9c83-0d970376acd5 could not be found. Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1846656c-5ced-4d41-828d-488d0f275b50 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Request method failure captured: Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: request: DELETE /compute/v2.1/servers/021c8f29-b243-4253-9c83-0d970376acd5 HTTP/1.1 Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsohP3Kd2tTMG4eWAG__xkif-jiTTP-YzEERy6DEATAJE6WG1WMOcW4RPUbPtA65gsKibpvGeprjPGzRIkzgh2kkRqSMUkndOiEzMff59I_-9lgPdhn8Dhskz4xfY05ZlFjtOKShk42mbTbEA2bHkTDbSMqCT1fcUbASqcYEzO_APDw Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: X-Openstack-Nova-Api-Version: 2.21 Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: ec6dc7d1281249f9a7156d78cfe6ea34 Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-InstanceActionsV221TestJSON-983419320 Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ec6dc7d1281249f9a7156d78cfe6ea34"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ec6dc7d1281249f9a7156d78cfe6ea34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ec6dc7d1281249f9a7156d78cfe6ea34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ec6dc7d1281249f9a7156d78cfe6ea34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-InstanceActionsV221TestJSON-983419320 Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: ec6dc7d1281249f9a7156d78cfe6ea34 Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-983419320 Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-InstanceActionsV221TestJSON-983419320-project Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 186666f2b025405980f87dee46e405f3 Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-InstanceActionsV221TestJSON-983419320-project Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 021c8f29-b243-4253-9c83-0d970376acd5 could not be found. Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '021c8f29-b243-4253-9c83-0d970376acd5'} Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 021c8f29-b243-4253-9c83-0d970376acd5 could not be found. Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:46:02.576065 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:46:02.581560 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 021c8f29-b243-4253-9c83-0d970376acd5 could not be found. Oct 18 15:46:02.581560 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:02.581560 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:46:02.581560 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:02.581560 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:02.581560 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:46:02.581560 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:46:02.581560 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:46:02.581560 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:46:02.581560 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 021c8f29-b243-4253-9c83-0d970376acd5 could not be found. Oct 18 15:46:02.581560 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:02.581560 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1846656c-5ced-4d41-828d-488d0f275b50 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Returning 404 to user: Instance 021c8f29-b243-4253-9c83-0d970376acd5 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:46:02.600376 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1846656c-5ced-4d41-828d-488d0f275b50 tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] 10.222.0.60 "DELETE /compute/v2.1/servers/021c8f29-b243-4253-9c83-0d970376acd5" status: 404 len: 111 microversion: 2.21 time: 0.108537 Oct 18 15:46:02.601024 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2324/4622] 10.222.0.60 () {60 vars in 1280 bytes} [Tue Oct 18 15:46:02 2022] DELETE /compute/v2.1/servers/021c8f29-b243-4253-9c83-0d970376acd5 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 18 15:46:02.610926 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c0d650f9-a7c2-40fb-8959-65067014bccb tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:02.611560 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c0d650f9-a7c2-40fb-8959-65067014bccb tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] [instance: 021c8f29-b243-4253-9c83-0d970376acd5] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:02.653590 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1fb1c6f4-022f-45ba-8b79-31d8d28adf69 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:02.654209 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1fb1c6f4-022f-45ba-8b79-31d8d28adf69 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 50e19888-f65b-4eaa-8a40-47733d990b8e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:02.656962 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0d650f9-a7c2-40fb-8959-65067014bccb tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:02.657469 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0d650f9-a7c2-40fb-8959-65067014bccb tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:02.657912 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0d650f9-a7c2-40fb-8959-65067014bccb tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:02.658634 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0d650f9-a7c2-40fb-8959-65067014bccb tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:02.661862 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0d650f9-a7c2-40fb-8959-65067014bccb tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:02.662380 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0d650f9-a7c2-40fb-8959-65067014bccb tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:02.667599 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1fb1c6f4-022f-45ba-8b79-31d8d28adf69 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:02.668101 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1fb1c6f4-022f-45ba-8b79-31d8d28adf69 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:02.668537 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1fb1c6f4-022f-45ba-8b79-31d8d28adf69 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:02.669357 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1fb1c6f4-022f-45ba-8b79-31d8d28adf69 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:02.703148 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1fb1c6f4-022f-45ba-8b79-31d8d28adf69 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:02.703677 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1fb1c6f4-022f-45ba-8b79-31d8d28adf69 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:02.762642 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-c0d650f9-a7c2-40fb-8959-65067014bccb tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] HTTP exception thrown: Instance 021c8f29-b243-4253-9c83-0d970376acd5 could not be found. Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c0d650f9-a7c2-40fb-8959-65067014bccb tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Request method failure captured: Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/021c8f29-b243-4253-9c83-0d970376acd5 HTTP/1.1 Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsohP3Kd2tTMG4eWAG__xkif-jiTTP-YzEERy6DEATAJE6WG1WMOcW4RPUbPtA65gsKibpvGeprjPGzRIkzgh2kkRqSMUkndOiEzMff59I_-9lgPdhn8Dhskz4xfY05ZlFjtOKShk42mbTbEA2bHkTDbSMqCT1fcUbASqcYEzO_APDw Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: X-Openstack-Nova-Api-Version: 2.21 Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: ec6dc7d1281249f9a7156d78cfe6ea34 Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-InstanceActionsV221TestJSON-983419320 Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ec6dc7d1281249f9a7156d78cfe6ea34"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ec6dc7d1281249f9a7156d78cfe6ea34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ec6dc7d1281249f9a7156d78cfe6ea34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ec6dc7d1281249f9a7156d78cfe6ea34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-InstanceActionsV221TestJSON-983419320 Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: ec6dc7d1281249f9a7156d78cfe6ea34 Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-983419320 Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-InstanceActionsV221TestJSON-983419320-project Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 186666f2b025405980f87dee46e405f3 Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-InstanceActionsV221TestJSON-983419320-project Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 021c8f29-b243-4253-9c83-0d970376acd5 could not be found. Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '021c8f29-b243-4253-9c83-0d970376acd5'} Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 021c8f29-b243-4253-9c83-0d970376acd5 could not be found. Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 021c8f29-b243-4253-9c83-0d970376acd5 could not be found. Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:46:02.764366 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:46:02.772636 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:46:02.772636 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:02.772636 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:46:02.772636 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:46:02.772636 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:46:02.772636 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:46:02.772636 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 021c8f29-b243-4253-9c83-0d970376acd5 could not be found. Oct 18 15:46:02.772636 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:46:02.772636 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c0d650f9-a7c2-40fb-8959-65067014bccb tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] Returning 404 to user: Instance 021c8f29-b243-4253-9c83-0d970376acd5 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:46:02.772636 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c0d650f9-a7c2-40fb-8959-65067014bccb tempest-InstanceActionsV221TestJSON-983419320 tempest-InstanceActionsV221TestJSON-983419320-project] 10.222.0.60 "GET /compute/v2.1/servers/021c8f29-b243-4253-9c83-0d970376acd5" status: 404 len: 111 microversion: 2.21 time: 0.165428 Oct 18 15:46:02.775155 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2299/4623] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:46:02 2022] GET /compute/v2.1/servers/021c8f29-b243-4253-9c83-0d970376acd5 => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:46:03.038764 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-10552383-6997-42ce-b7e0-a9f8f4a351e1 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:03.039787 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-10552383-6997-42ce-b7e0-a9f8f4a351e1 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:03.051775 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10552383-6997-42ce-b7e0-a9f8f4a351e1 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:03.056105 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10552383-6997-42ce-b7e0-a9f8f4a351e1 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:03.056569 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10552383-6997-42ce-b7e0-a9f8f4a351e1 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:03.059023 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10552383-6997-42ce-b7e0-a9f8f4a351e1 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:03.060672 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10552383-6997-42ce-b7e0-a9f8f4a351e1 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:03.062125 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10552383-6997-42ce-b7e0-a9f8f4a351e1 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:04.349988 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1fb1c6f4-022f-45ba-8b79-31d8d28adf69 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:04.373536 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1fb1c6f4-022f-45ba-8b79-31d8d28adf69 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e" status: 200 len: 1519 microversion: 2.1 time: 1.735068 Oct 18 15:46:04.374544 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2325/4624] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:02 2022] GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e => generated 1519 bytes in 1737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:04.547337 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-10552383-6997-42ce-b7e0-a9f8f4a351e1 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:04.560540 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-10552383-6997-42ce-b7e0-a9f8f4a351e1 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1520 microversion: 2.1 time: 1.523610 Oct 18 15:46:04.563195 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2300/4625] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:03 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1520 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:05.400766 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-180af936-b1ac-40aa-b17b-020500a42b2e tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:05.403052 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-180af936-b1ac-40aa-b17b-020500a42b2e tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 50e19888-f65b-4eaa-8a40-47733d990b8e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:05.439871 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-180af936-b1ac-40aa-b17b-020500a42b2e tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:05.440722 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-180af936-b1ac-40aa-b17b-020500a42b2e tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:05.443141 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-180af936-b1ac-40aa-b17b-020500a42b2e tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:05.444297 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-180af936-b1ac-40aa-b17b-020500a42b2e tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:05.448526 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-180af936-b1ac-40aa-b17b-020500a42b2e tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:05.452270 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-180af936-b1ac-40aa-b17b-020500a42b2e tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:05.593697 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b69f6348-68bd-4d58-95a8-0eecc6e51d82 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:05.595379 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b69f6348-68bd-4d58-95a8-0eecc6e51d82 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:05.617048 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b69f6348-68bd-4d58-95a8-0eecc6e51d82 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:05.618707 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b69f6348-68bd-4d58-95a8-0eecc6e51d82 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:05.622146 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b69f6348-68bd-4d58-95a8-0eecc6e51d82 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:05.626424 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b69f6348-68bd-4d58-95a8-0eecc6e51d82 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:05.628966 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b69f6348-68bd-4d58-95a8-0eecc6e51d82 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:05.630778 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b69f6348-68bd-4d58-95a8-0eecc6e51d82 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:07.210613 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-180af936-b1ac-40aa-b17b-020500a42b2e tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:07.223813 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-180af936-b1ac-40aa-b17b-020500a42b2e tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e" status: 200 len: 1519 microversion: 2.1 time: 1.828185 Oct 18 15:46:07.228863 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2326/4626] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:05 2022] GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e => generated 1519 bytes in 1830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:07.274765 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b69f6348-68bd-4d58-95a8-0eecc6e51d82 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:07.293186 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b69f6348-68bd-4d58-95a8-0eecc6e51d82 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1520 microversion: 2.1 time: 1.706735 Oct 18 15:46:07.295676 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2301/4627] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:05 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1520 bytes in 1710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:07.751189 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-46bdf2c2-3bd3-43ee-af4e-1b3e55d2eafc tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:46:07.754171 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-46bdf2c2-3bd3-43ee-af4e-1b3e55d2eafc tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:07.783898 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-46bdf2c2-3bd3-43ee-af4e-1b3e55d2eafc tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:07.785650 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-46bdf2c2-3bd3-43ee-af4e-1b3e55d2eafc tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:07.786323 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-46bdf2c2-3bd3-43ee-af4e-1b3e55d2eafc tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:07.790673 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-46bdf2c2-3bd3-43ee-af4e-1b3e55d2eafc tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:07.792217 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-46bdf2c2-3bd3-43ee-af4e-1b3e55d2eafc tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:07.794439 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-46bdf2c2-3bd3-43ee-af4e-1b3e55d2eafc tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:08.070589 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-46bdf2c2-3bd3-43ee-af4e-1b3e55d2eafc tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "POST /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8/action" status: 202 len: 0 microversion: 2.1 time: 0.326011 Oct 18 15:46:08.074138 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2327/4628] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:46:07 2022] POST /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8/action => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:46:08.082567 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0158b4ce-ff65-4fc7-9bd8-615be03b83be tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:08.083711 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0158b4ce-ff65-4fc7-9bd8-615be03b83be tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:08.120647 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0158b4ce-ff65-4fc7-9bd8-615be03b83be tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:08.121223 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0158b4ce-ff65-4fc7-9bd8-615be03b83be tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:08.121728 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0158b4ce-ff65-4fc7-9bd8-615be03b83be tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:08.126660 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0158b4ce-ff65-4fc7-9bd8-615be03b83be tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:08.127171 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0158b4ce-ff65-4fc7-9bd8-615be03b83be tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:08.131074 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0158b4ce-ff65-4fc7-9bd8-615be03b83be tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:08.263595 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1fcd4779-167c-47fd-8782-7338f97653e1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:08.268166 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1fcd4779-167c-47fd-8782-7338f97653e1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 50e19888-f65b-4eaa-8a40-47733d990b8e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:08.282833 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1fcd4779-167c-47fd-8782-7338f97653e1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:08.286656 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1fcd4779-167c-47fd-8782-7338f97653e1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:08.288057 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1fcd4779-167c-47fd-8782-7338f97653e1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:08.292016 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1fcd4779-167c-47fd-8782-7338f97653e1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:08.293459 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1fcd4779-167c-47fd-8782-7338f97653e1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:08.296280 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1fcd4779-167c-47fd-8782-7338f97653e1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:09.495290 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1fcd4779-167c-47fd-8782-7338f97653e1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:09.505606 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1fcd4779-167c-47fd-8782-7338f97653e1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e" status: 200 len: 1519 microversion: 2.1 time: 1.253742 Oct 18 15:46:09.509568 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2328/4629] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:08 2022] GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e => generated 1519 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:09.527712 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-81fa4c6e-d3c5-4422-9d73-41a292ada8e1 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:09.543181 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-81fa4c6e-d3c5-4422-9d73-41a292ada8e1 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:09.569804 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-81fa4c6e-d3c5-4422-9d73-41a292ada8e1 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:09.584084 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-81fa4c6e-d3c5-4422-9d73-41a292ada8e1 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:09.584762 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-81fa4c6e-d3c5-4422-9d73-41a292ada8e1 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:09.586946 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-81fa4c6e-d3c5-4422-9d73-41a292ada8e1 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:09.587427 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-81fa4c6e-d3c5-4422-9d73-41a292ada8e1 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:09.587865 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-81fa4c6e-d3c5-4422-9d73-41a292ada8e1 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:09.724782 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0158b4ce-ff65-4fc7-9bd8-615be03b83be tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:09.736866 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0158b4ce-ff65-4fc7-9bd8-615be03b83be tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1673 microversion: 2.1 time: 1.658404 Oct 18 15:46:09.740981 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2302/4630] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:08 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1673 bytes in 1663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:09.751381 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-93ec763f-f61e-4bfd-8dbf-19f90e441281 req-febce1d3-8866-41f0-ac48-3591a20c4f1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50e19888-f65b-4eaa-8a40-47733d990b8e", "name": "network-vif-plugged", "status": "completed", "tag": "e9e62ab9-78c2-4cf9-a44c-7b0b834cfaf3"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:46:09.774636 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-93ec763f-f61e-4bfd-8dbf-19f90e441281 req-febce1d3-8866-41f0-ac48-3591a20c4f1b service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:09.775516 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-93ec763f-f61e-4bfd-8dbf-19f90e441281 req-febce1d3-8866-41f0-ac48-3591a20c4f1b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:09.780188 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-93ec763f-f61e-4bfd-8dbf-19f90e441281 req-febce1d3-8866-41f0-ac48-3591a20c4f1b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:09.807723 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-93ec763f-f61e-4bfd-8dbf-19f90e441281 req-febce1d3-8866-41f0-ac48-3591a20c4f1b service nova] Creating event network-vif-plugged:e9e62ab9-78c2-4cf9-a44c-7b0b834cfaf3 for instance 50e19888-f65b-4eaa-8a40-47733d990b8e on n-h2-853682-5 Oct 18 15:46:09.818712 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-93ec763f-f61e-4bfd-8dbf-19f90e441281 req-febce1d3-8866-41f0-ac48-3591a20c4f1b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076222 Oct 18 15:46:09.824406 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2303/4631] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:46:10.489085 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-472704e2-7317-4e52-a47b-e9ca02eadda7 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:10.491743 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-472704e2-7317-4e52-a47b-e9ca02eadda7 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:10.492240 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-472704e2-7317-4e52-a47b-e9ca02eadda7 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:10.492679 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-472704e2-7317-4e52-a47b-e9ca02eadda7 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:10.495435 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-472704e2-7317-4e52-a47b-e9ca02eadda7 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:10.498358 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-472704e2-7317-4e52-a47b-e9ca02eadda7 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:10.501264 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-472704e2-7317-4e52-a47b-e9ca02eadda7 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:10.531874 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-81fa4c6e-d3c5-4422-9d73-41a292ada8e1 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:10.551500 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-81fa4c6e-d3c5-4422-9d73-41a292ada8e1 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1520 microversion: 2.1 time: 1.039722 Oct 18 15:46:10.555047 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2329/4632] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:09 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1520 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:10.590183 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-08e4bb64-3efe-4e51-88ac-edfef4b06e6c tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:10.606996 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-08e4bb64-3efe-4e51-88ac-edfef4b06e6c tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 50e19888-f65b-4eaa-8a40-47733d990b8e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:10.631636 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-08e4bb64-3efe-4e51-88ac-edfef4b06e6c tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:10.637534 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-08e4bb64-3efe-4e51-88ac-edfef4b06e6c tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:10.638272 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-08e4bb64-3efe-4e51-88ac-edfef4b06e6c tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:10.639201 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-08e4bb64-3efe-4e51-88ac-edfef4b06e6c tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:10.641087 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-08e4bb64-3efe-4e51-88ac-edfef4b06e6c tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:10.641716 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-08e4bb64-3efe-4e51-88ac-edfef4b06e6c tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:10.737459 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-472704e2-7317-4e52-a47b-e9ca02eadda7 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] 10.222.0.60 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.904807 Oct 18 15:46:10.756544 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2304/4633] 10.222.0.60 () {58 vars in 1185 bytes} [Tue Oct 18 15:46:09 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:46:10.768626 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e1253f99-902e-4efd-87b8-440161831933 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:10.794551 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e1253f99-902e-4efd-87b8-440161831933 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:10.833890 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e1253f99-902e-4efd-87b8-440161831933 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:10.836902 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e1253f99-902e-4efd-87b8-440161831933 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:10.838911 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e1253f99-902e-4efd-87b8-440161831933 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:10.839878 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e1253f99-902e-4efd-87b8-440161831933 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:10.846799 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e1253f99-902e-4efd-87b8-440161831933 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:10.847250 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e1253f99-902e-4efd-87b8-440161831933 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:11.569920 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-08e4bb64-3efe-4e51-88ac-edfef4b06e6c tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:11.582384 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-08e4bb64-3efe-4e51-88ac-edfef4b06e6c tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e" status: 200 len: 1519 microversion: 2.1 time: 1.025907 Oct 18 15:46:11.583276 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2330/4634] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:10 2022] GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e => generated 1519 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:11.594241 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c03e9a7c-c655-4594-93ec-ca04ad74fb9b tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1502196046", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "availability_zone": "nova:n-h2-853682-5", "networks": [{"uuid": "10dbdb0e-e304-481a-a42b-85bde0c53b49"}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:46:11.680478 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e1253f99-902e-4efd-87b8-440161831933 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:11.711293 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e1253f99-902e-4efd-87b8-440161831933 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1673 microversion: 2.1 time: 0.945385 Oct 18 15:46:11.712738 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2305/4635] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:10 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1673 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:11.735535 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-19eda6ea-4c85-4de9-9848-b96780178b20 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:11.736167 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-19eda6ea-4c85-4de9-9848-b96780178b20 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:11.746963 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:11.758598 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-19eda6ea-4c85-4de9-9848-b96780178b20 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:11.759988 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-19eda6ea-4c85-4de9-9848-b96780178b20 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:11.762705 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-19eda6ea-4c85-4de9-9848-b96780178b20 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:11.762705 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-19eda6ea-4c85-4de9-9848-b96780178b20 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:11.763736 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-19eda6ea-4c85-4de9-9848-b96780178b20 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:11.764200 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-19eda6ea-4c85-4de9-9848-b96780178b20 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:11.771110 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-c03e9a7c-c655-4594-93ec-ca04ad74fb9b tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] validate_networks() for [('10dbdb0e-e304-481a-a42b-85bde0c53b49', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:46:11.780136 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:12.274017 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-19eda6ea-4c85-4de9-9848-b96780178b20 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:12.284518 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-19eda6ea-4c85-4de9-9848-b96780178b20 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1520 microversion: 2.1 time: 0.569174 Oct 18 15:46:12.291548 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2306/4636] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:11 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1520 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:12.611386 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-55179909-dab6-485d-9329-4b41a50e95ae tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:12.612015 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-55179909-dab6-485d-9329-4b41a50e95ae tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 50e19888-f65b-4eaa-8a40-47733d990b8e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:12.621955 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55179909-dab6-485d-9329-4b41a50e95ae tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:12.622446 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55179909-dab6-485d-9329-4b41a50e95ae tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:12.625167 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55179909-dab6-485d-9329-4b41a50e95ae tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:12.626936 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55179909-dab6-485d-9329-4b41a50e95ae tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:12.631466 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55179909-dab6-485d-9329-4b41a50e95ae tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:12.632776 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55179909-dab6-485d-9329-4b41a50e95ae tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:13.771743 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-55179909-dab6-485d-9329-4b41a50e95ae tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:13.783463 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-55179909-dab6-485d-9329-4b41a50e95ae tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e" status: 200 len: 1519 microversion: 2.1 time: 1.176118 Oct 18 15:46:13.788584 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2307/4637] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:12 2022] GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e => generated 1519 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:13.805367 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e6f0fcf0-7d33-46b6-b5dd-1e607fcb347a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:13.806464 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e6f0fcf0-7d33-46b6-b5dd-1e607fcb347a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:13.837757 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6f0fcf0-7d33-46b6-b5dd-1e607fcb347a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:13.839964 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6f0fcf0-7d33-46b6-b5dd-1e607fcb347a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:13.841649 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6f0fcf0-7d33-46b6-b5dd-1e607fcb347a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:13.842800 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6f0fcf0-7d33-46b6-b5dd-1e607fcb347a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:13.844423 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6f0fcf0-7d33-46b6-b5dd-1e607fcb347a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:13.845939 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6f0fcf0-7d33-46b6-b5dd-1e607fcb347a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:14.096732 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-c03e9a7c-c655-4594-93ec-ca04ad74fb9b tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:46:14.097260 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-c03e9a7c-c655-4594-93ec-ca04ad74fb9b tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:46:14.099313 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-c03e9a7c-c655-4594-93ec-ca04ad74fb9b tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:46:14.101784 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-c03e9a7c-c655-4594-93ec-ca04ad74fb9b tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:46:14.102256 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-c03e9a7c-c655-4594-93ec-ca04ad74fb9b tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:46:14.159272 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c03e9a7c-c655-4594-93ec-ca04ad74fb9b tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:14.163213 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c03e9a7c-c655-4594-93ec-ca04ad74fb9b tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:14.163746 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c03e9a7c-c655-4594-93ec-ca04ad74fb9b tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:14.167272 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c03e9a7c-c655-4594-93ec-ca04ad74fb9b tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:14.167760 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c03e9a7c-c655-4594-93ec-ca04ad74fb9b tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:14.170753 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c03e9a7c-c655-4594-93ec-ca04ad74fb9b tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:14.225643 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-c03e9a7c-c655-4594-93ec-ca04ad74fb9b tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Getting quotas for project 57e1ed6dd4054683b164828361bf52da. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:46:14.237779 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-c03e9a7c-c655-4594-93ec-ca04ad74fb9b tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Getting quotas for user 724d2951ce1b427d923c7c22c0b32cf3 and project 57e1ed6dd4054683b164828361bf52da. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:46:14.248246 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e6f0fcf0-7d33-46b6-b5dd-1e607fcb347a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:14.258571 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c03e9a7c-c655-4594-93ec-ca04ad74fb9b tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:46:14.261934 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c03e9a7c-c655-4594-93ec-ca04ad74fb9b tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] [instance: 9807e0ee-bfbd-4a3d-8950-355027d9b1d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:46:14.277857 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e6f0fcf0-7d33-46b6-b5dd-1e607fcb347a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1678 microversion: 2.1 time: 0.487583 Oct 18 15:46:14.284080 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2308/4638] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:13 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1678 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:14.301303 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-24fff77b-fb08-4c65-8891-c9c52d077784 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:14.302162 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-24fff77b-fb08-4c65-8891-c9c52d077784 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:14.311315 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24fff77b-fb08-4c65-8891-c9c52d077784 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:14.312098 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24fff77b-fb08-4c65-8891-c9c52d077784 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:14.312704 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24fff77b-fb08-4c65-8891-c9c52d077784 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:14.314037 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24fff77b-fb08-4c65-8891-c9c52d077784 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:14.316333 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24fff77b-fb08-4c65-8891-c9c52d077784 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:14.316997 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24fff77b-fb08-4c65-8891-c9c52d077784 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:14.392642 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c03e9a7c-c655-4594-93ec-ca04ad74fb9b tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.807823 Oct 18 15:46:14.397657 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2331/4639] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:46:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:46:14.405515 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0a7ae390-d716-471d-aee0-e186f463e401 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:14.406486 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0a7ae390-d716-471d-aee0-e186f463e401 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] [instance: 9807e0ee-bfbd-4a3d-8950-355027d9b1d3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:14.543490 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0a7ae390-d716-471d-aee0-e186f463e401 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/9807e0ee-bfbd-4a3d-8950-355027d9b1d3" status: 200 len: 1329 microversion: 2.1 time: 0.141785 Oct 18 15:46:14.544663 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2332/4640] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:14 2022] GET /compute/v2.1/servers/9807e0ee-bfbd-4a3d-8950-355027d9b1d3 => generated 1329 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:46:14.705066 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-24fff77b-fb08-4c65-8891-c9c52d077784 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:14.728521 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-24fff77b-fb08-4c65-8891-c9c52d077784 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1520 microversion: 2.1 time: 0.443122 Oct 18 15:46:14.729999 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2309/4641] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:14 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1520 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:14.810049 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ce931671-246c-47ed-a1d8-1c416e303f15 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:14.810915 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ce931671-246c-47ed-a1d8-1c416e303f15 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 50e19888-f65b-4eaa-8a40-47733d990b8e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:14.833466 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ce931671-246c-47ed-a1d8-1c416e303f15 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:14.834308 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ce931671-246c-47ed-a1d8-1c416e303f15 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:14.834937 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ce931671-246c-47ed-a1d8-1c416e303f15 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:14.835821 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ce931671-246c-47ed-a1d8-1c416e303f15 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:14.836434 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ce931671-246c-47ed-a1d8-1c416e303f15 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:14.837052 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ce931671-246c-47ed-a1d8-1c416e303f15 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:15.104338 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ce931671-246c-47ed-a1d8-1c416e303f15 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:15.114373 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ce931671-246c-47ed-a1d8-1c416e303f15 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e" status: 200 len: 1504 microversion: 2.1 time: 0.308198 Oct 18 15:46:15.115994 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2333/4642] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:14 2022] GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e => generated 1504 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:15.144627 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f987c3d8-5399-4433-88af-897c28f693b7 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:15.145951 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f987c3d8-5399-4433-88af-897c28f693b7 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 50e19888-f65b-4eaa-8a40-47733d990b8e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:15.170192 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f987c3d8-5399-4433-88af-897c28f693b7 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:15.170703 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f987c3d8-5399-4433-88af-897c28f693b7 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:15.171144 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f987c3d8-5399-4433-88af-897c28f693b7 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:15.179657 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f987c3d8-5399-4433-88af-897c28f693b7 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:15.180198 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f987c3d8-5399-4433-88af-897c28f693b7 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:15.180649 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f987c3d8-5399-4433-88af-897c28f693b7 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:15.317903 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1602d9b7-9a3c-40e8-8c49-9c40e17e2a34 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:15.324095 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1602d9b7-9a3c-40e8-8c49-9c40e17e2a34 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:15.342821 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1602d9b7-9a3c-40e8-8c49-9c40e17e2a34 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:15.343458 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1602d9b7-9a3c-40e8-8c49-9c40e17e2a34 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:15.343749 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1602d9b7-9a3c-40e8-8c49-9c40e17e2a34 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:15.351820 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1602d9b7-9a3c-40e8-8c49-9c40e17e2a34 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:15.352444 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1602d9b7-9a3c-40e8-8c49-9c40e17e2a34 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:15.354673 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1602d9b7-9a3c-40e8-8c49-9c40e17e2a34 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:15.497178 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f987c3d8-5399-4433-88af-897c28f693b7 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:15.508128 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f987c3d8-5399-4433-88af-897c28f693b7 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e" status: 200 len: 1504 microversion: 2.1 time: 0.370771 Oct 18 15:46:15.516766 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2310/4643] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:15 2022] GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e => generated 1504 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:15.546390 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4df17827-d84b-4b92-aa8b-91be9e1ba449 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:15.546903 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4df17827-d84b-4b92-aa8b-91be9e1ba449 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 50e19888-f65b-4eaa-8a40-47733d990b8e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:15.570825 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4df17827-d84b-4b92-aa8b-91be9e1ba449 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:15.575680 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4df17827-d84b-4b92-aa8b-91be9e1ba449 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:15.576350 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4df17827-d84b-4b92-aa8b-91be9e1ba449 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:15.581827 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4df17827-d84b-4b92-aa8b-91be9e1ba449 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:15.582319 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4df17827-d84b-4b92-aa8b-91be9e1ba449 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:15.582845 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4df17827-d84b-4b92-aa8b-91be9e1ba449 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:15.674096 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4df17827-d84b-4b92-aa8b-91be9e1ba449 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 50e19888-f65b-4eaa-8a40-47733d990b8e] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:46:15.829858 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1602d9b7-9a3c-40e8-8c49-9c40e17e2a34 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:15.843448 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1602d9b7-9a3c-40e8-8c49-9c40e17e2a34 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1671 microversion: 2.1 time: 0.539572 Oct 18 15:46:15.849193 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2334/4644] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:15 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1671 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:46:15.866092 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-04aea156-e60b-41eb-8b4c-7fb0d6fb2b6c tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:15.867093 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-04aea156-e60b-41eb-8b4c-7fb0d6fb2b6c tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] [instance: 9807e0ee-bfbd-4a3d-8950-355027d9b1d3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:15.886170 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-04aea156-e60b-41eb-8b4c-7fb0d6fb2b6c tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:15.886888 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-04aea156-e60b-41eb-8b4c-7fb0d6fb2b6c tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:15.887478 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-04aea156-e60b-41eb-8b4c-7fb0d6fb2b6c tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:15.889662 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-04aea156-e60b-41eb-8b4c-7fb0d6fb2b6c tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:15.890974 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-04aea156-e60b-41eb-8b4c-7fb0d6fb2b6c tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:15.891573 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-04aea156-e60b-41eb-8b4c-7fb0d6fb2b6c tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:15.967717 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4df17827-d84b-4b92-aa8b-91be9e1ba449 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "DELETE /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e" status: 204 len: 0 microversion: 2.1 time: 0.424546 Oct 18 15:46:15.985238 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2311/4645] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:46:15 2022] DELETE /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:46:16.010938 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6d90f66c-524d-44b3-b8e5-989b565b9321 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:16.016671 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6d90f66c-524d-44b3-b8e5-989b565b9321 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:16.042808 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d90f66c-524d-44b3-b8e5-989b565b9321 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:16.042808 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d90f66c-524d-44b3-b8e5-989b565b9321 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:16.048607 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d90f66c-524d-44b3-b8e5-989b565b9321 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:16.050401 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d90f66c-524d-44b3-b8e5-989b565b9321 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:16.052323 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d90f66c-524d-44b3-b8e5-989b565b9321 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:16.054157 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d90f66c-524d-44b3-b8e5-989b565b9321 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:16.096597 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-04aea156-e60b-41eb-8b4c-7fb0d6fb2b6c tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/9807e0ee-bfbd-4a3d-8950-355027d9b1d3" status: 200 len: 1338 microversion: 2.1 time: 0.244501 Oct 18 15:46:16.099927 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2335/4646] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:15 2022] GET /compute/v2.1/servers/9807e0ee-bfbd-4a3d-8950-355027d9b1d3 => generated 1338 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:16.233180 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a9e1e732-ac14-4a76-88b1-3e619b476e27 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2008391298", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "555b266f-a669-4b15-ac01-9eefa267ee33"}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:46:16.354995 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-a9e1e732-ac14-4a76-88b1-3e619b476e27 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] validate_networks() for [('555b266f-a669-4b15-ac01-9eefa267ee33', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:46:16.402088 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6d90f66c-524d-44b3-b8e5-989b565b9321 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:16.415330 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6d90f66c-524d-44b3-b8e5-989b565b9321 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1520 microversion: 2.1 time: 0.428622 Oct 18 15:46:16.415940 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2312/4647] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:15 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1520 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:17.117980 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-a9e1e732-ac14-4a76-88b1-3e619b476e27 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:46:17.118722 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-a9e1e732-ac14-4a76-88b1-3e619b476e27 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:46:17.120654 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-a9e1e732-ac14-4a76-88b1-3e619b476e27 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:46:17.130154 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5359f2a0-dd14-4312-8a30-e056d41fea55 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:17.130872 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-a9e1e732-ac14-4a76-88b1-3e619b476e27 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:46:17.131313 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5359f2a0-dd14-4312-8a30-e056d41fea55 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] [instance: 9807e0ee-bfbd-4a3d-8950-355027d9b1d3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:17.134430 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-a9e1e732-ac14-4a76-88b1-3e619b476e27 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:46:17.149691 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:17.156485 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5359f2a0-dd14-4312-8a30-e056d41fea55 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:17.157754 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5359f2a0-dd14-4312-8a30-e056d41fea55 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:17.159480 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5359f2a0-dd14-4312-8a30-e056d41fea55 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:17.170038 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5359f2a0-dd14-4312-8a30-e056d41fea55 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:17.171196 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5359f2a0-dd14-4312-8a30-e056d41fea55 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:17.172443 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5359f2a0-dd14-4312-8a30-e056d41fea55 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:17.183369 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9e1e732-ac14-4a76-88b1-3e619b476e27 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:17.184146 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9e1e732-ac14-4a76-88b1-3e619b476e27 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:17.184941 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9e1e732-ac14-4a76-88b1-3e619b476e27 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:17.186712 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9e1e732-ac14-4a76-88b1-3e619b476e27 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:17.191567 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9e1e732-ac14-4a76-88b1-3e619b476e27 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:17.192259 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9e1e732-ac14-4a76-88b1-3e619b476e27 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:17.279627 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-a9e1e732-ac14-4a76-88b1-3e619b476e27 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Getting quotas for project 8c8478562c2e4f8fab01a9667d9b6b05. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:46:17.295106 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-a9e1e732-ac14-4a76-88b1-3e619b476e27 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Getting quotas for user 3c91f91c89b648c8b099dbedf7c822b8 and project 8c8478562c2e4f8fab01a9667d9b6b05. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:46:17.315642 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a9e1e732-ac14-4a76-88b1-3e619b476e27 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:46:17.319111 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a9e1e732-ac14-4a76-88b1-3e619b476e27 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 9d108fa0-49bb-46c2-a8b0-802c5835cb14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:46:17.483241 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5359f2a0-dd14-4312-8a30-e056d41fea55 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/9807e0ee-bfbd-4a3d-8950-355027d9b1d3" status: 200 len: 1338 microversion: 2.1 time: 0.359609 Oct 18 15:46:17.491794 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a9e1e732-ac14-4a76-88b1-3e619b476e27 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.262116 Oct 18 15:46:17.492488 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2336/4648] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:46:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1266 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 15:46:17.501674 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2313/4649] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:17 2022] GET /compute/v2.1/servers/9807e0ee-bfbd-4a3d-8950-355027d9b1d3 => generated 1338 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:17.544041 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-11250f56-4e17-41d9-99f4-f419f26b115f tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:17.544676 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-11250f56-4e17-41d9-99f4-f419f26b115f tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 9d108fa0-49bb-46c2-a8b0-802c5835cb14] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:17.549527 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7b33f518-8422-4e16-9e85-a9b46996728e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:17.551947 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7b33f518-8422-4e16-9e85-a9b46996728e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:17.585693 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7b33f518-8422-4e16-9e85-a9b46996728e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:17.591181 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7b33f518-8422-4e16-9e85-a9b46996728e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:17.593097 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7b33f518-8422-4e16-9e85-a9b46996728e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:17.595035 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7b33f518-8422-4e16-9e85-a9b46996728e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:17.600462 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7b33f518-8422-4e16-9e85-a9b46996728e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:17.601240 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7b33f518-8422-4e16-9e85-a9b46996728e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:17.773635 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-11250f56-4e17-41d9-99f4-f419f26b115f tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:17.784433 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-11250f56-4e17-41d9-99f4-f419f26b115f tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14" status: 200 len: 1218 microversion: 2.1 time: 0.279969 Oct 18 15:46:17.793226 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2314/4650] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:17 2022] GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14 => generated 1218 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:18.146278 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7b33f518-8422-4e16-9e85-a9b46996728e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:18.158891 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7b33f518-8422-4e16-9e85-a9b46996728e tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1520 microversion: 2.1 time: 0.647656 Oct 18 15:46:18.162742 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2337/4651] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:17 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1520 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:18.536017 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-938a4a08-d4d4-4bc3-a62c-8bfb7452cc1d tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:18.538399 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-938a4a08-d4d4-4bc3-a62c-8bfb7452cc1d tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] [instance: 9807e0ee-bfbd-4a3d-8950-355027d9b1d3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:18.560236 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-938a4a08-d4d4-4bc3-a62c-8bfb7452cc1d tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:18.561855 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-938a4a08-d4d4-4bc3-a62c-8bfb7452cc1d tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:18.563424 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-938a4a08-d4d4-4bc3-a62c-8bfb7452cc1d tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:18.566165 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-938a4a08-d4d4-4bc3-a62c-8bfb7452cc1d tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:18.567878 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-938a4a08-d4d4-4bc3-a62c-8bfb7452cc1d tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:18.569107 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-938a4a08-d4d4-4bc3-a62c-8bfb7452cc1d tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:18.817034 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-510918cc-0c47-4a1d-b4f0-0ca584263dee tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:18.818046 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-510918cc-0c47-4a1d-b4f0-0ca584263dee tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 9d108fa0-49bb-46c2-a8b0-802c5835cb14] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:18.824543 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-938a4a08-d4d4-4bc3-a62c-8bfb7452cc1d tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/9807e0ee-bfbd-4a3d-8950-355027d9b1d3" status: 200 len: 1424 microversion: 2.1 time: 0.300866 Oct 18 15:46:18.832490 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2315/4652] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:18 2022] GET /compute/v2.1/servers/9807e0ee-bfbd-4a3d-8950-355027d9b1d3 => generated 1424 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:18.835258 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-510918cc-0c47-4a1d-b4f0-0ca584263dee tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:18.837669 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-510918cc-0c47-4a1d-b4f0-0ca584263dee tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:18.849553 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-510918cc-0c47-4a1d-b4f0-0ca584263dee tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:18.851130 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-510918cc-0c47-4a1d-b4f0-0ca584263dee tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:18.855429 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-510918cc-0c47-4a1d-b4f0-0ca584263dee tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:18.856147 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-510918cc-0c47-4a1d-b4f0-0ca584263dee tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:19.082346 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-510918cc-0c47-4a1d-b4f0-0ca584263dee tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:19.100540 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-510918cc-0c47-4a1d-b4f0-0ca584263dee tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14" status: 200 len: 1222 microversion: 2.1 time: 0.291224 Oct 18 15:46:19.121227 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2338/4653] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:18 2022] GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14 => generated 1222 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:19.193605 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-986c037f-6b08-45e0-bd83-d6e5ead637f3 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:19.194220 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-986c037f-6b08-45e0-bd83-d6e5ead637f3 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:19.203220 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-986c037f-6b08-45e0-bd83-d6e5ead637f3 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:19.203718 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-986c037f-6b08-45e0-bd83-d6e5ead637f3 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:19.204337 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-986c037f-6b08-45e0-bd83-d6e5ead637f3 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:19.205264 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-986c037f-6b08-45e0-bd83-d6e5ead637f3 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:19.205989 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-986c037f-6b08-45e0-bd83-d6e5ead637f3 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:19.206796 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-986c037f-6b08-45e0-bd83-d6e5ead637f3 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:19.474573 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-efbcc119-bdb0-4eef-a862-17c39a99b363 req-3f1171f9-d283-4cc1-b40a-e5e73b7235d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50e19888-f65b-4eaa-8a40-47733d990b8e", "name": "network-vif-deleted", "tag": "e9e62ab9-78c2-4cf9-a44c-7b0b834cfaf3"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:46:19.506395 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-efbcc119-bdb0-4eef-a862-17c39a99b363 req-3f1171f9-d283-4cc1-b40a-e5e73b7235d7 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:19.507777 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-efbcc119-bdb0-4eef-a862-17c39a99b363 req-3f1171f9-d283-4cc1-b40a-e5e73b7235d7 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:19.508475 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-efbcc119-bdb0-4eef-a862-17c39a99b363 req-3f1171f9-d283-4cc1-b40a-e5e73b7235d7 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:19.543600 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:19.548335 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-efbcc119-bdb0-4eef-a862-17c39a99b363 req-3f1171f9-d283-4cc1-b40a-e5e73b7235d7 service nova] Creating event network-vif-deleted:e9e62ab9-78c2-4cf9-a44c-7b0b834cfaf3 for instance 50e19888-f65b-4eaa-8a40-47733d990b8e on n-h2-853682-5 Oct 18 15:46:19.562187 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-efbcc119-bdb0-4eef-a862-17c39a99b363 req-3f1171f9-d283-4cc1-b40a-e5e73b7235d7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089130 Oct 18 15:46:19.564312 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2339/4654] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:46:19.578178 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-986c037f-6b08-45e0-bd83-d6e5ead637f3 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:19.589706 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-986c037f-6b08-45e0-bd83-d6e5ead637f3 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1520 microversion: 2.1 time: 0.400137 Oct 18 15:46:19.591664 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2316/4655] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:19 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1520 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:19.855690 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-75882afb-9ba2-425f-9d63-bbbc8fd67015 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:19.857216 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-75882afb-9ba2-425f-9d63-bbbc8fd67015 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] [instance: 9807e0ee-bfbd-4a3d-8950-355027d9b1d3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:19.882918 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-75882afb-9ba2-425f-9d63-bbbc8fd67015 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:19.886216 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-75882afb-9ba2-425f-9d63-bbbc8fd67015 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:19.887655 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-75882afb-9ba2-425f-9d63-bbbc8fd67015 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:19.890600 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-75882afb-9ba2-425f-9d63-bbbc8fd67015 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:19.894898 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-75882afb-9ba2-425f-9d63-bbbc8fd67015 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:19.897608 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-75882afb-9ba2-425f-9d63-bbbc8fd67015 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:20.092551 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-b2bbdc95-7f83-4296-a9e5-11b019405a29 req-8ef47076-bdb2-4ca1-bb40-e55cdafd5dfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cc69e2e-cb26-42d6-b887-31e0afaa69fc", "name": "network-vif-plugged", "status": "completed", "tag": "c9ee9ae4-c0ad-4fa3-a68e-56018fcf2c7f"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:46:20.122028 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b2bbdc95-7f83-4296-a9e5-11b019405a29 req-8ef47076-bdb2-4ca1-bb40-e55cdafd5dfc service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:20.122972 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b2bbdc95-7f83-4296-a9e5-11b019405a29 req-8ef47076-bdb2-4ca1-bb40-e55cdafd5dfc service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:20.123624 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b2bbdc95-7f83-4296-a9e5-11b019405a29 req-8ef47076-bdb2-4ca1-bb40-e55cdafd5dfc service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:20.153031 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-b2bbdc95-7f83-4296-a9e5-11b019405a29 req-8ef47076-bdb2-4ca1-bb40-e55cdafd5dfc service nova] Creating event network-vif-plugged:c9ee9ae4-c0ad-4fa3-a68e-56018fcf2c7f for instance 2cc69e2e-cb26-42d6-b887-31e0afaa69fc on n-h2-853682-5 Oct 18 15:46:20.178856 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-b2bbdc95-7f83-4296-a9e5-11b019405a29 req-8ef47076-bdb2-4ca1-bb40-e55cdafd5dfc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091490 Oct 18 15:46:20.180009 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2317/4656] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:46:20.211246 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b2de6441-d5de-445b-9d41-d6dc318668ce tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:20.215570 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b2de6441-d5de-445b-9d41-d6dc318668ce tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 9d108fa0-49bb-46c2-a8b0-802c5835cb14] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:20.233288 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2de6441-d5de-445b-9d41-d6dc318668ce tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:20.236222 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2de6441-d5de-445b-9d41-d6dc318668ce tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:20.238002 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2de6441-d5de-445b-9d41-d6dc318668ce tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:20.242428 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2de6441-d5de-445b-9d41-d6dc318668ce tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:20.243501 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2de6441-d5de-445b-9d41-d6dc318668ce tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:20.244877 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2de6441-d5de-445b-9d41-d6dc318668ce tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:20.504310 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b2de6441-d5de-445b-9d41-d6dc318668ce tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:20.512783 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b2de6441-d5de-445b-9d41-d6dc318668ce tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14" status: 200 len: 1276 microversion: 2.1 time: 0.331487 Oct 18 15:46:20.525203 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2318/4657] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:20 2022] GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14 => generated 1276 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:20.614961 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9c982ffa-132e-4428-8b4c-373bc72c9881 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:20.615658 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9c982ffa-132e-4428-8b4c-373bc72c9881 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:20.635399 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:20.637073 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c982ffa-132e-4428-8b4c-373bc72c9881 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:20.637560 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c982ffa-132e-4428-8b4c-373bc72c9881 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:20.638190 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c982ffa-132e-4428-8b4c-373bc72c9881 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:20.639081 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c982ffa-132e-4428-8b4c-373bc72c9881 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:20.640452 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c982ffa-132e-4428-8b4c-373bc72c9881 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:20.641073 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c982ffa-132e-4428-8b4c-373bc72c9881 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:20.762740 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-75882afb-9ba2-425f-9d63-bbbc8fd67015 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/9807e0ee-bfbd-4a3d-8950-355027d9b1d3" status: 200 len: 1464 microversion: 2.1 time: 0.911898 Oct 18 15:46:20.763363 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2340/4658] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:19 2022] GET /compute/v2.1/servers/9807e0ee-bfbd-4a3d-8950-355027d9b1d3 => generated 1464 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:21.192869 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9c982ffa-132e-4428-8b4c-373bc72c9881 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:21.201697 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9c982ffa-132e-4428-8b4c-373bc72c9881 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1520 microversion: 2.1 time: 0.590537 Oct 18 15:46:21.213795 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2319/4659] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:20 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1520 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:46:21.544672 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-58b3ee90-73e2-41c3-ac17-2e398b449d6a tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:21.546930 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-58b3ee90-73e2-41c3-ac17-2e398b449d6a tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 9d108fa0-49bb-46c2-a8b0-802c5835cb14] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:21.560414 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-58b3ee90-73e2-41c3-ac17-2e398b449d6a tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:21.561344 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-58b3ee90-73e2-41c3-ac17-2e398b449d6a tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:21.562558 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-58b3ee90-73e2-41c3-ac17-2e398b449d6a tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:21.564378 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-58b3ee90-73e2-41c3-ac17-2e398b449d6a tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:21.565126 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-58b3ee90-73e2-41c3-ac17-2e398b449d6a tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:21.567208 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-58b3ee90-73e2-41c3-ac17-2e398b449d6a tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:21.787934 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8dd1a89c-6ce1-4a4b-8716-43ae7356f1ae tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:21.788828 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8dd1a89c-6ce1-4a4b-8716-43ae7356f1ae tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] [instance: 9807e0ee-bfbd-4a3d-8950-355027d9b1d3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:21.800241 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8dd1a89c-6ce1-4a4b-8716-43ae7356f1ae tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:21.801510 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-58b3ee90-73e2-41c3-ac17-2e398b449d6a tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:21.804007 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8dd1a89c-6ce1-4a4b-8716-43ae7356f1ae tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:21.804513 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8dd1a89c-6ce1-4a4b-8716-43ae7356f1ae tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:21.805313 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8dd1a89c-6ce1-4a4b-8716-43ae7356f1ae tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:21.805798 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8dd1a89c-6ce1-4a4b-8716-43ae7356f1ae tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:21.806229 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8dd1a89c-6ce1-4a4b-8716-43ae7356f1ae tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:21.810285 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-58b3ee90-73e2-41c3-ac17-2e398b449d6a tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14" status: 200 len: 1276 microversion: 2.1 time: 0.276038 Oct 18 15:46:21.810881 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2341/4660] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:21 2022] GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14 => generated 1276 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:46:22.192701 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8dd1a89c-6ce1-4a4b-8716-43ae7356f1ae tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/9807e0ee-bfbd-4a3d-8950-355027d9b1d3" status: 200 len: 1464 microversion: 2.1 time: 0.408621 Oct 18 15:46:22.193341 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2320/4661] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:21 2022] GET /compute/v2.1/servers/9807e0ee-bfbd-4a3d-8950-355027d9b1d3 => generated 1464 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:22.225637 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0e12aa89-fb07-4c54-a491-89a8d9f548b9 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:22.226585 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0e12aa89-fb07-4c54-a491-89a8d9f548b9 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:22.238439 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0e12aa89-fb07-4c54-a491-89a8d9f548b9 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:22.243194 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0e12aa89-fb07-4c54-a491-89a8d9f548b9 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:22.245290 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0e12aa89-fb07-4c54-a491-89a8d9f548b9 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:22.247513 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0e12aa89-fb07-4c54-a491-89a8d9f548b9 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:22.249627 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0e12aa89-fb07-4c54-a491-89a8d9f548b9 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:22.251096 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0e12aa89-fb07-4c54-a491-89a8d9f548b9 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:22.681429 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-281867da-cea8-4646-ada8-a44479919e82 req-b7e68162-c92a-416f-ab66-6f5c0b3919a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9807e0ee-bfbd-4a3d-8950-355027d9b1d3", "tag": "04c37d0b-ecbb-4eaa-ab82-c191fc26ceda"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:46:22.707861 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-281867da-cea8-4646-ada8-a44479919e82 req-b7e68162-c92a-416f-ab66-6f5c0b3919a6 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:22.708915 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-281867da-cea8-4646-ada8-a44479919e82 req-b7e68162-c92a-416f-ab66-6f5c0b3919a6 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:22.709535 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-281867da-cea8-4646-ada8-a44479919e82 req-b7e68162-c92a-416f-ab66-6f5c0b3919a6 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:22.743347 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-281867da-cea8-4646-ada8-a44479919e82 req-b7e68162-c92a-416f-ab66-6f5c0b3919a6 service nova] Creating event network-changed:04c37d0b-ecbb-4eaa-ab82-c191fc26ceda for instance 9807e0ee-bfbd-4a3d-8950-355027d9b1d3 on n-h2-853682-5 Oct 18 15:46:22.765538 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-281867da-cea8-4646-ada8-a44479919e82 req-b7e68162-c92a-416f-ab66-6f5c0b3919a6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087994 Oct 18 15:46:22.767423 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2321/4662] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:46:22.838482 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1112534b-d76f-400b-9fe9-8d48111d7fca tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:22.840509 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1112534b-d76f-400b-9fe9-8d48111d7fca tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 9d108fa0-49bb-46c2-a8b0-802c5835cb14] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:22.854069 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1112534b-d76f-400b-9fe9-8d48111d7fca tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:22.857373 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1112534b-d76f-400b-9fe9-8d48111d7fca tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:22.859838 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1112534b-d76f-400b-9fe9-8d48111d7fca tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:22.860772 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1112534b-d76f-400b-9fe9-8d48111d7fca tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:22.862308 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1112534b-d76f-400b-9fe9-8d48111d7fca tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:22.864629 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1112534b-d76f-400b-9fe9-8d48111d7fca tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:23.042633 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0e12aa89-fb07-4c54-a491-89a8d9f548b9 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:23.062203 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0e12aa89-fb07-4c54-a491-89a8d9f548b9 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1520 microversion: 2.1 time: 0.840892 Oct 18 15:46:23.064742 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2342/4663] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:22 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1520 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:23.220733 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bff2a418-3ab7-43c6-b136-3500bcbed868 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:23.221620 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-bff2a418-3ab7-43c6-b136-3500bcbed868 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] [instance: 9807e0ee-bfbd-4a3d-8950-355027d9b1d3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:23.232055 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bff2a418-3ab7-43c6-b136-3500bcbed868 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:23.232857 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bff2a418-3ab7-43c6-b136-3500bcbed868 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:23.233537 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bff2a418-3ab7-43c6-b136-3500bcbed868 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:23.235284 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bff2a418-3ab7-43c6-b136-3500bcbed868 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:23.239044 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bff2a418-3ab7-43c6-b136-3500bcbed868 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:23.239264 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bff2a418-3ab7-43c6-b136-3500bcbed868 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:23.516271 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1112534b-d76f-400b-9fe9-8d48111d7fca tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:23.522586 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1112534b-d76f-400b-9fe9-8d48111d7fca tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14" status: 200 len: 1318 microversion: 2.1 time: 0.690562 Oct 18 15:46:23.523375 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2322/4664] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:22 2022] GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14 => generated 1318 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:46:23.796373 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-bff2a418-3ab7-43c6-b136-3500bcbed868 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/9807e0ee-bfbd-4a3d-8950-355027d9b1d3" status: 200 len: 1464 microversion: 2.1 time: 0.579520 Oct 18 15:46:23.803448 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2343/4665] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:23 2022] GET /compute/v2.1/servers/9807e0ee-bfbd-4a3d-8950-355027d9b1d3 => generated 1464 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:46:24.085988 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e1e73468-c6e2-4e4e-b15a-3eda10e79664 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:24.087575 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e1e73468-c6e2-4e4e-b15a-3eda10e79664 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:24.099714 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e1e73468-c6e2-4e4e-b15a-3eda10e79664 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:24.105465 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e1e73468-c6e2-4e4e-b15a-3eda10e79664 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:24.106328 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e1e73468-c6e2-4e4e-b15a-3eda10e79664 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:24.107275 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e1e73468-c6e2-4e4e-b15a-3eda10e79664 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:24.107932 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e1e73468-c6e2-4e4e-b15a-3eda10e79664 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:24.108528 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e1e73468-c6e2-4e4e-b15a-3eda10e79664 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:24.140156 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:24.558876 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f3436835-338c-4f2a-9727-c5c9f580aa1e tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:24.560220 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f3436835-338c-4f2a-9727-c5c9f580aa1e tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 9d108fa0-49bb-46c2-a8b0-802c5835cb14] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:24.584870 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f3436835-338c-4f2a-9727-c5c9f580aa1e tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:24.593674 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f3436835-338c-4f2a-9727-c5c9f580aa1e tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:24.595791 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f3436835-338c-4f2a-9727-c5c9f580aa1e tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:24.596794 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f3436835-338c-4f2a-9727-c5c9f580aa1e tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:24.597806 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f3436835-338c-4f2a-9727-c5c9f580aa1e tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:24.599338 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f3436835-338c-4f2a-9727-c5c9f580aa1e tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:24.714701 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e1e73468-c6e2-4e4e-b15a-3eda10e79664 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:24.729923 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e1e73468-c6e2-4e4e-b15a-3eda10e79664 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.645668 Oct 18 15:46:24.730553 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2323/4666] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:24 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:24.754967 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cf6817b4-bdfe-447b-a75c-ce079c0de01a tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:24.755854 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cf6817b4-bdfe-447b-a75c-ce079c0de01a tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:24.767830 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf6817b4-bdfe-447b-a75c-ce079c0de01a tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:24.768319 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf6817b4-bdfe-447b-a75c-ce079c0de01a tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:24.773352 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf6817b4-bdfe-447b-a75c-ce079c0de01a tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:24.774877 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf6817b4-bdfe-447b-a75c-ce079c0de01a tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:24.776163 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf6817b4-bdfe-447b-a75c-ce079c0de01a tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:24.778055 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf6817b4-bdfe-447b-a75c-ce079c0de01a tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:25.130625 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f3436835-338c-4f2a-9727-c5c9f580aa1e tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:25.143877 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f3436835-338c-4f2a-9727-c5c9f580aa1e tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14" status: 200 len: 1318 microversion: 2.1 time: 0.590969 Oct 18 15:46:25.161896 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2344/4667] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:24 2022] GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14 => generated 1318 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:25.174189 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0939c561-4aa2-4dff-a1a7-9c192e16ad52 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:25.175536 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0939c561-4aa2-4dff-a1a7-9c192e16ad52 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] [instance: 9807e0ee-bfbd-4a3d-8950-355027d9b1d3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:25.186840 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0939c561-4aa2-4dff-a1a7-9c192e16ad52 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:25.188090 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0939c561-4aa2-4dff-a1a7-9c192e16ad52 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:25.188758 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0939c561-4aa2-4dff-a1a7-9c192e16ad52 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:25.196409 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0939c561-4aa2-4dff-a1a7-9c192e16ad52 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:25.196615 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cf6817b4-bdfe-447b-a75c-ce079c0de01a tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:25.203655 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0939c561-4aa2-4dff-a1a7-9c192e16ad52 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:25.204323 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0939c561-4aa2-4dff-a1a7-9c192e16ad52 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:25.205306 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cf6817b4-bdfe-447b-a75c-ce079c0de01a tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.455532 Oct 18 15:46:25.209097 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2324/4668] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:24 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:25.240801 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0a6ca1f0-f228-4ef5-9a40-8e9660e43564 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:25.241733 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0a6ca1f0-f228-4ef5-9a40-8e9660e43564 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:25.250261 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a6ca1f0-f228-4ef5-9a40-8e9660e43564 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:25.250947 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a6ca1f0-f228-4ef5-9a40-8e9660e43564 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:25.251572 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a6ca1f0-f228-4ef5-9a40-8e9660e43564 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:25.252450 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a6ca1f0-f228-4ef5-9a40-8e9660e43564 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:25.253797 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a6ca1f0-f228-4ef5-9a40-8e9660e43564 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:25.254392 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a6ca1f0-f228-4ef5-9a40-8e9660e43564 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:25.655548 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0939c561-4aa2-4dff-a1a7-9c192e16ad52 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/9807e0ee-bfbd-4a3d-8950-355027d9b1d3" status: 200 len: 1464 microversion: 2.1 time: 0.492358 Oct 18 15:46:25.656154 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2345/4669] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:25 2022] GET /compute/v2.1/servers/9807e0ee-bfbd-4a3d-8950-355027d9b1d3 => generated 1464 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:25.682521 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0a6ca1f0-f228-4ef5-9a40-8e9660e43564 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:25.703873 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0a6ca1f0-f228-4ef5-9a40-8e9660e43564 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.467998 Oct 18 15:46:25.705701 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2325/4670] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:25 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:46:25.729537 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-23e8f133-e7f7-4323-aa90-59f7034c9ed7 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:46:25.740387 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-23e8f133-e7f7-4323-aa90-59f7034c9ed7 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] HTTP exception thrown: Instance 3655f04a-9f72-478e-abf1-5870cdfce267 has no mapping to a cell. Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-23e8f133-e7f7-4323-aa90-59f7034c9ed7 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Request method failure captured: Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: request: POST /compute/v2.1/servers/3655f04a-9f72-478e-abf1-5870cdfce267/action HTTP/1.1 Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 15 Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTslxbnvpe5yiGf5CWZMgShC81OiGKrcSLYZFSWKOLbaqqF5kNJvh8cijdldsPo1OHjHXDcbdPuhTuFRNRswVq0HwpXLNCfOWcF3GU1M8LHkZwXu6ScaOEIHyQ8ewFnAFL7TXd1O14t3atsv_uM6Xc9ZHSfefERCjuehdw5SJuAn7MMs Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 96c4378d52d1489bb2d50e84cabf95eb Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: {"os-stop": {}} Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 3655f04a-9f72-478e-abf1-5870cdfce267 has no mapping to a cell. Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '3655f04a-9f72-478e-abf1-5870cdfce267', 'body': {'os-stop': {}}} Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 3655f04a-9f72-478e-abf1-5870cdfce267 has no mapping to a cell. Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:46:25.754225 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3655f04a-9f72-478e-abf1-5870cdfce267 has no mapping to a cell. Oct 18 15:46:25.759184 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:25.759184 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:46:25.759184 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:25.759184 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:25.759184 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:46:25.759184 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:46:25.759184 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:46:25.759184 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:46:25.759184 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3655f04a-9f72-478e-abf1-5870cdfce267 has no mapping to a cell. Oct 18 15:46:25.759184 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:25.761702 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-23e8f133-e7f7-4323-aa90-59f7034c9ed7 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Returning 404 to user: Instance 3655f04a-9f72-478e-abf1-5870cdfce267 has no mapping to a cell. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:46:25.764941 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-23e8f133-e7f7-4323-aa90-59f7034c9ed7 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "POST /compute/v2.1/servers/3655f04a-9f72-478e-abf1-5870cdfce267/action" status: 404 len: 117 microversion: 2.1 time: 0.038175 Oct 18 15:46:25.765911 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2346/4671] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:46:25 2022] POST /compute/v2.1/servers/3655f04a-9f72-478e-abf1-5870cdfce267/action => generated 117 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:46:25.774780 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f06c900d-0d6e-480f-9bed-59d3c92878ca tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:25.776196 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f06c900d-0d6e-480f-9bed-59d3c92878ca tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:25.786829 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-60191670-3676-4370-82e0-4cab46f8a5f5 req-0abc29f6-4b6e-46bb-9fe1-ef8f8ded0411 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d108fa0-49bb-46c2-a8b0-802c5835cb14", "tag": "415f8632-c892-4860-89a6-5fddaeb68947"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:46:25.802638 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f06c900d-0d6e-480f-9bed-59d3c92878ca tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:25.803634 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f06c900d-0d6e-480f-9bed-59d3c92878ca tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:25.804188 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f06c900d-0d6e-480f-9bed-59d3c92878ca tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:25.805090 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f06c900d-0d6e-480f-9bed-59d3c92878ca tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:25.805630 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f06c900d-0d6e-480f-9bed-59d3c92878ca tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:25.806137 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f06c900d-0d6e-480f-9bed-59d3c92878ca tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:25.811200 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-60191670-3676-4370-82e0-4cab46f8a5f5 req-0abc29f6-4b6e-46bb-9fe1-ef8f8ded0411 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:25.811701 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-60191670-3676-4370-82e0-4cab46f8a5f5 req-0abc29f6-4b6e-46bb-9fe1-ef8f8ded0411 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:25.812317 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-60191670-3676-4370-82e0-4cab46f8a5f5 req-0abc29f6-4b6e-46bb-9fe1-ef8f8ded0411 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:25.825145 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-60191670-3676-4370-82e0-4cab46f8a5f5 req-0abc29f6-4b6e-46bb-9fe1-ef8f8ded0411 service nova] Creating event network-changed:415f8632-c892-4860-89a6-5fddaeb68947 for instance 9d108fa0-49bb-46c2-a8b0-802c5835cb14 on n-h1-853682-5 Oct 18 15:46:25.832074 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-60191670-3676-4370-82e0-4cab46f8a5f5 req-0abc29f6-4b6e-46bb-9fe1-ef8f8ded0411 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048980 Oct 18 15:46:25.833365 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2347/4672] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:46:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:46:26.172607 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-61a7d6e0-47e4-4103-b150-249384625a93 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:26.174485 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-61a7d6e0-47e4-4103-b150-249384625a93 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 9d108fa0-49bb-46c2-a8b0-802c5835cb14] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:26.186365 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-61a7d6e0-47e4-4103-b150-249384625a93 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:26.188091 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-61a7d6e0-47e4-4103-b150-249384625a93 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:26.188547 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-61a7d6e0-47e4-4103-b150-249384625a93 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:26.190685 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-61a7d6e0-47e4-4103-b150-249384625a93 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:26.191326 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-61a7d6e0-47e4-4103-b150-249384625a93 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:26.192445 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-61a7d6e0-47e4-4103-b150-249384625a93 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:26.492715 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f06c900d-0d6e-480f-9bed-59d3c92878ca tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:26.512589 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f06c900d-0d6e-480f-9bed-59d3c92878ca tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.735622 Oct 18 15:46:26.513896 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2326/4673] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:25 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:26.542788 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-15e30c99-01c2-4c7c-8a89-9b76d6c14f78 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:26.543413 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-15e30c99-01c2-4c7c-8a89-9b76d6c14f78 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:26.554608 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15e30c99-01c2-4c7c-8a89-9b76d6c14f78 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:26.555110 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15e30c99-01c2-4c7c-8a89-9b76d6c14f78 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:26.555551 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15e30c99-01c2-4c7c-8a89-9b76d6c14f78 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:26.557054 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15e30c99-01c2-4c7c-8a89-9b76d6c14f78 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:26.558430 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15e30c99-01c2-4c7c-8a89-9b76d6c14f78 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:26.559041 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15e30c99-01c2-4c7c-8a89-9b76d6c14f78 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:27.055676 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-61a7d6e0-47e4-4103-b150-249384625a93 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:27.066375 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-61a7d6e0-47e4-4103-b150-249384625a93 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14" status: 200 len: 1318 microversion: 2.1 time: 0.900629 Oct 18 15:46:27.072353 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2348/4674] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:26 2022] GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14 => generated 1318 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:46:27.079573 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f6597748-14f3-49d2-a1ca-57bc9278e1d5 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:27.081308 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f6597748-14f3-49d2-a1ca-57bc9278e1d5 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] [instance: 9807e0ee-bfbd-4a3d-8950-355027d9b1d3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:27.095568 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f6597748-14f3-49d2-a1ca-57bc9278e1d5 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:27.097326 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f6597748-14f3-49d2-a1ca-57bc9278e1d5 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:27.102418 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f6597748-14f3-49d2-a1ca-57bc9278e1d5 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:27.103272 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f6597748-14f3-49d2-a1ca-57bc9278e1d5 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:27.105335 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f6597748-14f3-49d2-a1ca-57bc9278e1d5 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:27.105841 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f6597748-14f3-49d2-a1ca-57bc9278e1d5 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:27.247813 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=4 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:27.262133 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-15e30c99-01c2-4c7c-8a89-9b76d6c14f78 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:27.276134 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-15e30c99-01c2-4c7c-8a89-9b76d6c14f78 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.735456 Oct 18 15:46:27.277227 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2327/4675] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:26 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:27.306529 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=14 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:27.549515 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f6597748-14f3-49d2-a1ca-57bc9278e1d5 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/9807e0ee-bfbd-4a3d-8950-355027d9b1d3" status: 200 len: 1464 microversion: 2.1 time: 0.474945 Oct 18 15:46:27.553921 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2349/4676] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:27 2022] GET /compute/v2.1/servers/9807e0ee-bfbd-4a3d-8950-355027d9b1d3 => generated 1464 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:27.559177 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-519f9660-7158-47f0-9628-6d16c653dd69 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:46:27.559740 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-519f9660-7158-47f0-9628-6d16c653dd69 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 603b754b-2b7c-4ea0-83da-2f8dec2e2bc3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:27.591066 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-519f9660-7158-47f0-9628-6d16c653dd69 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] HTTP exception thrown: Instance 603b754b-2b7c-4ea0-83da-2f8dec2e2bc3 could not be found. Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-519f9660-7158-47f0-9628-6d16c653dd69 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Request method failure captured: Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: request: POST /compute/v2.1/servers/603b754b-2b7c-4ea0-83da-2f8dec2e2bc3/action HTTP/1.1 Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 15 Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTslxbnvpe5yiGf5CWZMgShC81OiGKrcSLYZFSWKOLbaqqF5kNJvh8cijdldsPo1OHjHXDcbdPuhTuFRNRswVq0HwpXLNCfOWcF3GU1M8LHkZwXu6ScaOEIHyQ8ewFnAFL7TXd1O14t3atsv_uM6Xc9ZHSfefERCjuehdw5SJuAn7MMs Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 96c4378d52d1489bb2d50e84cabf95eb Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: {"suspend": {}} Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 603b754b-2b7c-4ea0-83da-2f8dec2e2bc3 could not be found. Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '603b754b-2b7c-4ea0-83da-2f8dec2e2bc3', 'body': {'suspend': {}}} Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 603b754b-2b7c-4ea0-83da-2f8dec2e2bc3 could not be found. Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 603b754b-2b7c-4ea0-83da-2f8dec2e2bc3 could not be found. Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:46:27.593931 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:46:27.598256 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:46:27.598256 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:46:27.598256 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 603b754b-2b7c-4ea0-83da-2f8dec2e2bc3 could not be found. Oct 18 15:46:27.598256 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:27.598256 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-519f9660-7158-47f0-9628-6d16c653dd69 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Returning 404 to user: Instance 603b754b-2b7c-4ea0-83da-2f8dec2e2bc3 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:46:27.598256 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-519f9660-7158-47f0-9628-6d16c653dd69 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "POST /compute/v2.1/servers/603b754b-2b7c-4ea0-83da-2f8dec2e2bc3/action" status: 404 len: 111 microversion: 2.1 time: 0.042668 Oct 18 15:46:27.603971 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2350/4677] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:46:27 2022] POST /compute/v2.1/servers/603b754b-2b7c-4ea0-83da-2f8dec2e2bc3/action => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:46:27.613570 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-946ef1bb-a332-4169-8489-bebeb77383f5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:27.614193 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-946ef1bb-a332-4169-8489-bebeb77383f5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:27.639285 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-946ef1bb-a332-4169-8489-bebeb77383f5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:27.639798 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-946ef1bb-a332-4169-8489-bebeb77383f5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:27.640245 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-946ef1bb-a332-4169-8489-bebeb77383f5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:27.641076 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-946ef1bb-a332-4169-8489-bebeb77383f5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:27.642002 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-946ef1bb-a332-4169-8489-bebeb77383f5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:27.644015 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-946ef1bb-a332-4169-8489-bebeb77383f5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:27.782885 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:27.808902 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e971a6f1-1023-427d-9e39-f97897d52a48 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1515738581 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1515738581-project-admin] Calling method '.version_select at 0x7f7c3c7231f0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:27.811750 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e971a6f1-1023-427d-9e39-f97897d52a48 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1515738581 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1515738581-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:27.812238 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e971a6f1-1023-427d-9e39-f97897d52a48 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1515738581 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1515738581-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:27.812731 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e971a6f1-1023-427d-9e39-f97897d52a48 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1515738581 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1515738581-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:27.839235 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e971a6f1-1023-427d-9e39-f97897d52a48 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1515738581 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1515738581-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:27.839733 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e971a6f1-1023-427d-9e39-f97897d52a48 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1515738581 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1515738581-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:27.840169 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e971a6f1-1023-427d-9e39-f97897d52a48 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1515738581 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1515738581-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:27.864214 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e971a6f1-1023-427d-9e39-f97897d52a48 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1515738581 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1515738581-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:27.865091 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e971a6f1-1023-427d-9e39-f97897d52a48 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1515738581 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1515738581-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:27.865686 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e971a6f1-1023-427d-9e39-f97897d52a48 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1515738581 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1515738581-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:27.874449 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e971a6f1-1023-427d-9e39-f97897d52a48 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1515738581 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1515738581-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.579561 Oct 18 15:46:27.875321 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2328/4678] 10.222.0.60 () {58 vars in 1146 bytes} [Tue Oct 18 15:46:27 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:46:28.005531 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-946ef1bb-a332-4169-8489-bebeb77383f5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:28.037385 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-946ef1bb-a332-4169-8489-bebeb77383f5 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.427155 Oct 18 15:46:28.039543 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2351/4679] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:27 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:46:28.069469 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8eaeba26-7122-4bcf-83e7-3c82e8fa755f tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:28.070532 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8eaeba26-7122-4bcf-83e7-3c82e8fa755f tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:28.081181 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8eaeba26-7122-4bcf-83e7-3c82e8fa755f tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:28.082468 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8eaeba26-7122-4bcf-83e7-3c82e8fa755f tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:28.083528 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8eaeba26-7122-4bcf-83e7-3c82e8fa755f tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:28.086147 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8eaeba26-7122-4bcf-83e7-3c82e8fa755f tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:28.086838 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8eaeba26-7122-4bcf-83e7-3c82e8fa755f tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:28.087446 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8eaeba26-7122-4bcf-83e7-3c82e8fa755f tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:28.100615 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6c9342cf-5f58-4798-a394-a61cf6e8bc3d tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:28.101277 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6c9342cf-5f58-4798-a394-a61cf6e8bc3d tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 9d108fa0-49bb-46c2-a8b0-802c5835cb14] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:28.110997 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6c9342cf-5f58-4798-a394-a61cf6e8bc3d tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:28.112115 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6c9342cf-5f58-4798-a394-a61cf6e8bc3d tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:28.112572 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6c9342cf-5f58-4798-a394-a61cf6e8bc3d tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:28.117729 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6c9342cf-5f58-4798-a394-a61cf6e8bc3d tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:28.118231 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6c9342cf-5f58-4798-a394-a61cf6e8bc3d tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:28.119532 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6c9342cf-5f58-4798-a394-a61cf6e8bc3d tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:28.497565 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6c9342cf-5f58-4798-a394-a61cf6e8bc3d tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:28.501006 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8eaeba26-7122-4bcf-83e7-3c82e8fa755f tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:28.510754 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8eaeba26-7122-4bcf-83e7-3c82e8fa755f tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.447137 Oct 18 15:46:28.513052 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6c9342cf-5f58-4798-a394-a61cf6e8bc3d tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14" status: 200 len: 1318 microversion: 2.1 time: 0.420589 Oct 18 15:46:28.514430 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2352/4680] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:28 2022] GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14 => generated 1318 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:28.516190 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2329/4681] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:28 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:28.550416 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f2b9d8b7-1052-4744-8277-a4082c48c638 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:46:28.550983 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f2b9d8b7-1052-4744-8277-a4082c48c638 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:28.562953 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2b9d8b7-1052-4744-8277-a4082c48c638 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:28.563641 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2b9d8b7-1052-4744-8277-a4082c48c638 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:28.565175 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2b9d8b7-1052-4744-8277-a4082c48c638 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:28.567468 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2b9d8b7-1052-4744-8277-a4082c48c638 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:28.568983 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2b9d8b7-1052-4744-8277-a4082c48c638 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:28.569486 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2b9d8b7-1052-4744-8277-a4082c48c638 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:28.578518 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-92afd0d2-11dd-490e-b4b2-2c44d910a79b tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:28.579329 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-92afd0d2-11dd-490e-b4b2-2c44d910a79b tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] [instance: 9807e0ee-bfbd-4a3d-8950-355027d9b1d3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:28.591812 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-92afd0d2-11dd-490e-b4b2-2c44d910a79b tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:28.593393 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-92afd0d2-11dd-490e-b4b2-2c44d910a79b tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:28.594640 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-92afd0d2-11dd-490e-b4b2-2c44d910a79b tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:28.597516 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-92afd0d2-11dd-490e-b4b2-2c44d910a79b tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:28.599044 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-92afd0d2-11dd-490e-b4b2-2c44d910a79b tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:28.599861 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-92afd0d2-11dd-490e-b4b2-2c44d910a79b tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:28.629541 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-f2b9d8b7-1052-4744-8277-a4082c48c638 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lazy-loading 'flavor' on Instance uuid 2cc69e2e-cb26-42d6-b887-31e0afaa69fc {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:46:28.765539 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f2b9d8b7-1052-4744-8277-a4082c48c638 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "POST /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc/action" status: 202 len: 0 microversion: 2.1 time: 0.215612 Oct 18 15:46:28.789037 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2330/4682] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:46:28 2022] POST /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:46:28.807415 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-989ee455-3c88-4941-ab92-7a334c275430 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:28.808525 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-989ee455-3c88-4941-ab92-7a334c275430 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:28.817030 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-989ee455-3c88-4941-ab92-7a334c275430 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:28.817562 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-989ee455-3c88-4941-ab92-7a334c275430 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:28.818105 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-989ee455-3c88-4941-ab92-7a334c275430 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:28.818841 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-989ee455-3c88-4941-ab92-7a334c275430 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:28.819307 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-989ee455-3c88-4941-ab92-7a334c275430 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:28.819736 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-989ee455-3c88-4941-ab92-7a334c275430 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:28.985264 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-92afd0d2-11dd-490e-b4b2-2c44d910a79b tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/9807e0ee-bfbd-4a3d-8950-355027d9b1d3" status: 200 len: 1464 microversion: 2.1 time: 0.410647 Oct 18 15:46:28.985866 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2353/4683] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:28 2022] GET /compute/v2.1/servers/9807e0ee-bfbd-4a3d-8950-355027d9b1d3 => generated 1464 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:46:29.139283 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-989ee455-3c88-4941-ab92-7a334c275430 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:29.163968 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-989ee455-3c88-4941-ab92-7a334c275430 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1515 microversion: 2.1 time: 0.371643 Oct 18 15:46:29.164603 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2331/4684] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:28 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1515 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:29.468503 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d78f7470-aef2-4816-8039-1d9a888f9251 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1397079474", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "0ee3280d-9a39-49e3-b454-ff3fb585fd93"}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:46:29.544726 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-d78f7470-aef2-4816-8039-1d9a888f9251 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] validate_networks() for [('0ee3280d-9a39-49e3-b454-ff3fb585fd93', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:46:29.545007 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cb1ed17d-fab5-4742-a4d8-08354efc546b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:29.546123 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cb1ed17d-fab5-4742-a4d8-08354efc546b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 9d108fa0-49bb-46c2-a8b0-802c5835cb14] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:29.562435 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb1ed17d-fab5-4742-a4d8-08354efc546b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:29.563675 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb1ed17d-fab5-4742-a4d8-08354efc546b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:29.564680 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb1ed17d-fab5-4742-a4d8-08354efc546b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:29.566956 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb1ed17d-fab5-4742-a4d8-08354efc546b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:29.568053 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb1ed17d-fab5-4742-a4d8-08354efc546b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:29.569052 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb1ed17d-fab5-4742-a4d8-08354efc546b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:29.929656 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cb1ed17d-fab5-4742-a4d8-08354efc546b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:29.938088 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cb1ed17d-fab5-4742-a4d8-08354efc546b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14" status: 200 len: 1318 microversion: 2.1 time: 0.400985 Oct 18 15:46:29.939844 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2332/4685] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:29 2022] GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14 => generated 1318 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:46:30.011425 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bf3863bb-7336-4e4f-87a6-d6d4fdfc3be6 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:30.012161 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bf3863bb-7336-4e4f-87a6-d6d4fdfc3be6 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] [instance: 9807e0ee-bfbd-4a3d-8950-355027d9b1d3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:30.019908 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf3863bb-7336-4e4f-87a6-d6d4fdfc3be6 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:30.020601 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf3863bb-7336-4e4f-87a6-d6d4fdfc3be6 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:30.021241 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf3863bb-7336-4e4f-87a6-d6d4fdfc3be6 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:30.022557 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf3863bb-7336-4e4f-87a6-d6d4fdfc3be6 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:30.023264 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf3863bb-7336-4e4f-87a6-d6d4fdfc3be6 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:30.023999 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf3863bb-7336-4e4f-87a6-d6d4fdfc3be6 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:30.438329 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bf3863bb-7336-4e4f-87a6-d6d4fdfc3be6 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/9807e0ee-bfbd-4a3d-8950-355027d9b1d3" status: 200 len: 1464 microversion: 2.1 time: 0.431706 Oct 18 15:46:30.441931 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2333/4686] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:30 2022] GET /compute/v2.1/servers/9807e0ee-bfbd-4a3d-8950-355027d9b1d3 => generated 1464 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:46:30.453917 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-14f5d9fb-1d3d-4100-b6fc-e9179bb153ab tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:30.455443 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-14f5d9fb-1d3d-4100-b6fc-e9179bb153ab tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:30.475541 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14f5d9fb-1d3d-4100-b6fc-e9179bb153ab tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:30.476170 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14f5d9fb-1d3d-4100-b6fc-e9179bb153ab tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:30.478803 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14f5d9fb-1d3d-4100-b6fc-e9179bb153ab tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:30.479737 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14f5d9fb-1d3d-4100-b6fc-e9179bb153ab tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:30.480286 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14f5d9fb-1d3d-4100-b6fc-e9179bb153ab tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:30.481081 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14f5d9fb-1d3d-4100-b6fc-e9179bb153ab tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:30.797790 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-d78f7470-aef2-4816-8039-1d9a888f9251 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:46:30.798264 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-d78f7470-aef2-4816-8039-1d9a888f9251 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:46:30.798725 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-d78f7470-aef2-4816-8039-1d9a888f9251 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:46:30.799302 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-d78f7470-aef2-4816-8039-1d9a888f9251 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:46:30.799792 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-d78f7470-aef2-4816-8039-1d9a888f9251 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:46:30.816068 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d78f7470-aef2-4816-8039-1d9a888f9251 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:30.816579 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d78f7470-aef2-4816-8039-1d9a888f9251 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:30.818675 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d78f7470-aef2-4816-8039-1d9a888f9251 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:30.820226 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d78f7470-aef2-4816-8039-1d9a888f9251 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:30.820697 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d78f7470-aef2-4816-8039-1d9a888f9251 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:30.821891 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d78f7470-aef2-4816-8039-1d9a888f9251 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:30.850169 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-d78f7470-aef2-4816-8039-1d9a888f9251 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Getting quotas for project e42c92cc615744258653a5aa70010db5. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:46:30.857733 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-d78f7470-aef2-4816-8039-1d9a888f9251 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Getting quotas for user ad6caed9f67c4c05ba02abe4e424cbab and project e42c92cc615744258653a5aa70010db5. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:46:30.871753 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d78f7470-aef2-4816-8039-1d9a888f9251 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:46:30.874546 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d78f7470-aef2-4816-8039-1d9a888f9251 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] [instance: a2303432-63f3-45b5-848e-eea36fb0094c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:46:30.928679 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-14f5d9fb-1d3d-4100-b6fc-e9179bb153ab tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:30.946044 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d78f7470-aef2-4816-8039-1d9a888f9251 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.931977 Oct 18 15:46:30.946722 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2354/4687] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:46:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1934 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:46:30.947316 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-14f5d9fb-1d3d-4100-b6fc-e9179bb153ab tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1498 microversion: 2.1 time: 0.502028 Oct 18 15:46:30.948002 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2334/4688] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:30 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1498 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:30.965633 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-71eacd45-3937-4183-915a-b77adac4e226 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:30.967153 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-71eacd45-3937-4183-915a-b77adac4e226 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 9d108fa0-49bb-46c2-a8b0-802c5835cb14] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:30.974287 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c368d87f-0ca8-47bc-b9e6-6a407678c22f tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:30.974919 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c368d87f-0ca8-47bc-b9e6-6a407678c22f tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] [instance: a2303432-63f3-45b5-848e-eea36fb0094c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:30.982466 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-71eacd45-3937-4183-915a-b77adac4e226 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:30.983250 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-71eacd45-3937-4183-915a-b77adac4e226 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:30.989493 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-71eacd45-3937-4183-915a-b77adac4e226 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:30.990935 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-71eacd45-3937-4183-915a-b77adac4e226 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:30.992453 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-71eacd45-3937-4183-915a-b77adac4e226 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:30.995478 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-71eacd45-3937-4183-915a-b77adac4e226 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:31.068439 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c368d87f-0ca8-47bc-b9e6-6a407678c22f tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6caed9f67c4c05ba02abe4e424cbab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42c92cc615744258653a5aa70010db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:31.079005 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c368d87f-0ca8-47bc-b9e6-6a407678c22f tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] 10.222.0.60 "GET /compute/v2.1/servers/a2303432-63f3-45b5-848e-eea36fb0094c" status: 200 len: 1224 microversion: 2.1 time: 0.121779 Oct 18 15:46:31.084459 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2335/4689] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:30 2022] GET /compute/v2.1/servers/a2303432-63f3-45b5-848e-eea36fb0094c => generated 1224 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:31.094169 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f9e8060e-680e-42e8-ace0-b652da572401 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:46:31.097010 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f9e8060e-680e-42e8-ace0-b652da572401 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:31.113796 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9e8060e-680e-42e8-ace0-b652da572401 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:31.114601 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9e8060e-680e-42e8-ace0-b652da572401 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:31.115217 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9e8060e-680e-42e8-ace0-b652da572401 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:31.116124 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9e8060e-680e-42e8-ace0-b652da572401 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:31.116585 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9e8060e-680e-42e8-ace0-b652da572401 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:31.117049 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9e8060e-680e-42e8-ace0-b652da572401 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:31.176112 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-f9e8060e-680e-42e8-ace0-b652da572401 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lazy-loading 'flavor' on Instance uuid 2cc69e2e-cb26-42d6-b887-31e0afaa69fc {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:46:31.201945 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-f9e8060e-680e-42e8-ace0-b652da572401 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] HTTP exception thrown: Cannot 'suspend' instance 2cc69e2e-cb26-42d6-b887-31e0afaa69fc while it is in vm_state suspended Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f9e8060e-680e-42e8-ace0-b652da572401 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Request method failure captured: Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc/action HTTP/1.1 Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 15 Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTslxbnvpe5yiGf5CWZMgShC81OiGKrcSLYZFSWKOLbaqqF5kNJvh8cijdldsPo1OHjHXDcbdPuhTuFRNRswVq0HwpXLNCfOWcF3GU1M8LHkZwXu6ScaOEIHyQ8ewFnAFL7TXd1O14t3atsv_uM6Xc9ZHSfefERCjuehdw5SJuAn7MMs Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 96c4378d52d1489bb2d50e84cabf95eb Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: {"suspend": {}} Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: exception: Cannot 'suspend' instance 2cc69e2e-cb26-42d6-b887-31e0afaa69fc while it is in vm_state suspended Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '2cc69e2e-cb26-42d6-b887-31e0afaa69fc', 'body': {'suspend': {}}} Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2cc69e2e-cb26-42d6-b887-31e0afaa69fc in vm_state suspended. Cannot suspend while the instance is in this state. Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 18 15:46:31.203909 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 18 15:46:31.208123 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 15:46:31.208123 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 15:46:31.208123 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 2cc69e2e-cb26-42d6-b887-31e0afaa69fc while it is in vm_state suspended Oct 18 15:46:31.208123 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:46:31.208123 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:46:31.208123 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:46:31.208123 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:31.208123 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:46:31.208123 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:46:31.208123 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:46:31.208123 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:46:31.208123 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 2cc69e2e-cb26-42d6-b887-31e0afaa69fc while it is in vm_state suspended Oct 18 15:46:31.208123 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:46:31.208123 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f9e8060e-680e-42e8-ace0-b652da572401 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Returning 409 to user: Cannot 'suspend' instance 2cc69e2e-cb26-42d6-b887-31e0afaa69fc while it is in vm_state suspended {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:46:31.209342 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f9e8060e-680e-42e8-ace0-b652da572401 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "POST /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc/action" status: 409 len: 148 microversion: 2.1 time: 0.122138 Oct 18 15:46:31.215624 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2336/4690] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:46:31 2022] POST /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc/action => generated 148 bytes in 130 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 15:46:31.221672 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-01321981-616a-460c-9fc8-48ea061fbafb tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:46:31.222337 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-01321981-616a-460c-9fc8-48ea061fbafb tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:31.229308 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01321981-616a-460c-9fc8-48ea061fbafb tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:31.229924 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01321981-616a-460c-9fc8-48ea061fbafb tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:31.235056 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01321981-616a-460c-9fc8-48ea061fbafb tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:31.236010 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01321981-616a-460c-9fc8-48ea061fbafb tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:31.236728 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01321981-616a-460c-9fc8-48ea061fbafb tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:31.237359 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01321981-616a-460c-9fc8-48ea061fbafb tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:31.393567 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-71eacd45-3937-4183-915a-b77adac4e226 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:31.403649 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-71eacd45-3937-4183-915a-b77adac4e226 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14" status: 200 len: 1318 microversion: 2.1 time: 0.442599 Oct 18 15:46:31.405630 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2355/4691] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:30 2022] GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14 => generated 1318 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:31.438519 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-01321981-616a-460c-9fc8-48ea061fbafb tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "POST /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc/action" status: 202 len: 0 microversion: 2.1 time: 0.221536 Oct 18 15:46:31.439166 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2337/4692] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:46:31 2022] POST /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:46:31.455162 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-85e27846-b181-4f8d-9c7d-d12b63d8b1d6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:31.455910 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-85e27846-b181-4f8d-9c7d-d12b63d8b1d6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:31.471580 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-85e27846-b181-4f8d-9c7d-d12b63d8b1d6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:31.476594 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-85e27846-b181-4f8d-9c7d-d12b63d8b1d6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:31.477413 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-85e27846-b181-4f8d-9c7d-d12b63d8b1d6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:31.480346 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-85e27846-b181-4f8d-9c7d-d12b63d8b1d6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:31.481044 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-85e27846-b181-4f8d-9c7d-d12b63d8b1d6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:31.481583 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-85e27846-b181-4f8d-9c7d-d12b63d8b1d6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:31.483180 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e6481f89-2874-49f3-98b9-cac0ef25d4c4 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:31.483898 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e6481f89-2874-49f3-98b9-cac0ef25d4c4 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] [instance: 9807e0ee-bfbd-4a3d-8950-355027d9b1d3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:31.498573 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6481f89-2874-49f3-98b9-cac0ef25d4c4 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:31.499071 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6481f89-2874-49f3-98b9-cac0ef25d4c4 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:31.499509 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6481f89-2874-49f3-98b9-cac0ef25d4c4 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:31.501575 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6481f89-2874-49f3-98b9-cac0ef25d4c4 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:31.503887 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6481f89-2874-49f3-98b9-cac0ef25d4c4 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:31.505672 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6481f89-2874-49f3-98b9-cac0ef25d4c4 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:31.536462 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:32.508295 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-85e27846-b181-4f8d-9c7d-d12b63d8b1d6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:32.517946 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-85e27846-b181-4f8d-9c7d-d12b63d8b1d6 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1504 microversion: 2.1 time: 1.073044 Oct 18 15:46:32.518616 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2356/4693] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:31 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1504 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:32.530593 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0e1bbb13-1dd9-4d53-b613-e4d0be0f97b4 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:32.535129 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0e1bbb13-1dd9-4d53-b613-e4d0be0f97b4 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] [instance: a2303432-63f3-45b5-848e-eea36fb0094c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:32.547951 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0e1bbb13-1dd9-4d53-b613-e4d0be0f97b4 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:32.548761 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0e1bbb13-1dd9-4d53-b613-e4d0be0f97b4 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:32.559382 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0e1bbb13-1dd9-4d53-b613-e4d0be0f97b4 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:32.563235 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0e1bbb13-1dd9-4d53-b613-e4d0be0f97b4 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:32.563918 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0e1bbb13-1dd9-4d53-b613-e4d0be0f97b4 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:32.564584 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0e1bbb13-1dd9-4d53-b613-e4d0be0f97b4 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:32.590086 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e6481f89-2874-49f3-98b9-cac0ef25d4c4 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/9807e0ee-bfbd-4a3d-8950-355027d9b1d3" status: 200 len: 1464 microversion: 2.1 time: 1.117134 Oct 18 15:46:32.592046 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2338/4694] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:31 2022] GET /compute/v2.1/servers/9807e0ee-bfbd-4a3d-8950-355027d9b1d3 => generated 1464 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:32.608428 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-77a12c21-3eef-4560-a5f3-ac43ec578e78 req-6af8d5e0-23f5-49a7-9bd9-cb444f50020d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9807e0ee-bfbd-4a3d-8950-355027d9b1d3", "name": "network-vif-plugged", "status": "completed", "tag": "04c37d0b-ecbb-4eaa-ab82-c191fc26ceda"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:46:32.624890 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-77a12c21-3eef-4560-a5f3-ac43ec578e78 req-6af8d5e0-23f5-49a7-9bd9-cb444f50020d service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:32.625437 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-77a12c21-3eef-4560-a5f3-ac43ec578e78 req-6af8d5e0-23f5-49a7-9bd9-cb444f50020d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:32.626294 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-77a12c21-3eef-4560-a5f3-ac43ec578e78 req-6af8d5e0-23f5-49a7-9bd9-cb444f50020d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:32.669970 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-77a12c21-3eef-4560-a5f3-ac43ec578e78 req-6af8d5e0-23f5-49a7-9bd9-cb444f50020d service nova] Creating event network-vif-plugged:04c37d0b-ecbb-4eaa-ab82-c191fc26ceda for instance 9807e0ee-bfbd-4a3d-8950-355027d9b1d3 on n-h2-853682-5 Oct 18 15:46:32.680053 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-77a12c21-3eef-4560-a5f3-ac43ec578e78 req-6af8d5e0-23f5-49a7-9bd9-cb444f50020d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085586 Oct 18 15:46:32.680767 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2339/4695] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:46:32.689789 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-456feba5-8115-4ae8-a761-913f58fa4a5e tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:32.690884 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-456feba5-8115-4ae8-a761-913f58fa4a5e tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 9d108fa0-49bb-46c2-a8b0-802c5835cb14] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:32.708097 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0e1bbb13-1dd9-4d53-b613-e4d0be0f97b4 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6caed9f67c4c05ba02abe4e424cbab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42c92cc615744258653a5aa70010db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:32.718067 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0e1bbb13-1dd9-4d53-b613-e4d0be0f97b4 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] 10.222.0.60 "GET /compute/v2.1/servers/a2303432-63f3-45b5-848e-eea36fb0094c" status: 200 len: 1276 microversion: 2.1 time: 0.195421 Oct 18 15:46:32.722558 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2357/4696] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:32 2022] GET /compute/v2.1/servers/a2303432-63f3-45b5-848e-eea36fb0094c => generated 1276 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:32.749268 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-456feba5-8115-4ae8-a761-913f58fa4a5e tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:32.750161 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-456feba5-8115-4ae8-a761-913f58fa4a5e tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:32.750621 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-456feba5-8115-4ae8-a761-913f58fa4a5e tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:32.751398 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-456feba5-8115-4ae8-a761-913f58fa4a5e tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:32.751862 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-456feba5-8115-4ae8-a761-913f58fa4a5e tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:32.753488 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-456feba5-8115-4ae8-a761-913f58fa4a5e tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:33.268771 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-456feba5-8115-4ae8-a761-913f58fa4a5e tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:33.276991 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-456feba5-8115-4ae8-a761-913f58fa4a5e tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14" status: 200 len: 1318 microversion: 2.1 time: 0.593377 Oct 18 15:46:33.277924 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2340/4697] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:32 2022] GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14 => generated 1318 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:33.542952 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-684dda1c-07db-47be-92b3-b5e3c0d346d1 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:33.543847 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-684dda1c-07db-47be-92b3-b5e3c0d346d1 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:33.550967 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-684dda1c-07db-47be-92b3-b5e3c0d346d1 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:33.551461 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-684dda1c-07db-47be-92b3-b5e3c0d346d1 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:33.552133 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-684dda1c-07db-47be-92b3-b5e3c0d346d1 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:33.553220 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-684dda1c-07db-47be-92b3-b5e3c0d346d1 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:33.553900 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-684dda1c-07db-47be-92b3-b5e3c0d346d1 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:33.554347 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-684dda1c-07db-47be-92b3-b5e3c0d346d1 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:33.616732 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7d3347c9-d336-4f2e-916d-ca887a955814 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:33.619504 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7d3347c9-d336-4f2e-916d-ca887a955814 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] [instance: 9807e0ee-bfbd-4a3d-8950-355027d9b1d3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:33.631463 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d3347c9-d336-4f2e-916d-ca887a955814 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:33.632260 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d3347c9-d336-4f2e-916d-ca887a955814 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:33.632892 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d3347c9-d336-4f2e-916d-ca887a955814 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:33.634150 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d3347c9-d336-4f2e-916d-ca887a955814 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:33.635310 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d3347c9-d336-4f2e-916d-ca887a955814 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:33.636024 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d3347c9-d336-4f2e-916d-ca887a955814 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:33.824018 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-684dda1c-07db-47be-92b3-b5e3c0d346d1 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:33.835013 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-684dda1c-07db-47be-92b3-b5e3c0d346d1 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1504 microversion: 2.1 time: 0.295836 Oct 18 15:46:33.850413 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2358/4698] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:33 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1504 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:33.866145 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7d3347c9-d336-4f2e-916d-ca887a955814 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/9807e0ee-bfbd-4a3d-8950-355027d9b1d3" status: 200 len: 1464 microversion: 2.1 time: 0.253905 Oct 18 15:46:33.869295 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2341/4699] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:33 2022] GET /compute/v2.1/servers/9807e0ee-bfbd-4a3d-8950-355027d9b1d3 => generated 1464 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:46:33.869710 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d029a337-6ba9-47d5-85fe-95da4ddf02ce tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:33.870343 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d029a337-6ba9-47d5-85fe-95da4ddf02ce tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] [instance: a2303432-63f3-45b5-848e-eea36fb0094c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:33.876326 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d029a337-6ba9-47d5-85fe-95da4ddf02ce tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:33.876837 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d029a337-6ba9-47d5-85fe-95da4ddf02ce tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:33.877292 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d029a337-6ba9-47d5-85fe-95da4ddf02ce tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:33.878000 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d029a337-6ba9-47d5-85fe-95da4ddf02ce tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:33.878636 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d029a337-6ba9-47d5-85fe-95da4ddf02ce tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:33.879218 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d029a337-6ba9-47d5-85fe-95da4ddf02ce tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:33.967577 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d029a337-6ba9-47d5-85fe-95da4ddf02ce tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6caed9f67c4c05ba02abe4e424cbab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42c92cc615744258653a5aa70010db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:33.971460 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=100 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:33.981092 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d029a337-6ba9-47d5-85fe-95da4ddf02ce tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] 10.222.0.60 "GET /compute/v2.1/servers/a2303432-63f3-45b5-848e-eea36fb0094c" status: 200 len: 1282 microversion: 2.1 time: 0.129165 Oct 18 15:46:33.988375 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2359/4700] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:33 2022] GET /compute/v2.1/servers/a2303432-63f3-45b5-848e-eea36fb0094c => generated 1282 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:34.302126 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1d08e57b-2190-4cb3-93fc-d2a8f497d533 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:34.302767 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1d08e57b-2190-4cb3-93fc-d2a8f497d533 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 9d108fa0-49bb-46c2-a8b0-802c5835cb14] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:34.318143 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d08e57b-2190-4cb3-93fc-d2a8f497d533 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:34.318726 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d08e57b-2190-4cb3-93fc-d2a8f497d533 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:34.319188 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d08e57b-2190-4cb3-93fc-d2a8f497d533 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:34.322427 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d08e57b-2190-4cb3-93fc-d2a8f497d533 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:34.324104 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d08e57b-2190-4cb3-93fc-d2a8f497d533 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:34.326315 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d08e57b-2190-4cb3-93fc-d2a8f497d533 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:34.698212 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1d08e57b-2190-4cb3-93fc-d2a8f497d533 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:34.710283 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1d08e57b-2190-4cb3-93fc-d2a8f497d533 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14" status: 200 len: 1318 microversion: 2.1 time: 0.412557 Oct 18 15:46:34.715129 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2342/4701] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:34 2022] GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14 => generated 1318 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:34.737755 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-d07efc0b-4d02-4890-a464-c91387ce628f req-a5bf4a16-9dcf-46ad-948d-a429f65a5676 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d108fa0-49bb-46c2-a8b0-802c5835cb14", "name": "network-vif-plugged", "status": "completed", "tag": "415f8632-c892-4860-89a6-5fddaeb68947"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:46:34.761627 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-d07efc0b-4d02-4890-a464-c91387ce628f req-a5bf4a16-9dcf-46ad-948d-a429f65a5676 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:34.765086 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-d07efc0b-4d02-4890-a464-c91387ce628f req-a5bf4a16-9dcf-46ad-948d-a429f65a5676 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:34.768319 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-d07efc0b-4d02-4890-a464-c91387ce628f req-a5bf4a16-9dcf-46ad-948d-a429f65a5676 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:34.788271 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-d07efc0b-4d02-4890-a464-c91387ce628f req-a5bf4a16-9dcf-46ad-948d-a429f65a5676 service nova] Creating event network-vif-plugged:415f8632-c892-4860-89a6-5fddaeb68947 for instance 9d108fa0-49bb-46c2-a8b0-802c5835cb14 on n-h1-853682-5 Oct 18 15:46:34.794058 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-d07efc0b-4d02-4890-a464-c91387ce628f req-a5bf4a16-9dcf-46ad-948d-a429f65a5676 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061994 Oct 18 15:46:34.795335 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2360/4702] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:46:34.868564 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-389b3881-7504-4420-a524-323b2cf19d81 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:34.873057 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-389b3881-7504-4420-a524-323b2cf19d81 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:34.900570 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-69ea6464-4005-48f5-965f-0a7b700f65d6 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:34.903584 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-69ea6464-4005-48f5-965f-0a7b700f65d6 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] [instance: 9807e0ee-bfbd-4a3d-8950-355027d9b1d3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:34.919126 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-389b3881-7504-4420-a524-323b2cf19d81 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:34.921699 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-389b3881-7504-4420-a524-323b2cf19d81 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:34.923668 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-389b3881-7504-4420-a524-323b2cf19d81 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:34.926100 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-389b3881-7504-4420-a524-323b2cf19d81 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:34.926593 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-389b3881-7504-4420-a524-323b2cf19d81 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:34.929453 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-389b3881-7504-4420-a524-323b2cf19d81 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:34.931853 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-69ea6464-4005-48f5-965f-0a7b700f65d6 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:34.932348 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-69ea6464-4005-48f5-965f-0a7b700f65d6 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:34.932873 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-69ea6464-4005-48f5-965f-0a7b700f65d6 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:34.933501 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-69ea6464-4005-48f5-965f-0a7b700f65d6 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:34.933955 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-69ea6464-4005-48f5-965f-0a7b700f65d6 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:34.934538 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-69ea6464-4005-48f5-965f-0a7b700f65d6 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:35.358365 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-69ea6464-4005-48f5-965f-0a7b700f65d6 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/9807e0ee-bfbd-4a3d-8950-355027d9b1d3" status: 200 len: 1648 microversion: 2.1 time: 0.465853 Oct 18 15:46:35.361518 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2361/4703] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:34 2022] GET /compute/v2.1/servers/9807e0ee-bfbd-4a3d-8950-355027d9b1d3 => generated 1648 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:35.367168 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-71c75dd2-c9e3-4ae1-b97d-e550404340fd tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:35.375787 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-71c75dd2-c9e3-4ae1-b97d-e550404340fd tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] [instance: a2303432-63f3-45b5-848e-eea36fb0094c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:35.383556 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-389b3881-7504-4420-a524-323b2cf19d81 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:35.395833 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-389b3881-7504-4420-a524-323b2cf19d81 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.537477 Oct 18 15:46:35.412894 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2343/4704] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:34 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:35.422538 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6bc6cfe7-4358-478e-958e-4a38ee0f0156 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:35.423151 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6bc6cfe7-4358-478e-958e-4a38ee0f0156 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] [instance: 9807e0ee-bfbd-4a3d-8950-355027d9b1d3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:35.424963 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-71c75dd2-c9e3-4ae1-b97d-e550404340fd tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:35.425413 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-71c75dd2-c9e3-4ae1-b97d-e550404340fd tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:35.425847 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-71c75dd2-c9e3-4ae1-b97d-e550404340fd tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:35.426706 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-71c75dd2-c9e3-4ae1-b97d-e550404340fd tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:35.427162 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-71c75dd2-c9e3-4ae1-b97d-e550404340fd tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:35.427586 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-71c75dd2-c9e3-4ae1-b97d-e550404340fd tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:35.441607 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6bc6cfe7-4358-478e-958e-4a38ee0f0156 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:35.442879 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6bc6cfe7-4358-478e-958e-4a38ee0f0156 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:35.443629 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6bc6cfe7-4358-478e-958e-4a38ee0f0156 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:35.444574 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6bc6cfe7-4358-478e-958e-4a38ee0f0156 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:35.445230 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6bc6cfe7-4358-478e-958e-4a38ee0f0156 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:35.446049 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6bc6cfe7-4358-478e-958e-4a38ee0f0156 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:35.659392 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-71c75dd2-c9e3-4ae1-b97d-e550404340fd tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6caed9f67c4c05ba02abe4e424cbab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42c92cc615744258653a5aa70010db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:35.674184 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-71c75dd2-c9e3-4ae1-b97d-e550404340fd tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] 10.222.0.60 "GET /compute/v2.1/servers/a2303432-63f3-45b5-848e-eea36fb0094c" status: 200 len: 1324 microversion: 2.1 time: 0.310689 Oct 18 15:46:35.683745 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2362/4705] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:35 2022] GET /compute/v2.1/servers/a2303432-63f3-45b5-848e-eea36fb0094c => generated 1324 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:35.703058 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6b867ba1-a7cc-4eca-840f-becfa4038431 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:35.704428 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6b867ba1-a7cc-4eca-840f-becfa4038431 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:35.707371 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6bc6cfe7-4358-478e-958e-4a38ee0f0156 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/9807e0ee-bfbd-4a3d-8950-355027d9b1d3" status: 200 len: 1648 microversion: 2.1 time: 0.293117 Oct 18 15:46:35.707963 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2344/4706] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:35 2022] GET /compute/v2.1/servers/9807e0ee-bfbd-4a3d-8950-355027d9b1d3 => generated 1648 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:35.722566 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6b867ba1-a7cc-4eca-840f-becfa4038431 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:35.722566 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6b867ba1-a7cc-4eca-840f-becfa4038431 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:35.722566 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6b867ba1-a7cc-4eca-840f-becfa4038431 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:35.722566 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6b867ba1-a7cc-4eca-840f-becfa4038431 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:35.722566 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6b867ba1-a7cc-4eca-840f-becfa4038431 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:35.722566 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6b867ba1-a7cc-4eca-840f-becfa4038431 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:35.738572 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b75ae90a-32c1-48e4-88be-d134cb149715 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:35.742592 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b75ae90a-32c1-48e4-88be-d134cb149715 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] [instance: 9807e0ee-bfbd-4a3d-8950-355027d9b1d3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:35.753066 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b75ae90a-32c1-48e4-88be-d134cb149715 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:35.753640 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b75ae90a-32c1-48e4-88be-d134cb149715 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:35.754309 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b75ae90a-32c1-48e4-88be-d134cb149715 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:35.755098 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b75ae90a-32c1-48e4-88be-d134cb149715 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:35.755665 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b75ae90a-32c1-48e4-88be-d134cb149715 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:35.756199 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b75ae90a-32c1-48e4-88be-d134cb149715 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:36.053198 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b75ae90a-32c1-48e4-88be-d134cb149715 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/9807e0ee-bfbd-4a3d-8950-355027d9b1d3" status: 200 len: 1648 microversion: 2.1 time: 0.318148 Oct 18 15:46:36.054215 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2345/4707] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:35 2022] GET /compute/v2.1/servers/9807e0ee-bfbd-4a3d-8950-355027d9b1d3 => generated 1648 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:36.060094 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e215298b-faab-4db0-96bd-009ba95b7db7 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:36.061019 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e215298b-faab-4db0-96bd-009ba95b7db7 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 9d108fa0-49bb-46c2-a8b0-802c5835cb14] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:36.068381 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e215298b-faab-4db0-96bd-009ba95b7db7 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:36.068908 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e215298b-faab-4db0-96bd-009ba95b7db7 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:36.069523 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e215298b-faab-4db0-96bd-009ba95b7db7 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:36.070444 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e215298b-faab-4db0-96bd-009ba95b7db7 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:36.071395 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e215298b-faab-4db0-96bd-009ba95b7db7 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:36.072521 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e215298b-faab-4db0-96bd-009ba95b7db7 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:36.223350 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6b867ba1-a7cc-4eca-840f-becfa4038431 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:36.247774 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6b867ba1-a7cc-4eca-840f-becfa4038431 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.562502 Oct 18 15:46:36.250709 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2363/4708] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:35 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:36.274001 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-36ec35e2-3dfc-479d-b3f7-f42ff6dde9ce tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:46:36.274771 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-36ec35e2-3dfc-479d-b3f7-f42ff6dde9ce tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 92313981-da0a-4acb-a8e4-3a6cfdd84dac] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:36.284446 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-36ec35e2-3dfc-479d-b3f7-f42ff6dde9ce tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] HTTP exception thrown: Instance 92313981-da0a-4acb-a8e4-3a6cfdd84dac could not be found. Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-36ec35e2-3dfc-479d-b3f7-f42ff6dde9ce tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Request method failure captured: Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: request: POST /compute/v2.1/servers/92313981-da0a-4acb-a8e4-3a6cfdd84dac/action HTTP/1.1 Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 15 Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTslxbnvpe5yiGf5CWZMgShC81OiGKrcSLYZFSWKOLbaqqF5kNJvh8cijdldsPo1OHjHXDcbdPuhTuFRNRswVq0HwpXLNCfOWcF3GU1M8LHkZwXu6ScaOEIHyQ8ewFnAFL7TXd1O14t3atsv_uM6Xc9ZHSfefERCjuehdw5SJuAn7MMs Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 96c4378d52d1489bb2d50e84cabf95eb Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: {"unpause": {}} Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 92313981-da0a-4acb-a8e4-3a6cfdd84dac could not be found. Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '92313981-da0a-4acb-a8e4-3a6cfdd84dac', 'body': {'unpause': {}}} Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92313981-da0a-4acb-a8e4-3a6cfdd84dac could not be found. Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92313981-da0a-4acb-a8e4-3a6cfdd84dac could not be found. Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:46:36.297266 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:46:36.301850 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:46:36.301850 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:46:36.301850 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92313981-da0a-4acb-a8e4-3a6cfdd84dac could not be found. Oct 18 15:46:36.301850 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:36.301850 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-36ec35e2-3dfc-479d-b3f7-f42ff6dde9ce tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Returning 404 to user: Instance 92313981-da0a-4acb-a8e4-3a6cfdd84dac could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:46:36.301850 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-36ec35e2-3dfc-479d-b3f7-f42ff6dde9ce tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "POST /compute/v2.1/servers/92313981-da0a-4acb-a8e4-3a6cfdd84dac/action" status: 404 len: 111 microversion: 2.1 time: 0.028818 Oct 18 15:46:36.309024 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2364/4709] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:46:36 2022] POST /compute/v2.1/servers/92313981-da0a-4acb-a8e4-3a6cfdd84dac/action => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:46:36.314514 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-81a2ee05-9852-4609-93ba-ae28f5c8324f tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-843423120", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "availability_zone": "nova:n-h1-853682-5", "networks": [{"uuid": "10dbdb0e-e304-481a-a42b-85bde0c53b49"}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:46:36.435863 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-81a2ee05-9852-4609-93ba-ae28f5c8324f tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] validate_networks() for [('10dbdb0e-e304-481a-a42b-85bde0c53b49', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:46:36.614601 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e215298b-faab-4db0-96bd-009ba95b7db7 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:36.635618 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e215298b-faab-4db0-96bd-009ba95b7db7 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14" status: 200 len: 1318 microversion: 2.1 time: 0.580400 Oct 18 15:46:36.636226 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2346/4710] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:36 2022] GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14 => generated 1318 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:36.641054 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b2e258be-0d47-4e2d-bec2-a82fc4e679fc tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:36.641678 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b2e258be-0d47-4e2d-bec2-a82fc4e679fc tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:36.651475 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2e258be-0d47-4e2d-bec2-a82fc4e679fc tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:36.653383 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2e258be-0d47-4e2d-bec2-a82fc4e679fc tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:36.653692 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2e258be-0d47-4e2d-bec2-a82fc4e679fc tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:36.656002 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2e258be-0d47-4e2d-bec2-a82fc4e679fc tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:36.656764 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2e258be-0d47-4e2d-bec2-a82fc4e679fc tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:36.658409 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2e258be-0d47-4e2d-bec2-a82fc4e679fc tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:37.088971 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b2e258be-0d47-4e2d-bec2-a82fc4e679fc tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:37.097374 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b2e258be-0d47-4e2d-bec2-a82fc4e679fc tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.460102 Oct 18 15:46:37.099743 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2347/4711] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:36 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:37.116984 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2153efb8-b7b2-4e18-a859-bb95b8d6451b tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:37.116984 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2153efb8-b7b2-4e18-a859-bb95b8d6451b tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] [instance: a2303432-63f3-45b5-848e-eea36fb0094c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:37.123819 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2153efb8-b7b2-4e18-a859-bb95b8d6451b tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:37.124867 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2153efb8-b7b2-4e18-a859-bb95b8d6451b tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:37.125557 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2153efb8-b7b2-4e18-a859-bb95b8d6451b tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:37.126871 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2153efb8-b7b2-4e18-a859-bb95b8d6451b tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:37.127713 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2153efb8-b7b2-4e18-a859-bb95b8d6451b tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:37.128505 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2153efb8-b7b2-4e18-a859-bb95b8d6451b tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:37.324939 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-81a2ee05-9852-4609-93ba-ae28f5c8324f tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:46:37.326002 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-81a2ee05-9852-4609-93ba-ae28f5c8324f tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:46:37.327941 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-81a2ee05-9852-4609-93ba-ae28f5c8324f tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:46:37.329295 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-81a2ee05-9852-4609-93ba-ae28f5c8324f tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:46:37.330373 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-81a2ee05-9852-4609-93ba-ae28f5c8324f tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:46:37.348353 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2153efb8-b7b2-4e18-a859-bb95b8d6451b tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6caed9f67c4c05ba02abe4e424cbab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42c92cc615744258653a5aa70010db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:37.353948 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-81a2ee05-9852-4609-93ba-ae28f5c8324f tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:37.354530 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-81a2ee05-9852-4609-93ba-ae28f5c8324f tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:37.355109 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-81a2ee05-9852-4609-93ba-ae28f5c8324f tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:37.356477 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-81a2ee05-9852-4609-93ba-ae28f5c8324f tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:37.356974 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-81a2ee05-9852-4609-93ba-ae28f5c8324f tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:37.357412 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-81a2ee05-9852-4609-93ba-ae28f5c8324f tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:37.363706 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2153efb8-b7b2-4e18-a859-bb95b8d6451b tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] 10.222.0.60 "GET /compute/v2.1/servers/a2303432-63f3-45b5-848e-eea36fb0094c" status: 200 len: 1324 microversion: 2.1 time: 0.261085 Oct 18 15:46:37.364714 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2348/4712] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:37 2022] GET /compute/v2.1/servers/a2303432-63f3-45b5-848e-eea36fb0094c => generated 1324 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:37.372561 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-49e45a64-c9ee-46a7-9bf4-9693792952d1 req-fc33d161-bd9b-462c-852d-88cb006b5fd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2303432-63f3-45b5-848e-eea36fb0094c", "tag": "f6b0c2cd-bedf-41e0-9d1f-5330335c9efa"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:46:37.381598 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-81a2ee05-9852-4609-93ba-ae28f5c8324f tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Getting quotas for project 57e1ed6dd4054683b164828361bf52da. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:46:37.388917 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-49e45a64-c9ee-46a7-9bf4-9693792952d1 req-fc33d161-bd9b-462c-852d-88cb006b5fd1 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:37.390161 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-81a2ee05-9852-4609-93ba-ae28f5c8324f tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Getting quotas for user 724d2951ce1b427d923c7c22c0b32cf3 and project 57e1ed6dd4054683b164828361bf52da. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:46:37.390924 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-49e45a64-c9ee-46a7-9bf4-9693792952d1 req-fc33d161-bd9b-462c-852d-88cb006b5fd1 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:37.392156 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-49e45a64-c9ee-46a7-9bf4-9693792952d1 req-fc33d161-bd9b-462c-852d-88cb006b5fd1 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:37.407685 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-81a2ee05-9852-4609-93ba-ae28f5c8324f tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:46:37.411023 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-81a2ee05-9852-4609-93ba-ae28f5c8324f tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] [instance: 84b7e841-8cd5-4554-bf61-e2076ee819a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:46:37.411481 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-49e45a64-c9ee-46a7-9bf4-9693792952d1 req-fc33d161-bd9b-462c-852d-88cb006b5fd1 service nova] Creating event network-changed:f6b0c2cd-bedf-41e0-9d1f-5330335c9efa for instance a2303432-63f3-45b5-848e-eea36fb0094c on n-h2-853682-5 Oct 18 15:46:37.418125 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-49e45a64-c9ee-46a7-9bf4-9693792952d1 req-fc33d161-bd9b-462c-852d-88cb006b5fd1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051171 Oct 18 15:46:37.419054 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2349/4713] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:46:37.425392 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9a7b8a9d-e841-41a0-ba5b-c6d17c77d757 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:37.426111 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9a7b8a9d-e841-41a0-ba5b-c6d17c77d757 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:37.433744 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:37.435438 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a7b8a9d-e841-41a0-ba5b-c6d17c77d757 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:37.435940 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a7b8a9d-e841-41a0-ba5b-c6d17c77d757 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:37.436385 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a7b8a9d-e841-41a0-ba5b-c6d17c77d757 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:37.437255 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a7b8a9d-e841-41a0-ba5b-c6d17c77d757 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:37.437722 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a7b8a9d-e841-41a0-ba5b-c6d17c77d757 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:37.438236 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a7b8a9d-e841-41a0-ba5b-c6d17c77d757 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:37.449128 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:37.475054 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-81a2ee05-9852-4609-93ba-ae28f5c8324f tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.164616 Oct 18 15:46:37.483388 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2365/4714] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:46:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1173 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:46:37.490799 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-dbfda995-4a48-4858-a18a-0e471ff923e7 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:37.493860 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-dbfda995-4a48-4858-a18a-0e471ff923e7 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] [instance: 84b7e841-8cd5-4554-bf61-e2076ee819a9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:37.602105 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-dbfda995-4a48-4858-a18a-0e471ff923e7 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/84b7e841-8cd5-4554-bf61-e2076ee819a9" status: 200 len: 1328 microversion: 2.1 time: 0.116961 Oct 18 15:46:37.604438 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2366/4715] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:37 2022] GET /compute/v2.1/servers/84b7e841-8cd5-4554-bf61-e2076ee819a9 => generated 1328 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:37.663038 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-29c59269-0857-41fe-be4b-8ff27a05e5ac tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:37.663988 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-29c59269-0857-41fe-be4b-8ff27a05e5ac tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 9d108fa0-49bb-46c2-a8b0-802c5835cb14] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:37.676226 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-29c59269-0857-41fe-be4b-8ff27a05e5ac tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:37.676837 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9a7b8a9d-e841-41a0-ba5b-c6d17c77d757 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:37.677341 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-29c59269-0857-41fe-be4b-8ff27a05e5ac tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:37.677858 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-29c59269-0857-41fe-be4b-8ff27a05e5ac tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:37.681779 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-29c59269-0857-41fe-be4b-8ff27a05e5ac tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:37.682626 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-29c59269-0857-41fe-be4b-8ff27a05e5ac tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:37.683315 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-29c59269-0857-41fe-be4b-8ff27a05e5ac tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:37.687226 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9a7b8a9d-e841-41a0-ba5b-c6d17c77d757 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.266411 Oct 18 15:46:37.687827 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2350/4716] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:37 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:37.719546 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a6a17be3-e570-4bd0-a7a0-ab986299d7de tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:46:37.721251 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a6a17be3-e570-4bd0-a7a0-ab986299d7de tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:37.741466 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a6a17be3-e570-4bd0-a7a0-ab986299d7de tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:37.741955 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a6a17be3-e570-4bd0-a7a0-ab986299d7de tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:37.742397 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a6a17be3-e570-4bd0-a7a0-ab986299d7de tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:37.743103 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a6a17be3-e570-4bd0-a7a0-ab986299d7de tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:37.744243 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a6a17be3-e570-4bd0-a7a0-ab986299d7de tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:37.744668 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a6a17be3-e570-4bd0-a7a0-ab986299d7de tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:37.789330 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-a6a17be3-e570-4bd0-a7a0-ab986299d7de tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] HTTP exception thrown: Cannot 'unpause' instance 2cc69e2e-cb26-42d6-b887-31e0afaa69fc while it is in vm_state active Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a6a17be3-e570-4bd0-a7a0-ab986299d7de tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Request method failure captured: Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc/action HTTP/1.1 Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 15 Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTslxbnvpe5yiGf5CWZMgShC81OiGKrcSLYZFSWKOLbaqqF5kNJvh8cijdldsPo1OHjHXDcbdPuhTuFRNRswVq0HwpXLNCfOWcF3GU1M8LHkZwXu6ScaOEIHyQ8ewFnAFL7TXd1O14t3atsv_uM6Xc9ZHSfefERCjuehdw5SJuAn7MMs Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 96c4378d52d1489bb2d50e84cabf95eb Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: {"unpause": {}} Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: exception: Cannot 'unpause' instance 2cc69e2e-cb26-42d6-b887-31e0afaa69fc while it is in vm_state active Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '2cc69e2e-cb26-42d6-b887-31e0afaa69fc', 'body': {'unpause': {}}} Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2cc69e2e-cb26-42d6-b887-31e0afaa69fc in vm_state active. Cannot unpause while the instance is in this state. Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 2cc69e2e-cb26-42d6-b887-31e0afaa69fc while it is in vm_state active Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:37.791327 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:46:37.795512 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:46:37.795512 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:46:37.795512 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:46:37.795512 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 2cc69e2e-cb26-42d6-b887-31e0afaa69fc while it is in vm_state active Oct 18 15:46:37.795512 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:46:37.797559 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a6a17be3-e570-4bd0-a7a0-ab986299d7de tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Returning 409 to user: Cannot 'unpause' instance 2cc69e2e-cb26-42d6-b887-31e0afaa69fc while it is in vm_state active {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:46:37.798808 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a6a17be3-e570-4bd0-a7a0-ab986299d7de tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "POST /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc/action" status: 409 len: 145 microversion: 2.1 time: 0.083637 Oct 18 15:46:37.800452 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2351/4717] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:46:37 2022] POST /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc/action => generated 145 bytes in 86 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 15:46:37.811684 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fa8b5fe0-84f8-4428-9113-81d4a7cb7617 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:37.814420 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fa8b5fe0-84f8-4428-9113-81d4a7cb7617 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:37.824241 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fa8b5fe0-84f8-4428-9113-81d4a7cb7617 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:37.825099 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fa8b5fe0-84f8-4428-9113-81d4a7cb7617 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:37.825773 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fa8b5fe0-84f8-4428-9113-81d4a7cb7617 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:37.826699 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fa8b5fe0-84f8-4428-9113-81d4a7cb7617 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:37.827369 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fa8b5fe0-84f8-4428-9113-81d4a7cb7617 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:37.828303 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fa8b5fe0-84f8-4428-9113-81d4a7cb7617 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:37.918530 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-29c59269-0857-41fe-be4b-8ff27a05e5ac tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:37.932260 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-29c59269-0857-41fe-be4b-8ff27a05e5ac tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14" status: 200 len: 1507 microversion: 2.1 time: 0.272538 Oct 18 15:46:37.933206 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2367/4718] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:37 2022] GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14 => generated 1507 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:37.959058 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c78fcd6f-e662-47bb-a7ac-19998818e8cd tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:37.959897 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c78fcd6f-e662-47bb-a7ac-19998818e8cd tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 9d108fa0-49bb-46c2-a8b0-802c5835cb14] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:37.973099 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c78fcd6f-e662-47bb-a7ac-19998818e8cd tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:37.975776 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c78fcd6f-e662-47bb-a7ac-19998818e8cd tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:37.977089 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c78fcd6f-e662-47bb-a7ac-19998818e8cd tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:37.980202 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c78fcd6f-e662-47bb-a7ac-19998818e8cd tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:37.981185 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c78fcd6f-e662-47bb-a7ac-19998818e8cd tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:37.983628 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c78fcd6f-e662-47bb-a7ac-19998818e8cd tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:38.023017 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fa8b5fe0-84f8-4428-9113-81d4a7cb7617 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:38.037954 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fa8b5fe0-84f8-4428-9113-81d4a7cb7617 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.232924 Oct 18 15:46:38.040142 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2352/4719] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:37 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:38.066786 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4ee8c56b-4631-44a0-84a6-6f7ff03e984a tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:38.067502 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4ee8c56b-4631-44a0-84a6-6f7ff03e984a tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:38.079601 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ee8c56b-4631-44a0-84a6-6f7ff03e984a tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:38.080252 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ee8c56b-4631-44a0-84a6-6f7ff03e984a tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:38.080790 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ee8c56b-4631-44a0-84a6-6f7ff03e984a tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:38.084076 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ee8c56b-4631-44a0-84a6-6f7ff03e984a tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:38.084699 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ee8c56b-4631-44a0-84a6-6f7ff03e984a tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:38.086204 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ee8c56b-4631-44a0-84a6-6f7ff03e984a tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:38.222882 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c78fcd6f-e662-47bb-a7ac-19998818e8cd tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:38.235223 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c78fcd6f-e662-47bb-a7ac-19998818e8cd tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14" status: 200 len: 1507 microversion: 2.1 time: 0.280068 Oct 18 15:46:38.236859 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2368/4720] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:37 2022] GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14 => generated 1507 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:38.259649 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6eba0650-a3f6-46a2-adfc-38b2f98ed35b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:46:38.265732 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6eba0650-a3f6-46a2-adfc-38b2f98ed35b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 9d108fa0-49bb-46c2-a8b0-802c5835cb14] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:38.276712 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6eba0650-a3f6-46a2-adfc-38b2f98ed35b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:38.280261 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6eba0650-a3f6-46a2-adfc-38b2f98ed35b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:38.280720 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6eba0650-a3f6-46a2-adfc-38b2f98ed35b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:38.285694 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6eba0650-a3f6-46a2-adfc-38b2f98ed35b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:38.286489 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6eba0650-a3f6-46a2-adfc-38b2f98ed35b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:38.287196 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6eba0650-a3f6-46a2-adfc-38b2f98ed35b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:38.359602 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4ee8c56b-4631-44a0-84a6-6f7ff03e984a tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:38.374417 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4ee8c56b-4631-44a0-84a6-6f7ff03e984a tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.312183 Oct 18 15:46:38.375276 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2353/4721] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:38 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:38.391348 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-22e91f35-76bd-46aa-8b15-7a0cddd990ad tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:38.392221 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-22e91f35-76bd-46aa-8b15-7a0cddd990ad tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] [instance: a2303432-63f3-45b5-848e-eea36fb0094c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:38.406428 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-22e91f35-76bd-46aa-8b15-7a0cddd990ad tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:38.407330 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-22e91f35-76bd-46aa-8b15-7a0cddd990ad tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:38.407975 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-22e91f35-76bd-46aa-8b15-7a0cddd990ad tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:38.408893 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-22e91f35-76bd-46aa-8b15-7a0cddd990ad tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:38.410151 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6eba0650-a3f6-46a2-adfc-38b2f98ed35b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "PUT /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14" status: 200 len: 1079 microversion: 2.1 time: 0.155631 Oct 18 15:46:38.410670 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-22e91f35-76bd-46aa-8b15-7a0cddd990ad tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:38.411776 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2369/4722] 10.222.0.60 () {60 vars in 1256 bytes} [Tue Oct 18 15:46:38 2022] PUT /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14 => generated 1079 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:38.412901 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-22e91f35-76bd-46aa-8b15-7a0cddd990ad tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:38.431174 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a24fb6b4-b9ba-4ff6-8a7a-7181a8c9472b tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:46:38.434335 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a24fb6b4-b9ba-4ff6-8a7a-7181a8c9472b tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 8b951358-f7f4-4c05-8a4d-c088a62eef22] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:38.446059 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-a24fb6b4-b9ba-4ff6-8a7a-7181a8c9472b tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] HTTP exception thrown: Instance 8b951358-f7f4-4c05-8a4d-c088a62eef22 could not be found. Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a24fb6b4-b9ba-4ff6-8a7a-7181a8c9472b tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Request method failure captured: Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: request: POST /compute/v2.1/servers/8b951358-f7f4-4c05-8a4d-c088a62eef22/action HTTP/1.1 Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 18 Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTslxbnvpe5yiGf5CWZMgShC81OiGKrcSLYZFSWKOLbaqqF5kNJvh8cijdldsPo1OHjHXDcbdPuhTuFRNRswVq0HwpXLNCfOWcF3GU1M8LHkZwXu6ScaOEIHyQ8ewFnAFL7TXd1O14t3atsv_uM6Xc9ZHSfefERCjuehdw5SJuAn7MMs Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 96c4378d52d1489bb2d50e84cabf95eb Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: {"unshelve": null} Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 8b951358-f7f4-4c05-8a4d-c088a62eef22 could not be found. Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '8b951358-f7f4-4c05-8a4d-c088a62eef22', 'body': {'unshelve': None}} Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b951358-f7f4-4c05-8a4d-c088a62eef22 could not be found. Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b951358-f7f4-4c05-8a4d-c088a62eef22 could not be found. Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:38.448203 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:46:38.453488 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:38.453488 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:38.453488 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:46:38.453488 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:46:38.453488 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:46:38.453488 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:46:38.453488 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b951358-f7f4-4c05-8a4d-c088a62eef22 could not be found. Oct 18 15:46:38.453488 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:38.457082 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a24fb6b4-b9ba-4ff6-8a7a-7181a8c9472b tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Returning 404 to user: Instance 8b951358-f7f4-4c05-8a4d-c088a62eef22 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:46:38.458286 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a24fb6b4-b9ba-4ff6-8a7a-7181a8c9472b tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "POST /compute/v2.1/servers/8b951358-f7f4-4c05-8a4d-c088a62eef22/action" status: 404 len: 111 microversion: 2.1 time: 0.045221 Oct 18 15:46:38.459065 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2370/4723] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:46:38 2022] POST /compute/v2.1/servers/8b951358-f7f4-4c05-8a4d-c088a62eef22/action => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:46:38.465778 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-40d0930c-c08d-414d-aa64-a45833ce13eb tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:38.466899 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-40d0930c-c08d-414d-aa64-a45833ce13eb tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 9d108fa0-49bb-46c2-a8b0-802c5835cb14] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:38.474963 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-40d0930c-c08d-414d-aa64-a45833ce13eb tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:38.475800 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-40d0930c-c08d-414d-aa64-a45833ce13eb tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:38.476693 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-40d0930c-c08d-414d-aa64-a45833ce13eb tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:38.477794 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-40d0930c-c08d-414d-aa64-a45833ce13eb tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:38.479245 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-40d0930c-c08d-414d-aa64-a45833ce13eb tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:38.480017 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-40d0930c-c08d-414d-aa64-a45833ce13eb tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:38.750730 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-22e91f35-76bd-46aa-8b15-7a0cddd990ad tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6caed9f67c4c05ba02abe4e424cbab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42c92cc615744258653a5aa70010db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:38.760307 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-22e91f35-76bd-46aa-8b15-7a0cddd990ad tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] 10.222.0.60 "GET /compute/v2.1/servers/a2303432-63f3-45b5-848e-eea36fb0094c" status: 200 len: 1324 microversion: 2.1 time: 0.376172 Oct 18 15:46:38.761663 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2354/4724] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:38 2022] GET /compute/v2.1/servers/a2303432-63f3-45b5-848e-eea36fb0094c => generated 1324 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:38.767785 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-966dde22-1d4a-43a6-bc06-90a785e2916c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:38.768628 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-966dde22-1d4a-43a6-bc06-90a785e2916c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:38.776661 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-966dde22-1d4a-43a6-bc06-90a785e2916c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:38.778027 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-966dde22-1d4a-43a6-bc06-90a785e2916c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:38.778673 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-966dde22-1d4a-43a6-bc06-90a785e2916c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:38.779560 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-966dde22-1d4a-43a6-bc06-90a785e2916c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:38.780724 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-966dde22-1d4a-43a6-bc06-90a785e2916c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:38.781213 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-966dde22-1d4a-43a6-bc06-90a785e2916c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:38.788401 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-40d0930c-c08d-414d-aa64-a45833ce13eb tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:38.799206 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-40d0930c-c08d-414d-aa64-a45833ce13eb tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14" status: 200 len: 1505 microversion: 2.1 time: 0.338811 Oct 18 15:46:38.799789 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2371/4725] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:38 2022] GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14 => generated 1505 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:38.806752 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8fc7f6dd-4975-4c18-86ee-648e545c26c7 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:38.807491 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8fc7f6dd-4975-4c18-86ee-648e545c26c7 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] [instance: 84b7e841-8cd5-4554-bf61-e2076ee819a9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:38.819524 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8fc7f6dd-4975-4c18-86ee-648e545c26c7 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:38.820391 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8fc7f6dd-4975-4c18-86ee-648e545c26c7 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:38.821065 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8fc7f6dd-4975-4c18-86ee-648e545c26c7 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:38.822511 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8fc7f6dd-4975-4c18-86ee-648e545c26c7 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:38.822986 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8fc7f6dd-4975-4c18-86ee-648e545c26c7 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:38.823674 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8fc7f6dd-4975-4c18-86ee-648e545c26c7 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:38.913960 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8fc7f6dd-4975-4c18-86ee-648e545c26c7 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/84b7e841-8cd5-4554-bf61-e2076ee819a9" status: 200 len: 1415 microversion: 2.1 time: 0.111010 Oct 18 15:46:38.914549 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2372/4726] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:38 2022] GET /compute/v2.1/servers/84b7e841-8cd5-4554-bf61-e2076ee819a9 => generated 1415 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:38.919847 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-935e6555-08c8-467e-9787-df4dda772587 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:38.920469 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-935e6555-08c8-467e-9787-df4dda772587 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 9d108fa0-49bb-46c2-a8b0-802c5835cb14] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:38.928565 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-935e6555-08c8-467e-9787-df4dda772587 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:38.929762 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-935e6555-08c8-467e-9787-df4dda772587 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:38.930542 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-935e6555-08c8-467e-9787-df4dda772587 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:38.930931 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-935e6555-08c8-467e-9787-df4dda772587 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:38.931433 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-935e6555-08c8-467e-9787-df4dda772587 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:38.931865 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-935e6555-08c8-467e-9787-df4dda772587 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:38.950028 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-966dde22-1d4a-43a6-bc06-90a785e2916c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:38.958612 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-966dde22-1d4a-43a6-bc06-90a785e2916c tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.195653 Oct 18 15:46:38.959202 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2355/4727] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:38 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:38.983103 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6ed9462b-bcc7-40cf-b177-ee32581e8ff3 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:38.983829 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6ed9462b-bcc7-40cf-b177-ee32581e8ff3 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:38.991272 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ed9462b-bcc7-40cf-b177-ee32581e8ff3 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:38.991860 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ed9462b-bcc7-40cf-b177-ee32581e8ff3 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:38.992371 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ed9462b-bcc7-40cf-b177-ee32581e8ff3 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:38.993182 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ed9462b-bcc7-40cf-b177-ee32581e8ff3 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:38.993792 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ed9462b-bcc7-40cf-b177-ee32581e8ff3 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:38.994285 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ed9462b-bcc7-40cf-b177-ee32581e8ff3 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:39.149238 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-935e6555-08c8-467e-9787-df4dda772587 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:39.162111 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-935e6555-08c8-467e-9787-df4dda772587 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14" status: 200 len: 1505 microversion: 2.1 time: 0.245972 Oct 18 15:46:39.162708 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2373/4728] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:38 2022] GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14 => generated 1505 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:39.194004 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6ed9462b-bcc7-40cf-b177-ee32581e8ff3 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:39.194310 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-426dd90a-147f-42f0-bb8f-3269ad694600 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:46:39.196492 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:39.202081 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-426dd90a-147f-42f0-bb8f-3269ad694600 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 9d108fa0-49bb-46c2-a8b0-802c5835cb14] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:39.211804 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-426dd90a-147f-42f0-bb8f-3269ad694600 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:39.212409 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-426dd90a-147f-42f0-bb8f-3269ad694600 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:39.213231 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6ed9462b-bcc7-40cf-b177-ee32581e8ff3 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.233354 Oct 18 15:46:39.213561 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-426dd90a-147f-42f0-bb8f-3269ad694600 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:39.213857 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2356/4729] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:38 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:46:39.227077 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-426dd90a-147f-42f0-bb8f-3269ad694600 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:39.227593 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-426dd90a-147f-42f0-bb8f-3269ad694600 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:39.228077 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-426dd90a-147f-42f0-bb8f-3269ad694600 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:39.248914 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7691e6a3-145b-416b-8268-dfb588462a59 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:46:39.251102 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7691e6a3-145b-416b-8268-dfb588462a59 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:39.266140 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7691e6a3-145b-416b-8268-dfb588462a59 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:39.266642 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7691e6a3-145b-416b-8268-dfb588462a59 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:39.270775 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7691e6a3-145b-416b-8268-dfb588462a59 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:39.274349 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7691e6a3-145b-416b-8268-dfb588462a59 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:39.274882 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7691e6a3-145b-416b-8268-dfb588462a59 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:39.275752 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7691e6a3-145b-416b-8268-dfb588462a59 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:39.342282 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-426dd90a-147f-42f0-bb8f-3269ad694600 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:46:39.342921 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-426dd90a-147f-42f0-bb8f-3269ad694600 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:46:39.343692 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-7691e6a3-145b-416b-8268-dfb588462a59 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] HTTP exception thrown: Cannot 'unshelve' instance 2cc69e2e-cb26-42d6-b887-31e0afaa69fc while it is in vm_state active Oct 18 15:46:39.344352 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-426dd90a-147f-42f0-bb8f-3269ad694600 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:46:39.344967 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-426dd90a-147f-42f0-bb8f-3269ad694600 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:46:39.345532 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-426dd90a-147f-42f0-bb8f-3269ad694600 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7691e6a3-145b-416b-8268-dfb588462a59 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Request method failure captured: Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc/action HTTP/1.1 Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 18 Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTslxbnvpe5yiGf5CWZMgShC81OiGKrcSLYZFSWKOLbaqqF5kNJvh8cijdldsPo1OHjHXDcbdPuhTuFRNRswVq0HwpXLNCfOWcF3GU1M8LHkZwXu6ScaOEIHyQ8ewFnAFL7TXd1O14t3atsv_uM6Xc9ZHSfefERCjuehdw5SJuAn7MMs Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 96c4378d52d1489bb2d50e84cabf95eb Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: {"unshelve": null} Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: exception: Cannot 'unshelve' instance 2cc69e2e-cb26-42d6-b887-31e0afaa69fc while it is in vm_state active Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '2cc69e2e-cb26-42d6-b887-31e0afaa69fc', 'body': {'unshelve': None}} Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2cc69e2e-cb26-42d6-b887-31e0afaa69fc in vm_state active. Cannot unshelve while the instance is in this state. Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 15:46:39.347194 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 15:46:39.352482 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 2cc69e2e-cb26-42d6-b887-31e0afaa69fc while it is in vm_state active Oct 18 15:46:39.352482 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:46:39.352482 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:46:39.352482 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:46:39.352482 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:39.352482 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:46:39.352482 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:46:39.352482 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:46:39.352482 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:46:39.352482 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 2cc69e2e-cb26-42d6-b887-31e0afaa69fc while it is in vm_state active Oct 18 15:46:39.352482 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:46:39.352482 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7691e6a3-145b-416b-8268-dfb588462a59 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Returning 409 to user: Cannot 'unshelve' instance 2cc69e2e-cb26-42d6-b887-31e0afaa69fc while it is in vm_state active {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:46:39.352482 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7691e6a3-145b-416b-8268-dfb588462a59 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "POST /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc/action" status: 409 len: 146 microversion: 2.1 time: 0.112859 Oct 18 15:46:39.353387 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2357/4730] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:46:39 2022] POST /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc/action => generated 146 bytes in 117 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 18 15:46:39.375957 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7ebeaece-7f89-4b5d-bf23-f1cc1686760f tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:39.382221 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7ebeaece-7f89-4b5d-bf23-f1cc1686760f tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:39.408698 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ebeaece-7f89-4b5d-bf23-f1cc1686760f tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:39.409526 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ebeaece-7f89-4b5d-bf23-f1cc1686760f tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:39.410136 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ebeaece-7f89-4b5d-bf23-f1cc1686760f tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:39.413189 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ebeaece-7f89-4b5d-bf23-f1cc1686760f tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:39.414522 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ebeaece-7f89-4b5d-bf23-f1cc1686760f tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:39.415911 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ebeaece-7f89-4b5d-bf23-f1cc1686760f tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:39.442603 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-426dd90a-147f-42f0-bb8f-3269ad694600 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 9d108fa0-49bb-46c2-a8b0-802c5835cb14] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:39.451406 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-426dd90a-147f-42f0-bb8f-3269ad694600 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:39.452172 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-426dd90a-147f-42f0-bb8f-3269ad694600 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:39.452797 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-426dd90a-147f-42f0-bb8f-3269ad694600 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:39.453678 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-426dd90a-147f-42f0-bb8f-3269ad694600 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:39.454362 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-426dd90a-147f-42f0-bb8f-3269ad694600 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:39.454942 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-426dd90a-147f-42f0-bb8f-3269ad694600 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:39.482889 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-426dd90a-147f-42f0-bb8f-3269ad694600 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "POST /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14/action" status: 202 len: 1111 microversion: 2.1 time: 0.300102 Oct 18 15:46:39.483605 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2374/4731] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:46:39 2022] POST /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14/action => generated 1111 bytes in 302 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 18 15:46:39.503488 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3607d3bd-8d7a-4ae1-bb99-59c96f728151 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:39.504260 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3607d3bd-8d7a-4ae1-bb99-59c96f728151 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 9d108fa0-49bb-46c2-a8b0-802c5835cb14] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:39.511088 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3607d3bd-8d7a-4ae1-bb99-59c96f728151 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:39.511937 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3607d3bd-8d7a-4ae1-bb99-59c96f728151 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:39.512531 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3607d3bd-8d7a-4ae1-bb99-59c96f728151 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:39.513414 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3607d3bd-8d7a-4ae1-bb99-59c96f728151 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:39.514099 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3607d3bd-8d7a-4ae1-bb99-59c96f728151 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:39.514688 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3607d3bd-8d7a-4ae1-bb99-59c96f728151 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:39.865363 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7ebeaece-7f89-4b5d-bf23-f1cc1686760f tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:39.880474 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3607d3bd-8d7a-4ae1-bb99-59c96f728151 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:39.881473 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7ebeaece-7f89-4b5d-bf23-f1cc1686760f tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.525650 Oct 18 15:46:39.882393 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2358/4732] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:39 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:39.894176 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1ea8f601-a64e-403c-9ab2-08bdb019d765 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:39.897332 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1ea8f601-a64e-403c-9ab2-08bdb019d765 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] [instance: a2303432-63f3-45b5-848e-eea36fb0094c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:39.908698 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3607d3bd-8d7a-4ae1-bb99-59c96f728151 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14" status: 200 len: 1516 microversion: 2.1 time: 0.403767 Oct 18 15:46:39.911520 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2375/4733] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:39 2022] GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14 => generated 1516 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:39.915228 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ea8f601-a64e-403c-9ab2-08bdb019d765 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:39.916487 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ea8f601-a64e-403c-9ab2-08bdb019d765 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:39.917626 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ea8f601-a64e-403c-9ab2-08bdb019d765 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:39.919041 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ea8f601-a64e-403c-9ab2-08bdb019d765 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:39.920151 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ea8f601-a64e-403c-9ab2-08bdb019d765 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:39.920802 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ea8f601-a64e-403c-9ab2-08bdb019d765 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:39.925746 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-72a3256c-452b-4ae1-af59-cde00d5001b1 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:39.927642 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-72a3256c-452b-4ae1-af59-cde00d5001b1 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:39.947539 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-72a3256c-452b-4ae1-af59-cde00d5001b1 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:39.956595 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-72a3256c-452b-4ae1-af59-cde00d5001b1 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:39.961859 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-72a3256c-452b-4ae1-af59-cde00d5001b1 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:39.963449 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-72a3256c-452b-4ae1-af59-cde00d5001b1 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:39.970045 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-72a3256c-452b-4ae1-af59-cde00d5001b1 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:39.970809 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-72a3256c-452b-4ae1-af59-cde00d5001b1 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:40.317944 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1ea8f601-a64e-403c-9ab2-08bdb019d765 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6caed9f67c4c05ba02abe4e424cbab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42c92cc615744258653a5aa70010db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:40.327131 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1ea8f601-a64e-403c-9ab2-08bdb019d765 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] 10.222.0.60 "GET /compute/v2.1/servers/a2303432-63f3-45b5-848e-eea36fb0094c" status: 200 len: 1324 microversion: 2.1 time: 0.443432 Oct 18 15:46:40.327721 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2359/4734] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:39 2022] GET /compute/v2.1/servers/a2303432-63f3-45b5-848e-eea36fb0094c => generated 1324 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:40.356729 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-351bb10c-aaa0-4a8f-9481-b2e6e2031e7d tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:40.357148 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-351bb10c-aaa0-4a8f-9481-b2e6e2031e7d tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] [instance: 84b7e841-8cd5-4554-bf61-e2076ee819a9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:40.360106 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-72a3256c-452b-4ae1-af59-cde00d5001b1 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:40.367772 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-72a3256c-452b-4ae1-af59-cde00d5001b1 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.453227 Oct 18 15:46:40.368363 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2376/4735] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:39 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:40.391393 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-091eb62c-299c-42d0-9d10-57ab38769c76 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1007698446_updated"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:46:40.394692 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-091eb62c-299c-42d0-9d10-57ab38769c76 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 0ac8385f-a987-4a08-80a7-79c75e402be2] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:40.401576 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-091eb62c-299c-42d0-9d10-57ab38769c76 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] HTTP exception thrown: Instance 0ac8385f-a987-4a08-80a7-79c75e402be2 could not be found. Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-091eb62c-299c-42d0-9d10-57ab38769c76 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Request method failure captured: Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: request: PUT /compute/v2.1/servers/0ac8385f-a987-4a08-80a7-79c75e402be2 HTTP/1.1 Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 81 Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTslxbnvpe5yiGf5CWZMgShC81OiGKrcSLYZFSWKOLbaqqF5kNJvh8cijdldsPo1OHjHXDcbdPuhTuFRNRswVq0HwpXLNCfOWcF3GU1M8LHkZwXu6ScaOEIHyQ8ewFnAFL7TXd1O14t3atsv_uM6Xc9ZHSfefERCjuehdw5SJuAn7MMs Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 96c4378d52d1489bb2d50e84cabf95eb Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1007698446_updated"}} Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 0ac8385f-a987-4a08-80a7-79c75e402be2 could not be found. Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '0ac8385f-a987-4a08-80a7-79c75e402be2', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1007698446_updated'}}} Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ac8385f-a987-4a08-80a7-79c75e402be2 could not be found. Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 18 15:46:40.403459 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:46:40.408128 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:46:40.408128 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:46:40.408128 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:46:40.408128 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ac8385f-a987-4a08-80a7-79c75e402be2 could not be found. Oct 18 15:46:40.408128 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:40.408128 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:46:40.408128 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:40.408128 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:40.408128 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:46:40.408128 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:46:40.408128 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:46:40.408128 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:46:40.408128 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ac8385f-a987-4a08-80a7-79c75e402be2 could not be found. Oct 18 15:46:40.408128 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:40.410007 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-091eb62c-299c-42d0-9d10-57ab38769c76 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Returning 404 to user: Instance 0ac8385f-a987-4a08-80a7-79c75e402be2 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:46:40.410550 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-351bb10c-aaa0-4a8f-9481-b2e6e2031e7d tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:40.411069 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-351bb10c-aaa0-4a8f-9481-b2e6e2031e7d tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:40.411799 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-091eb62c-299c-42d0-9d10-57ab38769c76 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "PUT /compute/v2.1/servers/0ac8385f-a987-4a08-80a7-79c75e402be2" status: 404 len: 111 microversion: 2.1 time: 0.024558 Oct 18 15:46:40.413294 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-351bb10c-aaa0-4a8f-9481-b2e6e2031e7d tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:40.414046 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2377/4736] 10.222.0.60 () {60 vars in 1256 bytes} [Tue Oct 18 15:46:40 2022] PUT /compute/v2.1/servers/0ac8385f-a987-4a08-80a7-79c75e402be2 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 15:46:40.418886 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-351bb10c-aaa0-4a8f-9481-b2e6e2031e7d tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:40.418886 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-351bb10c-aaa0-4a8f-9481-b2e6e2031e7d tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:40.418886 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-351bb10c-aaa0-4a8f-9481-b2e6e2031e7d tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:40.424717 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f98cdf0d-a393-44a4-96b8-6d4ba0970a53 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:40.425793 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f98cdf0d-a393-44a4-96b8-6d4ba0970a53 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:40.438604 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f98cdf0d-a393-44a4-96b8-6d4ba0970a53 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:40.439413 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f98cdf0d-a393-44a4-96b8-6d4ba0970a53 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:40.440091 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f98cdf0d-a393-44a4-96b8-6d4ba0970a53 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:40.441058 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f98cdf0d-a393-44a4-96b8-6d4ba0970a53 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:40.441987 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f98cdf0d-a393-44a4-96b8-6d4ba0970a53 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:40.442824 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f98cdf0d-a393-44a4-96b8-6d4ba0970a53 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:40.839312 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f98cdf0d-a393-44a4-96b8-6d4ba0970a53 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:40.841581 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-351bb10c-aaa0-4a8f-9481-b2e6e2031e7d tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/84b7e841-8cd5-4554-bf61-e2076ee819a9" status: 200 len: 1463 microversion: 2.1 time: 0.498373 Oct 18 15:46:40.845339 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2360/4737] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:40 2022] GET /compute/v2.1/servers/84b7e841-8cd5-4554-bf61-e2076ee819a9 => generated 1463 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:40.864300 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f98cdf0d-a393-44a4-96b8-6d4ba0970a53 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.443384 Oct 18 15:46:40.878408 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2378/4738] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:40 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:40.889106 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-19e8b285-5e06-4538-8a20-0308e7b7f12f tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:40.889741 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-19e8b285-5e06-4538-8a20-0308e7b7f12f tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:40.901634 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-19e8b285-5e06-4538-8a20-0308e7b7f12f tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:40.902309 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-19e8b285-5e06-4538-8a20-0308e7b7f12f tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:40.903982 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-19e8b285-5e06-4538-8a20-0308e7b7f12f tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:40.905895 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-19e8b285-5e06-4538-8a20-0308e7b7f12f tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:40.906373 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-19e8b285-5e06-4538-8a20-0308e7b7f12f tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:40.906807 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-19e8b285-5e06-4538-8a20-0308e7b7f12f tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:40.936775 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-56753d64-0f0b-4bba-a6d9-d7cf32d3c3a1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:40.937732 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-56753d64-0f0b-4bba-a6d9-d7cf32d3c3a1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 9d108fa0-49bb-46c2-a8b0-802c5835cb14] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:40.952740 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-56753d64-0f0b-4bba-a6d9-d7cf32d3c3a1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:40.953262 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-56753d64-0f0b-4bba-a6d9-d7cf32d3c3a1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:40.953717 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-56753d64-0f0b-4bba-a6d9-d7cf32d3c3a1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:40.955571 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-56753d64-0f0b-4bba-a6d9-d7cf32d3c3a1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:40.956193 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-56753d64-0f0b-4bba-a6d9-d7cf32d3c3a1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:40.957036 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-56753d64-0f0b-4bba-a6d9-d7cf32d3c3a1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:40.964160 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:41.073810 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:41.674453 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-19e8b285-5e06-4538-8a20-0308e7b7f12f tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:41.678232 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-56753d64-0f0b-4bba-a6d9-d7cf32d3c3a1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:41.687046 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-19e8b285-5e06-4538-8a20-0308e7b7f12f tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.801659 Oct 18 15:46:41.705722 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-56753d64-0f0b-4bba-a6d9-d7cf32d3c3a1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14" status: 200 len: 1516 microversion: 2.1 time: 0.767732 Oct 18 15:46:41.705722 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2379/4740] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:40 2022] GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14 => generated 1516 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:41.706096 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2361/4740] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:40 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:41.711192 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-65c85e19-e8b5-49cc-ae94-0269e78b7176 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:41.712180 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-65c85e19-e8b5-49cc-ae94-0269e78b7176 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] [instance: a2303432-63f3-45b5-848e-eea36fb0094c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:41.721669 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-472b92e3-a5bb-4b04-a6d9-b341c8537368 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:46:41.723705 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-65c85e19-e8b5-49cc-ae94-0269e78b7176 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:41.724203 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-65c85e19-e8b5-49cc-ae94-0269e78b7176 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:41.724917 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-65c85e19-e8b5-49cc-ae94-0269e78b7176 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:41.725854 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-65c85e19-e8b5-49cc-ae94-0269e78b7176 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:41.726367 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-472b92e3-a5bb-4b04-a6d9-b341c8537368 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Request method failure captured: Oct 18 15:46:41.726367 n-d-853682-5 devstack@n-api.service[120406]: request: PUT /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc HTTP/1.1 Oct 18 15:46:41.726367 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:46:41.726367 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:46:41.726367 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:46:41.726367 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 280 Oct 18 15:46:41.726367 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:46:41.726367 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:46:41.726367 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:46:41.726367 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:46:41.726367 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTslxbnvpe5yiGf5CWZMgShC81OiGKrcSLYZFSWKOLbaqqF5kNJvh8cijdldsPo1OHjHXDcbdPuhTuFRNRswVq0HwpXLNCfOWcF3GU1M8LHkZwXu6ScaOEIHyQ8ewFnAFL7TXd1O14t3atsv_uM6Xc9ZHSfefERCjuehdw5SJuAn7MMs Oct 18 15:46:41.726367 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:46:41.726367 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:46:41.726367 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:46:41.726367 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:46:41.726367 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:46:41.726367 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:46:41.726367 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:46:41.726367 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:46:41.726367 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:46:41.726367 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:46:41.726367 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:46:41.726367 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:46:41.726367 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:46:41.726367 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:46:41.726367 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:46:41.726367 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:46:41.726367 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:46:41.726367 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 96c4378d52d1489bb2d50e84cabf95eb Oct 18 15:46:41.726367 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:46:41.726367 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:46:41.726367 n-d-853682-5 devstack@n-api.service[120406]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 18 15:46:41.726367 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:46:41.726367 n-d-853682-5 devstack@n-api.service[120406]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 15:46:41.726367 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '2cc69e2e-cb26-42d6-b887-31e0afaa69fc', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 18 15:46:41.726367 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:46:41.726367 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:41.726367 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 15:46:41.726367 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 15:46:41.726367 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 15:46:41.726367 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise error Oct 18 15:46:41.726367 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 15:46:41.726367 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:46:41.726367 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 18 15:46:41.726367 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 18 15:46:41.726367 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:46:41.726367 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 15:46:41.726367 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 18 15:46:41.726367 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:46:41.726367 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:46:41.726367 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:46:41.726367 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:41.731352 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:46:41.731352 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:46:41.731352 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:46:41.731352 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:46:41.731352 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:46:41.731352 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:46:41.731352 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:46:41.731352 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:46:41.731352 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 15:46:41.731352 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 15:46:41.731352 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 15:46:41.731352 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 15:46:41.731352 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 15:46:41.731352 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 15:46:41.731352 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 15:46:41.731352 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:46:41.731352 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:46:41.731352 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:46:41.731352 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:41.731352 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:46:41.731352 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:46:41.731352 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 15:46:41.731352 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 15:46:41.731352 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 15:46:41.731352 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:46:41.737187 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-65c85e19-e8b5-49cc-ae94-0269e78b7176 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:41.737187 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-65c85e19-e8b5-49cc-ae94-0269e78b7176 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:41.738612 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-472b92e3-a5bb-4b04-a6d9-b341c8537368 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:46:41.739832 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-472b92e3-a5bb-4b04-a6d9-b341c8537368 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "PUT /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 400 len: 619 microversion: 2.1 time: 0.025558 Oct 18 15:46:41.740645 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2362/4741] 10.222.0.60 () {60 vars in 1257 bytes} [Tue Oct 18 15:46:41 2022] PUT /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 619 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:46:41.750690 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1ff412d9-9a89-452d-ac18-7d04065bd88d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:41.751521 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1ff412d9-9a89-452d-ac18-7d04065bd88d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:41.760841 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ff412d9-9a89-452d-ac18-7d04065bd88d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:41.761611 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ff412d9-9a89-452d-ac18-7d04065bd88d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:41.762533 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ff412d9-9a89-452d-ac18-7d04065bd88d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:41.763423 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ff412d9-9a89-452d-ac18-7d04065bd88d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:41.764178 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ff412d9-9a89-452d-ac18-7d04065bd88d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:41.764762 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ff412d9-9a89-452d-ac18-7d04065bd88d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:42.114118 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-65c85e19-e8b5-49cc-ae94-0269e78b7176 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6caed9f67c4c05ba02abe4e424cbab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42c92cc615744258653a5aa70010db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:42.123084 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-65c85e19-e8b5-49cc-ae94-0269e78b7176 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] 10.222.0.60 "GET /compute/v2.1/servers/a2303432-63f3-45b5-848e-eea36fb0094c" status: 200 len: 1324 microversion: 2.1 time: 0.420886 Oct 18 15:46:42.123947 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2380/4742] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:41 2022] GET /compute/v2.1/servers/a2303432-63f3-45b5-848e-eea36fb0094c => generated 1324 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:42.133529 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1ff412d9-9a89-452d-ac18-7d04065bd88d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:42.144459 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-34e47a2c-c84f-4d10-81f9-b49631dfb698 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:42.146494 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1ff412d9-9a89-452d-ac18-7d04065bd88d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.401260 Oct 18 15:46:42.147067 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2363/4743] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:41 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:42.149053 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-34e47a2c-c84f-4d10-81f9-b49631dfb698 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] [instance: 84b7e841-8cd5-4554-bf61-e2076ee819a9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:42.156047 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-af304426-bdbe-4dfb-bf20-6e810e04c6e4 req-70f19c92-3333-4d8b-9cef-634724b1f8cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2303432-63f3-45b5-848e-eea36fb0094c", "name": "network-vif-plugged", "status": "completed", "tag": "f6b0c2cd-bedf-41e0-9d1f-5330335c9efa"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:46:42.162736 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-34e47a2c-c84f-4d10-81f9-b49631dfb698 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:42.165598 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-34e47a2c-c84f-4d10-81f9-b49631dfb698 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:42.166285 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-34e47a2c-c84f-4d10-81f9-b49631dfb698 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:42.166757 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-34e47a2c-c84f-4d10-81f9-b49631dfb698 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:42.167216 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-34e47a2c-c84f-4d10-81f9-b49631dfb698 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:42.169966 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-34e47a2c-c84f-4d10-81f9-b49631dfb698 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:42.180088 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-af304426-bdbe-4dfb-bf20-6e810e04c6e4 req-70f19c92-3333-4d8b-9cef-634724b1f8cf service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:42.180575 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-af304426-bdbe-4dfb-bf20-6e810e04c6e4 req-70f19c92-3333-4d8b-9cef-634724b1f8cf service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:42.182102 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-af304426-bdbe-4dfb-bf20-6e810e04c6e4 req-70f19c92-3333-4d8b-9cef-634724b1f8cf service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:42.205058 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-af304426-bdbe-4dfb-bf20-6e810e04c6e4 req-70f19c92-3333-4d8b-9cef-634724b1f8cf service nova] Creating event network-vif-plugged:f6b0c2cd-bedf-41e0-9d1f-5330335c9efa for instance a2303432-63f3-45b5-848e-eea36fb0094c on n-h2-853682-5 Oct 18 15:46:42.218880 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-af304426-bdbe-4dfb-bf20-6e810e04c6e4 req-70f19c92-3333-4d8b-9cef-634724b1f8cf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070288 Oct 18 15:46:42.219714 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2364/4744] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:46:42.233745 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-94fc37e6-8add-4ec1-8c3c-7b73c2be0a65 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:42.234822 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-94fc37e6-8add-4ec1-8c3c-7b73c2be0a65 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:42.242444 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94fc37e6-8add-4ec1-8c3c-7b73c2be0a65 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:42.243174 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94fc37e6-8add-4ec1-8c3c-7b73c2be0a65 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:42.244314 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94fc37e6-8add-4ec1-8c3c-7b73c2be0a65 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:42.256872 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94fc37e6-8add-4ec1-8c3c-7b73c2be0a65 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:42.259930 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94fc37e6-8add-4ec1-8c3c-7b73c2be0a65 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:42.261397 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94fc37e6-8add-4ec1-8c3c-7b73c2be0a65 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:42.524420 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-34e47a2c-c84f-4d10-81f9-b49631dfb698 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/84b7e841-8cd5-4554-bf61-e2076ee819a9" status: 200 len: 1463 microversion: 2.1 time: 0.399193 Oct 18 15:46:42.525469 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2381/4745] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:42 2022] GET /compute/v2.1/servers/84b7e841-8cd5-4554-bf61-e2076ee819a9 => generated 1463 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:42.581271 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-94fc37e6-8add-4ec1-8c3c-7b73c2be0a65 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:42.593097 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-94fc37e6-8add-4ec1-8c3c-7b73c2be0a65 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.368381 Oct 18 15:46:42.594084 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2365/4746] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:42 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:42.616678 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0a689bdc-a446-4c46-824c-83ad8701bcd1 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0a689bdc-a446-4c46-824c-83ad8701bcd1 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Request method failure captured: Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: request: PUT /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc HTTP/1.1 Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 24 Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTslxbnvpe5yiGf5CWZMgShC81OiGKrcSLYZFSWKOLbaqqF5kNJvh8cijdldsPo1OHjHXDcbdPuhTuFRNRswVq0HwpXLNCfOWcF3GU1M8LHkZwXu6ScaOEIHyQ8ewFnAFL7TXd1O14t3atsv_uM6Xc9ZHSfefERCjuehdw5SJuAn7MMs Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 96c4378d52d1489bb2d50e84cabf95eb Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: {"server": {"name": ""}} Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '2cc69e2e-cb26-42d6-b887-31e0afaa69fc', 'body': {'server': {'name': ''}}} Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise error Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi '' Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 15:46:42.621244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 18 15:46:42.625976 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:42.625976 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:46:42.625976 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:42.625976 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:42.625976 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:46:42.625976 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:46:42.625976 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 15:46:42.625976 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 15:46:42.625976 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 18 15:46:42.625976 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:42.627632 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0a689bdc-a446-4c46-824c-83ad8701bcd1 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:46:42.628663 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0a689bdc-a446-4c46-824c-83ad8701bcd1 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "PUT /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 400 len: 108 microversion: 2.1 time: 0.016114 Oct 18 15:46:42.633248 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2382/4747] 10.222.0.60 () {60 vars in 1256 bytes} [Tue Oct 18 15:46:42 2022] PUT /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 108 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:46:42.638474 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8bf1bf4c-90e1-4bc9-a572-5114ecc4aa02 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:42.639714 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8bf1bf4c-90e1-4bc9-a572-5114ecc4aa02 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:42.647982 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8bf1bf4c-90e1-4bc9-a572-5114ecc4aa02 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:42.648795 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8bf1bf4c-90e1-4bc9-a572-5114ecc4aa02 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:42.649412 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8bf1bf4c-90e1-4bc9-a572-5114ecc4aa02 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:42.650793 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8bf1bf4c-90e1-4bc9-a572-5114ecc4aa02 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:42.651984 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8bf1bf4c-90e1-4bc9-a572-5114ecc4aa02 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:42.652706 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8bf1bf4c-90e1-4bc9-a572-5114ecc4aa02 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:42.724047 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-610e8396-157e-4497-92fe-1b26b7beab0a tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:42.724672 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-610e8396-157e-4497-92fe-1b26b7beab0a tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 9d108fa0-49bb-46c2-a8b0-802c5835cb14] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:42.738570 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-610e8396-157e-4497-92fe-1b26b7beab0a tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:42.740495 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-610e8396-157e-4497-92fe-1b26b7beab0a tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:42.742356 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-610e8396-157e-4497-92fe-1b26b7beab0a tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:42.743162 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-610e8396-157e-4497-92fe-1b26b7beab0a tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:42.745545 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-610e8396-157e-4497-92fe-1b26b7beab0a tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:42.747734 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-610e8396-157e-4497-92fe-1b26b7beab0a tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:43.109717 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8bf1bf4c-90e1-4bc9-a572-5114ecc4aa02 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:43.117622 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8bf1bf4c-90e1-4bc9-a572-5114ecc4aa02 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1507 microversion: 2.1 time: 0.483908 Oct 18 15:46:43.124341 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2366/4748] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:42 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1507 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:46:43.148708 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-0db5e6d6-4632-41ac-9b0d-74c529ba99fe req-5ae66bec-5bb1-480d-985b-6b7a5a3061b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84b7e841-8cd5-4554-bf61-e2076ee819a9", "tag": "6781b44e-4894-41ec-941b-1a9d6af8944f"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:46:43.176943 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0db5e6d6-4632-41ac-9b0d-74c529ba99fe req-5ae66bec-5bb1-480d-985b-6b7a5a3061b6 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:43.177507 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0db5e6d6-4632-41ac-9b0d-74c529ba99fe req-5ae66bec-5bb1-480d-985b-6b7a5a3061b6 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:43.177957 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0db5e6d6-4632-41ac-9b0d-74c529ba99fe req-5ae66bec-5bb1-480d-985b-6b7a5a3061b6 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:43.197767 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-0db5e6d6-4632-41ac-9b0d-74c529ba99fe req-5ae66bec-5bb1-480d-985b-6b7a5a3061b6 service nova] Creating event network-changed:6781b44e-4894-41ec-941b-1a9d6af8944f for instance 84b7e841-8cd5-4554-bf61-e2076ee819a9 on n-h1-853682-5 Oct 18 15:46:43.207371 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-0db5e6d6-4632-41ac-9b0d-74c529ba99fe req-5ae66bec-5bb1-480d-985b-6b7a5a3061b6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067083 Oct 18 15:46:43.210025 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2367/4749] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:46:43.225368 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d5f6d66e-15b9-4b75-9e59-e2981fdb4274 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:43.229106 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d5f6d66e-15b9-4b75-9e59-e2981fdb4274 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] [instance: a2303432-63f3-45b5-848e-eea36fb0094c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:43.261269 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5f6d66e-15b9-4b75-9e59-e2981fdb4274 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:43.264633 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5f6d66e-15b9-4b75-9e59-e2981fdb4274 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:43.268472 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5f6d66e-15b9-4b75-9e59-e2981fdb4274 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:43.270335 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5f6d66e-15b9-4b75-9e59-e2981fdb4274 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:43.272422 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5f6d66e-15b9-4b75-9e59-e2981fdb4274 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:43.276037 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5f6d66e-15b9-4b75-9e59-e2981fdb4274 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:43.360050 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-610e8396-157e-4497-92fe-1b26b7beab0a tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:43.369407 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-610e8396-157e-4497-92fe-1b26b7beab0a tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14" status: 200 len: 1516 microversion: 2.1 time: 0.649777 Oct 18 15:46:43.372086 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2383/4750] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:42 2022] GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14 => generated 1516 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:43.532639 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d5f6d66e-15b9-4b75-9e59-e2981fdb4274 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6caed9f67c4c05ba02abe4e424cbab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42c92cc615744258653a5aa70010db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:43.547885 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-53228aa8-37fb-4fea-8c72-119bd986e0b1 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:43.548562 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-53228aa8-37fb-4fea-8c72-119bd986e0b1 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] [instance: 84b7e841-8cd5-4554-bf61-e2076ee819a9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:43.555914 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d5f6d66e-15b9-4b75-9e59-e2981fdb4274 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] 10.222.0.60 "GET /compute/v2.1/servers/a2303432-63f3-45b5-848e-eea36fb0094c" status: 200 len: 1324 microversion: 2.1 time: 0.341616 Oct 18 15:46:43.557080 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-53228aa8-37fb-4fea-8c72-119bd986e0b1 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:43.557334 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2368/4751] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:43 2022] GET /compute/v2.1/servers/a2303432-63f3-45b5-848e-eea36fb0094c => generated 1324 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:43.570405 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-53228aa8-37fb-4fea-8c72-119bd986e0b1 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:43.570983 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-53228aa8-37fb-4fea-8c72-119bd986e0b1 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:43.572281 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-53228aa8-37fb-4fea-8c72-119bd986e0b1 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:43.572769 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-53228aa8-37fb-4fea-8c72-119bd986e0b1 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:43.577233 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-53228aa8-37fb-4fea-8c72-119bd986e0b1 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:43.757481 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-53228aa8-37fb-4fea-8c72-119bd986e0b1 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/84b7e841-8cd5-4554-bf61-e2076ee819a9" status: 200 len: 1463 microversion: 2.1 time: 0.213432 Oct 18 15:46:43.770087 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2384/4752] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:43 2022] GET /compute/v2.1/servers/84b7e841-8cd5-4554-bf61-e2076ee819a9 => generated 1463 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:46:44.401159 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-befdccd6-ee23-4e02-bc97-e335d68e805b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:44.402562 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-befdccd6-ee23-4e02-bc97-e335d68e805b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 9d108fa0-49bb-46c2-a8b0-802c5835cb14] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:44.410440 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-befdccd6-ee23-4e02-bc97-e335d68e805b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:44.411258 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-befdccd6-ee23-4e02-bc97-e335d68e805b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:44.411868 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-befdccd6-ee23-4e02-bc97-e335d68e805b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:44.413155 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-befdccd6-ee23-4e02-bc97-e335d68e805b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:44.413870 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-befdccd6-ee23-4e02-bc97-e335d68e805b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:44.414624 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-befdccd6-ee23-4e02-bc97-e335d68e805b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:44.588173 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f7df3423-e5ec-402c-894d-77e8e3093f88 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:44.588829 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f7df3423-e5ec-402c-894d-77e8e3093f88 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] [instance: a2303432-63f3-45b5-848e-eea36fb0094c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:44.610886 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f7df3423-e5ec-402c-894d-77e8e3093f88 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:44.612667 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f7df3423-e5ec-402c-894d-77e8e3093f88 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:44.614489 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f7df3423-e5ec-402c-894d-77e8e3093f88 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:44.616531 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f7df3423-e5ec-402c-894d-77e8e3093f88 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:44.617266 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f7df3423-e5ec-402c-894d-77e8e3093f88 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:44.618199 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f7df3423-e5ec-402c-894d-77e8e3093f88 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:44.773904 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-befdccd6-ee23-4e02-bc97-e335d68e805b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:44.784903 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-befdccd6-ee23-4e02-bc97-e335d68e805b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14" status: 200 len: 1516 microversion: 2.1 time: 0.389129 Oct 18 15:46:44.786855 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2369/4753] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:44 2022] GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14 => generated 1516 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:44.791659 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1bfa6a7b-ec99-46ba-af38-b199df367169 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:44.792536 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1bfa6a7b-ec99-46ba-af38-b199df367169 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] [instance: 84b7e841-8cd5-4554-bf61-e2076ee819a9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:44.798913 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1bfa6a7b-ec99-46ba-af38-b199df367169 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:44.799761 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1bfa6a7b-ec99-46ba-af38-b199df367169 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:44.800451 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1bfa6a7b-ec99-46ba-af38-b199df367169 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:44.801492 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1bfa6a7b-ec99-46ba-af38-b199df367169 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:44.802273 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1bfa6a7b-ec99-46ba-af38-b199df367169 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:44.802953 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1bfa6a7b-ec99-46ba-af38-b199df367169 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:44.980332 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f7df3423-e5ec-402c-894d-77e8e3093f88 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6caed9f67c4c05ba02abe4e424cbab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42c92cc615744258653a5aa70010db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:44.995828 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f7df3423-e5ec-402c-894d-77e8e3093f88 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] 10.222.0.60 "GET /compute/v2.1/servers/a2303432-63f3-45b5-848e-eea36fb0094c" status: 200 len: 1519 microversion: 2.1 time: 0.413590 Oct 18 15:46:44.999065 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2385/4754] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:44 2022] GET /compute/v2.1/servers/a2303432-63f3-45b5-848e-eea36fb0094c => generated 1519 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:45.133940 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1bfa6a7b-ec99-46ba-af38-b199df367169 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/84b7e841-8cd5-4554-bf61-e2076ee819a9" status: 200 len: 1463 microversion: 2.1 time: 0.344356 Oct 18 15:46:45.135092 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2370/4755] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:44 2022] GET /compute/v2.1/servers/84b7e841-8cd5-4554-bf61-e2076ee819a9 => generated 1463 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:45.209257 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d03dc126-4cf5-4753-afd4-4a6f526769ef tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-672649089", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "0ee3280d-9a39-49e3-b454-ff3fb585fd93"}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d03dc126-4cf5-4753-afd4-4a6f526769ef tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Request method failure captured: Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 242 Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTspUTmyivAb_NtVuBPDpExGZALySc4b6c2s-EShbipstJvkF_qUQBj-F3jbOc6GfTw2pL3YB-s66PVFA_EknvF0FrSj-s5pVZLutEuO0638kzqCL8UXPSjzBdqyzIz_L5cLi8JvXlmPNe-MB4-GpCwCAe7YFyQdnF8xcZWHgsT0mTbA Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: e42c92cc615744258653a5aa70010db5 Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1778532528 Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e42c92cc615744258653a5aa70010db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e42c92cc615744258653a5aa70010db5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e42c92cc615744258653a5aa70010db5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e42c92cc615744258653a5aa70010db5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1778532528 Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: e42c92cc615744258653a5aa70010db5 Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1778532528 Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServerMetadataNegativeTestJSON-1778532528-project Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: ad6caed9f67c4c05ba02abe4e424cbab Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1778532528-project Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-672649089", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "0ee3280d-9a39-49e3-b454-ff3fb585fd93"}]}} Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-672649089', 'imageRef': '8f4db252-bff6-4685-9c8d-4c5d6bd9f78b', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '0ee3280d-9a39-49e3-b454-ff3fb585fd93'}]}}} Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise error Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:46:45.216990 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:46:45.221273 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:46:45.221273 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 15:46:45.221273 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 15:46:45.221273 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 15:46:45.221273 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 15:46:45.221273 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 15:46:45.221273 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 15:46:45.221273 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 15:46:45.221273 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:45.221273 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:46:45.221273 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:45.221273 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:45.221273 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:46:45.221273 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:46:45.221273 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 15:46:45.221273 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 15:46:45.221273 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 15:46:45.221273 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:45.225196 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d03dc126-4cf5-4753-afd4-4a6f526769ef tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:46:45.226848 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d03dc126-4cf5-4753-afd4-4a6f526769ef tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.023992 Oct 18 15:46:45.229303 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2386/4756] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:46:45 2022] POST /compute/v2.1/servers => generated 175 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:46:45.240672 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0526087e-b4a1-405c-bba2-32625059b175 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:45.242750 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0526087e-b4a1-405c-bba2-32625059b175 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] [instance: 069f1dd2-ffd1-44e5-90fc-3fa809b477ce] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:45.257327 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-0526087e-b4a1-405c-bba2-32625059b175 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] HTTP exception thrown: Instance 069f1dd2-ffd1-44e5-90fc-3fa809b477ce could not be found. Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0526087e-b4a1-405c-bba2-32625059b175 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Request method failure captured: Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/069f1dd2-ffd1-44e5-90fc-3fa809b477ce/metadata HTTP/1.1 Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTspUTmyivAb_NtVuBPDpExGZALySc4b6c2s-EShbipstJvkF_qUQBj-F3jbOc6GfTw2pL3YB-s66PVFA_EknvF0FrSj-s5pVZLutEuO0638kzqCL8UXPSjzBdqyzIz_L5cLi8JvXlmPNe-MB4-GpCwCAe7YFyQdnF8xcZWHgsT0mTbA Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: e42c92cc615744258653a5aa70010db5 Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1778532528 Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e42c92cc615744258653a5aa70010db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e42c92cc615744258653a5aa70010db5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e42c92cc615744258653a5aa70010db5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e42c92cc615744258653a5aa70010db5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1778532528 Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: e42c92cc615744258653a5aa70010db5 Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1778532528 Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServerMetadataNegativeTestJSON-1778532528-project Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: ad6caed9f67c4c05ba02abe4e424cbab Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1778532528-project Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 069f1dd2-ffd1-44e5-90fc-3fa809b477ce could not be found. Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'server_id': '069f1dd2-ffd1-44e5-90fc-3fa809b477ce'} Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 069f1dd2-ffd1-44e5-90fc-3fa809b477ce could not be found. Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 069f1dd2-ffd1-44e5-90fc-3fa809b477ce could not be found. Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:46:45.267294 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:46:45.272846 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:46:45.272846 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:46:45.272846 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 069f1dd2-ffd1-44e5-90fc-3fa809b477ce could not be found. Oct 18 15:46:45.272846 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:46:45.272846 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0526087e-b4a1-405c-bba2-32625059b175 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Returning 404 to user: Instance 069f1dd2-ffd1-44e5-90fc-3fa809b477ce could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:46:45.272846 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0526087e-b4a1-405c-bba2-32625059b175 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] 10.222.0.60 "GET /compute/v2.1/servers/069f1dd2-ffd1-44e5-90fc-3fa809b477ce/metadata" status: 404 len: 111 microversion: 2.1 time: 0.033030 Oct 18 15:46:45.272846 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2371/4757] 10.222.0.60 () {58 vars in 1263 bytes} [Tue Oct 18 15:46:45 2022] GET /compute/v2.1/servers/069f1dd2-ffd1-44e5-90fc-3fa809b477ce/metadata => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:46:45.452198 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-acc8ef39-e8c1-4175-93e2-87e6b369ce18 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1495289667", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "0ee3280d-9a39-49e3-b454-ff3fb585fd93"}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:46:45.457163 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-acc8ef39-e8c1-4175-93e2-87e6b369ce18 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Request method failure captured: Oct 18 15:46:45.457163 n-d-853682-5 devstack@n-api.service[120405]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 15:46:45.457163 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:46:45.457163 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:46:45.457163 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:46:45.457163 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 499 Oct 18 15:46:45.457163 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:46:45.457163 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:46:45.457163 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:46:45.457163 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:46:45.457163 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTspUTmyivAb_NtVuBPDpExGZALySc4b6c2s-EShbipstJvkF_qUQBj-F3jbOc6GfTw2pL3YB-s66PVFA_EknvF0FrSj-s5pVZLutEuO0638kzqCL8UXPSjzBdqyzIz_L5cLi8JvXlmPNe-MB4-GpCwCAe7YFyQdnF8xcZWHgsT0mTbA Oct 18 15:46:45.457163 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:46:45.457163 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:46:45.457163 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:46:45.457163 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:46:45.457163 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:46:45.457163 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:46:45.457163 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: e42c92cc615744258653a5aa70010db5 Oct 18 15:46:45.457163 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1778532528 Oct 18 15:46:45.457163 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:46:45.457163 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:46:45.457163 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e42c92cc615744258653a5aa70010db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e42c92cc615744258653a5aa70010db5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e42c92cc615744258653a5aa70010db5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e42c92cc615744258653a5aa70010db5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:46:45.457163 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1778532528 Oct 18 15:46:45.457163 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: e42c92cc615744258653a5aa70010db5 Oct 18 15:46:45.457163 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1778532528 Oct 18 15:46:45.457163 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServerMetadataNegativeTestJSON-1778532528-project Oct 18 15:46:45.457163 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:46:45.457163 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:46:45.457163 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: ad6caed9f67c4c05ba02abe4e424cbab Oct 18 15:46:45.457163 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1778532528-project Oct 18 15:46:45.457163 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:46:45.457163 n-d-853682-5 devstack@n-api.service[120405]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1495289667", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "0ee3280d-9a39-49e3-b454-ff3fb585fd93"}]}} Oct 18 15:46:45.457163 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:46:45.457163 n-d-853682-5 devstack@n-api.service[120405]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 15:46:45.457163 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1495289667', 'imageRef': '8f4db252-bff6-4685-9c8d-4c5d6bd9f78b', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '0ee3280d-9a39-49e3-b454-ff3fb585fd93'}]}}} Oct 18 15:46:45.457163 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:46:45.457163 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:45.457163 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 15:46:45.457163 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 15:46:45.457163 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 15:46:45.457163 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise error Oct 18 15:46:45.457163 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 15:46:45.457163 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:45.457163 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 18 15:46:45.457163 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 18 15:46:45.457163 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 18 15:46:45.457163 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 18 15:46:45.462355 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 18 15:46:45.462355 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:45.462355 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 15:46:45.462355 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 18 15:46:45.462355 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:45.462355 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:46:45.462355 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:45.462355 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:45.462355 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:46:45.462355 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:46:45.462355 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:46:45.462355 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:46:45.462355 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:46:45.462355 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:46:45.462355 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:46:45.462355 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:46:45.462355 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 15:46:45.462355 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 15:46:45.462355 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 15:46:45.462355 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 15:46:45.462355 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 15:46:45.462355 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 15:46:45.462355 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 15:46:45.462355 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:45.462355 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:46:45.462355 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:45.462355 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:45.462355 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:46:45.462355 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:46:45.462355 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 15:46:45.462355 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 15:46:45.462355 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 15:46:45.462355 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:45.462355 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-acc8ef39-e8c1-4175-93e2-87e6b369ce18 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:46:45.462355 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-acc8ef39-e8c1-4175-93e2-87e6b369ce18 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.011900 Oct 18 15:46:45.462355 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2387/4758] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:46:45 2022] POST /compute/v2.1/servers => generated 687 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:46:45.529165 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5067a0fd-a817-4414-b7fe-344eb101a9cb tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1393921077", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "0ee3280d-9a39-49e3-b454-ff3fb585fd93"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:46:45.535661 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5067a0fd-a817-4414-b7fe-344eb101a9cb tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Request method failure captured: Oct 18 15:46:45.535661 n-d-853682-5 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 15:46:45.535661 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:46:45.535661 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:46:45.535661 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:46:45.535661 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 500 Oct 18 15:46:45.535661 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:46:45.535661 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:46:45.535661 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:46:45.535661 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:46:45.535661 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTspUTmyivAb_NtVuBPDpExGZALySc4b6c2s-EShbipstJvkF_qUQBj-F3jbOc6GfTw2pL3YB-s66PVFA_EknvF0FrSj-s5pVZLutEuO0638kzqCL8UXPSjzBdqyzIz_L5cLi8JvXlmPNe-MB4-GpCwCAe7YFyQdnF8xcZWHgsT0mTbA Oct 18 15:46:45.535661 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:46:45.535661 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:46:45.535661 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:46:45.535661 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:46:45.535661 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:46:45.535661 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:46:45.535661 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: e42c92cc615744258653a5aa70010db5 Oct 18 15:46:45.535661 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1778532528 Oct 18 15:46:45.535661 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:46:45.535661 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:46:45.535661 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e42c92cc615744258653a5aa70010db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e42c92cc615744258653a5aa70010db5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e42c92cc615744258653a5aa70010db5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e42c92cc615744258653a5aa70010db5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:46:45.535661 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1778532528 Oct 18 15:46:45.535661 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: e42c92cc615744258653a5aa70010db5 Oct 18 15:46:45.535661 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1778532528 Oct 18 15:46:45.535661 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServerMetadataNegativeTestJSON-1778532528-project Oct 18 15:46:45.535661 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:46:45.535661 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:46:45.535661 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: ad6caed9f67c4c05ba02abe4e424cbab Oct 18 15:46:45.535661 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1778532528-project Oct 18 15:46:45.535661 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:46:45.535661 n-d-853682-5 devstack@n-api.service[120406]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1393921077", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "0ee3280d-9a39-49e3-b454-ff3fb585fd93"}]}} Oct 18 15:46:45.535661 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:46:45.535661 n-d-853682-5 devstack@n-api.service[120406]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 15:46:45.535661 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1393921077', 'imageRef': '8f4db252-bff6-4685-9c8d-4c5d6bd9f78b', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '0ee3280d-9a39-49e3-b454-ff3fb585fd93'}]}}} Oct 18 15:46:45.535661 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:46:45.535661 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:45.535661 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 15:46:45.535661 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 15:46:45.535661 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 15:46:45.535661 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise error Oct 18 15:46:45.535661 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 15:46:45.535661 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:46:45.535661 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 18 15:46:45.535661 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 18 15:46:45.535661 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 18 15:46:45.535661 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 18 15:46:45.538895 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 18 15:46:45.538895 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:46:45.538895 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 15:46:45.538895 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 18 15:46:45.538895 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:46:45.538895 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:46:45.538895 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:46:45.538895 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:45.538895 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:46:45.538895 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:46:45.538895 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:46:45.538895 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:46:45.538895 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:46:45.538895 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:46:45.538895 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:46:45.538895 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:46:45.538895 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 15:46:45.538895 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 15:46:45.538895 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 15:46:45.538895 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 15:46:45.538895 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 15:46:45.538895 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 15:46:45.538895 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 15:46:45.538895 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:46:45.538895 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:46:45.538895 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:46:45.538895 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:45.538895 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:46:45.538895 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:46:45.538895 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 15:46:45.538895 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 15:46:45.538895 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 15:46:45.538895 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:46:45.538895 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5067a0fd-a817-4414-b7fe-344eb101a9cb tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:46:45.538895 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5067a0fd-a817-4414-b7fe-344eb101a9cb tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.015361 Oct 18 15:46:45.542594 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2372/4759] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:46:45 2022] POST /compute/v2.1/servers => generated 689 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:46:45.599532 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-078dc256-36c7-4103-acd0-0e29c976908b tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-722567628", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "0ee3280d-9a39-49e3-b454-ff3fb585fd93"}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:46:45.605757 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-078dc256-36c7-4103-acd0-0e29c976908b tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Request method failure captured: Oct 18 15:46:45.605757 n-d-853682-5 devstack@n-api.service[120405]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 15:46:45.605757 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:46:45.605757 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:46:45.605757 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:46:45.605757 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 753 Oct 18 15:46:45.605757 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:46:45.605757 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:46:45.605757 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:46:45.605757 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:46:45.605757 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTspUTmyivAb_NtVuBPDpExGZALySc4b6c2s-EShbipstJvkF_qUQBj-F3jbOc6GfTw2pL3YB-s66PVFA_EknvF0FrSj-s5pVZLutEuO0638kzqCL8UXPSjzBdqyzIz_L5cLi8JvXlmPNe-MB4-GpCwCAe7YFyQdnF8xcZWHgsT0mTbA Oct 18 15:46:45.605757 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:46:45.605757 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:46:45.605757 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:46:45.605757 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:46:45.605757 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:46:45.605757 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:46:45.605757 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: e42c92cc615744258653a5aa70010db5 Oct 18 15:46:45.605757 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1778532528 Oct 18 15:46:45.605757 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:46:45.605757 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:46:45.605757 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e42c92cc615744258653a5aa70010db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e42c92cc615744258653a5aa70010db5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e42c92cc615744258653a5aa70010db5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e42c92cc615744258653a5aa70010db5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:46:45.605757 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1778532528 Oct 18 15:46:45.605757 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: e42c92cc615744258653a5aa70010db5 Oct 18 15:46:45.605757 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1778532528 Oct 18 15:46:45.605757 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServerMetadataNegativeTestJSON-1778532528-project Oct 18 15:46:45.605757 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:46:45.605757 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:46:45.605757 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: ad6caed9f67c4c05ba02abe4e424cbab Oct 18 15:46:45.605757 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1778532528-project Oct 18 15:46:45.605757 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 15:46:45.605757 n-d-853682-5 devstack@n-api.service[120405]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-722567628", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "0ee3280d-9a39-49e3-b454-ff3fb585fd93"}]}} Oct 18 15:46:45.605757 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:46:45.605757 n-d-853682-5 devstack@n-api.service[120405]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 15:46:45.605757 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-722567628', 'imageRef': '8f4db252-bff6-4685-9c8d-4c5d6bd9f78b', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '0ee3280d-9a39-49e3-b454-ff3fb585fd93'}]}}} Oct 18 15:46:45.605757 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:46:45.605757 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:45.605757 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 15:46:45.605757 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 15:46:45.605757 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 15:46:45.608421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise error Oct 18 15:46:45.608421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 15:46:45.608421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:45.608421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 18 15:46:45.608421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 18 15:46:45.608421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 18 15:46:45.608421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 18 15:46:45.608421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 18 15:46:45.608421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:45.608421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 15:46:45.608421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 18 15:46:45.608421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:45.608421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:46:45.608421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:45.608421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:45.608421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:46:45.608421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:46:45.608421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:46:45.608421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:46:45.608421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:46:45.608421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:46:45.608421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:46:45.608421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:46:45.608421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 15:46:45.608421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 15:46:45.608421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 15:46:45.608421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 15:46:45.608421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 15:46:45.608421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 15:46:45.608421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 15:46:45.608421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:45.608421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:46:45.608421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:45.608421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:45.608421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:46:45.608421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:46:45.608421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 15:46:45.608421 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 15:46:45.612520 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 15:46:45.612520 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:45.613698 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-078dc256-36c7-4103-acd0-0e29c976908b tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:46:45.616139 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-078dc256-36c7-4103-acd0-0e29c976908b tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.022263 Oct 18 15:46:45.617094 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2388/4760] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:46:45 2022] POST /compute/v2.1/servers => generated 1197 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 18 15:46:45.820570 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-98f2536a-014b-4ae5-9e16-f76d570b1148 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-916695002", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "0ee3280d-9a39-49e3-b454-ff3fb585fd93"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:46:45.827707 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7f1450ae-cea0-48fd-967d-e894a77524dc tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:45.829169 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7f1450ae-cea0-48fd-967d-e894a77524dc tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 9d108fa0-49bb-46c2-a8b0-802c5835cb14] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:45.849602 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-98f2536a-014b-4ae5-9e16-f76d570b1148 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Request method failure captured: Oct 18 15:46:45.849602 n-d-853682-5 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 15:46:45.849602 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:46:45.849602 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:46:45.849602 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:46:45.849602 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 1265 Oct 18 15:46:45.849602 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:46:45.849602 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:46:45.849602 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:46:45.849602 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:46:45.849602 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTspUTmyivAb_NtVuBPDpExGZALySc4b6c2s-EShbipstJvkF_qUQBj-F3jbOc6GfTw2pL3YB-s66PVFA_EknvF0FrSj-s5pVZLutEuO0638kzqCL8UXPSjzBdqyzIz_L5cLi8JvXlmPNe-MB4-GpCwCAe7YFyQdnF8xcZWHgsT0mTbA Oct 18 15:46:45.849602 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:46:45.849602 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:46:45.849602 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:46:45.849602 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:46:45.849602 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:46:45.849602 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:46:45.849602 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: e42c92cc615744258653a5aa70010db5 Oct 18 15:46:45.849602 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1778532528 Oct 18 15:46:45.849602 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:46:45.849602 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:46:45.849602 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e42c92cc615744258653a5aa70010db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e42c92cc615744258653a5aa70010db5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e42c92cc615744258653a5aa70010db5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e42c92cc615744258653a5aa70010db5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:46:45.849602 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1778532528 Oct 18 15:46:45.849602 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: e42c92cc615744258653a5aa70010db5 Oct 18 15:46:45.849602 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1778532528 Oct 18 15:46:45.849602 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServerMetadataNegativeTestJSON-1778532528-project Oct 18 15:46:45.849602 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:46:45.849602 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:46:45.849602 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: ad6caed9f67c4c05ba02abe4e424cbab Oct 18 15:46:45.849602 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1778532528-project Oct 18 15:46:45.849602 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:46:45.849602 n-d-853682-5 devstack@n-api.service[120406]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-916695002", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "0ee3280d-9a39-49e3-b454-ff3fb585fd93"}]}} Oct 18 15:46:45.849602 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:46:45.851853 n-d-853682-5 devstack@n-api.service[120406]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 15:46:45.851853 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-916695002', 'imageRef': '8f4db252-bff6-4685-9c8d-4c5d6bd9f78b', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '0ee3280d-9a39-49e3-b454-ff3fb585fd93'}]}}} Oct 18 15:46:45.851853 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:46:45.851853 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:45.851853 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 15:46:45.851853 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 15:46:45.851853 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 15:46:45.851853 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise error Oct 18 15:46:45.851853 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 15:46:45.851853 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:46:45.851853 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 18 15:46:45.851853 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 18 15:46:45.851853 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 18 15:46:45.851853 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 18 15:46:45.851853 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 18 15:46:45.851853 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:46:45.851853 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 15:46:45.854538 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 18 15:46:45.854538 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:46:45.854538 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:46:45.854538 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:46:45.854538 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:45.854538 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:46:45.854538 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:46:45.854538 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:46:45.854538 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:46:45.854538 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:46:45.854538 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:46:45.854538 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:46:45.854538 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:46:45.854538 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 15:46:45.854538 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 15:46:45.854538 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 15:46:45.854538 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 15:46:45.854538 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 15:46:45.854538 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 15:46:45.854538 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 15:46:45.854538 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:46:45.854538 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:46:45.854538 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:46:45.854538 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:45.854538 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:46:45.854538 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:46:45.854538 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 15:46:45.854538 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 15:46:45.859247 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 15:46:45.859247 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:46:45.864217 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7f1450ae-cea0-48fd-967d-e894a77524dc tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:45.867985 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7f1450ae-cea0-48fd-967d-e894a77524dc tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:45.871556 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-98f2536a-014b-4ae5-9e16-f76d570b1148 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:46:45.872782 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-98f2536a-014b-4ae5-9e16-f76d570b1148 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.073711 Oct 18 15:46:45.873348 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7f1450ae-cea0-48fd-967d-e894a77524dc tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:45.877362 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7f1450ae-cea0-48fd-967d-e894a77524dc tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:45.878486 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7f1450ae-cea0-48fd-967d-e894a77524dc tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:45.879847 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7f1450ae-cea0-48fd-967d-e894a77524dc tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:45.881515 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2373/4761] 10.222.0.60 () {60 vars in 1148 bytes} [Tue Oct 18 15:46:45 2022] POST /compute/v2.1/servers => generated 2221 bytes in 84 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 18 15:46:45.898223 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-266580a2-9b62-4817-b817-fbc1293acfc9 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:45.899053 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-266580a2-9b62-4817-b817-fbc1293acfc9 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] [instance: 6bcdd812-34e4-438e-bb67-c1b168b9676a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:45.917111 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-266580a2-9b62-4817-b817-fbc1293acfc9 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] HTTP exception thrown: Instance 6bcdd812-34e4-438e-bb67-c1b168b9676a could not be found. Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-266580a2-9b62-4817-b817-fbc1293acfc9 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Request method failure captured: Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/6bcdd812-34e4-438e-bb67-c1b168b9676a/metadata/test2 HTTP/1.1 Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTspUTmyivAb_NtVuBPDpExGZALySc4b6c2s-EShbipstJvkF_qUQBj-F3jbOc6GfTw2pL3YB-s66PVFA_EknvF0FrSj-s5pVZLutEuO0638kzqCL8UXPSjzBdqyzIz_L5cLi8JvXlmPNe-MB4-GpCwCAe7YFyQdnF8xcZWHgsT0mTbA Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: e42c92cc615744258653a5aa70010db5 Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1778532528 Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e42c92cc615744258653a5aa70010db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e42c92cc615744258653a5aa70010db5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e42c92cc615744258653a5aa70010db5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e42c92cc615744258653a5aa70010db5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1778532528 Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: e42c92cc615744258653a5aa70010db5 Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1778532528 Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServerMetadataNegativeTestJSON-1778532528-project Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: ad6caed9f67c4c05ba02abe4e424cbab Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1778532528-project Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 6bcdd812-34e4-438e-bb67-c1b168b9676a could not be found. Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'server_id': '6bcdd812-34e4-438e-bb67-c1b168b9676a', 'id': 'test2'} Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bcdd812-34e4-438e-bb67-c1b168b9676a could not be found. Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bcdd812-34e4-438e-bb67-c1b168b9676a could not be found. Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:46:45.919786 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:46:45.927015 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:46:45.927015 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:46:45.927015 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bcdd812-34e4-438e-bb67-c1b168b9676a could not be found. Oct 18 15:46:45.927015 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:46:45.927015 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-266580a2-9b62-4817-b817-fbc1293acfc9 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Returning 404 to user: Instance 6bcdd812-34e4-438e-bb67-c1b168b9676a could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:46:45.927015 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-266580a2-9b62-4817-b817-fbc1293acfc9 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] 10.222.0.60 "GET /compute/v2.1/servers/6bcdd812-34e4-438e-bb67-c1b168b9676a/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.036139 Oct 18 15:46:45.927015 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2374/4762] 10.222.0.60 () {58 vars in 1281 bytes} [Tue Oct 18 15:46:45 2022] GET /compute/v2.1/servers/6bcdd812-34e4-438e-bb67-c1b168b9676a/metadata/test2 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:46:45.940670 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b67dc58d-8d15-408a-88da-da5a97a4e729 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:45.953164 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b67dc58d-8d15-408a-88da-da5a97a4e729 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] [instance: a2303432-63f3-45b5-848e-eea36fb0094c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:45.968132 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b67dc58d-8d15-408a-88da-da5a97a4e729 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:45.968997 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b67dc58d-8d15-408a-88da-da5a97a4e729 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:45.969737 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b67dc58d-8d15-408a-88da-da5a97a4e729 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:45.975716 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b67dc58d-8d15-408a-88da-da5a97a4e729 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:45.984114 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b67dc58d-8d15-408a-88da-da5a97a4e729 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:45.985053 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b67dc58d-8d15-408a-88da-da5a97a4e729 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:46.044654 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b67dc58d-8d15-408a-88da-da5a97a4e729 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] [instance: a2303432-63f3-45b5-848e-eea36fb0094c] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:46:46.224560 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b67dc58d-8d15-408a-88da-da5a97a4e729 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a2303432-63f3-45b5-848e-eea36fb0094c" status: 204 len: 0 microversion: 2.1 time: 0.289402 Oct 18 15:46:46.229311 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2375/4763] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:46:45 2022] DELETE /compute/v2.1/servers/a2303432-63f3-45b5-848e-eea36fb0094c => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:46:46.239788 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-411b27e2-14e4-40da-830f-acd7f25602c0 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:46.241408 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-411b27e2-14e4-40da-830f-acd7f25602c0 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] [instance: 84b7e841-8cd5-4554-bf61-e2076ee819a9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:46.256431 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-411b27e2-14e4-40da-830f-acd7f25602c0 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:46.257668 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-411b27e2-14e4-40da-830f-acd7f25602c0 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:46.260003 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-411b27e2-14e4-40da-830f-acd7f25602c0 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:46.262041 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-411b27e2-14e4-40da-830f-acd7f25602c0 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:46.263591 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-411b27e2-14e4-40da-830f-acd7f25602c0 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:46.265427 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-411b27e2-14e4-40da-830f-acd7f25602c0 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:46.384400 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7f1450ae-cea0-48fd-967d-e894a77524dc tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:46.410847 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7f1450ae-cea0-48fd-967d-e894a77524dc tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14" status: 200 len: 1516 microversion: 2.1 time: 0.602071 Oct 18 15:46:46.418268 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2389/4764] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:45 2022] GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14 => generated 1516 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:46:46.426275 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1ed55cba-cb6e-42d8-a037-464b711a2d91 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:46.426926 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1ed55cba-cb6e-42d8-a037-464b711a2d91 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] [instance: a2303432-63f3-45b5-848e-eea36fb0094c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:46.440955 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1ed55cba-cb6e-42d8-a037-464b711a2d91 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:46.441454 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1ed55cba-cb6e-42d8-a037-464b711a2d91 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:46.441890 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1ed55cba-cb6e-42d8-a037-464b711a2d91 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:46.442599 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1ed55cba-cb6e-42d8-a037-464b711a2d91 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:46.443050 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1ed55cba-cb6e-42d8-a037-464b711a2d91 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:46.443682 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1ed55cba-cb6e-42d8-a037-464b711a2d91 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:47.094921 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1ed55cba-cb6e-42d8-a037-464b711a2d91 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6caed9f67c4c05ba02abe4e424cbab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42c92cc615744258653a5aa70010db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:47.105311 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1ed55cba-cb6e-42d8-a037-464b711a2d91 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] 10.222.0.60 "GET /compute/v2.1/servers/a2303432-63f3-45b5-848e-eea36fb0094c" status: 200 len: 1525 microversion: 2.1 time: 0.685841 Oct 18 15:46:47.108190 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-411b27e2-14e4-40da-830f-acd7f25602c0 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/84b7e841-8cd5-4554-bf61-e2076ee819a9" status: 200 len: 1463 microversion: 2.1 time: 0.879927 Oct 18 15:46:47.113034 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2376/4765] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:46 2022] GET /compute/v2.1/servers/84b7e841-8cd5-4554-bf61-e2076ee819a9 => generated 1463 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:47.121938 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2390/4766] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:46 2022] GET /compute/v2.1/servers/a2303432-63f3-45b5-848e-eea36fb0094c => generated 1525 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:47.438927 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8fa6af84-e45b-40ec-a2a8-adb8e56b4036 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:47.439963 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8fa6af84-e45b-40ec-a2a8-adb8e56b4036 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 9d108fa0-49bb-46c2-a8b0-802c5835cb14] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:47.447635 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8fa6af84-e45b-40ec-a2a8-adb8e56b4036 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:47.448491 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8fa6af84-e45b-40ec-a2a8-adb8e56b4036 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:47.449065 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8fa6af84-e45b-40ec-a2a8-adb8e56b4036 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:47.453172 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8fa6af84-e45b-40ec-a2a8-adb8e56b4036 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:47.453909 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8fa6af84-e45b-40ec-a2a8-adb8e56b4036 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:47.454624 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8fa6af84-e45b-40ec-a2a8-adb8e56b4036 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:47.642557 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8fa6af84-e45b-40ec-a2a8-adb8e56b4036 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:47.652017 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8fa6af84-e45b-40ec-a2a8-adb8e56b4036 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14" status: 200 len: 1516 microversion: 2.1 time: 0.218631 Oct 18 15:46:47.653244 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2377/4767] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:47 2022] GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14 => generated 1516 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:48.137439 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-dcfb7228-a015-4b62-9d31-3940816bc358 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:48.141047 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-dcfb7228-a015-4b62-9d31-3940816bc358 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] [instance: a2303432-63f3-45b5-848e-eea36fb0094c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:48.143875 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=4 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:48.145137 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=14 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:48.147505 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f6bb2900-4bfb-4820-9411-fb1e2b73b44a tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:48.148178 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f6bb2900-4bfb-4820-9411-fb1e2b73b44a tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] [instance: 84b7e841-8cd5-4554-bf61-e2076ee819a9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:48.159786 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dcfb7228-a015-4b62-9d31-3940816bc358 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:48.160744 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f6bb2900-4bfb-4820-9411-fb1e2b73b44a tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:48.161303 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dcfb7228-a015-4b62-9d31-3940816bc358 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:48.162462 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f6bb2900-4bfb-4820-9411-fb1e2b73b44a tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:48.162908 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f6bb2900-4bfb-4820-9411-fb1e2b73b44a tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:48.163360 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dcfb7228-a015-4b62-9d31-3940816bc358 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:48.163619 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f6bb2900-4bfb-4820-9411-fb1e2b73b44a tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:48.166019 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dcfb7228-a015-4b62-9d31-3940816bc358 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:48.166148 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f6bb2900-4bfb-4820-9411-fb1e2b73b44a tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:48.168210 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f6bb2900-4bfb-4820-9411-fb1e2b73b44a tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:48.171154 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dcfb7228-a015-4b62-9d31-3940816bc358 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:48.172405 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dcfb7228-a015-4b62-9d31-3940816bc358 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:48.207527 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:48.491029 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-dcfb7228-a015-4b62-9d31-3940816bc358 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6caed9f67c4c05ba02abe4e424cbab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42c92cc615744258653a5aa70010db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:48.501525 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f6bb2900-4bfb-4820-9411-fb1e2b73b44a tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/84b7e841-8cd5-4554-bf61-e2076ee819a9" status: 200 len: 1463 microversion: 2.1 time: 0.359353 Oct 18 15:46:48.502697 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2378/4768] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:48 2022] GET /compute/v2.1/servers/84b7e841-8cd5-4554-bf61-e2076ee819a9 => generated 1463 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:48.510525 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-dcfb7228-a015-4b62-9d31-3940816bc358 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] 10.222.0.60 "GET /compute/v2.1/servers/a2303432-63f3-45b5-848e-eea36fb0094c" status: 200 len: 1525 microversion: 2.1 time: 0.376960 Oct 18 15:46:48.511748 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2391/4769] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:48 2022] GET /compute/v2.1/servers/a2303432-63f3-45b5-848e-eea36fb0094c => generated 1525 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:48.679520 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-78115ad8-198d-4b75-9fa4-e948fcbc03ef tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:48.680405 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-78115ad8-198d-4b75-9fa4-e948fcbc03ef tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 9d108fa0-49bb-46c2-a8b0-802c5835cb14] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:48.688747 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-78115ad8-198d-4b75-9fa4-e948fcbc03ef tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:48.690226 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-78115ad8-198d-4b75-9fa4-e948fcbc03ef tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:48.690868 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-78115ad8-198d-4b75-9fa4-e948fcbc03ef tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:48.692683 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-78115ad8-198d-4b75-9fa4-e948fcbc03ef tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:48.693391 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-78115ad8-198d-4b75-9fa4-e948fcbc03ef tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:48.694204 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-78115ad8-198d-4b75-9fa4-e948fcbc03ef tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:48.950221 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-78115ad8-198d-4b75-9fa4-e948fcbc03ef tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:48.960605 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-78115ad8-198d-4b75-9fa4-e948fcbc03ef tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14" status: 200 len: 1516 microversion: 2.1 time: 0.286595 Oct 18 15:46:48.961231 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2379/4770] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:48 2022] GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14 => generated 1516 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:49.235250 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-c0194d32-8daa-4324-8e32-07eb4ef34f3c req-ab862159-3899-432b-9865-599ddf96b694 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2303432-63f3-45b5-848e-eea36fb0094c", "name": "network-vif-deleted", "tag": "f6b0c2cd-bedf-41e0-9d1f-5330335c9efa"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:46:49.260283 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-c0194d32-8daa-4324-8e32-07eb4ef34f3c req-ab862159-3899-432b-9865-599ddf96b694 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:49.260772 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-c0194d32-8daa-4324-8e32-07eb4ef34f3c req-ab862159-3899-432b-9865-599ddf96b694 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:49.261233 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-c0194d32-8daa-4324-8e32-07eb4ef34f3c req-ab862159-3899-432b-9865-599ddf96b694 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:49.282203 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-c0194d32-8daa-4324-8e32-07eb4ef34f3c req-ab862159-3899-432b-9865-599ddf96b694 service nova] Creating event network-vif-deleted:f6b0c2cd-bedf-41e0-9d1f-5330335c9efa for instance a2303432-63f3-45b5-848e-eea36fb0094c on n-h2-853682-5 Oct 18 15:46:49.293712 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-c0194d32-8daa-4324-8e32-07eb4ef34f3c req-ab862159-3899-432b-9865-599ddf96b694 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060829 Oct 18 15:46:49.294694 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2392/4771] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:46:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:46:49.528763 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a7a5e025-30de-460a-a292-9cc76df330bb tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:49.530035 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a7a5e025-30de-460a-a292-9cc76df330bb tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] [instance: 84b7e841-8cd5-4554-bf61-e2076ee819a9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:49.537026 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7e5dd101-7c6a-45d9-a184-fffc356566d4 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:49.539516 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7a5e025-30de-460a-a292-9cc76df330bb tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:49.541121 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7a5e025-30de-460a-a292-9cc76df330bb tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:49.542127 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7a5e025-30de-460a-a292-9cc76df330bb tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:49.542770 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7e5dd101-7c6a-45d9-a184-fffc356566d4 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] [instance: a2303432-63f3-45b5-848e-eea36fb0094c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:49.545026 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7a5e025-30de-460a-a292-9cc76df330bb tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:49.546663 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7a5e025-30de-460a-a292-9cc76df330bb tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:49.548064 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7a5e025-30de-460a-a292-9cc76df330bb tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:49.561630 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7e5dd101-7c6a-45d9-a184-fffc356566d4 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:49.567088 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7e5dd101-7c6a-45d9-a184-fffc356566d4 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:49.568684 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7e5dd101-7c6a-45d9-a184-fffc356566d4 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:49.571207 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7e5dd101-7c6a-45d9-a184-fffc356566d4 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:49.573689 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7e5dd101-7c6a-45d9-a184-fffc356566d4 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:49.575124 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7e5dd101-7c6a-45d9-a184-fffc356566d4 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:49.696708 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7e5dd101-7c6a-45d9-a184-fffc356566d4 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:49.697286 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7e5dd101-7c6a-45d9-a184-fffc356566d4 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:49.698418 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7e5dd101-7c6a-45d9-a184-fffc356566d4 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:49.699135 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-7e5dd101-7c6a-45d9-a184-fffc356566d4 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lazy-loading 'fault' on Instance uuid a2303432-63f3-45b5-848e-eea36fb0094c {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:46:49.778721 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7e5dd101-7c6a-45d9-a184-fffc356566d4 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6caed9f67c4c05ba02abe4e424cbab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42c92cc615744258653a5aa70010db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:49.787547 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7e5dd101-7c6a-45d9-a184-fffc356566d4 tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] 10.222.0.60 "GET /compute/v2.1/servers/a2303432-63f3-45b5-848e-eea36fb0094c" status: 200 len: 1314 microversion: 2.1 time: 0.257547 Oct 18 15:46:49.788511 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2393/4772] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:49 2022] GET /compute/v2.1/servers/a2303432-63f3-45b5-848e-eea36fb0094c => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:46:49.860337 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a7a5e025-30de-460a-a292-9cc76df330bb tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/84b7e841-8cd5-4554-bf61-e2076ee819a9" status: 200 len: 1463 microversion: 2.1 time: 0.336213 Oct 18 15:46:49.861674 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2380/4773] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:49 2022] GET /compute/v2.1/servers/84b7e841-8cd5-4554-bf61-e2076ee819a9 => generated 1463 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:49.975668 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-506a587f-dcb1-41e3-94a2-4bd3a66d7e65 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:49.977159 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-506a587f-dcb1-41e3-94a2-4bd3a66d7e65 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 28223cad-bdfe-40ba-905e-56488b5119be] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:49.987768 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d7b460a9-6137-45a8-970c-4ca2b0fc415f tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:49.988754 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d7b460a9-6137-45a8-970c-4ca2b0fc415f tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 9d108fa0-49bb-46c2-a8b0-802c5835cb14] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:49.997100 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d7b460a9-6137-45a8-970c-4ca2b0fc415f tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:50.002078 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-506a587f-dcb1-41e3-94a2-4bd3a66d7e65 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:50.003300 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d7b460a9-6137-45a8-970c-4ca2b0fc415f tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:50.003859 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d7b460a9-6137-45a8-970c-4ca2b0fc415f tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:50.004476 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-506a587f-dcb1-41e3-94a2-4bd3a66d7e65 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:50.005122 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-506a587f-dcb1-41e3-94a2-4bd3a66d7e65 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:50.005840 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-506a587f-dcb1-41e3-94a2-4bd3a66d7e65 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:50.006843 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d7b460a9-6137-45a8-970c-4ca2b0fc415f tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:50.007312 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d7b460a9-6137-45a8-970c-4ca2b0fc415f tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:50.007750 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d7b460a9-6137-45a8-970c-4ca2b0fc415f tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:50.008474 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-506a587f-dcb1-41e3-94a2-4bd3a66d7e65 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:50.009497 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-506a587f-dcb1-41e3-94a2-4bd3a66d7e65 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:50.056946 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-506a587f-dcb1-41e3-94a2-4bd3a66d7e65 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] HTTP exception thrown: Instance 28223cad-bdfe-40ba-905e-56488b5119be could not be found. Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-506a587f-dcb1-41e3-94a2-4bd3a66d7e65 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Request method failure captured: Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: request: DELETE /compute/v2.1/servers/28223cad-bdfe-40ba-905e-56488b5119be HTTP/1.1 Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTslxbnvpe5yiGf5CWZMgShC81OiGKrcSLYZFSWKOLbaqqF5kNJvh8cijdldsPo1OHjHXDcbdPuhTuFRNRswVq0HwpXLNCfOWcF3GU1M8LHkZwXu6ScaOEIHyQ8ewFnAFL7TXd1O14t3atsv_uM6Xc9ZHSfefERCjuehdw5SJuAn7MMs Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 96c4378d52d1489bb2d50e84cabf95eb Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 28223cad-bdfe-40ba-905e-56488b5119be could not be found. Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '28223cad-bdfe-40ba-905e-56488b5119be'} Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28223cad-bdfe-40ba-905e-56488b5119be could not be found. Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:46:50.061027 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:46:50.065271 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28223cad-bdfe-40ba-905e-56488b5119be could not be found. Oct 18 15:46:50.065271 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:50.065271 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:46:50.065271 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:50.065271 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:50.065271 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:46:50.065271 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:46:50.065271 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:46:50.065271 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:46:50.065271 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28223cad-bdfe-40ba-905e-56488b5119be could not be found. Oct 18 15:46:50.065271 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:50.065271 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-506a587f-dcb1-41e3-94a2-4bd3a66d7e65 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Returning 404 to user: Instance 28223cad-bdfe-40ba-905e-56488b5119be could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:46:50.066916 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-506a587f-dcb1-41e3-94a2-4bd3a66d7e65 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "DELETE /compute/v2.1/servers/28223cad-bdfe-40ba-905e-56488b5119be" status: 404 len: 111 microversion: 2.1 time: 0.094051 Oct 18 15:46:50.068279 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2394/4774] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:46:49 2022] DELETE /compute/v2.1/servers/28223cad-bdfe-40ba-905e-56488b5119be => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:46:50.081421 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c60d4804-372d-460b-b5de-d70fcfb20de4 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:50.086236 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c60d4804-372d-460b-b5de-d70fcfb20de4 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 28223cad-bdfe-40ba-905e-56488b5119be] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:50.102502 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c60d4804-372d-460b-b5de-d70fcfb20de4 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:50.107812 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c60d4804-372d-460b-b5de-d70fcfb20de4 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:50.108593 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c60d4804-372d-460b-b5de-d70fcfb20de4 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:50.109499 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c60d4804-372d-460b-b5de-d70fcfb20de4 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:50.110063 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c60d4804-372d-460b-b5de-d70fcfb20de4 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:50.110632 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c60d4804-372d-460b-b5de-d70fcfb20de4 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:50.151625 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-c60d4804-372d-460b-b5de-d70fcfb20de4 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] HTTP exception thrown: Instance 28223cad-bdfe-40ba-905e-56488b5119be could not be found. Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c60d4804-372d-460b-b5de-d70fcfb20de4 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Request method failure captured: Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/28223cad-bdfe-40ba-905e-56488b5119be HTTP/1.1 Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTslxbnvpe5yiGf5CWZMgShC81OiGKrcSLYZFSWKOLbaqqF5kNJvh8cijdldsPo1OHjHXDcbdPuhTuFRNRswVq0HwpXLNCfOWcF3GU1M8LHkZwXu6ScaOEIHyQ8ewFnAFL7TXd1O14t3atsv_uM6Xc9ZHSfefERCjuehdw5SJuAn7MMs Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 96c4378d52d1489bb2d50e84cabf95eb Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 28223cad-bdfe-40ba-905e-56488b5119be could not be found. Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '28223cad-bdfe-40ba-905e-56488b5119be'} Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28223cad-bdfe-40ba-905e-56488b5119be could not be found. Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28223cad-bdfe-40ba-905e-56488b5119be could not be found. Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:46:50.155388 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:50.159587 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:50.159587 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:46:50.159587 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:46:50.159587 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:46:50.159587 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:46:50.159587 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28223cad-bdfe-40ba-905e-56488b5119be could not be found. Oct 18 15:46:50.159587 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:50.159587 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c60d4804-372d-460b-b5de-d70fcfb20de4 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Returning 404 to user: Instance 28223cad-bdfe-40ba-905e-56488b5119be could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:46:50.159587 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c60d4804-372d-460b-b5de-d70fcfb20de4 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/28223cad-bdfe-40ba-905e-56488b5119be" status: 404 len: 111 microversion: 2.1 time: 0.083378 Oct 18 15:46:50.165240 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2395/4775] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:50 2022] GET /compute/v2.1/servers/28223cad-bdfe-40ba-905e-56488b5119be => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:46:50.172283 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c9d6ad4f-09b0-4e20-b695-c38c5e160db0 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:50.175692 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c9d6ad4f-09b0-4e20-b695-c38c5e160db0 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:50.188875 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c9d6ad4f-09b0-4e20-b695-c38c5e160db0 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:50.192256 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c9d6ad4f-09b0-4e20-b695-c38c5e160db0 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:50.192765 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c9d6ad4f-09b0-4e20-b695-c38c5e160db0 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:50.193537 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c9d6ad4f-09b0-4e20-b695-c38c5e160db0 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:50.194016 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c9d6ad4f-09b0-4e20-b695-c38c5e160db0 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:50.197257 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c9d6ad4f-09b0-4e20-b695-c38c5e160db0 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:50.240254 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c9d6ad4f-09b0-4e20-b695-c38c5e160db0 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:46:50.293547 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d7b460a9-6137-45a8-970c-4ca2b0fc415f tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:50.306945 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d7b460a9-6137-45a8-970c-4ca2b0fc415f tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14" status: 200 len: 1516 microversion: 2.1 time: 0.324910 Oct 18 15:46:50.325210 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2381/4776] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:49 2022] GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14 => generated 1516 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:46:50.351106 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-0d373ecc-db98-4cf6-b989-3338c27d4469 req-628a441e-9bd5-4bb5-92bd-5c4be92856b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84b7e841-8cd5-4554-bf61-e2076ee819a9", "name": "network-vif-plugged", "status": "completed", "tag": "6781b44e-4894-41ec-941b-1a9d6af8944f"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:46:50.365203 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0d373ecc-db98-4cf6-b989-3338c27d4469 req-628a441e-9bd5-4bb5-92bd-5c4be92856b7 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:50.366657 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0d373ecc-db98-4cf6-b989-3338c27d4469 req-628a441e-9bd5-4bb5-92bd-5c4be92856b7 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:50.369090 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0d373ecc-db98-4cf6-b989-3338c27d4469 req-628a441e-9bd5-4bb5-92bd-5c4be92856b7 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:50.399967 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-0d373ecc-db98-4cf6-b989-3338c27d4469 req-628a441e-9bd5-4bb5-92bd-5c4be92856b7 service nova] Creating event network-vif-plugged:6781b44e-4894-41ec-941b-1a9d6af8944f for instance 84b7e841-8cd5-4554-bf61-e2076ee819a9 on n-h1-853682-5 Oct 18 15:46:50.407274 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-0d373ecc-db98-4cf6-b989-3338c27d4469 req-628a441e-9bd5-4bb5-92bd-5c4be92856b7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060947 Oct 18 15:46:50.409564 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2382/4777] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:46:50.441965 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c9d6ad4f-09b0-4e20-b695-c38c5e160db0 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "DELETE /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 204 len: 0 microversion: 2.1 time: 0.275188 Oct 18 15:46:50.446989 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2396/4778] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:46:50 2022] DELETE /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:46:50.453666 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2c881733-9bdc-41fb-b7fe-5dfbfde2a488 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:50.454718 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2c881733-9bdc-41fb-b7fe-5dfbfde2a488 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:50.463240 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c881733-9bdc-41fb-b7fe-5dfbfde2a488 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:50.465025 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c881733-9bdc-41fb-b7fe-5dfbfde2a488 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:50.465932 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c881733-9bdc-41fb-b7fe-5dfbfde2a488 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:50.467062 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c881733-9bdc-41fb-b7fe-5dfbfde2a488 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:50.467808 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c881733-9bdc-41fb-b7fe-5dfbfde2a488 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:50.468449 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c881733-9bdc-41fb-b7fe-5dfbfde2a488 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:50.673020 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2c881733-9bdc-41fb-b7fe-5dfbfde2a488 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:50.691444 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2c881733-9bdc-41fb-b7fe-5dfbfde2a488 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1513 microversion: 2.1 time: 0.240180 Oct 18 15:46:50.705837 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2383/4779] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:50 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1513 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:46:50.816285 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-286f9a12-aaea-4282-b8fa-3de9bf20c62e tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:50.817207 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-286f9a12-aaea-4282-b8fa-3de9bf20c62e tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] [instance: a2303432-63f3-45b5-848e-eea36fb0094c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:50.825850 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-286f9a12-aaea-4282-b8fa-3de9bf20c62e tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:50.832223 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-286f9a12-aaea-4282-b8fa-3de9bf20c62e tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:50.835405 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-286f9a12-aaea-4282-b8fa-3de9bf20c62e tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:50.836571 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-286f9a12-aaea-4282-b8fa-3de9bf20c62e tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:50.838153 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-286f9a12-aaea-4282-b8fa-3de9bf20c62e tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:50.841176 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-286f9a12-aaea-4282-b8fa-3de9bf20c62e tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:50.870500 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-286f9a12-aaea-4282-b8fa-3de9bf20c62e tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] HTTP exception thrown: Instance a2303432-63f3-45b5-848e-eea36fb0094c could not be found. Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-286f9a12-aaea-4282-b8fa-3de9bf20c62e tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Request method failure captured: Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/a2303432-63f3-45b5-848e-eea36fb0094c HTTP/1.1 Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTspUTmyivAb_NtVuBPDpExGZALySc4b6c2s-EShbipstJvkF_qUQBj-F3jbOc6GfTw2pL3YB-s66PVFA_EknvF0FrSj-s5pVZLutEuO0638kzqCL8UXPSjzBdqyzIz_L5cLi8JvXlmPNe-MB4-GpCwCAe7YFyQdnF8xcZWHgsT0mTbA Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: e42c92cc615744258653a5aa70010db5 Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1778532528 Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e42c92cc615744258653a5aa70010db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e42c92cc615744258653a5aa70010db5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e42c92cc615744258653a5aa70010db5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e42c92cc615744258653a5aa70010db5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1778532528 Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: e42c92cc615744258653a5aa70010db5 Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1778532528 Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServerMetadataNegativeTestJSON-1778532528-project Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: ad6caed9f67c4c05ba02abe4e424cbab Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1778532528-project Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance a2303432-63f3-45b5-848e-eea36fb0094c could not be found. Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'a2303432-63f3-45b5-848e-eea36fb0094c'} Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2303432-63f3-45b5-848e-eea36fb0094c could not be found. Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2303432-63f3-45b5-848e-eea36fb0094c could not be found. Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:50.874072 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:46:50.880164 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:50.880164 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:50.880164 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:46:50.880164 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:46:50.880164 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:46:50.880164 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:46:50.880164 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2303432-63f3-45b5-848e-eea36fb0094c could not be found. Oct 18 15:46:50.880164 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:50.880164 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-286f9a12-aaea-4282-b8fa-3de9bf20c62e tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] Returning 404 to user: Instance a2303432-63f3-45b5-848e-eea36fb0094c could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:46:50.880164 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-286f9a12-aaea-4282-b8fa-3de9bf20c62e tempest-ServerMetadataNegativeTestJSON-1778532528 tempest-ServerMetadataNegativeTestJSON-1778532528-project] 10.222.0.60 "GET /compute/v2.1/servers/a2303432-63f3-45b5-848e-eea36fb0094c" status: 404 len: 111 microversion: 2.1 time: 0.067490 Oct 18 15:46:50.889111 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0ded763c-4dec-45be-85e9-fc8a95d6fae4 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:50.890304 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0ded763c-4dec-45be-85e9-fc8a95d6fae4 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] [instance: 84b7e841-8cd5-4554-bf61-e2076ee819a9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:50.891871 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2397/4780] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:50 2022] GET /compute/v2.1/servers/a2303432-63f3-45b5-848e-eea36fb0094c => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:46:50.898726 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ded763c-4dec-45be-85e9-fc8a95d6fae4 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:50.901223 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ded763c-4dec-45be-85e9-fc8a95d6fae4 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:50.903763 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ded763c-4dec-45be-85e9-fc8a95d6fae4 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:50.904620 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ded763c-4dec-45be-85e9-fc8a95d6fae4 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:50.906993 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ded763c-4dec-45be-85e9-fc8a95d6fae4 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:50.907726 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ded763c-4dec-45be-85e9-fc8a95d6fae4 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:51.221369 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0ded763c-4dec-45be-85e9-fc8a95d6fae4 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/84b7e841-8cd5-4554-bf61-e2076ee819a9" status: 200 len: 1463 microversion: 2.1 time: 0.337852 Oct 18 15:46:51.239192 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-406e31b7-ac48-4924-a39e-fcfabd15046f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:51.240867 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-406e31b7-ac48-4924-a39e-fcfabd15046f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:51.241417 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2384/4781] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:50 2022] GET /compute/v2.1/servers/84b7e841-8cd5-4554-bf61-e2076ee819a9 => generated 1463 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:51.254199 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-406e31b7-ac48-4924-a39e-fcfabd15046f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:51.255593 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-406e31b7-ac48-4924-a39e-fcfabd15046f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:51.256302 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-406e31b7-ac48-4924-a39e-fcfabd15046f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:51.258910 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-406e31b7-ac48-4924-a39e-fcfabd15046f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:51.260459 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-406e31b7-ac48-4924-a39e-fcfabd15046f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:51.262257 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-406e31b7-ac48-4924-a39e-fcfabd15046f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:51.335410 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bda9ce0d-411b-4bc0-b7a3-7d877901fe49 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:51.336197 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bda9ce0d-411b-4bc0-b7a3-7d877901fe49 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 9d108fa0-49bb-46c2-a8b0-802c5835cb14] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:51.343627 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bda9ce0d-411b-4bc0-b7a3-7d877901fe49 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:51.344683 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bda9ce0d-411b-4bc0-b7a3-7d877901fe49 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:51.345438 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bda9ce0d-411b-4bc0-b7a3-7d877901fe49 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:51.346434 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bda9ce0d-411b-4bc0-b7a3-7d877901fe49 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:51.347178 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bda9ce0d-411b-4bc0-b7a3-7d877901fe49 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:51.347861 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bda9ce0d-411b-4bc0-b7a3-7d877901fe49 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:51.619260 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-406e31b7-ac48-4924-a39e-fcfabd15046f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:51.629175 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-406e31b7-ac48-4924-a39e-fcfabd15046f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1671 microversion: 2.1 time: 0.394028 Oct 18 15:46:51.630684 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2398/4782] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:51 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1671 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:46:51.656106 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-887470a7-b19d-4c7f-aa85-80bb0e587635 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:51.657182 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-887470a7-b19d-4c7f-aa85-80bb0e587635 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:51.665032 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-887470a7-b19d-4c7f-aa85-80bb0e587635 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:51.666282 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-887470a7-b19d-4c7f-aa85-80bb0e587635 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:51.667484 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-887470a7-b19d-4c7f-aa85-80bb0e587635 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:51.669971 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-887470a7-b19d-4c7f-aa85-80bb0e587635 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:51.670622 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-887470a7-b19d-4c7f-aa85-80bb0e587635 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:51.672733 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bda9ce0d-411b-4bc0-b7a3-7d877901fe49 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:51.673362 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-887470a7-b19d-4c7f-aa85-80bb0e587635 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:51.699780 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bda9ce0d-411b-4bc0-b7a3-7d877901fe49 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14" status: 200 len: 1516 microversion: 2.1 time: 0.368785 Oct 18 15:46:51.700732 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2385/4783] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:51 2022] GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14 => generated 1516 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:51.721394 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-416918e1-e6a1-409f-8182-19d1744ecf92 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:51.722243 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-416918e1-e6a1-409f-8182-19d1744ecf92 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:51.729453 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-416918e1-e6a1-409f-8182-19d1744ecf92 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:51.730168 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-416918e1-e6a1-409f-8182-19d1744ecf92 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:51.730769 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-416918e1-e6a1-409f-8182-19d1744ecf92 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:51.731645 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-416918e1-e6a1-409f-8182-19d1744ecf92 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:51.732268 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-416918e1-e6a1-409f-8182-19d1744ecf92 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:51.732924 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-416918e1-e6a1-409f-8182-19d1744ecf92 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:52.028562 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-416918e1-e6a1-409f-8182-19d1744ecf92 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:52.036436 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-416918e1-e6a1-409f-8182-19d1744ecf92 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1513 microversion: 2.1 time: 0.322231 Oct 18 15:46:52.037649 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2386/4784] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:51 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1513 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:46:52.057424 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-887470a7-b19d-4c7f-aa85-80bb0e587635 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:52.070488 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-887470a7-b19d-4c7f-aa85-80bb0e587635 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1671 microversion: 2.1 time: 0.418543 Oct 18 15:46:52.092501 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2399/4785] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:51 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1671 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:46:52.099626 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4e419fa0-7dbe-42db-97bf-11c0d2e9c011 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:52.100255 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4e419fa0-7dbe-42db-97bf-11c0d2e9c011 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:52.110595 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e419fa0-7dbe-42db-97bf-11c0d2e9c011 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:52.111243 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e419fa0-7dbe-42db-97bf-11c0d2e9c011 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:52.114230 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e419fa0-7dbe-42db-97bf-11c0d2e9c011 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:52.114969 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e419fa0-7dbe-42db-97bf-11c0d2e9c011 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:52.115860 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e419fa0-7dbe-42db-97bf-11c0d2e9c011 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:52.116303 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e419fa0-7dbe-42db-97bf-11c0d2e9c011 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:52.247059 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e54825b5-c158-45d3-8e07-54c89bdbed15 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:52.248653 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e54825b5-c158-45d3-8e07-54c89bdbed15 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] [instance: 84b7e841-8cd5-4554-bf61-e2076ee819a9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:52.258781 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e54825b5-c158-45d3-8e07-54c89bdbed15 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:52.259988 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e54825b5-c158-45d3-8e07-54c89bdbed15 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:52.260625 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e54825b5-c158-45d3-8e07-54c89bdbed15 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:52.265870 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e54825b5-c158-45d3-8e07-54c89bdbed15 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:52.266495 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e54825b5-c158-45d3-8e07-54c89bdbed15 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:52.267245 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e54825b5-c158-45d3-8e07-54c89bdbed15 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:52.335736 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:52.356093 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4e419fa0-7dbe-42db-97bf-11c0d2e9c011 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:52.364372 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4e419fa0-7dbe-42db-97bf-11c0d2e9c011 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1671 microversion: 2.1 time: 0.269593 Oct 18 15:46:52.365519 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2387/4786] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:52 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1671 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:52.387754 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c38994cc-95ec-4297-9701-8132bc89fa18 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:52.388373 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c38994cc-95ec-4297-9701-8132bc89fa18 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:52.394455 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c38994cc-95ec-4297-9701-8132bc89fa18 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:52.395156 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c38994cc-95ec-4297-9701-8132bc89fa18 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:52.395765 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c38994cc-95ec-4297-9701-8132bc89fa18 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:52.396463 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c38994cc-95ec-4297-9701-8132bc89fa18 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:52.397244 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c38994cc-95ec-4297-9701-8132bc89fa18 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:52.397830 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c38994cc-95ec-4297-9701-8132bc89fa18 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:53.195895 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e54825b5-c158-45d3-8e07-54c89bdbed15 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/84b7e841-8cd5-4554-bf61-e2076ee819a9" status: 200 len: 1463 microversion: 2.1 time: 0.952727 Oct 18 15:46:53.209062 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2400/4787] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:52 2022] GET /compute/v2.1/servers/84b7e841-8cd5-4554-bf61-e2076ee819a9 => generated 1463 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:46:53.209062 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2c248b22-f834-4b29-a4a6-3e5b92069dcf tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:53.209062 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2c248b22-f834-4b29-a4a6-3e5b92069dcf tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 9d108fa0-49bb-46c2-a8b0-802c5835cb14] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:53.224999 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c248b22-f834-4b29-a4a6-3e5b92069dcf tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:53.225707 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c248b22-f834-4b29-a4a6-3e5b92069dcf tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:53.226166 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c248b22-f834-4b29-a4a6-3e5b92069dcf tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:53.226914 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c248b22-f834-4b29-a4a6-3e5b92069dcf tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:53.227378 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c248b22-f834-4b29-a4a6-3e5b92069dcf tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:53.228376 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c248b22-f834-4b29-a4a6-3e5b92069dcf tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:53.332172 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c38994cc-95ec-4297-9701-8132bc89fa18 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:53.346085 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c38994cc-95ec-4297-9701-8132bc89fa18 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1671 microversion: 2.1 time: 0.962960 Oct 18 15:46:53.350187 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2388/4788] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:52 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1671 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:46:53.367039 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-53eed44b-3105-4f45-86c1-44025cd1f7d4 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:53.367780 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-53eed44b-3105-4f45-86c1-44025cd1f7d4 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:53.375086 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-53eed44b-3105-4f45-86c1-44025cd1f7d4 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:53.378502 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-53eed44b-3105-4f45-86c1-44025cd1f7d4 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:53.379204 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-53eed44b-3105-4f45-86c1-44025cd1f7d4 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:53.380393 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-53eed44b-3105-4f45-86c1-44025cd1f7d4 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:53.381205 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-53eed44b-3105-4f45-86c1-44025cd1f7d4 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:53.381891 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-53eed44b-3105-4f45-86c1-44025cd1f7d4 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:53.429420 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-53eed44b-3105-4f45-86c1-44025cd1f7d4 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:53.432269 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-53eed44b-3105-4f45-86c1-44025cd1f7d4 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:53.432974 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-53eed44b-3105-4f45-86c1-44025cd1f7d4 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:53.433649 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-53eed44b-3105-4f45-86c1-44025cd1f7d4 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lazy-loading 'fault' on Instance uuid 2cc69e2e-cb26-42d6-b887-31e0afaa69fc {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:46:53.525639 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-53eed44b-3105-4f45-86c1-44025cd1f7d4 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c4378d52d1489bb2d50e84cabf95eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85a1afa85674bc39dbce30ed8792cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:53.534542 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-53eed44b-3105-4f45-86c1-44025cd1f7d4 tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 200 len: 1307 microversion: 2.1 time: 0.181720 Oct 18 15:46:53.538928 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2389/4789] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:53 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 1307 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:53.561319 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-4de0bb05-602c-43d2-84fe-24022949e6d2 req-83837057-5a27-4623-8e5f-d741ba888eb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cc69e2e-cb26-42d6-b887-31e0afaa69fc", "name": "network-vif-deleted", "tag": "c9ee9ae4-c0ad-4fa3-a68e-56018fcf2c7f"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:46:53.573640 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4de0bb05-602c-43d2-84fe-24022949e6d2 req-83837057-5a27-4623-8e5f-d741ba888eb2 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:53.574402 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4de0bb05-602c-43d2-84fe-24022949e6d2 req-83837057-5a27-4623-8e5f-d741ba888eb2 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:53.575033 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4de0bb05-602c-43d2-84fe-24022949e6d2 req-83837057-5a27-4623-8e5f-d741ba888eb2 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:53.589566 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-4de0bb05-602c-43d2-84fe-24022949e6d2 req-83837057-5a27-4623-8e5f-d741ba888eb2 service nova] Creating event network-vif-deleted:c9ee9ae4-c0ad-4fa3-a68e-56018fcf2c7f for instance 2cc69e2e-cb26-42d6-b887-31e0afaa69fc on n-h2-853682-5 Oct 18 15:46:53.597015 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-4de0bb05-602c-43d2-84fe-24022949e6d2 req-83837057-5a27-4623-8e5f-d741ba888eb2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041744 Oct 18 15:46:53.598252 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2390/4790] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:46:53.605861 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-019695f4-70fc-4340-87f9-2ba0594243e6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1637236782", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "f7f357f0-b7b8-48ee-8cbb-a57289af59df"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:46:53.676185 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-019695f4-70fc-4340-87f9-2ba0594243e6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] validate_networks() for [('f7f357f0-b7b8-48ee-8cbb-a57289af59df', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:46:53.964548 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2c248b22-f834-4b29-a4a6-3e5b92069dcf tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:53.981871 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2c248b22-f834-4b29-a4a6-3e5b92069dcf tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14" status: 200 len: 1516 microversion: 2.1 time: 0.780466 Oct 18 15:46:53.985667 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2401/4791] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:53 2022] GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14 => generated 1516 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:54.228383 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3c9984db-9280-401d-81c2-6e589d557ed6 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:54.230059 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3c9984db-9280-401d-81c2-6e589d557ed6 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] [instance: 84b7e841-8cd5-4554-bf61-e2076ee819a9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:54.248372 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3c9984db-9280-401d-81c2-6e589d557ed6 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:54.251095 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3c9984db-9280-401d-81c2-6e589d557ed6 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:54.253430 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3c9984db-9280-401d-81c2-6e589d557ed6 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:54.256307 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3c9984db-9280-401d-81c2-6e589d557ed6 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:54.260600 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3c9984db-9280-401d-81c2-6e589d557ed6 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:54.265300 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3c9984db-9280-401d-81c2-6e589d557ed6 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:54.643375 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3c9984db-9280-401d-81c2-6e589d557ed6 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/84b7e841-8cd5-4554-bf61-e2076ee819a9" status: 200 len: 1647 microversion: 2.1 time: 0.422998 Oct 18 15:46:54.647679 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2402/4792] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:54 2022] GET /compute/v2.1/servers/84b7e841-8cd5-4554-bf61-e2076ee819a9 => generated 1647 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:54.662623 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2f1aa38e-422c-48f1-ad71-610f7ba8ad7d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:54.663249 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2f1aa38e-422c-48f1-ad71-610f7ba8ad7d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] [instance: 2cc69e2e-cb26-42d6-b887-31e0afaa69fc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:54.680228 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2f1aa38e-422c-48f1-ad71-610f7ba8ad7d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:54.681323 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2f1aa38e-422c-48f1-ad71-610f7ba8ad7d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:54.681771 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2f1aa38e-422c-48f1-ad71-610f7ba8ad7d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:54.682487 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2f1aa38e-422c-48f1-ad71-610f7ba8ad7d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:54.682949 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2f1aa38e-422c-48f1-ad71-610f7ba8ad7d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:54.683482 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2f1aa38e-422c-48f1-ad71-610f7ba8ad7d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:54.733599 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-2f1aa38e-422c-48f1-ad71-610f7ba8ad7d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] HTTP exception thrown: Instance 2cc69e2e-cb26-42d6-b887-31e0afaa69fc could not be found. Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2f1aa38e-422c-48f1-ad71-610f7ba8ad7d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Request method failure captured: Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc HTTP/1.1 Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTslxbnvpe5yiGf5CWZMgShC81OiGKrcSLYZFSWKOLbaqqF5kNJvh8cijdldsPo1OHjHXDcbdPuhTuFRNRswVq0HwpXLNCfOWcF3GU1M8LHkZwXu6ScaOEIHyQ8ewFnAFL7TXd1O14t3atsv_uM6Xc9ZHSfefERCjuehdw5SJuAn7MMs Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f85a1afa85674bc39dbce30ed8792cb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: f85a1afa85674bc39dbce30ed8792cb0 Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServersNegativeTestJSON-585545808 Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 96c4378d52d1489bb2d50e84cabf95eb Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServersNegativeTestJSON-585545808-project Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 2cc69e2e-cb26-42d6-b887-31e0afaa69fc could not be found. Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '2cc69e2e-cb26-42d6-b887-31e0afaa69fc'} Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cc69e2e-cb26-42d6-b887-31e0afaa69fc could not be found. Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cc69e2e-cb26-42d6-b887-31e0afaa69fc could not be found. Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:46:54.735162 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:54.740109 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:46:54.740109 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:46:54.740109 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:46:54.740109 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:46:54.740109 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:46:54.740109 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cc69e2e-cb26-42d6-b887-31e0afaa69fc could not be found. Oct 18 15:46:54.740109 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:46:54.740109 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2f1aa38e-422c-48f1-ad71-610f7ba8ad7d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] Returning 404 to user: Instance 2cc69e2e-cb26-42d6-b887-31e0afaa69fc could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:46:54.740109 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2f1aa38e-422c-48f1-ad71-610f7ba8ad7d tempest-ServersNegativeTestJSON-585545808 tempest-ServersNegativeTestJSON-585545808-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc" status: 404 len: 111 microversion: 2.1 time: 0.085084 Oct 18 15:46:54.745073 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2403/4793] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:54 2022] GET /compute/v2.1/servers/2cc69e2e-cb26-42d6-b887-31e0afaa69fc => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:46:54.761000 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9b3c3e55-3f4c-436c-9f60-f26ec04a6e74 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:54.761625 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9b3c3e55-3f4c-436c-9f60-f26ec04a6e74 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] [instance: 84b7e841-8cd5-4554-bf61-e2076ee819a9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:54.775603 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9b3c3e55-3f4c-436c-9f60-f26ec04a6e74 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:54.776097 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9b3c3e55-3f4c-436c-9f60-f26ec04a6e74 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:54.776537 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9b3c3e55-3f4c-436c-9f60-f26ec04a6e74 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:54.777278 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9b3c3e55-3f4c-436c-9f60-f26ec04a6e74 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:54.783055 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9b3c3e55-3f4c-436c-9f60-f26ec04a6e74 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:54.783726 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9b3c3e55-3f4c-436c-9f60-f26ec04a6e74 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:54.983207 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-019695f4-70fc-4340-87f9-2ba0594243e6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:46:54.983743 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-019695f4-70fc-4340-87f9-2ba0594243e6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:46:54.984231 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-019695f4-70fc-4340-87f9-2ba0594243e6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:46:54.984693 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-019695f4-70fc-4340-87f9-2ba0594243e6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:46:54.985569 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-019695f4-70fc-4340-87f9-2ba0594243e6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:46:55.006475 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-019695f4-70fc-4340-87f9-2ba0594243e6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:55.007294 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-019695f4-70fc-4340-87f9-2ba0594243e6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:55.007965 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-019695f4-70fc-4340-87f9-2ba0594243e6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:55.008766 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-019695f4-70fc-4340-87f9-2ba0594243e6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:55.009797 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-019695f4-70fc-4340-87f9-2ba0594243e6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:55.010421 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-019695f4-70fc-4340-87f9-2ba0594243e6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:55.034944 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-019695f4-70fc-4340-87f9-2ba0594243e6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Getting quotas for project 2a2cdc778bd54f209d70f5b8703dc068. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:46:55.042714 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-019695f4-70fc-4340-87f9-2ba0594243e6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Getting quotas for user 2aa0148a4a43466da619ea9843b3f78c and project 2a2cdc778bd54f209d70f5b8703dc068. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:46:55.065993 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-019695f4-70fc-4340-87f9-2ba0594243e6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:46:55.070257 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-019695f4-70fc-4340-87f9-2ba0594243e6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 5378eb2d-663e-4d1d-a113-64363d4f1dd9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:46:55.133324 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-019695f4-70fc-4340-87f9-2ba0594243e6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.533310 Oct 18 15:46:55.134357 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2391/4794] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:46:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:46:55.152324 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5dc4eeb7-344b-4d3e-b444-c12e93eda9df tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:55.157976 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5dc4eeb7-344b-4d3e-b444-c12e93eda9df tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 9d108fa0-49bb-46c2-a8b0-802c5835cb14] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:55.169568 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:55.171693 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5dc4eeb7-344b-4d3e-b444-c12e93eda9df tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:55.172293 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5dc4eeb7-344b-4d3e-b444-c12e93eda9df tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:55.172841 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5dc4eeb7-344b-4d3e-b444-c12e93eda9df tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:55.173785 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5dc4eeb7-344b-4d3e-b444-c12e93eda9df tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:55.174408 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5dc4eeb7-344b-4d3e-b444-c12e93eda9df tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:55.174928 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5dc4eeb7-344b-4d3e-b444-c12e93eda9df tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:55.429390 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9b3c3e55-3f4c-436c-9f60-f26ec04a6e74 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/84b7e841-8cd5-4554-bf61-e2076ee819a9" status: 200 len: 1647 microversion: 2.1 time: 0.674532 Oct 18 15:46:55.437576 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2404/4795] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:54 2022] GET /compute/v2.1/servers/84b7e841-8cd5-4554-bf61-e2076ee819a9 => generated 1647 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:55.450133 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9546895f-fed0-486b-ba3f-d00e38dfe71e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:55.451059 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9546895f-fed0-486b-ba3f-d00e38dfe71e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 5378eb2d-663e-4d1d-a113-64363d4f1dd9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:55.580993 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5dc4eeb7-344b-4d3e-b444-c12e93eda9df tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:55.602740 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5dc4eeb7-344b-4d3e-b444-c12e93eda9df tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14" status: 200 len: 1516 microversion: 2.1 time: 0.462156 Oct 18 15:46:55.606144 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2392/4796] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:55 2022] GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14 => generated 1516 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:55.614136 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-defc2e7a-c9e1-41e7-a677-2b1def7fedcf tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:55.617279 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-defc2e7a-c9e1-41e7-a677-2b1def7fedcf tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] [instance: 84b7e841-8cd5-4554-bf61-e2076ee819a9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:55.636274 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-defc2e7a-c9e1-41e7-a677-2b1def7fedcf tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:55.639539 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-defc2e7a-c9e1-41e7-a677-2b1def7fedcf tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:55.640249 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-defc2e7a-c9e1-41e7-a677-2b1def7fedcf tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:55.641376 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-defc2e7a-c9e1-41e7-a677-2b1def7fedcf tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:55.644282 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-defc2e7a-c9e1-41e7-a677-2b1def7fedcf tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:55.645119 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-defc2e7a-c9e1-41e7-a677-2b1def7fedcf tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:55.769641 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9546895f-fed0-486b-ba3f-d00e38dfe71e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:55.777739 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9546895f-fed0-486b-ba3f-d00e38dfe71e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/5378eb2d-663e-4d1d-a113-64363d4f1dd9" status: 200 len: 1215 microversion: 2.1 time: 0.338138 Oct 18 15:46:55.782930 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2405/4797] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:55 2022] GET /compute/v2.1/servers/5378eb2d-663e-4d1d-a113-64363d4f1dd9 => generated 1215 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:55.913202 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ac762664-e1f6-4597-9b10-2c11c6dc2212 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1afd8b4-b9b9-4c07-979c-558282ac358e"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:46:55.925672 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ac762664-e1f6-4597-9b10-2c11c6dc2212 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 5e83c779-c8f8-4ebd-84ab-7f144ab8552a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:55.939750 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ac762664-e1f6-4597-9b10-2c11c6dc2212 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:55.944135 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ac762664-e1f6-4597-9b10-2c11c6dc2212 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:55.945505 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ac762664-e1f6-4597-9b10-2c11c6dc2212 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:55.946770 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ac762664-e1f6-4597-9b10-2c11c6dc2212 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:55.948497 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ac762664-e1f6-4597-9b10-2c11c6dc2212 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:55.949199 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ac762664-e1f6-4597-9b10-2c11c6dc2212 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:56.056031 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-defc2e7a-c9e1-41e7-a677-2b1def7fedcf tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/84b7e841-8cd5-4554-bf61-e2076ee819a9" status: 200 len: 1647 microversion: 2.1 time: 0.448393 Oct 18 15:46:56.060431 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2393/4798] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:55 2022] GET /compute/v2.1/servers/84b7e841-8cd5-4554-bf61-e2076ee819a9 => generated 1647 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:56.083948 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c0fb0d9c-ef31-42de-951d-529177a11bb4 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:56.084667 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c0fb0d9c-ef31-42de-951d-529177a11bb4 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] [instance: 84b7e841-8cd5-4554-bf61-e2076ee819a9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:56.096079 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0fb0d9c-ef31-42de-951d-529177a11bb4 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:56.097099 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0fb0d9c-ef31-42de-951d-529177a11bb4 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:56.102779 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0fb0d9c-ef31-42de-951d-529177a11bb4 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:56.103908 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0fb0d9c-ef31-42de-951d-529177a11bb4 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:56.104541 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0fb0d9c-ef31-42de-951d-529177a11bb4 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:56.105264 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0fb0d9c-ef31-42de-951d-529177a11bb4 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:56.170648 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c0fb0d9c-ef31-42de-951d-529177a11bb4 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] [instance: 84b7e841-8cd5-4554-bf61-e2076ee819a9] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:46:56.404529 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c0fb0d9c-ef31-42de-951d-529177a11bb4 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] 10.222.0.60 "DELETE /compute/v2.1/servers/84b7e841-8cd5-4554-bf61-e2076ee819a9" status: 204 len: 0 microversion: 2.1 time: 0.320878 Oct 18 15:46:56.407649 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2394/4799] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:46:56 2022] DELETE /compute/v2.1/servers/84b7e841-8cd5-4554-bf61-e2076ee819a9 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:46:56.419391 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1bf75686-7337-4db6-8aa4-3ba7676d8850 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:56.420376 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1bf75686-7337-4db6-8aa4-3ba7676d8850 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] [instance: 84b7e841-8cd5-4554-bf61-e2076ee819a9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:56.430581 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1bf75686-7337-4db6-8aa4-3ba7676d8850 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:56.431319 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1bf75686-7337-4db6-8aa4-3ba7676d8850 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:56.431963 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1bf75686-7337-4db6-8aa4-3ba7676d8850 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:56.432768 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1bf75686-7337-4db6-8aa4-3ba7676d8850 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:56.433584 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1bf75686-7337-4db6-8aa4-3ba7676d8850 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:56.454929 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1bf75686-7337-4db6-8aa4-3ba7676d8850 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:56.513278 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:56.570608 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ac762664-e1f6-4597-9b10-2c11c6dc2212 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "POST /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.660984 Oct 18 15:46:56.574331 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2406/4800] 10.222.0.60 () {60 vars in 1323 bytes} [Tue Oct 18 15:46:55 2022] POST /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a/os-volume_attachments => generated 194 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:46:56.635103 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9561b7fe-b6fb-4fa8-ad2f-d19e677fa7fa tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:56.635836 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9561b7fe-b6fb-4fa8-ad2f-d19e677fa7fa tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 9d108fa0-49bb-46c2-a8b0-802c5835cb14] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:56.650513 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9561b7fe-b6fb-4fa8-ad2f-d19e677fa7fa tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:56.652474 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9561b7fe-b6fb-4fa8-ad2f-d19e677fa7fa tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:56.655584 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9561b7fe-b6fb-4fa8-ad2f-d19e677fa7fa tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:56.656802 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9561b7fe-b6fb-4fa8-ad2f-d19e677fa7fa tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:56.659368 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9561b7fe-b6fb-4fa8-ad2f-d19e677fa7fa tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:56.661664 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9561b7fe-b6fb-4fa8-ad2f-d19e677fa7fa tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:56.822272 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1bf75686-7337-4db6-8aa4-3ba7676d8850 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/84b7e841-8cd5-4554-bf61-e2076ee819a9" status: 200 len: 1653 microversion: 2.1 time: 0.407127 Oct 18 15:46:56.823947 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2395/4801] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:56 2022] GET /compute/v2.1/servers/84b7e841-8cd5-4554-bf61-e2076ee819a9 => generated 1653 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:56.829175 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2bd1f03b-178f-4d18-814c-9f0091c8de8d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:56.829979 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2bd1f03b-178f-4d18-814c-9f0091c8de8d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 5378eb2d-663e-4d1d-a113-64363d4f1dd9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:56.841927 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2bd1f03b-178f-4d18-814c-9f0091c8de8d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:56.843031 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2bd1f03b-178f-4d18-814c-9f0091c8de8d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:56.843680 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2bd1f03b-178f-4d18-814c-9f0091c8de8d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:56.844597 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2bd1f03b-178f-4d18-814c-9f0091c8de8d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:56.845307 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2bd1f03b-178f-4d18-814c-9f0091c8de8d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:56.846584 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2bd1f03b-178f-4d18-814c-9f0091c8de8d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:56.950988 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2bd1f03b-178f-4d18-814c-9f0091c8de8d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:56.953405 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9561b7fe-b6fb-4fa8-ad2f-d19e677fa7fa tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:56.963169 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9561b7fe-b6fb-4fa8-ad2f-d19e677fa7fa tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14" status: 200 len: 1516 microversion: 2.1 time: 0.335224 Oct 18 15:46:56.965231 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2bd1f03b-178f-4d18-814c-9f0091c8de8d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/5378eb2d-663e-4d1d-a113-64363d4f1dd9" status: 200 len: 1267 microversion: 2.1 time: 0.139911 Oct 18 15:46:56.968313 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2396/4802] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:56 2022] GET /compute/v2.1/servers/5378eb2d-663e-4d1d-a113-64363d4f1dd9 => generated 1267 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:56.981321 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2407/4803] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:56 2022] GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14 => generated 1516 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:46:57.847114 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2f4311f1-8b82-46f2-9048-3ea35f60daa4 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:57.847740 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2f4311f1-8b82-46f2-9048-3ea35f60daa4 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] [instance: 84b7e841-8cd5-4554-bf61-e2076ee819a9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:57.866090 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f4311f1-8b82-46f2-9048-3ea35f60daa4 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:57.866866 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f4311f1-8b82-46f2-9048-3ea35f60daa4 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:57.867840 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f4311f1-8b82-46f2-9048-3ea35f60daa4 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:57.869579 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f4311f1-8b82-46f2-9048-3ea35f60daa4 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:57.871363 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f4311f1-8b82-46f2-9048-3ea35f60daa4 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:57.873793 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f4311f1-8b82-46f2-9048-3ea35f60daa4 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:57.988875 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1acd948a-095d-42a8-8517-1409495d2d32 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:57.990476 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1acd948a-095d-42a8-8517-1409495d2d32 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 9d108fa0-49bb-46c2-a8b0-802c5835cb14] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:58.008016 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1acd948a-095d-42a8-8517-1409495d2d32 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:58.008016 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1acd948a-095d-42a8-8517-1409495d2d32 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:58.008016 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1acd948a-095d-42a8-8517-1409495d2d32 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:58.008016 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1acd948a-095d-42a8-8517-1409495d2d32 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:58.008349 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1acd948a-095d-42a8-8517-1409495d2d32 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:58.008639 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1acd948a-095d-42a8-8517-1409495d2d32 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:58.287071 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2f4311f1-8b82-46f2-9048-3ea35f60daa4 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/84b7e841-8cd5-4554-bf61-e2076ee819a9" status: 200 len: 1653 microversion: 2.1 time: 0.444674 Oct 18 15:46:58.287662 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2397/4804] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:57 2022] GET /compute/v2.1/servers/84b7e841-8cd5-4554-bf61-e2076ee819a9 => generated 1653 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:58.292273 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a19041b7-2a10-48b2-8d8b-4381a239828e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:58.309033 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a19041b7-2a10-48b2-8d8b-4381a239828e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 5378eb2d-663e-4d1d-a113-64363d4f1dd9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:58.322854 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a19041b7-2a10-48b2-8d8b-4381a239828e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:58.332527 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a19041b7-2a10-48b2-8d8b-4381a239828e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:58.333032 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a19041b7-2a10-48b2-8d8b-4381a239828e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:58.337702 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a19041b7-2a10-48b2-8d8b-4381a239828e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:58.338200 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a19041b7-2a10-48b2-8d8b-4381a239828e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:58.338638 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a19041b7-2a10-48b2-8d8b-4381a239828e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:58.536450 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1acd948a-095d-42a8-8517-1409495d2d32 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:58.548217 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1acd948a-095d-42a8-8517-1409495d2d32 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14" status: 200 len: 1516 microversion: 2.1 time: 0.563319 Oct 18 15:46:58.552244 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2408/4805] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:57 2022] GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14 => generated 1516 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:58.669200 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a19041b7-2a10-48b2-8d8b-4381a239828e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:46:58.679766 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a19041b7-2a10-48b2-8d8b-4381a239828e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/5378eb2d-663e-4d1d-a113-64363d4f1dd9" status: 200 len: 1273 microversion: 2.1 time: 0.390473 Oct 18 15:46:58.685195 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2398/4806] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:58 2022] GET /compute/v2.1/servers/5378eb2d-663e-4d1d-a113-64363d4f1dd9 => generated 1273 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:59.322771 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-72c09247-5540-4c41-b303-5dff19e12e11 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:59.332775 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-72c09247-5540-4c41-b303-5dff19e12e11 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] [instance: 84b7e841-8cd5-4554-bf61-e2076ee819a9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:59.343784 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-72c09247-5540-4c41-b303-5dff19e12e11 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:59.344440 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-72c09247-5540-4c41-b303-5dff19e12e11 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:59.345045 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-72c09247-5540-4c41-b303-5dff19e12e11 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:59.345990 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-72c09247-5540-4c41-b303-5dff19e12e11 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:59.347780 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-72c09247-5540-4c41-b303-5dff19e12e11 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:59.348494 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-72c09247-5540-4c41-b303-5dff19e12e11 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:59.578271 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3096cb56-22e9-4c22-a748-d25274400e5c tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:46:59.579599 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3096cb56-22e9-4c22-a748-d25274400e5c tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 9d108fa0-49bb-46c2-a8b0-802c5835cb14] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:46:59.604977 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3096cb56-22e9-4c22-a748-d25274400e5c tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:59.606901 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3096cb56-22e9-4c22-a748-d25274400e5c tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:59.607622 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3096cb56-22e9-4c22-a748-d25274400e5c tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:46:59.608797 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3096cb56-22e9-4c22-a748-d25274400e5c tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:46:59.610414 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3096cb56-22e9-4c22-a748-d25274400e5c tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:46:59.611647 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3096cb56-22e9-4c22-a748-d25274400e5c tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:00.932679 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-72c09247-5540-4c41-b303-5dff19e12e11 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/84b7e841-8cd5-4554-bf61-e2076ee819a9" status: 200 len: 1653 microversion: 2.1 time: 1.613524 Oct 18 15:47:00.933911 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2409/4807] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:59 2022] GET /compute/v2.1/servers/84b7e841-8cd5-4554-bf61-e2076ee819a9 => generated 1653 bytes in 1622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:00.960954 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9ff0000f-5dce-462f-afcd-131e7140c10f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:00.969005 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9ff0000f-5dce-462f-afcd-131e7140c10f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 5378eb2d-663e-4d1d-a113-64363d4f1dd9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:00.996634 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9ff0000f-5dce-462f-afcd-131e7140c10f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:01.001791 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9ff0000f-5dce-462f-afcd-131e7140c10f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:01.002672 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9ff0000f-5dce-462f-afcd-131e7140c10f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:01.005503 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9ff0000f-5dce-462f-afcd-131e7140c10f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:01.007840 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9ff0000f-5dce-462f-afcd-131e7140c10f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:01.012644 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9ff0000f-5dce-462f-afcd-131e7140c10f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:01.146580 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3096cb56-22e9-4c22-a748-d25274400e5c tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:01.158543 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3096cb56-22e9-4c22-a748-d25274400e5c tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14" status: 200 len: 1516 microversion: 2.1 time: 1.587776 Oct 18 15:47:01.162791 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2399/4808] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:46:59 2022] GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14 => generated 1516 bytes in 1593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:47:01.183249 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-aacd0a1d-1cc8-4465-a447-804436a3228c req-17a90cc0-fb9e-433a-91c0-df48e9da73f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84b7e841-8cd5-4554-bf61-e2076ee819a9", "name": "network-vif-deleted", "tag": "6781b44e-4894-41ec-941b-1a9d6af8944f"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:47:01.222359 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-aacd0a1d-1cc8-4465-a447-804436a3228c req-17a90cc0-fb9e-433a-91c0-df48e9da73f6 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:01.224472 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-aacd0a1d-1cc8-4465-a447-804436a3228c req-17a90cc0-fb9e-433a-91c0-df48e9da73f6 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:01.224951 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-aacd0a1d-1cc8-4465-a447-804436a3228c req-17a90cc0-fb9e-433a-91c0-df48e9da73f6 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:01.251079 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-aacd0a1d-1cc8-4465-a447-804436a3228c req-17a90cc0-fb9e-433a-91c0-df48e9da73f6 service nova] Creating event network-vif-deleted:6781b44e-4894-41ec-941b-1a9d6af8944f for instance 84b7e841-8cd5-4554-bf61-e2076ee819a9 on n-h1-853682-5 Oct 18 15:47:01.265746 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-aacd0a1d-1cc8-4465-a447-804436a3228c req-17a90cc0-fb9e-433a-91c0-df48e9da73f6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101120 Oct 18 15:47:01.267922 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2400/4809] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:47:01.567806 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9ff0000f-5dce-462f-afcd-131e7140c10f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:01.583873 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9ff0000f-5dce-462f-afcd-131e7140c10f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/5378eb2d-663e-4d1d-a113-64363d4f1dd9" status: 200 len: 1315 microversion: 2.1 time: 0.645122 Oct 18 15:47:01.585102 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2410/4810] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:00 2022] GET /compute/v2.1/servers/5378eb2d-663e-4d1d-a113-64363d4f1dd9 => generated 1315 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:01.967674 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9d70db40-f104-4f86-9fae-5164525d5f94 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:01.968615 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9d70db40-f104-4f86-9fae-5164525d5f94 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] [instance: 84b7e841-8cd5-4554-bf61-e2076ee819a9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:01.980118 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d70db40-f104-4f86-9fae-5164525d5f94 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:01.980619 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d70db40-f104-4f86-9fae-5164525d5f94 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:01.983033 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d70db40-f104-4f86-9fae-5164525d5f94 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:01.983829 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d70db40-f104-4f86-9fae-5164525d5f94 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:01.984315 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d70db40-f104-4f86-9fae-5164525d5f94 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:01.984755 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d70db40-f104-4f86-9fae-5164525d5f94 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:02.000698 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-9d70db40-f104-4f86-9fae-5164525d5f94 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] HTTP exception thrown: Instance 84b7e841-8cd5-4554-bf61-e2076ee819a9 could not be found. Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9d70db40-f104-4f86-9fae-5164525d5f94 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Request method failure captured: Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/84b7e841-8cd5-4554-bf61-e2076ee819a9 HTTP/1.1 Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTspAL8tYYSONfe5DTCiaBspd0Qk_ggwKk7yHzb7B8oHp91aoxLE54HhBEqE8xWt9GjAeqiqKZKS5RsH1Zp5mX-m59uZHjs5OmPsdN_tBuldAXanQ28JsYO1mhYgksCdJo78C2Y5TRL6fkyKm_QYpCf6rsHFmWHB4X6XmNUuaASI6Vs4 Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 57e1ed6dd4054683b164828361bf52da Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-TestServerMultinode-690466367 Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,admin,reader Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,admin,reader Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57e1ed6dd4054683b164828361bf52da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57e1ed6dd4054683b164828361bf52da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/57e1ed6dd4054683b164828361bf52da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_57e1ed6dd4054683b164828361bf52da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-TestServerMultinode-690466367 Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 57e1ed6dd4054683b164828361bf52da Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-TestServerMultinode-690466367 Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-TestServerMultinode-690466367-project-admin Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 724d2951ce1b427d923c7c22c0b32cf3 Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-TestServerMultinode-690466367-project-admin Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 84b7e841-8cd5-4554-bf61-e2076ee819a9 could not be found. Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '84b7e841-8cd5-4554-bf61-e2076ee819a9'} Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84b7e841-8cd5-4554-bf61-e2076ee819a9 could not be found. Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84b7e841-8cd5-4554-bf61-e2076ee819a9 could not be found. Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:47:02.002719 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:47:02.007864 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:47:02.007864 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:47:02.007864 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:47:02.007864 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:47:02.007864 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:47:02.007864 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84b7e841-8cd5-4554-bf61-e2076ee819a9 could not be found. Oct 18 15:47:02.007864 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:47:02.009816 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9d70db40-f104-4f86-9fae-5164525d5f94 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Returning 404 to user: Instance 84b7e841-8cd5-4554-bf61-e2076ee819a9 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:47:02.010912 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9d70db40-f104-4f86-9fae-5164525d5f94 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/84b7e841-8cd5-4554-bf61-e2076ee819a9" status: 404 len: 111 microversion: 2.1 time: 0.056079 Oct 18 15:47:02.015396 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2401/4811] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:01 2022] GET /compute/v2.1/servers/84b7e841-8cd5-4554-bf61-e2076ee819a9 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:47:02.020347 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3b704c68-ef34-4e86-a6c8-6ac5aa056084 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:02.020963 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3b704c68-ef34-4e86-a6c8-6ac5aa056084 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] [instance: 9807e0ee-bfbd-4a3d-8950-355027d9b1d3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:02.023931 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=98,nova_api:UPDATE=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:02.034560 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3b704c68-ef34-4e86-a6c8-6ac5aa056084 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:02.042837 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3b704c68-ef34-4e86-a6c8-6ac5aa056084 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:02.043623 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3b704c68-ef34-4e86-a6c8-6ac5aa056084 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:02.044396 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3b704c68-ef34-4e86-a6c8-6ac5aa056084 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:02.044970 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3b704c68-ef34-4e86-a6c8-6ac5aa056084 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:02.045469 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3b704c68-ef34-4e86-a6c8-6ac5aa056084 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:02.085648 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3b704c68-ef34-4e86-a6c8-6ac5aa056084 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] [instance: 9807e0ee-bfbd-4a3d-8950-355027d9b1d3] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:47:02.193966 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e16538a4-a222-4792-9a7d-048964863915 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:02.194977 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e16538a4-a222-4792-9a7d-048964863915 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 9d108fa0-49bb-46c2-a8b0-802c5835cb14] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:02.211843 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3b704c68-ef34-4e86-a6c8-6ac5aa056084 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] 10.222.0.60 "DELETE /compute/v2.1/servers/9807e0ee-bfbd-4a3d-8950-355027d9b1d3" status: 204 len: 0 microversion: 2.1 time: 0.194127 Oct 18 15:47:02.213682 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2411/4812] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:47:02 2022] DELETE /compute/v2.1/servers/9807e0ee-bfbd-4a3d-8950-355027d9b1d3 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:47:02.215710 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e16538a4-a222-4792-9a7d-048964863915 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:02.216151 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e16538a4-a222-4792-9a7d-048964863915 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:02.222432 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e16538a4-a222-4792-9a7d-048964863915 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:02.222614 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e16538a4-a222-4792-9a7d-048964863915 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:02.223098 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e16538a4-a222-4792-9a7d-048964863915 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:02.228079 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e16538a4-a222-4792-9a7d-048964863915 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:02.231137 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-30c9df3b-3eee-4e53-ae6c-f3bfba3815cb tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:02.232229 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-30c9df3b-3eee-4e53-ae6c-f3bfba3815cb tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] [instance: 9807e0ee-bfbd-4a3d-8950-355027d9b1d3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:02.247538 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-30c9df3b-3eee-4e53-ae6c-f3bfba3815cb tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:02.250974 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-30c9df3b-3eee-4e53-ae6c-f3bfba3815cb tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:02.251550 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-30c9df3b-3eee-4e53-ae6c-f3bfba3815cb tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:02.254821 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-30c9df3b-3eee-4e53-ae6c-f3bfba3815cb tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:02.255482 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-30c9df3b-3eee-4e53-ae6c-f3bfba3815cb tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:02.256018 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-30c9df3b-3eee-4e53-ae6c-f3bfba3815cb tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:02.630383 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e16538a4-a222-4792-9a7d-048964863915 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:02.655401 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e16538a4-a222-4792-9a7d-048964863915 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14" status: 200 len: 1516 microversion: 2.1 time: 0.465338 Oct 18 15:47:02.660212 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2402/4813] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:02 2022] GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14 => generated 1516 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:47:02.671943 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bc10bc50-99c0-4e78-b061-3596fba7cbdd tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:02.680691 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bc10bc50-99c0-4e78-b061-3596fba7cbdd tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 5378eb2d-663e-4d1d-a113-64363d4f1dd9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:02.703792 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc10bc50-99c0-4e78-b061-3596fba7cbdd tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:02.704944 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc10bc50-99c0-4e78-b061-3596fba7cbdd tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:02.705559 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc10bc50-99c0-4e78-b061-3596fba7cbdd tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:02.709673 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc10bc50-99c0-4e78-b061-3596fba7cbdd tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:02.711466 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc10bc50-99c0-4e78-b061-3596fba7cbdd tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:02.713679 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc10bc50-99c0-4e78-b061-3596fba7cbdd tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:02.731218 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-30c9df3b-3eee-4e53-ae6c-f3bfba3815cb tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/9807e0ee-bfbd-4a3d-8950-355027d9b1d3" status: 200 len: 1654 microversion: 2.1 time: 0.510879 Oct 18 15:47:02.733765 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2412/4814] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:02 2022] GET /compute/v2.1/servers/9807e0ee-bfbd-4a3d-8950-355027d9b1d3 => generated 1654 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:02.939242 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bc10bc50-99c0-4e78-b061-3596fba7cbdd tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:02.954650 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bc10bc50-99c0-4e78-b061-3596fba7cbdd tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/5378eb2d-663e-4d1d-a113-64363d4f1dd9" status: 200 len: 1315 microversion: 2.1 time: 0.286314 Oct 18 15:47:02.955671 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2403/4815] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:02 2022] GET /compute/v2.1/servers/5378eb2d-663e-4d1d-a113-64363d4f1dd9 => generated 1315 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:03.692285 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-28cddfba-918f-4483-83e4-491e349d8946 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:03.693591 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-28cddfba-918f-4483-83e4-491e349d8946 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 9d108fa0-49bb-46c2-a8b0-802c5835cb14] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:03.708211 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-28cddfba-918f-4483-83e4-491e349d8946 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:03.708715 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-28cddfba-918f-4483-83e4-491e349d8946 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:03.709198 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-28cddfba-918f-4483-83e4-491e349d8946 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:03.717753 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-28cddfba-918f-4483-83e4-491e349d8946 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:03.718871 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-28cddfba-918f-4483-83e4-491e349d8946 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:03.719919 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-28cddfba-918f-4483-83e4-491e349d8946 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:03.759606 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3b3c5cb0-e610-42d8-b523-125d03ed3d25 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:03.760195 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3b3c5cb0-e610-42d8-b523-125d03ed3d25 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] [instance: 9807e0ee-bfbd-4a3d-8950-355027d9b1d3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:03.779576 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b3c5cb0-e610-42d8-b523-125d03ed3d25 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:03.780318 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b3c5cb0-e610-42d8-b523-125d03ed3d25 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:03.781111 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b3c5cb0-e610-42d8-b523-125d03ed3d25 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:03.782296 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b3c5cb0-e610-42d8-b523-125d03ed3d25 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:03.782965 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b3c5cb0-e610-42d8-b523-125d03ed3d25 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:03.783617 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b3c5cb0-e610-42d8-b523-125d03ed3d25 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:04.420272 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-28cddfba-918f-4483-83e4-491e349d8946 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:04.430967 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-28cddfba-918f-4483-83e4-491e349d8946 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14" status: 200 len: 1516 microversion: 2.1 time: 0.748966 Oct 18 15:47:04.431302 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3b3c5cb0-e610-42d8-b523-125d03ed3d25 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/9807e0ee-bfbd-4a3d-8950-355027d9b1d3" status: 200 len: 1654 microversion: 2.1 time: 0.676041 Oct 18 15:47:04.433740 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2413/4816] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:03 2022] GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14 => generated 1516 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:04.450126 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f5d12a7c-5ceb-4bc9-910b-259d4de11447 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:04.450552 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f5d12a7c-5ceb-4bc9-910b-259d4de11447 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 5378eb2d-663e-4d1d-a113-64363d4f1dd9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:04.462706 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f5d12a7c-5ceb-4bc9-910b-259d4de11447 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:04.473633 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f5d12a7c-5ceb-4bc9-910b-259d4de11447 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:04.474271 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f5d12a7c-5ceb-4bc9-910b-259d4de11447 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:04.475145 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f5d12a7c-5ceb-4bc9-910b-259d4de11447 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:04.476357 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f5d12a7c-5ceb-4bc9-910b-259d4de11447 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:04.476357 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f5d12a7c-5ceb-4bc9-910b-259d4de11447 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:04.477769 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2404/4817] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:03 2022] GET /compute/v2.1/servers/9807e0ee-bfbd-4a3d-8950-355027d9b1d3 => generated 1654 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:47:04.513692 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-f7791f26-6581-4bc3-a112-697461f6a4ef req-da1b8844-e351-4c26-a426-f8f441195755 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5378eb2d-663e-4d1d-a113-64363d4f1dd9", "tag": "747cbe5b-6f12-4c7f-88b6-e3e8249fa1e5"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:47:04.543364 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f7791f26-6581-4bc3-a112-697461f6a4ef req-da1b8844-e351-4c26-a426-f8f441195755 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:04.544233 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f7791f26-6581-4bc3-a112-697461f6a4ef req-da1b8844-e351-4c26-a426-f8f441195755 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:04.545043 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f7791f26-6581-4bc3-a112-697461f6a4ef req-da1b8844-e351-4c26-a426-f8f441195755 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:04.566587 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-f7791f26-6581-4bc3-a112-697461f6a4ef req-da1b8844-e351-4c26-a426-f8f441195755 service nova] Creating event network-changed:747cbe5b-6f12-4c7f-88b6-e3e8249fa1e5 for instance 5378eb2d-663e-4d1d-a113-64363d4f1dd9 on n-h2-853682-5 Oct 18 15:47:04.582012 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-f7791f26-6581-4bc3-a112-697461f6a4ef req-da1b8844-e351-4c26-a426-f8f441195755 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099716 Oct 18 15:47:04.583276 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2405/4818] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:47:04.919879 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f5d12a7c-5ceb-4bc9-910b-259d4de11447 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:04.944420 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f5d12a7c-5ceb-4bc9-910b-259d4de11447 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/5378eb2d-663e-4d1d-a113-64363d4f1dd9" status: 200 len: 1315 microversion: 2.1 time: 0.502021 Oct 18 15:47:04.949997 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2414/4819] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:04 2022] GET /compute/v2.1/servers/5378eb2d-663e-4d1d-a113-64363d4f1dd9 => generated 1315 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:05.128117 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-0c962afc-85ec-4b09-b794-f3e0460fa58b req-57a8e096-2f83-481f-93dc-936e6a207b25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9807e0ee-bfbd-4a3d-8950-355027d9b1d3", "name": "network-vif-deleted", "tag": "04c37d0b-ecbb-4eaa-ab82-c191fc26ceda"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:47:05.147357 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:05.148459 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:05.155333 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0c962afc-85ec-4b09-b794-f3e0460fa58b req-57a8e096-2f83-481f-93dc-936e6a207b25 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:05.155906 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0c962afc-85ec-4b09-b794-f3e0460fa58b req-57a8e096-2f83-481f-93dc-936e6a207b25 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:05.156607 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0c962afc-85ec-4b09-b794-f3e0460fa58b req-57a8e096-2f83-481f-93dc-936e6a207b25 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:05.188769 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-0c962afc-85ec-4b09-b794-f3e0460fa58b req-57a8e096-2f83-481f-93dc-936e6a207b25 service nova] Creating event network-vif-deleted:04c37d0b-ecbb-4eaa-ab82-c191fc26ceda for instance 9807e0ee-bfbd-4a3d-8950-355027d9b1d3 on n-h2-853682-5 Oct 18 15:47:05.205863 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-0c962afc-85ec-4b09-b794-f3e0460fa58b req-57a8e096-2f83-481f-93dc-936e6a207b25 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081869 Oct 18 15:47:05.206572 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2406/4820] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:47:05.473966 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0a3d47e8-0058-4cb3-bac8-b5157a2f676b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:05.474936 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0a3d47e8-0058-4cb3-bac8-b5157a2f676b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 9d108fa0-49bb-46c2-a8b0-802c5835cb14] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:05.490389 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0a3d47e8-0058-4cb3-bac8-b5157a2f676b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:05.501127 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0a3d47e8-0058-4cb3-bac8-b5157a2f676b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:05.501793 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0a3d47e8-0058-4cb3-bac8-b5157a2f676b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:05.507392 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0a3d47e8-0058-4cb3-bac8-b5157a2f676b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:05.507906 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0a3d47e8-0058-4cb3-bac8-b5157a2f676b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:05.508405 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0a3d47e8-0058-4cb3-bac8-b5157a2f676b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:05.606186 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-223db877-f288-4e47-8964-149baa8d97e8 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:05.606890 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-223db877-f288-4e47-8964-149baa8d97e8 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] [instance: 9807e0ee-bfbd-4a3d-8950-355027d9b1d3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:05.620571 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-223db877-f288-4e47-8964-149baa8d97e8 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:05.621407 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-223db877-f288-4e47-8964-149baa8d97e8 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:05.622001 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-223db877-f288-4e47-8964-149baa8d97e8 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:05.624543 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-223db877-f288-4e47-8964-149baa8d97e8 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:05.625220 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-223db877-f288-4e47-8964-149baa8d97e8 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:05.625812 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-223db877-f288-4e47-8964-149baa8d97e8 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:05.699126 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-223db877-f288-4e47-8964-149baa8d97e8 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:05.700972 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-223db877-f288-4e47-8964-149baa8d97e8 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:05.704257 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-223db877-f288-4e47-8964-149baa8d97e8 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:05.704685 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-223db877-f288-4e47-8964-149baa8d97e8 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lazy-loading 'fault' on Instance uuid 9807e0ee-bfbd-4a3d-8950-355027d9b1d3 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:47:05.776841 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:05.911731 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-223db877-f288-4e47-8964-149baa8d97e8 tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/9807e0ee-bfbd-4a3d-8950-355027d9b1d3" status: 200 len: 1454 microversion: 2.1 time: 0.305851 Oct 18 15:47:05.912408 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2407/4821] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:05 2022] GET /compute/v2.1/servers/9807e0ee-bfbd-4a3d-8950-355027d9b1d3 => generated 1454 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:47:05.974729 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c5ef0bc5-5166-4049-8837-4fb6e60cd237 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:05.975533 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c5ef0bc5-5166-4049-8837-4fb6e60cd237 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 5378eb2d-663e-4d1d-a113-64363d4f1dd9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:05.986426 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5ef0bc5-5166-4049-8837-4fb6e60cd237 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:05.986959 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5ef0bc5-5166-4049-8837-4fb6e60cd237 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:05.987412 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5ef0bc5-5166-4049-8837-4fb6e60cd237 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:05.988148 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5ef0bc5-5166-4049-8837-4fb6e60cd237 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:05.994569 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5ef0bc5-5166-4049-8837-4fb6e60cd237 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:05.995502 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5ef0bc5-5166-4049-8837-4fb6e60cd237 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:06.249739 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0a3d47e8-0058-4cb3-bac8-b5157a2f676b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:06.263464 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:06.276525 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0a3d47e8-0058-4cb3-bac8-b5157a2f676b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14" status: 200 len: 1516 microversion: 2.1 time: 0.813678 Oct 18 15:47:06.277848 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2415/4822] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:05 2022] GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14 => generated 1516 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:06.675565 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c5ef0bc5-5166-4049-8837-4fb6e60cd237 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:06.685314 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c5ef0bc5-5166-4049-8837-4fb6e60cd237 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/5378eb2d-663e-4d1d-a113-64363d4f1dd9" status: 200 len: 1315 microversion: 2.1 time: 0.714945 Oct 18 15:47:06.686474 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2408/4823] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:05 2022] GET /compute/v2.1/servers/5378eb2d-663e-4d1d-a113-64363d4f1dd9 => generated 1315 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:06.938597 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5e4a4922-b850-48f2-b533-1f40c6b5472a tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:06.939512 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5e4a4922-b850-48f2-b533-1f40c6b5472a tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] [instance: 9807e0ee-bfbd-4a3d-8950-355027d9b1d3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:06.948067 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5e4a4922-b850-48f2-b533-1f40c6b5472a tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:06.948952 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5e4a4922-b850-48f2-b533-1f40c6b5472a tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:06.949588 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5e4a4922-b850-48f2-b533-1f40c6b5472a tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:06.950482 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5e4a4922-b850-48f2-b533-1f40c6b5472a tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:06.951106 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5e4a4922-b850-48f2-b533-1f40c6b5472a tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:06.951699 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5e4a4922-b850-48f2-b533-1f40c6b5472a tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:06.972652 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-5e4a4922-b850-48f2-b533-1f40c6b5472a tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] HTTP exception thrown: Instance 9807e0ee-bfbd-4a3d-8950-355027d9b1d3 could not be found. Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5e4a4922-b850-48f2-b533-1f40c6b5472a tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Request method failure captured: Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/9807e0ee-bfbd-4a3d-8950-355027d9b1d3 HTTP/1.1 Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTspAL8tYYSONfe5DTCiaBspd0Qk_ggwKk7yHzb7B8oHp91aoxLE54HhBEqE8xWt9GjAeqiqKZKS5RsH1Zp5mX-m59uZHjs5OmPsdN_tBuldAXanQ28JsYO1mhYgksCdJo78C2Y5TRL6fkyKm_QYpCf6rsHFmWHB4X6XmNUuaASI6Vs4 Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 57e1ed6dd4054683b164828361bf52da Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-TestServerMultinode-690466367 Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,admin,reader Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,admin,reader Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57e1ed6dd4054683b164828361bf52da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57e1ed6dd4054683b164828361bf52da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/57e1ed6dd4054683b164828361bf52da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_57e1ed6dd4054683b164828361bf52da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-TestServerMultinode-690466367 Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 57e1ed6dd4054683b164828361bf52da Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-TestServerMultinode-690466367 Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-TestServerMultinode-690466367-project-admin Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 724d2951ce1b427d923c7c22c0b32cf3 Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-TestServerMultinode-690466367-project-admin Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 9807e0ee-bfbd-4a3d-8950-355027d9b1d3 could not be found. Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '9807e0ee-bfbd-4a3d-8950-355027d9b1d3'} Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9807e0ee-bfbd-4a3d-8950-355027d9b1d3 could not be found. Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9807e0ee-bfbd-4a3d-8950-355027d9b1d3 could not be found. Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:47:06.975427 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:47:06.980954 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:47:06.980954 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:47:06.980954 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:47:06.980954 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:47:06.980954 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:47:06.980954 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9807e0ee-bfbd-4a3d-8950-355027d9b1d3 could not be found. Oct 18 15:47:06.980954 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:47:06.983362 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5e4a4922-b850-48f2-b533-1f40c6b5472a tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] Returning 404 to user: Instance 9807e0ee-bfbd-4a3d-8950-355027d9b1d3 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:47:06.985219 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5e4a4922-b850-48f2-b533-1f40c6b5472a tempest-TestServerMultinode-690466367 tempest-TestServerMultinode-690466367-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/9807e0ee-bfbd-4a3d-8950-355027d9b1d3" status: 404 len: 111 microversion: 2.1 time: 0.050958 Oct 18 15:47:06.986158 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2416/4824] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:06 2022] GET /compute/v2.1/servers/9807e0ee-bfbd-4a3d-8950-355027d9b1d3 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:47:07.299698 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f882b192-f445-40a0-81b5-1f470693143b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:07.300502 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f882b192-f445-40a0-81b5-1f470693143b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 9d108fa0-49bb-46c2-a8b0-802c5835cb14] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:07.311268 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f882b192-f445-40a0-81b5-1f470693143b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:07.313280 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f882b192-f445-40a0-81b5-1f470693143b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:07.316066 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f882b192-f445-40a0-81b5-1f470693143b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:07.317169 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f882b192-f445-40a0-81b5-1f470693143b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:07.319681 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f882b192-f445-40a0-81b5-1f470693143b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:07.320418 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f882b192-f445-40a0-81b5-1f470693143b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:07.707841 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6643b8c6-57e5-4df9-aa4a-843ac5f52a80 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:07.709103 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6643b8c6-57e5-4df9-aa4a-843ac5f52a80 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 5378eb2d-663e-4d1d-a113-64363d4f1dd9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:07.718234 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6643b8c6-57e5-4df9-aa4a-843ac5f52a80 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:07.719165 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6643b8c6-57e5-4df9-aa4a-843ac5f52a80 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:07.719800 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6643b8c6-57e5-4df9-aa4a-843ac5f52a80 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:07.720711 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6643b8c6-57e5-4df9-aa4a-843ac5f52a80 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:07.721305 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6643b8c6-57e5-4df9-aa4a-843ac5f52a80 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:07.721810 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6643b8c6-57e5-4df9-aa4a-843ac5f52a80 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:07.803830 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f882b192-f445-40a0-81b5-1f470693143b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:07.818325 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f882b192-f445-40a0-81b5-1f470693143b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14" status: 200 len: 1522 microversion: 2.1 time: 0.522465 Oct 18 15:47:07.820127 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2409/4825] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:07 2022] GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14 => generated 1522 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:08.311189 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6643b8c6-57e5-4df9-aa4a-843ac5f52a80 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:08.322379 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6643b8c6-57e5-4df9-aa4a-843ac5f52a80 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/5378eb2d-663e-4d1d-a113-64363d4f1dd9" status: 200 len: 1315 microversion: 2.1 time: 0.618730 Oct 18 15:47:08.323929 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2417/4826] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:07 2022] GET /compute/v2.1/servers/5378eb2d-663e-4d1d-a113-64363d4f1dd9 => generated 1315 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:08.847669 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-927e1c70-96a9-49e2-9599-7a547b7832b1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:08.849634 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-927e1c70-96a9-49e2-9599-7a547b7832b1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 9d108fa0-49bb-46c2-a8b0-802c5835cb14] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:08.880048 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-927e1c70-96a9-49e2-9599-7a547b7832b1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:08.881239 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-927e1c70-96a9-49e2-9599-7a547b7832b1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:08.881938 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-927e1c70-96a9-49e2-9599-7a547b7832b1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:08.883117 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-927e1c70-96a9-49e2-9599-7a547b7832b1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:08.884275 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-927e1c70-96a9-49e2-9599-7a547b7832b1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:08.885022 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-927e1c70-96a9-49e2-9599-7a547b7832b1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:09.351132 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-47d41272-2b30-4610-abfc-42c66eece8d2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:09.352036 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-47d41272-2b30-4610-abfc-42c66eece8d2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 5378eb2d-663e-4d1d-a113-64363d4f1dd9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:09.369272 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-47d41272-2b30-4610-abfc-42c66eece8d2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:09.369587 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-47d41272-2b30-4610-abfc-42c66eece8d2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:09.371455 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-47d41272-2b30-4610-abfc-42c66eece8d2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:09.372629 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-47d41272-2b30-4610-abfc-42c66eece8d2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:09.374040 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-47d41272-2b30-4610-abfc-42c66eece8d2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:09.376153 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-47d41272-2b30-4610-abfc-42c66eece8d2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:09.564913 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-927e1c70-96a9-49e2-9599-7a547b7832b1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:09.577477 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-927e1c70-96a9-49e2-9599-7a547b7832b1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14" status: 200 len: 1522 microversion: 2.1 time: 0.736418 Oct 18 15:47:09.581222 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2410/4827] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:08 2022] GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14 => generated 1522 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:09.752883 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-47d41272-2b30-4610-abfc-42c66eece8d2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:09.765555 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-47d41272-2b30-4610-abfc-42c66eece8d2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/5378eb2d-663e-4d1d-a113-64363d4f1dd9" status: 200 len: 1315 microversion: 2.1 time: 0.423168 Oct 18 15:47:09.772555 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2418/4828] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:09 2022] GET /compute/v2.1/servers/5378eb2d-663e-4d1d-a113-64363d4f1dd9 => generated 1315 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:10.607956 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dfe5daef-52d2-40bc-8a2c-5f01497d004d tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:10.609620 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dfe5daef-52d2-40bc-8a2c-5f01497d004d tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 9d108fa0-49bb-46c2-a8b0-802c5835cb14] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:10.626561 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfe5daef-52d2-40bc-8a2c-5f01497d004d tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:10.627329 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfe5daef-52d2-40bc-8a2c-5f01497d004d tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:10.628534 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfe5daef-52d2-40bc-8a2c-5f01497d004d tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:10.629811 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfe5daef-52d2-40bc-8a2c-5f01497d004d tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:10.637598 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfe5daef-52d2-40bc-8a2c-5f01497d004d tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:10.638357 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfe5daef-52d2-40bc-8a2c-5f01497d004d tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:10.797679 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-dc6d1b74-0e30-4749-95fe-57d83aa987d9 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:10.798929 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-dc6d1b74-0e30-4749-95fe-57d83aa987d9 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 5378eb2d-663e-4d1d-a113-64363d4f1dd9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:10.813392 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dc6d1b74-0e30-4749-95fe-57d83aa987d9 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:10.814189 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dc6d1b74-0e30-4749-95fe-57d83aa987d9 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:10.814816 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dc6d1b74-0e30-4749-95fe-57d83aa987d9 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:10.815702 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dc6d1b74-0e30-4749-95fe-57d83aa987d9 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:10.816329 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dc6d1b74-0e30-4749-95fe-57d83aa987d9 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:10.818375 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dc6d1b74-0e30-4749-95fe-57d83aa987d9 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:11.287100 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dfe5daef-52d2-40bc-8a2c-5f01497d004d tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:11.308498 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dfe5daef-52d2-40bc-8a2c-5f01497d004d tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14" status: 200 len: 1522 microversion: 2.1 time: 0.704236 Oct 18 15:47:11.316694 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2411/4829] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:10 2022] GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14 => generated 1522 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:11.324523 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-b2115c66-7380-4a13-9c5e-da65ac2a807d req-cb5753b2-8853-410f-b820-082c5b2002f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d108fa0-49bb-46c2-a8b0-802c5835cb14", "name": "network-vif-unplugged", "status": "completed", "tag": "415f8632-c892-4860-89a6-5fddaeb68947"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:47:11.350308 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b2115c66-7380-4a13-9c5e-da65ac2a807d req-cb5753b2-8853-410f-b820-082c5b2002f0 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:11.354057 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b2115c66-7380-4a13-9c5e-da65ac2a807d req-cb5753b2-8853-410f-b820-082c5b2002f0 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:11.354938 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b2115c66-7380-4a13-9c5e-da65ac2a807d req-cb5753b2-8853-410f-b820-082c5b2002f0 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:11.388739 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-b2115c66-7380-4a13-9c5e-da65ac2a807d req-cb5753b2-8853-410f-b820-082c5b2002f0 service nova] Creating event network-vif-unplugged:415f8632-c892-4860-89a6-5fddaeb68947 for instance 9d108fa0-49bb-46c2-a8b0-802c5835cb14 on n-h1-853682-5 Oct 18 15:47:11.401569 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-b2115c66-7380-4a13-9c5e-da65ac2a807d req-cb5753b2-8853-410f-b820-082c5b2002f0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078147 Oct 18 15:47:11.404969 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2412/4830] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:47:11.588203 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-dc6d1b74-0e30-4749-95fe-57d83aa987d9 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:11.598851 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-dc6d1b74-0e30-4749-95fe-57d83aa987d9 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/5378eb2d-663e-4d1d-a113-64363d4f1dd9" status: 200 len: 1315 microversion: 2.1 time: 0.805493 Oct 18 15:47:11.621825 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2419/4831] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:10 2022] GET /compute/v2.1/servers/5378eb2d-663e-4d1d-a113-64363d4f1dd9 => generated 1315 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:11.789628 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2360f7c6-adc3-4e96-b6aa-5837e7a6e9dc tempest-ExtensionsTest-108127464 tempest-ExtensionsTest-108127464-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:11.791410 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2360f7c6-adc3-4e96-b6aa-5837e7a6e9dc tempest-ExtensionsTest-108127464 tempest-ExtensionsTest-108127464-project] 10.222.0.60 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.382346 Oct 18 15:47:11.792050 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2413/4832] 10.222.0.60 () {58 vars in 1170 bytes} [Tue Oct 18 15:47:11 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:47:11.803174 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ae7c72a7-04a7-4c98-be54-315c10feb2fc tempest-ExtensionsTest-108127464 tempest-ExtensionsTest-108127464-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:11.807407 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ae7c72a7-04a7-4c98-be54-315c10feb2fc tempest-ExtensionsTest-108127464 tempest-ExtensionsTest-108127464-project] 10.222.0.60 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.010088 Oct 18 15:47:11.808884 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2420/4833] 10.222.0.60 () {58 vars in 1134 bytes} [Tue Oct 18 15:47:11 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:47:12.348792 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-23526e3d-5a80-4aa0-9353-1d6c420d5fe1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:12.349572 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-23526e3d-5a80-4aa0-9353-1d6c420d5fe1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 9d108fa0-49bb-46c2-a8b0-802c5835cb14] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:12.367967 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23526e3d-5a80-4aa0-9353-1d6c420d5fe1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:12.372181 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23526e3d-5a80-4aa0-9353-1d6c420d5fe1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:12.373285 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23526e3d-5a80-4aa0-9353-1d6c420d5fe1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:12.376527 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23526e3d-5a80-4aa0-9353-1d6c420d5fe1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:12.377707 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23526e3d-5a80-4aa0-9353-1d6c420d5fe1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:12.379406 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23526e3d-5a80-4aa0-9353-1d6c420d5fe1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:12.582882 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c6291488-6a04-4cc6-b04a-7c093a0583bc tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:47:12.586706 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c6291488-6a04-4cc6-b04a-7c093a0583bc tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 5e83c779-c8f8-4ebd-84ab-7f144ab8552a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:12.606177 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c6291488-6a04-4cc6-b04a-7c093a0583bc tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:12.606590 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c6291488-6a04-4cc6-b04a-7c093a0583bc tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:12.625350 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c6291488-6a04-4cc6-b04a-7c093a0583bc tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:12.630835 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c6291488-6a04-4cc6-b04a-7c093a0583bc tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:12.631574 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c6291488-6a04-4cc6-b04a-7c093a0583bc tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:12.634479 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c6291488-6a04-4cc6-b04a-7c093a0583bc tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:12.715241 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-c6291488-6a04-4cc6-b04a-7c093a0583bc tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lazy-loading 'flavor' on Instance uuid 5e83c779-c8f8-4ebd-84ab-7f144ab8552a {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:47:13.043752 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c6291488-6a04-4cc6-b04a-7c093a0583bc tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "POST /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a/action" status: 200 len: 32 microversion: 2.1 time: 0.465464 Oct 18 15:47:13.046174 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2421/4834] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:47:12 2022] POST /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a/action => generated 32 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:47:13.082804 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-542a0adc-e531-45ce-a84b-f98d714074b3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:13.085666 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-542a0adc-e531-45ce-a84b-f98d714074b3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 5378eb2d-663e-4d1d-a113-64363d4f1dd9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:13.098034 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-542a0adc-e531-45ce-a84b-f98d714074b3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:13.100271 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-542a0adc-e531-45ce-a84b-f98d714074b3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:13.103838 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-542a0adc-e531-45ce-a84b-f98d714074b3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:13.106205 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-542a0adc-e531-45ce-a84b-f98d714074b3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:13.107038 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-542a0adc-e531-45ce-a84b-f98d714074b3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:13.107709 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-542a0adc-e531-45ce-a84b-f98d714074b3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:13.502369 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-23526e3d-5a80-4aa0-9353-1d6c420d5fe1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:13.516492 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-23526e3d-5a80-4aa0-9353-1d6c420d5fe1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14" status: 200 len: 1522 microversion: 2.1 time: 1.172958 Oct 18 15:47:13.521069 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2414/4835] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:12 2022] GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14 => generated 1522 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:13.545877 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dce5fad6-72ed-4af3-9004-37bed48686dd tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:13.546589 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dce5fad6-72ed-4af3-9004-37bed48686dd tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 5e83c779-c8f8-4ebd-84ab-7f144ab8552a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:13.568595 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dce5fad6-72ed-4af3-9004-37bed48686dd tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:13.569256 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dce5fad6-72ed-4af3-9004-37bed48686dd tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:13.576054 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dce5fad6-72ed-4af3-9004-37bed48686dd tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:13.582309 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dce5fad6-72ed-4af3-9004-37bed48686dd tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:13.582816 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dce5fad6-72ed-4af3-9004-37bed48686dd tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:13.586698 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dce5fad6-72ed-4af3-9004-37bed48686dd tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:13.636432 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-542a0adc-e531-45ce-a84b-f98d714074b3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:13.644526 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-542a0adc-e531-45ce-a84b-f98d714074b3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/5378eb2d-663e-4d1d-a113-64363d4f1dd9" status: 200 len: 1315 microversion: 2.1 time: 0.581604 Oct 18 15:47:13.645153 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2422/4836] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:13 2022] GET /compute/v2.1/servers/5378eb2d-663e-4d1d-a113-64363d4f1dd9 => generated 1315 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:14.544222 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-16b8382f-2ead-4e9e-b0ee-e74f7be1eaad tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:14.545660 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-16b8382f-2ead-4e9e-b0ee-e74f7be1eaad tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 9d108fa0-49bb-46c2-a8b0-802c5835cb14] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:14.560783 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-16b8382f-2ead-4e9e-b0ee-e74f7be1eaad tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:14.561654 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-16b8382f-2ead-4e9e-b0ee-e74f7be1eaad tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:14.563575 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-16b8382f-2ead-4e9e-b0ee-e74f7be1eaad tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:14.564517 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-16b8382f-2ead-4e9e-b0ee-e74f7be1eaad tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:14.566251 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-16b8382f-2ead-4e9e-b0ee-e74f7be1eaad tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:14.567394 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-16b8382f-2ead-4e9e-b0ee-e74f7be1eaad tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:14.689448 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dce5fad6-72ed-4af3-9004-37bed48686dd tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:14.699290 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:14.714540 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dce5fad6-72ed-4af3-9004-37bed48686dd tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a" status: 200 len: 1736 microversion: 2.1 time: 1.188210 Oct 18 15:47:14.716471 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2415/4837] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:13 2022] GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a => generated 1736 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:14.729313 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-db4b3a02-0794-4637-955b-c79e8c02ff43 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:14.730642 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-db4b3a02-0794-4637-955b-c79e8c02ff43 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 5378eb2d-663e-4d1d-a113-64363d4f1dd9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:14.753706 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db4b3a02-0794-4637-955b-c79e8c02ff43 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:14.755045 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db4b3a02-0794-4637-955b-c79e8c02ff43 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:14.755524 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db4b3a02-0794-4637-955b-c79e8c02ff43 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:14.760906 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db4b3a02-0794-4637-955b-c79e8c02ff43 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:14.762774 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db4b3a02-0794-4637-955b-c79e8c02ff43 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:14.764238 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db4b3a02-0794-4637-955b-c79e8c02ff43 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:15.342916 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-16b8382f-2ead-4e9e-b0ee-e74f7be1eaad tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:15.352964 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-16b8382f-2ead-4e9e-b0ee-e74f7be1eaad tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14" status: 200 len: 1522 microversion: 2.1 time: 0.812524 Oct 18 15:47:15.353126 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-db4b3a02-0794-4637-955b-c79e8c02ff43 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:15.360374 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2423/4838] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:14 2022] GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14 => generated 1522 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:47:15.389124 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-db4b3a02-0794-4637-955b-c79e8c02ff43 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/5378eb2d-663e-4d1d-a113-64363d4f1dd9" status: 200 len: 1315 microversion: 2.1 time: 0.670599 Oct 18 15:47:15.407338 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2416/4839] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:14 2022] GET /compute/v2.1/servers/5378eb2d-663e-4d1d-a113-64363d4f1dd9 => generated 1315 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:15.742538 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-139c582f-55cd-4fd5-9930-d4cd45b0a87c tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:15.743937 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-139c582f-55cd-4fd5-9930-d4cd45b0a87c tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 5e83c779-c8f8-4ebd-84ab-7f144ab8552a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:15.758923 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-139c582f-55cd-4fd5-9930-d4cd45b0a87c tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:15.760776 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-139c582f-55cd-4fd5-9930-d4cd45b0a87c tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:15.764921 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-139c582f-55cd-4fd5-9930-d4cd45b0a87c tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:15.766630 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-139c582f-55cd-4fd5-9930-d4cd45b0a87c tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:15.767355 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-139c582f-55cd-4fd5-9930-d4cd45b0a87c tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:15.768027 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-139c582f-55cd-4fd5-9930-d4cd45b0a87c tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:15.884191 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-2d17b76f-2538-4415-8d2c-fa51e9d4fc31 req-a102b374-1a14-4960-affd-08fce72da8f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5378eb2d-663e-4d1d-a113-64363d4f1dd9", "name": "network-vif-plugged", "status": "completed", "tag": "747cbe5b-6f12-4c7f-88b6-e3e8249fa1e5"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:47:15.907288 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2d17b76f-2538-4415-8d2c-fa51e9d4fc31 req-a102b374-1a14-4960-affd-08fce72da8f1 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:15.907771 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2d17b76f-2538-4415-8d2c-fa51e9d4fc31 req-a102b374-1a14-4960-affd-08fce72da8f1 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:15.908189 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2d17b76f-2538-4415-8d2c-fa51e9d4fc31 req-a102b374-1a14-4960-affd-08fce72da8f1 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:15.951898 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-2d17b76f-2538-4415-8d2c-fa51e9d4fc31 req-a102b374-1a14-4960-affd-08fce72da8f1 service nova] Creating event network-vif-plugged:747cbe5b-6f12-4c7f-88b6-e3e8249fa1e5 for instance 5378eb2d-663e-4d1d-a113-64363d4f1dd9 on n-h2-853682-5 Oct 18 15:47:15.966727 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-2d17b76f-2538-4415-8d2c-fa51e9d4fc31 req-a102b374-1a14-4960-affd-08fce72da8f1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089430 Oct 18 15:47:15.980090 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2417/4840] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:47:16.387133 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4bafc207-4f47-40c3-a10b-3be5d4a51424 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:16.387844 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4bafc207-4f47-40c3-a10b-3be5d4a51424 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 9d108fa0-49bb-46c2-a8b0-802c5835cb14] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:16.423413 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4bafc207-4f47-40c3-a10b-3be5d4a51424 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:16.427800 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4bafc207-4f47-40c3-a10b-3be5d4a51424 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:16.428429 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4bafc207-4f47-40c3-a10b-3be5d4a51424 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:16.431648 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4bafc207-4f47-40c3-a10b-3be5d4a51424 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:16.432349 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4bafc207-4f47-40c3-a10b-3be5d4a51424 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:16.436684 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4bafc207-4f47-40c3-a10b-3be5d4a51424 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:16.503029 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-139c582f-55cd-4fd5-9930-d4cd45b0a87c tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:16.518291 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-139c582f-55cd-4fd5-9930-d4cd45b0a87c tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a" status: 200 len: 1736 microversion: 2.1 time: 0.780322 Oct 18 15:47:16.521786 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2424/4841] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:15 2022] GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a => generated 1736 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:16.534590 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-850ca604-18ae-46a8-8376-239442fe0920 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:16.540475 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-850ca604-18ae-46a8-8376-239442fe0920 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 5378eb2d-663e-4d1d-a113-64363d4f1dd9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:16.558509 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-850ca604-18ae-46a8-8376-239442fe0920 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:16.559014 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-850ca604-18ae-46a8-8376-239442fe0920 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:16.560540 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-850ca604-18ae-46a8-8376-239442fe0920 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:16.561376 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-850ca604-18ae-46a8-8376-239442fe0920 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:16.561845 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-850ca604-18ae-46a8-8376-239442fe0920 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:16.562275 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-850ca604-18ae-46a8-8376-239442fe0920 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:17.296434 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4bafc207-4f47-40c3-a10b-3be5d4a51424 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:17.308294 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4bafc207-4f47-40c3-a10b-3be5d4a51424 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14" status: 200 len: 1522 microversion: 2.1 time: 0.926221 Oct 18 15:47:17.311744 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2418/4842] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:16 2022] GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14 => generated 1522 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:17.486523 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-850ca604-18ae-46a8-8376-239442fe0920 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:17.498207 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-850ca604-18ae-46a8-8376-239442fe0920 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/5378eb2d-663e-4d1d-a113-64363d4f1dd9" status: 200 len: 1315 microversion: 2.1 time: 0.972562 Oct 18 15:47:17.499545 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2425/4843] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:16 2022] GET /compute/v2.1/servers/5378eb2d-663e-4d1d-a113-64363d4f1dd9 => generated 1315 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:17.550361 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e08f7716-fe10-4e0b-a07f-4b56c11ad394 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:17.550991 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e08f7716-fe10-4e0b-a07f-4b56c11ad394 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 5e83c779-c8f8-4ebd-84ab-7f144ab8552a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:17.563492 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e08f7716-fe10-4e0b-a07f-4b56c11ad394 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:17.565612 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e08f7716-fe10-4e0b-a07f-4b56c11ad394 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:17.566332 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e08f7716-fe10-4e0b-a07f-4b56c11ad394 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:17.567547 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e08f7716-fe10-4e0b-a07f-4b56c11ad394 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:17.573416 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e08f7716-fe10-4e0b-a07f-4b56c11ad394 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:17.574339 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e08f7716-fe10-4e0b-a07f-4b56c11ad394 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:18.342210 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2cc8ccba-64e8-4174-9477-81b0c3338b1e tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:18.342837 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2cc8ccba-64e8-4174-9477-81b0c3338b1e tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 9d108fa0-49bb-46c2-a8b0-802c5835cb14] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:18.361424 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2cc8ccba-64e8-4174-9477-81b0c3338b1e tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:18.361925 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2cc8ccba-64e8-4174-9477-81b0c3338b1e tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:18.362370 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2cc8ccba-64e8-4174-9477-81b0c3338b1e tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:18.372359 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2cc8ccba-64e8-4174-9477-81b0c3338b1e tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:18.372970 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2cc8ccba-64e8-4174-9477-81b0c3338b1e tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:18.373437 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2cc8ccba-64e8-4174-9477-81b0c3338b1e tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:18.509309 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e08f7716-fe10-4e0b-a07f-4b56c11ad394 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:18.525462 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e08f7716-fe10-4e0b-a07f-4b56c11ad394 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a" status: 200 len: 1736 microversion: 2.1 time: 0.976373 Oct 18 15:47:18.526130 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2419/4844] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:17 2022] GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a => generated 1736 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:18.547274 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6febb673-19c2-466a-a6a8-ca147b06d975 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:18.548199 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6febb673-19c2-466a-a6a8-ca147b06d975 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 5378eb2d-663e-4d1d-a113-64363d4f1dd9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:18.558496 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6febb673-19c2-466a-a6a8-ca147b06d975 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:18.559260 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6febb673-19c2-466a-a6a8-ca147b06d975 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:18.559953 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6febb673-19c2-466a-a6a8-ca147b06d975 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:18.561126 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6febb673-19c2-466a-a6a8-ca147b06d975 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:18.561967 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6febb673-19c2-466a-a6a8-ca147b06d975 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:18.562917 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6febb673-19c2-466a-a6a8-ca147b06d975 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:19.007481 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6febb673-19c2-466a-a6a8-ca147b06d975 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:19.034840 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6febb673-19c2-466a-a6a8-ca147b06d975 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/5378eb2d-663e-4d1d-a113-64363d4f1dd9" status: 200 len: 1503 microversion: 2.1 time: 0.496940 Oct 18 15:47:19.037314 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2420/4845] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:18 2022] GET /compute/v2.1/servers/5378eb2d-663e-4d1d-a113-64363d4f1dd9 => generated 1503 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:19.066579 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2cc8ccba-64e8-4174-9477-81b0c3338b1e tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:19.074956 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2cc8ccba-64e8-4174-9477-81b0c3338b1e tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14" status: 200 len: 1522 microversion: 2.1 time: 0.737051 Oct 18 15:47:19.077989 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2426/4846] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:18 2022] GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14 => generated 1522 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:19.080286 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-46301d15-fa1c-42dc-ae2f-61405366539a req-b76402eb-0c78-4c44-9b61-5034814c127c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d108fa0-49bb-46c2-a8b0-802c5835cb14", "name": "network-vif-plugged", "status": "completed", "tag": "415f8632-c892-4860-89a6-5fddaeb68947"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:47:19.092723 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-111d50d1-bc95-4453-88b4-ad1b84f5fef3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:47:19.097657 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-111d50d1-bc95-4453-88b4-ad1b84f5fef3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 5378eb2d-663e-4d1d-a113-64363d4f1dd9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:19.116506 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-46301d15-fa1c-42dc-ae2f-61405366539a req-b76402eb-0c78-4c44-9b61-5034814c127c service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:19.126794 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-111d50d1-bc95-4453-88b4-ad1b84f5fef3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:19.127304 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-111d50d1-bc95-4453-88b4-ad1b84f5fef3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:19.127748 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-111d50d1-bc95-4453-88b4-ad1b84f5fef3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:19.128472 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-111d50d1-bc95-4453-88b4-ad1b84f5fef3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:19.128966 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-111d50d1-bc95-4453-88b4-ad1b84f5fef3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:19.129403 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-111d50d1-bc95-4453-88b4-ad1b84f5fef3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:19.136087 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-46301d15-fa1c-42dc-ae2f-61405366539a req-b76402eb-0c78-4c44-9b61-5034814c127c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:19.136725 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-46301d15-fa1c-42dc-ae2f-61405366539a req-b76402eb-0c78-4c44-9b61-5034814c127c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:19.179104 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-46301d15-fa1c-42dc-ae2f-61405366539a req-b76402eb-0c78-4c44-9b61-5034814c127c service nova] Creating event network-vif-plugged:415f8632-c892-4860-89a6-5fddaeb68947 for instance 9d108fa0-49bb-46c2-a8b0-802c5835cb14 on n-h1-853682-5 Oct 18 15:47:19.200691 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-46301d15-fa1c-42dc-ae2f-61405366539a req-b76402eb-0c78-4c44-9b61-5034814c127c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147485 Oct 18 15:47:19.209213 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2421/4847] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:47:19.573712 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-db056ced-654f-456a-82c0-5a5b3432373b tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:19.576849 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-db056ced-654f-456a-82c0-5a5b3432373b tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 5e83c779-c8f8-4ebd-84ab-7f144ab8552a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:19.590442 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db056ced-654f-456a-82c0-5a5b3432373b tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:19.591766 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db056ced-654f-456a-82c0-5a5b3432373b tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:19.592442 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db056ced-654f-456a-82c0-5a5b3432373b tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:19.594510 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db056ced-654f-456a-82c0-5a5b3432373b tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:19.595279 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db056ced-654f-456a-82c0-5a5b3432373b tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:19.597871 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db056ced-654f-456a-82c0-5a5b3432373b tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:19.794884 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.network.security_group_api [None req-111d50d1-bc95-4453-88b4-ad1b84f5fef3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Removing security group 46a31e62-7f14-4868-ae3f-37ad560d9c87 from port 747cbe5b-6f12-4c7f-88b6-e3e8249fa1e5 Oct 18 15:47:20.032346 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-db056ced-654f-456a-82c0-5a5b3432373b tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:20.047996 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-db056ced-654f-456a-82c0-5a5b3432373b tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a" status: 200 len: 1736 microversion: 2.1 time: 0.500863 Oct 18 15:47:20.057385 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2422/4848] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:19 2022] GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a => generated 1736 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:47:20.102781 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e1753ad6-8c0a-4b1a-9fed-82e390de8099 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:20.103144 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e1753ad6-8c0a-4b1a-9fed-82e390de8099 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 9d108fa0-49bb-46c2-a8b0-802c5835cb14] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:20.116042 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e1753ad6-8c0a-4b1a-9fed-82e390de8099 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:20.116547 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e1753ad6-8c0a-4b1a-9fed-82e390de8099 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:20.117016 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e1753ad6-8c0a-4b1a-9fed-82e390de8099 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:20.118344 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e1753ad6-8c0a-4b1a-9fed-82e390de8099 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:20.118792 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e1753ad6-8c0a-4b1a-9fed-82e390de8099 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:20.119211 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e1753ad6-8c0a-4b1a-9fed-82e390de8099 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:20.653291 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e1753ad6-8c0a-4b1a-9fed-82e390de8099 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:20.666384 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e1753ad6-8c0a-4b1a-9fed-82e390de8099 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14" status: 200 len: 1522 microversion: 2.1 time: 0.568617 Oct 18 15:47:20.667368 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2423/4849] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:20 2022] GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14 => generated 1522 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:47:20.939750 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-111d50d1-bc95-4453-88b4-ad1b84f5fef3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "POST /compute/v2.1/servers/5378eb2d-663e-4d1d-a113-64363d4f1dd9/action" status: 202 len: 0 microversion: 2.1 time: 1.860545 Oct 18 15:47:20.943946 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2427/4850] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:47:19 2022] POST /compute/v2.1/servers/5378eb2d-663e-4d1d-a113-64363d4f1dd9/action => generated 0 bytes in 1865 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:47:20.951875 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-34398b4d-626e-415a-88d3-086b49838ebb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:20.953614 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-34398b4d-626e-415a-88d3-086b49838ebb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 5378eb2d-663e-4d1d-a113-64363d4f1dd9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:20.979556 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-34398b4d-626e-415a-88d3-086b49838ebb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:20.980078 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-34398b4d-626e-415a-88d3-086b49838ebb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:20.982818 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-34398b4d-626e-415a-88d3-086b49838ebb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:20.985406 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-34398b4d-626e-415a-88d3-086b49838ebb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:20.985937 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-34398b4d-626e-415a-88d3-086b49838ebb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:20.987922 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-34398b4d-626e-415a-88d3-086b49838ebb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:21.101367 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e203354e-7eec-475a-99d6-15cae7e9cc91 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-89797686", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "77d1d96c-e20f-4c3e-8f5d-5aa6f71beb05"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:47:21.135720 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-34398b4d-626e-415a-88d3-086b49838ebb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:21.161769 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-34398b4d-626e-415a-88d3-086b49838ebb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/5378eb2d-663e-4d1d-a113-64363d4f1dd9" status: 200 len: 1461 microversion: 2.1 time: 0.216613 Oct 18 15:47:21.165160 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2428/4851] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:20 2022] GET /compute/v2.1/servers/5378eb2d-663e-4d1d-a113-64363d4f1dd9 => generated 1461 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:21.193163 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-566d62ac-9cf9-487c-bca2-c5cab8bf2f33 req-d204e42c-df61-456c-a65f-75e0539f78b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5378eb2d-663e-4d1d-a113-64363d4f1dd9", "tag": "747cbe5b-6f12-4c7f-88b6-e3e8249fa1e5"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:47:21.212905 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-e203354e-7eec-475a-99d6-15cae7e9cc91 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] validate_networks() for [('77d1d96c-e20f-4c3e-8f5d-5aa6f71beb05', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:47:21.222004 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-566d62ac-9cf9-487c-bca2-c5cab8bf2f33 req-d204e42c-df61-456c-a65f-75e0539f78b2 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:21.223460 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-566d62ac-9cf9-487c-bca2-c5cab8bf2f33 req-d204e42c-df61-456c-a65f-75e0539f78b2 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:21.224062 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-566d62ac-9cf9-487c-bca2-c5cab8bf2f33 req-d204e42c-df61-456c-a65f-75e0539f78b2 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:21.240538 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-566d62ac-9cf9-487c-bca2-c5cab8bf2f33 req-d204e42c-df61-456c-a65f-75e0539f78b2 service nova] Creating event network-changed:747cbe5b-6f12-4c7f-88b6-e3e8249fa1e5 for instance 5378eb2d-663e-4d1d-a113-64363d4f1dd9 on n-h2-853682-5 Oct 18 15:47:21.246976 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-566d62ac-9cf9-487c-bca2-c5cab8bf2f33 req-d204e42c-df61-456c-a65f-75e0539f78b2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068426 Oct 18 15:47:21.248486 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2429/4852] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:47:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:47:21.262621 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3ddaa48a-4780-4666-980c-e3afcadad438 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:21.269250 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3ddaa48a-4780-4666-980c-e3afcadad438 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 5e83c779-c8f8-4ebd-84ab-7f144ab8552a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:21.278602 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ddaa48a-4780-4666-980c-e3afcadad438 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:21.279483 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ddaa48a-4780-4666-980c-e3afcadad438 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:21.281107 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ddaa48a-4780-4666-980c-e3afcadad438 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:21.283529 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ddaa48a-4780-4666-980c-e3afcadad438 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:21.285202 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ddaa48a-4780-4666-980c-e3afcadad438 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:21.285833 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ddaa48a-4780-4666-980c-e3afcadad438 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:22.194350 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3ddaa48a-4780-4666-980c-e3afcadad438 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:22.214719 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3ddaa48a-4780-4666-980c-e3afcadad438 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a" status: 200 len: 1736 microversion: 2.1 time: 0.964787 Oct 18 15:47:22.216513 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2430/4853] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:21 2022] GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a => generated 1736 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:22.229775 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-43d544ac-6e2c-4f88-a095-595fc79008eb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:22.231268 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-43d544ac-6e2c-4f88-a095-595fc79008eb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:22.239581 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-43d544ac-6e2c-4f88-a095-595fc79008eb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:22.241039 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-43d544ac-6e2c-4f88-a095-595fc79008eb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:22.241692 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-43d544ac-6e2c-4f88-a095-595fc79008eb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:22.243958 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-43d544ac-6e2c-4f88-a095-595fc79008eb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:22.244602 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-43d544ac-6e2c-4f88-a095-595fc79008eb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:22.245320 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-43d544ac-6e2c-4f88-a095-595fc79008eb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:22.635087 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-e203354e-7eec-475a-99d6-15cae7e9cc91 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:47:22.636058 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-e203354e-7eec-475a-99d6-15cae7e9cc91 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:47:22.636758 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-e203354e-7eec-475a-99d6-15cae7e9cc91 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:47:22.637370 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-e203354e-7eec-475a-99d6-15cae7e9cc91 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:47:22.637944 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-e203354e-7eec-475a-99d6-15cae7e9cc91 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:47:22.654792 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e203354e-7eec-475a-99d6-15cae7e9cc91 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:22.656124 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e203354e-7eec-475a-99d6-15cae7e9cc91 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:22.658693 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e203354e-7eec-475a-99d6-15cae7e9cc91 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:22.661790 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e203354e-7eec-475a-99d6-15cae7e9cc91 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:22.662852 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e203354e-7eec-475a-99d6-15cae7e9cc91 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:22.665573 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e203354e-7eec-475a-99d6-15cae7e9cc91 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:22.703004 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-e203354e-7eec-475a-99d6-15cae7e9cc91 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Getting quotas for project 30f1a15bab624a0e8554e9f929f8520e. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:47:22.712677 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-e203354e-7eec-475a-99d6-15cae7e9cc91 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Getting quotas for user 370aba28a5264618a3ca0c82246ed847 and project 30f1a15bab624a0e8554e9f929f8520e. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:47:22.718651 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-43d544ac-6e2c-4f88-a095-595fc79008eb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:22.732943 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-43d544ac-6e2c-4f88-a095-595fc79008eb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1671 microversion: 2.1 time: 0.512808 Oct 18 15:47:22.743627 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e203354e-7eec-475a-99d6-15cae7e9cc91 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:47:22.754476 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2431/4854] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:22 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1671 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:22.757765 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e203354e-7eec-475a-99d6-15cae7e9cc91 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] [instance: 8ad81e1b-5d0b-4569-a058-b84881b87164] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:47:22.766277 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0bbf65ff-c94d-4736-9211-b54db99285a8 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:22.766918 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0bbf65ff-c94d-4736-9211-b54db99285a8 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 9d108fa0-49bb-46c2-a8b0-802c5835cb14] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:22.779781 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0bbf65ff-c94d-4736-9211-b54db99285a8 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:22.782037 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0bbf65ff-c94d-4736-9211-b54db99285a8 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:22.782806 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0bbf65ff-c94d-4736-9211-b54db99285a8 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:22.784795 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0bbf65ff-c94d-4736-9211-b54db99285a8 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:22.785483 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0bbf65ff-c94d-4736-9211-b54db99285a8 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:22.788215 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0bbf65ff-c94d-4736-9211-b54db99285a8 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:22.846338 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e203354e-7eec-475a-99d6-15cae7e9cc91 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.175698 Oct 18 15:47:22.848039 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2424/4855] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:47:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2179 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:47:22.860353 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-99545151-203a-4613-80da-ee2a15547ea4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:22.862951 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-99545151-203a-4613-80da-ee2a15547ea4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:22.881348 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99545151-203a-4613-80da-ee2a15547ea4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:22.882199 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99545151-203a-4613-80da-ee2a15547ea4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:22.883433 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99545151-203a-4613-80da-ee2a15547ea4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:22.885863 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99545151-203a-4613-80da-ee2a15547ea4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:22.886590 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99545151-203a-4613-80da-ee2a15547ea4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:22.906117 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99545151-203a-4613-80da-ee2a15547ea4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:23.481355 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0bbf65ff-c94d-4736-9211-b54db99285a8 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:23.493160 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0bbf65ff-c94d-4736-9211-b54db99285a8 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14" status: 200 len: 1507 microversion: 2.1 time: 0.736165 Oct 18 15:47:23.494846 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2432/4856] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:22 2022] GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14 => generated 1507 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:23.503523 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-96a66648-c79e-4ca3-8ae7-347188bd5973 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:23.504328 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-96a66648-c79e-4ca3-8ae7-347188bd5973 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] [instance: 8ad81e1b-5d0b-4569-a058-b84881b87164] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:23.676029 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-96a66648-c79e-4ca3-8ae7-347188bd5973 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370aba28a5264618a3ca0c82246ed847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f1a15bab624a0e8554e9f929f8520e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:23.684950 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-96a66648-c79e-4ca3-8ae7-347188bd5973 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] 10.222.0.60 "GET /compute/v2.1/servers/8ad81e1b-5d0b-4569-a058-b84881b87164" status: 200 len: 1214 microversion: 2.1 time: 0.187641 Oct 18 15:47:23.686233 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2433/4857] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:23 2022] GET /compute/v2.1/servers/8ad81e1b-5d0b-4569-a058-b84881b87164 => generated 1214 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:23.691341 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-cfdc9691-76f9-46c9-92fe-0471d1f28568 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:23.692402 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-cfdc9691-76f9-46c9-92fe-0471d1f28568 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 5e83c779-c8f8-4ebd-84ab-7f144ab8552a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:23.699796 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cfdc9691-76f9-46c9-92fe-0471d1f28568 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:23.700371 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cfdc9691-76f9-46c9-92fe-0471d1f28568 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:23.700906 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cfdc9691-76f9-46c9-92fe-0471d1f28568 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:23.701892 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cfdc9691-76f9-46c9-92fe-0471d1f28568 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:23.702684 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cfdc9691-76f9-46c9-92fe-0471d1f28568 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:23.703480 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cfdc9691-76f9-46c9-92fe-0471d1f28568 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:23.709286 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:23.787103 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-99545151-203a-4613-80da-ee2a15547ea4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:23.799760 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-99545151-203a-4613-80da-ee2a15547ea4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1671 microversion: 2.1 time: 0.949716 Oct 18 15:47:23.819323 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2425/4858] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:22 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1671 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:23.828008 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d5fa5968-3bbb-42ed-a376-b0341c188ac1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:23.830634 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d5fa5968-3bbb-42ed-a376-b0341c188ac1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 9d108fa0-49bb-46c2-a8b0-802c5835cb14] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:23.845151 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5fa5968-3bbb-42ed-a376-b0341c188ac1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:23.846053 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5fa5968-3bbb-42ed-a376-b0341c188ac1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:23.846826 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5fa5968-3bbb-42ed-a376-b0341c188ac1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:23.847792 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5fa5968-3bbb-42ed-a376-b0341c188ac1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:23.848436 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5fa5968-3bbb-42ed-a376-b0341c188ac1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:23.849586 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5fa5968-3bbb-42ed-a376-b0341c188ac1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:24.504573 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-cfdc9691-76f9-46c9-92fe-0471d1f28568 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:24.539575 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-cfdc9691-76f9-46c9-92fe-0471d1f28568 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a" status: 200 len: 1736 microversion: 2.1 time: 0.851262 Oct 18 15:47:24.540482 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2434/4859] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:23 2022] GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a => generated 1736 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:24.559696 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fdfc8bf0-e73c-41bf-b6fe-745ede95038a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:24.560346 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-fdfc8bf0-e73c-41bf-b6fe-745ede95038a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:24.582406 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fdfc8bf0-e73c-41bf-b6fe-745ede95038a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:24.583008 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fdfc8bf0-e73c-41bf-b6fe-745ede95038a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:24.583427 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fdfc8bf0-e73c-41bf-b6fe-745ede95038a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:24.584142 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fdfc8bf0-e73c-41bf-b6fe-745ede95038a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:24.597230 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fdfc8bf0-e73c-41bf-b6fe-745ede95038a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:24.597782 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fdfc8bf0-e73c-41bf-b6fe-745ede95038a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:24.825379 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d5fa5968-3bbb-42ed-a376-b0341c188ac1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:24.840076 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d5fa5968-3bbb-42ed-a376-b0341c188ac1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14" status: 200 len: 1507 microversion: 2.1 time: 1.016414 Oct 18 15:47:24.840717 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2426/4860] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:23 2022] GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14 => generated 1507 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:24.857936 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-00ab5270-71e6-4602-8e1f-ee725bccd714 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:24.858807 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-00ab5270-71e6-4602-8e1f-ee725bccd714 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] [instance: 8ad81e1b-5d0b-4569-a058-b84881b87164] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:24.865669 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00ab5270-71e6-4602-8e1f-ee725bccd714 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:24.866397 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00ab5270-71e6-4602-8e1f-ee725bccd714 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:24.872247 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00ab5270-71e6-4602-8e1f-ee725bccd714 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:24.873611 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00ab5270-71e6-4602-8e1f-ee725bccd714 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:24.874261 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00ab5270-71e6-4602-8e1f-ee725bccd714 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:24.875060 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00ab5270-71e6-4602-8e1f-ee725bccd714 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:25.502088 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-00ab5270-71e6-4602-8e1f-ee725bccd714 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370aba28a5264618a3ca0c82246ed847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f1a15bab624a0e8554e9f929f8520e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:25.511881 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-00ab5270-71e6-4602-8e1f-ee725bccd714 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] 10.222.0.60 "GET /compute/v2.1/servers/8ad81e1b-5d0b-4569-a058-b84881b87164" status: 200 len: 1266 microversion: 2.1 time: 0.657640 Oct 18 15:47:25.515801 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2427/4861] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:24 2022] GET /compute/v2.1/servers/8ad81e1b-5d0b-4569-a058-b84881b87164 => generated 1266 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:25.529219 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-418e8f8c-9611-4cdf-a555-1ff6b7f76efa tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:25.530145 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-418e8f8c-9611-4cdf-a555-1ff6b7f76efa tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 9d108fa0-49bb-46c2-a8b0-802c5835cb14] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:25.533565 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:25.557281 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-418e8f8c-9611-4cdf-a555-1ff6b7f76efa tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:25.562975 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-418e8f8c-9611-4cdf-a555-1ff6b7f76efa tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:25.563605 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-418e8f8c-9611-4cdf-a555-1ff6b7f76efa tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:25.564499 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-418e8f8c-9611-4cdf-a555-1ff6b7f76efa tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:25.565117 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-418e8f8c-9611-4cdf-a555-1ff6b7f76efa tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:25.565662 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-418e8f8c-9611-4cdf-a555-1ff6b7f76efa tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:25.635969 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-418e8f8c-9611-4cdf-a555-1ff6b7f76efa tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 9d108fa0-49bb-46c2-a8b0-802c5835cb14] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:47:25.826850 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-418e8f8c-9611-4cdf-a555-1ff6b7f76efa tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14" status: 204 len: 0 microversion: 2.1 time: 0.308434 Oct 18 15:47:25.827633 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2428/4862] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:47:25 2022] DELETE /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:47:25.832915 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-919f423a-6751-428f-b3e6-eb43a06a3249 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:25.835261 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-919f423a-6751-428f-b3e6-eb43a06a3249 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 5e83c779-c8f8-4ebd-84ab-7f144ab8552a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:25.864447 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-919f423a-6751-428f-b3e6-eb43a06a3249 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:25.864985 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-919f423a-6751-428f-b3e6-eb43a06a3249 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:25.873071 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-919f423a-6751-428f-b3e6-eb43a06a3249 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:25.873894 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-919f423a-6751-428f-b3e6-eb43a06a3249 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:25.874392 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-919f423a-6751-428f-b3e6-eb43a06a3249 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:25.874825 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-919f423a-6751-428f-b3e6-eb43a06a3249 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:26.218618 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-fdfc8bf0-e73c-41bf-b6fe-745ede95038a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:26.228559 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fdfc8bf0-e73c-41bf-b6fe-745ede95038a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1671 microversion: 2.1 time: 1.682554 Oct 18 15:47:26.251669 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2435/4863] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:24 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1671 bytes in 1703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:26.261237 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-19fd3942-e4b3-44be-b501-ab3f38cdab9b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-942589565", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "555b266f-a669-4b15-ac01-9eefa267ee33"}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:47:26.359577 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-919f423a-6751-428f-b3e6-eb43a06a3249 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:26.369291 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-919f423a-6751-428f-b3e6-eb43a06a3249 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a" status: 200 len: 1736 microversion: 2.1 time: 0.540407 Oct 18 15:47:26.375094 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2429/4864] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:25 2022] GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a => generated 1736 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:26.381767 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1843f24d-11e8-4a16-8999-bb26c4b46476 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:26.383217 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1843f24d-11e8-4a16-8999-bb26c4b46476 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:26.384459 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-19fd3942-e4b3-44be-b501-ab3f38cdab9b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] validate_networks() for [('555b266f-a669-4b15-ac01-9eefa267ee33', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:47:26.394411 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1843f24d-11e8-4a16-8999-bb26c4b46476 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:26.404067 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1843f24d-11e8-4a16-8999-bb26c4b46476 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:26.405411 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1843f24d-11e8-4a16-8999-bb26c4b46476 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:26.406175 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1843f24d-11e8-4a16-8999-bb26c4b46476 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:26.406638 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1843f24d-11e8-4a16-8999-bb26c4b46476 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:26.407089 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1843f24d-11e8-4a16-8999-bb26c4b46476 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:26.858760 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1843f24d-11e8-4a16-8999-bb26c4b46476 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:26.875495 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1843f24d-11e8-4a16-8999-bb26c4b46476 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1671 microversion: 2.1 time: 0.498902 Oct 18 15:47:26.877613 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2430/4865] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:26 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1671 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:26.903998 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2d9cd0e8-2f86-4291-9f1b-12013992e875 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:26.904994 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2d9cd0e8-2f86-4291-9f1b-12013992e875 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] [instance: 8ad81e1b-5d0b-4569-a058-b84881b87164] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:26.920112 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d9cd0e8-2f86-4291-9f1b-12013992e875 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:26.921086 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d9cd0e8-2f86-4291-9f1b-12013992e875 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:26.921830 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d9cd0e8-2f86-4291-9f1b-12013992e875 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:26.923322 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d9cd0e8-2f86-4291-9f1b-12013992e875 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:26.925454 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d9cd0e8-2f86-4291-9f1b-12013992e875 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:26.927660 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d9cd0e8-2f86-4291-9f1b-12013992e875 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:27.107863 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2d9cd0e8-2f86-4291-9f1b-12013992e875 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370aba28a5264618a3ca0c82246ed847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f1a15bab624a0e8554e9f929f8520e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:27.116576 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2d9cd0e8-2f86-4291-9f1b-12013992e875 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] 10.222.0.60 "GET /compute/v2.1/servers/8ad81e1b-5d0b-4569-a058-b84881b87164" status: 200 len: 1272 microversion: 2.1 time: 0.236416 Oct 18 15:47:27.119400 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2431/4866] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:26 2022] GET /compute/v2.1/servers/8ad81e1b-5d0b-4569-a058-b84881b87164 => generated 1272 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:27.144208 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3143fde3-6fd9-4c42-bc46-83a4ce062992 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-801645962", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "f7f357f0-b7b8-48ee-8cbb-a57289af59df"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:47:27.288755 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-3143fde3-6fd9-4c42-bc46-83a4ce062992 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] validate_networks() for [('f7f357f0-b7b8-48ee-8cbb-a57289af59df', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:47:28.057179 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-19fd3942-e4b3-44be-b501-ab3f38cdab9b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:47:28.057667 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-19fd3942-e4b3-44be-b501-ab3f38cdab9b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:47:28.058178 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-19fd3942-e4b3-44be-b501-ab3f38cdab9b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:47:28.058661 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-19fd3942-e4b3-44be-b501-ab3f38cdab9b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:47:28.059085 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-19fd3942-e4b3-44be-b501-ab3f38cdab9b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:47:28.069533 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-19fd3942-e4b3-44be-b501-ab3f38cdab9b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:28.071007 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-19fd3942-e4b3-44be-b501-ab3f38cdab9b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:28.071476 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-19fd3942-e4b3-44be-b501-ab3f38cdab9b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:28.072358 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-19fd3942-e4b3-44be-b501-ab3f38cdab9b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:28.073312 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-19fd3942-e4b3-44be-b501-ab3f38cdab9b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:28.073687 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-19fd3942-e4b3-44be-b501-ab3f38cdab9b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:28.097357 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-19fd3942-e4b3-44be-b501-ab3f38cdab9b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Getting quotas for project 8c8478562c2e4f8fab01a9667d9b6b05. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:47:28.104144 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-19fd3942-e4b3-44be-b501-ab3f38cdab9b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Getting quotas for user 3c91f91c89b648c8b099dbedf7c822b8 and project 8c8478562c2e4f8fab01a9667d9b6b05. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:47:28.126223 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-19fd3942-e4b3-44be-b501-ab3f38cdab9b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:47:28.131435 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-19fd3942-e4b3-44be-b501-ab3f38cdab9b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 2bf616f3-a9f8-4801-8fae-5056b3ba6598] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:47:28.219692 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-19fd3942-e4b3-44be-b501-ab3f38cdab9b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.966408 Oct 18 15:47:28.221475 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2436/4867] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:47:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1969 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:47:28.228717 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e429f31b-e11f-4979-8bf0-91eb7f4c916f tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:28.229906 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e429f31b-e11f-4979-8bf0-91eb7f4c916f tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 5e83c779-c8f8-4ebd-84ab-7f144ab8552a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:28.241512 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e429f31b-e11f-4979-8bf0-91eb7f4c916f tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:28.242909 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e429f31b-e11f-4979-8bf0-91eb7f4c916f tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:28.265342 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e429f31b-e11f-4979-8bf0-91eb7f4c916f tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:28.267258 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e429f31b-e11f-4979-8bf0-91eb7f4c916f tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:28.269722 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e429f31b-e11f-4979-8bf0-91eb7f4c916f tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:28.271148 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e429f31b-e11f-4979-8bf0-91eb7f4c916f tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:29.044583 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e429f31b-e11f-4979-8bf0-91eb7f4c916f tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:29.063668 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e429f31b-e11f-4979-8bf0-91eb7f4c916f tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a" status: 200 len: 1736 microversion: 2.1 time: 0.839834 Oct 18 15:47:29.064361 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2437/4868] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:28 2022] GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a => generated 1736 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:29.082648 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4f7961a3-fe4f-4842-9d71-18886a52f61b tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:29.083274 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4f7961a3-fe4f-4842-9d71-18886a52f61b tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] [instance: 8ad81e1b-5d0b-4569-a058-b84881b87164] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:29.098749 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4f7961a3-fe4f-4842-9d71-18886a52f61b tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:29.099612 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4f7961a3-fe4f-4842-9d71-18886a52f61b tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:29.099612 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4f7961a3-fe4f-4842-9d71-18886a52f61b tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:29.100348 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4f7961a3-fe4f-4842-9d71-18886a52f61b tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:29.100839 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4f7961a3-fe4f-4842-9d71-18886a52f61b tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:29.101795 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4f7961a3-fe4f-4842-9d71-18886a52f61b tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:29.217665 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-3143fde3-6fd9-4c42-bc46-83a4ce062992 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:47:29.218935 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-3143fde3-6fd9-4c42-bc46-83a4ce062992 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:47:29.219608 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-3143fde3-6fd9-4c42-bc46-83a4ce062992 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:47:29.220231 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-3143fde3-6fd9-4c42-bc46-83a4ce062992 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:47:29.221097 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-3143fde3-6fd9-4c42-bc46-83a4ce062992 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:47:29.251931 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3143fde3-6fd9-4c42-bc46-83a4ce062992 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:29.253951 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3143fde3-6fd9-4c42-bc46-83a4ce062992 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:29.255708 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3143fde3-6fd9-4c42-bc46-83a4ce062992 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:29.257702 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3143fde3-6fd9-4c42-bc46-83a4ce062992 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:29.261169 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3143fde3-6fd9-4c42-bc46-83a4ce062992 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:29.261733 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3143fde3-6fd9-4c42-bc46-83a4ce062992 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:29.310250 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-3143fde3-6fd9-4c42-bc46-83a4ce062992 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Getting quotas for project 2a2cdc778bd54f209d70f5b8703dc068. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:47:29.320724 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-3143fde3-6fd9-4c42-bc46-83a4ce062992 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Getting quotas for user 2aa0148a4a43466da619ea9843b3f78c and project 2a2cdc778bd54f209d70f5b8703dc068. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:47:29.342867 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3143fde3-6fd9-4c42-bc46-83a4ce062992 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:47:29.364024 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3143fde3-6fd9-4c42-bc46-83a4ce062992 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 41390db3-b9c7-4260-82d1-72bad9b9b0cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:47:29.495484 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3143fde3-6fd9-4c42-bc46-83a4ce062992 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.374058 Oct 18 15:47:29.498390 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2432/4869] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:47:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2378 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:47:29.504911 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f962d9cf-08ee-410a-88ab-ddc32561727c tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:29.507020 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f962d9cf-08ee-410a-88ab-ddc32561727c tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 2bf616f3-a9f8-4801-8fae-5056b3ba6598] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:29.518618 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f962d9cf-08ee-410a-88ab-ddc32561727c tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:29.519654 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f962d9cf-08ee-410a-88ab-ddc32561727c tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:29.520360 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f962d9cf-08ee-410a-88ab-ddc32561727c tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:29.521405 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f962d9cf-08ee-410a-88ab-ddc32561727c tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:29.522186 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f962d9cf-08ee-410a-88ab-ddc32561727c tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:29.523031 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f962d9cf-08ee-410a-88ab-ddc32561727c tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:29.626540 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:29.681499 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4f7961a3-fe4f-4842-9d71-18886a52f61b tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370aba28a5264618a3ca0c82246ed847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f1a15bab624a0e8554e9f929f8520e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:29.695908 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4f7961a3-fe4f-4842-9d71-18886a52f61b tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] 10.222.0.60 "GET /compute/v2.1/servers/8ad81e1b-5d0b-4569-a058-b84881b87164" status: 200 len: 1314 microversion: 2.1 time: 0.629586 Oct 18 15:47:29.700269 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2438/4870] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:29 2022] GET /compute/v2.1/servers/8ad81e1b-5d0b-4569-a058-b84881b87164 => generated 1314 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:29.712559 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-92438a05-acd6-45a1-bc65-419c2cc565b4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:29.714622 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-92438a05-acd6-45a1-bc65-419c2cc565b4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 41390db3-b9c7-4260-82d1-72bad9b9b0cc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:29.859037 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f962d9cf-08ee-410a-88ab-ddc32561727c tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:29.871179 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f962d9cf-08ee-410a-88ab-ddc32561727c tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/2bf616f3-a9f8-4801-8fae-5056b3ba6598" status: 200 len: 1269 microversion: 2.1 time: 0.371479 Oct 18 15:47:29.872627 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2433/4871] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:29 2022] GET /compute/v2.1/servers/2bf616f3-a9f8-4801-8fae-5056b3ba6598 => generated 1269 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:29.935389 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-92438a05-acd6-45a1-bc65-419c2cc565b4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:29.948021 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-92438a05-acd6-45a1-bc65-419c2cc565b4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc" status: 200 len: 1214 microversion: 2.1 time: 0.245229 Oct 18 15:47:29.953853 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2439/4872] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:29 2022] GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc => generated 1214 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:30.093065 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-80a482a2-9984-4d9d-b35a-08e36accb5f5 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:30.093717 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-80a482a2-9984-4d9d-b35a-08e36accb5f5 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 5e83c779-c8f8-4ebd-84ab-7f144ab8552a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:30.104940 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80a482a2-9984-4d9d-b35a-08e36accb5f5 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:30.104940 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80a482a2-9984-4d9d-b35a-08e36accb5f5 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:30.105274 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80a482a2-9984-4d9d-b35a-08e36accb5f5 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:30.106256 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80a482a2-9984-4d9d-b35a-08e36accb5f5 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:30.106504 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80a482a2-9984-4d9d-b35a-08e36accb5f5 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:30.106944 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80a482a2-9984-4d9d-b35a-08e36accb5f5 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:30.732278 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0447f3b4-d3e6-4c7f-af8d-f0ec43c20e58 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:30.737651 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0447f3b4-d3e6-4c7f-af8d-f0ec43c20e58 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] [instance: 8ad81e1b-5d0b-4569-a058-b84881b87164] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:30.757392 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0447f3b4-d3e6-4c7f-af8d-f0ec43c20e58 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:30.761311 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0447f3b4-d3e6-4c7f-af8d-f0ec43c20e58 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:30.763618 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0447f3b4-d3e6-4c7f-af8d-f0ec43c20e58 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:30.766041 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0447f3b4-d3e6-4c7f-af8d-f0ec43c20e58 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:30.768045 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0447f3b4-d3e6-4c7f-af8d-f0ec43c20e58 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:30.770724 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0447f3b4-d3e6-4c7f-af8d-f0ec43c20e58 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:30.790111 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-80a482a2-9984-4d9d-b35a-08e36accb5f5 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:30.803230 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-80a482a2-9984-4d9d-b35a-08e36accb5f5 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a" status: 200 len: 1736 microversion: 2.1 time: 0.712407 Oct 18 15:47:30.805728 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2434/4873] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:30 2022] GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a => generated 1736 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:30.896156 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cb414c59-35d9-4671-8fa6-ea2ab8ca02e2 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:30.897051 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cb414c59-35d9-4671-8fa6-ea2ab8ca02e2 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 2bf616f3-a9f8-4801-8fae-5056b3ba6598] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:30.910544 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb414c59-35d9-4671-8fa6-ea2ab8ca02e2 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:30.911929 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb414c59-35d9-4671-8fa6-ea2ab8ca02e2 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:30.915565 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb414c59-35d9-4671-8fa6-ea2ab8ca02e2 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:30.916628 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb414c59-35d9-4671-8fa6-ea2ab8ca02e2 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:30.917252 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb414c59-35d9-4671-8fa6-ea2ab8ca02e2 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:30.919961 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb414c59-35d9-4671-8fa6-ea2ab8ca02e2 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:31.559658 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cb414c59-35d9-4671-8fa6-ea2ab8ca02e2 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:31.570978 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cb414c59-35d9-4671-8fa6-ea2ab8ca02e2 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/2bf616f3-a9f8-4801-8fae-5056b3ba6598" status: 200 len: 1275 microversion: 2.1 time: 0.676207 Oct 18 15:47:31.587673 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2435/4874] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:30 2022] GET /compute/v2.1/servers/2bf616f3-a9f8-4801-8fae-5056b3ba6598 => generated 1275 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:31.598919 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f3c0f237-6ec0-4c82-8361-3e311f8d5259 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:31.601790 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f3c0f237-6ec0-4c82-8361-3e311f8d5259 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 41390db3-b9c7-4260-82d1-72bad9b9b0cc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:31.620974 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3c0f237-6ec0-4c82-8361-3e311f8d5259 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:31.621787 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3c0f237-6ec0-4c82-8361-3e311f8d5259 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:31.624333 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3c0f237-6ec0-4c82-8361-3e311f8d5259 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:31.626127 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3c0f237-6ec0-4c82-8361-3e311f8d5259 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:31.627699 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3c0f237-6ec0-4c82-8361-3e311f8d5259 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:31.629454 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3c0f237-6ec0-4c82-8361-3e311f8d5259 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:31.914863 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f3c0f237-6ec0-4c82-8361-3e311f8d5259 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:31.924326 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f3c0f237-6ec0-4c82-8361-3e311f8d5259 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc" status: 200 len: 1266 microversion: 2.1 time: 0.332292 Oct 18 15:47:31.928654 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2436/4875] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:31 2022] GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc => generated 1266 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:31.938552 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-01ad004b-b194-4b09-9eca-81354e8bbafa tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:31.941643 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-01ad004b-b194-4b09-9eca-81354e8bbafa tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 5e83c779-c8f8-4ebd-84ab-7f144ab8552a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:31.956522 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01ad004b-b194-4b09-9eca-81354e8bbafa tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:31.960786 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01ad004b-b194-4b09-9eca-81354e8bbafa tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:31.962241 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01ad004b-b194-4b09-9eca-81354e8bbafa tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:31.963129 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01ad004b-b194-4b09-9eca-81354e8bbafa tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:31.965493 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01ad004b-b194-4b09-9eca-81354e8bbafa tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:31.966377 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01ad004b-b194-4b09-9eca-81354e8bbafa tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:32.232655 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0447f3b4-d3e6-4c7f-af8d-f0ec43c20e58 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370aba28a5264618a3ca0c82246ed847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f1a15bab624a0e8554e9f929f8520e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:32.246331 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0447f3b4-d3e6-4c7f-af8d-f0ec43c20e58 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] 10.222.0.60 "GET /compute/v2.1/servers/8ad81e1b-5d0b-4569-a058-b84881b87164" status: 200 len: 1314 microversion: 2.1 time: 1.526922 Oct 18 15:47:32.247300 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2440/4876] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:30 2022] GET /compute/v2.1/servers/8ad81e1b-5d0b-4569-a058-b84881b87164 => generated 1314 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:32.269204 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-3d94facd-73fc-4344-ac17-6704a21ea031 req-7e553484-ab08-4964-a99c-b45c7732ef89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d108fa0-49bb-46c2-a8b0-802c5835cb14", "name": "network-vif-deleted", "tag": "415f8632-c892-4860-89a6-5fddaeb68947"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:47:32.276380 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:32.285209 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-3d94facd-73fc-4344-ac17-6704a21ea031 req-7e553484-ab08-4964-a99c-b45c7732ef89 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:32.286126 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-3d94facd-73fc-4344-ac17-6704a21ea031 req-7e553484-ab08-4964-a99c-b45c7732ef89 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:32.286605 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-3d94facd-73fc-4344-ac17-6704a21ea031 req-7e553484-ab08-4964-a99c-b45c7732ef89 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:32.302815 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-3d94facd-73fc-4344-ac17-6704a21ea031 req-7e553484-ab08-4964-a99c-b45c7732ef89 service nova] Creating event network-vif-deleted:415f8632-c892-4860-89a6-5fddaeb68947 for instance 9d108fa0-49bb-46c2-a8b0-802c5835cb14 on n-h1-853682-5 Oct 18 15:47:32.310576 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-3d94facd-73fc-4344-ac17-6704a21ea031 req-7e553484-ab08-4964-a99c-b45c7732ef89 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046214 Oct 18 15:47:32.311691 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2441/4877] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:47:32.598838 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-acc8d851-d3f0-4aea-88ad-15ee4c0318c1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:32.600062 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-acc8d851-d3f0-4aea-88ad-15ee4c0318c1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 2bf616f3-a9f8-4801-8fae-5056b3ba6598] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:32.619631 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-acc8d851-d3f0-4aea-88ad-15ee4c0318c1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:32.621416 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-acc8d851-d3f0-4aea-88ad-15ee4c0318c1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:32.625772 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-acc8d851-d3f0-4aea-88ad-15ee4c0318c1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:32.626711 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-acc8d851-d3f0-4aea-88ad-15ee4c0318c1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:32.627195 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-acc8d851-d3f0-4aea-88ad-15ee4c0318c1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:32.627625 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-acc8d851-d3f0-4aea-88ad-15ee4c0318c1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:32.630599 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-01ad004b-b194-4b09-9eca-81354e8bbafa tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:32.640499 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-01ad004b-b194-4b09-9eca-81354e8bbafa tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a" status: 200 len: 1716 microversion: 2.1 time: 0.709932 Oct 18 15:47:32.658346 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2437/4878] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:31 2022] GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a => generated 1716 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:32.892750 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4ff08739-4b57-4bea-b4ad-da8d8a4fe2a3 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:32.893589 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4ff08739-4b57-4bea-b4ad-da8d8a4fe2a3 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 5e83c779-c8f8-4ebd-84ab-7f144ab8552a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:32.905427 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ff08739-4b57-4bea-b4ad-da8d8a4fe2a3 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:32.906255 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ff08739-4b57-4bea-b4ad-da8d8a4fe2a3 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:32.917430 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ff08739-4b57-4bea-b4ad-da8d8a4fe2a3 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:32.920685 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ff08739-4b57-4bea-b4ad-da8d8a4fe2a3 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:32.923060 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ff08739-4b57-4bea-b4ad-da8d8a4fe2a3 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:32.923517 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ff08739-4b57-4bea-b4ad-da8d8a4fe2a3 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:32.932543 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-acc8d851-d3f0-4aea-88ad-15ee4c0318c1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:32.963865 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-acc8d851-d3f0-4aea-88ad-15ee4c0318c1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/2bf616f3-a9f8-4801-8fae-5056b3ba6598" status: 200 len: 1275 microversion: 2.1 time: 0.369860 Oct 18 15:47:32.969419 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2442/4879] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:32 2022] GET /compute/v2.1/servers/2bf616f3-a9f8-4801-8fae-5056b3ba6598 => generated 1275 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:47:32.976207 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0f3df30b-f995-4ab6-a61f-a34fd0f7f76f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:32.982017 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0f3df30b-f995-4ab6-a61f-a34fd0f7f76f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 41390db3-b9c7-4260-82d1-72bad9b9b0cc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:32.995882 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0f3df30b-f995-4ab6-a61f-a34fd0f7f76f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:32.996391 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0f3df30b-f995-4ab6-a61f-a34fd0f7f76f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:32.999848 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0f3df30b-f995-4ab6-a61f-a34fd0f7f76f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:33.002826 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0f3df30b-f995-4ab6-a61f-a34fd0f7f76f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:33.004164 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0f3df30b-f995-4ab6-a61f-a34fd0f7f76f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:33.004780 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0f3df30b-f995-4ab6-a61f-a34fd0f7f76f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:33.124802 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-4ff08739-4b57-4bea-b4ad-da8d8a4fe2a3 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] HTTP exception thrown: Cannot 'detach_volume' instance 5e83c779-c8f8-4ebd-84ab-7f144ab8552a while it is in vm_state rescued Oct 18 15:47:33.126839 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4ff08739-4b57-4bea-b4ad-da8d8a4fe2a3 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Request method failure captured: Oct 18 15:47:33.126839 n-d-853682-5 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a/os-volume_attachments/a1afd8b4-b9b9-4c07-979c-558282ac358e HTTP/1.1 Oct 18 15:47:33.126839 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:47:33.126839 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:47:33.126839 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:47:33.126839 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:47:33.126839 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:47:33.126839 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:47:33.126839 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:47:33.126839 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:47:33.126839 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsmOlfJjna__aWkkHZgCFMOd2DpNqn_dr-IEPGuxkqNqAVs7tN5T268nd09vhRJnPU2g5DJC-yqBSq_x2HTDX86g3yOFixR2PbozSJNAuQoWzOe1hqzQDBztCsy4gcfQ635XTPjGuAISQPn4_b-3rgJ6h45QPHOVHclQC7dNdVcnHno Oct 18 15:47:33.126839 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:47:33.126839 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:47:33.126839 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:47:33.126839 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:47:33.126839 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:47:33.126839 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:47:33.126839 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 224ca1f734c14bc8bf31e1826faf8e71 Oct 18 15:47:33.126839 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1233761615 Oct 18 15:47:33.126839 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:47:33.126839 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:47:33.126839 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/224ca1f734c14bc8bf31e1826faf8e71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/224ca1f734c14bc8bf31e1826faf8e71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/224ca1f734c14bc8bf31e1826faf8e71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_224ca1f734c14bc8bf31e1826faf8e71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:47:33.126839 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1233761615 Oct 18 15:47:33.126839 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 224ca1f734c14bc8bf31e1826faf8e71 Oct 18 15:47:33.126839 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1233761615 Oct 18 15:47:33.126839 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServerRescueNegativeTestJSON-1233761615-project Oct 18 15:47:33.126839 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:47:33.126839 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:47:33.126839 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 646fb4652c164c1dab5672d33d9fb295 Oct 18 15:47:33.126839 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1233761615-project Oct 18 15:47:33.126839 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:47:33.126839 n-d-853682-5 devstack@n-api.service[120406]: exception: Cannot 'detach_volume' instance 5e83c779-c8f8-4ebd-84ab-7f144ab8552a while it is in vm_state rescued Oct 18 15:47:33.126839 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'server_id': '5e83c779-c8f8-4ebd-84ab-7f144ab8552a', 'id': 'a1afd8b4-b9b9-4c07-979c-558282ac358e'} Oct 18 15:47:33.126839 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:47:33.126839 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:47:33.126839 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 18 15:47:33.126839 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 18 15:47:33.126839 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 15:47:33.126839 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 15:47:33.126839 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 18 15:47:33.126839 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 15:47:33.126839 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5e83c779-c8f8-4ebd-84ab-7f144ab8552a in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 18 15:47:33.126839 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:47:33.126839 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:47:33.126839 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:47:33.126839 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:47:33.126839 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:47:33.126839 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:47:33.126839 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:47:33.126839 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:47:33.126839 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:47:33.126839 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:47:33.126839 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 18 15:47:33.126839 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 18 15:47:33.126839 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 15:47:33.126839 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 15:47:33.126839 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 5e83c779-c8f8-4ebd-84ab-7f144ab8552a while it is in vm_state rescued Oct 18 15:47:33.126839 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:47:33.126839 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:47:33.126839 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:47:33.126839 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:47:33.132920 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:47:33.132920 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:47:33.132920 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:47:33.132920 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:47:33.132920 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 5e83c779-c8f8-4ebd-84ab-7f144ab8552a while it is in vm_state rescued Oct 18 15:47:33.132920 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:47:33.138068 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4ff08739-4b57-4bea-b4ad-da8d8a4fe2a3 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Returning 409 to user: Cannot 'detach_volume' instance 5e83c779-c8f8-4ebd-84ab-7f144ab8552a while it is in vm_state rescued {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:47:33.139095 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4ff08739-4b57-4bea-b4ad-da8d8a4fe2a3 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a/os-volume_attachments/a1afd8b4-b9b9-4c07-979c-558282ac358e" status: 409 len: 152 microversion: 2.1 time: 0.250268 Oct 18 15:47:33.140374 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2438/4880] 10.222.0.60 () {58 vars in 1416 bytes} [Tue Oct 18 15:47:32 2022] DELETE /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a/os-volume_attachments/a1afd8b4-b9b9-4c07-979c-558282ac358e => generated 152 bytes in 252 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 15:47:33.152460 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cf580165-a596-4d44-9ef6-3f77f6502a2b tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:47:33.153463 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cf580165-a596-4d44-9ef6-3f77f6502a2b tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 5e83c779-c8f8-4ebd-84ab-7f144ab8552a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:33.170344 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf580165-a596-4d44-9ef6-3f77f6502a2b tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:33.171117 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf580165-a596-4d44-9ef6-3f77f6502a2b tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:33.172251 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf580165-a596-4d44-9ef6-3f77f6502a2b tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:33.173387 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf580165-a596-4d44-9ef6-3f77f6502a2b tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:33.174083 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf580165-a596-4d44-9ef6-3f77f6502a2b tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:33.175126 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf580165-a596-4d44-9ef6-3f77f6502a2b tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:33.328797 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cf580165-a596-4d44-9ef6-3f77f6502a2b tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "POST /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a/action" status: 202 len: 0 microversion: 2.1 time: 0.184246 Oct 18 15:47:33.330131 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2439/4881] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:47:33 2022] POST /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 15:47:33.359317 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0f3df30b-f995-4ab6-a61f-a34fd0f7f76f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:33.375595 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-39ab1170-dffb-49bf-8bd3-5889a5faf6c0 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:33.376340 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-39ab1170-dffb-49bf-8bd3-5889a5faf6c0 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] [instance: 8ad81e1b-5d0b-4569-a058-b84881b87164] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:33.384976 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0f3df30b-f995-4ab6-a61f-a34fd0f7f76f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc" status: 200 len: 1272 microversion: 2.1 time: 0.406940 Oct 18 15:47:33.389015 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2443/4882] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:32 2022] GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc => generated 1272 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:33.395902 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39ab1170-dffb-49bf-8bd3-5889a5faf6c0 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:33.398731 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39ab1170-dffb-49bf-8bd3-5889a5faf6c0 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:33.400059 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39ab1170-dffb-49bf-8bd3-5889a5faf6c0 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:33.401489 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39ab1170-dffb-49bf-8bd3-5889a5faf6c0 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:33.402689 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39ab1170-dffb-49bf-8bd3-5889a5faf6c0 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:33.403289 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39ab1170-dffb-49bf-8bd3-5889a5faf6c0 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:33.403756 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a88cb44d-1c6b-46f5-ab56-9b9ace3540a2 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:33.406992 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a88cb44d-1c6b-46f5-ab56-9b9ace3540a2 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 5e83c779-c8f8-4ebd-84ab-7f144ab8552a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:33.423998 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a88cb44d-1c6b-46f5-ab56-9b9ace3540a2 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:33.425005 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a88cb44d-1c6b-46f5-ab56-9b9ace3540a2 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:33.425738 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a88cb44d-1c6b-46f5-ab56-9b9ace3540a2 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:33.428060 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a88cb44d-1c6b-46f5-ab56-9b9ace3540a2 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:33.431220 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a88cb44d-1c6b-46f5-ab56-9b9ace3540a2 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:33.431942 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a88cb44d-1c6b-46f5-ab56-9b9ace3540a2 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:34.049238 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a88cb44d-1c6b-46f5-ab56-9b9ace3540a2 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:34.064141 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a88cb44d-1c6b-46f5-ab56-9b9ace3540a2 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a" status: 200 len: 1724 microversion: 2.1 time: 0.671631 Oct 18 15:47:34.065070 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2444/4883] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:33 2022] GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a => generated 1724 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:34.088233 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-7d6d721c-9a3e-4c66-ab69-1d1becba4dbd req-6a42a75b-6eb5-463e-90bc-13cfe5a36529 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ad81e1b-5d0b-4569-a058-b84881b87164", "tag": "b9bd1e2a-b766-4326-88b6-df060e634233"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:47:34.111670 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-7d6d721c-9a3e-4c66-ab69-1d1becba4dbd req-6a42a75b-6eb5-463e-90bc-13cfe5a36529 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:34.112550 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-7d6d721c-9a3e-4c66-ab69-1d1becba4dbd req-6a42a75b-6eb5-463e-90bc-13cfe5a36529 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:34.113172 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-7d6d721c-9a3e-4c66-ab69-1d1becba4dbd req-6a42a75b-6eb5-463e-90bc-13cfe5a36529 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:34.127517 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-7d6d721c-9a3e-4c66-ab69-1d1becba4dbd req-6a42a75b-6eb5-463e-90bc-13cfe5a36529 service nova] Creating event network-changed:b9bd1e2a-b766-4326-88b6-df060e634233 for instance 8ad81e1b-5d0b-4569-a058-b84881b87164 on n-h1-853682-5 Oct 18 15:47:34.133105 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-7d6d721c-9a3e-4c66-ab69-1d1becba4dbd req-6a42a75b-6eb5-463e-90bc-13cfe5a36529 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054160 Oct 18 15:47:34.133649 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2445/4884] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:47:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:47:34.138941 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7ad9af8c-2df9-4a1b-8ed7-99f192f47562 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:34.139876 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7ad9af8c-2df9-4a1b-8ed7-99f192f47562 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 2bf616f3-a9f8-4801-8fae-5056b3ba6598] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:34.146755 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7ad9af8c-2df9-4a1b-8ed7-99f192f47562 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:34.147520 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7ad9af8c-2df9-4a1b-8ed7-99f192f47562 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:34.148667 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7ad9af8c-2df9-4a1b-8ed7-99f192f47562 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:34.149561 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7ad9af8c-2df9-4a1b-8ed7-99f192f47562 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:34.150200 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7ad9af8c-2df9-4a1b-8ed7-99f192f47562 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:34.150775 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7ad9af8c-2df9-4a1b-8ed7-99f192f47562 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:34.168096 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-39ab1170-dffb-49bf-8bd3-5889a5faf6c0 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370aba28a5264618a3ca0c82246ed847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f1a15bab624a0e8554e9f929f8520e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:34.175888 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-39ab1170-dffb-49bf-8bd3-5889a5faf6c0 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] 10.222.0.60 "GET /compute/v2.1/servers/8ad81e1b-5d0b-4569-a058-b84881b87164" status: 200 len: 1314 microversion: 2.1 time: 0.830880 Oct 18 15:47:34.191194 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2440/4885] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:33 2022] GET /compute/v2.1/servers/8ad81e1b-5d0b-4569-a058-b84881b87164 => generated 1314 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:34.418435 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e5f8e1ae-0b3c-4bce-8432-cb6667c60863 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:34.418604 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e5f8e1ae-0b3c-4bce-8432-cb6667c60863 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 41390db3-b9c7-4260-82d1-72bad9b9b0cc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:34.432317 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e5f8e1ae-0b3c-4bce-8432-cb6667c60863 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:34.439962 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e5f8e1ae-0b3c-4bce-8432-cb6667c60863 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:34.440580 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e5f8e1ae-0b3c-4bce-8432-cb6667c60863 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:34.441527 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e5f8e1ae-0b3c-4bce-8432-cb6667c60863 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:34.442138 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e5f8e1ae-0b3c-4bce-8432-cb6667c60863 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:34.442726 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e5f8e1ae-0b3c-4bce-8432-cb6667c60863 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:34.637518 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e5f8e1ae-0b3c-4bce-8432-cb6667c60863 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:34.653520 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e5f8e1ae-0b3c-4bce-8432-cb6667c60863 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc" status: 200 len: 1272 microversion: 2.1 time: 0.239334 Oct 18 15:47:34.654462 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2441/4886] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:34 2022] GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc => generated 1272 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:34.766423 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7ad9af8c-2df9-4a1b-8ed7-99f192f47562 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:34.777996 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7ad9af8c-2df9-4a1b-8ed7-99f192f47562 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/2bf616f3-a9f8-4801-8fae-5056b3ba6598" status: 200 len: 1317 microversion: 2.1 time: 0.642832 Oct 18 15:47:34.789784 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2446/4887] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:34 2022] GET /compute/v2.1/servers/2bf616f3-a9f8-4801-8fae-5056b3ba6598 => generated 1317 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:35.091920 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-994ec309-3609-4f82-84c2-a3ebc96e610b tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:35.093373 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-994ec309-3609-4f82-84c2-a3ebc96e610b tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 5e83c779-c8f8-4ebd-84ab-7f144ab8552a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:35.112903 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-994ec309-3609-4f82-84c2-a3ebc96e610b tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:35.117708 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-994ec309-3609-4f82-84c2-a3ebc96e610b tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:35.125024 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-994ec309-3609-4f82-84c2-a3ebc96e610b tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:35.128485 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-994ec309-3609-4f82-84c2-a3ebc96e610b tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:35.129182 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-994ec309-3609-4f82-84c2-a3ebc96e610b tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:35.130891 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-994ec309-3609-4f82-84c2-a3ebc96e610b tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:35.199207 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-542ca76a-1832-423a-8fdc-cb3004081db6 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:35.199855 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-542ca76a-1832-423a-8fdc-cb3004081db6 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] [instance: 8ad81e1b-5d0b-4569-a058-b84881b87164] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:35.211758 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-542ca76a-1832-423a-8fdc-cb3004081db6 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:35.212258 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-542ca76a-1832-423a-8fdc-cb3004081db6 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:35.213129 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-542ca76a-1832-423a-8fdc-cb3004081db6 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:35.218365 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-542ca76a-1832-423a-8fdc-cb3004081db6 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:35.221059 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-542ca76a-1832-423a-8fdc-cb3004081db6 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:35.225266 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-542ca76a-1832-423a-8fdc-cb3004081db6 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:35.912215 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-994ec309-3609-4f82-84c2-a3ebc96e610b tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:35.930510 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-994ec309-3609-4f82-84c2-a3ebc96e610b tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a" status: 200 len: 1724 microversion: 2.1 time: 0.843068 Oct 18 15:47:35.931454 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2442/4888] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:35 2022] GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a => generated 1724 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:35.936447 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d6e11d8d-c673-4840-915a-9a2c9dff511a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:35.946357 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d6e11d8d-c673-4840-915a-9a2c9dff511a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 41390db3-b9c7-4260-82d1-72bad9b9b0cc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:35.956669 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d6e11d8d-c673-4840-915a-9a2c9dff511a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:35.957195 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d6e11d8d-c673-4840-915a-9a2c9dff511a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:35.957853 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d6e11d8d-c673-4840-915a-9a2c9dff511a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:35.958950 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d6e11d8d-c673-4840-915a-9a2c9dff511a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:35.960110 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d6e11d8d-c673-4840-915a-9a2c9dff511a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:35.964519 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d6e11d8d-c673-4840-915a-9a2c9dff511a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:36.261652 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-542ca76a-1832-423a-8fdc-cb3004081db6 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370aba28a5264618a3ca0c82246ed847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f1a15bab624a0e8554e9f929f8520e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:36.269996 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-542ca76a-1832-423a-8fdc-cb3004081db6 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] 10.222.0.60 "GET /compute/v2.1/servers/8ad81e1b-5d0b-4569-a058-b84881b87164" status: 200 len: 1314 microversion: 2.1 time: 1.075031 Oct 18 15:47:36.285464 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2447/4889] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:35 2022] GET /compute/v2.1/servers/8ad81e1b-5d0b-4569-a058-b84881b87164 => generated 1314 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:47:36.291233 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-48b8f5df-0b4f-4140-888f-d787245508af tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:36.291863 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-48b8f5df-0b4f-4140-888f-d787245508af tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 2bf616f3-a9f8-4801-8fae-5056b3ba6598] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:36.297910 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-48b8f5df-0b4f-4140-888f-d787245508af tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:36.298653 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-48b8f5df-0b4f-4140-888f-d787245508af tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:36.299273 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-48b8f5df-0b4f-4140-888f-d787245508af tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:36.299990 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-48b8f5df-0b4f-4140-888f-d787245508af tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:36.300454 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-48b8f5df-0b4f-4140-888f-d787245508af tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:36.300930 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-48b8f5df-0b4f-4140-888f-d787245508af tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:36.552219 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d6e11d8d-c673-4840-915a-9a2c9dff511a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:36.573321 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d6e11d8d-c673-4840-915a-9a2c9dff511a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc" status: 200 len: 1314 microversion: 2.1 time: 0.640709 Oct 18 15:47:36.574121 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2443/4890] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:35 2022] GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc => generated 1314 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:36.772255 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-48b8f5df-0b4f-4140-888f-d787245508af tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:36.802454 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-48b8f5df-0b4f-4140-888f-d787245508af tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/2bf616f3-a9f8-4801-8fae-5056b3ba6598" status: 200 len: 1317 microversion: 2.1 time: 0.515566 Oct 18 15:47:36.804051 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2448/4891] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:36 2022] GET /compute/v2.1/servers/2bf616f3-a9f8-4801-8fae-5056b3ba6598 => generated 1317 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:36.962908 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-30cc02f4-9d1b-4626-9e96-2853c2976048 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:36.964639 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-30cc02f4-9d1b-4626-9e96-2853c2976048 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 5e83c779-c8f8-4ebd-84ab-7f144ab8552a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:36.974998 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30cc02f4-9d1b-4626-9e96-2853c2976048 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:36.976842 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30cc02f4-9d1b-4626-9e96-2853c2976048 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:36.977908 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30cc02f4-9d1b-4626-9e96-2853c2976048 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:36.978820 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30cc02f4-9d1b-4626-9e96-2853c2976048 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:36.979464 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30cc02f4-9d1b-4626-9e96-2853c2976048 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:36.980091 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30cc02f4-9d1b-4626-9e96-2853c2976048 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:37.403884 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1cd20cbc-76ac-4462-a62f-9c86e79b7725 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Action: 'create', calling method: .version_select at 0x7f7c3c0f4f70>, body: {"keypair": {"name": "tempest-keypair-305544900", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9iThRvmdspedRZZFPhkretCO/yal4rjXue0xXrak3Tm5cEMr2E9mraoRByA+wZwjH13G5jT1SGn98bxzYylDjNCeHeI2bubmQRYo9gA0mqPPsU+ryeXPScoO7r/eCKtw=="}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:47:37.406234 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-30cc02f4-9d1b-4626-9e96-2853c2976048 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:37.419312 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-30cc02f4-9d1b-4626-9e96-2853c2976048 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a" status: 200 len: 1724 microversion: 2.1 time: 0.463387 Oct 18 15:47:37.422914 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2444/4892] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:36 2022] GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a => generated 1724 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:37.436566 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8a6a8d61-6edb-41b6-92c7-3ea75edebdee tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:37.437765 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8a6a8d61-6edb-41b6-92c7-3ea75edebdee tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] [instance: 8ad81e1b-5d0b-4569-a058-b84881b87164] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:37.455580 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a6a8d61-6edb-41b6-92c7-3ea75edebdee tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:37.463546 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a6a8d61-6edb-41b6-92c7-3ea75edebdee tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:37.464319 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a6a8d61-6edb-41b6-92c7-3ea75edebdee tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:37.465363 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a6a8d61-6edb-41b6-92c7-3ea75edebdee tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:37.467331 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a6a8d61-6edb-41b6-92c7-3ea75edebdee tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:37.468040 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a6a8d61-6edb-41b6-92c7-3ea75edebdee tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:37.504406 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-1cd20cbc-76ac-4462-a62f-9c86e79b7725 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Getting quotas for project 2e4cd8880d3b47ad9098b2097c0563a2. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:47:37.528498 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-1cd20cbc-76ac-4462-a62f-9c86e79b7725 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Getting quotas for user e7f068c2e39541fb8d82265702a3179a and project 2e4cd8880d3b47ad9098b2097c0563a2. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:47:37.610881 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1cd20cbc-76ac-4462-a62f-9c86e79b7725 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.576907 Oct 18 15:47:37.613013 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2449/4893] 10.222.0.60 () {62 vars in 1200 bytes} [Tue Oct 18 15:47:37 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 580 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 18 15:47:37.622933 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-bd25cf36-56d6-4d3b-8bb4-1b90e0a41a86 req-c68e82e8-b263-48c7-b44f-e4fa51de520f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bf616f3-a9f8-4801-8fae-5056b3ba6598", "tag": "d81aaf80-478d-4eca-96d6-659964a3e785"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:47:37.670628 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-bd25cf36-56d6-4d3b-8bb4-1b90e0a41a86 req-c68e82e8-b263-48c7-b44f-e4fa51de520f service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:37.672199 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-bd25cf36-56d6-4d3b-8bb4-1b90e0a41a86 req-c68e82e8-b263-48c7-b44f-e4fa51de520f service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:37.672662 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-bd25cf36-56d6-4d3b-8bb4-1b90e0a41a86 req-c68e82e8-b263-48c7-b44f-e4fa51de520f service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:37.738225 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-bd25cf36-56d6-4d3b-8bb4-1b90e0a41a86 req-c68e82e8-b263-48c7-b44f-e4fa51de520f service nova] Creating event network-changed:d81aaf80-478d-4eca-96d6-659964a3e785 for instance 2bf616f3-a9f8-4801-8fae-5056b3ba6598 on n-h2-853682-5 Oct 18 15:47:37.763825 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-bd25cf36-56d6-4d3b-8bb4-1b90e0a41a86 req-c68e82e8-b263-48c7-b44f-e4fa51de520f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148070 Oct 18 15:47:37.764879 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2450/4894] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:47:37.771118 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-30905305-aec7-4f7f-9b8c-a16935091c4a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:37.772057 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-30905305-aec7-4f7f-9b8c-a16935091c4a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 41390db3-b9c7-4260-82d1-72bad9b9b0cc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:37.782445 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-30905305-aec7-4f7f-9b8c-a16935091c4a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:37.782945 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-30905305-aec7-4f7f-9b8c-a16935091c4a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:37.783394 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-30905305-aec7-4f7f-9b8c-a16935091c4a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:37.784215 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-30905305-aec7-4f7f-9b8c-a16935091c4a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:37.784689 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-30905305-aec7-4f7f-9b8c-a16935091c4a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:37.785162 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-30905305-aec7-4f7f-9b8c-a16935091c4a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:38.039926 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8a6a8d61-6edb-41b6-92c7-3ea75edebdee tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370aba28a5264618a3ca0c82246ed847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f1a15bab624a0e8554e9f929f8520e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:38.056772 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8a6a8d61-6edb-41b6-92c7-3ea75edebdee tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] 10.222.0.60 "GET /compute/v2.1/servers/8ad81e1b-5d0b-4569-a058-b84881b87164" status: 200 len: 1314 microversion: 2.1 time: 0.630831 Oct 18 15:47:38.057765 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2445/4895] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:37 2022] GET /compute/v2.1/servers/8ad81e1b-5d0b-4569-a058-b84881b87164 => generated 1314 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:38.065078 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e3ac5663-17df-43c5-88ef-26329bdde128 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:38.066470 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e3ac5663-17df-43c5-88ef-26329bdde128 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 2bf616f3-a9f8-4801-8fae-5056b3ba6598] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:38.085485 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:38.094712 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3ac5663-17df-43c5-88ef-26329bdde128 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:38.097934 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3ac5663-17df-43c5-88ef-26329bdde128 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:38.100106 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3ac5663-17df-43c5-88ef-26329bdde128 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:38.102384 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3ac5663-17df-43c5-88ef-26329bdde128 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:38.103710 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3ac5663-17df-43c5-88ef-26329bdde128 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:38.106074 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3ac5663-17df-43c5-88ef-26329bdde128 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:38.124293 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-30905305-aec7-4f7f-9b8c-a16935091c4a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:38.132709 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-30905305-aec7-4f7f-9b8c-a16935091c4a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc" status: 200 len: 1314 microversion: 2.1 time: 0.366222 Oct 18 15:47:38.137303 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2451/4896] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:37 2022] GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc => generated 1314 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:38.463994 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-38ee6ddf-fd8e-49c6-856d-901c1e8387d5 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:38.464684 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-38ee6ddf-fd8e-49c6-856d-901c1e8387d5 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 5e83c779-c8f8-4ebd-84ab-7f144ab8552a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:38.478714 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-38ee6ddf-fd8e-49c6-856d-901c1e8387d5 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:38.479222 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-38ee6ddf-fd8e-49c6-856d-901c1e8387d5 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:38.479673 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-38ee6ddf-fd8e-49c6-856d-901c1e8387d5 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:38.480397 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-38ee6ddf-fd8e-49c6-856d-901c1e8387d5 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:38.480887 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-38ee6ddf-fd8e-49c6-856d-901c1e8387d5 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:38.481544 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-38ee6ddf-fd8e-49c6-856d-901c1e8387d5 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:38.731433 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e3ac5663-17df-43c5-88ef-26329bdde128 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:38.743496 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e3ac5663-17df-43c5-88ef-26329bdde128 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/2bf616f3-a9f8-4801-8fae-5056b3ba6598" status: 200 len: 1317 microversion: 2.1 time: 0.683359 Oct 18 15:47:38.744104 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2446/4897] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:38 2022] GET /compute/v2.1/servers/2bf616f3-a9f8-4801-8fae-5056b3ba6598 => generated 1317 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:38.907855 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-ac7c45fe-4186-4dc1-83c0-ddb9377e2181 req-fa593bc9-f8a2-41f1-baa2-84b579b0b8ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41390db3-b9c7-4260-82d1-72bad9b9b0cc", "tag": "330a6dfe-e580-4dce-8a6e-1e1cd0081a73"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:47:38.920305 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ac7c45fe-4186-4dc1-83c0-ddb9377e2181 req-fa593bc9-f8a2-41f1-baa2-84b579b0b8ab service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:38.921097 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ac7c45fe-4186-4dc1-83c0-ddb9377e2181 req-fa593bc9-f8a2-41f1-baa2-84b579b0b8ab service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:38.921729 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ac7c45fe-4186-4dc1-83c0-ddb9377e2181 req-fa593bc9-f8a2-41f1-baa2-84b579b0b8ab service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:38.946065 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-ac7c45fe-4186-4dc1-83c0-ddb9377e2181 req-fa593bc9-f8a2-41f1-baa2-84b579b0b8ab service nova] Creating event network-changed:330a6dfe-e580-4dce-8a6e-1e1cd0081a73 for instance 41390db3-b9c7-4260-82d1-72bad9b9b0cc on n-h2-853682-5 Oct 18 15:47:38.951149 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-ac7c45fe-4186-4dc1-83c0-ddb9377e2181 req-fa593bc9-f8a2-41f1-baa2-84b579b0b8ab service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046993 Oct 18 15:47:38.952319 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2447/4898] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:47:39.096141 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8dd10ae2-f4e9-4845-ad99-5551f29f7c17 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:39.099688 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8dd10ae2-f4e9-4845-ad99-5551f29f7c17 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] [instance: 8ad81e1b-5d0b-4569-a058-b84881b87164] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:39.116618 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8dd10ae2-f4e9-4845-ad99-5551f29f7c17 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:39.131123 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8dd10ae2-f4e9-4845-ad99-5551f29f7c17 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:39.131769 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8dd10ae2-f4e9-4845-ad99-5551f29f7c17 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:39.136706 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8dd10ae2-f4e9-4845-ad99-5551f29f7c17 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:39.137368 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8dd10ae2-f4e9-4845-ad99-5551f29f7c17 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:39.138088 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8dd10ae2-f4e9-4845-ad99-5551f29f7c17 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:39.236082 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-38ee6ddf-fd8e-49c6-856d-901c1e8387d5 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:39.249027 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-38ee6ddf-fd8e-49c6-856d-901c1e8387d5 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a" status: 200 len: 1724 microversion: 2.1 time: 0.789227 Oct 18 15:47:39.270490 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2452/4899] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:38 2022] GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a => generated 1724 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:47:39.276702 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-46b1d9f9-06a9-471c-ae24-d9bd798c58e5 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:39.277549 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-46b1d9f9-06a9-471c-ae24-d9bd798c58e5 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 41390db3-b9c7-4260-82d1-72bad9b9b0cc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:39.284353 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-46b1d9f9-06a9-471c-ae24-d9bd798c58e5 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:39.285150 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-46b1d9f9-06a9-471c-ae24-d9bd798c58e5 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:39.285901 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-46b1d9f9-06a9-471c-ae24-d9bd798c58e5 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:39.286910 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-46b1d9f9-06a9-471c-ae24-d9bd798c58e5 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:39.287581 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-46b1d9f9-06a9-471c-ae24-d9bd798c58e5 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:39.287701 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:39.288343 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-46b1d9f9-06a9-471c-ae24-d9bd798c58e5 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:39.337083 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=12 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:39.432255 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8dd10ae2-f4e9-4845-ad99-5551f29f7c17 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370aba28a5264618a3ca0c82246ed847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f1a15bab624a0e8554e9f929f8520e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:39.446507 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8dd10ae2-f4e9-4845-ad99-5551f29f7c17 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] 10.222.0.60 "GET /compute/v2.1/servers/8ad81e1b-5d0b-4569-a058-b84881b87164" status: 200 len: 1314 microversion: 2.1 time: 0.356922 Oct 18 15:47:39.463098 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2448/4900] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:39 2022] GET /compute/v2.1/servers/8ad81e1b-5d0b-4569-a058-b84881b87164 => generated 1314 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:39.554979 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-46b1d9f9-06a9-471c-ae24-d9bd798c58e5 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:39.565165 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-46b1d9f9-06a9-471c-ae24-d9bd798c58e5 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc" status: 200 len: 1314 microversion: 2.1 time: 0.293075 Oct 18 15:47:39.566350 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2453/4901] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:39 2022] GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:39.767333 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d30d6cf6-a658-4eb0-a153-630419f5dd0a tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:39.768243 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d30d6cf6-a658-4eb0-a153-630419f5dd0a tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 2bf616f3-a9f8-4801-8fae-5056b3ba6598] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:39.774977 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d30d6cf6-a658-4eb0-a153-630419f5dd0a tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:39.775812 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d30d6cf6-a658-4eb0-a153-630419f5dd0a tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:39.776478 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d30d6cf6-a658-4eb0-a153-630419f5dd0a tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:39.777789 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d30d6cf6-a658-4eb0-a153-630419f5dd0a tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:39.778495 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d30d6cf6-a658-4eb0-a153-630419f5dd0a tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:39.779177 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d30d6cf6-a658-4eb0-a153-630419f5dd0a tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:39.798741 n-d-853682-5 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 15:47:39.799187 n-d-853682-5 devstack@n-api.service[120406]: Tue Oct 18 15:47:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2bf616f3-a9f8-4801-8fae-5056b3ba6598 (ip 10.222.0.60) !!! Oct 18 15:47:40.190240 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d30d6cf6-a658-4eb0-a153-630419f5dd0a tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:40.193984 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:40.206032 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d30d6cf6-a658-4eb0-a153-630419f5dd0a tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/2bf616f3-a9f8-4801-8fae-5056b3ba6598" status: 200 len: 1317 microversion: 2.1 time: 0.443261 Oct 18 15:47:40.223625 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2449/4902] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:39 2022] GET /compute/v2.1/servers/2bf616f3-a9f8-4801-8fae-5056b3ba6598 => generated 1317 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:40.278643 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0b2d19ea-8c46-4df8-8412-e111c9f06c94 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:40.279488 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0b2d19ea-8c46-4df8-8412-e111c9f06c94 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 5e83c779-c8f8-4ebd-84ab-7f144ab8552a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:40.288450 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0b2d19ea-8c46-4df8-8412-e111c9f06c94 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:40.289683 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0b2d19ea-8c46-4df8-8412-e111c9f06c94 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:40.290286 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0b2d19ea-8c46-4df8-8412-e111c9f06c94 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:40.291229 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0b2d19ea-8c46-4df8-8412-e111c9f06c94 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:40.291860 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0b2d19ea-8c46-4df8-8412-e111c9f06c94 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:40.292534 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0b2d19ea-8c46-4df8-8412-e111c9f06c94 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:40.477348 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8c60e4d8-d00e-460c-bb6d-019765d1de49 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:40.479004 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8c60e4d8-d00e-460c-bb6d-019765d1de49 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] [instance: 8ad81e1b-5d0b-4569-a058-b84881b87164] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:40.488586 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c60e4d8-d00e-460c-bb6d-019765d1de49 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:40.489623 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c60e4d8-d00e-460c-bb6d-019765d1de49 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:40.490065 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c60e4d8-d00e-460c-bb6d-019765d1de49 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:40.490778 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c60e4d8-d00e-460c-bb6d-019765d1de49 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:40.491236 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c60e4d8-d00e-460c-bb6d-019765d1de49 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:40.493025 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c60e4d8-d00e-460c-bb6d-019765d1de49 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:40.950809 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0b2d19ea-8c46-4df8-8412-e111c9f06c94 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:40.965850 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0b2d19ea-8c46-4df8-8412-e111c9f06c94 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a" status: 200 len: 1724 microversion: 2.1 time: 0.692702 Oct 18 15:47:40.980973 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2454/4903] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:40 2022] GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a => generated 1724 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:40.985857 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fb2d3954-6e03-4d6c-9920-1f45a2e3d0ad tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:40.987073 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-fb2d3954-6e03-4d6c-9920-1f45a2e3d0ad tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 41390db3-b9c7-4260-82d1-72bad9b9b0cc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:40.995464 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fb2d3954-6e03-4d6c-9920-1f45a2e3d0ad tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:40.996221 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fb2d3954-6e03-4d6c-9920-1f45a2e3d0ad tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:40.997165 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fb2d3954-6e03-4d6c-9920-1f45a2e3d0ad tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:40.998046 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fb2d3954-6e03-4d6c-9920-1f45a2e3d0ad tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:40.999790 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fb2d3954-6e03-4d6c-9920-1f45a2e3d0ad tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:41.000402 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fb2d3954-6e03-4d6c-9920-1f45a2e3d0ad tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:41.042184 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=100 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:41.250200 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8c60e4d8-d00e-460c-bb6d-019765d1de49 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370aba28a5264618a3ca0c82246ed847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f1a15bab624a0e8554e9f929f8520e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:41.263766 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8c60e4d8-d00e-460c-bb6d-019765d1de49 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] 10.222.0.60 "GET /compute/v2.1/servers/8ad81e1b-5d0b-4569-a058-b84881b87164" status: 200 len: 1314 microversion: 2.1 time: 0.795987 Oct 18 15:47:41.268320 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2450/4904] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:40 2022] GET /compute/v2.1/servers/8ad81e1b-5d0b-4569-a058-b84881b87164 => generated 1314 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:47:41.281227 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8e71599e-9e00-4049-a745-3caf837e1739 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:41.283445 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8e71599e-9e00-4049-a745-3caf837e1739 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 2bf616f3-a9f8-4801-8fae-5056b3ba6598] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:41.306736 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e71599e-9e00-4049-a745-3caf837e1739 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:41.312159 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e71599e-9e00-4049-a745-3caf837e1739 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:41.312933 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e71599e-9e00-4049-a745-3caf837e1739 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:41.316426 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e71599e-9e00-4049-a745-3caf837e1739 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:41.323403 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e71599e-9e00-4049-a745-3caf837e1739 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:41.333865 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e71599e-9e00-4049-a745-3caf837e1739 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:41.987926 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-fb2d3954-6e03-4d6c-9920-1f45a2e3d0ad tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:41.998000 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fb2d3954-6e03-4d6c-9920-1f45a2e3d0ad tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc" status: 200 len: 1314 microversion: 2.1 time: 1.027090 Oct 18 15:47:42.004976 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2455/4905] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:40 2022] GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc => generated 1314 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:42.016917 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5f4c8d7f-e7ae-4709-b81d-01825affa9fb tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:42.018754 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5f4c8d7f-e7ae-4709-b81d-01825affa9fb tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 5e83c779-c8f8-4ebd-84ab-7f144ab8552a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:42.029640 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5f4c8d7f-e7ae-4709-b81d-01825affa9fb tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:42.030594 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5f4c8d7f-e7ae-4709-b81d-01825affa9fb tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:42.031992 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5f4c8d7f-e7ae-4709-b81d-01825affa9fb tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:42.033541 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5f4c8d7f-e7ae-4709-b81d-01825affa9fb tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:42.034513 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5f4c8d7f-e7ae-4709-b81d-01825affa9fb tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:42.035753 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5f4c8d7f-e7ae-4709-b81d-01825affa9fb tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:42.122197 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8e71599e-9e00-4049-a745-3caf837e1739 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:42.131360 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8e71599e-9e00-4049-a745-3caf837e1739 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/2bf616f3-a9f8-4801-8fae-5056b3ba6598" status: 200 len: 1317 microversion: 2.1 time: 0.854854 Oct 18 15:47:42.132626 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2451/4906] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:41 2022] GET /compute/v2.1/servers/2bf616f3-a9f8-4801-8fae-5056b3ba6598 => generated 1317 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:42.293758 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0e384fa8-6db3-4291-a243-7ded4a2ca584 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:42.295801 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0e384fa8-6db3-4291-a243-7ded4a2ca584 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] [instance: 8ad81e1b-5d0b-4569-a058-b84881b87164] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:42.309421 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e384fa8-6db3-4291-a243-7ded4a2ca584 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:42.310178 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e384fa8-6db3-4291-a243-7ded4a2ca584 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:42.310856 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e384fa8-6db3-4291-a243-7ded4a2ca584 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:42.311873 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e384fa8-6db3-4291-a243-7ded4a2ca584 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:42.312768 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e384fa8-6db3-4291-a243-7ded4a2ca584 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:42.313994 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e384fa8-6db3-4291-a243-7ded4a2ca584 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:42.346937 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5f4c8d7f-e7ae-4709-b81d-01825affa9fb tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:42.360788 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5f4c8d7f-e7ae-4709-b81d-01825affa9fb tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a" status: 200 len: 1730 microversion: 2.1 time: 0.359811 Oct 18 15:47:42.362045 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2456/4907] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:41 2022] GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a => generated 1730 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:42.386133 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-953c6514-a34a-4fae-97a6-41dbe41deaea tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:42.387037 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-953c6514-a34a-4fae-97a6-41dbe41deaea tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 5e83c779-c8f8-4ebd-84ab-7f144ab8552a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:42.394562 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-953c6514-a34a-4fae-97a6-41dbe41deaea tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:42.395508 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-953c6514-a34a-4fae-97a6-41dbe41deaea tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:42.396183 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-953c6514-a34a-4fae-97a6-41dbe41deaea tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:42.397160 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-953c6514-a34a-4fae-97a6-41dbe41deaea tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:42.398561 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-953c6514-a34a-4fae-97a6-41dbe41deaea tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:42.399902 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-953c6514-a34a-4fae-97a6-41dbe41deaea tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:42.618508 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-953c6514-a34a-4fae-97a6-41dbe41deaea tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.236934 Oct 18 15:47:42.628441 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2457/4908] 10.222.0.60 () {58 vars in 1275 bytes} [Tue Oct 18 15:47:42 2022] GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a/os-interface => generated 285 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:47:42.803789 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0e384fa8-6db3-4291-a243-7ded4a2ca584 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370aba28a5264618a3ca0c82246ed847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f1a15bab624a0e8554e9f929f8520e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:42.812312 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0e384fa8-6db3-4291-a243-7ded4a2ca584 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] 10.222.0.60 "GET /compute/v2.1/servers/8ad81e1b-5d0b-4569-a058-b84881b87164" status: 200 len: 1314 microversion: 2.1 time: 0.524417 Oct 18 15:47:42.824834 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2452/4909] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:42 2022] GET /compute/v2.1/servers/8ad81e1b-5d0b-4569-a058-b84881b87164 => generated 1314 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:42.859353 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ecdb8ef8-b430-4234-acab-085b7fcd89f3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-137981992", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b620f396-c013-4ed8-97b8-413293fcbd43"}], "security_groups": [{"name": "tempest-securitygroup--1320102380"}], "key_name": "tempest-keypair-305544900", "user_data": "}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:47:43.026050 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-465f3a43-c9c0-435a-9e9a-a386d64c9727 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:43.028932 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-465f3a43-c9c0-435a-9e9a-a386d64c9727 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 41390db3-b9c7-4260-82d1-72bad9b9b0cc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:43.041000 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-465f3a43-c9c0-435a-9e9a-a386d64c9727 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:43.042874 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-465f3a43-c9c0-435a-9e9a-a386d64c9727 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:43.044141 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-465f3a43-c9c0-435a-9e9a-a386d64c9727 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:43.045287 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-465f3a43-c9c0-435a-9e9a-a386d64c9727 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:43.045955 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-465f3a43-c9c0-435a-9e9a-a386d64c9727 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:43.055720 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-465f3a43-c9c0-435a-9e9a-a386d64c9727 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:43.074212 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-ecdb8ef8-b430-4234-acab-085b7fcd89f3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] validate_networks() for [('b620f396-c013-4ed8-97b8-413293fcbd43', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:47:43.425952 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-465f3a43-c9c0-435a-9e9a-a386d64c9727 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:43.441276 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-465f3a43-c9c0-435a-9e9a-a386d64c9727 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc" status: 200 len: 1314 microversion: 2.1 time: 0.422834 Oct 18 15:47:43.448261 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2453/4910] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:43 2022] GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc => generated 1314 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:47:43.453723 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-a82ca97c-c421-406c-92df-b526e3a6150a req-390f3a8f-e8b5-4459-890e-eee2c42f02ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ad81e1b-5d0b-4569-a058-b84881b87164", "name": "network-vif-plugged", "status": "completed", "tag": "b9bd1e2a-b766-4326-88b6-df060e634233"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:47:43.470594 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a82ca97c-c421-406c-92df-b526e3a6150a req-390f3a8f-e8b5-4459-890e-eee2c42f02ba service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:43.471496 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a82ca97c-c421-406c-92df-b526e3a6150a req-390f3a8f-e8b5-4459-890e-eee2c42f02ba service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:43.472109 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a82ca97c-c421-406c-92df-b526e3a6150a req-390f3a8f-e8b5-4459-890e-eee2c42f02ba service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:43.487696 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-a82ca97c-c421-406c-92df-b526e3a6150a req-390f3a8f-e8b5-4459-890e-eee2c42f02ba service nova] Creating event network-vif-plugged:b9bd1e2a-b766-4326-88b6-df060e634233 for instance 8ad81e1b-5d0b-4569-a058-b84881b87164 on n-h1-853682-5 Oct 18 15:47:43.494108 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-a82ca97c-c421-406c-92df-b526e3a6150a req-390f3a8f-e8b5-4459-890e-eee2c42f02ba service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043822 Oct 18 15:47:43.495060 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2454/4911] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:47:43.502703 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bc8a2e87-73f5-4503-bf44-71671b6ce7d1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:43.503689 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bc8a2e87-73f5-4503-bf44-71671b6ce7d1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 2bf616f3-a9f8-4801-8fae-5056b3ba6598] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:43.511697 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc8a2e87-73f5-4503-bf44-71671b6ce7d1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:43.512636 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc8a2e87-73f5-4503-bf44-71671b6ce7d1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:43.513311 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc8a2e87-73f5-4503-bf44-71671b6ce7d1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:43.514274 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc8a2e87-73f5-4503-bf44-71671b6ce7d1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:43.514921 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc8a2e87-73f5-4503-bf44-71671b6ce7d1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:43.515533 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc8a2e87-73f5-4503-bf44-71671b6ce7d1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:44.439455 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bc8a2e87-73f5-4503-bf44-71671b6ce7d1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:44.477316 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bc8a2e87-73f5-4503-bf44-71671b6ce7d1 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/2bf616f3-a9f8-4801-8fae-5056b3ba6598" status: 200 len: 1317 microversion: 2.1 time: 0.980677 Oct 18 15:47:44.479860 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2455/4912] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:43 2022] GET /compute/v2.1/servers/2bf616f3-a9f8-4801-8fae-5056b3ba6598 => generated 1317 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:44.486243 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-82d45111-6f70-44aa-9626-824d391c6f74 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:44.487007 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-82d45111-6f70-44aa-9626-824d391c6f74 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] [instance: 8ad81e1b-5d0b-4569-a058-b84881b87164] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:44.496067 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82d45111-6f70-44aa-9626-824d391c6f74 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:44.496939 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82d45111-6f70-44aa-9626-824d391c6f74 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:44.497433 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82d45111-6f70-44aa-9626-824d391c6f74 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:44.498412 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82d45111-6f70-44aa-9626-824d391c6f74 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:44.498986 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82d45111-6f70-44aa-9626-824d391c6f74 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:44.499470 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82d45111-6f70-44aa-9626-824d391c6f74 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:44.545426 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-ecdb8ef8-b430-4234-acab-085b7fcd89f3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:47:44.545977 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-ecdb8ef8-b430-4234-acab-085b7fcd89f3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:47:44.546693 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-ecdb8ef8-b430-4234-acab-085b7fcd89f3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:47:44.547197 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-ecdb8ef8-b430-4234-acab-085b7fcd89f3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:47:44.547852 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-ecdb8ef8-b430-4234-acab-085b7fcd89f3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:47:44.557645 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ecdb8ef8-b430-4234-acab-085b7fcd89f3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:44.558204 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ecdb8ef8-b430-4234-acab-085b7fcd89f3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:44.558737 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ecdb8ef8-b430-4234-acab-085b7fcd89f3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:44.559599 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ecdb8ef8-b430-4234-acab-085b7fcd89f3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:44.560278 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ecdb8ef8-b430-4234-acab-085b7fcd89f3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:44.560948 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ecdb8ef8-b430-4234-acab-085b7fcd89f3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:44.583892 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-ecdb8ef8-b430-4234-acab-085b7fcd89f3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Getting quotas for project 2e4cd8880d3b47ad9098b2097c0563a2. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:47:44.589936 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-ecdb8ef8-b430-4234-acab-085b7fcd89f3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Getting quotas for user e7f068c2e39541fb8d82265702a3179a and project 2e4cd8880d3b47ad9098b2097c0563a2. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:47:44.604173 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ecdb8ef8-b430-4234-acab-085b7fcd89f3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:47:44.606931 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ecdb8ef8-b430-4234-acab-085b7fcd89f3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:47:44.660081 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ecdb8ef8-b430-4234-acab-085b7fcd89f3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.809844 Oct 18 15:47:44.668098 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2458/4913] 10.222.0.60 () {62 vars in 1188 bytes} [Tue Oct 18 15:47:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 1818 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 18 15:47:44.673461 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-32fd8224-2404-4239-85bb-ae69336faef9 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:44.674256 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-32fd8224-2404-4239-85bb-ae69336faef9 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 41390db3-b9c7-4260-82d1-72bad9b9b0cc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:44.679535 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-82d45111-6f70-44aa-9626-824d391c6f74 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370aba28a5264618a3ca0c82246ed847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f1a15bab624a0e8554e9f929f8520e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:44.688045 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-32fd8224-2404-4239-85bb-ae69336faef9 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:44.690556 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-32fd8224-2404-4239-85bb-ae69336faef9 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:44.691516 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-32fd8224-2404-4239-85bb-ae69336faef9 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:44.692774 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-32fd8224-2404-4239-85bb-ae69336faef9 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:44.693480 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-32fd8224-2404-4239-85bb-ae69336faef9 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:44.694121 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-32fd8224-2404-4239-85bb-ae69336faef9 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:44.696449 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-82d45111-6f70-44aa-9626-824d391c6f74 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] 10.222.0.60 "GET /compute/v2.1/servers/8ad81e1b-5d0b-4569-a058-b84881b87164" status: 200 len: 1314 microversion: 2.1 time: 0.214189 Oct 18 15:47:44.698601 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2456/4914] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:44 2022] GET /compute/v2.1/servers/8ad81e1b-5d0b-4569-a058-b84881b87164 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:44.706815 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bcdc9fe0-9457-428b-897c-d628c4bcf9ae tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:44.707675 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bcdc9fe0-9457-428b-897c-d628c4bcf9ae tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:44.806296 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bcdc9fe0-9457-428b-897c-d628c4bcf9ae tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:44.851971 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bcdc9fe0-9457-428b-897c-d628c4bcf9ae tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:44.853575 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bcdc9fe0-9457-428b-897c-d628c4bcf9ae tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:44.855282 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bcdc9fe0-9457-428b-897c-d628c4bcf9ae tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1280 microversion: 2.20 time: 0.155578 Oct 18 15:47:44.856189 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2457/4915] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:47:44 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1280 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:47:44.914832 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-32fd8224-2404-4239-85bb-ae69336faef9 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:44.930224 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-32fd8224-2404-4239-85bb-ae69336faef9 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc" status: 200 len: 1314 microversion: 2.1 time: 0.260633 Oct 18 15:47:44.941851 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2459/4916] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:44 2022] GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:45.143100 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-fa60a484-a81b-4c13-9fce-6d784fb12d11 req-5c668365-d7dc-44f6-b6b3-e57d4761e9fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e83c779-c8f8-4ebd-84ab-7f144ab8552a", "tag": "6427e7c0-691b-4a13-83be-346caf570d9c"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:47:45.169500 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-fa60a484-a81b-4c13-9fce-6d784fb12d11 req-5c668365-d7dc-44f6-b6b3-e57d4761e9fd service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:45.170028 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-fa60a484-a81b-4c13-9fce-6d784fb12d11 req-5c668365-d7dc-44f6-b6b3-e57d4761e9fd service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:45.170469 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-fa60a484-a81b-4c13-9fce-6d784fb12d11 req-5c668365-d7dc-44f6-b6b3-e57d4761e9fd service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:45.185556 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-fa60a484-a81b-4c13-9fce-6d784fb12d11 req-5c668365-d7dc-44f6-b6b3-e57d4761e9fd service nova] Creating event network-changed:6427e7c0-691b-4a13-83be-346caf570d9c for instance 5e83c779-c8f8-4ebd-84ab-7f144ab8552a on n-h1-853682-5 Oct 18 15:47:45.195498 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-fa60a484-a81b-4c13-9fce-6d784fb12d11 req-5c668365-d7dc-44f6-b6b3-e57d4761e9fd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056250 Oct 18 15:47:45.196962 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2458/4917] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:47:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:47:45.521048 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-83cd7519-6520-4b84-814a-da63a56e9773 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:45.522788 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-83cd7519-6520-4b84-814a-da63a56e9773 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 2bf616f3-a9f8-4801-8fae-5056b3ba6598] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:45.527961 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-01ce1c89-7863-4259-bfe8-de655dd27bf8 req-3e4fa4fe-0b72-4b3f-ae5b-fb968e23ca2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bf616f3-a9f8-4801-8fae-5056b3ba6598", "name": "network-vif-plugged", "status": "completed", "tag": "d81aaf80-478d-4eca-96d6-659964a3e785"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:47:45.542458 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-83cd7519-6520-4b84-814a-da63a56e9773 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:45.542981 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-83cd7519-6520-4b84-814a-da63a56e9773 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:45.543647 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-01ce1c89-7863-4259-bfe8-de655dd27bf8 req-3e4fa4fe-0b72-4b3f-ae5b-fb968e23ca2b service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:45.544318 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-01ce1c89-7863-4259-bfe8-de655dd27bf8 req-3e4fa4fe-0b72-4b3f-ae5b-fb968e23ca2b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:45.544650 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-83cd7519-6520-4b84-814a-da63a56e9773 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:45.545201 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-01ce1c89-7863-4259-bfe8-de655dd27bf8 req-3e4fa4fe-0b72-4b3f-ae5b-fb968e23ca2b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:45.549378 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-83cd7519-6520-4b84-814a-da63a56e9773 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:45.549851 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-83cd7519-6520-4b84-814a-da63a56e9773 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:45.550286 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-83cd7519-6520-4b84-814a-da63a56e9773 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:45.577914 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-01ce1c89-7863-4259-bfe8-de655dd27bf8 req-3e4fa4fe-0b72-4b3f-ae5b-fb968e23ca2b service nova] Creating event network-vif-plugged:d81aaf80-478d-4eca-96d6-659964a3e785 for instance 2bf616f3-a9f8-4801-8fae-5056b3ba6598 on n-h2-853682-5 Oct 18 15:47:45.584532 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-01ce1c89-7863-4259-bfe8-de655dd27bf8 req-3e4fa4fe-0b72-4b3f-ae5b-fb968e23ca2b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061636 Oct 18 15:47:45.591965 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2459/4918] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:47:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:47:45.723291 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-15dbd085-45d0-498e-96fa-efb15516ddeb tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:45.724466 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-15dbd085-45d0-498e-96fa-efb15516ddeb tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] [instance: 8ad81e1b-5d0b-4569-a058-b84881b87164] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:45.751319 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15dbd085-45d0-498e-96fa-efb15516ddeb tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:45.752158 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15dbd085-45d0-498e-96fa-efb15516ddeb tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:45.753406 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15dbd085-45d0-498e-96fa-efb15516ddeb tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:45.754633 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15dbd085-45d0-498e-96fa-efb15516ddeb tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:45.755318 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15dbd085-45d0-498e-96fa-efb15516ddeb tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:45.755950 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15dbd085-45d0-498e-96fa-efb15516ddeb tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:46.068071 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-83cd7519-6520-4b84-814a-da63a56e9773 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:46.078160 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-83cd7519-6520-4b84-814a-da63a56e9773 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/2bf616f3-a9f8-4801-8fae-5056b3ba6598" status: 200 len: 1317 microversion: 2.1 time: 0.580638 Oct 18 15:47:46.081012 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2460/4919] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:45 2022] GET /compute/v2.1/servers/2bf616f3-a9f8-4801-8fae-5056b3ba6598 => generated 1317 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:46.101788 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e762116b-cdba-4ee3-afc7-2b1bad278e50 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:46.102528 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e762116b-cdba-4ee3-afc7-2b1bad278e50 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:46.109422 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e762116b-cdba-4ee3-afc7-2b1bad278e50 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:46.109928 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e762116b-cdba-4ee3-afc7-2b1bad278e50 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:46.110372 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e762116b-cdba-4ee3-afc7-2b1bad278e50 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:46.111137 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e762116b-cdba-4ee3-afc7-2b1bad278e50 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:46.111589 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e762116b-cdba-4ee3-afc7-2b1bad278e50 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:46.112019 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e762116b-cdba-4ee3-afc7-2b1bad278e50 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:46.254374 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e762116b-cdba-4ee3-afc7-2b1bad278e50 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:46.266211 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e762116b-cdba-4ee3-afc7-2b1bad278e50 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:46.267674 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e762116b-cdba-4ee3-afc7-2b1bad278e50 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:46.268797 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e762116b-cdba-4ee3-afc7-2b1bad278e50 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1332 microversion: 2.20 time: 0.186672 Oct 18 15:47:46.271343 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2461/4920] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:47:46 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1332 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:47:46.279310 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c294ef40-74ea-4a93-b15b-6260caf2f083 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:46.280002 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c294ef40-74ea-4a93-b15b-6260caf2f083 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 41390db3-b9c7-4260-82d1-72bad9b9b0cc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:46.286882 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c294ef40-74ea-4a93-b15b-6260caf2f083 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:46.288199 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c294ef40-74ea-4a93-b15b-6260caf2f083 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:46.289365 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c294ef40-74ea-4a93-b15b-6260caf2f083 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:46.290241 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c294ef40-74ea-4a93-b15b-6260caf2f083 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:46.290854 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c294ef40-74ea-4a93-b15b-6260caf2f083 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:46.291783 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c294ef40-74ea-4a93-b15b-6260caf2f083 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:46.309559 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-15dbd085-45d0-498e-96fa-efb15516ddeb tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370aba28a5264618a3ca0c82246ed847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f1a15bab624a0e8554e9f929f8520e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:46.326429 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-15dbd085-45d0-498e-96fa-efb15516ddeb tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] 10.222.0.60 "GET /compute/v2.1/servers/8ad81e1b-5d0b-4569-a058-b84881b87164" status: 200 len: 1503 microversion: 2.1 time: 0.608160 Oct 18 15:47:46.327600 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2460/4921] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:45 2022] GET /compute/v2.1/servers/8ad81e1b-5d0b-4569-a058-b84881b87164 => generated 1503 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:46.352743 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-db0fa733-f174-460c-981b-175d68683fa5 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:46.353733 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-db0fa733-f174-460c-981b-175d68683fa5 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] [instance: 8ad81e1b-5d0b-4569-a058-b84881b87164] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:46.363316 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db0fa733-f174-460c-981b-175d68683fa5 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:46.363816 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db0fa733-f174-460c-981b-175d68683fa5 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:46.364257 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db0fa733-f174-460c-981b-175d68683fa5 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:46.365011 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db0fa733-f174-460c-981b-175d68683fa5 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:46.365469 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db0fa733-f174-460c-981b-175d68683fa5 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:46.370157 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db0fa733-f174-460c-981b-175d68683fa5 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:46.491796 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-db0fa733-f174-460c-981b-175d68683fa5 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8ad81e1b-5d0b-4569-a058-b84881b87164/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.143112 Oct 18 15:47:46.492541 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2461/4922] 10.222.0.60 () {58 vars in 1296 bytes} [Tue Oct 18 15:47:46 2022] DELETE /compute/v2.1/servers/8ad81e1b-5d0b-4569-a058-b84881b87164/os-server-password => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 15:47:46.503569 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dbe3b6ff-c22e-44a3-a4ae-ea8fda4c3b74 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:46.504416 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dbe3b6ff-c22e-44a3-a4ae-ea8fda4c3b74 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] [instance: 8ad81e1b-5d0b-4569-a058-b84881b87164] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:46.513320 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dbe3b6ff-c22e-44a3-a4ae-ea8fda4c3b74 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:46.514153 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dbe3b6ff-c22e-44a3-a4ae-ea8fda4c3b74 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:46.514836 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dbe3b6ff-c22e-44a3-a4ae-ea8fda4c3b74 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:46.515826 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dbe3b6ff-c22e-44a3-a4ae-ea8fda4c3b74 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:46.516519 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dbe3b6ff-c22e-44a3-a4ae-ea8fda4c3b74 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:46.517206 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dbe3b6ff-c22e-44a3-a4ae-ea8fda4c3b74 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:46.554485 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dbe3b6ff-c22e-44a3-a4ae-ea8fda4c3b74 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] 10.222.0.60 "GET /compute/v2.1/servers/8ad81e1b-5d0b-4569-a058-b84881b87164/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.055795 Oct 18 15:47:46.561809 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2462/4923] 10.222.0.60 () {58 vars in 1293 bytes} [Tue Oct 18 15:47:46 2022] GET /compute/v2.1/servers/8ad81e1b-5d0b-4569-a058-b84881b87164/os-server-password => generated 16 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:47:46.567022 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-42468e0d-ccaa-437d-897c-6e7089baab5f tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:46.569226 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-42468e0d-ccaa-437d-897c-6e7089baab5f tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] [instance: 8ad81e1b-5d0b-4569-a058-b84881b87164] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:46.578425 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42468e0d-ccaa-437d-897c-6e7089baab5f tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:46.579307 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42468e0d-ccaa-437d-897c-6e7089baab5f tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:46.579996 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42468e0d-ccaa-437d-897c-6e7089baab5f tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:46.580988 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42468e0d-ccaa-437d-897c-6e7089baab5f tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:46.582662 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42468e0d-ccaa-437d-897c-6e7089baab5f tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:46.583348 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42468e0d-ccaa-437d-897c-6e7089baab5f tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:46.625301 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-42468e0d-ccaa-437d-897c-6e7089baab5f tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] [instance: 8ad81e1b-5d0b-4569-a058-b84881b87164] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:47:46.779784 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-42468e0d-ccaa-437d-897c-6e7089baab5f tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8ad81e1b-5d0b-4569-a058-b84881b87164" status: 204 len: 0 microversion: 2.1 time: 0.215170 Oct 18 15:47:46.786298 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2463/4924] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:47:46 2022] DELETE /compute/v2.1/servers/8ad81e1b-5d0b-4569-a058-b84881b87164 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:47:46.794211 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cc2183a3-156b-40e7-b777-44dd7da3835e tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:46.808004 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c294ef40-74ea-4a93-b15b-6260caf2f083 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:46.809175 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cc2183a3-156b-40e7-b777-44dd7da3835e tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] [instance: 8ad81e1b-5d0b-4569-a058-b84881b87164] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:46.818191 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:46.821983 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cc2183a3-156b-40e7-b777-44dd7da3835e tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:46.823202 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cc2183a3-156b-40e7-b777-44dd7da3835e tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:46.825287 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cc2183a3-156b-40e7-b777-44dd7da3835e tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:46.826375 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cc2183a3-156b-40e7-b777-44dd7da3835e tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:46.827586 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cc2183a3-156b-40e7-b777-44dd7da3835e tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:46.829067 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cc2183a3-156b-40e7-b777-44dd7da3835e tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:46.831364 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c294ef40-74ea-4a93-b15b-6260caf2f083 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc" status: 200 len: 1314 microversion: 2.1 time: 0.547064 Oct 18 15:47:46.833351 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2462/4925] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:46 2022] GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc => generated 1314 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:47.065507 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cc2183a3-156b-40e7-b777-44dd7da3835e tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370aba28a5264618a3ca0c82246ed847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f1a15bab624a0e8554e9f929f8520e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:47.095020 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cc2183a3-156b-40e7-b777-44dd7da3835e tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] 10.222.0.60 "GET /compute/v2.1/servers/8ad81e1b-5d0b-4569-a058-b84881b87164" status: 200 len: 1509 microversion: 2.1 time: 0.306904 Oct 18 15:47:47.096843 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2464/4926] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:46 2022] GET /compute/v2.1/servers/8ad81e1b-5d0b-4569-a058-b84881b87164 => generated 1509 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:47.107662 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8438d91b-6072-47cb-8be0-1848fe96717b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:47.108277 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8438d91b-6072-47cb-8be0-1848fe96717b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 2bf616f3-a9f8-4801-8fae-5056b3ba6598] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:47.121079 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8438d91b-6072-47cb-8be0-1848fe96717b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:47.121905 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8438d91b-6072-47cb-8be0-1848fe96717b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:47.122584 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8438d91b-6072-47cb-8be0-1848fe96717b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:47.123569 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8438d91b-6072-47cb-8be0-1848fe96717b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:47.124384 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8438d91b-6072-47cb-8be0-1848fe96717b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:47.125060 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8438d91b-6072-47cb-8be0-1848fe96717b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:47.218099 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-55186a56-7369-4ddf-a2e2-37111c83be44 req-c1b291e8-58cc-4868-af5a-203888fe2041 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e83c779-c8f8-4ebd-84ab-7f144ab8552a", "tag": "6427e7c0-691b-4a13-83be-346caf570d9c"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:47:47.238060 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-55186a56-7369-4ddf-a2e2-37111c83be44 req-c1b291e8-58cc-4868-af5a-203888fe2041 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:47.238876 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-55186a56-7369-4ddf-a2e2-37111c83be44 req-c1b291e8-58cc-4868-af5a-203888fe2041 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:47.240378 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-55186a56-7369-4ddf-a2e2-37111c83be44 req-c1b291e8-58cc-4868-af5a-203888fe2041 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:47.255910 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-55186a56-7369-4ddf-a2e2-37111c83be44 req-c1b291e8-58cc-4868-af5a-203888fe2041 service nova] Creating event network-changed:6427e7c0-691b-4a13-83be-346caf570d9c for instance 5e83c779-c8f8-4ebd-84ab-7f144ab8552a on n-h1-853682-5 Oct 18 15:47:47.262473 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-55186a56-7369-4ddf-a2e2-37111c83be44 req-c1b291e8-58cc-4868-af5a-203888fe2041 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050622 Oct 18 15:47:47.263526 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2465/4927] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:47:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:47:47.301885 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-36b68867-8dbd-447b-a3b8-5e9bab2eb15f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:47.303096 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-36b68867-8dbd-447b-a3b8-5e9bab2eb15f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:47.313171 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36b68867-8dbd-447b-a3b8-5e9bab2eb15f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:47.315077 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36b68867-8dbd-447b-a3b8-5e9bab2eb15f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:47.316104 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36b68867-8dbd-447b-a3b8-5e9bab2eb15f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:47.317509 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36b68867-8dbd-447b-a3b8-5e9bab2eb15f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:47.318142 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36b68867-8dbd-447b-a3b8-5e9bab2eb15f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:47.318708 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36b68867-8dbd-447b-a3b8-5e9bab2eb15f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:47.403363 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8438d91b-6072-47cb-8be0-1848fe96717b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:47.408451 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-36b68867-8dbd-447b-a3b8-5e9bab2eb15f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:47.412750 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8438d91b-6072-47cb-8be0-1848fe96717b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/2bf616f3-a9f8-4801-8fae-5056b3ba6598" status: 200 len: 1317 microversion: 2.1 time: 0.308868 Oct 18 15:47:47.430590 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-36b68867-8dbd-447b-a3b8-5e9bab2eb15f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:47.430590 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-36b68867-8dbd-447b-a3b8-5e9bab2eb15f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:47.430590 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-36b68867-8dbd-447b-a3b8-5e9bab2eb15f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1350 microversion: 2.20 time: 0.127765 Oct 18 15:47:47.430590 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2466/4928] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:47:47 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1350 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:47:47.432006 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2463/4929] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:47 2022] GET /compute/v2.1/servers/2bf616f3-a9f8-4801-8fae-5056b3ba6598 => generated 1317 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:47.855797 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bd4294f2-3027-4a31-910c-b0a9595f88e3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:47.856699 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bd4294f2-3027-4a31-910c-b0a9595f88e3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 41390db3-b9c7-4260-82d1-72bad9b9b0cc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:47.863572 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd4294f2-3027-4a31-910c-b0a9595f88e3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:47.864089 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd4294f2-3027-4a31-910c-b0a9595f88e3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:47.864531 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd4294f2-3027-4a31-910c-b0a9595f88e3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:47.865533 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd4294f2-3027-4a31-910c-b0a9595f88e3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:47.866131 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd4294f2-3027-4a31-910c-b0a9595f88e3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:47.866709 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd4294f2-3027-4a31-910c-b0a9595f88e3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:47.883183 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:48.120373 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-81b59252-1ed5-41f4-9555-ccece904ed17 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:48.121249 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-81b59252-1ed5-41f4-9555-ccece904ed17 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] [instance: 8ad81e1b-5d0b-4569-a058-b84881b87164] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:48.128324 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-81b59252-1ed5-41f4-9555-ccece904ed17 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:48.128850 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-81b59252-1ed5-41f4-9555-ccece904ed17 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:48.129313 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-81b59252-1ed5-41f4-9555-ccece904ed17 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:48.130065 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-81b59252-1ed5-41f4-9555-ccece904ed17 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:48.130535 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-81b59252-1ed5-41f4-9555-ccece904ed17 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:48.133013 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-81b59252-1ed5-41f4-9555-ccece904ed17 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:48.589928 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bd4294f2-3027-4a31-910c-b0a9595f88e3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:48.598536 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bd4294f2-3027-4a31-910c-b0a9595f88e3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc" status: 200 len: 1314 microversion: 2.1 time: 0.747349 Oct 18 15:47:48.602474 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2467/4930] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:47 2022] GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc => generated 1314 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:48.607960 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-45e01b63-4f03-41c3-984a-11063d48e300 req-41d784e6-0d6d-4442-a91d-1381460592e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41390db3-b9c7-4260-82d1-72bad9b9b0cc", "name": "network-vif-plugged", "status": "completed", "tag": "330a6dfe-e580-4dce-8a6e-1e1cd0081a73"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:47:48.621373 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-45e01b63-4f03-41c3-984a-11063d48e300 req-41d784e6-0d6d-4442-a91d-1381460592e7 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:48.622092 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-45e01b63-4f03-41c3-984a-11063d48e300 req-41d784e6-0d6d-4442-a91d-1381460592e7 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:48.622786 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-45e01b63-4f03-41c3-984a-11063d48e300 req-41d784e6-0d6d-4442-a91d-1381460592e7 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:48.662238 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-45e01b63-4f03-41c3-984a-11063d48e300 req-41d784e6-0d6d-4442-a91d-1381460592e7 service nova] Creating event network-vif-plugged:330a6dfe-e580-4dce-8a6e-1e1cd0081a73 for instance 41390db3-b9c7-4260-82d1-72bad9b9b0cc on n-h2-853682-5 Oct 18 15:47:48.668585 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-45e01b63-4f03-41c3-984a-11063d48e300 req-41d784e6-0d6d-4442-a91d-1381460592e7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068173 Oct 18 15:47:48.669569 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2468/4931] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:47:48.678594 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ec9367d8-cdf3-42ec-893b-c9bd7e7c70ff tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:48.679900 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ec9367d8-cdf3-42ec-893b-c9bd7e7c70ff tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 2bf616f3-a9f8-4801-8fae-5056b3ba6598] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:48.688523 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec9367d8-cdf3-42ec-893b-c9bd7e7c70ff tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:48.696451 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec9367d8-cdf3-42ec-893b-c9bd7e7c70ff tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:48.696451 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec9367d8-cdf3-42ec-893b-c9bd7e7c70ff tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:48.697655 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec9367d8-cdf3-42ec-893b-c9bd7e7c70ff tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:48.697858 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec9367d8-cdf3-42ec-893b-c9bd7e7c70ff tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:48.698269 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec9367d8-cdf3-42ec-893b-c9bd7e7c70ff tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:48.890397 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-81b59252-1ed5-41f4-9555-ccece904ed17 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370aba28a5264618a3ca0c82246ed847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f1a15bab624a0e8554e9f929f8520e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:48.901650 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-81b59252-1ed5-41f4-9555-ccece904ed17 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] 10.222.0.60 "GET /compute/v2.1/servers/8ad81e1b-5d0b-4569-a058-b84881b87164" status: 200 len: 1509 microversion: 2.1 time: 0.785571 Oct 18 15:47:48.914955 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2464/4932] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:48 2022] GET /compute/v2.1/servers/8ad81e1b-5d0b-4569-a058-b84881b87164 => generated 1509 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:47:48.926023 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-09a82c00-6f6d-47ed-874e-52db73256cf1 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:48.926650 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-09a82c00-6f6d-47ed-874e-52db73256cf1 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:48.939995 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09a82c00-6f6d-47ed-874e-52db73256cf1 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:48.940932 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09a82c00-6f6d-47ed-874e-52db73256cf1 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:48.941640 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09a82c00-6f6d-47ed-874e-52db73256cf1 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:48.942787 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09a82c00-6f6d-47ed-874e-52db73256cf1 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:48.943946 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09a82c00-6f6d-47ed-874e-52db73256cf1 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:48.944625 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09a82c00-6f6d-47ed-874e-52db73256cf1 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:49.155244 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-09a82c00-6f6d-47ed-874e-52db73256cf1 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:49.165115 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-09a82c00-6f6d-47ed-874e-52db73256cf1 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:49.167067 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-09a82c00-6f6d-47ed-874e-52db73256cf1 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:49.168475 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-09a82c00-6f6d-47ed-874e-52db73256cf1 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1338 microversion: 2.20 time: 0.252306 Oct 18 15:47:49.169706 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2465/4933] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:47:48 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1338 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:47:49.207158 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ec9367d8-cdf3-42ec-893b-c9bd7e7c70ff tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:49.217500 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ec9367d8-cdf3-42ec-893b-c9bd7e7c70ff tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/2bf616f3-a9f8-4801-8fae-5056b3ba6598" status: 200 len: 1506 microversion: 2.1 time: 0.543941 Oct 18 15:47:49.218094 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2469/4934] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:48 2022] GET /compute/v2.1/servers/2bf616f3-a9f8-4801-8fae-5056b3ba6598 => generated 1506 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:49.241128 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f4978d3d-fdf6-48ae-b6aa-75b3fa976101 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:49.241922 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f4978d3d-fdf6-48ae-b6aa-75b3fa976101 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 2bf616f3-a9f8-4801-8fae-5056b3ba6598] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:49.249131 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f4978d3d-fdf6-48ae-b6aa-75b3fa976101 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:49.249762 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f4978d3d-fdf6-48ae-b6aa-75b3fa976101 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:49.250306 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f4978d3d-fdf6-48ae-b6aa-75b3fa976101 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:49.251117 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f4978d3d-fdf6-48ae-b6aa-75b3fa976101 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:49.251670 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f4978d3d-fdf6-48ae-b6aa-75b3fa976101 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:49.252489 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f4978d3d-fdf6-48ae-b6aa-75b3fa976101 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:49.622748 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7947054d-a1e9-4edd-a346-70f93451679a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:49.623785 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7947054d-a1e9-4edd-a346-70f93451679a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 41390db3-b9c7-4260-82d1-72bad9b9b0cc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:49.631338 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7947054d-a1e9-4edd-a346-70f93451679a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:49.632794 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7947054d-a1e9-4edd-a346-70f93451679a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:49.633726 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7947054d-a1e9-4edd-a346-70f93451679a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:49.635378 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7947054d-a1e9-4edd-a346-70f93451679a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:49.636063 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7947054d-a1e9-4edd-a346-70f93451679a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:49.636729 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7947054d-a1e9-4edd-a346-70f93451679a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:50.050087 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f4978d3d-fdf6-48ae-b6aa-75b3fa976101 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:50.058869 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f4978d3d-fdf6-48ae-b6aa-75b3fa976101 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/2bf616f3-a9f8-4801-8fae-5056b3ba6598" status: 200 len: 1506 microversion: 2.1 time: 0.821603 Oct 18 15:47:50.072880 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2466/4935] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:49 2022] GET /compute/v2.1/servers/2bf616f3-a9f8-4801-8fae-5056b3ba6598 => generated 1506 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:50.072880 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4aabb3f5-bfea-4a45-9699-2ce487216240 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:50.072880 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4aabb3f5-bfea-4a45-9699-2ce487216240 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] [instance: 8ad81e1b-5d0b-4569-a058-b84881b87164] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:50.076652 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4aabb3f5-bfea-4a45-9699-2ce487216240 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:50.077580 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4aabb3f5-bfea-4a45-9699-2ce487216240 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:50.078359 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4aabb3f5-bfea-4a45-9699-2ce487216240 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:50.079877 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4aabb3f5-bfea-4a45-9699-2ce487216240 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:50.080352 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4aabb3f5-bfea-4a45-9699-2ce487216240 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:50.080790 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4aabb3f5-bfea-4a45-9699-2ce487216240 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:50.769290 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7947054d-a1e9-4edd-a346-70f93451679a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:50.777667 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7947054d-a1e9-4edd-a346-70f93451679a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc" status: 200 len: 1314 microversion: 2.1 time: 1.159042 Oct 18 15:47:50.778452 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2470/4936] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:49 2022] GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc => generated 1314 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:47:50.782954 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ee7b49db-a685-42c3-a879-ef7d76e15c6e tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:47:50.785347 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ee7b49db-a685-42c3-a879-ef7d76e15c6e tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 2bf616f3-a9f8-4801-8fae-5056b3ba6598] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:50.791898 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee7b49db-a685-42c3-a879-ef7d76e15c6e tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:50.792321 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee7b49db-a685-42c3-a879-ef7d76e15c6e tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:50.792759 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee7b49db-a685-42c3-a879-ef7d76e15c6e tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:50.793516 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee7b49db-a685-42c3-a879-ef7d76e15c6e tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:50.793967 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee7b49db-a685-42c3-a879-ef7d76e15c6e tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:50.794386 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee7b49db-a685-42c3-a879-ef7d76e15c6e tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:50.860116 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ee7b49db-a685-42c3-a879-ef7d76e15c6e tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "PUT /compute/v2.1/servers/2bf616f3-a9f8-4801-8fae-5056b3ba6598" status: 200 len: 1078 microversion: 2.1 time: 0.080549 Oct 18 15:47:50.872834 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2471/4937] 10.222.0.60 () {60 vars in 1256 bytes} [Tue Oct 18 15:47:50 2022] PUT /compute/v2.1/servers/2bf616f3-a9f8-4801-8fae-5056b3ba6598 => generated 1078 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:50.878238 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-e670ca1a-ff83-4f46-9dd0-be3c63580ad1 req-4dccc447-0573-4a3c-95fa-1d7a8416fa34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b465248f-ab7a-4aba-b939-6f236eea166e", "tag": "440cc1c1-492e-40b0-8244-adb2559e6c7f"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:47:50.888979 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e670ca1a-ff83-4f46-9dd0-be3c63580ad1 req-4dccc447-0573-4a3c-95fa-1d7a8416fa34 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:50.889461 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e670ca1a-ff83-4f46-9dd0-be3c63580ad1 req-4dccc447-0573-4a3c-95fa-1d7a8416fa34 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:50.889890 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e670ca1a-ff83-4f46-9dd0-be3c63580ad1 req-4dccc447-0573-4a3c-95fa-1d7a8416fa34 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:50.901638 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-e670ca1a-ff83-4f46-9dd0-be3c63580ad1 req-4dccc447-0573-4a3c-95fa-1d7a8416fa34 service nova] Creating event network-changed:440cc1c1-492e-40b0-8244-adb2559e6c7f for instance b465248f-ab7a-4aba-b939-6f236eea166e on n-h1-853682-5 Oct 18 15:47:50.906545 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-e670ca1a-ff83-4f46-9dd0-be3c63580ad1 req-4dccc447-0573-4a3c-95fa-1d7a8416fa34 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044698 Oct 18 15:47:50.907154 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2472/4938] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:47:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:47:50.912335 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e3db5a82-7b0e-4a9f-9adb-814386ec811f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:50.913065 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e3db5a82-7b0e-4a9f-9adb-814386ec811f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:50.919412 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3db5a82-7b0e-4a9f-9adb-814386ec811f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:50.919892 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3db5a82-7b0e-4a9f-9adb-814386ec811f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:50.920331 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3db5a82-7b0e-4a9f-9adb-814386ec811f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:50.921713 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3db5a82-7b0e-4a9f-9adb-814386ec811f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:50.922180 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3db5a82-7b0e-4a9f-9adb-814386ec811f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:50.922606 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3db5a82-7b0e-4a9f-9adb-814386ec811f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:50.969939 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4aabb3f5-bfea-4a45-9699-2ce487216240 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370aba28a5264618a3ca0c82246ed847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f1a15bab624a0e8554e9f929f8520e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:50.977807 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4aabb3f5-bfea-4a45-9699-2ce487216240 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] 10.222.0.60 "GET /compute/v2.1/servers/8ad81e1b-5d0b-4569-a058-b84881b87164" status: 200 len: 1509 microversion: 2.1 time: 0.916588 Oct 18 15:47:50.978490 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2467/4939] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:50 2022] GET /compute/v2.1/servers/8ad81e1b-5d0b-4569-a058-b84881b87164 => generated 1509 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:50.983019 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-67580183-d0d4-47f2-8e63-4bd0f8289275 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:50.983631 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-67580183-d0d4-47f2-8e63-4bd0f8289275 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 2bf616f3-a9f8-4801-8fae-5056b3ba6598] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:50.990370 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-67580183-d0d4-47f2-8e63-4bd0f8289275 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:50.990857 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-67580183-d0d4-47f2-8e63-4bd0f8289275 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:50.991456 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-67580183-d0d4-47f2-8e63-4bd0f8289275 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:50.992190 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-67580183-d0d4-47f2-8e63-4bd0f8289275 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:50.992649 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-67580183-d0d4-47f2-8e63-4bd0f8289275 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:50.993189 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-67580183-d0d4-47f2-8e63-4bd0f8289275 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:51.494480 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e3db5a82-7b0e-4a9f-9adb-814386ec811f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:51.500949 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-67580183-d0d4-47f2-8e63-4bd0f8289275 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:51.503457 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e3db5a82-7b0e-4a9f-9adb-814386ec811f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:51.504943 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e3db5a82-7b0e-4a9f-9adb-814386ec811f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:51.506081 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e3db5a82-7b0e-4a9f-9adb-814386ec811f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1406 microversion: 2.20 time: 0.597848 Oct 18 15:47:51.507740 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2473/4940] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:47:50 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1406 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:47:51.513002 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-37df788d-64f9-4589-a427-2ca80254f087 req-a32676ce-79ef-4c4b-8459-9e89a5a3c9ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ad81e1b-5d0b-4569-a058-b84881b87164", "name": "network-vif-deleted", "tag": "b9bd1e2a-b766-4326-88b6-df060e634233"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:47:51.522432 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-37df788d-64f9-4589-a427-2ca80254f087 req-a32676ce-79ef-4c4b-8459-9e89a5a3c9ce service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:51.522912 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-37df788d-64f9-4589-a427-2ca80254f087 req-a32676ce-79ef-4c4b-8459-9e89a5a3c9ce service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:51.523342 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-37df788d-64f9-4589-a427-2ca80254f087 req-a32676ce-79ef-4c4b-8459-9e89a5a3c9ce service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:51.523642 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-67580183-d0d4-47f2-8e63-4bd0f8289275 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/2bf616f3-a9f8-4801-8fae-5056b3ba6598" status: 200 len: 1504 microversion: 2.1 time: 0.544110 Oct 18 15:47:51.540830 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2468/4941] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:50 2022] GET /compute/v2.1/servers/2bf616f3-a9f8-4801-8fae-5056b3ba6598 => generated 1504 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:51.549473 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-37df788d-64f9-4589-a427-2ca80254f087 req-a32676ce-79ef-4c4b-8459-9e89a5a3c9ce service nova] Creating event network-vif-deleted:b9bd1e2a-b766-4326-88b6-df060e634233 for instance 8ad81e1b-5d0b-4569-a058-b84881b87164 on n-h1-853682-5 Oct 18 15:47:51.550234 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e9fc314c-0f37-498b-aaa2-0b0e94fc7f0a tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:51.551286 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e9fc314c-0f37-498b-aaa2-0b0e94fc7f0a tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 2bf616f3-a9f8-4801-8fae-5056b3ba6598] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:51.555718 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-37df788d-64f9-4589-a427-2ca80254f087 req-a32676ce-79ef-4c4b-8459-9e89a5a3c9ce service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046389 Oct 18 15:47:51.556205 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2474/4942] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:47:51.557731 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e9fc314c-0f37-498b-aaa2-0b0e94fc7f0a tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:51.558567 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e9fc314c-0f37-498b-aaa2-0b0e94fc7f0a tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:51.558707 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e9fc314c-0f37-498b-aaa2-0b0e94fc7f0a tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:51.559360 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e9fc314c-0f37-498b-aaa2-0b0e94fc7f0a tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:51.559817 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e9fc314c-0f37-498b-aaa2-0b0e94fc7f0a tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:51.560243 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e9fc314c-0f37-498b-aaa2-0b0e94fc7f0a tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:51.802073 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8e1b3058-e4b1-43a6-94e5-70a012004d84 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:51.802877 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8e1b3058-e4b1-43a6-94e5-70a012004d84 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 41390db3-b9c7-4260-82d1-72bad9b9b0cc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:51.809795 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e1b3058-e4b1-43a6-94e5-70a012004d84 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:51.810354 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e1b3058-e4b1-43a6-94e5-70a012004d84 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:51.810978 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e1b3058-e4b1-43a6-94e5-70a012004d84 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:51.811673 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e1b3058-e4b1-43a6-94e5-70a012004d84 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:51.812187 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e1b3058-e4b1-43a6-94e5-70a012004d84 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:51.824959 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e1b3058-e4b1-43a6-94e5-70a012004d84 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:51.892347 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e9fc314c-0f37-498b-aaa2-0b0e94fc7f0a tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:51.900237 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e9fc314c-0f37-498b-aaa2-0b0e94fc7f0a tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/2bf616f3-a9f8-4801-8fae-5056b3ba6598" status: 200 len: 1504 microversion: 2.1 time: 0.354326 Oct 18 15:47:51.909681 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2469/4943] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:51 2022] GET /compute/v2.1/servers/2bf616f3-a9f8-4801-8fae-5056b3ba6598 => generated 1504 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:47:51.924046 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-adb99caf-fb07-41be-917f-a05711cde843 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:47:51.926774 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-adb99caf-fb07-41be-917f-a05711cde843 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 2bf616f3-a9f8-4801-8fae-5056b3ba6598] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:51.936357 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-adb99caf-fb07-41be-917f-a05711cde843 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:51.937083 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-adb99caf-fb07-41be-917f-a05711cde843 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:51.937582 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-adb99caf-fb07-41be-917f-a05711cde843 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:51.938397 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-adb99caf-fb07-41be-917f-a05711cde843 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:51.939296 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-adb99caf-fb07-41be-917f-a05711cde843 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:51.939730 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-adb99caf-fb07-41be-917f-a05711cde843 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:52.011898 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-adb99caf-fb07-41be-917f-a05711cde843 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "PUT /compute/v2.1/servers/2bf616f3-a9f8-4801-8fae-5056b3ba6598" status: 200 len: 1080 microversion: 2.1 time: 0.092073 Oct 18 15:47:52.021493 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2470/4944] 10.222.0.60 () {60 vars in 1256 bytes} [Tue Oct 18 15:47:51 2022] PUT /compute/v2.1/servers/2bf616f3-a9f8-4801-8fae-5056b3ba6598 => generated 1080 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:47:52.029701 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2748e657-0a3e-42fb-ab31-fb6cb534ac72 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:52.030500 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2748e657-0a3e-42fb-ab31-fb6cb534ac72 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] [instance: 8ad81e1b-5d0b-4569-a058-b84881b87164] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:52.039344 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2748e657-0a3e-42fb-ab31-fb6cb534ac72 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:52.040263 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2748e657-0a3e-42fb-ab31-fb6cb534ac72 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:52.040714 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2748e657-0a3e-42fb-ab31-fb6cb534ac72 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:52.041463 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2748e657-0a3e-42fb-ab31-fb6cb534ac72 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:52.041924 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2748e657-0a3e-42fb-ab31-fb6cb534ac72 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:52.042350 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2748e657-0a3e-42fb-ab31-fb6cb534ac72 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:52.144018 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2748e657-0a3e-42fb-ab31-fb6cb534ac72 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370aba28a5264618a3ca0c82246ed847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f1a15bab624a0e8554e9f929f8520e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:52.151078 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8e1b3058-e4b1-43a6-94e5-70a012004d84 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:52.166854 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2748e657-0a3e-42fb-ab31-fb6cb534ac72 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] 10.222.0.60 "GET /compute/v2.1/servers/8ad81e1b-5d0b-4569-a058-b84881b87164" status: 200 len: 1467 microversion: 2.1 time: 0.143968 Oct 18 15:47:52.169941 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8e1b3058-e4b1-43a6-94e5-70a012004d84 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc" status: 200 len: 1502 microversion: 2.1 time: 0.371281 Oct 18 15:47:52.181004 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2471/4945] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:52 2022] GET /compute/v2.1/servers/8ad81e1b-5d0b-4569-a058-b84881b87164 => generated 1467 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:52.181235 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2475/4946] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:51 2022] GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc => generated 1502 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:47:52.181430 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6429ee43-6894-46e6-93b5-c78a1bac21a3 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:52.181430 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6429ee43-6894-46e6-93b5-c78a1bac21a3 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 2bf616f3-a9f8-4801-8fae-5056b3ba6598] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:52.188827 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6429ee43-6894-46e6-93b5-c78a1bac21a3 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:52.188827 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6429ee43-6894-46e6-93b5-c78a1bac21a3 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:52.188827 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6429ee43-6894-46e6-93b5-c78a1bac21a3 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:52.188827 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6429ee43-6894-46e6-93b5-c78a1bac21a3 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:52.188827 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6429ee43-6894-46e6-93b5-c78a1bac21a3 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:52.188827 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6429ee43-6894-46e6-93b5-c78a1bac21a3 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:52.206707 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dc79ee62-3889-4077-9452-739c705cef04 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:47:52.207371 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dc79ee62-3889-4077-9452-739c705cef04 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 41390db3-b9c7-4260-82d1-72bad9b9b0cc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:52.210876 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:52.216559 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc79ee62-3889-4077-9452-739c705cef04 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:52.217297 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc79ee62-3889-4077-9452-739c705cef04 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:52.217847 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc79ee62-3889-4077-9452-739c705cef04 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:52.218786 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc79ee62-3889-4077-9452-739c705cef04 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:52.219375 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc79ee62-3889-4077-9452-739c705cef04 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:52.220149 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc79ee62-3889-4077-9452-739c705cef04 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:52.308167 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dc79ee62-3889-4077-9452-739c705cef04 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "POST /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc/action" status: 202 len: 0 microversion: 2.1 time: 0.105706 Oct 18 15:47:52.312044 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2476/4947] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:47:52 2022] POST /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:47:52.318120 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ee05117e-cb0b-47a8-904f-02f7bf1c60ed tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:52.321005 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ee05117e-cb0b-47a8-904f-02f7bf1c60ed tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 41390db3-b9c7-4260-82d1-72bad9b9b0cc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:52.332373 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee05117e-cb0b-47a8-904f-02f7bf1c60ed tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:52.332947 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee05117e-cb0b-47a8-904f-02f7bf1c60ed tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:52.333385 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee05117e-cb0b-47a8-904f-02f7bf1c60ed tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:52.334450 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee05117e-cb0b-47a8-904f-02f7bf1c60ed tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:52.334940 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee05117e-cb0b-47a8-904f-02f7bf1c60ed tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:52.335943 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee05117e-cb0b-47a8-904f-02f7bf1c60ed tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:52.615563 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6429ee43-6894-46e6-93b5-c78a1bac21a3 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:52.625618 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6429ee43-6894-46e6-93b5-c78a1bac21a3 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/2bf616f3-a9f8-4801-8fae-5056b3ba6598" status: 200 len: 1506 microversion: 2.1 time: 0.452429 Oct 18 15:47:52.626899 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2472/4948] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:52 2022] GET /compute/v2.1/servers/2bf616f3-a9f8-4801-8fae-5056b3ba6598 => generated 1506 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:52.633665 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a723172d-944c-4f99-abb0-abb3d4570bf9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:52.636195 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a723172d-944c-4f99-abb0-abb3d4570bf9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:52.642086 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ee05117e-cb0b-47a8-904f-02f7bf1c60ed tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:52.659423 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ee05117e-cb0b-47a8-904f-02f7bf1c60ed tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc" status: 200 len: 1507 microversion: 2.1 time: 0.345480 Oct 18 15:47:52.660058 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a723172d-944c-4f99-abb0-abb3d4570bf9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:52.660645 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a723172d-944c-4f99-abb0-abb3d4570bf9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:52.661260 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2477/4949] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:52 2022] GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc => generated 1507 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:47:52.661908 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a723172d-944c-4f99-abb0-abb3d4570bf9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:52.665779 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a723172d-944c-4f99-abb0-abb3d4570bf9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:52.666372 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a723172d-944c-4f99-abb0-abb3d4570bf9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:52.667499 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a723172d-944c-4f99-abb0-abb3d4570bf9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:52.672229 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6c2a6f8c-cbd7-4fbe-b0ad-90841f2ccc1b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:52.677280 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6c2a6f8c-cbd7-4fbe-b0ad-90841f2ccc1b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 2bf616f3-a9f8-4801-8fae-5056b3ba6598] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:52.698985 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6c2a6f8c-cbd7-4fbe-b0ad-90841f2ccc1b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:52.699586 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6c2a6f8c-cbd7-4fbe-b0ad-90841f2ccc1b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:52.700242 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6c2a6f8c-cbd7-4fbe-b0ad-90841f2ccc1b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:52.701151 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6c2a6f8c-cbd7-4fbe-b0ad-90841f2ccc1b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:52.701824 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6c2a6f8c-cbd7-4fbe-b0ad-90841f2ccc1b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:52.702588 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6c2a6f8c-cbd7-4fbe-b0ad-90841f2ccc1b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:53.030618 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a723172d-944c-4f99-abb0-abb3d4570bf9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:53.033903 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6c2a6f8c-cbd7-4fbe-b0ad-90841f2ccc1b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:53.042978 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a723172d-944c-4f99-abb0-abb3d4570bf9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:53.043969 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6c2a6f8c-cbd7-4fbe-b0ad-90841f2ccc1b tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/2bf616f3-a9f8-4801-8fae-5056b3ba6598" status: 200 len: 1506 microversion: 2.1 time: 0.380800 Oct 18 15:47:53.046383 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a723172d-944c-4f99-abb0-abb3d4570bf9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:53.048315 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a723172d-944c-4f99-abb0-abb3d4570bf9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1406 microversion: 2.20 time: 0.420099 Oct 18 15:47:53.057065 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2473/4950] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:47:52 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1406 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:47:53.057536 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2478/4951] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:52 2022] GET /compute/v2.1/servers/2bf616f3-a9f8-4801-8fae-5056b3ba6598 => generated 1506 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:53.072538 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-626e792c-beec-4c5e-8f9c-83e5d4126d81 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:53.073333 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-626e792c-beec-4c5e-8f9c-83e5d4126d81 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 2bf616f3-a9f8-4801-8fae-5056b3ba6598] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:53.084937 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-626e792c-beec-4c5e-8f9c-83e5d4126d81 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:53.087967 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-626e792c-beec-4c5e-8f9c-83e5d4126d81 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:53.088379 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-626e792c-beec-4c5e-8f9c-83e5d4126d81 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:53.089144 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-626e792c-beec-4c5e-8f9c-83e5d4126d81 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:53.089612 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-626e792c-beec-4c5e-8f9c-83e5d4126d81 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:53.090053 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-626e792c-beec-4c5e-8f9c-83e5d4126d81 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:53.135679 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-626e792c-beec-4c5e-8f9c-83e5d4126d81 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 2bf616f3-a9f8-4801-8fae-5056b3ba6598] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:47:53.213339 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-56b8453c-bfec-4f84-bdd7-9a4e31d8d760 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:53.214366 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-56b8453c-bfec-4f84-bdd7-9a4e31d8d760 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] [instance: 8ad81e1b-5d0b-4569-a058-b84881b87164] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:53.235584 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-56b8453c-bfec-4f84-bdd7-9a4e31d8d760 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:53.236543 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-56b8453c-bfec-4f84-bdd7-9a4e31d8d760 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:53.239455 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-56b8453c-bfec-4f84-bdd7-9a4e31d8d760 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:53.241979 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-56b8453c-bfec-4f84-bdd7-9a4e31d8d760 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:53.245644 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-56b8453c-bfec-4f84-bdd7-9a4e31d8d760 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:53.246986 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-56b8453c-bfec-4f84-bdd7-9a4e31d8d760 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:53.298324 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-626e792c-beec-4c5e-8f9c-83e5d4126d81 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "DELETE /compute/v2.1/servers/2bf616f3-a9f8-4801-8fae-5056b3ba6598" status: 204 len: 0 microversion: 2.1 time: 0.230216 Oct 18 15:47:53.299269 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2474/4952] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:47:53 2022] DELETE /compute/v2.1/servers/2bf616f3-a9f8-4801-8fae-5056b3ba6598 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:47:53.310147 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-33b771e0-fdb6-4324-8cc4-edee1aa561ec tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:53.311158 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-33b771e0-fdb6-4324-8cc4-edee1aa561ec tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 2bf616f3-a9f8-4801-8fae-5056b3ba6598] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:53.314358 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:53.321263 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-33b771e0-fdb6-4324-8cc4-edee1aa561ec tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:53.322386 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-33b771e0-fdb6-4324-8cc4-edee1aa561ec tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:53.322984 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-33b771e0-fdb6-4324-8cc4-edee1aa561ec tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:53.323915 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-33b771e0-fdb6-4324-8cc4-edee1aa561ec tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:53.324715 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-33b771e0-fdb6-4324-8cc4-edee1aa561ec tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:53.325426 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-33b771e0-fdb6-4324-8cc4-edee1aa561ec tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:53.328141 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-56b8453c-bfec-4f84-bdd7-9a4e31d8d760 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:53.328853 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-56b8453c-bfec-4f84-bdd7-9a4e31d8d760 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:53.329502 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-56b8453c-bfec-4f84-bdd7-9a4e31d8d760 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:53.330054 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-56b8453c-bfec-4f84-bdd7-9a4e31d8d760 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lazy-loading 'fault' on Instance uuid 8ad81e1b-5d0b-4569-a058-b84881b87164 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:47:53.357524 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-33b771e0-fdb6-4324-8cc4-edee1aa561ec tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 2bf616f3-a9f8-4801-8fae-5056b3ba6598] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:47:53.384470 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-56b8453c-bfec-4f84-bdd7-9a4e31d8d760 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370aba28a5264618a3ca0c82246ed847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f1a15bab624a0e8554e9f929f8520e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:53.395116 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-56b8453c-bfec-4f84-bdd7-9a4e31d8d760 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] 10.222.0.60 "GET /compute/v2.1/servers/8ad81e1b-5d0b-4569-a058-b84881b87164" status: 200 len: 1304 microversion: 2.1 time: 0.188460 Oct 18 15:47:53.396644 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2479/4953] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:53 2022] GET /compute/v2.1/servers/8ad81e1b-5d0b-4569-a058-b84881b87164 => generated 1304 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:53.408382 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.compute.api [None req-33b771e0-fdb6-4324-8cc4-edee1aa561ec tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 2bf616f3-a9f8-4801-8fae-5056b3ba6598] Instance is already in deleting state, ignoring this request Oct 18 15:47:53.409257 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-33b771e0-fdb6-4324-8cc4-edee1aa561ec tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "DELETE /compute/v2.1/servers/2bf616f3-a9f8-4801-8fae-5056b3ba6598" status: 204 len: 0 microversion: 2.1 time: 0.103277 Oct 18 15:47:53.410053 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2475/4954] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:47:53 2022] DELETE /compute/v2.1/servers/2bf616f3-a9f8-4801-8fae-5056b3ba6598 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:47:53.419356 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-89620f67-1212-481e-b006-2192585855b0 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:53.419895 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-89620f67-1212-481e-b006-2192585855b0 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 2bf616f3-a9f8-4801-8fae-5056b3ba6598] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:53.426154 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89620f67-1212-481e-b006-2192585855b0 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:53.426773 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89620f67-1212-481e-b006-2192585855b0 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:53.427213 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89620f67-1212-481e-b006-2192585855b0 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:53.427906 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89620f67-1212-481e-b006-2192585855b0 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:53.428364 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89620f67-1212-481e-b006-2192585855b0 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:53.429425 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89620f67-1212-481e-b006-2192585855b0 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:53.661996 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-89620f67-1212-481e-b006-2192585855b0 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:53.671362 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-89620f67-1212-481e-b006-2192585855b0 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/2bf616f3-a9f8-4801-8fae-5056b3ba6598" status: 200 len: 1512 microversion: 2.1 time: 0.256045 Oct 18 15:47:53.672281 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2480/4955] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:53 2022] GET /compute/v2.1/servers/2bf616f3-a9f8-4801-8fae-5056b3ba6598 => generated 1512 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:53.688016 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6f793bf1-b09e-4f2a-852f-5f01c9f20669 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:53.688016 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6f793bf1-b09e-4f2a-852f-5f01c9f20669 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 41390db3-b9c7-4260-82d1-72bad9b9b0cc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:53.698002 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6f793bf1-b09e-4f2a-852f-5f01c9f20669 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:53.698759 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6f793bf1-b09e-4f2a-852f-5f01c9f20669 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:53.698939 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6f793bf1-b09e-4f2a-852f-5f01c9f20669 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:53.699668 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6f793bf1-b09e-4f2a-852f-5f01c9f20669 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:53.700432 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6f793bf1-b09e-4f2a-852f-5f01c9f20669 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:53.700559 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6f793bf1-b09e-4f2a-852f-5f01c9f20669 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:54.021476 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6f793bf1-b09e-4f2a-852f-5f01c9f20669 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:54.031365 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6f793bf1-b09e-4f2a-852f-5f01c9f20669 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc" status: 200 len: 1487 microversion: 2.1 time: 0.351666 Oct 18 15:47:54.032827 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2476/4956] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:53 2022] GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc => generated 1487 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:54.055983 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a231f37c-df82-454f-9e15-7c1ba78bcbb0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:47:54.056609 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a231f37c-df82-454f-9e15-7c1ba78bcbb0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 41390db3-b9c7-4260-82d1-72bad9b9b0cc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:54.065015 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a231f37c-df82-454f-9e15-7c1ba78bcbb0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:54.065843 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a231f37c-df82-454f-9e15-7c1ba78bcbb0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:54.066283 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a231f37c-df82-454f-9e15-7c1ba78bcbb0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:54.066997 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a231f37c-df82-454f-9e15-7c1ba78bcbb0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:54.067669 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a231f37c-df82-454f-9e15-7c1ba78bcbb0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:54.068106 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a231f37c-df82-454f-9e15-7c1ba78bcbb0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:54.080625 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-961f34b6-0e52-4104-86c4-0d88b7f1f130 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:54.082022 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-961f34b6-0e52-4104-86c4-0d88b7f1f130 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:54.091678 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-961f34b6-0e52-4104-86c4-0d88b7f1f130 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:54.092846 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-961f34b6-0e52-4104-86c4-0d88b7f1f130 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:54.093769 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-961f34b6-0e52-4104-86c4-0d88b7f1f130 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:54.095055 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-961f34b6-0e52-4104-86c4-0d88b7f1f130 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:54.096019 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-961f34b6-0e52-4104-86c4-0d88b7f1f130 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:54.097737 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-961f34b6-0e52-4104-86c4-0d88b7f1f130 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:54.106012 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-a231f37c-df82-454f-9e15-7c1ba78bcbb0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lazy-loading 'flavor' on Instance uuid 41390db3-b9c7-4260-82d1-72bad9b9b0cc {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:47:54.277285 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-961f34b6-0e52-4104-86c4-0d88b7f1f130 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:54.286644 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-961f34b6-0e52-4104-86c4-0d88b7f1f130 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:54.289398 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-961f34b6-0e52-4104-86c4-0d88b7f1f130 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:54.290941 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-961f34b6-0e52-4104-86c4-0d88b7f1f130 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1406 microversion: 2.20 time: 0.216120 Oct 18 15:47:54.292223 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2477/4957] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:47:54 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1406 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:47:54.341821 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a231f37c-df82-454f-9e15-7c1ba78bcbb0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "POST /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc/action" status: 202 len: 0 microversion: 2.1 time: 0.289627 Oct 18 15:47:54.342423 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2481/4958] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:47:54 2022] POST /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:47:54.350699 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-17db5bc8-99b9-4ffa-9381-cbd734f2210f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:54.351316 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-17db5bc8-99b9-4ffa-9381-cbd734f2210f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 41390db3-b9c7-4260-82d1-72bad9b9b0cc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:54.357415 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-17db5bc8-99b9-4ffa-9381-cbd734f2210f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:54.357907 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-17db5bc8-99b9-4ffa-9381-cbd734f2210f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:54.358347 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-17db5bc8-99b9-4ffa-9381-cbd734f2210f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:54.359813 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-17db5bc8-99b9-4ffa-9381-cbd734f2210f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:54.360161 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-17db5bc8-99b9-4ffa-9381-cbd734f2210f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:54.360607 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-17db5bc8-99b9-4ffa-9381-cbd734f2210f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:54.420517 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6ada1b89-16d1-4d9c-9423-43727712f101 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:54.421914 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6ada1b89-16d1-4d9c-9423-43727712f101 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] [instance: 8ad81e1b-5d0b-4569-a058-b84881b87164] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:54.429758 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ada1b89-16d1-4d9c-9423-43727712f101 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:54.430249 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ada1b89-16d1-4d9c-9423-43727712f101 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:54.430680 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ada1b89-16d1-4d9c-9423-43727712f101 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:54.431567 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ada1b89-16d1-4d9c-9423-43727712f101 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:54.432128 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ada1b89-16d1-4d9c-9423-43727712f101 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:54.432553 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ada1b89-16d1-4d9c-9423-43727712f101 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:54.438256 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:54.449995 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-6ada1b89-16d1-4d9c-9423-43727712f101 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] HTTP exception thrown: Instance 8ad81e1b-5d0b-4569-a058-b84881b87164 could not be found. Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6ada1b89-16d1-4d9c-9423-43727712f101 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Request method failure captured: Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/8ad81e1b-5d0b-4569-a058-b84881b87164 HTTP/1.1 Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsqINTdhTdSlazAtAvc4oZ6HU0yY81ddJZfSWYfnWmRULhwrTaSRB80Dgg_gt-H4umFTLi828z95WiwceXYQN5e38ePMBCVBnpg837Kx-mOCFKJgQx6EJ0jRxsyrfByH2aOF_uL_orUkzUHrzfgPnuPwgACmm6KhBJcoaiL7Mpy57S4 Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 30f1a15bab624a0e8554e9f929f8520e Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerPasswordTestJSON-1597684309 Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/30f1a15bab624a0e8554e9f929f8520e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/30f1a15bab624a0e8554e9f929f8520e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/30f1a15bab624a0e8554e9f929f8520e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_30f1a15bab624a0e8554e9f929f8520e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServerPasswordTestJSON-1597684309 Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 30f1a15bab624a0e8554e9f929f8520e Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1597684309 Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServerPasswordTestJSON-1597684309-project Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 370aba28a5264618a3ca0c82246ed847 Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServerPasswordTestJSON-1597684309-project Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 8ad81e1b-5d0b-4569-a058-b84881b87164 could not be found. Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '8ad81e1b-5d0b-4569-a058-b84881b87164'} Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ad81e1b-5d0b-4569-a058-b84881b87164 could not be found. Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ad81e1b-5d0b-4569-a058-b84881b87164 could not be found. Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:47:54.452587 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:47:54.457742 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:47:54.457742 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:47:54.457742 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:47:54.457742 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:47:54.457742 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:47:54.457742 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ad81e1b-5d0b-4569-a058-b84881b87164 could not be found. Oct 18 15:47:54.457742 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:47:54.457742 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6ada1b89-16d1-4d9c-9423-43727712f101 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] Returning 404 to user: Instance 8ad81e1b-5d0b-4569-a058-b84881b87164 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:47:54.457742 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6ada1b89-16d1-4d9c-9423-43727712f101 tempest-ServerPasswordTestJSON-1597684309 tempest-ServerPasswordTestJSON-1597684309-project] 10.222.0.60 "GET /compute/v2.1/servers/8ad81e1b-5d0b-4569-a058-b84881b87164" status: 404 len: 111 microversion: 2.1 time: 0.038619 Oct 18 15:47:54.458477 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2482/4959] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:54 2022] GET /compute/v2.1/servers/8ad81e1b-5d0b-4569-a058-b84881b87164 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 15:47:54.510085 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-17db5bc8-99b9-4ffa-9381-cbd734f2210f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:54.518071 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-17db5bc8-99b9-4ffa-9381-cbd734f2210f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc" status: 200 len: 1493 microversion: 2.1 time: 0.171251 Oct 18 15:47:54.518649 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2478/4960] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:54 2022] GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc => generated 1493 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:47:54.698909 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-12531b5f-894c-49ea-8a85-560a5950d72f tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:54.699766 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-12531b5f-894c-49ea-8a85-560a5950d72f tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 2bf616f3-a9f8-4801-8fae-5056b3ba6598] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:54.706458 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-12531b5f-894c-49ea-8a85-560a5950d72f tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:54.707279 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-12531b5f-894c-49ea-8a85-560a5950d72f tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:54.707956 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-12531b5f-894c-49ea-8a85-560a5950d72f tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:54.709628 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-12531b5f-894c-49ea-8a85-560a5950d72f tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:54.710273 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-12531b5f-894c-49ea-8a85-560a5950d72f tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:54.711121 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-12531b5f-894c-49ea-8a85-560a5950d72f tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:54.843983 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:54.932652 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-12531b5f-894c-49ea-8a85-560a5950d72f tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:54.945639 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-12531b5f-894c-49ea-8a85-560a5950d72f tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/2bf616f3-a9f8-4801-8fae-5056b3ba6598" status: 200 len: 1512 microversion: 2.1 time: 0.253948 Oct 18 15:47:54.946143 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2483/4961] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:54 2022] GET /compute/v2.1/servers/2bf616f3-a9f8-4801-8fae-5056b3ba6598 => generated 1512 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:55.323283 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-51c1f81d-3cbd-4dd5-be4c-6b16de34f219 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:55.323904 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-51c1f81d-3cbd-4dd5-be4c-6b16de34f219 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:55.326161 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:55.327261 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=20 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:55.336133 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-51c1f81d-3cbd-4dd5-be4c-6b16de34f219 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:55.336713 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-51c1f81d-3cbd-4dd5-be4c-6b16de34f219 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:55.337209 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-51c1f81d-3cbd-4dd5-be4c-6b16de34f219 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:55.337920 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-51c1f81d-3cbd-4dd5-be4c-6b16de34f219 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:55.338370 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-51c1f81d-3cbd-4dd5-be4c-6b16de34f219 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:55.338794 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-51c1f81d-3cbd-4dd5-be4c-6b16de34f219 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:55.541204 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9a131133-2f07-4273-a2cd-79afe6f8df26 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:55.541817 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9a131133-2f07-4273-a2cd-79afe6f8df26 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 41390db3-b9c7-4260-82d1-72bad9b9b0cc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:55.548926 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a131133-2f07-4273-a2cd-79afe6f8df26 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:55.549687 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a131133-2f07-4273-a2cd-79afe6f8df26 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:55.550346 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a131133-2f07-4273-a2cd-79afe6f8df26 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:55.551300 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a131133-2f07-4273-a2cd-79afe6f8df26 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:55.552016 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a131133-2f07-4273-a2cd-79afe6f8df26 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:55.552661 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a131133-2f07-4273-a2cd-79afe6f8df26 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:55.688521 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-51c1f81d-3cbd-4dd5-be4c-6b16de34f219 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:55.702132 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-51c1f81d-3cbd-4dd5-be4c-6b16de34f219 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:55.705294 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-51c1f81d-3cbd-4dd5-be4c-6b16de34f219 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:55.706987 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-51c1f81d-3cbd-4dd5-be4c-6b16de34f219 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1406 microversion: 2.20 time: 0.389054 Oct 18 15:47:55.707798 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2479/4962] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:47:55 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1406 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:47:55.832310 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9a131133-2f07-4273-a2cd-79afe6f8df26 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:55.845246 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9a131133-2f07-4273-a2cd-79afe6f8df26 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc" status: 200 len: 1514 microversion: 2.1 time: 0.307954 Oct 18 15:47:55.846439 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2484/4963] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:55 2022] GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc => generated 1514 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:55.887897 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-dc261e45-1794-4b02-a0ac-80c01ce17426 req-d7087b13-174d-4a6d-9fab-cb7a0631ded4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bf616f3-a9f8-4801-8fae-5056b3ba6598", "name": "network-vif-deleted", "tag": "d81aaf80-478d-4eca-96d6-659964a3e785"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:47:55.901045 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-dc261e45-1794-4b02-a0ac-80c01ce17426 req-d7087b13-174d-4a6d-9fab-cb7a0631ded4 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:55.901868 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-dc261e45-1794-4b02-a0ac-80c01ce17426 req-d7087b13-174d-4a6d-9fab-cb7a0631ded4 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:55.902905 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-dc261e45-1794-4b02-a0ac-80c01ce17426 req-d7087b13-174d-4a6d-9fab-cb7a0631ded4 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:55.917015 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-dc261e45-1794-4b02-a0ac-80c01ce17426 req-d7087b13-174d-4a6d-9fab-cb7a0631ded4 service nova] Creating event network-vif-deleted:d81aaf80-478d-4eca-96d6-659964a3e785 for instance 2bf616f3-a9f8-4801-8fae-5056b3ba6598 on n-h2-853682-5 Oct 18 15:47:55.924083 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-dc261e45-1794-4b02-a0ac-80c01ce17426 req-d7087b13-174d-4a6d-9fab-cb7a0631ded4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040717 Oct 18 15:47:55.925055 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2480/4964] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:47:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:47:55.969626 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4d8e9afd-6e32-4bbb-9431-fce6c3ff4421 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:55.970627 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4d8e9afd-6e32-4bbb-9431-fce6c3ff4421 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 2bf616f3-a9f8-4801-8fae-5056b3ba6598] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:55.979495 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d8e9afd-6e32-4bbb-9431-fce6c3ff4421 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:55.980365 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d8e9afd-6e32-4bbb-9431-fce6c3ff4421 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:55.982073 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d8e9afd-6e32-4bbb-9431-fce6c3ff4421 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:55.983304 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d8e9afd-6e32-4bbb-9431-fce6c3ff4421 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:55.983992 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d8e9afd-6e32-4bbb-9431-fce6c3ff4421 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:55.984526 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d8e9afd-6e32-4bbb-9431-fce6c3ff4421 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:56.065742 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4d8e9afd-6e32-4bbb-9431-fce6c3ff4421 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c91f91c89b648c8b099dbedf7c822b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8478562c2e4f8fab01a9667d9b6b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:56.075548 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4d8e9afd-6e32-4bbb-9431-fce6c3ff4421 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/2bf616f3-a9f8-4801-8fae-5056b3ba6598" status: 200 len: 1302 microversion: 2.1 time: 0.110513 Oct 18 15:47:56.076313 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2485/4965] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:55 2022] GET /compute/v2.1/servers/2bf616f3-a9f8-4801-8fae-5056b3ba6598 => generated 1302 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:56.733226 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b28a41b4-74c6-48ae-ba76-57213ce75c0d tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:56.733939 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b28a41b4-74c6-48ae-ba76-57213ce75c0d tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:56.743967 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b28a41b4-74c6-48ae-ba76-57213ce75c0d tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:56.749508 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b28a41b4-74c6-48ae-ba76-57213ce75c0d tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:56.749900 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b28a41b4-74c6-48ae-ba76-57213ce75c0d tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:56.754088 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b28a41b4-74c6-48ae-ba76-57213ce75c0d tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:56.761554 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b28a41b4-74c6-48ae-ba76-57213ce75c0d tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:56.762258 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b28a41b4-74c6-48ae-ba76-57213ce75c0d tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:56.870512 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-92c006f5-06bf-4933-8491-521e59d43f3d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:56.871254 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-92c006f5-06bf-4933-8491-521e59d43f3d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 41390db3-b9c7-4260-82d1-72bad9b9b0cc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:56.887939 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92c006f5-06bf-4933-8491-521e59d43f3d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:56.890138 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92c006f5-06bf-4933-8491-521e59d43f3d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:56.890669 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92c006f5-06bf-4933-8491-521e59d43f3d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:56.894712 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92c006f5-06bf-4933-8491-521e59d43f3d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:56.895344 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92c006f5-06bf-4933-8491-521e59d43f3d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:56.895857 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92c006f5-06bf-4933-8491-521e59d43f3d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:57.352470 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b28a41b4-74c6-48ae-ba76-57213ce75c0d tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:57.371193 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b28a41b4-74c6-48ae-ba76-57213ce75c0d tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:57.373748 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b28a41b4-74c6-48ae-ba76-57213ce75c0d tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:57.374907 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b28a41b4-74c6-48ae-ba76-57213ce75c0d tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1406 microversion: 2.20 time: 0.645863 Oct 18 15:47:57.392838 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2481/4966] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:47:56 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1406 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:47:57.394225 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-b8e8d6d0-187f-44d7-8bd6-afb907494f9e req-a1cc0066-7a86-46ed-a003-c05cd551a209 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b465248f-ab7a-4aba-b939-6f236eea166e", "name": "network-vif-plugged", "status": "completed", "tag": "440cc1c1-492e-40b0-8244-adb2559e6c7f"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:47:57.394539 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-92c006f5-06bf-4933-8491-521e59d43f3d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:57.406279 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-b8e8d6d0-187f-44d7-8bd6-afb907494f9e req-a1cc0066-7a86-46ed-a003-c05cd551a209 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:57.406769 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-b8e8d6d0-187f-44d7-8bd6-afb907494f9e req-a1cc0066-7a86-46ed-a003-c05cd551a209 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:57.407204 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-b8e8d6d0-187f-44d7-8bd6-afb907494f9e req-a1cc0066-7a86-46ed-a003-c05cd551a209 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:57.407674 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-92c006f5-06bf-4933-8491-521e59d43f3d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc" status: 200 len: 1509 microversion: 2.1 time: 0.542533 Oct 18 15:47:57.408286 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2486/4967] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:56 2022] GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc => generated 1509 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:57.423003 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-b8e8d6d0-187f-44d7-8bd6-afb907494f9e req-a1cc0066-7a86-46ed-a003-c05cd551a209 service nova] Creating event network-vif-plugged:440cc1c1-492e-40b0-8244-adb2559e6c7f for instance b465248f-ab7a-4aba-b939-6f236eea166e on n-h1-853682-5 Oct 18 15:47:57.425731 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b892bcef-1a22-4c7c-b003-0df55c44a3a7 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:57.426752 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b892bcef-1a22-4c7c-b003-0df55c44a3a7 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 2bf616f3-a9f8-4801-8fae-5056b3ba6598] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:57.430881 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-b8e8d6d0-187f-44d7-8bd6-afb907494f9e req-a1cc0066-7a86-46ed-a003-c05cd551a209 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051551 Oct 18 15:47:57.435305 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2482/4968] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:47:57.450735 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b892bcef-1a22-4c7c-b003-0df55c44a3a7 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:57.451244 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b892bcef-1a22-4c7c-b003-0df55c44a3a7 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:57.451680 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b892bcef-1a22-4c7c-b003-0df55c44a3a7 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:57.452784 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b892bcef-1a22-4c7c-b003-0df55c44a3a7 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:57.453605 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b892bcef-1a22-4c7c-b003-0df55c44a3a7 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:57.454243 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b892bcef-1a22-4c7c-b003-0df55c44a3a7 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:57.474318 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-b892bcef-1a22-4c7c-b003-0df55c44a3a7 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] HTTP exception thrown: Instance 2bf616f3-a9f8-4801-8fae-5056b3ba6598 could not be found. Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b892bcef-1a22-4c7c-b003-0df55c44a3a7 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Request method failure captured: Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/2bf616f3-a9f8-4801-8fae-5056b3ba6598 HTTP/1.1 Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsn0Q24dK_zzoGSvYzdPaB1syNojAY_tbowuFy8XQq9tmxNYtWQocCOPky7xOZwF_mfEcX0uBDZKjtWfXDlgJ3AIw01i6onPAhGGc5PlLMXpN2VK6altw2LufdZ_INnNK3YUCVYCzHxj7kum2GEpBIQ_LnC7D8e-7QNaGi-V08ZzFCk Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 8c8478562c2e4f8fab01a9667d9b6b05 Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2133480959 Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8c8478562c2e4f8fab01a9667d9b6b05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8c8478562c2e4f8fab01a9667d9b6b05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8c8478562c2e4f8fab01a9667d9b6b05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8c8478562c2e4f8fab01a9667d9b6b05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServerDiskConfigTestJSON-2133480959 Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 8c8478562c2e4f8fab01a9667d9b6b05 Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2133480959 Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServerDiskConfigTestJSON-2133480959-project Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 3c91f91c89b648c8b099dbedf7c822b8 Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServerDiskConfigTestJSON-2133480959-project Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 2bf616f3-a9f8-4801-8fae-5056b3ba6598 could not be found. Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '2bf616f3-a9f8-4801-8fae-5056b3ba6598'} Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bf616f3-a9f8-4801-8fae-5056b3ba6598 could not be found. Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bf616f3-a9f8-4801-8fae-5056b3ba6598 could not be found. Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:47:57.478011 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:47:57.484255 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:47:57.484255 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:47:57.484255 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:47:57.484255 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:47:57.484255 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:47:57.484255 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bf616f3-a9f8-4801-8fae-5056b3ba6598 could not be found. Oct 18 15:47:57.484255 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:47:57.484255 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b892bcef-1a22-4c7c-b003-0df55c44a3a7 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Returning 404 to user: Instance 2bf616f3-a9f8-4801-8fae-5056b3ba6598 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:47:57.484255 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b892bcef-1a22-4c7c-b003-0df55c44a3a7 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/2bf616f3-a9f8-4801-8fae-5056b3ba6598" status: 404 len: 111 microversion: 2.1 time: 0.062642 Oct 18 15:47:57.484255 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2487/4969] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:57 2022] GET /compute/v2.1/servers/2bf616f3-a9f8-4801-8fae-5056b3ba6598 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:47:57.499867 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5eab52d1-aaa3-4fb8-af08-7eb9266d2011 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:57.501434 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5eab52d1-aaa3-4fb8-af08-7eb9266d2011 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 9d108fa0-49bb-46c2-a8b0-802c5835cb14] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:57.521534 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5eab52d1-aaa3-4fb8-af08-7eb9266d2011 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:57.522469 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5eab52d1-aaa3-4fb8-af08-7eb9266d2011 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:57.523178 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5eab52d1-aaa3-4fb8-af08-7eb9266d2011 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:57.524273 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5eab52d1-aaa3-4fb8-af08-7eb9266d2011 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:57.525000 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5eab52d1-aaa3-4fb8-af08-7eb9266d2011 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:57.526724 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5eab52d1-aaa3-4fb8-af08-7eb9266d2011 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:57.554681 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-5eab52d1-aaa3-4fb8-af08-7eb9266d2011 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] HTTP exception thrown: Instance 9d108fa0-49bb-46c2-a8b0-802c5835cb14 could not be found. Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5eab52d1-aaa3-4fb8-af08-7eb9266d2011 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Request method failure captured: Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: request: DELETE /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14 HTTP/1.1 Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsn0Q24dK_zzoGSvYzdPaB1syNojAY_tbowuFy8XQq9tmxNYtWQocCOPky7xOZwF_mfEcX0uBDZKjtWfXDlgJ3AIw01i6onPAhGGc5PlLMXpN2VK6altw2LufdZ_INnNK3YUCVYCzHxj7kum2GEpBIQ_LnC7D8e-7QNaGi-V08ZzFCk Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 8c8478562c2e4f8fab01a9667d9b6b05 Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2133480959 Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8c8478562c2e4f8fab01a9667d9b6b05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8c8478562c2e4f8fab01a9667d9b6b05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8c8478562c2e4f8fab01a9667d9b6b05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8c8478562c2e4f8fab01a9667d9b6b05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServerDiskConfigTestJSON-2133480959 Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 8c8478562c2e4f8fab01a9667d9b6b05 Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2133480959 Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServerDiskConfigTestJSON-2133480959-project Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 3c91f91c89b648c8b099dbedf7c822b8 Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServerDiskConfigTestJSON-2133480959-project Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 9d108fa0-49bb-46c2-a8b0-802c5835cb14 could not be found. Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '9d108fa0-49bb-46c2-a8b0-802c5835cb14'} Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d108fa0-49bb-46c2-a8b0-802c5835cb14 could not be found. Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:47:57.556060 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:47:57.560533 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d108fa0-49bb-46c2-a8b0-802c5835cb14 could not be found. Oct 18 15:47:57.560533 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:47:57.560533 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:47:57.560533 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:47:57.560533 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:47:57.560533 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:47:57.560533 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:47:57.560533 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:47:57.560533 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:47:57.560533 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d108fa0-49bb-46c2-a8b0-802c5835cb14 could not be found. Oct 18 15:47:57.560533 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:47:57.560533 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5eab52d1-aaa3-4fb8-af08-7eb9266d2011 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Returning 404 to user: Instance 9d108fa0-49bb-46c2-a8b0-802c5835cb14 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:47:57.560533 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5eab52d1-aaa3-4fb8-af08-7eb9266d2011 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14" status: 404 len: 111 microversion: 2.1 time: 0.069360 Oct 18 15:47:57.562848 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2483/4970] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:47:57 2022] DELETE /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:47:57.573884 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4a998c72-4c45-4d2c-aab9-e5bebbcb8488 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:57.574704 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4a998c72-4c45-4d2c-aab9-e5bebbcb8488 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 9d108fa0-49bb-46c2-a8b0-802c5835cb14] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:57.590827 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a998c72-4c45-4d2c-aab9-e5bebbcb8488 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:57.591650 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a998c72-4c45-4d2c-aab9-e5bebbcb8488 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:57.593031 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a998c72-4c45-4d2c-aab9-e5bebbcb8488 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:57.594851 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a998c72-4c45-4d2c-aab9-e5bebbcb8488 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:57.595619 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a998c72-4c45-4d2c-aab9-e5bebbcb8488 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:57.596302 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a998c72-4c45-4d2c-aab9-e5bebbcb8488 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:57.616190 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-4a998c72-4c45-4d2c-aab9-e5bebbcb8488 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] HTTP exception thrown: Instance 9d108fa0-49bb-46c2-a8b0-802c5835cb14 could not be found. Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4a998c72-4c45-4d2c-aab9-e5bebbcb8488 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Request method failure captured: Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14 HTTP/1.1 Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsn0Q24dK_zzoGSvYzdPaB1syNojAY_tbowuFy8XQq9tmxNYtWQocCOPky7xOZwF_mfEcX0uBDZKjtWfXDlgJ3AIw01i6onPAhGGc5PlLMXpN2VK6altw2LufdZ_INnNK3YUCVYCzHxj7kum2GEpBIQ_LnC7D8e-7QNaGi-V08ZzFCk Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 8c8478562c2e4f8fab01a9667d9b6b05 Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2133480959 Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8c8478562c2e4f8fab01a9667d9b6b05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8c8478562c2e4f8fab01a9667d9b6b05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8c8478562c2e4f8fab01a9667d9b6b05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8c8478562c2e4f8fab01a9667d9b6b05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServerDiskConfigTestJSON-2133480959 Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 8c8478562c2e4f8fab01a9667d9b6b05 Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2133480959 Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServerDiskConfigTestJSON-2133480959-project Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 3c91f91c89b648c8b099dbedf7c822b8 Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServerDiskConfigTestJSON-2133480959-project Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 9d108fa0-49bb-46c2-a8b0-802c5835cb14 could not be found. Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '9d108fa0-49bb-46c2-a8b0-802c5835cb14'} Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d108fa0-49bb-46c2-a8b0-802c5835cb14 could not be found. Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d108fa0-49bb-46c2-a8b0-802c5835cb14 could not be found. Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:47:57.618114 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:47:57.622937 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:47:57.622937 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:47:57.622937 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:47:57.622937 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:47:57.622937 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:47:57.622937 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d108fa0-49bb-46c2-a8b0-802c5835cb14 could not be found. Oct 18 15:47:57.622937 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:47:57.626903 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4a998c72-4c45-4d2c-aab9-e5bebbcb8488 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Returning 404 to user: Instance 9d108fa0-49bb-46c2-a8b0-802c5835cb14 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:47:57.628272 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4a998c72-4c45-4d2c-aab9-e5bebbcb8488 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14" status: 404 len: 111 microversion: 2.1 time: 0.062669 Oct 18 15:47:57.629495 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2488/4971] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:57 2022] GET /compute/v2.1/servers/9d108fa0-49bb-46c2-a8b0-802c5835cb14 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:47:57.637653 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-89e105ed-b27a-4e15-afb9-43cfdb5306c5 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:57.638165 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-89e105ed-b27a-4e15-afb9-43cfdb5306c5 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 50e19888-f65b-4eaa-8a40-47733d990b8e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:57.648180 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-89e105ed-b27a-4e15-afb9-43cfdb5306c5 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:57.649161 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-89e105ed-b27a-4e15-afb9-43cfdb5306c5 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:57.649777 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-89e105ed-b27a-4e15-afb9-43cfdb5306c5 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:57.650713 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-89e105ed-b27a-4e15-afb9-43cfdb5306c5 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:57.651339 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-89e105ed-b27a-4e15-afb9-43cfdb5306c5 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:57.651981 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-89e105ed-b27a-4e15-afb9-43cfdb5306c5 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:57.673022 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-89e105ed-b27a-4e15-afb9-43cfdb5306c5 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] HTTP exception thrown: Instance 50e19888-f65b-4eaa-8a40-47733d990b8e could not be found. Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-89e105ed-b27a-4e15-afb9-43cfdb5306c5 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Request method failure captured: Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: request: DELETE /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e HTTP/1.1 Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsn0Q24dK_zzoGSvYzdPaB1syNojAY_tbowuFy8XQq9tmxNYtWQocCOPky7xOZwF_mfEcX0uBDZKjtWfXDlgJ3AIw01i6onPAhGGc5PlLMXpN2VK6altw2LufdZ_INnNK3YUCVYCzHxj7kum2GEpBIQ_LnC7D8e-7QNaGi-V08ZzFCk Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 8c8478562c2e4f8fab01a9667d9b6b05 Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2133480959 Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8c8478562c2e4f8fab01a9667d9b6b05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8c8478562c2e4f8fab01a9667d9b6b05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8c8478562c2e4f8fab01a9667d9b6b05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8c8478562c2e4f8fab01a9667d9b6b05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServerDiskConfigTestJSON-2133480959 Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 8c8478562c2e4f8fab01a9667d9b6b05 Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2133480959 Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServerDiskConfigTestJSON-2133480959-project Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 3c91f91c89b648c8b099dbedf7c822b8 Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServerDiskConfigTestJSON-2133480959-project Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 50e19888-f65b-4eaa-8a40-47733d990b8e could not be found. Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '50e19888-f65b-4eaa-8a40-47733d990b8e'} Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50e19888-f65b-4eaa-8a40-47733d990b8e could not be found. Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:47:57.675594 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:47:57.680454 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50e19888-f65b-4eaa-8a40-47733d990b8e could not be found. Oct 18 15:47:57.680454 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:47:57.680454 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:47:57.680454 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:47:57.680454 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:47:57.680454 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:47:57.680454 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:47:57.680454 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:47:57.680454 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:47:57.680454 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50e19888-f65b-4eaa-8a40-47733d990b8e could not be found. Oct 18 15:47:57.680454 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:47:57.682769 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-89e105ed-b27a-4e15-afb9-43cfdb5306c5 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Returning 404 to user: Instance 50e19888-f65b-4eaa-8a40-47733d990b8e could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:47:57.683884 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-89e105ed-b27a-4e15-afb9-43cfdb5306c5 tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "DELETE /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e" status: 404 len: 111 microversion: 2.1 time: 0.050323 Oct 18 15:47:57.684969 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2484/4972] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:47:57 2022] DELETE /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:47:57.693690 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-29d7638b-651f-496f-b9e8-67d3dc98e6cd tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:57.694584 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-29d7638b-651f-496f-b9e8-67d3dc98e6cd tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] [instance: 50e19888-f65b-4eaa-8a40-47733d990b8e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:57.702324 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29d7638b-651f-496f-b9e8-67d3dc98e6cd tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:57.703056 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29d7638b-651f-496f-b9e8-67d3dc98e6cd tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:57.703661 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29d7638b-651f-496f-b9e8-67d3dc98e6cd tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:57.704589 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29d7638b-651f-496f-b9e8-67d3dc98e6cd tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:57.705242 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29d7638b-651f-496f-b9e8-67d3dc98e6cd tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:57.705828 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29d7638b-651f-496f-b9e8-67d3dc98e6cd tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:57.723055 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-29d7638b-651f-496f-b9e8-67d3dc98e6cd tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] HTTP exception thrown: Instance 50e19888-f65b-4eaa-8a40-47733d990b8e could not be found. Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-29d7638b-651f-496f-b9e8-67d3dc98e6cd tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Request method failure captured: Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e HTTP/1.1 Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsn0Q24dK_zzoGSvYzdPaB1syNojAY_tbowuFy8XQq9tmxNYtWQocCOPky7xOZwF_mfEcX0uBDZKjtWfXDlgJ3AIw01i6onPAhGGc5PlLMXpN2VK6altw2LufdZ_INnNK3YUCVYCzHxj7kum2GEpBIQ_LnC7D8e-7QNaGi-V08ZzFCk Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 8c8478562c2e4f8fab01a9667d9b6b05 Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2133480959 Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8c8478562c2e4f8fab01a9667d9b6b05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8c8478562c2e4f8fab01a9667d9b6b05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8c8478562c2e4f8fab01a9667d9b6b05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8c8478562c2e4f8fab01a9667d9b6b05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServerDiskConfigTestJSON-2133480959 Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 8c8478562c2e4f8fab01a9667d9b6b05 Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2133480959 Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServerDiskConfigTestJSON-2133480959-project Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 3c91f91c89b648c8b099dbedf7c822b8 Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServerDiskConfigTestJSON-2133480959-project Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 50e19888-f65b-4eaa-8a40-47733d990b8e could not be found. Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '50e19888-f65b-4eaa-8a40-47733d990b8e'} Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50e19888-f65b-4eaa-8a40-47733d990b8e could not be found. Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50e19888-f65b-4eaa-8a40-47733d990b8e could not be found. Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:47:57.726385 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:47:57.733456 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:47:57.733456 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:47:57.733456 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:47:57.733456 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:47:57.733456 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:47:57.733456 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50e19888-f65b-4eaa-8a40-47733d990b8e could not be found. Oct 18 15:47:57.733456 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:47:57.735477 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-29d7638b-651f-496f-b9e8-67d3dc98e6cd tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] Returning 404 to user: Instance 50e19888-f65b-4eaa-8a40-47733d990b8e could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:47:57.736716 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-29d7638b-651f-496f-b9e8-67d3dc98e6cd tempest-ServerDiskConfigTestJSON-2133480959 tempest-ServerDiskConfigTestJSON-2133480959-project] 10.222.0.60 "GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e" status: 404 len: 111 microversion: 2.1 time: 0.047680 Oct 18 15:47:57.737885 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2489/4973] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:57 2022] GET /compute/v2.1/servers/50e19888-f65b-4eaa-8a40-47733d990b8e => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:47:58.408323 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8e7e9131-cad2-4d2f-8add-c0392469570e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:58.409638 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8e7e9131-cad2-4d2f-8add-c0392469570e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:58.420561 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8e7e9131-cad2-4d2f-8add-c0392469570e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:58.426700 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8e7e9131-cad2-4d2f-8add-c0392469570e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:58.429631 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8e7e9131-cad2-4d2f-8add-c0392469570e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:58.438148 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-18bd42ef-6717-4db3-ba10-0cf454fd703e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:58.439385 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-18bd42ef-6717-4db3-ba10-0cf454fd703e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 41390db3-b9c7-4260-82d1-72bad9b9b0cc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:58.448731 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8e7e9131-cad2-4d2f-8add-c0392469570e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:58.449386 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8e7e9131-cad2-4d2f-8add-c0392469570e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:58.450024 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8e7e9131-cad2-4d2f-8add-c0392469570e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:58.453554 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18bd42ef-6717-4db3-ba10-0cf454fd703e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:58.464224 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18bd42ef-6717-4db3-ba10-0cf454fd703e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:58.466488 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18bd42ef-6717-4db3-ba10-0cf454fd703e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:58.469560 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18bd42ef-6717-4db3-ba10-0cf454fd703e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:58.470362 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18bd42ef-6717-4db3-ba10-0cf454fd703e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:58.475947 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18bd42ef-6717-4db3-ba10-0cf454fd703e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:58.814003 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8e7e9131-cad2-4d2f-8add-c0392469570e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:58.828744 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8e7e9131-cad2-4d2f-8add-c0392469570e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:58.836022 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8e7e9131-cad2-4d2f-8add-c0392469570e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:58.840352 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8e7e9131-cad2-4d2f-8add-c0392469570e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1406 microversion: 2.20 time: 0.435483 Oct 18 15:47:58.842596 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2485/4974] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:47:58 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1406 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:47:58.951728 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-18bd42ef-6717-4db3-ba10-0cf454fd703e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:47:58.960769 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-18bd42ef-6717-4db3-ba10-0cf454fd703e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc" status: 200 len: 1509 microversion: 2.1 time: 0.526596 Oct 18 15:47:58.965724 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2490/4975] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:58 2022] GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc => generated 1509 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:47:59.454332 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-844077e4-9a4b-44ad-9e54-f14dea76d060 req-871578a6-0678-4e64-8a83-fb745e2a0725 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41390db3-b9c7-4260-82d1-72bad9b9b0cc", "name": "network-vif-plugged", "status": "completed", "tag": "330a6dfe-e580-4dce-8a6e-1e1cd0081a73"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:47:59.481297 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-844077e4-9a4b-44ad-9e54-f14dea76d060 req-871578a6-0678-4e64-8a83-fb745e2a0725 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:59.482152 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-844077e4-9a4b-44ad-9e54-f14dea76d060 req-871578a6-0678-4e64-8a83-fb745e2a0725 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:59.483239 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-844077e4-9a4b-44ad-9e54-f14dea76d060 req-871578a6-0678-4e64-8a83-fb745e2a0725 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:59.501254 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-844077e4-9a4b-44ad-9e54-f14dea76d060 req-871578a6-0678-4e64-8a83-fb745e2a0725 service nova] Creating event network-vif-plugged:330a6dfe-e580-4dce-8a6e-1e1cd0081a73 for instance 41390db3-b9c7-4260-82d1-72bad9b9b0cc on n-h2-853682-5 Oct 18 15:47:59.535666 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-844077e4-9a4b-44ad-9e54-f14dea76d060 req-871578a6-0678-4e64-8a83-fb745e2a0725 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091467 Oct 18 15:47:59.536301 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2486/4976] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:47:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:47:59.868984 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a73ed2cb-da43-44d4-ad2b-876ffe889910 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:59.870702 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a73ed2cb-da43-44d4-ad2b-876ffe889910 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:47:59.888483 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a73ed2cb-da43-44d4-ad2b-876ffe889910 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:59.889304 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a73ed2cb-da43-44d4-ad2b-876ffe889910 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:59.890608 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a73ed2cb-da43-44d4-ad2b-876ffe889910 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:59.893594 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a73ed2cb-da43-44d4-ad2b-876ffe889910 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:47:59.894297 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a73ed2cb-da43-44d4-ad2b-876ffe889910 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:47:59.895589 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a73ed2cb-da43-44d4-ad2b-876ffe889910 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:47:59.991506 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-da4bfcd4-4698-4983-a11d-82de86919b9b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:47:59.992292 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-da4bfcd4-4698-4983-a11d-82de86919b9b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 41390db3-b9c7-4260-82d1-72bad9b9b0cc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:00.006180 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-da4bfcd4-4698-4983-a11d-82de86919b9b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:00.013465 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-da4bfcd4-4698-4983-a11d-82de86919b9b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:00.014772 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-da4bfcd4-4698-4983-a11d-82de86919b9b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:00.018275 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-da4bfcd4-4698-4983-a11d-82de86919b9b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:00.021378 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-da4bfcd4-4698-4983-a11d-82de86919b9b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:00.022741 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-da4bfcd4-4698-4983-a11d-82de86919b9b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:01.029155 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a73ed2cb-da43-44d4-ad2b-876ffe889910 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:01.048542 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a73ed2cb-da43-44d4-ad2b-876ffe889910 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:01.055445 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-da4bfcd4-4698-4983-a11d-82de86919b9b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:01.068116 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a73ed2cb-da43-44d4-ad2b-876ffe889910 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:01.076781 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a73ed2cb-da43-44d4-ad2b-876ffe889910 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1596 microversion: 2.20 time: 1.212042 Oct 18 15:48:01.077001 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-da4bfcd4-4698-4983-a11d-82de86919b9b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc" status: 200 len: 1509 microversion: 2.1 time: 1.084863 Oct 18 15:48:01.078281 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2487/4977] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:47:59 2022] GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc => generated 1509 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:01.079284 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2491/4978] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:47:59 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1596 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:48:01.128931 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-07da3127-3bb4-41df-93cc-77800eef7566 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:01.129605 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-07da3127-3bb4-41df-93cc-77800eef7566 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:01.141489 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-07da3127-3bb4-41df-93cc-77800eef7566 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:01.146259 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-07da3127-3bb4-41df-93cc-77800eef7566 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:01.149318 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-07da3127-3bb4-41df-93cc-77800eef7566 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:01.152563 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-07da3127-3bb4-41df-93cc-77800eef7566 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:01.155673 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-07da3127-3bb4-41df-93cc-77800eef7566 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:01.159693 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-07da3127-3bb4-41df-93cc-77800eef7566 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:01.374919 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-07da3127-3bb4-41df-93cc-77800eef7566 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.249083 Oct 18 15:48:01.376310 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2488/4979] 10.222.0.60 () {60 vars in 1316 bytes} [Tue Oct 18 15:48:01 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e/os-interface => generated 284 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:48:02.130152 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f143c66f-a67c-4aaa-a46f-392cfec85f6c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:02.130771 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f143c66f-a67c-4aaa-a46f-392cfec85f6c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 41390db3-b9c7-4260-82d1-72bad9b9b0cc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:02.152162 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f143c66f-a67c-4aaa-a46f-392cfec85f6c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:02.160285 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f143c66f-a67c-4aaa-a46f-392cfec85f6c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:02.161017 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f143c66f-a67c-4aaa-a46f-392cfec85f6c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:02.162205 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f143c66f-a67c-4aaa-a46f-392cfec85f6c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:02.163437 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f143c66f-a67c-4aaa-a46f-392cfec85f6c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:02.165771 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f143c66f-a67c-4aaa-a46f-392cfec85f6c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:02.546519 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f143c66f-a67c-4aaa-a46f-392cfec85f6c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:02.555756 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f143c66f-a67c-4aaa-a46f-392cfec85f6c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc" status: 200 len: 1509 microversion: 2.1 time: 0.429723 Oct 18 15:48:02.574306 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2492/4980] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:02 2022] GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc => generated 1509 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:03.581641 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1455c311-190c-44d3-9bbb-b144ac9d99e0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:03.582275 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1455c311-190c-44d3-9bbb-b144ac9d99e0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 41390db3-b9c7-4260-82d1-72bad9b9b0cc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:03.595195 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1455c311-190c-44d3-9bbb-b144ac9d99e0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:03.599382 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1455c311-190c-44d3-9bbb-b144ac9d99e0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:03.602399 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1455c311-190c-44d3-9bbb-b144ac9d99e0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:03.603174 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1455c311-190c-44d3-9bbb-b144ac9d99e0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:03.603652 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1455c311-190c-44d3-9bbb-b144ac9d99e0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:03.604103 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1455c311-190c-44d3-9bbb-b144ac9d99e0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:04.338708 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1455c311-190c-44d3-9bbb-b144ac9d99e0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:04.341377 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:48:04.348469 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1455c311-190c-44d3-9bbb-b144ac9d99e0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc" status: 200 len: 1509 microversion: 2.1 time: 0.772615 Oct 18 15:48:04.354169 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2489/4981] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:03 2022] GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc => generated 1509 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:05.378484 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5061cc95-bc6c-4a84-b804-a642c5fcf6e2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:05.379663 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5061cc95-bc6c-4a84-b804-a642c5fcf6e2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 41390db3-b9c7-4260-82d1-72bad9b9b0cc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:05.393496 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5061cc95-bc6c-4a84-b804-a642c5fcf6e2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:05.394011 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5061cc95-bc6c-4a84-b804-a642c5fcf6e2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:05.394464 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5061cc95-bc6c-4a84-b804-a642c5fcf6e2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:05.398605 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5061cc95-bc6c-4a84-b804-a642c5fcf6e2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:05.401885 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5061cc95-bc6c-4a84-b804-a642c5fcf6e2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:05.402591 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5061cc95-bc6c-4a84-b804-a642c5fcf6e2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:05.784356 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-48305459-443b-4357-a24a-817dfee22730 req-cfff3517-bdcc-49f1-988a-68695f3d199a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b465248f-ab7a-4aba-b939-6f236eea166e", "tag": "440cc1c1-492e-40b0-8244-adb2559e6c7f"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:48:05.815611 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-48305459-443b-4357-a24a-817dfee22730 req-cfff3517-bdcc-49f1-988a-68695f3d199a service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:05.818456 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-48305459-443b-4357-a24a-817dfee22730 req-cfff3517-bdcc-49f1-988a-68695f3d199a service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:05.820341 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-48305459-443b-4357-a24a-817dfee22730 req-cfff3517-bdcc-49f1-988a-68695f3d199a service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:05.865823 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-48305459-443b-4357-a24a-817dfee22730 req-cfff3517-bdcc-49f1-988a-68695f3d199a service nova] Creating event network-changed:440cc1c1-492e-40b0-8244-adb2559e6c7f for instance b465248f-ab7a-4aba-b939-6f236eea166e on n-h1-853682-5 Oct 18 15:48:05.884059 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-48305459-443b-4357-a24a-817dfee22730 req-cfff3517-bdcc-49f1-988a-68695f3d199a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101715 Oct 18 15:48:05.885483 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2490/4982] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:48:05.922286 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5061cc95-bc6c-4a84-b804-a642c5fcf6e2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:05.934901 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5061cc95-bc6c-4a84-b804-a642c5fcf6e2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc" status: 200 len: 1509 microversion: 2.1 time: 0.561759 Oct 18 15:48:05.939738 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2493/4983] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:05 2022] GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc => generated 1509 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:06.973633 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-474a627b-aff2-4b95-a5a5-fa05122d015a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:06.977497 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-474a627b-aff2-4b95-a5a5-fa05122d015a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 41390db3-b9c7-4260-82d1-72bad9b9b0cc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:06.999765 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-474a627b-aff2-4b95-a5a5-fa05122d015a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:07.001935 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-474a627b-aff2-4b95-a5a5-fa05122d015a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:07.003015 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-474a627b-aff2-4b95-a5a5-fa05122d015a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:07.005806 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-474a627b-aff2-4b95-a5a5-fa05122d015a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:07.006362 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-474a627b-aff2-4b95-a5a5-fa05122d015a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:07.006821 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-474a627b-aff2-4b95-a5a5-fa05122d015a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:07.549956 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-474a627b-aff2-4b95-a5a5-fa05122d015a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:07.568503 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-474a627b-aff2-4b95-a5a5-fa05122d015a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc" status: 200 len: 1509 microversion: 2.1 time: 0.604034 Oct 18 15:48:07.587875 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2491/4984] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:06 2022] GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc => generated 1509 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:08.601258 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-20e2c994-3e03-4e75-89ca-caa3f3271136 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:08.602799 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-20e2c994-3e03-4e75-89ca-caa3f3271136 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 41390db3-b9c7-4260-82d1-72bad9b9b0cc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:08.624017 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20e2c994-3e03-4e75-89ca-caa3f3271136 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:08.626972 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20e2c994-3e03-4e75-89ca-caa3f3271136 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:08.629403 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20e2c994-3e03-4e75-89ca-caa3f3271136 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:08.629403 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20e2c994-3e03-4e75-89ca-caa3f3271136 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:08.629403 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20e2c994-3e03-4e75-89ca-caa3f3271136 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:08.633233 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20e2c994-3e03-4e75-89ca-caa3f3271136 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:09.056445 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-20e2c994-3e03-4e75-89ca-caa3f3271136 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:09.065106 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-20e2c994-3e03-4e75-89ca-caa3f3271136 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc" status: 200 len: 1509 microversion: 2.1 time: 0.469926 Oct 18 15:48:09.070182 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2494/4985] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:08 2022] GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc => generated 1509 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:10.093508 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-def84183-79b0-474a-bf7b-7e0082ff6a97 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:10.094216 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-def84183-79b0-474a-bf7b-7e0082ff6a97 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 41390db3-b9c7-4260-82d1-72bad9b9b0cc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:10.108326 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-def84183-79b0-474a-bf7b-7e0082ff6a97 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:10.109126 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-def84183-79b0-474a-bf7b-7e0082ff6a97 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:10.114092 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-def84183-79b0-474a-bf7b-7e0082ff6a97 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:10.117380 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-def84183-79b0-474a-bf7b-7e0082ff6a97 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:10.118123 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-def84183-79b0-474a-bf7b-7e0082ff6a97 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:10.118765 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-def84183-79b0-474a-bf7b-7e0082ff6a97 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:10.603902 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-def84183-79b0-474a-bf7b-7e0082ff6a97 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:10.612707 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-def84183-79b0-474a-bf7b-7e0082ff6a97 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc" status: 200 len: 1509 microversion: 2.1 time: 0.523187 Oct 18 15:48:10.634583 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2492/4986] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:10 2022] GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc => generated 1509 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:11.645247 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f44b6f43-0e87-4ae9-97c4-86757511c0f6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:11.647346 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f44b6f43-0e87-4ae9-97c4-86757511c0f6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 41390db3-b9c7-4260-82d1-72bad9b9b0cc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:11.660386 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f44b6f43-0e87-4ae9-97c4-86757511c0f6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:11.661723 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f44b6f43-0e87-4ae9-97c4-86757511c0f6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:11.662824 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f44b6f43-0e87-4ae9-97c4-86757511c0f6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:11.664217 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f44b6f43-0e87-4ae9-97c4-86757511c0f6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:11.664932 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f44b6f43-0e87-4ae9-97c4-86757511c0f6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:11.665923 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f44b6f43-0e87-4ae9-97c4-86757511c0f6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:12.840705 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f44b6f43-0e87-4ae9-97c4-86757511c0f6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:12.848493 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f44b6f43-0e87-4ae9-97c4-86757511c0f6 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc" status: 200 len: 1509 microversion: 2.1 time: 1.208782 Oct 18 15:48:12.849114 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2495/4987] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:11 2022] GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc => generated 1509 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:13.872549 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-15dcbb39-6730-4a4f-b3ad-7fb8f1c612cd tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:13.873281 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-15dcbb39-6730-4a4f-b3ad-7fb8f1c612cd tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 41390db3-b9c7-4260-82d1-72bad9b9b0cc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:13.895974 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-15dcbb39-6730-4a4f-b3ad-7fb8f1c612cd tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:13.896550 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-15dcbb39-6730-4a4f-b3ad-7fb8f1c612cd tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:13.898621 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-15dcbb39-6730-4a4f-b3ad-7fb8f1c612cd tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:13.899419 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-15dcbb39-6730-4a4f-b3ad-7fb8f1c612cd tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:13.899971 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-15dcbb39-6730-4a4f-b3ad-7fb8f1c612cd tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:13.902092 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-15dcbb39-6730-4a4f-b3ad-7fb8f1c612cd tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:14.541878 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-15dcbb39-6730-4a4f-b3ad-7fb8f1c612cd tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:14.559166 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-15dcbb39-6730-4a4f-b3ad-7fb8f1c612cd tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc" status: 200 len: 1509 microversion: 2.1 time: 0.691321 Oct 18 15:48:14.571147 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2493/4988] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:13 2022] GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc => generated 1509 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:15.594310 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2c5fcf30-fa9a-4a94-8438-be7418cc0586 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:15.597992 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2c5fcf30-fa9a-4a94-8438-be7418cc0586 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 41390db3-b9c7-4260-82d1-72bad9b9b0cc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:15.610814 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c5fcf30-fa9a-4a94-8438-be7418cc0586 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:15.620656 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c5fcf30-fa9a-4a94-8438-be7418cc0586 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:15.621393 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c5fcf30-fa9a-4a94-8438-be7418cc0586 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:15.623095 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c5fcf30-fa9a-4a94-8438-be7418cc0586 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:15.625629 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c5fcf30-fa9a-4a94-8438-be7418cc0586 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:15.626431 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c5fcf30-fa9a-4a94-8438-be7418cc0586 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:16.087016 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2c5fcf30-fa9a-4a94-8438-be7418cc0586 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:16.101852 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2c5fcf30-fa9a-4a94-8438-be7418cc0586 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc" status: 200 len: 1509 microversion: 2.1 time: 0.511247 Oct 18 15:48:16.102933 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2496/4989] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:15 2022] GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc => generated 1509 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:17.131152 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a1d8ad9a-62e5-4a6c-90e6-403cceecaa02 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:17.131878 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a1d8ad9a-62e5-4a6c-90e6-403cceecaa02 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 41390db3-b9c7-4260-82d1-72bad9b9b0cc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:17.153797 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a1d8ad9a-62e5-4a6c-90e6-403cceecaa02 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:17.154689 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a1d8ad9a-62e5-4a6c-90e6-403cceecaa02 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:17.158062 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a1d8ad9a-62e5-4a6c-90e6-403cceecaa02 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:17.159080 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a1d8ad9a-62e5-4a6c-90e6-403cceecaa02 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:17.161842 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a1d8ad9a-62e5-4a6c-90e6-403cceecaa02 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:17.163239 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a1d8ad9a-62e5-4a6c-90e6-403cceecaa02 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:17.800885 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a1d8ad9a-62e5-4a6c-90e6-403cceecaa02 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:17.813143 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a1d8ad9a-62e5-4a6c-90e6-403cceecaa02 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc" status: 200 len: 1509 microversion: 2.1 time: 0.684570 Oct 18 15:48:17.831864 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2494/4990] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:17 2022] GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc => generated 1509 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:18.842252 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d08f2807-0de5-431e-bdbf-07d6f6dec3b2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:18.843426 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d08f2807-0de5-431e-bdbf-07d6f6dec3b2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 41390db3-b9c7-4260-82d1-72bad9b9b0cc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:18.848828 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=68 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:48:18.877909 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d08f2807-0de5-431e-bdbf-07d6f6dec3b2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:18.878876 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d08f2807-0de5-431e-bdbf-07d6f6dec3b2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:18.879718 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d08f2807-0de5-431e-bdbf-07d6f6dec3b2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:18.880674 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d08f2807-0de5-431e-bdbf-07d6f6dec3b2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:18.881873 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d08f2807-0de5-431e-bdbf-07d6f6dec3b2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:18.882716 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d08f2807-0de5-431e-bdbf-07d6f6dec3b2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:19.391310 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d08f2807-0de5-431e-bdbf-07d6f6dec3b2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:19.424874 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d08f2807-0de5-431e-bdbf-07d6f6dec3b2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc" status: 200 len: 1509 microversion: 2.1 time: 0.589311 Oct 18 15:48:19.426305 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2497/4991] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:18 2022] GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc => generated 1509 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:20.454918 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b5829ecd-b0d0-49cd-89a5-5a88381edb26 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:20.456397 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b5829ecd-b0d0-49cd-89a5-5a88381edb26 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 41390db3-b9c7-4260-82d1-72bad9b9b0cc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:20.489907 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5829ecd-b0d0-49cd-89a5-5a88381edb26 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:20.492639 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5829ecd-b0d0-49cd-89a5-5a88381edb26 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:20.493315 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5829ecd-b0d0-49cd-89a5-5a88381edb26 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:20.494235 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5829ecd-b0d0-49cd-89a5-5a88381edb26 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:20.495004 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5829ecd-b0d0-49cd-89a5-5a88381edb26 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:20.495730 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5829ecd-b0d0-49cd-89a5-5a88381edb26 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:20.728473 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-eae7ad1e-207b-4aff-a47a-bfecf7855bdb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1158080516", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "5126a012-82e3-4304-a7ec-ac28e05a407b"}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:48:20.831375 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-eae7ad1e-207b-4aff-a47a-bfecf7855bdb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] validate_networks() for [('5126a012-82e3-4304-a7ec-ac28e05a407b', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:48:21.121231 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b5829ecd-b0d0-49cd-89a5-5a88381edb26 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:21.129097 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b5829ecd-b0d0-49cd-89a5-5a88381edb26 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc" status: 200 len: 1506 microversion: 2.1 time: 0.679587 Oct 18 15:48:21.132392 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2498/4992] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:20 2022] GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc => generated 1506 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:22.159629 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f4df00aa-cffe-4451-b6fb-10ae9a56fb74 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:22.161827 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f4df00aa-cffe-4451-b6fb-10ae9a56fb74 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 41390db3-b9c7-4260-82d1-72bad9b9b0cc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:22.192399 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4df00aa-cffe-4451-b6fb-10ae9a56fb74 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:22.197985 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4df00aa-cffe-4451-b6fb-10ae9a56fb74 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:22.202088 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4df00aa-cffe-4451-b6fb-10ae9a56fb74 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:22.205651 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4df00aa-cffe-4451-b6fb-10ae9a56fb74 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:22.207536 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4df00aa-cffe-4451-b6fb-10ae9a56fb74 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:22.210642 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4df00aa-cffe-4451-b6fb-10ae9a56fb74 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:23.124076 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-eae7ad1e-207b-4aff-a47a-bfecf7855bdb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:48:23.124585 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-eae7ad1e-207b-4aff-a47a-bfecf7855bdb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:48:23.134596 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-eae7ad1e-207b-4aff-a47a-bfecf7855bdb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:48:23.135475 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-eae7ad1e-207b-4aff-a47a-bfecf7855bdb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:48:23.136166 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-eae7ad1e-207b-4aff-a47a-bfecf7855bdb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:48:23.148453 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eae7ad1e-207b-4aff-a47a-bfecf7855bdb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:23.149585 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eae7ad1e-207b-4aff-a47a-bfecf7855bdb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:23.150268 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eae7ad1e-207b-4aff-a47a-bfecf7855bdb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:23.151307 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eae7ad1e-207b-4aff-a47a-bfecf7855bdb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:23.158565 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eae7ad1e-207b-4aff-a47a-bfecf7855bdb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:23.159637 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eae7ad1e-207b-4aff-a47a-bfecf7855bdb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:23.188766 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-eae7ad1e-207b-4aff-a47a-bfecf7855bdb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Getting quotas for project afdb1e8b478f463987ec223f2d10db33. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:48:23.195956 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-eae7ad1e-207b-4aff-a47a-bfecf7855bdb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Getting quotas for user 73f4ee2e7ff34dd88b9b82fefbf06a36 and project afdb1e8b478f463987ec223f2d10db33. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:48:23.216843 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-eae7ad1e-207b-4aff-a47a-bfecf7855bdb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:48:23.220688 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-eae7ad1e-207b-4aff-a47a-bfecf7855bdb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 921da888-cf81-4364-bb2f-469e8e444978] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:48:23.297931 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-eae7ad1e-207b-4aff-a47a-bfecf7855bdb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.861482 Oct 18 15:48:23.306929 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2495/4993] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:48:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2871 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:48:23.313156 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-6a26a8a4-dac5-4b22-89df-dd536d982d76 req-6f37ce84-cdef-4c67-b048-197ad38288bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41390db3-b9c7-4260-82d1-72bad9b9b0cc", "name": "network-vif-unplugged", "status": "completed", "tag": "330a6dfe-e580-4dce-8a6e-1e1cd0081a73"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:48:23.335141 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-6a26a8a4-dac5-4b22-89df-dd536d982d76 req-6f37ce84-cdef-4c67-b048-197ad38288bf service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:23.336007 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-6a26a8a4-dac5-4b22-89df-dd536d982d76 req-6f37ce84-cdef-4c67-b048-197ad38288bf service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:23.338345 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-6a26a8a4-dac5-4b22-89df-dd536d982d76 req-6f37ce84-cdef-4c67-b048-197ad38288bf service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:23.360466 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-6a26a8a4-dac5-4b22-89df-dd536d982d76 req-6f37ce84-cdef-4c67-b048-197ad38288bf service nova] Creating event network-vif-unplugged:330a6dfe-e580-4dce-8a6e-1e1cd0081a73 for instance 41390db3-b9c7-4260-82d1-72bad9b9b0cc on n-h2-853682-5 Oct 18 15:48:23.371609 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-6a26a8a4-dac5-4b22-89df-dd536d982d76 req-6f37ce84-cdef-4c67-b048-197ad38288bf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062553 Oct 18 15:48:23.373224 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2496/4994] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:48:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:48:23.382970 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-dc933f77-44c7-47db-a76a-6a655b849966 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:23.385035 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-dc933f77-44c7-47db-a76a-6a655b849966 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 921da888-cf81-4364-bb2f-469e8e444978] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:23.395925 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:48:23.397820 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f4df00aa-cffe-4451-b6fb-10ae9a56fb74 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:23.413715 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f4df00aa-cffe-4451-b6fb-10ae9a56fb74 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc" status: 200 len: 1506 microversion: 2.1 time: 1.261566 Oct 18 15:48:23.425290 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2499/4995] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:22 2022] GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc => generated 1506 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:48:23.498419 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-dc933f77-44c7-47db-a76a-6a655b849966 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:23.507170 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-dc933f77-44c7-47db-a76a-6a655b849966 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/921da888-cf81-4364-bb2f-469e8e444978" status: 200 len: 1193 microversion: 2.1 time: 0.132190 Oct 18 15:48:23.509470 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2497/4996] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:23 2022] GET /compute/v2.1/servers/921da888-cf81-4364-bb2f-469e8e444978 => generated 1193 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:24.153553 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-2320a05a-176a-4e86-ab7b-e1dff97d5c36 req-c3bc725b-6b72-40bb-91f3-97637353291a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41390db3-b9c7-4260-82d1-72bad9b9b0cc", "name": "network-vif-unplugged", "status": "completed", "tag": "330a6dfe-e580-4dce-8a6e-1e1cd0081a73"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:48:24.178134 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2320a05a-176a-4e86-ab7b-e1dff97d5c36 req-c3bc725b-6b72-40bb-91f3-97637353291a service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:24.182232 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2320a05a-176a-4e86-ab7b-e1dff97d5c36 req-c3bc725b-6b72-40bb-91f3-97637353291a service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:24.190323 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2320a05a-176a-4e86-ab7b-e1dff97d5c36 req-c3bc725b-6b72-40bb-91f3-97637353291a service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:24.223294 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-2320a05a-176a-4e86-ab7b-e1dff97d5c36 req-c3bc725b-6b72-40bb-91f3-97637353291a service nova] Creating event network-vif-unplugged:330a6dfe-e580-4dce-8a6e-1e1cd0081a73 for instance 41390db3-b9c7-4260-82d1-72bad9b9b0cc on n-h2-853682-5 Oct 18 15:48:24.237685 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-2320a05a-176a-4e86-ab7b-e1dff97d5c36 req-c3bc725b-6b72-40bb-91f3-97637353291a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087771 Oct 18 15:48:24.242443 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2500/4997] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:48:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:48:24.445807 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-58a2c2b6-2aee-4472-9293-86161db5b96d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:24.446954 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-58a2c2b6-2aee-4472-9293-86161db5b96d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 41390db3-b9c7-4260-82d1-72bad9b9b0cc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:24.473230 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-58a2c2b6-2aee-4472-9293-86161db5b96d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:24.473789 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-58a2c2b6-2aee-4472-9293-86161db5b96d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:24.474265 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-58a2c2b6-2aee-4472-9293-86161db5b96d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:24.478211 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-58a2c2b6-2aee-4472-9293-86161db5b96d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:24.478967 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-58a2c2b6-2aee-4472-9293-86161db5b96d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:24.479415 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-58a2c2b6-2aee-4472-9293-86161db5b96d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:24.553679 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-52ebffe0-b9e2-495a-9733-665e85129c8c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:24.557395 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-52ebffe0-b9e2-495a-9733-665e85129c8c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 921da888-cf81-4364-bb2f-469e8e444978] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:24.578395 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52ebffe0-b9e2-495a-9733-665e85129c8c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:24.583201 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52ebffe0-b9e2-495a-9733-665e85129c8c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:24.584709 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52ebffe0-b9e2-495a-9733-665e85129c8c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:24.587890 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52ebffe0-b9e2-495a-9733-665e85129c8c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:24.591638 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52ebffe0-b9e2-495a-9733-665e85129c8c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:24.592216 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52ebffe0-b9e2-495a-9733-665e85129c8c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:24.928416 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-52ebffe0-b9e2-495a-9733-665e85129c8c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:24.946925 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:48:24.955654 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-52ebffe0-b9e2-495a-9733-665e85129c8c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/921da888-cf81-4364-bb2f-469e8e444978" status: 200 len: 1197 microversion: 2.1 time: 0.409515 Oct 18 15:48:24.956508 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2501/4998] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:24 2022] GET /compute/v2.1/servers/921da888-cf81-4364-bb2f-469e8e444978 => generated 1197 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:25.080221 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-58a2c2b6-2aee-4472-9293-86161db5b96d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:25.090479 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-58a2c2b6-2aee-4472-9293-86161db5b96d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc" status: 200 len: 1506 microversion: 2.1 time: 0.650436 Oct 18 15:48:25.100268 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2498/4999] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:24 2022] GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc => generated 1506 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:25.992153 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-393844bd-e0b3-41c1-9abb-1158d1b84e28 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:25.992739 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-393844bd-e0b3-41c1-9abb-1158d1b84e28 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 921da888-cf81-4364-bb2f-469e8e444978] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:26.013485 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-393844bd-e0b3-41c1-9abb-1158d1b84e28 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:26.013982 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-393844bd-e0b3-41c1-9abb-1158d1b84e28 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:26.021934 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-393844bd-e0b3-41c1-9abb-1158d1b84e28 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:26.028279 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-393844bd-e0b3-41c1-9abb-1158d1b84e28 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:26.028936 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-393844bd-e0b3-41c1-9abb-1158d1b84e28 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:26.029396 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-393844bd-e0b3-41c1-9abb-1158d1b84e28 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:26.128431 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f91944f1-1425-457f-82a1-7a931030a6af tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:26.129097 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f91944f1-1425-457f-82a1-7a931030a6af tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 41390db3-b9c7-4260-82d1-72bad9b9b0cc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:26.151800 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f91944f1-1425-457f-82a1-7a931030a6af tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:26.152419 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f91944f1-1425-457f-82a1-7a931030a6af tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:26.152912 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f91944f1-1425-457f-82a1-7a931030a6af tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:26.153674 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f91944f1-1425-457f-82a1-7a931030a6af tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:26.162886 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f91944f1-1425-457f-82a1-7a931030a6af tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:26.163459 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f91944f1-1425-457f-82a1-7a931030a6af tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:26.575323 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-393844bd-e0b3-41c1-9abb-1158d1b84e28 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:26.629220 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-393844bd-e0b3-41c1-9abb-1158d1b84e28 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/921da888-cf81-4364-bb2f-469e8e444978" status: 200 len: 1245 microversion: 2.1 time: 0.620699 Oct 18 15:48:26.631138 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2502/5000] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:25 2022] GET /compute/v2.1/servers/921da888-cf81-4364-bb2f-469e8e444978 => generated 1245 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:26.668201 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-47d64908-faac-4528-80ef-03d6c4cd8b06 req-d18326c1-a3cd-4c9f-93ba-459d76c48172 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41390db3-b9c7-4260-82d1-72bad9b9b0cc", "tag": "330a6dfe-e580-4dce-8a6e-1e1cd0081a73"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:48:26.702621 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-47d64908-faac-4528-80ef-03d6c4cd8b06 req-d18326c1-a3cd-4c9f-93ba-459d76c48172 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:26.703493 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-47d64908-faac-4528-80ef-03d6c4cd8b06 req-d18326c1-a3cd-4c9f-93ba-459d76c48172 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:26.704180 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-47d64908-faac-4528-80ef-03d6c4cd8b06 req-d18326c1-a3cd-4c9f-93ba-459d76c48172 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:26.741521 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-47d64908-faac-4528-80ef-03d6c4cd8b06 req-d18326c1-a3cd-4c9f-93ba-459d76c48172 service nova] Creating event network-changed:330a6dfe-e580-4dce-8a6e-1e1cd0081a73 for instance 41390db3-b9c7-4260-82d1-72bad9b9b0cc on n-h2-853682-5 Oct 18 15:48:26.759967 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-47d64908-faac-4528-80ef-03d6c4cd8b06 req-d18326c1-a3cd-4c9f-93ba-459d76c48172 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122375 Oct 18 15:48:26.764910 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2503/5001] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:48:27.658665 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f91944f1-1425-457f-82a1-7a931030a6af tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:27.666254 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e65702bc-049c-43b7-b828-7c30759822c9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:27.668504 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e65702bc-049c-43b7-b828-7c30759822c9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 921da888-cf81-4364-bb2f-469e8e444978] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:27.675143 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f91944f1-1425-457f-82a1-7a931030a6af tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc" status: 200 len: 1506 microversion: 2.1 time: 1.551089 Oct 18 15:48:27.676498 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2499/5002] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:26 2022] GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc => generated 1506 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:27.682500 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e65702bc-049c-43b7-b828-7c30759822c9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:27.683325 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e65702bc-049c-43b7-b828-7c30759822c9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:27.684069 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e65702bc-049c-43b7-b828-7c30759822c9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:27.685048 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e65702bc-049c-43b7-b828-7c30759822c9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:27.685732 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e65702bc-049c-43b7-b828-7c30759822c9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:27.686401 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e65702bc-049c-43b7-b828-7c30759822c9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:27.909676 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e65702bc-049c-43b7-b828-7c30759822c9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:27.930079 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e65702bc-049c-43b7-b828-7c30759822c9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/921da888-cf81-4364-bb2f-469e8e444978" status: 200 len: 1251 microversion: 2.1 time: 0.275695 Oct 18 15:48:27.933862 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2504/5003] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:27 2022] GET /compute/v2.1/servers/921da888-cf81-4364-bb2f-469e8e444978 => generated 1251 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:28.700445 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3e2bf86b-6e4b-498b-8fd4-47381b7518f3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:28.701986 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3e2bf86b-6e4b-498b-8fd4-47381b7518f3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 41390db3-b9c7-4260-82d1-72bad9b9b0cc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:28.721584 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3e2bf86b-6e4b-498b-8fd4-47381b7518f3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:28.722316 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3e2bf86b-6e4b-498b-8fd4-47381b7518f3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:28.722779 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3e2bf86b-6e4b-498b-8fd4-47381b7518f3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:28.723714 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3e2bf86b-6e4b-498b-8fd4-47381b7518f3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:28.724408 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3e2bf86b-6e4b-498b-8fd4-47381b7518f3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:28.725254 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3e2bf86b-6e4b-498b-8fd4-47381b7518f3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:28.962190 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b13ec12e-b991-4fdb-b107-5a6da1ca6323 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:28.968414 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b13ec12e-b991-4fdb-b107-5a6da1ca6323 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 921da888-cf81-4364-bb2f-469e8e444978] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:28.983418 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b13ec12e-b991-4fdb-b107-5a6da1ca6323 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:28.984283 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b13ec12e-b991-4fdb-b107-5a6da1ca6323 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:28.985021 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b13ec12e-b991-4fdb-b107-5a6da1ca6323 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:28.985955 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b13ec12e-b991-4fdb-b107-5a6da1ca6323 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:28.986621 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b13ec12e-b991-4fdb-b107-5a6da1ca6323 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:28.988479 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b13ec12e-b991-4fdb-b107-5a6da1ca6323 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:29.629239 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b13ec12e-b991-4fdb-b107-5a6da1ca6323 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:29.654909 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b13ec12e-b991-4fdb-b107-5a6da1ca6323 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/921da888-cf81-4364-bb2f-469e8e444978" status: 200 len: 1251 microversion: 2.1 time: 0.697076 Oct 18 15:48:29.655741 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2505/5004] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:28 2022] GET /compute/v2.1/servers/921da888-cf81-4364-bb2f-469e8e444978 => generated 1251 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:29.843122 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3e2bf86b-6e4b-498b-8fd4-47381b7518f3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:29.855432 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3e2bf86b-6e4b-498b-8fd4-47381b7518f3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc" status: 200 len: 1449 microversion: 2.1 time: 1.158995 Oct 18 15:48:29.856359 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2500/5005] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:28 2022] GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc => generated 1449 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:29.885170 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-afdd68aa-e4eb-461c-96d9-094ff2f0cb93 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:29.886306 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-afdd68aa-e4eb-461c-96d9-094ff2f0cb93 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:29.900464 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-afdd68aa-e4eb-461c-96d9-094ff2f0cb93 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:29.901023 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-afdd68aa-e4eb-461c-96d9-094ff2f0cb93 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:29.903739 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-afdd68aa-e4eb-461c-96d9-094ff2f0cb93 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:29.904721 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-afdd68aa-e4eb-461c-96d9-094ff2f0cb93 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:29.905865 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-afdd68aa-e4eb-461c-96d9-094ff2f0cb93 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:29.907384 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-afdd68aa-e4eb-461c-96d9-094ff2f0cb93 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:29.978755 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9cdd8394-735d-4000-a37a-cb4a07c3864a tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-487078765", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "e9cd694a-1ce0-44c2-bc63-4317d2dc0d92"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:48:30.058784 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-9cdd8394-735d-4000-a37a-cb4a07c3864a tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] validate_networks() for [('e9cd694a-1ce0-44c2-bc63-4317d2dc0d92', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:48:30.794689 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-afdd68aa-e4eb-461c-96d9-094ff2f0cb93 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:30.806960 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-afdd68aa-e4eb-461c-96d9-094ff2f0cb93 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1671 microversion: 2.1 time: 0.926629 Oct 18 15:48:30.812122 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2501/5006] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:29 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1671 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:30.824617 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-cef50029-579f-4323-83ea-ebd72df045fe tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:30.827453 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-cef50029-579f-4323-83ea-ebd72df045fe tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 921da888-cf81-4364-bb2f-469e8e444978] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:30.841986 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cef50029-579f-4323-83ea-ebd72df045fe tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:30.842997 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cef50029-579f-4323-83ea-ebd72df045fe tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:30.843470 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cef50029-579f-4323-83ea-ebd72df045fe tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:30.844192 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cef50029-579f-4323-83ea-ebd72df045fe tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:30.844658 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cef50029-579f-4323-83ea-ebd72df045fe tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:30.845121 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cef50029-579f-4323-83ea-ebd72df045fe tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:31.267363 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-cef50029-579f-4323-83ea-ebd72df045fe tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:31.280999 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-cef50029-579f-4323-83ea-ebd72df045fe tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/921da888-cf81-4364-bb2f-469e8e444978" status: 200 len: 1293 microversion: 2.1 time: 0.467556 Oct 18 15:48:31.282805 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2502/5007] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:30 2022] GET /compute/v2.1/servers/921da888-cf81-4364-bb2f-469e8e444978 => generated 1293 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:31.308583 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b24c1e99-b734-4a8a-9ce4-6b907cc576fa tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:31.309797 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b24c1e99-b734-4a8a-9ce4-6b907cc576fa tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:31.320144 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b24c1e99-b734-4a8a-9ce4-6b907cc576fa tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:31.321717 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b24c1e99-b734-4a8a-9ce4-6b907cc576fa tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:31.322525 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b24c1e99-b734-4a8a-9ce4-6b907cc576fa tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:31.323843 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b24c1e99-b734-4a8a-9ce4-6b907cc576fa tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:31.324536 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b24c1e99-b734-4a8a-9ce4-6b907cc576fa tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:31.325220 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b24c1e99-b734-4a8a-9ce4-6b907cc576fa tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:31.441118 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9cdd8394-735d-4000-a37a-cb4a07c3864a tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:48:31.442286 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9cdd8394-735d-4000-a37a-cb4a07c3864a tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:48:31.443006 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9cdd8394-735d-4000-a37a-cb4a07c3864a tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:48:31.444413 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9cdd8394-735d-4000-a37a-cb4a07c3864a tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:48:31.445064 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9cdd8394-735d-4000-a37a-cb4a07c3864a tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:48:31.467614 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9cdd8394-735d-4000-a37a-cb4a07c3864a tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:31.469195 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9cdd8394-735d-4000-a37a-cb4a07c3864a tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:31.469859 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9cdd8394-735d-4000-a37a-cb4a07c3864a tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:31.471552 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9cdd8394-735d-4000-a37a-cb4a07c3864a tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:31.472322 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9cdd8394-735d-4000-a37a-cb4a07c3864a tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:31.473170 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9cdd8394-735d-4000-a37a-cb4a07c3864a tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:31.511950 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-9cdd8394-735d-4000-a37a-cb4a07c3864a tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Getting quotas for project fc0254a3b1a54a9988125e3c09332bb3. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:48:31.518219 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-9cdd8394-735d-4000-a37a-cb4a07c3864a tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Getting quotas for user 4d61956417324dc89bca1389bacbd0a1 and project fc0254a3b1a54a9988125e3c09332bb3. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:48:31.533670 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9cdd8394-735d-4000-a37a-cb4a07c3864a tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Going to run 2 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:48:31.536532 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9cdd8394-735d-4000-a37a-cb4a07c3864a tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] [instance: 210addcc-0cd9-4236-93ff-23b30d8e9888] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:48:31.587705 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9cdd8394-735d-4000-a37a-cb4a07c3864a tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] [instance: c22a3632-d2ae-474c-baf8-e90790d52b43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=210addcc-0cd9-4236-93ff-23b30d8e9888,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:48:31.735885 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9cdd8394-735d-4000-a37a-cb4a07c3864a tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.972738 Oct 18 15:48:31.744877 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2506/5008] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:48:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1984 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 15:48:31.750710 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cbd3162f-c05f-40f0-8d89-fff6d2147964 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:31.758277 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cbd3162f-c05f-40f0-8d89-fff6d2147964 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4d61956417324dc89bca1389bacbd0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0254a3b1a54a9988125e3c09332bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:31.759471 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cbd3162f-c05f-40f0-8d89-fff6d2147964 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Searching by: {'deleted': False, 'project_id': 'fc0254a3b1a54a9988125e3c09332bb3'} {{(pid=120406) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 15:48:31.774486 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b24c1e99-b734-4a8a-9ce4-6b907cc576fa tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:31.783648 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b24c1e99-b734-4a8a-9ce4-6b907cc576fa tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1671 microversion: 2.1 time: 0.499552 Oct 18 15:48:31.783829 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbd3162f-c05f-40f0-8d89-fff6d2147964 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:31.784272 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbd3162f-c05f-40f0-8d89-fff6d2147964 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:31.785692 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbd3162f-c05f-40f0-8d89-fff6d2147964 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:31.788800 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2503/5009] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:31 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1671 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:31.789611 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbd3162f-c05f-40f0-8d89-fff6d2147964 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:31.790383 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbd3162f-c05f-40f0-8d89-fff6d2147964 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:31.790983 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbd3162f-c05f-40f0-8d89-fff6d2147964 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:31.816974 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3570f9b6-cdf0-4348-82e7-4369a2f08602 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:31.818277 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3570f9b6-cdf0-4348-82e7-4369a2f08602 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:31.821336 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cbd3162f-c05f-40f0-8d89-fff6d2147964 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.074470 Oct 18 15:48:31.830047 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2507/5010] 10.222.0.60 () {58 vars in 1125 bytes} [Tue Oct 18 15:48:31 2022] GET /compute/v2.1/servers => generated 675 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:48:31.830797 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3570f9b6-cdf0-4348-82e7-4369a2f08602 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:31.831541 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3570f9b6-cdf0-4348-82e7-4369a2f08602 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:31.832092 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3570f9b6-cdf0-4348-82e7-4369a2f08602 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:31.832950 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3570f9b6-cdf0-4348-82e7-4369a2f08602 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:31.838273 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dfd7496f-80b7-4cc3-824e-f774d1aa55f8 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:31.839138 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3570f9b6-cdf0-4348-82e7-4369a2f08602 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:31.839341 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dfd7496f-80b7-4cc3-824e-f774d1aa55f8 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] [instance: c22a3632-d2ae-474c-baf8-e90790d52b43] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:31.839804 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3570f9b6-cdf0-4348-82e7-4369a2f08602 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:31.968995 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dfd7496f-80b7-4cc3-824e-f774d1aa55f8 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d61956417324dc89bca1389bacbd0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0254a3b1a54a9988125e3c09332bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:31.979126 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dfd7496f-80b7-4cc3-824e-f774d1aa55f8 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] 10.222.0.60 "GET /compute/v2.1/servers/c22a3632-d2ae-474c-baf8-e90790d52b43" status: 200 len: 1219 microversion: 2.1 time: 0.145552 Oct 18 15:48:31.981966 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2508/5011] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:31 2022] GET /compute/v2.1/servers/c22a3632-d2ae-474c-baf8-e90790d52b43 => generated 1219 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:32.306549 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-399d4dc2-5761-4ca7-8a05-1f423331d8df tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:32.307597 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-399d4dc2-5761-4ca7-8a05-1f423331d8df tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 921da888-cf81-4364-bb2f-469e8e444978] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:32.315921 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-399d4dc2-5761-4ca7-8a05-1f423331d8df tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:32.316761 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-399d4dc2-5761-4ca7-8a05-1f423331d8df tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:32.317393 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-399d4dc2-5761-4ca7-8a05-1f423331d8df tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:32.318835 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-399d4dc2-5761-4ca7-8a05-1f423331d8df tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:32.319447 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-399d4dc2-5761-4ca7-8a05-1f423331d8df tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:32.320054 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-399d4dc2-5761-4ca7-8a05-1f423331d8df tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:32.595830 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3570f9b6-cdf0-4348-82e7-4369a2f08602 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:32.604762 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3570f9b6-cdf0-4348-82e7-4369a2f08602 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1671 microversion: 2.1 time: 0.793407 Oct 18 15:48:32.617915 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2504/5012] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:31 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1671 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:48:32.644243 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9a2fc231-8712-4f52-ab14-b8a62c6105a3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:32.645155 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9a2fc231-8712-4f52-ab14-b8a62c6105a3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:32.659011 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9a2fc231-8712-4f52-ab14-b8a62c6105a3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:32.659647 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9a2fc231-8712-4f52-ab14-b8a62c6105a3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:32.660212 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9a2fc231-8712-4f52-ab14-b8a62c6105a3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:32.661301 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9a2fc231-8712-4f52-ab14-b8a62c6105a3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:32.662110 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9a2fc231-8712-4f52-ab14-b8a62c6105a3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:32.662812 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9a2fc231-8712-4f52-ab14-b8a62c6105a3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:33.026011 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-399d4dc2-5761-4ca7-8a05-1f423331d8df tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:33.034610 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-399d4dc2-5761-4ca7-8a05-1f423331d8df tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/921da888-cf81-4364-bb2f-469e8e444978" status: 200 len: 1293 microversion: 2.1 time: 0.732378 Oct 18 15:48:33.035553 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2509/5013] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:32 2022] GET /compute/v2.1/servers/921da888-cf81-4364-bb2f-469e8e444978 => generated 1293 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:48:33.040730 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-96ab6c2f-ada6-403e-a879-c2150b56f79b tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:33.041370 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-96ab6c2f-ada6-403e-a879-c2150b56f79b tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] [instance: c22a3632-d2ae-474c-baf8-e90790d52b43] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:33.178701 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:48:33.502276 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=8 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:48:33.586718 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-96ab6c2f-ada6-403e-a879-c2150b56f79b tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d61956417324dc89bca1389bacbd0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0254a3b1a54a9988125e3c09332bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:33.606900 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-96ab6c2f-ada6-403e-a879-c2150b56f79b tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] 10.222.0.60 "GET /compute/v2.1/servers/c22a3632-d2ae-474c-baf8-e90790d52b43" status: 200 len: 1219 microversion: 2.1 time: 0.566922 Oct 18 15:48:33.612365 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2510/5014] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:33 2022] GET /compute/v2.1/servers/c22a3632-d2ae-474c-baf8-e90790d52b43 => generated 1219 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:33.803584 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9a2fc231-8712-4f52-ab14-b8a62c6105a3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:33.823112 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9a2fc231-8712-4f52-ab14-b8a62c6105a3 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1671 microversion: 2.1 time: 1.181823 Oct 18 15:48:33.825817 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2505/5015] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:32 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1671 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:48:33.849541 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-09cd1538-dc4e-4d49-ba97-1c755504bbfb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:48:33.859187 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09cd1538-dc4e-4d49-ba97-1c755504bbfb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:33.859688 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09cd1538-dc4e-4d49-ba97-1c755504bbfb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:33.860127 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09cd1538-dc4e-4d49-ba97-1c755504bbfb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:33.889862 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-09cd1538-dc4e-4d49-ba97-1c755504bbfb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Going to try to stop instance {{(pid=120406) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 18 15:48:33.945450 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-09cd1538-dc4e-4d49-ba97-1c755504bbfb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "POST /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8/action" status: 202 len: 0 microversion: 2.1 time: 0.099901 Oct 18 15:48:33.956653 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-41d29ea1-e2bc-43d6-82d4-d399b0608741 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:33.957801 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-41d29ea1-e2bc-43d6-82d4-d399b0608741 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:33.963039 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2511/5016] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:48:33 2022] POST /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:48:33.969505 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-41d29ea1-e2bc-43d6-82d4-d399b0608741 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:33.970701 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-41d29ea1-e2bc-43d6-82d4-d399b0608741 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:33.971477 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-41d29ea1-e2bc-43d6-82d4-d399b0608741 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:33.972659 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-41d29ea1-e2bc-43d6-82d4-d399b0608741 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:33.973460 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-41d29ea1-e2bc-43d6-82d4-d399b0608741 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:33.974202 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-41d29ea1-e2bc-43d6-82d4-d399b0608741 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:34.060584 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-67e37123-cb83-42fe-bf2e-033cbbc0f69b tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:34.061582 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-67e37123-cb83-42fe-bf2e-033cbbc0f69b tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 921da888-cf81-4364-bb2f-469e8e444978] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:34.104356 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67e37123-cb83-42fe-bf2e-033cbbc0f69b tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:34.104924 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67e37123-cb83-42fe-bf2e-033cbbc0f69b tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:34.108140 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67e37123-cb83-42fe-bf2e-033cbbc0f69b tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:34.112258 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67e37123-cb83-42fe-bf2e-033cbbc0f69b tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:34.112258 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67e37123-cb83-42fe-bf2e-033cbbc0f69b tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:34.112258 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67e37123-cb83-42fe-bf2e-033cbbc0f69b tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:34.461210 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-41d29ea1-e2bc-43d6-82d4-d399b0608741 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:34.479355 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-41d29ea1-e2bc-43d6-82d4-d399b0608741 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1681 microversion: 2.1 time: 0.526887 Oct 18 15:48:34.482044 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2506/5017] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:33 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1681 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:34.489805 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-2f439b72-d177-4128-a6c5-84ed1d014912 req-1359c34b-53e2-420c-980f-70441833bd3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "921da888-cf81-4364-bb2f-469e8e444978", "tag": "aade4fca-51ea-447f-9eaf-0a8a307c7974"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:48:34.503659 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-2f439b72-d177-4128-a6c5-84ed1d014912 req-1359c34b-53e2-420c-980f-70441833bd3d service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:34.504462 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-2f439b72-d177-4128-a6c5-84ed1d014912 req-1359c34b-53e2-420c-980f-70441833bd3d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:34.506954 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-2f439b72-d177-4128-a6c5-84ed1d014912 req-1359c34b-53e2-420c-980f-70441833bd3d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:34.548386 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-2f439b72-d177-4128-a6c5-84ed1d014912 req-1359c34b-53e2-420c-980f-70441833bd3d service nova] Creating event network-changed:aade4fca-51ea-447f-9eaf-0a8a307c7974 for instance 921da888-cf81-4364-bb2f-469e8e444978 on n-h1-853682-5 Oct 18 15:48:34.560348 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-2f439b72-d177-4128-a6c5-84ed1d014912 req-1359c34b-53e2-420c-980f-70441833bd3d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073959 Oct 18 15:48:34.562404 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2507/5018] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:48:34.648162 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-67e37123-cb83-42fe-bf2e-033cbbc0f69b tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:34.664376 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4db4235e-00e3-449b-92b0-8190be75d374 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:34.669712 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4db4235e-00e3-449b-92b0-8190be75d374 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] [instance: c22a3632-d2ae-474c-baf8-e90790d52b43] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:34.684988 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-67e37123-cb83-42fe-bf2e-033cbbc0f69b tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/921da888-cf81-4364-bb2f-469e8e444978" status: 200 len: 1293 microversion: 2.1 time: 0.627713 Oct 18 15:48:34.687607 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2512/5019] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:34 2022] GET /compute/v2.1/servers/921da888-cf81-4364-bb2f-469e8e444978 => generated 1293 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:48:34.688529 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4db4235e-00e3-449b-92b0-8190be75d374 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:34.689315 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4db4235e-00e3-449b-92b0-8190be75d374 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:34.699896 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4db4235e-00e3-449b-92b0-8190be75d374 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:34.701166 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4db4235e-00e3-449b-92b0-8190be75d374 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:34.703464 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4db4235e-00e3-449b-92b0-8190be75d374 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:34.705055 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4db4235e-00e3-449b-92b0-8190be75d374 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:34.913995 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4db4235e-00e3-449b-92b0-8190be75d374 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d61956417324dc89bca1389bacbd0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0254a3b1a54a9988125e3c09332bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:34.928111 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4db4235e-00e3-449b-92b0-8190be75d374 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] 10.222.0.60 "GET /compute/v2.1/servers/c22a3632-d2ae-474c-baf8-e90790d52b43" status: 200 len: 1271 microversion: 2.1 time: 0.292035 Oct 18 15:48:34.929328 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2508/5020] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:34 2022] GET /compute/v2.1/servers/c22a3632-d2ae-474c-baf8-e90790d52b43 => generated 1271 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:35.507704 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a9f9384b-fa80-4871-8f92-e8f10e2e1035 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:35.508501 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a9f9384b-fa80-4871-8f92-e8f10e2e1035 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:35.519118 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9f9384b-fa80-4871-8f92-e8f10e2e1035 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:35.519805 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9f9384b-fa80-4871-8f92-e8f10e2e1035 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:35.520246 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9f9384b-fa80-4871-8f92-e8f10e2e1035 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:35.522378 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9f9384b-fa80-4871-8f92-e8f10e2e1035 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:35.526650 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9f9384b-fa80-4871-8f92-e8f10e2e1035 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:35.527900 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9f9384b-fa80-4871-8f92-e8f10e2e1035 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:35.712406 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-84533c11-ec49-4c38-87fe-ab25b6e85a35 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:35.714102 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-84533c11-ec49-4c38-87fe-ab25b6e85a35 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 921da888-cf81-4364-bb2f-469e8e444978] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:35.730240 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-84533c11-ec49-4c38-87fe-ab25b6e85a35 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:35.737634 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-84533c11-ec49-4c38-87fe-ab25b6e85a35 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:35.738358 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-84533c11-ec49-4c38-87fe-ab25b6e85a35 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:35.739322 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-84533c11-ec49-4c38-87fe-ab25b6e85a35 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:35.739829 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-84533c11-ec49-4c38-87fe-ab25b6e85a35 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:35.740963 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-84533c11-ec49-4c38-87fe-ab25b6e85a35 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:35.923676 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a9f9384b-fa80-4871-8f92-e8f10e2e1035 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:35.936654 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a9f9384b-fa80-4871-8f92-e8f10e2e1035 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1681 microversion: 2.1 time: 0.432775 Oct 18 15:48:35.937387 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2513/5021] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:35 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1681 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:35.952984 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f3169d93-3290-4a90-8f2b-28c93c2a8481 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:35.953703 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f3169d93-3290-4a90-8f2b-28c93c2a8481 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] [instance: c22a3632-d2ae-474c-baf8-e90790d52b43] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:35.961432 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3169d93-3290-4a90-8f2b-28c93c2a8481 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:35.962529 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3169d93-3290-4a90-8f2b-28c93c2a8481 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:35.963184 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3169d93-3290-4a90-8f2b-28c93c2a8481 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:35.964123 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3169d93-3290-4a90-8f2b-28c93c2a8481 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:35.965084 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3169d93-3290-4a90-8f2b-28c93c2a8481 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:35.967308 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3169d93-3290-4a90-8f2b-28c93c2a8481 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:36.061526 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-84533c11-ec49-4c38-87fe-ab25b6e85a35 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:36.074871 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=98 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:48:36.082867 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-84533c11-ec49-4c38-87fe-ab25b6e85a35 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/921da888-cf81-4364-bb2f-469e8e444978" status: 200 len: 1293 microversion: 2.1 time: 0.374956 Oct 18 15:48:36.084706 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2509/5022] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:35 2022] GET /compute/v2.1/servers/921da888-cf81-4364-bb2f-469e8e444978 => generated 1293 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:36.092195 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f3169d93-3290-4a90-8f2b-28c93c2a8481 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d61956417324dc89bca1389bacbd0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0254a3b1a54a9988125e3c09332bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:36.101318 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f3169d93-3290-4a90-8f2b-28c93c2a8481 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] 10.222.0.60 "GET /compute/v2.1/servers/c22a3632-d2ae-474c-baf8-e90790d52b43" status: 200 len: 1277 microversion: 2.1 time: 0.152270 Oct 18 15:48:36.117758 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2514/5023] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:35 2022] GET /compute/v2.1/servers/c22a3632-d2ae-474c-baf8-e90790d52b43 => generated 1277 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:48:36.977348 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a7b06e34-a454-46a9-966f-95d9939d159f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:36.980884 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a7b06e34-a454-46a9-966f-95d9939d159f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:37.001218 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a7b06e34-a454-46a9-966f-95d9939d159f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:37.002326 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a7b06e34-a454-46a9-966f-95d9939d159f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:37.003004 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a7b06e34-a454-46a9-966f-95d9939d159f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:37.004183 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a7b06e34-a454-46a9-966f-95d9939d159f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:37.004998 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a7b06e34-a454-46a9-966f-95d9939d159f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:37.005699 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a7b06e34-a454-46a9-966f-95d9939d159f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:37.109597 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1b23dcb6-b04e-4bf8-b112-fd055b5342dd tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:37.110821 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1b23dcb6-b04e-4bf8-b112-fd055b5342dd tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 921da888-cf81-4364-bb2f-469e8e444978] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:37.129846 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b23dcb6-b04e-4bf8-b112-fd055b5342dd tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:37.130672 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b23dcb6-b04e-4bf8-b112-fd055b5342dd tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:37.131260 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b23dcb6-b04e-4bf8-b112-fd055b5342dd tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:37.139755 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b23dcb6-b04e-4bf8-b112-fd055b5342dd tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:37.140371 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b23dcb6-b04e-4bf8-b112-fd055b5342dd tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:37.143674 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b23dcb6-b04e-4bf8-b112-fd055b5342dd tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:38.202869 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1b23dcb6-b04e-4bf8-b112-fd055b5342dd tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:38.218183 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1b23dcb6-b04e-4bf8-b112-fd055b5342dd tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/921da888-cf81-4364-bb2f-469e8e444978" status: 200 len: 1293 microversion: 2.1 time: 1.113094 Oct 18 15:48:38.233242 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2515/5024] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:37 2022] GET /compute/v2.1/servers/921da888-cf81-4364-bb2f-469e8e444978 => generated 1293 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:48:38.242945 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-730459aa-d781-406d-a633-f5a2139f5445 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:38.243779 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-730459aa-d781-406d-a633-f5a2139f5445 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] [instance: c22a3632-d2ae-474c-baf8-e90790d52b43] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:38.252238 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-730459aa-d781-406d-a633-f5a2139f5445 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:38.253273 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-730459aa-d781-406d-a633-f5a2139f5445 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:38.254053 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-730459aa-d781-406d-a633-f5a2139f5445 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:38.255100 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-730459aa-d781-406d-a633-f5a2139f5445 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:38.255753 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-730459aa-d781-406d-a633-f5a2139f5445 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:38.256343 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-730459aa-d781-406d-a633-f5a2139f5445 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:38.289212 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a7b06e34-a454-46a9-966f-95d9939d159f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:38.299563 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a7b06e34-a454-46a9-966f-95d9939d159f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1681 microversion: 2.1 time: 1.335658 Oct 18 15:48:38.308296 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2510/5025] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:36 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1681 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:38.932253 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-730459aa-d781-406d-a633-f5a2139f5445 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d61956417324dc89bca1389bacbd0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0254a3b1a54a9988125e3c09332bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:38.941765 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-730459aa-d781-406d-a633-f5a2139f5445 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] 10.222.0.60 "GET /compute/v2.1/servers/c22a3632-d2ae-474c-baf8-e90790d52b43" status: 200 len: 1319 microversion: 2.1 time: 0.707283 Oct 18 15:48:38.942375 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2516/5026] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:38 2022] GET /compute/v2.1/servers/c22a3632-d2ae-474c-baf8-e90790d52b43 => generated 1319 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:39.249177 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6fdd03bb-d765-4437-a33c-f5b31a16d156 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:39.250046 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6fdd03bb-d765-4437-a33c-f5b31a16d156 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 921da888-cf81-4364-bb2f-469e8e444978] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:39.260387 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6fdd03bb-d765-4437-a33c-f5b31a16d156 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:39.260932 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6fdd03bb-d765-4437-a33c-f5b31a16d156 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:39.261383 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6fdd03bb-d765-4437-a33c-f5b31a16d156 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:39.262112 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6fdd03bb-d765-4437-a33c-f5b31a16d156 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:39.272658 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6fdd03bb-d765-4437-a33c-f5b31a16d156 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:39.273396 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6fdd03bb-d765-4437-a33c-f5b31a16d156 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:39.331537 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-834ba438-cf90-4d9f-b5c4-0853182067ae tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:39.332364 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-834ba438-cf90-4d9f-b5c4-0853182067ae tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:39.340098 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-834ba438-cf90-4d9f-b5c4-0853182067ae tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:39.340752 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-834ba438-cf90-4d9f-b5c4-0853182067ae tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:39.341671 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-834ba438-cf90-4d9f-b5c4-0853182067ae tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:39.342636 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-834ba438-cf90-4d9f-b5c4-0853182067ae tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:39.343367 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-834ba438-cf90-4d9f-b5c4-0853182067ae tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:39.344033 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-834ba438-cf90-4d9f-b5c4-0853182067ae tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:39.827784 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6fdd03bb-d765-4437-a33c-f5b31a16d156 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:39.839432 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6fdd03bb-d765-4437-a33c-f5b31a16d156 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/921da888-cf81-4364-bb2f-469e8e444978" status: 200 len: 1293 microversion: 2.1 time: 0.591180 Oct 18 15:48:39.839432 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2511/5027] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:39 2022] GET /compute/v2.1/servers/921da888-cf81-4364-bb2f-469e8e444978 => generated 1293 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:39.844629 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-8260abba-78ef-4ad6-9f2c-a05aa2e98888 req-b0876136-8fb7-458a-bf46-37a5f3a4a582 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "210addcc-0cd9-4236-93ff-23b30d8e9888", "tag": "6993f5ba-702e-42ef-bc0b-51b610b13d0a"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:48:39.855675 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-8260abba-78ef-4ad6-9f2c-a05aa2e98888 req-b0876136-8fb7-458a-bf46-37a5f3a4a582 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:39.856536 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-8260abba-78ef-4ad6-9f2c-a05aa2e98888 req-b0876136-8fb7-458a-bf46-37a5f3a4a582 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:39.857074 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-8260abba-78ef-4ad6-9f2c-a05aa2e98888 req-b0876136-8fb7-458a-bf46-37a5f3a4a582 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:39.869331 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-8260abba-78ef-4ad6-9f2c-a05aa2e98888 req-b0876136-8fb7-458a-bf46-37a5f3a4a582 service nova] Creating event network-changed:6993f5ba-702e-42ef-bc0b-51b610b13d0a for instance 210addcc-0cd9-4236-93ff-23b30d8e9888 on n-h2-853682-5 Oct 18 15:48:39.871759 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-834ba438-cf90-4d9f-b5c4-0853182067ae tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:39.876274 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-8260abba-78ef-4ad6-9f2c-a05aa2e98888 req-b0876136-8fb7-458a-bf46-37a5f3a4a582 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035383 Oct 18 15:48:39.877653 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2512/5028] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:48:39.881293 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-834ba438-cf90-4d9f-b5c4-0853182067ae tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1681 microversion: 2.1 time: 0.553694 Oct 18 15:48:39.882425 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2517/5029] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:39 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1681 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:39.948464 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-8d1f6540-6e3f-4b86-9fab-4d7343f025eb req-508d522b-f6eb-4317-a160-2d7981ea0521 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c22a3632-d2ae-474c-baf8-e90790d52b43", "tag": "0d975714-e3a7-4b4f-ae7c-ce973d7da75c"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:48:39.971119 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-8d1f6540-6e3f-4b86-9fab-4d7343f025eb req-508d522b-f6eb-4317-a160-2d7981ea0521 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:39.972695 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-8d1f6540-6e3f-4b86-9fab-4d7343f025eb req-508d522b-f6eb-4317-a160-2d7981ea0521 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:39.973564 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-8d1f6540-6e3f-4b86-9fab-4d7343f025eb req-508d522b-f6eb-4317-a160-2d7981ea0521 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:39.978959 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-15ceddc6-bd06-4613-965a-1e59153b1646 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:39.979878 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-15ceddc6-bd06-4613-965a-1e59153b1646 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] [instance: c22a3632-d2ae-474c-baf8-e90790d52b43] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:39.990336 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-8d1f6540-6e3f-4b86-9fab-4d7343f025eb req-508d522b-f6eb-4317-a160-2d7981ea0521 service nova] Creating event network-changed:0d975714-e3a7-4b4f-ae7c-ce973d7da75c for instance c22a3632-d2ae-474c-baf8-e90790d52b43 on n-h2-853682-5 Oct 18 15:48:39.998344 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15ceddc6-bd06-4613-965a-1e59153b1646 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:39.999404 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-8d1f6540-6e3f-4b86-9fab-4d7343f025eb req-508d522b-f6eb-4317-a160-2d7981ea0521 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056529 Oct 18 15:48:39.999892 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15ceddc6-bd06-4613-965a-1e59153b1646 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:40.000763 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2513/5030] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:48:40.002655 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15ceddc6-bd06-4613-965a-1e59153b1646 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:40.003386 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15ceddc6-bd06-4613-965a-1e59153b1646 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:40.009507 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15ceddc6-bd06-4613-965a-1e59153b1646 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:40.010622 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15ceddc6-bd06-4613-965a-1e59153b1646 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:40.360118 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3c08d2c5-e67e-4e14-8378-1cb69cd38095 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:40.361210 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3c08d2c5-e67e-4e14-8378-1cb69cd38095 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 5e83c779-c8f8-4ebd-84ab-7f144ab8552a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:40.368871 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3c08d2c5-e67e-4e14-8378-1cb69cd38095 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:40.369726 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3c08d2c5-e67e-4e14-8378-1cb69cd38095 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:40.370446 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3c08d2c5-e67e-4e14-8378-1cb69cd38095 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:40.372263 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3c08d2c5-e67e-4e14-8378-1cb69cd38095 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:40.373017 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3c08d2c5-e67e-4e14-8378-1cb69cd38095 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:40.373697 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3c08d2c5-e67e-4e14-8378-1cb69cd38095 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:40.495160 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-3c08d2c5-e67e-4e14-8378-1cb69cd38095 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lazy-loading 'services' on Instance uuid 5e83c779-c8f8-4ebd-84ab-7f144ab8552a {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:48:40.525048 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-15ceddc6-bd06-4613-965a-1e59153b1646 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d61956417324dc89bca1389bacbd0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0254a3b1a54a9988125e3c09332bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:40.539916 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-15ceddc6-bd06-4613-965a-1e59153b1646 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] 10.222.0.60 "GET /compute/v2.1/servers/c22a3632-d2ae-474c-baf8-e90790d52b43" status: 200 len: 1319 microversion: 2.1 time: 0.573175 Oct 18 15:48:40.541326 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2518/5031] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:39 2022] GET /compute/v2.1/servers/c22a3632-d2ae-474c-baf8-e90790d52b43 => generated 1319 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:48:40.627599 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3c08d2c5-e67e-4e14-8378-1cb69cd38095 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a/os-volume_attachments/a1afd8b4-b9b9-4c07-979c-558282ac358e" status: 202 len: 0 microversion: 2.1 time: 0.272913 Oct 18 15:48:40.629480 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2514/5032] 10.222.0.60 () {58 vars in 1416 bytes} [Tue Oct 18 15:48:40 2022] DELETE /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a/os-volume_attachments/a1afd8b4-b9b9-4c07-979c-558282ac358e => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:48:40.650284 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1579ecc7-a894-46e5-bc7c-53eb7c6d430f tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:40.656225 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1579ecc7-a894-46e5-bc7c-53eb7c6d430f tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 5e83c779-c8f8-4ebd-84ab-7f144ab8552a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:40.699390 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1579ecc7-a894-46e5-bc7c-53eb7c6d430f tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:40.700639 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1579ecc7-a894-46e5-bc7c-53eb7c6d430f tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:40.702795 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1579ecc7-a894-46e5-bc7c-53eb7c6d430f tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:40.703816 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1579ecc7-a894-46e5-bc7c-53eb7c6d430f tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:40.704571 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1579ecc7-a894-46e5-bc7c-53eb7c6d430f tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:40.705273 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1579ecc7-a894-46e5-bc7c-53eb7c6d430f tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:40.760224 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1579ecc7-a894-46e5-bc7c-53eb7c6d430f tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123727 Oct 18 15:48:40.765649 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2519/5033] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 15:48:40 2022] GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:48:40.861369 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-366d464a-6f55-4c96-a0c3-3c59e08a6ec6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:40.862761 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-366d464a-6f55-4c96-a0c3-3c59e08a6ec6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 921da888-cf81-4364-bb2f-469e8e444978] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:40.872553 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-366d464a-6f55-4c96-a0c3-3c59e08a6ec6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:40.873434 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-366d464a-6f55-4c96-a0c3-3c59e08a6ec6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:40.874110 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-366d464a-6f55-4c96-a0c3-3c59e08a6ec6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:40.878702 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-366d464a-6f55-4c96-a0c3-3c59e08a6ec6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:40.879413 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-366d464a-6f55-4c96-a0c3-3c59e08a6ec6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:40.881863 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-366d464a-6f55-4c96-a0c3-3c59e08a6ec6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:40.906734 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-94af45d9-3ea4-4c44-b30e-fe7c5fbfc009 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:40.908356 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-94af45d9-3ea4-4c44-b30e-fe7c5fbfc009 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:40.917047 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94af45d9-3ea4-4c44-b30e-fe7c5fbfc009 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:40.917804 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94af45d9-3ea4-4c44-b30e-fe7c5fbfc009 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:40.918399 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94af45d9-3ea4-4c44-b30e-fe7c5fbfc009 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:40.919297 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94af45d9-3ea4-4c44-b30e-fe7c5fbfc009 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:40.919910 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94af45d9-3ea4-4c44-b30e-fe7c5fbfc009 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:40.920495 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94af45d9-3ea4-4c44-b30e-fe7c5fbfc009 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:41.193804 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-94af45d9-3ea4-4c44-b30e-fe7c5fbfc009 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:41.197739 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-366d464a-6f55-4c96-a0c3-3c59e08a6ec6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:41.213908 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-94af45d9-3ea4-4c44-b30e-fe7c5fbfc009 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1681 microversion: 2.1 time: 0.312132 Oct 18 15:48:41.215099 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-366d464a-6f55-4c96-a0c3-3c59e08a6ec6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/921da888-cf81-4364-bb2f-469e8e444978" status: 200 len: 1293 microversion: 2.1 time: 0.359183 Oct 18 15:48:41.229004 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2515/5034] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:40 2022] GET /compute/v2.1/servers/921da888-cf81-4364-bb2f-469e8e444978 => generated 1293 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:41.229563 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2520/5035] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:40 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1681 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:41.564001 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ab041d5f-4b2b-458a-8bac-fae41a2b0810 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:41.564932 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ab041d5f-4b2b-458a-8bac-fae41a2b0810 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] [instance: c22a3632-d2ae-474c-baf8-e90790d52b43] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:41.572356 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ab041d5f-4b2b-458a-8bac-fae41a2b0810 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:41.581847 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ab041d5f-4b2b-458a-8bac-fae41a2b0810 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:41.582659 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ab041d5f-4b2b-458a-8bac-fae41a2b0810 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:41.584257 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ab041d5f-4b2b-458a-8bac-fae41a2b0810 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:41.584970 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ab041d5f-4b2b-458a-8bac-fae41a2b0810 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:41.587340 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ab041d5f-4b2b-458a-8bac-fae41a2b0810 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:41.778561 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4d7303e9-45ef-472f-8476-17d5304876b2 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:41.791230 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4d7303e9-45ef-472f-8476-17d5304876b2 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 5e83c779-c8f8-4ebd-84ab-7f144ab8552a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:41.801968 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d7303e9-45ef-472f-8476-17d5304876b2 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:41.803766 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d7303e9-45ef-472f-8476-17d5304876b2 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:41.804248 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d7303e9-45ef-472f-8476-17d5304876b2 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:41.805052 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d7303e9-45ef-472f-8476-17d5304876b2 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:41.805525 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d7303e9-45ef-472f-8476-17d5304876b2 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:41.805952 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d7303e9-45ef-472f-8476-17d5304876b2 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:41.810033 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:48:41.859565 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:48:41.894625 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4d7303e9-45ef-472f-8476-17d5304876b2 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122356 Oct 18 15:48:41.901158 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2521/5036] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 15:48:41 2022] GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:48:41.974812 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-02cb6b9b-8080-4ff6-b881-97eb3e0abcd4 req-3de01203-9003-4bb5-b402-dacd1d12ff20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "921da888-cf81-4364-bb2f-469e8e444978", "name": "network-vif-plugged", "status": "completed", "tag": "aade4fca-51ea-447f-9eaf-0a8a307c7974"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:48:41.990128 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-02cb6b9b-8080-4ff6-b881-97eb3e0abcd4 req-3de01203-9003-4bb5-b402-dacd1d12ff20 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:41.990879 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-02cb6b9b-8080-4ff6-b881-97eb3e0abcd4 req-3de01203-9003-4bb5-b402-dacd1d12ff20 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:41.991483 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-02cb6b9b-8080-4ff6-b881-97eb3e0abcd4 req-3de01203-9003-4bb5-b402-dacd1d12ff20 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:42.014397 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-02cb6b9b-8080-4ff6-b881-97eb3e0abcd4 req-3de01203-9003-4bb5-b402-dacd1d12ff20 service nova] Creating event network-vif-plugged:aade4fca-51ea-447f-9eaf-0a8a307c7974 for instance 921da888-cf81-4364-bb2f-469e8e444978 on n-h1-853682-5 Oct 18 15:48:42.030055 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-02cb6b9b-8080-4ff6-b881-97eb3e0abcd4 req-3de01203-9003-4bb5-b402-dacd1d12ff20 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055888 Oct 18 15:48:42.032095 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2522/5037] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:48:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:48:42.184675 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ab041d5f-4b2b-458a-8bac-fae41a2b0810 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d61956417324dc89bca1389bacbd0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0254a3b1a54a9988125e3c09332bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:42.195686 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ab041d5f-4b2b-458a-8bac-fae41a2b0810 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] 10.222.0.60 "GET /compute/v2.1/servers/c22a3632-d2ae-474c-baf8-e90790d52b43" status: 200 len: 1319 microversion: 2.1 time: 0.635738 Oct 18 15:48:42.201994 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2516/5038] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:41 2022] GET /compute/v2.1/servers/c22a3632-d2ae-474c-baf8-e90790d52b43 => generated 1319 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:42.253407 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-75b253e5-798f-4431-ba40-b7773afdb40b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:42.253724 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-42d382ef-4ea8-42a0-a716-54b4ad7bcd3d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:42.254533 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-42d382ef-4ea8-42a0-a716-54b4ad7bcd3d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 921da888-cf81-4364-bb2f-469e8e444978] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:42.256525 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-75b253e5-798f-4431-ba40-b7773afdb40b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:42.272284 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-42d382ef-4ea8-42a0-a716-54b4ad7bcd3d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:42.274447 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-75b253e5-798f-4431-ba40-b7773afdb40b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:42.275995 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-42d382ef-4ea8-42a0-a716-54b4ad7bcd3d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:42.276451 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-42d382ef-4ea8-42a0-a716-54b4ad7bcd3d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:42.277218 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-42d382ef-4ea8-42a0-a716-54b4ad7bcd3d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:42.277682 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-42d382ef-4ea8-42a0-a716-54b4ad7bcd3d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:42.278113 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-42d382ef-4ea8-42a0-a716-54b4ad7bcd3d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:42.278471 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-75b253e5-798f-4431-ba40-b7773afdb40b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:42.279135 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-75b253e5-798f-4431-ba40-b7773afdb40b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:42.279852 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-75b253e5-798f-4431-ba40-b7773afdb40b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:42.280315 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-75b253e5-798f-4431-ba40-b7773afdb40b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:42.280750 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-75b253e5-798f-4431-ba40-b7773afdb40b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:42.591492 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-42d382ef-4ea8-42a0-a716-54b4ad7bcd3d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:42.615595 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-42d382ef-4ea8-42a0-a716-54b4ad7bcd3d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/921da888-cf81-4364-bb2f-469e8e444978" status: 200 len: 1293 microversion: 2.1 time: 0.374033 Oct 18 15:48:42.629087 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2517/5039] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:42 2022] GET /compute/v2.1/servers/921da888-cf81-4364-bb2f-469e8e444978 => generated 1293 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:42.718566 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-75b253e5-798f-4431-ba40-b7773afdb40b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:42.740553 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-75b253e5-798f-4431-ba40-b7773afdb40b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1681 microversion: 2.1 time: 0.502504 Oct 18 15:48:42.752348 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2523/5040] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:42 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1681 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:42.910076 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-23ee200c-11ad-4f27-9a9d-47b7c6e4a4d4 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:42.913884 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-23ee200c-11ad-4f27-9a9d-47b7c6e4a4d4 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 5e83c779-c8f8-4ebd-84ab-7f144ab8552a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:42.930820 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-23ee200c-11ad-4f27-9a9d-47b7c6e4a4d4 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:42.934020 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-23ee200c-11ad-4f27-9a9d-47b7c6e4a4d4 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:42.934575 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-23ee200c-11ad-4f27-9a9d-47b7c6e4a4d4 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:42.936618 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-23ee200c-11ad-4f27-9a9d-47b7c6e4a4d4 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:42.938576 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-23ee200c-11ad-4f27-9a9d-47b7c6e4a4d4 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:42.940413 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-23ee200c-11ad-4f27-9a9d-47b7c6e4a4d4 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:43.030362 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-23ee200c-11ad-4f27-9a9d-47b7c6e4a4d4 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125858 Oct 18 15:48:43.031054 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2518/5041] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 15:48:42 2022] GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:48:43.228797 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3b227843-0691-45e4-87c1-dc6d6b2acace tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:43.229561 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3b227843-0691-45e4-87c1-dc6d6b2acace tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] [instance: c22a3632-d2ae-474c-baf8-e90790d52b43] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:43.239337 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b227843-0691-45e4-87c1-dc6d6b2acace tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:43.239868 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b227843-0691-45e4-87c1-dc6d6b2acace tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:43.240304 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b227843-0691-45e4-87c1-dc6d6b2acace tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:43.241052 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b227843-0691-45e4-87c1-dc6d6b2acace tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:43.241508 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b227843-0691-45e4-87c1-dc6d6b2acace tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:43.243430 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b227843-0691-45e4-87c1-dc6d6b2acace tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:43.593763 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=10 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:48:43.638913 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-12013f60-f6fe-4853-b4cf-3cb1a5c9a616 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:43.641346 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-12013f60-f6fe-4853-b4cf-3cb1a5c9a616 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 921da888-cf81-4364-bb2f-469e8e444978] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:43.651027 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12013f60-f6fe-4853-b4cf-3cb1a5c9a616 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:43.652231 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12013f60-f6fe-4853-b4cf-3cb1a5c9a616 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:43.653707 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12013f60-f6fe-4853-b4cf-3cb1a5c9a616 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:43.654532 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12013f60-f6fe-4853-b4cf-3cb1a5c9a616 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:43.655017 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12013f60-f6fe-4853-b4cf-3cb1a5c9a616 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:43.656305 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12013f60-f6fe-4853-b4cf-3cb1a5c9a616 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:43.974974 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3b227843-0691-45e4-87c1-dc6d6b2acace tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d61956417324dc89bca1389bacbd0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0254a3b1a54a9988125e3c09332bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:43.987264 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3b227843-0691-45e4-87c1-dc6d6b2acace tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] 10.222.0.60 "GET /compute/v2.1/servers/c22a3632-d2ae-474c-baf8-e90790d52b43" status: 200 len: 1319 microversion: 2.1 time: 0.762989 Oct 18 15:48:44.011426 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2524/5042] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:43 2022] GET /compute/v2.1/servers/c22a3632-d2ae-474c-baf8-e90790d52b43 => generated 1319 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:44.017200 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e13ee4af-94d0-4994-85c9-ad0418ed8e4f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:44.017838 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e13ee4af-94d0-4994-85c9-ad0418ed8e4f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:44.035865 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e13ee4af-94d0-4994-85c9-ad0418ed8e4f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:44.038555 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e13ee4af-94d0-4994-85c9-ad0418ed8e4f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:44.039041 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e13ee4af-94d0-4994-85c9-ad0418ed8e4f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:44.039798 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e13ee4af-94d0-4994-85c9-ad0418ed8e4f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:44.040276 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e13ee4af-94d0-4994-85c9-ad0418ed8e4f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:44.040716 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e13ee4af-94d0-4994-85c9-ad0418ed8e4f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:44.137573 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-12013f60-f6fe-4853-b4cf-3cb1a5c9a616 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:44.147427 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-12013f60-f6fe-4853-b4cf-3cb1a5c9a616 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/921da888-cf81-4364-bb2f-469e8e444978" status: 200 len: 1293 microversion: 2.1 time: 0.512291 Oct 18 15:48:44.150861 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2519/5043] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:43 2022] GET /compute/v2.1/servers/921da888-cf81-4364-bb2f-469e8e444978 => generated 1293 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:48:44.166015 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-829e3c13-7995-488e-9465-3b32cf333f09 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:44.170861 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-829e3c13-7995-488e-9465-3b32cf333f09 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 5e83c779-c8f8-4ebd-84ab-7f144ab8552a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:44.190340 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-829e3c13-7995-488e-9465-3b32cf333f09 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:44.194330 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-829e3c13-7995-488e-9465-3b32cf333f09 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:44.195352 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-829e3c13-7995-488e-9465-3b32cf333f09 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:44.197624 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-829e3c13-7995-488e-9465-3b32cf333f09 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:44.198289 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-829e3c13-7995-488e-9465-3b32cf333f09 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:44.201384 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-829e3c13-7995-488e-9465-3b32cf333f09 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:44.255646 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-829e3c13-7995-488e-9465-3b32cf333f09 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102370 Oct 18 15:48:44.257078 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2520/5044] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 15:48:44 2022] GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:48:44.521794 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e13ee4af-94d0-4994-85c9-ad0418ed8e4f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:44.536095 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e13ee4af-94d0-4994-85c9-ad0418ed8e4f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1681 microversion: 2.1 time: 0.521158 Oct 18 15:48:44.554187 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2525/5045] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:44 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1681 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:45.021475 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4bf85818-100c-409d-92f3-b44da636f6a0 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:45.022175 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4bf85818-100c-409d-92f3-b44da636f6a0 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] [instance: c22a3632-d2ae-474c-baf8-e90790d52b43] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:45.034404 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4bf85818-100c-409d-92f3-b44da636f6a0 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:45.034899 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4bf85818-100c-409d-92f3-b44da636f6a0 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:45.035343 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4bf85818-100c-409d-92f3-b44da636f6a0 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:45.036060 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4bf85818-100c-409d-92f3-b44da636f6a0 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:45.036562 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4bf85818-100c-409d-92f3-b44da636f6a0 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:45.037029 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4bf85818-100c-409d-92f3-b44da636f6a0 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:45.181741 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-37798a1b-6724-48af-8b6d-126cdc24f7ff tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:45.183415 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-37798a1b-6724-48af-8b6d-126cdc24f7ff tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 921da888-cf81-4364-bb2f-469e8e444978] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:45.194591 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-37798a1b-6724-48af-8b6d-126cdc24f7ff tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:45.199231 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-37798a1b-6724-48af-8b6d-126cdc24f7ff tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:45.199983 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-37798a1b-6724-48af-8b6d-126cdc24f7ff tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:45.201204 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-37798a1b-6724-48af-8b6d-126cdc24f7ff tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:45.201915 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-37798a1b-6724-48af-8b6d-126cdc24f7ff tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:45.202661 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-37798a1b-6724-48af-8b6d-126cdc24f7ff tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:45.542835 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4bf85818-100c-409d-92f3-b44da636f6a0 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d61956417324dc89bca1389bacbd0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0254a3b1a54a9988125e3c09332bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:45.551319 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4bf85818-100c-409d-92f3-b44da636f6a0 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] 10.222.0.60 "GET /compute/v2.1/servers/c22a3632-d2ae-474c-baf8-e90790d52b43" status: 200 len: 1319 microversion: 2.1 time: 0.543595 Oct 18 15:48:45.552437 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2521/5046] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:45 2022] GET /compute/v2.1/servers/c22a3632-d2ae-474c-baf8-e90790d52b43 => generated 1319 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:45.569030 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6cbf10da-1b4d-4500-ac5e-a3091fb0cc85 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:45.580939 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6cbf10da-1b4d-4500-ac5e-a3091fb0cc85 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 5e83c779-c8f8-4ebd-84ab-7f144ab8552a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:45.593706 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6cbf10da-1b4d-4500-ac5e-a3091fb0cc85 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:45.595591 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6cbf10da-1b4d-4500-ac5e-a3091fb0cc85 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:45.597038 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6cbf10da-1b4d-4500-ac5e-a3091fb0cc85 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:45.598079 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6cbf10da-1b4d-4500-ac5e-a3091fb0cc85 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:45.599328 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6cbf10da-1b4d-4500-ac5e-a3091fb0cc85 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:45.599988 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6cbf10da-1b4d-4500-ac5e-a3091fb0cc85 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:45.651785 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6cbf10da-1b4d-4500-ac5e-a3091fb0cc85 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089473 Oct 18 15:48:45.657275 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2522/5047] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 15:48:45 2022] GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:48:45.663132 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-80b0a283-2163-4bfb-8139-18afa1b26f4d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:45.664014 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-80b0a283-2163-4bfb-8139-18afa1b26f4d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:45.671363 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-80b0a283-2163-4bfb-8139-18afa1b26f4d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:45.672151 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-80b0a283-2163-4bfb-8139-18afa1b26f4d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:45.672769 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-80b0a283-2163-4bfb-8139-18afa1b26f4d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:45.673799 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-80b0a283-2163-4bfb-8139-18afa1b26f4d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:45.674494 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-80b0a283-2163-4bfb-8139-18afa1b26f4d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:45.675102 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-80b0a283-2163-4bfb-8139-18afa1b26f4d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:45.687199 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-37798a1b-6724-48af-8b6d-126cdc24f7ff tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:45.707582 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-37798a1b-6724-48af-8b6d-126cdc24f7ff tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/921da888-cf81-4364-bb2f-469e8e444978" status: 200 len: 1473 microversion: 2.1 time: 0.527997 Oct 18 15:48:45.729422 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2526/5048] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:45 2022] GET /compute/v2.1/servers/921da888-cf81-4364-bb2f-469e8e444978 => generated 1473 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:45.925780 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ee4c2b7d-81f8-41f8-ab6d-8468ed16bf6d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1957355852", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:48:46.018370 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-ee4c2b7d-81f8-41f8-ab6d-8468ed16bf6d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] validate_networks() for [('5126a012-82e3-4304-a7ec-ac28e05a407b', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:48:46.031786 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-80b0a283-2163-4bfb-8139-18afa1b26f4d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:46.040746 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-80b0a283-2163-4bfb-8139-18afa1b26f4d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1658 microversion: 2.1 time: 0.382107 Oct 18 15:48:46.041394 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2523/5049] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:45 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1658 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:46.067371 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f62e9262-0853-4b7f-9a61-7838b33cfe2c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:48:46.078057 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f62e9262-0853-4b7f-9a61-7838b33cfe2c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:46.078853 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f62e9262-0853-4b7f-9a61-7838b33cfe2c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:46.079469 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f62e9262-0853-4b7f-9a61-7838b33cfe2c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:46.126309 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f62e9262-0853-4b7f-9a61-7838b33cfe2c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Going to try to start instance {{(pid=120405) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 18 15:48:46.230911 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f62e9262-0853-4b7f-9a61-7838b33cfe2c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "POST /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8/action" status: 202 len: 0 microversion: 2.1 time: 0.167183 Oct 18 15:48:46.232055 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2524/5050] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:48:46 2022] POST /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:48:46.240489 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c914f635-9e22-49fb-8338-6d81be9bba04 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:46.241233 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c914f635-9e22-49fb-8338-6d81be9bba04 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:46.260771 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c914f635-9e22-49fb-8338-6d81be9bba04 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:46.261317 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c914f635-9e22-49fb-8338-6d81be9bba04 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:46.261763 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c914f635-9e22-49fb-8338-6d81be9bba04 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:46.262690 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c914f635-9e22-49fb-8338-6d81be9bba04 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:46.263297 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c914f635-9e22-49fb-8338-6d81be9bba04 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:46.263743 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c914f635-9e22-49fb-8338-6d81be9bba04 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:46.906648 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c914f635-9e22-49fb-8338-6d81be9bba04 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:46.923438 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c914f635-9e22-49fb-8338-6d81be9bba04 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1667 microversion: 2.1 time: 0.686951 Oct 18 15:48:46.924377 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2525/5051] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:46 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1667 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:48:46.930519 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e14d9cdd-91bd-4448-b73b-f42e80bd983f tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:46.931470 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e14d9cdd-91bd-4448-b73b-f42e80bd983f tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] [instance: c22a3632-d2ae-474c-baf8-e90790d52b43] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:46.951234 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e14d9cdd-91bd-4448-b73b-f42e80bd983f tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:46.955807 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e14d9cdd-91bd-4448-b73b-f42e80bd983f tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:46.956573 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e14d9cdd-91bd-4448-b73b-f42e80bd983f tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:46.958846 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e14d9cdd-91bd-4448-b73b-f42e80bd983f tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:46.961548 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e14d9cdd-91bd-4448-b73b-f42e80bd983f tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:46.962276 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e14d9cdd-91bd-4448-b73b-f42e80bd983f tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:47.004634 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:48:47.918286 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e14d9cdd-91bd-4448-b73b-f42e80bd983f tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d61956417324dc89bca1389bacbd0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0254a3b1a54a9988125e3c09332bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:47.924275 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-ee4c2b7d-81f8-41f8-ab6d-8468ed16bf6d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:48:47.925381 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-ee4c2b7d-81f8-41f8-ab6d-8468ed16bf6d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:48:47.926675 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-ee4c2b7d-81f8-41f8-ab6d-8468ed16bf6d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:48:47.927201 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-ee4c2b7d-81f8-41f8-ab6d-8468ed16bf6d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:48:47.927818 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-ee4c2b7d-81f8-41f8-ab6d-8468ed16bf6d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:48:47.933859 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e14d9cdd-91bd-4448-b73b-f42e80bd983f tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] 10.222.0.60 "GET /compute/v2.1/servers/c22a3632-d2ae-474c-baf8-e90790d52b43" status: 200 len: 1319 microversion: 2.1 time: 1.008127 Oct 18 15:48:47.934511 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2526/5052] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:46 2022] GET /compute/v2.1/servers/c22a3632-d2ae-474c-baf8-e90790d52b43 => generated 1319 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:47.953256 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-10d93a15-f669-4ad2-8e2b-a288cb352dc1 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:47.955037 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee4c2b7d-81f8-41f8-ab6d-8468ed16bf6d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:47.955719 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee4c2b7d-81f8-41f8-ab6d-8468ed16bf6d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:47.956332 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee4c2b7d-81f8-41f8-ab6d-8468ed16bf6d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:47.956974 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-10d93a15-f669-4ad2-8e2b-a288cb352dc1 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 5e83c779-c8f8-4ebd-84ab-7f144ab8552a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:47.957578 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee4c2b7d-81f8-41f8-ab6d-8468ed16bf6d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:47.958777 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee4c2b7d-81f8-41f8-ab6d-8468ed16bf6d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:47.959370 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee4c2b7d-81f8-41f8-ab6d-8468ed16bf6d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:47.973663 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-10d93a15-f669-4ad2-8e2b-a288cb352dc1 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:47.975663 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-10d93a15-f669-4ad2-8e2b-a288cb352dc1 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:47.976473 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-10d93a15-f669-4ad2-8e2b-a288cb352dc1 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:47.979219 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-10d93a15-f669-4ad2-8e2b-a288cb352dc1 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:47.983102 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-10d93a15-f669-4ad2-8e2b-a288cb352dc1 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:47.983854 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-10d93a15-f669-4ad2-8e2b-a288cb352dc1 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:48.047862 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-ee4c2b7d-81f8-41f8-ab6d-8468ed16bf6d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Getting quotas for project afdb1e8b478f463987ec223f2d10db33. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:48:48.058179 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-ee4c2b7d-81f8-41f8-ab6d-8468ed16bf6d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Getting quotas for user 73f4ee2e7ff34dd88b9b82fefbf06a36 and project afdb1e8b478f463987ec223f2d10db33. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:48:48.060553 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-10d93a15-f669-4ad2-8e2b-a288cb352dc1 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.119558 Oct 18 15:48:48.061740 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2527/5053] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 15:48:47 2022] GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a/os-volume_attachments => generated 25 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:48:48.066878 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-be56e4a9-7092-4d36-98ca-b7f61e9cbbab tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:48.068287 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-be56e4a9-7092-4d36-98ca-b7f61e9cbbab tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:48.084730 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-be56e4a9-7092-4d36-98ca-b7f61e9cbbab tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:48.087202 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-be56e4a9-7092-4d36-98ca-b7f61e9cbbab tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:48.087341 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ee4c2b7d-81f8-41f8-ab6d-8468ed16bf6d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:48:48.088213 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-be56e4a9-7092-4d36-98ca-b7f61e9cbbab tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:48.091162 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-be56e4a9-7092-4d36-98ca-b7f61e9cbbab tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:48.091839 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-be56e4a9-7092-4d36-98ca-b7f61e9cbbab tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:48.094498 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-be56e4a9-7092-4d36-98ca-b7f61e9cbbab tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:48.103715 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ee4c2b7d-81f8-41f8-ab6d-8468ed16bf6d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 98f6cc17-6875-49c2-86c5-a8130b901036] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:48:48.253862 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ee4c2b7d-81f8-41f8-ab6d-8468ed16bf6d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.332578 Oct 18 15:48:48.255697 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2527/5054] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:48:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2335 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:48:48.263858 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5638b385-8178-49d9-b40b-1c65621c4a2a tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:48:48.266659 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5638b385-8178-49d9-b40b-1c65621c4a2a tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: a49f5b92-61e2-44bd-92a9-2bbaa1fb8975] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:48.275577 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5638b385-8178-49d9-b40b-1c65621c4a2a tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:48.276249 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5638b385-8178-49d9-b40b-1c65621c4a2a tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:48.277023 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5638b385-8178-49d9-b40b-1c65621c4a2a tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:48.278056 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5638b385-8178-49d9-b40b-1c65621c4a2a tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:48.278672 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5638b385-8178-49d9-b40b-1c65621c4a2a tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:48.279288 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5638b385-8178-49d9-b40b-1c65621c4a2a tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:48.352603 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-be56e4a9-7092-4d36-98ca-b7f61e9cbbab tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:48.366382 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-be56e4a9-7092-4d36-98ca-b7f61e9cbbab tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1667 microversion: 2.1 time: 0.303324 Oct 18 15:48:48.381652 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-5638b385-8178-49d9-b40b-1c65621c4a2a tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] HTTP exception thrown: Cannot 'reboot' instance a49f5b92-61e2-44bd-92a9-2bbaa1fb8975 while it is in vm_state rescued Oct 18 15:48:48.385699 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2528/5055] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:48 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1667 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5638b385-8178-49d9-b40b-1c65621c4a2a tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Request method failure captured: Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975/action HTTP/1.1 Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 28 Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsmOlfJjna__aWkkHZgCFMOd2DpNqn_dr-IEPGuxkqNqAVs7tN5T268nd09vhRJnPU2g5DJC-yqBSq_x2HTDX86g3yOFixR2PbozSJNAuQoWzOe1hqzQDBztCsy4gcfQ635XTPjGuAISQPn4_b-3rgJ6h45QPHOVHclQC7dNdVcnHno Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 224ca1f734c14bc8bf31e1826faf8e71 Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1233761615 Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/224ca1f734c14bc8bf31e1826faf8e71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/224ca1f734c14bc8bf31e1826faf8e71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/224ca1f734c14bc8bf31e1826faf8e71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_224ca1f734c14bc8bf31e1826faf8e71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1233761615 Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 224ca1f734c14bc8bf31e1826faf8e71 Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1233761615 Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServerRescueNegativeTestJSON-1233761615-project Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 646fb4652c164c1dab5672d33d9fb295 Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1233761615-project Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: {"reboot": {"type": "HARD"}} Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: exception: Cannot 'reboot' instance a49f5b92-61e2-44bd-92a9-2bbaa1fb8975 while it is in vm_state rescued Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'a49f5b92-61e2-44bd-92a9-2bbaa1fb8975', 'body': {'reboot': {'type': 'HARD'}}} Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a49f5b92-61e2-44bd-92a9-2bbaa1fb8975 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 15:48:48.387672 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 15:48:48.392990 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance a49f5b92-61e2-44bd-92a9-2bbaa1fb8975 while it is in vm_state rescued Oct 18 15:48:48.392990 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:48:48.392990 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:48:48.392990 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:48:48.392990 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:48:48.392990 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:48:48.392990 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:48:48.392990 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:48:48.392990 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:48:48.392990 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance a49f5b92-61e2-44bd-92a9-2bbaa1fb8975 while it is in vm_state rescued Oct 18 15:48:48.392990 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:48:48.393858 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9b9fb7f3-dbab-4f9f-84c7-f120c34685b4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:48.393858 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9b9fb7f3-dbab-4f9f-84c7-f120c34685b4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 98f6cc17-6875-49c2-86c5-a8130b901036] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:48.396122 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5638b385-8178-49d9-b40b-1c65621c4a2a tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Returning 409 to user: Cannot 'reboot' instance a49f5b92-61e2-44bd-92a9-2bbaa1fb8975 while it is in vm_state rescued {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:48:48.398596 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5638b385-8178-49d9-b40b-1c65621c4a2a tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "POST /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975/action" status: 409 len: 145 microversion: 2.1 time: 0.140661 Oct 18 15:48:48.405642 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2528/5056] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:48:48 2022] POST /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975/action => generated 145 bytes in 149 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 15:48:48.413802 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9b9fb7f3-dbab-4f9f-84c7-f120c34685b4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 98f6cc17-6875-49c2-86c5-a8130b901036] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:48:48.416396 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4997fbbf-2712-4300-b4ce-8c6ffb65382d tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:48:48.419888 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4997fbbf-2712-4300-b4ce-8c6ffb65382d tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: a49f5b92-61e2-44bd-92a9-2bbaa1fb8975] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:48.435721 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:48:48.438551 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4997fbbf-2712-4300-b4ce-8c6ffb65382d tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:48.439253 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4997fbbf-2712-4300-b4ce-8c6ffb65382d tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:48.439946 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4997fbbf-2712-4300-b4ce-8c6ffb65382d tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:48.440913 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4997fbbf-2712-4300-b4ce-8c6ffb65382d tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:48.441833 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4997fbbf-2712-4300-b4ce-8c6ffb65382d tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:48.444210 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4997fbbf-2712-4300-b4ce-8c6ffb65382d tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:48.484086 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-4997fbbf-2712-4300-b4ce-8c6ffb65382d tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] HTTP exception thrown: Cannot 'rebuild' instance a49f5b92-61e2-44bd-92a9-2bbaa1fb8975 while it is in vm_state rescued Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4997fbbf-2712-4300-b4ce-8c6ffb65382d tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Request method failure captured: Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975/action HTTP/1.1 Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 65 Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsmOlfJjna__aWkkHZgCFMOd2DpNqn_dr-IEPGuxkqNqAVs7tN5T268nd09vhRJnPU2g5DJC-yqBSq_x2HTDX86g3yOFixR2PbozSJNAuQoWzOe1hqzQDBztCsy4gcfQ635XTPjGuAISQPn4_b-3rgJ6h45QPHOVHclQC7dNdVcnHno Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 224ca1f734c14bc8bf31e1826faf8e71 Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1233761615 Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/224ca1f734c14bc8bf31e1826faf8e71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/224ca1f734c14bc8bf31e1826faf8e71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/224ca1f734c14bc8bf31e1826faf8e71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_224ca1f734c14bc8bf31e1826faf8e71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1233761615 Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 224ca1f734c14bc8bf31e1826faf8e71 Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1233761615 Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServerRescueNegativeTestJSON-1233761615-project Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 646fb4652c164c1dab5672d33d9fb295 Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1233761615-project Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: {"rebuild": {"imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b"}} Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: exception: Cannot 'rebuild' instance a49f5b92-61e2-44bd-92a9-2bbaa1fb8975 while it is in vm_state rescued Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'a49f5b92-61e2-44bd-92a9-2bbaa1fb8975', 'body': {'rebuild': {'imageRef': '8f4db252-bff6-4685-9c8d-4c5d6bd9f78b'}}} Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a49f5b92-61e2-44bd-92a9-2bbaa1fb8975 in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:48:48.488079 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:48:48.494402 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:48:48.494402 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 18 15:48:48.494402 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 18 15:48:48.494402 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 18 15:48:48.494402 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 15:48:48.494402 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 15:48:48.494402 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance a49f5b92-61e2-44bd-92a9-2bbaa1fb8975 while it is in vm_state rescued Oct 18 15:48:48.494402 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:48:48.494402 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:48:48.494402 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:48:48.494402 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:48:48.494402 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:48:48.494402 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:48:48.494402 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:48:48.494402 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:48:48.494402 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance a49f5b92-61e2-44bd-92a9-2bbaa1fb8975 while it is in vm_state rescued Oct 18 15:48:48.494402 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:48:48.497992 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4997fbbf-2712-4300-b4ce-8c6ffb65382d tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Returning 409 to user: Cannot 'rebuild' instance a49f5b92-61e2-44bd-92a9-2bbaa1fb8975 while it is in vm_state rescued {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:48:48.499036 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4997fbbf-2712-4300-b4ce-8c6ffb65382d tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "POST /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975/action" status: 409 len: 146 microversion: 2.1 time: 0.087221 Oct 18 15:48:48.500066 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2529/5057] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:48:48 2022] POST /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975/action => generated 146 bytes in 89 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 18 15:48:48.513281 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d515fdf1-84d0-41cc-af51-f5114ffb82c3 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:48.519036 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d515fdf1-84d0-41cc-af51-f5114ffb82c3 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 5e83c779-c8f8-4ebd-84ab-7f144ab8552a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:48.526901 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d515fdf1-84d0-41cc-af51-f5114ffb82c3 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:48.527598 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d515fdf1-84d0-41cc-af51-f5114ffb82c3 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:48.528217 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d515fdf1-84d0-41cc-af51-f5114ffb82c3 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:48.529473 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d515fdf1-84d0-41cc-af51-f5114ffb82c3 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:48.530092 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d515fdf1-84d0-41cc-af51-f5114ffb82c3 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:48.530693 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d515fdf1-84d0-41cc-af51-f5114ffb82c3 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:48.562599 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9b9fb7f3-dbab-4f9f-84c7-f120c34685b4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "DELETE /compute/v2.1/servers/98f6cc17-6875-49c2-86c5-a8130b901036" status: 204 len: 0 microversion: 2.1 time: 0.175256 Oct 18 15:48:48.563410 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2529/5058] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:48:48 2022] DELETE /compute/v2.1/servers/98f6cc17-6875-49c2-86c5-a8130b901036 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:48:48.573126 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-56876454-61e4-45f3-ad0e-ca960240074a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:48.573891 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-56876454-61e4-45f3-ad0e-ca960240074a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 98f6cc17-6875-49c2-86c5-a8130b901036] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:48.591403 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-56876454-61e4-45f3-ad0e-ca960240074a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] HTTP exception thrown: Instance 98f6cc17-6875-49c2-86c5-a8130b901036 could not be found. Oct 18 15:48:48.592594 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d515fdf1-84d0-41cc-af51-f5114ffb82c3 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 5e83c779-c8f8-4ebd-84ab-7f144ab8552a] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-56876454-61e4-45f3-ad0e-ca960240074a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Request method failure captured: Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/98f6cc17-6875-49c2-86c5-a8130b901036 HTTP/1.1 Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsrEJhXnu9-kA1ME2ZgtL01L1ZZn_p1cwLPkqNlVzGclz5bmzyyOf2BB4P7wVe6-U6KsqFzM-iyEynyHjx99j1zL9TNO9M1_0gjdhVd46w55yQ-UymJhYbErDED9EKpU_GJnghtBqaCd9UvgTeTf4e4PvQGeOp69vMSi60uoNlhyAmg Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: afdb1e8b478f463987ec223f2d10db33 Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServersTestJSON-126042862 Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServersTestJSON-126042862 Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: afdb1e8b478f463987ec223f2d10db33 Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServersTestJSON-126042862 Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServersTestJSON-126042862-project Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 73f4ee2e7ff34dd88b9b82fefbf06a36 Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServersTestJSON-126042862-project Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 98f6cc17-6875-49c2-86c5-a8130b901036 could not be found. Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '98f6cc17-6875-49c2-86c5-a8130b901036'} Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2932, in _get_instance Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance 98f6cc17-6875-49c2-86c5-a8130b901036 Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98f6cc17-6875-49c2-86c5-a8130b901036 could not be found. Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:48:48.603041 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:48:48.608210 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:48:48.608210 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:48:48.608210 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:48:48.608210 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:48:48.608210 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:48:48.608210 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:48:48.608210 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:48:48.608210 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:48:48.608210 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:48:48.608210 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:48:48.608210 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98f6cc17-6875-49c2-86c5-a8130b901036 could not be found. Oct 18 15:48:48.608210 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:48:48.608210 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:48:48.608210 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:48:48.608210 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:48:48.608210 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:48:48.608210 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:48:48.608210 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:48:48.608210 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:48:48.608210 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98f6cc17-6875-49c2-86c5-a8130b901036 could not be found. Oct 18 15:48:48.608210 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:48:48.608210 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-56876454-61e4-45f3-ad0e-ca960240074a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Returning 404 to user: Instance 98f6cc17-6875-49c2-86c5-a8130b901036 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:48:48.608210 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-56876454-61e4-45f3-ad0e-ca960240074a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/98f6cc17-6875-49c2-86c5-a8130b901036" status: 404 len: 111 microversion: 2.1 time: 0.037964 Oct 18 15:48:48.617079 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2530/5059] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:48 2022] GET /compute/v2.1/servers/98f6cc17-6875-49c2-86c5-a8130b901036 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:48:48.701152 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9c8e09af-6394-4128-bd0e-213b979982d1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-41923334", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "5126a012-82e3-4304-a7ec-ac28e05a407b"}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:48:48.791119 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d515fdf1-84d0-41cc-af51-f5114ffb82c3 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a" status: 204 len: 0 microversion: 2.1 time: 0.282920 Oct 18 15:48:48.795525 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2530/5060] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:48:48 2022] DELETE /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 15:48:48.817777 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6322eed5-4a7e-452c-bf33-d27780b58813 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:48.821751 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6322eed5-4a7e-452c-bf33-d27780b58813 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 5e83c779-c8f8-4ebd-84ab-7f144ab8552a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:48.831993 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6322eed5-4a7e-452c-bf33-d27780b58813 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:48.832728 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6322eed5-4a7e-452c-bf33-d27780b58813 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:48.833330 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6322eed5-4a7e-452c-bf33-d27780b58813 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:48.834711 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6322eed5-4a7e-452c-bf33-d27780b58813 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:48.835168 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6322eed5-4a7e-452c-bf33-d27780b58813 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:48.837807 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6322eed5-4a7e-452c-bf33-d27780b58813 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:48.844677 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-9c8e09af-6394-4128-bd0e-213b979982d1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] validate_networks() for [('5126a012-82e3-4304-a7ec-ac28e05a407b', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:48:49.149319 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6322eed5-4a7e-452c-bf33-d27780b58813 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:49.174001 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6322eed5-4a7e-452c-bf33-d27780b58813 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a" status: 200 len: 1690 microversion: 2.1 time: 0.369795 Oct 18 15:48:49.174001 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2531/5061] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:48 2022] GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a => generated 1690 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:49.193207 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-759c1b6b-fa94-4b5c-9642-cf312ce1ecc1 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:49.193826 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-759c1b6b-fa94-4b5c-9642-cf312ce1ecc1 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] [instance: c22a3632-d2ae-474c-baf8-e90790d52b43] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:49.206761 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-759c1b6b-fa94-4b5c-9642-cf312ce1ecc1 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:49.208771 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-759c1b6b-fa94-4b5c-9642-cf312ce1ecc1 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:49.210075 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-759c1b6b-fa94-4b5c-9642-cf312ce1ecc1 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:49.211587 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-759c1b6b-fa94-4b5c-9642-cf312ce1ecc1 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:49.212236 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-759c1b6b-fa94-4b5c-9642-cf312ce1ecc1 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:49.212867 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-759c1b6b-fa94-4b5c-9642-cf312ce1ecc1 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:49.522296 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-759c1b6b-fa94-4b5c-9642-cf312ce1ecc1 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d61956417324dc89bca1389bacbd0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0254a3b1a54a9988125e3c09332bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:49.534431 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-759c1b6b-fa94-4b5c-9642-cf312ce1ecc1 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] 10.222.0.60 "GET /compute/v2.1/servers/c22a3632-d2ae-474c-baf8-e90790d52b43" status: 200 len: 1319 microversion: 2.1 time: 0.360970 Oct 18 15:48:49.536722 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2532/5062] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:49 2022] GET /compute/v2.1/servers/c22a3632-d2ae-474c-baf8-e90790d52b43 => generated 1319 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:49.543005 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-67e7f1ae-1aac-458b-bd60-86cd6428a4c9 req-32be9ee3-0431-4038-b1d3-ac6c6b8d9155 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "210addcc-0cd9-4236-93ff-23b30d8e9888", "name": "network-vif-plugged", "status": "completed", "tag": "6993f5ba-702e-42ef-bc0b-51b610b13d0a"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:48:49.560058 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-67e7f1ae-1aac-458b-bd60-86cd6428a4c9 req-32be9ee3-0431-4038-b1d3-ac6c6b8d9155 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:49.560740 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-67e7f1ae-1aac-458b-bd60-86cd6428a4c9 req-32be9ee3-0431-4038-b1d3-ac6c6b8d9155 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:49.561421 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-67e7f1ae-1aac-458b-bd60-86cd6428a4c9 req-32be9ee3-0431-4038-b1d3-ac6c6b8d9155 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:49.578652 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-67e7f1ae-1aac-458b-bd60-86cd6428a4c9 req-32be9ee3-0431-4038-b1d3-ac6c6b8d9155 service nova] Creating event network-vif-plugged:6993f5ba-702e-42ef-bc0b-51b610b13d0a for instance 210addcc-0cd9-4236-93ff-23b30d8e9888 on n-h2-853682-5 Oct 18 15:48:49.580311 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-9c8e09af-6394-4128-bd0e-213b979982d1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:48:49.580833 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-9c8e09af-6394-4128-bd0e-213b979982d1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:48:49.581412 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-9c8e09af-6394-4128-bd0e-213b979982d1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:48:49.581943 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-9c8e09af-6394-4128-bd0e-213b979982d1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:48:49.582459 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-9c8e09af-6394-4128-bd0e-213b979982d1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:48:49.584662 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-67e7f1ae-1aac-458b-bd60-86cd6428a4c9 req-32be9ee3-0431-4038-b1d3-ac6c6b8d9155 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046341 Oct 18 15:48:49.585997 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2533/5063] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:48:49.599742 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9c8e09af-6394-4128-bd0e-213b979982d1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:49.600383 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9c8e09af-6394-4128-bd0e-213b979982d1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:49.601118 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9c8e09af-6394-4128-bd0e-213b979982d1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:49.602562 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9c8e09af-6394-4128-bd0e-213b979982d1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:49.603332 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9c8e09af-6394-4128-bd0e-213b979982d1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:49.604005 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9c8e09af-6394-4128-bd0e-213b979982d1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:49.607805 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5f4ed4ab-5ce4-4eb4-9b61-168d706159bc tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:49.611147 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5f4ed4ab-5ce4-4eb4-9b61-168d706159bc tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:49.621107 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f4ed4ab-5ce4-4eb4-9b61-168d706159bc tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:49.621966 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f4ed4ab-5ce4-4eb4-9b61-168d706159bc tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:49.622587 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f4ed4ab-5ce4-4eb4-9b61-168d706159bc tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:49.632876 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f4ed4ab-5ce4-4eb4-9b61-168d706159bc tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:49.633700 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f4ed4ab-5ce4-4eb4-9b61-168d706159bc tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:49.635595 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f4ed4ab-5ce4-4eb4-9b61-168d706159bc tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:49.641582 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-9c8e09af-6394-4128-bd0e-213b979982d1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Getting quotas for project afdb1e8b478f463987ec223f2d10db33. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:48:49.651871 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-9c8e09af-6394-4128-bd0e-213b979982d1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Getting quotas for user 73f4ee2e7ff34dd88b9b82fefbf06a36 and project afdb1e8b478f463987ec223f2d10db33. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:48:49.668334 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9c8e09af-6394-4128-bd0e-213b979982d1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:48:49.672689 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9c8e09af-6394-4128-bd0e-213b979982d1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 9f83bb30-fed3-427f-bdb6-8013f5bc7b29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:48:49.711763 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:48:49.753302 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9c8e09af-6394-4128-bd0e-213b979982d1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.057758 Oct 18 15:48:49.761581 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2531/5064] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:48:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1068 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:48:49.767737 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1c18b4a8-8209-4667-9dcd-295140db9be9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:49.768606 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1c18b4a8-8209-4667-9dcd-295140db9be9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 9f83bb30-fed3-427f-bdb6-8013f5bc7b29] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:49.886889 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1c18b4a8-8209-4667-9dcd-295140db9be9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:49.899090 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1c18b4a8-8209-4667-9dcd-295140db9be9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/9f83bb30-fed3-427f-bdb6-8013f5bc7b29" status: 200 len: 1219 microversion: 2.1 time: 0.135492 Oct 18 15:48:49.901497 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2532/5065] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:49 2022] GET /compute/v2.1/servers/9f83bb30-fed3-427f-bdb6-8013f5bc7b29 => generated 1219 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:49.955876 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5f4ed4ab-5ce4-4eb4-9b61-168d706159bc tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:49.965901 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5f4ed4ab-5ce4-4eb4-9b61-168d706159bc tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1671 microversion: 2.1 time: 0.377553 Oct 18 15:48:49.969675 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2534/5066] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:49 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1671 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:49.994343 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b4b2f289-39bb-429e-8cd4-01e2be06762b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:49.994975 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b4b2f289-39bb-429e-8cd4-01e2be06762b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:50.002858 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b4b2f289-39bb-429e-8cd4-01e2be06762b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:50.003365 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b4b2f289-39bb-429e-8cd4-01e2be06762b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:50.003800 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b4b2f289-39bb-429e-8cd4-01e2be06762b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:50.004558 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b4b2f289-39bb-429e-8cd4-01e2be06762b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:50.005657 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b4b2f289-39bb-429e-8cd4-01e2be06762b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:50.006137 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b4b2f289-39bb-429e-8cd4-01e2be06762b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:50.197369 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5f6c2bb6-bca3-44ea-952a-ef14c16feb8b tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:50.199018 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5f6c2bb6-bca3-44ea-952a-ef14c16feb8b tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 5e83c779-c8f8-4ebd-84ab-7f144ab8552a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:50.216440 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f6c2bb6-bca3-44ea-952a-ef14c16feb8b tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:50.220170 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f6c2bb6-bca3-44ea-952a-ef14c16feb8b tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:50.221087 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f6c2bb6-bca3-44ea-952a-ef14c16feb8b tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:50.224848 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f6c2bb6-bca3-44ea-952a-ef14c16feb8b tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:50.225623 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f6c2bb6-bca3-44ea-952a-ef14c16feb8b tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:50.226341 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f6c2bb6-bca3-44ea-952a-ef14c16feb8b tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:50.246813 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b4b2f289-39bb-429e-8cd4-01e2be06762b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:50.261193 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b4b2f289-39bb-429e-8cd4-01e2be06762b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1671 microversion: 2.1 time: 0.270051 Oct 18 15:48:50.263554 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2533/5067] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:49 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1671 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:50.297552 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-54734d84-9f1f-4568-b92a-208da21bb9ab tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:50.298482 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-54734d84-9f1f-4568-b92a-208da21bb9ab tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:50.306818 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-54734d84-9f1f-4568-b92a-208da21bb9ab tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:50.307668 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-54734d84-9f1f-4568-b92a-208da21bb9ab tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:50.308430 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-54734d84-9f1f-4568-b92a-208da21bb9ab tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:50.310458 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-54734d84-9f1f-4568-b92a-208da21bb9ab tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:50.311919 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-54734d84-9f1f-4568-b92a-208da21bb9ab tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:50.312864 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-54734d84-9f1f-4568-b92a-208da21bb9ab tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:50.579713 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-54734d84-9f1f-4568-b92a-208da21bb9ab tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:50.591303 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-54734d84-9f1f-4568-b92a-208da21bb9ab tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1671 microversion: 2.1 time: 0.298457 Oct 18 15:48:50.593077 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2534/5068] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:50 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1671 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:48:50.597865 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-641202f9-1389-4062-8369-6bab6efe5b28 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:50.599959 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-641202f9-1389-4062-8369-6bab6efe5b28 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] [instance: c22a3632-d2ae-474c-baf8-e90790d52b43] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:50.615488 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-641202f9-1389-4062-8369-6bab6efe5b28 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:50.616124 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-641202f9-1389-4062-8369-6bab6efe5b28 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:50.616871 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-641202f9-1389-4062-8369-6bab6efe5b28 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:50.617681 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-641202f9-1389-4062-8369-6bab6efe5b28 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:50.618262 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-641202f9-1389-4062-8369-6bab6efe5b28 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:50.618714 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-641202f9-1389-4062-8369-6bab6efe5b28 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:50.639922 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5f6c2bb6-bca3-44ea-952a-ef14c16feb8b tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:50.651904 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5f6c2bb6-bca3-44ea-952a-ef14c16feb8b tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a" status: 200 len: 1690 microversion: 2.1 time: 0.460369 Oct 18 15:48:50.657632 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2535/5069] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:50 2022] GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a => generated 1690 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:50.670308 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dbb58763-4aa7-4bc8-8e73-840b603b0e41 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:50.672691 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dbb58763-4aa7-4bc8-8e73-840b603b0e41 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:50.680903 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dbb58763-4aa7-4bc8-8e73-840b603b0e41 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:50.681797 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dbb58763-4aa7-4bc8-8e73-840b603b0e41 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:50.682443 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dbb58763-4aa7-4bc8-8e73-840b603b0e41 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:50.683389 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dbb58763-4aa7-4bc8-8e73-840b603b0e41 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:50.684052 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dbb58763-4aa7-4bc8-8e73-840b603b0e41 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:50.684697 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dbb58763-4aa7-4bc8-8e73-840b603b0e41 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:50.873781 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-641202f9-1389-4062-8369-6bab6efe5b28 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d61956417324dc89bca1389bacbd0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0254a3b1a54a9988125e3c09332bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:50.882181 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-641202f9-1389-4062-8369-6bab6efe5b28 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] 10.222.0.60 "GET /compute/v2.1/servers/c22a3632-d2ae-474c-baf8-e90790d52b43" status: 200 len: 1319 microversion: 2.1 time: 0.287944 Oct 18 15:48:50.883490 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2535/5070] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:50 2022] GET /compute/v2.1/servers/c22a3632-d2ae-474c-baf8-e90790d52b43 => generated 1319 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:50.904993 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dbb58763-4aa7-4bc8-8e73-840b603b0e41 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:50.917514 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dbb58763-4aa7-4bc8-8e73-840b603b0e41 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1671 microversion: 2.1 time: 0.257879 Oct 18 15:48:50.918691 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2536/5071] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:50 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1671 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:50.932536 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e7aac94e-961c-4fd4-b342-e722b2527737 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:50.933601 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e7aac94e-961c-4fd4-b342-e722b2527737 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 9f83bb30-fed3-427f-bdb6-8013f5bc7b29] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:50.941381 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e7aac94e-961c-4fd4-b342-e722b2527737 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:50.943465 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-95bafd34-a1dc-469e-ba03-920fc66f62fe tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:50.943620 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e7aac94e-961c-4fd4-b342-e722b2527737 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:50.944410 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e7aac94e-961c-4fd4-b342-e722b2527737 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:50.944918 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-95bafd34-a1dc-469e-ba03-920fc66f62fe tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:50.945514 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e7aac94e-961c-4fd4-b342-e722b2527737 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:50.947619 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e7aac94e-961c-4fd4-b342-e722b2527737 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:50.948161 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e7aac94e-961c-4fd4-b342-e722b2527737 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:50.954792 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95bafd34-a1dc-469e-ba03-920fc66f62fe tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:50.955566 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95bafd34-a1dc-469e-ba03-920fc66f62fe tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:50.956211 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95bafd34-a1dc-469e-ba03-920fc66f62fe tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:50.957170 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95bafd34-a1dc-469e-ba03-920fc66f62fe tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:50.957786 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95bafd34-a1dc-469e-ba03-920fc66f62fe tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:50.959182 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95bafd34-a1dc-469e-ba03-920fc66f62fe tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:51.047293 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e7aac94e-961c-4fd4-b342-e722b2527737 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:51.056260 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e7aac94e-961c-4fd4-b342-e722b2527737 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/9f83bb30-fed3-427f-bdb6-8013f5bc7b29" status: 200 len: 1223 microversion: 2.1 time: 0.130992 Oct 18 15:48:51.056857 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2536/5072] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:50 2022] GET /compute/v2.1/servers/9f83bb30-fed3-427f-bdb6-8013f5bc7b29 => generated 1223 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:51.177724 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-95bafd34-a1dc-469e-ba03-920fc66f62fe tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:51.186977 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-95bafd34-a1dc-469e-ba03-920fc66f62fe tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1671 microversion: 2.1 time: 0.248488 Oct 18 15:48:51.188114 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2537/5073] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:50 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1671 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:48:51.212360 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2a16893a-8245-48f4-a11f-ad63020a9793 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:48:51.213077 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2a16893a-8245-48f4-a11f-ad63020a9793 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:51.220832 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a16893a-8245-48f4-a11f-ad63020a9793 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:51.221475 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a16893a-8245-48f4-a11f-ad63020a9793 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:51.222010 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a16893a-8245-48f4-a11f-ad63020a9793 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:51.222815 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a16893a-8245-48f4-a11f-ad63020a9793 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:51.223455 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a16893a-8245-48f4-a11f-ad63020a9793 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:51.223455 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a16893a-8245-48f4-a11f-ad63020a9793 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:51.252001 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-2a16893a-8245-48f4-a11f-ad63020a9793 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lazy-loading 'flavor' on Instance uuid 79212b18-bfd6-4a94-9d58-80c535525aa8 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:48:51.331100 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2a16893a-8245-48f4-a11f-ad63020a9793 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "POST /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8/action" status: 202 len: 0 microversion: 2.1 time: 0.123333 Oct 18 15:48:51.331957 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2537/5074] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:48:51 2022] POST /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:48:51.340696 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e8b644a3-4653-4c49-b222-86780601ef3c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:51.341981 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e8b644a3-4653-4c49-b222-86780601ef3c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:51.349153 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8b644a3-4653-4c49-b222-86780601ef3c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:51.350072 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8b644a3-4653-4c49-b222-86780601ef3c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:51.350683 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8b644a3-4653-4c49-b222-86780601ef3c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:51.351472 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8b644a3-4653-4c49-b222-86780601ef3c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:51.352170 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8b644a3-4653-4c49-b222-86780601ef3c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:51.352617 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8b644a3-4653-4c49-b222-86780601ef3c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:51.541731 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e8b644a3-4653-4c49-b222-86780601ef3c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:51.550040 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e8b644a3-4653-4c49-b222-86780601ef3c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1679 microversion: 2.1 time: 0.213185 Oct 18 15:48:51.550631 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2538/5075] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:51 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1679 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:51.604133 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-50a371d8-a969-40e9-ae3a-d95d5677f9f6 req-ede4e954-ba59-4bed-9905-6cb8bc2b0366 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c22a3632-d2ae-474c-baf8-e90790d52b43", "name": "network-vif-plugged", "status": "completed", "tag": "0d975714-e3a7-4b4f-ae7c-ce973d7da75c"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:48:51.615592 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-50a371d8-a969-40e9-ae3a-d95d5677f9f6 req-ede4e954-ba59-4bed-9905-6cb8bc2b0366 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:51.616081 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-50a371d8-a969-40e9-ae3a-d95d5677f9f6 req-ede4e954-ba59-4bed-9905-6cb8bc2b0366 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:51.616512 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-50a371d8-a969-40e9-ae3a-d95d5677f9f6 req-ede4e954-ba59-4bed-9905-6cb8bc2b0366 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:51.630228 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-50a371d8-a969-40e9-ae3a-d95d5677f9f6 req-ede4e954-ba59-4bed-9905-6cb8bc2b0366 service nova] Creating event network-vif-plugged:0d975714-e3a7-4b4f-ae7c-ce973d7da75c for instance c22a3632-d2ae-474c-baf8-e90790d52b43 on n-h2-853682-5 Oct 18 15:48:51.639536 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-50a371d8-a969-40e9-ae3a-d95d5677f9f6 req-ede4e954-ba59-4bed-9905-6cb8bc2b0366 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040465 Oct 18 15:48:51.640242 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2538/5076] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:48:51.697495 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-43feb8f7-dd7f-44c5-af37-1aa1a7ce04ad tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:51.699213 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-43feb8f7-dd7f-44c5-af37-1aa1a7ce04ad tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 5e83c779-c8f8-4ebd-84ab-7f144ab8552a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:51.707067 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-43feb8f7-dd7f-44c5-af37-1aa1a7ce04ad tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:51.707998 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-43feb8f7-dd7f-44c5-af37-1aa1a7ce04ad tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:51.708725 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-43feb8f7-dd7f-44c5-af37-1aa1a7ce04ad tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:51.711149 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-43feb8f7-dd7f-44c5-af37-1aa1a7ce04ad tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:51.712009 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-43feb8f7-dd7f-44c5-af37-1aa1a7ce04ad tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:51.712692 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-43feb8f7-dd7f-44c5-af37-1aa1a7ce04ad tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:51.724833 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:48:51.908530 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1fa5852f-44d7-4338-be49-d077c39162f3 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:51.909337 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1fa5852f-44d7-4338-be49-d077c39162f3 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] [instance: c22a3632-d2ae-474c-baf8-e90790d52b43] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:51.922395 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1fa5852f-44d7-4338-be49-d077c39162f3 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:51.923182 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1fa5852f-44d7-4338-be49-d077c39162f3 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:51.924027 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1fa5852f-44d7-4338-be49-d077c39162f3 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:51.927598 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1fa5852f-44d7-4338-be49-d077c39162f3 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:51.928451 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1fa5852f-44d7-4338-be49-d077c39162f3 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:51.930337 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1fa5852f-44d7-4338-be49-d077c39162f3 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:51.944664 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-43feb8f7-dd7f-44c5-af37-1aa1a7ce04ad tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:51.956125 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-43feb8f7-dd7f-44c5-af37-1aa1a7ce04ad tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a" status: 200 len: 1690 microversion: 2.1 time: 0.281921 Oct 18 15:48:51.957266 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2539/5077] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:51 2022] GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a => generated 1690 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:52.082118 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fab59b8b-6373-4f39-97bd-fc7237dfa018 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:52.083968 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fab59b8b-6373-4f39-97bd-fc7237dfa018 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 9f83bb30-fed3-427f-bdb6-8013f5bc7b29] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:52.090851 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fab59b8b-6373-4f39-97bd-fc7237dfa018 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:52.091614 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fab59b8b-6373-4f39-97bd-fc7237dfa018 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:52.092244 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fab59b8b-6373-4f39-97bd-fc7237dfa018 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:52.093314 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fab59b8b-6373-4f39-97bd-fc7237dfa018 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:52.094031 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fab59b8b-6373-4f39-97bd-fc7237dfa018 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:52.095706 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fab59b8b-6373-4f39-97bd-fc7237dfa018 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:52.140045 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1fa5852f-44d7-4338-be49-d077c39162f3 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d61956417324dc89bca1389bacbd0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0254a3b1a54a9988125e3c09332bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:52.149886 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1fa5852f-44d7-4338-be49-d077c39162f3 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] 10.222.0.60 "GET /compute/v2.1/servers/c22a3632-d2ae-474c-baf8-e90790d52b43" status: 200 len: 1319 microversion: 2.1 time: 0.245782 Oct 18 15:48:52.158531 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2539/5078] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:51 2022] GET /compute/v2.1/servers/c22a3632-d2ae-474c-baf8-e90790d52b43 => generated 1319 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:48:52.177002 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fab59b8b-6373-4f39-97bd-fc7237dfa018 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:52.189181 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fab59b8b-6373-4f39-97bd-fc7237dfa018 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/9f83bb30-fed3-427f-bdb6-8013f5bc7b29" status: 200 len: 1215 microversion: 2.1 time: 0.109948 Oct 18 15:48:52.191407 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2540/5079] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:52 2022] GET /compute/v2.1/servers/9f83bb30-fed3-427f-bdb6-8013f5bc7b29 => generated 1215 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:52.579233 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d32c2dd5-4573-4504-bf29-84e4a05200cf tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:52.580441 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d32c2dd5-4573-4504-bf29-84e4a05200cf tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:52.590474 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d32c2dd5-4573-4504-bf29-84e4a05200cf tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:52.591564 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d32c2dd5-4573-4504-bf29-84e4a05200cf tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:52.592322 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d32c2dd5-4573-4504-bf29-84e4a05200cf tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:52.593359 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d32c2dd5-4573-4504-bf29-84e4a05200cf tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:52.594390 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d32c2dd5-4573-4504-bf29-84e4a05200cf tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:52.595034 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d32c2dd5-4573-4504-bf29-84e4a05200cf tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:52.850051 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d32c2dd5-4573-4504-bf29-84e4a05200cf tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:52.866044 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d32c2dd5-4573-4504-bf29-84e4a05200cf tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1662 microversion: 2.1 time: 0.292367 Oct 18 15:48:52.867426 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2540/5080] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:52 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1662 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:52.901432 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-36a23be0-482d-467c-bc55-cf07f4aaa38e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:48:52.902028 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-36a23be0-482d-467c-bc55-cf07f4aaa38e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:52.913846 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36a23be0-482d-467c-bc55-cf07f4aaa38e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:52.914602 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36a23be0-482d-467c-bc55-cf07f4aaa38e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:52.915213 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36a23be0-482d-467c-bc55-cf07f4aaa38e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:52.916099 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36a23be0-482d-467c-bc55-cf07f4aaa38e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:52.916724 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36a23be0-482d-467c-bc55-cf07f4aaa38e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:52.917829 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36a23be0-482d-467c-bc55-cf07f4aaa38e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:53.003585 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ae79938b-dff5-411c-adc4-7aa59f211f95 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:53.006716 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ae79938b-dff5-411c-adc4-7aa59f211f95 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 5e83c779-c8f8-4ebd-84ab-7f144ab8552a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:53.029279 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae79938b-dff5-411c-adc4-7aa59f211f95 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:53.030336 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae79938b-dff5-411c-adc4-7aa59f211f95 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:53.030573 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-36a23be0-482d-467c-bc55-cf07f4aaa38e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "POST /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8/action" status: 202 len: 0 microversion: 2.1 time: 0.134828 Oct 18 15:48:53.032660 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae79938b-dff5-411c-adc4-7aa59f211f95 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:53.033785 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae79938b-dff5-411c-adc4-7aa59f211f95 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:53.035097 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2541/5081] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:48:52 2022] POST /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:48:53.036942 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae79938b-dff5-411c-adc4-7aa59f211f95 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:53.038119 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae79938b-dff5-411c-adc4-7aa59f211f95 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:53.041036 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3792ea48-d747-42e8-ba2c-e142da7b04e0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:53.041917 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3792ea48-d747-42e8-ba2c-e142da7b04e0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:53.053017 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3792ea48-d747-42e8-ba2c-e142da7b04e0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:53.053765 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3792ea48-d747-42e8-ba2c-e142da7b04e0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:53.054400 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3792ea48-d747-42e8-ba2c-e142da7b04e0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:53.055680 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3792ea48-d747-42e8-ba2c-e142da7b04e0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:53.056299 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3792ea48-d747-42e8-ba2c-e142da7b04e0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:53.056928 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3792ea48-d747-42e8-ba2c-e142da7b04e0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:53.690697 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3792ea48-d747-42e8-ba2c-e142da7b04e0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:53.709204 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3792ea48-d747-42e8-ba2c-e142da7b04e0 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1668 microversion: 2.1 time: 0.669611 Oct 18 15:48:53.721485 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2542/5082] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:53 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1668 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:53.735639 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-75f7cbfb-5baf-489c-acb1-e6534bf64e4f tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:53.738644 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-75f7cbfb-5baf-489c-acb1-e6534bf64e4f tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] [instance: c22a3632-d2ae-474c-baf8-e90790d52b43] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:53.758475 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-75f7cbfb-5baf-489c-acb1-e6534bf64e4f tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:53.758835 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-75f7cbfb-5baf-489c-acb1-e6534bf64e4f tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:53.767632 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-75f7cbfb-5baf-489c-acb1-e6534bf64e4f tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:53.768398 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-75f7cbfb-5baf-489c-acb1-e6534bf64e4f tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:53.768902 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-75f7cbfb-5baf-489c-acb1-e6534bf64e4f tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:53.769337 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-75f7cbfb-5baf-489c-acb1-e6534bf64e4f tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:53.793267 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ae79938b-dff5-411c-adc4-7aa59f211f95 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:53.807769 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ae79938b-dff5-411c-adc4-7aa59f211f95 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a" status: 200 len: 1690 microversion: 2.1 time: 0.823695 Oct 18 15:48:53.814944 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2541/5083] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:52 2022] GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a => generated 1690 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:48:53.824288 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-45157c5f-d2d0-4109-a545-21ecb5e5c627 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:53.828717 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-45157c5f-d2d0-4109-a545-21ecb5e5c627 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 9f83bb30-fed3-427f-bdb6-8013f5bc7b29] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:53.838932 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-45157c5f-d2d0-4109-a545-21ecb5e5c627 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:53.845845 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-45157c5f-d2d0-4109-a545-21ecb5e5c627 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:53.846514 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-45157c5f-d2d0-4109-a545-21ecb5e5c627 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:53.847439 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-45157c5f-d2d0-4109-a545-21ecb5e5c627 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:53.848163 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-45157c5f-d2d0-4109-a545-21ecb5e5c627 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:53.848872 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-45157c5f-d2d0-4109-a545-21ecb5e5c627 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:54.017086 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-45157c5f-d2d0-4109-a545-21ecb5e5c627 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:54.035140 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-45157c5f-d2d0-4109-a545-21ecb5e5c627 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/9f83bb30-fed3-427f-bdb6-8013f5bc7b29" status: 200 len: 1277 microversion: 2.1 time: 0.222983 Oct 18 15:48:54.036388 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2542/5084] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:53 2022] GET /compute/v2.1/servers/9f83bb30-fed3-427f-bdb6-8013f5bc7b29 => generated 1277 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:54.297823 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-75f7cbfb-5baf-489c-acb1-e6534bf64e4f tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d61956417324dc89bca1389bacbd0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0254a3b1a54a9988125e3c09332bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:54.309400 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-75f7cbfb-5baf-489c-acb1-e6534bf64e4f tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] 10.222.0.60 "GET /compute/v2.1/servers/c22a3632-d2ae-474c-baf8-e90790d52b43" status: 200 len: 1507 microversion: 2.1 time: 0.586358 Oct 18 15:48:54.318219 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2543/5085] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:53 2022] GET /compute/v2.1/servers/c22a3632-d2ae-474c-baf8-e90790d52b43 => generated 1507 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:54.339063 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a88af220-6df4-4648-a8cd-6d5705024b57 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:54.340992 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a88af220-6df4-4648-a8cd-6d5705024b57 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] [instance: 210addcc-0cd9-4236-93ff-23b30d8e9888] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:54.371798 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a88af220-6df4-4648-a8cd-6d5705024b57 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:54.372734 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a88af220-6df4-4648-a8cd-6d5705024b57 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:54.373660 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a88af220-6df4-4648-a8cd-6d5705024b57 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:54.374923 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a88af220-6df4-4648-a8cd-6d5705024b57 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:54.376748 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a88af220-6df4-4648-a8cd-6d5705024b57 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:54.377887 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a88af220-6df4-4648-a8cd-6d5705024b57 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:54.744637 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-176e813a-faed-4f73-8f8a-b108b7e5ada7 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:54.745685 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-176e813a-faed-4f73-8f8a-b108b7e5ada7 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:54.752403 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-176e813a-faed-4f73-8f8a-b108b7e5ada7 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:54.753246 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-176e813a-faed-4f73-8f8a-b108b7e5ada7 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:54.754762 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-176e813a-faed-4f73-8f8a-b108b7e5ada7 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:54.755947 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-176e813a-faed-4f73-8f8a-b108b7e5ada7 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:54.756781 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-176e813a-faed-4f73-8f8a-b108b7e5ada7 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:54.757610 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-176e813a-faed-4f73-8f8a-b108b7e5ada7 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:55.211778 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a88af220-6df4-4648-a8cd-6d5705024b57 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d61956417324dc89bca1389bacbd0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0254a3b1a54a9988125e3c09332bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:55.220989 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a88af220-6df4-4648-a8cd-6d5705024b57 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] 10.222.0.60 "GET /compute/v2.1/servers/210addcc-0cd9-4236-93ff-23b30d8e9888" status: 200 len: 1506 microversion: 2.1 time: 0.889010 Oct 18 15:48:55.237712 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2543/5086] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:54 2022] GET /compute/v2.1/servers/210addcc-0cd9-4236-93ff-23b30d8e9888 => generated 1506 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:55.245697 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-91398cac-1041-49f4-924b-1f8bf7dd4e96 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:55.246564 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-91398cac-1041-49f4-924b-1f8bf7dd4e96 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 5e83c779-c8f8-4ebd-84ab-7f144ab8552a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:55.258202 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-91398cac-1041-49f4-924b-1f8bf7dd4e96 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:55.259017 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-91398cac-1041-49f4-924b-1f8bf7dd4e96 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:55.259693 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-91398cac-1041-49f4-924b-1f8bf7dd4e96 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:55.260637 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-91398cac-1041-49f4-924b-1f8bf7dd4e96 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:55.261334 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-91398cac-1041-49f4-924b-1f8bf7dd4e96 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:55.262118 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-91398cac-1041-49f4-924b-1f8bf7dd4e96 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:55.383216 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-176e813a-faed-4f73-8f8a-b108b7e5ada7 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:55.417056 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-91398cac-1041-49f4-924b-1f8bf7dd4e96 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:55.429417 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-91398cac-1041-49f4-924b-1f8bf7dd4e96 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a" status: 200 len: 1623 microversion: 2.1 time: 0.188492 Oct 18 15:48:55.429928 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-176e813a-faed-4f73-8f8a-b108b7e5ada7 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1668 microversion: 2.1 time: 0.668027 Oct 18 15:48:55.431449 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2544/5087] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:55 2022] GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a => generated 1623 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:55.441798 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2544/5088] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:54 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1668 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:55.453810 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-88c0c3ec-52d8-414e-8d45-e72c5b6c9a29 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:55.454519 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-88c0c3ec-52d8-414e-8d45-e72c5b6c9a29 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] [instance: 210addcc-0cd9-4236-93ff-23b30d8e9888] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:55.485177 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a598a47c-6fd8-49f3-9cba-17a09ed9c028 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:55.488137 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88c0c3ec-52d8-414e-8d45-e72c5b6c9a29 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:55.490283 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88c0c3ec-52d8-414e-8d45-e72c5b6c9a29 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:55.491536 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a598a47c-6fd8-49f3-9cba-17a09ed9c028 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 9f83bb30-fed3-427f-bdb6-8013f5bc7b29] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:55.491758 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88c0c3ec-52d8-414e-8d45-e72c5b6c9a29 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:55.493130 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88c0c3ec-52d8-414e-8d45-e72c5b6c9a29 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:55.495447 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88c0c3ec-52d8-414e-8d45-e72c5b6c9a29 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:55.497786 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88c0c3ec-52d8-414e-8d45-e72c5b6c9a29 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:55.508426 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a598a47c-6fd8-49f3-9cba-17a09ed9c028 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:55.509399 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a598a47c-6fd8-49f3-9cba-17a09ed9c028 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:55.511358 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a598a47c-6fd8-49f3-9cba-17a09ed9c028 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:55.512559 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a598a47c-6fd8-49f3-9cba-17a09ed9c028 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:55.514839 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a598a47c-6fd8-49f3-9cba-17a09ed9c028 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:55.517313 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a598a47c-6fd8-49f3-9cba-17a09ed9c028 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:55.540941 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-88c0c3ec-52d8-414e-8d45-e72c5b6c9a29 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] [instance: 210addcc-0cd9-4236-93ff-23b30d8e9888] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:48:55.554909 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:48:55.674592 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a598a47c-6fd8-49f3-9cba-17a09ed9c028 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:55.689432 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a598a47c-6fd8-49f3-9cba-17a09ed9c028 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/9f83bb30-fed3-427f-bdb6-8013f5bc7b29" status: 200 len: 1277 microversion: 2.1 time: 0.235557 Oct 18 15:48:55.709921 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2545/5089] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:55 2022] GET /compute/v2.1/servers/9f83bb30-fed3-427f-bdb6-8013f5bc7b29 => generated 1277 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:55.716158 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-88c0c3ec-52d8-414e-8d45-e72c5b6c9a29 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] 10.222.0.60 "DELETE /compute/v2.1/servers/210addcc-0cd9-4236-93ff-23b30d8e9888" status: 204 len: 0 microversion: 2.1 time: 0.270146 Oct 18 15:48:55.717569 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2545/5090] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:48:55 2022] DELETE /compute/v2.1/servers/210addcc-0cd9-4236-93ff-23b30d8e9888 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:48:55.730451 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4dc9c569-115e-4442-a107-2e8b1f97a64e tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:55.731840 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4dc9c569-115e-4442-a107-2e8b1f97a64e tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] [instance: c22a3632-d2ae-474c-baf8-e90790d52b43] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:55.740616 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4dc9c569-115e-4442-a107-2e8b1f97a64e tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:55.740999 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4dc9c569-115e-4442-a107-2e8b1f97a64e tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:55.741666 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4dc9c569-115e-4442-a107-2e8b1f97a64e tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:55.743042 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4dc9c569-115e-4442-a107-2e8b1f97a64e tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:55.743861 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4dc9c569-115e-4442-a107-2e8b1f97a64e tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:55.744773 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4dc9c569-115e-4442-a107-2e8b1f97a64e tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:55.775408 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4dc9c569-115e-4442-a107-2e8b1f97a64e tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] [instance: c22a3632-d2ae-474c-baf8-e90790d52b43] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:48:55.901914 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4dc9c569-115e-4442-a107-2e8b1f97a64e tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c22a3632-d2ae-474c-baf8-e90790d52b43" status: 204 len: 0 microversion: 2.1 time: 0.179011 Oct 18 15:48:55.902863 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2546/5091] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:48:55 2022] DELETE /compute/v2.1/servers/c22a3632-d2ae-474c-baf8-e90790d52b43 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:48:56.072881 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-157edd39-fa52-473c-8d32-8fb47be224b2 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1567403240", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "e9cd694a-1ce0-44c2-bc63-4317d2dc0d92"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:48:56.084275 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-26a0eacc-1a1f-4d4a-9aa3-37db22c41c8a req-e53361bc-ecd1-4a72-b816-90c41e23f918 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e83c779-c8f8-4ebd-84ab-7f144ab8552a", "name": "network-vif-deleted", "tag": "6427e7c0-691b-4a13-83be-346caf570d9c"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:48:56.137593 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-26a0eacc-1a1f-4d4a-9aa3-37db22c41c8a req-e53361bc-ecd1-4a72-b816-90c41e23f918 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:56.139943 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-26a0eacc-1a1f-4d4a-9aa3-37db22c41c8a req-e53361bc-ecd1-4a72-b816-90c41e23f918 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:56.143405 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-26a0eacc-1a1f-4d4a-9aa3-37db22c41c8a req-e53361bc-ecd1-4a72-b816-90c41e23f918 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:56.193016 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-26a0eacc-1a1f-4d4a-9aa3-37db22c41c8a req-e53361bc-ecd1-4a72-b816-90c41e23f918 service nova] Creating event network-vif-deleted:6427e7c0-691b-4a13-83be-346caf570d9c for instance 5e83c779-c8f8-4ebd-84ab-7f144ab8552a on n-h1-853682-5 Oct 18 15:48:56.196285 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-157edd39-fa52-473c-8d32-8fb47be224b2 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] validate_networks() for [('e9cd694a-1ce0-44c2-bc63-4317d2dc0d92', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:48:56.207860 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-26a0eacc-1a1f-4d4a-9aa3-37db22c41c8a req-e53361bc-ecd1-4a72-b816-90c41e23f918 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126662 Oct 18 15:48:56.208677 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2547/5092] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:48:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:48:56.458785 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-75528565-c5c4-4ac4-869b-ff68c140d060 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:56.460178 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-75528565-c5c4-4ac4-869b-ff68c140d060 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 5e83c779-c8f8-4ebd-84ab-7f144ab8552a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:56.478627 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-75528565-c5c4-4ac4-869b-ff68c140d060 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:56.479140 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-75528565-c5c4-4ac4-869b-ff68c140d060 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:56.480744 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-75528565-c5c4-4ac4-869b-ff68c140d060 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:56.481504 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-75528565-c5c4-4ac4-869b-ff68c140d060 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:56.481977 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-75528565-c5c4-4ac4-869b-ff68c140d060 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:56.483620 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-75528565-c5c4-4ac4-869b-ff68c140d060 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:56.562999 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-75528565-c5c4-4ac4-869b-ff68c140d060 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:56.563726 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-75528565-c5c4-4ac4-869b-ff68c140d060 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:56.564340 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-75528565-c5c4-4ac4-869b-ff68c140d060 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:56.565055 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-75528565-c5c4-4ac4-869b-ff68c140d060 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lazy-loading 'fault' on Instance uuid 5e83c779-c8f8-4ebd-84ab-7f144ab8552a {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:48:56.823990 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-75528565-c5c4-4ac4-869b-ff68c140d060 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:56.839399 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-75528565-c5c4-4ac4-869b-ff68c140d060 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a" status: 200 len: 1335 microversion: 2.1 time: 0.387052 Oct 18 15:48:56.840006 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2548/5093] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:56 2022] GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a => generated 1335 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:56.845081 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ea02fe08-7b6d-4a9b-ad75-48e2a4a6be0d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:56.851240 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ea02fe08-7b6d-4a9b-ad75-48e2a4a6be0d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:56.874252 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea02fe08-7b6d-4a9b-ad75-48e2a4a6be0d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:56.874763 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea02fe08-7b6d-4a9b-ad75-48e2a4a6be0d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:56.875214 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea02fe08-7b6d-4a9b-ad75-48e2a4a6be0d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:56.875975 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea02fe08-7b6d-4a9b-ad75-48e2a4a6be0d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:56.876442 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea02fe08-7b6d-4a9b-ad75-48e2a4a6be0d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:56.876906 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea02fe08-7b6d-4a9b-ad75-48e2a4a6be0d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:57.391330 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ea02fe08-7b6d-4a9b-ad75-48e2a4a6be0d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:57.401693 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ea02fe08-7b6d-4a9b-ad75-48e2a4a6be0d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1668 microversion: 2.1 time: 0.560411 Oct 18 15:48:57.403040 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2549/5094] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:56 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1668 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:57.425041 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a955a204-a3db-4bb0-9900-fccb1a78068f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:57.428429 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a955a204-a3db-4bb0-9900-fccb1a78068f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 9f83bb30-fed3-427f-bdb6-8013f5bc7b29] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:57.447428 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a955a204-a3db-4bb0-9900-fccb1a78068f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:57.448221 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a955a204-a3db-4bb0-9900-fccb1a78068f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:57.449031 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a955a204-a3db-4bb0-9900-fccb1a78068f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:57.450480 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a955a204-a3db-4bb0-9900-fccb1a78068f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:57.451247 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a955a204-a3db-4bb0-9900-fccb1a78068f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:57.451852 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a955a204-a3db-4bb0-9900-fccb1a78068f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:57.887333 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a955a204-a3db-4bb0-9900-fccb1a78068f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:57.900028 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a955a204-a3db-4bb0-9900-fccb1a78068f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/9f83bb30-fed3-427f-bdb6-8013f5bc7b29" status: 200 len: 1319 microversion: 2.1 time: 0.495889 Oct 18 15:48:57.900801 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2550/5095] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:57 2022] GET /compute/v2.1/servers/9f83bb30-fed3-427f-bdb6-8013f5bc7b29 => generated 1319 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:57.914805 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5781d6b1-89fc-49eb-9ebf-27877315b85c tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:57.915770 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5781d6b1-89fc-49eb-9ebf-27877315b85c tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 5e83c779-c8f8-4ebd-84ab-7f144ab8552a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:57.925029 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5781d6b1-89fc-49eb-9ebf-27877315b85c tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:57.925631 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5781d6b1-89fc-49eb-9ebf-27877315b85c tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:57.929354 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5781d6b1-89fc-49eb-9ebf-27877315b85c tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:57.930274 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5781d6b1-89fc-49eb-9ebf-27877315b85c tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:57.930832 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5781d6b1-89fc-49eb-9ebf-27877315b85c tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:57.931350 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5781d6b1-89fc-49eb-9ebf-27877315b85c tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:57.960838 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-5781d6b1-89fc-49eb-9ebf-27877315b85c tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] HTTP exception thrown: Instance 5e83c779-c8f8-4ebd-84ab-7f144ab8552a could not be found. Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5781d6b1-89fc-49eb-9ebf-27877315b85c tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Request method failure captured: Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a HTTP/1.1 Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsmOlfJjna__aWkkHZgCFMOd2DpNqn_dr-IEPGuxkqNqAVs7tN5T268nd09vhRJnPU2g5DJC-yqBSq_x2HTDX86g3yOFixR2PbozSJNAuQoWzOe1hqzQDBztCsy4gcfQ635XTPjGuAISQPn4_b-3rgJ6h45QPHOVHclQC7dNdVcnHno Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 224ca1f734c14bc8bf31e1826faf8e71 Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1233761615 Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/224ca1f734c14bc8bf31e1826faf8e71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/224ca1f734c14bc8bf31e1826faf8e71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/224ca1f734c14bc8bf31e1826faf8e71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_224ca1f734c14bc8bf31e1826faf8e71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1233761615 Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 224ca1f734c14bc8bf31e1826faf8e71 Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1233761615 Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServerRescueNegativeTestJSON-1233761615-project Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 646fb4652c164c1dab5672d33d9fb295 Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1233761615-project Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 5e83c779-c8f8-4ebd-84ab-7f144ab8552a could not be found. Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '5e83c779-c8f8-4ebd-84ab-7f144ab8552a'} Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e83c779-c8f8-4ebd-84ab-7f144ab8552a could not be found. Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e83c779-c8f8-4ebd-84ab-7f144ab8552a could not be found. Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:48:57.962997 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:48:57.968316 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:48:57.968316 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:48:57.968316 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:48:57.968316 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:48:57.968316 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:48:57.968316 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:48:57.968316 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e83c779-c8f8-4ebd-84ab-7f144ab8552a could not be found. Oct 18 15:48:57.968316 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:48:57.970667 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5781d6b1-89fc-49eb-9ebf-27877315b85c tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Returning 404 to user: Instance 5e83c779-c8f8-4ebd-84ab-7f144ab8552a could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:48:57.971802 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5781d6b1-89fc-49eb-9ebf-27877315b85c tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a" status: 404 len: 111 microversion: 2.1 time: 0.069820 Oct 18 15:48:57.972606 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2551/5096] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:57 2022] GET /compute/v2.1/servers/5e83c779-c8f8-4ebd-84ab-7f144ab8552a => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:48:57.977598 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:48:57.990569 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f1e83d9f-f446-4e92-9ac0-1f6abd73e874 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '.version_select at 0x7f7c3c084dc0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:58.016683 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f1e83d9f-f446-4e92-9ac0-1f6abd73e874 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1611082033" status: 202 len: 0 microversion: 2.1 time: 0.030582 Oct 18 15:48:58.021445 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2552/5097] 10.222.0.60 () {58 vars in 1221 bytes} [Tue Oct 18 15:48:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1611082033 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:48:58.079016 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:48:58.247211 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-157edd39-fa52-473c-8d32-8fb47be224b2 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:48:58.249234 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-157edd39-fa52-473c-8d32-8fb47be224b2 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:48:58.249760 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-157edd39-fa52-473c-8d32-8fb47be224b2 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:48:58.251729 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-157edd39-fa52-473c-8d32-8fb47be224b2 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:48:58.252205 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-157edd39-fa52-473c-8d32-8fb47be224b2 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:48:58.281276 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-157edd39-fa52-473c-8d32-8fb47be224b2 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:58.282084 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-157edd39-fa52-473c-8d32-8fb47be224b2 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:58.282816 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-157edd39-fa52-473c-8d32-8fb47be224b2 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:58.284730 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-157edd39-fa52-473c-8d32-8fb47be224b2 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:58.285684 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-157edd39-fa52-473c-8d32-8fb47be224b2 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:58.286371 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-157edd39-fa52-473c-8d32-8fb47be224b2 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:58.329370 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-157edd39-fa52-473c-8d32-8fb47be224b2 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Getting quotas for project fc0254a3b1a54a9988125e3c09332bb3. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:48:58.339069 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-157edd39-fa52-473c-8d32-8fb47be224b2 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Getting quotas for user 4d61956417324dc89bca1389bacbd0a1 and project fc0254a3b1a54a9988125e3c09332bb3. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:48:58.370790 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-157edd39-fa52-473c-8d32-8fb47be224b2 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Going to run 2 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:48:58.373598 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-157edd39-fa52-473c-8d32-8fb47be224b2 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] [instance: bec82f31-03ac-4747-a394-4f38d9886320] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:48:58.432016 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-157edd39-fa52-473c-8d32-8fb47be224b2 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] [instance: b978eea8-e4b6-43a5-8ce7-502ed47f969e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=bec82f31-03ac-4747-a394-4f38d9886320,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:48:58.437767 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ac58b757-e08c-4f30-9e4b-4b0bb7d43ddb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:58.445559 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ac58b757-e08c-4f30-9e4b-4b0bb7d43ddb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:58.480913 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ac58b757-e08c-4f30-9e4b-4b0bb7d43ddb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:58.481806 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ac58b757-e08c-4f30-9e4b-4b0bb7d43ddb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:58.482492 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ac58b757-e08c-4f30-9e4b-4b0bb7d43ddb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:58.483452 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ac58b757-e08c-4f30-9e4b-4b0bb7d43ddb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:58.484152 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ac58b757-e08c-4f30-9e4b-4b0bb7d43ddb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:58.484823 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ac58b757-e08c-4f30-9e4b-4b0bb7d43ddb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:58.538461 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-157edd39-fa52-473c-8d32-8fb47be224b2 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.469484 Oct 18 15:48:58.542428 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2546/5098] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:48:56 2022] POST /compute/v2.1/servers => generated 32 bytes in 2477 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 18 15:48:58.571466 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ed40a032-52ed-41ad-84cb-d54811dcbf88 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:58.614972 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ed40a032-52ed-41ad-84cb-d54811dcbf88 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4d61956417324dc89bca1389bacbd0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0254a3b1a54a9988125e3c09332bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:58.620088 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ed40a032-52ed-41ad-84cb-d54811dcbf88 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Searching by: {'deleted': False, 'project_id': 'fc0254a3b1a54a9988125e3c09332bb3'} {{(pid=120406) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 15:48:58.671373 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed40a032-52ed-41ad-84cb-d54811dcbf88 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:58.673752 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed40a032-52ed-41ad-84cb-d54811dcbf88 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:58.674338 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed40a032-52ed-41ad-84cb-d54811dcbf88 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:58.680330 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed40a032-52ed-41ad-84cb-d54811dcbf88 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:58.682415 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed40a032-52ed-41ad-84cb-d54811dcbf88 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:58.682896 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed40a032-52ed-41ad-84cb-d54811dcbf88 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:58.753034 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.multi_cell_list [None req-ed40a032-52ed-41ad-84cb-d54811dcbf88 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=120406) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 15:48:58.797941 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ed40a032-52ed-41ad-84cb-d54811dcbf88 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.250424 Oct 18 15:48:58.799419 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2547/5099] 10.222.0.60 () {58 vars in 1125 bytes} [Tue Oct 18 15:48:58 2022] GET /compute/v2.1/servers => generated 1335 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:58.826866 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-80ed2305-60e6-4f4b-8bdc-aa28401c96bb tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:58.830409 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-80ed2305-60e6-4f4b-8bdc-aa28401c96bb tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] [instance: b978eea8-e4b6-43a5-8ce7-502ed47f969e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:59.078179 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-80ed2305-60e6-4f4b-8bdc-aa28401c96bb tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d61956417324dc89bca1389bacbd0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0254a3b1a54a9988125e3c09332bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:48:59.096338 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-80ed2305-60e6-4f4b-8bdc-aa28401c96bb tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] 10.222.0.60 "GET /compute/v2.1/servers/b978eea8-e4b6-43a5-8ce7-502ed47f969e" status: 200 len: 1218 microversion: 2.1 time: 0.271282 Oct 18 15:48:59.097586 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2548/5100] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:58 2022] GET /compute/v2.1/servers/b978eea8-e4b6-43a5-8ce7-502ed47f969e => generated 1218 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:48:59.112522 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3dc6660f-f246-4c4b-99e9-1a026ebd4ba4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:48:59.114055 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3dc6660f-f246-4c4b-99e9-1a026ebd4ba4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 9f83bb30-fed3-427f-bdb6-8013f5bc7b29] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:48:59.124188 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3dc6660f-f246-4c4b-99e9-1a026ebd4ba4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:59.124831 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3dc6660f-f246-4c4b-99e9-1a026ebd4ba4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:59.128120 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3dc6660f-f246-4c4b-99e9-1a026ebd4ba4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:59.129192 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3dc6660f-f246-4c4b-99e9-1a026ebd4ba4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:48:59.130455 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3dc6660f-f246-4c4b-99e9-1a026ebd4ba4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:48:59.131356 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3dc6660f-f246-4c4b-99e9-1a026ebd4ba4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:48:59.616148 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:48:59.893973 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=10 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:00.027300 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ac58b757-e08c-4f30-9e4b-4b0bb7d43ddb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:00.048843 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ac58b757-e08c-4f30-9e4b-4b0bb7d43ddb tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1671 microversion: 2.1 time: 1.612540 Oct 18 15:49:00.049410 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2553/5101] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:58 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1671 bytes in 1617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:49:00.065450 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-e26c3556-a460-4a07-b1e3-7e687a0cdfe7 req-1814071f-bab1-41de-a35c-de365d099b5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c22a3632-d2ae-474c-baf8-e90790d52b43", "name": "network-vif-deleted", "tag": "0d975714-e3a7-4b4f-ae7c-ce973d7da75c"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:49:00.089321 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-e26c3556-a460-4a07-b1e3-7e687a0cdfe7 req-1814071f-bab1-41de-a35c-de365d099b5d service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:00.090061 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-e26c3556-a460-4a07-b1e3-7e687a0cdfe7 req-1814071f-bab1-41de-a35c-de365d099b5d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:00.090826 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-e26c3556-a460-4a07-b1e3-7e687a0cdfe7 req-1814071f-bab1-41de-a35c-de365d099b5d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:00.119754 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-e26c3556-a460-4a07-b1e3-7e687a0cdfe7 req-1814071f-bab1-41de-a35c-de365d099b5d service nova] Creating event network-vif-deleted:0d975714-e3a7-4b4f-ae7c-ce973d7da75c for instance c22a3632-d2ae-474c-baf8-e90790d52b43 on n-h2-853682-5 Oct 18 15:49:00.125606 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-e26c3556-a460-4a07-b1e3-7e687a0cdfe7 req-1814071f-bab1-41de-a35c-de365d099b5d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074965 Oct 18 15:49:00.129342 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2554/5102] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:49:00.139307 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9d8988f6-9d07-4008-bf24-ff5b6d048cde tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:00.143253 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9d8988f6-9d07-4008-bf24-ff5b6d048cde tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:00.155568 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9d8988f6-9d07-4008-bf24-ff5b6d048cde tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:00.157448 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9d8988f6-9d07-4008-bf24-ff5b6d048cde tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:00.161994 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9d8988f6-9d07-4008-bf24-ff5b6d048cde tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:00.163121 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9d8988f6-9d07-4008-bf24-ff5b6d048cde tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:00.163770 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9d8988f6-9d07-4008-bf24-ff5b6d048cde tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:00.164374 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9d8988f6-9d07-4008-bf24-ff5b6d048cde tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:00.363553 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3dc6660f-f246-4c4b-99e9-1a026ebd4ba4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:00.376473 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3dc6660f-f246-4c4b-99e9-1a026ebd4ba4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/9f83bb30-fed3-427f-bdb6-8013f5bc7b29" status: 200 len: 1319 microversion: 2.1 time: 1.273088 Oct 18 15:49:00.422094 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2549/5103] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:48:59 2022] GET /compute/v2.1/servers/9f83bb30-fed3-427f-bdb6-8013f5bc7b29 => generated 1319 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:49:00.446617 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c162b70b-10e6-4ec9-b690-7d63001dab07 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:00.449781 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c162b70b-10e6-4ec9-b690-7d63001dab07 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] [instance: b978eea8-e4b6-43a5-8ce7-502ed47f969e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:00.499243 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c162b70b-10e6-4ec9-b690-7d63001dab07 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:00.508522 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c162b70b-10e6-4ec9-b690-7d63001dab07 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:00.509721 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c162b70b-10e6-4ec9-b690-7d63001dab07 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:00.512539 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c162b70b-10e6-4ec9-b690-7d63001dab07 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:00.515245 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c162b70b-10e6-4ec9-b690-7d63001dab07 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:00.518018 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c162b70b-10e6-4ec9-b690-7d63001dab07 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:00.823550 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c162b70b-10e6-4ec9-b690-7d63001dab07 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d61956417324dc89bca1389bacbd0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0254a3b1a54a9988125e3c09332bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:00.847849 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c162b70b-10e6-4ec9-b690-7d63001dab07 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] 10.222.0.60 "GET /compute/v2.1/servers/b978eea8-e4b6-43a5-8ce7-502ed47f969e" status: 200 len: 1270 microversion: 2.1 time: 0.423434 Oct 18 15:49:00.867840 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2550/5104] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:00 2022] GET /compute/v2.1/servers/b978eea8-e4b6-43a5-8ce7-502ed47f969e => generated 1270 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:49:00.875173 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-afb62f7f-61fe-48b0-bd1b-04c44c2bb02e req-435ca058-b08d-480a-8356-24613bd10710 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "210addcc-0cd9-4236-93ff-23b30d8e9888", "name": "network-vif-deleted", "tag": "6993f5ba-702e-42ef-bc0b-51b610b13d0a"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:49:00.898893 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-afb62f7f-61fe-48b0-bd1b-04c44c2bb02e req-435ca058-b08d-480a-8356-24613bd10710 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:00.899383 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-afb62f7f-61fe-48b0-bd1b-04c44c2bb02e req-435ca058-b08d-480a-8356-24613bd10710 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:00.899822 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-afb62f7f-61fe-48b0-bd1b-04c44c2bb02e req-435ca058-b08d-480a-8356-24613bd10710 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:00.920233 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-afb62f7f-61fe-48b0-bd1b-04c44c2bb02e req-435ca058-b08d-480a-8356-24613bd10710 service nova] Creating event network-vif-deleted:6993f5ba-702e-42ef-bc0b-51b610b13d0a for instance 210addcc-0cd9-4236-93ff-23b30d8e9888 on n-h2-853682-5 Oct 18 15:49:00.924084 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-afb62f7f-61fe-48b0-bd1b-04c44c2bb02e req-435ca058-b08d-480a-8356-24613bd10710 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053123 Oct 18 15:49:00.924864 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2551/5105] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:49:00.949587 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9d8988f6-9d07-4008-bf24-ff5b6d048cde tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:00.961962 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9d8988f6-9d07-4008-bf24-ff5b6d048cde tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1671 microversion: 2.1 time: 0.831065 Oct 18 15:49:00.963259 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2555/5106] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:00 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1671 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:49:00.989369 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-43073973-a82a-4033-9898-bd6ff9355afa tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:00.989895 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-43073973-a82a-4033-9898-bd6ff9355afa tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 41390db3-b9c7-4260-82d1-72bad9b9b0cc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:01.001865 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-43073973-a82a-4033-9898-bd6ff9355afa tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:01.002720 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-43073973-a82a-4033-9898-bd6ff9355afa tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:01.010089 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-43073973-a82a-4033-9898-bd6ff9355afa tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:01.010934 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-43073973-a82a-4033-9898-bd6ff9355afa tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:01.011430 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-43073973-a82a-4033-9898-bd6ff9355afa tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:01.015196 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-43073973-a82a-4033-9898-bd6ff9355afa tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:01.068290 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-43073973-a82a-4033-9898-bd6ff9355afa tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 41390db3-b9c7-4260-82d1-72bad9b9b0cc] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:49:01.085048 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.compute.api [None req-43073973-a82a-4033-9898-bd6ff9355afa tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 41390db3-b9c7-4260-82d1-72bad9b9b0cc] Working on deleting snapshot 22bd51d6-df74-4d43-9847-da72df492318 from shelved instance... Oct 18 15:49:01.406457 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e0eb0268-2d62-4ef3-b9ca-219ea2ed0a8e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:01.409414 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e0eb0268-2d62-4ef3-b9ca-219ea2ed0a8e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 9f83bb30-fed3-427f-bdb6-8013f5bc7b29] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:01.429698 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e0eb0268-2d62-4ef3-b9ca-219ea2ed0a8e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:01.434377 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e0eb0268-2d62-4ef3-b9ca-219ea2ed0a8e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:01.439158 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e0eb0268-2d62-4ef3-b9ca-219ea2ed0a8e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:01.443327 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e0eb0268-2d62-4ef3-b9ca-219ea2ed0a8e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:01.446601 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e0eb0268-2d62-4ef3-b9ca-219ea2ed0a8e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:01.451385 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e0eb0268-2d62-4ef3-b9ca-219ea2ed0a8e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:02.177175 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e0eb0268-2d62-4ef3-b9ca-219ea2ed0a8e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:02.208987 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e0eb0268-2d62-4ef3-b9ca-219ea2ed0a8e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/9f83bb30-fed3-427f-bdb6-8013f5bc7b29" status: 200 len: 1319 microversion: 2.1 time: 0.787866 Oct 18 15:49:02.227575 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2556/5107] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:01 2022] GET /compute/v2.1/servers/9f83bb30-fed3-427f-bdb6-8013f5bc7b29 => generated 1319 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:49:02.240233 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-decd5ab0-a4a4-466f-ad6b-1a9c5e583fde tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:02.241399 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-decd5ab0-a4a4-466f-ad6b-1a9c5e583fde tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] [instance: b978eea8-e4b6-43a5-8ce7-502ed47f969e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:02.252457 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-decd5ab0-a4a4-466f-ad6b-1a9c5e583fde tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:02.253247 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-decd5ab0-a4a4-466f-ad6b-1a9c5e583fde tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:02.253909 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-decd5ab0-a4a4-466f-ad6b-1a9c5e583fde tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:02.255452 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-decd5ab0-a4a4-466f-ad6b-1a9c5e583fde tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:02.257474 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-decd5ab0-a4a4-466f-ad6b-1a9c5e583fde tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:02.258178 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-decd5ab0-a4a4-466f-ad6b-1a9c5e583fde tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:02.363806 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-43073973-a82a-4033-9898-bd6ff9355afa tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 41390db3-b9c7-4260-82d1-72bad9b9b0cc] Doing local delete in cell 8ab54c98-adc3-429d-89a9-d68fdb0f782a(cell1) {{(pid=120406) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 18 15:49:02.365439 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-43073973-a82a-4033-9898-bd6ff9355afa tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:02.365999 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-43073973-a82a-4033-9898-bd6ff9355afa tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:02.366586 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-43073973-a82a-4033-9898-bd6ff9355afa tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:02.367038 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.compute.api [None req-43073973-a82a-4033-9898-bd6ff9355afa tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 41390db3-b9c7-4260-82d1-72bad9b9b0cc] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 18 15:49:02.379065 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-43073973-a82a-4033-9898-bd6ff9355afa tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 41390db3-b9c7-4260-82d1-72bad9b9b0cc] deallocate_for_instance() {{(pid=120406) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}} Oct 18 15:49:02.480988 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-decd5ab0-a4a4-466f-ad6b-1a9c5e583fde tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d61956417324dc89bca1389bacbd0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0254a3b1a54a9988125e3c09332bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:02.497145 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-decd5ab0-a4a4-466f-ad6b-1a9c5e583fde tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] 10.222.0.60 "GET /compute/v2.1/servers/b978eea8-e4b6-43a5-8ce7-502ed47f969e" status: 200 len: 1276 microversion: 2.1 time: 0.267291 Oct 18 15:49:02.503374 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2557/5108] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:02 2022] GET /compute/v2.1/servers/b978eea8-e4b6-43a5-8ce7-502ed47f969e => generated 1276 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:49:02.951601 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-df8fde64-55a5-48d8-a4d6-20a2fc311434 req-b7b5610d-7f8d-454b-8ff1-96fc62b8f077 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f83bb30-fed3-427f-bdb6-8013f5bc7b29", "tag": "aa03188b-a4e8-48ce-bc92-96127d0e3784"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:49:02.972449 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-df8fde64-55a5-48d8-a4d6-20a2fc311434 req-b7b5610d-7f8d-454b-8ff1-96fc62b8f077 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:02.972930 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-df8fde64-55a5-48d8-a4d6-20a2fc311434 req-b7b5610d-7f8d-454b-8ff1-96fc62b8f077 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:02.973919 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-df8fde64-55a5-48d8-a4d6-20a2fc311434 req-b7b5610d-7f8d-454b-8ff1-96fc62b8f077 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:03.004182 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-df8fde64-55a5-48d8-a4d6-20a2fc311434 req-b7b5610d-7f8d-454b-8ff1-96fc62b8f077 service nova] Creating event network-changed:aa03188b-a4e8-48ce-bc92-96127d0e3784 for instance 9f83bb30-fed3-427f-bdb6-8013f5bc7b29 on n-h1-853682-5 Oct 18 15:49:03.014687 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-df8fde64-55a5-48d8-a4d6-20a2fc311434 req-b7b5610d-7f8d-454b-8ff1-96fc62b8f077 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066942 Oct 18 15:49:03.015621 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2558/5109] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:49:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:49:03.232305 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b0524b44-970d-483c-a061-0aa017c6a9eb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:03.233692 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b0524b44-970d-483c-a061-0aa017c6a9eb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 9f83bb30-fed3-427f-bdb6-8013f5bc7b29] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:03.248855 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b0524b44-970d-483c-a061-0aa017c6a9eb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:03.249390 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b0524b44-970d-483c-a061-0aa017c6a9eb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:03.250041 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b0524b44-970d-483c-a061-0aa017c6a9eb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:03.250967 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b0524b44-970d-483c-a061-0aa017c6a9eb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:03.251604 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b0524b44-970d-483c-a061-0aa017c6a9eb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:03.252210 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b0524b44-970d-483c-a061-0aa017c6a9eb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:03.966263 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b0524b44-970d-483c-a061-0aa017c6a9eb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:03.989730 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b0524b44-970d-483c-a061-0aa017c6a9eb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/9f83bb30-fed3-427f-bdb6-8013f5bc7b29" status: 200 len: 1319 microversion: 2.1 time: 0.751508 Oct 18 15:49:04.006462 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2559/5110] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:03 2022] GET /compute/v2.1/servers/9f83bb30-fed3-427f-bdb6-8013f5bc7b29 => generated 1319 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:49:04.011854 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bd9aebae-5ce6-4244-8daa-42bc8c11c11d tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:04.012493 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-bd9aebae-5ce6-4244-8daa-42bc8c11c11d tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] [instance: b978eea8-e4b6-43a5-8ce7-502ed47f969e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:04.022021 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bd9aebae-5ce6-4244-8daa-42bc8c11c11d tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:04.022888 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bd9aebae-5ce6-4244-8daa-42bc8c11c11d tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:04.023317 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bd9aebae-5ce6-4244-8daa-42bc8c11c11d tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:04.034486 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bd9aebae-5ce6-4244-8daa-42bc8c11c11d tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:04.035141 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bd9aebae-5ce6-4244-8daa-42bc8c11c11d tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:04.035631 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bd9aebae-5ce6-4244-8daa-42bc8c11c11d tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:04.119960 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-43073973-a82a-4033-9898-bd6ff9355afa tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 41390db3-b9c7-4260-82d1-72bad9b9b0cc] Updating instance_info_cache with network_info: [] {{(pid=120406) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 18 15:49:04.149769 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:04.224649 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-bd9aebae-5ce6-4244-8daa-42bc8c11c11d tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d61956417324dc89bca1389bacbd0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0254a3b1a54a9988125e3c09332bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:04.249736 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-bd9aebae-5ce6-4244-8daa-42bc8c11c11d tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] 10.222.0.60 "GET /compute/v2.1/servers/b978eea8-e4b6-43a5-8ce7-502ed47f969e" status: 200 len: 1276 microversion: 2.1 time: 0.249849 Oct 18 15:49:04.268603 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2560/5111] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:03 2022] GET /compute/v2.1/servers/b978eea8-e4b6-43a5-8ce7-502ed47f969e => generated 1276 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:49:04.829786 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-43073973-a82a-4033-9898-bd6ff9355afa tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "DELETE /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc" status: 204 len: 0 microversion: 2.1 time: 3.846719 Oct 18 15:49:04.830794 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2552/5112] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:49:00 2022] DELETE /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc => generated 0 bytes in 3848 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:49:04.840468 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e576b819-a08b-478b-89cc-b7c7a30c027f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:04.841730 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e576b819-a08b-478b-89cc-b7c7a30c027f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 41390db3-b9c7-4260-82d1-72bad9b9b0cc] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:04.861901 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e576b819-a08b-478b-89cc-b7c7a30c027f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:04.862427 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e576b819-a08b-478b-89cc-b7c7a30c027f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:04.862864 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e576b819-a08b-478b-89cc-b7c7a30c027f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:04.863846 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e576b819-a08b-478b-89cc-b7c7a30c027f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:04.864377 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e576b819-a08b-478b-89cc-b7c7a30c027f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:04.864821 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e576b819-a08b-478b-89cc-b7c7a30c027f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:04.907802 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-e576b819-a08b-478b-89cc-b7c7a30c027f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] HTTP exception thrown: Instance 41390db3-b9c7-4260-82d1-72bad9b9b0cc could not be found. Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e576b819-a08b-478b-89cc-b7c7a30c027f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Request method failure captured: Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc HTTP/1.1 Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsjnRdctCp-8YpJETZx5RBXsp0tk0P-jTGcQMSIsNH2GEBs8Wg82Po84gRYEjmY4OarQGWuT5THqpHI7_-hfhGBlYj8sHI1l4vQlE5R8BdhWWvvol61i38spuPGOi5m1Vnr-duJeNWVp2-6eOy-UohsCpTw7z-IjZzPv-4bQM_LgFXg Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 2a2cdc778bd54f209d70f5b8703dc068 Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServerActionsTestJSON-1828367688 Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2a2cdc778bd54f209d70f5b8703dc068"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2a2cdc778bd54f209d70f5b8703dc068"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2a2cdc778bd54f209d70f5b8703dc068"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2a2cdc778bd54f209d70f5b8703dc068"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServerActionsTestJSON-1828367688 Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 2a2cdc778bd54f209d70f5b8703dc068 Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServerActionsTestJSON-1828367688 Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServerActionsTestJSON-1828367688-project Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 2aa0148a4a43466da619ea9843b3f78c Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServerActionsTestJSON-1828367688-project Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 41390db3-b9c7-4260-82d1-72bad9b9b0cc could not be found. Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '41390db3-b9c7-4260-82d1-72bad9b9b0cc'} Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41390db3-b9c7-4260-82d1-72bad9b9b0cc could not be found. Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41390db3-b9c7-4260-82d1-72bad9b9b0cc could not be found. Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:49:04.909547 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:49:04.916159 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:49:04.916159 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:49:04.916159 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:49:04.916159 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:49:04.916159 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:49:04.916159 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41390db3-b9c7-4260-82d1-72bad9b9b0cc could not be found. Oct 18 15:49:04.916159 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:49:04.920126 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e576b819-a08b-478b-89cc-b7c7a30c027f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Returning 404 to user: Instance 41390db3-b9c7-4260-82d1-72bad9b9b0cc could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:49:04.922490 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e576b819-a08b-478b-89cc-b7c7a30c027f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc" status: 404 len: 111 microversion: 2.1 time: 0.086709 Oct 18 15:49:04.923716 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2561/5113] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:04 2022] GET /compute/v2.1/servers/41390db3-b9c7-4260-82d1-72bad9b9b0cc => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 15:49:04.943720 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-518d49be-bfd8-4255-ac3d-6fe9d910ca84 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:04.943720 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-518d49be-bfd8-4255-ac3d-6fe9d910ca84 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 5378eb2d-663e-4d1d-a113-64363d4f1dd9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:04.943720 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-518d49be-bfd8-4255-ac3d-6fe9d910ca84 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:04.943720 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-518d49be-bfd8-4255-ac3d-6fe9d910ca84 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:04.943720 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-518d49be-bfd8-4255-ac3d-6fe9d910ca84 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:04.943720 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-518d49be-bfd8-4255-ac3d-6fe9d910ca84 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:04.943720 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-518d49be-bfd8-4255-ac3d-6fe9d910ca84 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:04.943720 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-518d49be-bfd8-4255-ac3d-6fe9d910ca84 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:05.010884 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-518d49be-bfd8-4255-ac3d-6fe9d910ca84 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 5378eb2d-663e-4d1d-a113-64363d4f1dd9] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:49:05.018312 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7c651101-5261-407f-8de4-d8a52ffb0581 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:05.019101 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7c651101-5261-407f-8de4-d8a52ffb0581 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 9f83bb30-fed3-427f-bdb6-8013f5bc7b29] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:05.036176 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7c651101-5261-407f-8de4-d8a52ffb0581 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:05.041471 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7c651101-5261-407f-8de4-d8a52ffb0581 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:05.042061 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7c651101-5261-407f-8de4-d8a52ffb0581 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:05.043005 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7c651101-5261-407f-8de4-d8a52ffb0581 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:05.043583 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7c651101-5261-407f-8de4-d8a52ffb0581 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:05.044126 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7c651101-5261-407f-8de4-d8a52ffb0581 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:05.206418 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-518d49be-bfd8-4255-ac3d-6fe9d910ca84 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5378eb2d-663e-4d1d-a113-64363d4f1dd9" status: 204 len: 0 microversion: 2.1 time: 0.278487 Oct 18 15:49:05.207984 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2553/5114] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:49:04 2022] DELETE /compute/v2.1/servers/5378eb2d-663e-4d1d-a113-64363d4f1dd9 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 15:49:05.215150 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-3f2cf11f-b728-46f6-807e-1753960c7b1a req-5c35701e-9845-4bec-b3d2-788f366aed54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41390db3-b9c7-4260-82d1-72bad9b9b0cc", "name": "network-vif-deleted", "tag": "330a6dfe-e580-4dce-8a6e-1e1cd0081a73"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:49:05.235787 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3f2cf11f-b728-46f6-807e-1753960c7b1a req-5c35701e-9845-4bec-b3d2-788f366aed54 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:05.237851 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3f2cf11f-b728-46f6-807e-1753960c7b1a req-5c35701e-9845-4bec-b3d2-788f366aed54 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:05.239361 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3f2cf11f-b728-46f6-807e-1753960c7b1a req-5c35701e-9845-4bec-b3d2-788f366aed54 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:05.267323 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.compute.server_external_events [req-3f2cf11f-b728-46f6-807e-1753960c7b1a req-5c35701e-9845-4bec-b3d2-788f366aed54 service nova] Unable to find a host for instance 41390db3-b9c7-4260-82d1-72bad9b9b0cc. Dropping event network-vif-deleted {{(pid=120406) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 18 15:49:05.268637 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-3f2cf11f-b728-46f6-807e-1753960c7b1a req-5c35701e-9845-4bec-b3d2-788f366aed54 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.059354 Oct 18 15:49:05.271990 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2554/5115] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:49:05 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 63 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 18 15:49:05.277001 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b1974733-d04b-4bf2-95ce-b29b14b804f9 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:05.287013 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b1974733-d04b-4bf2-95ce-b29b14b804f9 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 5378eb2d-663e-4d1d-a113-64363d4f1dd9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:05.298144 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1974733-d04b-4bf2-95ce-b29b14b804f9 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:05.298784 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1974733-d04b-4bf2-95ce-b29b14b804f9 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:05.299237 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1974733-d04b-4bf2-95ce-b29b14b804f9 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:05.299957 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1974733-d04b-4bf2-95ce-b29b14b804f9 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:05.300418 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1974733-d04b-4bf2-95ce-b29b14b804f9 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:05.300881 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1974733-d04b-4bf2-95ce-b29b14b804f9 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:05.491993 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b1974733-d04b-4bf2-95ce-b29b14b804f9 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:05.507474 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b1974733-d04b-4bf2-95ce-b29b14b804f9 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/5378eb2d-663e-4d1d-a113-64363d4f1dd9" status: 200 len: 1467 microversion: 2.1 time: 0.234151 Oct 18 15:49:05.508370 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2555/5116] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:05 2022] GET /compute/v2.1/servers/5378eb2d-663e-4d1d-a113-64363d4f1dd9 => generated 1467 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:49:05.530478 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a00e51e6-1f55-4fe0-bdaa-a23329281a71 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:05.532775 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a00e51e6-1f55-4fe0-bdaa-a23329281a71 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] [instance: b978eea8-e4b6-43a5-8ce7-502ed47f969e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:05.540997 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=4,nova_api:INSERT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:05.543614 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a00e51e6-1f55-4fe0-bdaa-a23329281a71 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:05.544844 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a00e51e6-1f55-4fe0-bdaa-a23329281a71 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:05.545504 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a00e51e6-1f55-4fe0-bdaa-a23329281a71 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:05.546790 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a00e51e6-1f55-4fe0-bdaa-a23329281a71 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:05.547420 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a00e51e6-1f55-4fe0-bdaa-a23329281a71 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:05.548066 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a00e51e6-1f55-4fe0-bdaa-a23329281a71 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:05.792516 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7c651101-5261-407f-8de4-d8a52ffb0581 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:05.806564 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7c651101-5261-407f-8de4-d8a52ffb0581 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/9f83bb30-fed3-427f-bdb6-8013f5bc7b29" status: 200 len: 1319 microversion: 2.1 time: 0.792571 Oct 18 15:49:05.807488 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2562/5117] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:05 2022] GET /compute/v2.1/servers/9f83bb30-fed3-427f-bdb6-8013f5bc7b29 => generated 1319 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:49:06.190663 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a00e51e6-1f55-4fe0-bdaa-a23329281a71 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d61956417324dc89bca1389bacbd0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0254a3b1a54a9988125e3c09332bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:06.210427 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a00e51e6-1f55-4fe0-bdaa-a23329281a71 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] 10.222.0.60 "GET /compute/v2.1/servers/b978eea8-e4b6-43a5-8ce7-502ed47f969e" status: 200 len: 1318 microversion: 2.1 time: 0.699445 Oct 18 15:49:06.215956 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2556/5118] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:05 2022] GET /compute/v2.1/servers/b978eea8-e4b6-43a5-8ce7-502ed47f969e => generated 1318 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:49:06.531177 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-31f35d3c-0744-437e-88c6-de831bb5541c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:06.531961 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-31f35d3c-0744-437e-88c6-de831bb5541c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 5378eb2d-663e-4d1d-a113-64363d4f1dd9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:06.546942 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-31f35d3c-0744-437e-88c6-de831bb5541c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:06.550130 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-31f35d3c-0744-437e-88c6-de831bb5541c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:06.550727 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-31f35d3c-0744-437e-88c6-de831bb5541c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:06.552378 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-31f35d3c-0744-437e-88c6-de831bb5541c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:06.553319 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-31f35d3c-0744-437e-88c6-de831bb5541c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:06.556258 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-31f35d3c-0744-437e-88c6-de831bb5541c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:06.783917 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-31f35d3c-0744-437e-88c6-de831bb5541c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:06.799995 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-31f35d3c-0744-437e-88c6-de831bb5541c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/5378eb2d-663e-4d1d-a113-64363d4f1dd9" status: 200 len: 1467 microversion: 2.1 time: 0.273881 Oct 18 15:49:06.800991 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2563/5119] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:06 2022] GET /compute/v2.1/servers/5378eb2d-663e-4d1d-a113-64363d4f1dd9 => generated 1467 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:49:06.836619 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dcdf89fa-522a-4e10-a4e7-f2092db445c3 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:06.837271 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dcdf89fa-522a-4e10-a4e7-f2092db445c3 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 9f83bb30-fed3-427f-bdb6-8013f5bc7b29] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:06.844167 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dcdf89fa-522a-4e10-a4e7-f2092db445c3 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:06.845020 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dcdf89fa-522a-4e10-a4e7-f2092db445c3 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:06.845632 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dcdf89fa-522a-4e10-a4e7-f2092db445c3 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:06.846524 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dcdf89fa-522a-4e10-a4e7-f2092db445c3 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:06.847207 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dcdf89fa-522a-4e10-a4e7-f2092db445c3 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:06.848741 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dcdf89fa-522a-4e10-a4e7-f2092db445c3 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:07.244689 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2f8491e0-0870-4c25-93ce-48ac40b2e91f tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:07.245577 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2f8491e0-0870-4c25-93ce-48ac40b2e91f tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] [instance: b978eea8-e4b6-43a5-8ce7-502ed47f969e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:07.276321 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2f8491e0-0870-4c25-93ce-48ac40b2e91f tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:07.277033 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2f8491e0-0870-4c25-93ce-48ac40b2e91f tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:07.277500 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2f8491e0-0870-4c25-93ce-48ac40b2e91f tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:07.278883 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2f8491e0-0870-4c25-93ce-48ac40b2e91f tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:07.279667 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2f8491e0-0870-4c25-93ce-48ac40b2e91f tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:07.280111 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2f8491e0-0870-4c25-93ce-48ac40b2e91f tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:07.358467 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:07.678646 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dcdf89fa-522a-4e10-a4e7-f2092db445c3 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:07.696074 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dcdf89fa-522a-4e10-a4e7-f2092db445c3 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/9f83bb30-fed3-427f-bdb6-8013f5bc7b29" status: 200 len: 1319 microversion: 2.1 time: 0.865210 Oct 18 15:49:07.716054 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2557/5120] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:06 2022] GET /compute/v2.1/servers/9f83bb30-fed3-427f-bdb6-8013f5bc7b29 => generated 1319 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:49:07.721694 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d1833754-9193-439c-bc21-57295948eeb7 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:07.732593 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d1833754-9193-439c-bc21-57295948eeb7 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:07.745352 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1833754-9193-439c-bc21-57295948eeb7 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:07.746036 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1833754-9193-439c-bc21-57295948eeb7 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:07.746635 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1833754-9193-439c-bc21-57295948eeb7 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:07.747609 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1833754-9193-439c-bc21-57295948eeb7 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:07.748267 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1833754-9193-439c-bc21-57295948eeb7 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:07.749752 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1833754-9193-439c-bc21-57295948eeb7 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:07.812332 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d1833754-9193-439c-bc21-57295948eeb7 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e/ips" status: 200 len: 149 microversion: 2.20 time: 0.094776 Oct 18 15:49:07.833886 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2558/5121] 10.222.0.60 () {60 vars in 1289 bytes} [Tue Oct 18 15:49:07 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e/ips => generated 149 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:49:07.839066 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-52f616d6-2890-40f0-9676-7084bf18040c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:07.839691 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-52f616d6-2890-40f0-9676-7084bf18040c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 5378eb2d-663e-4d1d-a113-64363d4f1dd9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:07.863066 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2f8491e0-0870-4c25-93ce-48ac40b2e91f tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d61956417324dc89bca1389bacbd0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0254a3b1a54a9988125e3c09332bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:07.869563 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52f616d6-2890-40f0-9676-7084bf18040c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:07.870073 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52f616d6-2890-40f0-9676-7084bf18040c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:07.870515 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52f616d6-2890-40f0-9676-7084bf18040c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:07.871238 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52f616d6-2890-40f0-9676-7084bf18040c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:07.879040 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2f8491e0-0870-4c25-93ce-48ac40b2e91f tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] 10.222.0.60 "GET /compute/v2.1/servers/b978eea8-e4b6-43a5-8ce7-502ed47f969e" status: 200 len: 1318 microversion: 2.1 time: 0.640034 Oct 18 15:49:07.886075 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52f616d6-2890-40f0-9676-7084bf18040c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:07.886878 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52f616d6-2890-40f0-9676-7084bf18040c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:07.906037 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2564/5122] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:07 2022] GET /compute/v2.1/servers/b978eea8-e4b6-43a5-8ce7-502ed47f969e => generated 1318 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:49:08.045963 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-52f616d6-2890-40f0-9676-7084bf18040c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:08.063507 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-52f616d6-2890-40f0-9676-7084bf18040c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/5378eb2d-663e-4d1d-a113-64363d4f1dd9" status: 200 len: 1467 microversion: 2.1 time: 0.228361 Oct 18 15:49:08.064708 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2559/5123] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:07 2022] GET /compute/v2.1/servers/5378eb2d-663e-4d1d-a113-64363d4f1dd9 => generated 1467 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:49:08.413904 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-aa4e4359-c665-4c41-afd7-57337603d388 req-2e0eebf7-1faf-4677-a602-228740544582 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bec82f31-03ac-4747-a394-4f38d9886320", "tag": "9e4c84c8-12be-4775-b871-e461527e836a"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:49:08.436973 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-aa4e4359-c665-4c41-afd7-57337603d388 req-2e0eebf7-1faf-4677-a602-228740544582 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:08.437707 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-aa4e4359-c665-4c41-afd7-57337603d388 req-2e0eebf7-1faf-4677-a602-228740544582 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:08.438485 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-aa4e4359-c665-4c41-afd7-57337603d388 req-2e0eebf7-1faf-4677-a602-228740544582 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:08.470976 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-aa4e4359-c665-4c41-afd7-57337603d388 req-2e0eebf7-1faf-4677-a602-228740544582 service nova] Creating event network-changed:9e4c84c8-12be-4775-b871-e461527e836a for instance bec82f31-03ac-4747-a394-4f38d9886320 on n-h1-853682-5 Oct 18 15:49:08.482550 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-aa4e4359-c665-4c41-afd7-57337603d388 req-2e0eebf7-1faf-4677-a602-228740544582 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081498 Oct 18 15:49:08.489086 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2565/5124] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:49:08.696169 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-8f398087-f264-4f80-9083-a350acae0744 req-6676ec02-d78c-43d6-92dd-3468641879c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5378eb2d-663e-4d1d-a113-64363d4f1dd9", "name": "network-vif-deleted", "tag": "747cbe5b-6f12-4c7f-88b6-e3e8249fa1e5"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:49:08.724077 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-decba620-3acd-4641-98dd-aff3355bb48a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:08.725174 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-decba620-3acd-4641-98dd-aff3355bb48a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 9f83bb30-fed3-427f-bdb6-8013f5bc7b29] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:08.736831 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:08.751525 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-decba620-3acd-4641-98dd-aff3355bb48a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:08.752094 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-decba620-3acd-4641-98dd-aff3355bb48a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:08.752639 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-decba620-3acd-4641-98dd-aff3355bb48a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:08.753493 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-decba620-3acd-4641-98dd-aff3355bb48a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:08.758765 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-decba620-3acd-4641-98dd-aff3355bb48a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:08.765540 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8f398087-f264-4f80-9083-a350acae0744 req-6676ec02-d78c-43d6-92dd-3468641879c9 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:08.766383 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-decba620-3acd-4641-98dd-aff3355bb48a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:08.773987 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8f398087-f264-4f80-9083-a350acae0744 req-6676ec02-d78c-43d6-92dd-3468641879c9 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:08.774686 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8f398087-f264-4f80-9083-a350acae0744 req-6676ec02-d78c-43d6-92dd-3468641879c9 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:08.819918 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-8f398087-f264-4f80-9083-a350acae0744 req-6676ec02-d78c-43d6-92dd-3468641879c9 service nova] Creating event network-vif-deleted:747cbe5b-6f12-4c7f-88b6-e3e8249fa1e5 for instance 5378eb2d-663e-4d1d-a113-64363d4f1dd9 on n-h2-853682-5 Oct 18 15:49:08.845510 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-8f398087-f264-4f80-9083-a350acae0744 req-6676ec02-d78c-43d6-92dd-3468641879c9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156811 Oct 18 15:49:08.846443 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2560/5125] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:49:08.909643 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-76064f19-5b04-4166-acf7-2ba5c98f0237 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:08.910983 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-76064f19-5b04-4166-acf7-2ba5c98f0237 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] [instance: b978eea8-e4b6-43a5-8ce7-502ed47f969e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:08.926053 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76064f19-5b04-4166-acf7-2ba5c98f0237 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:08.926683 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76064f19-5b04-4166-acf7-2ba5c98f0237 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:08.927116 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76064f19-5b04-4166-acf7-2ba5c98f0237 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:08.927830 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76064f19-5b04-4166-acf7-2ba5c98f0237 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:08.928285 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76064f19-5b04-4166-acf7-2ba5c98f0237 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:08.928710 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76064f19-5b04-4166-acf7-2ba5c98f0237 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:09.084169 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=8 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:09.850034 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-decba620-3acd-4641-98dd-aff3355bb48a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:09.862904 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-decba620-3acd-4641-98dd-aff3355bb48a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/9f83bb30-fed3-427f-bdb6-8013f5bc7b29" status: 200 len: 1319 microversion: 2.1 time: 1.143915 Oct 18 15:49:09.866649 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2566/5126] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:08 2022] GET /compute/v2.1/servers/9f83bb30-fed3-427f-bdb6-8013f5bc7b29 => generated 1319 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:49:09.879695 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8581d0b4-b558-46d6-8e0d-1767ff71496e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:09.880652 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8581d0b4-b558-46d6-8e0d-1767ff71496e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 5378eb2d-663e-4d1d-a113-64363d4f1dd9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:09.888058 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8581d0b4-b558-46d6-8e0d-1767ff71496e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:09.888939 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8581d0b4-b558-46d6-8e0d-1767ff71496e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:09.890171 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8581d0b4-b558-46d6-8e0d-1767ff71496e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:09.891150 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8581d0b4-b558-46d6-8e0d-1767ff71496e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:09.891847 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8581d0b4-b558-46d6-8e0d-1767ff71496e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:09.892546 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8581d0b4-b558-46d6-8e0d-1767ff71496e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:09.939542 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8581d0b4-b558-46d6-8e0d-1767ff71496e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:09.940457 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8581d0b4-b558-46d6-8e0d-1767ff71496e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:09.941435 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8581d0b4-b558-46d6-8e0d-1767ff71496e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:09.942013 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-8581d0b4-b558-46d6-8e0d-1767ff71496e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lazy-loading 'fault' on Instance uuid 5378eb2d-663e-4d1d-a113-64363d4f1dd9 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:49:09.950167 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-76064f19-5b04-4166-acf7-2ba5c98f0237 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d61956417324dc89bca1389bacbd0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0254a3b1a54a9988125e3c09332bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:09.965228 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-76064f19-5b04-4166-acf7-2ba5c98f0237 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] 10.222.0.60 "GET /compute/v2.1/servers/b978eea8-e4b6-43a5-8ce7-502ed47f969e" status: 200 len: 1318 microversion: 2.1 time: 1.060070 Oct 18 15:49:09.967295 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2561/5127] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:08 2022] GET /compute/v2.1/servers/b978eea8-e4b6-43a5-8ce7-502ed47f969e => generated 1318 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:49:10.132981 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8581d0b4-b558-46d6-8e0d-1767ff71496e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:10.142231 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8581d0b4-b558-46d6-8e0d-1767ff71496e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/5378eb2d-663e-4d1d-a113-64363d4f1dd9" status: 200 len: 1305 microversion: 2.1 time: 0.273494 Oct 18 15:49:10.144237 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2567/5128] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:09 2022] GET /compute/v2.1/servers/5378eb2d-663e-4d1d-a113-64363d4f1dd9 => generated 1305 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:49:10.893880 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a8fff11f-4cdc-43a4-9eb5-3e47a3dda281 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:10.894780 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a8fff11f-4cdc-43a4-9eb5-3e47a3dda281 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 9f83bb30-fed3-427f-bdb6-8013f5bc7b29] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:10.909774 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8fff11f-4cdc-43a4-9eb5-3e47a3dda281 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:10.910538 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8fff11f-4cdc-43a4-9eb5-3e47a3dda281 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:10.911139 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8fff11f-4cdc-43a4-9eb5-3e47a3dda281 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:10.912655 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8fff11f-4cdc-43a4-9eb5-3e47a3dda281 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:10.913123 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8fff11f-4cdc-43a4-9eb5-3e47a3dda281 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:10.913594 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8fff11f-4cdc-43a4-9eb5-3e47a3dda281 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:10.990171 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3ab092df-e9e1-4576-9e3b-3a7335081266 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:10.991416 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3ab092df-e9e1-4576-9e3b-3a7335081266 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] [instance: b978eea8-e4b6-43a5-8ce7-502ed47f969e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:11.004190 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ab092df-e9e1-4576-9e3b-3a7335081266 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:11.005254 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ab092df-e9e1-4576-9e3b-3a7335081266 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:11.005707 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ab092df-e9e1-4576-9e3b-3a7335081266 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:11.006456 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ab092df-e9e1-4576-9e3b-3a7335081266 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:11.006924 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ab092df-e9e1-4576-9e3b-3a7335081266 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:11.013703 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ab092df-e9e1-4576-9e3b-3a7335081266 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:11.428082 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a8fff11f-4cdc-43a4-9eb5-3e47a3dda281 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:11.432162 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3ab092df-e9e1-4576-9e3b-3a7335081266 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d61956417324dc89bca1389bacbd0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0254a3b1a54a9988125e3c09332bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:11.446629 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3ab092df-e9e1-4576-9e3b-3a7335081266 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] 10.222.0.60 "GET /compute/v2.1/servers/b978eea8-e4b6-43a5-8ce7-502ed47f969e" status: 200 len: 1318 microversion: 2.1 time: 0.459457 Oct 18 15:49:11.448673 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2568/5129] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:10 2022] GET /compute/v2.1/servers/b978eea8-e4b6-43a5-8ce7-502ed47f969e => generated 1318 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:49:11.460946 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-bd997dd5-b5be-4986-a616-73c9cc6bf14e req-e7065a36-5609-4e43-83d8-c791014d782e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b978eea8-e4b6-43a5-8ce7-502ed47f969e", "tag": "286c3437-f206-44a0-b5cb-bfe6e1d8011d"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:49:11.461709 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a8fff11f-4cdc-43a4-9eb5-3e47a3dda281 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/9f83bb30-fed3-427f-bdb6-8013f5bc7b29" status: 200 len: 1319 microversion: 2.1 time: 0.549937 Oct 18 15:49:11.462394 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2562/5130] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:10 2022] GET /compute/v2.1/servers/9f83bb30-fed3-427f-bdb6-8013f5bc7b29 => generated 1319 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:49:11.473619 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8f71d0d0-bff8-4db4-98bb-3fee1aa814e1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:11.473619 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8f71d0d0-bff8-4db4-98bb-3fee1aa814e1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 5378eb2d-663e-4d1d-a113-64363d4f1dd9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:11.486636 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-bd997dd5-b5be-4986-a616-73c9cc6bf14e req-e7065a36-5609-4e43-83d8-c791014d782e service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:11.486891 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f71d0d0-bff8-4db4-98bb-3fee1aa814e1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:11.487138 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f71d0d0-bff8-4db4-98bb-3fee1aa814e1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:11.487264 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-bd997dd5-b5be-4986-a616-73c9cc6bf14e req-e7065a36-5609-4e43-83d8-c791014d782e service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:11.487595 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f71d0d0-bff8-4db4-98bb-3fee1aa814e1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:11.488308 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f71d0d0-bff8-4db4-98bb-3fee1aa814e1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:11.488829 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f71d0d0-bff8-4db4-98bb-3fee1aa814e1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:11.489264 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f71d0d0-bff8-4db4-98bb-3fee1aa814e1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:11.490495 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-bd997dd5-b5be-4986-a616-73c9cc6bf14e req-e7065a36-5609-4e43-83d8-c791014d782e service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:11.516710 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-8f71d0d0-bff8-4db4-98bb-3fee1aa814e1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] HTTP exception thrown: Instance 5378eb2d-663e-4d1d-a113-64363d4f1dd9 could not be found. Oct 18 15:49:11.519033 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-bd997dd5-b5be-4986-a616-73c9cc6bf14e req-e7065a36-5609-4e43-83d8-c791014d782e service nova] Creating event network-changed:286c3437-f206-44a0-b5cb-bfe6e1d8011d for instance b978eea8-e4b6-43a5-8ce7-502ed47f969e on n-h2-853682-5 Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8f71d0d0-bff8-4db4-98bb-3fee1aa814e1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Request method failure captured: Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/5378eb2d-663e-4d1d-a113-64363d4f1dd9 HTTP/1.1 Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsjnRdctCp-8YpJETZx5RBXsp0tk0P-jTGcQMSIsNH2GEBs8Wg82Po84gRYEjmY4OarQGWuT5THqpHI7_-hfhGBlYj8sHI1l4vQlE5R8BdhWWvvol61i38spuPGOi5m1Vnr-duJeNWVp2-6eOy-UohsCpTw7z-IjZzPv-4bQM_LgFXg Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 2a2cdc778bd54f209d70f5b8703dc068 Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerActionsTestJSON-1828367688 Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2a2cdc778bd54f209d70f5b8703dc068"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2a2cdc778bd54f209d70f5b8703dc068"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2a2cdc778bd54f209d70f5b8703dc068"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2a2cdc778bd54f209d70f5b8703dc068"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServerActionsTestJSON-1828367688 Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 2a2cdc778bd54f209d70f5b8703dc068 Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerActionsTestJSON-1828367688 Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServerActionsTestJSON-1828367688-project Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 2aa0148a4a43466da619ea9843b3f78c Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServerActionsTestJSON-1828367688-project Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 5378eb2d-663e-4d1d-a113-64363d4f1dd9 could not be found. Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '5378eb2d-663e-4d1d-a113-64363d4f1dd9'} Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5378eb2d-663e-4d1d-a113-64363d4f1dd9 could not be found. Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5378eb2d-663e-4d1d-a113-64363d4f1dd9 could not be found. Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:49:11.526214 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:49:11.532848 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:49:11.532848 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:49:11.532848 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:49:11.532848 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:49:11.532848 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:49:11.532848 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5378eb2d-663e-4d1d-a113-64363d4f1dd9 could not be found. Oct 18 15:49:11.532848 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:49:11.532848 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8f71d0d0-bff8-4db4-98bb-3fee1aa814e1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Returning 404 to user: Instance 5378eb2d-663e-4d1d-a113-64363d4f1dd9 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:49:11.532848 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8f71d0d0-bff8-4db4-98bb-3fee1aa814e1 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/5378eb2d-663e-4d1d-a113-64363d4f1dd9" status: 404 len: 111 microversion: 2.1 time: 0.064440 Oct 18 15:49:11.532848 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2563/5131] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:11 2022] GET /compute/v2.1/servers/5378eb2d-663e-4d1d-a113-64363d4f1dd9 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:49:11.534444 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-bd997dd5-b5be-4986-a616-73c9cc6bf14e req-e7065a36-5609-4e43-83d8-c791014d782e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081448 Oct 18 15:49:11.536112 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2569/5132] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:49:11.546164 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-39ca9bc9-1b92-4b48-92c3-79250eed15d0 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:49:11.546721 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-39ca9bc9-1b92-4b48-92c3-79250eed15d0 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:11.555000 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f3eb7e40-393d-4755-9a62-792f081daa18 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:11.556057 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f3eb7e40-393d-4755-9a62-792f081daa18 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 25eb309d-2add-4b63-96b9-f78966b9f3b6] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:11.561596 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39ca9bc9-1b92-4b48-92c3-79250eed15d0 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:11.573495 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39ca9bc9-1b92-4b48-92c3-79250eed15d0 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:11.574043 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39ca9bc9-1b92-4b48-92c3-79250eed15d0 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:11.574818 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39ca9bc9-1b92-4b48-92c3-79250eed15d0 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:11.575296 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39ca9bc9-1b92-4b48-92c3-79250eed15d0 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:11.575732 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39ca9bc9-1b92-4b48-92c3-79250eed15d0 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:11.588767 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f3eb7e40-393d-4755-9a62-792f081daa18 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:11.589524 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f3eb7e40-393d-4755-9a62-792f081daa18 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:11.590127 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f3eb7e40-393d-4755-9a62-792f081daa18 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:11.590998 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f3eb7e40-393d-4755-9a62-792f081daa18 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:11.591642 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f3eb7e40-393d-4755-9a62-792f081daa18 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:11.592272 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f3eb7e40-393d-4755-9a62-792f081daa18 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:11.614931 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-39ca9bc9-1b92-4b48-92c3-79250eed15d0 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lazy-loading 'flavor' on Instance uuid b465248f-ab7a-4aba-b939-6f236eea166e {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:49:11.631750 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f3eb7e40-393d-4755-9a62-792f081daa18 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 25eb309d-2add-4b63-96b9-f78966b9f3b6] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:49:11.758120 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=16,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:11.769294 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:11.785929 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f3eb7e40-393d-4755-9a62-792f081daa18 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "DELETE /compute/v2.1/servers/25eb309d-2add-4b63-96b9-f78966b9f3b6" status: 204 len: 0 microversion: 2.1 time: 0.246888 Oct 18 15:49:11.788885 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2570/5133] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:49:11 2022] DELETE /compute/v2.1/servers/25eb309d-2add-4b63-96b9-f78966b9f3b6 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:49:11.808877 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-406f9c72-2d74-435c-9b9b-cf9cb6010148 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:11.810770 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-406f9c72-2d74-435c-9b9b-cf9cb6010148 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 25eb309d-2add-4b63-96b9-f78966b9f3b6] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:11.829284 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-406f9c72-2d74-435c-9b9b-cf9cb6010148 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:11.830104 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-406f9c72-2d74-435c-9b9b-cf9cb6010148 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:11.834996 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-406f9c72-2d74-435c-9b9b-cf9cb6010148 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:11.837408 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-406f9c72-2d74-435c-9b9b-cf9cb6010148 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:11.838133 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-406f9c72-2d74-435c-9b9b-cf9cb6010148 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:11.838786 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-406f9c72-2d74-435c-9b9b-cf9cb6010148 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:12.101749 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-39ca9bc9-1b92-4b48-92c3-79250eed15d0 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "POST /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e/action" status: 202 len: 0 microversion: 2.20 time: 0.565984 Oct 18 15:49:12.102952 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2564/5134] 10.222.0.60 () {62 vars in 1319 bytes} [Tue Oct 18 15:49:11 2022] POST /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e/action => generated 0 bytes in 571 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:49:12.113719 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a1581875-0a89-4287-afbf-12e27adb5e2a tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:12.118115 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a1581875-0a89-4287-afbf-12e27adb5e2a tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: a49f5b92-61e2-44bd-92a9-2bbaa1fb8975] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:12.130019 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1581875-0a89-4287-afbf-12e27adb5e2a tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:12.133512 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1581875-0a89-4287-afbf-12e27adb5e2a tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:12.133512 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1581875-0a89-4287-afbf-12e27adb5e2a tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:12.134106 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1581875-0a89-4287-afbf-12e27adb5e2a tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:12.141184 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1581875-0a89-4287-afbf-12e27adb5e2a tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:12.141731 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1581875-0a89-4287-afbf-12e27adb5e2a tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:12.222990 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a1581875-0a89-4287-afbf-12e27adb5e2a tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: a49f5b92-61e2-44bd-92a9-2bbaa1fb8975] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:49:12.388583 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a1581875-0a89-4287-afbf-12e27adb5e2a tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975" status: 204 len: 0 microversion: 2.1 time: 0.283880 Oct 18 15:49:12.390597 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2565/5135] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:49:12 2022] DELETE /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:49:12.405146 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3d41054a-3fab-41b2-bdab-40f9fe7061a4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:12.407052 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3d41054a-3fab-41b2-bdab-40f9fe7061a4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:12.424901 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d41054a-3fab-41b2-bdab-40f9fe7061a4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:12.425765 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d41054a-3fab-41b2-bdab-40f9fe7061a4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:12.427206 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d41054a-3fab-41b2-bdab-40f9fe7061a4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:12.429600 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d41054a-3fab-41b2-bdab-40f9fe7061a4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:12.430277 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d41054a-3fab-41b2-bdab-40f9fe7061a4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:12.430844 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d41054a-3fab-41b2-bdab-40f9fe7061a4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:12.710708 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-406f9c72-2d74-435c-9b9b-cf9cb6010148 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:12.720404 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-406f9c72-2d74-435c-9b9b-cf9cb6010148 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/25eb309d-2add-4b63-96b9-f78966b9f3b6" status: 200 len: 1508 microversion: 2.1 time: 0.926254 Oct 18 15:49:12.721031 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2571/5136] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:11 2022] GET /compute/v2.1/servers/25eb309d-2add-4b63-96b9-f78966b9f3b6 => generated 1508 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:49:12.736602 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-29864aea-f125-46c0-9a83-54175795024d tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:12.737370 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-29864aea-f125-46c0-9a83-54175795024d tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: a49f5b92-61e2-44bd-92a9-2bbaa1fb8975] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:12.748490 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-29864aea-f125-46c0-9a83-54175795024d tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:12.751091 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-29864aea-f125-46c0-9a83-54175795024d tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:12.751786 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-29864aea-f125-46c0-9a83-54175795024d tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:12.752743 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-29864aea-f125-46c0-9a83-54175795024d tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:12.755406 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-29864aea-f125-46c0-9a83-54175795024d tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:12.756157 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-29864aea-f125-46c0-9a83-54175795024d tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:12.942012 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3d41054a-3fab-41b2-bdab-40f9fe7061a4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:12.953278 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3d41054a-3fab-41b2-bdab-40f9fe7061a4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:12.956637 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3d41054a-3fab-41b2-bdab-40f9fe7061a4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:12.961305 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3d41054a-3fab-41b2-bdab-40f9fe7061a4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1720 microversion: 2.20 time: 0.567637 Oct 18 15:49:12.961305 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2566/5137] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:49:12 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1720 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:49:13.010605 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-550d4fcb-f6e7-4767-ba92-6e2f1b03c11b tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:13.014284 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-550d4fcb-f6e7-4767-ba92-6e2f1b03c11b tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] [instance: b978eea8-e4b6-43a5-8ce7-502ed47f969e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:13.045233 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-550d4fcb-f6e7-4767-ba92-6e2f1b03c11b tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:13.045950 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-550d4fcb-f6e7-4767-ba92-6e2f1b03c11b tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:13.049251 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-550d4fcb-f6e7-4767-ba92-6e2f1b03c11b tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:13.050025 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-550d4fcb-f6e7-4767-ba92-6e2f1b03c11b tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:13.052584 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-550d4fcb-f6e7-4767-ba92-6e2f1b03c11b tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:13.053084 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-550d4fcb-f6e7-4767-ba92-6e2f1b03c11b tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:13.266312 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-29864aea-f125-46c0-9a83-54175795024d tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:13.280406 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-29864aea-f125-46c0-9a83-54175795024d tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975" status: 200 len: 1509 microversion: 2.1 time: 0.546882 Oct 18 15:49:13.281454 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2572/5138] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:12 2022] GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975 => generated 1509 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:49:13.293715 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bb220e02-806c-451e-932d-ca8d6ff407b0 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:13.301719 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-bb220e02-806c-451e-932d-ca8d6ff407b0 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 9f83bb30-fed3-427f-bdb6-8013f5bc7b29] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:13.310611 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bb220e02-806c-451e-932d-ca8d6ff407b0 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:13.311450 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bb220e02-806c-451e-932d-ca8d6ff407b0 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:13.312153 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bb220e02-806c-451e-932d-ca8d6ff407b0 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:13.313136 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bb220e02-806c-451e-932d-ca8d6ff407b0 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:13.313855 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bb220e02-806c-451e-932d-ca8d6ff407b0 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:13.314530 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bb220e02-806c-451e-932d-ca8d6ff407b0 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:13.484403 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-550d4fcb-f6e7-4767-ba92-6e2f1b03c11b tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d61956417324dc89bca1389bacbd0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0254a3b1a54a9988125e3c09332bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:13.505479 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-550d4fcb-f6e7-4767-ba92-6e2f1b03c11b tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] 10.222.0.60 "GET /compute/v2.1/servers/b978eea8-e4b6-43a5-8ce7-502ed47f969e" status: 200 len: 1318 microversion: 2.1 time: 0.537525 Oct 18 15:49:13.506357 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2567/5139] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:12 2022] GET /compute/v2.1/servers/b978eea8-e4b6-43a5-8ce7-502ed47f969e => generated 1318 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:49:13.511157 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-933ef6f5-4835-459a-9eaa-8ca099a5224e req-f2a7c126-1f1a-43dd-bf55-8926599fbb9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f83bb30-fed3-427f-bdb6-8013f5bc7b29", "name": "network-vif-plugged", "status": "completed", "tag": "aa03188b-a4e8-48ce-bc92-96127d0e3784"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:49:13.540929 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-933ef6f5-4835-459a-9eaa-8ca099a5224e req-f2a7c126-1f1a-43dd-bf55-8926599fbb9c service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:13.541812 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-933ef6f5-4835-459a-9eaa-8ca099a5224e req-f2a7c126-1f1a-43dd-bf55-8926599fbb9c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:13.542429 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-933ef6f5-4835-459a-9eaa-8ca099a5224e req-f2a7c126-1f1a-43dd-bf55-8926599fbb9c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:13.561100 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-933ef6f5-4835-459a-9eaa-8ca099a5224e req-f2a7c126-1f1a-43dd-bf55-8926599fbb9c service nova] Creating event network-vif-plugged:aa03188b-a4e8-48ce-bc92-96127d0e3784 for instance 9f83bb30-fed3-427f-bdb6-8013f5bc7b29 on n-h1-853682-5 Oct 18 15:49:13.574079 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-933ef6f5-4835-459a-9eaa-8ca099a5224e req-f2a7c126-1f1a-43dd-bf55-8926599fbb9c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066412 Oct 18 15:49:13.574995 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2568/5140] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:49:13.745089 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ce7262f2-ea28-41d6-947a-3eb3ca90f31b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:13.746232 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ce7262f2-ea28-41d6-947a-3eb3ca90f31b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 25eb309d-2add-4b63-96b9-f78966b9f3b6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:13.754330 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-bb220e02-806c-451e-932d-ca8d6ff407b0 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:13.756801 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce7262f2-ea28-41d6-947a-3eb3ca90f31b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:13.757657 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce7262f2-ea28-41d6-947a-3eb3ca90f31b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:13.758531 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce7262f2-ea28-41d6-947a-3eb3ca90f31b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:13.759918 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce7262f2-ea28-41d6-947a-3eb3ca90f31b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:13.760631 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce7262f2-ea28-41d6-947a-3eb3ca90f31b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:13.761200 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce7262f2-ea28-41d6-947a-3eb3ca90f31b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:13.772053 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-bb220e02-806c-451e-932d-ca8d6ff407b0 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/9f83bb30-fed3-427f-bdb6-8013f5bc7b29" status: 200 len: 1319 microversion: 2.1 time: 0.480147 Oct 18 15:49:13.773316 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2573/5141] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:13 2022] GET /compute/v2.1/servers/9f83bb30-fed3-427f-bdb6-8013f5bc7b29 => generated 1319 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:49:13.990527 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-eb738df1-df1a-4bed-a3a0-1595980bf014 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:13.991443 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-eb738df1-df1a-4bed-a3a0-1595980bf014 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:13.998132 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eb738df1-df1a-4bed-a3a0-1595980bf014 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:13.999008 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eb738df1-df1a-4bed-a3a0-1595980bf014 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:13.999710 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eb738df1-df1a-4bed-a3a0-1595980bf014 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:14.000701 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eb738df1-df1a-4bed-a3a0-1595980bf014 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:14.001727 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eb738df1-df1a-4bed-a3a0-1595980bf014 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:14.002487 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eb738df1-df1a-4bed-a3a0-1595980bf014 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:14.041862 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ce7262f2-ea28-41d6-947a-3eb3ca90f31b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:14.053677 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ce7262f2-ea28-41d6-947a-3eb3ca90f31b tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/25eb309d-2add-4b63-96b9-f78966b9f3b6" status: 200 len: 1508 microversion: 2.1 time: 0.313675 Oct 18 15:49:14.054295 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2569/5142] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:13 2022] GET /compute/v2.1/servers/25eb309d-2add-4b63-96b9-f78966b9f3b6 => generated 1508 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:49:14.285862 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-eb738df1-df1a-4bed-a3a0-1595980bf014 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:14.296777 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-eb738df1-df1a-4bed-a3a0-1595980bf014 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:14.298778 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-eb738df1-df1a-4bed-a3a0-1595980bf014 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:14.300091 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-eb738df1-df1a-4bed-a3a0-1595980bf014 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1720 microversion: 2.20 time: 0.313828 Oct 18 15:49:14.300894 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2574/5143] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:49:13 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1720 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:49:14.313698 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7a428b6e-c979-4f84-b3a4-8853fb948416 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:14.314586 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7a428b6e-c979-4f84-b3a4-8853fb948416 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: a49f5b92-61e2-44bd-92a9-2bbaa1fb8975] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:14.321809 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a428b6e-c979-4f84-b3a4-8853fb948416 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:14.322300 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a428b6e-c979-4f84-b3a4-8853fb948416 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:14.322738 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a428b6e-c979-4f84-b3a4-8853fb948416 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:14.323653 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a428b6e-c979-4f84-b3a4-8853fb948416 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:14.324114 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a428b6e-c979-4f84-b3a4-8853fb948416 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:14.324543 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a428b6e-c979-4f84-b3a4-8853fb948416 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:14.532023 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-97af9c3d-1092-4773-9d8b-9654d4f37ff2 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:14.533121 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-97af9c3d-1092-4773-9d8b-9654d4f37ff2 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] [instance: b978eea8-e4b6-43a5-8ce7-502ed47f969e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:14.542800 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97af9c3d-1092-4773-9d8b-9654d4f37ff2 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:14.545398 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97af9c3d-1092-4773-9d8b-9654d4f37ff2 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:14.546189 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97af9c3d-1092-4773-9d8b-9654d4f37ff2 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:14.553062 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97af9c3d-1092-4773-9d8b-9654d4f37ff2 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:14.554750 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97af9c3d-1092-4773-9d8b-9654d4f37ff2 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:14.555619 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97af9c3d-1092-4773-9d8b-9654d4f37ff2 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:14.870752 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7a428b6e-c979-4f84-b3a4-8853fb948416 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:14.905969 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7a428b6e-c979-4f84-b3a4-8853fb948416 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975" status: 200 len: 1509 microversion: 2.1 time: 0.604024 Oct 18 15:49:14.913520 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2570/5144] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:14 2022] GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975 => generated 1509 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:49:14.921846 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-078d129f-62b3-4ba3-b43c-e6b693bbc546 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:14.922882 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-078d129f-62b3-4ba3-b43c-e6b693bbc546 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 9f83bb30-fed3-427f-bdb6-8013f5bc7b29] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:14.933894 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-078d129f-62b3-4ba3-b43c-e6b693bbc546 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:14.934662 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-078d129f-62b3-4ba3-b43c-e6b693bbc546 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:14.952300 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-078d129f-62b3-4ba3-b43c-e6b693bbc546 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:14.954083 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-078d129f-62b3-4ba3-b43c-e6b693bbc546 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:14.955196 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-078d129f-62b3-4ba3-b43c-e6b693bbc546 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:14.956143 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-078d129f-62b3-4ba3-b43c-e6b693bbc546 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:15.245232 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-97af9c3d-1092-4773-9d8b-9654d4f37ff2 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d61956417324dc89bca1389bacbd0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0254a3b1a54a9988125e3c09332bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:15.267618 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-97af9c3d-1092-4773-9d8b-9654d4f37ff2 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] 10.222.0.60 "GET /compute/v2.1/servers/b978eea8-e4b6-43a5-8ce7-502ed47f969e" status: 200 len: 1318 microversion: 2.1 time: 0.741261 Oct 18 15:49:15.286926 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2575/5145] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:14 2022] GET /compute/v2.1/servers/b978eea8-e4b6-43a5-8ce7-502ed47f969e => generated 1318 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:49:15.293125 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-005f944e-7a00-4e29-9645-66d8067f2dcc tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:15.302774 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-005f944e-7a00-4e29-9645-66d8067f2dcc tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 25eb309d-2add-4b63-96b9-f78966b9f3b6] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:15.314440 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-005f944e-7a00-4e29-9645-66d8067f2dcc tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:15.314971 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-005f944e-7a00-4e29-9645-66d8067f2dcc tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:15.315396 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-005f944e-7a00-4e29-9645-66d8067f2dcc tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:15.316117 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-005f944e-7a00-4e29-9645-66d8067f2dcc tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:15.317166 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-005f944e-7a00-4e29-9645-66d8067f2dcc tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:15.317819 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-005f944e-7a00-4e29-9645-66d8067f2dcc tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:16.250977 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-078d129f-62b3-4ba3-b43c-e6b693bbc546 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:16.276471 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-078d129f-62b3-4ba3-b43c-e6b693bbc546 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/9f83bb30-fed3-427f-bdb6-8013f5bc7b29" status: 200 len: 1319 microversion: 2.1 time: 1.359598 Oct 18 15:49:16.277545 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2571/5146] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:14 2022] GET /compute/v2.1/servers/9f83bb30-fed3-427f-bdb6-8013f5bc7b29 => generated 1319 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:49:16.305475 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dffef065-9b71-4b23-9336-826f137c15d6 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:16.306446 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dffef065-9b71-4b23-9336-826f137c15d6 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:16.356575 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dffef065-9b71-4b23-9336-826f137c15d6 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:16.361378 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dffef065-9b71-4b23-9336-826f137c15d6 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:16.361942 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dffef065-9b71-4b23-9336-826f137c15d6 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:16.362715 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dffef065-9b71-4b23-9336-826f137c15d6 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:16.363195 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dffef065-9b71-4b23-9336-826f137c15d6 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:16.364207 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dffef065-9b71-4b23-9336-826f137c15d6 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:16.622045 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-005f944e-7a00-4e29-9645-66d8067f2dcc tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:16.642951 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-005f944e-7a00-4e29-9645-66d8067f2dcc tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/25eb309d-2add-4b63-96b9-f78966b9f3b6" status: 200 len: 1508 microversion: 2.1 time: 1.354118 Oct 18 15:49:16.676352 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2576/5147] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:15 2022] GET /compute/v2.1/servers/25eb309d-2add-4b63-96b9-f78966b9f3b6 => generated 1508 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:49:16.693522 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-651d52d4-52ad-4a99-815b-068739f79dbf req-8aa9a75e-1732-462e-86de-bcf2609313d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a49f5b92-61e2-44bd-92a9-2bbaa1fb8975", "name": "network-vif-deleted", "tag": "896b942f-5533-44f6-8cb3-97209dd77612"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:49:16.723543 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-651d52d4-52ad-4a99-815b-068739f79dbf req-8aa9a75e-1732-462e-86de-bcf2609313d8 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:16.725388 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-651d52d4-52ad-4a99-815b-068739f79dbf req-8aa9a75e-1732-462e-86de-bcf2609313d8 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:16.734638 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-651d52d4-52ad-4a99-815b-068739f79dbf req-8aa9a75e-1732-462e-86de-bcf2609313d8 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:16.756872 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-651d52d4-52ad-4a99-815b-068739f79dbf req-8aa9a75e-1732-462e-86de-bcf2609313d8 service nova] Creating event network-vif-deleted:896b942f-5533-44f6-8cb3-97209dd77612 for instance a49f5b92-61e2-44bd-92a9-2bbaa1fb8975 on n-h2-853682-5 Oct 18 15:49:16.776320 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-651d52d4-52ad-4a99-815b-068739f79dbf req-8aa9a75e-1732-462e-86de-bcf2609313d8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097052 Oct 18 15:49:16.777698 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2577/5148] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:49:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:49:16.784374 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2fcd40c1-4434-4e66-93db-6a3e79125e94 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:16.785219 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2fcd40c1-4434-4e66-93db-6a3e79125e94 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: a49f5b92-61e2-44bd-92a9-2bbaa1fb8975] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:16.797060 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2fcd40c1-4434-4e66-93db-6a3e79125e94 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:16.803754 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2fcd40c1-4434-4e66-93db-6a3e79125e94 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:16.803754 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2fcd40c1-4434-4e66-93db-6a3e79125e94 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:16.803754 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2fcd40c1-4434-4e66-93db-6a3e79125e94 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:16.803754 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2fcd40c1-4434-4e66-93db-6a3e79125e94 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:16.805336 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2fcd40c1-4434-4e66-93db-6a3e79125e94 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:16.887608 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-2fcd40c1-4434-4e66-93db-6a3e79125e94 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] HTTP exception thrown: Instance a49f5b92-61e2-44bd-92a9-2bbaa1fb8975 could not be found. Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2fcd40c1-4434-4e66-93db-6a3e79125e94 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Request method failure captured: Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975 HTTP/1.1 Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsmOlfJjna__aWkkHZgCFMOd2DpNqn_dr-IEPGuxkqNqAVs7tN5T268nd09vhRJnPU2g5DJC-yqBSq_x2HTDX86g3yOFixR2PbozSJNAuQoWzOe1hqzQDBztCsy4gcfQ635XTPjGuAISQPn4_b-3rgJ6h45QPHOVHclQC7dNdVcnHno Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 224ca1f734c14bc8bf31e1826faf8e71 Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1233761615 Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/224ca1f734c14bc8bf31e1826faf8e71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/224ca1f734c14bc8bf31e1826faf8e71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/224ca1f734c14bc8bf31e1826faf8e71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_224ca1f734c14bc8bf31e1826faf8e71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1233761615 Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 224ca1f734c14bc8bf31e1826faf8e71 Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1233761615 Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServerRescueNegativeTestJSON-1233761615-project Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 646fb4652c164c1dab5672d33d9fb295 Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1233761615-project Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance a49f5b92-61e2-44bd-92a9-2bbaa1fb8975 could not be found. Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'a49f5b92-61e2-44bd-92a9-2bbaa1fb8975'} Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a49f5b92-61e2-44bd-92a9-2bbaa1fb8975 could not be found. Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a49f5b92-61e2-44bd-92a9-2bbaa1fb8975 could not be found. Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:49:16.894079 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:49:16.902458 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:49:16.902458 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:49:16.902458 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:49:16.902458 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:49:16.902458 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:49:16.902458 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:49:16.902458 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a49f5b92-61e2-44bd-92a9-2bbaa1fb8975 could not be found. Oct 18 15:49:16.902458 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:49:16.907257 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2fcd40c1-4434-4e66-93db-6a3e79125e94 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Returning 404 to user: Instance a49f5b92-61e2-44bd-92a9-2bbaa1fb8975 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:49:16.908920 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2fcd40c1-4434-4e66-93db-6a3e79125e94 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975" status: 404 len: 111 microversion: 2.1 time: 0.129620 Oct 18 15:49:16.917793 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2578/5149] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:16 2022] GET /compute/v2.1/servers/a49f5b92-61e2-44bd-92a9-2bbaa1fb8975 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:49:16.924116 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-347c6c7b-9e4a-49e8-b7f4-e06b76001777 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:16.940206 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-347c6c7b-9e4a-49e8-b7f4-e06b76001777 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] [instance: b978eea8-e4b6-43a5-8ce7-502ed47f969e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:16.956691 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-347c6c7b-9e4a-49e8-b7f4-e06b76001777 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:16.960228 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-347c6c7b-9e4a-49e8-b7f4-e06b76001777 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:16.961974 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dffef065-9b71-4b23-9336-826f137c15d6 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:16.962743 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-347c6c7b-9e4a-49e8-b7f4-e06b76001777 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:16.963855 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-347c6c7b-9e4a-49e8-b7f4-e06b76001777 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:16.964783 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-347c6c7b-9e4a-49e8-b7f4-e06b76001777 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:16.965478 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-347c6c7b-9e4a-49e8-b7f4-e06b76001777 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:16.978288 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dffef065-9b71-4b23-9336-826f137c15d6 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:16.980113 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dffef065-9b71-4b23-9336-826f137c15d6 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:16.981869 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dffef065-9b71-4b23-9336-826f137c15d6 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1720 microversion: 2.20 time: 0.702829 Oct 18 15:49:16.982442 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2572/5150] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:49:16 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1720 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:49:16.992263 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-23e7ae2b-47ac-4dbe-b08a-79f6d89d9125 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:16.992785 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-23e7ae2b-47ac-4dbe-b08a-79f6d89d9125 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 19226472-0c76-46f8-a4ba-7d32931341a2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:17.007744 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23e7ae2b-47ac-4dbe-b08a-79f6d89d9125 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:17.008245 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23e7ae2b-47ac-4dbe-b08a-79f6d89d9125 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:17.008684 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23e7ae2b-47ac-4dbe-b08a-79f6d89d9125 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:17.009417 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23e7ae2b-47ac-4dbe-b08a-79f6d89d9125 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:17.016110 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23e7ae2b-47ac-4dbe-b08a-79f6d89d9125 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:17.016647 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23e7ae2b-47ac-4dbe-b08a-79f6d89d9125 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:17.065493 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-23e7ae2b-47ac-4dbe-b08a-79f6d89d9125 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 19226472-0c76-46f8-a4ba-7d32931341a2] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:49:17.225933 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-23e7ae2b-47ac-4dbe-b08a-79f6d89d9125 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "DELETE /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2" status: 204 len: 0 microversion: 2.1 time: 0.241236 Oct 18 15:49:17.231751 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2573/5151] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:49:16 2022] DELETE /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:49:17.237748 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7144900b-80b9-490a-bbf5-d14b06fb55bd tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:17.238760 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7144900b-80b9-490a-bbf5-d14b06fb55bd tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 19226472-0c76-46f8-a4ba-7d32931341a2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:17.246066 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7144900b-80b9-490a-bbf5-d14b06fb55bd tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:17.246909 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7144900b-80b9-490a-bbf5-d14b06fb55bd tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:17.249147 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7144900b-80b9-490a-bbf5-d14b06fb55bd tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:17.250251 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7144900b-80b9-490a-bbf5-d14b06fb55bd tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:17.250964 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7144900b-80b9-490a-bbf5-d14b06fb55bd tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:17.252388 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7144900b-80b9-490a-bbf5-d14b06fb55bd tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:17.565225 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-347c6c7b-9e4a-49e8-b7f4-e06b76001777 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d61956417324dc89bca1389bacbd0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0254a3b1a54a9988125e3c09332bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:17.593880 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-347c6c7b-9e4a-49e8-b7f4-e06b76001777 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] 10.222.0.60 "GET /compute/v2.1/servers/b978eea8-e4b6-43a5-8ce7-502ed47f969e" status: 200 len: 1318 microversion: 2.1 time: 0.674565 Oct 18 15:49:17.609945 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2579/5152] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:16 2022] GET /compute/v2.1/servers/b978eea8-e4b6-43a5-8ce7-502ed47f969e => generated 1318 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:49:17.622223 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-75ba6fc7-256b-4ca3-a3a4-80d0d677d131 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:17.626475 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-75ba6fc7-256b-4ca3-a3a4-80d0d677d131 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 9f83bb30-fed3-427f-bdb6-8013f5bc7b29] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:17.641369 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-75ba6fc7-256b-4ca3-a3a4-80d0d677d131 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:17.643831 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-75ba6fc7-256b-4ca3-a3a4-80d0d677d131 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:17.644527 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-75ba6fc7-256b-4ca3-a3a4-80d0d677d131 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:17.646642 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-75ba6fc7-256b-4ca3-a3a4-80d0d677d131 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:17.647311 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-75ba6fc7-256b-4ca3-a3a4-80d0d677d131 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:17.648173 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-75ba6fc7-256b-4ca3-a3a4-80d0d677d131 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:17.824396 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7144900b-80b9-490a-bbf5-d14b06fb55bd tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:17.832395 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7144900b-80b9-490a-bbf5-d14b06fb55bd tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2" status: 200 len: 1522 microversion: 2.1 time: 0.598632 Oct 18 15:49:17.833712 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2574/5153] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:17 2022] GET /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2 => generated 1522 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:49:17.838749 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-79d1ed8f-a8ef-471b-a604-3bf27372ac65 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:17.839687 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-79d1ed8f-a8ef-471b-a604-3bf27372ac65 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 25eb309d-2add-4b63-96b9-f78966b9f3b6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:17.846747 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79d1ed8f-a8ef-471b-a604-3bf27372ac65 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:17.847536 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79d1ed8f-a8ef-471b-a604-3bf27372ac65 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:17.849156 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79d1ed8f-a8ef-471b-a604-3bf27372ac65 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:17.850142 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79d1ed8f-a8ef-471b-a604-3bf27372ac65 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:17.850855 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79d1ed8f-a8ef-471b-a604-3bf27372ac65 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:17.851506 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79d1ed8f-a8ef-471b-a604-3bf27372ac65 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:17.875365 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-79d1ed8f-a8ef-471b-a604-3bf27372ac65 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] HTTP exception thrown: Instance 25eb309d-2add-4b63-96b9-f78966b9f3b6 could not be found. Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-79d1ed8f-a8ef-471b-a604-3bf27372ac65 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Request method failure captured: Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/25eb309d-2add-4b63-96b9-f78966b9f3b6 HTTP/1.1 Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsjnRdctCp-8YpJETZx5RBXsp0tk0P-jTGcQMSIsNH2GEBs8Wg82Po84gRYEjmY4OarQGWuT5THqpHI7_-hfhGBlYj8sHI1l4vQlE5R8BdhWWvvol61i38spuPGOi5m1Vnr-duJeNWVp2-6eOy-UohsCpTw7z-IjZzPv-4bQM_LgFXg Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 2a2cdc778bd54f209d70f5b8703dc068 Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerActionsTestJSON-1828367688 Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2a2cdc778bd54f209d70f5b8703dc068"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2a2cdc778bd54f209d70f5b8703dc068"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2a2cdc778bd54f209d70f5b8703dc068"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2a2cdc778bd54f209d70f5b8703dc068"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServerActionsTestJSON-1828367688 Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 2a2cdc778bd54f209d70f5b8703dc068 Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerActionsTestJSON-1828367688 Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServerActionsTestJSON-1828367688-project Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 2aa0148a4a43466da619ea9843b3f78c Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServerActionsTestJSON-1828367688-project Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 25eb309d-2add-4b63-96b9-f78966b9f3b6 could not be found. Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '25eb309d-2add-4b63-96b9-f78966b9f3b6'} Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25eb309d-2add-4b63-96b9-f78966b9f3b6 could not be found. Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25eb309d-2add-4b63-96b9-f78966b9f3b6 could not be found. Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:49:17.877500 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:49:17.882198 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:49:17.882198 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:49:17.882198 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:49:17.882198 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:49:17.882198 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:49:17.882198 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25eb309d-2add-4b63-96b9-f78966b9f3b6 could not be found. Oct 18 15:49:17.882198 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:49:17.886780 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-79d1ed8f-a8ef-471b-a604-3bf27372ac65 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Returning 404 to user: Instance 25eb309d-2add-4b63-96b9-f78966b9f3b6 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:49:17.887866 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-79d1ed8f-a8ef-471b-a604-3bf27372ac65 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/25eb309d-2add-4b63-96b9-f78966b9f3b6" status: 404 len: 111 microversion: 2.1 time: 0.052680 Oct 18 15:49:17.891904 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2575/5154] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:17 2022] GET /compute/v2.1/servers/25eb309d-2add-4b63-96b9-f78966b9f3b6 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:49:17.898505 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e1bf1373-bd10-43e0-b947-bc237b378dad tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:17.899090 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e1bf1373-bd10-43e0-b947-bc237b378dad tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: e6019a42-1115-4a7b-bfab-badb33cafed8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:17.908412 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e1bf1373-bd10-43e0-b947-bc237b378dad tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:17.912433 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e1bf1373-bd10-43e0-b947-bc237b378dad tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:17.913660 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e1bf1373-bd10-43e0-b947-bc237b378dad tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:17.915987 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e1bf1373-bd10-43e0-b947-bc237b378dad tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:17.917503 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e1bf1373-bd10-43e0-b947-bc237b378dad tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:17.918678 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e1bf1373-bd10-43e0-b947-bc237b378dad tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:17.950658 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e1bf1373-bd10-43e0-b947-bc237b378dad tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: e6019a42-1115-4a7b-bfab-badb33cafed8] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:49:18.088511 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e1bf1373-bd10-43e0-b947-bc237b378dad tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8" status: 204 len: 0 microversion: 2.1 time: 0.194127 Oct 18 15:49:18.092598 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2576/5155] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:49:17 2022] DELETE /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:49:18.099871 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a948751e-7ff3-4503-83c8-669bfda909b3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:18.101101 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a948751e-7ff3-4503-83c8-669bfda909b3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:18.108077 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a948751e-7ff3-4503-83c8-669bfda909b3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:18.109018 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a948751e-7ff3-4503-83c8-669bfda909b3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:18.109858 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a948751e-7ff3-4503-83c8-669bfda909b3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:18.110683 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a948751e-7ff3-4503-83c8-669bfda909b3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:18.112159 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a948751e-7ff3-4503-83c8-669bfda909b3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:18.112902 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a948751e-7ff3-4503-83c8-669bfda909b3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:18.140425 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:18.159419 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-75ba6fc7-256b-4ca3-a3a4-80d0d677d131 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:18.171450 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-75ba6fc7-256b-4ca3-a3a4-80d0d677d131 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/9f83bb30-fed3-427f-bdb6-8013f5bc7b29" status: 200 len: 1500 microversion: 2.1 time: 0.557558 Oct 18 15:49:18.173608 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2580/5156] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:17 2022] GET /compute/v2.1/servers/9f83bb30-fed3-427f-bdb6-8013f5bc7b29 => generated 1500 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:49:18.188455 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-274f990b-f510-4f4a-88ed-abf406e6cb0a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:18.192445 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-274f990b-f510-4f4a-88ed-abf406e6cb0a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: e6019a42-1115-4a7b-bfab-badb33cafed8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:18.209340 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-274f990b-f510-4f4a-88ed-abf406e6cb0a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:18.212908 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-274f990b-f510-4f4a-88ed-abf406e6cb0a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:18.215582 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-274f990b-f510-4f4a-88ed-abf406e6cb0a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:18.216783 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-274f990b-f510-4f4a-88ed-abf406e6cb0a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:18.217508 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-274f990b-f510-4f4a-88ed-abf406e6cb0a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:18.225125 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-274f990b-f510-4f4a-88ed-abf406e6cb0a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:18.576415 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a948751e-7ff3-4503-83c8-669bfda909b3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:18.589532 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a948751e-7ff3-4503-83c8-669bfda909b3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:18.591023 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a948751e-7ff3-4503-83c8-669bfda909b3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:18.592235 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a948751e-7ff3-4503-83c8-669bfda909b3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1720 microversion: 2.20 time: 0.498175 Oct 18 15:49:18.592834 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2577/5157] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:49:18 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1720 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:49:18.614766 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ac404aa2-b8c8-4ae0-82c9-4454cf92f22f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:18.616316 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ac404aa2-b8c8-4ae0-82c9-4454cf92f22f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 9f83bb30-fed3-427f-bdb6-8013f5bc7b29] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:18.625021 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-274f990b-f510-4f4a-88ed-abf406e6cb0a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:18.632964 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:18.641799 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-274f990b-f510-4f4a-88ed-abf406e6cb0a tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8" status: 200 len: 1494 microversion: 2.1 time: 0.466392 Oct 18 15:49:18.643153 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2581/5158] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:18 2022] GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8 => generated 1494 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:49:18.646073 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac404aa2-b8c8-4ae0-82c9-4454cf92f22f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:18.646813 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac404aa2-b8c8-4ae0-82c9-4454cf92f22f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:18.647597 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac404aa2-b8c8-4ae0-82c9-4454cf92f22f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:18.648714 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac404aa2-b8c8-4ae0-82c9-4454cf92f22f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:18.649368 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac404aa2-b8c8-4ae0-82c9-4454cf92f22f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:18.649628 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c3aef24c-52da-4941-9521-0d6771935bcf tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:18.650249 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c3aef24c-52da-4941-9521-0d6771935bcf tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] [instance: b978eea8-e4b6-43a5-8ce7-502ed47f969e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:18.650476 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac404aa2-b8c8-4ae0-82c9-4454cf92f22f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:18.677506 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c3aef24c-52da-4941-9521-0d6771935bcf tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:18.678068 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c3aef24c-52da-4941-9521-0d6771935bcf tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:18.678527 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c3aef24c-52da-4941-9521-0d6771935bcf tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:18.699202 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c3aef24c-52da-4941-9521-0d6771935bcf tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:18.699715 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c3aef24c-52da-4941-9521-0d6771935bcf tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:18.700161 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c3aef24c-52da-4941-9521-0d6771935bcf tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:19.084321 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ac404aa2-b8c8-4ae0-82c9-4454cf92f22f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:19.092490 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ac404aa2-b8c8-4ae0-82c9-4454cf92f22f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/9f83bb30-fed3-427f-bdb6-8013f5bc7b29" status: 200 len: 1500 microversion: 2.1 time: 0.493727 Oct 18 15:49:19.112175 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c3aef24c-52da-4941-9521-0d6771935bcf tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d61956417324dc89bca1389bacbd0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0254a3b1a54a9988125e3c09332bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:19.121499 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c3aef24c-52da-4941-9521-0d6771935bcf tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] 10.222.0.60 "GET /compute/v2.1/servers/b978eea8-e4b6-43a5-8ce7-502ed47f969e" status: 200 len: 1318 microversion: 2.1 time: 0.476987 Oct 18 15:49:19.122020 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2578/5159] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:18 2022] GET /compute/v2.1/servers/9f83bb30-fed3-427f-bdb6-8013f5bc7b29 => generated 1500 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:49:19.127175 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3ab0d546-7ebc-4f09-b567-5fce47ca5ede tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:19.128291 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2582/5160] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:18 2022] GET /compute/v2.1/servers/b978eea8-e4b6-43a5-8ce7-502ed47f969e => generated 1318 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:49:19.133205 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3ab0d546-7ebc-4f09-b567-5fce47ca5ede tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 19226472-0c76-46f8-a4ba-7d32931341a2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:19.137690 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-65689ba9-3961-47ee-97a5-27b41f9e1dfb req-c6b1ef6e-54f1-43ee-8ad7-03608a0e44f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25eb309d-2add-4b63-96b9-f78966b9f3b6", "name": "network-vif-deleted", "tag": "c5682ba2-35a4-41c4-b0c6-b5675c138586"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:49:19.147302 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ab0d546-7ebc-4f09-b567-5fce47ca5ede tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:19.148045 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ab0d546-7ebc-4f09-b567-5fce47ca5ede tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:19.150088 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ab0d546-7ebc-4f09-b567-5fce47ca5ede tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:19.150816 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ab0d546-7ebc-4f09-b567-5fce47ca5ede tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:19.151263 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ab0d546-7ebc-4f09-b567-5fce47ca5ede tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:19.155244 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-65689ba9-3961-47ee-97a5-27b41f9e1dfb req-c6b1ef6e-54f1-43ee-8ad7-03608a0e44f4 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:19.155722 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-65689ba9-3961-47ee-97a5-27b41f9e1dfb req-c6b1ef6e-54f1-43ee-8ad7-03608a0e44f4 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:19.156185 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ab0d546-7ebc-4f09-b567-5fce47ca5ede tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:19.159657 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-65689ba9-3961-47ee-97a5-27b41f9e1dfb req-c6b1ef6e-54f1-43ee-8ad7-03608a0e44f4 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:19.199656 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-65689ba9-3961-47ee-97a5-27b41f9e1dfb req-c6b1ef6e-54f1-43ee-8ad7-03608a0e44f4 service nova] Creating event network-vif-deleted:c5682ba2-35a4-41c4-b0c6-b5675c138586 for instance 25eb309d-2add-4b63-96b9-f78966b9f3b6 on n-h1-853682-5 Oct 18 15:49:19.211738 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-65689ba9-3961-47ee-97a5-27b41f9e1dfb req-c6b1ef6e-54f1-43ee-8ad7-03608a0e44f4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080928 Oct 18 15:49:19.213038 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2583/5161] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:49:19.228975 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ba2f4382-ee6d-4a9d-aff6-8d4afec7d7fc tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:19.229776 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ba2f4382-ee6d-4a9d-aff6-8d4afec7d7fc tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 9f83bb30-fed3-427f-bdb6-8013f5bc7b29] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:19.239450 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba2f4382-ee6d-4a9d-aff6-8d4afec7d7fc tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:19.240353 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba2f4382-ee6d-4a9d-aff6-8d4afec7d7fc tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:19.241165 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba2f4382-ee6d-4a9d-aff6-8d4afec7d7fc tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:19.242157 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba2f4382-ee6d-4a9d-aff6-8d4afec7d7fc tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:19.242843 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba2f4382-ee6d-4a9d-aff6-8d4afec7d7fc tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:19.243520 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba2f4382-ee6d-4a9d-aff6-8d4afec7d7fc tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:19.284601 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ba2f4382-ee6d-4a9d-aff6-8d4afec7d7fc tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 9f83bb30-fed3-427f-bdb6-8013f5bc7b29] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:49:19.434024 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ba2f4382-ee6d-4a9d-aff6-8d4afec7d7fc tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9f83bb30-fed3-427f-bdb6-8013f5bc7b29" status: 204 len: 0 microversion: 2.1 time: 0.219553 Oct 18 15:49:19.434652 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2584/5162] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:49:19 2022] DELETE /compute/v2.1/servers/9f83bb30-fed3-427f-bdb6-8013f5bc7b29 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:49:19.443960 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a5b8a390-6aa1-4822-9f99-afc6aa40eeb1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:19.444955 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a5b8a390-6aa1-4822-9f99-afc6aa40eeb1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 9f83bb30-fed3-427f-bdb6-8013f5bc7b29] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:19.452411 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a5b8a390-6aa1-4822-9f99-afc6aa40eeb1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:19.454497 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a5b8a390-6aa1-4822-9f99-afc6aa40eeb1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:19.457334 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a5b8a390-6aa1-4822-9f99-afc6aa40eeb1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:19.458618 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a5b8a390-6aa1-4822-9f99-afc6aa40eeb1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:19.466535 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a5b8a390-6aa1-4822-9f99-afc6aa40eeb1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:19.467423 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a5b8a390-6aa1-4822-9f99-afc6aa40eeb1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:19.678718 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3ab0d546-7ebc-4f09-b567-5fce47ca5ede tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:19.713609 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3ab0d546-7ebc-4f09-b567-5fce47ca5ede tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2" status: 200 len: 1522 microversion: 2.1 time: 0.590102 Oct 18 15:49:19.714697 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2579/5163] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:19 2022] GET /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2 => generated 1522 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:49:19.719824 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-246ee916-71b9-47e6-89e6-ca5e7b4ebb56 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:19.720688 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-246ee916-71b9-47e6-89e6-ca5e7b4ebb56 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:19.727967 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-246ee916-71b9-47e6-89e6-ca5e7b4ebb56 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:19.728458 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-246ee916-71b9-47e6-89e6-ca5e7b4ebb56 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:19.728950 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-246ee916-71b9-47e6-89e6-ca5e7b4ebb56 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:19.729651 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-246ee916-71b9-47e6-89e6-ca5e7b4ebb56 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:19.730096 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-246ee916-71b9-47e6-89e6-ca5e7b4ebb56 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:19.730511 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-246ee916-71b9-47e6-89e6-ca5e7b4ebb56 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:20.122107 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a5b8a390-6aa1-4822-9f99-afc6aa40eeb1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:20.137655 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a5b8a390-6aa1-4822-9f99-afc6aa40eeb1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/9f83bb30-fed3-427f-bdb6-8013f5bc7b29" status: 200 len: 1506 microversion: 2.1 time: 0.698482 Oct 18 15:49:20.138249 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2585/5164] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:19 2022] GET /compute/v2.1/servers/9f83bb30-fed3-427f-bdb6-8013f5bc7b29 => generated 1506 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:49:20.158532 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-44e32d9d-7e3c-46a6-a7a7-990e97deafa4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:20.158867 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-246ee916-71b9-47e6-89e6-ca5e7b4ebb56 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:20.161212 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-44e32d9d-7e3c-46a6-a7a7-990e97deafa4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: e6019a42-1115-4a7b-bfab-badb33cafed8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:20.174555 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-246ee916-71b9-47e6-89e6-ca5e7b4ebb56 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:20.176869 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-44e32d9d-7e3c-46a6-a7a7-990e97deafa4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:20.182867 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-246ee916-71b9-47e6-89e6-ca5e7b4ebb56 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:20.185437 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-246ee916-71b9-47e6-89e6-ca5e7b4ebb56 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1720 microversion: 2.20 time: 0.469578 Oct 18 15:49:20.197179 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2580/5165] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:49:19 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1720 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:49:20.197433 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-44e32d9d-7e3c-46a6-a7a7-990e97deafa4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:20.197433 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-44e32d9d-7e3c-46a6-a7a7-990e97deafa4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:20.197433 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-44e32d9d-7e3c-46a6-a7a7-990e97deafa4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:20.197433 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-44e32d9d-7e3c-46a6-a7a7-990e97deafa4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:20.197433 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-44e32d9d-7e3c-46a6-a7a7-990e97deafa4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:20.212837 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-75560d5e-fb3e-4b44-b21f-44738be758aa req-8203251a-c139-4d1b-bca9-63919192dfd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bec82f31-03ac-4747-a394-4f38d9886320", "name": "network-vif-plugged", "status": "completed", "tag": "9e4c84c8-12be-4775-b871-e461527e836a"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:49:20.233007 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-75560d5e-fb3e-4b44-b21f-44738be758aa req-8203251a-c139-4d1b-bca9-63919192dfd3 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:20.234468 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-75560d5e-fb3e-4b44-b21f-44738be758aa req-8203251a-c139-4d1b-bca9-63919192dfd3 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:20.234897 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-75560d5e-fb3e-4b44-b21f-44738be758aa req-8203251a-c139-4d1b-bca9-63919192dfd3 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:20.257788 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-75560d5e-fb3e-4b44-b21f-44738be758aa req-8203251a-c139-4d1b-bca9-63919192dfd3 service nova] Creating event network-vif-plugged:9e4c84c8-12be-4775-b871-e461527e836a for instance bec82f31-03ac-4747-a394-4f38d9886320 on n-h1-853682-5 Oct 18 15:49:20.263430 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-75560d5e-fb3e-4b44-b21f-44738be758aa req-8203251a-c139-4d1b-bca9-63919192dfd3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073896 Oct 18 15:49:20.264727 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2581/5166] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:49:20.275427 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-690fd50b-ddbc-48ad-bd21-b47d3a14a2f2 req-145fe604-b135-440a-81fc-d8834a060b5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6019a42-1115-4a7b-bfab-badb33cafed8", "name": "network-vif-deleted", "tag": "ff5f4986-3641-402a-91e4-0dc5291f11fe"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:49:20.290897 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-690fd50b-ddbc-48ad-bd21-b47d3a14a2f2 req-145fe604-b135-440a-81fc-d8834a060b5e service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:20.291488 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-690fd50b-ddbc-48ad-bd21-b47d3a14a2f2 req-145fe604-b135-440a-81fc-d8834a060b5e service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:20.292070 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-690fd50b-ddbc-48ad-bd21-b47d3a14a2f2 req-145fe604-b135-440a-81fc-d8834a060b5e service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:20.296257 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-44e32d9d-7e3c-46a6-a7a7-990e97deafa4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:20.304982 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-44e32d9d-7e3c-46a6-a7a7-990e97deafa4 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8" status: 200 len: 1452 microversion: 2.1 time: 0.151094 Oct 18 15:49:20.319248 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2586/5167] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:20 2022] GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8 => generated 1452 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:49:20.319479 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-690fd50b-ddbc-48ad-bd21-b47d3a14a2f2 req-145fe604-b135-440a-81fc-d8834a060b5e service nova] Creating event network-vif-deleted:ff5f4986-3641-402a-91e4-0dc5291f11fe for instance e6019a42-1115-4a7b-bfab-badb33cafed8 on n-h1-853682-5 Oct 18 15:49:20.327285 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-690fd50b-ddbc-48ad-bd21-b47d3a14a2f2 req-145fe604-b135-440a-81fc-d8834a060b5e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053799 Oct 18 15:49:20.327285 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2582/5168] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:49:20.335108 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4d3071c2-67b3-4fa5-99b5-9ea53cef3c53 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:20.336055 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4d3071c2-67b3-4fa5-99b5-9ea53cef3c53 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] [instance: b978eea8-e4b6-43a5-8ce7-502ed47f969e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:20.346437 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4d3071c2-67b3-4fa5-99b5-9ea53cef3c53 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:20.349713 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4d3071c2-67b3-4fa5-99b5-9ea53cef3c53 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:20.351214 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4d3071c2-67b3-4fa5-99b5-9ea53cef3c53 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:20.352604 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4d3071c2-67b3-4fa5-99b5-9ea53cef3c53 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:20.353310 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4d3071c2-67b3-4fa5-99b5-9ea53cef3c53 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:20.354394 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4d3071c2-67b3-4fa5-99b5-9ea53cef3c53 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:20.752536 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4d3071c2-67b3-4fa5-99b5-9ea53cef3c53 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d61956417324dc89bca1389bacbd0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0254a3b1a54a9988125e3c09332bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:20.769849 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4d3071c2-67b3-4fa5-99b5-9ea53cef3c53 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] 10.222.0.60 "GET /compute/v2.1/servers/b978eea8-e4b6-43a5-8ce7-502ed47f969e" status: 200 len: 1318 microversion: 2.1 time: 0.462048 Oct 18 15:49:20.770517 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2587/5169] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:20 2022] GET /compute/v2.1/servers/b978eea8-e4b6-43a5-8ce7-502ed47f969e => generated 1318 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:49:20.783850 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c75620bd-52be-47cf-a46d-39ea5972cc9d tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:20.786011 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c75620bd-52be-47cf-a46d-39ea5972cc9d tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 19226472-0c76-46f8-a4ba-7d32931341a2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:20.815044 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c75620bd-52be-47cf-a46d-39ea5972cc9d tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:20.815534 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c75620bd-52be-47cf-a46d-39ea5972cc9d tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:20.836113 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c75620bd-52be-47cf-a46d-39ea5972cc9d tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:20.840157 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c75620bd-52be-47cf-a46d-39ea5972cc9d tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:20.841098 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c75620bd-52be-47cf-a46d-39ea5972cc9d tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:20.844261 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c75620bd-52be-47cf-a46d-39ea5972cc9d tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:20.989057 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c75620bd-52be-47cf-a46d-39ea5972cc9d tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fb4652c164c1dab5672d33d9fb295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224ca1f734c14bc8bf31e1826faf8e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:21.004154 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c75620bd-52be-47cf-a46d-39ea5972cc9d tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2" status: 200 len: 1480 microversion: 2.1 time: 0.265503 Oct 18 15:49:21.004752 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2583/5170] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:20 2022] GET /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2 => generated 1480 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:49:21.166339 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-27746c9c-ec5d-4190-a97f-d36552572c04 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:21.166957 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-27746c9c-ec5d-4190-a97f-d36552572c04 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 9f83bb30-fed3-427f-bdb6-8013f5bc7b29] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:21.182666 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-27746c9c-ec5d-4190-a97f-d36552572c04 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:21.183509 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-27746c9c-ec5d-4190-a97f-d36552572c04 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:21.184362 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-27746c9c-ec5d-4190-a97f-d36552572c04 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:21.185431 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-27746c9c-ec5d-4190-a97f-d36552572c04 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:21.186166 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-27746c9c-ec5d-4190-a97f-d36552572c04 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:21.186912 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-27746c9c-ec5d-4190-a97f-d36552572c04 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:21.230021 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-549e4e45-422d-4139-981a-77fa6da78777 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:21.230837 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-549e4e45-422d-4139-981a-77fa6da78777 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:21.244529 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-549e4e45-422d-4139-981a-77fa6da78777 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:21.245544 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-549e4e45-422d-4139-981a-77fa6da78777 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:21.248100 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-549e4e45-422d-4139-981a-77fa6da78777 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:21.249083 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-549e4e45-422d-4139-981a-77fa6da78777 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:21.249748 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-549e4e45-422d-4139-981a-77fa6da78777 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:21.250896 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-549e4e45-422d-4139-981a-77fa6da78777 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:21.712465 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-549e4e45-422d-4139-981a-77fa6da78777 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:21.722623 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-549e4e45-422d-4139-981a-77fa6da78777 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:21.724071 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-549e4e45-422d-4139-981a-77fa6da78777 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:21.725307 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-549e4e45-422d-4139-981a-77fa6da78777 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1720 microversion: 2.20 time: 0.499228 Oct 18 15:49:21.747454 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2584/5171] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:49:21 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1720 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:49:21.758521 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-88e64f7c-df40-4120-b892-451cb3c73402 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:21.761476 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-88e64f7c-df40-4120-b892-451cb3c73402 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: e6019a42-1115-4a7b-bfab-badb33cafed8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:21.771949 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88e64f7c-df40-4120-b892-451cb3c73402 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:21.776965 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-27746c9c-ec5d-4190-a97f-d36552572c04 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:21.779130 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88e64f7c-df40-4120-b892-451cb3c73402 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:21.780229 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88e64f7c-df40-4120-b892-451cb3c73402 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:21.785122 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-27746c9c-ec5d-4190-a97f-d36552572c04 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/9f83bb30-fed3-427f-bdb6-8013f5bc7b29" status: 200 len: 1506 microversion: 2.1 time: 0.622719 Oct 18 15:49:21.785339 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88e64f7c-df40-4120-b892-451cb3c73402 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:21.788481 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88e64f7c-df40-4120-b892-451cb3c73402 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:21.789228 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88e64f7c-df40-4120-b892-451cb3c73402 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:21.808983 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2588/5172] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:21 2022] GET /compute/v2.1/servers/9f83bb30-fed3-427f-bdb6-8013f5bc7b29 => generated 1506 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:49:21.824566 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-44cb2d0d-82a9-41dc-b467-a5493f4b8448 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:21.827800 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-44cb2d0d-82a9-41dc-b467-a5493f4b8448 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] [instance: b978eea8-e4b6-43a5-8ce7-502ed47f969e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:21.844505 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-44cb2d0d-82a9-41dc-b467-a5493f4b8448 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:21.845189 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88e64f7c-df40-4120-b892-451cb3c73402 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:21.845873 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88e64f7c-df40-4120-b892-451cb3c73402 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:21.846626 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-44cb2d0d-82a9-41dc-b467-a5493f4b8448 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:21.846856 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88e64f7c-df40-4120-b892-451cb3c73402 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:21.847081 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-44cb2d0d-82a9-41dc-b467-a5493f4b8448 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:21.847696 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-88e64f7c-df40-4120-b892-451cb3c73402 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lazy-loading 'fault' on Instance uuid e6019a42-1115-4a7b-bfab-badb33cafed8 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:49:21.847835 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-44cb2d0d-82a9-41dc-b467-a5493f4b8448 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:21.848295 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-44cb2d0d-82a9-41dc-b467-a5493f4b8448 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:21.853300 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-44cb2d0d-82a9-41dc-b467-a5493f4b8448 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:22.380991 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-88e64f7c-df40-4120-b892-451cb3c73402 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:22.400000 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-88e64f7c-df40-4120-b892-451cb3c73402 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8" status: 200 len: 1303 microversion: 2.1 time: 0.648900 Oct 18 15:49:22.418258 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2585/5173] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:21 2022] GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8 => generated 1303 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:49:22.424447 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-776e1df8-24af-430d-997c-5f6e7230bb77 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:22.425492 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-776e1df8-24af-430d-997c-5f6e7230bb77 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] [instance: 19226472-0c76-46f8-a4ba-7d32931341a2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:22.438286 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-776e1df8-24af-430d-997c-5f6e7230bb77 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:22.439085 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-776e1df8-24af-430d-997c-5f6e7230bb77 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:22.439751 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-776e1df8-24af-430d-997c-5f6e7230bb77 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:22.440828 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-776e1df8-24af-430d-997c-5f6e7230bb77 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:22.441851 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-776e1df8-24af-430d-997c-5f6e7230bb77 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:22.446332 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-776e1df8-24af-430d-997c-5f6e7230bb77 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:22.486851 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-776e1df8-24af-430d-997c-5f6e7230bb77 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] HTTP exception thrown: Instance 19226472-0c76-46f8-a4ba-7d32931341a2 could not be found. Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-776e1df8-24af-430d-997c-5f6e7230bb77 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Request method failure captured: Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2 HTTP/1.1 Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsmOlfJjna__aWkkHZgCFMOd2DpNqn_dr-IEPGuxkqNqAVs7tN5T268nd09vhRJnPU2g5DJC-yqBSq_x2HTDX86g3yOFixR2PbozSJNAuQoWzOe1hqzQDBztCsy4gcfQ635XTPjGuAISQPn4_b-3rgJ6h45QPHOVHclQC7dNdVcnHno Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 224ca1f734c14bc8bf31e1826faf8e71 Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1233761615 Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/224ca1f734c14bc8bf31e1826faf8e71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/224ca1f734c14bc8bf31e1826faf8e71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/224ca1f734c14bc8bf31e1826faf8e71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_224ca1f734c14bc8bf31e1826faf8e71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1233761615 Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 224ca1f734c14bc8bf31e1826faf8e71 Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1233761615 Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServerRescueNegativeTestJSON-1233761615-project Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 646fb4652c164c1dab5672d33d9fb295 Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1233761615-project Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 19226472-0c76-46f8-a4ba-7d32931341a2 could not be found. Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '19226472-0c76-46f8-a4ba-7d32931341a2'} Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19226472-0c76-46f8-a4ba-7d32931341a2 could not be found. Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19226472-0c76-46f8-a4ba-7d32931341a2 could not be found. Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:49:22.489598 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:49:22.494662 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:49:22.494662 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:49:22.494662 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:49:22.494662 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:49:22.494662 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:49:22.494662 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:49:22.494662 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19226472-0c76-46f8-a4ba-7d32931341a2 could not be found. Oct 18 15:49:22.494662 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:49:22.494662 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-776e1df8-24af-430d-997c-5f6e7230bb77 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] Returning 404 to user: Instance 19226472-0c76-46f8-a4ba-7d32931341a2 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:49:22.495419 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-776e1df8-24af-430d-997c-5f6e7230bb77 tempest-ServerRescueNegativeTestJSON-1233761615 tempest-ServerRescueNegativeTestJSON-1233761615-project] 10.222.0.60 "GET /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2" status: 404 len: 111 microversion: 2.1 time: 0.074281 Oct 18 15:49:22.496314 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2586/5174] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:22 2022] GET /compute/v2.1/servers/19226472-0c76-46f8-a4ba-7d32931341a2 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:49:22.501802 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-a6da0717-2034-4126-aabd-aa47344a4e75 req-83402f74-d908-435b-8d54-57a6468d6970 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b978eea8-e4b6-43a5-8ce7-502ed47f969e", "name": "network-vif-plugged", "status": "completed", "tag": "286c3437-f206-44a0-b5cb-bfe6e1d8011d"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:49:22.517602 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a6da0717-2034-4126-aabd-aa47344a4e75 req-83402f74-d908-435b-8d54-57a6468d6970 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:22.518607 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a6da0717-2034-4126-aabd-aa47344a4e75 req-83402f74-d908-435b-8d54-57a6468d6970 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:22.520188 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a6da0717-2034-4126-aabd-aa47344a4e75 req-83402f74-d908-435b-8d54-57a6468d6970 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:22.539864 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-a6da0717-2034-4126-aabd-aa47344a4e75 req-83402f74-d908-435b-8d54-57a6468d6970 service nova] Creating event network-vif-plugged:286c3437-f206-44a0-b5cb-bfe6e1d8011d for instance b978eea8-e4b6-43a5-8ce7-502ed47f969e on n-h2-853682-5 Oct 18 15:49:22.547961 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-a6da0717-2034-4126-aabd-aa47344a4e75 req-83402f74-d908-435b-8d54-57a6468d6970 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049719 Oct 18 15:49:22.549275 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2587/5175] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:49:22.558384 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-1e1bcd5c-d44d-4d1a-aa24-b44ce6a442ce req-1a028cf4-f771-4376-b3f6-38d20b6b50ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19226472-0c76-46f8-a4ba-7d32931341a2", "name": "network-vif-deleted", "tag": "b7515f7b-6a3a-4506-9e92-d62882ce4d5f"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:49:22.573128 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1e1bcd5c-d44d-4d1a-aa24-b44ce6a442ce req-1a028cf4-f771-4376-b3f6-38d20b6b50ce service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:22.574687 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1e1bcd5c-d44d-4d1a-aa24-b44ce6a442ce req-1a028cf4-f771-4376-b3f6-38d20b6b50ce service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:22.575288 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1e1bcd5c-d44d-4d1a-aa24-b44ce6a442ce req-1a028cf4-f771-4376-b3f6-38d20b6b50ce service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:22.590903 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-1e1bcd5c-d44d-4d1a-aa24-b44ce6a442ce req-1a028cf4-f771-4376-b3f6-38d20b6b50ce service nova] Creating event network-vif-deleted:b7515f7b-6a3a-4506-9e92-d62882ce4d5f for instance 19226472-0c76-46f8-a4ba-7d32931341a2 on n-h2-853682-5 Oct 18 15:49:22.598657 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-1e1bcd5c-d44d-4d1a-aa24-b44ce6a442ce req-1a028cf4-f771-4376-b3f6-38d20b6b50ce service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046932 Oct 18 15:49:22.599773 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2588/5176] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:49:22.739742 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-44cb2d0d-82a9-41dc-b467-a5493f4b8448 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d61956417324dc89bca1389bacbd0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0254a3b1a54a9988125e3c09332bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:22.751479 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5ccb4dd1-d698-47a9-8e79-04170db61da8 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:22.752189 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5ccb4dd1-d698-47a9-8e79-04170db61da8 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:22.776186 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-44cb2d0d-82a9-41dc-b467-a5493f4b8448 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] 10.222.0.60 "GET /compute/v2.1/servers/b978eea8-e4b6-43a5-8ce7-502ed47f969e" status: 200 len: 1318 microversion: 2.1 time: 0.964378 Oct 18 15:49:22.804246 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ccb4dd1-d698-47a9-8e79-04170db61da8 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:22.804874 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2589/5177] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:21 2022] GET /compute/v2.1/servers/b978eea8-e4b6-43a5-8ce7-502ed47f969e => generated 1318 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:49:22.810777 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ccb4dd1-d698-47a9-8e79-04170db61da8 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:22.811953 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ccb4dd1-d698-47a9-8e79-04170db61da8 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:22.812979 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ccb4dd1-d698-47a9-8e79-04170db61da8 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:22.814142 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ccb4dd1-d698-47a9-8e79-04170db61da8 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:22.815224 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-800c69e0-87c5-4f02-957a-7a8d32a866ae tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:22.817792 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ccb4dd1-d698-47a9-8e79-04170db61da8 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:22.823453 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-800c69e0-87c5-4f02-957a-7a8d32a866ae tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 9f83bb30-fed3-427f-bdb6-8013f5bc7b29] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:22.830582 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-800c69e0-87c5-4f02-957a-7a8d32a866ae tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:22.831379 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-800c69e0-87c5-4f02-957a-7a8d32a866ae tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:22.832026 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-800c69e0-87c5-4f02-957a-7a8d32a866ae tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:22.833197 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-800c69e0-87c5-4f02-957a-7a8d32a866ae tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:22.834471 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-800c69e0-87c5-4f02-957a-7a8d32a866ae tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:22.835120 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-800c69e0-87c5-4f02-957a-7a8d32a866ae tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:23.333318 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-800c69e0-87c5-4f02-957a-7a8d32a866ae tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:23.345555 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-800c69e0-87c5-4f02-957a-7a8d32a866ae tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/9f83bb30-fed3-427f-bdb6-8013f5bc7b29" status: 200 len: 1506 microversion: 2.1 time: 0.539151 Oct 18 15:49:23.346478 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2590/5178] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:22 2022] GET /compute/v2.1/servers/9f83bb30-fed3-427f-bdb6-8013f5bc7b29 => generated 1506 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:49:23.359583 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5ccb4dd1-d698-47a9-8e79-04170db61da8 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:23.365689 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5ccb4dd1-d698-47a9-8e79-04170db61da8 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:23.371719 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5ccb4dd1-d698-47a9-8e79-04170db61da8 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:23.380602 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5ccb4dd1-d698-47a9-8e79-04170db61da8 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1720 microversion: 2.20 time: 0.633748 Oct 18 15:49:23.381761 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2589/5179] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:49:22 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1720 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:49:23.427548 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bb57cffc-9ef8-4fbf-84a1-cfbb46e09f3d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:23.428605 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-bb57cffc-9ef8-4fbf-84a1-cfbb46e09f3d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: e6019a42-1115-4a7b-bfab-badb33cafed8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:23.447236 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bb57cffc-9ef8-4fbf-84a1-cfbb46e09f3d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:23.447835 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bb57cffc-9ef8-4fbf-84a1-cfbb46e09f3d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:23.448378 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bb57cffc-9ef8-4fbf-84a1-cfbb46e09f3d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:23.449660 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bb57cffc-9ef8-4fbf-84a1-cfbb46e09f3d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:23.450362 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bb57cffc-9ef8-4fbf-84a1-cfbb46e09f3d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:23.450877 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bb57cffc-9ef8-4fbf-84a1-cfbb46e09f3d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:23.468916 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-bb57cffc-9ef8-4fbf-84a1-cfbb46e09f3d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] HTTP exception thrown: Instance e6019a42-1115-4a7b-bfab-badb33cafed8 could not be found. Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bb57cffc-9ef8-4fbf-84a1-cfbb46e09f3d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Request method failure captured: Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8 HTTP/1.1 Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsjnRdctCp-8YpJETZx5RBXsp0tk0P-jTGcQMSIsNH2GEBs8Wg82Po84gRYEjmY4OarQGWuT5THqpHI7_-hfhGBlYj8sHI1l4vQlE5R8BdhWWvvol61i38spuPGOi5m1Vnr-duJeNWVp2-6eOy-UohsCpTw7z-IjZzPv-4bQM_LgFXg Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 2a2cdc778bd54f209d70f5b8703dc068 Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServerActionsTestJSON-1828367688 Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2a2cdc778bd54f209d70f5b8703dc068"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2a2cdc778bd54f209d70f5b8703dc068"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2a2cdc778bd54f209d70f5b8703dc068"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2a2cdc778bd54f209d70f5b8703dc068"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServerActionsTestJSON-1828367688 Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 2a2cdc778bd54f209d70f5b8703dc068 Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServerActionsTestJSON-1828367688 Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServerActionsTestJSON-1828367688-project Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 2aa0148a4a43466da619ea9843b3f78c Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServerActionsTestJSON-1828367688-project Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance e6019a42-1115-4a7b-bfab-badb33cafed8 could not be found. Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'e6019a42-1115-4a7b-bfab-badb33cafed8'} Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6019a42-1115-4a7b-bfab-badb33cafed8 could not be found. Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6019a42-1115-4a7b-bfab-badb33cafed8 could not be found. Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:49:23.470964 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:49:23.476489 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:49:23.476489 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:49:23.476489 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:49:23.476489 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:49:23.476489 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:49:23.476489 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6019a42-1115-4a7b-bfab-badb33cafed8 could not be found. Oct 18 15:49:23.476489 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:49:23.476489 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bb57cffc-9ef8-4fbf-84a1-cfbb46e09f3d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Returning 404 to user: Instance e6019a42-1115-4a7b-bfab-badb33cafed8 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:49:23.477887 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-bb57cffc-9ef8-4fbf-84a1-cfbb46e09f3d tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8" status: 404 len: 111 microversion: 2.1 time: 0.053946 Oct 18 15:49:23.478917 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2591/5180] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:23 2022] GET /compute/v2.1/servers/e6019a42-1115-4a7b-bfab-badb33cafed8 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:49:23.487065 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a1a156e1-d7fd-4258-8cb7-0d9d873ce109 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:23.488247 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a1a156e1-d7fd-4258-8cb7-0d9d873ce109 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:23.498646 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1a156e1-d7fd-4258-8cb7-0d9d873ce109 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:23.501503 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1a156e1-d7fd-4258-8cb7-0d9d873ce109 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:23.502184 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1a156e1-d7fd-4258-8cb7-0d9d873ce109 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:23.512101 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1a156e1-d7fd-4258-8cb7-0d9d873ce109 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:23.512608 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1a156e1-d7fd-4258-8cb7-0d9d873ce109 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:23.513092 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1a156e1-d7fd-4258-8cb7-0d9d873ce109 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:23.561894 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a1a156e1-d7fd-4258-8cb7-0d9d873ce109 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:49:23.662986 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a1a156e1-d7fd-4258-8cb7-0d9d873ce109 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "DELETE /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 204 len: 0 microversion: 2.1 time: 0.179043 Oct 18 15:49:23.663411 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2590/5181] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:49:23 2022] DELETE /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 15:49:23.674131 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3996ebb5-c223-49bd-b230-23bba951d61e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:23.676778 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3996ebb5-c223-49bd-b230-23bba951d61e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:23.689471 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3996ebb5-c223-49bd-b230-23bba951d61e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:23.689980 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3996ebb5-c223-49bd-b230-23bba951d61e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:23.690423 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3996ebb5-c223-49bd-b230-23bba951d61e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:23.691192 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3996ebb5-c223-49bd-b230-23bba951d61e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:23.691657 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3996ebb5-c223-49bd-b230-23bba951d61e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:23.692089 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3996ebb5-c223-49bd-b230-23bba951d61e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:23.810862 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6cbab7fd-09b2-4566-8196-d2fa1efff316 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:23.811584 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6cbab7fd-09b2-4566-8196-d2fa1efff316 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] [instance: b978eea8-e4b6-43a5-8ce7-502ed47f969e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:23.822450 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6cbab7fd-09b2-4566-8196-d2fa1efff316 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:23.829569 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6cbab7fd-09b2-4566-8196-d2fa1efff316 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:23.830021 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6cbab7fd-09b2-4566-8196-d2fa1efff316 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:23.830806 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6cbab7fd-09b2-4566-8196-d2fa1efff316 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:23.831264 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6cbab7fd-09b2-4566-8196-d2fa1efff316 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:23.831694 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6cbab7fd-09b2-4566-8196-d2fa1efff316 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:23.910420 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3996ebb5-c223-49bd-b230-23bba951d61e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:23.910420 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3996ebb5-c223-49bd-b230-23bba951d61e tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1677 microversion: 2.1 time: 0.238369 Oct 18 15:49:23.910420 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2592/5182] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:23 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1677 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:49:24.025428 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6cbab7fd-09b2-4566-8196-d2fa1efff316 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d61956417324dc89bca1389bacbd0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0254a3b1a54a9988125e3c09332bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:24.033975 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6cbab7fd-09b2-4566-8196-d2fa1efff316 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] 10.222.0.60 "GET /compute/v2.1/servers/b978eea8-e4b6-43a5-8ce7-502ed47f969e" status: 200 len: 1318 microversion: 2.1 time: 0.227539 Oct 18 15:49:24.056215 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2591/5183] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:23 2022] GET /compute/v2.1/servers/b978eea8-e4b6-43a5-8ce7-502ed47f969e => generated 1318 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:49:24.374017 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b00bbcca-b82e-422f-87a1-60239d58e7b5 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:24.374730 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b00bbcca-b82e-422f-87a1-60239d58e7b5 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 9f83bb30-fed3-427f-bdb6-8013f5bc7b29] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:24.382507 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b00bbcca-b82e-422f-87a1-60239d58e7b5 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:24.383186 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b00bbcca-b82e-422f-87a1-60239d58e7b5 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:24.384789 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b00bbcca-b82e-422f-87a1-60239d58e7b5 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:24.385599 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b00bbcca-b82e-422f-87a1-60239d58e7b5 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:24.386375 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b00bbcca-b82e-422f-87a1-60239d58e7b5 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:24.386959 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b00bbcca-b82e-422f-87a1-60239d58e7b5 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:24.408502 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8ac7a626-c4c3-40ff-947c-ce38a3eda83b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:24.409220 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8ac7a626-c4c3-40ff-947c-ce38a3eda83b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:24.420406 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ac7a626-c4c3-40ff-947c-ce38a3eda83b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:24.420937 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ac7a626-c4c3-40ff-947c-ce38a3eda83b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:24.423579 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ac7a626-c4c3-40ff-947c-ce38a3eda83b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:24.426239 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ac7a626-c4c3-40ff-947c-ce38a3eda83b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:24.426777 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ac7a626-c4c3-40ff-947c-ce38a3eda83b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:24.433601 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ac7a626-c4c3-40ff-947c-ce38a3eda83b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:24.440381 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b00bbcca-b82e-422f-87a1-60239d58e7b5 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:24.441100 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b00bbcca-b82e-422f-87a1-60239d58e7b5 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:24.442158 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b00bbcca-b82e-422f-87a1-60239d58e7b5 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:24.442792 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-b00bbcca-b82e-422f-87a1-60239d58e7b5 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lazy-loading 'fault' on Instance uuid 9f83bb30-fed3-427f-bdb6-8013f5bc7b29 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:49:24.550286 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b00bbcca-b82e-422f-87a1-60239d58e7b5 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:24.568180 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b00bbcca-b82e-422f-87a1-60239d58e7b5 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/9f83bb30-fed3-427f-bdb6-8013f5bc7b29" status: 200 len: 1309 microversion: 2.1 time: 0.196355 Oct 18 15:49:24.573716 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2593/5184] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:24 2022] GET /compute/v2.1/servers/9f83bb30-fed3-427f-bdb6-8013f5bc7b29 => generated 1309 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:49:24.651096 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-fc41c91f-ba33-4c3a-aa54-3a9e049057fc req-0e0b9a30-9cb5-4de5-9cf4-0f3371a1a643 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f83bb30-fed3-427f-bdb6-8013f5bc7b29", "name": "network-vif-deleted", "tag": "aa03188b-a4e8-48ce-bc92-96127d0e3784"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:49:24.663016 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-fc41c91f-ba33-4c3a-aa54-3a9e049057fc req-0e0b9a30-9cb5-4de5-9cf4-0f3371a1a643 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:24.663571 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-fc41c91f-ba33-4c3a-aa54-3a9e049057fc req-0e0b9a30-9cb5-4de5-9cf4-0f3371a1a643 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:24.664068 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-fc41c91f-ba33-4c3a-aa54-3a9e049057fc req-0e0b9a30-9cb5-4de5-9cf4-0f3371a1a643 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:24.677728 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-fc41c91f-ba33-4c3a-aa54-3a9e049057fc req-0e0b9a30-9cb5-4de5-9cf4-0f3371a1a643 service nova] Creating event network-vif-deleted:aa03188b-a4e8-48ce-bc92-96127d0e3784 for instance 9f83bb30-fed3-427f-bdb6-8013f5bc7b29 on n-h1-853682-5 Oct 18 15:49:24.684750 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-fc41c91f-ba33-4c3a-aa54-3a9e049057fc req-0e0b9a30-9cb5-4de5-9cf4-0f3371a1a643 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038135 Oct 18 15:49:24.686065 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2594/5185] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:49:24.846581 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8ac7a626-c4c3-40ff-947c-ce38a3eda83b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:24.870470 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8ac7a626-c4c3-40ff-947c-ce38a3eda83b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:24.877108 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8ac7a626-c4c3-40ff-947c-ce38a3eda83b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:24.879403 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8ac7a626-c4c3-40ff-947c-ce38a3eda83b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1720 microversion: 2.20 time: 0.474362 Oct 18 15:49:24.901707 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2592/5186] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:49:24 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1720 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:49:24.935879 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0f3906c2-8f43-429f-9cea-2683f9b2181f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:24.936684 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0f3906c2-8f43-429f-9cea-2683f9b2181f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:24.945947 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0f3906c2-8f43-429f-9cea-2683f9b2181f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:24.946452 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0f3906c2-8f43-429f-9cea-2683f9b2181f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:24.946889 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0f3906c2-8f43-429f-9cea-2683f9b2181f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:24.947606 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0f3906c2-8f43-429f-9cea-2683f9b2181f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:24.948065 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0f3906c2-8f43-429f-9cea-2683f9b2181f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:24.948489 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0f3906c2-8f43-429f-9cea-2683f9b2181f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:25.060769 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-008f72b7-5a66-403a-a339-a762f6a4f60b tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:25.061418 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-008f72b7-5a66-403a-a339-a762f6a4f60b tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] [instance: b978eea8-e4b6-43a5-8ce7-502ed47f969e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:25.065440 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:25.069708 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-008f72b7-5a66-403a-a339-a762f6a4f60b tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:25.070211 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-008f72b7-5a66-403a-a339-a762f6a4f60b tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:25.070914 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-008f72b7-5a66-403a-a339-a762f6a4f60b tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:25.071705 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-008f72b7-5a66-403a-a339-a762f6a4f60b tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:25.072301 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-008f72b7-5a66-403a-a339-a762f6a4f60b tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:25.072960 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-008f72b7-5a66-403a-a339-a762f6a4f60b tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:25.491826 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0f3906c2-8f43-429f-9cea-2683f9b2181f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:25.503354 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0f3906c2-8f43-429f-9cea-2683f9b2181f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1677 microversion: 2.1 time: 0.569160 Oct 18 15:49:25.505646 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2595/5187] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:24 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1677 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:49:25.596084 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b7e5d5ae-8e2b-432d-b9da-26f4a3f9e640 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:25.596653 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b7e5d5ae-8e2b-432d-b9da-26f4a3f9e640 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 9f83bb30-fed3-427f-bdb6-8013f5bc7b29] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:25.609195 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b7e5d5ae-8e2b-432d-b9da-26f4a3f9e640 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:25.609905 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b7e5d5ae-8e2b-432d-b9da-26f4a3f9e640 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:25.611138 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b7e5d5ae-8e2b-432d-b9da-26f4a3f9e640 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:25.611938 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b7e5d5ae-8e2b-432d-b9da-26f4a3f9e640 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:25.612577 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b7e5d5ae-8e2b-432d-b9da-26f4a3f9e640 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:25.613248 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b7e5d5ae-8e2b-432d-b9da-26f4a3f9e640 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:25.656175 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-b7e5d5ae-8e2b-432d-b9da-26f4a3f9e640 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] HTTP exception thrown: Instance 9f83bb30-fed3-427f-bdb6-8013f5bc7b29 could not be found. Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b7e5d5ae-8e2b-432d-b9da-26f4a3f9e640 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Request method failure captured: Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/9f83bb30-fed3-427f-bdb6-8013f5bc7b29 HTTP/1.1 Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsrEJhXnu9-kA1ME2ZgtL01L1ZZn_p1cwLPkqNlVzGclz5bmzyyOf2BB4P7wVe6-U6KsqFzM-iyEynyHjx99j1zL9TNO9M1_0gjdhVd46w55yQ-UymJhYbErDED9EKpU_GJnghtBqaCd9UvgTeTf4e4PvQGeOp69vMSi60uoNlhyAmg Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: afdb1e8b478f463987ec223f2d10db33 Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServersTestJSON-126042862 Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServersTestJSON-126042862 Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: afdb1e8b478f463987ec223f2d10db33 Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServersTestJSON-126042862 Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServersTestJSON-126042862-project Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 73f4ee2e7ff34dd88b9b82fefbf06a36 Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServersTestJSON-126042862-project Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 9f83bb30-fed3-427f-bdb6-8013f5bc7b29 could not be found. Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '9f83bb30-fed3-427f-bdb6-8013f5bc7b29'} Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f83bb30-fed3-427f-bdb6-8013f5bc7b29 could not be found. Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f83bb30-fed3-427f-bdb6-8013f5bc7b29 could not be found. Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:49:25.658545 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:49:25.665399 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:49:25.665399 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:49:25.665399 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:49:25.665399 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:49:25.665399 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f83bb30-fed3-427f-bdb6-8013f5bc7b29 could not be found. Oct 18 15:49:25.665399 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:49:25.669311 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b7e5d5ae-8e2b-432d-b9da-26f4a3f9e640 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Returning 404 to user: Instance 9f83bb30-fed3-427f-bdb6-8013f5bc7b29 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:49:25.669813 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b7e5d5ae-8e2b-432d-b9da-26f4a3f9e640 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/9f83bb30-fed3-427f-bdb6-8013f5bc7b29" status: 404 len: 111 microversion: 2.1 time: 0.077164 Oct 18 15:49:25.698803 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2596/5188] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:25 2022] GET /compute/v2.1/servers/9f83bb30-fed3-427f-bdb6-8013f5bc7b29 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:49:25.704608 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ecf80dfb-e33e-41fb-9487-710d197fcdbd tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Action: 'create', calling method: .version_select at 0x7f7c3c4e90d0>, body: {"keypair": {"name": "tempest-key-300304664", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGPNhOO35GR5V1379Iida/m0FuldoVGhB6m/Rsq1lXNjDk4lUBL9DDmpx/XEpkf0hD3qvoa3wxvTDSN3cmE6WnBn6lG4NP8fjRlwAIL3mwhqWLhZSG5cQ41yj7MJUy2XhA=="}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:49:25.714721 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-008f72b7-5a66-403a-a339-a762f6a4f60b tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d61956417324dc89bca1389bacbd0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0254a3b1a54a9988125e3c09332bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:25.725190 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-008f72b7-5a66-403a-a339-a762f6a4f60b tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] 10.222.0.60 "GET /compute/v2.1/servers/b978eea8-e4b6-43a5-8ce7-502ed47f969e" status: 200 len: 1505 microversion: 2.1 time: 0.670368 Oct 18 15:49:25.737280 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2593/5189] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:25 2022] GET /compute/v2.1/servers/b978eea8-e4b6-43a5-8ce7-502ed47f969e => generated 1505 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:49:25.746528 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-ecf80dfb-e33e-41fb-9487-710d197fcdbd tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Getting quotas for project afdb1e8b478f463987ec223f2d10db33. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:49:25.767803 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5d579ad2-6eb1-484e-958e-73b70b8efbd5 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:25.768526 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5d579ad2-6eb1-484e-958e-73b70b8efbd5 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] [instance: bec82f31-03ac-4747-a394-4f38d9886320] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:25.772429 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-ecf80dfb-e33e-41fb-9487-710d197fcdbd tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Getting quotas for user 73f4ee2e7ff34dd88b9b82fefbf06a36 and project afdb1e8b478f463987ec223f2d10db33. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:49:25.776589 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d579ad2-6eb1-484e-958e-73b70b8efbd5 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:25.777611 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d579ad2-6eb1-484e-958e-73b70b8efbd5 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:25.778264 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d579ad2-6eb1-484e-958e-73b70b8efbd5 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:25.779224 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d579ad2-6eb1-484e-958e-73b70b8efbd5 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:25.779895 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d579ad2-6eb1-484e-958e-73b70b8efbd5 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:25.780556 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d579ad2-6eb1-484e-958e-73b70b8efbd5 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:25.877583 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ecf80dfb-e33e-41fb-9487-710d197fcdbd tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.176946 Oct 18 15:49:25.878222 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2597/5190] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Oct 18 15:49:25 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:49:25.893110 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-dec68e4c-55c2-422e-8d7e-b46e3799d5fd tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '.version_select at 0x7f7c3c263a60>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:25.900395 n-d-853682-5 devstack@n-api.service[120405]: WARNING oslo_db.sqlalchemy.utils [None req-dec68e4c-55c2-422e-8d7e-b46e3799d5fd tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 18 15:49:25.906557 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-dec68e4c-55c2-422e-8d7e-b46e3799d5fd tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.017984 Oct 18 15:49:25.933229 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2598/5191] 10.222.0.60 () {58 vars in 1137 bytes} [Tue Oct 18 15:49:25 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:49:25.946933 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-93f96cc2-2785-438b-8e17-71a37f0df58b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:25.948391 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-93f96cc2-2785-438b-8e17-71a37f0df58b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:25.965831 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-93f96cc2-2785-438b-8e17-71a37f0df58b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:25.966583 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-93f96cc2-2785-438b-8e17-71a37f0df58b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:25.976274 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-93f96cc2-2785-438b-8e17-71a37f0df58b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:25.977202 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-93f96cc2-2785-438b-8e17-71a37f0df58b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:25.977708 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-93f96cc2-2785-438b-8e17-71a37f0df58b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:25.978164 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-93f96cc2-2785-438b-8e17-71a37f0df58b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:26.343983 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5d579ad2-6eb1-484e-958e-73b70b8efbd5 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d61956417324dc89bca1389bacbd0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0254a3b1a54a9988125e3c09332bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:26.356106 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5d579ad2-6eb1-484e-958e-73b70b8efbd5 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] 10.222.0.60 "GET /compute/v2.1/servers/bec82f31-03ac-4747-a394-4f38d9886320" status: 200 len: 1506 microversion: 2.1 time: 0.608130 Oct 18 15:49:26.378282 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2594/5192] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:25 2022] GET /compute/v2.1/servers/bec82f31-03ac-4747-a394-4f38d9886320 => generated 1506 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:49:26.385149 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6b200c7f-694b-4e75-890e-aa735a4554cb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1428277615", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "key_name": "tempest-key-300304664", "networks": [{"uuid": "5126a012-82e3-4304-a7ec-ac28e05a407b"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:49:26.444335 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-93f96cc2-2785-438b-8e17-71a37f0df58b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:26.477324 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-93f96cc2-2785-438b-8e17-71a37f0df58b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:26.480013 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-93f96cc2-2785-438b-8e17-71a37f0df58b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:26.481298 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-93f96cc2-2785-438b-8e17-71a37f0df58b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1741 microversion: 2.20 time: 0.546650 Oct 18 15:49:26.481874 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2599/5193] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:49:25 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1741 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:49:26.510203 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a85e785a-654b-49a8-8c50-d120ad6b8025 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:26.510996 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a85e785a-654b-49a8-8c50-d120ad6b8025 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] [instance: bec82f31-03ac-4747-a394-4f38d9886320] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:26.519678 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a85e785a-654b-49a8-8c50-d120ad6b8025 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:26.520444 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a85e785a-654b-49a8-8c50-d120ad6b8025 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:26.521136 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a85e785a-654b-49a8-8c50-d120ad6b8025 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:26.522142 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a85e785a-654b-49a8-8c50-d120ad6b8025 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:26.522773 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a85e785a-654b-49a8-8c50-d120ad6b8025 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:26.524027 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a85e785a-654b-49a8-8c50-d120ad6b8025 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:26.566239 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a85e785a-654b-49a8-8c50-d120ad6b8025 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] [instance: bec82f31-03ac-4747-a394-4f38d9886320] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:49:26.588248 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:26.712198 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-6b200c7f-694b-4e75-890e-aa735a4554cb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] validate_networks() for [('5126a012-82e3-4304-a7ec-ac28e05a407b', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:49:26.729323 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a85e785a-654b-49a8-8c50-d120ad6b8025 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] 10.222.0.60 "DELETE /compute/v2.1/servers/bec82f31-03ac-4747-a394-4f38d9886320" status: 204 len: 0 microversion: 2.1 time: 0.232184 Oct 18 15:49:26.730085 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2600/5194] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:49:26 2022] DELETE /compute/v2.1/servers/bec82f31-03ac-4747-a394-4f38d9886320 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:49:26.738220 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bd6d8f2e-7b3f-4698-8e5a-879c77df614f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:26.739075 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-bd6d8f2e-7b3f-4698-8e5a-879c77df614f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:26.745578 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bd6d8f2e-7b3f-4698-8e5a-879c77df614f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:26.746146 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bd6d8f2e-7b3f-4698-8e5a-879c77df614f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:26.746652 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bd6d8f2e-7b3f-4698-8e5a-879c77df614f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:26.747417 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bd6d8f2e-7b3f-4698-8e5a-879c77df614f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:26.748129 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bd6d8f2e-7b3f-4698-8e5a-879c77df614f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:26.748778 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bd6d8f2e-7b3f-4698-8e5a-879c77df614f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:27.161291 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-bd6d8f2e-7b3f-4698-8e5a-879c77df614f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:27.182585 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-bd6d8f2e-7b3f-4698-8e5a-879c77df614f tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1677 microversion: 2.1 time: 0.450459 Oct 18 15:49:27.185007 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2601/5195] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:26 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1677 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:49:27.191557 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-eabe951e-ea2e-42e6-980f-a009ef4df60e tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:27.192346 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-eabe951e-ea2e-42e6-980f-a009ef4df60e tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] [instance: b978eea8-e4b6-43a5-8ce7-502ed47f969e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:27.215715 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eabe951e-ea2e-42e6-980f-a009ef4df60e tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:27.216678 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eabe951e-ea2e-42e6-980f-a009ef4df60e tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:27.219605 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eabe951e-ea2e-42e6-980f-a009ef4df60e tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:27.220692 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eabe951e-ea2e-42e6-980f-a009ef4df60e tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:27.221434 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eabe951e-ea2e-42e6-980f-a009ef4df60e tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:27.222103 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eabe951e-ea2e-42e6-980f-a009ef4df60e tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:27.269900 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-eabe951e-ea2e-42e6-980f-a009ef4df60e tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] [instance: b978eea8-e4b6-43a5-8ce7-502ed47f969e] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:49:27.435841 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-eabe951e-ea2e-42e6-980f-a009ef4df60e tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b978eea8-e4b6-43a5-8ce7-502ed47f969e" status: 204 len: 0 microversion: 2.1 time: 0.249168 Oct 18 15:49:27.437373 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2602/5196] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:49:27 2022] DELETE /compute/v2.1/servers/b978eea8-e4b6-43a5-8ce7-502ed47f969e => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:49:27.448467 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d65d2ee5-f588-4066-a9ae-e2f2ffde1d59 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:27.449834 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d65d2ee5-f588-4066-a9ae-e2f2ffde1d59 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] [instance: bec82f31-03ac-4747-a394-4f38d9886320] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:27.458259 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d65d2ee5-f588-4066-a9ae-e2f2ffde1d59 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:27.459010 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d65d2ee5-f588-4066-a9ae-e2f2ffde1d59 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:27.460533 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d65d2ee5-f588-4066-a9ae-e2f2ffde1d59 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:27.461683 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d65d2ee5-f588-4066-a9ae-e2f2ffde1d59 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:27.462407 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d65d2ee5-f588-4066-a9ae-e2f2ffde1d59 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:27.463008 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d65d2ee5-f588-4066-a9ae-e2f2ffde1d59 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:28.397630 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d65d2ee5-f588-4066-a9ae-e2f2ffde1d59 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d61956417324dc89bca1389bacbd0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0254a3b1a54a9988125e3c09332bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:28.408192 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d65d2ee5-f588-4066-a9ae-e2f2ffde1d59 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] 10.222.0.60 "GET /compute/v2.1/servers/bec82f31-03ac-4747-a394-4f38d9886320" status: 200 len: 1512 microversion: 2.1 time: 0.965641 Oct 18 15:49:28.408786 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2603/5197] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:27 2022] GET /compute/v2.1/servers/bec82f31-03ac-4747-a394-4f38d9886320 => generated 1512 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:49:28.427800 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fa7e886a-aeb2-4f5d-809d-f13b5bfe699d tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:28.428585 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-fa7e886a-aeb2-4f5d-809d-f13b5bfe699d tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:28.443336 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fa7e886a-aeb2-4f5d-809d-f13b5bfe699d tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:28.443845 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fa7e886a-aeb2-4f5d-809d-f13b5bfe699d tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:28.444296 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fa7e886a-aeb2-4f5d-809d-f13b5bfe699d tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:28.445076 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fa7e886a-aeb2-4f5d-809d-f13b5bfe699d tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:28.445798 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fa7e886a-aeb2-4f5d-809d-f13b5bfe699d tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:28.446237 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fa7e886a-aeb2-4f5d-809d-f13b5bfe699d tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:28.946904 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-6b200c7f-694b-4e75-890e-aa735a4554cb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:49:28.947447 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-6b200c7f-694b-4e75-890e-aa735a4554cb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:49:28.947794 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-6b200c7f-694b-4e75-890e-aa735a4554cb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:49:28.948206 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-6b200c7f-694b-4e75-890e-aa735a4554cb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:49:28.948627 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-6b200c7f-694b-4e75-890e-aa735a4554cb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:49:28.964286 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b200c7f-694b-4e75-890e-aa735a4554cb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:28.964992 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b200c7f-694b-4e75-890e-aa735a4554cb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:28.965530 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b200c7f-694b-4e75-890e-aa735a4554cb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:28.966366 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b200c7f-694b-4e75-890e-aa735a4554cb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:28.966910 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b200c7f-694b-4e75-890e-aa735a4554cb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:28.967726 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b200c7f-694b-4e75-890e-aa735a4554cb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:28.977286 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:28.991664 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-6b200c7f-694b-4e75-890e-aa735a4554cb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Getting quotas for project afdb1e8b478f463987ec223f2d10db33. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:49:28.998843 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-6b200c7f-694b-4e75-890e-aa735a4554cb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Getting quotas for user 73f4ee2e7ff34dd88b9b82fefbf06a36 and project afdb1e8b478f463987ec223f2d10db33. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:49:29.013589 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6b200c7f-694b-4e75-890e-aa735a4554cb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:49:29.016515 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6b200c7f-694b-4e75-890e-aa735a4554cb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 4b8310b3-c20d-4832-a680-96c9120e3f00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:49:29.078087 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6b200c7f-694b-4e75-890e-aa735a4554cb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.696560 Oct 18 15:49:29.079750 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2595/5198] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:49:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:49:29.086671 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fcf4c8f8-5a9c-44e6-8c38-466ea2496298 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:29.087633 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fcf4c8f8-5a9c-44e6-8c38-466ea2496298 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:29.095689 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fcf4c8f8-5a9c-44e6-8c38-466ea2496298 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:29.096441 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fcf4c8f8-5a9c-44e6-8c38-466ea2496298 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:29.097697 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fcf4c8f8-5a9c-44e6-8c38-466ea2496298 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:29.099018 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fcf4c8f8-5a9c-44e6-8c38-466ea2496298 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:29.099816 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fcf4c8f8-5a9c-44e6-8c38-466ea2496298 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:29.100850 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fcf4c8f8-5a9c-44e6-8c38-466ea2496298 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:29.128146 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-fa7e886a-aeb2-4f5d-809d-f13b5bfe699d tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:29.151434 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-fa7e886a-aeb2-4f5d-809d-f13b5bfe699d tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:29.156355 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-fa7e886a-aeb2-4f5d-809d-f13b5bfe699d tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:29.159211 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fa7e886a-aeb2-4f5d-809d-f13b5bfe699d tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1741 microversion: 2.20 time: 0.749444 Oct 18 15:49:29.161401 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2604/5199] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:49:28 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1741 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:49:29.166842 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6144b125-64a4-4d3b-87b0-3e1fbdedf1fa tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:29.167793 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6144b125-64a4-4d3b-87b0-3e1fbdedf1fa tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 4b8310b3-c20d-4832-a680-96c9120e3f00] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:29.174734 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:29.266140 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fcf4c8f8-5a9c-44e6-8c38-466ea2496298 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:29.282699 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fcf4c8f8-5a9c-44e6-8c38-466ea2496298 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1610 microversion: 2.1 time: 0.201582 Oct 18 15:49:29.306194 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2596/5200] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:29 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1610 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:49:29.376024 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6144b125-64a4-4d3b-87b0-3e1fbdedf1fa tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:29.384855 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6144b125-64a4-4d3b-87b0-3e1fbdedf1fa tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/4b8310b3-c20d-4832-a680-96c9120e3f00" status: 200 len: 1228 microversion: 2.1 time: 0.221585 Oct 18 15:49:29.387314 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2605/5201] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:29 2022] GET /compute/v2.1/servers/4b8310b3-c20d-4832-a680-96c9120e3f00 => generated 1228 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:49:29.434809 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1654e596-c48f-4913-ae30-82c74ec360b3 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:29.436352 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1654e596-c48f-4913-ae30-82c74ec360b3 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] [instance: bec82f31-03ac-4747-a394-4f38d9886320] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:29.453271 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1654e596-c48f-4913-ae30-82c74ec360b3 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:29.453759 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1654e596-c48f-4913-ae30-82c74ec360b3 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:29.454192 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1654e596-c48f-4913-ae30-82c74ec360b3 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:29.454890 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1654e596-c48f-4913-ae30-82c74ec360b3 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:29.455341 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1654e596-c48f-4913-ae30-82c74ec360b3 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:29.455759 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1654e596-c48f-4913-ae30-82c74ec360b3 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:30.189757 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-030db3ca-04ca-4ffa-ac1e-bc2d4e0be73b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:30.191488 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-030db3ca-04ca-4ffa-ac1e-bc2d4e0be73b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:30.210187 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-030db3ca-04ca-4ffa-ac1e-bc2d4e0be73b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:30.226120 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-030db3ca-04ca-4ffa-ac1e-bc2d4e0be73b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:30.231157 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-030db3ca-04ca-4ffa-ac1e-bc2d4e0be73b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:30.236328 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-030db3ca-04ca-4ffa-ac1e-bc2d4e0be73b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:30.238975 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-030db3ca-04ca-4ffa-ac1e-bc2d4e0be73b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:30.240277 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-030db3ca-04ca-4ffa-ac1e-bc2d4e0be73b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:30.569889 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1654e596-c48f-4913-ae30-82c74ec360b3 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d61956417324dc89bca1389bacbd0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0254a3b1a54a9988125e3c09332bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:30.585140 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1654e596-c48f-4913-ae30-82c74ec360b3 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] 10.222.0.60 "GET /compute/v2.1/servers/bec82f31-03ac-4747-a394-4f38d9886320" status: 200 len: 1512 microversion: 2.1 time: 1.151725 Oct 18 15:49:30.587520 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2597/5202] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:29 2022] GET /compute/v2.1/servers/bec82f31-03ac-4747-a394-4f38d9886320 => generated 1512 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:49:30.596121 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-576ecf53-53b0-4765-b612-7d3463bfff66 req-ed544ab0-4dda-4646-84b5-ef018ff6777a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b978eea8-e4b6-43a5-8ce7-502ed47f969e", "name": "network-vif-deleted", "tag": "286c3437-f206-44a0-b5cb-bfe6e1d8011d"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:49:30.627856 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-576ecf53-53b0-4765-b612-7d3463bfff66 req-ed544ab0-4dda-4646-84b5-ef018ff6777a service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:30.637111 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-576ecf53-53b0-4765-b612-7d3463bfff66 req-ed544ab0-4dda-4646-84b5-ef018ff6777a service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:30.637939 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-576ecf53-53b0-4765-b612-7d3463bfff66 req-ed544ab0-4dda-4646-84b5-ef018ff6777a service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:30.670749 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-576ecf53-53b0-4765-b612-7d3463bfff66 req-ed544ab0-4dda-4646-84b5-ef018ff6777a service nova] Creating event network-vif-deleted:286c3437-f206-44a0-b5cb-bfe6e1d8011d for instance b978eea8-e4b6-43a5-8ce7-502ed47f969e on n-h2-853682-5 Oct 18 15:49:30.682233 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-576ecf53-53b0-4765-b612-7d3463bfff66 req-ed544ab0-4dda-4646-84b5-ef018ff6777a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092915 Oct 18 15:49:30.683422 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2598/5203] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:49:30.689744 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f9317b03-834d-41bd-8e43-4d5688d8d86c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:30.690747 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f9317b03-834d-41bd-8e43-4d5688d8d86c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:30.699013 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9317b03-834d-41bd-8e43-4d5688d8d86c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:30.699778 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9317b03-834d-41bd-8e43-4d5688d8d86c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:30.700471 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9317b03-834d-41bd-8e43-4d5688d8d86c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:30.701513 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9317b03-834d-41bd-8e43-4d5688d8d86c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:30.702566 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9317b03-834d-41bd-8e43-4d5688d8d86c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:30.703989 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9317b03-834d-41bd-8e43-4d5688d8d86c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:30.756947 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9317b03-834d-41bd-8e43-4d5688d8d86c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:30.757910 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9317b03-834d-41bd-8e43-4d5688d8d86c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:30.758591 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9317b03-834d-41bd-8e43-4d5688d8d86c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:30.759288 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-f9317b03-834d-41bd-8e43-4d5688d8d86c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lazy-loading 'fault' on Instance uuid 79212b18-bfd6-4a94-9d58-80c535525aa8 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:49:31.224193 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f9317b03-834d-41bd-8e43-4d5688d8d86c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa0148a4a43466da619ea9843b3f78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cdc778bd54f209d70f5b8703dc068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:31.232113 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f9317b03-834d-41bd-8e43-4d5688d8d86c tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 200 len: 1329 microversion: 2.1 time: 0.547289 Oct 18 15:49:31.237103 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2599/5204] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:30 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 1329 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:49:31.241200 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-030db3ca-04ca-4ffa-ac1e-bc2d4e0be73b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:31.247087 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dd190168-e35e-4914-924e-3940b0ad084d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:31.247854 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dd190168-e35e-4914-924e-3940b0ad084d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 4b8310b3-c20d-4832-a680-96c9120e3f00] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:31.257612 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-030db3ca-04ca-4ffa-ac1e-bc2d4e0be73b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:31.262598 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd190168-e35e-4914-924e-3940b0ad084d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:31.263445 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-030db3ca-04ca-4ffa-ac1e-bc2d4e0be73b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:31.263598 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd190168-e35e-4914-924e-3940b0ad084d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:31.264089 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd190168-e35e-4914-924e-3940b0ad084d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:31.265685 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-030db3ca-04ca-4ffa-ac1e-bc2d4e0be73b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1741 microversion: 2.20 time: 1.080244 Oct 18 15:49:31.268678 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2606/5205] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:49:30 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1741 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:49:31.269514 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd190168-e35e-4914-924e-3940b0ad084d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:31.270343 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd190168-e35e-4914-924e-3940b0ad084d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:31.271023 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd190168-e35e-4914-924e-3940b0ad084d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:31.291343 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-1d22846a-4bda-46ee-9409-7938c408df89 req-867d8cac-d938-401f-b69a-f7ed6e066169 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b465248f-ab7a-4aba-b939-6f236eea166e", "name": "network-vif-plugged", "status": "completed", "tag": "440cc1c1-492e-40b0-8244-adb2559e6c7f"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:49:31.309320 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-1d22846a-4bda-46ee-9409-7938c408df89 req-867d8cac-d938-401f-b69a-f7ed6e066169 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:31.310187 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-1d22846a-4bda-46ee-9409-7938c408df89 req-867d8cac-d938-401f-b69a-f7ed6e066169 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:31.310852 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-1d22846a-4bda-46ee-9409-7938c408df89 req-867d8cac-d938-401f-b69a-f7ed6e066169 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:31.330628 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-1d22846a-4bda-46ee-9409-7938c408df89 req-867d8cac-d938-401f-b69a-f7ed6e066169 service nova] Creating event network-vif-plugged:440cc1c1-492e-40b0-8244-adb2559e6c7f for instance b465248f-ab7a-4aba-b939-6f236eea166e on n-h1-853682-5 Oct 18 15:49:31.338502 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-1d22846a-4bda-46ee-9409-7938c408df89 req-867d8cac-d938-401f-b69a-f7ed6e066169 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065466 Oct 18 15:49:31.339810 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2607/5206] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:49:31.346851 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-21da7826-18c2-477e-8b8d-d3ec4272786a req-fd6d52cf-4971-4bed-b864-2374d6258ae9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79212b18-bfd6-4a94-9d58-80c535525aa8", "name": "network-vif-deleted", "tag": "65ddf63c-d787-42eb-bb1d-c107c1fe8b2f"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:49:31.361146 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-21da7826-18c2-477e-8b8d-d3ec4272786a req-fd6d52cf-4971-4bed-b864-2374d6258ae9 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:31.361846 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-21da7826-18c2-477e-8b8d-d3ec4272786a req-fd6d52cf-4971-4bed-b864-2374d6258ae9 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:31.362478 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-21da7826-18c2-477e-8b8d-d3ec4272786a req-fd6d52cf-4971-4bed-b864-2374d6258ae9 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:31.379064 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-21da7826-18c2-477e-8b8d-d3ec4272786a req-fd6d52cf-4971-4bed-b864-2374d6258ae9 service nova] Creating event network-vif-deleted:65ddf63c-d787-42eb-bb1d-c107c1fe8b2f for instance 79212b18-bfd6-4a94-9d58-80c535525aa8 on n-h2-853682-5 Oct 18 15:49:31.386625 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-21da7826-18c2-477e-8b8d-d3ec4272786a req-fd6d52cf-4971-4bed-b864-2374d6258ae9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044549 Oct 18 15:49:31.387479 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2608/5207] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:49:31.618336 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e62c1a0d-55c2-4673-b065-2eec7fe4b57c tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:31.619255 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e62c1a0d-55c2-4673-b065-2eec7fe4b57c tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] [instance: bec82f31-03ac-4747-a394-4f38d9886320] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:31.644322 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e62c1a0d-55c2-4673-b065-2eec7fe4b57c tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:31.647544 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e62c1a0d-55c2-4673-b065-2eec7fe4b57c tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:31.650515 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e62c1a0d-55c2-4673-b065-2eec7fe4b57c tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:31.655420 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e62c1a0d-55c2-4673-b065-2eec7fe4b57c tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:31.674065 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e62c1a0d-55c2-4673-b065-2eec7fe4b57c tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:31.674751 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e62c1a0d-55c2-4673-b065-2eec7fe4b57c tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:32.222989 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dd190168-e35e-4914-924e-3940b0ad084d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:32.253939 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dd190168-e35e-4914-924e-3940b0ad084d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/4b8310b3-c20d-4832-a680-96c9120e3f00" status: 200 len: 1298 microversion: 2.1 time: 1.013947 Oct 18 15:49:32.274814 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2600/5208] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:31 2022] GET /compute/v2.1/servers/4b8310b3-c20d-4832-a680-96c9120e3f00 => generated 1298 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:49:32.284507 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-58394eda-a839-4a17-bef1-c60c58b9ed45 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:32.291985 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-58394eda-a839-4a17-bef1-c60c58b9ed45 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] [instance: 79212b18-bfd6-4a94-9d58-80c535525aa8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:32.301993 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58394eda-a839-4a17-bef1-c60c58b9ed45 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:32.303720 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58394eda-a839-4a17-bef1-c60c58b9ed45 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:32.304368 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58394eda-a839-4a17-bef1-c60c58b9ed45 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:32.305319 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58394eda-a839-4a17-bef1-c60c58b9ed45 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:32.306348 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58394eda-a839-4a17-bef1-c60c58b9ed45 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:32.307004 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58394eda-a839-4a17-bef1-c60c58b9ed45 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:32.329636 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-58394eda-a839-4a17-bef1-c60c58b9ed45 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] HTTP exception thrown: Instance 79212b18-bfd6-4a94-9d58-80c535525aa8 could not be found. Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-58394eda-a839-4a17-bef1-c60c58b9ed45 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Request method failure captured: Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 HTTP/1.1 Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsjnRdctCp-8YpJETZx5RBXsp0tk0P-jTGcQMSIsNH2GEBs8Wg82Po84gRYEjmY4OarQGWuT5THqpHI7_-hfhGBlYj8sHI1l4vQlE5R8BdhWWvvol61i38spuPGOi5m1Vnr-duJeNWVp2-6eOy-UohsCpTw7z-IjZzPv-4bQM_LgFXg Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 2a2cdc778bd54f209d70f5b8703dc068 Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerActionsTestJSON-1828367688 Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2a2cdc778bd54f209d70f5b8703dc068"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2a2cdc778bd54f209d70f5b8703dc068"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2a2cdc778bd54f209d70f5b8703dc068"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2a2cdc778bd54f209d70f5b8703dc068"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServerActionsTestJSON-1828367688 Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 2a2cdc778bd54f209d70f5b8703dc068 Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerActionsTestJSON-1828367688 Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServerActionsTestJSON-1828367688-project Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 2aa0148a4a43466da619ea9843b3f78c Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServerActionsTestJSON-1828367688-project Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 79212b18-bfd6-4a94-9d58-80c535525aa8 could not be found. Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '79212b18-bfd6-4a94-9d58-80c535525aa8'} Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79212b18-bfd6-4a94-9d58-80c535525aa8 could not be found. Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79212b18-bfd6-4a94-9d58-80c535525aa8 could not be found. Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:49:32.343512 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:49:32.349131 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:49:32.349131 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:49:32.349131 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:49:32.349131 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:49:32.349131 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:49:32.349131 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79212b18-bfd6-4a94-9d58-80c535525aa8 could not be found. Oct 18 15:49:32.349131 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:49:32.350585 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-58394eda-a839-4a17-bef1-c60c58b9ed45 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Returning 404 to user: Instance 79212b18-bfd6-4a94-9d58-80c535525aa8 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:49:32.352739 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-58394eda-a839-4a17-bef1-c60c58b9ed45 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8" status: 404 len: 111 microversion: 2.1 time: 0.076153 Oct 18 15:49:32.355412 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2601/5209] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:32 2022] GET /compute/v2.1/servers/79212b18-bfd6-4a94-9d58-80c535525aa8 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:49:32.364789 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-044500c3-c1bb-4000-9ce7-1283bf9e2e36 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:32.366432 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-044500c3-c1bb-4000-9ce7-1283bf9e2e36 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:32.374527 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-044500c3-c1bb-4000-9ce7-1283bf9e2e36 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:32.375304 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-044500c3-c1bb-4000-9ce7-1283bf9e2e36 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:32.375965 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-044500c3-c1bb-4000-9ce7-1283bf9e2e36 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:32.376960 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-044500c3-c1bb-4000-9ce7-1283bf9e2e36 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:32.377602 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-044500c3-c1bb-4000-9ce7-1283bf9e2e36 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:32.378214 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-044500c3-c1bb-4000-9ce7-1283bf9e2e36 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:32.844908 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e62c1a0d-55c2-4673-b065-2eec7fe4b57c tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d61956417324dc89bca1389bacbd0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0254a3b1a54a9988125e3c09332bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:32.864883 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e62c1a0d-55c2-4673-b065-2eec7fe4b57c tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] 10.222.0.60 "GET /compute/v2.1/servers/bec82f31-03ac-4747-a394-4f38d9886320" status: 200 len: 1470 microversion: 2.1 time: 1.255666 Oct 18 15:49:32.868076 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2609/5210] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:31 2022] GET /compute/v2.1/servers/bec82f31-03ac-4747-a394-4f38d9886320 => generated 1470 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:49:32.874078 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b310a759-b266-4eb3-b565-a5476a4e21d2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] Calling method '.version_select at 0x7f7c3c5d1670>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:32.936841 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b310a759-b266-4eb3-b565-a5476a4e21d2 tempest-ServerActionsTestJSON-1828367688 tempest-ServerActionsTestJSON-1828367688-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2075174212" status: 202 len: 0 microversion: 2.1 time: 0.066745 Oct 18 15:49:32.938168 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2610/5211] 10.222.0.60 () {58 vars in 1221 bytes} [Tue Oct 18 15:49:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2075174212 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:49:33.283543 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-300d9cb7-67c4-4caa-9630-caf835724574 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:33.284399 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-300d9cb7-67c4-4caa-9630-caf835724574 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 4b8310b3-c20d-4832-a680-96c9120e3f00] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:33.302581 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-300d9cb7-67c4-4caa-9630-caf835724574 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:33.305657 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-300d9cb7-67c4-4caa-9630-caf835724574 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:33.306941 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-300d9cb7-67c4-4caa-9630-caf835724574 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:33.316660 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-300d9cb7-67c4-4caa-9630-caf835724574 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:33.317336 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-300d9cb7-67c4-4caa-9630-caf835724574 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:33.317795 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-300d9cb7-67c4-4caa-9630-caf835724574 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:33.649544 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-300d9cb7-67c4-4caa-9630-caf835724574 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:33.661519 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-300d9cb7-67c4-4caa-9630-caf835724574 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/4b8310b3-c20d-4832-a680-96c9120e3f00" status: 200 len: 1286 microversion: 2.1 time: 0.382775 Oct 18 15:49:33.666643 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2611/5212] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:33 2022] GET /compute/v2.1/servers/4b8310b3-c20d-4832-a680-96c9120e3f00 => generated 1286 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:49:33.696454 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-b201ff40-9559-4514-afe7-025335ff1f5d req-2b48f274-bfee-4abb-9e89-c9b39a58ab43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bec82f31-03ac-4747-a394-4f38d9886320", "name": "network-vif-deleted", "tag": "9e4c84c8-12be-4775-b871-e461527e836a"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:49:33.723356 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-b201ff40-9559-4514-afe7-025335ff1f5d req-2b48f274-bfee-4abb-9e89-c9b39a58ab43 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:33.724045 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-b201ff40-9559-4514-afe7-025335ff1f5d req-2b48f274-bfee-4abb-9e89-c9b39a58ab43 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:33.724786 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-b201ff40-9559-4514-afe7-025335ff1f5d req-2b48f274-bfee-4abb-9e89-c9b39a58ab43 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:33.751135 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-b201ff40-9559-4514-afe7-025335ff1f5d req-2b48f274-bfee-4abb-9e89-c9b39a58ab43 service nova] Creating event network-vif-deleted:9e4c84c8-12be-4775-b871-e461527e836a for instance bec82f31-03ac-4747-a394-4f38d9886320 on n-h1-853682-5 Oct 18 15:49:33.758901 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-b201ff40-9559-4514-afe7-025335ff1f5d req-2b48f274-bfee-4abb-9e89-c9b39a58ab43 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090775 Oct 18 15:49:33.760165 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2612/5213] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:49:33.896541 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f4edc4fa-e26e-49e1-b93a-48b2e7171ae0 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:33.897369 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f4edc4fa-e26e-49e1-b93a-48b2e7171ae0 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] [instance: bec82f31-03ac-4747-a394-4f38d9886320] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:33.914964 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f4edc4fa-e26e-49e1-b93a-48b2e7171ae0 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:33.915962 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f4edc4fa-e26e-49e1-b93a-48b2e7171ae0 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:33.917870 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f4edc4fa-e26e-49e1-b93a-48b2e7171ae0 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:33.919951 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f4edc4fa-e26e-49e1-b93a-48b2e7171ae0 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:33.920953 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f4edc4fa-e26e-49e1-b93a-48b2e7171ae0 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:33.925828 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f4edc4fa-e26e-49e1-b93a-48b2e7171ae0 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:34.018769 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f4edc4fa-e26e-49e1-b93a-48b2e7171ae0 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:34.020396 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f4edc4fa-e26e-49e1-b93a-48b2e7171ae0 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:34.023152 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f4edc4fa-e26e-49e1-b93a-48b2e7171ae0 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:34.023958 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-f4edc4fa-e26e-49e1-b93a-48b2e7171ae0 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lazy-loading 'fault' on Instance uuid bec82f31-03ac-4747-a394-4f38d9886320 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:49:34.036720 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-044500c3-c1bb-4000-9ce7-1283bf9e2e36 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:34.051407 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-044500c3-c1bb-4000-9ce7-1283bf9e2e36 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:34.054752 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-044500c3-c1bb-4000-9ce7-1283bf9e2e36 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:34.057958 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-044500c3-c1bb-4000-9ce7-1283bf9e2e36 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1736 microversion: 2.20 time: 1.699372 Oct 18 15:49:34.093159 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2602/5214] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:49:32 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1736 bytes in 1737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:49:34.176832 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f4edc4fa-e26e-49e1-b93a-48b2e7171ae0 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d61956417324dc89bca1389bacbd0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0254a3b1a54a9988125e3c09332bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:34.188872 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f4edc4fa-e26e-49e1-b93a-48b2e7171ae0 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] 10.222.0.60 "GET /compute/v2.1/servers/bec82f31-03ac-4747-a394-4f38d9886320" status: 200 len: 1308 microversion: 2.1 time: 0.297441 Oct 18 15:49:34.189499 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2613/5215] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:33 2022] GET /compute/v2.1/servers/bec82f31-03ac-4747-a394-4f38d9886320 => generated 1308 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:49:34.411236 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fc1902ce-c45c-4add-8db5-cc4f81661d3b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1431789106", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": "none"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:49:34.511487 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-fc1902ce-c45c-4add-8db5-cc4f81661d3b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:49:34.511760 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-fc1902ce-c45c-4add-8db5-cc4f81661d3b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:49:34.512288 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-fc1902ce-c45c-4add-8db5-cc4f81661d3b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:49:34.512669 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-fc1902ce-c45c-4add-8db5-cc4f81661d3b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:49:34.513107 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-fc1902ce-c45c-4add-8db5-cc4f81661d3b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:49:34.537303 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc1902ce-c45c-4add-8db5-cc4f81661d3b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:34.540274 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc1902ce-c45c-4add-8db5-cc4f81661d3b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:34.540926 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc1902ce-c45c-4add-8db5-cc4f81661d3b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:34.541839 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc1902ce-c45c-4add-8db5-cc4f81661d3b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:34.544278 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc1902ce-c45c-4add-8db5-cc4f81661d3b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:34.544796 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc1902ce-c45c-4add-8db5-cc4f81661d3b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:34.583122 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-fc1902ce-c45c-4add-8db5-cc4f81661d3b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Getting quotas for project 735d9a07584449d2b2d5895c360b3758. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:49:34.596015 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-fc1902ce-c45c-4add-8db5-cc4f81661d3b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Getting quotas for user c10f40eda373403a9fbe8adf7063ae8c and project 735d9a07584449d2b2d5895c360b3758. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:49:34.620506 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fc1902ce-c45c-4add-8db5-cc4f81661d3b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:49:34.622849 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fc1902ce-c45c-4add-8db5-cc4f81661d3b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] [instance: cba4c533-6604-4e8a-b6b6-5d6da9633866] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:49:34.690334 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-55091965-fe8d-40cc-bab0-2d4db9b576c1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:34.691114 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-55091965-fe8d-40cc-bab0-2d4db9b576c1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 4b8310b3-c20d-4832-a680-96c9120e3f00] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:34.704532 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-55091965-fe8d-40cc-bab0-2d4db9b576c1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:34.710837 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-55091965-fe8d-40cc-bab0-2d4db9b576c1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:34.711306 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-55091965-fe8d-40cc-bab0-2d4db9b576c1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:34.712075 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-55091965-fe8d-40cc-bab0-2d4db9b576c1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:34.719517 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fc1902ce-c45c-4add-8db5-cc4f81661d3b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.577675 Oct 18 15:49:34.719751 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-55091965-fe8d-40cc-bab0-2d4db9b576c1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:34.720303 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-55091965-fe8d-40cc-bab0-2d4db9b576c1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:34.721265 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2603/5216] 10.222.0.60 () {62 vars in 1188 bytes} [Tue Oct 18 15:49:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 18 15:49:34.734347 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8441fa14-b4a1-426c-9129-26a550ad1786 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:34.735355 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8441fa14-b4a1-426c-9129-26a550ad1786 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] [instance: cba4c533-6604-4e8a-b6b6-5d6da9633866] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:34.833827 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8441fa14-b4a1-426c-9129-26a550ad1786 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:34.849465 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8441fa14-b4a1-426c-9129-26a550ad1786 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:34.852564 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8441fa14-b4a1-426c-9129-26a550ad1786 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:34.854892 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8441fa14-b4a1-426c-9129-26a550ad1786 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] 10.222.0.60 "GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866" status: 200 len: 1278 microversion: 2.57 time: 0.124870 Oct 18 15:49:34.876189 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2604/5217] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:49:34 2022] GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866 => generated 1278 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:49:35.095079 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-676dfd64-29a4-498c-9b2b-dd1470cd4efa tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:35.096391 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-676dfd64-29a4-498c-9b2b-dd1470cd4efa tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:35.111598 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-676dfd64-29a4-498c-9b2b-dd1470cd4efa tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:35.112440 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-676dfd64-29a4-498c-9b2b-dd1470cd4efa tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:35.114997 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-676dfd64-29a4-498c-9b2b-dd1470cd4efa tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:35.115976 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-676dfd64-29a4-498c-9b2b-dd1470cd4efa tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:35.116629 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-676dfd64-29a4-498c-9b2b-dd1470cd4efa tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:35.122573 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-676dfd64-29a4-498c-9b2b-dd1470cd4efa tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:35.648177 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-55091965-fe8d-40cc-bab0-2d4db9b576c1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:35.663457 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-55091965-fe8d-40cc-bab0-2d4db9b576c1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/4b8310b3-c20d-4832-a680-96c9120e3f00" status: 200 len: 1328 microversion: 2.1 time: 0.973663 Oct 18 15:49:35.685461 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2614/5218] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:34 2022] GET /compute/v2.1/servers/4b8310b3-c20d-4832-a680-96c9120e3f00 => generated 1328 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:49:35.700427 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-534c6055-8d4e-4e0a-a51f-f1b0cb0309e0 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:35.702214 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-534c6055-8d4e-4e0a-a51f-f1b0cb0309e0 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] [instance: bec82f31-03ac-4747-a394-4f38d9886320] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:35.719534 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-534c6055-8d4e-4e0a-a51f-f1b0cb0309e0 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:35.720278 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-534c6055-8d4e-4e0a-a51f-f1b0cb0309e0 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:35.721162 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-534c6055-8d4e-4e0a-a51f-f1b0cb0309e0 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:35.725094 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-534c6055-8d4e-4e0a-a51f-f1b0cb0309e0 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:35.725791 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-534c6055-8d4e-4e0a-a51f-f1b0cb0309e0 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:35.726435 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-534c6055-8d4e-4e0a-a51f-f1b0cb0309e0 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:35.766056 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-534c6055-8d4e-4e0a-a51f-f1b0cb0309e0 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] HTTP exception thrown: Instance bec82f31-03ac-4747-a394-4f38d9886320 could not be found. Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-534c6055-8d4e-4e0a-a51f-f1b0cb0309e0 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Request method failure captured: Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/bec82f31-03ac-4747-a394-4f38d9886320 HTTP/1.1 Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsrNnoiIORp0S_-FMpdiDhaZS1eQ0Uph2Jgqf8oFgcGEiaW9CMhuTkn7LUhbjjqsyQWTCRjAEcJ4bOjBKQNdcCZEUgLowQsunpTFXxxmUeTmNtifUKw0T3kbC1OFCIQR0rOgtGPty0J0GuqSjGSOeSQ_VwTHmlgXMAIjWR0yjOyhFC8 Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: fc0254a3b1a54a9988125e3c09332bb3 Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-MultipleCreateTestJSON-1840788135 Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fc0254a3b1a54a9988125e3c09332bb3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fc0254a3b1a54a9988125e3c09332bb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/fc0254a3b1a54a9988125e3c09332bb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_fc0254a3b1a54a9988125e3c09332bb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-MultipleCreateTestJSON-1840788135 Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: fc0254a3b1a54a9988125e3c09332bb3 Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1840788135 Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-MultipleCreateTestJSON-1840788135-project Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 4d61956417324dc89bca1389bacbd0a1 Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-MultipleCreateTestJSON-1840788135-project Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance bec82f31-03ac-4747-a394-4f38d9886320 could not be found. Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'bec82f31-03ac-4747-a394-4f38d9886320'} Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bec82f31-03ac-4747-a394-4f38d9886320 could not be found. Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bec82f31-03ac-4747-a394-4f38d9886320 could not be found. Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:49:35.772212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:49:35.778478 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:49:35.778478 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:49:35.778478 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:49:35.778478 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:49:35.778478 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:49:35.778478 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bec82f31-03ac-4747-a394-4f38d9886320 could not be found. Oct 18 15:49:35.778478 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:49:35.778478 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-534c6055-8d4e-4e0a-a51f-f1b0cb0309e0 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Returning 404 to user: Instance bec82f31-03ac-4747-a394-4f38d9886320 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:49:35.778478 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-534c6055-8d4e-4e0a-a51f-f1b0cb0309e0 tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] 10.222.0.60 "GET /compute/v2.1/servers/bec82f31-03ac-4747-a394-4f38d9886320" status: 404 len: 111 microversion: 2.1 time: 0.088602 Oct 18 15:49:35.778478 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2615/5219] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:35 2022] GET /compute/v2.1/servers/bec82f31-03ac-4747-a394-4f38d9886320 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:49:35.789030 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0ac63297-46c5-46a4-bd55-570b25a6143a tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:35.791230 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0ac63297-46c5-46a4-bd55-570b25a6143a tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] [instance: b978eea8-e4b6-43a5-8ce7-502ed47f969e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:35.806956 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0ac63297-46c5-46a4-bd55-570b25a6143a tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:35.808593 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0ac63297-46c5-46a4-bd55-570b25a6143a tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:35.809297 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0ac63297-46c5-46a4-bd55-570b25a6143a tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:35.811454 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0ac63297-46c5-46a4-bd55-570b25a6143a tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:35.813026 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0ac63297-46c5-46a4-bd55-570b25a6143a tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:35.814197 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0ac63297-46c5-46a4-bd55-570b25a6143a tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:35.850588 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-0ac63297-46c5-46a4-bd55-570b25a6143a tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] HTTP exception thrown: Instance b978eea8-e4b6-43a5-8ce7-502ed47f969e could not be found. Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0ac63297-46c5-46a4-bd55-570b25a6143a tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Request method failure captured: Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/b978eea8-e4b6-43a5-8ce7-502ed47f969e HTTP/1.1 Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsrNnoiIORp0S_-FMpdiDhaZS1eQ0Uph2Jgqf8oFgcGEiaW9CMhuTkn7LUhbjjqsyQWTCRjAEcJ4bOjBKQNdcCZEUgLowQsunpTFXxxmUeTmNtifUKw0T3kbC1OFCIQR0rOgtGPty0J0GuqSjGSOeSQ_VwTHmlgXMAIjWR0yjOyhFC8 Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: fc0254a3b1a54a9988125e3c09332bb3 Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-MultipleCreateTestJSON-1840788135 Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fc0254a3b1a54a9988125e3c09332bb3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fc0254a3b1a54a9988125e3c09332bb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/fc0254a3b1a54a9988125e3c09332bb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_fc0254a3b1a54a9988125e3c09332bb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-MultipleCreateTestJSON-1840788135 Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: fc0254a3b1a54a9988125e3c09332bb3 Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1840788135 Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-MultipleCreateTestJSON-1840788135-project Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 4d61956417324dc89bca1389bacbd0a1 Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-MultipleCreateTestJSON-1840788135-project Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance b978eea8-e4b6-43a5-8ce7-502ed47f969e could not be found. Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'b978eea8-e4b6-43a5-8ce7-502ed47f969e'} Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b978eea8-e4b6-43a5-8ce7-502ed47f969e could not be found. Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b978eea8-e4b6-43a5-8ce7-502ed47f969e could not be found. Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:49:35.852883 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:49:35.859551 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:49:35.859551 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:49:35.859551 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:49:35.859551 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:49:35.859551 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:49:35.859551 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b978eea8-e4b6-43a5-8ce7-502ed47f969e could not be found. Oct 18 15:49:35.859551 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:49:35.862034 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0ac63297-46c5-46a4-bd55-570b25a6143a tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] Returning 404 to user: Instance b978eea8-e4b6-43a5-8ce7-502ed47f969e could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:49:35.863884 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0ac63297-46c5-46a4-bd55-570b25a6143a tempest-MultipleCreateTestJSON-1840788135 tempest-MultipleCreateTestJSON-1840788135-project] 10.222.0.60 "GET /compute/v2.1/servers/b978eea8-e4b6-43a5-8ce7-502ed47f969e" status: 404 len: 111 microversion: 2.1 time: 0.082847 Oct 18 15:49:35.865119 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2616/5220] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:35 2022] GET /compute/v2.1/servers/b978eea8-e4b6-43a5-8ce7-502ed47f969e => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:49:35.893065 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0840e3ee-479f-4030-9214-b074200a4ce0 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:35.895140 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0840e3ee-479f-4030-9214-b074200a4ce0 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] [instance: cba4c533-6604-4e8a-b6b6-5d6da9633866] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:35.912455 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0840e3ee-479f-4030-9214-b074200a4ce0 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:35.913439 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0840e3ee-479f-4030-9214-b074200a4ce0 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:35.914122 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0840e3ee-479f-4030-9214-b074200a4ce0 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:35.915148 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0840e3ee-479f-4030-9214-b074200a4ce0 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:35.917610 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0840e3ee-479f-4030-9214-b074200a4ce0 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:35.918324 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0840e3ee-479f-4030-9214-b074200a4ce0 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:36.114690 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-676dfd64-29a4-498c-9b2b-dd1470cd4efa tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:36.126569 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-676dfd64-29a4-498c-9b2b-dd1470cd4efa tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:36.128921 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-676dfd64-29a4-498c-9b2b-dd1470cd4efa tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:36.130345 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-676dfd64-29a4-498c-9b2b-dd1470cd4efa tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1736 microversion: 2.20 time: 1.039537 Oct 18 15:49:36.131494 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2605/5221] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:49:35 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1736 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:49:36.156498 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0840e3ee-479f-4030-9214-b074200a4ce0 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:36.177736 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0840e3ee-479f-4030-9214-b074200a4ce0 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:36.179643 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0840e3ee-479f-4030-9214-b074200a4ce0 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:36.181088 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0840e3ee-479f-4030-9214-b074200a4ce0 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] 10.222.0.60 "GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866" status: 200 len: 1282 microversion: 2.57 time: 0.293360 Oct 18 15:49:36.182408 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2617/5222] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:49:35 2022] GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866 => generated 1282 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:49:36.694716 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-588f1256-15b2-46d6-9c76-342e9d59a889 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:36.696030 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-588f1256-15b2-46d6-9c76-342e9d59a889 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 4b8310b3-c20d-4832-a680-96c9120e3f00] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:36.720528 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-588f1256-15b2-46d6-9c76-342e9d59a889 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:36.727700 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-588f1256-15b2-46d6-9c76-342e9d59a889 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:36.731451 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-588f1256-15b2-46d6-9c76-342e9d59a889 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:36.732538 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-588f1256-15b2-46d6-9c76-342e9d59a889 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:36.733260 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-588f1256-15b2-46d6-9c76-342e9d59a889 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:36.734064 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-588f1256-15b2-46d6-9c76-342e9d59a889 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:37.161291 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-912d24c4-d645-4c22-a8f4-4241e90f1bba tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:37.161932 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-912d24c4-d645-4c22-a8f4-4241e90f1bba tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:37.190931 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-912d24c4-d645-4c22-a8f4-4241e90f1bba tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:37.194738 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-912d24c4-d645-4c22-a8f4-4241e90f1bba tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:37.195978 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-912d24c4-d645-4c22-a8f4-4241e90f1bba tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:37.197857 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-912d24c4-d645-4c22-a8f4-4241e90f1bba tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:37.198972 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-912d24c4-d645-4c22-a8f4-4241e90f1bba tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:37.202564 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-912d24c4-d645-4c22-a8f4-4241e90f1bba tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:37.926849 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-912d24c4-d645-4c22-a8f4-4241e90f1bba tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:37.972517 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-912d24c4-d645-4c22-a8f4-4241e90f1bba tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:37.983489 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-912d24c4-d645-4c22-a8f4-4241e90f1bba tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:37.994358 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-912d24c4-d645-4c22-a8f4-4241e90f1bba tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1736 microversion: 2.20 time: 0.839532 Oct 18 15:49:37.999646 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2618/5223] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:49:37 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1736 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:49:38.006874 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6f70e450-c3bc-4526-ac79-40f7647c951b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:38.009798 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6f70e450-c3bc-4526-ac79-40f7647c951b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] [instance: cba4c533-6604-4e8a-b6b6-5d6da9633866] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:38.044716 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-588f1256-15b2-46d6-9c76-342e9d59a889 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:38.050929 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6f70e450-c3bc-4526-ac79-40f7647c951b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:38.054582 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6f70e450-c3bc-4526-ac79-40f7647c951b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:38.057183 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6f70e450-c3bc-4526-ac79-40f7647c951b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:38.058795 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6f70e450-c3bc-4526-ac79-40f7647c951b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:38.059163 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-588f1256-15b2-46d6-9c76-342e9d59a889 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/4b8310b3-c20d-4832-a680-96c9120e3f00" status: 200 len: 1328 microversion: 2.1 time: 1.369528 Oct 18 15:49:38.061557 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2606/5224] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:36 2022] GET /compute/v2.1/servers/4b8310b3-c20d-4832-a680-96c9120e3f00 => generated 1328 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:49:38.061812 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6f70e450-c3bc-4526-ac79-40f7647c951b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:38.062277 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6f70e450-c3bc-4526-ac79-40f7647c951b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:38.075733 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-2269d691-4d30-4d62-aa8e-02fd5bde2ef8 req-027badbe-0ad4-47da-b079-8c61bd147d17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b8310b3-c20d-4832-a680-96c9120e3f00", "tag": "36b9bc4d-1f90-418f-a31e-855272239b9f"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:49:38.102216 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2269d691-4d30-4d62-aa8e-02fd5bde2ef8 req-027badbe-0ad4-47da-b079-8c61bd147d17 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:38.102722 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2269d691-4d30-4d62-aa8e-02fd5bde2ef8 req-027badbe-0ad4-47da-b079-8c61bd147d17 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:38.103805 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2269d691-4d30-4d62-aa8e-02fd5bde2ef8 req-027badbe-0ad4-47da-b079-8c61bd147d17 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:38.120958 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:38.135297 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-2269d691-4d30-4d62-aa8e-02fd5bde2ef8 req-027badbe-0ad4-47da-b079-8c61bd147d17 service nova] Creating event network-changed:36b9bc4d-1f90-418f-a31e-855272239b9f for instance 4b8310b3-c20d-4832-a680-96c9120e3f00 on n-h2-853682-5 Oct 18 15:49:38.144210 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-2269d691-4d30-4d62-aa8e-02fd5bde2ef8 req-027badbe-0ad4-47da-b079-8c61bd147d17 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080520 Oct 18 15:49:38.144866 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2607/5225] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:49:38.312216 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6f70e450-c3bc-4526-ac79-40f7647c951b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:38.322624 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6f70e450-c3bc-4526-ac79-40f7647c951b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:38.335718 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6f70e450-c3bc-4526-ac79-40f7647c951b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:38.343344 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6f70e450-c3bc-4526-ac79-40f7647c951b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] 10.222.0.60 "GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866" status: 200 len: 1336 microversion: 2.57 time: 0.342213 Oct 18 15:49:38.344271 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2619/5226] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:49:37 2022] GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866 => generated 1336 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:49:39.031970 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-33e63e85-ec74-4623-b65f-e67efef1f7e8 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:39.033065 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-33e63e85-ec74-4623-b65f-e67efef1f7e8 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:39.043793 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33e63e85-ec74-4623-b65f-e67efef1f7e8 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:39.050924 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33e63e85-ec74-4623-b65f-e67efef1f7e8 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:39.052164 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33e63e85-ec74-4623-b65f-e67efef1f7e8 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:39.053298 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33e63e85-ec74-4623-b65f-e67efef1f7e8 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:39.054025 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33e63e85-ec74-4623-b65f-e67efef1f7e8 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:39.054714 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33e63e85-ec74-4623-b65f-e67efef1f7e8 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:39.090747 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f583cdb6-d494-4d43-aa8c-873e0d653a01 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:39.091809 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f583cdb6-d494-4d43-aa8c-873e0d653a01 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 4b8310b3-c20d-4832-a680-96c9120e3f00] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:39.099319 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f583cdb6-d494-4d43-aa8c-873e0d653a01 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:39.101886 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f583cdb6-d494-4d43-aa8c-873e0d653a01 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:39.104666 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f583cdb6-d494-4d43-aa8c-873e0d653a01 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:39.108292 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f583cdb6-d494-4d43-aa8c-873e0d653a01 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:39.111460 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f583cdb6-d494-4d43-aa8c-873e0d653a01 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:39.112194 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f583cdb6-d494-4d43-aa8c-873e0d653a01 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:39.381021 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=6 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:39.676728 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-33e63e85-ec74-4623-b65f-e67efef1f7e8 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:39.691208 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-33e63e85-ec74-4623-b65f-e67efef1f7e8 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:39.692724 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-33e63e85-ec74-4623-b65f-e67efef1f7e8 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:39.698580 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-33e63e85-ec74-4623-b65f-e67efef1f7e8 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1736 microversion: 2.20 time: 0.671210 Oct 18 15:49:39.699413 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2608/5227] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:49:39 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1736 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:49:39.714546 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-da58b832-11e7-4973-9428-04628efb5f1b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:39.715431 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-da58b832-11e7-4973-9428-04628efb5f1b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] [instance: cba4c533-6604-4e8a-b6b6-5d6da9633866] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:39.746891 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da58b832-11e7-4973-9428-04628efb5f1b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:39.748711 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da58b832-11e7-4973-9428-04628efb5f1b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:39.749892 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da58b832-11e7-4973-9428-04628efb5f1b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:39.750850 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da58b832-11e7-4973-9428-04628efb5f1b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:39.751495 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da58b832-11e7-4973-9428-04628efb5f1b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:39.754610 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da58b832-11e7-4973-9428-04628efb5f1b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:39.948234 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-da58b832-11e7-4973-9428-04628efb5f1b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:39.963283 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-da58b832-11e7-4973-9428-04628efb5f1b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:39.964281 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f583cdb6-d494-4d43-aa8c-873e0d653a01 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:39.968507 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-da58b832-11e7-4973-9428-04628efb5f1b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:39.972265 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-da58b832-11e7-4973-9428-04628efb5f1b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] 10.222.0.60 "GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866" status: 200 len: 1336 microversion: 2.57 time: 0.262327 Oct 18 15:49:39.974362 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f583cdb6-d494-4d43-aa8c-873e0d653a01 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/4b8310b3-c20d-4832-a680-96c9120e3f00" status: 200 len: 1328 microversion: 2.1 time: 0.887645 Oct 18 15:49:39.985207 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2620/5228] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:39 2022] GET /compute/v2.1/servers/4b8310b3-c20d-4832-a680-96c9120e3f00 => generated 1328 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:49:39.989361 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2609/5229] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:49:39 2022] GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866 => generated 1336 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:49:40.731107 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e8a30068-97e9-4fbc-9b5d-e260cbae29c9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:40.731741 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e8a30068-97e9-4fbc-9b5d-e260cbae29c9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:40.752694 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e8a30068-97e9-4fbc-9b5d-e260cbae29c9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:40.753290 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e8a30068-97e9-4fbc-9b5d-e260cbae29c9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:40.754246 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e8a30068-97e9-4fbc-9b5d-e260cbae29c9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:40.754984 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e8a30068-97e9-4fbc-9b5d-e260cbae29c9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:40.755433 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e8a30068-97e9-4fbc-9b5d-e260cbae29c9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:40.755863 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e8a30068-97e9-4fbc-9b5d-e260cbae29c9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:41.006854 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dd8f3e3f-6301-471f-845d-474dbe75189a tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:41.007488 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dd8f3e3f-6301-471f-845d-474dbe75189a tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] [instance: cba4c533-6604-4e8a-b6b6-5d6da9633866] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:41.026537 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd8f3e3f-6301-471f-845d-474dbe75189a tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:41.033850 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd8f3e3f-6301-471f-845d-474dbe75189a tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:41.038175 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd8f3e3f-6301-471f-845d-474dbe75189a tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:41.040835 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd8f3e3f-6301-471f-845d-474dbe75189a tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:41.043849 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd8f3e3f-6301-471f-845d-474dbe75189a tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:41.054392 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd8f3e3f-6301-471f-845d-474dbe75189a tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:41.127298 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e8a30068-97e9-4fbc-9b5d-e260cbae29c9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:41.141634 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e8a30068-97e9-4fbc-9b5d-e260cbae29c9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:41.143729 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e8a30068-97e9-4fbc-9b5d-e260cbae29c9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:41.145259 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e8a30068-97e9-4fbc-9b5d-e260cbae29c9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1736 microversion: 2.20 time: 0.419873 Oct 18 15:49:41.146693 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2621/5230] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:49:40 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1736 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:49:41.152797 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2fb76438-6b2c-4818-bc9d-8a41ad888ac1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:41.153749 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2fb76438-6b2c-4818-bc9d-8a41ad888ac1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 4b8310b3-c20d-4832-a680-96c9120e3f00] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:41.167813 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2fb76438-6b2c-4818-bc9d-8a41ad888ac1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:41.168697 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2fb76438-6b2c-4818-bc9d-8a41ad888ac1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:41.169938 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2fb76438-6b2c-4818-bc9d-8a41ad888ac1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:41.171135 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2fb76438-6b2c-4818-bc9d-8a41ad888ac1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:41.171838 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2fb76438-6b2c-4818-bc9d-8a41ad888ac1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:41.173650 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2fb76438-6b2c-4818-bc9d-8a41ad888ac1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:41.349677 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dd8f3e3f-6301-471f-845d-474dbe75189a tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:41.360416 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dd8f3e3f-6301-471f-845d-474dbe75189a tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:41.361896 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dd8f3e3f-6301-471f-845d-474dbe75189a tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:41.363624 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dd8f3e3f-6301-471f-845d-474dbe75189a tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] 10.222.0.60 "GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866" status: 200 len: 1336 microversion: 2.57 time: 0.363571 Oct 18 15:49:41.371491 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2610/5231] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:49:40 2022] GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866 => generated 1336 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:49:42.149477 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2fb76438-6b2c-4818-bc9d-8a41ad888ac1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:42.167770 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2fb76438-6b2c-4818-bc9d-8a41ad888ac1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/4b8310b3-c20d-4832-a680-96c9120e3f00" status: 200 len: 1328 microversion: 2.1 time: 1.019488 Oct 18 15:49:42.176351 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b7b5b618-fd28-44ee-bd0e-daacab2b7178 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:42.177616 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b7b5b618-fd28-44ee-bd0e-daacab2b7178 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:42.189970 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b7b5b618-fd28-44ee-bd0e-daacab2b7178 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:42.190833 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b7b5b618-fd28-44ee-bd0e-daacab2b7178 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:42.192284 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2622/5232] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:41 2022] GET /compute/v2.1/servers/4b8310b3-c20d-4832-a680-96c9120e3f00 => generated 1328 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:49:42.192938 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b7b5b618-fd28-44ee-bd0e-daacab2b7178 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:42.193849 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b7b5b618-fd28-44ee-bd0e-daacab2b7178 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:42.196384 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b7b5b618-fd28-44ee-bd0e-daacab2b7178 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:42.199731 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b7b5b618-fd28-44ee-bd0e-daacab2b7178 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:42.407701 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-878f78f6-66f4-4e03-aa6e-838c9d5dbef3 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:42.408609 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-878f78f6-66f4-4e03-aa6e-838c9d5dbef3 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] [instance: cba4c533-6604-4e8a-b6b6-5d6da9633866] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:42.422490 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-878f78f6-66f4-4e03-aa6e-838c9d5dbef3 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:42.423520 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-878f78f6-66f4-4e03-aa6e-838c9d5dbef3 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:42.424215 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-878f78f6-66f4-4e03-aa6e-838c9d5dbef3 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:42.425729 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-878f78f6-66f4-4e03-aa6e-838c9d5dbef3 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:42.426508 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-878f78f6-66f4-4e03-aa6e-838c9d5dbef3 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:42.437244 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-878f78f6-66f4-4e03-aa6e-838c9d5dbef3 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:42.824257 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b7b5b618-fd28-44ee-bd0e-daacab2b7178 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:42.826924 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-878f78f6-66f4-4e03-aa6e-838c9d5dbef3 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:42.841405 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b7b5b618-fd28-44ee-bd0e-daacab2b7178 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:42.844684 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-878f78f6-66f4-4e03-aa6e-838c9d5dbef3 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:42.845150 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b7b5b618-fd28-44ee-bd0e-daacab2b7178 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:42.846626 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b7b5b618-fd28-44ee-bd0e-daacab2b7178 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1736 microversion: 2.20 time: 0.674898 Oct 18 15:49:42.849475 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-878f78f6-66f4-4e03-aa6e-838c9d5dbef3 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:42.852672 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-878f78f6-66f4-4e03-aa6e-838c9d5dbef3 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] 10.222.0.60 "GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866" status: 200 len: 1357 microversion: 2.57 time: 0.448906 Oct 18 15:49:42.855669 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2623/5233] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:49:42 2022] GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866 => generated 1357 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:49:42.869344 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2611/5234] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:49:42 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1736 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:49:42.885791 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-952aaa4b-d892-4ff9-943f-0b1258bde58b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:49:42.891437 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-952aaa4b-d892-4ff9-943f-0b1258bde58b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] [instance: cba4c533-6604-4e8a-b6b6-5d6da9633866] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:42.908325 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-952aaa4b-d892-4ff9-943f-0b1258bde58b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:42.908868 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-952aaa4b-d892-4ff9-943f-0b1258bde58b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:42.913792 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-952aaa4b-d892-4ff9-943f-0b1258bde58b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:42.914722 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-952aaa4b-d892-4ff9-943f-0b1258bde58b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:42.915900 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-952aaa4b-d892-4ff9-943f-0b1258bde58b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:42.916581 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-952aaa4b-d892-4ff9-943f-0b1258bde58b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:43.117364 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-952aaa4b-d892-4ff9-943f-0b1258bde58b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:49:43.118946 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-952aaa4b-d892-4ff9-943f-0b1258bde58b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:49:43.119489 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-952aaa4b-d892-4ff9-943f-0b1258bde58b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:49:43.119883 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-952aaa4b-d892-4ff9-943f-0b1258bde58b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:49:43.120302 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-952aaa4b-d892-4ff9-943f-0b1258bde58b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:49:43.200170 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-87fe31cc-0296-40a7-b410-ba50e6b4c0ae tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:43.201002 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-87fe31cc-0296-40a7-b410-ba50e6b4c0ae tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 4b8310b3-c20d-4832-a680-96c9120e3f00] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:43.229466 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87fe31cc-0296-40a7-b410-ba50e6b4c0ae tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:43.230454 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87fe31cc-0296-40a7-b410-ba50e6b4c0ae tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:43.233519 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87fe31cc-0296-40a7-b410-ba50e6b4c0ae tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:43.236289 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87fe31cc-0296-40a7-b410-ba50e6b4c0ae tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:43.236833 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87fe31cc-0296-40a7-b410-ba50e6b4c0ae tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:43.239576 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87fe31cc-0296-40a7-b410-ba50e6b4c0ae tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:43.354508 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-952aaa4b-d892-4ff9-943f-0b1258bde58b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] [instance: cba4c533-6604-4e8a-b6b6-5d6da9633866] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:43.375119 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-952aaa4b-d892-4ff9-943f-0b1258bde58b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:43.375669 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-952aaa4b-d892-4ff9-943f-0b1258bde58b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:43.376092 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-952aaa4b-d892-4ff9-943f-0b1258bde58b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:43.376834 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-952aaa4b-d892-4ff9-943f-0b1258bde58b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:43.381981 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-952aaa4b-d892-4ff9-943f-0b1258bde58b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:43.382507 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-952aaa4b-d892-4ff9-943f-0b1258bde58b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:43.499166 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-952aaa4b-d892-4ff9-943f-0b1258bde58b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] 10.222.0.60 "POST /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866/action" status: 202 len: 1138 microversion: 2.57 time: 0.617976 Oct 18 15:49:43.502569 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2624/5235] 10.222.0.60 () {62 vars in 1320 bytes} [Tue Oct 18 15:49:42 2022] POST /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866/action => generated 1138 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 18 15:49:43.525157 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-27dbb0e9-237b-4a90-864e-1f7598cdf2b7 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:43.527014 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-27dbb0e9-237b-4a90-864e-1f7598cdf2b7 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] [instance: cba4c533-6604-4e8a-b6b6-5d6da9633866] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:43.571347 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-27dbb0e9-237b-4a90-864e-1f7598cdf2b7 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:43.571923 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-27dbb0e9-237b-4a90-864e-1f7598cdf2b7 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:43.575611 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-27dbb0e9-237b-4a90-864e-1f7598cdf2b7 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:43.578881 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-27dbb0e9-237b-4a90-864e-1f7598cdf2b7 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:43.579403 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-27dbb0e9-237b-4a90-864e-1f7598cdf2b7 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:43.579845 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-27dbb0e9-237b-4a90-864e-1f7598cdf2b7 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:43.875065 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-27dbb0e9-237b-4a90-864e-1f7598cdf2b7 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:43.888673 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-87fe31cc-0296-40a7-b410-ba50e6b4c0ae tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:43.931015 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-87fe31cc-0296-40a7-b410-ba50e6b4c0ae tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/4b8310b3-c20d-4832-a680-96c9120e3f00" status: 200 len: 1328 microversion: 2.1 time: 0.732787 Oct 18 15:49:43.937241 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2612/5236] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:43 2022] GET /compute/v2.1/servers/4b8310b3-c20d-4832-a680-96c9120e3f00 => generated 1328 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:49:43.943855 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-27dbb0e9-237b-4a90-864e-1f7598cdf2b7 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:43.959754 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-27dbb0e9-237b-4a90-864e-1f7598cdf2b7 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:43.962092 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-27dbb0e9-237b-4a90-864e-1f7598cdf2b7 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] 10.222.0.60 "GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866" status: 200 len: 1366 microversion: 2.57 time: 0.441765 Oct 18 15:49:43.964343 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7f82e8a7-0021-4002-bb21-a89f936a9d30 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:43.965072 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7f82e8a7-0021-4002-bb21-a89f936a9d30 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:43.991421 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2625/5237] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:49:43 2022] GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866 => generated 1366 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:49:44.014472 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f82e8a7-0021-4002-bb21-a89f936a9d30 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:44.014891 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f82e8a7-0021-4002-bb21-a89f936a9d30 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:44.026042 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f82e8a7-0021-4002-bb21-a89f936a9d30 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:44.029211 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f82e8a7-0021-4002-bb21-a89f936a9d30 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:44.029710 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f82e8a7-0021-4002-bb21-a89f936a9d30 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:44.037449 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f82e8a7-0021-4002-bb21-a89f936a9d30 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:44.558147 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:44.597042 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7f82e8a7-0021-4002-bb21-a89f936a9d30 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:44.620855 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7f82e8a7-0021-4002-bb21-a89f936a9d30 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:44.637203 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7f82e8a7-0021-4002-bb21-a89f936a9d30 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:44.638450 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7f82e8a7-0021-4002-bb21-a89f936a9d30 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1736 microversion: 2.20 time: 0.696690 Oct 18 15:49:44.639025 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2613/5238] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:49:43 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1736 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:49:44.962946 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7d91d422-21bd-4c65-8bdb-14ad545f7334 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:44.963660 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7d91d422-21bd-4c65-8bdb-14ad545f7334 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 4b8310b3-c20d-4832-a680-96c9120e3f00] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:44.997283 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5fcbd0b1-48e6-4e8e-8b38-033e2b43cc8c tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:44.997987 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5fcbd0b1-48e6-4e8e-8b38-033e2b43cc8c tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] [instance: cba4c533-6604-4e8a-b6b6-5d6da9633866] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:45.000521 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=14 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:45.018571 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5fcbd0b1-48e6-4e8e-8b38-033e2b43cc8c tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:45.019567 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5fcbd0b1-48e6-4e8e-8b38-033e2b43cc8c tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:45.020522 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7d91d422-21bd-4c65-8bdb-14ad545f7334 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:45.021001 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5fcbd0b1-48e6-4e8e-8b38-033e2b43cc8c tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:45.021743 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7d91d422-21bd-4c65-8bdb-14ad545f7334 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:45.022660 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5fcbd0b1-48e6-4e8e-8b38-033e2b43cc8c tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:45.023453 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7d91d422-21bd-4c65-8bdb-14ad545f7334 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:45.024111 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5fcbd0b1-48e6-4e8e-8b38-033e2b43cc8c tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:45.026265 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7d91d422-21bd-4c65-8bdb-14ad545f7334 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:45.026941 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5fcbd0b1-48e6-4e8e-8b38-033e2b43cc8c tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:45.028340 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7d91d422-21bd-4c65-8bdb-14ad545f7334 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:45.031774 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7d91d422-21bd-4c65-8bdb-14ad545f7334 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:45.390631 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5fcbd0b1-48e6-4e8e-8b38-033e2b43cc8c tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:45.401058 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5fcbd0b1-48e6-4e8e-8b38-033e2b43cc8c tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:45.406047 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5fcbd0b1-48e6-4e8e-8b38-033e2b43cc8c tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:45.407250 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5fcbd0b1-48e6-4e8e-8b38-033e2b43cc8c tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] 10.222.0.60 "GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866" status: 200 len: 1366 microversion: 2.57 time: 0.414145 Oct 18 15:49:45.413889 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2614/5239] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:49:44 2022] GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866 => generated 1366 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:49:45.676439 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-949bbc97-9da0-4ac8-bea1-2c808567ab7e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:45.677876 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-949bbc97-9da0-4ac8-bea1-2c808567ab7e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:45.691462 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-949bbc97-9da0-4ac8-bea1-2c808567ab7e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:45.697187 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-949bbc97-9da0-4ac8-bea1-2c808567ab7e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:45.697897 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-949bbc97-9da0-4ac8-bea1-2c808567ab7e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:45.698928 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-949bbc97-9da0-4ac8-bea1-2c808567ab7e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:45.701184 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-949bbc97-9da0-4ac8-bea1-2c808567ab7e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:45.702479 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-949bbc97-9da0-4ac8-bea1-2c808567ab7e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:45.793114 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7d91d422-21bd-4c65-8bdb-14ad545f7334 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:45.808567 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7d91d422-21bd-4c65-8bdb-14ad545f7334 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/4b8310b3-c20d-4832-a680-96c9120e3f00" status: 200 len: 1328 microversion: 2.1 time: 0.859103 Oct 18 15:49:45.809137 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2626/5240] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:44 2022] GET /compute/v2.1/servers/4b8310b3-c20d-4832-a680-96c9120e3f00 => generated 1328 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:49:46.444549 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-37733507-d4e5-42b1-b1a5-6c60535f6abb tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:46.446392 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-37733507-d4e5-42b1-b1a5-6c60535f6abb tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] [instance: cba4c533-6604-4e8a-b6b6-5d6da9633866] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:46.460411 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37733507-d4e5-42b1-b1a5-6c60535f6abb tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:46.464667 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37733507-d4e5-42b1-b1a5-6c60535f6abb tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:46.465209 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37733507-d4e5-42b1-b1a5-6c60535f6abb tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:46.465978 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37733507-d4e5-42b1-b1a5-6c60535f6abb tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:46.470424 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37733507-d4e5-42b1-b1a5-6c60535f6abb tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:46.470881 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37733507-d4e5-42b1-b1a5-6c60535f6abb tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:46.717817 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-37733507-d4e5-42b1-b1a5-6c60535f6abb tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:46.735765 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-37733507-d4e5-42b1-b1a5-6c60535f6abb tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:46.740082 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-37733507-d4e5-42b1-b1a5-6c60535f6abb tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:46.742712 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-37733507-d4e5-42b1-b1a5-6c60535f6abb tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] 10.222.0.60 "GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866" status: 200 len: 1366 microversion: 2.57 time: 0.302959 Oct 18 15:49:46.749064 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2627/5241] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:49:46 2022] GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866 => generated 1366 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:49:46.832163 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bd1dc8e5-e2a1-42af-b2f2-fd80a0d8f630 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:46.832953 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-bd1dc8e5-e2a1-42af-b2f2-fd80a0d8f630 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 4b8310b3-c20d-4832-a680-96c9120e3f00] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:46.843139 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bd1dc8e5-e2a1-42af-b2f2-fd80a0d8f630 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:46.844022 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bd1dc8e5-e2a1-42af-b2f2-fd80a0d8f630 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:46.844710 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bd1dc8e5-e2a1-42af-b2f2-fd80a0d8f630 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:46.845709 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bd1dc8e5-e2a1-42af-b2f2-fd80a0d8f630 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:46.850013 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bd1dc8e5-e2a1-42af-b2f2-fd80a0d8f630 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:46.850714 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bd1dc8e5-e2a1-42af-b2f2-fd80a0d8f630 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:47.187288 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-949bbc97-9da0-4ac8-bea1-2c808567ab7e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:47.189933 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:47.206782 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-949bbc97-9da0-4ac8-bea1-2c808567ab7e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:47.214304 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-949bbc97-9da0-4ac8-bea1-2c808567ab7e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:47.220456 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-949bbc97-9da0-4ac8-bea1-2c808567ab7e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1736 microversion: 2.20 time: 1.551434 Oct 18 15:49:47.221174 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2615/5242] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:49:45 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1736 bytes in 1558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:49:47.240566 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-b7366547-2e45-4dc7-a704-c219d8bfcf86 req-fd6b48ba-5c0b-47d7-a918-5a74c77bd500 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b8310b3-c20d-4832-a680-96c9120e3f00", "name": "network-vif-plugged", "status": "completed", "tag": "36b9bc4d-1f90-418f-a31e-855272239b9f"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:49:47.263363 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b7366547-2e45-4dc7-a704-c219d8bfcf86 req-fd6b48ba-5c0b-47d7-a918-5a74c77bd500 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:47.263856 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b7366547-2e45-4dc7-a704-c219d8bfcf86 req-fd6b48ba-5c0b-47d7-a918-5a74c77bd500 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:47.264296 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b7366547-2e45-4dc7-a704-c219d8bfcf86 req-fd6b48ba-5c0b-47d7-a918-5a74c77bd500 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:47.287644 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-b7366547-2e45-4dc7-a704-c219d8bfcf86 req-fd6b48ba-5c0b-47d7-a918-5a74c77bd500 service nova] Creating event network-vif-plugged:36b9bc4d-1f90-418f-a31e-855272239b9f for instance 4b8310b3-c20d-4832-a680-96c9120e3f00 on n-h2-853682-5 Oct 18 15:49:47.299426 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-b7366547-2e45-4dc7-a704-c219d8bfcf86 req-fd6b48ba-5c0b-47d7-a918-5a74c77bd500 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073459 Oct 18 15:49:47.300403 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2616/5243] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:49:47.458703 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-bd1dc8e5-e2a1-42af-b2f2-fd80a0d8f630 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:47.476734 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-bd1dc8e5-e2a1-42af-b2f2-fd80a0d8f630 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/4b8310b3-c20d-4832-a680-96c9120e3f00" status: 200 len: 1328 microversion: 2.1 time: 0.648955 Oct 18 15:49:47.488835 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2628/5244] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:46 2022] GET /compute/v2.1/servers/4b8310b3-c20d-4832-a680-96c9120e3f00 => generated 1328 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:49:47.780885 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0226f1d0-50e0-48c8-ad42-d047bc07dbcb tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:47.781636 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0226f1d0-50e0-48c8-ad42-d047bc07dbcb tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] [instance: cba4c533-6604-4e8a-b6b6-5d6da9633866] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:47.800183 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0226f1d0-50e0-48c8-ad42-d047bc07dbcb tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:47.800896 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0226f1d0-50e0-48c8-ad42-d047bc07dbcb tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:47.802896 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0226f1d0-50e0-48c8-ad42-d047bc07dbcb tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:47.805308 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0226f1d0-50e0-48c8-ad42-d047bc07dbcb tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:47.808600 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0226f1d0-50e0-48c8-ad42-d047bc07dbcb tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:47.809207 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0226f1d0-50e0-48c8-ad42-d047bc07dbcb tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:48.216851 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0226f1d0-50e0-48c8-ad42-d047bc07dbcb tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:48.229139 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0226f1d0-50e0-48c8-ad42-d047bc07dbcb tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:48.231162 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0226f1d0-50e0-48c8-ad42-d047bc07dbcb tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:48.235268 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0226f1d0-50e0-48c8-ad42-d047bc07dbcb tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] 10.222.0.60 "GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866" status: 200 len: 1366 microversion: 2.57 time: 0.459266 Oct 18 15:49:48.238336 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2617/5245] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:49:47 2022] GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866 => generated 1366 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:49:48.255133 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-04730255-a858-4185-a6b4-512648a833db tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:48.255819 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-04730255-a858-4185-a6b4-512648a833db tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:48.284775 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-04730255-a858-4185-a6b4-512648a833db tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:48.285809 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-04730255-a858-4185-a6b4-512648a833db tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:48.286434 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-04730255-a858-4185-a6b4-512648a833db tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:48.287953 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-04730255-a858-4185-a6b4-512648a833db tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:48.288616 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-04730255-a858-4185-a6b4-512648a833db tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:48.294699 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-04730255-a858-4185-a6b4-512648a833db tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:48.508550 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-25f7a14e-15c0-430f-b0e0-6ce887805ed7 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:48.509777 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-25f7a14e-15c0-430f-b0e0-6ce887805ed7 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 4b8310b3-c20d-4832-a680-96c9120e3f00] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:48.525714 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25f7a14e-15c0-430f-b0e0-6ce887805ed7 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:48.526504 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25f7a14e-15c0-430f-b0e0-6ce887805ed7 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:48.528225 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25f7a14e-15c0-430f-b0e0-6ce887805ed7 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:48.530227 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25f7a14e-15c0-430f-b0e0-6ce887805ed7 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:48.531857 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25f7a14e-15c0-430f-b0e0-6ce887805ed7 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:48.532694 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25f7a14e-15c0-430f-b0e0-6ce887805ed7 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:48.883632 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-04730255-a858-4185-a6b4-512648a833db tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:48.897873 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-04730255-a858-4185-a6b4-512648a833db tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:48.899354 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-04730255-a858-4185-a6b4-512648a833db tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:48.904280 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-04730255-a858-4185-a6b4-512648a833db tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1736 microversion: 2.20 time: 0.654981 Oct 18 15:49:48.905999 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2629/5246] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:49:48 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1736 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:49:49.272325 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a665b521-b6fb-4831-973b-1f6990827ff8 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:49.273417 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a665b521-b6fb-4831-973b-1f6990827ff8 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] [instance: cba4c533-6604-4e8a-b6b6-5d6da9633866] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:49.292856 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a665b521-b6fb-4831-973b-1f6990827ff8 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:49.293360 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a665b521-b6fb-4831-973b-1f6990827ff8 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:49.293825 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a665b521-b6fb-4831-973b-1f6990827ff8 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:49.304230 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a665b521-b6fb-4831-973b-1f6990827ff8 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:49.304934 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a665b521-b6fb-4831-973b-1f6990827ff8 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:49.309588 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a665b521-b6fb-4831-973b-1f6990827ff8 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:49.347579 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-25f7a14e-15c0-430f-b0e0-6ce887805ed7 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:49.358750 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-25f7a14e-15c0-430f-b0e0-6ce887805ed7 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/4b8310b3-c20d-4832-a680-96c9120e3f00" status: 200 len: 1328 microversion: 2.1 time: 0.858781 Oct 18 15:49:49.359832 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2618/5247] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:48 2022] GET /compute/v2.1/servers/4b8310b3-c20d-4832-a680-96c9120e3f00 => generated 1328 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:49:49.582093 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a665b521-b6fb-4831-973b-1f6990827ff8 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:49.593012 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a665b521-b6fb-4831-973b-1f6990827ff8 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:49.596428 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a665b521-b6fb-4831-973b-1f6990827ff8 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:49.598230 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a665b521-b6fb-4831-973b-1f6990827ff8 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] 10.222.0.60 "GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866" status: 200 len: 1366 microversion: 2.57 time: 0.330943 Oct 18 15:49:49.634674 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2630/5248] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:49:49 2022] GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866 => generated 1366 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:49:49.932798 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5ae5d276-9f09-4b61-b3c2-4ba0dddc5545 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:49.934136 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5ae5d276-9f09-4b61-b3c2-4ba0dddc5545 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:49.947578 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ae5d276-9f09-4b61-b3c2-4ba0dddc5545 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:49.948375 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ae5d276-9f09-4b61-b3c2-4ba0dddc5545 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:49.949205 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ae5d276-9f09-4b61-b3c2-4ba0dddc5545 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:49.950443 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ae5d276-9f09-4b61-b3c2-4ba0dddc5545 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:49.951146 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ae5d276-9f09-4b61-b3c2-4ba0dddc5545 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:49.951813 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ae5d276-9f09-4b61-b3c2-4ba0dddc5545 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:50.332903 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5ae5d276-9f09-4b61-b3c2-4ba0dddc5545 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:50.345745 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5ae5d276-9f09-4b61-b3c2-4ba0dddc5545 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:50.350413 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5ae5d276-9f09-4b61-b3c2-4ba0dddc5545 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:50.353864 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5ae5d276-9f09-4b61-b3c2-4ba0dddc5545 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1736 microversion: 2.20 time: 0.425695 Oct 18 15:49:50.369527 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2619/5249] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:49:49 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1736 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:49:50.391974 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5a7efd45-a6be-487b-8cc2-11cbe4c370c9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:50.392626 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5a7efd45-a6be-487b-8cc2-11cbe4c370c9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 4b8310b3-c20d-4832-a680-96c9120e3f00] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:50.407233 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5a7efd45-a6be-487b-8cc2-11cbe4c370c9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:50.410022 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5a7efd45-a6be-487b-8cc2-11cbe4c370c9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:50.411606 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5a7efd45-a6be-487b-8cc2-11cbe4c370c9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:50.413191 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5a7efd45-a6be-487b-8cc2-11cbe4c370c9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:50.413662 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5a7efd45-a6be-487b-8cc2-11cbe4c370c9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:50.414125 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5a7efd45-a6be-487b-8cc2-11cbe4c370c9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:50.633346 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8215cc99-d3f8-4c14-9d5a-52c2023eef9a tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:50.633968 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8215cc99-d3f8-4c14-9d5a-52c2023eef9a tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] [instance: cba4c533-6604-4e8a-b6b6-5d6da9633866] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:50.645261 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8215cc99-d3f8-4c14-9d5a-52c2023eef9a tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:50.645540 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8215cc99-d3f8-4c14-9d5a-52c2023eef9a tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:50.645985 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8215cc99-d3f8-4c14-9d5a-52c2023eef9a tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:50.646725 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8215cc99-d3f8-4c14-9d5a-52c2023eef9a tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:50.650782 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8215cc99-d3f8-4c14-9d5a-52c2023eef9a tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:50.652611 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8215cc99-d3f8-4c14-9d5a-52c2023eef9a tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:50.824743 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8215cc99-d3f8-4c14-9d5a-52c2023eef9a tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:50.843089 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8215cc99-d3f8-4c14-9d5a-52c2023eef9a tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:50.848456 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8215cc99-d3f8-4c14-9d5a-52c2023eef9a tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:50.852571 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8215cc99-d3f8-4c14-9d5a-52c2023eef9a tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] 10.222.0.60 "GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866" status: 200 len: 1366 microversion: 2.57 time: 0.224723 Oct 18 15:49:50.869624 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2620/5250] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:49:50 2022] GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866 => generated 1366 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:49:50.908333 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5a7efd45-a6be-487b-8cc2-11cbe4c370c9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:50.923042 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5a7efd45-a6be-487b-8cc2-11cbe4c370c9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/4b8310b3-c20d-4832-a680-96c9120e3f00" status: 200 len: 1509 microversion: 2.1 time: 0.542655 Oct 18 15:49:50.924140 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2631/5251] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:50 2022] GET /compute/v2.1/servers/4b8310b3-c20d-4832-a680-96c9120e3f00 => generated 1509 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:49:50.947485 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eb785bd5-0986-4d46-bae5-2816e92c8e35 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:50.948387 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-eb785bd5-0986-4d46-bae5-2816e92c8e35 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 4b8310b3-c20d-4832-a680-96c9120e3f00] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:50.963655 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb785bd5-0986-4d46-bae5-2816e92c8e35 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:50.964167 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb785bd5-0986-4d46-bae5-2816e92c8e35 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:50.966488 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb785bd5-0986-4d46-bae5-2816e92c8e35 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:50.969952 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb785bd5-0986-4d46-bae5-2816e92c8e35 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:50.970458 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb785bd5-0986-4d46-bae5-2816e92c8e35 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:50.972236 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb785bd5-0986-4d46-bae5-2816e92c8e35 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:51.386587 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0c15b927-0c98-441f-8268-ae19253a69e3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:51.387226 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0c15b927-0c98-441f-8268-ae19253a69e3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:51.396571 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0c15b927-0c98-441f-8268-ae19253a69e3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:51.397372 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0c15b927-0c98-441f-8268-ae19253a69e3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:51.398208 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0c15b927-0c98-441f-8268-ae19253a69e3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:51.398208 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0c15b927-0c98-441f-8268-ae19253a69e3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:51.409779 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0c15b927-0c98-441f-8268-ae19253a69e3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:51.413112 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0c15b927-0c98-441f-8268-ae19253a69e3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:51.684641 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-eb785bd5-0986-4d46-bae5-2816e92c8e35 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:51.698866 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-eb785bd5-0986-4d46-bae5-2816e92c8e35 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/4b8310b3-c20d-4832-a680-96c9120e3f00" status: 200 len: 1509 microversion: 2.1 time: 0.755858 Oct 18 15:49:51.700733 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2621/5252] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:50 2022] GET /compute/v2.1/servers/4b8310b3-c20d-4832-a680-96c9120e3f00 => generated 1509 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:49:51.737907 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-36f0d311-5e07-40b6-bb0b-bac016d45867 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:51.744960 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-36f0d311-5e07-40b6-bb0b-bac016d45867 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 4b8310b3-c20d-4832-a680-96c9120e3f00] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:51.769258 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36f0d311-5e07-40b6-bb0b-bac016d45867 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:51.770126 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36f0d311-5e07-40b6-bb0b-bac016d45867 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:51.772430 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36f0d311-5e07-40b6-bb0b-bac016d45867 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:51.773310 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36f0d311-5e07-40b6-bb0b-bac016d45867 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:51.774862 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36f0d311-5e07-40b6-bb0b-bac016d45867 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:51.775607 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36f0d311-5e07-40b6-bb0b-bac016d45867 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:51.862684 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-36f0d311-5e07-40b6-bb0b-bac016d45867 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 4b8310b3-c20d-4832-a680-96c9120e3f00] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:49:52.108958 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-36f0d311-5e07-40b6-bb0b-bac016d45867 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4b8310b3-c20d-4832-a680-96c9120e3f00" status: 204 len: 0 microversion: 2.1 time: 0.385929 Oct 18 15:49:52.114738 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2622/5253] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:49:51 2022] DELETE /compute/v2.1/servers/4b8310b3-c20d-4832-a680-96c9120e3f00 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:49:52.122988 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a3bf4bcd-346d-4b24-9587-2d6bdb7bff60 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:52.123883 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a3bf4bcd-346d-4b24-9587-2d6bdb7bff60 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] [instance: cba4c533-6604-4e8a-b6b6-5d6da9633866] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:52.139111 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:52.141249 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3bf4bcd-346d-4b24-9587-2d6bdb7bff60 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:52.143464 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3bf4bcd-346d-4b24-9587-2d6bdb7bff60 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:52.143464 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3bf4bcd-346d-4b24-9587-2d6bdb7bff60 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:52.148300 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3bf4bcd-346d-4b24-9587-2d6bdb7bff60 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:52.148797 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3bf4bcd-346d-4b24-9587-2d6bdb7bff60 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:52.149271 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3bf4bcd-346d-4b24-9587-2d6bdb7bff60 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:52.155562 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0c15b927-0c98-441f-8268-ae19253a69e3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:52.175398 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0c15b927-0c98-441f-8268-ae19253a69e3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:52.180376 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0c15b927-0c98-441f-8268-ae19253a69e3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:52.185044 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0c15b927-0c98-441f-8268-ae19253a69e3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1736 microversion: 2.20 time: 0.800698 Oct 18 15:49:52.188038 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2632/5254] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:49:51 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1736 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:49:52.206359 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6afd8d85-9308-45da-9b29-9901b6c0d4df tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:52.209090 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6afd8d85-9308-45da-9b29-9901b6c0d4df tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 4b8310b3-c20d-4832-a680-96c9120e3f00] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:52.227389 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6afd8d85-9308-45da-9b29-9901b6c0d4df tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:52.230931 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6afd8d85-9308-45da-9b29-9901b6c0d4df tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:52.232612 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6afd8d85-9308-45da-9b29-9901b6c0d4df tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:52.234133 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6afd8d85-9308-45da-9b29-9901b6c0d4df tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:52.237775 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6afd8d85-9308-45da-9b29-9901b6c0d4df tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:52.238746 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6afd8d85-9308-45da-9b29-9901b6c0d4df tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:52.443587 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a3bf4bcd-346d-4b24-9587-2d6bdb7bff60 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:52.459294 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a3bf4bcd-346d-4b24-9587-2d6bdb7bff60 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:52.462114 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a3bf4bcd-346d-4b24-9587-2d6bdb7bff60 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:52.463878 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a3bf4bcd-346d-4b24-9587-2d6bdb7bff60 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] 10.222.0.60 "GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866" status: 200 len: 1366 microversion: 2.57 time: 0.349364 Oct 18 15:49:52.473679 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2623/5255] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:49:52 2022] GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866 => generated 1366 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:49:52.671279 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6afd8d85-9308-45da-9b29-9901b6c0d4df tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:52.682597 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6afd8d85-9308-45da-9b29-9901b6c0d4df tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/4b8310b3-c20d-4832-a680-96c9120e3f00" status: 200 len: 1515 microversion: 2.1 time: 0.493083 Oct 18 15:49:52.694646 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2633/5256] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:52 2022] GET /compute/v2.1/servers/4b8310b3-c20d-4832-a680-96c9120e3f00 => generated 1515 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:49:53.215588 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b254298f-d79d-4b17-9938-df5ede1342d9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:53.216212 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b254298f-d79d-4b17-9938-df5ede1342d9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:53.224165 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b254298f-d79d-4b17-9938-df5ede1342d9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:53.224677 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b254298f-d79d-4b17-9938-df5ede1342d9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:53.225151 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b254298f-d79d-4b17-9938-df5ede1342d9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:53.225883 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b254298f-d79d-4b17-9938-df5ede1342d9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:53.226327 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b254298f-d79d-4b17-9938-df5ede1342d9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:53.226758 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b254298f-d79d-4b17-9938-df5ede1342d9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:53.500394 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ee664377-a6eb-499e-9a99-0e8e8e29a196 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:53.501205 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ee664377-a6eb-499e-9a99-0e8e8e29a196 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] [instance: cba4c533-6604-4e8a-b6b6-5d6da9633866] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:53.512345 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ee664377-a6eb-499e-9a99-0e8e8e29a196 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:53.516779 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ee664377-a6eb-499e-9a99-0e8e8e29a196 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:53.521638 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ee664377-a6eb-499e-9a99-0e8e8e29a196 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:53.523110 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ee664377-a6eb-499e-9a99-0e8e8e29a196 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:53.524490 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ee664377-a6eb-499e-9a99-0e8e8e29a196 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:53.530972 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ee664377-a6eb-499e-9a99-0e8e8e29a196 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:53.541795 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:53.740600 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ee664377-a6eb-499e-9a99-0e8e8e29a196 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:53.751542 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ee664377-a6eb-499e-9a99-0e8e8e29a196 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:53.758570 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ee664377-a6eb-499e-9a99-0e8e8e29a196 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:53.759896 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ee664377-a6eb-499e-9a99-0e8e8e29a196 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] 10.222.0.60 "GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866" status: 200 len: 1366 microversion: 2.57 time: 0.263686 Oct 18 15:49:53.760500 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2634/5257] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:49:53 2022] GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866 => generated 1366 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:49:53.791856 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ca42294d-9058-4947-a37b-6748aa73473c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:53.792495 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ca42294d-9058-4947-a37b-6748aa73473c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 4b8310b3-c20d-4832-a680-96c9120e3f00] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:53.812404 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca42294d-9058-4947-a37b-6748aa73473c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:53.813186 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca42294d-9058-4947-a37b-6748aa73473c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:53.813530 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca42294d-9058-4947-a37b-6748aa73473c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:53.814623 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca42294d-9058-4947-a37b-6748aa73473c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:53.815789 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca42294d-9058-4947-a37b-6748aa73473c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:53.816414 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca42294d-9058-4947-a37b-6748aa73473c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:53.904676 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b254298f-d79d-4b17-9938-df5ede1342d9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:53.919850 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b254298f-d79d-4b17-9938-df5ede1342d9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:53.921596 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b254298f-d79d-4b17-9938-df5ede1342d9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:53.922854 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b254298f-d79d-4b17-9938-df5ede1342d9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1736 microversion: 2.20 time: 0.711207 Oct 18 15:49:53.934959 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2624/5258] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:49:53 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1736 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:49:54.193357 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ca42294d-9058-4947-a37b-6748aa73473c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:54.205544 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ca42294d-9058-4947-a37b-6748aa73473c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/4b8310b3-c20d-4832-a680-96c9120e3f00" status: 200 len: 1515 microversion: 2.1 time: 0.417589 Oct 18 15:49:54.221232 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2635/5259] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:53 2022] GET /compute/v2.1/servers/4b8310b3-c20d-4832-a680-96c9120e3f00 => generated 1515 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:49:54.787853 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c3b7456d-1974-4966-ade2-83ed9f97fdc6 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:54.788711 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c3b7456d-1974-4966-ade2-83ed9f97fdc6 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] [instance: cba4c533-6604-4e8a-b6b6-5d6da9633866] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:54.806421 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3b7456d-1974-4966-ade2-83ed9f97fdc6 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:54.806915 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3b7456d-1974-4966-ade2-83ed9f97fdc6 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:54.807347 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3b7456d-1974-4966-ade2-83ed9f97fdc6 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:54.808045 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3b7456d-1974-4966-ade2-83ed9f97fdc6 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:54.825209 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3b7456d-1974-4966-ade2-83ed9f97fdc6 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:54.826133 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3b7456d-1974-4966-ade2-83ed9f97fdc6 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:54.917641 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-5cc51a9d-a865-4f3a-bb48-e4ced4e2bcc3 req-555419e7-4135-4af9-99ab-9721501d7b00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b8310b3-c20d-4832-a680-96c9120e3f00", "name": "network-vif-deleted", "tag": "36b9bc4d-1f90-418f-a31e-855272239b9f"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:49:54.946520 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-5cc51a9d-a865-4f3a-bb48-e4ced4e2bcc3 req-555419e7-4135-4af9-99ab-9721501d7b00 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:54.947258 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-5cc51a9d-a865-4f3a-bb48-e4ced4e2bcc3 req-555419e7-4135-4af9-99ab-9721501d7b00 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:54.949418 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-5cc51a9d-a865-4f3a-bb48-e4ced4e2bcc3 req-555419e7-4135-4af9-99ab-9721501d7b00 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:54.989724 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-5cc51a9d-a865-4f3a-bb48-e4ced4e2bcc3 req-555419e7-4135-4af9-99ab-9721501d7b00 service nova] Creating event network-vif-deleted:36b9bc4d-1f90-418f-a31e-855272239b9f for instance 4b8310b3-c20d-4832-a680-96c9120e3f00 on n-h2-853682-5 Oct 18 15:49:55.006656 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-5cc51a9d-a865-4f3a-bb48-e4ced4e2bcc3 req-555419e7-4135-4af9-99ab-9721501d7b00 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092632 Oct 18 15:49:55.007297 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2636/5260] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:49:55.012627 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-03b370d5-a1a5-4474-aecf-e609a09c61f9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:55.029711 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-03b370d5-a1a5-4474-aecf-e609a09c61f9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:55.046743 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-03b370d5-a1a5-4474-aecf-e609a09c61f9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:55.057628 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-03b370d5-a1a5-4474-aecf-e609a09c61f9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:55.058394 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-03b370d5-a1a5-4474-aecf-e609a09c61f9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:55.063573 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-03b370d5-a1a5-4474-aecf-e609a09c61f9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:55.064272 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-03b370d5-a1a5-4474-aecf-e609a09c61f9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:55.064923 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-03b370d5-a1a5-4474-aecf-e609a09c61f9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:55.394766 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-03b370d5-a1a5-4474-aecf-e609a09c61f9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:55.410286 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-03b370d5-a1a5-4474-aecf-e609a09c61f9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:55.414923 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-03b370d5-a1a5-4474-aecf-e609a09c61f9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:55.416242 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-03b370d5-a1a5-4474-aecf-e609a09c61f9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1736 microversion: 2.20 time: 0.407797 Oct 18 15:49:55.416850 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2637/5261] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:49:55 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1736 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:49:55.444173 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-877cf180-b2ca-4372-a5ee-a8a5c48896a1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:55.446337 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-877cf180-b2ca-4372-a5ee-a8a5c48896a1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 4b8310b3-c20d-4832-a680-96c9120e3f00] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:55.488357 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-877cf180-b2ca-4372-a5ee-a8a5c48896a1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:55.490438 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-877cf180-b2ca-4372-a5ee-a8a5c48896a1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:55.491232 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-877cf180-b2ca-4372-a5ee-a8a5c48896a1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:55.494003 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-877cf180-b2ca-4372-a5ee-a8a5c48896a1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:55.497279 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-877cf180-b2ca-4372-a5ee-a8a5c48896a1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:55.498001 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-877cf180-b2ca-4372-a5ee-a8a5c48896a1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:55.580531 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c3b7456d-1974-4966-ade2-83ed9f97fdc6 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:55.581902 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-877cf180-b2ca-4372-a5ee-a8a5c48896a1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:55.582621 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-877cf180-b2ca-4372-a5ee-a8a5c48896a1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:55.583665 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-877cf180-b2ca-4372-a5ee-a8a5c48896a1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:55.584221 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-877cf180-b2ca-4372-a5ee-a8a5c48896a1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lazy-loading 'fault' on Instance uuid 4b8310b3-c20d-4832-a680-96c9120e3f00 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:49:55.604159 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c3b7456d-1974-4966-ade2-83ed9f97fdc6 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:55.605736 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c3b7456d-1974-4966-ade2-83ed9f97fdc6 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:55.606963 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c3b7456d-1974-4966-ade2-83ed9f97fdc6 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] 10.222.0.60 "GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866" status: 200 len: 1366 microversion: 2.57 time: 0.825206 Oct 18 15:49:55.620840 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2625/5262] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:49:54 2022] GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866 => generated 1366 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:49:55.675316 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-877cf180-b2ca-4372-a5ee-a8a5c48896a1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:55.684674 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-877cf180-b2ca-4372-a5ee-a8a5c48896a1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/4b8310b3-c20d-4832-a680-96c9120e3f00" status: 200 len: 1318 microversion: 2.1 time: 0.261077 Oct 18 15:49:55.686118 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2638/5263] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:55 2022] GET /compute/v2.1/servers/4b8310b3-c20d-4832-a680-96c9120e3f00 => generated 1318 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:49:56.447069 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e0b0b3c7-aae3-4bb9-a5a5-3c666f664381 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:56.448484 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e0b0b3c7-aae3-4bb9-a5a5-3c666f664381 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:56.457203 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e0b0b3c7-aae3-4bb9-a5a5-3c666f664381 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:56.458099 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e0b0b3c7-aae3-4bb9-a5a5-3c666f664381 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:56.458798 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e0b0b3c7-aae3-4bb9-a5a5-3c666f664381 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:56.459804 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e0b0b3c7-aae3-4bb9-a5a5-3c666f664381 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:56.460520 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e0b0b3c7-aae3-4bb9-a5a5-3c666f664381 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:56.461284 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e0b0b3c7-aae3-4bb9-a5a5-3c666f664381 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:56.640305 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9034bcdc-6134-4877-af04-3e510e5af1dc tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:56.641248 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9034bcdc-6134-4877-af04-3e510e5af1dc tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] [instance: cba4c533-6604-4e8a-b6b6-5d6da9633866] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:56.654867 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9034bcdc-6134-4877-af04-3e510e5af1dc tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:56.656619 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9034bcdc-6134-4877-af04-3e510e5af1dc tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:56.662114 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9034bcdc-6134-4877-af04-3e510e5af1dc tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:56.663146 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9034bcdc-6134-4877-af04-3e510e5af1dc tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:56.663894 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9034bcdc-6134-4877-af04-3e510e5af1dc tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:56.664510 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9034bcdc-6134-4877-af04-3e510e5af1dc tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:56.860407 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9034bcdc-6134-4877-af04-3e510e5af1dc tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:56.895471 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9034bcdc-6134-4877-af04-3e510e5af1dc tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:56.897323 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9034bcdc-6134-4877-af04-3e510e5af1dc tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:56.899291 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9034bcdc-6134-4877-af04-3e510e5af1dc tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] 10.222.0.60 "GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866" status: 200 len: 1366 microversion: 2.57 time: 0.265665 Oct 18 15:49:56.912835 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2639/5264] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:49:56 2022] GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866 => generated 1366 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:49:56.912835 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-08c1bf47-fc95-4b36-9921-9c9b3ab08df4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:56.912835 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-08c1bf47-fc95-4b36-9921-9c9b3ab08df4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 4b8310b3-c20d-4832-a680-96c9120e3f00] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:56.923450 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-08c1bf47-fc95-4b36-9921-9c9b3ab08df4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:56.924082 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-08c1bf47-fc95-4b36-9921-9c9b3ab08df4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:56.928995 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-08c1bf47-fc95-4b36-9921-9c9b3ab08df4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:56.932619 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-08c1bf47-fc95-4b36-9921-9c9b3ab08df4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:56.933343 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-08c1bf47-fc95-4b36-9921-9c9b3ab08df4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:56.933878 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-08c1bf47-fc95-4b36-9921-9c9b3ab08df4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:56.962671 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-08c1bf47-fc95-4b36-9921-9c9b3ab08df4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] HTTP exception thrown: Instance 4b8310b3-c20d-4832-a680-96c9120e3f00 could not be found. Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-08c1bf47-fc95-4b36-9921-9c9b3ab08df4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Request method failure captured: Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/4b8310b3-c20d-4832-a680-96c9120e3f00 HTTP/1.1 Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsrEJhXnu9-kA1ME2ZgtL01L1ZZn_p1cwLPkqNlVzGclz5bmzyyOf2BB4P7wVe6-U6KsqFzM-iyEynyHjx99j1zL9TNO9M1_0gjdhVd46w55yQ-UymJhYbErDED9EKpU_GJnghtBqaCd9UvgTeTf4e4PvQGeOp69vMSi60uoNlhyAmg Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: afdb1e8b478f463987ec223f2d10db33 Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServersTestJSON-126042862 Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServersTestJSON-126042862 Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: afdb1e8b478f463987ec223f2d10db33 Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServersTestJSON-126042862 Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServersTestJSON-126042862-project Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 73f4ee2e7ff34dd88b9b82fefbf06a36 Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServersTestJSON-126042862-project Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 4b8310b3-c20d-4832-a680-96c9120e3f00 could not be found. Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '4b8310b3-c20d-4832-a680-96c9120e3f00'} Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b8310b3-c20d-4832-a680-96c9120e3f00 could not be found. Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b8310b3-c20d-4832-a680-96c9120e3f00 could not be found. Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:49:56.965696 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:49:56.971685 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:49:56.971685 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:49:56.971685 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:49:56.971685 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:49:56.971685 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b8310b3-c20d-4832-a680-96c9120e3f00 could not be found. Oct 18 15:49:56.971685 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:49:56.981156 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-08c1bf47-fc95-4b36-9921-9c9b3ab08df4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Returning 404 to user: Instance 4b8310b3-c20d-4832-a680-96c9120e3f00 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:49:56.986918 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-08c1bf47-fc95-4b36-9921-9c9b3ab08df4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/4b8310b3-c20d-4832-a680-96c9120e3f00" status: 404 len: 111 microversion: 2.1 time: 0.084228 Oct 18 15:49:56.989303 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2640/5265] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:56 2022] GET /compute/v2.1/servers/4b8310b3-c20d-4832-a680-96c9120e3f00 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:49:57.000913 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-33cc5822-2b62-49c5-a943-f73894dbc48f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '.version_select at 0x7f7c415dbee0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:57.035941 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-33cc5822-2b62-49c5-a943-f73894dbc48f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-key-300304664" status: 202 len: 0 microversion: 2.1 time: 0.040930 Oct 18 15:49:57.039961 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2641/5266] 10.222.0.60 () {58 vars in 1206 bytes} [Tue Oct 18 15:49:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-300304664 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:49:57.134446 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e0b0b3c7-aae3-4bb9-a5a5-3c666f664381 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:57.147142 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e0b0b3c7-aae3-4bb9-a5a5-3c666f664381 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:57.151737 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e0b0b3c7-aae3-4bb9-a5a5-3c666f664381 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:57.152992 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e0b0b3c7-aae3-4bb9-a5a5-3c666f664381 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1718 microversion: 2.20 time: 0.710852 Oct 18 15:49:57.169210 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2626/5267] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:49:56 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1718 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:49:57.228557 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-557fd2c0-50a4-40c3-a32f-e3389c6519bd tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1520842512", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "5126a012-82e3-4304-a7ec-ac28e05a407b"}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:49:57.305029 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-557fd2c0-50a4-40c3-a32f-e3389c6519bd tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] validate_networks() for [('5126a012-82e3-4304-a7ec-ac28e05a407b', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:49:57.947908 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8818b8b2-dfea-4198-91c1-96359d6597d2 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:57.949785 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8818b8b2-dfea-4198-91c1-96359d6597d2 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] [instance: cba4c533-6604-4e8a-b6b6-5d6da9633866] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:57.968554 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8818b8b2-dfea-4198-91c1-96359d6597d2 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:57.969487 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8818b8b2-dfea-4198-91c1-96359d6597d2 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:57.972650 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8818b8b2-dfea-4198-91c1-96359d6597d2 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:57.973706 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8818b8b2-dfea-4198-91c1-96359d6597d2 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:57.975224 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8818b8b2-dfea-4198-91c1-96359d6597d2 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:57.978066 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8818b8b2-dfea-4198-91c1-96359d6597d2 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:58.155591 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8818b8b2-dfea-4198-91c1-96359d6597d2 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:58.170914 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8818b8b2-dfea-4198-91c1-96359d6597d2 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:58.176571 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8818b8b2-dfea-4198-91c1-96359d6597d2 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:58.183536 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8818b8b2-dfea-4198-91c1-96359d6597d2 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] 10.222.0.60 "GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866" status: 200 len: 1366 microversion: 2.57 time: 0.256376 Oct 18 15:49:58.188976 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2627/5268] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:49:57 2022] GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866 => generated 1366 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:49:58.194304 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2c7c7427-c240-4b29-904e-b7ffa8251990 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:58.201462 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2c7c7427-c240-4b29-904e-b7ffa8251990 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:58.214918 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c7c7427-c240-4b29-904e-b7ffa8251990 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:58.217596 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c7c7427-c240-4b29-904e-b7ffa8251990 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:58.218312 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c7c7427-c240-4b29-904e-b7ffa8251990 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:58.219436 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c7c7427-c240-4b29-904e-b7ffa8251990 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:58.221134 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c7c7427-c240-4b29-904e-b7ffa8251990 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:58.222384 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c7c7427-c240-4b29-904e-b7ffa8251990 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:58.578974 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-557fd2c0-50a4-40c3-a32f-e3389c6519bd tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:49:58.580037 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-557fd2c0-50a4-40c3-a32f-e3389c6519bd tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:49:58.581722 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-557fd2c0-50a4-40c3-a32f-e3389c6519bd tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:49:58.582918 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-557fd2c0-50a4-40c3-a32f-e3389c6519bd tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:49:58.583485 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-557fd2c0-50a4-40c3-a32f-e3389c6519bd tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:49:58.604147 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-557fd2c0-50a4-40c3-a32f-e3389c6519bd tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:58.605155 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-557fd2c0-50a4-40c3-a32f-e3389c6519bd tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:58.605833 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-557fd2c0-50a4-40c3-a32f-e3389c6519bd tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:58.606834 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-557fd2c0-50a4-40c3-a32f-e3389c6519bd tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:58.607591 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-557fd2c0-50a4-40c3-a32f-e3389c6519bd tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:58.608341 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-557fd2c0-50a4-40c3-a32f-e3389c6519bd tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:58.639151 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-557fd2c0-50a4-40c3-a32f-e3389c6519bd tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Getting quotas for project afdb1e8b478f463987ec223f2d10db33. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:49:58.649229 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-557fd2c0-50a4-40c3-a32f-e3389c6519bd tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Getting quotas for user 73f4ee2e7ff34dd88b9b82fefbf06a36 and project afdb1e8b478f463987ec223f2d10db33. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:49:58.668194 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-557fd2c0-50a4-40c3-a32f-e3389c6519bd tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:49:58.672658 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-557fd2c0-50a4-40c3-a32f-e3389c6519bd tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: d3069d75-261b-4abe-a68b-fc25cac7e549] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:49:58.691179 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2c7c7427-c240-4b29-904e-b7ffa8251990 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:58.702209 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:58.712829 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2c7c7427-c240-4b29-904e-b7ffa8251990 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:58.718735 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2c7c7427-c240-4b29-904e-b7ffa8251990 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:58.720109 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2c7c7427-c240-4b29-904e-b7ffa8251990 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1718 microversion: 2.20 time: 0.529685 Oct 18 15:49:58.720719 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2628/5269] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:49:58 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1718 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:49:58.794043 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-557fd2c0-50a4-40c3-a32f-e3389c6519bd tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.570605 Oct 18 15:49:58.800373 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2642/5270] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:49:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:49:58.810630 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7244e7aa-be9b-4455-88c2-fff3fb1e23a4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:58.811356 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7244e7aa-be9b-4455-88c2-fff3fb1e23a4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: d3069d75-261b-4abe-a68b-fc25cac7e549] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:58.962239 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7244e7aa-be9b-4455-88c2-fff3fb1e23a4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:58.982537 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7244e7aa-be9b-4455-88c2-fff3fb1e23a4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/d3069d75-261b-4abe-a68b-fc25cac7e549" status: 200 len: 1209 microversion: 2.1 time: 0.175563 Oct 18 15:49:58.985991 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2629/5271] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:49:58 2022] GET /compute/v2.1/servers/d3069d75-261b-4abe-a68b-fc25cac7e549 => generated 1209 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:49:59.216012 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2482c1c6-1b43-48cf-824c-aab9e93f8a10 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:59.217065 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2482c1c6-1b43-48cf-824c-aab9e93f8a10 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] [instance: cba4c533-6604-4e8a-b6b6-5d6da9633866] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:59.231210 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2482c1c6-1b43-48cf-824c-aab9e93f8a10 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:59.231720 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2482c1c6-1b43-48cf-824c-aab9e93f8a10 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:59.232177 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2482c1c6-1b43-48cf-824c-aab9e93f8a10 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:59.232934 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2482c1c6-1b43-48cf-824c-aab9e93f8a10 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:59.233407 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2482c1c6-1b43-48cf-824c-aab9e93f8a10 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:59.233955 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2482c1c6-1b43-48cf-824c-aab9e93f8a10 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:59.495717 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2482c1c6-1b43-48cf-824c-aab9e93f8a10 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:59.508462 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2482c1c6-1b43-48cf-824c-aab9e93f8a10 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:59.509980 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2482c1c6-1b43-48cf-824c-aab9e93f8a10 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:49:59.518847 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2482c1c6-1b43-48cf-824c-aab9e93f8a10 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] 10.222.0.60 "GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866" status: 200 len: 1366 microversion: 2.57 time: 0.306890 Oct 18 15:49:59.532847 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2643/5272] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:49:59 2022] GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866 => generated 1366 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:49:59.752836 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ca7dfff1-c5f2-4851-95a8-82eae900a69e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:49:59.753722 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ca7dfff1-c5f2-4851-95a8-82eae900a69e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:49:59.779252 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca7dfff1-c5f2-4851-95a8-82eae900a69e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:59.782716 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca7dfff1-c5f2-4851-95a8-82eae900a69e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:59.785421 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca7dfff1-c5f2-4851-95a8-82eae900a69e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:49:59.786509 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca7dfff1-c5f2-4851-95a8-82eae900a69e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:49:59.789188 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca7dfff1-c5f2-4851-95a8-82eae900a69e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:49:59.789934 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca7dfff1-c5f2-4851-95a8-82eae900a69e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:00.008329 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fcb42b48-019a-4376-b53a-a7646eaaeb14 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:00.009007 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-fcb42b48-019a-4376-b53a-a7646eaaeb14 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: d3069d75-261b-4abe-a68b-fc25cac7e549] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:00.031181 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fcb42b48-019a-4376-b53a-a7646eaaeb14 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:00.034574 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fcb42b48-019a-4376-b53a-a7646eaaeb14 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:00.035079 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fcb42b48-019a-4376-b53a-a7646eaaeb14 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:00.035893 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fcb42b48-019a-4376-b53a-a7646eaaeb14 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:00.038739 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fcb42b48-019a-4376-b53a-a7646eaaeb14 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:00.039235 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fcb42b48-019a-4376-b53a-a7646eaaeb14 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:00.900336 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-fcb42b48-019a-4376-b53a-a7646eaaeb14 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:00.912663 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fcb42b48-019a-4376-b53a-a7646eaaeb14 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/d3069d75-261b-4abe-a68b-fc25cac7e549" status: 200 len: 1261 microversion: 2.1 time: 0.908221 Oct 18 15:50:00.915346 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2644/5273] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:00 2022] GET /compute/v2.1/servers/d3069d75-261b-4abe-a68b-fc25cac7e549 => generated 1261 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:00.933505 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-b6812e80-ce68-44b3-a95a-d3ab3fc803b3 req-62b97d87-feca-4645-a953-fee55b6065c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b465248f-ab7a-4aba-b939-6f236eea166e", "name": "network-vif-unplugged", "status": "completed", "tag": "440cc1c1-492e-40b0-8244-adb2559e6c7f"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:50:00.953538 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-b6812e80-ce68-44b3-a95a-d3ab3fc803b3 req-62b97d87-feca-4645-a953-fee55b6065c5 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:00.954435 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-b6812e80-ce68-44b3-a95a-d3ab3fc803b3 req-62b97d87-feca-4645-a953-fee55b6065c5 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:00.956236 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-b6812e80-ce68-44b3-a95a-d3ab3fc803b3 req-62b97d87-feca-4645-a953-fee55b6065c5 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:00.991685 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-b6812e80-ce68-44b3-a95a-d3ab3fc803b3 req-62b97d87-feca-4645-a953-fee55b6065c5 service nova] Creating event network-vif-unplugged:440cc1c1-492e-40b0-8244-adb2559e6c7f for instance b465248f-ab7a-4aba-b939-6f236eea166e on n-h1-853682-5 Oct 18 15:50:01.006151 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-b6812e80-ce68-44b3-a95a-d3ab3fc803b3 req-62b97d87-feca-4645-a953-fee55b6065c5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088676 Oct 18 15:50:01.012755 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2645/5274] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:50:01.019237 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-faa6527d-a3bf-4a1f-bbdc-361fe556f0c0 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:01.019953 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-faa6527d-a3bf-4a1f-bbdc-361fe556f0c0 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] [instance: cba4c533-6604-4e8a-b6b6-5d6da9633866] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:01.027929 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-faa6527d-a3bf-4a1f-bbdc-361fe556f0c0 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:01.028428 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-faa6527d-a3bf-4a1f-bbdc-361fe556f0c0 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:01.028906 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-faa6527d-a3bf-4a1f-bbdc-361fe556f0c0 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:01.029616 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-faa6527d-a3bf-4a1f-bbdc-361fe556f0c0 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:01.030076 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-faa6527d-a3bf-4a1f-bbdc-361fe556f0c0 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:01.030506 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-faa6527d-a3bf-4a1f-bbdc-361fe556f0c0 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:01.242278 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-faa6527d-a3bf-4a1f-bbdc-361fe556f0c0 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:01.258085 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-faa6527d-a3bf-4a1f-bbdc-361fe556f0c0 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:01.260864 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-faa6527d-a3bf-4a1f-bbdc-361fe556f0c0 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:01.262508 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-faa6527d-a3bf-4a1f-bbdc-361fe556f0c0 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] 10.222.0.60 "GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866" status: 200 len: 1366 microversion: 2.57 time: 0.248376 Oct 18 15:50:01.263144 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ca7dfff1-c5f2-4851-95a8-82eae900a69e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:01.264921 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2646/5275] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:50:01 2022] GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866 => generated 1366 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:50:01.282032 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ca7dfff1-c5f2-4851-95a8-82eae900a69e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:01.283503 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ca7dfff1-c5f2-4851-95a8-82eae900a69e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:01.286117 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ca7dfff1-c5f2-4851-95a8-82eae900a69e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1718 microversion: 2.20 time: 1.541159 Oct 18 15:50:01.287048 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2630/5276] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:49:59 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1718 bytes in 1544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:50:01.938399 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-321865e7-25f5-4634-93c8-685714c0ad3f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:01.939808 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-321865e7-25f5-4634-93c8-685714c0ad3f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: d3069d75-261b-4abe-a68b-fc25cac7e549] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:01.953126 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-321865e7-25f5-4634-93c8-685714c0ad3f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:01.953633 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-321865e7-25f5-4634-93c8-685714c0ad3f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:01.954301 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-321865e7-25f5-4634-93c8-685714c0ad3f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:01.955029 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-321865e7-25f5-4634-93c8-685714c0ad3f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:01.956044 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-321865e7-25f5-4634-93c8-685714c0ad3f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:01.956469 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-321865e7-25f5-4634-93c8-685714c0ad3f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:02.155028 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-321865e7-25f5-4634-93c8-685714c0ad3f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:02.169706 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-321865e7-25f5-4634-93c8-685714c0ad3f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/d3069d75-261b-4abe-a68b-fc25cac7e549" status: 200 len: 1267 microversion: 2.1 time: 0.233482 Oct 18 15:50:02.171740 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2647/5277] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:01 2022] GET /compute/v2.1/servers/d3069d75-261b-4abe-a68b-fc25cac7e549 => generated 1267 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:02.292725 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dad8c382-c691-49a0-906a-03c5dec2e0fd tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:02.295099 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dad8c382-c691-49a0-906a-03c5dec2e0fd tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] [instance: cba4c533-6604-4e8a-b6b6-5d6da9633866] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:02.314195 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-dd8e4617-b978-4256-aaad-4f7daad1ca64 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:02.315822 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-dd8e4617-b978-4256-aaad-4f7daad1ca64 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:02.337299 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dd8e4617-b978-4256-aaad-4f7daad1ca64 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:02.337679 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dad8c382-c691-49a0-906a-03c5dec2e0fd tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:02.338385 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dad8c382-c691-49a0-906a-03c5dec2e0fd tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:02.339121 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dd8e4617-b978-4256-aaad-4f7daad1ca64 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:02.339937 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dad8c382-c691-49a0-906a-03c5dec2e0fd tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:02.340707 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dd8e4617-b978-4256-aaad-4f7daad1ca64 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:02.341714 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dad8c382-c691-49a0-906a-03c5dec2e0fd tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:02.343538 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dd8e4617-b978-4256-aaad-4f7daad1ca64 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:02.344267 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dad8c382-c691-49a0-906a-03c5dec2e0fd tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:02.345013 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dd8e4617-b978-4256-aaad-4f7daad1ca64 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:02.345856 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dad8c382-c691-49a0-906a-03c5dec2e0fd tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:02.349563 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dd8e4617-b978-4256-aaad-4f7daad1ca64 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:02.814412 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dad8c382-c691-49a0-906a-03c5dec2e0fd tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:02.835121 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dad8c382-c691-49a0-906a-03c5dec2e0fd tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:02.842240 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dad8c382-c691-49a0-906a-03c5dec2e0fd tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:02.851595 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dad8c382-c691-49a0-906a-03c5dec2e0fd tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] 10.222.0.60 "GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866" status: 200 len: 1366 microversion: 2.57 time: 0.560842 Oct 18 15:50:02.854746 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2631/5278] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:50:02 2022] GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866 => generated 1366 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:50:03.075930 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-2b41a967-98fd-4dfb-a00a-770d5f5ee08d req-217a90d6-6973-4bc3-a247-82e6b4628001 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b465248f-ab7a-4aba-b939-6f236eea166e", "tag": "440cc1c1-492e-40b0-8244-adb2559e6c7f"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:50:03.131280 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2b41a967-98fd-4dfb-a00a-770d5f5ee08d req-217a90d6-6973-4bc3-a247-82e6b4628001 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:03.137541 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2b41a967-98fd-4dfb-a00a-770d5f5ee08d req-217a90d6-6973-4bc3-a247-82e6b4628001 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:03.138118 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2b41a967-98fd-4dfb-a00a-770d5f5ee08d req-217a90d6-6973-4bc3-a247-82e6b4628001 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:03.183958 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-2b41a967-98fd-4dfb-a00a-770d5f5ee08d req-217a90d6-6973-4bc3-a247-82e6b4628001 service nova] Creating event network-changed:440cc1c1-492e-40b0-8244-adb2559e6c7f for instance b465248f-ab7a-4aba-b939-6f236eea166e on n-h1-853682-5 Oct 18 15:50:03.197108 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-2b41a967-98fd-4dfb-a00a-770d5f5ee08d req-217a90d6-6973-4bc3-a247-82e6b4628001 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132663 Oct 18 15:50:03.199497 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2632/5279] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:50:03.218218 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c43a616a-4fa6-4c0c-a649-55b1fc52c2c0 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:03.218957 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c43a616a-4fa6-4c0c-a649-55b1fc52c2c0 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: d3069d75-261b-4abe-a68b-fc25cac7e549] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:03.242079 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c43a616a-4fa6-4c0c-a649-55b1fc52c2c0 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:03.243265 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c43a616a-4fa6-4c0c-a649-55b1fc52c2c0 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:03.244292 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c43a616a-4fa6-4c0c-a649-55b1fc52c2c0 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:03.245075 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c43a616a-4fa6-4c0c-a649-55b1fc52c2c0 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:03.245982 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c43a616a-4fa6-4c0c-a649-55b1fc52c2c0 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:03.247744 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c43a616a-4fa6-4c0c-a649-55b1fc52c2c0 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:03.357600 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:50:03.547327 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-dd8e4617-b978-4256-aaad-4f7daad1ca64 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:03.562526 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-dd8e4617-b978-4256-aaad-4f7daad1ca64 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:03.570027 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-dd8e4617-b978-4256-aaad-4f7daad1ca64 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:03.572024 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-dd8e4617-b978-4256-aaad-4f7daad1ca64 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1718 microversion: 2.20 time: 1.262740 Oct 18 15:50:03.575221 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2648/5280] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:50:02 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1718 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:50:03.885520 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ae979abc-4729-4c9a-8443-15ba6d8212eb tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:03.886340 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ae979abc-4729-4c9a-8443-15ba6d8212eb tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] [instance: cba4c533-6604-4e8a-b6b6-5d6da9633866] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:03.895940 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae979abc-4729-4c9a-8443-15ba6d8212eb tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:03.896480 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae979abc-4729-4c9a-8443-15ba6d8212eb tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:03.896949 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae979abc-4729-4c9a-8443-15ba6d8212eb tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:03.897881 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae979abc-4729-4c9a-8443-15ba6d8212eb tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:03.898538 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae979abc-4729-4c9a-8443-15ba6d8212eb tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:03.899136 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae979abc-4729-4c9a-8443-15ba6d8212eb tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:04.375660 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ae979abc-4729-4c9a-8443-15ba6d8212eb tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:04.392373 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ae979abc-4729-4c9a-8443-15ba6d8212eb tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:04.395158 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ae979abc-4729-4c9a-8443-15ba6d8212eb tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:04.396490 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ae979abc-4729-4c9a-8443-15ba6d8212eb tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] 10.222.0.60 "GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866" status: 200 len: 1366 microversion: 2.57 time: 0.515940 Oct 18 15:50:04.397334 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2649/5281] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:50:03 2022] GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866 => generated 1366 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:50:04.606072 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3ce7600c-7f96-4826-a32a-730fa6f6e776 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:04.606735 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3ce7600c-7f96-4826-a32a-730fa6f6e776 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:04.621561 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ce7600c-7f96-4826-a32a-730fa6f6e776 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:04.622069 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ce7600c-7f96-4826-a32a-730fa6f6e776 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:04.622514 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ce7600c-7f96-4826-a32a-730fa6f6e776 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:04.623257 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ce7600c-7f96-4826-a32a-730fa6f6e776 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:04.623707 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ce7600c-7f96-4826-a32a-730fa6f6e776 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:04.624137 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ce7600c-7f96-4826-a32a-730fa6f6e776 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:04.767698 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c43a616a-4fa6-4c0c-a649-55b1fc52c2c0 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:04.779355 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c43a616a-4fa6-4c0c-a649-55b1fc52c2c0 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/d3069d75-261b-4abe-a68b-fc25cac7e549" status: 200 len: 1309 microversion: 2.1 time: 1.577148 Oct 18 15:50:04.780627 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2633/5282] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:03 2022] GET /compute/v2.1/servers/d3069d75-261b-4abe-a68b-fc25cac7e549 => generated 1309 bytes in 1580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:05.430637 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7d90994d-3c79-407f-9fb6-ebbe76aa2554 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:05.432787 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7d90994d-3c79-407f-9fb6-ebbe76aa2554 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] [instance: cba4c533-6604-4e8a-b6b6-5d6da9633866] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:05.448442 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d90994d-3c79-407f-9fb6-ebbe76aa2554 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:05.458979 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d90994d-3c79-407f-9fb6-ebbe76aa2554 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:05.461532 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d90994d-3c79-407f-9fb6-ebbe76aa2554 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:05.463236 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d90994d-3c79-407f-9fb6-ebbe76aa2554 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:05.465495 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d90994d-3c79-407f-9fb6-ebbe76aa2554 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:05.468456 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d90994d-3c79-407f-9fb6-ebbe76aa2554 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:05.483194 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3ce7600c-7f96-4826-a32a-730fa6f6e776 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:05.492496 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3ce7600c-7f96-4826-a32a-730fa6f6e776 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:05.500186 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3ce7600c-7f96-4826-a32a-730fa6f6e776 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:05.501695 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3ce7600c-7f96-4826-a32a-730fa6f6e776 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1661 microversion: 2.20 time: 0.899684 Oct 18 15:50:05.509981 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2650/5283] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:50:04 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1661 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:50:05.539524 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-37970d75-687b-4a0a-a0d7-682caa8fe623 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "89a3c710-d937-4189-928f-ac35d9b94338"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:50:05.542237 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-37970d75-687b-4a0a-a0d7-682caa8fe623 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:05.585649 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37970d75-687b-4a0a-a0d7-682caa8fe623 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:05.586286 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37970d75-687b-4a0a-a0d7-682caa8fe623 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:05.586745 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37970d75-687b-4a0a-a0d7-682caa8fe623 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:05.587585 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37970d75-687b-4a0a-a0d7-682caa8fe623 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:05.587952 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37970d75-687b-4a0a-a0d7-682caa8fe623 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:05.588384 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37970d75-687b-4a0a-a0d7-682caa8fe623 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:05.932010 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7d90994d-3c79-407f-9fb6-ebbe76aa2554 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:05.947296 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7d90994d-3c79-407f-9fb6-ebbe76aa2554 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:05.952402 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7d90994d-3c79-407f-9fb6-ebbe76aa2554 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:05.953903 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7d90994d-3c79-407f-9fb6-ebbe76aa2554 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] 10.222.0.60 "GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866" status: 200 len: 1366 microversion: 2.57 time: 0.532230 Oct 18 15:50:05.954695 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2634/5284] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:50:05 2022] GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866 => generated 1366 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:50:06.110943 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:50:06.139339 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-37970d75-687b-4a0a-a0d7-682caa8fe623 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "POST /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.604583 Oct 18 15:50:06.140261 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2651/5285] 10.222.0.60 () {62 vars in 1364 bytes} [Tue Oct 18 15:50:05 2022] POST /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e/os-volume_attachments => generated 188 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 15:50:06.176333 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b08cd350-8889-4054-a1b4-ee062bd194a6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:06.179925 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b08cd350-8889-4054-a1b4-ee062bd194a6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: d3069d75-261b-4abe-a68b-fc25cac7e549] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:06.193870 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b08cd350-8889-4054-a1b4-ee062bd194a6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:06.194603 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b08cd350-8889-4054-a1b4-ee062bd194a6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:06.197312 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b08cd350-8889-4054-a1b4-ee062bd194a6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:06.201140 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b08cd350-8889-4054-a1b4-ee062bd194a6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:06.202173 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b08cd350-8889-4054-a1b4-ee062bd194a6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:06.203348 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b08cd350-8889-4054-a1b4-ee062bd194a6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:06.334960 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2d13b734-bf5c-403a-9616-5bc696ecb78a tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-219220007", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:50:06.441228 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-2d13b734-bf5c-403a-9616-5bc696ecb78a tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] validate_networks() for [('b861343f-1d52-458f-a797-60934e302b9c', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:50:06.967192 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b08cd350-8889-4054-a1b4-ee062bd194a6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:06.990213 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b08cd350-8889-4054-a1b4-ee062bd194a6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/d3069d75-261b-4abe-a68b-fc25cac7e549" status: 200 len: 1309 microversion: 2.1 time: 0.848286 Oct 18 15:50:06.991242 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2652/5286] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:06 2022] GET /compute/v2.1/servers/d3069d75-261b-4abe-a68b-fc25cac7e549 => generated 1309 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:06.996675 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-33fa0361-5444-4613-a8c0-8e2dca5f2c1c tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:50:06.998187 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-33fa0361-5444-4613-a8c0-8e2dca5f2c1c tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:07.015786 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-33fa0361-5444-4613-a8c0-8e2dca5f2c1c tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:07.019082 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-33fa0361-5444-4613-a8c0-8e2dca5f2c1c tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:07.019775 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-33fa0361-5444-4613-a8c0-8e2dca5f2c1c tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:07.021106 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-33fa0361-5444-4613-a8c0-8e2dca5f2c1c tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:07.021879 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-33fa0361-5444-4613-a8c0-8e2dca5f2c1c tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:07.024134 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-33fa0361-5444-4613-a8c0-8e2dca5f2c1c tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:07.182041 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-33fa0361-5444-4613-a8c0-8e2dca5f2c1c tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120405) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 18 15:50:07.357755 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-33fa0361-5444-4613-a8c0-8e2dca5f2c1c tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "POST /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e/action" status: 202 len: 0 microversion: 2.20 time: 0.365176 Oct 18 15:50:07.359863 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2653/5287] 10.222.0.60 () {62 vars in 1319 bytes} [Tue Oct 18 15:50:06 2022] POST /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e/action => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:50:07.393856 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ebfcd3a2-7ca1-41cc-83c2-8af728dc4c42 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:07.395409 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ebfcd3a2-7ca1-41cc-83c2-8af728dc4c42 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] [instance: cba4c533-6604-4e8a-b6b6-5d6da9633866] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:07.424268 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ebfcd3a2-7ca1-41cc-83c2-8af728dc4c42 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:07.426293 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ebfcd3a2-7ca1-41cc-83c2-8af728dc4c42 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:07.429770 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ebfcd3a2-7ca1-41cc-83c2-8af728dc4c42 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:07.431580 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ebfcd3a2-7ca1-41cc-83c2-8af728dc4c42 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:07.434808 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ebfcd3a2-7ca1-41cc-83c2-8af728dc4c42 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:07.435942 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ebfcd3a2-7ca1-41cc-83c2-8af728dc4c42 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:07.677666 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ebfcd3a2-7ca1-41cc-83c2-8af728dc4c42 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:07.695561 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ebfcd3a2-7ca1-41cc-83c2-8af728dc4c42 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:07.698318 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ebfcd3a2-7ca1-41cc-83c2-8af728dc4c42 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:07.700156 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ebfcd3a2-7ca1-41cc-83c2-8af728dc4c42 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] 10.222.0.60 "GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866" status: 200 len: 1366 microversion: 2.57 time: 0.338830 Oct 18 15:50:07.714862 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2654/5288] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:50:07 2022] GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866 => generated 1366 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:50:07.729265 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8336ec23-1910-456b-9e8d-4ff53dce387e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:07.730192 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8336ec23-1910-456b-9e8d-4ff53dce387e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:07.742634 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8336ec23-1910-456b-9e8d-4ff53dce387e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:07.743339 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8336ec23-1910-456b-9e8d-4ff53dce387e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:07.744035 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8336ec23-1910-456b-9e8d-4ff53dce387e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:07.745718 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8336ec23-1910-456b-9e8d-4ff53dce387e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:07.746205 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8336ec23-1910-456b-9e8d-4ff53dce387e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:07.747211 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8336ec23-1910-456b-9e8d-4ff53dce387e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:08.447999 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-2d13b734-bf5c-403a-9616-5bc696ecb78a tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:50:08.448948 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-2d13b734-bf5c-403a-9616-5bc696ecb78a tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:50:08.449535 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-2d13b734-bf5c-403a-9616-5bc696ecb78a tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:50:08.450207 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-2d13b734-bf5c-403a-9616-5bc696ecb78a tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:50:08.450890 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-2d13b734-bf5c-403a-9616-5bc696ecb78a tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:50:08.472057 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d13b734-bf5c-403a-9616-5bc696ecb78a tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:08.472828 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d13b734-bf5c-403a-9616-5bc696ecb78a tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:08.473395 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d13b734-bf5c-403a-9616-5bc696ecb78a tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:08.474243 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d13b734-bf5c-403a-9616-5bc696ecb78a tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:08.479495 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d13b734-bf5c-403a-9616-5bc696ecb78a tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:08.480080 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d13b734-bf5c-403a-9616-5bc696ecb78a tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:08.527817 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-2d13b734-bf5c-403a-9616-5bc696ecb78a tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Getting quotas for project 103b0fb8d9184bf09acde8f6f98eb018. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:50:08.555533 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-2d13b734-bf5c-403a-9616-5bc696ecb78a tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Getting quotas for user b8fed4f99b0845f69f77530084b11042 and project 103b0fb8d9184bf09acde8f6f98eb018. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:50:08.574191 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2d13b734-bf5c-403a-9616-5bc696ecb78a tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:50:08.577512 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2d13b734-bf5c-403a-9616-5bc696ecb78a tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: ebefddda-1a5f-485c-a89b-697fe8119af0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:50:08.623461 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:50:08.659688 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=6 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:50:08.693241 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2d13b734-bf5c-403a-9616-5bc696ecb78a tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.716153 Oct 18 15:50:08.695588 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2635/5289] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:50:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 2740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:50:08.708539 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d3dabdf5-8529-4c0c-ad49-b330bb3ef288 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:08.709316 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d3dabdf5-8529-4c0c-ad49-b330bb3ef288 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: d3069d75-261b-4abe-a68b-fc25cac7e549] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:08.721832 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3dabdf5-8529-4c0c-ad49-b330bb3ef288 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:08.739075 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3dabdf5-8529-4c0c-ad49-b330bb3ef288 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:08.741192 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3dabdf5-8529-4c0c-ad49-b330bb3ef288 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:08.744282 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3dabdf5-8529-4c0c-ad49-b330bb3ef288 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:08.745818 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3dabdf5-8529-4c0c-ad49-b330bb3ef288 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:08.746757 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3dabdf5-8529-4c0c-ad49-b330bb3ef288 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:08.748324 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8336ec23-1910-456b-9e8d-4ff53dce387e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:08.760688 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8336ec23-1910-456b-9e8d-4ff53dce387e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:08.769467 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8336ec23-1910-456b-9e8d-4ff53dce387e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:08.770705 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8336ec23-1910-456b-9e8d-4ff53dce387e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1747 microversion: 2.20 time: 1.054243 Oct 18 15:50:08.782847 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2655/5290] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:50:07 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1747 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:50:08.800253 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a2354dc5-9035-478f-a9e5-8c6d50c241d2 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:08.800253 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a2354dc5-9035-478f-a9e5-8c6d50c241d2 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: ebefddda-1a5f-485c-a89b-697fe8119af0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:09.041681 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a2354dc5-9035-478f-a9e5-8c6d50c241d2 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:09.051595 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a2354dc5-9035-478f-a9e5-8c6d50c241d2 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0" status: 200 len: 1213 microversion: 2.1 time: 0.266755 Oct 18 15:50:09.055788 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2656/5291] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:08 2022] GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0 => generated 1213 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:09.083451 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-abf7eae3-d4a8-4178-a1da-69cd64683a76 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:09.084298 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-abf7eae3-d4a8-4178-a1da-69cd64683a76 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] [instance: cba4c533-6604-4e8a-b6b6-5d6da9633866] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:09.097372 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-abf7eae3-d4a8-4178-a1da-69cd64683a76 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:09.097866 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-abf7eae3-d4a8-4178-a1da-69cd64683a76 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:09.098605 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-abf7eae3-d4a8-4178-a1da-69cd64683a76 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:09.099329 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-abf7eae3-d4a8-4178-a1da-69cd64683a76 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:09.099781 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-abf7eae3-d4a8-4178-a1da-69cd64683a76 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:09.100207 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-abf7eae3-d4a8-4178-a1da-69cd64683a76 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:09.344177 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-abf7eae3-d4a8-4178-a1da-69cd64683a76 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:09.359501 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-abf7eae3-d4a8-4178-a1da-69cd64683a76 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:09.362634 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-abf7eae3-d4a8-4178-a1da-69cd64683a76 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:09.367140 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-abf7eae3-d4a8-4178-a1da-69cd64683a76 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] 10.222.0.60 "GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866" status: 200 len: 1366 microversion: 2.57 time: 0.310197 Oct 18 15:50:09.369976 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2657/5292] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:50:09 2022] GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866 => generated 1366 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:50:09.381676 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-d6cacd6e-5771-4695-bfaf-693d86177034 req-379621d0-28d2-40da-b11c-85eff859c7a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3069d75-261b-4abe-a68b-fc25cac7e549", "tag": "0063c4b1-1439-4928-82c4-33af9c9bdb56"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:50:09.408584 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-d6cacd6e-5771-4695-bfaf-693d86177034 req-379621d0-28d2-40da-b11c-85eff859c7a2 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:09.411570 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-d6cacd6e-5771-4695-bfaf-693d86177034 req-379621d0-28d2-40da-b11c-85eff859c7a2 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:09.412103 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-d6cacd6e-5771-4695-bfaf-693d86177034 req-379621d0-28d2-40da-b11c-85eff859c7a2 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:09.456232 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-d6cacd6e-5771-4695-bfaf-693d86177034 req-379621d0-28d2-40da-b11c-85eff859c7a2 service nova] Creating event network-changed:0063c4b1-1439-4928-82c4-33af9c9bdb56 for instance d3069d75-261b-4abe-a68b-fc25cac7e549 on n-h2-853682-5 Oct 18 15:50:09.470650 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-d6cacd6e-5771-4695-bfaf-693d86177034 req-379621d0-28d2-40da-b11c-85eff859c7a2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098020 Oct 18 15:50:09.471742 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2658/5293] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:50:09.509791 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d3dabdf5-8529-4c0c-ad49-b330bb3ef288 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:09.520847 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d3dabdf5-8529-4c0c-ad49-b330bb3ef288 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/d3069d75-261b-4abe-a68b-fc25cac7e549" status: 200 len: 1309 microversion: 2.1 time: 0.823136 Oct 18 15:50:09.523959 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2636/5294] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:08 2022] GET /compute/v2.1/servers/d3069d75-261b-4abe-a68b-fc25cac7e549 => generated 1309 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:09.810775 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-09b9ca4a-4af5-4cea-abb6-bd9a862c9c7b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:09.812243 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-09b9ca4a-4af5-4cea-abb6-bd9a862c9c7b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:09.832646 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09b9ca4a-4af5-4cea-abb6-bd9a862c9c7b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:09.837271 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09b9ca4a-4af5-4cea-abb6-bd9a862c9c7b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:09.837732 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09b9ca4a-4af5-4cea-abb6-bd9a862c9c7b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:09.838484 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09b9ca4a-4af5-4cea-abb6-bd9a862c9c7b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:09.838953 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09b9ca4a-4af5-4cea-abb6-bd9a862c9c7b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:09.839386 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09b9ca4a-4af5-4cea-abb6-bd9a862c9c7b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:10.080765 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4e576bb3-7fa3-4ba5-8452-8c22157c14ad tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:10.081768 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4e576bb3-7fa3-4ba5-8452-8c22157c14ad tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: ebefddda-1a5f-485c-a89b-697fe8119af0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:10.092853 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e576bb3-7fa3-4ba5-8452-8c22157c14ad tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:10.098268 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e576bb3-7fa3-4ba5-8452-8c22157c14ad tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:10.098938 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e576bb3-7fa3-4ba5-8452-8c22157c14ad tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:10.099781 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e576bb3-7fa3-4ba5-8452-8c22157c14ad tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:10.100522 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e576bb3-7fa3-4ba5-8452-8c22157c14ad tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:10.101186 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e576bb3-7fa3-4ba5-8452-8c22157c14ad tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:10.266464 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4e576bb3-7fa3-4ba5-8452-8c22157c14ad tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:10.279467 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4e576bb3-7fa3-4ba5-8452-8c22157c14ad tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0" status: 200 len: 1265 microversion: 2.1 time: 0.203715 Oct 18 15:50:10.293275 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2637/5295] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:10 2022] GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0 => generated 1265 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:10.401201 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d98a98f8-dd64-4d54-a1f7-a950b343b3f6 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:10.402417 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d98a98f8-dd64-4d54-a1f7-a950b343b3f6 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] [instance: cba4c533-6604-4e8a-b6b6-5d6da9633866] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:10.418059 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d98a98f8-dd64-4d54-a1f7-a950b343b3f6 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:10.420457 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d98a98f8-dd64-4d54-a1f7-a950b343b3f6 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:10.421183 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d98a98f8-dd64-4d54-a1f7-a950b343b3f6 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:10.423598 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d98a98f8-dd64-4d54-a1f7-a950b343b3f6 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:10.426310 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d98a98f8-dd64-4d54-a1f7-a950b343b3f6 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:10.427200 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d98a98f8-dd64-4d54-a1f7-a950b343b3f6 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:10.600737 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-09b9ca4a-4af5-4cea-abb6-bd9a862c9c7b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:10.619254 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-09b9ca4a-4af5-4cea-abb6-bd9a862c9c7b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:10.625345 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-09b9ca4a-4af5-4cea-abb6-bd9a862c9c7b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:10.628405 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-09b9ca4a-4af5-4cea-abb6-bd9a862c9c7b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1749 microversion: 2.20 time: 0.822040 Oct 18 15:50:10.631048 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2659/5296] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:50:09 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1749 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:50:10.649901 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-25d4a9a1-e58f-4f13-8b99-58fc476ae21b tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:10.652506 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-25d4a9a1-e58f-4f13-8b99-58fc476ae21b tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: d3069d75-261b-4abe-a68b-fc25cac7e549] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:10.666642 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-25d4a9a1-e58f-4f13-8b99-58fc476ae21b tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:10.667143 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-25d4a9a1-e58f-4f13-8b99-58fc476ae21b tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:10.670383 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-25d4a9a1-e58f-4f13-8b99-58fc476ae21b tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:10.671503 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-25d4a9a1-e58f-4f13-8b99-58fc476ae21b tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:10.673745 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-25d4a9a1-e58f-4f13-8b99-58fc476ae21b tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:10.675170 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-25d4a9a1-e58f-4f13-8b99-58fc476ae21b tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:10.680309 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d98a98f8-dd64-4d54-a1f7-a950b343b3f6 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:10.695676 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d98a98f8-dd64-4d54-a1f7-a950b343b3f6 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:10.698556 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d98a98f8-dd64-4d54-a1f7-a950b343b3f6 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:10.702460 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d98a98f8-dd64-4d54-a1f7-a950b343b3f6 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] 10.222.0.60 "GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866" status: 200 len: 1366 microversion: 2.57 time: 0.307026 Oct 18 15:50:10.706757 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2638/5297] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:50:10 2022] GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866 => generated 1366 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:50:11.144619 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-25d4a9a1-e58f-4f13-8b99-58fc476ae21b tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:11.156138 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-25d4a9a1-e58f-4f13-8b99-58fc476ae21b tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/d3069d75-261b-4abe-a68b-fc25cac7e549" status: 200 len: 1309 microversion: 2.1 time: 0.523115 Oct 18 15:50:11.157391 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2660/5298] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:10 2022] GET /compute/v2.1/servers/d3069d75-261b-4abe-a68b-fc25cac7e549 => generated 1309 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:11.306459 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a0033824-a88a-4fbb-8900-97e0a665d321 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:11.307267 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a0033824-a88a-4fbb-8900-97e0a665d321 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: ebefddda-1a5f-485c-a89b-697fe8119af0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:11.315016 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0033824-a88a-4fbb-8900-97e0a665d321 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:11.320047 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0033824-a88a-4fbb-8900-97e0a665d321 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:11.322699 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0033824-a88a-4fbb-8900-97e0a665d321 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:11.323726 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0033824-a88a-4fbb-8900-97e0a665d321 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:11.325863 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0033824-a88a-4fbb-8900-97e0a665d321 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:11.326563 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0033824-a88a-4fbb-8900-97e0a665d321 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:11.465897 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a0033824-a88a-4fbb-8900-97e0a665d321 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:11.478141 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a0033824-a88a-4fbb-8900-97e0a665d321 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0" status: 200 len: 1271 microversion: 2.1 time: 0.175417 Oct 18 15:50:11.481168 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2639/5299] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:11 2022] GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0 => generated 1271 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:11.664381 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b6c152a1-2740-40c8-b4ec-c6e7155fafa7 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:11.665321 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b6c152a1-2740-40c8-b4ec-c6e7155fafa7 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:11.689009 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b6c152a1-2740-40c8-b4ec-c6e7155fafa7 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:11.689697 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b6c152a1-2740-40c8-b4ec-c6e7155fafa7 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:11.699561 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b6c152a1-2740-40c8-b4ec-c6e7155fafa7 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:11.701990 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b6c152a1-2740-40c8-b4ec-c6e7155fafa7 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:11.706286 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b6c152a1-2740-40c8-b4ec-c6e7155fafa7 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:11.707234 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b6c152a1-2740-40c8-b4ec-c6e7155fafa7 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:11.724194 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e28b4ed6-bfa3-4853-91bb-53b1cbcf8de7 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1065661179", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "7ce12d65-65c4-44f2-b365-4385f6291c70"}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:50:11.852686 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-e28b4ed6-bfa3-4853-91bb-53b1cbcf8de7 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] validate_networks() for [('7ce12d65-65c4-44f2-b365-4385f6291c70', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:50:12.700746 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b6c152a1-2740-40c8-b4ec-c6e7155fafa7 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:12.715723 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b6c152a1-2740-40c8-b4ec-c6e7155fafa7 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:12.729478 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b6c152a1-2740-40c8-b4ec-c6e7155fafa7 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:12.732228 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b6c152a1-2740-40c8-b4ec-c6e7155fafa7 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1749 microversion: 2.20 time: 1.075307 Oct 18 15:50:12.735024 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2640/5300] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:50:11 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1749 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:50:12.765613 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e8ecbb9a-008a-4075-bc28-3390c3e0ea31 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:12.766250 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e8ecbb9a-008a-4075-bc28-3390c3e0ea31 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] [instance: cba4c533-6604-4e8a-b6b6-5d6da9633866] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:12.792126 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8ecbb9a-008a-4075-bc28-3390c3e0ea31 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:12.798582 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8ecbb9a-008a-4075-bc28-3390c3e0ea31 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:12.803002 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8ecbb9a-008a-4075-bc28-3390c3e0ea31 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:12.803952 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8ecbb9a-008a-4075-bc28-3390c3e0ea31 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:12.804742 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8ecbb9a-008a-4075-bc28-3390c3e0ea31 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:12.805527 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8ecbb9a-008a-4075-bc28-3390c3e0ea31 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:13.360127 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e8ecbb9a-008a-4075-bc28-3390c3e0ea31 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:13.371619 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e8ecbb9a-008a-4075-bc28-3390c3e0ea31 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:13.380483 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e8ecbb9a-008a-4075-bc28-3390c3e0ea31 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:13.384236 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e8ecbb9a-008a-4075-bc28-3390c3e0ea31 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] 10.222.0.60 "GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866" status: 200 len: 1366 microversion: 2.57 time: 0.630330 Oct 18 15:50:13.388142 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2641/5301] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:50:12 2022] GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866 => generated 1366 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:50:13.396550 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-494209e2-56d2-44dd-8c7b-51c14c0b9533 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:13.404152 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-494209e2-56d2-44dd-8c7b-51c14c0b9533 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: d3069d75-261b-4abe-a68b-fc25cac7e549] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:13.423217 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-494209e2-56d2-44dd-8c7b-51c14c0b9533 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:13.424186 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-494209e2-56d2-44dd-8c7b-51c14c0b9533 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:13.424853 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-494209e2-56d2-44dd-8c7b-51c14c0b9533 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:13.425770 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-494209e2-56d2-44dd-8c7b-51c14c0b9533 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:13.426420 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-494209e2-56d2-44dd-8c7b-51c14c0b9533 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:13.427024 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-494209e2-56d2-44dd-8c7b-51c14c0b9533 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:14.635358 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-494209e2-56d2-44dd-8c7b-51c14c0b9533 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:14.647193 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-494209e2-56d2-44dd-8c7b-51c14c0b9533 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/d3069d75-261b-4abe-a68b-fc25cac7e549" status: 200 len: 1309 microversion: 2.1 time: 1.255297 Oct 18 15:50:14.653308 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2642/5302] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:13 2022] GET /compute/v2.1/servers/d3069d75-261b-4abe-a68b-fc25cac7e549 => generated 1309 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:14.658562 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-95ed4036-868b-4a55-8f61-f6647d012aaa tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:14.665614 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-95ed4036-868b-4a55-8f61-f6647d012aaa tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: ebefddda-1a5f-485c-a89b-697fe8119af0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:14.696453 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95ed4036-868b-4a55-8f61-f6647d012aaa tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:14.697923 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95ed4036-868b-4a55-8f61-f6647d012aaa tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:14.698068 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95ed4036-868b-4a55-8f61-f6647d012aaa tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:14.703469 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95ed4036-868b-4a55-8f61-f6647d012aaa tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:14.704194 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95ed4036-868b-4a55-8f61-f6647d012aaa tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:14.704826 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95ed4036-868b-4a55-8f61-f6647d012aaa tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:16.343396 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-e28b4ed6-bfa3-4853-91bb-53b1cbcf8de7 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:50:16.345017 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-e28b4ed6-bfa3-4853-91bb-53b1cbcf8de7 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:50:16.345791 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-e28b4ed6-bfa3-4853-91bb-53b1cbcf8de7 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:50:16.346449 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-e28b4ed6-bfa3-4853-91bb-53b1cbcf8de7 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:50:16.347123 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-e28b4ed6-bfa3-4853-91bb-53b1cbcf8de7 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:50:16.360351 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-95ed4036-868b-4a55-8f61-f6647d012aaa tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:16.367560 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e28b4ed6-bfa3-4853-91bb-53b1cbcf8de7 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:16.368056 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e28b4ed6-bfa3-4853-91bb-53b1cbcf8de7 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:16.368484 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e28b4ed6-bfa3-4853-91bb-53b1cbcf8de7 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:16.369247 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e28b4ed6-bfa3-4853-91bb-53b1cbcf8de7 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:16.369752 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e28b4ed6-bfa3-4853-91bb-53b1cbcf8de7 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:16.370820 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e28b4ed6-bfa3-4853-91bb-53b1cbcf8de7 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:16.376653 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-95ed4036-868b-4a55-8f61-f6647d012aaa tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0" status: 200 len: 1313 microversion: 2.1 time: 1.720617 Oct 18 15:50:16.379892 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2643/5303] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:14 2022] GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0 => generated 1313 bytes in 1726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:16.392464 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-44d86045-e9bc-45d3-8a6b-7514281e8d58 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:16.398959 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-44d86045-e9bc-45d3-8a6b-7514281e8d58 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:16.408769 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44d86045-e9bc-45d3-8a6b-7514281e8d58 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:16.410867 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44d86045-e9bc-45d3-8a6b-7514281e8d58 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:16.412326 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44d86045-e9bc-45d3-8a6b-7514281e8d58 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:16.415387 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44d86045-e9bc-45d3-8a6b-7514281e8d58 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:16.416108 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44d86045-e9bc-45d3-8a6b-7514281e8d58 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:16.421123 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44d86045-e9bc-45d3-8a6b-7514281e8d58 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:16.433555 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-e28b4ed6-bfa3-4853-91bb-53b1cbcf8de7 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Getting quotas for project 091b079fb5064ba0aa33004016dd834e. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:50:16.441387 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-e28b4ed6-bfa3-4853-91bb-53b1cbcf8de7 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Getting quotas for user 75d4acf4d5e94fb69a8d757afcadb795 and project 091b079fb5064ba0aa33004016dd834e. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:50:16.480022 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e28b4ed6-bfa3-4853-91bb-53b1cbcf8de7 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:50:16.483395 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e28b4ed6-bfa3-4853-91bb-53b1cbcf8de7 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] [instance: cb3b247b-0a03-4399-a95f-73711fb54c0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:50:16.591529 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e28b4ed6-bfa3-4853-91bb-53b1cbcf8de7 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.022338 Oct 18 15:50:16.598239 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2661/5304] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:50:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 5024 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:50:16.598239 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-892b8341-6ec5-4a0c-b4cf-847d4c6e37d9 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:16.598239 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-892b8341-6ec5-4a0c-b4cf-847d4c6e37d9 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] [instance: cba4c533-6604-4e8a-b6b6-5d6da9633866] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:16.615325 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-892b8341-6ec5-4a0c-b4cf-847d4c6e37d9 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:16.616296 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-892b8341-6ec5-4a0c-b4cf-847d4c6e37d9 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:16.616821 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-892b8341-6ec5-4a0c-b4cf-847d4c6e37d9 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:16.617470 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-892b8341-6ec5-4a0c-b4cf-847d4c6e37d9 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:16.617922 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-892b8341-6ec5-4a0c-b4cf-847d4c6e37d9 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:16.627860 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-892b8341-6ec5-4a0c-b4cf-847d4c6e37d9 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:16.824422 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-892b8341-6ec5-4a0c-b4cf-847d4c6e37d9 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:16.836079 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-892b8341-6ec5-4a0c-b4cf-847d4c6e37d9 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:16.845371 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-892b8341-6ec5-4a0c-b4cf-847d4c6e37d9 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:16.847120 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-892b8341-6ec5-4a0c-b4cf-847d4c6e37d9 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] 10.222.0.60 "GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866" status: 200 len: 1372 microversion: 2.57 time: 0.253518 Oct 18 15:50:16.854482 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2662/5305] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:50:16 2022] GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866 => generated 1372 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:50:16.868923 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6e566680-41c0-4a8e-9578-49d2326744c5 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:16.869951 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6e566680-41c0-4a8e-9578-49d2326744c5 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: d3069d75-261b-4abe-a68b-fc25cac7e549] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:16.880912 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6e566680-41c0-4a8e-9578-49d2326744c5 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:16.882356 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6e566680-41c0-4a8e-9578-49d2326744c5 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:16.883042 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6e566680-41c0-4a8e-9578-49d2326744c5 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:16.884039 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6e566680-41c0-4a8e-9578-49d2326744c5 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:16.884733 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6e566680-41c0-4a8e-9578-49d2326744c5 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:16.885624 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6e566680-41c0-4a8e-9578-49d2326744c5 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:16.922955 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-44d86045-e9bc-45d3-8a6b-7514281e8d58 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:16.942515 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-44d86045-e9bc-45d3-8a6b-7514281e8d58 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:16.943988 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-44d86045-e9bc-45d3-8a6b-7514281e8d58 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:16.958113 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-44d86045-e9bc-45d3-8a6b-7514281e8d58 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1749 microversion: 2.20 time: 0.575831 Oct 18 15:50:16.959134 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2644/5306] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:50:16 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1749 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:50:16.983961 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ac07b54b-e62f-4e5a-a9fa-1bcf51da2b67 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:16.984629 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ac07b54b-e62f-4e5a-a9fa-1bcf51da2b67 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] [instance: cb3b247b-0a03-4399-a95f-73711fb54c0d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:17.142646 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ac07b54b-e62f-4e5a-a9fa-1bcf51da2b67 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d4acf4d5e94fb69a8d757afcadb795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '091b079fb5064ba0aa33004016dd834e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:17.150839 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ac07b54b-e62f-4e5a-a9fa-1bcf51da2b67 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3b247b-0a03-4399-a95f-73711fb54c0d" status: 200 len: 1217 microversion: 2.1 time: 0.190620 Oct 18 15:50:17.156180 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2645/5307] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:16 2022] GET /compute/v2.1/servers/cb3b247b-0a03-4399-a95f-73711fb54c0d => generated 1217 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:17.242913 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6e566680-41c0-4a8e-9578-49d2326744c5 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:17.251299 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6e566680-41c0-4a8e-9578-49d2326744c5 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/d3069d75-261b-4abe-a68b-fc25cac7e549" status: 200 len: 1309 microversion: 2.1 time: 0.395312 Oct 18 15:50:17.257587 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2663/5308] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:16 2022] GET /compute/v2.1/servers/d3069d75-261b-4abe-a68b-fc25cac7e549 => generated 1309 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:17.406238 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3c5c4e65-42a5-46f6-9593-e8530f75ec0e tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:17.407118 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3c5c4e65-42a5-46f6-9593-e8530f75ec0e tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: ebefddda-1a5f-485c-a89b-697fe8119af0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:17.418458 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c5c4e65-42a5-46f6-9593-e8530f75ec0e tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:17.421264 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c5c4e65-42a5-46f6-9593-e8530f75ec0e tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:17.421983 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c5c4e65-42a5-46f6-9593-e8530f75ec0e tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:17.422815 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c5c4e65-42a5-46f6-9593-e8530f75ec0e tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:17.425009 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c5c4e65-42a5-46f6-9593-e8530f75ec0e tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:17.425597 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c5c4e65-42a5-46f6-9593-e8530f75ec0e tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:17.864206 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3c5c4e65-42a5-46f6-9593-e8530f75ec0e tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:17.872750 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3c5c4e65-42a5-46f6-9593-e8530f75ec0e tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0" status: 200 len: 1313 microversion: 2.1 time: 0.470400 Oct 18 15:50:17.873706 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2646/5309] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:17 2022] GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0 => generated 1313 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:17.888077 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d56c36de-575a-4290-a4f2-c61a3398adbd tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:17.888700 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d56c36de-575a-4290-a4f2-c61a3398adbd tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] [instance: cba4c533-6604-4e8a-b6b6-5d6da9633866] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:17.901282 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d56c36de-575a-4290-a4f2-c61a3398adbd tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:17.901780 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d56c36de-575a-4290-a4f2-c61a3398adbd tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:17.902224 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d56c36de-575a-4290-a4f2-c61a3398adbd tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:17.902944 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d56c36de-575a-4290-a4f2-c61a3398adbd tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:17.903398 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d56c36de-575a-4290-a4f2-c61a3398adbd tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:17.903823 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d56c36de-575a-4290-a4f2-c61a3398adbd tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:17.988265 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c3b83d41-9c27-4a63-bf6d-51bb804ee196 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:17.988799 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c3b83d41-9c27-4a63-bf6d-51bb804ee196 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:18.008361 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3b83d41-9c27-4a63-bf6d-51bb804ee196 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:18.014701 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3b83d41-9c27-4a63-bf6d-51bb804ee196 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:18.015638 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3b83d41-9c27-4a63-bf6d-51bb804ee196 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:18.022268 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3b83d41-9c27-4a63-bf6d-51bb804ee196 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:18.022772 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3b83d41-9c27-4a63-bf6d-51bb804ee196 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:18.023218 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3b83d41-9c27-4a63-bf6d-51bb804ee196 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:18.076099 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d56c36de-575a-4290-a4f2-c61a3398adbd tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:18.094130 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d56c36de-575a-4290-a4f2-c61a3398adbd tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:18.098859 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d56c36de-575a-4290-a4f2-c61a3398adbd tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:18.101880 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d56c36de-575a-4290-a4f2-c61a3398adbd tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] 10.222.0.60 "GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866" status: 200 len: 1372 microversion: 2.57 time: 0.218222 Oct 18 15:50:18.103965 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2664/5310] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:50:17 2022] GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866 => generated 1372 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:50:18.184494 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-cda78de7-73d9-4ee2-be62-2597dfba3ded tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:18.185312 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-cda78de7-73d9-4ee2-be62-2597dfba3ded tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] [instance: cb3b247b-0a03-4399-a95f-73711fb54c0d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:18.205417 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cda78de7-73d9-4ee2-be62-2597dfba3ded tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:18.211224 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cda78de7-73d9-4ee2-be62-2597dfba3ded tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:18.215915 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cda78de7-73d9-4ee2-be62-2597dfba3ded tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:18.218046 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cda78de7-73d9-4ee2-be62-2597dfba3ded tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:18.232369 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cda78de7-73d9-4ee2-be62-2597dfba3ded tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:18.234666 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cda78de7-73d9-4ee2-be62-2597dfba3ded tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:18.505710 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:50:18.523050 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-cda78de7-73d9-4ee2-be62-2597dfba3ded tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d4acf4d5e94fb69a8d757afcadb795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '091b079fb5064ba0aa33004016dd834e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:18.538944 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-cda78de7-73d9-4ee2-be62-2597dfba3ded tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3b247b-0a03-4399-a95f-73711fb54c0d" status: 200 len: 1213 microversion: 2.1 time: 0.358883 Oct 18 15:50:18.545173 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2665/5311] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:18 2022] GET /compute/v2.1/servers/cb3b247b-0a03-4399-a95f-73711fb54c0d => generated 1213 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:18.554506 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6bf18860-fcf5-4522-b665-7fda55f13ab5 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:18.562170 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6bf18860-fcf5-4522-b665-7fda55f13ab5 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: d3069d75-261b-4abe-a68b-fc25cac7e549] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:18.582139 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6bf18860-fcf5-4522-b665-7fda55f13ab5 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:18.596726 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6bf18860-fcf5-4522-b665-7fda55f13ab5 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:18.597772 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6bf18860-fcf5-4522-b665-7fda55f13ab5 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:18.599079 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6bf18860-fcf5-4522-b665-7fda55f13ab5 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:18.599931 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6bf18860-fcf5-4522-b665-7fda55f13ab5 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:18.600600 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6bf18860-fcf5-4522-b665-7fda55f13ab5 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:18.706943 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c3b83d41-9c27-4a63-bf6d-51bb804ee196 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:18.730074 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c3b83d41-9c27-4a63-bf6d-51bb804ee196 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:18.733210 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c3b83d41-9c27-4a63-bf6d-51bb804ee196 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:18.735562 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c3b83d41-9c27-4a63-bf6d-51bb804ee196 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1749 microversion: 2.20 time: 0.751930 Oct 18 15:50:18.745565 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2647/5312] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:50:17 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1749 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:50:18.899877 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0f83fafa-6332-40e3-b721-bc6ef39430f7 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:18.900568 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0f83fafa-6332-40e3-b721-bc6ef39430f7 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: ebefddda-1a5f-485c-a89b-697fe8119af0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:18.911674 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f83fafa-6332-40e3-b721-bc6ef39430f7 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:18.913953 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f83fafa-6332-40e3-b721-bc6ef39430f7 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:18.926247 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f83fafa-6332-40e3-b721-bc6ef39430f7 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:18.927045 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f83fafa-6332-40e3-b721-bc6ef39430f7 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:18.927539 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f83fafa-6332-40e3-b721-bc6ef39430f7 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:18.927988 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f83fafa-6332-40e3-b721-bc6ef39430f7 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:19.021247 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6bf18860-fcf5-4522-b665-7fda55f13ab5 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:19.029573 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6bf18860-fcf5-4522-b665-7fda55f13ab5 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/d3069d75-261b-4abe-a68b-fc25cac7e549" status: 200 len: 1309 microversion: 2.1 time: 0.483055 Oct 18 15:50:19.030172 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2666/5313] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:18 2022] GET /compute/v2.1/servers/d3069d75-261b-4abe-a68b-fc25cac7e549 => generated 1309 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:19.135915 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2d4e1931-5515-4190-8a34-4b1259c23134 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:19.136560 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2d4e1931-5515-4190-8a34-4b1259c23134 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] [instance: cba4c533-6604-4e8a-b6b6-5d6da9633866] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:19.157672 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d4e1931-5515-4190-8a34-4b1259c23134 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:19.158161 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d4e1931-5515-4190-8a34-4b1259c23134 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:19.158612 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d4e1931-5515-4190-8a34-4b1259c23134 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:19.159340 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d4e1931-5515-4190-8a34-4b1259c23134 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:19.159820 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d4e1931-5515-4190-8a34-4b1259c23134 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:19.160243 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d4e1931-5515-4190-8a34-4b1259c23134 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:19.297953 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2d4e1931-5515-4190-8a34-4b1259c23134 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:19.308677 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2d4e1931-5515-4190-8a34-4b1259c23134 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:19.310187 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2d4e1931-5515-4190-8a34-4b1259c23134 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:19.312994 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2d4e1931-5515-4190-8a34-4b1259c23134 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] 10.222.0.60 "GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866" status: 200 len: 1372 microversion: 2.57 time: 0.181113 Oct 18 15:50:19.325275 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0f83fafa-6332-40e3-b721-bc6ef39430f7 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:19.325542 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2667/5314] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:50:19 2022] GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866 => generated 1372 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:50:19.335437 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0f83fafa-6332-40e3-b721-bc6ef39430f7 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0" status: 200 len: 1313 microversion: 2.1 time: 0.439469 Oct 18 15:50:19.336047 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2648/5315] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:18 2022] GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0 => generated 1313 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:50:19.561978 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9f0d53a5-82c7-4d0f-b23b-36f9e931ff01 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:19.562613 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9f0d53a5-82c7-4d0f-b23b-36f9e931ff01 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] [instance: cb3b247b-0a03-4399-a95f-73711fb54c0d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:19.572411 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9f0d53a5-82c7-4d0f-b23b-36f9e931ff01 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:19.573294 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9f0d53a5-82c7-4d0f-b23b-36f9e931ff01 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:19.574099 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9f0d53a5-82c7-4d0f-b23b-36f9e931ff01 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:19.575015 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9f0d53a5-82c7-4d0f-b23b-36f9e931ff01 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:19.575660 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9f0d53a5-82c7-4d0f-b23b-36f9e931ff01 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:19.576482 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9f0d53a5-82c7-4d0f-b23b-36f9e931ff01 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:19.716764 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9f0d53a5-82c7-4d0f-b23b-36f9e931ff01 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d4acf4d5e94fb69a8d757afcadb795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '091b079fb5064ba0aa33004016dd834e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:19.744873 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9f0d53a5-82c7-4d0f-b23b-36f9e931ff01 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3b247b-0a03-4399-a95f-73711fb54c0d" status: 200 len: 1269 microversion: 2.1 time: 0.178210 Oct 18 15:50:19.745575 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2668/5316] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:19 2022] GET /compute/v2.1/servers/cb3b247b-0a03-4399-a95f-73711fb54c0d => generated 1269 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:19.767150 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f9e8fc46-9b2b-4c78-b765-86df09424edb tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:19.769532 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f9e8fc46-9b2b-4c78-b765-86df09424edb tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:19.779556 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9e8fc46-9b2b-4c78-b765-86df09424edb tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:19.780562 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9e8fc46-9b2b-4c78-b765-86df09424edb tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:19.787812 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9e8fc46-9b2b-4c78-b765-86df09424edb tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:19.798109 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9e8fc46-9b2b-4c78-b765-86df09424edb tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:19.798777 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9e8fc46-9b2b-4c78-b765-86df09424edb tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:19.799242 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9e8fc46-9b2b-4c78-b765-86df09424edb tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:20.056242 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0a07ccfe-c2d5-4d79-ae5b-12a4c1f15d84 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:20.057184 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0a07ccfe-c2d5-4d79-ae5b-12a4c1f15d84 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: d3069d75-261b-4abe-a68b-fc25cac7e549] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:20.080825 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0a07ccfe-c2d5-4d79-ae5b-12a4c1f15d84 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:20.081501 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0a07ccfe-c2d5-4d79-ae5b-12a4c1f15d84 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:20.086819 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0a07ccfe-c2d5-4d79-ae5b-12a4c1f15d84 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:20.087717 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0a07ccfe-c2d5-4d79-ae5b-12a4c1f15d84 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:20.088285 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0a07ccfe-c2d5-4d79-ae5b-12a4c1f15d84 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:20.089607 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0a07ccfe-c2d5-4d79-ae5b-12a4c1f15d84 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:20.122942 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f9e8fc46-9b2b-4c78-b765-86df09424edb tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:20.156414 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f9e8fc46-9b2b-4c78-b765-86df09424edb tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:20.157790 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:50:20.197618 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f9e8fc46-9b2b-4c78-b765-86df09424edb tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:20.198988 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f9e8fc46-9b2b-4c78-b765-86df09424edb tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1805 microversion: 2.20 time: 0.435823 Oct 18 15:50:20.210170 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2649/5317] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:50:19 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1805 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:50:20.341105 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2beea32c-50fc-4398-89b0-83b4cb1f6d5b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:20.342234 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2beea32c-50fc-4398-89b0-83b4cb1f6d5b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] [instance: cba4c533-6604-4e8a-b6b6-5d6da9633866] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:20.363708 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2beea32c-50fc-4398-89b0-83b4cb1f6d5b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:20.364366 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2beea32c-50fc-4398-89b0-83b4cb1f6d5b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:20.364916 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2beea32c-50fc-4398-89b0-83b4cb1f6d5b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:20.365636 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2beea32c-50fc-4398-89b0-83b4cb1f6d5b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:20.366104 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2beea32c-50fc-4398-89b0-83b4cb1f6d5b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:20.366768 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2beea32c-50fc-4398-89b0-83b4cb1f6d5b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:20.620801 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2beea32c-50fc-4398-89b0-83b4cb1f6d5b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:20.651613 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2beea32c-50fc-4398-89b0-83b4cb1f6d5b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:20.659989 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2beea32c-50fc-4398-89b0-83b4cb1f6d5b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:20.665491 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2beea32c-50fc-4398-89b0-83b4cb1f6d5b tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] 10.222.0.60 "GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866" status: 200 len: 1357 microversion: 2.57 time: 0.327453 Oct 18 15:50:20.667052 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2650/5318] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:50:20 2022] GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866 => generated 1357 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:50:20.676857 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6e54a9f2-c79b-4b2b-b8c0-1b4bd352f9f2 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:20.678016 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6e54a9f2-c79b-4b2b-b8c0-1b4bd352f9f2 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: ebefddda-1a5f-485c-a89b-697fe8119af0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:20.709525 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6e54a9f2-c79b-4b2b-b8c0-1b4bd352f9f2 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:20.710040 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6e54a9f2-c79b-4b2b-b8c0-1b4bd352f9f2 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:20.710799 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6e54a9f2-c79b-4b2b-b8c0-1b4bd352f9f2 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:20.712079 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6e54a9f2-c79b-4b2b-b8c0-1b4bd352f9f2 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:20.712553 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6e54a9f2-c79b-4b2b-b8c0-1b4bd352f9f2 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:20.713446 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6e54a9f2-c79b-4b2b-b8c0-1b4bd352f9f2 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:20.735022 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:50:20.913099 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0a07ccfe-c2d5-4d79-ae5b-12a4c1f15d84 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:20.923433 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0a07ccfe-c2d5-4d79-ae5b-12a4c1f15d84 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/d3069d75-261b-4abe-a68b-fc25cac7e549" status: 200 len: 1309 microversion: 2.1 time: 0.871928 Oct 18 15:50:20.929127 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2669/5319] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:20 2022] GET /compute/v2.1/servers/d3069d75-261b-4abe-a68b-fc25cac7e549 => generated 1309 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:50:20.937475 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-97073efa-a388-488f-9b7b-023d5095b078 req-b97e0cef-169f-42ec-862a-5d999095b1ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3069d75-261b-4abe-a68b-fc25cac7e549", "name": "network-vif-plugged", "status": "completed", "tag": "0063c4b1-1439-4928-82c4-33af9c9bdb56"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:50:20.952952 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-97073efa-a388-488f-9b7b-023d5095b078 req-b97e0cef-169f-42ec-862a-5d999095b1ca service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:20.954109 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-97073efa-a388-488f-9b7b-023d5095b078 req-b97e0cef-169f-42ec-862a-5d999095b1ca service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:20.954834 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-97073efa-a388-488f-9b7b-023d5095b078 req-b97e0cef-169f-42ec-862a-5d999095b1ca service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:20.973304 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-97073efa-a388-488f-9b7b-023d5095b078 req-b97e0cef-169f-42ec-862a-5d999095b1ca service nova] Creating event network-vif-plugged:0063c4b1-1439-4928-82c4-33af9c9bdb56 for instance d3069d75-261b-4abe-a68b-fc25cac7e549 on n-h2-853682-5 Oct 18 15:50:20.979517 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-97073efa-a388-488f-9b7b-023d5095b078 req-b97e0cef-169f-42ec-862a-5d999095b1ca service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049105 Oct 18 15:50:20.980906 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2670/5320] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:50:21.000896 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8bbc5917-43c5-4352-b081-5bbb3eb52a03 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:21.003014 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8bbc5917-43c5-4352-b081-5bbb3eb52a03 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] [instance: cba4c533-6604-4e8a-b6b6-5d6da9633866] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:21.012176 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8bbc5917-43c5-4352-b081-5bbb3eb52a03 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:21.013103 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8bbc5917-43c5-4352-b081-5bbb3eb52a03 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:21.013791 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8bbc5917-43c5-4352-b081-5bbb3eb52a03 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:21.014773 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8bbc5917-43c5-4352-b081-5bbb3eb52a03 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:21.015623 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8bbc5917-43c5-4352-b081-5bbb3eb52a03 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:21.016277 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8bbc5917-43c5-4352-b081-5bbb3eb52a03 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:21.073605 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8bbc5917-43c5-4352-b081-5bbb3eb52a03 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] [instance: cba4c533-6604-4e8a-b6b6-5d6da9633866] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:50:21.198241 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8bbc5917-43c5-4352-b081-5bbb3eb52a03 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] 10.222.0.60 "DELETE /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866" status: 204 len: 0 microversion: 2.57 time: 0.214966 Oct 18 15:50:21.204518 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2671/5321] 10.222.0.60 () {60 vars in 1280 bytes} [Tue Oct 18 15:50:20 2022] DELETE /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 15:50:21.213826 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-68dc05b3-5d11-465a-af97-e7be4121632d tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:21.215446 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-68dc05b3-5d11-465a-af97-e7be4121632d tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] [instance: cb3b247b-0a03-4399-a95f-73711fb54c0d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:21.226063 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-68dc05b3-5d11-465a-af97-e7be4121632d tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:21.226738 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-68dc05b3-5d11-465a-af97-e7be4121632d tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:21.227470 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-68dc05b3-5d11-465a-af97-e7be4121632d tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:21.229209 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-68dc05b3-5d11-465a-af97-e7be4121632d tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:21.229889 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-68dc05b3-5d11-465a-af97-e7be4121632d tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:21.230538 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-68dc05b3-5d11-465a-af97-e7be4121632d tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:21.269613 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6e54a9f2-c79b-4b2b-b8c0-1b4bd352f9f2 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:21.286505 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6e54a9f2-c79b-4b2b-b8c0-1b4bd352f9f2 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0" status: 200 len: 1313 microversion: 2.1 time: 0.611274 Oct 18 15:50:21.289432 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2651/5322] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:20 2022] GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0 => generated 1313 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:21.304340 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-2dd2ab43-4ca2-4631-8341-254392099cbe req-82d91337-9ae2-4d30-a5c3-0d5447f85e63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebefddda-1a5f-485c-a89b-697fe8119af0", "tag": "f996c199-2ca6-4e8e-8432-2bea01445275"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:50:21.315394 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2dd2ab43-4ca2-4631-8341-254392099cbe req-82d91337-9ae2-4d30-a5c3-0d5447f85e63 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:21.316030 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2dd2ab43-4ca2-4631-8341-254392099cbe req-82d91337-9ae2-4d30-a5c3-0d5447f85e63 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:21.316561 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2dd2ab43-4ca2-4631-8341-254392099cbe req-82d91337-9ae2-4d30-a5c3-0d5447f85e63 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:21.344166 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-2dd2ab43-4ca2-4631-8341-254392099cbe req-82d91337-9ae2-4d30-a5c3-0d5447f85e63 service nova] Creating event network-changed:f996c199-2ca6-4e8e-8432-2bea01445275 for instance ebefddda-1a5f-485c-a89b-697fe8119af0 on n-h2-853682-5 Oct 18 15:50:21.351962 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-2dd2ab43-4ca2-4631-8341-254392099cbe req-82d91337-9ae2-4d30-a5c3-0d5447f85e63 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060955 Oct 18 15:50:21.355429 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2652/5323] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:50:21.362205 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5dec5fb3-30a7-4e5e-9a20-cd037f82eea5 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:21.362908 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5dec5fb3-30a7-4e5e-9a20-cd037f82eea5 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] [instance: cba4c533-6604-4e8a-b6b6-5d6da9633866] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:21.372563 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5dec5fb3-30a7-4e5e-9a20-cd037f82eea5 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:21.373093 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5dec5fb3-30a7-4e5e-9a20-cd037f82eea5 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:21.373862 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5dec5fb3-30a7-4e5e-9a20-cd037f82eea5 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:21.376842 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5dec5fb3-30a7-4e5e-9a20-cd037f82eea5 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:21.379929 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5dec5fb3-30a7-4e5e-9a20-cd037f82eea5 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:21.380384 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5dec5fb3-30a7-4e5e-9a20-cd037f82eea5 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:21.445029 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-68dc05b3-5d11-465a-af97-e7be4121632d tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d4acf4d5e94fb69a8d757afcadb795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '091b079fb5064ba0aa33004016dd834e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:21.453063 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-68dc05b3-5d11-465a-af97-e7be4121632d tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3b247b-0a03-4399-a95f-73711fb54c0d" status: 200 len: 1275 microversion: 2.1 time: 0.246350 Oct 18 15:50:21.453647 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2672/5324] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:21 2022] GET /compute/v2.1/servers/cb3b247b-0a03-4399-a95f-73711fb54c0d => generated 1275 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:21.473190 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-48fa8a32-d808-4565-ab47-774ef113bc61 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:21.474028 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-48fa8a32-d808-4565-ab47-774ef113bc61 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:21.483910 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-48fa8a32-d808-4565-ab47-774ef113bc61 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:21.495262 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-48fa8a32-d808-4565-ab47-774ef113bc61 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:21.497206 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-48fa8a32-d808-4565-ab47-774ef113bc61 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:21.498994 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-48fa8a32-d808-4565-ab47-774ef113bc61 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:21.500851 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-48fa8a32-d808-4565-ab47-774ef113bc61 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:21.514120 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-48fa8a32-d808-4565-ab47-774ef113bc61 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:21.606337 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5dec5fb3-30a7-4e5e-9a20-cd037f82eea5 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:21.623302 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5dec5fb3-30a7-4e5e-9a20-cd037f82eea5 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:21.624799 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5dec5fb3-30a7-4e5e-9a20-cd037f82eea5 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:21.626045 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5dec5fb3-30a7-4e5e-9a20-cd037f82eea5 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] 10.222.0.60 "GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866" status: 200 len: 1363 microversion: 2.57 time: 0.269359 Oct 18 15:50:21.627154 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2653/5325] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:50:21 2022] GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866 => generated 1363 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:50:21.926587 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-48fa8a32-d808-4565-ab47-774ef113bc61 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:21.947906 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b8a7c433-0775-4937-aa11-ed096cad9d26 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:21.948946 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b8a7c433-0775-4937-aa11-ed096cad9d26 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: d3069d75-261b-4abe-a68b-fc25cac7e549] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:21.952780 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-48fa8a32-d808-4565-ab47-774ef113bc61 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:21.959522 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8a7c433-0775-4937-aa11-ed096cad9d26 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:21.967649 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-48fa8a32-d808-4565-ab47-774ef113bc61 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:21.969637 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8a7c433-0775-4937-aa11-ed096cad9d26 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:21.971181 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8a7c433-0775-4937-aa11-ed096cad9d26 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:21.971515 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8a7c433-0775-4937-aa11-ed096cad9d26 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:21.972249 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8a7c433-0775-4937-aa11-ed096cad9d26 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:21.972399 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-48fa8a32-d808-4565-ab47-774ef113bc61 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1805 microversion: 2.20 time: 0.510755 Oct 18 15:50:21.973069 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8a7c433-0775-4937-aa11-ed096cad9d26 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:21.987813 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2673/5326] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:50:21 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1805 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:50:22.311641 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-53012f35-291a-4779-8a9e-b4360676baa9 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:22.312337 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-53012f35-291a-4779-8a9e-b4360676baa9 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: ebefddda-1a5f-485c-a89b-697fe8119af0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:22.326429 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-53012f35-291a-4779-8a9e-b4360676baa9 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:22.327492 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-53012f35-291a-4779-8a9e-b4360676baa9 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:22.327827 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-53012f35-291a-4779-8a9e-b4360676baa9 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:22.328698 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-53012f35-291a-4779-8a9e-b4360676baa9 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:22.329337 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-53012f35-291a-4779-8a9e-b4360676baa9 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:22.329602 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-53012f35-291a-4779-8a9e-b4360676baa9 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:22.611479 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b8a7c433-0775-4937-aa11-ed096cad9d26 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:22.626129 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b8a7c433-0775-4937-aa11-ed096cad9d26 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/d3069d75-261b-4abe-a68b-fc25cac7e549" status: 200 len: 1309 microversion: 2.1 time: 0.682054 Oct 18 15:50:22.627180 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2654/5327] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:21 2022] GET /compute/v2.1/servers/d3069d75-261b-4abe-a68b-fc25cac7e549 => generated 1309 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:50:22.637314 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5a3db08f-c959-45df-b949-469883812dc9 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:22.637946 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5a3db08f-c959-45df-b949-469883812dc9 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] [instance: cb3b247b-0a03-4399-a95f-73711fb54c0d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:22.659362 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:50:22.663348 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a3db08f-c959-45df-b949-469883812dc9 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:22.664151 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a3db08f-c959-45df-b949-469883812dc9 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:22.665498 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a3db08f-c959-45df-b949-469883812dc9 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:22.668348 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a3db08f-c959-45df-b949-469883812dc9 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:22.674640 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a3db08f-c959-45df-b949-469883812dc9 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:22.675445 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a3db08f-c959-45df-b949-469883812dc9 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:23.150507 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-53012f35-291a-4779-8a9e-b4360676baa9 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:23.165299 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-53012f35-291a-4779-8a9e-b4360676baa9 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0" status: 200 len: 1313 microversion: 2.1 time: 0.854727 Oct 18 15:50:23.169262 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2674/5328] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:22 2022] GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0 => generated 1313 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:23.179268 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-baa64f73-9e7e-4eca-86c6-2327d9860db5 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:23.181590 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-baa64f73-9e7e-4eca-86c6-2327d9860db5 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] [instance: cba4c533-6604-4e8a-b6b6-5d6da9633866] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:23.199446 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-baa64f73-9e7e-4eca-86c6-2327d9860db5 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:23.200247 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-baa64f73-9e7e-4eca-86c6-2327d9860db5 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:23.201076 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-baa64f73-9e7e-4eca-86c6-2327d9860db5 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:23.201972 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-baa64f73-9e7e-4eca-86c6-2327d9860db5 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:23.202839 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-baa64f73-9e7e-4eca-86c6-2327d9860db5 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:23.203428 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-baa64f73-9e7e-4eca-86c6-2327d9860db5 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:23.227042 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5a3db08f-c959-45df-b949-469883812dc9 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d4acf4d5e94fb69a8d757afcadb795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '091b079fb5064ba0aa33004016dd834e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:23.247726 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5a3db08f-c959-45df-b949-469883812dc9 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3b247b-0a03-4399-a95f-73711fb54c0d" status: 200 len: 1317 microversion: 2.1 time: 0.619379 Oct 18 15:50:23.262984 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2655/5329] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:22 2022] GET /compute/v2.1/servers/cb3b247b-0a03-4399-a95f-73711fb54c0d => generated 1317 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:23.276845 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cd942e9b-226a-4218-8be2-deb54a7bd1c9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:23.280246 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cd942e9b-226a-4218-8be2-deb54a7bd1c9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:23.297288 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd942e9b-226a-4218-8be2-deb54a7bd1c9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:23.298074 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd942e9b-226a-4218-8be2-deb54a7bd1c9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:23.299130 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd942e9b-226a-4218-8be2-deb54a7bd1c9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:23.300075 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd942e9b-226a-4218-8be2-deb54a7bd1c9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:23.300546 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd942e9b-226a-4218-8be2-deb54a7bd1c9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:23.301035 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd942e9b-226a-4218-8be2-deb54a7bd1c9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:23.332060 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-baa64f73-9e7e-4eca-86c6-2327d9860db5 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:23.359876 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-baa64f73-9e7e-4eca-86c6-2327d9860db5 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:23.362455 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-baa64f73-9e7e-4eca-86c6-2327d9860db5 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c10f40eda373403a9fbe8adf7063ae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735d9a07584449d2b2d5895c360b3758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:23.364545 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-baa64f73-9e7e-4eca-86c6-2327d9860db5 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] 10.222.0.60 "GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866" status: 200 len: 1363 microversion: 2.57 time: 0.193232 Oct 18 15:50:23.366704 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2675/5330] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:50:23 2022] GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866 => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:50:23.650619 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3040e59e-2aab-4ad3-96da-9247d4a036cb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:23.651245 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3040e59e-2aab-4ad3-96da-9247d4a036cb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: d3069d75-261b-4abe-a68b-fc25cac7e549] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:23.665102 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3040e59e-2aab-4ad3-96da-9247d4a036cb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:23.665933 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3040e59e-2aab-4ad3-96da-9247d4a036cb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:23.669675 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3040e59e-2aab-4ad3-96da-9247d4a036cb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:23.670848 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3040e59e-2aab-4ad3-96da-9247d4a036cb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:23.671532 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3040e59e-2aab-4ad3-96da-9247d4a036cb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:23.675106 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3040e59e-2aab-4ad3-96da-9247d4a036cb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:24.420039 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cd942e9b-226a-4218-8be2-deb54a7bd1c9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:24.434653 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cd942e9b-226a-4218-8be2-deb54a7bd1c9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:24.436121 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cd942e9b-226a-4218-8be2-deb54a7bd1c9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:24.442791 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cd942e9b-226a-4218-8be2-deb54a7bd1c9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1805 microversion: 2.20 time: 1.178547 Oct 18 15:50:24.457964 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2656/5331] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:50:23 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1805 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:50:24.467998 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-14fb6ce1-1afa-456a-888c-4dfadf863e58 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:24.468898 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-14fb6ce1-1afa-456a-888c-4dfadf863e58 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: ebefddda-1a5f-485c-a89b-697fe8119af0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:24.475817 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14fb6ce1-1afa-456a-888c-4dfadf863e58 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:24.476682 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14fb6ce1-1afa-456a-888c-4dfadf863e58 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:24.477364 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14fb6ce1-1afa-456a-888c-4dfadf863e58 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:24.478468 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14fb6ce1-1afa-456a-888c-4dfadf863e58 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:24.479145 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14fb6ce1-1afa-456a-888c-4dfadf863e58 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:24.479828 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14fb6ce1-1afa-456a-888c-4dfadf863e58 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:24.821975 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3040e59e-2aab-4ad3-96da-9247d4a036cb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:24.830666 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3040e59e-2aab-4ad3-96da-9247d4a036cb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/d3069d75-261b-4abe-a68b-fc25cac7e549" status: 200 len: 1489 microversion: 2.1 time: 1.184678 Oct 18 15:50:24.846489 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2676/5332] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:23 2022] GET /compute/v2.1/servers/d3069d75-261b-4abe-a68b-fc25cac7e549 => generated 1489 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:24.865968 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-591f2267-8422-410b-81ba-8e0da09249cc tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:24.866980 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-591f2267-8422-410b-81ba-8e0da09249cc tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] [instance: cb3b247b-0a03-4399-a95f-73711fb54c0d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:24.873870 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-591f2267-8422-410b-81ba-8e0da09249cc tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:24.874637 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-591f2267-8422-410b-81ba-8e0da09249cc tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:24.875251 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-591f2267-8422-410b-81ba-8e0da09249cc tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:24.876151 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-591f2267-8422-410b-81ba-8e0da09249cc tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:24.877049 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-591f2267-8422-410b-81ba-8e0da09249cc tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:24.877428 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-591f2267-8422-410b-81ba-8e0da09249cc tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:25.281697 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-14fb6ce1-1afa-456a-888c-4dfadf863e58 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:25.292069 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-14fb6ce1-1afa-456a-888c-4dfadf863e58 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0" status: 200 len: 1313 microversion: 2.1 time: 0.832693 Oct 18 15:50:25.293061 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2657/5333] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:24 2022] GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0 => generated 1313 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:25.317434 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9cc0a601-605c-444e-b2e7-728cc79e9a85 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:25.318507 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9cc0a601-605c-444e-b2e7-728cc79e9a85 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] [instance: cba4c533-6604-4e8a-b6b6-5d6da9633866] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:25.327029 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9cc0a601-605c-444e-b2e7-728cc79e9a85 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:25.327805 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9cc0a601-605c-444e-b2e7-728cc79e9a85 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:25.329150 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9cc0a601-605c-444e-b2e7-728cc79e9a85 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:25.330700 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9cc0a601-605c-444e-b2e7-728cc79e9a85 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:25.331495 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9cc0a601-605c-444e-b2e7-728cc79e9a85 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:25.331994 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9cc0a601-605c-444e-b2e7-728cc79e9a85 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:25.354444 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-9cc0a601-605c-444e-b2e7-728cc79e9a85 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] HTTP exception thrown: Instance cba4c533-6604-4e8a-b6b6-5d6da9633866 could not be found. Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9cc0a601-605c-444e-b2e7-728cc79e9a85 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Request method failure captured: Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866 HTTP/1.1 Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTssNW7SKVfJdXxt_PTdSvy0s4ZyrmJY_UxTwEHXPwOusIAqCIPwVpZTxx2vnakymAR4gRQicCQ-iOVvnYmcj3-Js68FFjPFJ0wwqhSgDfNxEG75QWBiVNjX0r3YLRHBSh-kG-4FwrMY6whFrzOAgwfPCkqF-Dcsq7RfiRHUCfG_ACw4 Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: X-Openstack-Nova-Api-Version: 2.57 Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 735d9a07584449d2b2d5895c360b3758 Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerShowV257Test-166853909 Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/735d9a07584449d2b2d5895c360b3758"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/735d9a07584449d2b2d5895c360b3758"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/735d9a07584449d2b2d5895c360b3758"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_735d9a07584449d2b2d5895c360b3758"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServerShowV257Test-166853909 Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 735d9a07584449d2b2d5895c360b3758 Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerShowV257Test-166853909 Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServerShowV257Test-166853909-project Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: c10f40eda373403a9fbe8adf7063ae8c Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServerShowV257Test-166853909-project Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance cba4c533-6604-4e8a-b6b6-5d6da9633866 could not be found. Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'cba4c533-6604-4e8a-b6b6-5d6da9633866'} Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cba4c533-6604-4e8a-b6b6-5d6da9633866 could not be found. Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cba4c533-6604-4e8a-b6b6-5d6da9633866 could not be found. Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:50:25.356390 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:50:25.363861 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:50:25.363861 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:50:25.363861 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:50:25.363861 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:50:25.363861 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:50:25.363861 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cba4c533-6604-4e8a-b6b6-5d6da9633866 could not be found. Oct 18 15:50:25.363861 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:50:25.363861 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9cc0a601-605c-444e-b2e7-728cc79e9a85 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] Returning 404 to user: Instance cba4c533-6604-4e8a-b6b6-5d6da9633866 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:50:25.363861 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9cc0a601-605c-444e-b2e7-728cc79e9a85 tempest-ServerShowV257Test-166853909 tempest-ServerShowV257Test-166853909-project] 10.222.0.60 "GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866" status: 404 len: 111 microversion: 2.57 time: 0.050961 Oct 18 15:50:25.363861 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2658/5334] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:50:25 2022] GET /compute/v2.1/servers/cba4c533-6604-4e8a-b6b6-5d6da9633866 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:50:25.370043 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-d117fcd1-00ed-4137-88e1-082d185bc387 req-50e225d8-8625-4d80-aae1-144b8e6a820b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b465248f-ab7a-4aba-b939-6f236eea166e", "tag": "440cc1c1-492e-40b0-8244-adb2559e6c7f"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:50:25.380275 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d117fcd1-00ed-4137-88e1-082d185bc387 req-50e225d8-8625-4d80-aae1-144b8e6a820b service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:25.380920 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d117fcd1-00ed-4137-88e1-082d185bc387 req-50e225d8-8625-4d80-aae1-144b8e6a820b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:25.381429 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d117fcd1-00ed-4137-88e1-082d185bc387 req-50e225d8-8625-4d80-aae1-144b8e6a820b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:25.408721 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-d117fcd1-00ed-4137-88e1-082d185bc387 req-50e225d8-8625-4d80-aae1-144b8e6a820b service nova] Creating event network-changed:440cc1c1-492e-40b0-8244-adb2559e6c7f for instance b465248f-ab7a-4aba-b939-6f236eea166e on n-h2-853682-5 Oct 18 15:50:25.416585 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-d117fcd1-00ed-4137-88e1-082d185bc387 req-50e225d8-8625-4d80-aae1-144b8e6a820b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052863 Oct 18 15:50:25.419293 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2659/5335] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:50:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:50:25.427163 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-643ff8a2-d8e1-49bf-9517-fe4dea90c1d9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1520842512", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "5126a012-82e3-4304-a7ec-ac28e05a407b"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:50:25.499545 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-591f2267-8422-410b-81ba-8e0da09249cc tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d4acf4d5e94fb69a8d757afcadb795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '091b079fb5064ba0aa33004016dd834e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:25.518233 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-591f2267-8422-410b-81ba-8e0da09249cc tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3b247b-0a03-4399-a95f-73711fb54c0d" status: 200 len: 1317 microversion: 2.1 time: 0.669793 Oct 18 15:50:25.523153 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2677/5336] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:24 2022] GET /compute/v2.1/servers/cb3b247b-0a03-4399-a95f-73711fb54c0d => generated 1317 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:25.523678 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-643ff8a2-d8e1-49bf-9517-fe4dea90c1d9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] validate_networks() for [('5126a012-82e3-4304-a7ec-ac28e05a407b', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:50:25.531386 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7c0ca390-ead5-40aa-9113-2bd4998ab617 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:25.535761 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7c0ca390-ead5-40aa-9113-2bd4998ab617 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:25.541811 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=93,nova_api:UPDATE=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:50:25.544086 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7c0ca390-ead5-40aa-9113-2bd4998ab617 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:25.544918 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7c0ca390-ead5-40aa-9113-2bd4998ab617 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:25.545691 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7c0ca390-ead5-40aa-9113-2bd4998ab617 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:25.546644 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7c0ca390-ead5-40aa-9113-2bd4998ab617 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:25.547384 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7c0ca390-ead5-40aa-9113-2bd4998ab617 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:25.548048 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7c0ca390-ead5-40aa-9113-2bd4998ab617 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:26.283518 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7c0ca390-ead5-40aa-9113-2bd4998ab617 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:26.294941 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7c0ca390-ead5-40aa-9113-2bd4998ab617 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:26.298202 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7c0ca390-ead5-40aa-9113-2bd4998ab617 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:26.301941 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7c0ca390-ead5-40aa-9113-2bd4998ab617 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1805 microversion: 2.20 time: 0.776454 Oct 18 15:50:26.303142 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2678/5337] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:50:25 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1805 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:50:26.321851 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8c0642a8-b740-4acd-bbfb-79356ca790f8 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:26.322797 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8c0642a8-b740-4acd-bbfb-79356ca790f8 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: ebefddda-1a5f-485c-a89b-697fe8119af0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:26.332114 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c0642a8-b740-4acd-bbfb-79356ca790f8 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:26.333019 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c0642a8-b740-4acd-bbfb-79356ca790f8 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:26.333655 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c0642a8-b740-4acd-bbfb-79356ca790f8 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:26.334546 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c0642a8-b740-4acd-bbfb-79356ca790f8 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:26.335178 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c0642a8-b740-4acd-bbfb-79356ca790f8 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:26.335915 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c0642a8-b740-4acd-bbfb-79356ca790f8 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:26.415023 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:50:26.453520 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=8 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:50:27.097501 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8c0642a8-b740-4acd-bbfb-79356ca790f8 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:27.108179 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8c0642a8-b740-4acd-bbfb-79356ca790f8 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0" status: 200 len: 1313 microversion: 2.1 time: 0.792939 Oct 18 15:50:27.108794 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2679/5338] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:26 2022] GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0 => generated 1313 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:50:27.125189 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-52385026-6983-4d56-90a4-27539a3b5e56 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:27.127227 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-52385026-6983-4d56-90a4-27539a3b5e56 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] [instance: cb3b247b-0a03-4399-a95f-73711fb54c0d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:27.133719 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-52385026-6983-4d56-90a4-27539a3b5e56 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:27.134471 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-52385026-6983-4d56-90a4-27539a3b5e56 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:27.135239 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-52385026-6983-4d56-90a4-27539a3b5e56 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:27.136147 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-52385026-6983-4d56-90a4-27539a3b5e56 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:27.137120 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-52385026-6983-4d56-90a4-27539a3b5e56 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:27.137722 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-52385026-6983-4d56-90a4-27539a3b5e56 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:27.147227 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=10 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:50:27.880314 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-643ff8a2-d8e1-49bf-9517-fe4dea90c1d9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:50:27.880744 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-643ff8a2-d8e1-49bf-9517-fe4dea90c1d9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:50:27.881443 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-643ff8a2-d8e1-49bf-9517-fe4dea90c1d9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:50:27.882062 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-643ff8a2-d8e1-49bf-9517-fe4dea90c1d9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:50:27.883218 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-643ff8a2-d8e1-49bf-9517-fe4dea90c1d9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:50:27.900985 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-643ff8a2-d8e1-49bf-9517-fe4dea90c1d9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:27.901941 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-643ff8a2-d8e1-49bf-9517-fe4dea90c1d9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:27.902878 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-643ff8a2-d8e1-49bf-9517-fe4dea90c1d9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:27.903871 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-643ff8a2-d8e1-49bf-9517-fe4dea90c1d9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:27.905216 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-643ff8a2-d8e1-49bf-9517-fe4dea90c1d9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:27.906082 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-643ff8a2-d8e1-49bf-9517-fe4dea90c1d9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:27.933586 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-643ff8a2-d8e1-49bf-9517-fe4dea90c1d9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Getting quotas for project afdb1e8b478f463987ec223f2d10db33. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:50:27.941943 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-643ff8a2-d8e1-49bf-9517-fe4dea90c1d9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Getting quotas for user 73f4ee2e7ff34dd88b9b82fefbf06a36 and project afdb1e8b478f463987ec223f2d10db33. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:50:27.958377 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-643ff8a2-d8e1-49bf-9517-fe4dea90c1d9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:50:27.962828 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-643ff8a2-d8e1-49bf-9517-fe4dea90c1d9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 4ccaffe8-f3ed-47df-a9ee-5437c24b469c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:50:28.026162 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-643ff8a2-d8e1-49bf-9517-fe4dea90c1d9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.605255 Oct 18 15:50:28.037045 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2660/5339] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:50:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:50:28.042969 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-65a4a1dd-d1b8-48e7-ab4e-9548bc96e994 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:28.043871 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-65a4a1dd-d1b8-48e7-ab4e-9548bc96e994 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:28.053865 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65a4a1dd-d1b8-48e7-ab4e-9548bc96e994 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:28.056535 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65a4a1dd-d1b8-48e7-ab4e-9548bc96e994 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:28.057377 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65a4a1dd-d1b8-48e7-ab4e-9548bc96e994 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:28.059040 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65a4a1dd-d1b8-48e7-ab4e-9548bc96e994 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:28.059719 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65a4a1dd-d1b8-48e7-ab4e-9548bc96e994 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:28.060360 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65a4a1dd-d1b8-48e7-ab4e-9548bc96e994 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:28.381523 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-52385026-6983-4d56-90a4-27539a3b5e56 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d4acf4d5e94fb69a8d757afcadb795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '091b079fb5064ba0aa33004016dd834e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:28.416655 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-52385026-6983-4d56-90a4-27539a3b5e56 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3b247b-0a03-4399-a95f-73711fb54c0d" status: 200 len: 1317 microversion: 2.1 time: 1.306748 Oct 18 15:50:28.419882 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2680/5340] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:27 2022] GET /compute/v2.1/servers/cb3b247b-0a03-4399-a95f-73711fb54c0d => generated 1317 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:28.438013 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9b6d4d1d-16e6-4dcc-b757-1125f37759da tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:28.439784 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9b6d4d1d-16e6-4dcc-b757-1125f37759da tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 4ccaffe8-f3ed-47df-a9ee-5437c24b469c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:28.632591 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9b6d4d1d-16e6-4dcc-b757-1125f37759da tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:28.651092 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9b6d4d1d-16e6-4dcc-b757-1125f37759da tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/4ccaffe8-f3ed-47df-a9ee-5437c24b469c" status: 200 len: 1209 microversion: 2.1 time: 0.228312 Oct 18 15:50:28.653947 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2681/5341] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:28 2022] GET /compute/v2.1/servers/4ccaffe8-f3ed-47df-a9ee-5437c24b469c => generated 1209 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:28.677115 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fa0d708c-fa79-491e-9eec-f5ce78d4fb85 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:28.677391 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-fa0d708c-fa79-491e-9eec-f5ce78d4fb85 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: ebefddda-1a5f-485c-a89b-697fe8119af0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:28.705142 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-65a4a1dd-d1b8-48e7-ab4e-9548bc96e994 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:28.714381 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fa0d708c-fa79-491e-9eec-f5ce78d4fb85 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:28.720798 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fa0d708c-fa79-491e-9eec-f5ce78d4fb85 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:28.722727 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fa0d708c-fa79-491e-9eec-f5ce78d4fb85 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:28.722867 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-65a4a1dd-d1b8-48e7-ab4e-9548bc96e994 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:28.726958 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fa0d708c-fa79-491e-9eec-f5ce78d4fb85 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:28.732327 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-65a4a1dd-d1b8-48e7-ab4e-9548bc96e994 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:28.733482 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-65a4a1dd-d1b8-48e7-ab4e-9548bc96e994 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1805 microversion: 2.20 time: 0.694601 Oct 18 15:50:28.736998 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2661/5342] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:50:28 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1805 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:50:28.742386 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-4c2d9e37-0b2a-4cd4-a5ea-7a4886638bff req-f5c198bc-882b-46ba-ad0b-655e53ab8207 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebefddda-1a5f-485c-a89b-697fe8119af0", "name": "network-vif-plugged", "status": "completed", "tag": "f996c199-2ca6-4e8e-8432-2bea01445275"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:50:28.747692 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fa0d708c-fa79-491e-9eec-f5ce78d4fb85 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:28.749446 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fa0d708c-fa79-491e-9eec-f5ce78d4fb85 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:28.818736 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4c2d9e37-0b2a-4cd4-a5ea-7a4886638bff req-f5c198bc-882b-46ba-ad0b-655e53ab8207 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:28.819690 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4c2d9e37-0b2a-4cd4-a5ea-7a4886638bff req-f5c198bc-882b-46ba-ad0b-655e53ab8207 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:28.820146 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4c2d9e37-0b2a-4cd4-a5ea-7a4886638bff req-f5c198bc-882b-46ba-ad0b-655e53ab8207 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:28.859237 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-4c2d9e37-0b2a-4cd4-a5ea-7a4886638bff req-f5c198bc-882b-46ba-ad0b-655e53ab8207 service nova] Creating event network-vif-plugged:f996c199-2ca6-4e8e-8432-2bea01445275 for instance ebefddda-1a5f-485c-a89b-697fe8119af0 on n-h2-853682-5 Oct 18 15:50:28.872150 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-4c2d9e37-0b2a-4cd4-a5ea-7a4886638bff req-f5c198bc-882b-46ba-ad0b-655e53ab8207 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132198 Oct 18 15:50:28.881178 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2662/5343] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:50:28.888377 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-74066556-0ce3-415c-a8ef-d542ccf6a977 req-4cfcf5ee-b6b6-4a58-bf73-9528ba289ac2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb3b247b-0a03-4399-a95f-73711fb54c0d", "tag": "50da9465-25dd-4be0-895a-af5aa6979948"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:50:28.911826 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-74066556-0ce3-415c-a8ef-d542ccf6a977 req-4cfcf5ee-b6b6-4a58-bf73-9528ba289ac2 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:28.917316 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-74066556-0ce3-415c-a8ef-d542ccf6a977 req-4cfcf5ee-b6b6-4a58-bf73-9528ba289ac2 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:28.918623 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-74066556-0ce3-415c-a8ef-d542ccf6a977 req-4cfcf5ee-b6b6-4a58-bf73-9528ba289ac2 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:28.940166 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-74066556-0ce3-415c-a8ef-d542ccf6a977 req-4cfcf5ee-b6b6-4a58-bf73-9528ba289ac2 service nova] Creating event network-changed:50da9465-25dd-4be0-895a-af5aa6979948 for instance cb3b247b-0a03-4399-a95f-73711fb54c0d on n-h1-853682-5 Oct 18 15:50:28.946387 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-74066556-0ce3-415c-a8ef-d542ccf6a977 req-4cfcf5ee-b6b6-4a58-bf73-9528ba289ac2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062967 Oct 18 15:50:28.947196 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2663/5344] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:50:29.461652 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-fa0d708c-fa79-491e-9eec-f5ce78d4fb85 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:29.463115 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5689663d-0ab0-4fbc-ae69-7d7835060843 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:29.467163 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5689663d-0ab0-4fbc-ae69-7d7835060843 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] [instance: cb3b247b-0a03-4399-a95f-73711fb54c0d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:29.479413 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fa0d708c-fa79-491e-9eec-f5ce78d4fb85 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0" status: 200 len: 1313 microversion: 2.1 time: 0.824103 Oct 18 15:50:29.482505 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2682/5345] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:28 2022] GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0 => generated 1313 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:29.509010 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5689663d-0ab0-4fbc-ae69-7d7835060843 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:29.511192 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5689663d-0ab0-4fbc-ae69-7d7835060843 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:29.512139 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5689663d-0ab0-4fbc-ae69-7d7835060843 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:29.513154 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5689663d-0ab0-4fbc-ae69-7d7835060843 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:29.514863 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5689663d-0ab0-4fbc-ae69-7d7835060843 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:29.516124 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5689663d-0ab0-4fbc-ae69-7d7835060843 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:29.676584 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-708606f0-c07b-460f-ac34-2754db732b63 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:29.677519 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-708606f0-c07b-460f-ac34-2754db732b63 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 4ccaffe8-f3ed-47df-a9ee-5437c24b469c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:29.684386 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-708606f0-c07b-460f-ac34-2754db732b63 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:29.700652 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-708606f0-c07b-460f-ac34-2754db732b63 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:29.702901 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-708606f0-c07b-460f-ac34-2754db732b63 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:29.706503 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-708606f0-c07b-460f-ac34-2754db732b63 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:29.711155 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-708606f0-c07b-460f-ac34-2754db732b63 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:29.714245 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-708606f0-c07b-460f-ac34-2754db732b63 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:30.231006 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-708606f0-c07b-460f-ac34-2754db732b63 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:30.247699 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-708606f0-c07b-460f-ac34-2754db732b63 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/4ccaffe8-f3ed-47df-a9ee-5437c24b469c" status: 200 len: 1261 microversion: 2.1 time: 0.574516 Oct 18 15:50:30.266542 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2683/5346] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:29 2022] GET /compute/v2.1/servers/4ccaffe8-f3ed-47df-a9ee-5437c24b469c => generated 1261 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:30.276686 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b3d7e9f5-047b-4b56-ba47-0893bc6ee218 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:30.277693 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b3d7e9f5-047b-4b56-ba47-0893bc6ee218 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:30.289016 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b3d7e9f5-047b-4b56-ba47-0893bc6ee218 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:30.290862 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b3d7e9f5-047b-4b56-ba47-0893bc6ee218 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:30.292103 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b3d7e9f5-047b-4b56-ba47-0893bc6ee218 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:30.294419 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b3d7e9f5-047b-4b56-ba47-0893bc6ee218 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:30.299812 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b3d7e9f5-047b-4b56-ba47-0893bc6ee218 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:30.300516 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b3d7e9f5-047b-4b56-ba47-0893bc6ee218 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:30.532560 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5689663d-0ab0-4fbc-ae69-7d7835060843 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d4acf4d5e94fb69a8d757afcadb795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '091b079fb5064ba0aa33004016dd834e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:30.559353 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5689663d-0ab0-4fbc-ae69-7d7835060843 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3b247b-0a03-4399-a95f-73711fb54c0d" status: 200 len: 1317 microversion: 2.1 time: 1.103318 Oct 18 15:50:30.576204 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2664/5347] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:29 2022] GET /compute/v2.1/servers/cb3b247b-0a03-4399-a95f-73711fb54c0d => generated 1317 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:30.589744 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2de74d58-a278-4bdb-8715-2435f1ff75ca tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:30.590762 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2de74d58-a278-4bdb-8715-2435f1ff75ca tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: ebefddda-1a5f-485c-a89b-697fe8119af0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:30.628376 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2de74d58-a278-4bdb-8715-2435f1ff75ca tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:30.630037 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2de74d58-a278-4bdb-8715-2435f1ff75ca tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:30.630910 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2de74d58-a278-4bdb-8715-2435f1ff75ca tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:30.631934 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2de74d58-a278-4bdb-8715-2435f1ff75ca tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:30.632870 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2de74d58-a278-4bdb-8715-2435f1ff75ca tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:30.633723 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2de74d58-a278-4bdb-8715-2435f1ff75ca tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:30.894065 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b3d7e9f5-047b-4b56-ba47-0893bc6ee218 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:30.904262 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b3d7e9f5-047b-4b56-ba47-0893bc6ee218 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:30.906428 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b3d7e9f5-047b-4b56-ba47-0893bc6ee218 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:30.908704 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b3d7e9f5-047b-4b56-ba47-0893bc6ee218 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1805 microversion: 2.20 time: 0.640072 Oct 18 15:50:30.909741 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2684/5348] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:50:30 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1805 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:50:31.030730 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2de74d58-a278-4bdb-8715-2435f1ff75ca tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:31.043051 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2de74d58-a278-4bdb-8715-2435f1ff75ca tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0" status: 200 len: 1313 microversion: 2.1 time: 0.460304 Oct 18 15:50:31.046787 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2665/5349] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:30 2022] GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0 => generated 1313 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:31.280094 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ab93fea2-11e2-4ca9-ba34-a2dd950e68cd tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:31.283310 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ab93fea2-11e2-4ca9-ba34-a2dd950e68cd tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 4ccaffe8-f3ed-47df-a9ee-5437c24b469c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:31.298957 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ab93fea2-11e2-4ca9-ba34-a2dd950e68cd tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:31.307387 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ab93fea2-11e2-4ca9-ba34-a2dd950e68cd tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:31.308614 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ab93fea2-11e2-4ca9-ba34-a2dd950e68cd tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:31.310987 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ab93fea2-11e2-4ca9-ba34-a2dd950e68cd tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:31.316142 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ab93fea2-11e2-4ca9-ba34-a2dd950e68cd tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:31.335203 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ab93fea2-11e2-4ca9-ba34-a2dd950e68cd tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:31.574492 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ab93fea2-11e2-4ca9-ba34-a2dd950e68cd tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:31.588365 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ab93fea2-11e2-4ca9-ba34-a2dd950e68cd tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/4ccaffe8-f3ed-47df-a9ee-5437c24b469c" status: 200 len: 1267 microversion: 2.1 time: 0.313739 Oct 18 15:50:31.589065 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2685/5350] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:31 2022] GET /compute/v2.1/servers/4ccaffe8-f3ed-47df-a9ee-5437c24b469c => generated 1267 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:31.589345 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-361a7dc5-3d58-4ab6-b6b4-10be57f6cf5a tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:31.589969 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-361a7dc5-3d58-4ab6-b6b4-10be57f6cf5a tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] [instance: cb3b247b-0a03-4399-a95f-73711fb54c0d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:31.597207 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-361a7dc5-3d58-4ab6-b6b4-10be57f6cf5a tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:31.597698 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-361a7dc5-3d58-4ab6-b6b4-10be57f6cf5a tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:31.598131 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-361a7dc5-3d58-4ab6-b6b4-10be57f6cf5a tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:31.598830 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-361a7dc5-3d58-4ab6-b6b4-10be57f6cf5a tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:31.599281 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-361a7dc5-3d58-4ab6-b6b4-10be57f6cf5a tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:31.599712 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-361a7dc5-3d58-4ab6-b6b4-10be57f6cf5a tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:31.936238 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-44d927a3-b14c-4e9a-bdbe-dff0d52b8412 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:31.937347 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-44d927a3-b14c-4e9a-bdbe-dff0d52b8412 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:31.955276 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-44d927a3-b14c-4e9a-bdbe-dff0d52b8412 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:31.957672 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-44d927a3-b14c-4e9a-bdbe-dff0d52b8412 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:31.959324 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-44d927a3-b14c-4e9a-bdbe-dff0d52b8412 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:31.960961 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-44d927a3-b14c-4e9a-bdbe-dff0d52b8412 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:31.966429 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-44d927a3-b14c-4e9a-bdbe-dff0d52b8412 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:31.967795 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-44d927a3-b14c-4e9a-bdbe-dff0d52b8412 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:31.983177 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:50:32.545281 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-361a7dc5-3d58-4ab6-b6b4-10be57f6cf5a tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d4acf4d5e94fb69a8d757afcadb795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '091b079fb5064ba0aa33004016dd834e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:32.557354 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-361a7dc5-3d58-4ab6-b6b4-10be57f6cf5a tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3b247b-0a03-4399-a95f-73711fb54c0d" status: 200 len: 1317 microversion: 2.1 time: 0.971405 Oct 18 15:50:32.560423 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2666/5351] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:31 2022] GET /compute/v2.1/servers/cb3b247b-0a03-4399-a95f-73711fb54c0d => generated 1317 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:32.577378 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2fb375b9-6312-4cc4-b829-4f4c05ff88c1 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:32.584490 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2fb375b9-6312-4cc4-b829-4f4c05ff88c1 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: ebefddda-1a5f-485c-a89b-697fe8119af0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:32.593730 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2fb375b9-6312-4cc4-b829-4f4c05ff88c1 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:32.595048 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2fb375b9-6312-4cc4-b829-4f4c05ff88c1 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:32.595499 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2fb375b9-6312-4cc4-b829-4f4c05ff88c1 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:32.596286 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2fb375b9-6312-4cc4-b829-4f4c05ff88c1 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:32.596747 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2fb375b9-6312-4cc4-b829-4f4c05ff88c1 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:32.597350 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2fb375b9-6312-4cc4-b829-4f4c05ff88c1 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:32.918274 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-44d927a3-b14c-4e9a-bdbe-dff0d52b8412 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:32.938626 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-44d927a3-b14c-4e9a-bdbe-dff0d52b8412 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:32.940244 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-44d927a3-b14c-4e9a-bdbe-dff0d52b8412 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:32.950738 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-44d927a3-b14c-4e9a-bdbe-dff0d52b8412 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1805 microversion: 2.20 time: 1.018425 Oct 18 15:50:32.961528 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2686/5352] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:50:31 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1805 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:50:32.968101 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-81dacae5-beb9-4c49-9954-2b69cc841ce4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:32.981912 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-81dacae5-beb9-4c49-9954-2b69cc841ce4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 4ccaffe8-f3ed-47df-a9ee-5437c24b469c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:32.989935 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-81dacae5-beb9-4c49-9954-2b69cc841ce4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:32.991129 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-81dacae5-beb9-4c49-9954-2b69cc841ce4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:32.991810 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-81dacae5-beb9-4c49-9954-2b69cc841ce4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:32.992766 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-81dacae5-beb9-4c49-9954-2b69cc841ce4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:32.993426 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-81dacae5-beb9-4c49-9954-2b69cc841ce4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:32.994109 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-81dacae5-beb9-4c49-9954-2b69cc841ce4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:33.150779 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2fb375b9-6312-4cc4-b829-4f4c05ff88c1 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:33.164252 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2fb375b9-6312-4cc4-b829-4f4c05ff88c1 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0" status: 200 len: 1498 microversion: 2.1 time: 0.598881 Oct 18 15:50:33.168780 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2667/5353] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:32 2022] GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0 => generated 1498 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:33.172322 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-81dacae5-beb9-4c49-9954-2b69cc841ce4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:33.191285 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-81dacae5-beb9-4c49-9954-2b69cc841ce4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/4ccaffe8-f3ed-47df-a9ee-5437c24b469c" status: 200 len: 1267 microversion: 2.1 time: 0.226976 Oct 18 15:50:33.193878 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2687/5354] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:32 2022] GET /compute/v2.1/servers/4ccaffe8-f3ed-47df-a9ee-5437c24b469c => generated 1267 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:33.198032 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0ed58e10-ddcf-4dc1-a859-98ffa9e4c899 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:50:33.201053 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0ed58e10-ddcf-4dc1-a859-98ffa9e4c899 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: ebefddda-1a5f-485c-a89b-697fe8119af0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:33.228538 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ed58e10-ddcf-4dc1-a859-98ffa9e4c899 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:33.231736 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ed58e10-ddcf-4dc1-a859-98ffa9e4c899 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:33.232453 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ed58e10-ddcf-4dc1-a859-98ffa9e4c899 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:33.234368 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ed58e10-ddcf-4dc1-a859-98ffa9e4c899 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:33.237248 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ed58e10-ddcf-4dc1-a859-98ffa9e4c899 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:33.237994 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ed58e10-ddcf-4dc1-a859-98ffa9e4c899 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:33.281483 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-0ed58e10-ddcf-4dc1-a859-98ffa9e4c899 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lazy-loading 'flavor' on Instance uuid ebefddda-1a5f-485c-a89b-697fe8119af0 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:50:33.465796 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0ed58e10-ddcf-4dc1-a859-98ffa9e4c899 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "POST /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0/action" status: 200 len: 32 microversion: 2.1 time: 0.275637 Oct 18 15:50:33.472731 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2668/5355] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:50:33 2022] POST /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0/action => generated 32 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 15:50:33.491053 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-022b4b0e-6a7b-44e0-a98b-c394ca1bf866 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:33.494519 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-022b4b0e-6a7b-44e0-a98b-c394ca1bf866 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: ebefddda-1a5f-485c-a89b-697fe8119af0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:33.523722 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-022b4b0e-6a7b-44e0-a98b-c394ca1bf866 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:33.525971 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-022b4b0e-6a7b-44e0-a98b-c394ca1bf866 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:33.527769 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-022b4b0e-6a7b-44e0-a98b-c394ca1bf866 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:33.528794 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-022b4b0e-6a7b-44e0-a98b-c394ca1bf866 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:33.533546 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-022b4b0e-6a7b-44e0-a98b-c394ca1bf866 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:33.538548 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-022b4b0e-6a7b-44e0-a98b-c394ca1bf866 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:33.586349 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1c35acc4-d28b-465f-b33f-062cc852b98e tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:33.588119 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1c35acc4-d28b-465f-b33f-062cc852b98e tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] [instance: cb3b247b-0a03-4399-a95f-73711fb54c0d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:33.603468 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1c35acc4-d28b-465f-b33f-062cc852b98e tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:33.616603 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1c35acc4-d28b-465f-b33f-062cc852b98e tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:33.620150 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1c35acc4-d28b-465f-b33f-062cc852b98e tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:33.622803 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1c35acc4-d28b-465f-b33f-062cc852b98e tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:33.623776 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1c35acc4-d28b-465f-b33f-062cc852b98e tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:33.627593 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1c35acc4-d28b-465f-b33f-062cc852b98e tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:34.101121 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1c35acc4-d28b-465f-b33f-062cc852b98e tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d4acf4d5e94fb69a8d757afcadb795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '091b079fb5064ba0aa33004016dd834e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:34.109166 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1c35acc4-d28b-465f-b33f-062cc852b98e tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3b247b-0a03-4399-a95f-73711fb54c0d" status: 200 len: 1317 microversion: 2.1 time: 0.527164 Oct 18 15:50:34.129433 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2669/5356] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:33 2022] GET /compute/v2.1/servers/cb3b247b-0a03-4399-a95f-73711fb54c0d => generated 1317 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:34.135329 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dd4ab276-75fa-4678-b864-abf92fc5cae7 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:34.136286 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dd4ab276-75fa-4678-b864-abf92fc5cae7 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:34.143215 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd4ab276-75fa-4678-b864-abf92fc5cae7 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:34.144069 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd4ab276-75fa-4678-b864-abf92fc5cae7 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:34.144767 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd4ab276-75fa-4678-b864-abf92fc5cae7 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:34.145790 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd4ab276-75fa-4678-b864-abf92fc5cae7 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:34.146485 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd4ab276-75fa-4678-b864-abf92fc5cae7 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:34.147152 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd4ab276-75fa-4678-b864-abf92fc5cae7 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:34.172966 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:50:34.242248 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-022b4b0e-6a7b-44e0-a98b-c394ca1bf866 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:34.254377 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-022b4b0e-6a7b-44e0-a98b-c394ca1bf866 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0" status: 200 len: 1504 microversion: 2.1 time: 0.774066 Oct 18 15:50:34.258597 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2688/5357] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:33 2022] GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0 => generated 1504 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:34.271886 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0c7bd66f-c172-47fd-8629-251a69210784 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:34.276167 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0c7bd66f-c172-47fd-8629-251a69210784 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 4ccaffe8-f3ed-47df-a9ee-5437c24b469c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:34.293780 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0c7bd66f-c172-47fd-8629-251a69210784 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:34.296505 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0c7bd66f-c172-47fd-8629-251a69210784 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:34.297347 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0c7bd66f-c172-47fd-8629-251a69210784 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:34.298461 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0c7bd66f-c172-47fd-8629-251a69210784 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:34.299731 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0c7bd66f-c172-47fd-8629-251a69210784 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:34.301816 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0c7bd66f-c172-47fd-8629-251a69210784 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:34.493856 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0c7bd66f-c172-47fd-8629-251a69210784 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:34.509166 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0c7bd66f-c172-47fd-8629-251a69210784 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/4ccaffe8-f3ed-47df-a9ee-5437c24b469c" status: 200 len: 1267 microversion: 2.1 time: 0.249075 Oct 18 15:50:34.511820 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2689/5358] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:34 2022] GET /compute/v2.1/servers/4ccaffe8-f3ed-47df-a9ee-5437c24b469c => generated 1267 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:34.783161 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dd4ab276-75fa-4678-b864-abf92fc5cae7 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:34.799825 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dd4ab276-75fa-4678-b864-abf92fc5cae7 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:34.805907 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dd4ab276-75fa-4678-b864-abf92fc5cae7 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:34.812285 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dd4ab276-75fa-4678-b864-abf92fc5cae7 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1805 microversion: 2.20 time: 0.679222 Oct 18 15:50:34.818561 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2670/5359] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:50:34 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1805 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:50:35.135575 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-88de6803-9d69-4132-b90b-a82a58b74cd7 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:35.136202 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-88de6803-9d69-4132-b90b-a82a58b74cd7 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] [instance: cb3b247b-0a03-4399-a95f-73711fb54c0d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:35.151889 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-88de6803-9d69-4132-b90b-a82a58b74cd7 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:35.152397 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-88de6803-9d69-4132-b90b-a82a58b74cd7 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:35.161756 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-88de6803-9d69-4132-b90b-a82a58b74cd7 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:35.167928 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-88de6803-9d69-4132-b90b-a82a58b74cd7 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:35.168611 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-88de6803-9d69-4132-b90b-a82a58b74cd7 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:35.169220 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-88de6803-9d69-4132-b90b-a82a58b74cd7 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:35.284444 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a03c2000-effb-4658-aeeb-f3eb199c6da4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:35.285750 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a03c2000-effb-4658-aeeb-f3eb199c6da4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: ebefddda-1a5f-485c-a89b-697fe8119af0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:35.300228 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a03c2000-effb-4658-aeeb-f3eb199c6da4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:35.300975 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a03c2000-effb-4658-aeeb-f3eb199c6da4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:35.301805 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a03c2000-effb-4658-aeeb-f3eb199c6da4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:35.302838 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a03c2000-effb-4658-aeeb-f3eb199c6da4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:35.303589 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a03c2000-effb-4658-aeeb-f3eb199c6da4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:35.304194 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a03c2000-effb-4658-aeeb-f3eb199c6da4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:35.455267 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-88de6803-9d69-4132-b90b-a82a58b74cd7 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d4acf4d5e94fb69a8d757afcadb795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '091b079fb5064ba0aa33004016dd834e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:35.478686 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-88de6803-9d69-4132-b90b-a82a58b74cd7 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3b247b-0a03-4399-a95f-73711fb54c0d" status: 200 len: 1317 microversion: 2.1 time: 0.346896 Oct 18 15:50:35.497868 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2690/5360] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:35 2022] GET /compute/v2.1/servers/cb3b247b-0a03-4399-a95f-73711fb54c0d => generated 1317 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:35.538100 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f6703607-fcfc-4055-ab72-50b05c36b642 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:35.538725 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f6703607-fcfc-4055-ab72-50b05c36b642 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 4ccaffe8-f3ed-47df-a9ee-5437c24b469c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:35.561402 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f6703607-fcfc-4055-ab72-50b05c36b642 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:35.570209 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f6703607-fcfc-4055-ab72-50b05c36b642 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:35.570677 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f6703607-fcfc-4055-ab72-50b05c36b642 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:35.571430 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f6703607-fcfc-4055-ab72-50b05c36b642 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:35.571893 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f6703607-fcfc-4055-ab72-50b05c36b642 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:35.572332 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f6703607-fcfc-4055-ab72-50b05c36b642 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:36.360149 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a03c2000-effb-4658-aeeb-f3eb199c6da4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:36.379801 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a03c2000-effb-4658-aeeb-f3eb199c6da4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0" status: 200 len: 1504 microversion: 2.1 time: 1.099351 Oct 18 15:50:36.384191 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2671/5361] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:35 2022] GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0 => generated 1504 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:36.402281 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d06ce637-d979-46b9-9728-e49924c0500c tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:36.403507 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d06ce637-d979-46b9-9728-e49924c0500c tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:36.412399 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f6703607-fcfc-4055-ab72-50b05c36b642 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:36.419777 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d06ce637-d979-46b9-9728-e49924c0500c tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:36.421562 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d06ce637-d979-46b9-9728-e49924c0500c tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:36.424381 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d06ce637-d979-46b9-9728-e49924c0500c tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:36.425965 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d06ce637-d979-46b9-9728-e49924c0500c tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:36.427929 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f6703607-fcfc-4055-ab72-50b05c36b642 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/4ccaffe8-f3ed-47df-a9ee-5437c24b469c" status: 200 len: 1309 microversion: 2.1 time: 0.893710 Oct 18 15:50:36.429073 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2691/5362] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:35 2022] GET /compute/v2.1/servers/4ccaffe8-f3ed-47df-a9ee-5437c24b469c => generated 1309 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:36.445783 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d06ce637-d979-46b9-9728-e49924c0500c tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:36.446719 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d06ce637-d979-46b9-9728-e49924c0500c tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:36.506618 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fe249d06-550d-444e-94c0-5913a4a62bd7 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:36.507163 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-fe249d06-550d-444e-94c0-5913a4a62bd7 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] [instance: cb3b247b-0a03-4399-a95f-73711fb54c0d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:36.517941 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fe249d06-550d-444e-94c0-5913a4a62bd7 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:36.519366 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fe249d06-550d-444e-94c0-5913a4a62bd7 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:36.519823 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fe249d06-550d-444e-94c0-5913a4a62bd7 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:36.523247 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fe249d06-550d-444e-94c0-5913a4a62bd7 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:36.523751 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fe249d06-550d-444e-94c0-5913a4a62bd7 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:36.524189 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fe249d06-550d-444e-94c0-5913a4a62bd7 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:36.856796 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d06ce637-d979-46b9-9728-e49924c0500c tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:36.864670 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-fe249d06-550d-444e-94c0-5913a4a62bd7 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d4acf4d5e94fb69a8d757afcadb795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '091b079fb5064ba0aa33004016dd834e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:36.874694 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d06ce637-d979-46b9-9728-e49924c0500c tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:36.875888 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fe249d06-550d-444e-94c0-5913a4a62bd7 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3b247b-0a03-4399-a95f-73711fb54c0d" status: 200 len: 1317 microversion: 2.1 time: 0.373343 Oct 18 15:50:36.877977 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d06ce637-d979-46b9-9728-e49924c0500c tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:36.878574 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2692/5363] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:36 2022] GET /compute/v2.1/servers/cb3b247b-0a03-4399-a95f-73711fb54c0d => generated 1317 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:50:36.883393 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d06ce637-d979-46b9-9728-e49924c0500c tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1805 microversion: 2.20 time: 0.496901 Oct 18 15:50:36.884995 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2672/5364] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:50:36 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1805 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:50:37.135755 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-2c184206-ab9a-4eeb-a8ee-1dc6c25c7999 req-13ae134a-6c97-4436-b56a-46a0cc32ca7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb3b247b-0a03-4399-a95f-73711fb54c0d", "name": "network-vif-plugged", "status": "completed", "tag": "50da9465-25dd-4be0-895a-af5aa6979948"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:50:37.159394 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-2c184206-ab9a-4eeb-a8ee-1dc6c25c7999 req-13ae134a-6c97-4436-b56a-46a0cc32ca7d service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:37.160223 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-2c184206-ab9a-4eeb-a8ee-1dc6c25c7999 req-13ae134a-6c97-4436-b56a-46a0cc32ca7d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:37.160906 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-2c184206-ab9a-4eeb-a8ee-1dc6c25c7999 req-13ae134a-6c97-4436-b56a-46a0cc32ca7d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:37.184754 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-2c184206-ab9a-4eeb-a8ee-1dc6c25c7999 req-13ae134a-6c97-4436-b56a-46a0cc32ca7d service nova] Creating event network-vif-plugged:50da9465-25dd-4be0-895a-af5aa6979948 for instance cb3b247b-0a03-4399-a95f-73711fb54c0d on n-h1-853682-5 Oct 18 15:50:37.204709 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-2c184206-ab9a-4eeb-a8ee-1dc6c25c7999 req-13ae134a-6c97-4436-b56a-46a0cc32ca7d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072464 Oct 18 15:50:37.206004 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2693/5365] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:50:37.410306 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fecf0436-224a-4452-83d2-92919a09c363 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:37.411224 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fecf0436-224a-4452-83d2-92919a09c363 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: ebefddda-1a5f-485c-a89b-697fe8119af0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:37.427447 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fecf0436-224a-4452-83d2-92919a09c363 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:37.428791 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fecf0436-224a-4452-83d2-92919a09c363 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:37.429485 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fecf0436-224a-4452-83d2-92919a09c363 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:37.430392 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fecf0436-224a-4452-83d2-92919a09c363 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:37.431170 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fecf0436-224a-4452-83d2-92919a09c363 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:37.431764 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fecf0436-224a-4452-83d2-92919a09c363 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:37.470779 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-32a54b5f-3e5a-4901-b902-6a0de950d1ea tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:37.471960 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-32a54b5f-3e5a-4901-b902-6a0de950d1ea tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 4ccaffe8-f3ed-47df-a9ee-5437c24b469c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:37.489457 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-32a54b5f-3e5a-4901-b902-6a0de950d1ea tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:37.493764 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-32a54b5f-3e5a-4901-b902-6a0de950d1ea tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:37.496014 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-32a54b5f-3e5a-4901-b902-6a0de950d1ea tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:37.499370 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-32a54b5f-3e5a-4901-b902-6a0de950d1ea tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:37.502005 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-32a54b5f-3e5a-4901-b902-6a0de950d1ea tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:37.502865 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-32a54b5f-3e5a-4901-b902-6a0de950d1ea tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:37.924209 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:50:37.952063 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:50:38.150232 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fecf0436-224a-4452-83d2-92919a09c363 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:38.166828 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fecf0436-224a-4452-83d2-92919a09c363 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0" status: 200 len: 1504 microversion: 2.1 time: 0.761908 Oct 18 15:50:38.170544 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2673/5366] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:37 2022] GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0 => generated 1504 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:38.194548 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-268047fb-cfed-4f0b-8080-08dd1aeaa22d tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:38.198843 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-268047fb-cfed-4f0b-8080-08dd1aeaa22d tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] [instance: cb3b247b-0a03-4399-a95f-73711fb54c0d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:38.236385 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-268047fb-cfed-4f0b-8080-08dd1aeaa22d tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:38.256297 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-268047fb-cfed-4f0b-8080-08dd1aeaa22d tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:38.256990 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-268047fb-cfed-4f0b-8080-08dd1aeaa22d tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:38.257790 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-268047fb-cfed-4f0b-8080-08dd1aeaa22d tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:38.258276 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-268047fb-cfed-4f0b-8080-08dd1aeaa22d tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:38.258767 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-268047fb-cfed-4f0b-8080-08dd1aeaa22d tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:38.353355 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-32a54b5f-3e5a-4901-b902-6a0de950d1ea tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:38.367077 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-32a54b5f-3e5a-4901-b902-6a0de950d1ea tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/4ccaffe8-f3ed-47df-a9ee-5437c24b469c" status: 200 len: 1309 microversion: 2.1 time: 0.909265 Oct 18 15:50:38.368794 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2694/5367] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:37 2022] GET /compute/v2.1/servers/4ccaffe8-f3ed-47df-a9ee-5437c24b469c => generated 1309 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:50:38.375746 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2a73cca0-d6a6-4c01-a824-9b376c2a68f0 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:38.377395 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2a73cca0-d6a6-4c01-a824-9b376c2a68f0 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:38.384858 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a73cca0-d6a6-4c01-a824-9b376c2a68f0 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:38.385733 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a73cca0-d6a6-4c01-a824-9b376c2a68f0 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:38.386558 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a73cca0-d6a6-4c01-a824-9b376c2a68f0 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:38.387517 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a73cca0-d6a6-4c01-a824-9b376c2a68f0 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:38.388731 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a73cca0-d6a6-4c01-a824-9b376c2a68f0 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:38.389455 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a73cca0-d6a6-4c01-a824-9b376c2a68f0 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:38.647571 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:50:39.008525 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-268047fb-cfed-4f0b-8080-08dd1aeaa22d tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d4acf4d5e94fb69a8d757afcadb795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '091b079fb5064ba0aa33004016dd834e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:39.031234 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-268047fb-cfed-4f0b-8080-08dd1aeaa22d tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3b247b-0a03-4399-a95f-73711fb54c0d" status: 200 len: 1317 microversion: 2.1 time: 0.850339 Oct 18 15:50:39.045157 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2674/5368] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:38 2022] GET /compute/v2.1/servers/cb3b247b-0a03-4399-a95f-73711fb54c0d => generated 1317 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:39.116771 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2a73cca0-d6a6-4c01-a824-9b376c2a68f0 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:39.150051 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2a73cca0-d6a6-4c01-a824-9b376c2a68f0 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:39.155965 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2a73cca0-d6a6-4c01-a824-9b376c2a68f0 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:39.159502 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2a73cca0-d6a6-4c01-a824-9b376c2a68f0 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1805 microversion: 2.20 time: 0.788972 Oct 18 15:50:39.160387 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2695/5369] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:50:38 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1805 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:50:39.195287 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-138075c8-236b-4204-9faf-c2c92c010004 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:39.198523 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-138075c8-236b-4204-9faf-c2c92c010004 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: ebefddda-1a5f-485c-a89b-697fe8119af0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:39.223379 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-138075c8-236b-4204-9faf-c2c92c010004 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:39.224134 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-138075c8-236b-4204-9faf-c2c92c010004 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:39.224766 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-138075c8-236b-4204-9faf-c2c92c010004 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:39.226648 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-138075c8-236b-4204-9faf-c2c92c010004 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:39.227340 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-138075c8-236b-4204-9faf-c2c92c010004 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:39.227972 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-138075c8-236b-4204-9faf-c2c92c010004 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:39.395771 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-79e774da-2d2e-4926-854d-3925f2bf5526 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:39.397309 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-79e774da-2d2e-4926-854d-3925f2bf5526 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 4ccaffe8-f3ed-47df-a9ee-5437c24b469c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:39.420343 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-79e774da-2d2e-4926-854d-3925f2bf5526 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:39.423688 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-79e774da-2d2e-4926-854d-3925f2bf5526 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:39.425186 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-79e774da-2d2e-4926-854d-3925f2bf5526 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:39.427578 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-79e774da-2d2e-4926-854d-3925f2bf5526 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:39.430618 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-79e774da-2d2e-4926-854d-3925f2bf5526 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:39.432458 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-79e774da-2d2e-4926-854d-3925f2bf5526 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:40.115140 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-138075c8-236b-4204-9faf-c2c92c010004 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:40.127525 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-138075c8-236b-4204-9faf-c2c92c010004 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0" status: 200 len: 1504 microversion: 2.1 time: 0.936996 Oct 18 15:50:40.128331 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2675/5370] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:39 2022] GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0 => generated 1504 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:40.152193 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-1f7c6bfe-e75c-4867-884b-bedaa612180d req-a04b824b-cc1f-43c5-8c24-ff8792f361bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ccaffe8-f3ed-47df-a9ee-5437c24b469c", "tag": "c1c3e92b-76a2-45fc-a4f5-0e22972d1e6b"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:50:40.155260 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-79e774da-2d2e-4926-854d-3925f2bf5526 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:40.165304 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-79e774da-2d2e-4926-854d-3925f2bf5526 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/4ccaffe8-f3ed-47df-a9ee-5437c24b469c" status: 200 len: 1309 microversion: 2.1 time: 0.776501 Oct 18 15:50:40.167739 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2696/5371] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:39 2022] GET /compute/v2.1/servers/4ccaffe8-f3ed-47df-a9ee-5437c24b469c => generated 1309 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:40.173122 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a54becda-1d9d-4145-b681-ff69eb80a8c8 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:40.173998 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a54becda-1d9d-4145-b681-ff69eb80a8c8 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] [instance: cb3b247b-0a03-4399-a95f-73711fb54c0d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:40.181515 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a54becda-1d9d-4145-b681-ff69eb80a8c8 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:40.182201 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a54becda-1d9d-4145-b681-ff69eb80a8c8 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:40.182836 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a54becda-1d9d-4145-b681-ff69eb80a8c8 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:40.184482 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a54becda-1d9d-4145-b681-ff69eb80a8c8 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:40.185143 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a54becda-1d9d-4145-b681-ff69eb80a8c8 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:40.186143 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a54becda-1d9d-4145-b681-ff69eb80a8c8 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:40.199112 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1f7c6bfe-e75c-4867-884b-bedaa612180d req-a04b824b-cc1f-43c5-8c24-ff8792f361bd service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:40.200008 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1f7c6bfe-e75c-4867-884b-bedaa612180d req-a04b824b-cc1f-43c5-8c24-ff8792f361bd service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:40.201863 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1f7c6bfe-e75c-4867-884b-bedaa612180d req-a04b824b-cc1f-43c5-8c24-ff8792f361bd service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:40.246092 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-1f7c6bfe-e75c-4867-884b-bedaa612180d req-a04b824b-cc1f-43c5-8c24-ff8792f361bd service nova] Creating event network-changed:c1c3e92b-76a2-45fc-a4f5-0e22972d1e6b for instance 4ccaffe8-f3ed-47df-a9ee-5437c24b469c on n-h1-853682-5 Oct 18 15:50:40.258329 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-1f7c6bfe-e75c-4867-884b-bedaa612180d req-a04b824b-cc1f-43c5-8c24-ff8792f361bd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128857 Oct 18 15:50:40.266135 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2676/5372] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:50:40.276504 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7c98568f-0162-4ed7-aa1b-f402c4106007 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:40.284925 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7c98568f-0162-4ed7-aa1b-f402c4106007 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:40.298483 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c98568f-0162-4ed7-aa1b-f402c4106007 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:40.300776 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c98568f-0162-4ed7-aa1b-f402c4106007 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:40.306106 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c98568f-0162-4ed7-aa1b-f402c4106007 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:40.307356 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c98568f-0162-4ed7-aa1b-f402c4106007 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:40.308081 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c98568f-0162-4ed7-aa1b-f402c4106007 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:40.308845 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c98568f-0162-4ed7-aa1b-f402c4106007 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:41.068626 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7c98568f-0162-4ed7-aa1b-f402c4106007 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:41.081778 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a54becda-1d9d-4145-b681-ff69eb80a8c8 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d4acf4d5e94fb69a8d757afcadb795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '091b079fb5064ba0aa33004016dd834e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:41.082532 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7c98568f-0162-4ed7-aa1b-f402c4106007 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:41.084090 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7c98568f-0162-4ed7-aa1b-f402c4106007 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:41.085362 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7c98568f-0162-4ed7-aa1b-f402c4106007 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1805 microversion: 2.20 time: 0.816477 Oct 18 15:50:41.086636 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2677/5373] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:50:40 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1805 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:50:41.098073 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a54becda-1d9d-4145-b681-ff69eb80a8c8 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3b247b-0a03-4399-a95f-73711fb54c0d" status: 200 len: 1505 microversion: 2.1 time: 0.929042 Oct 18 15:50:41.120186 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2697/5374] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:40 2022] GET /compute/v2.1/servers/cb3b247b-0a03-4399-a95f-73711fb54c0d => generated 1505 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:41.126264 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-44525254-7a68-47a0-b1b0-f08fe0d8177a tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:41.127387 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-44525254-7a68-47a0-b1b0-f08fe0d8177a tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] [instance: cb3b247b-0a03-4399-a95f-73711fb54c0d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:41.135402 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44525254-7a68-47a0-b1b0-f08fe0d8177a tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:41.136201 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44525254-7a68-47a0-b1b0-f08fe0d8177a tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:41.136867 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44525254-7a68-47a0-b1b0-f08fe0d8177a tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:41.137880 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44525254-7a68-47a0-b1b0-f08fe0d8177a tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:41.138517 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44525254-7a68-47a0-b1b0-f08fe0d8177a tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:41.139874 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44525254-7a68-47a0-b1b0-f08fe0d8177a tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:41.161504 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6041f74c-2617-4177-a706-1103fc8cd9b3 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:41.162749 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6041f74c-2617-4177-a706-1103fc8cd9b3 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: ebefddda-1a5f-485c-a89b-697fe8119af0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:41.172322 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6041f74c-2617-4177-a706-1103fc8cd9b3 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:41.176538 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6041f74c-2617-4177-a706-1103fc8cd9b3 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:41.177428 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6041f74c-2617-4177-a706-1103fc8cd9b3 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:41.178532 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6041f74c-2617-4177-a706-1103fc8cd9b3 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:41.183187 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6041f74c-2617-4177-a706-1103fc8cd9b3 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:41.183860 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6041f74c-2617-4177-a706-1103fc8cd9b3 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:41.200695 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-44525254-7a68-47a0-b1b0-f08fe0d8177a tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3b247b-0a03-4399-a95f-73711fb54c0d/ips" status: 200 len: 108 microversion: 2.1 time: 0.079232 Oct 18 15:50:41.202892 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2678/5375] 10.222.0.60 () {58 vars in 1248 bytes} [Tue Oct 18 15:50:41 2022] GET /compute/v2.1/servers/cb3b247b-0a03-4399-a95f-73711fb54c0d/ips => generated 108 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:50:41.217259 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a0de81bd-a779-4510-b39f-701add5bbceb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:41.218310 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a0de81bd-a779-4510-b39f-701add5bbceb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 4ccaffe8-f3ed-47df-a9ee-5437c24b469c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:41.233666 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0de81bd-a779-4510-b39f-701add5bbceb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:41.236646 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0de81bd-a779-4510-b39f-701add5bbceb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:41.237328 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0de81bd-a779-4510-b39f-701add5bbceb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:41.238802 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0de81bd-a779-4510-b39f-701add5bbceb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:41.239289 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0de81bd-a779-4510-b39f-701add5bbceb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:41.239727 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0de81bd-a779-4510-b39f-701add5bbceb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:41.485240 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6041f74c-2617-4177-a706-1103fc8cd9b3 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:41.495439 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6041f74c-2617-4177-a706-1103fc8cd9b3 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0" status: 200 len: 1504 microversion: 2.1 time: 0.338567 Oct 18 15:50:41.500060 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2698/5376] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:41 2022] GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0 => generated 1504 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:50:41.510169 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2a63d7b0-2c76-4a58-ac48-51c1a0d864c9 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:41.516284 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2a63d7b0-2c76-4a58-ac48-51c1a0d864c9 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] [instance: cb3b247b-0a03-4399-a95f-73711fb54c0d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:41.531814 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a63d7b0-2c76-4a58-ac48-51c1a0d864c9 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:41.534137 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a63d7b0-2c76-4a58-ac48-51c1a0d864c9 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:41.534860 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a63d7b0-2c76-4a58-ac48-51c1a0d864c9 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:41.536529 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a63d7b0-2c76-4a58-ac48-51c1a0d864c9 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:41.537598 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a63d7b0-2c76-4a58-ac48-51c1a0d864c9 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:41.539982 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a63d7b0-2c76-4a58-ac48-51c1a0d864c9 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:41.580548 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a0de81bd-a779-4510-b39f-701add5bbceb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:41.591017 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a0de81bd-a779-4510-b39f-701add5bbceb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/4ccaffe8-f3ed-47df-a9ee-5437c24b469c" status: 200 len: 1309 microversion: 2.1 time: 0.386778 Oct 18 15:50:41.591619 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2679/5377] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:41 2022] GET /compute/v2.1/servers/4ccaffe8-f3ed-47df-a9ee-5437c24b469c => generated 1309 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:41.600510 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2a63d7b0-2c76-4a58-ac48-51c1a0d864c9 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3b247b-0a03-4399-a95f-73711fb54c0d/ips" status: 200 len: 108 microversion: 2.1 time: 0.098924 Oct 18 15:50:41.608046 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2699/5378] 10.222.0.60 () {58 vars in 1248 bytes} [Tue Oct 18 15:50:41 2022] GET /compute/v2.1/servers/cb3b247b-0a03-4399-a95f-73711fb54c0d/ips => generated 108 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:50:41.621067 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a5217035-b520-4f7d-aa9d-28aa5a380d9f tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:41.621584 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a5217035-b520-4f7d-aa9d-28aa5a380d9f tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] [instance: cb3b247b-0a03-4399-a95f-73711fb54c0d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:41.639082 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5217035-b520-4f7d-aa9d-28aa5a380d9f tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:41.639082 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5217035-b520-4f7d-aa9d-28aa5a380d9f tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:41.639427 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5217035-b520-4f7d-aa9d-28aa5a380d9f tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:41.640029 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5217035-b520-4f7d-aa9d-28aa5a380d9f tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:41.640639 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5217035-b520-4f7d-aa9d-28aa5a380d9f tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:41.641482 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5217035-b520-4f7d-aa9d-28aa5a380d9f tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:41.689947 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a5217035-b520-4f7d-aa9d-28aa5a380d9f tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3b247b-0a03-4399-a95f-73711fb54c0d/ips/tempest-ServerAddressesTestJSON-439473612-network" status: 200 len: 93 microversion: 2.1 time: 0.080697 Oct 18 15:50:41.691869 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2680/5379] 10.222.0.60 () {58 vars in 1398 bytes} [Tue Oct 18 15:50:41 2022] GET /compute/v2.1/servers/cb3b247b-0a03-4399-a95f-73711fb54c0d/ips/tempest-ServerAddressesTestJSON-439473612-network => generated 93 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 18 15:50:41.704154 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f94140c8-8e36-483d-affa-6c3db7687494 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:41.705928 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f94140c8-8e36-483d-affa-6c3db7687494 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] [instance: cb3b247b-0a03-4399-a95f-73711fb54c0d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:41.712674 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f94140c8-8e36-483d-affa-6c3db7687494 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:41.713306 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f94140c8-8e36-483d-affa-6c3db7687494 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:41.713819 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f94140c8-8e36-483d-affa-6c3db7687494 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:41.714744 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f94140c8-8e36-483d-affa-6c3db7687494 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:41.715281 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f94140c8-8e36-483d-affa-6c3db7687494 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:41.715873 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f94140c8-8e36-483d-affa-6c3db7687494 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:41.755987 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f94140c8-8e36-483d-affa-6c3db7687494 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] [instance: cb3b247b-0a03-4399-a95f-73711fb54c0d] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:50:41.888629 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f94140c8-8e36-483d-affa-6c3db7687494 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] 10.222.0.60 "DELETE /compute/v2.1/servers/cb3b247b-0a03-4399-a95f-73711fb54c0d" status: 204 len: 0 microversion: 2.1 time: 0.187611 Oct 18 15:50:41.890034 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2700/5380] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:50:41 2022] DELETE /compute/v2.1/servers/cb3b247b-0a03-4399-a95f-73711fb54c0d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:50:41.901705 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5b041b57-9bb6-4933-ba4f-0d06ff4befcd tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:41.902722 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5b041b57-9bb6-4933-ba4f-0d06ff4befcd tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] [instance: cb3b247b-0a03-4399-a95f-73711fb54c0d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:41.914856 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5b041b57-9bb6-4933-ba4f-0d06ff4befcd tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:41.915623 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5b041b57-9bb6-4933-ba4f-0d06ff4befcd tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:41.916251 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5b041b57-9bb6-4933-ba4f-0d06ff4befcd tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:41.917246 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5b041b57-9bb6-4933-ba4f-0d06ff4befcd tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:41.917920 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5b041b57-9bb6-4933-ba4f-0d06ff4befcd tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:41.918525 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5b041b57-9bb6-4933-ba4f-0d06ff4befcd tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:42.114245 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-df47961b-ec6a-442b-978e-24bc38c03259 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:42.114799 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-df47961b-ec6a-442b-978e-24bc38c03259 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:42.130728 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-df47961b-ec6a-442b-978e-24bc38c03259 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:42.131237 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-df47961b-ec6a-442b-978e-24bc38c03259 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:42.131686 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-df47961b-ec6a-442b-978e-24bc38c03259 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:42.132404 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-df47961b-ec6a-442b-978e-24bc38c03259 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:42.133798 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-df47961b-ec6a-442b-978e-24bc38c03259 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:42.134489 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-df47961b-ec6a-442b-978e-24bc38c03259 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:42.189439 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5b041b57-9bb6-4933-ba4f-0d06ff4befcd tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d4acf4d5e94fb69a8d757afcadb795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '091b079fb5064ba0aa33004016dd834e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:42.204682 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5b041b57-9bb6-4933-ba4f-0d06ff4befcd tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3b247b-0a03-4399-a95f-73711fb54c0d" status: 200 len: 1511 microversion: 2.1 time: 0.306187 Oct 18 15:50:42.206051 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2681/5381] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:41 2022] GET /compute/v2.1/servers/cb3b247b-0a03-4399-a95f-73711fb54c0d => generated 1511 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:50:42.455987 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-df47961b-ec6a-442b-978e-24bc38c03259 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:42.467139 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-df47961b-ec6a-442b-978e-24bc38c03259 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:42.468699 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-df47961b-ec6a-442b-978e-24bc38c03259 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:42.470901 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-df47961b-ec6a-442b-978e-24bc38c03259 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1805 microversion: 2.20 time: 0.362669 Oct 18 15:50:42.484832 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2701/5382] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:50:42 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1805 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:50:42.528550 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4e232b99-c13f-40b0-aef6-af7c0fef4fd1 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:42.529570 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4e232b99-c13f-40b0-aef6-af7c0fef4fd1 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: ebefddda-1a5f-485c-a89b-697fe8119af0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:42.541336 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e232b99-c13f-40b0-aef6-af7c0fef4fd1 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:42.541826 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e232b99-c13f-40b0-aef6-af7c0fef4fd1 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:42.542268 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e232b99-c13f-40b0-aef6-af7c0fef4fd1 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:42.542994 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e232b99-c13f-40b0-aef6-af7c0fef4fd1 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:42.547252 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e232b99-c13f-40b0-aef6-af7c0fef4fd1 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:42.548184 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e232b99-c13f-40b0-aef6-af7c0fef4fd1 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:42.616658 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-46f71315-8112-4d45-9b16-39593ba51d1d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:42.617394 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-46f71315-8112-4d45-9b16-39593ba51d1d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 4ccaffe8-f3ed-47df-a9ee-5437c24b469c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:42.630749 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-46f71315-8112-4d45-9b16-39593ba51d1d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:42.631259 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-46f71315-8112-4d45-9b16-39593ba51d1d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:42.631709 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-46f71315-8112-4d45-9b16-39593ba51d1d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:42.632434 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-46f71315-8112-4d45-9b16-39593ba51d1d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:42.632927 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-46f71315-8112-4d45-9b16-39593ba51d1d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:42.639577 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-46f71315-8112-4d45-9b16-39593ba51d1d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:42.645198 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:50:42.940500 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4e232b99-c13f-40b0-aef6-af7c0fef4fd1 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:42.955310 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4e232b99-c13f-40b0-aef6-af7c0fef4fd1 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0" status: 200 len: 1504 microversion: 2.1 time: 0.429414 Oct 18 15:50:42.955976 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2682/5383] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:42 2022] GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0 => generated 1504 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:42.962704 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-46f71315-8112-4d45-9b16-39593ba51d1d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:42.972452 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-46f71315-8112-4d45-9b16-39593ba51d1d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/4ccaffe8-f3ed-47df-a9ee-5437c24b469c" status: 200 len: 1309 microversion: 2.1 time: 0.360494 Oct 18 15:50:42.973923 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2702/5384] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:42 2022] GET /compute/v2.1/servers/4ccaffe8-f3ed-47df-a9ee-5437c24b469c => generated 1309 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:43.228536 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4f97d048-d775-483d-9e43-48b88e16d9e7 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:43.229193 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4f97d048-d775-483d-9e43-48b88e16d9e7 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] [instance: cb3b247b-0a03-4399-a95f-73711fb54c0d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:43.236162 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f97d048-d775-483d-9e43-48b88e16d9e7 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:43.236655 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f97d048-d775-483d-9e43-48b88e16d9e7 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:43.241954 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f97d048-d775-483d-9e43-48b88e16d9e7 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:43.244907 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f97d048-d775-483d-9e43-48b88e16d9e7 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:43.245622 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f97d048-d775-483d-9e43-48b88e16d9e7 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:43.246068 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f97d048-d775-483d-9e43-48b88e16d9e7 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:43.477123 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4f97d048-d775-483d-9e43-48b88e16d9e7 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d4acf4d5e94fb69a8d757afcadb795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '091b079fb5064ba0aa33004016dd834e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:43.487352 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4f97d048-d775-483d-9e43-48b88e16d9e7 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3b247b-0a03-4399-a95f-73711fb54c0d" status: 200 len: 1511 microversion: 2.1 time: 0.262554 Oct 18 15:50:43.488174 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2683/5385] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:43 2022] GET /compute/v2.1/servers/cb3b247b-0a03-4399-a95f-73711fb54c0d => generated 1511 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:43.508733 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bc17545d-37ab-4172-a5dc-431c3aea8de1 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:43.509931 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-bc17545d-37ab-4172-a5dc-431c3aea8de1 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:43.517544 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bc17545d-37ab-4172-a5dc-431c3aea8de1 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:43.518318 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bc17545d-37ab-4172-a5dc-431c3aea8de1 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:43.518987 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bc17545d-37ab-4172-a5dc-431c3aea8de1 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:43.519990 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bc17545d-37ab-4172-a5dc-431c3aea8de1 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:43.520634 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bc17545d-37ab-4172-a5dc-431c3aea8de1 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:43.521266 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bc17545d-37ab-4172-a5dc-431c3aea8de1 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:43.707244 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-bc17545d-37ab-4172-a5dc-431c3aea8de1 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:43.720288 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-bc17545d-37ab-4172-a5dc-431c3aea8de1 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:43.722276 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-bc17545d-37ab-4172-a5dc-431c3aea8de1 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:43.723773 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-bc17545d-37ab-4172-a5dc-431c3aea8de1 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1805 microversion: 2.20 time: 0.221468 Oct 18 15:50:43.737471 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2703/5386] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:50:43 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1805 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:50:43.983130 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-992123ea-87e2-4080-a262-b1a69804583f tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:43.984462 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-992123ea-87e2-4080-a262-b1a69804583f tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: ebefddda-1a5f-485c-a89b-697fe8119af0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:43.997313 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-992123ea-87e2-4080-a262-b1a69804583f tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:43.998117 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-992123ea-87e2-4080-a262-b1a69804583f tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:43.998784 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-992123ea-87e2-4080-a262-b1a69804583f tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:43.999703 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-992123ea-87e2-4080-a262-b1a69804583f tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:43.999912 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2f5195bf-2037-415e-9ae4-54baa816129e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:44.000543 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2f5195bf-2037-415e-9ae4-54baa816129e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 4ccaffe8-f3ed-47df-a9ee-5437c24b469c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:44.000782 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-992123ea-87e2-4080-a262-b1a69804583f tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:44.001456 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-992123ea-87e2-4080-a262-b1a69804583f tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:44.018197 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2f5195bf-2037-415e-9ae4-54baa816129e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:44.018823 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2f5195bf-2037-415e-9ae4-54baa816129e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:44.019392 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2f5195bf-2037-415e-9ae4-54baa816129e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:44.020153 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2f5195bf-2037-415e-9ae4-54baa816129e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:44.020626 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2f5195bf-2037-415e-9ae4-54baa816129e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:44.021092 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2f5195bf-2037-415e-9ae4-54baa816129e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:44.327041 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-992123ea-87e2-4080-a262-b1a69804583f tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:44.328700 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2f5195bf-2037-415e-9ae4-54baa816129e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:44.343577 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-992123ea-87e2-4080-a262-b1a69804583f tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0" status: 200 len: 1504 microversion: 2.1 time: 0.364019 Oct 18 15:50:44.345593 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2f5195bf-2037-415e-9ae4-54baa816129e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/4ccaffe8-f3ed-47df-a9ee-5437c24b469c" status: 200 len: 1309 microversion: 2.1 time: 0.349413 Oct 18 15:50:44.357323 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2704/5388] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:43 2022] GET /compute/v2.1/servers/4ccaffe8-f3ed-47df-a9ee-5437c24b469c => generated 1309 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:50:44.357660 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2684/5388] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:43 2022] GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0 => generated 1504 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:44.515985 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eb01508c-cafe-4016-9eb1-3e8bf18f32c2 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:44.516647 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-eb01508c-cafe-4016-9eb1-3e8bf18f32c2 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] [instance: cb3b247b-0a03-4399-a95f-73711fb54c0d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:44.524179 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb01508c-cafe-4016-9eb1-3e8bf18f32c2 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:44.524675 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb01508c-cafe-4016-9eb1-3e8bf18f32c2 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:44.525144 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb01508c-cafe-4016-9eb1-3e8bf18f32c2 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:44.525847 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb01508c-cafe-4016-9eb1-3e8bf18f32c2 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:44.526298 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb01508c-cafe-4016-9eb1-3e8bf18f32c2 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:44.526902 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb01508c-cafe-4016-9eb1-3e8bf18f32c2 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:44.753517 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0573e00c-9368-4e3b-a078-724824ef3cbb tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:44.754280 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0573e00c-9368-4e3b-a078-724824ef3cbb tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:44.793732 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0573e00c-9368-4e3b-a078-724824ef3cbb tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:44.795268 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0573e00c-9368-4e3b-a078-724824ef3cbb tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:44.798841 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0573e00c-9368-4e3b-a078-724824ef3cbb tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:44.801920 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0573e00c-9368-4e3b-a078-724824ef3cbb tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:44.802438 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0573e00c-9368-4e3b-a078-724824ef3cbb tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:44.802874 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0573e00c-9368-4e3b-a078-724824ef3cbb tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:44.820268 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-eb01508c-cafe-4016-9eb1-3e8bf18f32c2 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d4acf4d5e94fb69a8d757afcadb795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '091b079fb5064ba0aa33004016dd834e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:44.828468 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-eb01508c-cafe-4016-9eb1-3e8bf18f32c2 tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3b247b-0a03-4399-a95f-73711fb54c0d" status: 200 len: 1511 microversion: 2.1 time: 0.316803 Oct 18 15:50:44.848898 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2685/5389] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:44 2022] GET /compute/v2.1/servers/cb3b247b-0a03-4399-a95f-73711fb54c0d => generated 1511 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:45.369765 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ee07a225-5c4a-4fb0-92dc-7e76914834e7 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:45.370328 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ee07a225-5c4a-4fb0-92dc-7e76914834e7 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: ebefddda-1a5f-485c-a89b-697fe8119af0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:45.382411 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee07a225-5c4a-4fb0-92dc-7e76914834e7 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:45.382916 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee07a225-5c4a-4fb0-92dc-7e76914834e7 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:45.383358 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee07a225-5c4a-4fb0-92dc-7e76914834e7 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:45.384079 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee07a225-5c4a-4fb0-92dc-7e76914834e7 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:45.384537 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee07a225-5c4a-4fb0-92dc-7e76914834e7 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:45.388688 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee07a225-5c4a-4fb0-92dc-7e76914834e7 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:45.759818 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0573e00c-9368-4e3b-a078-724824ef3cbb tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:45.784521 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0573e00c-9368-4e3b-a078-724824ef3cbb tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:45.787444 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0573e00c-9368-4e3b-a078-724824ef3cbb tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:45.792511 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0573e00c-9368-4e3b-a078-724824ef3cbb tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1805 microversion: 2.20 time: 1.044954 Oct 18 15:50:45.796397 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2705/5390] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:50:44 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1805 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:50:45.811870 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a8e89803-81f4-4837-a605-f6aa4adad292 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:45.812517 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a8e89803-81f4-4837-a605-f6aa4adad292 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 4ccaffe8-f3ed-47df-a9ee-5437c24b469c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:45.817870 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ee07a225-5c4a-4fb0-92dc-7e76914834e7 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:45.827322 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ee07a225-5c4a-4fb0-92dc-7e76914834e7 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0" status: 200 len: 1504 microversion: 2.1 time: 0.461489 Oct 18 15:50:45.827920 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2686/5391] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:45 2022] GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0 => generated 1504 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:45.838733 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a8e89803-81f4-4837-a605-f6aa4adad292 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:45.839973 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a8e89803-81f4-4837-a605-f6aa4adad292 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:45.840583 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a8e89803-81f4-4837-a605-f6aa4adad292 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:45.847489 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a8e89803-81f4-4837-a605-f6aa4adad292 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:45.847979 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a8e89803-81f4-4837-a605-f6aa4adad292 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:45.848411 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a8e89803-81f4-4837-a605-f6aa4adad292 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:46.093247 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a8e89803-81f4-4837-a605-f6aa4adad292 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:46.107549 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a8e89803-81f4-4837-a605-f6aa4adad292 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/4ccaffe8-f3ed-47df-a9ee-5437c24b469c" status: 200 len: 1309 microversion: 2.1 time: 0.305097 Oct 18 15:50:46.107549 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2706/5392] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:45 2022] GET /compute/v2.1/servers/4ccaffe8-f3ed-47df-a9ee-5437c24b469c => generated 1309 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:46.130219 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b7cf509e-c4d3-4872-b5cb-3f10b742f23d tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:46.130854 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b7cf509e-c4d3-4872-b5cb-3f10b742f23d tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] [instance: cb3b247b-0a03-4399-a95f-73711fb54c0d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:46.140213 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b7cf509e-c4d3-4872-b5cb-3f10b742f23d tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:46.146376 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b7cf509e-c4d3-4872-b5cb-3f10b742f23d tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:46.151066 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b7cf509e-c4d3-4872-b5cb-3f10b742f23d tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:46.153721 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b7cf509e-c4d3-4872-b5cb-3f10b742f23d tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:46.154791 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b7cf509e-c4d3-4872-b5cb-3f10b742f23d tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:46.156602 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b7cf509e-c4d3-4872-b5cb-3f10b742f23d tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:46.194959 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-cbf40957-d2fa-4c23-8f33-721b5184e011 req-0e031343-5ac2-4f36-97cb-c6c42eaed972 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb3b247b-0a03-4399-a95f-73711fb54c0d", "name": "network-vif-deleted", "tag": "50da9465-25dd-4be0-895a-af5aa6979948"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:50:46.212966 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-cbf40957-d2fa-4c23-8f33-721b5184e011 req-0e031343-5ac2-4f36-97cb-c6c42eaed972 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:46.213848 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-cbf40957-d2fa-4c23-8f33-721b5184e011 req-0e031343-5ac2-4f36-97cb-c6c42eaed972 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:46.218262 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-cbf40957-d2fa-4c23-8f33-721b5184e011 req-0e031343-5ac2-4f36-97cb-c6c42eaed972 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:46.255768 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-cbf40957-d2fa-4c23-8f33-721b5184e011 req-0e031343-5ac2-4f36-97cb-c6c42eaed972 service nova] Creating event network-vif-deleted:50da9465-25dd-4be0-895a-af5aa6979948 for instance cb3b247b-0a03-4399-a95f-73711fb54c0d on n-h1-853682-5 Oct 18 15:50:46.258594 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b7cf509e-c4d3-4872-b5cb-3f10b742f23d tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:46.262552 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b7cf509e-c4d3-4872-b5cb-3f10b742f23d tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:46.263009 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b7cf509e-c4d3-4872-b5cb-3f10b742f23d tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:46.266295 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-b7cf509e-c4d3-4872-b5cb-3f10b742f23d tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lazy-loading 'fault' on Instance uuid cb3b247b-0a03-4399-a95f-73711fb54c0d {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:50:46.269419 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-cbf40957-d2fa-4c23-8f33-721b5184e011 req-0e031343-5ac2-4f36-97cb-c6c42eaed972 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.434872 Oct 18 15:50:46.273465 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2687/5393] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:50:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:50:46.430550 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b7cf509e-c4d3-4872-b5cb-3f10b742f23d tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d4acf4d5e94fb69a8d757afcadb795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '091b079fb5064ba0aa33004016dd834e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:46.442293 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b7cf509e-c4d3-4872-b5cb-3f10b742f23d tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3b247b-0a03-4399-a95f-73711fb54c0d" status: 200 len: 1307 microversion: 2.1 time: 0.334661 Oct 18 15:50:46.443392 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2707/5394] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:46 2022] GET /compute/v2.1/servers/cb3b247b-0a03-4399-a95f-73711fb54c0d => generated 1307 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:46.464160 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-21ed413d-3d90-4583-9340-e237d6d0a279 req-46da15c7-3a09-4a4b-9b5d-7ea30cb75f88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ccaffe8-f3ed-47df-a9ee-5437c24b469c", "name": "network-vif-plugged", "status": "completed", "tag": "c1c3e92b-76a2-45fc-a4f5-0e22972d1e6b"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:50:46.476154 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-21ed413d-3d90-4583-9340-e237d6d0a279 req-46da15c7-3a09-4a4b-9b5d-7ea30cb75f88 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:46.476620 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-21ed413d-3d90-4583-9340-e237d6d0a279 req-46da15c7-3a09-4a4b-9b5d-7ea30cb75f88 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:46.477327 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-21ed413d-3d90-4583-9340-e237d6d0a279 req-46da15c7-3a09-4a4b-9b5d-7ea30cb75f88 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:46.490423 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-21ed413d-3d90-4583-9340-e237d6d0a279 req-46da15c7-3a09-4a4b-9b5d-7ea30cb75f88 service nova] Creating event network-vif-plugged:c1c3e92b-76a2-45fc-a4f5-0e22972d1e6b for instance 4ccaffe8-f3ed-47df-a9ee-5437c24b469c on n-h1-853682-5 Oct 18 15:50:46.495714 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-21ed413d-3d90-4583-9340-e237d6d0a279 req-46da15c7-3a09-4a4b-9b5d-7ea30cb75f88 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169430 Oct 18 15:50:46.499876 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2688/5395] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:50:46.825684 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e04d328b-c953-4cac-9e46-021984cf364a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:46.827085 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e04d328b-c953-4cac-9e46-021984cf364a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:46.836508 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e04d328b-c953-4cac-9e46-021984cf364a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:46.837456 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e04d328b-c953-4cac-9e46-021984cf364a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:46.838472 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e04d328b-c953-4cac-9e46-021984cf364a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:46.839997 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e04d328b-c953-4cac-9e46-021984cf364a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:46.840989 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e04d328b-c953-4cac-9e46-021984cf364a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:46.841640 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e04d328b-c953-4cac-9e46-021984cf364a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:46.858246 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f05a19ea-cc70-45c0-9e06-cc91ab7bdfeb tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:46.860709 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f05a19ea-cc70-45c0-9e06-cc91ab7bdfeb tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: ebefddda-1a5f-485c-a89b-697fe8119af0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:46.882343 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f05a19ea-cc70-45c0-9e06-cc91ab7bdfeb tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:46.883836 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f05a19ea-cc70-45c0-9e06-cc91ab7bdfeb tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:46.895864 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f05a19ea-cc70-45c0-9e06-cc91ab7bdfeb tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:46.898396 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f05a19ea-cc70-45c0-9e06-cc91ab7bdfeb tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:46.899577 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f05a19ea-cc70-45c0-9e06-cc91ab7bdfeb tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:46.901025 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f05a19ea-cc70-45c0-9e06-cc91ab7bdfeb tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:46.942855 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:50:47.548591 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f05a19ea-cc70-45c0-9e06-cc91ab7bdfeb tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:47.560224 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f05a19ea-cc70-45c0-9e06-cc91ab7bdfeb tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0" status: 200 len: 1504 microversion: 2.1 time: 0.707520 Oct 18 15:50:47.595997 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2689/5396] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:46 2022] GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0 => generated 1504 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:50:47.607899 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a7dd7b67-61f7-41f6-b0a8-77640fb2ed97 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:47.610213 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a7dd7b67-61f7-41f6-b0a8-77640fb2ed97 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 4ccaffe8-f3ed-47df-a9ee-5437c24b469c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:47.630466 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7dd7b67-61f7-41f6-b0a8-77640fb2ed97 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:47.633432 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7dd7b67-61f7-41f6-b0a8-77640fb2ed97 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:47.633432 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7dd7b67-61f7-41f6-b0a8-77640fb2ed97 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:47.635348 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7dd7b67-61f7-41f6-b0a8-77640fb2ed97 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:47.636232 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7dd7b67-61f7-41f6-b0a8-77640fb2ed97 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:47.636967 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7dd7b67-61f7-41f6-b0a8-77640fb2ed97 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:47.637142 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e04d328b-c953-4cac-9e46-021984cf364a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:47.660280 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e04d328b-c953-4cac-9e46-021984cf364a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:47.698946 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e04d328b-c953-4cac-9e46-021984cf364a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:47.702847 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e04d328b-c953-4cac-9e46-021984cf364a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1805 microversion: 2.20 time: 0.882851 Oct 18 15:50:47.710203 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2708/5397] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:50:46 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1805 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:50:47.721458 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-30204dac-1e7e-4415-8410-539fcf8949fd tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:47.725009 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-30204dac-1e7e-4415-8410-539fcf8949fd tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] [instance: cb3b247b-0a03-4399-a95f-73711fb54c0d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:47.734658 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-30204dac-1e7e-4415-8410-539fcf8949fd tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:47.735195 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-30204dac-1e7e-4415-8410-539fcf8949fd tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:47.741365 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-30204dac-1e7e-4415-8410-539fcf8949fd tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:47.742557 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-30204dac-1e7e-4415-8410-539fcf8949fd tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:47.743213 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-30204dac-1e7e-4415-8410-539fcf8949fd tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:47.743937 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-30204dac-1e7e-4415-8410-539fcf8949fd tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:47.791035 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-30204dac-1e7e-4415-8410-539fcf8949fd tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] HTTP exception thrown: Instance cb3b247b-0a03-4399-a95f-73711fb54c0d could not be found. Oct 18 15:50:47.791035 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-30204dac-1e7e-4415-8410-539fcf8949fd tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Request method failure captured: Oct 18 15:50:47.791035 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/cb3b247b-0a03-4399-a95f-73711fb54c0d HTTP/1.1 Oct 18 15:50:47.791035 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:50:47.791035 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:50:47.791035 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:50:47.791035 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:50:47.791035 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:50:47.791035 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:50:47.791035 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:50:47.791035 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:50:47.791035 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsszblhJA4ilXR1eG_cg4tvH0iGzF-SCGop7LkJcpi_0XIKkIXGj7U8FBRX0QJT_5r37OH3lq5AKnZQ-89AQIl9CDp62hgIxpCiNZ25hgq6Pi4beDDuTQLqecceTxPYRLLTNueGokWG8T1G7lmvrKF_hmbrnb1CVkDfaAuEgAa5CPZM Oct 18 15:50:47.791035 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:50:47.791035 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:50:47.791035 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:50:47.791035 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:50:47.791035 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:50:47.791035 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:50:47.791035 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 091b079fb5064ba0aa33004016dd834e Oct 18 15:50:47.791035 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServerAddressesTestJSON-1365059826 Oct 18 15:50:47.791035 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:50:47.791035 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:50:47.791035 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/091b079fb5064ba0aa33004016dd834e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/091b079fb5064ba0aa33004016dd834e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/091b079fb5064ba0aa33004016dd834e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_091b079fb5064ba0aa33004016dd834e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:50:47.791035 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServerAddressesTestJSON-1365059826 Oct 18 15:50:47.791035 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 091b079fb5064ba0aa33004016dd834e Oct 18 15:50:47.791035 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1365059826 Oct 18 15:50:47.791035 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServerAddressesTestJSON-1365059826-project Oct 18 15:50:47.791035 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:50:47.791035 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:50:47.791035 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 75d4acf4d5e94fb69a8d757afcadb795 Oct 18 15:50:47.791035 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServerAddressesTestJSON-1365059826-project Oct 18 15:50:47.791035 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:50:47.791035 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance cb3b247b-0a03-4399-a95f-73711fb54c0d could not be found. Oct 18 15:50:47.791035 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'cb3b247b-0a03-4399-a95f-73711fb54c0d'} Oct 18 15:50:47.791035 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:50:47.791035 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:50:47.791035 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:50:47.791035 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:50:47.791035 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:50:47.791035 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:50:47.791035 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:50:47.791035 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:50:47.791035 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:50:47.791035 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:50:47.791035 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb3b247b-0a03-4399-a95f-73711fb54c0d could not be found. Oct 18 15:50:47.791035 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:50:47.791035 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:50:47.791035 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:50:47.791035 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:50:47.791035 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:50:47.791035 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:50:47.791035 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:50:47.791035 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:50:47.791035 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:50:47.791035 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:50:47.791035 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:50:47.791035 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:50:47.791035 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:50:47.791035 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:50:47.791035 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:50:47.791035 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:50:47.796562 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb3b247b-0a03-4399-a95f-73711fb54c0d could not be found. Oct 18 15:50:47.796562 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:50:47.796562 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:50:47.796562 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:50:47.796562 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:50:47.796562 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:50:47.796562 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:50:47.796562 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:50:47.796562 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:50:47.796562 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb3b247b-0a03-4399-a95f-73711fb54c0d could not be found. Oct 18 15:50:47.796562 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:50:47.796562 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-30204dac-1e7e-4415-8410-539fcf8949fd tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] Returning 404 to user: Instance cb3b247b-0a03-4399-a95f-73711fb54c0d could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:50:47.798239 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-30204dac-1e7e-4415-8410-539fcf8949fd tempest-ServerAddressesTestJSON-1365059826 tempest-ServerAddressesTestJSON-1365059826-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3b247b-0a03-4399-a95f-73711fb54c0d" status: 404 len: 111 microversion: 2.1 time: 0.079112 Oct 18 15:50:47.798239 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2709/5398] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:47 2022] GET /compute/v2.1/servers/cb3b247b-0a03-4399-a95f-73711fb54c0d => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:50:48.225462 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a7dd7b67-61f7-41f6-b0a8-77640fb2ed97 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:48.234073 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a7dd7b67-61f7-41f6-b0a8-77640fb2ed97 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/4ccaffe8-f3ed-47df-a9ee-5437c24b469c" status: 200 len: 1309 microversion: 2.1 time: 0.636599 Oct 18 15:50:48.234675 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2690/5399] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:47 2022] GET /compute/v2.1/servers/4ccaffe8-f3ed-47df-a9ee-5437c24b469c => generated 1309 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:48.590929 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-babdf1a8-f73d-4c44-8d84-15c34cefa15f tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:48.591558 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-babdf1a8-f73d-4c44-8d84-15c34cefa15f tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: ebefddda-1a5f-485c-a89b-697fe8119af0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:48.604730 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-babdf1a8-f73d-4c44-8d84-15c34cefa15f tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:48.605004 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-babdf1a8-f73d-4c44-8d84-15c34cefa15f tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:48.605445 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-babdf1a8-f73d-4c44-8d84-15c34cefa15f tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:48.606170 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-babdf1a8-f73d-4c44-8d84-15c34cefa15f tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:48.609189 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-babdf1a8-f73d-4c44-8d84-15c34cefa15f tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:48.609623 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-babdf1a8-f73d-4c44-8d84-15c34cefa15f tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:48.732330 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8d5d6d26-7d28-4625-9a98-b368eaac14d8 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:48.733669 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8d5d6d26-7d28-4625-9a98-b368eaac14d8 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:48.749978 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d5d6d26-7d28-4625-9a98-b368eaac14d8 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:48.750772 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d5d6d26-7d28-4625-9a98-b368eaac14d8 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:48.751456 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d5d6d26-7d28-4625-9a98-b368eaac14d8 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:48.753833 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d5d6d26-7d28-4625-9a98-b368eaac14d8 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:48.755091 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d5d6d26-7d28-4625-9a98-b368eaac14d8 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:48.757132 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d5d6d26-7d28-4625-9a98-b368eaac14d8 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:48.999783 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-babdf1a8-f73d-4c44-8d84-15c34cefa15f tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:49.015659 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-babdf1a8-f73d-4c44-8d84-15c34cefa15f tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0" status: 200 len: 1504 microversion: 2.1 time: 0.426617 Oct 18 15:50:49.018860 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2710/5400] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:48 2022] GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0 => generated 1504 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:49.195163 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8d5d6d26-7d28-4625-9a98-b368eaac14d8 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:49.216964 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8d5d6d26-7d28-4625-9a98-b368eaac14d8 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:49.218703 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8d5d6d26-7d28-4625-9a98-b368eaac14d8 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:49.220582 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8d5d6d26-7d28-4625-9a98-b368eaac14d8 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1805 microversion: 2.20 time: 0.492994 Oct 18 15:50:49.221192 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2691/5401] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:50:48 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1805 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:50:49.261014 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7006ea0a-b151-4593-892e-74811c3464ab tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:49.262780 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7006ea0a-b151-4593-892e-74811c3464ab tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 4ccaffe8-f3ed-47df-a9ee-5437c24b469c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:49.272775 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7006ea0a-b151-4593-892e-74811c3464ab tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:49.277326 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7006ea0a-b151-4593-892e-74811c3464ab tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:49.277819 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7006ea0a-b151-4593-892e-74811c3464ab tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:49.278807 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7006ea0a-b151-4593-892e-74811c3464ab tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:49.279288 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7006ea0a-b151-4593-892e-74811c3464ab tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:49.279718 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7006ea0a-b151-4593-892e-74811c3464ab tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:49.594189 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7006ea0a-b151-4593-892e-74811c3464ab tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:49.607723 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7006ea0a-b151-4593-892e-74811c3464ab tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/4ccaffe8-f3ed-47df-a9ee-5437c24b469c" status: 200 len: 1490 microversion: 2.1 time: 0.351764 Oct 18 15:50:49.626838 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2711/5402] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:49 2022] GET /compute/v2.1/servers/4ccaffe8-f3ed-47df-a9ee-5437c24b469c => generated 1490 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:49.635100 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-04ae1b01-bcb3-4db5-a7c5-6781ebcdc3f8 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:49.635737 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-04ae1b01-bcb3-4db5-a7c5-6781ebcdc3f8 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: d3069d75-261b-4abe-a68b-fc25cac7e549] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:49.649931 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04ae1b01-bcb3-4db5-a7c5-6781ebcdc3f8 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:49.650627 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04ae1b01-bcb3-4db5-a7c5-6781ebcdc3f8 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:49.651070 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04ae1b01-bcb3-4db5-a7c5-6781ebcdc3f8 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:49.651948 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04ae1b01-bcb3-4db5-a7c5-6781ebcdc3f8 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:49.652453 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04ae1b01-bcb3-4db5-a7c5-6781ebcdc3f8 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:49.652868 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04ae1b01-bcb3-4db5-a7c5-6781ebcdc3f8 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:50.041553 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-79c77048-4c8d-4119-81aa-d73ee3ac9f6a tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:50.042104 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-04ae1b01-bcb3-4db5-a7c5-6781ebcdc3f8 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:50.042637 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-79c77048-4c8d-4119-81aa-d73ee3ac9f6a tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: ebefddda-1a5f-485c-a89b-697fe8119af0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:50.052039 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-04ae1b01-bcb3-4db5-a7c5-6781ebcdc3f8 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/d3069d75-261b-4abe-a68b-fc25cac7e549" status: 200 len: 1489 microversion: 2.1 time: 0.421466 Oct 18 15:50:50.052612 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-79c77048-4c8d-4119-81aa-d73ee3ac9f6a tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:50.056604 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2692/5403] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:49 2022] GET /compute/v2.1/servers/d3069d75-261b-4abe-a68b-fc25cac7e549 => generated 1489 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:50.064437 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-79c77048-4c8d-4119-81aa-d73ee3ac9f6a tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:50.064988 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-79c77048-4c8d-4119-81aa-d73ee3ac9f6a tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:50.065762 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-79c77048-4c8d-4119-81aa-d73ee3ac9f6a tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:50.066247 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-79c77048-4c8d-4119-81aa-d73ee3ac9f6a tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:50.066675 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-79c77048-4c8d-4119-81aa-d73ee3ac9f6a tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:50.088413 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a1fe7e04-dd91-4c9f-ae35-f4bdefbc7a5f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:50.088904 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a1fe7e04-dd91-4c9f-ae35-f4bdefbc7a5f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 4ccaffe8-f3ed-47df-a9ee-5437c24b469c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:50.099474 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1fe7e04-dd91-4c9f-ae35-f4bdefbc7a5f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:50.100433 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1fe7e04-dd91-4c9f-ae35-f4bdefbc7a5f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:50.103473 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1fe7e04-dd91-4c9f-ae35-f4bdefbc7a5f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:50.104493 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1fe7e04-dd91-4c9f-ae35-f4bdefbc7a5f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:50.105221 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1fe7e04-dd91-4c9f-ae35-f4bdefbc7a5f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:50.107537 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1fe7e04-dd91-4c9f-ae35-f4bdefbc7a5f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:50.482585 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-79c77048-4c8d-4119-81aa-d73ee3ac9f6a tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:50.495975 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-79c77048-4c8d-4119-81aa-d73ee3ac9f6a tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0" status: 200 len: 1504 microversion: 2.1 time: 0.456276 Oct 18 15:50:50.499797 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2712/5404] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:50 2022] GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0 => generated 1504 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:50:50.510543 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-432b2134-7651-446e-88f6-3049f970e933 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:50.512248 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-432b2134-7651-446e-88f6-3049f970e933 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:50.528730 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-432b2134-7651-446e-88f6-3049f970e933 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:50.536938 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-432b2134-7651-446e-88f6-3049f970e933 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:50.537597 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-432b2134-7651-446e-88f6-3049f970e933 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:50.538447 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-432b2134-7651-446e-88f6-3049f970e933 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:50.539462 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-432b2134-7651-446e-88f6-3049f970e933 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:50.540141 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-432b2134-7651-446e-88f6-3049f970e933 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:50.545496 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a1fe7e04-dd91-4c9f-ae35-f4bdefbc7a5f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:50.562026 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a1fe7e04-dd91-4c9f-ae35-f4bdefbc7a5f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/4ccaffe8-f3ed-47df-a9ee-5437c24b469c" status: 200 len: 1490 microversion: 2.1 time: 0.473589 Oct 18 15:50:50.566259 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2693/5405] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:50 2022] GET /compute/v2.1/servers/4ccaffe8-f3ed-47df-a9ee-5437c24b469c => generated 1490 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:50.595933 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d01289a8-f319-441c-b58c-5a3785671e8e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:50.596765 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d01289a8-f319-441c-b58c-5a3785671e8e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 4ccaffe8-f3ed-47df-a9ee-5437c24b469c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:50.608398 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d01289a8-f319-441c-b58c-5a3785671e8e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:50.609225 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d01289a8-f319-441c-b58c-5a3785671e8e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:50.612409 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d01289a8-f319-441c-b58c-5a3785671e8e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:50.614074 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d01289a8-f319-441c-b58c-5a3785671e8e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:50.614749 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d01289a8-f319-441c-b58c-5a3785671e8e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:50.615414 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d01289a8-f319-441c-b58c-5a3785671e8e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:50.720348 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d01289a8-f319-441c-b58c-5a3785671e8e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 4ccaffe8-f3ed-47df-a9ee-5437c24b469c] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:50:50.861463 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-432b2134-7651-446e-88f6-3049f970e933 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:50.876079 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-432b2134-7651-446e-88f6-3049f970e933 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:50.878355 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-432b2134-7651-446e-88f6-3049f970e933 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:50.886400 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-432b2134-7651-446e-88f6-3049f970e933 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1805 microversion: 2.20 time: 0.384021 Oct 18 15:50:50.887459 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2713/5406] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:50:50 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1805 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:50:50.945078 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d01289a8-f319-441c-b58c-5a3785671e8e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4ccaffe8-f3ed-47df-a9ee-5437c24b469c" status: 204 len: 0 microversion: 2.1 time: 0.354401 Oct 18 15:50:50.946191 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2694/5407] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:50:50 2022] DELETE /compute/v2.1/servers/4ccaffe8-f3ed-47df-a9ee-5437c24b469c => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 15:50:50.962473 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9f61fb9d-eabe-4fe1-ae17-fcf30610620f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:50.963606 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9f61fb9d-eabe-4fe1-ae17-fcf30610620f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 4ccaffe8-f3ed-47df-a9ee-5437c24b469c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:50.974141 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9f61fb9d-eabe-4fe1-ae17-fcf30610620f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:50.975396 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9f61fb9d-eabe-4fe1-ae17-fcf30610620f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:50.976136 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9f61fb9d-eabe-4fe1-ae17-fcf30610620f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:50.977120 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9f61fb9d-eabe-4fe1-ae17-fcf30610620f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:50.977917 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9f61fb9d-eabe-4fe1-ae17-fcf30610620f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:50.978603 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9f61fb9d-eabe-4fe1-ae17-fcf30610620f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:51.236276 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9f61fb9d-eabe-4fe1-ae17-fcf30610620f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:51.245912 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9f61fb9d-eabe-4fe1-ae17-fcf30610620f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/4ccaffe8-f3ed-47df-a9ee-5437c24b469c" status: 200 len: 1496 microversion: 2.1 time: 0.294997 Oct 18 15:50:51.250568 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2714/5408] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:50 2022] GET /compute/v2.1/servers/4ccaffe8-f3ed-47df-a9ee-5437c24b469c => generated 1496 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:50:51.525208 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-063e5fcd-96e5-4b8f-8144-ca8cfef4f695 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:51.526331 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-063e5fcd-96e5-4b8f-8144-ca8cfef4f695 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: ebefddda-1a5f-485c-a89b-697fe8119af0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:51.534412 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:50:51.536102 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-063e5fcd-96e5-4b8f-8144-ca8cfef4f695 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:51.536936 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-063e5fcd-96e5-4b8f-8144-ca8cfef4f695 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:51.537609 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-063e5fcd-96e5-4b8f-8144-ca8cfef4f695 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:51.539411 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-063e5fcd-96e5-4b8f-8144-ca8cfef4f695 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:51.540053 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-063e5fcd-96e5-4b8f-8144-ca8cfef4f695 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:51.540657 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-063e5fcd-96e5-4b8f-8144-ca8cfef4f695 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:51.874229 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-063e5fcd-96e5-4b8f-8144-ca8cfef4f695 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:51.887024 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-063e5fcd-96e5-4b8f-8144-ca8cfef4f695 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0" status: 200 len: 1504 microversion: 2.1 time: 0.366887 Oct 18 15:50:51.888150 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2695/5409] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:51 2022] GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0 => generated 1504 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:51.918922 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-af600785-91f4-41d2-afa4-23e103df93f3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:51.920525 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-af600785-91f4-41d2-afa4-23e103df93f3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:51.928461 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-af600785-91f4-41d2-afa4-23e103df93f3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:51.929273 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-af600785-91f4-41d2-afa4-23e103df93f3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:51.930209 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-af600785-91f4-41d2-afa4-23e103df93f3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:51.931157 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-af600785-91f4-41d2-afa4-23e103df93f3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:51.931915 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-af600785-91f4-41d2-afa4-23e103df93f3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:51.932340 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-af600785-91f4-41d2-afa4-23e103df93f3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:52.272046 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-10b3b264-bca0-4137-a7f5-bd7e997524d7 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:52.273223 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-10b3b264-bca0-4137-a7f5-bd7e997524d7 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 4ccaffe8-f3ed-47df-a9ee-5437c24b469c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:52.288770 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10b3b264-bca0-4137-a7f5-bd7e997524d7 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:52.289507 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10b3b264-bca0-4137-a7f5-bd7e997524d7 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:52.290143 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10b3b264-bca0-4137-a7f5-bd7e997524d7 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:52.291029 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10b3b264-bca0-4137-a7f5-bd7e997524d7 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:52.291660 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10b3b264-bca0-4137-a7f5-bd7e997524d7 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:52.292251 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10b3b264-bca0-4137-a7f5-bd7e997524d7 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:52.352211 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-af600785-91f4-41d2-afa4-23e103df93f3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:52.411533 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-af600785-91f4-41d2-afa4-23e103df93f3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:52.420751 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-af600785-91f4-41d2-afa4-23e103df93f3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:52.426409 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-af600785-91f4-41d2-afa4-23e103df93f3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1805 microversion: 2.20 time: 0.513478 Oct 18 15:50:52.434949 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2715/5410] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:50:51 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1805 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:50:52.551620 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-10b3b264-bca0-4137-a7f5-bd7e997524d7 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:52.563498 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-10b3b264-bca0-4137-a7f5-bd7e997524d7 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/4ccaffe8-f3ed-47df-a9ee-5437c24b469c" status: 200 len: 1496 microversion: 2.1 time: 0.295432 Oct 18 15:50:52.565657 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2696/5411] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:52 2022] GET /compute/v2.1/servers/4ccaffe8-f3ed-47df-a9ee-5437c24b469c => generated 1496 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:50:52.852497 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-77eedc4c-49ba-4c6d-b6b4-2f1c70647aa5 req-7a5341ac-7224-4756-be0e-c0d56fb6ca7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b465248f-ab7a-4aba-b939-6f236eea166e", "name": "network-vif-plugged", "status": "completed", "tag": "440cc1c1-492e-40b0-8244-adb2559e6c7f"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:50:52.875113 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-77eedc4c-49ba-4c6d-b6b4-2f1c70647aa5 req-7a5341ac-7224-4756-be0e-c0d56fb6ca7b service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:52.875635 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-77eedc4c-49ba-4c6d-b6b4-2f1c70647aa5 req-7a5341ac-7224-4756-be0e-c0d56fb6ca7b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:52.876061 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-77eedc4c-49ba-4c6d-b6b4-2f1c70647aa5 req-7a5341ac-7224-4756-be0e-c0d56fb6ca7b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:52.891029 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-77eedc4c-49ba-4c6d-b6b4-2f1c70647aa5 req-7a5341ac-7224-4756-be0e-c0d56fb6ca7b service nova] Creating event network-vif-plugged:440cc1c1-492e-40b0-8244-adb2559e6c7f for instance b465248f-ab7a-4aba-b939-6f236eea166e on n-h2-853682-5 Oct 18 15:50:52.897466 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-77eedc4c-49ba-4c6d-b6b4-2f1c70647aa5 req-7a5341ac-7224-4756-be0e-c0d56fb6ca7b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055624 Oct 18 15:50:52.898210 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2716/5412] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:50:52.912304 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-480fa4b7-e167-4a7d-9ded-ecd10dbbf08f tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:52.913866 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-480fa4b7-e167-4a7d-9ded-ecd10dbbf08f tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: ebefddda-1a5f-485c-a89b-697fe8119af0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:52.931580 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-480fa4b7-e167-4a7d-9ded-ecd10dbbf08f tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:52.932112 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-480fa4b7-e167-4a7d-9ded-ecd10dbbf08f tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:52.933397 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-480fa4b7-e167-4a7d-9ded-ecd10dbbf08f tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:52.934042 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-480fa4b7-e167-4a7d-9ded-ecd10dbbf08f tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:52.934710 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-480fa4b7-e167-4a7d-9ded-ecd10dbbf08f tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:52.936101 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-480fa4b7-e167-4a7d-9ded-ecd10dbbf08f tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:53.179695 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-480fa4b7-e167-4a7d-9ded-ecd10dbbf08f tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:53.190045 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-480fa4b7-e167-4a7d-9ded-ecd10dbbf08f tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0" status: 200 len: 1504 microversion: 2.1 time: 0.283861 Oct 18 15:50:53.191513 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2697/5413] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:52 2022] GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0 => generated 1504 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:53.466434 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e476dd12-54e6-4729-a2d7-456cbf278d89 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:53.467942 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e476dd12-54e6-4729-a2d7-456cbf278d89 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:53.493511 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e476dd12-54e6-4729-a2d7-456cbf278d89 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:53.494033 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e476dd12-54e6-4729-a2d7-456cbf278d89 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:53.494485 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e476dd12-54e6-4729-a2d7-456cbf278d89 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:53.495222 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e476dd12-54e6-4729-a2d7-456cbf278d89 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:53.495680 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e476dd12-54e6-4729-a2d7-456cbf278d89 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:53.498998 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e476dd12-54e6-4729-a2d7-456cbf278d89 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:53.590905 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fc389d27-67d7-4081-9f10-53c479f251fe tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:53.591697 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fc389d27-67d7-4081-9f10-53c479f251fe tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 4ccaffe8-f3ed-47df-a9ee-5437c24b469c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:53.610638 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc389d27-67d7-4081-9f10-53c479f251fe tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:53.613883 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc389d27-67d7-4081-9f10-53c479f251fe tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:53.618760 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc389d27-67d7-4081-9f10-53c479f251fe tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:53.624512 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc389d27-67d7-4081-9f10-53c479f251fe tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:53.625291 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc389d27-67d7-4081-9f10-53c479f251fe tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:53.627025 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc389d27-67d7-4081-9f10-53c479f251fe tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:53.863917 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e476dd12-54e6-4729-a2d7-456cbf278d89 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:53.877843 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e476dd12-54e6-4729-a2d7-456cbf278d89 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:53.879742 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e476dd12-54e6-4729-a2d7-456cbf278d89 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:53.884889 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e476dd12-54e6-4729-a2d7-456cbf278d89 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1805 microversion: 2.20 time: 0.423810 Oct 18 15:50:53.886498 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2717/5414] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:50:53 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1805 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:50:54.022906 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fc389d27-67d7-4081-9f10-53c479f251fe tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:54.051284 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fc389d27-67d7-4081-9f10-53c479f251fe tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/4ccaffe8-f3ed-47df-a9ee-5437c24b469c" status: 200 len: 1496 microversion: 2.1 time: 0.458090 Oct 18 15:50:54.054292 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2698/5415] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:53 2022] GET /compute/v2.1/servers/4ccaffe8-f3ed-47df-a9ee-5437c24b469c => generated 1496 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:54.218622 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bcd6fa0e-f60d-4d54-8290-c8723a9aa27d tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:54.219950 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-bcd6fa0e-f60d-4d54-8290-c8723a9aa27d tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: ebefddda-1a5f-485c-a89b-697fe8119af0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:54.230602 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bcd6fa0e-f60d-4d54-8290-c8723a9aa27d tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:54.231467 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bcd6fa0e-f60d-4d54-8290-c8723a9aa27d tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:54.232163 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bcd6fa0e-f60d-4d54-8290-c8723a9aa27d tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:54.234126 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bcd6fa0e-f60d-4d54-8290-c8723a9aa27d tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:54.234854 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bcd6fa0e-f60d-4d54-8290-c8723a9aa27d tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:54.238492 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bcd6fa0e-f60d-4d54-8290-c8723a9aa27d tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:54.785147 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-bcd6fa0e-f60d-4d54-8290-c8723a9aa27d tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:54.845943 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-bcd6fa0e-f60d-4d54-8290-c8723a9aa27d tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0" status: 200 len: 1504 microversion: 2.1 time: 0.608989 Oct 18 15:50:54.853356 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-8f141212-ca65-4cb9-80ab-a45070990215 req-9727bdef-5340-453a-b728-62acd41b70d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ccaffe8-f3ed-47df-a9ee-5437c24b469c", "name": "network-vif-deleted", "tag": "c1c3e92b-76a2-45fc-a4f5-0e22972d1e6b"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:50:54.853988 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2718/5416] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:54 2022] GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0 => generated 1504 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:54.898724 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8f141212-ca65-4cb9-80ab-a45070990215 req-9727bdef-5340-453a-b728-62acd41b70d8 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:54.899174 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8f141212-ca65-4cb9-80ab-a45070990215 req-9727bdef-5340-453a-b728-62acd41b70d8 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:54.908025 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8f141212-ca65-4cb9-80ab-a45070990215 req-9727bdef-5340-453a-b728-62acd41b70d8 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:54.912311 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8142c971-1afe-405f-ac9c-ea0f186f0fed tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:54.913067 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8142c971-1afe-405f-ac9c-ea0f186f0fed tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:54.923830 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8142c971-1afe-405f-ac9c-ea0f186f0fed tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:54.925564 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8142c971-1afe-405f-ac9c-ea0f186f0fed tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:54.928058 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8142c971-1afe-405f-ac9c-ea0f186f0fed tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:54.929841 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8142c971-1afe-405f-ac9c-ea0f186f0fed tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:54.930930 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8142c971-1afe-405f-ac9c-ea0f186f0fed tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:54.931859 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8142c971-1afe-405f-ac9c-ea0f186f0fed tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:54.966827 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-8f141212-ca65-4cb9-80ab-a45070990215 req-9727bdef-5340-453a-b728-62acd41b70d8 service nova] Creating event network-vif-deleted:c1c3e92b-76a2-45fc-a4f5-0e22972d1e6b for instance 4ccaffe8-f3ed-47df-a9ee-5437c24b469c on n-h1-853682-5 Oct 18 15:50:54.987916 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-8f141212-ca65-4cb9-80ab-a45070990215 req-9727bdef-5340-453a-b728-62acd41b70d8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.639828 Oct 18 15:50:54.988880 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2699/5417] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:50:55.081448 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4a676578-4ed9-4838-b05d-105a385894df tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:55.082422 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4a676578-4ed9-4838-b05d-105a385894df tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 4ccaffe8-f3ed-47df-a9ee-5437c24b469c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:55.103793 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a676578-4ed9-4838-b05d-105a385894df tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:55.104518 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a676578-4ed9-4838-b05d-105a385894df tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:55.105164 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a676578-4ed9-4838-b05d-105a385894df tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:55.106273 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a676578-4ed9-4838-b05d-105a385894df tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:55.106962 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a676578-4ed9-4838-b05d-105a385894df tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:55.107610 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a676578-4ed9-4838-b05d-105a385894df tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:55.193380 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a676578-4ed9-4838-b05d-105a385894df tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:55.194875 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a676578-4ed9-4838-b05d-105a385894df tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:55.195677 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a676578-4ed9-4838-b05d-105a385894df tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:55.197199 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-4a676578-4ed9-4838-b05d-105a385894df tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lazy-loading 'fault' on Instance uuid 4ccaffe8-f3ed-47df-a9ee-5437c24b469c {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:50:55.839355 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4a676578-4ed9-4838-b05d-105a385894df tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:55.850727 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4a676578-4ed9-4838-b05d-105a385894df tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/4ccaffe8-f3ed-47df-a9ee-5437c24b469c" status: 200 len: 1299 microversion: 2.1 time: 0.774865 Oct 18 15:50:55.853317 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2700/5418] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:55 2022] GET /compute/v2.1/servers/4ccaffe8-f3ed-47df-a9ee-5437c24b469c => generated 1299 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:55.883717 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e6452571-dcee-4b87-9013-04f2d1f9a6c4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:55.884506 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e6452571-dcee-4b87-9013-04f2d1f9a6c4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: ebefddda-1a5f-485c-a89b-697fe8119af0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:55.896380 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6452571-dcee-4b87-9013-04f2d1f9a6c4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:55.899348 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6452571-dcee-4b87-9013-04f2d1f9a6c4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:55.899861 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6452571-dcee-4b87-9013-04f2d1f9a6c4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:55.900687 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6452571-dcee-4b87-9013-04f2d1f9a6c4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:55.905275 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6452571-dcee-4b87-9013-04f2d1f9a6c4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:55.905897 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6452571-dcee-4b87-9013-04f2d1f9a6c4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:56.098176 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8142c971-1afe-405f-ac9c-ea0f186f0fed tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:56.107665 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=100 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:50:56.128154 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8142c971-1afe-405f-ac9c-ea0f186f0fed tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:56.140241 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8142c971-1afe-405f-ac9c-ea0f186f0fed tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:56.154338 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8142c971-1afe-405f-ac9c-ea0f186f0fed tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1805 microversion: 2.20 time: 1.238358 Oct 18 15:50:56.156424 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2719/5419] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:50:54 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1805 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:50:56.290873 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e6452571-dcee-4b87-9013-04f2d1f9a6c4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:56.303103 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e6452571-dcee-4b87-9013-04f2d1f9a6c4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0" status: 200 len: 1504 microversion: 2.1 time: 0.424947 Oct 18 15:50:56.313462 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2701/5420] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:55 2022] GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0 => generated 1504 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:56.881133 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-67f72ff6-8bb7-49d0-9186-915e2daa17d7 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:56.881885 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-67f72ff6-8bb7-49d0-9186-915e2daa17d7 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 4ccaffe8-f3ed-47df-a9ee-5437c24b469c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:56.896259 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:50:56.897813 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-67f72ff6-8bb7-49d0-9186-915e2daa17d7 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:56.898313 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-67f72ff6-8bb7-49d0-9186-915e2daa17d7 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:56.898757 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-67f72ff6-8bb7-49d0-9186-915e2daa17d7 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:56.899480 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-67f72ff6-8bb7-49d0-9186-915e2daa17d7 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:56.899943 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-67f72ff6-8bb7-49d0-9186-915e2daa17d7 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:56.900382 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-67f72ff6-8bb7-49d0-9186-915e2daa17d7 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:56.923955 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-67f72ff6-8bb7-49d0-9186-915e2daa17d7 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] HTTP exception thrown: Instance 4ccaffe8-f3ed-47df-a9ee-5437c24b469c could not be found. Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-67f72ff6-8bb7-49d0-9186-915e2daa17d7 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Request method failure captured: Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/4ccaffe8-f3ed-47df-a9ee-5437c24b469c HTTP/1.1 Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsrEJhXnu9-kA1ME2ZgtL01L1ZZn_p1cwLPkqNlVzGclz5bmzyyOf2BB4P7wVe6-U6KsqFzM-iyEynyHjx99j1zL9TNO9M1_0gjdhVd46w55yQ-UymJhYbErDED9EKpU_GJnghtBqaCd9UvgTeTf4e4PvQGeOp69vMSi60uoNlhyAmg Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: afdb1e8b478f463987ec223f2d10db33 Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServersTestJSON-126042862 Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServersTestJSON-126042862 Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: afdb1e8b478f463987ec223f2d10db33 Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServersTestJSON-126042862 Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServersTestJSON-126042862-project Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 73f4ee2e7ff34dd88b9b82fefbf06a36 Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServersTestJSON-126042862-project Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 4ccaffe8-f3ed-47df-a9ee-5437c24b469c could not be found. Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '4ccaffe8-f3ed-47df-a9ee-5437c24b469c'} Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ccaffe8-f3ed-47df-a9ee-5437c24b469c could not be found. Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ccaffe8-f3ed-47df-a9ee-5437c24b469c could not be found. Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:50:56.926064 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:50:56.932494 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:50:56.932494 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:50:56.932494 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:50:56.932494 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:50:56.932494 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ccaffe8-f3ed-47df-a9ee-5437c24b469c could not be found. Oct 18 15:50:56.932494 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:50:56.934549 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-67f72ff6-8bb7-49d0-9186-915e2daa17d7 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Returning 404 to user: Instance 4ccaffe8-f3ed-47df-a9ee-5437c24b469c could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:50:56.935650 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-67f72ff6-8bb7-49d0-9186-915e2daa17d7 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/4ccaffe8-f3ed-47df-a9ee-5437c24b469c" status: 404 len: 111 microversion: 2.1 time: 0.059455 Oct 18 15:50:56.936759 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2720/5421] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:56 2022] GET /compute/v2.1/servers/4ccaffe8-f3ed-47df-a9ee-5437c24b469c => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:50:56.953119 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0a748602-dd6c-4dda-89db-18bfd60488a3 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:56.955203 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0a748602-dd6c-4dda-89db-18bfd60488a3 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: d3069d75-261b-4abe-a68b-fc25cac7e549] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:56.964878 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a748602-dd6c-4dda-89db-18bfd60488a3 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:56.966048 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a748602-dd6c-4dda-89db-18bfd60488a3 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:56.966730 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a748602-dd6c-4dda-89db-18bfd60488a3 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:56.968231 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a748602-dd6c-4dda-89db-18bfd60488a3 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:56.969008 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a748602-dd6c-4dda-89db-18bfd60488a3 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:56.970683 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a748602-dd6c-4dda-89db-18bfd60488a3 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:57.013299 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0a748602-dd6c-4dda-89db-18bfd60488a3 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: d3069d75-261b-4abe-a68b-fc25cac7e549] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:50:57.163548 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0a748602-dd6c-4dda-89db-18bfd60488a3 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d3069d75-261b-4abe-a68b-fc25cac7e549" status: 204 len: 0 microversion: 2.1 time: 0.221512 Oct 18 15:50:57.164156 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2702/5422] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:50:56 2022] DELETE /compute/v2.1/servers/d3069d75-261b-4abe-a68b-fc25cac7e549 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 15:50:57.176001 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-38f7ee0c-a6b3-43ed-8a3a-b5a5c4ac632f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:57.177704 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-38f7ee0c-a6b3-43ed-8a3a-b5a5c4ac632f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: d3069d75-261b-4abe-a68b-fc25cac7e549] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:57.186713 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c30abea1-7587-42d0-94cc-8654ac289e0f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:57.187441 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c30abea1-7587-42d0-94cc-8654ac289e0f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:57.197162 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c30abea1-7587-42d0-94cc-8654ac289e0f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:57.199365 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-38f7ee0c-a6b3-43ed-8a3a-b5a5c4ac632f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:57.200781 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-38f7ee0c-a6b3-43ed-8a3a-b5a5c4ac632f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:57.201413 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-38f7ee0c-a6b3-43ed-8a3a-b5a5c4ac632f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:57.204780 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-38f7ee0c-a6b3-43ed-8a3a-b5a5c4ac632f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:57.205958 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-38f7ee0c-a6b3-43ed-8a3a-b5a5c4ac632f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:57.207020 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c30abea1-7587-42d0-94cc-8654ac289e0f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:57.208119 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-38f7ee0c-a6b3-43ed-8a3a-b5a5c4ac632f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:57.208240 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c30abea1-7587-42d0-94cc-8654ac289e0f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:57.208240 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c30abea1-7587-42d0-94cc-8654ac289e0f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:57.208688 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c30abea1-7587-42d0-94cc-8654ac289e0f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:57.209195 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c30abea1-7587-42d0-94cc-8654ac289e0f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:57.216345 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:50:57.584183 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-38f7ee0c-a6b3-43ed-8a3a-b5a5c4ac632f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:57.593195 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-38f7ee0c-a6b3-43ed-8a3a-b5a5c4ac632f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/d3069d75-261b-4abe-a68b-fc25cac7e549" status: 200 len: 1495 microversion: 2.1 time: 0.423887 Oct 18 15:50:57.594200 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2721/5423] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:57 2022] GET /compute/v2.1/servers/d3069d75-261b-4abe-a68b-fc25cac7e549 => generated 1495 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:57.599988 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-588e66e4-40c4-4bc5-b381-708debaa26c8 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:57.600695 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-588e66e4-40c4-4bc5-b381-708debaa26c8 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: ebefddda-1a5f-485c-a89b-697fe8119af0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:57.606700 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-588e66e4-40c4-4bc5-b381-708debaa26c8 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:57.607296 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-588e66e4-40c4-4bc5-b381-708debaa26c8 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:57.607829 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-588e66e4-40c4-4bc5-b381-708debaa26c8 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:57.608647 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-588e66e4-40c4-4bc5-b381-708debaa26c8 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:57.609217 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-588e66e4-40c4-4bc5-b381-708debaa26c8 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:57.609995 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-588e66e4-40c4-4bc5-b381-708debaa26c8 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:57.630145 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c30abea1-7587-42d0-94cc-8654ac289e0f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:57.645521 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c30abea1-7587-42d0-94cc-8654ac289e0f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:57.650309 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c30abea1-7587-42d0-94cc-8654ac289e0f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:57.652125 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c30abea1-7587-42d0-94cc-8654ac289e0f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1792 microversion: 2.20 time: 0.470984 Oct 18 15:50:57.652999 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2703/5424] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:50:57 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1792 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:50:57.859567 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-588e66e4-40c4-4bc5-b381-708debaa26c8 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:57.871372 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-588e66e4-40c4-4bc5-b381-708debaa26c8 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0" status: 200 len: 1504 microversion: 2.1 time: 0.275822 Oct 18 15:50:57.872253 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2722/5425] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:57 2022] GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0 => generated 1504 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:58.625110 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d4b2d932-1355-4ce2-90d4-01a4a93498a6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:58.645153 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d4b2d932-1355-4ce2-90d4-01a4a93498a6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: d3069d75-261b-4abe-a68b-fc25cac7e549] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:58.661645 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d4b2d932-1355-4ce2-90d4-01a4a93498a6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:58.662963 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d4b2d932-1355-4ce2-90d4-01a4a93498a6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:58.663505 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d4b2d932-1355-4ce2-90d4-01a4a93498a6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:58.664429 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d4b2d932-1355-4ce2-90d4-01a4a93498a6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:58.685138 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d4b2d932-1355-4ce2-90d4-01a4a93498a6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:58.685773 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d4b2d932-1355-4ce2-90d4-01a4a93498a6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:58.899547 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a2695458-a52d-43b7-8d34-dc6d45d2e23e tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:50:58.900172 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a2695458-a52d-43b7-8d34-dc6d45d2e23e tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: ebefddda-1a5f-485c-a89b-697fe8119af0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:50:58.918042 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a2695458-a52d-43b7-8d34-dc6d45d2e23e tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:58.918549 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a2695458-a52d-43b7-8d34-dc6d45d2e23e tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:58.918997 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a2695458-a52d-43b7-8d34-dc6d45d2e23e tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:58.919728 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a2695458-a52d-43b7-8d34-dc6d45d2e23e tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:50:58.920184 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a2695458-a52d-43b7-8d34-dc6d45d2e23e tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:50:58.928254 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a2695458-a52d-43b7-8d34-dc6d45d2e23e tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:50:59.269817 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d4b2d932-1355-4ce2-90d4-01a4a93498a6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:59.278858 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d4b2d932-1355-4ce2-90d4-01a4a93498a6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/d3069d75-261b-4abe-a68b-fc25cac7e549" status: 200 len: 1495 microversion: 2.1 time: 0.663260 Oct 18 15:50:59.284867 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2704/5426] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:58 2022] GET /compute/v2.1/servers/d3069d75-261b-4abe-a68b-fc25cac7e549 => generated 1495 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:50:59.504407 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a2695458-a52d-43b7-8d34-dc6d45d2e23e tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:50:59.538925 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a2695458-a52d-43b7-8d34-dc6d45d2e23e tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0" status: 200 len: 1504 microversion: 2.1 time: 0.645283 Oct 18 15:50:59.544629 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2723/5427] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:50:58 2022] GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0 => generated 1504 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:00.039313 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-6a008e98-ec47-430c-bade-e769dc96fd15 req-874f916e-fd79-4f60-9bf7-466b3fa41d38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3069d75-261b-4abe-a68b-fc25cac7e549", "name": "network-vif-deleted", "tag": "0063c4b1-1439-4928-82c4-33af9c9bdb56"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:51:00.060094 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6a008e98-ec47-430c-bade-e769dc96fd15 req-874f916e-fd79-4f60-9bf7-466b3fa41d38 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:00.060977 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6a008e98-ec47-430c-bade-e769dc96fd15 req-874f916e-fd79-4f60-9bf7-466b3fa41d38 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:00.061588 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6a008e98-ec47-430c-bade-e769dc96fd15 req-874f916e-fd79-4f60-9bf7-466b3fa41d38 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:00.085398 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-6a008e98-ec47-430c-bade-e769dc96fd15 req-874f916e-fd79-4f60-9bf7-466b3fa41d38 service nova] Creating event network-vif-deleted:0063c4b1-1439-4928-82c4-33af9c9bdb56 for instance d3069d75-261b-4abe-a68b-fc25cac7e549 on n-h2-853682-5 Oct 18 15:51:00.091807 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-6a008e98-ec47-430c-bade-e769dc96fd15 req-874f916e-fd79-4f60-9bf7-466b3fa41d38 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059065 Oct 18 15:51:00.093656 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2705/5428] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:51:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:51:00.309512 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-df13993b-cd6f-465f-944c-f2f6e7d8fd9e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:00.310121 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-df13993b-cd6f-465f-944c-f2f6e7d8fd9e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: d3069d75-261b-4abe-a68b-fc25cac7e549] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:00.330655 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-df13993b-cd6f-465f-944c-f2f6e7d8fd9e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:00.331665 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-df13993b-cd6f-465f-944c-f2f6e7d8fd9e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:00.334720 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-df13993b-cd6f-465f-944c-f2f6e7d8fd9e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:00.335859 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-df13993b-cd6f-465f-944c-f2f6e7d8fd9e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:00.338061 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-df13993b-cd6f-465f-944c-f2f6e7d8fd9e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:00.339438 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-df13993b-cd6f-465f-944c-f2f6e7d8fd9e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:00.439464 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-df13993b-cd6f-465f-944c-f2f6e7d8fd9e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:00.439825 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-df13993b-cd6f-465f-944c-f2f6e7d8fd9e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:00.440269 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-df13993b-cd6f-465f-944c-f2f6e7d8fd9e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:00.440732 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-df13993b-cd6f-465f-944c-f2f6e7d8fd9e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lazy-loading 'fault' on Instance uuid d3069d75-261b-4abe-a68b-fc25cac7e549 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:51:00.566790 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5c387892-144c-4e6d-b338-a5fcff7500e2 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:00.567830 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5c387892-144c-4e6d-b338-a5fcff7500e2 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: ebefddda-1a5f-485c-a89b-697fe8119af0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:00.586198 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-df13993b-cd6f-465f-944c-f2f6e7d8fd9e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:00.604629 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-df13993b-cd6f-465f-944c-f2f6e7d8fd9e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/d3069d75-261b-4abe-a68b-fc25cac7e549" status: 200 len: 1299 microversion: 2.1 time: 0.299066 Oct 18 15:51:00.605885 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c387892-144c-4e6d-b338-a5fcff7500e2 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:00.608191 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c387892-144c-4e6d-b338-a5fcff7500e2 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:00.608674 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c387892-144c-4e6d-b338-a5fcff7500e2 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:00.613528 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2724/5429] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:00 2022] GET /compute/v2.1/servers/d3069d75-261b-4abe-a68b-fc25cac7e549 => generated 1299 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:00.614685 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c387892-144c-4e6d-b338-a5fcff7500e2 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:00.615544 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c387892-144c-4e6d-b338-a5fcff7500e2 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:00.617172 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c387892-144c-4e6d-b338-a5fcff7500e2 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:01.069668 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5c387892-144c-4e6d-b338-a5fcff7500e2 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:01.090869 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5c387892-144c-4e6d-b338-a5fcff7500e2 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0" status: 200 len: 1504 microversion: 2.1 time: 0.532422 Oct 18 15:51:01.092291 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2706/5430] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:00 2022] GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0 => generated 1504 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:51:01.641999 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-995cd0b7-dc77-420b-8daa-93a63c358f6f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:01.642510 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-995cd0b7-dc77-420b-8daa-93a63c358f6f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: d3069d75-261b-4abe-a68b-fc25cac7e549] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:01.657597 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-995cd0b7-dc77-420b-8daa-93a63c358f6f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:01.658259 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-995cd0b7-dc77-420b-8daa-93a63c358f6f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:01.658885 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-995cd0b7-dc77-420b-8daa-93a63c358f6f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:01.659779 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-995cd0b7-dc77-420b-8daa-93a63c358f6f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:01.660546 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-995cd0b7-dc77-420b-8daa-93a63c358f6f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:01.661394 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-995cd0b7-dc77-420b-8daa-93a63c358f6f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:01.702574 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-995cd0b7-dc77-420b-8daa-93a63c358f6f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] HTTP exception thrown: Instance d3069d75-261b-4abe-a68b-fc25cac7e549 could not be found. Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-995cd0b7-dc77-420b-8daa-93a63c358f6f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Request method failure captured: Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/d3069d75-261b-4abe-a68b-fc25cac7e549 HTTP/1.1 Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsrEJhXnu9-kA1ME2ZgtL01L1ZZn_p1cwLPkqNlVzGclz5bmzyyOf2BB4P7wVe6-U6KsqFzM-iyEynyHjx99j1zL9TNO9M1_0gjdhVd46w55yQ-UymJhYbErDED9EKpU_GJnghtBqaCd9UvgTeTf4e4PvQGeOp69vMSi60uoNlhyAmg Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: afdb1e8b478f463987ec223f2d10db33 Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServersTestJSON-126042862 Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServersTestJSON-126042862 Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: afdb1e8b478f463987ec223f2d10db33 Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServersTestJSON-126042862 Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServersTestJSON-126042862-project Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 73f4ee2e7ff34dd88b9b82fefbf06a36 Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServersTestJSON-126042862-project Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance d3069d75-261b-4abe-a68b-fc25cac7e549 could not be found. Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'd3069d75-261b-4abe-a68b-fc25cac7e549'} Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3069d75-261b-4abe-a68b-fc25cac7e549 could not be found. Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3069d75-261b-4abe-a68b-fc25cac7e549 could not be found. Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:51:01.705074 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:51:01.713670 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:51:01.713670 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:51:01.713670 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:51:01.713670 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:51:01.713670 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3069d75-261b-4abe-a68b-fc25cac7e549 could not be found. Oct 18 15:51:01.713670 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:51:01.713670 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-995cd0b7-dc77-420b-8daa-93a63c358f6f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Returning 404 to user: Instance d3069d75-261b-4abe-a68b-fc25cac7e549 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:51:01.713670 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-995cd0b7-dc77-420b-8daa-93a63c358f6f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/d3069d75-261b-4abe-a68b-fc25cac7e549" status: 404 len: 111 microversion: 2.1 time: 0.070919 Oct 18 15:51:01.713670 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2725/5431] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:01 2022] GET /compute/v2.1/servers/d3069d75-261b-4abe-a68b-fc25cac7e549 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:51:01.863993 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5556e317-2514-48a3-b089-ff78fa268f2a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-204292004", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "5126a012-82e3-4304-a7ec-ac28e05a407b"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:51:01.958523 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-5556e317-2514-48a3-b089-ff78fa268f2a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] validate_networks() for [('5126a012-82e3-4304-a7ec-ac28e05a407b', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:51:02.117835 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1a551fb2-60d8-45c0-a125-849fd86c04c8 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:02.123683 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1a551fb2-60d8-45c0-a125-849fd86c04c8 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: ebefddda-1a5f-485c-a89b-697fe8119af0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:02.136331 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1a551fb2-60d8-45c0-a125-849fd86c04c8 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:02.137844 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1a551fb2-60d8-45c0-a125-849fd86c04c8 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:02.138488 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1a551fb2-60d8-45c0-a125-849fd86c04c8 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:02.139811 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1a551fb2-60d8-45c0-a125-849fd86c04c8 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:02.142007 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1a551fb2-60d8-45c0-a125-849fd86c04c8 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:02.142773 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1a551fb2-60d8-45c0-a125-849fd86c04c8 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:03.419068 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1a551fb2-60d8-45c0-a125-849fd86c04c8 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:03.430299 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1a551fb2-60d8-45c0-a125-849fd86c04c8 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0" status: 200 len: 1504 microversion: 2.1 time: 1.318283 Oct 18 15:51:03.441779 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2726/5432] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:02 2022] GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0 => generated 1504 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:51:04.263102 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-5556e317-2514-48a3-b089-ff78fa268f2a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:51:04.263627 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-5556e317-2514-48a3-b089-ff78fa268f2a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:51:04.264346 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-5556e317-2514-48a3-b089-ff78fa268f2a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:51:04.264768 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-5556e317-2514-48a3-b089-ff78fa268f2a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:51:04.265216 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-5556e317-2514-48a3-b089-ff78fa268f2a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:51:04.281055 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5556e317-2514-48a3-b089-ff78fa268f2a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:04.281594 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5556e317-2514-48a3-b089-ff78fa268f2a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:04.282035 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5556e317-2514-48a3-b089-ff78fa268f2a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:04.282889 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5556e317-2514-48a3-b089-ff78fa268f2a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:04.283348 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5556e317-2514-48a3-b089-ff78fa268f2a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:04.284942 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5556e317-2514-48a3-b089-ff78fa268f2a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:04.320313 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-5556e317-2514-48a3-b089-ff78fa268f2a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Getting quotas for project afdb1e8b478f463987ec223f2d10db33. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:51:04.327122 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-5556e317-2514-48a3-b089-ff78fa268f2a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Getting quotas for user 73f4ee2e7ff34dd88b9b82fefbf06a36 and project afdb1e8b478f463987ec223f2d10db33. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:51:04.358108 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5556e317-2514-48a3-b089-ff78fa268f2a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:51:04.362232 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5556e317-2514-48a3-b089-ff78fa268f2a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 6275fe37-a499-43c2-ac51-d776052c7f43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:51:04.433900 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5556e317-2514-48a3-b089-ff78fa268f2a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.574447 Oct 18 15:51:04.435826 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2707/5433] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:51:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:51:04.447234 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b7a8a7cb-64bc-45c2-886a-613b8c53f746 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:04.448378 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b7a8a7cb-64bc-45c2-886a-613b8c53f746 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 6275fe37-a499-43c2-ac51-d776052c7f43] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:04.467548 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c8be2f27-f94d-42e8-b34d-268e2bb4c4a4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:04.469852 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c8be2f27-f94d-42e8-b34d-268e2bb4c4a4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: ebefddda-1a5f-485c-a89b-697fe8119af0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:04.497716 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8be2f27-f94d-42e8-b34d-268e2bb4c4a4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:04.501279 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8be2f27-f94d-42e8-b34d-268e2bb4c4a4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:04.501934 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8be2f27-f94d-42e8-b34d-268e2bb4c4a4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:04.506507 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8be2f27-f94d-42e8-b34d-268e2bb4c4a4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:04.507190 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8be2f27-f94d-42e8-b34d-268e2bb4c4a4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:04.507912 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8be2f27-f94d-42e8-b34d-268e2bb4c4a4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:04.823218 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b7a8a7cb-64bc-45c2-886a-613b8c53f746 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:04.835239 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b7a8a7cb-64bc-45c2-886a-613b8c53f746 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/6275fe37-a499-43c2-ac51-d776052c7f43" status: 200 len: 1208 microversion: 2.1 time: 0.392048 Oct 18 15:51:04.835855 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2727/5434] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:04 2022] GET /compute/v2.1/servers/6275fe37-a499-43c2-ac51-d776052c7f43 => generated 1208 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:05.168768 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c8be2f27-f94d-42e8-b34d-268e2bb4c4a4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:05.179776 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c8be2f27-f94d-42e8-b34d-268e2bb4c4a4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0" status: 200 len: 1504 microversion: 2.1 time: 0.716067 Oct 18 15:51:05.188988 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2708/5435] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:04 2022] GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0 => generated 1504 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:05.860847 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-48cd7498-6c9d-4699-9236-1664d6e501d0 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:05.861539 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-48cd7498-6c9d-4699-9236-1664d6e501d0 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 6275fe37-a499-43c2-ac51-d776052c7f43] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:05.879093 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-48cd7498-6c9d-4699-9236-1664d6e501d0 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:05.882461 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-48cd7498-6c9d-4699-9236-1664d6e501d0 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:05.883262 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-48cd7498-6c9d-4699-9236-1664d6e501d0 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:05.885070 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-48cd7498-6c9d-4699-9236-1664d6e501d0 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:05.886426 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-48cd7498-6c9d-4699-9236-1664d6e501d0 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:05.886426 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-48cd7498-6c9d-4699-9236-1664d6e501d0 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:06.066877 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-48cd7498-6c9d-4699-9236-1664d6e501d0 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:06.083058 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-48cd7498-6c9d-4699-9236-1664d6e501d0 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/6275fe37-a499-43c2-ac51-d776052c7f43" status: 200 len: 1204 microversion: 2.1 time: 0.227354 Oct 18 15:51:06.083644 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2728/5436] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:05 2022] GET /compute/v2.1/servers/6275fe37-a499-43c2-ac51-d776052c7f43 => generated 1204 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:06.208301 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9883ac97-cd43-4fa3-96a9-27b917f7b5db tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:06.209916 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9883ac97-cd43-4fa3-96a9-27b917f7b5db tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: ebefddda-1a5f-485c-a89b-697fe8119af0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:06.226396 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9883ac97-cd43-4fa3-96a9-27b917f7b5db tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:06.228056 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9883ac97-cd43-4fa3-96a9-27b917f7b5db tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:06.229137 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9883ac97-cd43-4fa3-96a9-27b917f7b5db tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:06.230106 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9883ac97-cd43-4fa3-96a9-27b917f7b5db tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:06.233208 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9883ac97-cd43-4fa3-96a9-27b917f7b5db tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:06.233703 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9883ac97-cd43-4fa3-96a9-27b917f7b5db tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:06.703069 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9883ac97-cd43-4fa3-96a9-27b917f7b5db tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:06.727931 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9883ac97-cd43-4fa3-96a9-27b917f7b5db tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0" status: 200 len: 1504 microversion: 2.1 time: 0.524966 Oct 18 15:51:06.731131 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2709/5437] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:06 2022] GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0 => generated 1504 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:07.108158 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1000911f-faf3-4036-9ec7-c09d0fcd90e5 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:07.108706 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1000911f-faf3-4036-9ec7-c09d0fcd90e5 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 6275fe37-a499-43c2-ac51-d776052c7f43] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:07.125442 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1000911f-faf3-4036-9ec7-c09d0fcd90e5 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:07.126201 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1000911f-faf3-4036-9ec7-c09d0fcd90e5 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:07.127058 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1000911f-faf3-4036-9ec7-c09d0fcd90e5 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:07.127952 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1000911f-faf3-4036-9ec7-c09d0fcd90e5 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:07.128608 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1000911f-faf3-4036-9ec7-c09d0fcd90e5 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:07.129236 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1000911f-faf3-4036-9ec7-c09d0fcd90e5 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:07.277431 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1000911f-faf3-4036-9ec7-c09d0fcd90e5 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:07.295213 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1000911f-faf3-4036-9ec7-c09d0fcd90e5 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/6275fe37-a499-43c2-ac51-d776052c7f43" status: 200 len: 1266 microversion: 2.1 time: 0.184279 Oct 18 15:51:07.296424 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2729/5438] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:07 2022] GET /compute/v2.1/servers/6275fe37-a499-43c2-ac51-d776052c7f43 => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:07.755552 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-088a3932-f6a2-4ce1-8ec9-117e33850ccd tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:07.757382 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-088a3932-f6a2-4ce1-8ec9-117e33850ccd tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: ebefddda-1a5f-485c-a89b-697fe8119af0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:07.769227 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-088a3932-f6a2-4ce1-8ec9-117e33850ccd tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:07.770396 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-088a3932-f6a2-4ce1-8ec9-117e33850ccd tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:07.771559 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-088a3932-f6a2-4ce1-8ec9-117e33850ccd tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:07.773061 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-088a3932-f6a2-4ce1-8ec9-117e33850ccd tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:07.774624 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-088a3932-f6a2-4ce1-8ec9-117e33850ccd tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:07.779467 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-088a3932-f6a2-4ce1-8ec9-117e33850ccd tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:08.169254 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-088a3932-f6a2-4ce1-8ec9-117e33850ccd tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:08.197073 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-088a3932-f6a2-4ce1-8ec9-117e33850ccd tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0" status: 200 len: 1484 microversion: 2.1 time: 0.445278 Oct 18 15:51:08.197373 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2710/5439] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:07 2022] GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0 => generated 1484 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:08.323261 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-96c0b6a9-9165-404a-9803-05f152e0bcf8 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:08.324346 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-96c0b6a9-9165-404a-9803-05f152e0bcf8 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 6275fe37-a499-43c2-ac51-d776052c7f43] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:08.343353 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-96c0b6a9-9165-404a-9803-05f152e0bcf8 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:08.343539 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-96c0b6a9-9165-404a-9803-05f152e0bcf8 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:08.349640 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-96c0b6a9-9165-404a-9803-05f152e0bcf8 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:08.350664 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-96c0b6a9-9165-404a-9803-05f152e0bcf8 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:08.351339 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-96c0b6a9-9165-404a-9803-05f152e0bcf8 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:08.351989 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-96c0b6a9-9165-404a-9803-05f152e0bcf8 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:08.481036 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-16b256b7-3184-42a9-82c5-076875e57da7 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-437725748", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:51:08.585354 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-96c0b6a9-9165-404a-9803-05f152e0bcf8 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:08.593269 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-96c0b6a9-9165-404a-9803-05f152e0bcf8 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/6275fe37-a499-43c2-ac51-d776052c7f43" status: 200 len: 1266 microversion: 2.1 time: 0.274253 Oct 18 15:51:08.602108 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2730/5440] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:08 2022] GET /compute/v2.1/servers/6275fe37-a499-43c2-ac51-d776052c7f43 => generated 1266 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:08.622823 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-16b256b7-3184-42a9-82c5-076875e57da7 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] validate_networks() for [('b861343f-1d52-458f-a797-60934e302b9c', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:51:09.617757 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e5ff1372-3c92-41d8-8006-1ca39b4ba8a9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:09.618379 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e5ff1372-3c92-41d8-8006-1ca39b4ba8a9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 6275fe37-a499-43c2-ac51-d776052c7f43] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:09.629101 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e5ff1372-3c92-41d8-8006-1ca39b4ba8a9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:09.634715 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e5ff1372-3c92-41d8-8006-1ca39b4ba8a9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:09.635331 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e5ff1372-3c92-41d8-8006-1ca39b4ba8a9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:09.636447 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e5ff1372-3c92-41d8-8006-1ca39b4ba8a9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:09.644786 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e5ff1372-3c92-41d8-8006-1ca39b4ba8a9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:09.645607 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e5ff1372-3c92-41d8-8006-1ca39b4ba8a9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:10.202050 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e5ff1372-3c92-41d8-8006-1ca39b4ba8a9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:10.215463 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e5ff1372-3c92-41d8-8006-1ca39b4ba8a9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/6275fe37-a499-43c2-ac51-d776052c7f43" status: 200 len: 1308 microversion: 2.1 time: 0.599363 Oct 18 15:51:10.233384 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2731/5441] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:09 2022] GET /compute/v2.1/servers/6275fe37-a499-43c2-ac51-d776052c7f43 => generated 1308 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:51:10.552942 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-16b256b7-3184-42a9-82c5-076875e57da7 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:51:10.553406 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-16b256b7-3184-42a9-82c5-076875e57da7 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:51:10.553846 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-16b256b7-3184-42a9-82c5-076875e57da7 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:51:10.554264 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-16b256b7-3184-42a9-82c5-076875e57da7 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:51:10.554685 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-16b256b7-3184-42a9-82c5-076875e57da7 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:51:10.570580 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16b256b7-3184-42a9-82c5-076875e57da7 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:10.571127 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16b256b7-3184-42a9-82c5-076875e57da7 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:10.571580 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16b256b7-3184-42a9-82c5-076875e57da7 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:10.572322 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16b256b7-3184-42a9-82c5-076875e57da7 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:10.572848 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16b256b7-3184-42a9-82c5-076875e57da7 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:10.573249 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16b256b7-3184-42a9-82c5-076875e57da7 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:10.617936 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-16b256b7-3184-42a9-82c5-076875e57da7 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Getting quotas for project 103b0fb8d9184bf09acde8f6f98eb018. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:51:10.632465 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-16b256b7-3184-42a9-82c5-076875e57da7 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Getting quotas for user b8fed4f99b0845f69f77530084b11042 and project 103b0fb8d9184bf09acde8f6f98eb018. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:51:10.660432 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-16b256b7-3184-42a9-82c5-076875e57da7 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:51:10.662721 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-16b256b7-3184-42a9-82c5-076875e57da7 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: 61d72ac7-5fdd-4c9b-a36a-306accdb31e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:51:10.783217 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-16b256b7-3184-42a9-82c5-076875e57da7 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.310504 Oct 18 15:51:10.784988 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2711/5442] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:51:08 2022] POST /compute/v2.1/servers => generated 383 bytes in 2313 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:51:10.798259 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-15dc7a35-04b5-40bf-8348-1bfc485fa6e6 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:10.800055 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-15dc7a35-04b5-40bf-8348-1bfc485fa6e6 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: 61d72ac7-5fdd-4c9b-a36a-306accdb31e9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:11.039674 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-15dc7a35-04b5-40bf-8348-1bfc485fa6e6 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:11.055033 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-15dc7a35-04b5-40bf-8348-1bfc485fa6e6 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9" status: 200 len: 1213 microversion: 2.1 time: 0.261935 Oct 18 15:51:11.086094 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2732/5443] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:10 2022] GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9 => generated 1213 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:11.243665 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-28301266-a648-4c53-9319-138c1591f346 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:11.244304 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-28301266-a648-4c53-9319-138c1591f346 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 6275fe37-a499-43c2-ac51-d776052c7f43] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:11.258537 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-28301266-a648-4c53-9319-138c1591f346 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:11.262603 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-28301266-a648-4c53-9319-138c1591f346 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:11.263221 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-28301266-a648-4c53-9319-138c1591f346 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:11.264104 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-28301266-a648-4c53-9319-138c1591f346 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:11.264714 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-28301266-a648-4c53-9319-138c1591f346 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:11.280759 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-28301266-a648-4c53-9319-138c1591f346 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:11.865520 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-28301266-a648-4c53-9319-138c1591f346 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:11.875343 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-28301266-a648-4c53-9319-138c1591f346 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/6275fe37-a499-43c2-ac51-d776052c7f43" status: 200 len: 1308 microversion: 2.1 time: 0.635108 Oct 18 15:51:11.897010 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2712/5444] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:11 2022] GET /compute/v2.1/servers/6275fe37-a499-43c2-ac51-d776052c7f43 => generated 1308 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:11.958950 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-81cd0146-cadc-474c-a469-f403b11a742a req-133aff2d-ec60-40c2-845b-0adbe85e09b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6275fe37-a499-43c2-ac51-d776052c7f43", "tag": "251e0ae3-0d50-452d-97f4-07fb53035930"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:51:12.047882 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-81cd0146-cadc-474c-a469-f403b11a742a req-133aff2d-ec60-40c2-845b-0adbe85e09b6 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:12.049068 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-81cd0146-cadc-474c-a469-f403b11a742a req-133aff2d-ec60-40c2-845b-0adbe85e09b6 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:12.051267 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-81cd0146-cadc-474c-a469-f403b11a742a req-133aff2d-ec60-40c2-845b-0adbe85e09b6 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:12.085264 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-81cd0146-cadc-474c-a469-f403b11a742a req-133aff2d-ec60-40c2-845b-0adbe85e09b6 service nova] Creating event network-changed:251e0ae3-0d50-452d-97f4-07fb53035930 for instance 6275fe37-a499-43c2-ac51-d776052c7f43 on n-h1-853682-5 Oct 18 15:51:12.085934 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4cbd6301-7024-4869-bd0d-baac1fb6af0d tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:12.086813 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4cbd6301-7024-4869-bd0d-baac1fb6af0d tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: 61d72ac7-5fdd-4c9b-a36a-306accdb31e9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:12.105377 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4cbd6301-7024-4869-bd0d-baac1fb6af0d tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:12.106434 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4cbd6301-7024-4869-bd0d-baac1fb6af0d tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:12.108197 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4cbd6301-7024-4869-bd0d-baac1fb6af0d tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:12.110621 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-81cd0146-cadc-474c-a469-f403b11a742a req-133aff2d-ec60-40c2-845b-0adbe85e09b6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158001 Oct 18 15:51:12.114112 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4cbd6301-7024-4869-bd0d-baac1fb6af0d tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:12.115830 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2733/5445] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:51:12.116973 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4cbd6301-7024-4869-bd0d-baac1fb6af0d tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:12.118124 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4cbd6301-7024-4869-bd0d-baac1fb6af0d tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:12.385525 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4cbd6301-7024-4869-bd0d-baac1fb6af0d tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:12.404363 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4cbd6301-7024-4869-bd0d-baac1fb6af0d tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9" status: 200 len: 1209 microversion: 2.1 time: 0.323516 Oct 18 15:51:12.421134 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2713/5446] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:12 2022] GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9 => generated 1209 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:12.706700 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-045f6a4a-b68f-4811-9411-f4859fce6479 tempest-ServerGroup264TestJSON-478870796 tempest-ServerGroup264TestJSON-478870796-project] Action: 'create', calling method: .version_select at 0x7f7c416f8820>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:51:12.736249 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-045f6a4a-b68f-4811-9411-f4859fce6479 tempest-ServerGroup264TestJSON-478870796 tempest-ServerGroup264TestJSON-478870796-project] Getting quotas for project a223ee9d4649467f9578a2b8dd00180a. Resources: {'server_groups'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:51:12.750946 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-045f6a4a-b68f-4811-9411-f4859fce6479 tempest-ServerGroup264TestJSON-478870796 tempest-ServerGroup264TestJSON-478870796-project] Getting quotas for user ac02df3882f14cdabe74cc03abac7675 and project a223ee9d4649467f9578a2b8dd00180a. Resources: {'server_groups'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:51:12.811957 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-045f6a4a-b68f-4811-9411-f4859fce6479 tempest-ServerGroup264TestJSON-478870796 tempest-ServerGroup264TestJSON-478870796-project] Getting quotas for project a223ee9d4649467f9578a2b8dd00180a. Resources: {'server_groups'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:51:12.839853 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-045f6a4a-b68f-4811-9411-f4859fce6479 tempest-ServerGroup264TestJSON-478870796 tempest-ServerGroup264TestJSON-478870796-project] Getting quotas for user ac02df3882f14cdabe74cc03abac7675 and project a223ee9d4649467f9578a2b8dd00180a. Resources: {'server_groups'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:51:12.867469 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-045f6a4a-b68f-4811-9411-f4859fce6479 tempest-ServerGroup264TestJSON-478870796 tempest-ServerGroup264TestJSON-478870796-project] 10.222.0.60 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.689138 Oct 18 15:51:12.869462 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2734/5447] 10.222.0.60 () {62 vars in 1214 bytes} [Tue Oct 18 15:51:12 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:51:12.882306 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0585ad05-64c5-4238-b2ed-b0e3617d5167 tempest-ServerGroup264TestJSON-478870796 tempest-ServerGroup264TestJSON-478870796-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:12.904185 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2da3d3cd-905c-480c-aa89-82c7b7d70413 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:12.905256 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2da3d3cd-905c-480c-aa89-82c7b7d70413 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 6275fe37-a499-43c2-ac51-d776052c7f43] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:12.915228 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0585ad05-64c5-4238-b2ed-b0e3617d5167 tempest-ServerGroup264TestJSON-478870796 tempest-ServerGroup264TestJSON-478870796-project] 10.222.0.60 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.038754 Oct 18 15:51:12.921436 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2da3d3cd-905c-480c-aa89-82c7b7d70413 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:12.925146 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2714/5448] 10.222.0.60 () {60 vars in 1193 bytes} [Tue Oct 18 15:51:12 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:51:12.935964 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2da3d3cd-905c-480c-aa89-82c7b7d70413 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:12.939615 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2da3d3cd-905c-480c-aa89-82c7b7d70413 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:12.944509 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2da3d3cd-905c-480c-aa89-82c7b7d70413 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:12.945086 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-83638877-1dc9-4708-895e-f339280fa0f9 tempest-ServerGroup264TestJSON-478870796 tempest-ServerGroup264TestJSON-478870796-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:12.946289 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2da3d3cd-905c-480c-aa89-82c7b7d70413 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:12.948108 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2da3d3cd-905c-480c-aa89-82c7b7d70413 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:12.979196 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-83638877-1dc9-4708-895e-f339280fa0f9 tempest-ServerGroup264TestJSON-478870796 tempest-ServerGroup264TestJSON-478870796-project] 10.222.0.60 "GET /compute/v2.1/os-server-groups/29cf825b-7e48-4119-a31c-31f33bd5baca" status: 200 len: 235 microversion: 2.64 time: 0.048128 Oct 18 15:51:12.991758 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2715/5449] 10.222.0.60 () {60 vars in 1304 bytes} [Tue Oct 18 15:51:12 2022] GET /compute/v2.1/os-server-groups/29cf825b-7e48-4119-a31c-31f33bd5baca => generated 235 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:51:13.008707 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-16b82777-4759-45e7-a06f-457cae0bc01b tempest-ServerGroup264TestJSON-478870796 tempest-ServerGroup264TestJSON-478870796-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:13.101341 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-16b82777-4759-45e7-a06f-457cae0bc01b tempest-ServerGroup264TestJSON-478870796 tempest-ServerGroup264TestJSON-478870796-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/29cf825b-7e48-4119-a31c-31f33bd5baca" status: 204 len: 0 microversion: 2.64 time: 0.101139 Oct 18 15:51:13.102216 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2716/5450] 10.222.0.60 () {60 vars in 1307 bytes} [Tue Oct 18 15:51:12 2022] DELETE /compute/v2.1/os-server-groups/29cf825b-7e48-4119-a31c-31f33bd5baca => generated 0 bytes in 104 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 18 15:51:13.121059 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5d958c35-d57a-4fbc-b5a6-b84917636bb8 tempest-ServerGroup264TestJSON-478870796 tempest-ServerGroup264TestJSON-478870796-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:13.137722 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-5d958c35-d57a-4fbc-b5a6-b84917636bb8 tempest-ServerGroup264TestJSON-478870796 tempest-ServerGroup264TestJSON-478870796-project] HTTP exception thrown: Instance group 29cf825b-7e48-4119-a31c-31f33bd5baca could not be found. Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5d958c35-d57a-4fbc-b5a6-b84917636bb8 tempest-ServerGroup264TestJSON-478870796 tempest-ServerGroup264TestJSON-478870796-project] Request method failure captured: Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/os-server-groups/29cf825b-7e48-4119-a31c-31f33bd5baca HTTP/1.1 Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTstwYi89kdu79SZtP8mTj1Z3OVOoQzQFpU7Xex6kqRaHFNxbIATJIYb1SLne_lIXsWAnrnAGdsNGII0HgunAW8vYlgmYJGHIRpDtdGu5nwOKdkEL9q4NcoLmcb92Z9yRVZJffGHwA1zzeIourIezt0WtEusTTKieIXxqjGJKDWwu5sQ Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: X-Openstack-Nova-Api-Version: 2.64 Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: a223ee9d4649467f9578a2b8dd00180a Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerGroup264TestJSON-478870796 Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a223ee9d4649467f9578a2b8dd00180a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a223ee9d4649467f9578a2b8dd00180a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a223ee9d4649467f9578a2b8dd00180a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a223ee9d4649467f9578a2b8dd00180a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServerGroup264TestJSON-478870796 Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: a223ee9d4649467f9578a2b8dd00180a Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerGroup264TestJSON-478870796 Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServerGroup264TestJSON-478870796-project Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: ac02df3882f14cdabe74cc03abac7675 Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServerGroup264TestJSON-478870796-project Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance group 29cf825b-7e48-4119-a31c-31f33bd5baca could not be found. Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '29cf825b-7e48-4119-a31c-31f33bd5baca'} Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 29cf825b-7e48-4119-a31c-31f33bd5baca could not be found. Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 29cf825b-7e48-4119-a31c-31f33bd5baca could not be found. Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:51:13.139970 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:51:13.144343 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:51:13.144343 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:51:13.144343 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:51:13.144343 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:51:13.144343 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 29cf825b-7e48-4119-a31c-31f33bd5baca could not be found. Oct 18 15:51:13.144343 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:51:13.150128 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5d958c35-d57a-4fbc-b5a6-b84917636bb8 tempest-ServerGroup264TestJSON-478870796 tempest-ServerGroup264TestJSON-478870796-project] Returning 404 to user: Instance group 29cf825b-7e48-4119-a31c-31f33bd5baca could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:51:13.157434 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5d958c35-d57a-4fbc-b5a6-b84917636bb8 tempest-ServerGroup264TestJSON-478870796 tempest-ServerGroup264TestJSON-478870796-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/29cf825b-7e48-4119-a31c-31f33bd5baca" status: 404 len: 117 microversion: 2.64 time: 0.048824 Oct 18 15:51:13.160134 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2717/5451] 10.222.0.60 () {60 vars in 1307 bytes} [Tue Oct 18 15:51:13 2022] DELETE /compute/v2.1/os-server-groups/29cf825b-7e48-4119-a31c-31f33bd5baca => generated 117 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:51:13.439623 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9acda1d2-5d14-4423-aa8d-c3ea6e0dda8a tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:13.440256 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9acda1d2-5d14-4423-aa8d-c3ea6e0dda8a tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: 61d72ac7-5fdd-4c9b-a36a-306accdb31e9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:13.459283 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9acda1d2-5d14-4423-aa8d-c3ea6e0dda8a tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:13.459780 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9acda1d2-5d14-4423-aa8d-c3ea6e0dda8a tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:13.461128 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9acda1d2-5d14-4423-aa8d-c3ea6e0dda8a tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:13.470705 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9acda1d2-5d14-4423-aa8d-c3ea6e0dda8a tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:13.471751 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9acda1d2-5d14-4423-aa8d-c3ea6e0dda8a tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:13.472595 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9acda1d2-5d14-4423-aa8d-c3ea6e0dda8a tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:13.671335 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2da3d3cd-905c-480c-aa89-82c7b7d70413 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:13.688272 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2da3d3cd-905c-480c-aa89-82c7b7d70413 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/6275fe37-a499-43c2-ac51-d776052c7f43" status: 200 len: 1308 microversion: 2.1 time: 0.787887 Oct 18 15:51:13.689036 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2735/5452] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:12 2022] GET /compute/v2.1/servers/6275fe37-a499-43c2-ac51-d776052c7f43 => generated 1308 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:51:13.753539 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9acda1d2-5d14-4423-aa8d-c3ea6e0dda8a tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:13.775554 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9acda1d2-5d14-4423-aa8d-c3ea6e0dda8a tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9" status: 200 len: 1271 microversion: 2.1 time: 0.336452 Oct 18 15:51:13.776417 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2718/5453] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:13 2022] GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9 => generated 1271 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:51:14.719718 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-94aa5b6d-2a34-4730-a0dc-2652d567882c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:14.720515 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-94aa5b6d-2a34-4730-a0dc-2652d567882c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 6275fe37-a499-43c2-ac51-d776052c7f43] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:14.736455 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-94aa5b6d-2a34-4730-a0dc-2652d567882c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:14.736903 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-94aa5b6d-2a34-4730-a0dc-2652d567882c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:14.739102 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-94aa5b6d-2a34-4730-a0dc-2652d567882c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:14.740307 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-94aa5b6d-2a34-4730-a0dc-2652d567882c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:14.742007 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-94aa5b6d-2a34-4730-a0dc-2652d567882c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:14.744270 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-94aa5b6d-2a34-4730-a0dc-2652d567882c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:14.803331 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3051d622-eed2-4bfb-97ec-22959c07beaf tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:14.803954 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3051d622-eed2-4bfb-97ec-22959c07beaf tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: 61d72ac7-5fdd-4c9b-a36a-306accdb31e9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:14.821870 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3051d622-eed2-4bfb-97ec-22959c07beaf tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:14.822384 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3051d622-eed2-4bfb-97ec-22959c07beaf tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:14.822831 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3051d622-eed2-4bfb-97ec-22959c07beaf tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:14.823565 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3051d622-eed2-4bfb-97ec-22959c07beaf tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:14.825488 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3051d622-eed2-4bfb-97ec-22959c07beaf tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:14.838071 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3051d622-eed2-4bfb-97ec-22959c07beaf tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:14.986312 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3051d622-eed2-4bfb-97ec-22959c07beaf tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:14.996335 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3051d622-eed2-4bfb-97ec-22959c07beaf tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9" status: 200 len: 1271 microversion: 2.1 time: 0.197082 Oct 18 15:51:15.001827 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2719/5454] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:14 2022] GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9 => generated 1271 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:51:15.053489 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-94aa5b6d-2a34-4730-a0dc-2652d567882c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:15.070481 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-94aa5b6d-2a34-4730-a0dc-2652d567882c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/6275fe37-a499-43c2-ac51-d776052c7f43" status: 200 len: 1308 microversion: 2.1 time: 0.357193 Oct 18 15:51:15.071089 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2736/5455] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:14 2022] GET /compute/v2.1/servers/6275fe37-a499-43c2-ac51-d776052c7f43 => generated 1308 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:16.027980 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-81b225eb-d424-4a6a-859e-846acc977276 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:16.028964 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-81b225eb-d424-4a6a-859e-846acc977276 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: 61d72ac7-5fdd-4c9b-a36a-306accdb31e9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:16.043014 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81b225eb-d424-4a6a-859e-846acc977276 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:16.044980 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81b225eb-d424-4a6a-859e-846acc977276 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:16.047618 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81b225eb-d424-4a6a-859e-846acc977276 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:16.049605 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81b225eb-d424-4a6a-859e-846acc977276 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:16.051779 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81b225eb-d424-4a6a-859e-846acc977276 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:16.052701 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81b225eb-d424-4a6a-859e-846acc977276 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:16.095471 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6cd41c48-d248-4231-938c-91baa9dba823 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:16.096260 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6cd41c48-d248-4231-938c-91baa9dba823 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 6275fe37-a499-43c2-ac51-d776052c7f43] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:16.121584 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6cd41c48-d248-4231-938c-91baa9dba823 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:16.124148 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6cd41c48-d248-4231-938c-91baa9dba823 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:16.126743 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6cd41c48-d248-4231-938c-91baa9dba823 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:16.129587 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6cd41c48-d248-4231-938c-91baa9dba823 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:16.137536 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6cd41c48-d248-4231-938c-91baa9dba823 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:16.139095 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6cd41c48-d248-4231-938c-91baa9dba823 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:17.150198 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-81b225eb-d424-4a6a-859e-846acc977276 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:17.164483 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-81b225eb-d424-4a6a-859e-846acc977276 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9" status: 200 len: 1313 microversion: 2.1 time: 1.141854 Oct 18 15:51:17.167931 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2720/5456] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:16 2022] GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9 => generated 1313 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:17.176394 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6cd41c48-d248-4231-938c-91baa9dba823 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:17.187740 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6cd41c48-d248-4231-938c-91baa9dba823 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/6275fe37-a499-43c2-ac51-d776052c7f43" status: 200 len: 1308 microversion: 2.1 time: 1.096053 Oct 18 15:51:17.188912 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2737/5457] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:16 2022] GET /compute/v2.1/servers/6275fe37-a499-43c2-ac51-d776052c7f43 => generated 1308 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:18.192151 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-225ee881-80b5-48b7-be37-3d1636566d75 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:18.193629 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-225ee881-80b5-48b7-be37-3d1636566d75 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: 61d72ac7-5fdd-4c9b-a36a-306accdb31e9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:18.207747 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-225ee881-80b5-48b7-be37-3d1636566d75 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:18.215024 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-09f03edb-c0c6-47dd-9441-366520d655d2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:18.216230 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-09f03edb-c0c6-47dd-9441-366520d655d2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 6275fe37-a499-43c2-ac51-d776052c7f43] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:18.224496 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-225ee881-80b5-48b7-be37-3d1636566d75 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:18.225633 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-225ee881-80b5-48b7-be37-3d1636566d75 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:18.230077 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-225ee881-80b5-48b7-be37-3d1636566d75 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:18.230644 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-225ee881-80b5-48b7-be37-3d1636566d75 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:18.231039 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-225ee881-80b5-48b7-be37-3d1636566d75 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:18.237567 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09f03edb-c0c6-47dd-9441-366520d655d2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:18.239033 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09f03edb-c0c6-47dd-9441-366520d655d2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:18.241296 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09f03edb-c0c6-47dd-9441-366520d655d2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:18.244697 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09f03edb-c0c6-47dd-9441-366520d655d2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:18.247002 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09f03edb-c0c6-47dd-9441-366520d655d2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:18.247736 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09f03edb-c0c6-47dd-9441-366520d655d2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:18.791018 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-09f03edb-c0c6-47dd-9441-366520d655d2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:18.814056 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-09f03edb-c0c6-47dd-9441-366520d655d2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/6275fe37-a499-43c2-ac51-d776052c7f43" status: 200 len: 1308 microversion: 2.1 time: 0.602737 Oct 18 15:51:18.814699 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2738/5458] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:18 2022] GET /compute/v2.1/servers/6275fe37-a499-43c2-ac51-d776052c7f43 => generated 1308 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:51:18.834959 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-225ee881-80b5-48b7-be37-3d1636566d75 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:18.845294 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-225ee881-80b5-48b7-be37-3d1636566d75 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9" status: 200 len: 1313 microversion: 2.1 time: 0.657696 Oct 18 15:51:18.846782 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2721/5459] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:18 2022] GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9 => generated 1313 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:19.516219 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-ff79ab4f-7251-44c0-933f-3c42682fc365 req-ae7df237-6a81-4a29-affa-3d4abb54031d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61d72ac7-5fdd-4c9b-a36a-306accdb31e9", "tag": "2c1efa57-6386-4097-9761-d01f2ac449c7"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:51:19.539901 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-ff79ab4f-7251-44c0-933f-3c42682fc365 req-ae7df237-6a81-4a29-affa-3d4abb54031d service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:19.540398 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-ff79ab4f-7251-44c0-933f-3c42682fc365 req-ae7df237-6a81-4a29-affa-3d4abb54031d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:19.540850 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-ff79ab4f-7251-44c0-933f-3c42682fc365 req-ae7df237-6a81-4a29-affa-3d4abb54031d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:19.579818 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-ff79ab4f-7251-44c0-933f-3c42682fc365 req-ae7df237-6a81-4a29-affa-3d4abb54031d service nova] Creating event network-changed:2c1efa57-6386-4097-9761-d01f2ac449c7 for instance 61d72ac7-5fdd-4c9b-a36a-306accdb31e9 on n-h2-853682-5 Oct 18 15:51:19.600858 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-ff79ab4f-7251-44c0-933f-3c42682fc365 req-ae7df237-6a81-4a29-affa-3d4abb54031d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092135 Oct 18 15:51:19.601508 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2739/5460] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:51:19.843673 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1ff8cf54-b210-4b62-a9b3-26f7c1817113 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:19.845311 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1ff8cf54-b210-4b62-a9b3-26f7c1817113 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 6275fe37-a499-43c2-ac51-d776052c7f43] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:19.860178 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ff8cf54-b210-4b62-a9b3-26f7c1817113 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:19.863169 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ff8cf54-b210-4b62-a9b3-26f7c1817113 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:19.863693 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ff8cf54-b210-4b62-a9b3-26f7c1817113 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:19.865139 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ff8cf54-b210-4b62-a9b3-26f7c1817113 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:19.868751 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ff8cf54-b210-4b62-a9b3-26f7c1817113 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:19.869322 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ff8cf54-b210-4b62-a9b3-26f7c1817113 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:19.873846 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2630d21a-5811-4eec-ae90-ccc8fad6cbd6 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:19.875853 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2630d21a-5811-4eec-ae90-ccc8fad6cbd6 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: 61d72ac7-5fdd-4c9b-a36a-306accdb31e9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:19.887934 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2630d21a-5811-4eec-ae90-ccc8fad6cbd6 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:19.891293 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2630d21a-5811-4eec-ae90-ccc8fad6cbd6 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:19.891929 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2630d21a-5811-4eec-ae90-ccc8fad6cbd6 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:19.893012 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2630d21a-5811-4eec-ae90-ccc8fad6cbd6 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:19.893713 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2630d21a-5811-4eec-ae90-ccc8fad6cbd6 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:19.897940 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2630d21a-5811-4eec-ae90-ccc8fad6cbd6 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:20.421190 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1ff8cf54-b210-4b62-a9b3-26f7c1817113 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:20.450491 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1ff8cf54-b210-4b62-a9b3-26f7c1817113 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/6275fe37-a499-43c2-ac51-d776052c7f43" status: 200 len: 1308 microversion: 2.1 time: 0.611693 Oct 18 15:51:20.451527 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2722/5461] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:19 2022] GET /compute/v2.1/servers/6275fe37-a499-43c2-ac51-d776052c7f43 => generated 1308 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:20.480281 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-bdb3c303-846c-4044-b547-d8a83cd1f235 req-c942602e-be04-41fa-9022-49f24ac92e7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6275fe37-a499-43c2-ac51-d776052c7f43", "name": "network-vif-plugged", "status": "completed", "tag": "251e0ae3-0d50-452d-97f4-07fb53035930"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:51:20.504056 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2630d21a-5811-4eec-ae90-ccc8fad6cbd6 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:20.511465 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-bdb3c303-846c-4044-b547-d8a83cd1f235 req-c942602e-be04-41fa-9022-49f24ac92e7a service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:20.516690 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-bdb3c303-846c-4044-b547-d8a83cd1f235 req-c942602e-be04-41fa-9022-49f24ac92e7a service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:20.517574 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-bdb3c303-846c-4044-b547-d8a83cd1f235 req-c942602e-be04-41fa-9022-49f24ac92e7a service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:20.519625 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2630d21a-5811-4eec-ae90-ccc8fad6cbd6 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9" status: 200 len: 1313 microversion: 2.1 time: 0.650352 Oct 18 15:51:20.522242 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2740/5462] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:19 2022] GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9 => generated 1313 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:20.550854 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-bdb3c303-846c-4044-b547-d8a83cd1f235 req-c942602e-be04-41fa-9022-49f24ac92e7a service nova] Creating event network-vif-plugged:251e0ae3-0d50-452d-97f4-07fb53035930 for instance 6275fe37-a499-43c2-ac51-d776052c7f43 on n-h1-853682-5 Oct 18 15:51:20.562689 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-bdb3c303-846c-4044-b547-d8a83cd1f235 req-c942602e-be04-41fa-9022-49f24ac92e7a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098656 Oct 18 15:51:20.565541 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2723/5463] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:51:21.475381 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bc1dd733-fb7c-4340-8356-aa377d1f9814 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:21.476035 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-bc1dd733-fb7c-4340-8356-aa377d1f9814 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 6275fe37-a499-43c2-ac51-d776052c7f43] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:21.484739 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bc1dd733-fb7c-4340-8356-aa377d1f9814 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:21.485229 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bc1dd733-fb7c-4340-8356-aa377d1f9814 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:21.485681 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bc1dd733-fb7c-4340-8356-aa377d1f9814 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:21.489109 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bc1dd733-fb7c-4340-8356-aa377d1f9814 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:21.489906 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bc1dd733-fb7c-4340-8356-aa377d1f9814 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:21.493559 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bc1dd733-fb7c-4340-8356-aa377d1f9814 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:21.548650 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-390c82ba-c5b8-4965-b96d-5e636042a18c tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:21.549550 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-390c82ba-c5b8-4965-b96d-5e636042a18c tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: 61d72ac7-5fdd-4c9b-a36a-306accdb31e9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:21.552157 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:51:21.554341 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=12 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:51:21.559230 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:51:21.580360 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-390c82ba-c5b8-4965-b96d-5e636042a18c tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:21.586590 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-390c82ba-c5b8-4965-b96d-5e636042a18c tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:21.587052 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-390c82ba-c5b8-4965-b96d-5e636042a18c tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:21.587800 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-390c82ba-c5b8-4965-b96d-5e636042a18c tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:21.591889 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-390c82ba-c5b8-4965-b96d-5e636042a18c tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:21.592341 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-390c82ba-c5b8-4965-b96d-5e636042a18c tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:22.009292 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-bc1dd733-fb7c-4340-8356-aa377d1f9814 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:22.019659 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=100 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:51:22.026985 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-bc1dd733-fb7c-4340-8356-aa377d1f9814 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/6275fe37-a499-43c2-ac51-d776052c7f43" status: 200 len: 1308 microversion: 2.1 time: 0.555782 Oct 18 15:51:22.031701 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2741/5464] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:21 2022] GET /compute/v2.1/servers/6275fe37-a499-43c2-ac51-d776052c7f43 => generated 1308 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:22.040624 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-390c82ba-c5b8-4965-b96d-5e636042a18c tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:22.055773 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-390c82ba-c5b8-4965-b96d-5e636042a18c tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9" status: 200 len: 1313 microversion: 2.1 time: 0.509888 Oct 18 15:51:22.057238 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2724/5465] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:21 2022] GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9 => generated 1313 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:23.053014 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ea724e2f-5985-43da-abf2-24b8000203a2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:23.053626 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ea724e2f-5985-43da-abf2-24b8000203a2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 6275fe37-a499-43c2-ac51-d776052c7f43] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:23.064017 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=12 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:51:23.070826 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea724e2f-5985-43da-abf2-24b8000203a2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:23.073858 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea724e2f-5985-43da-abf2-24b8000203a2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:23.074874 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea724e2f-5985-43da-abf2-24b8000203a2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:23.075953 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea724e2f-5985-43da-abf2-24b8000203a2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:23.084255 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bcf8da36-9516-4137-9d43-3640e744d85c tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:23.084846 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea724e2f-5985-43da-abf2-24b8000203a2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:23.085818 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bcf8da36-9516-4137-9d43-3640e744d85c tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: 61d72ac7-5fdd-4c9b-a36a-306accdb31e9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:23.120430 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea724e2f-5985-43da-abf2-24b8000203a2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:23.127496 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bcf8da36-9516-4137-9d43-3640e744d85c tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:23.128002 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bcf8da36-9516-4137-9d43-3640e744d85c tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:23.128441 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bcf8da36-9516-4137-9d43-3640e744d85c tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:23.136260 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bcf8da36-9516-4137-9d43-3640e744d85c tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:23.152347 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bcf8da36-9516-4137-9d43-3640e744d85c tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:23.154140 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bcf8da36-9516-4137-9d43-3640e744d85c tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:23.549338 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ea724e2f-5985-43da-abf2-24b8000203a2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:23.559526 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ea724e2f-5985-43da-abf2-24b8000203a2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/6275fe37-a499-43c2-ac51-d776052c7f43" status: 200 len: 1489 microversion: 2.1 time: 0.509696 Oct 18 15:51:23.561759 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2742/5466] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:23 2022] GET /compute/v2.1/servers/6275fe37-a499-43c2-ac51-d776052c7f43 => generated 1489 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:23.572050 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bcf8da36-9516-4137-9d43-3640e744d85c tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:23.585680 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bcf8da36-9516-4137-9d43-3640e744d85c tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9" status: 200 len: 1313 microversion: 2.1 time: 0.505866 Oct 18 15:51:23.588407 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c42f4532-76f8-4d64-a868-1d9d1cf5204a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:51:23.591023 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c42f4532-76f8-4d64-a868-1d9d1cf5204a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 6275fe37-a499-43c2-ac51-d776052c7f43] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:23.599837 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2725/5467] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:23 2022] GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9 => generated 1313 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:51:23.614547 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c42f4532-76f8-4d64-a868-1d9d1cf5204a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:23.616647 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c42f4532-76f8-4d64-a868-1d9d1cf5204a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:23.618205 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c42f4532-76f8-4d64-a868-1d9d1cf5204a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:23.619219 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c42f4532-76f8-4d64-a868-1d9d1cf5204a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:23.621691 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c42f4532-76f8-4d64-a868-1d9d1cf5204a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:23.622399 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c42f4532-76f8-4d64-a868-1d9d1cf5204a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:23.736389 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c42f4532-76f8-4d64-a868-1d9d1cf5204a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "PUT /compute/v2.1/servers/6275fe37-a499-43c2-ac51-d776052c7f43" status: 200 len: 1084 microversion: 2.1 time: 0.154361 Oct 18 15:51:23.745001 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2743/5468] 10.222.0.60 () {60 vars in 1256 bytes} [Tue Oct 18 15:51:23 2022] PUT /compute/v2.1/servers/6275fe37-a499-43c2-ac51-d776052c7f43 => generated 1084 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:51:23.761344 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-54c89b60-145b-4eaa-a511-db94e24a00e5 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:23.762262 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-54c89b60-145b-4eaa-a511-db94e24a00e5 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 6275fe37-a499-43c2-ac51-d776052c7f43] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:23.770438 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54c89b60-145b-4eaa-a511-db94e24a00e5 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:23.771223 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54c89b60-145b-4eaa-a511-db94e24a00e5 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:23.771856 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54c89b60-145b-4eaa-a511-db94e24a00e5 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:23.772750 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54c89b60-145b-4eaa-a511-db94e24a00e5 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:23.773528 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54c89b60-145b-4eaa-a511-db94e24a00e5 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:23.774143 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54c89b60-145b-4eaa-a511-db94e24a00e5 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:23.791576 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:51:23.997574 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-54c89b60-145b-4eaa-a511-db94e24a00e5 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:24.007440 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-54c89b60-145b-4eaa-a511-db94e24a00e5 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/6275fe37-a499-43c2-ac51-d776052c7f43" status: 200 len: 1510 microversion: 2.1 time: 0.250220 Oct 18 15:51:24.008539 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2726/5469] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:23 2022] GET /compute/v2.1/servers/6275fe37-a499-43c2-ac51-d776052c7f43 => generated 1510 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:24.031437 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2c01fe3c-dcd4-460a-9a47-38d341a3d061 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:24.032268 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2c01fe3c-dcd4-460a-9a47-38d341a3d061 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 6275fe37-a499-43c2-ac51-d776052c7f43] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:24.039371 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c01fe3c-dcd4-460a-9a47-38d341a3d061 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:24.039987 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c01fe3c-dcd4-460a-9a47-38d341a3d061 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:24.041075 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c01fe3c-dcd4-460a-9a47-38d341a3d061 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:24.042172 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c01fe3c-dcd4-460a-9a47-38d341a3d061 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:24.043044 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c01fe3c-dcd4-460a-9a47-38d341a3d061 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:24.044078 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c01fe3c-dcd4-460a-9a47-38d341a3d061 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:24.227869 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2c01fe3c-dcd4-460a-9a47-38d341a3d061 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:24.236735 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2c01fe3c-dcd4-460a-9a47-38d341a3d061 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/6275fe37-a499-43c2-ac51-d776052c7f43" status: 200 len: 1510 microversion: 2.1 time: 0.209570 Oct 18 15:51:24.253275 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2744/5470] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:24 2022] GET /compute/v2.1/servers/6275fe37-a499-43c2-ac51-d776052c7f43 => generated 1510 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:24.261169 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7adaf386-8fc7-4f3d-b493-4f9b67e8e5fe tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:24.262513 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7adaf386-8fc7-4f3d-b493-4f9b67e8e5fe tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 6275fe37-a499-43c2-ac51-d776052c7f43] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:24.270849 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7adaf386-8fc7-4f3d-b493-4f9b67e8e5fe tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:24.271617 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7adaf386-8fc7-4f3d-b493-4f9b67e8e5fe tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:24.272075 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7adaf386-8fc7-4f3d-b493-4f9b67e8e5fe tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:24.272796 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7adaf386-8fc7-4f3d-b493-4f9b67e8e5fe tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:24.273563 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7adaf386-8fc7-4f3d-b493-4f9b67e8e5fe tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:24.274225 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7adaf386-8fc7-4f3d-b493-4f9b67e8e5fe tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:24.308509 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7adaf386-8fc7-4f3d-b493-4f9b67e8e5fe tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 6275fe37-a499-43c2-ac51-d776052c7f43] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:51:24.444745 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7adaf386-8fc7-4f3d-b493-4f9b67e8e5fe tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6275fe37-a499-43c2-ac51-d776052c7f43" status: 204 len: 0 microversion: 2.1 time: 0.186520 Oct 18 15:51:24.448471 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2727/5471] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:51:24 2022] DELETE /compute/v2.1/servers/6275fe37-a499-43c2-ac51-d776052c7f43 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:51:24.456637 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1f52dbbe-741c-40dc-91f3-ea6c619140f4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:24.457294 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1f52dbbe-741c-40dc-91f3-ea6c619140f4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 6275fe37-a499-43c2-ac51-d776052c7f43] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:24.478294 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1f52dbbe-741c-40dc-91f3-ea6c619140f4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:24.479668 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1f52dbbe-741c-40dc-91f3-ea6c619140f4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:24.480682 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1f52dbbe-741c-40dc-91f3-ea6c619140f4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:24.483313 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1f52dbbe-741c-40dc-91f3-ea6c619140f4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:24.486077 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1f52dbbe-741c-40dc-91f3-ea6c619140f4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:24.488132 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1f52dbbe-741c-40dc-91f3-ea6c619140f4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:24.616389 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-59ab516e-6112-4213-ad31-a96ade0fc352 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:24.617285 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-59ab516e-6112-4213-ad31-a96ade0fc352 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: 61d72ac7-5fdd-4c9b-a36a-306accdb31e9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:24.634499 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-59ab516e-6112-4213-ad31-a96ade0fc352 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:24.635380 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-59ab516e-6112-4213-ad31-a96ade0fc352 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:24.636310 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-59ab516e-6112-4213-ad31-a96ade0fc352 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:24.637962 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-59ab516e-6112-4213-ad31-a96ade0fc352 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:24.638833 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-59ab516e-6112-4213-ad31-a96ade0fc352 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:24.641498 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-59ab516e-6112-4213-ad31-a96ade0fc352 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:24.716611 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1f52dbbe-741c-40dc-91f3-ea6c619140f4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:24.725899 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1f52dbbe-741c-40dc-91f3-ea6c619140f4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/6275fe37-a499-43c2-ac51-d776052c7f43" status: 200 len: 1516 microversion: 2.1 time: 0.273128 Oct 18 15:51:24.727353 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2745/5472] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:24 2022] GET /compute/v2.1/servers/6275fe37-a499-43c2-ac51-d776052c7f43 => generated 1516 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:24.913644 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-59ab516e-6112-4213-ad31-a96ade0fc352 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:24.924336 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-59ab516e-6112-4213-ad31-a96ade0fc352 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9" status: 200 len: 1313 microversion: 2.1 time: 0.315709 Oct 18 15:51:24.925335 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2728/5473] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:24 2022] GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9 => generated 1313 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:51:25.753612 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a00a7b67-efbb-4a64-a8ef-4be966aa7f5f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:25.756704 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a00a7b67-efbb-4a64-a8ef-4be966aa7f5f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 6275fe37-a499-43c2-ac51-d776052c7f43] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:25.773318 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a00a7b67-efbb-4a64-a8ef-4be966aa7f5f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:25.776974 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a00a7b67-efbb-4a64-a8ef-4be966aa7f5f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:25.778609 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a00a7b67-efbb-4a64-a8ef-4be966aa7f5f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:25.779752 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a00a7b67-efbb-4a64-a8ef-4be966aa7f5f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:25.780239 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a00a7b67-efbb-4a64-a8ef-4be966aa7f5f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:25.781255 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a00a7b67-efbb-4a64-a8ef-4be966aa7f5f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:25.948193 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-620fa9db-b2ca-4173-8f22-4f6c1c79cc04 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:25.949455 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-620fa9db-b2ca-4173-8f22-4f6c1c79cc04 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: 61d72ac7-5fdd-4c9b-a36a-306accdb31e9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:25.964154 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-620fa9db-b2ca-4173-8f22-4f6c1c79cc04 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:25.964911 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-620fa9db-b2ca-4173-8f22-4f6c1c79cc04 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:25.965504 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-620fa9db-b2ca-4173-8f22-4f6c1c79cc04 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:25.970142 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-620fa9db-b2ca-4173-8f22-4f6c1c79cc04 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:25.970833 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-620fa9db-b2ca-4173-8f22-4f6c1c79cc04 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:25.971418 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-620fa9db-b2ca-4173-8f22-4f6c1c79cc04 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:26.341338 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a00a7b67-efbb-4a64-a8ef-4be966aa7f5f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:26.349977 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a00a7b67-efbb-4a64-a8ef-4be966aa7f5f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/6275fe37-a499-43c2-ac51-d776052c7f43" status: 200 len: 1516 microversion: 2.1 time: 0.602858 Oct 18 15:51:26.357641 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2746/5474] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:25 2022] GET /compute/v2.1/servers/6275fe37-a499-43c2-ac51-d776052c7f43 => generated 1516 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:26.455291 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-620fa9db-b2ca-4173-8f22-4f6c1c79cc04 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:26.472061 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-620fa9db-b2ca-4173-8f22-4f6c1c79cc04 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9" status: 200 len: 1313 microversion: 2.1 time: 0.527520 Oct 18 15:51:26.475959 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2729/5475] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:25 2022] GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9 => generated 1313 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:27.384009 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ba983892-bbd2-4463-8c72-a95a77a527d2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:27.384642 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ba983892-bbd2-4463-8c72-a95a77a527d2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 6275fe37-a499-43c2-ac51-d776052c7f43] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:27.396444 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:51:27.416080 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba983892-bbd2-4463-8c72-a95a77a527d2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:27.416657 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba983892-bbd2-4463-8c72-a95a77a527d2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:27.417296 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba983892-bbd2-4463-8c72-a95a77a527d2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:27.418335 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba983892-bbd2-4463-8c72-a95a77a527d2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:27.419505 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba983892-bbd2-4463-8c72-a95a77a527d2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:27.430152 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba983892-bbd2-4463-8c72-a95a77a527d2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:27.483097 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-922bbba5-6ec0-4a53-8def-a42631539381 req-1cc7cf20-41f6-432a-9d2e-baa005673999 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6275fe37-a499-43c2-ac51-d776052c7f43", "name": "network-vif-deleted", "tag": "251e0ae3-0d50-452d-97f4-07fb53035930"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:51:27.525392 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-922bbba5-6ec0-4a53-8def-a42631539381 req-1cc7cf20-41f6-432a-9d2e-baa005673999 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:27.528411 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-922bbba5-6ec0-4a53-8def-a42631539381 req-1cc7cf20-41f6-432a-9d2e-baa005673999 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:27.529866 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-922bbba5-6ec0-4a53-8def-a42631539381 req-1cc7cf20-41f6-432a-9d2e-baa005673999 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:27.568751 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-922bbba5-6ec0-4a53-8def-a42631539381 req-1cc7cf20-41f6-432a-9d2e-baa005673999 service nova] Creating event network-vif-deleted:251e0ae3-0d50-452d-97f4-07fb53035930 for instance 6275fe37-a499-43c2-ac51-d776052c7f43 on n-h1-853682-5 Oct 18 15:51:27.582610 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ba983892-bbd2-4463-8c72-a95a77a527d2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:27.595342 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-922bbba5-6ec0-4a53-8def-a42631539381 req-1cc7cf20-41f6-432a-9d2e-baa005673999 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122663 Oct 18 15:51:27.600174 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2730/5476] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:51:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:51:27.609407 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ba983892-bbd2-4463-8c72-a95a77a527d2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/6275fe37-a499-43c2-ac51-d776052c7f43" status: 200 len: 1474 microversion: 2.1 time: 0.230464 Oct 18 15:51:27.612198 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2747/5477] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:27 2022] GET /compute/v2.1/servers/6275fe37-a499-43c2-ac51-d776052c7f43 => generated 1474 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:27.613615 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-889b3033-f3d9-4139-9d7d-8baa633dbf7d tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:27.615566 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-889b3033-f3d9-4139-9d7d-8baa633dbf7d tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: 61d72ac7-5fdd-4c9b-a36a-306accdb31e9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:27.630270 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-889b3033-f3d9-4139-9d7d-8baa633dbf7d tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:27.631412 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-889b3033-f3d9-4139-9d7d-8baa633dbf7d tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:27.633788 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-889b3033-f3d9-4139-9d7d-8baa633dbf7d tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:27.635863 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-889b3033-f3d9-4139-9d7d-8baa633dbf7d tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:27.637634 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-889b3033-f3d9-4139-9d7d-8baa633dbf7d tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:27.640098 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-889b3033-f3d9-4139-9d7d-8baa633dbf7d tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:28.041707 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-889b3033-f3d9-4139-9d7d-8baa633dbf7d tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:28.053793 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-889b3033-f3d9-4139-9d7d-8baa633dbf7d tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9" status: 200 len: 1313 microversion: 2.1 time: 0.451863 Oct 18 15:51:28.055042 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2731/5478] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:27 2022] GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9 => generated 1313 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:28.635524 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-24b53f2a-45d7-402d-b5de-cfd0e2eec980 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:28.636998 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-24b53f2a-45d7-402d-b5de-cfd0e2eec980 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 6275fe37-a499-43c2-ac51-d776052c7f43] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:28.651313 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-24b53f2a-45d7-402d-b5de-cfd0e2eec980 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:28.653332 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-24b53f2a-45d7-402d-b5de-cfd0e2eec980 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:28.654799 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-24b53f2a-45d7-402d-b5de-cfd0e2eec980 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:28.655922 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-24b53f2a-45d7-402d-b5de-cfd0e2eec980 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:28.659634 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-24b53f2a-45d7-402d-b5de-cfd0e2eec980 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:28.660134 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-24b53f2a-45d7-402d-b5de-cfd0e2eec980 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:28.684997 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-24b53f2a-45d7-402d-b5de-cfd0e2eec980 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] HTTP exception thrown: Instance 6275fe37-a499-43c2-ac51-d776052c7f43 could not be found. Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-24b53f2a-45d7-402d-b5de-cfd0e2eec980 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Request method failure captured: Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/6275fe37-a499-43c2-ac51-d776052c7f43 HTTP/1.1 Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsrEJhXnu9-kA1ME2ZgtL01L1ZZn_p1cwLPkqNlVzGclz5bmzyyOf2BB4P7wVe6-U6KsqFzM-iyEynyHjx99j1zL9TNO9M1_0gjdhVd46w55yQ-UymJhYbErDED9EKpU_GJnghtBqaCd9UvgTeTf4e4PvQGeOp69vMSi60uoNlhyAmg Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: afdb1e8b478f463987ec223f2d10db33 Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServersTestJSON-126042862 Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServersTestJSON-126042862 Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: afdb1e8b478f463987ec223f2d10db33 Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServersTestJSON-126042862 Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServersTestJSON-126042862-project Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 73f4ee2e7ff34dd88b9b82fefbf06a36 Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServersTestJSON-126042862-project Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 6275fe37-a499-43c2-ac51-d776052c7f43 could not be found. Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '6275fe37-a499-43c2-ac51-d776052c7f43'} Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6275fe37-a499-43c2-ac51-d776052c7f43 could not be found. Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6275fe37-a499-43c2-ac51-d776052c7f43 could not be found. Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:51:28.688751 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:51:28.695919 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:51:28.695919 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:51:28.695919 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:51:28.695919 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:51:28.695919 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6275fe37-a499-43c2-ac51-d776052c7f43 could not be found. Oct 18 15:51:28.695919 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:51:28.695919 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-24b53f2a-45d7-402d-b5de-cfd0e2eec980 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Returning 404 to user: Instance 6275fe37-a499-43c2-ac51-d776052c7f43 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:51:28.697772 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-24b53f2a-45d7-402d-b5de-cfd0e2eec980 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/6275fe37-a499-43c2-ac51-d776052c7f43" status: 404 len: 111 microversion: 2.1 time: 0.064843 Oct 18 15:51:28.703504 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2748/5479] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:28 2022] GET /compute/v2.1/servers/6275fe37-a499-43c2-ac51-d776052c7f43 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:51:28.911653 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ffe8f5de-1184-4141-9d95-591696c4479b tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-771903851", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "5126a012-82e3-4304-a7ec-ac28e05a407b"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:51:29.001827 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-ffe8f5de-1184-4141-9d95-591696c4479b tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] validate_networks() for [('5126a012-82e3-4304-a7ec-ac28e05a407b', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:51:29.082271 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0dddaf28-8f0f-4c5d-ae55-4ddaf8e11188 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:29.083131 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0dddaf28-8f0f-4c5d-ae55-4ddaf8e11188 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: 61d72ac7-5fdd-4c9b-a36a-306accdb31e9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:29.092933 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0dddaf28-8f0f-4c5d-ae55-4ddaf8e11188 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:29.094624 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0dddaf28-8f0f-4c5d-ae55-4ddaf8e11188 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:29.096083 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0dddaf28-8f0f-4c5d-ae55-4ddaf8e11188 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:29.101250 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0dddaf28-8f0f-4c5d-ae55-4ddaf8e11188 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:29.102288 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0dddaf28-8f0f-4c5d-ae55-4ddaf8e11188 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:29.102900 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0dddaf28-8f0f-4c5d-ae55-4ddaf8e11188 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:29.961021 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0dddaf28-8f0f-4c5d-ae55-4ddaf8e11188 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:29.974535 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0dddaf28-8f0f-4c5d-ae55-4ddaf8e11188 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9" status: 200 len: 1313 microversion: 2.1 time: 0.896662 Oct 18 15:51:29.997175 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2749/5480] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:29 2022] GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9 => generated 1313 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:51:30.002739 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-632fd624-3c10-406d-9e06-14c4539f3aa6 req-7fdd29c8-6bd9-44da-925e-2071c95a77a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61d72ac7-5fdd-4c9b-a36a-306accdb31e9", "name": "network-vif-plugged", "status": "completed", "tag": "2c1efa57-6386-4097-9761-d01f2ac449c7"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:51:30.013608 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-632fd624-3c10-406d-9e06-14c4539f3aa6 req-7fdd29c8-6bd9-44da-925e-2071c95a77a7 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:30.014611 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-632fd624-3c10-406d-9e06-14c4539f3aa6 req-7fdd29c8-6bd9-44da-925e-2071c95a77a7 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:30.016186 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-632fd624-3c10-406d-9e06-14c4539f3aa6 req-7fdd29c8-6bd9-44da-925e-2071c95a77a7 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:30.029086 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-632fd624-3c10-406d-9e06-14c4539f3aa6 req-7fdd29c8-6bd9-44da-925e-2071c95a77a7 service nova] Creating event network-vif-plugged:2c1efa57-6386-4097-9761-d01f2ac449c7 for instance 61d72ac7-5fdd-4c9b-a36a-306accdb31e9 on n-h2-853682-5 Oct 18 15:51:30.079377 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-632fd624-3c10-406d-9e06-14c4539f3aa6 req-7fdd29c8-6bd9-44da-925e-2071c95a77a7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080771 Oct 18 15:51:30.084208 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2750/5481] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:51:30.301895 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3d948563-611f-439d-8ecf-810fc085e55a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:30.302604 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3d948563-611f-439d-8ecf-810fc085e55a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:30.310026 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3d948563-611f-439d-8ecf-810fc085e55a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:30.310627 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3d948563-611f-439d-8ecf-810fc085e55a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:30.311262 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3d948563-611f-439d-8ecf-810fc085e55a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:30.312612 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3d948563-611f-439d-8ecf-810fc085e55a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:30.313078 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3d948563-611f-439d-8ecf-810fc085e55a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:30.313665 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3d948563-611f-439d-8ecf-810fc085e55a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:30.370353 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3d948563-611f-439d-8ecf-810fc085e55a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e/os-volume_attachments/89a3c710-d937-4189-928f-ac35d9b94338" status: 200 len: 194 microversion: 2.20 time: 0.074404 Oct 18 15:51:30.372473 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2751/5482] 10.222.0.60 () {60 vars in 1454 bytes} [Tue Oct 18 15:51:30 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e/os-volume_attachments/89a3c710-d937-4189-928f-ac35d9b94338 => generated 194 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 15:51:30.471602 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ce0c747c-b0e3-4ec9-b9df-bd40e63bb6e2 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:30.472631 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ce0c747c-b0e3-4ec9-b9df-bd40e63bb6e2 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:30.484068 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ce0c747c-b0e3-4ec9-b9df-bd40e63bb6e2 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:30.485344 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ce0c747c-b0e3-4ec9-b9df-bd40e63bb6e2 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:30.486104 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ce0c747c-b0e3-4ec9-b9df-bd40e63bb6e2 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:30.487165 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ce0c747c-b0e3-4ec9-b9df-bd40e63bb6e2 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:30.487708 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ce0c747c-b0e3-4ec9-b9df-bd40e63bb6e2 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:30.488696 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ce0c747c-b0e3-4ec9-b9df-bd40e63bb6e2 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:30.662348 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-ce0c747c-b0e3-4ec9-b9df-bd40e63bb6e2 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lazy-loading 'services' on Instance uuid b465248f-ab7a-4aba-b939-6f236eea166e {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:51:30.887819 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ce0c747c-b0e3-4ec9-b9df-bd40e63bb6e2 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e/os-volume_attachments/89a3c710-d937-4189-928f-ac35d9b94338" status: 202 len: 0 microversion: 2.20 time: 0.419897 Oct 18 15:51:30.889172 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2752/5483] 10.222.0.60 () {60 vars in 1457 bytes} [Tue Oct 18 15:51:30 2022] DELETE /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e/os-volume_attachments/89a3c710-d937-4189-928f-ac35d9b94338 => generated 0 bytes in 423 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 18 15:51:30.917379 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e1603992-c2b3-46c7-bf0b-2debcc46cf3e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:30.920378 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e1603992-c2b3-46c7-bf0b-2debcc46cf3e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:30.932256 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e1603992-c2b3-46c7-bf0b-2debcc46cf3e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:30.933033 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e1603992-c2b3-46c7-bf0b-2debcc46cf3e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:30.933689 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e1603992-c2b3-46c7-bf0b-2debcc46cf3e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:30.935082 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e1603992-c2b3-46c7-bf0b-2debcc46cf3e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:30.935772 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e1603992-c2b3-46c7-bf0b-2debcc46cf3e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:30.936432 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e1603992-c2b3-46c7-bf0b-2debcc46cf3e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:31.013717 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e1603992-c2b3-46c7-bf0b-2debcc46cf3e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.111716 Oct 18 15:51:31.025108 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2753/5484] 10.222.0.60 () {60 vars in 1343 bytes} [Tue Oct 18 15:51:30 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:51:31.037258 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7d962ed3-8a06-4146-a563-73ee5cad8c1e tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:31.039244 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7d962ed3-8a06-4146-a563-73ee5cad8c1e tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: 61d72ac7-5fdd-4c9b-a36a-306accdb31e9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:31.055714 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7d962ed3-8a06-4146-a563-73ee5cad8c1e tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:31.058752 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7d962ed3-8a06-4146-a563-73ee5cad8c1e tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:31.061027 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7d962ed3-8a06-4146-a563-73ee5cad8c1e tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:31.063108 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7d962ed3-8a06-4146-a563-73ee5cad8c1e tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:31.063832 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7d962ed3-8a06-4146-a563-73ee5cad8c1e tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:31.066097 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7d962ed3-8a06-4146-a563-73ee5cad8c1e tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:31.347890 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-ffe8f5de-1184-4141-9d95-591696c4479b tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:51:31.348410 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-ffe8f5de-1184-4141-9d95-591696c4479b tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:51:31.349294 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-ffe8f5de-1184-4141-9d95-591696c4479b tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:51:31.349790 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-ffe8f5de-1184-4141-9d95-591696c4479b tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:51:31.350169 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-ffe8f5de-1184-4141-9d95-591696c4479b tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:51:31.367790 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ffe8f5de-1184-4141-9d95-591696c4479b tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:31.368540 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ffe8f5de-1184-4141-9d95-591696c4479b tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:31.370424 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ffe8f5de-1184-4141-9d95-591696c4479b tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:31.373420 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ffe8f5de-1184-4141-9d95-591696c4479b tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:31.374078 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ffe8f5de-1184-4141-9d95-591696c4479b tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:31.377784 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ffe8f5de-1184-4141-9d95-591696c4479b tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:31.458944 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-ffe8f5de-1184-4141-9d95-591696c4479b tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Getting quotas for project afdb1e8b478f463987ec223f2d10db33. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:51:31.476054 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-ffe8f5de-1184-4141-9d95-591696c4479b tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Getting quotas for user 73f4ee2e7ff34dd88b9b82fefbf06a36 and project afdb1e8b478f463987ec223f2d10db33. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:51:31.526693 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ffe8f5de-1184-4141-9d95-591696c4479b tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:51:31.529460 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ffe8f5de-1184-4141-9d95-591696c4479b tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:51:31.657736 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ffe8f5de-1184-4141-9d95-591696c4479b tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.749887 Oct 18 15:51:31.659436 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2732/5485] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:51:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:51:31.671683 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-281b2e1e-0e8d-431a-b426-f0820a543f79 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:31.672678 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-281b2e1e-0e8d-431a-b426-f0820a543f79 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:31.971329 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-281b2e1e-0e8d-431a-b426-f0820a543f79 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:31.994426 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-281b2e1e-0e8d-431a-b426-f0820a543f79 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6" status: 200 len: 1208 microversion: 2.1 time: 0.327835 Oct 18 15:51:32.012834 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2733/5486] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:31 2022] GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 => generated 1208 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:51:32.024613 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7d962ed3-8a06-4146-a563-73ee5cad8c1e tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:32.027201 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d851a3c8-1958-4fc9-8c46-3ae3d2255868 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:32.032077 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d851a3c8-1958-4fc9-8c46-3ae3d2255868 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:32.037821 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7d962ed3-8a06-4146-a563-73ee5cad8c1e tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9" status: 200 len: 1313 microversion: 2.1 time: 1.009301 Oct 18 15:51:32.037821 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2754/5487] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:31 2022] GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9 => generated 1313 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:32.055155 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d851a3c8-1958-4fc9-8c46-3ae3d2255868 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:32.055809 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d851a3c8-1958-4fc9-8c46-3ae3d2255868 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:32.056484 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d851a3c8-1958-4fc9-8c46-3ae3d2255868 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:32.057457 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d851a3c8-1958-4fc9-8c46-3ae3d2255868 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:32.058097 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d851a3c8-1958-4fc9-8c46-3ae3d2255868 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:32.058671 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d851a3c8-1958-4fc9-8c46-3ae3d2255868 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:32.138193 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d851a3c8-1958-4fc9-8c46-3ae3d2255868 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.114894 Oct 18 15:51:32.157722 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2734/5488] 10.222.0.60 () {60 vars in 1343 bytes} [Tue Oct 18 15:51:32 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 15:51:33.023666 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-79581043-d32d-485b-b759-3cfa3e45daea tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:33.024524 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-79581043-d32d-485b-b759-3cfa3e45daea tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:33.034699 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-79581043-d32d-485b-b759-3cfa3e45daea tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:33.040365 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-79581043-d32d-485b-b759-3cfa3e45daea tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:33.041063 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-79581043-d32d-485b-b759-3cfa3e45daea tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:33.041967 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-79581043-d32d-485b-b759-3cfa3e45daea tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:33.042671 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-79581043-d32d-485b-b759-3cfa3e45daea tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:33.043283 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-79581043-d32d-485b-b759-3cfa3e45daea tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:33.065017 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-45e583bc-1bfa-4c53-bf7a-7ce0a4560a42 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:33.066465 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-45e583bc-1bfa-4c53-bf7a-7ce0a4560a42 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: 61d72ac7-5fdd-4c9b-a36a-306accdb31e9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:33.082973 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45e583bc-1bfa-4c53-bf7a-7ce0a4560a42 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:33.085846 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45e583bc-1bfa-4c53-bf7a-7ce0a4560a42 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:33.093910 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45e583bc-1bfa-4c53-bf7a-7ce0a4560a42 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:33.097603 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45e583bc-1bfa-4c53-bf7a-7ce0a4560a42 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:33.098204 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45e583bc-1bfa-4c53-bf7a-7ce0a4560a42 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:33.098931 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45e583bc-1bfa-4c53-bf7a-7ce0a4560a42 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:33.299286 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-79581043-d32d-485b-b759-3cfa3e45daea tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:33.317912 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-79581043-d32d-485b-b759-3cfa3e45daea tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6" status: 200 len: 1204 microversion: 2.1 time: 0.298181 Oct 18 15:51:33.323519 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2755/5489] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:33 2022] GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 => generated 1204 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:33.340230 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3cd25c27-fa0d-4306-80a3-fddb439b7d2a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:33.348461 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3cd25c27-fa0d-4306-80a3-fddb439b7d2a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:33.363551 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3cd25c27-fa0d-4306-80a3-fddb439b7d2a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:33.364299 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3cd25c27-fa0d-4306-80a3-fddb439b7d2a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:33.365002 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3cd25c27-fa0d-4306-80a3-fddb439b7d2a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:33.365917 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3cd25c27-fa0d-4306-80a3-fddb439b7d2a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:33.366564 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3cd25c27-fa0d-4306-80a3-fddb439b7d2a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:33.367336 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3cd25c27-fa0d-4306-80a3-fddb439b7d2a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:33.443530 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3cd25c27-fa0d-4306-80a3-fddb439b7d2a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.114753 Oct 18 15:51:33.450022 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2756/5490] 10.222.0.60 () {60 vars in 1343 bytes} [Tue Oct 18 15:51:33 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:51:34.349313 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-efdf93cf-1fd9-4bca-8d64-8458b455c52a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:34.350213 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-efdf93cf-1fd9-4bca-8d64-8458b455c52a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:34.366206 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-efdf93cf-1fd9-4bca-8d64-8458b455c52a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:34.367158 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-efdf93cf-1fd9-4bca-8d64-8458b455c52a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:34.379123 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-efdf93cf-1fd9-4bca-8d64-8458b455c52a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:34.380654 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-efdf93cf-1fd9-4bca-8d64-8458b455c52a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:34.381678 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-efdf93cf-1fd9-4bca-8d64-8458b455c52a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:34.384357 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-efdf93cf-1fd9-4bca-8d64-8458b455c52a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:34.584587 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-efdf93cf-1fd9-4bca-8d64-8458b455c52a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:34.596057 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-efdf93cf-1fd9-4bca-8d64-8458b455c52a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6" status: 200 len: 1266 microversion: 2.1 time: 0.253236 Oct 18 15:51:34.603680 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2757/5491] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:34 2022] GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 => generated 1266 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:51:34.609347 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-03ba4c30-ef65-4617-85f8-8a2d4d42564b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:34.615226 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-03ba4c30-ef65-4617-85f8-8a2d4d42564b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:34.621565 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-45e583bc-1bfa-4c53-bf7a-7ce0a4560a42 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:34.629719 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-03ba4c30-ef65-4617-85f8-8a2d4d42564b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:34.630438 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-03ba4c30-ef65-4617-85f8-8a2d4d42564b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:34.631061 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-03ba4c30-ef65-4617-85f8-8a2d4d42564b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:34.632289 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-03ba4c30-ef65-4617-85f8-8a2d4d42564b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:34.632939 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-03ba4c30-ef65-4617-85f8-8a2d4d42564b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:34.633514 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-03ba4c30-ef65-4617-85f8-8a2d4d42564b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:34.643240 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-45e583bc-1bfa-4c53-bf7a-7ce0a4560a42 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9" status: 200 len: 1498 microversion: 2.1 time: 1.583776 Oct 18 15:51:34.656800 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:51:34.657204 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2735/5492] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:33 2022] GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9 => generated 1498 bytes in 1598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:34.670231 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4ac81c5d-7f50-4c91-b8f2-e72de3c13e70 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:51:34.671176 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-03ba4c30-ef65-4617-85f8-8a2d4d42564b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066178 Oct 18 15:51:34.672267 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2758/5493] 10.222.0.60 () {60 vars in 1343 bytes} [Tue Oct 18 15:51:34 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:51:34.672614 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4ac81c5d-7f50-4c91-b8f2-e72de3c13e70 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: 61d72ac7-5fdd-4c9b-a36a-306accdb31e9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:34.684433 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ac81c5d-7f50-4c91-b8f2-e72de3c13e70 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:34.684962 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ac81c5d-7f50-4c91-b8f2-e72de3c13e70 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:34.685401 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ac81c5d-7f50-4c91-b8f2-e72de3c13e70 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:34.686116 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ac81c5d-7f50-4c91-b8f2-e72de3c13e70 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:34.687101 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ac81c5d-7f50-4c91-b8f2-e72de3c13e70 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:34.687571 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ac81c5d-7f50-4c91-b8f2-e72de3c13e70 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:34.743567 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-4ac81c5d-7f50-4c91-b8f2-e72de3c13e70 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lazy-loading 'flavor' on Instance uuid 61d72ac7-5fdd-4c9b-a36a-306accdb31e9 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:51:34.888579 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4ac81c5d-7f50-4c91-b8f2-e72de3c13e70 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "POST /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9/action" status: 200 len: 32 microversion: 2.1 time: 0.222328 Oct 18 15:51:34.889251 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2736/5494] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:51:34 2022] POST /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9/action => generated 32 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 18 15:51:34.913688 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-052517b9-f497-420f-ae44-e4d8f0941d22 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:34.915757 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-052517b9-f497-420f-ae44-e4d8f0941d22 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: 61d72ac7-5fdd-4c9b-a36a-306accdb31e9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:34.933799 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-052517b9-f497-420f-ae44-e4d8f0941d22 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:34.939860 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-052517b9-f497-420f-ae44-e4d8f0941d22 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:34.940956 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-052517b9-f497-420f-ae44-e4d8f0941d22 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:34.941844 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-052517b9-f497-420f-ae44-e4d8f0941d22 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:34.942647 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-052517b9-f497-420f-ae44-e4d8f0941d22 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:34.943486 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-052517b9-f497-420f-ae44-e4d8f0941d22 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:35.497264 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-052517b9-f497-420f-ae44-e4d8f0941d22 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:35.524204 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-052517b9-f497-420f-ae44-e4d8f0941d22 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9" status: 200 len: 1504 microversion: 2.1 time: 0.629000 Oct 18 15:51:35.528025 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2759/5495] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:34 2022] GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9 => generated 1504 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:35.631354 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2ff4bc55-622f-4e3b-87c4-c54ce0e122e1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:35.632221 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2ff4bc55-622f-4e3b-87c4-c54ce0e122e1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:35.648547 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2ff4bc55-622f-4e3b-87c4-c54ce0e122e1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:35.649065 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2ff4bc55-622f-4e3b-87c4-c54ce0e122e1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:35.651317 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2ff4bc55-622f-4e3b-87c4-c54ce0e122e1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:35.660173 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2ff4bc55-622f-4e3b-87c4-c54ce0e122e1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:35.662175 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2ff4bc55-622f-4e3b-87c4-c54ce0e122e1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:35.665621 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2ff4bc55-622f-4e3b-87c4-c54ce0e122e1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:35.693255 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2e343ae8-09bb-4bc1-a557-605072925252 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:35.696593 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2e343ae8-09bb-4bc1-a557-605072925252 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:35.723736 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2e343ae8-09bb-4bc1-a557-605072925252 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:35.725684 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2e343ae8-09bb-4bc1-a557-605072925252 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:35.727943 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2e343ae8-09bb-4bc1-a557-605072925252 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:35.728902 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2e343ae8-09bb-4bc1-a557-605072925252 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:35.731734 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2e343ae8-09bb-4bc1-a557-605072925252 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:35.732365 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2e343ae8-09bb-4bc1-a557-605072925252 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:35.784556 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2e343ae8-09bb-4bc1-a557-605072925252 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.101956 Oct 18 15:51:35.790039 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2760/5496] 10.222.0.60 () {60 vars in 1343 bytes} [Tue Oct 18 15:51:35 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:51:36.202744 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2ff4bc55-622f-4e3b-87c4-c54ce0e122e1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:36.212615 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2ff4bc55-622f-4e3b-87c4-c54ce0e122e1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6" status: 200 len: 1308 microversion: 2.1 time: 0.589491 Oct 18 15:51:36.213203 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2737/5497] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:35 2022] GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 => generated 1308 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:36.559875 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-82b3a39f-3cec-4f75-a9d3-947902ada570 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:36.561212 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-82b3a39f-3cec-4f75-a9d3-947902ada570 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: 61d72ac7-5fdd-4c9b-a36a-306accdb31e9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:36.589582 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-82b3a39f-3cec-4f75-a9d3-947902ada570 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:36.597729 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-82b3a39f-3cec-4f75-a9d3-947902ada570 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:36.598660 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-82b3a39f-3cec-4f75-a9d3-947902ada570 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:36.600627 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-82b3a39f-3cec-4f75-a9d3-947902ada570 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:36.605037 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-82b3a39f-3cec-4f75-a9d3-947902ada570 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:36.607824 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-82b3a39f-3cec-4f75-a9d3-947902ada570 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:36.798227 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5427e743-7bef-4f45-8ab5-5f691fca4cd7 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:36.802446 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5427e743-7bef-4f45-8ab5-5f691fca4cd7 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:36.823620 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5427e743-7bef-4f45-8ab5-5f691fca4cd7 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:36.825479 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5427e743-7bef-4f45-8ab5-5f691fca4cd7 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:36.831878 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5427e743-7bef-4f45-8ab5-5f691fca4cd7 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:36.833026 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5427e743-7bef-4f45-8ab5-5f691fca4cd7 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:36.837551 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5427e743-7bef-4f45-8ab5-5f691fca4cd7 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:36.846751 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5427e743-7bef-4f45-8ab5-5f691fca4cd7 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:36.915510 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5427e743-7bef-4f45-8ab5-5f691fca4cd7 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.122063 Oct 18 15:51:36.920380 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2738/5498] 10.222.0.60 () {60 vars in 1343 bytes} [Tue Oct 18 15:51:36 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 15:51:37.242175 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-811d1ae4-2105-4bd7-956b-52967030eac1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:37.242800 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-811d1ae4-2105-4bd7-956b-52967030eac1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:37.255172 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-811d1ae4-2105-4bd7-956b-52967030eac1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:37.255665 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-811d1ae4-2105-4bd7-956b-52967030eac1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:37.256102 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-811d1ae4-2105-4bd7-956b-52967030eac1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:37.256861 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-811d1ae4-2105-4bd7-956b-52967030eac1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:37.257331 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-811d1ae4-2105-4bd7-956b-52967030eac1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:37.257757 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-811d1ae4-2105-4bd7-956b-52967030eac1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:37.607210 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-82b3a39f-3cec-4f75-a9d3-947902ada570 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:37.628800 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-82b3a39f-3cec-4f75-a9d3-947902ada570 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9" status: 200 len: 1504 microversion: 2.1 time: 1.075846 Oct 18 15:51:37.649772 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2761/5499] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:36 2022] GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9 => generated 1504 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:37.659409 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-17f54ae5-835b-44dd-9f23-4821b1b8c07d req-5f1b9289-df75-4e4b-b588-196064a2991f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6", "tag": "ce0d7a7c-9381-448c-a84f-9a9bd1cc6802"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:51:37.793615 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-17f54ae5-835b-44dd-9f23-4821b1b8c07d req-5f1b9289-df75-4e4b-b588-196064a2991f service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:37.794146 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-17f54ae5-835b-44dd-9f23-4821b1b8c07d req-5f1b9289-df75-4e4b-b588-196064a2991f service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:37.794595 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-17f54ae5-835b-44dd-9f23-4821b1b8c07d req-5f1b9289-df75-4e4b-b588-196064a2991f service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:37.827225 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-17f54ae5-835b-44dd-9f23-4821b1b8c07d req-5f1b9289-df75-4e4b-b588-196064a2991f service nova] Creating event network-changed:ce0d7a7c-9381-448c-a84f-9a9bd1cc6802 for instance e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 on n-h1-853682-5 Oct 18 15:51:37.848742 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-17f54ae5-835b-44dd-9f23-4821b1b8c07d req-5f1b9289-df75-4e4b-b588-196064a2991f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.196076 Oct 18 15:51:37.851480 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2762/5500] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:51:37.933313 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-45d8cf51-12d5-4e06-bc13-8bd21df9ca01 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:37.937805 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-45d8cf51-12d5-4e06-bc13-8bd21df9ca01 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:37.956445 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-45d8cf51-12d5-4e06-bc13-8bd21df9ca01 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:37.959307 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-45d8cf51-12d5-4e06-bc13-8bd21df9ca01 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:37.959787 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-45d8cf51-12d5-4e06-bc13-8bd21df9ca01 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:37.965366 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-45d8cf51-12d5-4e06-bc13-8bd21df9ca01 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:37.966634 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-45d8cf51-12d5-4e06-bc13-8bd21df9ca01 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:37.967895 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-45d8cf51-12d5-4e06-bc13-8bd21df9ca01 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:37.974176 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-811d1ae4-2105-4bd7-956b-52967030eac1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:37.992280 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-811d1ae4-2105-4bd7-956b-52967030eac1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6" status: 200 len: 1308 microversion: 2.1 time: 0.753348 Oct 18 15:51:37.999973 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2739/5501] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:37 2022] GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 => generated 1308 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:51:38.071213 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-45d8cf51-12d5-4e06-bc13-8bd21df9ca01 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.141319 Oct 18 15:51:38.072752 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2763/5502] 10.222.0.60 () {60 vars in 1343 bytes} [Tue Oct 18 15:51:37 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 15:51:38.667715 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-834adc7d-7d59-4d46-8dc5-145796c1b85f tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:38.668712 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-834adc7d-7d59-4d46-8dc5-145796c1b85f tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: 61d72ac7-5fdd-4c9b-a36a-306accdb31e9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:38.675339 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-834adc7d-7d59-4d46-8dc5-145796c1b85f tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:38.676137 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-834adc7d-7d59-4d46-8dc5-145796c1b85f tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:38.676791 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-834adc7d-7d59-4d46-8dc5-145796c1b85f tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:38.677920 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-834adc7d-7d59-4d46-8dc5-145796c1b85f tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:38.681730 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-834adc7d-7d59-4d46-8dc5-145796c1b85f tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:38.683034 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-834adc7d-7d59-4d46-8dc5-145796c1b85f tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:39.022092 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e72294f8-ef4b-43c0-931e-96d53bae31a9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:39.022692 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e72294f8-ef4b-43c0-931e-96d53bae31a9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:39.037900 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e72294f8-ef4b-43c0-931e-96d53bae31a9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:39.045341 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e72294f8-ef4b-43c0-931e-96d53bae31a9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:39.046414 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e72294f8-ef4b-43c0-931e-96d53bae31a9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:39.048221 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e72294f8-ef4b-43c0-931e-96d53bae31a9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:39.050432 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e72294f8-ef4b-43c0-931e-96d53bae31a9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:39.053368 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e72294f8-ef4b-43c0-931e-96d53bae31a9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:39.262094 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-834adc7d-7d59-4d46-8dc5-145796c1b85f tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:39.276092 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-834adc7d-7d59-4d46-8dc5-145796c1b85f tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9" status: 200 len: 1504 microversion: 2.1 time: 0.622879 Oct 18 15:51:39.294042 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2740/5503] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:38 2022] GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9 => generated 1504 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:39.309983 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-58b035a7-5053-4504-a492-7216f0568dec tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:39.315745 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-58b035a7-5053-4504-a492-7216f0568dec tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:39.332556 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58b035a7-5053-4504-a492-7216f0568dec tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:39.335382 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58b035a7-5053-4504-a492-7216f0568dec tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:39.342425 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58b035a7-5053-4504-a492-7216f0568dec tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:39.344015 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58b035a7-5053-4504-a492-7216f0568dec tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:39.347879 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58b035a7-5053-4504-a492-7216f0568dec tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:39.349088 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58b035a7-5053-4504-a492-7216f0568dec tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:39.413906 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:51:39.431380 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-58b035a7-5053-4504-a492-7216f0568dec tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.135798 Oct 18 15:51:39.434007 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2741/5504] 10.222.0.60 () {60 vars in 1343 bytes} [Tue Oct 18 15:51:39 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:51:39.562026 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e72294f8-ef4b-43c0-931e-96d53bae31a9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:39.577765 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e72294f8-ef4b-43c0-931e-96d53bae31a9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6" status: 200 len: 1308 microversion: 2.1 time: 0.560036 Oct 18 15:51:39.582649 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2764/5505] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:39 2022] GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 => generated 1308 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:51:40.309914 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-10ea3d01-4232-4e0e-adef-ae9678b62e67 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:40.312285 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-10ea3d01-4232-4e0e-adef-ae9678b62e67 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: 61d72ac7-5fdd-4c9b-a36a-306accdb31e9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:40.328110 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10ea3d01-4232-4e0e-adef-ae9678b62e67 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:40.328665 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10ea3d01-4232-4e0e-adef-ae9678b62e67 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:40.329145 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10ea3d01-4232-4e0e-adef-ae9678b62e67 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:40.335550 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10ea3d01-4232-4e0e-adef-ae9678b62e67 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:40.337866 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10ea3d01-4232-4e0e-adef-ae9678b62e67 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:40.340763 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10ea3d01-4232-4e0e-adef-ae9678b62e67 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:40.448198 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5c5a17e6-5777-402b-a7c1-19a17c9d644c tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:40.450421 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5c5a17e6-5777-402b-a7c1-19a17c9d644c tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:40.467047 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5c5a17e6-5777-402b-a7c1-19a17c9d644c tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:40.467579 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5c5a17e6-5777-402b-a7c1-19a17c9d644c tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:40.469466 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5c5a17e6-5777-402b-a7c1-19a17c9d644c tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:40.470367 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5c5a17e6-5777-402b-a7c1-19a17c9d644c tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:40.472290 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5c5a17e6-5777-402b-a7c1-19a17c9d644c tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:40.473316 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5c5a17e6-5777-402b-a7c1-19a17c9d644c tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:40.530547 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5c5a17e6-5777-402b-a7c1-19a17c9d644c tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.087234 Oct 18 15:51:40.537483 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2765/5506] 10.222.0.60 () {60 vars in 1343 bytes} [Tue Oct 18 15:51:40 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e/os-volume_attachments => generated 25 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:40.609248 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-86071e66-a65f-4b69-8f0d-33be3ed41c62 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:40.610143 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-86071e66-a65f-4b69-8f0d-33be3ed41c62 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:40.627155 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-86071e66-a65f-4b69-8f0d-33be3ed41c62 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:40.632513 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-86071e66-a65f-4b69-8f0d-33be3ed41c62 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:40.633136 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-86071e66-a65f-4b69-8f0d-33be3ed41c62 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:40.634242 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-86071e66-a65f-4b69-8f0d-33be3ed41c62 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:40.639504 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-86071e66-a65f-4b69-8f0d-33be3ed41c62 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:40.649300 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-86071e66-a65f-4b69-8f0d-33be3ed41c62 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:40.751533 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-10ea3d01-4232-4e0e-adef-ae9678b62e67 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:40.767288 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-10ea3d01-4232-4e0e-adef-ae9678b62e67 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9" status: 200 len: 1504 microversion: 2.1 time: 0.464346 Oct 18 15:51:40.770825 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2742/5507] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:40 2022] GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9 => generated 1504 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:40.779040 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3e2c1d5f-76dc-4299-8541-686acb999004 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:40.787648 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3e2c1d5f-76dc-4299-8541-686acb999004 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:40.804575 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e2c1d5f-76dc-4299-8541-686acb999004 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:40.807037 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e2c1d5f-76dc-4299-8541-686acb999004 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:40.808714 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e2c1d5f-76dc-4299-8541-686acb999004 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:40.809864 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e2c1d5f-76dc-4299-8541-686acb999004 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:40.812101 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e2c1d5f-76dc-4299-8541-686acb999004 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:40.814024 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e2c1d5f-76dc-4299-8541-686acb999004 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:40.910046 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3e2c1d5f-76dc-4299-8541-686acb999004 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:51:41.028781 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-86071e66-a65f-4b69-8f0d-33be3ed41c62 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:41.039440 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-86071e66-a65f-4b69-8f0d-33be3ed41c62 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6" status: 200 len: 1308 microversion: 2.1 time: 0.434396 Oct 18 15:51:41.040057 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2766/5508] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:40 2022] GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 => generated 1308 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:51:41.127775 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3e2c1d5f-76dc-4299-8541-686acb999004 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 204 len: 0 microversion: 2.20 time: 0.354990 Oct 18 15:51:41.134405 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2743/5509] 10.222.0.60 () {60 vars in 1280 bytes} [Tue Oct 18 15:51:40 2022] DELETE /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 15:51:41.146876 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-64769bba-e148-4408-8ee2-b517e93897fc tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:41.147878 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-64769bba-e148-4408-8ee2-b517e93897fc tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:41.161207 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64769bba-e148-4408-8ee2-b517e93897fc tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:41.162163 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64769bba-e148-4408-8ee2-b517e93897fc tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:41.162968 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64769bba-e148-4408-8ee2-b517e93897fc tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:41.164238 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64769bba-e148-4408-8ee2-b517e93897fc tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:41.165050 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64769bba-e148-4408-8ee2-b517e93897fc tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:41.166374 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64769bba-e148-4408-8ee2-b517e93897fc tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:41.415275 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:51:41.547306 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-64769bba-e148-4408-8ee2-b517e93897fc tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:41.563828 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-64769bba-e148-4408-8ee2-b517e93897fc tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:41.567408 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-64769bba-e148-4408-8ee2-b517e93897fc tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:41.569942 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-64769bba-e148-4408-8ee2-b517e93897fc tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1720 microversion: 2.20 time: 0.430826 Oct 18 15:51:41.571548 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2744/5510] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:51:41 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1720 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:51:41.643578 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-86f46548-748e-433d-b6a7-1ca58bd3849f tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-519048756", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:51:41.773613 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-86f46548-748e-433d-b6a7-1ca58bd3849f tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] validate_networks() for [('f869bd7a-04a0-4771-893a-477b7d96732b', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:51:41.795005 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cf222b75-d7c7-4b2a-87d7-c5c6837155b4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:41.795654 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cf222b75-d7c7-4b2a-87d7-c5c6837155b4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: 61d72ac7-5fdd-4c9b-a36a-306accdb31e9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:41.806534 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf222b75-d7c7-4b2a-87d7-c5c6837155b4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:41.807496 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf222b75-d7c7-4b2a-87d7-c5c6837155b4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:41.808094 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf222b75-d7c7-4b2a-87d7-c5c6837155b4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:41.809618 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf222b75-d7c7-4b2a-87d7-c5c6837155b4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:41.813520 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf222b75-d7c7-4b2a-87d7-c5c6837155b4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:41.814212 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf222b75-d7c7-4b2a-87d7-c5c6837155b4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:41.996041 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=8 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:51:42.146765 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cf222b75-d7c7-4b2a-87d7-c5c6837155b4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:42.156375 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cf222b75-d7c7-4b2a-87d7-c5c6837155b4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9" status: 200 len: 1504 microversion: 2.1 time: 0.365228 Oct 18 15:51:42.157527 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2745/5511] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:41 2022] GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9 => generated 1504 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:51:42.163139 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d0c187cf-fd42-4827-b344-daad244cb619 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:42.163754 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d0c187cf-fd42-4827-b344-daad244cb619 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:42.173248 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0c187cf-fd42-4827-b344-daad244cb619 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:42.173631 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0c187cf-fd42-4827-b344-daad244cb619 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:42.174242 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0c187cf-fd42-4827-b344-daad244cb619 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:42.175115 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0c187cf-fd42-4827-b344-daad244cb619 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:42.175570 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0c187cf-fd42-4827-b344-daad244cb619 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:42.175994 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0c187cf-fd42-4827-b344-daad244cb619 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:42.455679 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d0c187cf-fd42-4827-b344-daad244cb619 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:42.473568 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d0c187cf-fd42-4827-b344-daad244cb619 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6" status: 200 len: 1308 microversion: 2.1 time: 0.314777 Oct 18 15:51:42.474166 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2746/5512] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:42 2022] GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 => generated 1308 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:42.597320 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0f0911b2-1f32-409a-a7e5-f03ac9808339 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:42.598795 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0f0911b2-1f32-409a-a7e5-f03ac9808339 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:42.610514 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f0911b2-1f32-409a-a7e5-f03ac9808339 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:42.611556 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f0911b2-1f32-409a-a7e5-f03ac9808339 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:42.612231 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f0911b2-1f32-409a-a7e5-f03ac9808339 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:42.613766 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f0911b2-1f32-409a-a7e5-f03ac9808339 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:42.622919 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f0911b2-1f32-409a-a7e5-f03ac9808339 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:42.623821 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f0911b2-1f32-409a-a7e5-f03ac9808339 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:43.252997 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-86f46548-748e-433d-b6a7-1ca58bd3849f tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:51:43.253561 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-86f46548-748e-433d-b6a7-1ca58bd3849f tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:51:43.253996 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-86f46548-748e-433d-b6a7-1ca58bd3849f tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:51:43.254489 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-86f46548-748e-433d-b6a7-1ca58bd3849f tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:51:43.254946 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-86f46548-748e-433d-b6a7-1ca58bd3849f tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:51:43.277418 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0f0911b2-1f32-409a-a7e5-f03ac9808339 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:43.278038 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-86f46548-748e-433d-b6a7-1ca58bd3849f tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:43.278609 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-86f46548-748e-433d-b6a7-1ca58bd3849f tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:43.279069 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-86f46548-748e-433d-b6a7-1ca58bd3849f tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:43.284393 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-86f46548-748e-433d-b6a7-1ca58bd3849f tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:43.285137 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-86f46548-748e-433d-b6a7-1ca58bd3849f tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:43.287694 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-86f46548-748e-433d-b6a7-1ca58bd3849f tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:43.287964 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0f0911b2-1f32-409a-a7e5-f03ac9808339 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:43.289530 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0f0911b2-1f32-409a-a7e5-f03ac9808339 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:43.290736 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0f0911b2-1f32-409a-a7e5-f03ac9808339 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1720 microversion: 2.20 time: 0.697961 Oct 18 15:51:43.291670 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2747/5513] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:51:42 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1720 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:51:43.296899 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1016150a-1158-4bda-bc33-63cae770d5a1 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:43.297522 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1016150a-1158-4bda-bc33-63cae770d5a1 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: 61d72ac7-5fdd-4c9b-a36a-306accdb31e9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:43.304123 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1016150a-1158-4bda-bc33-63cae770d5a1 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:43.304624 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1016150a-1158-4bda-bc33-63cae770d5a1 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:43.305088 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1016150a-1158-4bda-bc33-63cae770d5a1 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:43.305797 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1016150a-1158-4bda-bc33-63cae770d5a1 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:43.306299 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1016150a-1158-4bda-bc33-63cae770d5a1 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:43.306659 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1016150a-1158-4bda-bc33-63cae770d5a1 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:43.331182 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-86f46548-748e-433d-b6a7-1ca58bd3849f tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Getting quotas for project a2164f4bcd424ffbace7a1baf85f36db. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:51:43.340714 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-86f46548-748e-433d-b6a7-1ca58bd3849f tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Getting quotas for user 0c27994e138c42ffbe4d9151b776ae6e and project a2164f4bcd424ffbace7a1baf85f36db. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:51:43.357322 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-86f46548-748e-433d-b6a7-1ca58bd3849f tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:51:43.361135 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-86f46548-748e-433d-b6a7-1ca58bd3849f tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] [instance: bfd97d9c-daf6-4503-8fd1-ae8750a24793] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:51:43.464353 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-86f46548-748e-433d-b6a7-1ca58bd3849f tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.423147 Oct 18 15:51:43.465406 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2767/5514] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:51:41 2022] POST /compute/v2.1/servers => generated 383 bytes in 2425 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:51:43.466444 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1016150a-1158-4bda-bc33-63cae770d5a1 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:43.475313 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1016150a-1158-4bda-bc33-63cae770d5a1 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9" status: 200 len: 1504 microversion: 2.1 time: 0.182342 Oct 18 15:51:43.489769 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2748/5515] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:43 2022] GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9 => generated 1504 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:43.498199 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fd79ed79-d4ee-4c6d-8d5b-2e73cf21d11d tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:43.500006 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-fd79ed79-d4ee-4c6d-8d5b-2e73cf21d11d tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] [instance: bfd97d9c-daf6-4503-8fd1-ae8750a24793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:43.509956 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3e98bdda-df22-4796-9dbd-d9fa3e36f91c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:43.511200 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3e98bdda-df22-4796-9dbd-d9fa3e36f91c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:43.541663 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e98bdda-df22-4796-9dbd-d9fa3e36f91c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:43.542174 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e98bdda-df22-4796-9dbd-d9fa3e36f91c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:43.551612 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e98bdda-df22-4796-9dbd-d9fa3e36f91c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:43.558438 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e98bdda-df22-4796-9dbd-d9fa3e36f91c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:43.559222 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e98bdda-df22-4796-9dbd-d9fa3e36f91c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:43.560460 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e98bdda-df22-4796-9dbd-d9fa3e36f91c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:43.599827 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-fd79ed79-d4ee-4c6d-8d5b-2e73cf21d11d tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c27994e138c42ffbe4d9151b776ae6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2164f4bcd424ffbace7a1baf85f36db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:43.617878 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fd79ed79-d4ee-4c6d-8d5b-2e73cf21d11d tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] 10.222.0.60 "GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793" status: 200 len: 1222 microversion: 2.1 time: 0.143855 Oct 18 15:51:43.619078 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2768/5516] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:43 2022] GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793 => generated 1222 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:43.780687 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3e98bdda-df22-4796-9dbd-d9fa3e36f91c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:43.804459 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3e98bdda-df22-4796-9dbd-d9fa3e36f91c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6" status: 200 len: 1308 microversion: 2.1 time: 0.309755 Oct 18 15:51:43.821737 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2749/5517] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:43 2022] GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 => generated 1308 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:44.323364 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8fef11b6-263d-440e-b81a-0db614d7549e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:44.324652 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8fef11b6-263d-440e-b81a-0db614d7549e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:44.350044 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8fef11b6-263d-440e-b81a-0db614d7549e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:44.350995 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8fef11b6-263d-440e-b81a-0db614d7549e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:44.351541 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8fef11b6-263d-440e-b81a-0db614d7549e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:44.353689 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8fef11b6-263d-440e-b81a-0db614d7549e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:44.359696 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8fef11b6-263d-440e-b81a-0db614d7549e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:44.360298 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8fef11b6-263d-440e-b81a-0db614d7549e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:44.505744 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0241162c-065e-4abd-9715-97564b9048c3 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:44.507605 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0241162c-065e-4abd-9715-97564b9048c3 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: 61d72ac7-5fdd-4c9b-a36a-306accdb31e9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:44.546736 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0241162c-065e-4abd-9715-97564b9048c3 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:44.554487 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0241162c-065e-4abd-9715-97564b9048c3 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:44.555037 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0241162c-065e-4abd-9715-97564b9048c3 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:44.555821 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0241162c-065e-4abd-9715-97564b9048c3 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:44.556306 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0241162c-065e-4abd-9715-97564b9048c3 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:44.556744 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0241162c-065e-4abd-9715-97564b9048c3 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:44.808424 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8fef11b6-263d-440e-b81a-0db614d7549e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:44.824233 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8fef11b6-263d-440e-b81a-0db614d7549e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:44.832798 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8fef11b6-263d-440e-b81a-0db614d7549e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:44.842955 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8fef11b6-263d-440e-b81a-0db614d7549e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1720 microversion: 2.20 time: 0.516641 Oct 18 15:51:44.844622 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2769/5518] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:51:44 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1720 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:51:44.852556 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-03bcdd09-e98f-4cf5-baf0-f693c85329df tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:44.853225 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-03bcdd09-e98f-4cf5-baf0-f693c85329df tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] [instance: bfd97d9c-daf6-4503-8fd1-ae8750a24793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:44.868567 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-03bcdd09-e98f-4cf5-baf0-f693c85329df tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:44.870622 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-03bcdd09-e98f-4cf5-baf0-f693c85329df tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:44.876828 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-03bcdd09-e98f-4cf5-baf0-f693c85329df tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:44.884225 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-03bcdd09-e98f-4cf5-baf0-f693c85329df tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:44.885040 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-03bcdd09-e98f-4cf5-baf0-f693c85329df tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:44.887118 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-03bcdd09-e98f-4cf5-baf0-f693c85329df tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:45.000379 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0241162c-065e-4abd-9715-97564b9048c3 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:45.031451 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0241162c-065e-4abd-9715-97564b9048c3 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9" status: 200 len: 1504 microversion: 2.1 time: 0.514964 Oct 18 15:51:45.032167 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2750/5519] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:44 2022] GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9 => generated 1504 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:51:45.092528 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-bb058f10-18f4-4e70-976b-eb2b7108ed66 req-fe53f4b9-2053-42a3-adb4-e2d335b45e53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6", "name": "network-vif-plugged", "status": "completed", "tag": "ce0d7a7c-9381-448c-a84f-9a9bd1cc6802"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:51:45.172998 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-bb058f10-18f4-4e70-976b-eb2b7108ed66 req-fe53f4b9-2053-42a3-adb4-e2d335b45e53 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:45.173552 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-bb058f10-18f4-4e70-976b-eb2b7108ed66 req-fe53f4b9-2053-42a3-adb4-e2d335b45e53 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:45.173994 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-bb058f10-18f4-4e70-976b-eb2b7108ed66 req-fe53f4b9-2053-42a3-adb4-e2d335b45e53 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:45.222007 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-03bcdd09-e98f-4cf5-baf0-f693c85329df tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c27994e138c42ffbe4d9151b776ae6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2164f4bcd424ffbace7a1baf85f36db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:45.237248 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-bb058f10-18f4-4e70-976b-eb2b7108ed66 req-fe53f4b9-2053-42a3-adb4-e2d335b45e53 service nova] Creating event network-vif-plugged:ce0d7a7c-9381-448c-a84f-9a9bd1cc6802 for instance e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 on n-h1-853682-5 Oct 18 15:51:45.238001 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-03bcdd09-e98f-4cf5-baf0-f693c85329df tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] 10.222.0.60 "GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793" status: 200 len: 1218 microversion: 2.1 time: 0.387566 Oct 18 15:51:45.238904 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2770/5520] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:44 2022] GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793 => generated 1218 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:45.265109 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0c3a0d70-e517-4d61-9bef-93acd68847e2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:45.275797 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0c3a0d70-e517-4d61-9bef-93acd68847e2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:45.280958 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-bb058f10-18f4-4e70-976b-eb2b7108ed66 req-fe53f4b9-2053-42a3-adb4-e2d335b45e53 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.226719 Oct 18 15:51:45.281833 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2751/5521] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:51:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:51:45.292644 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0c3a0d70-e517-4d61-9bef-93acd68847e2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:45.293459 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0c3a0d70-e517-4d61-9bef-93acd68847e2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:45.294069 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0c3a0d70-e517-4d61-9bef-93acd68847e2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:45.297725 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0c3a0d70-e517-4d61-9bef-93acd68847e2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:45.298212 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0c3a0d70-e517-4d61-9bef-93acd68847e2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:45.299324 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0c3a0d70-e517-4d61-9bef-93acd68847e2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:45.565774 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0c3a0d70-e517-4d61-9bef-93acd68847e2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:45.579528 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0c3a0d70-e517-4d61-9bef-93acd68847e2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6" status: 200 len: 1308 microversion: 2.1 time: 0.320569 Oct 18 15:51:45.580579 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2771/5522] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:45 2022] GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 => generated 1308 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:45.876695 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e7316b4b-9b66-4a3f-bbb9-c2495cd4dc5a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:45.878422 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e7316b4b-9b66-4a3f-bbb9-c2495cd4dc5a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:45.933835 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7316b4b-9b66-4a3f-bbb9-c2495cd4dc5a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:45.934605 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7316b4b-9b66-4a3f-bbb9-c2495cd4dc5a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:45.937217 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7316b4b-9b66-4a3f-bbb9-c2495cd4dc5a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:45.939885 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7316b4b-9b66-4a3f-bbb9-c2495cd4dc5a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:45.940569 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7316b4b-9b66-4a3f-bbb9-c2495cd4dc5a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:45.945596 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7316b4b-9b66-4a3f-bbb9-c2495cd4dc5a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:46.056711 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-569163a8-bbd3-40d8-ac1f-c4fb1a8628b0 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:46.057571 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-569163a8-bbd3-40d8-ac1f-c4fb1a8628b0 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: 61d72ac7-5fdd-4c9b-a36a-306accdb31e9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:46.068881 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-569163a8-bbd3-40d8-ac1f-c4fb1a8628b0 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:46.072013 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-569163a8-bbd3-40d8-ac1f-c4fb1a8628b0 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:46.073824 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-569163a8-bbd3-40d8-ac1f-c4fb1a8628b0 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:46.075090 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-569163a8-bbd3-40d8-ac1f-c4fb1a8628b0 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:46.075908 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-569163a8-bbd3-40d8-ac1f-c4fb1a8628b0 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:46.078158 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-569163a8-bbd3-40d8-ac1f-c4fb1a8628b0 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:46.122783 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e7316b4b-9b66-4a3f-bbb9-c2495cd4dc5a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:46.137209 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e7316b4b-9b66-4a3f-bbb9-c2495cd4dc5a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:46.145502 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e7316b4b-9b66-4a3f-bbb9-c2495cd4dc5a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:46.150077 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e7316b4b-9b66-4a3f-bbb9-c2495cd4dc5a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1652 microversion: 2.20 time: 0.279471 Oct 18 15:51:46.161784 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2752/5523] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:51:45 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1652 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:51:46.272037 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c016c4a9-5bc7-460b-954e-324b3b0d3728 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:46.272921 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c016c4a9-5bc7-460b-954e-324b3b0d3728 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] [instance: bfd97d9c-daf6-4503-8fd1-ae8750a24793] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:46.293043 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c016c4a9-5bc7-460b-954e-324b3b0d3728 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:46.298746 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c016c4a9-5bc7-460b-954e-324b3b0d3728 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:46.299299 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c016c4a9-5bc7-460b-954e-324b3b0d3728 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:46.304231 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c016c4a9-5bc7-460b-954e-324b3b0d3728 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:46.306911 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c016c4a9-5bc7-460b-954e-324b3b0d3728 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:46.307407 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c016c4a9-5bc7-460b-954e-324b3b0d3728 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:46.457163 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c016c4a9-5bc7-460b-954e-324b3b0d3728 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c27994e138c42ffbe4d9151b776ae6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2164f4bcd424ffbace7a1baf85f36db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:46.465615 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c016c4a9-5bc7-460b-954e-324b3b0d3728 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] 10.222.0.60 "GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793" status: 200 len: 1292 microversion: 2.1 time: 0.204004 Oct 18 15:51:46.472300 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2753/5524] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:46 2022] GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793 => generated 1292 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:46.491521 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-569163a8-bbd3-40d8-ac1f-c4fb1a8628b0 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:46.500514 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-569163a8-bbd3-40d8-ac1f-c4fb1a8628b0 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9" status: 200 len: 1504 microversion: 2.1 time: 0.448808 Oct 18 15:51:46.502142 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2772/5525] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:46 2022] GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9 => generated 1504 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:51:46.603254 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d790f995-44ef-4845-b0ba-e95d9dc963e9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:46.603891 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d790f995-44ef-4845-b0ba-e95d9dc963e9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:46.624168 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d790f995-44ef-4845-b0ba-e95d9dc963e9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:46.624672 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d790f995-44ef-4845-b0ba-e95d9dc963e9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:46.625319 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d790f995-44ef-4845-b0ba-e95d9dc963e9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:46.627110 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d790f995-44ef-4845-b0ba-e95d9dc963e9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:46.639600 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d790f995-44ef-4845-b0ba-e95d9dc963e9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:46.640374 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d790f995-44ef-4845-b0ba-e95d9dc963e9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:46.933214 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-d3ca4d99-78e9-4d95-95c6-7dff0523e96a req-2b41a4dd-60af-4229-b681-9d8edf399533 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b465248f-ab7a-4aba-b939-6f236eea166e", "name": "network-vif-deleted", "tag": "440cc1c1-492e-40b0-8244-adb2559e6c7f"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:51:46.951212 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-d3ca4d99-78e9-4d95-95c6-7dff0523e96a req-2b41a4dd-60af-4229-b681-9d8edf399533 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:46.956789 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-d3ca4d99-78e9-4d95-95c6-7dff0523e96a req-2b41a4dd-60af-4229-b681-9d8edf399533 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:46.957581 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-d3ca4d99-78e9-4d95-95c6-7dff0523e96a req-2b41a4dd-60af-4229-b681-9d8edf399533 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:46.996434 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-d3ca4d99-78e9-4d95-95c6-7dff0523e96a req-2b41a4dd-60af-4229-b681-9d8edf399533 service nova] Creating event network-vif-deleted:440cc1c1-492e-40b0-8244-adb2559e6c7f for instance b465248f-ab7a-4aba-b939-6f236eea166e on n-h2-853682-5 Oct 18 15:51:47.022275 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-d3ca4d99-78e9-4d95-95c6-7dff0523e96a req-2b41a4dd-60af-4229-b681-9d8edf399533 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093031 Oct 18 15:51:47.023201 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2773/5526] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:51:47.180834 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5f4c0480-848f-4914-bea3-7d9bd31e465b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:47.181544 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5f4c0480-848f-4914-bea3-7d9bd31e465b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:47.217213 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5f4c0480-848f-4914-bea3-7d9bd31e465b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:47.217213 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5f4c0480-848f-4914-bea3-7d9bd31e465b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:47.217213 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5f4c0480-848f-4914-bea3-7d9bd31e465b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:47.217213 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5f4c0480-848f-4914-bea3-7d9bd31e465b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:47.217213 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5f4c0480-848f-4914-bea3-7d9bd31e465b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:47.217213 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5f4c0480-848f-4914-bea3-7d9bd31e465b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:47.310586 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d790f995-44ef-4845-b0ba-e95d9dc963e9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:47.340439 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d790f995-44ef-4845-b0ba-e95d9dc963e9 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6" status: 200 len: 1308 microversion: 2.1 time: 0.740968 Oct 18 15:51:47.354706 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2754/5527] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:46 2022] GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 => generated 1308 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:47.363008 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5f4c0480-848f-4914-bea3-7d9bd31e465b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:47.366060 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5f4c0480-848f-4914-bea3-7d9bd31e465b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:47.370785 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5f4c0480-848f-4914-bea3-7d9bd31e465b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:47.371295 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-5f4c0480-848f-4914-bea3-7d9bd31e465b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lazy-loading 'fault' on Instance uuid b465248f-ab7a-4aba-b939-6f236eea166e {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:51:47.494124 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0c21c140-e336-41d2-a420-39e4954762c3 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:47.499304 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0c21c140-e336-41d2-a420-39e4954762c3 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] [instance: bfd97d9c-daf6-4503-8fd1-ae8750a24793] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:47.509201 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c21c140-e336-41d2-a420-39e4954762c3 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:47.509764 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c21c140-e336-41d2-a420-39e4954762c3 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:47.510219 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c21c140-e336-41d2-a420-39e4954762c3 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:47.513228 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c21c140-e336-41d2-a420-39e4954762c3 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:47.513751 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c21c140-e336-41d2-a420-39e4954762c3 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:47.517863 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c21c140-e336-41d2-a420-39e4954762c3 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:47.568332 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5f4c0480-848f-4914-bea3-7d9bd31e465b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:47.586614 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5f4c0480-848f-4914-bea3-7d9bd31e465b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:47.593260 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5f4c0480-848f-4914-bea3-7d9bd31e465b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:47.596407 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5f4c0480-848f-4914-bea3-7d9bd31e465b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 200 len: 1370 microversion: 2.20 time: 0.418911 Oct 18 15:51:47.617279 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2774/5528] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:51:47 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 1370 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:51:47.636125 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-cee50f93-0260-4f3d-bef7-4fe88c369647 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:47.641766 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-cee50f93-0260-4f3d-bef7-4fe88c369647 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: 61d72ac7-5fdd-4c9b-a36a-306accdb31e9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:47.661200 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cee50f93-0260-4f3d-bef7-4fe88c369647 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:47.666374 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cee50f93-0260-4f3d-bef7-4fe88c369647 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:47.667585 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cee50f93-0260-4f3d-bef7-4fe88c369647 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:47.672321 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cee50f93-0260-4f3d-bef7-4fe88c369647 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:47.673145 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cee50f93-0260-4f3d-bef7-4fe88c369647 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:47.673850 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cee50f93-0260-4f3d-bef7-4fe88c369647 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:47.712258 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0c21c140-e336-41d2-a420-39e4954762c3 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c27994e138c42ffbe4d9151b776ae6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2164f4bcd424ffbace7a1baf85f36db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:47.723734 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0c21c140-e336-41d2-a420-39e4954762c3 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] 10.222.0.60 "GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793" status: 200 len: 1280 microversion: 2.1 time: 0.237287 Oct 18 15:51:47.729175 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2755/5529] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:47 2022] GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793 => generated 1280 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:51:48.153266 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-cee50f93-0260-4f3d-bef7-4fe88c369647 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:48.162629 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-cee50f93-0260-4f3d-bef7-4fe88c369647 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9" status: 200 len: 1504 microversion: 2.1 time: 0.541635 Oct 18 15:51:48.163223 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2775/5530] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:47 2022] GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9 => generated 1504 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:48.379611 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-512a942a-75c0-4986-a3e2-7b52e59e6762 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:48.380432 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-512a942a-75c0-4986-a3e2-7b52e59e6762 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:48.391814 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-512a942a-75c0-4986-a3e2-7b52e59e6762 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:48.392363 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-512a942a-75c0-4986-a3e2-7b52e59e6762 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:48.392849 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-512a942a-75c0-4986-a3e2-7b52e59e6762 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:48.393629 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-512a942a-75c0-4986-a3e2-7b52e59e6762 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:48.394027 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-512a942a-75c0-4986-a3e2-7b52e59e6762 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:48.394448 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-512a942a-75c0-4986-a3e2-7b52e59e6762 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:48.632141 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6a5ae3ca-37c1-4c06-8e63-629b54d5dcb4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:48.633282 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6a5ae3ca-37c1-4c06-8e63-629b54d5dcb4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:48.669350 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6a5ae3ca-37c1-4c06-8e63-629b54d5dcb4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:48.670109 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6a5ae3ca-37c1-4c06-8e63-629b54d5dcb4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:48.671402 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6a5ae3ca-37c1-4c06-8e63-629b54d5dcb4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:48.674909 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6a5ae3ca-37c1-4c06-8e63-629b54d5dcb4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:48.675736 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6a5ae3ca-37c1-4c06-8e63-629b54d5dcb4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:48.676400 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6a5ae3ca-37c1-4c06-8e63-629b54d5dcb4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:48.714295 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-6a5ae3ca-37c1-4c06-8e63-629b54d5dcb4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] HTTP exception thrown: Instance b465248f-ab7a-4aba-b939-6f236eea166e could not be found. Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6a5ae3ca-37c1-4c06-8e63-629b54d5dcb4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Request method failure captured: Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e HTTP/1.1 Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsqYDHglXRrKKDfqs5wbB85aL1IgsbKNF1z6Sqn3ConJiRPpx0UNXPU9GBcVgVIVA6Cv0KVW_QZkVxEQzEhdvRXaHfIXystMZjHnbqDb3MGXqIMBIAb_BfqWpNNsmkNwvE0YKpE5VnVYMQHyS_V0VqjFt3xFH_oEjIPB2-nD9wOWCxY Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: X-Openstack-Nova-Api-Version: 2.20 Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 2e4cd8880d3b47ad9098b2097c0563a2 Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-778019649 Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2e4cd8880d3b47ad9098b2097c0563a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2e4cd8880d3b47ad9098b2097c0563a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2e4cd8880d3b47ad9098b2097c0563a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2e4cd8880d3b47ad9098b2097c0563a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-AttachVolumeShelveTestJSON-778019649 Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 2e4cd8880d3b47ad9098b2097c0563a2 Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-778019649 Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-AttachVolumeShelveTestJSON-778019649-project Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: e7f068c2e39541fb8d82265702a3179a Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-AttachVolumeShelveTestJSON-778019649-project Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance b465248f-ab7a-4aba-b939-6f236eea166e could not be found. Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'b465248f-ab7a-4aba-b939-6f236eea166e'} Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b465248f-ab7a-4aba-b939-6f236eea166e could not be found. Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b465248f-ab7a-4aba-b939-6f236eea166e could not be found. Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:51:48.716161 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:51:48.725908 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:51:48.725908 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:51:48.725908 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:51:48.725908 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:51:48.725908 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:51:48.725908 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:51:48.725908 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b465248f-ab7a-4aba-b939-6f236eea166e could not be found. Oct 18 15:51:48.725908 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:51:48.728599 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6a5ae3ca-37c1-4c06-8e63-629b54d5dcb4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Returning 404 to user: Instance b465248f-ab7a-4aba-b939-6f236eea166e could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:51:48.729950 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6a5ae3ca-37c1-4c06-8e63-629b54d5dcb4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 404 len: 111 microversion: 2.20 time: 0.102275 Oct 18 15:51:48.731198 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2776/5531] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:51:48 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:51:48.741470 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6abfe3cb-261e-4a86-8b40-68fa03b22b87 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '.version_select at 0x7f7c4166c550>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:48.775845 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6abfe3cb-261e-4a86-8b40-68fa03b22b87 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-305544900" status: 204 len: 0 microversion: 2.20 time: 0.039603 Oct 18 15:51:48.778543 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2777/5532] 10.222.0.60 () {60 vars in 1259 bytes} [Tue Oct 18 15:51:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-305544900 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 15:51:48.789373 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-df00b079-e90c-4b38-8985-df9d01e8d4d9 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:48.794156 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-df00b079-e90c-4b38-8985-df9d01e8d4d9 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] [instance: bfd97d9c-daf6-4503-8fd1-ae8750a24793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:48.819482 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-df00b079-e90c-4b38-8985-df9d01e8d4d9 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:48.819968 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-df00b079-e90c-4b38-8985-df9d01e8d4d9 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:48.821313 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-df00b079-e90c-4b38-8985-df9d01e8d4d9 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:48.822500 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-df00b079-e90c-4b38-8985-df9d01e8d4d9 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:48.825187 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-df00b079-e90c-4b38-8985-df9d01e8d4d9 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:48.826229 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-df00b079-e90c-4b38-8985-df9d01e8d4d9 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:48.902655 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-512a942a-75c0-4986-a3e2-7b52e59e6762 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:48.926549 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-512a942a-75c0-4986-a3e2-7b52e59e6762 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6" status: 200 len: 1488 microversion: 2.1 time: 0.544252 Oct 18 15:51:48.927263 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2756/5533] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:48 2022] GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 => generated 1488 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:48.953101 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c27756e3-745a-4d0d-a47e-b9569add4db0 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-2132307552"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:51:48.964418 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c27756e3-745a-4d0d-a47e-b9569add4db0 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:49.013688 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c27756e3-745a-4d0d-a47e-b9569add4db0 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:49.014754 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c27756e3-745a-4d0d-a47e-b9569add4db0 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:49.015325 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c27756e3-745a-4d0d-a47e-b9569add4db0 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:49.021443 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c27756e3-745a-4d0d-a47e-b9569add4db0 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:49.021443 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c27756e3-745a-4d0d-a47e-b9569add4db0 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:49.021443 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c27756e3-745a-4d0d-a47e-b9569add4db0 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:49.060195 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:51:49.098975 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-df00b079-e90c-4b38-8985-df9d01e8d4d9 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c27994e138c42ffbe4d9151b776ae6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2164f4bcd424ffbace7a1baf85f36db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:49.116954 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-df00b079-e90c-4b38-8985-df9d01e8d4d9 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] 10.222.0.60 "GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793" status: 200 len: 1322 microversion: 2.1 time: 0.331747 Oct 18 15:51:49.120129 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2778/5534] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:48 2022] GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793 => generated 1322 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:49.172071 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c27756e3-745a-4d0d-a47e-b9569add4db0 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "PUT /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6" status: 200 len: 1074 microversion: 2.1 time: 0.225955 Oct 18 15:51:49.177858 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2757/5535] 10.222.0.60 () {60 vars in 1256 bytes} [Tue Oct 18 15:51:48 2022] PUT /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 => generated 1074 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:49.190652 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bba7f410-79a1-4b09-b79e-772e751dbdb7 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:49.191888 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-bba7f410-79a1-4b09-b79e-772e751dbdb7 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: 61d72ac7-5fdd-4c9b-a36a-306accdb31e9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:49.197635 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b978098a-811b-4776-b75b-a387b4a006a8 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:49.198264 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b978098a-811b-4776-b75b-a387b4a006a8 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:49.202740 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bba7f410-79a1-4b09-b79e-772e751dbdb7 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:49.205347 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bba7f410-79a1-4b09-b79e-772e751dbdb7 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:49.208495 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bba7f410-79a1-4b09-b79e-772e751dbdb7 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:49.210277 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bba7f410-79a1-4b09-b79e-772e751dbdb7 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:49.210915 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bba7f410-79a1-4b09-b79e-772e751dbdb7 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:49.212401 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bba7f410-79a1-4b09-b79e-772e751dbdb7 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:49.215993 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b978098a-811b-4776-b75b-a387b4a006a8 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:49.216500 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b978098a-811b-4776-b75b-a387b4a006a8 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:49.216984 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b978098a-811b-4776-b75b-a387b4a006a8 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:49.218271 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b978098a-811b-4776-b75b-a387b4a006a8 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:49.218901 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b978098a-811b-4776-b75b-a387b4a006a8 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:49.219163 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b978098a-811b-4776-b75b-a387b4a006a8 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:49.254803 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=100 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:51:49.623049 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-bba7f410-79a1-4b09-b79e-772e751dbdb7 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:49.639187 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-bba7f410-79a1-4b09-b79e-772e751dbdb7 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9" status: 200 len: 1504 microversion: 2.1 time: 0.451621 Oct 18 15:51:49.642791 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2779/5536] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:49 2022] GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9 => generated 1504 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:49.685028 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b978098a-811b-4776-b75b-a387b4a006a8 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:49.697143 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b978098a-811b-4776-b75b-a387b4a006a8 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6" status: 200 len: 1500 microversion: 2.1 time: 0.504180 Oct 18 15:51:49.697738 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2758/5537] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:49 2022] GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 => generated 1500 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:51:49.726713 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d6a77eb4-125e-40d4-aad3-865cd1db0353 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:49.729069 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d6a77eb4-125e-40d4-aad3-865cd1db0353 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:49.747057 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d6a77eb4-125e-40d4-aad3-865cd1db0353 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:49.747689 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d6a77eb4-125e-40d4-aad3-865cd1db0353 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:49.750878 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d6a77eb4-125e-40d4-aad3-865cd1db0353 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:49.753622 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d6a77eb4-125e-40d4-aad3-865cd1db0353 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:49.755280 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d6a77eb4-125e-40d4-aad3-865cd1db0353 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:49.756891 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d6a77eb4-125e-40d4-aad3-865cd1db0353 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:50.140621 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-754b0e77-da37-4a78-aa5c-c14741866523 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:50.142265 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-754b0e77-da37-4a78-aa5c-c14741866523 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] [instance: bfd97d9c-daf6-4503-8fd1-ae8750a24793] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:50.150684 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-754b0e77-da37-4a78-aa5c-c14741866523 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:50.152231 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-754b0e77-da37-4a78-aa5c-c14741866523 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:50.152787 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-754b0e77-da37-4a78-aa5c-c14741866523 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:50.153732 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-754b0e77-da37-4a78-aa5c-c14741866523 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:50.154461 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-754b0e77-da37-4a78-aa5c-c14741866523 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:50.155602 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-754b0e77-da37-4a78-aa5c-c14741866523 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:50.338991 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d6a77eb4-125e-40d4-aad3-865cd1db0353 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:50.355738 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d6a77eb4-125e-40d4-aad3-865cd1db0353 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6" status: 200 len: 1500 microversion: 2.1 time: 0.638126 Oct 18 15:51:50.373943 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2780/5538] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:49 2022] GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 => generated 1500 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:50.388006 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f2435337-717c-4a46-8d2a-4910cd60b2b5 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:51:50.419808 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f2435337-717c-4a46-8d2a-4910cd60b2b5 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:50.423993 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f2435337-717c-4a46-8d2a-4910cd60b2b5 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:50.425012 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f2435337-717c-4a46-8d2a-4910cd60b2b5 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:50.492226 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f2435337-717c-4a46-8d2a-4910cd60b2b5 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6] Going to try to stop instance {{(pid=120405) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 18 15:51:50.500726 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-754b0e77-da37-4a78-aa5c-c14741866523 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c27994e138c42ffbe4d9151b776ae6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2164f4bcd424ffbace7a1baf85f36db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:50.509533 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-754b0e77-da37-4a78-aa5c-c14741866523 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] 10.222.0.60 "GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793" status: 200 len: 1322 microversion: 2.1 time: 0.373867 Oct 18 15:51:50.510739 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2759/5539] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:50 2022] GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793 => generated 1322 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:51:50.586543 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f2435337-717c-4a46-8d2a-4910cd60b2b5 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "POST /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6/action" status: 202 len: 0 microversion: 2.1 time: 0.209747 Oct 18 15:51:50.587482 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2781/5540] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:51:50 2022] POST /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:51:50.595600 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ed761e47-b40e-4c1e-b545-347731f555d2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:50.596224 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ed761e47-b40e-4c1e-b545-347731f555d2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:50.598568 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:51:50.611410 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed761e47-b40e-4c1e-b545-347731f555d2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:50.612480 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed761e47-b40e-4c1e-b545-347731f555d2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:50.613122 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed761e47-b40e-4c1e-b545-347731f555d2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:50.616249 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed761e47-b40e-4c1e-b545-347731f555d2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:50.616975 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed761e47-b40e-4c1e-b545-347731f555d2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:50.621914 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed761e47-b40e-4c1e-b545-347731f555d2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:50.671996 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a1710b68-4710-4efd-92cb-ffdc78638664 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:50.673743 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a1710b68-4710-4efd-92cb-ffdc78638664 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: 61d72ac7-5fdd-4c9b-a36a-306accdb31e9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:50.690390 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a1710b68-4710-4efd-92cb-ffdc78638664 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:50.694131 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a1710b68-4710-4efd-92cb-ffdc78638664 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:50.695634 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a1710b68-4710-4efd-92cb-ffdc78638664 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:50.696598 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a1710b68-4710-4efd-92cb-ffdc78638664 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:50.699917 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a1710b68-4710-4efd-92cb-ffdc78638664 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:50.702399 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a1710b68-4710-4efd-92cb-ffdc78638664 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:51.066788 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a1710b68-4710-4efd-92cb-ffdc78638664 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:51.079794 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a1710b68-4710-4efd-92cb-ffdc78638664 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9" status: 200 len: 1504 microversion: 2.1 time: 0.413308 Oct 18 15:51:51.082048 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2782/5541] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:50 2022] GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9 => generated 1504 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:51:51.179836 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ed761e47-b40e-4c1e-b545-347731f555d2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:51.199727 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ed761e47-b40e-4c1e-b545-347731f555d2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6" status: 200 len: 1510 microversion: 2.1 time: 0.608094 Oct 18 15:51:51.201034 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2760/5542] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:50 2022] GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 => generated 1510 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:51.221439 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-809cd50a-0f4d-400d-97bc-b2b1eefca9b3 req-e3dafc38-f316-4e0e-9ed5-0287d3e2ba0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfd97d9c-daf6-4503-8fd1-ae8750a24793", "tag": "d953661c-7e35-4446-9f77-70c196bc52ed"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:51:51.246900 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-809cd50a-0f4d-400d-97bc-b2b1eefca9b3 req-e3dafc38-f316-4e0e-9ed5-0287d3e2ba0d service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:51.248051 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-809cd50a-0f4d-400d-97bc-b2b1eefca9b3 req-e3dafc38-f316-4e0e-9ed5-0287d3e2ba0d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:51.248747 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-809cd50a-0f4d-400d-97bc-b2b1eefca9b3 req-e3dafc38-f316-4e0e-9ed5-0287d3e2ba0d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:51.276394 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-809cd50a-0f4d-400d-97bc-b2b1eefca9b3 req-e3dafc38-f316-4e0e-9ed5-0287d3e2ba0d service nova] Creating event network-changed:d953661c-7e35-4446-9f77-70c196bc52ed for instance bfd97d9c-daf6-4503-8fd1-ae8750a24793 on n-h1-853682-5 Oct 18 15:51:51.290896 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-809cd50a-0f4d-400d-97bc-b2b1eefca9b3 req-e3dafc38-f316-4e0e-9ed5-0287d3e2ba0d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078063 Oct 18 15:51:51.291864 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2783/5543] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:51:51.504389 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3cac191c-aa31-4806-bf5c-227ab4e5c899 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Action: 'create', calling method: .version_select at 0x7f7c3c723b80>, body: {"keypair": {"name": "tempest-keypair-1331664841", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnarr3nQe8svHgq4WGOawd/zOCsITdPw5+C24v299V7Nhm5L8HLHw31MhZE85akZnFFFqqeP/5iTm92R2mvztTGPUwZ+M7LUTC7FK4AJPAq6sttLUKYrk0wDtTtW+Mldg=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:51:51.523950 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-3cac191c-aa31-4806-bf5c-227ab4e5c899 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Getting quotas for project 2e4cd8880d3b47ad9098b2097c0563a2. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:51:51.535953 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7ba4d9eb-3e04-4853-af3e-defe8818721f tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:51.538290 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7ba4d9eb-3e04-4853-af3e-defe8818721f tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] [instance: bfd97d9c-daf6-4503-8fd1-ae8750a24793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:51.550696 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-3cac191c-aa31-4806-bf5c-227ab4e5c899 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Getting quotas for user e7f068c2e39541fb8d82265702a3179a and project 2e4cd8880d3b47ad9098b2097c0563a2. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:51:51.552532 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7ba4d9eb-3e04-4853-af3e-defe8818721f tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:51.554774 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7ba4d9eb-3e04-4853-af3e-defe8818721f tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:51.559822 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7ba4d9eb-3e04-4853-af3e-defe8818721f tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:51.564424 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7ba4d9eb-3e04-4853-af3e-defe8818721f tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:51.566504 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7ba4d9eb-3e04-4853-af3e-defe8818721f tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:51.567628 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7ba4d9eb-3e04-4853-af3e-defe8818721f tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:51.621047 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3cac191c-aa31-4806-bf5c-227ab4e5c899 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.121803 Oct 18 15:51:51.621930 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2761/5544] 10.222.0.60 () {62 vars in 1200 bytes} [Tue Oct 18 15:51:51 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 123 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 18 15:51:51.842466 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7ba4d9eb-3e04-4853-af3e-defe8818721f tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c27994e138c42ffbe4d9151b776ae6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2164f4bcd424ffbace7a1baf85f36db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:51.855976 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7ba4d9eb-3e04-4853-af3e-defe8818721f tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] 10.222.0.60 "GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793" status: 200 len: 1322 microversion: 2.1 time: 0.326217 Oct 18 15:51:51.857058 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2784/5545] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:51 2022] GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793 => generated 1322 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:51:52.106513 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f97f2e5d-71cd-4d6b-871f-ae7ca421c680 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:52.107366 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f97f2e5d-71cd-4d6b-871f-ae7ca421c680 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: 61d72ac7-5fdd-4c9b-a36a-306accdb31e9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:52.118042 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f97f2e5d-71cd-4d6b-871f-ae7ca421c680 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:52.123025 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f97f2e5d-71cd-4d6b-871f-ae7ca421c680 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:52.124250 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f97f2e5d-71cd-4d6b-871f-ae7ca421c680 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:52.125224 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f97f2e5d-71cd-4d6b-871f-ae7ca421c680 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:52.125693 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f97f2e5d-71cd-4d6b-871f-ae7ca421c680 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:52.126225 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f97f2e5d-71cd-4d6b-871f-ae7ca421c680 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:52.226886 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d3a298e3-1f39-4ee0-a591-eb5379d4af4d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:52.229125 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d3a298e3-1f39-4ee0-a591-eb5379d4af4d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:52.237532 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d3a298e3-1f39-4ee0-a591-eb5379d4af4d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:52.238739 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d3a298e3-1f39-4ee0-a591-eb5379d4af4d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:52.239446 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d3a298e3-1f39-4ee0-a591-eb5379d4af4d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:52.240509 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d3a298e3-1f39-4ee0-a591-eb5379d4af4d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:52.241291 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d3a298e3-1f39-4ee0-a591-eb5379d4af4d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:52.242016 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d3a298e3-1f39-4ee0-a591-eb5379d4af4d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:52.999438 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f97f2e5d-71cd-4d6b-871f-ae7ca421c680 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:53.015065 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f97f2e5d-71cd-4d6b-871f-ae7ca421c680 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9" status: 200 len: 1504 microversion: 2.1 time: 0.912211 Oct 18 15:51:53.015730 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2762/5546] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:52 2022] GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9 => generated 1504 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:53.042198 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-54847222-f11c-4f17-b5c2-c025c156dcae tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:53.042819 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-54847222-f11c-4f17-b5c2-c025c156dcae tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] [instance: bfd97d9c-daf6-4503-8fd1-ae8750a24793] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:53.051382 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d3a298e3-1f39-4ee0-a591-eb5379d4af4d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:53.060471 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d3a298e3-1f39-4ee0-a591-eb5379d4af4d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6" status: 200 len: 1510 microversion: 2.1 time: 0.838280 Oct 18 15:51:53.064117 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54847222-f11c-4f17-b5c2-c025c156dcae tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:53.064799 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2785/5547] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:52 2022] GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 => generated 1510 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:51:53.065283 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54847222-f11c-4f17-b5c2-c025c156dcae tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:53.065890 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54847222-f11c-4f17-b5c2-c025c156dcae tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:53.066834 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54847222-f11c-4f17-b5c2-c025c156dcae tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:53.067523 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54847222-f11c-4f17-b5c2-c025c156dcae tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:53.068370 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54847222-f11c-4f17-b5c2-c025c156dcae tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:53.305718 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-54847222-f11c-4f17-b5c2-c025c156dcae tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c27994e138c42ffbe4d9151b776ae6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2164f4bcd424ffbace7a1baf85f36db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:53.318947 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-54847222-f11c-4f17-b5c2-c025c156dcae tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] 10.222.0.60 "GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793" status: 200 len: 1322 microversion: 2.1 time: 0.284072 Oct 18 15:51:53.321210 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2763/5548] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:53 2022] GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793 => generated 1322 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:54.039010 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a8947fc4-c4e3-477b-8683-3cfceb970527 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:54.039637 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a8947fc4-c4e3-477b-8683-3cfceb970527 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: 61d72ac7-5fdd-4c9b-a36a-306accdb31e9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:54.041716 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:51:54.042864 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=8 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:51:54.062838 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a8947fc4-c4e3-477b-8683-3cfceb970527 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:54.064007 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a8947fc4-c4e3-477b-8683-3cfceb970527 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:54.064635 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a8947fc4-c4e3-477b-8683-3cfceb970527 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:54.065533 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a8947fc4-c4e3-477b-8683-3cfceb970527 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:54.066145 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a8947fc4-c4e3-477b-8683-3cfceb970527 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:54.066944 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a8947fc4-c4e3-477b-8683-3cfceb970527 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:54.088386 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-30189620-1e5b-46db-bef4-3ec644e3f6c0 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:54.089146 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-30189620-1e5b-46db-bef4-3ec644e3f6c0 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:54.098856 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30189620-1e5b-46db-bef4-3ec644e3f6c0 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:54.101420 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30189620-1e5b-46db-bef4-3ec644e3f6c0 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:54.103195 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30189620-1e5b-46db-bef4-3ec644e3f6c0 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:54.104529 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30189620-1e5b-46db-bef4-3ec644e3f6c0 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:54.104529 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30189620-1e5b-46db-bef4-3ec644e3f6c0 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:54.111890 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30189620-1e5b-46db-bef4-3ec644e3f6c0 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:54.416665 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a8947fc4-c4e3-477b-8683-3cfceb970527 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:54.426337 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-30189620-1e5b-46db-bef4-3ec644e3f6c0 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:54.427991 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a8947fc4-c4e3-477b-8683-3cfceb970527 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9" status: 200 len: 1504 microversion: 2.1 time: 0.392751 Oct 18 15:51:54.442886 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-30189620-1e5b-46db-bef4-3ec644e3f6c0 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6" status: 200 len: 1510 microversion: 2.1 time: 0.357277 Oct 18 15:51:54.446889 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2786/5549] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:54 2022] GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9 => generated 1504 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:54.450685 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2764/5550] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:54 2022] GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 => generated 1510 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:51:54.458743 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-aedca986-d923-4b2f-87d7-bd94d0454e20 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-110539646", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b620f396-c013-4ed8-97b8-413293fcbd43"}], "security_groups": [{"name": "tempest-securitygroup--1088762916"}], "key_name": "tempest-keypair-1331664841", "user_data": "}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:51:54.464478 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-26a6b78e-49f5-439b-bf60-d506c31a484b tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:54.466599 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-26a6b78e-49f5-439b-bf60-d506c31a484b tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] [instance: bfd97d9c-daf6-4503-8fd1-ae8750a24793] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:54.486749 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26a6b78e-49f5-439b-bf60-d506c31a484b tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:54.487516 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26a6b78e-49f5-439b-bf60-d506c31a484b tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:54.488114 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26a6b78e-49f5-439b-bf60-d506c31a484b tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:54.489600 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26a6b78e-49f5-439b-bf60-d506c31a484b tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:54.494177 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26a6b78e-49f5-439b-bf60-d506c31a484b tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:54.494818 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26a6b78e-49f5-439b-bf60-d506c31a484b tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:54.513935 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:51:54.710832 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-aedca986-d923-4b2f-87d7-bd94d0454e20 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] validate_networks() for [('b620f396-c013-4ed8-97b8-413293fcbd43', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:51:54.745351 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-26a6b78e-49f5-439b-bf60-d506c31a484b tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c27994e138c42ffbe4d9151b776ae6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2164f4bcd424ffbace7a1baf85f36db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:54.768458 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-26a6b78e-49f5-439b-bf60-d506c31a484b tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] 10.222.0.60 "GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793" status: 200 len: 1322 microversion: 2.1 time: 0.316481 Oct 18 15:51:54.770654 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2765/5551] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:54 2022] GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793 => generated 1322 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:55.455138 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d74322c7-b509-4c95-84bb-168279f01d3a tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:55.456691 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d74322c7-b509-4c95-84bb-168279f01d3a tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: 61d72ac7-5fdd-4c9b-a36a-306accdb31e9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:55.469326 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d74322c7-b509-4c95-84bb-168279f01d3a tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:55.470408 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d74322c7-b509-4c95-84bb-168279f01d3a tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:55.471005 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d74322c7-b509-4c95-84bb-168279f01d3a tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:55.471892 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d74322c7-b509-4c95-84bb-168279f01d3a tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:55.472500 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d74322c7-b509-4c95-84bb-168279f01d3a tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:55.473437 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d74322c7-b509-4c95-84bb-168279f01d3a tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:55.611564 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-aedca986-d923-4b2f-87d7-bd94d0454e20 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:51:55.612093 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-aedca986-d923-4b2f-87d7-bd94d0454e20 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:51:55.612464 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-aedca986-d923-4b2f-87d7-bd94d0454e20 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:51:55.613054 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-aedca986-d923-4b2f-87d7-bd94d0454e20 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:51:55.613547 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-aedca986-d923-4b2f-87d7-bd94d0454e20 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:51:55.626635 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aedca986-d923-4b2f-87d7-bd94d0454e20 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:55.627418 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aedca986-d923-4b2f-87d7-bd94d0454e20 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:55.628016 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aedca986-d923-4b2f-87d7-bd94d0454e20 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:55.628941 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aedca986-d923-4b2f-87d7-bd94d0454e20 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:55.629918 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aedca986-d923-4b2f-87d7-bd94d0454e20 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:55.630603 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aedca986-d923-4b2f-87d7-bd94d0454e20 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:55.654993 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-aedca986-d923-4b2f-87d7-bd94d0454e20 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Getting quotas for project 2e4cd8880d3b47ad9098b2097c0563a2. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:51:55.662336 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-aedca986-d923-4b2f-87d7-bd94d0454e20 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Getting quotas for user e7f068c2e39541fb8d82265702a3179a and project 2e4cd8880d3b47ad9098b2097c0563a2. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:51:55.678463 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-aedca986-d923-4b2f-87d7-bd94d0454e20 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:51:55.698593 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-aedca986-d923-4b2f-87d7-bd94d0454e20 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:51:55.747634 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d74322c7-b509-4c95-84bb-168279f01d3a tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:55.765494 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d74322c7-b509-4c95-84bb-168279f01d3a tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9" status: 200 len: 1504 microversion: 2.1 time: 0.314761 Oct 18 15:51:55.772881 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2766/5552] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:55 2022] GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9 => generated 1504 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:51:55.791425 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d9067c3d-7494-463f-8c39-b45ca652312b tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:55.794000 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d9067c3d-7494-463f-8c39-b45ca652312b tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:55.804702 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-aedca986-d923-4b2f-87d7-bd94d0454e20 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.356073 Oct 18 15:51:55.805715 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2787/5553] 10.222.0.60 () {62 vars in 1188 bytes} [Tue Oct 18 15:51:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 1358 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 18 15:51:55.816780 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8bf5817c-74a2-47f6-87f5-07d12e1e44b4 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:55.818053 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8bf5817c-74a2-47f6-87f5-07d12e1e44b4 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] [instance: bfd97d9c-daf6-4503-8fd1-ae8750a24793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:55.827192 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8bf5817c-74a2-47f6-87f5-07d12e1e44b4 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:55.828104 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8bf5817c-74a2-47f6-87f5-07d12e1e44b4 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:55.830996 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8bf5817c-74a2-47f6-87f5-07d12e1e44b4 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:55.832148 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8bf5817c-74a2-47f6-87f5-07d12e1e44b4 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:55.833064 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8bf5817c-74a2-47f6-87f5-07d12e1e44b4 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:55.836133 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8bf5817c-74a2-47f6-87f5-07d12e1e44b4 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:55.880587 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d9067c3d-7494-463f-8c39-b45ca652312b tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:55.881482 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d9067c3d-7494-463f-8c39-b45ca652312b tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:55.881936 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d9067c3d-7494-463f-8c39-b45ca652312b tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:55.882656 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d9067c3d-7494-463f-8c39-b45ca652312b tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:55.883116 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d9067c3d-7494-463f-8c39-b45ca652312b tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:55.883544 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d9067c3d-7494-463f-8c39-b45ca652312b tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:56.382964 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8bf5817c-74a2-47f6-87f5-07d12e1e44b4 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c27994e138c42ffbe4d9151b776ae6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2164f4bcd424ffbace7a1baf85f36db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:56.394662 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8bf5817c-74a2-47f6-87f5-07d12e1e44b4 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] 10.222.0.60 "GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793" status: 200 len: 1322 microversion: 2.1 time: 0.587217 Oct 18 15:51:56.395566 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2788/5554] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:55 2022] GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793 => generated 1322 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:56.406199 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1b572bc8-4c3d-48f5-a217-dbcb9cdfba19 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:56.408404 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1b572bc8-4c3d-48f5-a217-dbcb9cdfba19 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:56.444785 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d9067c3d-7494-463f-8c39-b45ca652312b tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:56.458556 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d9067c3d-7494-463f-8c39-b45ca652312b tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6" status: 200 len: 1510 microversion: 2.1 time: 0.683898 Oct 18 15:51:56.464183 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2767/5555] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:55 2022] GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 => generated 1510 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:56.528889 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1b572bc8-4c3d-48f5-a217-dbcb9cdfba19 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:56.542227 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1b572bc8-4c3d-48f5-a217-dbcb9cdfba19 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:56.546906 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1b572bc8-4c3d-48f5-a217-dbcb9cdfba19 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:56.548874 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1b572bc8-4c3d-48f5-a217-dbcb9cdfba19 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1281 microversion: 2.20 time: 0.151351 Oct 18 15:51:56.550181 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2789/5556] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:51:56 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1281 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:51:56.799830 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-74022c8c-88bc-4cb1-bca7-357dcfbc91e2 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:56.802025 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-74022c8c-88bc-4cb1-bca7-357dcfbc91e2 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: 61d72ac7-5fdd-4c9b-a36a-306accdb31e9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:56.824454 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-74022c8c-88bc-4cb1-bca7-357dcfbc91e2 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:56.828042 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-74022c8c-88bc-4cb1-bca7-357dcfbc91e2 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:56.829780 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-74022c8c-88bc-4cb1-bca7-357dcfbc91e2 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:56.829984 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-74022c8c-88bc-4cb1-bca7-357dcfbc91e2 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:56.835558 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-74022c8c-88bc-4cb1-bca7-357dcfbc91e2 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:56.836020 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-74022c8c-88bc-4cb1-bca7-357dcfbc91e2 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:57.169164 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-74022c8c-88bc-4cb1-bca7-357dcfbc91e2 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:57.178993 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-74022c8c-88bc-4cb1-bca7-357dcfbc91e2 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9" status: 200 len: 1504 microversion: 2.1 time: 0.387236 Oct 18 15:51:57.215223 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2768/5557] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:56 2022] GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9 => generated 1504 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:57.424164 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0b825118-a5ea-4619-99c3-8ee6e4ef9446 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:57.425944 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0b825118-a5ea-4619-99c3-8ee6e4ef9446 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] [instance: bfd97d9c-daf6-4503-8fd1-ae8750a24793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:57.465111 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0b825118-a5ea-4619-99c3-8ee6e4ef9446 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:57.468119 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0b825118-a5ea-4619-99c3-8ee6e4ef9446 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:57.469586 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0b825118-a5ea-4619-99c3-8ee6e4ef9446 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:57.470725 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0b825118-a5ea-4619-99c3-8ee6e4ef9446 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:57.472166 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0b825118-a5ea-4619-99c3-8ee6e4ef9446 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:57.474093 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0b825118-a5ea-4619-99c3-8ee6e4ef9446 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:57.486855 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3aa8394f-0345-4c66-a0e7-51745ac56ad1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:57.488610 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3aa8394f-0345-4c66-a0e7-51745ac56ad1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:57.505762 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3aa8394f-0345-4c66-a0e7-51745ac56ad1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:57.512035 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3aa8394f-0345-4c66-a0e7-51745ac56ad1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:57.514983 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3aa8394f-0345-4c66-a0e7-51745ac56ad1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:57.522275 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3aa8394f-0345-4c66-a0e7-51745ac56ad1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:57.523216 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3aa8394f-0345-4c66-a0e7-51745ac56ad1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:57.523921 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3aa8394f-0345-4c66-a0e7-51745ac56ad1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:58.182825 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0b825118-a5ea-4619-99c3-8ee6e4ef9446 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c27994e138c42ffbe4d9151b776ae6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2164f4bcd424ffbace7a1baf85f36db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:58.197168 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0b825118-a5ea-4619-99c3-8ee6e4ef9446 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] 10.222.0.60 "GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793" status: 200 len: 1322 microversion: 2.1 time: 0.779671 Oct 18 15:51:58.202676 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2790/5558] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:57 2022] GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793 => generated 1322 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:58.215338 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2d5e1215-1d01-4d1a-8fd7-da3f90d32fff tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:58.216234 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2d5e1215-1d01-4d1a-8fd7-da3f90d32fff tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:58.230209 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d5e1215-1d01-4d1a-8fd7-da3f90d32fff tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:58.231678 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d5e1215-1d01-4d1a-8fd7-da3f90d32fff tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:58.233467 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d5e1215-1d01-4d1a-8fd7-da3f90d32fff tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:58.235493 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d5e1215-1d01-4d1a-8fd7-da3f90d32fff tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:58.236450 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d5e1215-1d01-4d1a-8fd7-da3f90d32fff tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:58.237493 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d5e1215-1d01-4d1a-8fd7-da3f90d32fff tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:58.255025 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3aa8394f-0345-4c66-a0e7-51745ac56ad1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:58.271581 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3aa8394f-0345-4c66-a0e7-51745ac56ad1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6" status: 200 len: 1510 microversion: 2.1 time: 0.792530 Oct 18 15:51:58.272177 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2769/5559] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:57 2022] GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 => generated 1510 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:51:58.289350 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eff1a929-8473-482b-bbc9-d88f784b8d16 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:58.290137 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-eff1a929-8473-482b-bbc9-d88f784b8d16 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: 61d72ac7-5fdd-4c9b-a36a-306accdb31e9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:58.296969 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eff1a929-8473-482b-bbc9-d88f784b8d16 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:58.304874 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eff1a929-8473-482b-bbc9-d88f784b8d16 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:58.305337 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eff1a929-8473-482b-bbc9-d88f784b8d16 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:58.306081 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eff1a929-8473-482b-bbc9-d88f784b8d16 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:58.306543 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eff1a929-8473-482b-bbc9-d88f784b8d16 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:58.306973 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eff1a929-8473-482b-bbc9-d88f784b8d16 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:58.424454 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2d5e1215-1d01-4d1a-8fd7-da3f90d32fff tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:58.440491 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2d5e1215-1d01-4d1a-8fd7-da3f90d32fff tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:58.444557 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2d5e1215-1d01-4d1a-8fd7-da3f90d32fff tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:58.447218 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2d5e1215-1d01-4d1a-8fd7-da3f90d32fff tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1339 microversion: 2.20 time: 0.243213 Oct 18 15:51:58.468419 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2791/5560] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:51:58 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1339 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:51:58.577372 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-eff1a929-8473-482b-bbc9-d88f784b8d16 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:58.605785 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-eff1a929-8473-482b-bbc9-d88f784b8d16 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9" status: 200 len: 1504 microversion: 2.1 time: 0.331835 Oct 18 15:51:58.607306 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2770/5561] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:58 2022] GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9 => generated 1504 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:51:59.221037 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-09a921c5-a067-42f5-917e-c30424d4f4e6 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:59.221660 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-09a921c5-a067-42f5-917e-c30424d4f4e6 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] [instance: bfd97d9c-daf6-4503-8fd1-ae8750a24793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:59.240402 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09a921c5-a067-42f5-917e-c30424d4f4e6 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:59.241290 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09a921c5-a067-42f5-917e-c30424d4f4e6 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:59.242004 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09a921c5-a067-42f5-917e-c30424d4f4e6 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:59.242946 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09a921c5-a067-42f5-917e-c30424d4f4e6 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:59.243621 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09a921c5-a067-42f5-917e-c30424d4f4e6 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:59.244285 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09a921c5-a067-42f5-917e-c30424d4f4e6 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:59.302400 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f32d1c6a-ad1d-4510-a416-6e77fca8fffb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:59.303367 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f32d1c6a-ad1d-4510-a416-6e77fca8fffb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:59.317028 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f32d1c6a-ad1d-4510-a416-6e77fca8fffb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:59.318134 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f32d1c6a-ad1d-4510-a416-6e77fca8fffb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:59.318799 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f32d1c6a-ad1d-4510-a416-6e77fca8fffb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:59.319752 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f32d1c6a-ad1d-4510-a416-6e77fca8fffb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:59.320426 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f32d1c6a-ad1d-4510-a416-6e77fca8fffb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:59.321092 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f32d1c6a-ad1d-4510-a416-6e77fca8fffb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:59.629170 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-09a921c5-a067-42f5-917e-c30424d4f4e6 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c27994e138c42ffbe4d9151b776ae6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2164f4bcd424ffbace7a1baf85f36db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:59.646315 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-09a921c5-a067-42f5-917e-c30424d4f4e6 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] 10.222.0.60 "GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793" status: 200 len: 1322 microversion: 2.1 time: 0.429642 Oct 18 15:51:59.646921 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2792/5562] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:59 2022] GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793 => generated 1322 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:51:59.667339 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f32d1c6a-ad1d-4510-a416-6e77fca8fffb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:51:59.671440 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c777c313-d036-46a2-b729-c40e04f4d627 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:59.675745 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c777c313-d036-46a2-b729-c40e04f4d627 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:59.676723 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f32d1c6a-ad1d-4510-a416-6e77fca8fffb tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6" status: 200 len: 1510 microversion: 2.1 time: 0.379079 Oct 18 15:51:59.677611 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2771/5563] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:59 2022] GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 => generated 1510 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:51:59.683169 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-c7187ac8-55d6-4e6e-9679-1a884ea916bc req-461e0e96-c604-4bf4-a3db-9b3481cd3a95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfd97d9c-daf6-4503-8fd1-ae8750a24793", "name": "network-vif-plugged", "status": "completed", "tag": "d953661c-7e35-4446-9f77-70c196bc52ed"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:51:59.695233 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c7187ac8-55d6-4e6e-9679-1a884ea916bc req-461e0e96-c604-4bf4-a3db-9b3481cd3a95 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:59.696079 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c7187ac8-55d6-4e6e-9679-1a884ea916bc req-461e0e96-c604-4bf4-a3db-9b3481cd3a95 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:59.696762 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c7187ac8-55d6-4e6e-9679-1a884ea916bc req-461e0e96-c604-4bf4-a3db-9b3481cd3a95 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:59.711516 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-c7187ac8-55d6-4e6e-9679-1a884ea916bc req-461e0e96-c604-4bf4-a3db-9b3481cd3a95 service nova] Creating event network-vif-plugged:d953661c-7e35-4446-9f77-70c196bc52ed for instance bfd97d9c-daf6-4503-8fd1-ae8750a24793 on n-h1-853682-5 Oct 18 15:51:59.723257 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-c7187ac8-55d6-4e6e-9679-1a884ea916bc req-461e0e96-c604-4bf4-a3db-9b3481cd3a95 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044236 Oct 18 15:51:59.724226 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2772/5564] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:51:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:51:59.725952 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c777c313-d036-46a2-b729-c40e04f4d627 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:59.726466 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c777c313-d036-46a2-b729-c40e04f4d627 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:59.726912 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c777c313-d036-46a2-b729-c40e04f4d627 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:59.727639 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c777c313-d036-46a2-b729-c40e04f4d627 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:59.728108 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c777c313-d036-46a2-b729-c40e04f4d627 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:59.728542 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c777c313-d036-46a2-b729-c40e04f4d627 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:59.732177 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8ddb1aa1-a816-41bd-ad9f-eb2d8862a6be tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:51:59.733218 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8ddb1aa1-a816-41bd-ad9f-eb2d8862a6be tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: 61d72ac7-5fdd-4c9b-a36a-306accdb31e9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:51:59.745864 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ddb1aa1-a816-41bd-ad9f-eb2d8862a6be tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:59.746712 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ddb1aa1-a816-41bd-ad9f-eb2d8862a6be tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:59.747397 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ddb1aa1-a816-41bd-ad9f-eb2d8862a6be tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:59.748587 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ddb1aa1-a816-41bd-ad9f-eb2d8862a6be tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:51:59.749717 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ddb1aa1-a816-41bd-ad9f-eb2d8862a6be tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:51:59.753430 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ddb1aa1-a816-41bd-ad9f-eb2d8862a6be tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:51:59.991267 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c777c313-d036-46a2-b729-c40e04f4d627 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:00.011707 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c777c313-d036-46a2-b729-c40e04f4d627 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:00.032637 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c777c313-d036-46a2-b729-c40e04f4d627 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:00.033972 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c777c313-d036-46a2-b729-c40e04f4d627 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1339 microversion: 2.20 time: 0.381722 Oct 18 15:52:00.034755 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2793/5565] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:51:59 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1339 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:52:00.396540 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8ddb1aa1-a816-41bd-ad9f-eb2d8862a6be tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:00.408051 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8ddb1aa1-a816-41bd-ad9f-eb2d8862a6be tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9" status: 200 len: 1504 microversion: 2.1 time: 0.680611 Oct 18 15:52:00.409777 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2773/5566] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:51:59 2022] GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9 => generated 1504 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:52:00.684541 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6d1a81db-33c9-4634-8be6-acfecafb1d06 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:00.689602 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6d1a81db-33c9-4634-8be6-acfecafb1d06 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] [instance: bfd97d9c-daf6-4503-8fd1-ae8750a24793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:00.709975 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0cd58c58-f081-4dc9-a522-2b1be0385c55 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:00.713695 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0cd58c58-f081-4dc9-a522-2b1be0385c55 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:00.738205 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6d1a81db-33c9-4634-8be6-acfecafb1d06 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:00.739141 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0cd58c58-f081-4dc9-a522-2b1be0385c55 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:00.741521 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0cd58c58-f081-4dc9-a522-2b1be0385c55 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:00.746037 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6d1a81db-33c9-4634-8be6-acfecafb1d06 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:00.746545 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0cd58c58-f081-4dc9-a522-2b1be0385c55 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:00.749348 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6d1a81db-33c9-4634-8be6-acfecafb1d06 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:00.752593 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0cd58c58-f081-4dc9-a522-2b1be0385c55 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:00.753367 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6d1a81db-33c9-4634-8be6-acfecafb1d06 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:00.766817 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6d1a81db-33c9-4634-8be6-acfecafb1d06 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:00.767729 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0cd58c58-f081-4dc9-a522-2b1be0385c55 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:00.768061 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0cd58c58-f081-4dc9-a522-2b1be0385c55 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:00.768668 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6d1a81db-33c9-4634-8be6-acfecafb1d06 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:01.205799 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6d1a81db-33c9-4634-8be6-acfecafb1d06 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c27994e138c42ffbe4d9151b776ae6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2164f4bcd424ffbace7a1baf85f36db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:01.224761 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6d1a81db-33c9-4634-8be6-acfecafb1d06 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] 10.222.0.60 "GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793" status: 200 len: 1322 microversion: 2.1 time: 0.550671 Oct 18 15:52:01.241474 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2794/5567] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:00 2022] GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793 => generated 1322 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:52:01.246743 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b2d04d42-d08d-40e7-a212-b38eb7172bbd tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:01.247710 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b2d04d42-d08d-40e7-a212-b38eb7172bbd tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:01.254902 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b2d04d42-d08d-40e7-a212-b38eb7172bbd tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:01.256033 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b2d04d42-d08d-40e7-a212-b38eb7172bbd tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:01.257201 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b2d04d42-d08d-40e7-a212-b38eb7172bbd tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:01.258256 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b2d04d42-d08d-40e7-a212-b38eb7172bbd tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:01.259900 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b2d04d42-d08d-40e7-a212-b38eb7172bbd tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:01.260576 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b2d04d42-d08d-40e7-a212-b38eb7172bbd tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:01.285758 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0cd58c58-f081-4dc9-a522-2b1be0385c55 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:01.312651 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0cd58c58-f081-4dc9-a522-2b1be0385c55 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6" status: 200 len: 1510 microversion: 2.1 time: 0.599313 Oct 18 15:52:01.325261 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2774/5568] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:00 2022] GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 => generated 1510 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:52:01.433765 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2b17fc59-d51b-4860-866c-acd1e5d78ea4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:01.434459 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2b17fc59-d51b-4860-866c-acd1e5d78ea4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: 61d72ac7-5fdd-4c9b-a36a-306accdb31e9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:01.444013 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b17fc59-d51b-4860-866c-acd1e5d78ea4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:01.448639 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b17fc59-d51b-4860-866c-acd1e5d78ea4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:01.449483 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b17fc59-d51b-4860-866c-acd1e5d78ea4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:01.453448 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b17fc59-d51b-4860-866c-acd1e5d78ea4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:01.454146 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b17fc59-d51b-4860-866c-acd1e5d78ea4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:01.454772 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b17fc59-d51b-4860-866c-acd1e5d78ea4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:01.469447 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:01.575165 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:02.083995 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b2d04d42-d08d-40e7-a212-b38eb7172bbd tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:02.093352 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b2d04d42-d08d-40e7-a212-b38eb7172bbd tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:02.101009 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b2d04d42-d08d-40e7-a212-b38eb7172bbd tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:02.102421 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b2d04d42-d08d-40e7-a212-b38eb7172bbd tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1407 microversion: 2.20 time: 0.859674 Oct 18 15:52:02.103463 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2795/5569] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:52:01 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1407 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:52:02.149033 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2b17fc59-d51b-4860-866c-acd1e5d78ea4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:02.158707 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2b17fc59-d51b-4860-866c-acd1e5d78ea4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9" status: 200 len: 1504 microversion: 2.1 time: 0.729722 Oct 18 15:52:02.159294 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2775/5570] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:01 2022] GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9 => generated 1504 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:52:02.247528 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4bc7d389-e22e-4f62-826f-7e49e80fe7e3 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:02.248792 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4bc7d389-e22e-4f62-826f-7e49e80fe7e3 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] [instance: bfd97d9c-daf6-4503-8fd1-ae8750a24793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:02.255377 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4bc7d389-e22e-4f62-826f-7e49e80fe7e3 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:02.261643 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4bc7d389-e22e-4f62-826f-7e49e80fe7e3 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:02.262263 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4bc7d389-e22e-4f62-826f-7e49e80fe7e3 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:02.263010 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4bc7d389-e22e-4f62-826f-7e49e80fe7e3 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:02.263485 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4bc7d389-e22e-4f62-826f-7e49e80fe7e3 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:02.264607 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4bc7d389-e22e-4f62-826f-7e49e80fe7e3 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:02.340032 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dbc9d128-547d-46ad-a707-d415ec3abd98 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:02.341371 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dbc9d128-547d-46ad-a707-d415ec3abd98 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:02.351664 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dbc9d128-547d-46ad-a707-d415ec3abd98 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:02.352345 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dbc9d128-547d-46ad-a707-d415ec3abd98 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:02.353216 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dbc9d128-547d-46ad-a707-d415ec3abd98 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:02.354366 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dbc9d128-547d-46ad-a707-d415ec3abd98 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:02.355006 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dbc9d128-547d-46ad-a707-d415ec3abd98 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:02.355588 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dbc9d128-547d-46ad-a707-d415ec3abd98 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:02.694221 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4bc7d389-e22e-4f62-826f-7e49e80fe7e3 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c27994e138c42ffbe4d9151b776ae6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2164f4bcd424ffbace7a1baf85f36db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:02.698875 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dbc9d128-547d-46ad-a707-d415ec3abd98 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:02.705843 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4bc7d389-e22e-4f62-826f-7e49e80fe7e3 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] 10.222.0.60 "GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793" status: 200 len: 1517 microversion: 2.1 time: 0.462216 Oct 18 15:52:02.711615 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2796/5571] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:02 2022] GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793 => generated 1517 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:52:02.727238 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dbc9d128-547d-46ad-a707-d415ec3abd98 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6" status: 200 len: 1510 microversion: 2.1 time: 0.390651 Oct 18 15:52:02.727876 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2776/5572] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:02 2022] GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 => generated 1510 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:52:02.750505 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8c254190-f870-48f9-9d4c-744ea89ea038 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:52:02.753465 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8c254190-f870-48f9-9d4c-744ea89ea038 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] [instance: bfd97d9c-daf6-4503-8fd1-ae8750a24793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:02.759981 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c254190-f870-48f9-9d4c-744ea89ea038 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:02.761047 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c254190-f870-48f9-9d4c-744ea89ea038 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:02.761791 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c254190-f870-48f9-9d4c-744ea89ea038 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:02.763086 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c254190-f870-48f9-9d4c-744ea89ea038 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:02.763213 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c254190-f870-48f9-9d4c-744ea89ea038 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:02.763875 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c254190-f870-48f9-9d4c-744ea89ea038 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:02.794440 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:02.817869 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-8c254190-f870-48f9-9d4c-744ea89ea038 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lazy-loading 'flavor' on Instance uuid bfd97d9c-daf6-4503-8fd1-ae8750a24793 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:52:02.879967 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-838b88a8-77d5-4ec3-a6d2-3bbc8243756b req-8137a1ee-2e20-4cc5-9c7d-02c6f54b9ca6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6af51230-78de-43fb-be54-c1b182368139", "tag": "e6888c52-692f-4a5c-a3cf-e7018e476bf5"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:52:02.898715 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-838b88a8-77d5-4ec3-a6d2-3bbc8243756b req-8137a1ee-2e20-4cc5-9c7d-02c6f54b9ca6 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:02.899561 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-838b88a8-77d5-4ec3-a6d2-3bbc8243756b req-8137a1ee-2e20-4cc5-9c7d-02c6f54b9ca6 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:02.900212 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-838b88a8-77d5-4ec3-a6d2-3bbc8243756b req-8137a1ee-2e20-4cc5-9c7d-02c6f54b9ca6 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:02.931438 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-838b88a8-77d5-4ec3-a6d2-3bbc8243756b req-8137a1ee-2e20-4cc5-9c7d-02c6f54b9ca6 service nova] Creating event network-changed:e6888c52-692f-4a5c-a3cf-e7018e476bf5 for instance 6af51230-78de-43fb-be54-c1b182368139 on n-h2-853682-5 Oct 18 15:52:02.937805 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-838b88a8-77d5-4ec3-a6d2-3bbc8243756b req-8137a1ee-2e20-4cc5-9c7d-02c6f54b9ca6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062502 Oct 18 15:52:02.939330 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2777/5573] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:52:02.952413 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8c254190-f870-48f9-9d4c-744ea89ea038 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] 10.222.0.60 "POST /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793/action" status: 200 len: 32 microversion: 2.1 time: 0.226455 Oct 18 15:52:02.958039 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2797/5574] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:52:02 2022] POST /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793/action => generated 32 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 18 15:52:02.965881 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6a039def-05ab-4696-a85b-be2db76d0aad tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:02.967824 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6a039def-05ab-4696-a85b-be2db76d0aad tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] [instance: bfd97d9c-daf6-4503-8fd1-ae8750a24793] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:02.984987 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a039def-05ab-4696-a85b-be2db76d0aad tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:02.985493 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a039def-05ab-4696-a85b-be2db76d0aad tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:02.986127 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a039def-05ab-4696-a85b-be2db76d0aad tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:02.987017 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a039def-05ab-4696-a85b-be2db76d0aad tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:02.987483 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a039def-05ab-4696-a85b-be2db76d0aad tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:02.987908 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a039def-05ab-4696-a85b-be2db76d0aad tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:03.131017 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a6e7d200-7365-476d-85bb-0fd1257b0f39 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:03.131719 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a6e7d200-7365-476d-85bb-0fd1257b0f39 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:03.139721 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a6e7d200-7365-476d-85bb-0fd1257b0f39 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:03.140430 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a6e7d200-7365-476d-85bb-0fd1257b0f39 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:03.141126 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a6e7d200-7365-476d-85bb-0fd1257b0f39 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:03.142256 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a6e7d200-7365-476d-85bb-0fd1257b0f39 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:03.142893 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a6e7d200-7365-476d-85bb-0fd1257b0f39 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:03.143710 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a6e7d200-7365-476d-85bb-0fd1257b0f39 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:03.543753 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6a039def-05ab-4696-a85b-be2db76d0aad tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c27994e138c42ffbe4d9151b776ae6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2164f4bcd424ffbace7a1baf85f36db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:03.557150 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6a039def-05ab-4696-a85b-be2db76d0aad tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] 10.222.0.60 "GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793" status: 200 len: 1523 microversion: 2.1 time: 0.597519 Oct 18 15:52:03.558599 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2778/5575] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:02 2022] GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793 => generated 1523 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:52:03.585042 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f4072c89-9472-440a-8783-feeac99e687f tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:03.586082 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f4072c89-9472-440a-8783-feeac99e687f tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: 61d72ac7-5fdd-4c9b-a36a-306accdb31e9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:03.593763 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4072c89-9472-440a-8783-feeac99e687f tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:03.594638 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4072c89-9472-440a-8783-feeac99e687f tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:03.595339 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4072c89-9472-440a-8783-feeac99e687f tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:03.597802 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4072c89-9472-440a-8783-feeac99e687f tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:03.599864 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a6e7d200-7365-476d-85bb-0fd1257b0f39 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:03.607083 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4072c89-9472-440a-8783-feeac99e687f tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:03.607854 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4072c89-9472-440a-8783-feeac99e687f tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:03.608458 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a6e7d200-7365-476d-85bb-0fd1257b0f39 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:03.610080 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a6e7d200-7365-476d-85bb-0fd1257b0f39 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:03.611229 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a6e7d200-7365-476d-85bb-0fd1257b0f39 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1407 microversion: 2.20 time: 0.484808 Oct 18 15:52:03.620000 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2798/5576] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:52:03 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1407 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:52:03.759344 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d0ccf335-9ad3-446e-a527-52538063686d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:03.759975 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d0ccf335-9ad3-446e-a527-52538063686d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:03.787140 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d0ccf335-9ad3-446e-a527-52538063686d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:03.787586 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d0ccf335-9ad3-446e-a527-52538063686d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:03.788052 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d0ccf335-9ad3-446e-a527-52538063686d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:03.788848 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d0ccf335-9ad3-446e-a527-52538063686d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:03.789646 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d0ccf335-9ad3-446e-a527-52538063686d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:03.790254 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d0ccf335-9ad3-446e-a527-52538063686d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:04.223487 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d0ccf335-9ad3-446e-a527-52538063686d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:04.227650 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f4072c89-9472-440a-8783-feeac99e687f tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:04.236980 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d0ccf335-9ad3-446e-a527-52538063686d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6" status: 200 len: 1510 microversion: 2.1 time: 0.483282 Oct 18 15:52:04.240997 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2799/5577] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:03 2022] GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 => generated 1510 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:52:04.241285 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f4072c89-9472-440a-8783-feeac99e687f tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9" status: 200 len: 1504 microversion: 2.1 time: 0.660591 Oct 18 15:52:04.242748 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2779/5578] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:03 2022] GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9 => generated 1504 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:52:04.584979 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fd309bfb-f165-4136-9935-67ee86666024 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:04.586005 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-fd309bfb-f165-4136-9935-67ee86666024 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] [instance: bfd97d9c-daf6-4503-8fd1-ae8750a24793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:04.594580 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fd309bfb-f165-4136-9935-67ee86666024 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:04.595428 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fd309bfb-f165-4136-9935-67ee86666024 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:04.596102 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fd309bfb-f165-4136-9935-67ee86666024 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:04.597078 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fd309bfb-f165-4136-9935-67ee86666024 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:04.597785 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fd309bfb-f165-4136-9935-67ee86666024 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:04.598613 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fd309bfb-f165-4136-9935-67ee86666024 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:04.638694 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2e7e1f34-96ff-4d15-bf3a-77abe9766221 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:04.640023 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2e7e1f34-96ff-4d15-bf3a-77abe9766221 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:04.653662 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e7e1f34-96ff-4d15-bf3a-77abe9766221 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:04.654939 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e7e1f34-96ff-4d15-bf3a-77abe9766221 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:04.657781 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e7e1f34-96ff-4d15-bf3a-77abe9766221 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:04.658726 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e7e1f34-96ff-4d15-bf3a-77abe9766221 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:04.659401 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e7e1f34-96ff-4d15-bf3a-77abe9766221 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:04.661320 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e7e1f34-96ff-4d15-bf3a-77abe9766221 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:04.900644 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-fd309bfb-f165-4136-9935-67ee86666024 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c27994e138c42ffbe4d9151b776ae6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2164f4bcd424ffbace7a1baf85f36db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:04.902415 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2e7e1f34-96ff-4d15-bf3a-77abe9766221 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:04.911820 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fd309bfb-f165-4136-9935-67ee86666024 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] 10.222.0.60 "GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793" status: 200 len: 1523 microversion: 2.1 time: 0.330916 Oct 18 15:52:04.913002 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2800/5579] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:04 2022] GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793 => generated 1523 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:52:04.925168 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2e7e1f34-96ff-4d15-bf3a-77abe9766221 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:04.925168 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2e7e1f34-96ff-4d15-bf3a-77abe9766221 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:04.925168 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2e7e1f34-96ff-4d15-bf3a-77abe9766221 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1407 microversion: 2.20 time: 0.284803 Oct 18 15:52:04.925168 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2780/5580] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:52:04 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1407 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:52:05.271580 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-dc066db6-e000-4a3e-b4ee-33f189802fe2 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:05.272276 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-dc066db6-e000-4a3e-b4ee-33f189802fe2 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: 61d72ac7-5fdd-4c9b-a36a-306accdb31e9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:05.273785 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-166dc49d-3efb-4e7c-8f04-eff3fa1bd321 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:05.274419 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-166dc49d-3efb-4e7c-8f04-eff3fa1bd321 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:05.283686 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dc066db6-e000-4a3e-b4ee-33f189802fe2 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:05.283856 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-166dc49d-3efb-4e7c-8f04-eff3fa1bd321 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:05.284247 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-166dc49d-3efb-4e7c-8f04-eff3fa1bd321 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:05.284607 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dc066db6-e000-4a3e-b4ee-33f189802fe2 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:05.284717 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-166dc49d-3efb-4e7c-8f04-eff3fa1bd321 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:05.285440 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-166dc49d-3efb-4e7c-8f04-eff3fa1bd321 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:05.286453 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dc066db6-e000-4a3e-b4ee-33f189802fe2 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:05.288998 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dc066db6-e000-4a3e-b4ee-33f189802fe2 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:05.289263 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-166dc49d-3efb-4e7c-8f04-eff3fa1bd321 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:05.290867 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dc066db6-e000-4a3e-b4ee-33f189802fe2 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:05.291987 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dc066db6-e000-4a3e-b4ee-33f189802fe2 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:05.308786 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-166dc49d-3efb-4e7c-8f04-eff3fa1bd321 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:05.642669 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:05.653825 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-dc066db6-e000-4a3e-b4ee-33f189802fe2 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:05.674348 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-dc066db6-e000-4a3e-b4ee-33f189802fe2 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9" status: 200 len: 1484 microversion: 2.1 time: 0.406196 Oct 18 15:52:05.676468 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2801/5581] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:05 2022] GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9 => generated 1484 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:52:05.695422 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-166dc49d-3efb-4e7c-8f04-eff3fa1bd321 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:05.700165 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-53b8958b-9465-4bc3-a41f-0fddfb51bb20 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:52:05.700734 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-53b8958b-9465-4bc3-a41f-0fddfb51bb20 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: 61d72ac7-5fdd-4c9b-a36a-306accdb31e9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:05.709323 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-53b8958b-9465-4bc3-a41f-0fddfb51bb20 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:05.710152 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-53b8958b-9465-4bc3-a41f-0fddfb51bb20 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:05.711409 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-53b8958b-9465-4bc3-a41f-0fddfb51bb20 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:05.712336 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-53b8958b-9465-4bc3-a41f-0fddfb51bb20 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:05.713039 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-53b8958b-9465-4bc3-a41f-0fddfb51bb20 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:05.713705 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-53b8958b-9465-4bc3-a41f-0fddfb51bb20 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:05.714029 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-166dc49d-3efb-4e7c-8f04-eff3fa1bd321 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6" status: 200 len: 1510 microversion: 2.1 time: 0.447460 Oct 18 15:52:05.726020 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2781/5582] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:05 2022] GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 => generated 1510 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:52:05.803084 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-53b8958b-9465-4bc3-a41f-0fddfb51bb20 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "POST /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9/action" status: 202 len: 0 microversion: 2.1 time: 0.106586 Oct 18 15:52:05.807671 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2802/5583] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:52:05 2022] POST /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 15:52:05.815444 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-de5fbd6e-91ab-437e-a6ff-d76469bfe914 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:05.816122 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-de5fbd6e-91ab-437e-a6ff-d76469bfe914 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: 61d72ac7-5fdd-4c9b-a36a-306accdb31e9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:05.829102 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de5fbd6e-91ab-437e-a6ff-d76469bfe914 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:05.833060 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de5fbd6e-91ab-437e-a6ff-d76469bfe914 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:05.833755 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de5fbd6e-91ab-437e-a6ff-d76469bfe914 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:05.847957 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de5fbd6e-91ab-437e-a6ff-d76469bfe914 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:05.852164 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de5fbd6e-91ab-437e-a6ff-d76469bfe914 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:05.853373 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de5fbd6e-91ab-437e-a6ff-d76469bfe914 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:05.947121 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4ea4a8b8-e2bc-4947-a36b-3dc7f6d97c7d tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:05.948739 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4ea4a8b8-e2bc-4947-a36b-3dc7f6d97c7d tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] [instance: bfd97d9c-daf6-4503-8fd1-ae8750a24793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:05.956401 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ea4a8b8-e2bc-4947-a36b-3dc7f6d97c7d tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:05.957213 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ea4a8b8-e2bc-4947-a36b-3dc7f6d97c7d tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:05.957901 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ea4a8b8-e2bc-4947-a36b-3dc7f6d97c7d tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:05.958833 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ea4a8b8-e2bc-4947-a36b-3dc7f6d97c7d tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:05.959533 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ea4a8b8-e2bc-4947-a36b-3dc7f6d97c7d tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:05.960231 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ea4a8b8-e2bc-4947-a36b-3dc7f6d97c7d tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:06.277383 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-de5fbd6e-91ab-437e-a6ff-d76469bfe914 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:06.289642 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-de5fbd6e-91ab-437e-a6ff-d76469bfe914 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9" status: 200 len: 1492 microversion: 2.1 time: 0.480939 Oct 18 15:52:06.291431 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4ea4a8b8-e2bc-4947-a36b-3dc7f6d97c7d tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c27994e138c42ffbe4d9151b776ae6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2164f4bcd424ffbace7a1baf85f36db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:06.292390 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2782/5584] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:05 2022] GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9 => generated 1492 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:52:06.299398 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b79fea5c-425f-445f-baee-e85a274a5d4d tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:06.300514 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b79fea5c-425f-445f-baee-e85a274a5d4d tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:06.310846 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b79fea5c-425f-445f-baee-e85a274a5d4d tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:06.311910 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b79fea5c-425f-445f-baee-e85a274a5d4d tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:06.312581 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b79fea5c-425f-445f-baee-e85a274a5d4d tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:06.313685 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b79fea5c-425f-445f-baee-e85a274a5d4d tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:06.314810 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b79fea5c-425f-445f-baee-e85a274a5d4d tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:06.315600 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b79fea5c-425f-445f-baee-e85a274a5d4d tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:06.319288 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4ea4a8b8-e2bc-4947-a36b-3dc7f6d97c7d tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] 10.222.0.60 "GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793" status: 200 len: 1523 microversion: 2.1 time: 0.381599 Oct 18 15:52:06.319872 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2803/5585] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:05 2022] GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793 => generated 1523 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:52:06.745079 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-04c051c6-cdef-4bb8-9417-a22c21178666 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:06.745801 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-04c051c6-cdef-4bb8-9417-a22c21178666 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:06.754544 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=8 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:06.756966 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-04c051c6-cdef-4bb8-9417-a22c21178666 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:06.757428 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-04c051c6-cdef-4bb8-9417-a22c21178666 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:06.758057 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-04c051c6-cdef-4bb8-9417-a22c21178666 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:06.759286 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-04c051c6-cdef-4bb8-9417-a22c21178666 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:06.759887 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-04c051c6-cdef-4bb8-9417-a22c21178666 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:06.760416 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-04c051c6-cdef-4bb8-9417-a22c21178666 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:06.809030 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b79fea5c-425f-445f-baee-e85a274a5d4d tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:06.824917 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b79fea5c-425f-445f-baee-e85a274a5d4d tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:06.830984 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b79fea5c-425f-445f-baee-e85a274a5d4d tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:06.835398 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b79fea5c-425f-445f-baee-e85a274a5d4d tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1407 microversion: 2.20 time: 0.541100 Oct 18 15:52:06.836199 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2783/5586] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:52:06 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1407 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:52:07.175533 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-04c051c6-cdef-4bb8-9417-a22c21178666 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:07.183564 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-04c051c6-cdef-4bb8-9417-a22c21178666 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6" status: 200 len: 1510 microversion: 2.1 time: 0.444644 Oct 18 15:52:07.190047 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2804/5587] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:06 2022] GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 => generated 1510 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:52:07.319364 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-80a68247-595a-4168-aae7-e32ba842a8d5 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:07.319837 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-80a68247-595a-4168-aae7-e32ba842a8d5 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: 61d72ac7-5fdd-4c9b-a36a-306accdb31e9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:07.337131 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80a68247-595a-4168-aae7-e32ba842a8d5 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:07.337898 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80a68247-595a-4168-aae7-e32ba842a8d5 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:07.338549 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80a68247-595a-4168-aae7-e32ba842a8d5 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:07.345591 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80a68247-595a-4168-aae7-e32ba842a8d5 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:07.346100 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80a68247-595a-4168-aae7-e32ba842a8d5 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:07.346552 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80a68247-595a-4168-aae7-e32ba842a8d5 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:07.348865 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-209f4a91-c981-4fb9-a0b6-6da336647bb4 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:07.350109 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-209f4a91-c981-4fb9-a0b6-6da336647bb4 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] [instance: bfd97d9c-daf6-4503-8fd1-ae8750a24793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:07.359166 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-209f4a91-c981-4fb9-a0b6-6da336647bb4 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:07.360422 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-209f4a91-c981-4fb9-a0b6-6da336647bb4 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:07.361240 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-209f4a91-c981-4fb9-a0b6-6da336647bb4 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:07.362381 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-209f4a91-c981-4fb9-a0b6-6da336647bb4 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:07.363058 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-209f4a91-c981-4fb9-a0b6-6da336647bb4 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:07.363712 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-209f4a91-c981-4fb9-a0b6-6da336647bb4 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:07.733101 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-209f4a91-c981-4fb9-a0b6-6da336647bb4 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c27994e138c42ffbe4d9151b776ae6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2164f4bcd424ffbace7a1baf85f36db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:07.749000 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-80a68247-595a-4168-aae7-e32ba842a8d5 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:07.752878 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-209f4a91-c981-4fb9-a0b6-6da336647bb4 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] 10.222.0.60 "GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793" status: 200 len: 1523 microversion: 2.1 time: 0.408354 Oct 18 15:52:07.753824 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2805/5588] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:07 2022] GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793 => generated 1523 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:52:07.776186 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-80a68247-595a-4168-aae7-e32ba842a8d5 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9" status: 200 len: 1492 microversion: 2.1 time: 0.461075 Oct 18 15:52:07.776802 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2784/5589] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:07 2022] GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9 => generated 1492 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:52:07.863868 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5b4eb0cc-6e06-44d5-9ab2-7b55369f3417 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:07.864636 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5b4eb0cc-6e06-44d5-9ab2-7b55369f3417 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:07.877703 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5b4eb0cc-6e06-44d5-9ab2-7b55369f3417 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:07.878207 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5b4eb0cc-6e06-44d5-9ab2-7b55369f3417 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:07.878651 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5b4eb0cc-6e06-44d5-9ab2-7b55369f3417 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:07.879521 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5b4eb0cc-6e06-44d5-9ab2-7b55369f3417 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:07.879961 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5b4eb0cc-6e06-44d5-9ab2-7b55369f3417 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:07.880396 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5b4eb0cc-6e06-44d5-9ab2-7b55369f3417 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:08.154639 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5b4eb0cc-6e06-44d5-9ab2-7b55369f3417 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:08.170308 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5b4eb0cc-6e06-44d5-9ab2-7b55369f3417 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:08.172065 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5b4eb0cc-6e06-44d5-9ab2-7b55369f3417 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:08.173523 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5b4eb0cc-6e06-44d5-9ab2-7b55369f3417 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1407 microversion: 2.20 time: 0.313795 Oct 18 15:52:08.174594 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2806/5590] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:52:07 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1407 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:52:08.217118 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6b585688-0638-457a-9f4d-bf7a7a8843ad tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:08.218400 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6b585688-0638-457a-9f4d-bf7a7a8843ad tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:08.230385 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b585688-0638-457a-9f4d-bf7a7a8843ad tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:08.231076 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b585688-0638-457a-9f4d-bf7a7a8843ad tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:08.231700 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b585688-0638-457a-9f4d-bf7a7a8843ad tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:08.232620 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b585688-0638-457a-9f4d-bf7a7a8843ad tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:08.233261 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b585688-0638-457a-9f4d-bf7a7a8843ad tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:08.238473 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b585688-0638-457a-9f4d-bf7a7a8843ad tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:08.544435 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6b585688-0638-457a-9f4d-bf7a7a8843ad tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:08.553770 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6b585688-0638-457a-9f4d-bf7a7a8843ad tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6" status: 200 len: 1510 microversion: 2.1 time: 0.340561 Oct 18 15:52:08.573814 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2785/5591] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:08 2022] GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 => generated 1510 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:52:08.777403 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8c7d5beb-112c-432f-98a1-a2799f7924a0 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:08.778104 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8c7d5beb-112c-432f-98a1-a2799f7924a0 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] [instance: bfd97d9c-daf6-4503-8fd1-ae8750a24793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:08.792490 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c7d5beb-112c-432f-98a1-a2799f7924a0 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:08.795610 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c7d5beb-112c-432f-98a1-a2799f7924a0 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:08.799712 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c7d5beb-112c-432f-98a1-a2799f7924a0 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:08.801170 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c7d5beb-112c-432f-98a1-a2799f7924a0 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:08.801663 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c7d5beb-112c-432f-98a1-a2799f7924a0 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:08.802847 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9a2529ae-b43b-41cc-a015-feb8e346fab4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:08.803171 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c7d5beb-112c-432f-98a1-a2799f7924a0 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:08.803723 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9a2529ae-b43b-41cc-a015-feb8e346fab4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: 61d72ac7-5fdd-4c9b-a36a-306accdb31e9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:08.816897 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a2529ae-b43b-41cc-a015-feb8e346fab4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:08.818659 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a2529ae-b43b-41cc-a015-feb8e346fab4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:08.819107 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a2529ae-b43b-41cc-a015-feb8e346fab4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:08.822656 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a2529ae-b43b-41cc-a015-feb8e346fab4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:08.823238 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a2529ae-b43b-41cc-a015-feb8e346fab4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:08.823692 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a2529ae-b43b-41cc-a015-feb8e346fab4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:09.173179 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8c7d5beb-112c-432f-98a1-a2799f7924a0 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c27994e138c42ffbe4d9151b776ae6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2164f4bcd424ffbace7a1baf85f36db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:09.181372 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8c7d5beb-112c-432f-98a1-a2799f7924a0 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] 10.222.0.60 "GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793" status: 200 len: 1523 microversion: 2.1 time: 0.407891 Oct 18 15:52:09.187484 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2807/5592] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:08 2022] GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793 => generated 1523 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:52:09.208285 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-75355cfa-bdec-48c9-8b61-2fbc75647671 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:09.208960 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-75355cfa-bdec-48c9-8b61-2fbc75647671 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:09.226186 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-75355cfa-bdec-48c9-8b61-2fbc75647671 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:09.227004 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-75355cfa-bdec-48c9-8b61-2fbc75647671 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:09.227457 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-75355cfa-bdec-48c9-8b61-2fbc75647671 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:09.228192 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-75355cfa-bdec-48c9-8b61-2fbc75647671 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:09.228659 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-75355cfa-bdec-48c9-8b61-2fbc75647671 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:09.229119 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-75355cfa-bdec-48c9-8b61-2fbc75647671 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:09.246413 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9a2529ae-b43b-41cc-a015-feb8e346fab4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:09.259877 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9a2529ae-b43b-41cc-a015-feb8e346fab4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9" status: 200 len: 1498 microversion: 2.1 time: 0.459078 Oct 18 15:52:09.261368 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2786/5593] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:08 2022] GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9 => generated 1498 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:52:09.288751 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5f3bf597-6fac-4e7e-acdd-440e0a85e67a tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:09.289302 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5f3bf597-6fac-4e7e-acdd-440e0a85e67a tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: 61d72ac7-5fdd-4c9b-a36a-306accdb31e9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:09.297222 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f3bf597-6fac-4e7e-acdd-440e0a85e67a tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:09.298300 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f3bf597-6fac-4e7e-acdd-440e0a85e67a tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:09.298937 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f3bf597-6fac-4e7e-acdd-440e0a85e67a tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:09.300045 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f3bf597-6fac-4e7e-acdd-440e0a85e67a tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:09.301051 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f3bf597-6fac-4e7e-acdd-440e0a85e67a tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:09.301897 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f3bf597-6fac-4e7e-acdd-440e0a85e67a tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:09.335444 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5f3bf597-6fac-4e7e-acdd-440e0a85e67a tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: 61d72ac7-5fdd-4c9b-a36a-306accdb31e9] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:52:09.505335 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5f3bf597-6fac-4e7e-acdd-440e0a85e67a tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "DELETE /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9" status: 204 len: 0 microversion: 2.1 time: 0.219552 Oct 18 15:52:09.506510 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-75355cfa-bdec-48c9-8b61-2fbc75647671 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:09.508451 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2787/5594] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:52:09 2022] DELETE /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 15:52:09.516426 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-02732133-7e5d-4254-820f-6157b443d8e3 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:09.517207 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-02732133-7e5d-4254-820f-6157b443d8e3 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: 61d72ac7-5fdd-4c9b-a36a-306accdb31e9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:09.519010 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-75355cfa-bdec-48c9-8b61-2fbc75647671 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:09.520775 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-75355cfa-bdec-48c9-8b61-2fbc75647671 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:09.522616 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-75355cfa-bdec-48c9-8b61-2fbc75647671 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1407 microversion: 2.20 time: 0.319013 Oct 18 15:52:09.523893 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2808/5595] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:52:09 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1407 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:52:09.524579 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02732133-7e5d-4254-820f-6157b443d8e3 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:09.525122 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02732133-7e5d-4254-820f-6157b443d8e3 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:09.526036 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02732133-7e5d-4254-820f-6157b443d8e3 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:09.526908 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02732133-7e5d-4254-820f-6157b443d8e3 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:09.527688 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02732133-7e5d-4254-820f-6157b443d8e3 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:09.528259 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02732133-7e5d-4254-820f-6157b443d8e3 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:09.586688 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7f6e4c5e-5193-42fd-9e5f-ab610506b66c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:09.587593 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7f6e4c5e-5193-42fd-9e5f-ab610506b66c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:09.595047 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7f6e4c5e-5193-42fd-9e5f-ab610506b66c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:09.595761 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7f6e4c5e-5193-42fd-9e5f-ab610506b66c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:09.596372 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7f6e4c5e-5193-42fd-9e5f-ab610506b66c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:09.597465 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7f6e4c5e-5193-42fd-9e5f-ab610506b66c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:09.598084 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7f6e4c5e-5193-42fd-9e5f-ab610506b66c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:09.598667 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7f6e4c5e-5193-42fd-9e5f-ab610506b66c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:10.280247 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-02732133-7e5d-4254-820f-6157b443d8e3 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:10.295282 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-02732133-7e5d-4254-820f-6157b443d8e3 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9" status: 200 len: 1504 microversion: 2.1 time: 0.783624 Oct 18 15:52:10.308831 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2788/5596] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:09 2022] GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9 => generated 1504 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:52:10.319144 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2f73693b-569c-47a0-b8a4-805967888eea tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:10.320904 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2f73693b-569c-47a0-b8a4-805967888eea tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] [instance: bfd97d9c-daf6-4503-8fd1-ae8750a24793] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:10.329111 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f73693b-569c-47a0-b8a4-805967888eea tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:10.329773 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f73693b-569c-47a0-b8a4-805967888eea tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:10.330558 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f73693b-569c-47a0-b8a4-805967888eea tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:10.331457 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f73693b-569c-47a0-b8a4-805967888eea tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:10.332414 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f73693b-569c-47a0-b8a4-805967888eea tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:10.333069 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f73693b-569c-47a0-b8a4-805967888eea tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:10.426671 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7f6e4c5e-5193-42fd-9e5f-ab610506b66c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:10.439367 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7f6e4c5e-5193-42fd-9e5f-ab610506b66c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6" status: 200 len: 1510 microversion: 2.1 time: 0.862716 Oct 18 15:52:10.440676 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2809/5597] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:09 2022] GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 => generated 1510 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:52:10.556796 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-40710d5e-f495-4439-93c7-726062e80f60 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:10.557945 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-40710d5e-f495-4439-93c7-726062e80f60 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:10.566066 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-40710d5e-f495-4439-93c7-726062e80f60 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:10.566960 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-40710d5e-f495-4439-93c7-726062e80f60 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:10.568187 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-40710d5e-f495-4439-93c7-726062e80f60 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:10.569127 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-40710d5e-f495-4439-93c7-726062e80f60 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:10.569979 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-40710d5e-f495-4439-93c7-726062e80f60 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:10.570595 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-40710d5e-f495-4439-93c7-726062e80f60 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:10.822440 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2f73693b-569c-47a0-b8a4-805967888eea tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c27994e138c42ffbe4d9151b776ae6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2164f4bcd424ffbace7a1baf85f36db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:10.841795 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2f73693b-569c-47a0-b8a4-805967888eea tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] 10.222.0.60 "GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793" status: 200 len: 1523 microversion: 2.1 time: 0.535260 Oct 18 15:52:10.842899 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2789/5598] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:10 2022] GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793 => generated 1523 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:52:11.024392 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-517ddbf9-cb20-4521-b93e-dbe078122951 req-51bbba13-ccb7-43c5-959b-7ad4a1563597 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6af51230-78de-43fb-be54-c1b182368139", "name": "network-vif-plugged", "status": "completed", "tag": "e6888c52-692f-4a5c-a3cf-e7018e476bf5"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:52:11.065175 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-517ddbf9-cb20-4521-b93e-dbe078122951 req-51bbba13-ccb7-43c5-959b-7ad4a1563597 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:11.067877 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-517ddbf9-cb20-4521-b93e-dbe078122951 req-51bbba13-ccb7-43c5-959b-7ad4a1563597 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:11.070083 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-517ddbf9-cb20-4521-b93e-dbe078122951 req-51bbba13-ccb7-43c5-959b-7ad4a1563597 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:11.078176 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-40710d5e-f495-4439-93c7-726062e80f60 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:11.090237 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-40710d5e-f495-4439-93c7-726062e80f60 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:11.094216 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-517ddbf9-cb20-4521-b93e-dbe078122951 req-51bbba13-ccb7-43c5-959b-7ad4a1563597 service nova] Creating event network-vif-plugged:e6888c52-692f-4a5c-a3cf-e7018e476bf5 for instance 6af51230-78de-43fb-be54-c1b182368139 on n-h2-853682-5 Oct 18 15:52:11.096119 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-40710d5e-f495-4439-93c7-726062e80f60 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:11.097843 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-40710d5e-f495-4439-93c7-726062e80f60 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1407 microversion: 2.20 time: 0.546133 Oct 18 15:52:11.110316 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2810/5599] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:52:10 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1407 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:52:11.112765 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-517ddbf9-cb20-4521-b93e-dbe078122951 req-51bbba13-ccb7-43c5-959b-7ad4a1563597 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099750 Oct 18 15:52:11.114026 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2790/5600] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:52:11.322680 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b524a135-c82a-4d73-9356-a1ffae33052c tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:11.323307 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b524a135-c82a-4d73-9356-a1ffae33052c tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: 61d72ac7-5fdd-4c9b-a36a-306accdb31e9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:11.331695 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b524a135-c82a-4d73-9356-a1ffae33052c tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:11.332530 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b524a135-c82a-4d73-9356-a1ffae33052c tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:11.333206 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b524a135-c82a-4d73-9356-a1ffae33052c tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:11.334108 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b524a135-c82a-4d73-9356-a1ffae33052c tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:11.334725 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b524a135-c82a-4d73-9356-a1ffae33052c tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:11.335310 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b524a135-c82a-4d73-9356-a1ffae33052c tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:11.361053 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:11.468296 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b1c03cf6-709d-4c69-90fd-5065439671b6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:11.469755 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b1c03cf6-709d-4c69-90fd-5065439671b6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:11.477170 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1c03cf6-709d-4c69-90fd-5065439671b6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:11.478049 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1c03cf6-709d-4c69-90fd-5065439671b6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:11.478585 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1c03cf6-709d-4c69-90fd-5065439671b6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:11.479606 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1c03cf6-709d-4c69-90fd-5065439671b6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:11.480129 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1c03cf6-709d-4c69-90fd-5065439671b6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:11.480787 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1c03cf6-709d-4c69-90fd-5065439671b6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:11.502417 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:11.629507 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b524a135-c82a-4d73-9356-a1ffae33052c tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:11.648321 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b524a135-c82a-4d73-9356-a1ffae33052c tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9" status: 200 len: 1504 microversion: 2.1 time: 0.329162 Oct 18 15:52:11.649873 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2811/5601] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:11 2022] GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9 => generated 1504 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:52:11.783123 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b1c03cf6-709d-4c69-90fd-5065439671b6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:11.793221 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b1c03cf6-709d-4c69-90fd-5065439671b6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6" status: 200 len: 1510 microversion: 2.1 time: 0.331827 Oct 18 15:52:11.797051 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2791/5602] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:11 2022] GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 => generated 1510 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:52:11.867090 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-48126086-2ddf-465c-9f95-d2322608ad92 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:11.867708 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-48126086-2ddf-465c-9f95-d2322608ad92 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] [instance: bfd97d9c-daf6-4503-8fd1-ae8750a24793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:11.884590 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-48126086-2ddf-465c-9f95-d2322608ad92 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:11.885822 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-48126086-2ddf-465c-9f95-d2322608ad92 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:11.887369 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-48126086-2ddf-465c-9f95-d2322608ad92 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:11.888356 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-48126086-2ddf-465c-9f95-d2322608ad92 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:11.889509 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-48126086-2ddf-465c-9f95-d2322608ad92 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:11.889948 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-48126086-2ddf-465c-9f95-d2322608ad92 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:12.124733 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2350aec6-108a-446a-9b9a-82781dc87cf4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:12.125765 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2350aec6-108a-446a-9b9a-82781dc87cf4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:12.136453 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2350aec6-108a-446a-9b9a-82781dc87cf4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:12.140046 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2350aec6-108a-446a-9b9a-82781dc87cf4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:12.142829 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2350aec6-108a-446a-9b9a-82781dc87cf4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:12.144016 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2350aec6-108a-446a-9b9a-82781dc87cf4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:12.147206 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2350aec6-108a-446a-9b9a-82781dc87cf4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:12.147671 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2350aec6-108a-446a-9b9a-82781dc87cf4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:12.214261 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-48126086-2ddf-465c-9f95-d2322608ad92 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c27994e138c42ffbe4d9151b776ae6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2164f4bcd424ffbace7a1baf85f36db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:12.230675 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-48126086-2ddf-465c-9f95-d2322608ad92 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] 10.222.0.60 "GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793" status: 200 len: 1523 microversion: 2.1 time: 0.368620 Oct 18 15:52:12.234798 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2812/5603] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:11 2022] GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793 => generated 1523 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:52:12.550913 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2350aec6-108a-446a-9b9a-82781dc87cf4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:12.563700 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2350aec6-108a-446a-9b9a-82781dc87cf4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:12.570759 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2350aec6-108a-446a-9b9a-82781dc87cf4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:12.577138 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2350aec6-108a-446a-9b9a-82781dc87cf4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1407 microversion: 2.20 time: 0.457496 Oct 18 15:52:12.593302 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2792/5604] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:52:12 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1407 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:52:12.674629 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d9f42c4d-b8bf-44e2-9704-1f0be96c0234 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:12.675515 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d9f42c4d-b8bf-44e2-9704-1f0be96c0234 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: 61d72ac7-5fdd-4c9b-a36a-306accdb31e9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:12.682272 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d9f42c4d-b8bf-44e2-9704-1f0be96c0234 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:12.682941 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d9f42c4d-b8bf-44e2-9704-1f0be96c0234 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:12.683484 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d9f42c4d-b8bf-44e2-9704-1f0be96c0234 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:12.684315 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d9f42c4d-b8bf-44e2-9704-1f0be96c0234 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:12.684933 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d9f42c4d-b8bf-44e2-9704-1f0be96c0234 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:12.685501 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d9f42c4d-b8bf-44e2-9704-1f0be96c0234 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:12.819436 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7587655f-0f27-469c-83af-4b2405cf1414 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:12.820059 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7587655f-0f27-469c-83af-4b2405cf1414 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:12.829903 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7587655f-0f27-469c-83af-4b2405cf1414 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:12.832861 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7587655f-0f27-469c-83af-4b2405cf1414 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:12.833360 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7587655f-0f27-469c-83af-4b2405cf1414 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:12.836445 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7587655f-0f27-469c-83af-4b2405cf1414 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:12.837031 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7587655f-0f27-469c-83af-4b2405cf1414 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:12.837478 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7587655f-0f27-469c-83af-4b2405cf1414 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:13.270180 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d9f42c4d-b8bf-44e2-9704-1f0be96c0234 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:13.283065 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d9f42c4d-b8bf-44e2-9704-1f0be96c0234 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9" status: 200 len: 1504 microversion: 2.1 time: 0.611085 Oct 18 15:52:13.284133 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2813/5605] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:12 2022] GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9 => generated 1504 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:52:13.295263 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1322be96-ad90-4eef-aefb-e152fc9198ad tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:13.296711 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1322be96-ad90-4eef-aefb-e152fc9198ad tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] [instance: bfd97d9c-daf6-4503-8fd1-ae8750a24793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:13.314334 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1322be96-ad90-4eef-aefb-e152fc9198ad tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:13.315241 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1322be96-ad90-4eef-aefb-e152fc9198ad tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:13.316005 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1322be96-ad90-4eef-aefb-e152fc9198ad tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:13.317637 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1322be96-ad90-4eef-aefb-e152fc9198ad tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:13.318339 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1322be96-ad90-4eef-aefb-e152fc9198ad tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:13.319543 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1322be96-ad90-4eef-aefb-e152fc9198ad tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:13.563739 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7587655f-0f27-469c-83af-4b2405cf1414 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:13.573857 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7587655f-0f27-469c-83af-4b2405cf1414 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6" status: 200 len: 1510 microversion: 2.1 time: 0.758684 Oct 18 15:52:13.582342 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2793/5606] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:12 2022] GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 => generated 1510 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:52:13.601636 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-5d90c121-2605-4903-aaaa-8cfa63785aea req-3ae33d63-da43-4e1d-8ada-12c16f71a866 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61d72ac7-5fdd-4c9b-a36a-306accdb31e9", "name": "network-vif-deleted", "tag": "2c1efa57-6386-4097-9761-d01f2ac449c7"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:52:13.625550 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5d90c121-2605-4903-aaaa-8cfa63785aea req-3ae33d63-da43-4e1d-8ada-12c16f71a866 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:13.626056 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5d90c121-2605-4903-aaaa-8cfa63785aea req-3ae33d63-da43-4e1d-8ada-12c16f71a866 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:13.627239 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5d90c121-2605-4903-aaaa-8cfa63785aea req-3ae33d63-da43-4e1d-8ada-12c16f71a866 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:13.692566 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-5d90c121-2605-4903-aaaa-8cfa63785aea req-3ae33d63-da43-4e1d-8ada-12c16f71a866 service nova] Creating event network-vif-deleted:2c1efa57-6386-4097-9761-d01f2ac449c7 for instance 61d72ac7-5fdd-4c9b-a36a-306accdb31e9 on n-h2-853682-5 Oct 18 15:52:13.714013 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-5d90c121-2605-4903-aaaa-8cfa63785aea req-3ae33d63-da43-4e1d-8ada-12c16f71a866 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130201 Oct 18 15:52:13.714926 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2794/5607] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:52:13.728985 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7f0568ba-6a78-4c8e-ba92-6d867ba8366d tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:13.734562 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7f0568ba-6a78-4c8e-ba92-6d867ba8366d tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:13.746476 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f0568ba-6a78-4c8e-ba92-6d867ba8366d tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:13.752072 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f0568ba-6a78-4c8e-ba92-6d867ba8366d tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:13.752865 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f0568ba-6a78-4c8e-ba92-6d867ba8366d tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:13.753930 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f0568ba-6a78-4c8e-ba92-6d867ba8366d tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:13.754545 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f0568ba-6a78-4c8e-ba92-6d867ba8366d tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:13.757831 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f0568ba-6a78-4c8e-ba92-6d867ba8366d tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:13.777547 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1322be96-ad90-4eef-aefb-e152fc9198ad tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c27994e138c42ffbe4d9151b776ae6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2164f4bcd424ffbace7a1baf85f36db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:13.789358 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1322be96-ad90-4eef-aefb-e152fc9198ad tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] 10.222.0.60 "GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793" status: 200 len: 1523 microversion: 2.1 time: 0.503756 Oct 18 15:52:13.808245 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2814/5608] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:13 2022] GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793 => generated 1523 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:52:14.308709 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d2cff84f-4195-444d-8419-10b12441e8c4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:14.309371 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d2cff84f-4195-444d-8419-10b12441e8c4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: 61d72ac7-5fdd-4c9b-a36a-306accdb31e9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:14.316613 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d2cff84f-4195-444d-8419-10b12441e8c4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:14.320354 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d2cff84f-4195-444d-8419-10b12441e8c4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:14.322719 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d2cff84f-4195-444d-8419-10b12441e8c4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:14.324415 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d2cff84f-4195-444d-8419-10b12441e8c4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:14.327130 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d2cff84f-4195-444d-8419-10b12441e8c4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:14.327583 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d2cff84f-4195-444d-8419-10b12441e8c4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:14.400689 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d2cff84f-4195-444d-8419-10b12441e8c4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:14.401224 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d2cff84f-4195-444d-8419-10b12441e8c4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:14.401670 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d2cff84f-4195-444d-8419-10b12441e8c4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:14.402197 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-d2cff84f-4195-444d-8419-10b12441e8c4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lazy-loading 'fault' on Instance uuid 61d72ac7-5fdd-4c9b-a36a-306accdb31e9 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:52:14.418794 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7f0568ba-6a78-4c8e-ba92-6d867ba8366d tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:14.429106 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7f0568ba-6a78-4c8e-ba92-6d867ba8366d tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:14.430574 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7f0568ba-6a78-4c8e-ba92-6d867ba8366d tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:14.431726 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7f0568ba-6a78-4c8e-ba92-6d867ba8366d tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1407 microversion: 2.20 time: 0.715556 Oct 18 15:52:14.432310 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2795/5609] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:52:13 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1407 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:52:14.484028 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d2cff84f-4195-444d-8419-10b12441e8c4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:14.505995 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d2cff84f-4195-444d-8419-10b12441e8c4 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9" status: 200 len: 1303 microversion: 2.1 time: 0.200797 Oct 18 15:52:14.506671 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2815/5610] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:14 2022] GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9 => generated 1303 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:52:14.604766 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6271bfb2-6840-44d2-bd37-6601ad8f5d5c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:14.605797 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6271bfb2-6840-44d2-bd37-6601ad8f5d5c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:14.614234 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6271bfb2-6840-44d2-bd37-6601ad8f5d5c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:14.614991 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6271bfb2-6840-44d2-bd37-6601ad8f5d5c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:14.615664 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6271bfb2-6840-44d2-bd37-6601ad8f5d5c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:14.616601 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6271bfb2-6840-44d2-bd37-6601ad8f5d5c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:14.617505 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6271bfb2-6840-44d2-bd37-6601ad8f5d5c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:14.617995 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6271bfb2-6840-44d2-bd37-6601ad8f5d5c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:14.817145 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-07bd5095-7837-4ba3-8824-125a0f013dd8 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:14.818045 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-07bd5095-7837-4ba3-8824-125a0f013dd8 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] [instance: bfd97d9c-daf6-4503-8fd1-ae8750a24793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:14.829421 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-07bd5095-7837-4ba3-8824-125a0f013dd8 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:14.837376 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-07bd5095-7837-4ba3-8824-125a0f013dd8 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:14.837881 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-07bd5095-7837-4ba3-8824-125a0f013dd8 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:14.838778 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-07bd5095-7837-4ba3-8824-125a0f013dd8 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:14.839122 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-07bd5095-7837-4ba3-8824-125a0f013dd8 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:14.839558 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-07bd5095-7837-4ba3-8824-125a0f013dd8 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:14.874397 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6271bfb2-6840-44d2-bd37-6601ad8f5d5c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:14.895330 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6271bfb2-6840-44d2-bd37-6601ad8f5d5c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6" status: 200 len: 1510 microversion: 2.1 time: 0.297440 Oct 18 15:52:14.908587 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2796/5611] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:14 2022] GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 => generated 1510 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:52:15.079382 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-07bd5095-7837-4ba3-8824-125a0f013dd8 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c27994e138c42ffbe4d9151b776ae6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2164f4bcd424ffbace7a1baf85f36db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:15.087252 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-07bd5095-7837-4ba3-8824-125a0f013dd8 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] 10.222.0.60 "GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793" status: 200 len: 1523 microversion: 2.1 time: 0.275046 Oct 18 15:52:15.087884 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2816/5612] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:14 2022] GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793 => generated 1523 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:52:15.460755 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4e2ff9b6-b2fa-453b-bfc3-13d0447442fe tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:15.461425 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4e2ff9b6-b2fa-453b-bfc3-13d0447442fe tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:15.471336 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e2ff9b6-b2fa-453b-bfc3-13d0447442fe tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:15.471747 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e2ff9b6-b2fa-453b-bfc3-13d0447442fe tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:15.472190 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e2ff9b6-b2fa-453b-bfc3-13d0447442fe tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:15.472935 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e2ff9b6-b2fa-453b-bfc3-13d0447442fe tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:15.473395 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e2ff9b6-b2fa-453b-bfc3-13d0447442fe tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:15.473826 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e2ff9b6-b2fa-453b-bfc3-13d0447442fe tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:15.532620 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2e3a321d-b94e-4abc-988c-b75b181104a9 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:15.533454 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2e3a321d-b94e-4abc-988c-b75b181104a9 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: 61d72ac7-5fdd-4c9b-a36a-306accdb31e9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:15.548407 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2e3a321d-b94e-4abc-988c-b75b181104a9 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:15.550057 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2e3a321d-b94e-4abc-988c-b75b181104a9 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:15.550511 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2e3a321d-b94e-4abc-988c-b75b181104a9 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:15.551248 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2e3a321d-b94e-4abc-988c-b75b181104a9 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:15.553386 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2e3a321d-b94e-4abc-988c-b75b181104a9 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:15.553918 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2e3a321d-b94e-4abc-988c-b75b181104a9 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:15.573414 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-2e3a321d-b94e-4abc-988c-b75b181104a9 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] HTTP exception thrown: Instance 61d72ac7-5fdd-4c9b-a36a-306accdb31e9 could not be found. Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2e3a321d-b94e-4abc-988c-b75b181104a9 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Request method failure captured: Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9 HTTP/1.1 Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsstS3tt3aPIllUZbcJBCHdmMFiq2VflR76ayFACcBwVYGs70ZR3y-CdmaCQ3Z_cADVTYuUhSEjNVMnU7ztsxmdtqLWCpr5G8Lb-fFKPrMrFWlOI6ycYukAX-ZOd-ESsG8Wz4oX3lSybezVMSfypgVqomyqe8vebqfVFw0Ym51vCfgQ Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 103b0fb8d9184bf09acde8f6f98eb018 Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServerRescueTestJSON-1130590936 Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/103b0fb8d9184bf09acde8f6f98eb018"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/103b0fb8d9184bf09acde8f6f98eb018"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/103b0fb8d9184bf09acde8f6f98eb018"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_103b0fb8d9184bf09acde8f6f98eb018"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServerRescueTestJSON-1130590936 Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 103b0fb8d9184bf09acde8f6f98eb018 Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServerRescueTestJSON-1130590936 Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServerRescueTestJSON-1130590936-project Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: b8fed4f99b0845f69f77530084b11042 Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServerRescueTestJSON-1130590936-project Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 61d72ac7-5fdd-4c9b-a36a-306accdb31e9 could not be found. Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '61d72ac7-5fdd-4c9b-a36a-306accdb31e9'} Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61d72ac7-5fdd-4c9b-a36a-306accdb31e9 could not be found. Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61d72ac7-5fdd-4c9b-a36a-306accdb31e9 could not be found. Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:52:15.575445 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:52:15.579237 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:15.579237 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:52:15.579237 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:52:15.579237 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:52:15.579237 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:52:15.579237 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61d72ac7-5fdd-4c9b-a36a-306accdb31e9 could not be found. Oct 18 15:52:15.579237 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:52:15.580794 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2e3a321d-b94e-4abc-988c-b75b181104a9 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Returning 404 to user: Instance 61d72ac7-5fdd-4c9b-a36a-306accdb31e9 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:52:15.581884 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2e3a321d-b94e-4abc-988c-b75b181104a9 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9" status: 404 len: 111 microversion: 2.1 time: 0.054203 Oct 18 15:52:15.582910 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2817/5613] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:15 2022] GET /compute/v2.1/servers/61d72ac7-5fdd-4c9b-a36a-306accdb31e9 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:52:15.593142 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6fd693f7-54a4-4e0f-9bf7-3a170d1bacf9 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:15.594039 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6fd693f7-54a4-4e0f-9bf7-3a170d1bacf9 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: ebefddda-1a5f-485c-a89b-697fe8119af0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:15.601806 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6fd693f7-54a4-4e0f-9bf7-3a170d1bacf9 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:15.602538 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6fd693f7-54a4-4e0f-9bf7-3a170d1bacf9 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:15.603131 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6fd693f7-54a4-4e0f-9bf7-3a170d1bacf9 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:15.604165 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6fd693f7-54a4-4e0f-9bf7-3a170d1bacf9 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:15.604775 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6fd693f7-54a4-4e0f-9bf7-3a170d1bacf9 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:15.605376 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6fd693f7-54a4-4e0f-9bf7-3a170d1bacf9 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:15.644670 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6fd693f7-54a4-4e0f-9bf7-3a170d1bacf9 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: ebefddda-1a5f-485c-a89b-697fe8119af0] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:52:15.840410 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6fd693f7-54a4-4e0f-9bf7-3a170d1bacf9 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0" status: 204 len: 0 microversion: 2.1 time: 0.250634 Oct 18 15:52:15.843547 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2818/5614] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:52:15 2022] DELETE /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:52:15.858935 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8970028b-e1ae-4cf2-8668-85c77c035c52 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:15.860625 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8970028b-e1ae-4cf2-8668-85c77c035c52 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: ebefddda-1a5f-485c-a89b-697fe8119af0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:15.875867 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8970028b-e1ae-4cf2-8668-85c77c035c52 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:15.879200 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8970028b-e1ae-4cf2-8668-85c77c035c52 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:15.879903 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8970028b-e1ae-4cf2-8668-85c77c035c52 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:15.880931 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8970028b-e1ae-4cf2-8668-85c77c035c52 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:15.881591 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8970028b-e1ae-4cf2-8668-85c77c035c52 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:15.883225 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8970028b-e1ae-4cf2-8668-85c77c035c52 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:15.912127 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4e2ff9b6-b2fa-453b-bfc3-13d0447442fe tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:15.931500 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4e2ff9b6-b2fa-453b-bfc3-13d0447442fe tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:15.936448 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4e2ff9b6-b2fa-453b-bfc3-13d0447442fe tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:15.940734 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4e2ff9b6-b2fa-453b-bfc3-13d0447442fe tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1597 microversion: 2.20 time: 0.487542 Oct 18 15:52:15.945432 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2797/5615] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:52:15 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1597 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:52:15.963210 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4556e666-0ec3-4694-b4e6-105a06201e94 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:15.964328 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4556e666-0ec3-4694-b4e6-105a06201e94 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:15.986711 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4556e666-0ec3-4694-b4e6-105a06201e94 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:15.988251 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4556e666-0ec3-4694-b4e6-105a06201e94 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:15.990333 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4556e666-0ec3-4694-b4e6-105a06201e94 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:15.991270 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4556e666-0ec3-4694-b4e6-105a06201e94 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:15.992248 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4556e666-0ec3-4694-b4e6-105a06201e94 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:15.993578 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4556e666-0ec3-4694-b4e6-105a06201e94 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:16.236511 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8970028b-e1ae-4cf2-8668-85c77c035c52 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:16.246880 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8970028b-e1ae-4cf2-8668-85c77c035c52 tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0" status: 200 len: 1490 microversion: 2.1 time: 0.398812 Oct 18 15:52:16.250109 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2819/5616] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:15 2022] GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0 => generated 1490 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:52:16.256109 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-67b4d985-a469-4e74-bdd1-b5b2a7c78625 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:16.257022 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-67b4d985-a469-4e74-bdd1-b5b2a7c78625 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:16.265069 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-67b4d985-a469-4e74-bdd1-b5b2a7c78625 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:16.265720 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-67b4d985-a469-4e74-bdd1-b5b2a7c78625 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:16.266300 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-67b4d985-a469-4e74-bdd1-b5b2a7c78625 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:16.267454 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-67b4d985-a469-4e74-bdd1-b5b2a7c78625 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:16.268160 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-67b4d985-a469-4e74-bdd1-b5b2a7c78625 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:16.268736 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-67b4d985-a469-4e74-bdd1-b5b2a7c78625 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:16.431695 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-67b4d985-a469-4e74-bdd1-b5b2a7c78625 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.177785 Oct 18 15:52:16.432980 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2820/5617] 10.222.0.60 () {60 vars in 1316 bytes} [Tue Oct 18 15:52:16 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139/os-interface => generated 284 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:52:16.442977 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4556e666-0ec3-4694-b4e6-105a06201e94 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:16.446079 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ea2f5c98-0c96-420d-a6bf-e83faddd0c78 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:16.447626 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ea2f5c98-0c96-420d-a6bf-e83faddd0c78 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] [instance: bfd97d9c-daf6-4503-8fd1-ae8750a24793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:16.458356 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4556e666-0ec3-4694-b4e6-105a06201e94 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6" status: 200 len: 1510 microversion: 2.1 time: 0.510951 Oct 18 15:52:16.459285 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2798/5618] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:15 2022] GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 => generated 1510 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:52:16.462772 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea2f5c98-0c96-420d-a6bf-e83faddd0c78 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:16.467062 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea2f5c98-0c96-420d-a6bf-e83faddd0c78 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:16.467772 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea2f5c98-0c96-420d-a6bf-e83faddd0c78 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:16.468730 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea2f5c98-0c96-420d-a6bf-e83faddd0c78 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:16.469383 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea2f5c98-0c96-420d-a6bf-e83faddd0c78 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:16.470800 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea2f5c98-0c96-420d-a6bf-e83faddd0c78 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:16.897858 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ea2f5c98-0c96-420d-a6bf-e83faddd0c78 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c27994e138c42ffbe4d9151b776ae6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2164f4bcd424ffbace7a1baf85f36db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:16.910377 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ea2f5c98-0c96-420d-a6bf-e83faddd0c78 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] 10.222.0.60 "GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793" status: 200 len: 1523 microversion: 2.1 time: 0.475434 Oct 18 15:52:16.929574 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2821/5619] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:16 2022] GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793 => generated 1523 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:52:17.275592 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5730e95d-06db-49a7-8f1e-794e3e0c1f9f tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:17.276394 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5730e95d-06db-49a7-8f1e-794e3e0c1f9f tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: ebefddda-1a5f-485c-a89b-697fe8119af0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:17.287108 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5730e95d-06db-49a7-8f1e-794e3e0c1f9f tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:17.288335 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5730e95d-06db-49a7-8f1e-794e3e0c1f9f tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:17.290136 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5730e95d-06db-49a7-8f1e-794e3e0c1f9f tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:17.291131 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5730e95d-06db-49a7-8f1e-794e3e0c1f9f tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:17.291761 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5730e95d-06db-49a7-8f1e-794e3e0c1f9f tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:17.292340 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5730e95d-06db-49a7-8f1e-794e3e0c1f9f tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:17.498766 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-cf99648b-7666-41be-9336-f77631fbfc2f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:17.500739 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-cf99648b-7666-41be-9336-f77631fbfc2f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:17.508386 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cf99648b-7666-41be-9336-f77631fbfc2f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:17.510069 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cf99648b-7666-41be-9336-f77631fbfc2f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:17.512155 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cf99648b-7666-41be-9336-f77631fbfc2f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:17.513553 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cf99648b-7666-41be-9336-f77631fbfc2f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:17.514490 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cf99648b-7666-41be-9336-f77631fbfc2f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:17.515829 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cf99648b-7666-41be-9336-f77631fbfc2f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:17.784999 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5730e95d-06db-49a7-8f1e-794e3e0c1f9f tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:17.796943 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5730e95d-06db-49a7-8f1e-794e3e0c1f9f tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0" status: 200 len: 1490 microversion: 2.1 time: 0.525510 Oct 18 15:52:17.797667 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2799/5620] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:17 2022] GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0 => generated 1490 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:52:17.936836 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7d65631f-61bb-4b18-9143-f2afe1a8f6c4 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:17.938635 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7d65631f-61bb-4b18-9143-f2afe1a8f6c4 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] [instance: bfd97d9c-daf6-4503-8fd1-ae8750a24793] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:17.945257 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d65631f-61bb-4b18-9143-f2afe1a8f6c4 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:17.946064 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d65631f-61bb-4b18-9143-f2afe1a8f6c4 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:17.946787 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d65631f-61bb-4b18-9143-f2afe1a8f6c4 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:17.947991 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d65631f-61bb-4b18-9143-f2afe1a8f6c4 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:17.948612 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d65631f-61bb-4b18-9143-f2afe1a8f6c4 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:17.949383 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d65631f-61bb-4b18-9143-f2afe1a8f6c4 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:18.416068 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-cf99648b-7666-41be-9336-f77631fbfc2f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:18.466151 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-cf99648b-7666-41be-9336-f77631fbfc2f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6" status: 200 len: 1510 microversion: 2.1 time: 0.979528 Oct 18 15:52:18.468175 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2822/5621] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:17 2022] GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 => generated 1510 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:52:18.567683 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7d65631f-61bb-4b18-9143-f2afe1a8f6c4 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c27994e138c42ffbe4d9151b776ae6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2164f4bcd424ffbace7a1baf85f36db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:18.577045 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7d65631f-61bb-4b18-9143-f2afe1a8f6c4 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] 10.222.0.60 "GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793" status: 200 len: 1523 microversion: 2.1 time: 0.643874 Oct 18 15:52:18.578528 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2800/5622] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:17 2022] GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793 => generated 1523 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:52:18.822193 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9911e15e-8711-4b6b-af4e-f663bd68d9da tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:18.822804 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9911e15e-8711-4b6b-af4e-f663bd68d9da tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: ebefddda-1a5f-485c-a89b-697fe8119af0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:18.837520 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9911e15e-8711-4b6b-af4e-f663bd68d9da tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:18.838266 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9911e15e-8711-4b6b-af4e-f663bd68d9da tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:18.838872 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9911e15e-8711-4b6b-af4e-f663bd68d9da tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:18.840495 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9911e15e-8711-4b6b-af4e-f663bd68d9da tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:18.843079 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9911e15e-8711-4b6b-af4e-f663bd68d9da tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:18.843700 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9911e15e-8711-4b6b-af4e-f663bd68d9da tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:19.045605 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9911e15e-8711-4b6b-af4e-f663bd68d9da tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:19.055462 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9911e15e-8711-4b6b-af4e-f663bd68d9da tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0" status: 200 len: 1490 microversion: 2.1 time: 0.237975 Oct 18 15:52:19.071286 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2823/5623] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:18 2022] GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0 => generated 1490 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:52:19.144025 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-c4dbaa2e-abd3-46e6-9db4-cb8995e6a7f8 req-6896d190-30ee-43e4-8293-a196d5cd774a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6af51230-78de-43fb-be54-c1b182368139", "tag": "e6888c52-692f-4a5c-a3cf-e7018e476bf5"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:52:19.162255 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c4dbaa2e-abd3-46e6-9db4-cb8995e6a7f8 req-6896d190-30ee-43e4-8293-a196d5cd774a service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:19.162808 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c4dbaa2e-abd3-46e6-9db4-cb8995e6a7f8 req-6896d190-30ee-43e4-8293-a196d5cd774a service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:19.163124 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c4dbaa2e-abd3-46e6-9db4-cb8995e6a7f8 req-6896d190-30ee-43e4-8293-a196d5cd774a service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:19.189336 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-c4dbaa2e-abd3-46e6-9db4-cb8995e6a7f8 req-6896d190-30ee-43e4-8293-a196d5cd774a service nova] Creating event network-changed:e6888c52-692f-4a5c-a3cf-e7018e476bf5 for instance 6af51230-78de-43fb-be54-c1b182368139 on n-h2-853682-5 Oct 18 15:52:19.201676 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-c4dbaa2e-abd3-46e6-9db4-cb8995e6a7f8 req-6896d190-30ee-43e4-8293-a196d5cd774a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059294 Oct 18 15:52:19.205102 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2801/5624] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:52:19.355467 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-6dd3020d-4170-49b8-be90-fcf4880432d0 req-0c074164-2fa4-4f1b-ae39-8777166175e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebefddda-1a5f-485c-a89b-697fe8119af0", "name": "network-vif-deleted", "tag": "f996c199-2ca6-4e8e-8432-2bea01445275"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:52:19.384577 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:19.393875 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-6dd3020d-4170-49b8-be90-fcf4880432d0 req-0c074164-2fa4-4f1b-ae39-8777166175e8 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:19.394422 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-6dd3020d-4170-49b8-be90-fcf4880432d0 req-0c074164-2fa4-4f1b-ae39-8777166175e8 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:19.395979 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-6dd3020d-4170-49b8-be90-fcf4880432d0 req-0c074164-2fa4-4f1b-ae39-8777166175e8 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:19.443707 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-6dd3020d-4170-49b8-be90-fcf4880432d0 req-0c074164-2fa4-4f1b-ae39-8777166175e8 service nova] Creating event network-vif-deleted:f996c199-2ca6-4e8e-8432-2bea01445275 for instance ebefddda-1a5f-485c-a89b-697fe8119af0 on n-h2-853682-5 Oct 18 15:52:19.466742 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-6dd3020d-4170-49b8-be90-fcf4880432d0 req-0c074164-2fa4-4f1b-ae39-8777166175e8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113691 Oct 18 15:52:19.471612 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2824/5625] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:52:19.491553 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dae09709-a34c-451b-8445-e5d9306af96f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:19.492274 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dae09709-a34c-451b-8445-e5d9306af96f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:19.511286 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:19.517071 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dae09709-a34c-451b-8445-e5d9306af96f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:19.519001 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dae09709-a34c-451b-8445-e5d9306af96f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:19.520541 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dae09709-a34c-451b-8445-e5d9306af96f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:19.522924 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dae09709-a34c-451b-8445-e5d9306af96f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:19.524344 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dae09709-a34c-451b-8445-e5d9306af96f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:19.527032 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dae09709-a34c-451b-8445-e5d9306af96f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:19.605365 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e215f46c-b06f-4a6f-b61e-a8218294cebf tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:19.616054 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e215f46c-b06f-4a6f-b61e-a8218294cebf tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] [instance: bfd97d9c-daf6-4503-8fd1-ae8750a24793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:19.637563 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e215f46c-b06f-4a6f-b61e-a8218294cebf tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:19.639641 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e215f46c-b06f-4a6f-b61e-a8218294cebf tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:19.640309 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e215f46c-b06f-4a6f-b61e-a8218294cebf tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:19.642967 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e215f46c-b06f-4a6f-b61e-a8218294cebf tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:19.645329 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e215f46c-b06f-4a6f-b61e-a8218294cebf tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:19.647664 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e215f46c-b06f-4a6f-b61e-a8218294cebf tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:20.063834 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dae09709-a34c-451b-8445-e5d9306af96f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:20.086588 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dae09709-a34c-451b-8445-e5d9306af96f tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6" status: 200 len: 1510 microversion: 2.1 time: 0.599385 Oct 18 15:52:20.087231 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2802/5626] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:19 2022] GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 => generated 1510 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:52:20.092452 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-45f086cb-e07f-4e30-b3a9-639481ece5ff tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:20.111474 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-45f086cb-e07f-4e30-b3a9-639481ece5ff tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: ebefddda-1a5f-485c-a89b-697fe8119af0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:20.129515 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45f086cb-e07f-4e30-b3a9-639481ece5ff tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:20.130269 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45f086cb-e07f-4e30-b3a9-639481ece5ff tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:20.132862 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45f086cb-e07f-4e30-b3a9-639481ece5ff tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:20.133807 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45f086cb-e07f-4e30-b3a9-639481ece5ff tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:20.134465 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45f086cb-e07f-4e30-b3a9-639481ece5ff tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:20.140834 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45f086cb-e07f-4e30-b3a9-639481ece5ff tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:20.166653 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e215f46c-b06f-4a6f-b61e-a8218294cebf tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c27994e138c42ffbe4d9151b776ae6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2164f4bcd424ffbace7a1baf85f36db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:20.192043 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e215f46c-b06f-4a6f-b61e-a8218294cebf tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] 10.222.0.60 "GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793" status: 200 len: 1523 microversion: 2.1 time: 0.587841 Oct 18 15:52:20.194079 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2825/5627] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:19 2022] GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793 => generated 1523 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:52:20.198125 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45f086cb-e07f-4e30-b3a9-639481ece5ff tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:20.198863 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45f086cb-e07f-4e30-b3a9-639481ece5ff tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:20.199447 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45f086cb-e07f-4e30-b3a9-639481ece5ff tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:20.200046 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-45f086cb-e07f-4e30-b3a9-639481ece5ff tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lazy-loading 'fault' on Instance uuid ebefddda-1a5f-485c-a89b-697fe8119af0 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:52:20.270734 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-45f086cb-e07f-4e30-b3a9-639481ece5ff tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8fed4f99b0845f69f77530084b11042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103b0fb8d9184bf09acde8f6f98eb018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:20.285307 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-45f086cb-e07f-4e30-b3a9-639481ece5ff tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0" status: 200 len: 1303 microversion: 2.1 time: 0.196596 Oct 18 15:52:20.303839 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2803/5628] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:20 2022] GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0 => generated 1303 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:52:21.116045 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-90fd4534-210c-4d29-a37d-3b3da82bfc61 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:21.116958 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-90fd4534-210c-4d29-a37d-3b3da82bfc61 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:21.129771 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-90fd4534-210c-4d29-a37d-3b3da82bfc61 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:21.133601 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-90fd4534-210c-4d29-a37d-3b3da82bfc61 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:21.134140 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-90fd4534-210c-4d29-a37d-3b3da82bfc61 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:21.135015 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-90fd4534-210c-4d29-a37d-3b3da82bfc61 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:21.135786 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-90fd4534-210c-4d29-a37d-3b3da82bfc61 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:21.136305 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-90fd4534-210c-4d29-a37d-3b3da82bfc61 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:21.220426 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-75f19553-f932-4de0-9025-d792365f20ef tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:21.221072 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-75f19553-f932-4de0-9025-d792365f20ef tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] [instance: bfd97d9c-daf6-4503-8fd1-ae8750a24793] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:21.233757 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-75f19553-f932-4de0-9025-d792365f20ef tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:21.235053 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-75f19553-f932-4de0-9025-d792365f20ef tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:21.236576 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-75f19553-f932-4de0-9025-d792365f20ef tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:21.237481 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-75f19553-f932-4de0-9025-d792365f20ef tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:21.238546 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-75f19553-f932-4de0-9025-d792365f20ef tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:21.240126 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-75f19553-f932-4de0-9025-d792365f20ef tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:21.620627 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-90fd4534-210c-4d29-a37d-3b3da82bfc61 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:21.632176 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-90fd4534-210c-4d29-a37d-3b3da82bfc61 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6" status: 200 len: 1510 microversion: 2.1 time: 0.520664 Oct 18 15:52:21.633700 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2826/5629] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:21 2022] GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 => generated 1510 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:52:21.638717 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f99a6fa6-d39a-49aa-8ee4-9a6b910d0a5e tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:21.639487 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f99a6fa6-d39a-49aa-8ee4-9a6b910d0a5e tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] [instance: ebefddda-1a5f-485c-a89b-697fe8119af0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:21.646122 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f99a6fa6-d39a-49aa-8ee4-9a6b910d0a5e tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:21.646834 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f99a6fa6-d39a-49aa-8ee4-9a6b910d0a5e tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:21.647270 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f99a6fa6-d39a-49aa-8ee4-9a6b910d0a5e tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:21.648104 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f99a6fa6-d39a-49aa-8ee4-9a6b910d0a5e tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:21.648582 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f99a6fa6-d39a-49aa-8ee4-9a6b910d0a5e tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:21.649032 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f99a6fa6-d39a-49aa-8ee4-9a6b910d0a5e tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:21.670757 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-75f19553-f932-4de0-9025-d792365f20ef tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c27994e138c42ffbe4d9151b776ae6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2164f4bcd424ffbace7a1baf85f36db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:21.675919 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-f99a6fa6-d39a-49aa-8ee4-9a6b910d0a5e tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] HTTP exception thrown: Instance ebefddda-1a5f-485c-a89b-697fe8119af0 could not be found. Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f99a6fa6-d39a-49aa-8ee4-9a6b910d0a5e tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Request method failure captured: Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0 HTTP/1.1 Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsstS3tt3aPIllUZbcJBCHdmMFiq2VflR76ayFACcBwVYGs70ZR3y-CdmaCQ3Z_cADVTYuUhSEjNVMnU7ztsxmdtqLWCpr5G8Lb-fFKPrMrFWlOI6ycYukAX-ZOd-ESsG8Wz4oX3lSybezVMSfypgVqomyqe8vebqfVFw0Ym51vCfgQ Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 103b0fb8d9184bf09acde8f6f98eb018 Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServerRescueTestJSON-1130590936 Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/103b0fb8d9184bf09acde8f6f98eb018"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/103b0fb8d9184bf09acde8f6f98eb018"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/103b0fb8d9184bf09acde8f6f98eb018"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_103b0fb8d9184bf09acde8f6f98eb018"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServerRescueTestJSON-1130590936 Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 103b0fb8d9184bf09acde8f6f98eb018 Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServerRescueTestJSON-1130590936 Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServerRescueTestJSON-1130590936-project Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: b8fed4f99b0845f69f77530084b11042 Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServerRescueTestJSON-1130590936-project Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance ebefddda-1a5f-485c-a89b-697fe8119af0 could not be found. Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'ebefddda-1a5f-485c-a89b-697fe8119af0'} Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebefddda-1a5f-485c-a89b-697fe8119af0 could not be found. Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebefddda-1a5f-485c-a89b-697fe8119af0 could not be found. Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:52:21.679859 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:52:21.684444 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:21.684444 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:52:21.684444 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:52:21.684444 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:52:21.684444 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:52:21.684444 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebefddda-1a5f-485c-a89b-697fe8119af0 could not be found. Oct 18 15:52:21.684444 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:52:21.685305 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f99a6fa6-d39a-49aa-8ee4-9a6b910d0a5e tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] Returning 404 to user: Instance ebefddda-1a5f-485c-a89b-697fe8119af0 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:52:21.686474 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f99a6fa6-d39a-49aa-8ee4-9a6b910d0a5e tempest-ServerRescueTestJSON-1130590936 tempest-ServerRescueTestJSON-1130590936-project] 10.222.0.60 "GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0" status: 404 len: 111 microversion: 2.1 time: 0.051613 Oct 18 15:52:21.686926 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-75f19553-f932-4de0-9025-d792365f20ef tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] 10.222.0.60 "GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793" status: 200 len: 1523 microversion: 2.1 time: 0.472263 Oct 18 15:52:21.687972 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2804/5630] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:21 2022] GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793 => generated 1523 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:52:21.690004 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2827/5631] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:21 2022] GET /compute/v2.1/servers/ebefddda-1a5f-485c-a89b-697fe8119af0 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:52:22.660069 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8c12d103-cd26-4df7-a697-baf8890b8eca tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:22.661357 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8c12d103-cd26-4df7-a697-baf8890b8eca tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:22.670517 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c12d103-cd26-4df7-a697-baf8890b8eca tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:22.671212 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c12d103-cd26-4df7-a697-baf8890b8eca tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:22.671829 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c12d103-cd26-4df7-a697-baf8890b8eca tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:22.672950 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c12d103-cd26-4df7-a697-baf8890b8eca tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:22.673567 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c12d103-cd26-4df7-a697-baf8890b8eca tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:22.674144 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c12d103-cd26-4df7-a697-baf8890b8eca tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:22.720376 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-742815f9-5120-4d26-b109-3ecee94fc5d2 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:22.721671 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-742815f9-5120-4d26-b109-3ecee94fc5d2 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] [instance: bfd97d9c-daf6-4503-8fd1-ae8750a24793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:22.731736 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-742815f9-5120-4d26-b109-3ecee94fc5d2 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:22.732098 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-742815f9-5120-4d26-b109-3ecee94fc5d2 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:22.737174 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-742815f9-5120-4d26-b109-3ecee94fc5d2 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:22.741665 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-742815f9-5120-4d26-b109-3ecee94fc5d2 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:22.742383 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-742815f9-5120-4d26-b109-3ecee94fc5d2 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:22.742984 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-742815f9-5120-4d26-b109-3ecee94fc5d2 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:22.748923 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:23.039343 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8c12d103-cd26-4df7-a697-baf8890b8eca tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:23.049699 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8c12d103-cd26-4df7-a697-baf8890b8eca tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6" status: 200 len: 1487 microversion: 2.1 time: 0.392851 Oct 18 15:52:23.064833 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2805/5632] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:22 2022] GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 => generated 1487 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:52:23.075102 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d3b72b0a-51b7-4d40-a010-4eb3bea48fce tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1110255988"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:52:23.078452 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d3b72b0a-51b7-4d40-a010-4eb3bea48fce tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:23.096525 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3b72b0a-51b7-4d40-a010-4eb3bea48fce tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:23.097368 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3b72b0a-51b7-4d40-a010-4eb3bea48fce tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:23.097999 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3b72b0a-51b7-4d40-a010-4eb3bea48fce tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:23.098895 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3b72b0a-51b7-4d40-a010-4eb3bea48fce tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:23.099515 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3b72b0a-51b7-4d40-a010-4eb3bea48fce tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:23.100101 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3b72b0a-51b7-4d40-a010-4eb3bea48fce tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:23.130790 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-742815f9-5120-4d26-b109-3ecee94fc5d2 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c27994e138c42ffbe4d9151b776ae6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2164f4bcd424ffbace7a1baf85f36db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:23.146160 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-742815f9-5120-4d26-b109-3ecee94fc5d2 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] 10.222.0.60 "GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793" status: 200 len: 1523 microversion: 2.1 time: 0.429934 Oct 18 15:52:23.147105 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2828/5633] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:22 2022] GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793 => generated 1523 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:52:23.258575 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d3b72b0a-51b7-4d40-a010-4eb3bea48fce tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "PUT /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6" status: 200 len: 1060 microversion: 2.1 time: 0.187428 Oct 18 15:52:23.265866 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2806/5634] 10.222.0.60 () {60 vars in 1256 bytes} [Tue Oct 18 15:52:23 2022] PUT /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 => generated 1060 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:52:23.282909 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ed32a537-4b7f-4506-94fa-0be8cb6b831c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:23.283542 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ed32a537-4b7f-4506-94fa-0be8cb6b831c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:23.296467 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ed32a537-4b7f-4506-94fa-0be8cb6b831c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:23.297337 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ed32a537-4b7f-4506-94fa-0be8cb6b831c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:23.297455 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ed32a537-4b7f-4506-94fa-0be8cb6b831c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:23.298171 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ed32a537-4b7f-4506-94fa-0be8cb6b831c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:23.298632 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ed32a537-4b7f-4506-94fa-0be8cb6b831c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:23.299061 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ed32a537-4b7f-4506-94fa-0be8cb6b831c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:23.482734 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ed32a537-4b7f-4506-94fa-0be8cb6b831c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:23.493159 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ed32a537-4b7f-4506-94fa-0be8cb6b831c tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6" status: 200 len: 1487 microversion: 2.1 time: 0.216877 Oct 18 15:52:23.493697 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2829/5635] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:23 2022] GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 => generated 1487 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:52:23.517110 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7b5f899d-0e5d-4fdd-8eea-a1ab32cc3df4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:23.518004 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7b5f899d-0e5d-4fdd-8eea-a1ab32cc3df4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:23.524300 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b5f899d-0e5d-4fdd-8eea-a1ab32cc3df4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:23.524794 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b5f899d-0e5d-4fdd-8eea-a1ab32cc3df4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:23.526086 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b5f899d-0e5d-4fdd-8eea-a1ab32cc3df4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:23.526883 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b5f899d-0e5d-4fdd-8eea-a1ab32cc3df4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:23.527336 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b5f899d-0e5d-4fdd-8eea-a1ab32cc3df4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:23.527767 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b5f899d-0e5d-4fdd-8eea-a1ab32cc3df4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:23.716698 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7b5f899d-0e5d-4fdd-8eea-a1ab32cc3df4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:23.726478 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7b5f899d-0e5d-4fdd-8eea-a1ab32cc3df4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6" status: 200 len: 1487 microversion: 2.1 time: 0.214274 Oct 18 15:52:23.742005 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2807/5636] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:23 2022] GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 => generated 1487 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:52:23.753618 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-26d61bbe-2fa4-4358-be79-5e008b6473d7 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:23.755140 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-26d61bbe-2fa4-4358-be79-5e008b6473d7 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:23.762782 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26d61bbe-2fa4-4358-be79-5e008b6473d7 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:23.763302 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26d61bbe-2fa4-4358-be79-5e008b6473d7 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:23.763942 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26d61bbe-2fa4-4358-be79-5e008b6473d7 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:23.764973 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26d61bbe-2fa4-4358-be79-5e008b6473d7 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:23.765977 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26d61bbe-2fa4-4358-be79-5e008b6473d7 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:23.766575 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26d61bbe-2fa4-4358-be79-5e008b6473d7 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:23.798092 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-26d61bbe-2fa4-4358-be79-5e008b6473d7 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:52:23.911799 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-26d61bbe-2fa4-4358-be79-5e008b6473d7 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6" status: 204 len: 0 microversion: 2.1 time: 0.161196 Oct 18 15:52:23.913253 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2830/5637] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:52:23 2022] DELETE /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:52:23.924581 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-44d0c389-5aee-4d9d-bb13-f08814df273a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:23.925841 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-44d0c389-5aee-4d9d-bb13-f08814df273a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:23.950886 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44d0c389-5aee-4d9d-bb13-f08814df273a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:23.951884 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44d0c389-5aee-4d9d-bb13-f08814df273a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:23.956716 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44d0c389-5aee-4d9d-bb13-f08814df273a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:23.958024 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44d0c389-5aee-4d9d-bb13-f08814df273a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:23.959646 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44d0c389-5aee-4d9d-bb13-f08814df273a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:23.960764 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44d0c389-5aee-4d9d-bb13-f08814df273a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:24.008567 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:24.175376 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9e7da52c-df43-4920-a615-84bbde416eb0 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:24.176463 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9e7da52c-df43-4920-a615-84bbde416eb0 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] [instance: bfd97d9c-daf6-4503-8fd1-ae8750a24793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:24.192594 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9e7da52c-df43-4920-a615-84bbde416eb0 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:24.193108 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9e7da52c-df43-4920-a615-84bbde416eb0 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:24.193725 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9e7da52c-df43-4920-a615-84bbde416eb0 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:24.194604 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9e7da52c-df43-4920-a615-84bbde416eb0 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:24.195206 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9e7da52c-df43-4920-a615-84bbde416eb0 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:24.195781 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9e7da52c-df43-4920-a615-84bbde416eb0 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:24.692968 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-44d0c389-5aee-4d9d-bb13-f08814df273a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:24.708863 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-44d0c389-5aee-4d9d-bb13-f08814df273a tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6" status: 200 len: 1493 microversion: 2.1 time: 0.789997 Oct 18 15:52:24.709689 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2808/5638] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:23 2022] GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 => generated 1493 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:52:24.817746 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9e7da52c-df43-4920-a615-84bbde416eb0 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c27994e138c42ffbe4d9151b776ae6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2164f4bcd424ffbace7a1baf85f36db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:24.835042 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9e7da52c-df43-4920-a615-84bbde416eb0 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] 10.222.0.60 "GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793" status: 200 len: 1523 microversion: 2.1 time: 0.664036 Oct 18 15:52:24.840551 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2831/5639] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:24 2022] GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793 => generated 1523 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:52:25.734964 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-577420c5-5963-4b0c-82c6-98e07591aae6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:25.735814 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-577420c5-5963-4b0c-82c6-98e07591aae6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:25.743426 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-577420c5-5963-4b0c-82c6-98e07591aae6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:25.744067 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-577420c5-5963-4b0c-82c6-98e07591aae6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:25.744741 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-577420c5-5963-4b0c-82c6-98e07591aae6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:25.745683 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-577420c5-5963-4b0c-82c6-98e07591aae6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:25.746248 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-577420c5-5963-4b0c-82c6-98e07591aae6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:25.746927 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-577420c5-5963-4b0c-82c6-98e07591aae6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:25.858728 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b24d614d-2083-46b9-b0c3-1fcc20374170 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:25.859535 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b24d614d-2083-46b9-b0c3-1fcc20374170 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] [instance: bfd97d9c-daf6-4503-8fd1-ae8750a24793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:25.867227 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b24d614d-2083-46b9-b0c3-1fcc20374170 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:25.868186 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b24d614d-2083-46b9-b0c3-1fcc20374170 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:25.868861 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b24d614d-2083-46b9-b0c3-1fcc20374170 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:25.869692 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b24d614d-2083-46b9-b0c3-1fcc20374170 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:25.870321 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b24d614d-2083-46b9-b0c3-1fcc20374170 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:25.870759 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b24d614d-2083-46b9-b0c3-1fcc20374170 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:26.121204 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-577420c5-5963-4b0c-82c6-98e07591aae6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:26.154517 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-577420c5-5963-4b0c-82c6-98e07591aae6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6" status: 200 len: 1493 microversion: 2.1 time: 0.421129 Oct 18 15:52:26.156387 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2809/5640] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:25 2022] GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 => generated 1493 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:52:26.283387 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b24d614d-2083-46b9-b0c3-1fcc20374170 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c27994e138c42ffbe4d9151b776ae6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2164f4bcd424ffbace7a1baf85f36db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:26.300197 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b24d614d-2083-46b9-b0c3-1fcc20374170 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] 10.222.0.60 "GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793" status: 200 len: 1523 microversion: 2.1 time: 0.445383 Oct 18 15:52:26.301413 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2832/5641] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:25 2022] GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793 => generated 1523 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:52:26.725404 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-7f06fe0a-a468-4d54-801f-0ab9161e09ac req-ee9490df-6a92-4690-93e8-dc971e029af8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6", "name": "network-vif-deleted", "tag": "ce0d7a7c-9381-448c-a84f-9a9bd1cc6802"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:52:26.750664 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7f06fe0a-a468-4d54-801f-0ab9161e09ac req-ee9490df-6a92-4690-93e8-dc971e029af8 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:26.751854 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7f06fe0a-a468-4d54-801f-0ab9161e09ac req-ee9490df-6a92-4690-93e8-dc971e029af8 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:26.752452 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7f06fe0a-a468-4d54-801f-0ab9161e09ac req-ee9490df-6a92-4690-93e8-dc971e029af8 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:26.773418 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-7f06fe0a-a468-4d54-801f-0ab9161e09ac req-ee9490df-6a92-4690-93e8-dc971e029af8 service nova] Creating event network-vif-deleted:ce0d7a7c-9381-448c-a84f-9a9bd1cc6802 for instance e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 on n-h1-853682-5 Oct 18 15:52:26.789307 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-7f06fe0a-a468-4d54-801f-0ab9161e09ac req-ee9490df-6a92-4690-93e8-dc971e029af8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067847 Oct 18 15:52:26.790316 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2810/5642] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:52:27.189486 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9e37d68b-a198-4e55-a374-be341c94fbe2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:27.193923 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9e37d68b-a198-4e55-a374-be341c94fbe2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:27.213515 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9e37d68b-a198-4e55-a374-be341c94fbe2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:27.217554 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9e37d68b-a198-4e55-a374-be341c94fbe2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:27.218141 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9e37d68b-a198-4e55-a374-be341c94fbe2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:27.220731 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9e37d68b-a198-4e55-a374-be341c94fbe2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:27.222808 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9e37d68b-a198-4e55-a374-be341c94fbe2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:27.223469 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9e37d68b-a198-4e55-a374-be341c94fbe2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:27.315298 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9e37d68b-a198-4e55-a374-be341c94fbe2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:27.315994 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9e37d68b-a198-4e55-a374-be341c94fbe2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:27.316825 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9e37d68b-a198-4e55-a374-be341c94fbe2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:27.317695 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-9e37d68b-a198-4e55-a374-be341c94fbe2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lazy-loading 'fault' on Instance uuid e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:52:27.324342 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dc8f95f7-8146-4c00-a556-88461864fe9d tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:27.325092 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dc8f95f7-8146-4c00-a556-88461864fe9d tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] [instance: bfd97d9c-daf6-4503-8fd1-ae8750a24793] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:27.336399 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc8f95f7-8146-4c00-a556-88461864fe9d tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:27.337184 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc8f95f7-8146-4c00-a556-88461864fe9d tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:27.337779 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc8f95f7-8146-4c00-a556-88461864fe9d tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:27.338640 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc8f95f7-8146-4c00-a556-88461864fe9d tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:27.339244 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc8f95f7-8146-4c00-a556-88461864fe9d tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:27.339938 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc8f95f7-8146-4c00-a556-88461864fe9d tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:27.435225 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9e37d68b-a198-4e55-a374-be341c94fbe2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:27.449030 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9e37d68b-a198-4e55-a374-be341c94fbe2 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6" status: 200 len: 1310 microversion: 2.1 time: 0.273063 Oct 18 15:52:27.454423 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2833/5643] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:27 2022] GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 => generated 1310 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:52:27.716722 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dc8f95f7-8146-4c00-a556-88461864fe9d tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c27994e138c42ffbe4d9151b776ae6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2164f4bcd424ffbace7a1baf85f36db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:27.732275 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dc8f95f7-8146-4c00-a556-88461864fe9d tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] 10.222.0.60 "GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793" status: 200 len: 1523 microversion: 2.1 time: 0.411896 Oct 18 15:52:27.733181 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2811/5644] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:27 2022] GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793 => generated 1523 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:52:28.478989 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d7fac04e-3dcd-4806-bd24-5926d90d8675 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:28.479608 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d7fac04e-3dcd-4806-bd24-5926d90d8675 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:28.494820 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d7fac04e-3dcd-4806-bd24-5926d90d8675 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:28.495668 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d7fac04e-3dcd-4806-bd24-5926d90d8675 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:28.495775 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d7fac04e-3dcd-4806-bd24-5926d90d8675 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:28.496425 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d7fac04e-3dcd-4806-bd24-5926d90d8675 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:28.498670 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d7fac04e-3dcd-4806-bd24-5926d90d8675 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:28.499773 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d7fac04e-3dcd-4806-bd24-5926d90d8675 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:28.539619 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-d7fac04e-3dcd-4806-bd24-5926d90d8675 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] HTTP exception thrown: Instance e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 could not be found. Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d7fac04e-3dcd-4806-bd24-5926d90d8675 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Request method failure captured: Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 HTTP/1.1 Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsrEJhXnu9-kA1ME2ZgtL01L1ZZn_p1cwLPkqNlVzGclz5bmzyyOf2BB4P7wVe6-U6KsqFzM-iyEynyHjx99j1zL9TNO9M1_0gjdhVd46w55yQ-UymJhYbErDED9EKpU_GJnghtBqaCd9UvgTeTf4e4PvQGeOp69vMSi60uoNlhyAmg Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: afdb1e8b478f463987ec223f2d10db33 Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServersTestJSON-126042862 Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServersTestJSON-126042862 Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: afdb1e8b478f463987ec223f2d10db33 Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServersTestJSON-126042862 Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServersTestJSON-126042862-project Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 73f4ee2e7ff34dd88b9b82fefbf06a36 Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServersTestJSON-126042862-project Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 could not be found. Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6'} Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 could not be found. Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 could not be found. Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:52:28.548758 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:28.552520 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:52:28.552520 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:52:28.552520 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:52:28.552520 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:52:28.552520 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 could not be found. Oct 18 15:52:28.552520 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:52:28.552520 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d7fac04e-3dcd-4806-bd24-5926d90d8675 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Returning 404 to user: Instance e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:52:28.554381 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d7fac04e-3dcd-4806-bd24-5926d90d8675 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6" status: 404 len: 111 microversion: 2.1 time: 0.075384 Oct 18 15:52:28.554381 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2834/5645] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:28 2022] GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:52:28.572491 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-33727375-c065-4a82-b8f0-2a4b9e0272e6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:28.573746 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-33727375-c065-4a82-b8f0-2a4b9e0272e6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:28.583775 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33727375-c065-4a82-b8f0-2a4b9e0272e6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:28.584455 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33727375-c065-4a82-b8f0-2a4b9e0272e6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:28.585219 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33727375-c065-4a82-b8f0-2a4b9e0272e6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:28.586104 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33727375-c065-4a82-b8f0-2a4b9e0272e6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:28.587266 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33727375-c065-4a82-b8f0-2a4b9e0272e6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:28.587876 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33727375-c065-4a82-b8f0-2a4b9e0272e6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:28.608191 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-33727375-c065-4a82-b8f0-2a4b9e0272e6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] HTTP exception thrown: Instance e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 could not be found. Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-33727375-c065-4a82-b8f0-2a4b9e0272e6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Request method failure captured: Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 HTTP/1.1 Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsrEJhXnu9-kA1ME2ZgtL01L1ZZn_p1cwLPkqNlVzGclz5bmzyyOf2BB4P7wVe6-U6KsqFzM-iyEynyHjx99j1zL9TNO9M1_0gjdhVd46w55yQ-UymJhYbErDED9EKpU_GJnghtBqaCd9UvgTeTf4e4PvQGeOp69vMSi60uoNlhyAmg Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: afdb1e8b478f463987ec223f2d10db33 Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersTestJSON-126042862 Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersTestJSON-126042862 Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: afdb1e8b478f463987ec223f2d10db33 Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersTestJSON-126042862 Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersTestJSON-126042862-project Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 73f4ee2e7ff34dd88b9b82fefbf06a36 Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersTestJSON-126042862-project Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 could not be found. Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6'} Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 could not be found. Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:52:28.611198 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 could not be found. Oct 18 15:52:28.614795 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:52:28.614795 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:52:28.614795 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:52:28.614795 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:28.614795 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:52:28.614795 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:52:28.614795 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:52:28.614795 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:52:28.614795 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 could not be found. Oct 18 15:52:28.614795 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:52:28.635438 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-33727375-c065-4a82-b8f0-2a4b9e0272e6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Returning 404 to user: Instance e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:52:28.636465 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-33727375-c065-4a82-b8f0-2a4b9e0272e6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6" status: 404 len: 111 microversion: 2.1 time: 0.072155 Oct 18 15:52:28.642853 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2812/5646] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:52:28 2022] DELETE /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:52:28.649442 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d032f82e-2e5d-4782-af3e-bec1d9da9278 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:28.650137 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d032f82e-2e5d-4782-af3e-bec1d9da9278 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:28.663475 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d032f82e-2e5d-4782-af3e-bec1d9da9278 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:28.665154 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d032f82e-2e5d-4782-af3e-bec1d9da9278 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:28.668896 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d032f82e-2e5d-4782-af3e-bec1d9da9278 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:28.671007 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d032f82e-2e5d-4782-af3e-bec1d9da9278 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:28.673198 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d032f82e-2e5d-4782-af3e-bec1d9da9278 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:28.676293 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d032f82e-2e5d-4782-af3e-bec1d9da9278 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:28.710504 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-d032f82e-2e5d-4782-af3e-bec1d9da9278 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] HTTP exception thrown: Instance e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 could not be found. Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d032f82e-2e5d-4782-af3e-bec1d9da9278 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Request method failure captured: Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 HTTP/1.1 Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsrEJhXnu9-kA1ME2ZgtL01L1ZZn_p1cwLPkqNlVzGclz5bmzyyOf2BB4P7wVe6-U6KsqFzM-iyEynyHjx99j1zL9TNO9M1_0gjdhVd46w55yQ-UymJhYbErDED9EKpU_GJnghtBqaCd9UvgTeTf4e4PvQGeOp69vMSi60uoNlhyAmg Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: afdb1e8b478f463987ec223f2d10db33 Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServersTestJSON-126042862 Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServersTestJSON-126042862 Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: afdb1e8b478f463987ec223f2d10db33 Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServersTestJSON-126042862 Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServersTestJSON-126042862-project Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 73f4ee2e7ff34dd88b9b82fefbf06a36 Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServersTestJSON-126042862-project Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 could not be found. Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6'} Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 could not be found. Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 could not be found. Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:52:28.715432 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:28.720055 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:52:28.720055 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:52:28.720055 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:52:28.720055 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:52:28.720055 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 could not be found. Oct 18 15:52:28.720055 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:52:28.724201 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d032f82e-2e5d-4782-af3e-bec1d9da9278 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Returning 404 to user: Instance e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:52:28.731265 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d032f82e-2e5d-4782-af3e-bec1d9da9278 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6" status: 404 len: 111 microversion: 2.1 time: 0.087043 Oct 18 15:52:28.732594 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2835/5647] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:28 2022] GET /compute/v2.1/servers/e4dd421a-8fcb-4d2c-bd3c-6f1e023e8bb6 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 15:52:28.741004 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-484bd362-db73-472d-87f8-3971cdf09633 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:28.741521 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-484bd362-db73-472d-87f8-3971cdf09633 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 6275fe37-a499-43c2-ac51-d776052c7f43] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:28.755703 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ece4f605-704f-4f6b-a838-6bff899290cb tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:28.756328 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ece4f605-704f-4f6b-a838-6bff899290cb tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] [instance: bfd97d9c-daf6-4503-8fd1-ae8750a24793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:28.758733 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-484bd362-db73-472d-87f8-3971cdf09633 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:28.759239 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-484bd362-db73-472d-87f8-3971cdf09633 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:28.759681 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-484bd362-db73-472d-87f8-3971cdf09633 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:28.760405 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-484bd362-db73-472d-87f8-3971cdf09633 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:28.769303 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-484bd362-db73-472d-87f8-3971cdf09633 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:28.769859 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-484bd362-db73-472d-87f8-3971cdf09633 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:28.788136 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ece4f605-704f-4f6b-a838-6bff899290cb tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:28.788698 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ece4f605-704f-4f6b-a838-6bff899290cb tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:28.789217 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ece4f605-704f-4f6b-a838-6bff899290cb tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:28.789974 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ece4f605-704f-4f6b-a838-6bff899290cb tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:28.790439 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ece4f605-704f-4f6b-a838-6bff899290cb tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:28.790874 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ece4f605-704f-4f6b-a838-6bff899290cb tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:28.824268 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-484bd362-db73-472d-87f8-3971cdf09633 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] HTTP exception thrown: Instance 6275fe37-a499-43c2-ac51-d776052c7f43 could not be found. Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-484bd362-db73-472d-87f8-3971cdf09633 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Request method failure captured: Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/6275fe37-a499-43c2-ac51-d776052c7f43 HTTP/1.1 Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsrEJhXnu9-kA1ME2ZgtL01L1ZZn_p1cwLPkqNlVzGclz5bmzyyOf2BB4P7wVe6-U6KsqFzM-iyEynyHjx99j1zL9TNO9M1_0gjdhVd46w55yQ-UymJhYbErDED9EKpU_GJnghtBqaCd9UvgTeTf4e4PvQGeOp69vMSi60uoNlhyAmg Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: afdb1e8b478f463987ec223f2d10db33 Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersTestJSON-126042862 Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersTestJSON-126042862 Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: afdb1e8b478f463987ec223f2d10db33 Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersTestJSON-126042862 Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersTestJSON-126042862-project Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 73f4ee2e7ff34dd88b9b82fefbf06a36 Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersTestJSON-126042862-project Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 6275fe37-a499-43c2-ac51-d776052c7f43 could not be found. Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '6275fe37-a499-43c2-ac51-d776052c7f43'} Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6275fe37-a499-43c2-ac51-d776052c7f43 could not be found. Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:52:28.826465 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6275fe37-a499-43c2-ac51-d776052c7f43 could not be found. Oct 18 15:52:28.829907 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:52:28.829907 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:52:28.829907 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:52:28.829907 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:28.829907 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:52:28.829907 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:52:28.829907 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:52:28.829907 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:52:28.829907 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6275fe37-a499-43c2-ac51-d776052c7f43 could not be found. Oct 18 15:52:28.829907 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:52:28.836003 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-484bd362-db73-472d-87f8-3971cdf09633 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Returning 404 to user: Instance 6275fe37-a499-43c2-ac51-d776052c7f43 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:52:28.838884 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-484bd362-db73-472d-87f8-3971cdf09633 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6275fe37-a499-43c2-ac51-d776052c7f43" status: 404 len: 111 microversion: 2.1 time: 0.102101 Oct 18 15:52:28.844214 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2813/5648] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:52:28 2022] DELETE /compute/v2.1/servers/6275fe37-a499-43c2-ac51-d776052c7f43 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:52:28.851490 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1bc4f2d6-9391-4060-afdf-61f335fc3518 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:28.853577 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1bc4f2d6-9391-4060-afdf-61f335fc3518 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 6275fe37-a499-43c2-ac51-d776052c7f43] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:28.876831 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1bc4f2d6-9391-4060-afdf-61f335fc3518 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:28.879165 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1bc4f2d6-9391-4060-afdf-61f335fc3518 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:28.880133 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1bc4f2d6-9391-4060-afdf-61f335fc3518 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:28.881373 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1bc4f2d6-9391-4060-afdf-61f335fc3518 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:28.882069 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1bc4f2d6-9391-4060-afdf-61f335fc3518 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:28.882900 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1bc4f2d6-9391-4060-afdf-61f335fc3518 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:28.903280 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-1bc4f2d6-9391-4060-afdf-61f335fc3518 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] HTTP exception thrown: Instance 6275fe37-a499-43c2-ac51-d776052c7f43 could not be found. Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1bc4f2d6-9391-4060-afdf-61f335fc3518 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Request method failure captured: Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/6275fe37-a499-43c2-ac51-d776052c7f43 HTTP/1.1 Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsrEJhXnu9-kA1ME2ZgtL01L1ZZn_p1cwLPkqNlVzGclz5bmzyyOf2BB4P7wVe6-U6KsqFzM-iyEynyHjx99j1zL9TNO9M1_0gjdhVd46w55yQ-UymJhYbErDED9EKpU_GJnghtBqaCd9UvgTeTf4e4PvQGeOp69vMSi60uoNlhyAmg Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: afdb1e8b478f463987ec223f2d10db33 Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersTestJSON-126042862 Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersTestJSON-126042862 Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: afdb1e8b478f463987ec223f2d10db33 Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersTestJSON-126042862 Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersTestJSON-126042862-project Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 73f4ee2e7ff34dd88b9b82fefbf06a36 Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersTestJSON-126042862-project Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 6275fe37-a499-43c2-ac51-d776052c7f43 could not be found. Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '6275fe37-a499-43c2-ac51-d776052c7f43'} Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6275fe37-a499-43c2-ac51-d776052c7f43 could not be found. Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6275fe37-a499-43c2-ac51-d776052c7f43 could not be found. Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:52:28.905810 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:28.909963 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:52:28.909963 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:52:28.909963 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:52:28.909963 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:52:28.909963 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6275fe37-a499-43c2-ac51-d776052c7f43 could not be found. Oct 18 15:52:28.909963 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:52:28.911949 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1bc4f2d6-9391-4060-afdf-61f335fc3518 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Returning 404 to user: Instance 6275fe37-a499-43c2-ac51-d776052c7f43 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:52:28.913287 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1bc4f2d6-9391-4060-afdf-61f335fc3518 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/6275fe37-a499-43c2-ac51-d776052c7f43" status: 404 len: 111 microversion: 2.1 time: 0.067668 Oct 18 15:52:28.914082 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2814/5649] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:28 2022] GET /compute/v2.1/servers/6275fe37-a499-43c2-ac51-d776052c7f43 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:52:28.930449 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-94cae448-43cb-4cb3-b0ea-c3579950e4f1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:28.931181 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-94cae448-43cb-4cb3-b0ea-c3579950e4f1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 4ccaffe8-f3ed-47df-a9ee-5437c24b469c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:28.946986 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94cae448-43cb-4cb3-b0ea-c3579950e4f1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:28.949286 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94cae448-43cb-4cb3-b0ea-c3579950e4f1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:28.953644 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94cae448-43cb-4cb3-b0ea-c3579950e4f1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:28.954782 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94cae448-43cb-4cb3-b0ea-c3579950e4f1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:28.955525 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94cae448-43cb-4cb3-b0ea-c3579950e4f1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:28.957828 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94cae448-43cb-4cb3-b0ea-c3579950e4f1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:28.992777 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-94cae448-43cb-4cb3-b0ea-c3579950e4f1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] HTTP exception thrown: Instance 4ccaffe8-f3ed-47df-a9ee-5437c24b469c could not be found. Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-94cae448-43cb-4cb3-b0ea-c3579950e4f1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Request method failure captured: Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/4ccaffe8-f3ed-47df-a9ee-5437c24b469c HTTP/1.1 Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsrEJhXnu9-kA1ME2ZgtL01L1ZZn_p1cwLPkqNlVzGclz5bmzyyOf2BB4P7wVe6-U6KsqFzM-iyEynyHjx99j1zL9TNO9M1_0gjdhVd46w55yQ-UymJhYbErDED9EKpU_GJnghtBqaCd9UvgTeTf4e4PvQGeOp69vMSi60uoNlhyAmg Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: afdb1e8b478f463987ec223f2d10db33 Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersTestJSON-126042862 Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersTestJSON-126042862 Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: afdb1e8b478f463987ec223f2d10db33 Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersTestJSON-126042862 Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersTestJSON-126042862-project Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 73f4ee2e7ff34dd88b9b82fefbf06a36 Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersTestJSON-126042862-project Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 4ccaffe8-f3ed-47df-a9ee-5437c24b469c could not be found. Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '4ccaffe8-f3ed-47df-a9ee-5437c24b469c'} Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ccaffe8-f3ed-47df-a9ee-5437c24b469c could not be found. Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:52:28.996371 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ccaffe8-f3ed-47df-a9ee-5437c24b469c could not be found. Oct 18 15:52:29.000377 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:52:29.000377 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:52:29.000377 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:52:29.000377 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:29.000377 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:52:29.000377 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:52:29.000377 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:52:29.000377 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:52:29.000377 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ccaffe8-f3ed-47df-a9ee-5437c24b469c could not be found. Oct 18 15:52:29.000377 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:52:29.003151 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-94cae448-43cb-4cb3-b0ea-c3579950e4f1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Returning 404 to user: Instance 4ccaffe8-f3ed-47df-a9ee-5437c24b469c could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:52:29.004231 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-94cae448-43cb-4cb3-b0ea-c3579950e4f1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4ccaffe8-f3ed-47df-a9ee-5437c24b469c" status: 404 len: 111 microversion: 2.1 time: 0.084129 Oct 18 15:52:29.008452 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2815/5650] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:52:28 2022] DELETE /compute/v2.1/servers/4ccaffe8-f3ed-47df-a9ee-5437c24b469c => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:52:29.015962 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-263d6d3e-2750-446d-b8a0-dffed83609b0 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:29.017256 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-263d6d3e-2750-446d-b8a0-dffed83609b0 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 4ccaffe8-f3ed-47df-a9ee-5437c24b469c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:29.025489 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-263d6d3e-2750-446d-b8a0-dffed83609b0 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:29.026346 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-263d6d3e-2750-446d-b8a0-dffed83609b0 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:29.027000 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-263d6d3e-2750-446d-b8a0-dffed83609b0 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:29.027947 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-263d6d3e-2750-446d-b8a0-dffed83609b0 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:29.029576 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-263d6d3e-2750-446d-b8a0-dffed83609b0 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:29.030233 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-263d6d3e-2750-446d-b8a0-dffed83609b0 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:29.052444 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-263d6d3e-2750-446d-b8a0-dffed83609b0 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] HTTP exception thrown: Instance 4ccaffe8-f3ed-47df-a9ee-5437c24b469c could not be found. Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-263d6d3e-2750-446d-b8a0-dffed83609b0 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Request method failure captured: Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/4ccaffe8-f3ed-47df-a9ee-5437c24b469c HTTP/1.1 Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsrEJhXnu9-kA1ME2ZgtL01L1ZZn_p1cwLPkqNlVzGclz5bmzyyOf2BB4P7wVe6-U6KsqFzM-iyEynyHjx99j1zL9TNO9M1_0gjdhVd46w55yQ-UymJhYbErDED9EKpU_GJnghtBqaCd9UvgTeTf4e4PvQGeOp69vMSi60uoNlhyAmg Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: afdb1e8b478f463987ec223f2d10db33 Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersTestJSON-126042862 Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersTestJSON-126042862 Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: afdb1e8b478f463987ec223f2d10db33 Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersTestJSON-126042862 Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersTestJSON-126042862-project Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 73f4ee2e7ff34dd88b9b82fefbf06a36 Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersTestJSON-126042862-project Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 4ccaffe8-f3ed-47df-a9ee-5437c24b469c could not be found. Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '4ccaffe8-f3ed-47df-a9ee-5437c24b469c'} Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ccaffe8-f3ed-47df-a9ee-5437c24b469c could not be found. Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ccaffe8-f3ed-47df-a9ee-5437c24b469c could not be found. Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:52:29.054756 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:29.058431 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:52:29.058431 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:52:29.058431 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:52:29.058431 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:52:29.058431 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ccaffe8-f3ed-47df-a9ee-5437c24b469c could not be found. Oct 18 15:52:29.058431 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:52:29.070623 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-263d6d3e-2750-446d-b8a0-dffed83609b0 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Returning 404 to user: Instance 4ccaffe8-f3ed-47df-a9ee-5437c24b469c could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:52:29.071982 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-263d6d3e-2750-446d-b8a0-dffed83609b0 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/4ccaffe8-f3ed-47df-a9ee-5437c24b469c" status: 404 len: 111 microversion: 2.1 time: 0.062095 Oct 18 15:52:29.076328 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2816/5651] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:29 2022] GET /compute/v2.1/servers/4ccaffe8-f3ed-47df-a9ee-5437c24b469c => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:52:29.084590 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2531326e-e5d8-401f-8650-c3b6a9233820 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:29.086450 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2531326e-e5d8-401f-8650-c3b6a9233820 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: d3069d75-261b-4abe-a68b-fc25cac7e549] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:29.095752 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2531326e-e5d8-401f-8650-c3b6a9233820 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:29.096609 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2531326e-e5d8-401f-8650-c3b6a9233820 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:29.097286 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2531326e-e5d8-401f-8650-c3b6a9233820 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:29.098498 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2531326e-e5d8-401f-8650-c3b6a9233820 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:29.099364 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2531326e-e5d8-401f-8650-c3b6a9233820 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:29.100034 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2531326e-e5d8-401f-8650-c3b6a9233820 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:29.121558 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-2531326e-e5d8-401f-8650-c3b6a9233820 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] HTTP exception thrown: Instance d3069d75-261b-4abe-a68b-fc25cac7e549 could not be found. Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2531326e-e5d8-401f-8650-c3b6a9233820 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Request method failure captured: Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/d3069d75-261b-4abe-a68b-fc25cac7e549 HTTP/1.1 Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsrEJhXnu9-kA1ME2ZgtL01L1ZZn_p1cwLPkqNlVzGclz5bmzyyOf2BB4P7wVe6-U6KsqFzM-iyEynyHjx99j1zL9TNO9M1_0gjdhVd46w55yQ-UymJhYbErDED9EKpU_GJnghtBqaCd9UvgTeTf4e4PvQGeOp69vMSi60uoNlhyAmg Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: afdb1e8b478f463987ec223f2d10db33 Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersTestJSON-126042862 Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersTestJSON-126042862 Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: afdb1e8b478f463987ec223f2d10db33 Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersTestJSON-126042862 Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersTestJSON-126042862-project Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 73f4ee2e7ff34dd88b9b82fefbf06a36 Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersTestJSON-126042862-project Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance d3069d75-261b-4abe-a68b-fc25cac7e549 could not be found. Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'd3069d75-261b-4abe-a68b-fc25cac7e549'} Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3069d75-261b-4abe-a68b-fc25cac7e549 could not be found. Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:52:29.124274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3069d75-261b-4abe-a68b-fc25cac7e549 could not be found. Oct 18 15:52:29.127862 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:52:29.127862 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:52:29.127862 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:52:29.127862 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:29.127862 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:52:29.127862 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:52:29.127862 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:52:29.127862 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:52:29.127862 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3069d75-261b-4abe-a68b-fc25cac7e549 could not be found. Oct 18 15:52:29.127862 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:52:29.129466 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2531326e-e5d8-401f-8650-c3b6a9233820 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Returning 404 to user: Instance d3069d75-261b-4abe-a68b-fc25cac7e549 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:52:29.130653 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2531326e-e5d8-401f-8650-c3b6a9233820 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d3069d75-261b-4abe-a68b-fc25cac7e549" status: 404 len: 111 microversion: 2.1 time: 0.052348 Oct 18 15:52:29.131655 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2817/5652] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:52:29 2022] DELETE /compute/v2.1/servers/d3069d75-261b-4abe-a68b-fc25cac7e549 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:52:29.142435 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0ecc4424-f666-498c-bf75-fbae9c27ae95 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:29.143455 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0ecc4424-f666-498c-bf75-fbae9c27ae95 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: d3069d75-261b-4abe-a68b-fc25cac7e549] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:29.150451 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ecc4424-f666-498c-bf75-fbae9c27ae95 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:29.151334 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ecc4424-f666-498c-bf75-fbae9c27ae95 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:29.152104 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ecc4424-f666-498c-bf75-fbae9c27ae95 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:29.153159 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ecc4424-f666-498c-bf75-fbae9c27ae95 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:29.153920 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ecc4424-f666-498c-bf75-fbae9c27ae95 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:29.154582 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ecc4424-f666-498c-bf75-fbae9c27ae95 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:29.174436 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-0ecc4424-f666-498c-bf75-fbae9c27ae95 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] HTTP exception thrown: Instance d3069d75-261b-4abe-a68b-fc25cac7e549 could not be found. Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0ecc4424-f666-498c-bf75-fbae9c27ae95 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Request method failure captured: Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/d3069d75-261b-4abe-a68b-fc25cac7e549 HTTP/1.1 Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsrEJhXnu9-kA1ME2ZgtL01L1ZZn_p1cwLPkqNlVzGclz5bmzyyOf2BB4P7wVe6-U6KsqFzM-iyEynyHjx99j1zL9TNO9M1_0gjdhVd46w55yQ-UymJhYbErDED9EKpU_GJnghtBqaCd9UvgTeTf4e4PvQGeOp69vMSi60uoNlhyAmg Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: afdb1e8b478f463987ec223f2d10db33 Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersTestJSON-126042862 Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersTestJSON-126042862 Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: afdb1e8b478f463987ec223f2d10db33 Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersTestJSON-126042862 Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersTestJSON-126042862-project Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 73f4ee2e7ff34dd88b9b82fefbf06a36 Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersTestJSON-126042862-project Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance d3069d75-261b-4abe-a68b-fc25cac7e549 could not be found. Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'd3069d75-261b-4abe-a68b-fc25cac7e549'} Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3069d75-261b-4abe-a68b-fc25cac7e549 could not be found. Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3069d75-261b-4abe-a68b-fc25cac7e549 could not be found. Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:52:29.177265 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:29.182203 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:52:29.182203 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:52:29.182203 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:52:29.182203 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:52:29.182203 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3069d75-261b-4abe-a68b-fc25cac7e549 could not be found. Oct 18 15:52:29.182203 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:52:29.184344 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0ecc4424-f666-498c-bf75-fbae9c27ae95 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Returning 404 to user: Instance d3069d75-261b-4abe-a68b-fc25cac7e549 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:52:29.186246 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0ecc4424-f666-498c-bf75-fbae9c27ae95 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/d3069d75-261b-4abe-a68b-fc25cac7e549" status: 404 len: 111 microversion: 2.1 time: 0.050095 Oct 18 15:52:29.187233 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2818/5653] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:29 2022] GET /compute/v2.1/servers/d3069d75-261b-4abe-a68b-fc25cac7e549 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:52:29.195600 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-14a1d73f-c95e-4477-b128-aa6f7ccba6ed tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:29.196106 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-14a1d73f-c95e-4477-b128-aa6f7ccba6ed tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 4b8310b3-c20d-4832-a680-96c9120e3f00] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:29.203790 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14a1d73f-c95e-4477-b128-aa6f7ccba6ed tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:29.204518 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14a1d73f-c95e-4477-b128-aa6f7ccba6ed tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:29.205176 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14a1d73f-c95e-4477-b128-aa6f7ccba6ed tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:29.206241 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14a1d73f-c95e-4477-b128-aa6f7ccba6ed tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:29.207053 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14a1d73f-c95e-4477-b128-aa6f7ccba6ed tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:29.207860 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14a1d73f-c95e-4477-b128-aa6f7ccba6ed tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:29.222878 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-14a1d73f-c95e-4477-b128-aa6f7ccba6ed tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] HTTP exception thrown: Instance 4b8310b3-c20d-4832-a680-96c9120e3f00 could not be found. Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-14a1d73f-c95e-4477-b128-aa6f7ccba6ed tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Request method failure captured: Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/4b8310b3-c20d-4832-a680-96c9120e3f00 HTTP/1.1 Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsrEJhXnu9-kA1ME2ZgtL01L1ZZn_p1cwLPkqNlVzGclz5bmzyyOf2BB4P7wVe6-U6KsqFzM-iyEynyHjx99j1zL9TNO9M1_0gjdhVd46w55yQ-UymJhYbErDED9EKpU_GJnghtBqaCd9UvgTeTf4e4PvQGeOp69vMSi60uoNlhyAmg Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: afdb1e8b478f463987ec223f2d10db33 Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersTestJSON-126042862 Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersTestJSON-126042862 Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: afdb1e8b478f463987ec223f2d10db33 Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersTestJSON-126042862 Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersTestJSON-126042862-project Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 73f4ee2e7ff34dd88b9b82fefbf06a36 Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersTestJSON-126042862-project Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 4b8310b3-c20d-4832-a680-96c9120e3f00 could not be found. Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '4b8310b3-c20d-4832-a680-96c9120e3f00'} Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b8310b3-c20d-4832-a680-96c9120e3f00 could not be found. Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:52:29.224774 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b8310b3-c20d-4832-a680-96c9120e3f00 could not be found. Oct 18 15:52:29.228350 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:52:29.228350 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:52:29.228350 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:52:29.228350 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:29.228350 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:52:29.228350 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:52:29.228350 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:52:29.228350 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:52:29.228350 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b8310b3-c20d-4832-a680-96c9120e3f00 could not be found. Oct 18 15:52:29.228350 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:52:29.230414 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-14a1d73f-c95e-4477-b128-aa6f7ccba6ed tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Returning 404 to user: Instance 4b8310b3-c20d-4832-a680-96c9120e3f00 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:52:29.231526 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-14a1d73f-c95e-4477-b128-aa6f7ccba6ed tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4b8310b3-c20d-4832-a680-96c9120e3f00" status: 404 len: 111 microversion: 2.1 time: 0.039954 Oct 18 15:52:29.232712 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2819/5654] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:52:29 2022] DELETE /compute/v2.1/servers/4b8310b3-c20d-4832-a680-96c9120e3f00 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 15:52:29.242412 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ed4139c8-9669-4d05-be42-003ed26ec1da tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:29.243142 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ed4139c8-9669-4d05-be42-003ed26ec1da tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 4b8310b3-c20d-4832-a680-96c9120e3f00] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:29.249853 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed4139c8-9669-4d05-be42-003ed26ec1da tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:29.250562 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed4139c8-9669-4d05-be42-003ed26ec1da tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:29.251159 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed4139c8-9669-4d05-be42-003ed26ec1da tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:29.252025 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed4139c8-9669-4d05-be42-003ed26ec1da tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:29.252665 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed4139c8-9669-4d05-be42-003ed26ec1da tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:29.253441 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed4139c8-9669-4d05-be42-003ed26ec1da tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:29.268838 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-ed4139c8-9669-4d05-be42-003ed26ec1da tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] HTTP exception thrown: Instance 4b8310b3-c20d-4832-a680-96c9120e3f00 could not be found. Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ed4139c8-9669-4d05-be42-003ed26ec1da tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Request method failure captured: Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/4b8310b3-c20d-4832-a680-96c9120e3f00 HTTP/1.1 Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsrEJhXnu9-kA1ME2ZgtL01L1ZZn_p1cwLPkqNlVzGclz5bmzyyOf2BB4P7wVe6-U6KsqFzM-iyEynyHjx99j1zL9TNO9M1_0gjdhVd46w55yQ-UymJhYbErDED9EKpU_GJnghtBqaCd9UvgTeTf4e4PvQGeOp69vMSi60uoNlhyAmg Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: afdb1e8b478f463987ec223f2d10db33 Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersTestJSON-126042862 Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersTestJSON-126042862 Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: afdb1e8b478f463987ec223f2d10db33 Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersTestJSON-126042862 Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersTestJSON-126042862-project Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 73f4ee2e7ff34dd88b9b82fefbf06a36 Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersTestJSON-126042862-project Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 4b8310b3-c20d-4832-a680-96c9120e3f00 could not be found. Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '4b8310b3-c20d-4832-a680-96c9120e3f00'} Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b8310b3-c20d-4832-a680-96c9120e3f00 could not be found. Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b8310b3-c20d-4832-a680-96c9120e3f00 could not be found. Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:52:29.271405 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:29.275182 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:52:29.275182 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:52:29.275182 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:52:29.275182 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:52:29.275182 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b8310b3-c20d-4832-a680-96c9120e3f00 could not be found. Oct 18 15:52:29.275182 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:52:29.277144 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ed4139c8-9669-4d05-be42-003ed26ec1da tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Returning 404 to user: Instance 4b8310b3-c20d-4832-a680-96c9120e3f00 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:52:29.278250 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ed4139c8-9669-4d05-be42-003ed26ec1da tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/4b8310b3-c20d-4832-a680-96c9120e3f00" status: 404 len: 111 microversion: 2.1 time: 0.039914 Oct 18 15:52:29.279374 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2820/5655] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:29 2022] GET /compute/v2.1/servers/4b8310b3-c20d-4832-a680-96c9120e3f00 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:52:29.288671 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bae7260f-81fa-49b9-8071-ad88db78ff59 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:29.289515 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bae7260f-81fa-49b9-8071-ad88db78ff59 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 9f83bb30-fed3-427f-bdb6-8013f5bc7b29] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:29.297329 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bae7260f-81fa-49b9-8071-ad88db78ff59 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:29.298174 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bae7260f-81fa-49b9-8071-ad88db78ff59 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:29.298850 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bae7260f-81fa-49b9-8071-ad88db78ff59 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:29.299779 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bae7260f-81fa-49b9-8071-ad88db78ff59 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:29.300509 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bae7260f-81fa-49b9-8071-ad88db78ff59 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:29.301833 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bae7260f-81fa-49b9-8071-ad88db78ff59 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:29.306519 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ece4f605-704f-4f6b-a838-6bff899290cb tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c27994e138c42ffbe4d9151b776ae6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2164f4bcd424ffbace7a1baf85f36db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:29.316729 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ece4f605-704f-4f6b-a838-6bff899290cb tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] 10.222.0.60 "GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793" status: 200 len: 1523 microversion: 2.1 time: 0.564816 Oct 18 15:52:29.318008 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-bae7260f-81fa-49b9-8071-ad88db78ff59 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] HTTP exception thrown: Instance 9f83bb30-fed3-427f-bdb6-8013f5bc7b29 could not be found. Oct 18 15:52:29.318442 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2836/5656] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:28 2022] GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793 => generated 1523 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bae7260f-81fa-49b9-8071-ad88db78ff59 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Request method failure captured: Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/9f83bb30-fed3-427f-bdb6-8013f5bc7b29 HTTP/1.1 Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsrEJhXnu9-kA1ME2ZgtL01L1ZZn_p1cwLPkqNlVzGclz5bmzyyOf2BB4P7wVe6-U6KsqFzM-iyEynyHjx99j1zL9TNO9M1_0gjdhVd46w55yQ-UymJhYbErDED9EKpU_GJnghtBqaCd9UvgTeTf4e4PvQGeOp69vMSi60uoNlhyAmg Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: afdb1e8b478f463987ec223f2d10db33 Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersTestJSON-126042862 Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersTestJSON-126042862 Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: afdb1e8b478f463987ec223f2d10db33 Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersTestJSON-126042862 Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersTestJSON-126042862-project Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 73f4ee2e7ff34dd88b9b82fefbf06a36 Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersTestJSON-126042862-project Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 9f83bb30-fed3-427f-bdb6-8013f5bc7b29 could not be found. Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '9f83bb30-fed3-427f-bdb6-8013f5bc7b29'} Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f83bb30-fed3-427f-bdb6-8013f5bc7b29 could not be found. Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:52:29.327142 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f83bb30-fed3-427f-bdb6-8013f5bc7b29 could not be found. Oct 18 15:52:29.331050 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:52:29.331050 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:52:29.331050 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:52:29.331050 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:29.331050 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:52:29.331050 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:52:29.331050 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:52:29.331050 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:52:29.331050 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f83bb30-fed3-427f-bdb6-8013f5bc7b29 could not be found. Oct 18 15:52:29.331050 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:52:29.349188 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bae7260f-81fa-49b9-8071-ad88db78ff59 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Returning 404 to user: Instance 9f83bb30-fed3-427f-bdb6-8013f5bc7b29 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:52:29.350384 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bae7260f-81fa-49b9-8071-ad88db78ff59 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9f83bb30-fed3-427f-bdb6-8013f5bc7b29" status: 404 len: 111 microversion: 2.1 time: 0.065577 Oct 18 15:52:29.354226 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2821/5657] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:52:29 2022] DELETE /compute/v2.1/servers/9f83bb30-fed3-427f-bdb6-8013f5bc7b29 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:52:29.362752 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e216e79c-090c-4bbc-b464-87772568bd8e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:29.364532 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e216e79c-090c-4bbc-b464-87772568bd8e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 9f83bb30-fed3-427f-bdb6-8013f5bc7b29] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:29.376175 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e216e79c-090c-4bbc-b464-87772568bd8e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:29.381456 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e216e79c-090c-4bbc-b464-87772568bd8e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:29.382005 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e216e79c-090c-4bbc-b464-87772568bd8e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:29.383021 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e216e79c-090c-4bbc-b464-87772568bd8e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:29.384445 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e216e79c-090c-4bbc-b464-87772568bd8e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:29.384955 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e216e79c-090c-4bbc-b464-87772568bd8e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:29.415331 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-e216e79c-090c-4bbc-b464-87772568bd8e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] HTTP exception thrown: Instance 9f83bb30-fed3-427f-bdb6-8013f5bc7b29 could not be found. Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e216e79c-090c-4bbc-b464-87772568bd8e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Request method failure captured: Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/9f83bb30-fed3-427f-bdb6-8013f5bc7b29 HTTP/1.1 Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsrEJhXnu9-kA1ME2ZgtL01L1ZZn_p1cwLPkqNlVzGclz5bmzyyOf2BB4P7wVe6-U6KsqFzM-iyEynyHjx99j1zL9TNO9M1_0gjdhVd46w55yQ-UymJhYbErDED9EKpU_GJnghtBqaCd9UvgTeTf4e4PvQGeOp69vMSi60uoNlhyAmg Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: afdb1e8b478f463987ec223f2d10db33 Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServersTestJSON-126042862 Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServersTestJSON-126042862 Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: afdb1e8b478f463987ec223f2d10db33 Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServersTestJSON-126042862 Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServersTestJSON-126042862-project Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 73f4ee2e7ff34dd88b9b82fefbf06a36 Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServersTestJSON-126042862-project Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 9f83bb30-fed3-427f-bdb6-8013f5bc7b29 could not be found. Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '9f83bb30-fed3-427f-bdb6-8013f5bc7b29'} Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f83bb30-fed3-427f-bdb6-8013f5bc7b29 could not be found. Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f83bb30-fed3-427f-bdb6-8013f5bc7b29 could not be found. Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:52:29.416980 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:29.421026 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:52:29.421026 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:52:29.421026 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:52:29.421026 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:52:29.421026 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f83bb30-fed3-427f-bdb6-8013f5bc7b29 could not be found. Oct 18 15:52:29.421026 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:52:29.421026 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e216e79c-090c-4bbc-b464-87772568bd8e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Returning 404 to user: Instance 9f83bb30-fed3-427f-bdb6-8013f5bc7b29 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:52:29.421026 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e216e79c-090c-4bbc-b464-87772568bd8e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/9f83bb30-fed3-427f-bdb6-8013f5bc7b29" status: 404 len: 111 microversion: 2.1 time: 0.059901 Oct 18 15:52:29.434265 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2837/5658] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:29 2022] GET /compute/v2.1/servers/9f83bb30-fed3-427f-bdb6-8013f5bc7b29 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:52:29.452311 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5409cb38-900a-477f-933d-be2cad76d351 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:29.452834 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5409cb38-900a-477f-933d-be2cad76d351 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 98f6cc17-6875-49c2-86c5-a8130b901036] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:29.460199 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-5409cb38-900a-477f-933d-be2cad76d351 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] HTTP exception thrown: Instance 98f6cc17-6875-49c2-86c5-a8130b901036 could not be found. Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5409cb38-900a-477f-933d-be2cad76d351 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Request method failure captured: Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/98f6cc17-6875-49c2-86c5-a8130b901036 HTTP/1.1 Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsrEJhXnu9-kA1ME2ZgtL01L1ZZn_p1cwLPkqNlVzGclz5bmzyyOf2BB4P7wVe6-U6KsqFzM-iyEynyHjx99j1zL9TNO9M1_0gjdhVd46w55yQ-UymJhYbErDED9EKpU_GJnghtBqaCd9UvgTeTf4e4PvQGeOp69vMSi60uoNlhyAmg Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: afdb1e8b478f463987ec223f2d10db33 Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersTestJSON-126042862 Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersTestJSON-126042862 Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: afdb1e8b478f463987ec223f2d10db33 Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersTestJSON-126042862 Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersTestJSON-126042862-project Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 73f4ee2e7ff34dd88b9b82fefbf06a36 Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersTestJSON-126042862-project Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 98f6cc17-6875-49c2-86c5-a8130b901036 could not be found. Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '98f6cc17-6875-49c2-86c5-a8130b901036'} Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98f6cc17-6875-49c2-86c5-a8130b901036 could not be found. Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98f6cc17-6875-49c2-86c5-a8130b901036 could not be found. Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:52:29.462126 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:52:29.465872 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:29.465872 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:52:29.465872 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:52:29.465872 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:52:29.465872 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:52:29.465872 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98f6cc17-6875-49c2-86c5-a8130b901036 could not be found. Oct 18 15:52:29.465872 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:52:29.465872 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5409cb38-900a-477f-933d-be2cad76d351 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Returning 404 to user: Instance 98f6cc17-6875-49c2-86c5-a8130b901036 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:52:29.465872 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5409cb38-900a-477f-933d-be2cad76d351 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "DELETE /compute/v2.1/servers/98f6cc17-6875-49c2-86c5-a8130b901036" status: 404 len: 111 microversion: 2.1 time: 0.036436 Oct 18 15:52:29.473042 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2822/5659] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:52:29 2022] DELETE /compute/v2.1/servers/98f6cc17-6875-49c2-86c5-a8130b901036 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:52:29.478911 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d263ee2f-c3e7-49ec-8dd0-a683132ebdf1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:29.479471 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d263ee2f-c3e7-49ec-8dd0-a683132ebdf1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 98f6cc17-6875-49c2-86c5-a8130b901036] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:29.498984 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-d263ee2f-c3e7-49ec-8dd0-a683132ebdf1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] HTTP exception thrown: Instance 98f6cc17-6875-49c2-86c5-a8130b901036 could not be found. Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d263ee2f-c3e7-49ec-8dd0-a683132ebdf1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Request method failure captured: Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/98f6cc17-6875-49c2-86c5-a8130b901036 HTTP/1.1 Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsrEJhXnu9-kA1ME2ZgtL01L1ZZn_p1cwLPkqNlVzGclz5bmzyyOf2BB4P7wVe6-U6KsqFzM-iyEynyHjx99j1zL9TNO9M1_0gjdhVd46w55yQ-UymJhYbErDED9EKpU_GJnghtBqaCd9UvgTeTf4e4PvQGeOp69vMSi60uoNlhyAmg Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: afdb1e8b478f463987ec223f2d10db33 Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServersTestJSON-126042862 Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServersTestJSON-126042862 Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: afdb1e8b478f463987ec223f2d10db33 Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServersTestJSON-126042862 Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServersTestJSON-126042862-project Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 73f4ee2e7ff34dd88b9b82fefbf06a36 Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServersTestJSON-126042862-project Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 98f6cc17-6875-49c2-86c5-a8130b901036 could not be found. Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '98f6cc17-6875-49c2-86c5-a8130b901036'} Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98f6cc17-6875-49c2-86c5-a8130b901036 could not be found. Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98f6cc17-6875-49c2-86c5-a8130b901036 could not be found. Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:52:29.500863 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:52:29.505001 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:52:29.505001 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:52:29.505001 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98f6cc17-6875-49c2-86c5-a8130b901036 could not be found. Oct 18 15:52:29.505001 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:52:29.506175 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d263ee2f-c3e7-49ec-8dd0-a683132ebdf1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Returning 404 to user: Instance 98f6cc17-6875-49c2-86c5-a8130b901036 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:52:29.507224 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d263ee2f-c3e7-49ec-8dd0-a683132ebdf1 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/98f6cc17-6875-49c2-86c5-a8130b901036" status: 404 len: 111 microversion: 2.1 time: 0.032352 Oct 18 15:52:29.507992 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2838/5660] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:29 2022] GET /compute/v2.1/servers/98f6cc17-6875-49c2-86c5-a8130b901036 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 15:52:29.524389 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5262e4ba-950c-4e5c-8e3f-f3626d942907 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:29.524931 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5262e4ba-950c-4e5c-8e3f-f3626d942907 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 921da888-cf81-4364-bb2f-469e8e444978] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:29.535032 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5262e4ba-950c-4e5c-8e3f-f3626d942907 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:29.537438 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5262e4ba-950c-4e5c-8e3f-f3626d942907 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:29.537920 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5262e4ba-950c-4e5c-8e3f-f3626d942907 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:29.538665 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5262e4ba-950c-4e5c-8e3f-f3626d942907 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:29.539135 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5262e4ba-950c-4e5c-8e3f-f3626d942907 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:29.539571 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5262e4ba-950c-4e5c-8e3f-f3626d942907 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:29.583501 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5262e4ba-950c-4e5c-8e3f-f3626d942907 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 921da888-cf81-4364-bb2f-469e8e444978] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:52:29.766470 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5262e4ba-950c-4e5c-8e3f-f3626d942907 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "DELETE /compute/v2.1/servers/921da888-cf81-4364-bb2f-469e8e444978" status: 204 len: 0 microversion: 2.1 time: 0.252361 Oct 18 15:52:29.767771 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2823/5661] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:52:29 2022] DELETE /compute/v2.1/servers/921da888-cf81-4364-bb2f-469e8e444978 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:52:29.775504 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-76885c14-2547-469c-884d-e3bd528c89b6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:29.776638 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-76885c14-2547-469c-884d-e3bd528c89b6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 921da888-cf81-4364-bb2f-469e8e444978] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:29.792454 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-76885c14-2547-469c-884d-e3bd528c89b6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:29.793526 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-76885c14-2547-469c-884d-e3bd528c89b6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:29.795199 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-76885c14-2547-469c-884d-e3bd528c89b6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:29.797104 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-76885c14-2547-469c-884d-e3bd528c89b6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:29.797830 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-76885c14-2547-469c-884d-e3bd528c89b6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:29.798594 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-76885c14-2547-469c-884d-e3bd528c89b6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:30.104837 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-76885c14-2547-469c-884d-e3bd528c89b6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:30.119724 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-76885c14-2547-469c-884d-e3bd528c89b6 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/921da888-cf81-4364-bb2f-469e8e444978" status: 200 len: 1479 microversion: 2.1 time: 0.343936 Oct 18 15:52:30.125589 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2839/5662] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:29 2022] GET /compute/v2.1/servers/921da888-cf81-4364-bb2f-469e8e444978 => generated 1479 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:52:30.348613 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a1d86e5d-0dbd-4029-a769-3c781ccfab44 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:30.349868 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a1d86e5d-0dbd-4029-a769-3c781ccfab44 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] [instance: bfd97d9c-daf6-4503-8fd1-ae8750a24793] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:30.366161 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1d86e5d-0dbd-4029-a769-3c781ccfab44 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:30.367375 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1d86e5d-0dbd-4029-a769-3c781ccfab44 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:30.369247 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1d86e5d-0dbd-4029-a769-3c781ccfab44 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:30.370631 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1d86e5d-0dbd-4029-a769-3c781ccfab44 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:30.372217 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1d86e5d-0dbd-4029-a769-3c781ccfab44 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:30.373609 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1d86e5d-0dbd-4029-a769-3c781ccfab44 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:30.818118 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a1d86e5d-0dbd-4029-a769-3c781ccfab44 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c27994e138c42ffbe4d9151b776ae6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2164f4bcd424ffbace7a1baf85f36db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:30.853887 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a1d86e5d-0dbd-4029-a769-3c781ccfab44 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] 10.222.0.60 "GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793" status: 200 len: 1523 microversion: 2.1 time: 0.510685 Oct 18 15:52:30.876768 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2824/5663] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:30 2022] GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793 => generated 1523 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:52:31.145434 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c87b25f7-8fe6-4b20-abd8-93e43b892bb4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:31.146648 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c87b25f7-8fe6-4b20-abd8-93e43b892bb4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 921da888-cf81-4364-bb2f-469e8e444978] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:31.159709 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c87b25f7-8fe6-4b20-abd8-93e43b892bb4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:31.173697 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c87b25f7-8fe6-4b20-abd8-93e43b892bb4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:31.174361 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c87b25f7-8fe6-4b20-abd8-93e43b892bb4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:31.177342 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c87b25f7-8fe6-4b20-abd8-93e43b892bb4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:31.178552 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c87b25f7-8fe6-4b20-abd8-93e43b892bb4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:31.181333 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c87b25f7-8fe6-4b20-abd8-93e43b892bb4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:31.480792 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c87b25f7-8fe6-4b20-abd8-93e43b892bb4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:31.495620 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c87b25f7-8fe6-4b20-abd8-93e43b892bb4 tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/921da888-cf81-4364-bb2f-469e8e444978" status: 200 len: 1479 microversion: 2.1 time: 0.355697 Oct 18 15:52:31.497170 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2840/5664] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:31 2022] GET /compute/v2.1/servers/921da888-cf81-4364-bb2f-469e8e444978 => generated 1479 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:52:31.883334 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fe28e565-28ad-4ce9-af0d-cf7855ba5e38 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:31.883958 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fe28e565-28ad-4ce9-af0d-cf7855ba5e38 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] [instance: bfd97d9c-daf6-4503-8fd1-ae8750a24793] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:31.892128 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe28e565-28ad-4ce9-af0d-cf7855ba5e38 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:31.892949 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe28e565-28ad-4ce9-af0d-cf7855ba5e38 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:31.893557 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe28e565-28ad-4ce9-af0d-cf7855ba5e38 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:31.894538 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe28e565-28ad-4ce9-af0d-cf7855ba5e38 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:31.895150 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe28e565-28ad-4ce9-af0d-cf7855ba5e38 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:31.895740 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe28e565-28ad-4ce9-af0d-cf7855ba5e38 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:32.110845 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fe28e565-28ad-4ce9-af0d-cf7855ba5e38 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c27994e138c42ffbe4d9151b776ae6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2164f4bcd424ffbace7a1baf85f36db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:32.121392 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fe28e565-28ad-4ce9-af0d-cf7855ba5e38 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] 10.222.0.60 "GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793" status: 200 len: 1523 microversion: 2.1 time: 0.241807 Oct 18 15:52:32.123199 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2825/5665] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:31 2022] GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793 => generated 1523 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:52:32.519240 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-63841059-2ceb-4f43-935c-ed18c6d4f63d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:32.520157 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-63841059-2ceb-4f43-935c-ed18c6d4f63d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 921da888-cf81-4364-bb2f-469e8e444978] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:32.536327 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63841059-2ceb-4f43-935c-ed18c6d4f63d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:32.537300 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63841059-2ceb-4f43-935c-ed18c6d4f63d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:32.538595 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63841059-2ceb-4f43-935c-ed18c6d4f63d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:32.540050 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63841059-2ceb-4f43-935c-ed18c6d4f63d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:32.542207 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63841059-2ceb-4f43-935c-ed18c6d4f63d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:32.542648 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63841059-2ceb-4f43-935c-ed18c6d4f63d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:32.676466 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2c0cd7ff-4313-4742-80b8-0a891f478c55 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-12029820", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": "none"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:52:32.847170 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-2c0cd7ff-4313-4742-80b8-0a891f478c55 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:52:32.849849 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-2c0cd7ff-4313-4742-80b8-0a891f478c55 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:52:32.850424 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-2c0cd7ff-4313-4742-80b8-0a891f478c55 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:52:32.850854 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-2c0cd7ff-4313-4742-80b8-0a891f478c55 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:52:32.851279 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-2c0cd7ff-4313-4742-80b8-0a891f478c55 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:52:32.870092 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c0cd7ff-4313-4742-80b8-0a891f478c55 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:32.881251 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c0cd7ff-4313-4742-80b8-0a891f478c55 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:32.881776 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c0cd7ff-4313-4742-80b8-0a891f478c55 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:32.890366 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c0cd7ff-4313-4742-80b8-0a891f478c55 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:32.891048 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c0cd7ff-4313-4742-80b8-0a891f478c55 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:32.891744 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c0cd7ff-4313-4742-80b8-0a891f478c55 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:32.917099 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-2c0cd7ff-4313-4742-80b8-0a891f478c55 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Getting quotas for project de33b2593b254c58ab78562a8fbe076f. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:52:32.924655 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-2c0cd7ff-4313-4742-80b8-0a891f478c55 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Getting quotas for user 229b7746de984addaecc5e01ddea3207 and project de33b2593b254c58ab78562a8fbe076f. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:52:32.968447 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2c0cd7ff-4313-4742-80b8-0a891f478c55 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:52:32.974221 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2c0cd7ff-4313-4742-80b8-0a891f478c55 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] [instance: 77fc629c-1fd4-42f9-a9aa-40dde963e33f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:52:33.051033 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2c0cd7ff-4313-4742-80b8-0a891f478c55 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.724379 Oct 18 15:52:33.051750 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2841/5666] 10.222.0.60 () {62 vars in 1188 bytes} [Tue Oct 18 15:52:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 18 15:52:33.083245 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-79eae189-a0ff-4de8-8e2b-180f995434d6 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:33.083865 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-79eae189-a0ff-4de8-8e2b-180f995434d6 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] [instance: 77fc629c-1fd4-42f9-a9aa-40dde963e33f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:33.738088 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-79eae189-a0ff-4de8-8e2b-180f995434d6 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:33.766092 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-79eae189-a0ff-4de8-8e2b-180f995434d6 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:33.768195 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-79eae189-a0ff-4de8-8e2b-180f995434d6 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:33.769876 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-79eae189-a0ff-4de8-8e2b-180f995434d6 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] 10.222.0.60 "GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f" status: 200 len: 1276 microversion: 2.54 time: 0.710423 Oct 18 15:52:33.770745 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2842/5667] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:52:33 2022] GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f => generated 1276 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:52:33.780898 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-abdc55f7-d3d5-4bb2-96ab-c7bb42b30565 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:33.782460 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-abdc55f7-d3d5-4bb2-96ab-c7bb42b30565 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] [instance: bfd97d9c-daf6-4503-8fd1-ae8750a24793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:33.796322 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-abdc55f7-d3d5-4bb2-96ab-c7bb42b30565 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:33.800735 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-abdc55f7-d3d5-4bb2-96ab-c7bb42b30565 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:33.802914 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-abdc55f7-d3d5-4bb2-96ab-c7bb42b30565 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:33.805152 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-abdc55f7-d3d5-4bb2-96ab-c7bb42b30565 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:33.807242 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-abdc55f7-d3d5-4bb2-96ab-c7bb42b30565 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:33.808464 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-abdc55f7-d3d5-4bb2-96ab-c7bb42b30565 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:33.953568 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-63841059-2ceb-4f43-935c-ed18c6d4f63d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:33.970478 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-63841059-2ceb-4f43-935c-ed18c6d4f63d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/921da888-cf81-4364-bb2f-469e8e444978" status: 200 len: 1479 microversion: 2.1 time: 1.455645 Oct 18 15:52:33.975337 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2826/5668] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:32 2022] GET /compute/v2.1/servers/921da888-cf81-4364-bb2f-469e8e444978 => generated 1479 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:52:34.473799 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-abdc55f7-d3d5-4bb2-96ab-c7bb42b30565 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c27994e138c42ffbe4d9151b776ae6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2164f4bcd424ffbace7a1baf85f36db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:34.483045 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-abdc55f7-d3d5-4bb2-96ab-c7bb42b30565 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] 10.222.0.60 "GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793" status: 200 len: 1523 microversion: 2.1 time: 0.710986 Oct 18 15:52:34.483804 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2843/5669] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:33 2022] GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793 => generated 1523 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:52:34.801995 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-25cd2aff-de94-4fee-aa9c-371745603f14 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:34.802858 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-25cd2aff-de94-4fee-aa9c-371745603f14 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] [instance: 77fc629c-1fd4-42f9-a9aa-40dde963e33f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:34.816240 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25cd2aff-de94-4fee-aa9c-371745603f14 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:34.818026 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25cd2aff-de94-4fee-aa9c-371745603f14 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:34.818475 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25cd2aff-de94-4fee-aa9c-371745603f14 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:34.820645 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25cd2aff-de94-4fee-aa9c-371745603f14 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:34.821183 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25cd2aff-de94-4fee-aa9c-371745603f14 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:34.821614 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25cd2aff-de94-4fee-aa9c-371745603f14 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:35.003018 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3ca680af-9aa5-41d1-8667-d1cf154ff43d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:35.003649 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3ca680af-9aa5-41d1-8667-d1cf154ff43d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 921da888-cf81-4364-bb2f-469e8e444978] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:35.014800 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ca680af-9aa5-41d1-8667-d1cf154ff43d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:35.015513 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ca680af-9aa5-41d1-8667-d1cf154ff43d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:35.019076 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-25cd2aff-de94-4fee-aa9c-371745603f14 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:35.028901 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-25cd2aff-de94-4fee-aa9c-371745603f14 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:35.030574 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ca680af-9aa5-41d1-8667-d1cf154ff43d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:35.034597 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ca680af-9aa5-41d1-8667-d1cf154ff43d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:35.035409 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ca680af-9aa5-41d1-8667-d1cf154ff43d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:35.036069 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ca680af-9aa5-41d1-8667-d1cf154ff43d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:35.039135 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-25cd2aff-de94-4fee-aa9c-371745603f14 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:35.051107 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-25cd2aff-de94-4fee-aa9c-371745603f14 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] 10.222.0.60 "GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f" status: 200 len: 1328 microversion: 2.54 time: 0.253492 Oct 18 15:52:35.053583 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2827/5670] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:52:34 2022] GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f => generated 1328 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:52:35.211385 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3ca680af-9aa5-41d1-8667-d1cf154ff43d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:35.225366 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3ca680af-9aa5-41d1-8667-d1cf154ff43d tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/921da888-cf81-4364-bb2f-469e8e444978" status: 200 len: 1437 microversion: 2.1 time: 0.224212 Oct 18 15:52:35.228270 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2844/5671] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:34 2022] GET /compute/v2.1/servers/921da888-cf81-4364-bb2f-469e8e444978 => generated 1437 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:52:35.289879 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-51ef42cc-a887-40a6-951f-63d645250603 req-22945760-1b4e-4a5f-b13f-f2fffaf05817 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "921da888-cf81-4364-bb2f-469e8e444978", "name": "network-vif-deleted", "tag": "aade4fca-51ea-447f-9eaf-0a8a307c7974"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:52:35.307907 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-51ef42cc-a887-40a6-951f-63d645250603 req-22945760-1b4e-4a5f-b13f-f2fffaf05817 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:35.309905 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-51ef42cc-a887-40a6-951f-63d645250603 req-22945760-1b4e-4a5f-b13f-f2fffaf05817 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:35.313511 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-51ef42cc-a887-40a6-951f-63d645250603 req-22945760-1b4e-4a5f-b13f-f2fffaf05817 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:35.335579 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-51ef42cc-a887-40a6-951f-63d645250603 req-22945760-1b4e-4a5f-b13f-f2fffaf05817 service nova] Creating event network-vif-deleted:aade4fca-51ea-447f-9eaf-0a8a307c7974 for instance 921da888-cf81-4364-bb2f-469e8e444978 on n-h1-853682-5 Oct 18 15:52:35.348022 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-51ef42cc-a887-40a6-951f-63d645250603 req-22945760-1b4e-4a5f-b13f-f2fffaf05817 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061958 Oct 18 15:52:35.352359 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2828/5672] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:52:35.508538 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4cb13a5b-27a7-4b22-b89b-d3866fbf3d49 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:35.509338 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4cb13a5b-27a7-4b22-b89b-d3866fbf3d49 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] [instance: bfd97d9c-daf6-4503-8fd1-ae8750a24793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:35.525998 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4cb13a5b-27a7-4b22-b89b-d3866fbf3d49 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:35.526634 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4cb13a5b-27a7-4b22-b89b-d3866fbf3d49 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:35.527152 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4cb13a5b-27a7-4b22-b89b-d3866fbf3d49 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:35.528030 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4cb13a5b-27a7-4b22-b89b-d3866fbf3d49 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:35.528603 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4cb13a5b-27a7-4b22-b89b-d3866fbf3d49 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:35.529129 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4cb13a5b-27a7-4b22-b89b-d3866fbf3d49 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:35.871864 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4cb13a5b-27a7-4b22-b89b-d3866fbf3d49 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c27994e138c42ffbe4d9151b776ae6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2164f4bcd424ffbace7a1baf85f36db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:35.887673 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4cb13a5b-27a7-4b22-b89b-d3866fbf3d49 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] 10.222.0.60 "GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793" status: 200 len: 1503 microversion: 2.1 time: 0.384005 Oct 18 15:52:35.889084 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2845/5673] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:35 2022] GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793 => generated 1503 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:52:35.917077 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-522aa22f-1d1c-4250-ae83-b7408b069f9a tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Action: 'create', calling method: .version_select at 0x7f7c3ceeeee0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-2429566", "description": "tempest-description-49125490"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:52:36.080450 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-78c03ac1-6d2e-4cbd-9577-552d63d0436c tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:36.081943 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-78c03ac1-6d2e-4cbd-9577-552d63d0436c tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] [instance: 77fc629c-1fd4-42f9-a9aa-40dde963e33f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:36.089125 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-78c03ac1-6d2e-4cbd-9577-552d63d0436c tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:36.089836 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-78c03ac1-6d2e-4cbd-9577-552d63d0436c tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:36.090428 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-78c03ac1-6d2e-4cbd-9577-552d63d0436c tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:36.092567 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-78c03ac1-6d2e-4cbd-9577-552d63d0436c tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:36.093221 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-78c03ac1-6d2e-4cbd-9577-552d63d0436c tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:36.093806 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-78c03ac1-6d2e-4cbd-9577-552d63d0436c tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:36.210554 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-78c03ac1-6d2e-4cbd-9577-552d63d0436c tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:36.220010 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-78c03ac1-6d2e-4cbd-9577-552d63d0436c tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:36.221650 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-78c03ac1-6d2e-4cbd-9577-552d63d0436c tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:36.222807 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-78c03ac1-6d2e-4cbd-9577-552d63d0436c tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] 10.222.0.60 "GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f" status: 200 len: 1334 microversion: 2.54 time: 0.146948 Oct 18 15:52:36.223372 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2846/5674] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:52:36 2022] GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f => generated 1334 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:52:36.254070 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0f069fb3-8d6b-4d4a-ac87-f4cffc3cdf5e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:36.254880 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0f069fb3-8d6b-4d4a-ac87-f4cffc3cdf5e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 921da888-cf81-4364-bb2f-469e8e444978] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:36.261357 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0f069fb3-8d6b-4d4a-ac87-f4cffc3cdf5e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:36.261953 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0f069fb3-8d6b-4d4a-ac87-f4cffc3cdf5e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:36.263039 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0f069fb3-8d6b-4d4a-ac87-f4cffc3cdf5e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:36.264058 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0f069fb3-8d6b-4d4a-ac87-f4cffc3cdf5e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:36.272187 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0f069fb3-8d6b-4d4a-ac87-f4cffc3cdf5e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:36.273628 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0f069fb3-8d6b-4d4a-ac87-f4cffc3cdf5e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:36.306353 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:36.328096 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0f069fb3-8d6b-4d4a-ac87-f4cffc3cdf5e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:36.328969 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0f069fb3-8d6b-4d4a-ac87-f4cffc3cdf5e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:36.329508 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0f069fb3-8d6b-4d4a-ac87-f4cffc3cdf5e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:36.331335 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-0f069fb3-8d6b-4d4a-ac87-f4cffc3cdf5e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lazy-loading 'fault' on Instance uuid 921da888-cf81-4364-bb2f-469e8e444978 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:52:36.583544 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0f069fb3-8d6b-4d4a-ac87-f4cffc3cdf5e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f4ee2e7ff34dd88b9b82fefbf06a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdb1e8b478f463987ec223f2d10db33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:36.590959 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0f069fb3-8d6b-4d4a-ac87-f4cffc3cdf5e tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/921da888-cf81-4364-bb2f-469e8e444978" status: 200 len: 1283 microversion: 2.1 time: 0.341140 Oct 18 15:52:36.592048 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2847/5675] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:36 2022] GET /compute/v2.1/servers/921da888-cf81-4364-bb2f-469e8e444978 => generated 1283 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:52:36.826151 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-522aa22f-1d1c-4250-ae83-b7408b069f9a tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.913415 Oct 18 15:52:36.826813 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2829/5676] 10.222.0.60 () {60 vars in 1180 bytes} [Tue Oct 18 15:52:35 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:52:36.840164 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c22ba520-5471-4afe-822c-edc453abf118 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-2429566"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:52:36.840750 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c22ba520-5471-4afe-822c-edc453abf118 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] [instance: bfd97d9c-daf6-4503-8fd1-ae8750a24793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:36.847019 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c22ba520-5471-4afe-822c-edc453abf118 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:36.847518 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c22ba520-5471-4afe-822c-edc453abf118 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:36.848177 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c22ba520-5471-4afe-822c-edc453abf118 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:36.848917 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c22ba520-5471-4afe-822c-edc453abf118 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:36.849382 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c22ba520-5471-4afe-822c-edc453abf118 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:36.849807 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c22ba520-5471-4afe-822c-edc453abf118 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:37.250509 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e578e414-75d8-4807-b05a-13c11f110dbb tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:37.252185 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e578e414-75d8-4807-b05a-13c11f110dbb tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] [instance: 77fc629c-1fd4-42f9-a9aa-40dde963e33f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:37.264228 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e578e414-75d8-4807-b05a-13c11f110dbb tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:37.264735 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e578e414-75d8-4807-b05a-13c11f110dbb tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:37.265221 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e578e414-75d8-4807-b05a-13c11f110dbb tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:37.265940 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e578e414-75d8-4807-b05a-13c11f110dbb tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:37.266404 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e578e414-75d8-4807-b05a-13c11f110dbb tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:37.266834 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e578e414-75d8-4807-b05a-13c11f110dbb tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:37.390636 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e578e414-75d8-4807-b05a-13c11f110dbb tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:37.399756 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e578e414-75d8-4807-b05a-13c11f110dbb tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:37.401249 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e578e414-75d8-4807-b05a-13c11f110dbb tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:37.402726 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e578e414-75d8-4807-b05a-13c11f110dbb tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] 10.222.0.60 "GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f" status: 200 len: 1334 microversion: 2.54 time: 0.157772 Oct 18 15:52:37.404198 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2830/5677] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:52:37 2022] GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f => generated 1334 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:52:37.420611 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.network.security_group_api [None req-c22ba520-5471-4afe-822c-edc453abf118 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Adding security group 89acbe2b-5a99-4d7d-97be-27dceeb31d3a to port d953661c-7e35-4446-9f77-70c196bc52ed Oct 18 15:52:37.614792 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9a2f1ebf-1f17-43a6-bf1c-a167c09e24ca tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:37.616001 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9a2f1ebf-1f17-43a6-bf1c-a167c09e24ca tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] [instance: 921da888-cf81-4364-bb2f-469e8e444978] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:37.625381 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a2f1ebf-1f17-43a6-bf1c-a167c09e24ca tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:37.626158 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a2f1ebf-1f17-43a6-bf1c-a167c09e24ca tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:37.626832 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a2f1ebf-1f17-43a6-bf1c-a167c09e24ca tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:37.627964 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a2f1ebf-1f17-43a6-bf1c-a167c09e24ca tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:37.629003 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a2f1ebf-1f17-43a6-bf1c-a167c09e24ca tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:37.629631 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a2f1ebf-1f17-43a6-bf1c-a167c09e24ca tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:37.647976 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-9a2f1ebf-1f17-43a6-bf1c-a167c09e24ca tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] HTTP exception thrown: Instance 921da888-cf81-4364-bb2f-469e8e444978 could not be found. Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9a2f1ebf-1f17-43a6-bf1c-a167c09e24ca tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Request method failure captured: Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/921da888-cf81-4364-bb2f-469e8e444978 HTTP/1.1 Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsrEJhXnu9-kA1ME2ZgtL01L1ZZn_p1cwLPkqNlVzGclz5bmzyyOf2BB4P7wVe6-U6KsqFzM-iyEynyHjx99j1zL9TNO9M1_0gjdhVd46w55yQ-UymJhYbErDED9EKpU_GJnghtBqaCd9UvgTeTf4e4PvQGeOp69vMSi60uoNlhyAmg Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: afdb1e8b478f463987ec223f2d10db33 Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersTestJSON-126042862 Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_afdb1e8b478f463987ec223f2d10db33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersTestJSON-126042862 Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: afdb1e8b478f463987ec223f2d10db33 Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersTestJSON-126042862 Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersTestJSON-126042862-project Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 73f4ee2e7ff34dd88b9b82fefbf06a36 Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersTestJSON-126042862-project Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 921da888-cf81-4364-bb2f-469e8e444978 could not be found. Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '921da888-cf81-4364-bb2f-469e8e444978'} Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 921da888-cf81-4364-bb2f-469e8e444978 could not be found. Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 921da888-cf81-4364-bb2f-469e8e444978 could not be found. Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:52:37.650220 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:52:37.660077 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:52:37.660077 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:52:37.660077 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:52:37.660077 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:52:37.660077 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 921da888-cf81-4364-bb2f-469e8e444978 could not be found. Oct 18 15:52:37.660077 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:52:37.677784 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9a2f1ebf-1f17-43a6-bf1c-a167c09e24ca tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] Returning 404 to user: Instance 921da888-cf81-4364-bb2f-469e8e444978 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:52:37.680416 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9a2f1ebf-1f17-43a6-bf1c-a167c09e24ca tempest-ServersTestJSON-126042862 tempest-ServersTestJSON-126042862-project] 10.222.0.60 "GET /compute/v2.1/servers/921da888-cf81-4364-bb2f-469e8e444978" status: 404 len: 111 microversion: 2.1 time: 0.069572 Oct 18 15:52:37.683276 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2831/5678] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:52:37 2022] GET /compute/v2.1/servers/921da888-cf81-4364-bb2f-469e8e444978 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:52:38.430129 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-330da911-1898-40d4-82ef-1f6016b1d2d9 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:38.431456 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-330da911-1898-40d4-82ef-1f6016b1d2d9 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] [instance: 77fc629c-1fd4-42f9-a9aa-40dde963e33f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:38.446730 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-330da911-1898-40d4-82ef-1f6016b1d2d9 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:38.448951 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-330da911-1898-40d4-82ef-1f6016b1d2d9 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:38.457007 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-330da911-1898-40d4-82ef-1f6016b1d2d9 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:38.458621 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-330da911-1898-40d4-82ef-1f6016b1d2d9 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:38.459108 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-330da911-1898-40d4-82ef-1f6016b1d2d9 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:38.460071 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-330da911-1898-40d4-82ef-1f6016b1d2d9 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:38.742593 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c22ba520-5471-4afe-822c-edc453abf118 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] 10.222.0.60 "POST /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793/action" status: 202 len: 0 microversion: 2.1 time: 1.906512 Oct 18 15:52:38.747370 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2848/5679] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:52:36 2022] POST /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793/action => generated 0 bytes in 1908 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:52:38.752467 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-60a89001-6709-44d4-9a54-1b39b4f17227 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-2429566"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:52:38.753051 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-60a89001-6709-44d4-9a54-1b39b4f17227 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] [instance: bfd97d9c-daf6-4503-8fd1-ae8750a24793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:38.765771 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-60a89001-6709-44d4-9a54-1b39b4f17227 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:38.767643 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-60a89001-6709-44d4-9a54-1b39b4f17227 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:38.768115 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-60a89001-6709-44d4-9a54-1b39b4f17227 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:38.768869 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-60a89001-6709-44d4-9a54-1b39b4f17227 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:38.769525 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-60a89001-6709-44d4-9a54-1b39b4f17227 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:38.769966 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-60a89001-6709-44d4-9a54-1b39b4f17227 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:39.002123 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-330da911-1898-40d4-82ef-1f6016b1d2d9 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:39.017755 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-330da911-1898-40d4-82ef-1f6016b1d2d9 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:39.022927 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-330da911-1898-40d4-82ef-1f6016b1d2d9 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:39.024306 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-330da911-1898-40d4-82ef-1f6016b1d2d9 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] 10.222.0.60 "GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f" status: 200 len: 1355 microversion: 2.54 time: 0.598472 Oct 18 15:52:39.036847 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2832/5680] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:52:38 2022] GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f => generated 1355 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:52:39.039734 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-d0f8843d-c43a-42ce-ad20-17e739cbcfc9 req-cc6a59a8-cc72-4711-b8d8-22afb1df987e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfd97d9c-daf6-4503-8fd1-ae8750a24793", "tag": "d953661c-7e35-4446-9f77-70c196bc52ed"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:52:39.061882 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d0f8843d-c43a-42ce-ad20-17e739cbcfc9 req-cc6a59a8-cc72-4711-b8d8-22afb1df987e service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:39.062514 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d0f8843d-c43a-42ce-ad20-17e739cbcfc9 req-cc6a59a8-cc72-4711-b8d8-22afb1df987e service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:39.063060 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d0f8843d-c43a-42ce-ad20-17e739cbcfc9 req-cc6a59a8-cc72-4711-b8d8-22afb1df987e service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:39.085987 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-d0f8843d-c43a-42ce-ad20-17e739cbcfc9 req-cc6a59a8-cc72-4711-b8d8-22afb1df987e service nova] Creating event network-changed:d953661c-7e35-4446-9f77-70c196bc52ed for instance bfd97d9c-daf6-4503-8fd1-ae8750a24793 on n-h1-853682-5 Oct 18 15:52:39.097469 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-d0f8843d-c43a-42ce-ad20-17e739cbcfc9 req-cc6a59a8-cc72-4711-b8d8-22afb1df987e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068909 Oct 18 15:52:39.102758 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2833/5681] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:52:39.108486 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4a1c9df0-2b3c-4a15-9e1a-53aedde0e6f7 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Action: 'create', calling method: .version_select at 0x7f7c3d0235e0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1647916641", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGn583sZBlQhIR8G8XfRisrUgZaFX/Bm5ktARnoVhHlmYo1YQMiLIbdDNTUjb4vmF2VK2rM2xz5vRtjUrDijlZm29P/zuh9BjS9PLqih10X5Z6QnstTQVfwm+HIZs8lyCA=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:52:39.126685 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-4a1c9df0-2b3c-4a15-9e1a-53aedde0e6f7 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Getting quotas for project de33b2593b254c58ab78562a8fbe076f. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:52:39.132199 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-4a1c9df0-2b3c-4a15-9e1a-53aedde0e6f7 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Getting quotas for user 229b7746de984addaecc5e01ddea3207 and project de33b2593b254c58ab78562a8fbe076f. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:52:39.166245 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4a1c9df0-2b3c-4a15-9e1a-53aedde0e6f7 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.061982 Oct 18 15:52:39.175053 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2834/5682] 10.222.0.60 () {62 vars in 1200 bytes} [Tue Oct 18 15:52:39 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 71 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 18 15:52:39.181746 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-76205921-1384-4f0c-8df9-69f95dab7550 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1647916641", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:52:39.186292 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-76205921-1384-4f0c-8df9-69f95dab7550 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] [instance: 77fc629c-1fd4-42f9-a9aa-40dde963e33f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:39.197610 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76205921-1384-4f0c-8df9-69f95dab7550 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:39.198806 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76205921-1384-4f0c-8df9-69f95dab7550 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:39.199429 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76205921-1384-4f0c-8df9-69f95dab7550 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:39.200982 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76205921-1384-4f0c-8df9-69f95dab7550 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:39.201599 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76205921-1384-4f0c-8df9-69f95dab7550 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:39.202214 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76205921-1384-4f0c-8df9-69f95dab7550 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:39.483098 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:39.513489 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-76205921-1384-4f0c-8df9-69f95dab7550 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:52:39.514013 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-76205921-1384-4f0c-8df9-69f95dab7550 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:52:39.514517 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-76205921-1384-4f0c-8df9-69f95dab7550 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:52:39.514936 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-76205921-1384-4f0c-8df9-69f95dab7550 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:52:39.515996 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-76205921-1384-4f0c-8df9-69f95dab7550 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:52:39.702386 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-76205921-1384-4f0c-8df9-69f95dab7550 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] [instance: 77fc629c-1fd4-42f9-a9aa-40dde963e33f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:39.710894 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76205921-1384-4f0c-8df9-69f95dab7550 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:39.712914 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76205921-1384-4f0c-8df9-69f95dab7550 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:39.713697 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76205921-1384-4f0c-8df9-69f95dab7550 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:39.714946 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76205921-1384-4f0c-8df9-69f95dab7550 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:39.716788 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76205921-1384-4f0c-8df9-69f95dab7550 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:39.717523 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76205921-1384-4f0c-8df9-69f95dab7550 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:39.768906 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-76205921-1384-4f0c-8df9-69f95dab7550 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] 10.222.0.60 "POST /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f/action" status: 202 len: 1138 microversion: 2.54 time: 0.592079 Oct 18 15:52:39.769785 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2835/5683] 10.222.0.60 () {62 vars in 1320 bytes} [Tue Oct 18 15:52:39 2022] POST /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f/action => generated 1138 bytes in 594 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 18 15:52:39.791924 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f26ab45d-57de-4e02-9b77-3b1948baaf73 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:39.793280 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f26ab45d-57de-4e02-9b77-3b1948baaf73 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] [instance: 77fc629c-1fd4-42f9-a9aa-40dde963e33f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:39.811670 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f26ab45d-57de-4e02-9b77-3b1948baaf73 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:39.815255 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f26ab45d-57de-4e02-9b77-3b1948baaf73 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:39.815718 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f26ab45d-57de-4e02-9b77-3b1948baaf73 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:39.816467 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f26ab45d-57de-4e02-9b77-3b1948baaf73 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:39.821520 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f26ab45d-57de-4e02-9b77-3b1948baaf73 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:39.822007 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f26ab45d-57de-4e02-9b77-3b1948baaf73 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:40.173099 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f26ab45d-57de-4e02-9b77-3b1948baaf73 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:40.182100 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f26ab45d-57de-4e02-9b77-3b1948baaf73 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:40.189278 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f26ab45d-57de-4e02-9b77-3b1948baaf73 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:40.190816 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f26ab45d-57de-4e02-9b77-3b1948baaf73 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] 10.222.0.60 "GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f" status: 200 len: 1407 microversion: 2.54 time: 0.404210 Oct 18 15:52:40.197218 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2836/5684] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:52:39 2022] GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f => generated 1407 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:52:40.393801 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.network.security_group_api [None req-60a89001-6709-44d4-9a54-1b39b4f17227 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Removing security group 89acbe2b-5a99-4d7d-97be-27dceeb31d3a from port d953661c-7e35-4446-9f77-70c196bc52ed Oct 18 15:52:41.226504 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5f3ed4c3-685c-4975-9f95-93260077d8bc tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:41.228181 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5f3ed4c3-685c-4975-9f95-93260077d8bc tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] [instance: 77fc629c-1fd4-42f9-a9aa-40dde963e33f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:41.244991 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f3ed4c3-685c-4975-9f95-93260077d8bc tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:41.246704 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f3ed4c3-685c-4975-9f95-93260077d8bc tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:41.247392 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f3ed4c3-685c-4975-9f95-93260077d8bc tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:41.248683 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f3ed4c3-685c-4975-9f95-93260077d8bc tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:41.249402 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f3ed4c3-685c-4975-9f95-93260077d8bc tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:41.250601 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f3ed4c3-685c-4975-9f95-93260077d8bc tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:41.434955 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5f3ed4c3-685c-4975-9f95-93260077d8bc tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:41.496219 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5f3ed4c3-685c-4975-9f95-93260077d8bc tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:41.502135 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5f3ed4c3-685c-4975-9f95-93260077d8bc tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:41.503377 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5f3ed4c3-685c-4975-9f95-93260077d8bc tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] 10.222.0.60 "GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f" status: 200 len: 1407 microversion: 2.54 time: 0.282193 Oct 18 15:52:41.503948 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2837/5685] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:52:41 2022] GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f => generated 1407 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:52:41.834757 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-60a89001-6709-44d4-9a54-1b39b4f17227 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] 10.222.0.60 "POST /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793/action" status: 202 len: 0 microversion: 2.1 time: 3.086520 Oct 18 15:52:41.835462 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2849/5686] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:52:38 2022] POST /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793/action => generated 0 bytes in 3088 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:52:41.845871 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-99beeb55-99a8-42d0-bf9b-fc2fc5bec746 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Action: 'create', calling method: .version_select at 0x7f7c3cdbedc0>, body: {"pool": null} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:52:41.862643 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-b25dceb8-6f67-4bf3-9e0b-49e3996a050e req-0e2cd0bc-8eea-44de-9c46-c0de297f5aae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfd97d9c-daf6-4503-8fd1-ae8750a24793", "tag": "d953661c-7e35-4446-9f77-70c196bc52ed"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:52:41.894508 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-b25dceb8-6f67-4bf3-9e0b-49e3996a050e req-0e2cd0bc-8eea-44de-9c46-c0de297f5aae service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:41.899756 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-b25dceb8-6f67-4bf3-9e0b-49e3996a050e req-0e2cd0bc-8eea-44de-9c46-c0de297f5aae service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:41.900369 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-b25dceb8-6f67-4bf3-9e0b-49e3996a050e req-0e2cd0bc-8eea-44de-9c46-c0de297f5aae service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:41.939727 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-b25dceb8-6f67-4bf3-9e0b-49e3996a050e req-0e2cd0bc-8eea-44de-9c46-c0de297f5aae service nova] Creating event network-changed:d953661c-7e35-4446-9f77-70c196bc52ed for instance bfd97d9c-daf6-4503-8fd1-ae8750a24793 on n-h1-853682-5 Oct 18 15:52:41.967042 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-b25dceb8-6f67-4bf3-9e0b-49e3996a050e req-0e2cd0bc-8eea-44de-9c46-c0de297f5aae service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109635 Oct 18 15:52:41.967962 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2850/5687] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:52:42.534636 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-86912a4f-4dd1-492c-8d37-35e60eb0d6d9 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:42.535349 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-86912a4f-4dd1-492c-8d37-35e60eb0d6d9 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] [instance: 77fc629c-1fd4-42f9-a9aa-40dde963e33f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:42.554789 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-86912a4f-4dd1-492c-8d37-35e60eb0d6d9 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:42.555076 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-86912a4f-4dd1-492c-8d37-35e60eb0d6d9 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:42.555522 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-86912a4f-4dd1-492c-8d37-35e60eb0d6d9 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:42.556543 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-86912a4f-4dd1-492c-8d37-35e60eb0d6d9 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:42.556663 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-86912a4f-4dd1-492c-8d37-35e60eb0d6d9 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:42.557132 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-86912a4f-4dd1-492c-8d37-35e60eb0d6d9 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:42.906106 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:42.913919 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-86912a4f-4dd1-492c-8d37-35e60eb0d6d9 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:42.942653 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-86912a4f-4dd1-492c-8d37-35e60eb0d6d9 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:42.946537 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-86912a4f-4dd1-492c-8d37-35e60eb0d6d9 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:42.966584 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-86912a4f-4dd1-492c-8d37-35e60eb0d6d9 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] 10.222.0.60 "GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f" status: 200 len: 1407 microversion: 2.54 time: 0.436082 Oct 18 15:52:42.967198 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2851/5688] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:52:42 2022] GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f => generated 1407 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:52:44.006959 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-322e2b4f-f93a-4c4d-be44-8293075b35c4 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:44.008519 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-322e2b4f-f93a-4c4d-be44-8293075b35c4 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] [instance: 77fc629c-1fd4-42f9-a9aa-40dde963e33f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:44.029752 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=8 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:44.034380 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-322e2b4f-f93a-4c4d-be44-8293075b35c4 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:44.036331 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-322e2b4f-f93a-4c4d-be44-8293075b35c4 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:44.037053 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-322e2b4f-f93a-4c4d-be44-8293075b35c4 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:44.039868 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-322e2b4f-f93a-4c4d-be44-8293075b35c4 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:44.040903 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-322e2b4f-f93a-4c4d-be44-8293075b35c4 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:44.043976 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-322e2b4f-f93a-4c4d-be44-8293075b35c4 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:44.390455 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-322e2b4f-f93a-4c4d-be44-8293075b35c4 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:44.407828 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-322e2b4f-f93a-4c4d-be44-8293075b35c4 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:44.412058 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-322e2b4f-f93a-4c4d-be44-8293075b35c4 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:44.416584 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-322e2b4f-f93a-4c4d-be44-8293075b35c4 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] 10.222.0.60 "GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f" status: 200 len: 1407 microversion: 2.54 time: 0.414230 Oct 18 15:52:44.417951 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2852/5689] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:52:44 2022] GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f => generated 1407 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:52:45.459789 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8cf910ee-f4a1-4c9c-b707-5706332ff461 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:45.460657 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8cf910ee-f4a1-4c9c-b707-5706332ff461 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] [instance: 77fc629c-1fd4-42f9-a9aa-40dde963e33f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:45.472552 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8cf910ee-f4a1-4c9c-b707-5706332ff461 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:45.476475 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8cf910ee-f4a1-4c9c-b707-5706332ff461 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:45.477133 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8cf910ee-f4a1-4c9c-b707-5706332ff461 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:45.485071 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8cf910ee-f4a1-4c9c-b707-5706332ff461 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:45.485773 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8cf910ee-f4a1-4c9c-b707-5706332ff461 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:45.486371 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8cf910ee-f4a1-4c9c-b707-5706332ff461 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:45.801357 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8cf910ee-f4a1-4c9c-b707-5706332ff461 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:45.814373 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8cf910ee-f4a1-4c9c-b707-5706332ff461 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:45.816449 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8cf910ee-f4a1-4c9c-b707-5706332ff461 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:45.818631 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8cf910ee-f4a1-4c9c-b707-5706332ff461 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] 10.222.0.60 "GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f" status: 200 len: 1407 microversion: 2.54 time: 0.362743 Oct 18 15:52:45.819727 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2853/5690] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:52:45 2022] GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f => generated 1407 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:52:46.750559 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-99beeb55-99a8-42d0-bf9b-fc2fc5bec746 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] 10.222.0.60 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.909904 Oct 18 15:52:46.751456 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2838/5691] 10.222.0.60 () {60 vars in 1170 bytes} [Tue Oct 18 15:52:41 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4911 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:52:46.764218 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a88fe4c7-695f-4e26-b9c4-543206957bdb tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.4.180"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:52:46.766898 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a88fe4c7-695f-4e26-b9c4-543206957bdb tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] [instance: bfd97d9c-daf6-4503-8fd1-ae8750a24793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:46.778587 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a88fe4c7-695f-4e26-b9c4-543206957bdb tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:46.782365 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a88fe4c7-695f-4e26-b9c4-543206957bdb tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:46.784295 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a88fe4c7-695f-4e26-b9c4-543206957bdb tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:46.785357 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a88fe4c7-695f-4e26-b9c4-543206957bdb tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:46.786014 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a88fe4c7-695f-4e26-b9c4-543206957bdb tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:46.786610 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a88fe4c7-695f-4e26-b9c4-543206957bdb tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:46.847714 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5bc355e6-aab2-4d24-a70d-2dda9c612488 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:46.848619 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5bc355e6-aab2-4d24-a70d-2dda9c612488 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] [instance: 77fc629c-1fd4-42f9-a9aa-40dde963e33f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:46.864416 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5bc355e6-aab2-4d24-a70d-2dda9c612488 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:46.867261 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5bc355e6-aab2-4d24-a70d-2dda9c612488 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:46.867888 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5bc355e6-aab2-4d24-a70d-2dda9c612488 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:46.869604 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5bc355e6-aab2-4d24-a70d-2dda9c612488 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:46.874954 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5bc355e6-aab2-4d24-a70d-2dda9c612488 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:46.875708 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5bc355e6-aab2-4d24-a70d-2dda9c612488 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:46.876713 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a88fe4c7-695f-4e26-b9c4-543206957bdb tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "refresh_cache-bfd97d9c-daf6-4503-8fd1-ae8750a24793" {{(pid=120405) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 18 15:52:46.881501 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a88fe4c7-695f-4e26-b9c4-543206957bdb tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquired lock "refresh_cache-bfd97d9c-daf6-4503-8fd1-ae8750a24793" {{(pid=120405) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 18 15:52:47.105479 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5bc355e6-aab2-4d24-a70d-2dda9c612488 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:47.115767 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5bc355e6-aab2-4d24-a70d-2dda9c612488 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:47.124538 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5bc355e6-aab2-4d24-a70d-2dda9c612488 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:47.126091 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5bc355e6-aab2-4d24-a70d-2dda9c612488 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] 10.222.0.60 "GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f" status: 200 len: 1407 microversion: 2.54 time: 0.283960 Oct 18 15:52:47.128757 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2839/5692] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:52:46 2022] GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f => generated 1407 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:52:48.158369 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a3d9f35d-5cc5-4a66-8107-cdb74bb66f67 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:48.159629 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a3d9f35d-5cc5-4a66-8107-cdb74bb66f67 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] [instance: 77fc629c-1fd4-42f9-a9aa-40dde963e33f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:48.165785 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3d9f35d-5cc5-4a66-8107-cdb74bb66f67 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:48.166478 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3d9f35d-5cc5-4a66-8107-cdb74bb66f67 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:48.167085 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3d9f35d-5cc5-4a66-8107-cdb74bb66f67 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:48.167936 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3d9f35d-5cc5-4a66-8107-cdb74bb66f67 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:48.168575 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3d9f35d-5cc5-4a66-8107-cdb74bb66f67 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:48.169496 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3d9f35d-5cc5-4a66-8107-cdb74bb66f67 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:48.261730 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a3d9f35d-5cc5-4a66-8107-cdb74bb66f67 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:48.278911 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a3d9f35d-5cc5-4a66-8107-cdb74bb66f67 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:48.280555 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a3d9f35d-5cc5-4a66-8107-cdb74bb66f67 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:48.281922 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a3d9f35d-5cc5-4a66-8107-cdb74bb66f67 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] 10.222.0.60 "GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f" status: 200 len: 1407 microversion: 2.54 time: 0.128385 Oct 18 15:52:48.297391 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2840/5693] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:52:48 2022] GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f => generated 1407 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:52:49.077526 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-a88fe4c7-695f-4e26-b9c4-543206957bdb tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] [instance: bfd97d9c-daf6-4503-8fd1-ae8750a24793] Building network info cache for instance {{(pid=120405) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}} Oct 18 15:52:49.087216 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-e7defb1c-e873-4df5-9aa4-a5ccb8204980 req-5f9e8501-b7f4-4e92-806f-e100b93020f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfd97d9c-daf6-4503-8fd1-ae8750a24793", "tag": "d953661c-7e35-4446-9f77-70c196bc52ed"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:52:49.105994 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e7defb1c-e873-4df5-9aa4-a5ccb8204980 req-5f9e8501-b7f4-4e92-806f-e100b93020f7 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:49.106614 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e7defb1c-e873-4df5-9aa4-a5ccb8204980 req-5f9e8501-b7f4-4e92-806f-e100b93020f7 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:49.107223 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e7defb1c-e873-4df5-9aa4-a5ccb8204980 req-5f9e8501-b7f4-4e92-806f-e100b93020f7 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:49.129149 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-e7defb1c-e873-4df5-9aa4-a5ccb8204980 req-5f9e8501-b7f4-4e92-806f-e100b93020f7 service nova] Creating event network-changed:d953661c-7e35-4446-9f77-70c196bc52ed for instance bfd97d9c-daf6-4503-8fd1-ae8750a24793 on n-h1-853682-5 Oct 18 15:52:49.143715 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-e7defb1c-e873-4df5-9aa4-a5ccb8204980 req-5f9e8501-b7f4-4e92-806f-e100b93020f7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060083 Oct 18 15:52:49.146675 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2841/5694] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:52:49.322498 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:49.330480 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7cb7c361-852a-449c-bb6c-580867fbdf10 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:49.330801 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7cb7c361-852a-449c-bb6c-580867fbdf10 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] [instance: 77fc629c-1fd4-42f9-a9aa-40dde963e33f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:49.343174 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:49.349452 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7cb7c361-852a-449c-bb6c-580867fbdf10 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:49.349968 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7cb7c361-852a-449c-bb6c-580867fbdf10 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:49.350401 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7cb7c361-852a-449c-bb6c-580867fbdf10 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:49.356435 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7cb7c361-852a-449c-bb6c-580867fbdf10 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:49.357394 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7cb7c361-852a-449c-bb6c-580867fbdf10 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:49.358471 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7cb7c361-852a-449c-bb6c-580867fbdf10 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:49.593338 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7cb7c361-852a-449c-bb6c-580867fbdf10 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:49.621192 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7cb7c361-852a-449c-bb6c-580867fbdf10 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:49.627552 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7cb7c361-852a-449c-bb6c-580867fbdf10 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:49.632643 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7cb7c361-852a-449c-bb6c-580867fbdf10 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] 10.222.0.60 "GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f" status: 200 len: 1407 microversion: 2.54 time: 0.310992 Oct 18 15:52:49.639057 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2842/5695] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:52:49 2022] GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f => generated 1407 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:52:50.665835 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-37b4684d-841f-41ac-9432-a48300676b26 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:50.666483 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-37b4684d-841f-41ac-9432-a48300676b26 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] [instance: 77fc629c-1fd4-42f9-a9aa-40dde963e33f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:50.687280 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-37b4684d-841f-41ac-9432-a48300676b26 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:50.688510 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-37b4684d-841f-41ac-9432-a48300676b26 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:50.689225 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-37b4684d-841f-41ac-9432-a48300676b26 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:50.690297 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-37b4684d-841f-41ac-9432-a48300676b26 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:50.690921 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-37b4684d-841f-41ac-9432-a48300676b26 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:50.691753 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-37b4684d-841f-41ac-9432-a48300676b26 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:51.275321 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-37b4684d-841f-41ac-9432-a48300676b26 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:51.292472 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-37b4684d-841f-41ac-9432-a48300676b26 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:51.298544 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-37b4684d-841f-41ac-9432-a48300676b26 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:51.303355 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-37b4684d-841f-41ac-9432-a48300676b26 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] 10.222.0.60 "GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f" status: 200 len: 1407 microversion: 2.54 time: 0.641762 Oct 18 15:52:51.304989 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2843/5696] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:52:50 2022] GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f => generated 1407 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:52:51.466344 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-a88fe4c7-695f-4e26-b9c4-543206957bdb tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] [instance: bfd97d9c-daf6-4503-8fd1-ae8750a24793] Updating instance_info_cache with network_info: [{"id": "d953661c-7e35-4446-9f77-70c196bc52ed", "address": "fa:16:3e:98:33:8e", "network": {"id": "f869bd7a-04a0-4771-893a-477b7d96732b", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-916656208-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a2164f4bcd424ffbace7a1baf85f36db", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd953661c-7e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120405) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 18 15:52:51.492666 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a88fe4c7-695f-4e26-b9c4-543206957bdb tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Releasing lock "refresh_cache-bfd97d9c-daf6-4503-8fd1-ae8750a24793" {{(pid=120405) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 18 15:52:51.496364 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a88fe4c7-695f-4e26-b9c4-543206957bdb tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] 10.222.0.60 "POST /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793/action" status: 202 len: 0 microversion: 2.1 time: 4.735720 Oct 18 15:52:51.499061 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2854/5697] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:52:46 2022] POST /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793/action => generated 0 bytes in 4740 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Oct 18 15:52:51.510871 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2821c1b3-499a-4354-b0c1-6cf3a1749792 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.4.180"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:52:51.866959 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2821c1b3-499a-4354-b0c1-6cf3a1749792 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] [instance: bfd97d9c-daf6-4503-8fd1-ae8750a24793] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:51.886517 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2821c1b3-499a-4354-b0c1-6cf3a1749792 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:51.887792 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2821c1b3-499a-4354-b0c1-6cf3a1749792 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:51.889954 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2821c1b3-499a-4354-b0c1-6cf3a1749792 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:51.891651 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2821c1b3-499a-4354-b0c1-6cf3a1749792 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:51.892733 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2821c1b3-499a-4354-b0c1-6cf3a1749792 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:51.894021 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2821c1b3-499a-4354-b0c1-6cf3a1749792 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:52.168024 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2fceec83-8009-44db-86a6-bf9d77c1ecee tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:52.172246 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2fceec83-8009-44db-86a6-bf9d77c1ecee tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:52.178633 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:52.197840 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2fceec83-8009-44db-86a6-bf9d77c1ecee tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:52.200658 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2fceec83-8009-44db-86a6-bf9d77c1ecee tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:52.201162 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2fceec83-8009-44db-86a6-bf9d77c1ecee tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:52.203662 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2fceec83-8009-44db-86a6-bf9d77c1ecee tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:52.204149 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2fceec83-8009-44db-86a6-bf9d77c1ecee tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:52.205867 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2fceec83-8009-44db-86a6-bf9d77c1ecee tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:52.299708 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2fceec83-8009-44db-86a6-bf9d77c1ecee tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139/ips" status: 200 len: 148 microversion: 2.20 time: 0.513321 Oct 18 15:52:52.304066 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2855/5698] 10.222.0.60 () {60 vars in 1289 bytes} [Tue Oct 18 15:52:51 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139/ips => generated 148 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:52:52.341134 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c4c02115-aec5-4a70-8e8a-03e06eb37014 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:52.341844 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c4c02115-aec5-4a70-8e8a-03e06eb37014 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] [instance: 77fc629c-1fd4-42f9-a9aa-40dde963e33f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:52.358891 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c4c02115-aec5-4a70-8e8a-03e06eb37014 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:52.360181 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c4c02115-aec5-4a70-8e8a-03e06eb37014 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:52.362100 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c4c02115-aec5-4a70-8e8a-03e06eb37014 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:52.363491 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c4c02115-aec5-4a70-8e8a-03e06eb37014 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:52.366458 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c4c02115-aec5-4a70-8e8a-03e06eb37014 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:52.366986 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c4c02115-aec5-4a70-8e8a-03e06eb37014 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:52.434351 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2821c1b3-499a-4354-b0c1-6cf3a1749792 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "refresh_cache-bfd97d9c-daf6-4503-8fd1-ae8750a24793" {{(pid=120406) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 18 15:52:52.434964 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2821c1b3-499a-4354-b0c1-6cf3a1749792 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquired lock "refresh_cache-bfd97d9c-daf6-4503-8fd1-ae8750a24793" {{(pid=120406) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 18 15:52:52.988616 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c4c02115-aec5-4a70-8e8a-03e06eb37014 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:53.016349 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c4c02115-aec5-4a70-8e8a-03e06eb37014 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:53.017861 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c4c02115-aec5-4a70-8e8a-03e06eb37014 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:53.026451 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c4c02115-aec5-4a70-8e8a-03e06eb37014 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] 10.222.0.60 "GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f" status: 200 len: 1407 microversion: 2.54 time: 0.686011 Oct 18 15:52:53.032624 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2856/5699] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:52:52 2022] GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f => generated 1407 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:52:54.056730 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8e534099-71ab-4994-a4b0-475ac3b5b6c2 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:54.058211 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8e534099-71ab-4994-a4b0-475ac3b5b6c2 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] [instance: 77fc629c-1fd4-42f9-a9aa-40dde963e33f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:54.086452 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8e534099-71ab-4994-a4b0-475ac3b5b6c2 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:54.087210 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8e534099-71ab-4994-a4b0-475ac3b5b6c2 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:54.087936 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8e534099-71ab-4994-a4b0-475ac3b5b6c2 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:54.092917 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8e534099-71ab-4994-a4b0-475ac3b5b6c2 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:54.093857 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8e534099-71ab-4994-a4b0-475ac3b5b6c2 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:54.094482 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8e534099-71ab-4994-a4b0-475ac3b5b6c2 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:54.261614 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8e534099-71ab-4994-a4b0-475ac3b5b6c2 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:54.274113 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8e534099-71ab-4994-a4b0-475ac3b5b6c2 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:54.280939 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8e534099-71ab-4994-a4b0-475ac3b5b6c2 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:54.282983 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8e534099-71ab-4994-a4b0-475ac3b5b6c2 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] 10.222.0.60 "GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f" status: 200 len: 1407 microversion: 2.54 time: 0.232755 Oct 18 15:52:54.288208 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2857/5700] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:52:54 2022] GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f => generated 1407 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:52:55.105604 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-2821c1b3-499a-4354-b0c1-6cf3a1749792 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] [instance: bfd97d9c-daf6-4503-8fd1-ae8750a24793] Building network info cache for instance {{(pid=120406) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}} Oct 18 15:52:55.143585 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-712f3981-bdfd-4774-8cd5-82293c554b74 req-ef4d099f-bd71-40e3-9178-15c85423fc04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfd97d9c-daf6-4503-8fd1-ae8750a24793", "tag": "d953661c-7e35-4446-9f77-70c196bc52ed"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:52:55.192760 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-712f3981-bdfd-4774-8cd5-82293c554b74 req-ef4d099f-bd71-40e3-9178-15c85423fc04 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:55.193069 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-712f3981-bdfd-4774-8cd5-82293c554b74 req-ef4d099f-bd71-40e3-9178-15c85423fc04 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:55.201607 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-712f3981-bdfd-4774-8cd5-82293c554b74 req-ef4d099f-bd71-40e3-9178-15c85423fc04 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:55.226421 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-712f3981-bdfd-4774-8cd5-82293c554b74 req-ef4d099f-bd71-40e3-9178-15c85423fc04 service nova] Creating event network-changed:d953661c-7e35-4446-9f77-70c196bc52ed for instance bfd97d9c-daf6-4503-8fd1-ae8750a24793 on n-h1-853682-5 Oct 18 15:52:55.270227 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-712f3981-bdfd-4774-8cd5-82293c554b74 req-ef4d099f-bd71-40e3-9178-15c85423fc04 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132836 Oct 18 15:52:55.278780 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2858/5701] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:52:55.323886 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-79aabe18-cdc7-4336-b043-d659da150431 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:55.325273 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-79aabe18-cdc7-4336-b043-d659da150431 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] [instance: 77fc629c-1fd4-42f9-a9aa-40dde963e33f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:55.352386 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-79aabe18-cdc7-4336-b043-d659da150431 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:55.358966 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-79aabe18-cdc7-4336-b043-d659da150431 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:55.359637 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-79aabe18-cdc7-4336-b043-d659da150431 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:55.360464 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-79aabe18-cdc7-4336-b043-d659da150431 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:55.360986 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-79aabe18-cdc7-4336-b043-d659da150431 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:55.361417 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-79aabe18-cdc7-4336-b043-d659da150431 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:56.817210 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-79aabe18-cdc7-4336-b043-d659da150431 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:56.826226 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-79aabe18-cdc7-4336-b043-d659da150431 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:56.827676 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-79aabe18-cdc7-4336-b043-d659da150431 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:56.835670 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-79aabe18-cdc7-4336-b043-d659da150431 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] 10.222.0.60 "GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f" status: 200 len: 1407 microversion: 2.54 time: 1.517225 Oct 18 15:52:56.837570 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2859/5702] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:52:55 2022] GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f => generated 1407 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:52:56.939749 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f5334099-1cff-4d9c-b98d-8c309be18ab6 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:52:56.940789 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f5334099-1cff-4d9c-b98d-8c309be18ab6 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:56.957961 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f5334099-1cff-4d9c-b98d-8c309be18ab6 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:56.958479 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f5334099-1cff-4d9c-b98d-8c309be18ab6 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:56.958924 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f5334099-1cff-4d9c-b98d-8c309be18ab6 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:56.959653 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f5334099-1cff-4d9c-b98d-8c309be18ab6 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:56.960111 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f5334099-1cff-4d9c-b98d-8c309be18ab6 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:56.960539 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f5334099-1cff-4d9c-b98d-8c309be18ab6 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:56.997528 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-f5334099-1cff-4d9c-b98d-8c309be18ab6 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lazy-loading 'flavor' on Instance uuid 6af51230-78de-43fb-be54-c1b182368139 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:52:57.416521 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f5334099-1cff-4d9c-b98d-8c309be18ab6 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "POST /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139/action" status: 202 len: 0 microversion: 2.20 time: 0.480986 Oct 18 15:52:57.417778 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2860/5703] 10.222.0.60 () {62 vars in 1319 bytes} [Tue Oct 18 15:52:56 2022] POST /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139/action => generated 0 bytes in 484 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 18 15:52:57.436345 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3ddcf1d6-8d7f-4670-863f-cdf4d49bacf4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:57.437442 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3ddcf1d6-8d7f-4670-863f-cdf4d49bacf4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:57.459577 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ddcf1d6-8d7f-4670-863f-cdf4d49bacf4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:57.461370 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ddcf1d6-8d7f-4670-863f-cdf4d49bacf4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:57.463484 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ddcf1d6-8d7f-4670-863f-cdf4d49bacf4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:57.464413 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ddcf1d6-8d7f-4670-863f-cdf4d49bacf4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:57.467024 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ddcf1d6-8d7f-4670-863f-cdf4d49bacf4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:57.467480 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ddcf1d6-8d7f-4670-863f-cdf4d49bacf4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:58.359673 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3ddcf1d6-8d7f-4670-863f-cdf4d49bacf4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:58.376166 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3ddcf1d6-8d7f-4670-863f-cdf4d49bacf4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:58.378649 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3ddcf1d6-8d7f-4670-863f-cdf4d49bacf4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:58.382910 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3ddcf1d6-8d7f-4670-863f-cdf4d49bacf4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1720 microversion: 2.20 time: 0.956772 Oct 18 15:52:58.397844 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2861/5704] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:52:57 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1720 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:52:58.419465 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8376b2f9-0fb2-4cdf-97d5-3707c986c4b0 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:58.422169 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8376b2f9-0fb2-4cdf-97d5-3707c986c4b0 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] [instance: 77fc629c-1fd4-42f9-a9aa-40dde963e33f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:58.437441 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8376b2f9-0fb2-4cdf-97d5-3707c986c4b0 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:58.439834 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8376b2f9-0fb2-4cdf-97d5-3707c986c4b0 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:58.440606 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8376b2f9-0fb2-4cdf-97d5-3707c986c4b0 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:58.442738 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8376b2f9-0fb2-4cdf-97d5-3707c986c4b0 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:58.444976 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8376b2f9-0fb2-4cdf-97d5-3707c986c4b0 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:58.445677 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8376b2f9-0fb2-4cdf-97d5-3707c986c4b0 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:58.774631 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8376b2f9-0fb2-4cdf-97d5-3707c986c4b0 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:58.790731 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8376b2f9-0fb2-4cdf-97d5-3707c986c4b0 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:58.795650 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8376b2f9-0fb2-4cdf-97d5-3707c986c4b0 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:52:58.797748 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8376b2f9-0fb2-4cdf-97d5-3707c986c4b0 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] 10.222.0.60 "GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f" status: 200 len: 1407 microversion: 2.54 time: 0.397754 Oct 18 15:52:58.799007 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2862/5705] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:52:58 2022] GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f => generated 1407 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:52:59.078494 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-41684d00-dfd1-4a57-88fe-2e9ba3e31d86 tempest-ComputeTenantNetworksTest-1068428514 tempest-ComputeTenantNetworksTest-1068428514-project] Calling method '.version_select at 0x7f7c415bbc10>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:59.091231 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-2821c1b3-499a-4354-b0c1-6cf3a1749792 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] [instance: bfd97d9c-daf6-4503-8fd1-ae8750a24793] Updating instance_info_cache with network_info: [{"id": "d953661c-7e35-4446-9f77-70c196bc52ed", "address": "fa:16:3e:98:33:8e", "network": {"id": "f869bd7a-04a0-4771-893a-477b7d96732b", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-916656208-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a2164f4bcd424ffbace7a1baf85f36db", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd953661c-7e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120406) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 18 15:52:59.099675 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2821c1b3-499a-4354-b0c1-6cf3a1749792 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Releasing lock "refresh_cache-bfd97d9c-daf6-4503-8fd1-ae8750a24793" {{(pid=120406) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 18 15:52:59.100575 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2821c1b3-499a-4354-b0c1-6cf3a1749792 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] 10.222.0.60 "POST /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793/action" status: 202 len: 0 microversion: 2.1 time: 7.596017 Oct 18 15:52:59.105251 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2844/5706] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 15:52:51 2022] POST /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793/action => generated 0 bytes in 7602 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 18 15:52:59.117593 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8d5a4a45-4cbe-4f31-beea-fb666744cbf0 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Calling method '.version_select at 0x7f7c3d819670>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:59.504748 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-41684d00-dfd1-4a57-88fe-2e9ba3e31d86 tempest-ComputeTenantNetworksTest-1068428514 tempest-ComputeTenantNetworksTest-1068428514-project] 10.222.0.60 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.704387 Oct 18 15:52:59.506333 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2863/5707] 10.222.0.60 () {58 vars in 1158 bytes} [Tue Oct 18 15:52:58 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:52:59.512575 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-85b24246-e4bd-488e-adcf-558ee86e94e0 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:52:59.513242 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-85b24246-e4bd-488e-adcf-558ee86e94e0 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:52:59.523739 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-85b24246-e4bd-488e-adcf-558ee86e94e0 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:59.524278 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-85b24246-e4bd-488e-adcf-558ee86e94e0 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:59.524725 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-85b24246-e4bd-488e-adcf-558ee86e94e0 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:59.529415 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-85b24246-e4bd-488e-adcf-558ee86e94e0 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:52:59.529940 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-85b24246-e4bd-488e-adcf-558ee86e94e0 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:52:59.533513 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-85b24246-e4bd-488e-adcf-558ee86e94e0 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:52:59.579526 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:53:00.055137 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-85b24246-e4bd-488e-adcf-558ee86e94e0 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:00.073968 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-85b24246-e4bd-488e-adcf-558ee86e94e0 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:00.079395 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-85b24246-e4bd-488e-adcf-558ee86e94e0 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:00.085261 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-85b24246-e4bd-488e-adcf-558ee86e94e0 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1720 microversion: 2.20 time: 0.577305 Oct 18 15:53:00.085873 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2864/5708] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:52:59 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1720 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:53:00.095355 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-155e8e56-8778-4225-83f6-9618b373190b tempest-ComputeTenantNetworksTest-1068428514 tempest-ComputeTenantNetworksTest-1068428514-project] Calling method '.version_select at 0x7f7c3d01a280>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:00.446162 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-155e8e56-8778-4225-83f6-9618b373190b tempest-ComputeTenantNetworksTest-1068428514 tempest-ComputeTenantNetworksTest-1068428514-project] 10.222.0.60 "GET /compute/v2.1/os-tenant-networks/3b29f462-e537-4aa1-a7f0-3027c38eb7c1" status: 200 len: 140 microversion: 2.1 time: 0.358955 Oct 18 15:53:00.447718 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2865/5709] 10.222.0.60 () {58 vars in 1269 bytes} [Tue Oct 18 15:53:00 2022] GET /compute/v2.1/os-tenant-networks/3b29f462-e537-4aa1-a7f0-3027c38eb7c1 => generated 140 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:53:00.463820 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-23ee8a8e-23e9-4be3-8c57-5fe02ca9e23d tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:00.466633 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-23ee8a8e-23e9-4be3-8c57-5fe02ca9e23d tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] [instance: 77fc629c-1fd4-42f9-a9aa-40dde963e33f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:00.493746 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-23ee8a8e-23e9-4be3-8c57-5fe02ca9e23d tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:00.500940 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-23ee8a8e-23e9-4be3-8c57-5fe02ca9e23d tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:00.501874 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-23ee8a8e-23e9-4be3-8c57-5fe02ca9e23d tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:00.503149 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-23ee8a8e-23e9-4be3-8c57-5fe02ca9e23d tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:00.503357 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-23ee8a8e-23e9-4be3-8c57-5fe02ca9e23d tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:00.504064 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-23ee8a8e-23e9-4be3-8c57-5fe02ca9e23d tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:00.813475 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-23ee8a8e-23e9-4be3-8c57-5fe02ca9e23d tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:00.829496 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-23ee8a8e-23e9-4be3-8c57-5fe02ca9e23d tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:00.834585 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-23ee8a8e-23e9-4be3-8c57-5fe02ca9e23d tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:00.841388 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-23ee8a8e-23e9-4be3-8c57-5fe02ca9e23d tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] 10.222.0.60 "GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f" status: 200 len: 1407 microversion: 2.54 time: 0.387254 Oct 18 15:53:00.842152 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2866/5710] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:53:00 2022] GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f => generated 1407 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:53:01.111527 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-aec5f645-5a88-4c33-a2c3-b8753ba71f47 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:01.112146 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-aec5f645-5a88-4c33-a2c3-b8753ba71f47 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:01.123184 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aec5f645-5a88-4c33-a2c3-b8753ba71f47 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:01.124274 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aec5f645-5a88-4c33-a2c3-b8753ba71f47 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:01.124975 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aec5f645-5a88-4c33-a2c3-b8753ba71f47 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:01.129914 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aec5f645-5a88-4c33-a2c3-b8753ba71f47 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:01.135004 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aec5f645-5a88-4c33-a2c3-b8753ba71f47 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:01.135768 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aec5f645-5a88-4c33-a2c3-b8753ba71f47 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:01.657955 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-aec5f645-5a88-4c33-a2c3-b8753ba71f47 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:01.678129 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-aec5f645-5a88-4c33-a2c3-b8753ba71f47 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:01.679956 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-aec5f645-5a88-4c33-a2c3-b8753ba71f47 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:01.681426 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-aec5f645-5a88-4c33-a2c3-b8753ba71f47 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1720 microversion: 2.20 time: 0.574042 Oct 18 15:53:01.682624 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2867/5711] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:53:01 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1720 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:53:01.873311 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9e7e3299-0536-4452-bb4f-56edf90fd49f tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:01.874684 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9e7e3299-0536-4452-bb4f-56edf90fd49f tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] [instance: 77fc629c-1fd4-42f9-a9aa-40dde963e33f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:01.884298 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8d5a4a45-4cbe-4f31-beea-fb666744cbf0 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] 10.222.0.60 "DELETE /compute/v2.1/os-floating-ips/7637ca56-7dc6-4ecc-a89f-800384e842bc" status: 202 len: 0 microversion: 2.1 time: 2.771457 Oct 18 15:53:01.884945 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2845/5712] 10.222.0.60 () {58 vars in 1263 bytes} [Tue Oct 18 15:52:59 2022] DELETE /compute/v2.1/os-floating-ips/7637ca56-7dc6-4ecc-a89f-800384e842bc => generated 0 bytes in 2773 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:53:01.885517 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9e7e3299-0536-4452-bb4f-56edf90fd49f tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:01.887405 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9e7e3299-0536-4452-bb4f-56edf90fd49f tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:01.890766 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9e7e3299-0536-4452-bb4f-56edf90fd49f tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:01.891813 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9e7e3299-0536-4452-bb4f-56edf90fd49f tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:01.892428 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9e7e3299-0536-4452-bb4f-56edf90fd49f tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:01.894640 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9e7e3299-0536-4452-bb4f-56edf90fd49f tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:01.901851 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0d470100-a1e6-4885-be8f-0f3172ee9b48 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Calling method '.version_select at 0x7f7c3d5c1820>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:01.920043 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=5 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:53:02.042614 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9e7e3299-0536-4452-bb4f-56edf90fd49f tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:02.061329 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9e7e3299-0536-4452-bb4f-56edf90fd49f tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:02.065993 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9e7e3299-0536-4452-bb4f-56edf90fd49f tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:02.071593 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9e7e3299-0536-4452-bb4f-56edf90fd49f tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] 10.222.0.60 "GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f" status: 200 len: 1407 microversion: 2.54 time: 0.202727 Oct 18 15:53:02.095207 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2868/5713] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:53:01 2022] GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f => generated 1407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:53:02.287233 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0d470100-a1e6-4885-be8f-0f3172ee9b48 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/89acbe2b-5a99-4d7d-97be-27dceeb31d3a" status: 202 len: 0 microversion: 2.1 time: 0.389995 Oct 18 15:53:02.288217 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2846/5714] 10.222.0.60 () {58 vars in 1272 bytes} [Tue Oct 18 15:53:01 2022] DELETE /compute/v2.1/os-security-groups/89acbe2b-5a99-4d7d-97be-27dceeb31d3a => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:53:02.309327 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b262ef3d-b22e-4c2e-b967-d817710cf054 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:02.310297 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b262ef3d-b22e-4c2e-b967-d817710cf054 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] [instance: bfd97d9c-daf6-4503-8fd1-ae8750a24793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:02.332412 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b262ef3d-b22e-4c2e-b967-d817710cf054 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:02.332938 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b262ef3d-b22e-4c2e-b967-d817710cf054 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:02.333518 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b262ef3d-b22e-4c2e-b967-d817710cf054 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:02.334091 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b262ef3d-b22e-4c2e-b967-d817710cf054 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:02.342202 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b262ef3d-b22e-4c2e-b967-d817710cf054 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:02.343424 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b262ef3d-b22e-4c2e-b967-d817710cf054 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:02.400281 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b262ef3d-b22e-4c2e-b967-d817710cf054 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] [instance: bfd97d9c-daf6-4503-8fd1-ae8750a24793] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:53:02.650954 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b262ef3d-b22e-4c2e-b967-d817710cf054 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] 10.222.0.60 "DELETE /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793" status: 204 len: 0 microversion: 2.1 time: 0.352511 Oct 18 15:53:02.656398 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2869/5715] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:53:02 2022] DELETE /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:53:02.662374 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-385a2e72-4eb8-45e1-b163-f001d29bec44 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:02.663341 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-385a2e72-4eb8-45e1-b163-f001d29bec44 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] [instance: bfd97d9c-daf6-4503-8fd1-ae8750a24793] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:02.674345 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-385a2e72-4eb8-45e1-b163-f001d29bec44 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:02.675661 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-385a2e72-4eb8-45e1-b163-f001d29bec44 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:02.677400 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-385a2e72-4eb8-45e1-b163-f001d29bec44 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:02.681125 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-385a2e72-4eb8-45e1-b163-f001d29bec44 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:02.682336 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-385a2e72-4eb8-45e1-b163-f001d29bec44 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:02.683022 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-385a2e72-4eb8-45e1-b163-f001d29bec44 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:02.712044 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-125c10c8-42ac-4282-9454-18b9a468532a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:02.713409 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-125c10c8-42ac-4282-9454-18b9a468532a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:02.745806 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-125c10c8-42ac-4282-9454-18b9a468532a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:02.746888 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-125c10c8-42ac-4282-9454-18b9a468532a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:02.760764 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-125c10c8-42ac-4282-9454-18b9a468532a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:02.770615 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-125c10c8-42ac-4282-9454-18b9a468532a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:02.775376 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-125c10c8-42ac-4282-9454-18b9a468532a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:02.776042 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-125c10c8-42ac-4282-9454-18b9a468532a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:03.084719 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-385a2e72-4eb8-45e1-b163-f001d29bec44 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c27994e138c42ffbe4d9151b776ae6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2164f4bcd424ffbace7a1baf85f36db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:03.099607 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-385a2e72-4eb8-45e1-b163-f001d29bec44 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] 10.222.0.60 "GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793" status: 200 len: 1509 microversion: 2.1 time: 0.441811 Oct 18 15:53:03.100222 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2847/5716] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:53:02 2022] GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793 => generated 1509 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:53:03.127945 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1274d20a-9c95-4be4-baec-6c66467241aa tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:03.128980 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1274d20a-9c95-4be4-baec-6c66467241aa tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] [instance: 77fc629c-1fd4-42f9-a9aa-40dde963e33f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:03.137344 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1274d20a-9c95-4be4-baec-6c66467241aa tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:03.144635 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1274d20a-9c95-4be4-baec-6c66467241aa tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:03.145249 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1274d20a-9c95-4be4-baec-6c66467241aa tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:03.146005 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1274d20a-9c95-4be4-baec-6c66467241aa tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:03.146461 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1274d20a-9c95-4be4-baec-6c66467241aa tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:03.149683 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1274d20a-9c95-4be4-baec-6c66467241aa tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:03.188563 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-125c10c8-42ac-4282-9454-18b9a468532a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:03.199940 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-125c10c8-42ac-4282-9454-18b9a468532a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:03.205512 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-125c10c8-42ac-4282-9454-18b9a468532a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:03.214081 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-125c10c8-42ac-4282-9454-18b9a468532a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1720 microversion: 2.20 time: 0.507261 Oct 18 15:53:03.217240 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2870/5717] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:53:02 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1720 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:53:03.321172 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1274d20a-9c95-4be4-baec-6c66467241aa tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:03.344888 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1274d20a-9c95-4be4-baec-6c66467241aa tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:03.351721 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1274d20a-9c95-4be4-baec-6c66467241aa tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:03.359265 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1274d20a-9c95-4be4-baec-6c66467241aa tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] 10.222.0.60 "GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f" status: 200 len: 1407 microversion: 2.54 time: 0.238900 Oct 18 15:53:03.360076 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2848/5718] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:53:03 2022] GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f => generated 1407 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:53:04.134956 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a56237ca-027f-4ba3-bdec-7fe4afb1e6d7 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:04.136353 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a56237ca-027f-4ba3-bdec-7fe4afb1e6d7 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] [instance: bfd97d9c-daf6-4503-8fd1-ae8750a24793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:04.155102 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a56237ca-027f-4ba3-bdec-7fe4afb1e6d7 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:04.155967 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a56237ca-027f-4ba3-bdec-7fe4afb1e6d7 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:04.157013 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a56237ca-027f-4ba3-bdec-7fe4afb1e6d7 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:04.159042 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a56237ca-027f-4ba3-bdec-7fe4afb1e6d7 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:04.159676 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a56237ca-027f-4ba3-bdec-7fe4afb1e6d7 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:04.160730 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a56237ca-027f-4ba3-bdec-7fe4afb1e6d7 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:04.242226 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4ce5b4e9-a61d-462a-9f40-d8d33679c49e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:04.243430 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4ce5b4e9-a61d-462a-9f40-d8d33679c49e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:04.271057 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ce5b4e9-a61d-462a-9f40-d8d33679c49e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:04.278860 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ce5b4e9-a61d-462a-9f40-d8d33679c49e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:04.279557 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ce5b4e9-a61d-462a-9f40-d8d33679c49e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:04.285844 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ce5b4e9-a61d-462a-9f40-d8d33679c49e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:04.296343 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ce5b4e9-a61d-462a-9f40-d8d33679c49e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:04.311935 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ce5b4e9-a61d-462a-9f40-d8d33679c49e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:04.624553 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4ce5b4e9-a61d-462a-9f40-d8d33679c49e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:04.635303 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a56237ca-027f-4ba3-bdec-7fe4afb1e6d7 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c27994e138c42ffbe4d9151b776ae6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2164f4bcd424ffbace7a1baf85f36db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:04.638762 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4ce5b4e9-a61d-462a-9f40-d8d33679c49e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:04.642703 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4ce5b4e9-a61d-462a-9f40-d8d33679c49e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:04.648206 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a56237ca-027f-4ba3-bdec-7fe4afb1e6d7 tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] 10.222.0.60 "GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793" status: 200 len: 1509 microversion: 2.1 time: 0.526062 Oct 18 15:53:04.648696 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4ce5b4e9-a61d-462a-9f40-d8d33679c49e tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1720 microversion: 2.20 time: 0.408643 Oct 18 15:53:04.663598 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2849/5719] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:53:04 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1720 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:53:04.671907 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2871/5720] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:53:04 2022] GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793 => generated 1509 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:53:04.682241 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d5d87170-1503-4d6f-80a9-271e8cbe7104 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:04.685246 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d5d87170-1503-4d6f-80a9-271e8cbe7104 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] [instance: 77fc629c-1fd4-42f9-a9aa-40dde963e33f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:04.713657 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5d87170-1503-4d6f-80a9-271e8cbe7104 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:04.715355 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5d87170-1503-4d6f-80a9-271e8cbe7104 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:04.716309 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5d87170-1503-4d6f-80a9-271e8cbe7104 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:04.718700 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5d87170-1503-4d6f-80a9-271e8cbe7104 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:04.719341 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5d87170-1503-4d6f-80a9-271e8cbe7104 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:04.719964 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5d87170-1503-4d6f-80a9-271e8cbe7104 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:04.932716 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d5d87170-1503-4d6f-80a9-271e8cbe7104 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:04.952405 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d5d87170-1503-4d6f-80a9-271e8cbe7104 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:04.956937 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d5d87170-1503-4d6f-80a9-271e8cbe7104 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:04.958690 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d5d87170-1503-4d6f-80a9-271e8cbe7104 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] 10.222.0.60 "GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f" status: 200 len: 1407 microversion: 2.54 time: 0.293903 Oct 18 15:53:04.978380 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2850/5721] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:53:04 2022] GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f => generated 1407 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:53:05.678942 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1b69fabb-9071-46fc-80a6-f675cc6cdbaf tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:05.679560 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1b69fabb-9071-46fc-80a6-f675cc6cdbaf tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] [instance: bfd97d9c-daf6-4503-8fd1-ae8750a24793] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:05.689916 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8a87ee3b-0152-4a5a-9641-c15a6fb3525a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:05.691499 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8a87ee3b-0152-4a5a-9641-c15a6fb3525a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:05.697371 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1b69fabb-9071-46fc-80a6-f675cc6cdbaf tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:05.698102 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1b69fabb-9071-46fc-80a6-f675cc6cdbaf tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:05.698726 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1b69fabb-9071-46fc-80a6-f675cc6cdbaf tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:05.699964 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1b69fabb-9071-46fc-80a6-f675cc6cdbaf tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:05.701732 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1b69fabb-9071-46fc-80a6-f675cc6cdbaf tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:05.704022 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1b69fabb-9071-46fc-80a6-f675cc6cdbaf tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:05.712572 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a87ee3b-0152-4a5a-9641-c15a6fb3525a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:05.717818 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a87ee3b-0152-4a5a-9641-c15a6fb3525a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:05.718647 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a87ee3b-0152-4a5a-9641-c15a6fb3525a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:05.720024 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a87ee3b-0152-4a5a-9641-c15a6fb3525a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:05.725544 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a87ee3b-0152-4a5a-9641-c15a6fb3525a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:05.726010 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a87ee3b-0152-4a5a-9641-c15a6fb3525a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:06.573384 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8a87ee3b-0152-4a5a-9641-c15a6fb3525a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:06.583401 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8a87ee3b-0152-4a5a-9641-c15a6fb3525a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:06.593214 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8a87ee3b-0152-4a5a-9641-c15a6fb3525a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:06.594680 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8a87ee3b-0152-4a5a-9641-c15a6fb3525a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1720 microversion: 2.20 time: 0.909185 Oct 18 15:53:06.598811 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1b69fabb-9071-46fc-80a6-f675cc6cdbaf tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c27994e138c42ffbe4d9151b776ae6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2164f4bcd424ffbace7a1baf85f36db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:06.611431 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2851/5722] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:53:05 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1720 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:53:06.625926 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5194de04-c3e5-4482-b2da-5d7d10bed0e8 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:06.629947 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5194de04-c3e5-4482-b2da-5d7d10bed0e8 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] [instance: 77fc629c-1fd4-42f9-a9aa-40dde963e33f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:06.639265 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1b69fabb-9071-46fc-80a6-f675cc6cdbaf tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] 10.222.0.60 "GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793" status: 200 len: 1509 microversion: 2.1 time: 0.964775 Oct 18 15:53:06.643736 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5194de04-c3e5-4482-b2da-5d7d10bed0e8 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:06.644603 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2872/5723] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:53:05 2022] GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793 => generated 1509 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:53:06.647127 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5194de04-c3e5-4482-b2da-5d7d10bed0e8 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:06.647902 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5194de04-c3e5-4482-b2da-5d7d10bed0e8 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:06.648785 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5194de04-c3e5-4482-b2da-5d7d10bed0e8 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:06.650448 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5194de04-c3e5-4482-b2da-5d7d10bed0e8 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:06.651028 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5194de04-c3e5-4482-b2da-5d7d10bed0e8 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:06.674927 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-9da7df45-f215-4e9e-ab17-6442f8a596d0 req-73ee2039-f0f1-449f-a5f1-ebb5b1e06394 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfd97d9c-daf6-4503-8fd1-ae8750a24793", "name": "network-vif-deleted", "tag": "d953661c-7e35-4446-9f77-70c196bc52ed"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:53:06.718739 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-9da7df45-f215-4e9e-ab17-6442f8a596d0 req-73ee2039-f0f1-449f-a5f1-ebb5b1e06394 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:06.720778 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-9da7df45-f215-4e9e-ab17-6442f8a596d0 req-73ee2039-f0f1-449f-a5f1-ebb5b1e06394 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:06.724545 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-9da7df45-f215-4e9e-ab17-6442f8a596d0 req-73ee2039-f0f1-449f-a5f1-ebb5b1e06394 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:06.750010 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-9da7df45-f215-4e9e-ab17-6442f8a596d0 req-73ee2039-f0f1-449f-a5f1-ebb5b1e06394 service nova] Creating event network-vif-deleted:d953661c-7e35-4446-9f77-70c196bc52ed for instance bfd97d9c-daf6-4503-8fd1-ae8750a24793 on n-h1-853682-5 Oct 18 15:53:06.765528 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-9da7df45-f215-4e9e-ab17-6442f8a596d0 req-73ee2039-f0f1-449f-a5f1-ebb5b1e06394 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115915 Oct 18 15:53:06.766378 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2873/5724] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:53:06.830450 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5194de04-c3e5-4482-b2da-5d7d10bed0e8 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:06.845096 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5194de04-c3e5-4482-b2da-5d7d10bed0e8 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:06.851177 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5194de04-c3e5-4482-b2da-5d7d10bed0e8 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:06.852431 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5194de04-c3e5-4482-b2da-5d7d10bed0e8 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] 10.222.0.60 "GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f" status: 200 len: 1407 microversion: 2.54 time: 0.239729 Oct 18 15:53:06.878001 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2852/5725] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:53:06 2022] GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f => generated 1407 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:53:07.627639 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9096864c-1dad-41ac-8612-5be3580a90a5 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:07.628437 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9096864c-1dad-41ac-8612-5be3580a90a5 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:07.644944 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9096864c-1dad-41ac-8612-5be3580a90a5 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:07.651594 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9096864c-1dad-41ac-8612-5be3580a90a5 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:07.654309 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9096864c-1dad-41ac-8612-5be3580a90a5 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:07.655179 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9096864c-1dad-41ac-8612-5be3580a90a5 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:07.657624 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9096864c-1dad-41ac-8612-5be3580a90a5 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:07.659800 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9096864c-1dad-41ac-8612-5be3580a90a5 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:07.671049 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fe2aa526-df2d-48b1-b5a5-9d868f296cbe tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:07.671822 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fe2aa526-df2d-48b1-b5a5-9d868f296cbe tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] [instance: bfd97d9c-daf6-4503-8fd1-ae8750a24793] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:07.710192 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe2aa526-df2d-48b1-b5a5-9d868f296cbe tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:07.710711 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe2aa526-df2d-48b1-b5a5-9d868f296cbe tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:07.713608 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe2aa526-df2d-48b1-b5a5-9d868f296cbe tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:07.716052 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe2aa526-df2d-48b1-b5a5-9d868f296cbe tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:07.717030 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe2aa526-df2d-48b1-b5a5-9d868f296cbe tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:07.720502 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe2aa526-df2d-48b1-b5a5-9d868f296cbe tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:07.733281 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:53:07.770830 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-fe2aa526-df2d-48b1-b5a5-9d868f296cbe tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] HTTP exception thrown: Instance bfd97d9c-daf6-4503-8fd1-ae8750a24793 could not be found. Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fe2aa526-df2d-48b1-b5a5-9d868f296cbe tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Request method failure captured: Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793 HTTP/1.1 Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsuMDeZn826ca1DOO0XPldZ-5dGmObNYgX1Q8lv9OgW6TgMxSJwXLXrGWxc9p3eQEXkYVvMBP8u2MMaCzy97ir2Z5M5DsuoSyEmR4BWeeKoojkGYnuN7vR7HLbKqEfqPLgfh_VGr5avm61ubI8qH_TlUyY7SH3IoPocsG6m82VDMZwI Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: a2164f4bcd424ffbace7a1baf85f36db Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-303478262 Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a2164f4bcd424ffbace7a1baf85f36db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a2164f4bcd424ffbace7a1baf85f36db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a2164f4bcd424ffbace7a1baf85f36db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a2164f4bcd424ffbace7a1baf85f36db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-303478262 Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: a2164f4bcd424ffbace7a1baf85f36db Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-303478262 Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServerRescueTestJSONUnderV235-303478262-project Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 0c27994e138c42ffbe4d9151b776ae6e Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-303478262-project Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance bfd97d9c-daf6-4503-8fd1-ae8750a24793 could not be found. Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'bfd97d9c-daf6-4503-8fd1-ae8750a24793'} Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfd97d9c-daf6-4503-8fd1-ae8750a24793 could not be found. Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfd97d9c-daf6-4503-8fd1-ae8750a24793 could not be found. Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:53:07.797165 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:53:07.801461 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:53:07.801461 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:53:07.801461 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:53:07.801461 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:53:07.801461 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:53:07.801461 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:53:07.801461 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfd97d9c-daf6-4503-8fd1-ae8750a24793 could not be found. Oct 18 15:53:07.801461 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:53:07.801461 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fe2aa526-df2d-48b1-b5a5-9d868f296cbe tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] Returning 404 to user: Instance bfd97d9c-daf6-4503-8fd1-ae8750a24793 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:53:07.802209 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fe2aa526-df2d-48b1-b5a5-9d868f296cbe tempest-ServerRescueTestJSONUnderV235-303478262 tempest-ServerRescueTestJSONUnderV235-303478262-project] 10.222.0.60 "GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793" status: 404 len: 111 microversion: 2.1 time: 0.136078 Oct 18 15:53:07.809286 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2853/5726] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:53:07 2022] GET /compute/v2.1/servers/bfd97d9c-daf6-4503-8fd1-ae8750a24793 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:53:07.892316 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2d8332a6-44f5-4590-922c-b555ddf364e8 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:07.893009 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2d8332a6-44f5-4590-922c-b555ddf364e8 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] [instance: 77fc629c-1fd4-42f9-a9aa-40dde963e33f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:07.908640 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d8332a6-44f5-4590-922c-b555ddf364e8 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:07.910211 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d8332a6-44f5-4590-922c-b555ddf364e8 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:07.910667 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d8332a6-44f5-4590-922c-b555ddf364e8 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:07.913841 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d8332a6-44f5-4590-922c-b555ddf364e8 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:07.916070 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d8332a6-44f5-4590-922c-b555ddf364e8 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:07.916854 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d8332a6-44f5-4590-922c-b555ddf364e8 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:08.126221 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2d8332a6-44f5-4590-922c-b555ddf364e8 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:08.145231 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2d8332a6-44f5-4590-922c-b555ddf364e8 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:08.147728 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2d8332a6-44f5-4590-922c-b555ddf364e8 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:08.160186 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2d8332a6-44f5-4590-922c-b555ddf364e8 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] 10.222.0.60 "GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f" status: 200 len: 1407 microversion: 2.54 time: 0.276505 Oct 18 15:53:08.163084 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2854/5727] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:53:07 2022] GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f => generated 1407 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:53:08.272921 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9096864c-1dad-41ac-8612-5be3580a90a5 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:08.284377 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9096864c-1dad-41ac-8612-5be3580a90a5 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:08.289297 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9096864c-1dad-41ac-8612-5be3580a90a5 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:08.290562 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9096864c-1dad-41ac-8612-5be3580a90a5 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1720 microversion: 2.20 time: 0.669775 Oct 18 15:53:08.293969 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2874/5728] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:53:07 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1720 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:53:09.193680 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2a39436f-dae4-4f22-8f13-b59d82fd5e7b tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:09.194345 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2a39436f-dae4-4f22-8f13-b59d82fd5e7b tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] [instance: 77fc629c-1fd4-42f9-a9aa-40dde963e33f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:09.210084 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a39436f-dae4-4f22-8f13-b59d82fd5e7b tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:09.212416 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a39436f-dae4-4f22-8f13-b59d82fd5e7b tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:09.213559 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a39436f-dae4-4f22-8f13-b59d82fd5e7b tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:09.215534 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a39436f-dae4-4f22-8f13-b59d82fd5e7b tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:09.217928 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a39436f-dae4-4f22-8f13-b59d82fd5e7b tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:09.218540 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a39436f-dae4-4f22-8f13-b59d82fd5e7b tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:09.318346 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-736b366c-1be6-443b-a78f-9d1097f2abf0 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:09.319138 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-736b366c-1be6-443b-a78f-9d1097f2abf0 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:09.336475 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-736b366c-1be6-443b-a78f-9d1097f2abf0 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:09.340691 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-736b366c-1be6-443b-a78f-9d1097f2abf0 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:09.342569 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-736b366c-1be6-443b-a78f-9d1097f2abf0 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:09.343448 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-736b366c-1be6-443b-a78f-9d1097f2abf0 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:09.349168 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-736b366c-1be6-443b-a78f-9d1097f2abf0 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:09.349723 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-736b366c-1be6-443b-a78f-9d1097f2abf0 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:09.430517 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2a39436f-dae4-4f22-8f13-b59d82fd5e7b tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:09.453836 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2a39436f-dae4-4f22-8f13-b59d82fd5e7b tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:09.455623 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2a39436f-dae4-4f22-8f13-b59d82fd5e7b tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:09.456911 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2a39436f-dae4-4f22-8f13-b59d82fd5e7b tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] 10.222.0.60 "GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f" status: 200 len: 1407 microversion: 2.54 time: 0.269743 Oct 18 15:53:09.478588 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2855/5729] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:53:09 2022] GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f => generated 1407 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:53:10.068210 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-736b366c-1be6-443b-a78f-9d1097f2abf0 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:10.105166 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-736b366c-1be6-443b-a78f-9d1097f2abf0 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:10.122573 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-736b366c-1be6-443b-a78f-9d1097f2abf0 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:10.131804 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-736b366c-1be6-443b-a78f-9d1097f2abf0 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1741 microversion: 2.20 time: 0.814150 Oct 18 15:53:10.133435 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2875/5730] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:53:09 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1741 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:53:10.500199 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a5f1b9f7-9681-4f71-9e61-d4f2f0ea93b4 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:10.503030 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a5f1b9f7-9681-4f71-9e61-d4f2f0ea93b4 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] [instance: 77fc629c-1fd4-42f9-a9aa-40dde963e33f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:10.552418 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5f1b9f7-9681-4f71-9e61-d4f2f0ea93b4 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:10.554463 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5f1b9f7-9681-4f71-9e61-d4f2f0ea93b4 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:10.559815 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5f1b9f7-9681-4f71-9e61-d4f2f0ea93b4 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:10.570340 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5f1b9f7-9681-4f71-9e61-d4f2f0ea93b4 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:10.572096 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5f1b9f7-9681-4f71-9e61-d4f2f0ea93b4 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:10.575393 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5f1b9f7-9681-4f71-9e61-d4f2f0ea93b4 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:10.937467 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a5f1b9f7-9681-4f71-9e61-d4f2f0ea93b4 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:10.955489 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a5f1b9f7-9681-4f71-9e61-d4f2f0ea93b4 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:10.963128 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a5f1b9f7-9681-4f71-9e61-d4f2f0ea93b4 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:10.971270 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a5f1b9f7-9681-4f71-9e61-d4f2f0ea93b4 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] 10.222.0.60 "GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f" status: 200 len: 1407 microversion: 2.54 time: 0.487370 Oct 18 15:53:10.988834 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2856/5731] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:53:10 2022] GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f => generated 1407 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:53:11.161403 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-445f2935-59c4-4800-ac6f-c92620f3f7ee tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:11.162053 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-445f2935-59c4-4800-ac6f-c92620f3f7ee tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:11.186423 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-445f2935-59c4-4800-ac6f-c92620f3f7ee tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:11.186945 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-445f2935-59c4-4800-ac6f-c92620f3f7ee tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:11.191058 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-445f2935-59c4-4800-ac6f-c92620f3f7ee tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:11.192299 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-445f2935-59c4-4800-ac6f-c92620f3f7ee tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:11.192785 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-445f2935-59c4-4800-ac6f-c92620f3f7ee tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:11.201041 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-445f2935-59c4-4800-ac6f-c92620f3f7ee tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:11.868678 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-445f2935-59c4-4800-ac6f-c92620f3f7ee tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:11.897318 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-445f2935-59c4-4800-ac6f-c92620f3f7ee tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:11.903466 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-445f2935-59c4-4800-ac6f-c92620f3f7ee tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:11.908944 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-445f2935-59c4-4800-ac6f-c92620f3f7ee tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1736 microversion: 2.20 time: 0.751356 Oct 18 15:53:11.912446 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2876/5732] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:53:11 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1736 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:53:12.005641 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8b110ed8-d822-44bd-84b0-f3bc65cf5e91 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:12.006325 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8b110ed8-d822-44bd-84b0-f3bc65cf5e91 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] [instance: 77fc629c-1fd4-42f9-a9aa-40dde963e33f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:12.027553 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b110ed8-d822-44bd-84b0-f3bc65cf5e91 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:12.028590 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b110ed8-d822-44bd-84b0-f3bc65cf5e91 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:12.029900 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b110ed8-d822-44bd-84b0-f3bc65cf5e91 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:12.032019 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b110ed8-d822-44bd-84b0-f3bc65cf5e91 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:12.032618 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b110ed8-d822-44bd-84b0-f3bc65cf5e91 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:12.033127 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b110ed8-d822-44bd-84b0-f3bc65cf5e91 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:12.284750 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8b110ed8-d822-44bd-84b0-f3bc65cf5e91 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:12.298047 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8b110ed8-d822-44bd-84b0-f3bc65cf5e91 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:12.304707 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8b110ed8-d822-44bd-84b0-f3bc65cf5e91 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:12.309782 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8b110ed8-d822-44bd-84b0-f3bc65cf5e91 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] 10.222.0.60 "GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f" status: 200 len: 1413 microversion: 2.54 time: 0.308427 Oct 18 15:53:12.310616 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2857/5733] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:53:11 2022] GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f => generated 1413 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:53:12.937409 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a08abefc-f962-4a91-9c5b-ec11a517da80 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:12.938052 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a08abefc-f962-4a91-9c5b-ec11a517da80 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:12.955110 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a08abefc-f962-4a91-9c5b-ec11a517da80 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:12.955617 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a08abefc-f962-4a91-9c5b-ec11a517da80 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:12.956068 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a08abefc-f962-4a91-9c5b-ec11a517da80 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:12.956799 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a08abefc-f962-4a91-9c5b-ec11a517da80 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:12.973163 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a08abefc-f962-4a91-9c5b-ec11a517da80 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:12.973904 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a08abefc-f962-4a91-9c5b-ec11a517da80 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:13.343645 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-77a2e976-945b-4bfc-a18a-33257a612c83 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:13.344370 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-77a2e976-945b-4bfc-a18a-33257a612c83 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] [instance: 77fc629c-1fd4-42f9-a9aa-40dde963e33f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:13.362804 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77a2e976-945b-4bfc-a18a-33257a612c83 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:13.363316 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77a2e976-945b-4bfc-a18a-33257a612c83 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:13.363764 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77a2e976-945b-4bfc-a18a-33257a612c83 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:13.364488 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77a2e976-945b-4bfc-a18a-33257a612c83 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:13.364977 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77a2e976-945b-4bfc-a18a-33257a612c83 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:13.365415 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77a2e976-945b-4bfc-a18a-33257a612c83 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:13.765982 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a08abefc-f962-4a91-9c5b-ec11a517da80 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:13.772470 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-77a2e976-945b-4bfc-a18a-33257a612c83 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:13.786751 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-77a2e976-945b-4bfc-a18a-33257a612c83 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:13.787638 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a08abefc-f962-4a91-9c5b-ec11a517da80 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:13.795643 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a08abefc-f962-4a91-9c5b-ec11a517da80 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:13.805649 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a08abefc-f962-4a91-9c5b-ec11a517da80 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1736 microversion: 2.20 time: 0.872466 Oct 18 15:53:13.809984 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2877/5734] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:53:12 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1736 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:53:13.833172 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-77a2e976-945b-4bfc-a18a-33257a612c83 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:13.834655 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-77a2e976-945b-4bfc-a18a-33257a612c83 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] 10.222.0.60 "GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f" status: 200 len: 1413 microversion: 2.54 time: 0.495668 Oct 18 15:53:13.838247 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2858/5735] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:53:13 2022] GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f => generated 1413 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:53:14.837508 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-03c17071-dfe1-42d3-9880-94efe8fa0963 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:14.838167 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-03c17071-dfe1-42d3-9880-94efe8fa0963 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:14.872176 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-03c17071-dfe1-42d3-9880-94efe8fa0963 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:14.873031 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-03c17071-dfe1-42d3-9880-94efe8fa0963 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:14.875598 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-03c17071-dfe1-42d3-9880-94efe8fa0963 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:14.876552 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-03c17071-dfe1-42d3-9880-94efe8fa0963 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:14.877348 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-03c17071-dfe1-42d3-9880-94efe8fa0963 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:14.885566 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b0c9d142-3612-417b-a929-665181b377f4 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:14.895557 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-03c17071-dfe1-42d3-9880-94efe8fa0963 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:14.912044 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b0c9d142-3612-417b-a929-665181b377f4 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] [instance: 77fc629c-1fd4-42f9-a9aa-40dde963e33f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:15.009719 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b0c9d142-3612-417b-a929-665181b377f4 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:15.012704 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b0c9d142-3612-417b-a929-665181b377f4 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:15.033570 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b0c9d142-3612-417b-a929-665181b377f4 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:15.045262 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b0c9d142-3612-417b-a929-665181b377f4 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:15.051078 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b0c9d142-3612-417b-a929-665181b377f4 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:15.052346 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b0c9d142-3612-417b-a929-665181b377f4 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:16.028892 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b0c9d142-3612-417b-a929-665181b377f4 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:16.040721 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b0c9d142-3612-417b-a929-665181b377f4 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:16.047057 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b0c9d142-3612-417b-a929-665181b377f4 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:16.051001 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b0c9d142-3612-417b-a929-665181b377f4 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] 10.222.0.60 "GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f" status: 200 len: 1398 microversion: 2.54 time: 1.187232 Oct 18 15:53:16.084955 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2859/5736] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:53:14 2022] GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f => generated 1398 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:53:16.098934 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-ff2855c2-4982-4d72-8662-0bb54c52d17e req-f2f14ffc-627f-47ea-bc76-e69d391463c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6af51230-78de-43fb-be54-c1b182368139", "name": "network-vif-plugged", "status": "completed", "tag": "e6888c52-692f-4a5c-a3cf-e7018e476bf5"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:53:16.128918 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ff2855c2-4982-4d72-8662-0bb54c52d17e req-f2f14ffc-627f-47ea-bc76-e69d391463c0 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:16.131464 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ff2855c2-4982-4d72-8662-0bb54c52d17e req-f2f14ffc-627f-47ea-bc76-e69d391463c0 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:16.132165 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ff2855c2-4982-4d72-8662-0bb54c52d17e req-f2f14ffc-627f-47ea-bc76-e69d391463c0 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:16.166457 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-ff2855c2-4982-4d72-8662-0bb54c52d17e req-f2f14ffc-627f-47ea-bc76-e69d391463c0 service nova] Creating event network-vif-plugged:e6888c52-692f-4a5c-a3cf-e7018e476bf5 for instance 6af51230-78de-43fb-be54-c1b182368139 on n-h2-853682-5 Oct 18 15:53:16.177614 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-ff2855c2-4982-4d72-8662-0bb54c52d17e req-f2f14ffc-627f-47ea-bc76-e69d391463c0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091000 Oct 18 15:53:16.181799 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2860/5737] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:53:16.198004 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bc5fd38f-2e15-4cd9-91ea-0a1ace39a349 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Calling method '.version_select at 0x7f7c3d8191f0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:16.253801 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bc5fd38f-2e15-4cd9-91ea-0a1ace39a349 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1647916641" status: 204 len: 0 microversion: 2.54 time: 0.069420 Oct 18 15:53:16.254431 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2861/5738] 10.222.0.60 () {60 vars in 1319 bytes} [Tue Oct 18 15:53:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1647916641 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 15:53:16.273022 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6b649226-36d6-4bea-9ac0-4608fa53403d tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:16.273643 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6b649226-36d6-4bea-9ac0-4608fa53403d tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] [instance: 77fc629c-1fd4-42f9-a9aa-40dde963e33f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:16.285140 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b649226-36d6-4bea-9ac0-4608fa53403d tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:16.287733 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b649226-36d6-4bea-9ac0-4608fa53403d tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:16.290202 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b649226-36d6-4bea-9ac0-4608fa53403d tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:16.291116 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b649226-36d6-4bea-9ac0-4608fa53403d tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:16.291576 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b649226-36d6-4bea-9ac0-4608fa53403d tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:16.294246 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b649226-36d6-4bea-9ac0-4608fa53403d tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:16.378028 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6b649226-36d6-4bea-9ac0-4608fa53403d tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] [instance: 77fc629c-1fd4-42f9-a9aa-40dde963e33f] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:53:16.531701 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-03c17071-dfe1-42d3-9880-94efe8fa0963 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:16.546123 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-03c17071-dfe1-42d3-9880-94efe8fa0963 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:16.547620 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-03c17071-dfe1-42d3-9880-94efe8fa0963 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:16.552008 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6b649226-36d6-4bea-9ac0-4608fa53403d tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] 10.222.0.60 "DELETE /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f" status: 204 len: 0 microversion: 2.54 time: 0.279174 Oct 18 15:53:16.555955 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2862/5739] 10.222.0.60 () {60 vars in 1280 bytes} [Tue Oct 18 15:53:16 2022] DELETE /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 18 15:53:16.565444 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-03c17071-dfe1-42d3-9880-94efe8fa0963 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1736 microversion: 2.20 time: 1.715832 Oct 18 15:53:16.566864 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2878/5740] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:53:14 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1736 bytes in 1734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:53:16.571744 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d8a9c475-9d55-4cb7-8819-adc207736919 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:16.572482 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d8a9c475-9d55-4cb7-8819-adc207736919 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] [instance: 77fc629c-1fd4-42f9-a9aa-40dde963e33f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:16.611064 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8a9c475-9d55-4cb7-8819-adc207736919 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:16.613195 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8a9c475-9d55-4cb7-8819-adc207736919 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:16.613924 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8a9c475-9d55-4cb7-8819-adc207736919 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:16.621658 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8a9c475-9d55-4cb7-8819-adc207736919 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:16.624441 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8a9c475-9d55-4cb7-8819-adc207736919 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:16.629952 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8a9c475-9d55-4cb7-8819-adc207736919 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:17.044655 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d8a9c475-9d55-4cb7-8819-adc207736919 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:17.090724 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d8a9c475-9d55-4cb7-8819-adc207736919 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:17.092215 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d8a9c475-9d55-4cb7-8819-adc207736919 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:17.093836 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d8a9c475-9d55-4cb7-8819-adc207736919 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] 10.222.0.60 "GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f" status: 200 len: 1404 microversion: 2.54 time: 0.533072 Oct 18 15:53:17.098092 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2863/5741] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:53:16 2022] GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f => generated 1404 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:53:17.597538 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-dd2d6c1f-5ea6-4ebc-b7d6-09c4fc98e191 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:17.598157 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-dd2d6c1f-5ea6-4ebc-b7d6-09c4fc98e191 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:17.613039 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dd2d6c1f-5ea6-4ebc-b7d6-09c4fc98e191 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:17.617342 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dd2d6c1f-5ea6-4ebc-b7d6-09c4fc98e191 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:17.622499 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dd2d6c1f-5ea6-4ebc-b7d6-09c4fc98e191 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:17.623604 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dd2d6c1f-5ea6-4ebc-b7d6-09c4fc98e191 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:17.625929 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dd2d6c1f-5ea6-4ebc-b7d6-09c4fc98e191 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:17.627351 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dd2d6c1f-5ea6-4ebc-b7d6-09c4fc98e191 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:18.132694 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2beb1507-8f01-4100-b92c-189570ec3ce3 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:18.133371 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2beb1507-8f01-4100-b92c-189570ec3ce3 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] [instance: 77fc629c-1fd4-42f9-a9aa-40dde963e33f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:18.148844 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2beb1507-8f01-4100-b92c-189570ec3ce3 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:18.156323 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2beb1507-8f01-4100-b92c-189570ec3ce3 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:18.156786 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2beb1507-8f01-4100-b92c-189570ec3ce3 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:18.157569 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2beb1507-8f01-4100-b92c-189570ec3ce3 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:18.158037 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2beb1507-8f01-4100-b92c-189570ec3ce3 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:18.158484 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2beb1507-8f01-4100-b92c-189570ec3ce3 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:18.240466 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-dd2d6c1f-5ea6-4ebc-b7d6-09c4fc98e191 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:18.258656 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-dd2d6c1f-5ea6-4ebc-b7d6-09c4fc98e191 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:18.260161 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-dd2d6c1f-5ea6-4ebc-b7d6-09c4fc98e191 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:18.266453 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-dd2d6c1f-5ea6-4ebc-b7d6-09c4fc98e191 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1736 microversion: 2.20 time: 0.672711 Oct 18 15:53:18.290651 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2879/5742] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:53:17 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1736 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:53:18.430317 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2beb1507-8f01-4100-b92c-189570ec3ce3 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:18.439586 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2beb1507-8f01-4100-b92c-189570ec3ce3 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:18.455859 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2beb1507-8f01-4100-b92c-189570ec3ce3 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:18.457214 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2beb1507-8f01-4100-b92c-189570ec3ce3 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] 10.222.0.60 "GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f" status: 200 len: 1404 microversion: 2.54 time: 0.329448 Oct 18 15:53:18.491338 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2864/5743] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:53:18 2022] GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f => generated 1404 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:53:19.297044 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ca7b307e-7fc2-41d3-bfe4-cae1b04462d9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:19.298903 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ca7b307e-7fc2-41d3-bfe4-cae1b04462d9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:19.323045 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca7b307e-7fc2-41d3-bfe4-cae1b04462d9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:19.327594 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca7b307e-7fc2-41d3-bfe4-cae1b04462d9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:19.334811 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca7b307e-7fc2-41d3-bfe4-cae1b04462d9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:19.337137 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca7b307e-7fc2-41d3-bfe4-cae1b04462d9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:19.340381 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca7b307e-7fc2-41d3-bfe4-cae1b04462d9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:19.349175 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca7b307e-7fc2-41d3-bfe4-cae1b04462d9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:19.487339 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-96aa1e0b-36c2-478e-b8f5-393290d8a608 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:19.488549 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-96aa1e0b-36c2-478e-b8f5-393290d8a608 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] [instance: 77fc629c-1fd4-42f9-a9aa-40dde963e33f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:19.521594 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96aa1e0b-36c2-478e-b8f5-393290d8a608 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:19.522090 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96aa1e0b-36c2-478e-b8f5-393290d8a608 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:19.522529 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96aa1e0b-36c2-478e-b8f5-393290d8a608 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:19.531813 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96aa1e0b-36c2-478e-b8f5-393290d8a608 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:19.532498 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96aa1e0b-36c2-478e-b8f5-393290d8a608 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:19.533048 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96aa1e0b-36c2-478e-b8f5-393290d8a608 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:19.708781 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96aa1e0b-36c2-478e-b8f5-393290d8a608 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:19.718104 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96aa1e0b-36c2-478e-b8f5-393290d8a608 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:19.718576 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96aa1e0b-36c2-478e-b8f5-393290d8a608 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:19.719056 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-96aa1e0b-36c2-478e-b8f5-393290d8a608 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lazy-loading 'fault' on Instance uuid 77fc629c-1fd4-42f9-a9aa-40dde963e33f {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:53:20.108849 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-96aa1e0b-36c2-478e-b8f5-393290d8a608 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:20.126033 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-96aa1e0b-36c2-478e-b8f5-393290d8a608 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:20.127496 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-96aa1e0b-36c2-478e-b8f5-393290d8a608 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229b7746de984addaecc5e01ddea3207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de33b2593b254c58ab78562a8fbe076f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:20.128745 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-96aa1e0b-36c2-478e-b8f5-393290d8a608 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] 10.222.0.60 "GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f" status: 200 len: 1409 microversion: 2.54 time: 0.645581 Oct 18 15:53:20.148475 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2865/5744] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:53:19 2022] GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f => generated 1409 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:53:20.284845 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ca7b307e-7fc2-41d3-bfe4-cae1b04462d9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:20.295103 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:53:20.313391 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ca7b307e-7fc2-41d3-bfe4-cae1b04462d9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:20.329571 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ca7b307e-7fc2-41d3-bfe4-cae1b04462d9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:20.334213 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ca7b307e-7fc2-41d3-bfe4-cae1b04462d9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1736 microversion: 2.20 time: 1.042262 Oct 18 15:53:20.343172 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2880/5745] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:53:19 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1736 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:53:21.196239 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-23df1958-dbcd-4b74-a6c6-a511a53eab51 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:21.200905 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-23df1958-dbcd-4b74-a6c6-a511a53eab51 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] [instance: 77fc629c-1fd4-42f9-a9aa-40dde963e33f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:21.231251 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23df1958-dbcd-4b74-a6c6-a511a53eab51 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:21.234703 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23df1958-dbcd-4b74-a6c6-a511a53eab51 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:21.235996 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23df1958-dbcd-4b74-a6c6-a511a53eab51 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:21.242140 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23df1958-dbcd-4b74-a6c6-a511a53eab51 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:21.246307 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23df1958-dbcd-4b74-a6c6-a511a53eab51 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:21.247358 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23df1958-dbcd-4b74-a6c6-a511a53eab51 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:21.318386 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-23df1958-dbcd-4b74-a6c6-a511a53eab51 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] HTTP exception thrown: Instance 77fc629c-1fd4-42f9-a9aa-40dde963e33f could not be found. Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-23df1958-dbcd-4b74-a6c6-a511a53eab51 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Request method failure captured: Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f HTTP/1.1 Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsvAHNKSaDP2FR9bf4PQw8z-5VVkU8M1y_3W6FenONNtrZbzfkR3f6z9J2XnaajSWuBpilpExZxbYuc6TV-FSw7aoqtez0xEavHgXo70vypMikKoaAVPG0TPLN9A1lAEBd00fD362TCN-FvLV6XZy-dlITRUJ6sC5EgpcohH71v543U Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: X-Openstack-Nova-Api-Version: 2.54 Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: de33b2593b254c58ab78562a8fbe076f Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerShowV254Test-1642694154 Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/de33b2593b254c58ab78562a8fbe076f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/de33b2593b254c58ab78562a8fbe076f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/de33b2593b254c58ab78562a8fbe076f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_de33b2593b254c58ab78562a8fbe076f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServerShowV254Test-1642694154 Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: de33b2593b254c58ab78562a8fbe076f Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerShowV254Test-1642694154 Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServerShowV254Test-1642694154-project Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 229b7746de984addaecc5e01ddea3207 Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServerShowV254Test-1642694154-project Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 77fc629c-1fd4-42f9-a9aa-40dde963e33f could not be found. Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '77fc629c-1fd4-42f9-a9aa-40dde963e33f'} Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77fc629c-1fd4-42f9-a9aa-40dde963e33f could not be found. Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77fc629c-1fd4-42f9-a9aa-40dde963e33f could not be found. Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:53:21.321929 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:53:21.330513 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:53:21.330513 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:53:21.330513 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:53:21.330513 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:53:21.330513 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:53:21.330513 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77fc629c-1fd4-42f9-a9aa-40dde963e33f could not be found. Oct 18 15:53:21.330513 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:53:21.336378 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-23df1958-dbcd-4b74-a6c6-a511a53eab51 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] Returning 404 to user: Instance 77fc629c-1fd4-42f9-a9aa-40dde963e33f could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:53:21.341162 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-23df1958-dbcd-4b74-a6c6-a511a53eab51 tempest-ServerShowV254Test-1642694154 tempest-ServerShowV254Test-1642694154-project] 10.222.0.60 "GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f" status: 404 len: 111 microversion: 2.54 time: 0.162639 Oct 18 15:53:21.345079 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2866/5746] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:53:21 2022] GET /compute/v2.1/servers/77fc629c-1fd4-42f9-a9aa-40dde963e33f => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:53:21.373293 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-400427fe-3180-4c58-ae8e-2e25ce9d0187 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:21.374043 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-400427fe-3180-4c58-ae8e-2e25ce9d0187 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:21.398253 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-400427fe-3180-4c58-ae8e-2e25ce9d0187 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:21.398751 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-400427fe-3180-4c58-ae8e-2e25ce9d0187 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:21.399194 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-400427fe-3180-4c58-ae8e-2e25ce9d0187 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:21.399913 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-400427fe-3180-4c58-ae8e-2e25ce9d0187 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:21.400369 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-400427fe-3180-4c58-ae8e-2e25ce9d0187 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:21.412201 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-400427fe-3180-4c58-ae8e-2e25ce9d0187 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:22.270945 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-400427fe-3180-4c58-ae8e-2e25ce9d0187 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:22.283718 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-400427fe-3180-4c58-ae8e-2e25ce9d0187 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:22.288072 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-400427fe-3180-4c58-ae8e-2e25ce9d0187 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:22.293161 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-400427fe-3180-4c58-ae8e-2e25ce9d0187 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1736 microversion: 2.20 time: 0.925266 Oct 18 15:53:22.319574 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2881/5747] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:53:21 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1736 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:53:23.328257 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f2594146-922f-4ad9-a926-752db16f4dec tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:23.329616 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f2594146-922f-4ad9-a926-752db16f4dec tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:23.356479 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2594146-922f-4ad9-a926-752db16f4dec tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:23.360431 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2594146-922f-4ad9-a926-752db16f4dec tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:23.361494 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2594146-922f-4ad9-a926-752db16f4dec tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:23.365151 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2594146-922f-4ad9-a926-752db16f4dec tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:23.369207 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2594146-922f-4ad9-a926-752db16f4dec tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:23.373254 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2594146-922f-4ad9-a926-752db16f4dec tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:24.143063 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f2594146-922f-4ad9-a926-752db16f4dec tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:24.162618 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f2594146-922f-4ad9-a926-752db16f4dec tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:24.166024 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f2594146-922f-4ad9-a926-752db16f4dec tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:24.176696 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f2594146-922f-4ad9-a926-752db16f4dec tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1736 microversion: 2.20 time: 0.849302 Oct 18 15:53:24.177893 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2867/5748] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:53:23 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1736 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:53:25.207920 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e6e4eb94-a8e2-4227-a85a-c2e931a70324 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:25.208535 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e6e4eb94-a8e2-4227-a85a-c2e931a70324 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:25.213996 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:53:25.231816 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e6e4eb94-a8e2-4227-a85a-c2e931a70324 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:25.235542 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e6e4eb94-a8e2-4227-a85a-c2e931a70324 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:25.240170 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e6e4eb94-a8e2-4227-a85a-c2e931a70324 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:25.244240 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e6e4eb94-a8e2-4227-a85a-c2e931a70324 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:25.246596 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e6e4eb94-a8e2-4227-a85a-c2e931a70324 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:25.247204 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e6e4eb94-a8e2-4227-a85a-c2e931a70324 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:25.950811 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e6e4eb94-a8e2-4227-a85a-c2e931a70324 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:25.959691 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e6e4eb94-a8e2-4227-a85a-c2e931a70324 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:25.972539 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e6e4eb94-a8e2-4227-a85a-c2e931a70324 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:25.973885 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e6e4eb94-a8e2-4227-a85a-c2e931a70324 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1736 microversion: 2.20 time: 0.769993 Oct 18 15:53:26.004942 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2882/5749] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:53:25 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1736 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:53:27.003860 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-98f714a6-41e5-49f8-bfc1-b781d49e235b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:27.005283 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-98f714a6-41e5-49f8-bfc1-b781d49e235b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:27.016412 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98f714a6-41e5-49f8-bfc1-b781d49e235b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:27.022046 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98f714a6-41e5-49f8-bfc1-b781d49e235b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:27.022863 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98f714a6-41e5-49f8-bfc1-b781d49e235b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:27.024147 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98f714a6-41e5-49f8-bfc1-b781d49e235b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:27.024864 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98f714a6-41e5-49f8-bfc1-b781d49e235b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:27.025565 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98f714a6-41e5-49f8-bfc1-b781d49e235b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:28.590794 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-98f714a6-41e5-49f8-bfc1-b781d49e235b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:28.627553 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-98f714a6-41e5-49f8-bfc1-b781d49e235b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:28.629152 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-98f714a6-41e5-49f8-bfc1-b781d49e235b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:28.639958 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-98f714a6-41e5-49f8-bfc1-b781d49e235b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1736 microversion: 2.20 time: 1.640068 Oct 18 15:53:28.674907 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2868/5750] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:53:26 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1736 bytes in 1676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:53:29.677597 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-dc0cb476-65f3-4587-97b6-aa63476f27b4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:29.678916 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-dc0cb476-65f3-4587-97b6-aa63476f27b4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:29.695867 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dc0cb476-65f3-4587-97b6-aa63476f27b4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:29.696826 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dc0cb476-65f3-4587-97b6-aa63476f27b4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:29.697588 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dc0cb476-65f3-4587-97b6-aa63476f27b4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:29.699338 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dc0cb476-65f3-4587-97b6-aa63476f27b4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:29.700201 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dc0cb476-65f3-4587-97b6-aa63476f27b4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:29.701346 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dc0cb476-65f3-4587-97b6-aa63476f27b4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:30.669299 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-dc0cb476-65f3-4587-97b6-aa63476f27b4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:30.684677 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-dc0cb476-65f3-4587-97b6-aa63476f27b4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:30.694085 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-dc0cb476-65f3-4587-97b6-aa63476f27b4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:30.702903 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-dc0cb476-65f3-4587-97b6-aa63476f27b4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1736 microversion: 2.20 time: 1.028976 Oct 18 15:53:30.707583 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2883/5751] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:53:29 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1736 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:53:31.735355 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6057c05d-3a6b-4fae-8e9c-f4c60f303ddc tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:31.735974 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6057c05d-3a6b-4fae-8e9c-f4c60f303ddc tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:31.762712 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6057c05d-3a6b-4fae-8e9c-f4c60f303ddc tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:31.763216 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6057c05d-3a6b-4fae-8e9c-f4c60f303ddc tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:31.763684 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6057c05d-3a6b-4fae-8e9c-f4c60f303ddc tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:31.764462 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6057c05d-3a6b-4fae-8e9c-f4c60f303ddc tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:31.772512 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6057c05d-3a6b-4fae-8e9c-f4c60f303ddc tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:31.774748 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6057c05d-3a6b-4fae-8e9c-f4c60f303ddc tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:32.545027 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6057c05d-3a6b-4fae-8e9c-f4c60f303ddc tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:32.569917 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6057c05d-3a6b-4fae-8e9c-f4c60f303ddc tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:32.571608 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6057c05d-3a6b-4fae-8e9c-f4c60f303ddc tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:32.590707 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6057c05d-3a6b-4fae-8e9c-f4c60f303ddc tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1736 microversion: 2.20 time: 0.859214 Oct 18 15:53:32.601492 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2869/5752] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:53:31 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1736 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:53:33.631055 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1f449125-20e7-4fdb-bd24-694e4b5942a1 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:33.632523 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1f449125-20e7-4fdb-bd24-694e4b5942a1 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:33.656759 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1f449125-20e7-4fdb-bd24-694e4b5942a1 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:33.662750 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1f449125-20e7-4fdb-bd24-694e4b5942a1 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:33.663223 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1f449125-20e7-4fdb-bd24-694e4b5942a1 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:33.675629 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1f449125-20e7-4fdb-bd24-694e4b5942a1 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:33.676180 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1f449125-20e7-4fdb-bd24-694e4b5942a1 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:33.685536 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1f449125-20e7-4fdb-bd24-694e4b5942a1 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:34.207431 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1f449125-20e7-4fdb-bd24-694e4b5942a1 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:34.228086 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1f449125-20e7-4fdb-bd24-694e4b5942a1 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:34.234765 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1f449125-20e7-4fdb-bd24-694e4b5942a1 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:34.241098 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1f449125-20e7-4fdb-bd24-694e4b5942a1 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1736 microversion: 2.20 time: 0.609844 Oct 18 15:53:34.242413 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2884/5753] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:53:33 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1736 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:53:35.274690 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c4bbd09e-4280-466b-9164-d50aa2ca99fb tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:35.275346 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c4bbd09e-4280-466b-9164-d50aa2ca99fb tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:35.280285 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:53:35.309527 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4bbd09e-4280-466b-9164-d50aa2ca99fb tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:35.313513 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4bbd09e-4280-466b-9164-d50aa2ca99fb tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:35.324740 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4bbd09e-4280-466b-9164-d50aa2ca99fb tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:35.327330 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4bbd09e-4280-466b-9164-d50aa2ca99fb tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:35.328297 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4bbd09e-4280-466b-9164-d50aa2ca99fb tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:35.336885 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4bbd09e-4280-466b-9164-d50aa2ca99fb tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:37.708593 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c4bbd09e-4280-466b-9164-d50aa2ca99fb tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:37.714467 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:53:37.735949 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c4bbd09e-4280-466b-9164-d50aa2ca99fb tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:37.741459 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c4bbd09e-4280-466b-9164-d50aa2ca99fb tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:37.743532 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c4bbd09e-4280-466b-9164-d50aa2ca99fb tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1736 microversion: 2.20 time: 2.474839 Oct 18 15:53:37.771536 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2870/5754] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:53:35 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1736 bytes in 2504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:53:38.413198 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6f87aa1a-aac8-404c-ac3c-ebf02a2e5c79 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-2466390", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "e5619139-ffeb-48a4-bc53-b1a7e893be56"}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:53:38.600781 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-6f87aa1a-aac8-404c-ac3c-ebf02a2e5c79 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] validate_networks() for [('e5619139-ffeb-48a4-bc53-b1a7e893be56', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:53:38.779033 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-42556b8b-3708-4308-ae7e-22b04ffdfb7b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:38.779723 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-42556b8b-3708-4308-ae7e-22b04ffdfb7b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:38.813772 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42556b8b-3708-4308-ae7e-22b04ffdfb7b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:38.816190 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42556b8b-3708-4308-ae7e-22b04ffdfb7b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:38.820660 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42556b8b-3708-4308-ae7e-22b04ffdfb7b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:38.823890 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42556b8b-3708-4308-ae7e-22b04ffdfb7b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:38.829029 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42556b8b-3708-4308-ae7e-22b04ffdfb7b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:38.830535 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42556b8b-3708-4308-ae7e-22b04ffdfb7b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:39.647701 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-42556b8b-3708-4308-ae7e-22b04ffdfb7b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:39.657144 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-42556b8b-3708-4308-ae7e-22b04ffdfb7b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:39.661882 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-42556b8b-3708-4308-ae7e-22b04ffdfb7b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:39.663474 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-42556b8b-3708-4308-ae7e-22b04ffdfb7b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1736 microversion: 2.20 time: 0.890089 Oct 18 15:53:39.685327 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2871/5755] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:53:38 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1736 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:53:40.701566 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6dd54443-a2d1-4907-8044-7d76c6fe8ceb tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:40.702299 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6dd54443-a2d1-4907-8044-7d76c6fe8ceb tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:40.745190 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6dd54443-a2d1-4907-8044-7d76c6fe8ceb tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:40.753054 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6dd54443-a2d1-4907-8044-7d76c6fe8ceb tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:40.754943 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6dd54443-a2d1-4907-8044-7d76c6fe8ceb tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:40.755568 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6dd54443-a2d1-4907-8044-7d76c6fe8ceb tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:40.756052 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6dd54443-a2d1-4907-8044-7d76c6fe8ceb tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:40.762022 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6dd54443-a2d1-4907-8044-7d76c6fe8ceb tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:41.141016 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-6f87aa1a-aac8-404c-ac3c-ebf02a2e5c79 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:53:41.141647 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-6f87aa1a-aac8-404c-ac3c-ebf02a2e5c79 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:53:41.142253 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-6f87aa1a-aac8-404c-ac3c-ebf02a2e5c79 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:53:41.142709 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-6f87aa1a-aac8-404c-ac3c-ebf02a2e5c79 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:53:41.143200 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-6f87aa1a-aac8-404c-ac3c-ebf02a2e5c79 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:53:41.171291 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6f87aa1a-aac8-404c-ac3c-ebf02a2e5c79 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:41.172070 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6f87aa1a-aac8-404c-ac3c-ebf02a2e5c79 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:41.172688 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6f87aa1a-aac8-404c-ac3c-ebf02a2e5c79 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:41.176084 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6f87aa1a-aac8-404c-ac3c-ebf02a2e5c79 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:41.178216 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6f87aa1a-aac8-404c-ac3c-ebf02a2e5c79 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:41.179952 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6f87aa1a-aac8-404c-ac3c-ebf02a2e5c79 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:41.235414 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-6f87aa1a-aac8-404c-ac3c-ebf02a2e5c79 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Getting quotas for project f100b0821c644e5297fb767dffd9c808. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:53:41.250646 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-6f87aa1a-aac8-404c-ac3c-ebf02a2e5c79 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Getting quotas for user ddcf46b0597e44dd82f7a8521e230e21 and project f100b0821c644e5297fb767dffd9c808. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:53:41.274509 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6dd54443-a2d1-4907-8044-7d76c6fe8ceb tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:41.286880 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6dd54443-a2d1-4907-8044-7d76c6fe8ceb tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:41.291679 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6dd54443-a2d1-4907-8044-7d76c6fe8ceb tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:41.294196 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6dd54443-a2d1-4907-8044-7d76c6fe8ceb tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1736 microversion: 2.20 time: 0.597293 Oct 18 15:53:41.300659 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6f87aa1a-aac8-404c-ac3c-ebf02a2e5c79 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:53:41.304153 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6f87aa1a-aac8-404c-ac3c-ebf02a2e5c79 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] [instance: 90130005-57a3-4424-b7a6-88a5f153eb8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:53:41.315295 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2872/5756] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:53:40 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1736 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:53:41.421953 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6f87aa1a-aac8-404c-ac3c-ebf02a2e5c79 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 4.090696 Oct 18 15:53:41.424329 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2885/5757] 10.222.0.60 () {62 vars in 1188 bytes} [Tue Oct 18 15:53:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 4094 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 18 15:53:41.438072 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3b1b593a-92b5-495a-a1cd-3e6aabb5cee5 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:41.439765 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3b1b593a-92b5-495a-a1cd-3e6aabb5cee5 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] [instance: 90130005-57a3-4424-b7a6-88a5f153eb8d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:41.653532 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3b1b593a-92b5-495a-a1cd-3e6aabb5cee5 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcf46b0597e44dd82f7a8521e230e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100b0821c644e5297fb767dffd9c808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:41.663040 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3b1b593a-92b5-495a-a1cd-3e6aabb5cee5 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddcf46b0597e44dd82f7a8521e230e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100b0821c644e5297fb767dffd9c808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:41.664504 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3b1b593a-92b5-495a-a1cd-3e6aabb5cee5 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddcf46b0597e44dd82f7a8521e230e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100b0821c644e5297fb767dffd9c808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:41.665716 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3b1b593a-92b5-495a-a1cd-3e6aabb5cee5 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] 10.222.0.60 "GET /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d" status: 200 len: 1259 microversion: 2.26 time: 0.234117 Oct 18 15:53:41.693807 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2873/5758] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:53:41 2022] GET /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d => generated 1259 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:53:42.330332 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-60366db0-38ab-4b63-b0e1-dae7ebf73a94 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:42.331635 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-60366db0-38ab-4b63-b0e1-dae7ebf73a94 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:42.364298 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-60366db0-38ab-4b63-b0e1-dae7ebf73a94 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:42.364822 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-60366db0-38ab-4b63-b0e1-dae7ebf73a94 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:42.365386 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-60366db0-38ab-4b63-b0e1-dae7ebf73a94 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:42.366120 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-60366db0-38ab-4b63-b0e1-dae7ebf73a94 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:42.366587 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-60366db0-38ab-4b63-b0e1-dae7ebf73a94 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:42.367022 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-60366db0-38ab-4b63-b0e1-dae7ebf73a94 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:42.694982 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-35dd753c-1e44-4c9b-9cbd-c38e8d8add6c tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:42.702689 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-35dd753c-1e44-4c9b-9cbd-c38e8d8add6c tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] [instance: 90130005-57a3-4424-b7a6-88a5f153eb8d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:42.809381 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-60366db0-38ab-4b63-b0e1-dae7ebf73a94 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:42.831925 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-60366db0-38ab-4b63-b0e1-dae7ebf73a94 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:42.835610 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-60366db0-38ab-4b63-b0e1-dae7ebf73a94 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:42.842436 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-60366db0-38ab-4b63-b0e1-dae7ebf73a94 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1736 microversion: 2.20 time: 0.518336 Oct 18 15:53:42.847462 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2886/5759] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:53:42 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1736 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:53:42.943677 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-35dd753c-1e44-4c9b-9cbd-c38e8d8add6c tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcf46b0597e44dd82f7a8521e230e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100b0821c644e5297fb767dffd9c808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:42.951697 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-35dd753c-1e44-4c9b-9cbd-c38e8d8add6c tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddcf46b0597e44dd82f7a8521e230e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100b0821c644e5297fb767dffd9c808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:42.967755 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-35dd753c-1e44-4c9b-9cbd-c38e8d8add6c tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddcf46b0597e44dd82f7a8521e230e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100b0821c644e5297fb767dffd9c808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:42.974069 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-35dd753c-1e44-4c9b-9cbd-c38e8d8add6c tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] 10.222.0.60 "GET /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d" status: 200 len: 1259 microversion: 2.26 time: 0.279435 Oct 18 15:53:42.978307 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2874/5760] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:53:42 2022] GET /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d => generated 1259 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:53:43.873211 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-cc047ea5-bca6-48cf-a1f8-ca244c23fe42 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:43.874491 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-cc047ea5-bca6-48cf-a1f8-ca244c23fe42 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:43.898965 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cc047ea5-bca6-48cf-a1f8-ca244c23fe42 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:43.899726 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cc047ea5-bca6-48cf-a1f8-ca244c23fe42 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:43.900384 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cc047ea5-bca6-48cf-a1f8-ca244c23fe42 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:43.903848 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cc047ea5-bca6-48cf-a1f8-ca244c23fe42 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:43.907611 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cc047ea5-bca6-48cf-a1f8-ca244c23fe42 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:43.908389 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cc047ea5-bca6-48cf-a1f8-ca244c23fe42 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:44.008110 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-995f2038-adc0-485f-a585-af887ab9b1cf tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:44.010222 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-995f2038-adc0-485f-a585-af887ab9b1cf tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] [instance: 90130005-57a3-4424-b7a6-88a5f153eb8d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:44.026155 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-995f2038-adc0-485f-a585-af887ab9b1cf tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:44.040245 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-995f2038-adc0-485f-a585-af887ab9b1cf tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:44.043232 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-995f2038-adc0-485f-a585-af887ab9b1cf tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:44.045882 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-995f2038-adc0-485f-a585-af887ab9b1cf tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:44.046482 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-995f2038-adc0-485f-a585-af887ab9b1cf tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:44.047646 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-995f2038-adc0-485f-a585-af887ab9b1cf tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:44.320848 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-995f2038-adc0-485f-a585-af887ab9b1cf tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcf46b0597e44dd82f7a8521e230e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100b0821c644e5297fb767dffd9c808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:44.336929 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-995f2038-adc0-485f-a585-af887ab9b1cf tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddcf46b0597e44dd82f7a8521e230e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100b0821c644e5297fb767dffd9c808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:44.339524 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-995f2038-adc0-485f-a585-af887ab9b1cf tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddcf46b0597e44dd82f7a8521e230e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100b0821c644e5297fb767dffd9c808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:44.348783 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-995f2038-adc0-485f-a585-af887ab9b1cf tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] 10.222.0.60 "GET /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d" status: 200 len: 1311 microversion: 2.26 time: 0.348998 Oct 18 15:53:44.353205 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2875/5761] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:53:43 2022] GET /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d => generated 1311 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:53:44.694355 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-cc047ea5-bca6-48cf-a1f8-ca244c23fe42 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:44.708984 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-cc047ea5-bca6-48cf-a1f8-ca244c23fe42 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:44.713844 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-cc047ea5-bca6-48cf-a1f8-ca244c23fe42 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:44.720310 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-cc047ea5-bca6-48cf-a1f8-ca244c23fe42 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1736 microversion: 2.20 time: 0.852176 Oct 18 15:53:44.721694 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2887/5762] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:53:43 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1736 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:53:45.388696 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-97f2be25-8a62-4485-bc8c-539cd7db72dd tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:45.390160 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-97f2be25-8a62-4485-bc8c-539cd7db72dd tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] [instance: 90130005-57a3-4424-b7a6-88a5f153eb8d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:45.400285 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-97f2be25-8a62-4485-bc8c-539cd7db72dd tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:45.402036 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-97f2be25-8a62-4485-bc8c-539cd7db72dd tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:45.403266 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-97f2be25-8a62-4485-bc8c-539cd7db72dd tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:45.404375 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-97f2be25-8a62-4485-bc8c-539cd7db72dd tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:45.405657 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-97f2be25-8a62-4485-bc8c-539cd7db72dd tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:45.407860 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-97f2be25-8a62-4485-bc8c-539cd7db72dd tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:45.751932 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0b0af5c7-9bd8-4393-983b-d127144d448d tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:45.752560 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0b0af5c7-9bd8-4393-983b-d127144d448d tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:45.764670 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0b0af5c7-9bd8-4393-983b-d127144d448d tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:45.779827 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0b0af5c7-9bd8-4393-983b-d127144d448d tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:45.783703 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0b0af5c7-9bd8-4393-983b-d127144d448d tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:45.786017 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0b0af5c7-9bd8-4393-983b-d127144d448d tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:45.788894 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0b0af5c7-9bd8-4393-983b-d127144d448d tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:45.790134 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0b0af5c7-9bd8-4393-983b-d127144d448d tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:46.146588 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-97f2be25-8a62-4485-bc8c-539cd7db72dd tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcf46b0597e44dd82f7a8521e230e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100b0821c644e5297fb767dffd9c808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:46.163969 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-97f2be25-8a62-4485-bc8c-539cd7db72dd tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddcf46b0597e44dd82f7a8521e230e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100b0821c644e5297fb767dffd9c808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:46.165165 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-97f2be25-8a62-4485-bc8c-539cd7db72dd tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddcf46b0597e44dd82f7a8521e230e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100b0821c644e5297fb767dffd9c808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:46.174823 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-97f2be25-8a62-4485-bc8c-539cd7db72dd tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] 10.222.0.60 "GET /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d" status: 200 len: 1317 microversion: 2.26 time: 0.788006 Oct 18 15:53:46.179549 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2876/5763] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:53:45 2022] GET /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d => generated 1317 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:53:46.604888 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0b0af5c7-9bd8-4393-983b-d127144d448d tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:46.621094 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0b0af5c7-9bd8-4393-983b-d127144d448d tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:46.642719 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0b0af5c7-9bd8-4393-983b-d127144d448d tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:46.647900 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0b0af5c7-9bd8-4393-983b-d127144d448d tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1736 microversion: 2.20 time: 0.900601 Oct 18 15:53:46.652705 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2888/5764] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:53:45 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1736 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:53:47.201412 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dee1d6cd-66ee-467a-a997-4b1d3a9a80fc tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:47.203119 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dee1d6cd-66ee-467a-a997-4b1d3a9a80fc tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] [instance: 90130005-57a3-4424-b7a6-88a5f153eb8d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:47.227002 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dee1d6cd-66ee-467a-a997-4b1d3a9a80fc tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:47.227501 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dee1d6cd-66ee-467a-a997-4b1d3a9a80fc tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:47.227938 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dee1d6cd-66ee-467a-a997-4b1d3a9a80fc tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:47.229276 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dee1d6cd-66ee-467a-a997-4b1d3a9a80fc tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:47.229756 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dee1d6cd-66ee-467a-a997-4b1d3a9a80fc tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:47.230191 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dee1d6cd-66ee-467a-a997-4b1d3a9a80fc tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:47.679917 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6e650990-1196-4805-928b-2dceaf89a957 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:47.681137 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6e650990-1196-4805-928b-2dceaf89a957 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:47.701022 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6e650990-1196-4805-928b-2dceaf89a957 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:47.703970 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6e650990-1196-4805-928b-2dceaf89a957 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:47.707072 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6e650990-1196-4805-928b-2dceaf89a957 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:47.709663 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6e650990-1196-4805-928b-2dceaf89a957 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:47.711616 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6e650990-1196-4805-928b-2dceaf89a957 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:47.716172 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6e650990-1196-4805-928b-2dceaf89a957 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:48.518930 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dee1d6cd-66ee-467a-a997-4b1d3a9a80fc tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcf46b0597e44dd82f7a8521e230e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100b0821c644e5297fb767dffd9c808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:48.524940 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6e650990-1196-4805-928b-2dceaf89a957 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:48.556446 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6e650990-1196-4805-928b-2dceaf89a957 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:48.558525 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6e650990-1196-4805-928b-2dceaf89a957 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:48.561811 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dee1d6cd-66ee-467a-a997-4b1d3a9a80fc tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddcf46b0597e44dd82f7a8521e230e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100b0821c644e5297fb767dffd9c808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:48.563293 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dee1d6cd-66ee-467a-a997-4b1d3a9a80fc tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddcf46b0597e44dd82f7a8521e230e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100b0821c644e5297fb767dffd9c808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:48.564487 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dee1d6cd-66ee-467a-a997-4b1d3a9a80fc tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] 10.222.0.60 "GET /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d" status: 200 len: 1359 microversion: 2.26 time: 1.367537 Oct 18 15:53:48.565095 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2877/5765] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:53:47 2022] GET /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d => generated 1359 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:53:48.567383 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6e650990-1196-4805-928b-2dceaf89a957 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1736 microversion: 2.20 time: 0.891682 Oct 18 15:53:48.575685 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2889/5766] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:53:47 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1736 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:53:49.597292 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a1698d39-b231-4bf2-9bb8-55e22004d2a2 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:49.600330 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c4e7bad0-f9d3-43e4-8b0c-85b712d4e3d3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:49.600993 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c4e7bad0-f9d3-43e4-8b0c-85b712d4e3d3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:49.602134 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a1698d39-b231-4bf2-9bb8-55e22004d2a2 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] [instance: 90130005-57a3-4424-b7a6-88a5f153eb8d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:49.618883 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c4e7bad0-f9d3-43e4-8b0c-85b712d4e3d3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:49.623102 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1698d39-b231-4bf2-9bb8-55e22004d2a2 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:49.623888 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c4e7bad0-f9d3-43e4-8b0c-85b712d4e3d3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:49.624494 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c4e7bad0-f9d3-43e4-8b0c-85b712d4e3d3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:49.626287 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c4e7bad0-f9d3-43e4-8b0c-85b712d4e3d3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:49.629042 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1698d39-b231-4bf2-9bb8-55e22004d2a2 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:49.629805 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c4e7bad0-f9d3-43e4-8b0c-85b712d4e3d3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:49.630220 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c4e7bad0-f9d3-43e4-8b0c-85b712d4e3d3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:49.633315 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1698d39-b231-4bf2-9bb8-55e22004d2a2 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:49.634072 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1698d39-b231-4bf2-9bb8-55e22004d2a2 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:49.634544 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1698d39-b231-4bf2-9bb8-55e22004d2a2 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:49.641121 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1698d39-b231-4bf2-9bb8-55e22004d2a2 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:50.353714 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a1698d39-b231-4bf2-9bb8-55e22004d2a2 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcf46b0597e44dd82f7a8521e230e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100b0821c644e5297fb767dffd9c808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:50.371870 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a1698d39-b231-4bf2-9bb8-55e22004d2a2 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddcf46b0597e44dd82f7a8521e230e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100b0821c644e5297fb767dffd9c808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:50.378947 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a1698d39-b231-4bf2-9bb8-55e22004d2a2 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddcf46b0597e44dd82f7a8521e230e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100b0821c644e5297fb767dffd9c808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:50.385735 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a1698d39-b231-4bf2-9bb8-55e22004d2a2 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] 10.222.0.60 "GET /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d" status: 200 len: 1359 microversion: 2.26 time: 0.792579 Oct 18 15:53:50.386421 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2878/5767] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:53:49 2022] GET /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d => generated 1359 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:53:50.514999 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c4e7bad0-f9d3-43e4-8b0c-85b712d4e3d3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:50.535127 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c4e7bad0-f9d3-43e4-8b0c-85b712d4e3d3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:50.542845 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c4e7bad0-f9d3-43e4-8b0c-85b712d4e3d3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:50.547176 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c4e7bad0-f9d3-43e4-8b0c-85b712d4e3d3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1718 microversion: 2.20 time: 0.956353 Oct 18 15:53:50.564977 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2890/5768] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:53:49 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1718 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:53:51.415145 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-235da905-d513-4cc2-82b7-37a99334b477 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:51.415664 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-235da905-d513-4cc2-82b7-37a99334b477 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] [instance: 90130005-57a3-4424-b7a6-88a5f153eb8d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:51.432369 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-235da905-d513-4cc2-82b7-37a99334b477 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:51.438986 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-235da905-d513-4cc2-82b7-37a99334b477 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:51.442841 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-235da905-d513-4cc2-82b7-37a99334b477 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:51.444464 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-235da905-d513-4cc2-82b7-37a99334b477 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:51.450245 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-235da905-d513-4cc2-82b7-37a99334b477 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:51.451425 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-235da905-d513-4cc2-82b7-37a99334b477 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:51.586828 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fe2ceff2-dc21-4024-b3fc-4d960cb16174 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:51.590114 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-fe2ceff2-dc21-4024-b3fc-4d960cb16174 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:51.601955 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:53:51.603859 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=6 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:53:51.607676 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fe2ceff2-dc21-4024-b3fc-4d960cb16174 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:51.608480 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fe2ceff2-dc21-4024-b3fc-4d960cb16174 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:51.609122 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fe2ceff2-dc21-4024-b3fc-4d960cb16174 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:51.609992 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fe2ceff2-dc21-4024-b3fc-4d960cb16174 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:51.610908 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fe2ceff2-dc21-4024-b3fc-4d960cb16174 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:51.611496 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fe2ceff2-dc21-4024-b3fc-4d960cb16174 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:51.642915 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=57 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:53:52.155674 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-fe2ceff2-dc21-4024-b3fc-4d960cb16174 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:52.170486 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-fe2ceff2-dc21-4024-b3fc-4d960cb16174 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:52.172198 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-fe2ceff2-dc21-4024-b3fc-4d960cb16174 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:52.174499 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fe2ceff2-dc21-4024-b3fc-4d960cb16174 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1718 microversion: 2.20 time: 0.593578 Oct 18 15:53:52.187101 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2891/5769] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:53:51 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1718 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:53:52.213833 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-4bc531d6-bb98-4d9f-8e2b-318f631ece11 req-0dfcbe2a-c9c8-4520-bd0f-90daf69cb7f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90130005-57a3-4424-b7a6-88a5f153eb8d", "tag": "7bc06ef7-d04c-4a0a-ac6d-349c997c8d14"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:53:52.224784 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-4bc531d6-bb98-4d9f-8e2b-318f631ece11 req-0dfcbe2a-c9c8-4520-bd0f-90daf69cb7f6 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:52.225626 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-4bc531d6-bb98-4d9f-8e2b-318f631ece11 req-0dfcbe2a-c9c8-4520-bd0f-90daf69cb7f6 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:52.226263 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-4bc531d6-bb98-4d9f-8e2b-318f631ece11 req-0dfcbe2a-c9c8-4520-bd0f-90daf69cb7f6 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:52.251472 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-4bc531d6-bb98-4d9f-8e2b-318f631ece11 req-0dfcbe2a-c9c8-4520-bd0f-90daf69cb7f6 service nova] Creating event network-changed:7bc06ef7-d04c-4a0a-ac6d-349c997c8d14 for instance 90130005-57a3-4424-b7a6-88a5f153eb8d on n-h1-853682-5 Oct 18 15:53:52.279274 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-4bc531d6-bb98-4d9f-8e2b-318f631ece11 req-0dfcbe2a-c9c8-4520-bd0f-90daf69cb7f6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072854 Oct 18 15:53:52.295811 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2892/5770] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:53:52.451114 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-235da905-d513-4cc2-82b7-37a99334b477 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcf46b0597e44dd82f7a8521e230e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100b0821c644e5297fb767dffd9c808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:52.467378 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-235da905-d513-4cc2-82b7-37a99334b477 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddcf46b0597e44dd82f7a8521e230e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100b0821c644e5297fb767dffd9c808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:52.473000 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-235da905-d513-4cc2-82b7-37a99334b477 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddcf46b0597e44dd82f7a8521e230e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100b0821c644e5297fb767dffd9c808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:52.476793 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-235da905-d513-4cc2-82b7-37a99334b477 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] 10.222.0.60 "GET /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d" status: 200 len: 1359 microversion: 2.26 time: 1.065232 Oct 18 15:53:52.477604 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2879/5771] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:53:51 2022] GET /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d => generated 1359 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:53:53.100189 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-b4a250fa-cbf7-45ea-8336-0e97cf707ebc req-ff9f75ac-f38c-484a-8535-aa07a3958618 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6af51230-78de-43fb-be54-c1b182368139", "name": "network-vif-unplugged", "status": "completed", "tag": "e6888c52-692f-4a5c-a3cf-e7018e476bf5"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:53:53.121243 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-b4a250fa-cbf7-45ea-8336-0e97cf707ebc req-ff9f75ac-f38c-484a-8535-aa07a3958618 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:53.121744 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-b4a250fa-cbf7-45ea-8336-0e97cf707ebc req-ff9f75ac-f38c-484a-8535-aa07a3958618 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:53.122165 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-b4a250fa-cbf7-45ea-8336-0e97cf707ebc req-ff9f75ac-f38c-484a-8535-aa07a3958618 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:53.151513 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-b4a250fa-cbf7-45ea-8336-0e97cf707ebc req-ff9f75ac-f38c-484a-8535-aa07a3958618 service nova] Creating event network-vif-unplugged:e6888c52-692f-4a5c-a3cf-e7018e476bf5 for instance 6af51230-78de-43fb-be54-c1b182368139 on n-h2-853682-5 Oct 18 15:53:53.171330 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-b4a250fa-cbf7-45ea-8336-0e97cf707ebc req-ff9f75ac-f38c-484a-8535-aa07a3958618 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075024 Oct 18 15:53:53.172595 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2893/5772] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:53:53.215787 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fb737385-f3d8-462a-a9d3-f1e8b522dc27 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:53.216677 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fb737385-f3d8-462a-a9d3-f1e8b522dc27 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:53.235666 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:53:53.250478 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb737385-f3d8-462a-a9d3-f1e8b522dc27 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:53.252070 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb737385-f3d8-462a-a9d3-f1e8b522dc27 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:53.252539 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb737385-f3d8-462a-a9d3-f1e8b522dc27 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:53.261353 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb737385-f3d8-462a-a9d3-f1e8b522dc27 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:53.261859 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb737385-f3d8-462a-a9d3-f1e8b522dc27 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:53.262298 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb737385-f3d8-462a-a9d3-f1e8b522dc27 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:53.504648 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1367a1e7-ce39-467d-a426-d14c6cc43821 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:53.505525 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1367a1e7-ce39-467d-a426-d14c6cc43821 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] [instance: 90130005-57a3-4424-b7a6-88a5f153eb8d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:53.524871 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1367a1e7-ce39-467d-a426-d14c6cc43821 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:53.525424 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1367a1e7-ce39-467d-a426-d14c6cc43821 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:53.529183 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1367a1e7-ce39-467d-a426-d14c6cc43821 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:53.530830 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1367a1e7-ce39-467d-a426-d14c6cc43821 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:53.534767 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1367a1e7-ce39-467d-a426-d14c6cc43821 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:53.538710 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1367a1e7-ce39-467d-a426-d14c6cc43821 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:53.960627 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fb737385-f3d8-462a-a9d3-f1e8b522dc27 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:53.974602 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fb737385-f3d8-462a-a9d3-f1e8b522dc27 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:53.976111 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fb737385-f3d8-462a-a9d3-f1e8b522dc27 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:53.981518 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fb737385-f3d8-462a-a9d3-f1e8b522dc27 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1718 microversion: 2.20 time: 0.770850 Oct 18 15:53:53.989163 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2880/5773] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:53:53 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1718 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:53:54.020588 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1367a1e7-ce39-467d-a426-d14c6cc43821 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcf46b0597e44dd82f7a8521e230e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100b0821c644e5297fb767dffd9c808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:54.036593 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1367a1e7-ce39-467d-a426-d14c6cc43821 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddcf46b0597e44dd82f7a8521e230e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100b0821c644e5297fb767dffd9c808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:54.044372 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1367a1e7-ce39-467d-a426-d14c6cc43821 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddcf46b0597e44dd82f7a8521e230e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100b0821c644e5297fb767dffd9c808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:54.046414 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1367a1e7-ce39-467d-a426-d14c6cc43821 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] 10.222.0.60 "GET /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d" status: 200 len: 1359 microversion: 2.26 time: 0.545748 Oct 18 15:53:54.050426 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2894/5774] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:53:53 2022] GET /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d => generated 1359 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:53:54.309827 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-b99530cc-87d0-4010-a6e4-277507d9b89e req-e26f98ef-f31d-45a2-bed6-c6be200d1ded service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6af51230-78de-43fb-be54-c1b182368139", "name": "network-vif-unplugged", "status": "completed", "tag": "e6888c52-692f-4a5c-a3cf-e7018e476bf5"}, {"name": "network-changed", "server_uuid": "6af51230-78de-43fb-be54-c1b182368139", "tag": "e6888c52-692f-4a5c-a3cf-e7018e476bf5"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:53:54.349472 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b99530cc-87d0-4010-a6e4-277507d9b89e req-e26f98ef-f31d-45a2-bed6-c6be200d1ded service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:54.352215 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b99530cc-87d0-4010-a6e4-277507d9b89e req-e26f98ef-f31d-45a2-bed6-c6be200d1ded service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:54.354430 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b99530cc-87d0-4010-a6e4-277507d9b89e req-e26f98ef-f31d-45a2-bed6-c6be200d1ded service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:54.382538 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-b99530cc-87d0-4010-a6e4-277507d9b89e req-e26f98ef-f31d-45a2-bed6-c6be200d1ded service nova] Creating event network-vif-unplugged:e6888c52-692f-4a5c-a3cf-e7018e476bf5 for instance 6af51230-78de-43fb-be54-c1b182368139 on n-h2-853682-5 Oct 18 15:53:54.383212 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-b99530cc-87d0-4010-a6e4-277507d9b89e req-e26f98ef-f31d-45a2-bed6-c6be200d1ded service nova] Creating event network-changed:e6888c52-692f-4a5c-a3cf-e7018e476bf5 for instance 6af51230-78de-43fb-be54-c1b182368139 on n-h2-853682-5 Oct 18 15:53:54.389290 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-b99530cc-87d0-4010-a6e4-277507d9b89e req-e26f98ef-f31d-45a2-bed6-c6be200d1ded service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.083683 Oct 18 15:53:54.390290 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2881/5775] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:53:55.019977 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f149b13f-47f9-4b61-a865-0e6435811c4f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:55.021710 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f149b13f-47f9-4b61-a865-0e6435811c4f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:55.035883 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f149b13f-47f9-4b61-a865-0e6435811c4f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:55.036562 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f149b13f-47f9-4b61-a865-0e6435811c4f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:55.038077 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f149b13f-47f9-4b61-a865-0e6435811c4f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:55.040335 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f149b13f-47f9-4b61-a865-0e6435811c4f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:55.042186 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f149b13f-47f9-4b61-a865-0e6435811c4f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:55.044052 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f149b13f-47f9-4b61-a865-0e6435811c4f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:55.081179 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4efe64ad-be8e-40c4-912f-59fa8accfa71 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:55.082591 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4efe64ad-be8e-40c4-912f-59fa8accfa71 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] [instance: 90130005-57a3-4424-b7a6-88a5f153eb8d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:55.093263 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4efe64ad-be8e-40c4-912f-59fa8accfa71 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:55.094147 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4efe64ad-be8e-40c4-912f-59fa8accfa71 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:55.100273 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4efe64ad-be8e-40c4-912f-59fa8accfa71 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:55.101291 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4efe64ad-be8e-40c4-912f-59fa8accfa71 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:55.102468 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4efe64ad-be8e-40c4-912f-59fa8accfa71 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:55.103064 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4efe64ad-be8e-40c4-912f-59fa8accfa71 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:55.329402 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f149b13f-47f9-4b61-a865-0e6435811c4f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:55.347857 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f149b13f-47f9-4b61-a865-0e6435811c4f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:55.352826 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f149b13f-47f9-4b61-a865-0e6435811c4f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:55.360887 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f149b13f-47f9-4b61-a865-0e6435811c4f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1718 microversion: 2.20 time: 0.350829 Oct 18 15:53:55.362199 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2895/5776] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:53:55 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1718 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:53:56.173606 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4efe64ad-be8e-40c4-912f-59fa8accfa71 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcf46b0597e44dd82f7a8521e230e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100b0821c644e5297fb767dffd9c808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:56.188438 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4efe64ad-be8e-40c4-912f-59fa8accfa71 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddcf46b0597e44dd82f7a8521e230e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100b0821c644e5297fb767dffd9c808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:56.192066 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4efe64ad-be8e-40c4-912f-59fa8accfa71 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddcf46b0597e44dd82f7a8521e230e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100b0821c644e5297fb767dffd9c808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:56.193938 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4efe64ad-be8e-40c4-912f-59fa8accfa71 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] 10.222.0.60 "GET /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d" status: 200 len: 1359 microversion: 2.26 time: 1.125619 Oct 18 15:53:56.211815 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2882/5777] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:53:55 2022] GET /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d => generated 1359 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:53:56.392396 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-80046ecb-4ea8-4d65-a435-0b2263611413 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:56.393444 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-80046ecb-4ea8-4d65-a435-0b2263611413 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:56.397786 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:53:56.438891 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-80046ecb-4ea8-4d65-a435-0b2263611413 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:56.439399 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-80046ecb-4ea8-4d65-a435-0b2263611413 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:56.439846 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-80046ecb-4ea8-4d65-a435-0b2263611413 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:56.440855 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-80046ecb-4ea8-4d65-a435-0b2263611413 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:56.441326 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-80046ecb-4ea8-4d65-a435-0b2263611413 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:56.448299 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-80046ecb-4ea8-4d65-a435-0b2263611413 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:57.224358 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-65d6edd0-eaa1-4601-92d3-e3cc50f1a063 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:57.225138 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-65d6edd0-eaa1-4601-92d3-e3cc50f1a063 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] [instance: 90130005-57a3-4424-b7a6-88a5f153eb8d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:57.240687 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65d6edd0-eaa1-4601-92d3-e3cc50f1a063 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:57.246416 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65d6edd0-eaa1-4601-92d3-e3cc50f1a063 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:57.248328 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65d6edd0-eaa1-4601-92d3-e3cc50f1a063 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:57.250091 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65d6edd0-eaa1-4601-92d3-e3cc50f1a063 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:57.251549 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65d6edd0-eaa1-4601-92d3-e3cc50f1a063 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:57.253389 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65d6edd0-eaa1-4601-92d3-e3cc50f1a063 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:57.439571 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-80046ecb-4ea8-4d65-a435-0b2263611413 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:57.467832 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-80046ecb-4ea8-4d65-a435-0b2263611413 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:57.473220 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-80046ecb-4ea8-4d65-a435-0b2263611413 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:57.476024 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-80046ecb-4ea8-4d65-a435-0b2263611413 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1661 microversion: 2.20 time: 1.090362 Oct 18 15:53:57.479992 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2896/5778] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:53:56 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1661 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:53:57.511222 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c7f9caaf-6321-42cb-aa1e-ed35524ccbd0 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8838e68d-0cb4-4963-a884-5b00bed9471d"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:53:57.514312 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c7f9caaf-6321-42cb-aa1e-ed35524ccbd0 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:57.526800 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c7f9caaf-6321-42cb-aa1e-ed35524ccbd0 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:57.527303 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c7f9caaf-6321-42cb-aa1e-ed35524ccbd0 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:57.527771 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c7f9caaf-6321-42cb-aa1e-ed35524ccbd0 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:57.528565 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c7f9caaf-6321-42cb-aa1e-ed35524ccbd0 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:57.529051 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c7f9caaf-6321-42cb-aa1e-ed35524ccbd0 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:57.529479 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c7f9caaf-6321-42cb-aa1e-ed35524ccbd0 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:57.816520 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-65d6edd0-eaa1-4601-92d3-e3cc50f1a063 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcf46b0597e44dd82f7a8521e230e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100b0821c644e5297fb767dffd9c808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:57.847949 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-65d6edd0-eaa1-4601-92d3-e3cc50f1a063 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddcf46b0597e44dd82f7a8521e230e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100b0821c644e5297fb767dffd9c808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:57.851870 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-65d6edd0-eaa1-4601-92d3-e3cc50f1a063 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddcf46b0597e44dd82f7a8521e230e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100b0821c644e5297fb767dffd9c808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:57.854444 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-65d6edd0-eaa1-4601-92d3-e3cc50f1a063 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] 10.222.0.60 "GET /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d" status: 200 len: 1359 microversion: 2.26 time: 0.634805 Oct 18 15:53:57.868993 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2883/5779] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:53:57 2022] GET /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d => generated 1359 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:53:58.271795 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c7f9caaf-6321-42cb-aa1e-ed35524ccbd0 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "POST /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.765048 Oct 18 15:53:58.273235 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2897/5780] 10.222.0.60 () {62 vars in 1364 bytes} [Tue Oct 18 15:53:57 2022] POST /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139/os-volume_attachments => generated 188 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 15:53:58.528643 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c8f10ee2-ad31-4b52-91a2-8cac29e8bf16 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:58.529826 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c8f10ee2-ad31-4b52-91a2-8cac29e8bf16 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:58.558170 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8f10ee2-ad31-4b52-91a2-8cac29e8bf16 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:58.558886 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8f10ee2-ad31-4b52-91a2-8cac29e8bf16 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:58.560915 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8f10ee2-ad31-4b52-91a2-8cac29e8bf16 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:58.561793 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8f10ee2-ad31-4b52-91a2-8cac29e8bf16 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:58.562289 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8f10ee2-ad31-4b52-91a2-8cac29e8bf16 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:58.563869 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8f10ee2-ad31-4b52-91a2-8cac29e8bf16 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:58.892764 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4d51d02c-a9aa-421a-91df-e17183a73543 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:58.908020 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4d51d02c-a9aa-421a-91df-e17183a73543 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] [instance: 90130005-57a3-4424-b7a6-88a5f153eb8d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:58.918501 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4d51d02c-a9aa-421a-91df-e17183a73543 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:58.919464 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4d51d02c-a9aa-421a-91df-e17183a73543 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:58.921985 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4d51d02c-a9aa-421a-91df-e17183a73543 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:58.924465 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4d51d02c-a9aa-421a-91df-e17183a73543 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:58.925392 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4d51d02c-a9aa-421a-91df-e17183a73543 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:58.926249 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4d51d02c-a9aa-421a-91df-e17183a73543 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:59.115956 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c8f10ee2-ad31-4b52-91a2-8cac29e8bf16 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139/os-volume_attachments/8838e68d-0cb4-4963-a884-5b00bed9471d" status: 202 len: 0 microversion: 2.20 time: 0.592369 Oct 18 15:53:59.122563 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2884/5781] 10.222.0.60 () {60 vars in 1457 bytes} [Tue Oct 18 15:53:58 2022] DELETE /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139/os-volume_attachments/8838e68d-0cb4-4963-a884-5b00bed9471d => generated 0 bytes in 597 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:53:59.228114 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cb90051b-9737-4a64-9ef2-92270c08c328 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:53:59.229402 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cb90051b-9737-4a64-9ef2-92270c08c328 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:59.240271 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb90051b-9737-4a64-9ef2-92270c08c328 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:59.244602 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb90051b-9737-4a64-9ef2-92270c08c328 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:59.245624 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb90051b-9737-4a64-9ef2-92270c08c328 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:59.246707 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb90051b-9737-4a64-9ef2-92270c08c328 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:59.248713 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb90051b-9737-4a64-9ef2-92270c08c328 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:59.249451 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb90051b-9737-4a64-9ef2-92270c08c328 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:59.321777 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cb90051b-9737-4a64-9ef2-92270c08c328 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120406) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 18 15:53:59.364760 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4d51d02c-a9aa-421a-91df-e17183a73543 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcf46b0597e44dd82f7a8521e230e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100b0821c644e5297fb767dffd9c808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:59.374771 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4d51d02c-a9aa-421a-91df-e17183a73543 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddcf46b0597e44dd82f7a8521e230e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100b0821c644e5297fb767dffd9c808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:59.393041 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4d51d02c-a9aa-421a-91df-e17183a73543 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddcf46b0597e44dd82f7a8521e230e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100b0821c644e5297fb767dffd9c808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:53:59.398739 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4d51d02c-a9aa-421a-91df-e17183a73543 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] 10.222.0.60 "GET /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d" status: 200 len: 1359 microversion: 2.26 time: 0.510009 Oct 18 15:53:59.401213 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2898/5782] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:53:58 2022] GET /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d => generated 1359 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:53:59.461988 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cb90051b-9737-4a64-9ef2-92270c08c328 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "POST /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139/action" status: 202 len: 0 microversion: 2.20 time: 0.239798 Oct 18 15:53:59.463199 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2885/5783] 10.222.0.60 () {62 vars in 1319 bytes} [Tue Oct 18 15:53:59 2022] POST /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 18 15:53:59.475447 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-78e2e196-8808-44a3-854c-819ad1077d60 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:53:59.476071 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-78e2e196-8808-44a3-854c-819ad1077d60 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:53:59.495551 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-78e2e196-8808-44a3-854c-819ad1077d60 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:59.496061 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-78e2e196-8808-44a3-854c-819ad1077d60 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:59.496510 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-78e2e196-8808-44a3-854c-819ad1077d60 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:53:59.497387 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-78e2e196-8808-44a3-854c-819ad1077d60 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:53:59.497940 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-78e2e196-8808-44a3-854c-819ad1077d60 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:53:59.498374 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-78e2e196-8808-44a3-854c-819ad1077d60 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:00.129442 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-78e2e196-8808-44a3-854c-819ad1077d60 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:00.136043 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-5826ded8-e823-49c4-896f-915e2c542921 req-454e53bb-e14e-49a2-a04a-2de4c38789c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90130005-57a3-4424-b7a6-88a5f153eb8d", "name": "network-vif-plugged", "status": "completed", "tag": "7bc06ef7-d04c-4a0a-ac6d-349c997c8d14"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:54:00.138488 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-78e2e196-8808-44a3-854c-819ad1077d60 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:00.139900 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-78e2e196-8808-44a3-854c-819ad1077d60 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:00.151123 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-78e2e196-8808-44a3-854c-819ad1077d60 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1669 microversion: 2.20 time: 0.670228 Oct 18 15:54:00.154927 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2899/5784] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:53:59 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1669 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:54:00.179010 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5826ded8-e823-49c4-896f-915e2c542921 req-454e53bb-e14e-49a2-a04a-2de4c38789c9 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:00.180047 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5826ded8-e823-49c4-896f-915e2c542921 req-454e53bb-e14e-49a2-a04a-2de4c38789c9 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:00.182778 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5826ded8-e823-49c4-896f-915e2c542921 req-454e53bb-e14e-49a2-a04a-2de4c38789c9 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:00.213739 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-5826ded8-e823-49c4-896f-915e2c542921 req-454e53bb-e14e-49a2-a04a-2de4c38789c9 service nova] Creating event network-vif-plugged:7bc06ef7-d04c-4a0a-ac6d-349c997c8d14 for instance 90130005-57a3-4424-b7a6-88a5f153eb8d on n-h1-853682-5 Oct 18 15:54:00.220153 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-5826ded8-e823-49c4-896f-915e2c542921 req-454e53bb-e14e-49a2-a04a-2de4c38789c9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094281 Oct 18 15:54:00.221562 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2886/5785] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:54:00.433463 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-306e38ed-b8d8-4d2e-a8f5-5500ac774891 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:54:00.434460 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-306e38ed-b8d8-4d2e-a8f5-5500ac774891 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] [instance: 90130005-57a3-4424-b7a6-88a5f153eb8d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:54:00.446827 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-306e38ed-b8d8-4d2e-a8f5-5500ac774891 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:00.448030 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-306e38ed-b8d8-4d2e-a8f5-5500ac774891 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:00.448657 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-306e38ed-b8d8-4d2e-a8f5-5500ac774891 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:00.449968 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-306e38ed-b8d8-4d2e-a8f5-5500ac774891 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:00.450629 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-306e38ed-b8d8-4d2e-a8f5-5500ac774891 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:00.451492 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-306e38ed-b8d8-4d2e-a8f5-5500ac774891 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:00.779169 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-306e38ed-b8d8-4d2e-a8f5-5500ac774891 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcf46b0597e44dd82f7a8521e230e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100b0821c644e5297fb767dffd9c808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:00.792371 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-306e38ed-b8d8-4d2e-a8f5-5500ac774891 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddcf46b0597e44dd82f7a8521e230e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100b0821c644e5297fb767dffd9c808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:00.794750 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-306e38ed-b8d8-4d2e-a8f5-5500ac774891 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddcf46b0597e44dd82f7a8521e230e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100b0821c644e5297fb767dffd9c808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:00.796976 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-306e38ed-b8d8-4d2e-a8f5-5500ac774891 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] 10.222.0.60 "GET /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d" status: 200 len: 1359 microversion: 2.26 time: 0.370271 Oct 18 15:54:00.798250 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2900/5786] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:54:00 2022] GET /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d => generated 1359 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:54:01.190397 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c9f750b0-2fe7-4c6b-b8bc-a01ad0ba664a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:54:01.191197 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c9f750b0-2fe7-4c6b-b8bc-a01ad0ba664a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:54:01.211998 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9f750b0-2fe7-4c6b-b8bc-a01ad0ba664a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:01.215811 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9f750b0-2fe7-4c6b-b8bc-a01ad0ba664a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:01.217800 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9f750b0-2fe7-4c6b-b8bc-a01ad0ba664a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:01.221723 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9f750b0-2fe7-4c6b-b8bc-a01ad0ba664a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:01.223791 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9f750b0-2fe7-4c6b-b8bc-a01ad0ba664a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:01.225476 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9f750b0-2fe7-4c6b-b8bc-a01ad0ba664a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:01.241526 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:54:01.542390 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c9f750b0-2fe7-4c6b-b8bc-a01ad0ba664a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:01.560995 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c9f750b0-2fe7-4c6b-b8bc-a01ad0ba664a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:01.565721 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c9f750b0-2fe7-4c6b-b8bc-a01ad0ba664a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:01.568161 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c9f750b0-2fe7-4c6b-b8bc-a01ad0ba664a tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1669 microversion: 2.20 time: 0.385038 Oct 18 15:54:01.571733 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2887/5787] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:54:01 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1669 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:54:01.825715 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-78524016-14df-460b-a6ef-a90d8d5b4a15 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:54:01.826464 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-78524016-14df-460b-a6ef-a90d8d5b4a15 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] [instance: 90130005-57a3-4424-b7a6-88a5f153eb8d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:54:01.836527 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-78524016-14df-460b-a6ef-a90d8d5b4a15 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:01.837066 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-78524016-14df-460b-a6ef-a90d8d5b4a15 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:01.837557 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-78524016-14df-460b-a6ef-a90d8d5b4a15 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:01.838279 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-78524016-14df-460b-a6ef-a90d8d5b4a15 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:01.838746 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-78524016-14df-460b-a6ef-a90d8d5b4a15 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:01.839184 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-78524016-14df-460b-a6ef-a90d8d5b4a15 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:02.218447 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-78524016-14df-460b-a6ef-a90d8d5b4a15 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcf46b0597e44dd82f7a8521e230e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100b0821c644e5297fb767dffd9c808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:02.240378 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-78524016-14df-460b-a6ef-a90d8d5b4a15 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddcf46b0597e44dd82f7a8521e230e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100b0821c644e5297fb767dffd9c808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:02.245489 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-78524016-14df-460b-a6ef-a90d8d5b4a15 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddcf46b0597e44dd82f7a8521e230e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100b0821c644e5297fb767dffd9c808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:02.247883 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-78524016-14df-460b-a6ef-a90d8d5b4a15 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] 10.222.0.60 "GET /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d" status: 200 len: 1359 microversion: 2.26 time: 0.425773 Oct 18 15:54:02.256875 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2901/5788] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:54:01 2022] GET /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d => generated 1359 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:54:02.601887 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0405abf8-25db-43b0-a641-dab23e5f2c29 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:54:02.604335 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0405abf8-25db-43b0-a641-dab23e5f2c29 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:54:02.619690 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0405abf8-25db-43b0-a641-dab23e5f2c29 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:02.621173 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0405abf8-25db-43b0-a641-dab23e5f2c29 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:02.622159 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0405abf8-25db-43b0-a641-dab23e5f2c29 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:02.623704 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0405abf8-25db-43b0-a641-dab23e5f2c29 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:02.626895 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0405abf8-25db-43b0-a641-dab23e5f2c29 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:02.627648 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0405abf8-25db-43b0-a641-dab23e5f2c29 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:03.106002 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0405abf8-25db-43b0-a641-dab23e5f2c29 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:03.122595 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0405abf8-25db-43b0-a641-dab23e5f2c29 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:03.124106 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0405abf8-25db-43b0-a641-dab23e5f2c29 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:03.125387 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0405abf8-25db-43b0-a641-dab23e5f2c29 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1727 microversion: 2.20 time: 0.529670 Oct 18 15:54:03.131674 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2888/5789] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:54:02 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1727 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:54:03.276662 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-baaac807-ff04-4e63-85f0-ac13d588ebd8 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:54:03.279315 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-baaac807-ff04-4e63-85f0-ac13d588ebd8 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] [instance: 90130005-57a3-4424-b7a6-88a5f153eb8d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:54:03.289840 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-baaac807-ff04-4e63-85f0-ac13d588ebd8 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:03.291275 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-baaac807-ff04-4e63-85f0-ac13d588ebd8 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:03.292043 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-baaac807-ff04-4e63-85f0-ac13d588ebd8 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:03.293235 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-baaac807-ff04-4e63-85f0-ac13d588ebd8 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:03.294062 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-baaac807-ff04-4e63-85f0-ac13d588ebd8 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:03.294770 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-baaac807-ff04-4e63-85f0-ac13d588ebd8 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:04.136384 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-baaac807-ff04-4e63-85f0-ac13d588ebd8 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcf46b0597e44dd82f7a8521e230e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100b0821c644e5297fb767dffd9c808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:04.153563 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-baaac807-ff04-4e63-85f0-ac13d588ebd8 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddcf46b0597e44dd82f7a8521e230e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100b0821c644e5297fb767dffd9c808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:04.155775 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-65b8827f-79ae-4d4e-ab97-703450be34d3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:54:04.156516 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-65b8827f-79ae-4d4e-ab97-703450be34d3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:54:04.158768 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-baaac807-ff04-4e63-85f0-ac13d588ebd8 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddcf46b0597e44dd82f7a8521e230e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100b0821c644e5297fb767dffd9c808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:04.160745 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-baaac807-ff04-4e63-85f0-ac13d588ebd8 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] 10.222.0.60 "GET /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d" status: 200 len: 1542 microversion: 2.26 time: 0.888273 Oct 18 15:54:04.179749 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2902/5790] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:54:03 2022] GET /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d => generated 1542 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:54:04.180169 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65b8827f-79ae-4d4e-ab97-703450be34d3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:04.180169 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65b8827f-79ae-4d4e-ab97-703450be34d3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:04.180169 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65b8827f-79ae-4d4e-ab97-703450be34d3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:04.180169 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65b8827f-79ae-4d4e-ab97-703450be34d3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:04.181588 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65b8827f-79ae-4d4e-ab97-703450be34d3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:04.183231 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65b8827f-79ae-4d4e-ab97-703450be34d3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:04.190353 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4126f11a-83a7-412b-a604-8811472274ba tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Calling method '.version_select at 0x7f7c416c4b80>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:54:04.204698 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4126f11a-83a7-412b-a604-8811472274ba tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:04.205448 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4126f11a-83a7-412b-a604-8811472274ba tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:04.206050 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4126f11a-83a7-412b-a604-8811472274ba tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:04.206688 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4126f11a-83a7-412b-a604-8811472274ba tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] [instance: 90130005-57a3-4424-b7a6-88a5f153eb8d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:54:04.215099 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4126f11a-83a7-412b-a604-8811472274ba tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:04.216110 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4126f11a-83a7-412b-a604-8811472274ba tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:04.216711 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4126f11a-83a7-412b-a604-8811472274ba tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:04.217696 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4126f11a-83a7-412b-a604-8811472274ba tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:04.218316 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4126f11a-83a7-412b-a604-8811472274ba tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:04.218897 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4126f11a-83a7-412b-a604-8811472274ba tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:04.255883 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4126f11a-83a7-412b-a604-8811472274ba tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:04.256682 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4126f11a-83a7-412b-a604-8811472274ba tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:04.257489 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4126f11a-83a7-412b-a604-8811472274ba tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:04.294949 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4126f11a-83a7-412b-a604-8811472274ba tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:04.296766 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4126f11a-83a7-412b-a604-8811472274ba tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:04.298629 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4126f11a-83a7-412b-a604-8811472274ba tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:04.362840 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-4126f11a-83a7-412b-a604-8811472274ba tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lazy-loading 'flavor' on Instance uuid 90130005-57a3-4424-b7a6-88a5f153eb8d {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:54:04.386503 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4126f11a-83a7-412b-a604-8811472274ba tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] 10.222.0.60 "PUT /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d/tags/tempest-tag-61121823" status: 201 len: 0 microversion: 2.26 time: 0.202113 Oct 18 15:54:04.387662 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2903/5791] 10.222.0.60 () {62 vars in 1374 bytes} [Tue Oct 18 15:54:04 2022] PUT /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d/tags/tempest-tag-61121823 => generated 0 bytes in 204 msecs (HTTP/1.1 201) 10 headers in 484 bytes (2 switches on core 0) Oct 18 15:54:04.400154 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b06d4a07-248c-46e1-9589-8eb225469bb7 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Calling method '.version_select at 0x7f7c3c4e0ee0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:54:04.414485 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b06d4a07-248c-46e1-9589-8eb225469bb7 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:04.415252 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b06d4a07-248c-46e1-9589-8eb225469bb7 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:04.420726 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b06d4a07-248c-46e1-9589-8eb225469bb7 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:04.437527 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b06d4a07-248c-46e1-9589-8eb225469bb7 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] 10.222.0.60 "GET /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d/tags/tempest-tag-61121823" status: 204 len: 0 microversion: 2.26 time: 0.041589 Oct 18 15:54:04.438284 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2904/5792] 10.222.0.60 () {60 vars in 1355 bytes} [Tue Oct 18 15:54:04 2022] GET /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d/tags/tempest-tag-61121823 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 15:54:04.448107 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2b5cf965-377a-4df5-8841-d96f5c3ec024 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Calling method '.version_select at 0x7f7c3c4e15e0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:54:04.464415 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2b5cf965-377a-4df5-8841-d96f5c3ec024 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:04.465261 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2b5cf965-377a-4df5-8841-d96f5c3ec024 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:04.468227 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2b5cf965-377a-4df5-8841-d96f5c3ec024 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:04.468913 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2b5cf965-377a-4df5-8841-d96f5c3ec024 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] [instance: 90130005-57a3-4424-b7a6-88a5f153eb8d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:54:04.477707 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2b5cf965-377a-4df5-8841-d96f5c3ec024 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:04.477707 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2b5cf965-377a-4df5-8841-d96f5c3ec024 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:04.479235 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2b5cf965-377a-4df5-8841-d96f5c3ec024 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:04.480325 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2b5cf965-377a-4df5-8841-d96f5c3ec024 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:04.480928 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2b5cf965-377a-4df5-8841-d96f5c3ec024 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:04.482250 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2b5cf965-377a-4df5-8841-d96f5c3ec024 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:04.487309 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=4,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:54:04.519615 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2b5cf965-377a-4df5-8841-d96f5c3ec024 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:04.520417 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2b5cf965-377a-4df5-8841-d96f5c3ec024 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:04.521277 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2b5cf965-377a-4df5-8841-d96f5c3ec024 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:04.569288 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-2b5cf965-377a-4df5-8841-d96f5c3ec024 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lazy-loading 'flavor' on Instance uuid 90130005-57a3-4424-b7a6-88a5f153eb8d {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:54:04.594971 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2b5cf965-377a-4df5-8841-d96f5c3ec024 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] 10.222.0.60 "DELETE /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d/tags" status: 204 len: 0 microversion: 2.26 time: 0.151760 Oct 18 15:54:04.595755 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2905/5793] 10.222.0.60 () {60 vars in 1295 bytes} [Tue Oct 18 15:54:04 2022] DELETE /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d/tags => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 15:54:04.609116 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-55ee5ba1-92ea-48a1-997a-96cc32aef4a7 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Calling method '.version_select at 0x7f7c416c4f70>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:54:04.627367 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-55ee5ba1-92ea-48a1-997a-96cc32aef4a7 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:04.628572 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-55ee5ba1-92ea-48a1-997a-96cc32aef4a7 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:04.629991 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-55ee5ba1-92ea-48a1-997a-96cc32aef4a7 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:04.649036 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-55ee5ba1-92ea-48a1-997a-96cc32aef4a7 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] 10.222.0.60 "GET /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d/tags" status: 200 len: 12 microversion: 2.26 time: 0.047306 Oct 18 15:54:04.651270 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2906/5794] 10.222.0.60 () {60 vars in 1292 bytes} [Tue Oct 18 15:54:04 2022] GET /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d/tags => generated 12 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:54:04.669147 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-aa771a1d-e873-440b-9aae-a000fbb45c6e tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Calling method '.version_select at 0x7f7c3c0dbca0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:54:04.686014 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aa771a1d-e873-440b-9aae-a000fbb45c6e tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:04.686014 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aa771a1d-e873-440b-9aae-a000fbb45c6e tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:04.686014 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aa771a1d-e873-440b-9aae-a000fbb45c6e tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:04.686014 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-aa771a1d-e873-440b-9aae-a000fbb45c6e tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] [instance: 90130005-57a3-4424-b7a6-88a5f153eb8d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:54:04.691283 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aa771a1d-e873-440b-9aae-a000fbb45c6e tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:04.692143 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aa771a1d-e873-440b-9aae-a000fbb45c6e tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:04.693162 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aa771a1d-e873-440b-9aae-a000fbb45c6e tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:04.694226 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aa771a1d-e873-440b-9aae-a000fbb45c6e tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:04.694931 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aa771a1d-e873-440b-9aae-a000fbb45c6e tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:04.695608 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aa771a1d-e873-440b-9aae-a000fbb45c6e tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:04.776193 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aa771a1d-e873-440b-9aae-a000fbb45c6e tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:04.779749 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aa771a1d-e873-440b-9aae-a000fbb45c6e tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:04.780393 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aa771a1d-e873-440b-9aae-a000fbb45c6e tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:04.800357 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-65b8827f-79ae-4d4e-ab97-703450be34d3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:04.814649 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-65b8827f-79ae-4d4e-ab97-703450be34d3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:04.816430 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-65b8827f-79ae-4d4e-ab97-703450be34d3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:04.817687 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-65b8827f-79ae-4d4e-ab97-703450be34d3 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1727 microversion: 2.20 time: 0.666659 Oct 18 15:54:04.818205 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2889/5795] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:54:04 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1727 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:54:04.831150 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aa771a1d-e873-440b-9aae-a000fbb45c6e tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:04.831654 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aa771a1d-e873-440b-9aae-a000fbb45c6e tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:04.832104 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aa771a1d-e873-440b-9aae-a000fbb45c6e tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:04.877339 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-aa771a1d-e873-440b-9aae-a000fbb45c6e tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lazy-loading 'flavor' on Instance uuid 90130005-57a3-4424-b7a6-88a5f153eb8d {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:54:04.912639 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-aa771a1d-e873-440b-9aae-a000fbb45c6e tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] 10.222.0.60 "PUT /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d/tags/tempest-tag-763823533" status: 201 len: 0 microversion: 2.26 time: 0.254489 Oct 18 15:54:04.913712 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2907/5796] 10.222.0.60 () {62 vars in 1377 bytes} [Tue Oct 18 15:54:04 2022] PUT /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d/tags/tempest-tag-763823533 => generated 0 bytes in 257 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Oct 18 15:54:04.924722 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-26f6bc68-c2f7-4884-a0f7-7d96d44e0ff9 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Calling method '.version_select at 0x7f7c3c72b4c0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:54:04.940720 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26f6bc68-c2f7-4884-a0f7-7d96d44e0ff9 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:04.941696 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26f6bc68-c2f7-4884-a0f7-7d96d44e0ff9 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:04.943452 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26f6bc68-c2f7-4884-a0f7-7d96d44e0ff9 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:04.982879 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-26f6bc68-c2f7-4884-a0f7-7d96d44e0ff9 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] 10.222.0.60 "GET /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d/tags" status: 200 len: 35 microversion: 2.26 time: 0.063606 Oct 18 15:54:04.984016 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2890/5797] 10.222.0.60 () {60 vars in 1292 bytes} [Tue Oct 18 15:54:04 2022] GET /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d/tags => generated 35 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:54:04.995725 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-add45f71-279c-4c21-a564-b96a627828de tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Calling method '.version_select at 0x7f7c3c0dbaf0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:54:05.007101 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-add45f71-279c-4c21-a564-b96a627828de tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:05.008311 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-add45f71-279c-4c21-a564-b96a627828de tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:05.008829 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-add45f71-279c-4c21-a564-b96a627828de tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:05.010054 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-add45f71-279c-4c21-a564-b96a627828de tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] [instance: 90130005-57a3-4424-b7a6-88a5f153eb8d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:54:05.030394 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-add45f71-279c-4c21-a564-b96a627828de tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:05.031171 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-add45f71-279c-4c21-a564-b96a627828de tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:05.031623 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-add45f71-279c-4c21-a564-b96a627828de tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:05.032704 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-add45f71-279c-4c21-a564-b96a627828de tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:05.033334 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-add45f71-279c-4c21-a564-b96a627828de tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:05.033972 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-add45f71-279c-4c21-a564-b96a627828de tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:05.092220 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-add45f71-279c-4c21-a564-b96a627828de tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:05.092721 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-add45f71-279c-4c21-a564-b96a627828de tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:05.093396 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-add45f71-279c-4c21-a564-b96a627828de tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:05.121869 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-add45f71-279c-4c21-a564-b96a627828de tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lazy-loading 'flavor' on Instance uuid 90130005-57a3-4424-b7a6-88a5f153eb8d {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:54:05.143554 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-add45f71-279c-4c21-a564-b96a627828de tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] 10.222.0.60 "DELETE /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d/tags/tempest-tag-763823533" status: 204 len: 0 microversion: 2.26 time: 0.153290 Oct 18 15:54:05.144854 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2908/5798] 10.222.0.60 () {60 vars in 1361 bytes} [Tue Oct 18 15:54:04 2022] DELETE /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d/tags/tempest-tag-763823533 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 15:54:05.154264 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8e17522f-f635-4aaf-9d6f-098f7f3c37b0 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Calling method '.version_select at 0x7f7c3d1d70d0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:54:05.177943 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e17522f-f635-4aaf-9d6f-098f7f3c37b0 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:05.178534 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e17522f-f635-4aaf-9d6f-098f7f3c37b0 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:05.180518 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e17522f-f635-4aaf-9d6f-098f7f3c37b0 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:05.213319 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8e17522f-f635-4aaf-9d6f-098f7f3c37b0 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] 10.222.0.60 "GET /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d/tags" status: 200 len: 12 microversion: 2.26 time: 0.063389 Oct 18 15:54:05.219129 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2891/5799] 10.222.0.60 () {60 vars in 1292 bytes} [Tue Oct 18 15:54:05 2022] GET /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d/tags => generated 12 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:54:05.229286 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1cb1db47-c567-4670-975f-6f6652dd1f74 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Calling method '.version_select at 0x7f7c3c4e1ee0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:54:05.245867 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1cb1db47-c567-4670-975f-6f6652dd1f74 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:05.247634 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1cb1db47-c567-4670-975f-6f6652dd1f74 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:05.248842 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1cb1db47-c567-4670-975f-6f6652dd1f74 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:05.249945 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1cb1db47-c567-4670-975f-6f6652dd1f74 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] [instance: 90130005-57a3-4424-b7a6-88a5f153eb8d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:54:05.265699 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1cb1db47-c567-4670-975f-6f6652dd1f74 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:05.270311 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1cb1db47-c567-4670-975f-6f6652dd1f74 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:05.271082 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1cb1db47-c567-4670-975f-6f6652dd1f74 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:05.276240 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1cb1db47-c567-4670-975f-6f6652dd1f74 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:05.279338 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1cb1db47-c567-4670-975f-6f6652dd1f74 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:05.279338 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1cb1db47-c567-4670-975f-6f6652dd1f74 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:05.354077 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1cb1db47-c567-4670-975f-6f6652dd1f74 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:05.356752 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1cb1db47-c567-4670-975f-6f6652dd1f74 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:05.357894 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1cb1db47-c567-4670-975f-6f6652dd1f74 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:05.396270 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-1cb1db47-c567-4670-975f-6f6652dd1f74 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lazy-loading 'flavor' on Instance uuid 90130005-57a3-4424-b7a6-88a5f153eb8d {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:54:05.418509 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1cb1db47-c567-4670-975f-6f6652dd1f74 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] 10.222.0.60 "DELETE /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d/tags" status: 204 len: 0 microversion: 2.26 time: 0.194422 Oct 18 15:54:05.419855 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2909/5800] 10.222.0.60 () {60 vars in 1295 bytes} [Tue Oct 18 15:54:05 2022] DELETE /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d/tags => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 15:54:05.430912 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2639f983-a8d0-4512-97b5-b85084056180 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Calling method '.version_select at 0x7f7c3c72ba60>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:54:05.465205 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:54:05.471187 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2639f983-a8d0-4512-97b5-b85084056180 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:05.471815 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2639f983-a8d0-4512-97b5-b85084056180 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:05.472562 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2639f983-a8d0-4512-97b5-b85084056180 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:05.484419 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2639f983-a8d0-4512-97b5-b85084056180 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] [instance: 90130005-57a3-4424-b7a6-88a5f153eb8d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:54:05.503858 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-13bcf10c-5773-41cf-be42-8619f33987a0 req-5e6c63d8-fd75-478e-8fb9-306f41b19fb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6af51230-78de-43fb-be54-c1b182368139", "tag": "e6888c52-692f-4a5c-a3cf-e7018e476bf5"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:54:05.517888 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2639f983-a8d0-4512-97b5-b85084056180 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:05.518650 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2639f983-a8d0-4512-97b5-b85084056180 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:05.519251 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2639f983-a8d0-4512-97b5-b85084056180 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:05.520388 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2639f983-a8d0-4512-97b5-b85084056180 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:05.521027 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2639f983-a8d0-4512-97b5-b85084056180 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:05.521631 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2639f983-a8d0-4512-97b5-b85084056180 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:05.532441 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-13bcf10c-5773-41cf-be42-8619f33987a0 req-5e6c63d8-fd75-478e-8fb9-306f41b19fb6 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:05.533395 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-13bcf10c-5773-41cf-be42-8619f33987a0 req-5e6c63d8-fd75-478e-8fb9-306f41b19fb6 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:05.533842 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-13bcf10c-5773-41cf-be42-8619f33987a0 req-5e6c63d8-fd75-478e-8fb9-306f41b19fb6 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:05.588716 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2639f983-a8d0-4512-97b5-b85084056180 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:05.589217 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-13bcf10c-5773-41cf-be42-8619f33987a0 req-5e6c63d8-fd75-478e-8fb9-306f41b19fb6 service nova] Creating event network-changed:e6888c52-692f-4a5c-a3cf-e7018e476bf5 for instance 6af51230-78de-43fb-be54-c1b182368139 on n-h2-853682-5 Oct 18 15:54:05.589619 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2639f983-a8d0-4512-97b5-b85084056180 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:05.590499 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2639f983-a8d0-4512-97b5-b85084056180 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:05.605015 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-13bcf10c-5773-41cf-be42-8619f33987a0 req-5e6c63d8-fd75-478e-8fb9-306f41b19fb6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103361 Oct 18 15:54:05.606428 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2910/5801] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:54:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:54:05.631705 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2639f983-a8d0-4512-97b5-b85084056180 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:05.634243 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2639f983-a8d0-4512-97b5-b85084056180 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:05.634913 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2639f983-a8d0-4512-97b5-b85084056180 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:05.694179 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-2639f983-a8d0-4512-97b5-b85084056180 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lazy-loading 'flavor' on Instance uuid 90130005-57a3-4424-b7a6-88a5f153eb8d {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:54:05.739211 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2639f983-a8d0-4512-97b5-b85084056180 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] 10.222.0.60 "PUT /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d/tags/tempest-tag-1813159440" status: 201 len: 0 microversion: 2.26 time: 0.313898 Oct 18 15:54:05.740369 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2892/5802] 10.222.0.60 () {62 vars in 1380 bytes} [Tue Oct 18 15:54:05 2022] PUT /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d/tags/tempest-tag-1813159440 => generated 0 bytes in 316 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 18 15:54:05.759628 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-42773e6a-2904-437b-a4f5-9e98aebfef9e tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Calling method '.version_select at 0x7f7c3c0e6040>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:54:05.782545 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-42773e6a-2904-437b-a4f5-9e98aebfef9e tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:05.783230 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-42773e6a-2904-437b-a4f5-9e98aebfef9e tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:05.783681 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-42773e6a-2904-437b-a4f5-9e98aebfef9e tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:05.784297 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-42773e6a-2904-437b-a4f5-9e98aebfef9e tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] [instance: 90130005-57a3-4424-b7a6-88a5f153eb8d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:54:05.796988 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-42773e6a-2904-437b-a4f5-9e98aebfef9e tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:05.797750 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-42773e6a-2904-437b-a4f5-9e98aebfef9e tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:05.798207 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-42773e6a-2904-437b-a4f5-9e98aebfef9e tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:05.798935 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-42773e6a-2904-437b-a4f5-9e98aebfef9e tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:05.799402 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-42773e6a-2904-437b-a4f5-9e98aebfef9e tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:05.799833 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-42773e6a-2904-437b-a4f5-9e98aebfef9e tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:05.847272 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0d5b071e-2913-458c-a9c0-d805fa65db95 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:54:05.848641 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0d5b071e-2913-458c-a9c0-d805fa65db95 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:54:05.865877 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0d5b071e-2913-458c-a9c0-d805fa65db95 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:05.866698 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0d5b071e-2913-458c-a9c0-d805fa65db95 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:05.867309 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0d5b071e-2913-458c-a9c0-d805fa65db95 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:05.868217 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0d5b071e-2913-458c-a9c0-d805fa65db95 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:05.869695 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0d5b071e-2913-458c-a9c0-d805fa65db95 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:05.873362 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-42773e6a-2904-437b-a4f5-9e98aebfef9e tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:05.874073 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0d5b071e-2913-458c-a9c0-d805fa65db95 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:05.876060 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-42773e6a-2904-437b-a4f5-9e98aebfef9e tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:05.876547 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-42773e6a-2904-437b-a4f5-9e98aebfef9e tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:05.912500 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-42773e6a-2904-437b-a4f5-9e98aebfef9e tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:05.913105 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-42773e6a-2904-437b-a4f5-9e98aebfef9e tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:05.914288 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-42773e6a-2904-437b-a4f5-9e98aebfef9e tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:06.001551 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-42773e6a-2904-437b-a4f5-9e98aebfef9e tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lazy-loading 'flavor' on Instance uuid 90130005-57a3-4424-b7a6-88a5f153eb8d {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:54:06.047232 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-42773e6a-2904-437b-a4f5-9e98aebfef9e tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] 10.222.0.60 "PUT /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d/tags/tempest-tag-1403986802" status: 201 len: 0 microversion: 2.26 time: 0.298112 Oct 18 15:54:06.053731 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2911/5803] 10.222.0.60 () {62 vars in 1380 bytes} [Tue Oct 18 15:54:05 2022] PUT /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d/tags/tempest-tag-1403986802 => generated 0 bytes in 305 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 18 15:54:06.079434 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-82d1d70f-e1fb-46b9-8cf2-a4d2611a87e4 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Calling method '.version_select at 0x7f7c3c603c10>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:54:06.112956 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-82d1d70f-e1fb-46b9-8cf2-a4d2611a87e4 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:06.114087 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-82d1d70f-e1fb-46b9-8cf2-a4d2611a87e4 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:06.114651 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-82d1d70f-e1fb-46b9-8cf2-a4d2611a87e4 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:06.116147 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-82d1d70f-e1fb-46b9-8cf2-a4d2611a87e4 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] [instance: 90130005-57a3-4424-b7a6-88a5f153eb8d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:54:06.124037 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-82d1d70f-e1fb-46b9-8cf2-a4d2611a87e4 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:06.124687 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-82d1d70f-e1fb-46b9-8cf2-a4d2611a87e4 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:06.125523 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-82d1d70f-e1fb-46b9-8cf2-a4d2611a87e4 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:06.126518 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-82d1d70f-e1fb-46b9-8cf2-a4d2611a87e4 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:06.127276 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-82d1d70f-e1fb-46b9-8cf2-a4d2611a87e4 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:06.127809 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-82d1d70f-e1fb-46b9-8cf2-a4d2611a87e4 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:06.167653 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-82d1d70f-e1fb-46b9-8cf2-a4d2611a87e4 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:06.168231 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-82d1d70f-e1fb-46b9-8cf2-a4d2611a87e4 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:06.168773 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-82d1d70f-e1fb-46b9-8cf2-a4d2611a87e4 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:06.190653 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-82d1d70f-e1fb-46b9-8cf2-a4d2611a87e4 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lazy-loading 'flavor' on Instance uuid 90130005-57a3-4424-b7a6-88a5f153eb8d {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:54:06.228620 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-82d1d70f-e1fb-46b9-8cf2-a4d2611a87e4 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] 10.222.0.60 "DELETE /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d/tags" status: 204 len: 0 microversion: 2.26 time: 0.172959 Oct 18 15:54:06.233459 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2912/5804] 10.222.0.60 () {60 vars in 1295 bytes} [Tue Oct 18 15:54:06 2022] DELETE /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d/tags => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 15:54:06.242633 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2b2ae9db-01ee-4523-ae3c-07001493851a tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Calling method '.version_select at 0x7f7c416c4f70>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:54:06.279057 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2b2ae9db-01ee-4523-ae3c-07001493851a tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:06.279615 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2b2ae9db-01ee-4523-ae3c-07001493851a tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:06.280071 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2b2ae9db-01ee-4523-ae3c-07001493851a tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:06.344769 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2b2ae9db-01ee-4523-ae3c-07001493851a tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] 10.222.0.60 "GET /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d/tags" status: 200 len: 12 microversion: 2.26 time: 0.110098 Oct 18 15:54:06.347534 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2913/5805] 10.222.0.60 () {60 vars in 1292 bytes} [Tue Oct 18 15:54:06 2022] GET /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d/tags => generated 12 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:54:06.360418 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-57c37bf4-427b-43b7-90be-eb85b86ceb7e tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Calling method '.version_select at 0x7f7c3c603ca0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:54:06.394704 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57c37bf4-427b-43b7-90be-eb85b86ceb7e tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:06.405606 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57c37bf4-427b-43b7-90be-eb85b86ceb7e tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:06.406076 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57c37bf4-427b-43b7-90be-eb85b86ceb7e tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:06.406587 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-57c37bf4-427b-43b7-90be-eb85b86ceb7e tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] [instance: 90130005-57a3-4424-b7a6-88a5f153eb8d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:54:06.413024 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57c37bf4-427b-43b7-90be-eb85b86ceb7e tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:06.413528 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57c37bf4-427b-43b7-90be-eb85b86ceb7e tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:06.413975 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57c37bf4-427b-43b7-90be-eb85b86ceb7e tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:06.414701 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57c37bf4-427b-43b7-90be-eb85b86ceb7e tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:06.417640 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57c37bf4-427b-43b7-90be-eb85b86ceb7e tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:06.418097 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57c37bf4-427b-43b7-90be-eb85b86ceb7e tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:06.464969 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57c37bf4-427b-43b7-90be-eb85b86ceb7e tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:06.465466 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57c37bf4-427b-43b7-90be-eb85b86ceb7e tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:06.465910 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57c37bf4-427b-43b7-90be-eb85b86ceb7e tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:06.490812 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-57c37bf4-427b-43b7-90be-eb85b86ceb7e tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lazy-loading 'flavor' on Instance uuid 90130005-57a3-4424-b7a6-88a5f153eb8d {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:54:06.529537 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-57c37bf4-427b-43b7-90be-eb85b86ceb7e tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] 10.222.0.60 "DELETE /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d/tags" status: 204 len: 0 microversion: 2.26 time: 0.175404 Oct 18 15:54:06.533811 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2914/5806] 10.222.0.60 () {60 vars in 1295 bytes} [Tue Oct 18 15:54:06 2022] DELETE /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d/tags => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 15:54:06.548266 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3325cb51-8916-458f-9695-a3756f7afdad tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Calling method '.version_select at 0x7f7c3d17e0d0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:54:06.563980 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0d5b071e-2913-458c-a9c0-d805fa65db95 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:06.570732 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3325cb51-8916-458f-9695-a3756f7afdad tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:06.571272 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3325cb51-8916-458f-9695-a3756f7afdad tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:06.571754 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3325cb51-8916-458f-9695-a3756f7afdad tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:06.572368 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3325cb51-8916-458f-9695-a3756f7afdad tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] [instance: 90130005-57a3-4424-b7a6-88a5f153eb8d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:54:06.589208 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0d5b071e-2913-458c-a9c0-d805fa65db95 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:06.592508 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3325cb51-8916-458f-9695-a3756f7afdad tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:06.593252 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3325cb51-8916-458f-9695-a3756f7afdad tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:06.593409 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0d5b071e-2913-458c-a9c0-d805fa65db95 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:06.594051 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3325cb51-8916-458f-9695-a3756f7afdad tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:06.594667 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0d5b071e-2913-458c-a9c0-d805fa65db95 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1727 microversion: 2.20 time: 0.751515 Oct 18 15:54:06.594793 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3325cb51-8916-458f-9695-a3756f7afdad tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:06.595260 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2893/5807] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:54:05 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1727 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:54:06.604953 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3325cb51-8916-458f-9695-a3756f7afdad tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:06.606414 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3325cb51-8916-458f-9695-a3756f7afdad tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:06.675355 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3325cb51-8916-458f-9695-a3756f7afdad tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:06.676310 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3325cb51-8916-458f-9695-a3756f7afdad tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:06.677074 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3325cb51-8916-458f-9695-a3756f7afdad tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:06.687314 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3325cb51-8916-458f-9695-a3756f7afdad tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:06.688054 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3325cb51-8916-458f-9695-a3756f7afdad tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:06.689066 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3325cb51-8916-458f-9695-a3756f7afdad tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:06.698349 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=87,nova_cell1:DELETE=5,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=3,nova_cell1:RELEASE=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:54:06.751463 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-3325cb51-8916-458f-9695-a3756f7afdad tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lazy-loading 'flavor' on Instance uuid 90130005-57a3-4424-b7a6-88a5f153eb8d {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:54:06.773404 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3325cb51-8916-458f-9695-a3756f7afdad tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] 10.222.0.60 "PUT /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d/tags/tempest-tag-832666087" status: 201 len: 0 microversion: 2.26 time: 0.230378 Oct 18 15:54:06.780420 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2915/5808] 10.222.0.60 () {62 vars in 1377 bytes} [Tue Oct 18 15:54:06 2022] PUT /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d/tags/tempest-tag-832666087 => generated 0 bytes in 239 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Oct 18 15:54:06.787367 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cf029cce-265e-48bd-b816-c91c5653715b tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Calling method '.version_select at 0x7f7c3ce181f0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:54:06.811712 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf029cce-265e-48bd-b816-c91c5653715b tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:06.815846 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf029cce-265e-48bd-b816-c91c5653715b tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:06.816408 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf029cce-265e-48bd-b816-c91c5653715b tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:06.817766 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cf029cce-265e-48bd-b816-c91c5653715b tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] [instance: 90130005-57a3-4424-b7a6-88a5f153eb8d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:54:06.834182 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf029cce-265e-48bd-b816-c91c5653715b tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:06.834464 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf029cce-265e-48bd-b816-c91c5653715b tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:06.834920 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf029cce-265e-48bd-b816-c91c5653715b tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:06.838232 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf029cce-265e-48bd-b816-c91c5653715b tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:06.839273 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf029cce-265e-48bd-b816-c91c5653715b tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:06.839873 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf029cce-265e-48bd-b816-c91c5653715b tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:06.881059 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf029cce-265e-48bd-b816-c91c5653715b tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:06.881825 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf029cce-265e-48bd-b816-c91c5653715b tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:06.882734 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf029cce-265e-48bd-b816-c91c5653715b tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:06.895124 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf029cce-265e-48bd-b816-c91c5653715b tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:06.896210 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf029cce-265e-48bd-b816-c91c5653715b tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:06.897265 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf029cce-265e-48bd-b816-c91c5653715b tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:06.928934 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-cf029cce-265e-48bd-b816-c91c5653715b tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lazy-loading 'flavor' on Instance uuid 90130005-57a3-4424-b7a6-88a5f153eb8d {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:54:06.949275 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cf029cce-265e-48bd-b816-c91c5653715b tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] 10.222.0.60 "PUT /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d/tags/tempest-tag-305582122" status: 201 len: 0 microversion: 2.26 time: 0.168027 Oct 18 15:54:06.951155 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2894/5809] 10.222.0.60 () {62 vars in 1377 bytes} [Tue Oct 18 15:54:06 2022] PUT /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d/tags/tempest-tag-305582122 => generated 0 bytes in 171 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Oct 18 15:54:06.965522 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3430d3aa-5dda-4e2d-9def-02c7fb26ce49 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Action: 'update_all', calling method: .version_select at 0x7f7c416841f0>, body: {"tags": ["tempest-tag-1028323006", "tempest-tag-248763063"]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:54:06.984297 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3430d3aa-5dda-4e2d-9def-02c7fb26ce49 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:06.986541 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3430d3aa-5dda-4e2d-9def-02c7fb26ce49 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:06.987136 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3430d3aa-5dda-4e2d-9def-02c7fb26ce49 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:06.989598 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3430d3aa-5dda-4e2d-9def-02c7fb26ce49 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] [instance: 90130005-57a3-4424-b7a6-88a5f153eb8d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:54:06.997666 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3430d3aa-5dda-4e2d-9def-02c7fb26ce49 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:06.998264 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3430d3aa-5dda-4e2d-9def-02c7fb26ce49 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:06.998902 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3430d3aa-5dda-4e2d-9def-02c7fb26ce49 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:07.000050 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3430d3aa-5dda-4e2d-9def-02c7fb26ce49 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:07.000617 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3430d3aa-5dda-4e2d-9def-02c7fb26ce49 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:07.001384 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3430d3aa-5dda-4e2d-9def-02c7fb26ce49 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:07.035857 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3430d3aa-5dda-4e2d-9def-02c7fb26ce49 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:07.037270 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3430d3aa-5dda-4e2d-9def-02c7fb26ce49 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:07.039222 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3430d3aa-5dda-4e2d-9def-02c7fb26ce49 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:07.077308 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-3430d3aa-5dda-4e2d-9def-02c7fb26ce49 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lazy-loading 'flavor' on Instance uuid 90130005-57a3-4424-b7a6-88a5f153eb8d {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:54:07.095365 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3430d3aa-5dda-4e2d-9def-02c7fb26ce49 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] 10.222.0.60 "PUT /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d/tags" status: 200 len: 61 microversion: 2.26 time: 0.138899 Oct 18 15:54:07.096262 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2916/5810] 10.222.0.60 () {62 vars in 1312 bytes} [Tue Oct 18 15:54:06 2022] PUT /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d/tags => generated 61 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:54:07.108072 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-33d39137-512e-40d6-908e-7eb35a95dfd3 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Calling method '.version_select at 0x7f7c3c544a60>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:54:07.118869 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33d39137-512e-40d6-908e-7eb35a95dfd3 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:07.119602 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33d39137-512e-40d6-908e-7eb35a95dfd3 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:07.120199 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33d39137-512e-40d6-908e-7eb35a95dfd3 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:07.133496 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-33d39137-512e-40d6-908e-7eb35a95dfd3 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] 10.222.0.60 "GET /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d/tags" status: 200 len: 61 microversion: 2.26 time: 0.030627 Oct 18 15:54:07.135304 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2895/5811] 10.222.0.60 () {60 vars in 1292 bytes} [Tue Oct 18 15:54:07 2022] GET /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d/tags => generated 61 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:54:07.147732 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c10997a8-b8cf-4100-a3cd-37816e404863 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Calling method '.version_select at 0x7f7c41575700>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:54:07.165914 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c10997a8-b8cf-4100-a3cd-37816e404863 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:07.167713 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c10997a8-b8cf-4100-a3cd-37816e404863 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:07.168413 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c10997a8-b8cf-4100-a3cd-37816e404863 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:07.168940 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c10997a8-b8cf-4100-a3cd-37816e404863 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] [instance: 90130005-57a3-4424-b7a6-88a5f153eb8d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:54:07.178881 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c10997a8-b8cf-4100-a3cd-37816e404863 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:07.179498 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c10997a8-b8cf-4100-a3cd-37816e404863 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:07.179948 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c10997a8-b8cf-4100-a3cd-37816e404863 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:07.180746 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c10997a8-b8cf-4100-a3cd-37816e404863 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:07.181248 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c10997a8-b8cf-4100-a3cd-37816e404863 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:07.181683 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c10997a8-b8cf-4100-a3cd-37816e404863 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:07.216352 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c10997a8-b8cf-4100-a3cd-37816e404863 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:07.216868 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c10997a8-b8cf-4100-a3cd-37816e404863 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:07.217311 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c10997a8-b8cf-4100-a3cd-37816e404863 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:07.236523 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-c10997a8-b8cf-4100-a3cd-37816e404863 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lazy-loading 'flavor' on Instance uuid 90130005-57a3-4424-b7a6-88a5f153eb8d {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:54:07.258360 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c10997a8-b8cf-4100-a3cd-37816e404863 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] 10.222.0.60 "DELETE /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d/tags" status: 204 len: 0 microversion: 2.26 time: 0.113988 Oct 18 15:54:07.261750 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2917/5812] 10.222.0.60 () {60 vars in 1295 bytes} [Tue Oct 18 15:54:07 2022] DELETE /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d/tags => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 15:54:07.266943 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0a474a39-ca49-44b2-8467-483ad3ce6234 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:54:07.267750 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0a474a39-ca49-44b2-8467-483ad3ce6234 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] [instance: 90130005-57a3-4424-b7a6-88a5f153eb8d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:54:07.289798 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a474a39-ca49-44b2-8467-483ad3ce6234 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:07.291281 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a474a39-ca49-44b2-8467-483ad3ce6234 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:07.294062 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a474a39-ca49-44b2-8467-483ad3ce6234 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:07.294957 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a474a39-ca49-44b2-8467-483ad3ce6234 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:07.296477 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a474a39-ca49-44b2-8467-483ad3ce6234 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:07.298047 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a474a39-ca49-44b2-8467-483ad3ce6234 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:07.364356 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0a474a39-ca49-44b2-8467-483ad3ce6234 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] [instance: 90130005-57a3-4424-b7a6-88a5f153eb8d] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:54:07.559352 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0a474a39-ca49-44b2-8467-483ad3ce6234 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] 10.222.0.60 "DELETE /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d" status: 204 len: 0 microversion: 2.26 time: 0.296314 Oct 18 15:54:07.563817 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2896/5813] 10.222.0.60 () {60 vars in 1280 bytes} [Tue Oct 18 15:54:07 2022] DELETE /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 15:54:07.573796 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-26bc00c6-2a50-4ceb-9533-413a2b082690 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:54:07.574407 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-26bc00c6-2a50-4ceb-9533-413a2b082690 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] [instance: 90130005-57a3-4424-b7a6-88a5f153eb8d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:54:07.586259 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26bc00c6-2a50-4ceb-9533-413a2b082690 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:07.590916 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26bc00c6-2a50-4ceb-9533-413a2b082690 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:07.591596 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26bc00c6-2a50-4ceb-9533-413a2b082690 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:07.592528 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26bc00c6-2a50-4ceb-9533-413a2b082690 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:07.594426 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26bc00c6-2a50-4ceb-9533-413a2b082690 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:07.595025 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26bc00c6-2a50-4ceb-9533-413a2b082690 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:07.626164 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f7269cd6-1aa6-4489-b603-1c1bc6a0a0ef tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:54:07.627718 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f7269cd6-1aa6-4489-b603-1c1bc6a0a0ef tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:54:07.642129 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7269cd6-1aa6-4489-b603-1c1bc6a0a0ef tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:07.642627 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7269cd6-1aa6-4489-b603-1c1bc6a0a0ef tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:07.645592 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7269cd6-1aa6-4489-b603-1c1bc6a0a0ef tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:07.646558 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7269cd6-1aa6-4489-b603-1c1bc6a0a0ef tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:07.648611 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7269cd6-1aa6-4489-b603-1c1bc6a0a0ef tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:07.649399 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7269cd6-1aa6-4489-b603-1c1bc6a0a0ef tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:08.203495 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-26bc00c6-2a50-4ceb-9533-413a2b082690 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcf46b0597e44dd82f7a8521e230e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100b0821c644e5297fb767dffd9c808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:08.222570 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-26bc00c6-2a50-4ceb-9533-413a2b082690 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddcf46b0597e44dd82f7a8521e230e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100b0821c644e5297fb767dffd9c808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:08.225227 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f7269cd6-1aa6-4489-b603-1c1bc6a0a0ef tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:08.226805 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-26bc00c6-2a50-4ceb-9533-413a2b082690 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddcf46b0597e44dd82f7a8521e230e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100b0821c644e5297fb767dffd9c808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:08.233120 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-26bc00c6-2a50-4ceb-9533-413a2b082690 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] 10.222.0.60 "GET /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d" status: 200 len: 1548 microversion: 2.26 time: 0.664748 Oct 18 15:54:08.234121 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2918/5814] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:54:07 2022] GET /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d => generated 1548 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:54:08.245124 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f7269cd6-1aa6-4489-b603-1c1bc6a0a0ef tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:08.245124 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f7269cd6-1aa6-4489-b603-1c1bc6a0a0ef tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:08.245124 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f7269cd6-1aa6-4489-b603-1c1bc6a0a0ef tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1727 microversion: 2.20 time: 0.621009 Oct 18 15:54:08.256465 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2897/5815] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:54:07 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1727 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:54:09.263589 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-32658108-151e-43c7-bc15-87e78b2158d7 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:54:09.271269 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c909f71a-21a4-45e5-93fb-66c01e6c4b8f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:54:09.272406 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c909f71a-21a4-45e5-93fb-66c01e6c4b8f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:54:09.272746 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-32658108-151e-43c7-bc15-87e78b2158d7 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] [instance: 90130005-57a3-4424-b7a6-88a5f153eb8d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:54:09.289496 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c909f71a-21a4-45e5-93fb-66c01e6c4b8f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:09.292713 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-32658108-151e-43c7-bc15-87e78b2158d7 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:09.294932 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c909f71a-21a4-45e5-93fb-66c01e6c4b8f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:09.295554 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c909f71a-21a4-45e5-93fb-66c01e6c4b8f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:09.296265 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-32658108-151e-43c7-bc15-87e78b2158d7 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:09.303345 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c909f71a-21a4-45e5-93fb-66c01e6c4b8f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:09.304188 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-32658108-151e-43c7-bc15-87e78b2158d7 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:09.305121 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-32658108-151e-43c7-bc15-87e78b2158d7 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:09.306587 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c909f71a-21a4-45e5-93fb-66c01e6c4b8f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:09.307250 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-32658108-151e-43c7-bc15-87e78b2158d7 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:09.307844 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c909f71a-21a4-45e5-93fb-66c01e6c4b8f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:09.309330 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-32658108-151e-43c7-bc15-87e78b2158d7 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:09.826755 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c909f71a-21a4-45e5-93fb-66c01e6c4b8f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:09.836276 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c909f71a-21a4-45e5-93fb-66c01e6c4b8f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:09.843572 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c909f71a-21a4-45e5-93fb-66c01e6c4b8f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:09.845323 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c909f71a-21a4-45e5-93fb-66c01e6c4b8f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1727 microversion: 2.20 time: 0.578849 Oct 18 15:54:09.849668 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2898/5816] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:54:09 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1727 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:54:09.891950 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-32658108-151e-43c7-bc15-87e78b2158d7 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcf46b0597e44dd82f7a8521e230e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100b0821c644e5297fb767dffd9c808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:09.905062 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-32658108-151e-43c7-bc15-87e78b2158d7 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddcf46b0597e44dd82f7a8521e230e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100b0821c644e5297fb767dffd9c808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:09.906534 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-32658108-151e-43c7-bc15-87e78b2158d7 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddcf46b0597e44dd82f7a8521e230e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100b0821c644e5297fb767dffd9c808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:09.907775 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-32658108-151e-43c7-bc15-87e78b2158d7 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] 10.222.0.60 "GET /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d" status: 200 len: 1548 microversion: 2.26 time: 0.648504 Oct 18 15:54:09.911258 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2919/5817] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:54:09 2022] GET /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d => generated 1548 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:54:10.646710 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-6623b37b-f411-4a22-8d71-4e2094c13cb4 req-8692acd2-b01a-43d4-9470-cbc7b00fda0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90130005-57a3-4424-b7a6-88a5f153eb8d", "name": "network-vif-deleted", "tag": "7bc06ef7-d04c-4a0a-ac6d-349c997c8d14"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:54:10.682342 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6623b37b-f411-4a22-8d71-4e2094c13cb4 req-8692acd2-b01a-43d4-9470-cbc7b00fda0d service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:10.683470 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6623b37b-f411-4a22-8d71-4e2094c13cb4 req-8692acd2-b01a-43d4-9470-cbc7b00fda0d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:10.684107 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6623b37b-f411-4a22-8d71-4e2094c13cb4 req-8692acd2-b01a-43d4-9470-cbc7b00fda0d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:10.722423 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-6623b37b-f411-4a22-8d71-4e2094c13cb4 req-8692acd2-b01a-43d4-9470-cbc7b00fda0d service nova] Creating event network-vif-deleted:7bc06ef7-d04c-4a0a-ac6d-349c997c8d14 for instance 90130005-57a3-4424-b7a6-88a5f153eb8d on n-h1-853682-5 Oct 18 15:54:10.752408 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-6623b37b-f411-4a22-8d71-4e2094c13cb4 req-8692acd2-b01a-43d4-9470-cbc7b00fda0d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110198 Oct 18 15:54:10.759404 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2899/5818] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:54:10.885208 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-76885de1-199c-46c9-9e22-05ee5c0b3610 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:54:10.885883 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-76885de1-199c-46c9-9e22-05ee5c0b3610 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:54:10.897650 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-76885de1-199c-46c9-9e22-05ee5c0b3610 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:10.901980 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-76885de1-199c-46c9-9e22-05ee5c0b3610 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:10.902759 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-76885de1-199c-46c9-9e22-05ee5c0b3610 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:10.905534 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-76885de1-199c-46c9-9e22-05ee5c0b3610 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:10.906727 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-76885de1-199c-46c9-9e22-05ee5c0b3610 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:10.907754 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-76885de1-199c-46c9-9e22-05ee5c0b3610 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:10.938103 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-703abac4-aa8a-4f04-9ac3-659676370a58 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:54:10.939057 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-703abac4-aa8a-4f04-9ac3-659676370a58 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] [instance: 90130005-57a3-4424-b7a6-88a5f153eb8d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:54:10.964909 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-703abac4-aa8a-4f04-9ac3-659676370a58 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:10.972415 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-703abac4-aa8a-4f04-9ac3-659676370a58 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:10.973562 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-703abac4-aa8a-4f04-9ac3-659676370a58 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:10.978495 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-703abac4-aa8a-4f04-9ac3-659676370a58 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:10.983512 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-703abac4-aa8a-4f04-9ac3-659676370a58 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:10.983970 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-703abac4-aa8a-4f04-9ac3-659676370a58 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:11.082846 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-703abac4-aa8a-4f04-9ac3-659676370a58 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:11.083341 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-703abac4-aa8a-4f04-9ac3-659676370a58 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:11.083784 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-703abac4-aa8a-4f04-9ac3-659676370a58 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:11.084246 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-703abac4-aa8a-4f04-9ac3-659676370a58 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lazy-loading 'fault' on Instance uuid 90130005-57a3-4424-b7a6-88a5f153eb8d {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:54:11.088914 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2,nova_cell1:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:54:11.423449 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-703abac4-aa8a-4f04-9ac3-659676370a58 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddcf46b0597e44dd82f7a8521e230e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100b0821c644e5297fb767dffd9c808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:11.438606 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-703abac4-aa8a-4f04-9ac3-659676370a58 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddcf46b0597e44dd82f7a8521e230e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100b0821c644e5297fb767dffd9c808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:11.448013 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-703abac4-aa8a-4f04-9ac3-659676370a58 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddcf46b0597e44dd82f7a8521e230e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100b0821c644e5297fb767dffd9c808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:11.449857 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-703abac4-aa8a-4f04-9ac3-659676370a58 tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] 10.222.0.60 "GET /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d" status: 200 len: 1349 microversion: 2.26 time: 0.517492 Oct 18 15:54:11.453891 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2900/5819] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:54:10 2022] GET /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d => generated 1349 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:54:11.494461 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-76885de1-199c-46c9-9e22-05ee5c0b3610 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:11.509126 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-76885de1-199c-46c9-9e22-05ee5c0b3610 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:11.511357 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-76885de1-199c-46c9-9e22-05ee5c0b3610 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:11.512999 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-76885de1-199c-46c9-9e22-05ee5c0b3610 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1727 microversion: 2.20 time: 0.633071 Oct 18 15:54:11.526121 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2920/5820] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:54:10 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1727 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 15:54:12.482768 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-395db6e8-f652-4423-bc94-a4a74e8db16f tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:54:12.484161 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-395db6e8-f652-4423-bc94-a4a74e8db16f tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] [instance: 90130005-57a3-4424-b7a6-88a5f153eb8d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:54:12.509534 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-395db6e8-f652-4423-bc94-a4a74e8db16f tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:12.514104 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-395db6e8-f652-4423-bc94-a4a74e8db16f tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:12.515043 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-395db6e8-f652-4423-bc94-a4a74e8db16f tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:12.516796 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-395db6e8-f652-4423-bc94-a4a74e8db16f tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:12.517456 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-395db6e8-f652-4423-bc94-a4a74e8db16f tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:12.530927 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-395db6e8-f652-4423-bc94-a4a74e8db16f tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:12.543531 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a9b87aaf-4dd6-406a-87a4-0ae4bd91e9d9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:54:12.545029 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a9b87aaf-4dd6-406a-87a4-0ae4bd91e9d9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:54:12.563084 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9b87aaf-4dd6-406a-87a4-0ae4bd91e9d9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:12.563863 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9b87aaf-4dd6-406a-87a4-0ae4bd91e9d9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:12.566468 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9b87aaf-4dd6-406a-87a4-0ae4bd91e9d9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:12.567435 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9b87aaf-4dd6-406a-87a4-0ae4bd91e9d9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:12.570284 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9b87aaf-4dd6-406a-87a4-0ae4bd91e9d9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:12.572927 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9b87aaf-4dd6-406a-87a4-0ae4bd91e9d9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:12.579828 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-395db6e8-f652-4423-bc94-a4a74e8db16f tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] HTTP exception thrown: Instance 90130005-57a3-4424-b7a6-88a5f153eb8d could not be found. Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-395db6e8-f652-4423-bc94-a4a74e8db16f tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Request method failure captured: Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d HTTP/1.1 Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTswAT0-69tyc5FjVf3hBh4KrQpm8OWgmc0M5H8gU_uoKDNFcjHGaQL-ArRKZGl4menwxNdWKlU9oMVGNlpLGxXupSAW1YVyGRUXJ9DszCAg9K7zrIxXrhCQxoNYHmFAB-uREJIHTQmgSPQWJz1JpyHs9-3ru-yxK_S94hcQmhZMN9nM Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: X-Openstack-Nova-Api-Version: 2.26 Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: f100b0821c644e5297fb767dffd9c808 Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerTagsTestJSON-1984489388 Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f100b0821c644e5297fb767dffd9c808"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f100b0821c644e5297fb767dffd9c808"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f100b0821c644e5297fb767dffd9c808"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f100b0821c644e5297fb767dffd9c808"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServerTagsTestJSON-1984489388 Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: f100b0821c644e5297fb767dffd9c808 Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerTagsTestJSON-1984489388 Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServerTagsTestJSON-1984489388-project Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: ddcf46b0597e44dd82f7a8521e230e21 Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServerTagsTestJSON-1984489388-project Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 90130005-57a3-4424-b7a6-88a5f153eb8d could not be found. Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '90130005-57a3-4424-b7a6-88a5f153eb8d'} Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90130005-57a3-4424-b7a6-88a5f153eb8d could not be found. Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90130005-57a3-4424-b7a6-88a5f153eb8d could not be found. Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:54:12.602693 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:54:12.607581 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:54:12.607581 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:54:12.607581 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:54:12.607581 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:54:12.607581 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:54:12.607581 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90130005-57a3-4424-b7a6-88a5f153eb8d could not be found. Oct 18 15:54:12.607581 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:54:12.612490 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-395db6e8-f652-4423-bc94-a4a74e8db16f tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] Returning 404 to user: Instance 90130005-57a3-4424-b7a6-88a5f153eb8d could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:54:12.617831 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-395db6e8-f652-4423-bc94-a4a74e8db16f tempest-ServerTagsTestJSON-1984489388 tempest-ServerTagsTestJSON-1984489388-project] 10.222.0.60 "GET /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d" status: 404 len: 111 microversion: 2.26 time: 0.140468 Oct 18 15:54:12.621805 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2901/5821] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:54:12 2022] GET /compute/v2.1/servers/90130005-57a3-4424-b7a6-88a5f153eb8d => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:54:13.376561 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a9b87aaf-4dd6-406a-87a4-0ae4bd91e9d9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:13.392278 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a9b87aaf-4dd6-406a-87a4-0ae4bd91e9d9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:13.398284 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a9b87aaf-4dd6-406a-87a4-0ae4bd91e9d9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:13.400265 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a9b87aaf-4dd6-406a-87a4-0ae4bd91e9d9 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1727 microversion: 2.20 time: 0.862046 Oct 18 15:54:13.420666 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2921/5822] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:54:12 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1727 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:54:14.443740 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-637932c3-0693-43ae-b571-9ff0a755736b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:54:14.443740 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-637932c3-0693-43ae-b571-9ff0a755736b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:54:14.449489 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-637932c3-0693-43ae-b571-9ff0a755736b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:14.450431 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-637932c3-0693-43ae-b571-9ff0a755736b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:14.451122 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-637932c3-0693-43ae-b571-9ff0a755736b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:14.452111 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-637932c3-0693-43ae-b571-9ff0a755736b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:14.452869 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-637932c3-0693-43ae-b571-9ff0a755736b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:14.453564 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-637932c3-0693-43ae-b571-9ff0a755736b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:14.784038 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-637932c3-0693-43ae-b571-9ff0a755736b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:14.803751 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-637932c3-0693-43ae-b571-9ff0a755736b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:14.821128 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-637932c3-0693-43ae-b571-9ff0a755736b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:14.823143 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-637932c3-0693-43ae-b571-9ff0a755736b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1727 microversion: 2.20 time: 0.390567 Oct 18 15:54:14.824557 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2902/5823] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:54:14 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1727 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:54:15.854685 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-733526bc-987d-4880-8c61-973c57a1a6de tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:54:15.855503 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-733526bc-987d-4880-8c61-973c57a1a6de tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:54:15.872062 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-733526bc-987d-4880-8c61-973c57a1a6de tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:15.878443 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-733526bc-987d-4880-8c61-973c57a1a6de tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:15.879467 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-733526bc-987d-4880-8c61-973c57a1a6de tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:15.882238 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-733526bc-987d-4880-8c61-973c57a1a6de tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:15.884728 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-733526bc-987d-4880-8c61-973c57a1a6de tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:15.889491 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-733526bc-987d-4880-8c61-973c57a1a6de tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:16.766201 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-733526bc-987d-4880-8c61-973c57a1a6de tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:16.801854 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-733526bc-987d-4880-8c61-973c57a1a6de tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:16.810442 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-733526bc-987d-4880-8c61-973c57a1a6de tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:16.815674 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-733526bc-987d-4880-8c61-973c57a1a6de tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1727 microversion: 2.20 time: 0.962794 Oct 18 15:54:16.819154 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2922/5824] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:54:15 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1727 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:54:17.846823 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-17d37a49-a4b6-430d-82a6-6edc9257a92f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:54:17.847437 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-17d37a49-a4b6-430d-82a6-6edc9257a92f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:54:17.866401 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17d37a49-a4b6-430d-82a6-6edc9257a92f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:17.866911 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17d37a49-a4b6-430d-82a6-6edc9257a92f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:17.867360 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17d37a49-a4b6-430d-82a6-6edc9257a92f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:17.868089 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17d37a49-a4b6-430d-82a6-6edc9257a92f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:17.868651 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17d37a49-a4b6-430d-82a6-6edc9257a92f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:17.869148 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17d37a49-a4b6-430d-82a6-6edc9257a92f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:18.892170 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-17d37a49-a4b6-430d-82a6-6edc9257a92f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:18.929602 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-17d37a49-a4b6-430d-82a6-6edc9257a92f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:18.933790 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-17d37a49-a4b6-430d-82a6-6edc9257a92f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:18.939153 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-17d37a49-a4b6-430d-82a6-6edc9257a92f tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1727 microversion: 2.20 time: 1.096823 Oct 18 15:54:18.981286 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2903/5825] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:54:17 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1727 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:54:19.984860 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4186a620-8867-4862-b617-a19d51afe3dc tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:54:19.986786 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4186a620-8867-4862-b617-a19d51afe3dc tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:54:20.004548 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4186a620-8867-4862-b617-a19d51afe3dc tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:20.011173 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4186a620-8867-4862-b617-a19d51afe3dc tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:20.016267 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4186a620-8867-4862-b617-a19d51afe3dc tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:20.021467 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4186a620-8867-4862-b617-a19d51afe3dc tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:20.024048 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4186a620-8867-4862-b617-a19d51afe3dc tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:20.035644 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4186a620-8867-4862-b617-a19d51afe3dc tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:20.456948 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4186a620-8867-4862-b617-a19d51afe3dc tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:20.487974 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4186a620-8867-4862-b617-a19d51afe3dc tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:20.496325 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4186a620-8867-4862-b617-a19d51afe3dc tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:20.501325 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4186a620-8867-4862-b617-a19d51afe3dc tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1727 microversion: 2.20 time: 0.519386 Oct 18 15:54:20.521631 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2923/5826] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:54:19 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1727 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:54:21.534696 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-becf49cd-6984-4350-a997-87fc38f10805 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:54:21.536221 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-becf49cd-6984-4350-a997-87fc38f10805 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:54:21.575702 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-becf49cd-6984-4350-a997-87fc38f10805 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:21.576487 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-becf49cd-6984-4350-a997-87fc38f10805 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:21.577203 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-becf49cd-6984-4350-a997-87fc38f10805 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:21.578181 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-becf49cd-6984-4350-a997-87fc38f10805 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:21.581408 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-becf49cd-6984-4350-a997-87fc38f10805 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:21.583660 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-becf49cd-6984-4350-a997-87fc38f10805 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:22.099179 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-becf49cd-6984-4350-a997-87fc38f10805 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:22.109893 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-becf49cd-6984-4350-a997-87fc38f10805 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:22.116428 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-becf49cd-6984-4350-a997-87fc38f10805 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:22.120783 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-becf49cd-6984-4350-a997-87fc38f10805 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1727 microversion: 2.20 time: 0.592911 Oct 18 15:54:22.121704 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2904/5827] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:54:21 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1727 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:54:23.148583 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7eb28406-2a56-45f7-8a2d-297fb4e1054b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:54:23.150214 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7eb28406-2a56-45f7-8a2d-297fb4e1054b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:54:23.166571 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7eb28406-2a56-45f7-8a2d-297fb4e1054b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:23.167798 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7eb28406-2a56-45f7-8a2d-297fb4e1054b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:23.168672 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7eb28406-2a56-45f7-8a2d-297fb4e1054b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:23.169956 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7eb28406-2a56-45f7-8a2d-297fb4e1054b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:23.170756 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7eb28406-2a56-45f7-8a2d-297fb4e1054b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:23.171630 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7eb28406-2a56-45f7-8a2d-297fb4e1054b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:23.658333 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7eb28406-2a56-45f7-8a2d-297fb4e1054b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:23.678601 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7eb28406-2a56-45f7-8a2d-297fb4e1054b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:23.687541 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7eb28406-2a56-45f7-8a2d-297fb4e1054b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:23.693068 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7eb28406-2a56-45f7-8a2d-297fb4e1054b tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1727 microversion: 2.20 time: 0.550079 Oct 18 15:54:23.695873 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2924/5828] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:54:23 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1727 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:54:24.733510 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8dc9586a-7990-49fe-9608-b5932d69ecdb tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:54:24.734569 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8dc9586a-7990-49fe-9608-b5932d69ecdb tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:54:24.749386 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8dc9586a-7990-49fe-9608-b5932d69ecdb tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:24.749897 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8dc9586a-7990-49fe-9608-b5932d69ecdb tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:24.750341 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8dc9586a-7990-49fe-9608-b5932d69ecdb tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:24.751057 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8dc9586a-7990-49fe-9608-b5932d69ecdb tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:24.751576 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8dc9586a-7990-49fe-9608-b5932d69ecdb tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:24.751927 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8dc9586a-7990-49fe-9608-b5932d69ecdb tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:24.995953 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8dc9586a-7990-49fe-9608-b5932d69ecdb tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:25.028339 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8dc9586a-7990-49fe-9608-b5932d69ecdb tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:25.037446 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8dc9586a-7990-49fe-9608-b5932d69ecdb tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:25.039867 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8dc9586a-7990-49fe-9608-b5932d69ecdb tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1727 microversion: 2.20 time: 0.311272 Oct 18 15:54:25.044111 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2905/5829] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:54:24 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1727 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:54:26.070839 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1c7e6dc5-1e89-419e-ab98-429425f27245 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:54:26.071818 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1c7e6dc5-1e89-419e-ab98-429425f27245 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:54:26.083808 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1c7e6dc5-1e89-419e-ab98-429425f27245 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:26.090566 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1c7e6dc5-1e89-419e-ab98-429425f27245 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:26.091109 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1c7e6dc5-1e89-419e-ab98-429425f27245 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:26.091882 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1c7e6dc5-1e89-419e-ab98-429425f27245 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:26.092353 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1c7e6dc5-1e89-419e-ab98-429425f27245 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:26.093008 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1c7e6dc5-1e89-419e-ab98-429425f27245 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:26.382225 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1c7e6dc5-1e89-419e-ab98-429425f27245 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:26.409789 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1c7e6dc5-1e89-419e-ab98-429425f27245 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:26.415983 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1c7e6dc5-1e89-419e-ab98-429425f27245 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:26.421216 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1c7e6dc5-1e89-419e-ab98-429425f27245 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1727 microversion: 2.20 time: 0.355412 Oct 18 15:54:26.427953 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2925/5830] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:54:26 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1727 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:54:27.461353 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-941411da-bfc7-49cf-97e3-ff847f88bbec tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:54:27.462664 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-941411da-bfc7-49cf-97e3-ff847f88bbec tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:54:27.499915 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-941411da-bfc7-49cf-97e3-ff847f88bbec tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:27.504318 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-941411da-bfc7-49cf-97e3-ff847f88bbec tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:27.504776 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-941411da-bfc7-49cf-97e3-ff847f88bbec tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:27.506307 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-941411da-bfc7-49cf-97e3-ff847f88bbec tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:27.511984 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-941411da-bfc7-49cf-97e3-ff847f88bbec tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:27.513486 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-941411da-bfc7-49cf-97e3-ff847f88bbec tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:27.827991 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-f045f68f-d83c-405a-84cd-867a5012f0cf req-4695a567-e015-4c6b-aafd-256cd221380d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6af51230-78de-43fb-be54-c1b182368139", "name": "network-vif-plugged", "status": "completed", "tag": "e6888c52-692f-4a5c-a3cf-e7018e476bf5"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:54:27.866544 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=82 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:54:27.875113 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-f045f68f-d83c-405a-84cd-867a5012f0cf req-4695a567-e015-4c6b-aafd-256cd221380d service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:27.876049 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-f045f68f-d83c-405a-84cd-867a5012f0cf req-4695a567-e015-4c6b-aafd-256cd221380d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:27.876686 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-f045f68f-d83c-405a-84cd-867a5012f0cf req-4695a567-e015-4c6b-aafd-256cd221380d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:27.910178 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-f045f68f-d83c-405a-84cd-867a5012f0cf req-4695a567-e015-4c6b-aafd-256cd221380d service nova] Creating event network-vif-plugged:e6888c52-692f-4a5c-a3cf-e7018e476bf5 for instance 6af51230-78de-43fb-be54-c1b182368139 on n-h2-853682-5 Oct 18 15:54:27.922605 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-f045f68f-d83c-405a-84cd-867a5012f0cf req-4695a567-e015-4c6b-aafd-256cd221380d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100022 Oct 18 15:54:27.926262 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2926/5831] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:54:28.893363 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-941411da-bfc7-49cf-97e3-ff847f88bbec tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:28.904010 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-941411da-bfc7-49cf-97e3-ff847f88bbec tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:28.911498 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-941411da-bfc7-49cf-97e3-ff847f88bbec tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:28.917505 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-941411da-bfc7-49cf-97e3-ff847f88bbec tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1727 microversion: 2.20 time: 1.465093 Oct 18 15:54:28.919113 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2906/5832] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:54:27 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1727 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:54:29.969782 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-16863248-65f5-4180-9933-6752eec0a4ae tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:54:29.970822 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-16863248-65f5-4180-9933-6752eec0a4ae tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:54:29.995210 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-16863248-65f5-4180-9933-6752eec0a4ae tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:29.997322 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-16863248-65f5-4180-9933-6752eec0a4ae tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:29.997965 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-16863248-65f5-4180-9933-6752eec0a4ae tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:29.998735 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-16863248-65f5-4180-9933-6752eec0a4ae tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:29.999240 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-16863248-65f5-4180-9933-6752eec0a4ae tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:29.999646 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-16863248-65f5-4180-9933-6752eec0a4ae tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:30.337173 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-16863248-65f5-4180-9933-6752eec0a4ae tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:30.348592 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-16863248-65f5-4180-9933-6752eec0a4ae tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:30.350148 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-16863248-65f5-4180-9933-6752eec0a4ae tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:30.356024 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-16863248-65f5-4180-9933-6752eec0a4ae tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1727 microversion: 2.20 time: 0.391374 Oct 18 15:54:30.358037 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2927/5833] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:54:29 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1727 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:54:31.388187 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3b758eaa-fa0a-40a4-b6e7-b03766645085 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:54:31.388832 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3b758eaa-fa0a-40a4-b6e7-b03766645085 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:54:31.415426 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b758eaa-fa0a-40a4-b6e7-b03766645085 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:31.415932 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b758eaa-fa0a-40a4-b6e7-b03766645085 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:31.416383 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b758eaa-fa0a-40a4-b6e7-b03766645085 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:31.417166 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b758eaa-fa0a-40a4-b6e7-b03766645085 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:31.417636 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b758eaa-fa0a-40a4-b6e7-b03766645085 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:31.418069 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b758eaa-fa0a-40a4-b6e7-b03766645085 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:31.898998 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3b758eaa-fa0a-40a4-b6e7-b03766645085 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:31.908274 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3b758eaa-fa0a-40a4-b6e7-b03766645085 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:31.923132 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3b758eaa-fa0a-40a4-b6e7-b03766645085 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:31.924382 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3b758eaa-fa0a-40a4-b6e7-b03766645085 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1727 microversion: 2.20 time: 0.540822 Oct 18 15:54:31.941926 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2907/5834] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:54:31 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1727 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:54:32.970067 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b700328d-72b5-49f2-bbb7-31d87a982ee4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:54:32.972369 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b700328d-72b5-49f2-bbb7-31d87a982ee4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:54:32.987629 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b700328d-72b5-49f2-bbb7-31d87a982ee4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:32.989618 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b700328d-72b5-49f2-bbb7-31d87a982ee4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:32.994007 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b700328d-72b5-49f2-bbb7-31d87a982ee4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:32.998955 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b700328d-72b5-49f2-bbb7-31d87a982ee4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:32.999877 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b700328d-72b5-49f2-bbb7-31d87a982ee4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:33.000851 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b700328d-72b5-49f2-bbb7-31d87a982ee4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:34.042141 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b700328d-72b5-49f2-bbb7-31d87a982ee4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:34.056411 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b700328d-72b5-49f2-bbb7-31d87a982ee4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:34.058641 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b700328d-72b5-49f2-bbb7-31d87a982ee4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:34.059986 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b700328d-72b5-49f2-bbb7-31d87a982ee4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1714 microversion: 2.20 time: 1.094990 Oct 18 15:54:34.061006 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2928/5835] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:54:32 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1714 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:54:47.751047 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:54:47.752581 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=41 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:54:48.238297 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f60fe2dc-93d2-4f8e-b836-ecff6a29e652 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-725387997", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "591d95b8-1683-4239-873c-3902bca76c6d"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:54:48.334149 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-f60fe2dc-93d2-4f8e-b836-ecff6a29e652 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] validate_networks() for [('591d95b8-1683-4239-873c-3902bca76c6d', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:54:48.932918 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-f60fe2dc-93d2-4f8e-b836-ecff6a29e652 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:54:48.933599 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-f60fe2dc-93d2-4f8e-b836-ecff6a29e652 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:54:48.933781 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-f60fe2dc-93d2-4f8e-b836-ecff6a29e652 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:54:48.934532 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-f60fe2dc-93d2-4f8e-b836-ecff6a29e652 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:54:48.935105 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-f60fe2dc-93d2-4f8e-b836-ecff6a29e652 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:54:48.945016 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f60fe2dc-93d2-4f8e-b836-ecff6a29e652 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:48.946600 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f60fe2dc-93d2-4f8e-b836-ecff6a29e652 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:48.947225 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f60fe2dc-93d2-4f8e-b836-ecff6a29e652 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:48.948211 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f60fe2dc-93d2-4f8e-b836-ecff6a29e652 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:48.948675 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f60fe2dc-93d2-4f8e-b836-ecff6a29e652 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:48.949128 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f60fe2dc-93d2-4f8e-b836-ecff6a29e652 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:49.009020 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-f60fe2dc-93d2-4f8e-b836-ecff6a29e652 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Getting quotas for project ec6debdfed5a414a93d822dbe55f74ca. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:54:49.018797 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-f60fe2dc-93d2-4f8e-b836-ecff6a29e652 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Getting quotas for user 3b3a5da005a04f559d3f71cce172f28b and project ec6debdfed5a414a93d822dbe55f74ca. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:54:49.038289 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f60fe2dc-93d2-4f8e-b836-ecff6a29e652 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:54:49.041423 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f60fe2dc-93d2-4f8e-b836-ecff6a29e652 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] [instance: 57181ade-9174-46e3-89f0-e3d59465534f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:54:49.104688 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f60fe2dc-93d2-4f8e-b836-ecff6a29e652 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.368862 Oct 18 15:54:49.105561 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2908/5836] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:54:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1370 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 15:54:49.116902 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2335cdb6-2cca-4314-8ac1-46d649764582 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:54:49.118094 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2335cdb6-2cca-4314-8ac1-46d649764582 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] [instance: 57181ade-9174-46e3-89f0-e3d59465534f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:54:49.122249 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=5 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:54:49.123013 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:RELEASE=1,nova_cell1:SELECT=85,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:54:49.213086 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2335cdb6-2cca-4314-8ac1-46d649764582 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3a5da005a04f559d3f71cce172f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6debdfed5a414a93d822dbe55f74ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:49.221059 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2335cdb6-2cca-4314-8ac1-46d649764582 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] 10.222.0.60 "GET /compute/v2.1/servers/57181ade-9174-46e3-89f0-e3d59465534f" status: 200 len: 1227 microversion: 2.1 time: 0.108134 Oct 18 15:54:49.221966 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2929/5837] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:54:49 2022] GET /compute/v2.1/servers/57181ade-9174-46e3-89f0-e3d59465534f => generated 1227 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:54:50.246802 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0eac711d-c5c6-4cc2-91ae-0b5a098cf64b tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:54:50.248101 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0eac711d-c5c6-4cc2-91ae-0b5a098cf64b tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] [instance: 57181ade-9174-46e3-89f0-e3d59465534f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:54:50.370876 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0eac711d-c5c6-4cc2-91ae-0b5a098cf64b tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3a5da005a04f559d3f71cce172f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6debdfed5a414a93d822dbe55f74ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:50.383475 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0eac711d-c5c6-4cc2-91ae-0b5a098cf64b tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] 10.222.0.60 "GET /compute/v2.1/servers/57181ade-9174-46e3-89f0-e3d59465534f" status: 200 len: 1227 microversion: 2.1 time: 0.141330 Oct 18 15:54:50.385959 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2909/5838] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:54:50 2022] GET /compute/v2.1/servers/57181ade-9174-46e3-89f0-e3d59465534f => generated 1227 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:54:51.409158 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-66c6f5e9-8661-48a1-be18-d26ec5355a3f tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:54:51.409939 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-66c6f5e9-8661-48a1-be18-d26ec5355a3f tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] [instance: 57181ade-9174-46e3-89f0-e3d59465534f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:54:51.426599 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-66c6f5e9-8661-48a1-be18-d26ec5355a3f tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:51.428995 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-66c6f5e9-8661-48a1-be18-d26ec5355a3f tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:51.430056 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-66c6f5e9-8661-48a1-be18-d26ec5355a3f tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:51.431333 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-66c6f5e9-8661-48a1-be18-d26ec5355a3f tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:51.431808 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-66c6f5e9-8661-48a1-be18-d26ec5355a3f tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:51.432256 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-66c6f5e9-8661-48a1-be18-d26ec5355a3f tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:51.571953 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-66c6f5e9-8661-48a1-be18-d26ec5355a3f tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3a5da005a04f559d3f71cce172f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6debdfed5a414a93d822dbe55f74ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:51.580488 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-66c6f5e9-8661-48a1-be18-d26ec5355a3f tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] 10.222.0.60 "GET /compute/v2.1/servers/57181ade-9174-46e3-89f0-e3d59465534f" status: 200 len: 1279 microversion: 2.1 time: 0.175367 Oct 18 15:54:51.584955 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2930/5839] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:54:51 2022] GET /compute/v2.1/servers/57181ade-9174-46e3-89f0-e3d59465534f => generated 1279 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:54:52.607700 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b74c2111-7356-4ee8-85ab-0980c068fe43 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:54:52.608338 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b74c2111-7356-4ee8-85ab-0980c068fe43 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] [instance: 57181ade-9174-46e3-89f0-e3d59465534f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:54:52.641271 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b74c2111-7356-4ee8-85ab-0980c068fe43 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:52.641776 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b74c2111-7356-4ee8-85ab-0980c068fe43 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:52.642222 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b74c2111-7356-4ee8-85ab-0980c068fe43 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:52.645908 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b74c2111-7356-4ee8-85ab-0980c068fe43 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:52.646960 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b74c2111-7356-4ee8-85ab-0980c068fe43 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:52.646960 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b74c2111-7356-4ee8-85ab-0980c068fe43 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:52.873804 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b74c2111-7356-4ee8-85ab-0980c068fe43 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3a5da005a04f559d3f71cce172f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6debdfed5a414a93d822dbe55f74ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:52.886051 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b74c2111-7356-4ee8-85ab-0980c068fe43 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] 10.222.0.60 "GET /compute/v2.1/servers/57181ade-9174-46e3-89f0-e3d59465534f" status: 200 len: 1285 microversion: 2.1 time: 0.282993 Oct 18 15:54:52.890019 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2910/5840] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:54:52 2022] GET /compute/v2.1/servers/57181ade-9174-46e3-89f0-e3d59465534f => generated 1285 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:54:53.916570 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-588eed09-4b05-4d08-8b73-4a3e3d965922 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:54:53.917393 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-588eed09-4b05-4d08-8b73-4a3e3d965922 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] [instance: 57181ade-9174-46e3-89f0-e3d59465534f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:54:53.933323 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-588eed09-4b05-4d08-8b73-4a3e3d965922 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:53.939816 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-588eed09-4b05-4d08-8b73-4a3e3d965922 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:53.946726 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-588eed09-4b05-4d08-8b73-4a3e3d965922 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:53.947846 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-588eed09-4b05-4d08-8b73-4a3e3d965922 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:53.953283 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-588eed09-4b05-4d08-8b73-4a3e3d965922 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:53.953989 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-588eed09-4b05-4d08-8b73-4a3e3d965922 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:55.098978 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-588eed09-4b05-4d08-8b73-4a3e3d965922 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3a5da005a04f559d3f71cce172f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6debdfed5a414a93d822dbe55f74ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:55.107252 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-588eed09-4b05-4d08-8b73-4a3e3d965922 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] 10.222.0.60 "GET /compute/v2.1/servers/57181ade-9174-46e3-89f0-e3d59465534f" status: 200 len: 1327 microversion: 2.1 time: 1.195539 Oct 18 15:54:55.107861 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2931/5841] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:54:53 2022] GET /compute/v2.1/servers/57181ade-9174-46e3-89f0-e3d59465534f => generated 1327 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:54:56.138835 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eebcdbb9-16b3-4e35-8ae5-f4c9a39a7276 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:54:56.143215 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-eebcdbb9-16b3-4e35-8ae5-f4c9a39a7276 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] [instance: 57181ade-9174-46e3-89f0-e3d59465534f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:54:56.217524 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eebcdbb9-16b3-4e35-8ae5-f4c9a39a7276 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:56.234901 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eebcdbb9-16b3-4e35-8ae5-f4c9a39a7276 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:56.236116 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eebcdbb9-16b3-4e35-8ae5-f4c9a39a7276 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:56.237801 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eebcdbb9-16b3-4e35-8ae5-f4c9a39a7276 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:56.245058 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eebcdbb9-16b3-4e35-8ae5-f4c9a39a7276 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:56.255288 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eebcdbb9-16b3-4e35-8ae5-f4c9a39a7276 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:57.363716 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-eebcdbb9-16b3-4e35-8ae5-f4c9a39a7276 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3a5da005a04f559d3f71cce172f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6debdfed5a414a93d822dbe55f74ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:57.374398 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-eebcdbb9-16b3-4e35-8ae5-f4c9a39a7276 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] 10.222.0.60 "GET /compute/v2.1/servers/57181ade-9174-46e3-89f0-e3d59465534f" status: 200 len: 1327 microversion: 2.1 time: 1.243563 Oct 18 15:54:57.375235 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2911/5842] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:54:56 2022] GET /compute/v2.1/servers/57181ade-9174-46e3-89f0-e3d59465534f => generated 1327 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:54:58.407658 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ce34cdd9-bf0b-4778-af79-987c7f092fca tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:54:58.408341 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ce34cdd9-bf0b-4778-af79-987c7f092fca tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] [instance: 57181ade-9174-46e3-89f0-e3d59465534f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:54:58.422115 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ce34cdd9-bf0b-4778-af79-987c7f092fca tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:58.422945 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ce34cdd9-bf0b-4778-af79-987c7f092fca tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:58.423610 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ce34cdd9-bf0b-4778-af79-987c7f092fca tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:58.424557 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ce34cdd9-bf0b-4778-af79-987c7f092fca tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:58.425260 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ce34cdd9-bf0b-4778-af79-987c7f092fca tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:58.429531 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ce34cdd9-bf0b-4778-af79-987c7f092fca tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:58.510193 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-ad65080d-9f9c-4a11-b366-a4d6ba2780e4 req-cb4c1bc1-2469-4e5c-ba33-c3db758aa34f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57181ade-9174-46e3-89f0-e3d59465534f", "tag": "f8f4eeba-bafe-472b-aa0f-91ab0ee85fbc"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:54:58.526476 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ad65080d-9f9c-4a11-b366-a4d6ba2780e4 req-cb4c1bc1-2469-4e5c-ba33-c3db758aa34f service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:54:58.533017 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ad65080d-9f9c-4a11-b366-a4d6ba2780e4 req-cb4c1bc1-2469-4e5c-ba33-c3db758aa34f service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:54:58.533751 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ad65080d-9f9c-4a11-b366-a4d6ba2780e4 req-cb4c1bc1-2469-4e5c-ba33-c3db758aa34f service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:54:58.558407 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-ad65080d-9f9c-4a11-b366-a4d6ba2780e4 req-cb4c1bc1-2469-4e5c-ba33-c3db758aa34f service nova] Creating event network-changed:f8f4eeba-bafe-472b-aa0f-91ab0ee85fbc for instance 57181ade-9174-46e3-89f0-e3d59465534f on n-h1-853682-5 Oct 18 15:54:58.571042 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-ad65080d-9f9c-4a11-b366-a4d6ba2780e4 req-cb4c1bc1-2469-4e5c-ba33-c3db758aa34f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064933 Oct 18 15:54:58.572280 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2912/5843] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:54:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:54:59.222855 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:54:59.231775 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ce34cdd9-bf0b-4778-af79-987c7f092fca tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3a5da005a04f559d3f71cce172f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6debdfed5a414a93d822dbe55f74ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:54:59.255375 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ce34cdd9-bf0b-4778-af79-987c7f092fca tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] 10.222.0.60 "GET /compute/v2.1/servers/57181ade-9174-46e3-89f0-e3d59465534f" status: 200 len: 1327 microversion: 2.1 time: 0.851536 Oct 18 15:54:59.271322 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2932/5844] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:54:58 2022] GET /compute/v2.1/servers/57181ade-9174-46e3-89f0-e3d59465534f => generated 1327 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:55:00.294152 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:55:00.300616 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d6e67859-9370-42dd-b298-6210f554f6ce tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:55:00.301391 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d6e67859-9370-42dd-b298-6210f554f6ce tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] [instance: 57181ade-9174-46e3-89f0-e3d59465534f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:55:00.323730 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d6e67859-9370-42dd-b298-6210f554f6ce tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:55:00.324240 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d6e67859-9370-42dd-b298-6210f554f6ce tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:55:00.324690 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d6e67859-9370-42dd-b298-6210f554f6ce tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:55:00.325482 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d6e67859-9370-42dd-b298-6210f554f6ce tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:55:00.325948 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d6e67859-9370-42dd-b298-6210f554f6ce tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:55:00.326387 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d6e67859-9370-42dd-b298-6210f554f6ce tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:55:00.380493 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=8 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:55:00.801330 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d6e67859-9370-42dd-b298-6210f554f6ce tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3a5da005a04f559d3f71cce172f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6debdfed5a414a93d822dbe55f74ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:55:00.816363 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d6e67859-9370-42dd-b298-6210f554f6ce tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] 10.222.0.60 "GET /compute/v2.1/servers/57181ade-9174-46e3-89f0-e3d59465534f" status: 200 len: 1327 microversion: 2.1 time: 0.523117 Oct 18 15:55:00.839477 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2913/5845] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:55:00 2022] GET /compute/v2.1/servers/57181ade-9174-46e3-89f0-e3d59465534f => generated 1327 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:55:01.842813 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e5114477-db66-46e8-9ca0-6ba4ac043a47 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:55:01.843435 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e5114477-db66-46e8-9ca0-6ba4ac043a47 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] [instance: 57181ade-9174-46e3-89f0-e3d59465534f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:55:01.859042 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e5114477-db66-46e8-9ca0-6ba4ac043a47 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:55:01.859822 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e5114477-db66-46e8-9ca0-6ba4ac043a47 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:55:01.861136 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e5114477-db66-46e8-9ca0-6ba4ac043a47 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:55:01.862030 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e5114477-db66-46e8-9ca0-6ba4ac043a47 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:55:01.865435 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e5114477-db66-46e8-9ca0-6ba4ac043a47 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:55:01.866401 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e5114477-db66-46e8-9ca0-6ba4ac043a47 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:55:02.345407 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e5114477-db66-46e8-9ca0-6ba4ac043a47 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3a5da005a04f559d3f71cce172f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6debdfed5a414a93d822dbe55f74ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:55:02.383404 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e5114477-db66-46e8-9ca0-6ba4ac043a47 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] 10.222.0.60 "GET /compute/v2.1/servers/57181ade-9174-46e3-89f0-e3d59465534f" status: 200 len: 1327 microversion: 2.1 time: 0.542977 Oct 18 15:55:02.400984 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2933/5846] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:55:01 2022] GET /compute/v2.1/servers/57181ade-9174-46e3-89f0-e3d59465534f => generated 1327 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:55:03.408760 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2426a654-256b-448b-a238-9f8bfaece575 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:55:03.409423 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2426a654-256b-448b-a238-9f8bfaece575 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] [instance: 57181ade-9174-46e3-89f0-e3d59465534f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:55:03.426902 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2426a654-256b-448b-a238-9f8bfaece575 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:55:03.427408 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2426a654-256b-448b-a238-9f8bfaece575 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:55:03.427854 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2426a654-256b-448b-a238-9f8bfaece575 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:55:03.428588 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2426a654-256b-448b-a238-9f8bfaece575 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:55:03.429674 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2426a654-256b-448b-a238-9f8bfaece575 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:55:03.430111 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2426a654-256b-448b-a238-9f8bfaece575 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:55:03.738868 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2426a654-256b-448b-a238-9f8bfaece575 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3a5da005a04f559d3f71cce172f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6debdfed5a414a93d822dbe55f74ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:55:03.748129 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2426a654-256b-448b-a238-9f8bfaece575 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] 10.222.0.60 "GET /compute/v2.1/servers/57181ade-9174-46e3-89f0-e3d59465534f" status: 200 len: 1327 microversion: 2.1 time: 0.343140 Oct 18 15:55:03.763550 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2914/5847] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:55:03 2022] GET /compute/v2.1/servers/57181ade-9174-46e3-89f0-e3d59465534f => generated 1327 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:55:03.825821 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e12a5fb6-941d-47ba-8a68-5291ae016a31 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:55:03.828976 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e12a5fb6-941d-47ba-8a68-5291ae016a31 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:55:03.849789 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e12a5fb6-941d-47ba-8a68-5291ae016a31 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:55:03.861457 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e12a5fb6-941d-47ba-8a68-5291ae016a31 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:55:03.866240 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e12a5fb6-941d-47ba-8a68-5291ae016a31 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:55:03.867478 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e12a5fb6-941d-47ba-8a68-5291ae016a31 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:55:03.869500 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e12a5fb6-941d-47ba-8a68-5291ae016a31 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:55:03.870765 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e12a5fb6-941d-47ba-8a68-5291ae016a31 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:55:03.997938 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e12a5fb6-941d-47ba-8a68-5291ae016a31 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.177779 Oct 18 15:55:04.002062 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2934/5848] 10.222.0.60 () {60 vars in 1343 bytes} [Tue Oct 18 15:55:03 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139/os-volume_attachments => generated 25 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:55:04.136980 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-264925c8-c567-4c7b-9d61-2d812ed41149 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:55:04.137824 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-264925c8-c567-4c7b-9d61-2d812ed41149 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:55:04.154772 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-264925c8-c567-4c7b-9d61-2d812ed41149 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:55:04.155660 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-264925c8-c567-4c7b-9d61-2d812ed41149 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:55:04.156378 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-264925c8-c567-4c7b-9d61-2d812ed41149 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:55:04.157342 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-264925c8-c567-4c7b-9d61-2d812ed41149 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:55:04.165531 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-264925c8-c567-4c7b-9d61-2d812ed41149 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:55:04.166307 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-264925c8-c567-4c7b-9d61-2d812ed41149 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:55:04.221716 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-264925c8-c567-4c7b-9d61-2d812ed41149 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:55:04.493564 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-264925c8-c567-4c7b-9d61-2d812ed41149 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 204 len: 0 microversion: 2.20 time: 0.356730 Oct 18 15:55:04.500053 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2915/5849] 10.222.0.60 () {60 vars in 1280 bytes} [Tue Oct 18 15:55:04 2022] DELETE /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 15:55:04.512603 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-dc9bd50a-bbe1-4e21-af0e-df1539cc3754 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:55:04.513549 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-dc9bd50a-bbe1-4e21-af0e-df1539cc3754 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:55:04.545491 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dc9bd50a-bbe1-4e21-af0e-df1539cc3754 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:55:04.549513 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dc9bd50a-bbe1-4e21-af0e-df1539cc3754 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:55:04.551156 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dc9bd50a-bbe1-4e21-af0e-df1539cc3754 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:55:04.556715 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dc9bd50a-bbe1-4e21-af0e-df1539cc3754 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:55:04.562455 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dc9bd50a-bbe1-4e21-af0e-df1539cc3754 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:55:04.563553 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dc9bd50a-bbe1-4e21-af0e-df1539cc3754 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:55:04.773319 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-32e027fc-bccd-4408-9058-a9f66f35bc0f tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:55:04.775334 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-32e027fc-bccd-4408-9058-a9f66f35bc0f tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] [instance: 57181ade-9174-46e3-89f0-e3d59465534f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:55:04.812692 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32e027fc-bccd-4408-9058-a9f66f35bc0f tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:55:04.813232 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32e027fc-bccd-4408-9058-a9f66f35bc0f tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:55:04.818398 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32e027fc-bccd-4408-9058-a9f66f35bc0f tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:55:04.822586 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32e027fc-bccd-4408-9058-a9f66f35bc0f tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:55:04.823604 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32e027fc-bccd-4408-9058-a9f66f35bc0f tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:55:04.830365 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32e027fc-bccd-4408-9058-a9f66f35bc0f tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:55:04.965166 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-dc9bd50a-bbe1-4e21-af0e-df1539cc3754 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:55:04.979772 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-dc9bd50a-bbe1-4e21-af0e-df1539cc3754 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:55:04.981247 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-dc9bd50a-bbe1-4e21-af0e-df1539cc3754 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:55:04.982542 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-dc9bd50a-bbe1-4e21-af0e-df1539cc3754 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1720 microversion: 2.20 time: 0.476857 Oct 18 15:55:04.983089 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2935/5850] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:55:04 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1720 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:55:05.269030 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-32e027fc-bccd-4408-9058-a9f66f35bc0f tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3a5da005a04f559d3f71cce172f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6debdfed5a414a93d822dbe55f74ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:55:05.287277 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-32e027fc-bccd-4408-9058-a9f66f35bc0f tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] 10.222.0.60 "GET /compute/v2.1/servers/57181ade-9174-46e3-89f0-e3d59465534f" status: 200 len: 1327 microversion: 2.1 time: 0.515549 Oct 18 15:55:05.290672 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2916/5851] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:55:04 2022] GET /compute/v2.1/servers/57181ade-9174-46e3-89f0-e3d59465534f => generated 1327 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:55:06.016515 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b6eff34f-b4f2-4832-91cb-18608cf3fb24 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:55:06.017853 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b6eff34f-b4f2-4832-91cb-18608cf3fb24 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:55:06.041341 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b6eff34f-b4f2-4832-91cb-18608cf3fb24 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:55:06.041855 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b6eff34f-b4f2-4832-91cb-18608cf3fb24 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:55:06.043786 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b6eff34f-b4f2-4832-91cb-18608cf3fb24 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:55:06.044701 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b6eff34f-b4f2-4832-91cb-18608cf3fb24 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:55:06.046209 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b6eff34f-b4f2-4832-91cb-18608cf3fb24 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:55:06.047039 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b6eff34f-b4f2-4832-91cb-18608cf3fb24 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:55:06.316305 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c81dedac-6b33-44ee-adea-cfa8c8a1cca2 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:55:06.317040 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c81dedac-6b33-44ee-adea-cfa8c8a1cca2 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] [instance: 57181ade-9174-46e3-89f0-e3d59465534f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:55:06.342566 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c81dedac-6b33-44ee-adea-cfa8c8a1cca2 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:55:06.345743 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c81dedac-6b33-44ee-adea-cfa8c8a1cca2 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:55:06.346913 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c81dedac-6b33-44ee-adea-cfa8c8a1cca2 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:55:06.348802 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c81dedac-6b33-44ee-adea-cfa8c8a1cca2 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:55:06.350326 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c81dedac-6b33-44ee-adea-cfa8c8a1cca2 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:55:06.350681 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c81dedac-6b33-44ee-adea-cfa8c8a1cca2 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:55:07.479223 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b6eff34f-b4f2-4832-91cb-18608cf3fb24 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:55:07.503709 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b6eff34f-b4f2-4832-91cb-18608cf3fb24 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:55:07.505567 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b6eff34f-b4f2-4832-91cb-18608cf3fb24 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:55:07.506825 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b6eff34f-b4f2-4832-91cb-18608cf3fb24 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1720 microversion: 2.20 time: 1.495199 Oct 18 15:55:07.507468 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2936/5852] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:55:06 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1720 bytes in 1496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:55:07.527088 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-7f491626-9d79-4d3b-89e3-e015634fd968 req-b3b1010c-54ef-4676-8f0e-777f004cf613 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57181ade-9174-46e3-89f0-e3d59465534f", "name": "network-vif-plugged", "status": "completed", "tag": "f8f4eeba-bafe-472b-aa0f-91ab0ee85fbc"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:55:07.566308 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-7f491626-9d79-4d3b-89e3-e015634fd968 req-b3b1010c-54ef-4676-8f0e-777f004cf613 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:55:07.569933 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-7f491626-9d79-4d3b-89e3-e015634fd968 req-b3b1010c-54ef-4676-8f0e-777f004cf613 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:55:07.573960 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-7f491626-9d79-4d3b-89e3-e015634fd968 req-b3b1010c-54ef-4676-8f0e-777f004cf613 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:55:07.602789 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-7f491626-9d79-4d3b-89e3-e015634fd968 req-b3b1010c-54ef-4676-8f0e-777f004cf613 service nova] Creating event network-vif-plugged:f8f4eeba-bafe-472b-aa0f-91ab0ee85fbc for instance 57181ade-9174-46e3-89f0-e3d59465534f on n-h1-853682-5 Oct 18 15:55:07.616080 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-7f491626-9d79-4d3b-89e3-e015634fd968 req-b3b1010c-54ef-4676-8f0e-777f004cf613 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102683 Oct 18 15:55:07.616862 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2937/5853] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:55:07.722162 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c81dedac-6b33-44ee-adea-cfa8c8a1cca2 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3a5da005a04f559d3f71cce172f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6debdfed5a414a93d822dbe55f74ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:55:07.742769 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c81dedac-6b33-44ee-adea-cfa8c8a1cca2 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] 10.222.0.60 "GET /compute/v2.1/servers/57181ade-9174-46e3-89f0-e3d59465534f" status: 200 len: 1327 microversion: 2.1 time: 1.433907 Oct 18 15:55:07.745966 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2917/5854] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:55:06 2022] GET /compute/v2.1/servers/57181ade-9174-46e3-89f0-e3d59465534f => generated 1327 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:55:08.534377 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-03471279-f871-4a11-b61b-bf49a498c410 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:55:08.535087 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-03471279-f871-4a11-b61b-bf49a498c410 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:55:08.559960 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-03471279-f871-4a11-b61b-bf49a498c410 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:55:08.560535 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-03471279-f871-4a11-b61b-bf49a498c410 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:55:08.561065 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-03471279-f871-4a11-b61b-bf49a498c410 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:55:08.564689 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-03471279-f871-4a11-b61b-bf49a498c410 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:55:08.565276 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-03471279-f871-4a11-b61b-bf49a498c410 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:55:08.565723 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-03471279-f871-4a11-b61b-bf49a498c410 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:55:08.778112 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f45510ef-da7a-48c1-a4b7-8a8a9988cfef tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:55:08.778947 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f45510ef-da7a-48c1-a4b7-8a8a9988cfef tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] [instance: 57181ade-9174-46e3-89f0-e3d59465534f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:55:08.799602 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f45510ef-da7a-48c1-a4b7-8a8a9988cfef tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:55:08.799782 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f45510ef-da7a-48c1-a4b7-8a8a9988cfef tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:55:08.802485 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f45510ef-da7a-48c1-a4b7-8a8a9988cfef tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:55:08.807013 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f45510ef-da7a-48c1-a4b7-8a8a9988cfef tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:55:08.809844 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f45510ef-da7a-48c1-a4b7-8a8a9988cfef tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:55:08.810693 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f45510ef-da7a-48c1-a4b7-8a8a9988cfef tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:55:09.057824 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-03471279-f871-4a11-b61b-bf49a498c410 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:55:09.072613 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-03471279-f871-4a11-b61b-bf49a498c410 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:55:09.089716 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-03471279-f871-4a11-b61b-bf49a498c410 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7f068c2e39541fb8d82265702a3179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4cd8880d3b47ad9098b2097c0563a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:55:09.113287 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-03471279-f871-4a11-b61b-bf49a498c410 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 200 len: 1652 microversion: 2.20 time: 0.564241 Oct 18 15:55:09.125171 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2938/5855] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:55:08 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 1652 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 15:55:09.315303 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-cac32a87-e8ca-4f34-9bca-0122571992b1 req-cd6ddf37-e93b-4238-ba69-e5c172152fbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6af51230-78de-43fb-be54-c1b182368139", "name": "network-vif-deleted", "tag": "e6888c52-692f-4a5c-a3cf-e7018e476bf5"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:55:09.329175 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-cac32a87-e8ca-4f34-9bca-0122571992b1 req-cd6ddf37-e93b-4238-ba69-e5c172152fbc service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:55:09.330085 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-cac32a87-e8ca-4f34-9bca-0122571992b1 req-cd6ddf37-e93b-4238-ba69-e5c172152fbc service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:55:09.330850 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-cac32a87-e8ca-4f34-9bca-0122571992b1 req-cd6ddf37-e93b-4238-ba69-e5c172152fbc service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:55:09.344150 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-cac32a87-e8ca-4f34-9bca-0122571992b1 req-cd6ddf37-e93b-4238-ba69-e5c172152fbc service nova] Creating event network-vif-deleted:e6888c52-692f-4a5c-a3cf-e7018e476bf5 for instance 6af51230-78de-43fb-be54-c1b182368139 on n-h2-853682-5 Oct 18 15:55:09.352498 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-cac32a87-e8ca-4f34-9bca-0122571992b1 req-cd6ddf37-e93b-4238-ba69-e5c172152fbc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041062 Oct 18 15:55:09.354086 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2939/5856] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:55:10.144983 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a550cb93-3602-43f1-a190-dcf8e118f8e4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:55:10.148134 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a550cb93-3602-43f1-a190-dcf8e118f8e4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:55:10.162158 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a550cb93-3602-43f1-a190-dcf8e118f8e4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:55:10.166618 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a550cb93-3602-43f1-a190-dcf8e118f8e4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:55:10.167240 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a550cb93-3602-43f1-a190-dcf8e118f8e4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:55:10.168146 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a550cb93-3602-43f1-a190-dcf8e118f8e4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:55:10.168783 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a550cb93-3602-43f1-a190-dcf8e118f8e4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:55:10.169499 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a550cb93-3602-43f1-a190-dcf8e118f8e4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:55:10.184881 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-a550cb93-3602-43f1-a190-dcf8e118f8e4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] HTTP exception thrown: Instance 6af51230-78de-43fb-be54-c1b182368139 could not be found. Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a550cb93-3602-43f1-a190-dcf8e118f8e4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Request method failure captured: Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 HTTP/1.1 Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsqYDHglXRrKKDfqs5wbB85aL1IgsbKNF1z6Sqn3ConJiRPpx0UNXPU9GBcVgVIVA6Cv0KVW_QZkVxEQzEhdvRXaHfIXystMZjHnbqDb3MGXqIMBIAb_BfqWpNNsmkNwvE0YKpE5VnVYMQHyS_V0VqjFt3xFH_oEjIPB2-nD9wOWCxY Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: X-Openstack-Nova-Api-Version: 2.20 Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 2e4cd8880d3b47ad9098b2097c0563a2 Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-778019649 Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2e4cd8880d3b47ad9098b2097c0563a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2e4cd8880d3b47ad9098b2097c0563a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2e4cd8880d3b47ad9098b2097c0563a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2e4cd8880d3b47ad9098b2097c0563a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-AttachVolumeShelveTestJSON-778019649 Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 2e4cd8880d3b47ad9098b2097c0563a2 Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-778019649 Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-AttachVolumeShelveTestJSON-778019649-project Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: e7f068c2e39541fb8d82265702a3179a Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-AttachVolumeShelveTestJSON-778019649-project Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 6af51230-78de-43fb-be54-c1b182368139 could not be found. Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '6af51230-78de-43fb-be54-c1b182368139'} Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6af51230-78de-43fb-be54-c1b182368139 could not be found. Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6af51230-78de-43fb-be54-c1b182368139 could not be found. Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:55:10.186989 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:55:10.192947 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:55:10.192947 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:55:10.192947 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:55:10.192947 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:55:10.192947 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:55:10.192947 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:55:10.192947 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6af51230-78de-43fb-be54-c1b182368139 could not be found. Oct 18 15:55:10.192947 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:55:10.192947 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a550cb93-3602-43f1-a190-dcf8e118f8e4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Returning 404 to user: Instance 6af51230-78de-43fb-be54-c1b182368139 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:55:10.192947 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a550cb93-3602-43f1-a190-dcf8e118f8e4 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 404 len: 111 microversion: 2.20 time: 0.048036 Oct 18 15:55:10.192947 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2940/5857] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:55:10 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 18 15:55:10.198226 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f45510ef-da7a-48c1-a4b7-8a8a9988cfef tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3a5da005a04f559d3f71cce172f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6debdfed5a414a93d822dbe55f74ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:55:10.206163 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f45510ef-da7a-48c1-a4b7-8a8a9988cfef tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] 10.222.0.60 "GET /compute/v2.1/servers/57181ade-9174-46e3-89f0-e3d59465534f" status: 200 len: 1327 microversion: 2.1 time: 1.431883 Oct 18 15:55:10.206762 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2918/5858] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:55:08 2022] GET /compute/v2.1/servers/57181ade-9174-46e3-89f0-e3d59465534f => generated 1327 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:55:10.226527 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9bc57c35-7b45-424a-b0b8-f8a8d7efeadc tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '.version_select at 0x7f7c416c4b80>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:55:10.263654 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9bc57c35-7b45-424a-b0b8-f8a8d7efeadc tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1331664841" status: 204 len: 0 microversion: 2.20 time: 0.069630 Oct 18 15:55:10.264643 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2941/5859] 10.222.0.60 () {60 vars in 1262 bytes} [Tue Oct 18 15:55:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1331664841 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 15:55:11.234704 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6efaf82b-39c3-4308-bc01-f798e879afe6 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:55:11.235973 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6efaf82b-39c3-4308-bc01-f798e879afe6 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] [instance: 57181ade-9174-46e3-89f0-e3d59465534f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:55:11.249280 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6efaf82b-39c3-4308-bc01-f798e879afe6 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:55:11.250117 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6efaf82b-39c3-4308-bc01-f798e879afe6 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:55:11.250735 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6efaf82b-39c3-4308-bc01-f798e879afe6 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:55:11.252603 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6efaf82b-39c3-4308-bc01-f798e879afe6 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:55:11.255355 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6efaf82b-39c3-4308-bc01-f798e879afe6 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:55:11.255998 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6efaf82b-39c3-4308-bc01-f798e879afe6 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:55:11.561439 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6efaf82b-39c3-4308-bc01-f798e879afe6 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3a5da005a04f559d3f71cce172f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6debdfed5a414a93d822dbe55f74ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:55:11.586199 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6efaf82b-39c3-4308-bc01-f798e879afe6 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] 10.222.0.60 "GET /compute/v2.1/servers/57181ade-9174-46e3-89f0-e3d59465534f" status: 200 len: 1526 microversion: 2.1 time: 0.352621 Oct 18 15:55:11.604749 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2919/5860] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:55:11 2022] GET /compute/v2.1/servers/57181ade-9174-46e3-89f0-e3d59465534f => generated 1526 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:55:11.620759 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3790660f-a47a-4f55-9e06-6eee9af86579 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:55:11.623083 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3790660f-a47a-4f55-9e06-6eee9af86579 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] [instance: 57181ade-9174-46e3-89f0-e3d59465534f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:55:11.651827 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3790660f-a47a-4f55-9e06-6eee9af86579 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:55:11.652359 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3790660f-a47a-4f55-9e06-6eee9af86579 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:55:11.657427 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3790660f-a47a-4f55-9e06-6eee9af86579 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:55:11.658239 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3790660f-a47a-4f55-9e06-6eee9af86579 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:55:11.662180 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3790660f-a47a-4f55-9e06-6eee9af86579 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:55:11.665267 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3790660f-a47a-4f55-9e06-6eee9af86579 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:55:12.145647 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3790660f-a47a-4f55-9e06-6eee9af86579 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3a5da005a04f559d3f71cce172f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6debdfed5a414a93d822dbe55f74ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:55:12.158777 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3790660f-a47a-4f55-9e06-6eee9af86579 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] 10.222.0.60 "GET /compute/v2.1/servers/57181ade-9174-46e3-89f0-e3d59465534f" status: 200 len: 1526 microversion: 2.1 time: 0.542993 Oct 18 15:55:12.197443 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2942/5861] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:55:11 2022] GET /compute/v2.1/servers/57181ade-9174-46e3-89f0-e3d59465534f => generated 1526 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:55:12.834763 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-23f12e63-6cde-4640-b6d2-fba4102188dc tempest-ServersNegativeTestMultiTenantJSON-495059859 tempest-ServersNegativeTestMultiTenantJSON-495059859-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:55:12.836406 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-23f12e63-6cde-4640-b6d2-fba4102188dc tempest-ServersNegativeTestMultiTenantJSON-495059859 tempest-ServersNegativeTestMultiTenantJSON-495059859-project] [instance: 57181ade-9174-46e3-89f0-e3d59465534f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:55:12.844280 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23f12e63-6cde-4640-b6d2-fba4102188dc tempest-ServersNegativeTestMultiTenantJSON-495059859 tempest-ServersNegativeTestMultiTenantJSON-495059859-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:55:12.849565 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23f12e63-6cde-4640-b6d2-fba4102188dc tempest-ServersNegativeTestMultiTenantJSON-495059859 tempest-ServersNegativeTestMultiTenantJSON-495059859-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:55:12.850216 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23f12e63-6cde-4640-b6d2-fba4102188dc tempest-ServersNegativeTestMultiTenantJSON-495059859 tempest-ServersNegativeTestMultiTenantJSON-495059859-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:55:12.851757 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23f12e63-6cde-4640-b6d2-fba4102188dc tempest-ServersNegativeTestMultiTenantJSON-495059859 tempest-ServersNegativeTestMultiTenantJSON-495059859-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:55:12.853354 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23f12e63-6cde-4640-b6d2-fba4102188dc tempest-ServersNegativeTestMultiTenantJSON-495059859 tempest-ServersNegativeTestMultiTenantJSON-495059859-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:55:12.855648 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23f12e63-6cde-4640-b6d2-fba4102188dc tempest-ServersNegativeTestMultiTenantJSON-495059859 tempest-ServersNegativeTestMultiTenantJSON-495059859-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:55:12.894205 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-23f12e63-6cde-4640-b6d2-fba4102188dc tempest-ServersNegativeTestMultiTenantJSON-495059859 tempest-ServersNegativeTestMultiTenantJSON-495059859-project] HTTP exception thrown: Instance 57181ade-9174-46e3-89f0-e3d59465534f could not be found. Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-23f12e63-6cde-4640-b6d2-fba4102188dc tempest-ServersNegativeTestMultiTenantJSON-495059859 tempest-ServersNegativeTestMultiTenantJSON-495059859-project] Request method failure captured: Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/57181ade-9174-46e3-89f0-e3d59465534f HTTP/1.1 Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsxHFzuSC-wbq0kMvnxoqO6-oh9ybkT3Cok2mk29JaYIFlOqN7x2Ru8K6o1RbpwNUBKC3mb2LbOVYta5r9pgHz1egyL-2iIIvK5G4OKAWRJnxkrVDfB23uh3C6zyrF0JKT16FiA0UtPZcsauraJ5k-lYBPGVGJu-ZitxLsRCGLLZfRM Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: b967a788fc984faa883f36384d5ed1c7 Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-495059859 Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b967a788fc984faa883f36384d5ed1c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b967a788fc984faa883f36384d5ed1c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b967a788fc984faa883f36384d5ed1c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b967a788fc984faa883f36384d5ed1c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-495059859 Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: b967a788fc984faa883f36384d5ed1c7 Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-495059859 Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersNegativeTestMultiTenantJSON-495059859-project Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 8c3f65f7acf24e4b96d96e5d9cab17bd Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-495059859-project Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 57181ade-9174-46e3-89f0-e3d59465534f could not be found. Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '57181ade-9174-46e3-89f0-e3d59465534f'} Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57181ade-9174-46e3-89f0-e3d59465534f could not be found. Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:55:12.896164 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:55:12.900778 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57181ade-9174-46e3-89f0-e3d59465534f could not be found. Oct 18 15:55:12.900778 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:55:12.900778 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:55:12.900778 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:55:12.900778 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:55:12.900778 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:55:12.900778 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:55:12.900778 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:55:12.900778 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:55:12.900778 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57181ade-9174-46e3-89f0-e3d59465534f could not be found. Oct 18 15:55:12.900778 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:55:12.902312 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-23f12e63-6cde-4640-b6d2-fba4102188dc tempest-ServersNegativeTestMultiTenantJSON-495059859 tempest-ServersNegativeTestMultiTenantJSON-495059859-project] Returning 404 to user: Instance 57181ade-9174-46e3-89f0-e3d59465534f could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:55:12.903329 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-23f12e63-6cde-4640-b6d2-fba4102188dc tempest-ServersNegativeTestMultiTenantJSON-495059859 tempest-ServersNegativeTestMultiTenantJSON-495059859-project] 10.222.0.60 "DELETE /compute/v2.1/servers/57181ade-9174-46e3-89f0-e3d59465534f" status: 404 len: 111 microversion: 2.1 time: 0.714903 Oct 18 15:55:12.904381 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2920/5862] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:55:12 2022] DELETE /compute/v2.1/servers/57181ade-9174-46e3-89f0-e3d59465534f => generated 111 bytes in 717 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:55:12.917708 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ca8f7a03-c0e7-45a1-b012-99caebe5eb0a tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:55:12.918784 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ca8f7a03-c0e7-45a1-b012-99caebe5eb0a tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] [instance: 57181ade-9174-46e3-89f0-e3d59465534f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:55:12.946198 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca8f7a03-c0e7-45a1-b012-99caebe5eb0a tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:55:12.947688 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca8f7a03-c0e7-45a1-b012-99caebe5eb0a tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:55:12.950158 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca8f7a03-c0e7-45a1-b012-99caebe5eb0a tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:55:12.953653 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca8f7a03-c0e7-45a1-b012-99caebe5eb0a tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:55:12.954993 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca8f7a03-c0e7-45a1-b012-99caebe5eb0a tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:55:12.957021 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca8f7a03-c0e7-45a1-b012-99caebe5eb0a tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:55:13.379381 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ca8f7a03-c0e7-45a1-b012-99caebe5eb0a tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3a5da005a04f559d3f71cce172f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6debdfed5a414a93d822dbe55f74ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:55:13.393031 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ca8f7a03-c0e7-45a1-b012-99caebe5eb0a tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] 10.222.0.60 "GET /compute/v2.1/servers/57181ade-9174-46e3-89f0-e3d59465534f" status: 200 len: 1526 microversion: 2.1 time: 0.481956 Oct 18 15:55:13.411561 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2943/5863] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:55:12 2022] GET /compute/v2.1/servers/57181ade-9174-46e3-89f0-e3d59465534f => generated 1526 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:55:13.418720 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bf640c40-7933-44cb-a968-b32693e0299b tempest-ServersNegativeTestMultiTenantJSON-495059859 tempest-ServersNegativeTestMultiTenantJSON-495059859-project] Action: 'update', calling method: >, body: {"server": {"name": "57181ade-9174-46e3-89f0-e3d59465534f_new"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:55:13.424004 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bf640c40-7933-44cb-a968-b32693e0299b tempest-ServersNegativeTestMultiTenantJSON-495059859 tempest-ServersNegativeTestMultiTenantJSON-495059859-project] [instance: 57181ade-9174-46e3-89f0-e3d59465534f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:55:13.448137 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf640c40-7933-44cb-a968-b32693e0299b tempest-ServersNegativeTestMultiTenantJSON-495059859 tempest-ServersNegativeTestMultiTenantJSON-495059859-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:55:13.448872 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf640c40-7933-44cb-a968-b32693e0299b tempest-ServersNegativeTestMultiTenantJSON-495059859 tempest-ServersNegativeTestMultiTenantJSON-495059859-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:55:13.450283 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf640c40-7933-44cb-a968-b32693e0299b tempest-ServersNegativeTestMultiTenantJSON-495059859 tempest-ServersNegativeTestMultiTenantJSON-495059859-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:55:13.452643 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf640c40-7933-44cb-a968-b32693e0299b tempest-ServersNegativeTestMultiTenantJSON-495059859 tempest-ServersNegativeTestMultiTenantJSON-495059859-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:55:13.453246 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf640c40-7933-44cb-a968-b32693e0299b tempest-ServersNegativeTestMultiTenantJSON-495059859 tempest-ServersNegativeTestMultiTenantJSON-495059859-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:55:13.454075 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf640c40-7933-44cb-a968-b32693e0299b tempest-ServersNegativeTestMultiTenantJSON-495059859 tempest-ServersNegativeTestMultiTenantJSON-495059859-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:55:13.498648 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-bf640c40-7933-44cb-a968-b32693e0299b tempest-ServersNegativeTestMultiTenantJSON-495059859 tempest-ServersNegativeTestMultiTenantJSON-495059859-project] HTTP exception thrown: Instance 57181ade-9174-46e3-89f0-e3d59465534f could not be found. Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bf640c40-7933-44cb-a968-b32693e0299b tempest-ServersNegativeTestMultiTenantJSON-495059859 tempest-ServersNegativeTestMultiTenantJSON-495059859-project] Request method failure captured: Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: request: PUT /compute/v2.1/servers/57181ade-9174-46e3-89f0-e3d59465534f HTTP/1.1 Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 64 Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsxHFzuSC-wbq0kMvnxoqO6-oh9ybkT3Cok2mk29JaYIFlOqN7x2Ru8K6o1RbpwNUBKC3mb2LbOVYta5r9pgHz1egyL-2iIIvK5G4OKAWRJnxkrVDfB23uh3C6zyrF0JKT16FiA0UtPZcsauraJ5k-lYBPGVGJu-ZitxLsRCGLLZfRM Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: b967a788fc984faa883f36384d5ed1c7 Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-495059859 Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b967a788fc984faa883f36384d5ed1c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b967a788fc984faa883f36384d5ed1c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b967a788fc984faa883f36384d5ed1c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b967a788fc984faa883f36384d5ed1c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-495059859 Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: b967a788fc984faa883f36384d5ed1c7 Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-495059859 Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersNegativeTestMultiTenantJSON-495059859-project Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 8c3f65f7acf24e4b96d96e5d9cab17bd Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-495059859-project Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: {"server": {"name": "57181ade-9174-46e3-89f0-e3d59465534f_new"}} Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 57181ade-9174-46e3-89f0-e3d59465534f could not be found. Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '57181ade-9174-46e3-89f0-e3d59465534f', 'body': {'server': {'name': '57181ade-9174-46e3-89f0-e3d59465534f_new'}}} Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57181ade-9174-46e3-89f0-e3d59465534f could not be found. Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 15:55:13.505766 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 18 15:55:13.510679 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 18 15:55:13.510679 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 18 15:55:13.510679 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:55:13.510679 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:55:13.510679 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:55:13.510679 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:55:13.510679 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57181ade-9174-46e3-89f0-e3d59465534f could not be found. Oct 18 15:55:13.510679 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:55:13.510679 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:55:13.510679 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:55:13.510679 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:55:13.510679 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:55:13.510679 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:55:13.510679 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:55:13.510679 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:55:13.510679 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57181ade-9174-46e3-89f0-e3d59465534f could not be found. Oct 18 15:55:13.510679 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:55:13.513651 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bf640c40-7933-44cb-a968-b32693e0299b tempest-ServersNegativeTestMultiTenantJSON-495059859 tempest-ServersNegativeTestMultiTenantJSON-495059859-project] Returning 404 to user: Instance 57181ade-9174-46e3-89f0-e3d59465534f could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:55:13.515435 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bf640c40-7933-44cb-a968-b32693e0299b tempest-ServersNegativeTestMultiTenantJSON-495059859 tempest-ServersNegativeTestMultiTenantJSON-495059859-project] 10.222.0.60 "PUT /compute/v2.1/servers/57181ade-9174-46e3-89f0-e3d59465534f" status: 404 len: 111 microversion: 2.1 time: 0.102757 Oct 18 15:55:13.517469 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2921/5864] 10.222.0.60 () {60 vars in 1256 bytes} [Tue Oct 18 15:55:13 2022] PUT /compute/v2.1/servers/57181ade-9174-46e3-89f0-e3d59465534f => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:55:13.528413 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-15ae8d2d-77b4-423e-b0cc-77d513488d02 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:55:13.529244 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-15ae8d2d-77b4-423e-b0cc-77d513488d02 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] [instance: 57181ade-9174-46e3-89f0-e3d59465534f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:55:13.538987 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-15ae8d2d-77b4-423e-b0cc-77d513488d02 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:55:13.540077 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-15ae8d2d-77b4-423e-b0cc-77d513488d02 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:55:13.540771 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-15ae8d2d-77b4-423e-b0cc-77d513488d02 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:55:13.542678 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-15ae8d2d-77b4-423e-b0cc-77d513488d02 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:55:13.543387 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-15ae8d2d-77b4-423e-b0cc-77d513488d02 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:55:13.544067 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-15ae8d2d-77b4-423e-b0cc-77d513488d02 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:55:13.599472 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-15ae8d2d-77b4-423e-b0cc-77d513488d02 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] [instance: 57181ade-9174-46e3-89f0-e3d59465534f] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:55:13.775953 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-15ae8d2d-77b4-423e-b0cc-77d513488d02 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] 10.222.0.60 "DELETE /compute/v2.1/servers/57181ade-9174-46e3-89f0-e3d59465534f" status: 204 len: 0 microversion: 2.1 time: 0.253116 Oct 18 15:55:13.777016 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2944/5865] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:55:13 2022] DELETE /compute/v2.1/servers/57181ade-9174-46e3-89f0-e3d59465534f => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:55:13.784756 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-54eaf135-c864-4447-b9a2-3cc05b3de73e tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:55:13.785641 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-54eaf135-c864-4447-b9a2-3cc05b3de73e tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] [instance: 57181ade-9174-46e3-89f0-e3d59465534f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:55:13.797717 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54eaf135-c864-4447-b9a2-3cc05b3de73e tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:55:13.799567 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54eaf135-c864-4447-b9a2-3cc05b3de73e tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:55:13.800169 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54eaf135-c864-4447-b9a2-3cc05b3de73e tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:55:13.801086 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54eaf135-c864-4447-b9a2-3cc05b3de73e tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:55:13.802602 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54eaf135-c864-4447-b9a2-3cc05b3de73e tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:55:13.803211 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54eaf135-c864-4447-b9a2-3cc05b3de73e tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:55:14.116524 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-54eaf135-c864-4447-b9a2-3cc05b3de73e tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3a5da005a04f559d3f71cce172f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6debdfed5a414a93d822dbe55f74ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:55:14.125296 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-54eaf135-c864-4447-b9a2-3cc05b3de73e tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] 10.222.0.60 "GET /compute/v2.1/servers/57181ade-9174-46e3-89f0-e3d59465534f" status: 200 len: 1532 microversion: 2.1 time: 0.344170 Oct 18 15:55:14.126325 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2922/5866] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:55:13 2022] GET /compute/v2.1/servers/57181ade-9174-46e3-89f0-e3d59465534f => generated 1532 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:55:15.154213 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ef8ee655-f6ec-49f3-b114-f0c6a67f92f3 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:55:15.155243 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ef8ee655-f6ec-49f3-b114-f0c6a67f92f3 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] [instance: 57181ade-9174-46e3-89f0-e3d59465534f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:55:15.168444 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ef8ee655-f6ec-49f3-b114-f0c6a67f92f3 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:55:15.172058 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ef8ee655-f6ec-49f3-b114-f0c6a67f92f3 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:55:15.172629 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ef8ee655-f6ec-49f3-b114-f0c6a67f92f3 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:55:15.173724 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ef8ee655-f6ec-49f3-b114-f0c6a67f92f3 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:55:15.174407 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ef8ee655-f6ec-49f3-b114-f0c6a67f92f3 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:55:15.175752 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ef8ee655-f6ec-49f3-b114-f0c6a67f92f3 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:55:16.280480 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ef8ee655-f6ec-49f3-b114-f0c6a67f92f3 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3a5da005a04f559d3f71cce172f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6debdfed5a414a93d822dbe55f74ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:55:16.294274 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ef8ee655-f6ec-49f3-b114-f0c6a67f92f3 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] 10.222.0.60 "GET /compute/v2.1/servers/57181ade-9174-46e3-89f0-e3d59465534f" status: 200 len: 1532 microversion: 2.1 time: 1.145142 Oct 18 15:55:16.297582 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2945/5867] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:55:15 2022] GET /compute/v2.1/servers/57181ade-9174-46e3-89f0-e3d59465534f => generated 1532 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:55:16.953548 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ad02b624-8e6f-4a36-8a45-fc8aa83ea9a8 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:55:16.954116 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ad02b624-8e6f-4a36-8a45-fc8aa83ea9a8 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:55:16.985444 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad02b624-8e6f-4a36-8a45-fc8aa83ea9a8 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:55:16.986325 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad02b624-8e6f-4a36-8a45-fc8aa83ea9a8 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:55:16.989218 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad02b624-8e6f-4a36-8a45-fc8aa83ea9a8 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:55:16.990208 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad02b624-8e6f-4a36-8a45-fc8aa83ea9a8 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:55:16.990852 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad02b624-8e6f-4a36-8a45-fc8aa83ea9a8 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:55:16.991615 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad02b624-8e6f-4a36-8a45-fc8aa83ea9a8 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:55:17.036952 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-ad02b624-8e6f-4a36-8a45-fc8aa83ea9a8 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] HTTP exception thrown: Instance 6af51230-78de-43fb-be54-c1b182368139 could not be found. Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ad02b624-8e6f-4a36-8a45-fc8aa83ea9a8 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Request method failure captured: Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 HTTP/1.1 Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsqYDHglXRrKKDfqs5wbB85aL1IgsbKNF1z6Sqn3ConJiRPpx0UNXPU9GBcVgVIVA6Cv0KVW_QZkVxEQzEhdvRXaHfIXystMZjHnbqDb3MGXqIMBIAb_BfqWpNNsmkNwvE0YKpE5VnVYMQHyS_V0VqjFt3xFH_oEjIPB2-nD9wOWCxY Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: X-Openstack-Nova-Api-Version: 2.20 Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 2e4cd8880d3b47ad9098b2097c0563a2 Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-778019649 Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2e4cd8880d3b47ad9098b2097c0563a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2e4cd8880d3b47ad9098b2097c0563a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2e4cd8880d3b47ad9098b2097c0563a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2e4cd8880d3b47ad9098b2097c0563a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-AttachVolumeShelveTestJSON-778019649 Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 2e4cd8880d3b47ad9098b2097c0563a2 Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-778019649 Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-AttachVolumeShelveTestJSON-778019649-project Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: e7f068c2e39541fb8d82265702a3179a Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-AttachVolumeShelveTestJSON-778019649-project Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 6af51230-78de-43fb-be54-c1b182368139 could not be found. Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '6af51230-78de-43fb-be54-c1b182368139'} Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6af51230-78de-43fb-be54-c1b182368139 could not be found. Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:55:17.052574 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:55:17.057115 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6af51230-78de-43fb-be54-c1b182368139 could not be found. Oct 18 15:55:17.057115 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:55:17.057115 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:55:17.057115 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:55:17.057115 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:55:17.057115 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:55:17.057115 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:55:17.057115 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:55:17.057115 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:55:17.057115 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6af51230-78de-43fb-be54-c1b182368139 could not be found. Oct 18 15:55:17.057115 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:55:17.062968 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ad02b624-8e6f-4a36-8a45-fc8aa83ea9a8 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Returning 404 to user: Instance 6af51230-78de-43fb-be54-c1b182368139 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:55:17.064360 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ad02b624-8e6f-4a36-8a45-fc8aa83ea9a8 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 404 len: 111 microversion: 2.20 time: 0.114915 Oct 18 15:55:17.068466 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2923/5868] 10.222.0.60 () {60 vars in 1280 bytes} [Tue Oct 18 15:55:16 2022] DELETE /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:55:17.077888 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-33a306da-0d90-450a-9481-e1bc60ff8c0c tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:55:17.078644 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-33a306da-0d90-450a-9481-e1bc60ff8c0c tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: 6af51230-78de-43fb-be54-c1b182368139] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:55:17.089740 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-33a306da-0d90-450a-9481-e1bc60ff8c0c tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:55:17.090855 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-33a306da-0d90-450a-9481-e1bc60ff8c0c tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:55:17.092622 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-33a306da-0d90-450a-9481-e1bc60ff8c0c tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:55:17.098511 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-33a306da-0d90-450a-9481-e1bc60ff8c0c tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:55:17.099171 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-33a306da-0d90-450a-9481-e1bc60ff8c0c tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:55:17.099971 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-33a306da-0d90-450a-9481-e1bc60ff8c0c tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:55:17.146975 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-33a306da-0d90-450a-9481-e1bc60ff8c0c tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] HTTP exception thrown: Instance 6af51230-78de-43fb-be54-c1b182368139 could not be found. Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-33a306da-0d90-450a-9481-e1bc60ff8c0c tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Request method failure captured: Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 HTTP/1.1 Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsqYDHglXRrKKDfqs5wbB85aL1IgsbKNF1z6Sqn3ConJiRPpx0UNXPU9GBcVgVIVA6Cv0KVW_QZkVxEQzEhdvRXaHfIXystMZjHnbqDb3MGXqIMBIAb_BfqWpNNsmkNwvE0YKpE5VnVYMQHyS_V0VqjFt3xFH_oEjIPB2-nD9wOWCxY Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: X-Openstack-Nova-Api-Version: 2.20 Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 2e4cd8880d3b47ad9098b2097c0563a2 Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-778019649 Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2e4cd8880d3b47ad9098b2097c0563a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2e4cd8880d3b47ad9098b2097c0563a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2e4cd8880d3b47ad9098b2097c0563a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2e4cd8880d3b47ad9098b2097c0563a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-AttachVolumeShelveTestJSON-778019649 Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 2e4cd8880d3b47ad9098b2097c0563a2 Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-778019649 Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-AttachVolumeShelveTestJSON-778019649-project Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: e7f068c2e39541fb8d82265702a3179a Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-AttachVolumeShelveTestJSON-778019649-project Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 6af51230-78de-43fb-be54-c1b182368139 could not be found. Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '6af51230-78de-43fb-be54-c1b182368139'} Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6af51230-78de-43fb-be54-c1b182368139 could not be found. Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6af51230-78de-43fb-be54-c1b182368139 could not be found. Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:55:17.154340 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:55:17.161014 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:55:17.161014 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:55:17.161014 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:55:17.161014 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:55:17.161014 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:55:17.161014 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:55:17.161014 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6af51230-78de-43fb-be54-c1b182368139 could not be found. Oct 18 15:55:17.161014 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:55:17.161014 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-33a306da-0d90-450a-9481-e1bc60ff8c0c tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Returning 404 to user: Instance 6af51230-78de-43fb-be54-c1b182368139 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:55:17.165089 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-33a306da-0d90-450a-9481-e1bc60ff8c0c tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139" status: 404 len: 111 microversion: 2.20 time: 0.091924 Oct 18 15:55:17.167188 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2946/5869] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:55:17 2022] GET /compute/v2.1/servers/6af51230-78de-43fb-be54-c1b182368139 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:55:17.325623 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c8d143db-4354-4ad1-a967-b5b68d9bb417 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:55:17.326252 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c8d143db-4354-4ad1-a967-b5b68d9bb417 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] [instance: 57181ade-9174-46e3-89f0-e3d59465534f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:55:17.348796 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8d143db-4354-4ad1-a967-b5b68d9bb417 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:55:17.349727 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8d143db-4354-4ad1-a967-b5b68d9bb417 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:55:17.351026 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8d143db-4354-4ad1-a967-b5b68d9bb417 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:55:17.355098 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8d143db-4354-4ad1-a967-b5b68d9bb417 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:55:17.355893 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8d143db-4354-4ad1-a967-b5b68d9bb417 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:55:17.356594 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8d143db-4354-4ad1-a967-b5b68d9bb417 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:55:18.283842 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c8d143db-4354-4ad1-a967-b5b68d9bb417 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3a5da005a04f559d3f71cce172f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6debdfed5a414a93d822dbe55f74ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:55:18.288081 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:55:18.308336 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-08bd0ec6-c247-4db3-aea9-239a58bc5d47 req-76fafb3c-57e6-4ba4-b60b-3d1eb4e5e71e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57181ade-9174-46e3-89f0-e3d59465534f", "name": "network-vif-deleted", "tag": "f8f4eeba-bafe-472b-aa0f-91ab0ee85fbc"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:55:18.329803 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c8d143db-4354-4ad1-a967-b5b68d9bb417 tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] 10.222.0.60 "GET /compute/v2.1/servers/57181ade-9174-46e3-89f0-e3d59465534f" status: 200 len: 1532 microversion: 2.1 time: 1.008883 Oct 18 15:55:18.335340 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2924/5870] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:55:17 2022] GET /compute/v2.1/servers/57181ade-9174-46e3-89f0-e3d59465534f => generated 1532 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:55:18.348981 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-08bd0ec6-c247-4db3-aea9-239a58bc5d47 req-76fafb3c-57e6-4ba4-b60b-3d1eb4e5e71e service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:55:18.351943 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-08bd0ec6-c247-4db3-aea9-239a58bc5d47 req-76fafb3c-57e6-4ba4-b60b-3d1eb4e5e71e service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:55:18.357500 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-08bd0ec6-c247-4db3-aea9-239a58bc5d47 req-76fafb3c-57e6-4ba4-b60b-3d1eb4e5e71e service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:55:18.389585 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-08bd0ec6-c247-4db3-aea9-239a58bc5d47 req-76fafb3c-57e6-4ba4-b60b-3d1eb4e5e71e service nova] Creating event network-vif-deleted:f8f4eeba-bafe-472b-aa0f-91ab0ee85fbc for instance 57181ade-9174-46e3-89f0-e3d59465534f on n-h1-853682-5 Oct 18 15:55:18.406681 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-08bd0ec6-c247-4db3-aea9-239a58bc5d47 req-76fafb3c-57e6-4ba4-b60b-3d1eb4e5e71e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101840 Oct 18 15:55:18.409813 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2947/5871] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:55:19.358367 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1dd1af07-bf63-4b67-9df9-2cb95003133b tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:55:19.358994 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1dd1af07-bf63-4b67-9df9-2cb95003133b tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] [instance: 57181ade-9174-46e3-89f0-e3d59465534f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:55:19.362883 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:55:19.403350 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1dd1af07-bf63-4b67-9df9-2cb95003133b tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:55:19.404092 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1dd1af07-bf63-4b67-9df9-2cb95003133b tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:55:19.404667 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1dd1af07-bf63-4b67-9df9-2cb95003133b tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:55:19.407635 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1dd1af07-bf63-4b67-9df9-2cb95003133b tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:55:19.409175 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1dd1af07-bf63-4b67-9df9-2cb95003133b tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:55:19.422258 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1dd1af07-bf63-4b67-9df9-2cb95003133b tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:55:19.516258 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-1dd1af07-bf63-4b67-9df9-2cb95003133b tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] HTTP exception thrown: Instance 57181ade-9174-46e3-89f0-e3d59465534f could not be found. Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1dd1af07-bf63-4b67-9df9-2cb95003133b tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Request method failure captured: Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/57181ade-9174-46e3-89f0-e3d59465534f HTTP/1.1 Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsw7wTPcSP6adfShz9AGxYMK4DITdHlb0_GA-DETXX9tuAGyVucRX1tW09Y8P62XwFoDt4m4dPnAXNHLqwAPgkj3PnL_UbHSiqjF1PkJ8ArgQpopFJwKP9bbW_KtdKkU8S99XHeW5iwu8PlIXP_LBVCO8ipC_Q_76oZ9YcoJ000YQK0 Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: ec6debdfed5a414a93d822dbe55f74ca Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1648585529 Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ec6debdfed5a414a93d822dbe55f74ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ec6debdfed5a414a93d822dbe55f74ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ec6debdfed5a414a93d822dbe55f74ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ec6debdfed5a414a93d822dbe55f74ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1648585529 Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: ec6debdfed5a414a93d822dbe55f74ca Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1648585529 Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1648585529-project Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 3b3a5da005a04f559d3f71cce172f28b Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1648585529-project Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 57181ade-9174-46e3-89f0-e3d59465534f could not be found. Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '57181ade-9174-46e3-89f0-e3d59465534f'} Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57181ade-9174-46e3-89f0-e3d59465534f could not be found. Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57181ade-9174-46e3-89f0-e3d59465534f could not be found. Oct 18 15:55:19.529640 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:55:19.537189 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:55:19.537189 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:55:19.537189 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:55:19.537189 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:55:19.537189 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:55:19.537189 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:55:19.537189 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:55:19.537189 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57181ade-9174-46e3-89f0-e3d59465534f could not be found. Oct 18 15:55:19.537189 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:55:19.537189 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1dd1af07-bf63-4b67-9df9-2cb95003133b tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] Returning 404 to user: Instance 57181ade-9174-46e3-89f0-e3d59465534f could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:55:19.537189 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1dd1af07-bf63-4b67-9df9-2cb95003133b tempest-ServersNegativeTestMultiTenantJSON-1648585529 tempest-ServersNegativeTestMultiTenantJSON-1648585529-project] 10.222.0.60 "GET /compute/v2.1/servers/57181ade-9174-46e3-89f0-e3d59465534f" status: 404 len: 111 microversion: 2.1 time: 0.177347 Oct 18 15:55:19.545581 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2925/5872] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:55:19 2022] GET /compute/v2.1/servers/57181ade-9174-46e3-89f0-e3d59465534f => generated 111 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:55:25.266911 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9ac185aa-4bc6-412c-be68-af4ceabb5029 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:55:25.268388 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9ac185aa-4bc6-412c-be68-af4ceabb5029 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:55:25.285848 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:55:25.287674 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9ac185aa-4bc6-412c-be68-af4ceabb5029 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:55:25.290775 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9ac185aa-4bc6-412c-be68-af4ceabb5029 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:55:25.291524 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9ac185aa-4bc6-412c-be68-af4ceabb5029 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:55:25.292544 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9ac185aa-4bc6-412c-be68-af4ceabb5029 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:55:25.312544 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9ac185aa-4bc6-412c-be68-af4ceabb5029 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:55:25.316408 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9ac185aa-4bc6-412c-be68-af4ceabb5029 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:55:25.326279 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:55:25.363592 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-9ac185aa-4bc6-412c-be68-af4ceabb5029 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] HTTP exception thrown: Instance b465248f-ab7a-4aba-b939-6f236eea166e could not be found. Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9ac185aa-4bc6-412c-be68-af4ceabb5029 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Request method failure captured: Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: request: DELETE /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e HTTP/1.1 Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTsqYDHglXRrKKDfqs5wbB85aL1IgsbKNF1z6Sqn3ConJiRPpx0UNXPU9GBcVgVIVA6Cv0KVW_QZkVxEQzEhdvRXaHfIXystMZjHnbqDb3MGXqIMBIAb_BfqWpNNsmkNwvE0YKpE5VnVYMQHyS_V0VqjFt3xFH_oEjIPB2-nD9wOWCxY Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: X-Openstack-Nova-Api-Version: 2.20 Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 2e4cd8880d3b47ad9098b2097c0563a2 Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-778019649 Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2e4cd8880d3b47ad9098b2097c0563a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2e4cd8880d3b47ad9098b2097c0563a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2e4cd8880d3b47ad9098b2097c0563a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2e4cd8880d3b47ad9098b2097c0563a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-AttachVolumeShelveTestJSON-778019649 Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 2e4cd8880d3b47ad9098b2097c0563a2 Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-778019649 Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-AttachVolumeShelveTestJSON-778019649-project Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: e7f068c2e39541fb8d82265702a3179a Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-AttachVolumeShelveTestJSON-778019649-project Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance b465248f-ab7a-4aba-b939-6f236eea166e could not be found. Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'b465248f-ab7a-4aba-b939-6f236eea166e'} Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b465248f-ab7a-4aba-b939-6f236eea166e could not be found. Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:55:25.365483 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:55:25.370411 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b465248f-ab7a-4aba-b939-6f236eea166e could not be found. Oct 18 15:55:25.370411 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:55:25.370411 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:55:25.370411 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:55:25.370411 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:55:25.370411 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:55:25.370411 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:55:25.370411 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:55:25.370411 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:55:25.370411 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b465248f-ab7a-4aba-b939-6f236eea166e could not be found. Oct 18 15:55:25.370411 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 15:55:25.374204 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9ac185aa-4bc6-412c-be68-af4ceabb5029 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Returning 404 to user: Instance b465248f-ab7a-4aba-b939-6f236eea166e could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:55:25.376455 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9ac185aa-4bc6-412c-be68-af4ceabb5029 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 404 len: 111 microversion: 2.20 time: 0.116041 Oct 18 15:55:25.381534 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2948/5873] 10.222.0.60 () {60 vars in 1280 bytes} [Tue Oct 18 15:55:25 2022] DELETE /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:55:25.388781 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c4bfcb88-9ddc-4798-8487-9e297ca84742 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:55:25.390150 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c4bfcb88-9ddc-4798-8487-9e297ca84742 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] [instance: b465248f-ab7a-4aba-b939-6f236eea166e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:55:25.401905 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4bfcb88-9ddc-4798-8487-9e297ca84742 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:55:25.404271 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4bfcb88-9ddc-4798-8487-9e297ca84742 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:55:25.405018 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4bfcb88-9ddc-4798-8487-9e297ca84742 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:55:25.405981 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4bfcb88-9ddc-4798-8487-9e297ca84742 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:55:25.406684 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4bfcb88-9ddc-4798-8487-9e297ca84742 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:55:25.407359 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4bfcb88-9ddc-4798-8487-9e297ca84742 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:55:25.450658 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-c4bfcb88-9ddc-4798-8487-9e297ca84742 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] HTTP exception thrown: Instance b465248f-ab7a-4aba-b939-6f236eea166e could not be found. Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c4bfcb88-9ddc-4798-8487-9e297ca84742 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Request method failure captured: Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e HTTP/1.1 Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTsqYDHglXRrKKDfqs5wbB85aL1IgsbKNF1z6Sqn3ConJiRPpx0UNXPU9GBcVgVIVA6Cv0KVW_QZkVxEQzEhdvRXaHfIXystMZjHnbqDb3MGXqIMBIAb_BfqWpNNsmkNwvE0YKpE5VnVYMQHyS_V0VqjFt3xFH_oEjIPB2-nD9wOWCxY Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: X-Openstack-Nova-Api-Version: 2.20 Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 2e4cd8880d3b47ad9098b2097c0563a2 Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-778019649 Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2e4cd8880d3b47ad9098b2097c0563a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2e4cd8880d3b47ad9098b2097c0563a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2e4cd8880d3b47ad9098b2097c0563a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2e4cd8880d3b47ad9098b2097c0563a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-AttachVolumeShelveTestJSON-778019649 Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 2e4cd8880d3b47ad9098b2097c0563a2 Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-778019649 Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-AttachVolumeShelveTestJSON-778019649-project Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: e7f068c2e39541fb8d82265702a3179a Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-AttachVolumeShelveTestJSON-778019649-project Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance b465248f-ab7a-4aba-b939-6f236eea166e could not be found. Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'b465248f-ab7a-4aba-b939-6f236eea166e'} Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b465248f-ab7a-4aba-b939-6f236eea166e could not be found. Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b465248f-ab7a-4aba-b939-6f236eea166e could not be found. Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:55:25.457306 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:55:25.462930 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:55:25.462930 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:55:25.462930 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:55:25.462930 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:55:25.462930 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:55:25.462930 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:55:25.462930 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b465248f-ab7a-4aba-b939-6f236eea166e could not be found. Oct 18 15:55:25.462930 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:55:25.465434 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c4bfcb88-9ddc-4798-8487-9e297ca84742 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Returning 404 to user: Instance b465248f-ab7a-4aba-b939-6f236eea166e could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:55:25.466511 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c4bfcb88-9ddc-4798-8487-9e297ca84742 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e" status: 404 len: 111 microversion: 2.20 time: 0.082337 Oct 18 15:55:25.471792 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2926/5874] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Oct 18 15:55:25 2022] GET /compute/v2.1/servers/b465248f-ab7a-4aba-b939-6f236eea166e => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 15:56:03.232453 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9ac185aa-4bc6-412c-be68-af4ceabb5029 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:56:03.233575 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9ac185aa-4bc6-412c-be68-af4ceabb5029 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002649 Oct 18 15:56:03.234121 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2949/5875] 10.222.0.60 () {56 vars in 886 bytes} [Tue Oct 18 15:56:03 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 18 15:56:20.384869 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c4bfcb88-9ddc-4798-8487-9e297ca84742 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:56:20.385992 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c4bfcb88-9ddc-4798-8487-9e297ca84742 tempest-AttachVolumeShelveTestJSON-778019649 tempest-AttachVolumeShelveTestJSON-778019649-project] 10.222.0.60 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001488 Oct 18 15:56:20.386655 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2927/5876] 10.222.0.60 () {56 vars in 886 bytes} [Tue Oct 18 15:56:20 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 18 15:56:59.073294 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5e43b5b8-4dbb-41c7-9c12-cdcab0c76a40 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-884337177", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:56:59.086336 n-d-853682-5 devstack@n-api.service[120405]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 15:56:59.086667 n-d-853682-5 devstack@n-api.service[120405]: Tue Oct 18 15:56:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Oct 18 15:56:59.214572 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-5e43b5b8-4dbb-41c7-9c12-cdcab0c76a40 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] validate_networks() for None {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:57:00.042360 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-5e43b5b8-4dbb-41c7-9c12-cdcab0c76a40 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:57:00.042941 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-5e43b5b8-4dbb-41c7-9c12-cdcab0c76a40 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:57:00.043531 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-5e43b5b8-4dbb-41c7-9c12-cdcab0c76a40 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:57:00.044056 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-5e43b5b8-4dbb-41c7-9c12-cdcab0c76a40 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:57:00.044581 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-5e43b5b8-4dbb-41c7-9c12-cdcab0c76a40 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:57:00.061144 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5e43b5b8-4dbb-41c7-9c12-cdcab0c76a40 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:00.062061 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5e43b5b8-4dbb-41c7-9c12-cdcab0c76a40 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:00.062753 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5e43b5b8-4dbb-41c7-9c12-cdcab0c76a40 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:00.063604 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5e43b5b8-4dbb-41c7-9c12-cdcab0c76a40 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:00.064192 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5e43b5b8-4dbb-41c7-9c12-cdcab0c76a40 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:00.064728 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5e43b5b8-4dbb-41c7-9c12-cdcab0c76a40 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:00.108699 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-5e43b5b8-4dbb-41c7-9c12-cdcab0c76a40 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Getting quotas for project e5f6fd4e41e540ed8ce96e8de88311f6. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:57:00.116152 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-5e43b5b8-4dbb-41c7-9c12-cdcab0c76a40 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Getting quotas for user eff793c58c02491f82c4de2c0d882bd3 and project e5f6fd4e41e540ed8ce96e8de88311f6. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:57:00.134855 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5e43b5b8-4dbb-41c7-9c12-cdcab0c76a40 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:57:00.137749 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5e43b5b8-4dbb-41c7-9c12-cdcab0c76a40 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] [instance: 8e57d947-495e-49ab-ab4a-69394abb0fb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:57:00.298648 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5e43b5b8-4dbb-41c7-9c12-cdcab0c76a40 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.232852 Oct 18 15:57:00.300733 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2950/5877] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:56:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1236 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:57:00.310100 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:57:00.310839 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=5 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:57:00.312508 n-d-853682-5 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 15:57:00.312992 n-d-853682-5 devstack@n-api.service[120406]: Tue Oct 18 15:57:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8e57d947-495e-49ab-ab4a-69394abb0fb5 (ip 10.222.0.60) !!! Oct 18 15:57:00.318410 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e053745d-cc5c-48ce-af9c-218be86d2d99 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:57:00.319050 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e053745d-cc5c-48ce-af9c-218be86d2d99 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] [instance: 8e57d947-495e-49ab-ab4a-69394abb0fb5] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:57:00.936884 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e053745d-cc5c-48ce-af9c-218be86d2d99 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff793c58c02491f82c4de2c0d882bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f6fd4e41e540ed8ce96e8de88311f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:57:00.946729 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e053745d-cc5c-48ce-af9c-218be86d2d99 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] 10.222.0.60 "GET /compute/v2.1/servers/8e57d947-495e-49ab-ab4a-69394abb0fb5" status: 200 len: 1213 microversion: 2.1 time: 0.638515 Oct 18 15:57:00.979117 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2928/5878] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:57:00 2022] GET /compute/v2.1/servers/8e57d947-495e-49ab-ab4a-69394abb0fb5 => generated 1213 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:57:02.001811 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8ee9beb1-7029-4465-809c-8bc5e8de6ded tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:57:02.003260 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8ee9beb1-7029-4465-809c-8bc5e8de6ded tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] [instance: 8e57d947-495e-49ab-ab4a-69394abb0fb5] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:57:02.024756 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8ee9beb1-7029-4465-809c-8bc5e8de6ded tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:02.024756 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8ee9beb1-7029-4465-809c-8bc5e8de6ded tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:02.024756 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8ee9beb1-7029-4465-809c-8bc5e8de6ded tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:02.024756 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8ee9beb1-7029-4465-809c-8bc5e8de6ded tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:02.025410 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8ee9beb1-7029-4465-809c-8bc5e8de6ded tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:02.025410 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8ee9beb1-7029-4465-809c-8bc5e8de6ded tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:02.286645 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8ee9beb1-7029-4465-809c-8bc5e8de6ded tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff793c58c02491f82c4de2c0d882bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f6fd4e41e540ed8ce96e8de88311f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:57:02.307170 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8ee9beb1-7029-4465-809c-8bc5e8de6ded tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] 10.222.0.60 "GET /compute/v2.1/servers/8e57d947-495e-49ab-ab4a-69394abb0fb5" status: 200 len: 1273 microversion: 2.1 time: 0.309517 Oct 18 15:57:02.311346 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2951/5879] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:57:01 2022] GET /compute/v2.1/servers/8e57d947-495e-49ab-ab4a-69394abb0fb5 => generated 1273 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:57:03.334381 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0b301e5a-4ddd-4b80-9d2d-3e8f181cdaaa tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:57:03.335175 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0b301e5a-4ddd-4b80-9d2d-3e8f181cdaaa tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] [instance: 8e57d947-495e-49ab-ab4a-69394abb0fb5] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:57:03.353690 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b301e5a-4ddd-4b80-9d2d-3e8f181cdaaa tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:03.368382 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b301e5a-4ddd-4b80-9d2d-3e8f181cdaaa tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:03.370049 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b301e5a-4ddd-4b80-9d2d-3e8f181cdaaa tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:03.377159 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b301e5a-4ddd-4b80-9d2d-3e8f181cdaaa tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:03.378328 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b301e5a-4ddd-4b80-9d2d-3e8f181cdaaa tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:03.383491 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b301e5a-4ddd-4b80-9d2d-3e8f181cdaaa tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:03.621232 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0b301e5a-4ddd-4b80-9d2d-3e8f181cdaaa tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff793c58c02491f82c4de2c0d882bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f6fd4e41e540ed8ce96e8de88311f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:57:03.636738 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0b301e5a-4ddd-4b80-9d2d-3e8f181cdaaa tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] 10.222.0.60 "GET /compute/v2.1/servers/8e57d947-495e-49ab-ab4a-69394abb0fb5" status: 200 len: 1271 microversion: 2.1 time: 0.306798 Oct 18 15:57:03.643214 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2929/5880] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:57:03 2022] GET /compute/v2.1/servers/8e57d947-495e-49ab-ab4a-69394abb0fb5 => generated 1271 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:57:04.664405 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3e1792a6-c7aa-4eb3-9d9c-14276391e5d0 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:57:04.665831 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3e1792a6-c7aa-4eb3-9d9c-14276391e5d0 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] [instance: 8e57d947-495e-49ab-ab4a-69394abb0fb5] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:57:04.683215 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3e1792a6-c7aa-4eb3-9d9c-14276391e5d0 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:04.684255 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3e1792a6-c7aa-4eb3-9d9c-14276391e5d0 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:04.685020 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3e1792a6-c7aa-4eb3-9d9c-14276391e5d0 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:04.688193 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3e1792a6-c7aa-4eb3-9d9c-14276391e5d0 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:04.689454 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3e1792a6-c7aa-4eb3-9d9c-14276391e5d0 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:04.691747 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3e1792a6-c7aa-4eb3-9d9c-14276391e5d0 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:06.224574 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3e1792a6-c7aa-4eb3-9d9c-14276391e5d0 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff793c58c02491f82c4de2c0d882bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f6fd4e41e540ed8ce96e8de88311f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:57:06.234708 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3e1792a6-c7aa-4eb3-9d9c-14276391e5d0 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] 10.222.0.60 "GET /compute/v2.1/servers/8e57d947-495e-49ab-ab4a-69394abb0fb5" status: 200 len: 1313 microversion: 2.1 time: 1.574386 Oct 18 15:57:06.238881 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2952/5881] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:57:04 2022] GET /compute/v2.1/servers/8e57d947-495e-49ab-ab4a-69394abb0fb5 => generated 1313 bytes in 1580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:57:07.264931 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0a987a6b-89e4-4f96-b97c-e1d17d1f2f78 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:57:07.265415 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0a987a6b-89e4-4f96-b97c-e1d17d1f2f78 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] [instance: 8e57d947-495e-49ab-ab4a-69394abb0fb5] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:57:07.296769 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a987a6b-89e4-4f96-b97c-e1d17d1f2f78 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:07.297301 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a987a6b-89e4-4f96-b97c-e1d17d1f2f78 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:07.297749 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a987a6b-89e4-4f96-b97c-e1d17d1f2f78 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:07.298575 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a987a6b-89e4-4f96-b97c-e1d17d1f2f78 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:07.299061 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a987a6b-89e4-4f96-b97c-e1d17d1f2f78 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:07.300130 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a987a6b-89e4-4f96-b97c-e1d17d1f2f78 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:07.672659 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0a987a6b-89e4-4f96-b97c-e1d17d1f2f78 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff793c58c02491f82c4de2c0d882bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f6fd4e41e540ed8ce96e8de88311f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:57:07.685915 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0a987a6b-89e4-4f96-b97c-e1d17d1f2f78 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] 10.222.0.60 "GET /compute/v2.1/servers/8e57d947-495e-49ab-ab4a-69394abb0fb5" status: 200 len: 1313 microversion: 2.1 time: 0.425802 Oct 18 15:57:07.692426 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2930/5882] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:57:07 2022] GET /compute/v2.1/servers/8e57d947-495e-49ab-ab4a-69394abb0fb5 => generated 1313 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:57:08.717133 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9f8906e8-96f5-473f-a22a-711551bfa699 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:57:08.718465 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9f8906e8-96f5-473f-a22a-711551bfa699 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] [instance: 8e57d947-495e-49ab-ab4a-69394abb0fb5] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:57:08.733811 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9f8906e8-96f5-473f-a22a-711551bfa699 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:08.738039 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9f8906e8-96f5-473f-a22a-711551bfa699 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:08.738974 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9f8906e8-96f5-473f-a22a-711551bfa699 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:08.743287 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9f8906e8-96f5-473f-a22a-711551bfa699 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:08.746754 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9f8906e8-96f5-473f-a22a-711551bfa699 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:08.750010 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9f8906e8-96f5-473f-a22a-711551bfa699 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:09.273297 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9f8906e8-96f5-473f-a22a-711551bfa699 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff793c58c02491f82c4de2c0d882bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f6fd4e41e540ed8ce96e8de88311f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:57:09.281615 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9f8906e8-96f5-473f-a22a-711551bfa699 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] 10.222.0.60 "GET /compute/v2.1/servers/8e57d947-495e-49ab-ab4a-69394abb0fb5" status: 200 len: 1313 microversion: 2.1 time: 0.574001 Oct 18 15:57:09.286173 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2953/5883] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:57:08 2022] GET /compute/v2.1/servers/8e57d947-495e-49ab-ab4a-69394abb0fb5 => generated 1313 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:57:09.911743 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-a86e84f8-13a0-4ec9-9a4a-02923847e899 req-dffdf362-b0b4-44cd-8c81-a4f09e3f83af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e57d947-495e-49ab-ab4a-69394abb0fb5", "tag": "8fec50f3-1db1-4a3c-8cae-67ad06271041"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:57:09.948386 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a86e84f8-13a0-4ec9-9a4a-02923847e899 req-dffdf362-b0b4-44cd-8c81-a4f09e3f83af service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:09.948915 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a86e84f8-13a0-4ec9-9a4a-02923847e899 req-dffdf362-b0b4-44cd-8c81-a4f09e3f83af service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:09.949358 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a86e84f8-13a0-4ec9-9a4a-02923847e899 req-dffdf362-b0b4-44cd-8c81-a4f09e3f83af service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:10.020728 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-a86e84f8-13a0-4ec9-9a4a-02923847e899 req-dffdf362-b0b4-44cd-8c81-a4f09e3f83af service nova] Creating event network-changed:8fec50f3-1db1-4a3c-8cae-67ad06271041 for instance 8e57d947-495e-49ab-ab4a-69394abb0fb5 on n-h1-853682-5 Oct 18 15:57:10.047804 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-a86e84f8-13a0-4ec9-9a4a-02923847e899 req-dffdf362-b0b4-44cd-8c81-a4f09e3f83af service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.477474 Oct 18 15:57:10.048300 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2931/5884] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:57:10.317394 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-09a96d56-e3ee-4084-823c-b39d7265d68d tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:57:10.319609 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-09a96d56-e3ee-4084-823c-b39d7265d68d tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] [instance: 8e57d947-495e-49ab-ab4a-69394abb0fb5] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:57:10.350192 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:57:10.352917 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=6 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:57:10.359878 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09a96d56-e3ee-4084-823c-b39d7265d68d tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:10.363533 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09a96d56-e3ee-4084-823c-b39d7265d68d tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:10.365165 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09a96d56-e3ee-4084-823c-b39d7265d68d tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:10.371148 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09a96d56-e3ee-4084-823c-b39d7265d68d tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:10.371646 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09a96d56-e3ee-4084-823c-b39d7265d68d tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:10.372090 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09a96d56-e3ee-4084-823c-b39d7265d68d tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:10.798927 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-09a96d56-e3ee-4084-823c-b39d7265d68d tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff793c58c02491f82c4de2c0d882bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f6fd4e41e540ed8ce96e8de88311f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:57:10.807473 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-09a96d56-e3ee-4084-823c-b39d7265d68d tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] 10.222.0.60 "GET /compute/v2.1/servers/8e57d947-495e-49ab-ab4a-69394abb0fb5" status: 200 len: 1313 microversion: 2.1 time: 0.501436 Oct 18 15:57:10.813073 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2954/5885] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:57:10 2022] GET /compute/v2.1/servers/8e57d947-495e-49ab-ab4a-69394abb0fb5 => generated 1313 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:57:11.841164 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3a95f8d1-4b00-44c7-be97-526c7e790453 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:57:11.849727 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3a95f8d1-4b00-44c7-be97-526c7e790453 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] [instance: 8e57d947-495e-49ab-ab4a-69394abb0fb5] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:57:11.857594 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:57:11.860181 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a95f8d1-4b00-44c7-be97-526c7e790453 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:11.861282 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a95f8d1-4b00-44c7-be97-526c7e790453 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:11.862762 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a95f8d1-4b00-44c7-be97-526c7e790453 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:11.863758 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a95f8d1-4b00-44c7-be97-526c7e790453 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:11.865751 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a95f8d1-4b00-44c7-be97-526c7e790453 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:11.867205 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a95f8d1-4b00-44c7-be97-526c7e790453 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:12.591785 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3a95f8d1-4b00-44c7-be97-526c7e790453 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff793c58c02491f82c4de2c0d882bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f6fd4e41e540ed8ce96e8de88311f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:57:12.602657 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3a95f8d1-4b00-44c7-be97-526c7e790453 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] 10.222.0.60 "GET /compute/v2.1/servers/8e57d947-495e-49ab-ab4a-69394abb0fb5" status: 200 len: 1313 microversion: 2.1 time: 0.765488 Oct 18 15:57:12.604725 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2932/5886] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:57:11 2022] GET /compute/v2.1/servers/8e57d947-495e-49ab-ab4a-69394abb0fb5 => generated 1313 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:57:13.632668 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7cb4a1d7-4eca-4437-9ea4-57f9b697521f tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:57:13.633898 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7cb4a1d7-4eca-4437-9ea4-57f9b697521f tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] [instance: 8e57d947-495e-49ab-ab4a-69394abb0fb5] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:57:13.646314 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7cb4a1d7-4eca-4437-9ea4-57f9b697521f tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:13.648565 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7cb4a1d7-4eca-4437-9ea4-57f9b697521f tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:13.648565 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7cb4a1d7-4eca-4437-9ea4-57f9b697521f tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:13.649425 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7cb4a1d7-4eca-4437-9ea4-57f9b697521f tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:13.650357 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7cb4a1d7-4eca-4437-9ea4-57f9b697521f tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:13.651114 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7cb4a1d7-4eca-4437-9ea4-57f9b697521f tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:14.295436 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7cb4a1d7-4eca-4437-9ea4-57f9b697521f tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff793c58c02491f82c4de2c0d882bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f6fd4e41e540ed8ce96e8de88311f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:57:14.310123 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7cb4a1d7-4eca-4437-9ea4-57f9b697521f tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] 10.222.0.60 "GET /compute/v2.1/servers/8e57d947-495e-49ab-ab4a-69394abb0fb5" status: 200 len: 1313 microversion: 2.1 time: 0.679533 Oct 18 15:57:14.329407 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2955/5887] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:57:13 2022] GET /compute/v2.1/servers/8e57d947-495e-49ab-ab4a-69394abb0fb5 => generated 1313 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:57:15.334709 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2e97ebc9-bb5f-44a9-ba89-f9ad040371bb tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:57:15.335328 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2e97ebc9-bb5f-44a9-ba89-f9ad040371bb tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] [instance: 8e57d947-495e-49ab-ab4a-69394abb0fb5] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:57:15.348379 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e97ebc9-bb5f-44a9-ba89-f9ad040371bb tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:15.349277 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e97ebc9-bb5f-44a9-ba89-f9ad040371bb tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:15.351812 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e97ebc9-bb5f-44a9-ba89-f9ad040371bb tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:15.352775 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e97ebc9-bb5f-44a9-ba89-f9ad040371bb tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:15.353431 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e97ebc9-bb5f-44a9-ba89-f9ad040371bb tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:15.356601 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e97ebc9-bb5f-44a9-ba89-f9ad040371bb tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:16.150696 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2e97ebc9-bb5f-44a9-ba89-f9ad040371bb tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff793c58c02491f82c4de2c0d882bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f6fd4e41e540ed8ce96e8de88311f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:57:16.166109 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2e97ebc9-bb5f-44a9-ba89-f9ad040371bb tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] 10.222.0.60 "GET /compute/v2.1/servers/8e57d947-495e-49ab-ab4a-69394abb0fb5" status: 200 len: 1313 microversion: 2.1 time: 0.829471 Oct 18 15:57:16.166815 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2933/5888] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:57:15 2022] GET /compute/v2.1/servers/8e57d947-495e-49ab-ab4a-69394abb0fb5 => generated 1313 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:57:17.190318 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-215503ee-d9ff-4147-bb03-e65801a51b36 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:57:17.190944 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-215503ee-d9ff-4147-bb03-e65801a51b36 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] [instance: 8e57d947-495e-49ab-ab4a-69394abb0fb5] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:57:17.218373 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-215503ee-d9ff-4147-bb03-e65801a51b36 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:17.218872 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-215503ee-d9ff-4147-bb03-e65801a51b36 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:17.225523 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-215503ee-d9ff-4147-bb03-e65801a51b36 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:17.226895 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-215503ee-d9ff-4147-bb03-e65801a51b36 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:17.227394 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-215503ee-d9ff-4147-bb03-e65801a51b36 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:17.227844 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-215503ee-d9ff-4147-bb03-e65801a51b36 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:17.798264 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-215503ee-d9ff-4147-bb03-e65801a51b36 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff793c58c02491f82c4de2c0d882bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f6fd4e41e540ed8ce96e8de88311f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:57:17.809247 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-215503ee-d9ff-4147-bb03-e65801a51b36 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] 10.222.0.60 "GET /compute/v2.1/servers/8e57d947-495e-49ab-ab4a-69394abb0fb5" status: 200 len: 1313 microversion: 2.1 time: 0.623382 Oct 18 15:57:17.809855 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2956/5889] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:57:17 2022] GET /compute/v2.1/servers/8e57d947-495e-49ab-ab4a-69394abb0fb5 => generated 1313 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:57:18.834006 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-635c1c8d-4fef-41ea-8c4d-cfa8a9d0fcd1 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:57:18.834639 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-635c1c8d-4fef-41ea-8c4d-cfa8a9d0fcd1 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] [instance: 8e57d947-495e-49ab-ab4a-69394abb0fb5] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:57:18.854300 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-635c1c8d-4fef-41ea-8c4d-cfa8a9d0fcd1 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:18.854833 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-635c1c8d-4fef-41ea-8c4d-cfa8a9d0fcd1 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:18.858690 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-635c1c8d-4fef-41ea-8c4d-cfa8a9d0fcd1 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:18.861957 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-635c1c8d-4fef-41ea-8c4d-cfa8a9d0fcd1 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:18.868884 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-635c1c8d-4fef-41ea-8c4d-cfa8a9d0fcd1 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:18.869958 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-635c1c8d-4fef-41ea-8c4d-cfa8a9d0fcd1 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:19.338196 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-3be2627d-c1b1-40e9-aa51-9522e01d2505 req-d18ce185-27c7-46a6-aaff-8bddb38db062 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e57d947-495e-49ab-ab4a-69394abb0fb5", "name": "network-vif-plugged", "status": "completed", "tag": "8fec50f3-1db1-4a3c-8cae-67ad06271041"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:57:19.368069 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-3be2627d-c1b1-40e9-aa51-9522e01d2505 req-d18ce185-27c7-46a6-aaff-8bddb38db062 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:19.369072 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-3be2627d-c1b1-40e9-aa51-9522e01d2505 req-d18ce185-27c7-46a6-aaff-8bddb38db062 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:19.369635 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-3be2627d-c1b1-40e9-aa51-9522e01d2505 req-d18ce185-27c7-46a6-aaff-8bddb38db062 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:19.401046 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-3be2627d-c1b1-40e9-aa51-9522e01d2505 req-d18ce185-27c7-46a6-aaff-8bddb38db062 service nova] Creating event network-vif-plugged:8fec50f3-1db1-4a3c-8cae-67ad06271041 for instance 8e57d947-495e-49ab-ab4a-69394abb0fb5 on n-h1-853682-5 Oct 18 15:57:19.420248 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-3be2627d-c1b1-40e9-aa51-9522e01d2505 req-d18ce185-27c7-46a6-aaff-8bddb38db062 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.330949 Oct 18 15:57:19.422086 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2957/5890] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:57:19.492343 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-635c1c8d-4fef-41ea-8c4d-cfa8a9d0fcd1 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff793c58c02491f82c4de2c0d882bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f6fd4e41e540ed8ce96e8de88311f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:57:19.506856 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-635c1c8d-4fef-41ea-8c4d-cfa8a9d0fcd1 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] 10.222.0.60 "GET /compute/v2.1/servers/8e57d947-495e-49ab-ab4a-69394abb0fb5" status: 200 len: 1313 microversion: 2.1 time: 0.677556 Oct 18 15:57:19.510555 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2934/5891] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:57:18 2022] GET /compute/v2.1/servers/8e57d947-495e-49ab-ab4a-69394abb0fb5 => generated 1313 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:57:20.533938 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c0075257-0468-4cf8-a379-dee9ce282a36 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:57:20.534330 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c0075257-0468-4cf8-a379-dee9ce282a36 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] [instance: 8e57d947-495e-49ab-ab4a-69394abb0fb5] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:57:20.543406 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c0075257-0468-4cf8-a379-dee9ce282a36 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:20.543918 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c0075257-0468-4cf8-a379-dee9ce282a36 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:20.544412 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c0075257-0468-4cf8-a379-dee9ce282a36 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:20.545154 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c0075257-0468-4cf8-a379-dee9ce282a36 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:20.552775 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c0075257-0468-4cf8-a379-dee9ce282a36 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:20.553941 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c0075257-0468-4cf8-a379-dee9ce282a36 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:21.463296 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c0075257-0468-4cf8-a379-dee9ce282a36 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff793c58c02491f82c4de2c0d882bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f6fd4e41e540ed8ce96e8de88311f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:57:21.475272 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c0075257-0468-4cf8-a379-dee9ce282a36 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] 10.222.0.60 "GET /compute/v2.1/servers/8e57d947-495e-49ab-ab4a-69394abb0fb5" status: 200 len: 1313 microversion: 2.1 time: 0.947168 Oct 18 15:57:21.476980 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2958/5892] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:57:20 2022] GET /compute/v2.1/servers/8e57d947-495e-49ab-ab4a-69394abb0fb5 => generated 1313 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:57:22.506261 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1b748233-8e83-456d-bbb1-e138ba081677 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:57:22.507593 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1b748233-8e83-456d-bbb1-e138ba081677 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] [instance: 8e57d947-495e-49ab-ab4a-69394abb0fb5] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:57:22.515378 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b748233-8e83-456d-bbb1-e138ba081677 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:22.516277 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b748233-8e83-456d-bbb1-e138ba081677 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:22.517005 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b748233-8e83-456d-bbb1-e138ba081677 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:22.518004 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b748233-8e83-456d-bbb1-e138ba081677 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:22.520642 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b748233-8e83-456d-bbb1-e138ba081677 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:22.521451 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b748233-8e83-456d-bbb1-e138ba081677 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:22.881431 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1b748233-8e83-456d-bbb1-e138ba081677 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff793c58c02491f82c4de2c0d882bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f6fd4e41e540ed8ce96e8de88311f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:57:22.892139 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1b748233-8e83-456d-bbb1-e138ba081677 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] 10.222.0.60 "GET /compute/v2.1/servers/8e57d947-495e-49ab-ab4a-69394abb0fb5" status: 200 len: 1463 microversion: 2.1 time: 0.393947 Oct 18 15:57:22.894612 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2935/5893] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:57:22 2022] GET /compute/v2.1/servers/8e57d947-495e-49ab-ab4a-69394abb0fb5 => generated 1463 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:57:22.926963 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-201eaad7-2a21-4f78-8565-1fb2f834f5f8 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3a5e7a68-6f50-416c-97e0-d77ce710080f", "device": "/dev/sdb"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:57:22.931493 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-201eaad7-2a21-4f78-8565-1fb2f834f5f8 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] [instance: 8e57d947-495e-49ab-ab4a-69394abb0fb5] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:57:22.940444 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-201eaad7-2a21-4f78-8565-1fb2f834f5f8 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:22.940967 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-201eaad7-2a21-4f78-8565-1fb2f834f5f8 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:22.942094 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-201eaad7-2a21-4f78-8565-1fb2f834f5f8 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:22.944352 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-201eaad7-2a21-4f78-8565-1fb2f834f5f8 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:22.944873 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-201eaad7-2a21-4f78-8565-1fb2f834f5f8 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:22.945437 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-201eaad7-2a21-4f78-8565-1fb2f834f5f8 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:23.421495 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-201eaad7-2a21-4f78-8565-1fb2f834f5f8 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] 10.222.0.60 "POST /compute/v2.1/servers/8e57d947-495e-49ab-ab4a-69394abb0fb5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.504364 Oct 18 15:57:23.422147 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2959/5894] 10.222.0.60 () {60 vars in 1323 bytes} [Tue Oct 18 15:57:22 2022] POST /compute/v2.1/servers/8e57d947-495e-49ab-ab4a-69394abb0fb5/os-volume_attachments => generated 194 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:57:30.519294 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5ab94520-c08f-445e-a48d-d36d910cba96 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1503395423", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:57:30.562177 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=19 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:57:30.693107 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-5ab94520-c08f-445e-a48d-d36d910cba96 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] validate_networks() for None {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:57:31.623453 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-5ab94520-c08f-445e-a48d-d36d910cba96 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:57:31.624046 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-5ab94520-c08f-445e-a48d-d36d910cba96 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:57:31.624311 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-5ab94520-c08f-445e-a48d-d36d910cba96 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:57:31.625152 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-5ab94520-c08f-445e-a48d-d36d910cba96 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:57:31.626329 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-5ab94520-c08f-445e-a48d-d36d910cba96 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:57:31.636649 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ab94520-c08f-445e-a48d-d36d910cba96 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:31.637471 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ab94520-c08f-445e-a48d-d36d910cba96 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:31.638085 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ab94520-c08f-445e-a48d-d36d910cba96 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:31.639127 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ab94520-c08f-445e-a48d-d36d910cba96 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:31.639760 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ab94520-c08f-445e-a48d-d36d910cba96 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:31.640378 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ab94520-c08f-445e-a48d-d36d910cba96 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:31.653245 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=39 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:57:31.705428 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-5ab94520-c08f-445e-a48d-d36d910cba96 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Getting quotas for project 524db207a5e1432c8157c73b607fcec9. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:57:31.724419 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-5ab94520-c08f-445e-a48d-d36d910cba96 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Getting quotas for user ed9f1ddf9aa149af838025955a3054ab and project 524db207a5e1432c8157c73b607fcec9. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:57:31.755266 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5ab94520-c08f-445e-a48d-d36d910cba96 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:57:31.763823 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5ab94520-c08f-445e-a48d-d36d910cba96 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] [instance: 0d1b27ac-69c5-43d0-be12-042b55adcf2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:57:31.870495 n-d-853682-5 devstack@n-api.service[120406]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5ab94520-c08f-445e-a48d-d36d910cba96 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] [15ae3e35-725d-454e-98c3-d97b19cb1781] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 15:57:32.879127 n-d-853682-5 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [None req-5ab94520-c08f-445e-a48d-d36d910cba96 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] [15ae3e35-725d-454e-98c3-d97b19cb1781] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 44272. Oct 18 15:57:32.885244 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5ab94520-c08f-445e-a48d-d36d910cba96 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.380901 Oct 18 15:57:32.886059 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2936/5895] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:57:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2383 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:57:32.900728 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4ae140aa-995b-4a0e-a3d0-3421c58f4503 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:57:32.902104 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4ae140aa-995b-4a0e-a3d0-3421c58f4503 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] [instance: 0d1b27ac-69c5-43d0-be12-042b55adcf2a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:57:32.923619 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:57:33.077455 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4ae140aa-995b-4a0e-a3d0-3421c58f4503 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9f1ddf9aa149af838025955a3054ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524db207a5e1432c8157c73b607fcec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:57:33.086377 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4ae140aa-995b-4a0e-a3d0-3421c58f4503 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] 10.222.0.60 "GET /compute/v2.1/servers/0d1b27ac-69c5-43d0-be12-042b55adcf2a" status: 200 len: 1215 microversion: 2.1 time: 0.191968 Oct 18 15:57:33.096319 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2960/5896] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:57:32 2022] GET /compute/v2.1/servers/0d1b27ac-69c5-43d0-be12-042b55adcf2a => generated 1215 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:57:34.128506 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f4875972-8fd0-4d38-a2fa-33133c1674f8 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:57:34.130165 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f4875972-8fd0-4d38-a2fa-33133c1674f8 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] [instance: 0d1b27ac-69c5-43d0-be12-042b55adcf2a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:57:34.406724 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f4875972-8fd0-4d38-a2fa-33133c1674f8 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9f1ddf9aa149af838025955a3054ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524db207a5e1432c8157c73b607fcec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:57:34.427224 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f4875972-8fd0-4d38-a2fa-33133c1674f8 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] 10.222.0.60 "GET /compute/v2.1/servers/0d1b27ac-69c5-43d0-be12-042b55adcf2a" status: 200 len: 1215 microversion: 2.1 time: 0.303798 Oct 18 15:57:34.433577 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2937/5897] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:57:34 2022] GET /compute/v2.1/servers/0d1b27ac-69c5-43d0-be12-042b55adcf2a => generated 1215 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:57:35.459087 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ca409516-a530-4142-9081-faccf2a4123e tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:57:35.459714 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ca409516-a530-4142-9081-faccf2a4123e tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] [instance: 0d1b27ac-69c5-43d0-be12-042b55adcf2a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:57:35.462154 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:57:35.474743 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca409516-a530-4142-9081-faccf2a4123e tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:35.477604 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca409516-a530-4142-9081-faccf2a4123e tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:35.478301 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca409516-a530-4142-9081-faccf2a4123e tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:35.479183 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca409516-a530-4142-9081-faccf2a4123e tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:35.479780 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca409516-a530-4142-9081-faccf2a4123e tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:35.480290 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca409516-a530-4142-9081-faccf2a4123e tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:35.631664 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ca409516-a530-4142-9081-faccf2a4123e tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9f1ddf9aa149af838025955a3054ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524db207a5e1432c8157c73b607fcec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:57:35.642983 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ca409516-a530-4142-9081-faccf2a4123e tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] 10.222.0.60 "GET /compute/v2.1/servers/0d1b27ac-69c5-43d0-be12-042b55adcf2a" status: 200 len: 1219 microversion: 2.1 time: 0.187281 Oct 18 15:57:35.644581 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2961/5898] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:57:35 2022] GET /compute/v2.1/servers/0d1b27ac-69c5-43d0-be12-042b55adcf2a => generated 1219 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:57:36.670507 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-22af326c-a286-4f3a-8ae1-764c827513b1 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:57:36.671328 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-22af326c-a286-4f3a-8ae1-764c827513b1 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] [instance: 0d1b27ac-69c5-43d0-be12-042b55adcf2a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:57:36.699012 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-22af326c-a286-4f3a-8ae1-764c827513b1 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:36.699436 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-22af326c-a286-4f3a-8ae1-764c827513b1 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:36.699927 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-22af326c-a286-4f3a-8ae1-764c827513b1 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:36.700678 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-22af326c-a286-4f3a-8ae1-764c827513b1 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:36.701177 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-22af326c-a286-4f3a-8ae1-764c827513b1 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:36.701608 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-22af326c-a286-4f3a-8ae1-764c827513b1 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:36.851478 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-22af326c-a286-4f3a-8ae1-764c827513b1 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9f1ddf9aa149af838025955a3054ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524db207a5e1432c8157c73b607fcec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:57:36.872287 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-22af326c-a286-4f3a-8ae1-764c827513b1 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] 10.222.0.60 "GET /compute/v2.1/servers/0d1b27ac-69c5-43d0-be12-042b55adcf2a" status: 200 len: 1267 microversion: 2.1 time: 0.206508 Oct 18 15:57:36.874939 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2938/5899] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:57:36 2022] GET /compute/v2.1/servers/0d1b27ac-69c5-43d0-be12-042b55adcf2a => generated 1267 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:57:37.900672 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-efaef490-1934-4d8f-ad02-ebe017f440ec tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:57:37.902683 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-efaef490-1934-4d8f-ad02-ebe017f440ec tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] [instance: 0d1b27ac-69c5-43d0-be12-042b55adcf2a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:57:37.925415 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-efaef490-1934-4d8f-ad02-ebe017f440ec tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:37.926480 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-efaef490-1934-4d8f-ad02-ebe017f440ec tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:37.928064 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-efaef490-1934-4d8f-ad02-ebe017f440ec tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:37.929262 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-efaef490-1934-4d8f-ad02-ebe017f440ec tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:37.930038 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-efaef490-1934-4d8f-ad02-ebe017f440ec tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:37.930629 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-efaef490-1934-4d8f-ad02-ebe017f440ec tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:38.257341 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-efaef490-1934-4d8f-ad02-ebe017f440ec tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9f1ddf9aa149af838025955a3054ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524db207a5e1432c8157c73b607fcec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:57:38.275367 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-efaef490-1934-4d8f-ad02-ebe017f440ec tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] 10.222.0.60 "GET /compute/v2.1/servers/0d1b27ac-69c5-43d0-be12-042b55adcf2a" status: 200 len: 1273 microversion: 2.1 time: 0.380638 Oct 18 15:57:38.275859 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2962/5900] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:57:37 2022] GET /compute/v2.1/servers/0d1b27ac-69c5-43d0-be12-042b55adcf2a => generated 1273 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:57:39.307421 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0acad9c7-ad49-4fa3-af5e-23018565259e tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:57:39.309127 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0acad9c7-ad49-4fa3-af5e-23018565259e tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] [instance: 0d1b27ac-69c5-43d0-be12-042b55adcf2a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:57:39.317701 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0acad9c7-ad49-4fa3-af5e-23018565259e tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:39.318482 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0acad9c7-ad49-4fa3-af5e-23018565259e tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:39.319492 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0acad9c7-ad49-4fa3-af5e-23018565259e tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:39.320616 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0acad9c7-ad49-4fa3-af5e-23018565259e tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:39.321518 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0acad9c7-ad49-4fa3-af5e-23018565259e tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:39.322481 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0acad9c7-ad49-4fa3-af5e-23018565259e tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:39.452222 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0acad9c7-ad49-4fa3-af5e-23018565259e tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9f1ddf9aa149af838025955a3054ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524db207a5e1432c8157c73b607fcec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:57:39.465470 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0acad9c7-ad49-4fa3-af5e-23018565259e tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] 10.222.0.60 "GET /compute/v2.1/servers/0d1b27ac-69c5-43d0-be12-042b55adcf2a" status: 200 len: 1273 microversion: 2.1 time: 0.163955 Oct 18 15:57:39.477032 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2939/5901] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:57:39 2022] GET /compute/v2.1/servers/0d1b27ac-69c5-43d0-be12-042b55adcf2a => generated 1273 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:57:40.498421 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-43c9be8a-2b23-4e0d-8ef0-3fa3ee7d475b tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:57:40.499618 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-43c9be8a-2b23-4e0d-8ef0-3fa3ee7d475b tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] [instance: 0d1b27ac-69c5-43d0-be12-042b55adcf2a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:57:40.524733 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-43c9be8a-2b23-4e0d-8ef0-3fa3ee7d475b tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:40.526873 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-43c9be8a-2b23-4e0d-8ef0-3fa3ee7d475b tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:40.527524 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-43c9be8a-2b23-4e0d-8ef0-3fa3ee7d475b tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:40.528934 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-43c9be8a-2b23-4e0d-8ef0-3fa3ee7d475b tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:40.529886 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-43c9be8a-2b23-4e0d-8ef0-3fa3ee7d475b tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:40.534302 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-43c9be8a-2b23-4e0d-8ef0-3fa3ee7d475b tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:40.778877 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-43c9be8a-2b23-4e0d-8ef0-3fa3ee7d475b tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9f1ddf9aa149af838025955a3054ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524db207a5e1432c8157c73b607fcec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:57:40.793912 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-43c9be8a-2b23-4e0d-8ef0-3fa3ee7d475b tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] 10.222.0.60 "GET /compute/v2.1/servers/0d1b27ac-69c5-43d0-be12-042b55adcf2a" status: 200 len: 1273 microversion: 2.1 time: 0.304406 Oct 18 15:57:40.796965 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2963/5902] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:57:40 2022] GET /compute/v2.1/servers/0d1b27ac-69c5-43d0-be12-042b55adcf2a => generated 1273 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:57:41.822460 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1a06c375-aab5-4885-b6c2-181951e76d56 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:57:41.823719 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1a06c375-aab5-4885-b6c2-181951e76d56 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] [instance: 0d1b27ac-69c5-43d0-be12-042b55adcf2a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:57:41.828124 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:57:41.847052 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1a06c375-aab5-4885-b6c2-181951e76d56 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:41.849472 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1a06c375-aab5-4885-b6c2-181951e76d56 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:41.850132 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1a06c375-aab5-4885-b6c2-181951e76d56 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:41.851095 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1a06c375-aab5-4885-b6c2-181951e76d56 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:41.856850 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1a06c375-aab5-4885-b6c2-181951e76d56 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:41.857606 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1a06c375-aab5-4885-b6c2-181951e76d56 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:42.852817 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1a06c375-aab5-4885-b6c2-181951e76d56 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9f1ddf9aa149af838025955a3054ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524db207a5e1432c8157c73b607fcec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:57:42.860957 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1a06c375-aab5-4885-b6c2-181951e76d56 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] 10.222.0.60 "GET /compute/v2.1/servers/0d1b27ac-69c5-43d0-be12-042b55adcf2a" status: 200 len: 1315 microversion: 2.1 time: 1.042524 Oct 18 15:57:42.861577 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2940/5903] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:57:41 2022] GET /compute/v2.1/servers/0d1b27ac-69c5-43d0-be12-042b55adcf2a => generated 1315 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:57:43.887213 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-09d27d13-fa00-467b-83aa-6a0bd913a156 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:57:43.888029 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-09d27d13-fa00-467b-83aa-6a0bd913a156 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] [instance: 0d1b27ac-69c5-43d0-be12-042b55adcf2a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:57:43.902475 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:57:43.909305 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09d27d13-fa00-467b-83aa-6a0bd913a156 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:43.909921 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09d27d13-fa00-467b-83aa-6a0bd913a156 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:43.910377 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09d27d13-fa00-467b-83aa-6a0bd913a156 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:43.911130 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09d27d13-fa00-467b-83aa-6a0bd913a156 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:43.913649 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09d27d13-fa00-467b-83aa-6a0bd913a156 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:43.914042 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09d27d13-fa00-467b-83aa-6a0bd913a156 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:44.688212 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-09d27d13-fa00-467b-83aa-6a0bd913a156 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9f1ddf9aa149af838025955a3054ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524db207a5e1432c8157c73b607fcec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:57:44.702790 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-09d27d13-fa00-467b-83aa-6a0bd913a156 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] 10.222.0.60 "GET /compute/v2.1/servers/0d1b27ac-69c5-43d0-be12-042b55adcf2a" status: 200 len: 1315 microversion: 2.1 time: 0.820319 Oct 18 15:57:44.711109 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2964/5904] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:57:43 2022] GET /compute/v2.1/servers/0d1b27ac-69c5-43d0-be12-042b55adcf2a => generated 1315 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:57:45.733785 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1fb9be58-ce5b-4a25-9ea4-dea5ef128df4 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:57:45.736211 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1fb9be58-ce5b-4a25-9ea4-dea5ef128df4 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] [instance: 0d1b27ac-69c5-43d0-be12-042b55adcf2a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:57:45.755276 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=8 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:57:45.758990 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1fb9be58-ce5b-4a25-9ea4-dea5ef128df4 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:45.759659 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1fb9be58-ce5b-4a25-9ea4-dea5ef128df4 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:45.760167 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1fb9be58-ce5b-4a25-9ea4-dea5ef128df4 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:45.769179 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1fb9be58-ce5b-4a25-9ea4-dea5ef128df4 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:45.770572 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1fb9be58-ce5b-4a25-9ea4-dea5ef128df4 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:45.771052 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1fb9be58-ce5b-4a25-9ea4-dea5ef128df4 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:46.475884 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1fb9be58-ce5b-4a25-9ea4-dea5ef128df4 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9f1ddf9aa149af838025955a3054ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524db207a5e1432c8157c73b607fcec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:57:46.500773 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1fb9be58-ce5b-4a25-9ea4-dea5ef128df4 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] 10.222.0.60 "GET /compute/v2.1/servers/0d1b27ac-69c5-43d0-be12-042b55adcf2a" status: 200 len: 1315 microversion: 2.1 time: 0.769198 Oct 18 15:57:46.509971 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2941/5905] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:57:45 2022] GET /compute/v2.1/servers/0d1b27ac-69c5-43d0-be12-042b55adcf2a => generated 1315 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:57:47.534278 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-58f6db24-b060-4160-9677-da47376dbe8b tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:57:47.535778 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-58f6db24-b060-4160-9677-da47376dbe8b tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] [instance: 0d1b27ac-69c5-43d0-be12-042b55adcf2a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:57:47.549629 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-58f6db24-b060-4160-9677-da47376dbe8b tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:47.550946 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-58f6db24-b060-4160-9677-da47376dbe8b tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:47.552612 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-58f6db24-b060-4160-9677-da47376dbe8b tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:47.555026 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-58f6db24-b060-4160-9677-da47376dbe8b tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:47.555923 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-58f6db24-b060-4160-9677-da47376dbe8b tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:47.556564 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-58f6db24-b060-4160-9677-da47376dbe8b tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:48.154275 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-d04cc73f-c5c6-4127-b8ea-4e5c2859c777 req-b2e98fee-1e74-4839-899b-847ab46c67b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d1b27ac-69c5-43d0-be12-042b55adcf2a", "tag": "07b91101-e7a0-416b-aae5-cdc090837dcf"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:57:48.193549 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d04cc73f-c5c6-4127-b8ea-4e5c2859c777 req-b2e98fee-1e74-4839-899b-847ab46c67b8 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:48.201311 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d04cc73f-c5c6-4127-b8ea-4e5c2859c777 req-b2e98fee-1e74-4839-899b-847ab46c67b8 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:48.203194 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d04cc73f-c5c6-4127-b8ea-4e5c2859c777 req-b2e98fee-1e74-4839-899b-847ab46c67b8 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:48.232272 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-d04cc73f-c5c6-4127-b8ea-4e5c2859c777 req-b2e98fee-1e74-4839-899b-847ab46c67b8 service nova] Creating event network-changed:07b91101-e7a0-416b-aae5-cdc090837dcf for instance 0d1b27ac-69c5-43d0-be12-042b55adcf2a on n-h2-853682-5 Oct 18 15:57:48.245205 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-d04cc73f-c5c6-4127-b8ea-4e5c2859c777 req-b2e98fee-1e74-4839-899b-847ab46c67b8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095137 Oct 18 15:57:48.246324 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2942/5906] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:57:48.855932 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-58f6db24-b060-4160-9677-da47376dbe8b tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9f1ddf9aa149af838025955a3054ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524db207a5e1432c8157c73b607fcec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:57:48.865221 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-58f6db24-b060-4160-9677-da47376dbe8b tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] 10.222.0.60 "GET /compute/v2.1/servers/0d1b27ac-69c5-43d0-be12-042b55adcf2a" status: 200 len: 1315 microversion: 2.1 time: 1.334920 Oct 18 15:57:48.873620 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2965/5907] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:57:47 2022] GET /compute/v2.1/servers/0d1b27ac-69c5-43d0-be12-042b55adcf2a => generated 1315 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:57:49.911002 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bd694beb-2813-47d5-883f-b4501a319b1c tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:57:49.912701 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bd694beb-2813-47d5-883f-b4501a319b1c tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] [instance: 0d1b27ac-69c5-43d0-be12-042b55adcf2a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:57:49.942836 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd694beb-2813-47d5-883f-b4501a319b1c tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:49.944779 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd694beb-2813-47d5-883f-b4501a319b1c tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:49.947203 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd694beb-2813-47d5-883f-b4501a319b1c tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:49.950384 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd694beb-2813-47d5-883f-b4501a319b1c tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:49.957450 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd694beb-2813-47d5-883f-b4501a319b1c tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:49.958152 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd694beb-2813-47d5-883f-b4501a319b1c tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:51.346469 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bd694beb-2813-47d5-883f-b4501a319b1c tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9f1ddf9aa149af838025955a3054ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524db207a5e1432c8157c73b607fcec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:57:51.360293 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bd694beb-2813-47d5-883f-b4501a319b1c tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] 10.222.0.60 "GET /compute/v2.1/servers/0d1b27ac-69c5-43d0-be12-042b55adcf2a" status: 200 len: 1315 microversion: 2.1 time: 1.461913 Oct 18 15:57:51.360929 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2943/5908] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:57:49 2022] GET /compute/v2.1/servers/0d1b27ac-69c5-43d0-be12-042b55adcf2a => generated 1315 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:57:52.387046 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c7327e4c-a62c-41f7-b5cf-cd809dd9e740 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:57:52.387809 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c7327e4c-a62c-41f7-b5cf-cd809dd9e740 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] [instance: 0d1b27ac-69c5-43d0-be12-042b55adcf2a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:57:52.455985 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c7327e4c-a62c-41f7-b5cf-cd809dd9e740 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:52.457361 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c7327e4c-a62c-41f7-b5cf-cd809dd9e740 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:52.458687 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c7327e4c-a62c-41f7-b5cf-cd809dd9e740 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:52.463850 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c7327e4c-a62c-41f7-b5cf-cd809dd9e740 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:52.474361 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c7327e4c-a62c-41f7-b5cf-cd809dd9e740 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:52.482777 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c7327e4c-a62c-41f7-b5cf-cd809dd9e740 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:53.707375 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c7327e4c-a62c-41f7-b5cf-cd809dd9e740 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9f1ddf9aa149af838025955a3054ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524db207a5e1432c8157c73b607fcec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:57:53.717448 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c7327e4c-a62c-41f7-b5cf-cd809dd9e740 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] 10.222.0.60 "GET /compute/v2.1/servers/0d1b27ac-69c5-43d0-be12-042b55adcf2a" status: 200 len: 1315 microversion: 2.1 time: 1.337723 Oct 18 15:57:53.723299 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2966/5909] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:57:52 2022] GET /compute/v2.1/servers/0d1b27ac-69c5-43d0-be12-042b55adcf2a => generated 1315 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:57:54.750801 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3c09ba9b-8fa8-4e74-b81a-608e50d59510 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:57:54.752233 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3c09ba9b-8fa8-4e74-b81a-608e50d59510 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] [instance: 0d1b27ac-69c5-43d0-be12-042b55adcf2a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:57:54.769410 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c09ba9b-8fa8-4e74-b81a-608e50d59510 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:54.774328 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c09ba9b-8fa8-4e74-b81a-608e50d59510 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:54.775145 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c09ba9b-8fa8-4e74-b81a-608e50d59510 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:54.776124 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c09ba9b-8fa8-4e74-b81a-608e50d59510 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:54.777082 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c09ba9b-8fa8-4e74-b81a-608e50d59510 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:54.777747 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c09ba9b-8fa8-4e74-b81a-608e50d59510 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:55.675091 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3c09ba9b-8fa8-4e74-b81a-608e50d59510 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9f1ddf9aa149af838025955a3054ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524db207a5e1432c8157c73b607fcec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:57:55.710489 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3c09ba9b-8fa8-4e74-b81a-608e50d59510 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] 10.222.0.60 "GET /compute/v2.1/servers/0d1b27ac-69c5-43d0-be12-042b55adcf2a" status: 200 len: 1315 microversion: 2.1 time: 0.959796 Oct 18 15:57:55.711943 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2944/5910] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:57:54 2022] GET /compute/v2.1/servers/0d1b27ac-69c5-43d0-be12-042b55adcf2a => generated 1315 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:57:56.498700 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-b63145e9-b0ea-41c2-be3b-24cbe1295d54 req-260aa250-d7c4-4c3a-befb-058147209666 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d1b27ac-69c5-43d0-be12-042b55adcf2a", "name": "network-vif-plugged", "status": "completed", "tag": "07b91101-e7a0-416b-aae5-cdc090837dcf"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:57:56.534652 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-b63145e9-b0ea-41c2-be3b-24cbe1295d54 req-260aa250-d7c4-4c3a-befb-058147209666 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:56.536186 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-b63145e9-b0ea-41c2-be3b-24cbe1295d54 req-260aa250-d7c4-4c3a-befb-058147209666 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:56.537429 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-b63145e9-b0ea-41c2-be3b-24cbe1295d54 req-260aa250-d7c4-4c3a-befb-058147209666 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:56.575755 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-b63145e9-b0ea-41c2-be3b-24cbe1295d54 req-260aa250-d7c4-4c3a-befb-058147209666 service nova] Creating event network-vif-plugged:07b91101-e7a0-416b-aae5-cdc090837dcf for instance 0d1b27ac-69c5-43d0-be12-042b55adcf2a on n-h2-853682-5 Oct 18 15:57:56.583942 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-b63145e9-b0ea-41c2-be3b-24cbe1295d54 req-260aa250-d7c4-4c3a-befb-058147209666 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090830 Oct 18 15:57:56.585349 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2967/5911] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:57:56.737526 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5d4ed7d9-927e-443c-980e-1d0da25092b6 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:57:56.738893 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5d4ed7d9-927e-443c-980e-1d0da25092b6 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] [instance: 0d1b27ac-69c5-43d0-be12-042b55adcf2a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:57:56.757974 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d4ed7d9-927e-443c-980e-1d0da25092b6 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:56.759975 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d4ed7d9-927e-443c-980e-1d0da25092b6 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:56.762116 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d4ed7d9-927e-443c-980e-1d0da25092b6 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:56.762902 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d4ed7d9-927e-443c-980e-1d0da25092b6 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:56.765975 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d4ed7d9-927e-443c-980e-1d0da25092b6 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:56.772130 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d4ed7d9-927e-443c-980e-1d0da25092b6 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:57.376021 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5d4ed7d9-927e-443c-980e-1d0da25092b6 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9f1ddf9aa149af838025955a3054ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524db207a5e1432c8157c73b607fcec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:57:57.384201 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5d4ed7d9-927e-443c-980e-1d0da25092b6 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] 10.222.0.60 "GET /compute/v2.1/servers/0d1b27ac-69c5-43d0-be12-042b55adcf2a" status: 200 len: 1315 microversion: 2.1 time: 0.652740 Oct 18 15:57:57.396938 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2945/5912] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:57:56 2022] GET /compute/v2.1/servers/0d1b27ac-69c5-43d0-be12-042b55adcf2a => generated 1315 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:57:58.412991 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-024c8d06-9c91-4573-a2d2-fbbb5074e37c tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:57:58.414001 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-024c8d06-9c91-4573-a2d2-fbbb5074e37c tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] [instance: 0d1b27ac-69c5-43d0-be12-042b55adcf2a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:57:58.430021 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-024c8d06-9c91-4573-a2d2-fbbb5074e37c tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:58.430434 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-024c8d06-9c91-4573-a2d2-fbbb5074e37c tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:58.433198 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-024c8d06-9c91-4573-a2d2-fbbb5074e37c tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:58.436182 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-024c8d06-9c91-4573-a2d2-fbbb5074e37c tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:58.436675 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-024c8d06-9c91-4573-a2d2-fbbb5074e37c tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:58.438121 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-024c8d06-9c91-4573-a2d2-fbbb5074e37c tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:59.021508 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-024c8d06-9c91-4573-a2d2-fbbb5074e37c tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9f1ddf9aa149af838025955a3054ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524db207a5e1432c8157c73b607fcec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:57:59.033620 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-024c8d06-9c91-4573-a2d2-fbbb5074e37c tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] 10.222.0.60 "GET /compute/v2.1/servers/0d1b27ac-69c5-43d0-be12-042b55adcf2a" status: 200 len: 1465 microversion: 2.1 time: 0.623078 Oct 18 15:57:59.058572 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2968/5913] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:57:58 2022] GET /compute/v2.1/servers/0d1b27ac-69c5-43d0-be12-042b55adcf2a => generated 1465 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:57:59.122999 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7fb1c73c-e7c1-4291-83d6-f5108371607c tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:57:59.125263 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7fb1c73c-e7c1-4291-83d6-f5108371607c tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] [instance: 0d1b27ac-69c5-43d0-be12-042b55adcf2a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:57:59.135157 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7fb1c73c-e7c1-4291-83d6-f5108371607c tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:59.136380 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7fb1c73c-e7c1-4291-83d6-f5108371607c tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:59.137069 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7fb1c73c-e7c1-4291-83d6-f5108371607c tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:59.138117 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7fb1c73c-e7c1-4291-83d6-f5108371607c tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:59.138750 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7fb1c73c-e7c1-4291-83d6-f5108371607c tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:59.139386 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7fb1c73c-e7c1-4291-83d6-f5108371607c tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:59.178141 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7fb1c73c-e7c1-4291-83d6-f5108371607c tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] [instance: 0d1b27ac-69c5-43d0-be12-042b55adcf2a] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:57:59.427343 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7fb1c73c-e7c1-4291-83d6-f5108371607c tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] 10.222.0.60 "DELETE /compute/v2.1/servers/0d1b27ac-69c5-43d0-be12-042b55adcf2a" status: 204 len: 0 microversion: 2.1 time: 0.309840 Oct 18 15:57:59.429524 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2946/5914] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:57:59 2022] DELETE /compute/v2.1/servers/0d1b27ac-69c5-43d0-be12-042b55adcf2a => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:57:59.442462 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-984fb3e3-821c-4c9f-adf8-6009fb87ade1 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:57:59.443087 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-984fb3e3-821c-4c9f-adf8-6009fb87ade1 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] [instance: 0d1b27ac-69c5-43d0-be12-042b55adcf2a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:57:59.456938 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-984fb3e3-821c-4c9f-adf8-6009fb87ade1 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:59.457365 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-984fb3e3-821c-4c9f-adf8-6009fb87ade1 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:59.457972 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-984fb3e3-821c-4c9f-adf8-6009fb87ade1 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:57:59.458703 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-984fb3e3-821c-4c9f-adf8-6009fb87ade1 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:57:59.459169 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-984fb3e3-821c-4c9f-adf8-6009fb87ade1 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:57:59.459602 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-984fb3e3-821c-4c9f-adf8-6009fb87ade1 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:58:00.357215 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-984fb3e3-821c-4c9f-adf8-6009fb87ade1 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9f1ddf9aa149af838025955a3054ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524db207a5e1432c8157c73b607fcec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:58:00.371975 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-984fb3e3-821c-4c9f-adf8-6009fb87ade1 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] 10.222.0.60 "GET /compute/v2.1/servers/0d1b27ac-69c5-43d0-be12-042b55adcf2a" status: 200 len: 1471 microversion: 2.1 time: 0.933854 Oct 18 15:58:00.375327 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2969/5915] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:57:59 2022] GET /compute/v2.1/servers/0d1b27ac-69c5-43d0-be12-042b55adcf2a => generated 1471 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:58:01.404771 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-82a554a1-a87a-4e26-bdfd-e8a02813d0f6 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:58:01.406190 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-82a554a1-a87a-4e26-bdfd-e8a02813d0f6 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] [instance: 0d1b27ac-69c5-43d0-be12-042b55adcf2a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:58:01.421041 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:58:01.424925 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82a554a1-a87a-4e26-bdfd-e8a02813d0f6 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:58:01.426248 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82a554a1-a87a-4e26-bdfd-e8a02813d0f6 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:58:01.427111 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82a554a1-a87a-4e26-bdfd-e8a02813d0f6 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:58:01.428472 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82a554a1-a87a-4e26-bdfd-e8a02813d0f6 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:58:01.429216 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82a554a1-a87a-4e26-bdfd-e8a02813d0f6 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:58:01.429922 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82a554a1-a87a-4e26-bdfd-e8a02813d0f6 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:58:01.808958 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-82a554a1-a87a-4e26-bdfd-e8a02813d0f6 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9f1ddf9aa149af838025955a3054ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524db207a5e1432c8157c73b607fcec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:58:01.812864 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:58:01.836540 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-82a554a1-a87a-4e26-bdfd-e8a02813d0f6 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] 10.222.0.60 "GET /compute/v2.1/servers/0d1b27ac-69c5-43d0-be12-042b55adcf2a" status: 200 len: 1429 microversion: 2.1 time: 0.435086 Oct 18 15:58:01.837245 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2947/5916] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:58:01 2022] GET /compute/v2.1/servers/0d1b27ac-69c5-43d0-be12-042b55adcf2a => generated 1429 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:58:02.125323 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-ead9d18d-08b5-46b5-8f16-1ac7147a8cec req-01e2cc4f-23b3-4b3e-81b0-c4c9a64d12d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d1b27ac-69c5-43d0-be12-042b55adcf2a", "name": "network-vif-deleted", "tag": "07b91101-e7a0-416b-aae5-cdc090837dcf"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:58:02.205326 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-ead9d18d-08b5-46b5-8f16-1ac7147a8cec req-01e2cc4f-23b3-4b3e-81b0-c4c9a64d12d2 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:58:02.206266 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-ead9d18d-08b5-46b5-8f16-1ac7147a8cec req-01e2cc4f-23b3-4b3e-81b0-c4c9a64d12d2 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:58:02.206979 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-ead9d18d-08b5-46b5-8f16-1ac7147a8cec req-01e2cc4f-23b3-4b3e-81b0-c4c9a64d12d2 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:58:02.228899 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-ead9d18d-08b5-46b5-8f16-1ac7147a8cec req-01e2cc4f-23b3-4b3e-81b0-c4c9a64d12d2 service nova] Creating event network-vif-deleted:07b91101-e7a0-416b-aae5-cdc090837dcf for instance 0d1b27ac-69c5-43d0-be12-042b55adcf2a on n-h2-853682-5 Oct 18 15:58:02.243776 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-ead9d18d-08b5-46b5-8f16-1ac7147a8cec req-01e2cc4f-23b3-4b3e-81b0-c4c9a64d12d2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124310 Oct 18 15:58:02.244903 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2970/5917] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:58:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:58:02.869375 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fca45b98-77c5-4ea6-912f-5bbcdea59359 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:58:02.869912 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fca45b98-77c5-4ea6-912f-5bbcdea59359 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] [instance: 0d1b27ac-69c5-43d0-be12-042b55adcf2a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:58:02.885759 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fca45b98-77c5-4ea6-912f-5bbcdea59359 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:58:02.886259 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fca45b98-77c5-4ea6-912f-5bbcdea59359 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:58:02.888845 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fca45b98-77c5-4ea6-912f-5bbcdea59359 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:58:02.905641 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fca45b98-77c5-4ea6-912f-5bbcdea59359 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:58:02.911861 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fca45b98-77c5-4ea6-912f-5bbcdea59359 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:58:02.913533 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fca45b98-77c5-4ea6-912f-5bbcdea59359 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:58:03.019408 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fca45b98-77c5-4ea6-912f-5bbcdea59359 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:58:03.019622 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fca45b98-77c5-4ea6-912f-5bbcdea59359 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:58:03.020048 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fca45b98-77c5-4ea6-912f-5bbcdea59359 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:58:03.020562 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-fca45b98-77c5-4ea6-912f-5bbcdea59359 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lazy-loading 'fault' on Instance uuid 0d1b27ac-69c5-43d0-be12-042b55adcf2a {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:58:03.135814 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fca45b98-77c5-4ea6-912f-5bbcdea59359 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9f1ddf9aa149af838025955a3054ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524db207a5e1432c8157c73b607fcec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:58:03.151947 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fca45b98-77c5-4ea6-912f-5bbcdea59359 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] 10.222.0.60 "GET /compute/v2.1/servers/0d1b27ac-69c5-43d0-be12-042b55adcf2a" status: 200 len: 1305 microversion: 2.1 time: 0.284881 Oct 18 15:58:03.155673 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2948/5918] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:58:02 2022] GET /compute/v2.1/servers/0d1b27ac-69c5-43d0-be12-042b55adcf2a => generated 1305 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:58:04.181274 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d92987fb-cb4b-45b5-98f0-22b335e4f628 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:58:04.181991 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d92987fb-cb4b-45b5-98f0-22b335e4f628 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] [instance: 0d1b27ac-69c5-43d0-be12-042b55adcf2a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:58:04.192722 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d92987fb-cb4b-45b5-98f0-22b335e4f628 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:58:04.193608 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d92987fb-cb4b-45b5-98f0-22b335e4f628 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:58:04.194366 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d92987fb-cb4b-45b5-98f0-22b335e4f628 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:58:04.196644 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d92987fb-cb4b-45b5-98f0-22b335e4f628 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:58:04.197607 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d92987fb-cb4b-45b5-98f0-22b335e4f628 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:58:04.217504 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d92987fb-cb4b-45b5-98f0-22b335e4f628 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:58:04.276896 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-d92987fb-cb4b-45b5-98f0-22b335e4f628 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] HTTP exception thrown: Instance 0d1b27ac-69c5-43d0-be12-042b55adcf2a could not be found. Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d92987fb-cb4b-45b5-98f0-22b335e4f628 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Request method failure captured: Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/0d1b27ac-69c5-43d0-be12-042b55adcf2a HTTP/1.1 Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTszlQb0ThHUSP1Ktdxxy09fDwwZ6b1OKBi8i8znhQ8AXD5Xzx2afKVGAW6TFVdSFokE8fZOkyF2MTdH2Pm7eixZCfD840Mf9SWDrz4zbmrVcgAuNOM0PtIgAdEBzrEQR390PC2_4vUNlmIWi7VLr7W1ooFMaW7w9hvv0BHrOxEn3GZs Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 524db207a5e1432c8157c73b607fcec9 Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-VolumesNegativeTest-1273741002 Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/524db207a5e1432c8157c73b607fcec9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/524db207a5e1432c8157c73b607fcec9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/524db207a5e1432c8157c73b607fcec9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_524db207a5e1432c8157c73b607fcec9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-VolumesNegativeTest-1273741002 Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 524db207a5e1432c8157c73b607fcec9 Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-VolumesNegativeTest-1273741002 Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-VolumesNegativeTest-1273741002-project Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: ed9f1ddf9aa149af838025955a3054ab Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-VolumesNegativeTest-1273741002-project Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 0d1b27ac-69c5-43d0-be12-042b55adcf2a could not be found. Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '0d1b27ac-69c5-43d0-be12-042b55adcf2a'} Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d1b27ac-69c5-43d0-be12-042b55adcf2a could not be found. Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d1b27ac-69c5-43d0-be12-042b55adcf2a could not be found. Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:58:04.279116 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:58:04.286073 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:58:04.286073 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:58:04.286073 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:58:04.286073 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:58:04.286073 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:58:04.286073 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d1b27ac-69c5-43d0-be12-042b55adcf2a could not be found. Oct 18 15:58:04.286073 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:58:04.289912 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d92987fb-cb4b-45b5-98f0-22b335e4f628 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] Returning 404 to user: Instance 0d1b27ac-69c5-43d0-be12-042b55adcf2a could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:58:04.290802 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d92987fb-cb4b-45b5-98f0-22b335e4f628 tempest-VolumesNegativeTest-1273741002 tempest-VolumesNegativeTest-1273741002-project] 10.222.0.60 "GET /compute/v2.1/servers/0d1b27ac-69c5-43d0-be12-042b55adcf2a" status: 404 len: 111 microversion: 2.1 time: 0.114392 Oct 18 15:58:04.297869 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2949/5919] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:58:04 2022] GET /compute/v2.1/servers/0d1b27ac-69c5-43d0-be12-042b55adcf2a => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:58:04.587321 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c8698c5b-ed89-4c33-9403-ec7adf50f2a9 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Action: 'create', calling method: .version_select at 0x7f7c3d33d8b0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1681176835", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL/065xQ94dvH3Zi2QphXiIa6+KR5Q3M+20fJ4vfFQL3k9aKk4jgGM8Wpri7JPSi9uC+xrtFcyhoe/x9Aklts6qsj4S8qNIjHySnaxxR7auxog5X3dQp8kT32ZypQy47pg=="}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:58:04.602843 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=24 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:58:04.638528 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-c8698c5b-ed89-4c33-9403-ec7adf50f2a9 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Getting quotas for project d62510e4663941a9ae5a7c4a810d316c. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:58:04.657777 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-c8698c5b-ed89-4c33-9403-ec7adf50f2a9 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Getting quotas for user bab5a58990724e7bbbf18025ccdfcc1f and project d62510e4663941a9ae5a7c4a810d316c. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:58:04.710517 n-d-853682-5 devstack@n-api.service[120405]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c8698c5b-ed89-4c33-9403-ec7adf50f2a9 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] [261cbdb9-2eb5-48c9-b9c4-f39c963233ba] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 15:58:05.721493 n-d-853682-5 devstack@n-api.service[120405]: INFO oslo.messaging._drivers.impl_rabbit [None req-c8698c5b-ed89-4c33-9403-ec7adf50f2a9 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] [261cbdb9-2eb5-48c9-b9c4-f39c963233ba] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 45010. Oct 18 15:58:05.749013 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c8698c5b-ed89-4c33-9403-ec7adf50f2a9 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 1.716198 Oct 18 15:58:05.773927 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2971/5920] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Oct 18 15:58:04 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 1742 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:58:08.311588 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bf1d08e0-6aee-40cc-9db6-ccf8f413f4ff tempest-PortsAdminExtendedAttrsTestJSON-336963428 tempest-PortsAdminExtendedAttrsTestJSON-336963428-project-admin] Calling method '.version_select at 0x7f7c3d1525e0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:58:08.313909 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf1d08e0-6aee-40cc-9db6-ccf8f413f4ff tempest-PortsAdminExtendedAttrsTestJSON-336963428 tempest-PortsAdminExtendedAttrsTestJSON-336963428-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:58:08.314399 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf1d08e0-6aee-40cc-9db6-ccf8f413f4ff tempest-PortsAdminExtendedAttrsTestJSON-336963428 tempest-PortsAdminExtendedAttrsTestJSON-336963428-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:58:08.314841 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf1d08e0-6aee-40cc-9db6-ccf8f413f4ff tempest-PortsAdminExtendedAttrsTestJSON-336963428 tempest-PortsAdminExtendedAttrsTestJSON-336963428-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:58:08.362324 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf1d08e0-6aee-40cc-9db6-ccf8f413f4ff tempest-PortsAdminExtendedAttrsTestJSON-336963428 tempest-PortsAdminExtendedAttrsTestJSON-336963428-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:58:08.363075 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf1d08e0-6aee-40cc-9db6-ccf8f413f4ff tempest-PortsAdminExtendedAttrsTestJSON-336963428 tempest-PortsAdminExtendedAttrsTestJSON-336963428-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:58:08.364371 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf1d08e0-6aee-40cc-9db6-ccf8f413f4ff tempest-PortsAdminExtendedAttrsTestJSON-336963428 tempest-PortsAdminExtendedAttrsTestJSON-336963428-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:58:08.394345 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf1d08e0-6aee-40cc-9db6-ccf8f413f4ff tempest-PortsAdminExtendedAttrsTestJSON-336963428 tempest-PortsAdminExtendedAttrsTestJSON-336963428-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:58:08.395539 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf1d08e0-6aee-40cc-9db6-ccf8f413f4ff tempest-PortsAdminExtendedAttrsTestJSON-336963428 tempest-PortsAdminExtendedAttrsTestJSON-336963428-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:58:08.396399 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf1d08e0-6aee-40cc-9db6-ccf8f413f4ff tempest-PortsAdminExtendedAttrsTestJSON-336963428 tempest-PortsAdminExtendedAttrsTestJSON-336963428-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:58:08.404742 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bf1d08e0-6aee-40cc-9db6-ccf8f413f4ff tempest-PortsAdminExtendedAttrsTestJSON-336963428 tempest-PortsAdminExtendedAttrsTestJSON-336963428-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.458977 Oct 18 15:58:08.406000 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2950/5921] 10.222.0.60 () {58 vars in 1146 bytes} [Tue Oct 18 15:58:07 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:58:29.629153 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-92c26017-3d50-4eb4-8c66-a7ae2787a1d1 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1799536726-access_point-837148560", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "5e28172a-b2aa-451a-9494-b8af27e9dbaf"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1681176835", "security_groups": [{"name": "tempest-secgroup_access--1768532596"}, {"name": "tempest-secgroup_general--1188243396"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:58:29.719392 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=52 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:58:29.726536 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=4 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:58:29.731418 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=10,nova_api:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:58:30.231156 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-92c26017-3d50-4eb4-8c66-a7ae2787a1d1 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] validate_networks() for [('5e28172a-b2aa-451a-9494-b8af27e9dbaf', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:58:33.182590 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-92c26017-3d50-4eb4-8c66-a7ae2787a1d1 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:58:33.183166 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-92c26017-3d50-4eb4-8c66-a7ae2787a1d1 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:58:33.183689 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-92c26017-3d50-4eb4-8c66-a7ae2787a1d1 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:58:33.184211 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-92c26017-3d50-4eb4-8c66-a7ae2787a1d1 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:58:33.185017 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-92c26017-3d50-4eb4-8c66-a7ae2787a1d1 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:58:33.230707 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-92c26017-3d50-4eb4-8c66-a7ae2787a1d1 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:58:33.233405 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-92c26017-3d50-4eb4-8c66-a7ae2787a1d1 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:58:33.234607 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-92c26017-3d50-4eb4-8c66-a7ae2787a1d1 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:58:33.241854 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-92c26017-3d50-4eb4-8c66-a7ae2787a1d1 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:58:33.242530 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-92c26017-3d50-4eb4-8c66-a7ae2787a1d1 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:58:33.245945 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-92c26017-3d50-4eb4-8c66-a7ae2787a1d1 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:58:33.333722 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-92c26017-3d50-4eb4-8c66-a7ae2787a1d1 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Getting quotas for project d62510e4663941a9ae5a7c4a810d316c. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:58:33.353866 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-92c26017-3d50-4eb4-8c66-a7ae2787a1d1 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Getting quotas for user bab5a58990724e7bbbf18025ccdfcc1f and project d62510e4663941a9ae5a7c4a810d316c. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:58:33.384165 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-92c26017-3d50-4eb4-8c66-a7ae2787a1d1 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:58:33.387854 n-d-853682-5 devstack@n-api.service[120405]: WARNING nova.utils [None req-92c26017-3d50-4eb4-8c66-a7ae2787a1d1 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1799536726-access_point-837148560 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1799536726-ac Oct 18 15:58:33.389040 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-92c26017-3d50-4eb4-8c66-a7ae2787a1d1 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] [instance: 258517fa-d3ca-4b69-87e0-a2ea38ce3ce6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:58:33.496639 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-92c26017-3d50-4eb4-8c66-a7ae2787a1d1 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 458 microversion: 2.1 time: 3.872382 Oct 18 15:58:33.498044 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2972/5922] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:58:29 2022] POST /compute/v2.1/servers => generated 458 bytes in 3874 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:58:33.512156 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ae2cf1b3-8b49-439d-8a41-17d54c519f40 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:58:33.512792 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ae2cf1b3-8b49-439d-8a41-17d54c519f40 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] [instance: 258517fa-d3ca-4b69-87e0-a2ea38ce3ce6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:58:33.530061 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=11 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:58:33.533753 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=17 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:58:33.747887 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ae2cf1b3-8b49-439d-8a41-17d54c519f40 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab5a58990724e7bbbf18025ccdfcc1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62510e4663941a9ae5a7c4a810d316c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:58:33.758295 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ae2cf1b3-8b49-439d-8a41-17d54c519f40 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] 10.222.0.60 "GET /compute/v2.1/servers/258517fa-d3ca-4b69-87e0-a2ea38ce3ce6" status: 200 len: 1294 microversion: 2.1 time: 0.251640 Oct 18 15:58:33.769474 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2951/5923] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:58:33 2022] GET /compute/v2.1/servers/258517fa-d3ca-4b69-87e0-a2ea38ce3ce6 => generated 1294 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:58:34.793782 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a75d58cf-d8bd-4df0-aff7-e99314fd7927 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:58:34.795895 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a75d58cf-d8bd-4df0-aff7-e99314fd7927 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] [instance: 258517fa-d3ca-4b69-87e0-a2ea38ce3ce6] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:58:34.807354 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a75d58cf-d8bd-4df0-aff7-e99314fd7927 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:58:34.810375 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a75d58cf-d8bd-4df0-aff7-e99314fd7927 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:58:34.813498 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a75d58cf-d8bd-4df0-aff7-e99314fd7927 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:58:34.815922 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a75d58cf-d8bd-4df0-aff7-e99314fd7927 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:58:34.816967 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a75d58cf-d8bd-4df0-aff7-e99314fd7927 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:58:34.819777 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a75d58cf-d8bd-4df0-aff7-e99314fd7927 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:58:35.147702 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a75d58cf-d8bd-4df0-aff7-e99314fd7927 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab5a58990724e7bbbf18025ccdfcc1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62510e4663941a9ae5a7c4a810d316c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:58:35.170375 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a75d58cf-d8bd-4df0-aff7-e99314fd7927 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] 10.222.0.60 "GET /compute/v2.1/servers/258517fa-d3ca-4b69-87e0-a2ea38ce3ce6" status: 200 len: 1290 microversion: 2.1 time: 0.376962 Oct 18 15:58:35.171815 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2973/5924] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:58:34 2022] GET /compute/v2.1/servers/258517fa-d3ca-4b69-87e0-a2ea38ce3ce6 => generated 1290 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:58:36.199087 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4e4a1b25-4cfd-46fe-aa42-a85da7107ade tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:58:36.199701 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4e4a1b25-4cfd-46fe-aa42-a85da7107ade tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] [instance: 258517fa-d3ca-4b69-87e0-a2ea38ce3ce6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:58:36.222817 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e4a1b25-4cfd-46fe-aa42-a85da7107ade tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:58:36.224356 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e4a1b25-4cfd-46fe-aa42-a85da7107ade tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:58:36.225081 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e4a1b25-4cfd-46fe-aa42-a85da7107ade tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:58:36.226082 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e4a1b25-4cfd-46fe-aa42-a85da7107ade tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:58:36.226721 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e4a1b25-4cfd-46fe-aa42-a85da7107ade tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:58:36.227340 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e4a1b25-4cfd-46fe-aa42-a85da7107ade tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:58:36.793103 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4e4a1b25-4cfd-46fe-aa42-a85da7107ade tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab5a58990724e7bbbf18025ccdfcc1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62510e4663941a9ae5a7c4a810d316c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:58:36.808080 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4e4a1b25-4cfd-46fe-aa42-a85da7107ade tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] 10.222.0.60 "GET /compute/v2.1/servers/258517fa-d3ca-4b69-87e0-a2ea38ce3ce6" status: 200 len: 1352 microversion: 2.1 time: 0.612779 Oct 18 15:58:36.812739 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2952/5925] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:58:36 2022] GET /compute/v2.1/servers/258517fa-d3ca-4b69-87e0-a2ea38ce3ce6 => generated 1352 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:58:37.842393 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9405d6be-10b0-43d6-a29f-c036b7ee3fe7 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:58:37.843754 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9405d6be-10b0-43d6-a29f-c036b7ee3fe7 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] [instance: 258517fa-d3ca-4b69-87e0-a2ea38ce3ce6] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:58:37.886628 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9405d6be-10b0-43d6-a29f-c036b7ee3fe7 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:58:37.887146 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9405d6be-10b0-43d6-a29f-c036b7ee3fe7 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:58:37.892973 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9405d6be-10b0-43d6-a29f-c036b7ee3fe7 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:58:37.896003 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9405d6be-10b0-43d6-a29f-c036b7ee3fe7 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:58:37.896498 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9405d6be-10b0-43d6-a29f-c036b7ee3fe7 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:58:37.901768 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9405d6be-10b0-43d6-a29f-c036b7ee3fe7 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:58:38.081073 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9405d6be-10b0-43d6-a29f-c036b7ee3fe7 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab5a58990724e7bbbf18025ccdfcc1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62510e4663941a9ae5a7c4a810d316c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:58:38.137836 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9405d6be-10b0-43d6-a29f-c036b7ee3fe7 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] 10.222.0.60 "GET /compute/v2.1/servers/258517fa-d3ca-4b69-87e0-a2ea38ce3ce6" status: 200 len: 1352 microversion: 2.1 time: 0.305185 Oct 18 15:58:38.144698 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2974/5926] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:58:37 2022] GET /compute/v2.1/servers/258517fa-d3ca-4b69-87e0-a2ea38ce3ce6 => generated 1352 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:58:39.177822 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7801c801-d593-440e-8c36-b54e4fcf36cf tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:58:39.185562 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7801c801-d593-440e-8c36-b54e4fcf36cf tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] [instance: 258517fa-d3ca-4b69-87e0-a2ea38ce3ce6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:58:39.235635 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7801c801-d593-440e-8c36-b54e4fcf36cf tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:58:39.236447 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7801c801-d593-440e-8c36-b54e4fcf36cf tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:58:39.238385 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7801c801-d593-440e-8c36-b54e4fcf36cf tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:58:39.242113 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7801c801-d593-440e-8c36-b54e4fcf36cf tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:58:39.242830 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7801c801-d593-440e-8c36-b54e4fcf36cf tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:58:39.245508 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7801c801-d593-440e-8c36-b54e4fcf36cf tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:58:39.842269 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7801c801-d593-440e-8c36-b54e4fcf36cf tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab5a58990724e7bbbf18025ccdfcc1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62510e4663941a9ae5a7c4a810d316c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:58:39.903749 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7801c801-d593-440e-8c36-b54e4fcf36cf tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] 10.222.0.60 "GET /compute/v2.1/servers/258517fa-d3ca-4b69-87e0-a2ea38ce3ce6" status: 200 len: 1472 microversion: 2.1 time: 0.722948 Oct 18 15:58:39.909842 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2953/5927] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:58:39 2022] GET /compute/v2.1/servers/258517fa-d3ca-4b69-87e0-a2ea38ce3ce6 => generated 1472 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:58:40.931838 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d5ad0618-55ab-43ae-93b3-4e7aff0893e0 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:58:40.932464 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d5ad0618-55ab-43ae-93b3-4e7aff0893e0 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] [instance: 258517fa-d3ca-4b69-87e0-a2ea38ce3ce6] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:58:40.965557 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d5ad0618-55ab-43ae-93b3-4e7aff0893e0 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:58:40.965994 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d5ad0618-55ab-43ae-93b3-4e7aff0893e0 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:58:40.966443 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d5ad0618-55ab-43ae-93b3-4e7aff0893e0 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:58:40.967182 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d5ad0618-55ab-43ae-93b3-4e7aff0893e0 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:58:40.967645 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d5ad0618-55ab-43ae-93b3-4e7aff0893e0 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:58:40.968611 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d5ad0618-55ab-43ae-93b3-4e7aff0893e0 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:58:42.015731 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d5ad0618-55ab-43ae-93b3-4e7aff0893e0 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab5a58990724e7bbbf18025ccdfcc1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62510e4663941a9ae5a7c4a810d316c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:58:42.028389 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d5ad0618-55ab-43ae-93b3-4e7aff0893e0 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] 10.222.0.60 "GET /compute/v2.1/servers/258517fa-d3ca-4b69-87e0-a2ea38ce3ce6" status: 200 len: 1472 microversion: 2.1 time: 1.100399 Oct 18 15:58:42.054925 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2975/5928] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:58:40 2022] GET /compute/v2.1/servers/258517fa-d3ca-4b69-87e0-a2ea38ce3ce6 => generated 1472 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:58:42.334984 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-8026c485-3bcb-4183-bb36-08cf1029c95c req-98406513-22e7-43be-a619-f811d4794436 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "258517fa-d3ca-4b69-87e0-a2ea38ce3ce6", "tag": "e1bb89df-1467-49a0-8f2f-09537d27a571"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:58:42.363114 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8026c485-3bcb-4183-bb36-08cf1029c95c req-98406513-22e7-43be-a619-f811d4794436 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:58:42.365382 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8026c485-3bcb-4183-bb36-08cf1029c95c req-98406513-22e7-43be-a619-f811d4794436 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:58:42.371380 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8026c485-3bcb-4183-bb36-08cf1029c95c req-98406513-22e7-43be-a619-f811d4794436 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:58:42.408557 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-8026c485-3bcb-4183-bb36-08cf1029c95c req-98406513-22e7-43be-a619-f811d4794436 service nova] Creating event network-changed:e1bb89df-1467-49a0-8f2f-09537d27a571 for instance 258517fa-d3ca-4b69-87e0-a2ea38ce3ce6 on n-h2-853682-5 Oct 18 15:58:42.432282 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-8026c485-3bcb-4183-bb36-08cf1029c95c req-98406513-22e7-43be-a619-f811d4794436 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102298 Oct 18 15:58:42.453241 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2954/5929] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:58:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:58:43.062398 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-afd11d38-dd61-4807-8f25-c63612a4aac6 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:58:43.063100 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-afd11d38-dd61-4807-8f25-c63612a4aac6 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] [instance: 258517fa-d3ca-4b69-87e0-a2ea38ce3ce6] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:58:43.079313 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-afd11d38-dd61-4807-8f25-c63612a4aac6 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:58:43.087213 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-afd11d38-dd61-4807-8f25-c63612a4aac6 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:58:43.091247 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-afd11d38-dd61-4807-8f25-c63612a4aac6 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:58:43.092296 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-afd11d38-dd61-4807-8f25-c63612a4aac6 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:58:43.105585 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-afd11d38-dd61-4807-8f25-c63612a4aac6 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:58:43.106413 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-afd11d38-dd61-4807-8f25-c63612a4aac6 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:58:43.297031 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:58:43.378555 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=6 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:58:44.177224 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-afd11d38-dd61-4807-8f25-c63612a4aac6 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab5a58990724e7bbbf18025ccdfcc1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62510e4663941a9ae5a7c4a810d316c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:58:44.210808 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-afd11d38-dd61-4807-8f25-c63612a4aac6 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] 10.222.0.60 "GET /compute/v2.1/servers/258517fa-d3ca-4b69-87e0-a2ea38ce3ce6" status: 200 len: 1472 microversion: 2.1 time: 1.153238 Oct 18 15:58:44.234926 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2976/5930] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:58:43 2022] GET /compute/v2.1/servers/258517fa-d3ca-4b69-87e0-a2ea38ce3ce6 => generated 1472 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:58:45.263232 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:58:45.272318 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-80bbb7f1-baec-4355-98dc-a69c3bb05c69 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:58:45.274707 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-80bbb7f1-baec-4355-98dc-a69c3bb05c69 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] [instance: 258517fa-d3ca-4b69-87e0-a2ea38ce3ce6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:58:45.292909 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80bbb7f1-baec-4355-98dc-a69c3bb05c69 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:58:45.293829 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80bbb7f1-baec-4355-98dc-a69c3bb05c69 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:58:45.295203 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80bbb7f1-baec-4355-98dc-a69c3bb05c69 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:58:45.297801 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80bbb7f1-baec-4355-98dc-a69c3bb05c69 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:58:45.298758 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80bbb7f1-baec-4355-98dc-a69c3bb05c69 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:58:45.300355 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80bbb7f1-baec-4355-98dc-a69c3bb05c69 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:58:46.252020 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-80bbb7f1-baec-4355-98dc-a69c3bb05c69 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab5a58990724e7bbbf18025ccdfcc1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62510e4663941a9ae5a7c4a810d316c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:58:46.269878 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-80bbb7f1-baec-4355-98dc-a69c3bb05c69 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] 10.222.0.60 "GET /compute/v2.1/servers/258517fa-d3ca-4b69-87e0-a2ea38ce3ce6" status: 200 len: 1472 microversion: 2.1 time: 1.009605 Oct 18 15:58:46.289804 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2955/5931] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:58:45 2022] GET /compute/v2.1/servers/258517fa-d3ca-4b69-87e0-a2ea38ce3ce6 => generated 1472 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:58:47.300536 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7b36a747-1520-42ab-b2f7-181ae0739e59 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:58:47.301305 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7b36a747-1520-42ab-b2f7-181ae0739e59 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] [instance: 258517fa-d3ca-4b69-87e0-a2ea38ce3ce6] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:58:47.314606 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7b36a747-1520-42ab-b2f7-181ae0739e59 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:58:47.315058 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7b36a747-1520-42ab-b2f7-181ae0739e59 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:58:47.315507 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7b36a747-1520-42ab-b2f7-181ae0739e59 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:58:47.319612 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7b36a747-1520-42ab-b2f7-181ae0739e59 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:58:47.322344 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7b36a747-1520-42ab-b2f7-181ae0739e59 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:58:47.324497 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7b36a747-1520-42ab-b2f7-181ae0739e59 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:58:47.542731 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7b36a747-1520-42ab-b2f7-181ae0739e59 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab5a58990724e7bbbf18025ccdfcc1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62510e4663941a9ae5a7c4a810d316c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:58:47.551869 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7b36a747-1520-42ab-b2f7-181ae0739e59 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] 10.222.0.60 "GET /compute/v2.1/servers/258517fa-d3ca-4b69-87e0-a2ea38ce3ce6" status: 200 len: 1472 microversion: 2.1 time: 0.255935 Oct 18 15:58:47.553315 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2977/5932] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:58:47 2022] GET /compute/v2.1/servers/258517fa-d3ca-4b69-87e0-a2ea38ce3ce6 => generated 1472 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:58:48.586659 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d0e90c50-4b0d-477d-837b-193b0efdfeb4 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:58:48.587906 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d0e90c50-4b0d-477d-837b-193b0efdfeb4 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] [instance: 258517fa-d3ca-4b69-87e0-a2ea38ce3ce6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:58:48.616463 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0e90c50-4b0d-477d-837b-193b0efdfeb4 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:58:48.617613 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0e90c50-4b0d-477d-837b-193b0efdfeb4 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:58:48.618068 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0e90c50-4b0d-477d-837b-193b0efdfeb4 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:58:48.618800 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0e90c50-4b0d-477d-837b-193b0efdfeb4 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:58:48.619259 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0e90c50-4b0d-477d-837b-193b0efdfeb4 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:58:48.619687 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0e90c50-4b0d-477d-837b-193b0efdfeb4 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:58:49.701824 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d0e90c50-4b0d-477d-837b-193b0efdfeb4 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab5a58990724e7bbbf18025ccdfcc1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62510e4663941a9ae5a7c4a810d316c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:58:49.718756 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d0e90c50-4b0d-477d-837b-193b0efdfeb4 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] 10.222.0.60 "GET /compute/v2.1/servers/258517fa-d3ca-4b69-87e0-a2ea38ce3ce6" status: 200 len: 1472 microversion: 2.1 time: 1.138603 Oct 18 15:58:49.724955 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2956/5933] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:58:48 2022] GET /compute/v2.1/servers/258517fa-d3ca-4b69-87e0-a2ea38ce3ce6 => generated 1472 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:58:50.755021 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-66ec2787-8572-43c2-b534-4267d7d4c811 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:58:50.755633 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-66ec2787-8572-43c2-b534-4267d7d4c811 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] [instance: 258517fa-d3ca-4b69-87e0-a2ea38ce3ce6] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:58:50.784612 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-66ec2787-8572-43c2-b534-4267d7d4c811 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:58:50.787847 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-66ec2787-8572-43c2-b534-4267d7d4c811 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:58:50.788377 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-66ec2787-8572-43c2-b534-4267d7d4c811 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:58:50.789113 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-66ec2787-8572-43c2-b534-4267d7d4c811 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:58:50.794425 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-66ec2787-8572-43c2-b534-4267d7d4c811 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:58:50.799586 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-66ec2787-8572-43c2-b534-4267d7d4c811 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:58:50.864025 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-2313255a-77a8-4002-a6f5-6a3e4a5c41be req-9612c2e3-bc87-4efe-9abe-59b0371b66aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "258517fa-d3ca-4b69-87e0-a2ea38ce3ce6", "name": "network-vif-plugged", "status": "completed", "tag": "e1bb89df-1467-49a0-8f2f-09537d27a571"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:58:50.890693 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2313255a-77a8-4002-a6f5-6a3e4a5c41be req-9612c2e3-bc87-4efe-9abe-59b0371b66aa service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:58:50.897810 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2313255a-77a8-4002-a6f5-6a3e4a5c41be req-9612c2e3-bc87-4efe-9abe-59b0371b66aa service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:58:50.899858 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2313255a-77a8-4002-a6f5-6a3e4a5c41be req-9612c2e3-bc87-4efe-9abe-59b0371b66aa service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:58:50.949915 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-2313255a-77a8-4002-a6f5-6a3e4a5c41be req-9612c2e3-bc87-4efe-9abe-59b0371b66aa service nova] Creating event network-vif-plugged:e1bb89df-1467-49a0-8f2f-09537d27a571 for instance 258517fa-d3ca-4b69-87e0-a2ea38ce3ce6 on n-h2-853682-5 Oct 18 15:58:50.979729 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-2313255a-77a8-4002-a6f5-6a3e4a5c41be req-9612c2e3-bc87-4efe-9abe-59b0371b66aa service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114672 Oct 18 15:58:50.981421 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2957/5934] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 18 15:58:51.267140 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-66ec2787-8572-43c2-b534-4267d7d4c811 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab5a58990724e7bbbf18025ccdfcc1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62510e4663941a9ae5a7c4a810d316c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:58:51.276290 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-66ec2787-8572-43c2-b534-4267d7d4c811 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] 10.222.0.60 "GET /compute/v2.1/servers/258517fa-d3ca-4b69-87e0-a2ea38ce3ce6" status: 200 len: 1472 microversion: 2.1 time: 0.526193 Oct 18 15:58:51.281236 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2978/5935] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:58:50 2022] GET /compute/v2.1/servers/258517fa-d3ca-4b69-87e0-a2ea38ce3ce6 => generated 1472 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:58:52.308263 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-52fa8bc5-d6e2-4fcc-b578-36242e108474 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:58:52.309861 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-52fa8bc5-d6e2-4fcc-b578-36242e108474 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] [instance: 258517fa-d3ca-4b69-87e0-a2ea38ce3ce6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:58:52.324167 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52fa8bc5-d6e2-4fcc-b578-36242e108474 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:58:52.331895 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52fa8bc5-d6e2-4fcc-b578-36242e108474 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:58:52.332520 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52fa8bc5-d6e2-4fcc-b578-36242e108474 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:58:52.333427 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52fa8bc5-d6e2-4fcc-b578-36242e108474 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:58:52.334009 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52fa8bc5-d6e2-4fcc-b578-36242e108474 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:58:52.334571 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52fa8bc5-d6e2-4fcc-b578-36242e108474 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:58:54.171850 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-52fa8bc5-d6e2-4fcc-b578-36242e108474 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab5a58990724e7bbbf18025ccdfcc1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62510e4663941a9ae5a7c4a810d316c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:58:54.201417 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-52fa8bc5-d6e2-4fcc-b578-36242e108474 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] 10.222.0.60 "GET /compute/v2.1/servers/258517fa-d3ca-4b69-87e0-a2ea38ce3ce6" status: 200 len: 1472 microversion: 2.1 time: 1.897120 Oct 18 15:58:54.208931 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2958/5936] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:58:52 2022] GET /compute/v2.1/servers/258517fa-d3ca-4b69-87e0-a2ea38ce3ce6 => generated 1472 bytes in 1906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:58:55.236478 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-24cb6034-69cd-49f6-b399-c1c72ee00e2e tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:58:55.238161 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-24cb6034-69cd-49f6-b399-c1c72ee00e2e tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] [instance: 258517fa-d3ca-4b69-87e0-a2ea38ce3ce6] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:58:55.270141 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-24cb6034-69cd-49f6-b399-c1c72ee00e2e tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:58:55.274911 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-24cb6034-69cd-49f6-b399-c1c72ee00e2e tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:58:55.275413 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-24cb6034-69cd-49f6-b399-c1c72ee00e2e tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:58:55.276185 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-24cb6034-69cd-49f6-b399-c1c72ee00e2e tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:58:55.276670 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-24cb6034-69cd-49f6-b399-c1c72ee00e2e tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:58:55.281507 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-24cb6034-69cd-49f6-b399-c1c72ee00e2e tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:58:55.868669 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-24cb6034-69cd-49f6-b399-c1c72ee00e2e tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab5a58990724e7bbbf18025ccdfcc1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62510e4663941a9ae5a7c4a810d316c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:58:55.883480 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-24cb6034-69cd-49f6-b399-c1c72ee00e2e tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] 10.222.0.60 "GET /compute/v2.1/servers/258517fa-d3ca-4b69-87e0-a2ea38ce3ce6" status: 200 len: 1644 microversion: 2.1 time: 0.649148 Oct 18 15:58:55.884207 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2979/5937] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:58:55 2022] GET /compute/v2.1/servers/258517fa-d3ca-4b69-87e0-a2ea38ce3ce6 => generated 1644 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:58:55.911002 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9997fe5b-8441-4d4a-9c6a-c2f51988f144 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:58:55.911763 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9997fe5b-8441-4d4a-9c6a-c2f51988f144 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] [instance: 258517fa-d3ca-4b69-87e0-a2ea38ce3ce6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:58:55.936452 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9997fe5b-8441-4d4a-9c6a-c2f51988f144 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:58:55.937003 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9997fe5b-8441-4d4a-9c6a-c2f51988f144 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:58:55.937449 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9997fe5b-8441-4d4a-9c6a-c2f51988f144 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:58:55.938173 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9997fe5b-8441-4d4a-9c6a-c2f51988f144 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:58:55.938636 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9997fe5b-8441-4d4a-9c6a-c2f51988f144 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:58:55.939067 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9997fe5b-8441-4d4a-9c6a-c2f51988f144 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:58:56.535254 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9997fe5b-8441-4d4a-9c6a-c2f51988f144 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab5a58990724e7bbbf18025ccdfcc1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62510e4663941a9ae5a7c4a810d316c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:58:56.545823 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9997fe5b-8441-4d4a-9c6a-c2f51988f144 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] 10.222.0.60 "GET /compute/v2.1/servers/258517fa-d3ca-4b69-87e0-a2ea38ce3ce6" status: 200 len: 1644 microversion: 2.1 time: 0.643270 Oct 18 15:58:56.548827 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2959/5938] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:58:55 2022] GET /compute/v2.1/servers/258517fa-d3ca-4b69-87e0-a2ea38ce3ce6 => generated 1644 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:58:56.595421 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c4be0922-e1f7-4b0c-9f18-5c7de52de2f8 tempest-TestSecurityGroupsBasicOps-708900150 tempest-TestSecurityGroupsBasicOps-708900150-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:58:56.596068 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c4be0922-e1f7-4b0c-9f18-5c7de52de2f8 tempest-TestSecurityGroupsBasicOps-708900150 tempest-TestSecurityGroupsBasicOps-708900150-project-admin] [instance: 258517fa-d3ca-4b69-87e0-a2ea38ce3ce6] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:58:56.612094 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c4be0922-e1f7-4b0c-9f18-5c7de52de2f8 tempest-TestSecurityGroupsBasicOps-708900150 tempest-TestSecurityGroupsBasicOps-708900150-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:58:56.612588 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c4be0922-e1f7-4b0c-9f18-5c7de52de2f8 tempest-TestSecurityGroupsBasicOps-708900150 tempest-TestSecurityGroupsBasicOps-708900150-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:58:56.616381 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c4be0922-e1f7-4b0c-9f18-5c7de52de2f8 tempest-TestSecurityGroupsBasicOps-708900150 tempest-TestSecurityGroupsBasicOps-708900150-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:58:56.618373 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c4be0922-e1f7-4b0c-9f18-5c7de52de2f8 tempest-TestSecurityGroupsBasicOps-708900150 tempest-TestSecurityGroupsBasicOps-708900150-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:58:56.620021 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c4be0922-e1f7-4b0c-9f18-5c7de52de2f8 tempest-TestSecurityGroupsBasicOps-708900150 tempest-TestSecurityGroupsBasicOps-708900150-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:58:56.620656 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c4be0922-e1f7-4b0c-9f18-5c7de52de2f8 tempest-TestSecurityGroupsBasicOps-708900150 tempest-TestSecurityGroupsBasicOps-708900150-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:58:57.659205 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c4be0922-e1f7-4b0c-9f18-5c7de52de2f8 tempest-TestSecurityGroupsBasicOps-708900150 tempest-TestSecurityGroupsBasicOps-708900150-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/258517fa-d3ca-4b69-87e0-a2ea38ce3ce6" status: 200 len: 1795 microversion: 2.1 time: 1.082586 Oct 18 15:58:57.665896 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2980/5939] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:58:56 2022] GET /compute/v2.1/servers/258517fa-d3ca-4b69-87e0-a2ea38ce3ce6 => generated 1795 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:59:07.173458 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-4bc57e12-bc92-4fc9-a96c-317355101721 req-3d90869a-c6d6-43bd-8e96-de1b87d56d53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "258517fa-d3ca-4b69-87e0-a2ea38ce3ce6", "tag": "e1bb89df-1467-49a0-8f2f-09537d27a571"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:59:07.195715 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=20 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:59:07.199177 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=40 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:59:07.202969 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4bc57e12-bc92-4fc9-a96c-317355101721 req-3d90869a-c6d6-43bd-8e96-de1b87d56d53 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:59:07.209070 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4bc57e12-bc92-4fc9-a96c-317355101721 req-3d90869a-c6d6-43bd-8e96-de1b87d56d53 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:59:07.209962 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4bc57e12-bc92-4fc9-a96c-317355101721 req-3d90869a-c6d6-43bd-8e96-de1b87d56d53 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:59:07.242386 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-4bc57e12-bc92-4fc9-a96c-317355101721 req-3d90869a-c6d6-43bd-8e96-de1b87d56d53 service nova] Creating event network-changed:e1bb89df-1467-49a0-8f2f-09537d27a571 for instance 258517fa-d3ca-4b69-87e0-a2ea38ce3ce6 on n-h2-853682-5 Oct 18 15:59:07.255996 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-4bc57e12-bc92-4fc9-a96c-317355101721 req-3d90869a-c6d6-43bd-8e96-de1b87d56d53 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090068 Oct 18 15:59:07.262603 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2960/5940] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:59:37.309686 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7c83bbf8-305a-410a-9dce-4908c15e837f tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:59:37.310444 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7c83bbf8-305a-410a-9dce-4908c15e837f tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] [instance: 8e57d947-495e-49ab-ab4a-69394abb0fb5] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:59:37.324697 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:59:37.326877 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=50 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:59:37.329541 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7c83bbf8-305a-410a-9dce-4908c15e837f tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:59:37.333154 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7c83bbf8-305a-410a-9dce-4908c15e837f tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:59:37.333916 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7c83bbf8-305a-410a-9dce-4908c15e837f tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:59:37.334876 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7c83bbf8-305a-410a-9dce-4908c15e837f tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:59:37.336107 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7c83bbf8-305a-410a-9dce-4908c15e837f tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:59:37.337310 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7c83bbf8-305a-410a-9dce-4908c15e837f tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:59:37.963323 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-7c83bbf8-305a-410a-9dce-4908c15e837f tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lazy-loading 'services' on Instance uuid 8e57d947-495e-49ab-ab4a-69394abb0fb5 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:59:38.154209 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7c83bbf8-305a-410a-9dce-4908c15e837f tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8e57d947-495e-49ab-ab4a-69394abb0fb5/os-volume_attachments/3a5e7a68-6f50-416c-97e0-d77ce710080f" status: 202 len: 0 microversion: 2.1 time: 0.850832 Oct 18 15:59:38.176074 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2981/5941] 10.222.0.60 () {58 vars in 1416 bytes} [Tue Oct 18 15:59:37 2022] DELETE /compute/v2.1/servers/8e57d947-495e-49ab-ab4a-69394abb0fb5/os-volume_attachments/3a5e7a68-6f50-416c-97e0-d77ce710080f => generated 0 bytes in 873 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:59:48.476254 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-898c9d72-039d-4edd-a14f-71f9da7d8294 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:59:48.477411 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-898c9d72-039d-4edd-a14f-71f9da7d8294 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] [instance: 8e57d947-495e-49ab-ab4a-69394abb0fb5] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:59:48.500003 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:59:48.503517 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:59:48.505443 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-898c9d72-039d-4edd-a14f-71f9da7d8294 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:59:48.508285 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-898c9d72-039d-4edd-a14f-71f9da7d8294 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:59:48.509134 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-898c9d72-039d-4edd-a14f-71f9da7d8294 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:59:48.510369 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-898c9d72-039d-4edd-a14f-71f9da7d8294 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:59:48.511693 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-898c9d72-039d-4edd-a14f-71f9da7d8294 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:59:48.512323 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-898c9d72-039d-4edd-a14f-71f9da7d8294 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:59:48.601902 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-898c9d72-039d-4edd-a14f-71f9da7d8294 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] [instance: 8e57d947-495e-49ab-ab4a-69394abb0fb5] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:59:48.819764 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-898c9d72-039d-4edd-a14f-71f9da7d8294 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8e57d947-495e-49ab-ab4a-69394abb0fb5" status: 204 len: 0 microversion: 2.1 time: 0.381114 Oct 18 15:59:48.821985 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2961/5942] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 15:59:48 2022] DELETE /compute/v2.1/servers/8e57d947-495e-49ab-ab4a-69394abb0fb5 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:59:48.830315 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:59:48.831007 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:59:48.835689 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d116f1ba-6981-417b-888a-2909cde8252b tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:59:48.836614 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d116f1ba-6981-417b-888a-2909cde8252b tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] [instance: 8e57d947-495e-49ab-ab4a-69394abb0fb5] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:59:48.867325 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d116f1ba-6981-417b-888a-2909cde8252b tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:59:48.873000 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d116f1ba-6981-417b-888a-2909cde8252b tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:59:48.873504 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d116f1ba-6981-417b-888a-2909cde8252b tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:59:48.874417 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d116f1ba-6981-417b-888a-2909cde8252b tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:59:48.876328 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d116f1ba-6981-417b-888a-2909cde8252b tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:59:48.876772 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d116f1ba-6981-417b-888a-2909cde8252b tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:59:49.187693 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d116f1ba-6981-417b-888a-2909cde8252b tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff793c58c02491f82c4de2c0d882bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f6fd4e41e540ed8ce96e8de88311f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:59:49.197164 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d116f1ba-6981-417b-888a-2909cde8252b tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] 10.222.0.60 "GET /compute/v2.1/servers/8e57d947-495e-49ab-ab4a-69394abb0fb5" status: 200 len: 1469 microversion: 2.1 time: 0.369917 Oct 18 15:59:49.218874 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2982/5943] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:59:48 2022] GET /compute/v2.1/servers/8e57d947-495e-49ab-ab4a-69394abb0fb5 => generated 1469 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:59:50.226041 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2332424f-b9c0-434a-bac7-733df4630495 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:59:50.226932 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2332424f-b9c0-434a-bac7-733df4630495 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] [instance: 8e57d947-495e-49ab-ab4a-69394abb0fb5] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:59:50.236446 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2332424f-b9c0-434a-bac7-733df4630495 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:59:50.243751 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2332424f-b9c0-434a-bac7-733df4630495 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:59:50.244394 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2332424f-b9c0-434a-bac7-733df4630495 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:59:50.245379 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2332424f-b9c0-434a-bac7-733df4630495 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:59:50.245960 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2332424f-b9c0-434a-bac7-733df4630495 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:59:50.248442 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2332424f-b9c0-434a-bac7-733df4630495 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:59:51.082757 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ab52de63-80ee-4b2c-a4c4-ff43a27655d7 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1004973558", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "9fc0c884-26cc-4756-b462-1b060f53d5e3"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1681176835", "security_groups": []}, "os:scheduler_hints": {"different_host": ["258517fa-d3ca-4b69-87e0-a2ea38ce3ce6"]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:59:51.237601 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-ab52de63-80ee-4b2c-a4c4-ff43a27655d7 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] validate_networks() for [('9fc0c884-26cc-4756-b462-1b060f53d5e3', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:59:52.010389 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2332424f-b9c0-434a-bac7-733df4630495 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff793c58c02491f82c4de2c0d882bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f6fd4e41e540ed8ce96e8de88311f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:59:52.023319 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2332424f-b9c0-434a-bac7-733df4630495 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] 10.222.0.60 "GET /compute/v2.1/servers/8e57d947-495e-49ab-ab4a-69394abb0fb5" status: 200 len: 1469 microversion: 2.1 time: 1.801966 Oct 18 15:59:52.027297 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2962/5944] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:59:50 2022] GET /compute/v2.1/servers/8e57d947-495e-49ab-ab4a-69394abb0fb5 => generated 1469 bytes in 1806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:59:52.870801 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-ee42719b-0e23-4f63-a900-036a47ac8bed req-7fd20a66-cd3e-4b8b-bf57-e6e4e540f28a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e57d947-495e-49ab-ab4a-69394abb0fb5", "name": "network-vif-deleted", "tag": "8fec50f3-1db1-4a3c-8cae-67ad06271041"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:59:52.907785 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ee42719b-0e23-4f63-a900-036a47ac8bed req-7fd20a66-cd3e-4b8b-bf57-e6e4e540f28a service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:59:52.909312 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-ab52de63-80ee-4b2c-a4c4-ff43a27655d7 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:59:52.910355 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-ab52de63-80ee-4b2c-a4c4-ff43a27655d7 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:59:52.911231 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-ab52de63-80ee-4b2c-a4c4-ff43a27655d7 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:59:52.912021 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-ab52de63-80ee-4b2c-a4c4-ff43a27655d7 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:59:52.912527 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ee42719b-0e23-4f63-a900-036a47ac8bed req-7fd20a66-cd3e-4b8b-bf57-e6e4e540f28a service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:59:52.912951 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-ab52de63-80ee-4b2c-a4c4-ff43a27655d7 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:59:52.913150 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ee42719b-0e23-4f63-a900-036a47ac8bed req-7fd20a66-cd3e-4b8b-bf57-e6e4e540f28a service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:59:52.931053 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ab52de63-80ee-4b2c-a4c4-ff43a27655d7 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:59:52.931885 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ab52de63-80ee-4b2c-a4c4-ff43a27655d7 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:59:52.933590 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ab52de63-80ee-4b2c-a4c4-ff43a27655d7 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:59:52.936620 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ab52de63-80ee-4b2c-a4c4-ff43a27655d7 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:59:52.947615 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ab52de63-80ee-4b2c-a4c4-ff43a27655d7 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:59:52.947788 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-ee42719b-0e23-4f63-a900-036a47ac8bed req-7fd20a66-cd3e-4b8b-bf57-e6e4e540f28a service nova] Creating event network-vif-deleted:8fec50f3-1db1-4a3c-8cae-67ad06271041 for instance 8e57d947-495e-49ab-ab4a-69394abb0fb5 on n-h1-853682-5 Oct 18 15:59:52.950505 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ab52de63-80ee-4b2c-a4c4-ff43a27655d7 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:59:52.953607 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-ee42719b-0e23-4f63-a900-036a47ac8bed req-7fd20a66-cd3e-4b8b-bf57-e6e4e540f28a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087017 Oct 18 15:59:52.954738 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2963/5945] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 15:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:59:52.992333 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-ab52de63-80ee-4b2c-a4c4-ff43a27655d7 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Getting quotas for project d62510e4663941a9ae5a7c4a810d316c. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:59:52.999237 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-ab52de63-80ee-4b2c-a4c4-ff43a27655d7 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Getting quotas for user bab5a58990724e7bbbf18025ccdfcc1f and project d62510e4663941a9ae5a7c4a810d316c. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:59:53.016564 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ab52de63-80ee-4b2c-a4c4-ff43a27655d7 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:59:53.019593 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ab52de63-80ee-4b2c-a4c4-ff43a27655d7 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] [instance: 8512c248-e512-4728-934f-ba2d3e62aed3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:59:53.048998 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c546e0e0-fca5-4c99-8d40-529e512523de tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:59:53.049693 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c546e0e0-fca5-4c99-8d40-529e512523de tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] [instance: 8e57d947-495e-49ab-ab4a-69394abb0fb5] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:59:53.060635 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c546e0e0-fca5-4c99-8d40-529e512523de tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:59:53.061168 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c546e0e0-fca5-4c99-8d40-529e512523de tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:59:53.061617 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c546e0e0-fca5-4c99-8d40-529e512523de tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:59:53.062339 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c546e0e0-fca5-4c99-8d40-529e512523de tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:59:53.062804 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c546e0e0-fca5-4c99-8d40-529e512523de tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:59:53.063234 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c546e0e0-fca5-4c99-8d40-529e512523de tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:59:53.086637 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ab52de63-80ee-4b2c-a4c4-ff43a27655d7 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 2.017197 Oct 18 15:59:53.087831 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2983/5946] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:59:51 2022] POST /compute/v2.1/servers => generated 361 bytes in 2019 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:59:53.100712 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-68e25b93-2e51-4eca-9e89-b1c1521b0a67 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:59:53.102268 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-68e25b93-2e51-4eca-9e89-b1c1521b0a67 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] [instance: 8512c248-e512-4728-934f-ba2d3e62aed3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:59:53.208698 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c546e0e0-fca5-4c99-8d40-529e512523de tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:59:53.211314 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c546e0e0-fca5-4c99-8d40-529e512523de tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:59:53.213131 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c546e0e0-fca5-4c99-8d40-529e512523de tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:59:53.215611 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-c546e0e0-fca5-4c99-8d40-529e512523de tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lazy-loading 'fault' on Instance uuid 8e57d947-495e-49ab-ab4a-69394abb0fb5 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:59:53.734660 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-68e25b93-2e51-4eca-9e89-b1c1521b0a67 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab5a58990724e7bbbf18025ccdfcc1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62510e4663941a9ae5a7c4a810d316c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:59:53.760850 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c546e0e0-fca5-4c99-8d40-529e512523de tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff793c58c02491f82c4de2c0d882bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f6fd4e41e540ed8ce96e8de88311f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:59:53.765771 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-68e25b93-2e51-4eca-9e89-b1c1521b0a67 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] 10.222.0.60 "GET /compute/v2.1/servers/8512c248-e512-4728-934f-ba2d3e62aed3" status: 200 len: 1242 microversion: 2.1 time: 0.660066 Oct 18 15:59:53.766442 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2984/5947] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:59:53 2022] GET /compute/v2.1/servers/8512c248-e512-4728-934f-ba2d3e62aed3 => generated 1242 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:59:53.784456 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c546e0e0-fca5-4c99-8d40-529e512523de tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] 10.222.0.60 "GET /compute/v2.1/servers/8e57d947-495e-49ab-ab4a-69394abb0fb5" status: 200 len: 1303 microversion: 2.1 time: 0.740783 Oct 18 15:59:53.785462 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2964/5948] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:59:53 2022] GET /compute/v2.1/servers/8e57d947-495e-49ab-ab4a-69394abb0fb5 => generated 1303 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:59:54.789954 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bbf6fb7a-f5be-429e-880f-5f50969dca85 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:59:54.790482 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-bbf6fb7a-f5be-429e-880f-5f50969dca85 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] [instance: 8512c248-e512-4728-934f-ba2d3e62aed3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:59:54.813367 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fd319217-8b38-4d00-8396-467bd6603090 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:59:54.814001 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fd319217-8b38-4d00-8396-467bd6603090 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] [instance: 8e57d947-495e-49ab-ab4a-69394abb0fb5] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:59:54.823747 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd319217-8b38-4d00-8396-467bd6603090 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:59:54.824241 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd319217-8b38-4d00-8396-467bd6603090 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:59:54.828211 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bbf6fb7a-f5be-429e-880f-5f50969dca85 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:59:54.830454 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd319217-8b38-4d00-8396-467bd6603090 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:59:54.831099 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bbf6fb7a-f5be-429e-880f-5f50969dca85 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:59:54.832742 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd319217-8b38-4d00-8396-467bd6603090 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:59:54.834555 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bbf6fb7a-f5be-429e-880f-5f50969dca85 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:59:54.835585 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bbf6fb7a-f5be-429e-880f-5f50969dca85 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:59:54.836360 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd319217-8b38-4d00-8396-467bd6603090 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:59:54.837515 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bbf6fb7a-f5be-429e-880f-5f50969dca85 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:59:54.840744 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd319217-8b38-4d00-8396-467bd6603090 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:59:54.841866 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bbf6fb7a-f5be-429e-880f-5f50969dca85 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:59:54.890627 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-fd319217-8b38-4d00-8396-467bd6603090 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] HTTP exception thrown: Instance 8e57d947-495e-49ab-ab4a-69394abb0fb5 could not be found. Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fd319217-8b38-4d00-8396-467bd6603090 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Request method failure captured: Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/8e57d947-495e-49ab-ab4a-69394abb0fb5 HTTP/1.1 Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTszFy0jiWYHSH1Y3O9aWm4_dVeGNLywJjim0KoBPlBlV7qC52OEONxeb5bZ5FfAwX8Jqh_KPQP6FJqpZd4BlFdxx73z_6m4qfXi38SohbT00qbufrHIPkg99KIqzpUVygLeI1_V0t5uC8tUARXZiRKj24ddFjoPSuKFMdTAZOUqJhL0 Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: e5f6fd4e41e540ed8ce96e8de88311f6 Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-VolumesBackupsTest-1559549193 Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e5f6fd4e41e540ed8ce96e8de88311f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e5f6fd4e41e540ed8ce96e8de88311f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e5f6fd4e41e540ed8ce96e8de88311f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e5f6fd4e41e540ed8ce96e8de88311f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-VolumesBackupsTest-1559549193 Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: e5f6fd4e41e540ed8ce96e8de88311f6 Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-VolumesBackupsTest-1559549193 Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-VolumesBackupsTest-1559549193-project Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: eff793c58c02491f82c4de2c0d882bd3 Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-VolumesBackupsTest-1559549193-project Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 8e57d947-495e-49ab-ab4a-69394abb0fb5 could not be found. Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '8e57d947-495e-49ab-ab4a-69394abb0fb5'} Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e57d947-495e-49ab-ab4a-69394abb0fb5 could not be found. Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e57d947-495e-49ab-ab4a-69394abb0fb5 could not be found. Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:59:54.899148 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:59:54.902608 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:59:54.902608 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:59:54.902608 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:59:54.902608 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:59:54.902608 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:59:54.902608 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e57d947-495e-49ab-ab4a-69394abb0fb5 could not be found. Oct 18 15:59:54.902608 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 15:59:54.906963 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fd319217-8b38-4d00-8396-467bd6603090 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] Returning 404 to user: Instance 8e57d947-495e-49ab-ab4a-69394abb0fb5 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:59:54.909135 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fd319217-8b38-4d00-8396-467bd6603090 tempest-VolumesBackupsTest-1559549193 tempest-VolumesBackupsTest-1559549193-project] 10.222.0.60 "GET /compute/v2.1/servers/8e57d947-495e-49ab-ab4a-69394abb0fb5" status: 404 len: 111 microversion: 2.1 time: 0.101225 Oct 18 15:59:54.910143 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2965/5949] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:59:54 2022] GET /compute/v2.1/servers/8e57d947-495e-49ab-ab4a-69394abb0fb5 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:59:55.096210 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-bbf6fb7a-f5be-429e-880f-5f50969dca85 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab5a58990724e7bbbf18025ccdfcc1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62510e4663941a9ae5a7c4a810d316c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:59:55.113334 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-bbf6fb7a-f5be-429e-880f-5f50969dca85 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] 10.222.0.60 "GET /compute/v2.1/servers/8512c248-e512-4728-934f-ba2d3e62aed3" status: 200 len: 1238 microversion: 2.1 time: 0.328549 Oct 18 15:59:55.117360 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2985/5950] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:59:54 2022] GET /compute/v2.1/servers/8512c248-e512-4728-934f-ba2d3e62aed3 => generated 1238 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:59:56.159023 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8ecedd83-0c49-4dd9-8eaf-5ebdfb2c8274 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:59:56.160282 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8ecedd83-0c49-4dd9-8eaf-5ebdfb2c8274 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] [instance: 8512c248-e512-4728-934f-ba2d3e62aed3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:59:56.186376 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ecedd83-0c49-4dd9-8eaf-5ebdfb2c8274 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:59:56.186870 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ecedd83-0c49-4dd9-8eaf-5ebdfb2c8274 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:59:56.190502 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ecedd83-0c49-4dd9-8eaf-5ebdfb2c8274 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:59:56.194715 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ecedd83-0c49-4dd9-8eaf-5ebdfb2c8274 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:59:56.195416 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ecedd83-0c49-4dd9-8eaf-5ebdfb2c8274 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:59:56.199215 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ecedd83-0c49-4dd9-8eaf-5ebdfb2c8274 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:59:56.927819 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8ecedd83-0c49-4dd9-8eaf-5ebdfb2c8274 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab5a58990724e7bbbf18025ccdfcc1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62510e4663941a9ae5a7c4a810d316c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:59:56.944380 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8ecedd83-0c49-4dd9-8eaf-5ebdfb2c8274 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] 10.222.0.60 "GET /compute/v2.1/servers/8512c248-e512-4728-934f-ba2d3e62aed3" status: 200 len: 1300 microversion: 2.1 time: 0.793603 Oct 18 15:59:56.946256 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2966/5951] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:59:56 2022] GET /compute/v2.1/servers/8512c248-e512-4728-934f-ba2d3e62aed3 => generated 1300 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:59:57.808775 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-be9d9828-a702-4648-b32c-09c1a313c9a2 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1686676113", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "b29b5e8d-8d62-4a96-84cc-f2fc554f1459"}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:59:57.939634 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-be9d9828-a702-4648-b32c-09c1a313c9a2 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] validate_networks() for [('b29b5e8d-8d62-4a96-84cc-f2fc554f1459', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 15:59:57.973981 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f35e0c3a-dfaf-426d-83f7-bf8d688933c2 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:59:57.979571 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f35e0c3a-dfaf-426d-83f7-bf8d688933c2 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] [instance: 8512c248-e512-4728-934f-ba2d3e62aed3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:59:57.991691 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f35e0c3a-dfaf-426d-83f7-bf8d688933c2 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:59:57.992208 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f35e0c3a-dfaf-426d-83f7-bf8d688933c2 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:59:57.992645 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f35e0c3a-dfaf-426d-83f7-bf8d688933c2 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:59:58.021140 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f35e0c3a-dfaf-426d-83f7-bf8d688933c2 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:59:58.021821 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f35e0c3a-dfaf-426d-83f7-bf8d688933c2 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:59:58.022285 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f35e0c3a-dfaf-426d-83f7-bf8d688933c2 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:59:58.926835 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f35e0c3a-dfaf-426d-83f7-bf8d688933c2 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab5a58990724e7bbbf18025ccdfcc1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62510e4663941a9ae5a7c4a810d316c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:59:58.940843 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f35e0c3a-dfaf-426d-83f7-bf8d688933c2 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] 10.222.0.60 "GET /compute/v2.1/servers/8512c248-e512-4728-934f-ba2d3e62aed3" status: 200 len: 1300 microversion: 2.1 time: 0.972941 Oct 18 15:59:58.941650 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2967/5952] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:59:57 2022] GET /compute/v2.1/servers/8512c248-e512-4728-934f-ba2d3e62aed3 => generated 1300 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:59:59.968225 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bdf62b4d-1ba4-4cb8-b736-c869c3873bc3 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:59:59.968883 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bdf62b4d-1ba4-4cb8-b736-c869c3873bc3 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] [instance: 8512c248-e512-4728-934f-ba2d3e62aed3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:59:59.984313 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bdf62b4d-1ba4-4cb8-b736-c869c3873bc3 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:59:59.989626 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bdf62b4d-1ba4-4cb8-b736-c869c3873bc3 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:59:59.990391 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bdf62b4d-1ba4-4cb8-b736-c869c3873bc3 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:59:59.991602 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bdf62b4d-1ba4-4cb8-b736-c869c3873bc3 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:59:59.992223 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bdf62b4d-1ba4-4cb8-b736-c869c3873bc3 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:59:59.992844 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bdf62b4d-1ba4-4cb8-b736-c869c3873bc3 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:00.242890 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bdf62b4d-1ba4-4cb8-b736-c869c3873bc3 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab5a58990724e7bbbf18025ccdfcc1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62510e4663941a9ae5a7c4a810d316c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:00.254482 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bdf62b4d-1ba4-4cb8-b736-c869c3873bc3 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] 10.222.0.60 "GET /compute/v2.1/servers/8512c248-e512-4728-934f-ba2d3e62aed3" status: 200 len: 1300 microversion: 2.1 time: 0.290036 Oct 18 16:00:00.256370 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2968/5953] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 15:59:59 2022] GET /compute/v2.1/servers/8512c248-e512-4728-934f-ba2d3e62aed3 => generated 1300 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:00:00.499623 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-be9d9828-a702-4648-b32c-09c1a313c9a2 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:00:00.500463 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-be9d9828-a702-4648-b32c-09c1a313c9a2 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:00:00.501039 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-be9d9828-a702-4648-b32c-09c1a313c9a2 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:00:00.501527 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-be9d9828-a702-4648-b32c-09c1a313c9a2 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:00:00.502291 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-be9d9828-a702-4648-b32c-09c1a313c9a2 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:00:00.527202 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-be9d9828-a702-4648-b32c-09c1a313c9a2 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:00.528276 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-be9d9828-a702-4648-b32c-09c1a313c9a2 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:00.528723 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-be9d9828-a702-4648-b32c-09c1a313c9a2 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:00.529494 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-be9d9828-a702-4648-b32c-09c1a313c9a2 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:00.529960 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-be9d9828-a702-4648-b32c-09c1a313c9a2 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:00.530397 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-be9d9828-a702-4648-b32c-09c1a313c9a2 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:00.570638 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-be9d9828-a702-4648-b32c-09c1a313c9a2 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Getting quotas for project 1b40ce5bac1749458f339ddc4cde658f. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:00:00.587508 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-be9d9828-a702-4648-b32c-09c1a313c9a2 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Getting quotas for user 973b32f6d7094ab9b4368f908dfaaa3e and project 1b40ce5bac1749458f339ddc4cde658f. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:00:00.624912 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-be9d9828-a702-4648-b32c-09c1a313c9a2 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:00:00.627474 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-be9d9828-a702-4648-b32c-09c1a313c9a2 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] [instance: 82b24658-6a40-4370-a6da-0f6dabc6938a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:00:00.713399 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-be9d9828-a702-4648-b32c-09c1a313c9a2 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.359503 Oct 18 16:00:00.714495 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2986/5954] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 15:59:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 3361 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:00:00.726193 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fa499f01-8507-490f-94f7-5583c6323e30 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:00.727036 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fa499f01-8507-490f-94f7-5583c6323e30 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] [instance: 82b24658-6a40-4370-a6da-0f6dabc6938a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:00.828211 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fa499f01-8507-490f-94f7-5583c6323e30 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973b32f6d7094ab9b4368f908dfaaa3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b40ce5bac1749458f339ddc4cde658f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:00.840636 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fa499f01-8507-490f-94f7-5583c6323e30 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] 10.222.0.60 "GET /compute/v2.1/servers/82b24658-6a40-4370-a6da-0f6dabc6938a" status: 200 len: 1214 microversion: 2.1 time: 0.117689 Oct 18 16:00:00.842862 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2969/5955] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:00 2022] GET /compute/v2.1/servers/82b24658-6a40-4370-a6da-0f6dabc6938a => generated 1214 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:00.944824 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-44b1db94-d8fd-48a1-983d-c51ed78971c4 req-2eeff11b-c805-4464-890a-8228d21009a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8512c248-e512-4728-934f-ba2d3e62aed3", "tag": "12d6e278-4b98-4274-84b2-ddfb8542bca3"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:00:00.990040 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-44b1db94-d8fd-48a1-983d-c51ed78971c4 req-2eeff11b-c805-4464-890a-8228d21009a0 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:00.997600 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-44b1db94-d8fd-48a1-983d-c51ed78971c4 req-2eeff11b-c805-4464-890a-8228d21009a0 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:00.998662 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-44b1db94-d8fd-48a1-983d-c51ed78971c4 req-2eeff11b-c805-4464-890a-8228d21009a0 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:01.033338 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-44b1db94-d8fd-48a1-983d-c51ed78971c4 req-2eeff11b-c805-4464-890a-8228d21009a0 service nova] Creating event network-changed:12d6e278-4b98-4274-84b2-ddfb8542bca3 for instance 8512c248-e512-4728-934f-ba2d3e62aed3 on n-h1-853682-5 Oct 18 16:00:01.046796 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-44b1db94-d8fd-48a1-983d-c51ed78971c4 req-2eeff11b-c805-4464-890a-8228d21009a0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104388 Oct 18 16:00:01.049392 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2987/5956] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:00:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:00:01.278911 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-81ffcf6b-f976-44ea-b3fb-406e7431b6b2 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:01.279391 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-81ffcf6b-f976-44ea-b3fb-406e7431b6b2 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] [instance: 8512c248-e512-4728-934f-ba2d3e62aed3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:01.310062 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81ffcf6b-f976-44ea-b3fb-406e7431b6b2 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:01.310564 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81ffcf6b-f976-44ea-b3fb-406e7431b6b2 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:01.311012 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81ffcf6b-f976-44ea-b3fb-406e7431b6b2 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:01.311727 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81ffcf6b-f976-44ea-b3fb-406e7431b6b2 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:01.312195 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81ffcf6b-f976-44ea-b3fb-406e7431b6b2 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:01.312646 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81ffcf6b-f976-44ea-b3fb-406e7431b6b2 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:01.543924 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-81ffcf6b-f976-44ea-b3fb-406e7431b6b2 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab5a58990724e7bbbf18025ccdfcc1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62510e4663941a9ae5a7c4a810d316c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:01.569019 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-81ffcf6b-f976-44ea-b3fb-406e7431b6b2 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] 10.222.0.60 "GET /compute/v2.1/servers/8512c248-e512-4728-934f-ba2d3e62aed3" status: 200 len: 1300 microversion: 2.1 time: 0.282019 Oct 18 16:00:01.571337 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2970/5957] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:01 2022] GET /compute/v2.1/servers/8512c248-e512-4728-934f-ba2d3e62aed3 => generated 1300 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:01.869250 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-aa56ce5e-9426-45d1-b07d-6ab5fe7a51b7 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:01.870168 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-aa56ce5e-9426-45d1-b07d-6ab5fe7a51b7 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] [instance: 82b24658-6a40-4370-a6da-0f6dabc6938a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:01.886079 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aa56ce5e-9426-45d1-b07d-6ab5fe7a51b7 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:01.887569 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aa56ce5e-9426-45d1-b07d-6ab5fe7a51b7 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:01.888959 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aa56ce5e-9426-45d1-b07d-6ab5fe7a51b7 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:01.892940 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aa56ce5e-9426-45d1-b07d-6ab5fe7a51b7 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:01.894490 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aa56ce5e-9426-45d1-b07d-6ab5fe7a51b7 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:01.895021 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aa56ce5e-9426-45d1-b07d-6ab5fe7a51b7 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:02.092463 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-aa56ce5e-9426-45d1-b07d-6ab5fe7a51b7 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973b32f6d7094ab9b4368f908dfaaa3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b40ce5bac1749458f339ddc4cde658f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:02.123006 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-aa56ce5e-9426-45d1-b07d-6ab5fe7a51b7 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] 10.222.0.60 "GET /compute/v2.1/servers/82b24658-6a40-4370-a6da-0f6dabc6938a" status: 200 len: 1218 microversion: 2.1 time: 0.239854 Oct 18 16:00:02.127196 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2988/5958] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:01 2022] GET /compute/v2.1/servers/82b24658-6a40-4370-a6da-0f6dabc6938a => generated 1218 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:02.600131 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9bd4538a-b3ed-4b67-887c-a64494f92446 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:02.603391 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9bd4538a-b3ed-4b67-887c-a64494f92446 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] [instance: 8512c248-e512-4728-934f-ba2d3e62aed3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:02.623848 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9bd4538a-b3ed-4b67-887c-a64494f92446 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:02.630108 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9bd4538a-b3ed-4b67-887c-a64494f92446 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:02.632867 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9bd4538a-b3ed-4b67-887c-a64494f92446 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:02.634589 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9bd4538a-b3ed-4b67-887c-a64494f92446 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:02.639282 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9bd4538a-b3ed-4b67-887c-a64494f92446 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:02.640861 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9bd4538a-b3ed-4b67-887c-a64494f92446 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:03.071652 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9bd4538a-b3ed-4b67-887c-a64494f92446 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab5a58990724e7bbbf18025ccdfcc1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62510e4663941a9ae5a7c4a810d316c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:03.093826 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9bd4538a-b3ed-4b67-887c-a64494f92446 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] 10.222.0.60 "GET /compute/v2.1/servers/8512c248-e512-4728-934f-ba2d3e62aed3" status: 200 len: 1300 microversion: 2.1 time: 0.504470 Oct 18 16:00:03.101119 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2971/5959] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:02 2022] GET /compute/v2.1/servers/8512c248-e512-4728-934f-ba2d3e62aed3 => generated 1300 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:03.161032 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-70fe1433-a183-48b4-b969-8736b221c8d8 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:03.162188 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-70fe1433-a183-48b4-b969-8736b221c8d8 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] [instance: 82b24658-6a40-4370-a6da-0f6dabc6938a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:03.178712 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-70fe1433-a183-48b4-b969-8736b221c8d8 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:03.179579 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-70fe1433-a183-48b4-b969-8736b221c8d8 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:03.180426 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-70fe1433-a183-48b4-b969-8736b221c8d8 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:03.181352 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-70fe1433-a183-48b4-b969-8736b221c8d8 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:03.182351 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-70fe1433-a183-48b4-b969-8736b221c8d8 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:03.183210 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-70fe1433-a183-48b4-b969-8736b221c8d8 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:03.632866 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-70fe1433-a183-48b4-b969-8736b221c8d8 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973b32f6d7094ab9b4368f908dfaaa3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b40ce5bac1749458f339ddc4cde658f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:03.643624 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-70fe1433-a183-48b4-b969-8736b221c8d8 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] 10.222.0.60 "GET /compute/v2.1/servers/82b24658-6a40-4370-a6da-0f6dabc6938a" status: 200 len: 1274 microversion: 2.1 time: 0.487855 Oct 18 16:00:03.663260 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2989/5960] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:03 2022] GET /compute/v2.1/servers/82b24658-6a40-4370-a6da-0f6dabc6938a => generated 1274 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:04.118873 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4a1cf71e-8638-4d96-9e0e-03f463bcbae3 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:04.120355 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4a1cf71e-8638-4d96-9e0e-03f463bcbae3 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] [instance: 8512c248-e512-4728-934f-ba2d3e62aed3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:04.142565 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a1cf71e-8638-4d96-9e0e-03f463bcbae3 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:04.143451 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a1cf71e-8638-4d96-9e0e-03f463bcbae3 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:04.144093 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a1cf71e-8638-4d96-9e0e-03f463bcbae3 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:04.145050 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a1cf71e-8638-4d96-9e0e-03f463bcbae3 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:04.145697 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a1cf71e-8638-4d96-9e0e-03f463bcbae3 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:04.146330 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a1cf71e-8638-4d96-9e0e-03f463bcbae3 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:04.702644 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d1cb08ef-40c6-45ce-9dc3-4c3cadb387d5 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:04.704234 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d1cb08ef-40c6-45ce-9dc3-4c3cadb387d5 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] [instance: 82b24658-6a40-4370-a6da-0f6dabc6938a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:04.718216 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d1cb08ef-40c6-45ce-9dc3-4c3cadb387d5 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:04.718727 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d1cb08ef-40c6-45ce-9dc3-4c3cadb387d5 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:04.719173 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d1cb08ef-40c6-45ce-9dc3-4c3cadb387d5 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:04.719902 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d1cb08ef-40c6-45ce-9dc3-4c3cadb387d5 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:04.720363 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d1cb08ef-40c6-45ce-9dc3-4c3cadb387d5 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:04.720795 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d1cb08ef-40c6-45ce-9dc3-4c3cadb387d5 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:05.045233 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d1cb08ef-40c6-45ce-9dc3-4c3cadb387d5 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973b32f6d7094ab9b4368f908dfaaa3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b40ce5bac1749458f339ddc4cde658f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:05.053675 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d1cb08ef-40c6-45ce-9dc3-4c3cadb387d5 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] 10.222.0.60 "GET /compute/v2.1/servers/82b24658-6a40-4370-a6da-0f6dabc6938a" status: 200 len: 1272 microversion: 2.1 time: 0.377797 Oct 18 16:00:05.064192 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2990/5961] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:04 2022] GET /compute/v2.1/servers/82b24658-6a40-4370-a6da-0f6dabc6938a => generated 1272 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:00:05.158440 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4a1cf71e-8638-4d96-9e0e-03f463bcbae3 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab5a58990724e7bbbf18025ccdfcc1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62510e4663941a9ae5a7c4a810d316c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:05.173819 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4a1cf71e-8638-4d96-9e0e-03f463bcbae3 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] 10.222.0.60 "GET /compute/v2.1/servers/8512c248-e512-4728-934f-ba2d3e62aed3" status: 200 len: 1300 microversion: 2.1 time: 1.058850 Oct 18 16:00:05.182947 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2972/5962] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:04 2022] GET /compute/v2.1/servers/8512c248-e512-4728-934f-ba2d3e62aed3 => generated 1300 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:06.090962 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-13f07bac-72ea-417c-bb48-5dcf57126c9b tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:06.091538 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-13f07bac-72ea-417c-bb48-5dcf57126c9b tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] [instance: 82b24658-6a40-4370-a6da-0f6dabc6938a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:06.113602 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-13f07bac-72ea-417c-bb48-5dcf57126c9b tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:06.114347 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-13f07bac-72ea-417c-bb48-5dcf57126c9b tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:06.114947 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-13f07bac-72ea-417c-bb48-5dcf57126c9b tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:06.115815 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-13f07bac-72ea-417c-bb48-5dcf57126c9b tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:06.116428 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-13f07bac-72ea-417c-bb48-5dcf57126c9b tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:06.119169 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-13f07bac-72ea-417c-bb48-5dcf57126c9b tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:06.207900 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-aeb7f30e-38d4-46d4-a3b8-85eb2ee9be34 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:06.208827 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-aeb7f30e-38d4-46d4-a3b8-85eb2ee9be34 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] [instance: 8512c248-e512-4728-934f-ba2d3e62aed3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:06.223039 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aeb7f30e-38d4-46d4-a3b8-85eb2ee9be34 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:06.231029 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aeb7f30e-38d4-46d4-a3b8-85eb2ee9be34 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:06.236205 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aeb7f30e-38d4-46d4-a3b8-85eb2ee9be34 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:06.238259 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aeb7f30e-38d4-46d4-a3b8-85eb2ee9be34 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:06.243783 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aeb7f30e-38d4-46d4-a3b8-85eb2ee9be34 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:06.245376 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aeb7f30e-38d4-46d4-a3b8-85eb2ee9be34 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:06.365408 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-13f07bac-72ea-417c-bb48-5dcf57126c9b tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973b32f6d7094ab9b4368f908dfaaa3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b40ce5bac1749458f339ddc4cde658f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:06.375217 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-13f07bac-72ea-417c-bb48-5dcf57126c9b tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] 10.222.0.60 "GET /compute/v2.1/servers/82b24658-6a40-4370-a6da-0f6dabc6938a" status: 200 len: 1272 microversion: 2.1 time: 0.288903 Oct 18 16:00:06.384441 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2991/5963] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:06 2022] GET /compute/v2.1/servers/82b24658-6a40-4370-a6da-0f6dabc6938a => generated 1272 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:06.476536 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-aeb7f30e-38d4-46d4-a3b8-85eb2ee9be34 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab5a58990724e7bbbf18025ccdfcc1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62510e4663941a9ae5a7c4a810d316c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:06.491280 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-aeb7f30e-38d4-46d4-a3b8-85eb2ee9be34 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] 10.222.0.60 "GET /compute/v2.1/servers/8512c248-e512-4728-934f-ba2d3e62aed3" status: 200 len: 1300 microversion: 2.1 time: 0.287306 Oct 18 16:00:06.496736 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2973/5964] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:06 2022] GET /compute/v2.1/servers/8512c248-e512-4728-934f-ba2d3e62aed3 => generated 1300 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:00:07.406642 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-35c55fb5-730b-4360-9f0d-af61572e5007 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:07.408210 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-35c55fb5-730b-4360-9f0d-af61572e5007 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] [instance: 82b24658-6a40-4370-a6da-0f6dabc6938a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:07.428282 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-35c55fb5-730b-4360-9f0d-af61572e5007 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:07.429687 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-35c55fb5-730b-4360-9f0d-af61572e5007 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:07.430999 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-35c55fb5-730b-4360-9f0d-af61572e5007 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:07.432763 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-35c55fb5-730b-4360-9f0d-af61572e5007 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:07.438089 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-35c55fb5-730b-4360-9f0d-af61572e5007 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:07.439412 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-35c55fb5-730b-4360-9f0d-af61572e5007 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:07.521529 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-913841fc-12d1-4264-ad78-6b810d28066d tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:07.522256 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-913841fc-12d1-4264-ad78-6b810d28066d tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] [instance: 8512c248-e512-4728-934f-ba2d3e62aed3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:07.538098 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-913841fc-12d1-4264-ad78-6b810d28066d tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:07.553651 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-913841fc-12d1-4264-ad78-6b810d28066d tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:07.554455 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-913841fc-12d1-4264-ad78-6b810d28066d tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:07.555428 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-913841fc-12d1-4264-ad78-6b810d28066d tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:07.556141 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-913841fc-12d1-4264-ad78-6b810d28066d tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:07.556787 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-913841fc-12d1-4264-ad78-6b810d28066d tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:07.778392 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-35c55fb5-730b-4360-9f0d-af61572e5007 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973b32f6d7094ab9b4368f908dfaaa3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b40ce5bac1749458f339ddc4cde658f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:07.791222 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-35c55fb5-730b-4360-9f0d-af61572e5007 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] 10.222.0.60 "GET /compute/v2.1/servers/82b24658-6a40-4370-a6da-0f6dabc6938a" status: 200 len: 1272 microversion: 2.1 time: 0.384969 Oct 18 16:00:07.792181 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2992/5965] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:07 2022] GET /compute/v2.1/servers/82b24658-6a40-4370-a6da-0f6dabc6938a => generated 1272 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:08.013595 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-913841fc-12d1-4264-ad78-6b810d28066d tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab5a58990724e7bbbf18025ccdfcc1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62510e4663941a9ae5a7c4a810d316c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:08.028249 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-913841fc-12d1-4264-ad78-6b810d28066d tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] 10.222.0.60 "GET /compute/v2.1/servers/8512c248-e512-4728-934f-ba2d3e62aed3" status: 200 len: 1300 microversion: 2.1 time: 0.512805 Oct 18 16:00:08.033669 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2974/5966] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:07 2022] GET /compute/v2.1/servers/8512c248-e512-4728-934f-ba2d3e62aed3 => generated 1300 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:00:08.818497 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d164cbf8-b7b9-41e8-a127-6b91482a3491 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:08.820022 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d164cbf8-b7b9-41e8-a127-6b91482a3491 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] [instance: 82b24658-6a40-4370-a6da-0f6dabc6938a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:08.829123 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d164cbf8-b7b9-41e8-a127-6b91482a3491 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:08.833953 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d164cbf8-b7b9-41e8-a127-6b91482a3491 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:08.834595 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d164cbf8-b7b9-41e8-a127-6b91482a3491 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:08.835521 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d164cbf8-b7b9-41e8-a127-6b91482a3491 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:08.836136 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d164cbf8-b7b9-41e8-a127-6b91482a3491 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:08.837369 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d164cbf8-b7b9-41e8-a127-6b91482a3491 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:09.062646 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-287f7b16-8427-44f8-af6a-ef0b10eb05c0 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:09.063916 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-287f7b16-8427-44f8-af6a-ef0b10eb05c0 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] [instance: 8512c248-e512-4728-934f-ba2d3e62aed3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:09.075705 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-287f7b16-8427-44f8-af6a-ef0b10eb05c0 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:09.077220 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-287f7b16-8427-44f8-af6a-ef0b10eb05c0 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:09.078100 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-287f7b16-8427-44f8-af6a-ef0b10eb05c0 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:09.079221 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-287f7b16-8427-44f8-af6a-ef0b10eb05c0 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:09.079895 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-287f7b16-8427-44f8-af6a-ef0b10eb05c0 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:09.080569 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-287f7b16-8427-44f8-af6a-ef0b10eb05c0 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:09.681183 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-287f7b16-8427-44f8-af6a-ef0b10eb05c0 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab5a58990724e7bbbf18025ccdfcc1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62510e4663941a9ae5a7c4a810d316c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:09.691778 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-287f7b16-8427-44f8-af6a-ef0b10eb05c0 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] 10.222.0.60 "GET /compute/v2.1/servers/8512c248-e512-4728-934f-ba2d3e62aed3" status: 200 len: 1300 microversion: 2.1 time: 0.635909 Oct 18 16:00:09.714224 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2975/5967] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:09 2022] GET /compute/v2.1/servers/8512c248-e512-4728-934f-ba2d3e62aed3 => generated 1300 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:09.810918 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d164cbf8-b7b9-41e8-a127-6b91482a3491 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973b32f6d7094ab9b4368f908dfaaa3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b40ce5bac1749458f339ddc4cde658f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:09.827963 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d164cbf8-b7b9-41e8-a127-6b91482a3491 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] 10.222.0.60 "GET /compute/v2.1/servers/82b24658-6a40-4370-a6da-0f6dabc6938a" status: 200 len: 1314 microversion: 2.1 time: 1.011638 Oct 18 16:00:09.830648 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2993/5968] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:08 2022] GET /compute/v2.1/servers/82b24658-6a40-4370-a6da-0f6dabc6938a => generated 1314 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:10.336043 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-d2f6693c-acb1-4769-ad87-6ff13d98b274 req-188356de-ecfa-4476-80d9-f8c5115b7528 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82b24658-6a40-4370-a6da-0f6dabc6938a", "tag": "73322ff3-c8d0-4b89-b3d1-7cf87dd0cc7e"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:00:10.353330 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d2f6693c-acb1-4769-ad87-6ff13d98b274 req-188356de-ecfa-4476-80d9-f8c5115b7528 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:10.357387 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d2f6693c-acb1-4769-ad87-6ff13d98b274 req-188356de-ecfa-4476-80d9-f8c5115b7528 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:10.358255 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d2f6693c-acb1-4769-ad87-6ff13d98b274 req-188356de-ecfa-4476-80d9-f8c5115b7528 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:10.377733 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-d2f6693c-acb1-4769-ad87-6ff13d98b274 req-188356de-ecfa-4476-80d9-f8c5115b7528 service nova] Creating event network-changed:73322ff3-c8d0-4b89-b3d1-7cf87dd0cc7e for instance 82b24658-6a40-4370-a6da-0f6dabc6938a on n-h2-853682-5 Oct 18 16:00:10.384237 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-d2f6693c-acb1-4769-ad87-6ff13d98b274 req-188356de-ecfa-4476-80d9-f8c5115b7528 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053257 Oct 18 16:00:10.385509 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2976/5969] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:00:10.723120 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d0d11a25-63b3-49ee-8cf7-df3dce4d21c2 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:10.725065 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d0d11a25-63b3-49ee-8cf7-df3dce4d21c2 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] [instance: 8512c248-e512-4728-934f-ba2d3e62aed3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:10.742956 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=4 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:10.745752 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=14 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:10.753665 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d0d11a25-63b3-49ee-8cf7-df3dce4d21c2 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:10.755692 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d0d11a25-63b3-49ee-8cf7-df3dce4d21c2 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:10.758316 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d0d11a25-63b3-49ee-8cf7-df3dce4d21c2 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:10.763340 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d0d11a25-63b3-49ee-8cf7-df3dce4d21c2 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:10.764313 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d0d11a25-63b3-49ee-8cf7-df3dce4d21c2 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:10.767208 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d0d11a25-63b3-49ee-8cf7-df3dce4d21c2 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:10.860440 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:10.873706 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7bd9b1c4-1e53-415f-ac13-439ad2f5ab2b tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:10.875938 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7bd9b1c4-1e53-415f-ac13-439ad2f5ab2b tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] [instance: 82b24658-6a40-4370-a6da-0f6dabc6938a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:10.891194 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7bd9b1c4-1e53-415f-ac13-439ad2f5ab2b tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:10.892130 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7bd9b1c4-1e53-415f-ac13-439ad2f5ab2b tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:10.893308 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7bd9b1c4-1e53-415f-ac13-439ad2f5ab2b tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:10.894352 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7bd9b1c4-1e53-415f-ac13-439ad2f5ab2b tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:10.896245 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7bd9b1c4-1e53-415f-ac13-439ad2f5ab2b tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:10.896916 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7bd9b1c4-1e53-415f-ac13-439ad2f5ab2b tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:11.175988 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d0d11a25-63b3-49ee-8cf7-df3dce4d21c2 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab5a58990724e7bbbf18025ccdfcc1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62510e4663941a9ae5a7c4a810d316c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:11.190533 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d0d11a25-63b3-49ee-8cf7-df3dce4d21c2 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] 10.222.0.60 "GET /compute/v2.1/servers/8512c248-e512-4728-934f-ba2d3e62aed3" status: 200 len: 1300 microversion: 2.1 time: 0.472334 Oct 18 16:00:11.191210 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2994/5970] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:10 2022] GET /compute/v2.1/servers/8512c248-e512-4728-934f-ba2d3e62aed3 => generated 1300 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:11.522602 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7bd9b1c4-1e53-415f-ac13-439ad2f5ab2b tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973b32f6d7094ab9b4368f908dfaaa3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b40ce5bac1749458f339ddc4cde658f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:11.537834 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7bd9b1c4-1e53-415f-ac13-439ad2f5ab2b tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] 10.222.0.60 "GET /compute/v2.1/servers/82b24658-6a40-4370-a6da-0f6dabc6938a" status: 200 len: 1314 microversion: 2.1 time: 0.682496 Oct 18 16:00:11.539040 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2977/5971] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:10 2022] GET /compute/v2.1/servers/82b24658-6a40-4370-a6da-0f6dabc6938a => generated 1314 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:12.072626 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-91b2701d-e740-4b55-8f6c-971abf5d8134 req-8a029311-f74d-4d64-80a2-3c6060e01d5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8512c248-e512-4728-934f-ba2d3e62aed3", "name": "network-vif-plugged", "status": "completed", "tag": "12d6e278-4b98-4274-84b2-ddfb8542bca3"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:00:12.099308 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-91b2701d-e740-4b55-8f6c-971abf5d8134 req-8a029311-f74d-4d64-80a2-3c6060e01d5f service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:12.101576 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-91b2701d-e740-4b55-8f6c-971abf5d8134 req-8a029311-f74d-4d64-80a2-3c6060e01d5f service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:12.102232 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-91b2701d-e740-4b55-8f6c-971abf5d8134 req-8a029311-f74d-4d64-80a2-3c6060e01d5f service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:12.135744 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-91b2701d-e740-4b55-8f6c-971abf5d8134 req-8a029311-f74d-4d64-80a2-3c6060e01d5f service nova] Creating event network-vif-plugged:12d6e278-4b98-4274-84b2-ddfb8542bca3 for instance 8512c248-e512-4728-934f-ba2d3e62aed3 on n-h1-853682-5 Oct 18 16:00:12.150469 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-91b2701d-e740-4b55-8f6c-971abf5d8134 req-8a029311-f74d-4d64-80a2-3c6060e01d5f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082095 Oct 18 16:00:12.154239 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2995/5972] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:00:12.219461 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-09b2eb52-387f-4485-b6cd-05a33372cd87 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:12.220088 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-09b2eb52-387f-4485-b6cd-05a33372cd87 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] [instance: 8512c248-e512-4728-934f-ba2d3e62aed3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:12.232779 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09b2eb52-387f-4485-b6cd-05a33372cd87 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:12.237266 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09b2eb52-387f-4485-b6cd-05a33372cd87 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:12.241657 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09b2eb52-387f-4485-b6cd-05a33372cd87 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:12.245398 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09b2eb52-387f-4485-b6cd-05a33372cd87 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:12.247981 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09b2eb52-387f-4485-b6cd-05a33372cd87 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:12.248750 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09b2eb52-387f-4485-b6cd-05a33372cd87 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:12.300925 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:12.564424 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c44dd29a-fec9-4cc7-960e-dae1520a61be tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:12.565176 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c44dd29a-fec9-4cc7-960e-dae1520a61be tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] [instance: 82b24658-6a40-4370-a6da-0f6dabc6938a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:12.581717 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c44dd29a-fec9-4cc7-960e-dae1520a61be tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:12.582265 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c44dd29a-fec9-4cc7-960e-dae1520a61be tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:12.582716 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c44dd29a-fec9-4cc7-960e-dae1520a61be tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:12.583718 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c44dd29a-fec9-4cc7-960e-dae1520a61be tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:12.584354 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c44dd29a-fec9-4cc7-960e-dae1520a61be tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:12.584971 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c44dd29a-fec9-4cc7-960e-dae1520a61be tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:13.239866 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-09b2eb52-387f-4485-b6cd-05a33372cd87 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab5a58990724e7bbbf18025ccdfcc1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62510e4663941a9ae5a7c4a810d316c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:13.255996 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-09b2eb52-387f-4485-b6cd-05a33372cd87 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] 10.222.0.60 "GET /compute/v2.1/servers/8512c248-e512-4728-934f-ba2d3e62aed3" status: 200 len: 1300 microversion: 2.1 time: 1.041186 Oct 18 16:00:13.258443 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2978/5973] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:12 2022] GET /compute/v2.1/servers/8512c248-e512-4728-934f-ba2d3e62aed3 => generated 1300 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:14.048056 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c44dd29a-fec9-4cc7-960e-dae1520a61be tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973b32f6d7094ab9b4368f908dfaaa3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b40ce5bac1749458f339ddc4cde658f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:14.061522 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c44dd29a-fec9-4cc7-960e-dae1520a61be tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] 10.222.0.60 "GET /compute/v2.1/servers/82b24658-6a40-4370-a6da-0f6dabc6938a" status: 200 len: 1314 microversion: 2.1 time: 1.500698 Oct 18 16:00:14.064244 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2996/5974] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:12 2022] GET /compute/v2.1/servers/82b24658-6a40-4370-a6da-0f6dabc6938a => generated 1314 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:14.285218 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b5b5d5d2-127b-44d6-969d-2d0cbee5f920 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:14.285835 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b5b5d5d2-127b-44d6-969d-2d0cbee5f920 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] [instance: 8512c248-e512-4728-934f-ba2d3e62aed3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:14.309293 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5b5d5d2-127b-44d6-969d-2d0cbee5f920 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:14.309821 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5b5d5d2-127b-44d6-969d-2d0cbee5f920 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:14.310262 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5b5d5d2-127b-44d6-969d-2d0cbee5f920 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:14.310980 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5b5d5d2-127b-44d6-969d-2d0cbee5f920 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:14.311600 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5b5d5d2-127b-44d6-969d-2d0cbee5f920 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:14.312170 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5b5d5d2-127b-44d6-969d-2d0cbee5f920 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:14.571571 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b5b5d5d2-127b-44d6-969d-2d0cbee5f920 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab5a58990724e7bbbf18025ccdfcc1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62510e4663941a9ae5a7c4a810d316c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:14.580168 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b5b5d5d2-127b-44d6-969d-2d0cbee5f920 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] 10.222.0.60 "GET /compute/v2.1/servers/8512c248-e512-4728-934f-ba2d3e62aed3" status: 200 len: 1300 microversion: 2.1 time: 0.298881 Oct 18 16:00:14.586212 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2979/5975] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:14 2022] GET /compute/v2.1/servers/8512c248-e512-4728-934f-ba2d3e62aed3 => generated 1300 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:15.091475 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5a7fb2cf-6396-4bee-a286-14ed8b135d1b tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:15.092092 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5a7fb2cf-6396-4bee-a286-14ed8b135d1b tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] [instance: 82b24658-6a40-4370-a6da-0f6dabc6938a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:15.110298 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5a7fb2cf-6396-4bee-a286-14ed8b135d1b tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:15.110868 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5a7fb2cf-6396-4bee-a286-14ed8b135d1b tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:15.111377 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5a7fb2cf-6396-4bee-a286-14ed8b135d1b tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:15.114610 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5a7fb2cf-6396-4bee-a286-14ed8b135d1b tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:15.116965 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5a7fb2cf-6396-4bee-a286-14ed8b135d1b tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:15.117480 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5a7fb2cf-6396-4bee-a286-14ed8b135d1b tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:15.612332 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ad7ad4e1-32b3-48b5-8852-4a82d3ce6143 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:15.613144 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ad7ad4e1-32b3-48b5-8852-4a82d3ce6143 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] [instance: 8512c248-e512-4728-934f-ba2d3e62aed3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:15.626518 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad7ad4e1-32b3-48b5-8852-4a82d3ce6143 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:15.628402 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad7ad4e1-32b3-48b5-8852-4a82d3ce6143 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:15.634280 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad7ad4e1-32b3-48b5-8852-4a82d3ce6143 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:15.635199 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad7ad4e1-32b3-48b5-8852-4a82d3ce6143 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:15.645915 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad7ad4e1-32b3-48b5-8852-4a82d3ce6143 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:15.646373 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad7ad4e1-32b3-48b5-8852-4a82d3ce6143 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:16.764146 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ad7ad4e1-32b3-48b5-8852-4a82d3ce6143 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab5a58990724e7bbbf18025ccdfcc1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62510e4663941a9ae5a7c4a810d316c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:16.778416 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ad7ad4e1-32b3-48b5-8852-4a82d3ce6143 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] 10.222.0.60 "GET /compute/v2.1/servers/8512c248-e512-4728-934f-ba2d3e62aed3" status: 200 len: 1473 microversion: 2.1 time: 1.169954 Oct 18 16:00:16.792178 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5a7fb2cf-6396-4bee-a286-14ed8b135d1b tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973b32f6d7094ab9b4368f908dfaaa3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b40ce5bac1749458f339ddc4cde658f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:16.794381 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2980/5976] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:15 2022] GET /compute/v2.1/servers/8512c248-e512-4728-934f-ba2d3e62aed3 => generated 1473 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:16.804246 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5a7fb2cf-6396-4bee-a286-14ed8b135d1b tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] 10.222.0.60 "GET /compute/v2.1/servers/82b24658-6a40-4370-a6da-0f6dabc6938a" status: 200 len: 1314 microversion: 2.1 time: 1.716468 Oct 18 16:00:16.821054 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7b6396ec-9d24-431a-8fe6-b465fa9e1188 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:16.821669 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7b6396ec-9d24-431a-8fe6-b465fa9e1188 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] [instance: 8512c248-e512-4728-934f-ba2d3e62aed3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:16.821895 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2997/5977] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:15 2022] GET /compute/v2.1/servers/82b24658-6a40-4370-a6da-0f6dabc6938a => generated 1314 bytes in 1735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:16.830725 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b6396ec-9d24-431a-8fe6-b465fa9e1188 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:16.831204 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b6396ec-9d24-431a-8fe6-b465fa9e1188 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:16.831649 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b6396ec-9d24-431a-8fe6-b465fa9e1188 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:16.832459 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b6396ec-9d24-431a-8fe6-b465fa9e1188 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:16.832974 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b6396ec-9d24-431a-8fe6-b465fa9e1188 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:16.833398 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b6396ec-9d24-431a-8fe6-b465fa9e1188 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:17.003567 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7b6396ec-9d24-431a-8fe6-b465fa9e1188 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab5a58990724e7bbbf18025ccdfcc1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62510e4663941a9ae5a7c4a810d316c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:17.022671 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7b6396ec-9d24-431a-8fe6-b465fa9e1188 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] 10.222.0.60 "GET /compute/v2.1/servers/8512c248-e512-4728-934f-ba2d3e62aed3" status: 200 len: 1473 microversion: 2.1 time: 0.219780 Oct 18 16:00:17.039508 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2981/5978] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:16 2022] GET /compute/v2.1/servers/8512c248-e512-4728-934f-ba2d3e62aed3 => generated 1473 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:00:17.051932 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e86d7bd5-91ef-4721-9cf3-b41792aeab82 tempest-TestSecurityGroupsBasicOps-708900150 tempest-TestSecurityGroupsBasicOps-708900150-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:17.052559 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e86d7bd5-91ef-4721-9cf3-b41792aeab82 tempest-TestSecurityGroupsBasicOps-708900150 tempest-TestSecurityGroupsBasicOps-708900150-project-admin] [instance: 8512c248-e512-4728-934f-ba2d3e62aed3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:17.064614 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e86d7bd5-91ef-4721-9cf3-b41792aeab82 tempest-TestSecurityGroupsBasicOps-708900150 tempest-TestSecurityGroupsBasicOps-708900150-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:17.065142 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e86d7bd5-91ef-4721-9cf3-b41792aeab82 tempest-TestSecurityGroupsBasicOps-708900150 tempest-TestSecurityGroupsBasicOps-708900150-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:17.065582 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e86d7bd5-91ef-4721-9cf3-b41792aeab82 tempest-TestSecurityGroupsBasicOps-708900150 tempest-TestSecurityGroupsBasicOps-708900150-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:17.066296 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e86d7bd5-91ef-4721-9cf3-b41792aeab82 tempest-TestSecurityGroupsBasicOps-708900150 tempest-TestSecurityGroupsBasicOps-708900150-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:17.067217 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e86d7bd5-91ef-4721-9cf3-b41792aeab82 tempest-TestSecurityGroupsBasicOps-708900150 tempest-TestSecurityGroupsBasicOps-708900150-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:17.067217 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e86d7bd5-91ef-4721-9cf3-b41792aeab82 tempest-TestSecurityGroupsBasicOps-708900150 tempest-TestSecurityGroupsBasicOps-708900150-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:17.246173 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e86d7bd5-91ef-4721-9cf3-b41792aeab82 tempest-TestSecurityGroupsBasicOps-708900150 tempest-TestSecurityGroupsBasicOps-708900150-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/8512c248-e512-4728-934f-ba2d3e62aed3" status: 200 len: 1624 microversion: 2.1 time: 0.197614 Oct 18 16:00:17.246720 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2998/5979] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:17 2022] GET /compute/v2.1/servers/8512c248-e512-4728-934f-ba2d3e62aed3 => generated 1624 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:00:17.269770 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-89c86645-4196-4b5b-b541-fe30f09e76aa tempest-TestSecurityGroupsBasicOps-708900150 tempest-TestSecurityGroupsBasicOps-708900150-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:17.270316 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-89c86645-4196-4b5b-b541-fe30f09e76aa tempest-TestSecurityGroupsBasicOps-708900150 tempest-TestSecurityGroupsBasicOps-708900150-project-admin] [instance: 258517fa-d3ca-4b69-87e0-a2ea38ce3ce6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:17.294495 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89c86645-4196-4b5b-b541-fe30f09e76aa tempest-TestSecurityGroupsBasicOps-708900150 tempest-TestSecurityGroupsBasicOps-708900150-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:17.297456 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89c86645-4196-4b5b-b541-fe30f09e76aa tempest-TestSecurityGroupsBasicOps-708900150 tempest-TestSecurityGroupsBasicOps-708900150-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:17.298749 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89c86645-4196-4b5b-b541-fe30f09e76aa tempest-TestSecurityGroupsBasicOps-708900150 tempest-TestSecurityGroupsBasicOps-708900150-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:17.303668 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89c86645-4196-4b5b-b541-fe30f09e76aa tempest-TestSecurityGroupsBasicOps-708900150 tempest-TestSecurityGroupsBasicOps-708900150-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:17.304388 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89c86645-4196-4b5b-b541-fe30f09e76aa tempest-TestSecurityGroupsBasicOps-708900150 tempest-TestSecurityGroupsBasicOps-708900150-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:17.305045 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89c86645-4196-4b5b-b541-fe30f09e76aa tempest-TestSecurityGroupsBasicOps-708900150 tempest-TestSecurityGroupsBasicOps-708900150-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:17.553563 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-89c86645-4196-4b5b-b541-fe30f09e76aa tempest-TestSecurityGroupsBasicOps-708900150 tempest-TestSecurityGroupsBasicOps-708900150-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/258517fa-d3ca-4b69-87e0-a2ea38ce3ce6" status: 200 len: 1913 microversion: 2.1 time: 0.287356 Oct 18 16:00:17.568192 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2982/5980] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:17 2022] GET /compute/v2.1/servers/258517fa-d3ca-4b69-87e0-a2ea38ce3ce6 => generated 1913 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:17.679314 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7a81ebba-7ebf-43eb-a58d-8699dcf9467b tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:17.680091 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7a81ebba-7ebf-43eb-a58d-8699dcf9467b tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] [instance: 8512c248-e512-4728-934f-ba2d3e62aed3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:17.688084 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7a81ebba-7ebf-43eb-a58d-8699dcf9467b tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:17.688579 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7a81ebba-7ebf-43eb-a58d-8699dcf9467b tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:17.689036 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7a81ebba-7ebf-43eb-a58d-8699dcf9467b tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:17.689931 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7a81ebba-7ebf-43eb-a58d-8699dcf9467b tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:17.690539 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7a81ebba-7ebf-43eb-a58d-8699dcf9467b tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:17.691269 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7a81ebba-7ebf-43eb-a58d-8699dcf9467b tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:17.756829 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7a81ebba-7ebf-43eb-a58d-8699dcf9467b tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] [instance: 8512c248-e512-4728-934f-ba2d3e62aed3] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:00:17.828306 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3389cb9c-3253-4544-9ae7-4a1ff33c7045 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:17.829720 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3389cb9c-3253-4544-9ae7-4a1ff33c7045 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] [instance: 82b24658-6a40-4370-a6da-0f6dabc6938a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:17.835350 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3389cb9c-3253-4544-9ae7-4a1ff33c7045 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:17.835846 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3389cb9c-3253-4544-9ae7-4a1ff33c7045 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:17.836286 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3389cb9c-3253-4544-9ae7-4a1ff33c7045 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:17.837044 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3389cb9c-3253-4544-9ae7-4a1ff33c7045 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:17.837506 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3389cb9c-3253-4544-9ae7-4a1ff33c7045 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:17.842011 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3389cb9c-3253-4544-9ae7-4a1ff33c7045 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:17.913377 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7a81ebba-7ebf-43eb-a58d-8699dcf9467b tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8512c248-e512-4728-934f-ba2d3e62aed3" status: 204 len: 0 microversion: 2.1 time: 0.241130 Oct 18 16:00:17.914784 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 2999/5981] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 16:00:17 2022] DELETE /compute/v2.1/servers/8512c248-e512-4728-934f-ba2d3e62aed3 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:00:17.925580 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5d9e3b89-9fa8-446a-b9e4-c113b7649bd0 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-374313805", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "474ab74d-9d7a-430f-bdbd-4a828b657e5e"}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:00:18.009532 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-5d9e3b89-9fa8-446a-b9e4-c113b7649bd0 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] validate_networks() for [('474ab74d-9d7a-430f-bdbd-4a828b657e5e', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 16:00:18.226822 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3389cb9c-3253-4544-9ae7-4a1ff33c7045 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973b32f6d7094ab9b4368f908dfaaa3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b40ce5bac1749458f339ddc4cde658f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:18.247623 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3389cb9c-3253-4544-9ae7-4a1ff33c7045 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] 10.222.0.60 "GET /compute/v2.1/servers/82b24658-6a40-4370-a6da-0f6dabc6938a" status: 200 len: 1314 microversion: 2.1 time: 0.423953 Oct 18 16:00:18.253155 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2983/5982] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:17 2022] GET /compute/v2.1/servers/82b24658-6a40-4370-a6da-0f6dabc6938a => generated 1314 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:00:18.264683 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2ab70e59-7f97-43c3-a1b9-73a54d4317df tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:18.266571 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2ab70e59-7f97-43c3-a1b9-73a54d4317df tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] [instance: 8512c248-e512-4728-934f-ba2d3e62aed3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:18.285286 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2ab70e59-7f97-43c3-a1b9-73a54d4317df tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:18.286049 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2ab70e59-7f97-43c3-a1b9-73a54d4317df tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:18.286494 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2ab70e59-7f97-43c3-a1b9-73a54d4317df tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:18.287477 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2ab70e59-7f97-43c3-a1b9-73a54d4317df tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:18.287940 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2ab70e59-7f97-43c3-a1b9-73a54d4317df tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:18.294747 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2ab70e59-7f97-43c3-a1b9-73a54d4317df tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:18.529752 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2ab70e59-7f97-43c3-a1b9-73a54d4317df tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab5a58990724e7bbbf18025ccdfcc1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62510e4663941a9ae5a7c4a810d316c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:18.545082 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2ab70e59-7f97-43c3-a1b9-73a54d4317df tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] 10.222.0.60 "GET /compute/v2.1/servers/8512c248-e512-4728-934f-ba2d3e62aed3" status: 200 len: 1479 microversion: 2.1 time: 0.290523 Oct 18 16:00:18.545685 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2984/5983] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:18 2022] GET /compute/v2.1/servers/8512c248-e512-4728-934f-ba2d3e62aed3 => generated 1479 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:18.804979 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-5d9e3b89-9fa8-446a-b9e4-c113b7649bd0 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:00:18.805653 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-5d9e3b89-9fa8-446a-b9e4-c113b7649bd0 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:00:18.806457 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-5d9e3b89-9fa8-446a-b9e4-c113b7649bd0 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:00:18.807450 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-5d9e3b89-9fa8-446a-b9e4-c113b7649bd0 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:00:18.808150 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-5d9e3b89-9fa8-446a-b9e4-c113b7649bd0 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:00:18.827729 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5d9e3b89-9fa8-446a-b9e4-c113b7649bd0 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:18.828507 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5d9e3b89-9fa8-446a-b9e4-c113b7649bd0 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:18.829194 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5d9e3b89-9fa8-446a-b9e4-c113b7649bd0 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:18.832077 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5d9e3b89-9fa8-446a-b9e4-c113b7649bd0 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:18.838230 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5d9e3b89-9fa8-446a-b9e4-c113b7649bd0 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:18.841679 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5d9e3b89-9fa8-446a-b9e4-c113b7649bd0 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:18.878730 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:18.897092 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-5d9e3b89-9fa8-446a-b9e4-c113b7649bd0 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Getting quotas for project b1a38df7fef8486ca8bc1040f507b9d7. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:00:18.907515 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-5d9e3b89-9fa8-446a-b9e4-c113b7649bd0 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Getting quotas for user e24171f046534c22b854e3db9d80ed6d and project b1a38df7fef8486ca8bc1040f507b9d7. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:00:18.928299 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5d9e3b89-9fa8-446a-b9e4-c113b7649bd0 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:00:18.932669 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5d9e3b89-9fa8-446a-b9e4-c113b7649bd0 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] [instance: 97042a13-5053-436e-b247-3f3c107a2f27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:00:19.019176 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5d9e3b89-9fa8-446a-b9e4-c113b7649bd0 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.098809 Oct 18 16:00:19.026041 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3000/5984] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 16:00:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1106 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:00:19.038208 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-591bba40-42c2-4ad8-9c04-6ced1f63dfad tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:19.041046 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-591bba40-42c2-4ad8-9c04-6ced1f63dfad tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] [instance: 97042a13-5053-436e-b247-3f3c107a2f27] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:19.056059 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:19.193586 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-d02a99f6-0b35-4f04-b405-2c65e49747b4 req-c0107bd8-c96a-43c6-bf10-486fab421149 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82b24658-6a40-4370-a6da-0f6dabc6938a", "name": "network-vif-plugged", "status": "completed", "tag": "73322ff3-c8d0-4b89-b3d1-7cf87dd0cc7e"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:00:19.216338 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-d02a99f6-0b35-4f04-b405-2c65e49747b4 req-c0107bd8-c96a-43c6-bf10-486fab421149 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:19.217241 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-d02a99f6-0b35-4f04-b405-2c65e49747b4 req-c0107bd8-c96a-43c6-bf10-486fab421149 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:19.221413 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-d02a99f6-0b35-4f04-b405-2c65e49747b4 req-c0107bd8-c96a-43c6-bf10-486fab421149 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:19.225963 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:19.244799 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-591bba40-42c2-4ad8-9c04-6ced1f63dfad tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24171f046534c22b854e3db9d80ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1a38df7fef8486ca8bc1040f507b9d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:19.246455 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-d02a99f6-0b35-4f04-b405-2c65e49747b4 req-c0107bd8-c96a-43c6-bf10-486fab421149 service nova] Creating event network-vif-plugged:73322ff3-c8d0-4b89-b3d1-7cf87dd0cc7e for instance 82b24658-6a40-4370-a6da-0f6dabc6938a on n-h2-853682-5 Oct 18 16:00:19.252955 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-591bba40-42c2-4ad8-9c04-6ced1f63dfad tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] 10.222.0.60 "GET /compute/v2.1/servers/97042a13-5053-436e-b247-3f3c107a2f27" status: 200 len: 1218 microversion: 2.1 time: 0.219745 Oct 18 16:00:19.259083 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-d02a99f6-0b35-4f04-b405-2c65e49747b4 req-c0107bd8-c96a-43c6-bf10-486fab421149 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071198 Oct 18 16:00:19.260073 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3001/5985] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:00:19.273356 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2985/5986] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:19 2022] GET /compute/v2.1/servers/97042a13-5053-436e-b247-3f3c107a2f27 => generated 1218 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:19.280461 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-32c905a7-9d0f-4ec9-8b66-c51b859cc86a tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:19.281343 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-32c905a7-9d0f-4ec9-8b66-c51b859cc86a tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] [instance: 82b24658-6a40-4370-a6da-0f6dabc6938a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:19.300578 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-32c905a7-9d0f-4ec9-8b66-c51b859cc86a tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:19.303863 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-32c905a7-9d0f-4ec9-8b66-c51b859cc86a tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:19.306011 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-32c905a7-9d0f-4ec9-8b66-c51b859cc86a tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:19.309649 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-32c905a7-9d0f-4ec9-8b66-c51b859cc86a tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:19.310292 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-32c905a7-9d0f-4ec9-8b66-c51b859cc86a tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:19.311624 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-32c905a7-9d0f-4ec9-8b66-c51b859cc86a tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:19.573520 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-92563daf-3fc0-4466-ac3d-864f3d858d31 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:19.574301 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-92563daf-3fc0-4466-ac3d-864f3d858d31 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] [instance: 8512c248-e512-4728-934f-ba2d3e62aed3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:19.587414 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92563daf-3fc0-4466-ac3d-864f3d858d31 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:19.597324 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92563daf-3fc0-4466-ac3d-864f3d858d31 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:19.597938 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92563daf-3fc0-4466-ac3d-864f3d858d31 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:19.598983 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92563daf-3fc0-4466-ac3d-864f3d858d31 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:19.599459 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92563daf-3fc0-4466-ac3d-864f3d858d31 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:19.599887 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92563daf-3fc0-4466-ac3d-864f3d858d31 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:20.006594 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-92563daf-3fc0-4466-ac3d-864f3d858d31 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab5a58990724e7bbbf18025ccdfcc1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62510e4663941a9ae5a7c4a810d316c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:20.026377 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-92563daf-3fc0-4466-ac3d-864f3d858d31 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] 10.222.0.60 "GET /compute/v2.1/servers/8512c248-e512-4728-934f-ba2d3e62aed3" status: 200 len: 1479 microversion: 2.1 time: 0.456573 Oct 18 16:00:20.032639 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2986/5987] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:19 2022] GET /compute/v2.1/servers/8512c248-e512-4728-934f-ba2d3e62aed3 => generated 1479 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:20.067070 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-32c905a7-9d0f-4ec9-8b66-c51b859cc86a tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973b32f6d7094ab9b4368f908dfaaa3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b40ce5bac1749458f339ddc4cde658f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:20.083155 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-32c905a7-9d0f-4ec9-8b66-c51b859cc86a tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] 10.222.0.60 "GET /compute/v2.1/servers/82b24658-6a40-4370-a6da-0f6dabc6938a" status: 200 len: 1314 microversion: 2.1 time: 0.806878 Oct 18 16:00:20.098401 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3002/5988] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:19 2022] GET /compute/v2.1/servers/82b24658-6a40-4370-a6da-0f6dabc6938a => generated 1314 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:00:20.280632 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8a6cac68-256f-4f3d-af86-e15274a616db tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:20.281880 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8a6cac68-256f-4f3d-af86-e15274a616db tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] [instance: 97042a13-5053-436e-b247-3f3c107a2f27] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:20.291991 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a6cac68-256f-4f3d-af86-e15274a616db tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:20.293086 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a6cac68-256f-4f3d-af86-e15274a616db tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:20.295044 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a6cac68-256f-4f3d-af86-e15274a616db tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:20.296685 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a6cac68-256f-4f3d-af86-e15274a616db tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:20.299181 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a6cac68-256f-4f3d-af86-e15274a616db tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:20.300059 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a6cac68-256f-4f3d-af86-e15274a616db tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:20.461196 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8a6cac68-256f-4f3d-af86-e15274a616db tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24171f046534c22b854e3db9d80ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1a38df7fef8486ca8bc1040f507b9d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:20.487871 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8a6cac68-256f-4f3d-af86-e15274a616db tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] 10.222.0.60 "GET /compute/v2.1/servers/97042a13-5053-436e-b247-3f3c107a2f27" status: 200 len: 1214 microversion: 2.1 time: 0.211953 Oct 18 16:00:20.489574 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2987/5989] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:20 2022] GET /compute/v2.1/servers/97042a13-5053-436e-b247-3f3c107a2f27 => generated 1214 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:21.051836 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8fbc4e02-1842-49c4-b337-1c4e05d77ec7 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:21.052550 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8fbc4e02-1842-49c4-b337-1c4e05d77ec7 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] [instance: 8512c248-e512-4728-934f-ba2d3e62aed3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:21.063530 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8fbc4e02-1842-49c4-b337-1c4e05d77ec7 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:21.064028 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8fbc4e02-1842-49c4-b337-1c4e05d77ec7 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:21.064475 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8fbc4e02-1842-49c4-b337-1c4e05d77ec7 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:21.077752 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8fbc4e02-1842-49c4-b337-1c4e05d77ec7 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:21.078424 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8fbc4e02-1842-49c4-b337-1c4e05d77ec7 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:21.079514 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8fbc4e02-1842-49c4-b337-1c4e05d77ec7 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:21.113840 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9149d6b3-c8f4-4692-9c79-be2d219a2d47 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:21.114504 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9149d6b3-c8f4-4692-9c79-be2d219a2d47 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] [instance: 82b24658-6a40-4370-a6da-0f6dabc6938a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:21.133063 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9149d6b3-c8f4-4692-9c79-be2d219a2d47 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:21.136026 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9149d6b3-c8f4-4692-9c79-be2d219a2d47 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:21.136652 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9149d6b3-c8f4-4692-9c79-be2d219a2d47 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:21.137650 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9149d6b3-c8f4-4692-9c79-be2d219a2d47 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:21.141521 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9149d6b3-c8f4-4692-9c79-be2d219a2d47 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:21.142203 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9149d6b3-c8f4-4692-9c79-be2d219a2d47 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:21.488554 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8fbc4e02-1842-49c4-b337-1c4e05d77ec7 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab5a58990724e7bbbf18025ccdfcc1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62510e4663941a9ae5a7c4a810d316c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:21.507793 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8fbc4e02-1842-49c4-b337-1c4e05d77ec7 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] 10.222.0.60 "GET /compute/v2.1/servers/8512c248-e512-4728-934f-ba2d3e62aed3" status: 200 len: 1479 microversion: 2.1 time: 0.460255 Oct 18 16:00:21.529267 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3003/5990] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:21 2022] GET /compute/v2.1/servers/8512c248-e512-4728-934f-ba2d3e62aed3 => generated 1479 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:21.549206 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-55eb5bcb-8dff-4afa-ae37-c6799fdbbd0f req-673eab80-e93f-4124-b815-fa7a6cbc9eda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8512c248-e512-4728-934f-ba2d3e62aed3", "name": "network-vif-deleted", "tag": "12d6e278-4b98-4274-84b2-ddfb8542bca3"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:00:21.634720 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-55eb5bcb-8dff-4afa-ae37-c6799fdbbd0f req-673eab80-e93f-4124-b815-fa7a6cbc9eda service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:21.635235 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-55eb5bcb-8dff-4afa-ae37-c6799fdbbd0f req-673eab80-e93f-4124-b815-fa7a6cbc9eda service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:21.635669 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-55eb5bcb-8dff-4afa-ae37-c6799fdbbd0f req-673eab80-e93f-4124-b815-fa7a6cbc9eda service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:21.683486 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-55eb5bcb-8dff-4afa-ae37-c6799fdbbd0f req-673eab80-e93f-4124-b815-fa7a6cbc9eda service nova] Creating event network-vif-deleted:12d6e278-4b98-4274-84b2-ddfb8542bca3 for instance 8512c248-e512-4728-934f-ba2d3e62aed3 on n-h1-853682-5 Oct 18 16:00:21.716704 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-55eb5bcb-8dff-4afa-ae37-c6799fdbbd0f req-673eab80-e93f-4124-b815-fa7a6cbc9eda service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180286 Oct 18 16:00:21.716704 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3004/5991] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:00:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:00:21.726292 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c7014a8a-dadf-413a-9c48-b31152920cca tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:21.726292 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c7014a8a-dadf-413a-9c48-b31152920cca tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] [instance: 97042a13-5053-436e-b247-3f3c107a2f27] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:21.745973 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c7014a8a-dadf-413a-9c48-b31152920cca tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:21.746804 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c7014a8a-dadf-413a-9c48-b31152920cca tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:21.747407 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c7014a8a-dadf-413a-9c48-b31152920cca tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:21.754150 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c7014a8a-dadf-413a-9c48-b31152920cca tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:21.754829 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c7014a8a-dadf-413a-9c48-b31152920cca tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:21.755477 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c7014a8a-dadf-413a-9c48-b31152920cca tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:21.939736 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9149d6b3-c8f4-4692-9c79-be2d219a2d47 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973b32f6d7094ab9b4368f908dfaaa3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b40ce5bac1749458f339ddc4cde658f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:21.955647 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9149d6b3-c8f4-4692-9c79-be2d219a2d47 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] 10.222.0.60 "GET /compute/v2.1/servers/82b24658-6a40-4370-a6da-0f6dabc6938a" status: 200 len: 1314 microversion: 2.1 time: 0.849393 Oct 18 16:00:21.975001 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2988/5992] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:21 2022] GET /compute/v2.1/servers/82b24658-6a40-4370-a6da-0f6dabc6938a => generated 1314 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:00:22.069159 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c7014a8a-dadf-413a-9c48-b31152920cca tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24171f046534c22b854e3db9d80ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1a38df7fef8486ca8bc1040f507b9d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:22.087454 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c7014a8a-dadf-413a-9c48-b31152920cca tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] 10.222.0.60 "GET /compute/v2.1/servers/97042a13-5053-436e-b247-3f3c107a2f27" status: 200 len: 1276 microversion: 2.1 time: 0.373898 Oct 18 16:00:22.091367 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3005/5993] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:21 2022] GET /compute/v2.1/servers/97042a13-5053-436e-b247-3f3c107a2f27 => generated 1276 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:22.565092 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b60ea438-f493-444d-9426-1643c0185879 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:22.566570 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b60ea438-f493-444d-9426-1643c0185879 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] [instance: 8512c248-e512-4728-934f-ba2d3e62aed3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:22.574101 n-d-853682-5 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 16:00:22.574612 n-d-853682-5 devstack@n-api.service[120406]: Tue Oct 18 16:00:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8512c248-e512-4728-934f-ba2d3e62aed3 (ip 10.222.0.60) !!! Oct 18 16:00:22.581184 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b60ea438-f493-444d-9426-1643c0185879 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:22.582810 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b60ea438-f493-444d-9426-1643c0185879 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:22.583471 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b60ea438-f493-444d-9426-1643c0185879 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:22.584414 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b60ea438-f493-444d-9426-1643c0185879 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:22.585815 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b60ea438-f493-444d-9426-1643c0185879 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:22.586552 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b60ea438-f493-444d-9426-1643c0185879 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:22.614266 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-b60ea438-f493-444d-9426-1643c0185879 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] HTTP exception thrown: Instance 8512c248-e512-4728-934f-ba2d3e62aed3 could not be found. Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b60ea438-f493-444d-9426-1643c0185879 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Request method failure captured: Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/8512c248-e512-4728-934f-ba2d3e62aed3 HTTP/1.1 Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTs0Igz0IIFQkVL0A0h8tVXy7U3KOBAoacO1D4tRSqeIGkjSqu92JaXH1vkNDIv3Wg5fihwHz6IAZHUpViBVc1BZjczdtrMP3YHrnaX1EX1N85UYyRC7xZQ4hkgsTt4altr5R48jKQDuaFoLMwkU1Pe9uWPJZaxvMgQHmQaWUNRw8WLM Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: d62510e4663941a9ae5a7c4a810d316c Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1799536726 Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d62510e4663941a9ae5a7c4a810d316c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d62510e4663941a9ae5a7c4a810d316c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d62510e4663941a9ae5a7c4a810d316c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d62510e4663941a9ae5a7c4a810d316c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1799536726 Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: d62510e4663941a9ae5a7c4a810d316c Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1799536726 Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-TestSecurityGroupsBasicOps-1799536726-project Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: bab5a58990724e7bbbf18025ccdfcc1f Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1799536726-project Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 8512c248-e512-4728-934f-ba2d3e62aed3 could not be found. Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '8512c248-e512-4728-934f-ba2d3e62aed3'} Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8512c248-e512-4728-934f-ba2d3e62aed3 could not be found. Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8512c248-e512-4728-934f-ba2d3e62aed3 could not be found. Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:00:22.617682 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:00:22.626122 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:00:22.626122 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:00:22.626122 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:00:22.626122 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:00:22.626122 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:00:22.626122 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:00:22.626122 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8512c248-e512-4728-934f-ba2d3e62aed3 could not be found. Oct 18 16:00:22.626122 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:00:22.626122 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b60ea438-f493-444d-9426-1643c0185879 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Returning 404 to user: Instance 8512c248-e512-4728-934f-ba2d3e62aed3 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:00:22.626122 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b60ea438-f493-444d-9426-1643c0185879 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] 10.222.0.60 "GET /compute/v2.1/servers/8512c248-e512-4728-934f-ba2d3e62aed3" status: 404 len: 111 microversion: 2.1 time: 0.062144 Oct 18 16:00:22.626122 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2989/5994] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:22 2022] GET /compute/v2.1/servers/8512c248-e512-4728-934f-ba2d3e62aed3 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:00:22.984341 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f3e5513f-7003-4fd6-a675-1200d4a04bf7 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:22.985008 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f3e5513f-7003-4fd6-a675-1200d4a04bf7 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] [instance: 82b24658-6a40-4370-a6da-0f6dabc6938a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:22.995158 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f3e5513f-7003-4fd6-a675-1200d4a04bf7 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:22.998314 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f3e5513f-7003-4fd6-a675-1200d4a04bf7 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:23.001689 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f3e5513f-7003-4fd6-a675-1200d4a04bf7 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:23.003130 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f3e5513f-7003-4fd6-a675-1200d4a04bf7 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:23.003961 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f3e5513f-7003-4fd6-a675-1200d4a04bf7 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:23.004587 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f3e5513f-7003-4fd6-a675-1200d4a04bf7 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:23.123254 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-26012a47-9439-4a6e-8d99-8822410ce71d tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:23.123890 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-26012a47-9439-4a6e-8d99-8822410ce71d tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] [instance: 97042a13-5053-436e-b247-3f3c107a2f27] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:23.136621 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26012a47-9439-4a6e-8d99-8822410ce71d tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:23.137452 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26012a47-9439-4a6e-8d99-8822410ce71d tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:23.138096 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26012a47-9439-4a6e-8d99-8822410ce71d tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:23.139184 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26012a47-9439-4a6e-8d99-8822410ce71d tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:23.139898 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26012a47-9439-4a6e-8d99-8822410ce71d tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:23.140875 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26012a47-9439-4a6e-8d99-8822410ce71d tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:23.279263 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-26012a47-9439-4a6e-8d99-8822410ce71d tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24171f046534c22b854e3db9d80ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1a38df7fef8486ca8bc1040f507b9d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:23.331262 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-26012a47-9439-4a6e-8d99-8822410ce71d tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] 10.222.0.60 "GET /compute/v2.1/servers/97042a13-5053-436e-b247-3f3c107a2f27" status: 200 len: 1276 microversion: 2.1 time: 0.216994 Oct 18 16:00:23.335559 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2990/5995] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:23 2022] GET /compute/v2.1/servers/97042a13-5053-436e-b247-3f3c107a2f27 => generated 1276 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:23.419561 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f3e5513f-7003-4fd6-a675-1200d4a04bf7 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973b32f6d7094ab9b4368f908dfaaa3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b40ce5bac1749458f339ddc4cde658f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:23.445370 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f3e5513f-7003-4fd6-a675-1200d4a04bf7 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] 10.222.0.60 "GET /compute/v2.1/servers/82b24658-6a40-4370-a6da-0f6dabc6938a" status: 200 len: 1497 microversion: 2.1 time: 0.464630 Oct 18 16:00:23.447185 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3006/5996] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:22 2022] GET /compute/v2.1/servers/82b24658-6a40-4370-a6da-0f6dabc6938a => generated 1497 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:24.359000 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4839044c-7d8e-4a98-bfe7-e2a7e5666ff3 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:24.360632 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4839044c-7d8e-4a98-bfe7-e2a7e5666ff3 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] [instance: 97042a13-5053-436e-b247-3f3c107a2f27] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:24.371272 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4839044c-7d8e-4a98-bfe7-e2a7e5666ff3 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:24.373827 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4839044c-7d8e-4a98-bfe7-e2a7e5666ff3 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:24.375000 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4839044c-7d8e-4a98-bfe7-e2a7e5666ff3 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:24.376150 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4839044c-7d8e-4a98-bfe7-e2a7e5666ff3 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:24.376884 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4839044c-7d8e-4a98-bfe7-e2a7e5666ff3 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:24.378004 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4839044c-7d8e-4a98-bfe7-e2a7e5666ff3 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:24.859689 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4839044c-7d8e-4a98-bfe7-e2a7e5666ff3 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24171f046534c22b854e3db9d80ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1a38df7fef8486ca8bc1040f507b9d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:24.868239 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4839044c-7d8e-4a98-bfe7-e2a7e5666ff3 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] 10.222.0.60 "GET /compute/v2.1/servers/97042a13-5053-436e-b247-3f3c107a2f27" status: 200 len: 1318 microversion: 2.1 time: 0.516324 Oct 18 16:00:24.877726 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2991/5997] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:24 2022] GET /compute/v2.1/servers/97042a13-5053-436e-b247-3f3c107a2f27 => generated 1318 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:25.903179 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-dd7490dc-c690-4863-8a35-d03c67841fde tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:25.904270 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-dd7490dc-c690-4863-8a35-d03c67841fde tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] [instance: 97042a13-5053-436e-b247-3f3c107a2f27] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:25.914888 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dd7490dc-c690-4863-8a35-d03c67841fde tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:25.917889 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dd7490dc-c690-4863-8a35-d03c67841fde tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:25.918337 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dd7490dc-c690-4863-8a35-d03c67841fde tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:25.919078 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dd7490dc-c690-4863-8a35-d03c67841fde tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:25.919519 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dd7490dc-c690-4863-8a35-d03c67841fde tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:25.919947 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dd7490dc-c690-4863-8a35-d03c67841fde tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:26.367787 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-dd7490dc-c690-4863-8a35-d03c67841fde tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24171f046534c22b854e3db9d80ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1a38df7fef8486ca8bc1040f507b9d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:26.383919 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-dd7490dc-c690-4863-8a35-d03c67841fde tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] 10.222.0.60 "GET /compute/v2.1/servers/97042a13-5053-436e-b247-3f3c107a2f27" status: 200 len: 1318 microversion: 2.1 time: 0.484244 Oct 18 16:00:26.389139 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3007/5998] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:25 2022] GET /compute/v2.1/servers/97042a13-5053-436e-b247-3f3c107a2f27 => generated 1318 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:26.815088 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-5ff523db-c4e2-4dea-a720-f43c6d3cf62d req-0e109130-052b-46e1-bb2e-f943fb3fc49b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97042a13-5053-436e-b247-3f3c107a2f27", "tag": "376a1199-87d6-4647-ab08-6bf31d946247"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:00:26.848418 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5ff523db-c4e2-4dea-a720-f43c6d3cf62d req-0e109130-052b-46e1-bb2e-f943fb3fc49b service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:26.848925 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5ff523db-c4e2-4dea-a720-f43c6d3cf62d req-0e109130-052b-46e1-bb2e-f943fb3fc49b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:26.850937 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5ff523db-c4e2-4dea-a720-f43c6d3cf62d req-0e109130-052b-46e1-bb2e-f943fb3fc49b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:26.883666 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-5ff523db-c4e2-4dea-a720-f43c6d3cf62d req-0e109130-052b-46e1-bb2e-f943fb3fc49b service nova] Creating event network-changed:376a1199-87d6-4647-ab08-6bf31d946247 for instance 97042a13-5053-436e-b247-3f3c107a2f27 on n-h1-853682-5 Oct 18 16:00:26.897916 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-5ff523db-c4e2-4dea-a720-f43c6d3cf62d req-0e109130-052b-46e1-bb2e-f943fb3fc49b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087210 Oct 18 16:00:26.899901 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2992/5999] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:00:27.409295 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2b12ad27-5ec0-4534-94ed-8c1a5f41445b tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:27.410010 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2b12ad27-5ec0-4534-94ed-8c1a5f41445b tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] [instance: 97042a13-5053-436e-b247-3f3c107a2f27] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:27.440828 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2b12ad27-5ec0-4534-94ed-8c1a5f41445b tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:27.447348 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2b12ad27-5ec0-4534-94ed-8c1a5f41445b tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:27.449082 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2b12ad27-5ec0-4534-94ed-8c1a5f41445b tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:27.453406 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2b12ad27-5ec0-4534-94ed-8c1a5f41445b tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:27.456714 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2b12ad27-5ec0-4534-94ed-8c1a5f41445b tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:27.457576 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2b12ad27-5ec0-4534-94ed-8c1a5f41445b tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:28.128762 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2b12ad27-5ec0-4534-94ed-8c1a5f41445b tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24171f046534c22b854e3db9d80ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1a38df7fef8486ca8bc1040f507b9d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:28.139356 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2b12ad27-5ec0-4534-94ed-8c1a5f41445b tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] 10.222.0.60 "GET /compute/v2.1/servers/97042a13-5053-436e-b247-3f3c107a2f27" status: 200 len: 1318 microversion: 2.1 time: 0.735607 Oct 18 16:00:28.153586 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3008/6000] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:27 2022] GET /compute/v2.1/servers/97042a13-5053-436e-b247-3f3c107a2f27 => generated 1318 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:28.384500 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3a718aea-fc7e-49b7-b7af-795e9d9b7240 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:28.387509 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3a718aea-fc7e-49b7-b7af-795e9d9b7240 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] [instance: 82b24658-6a40-4370-a6da-0f6dabc6938a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:28.414058 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a718aea-fc7e-49b7-b7af-795e9d9b7240 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:28.418074 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a718aea-fc7e-49b7-b7af-795e9d9b7240 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:28.418842 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a718aea-fc7e-49b7-b7af-795e9d9b7240 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:28.419889 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a718aea-fc7e-49b7-b7af-795e9d9b7240 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:28.420989 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a718aea-fc7e-49b7-b7af-795e9d9b7240 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:28.422191 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a718aea-fc7e-49b7-b7af-795e9d9b7240 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:28.497112 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3a718aea-fc7e-49b7-b7af-795e9d9b7240 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] [instance: 82b24658-6a40-4370-a6da-0f6dabc6938a] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:00:28.719259 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3a718aea-fc7e-49b7-b7af-795e9d9b7240 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] 10.222.0.60 "DELETE /compute/v2.1/servers/82b24658-6a40-4370-a6da-0f6dabc6938a" status: 204 len: 0 microversion: 2.1 time: 0.320163 Oct 18 16:00:28.727351 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2993/6001] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 16:00:28 2022] DELETE /compute/v2.1/servers/82b24658-6a40-4370-a6da-0f6dabc6938a => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:00:28.734360 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-20318099-c0f2-4ad3-bd1d-5d4ea764967a tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:28.738793 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-20318099-c0f2-4ad3-bd1d-5d4ea764967a tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] [instance: 82b24658-6a40-4370-a6da-0f6dabc6938a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:28.750264 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-20318099-c0f2-4ad3-bd1d-5d4ea764967a tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:28.751151 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-20318099-c0f2-4ad3-bd1d-5d4ea764967a tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:28.752054 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-20318099-c0f2-4ad3-bd1d-5d4ea764967a tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:28.754173 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-20318099-c0f2-4ad3-bd1d-5d4ea764967a tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:28.754834 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-20318099-c0f2-4ad3-bd1d-5d4ea764967a tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:28.756393 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-20318099-c0f2-4ad3-bd1d-5d4ea764967a tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:28.869776 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:28.916123 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=6 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:29.173352 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8862137e-c3c9-4fd7-a7c7-f04a884434d8 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:29.173352 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8862137e-c3c9-4fd7-a7c7-f04a884434d8 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] [instance: 97042a13-5053-436e-b247-3f3c107a2f27] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:29.185963 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8862137e-c3c9-4fd7-a7c7-f04a884434d8 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:29.186560 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8862137e-c3c9-4fd7-a7c7-f04a884434d8 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:29.189185 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8862137e-c3c9-4fd7-a7c7-f04a884434d8 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:29.193565 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8862137e-c3c9-4fd7-a7c7-f04a884434d8 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:29.194063 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8862137e-c3c9-4fd7-a7c7-f04a884434d8 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:29.199589 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8862137e-c3c9-4fd7-a7c7-f04a884434d8 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:29.257443 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:30.047583 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-20318099-c0f2-4ad3-bd1d-5d4ea764967a tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973b32f6d7094ab9b4368f908dfaaa3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b40ce5bac1749458f339ddc4cde658f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:30.059494 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-20318099-c0f2-4ad3-bd1d-5d4ea764967a tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] 10.222.0.60 "GET /compute/v2.1/servers/82b24658-6a40-4370-a6da-0f6dabc6938a" status: 200 len: 1503 microversion: 2.1 time: 1.330811 Oct 18 16:00:30.074337 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3009/6002] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:28 2022] GET /compute/v2.1/servers/82b24658-6a40-4370-a6da-0f6dabc6938a => generated 1503 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:30.410010 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8862137e-c3c9-4fd7-a7c7-f04a884434d8 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24171f046534c22b854e3db9d80ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1a38df7fef8486ca8bc1040f507b9d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:30.420391 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8862137e-c3c9-4fd7-a7c7-f04a884434d8 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] 10.222.0.60 "GET /compute/v2.1/servers/97042a13-5053-436e-b247-3f3c107a2f27" status: 200 len: 1318 microversion: 2.1 time: 1.257646 Oct 18 16:00:30.429401 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2994/6003] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:29 2022] GET /compute/v2.1/servers/97042a13-5053-436e-b247-3f3c107a2f27 => generated 1318 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:00:31.104268 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-49966bce-5cd9-4d54-9ff0-931e0c1375ba tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:31.104959 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-49966bce-5cd9-4d54-9ff0-931e0c1375ba tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] [instance: 82b24658-6a40-4370-a6da-0f6dabc6938a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:31.117110 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-49966bce-5cd9-4d54-9ff0-931e0c1375ba tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:31.117772 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-49966bce-5cd9-4d54-9ff0-931e0c1375ba tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:31.121500 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-49966bce-5cd9-4d54-9ff0-931e0c1375ba tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:31.122962 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-49966bce-5cd9-4d54-9ff0-931e0c1375ba tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:31.124748 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-49966bce-5cd9-4d54-9ff0-931e0c1375ba tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:31.129383 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-49966bce-5cd9-4d54-9ff0-931e0c1375ba tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:31.454274 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5af3d937-c2fc-454a-8fe1-b0f09beae3d5 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:31.454924 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5af3d937-c2fc-454a-8fe1-b0f09beae3d5 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] [instance: 97042a13-5053-436e-b247-3f3c107a2f27] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:31.463480 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5af3d937-c2fc-454a-8fe1-b0f09beae3d5 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:31.464002 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5af3d937-c2fc-454a-8fe1-b0f09beae3d5 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:31.475353 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5af3d937-c2fc-454a-8fe1-b0f09beae3d5 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:31.476486 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5af3d937-c2fc-454a-8fe1-b0f09beae3d5 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:31.477156 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5af3d937-c2fc-454a-8fe1-b0f09beae3d5 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:31.477732 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5af3d937-c2fc-454a-8fe1-b0f09beae3d5 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:32.379489 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-49966bce-5cd9-4d54-9ff0-931e0c1375ba tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973b32f6d7094ab9b4368f908dfaaa3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b40ce5bac1749458f339ddc4cde658f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:32.393848 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-49966bce-5cd9-4d54-9ff0-931e0c1375ba tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] 10.222.0.60 "GET /compute/v2.1/servers/82b24658-6a40-4370-a6da-0f6dabc6938a" status: 200 len: 1503 microversion: 2.1 time: 1.293378 Oct 18 16:00:32.394453 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3010/6004] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:31 2022] GET /compute/v2.1/servers/82b24658-6a40-4370-a6da-0f6dabc6938a => generated 1503 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:32.408483 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-c7004e91-38b7-464d-8923-ec4eec63abc2 req-fb4930bc-8d14-491b-b5c8-74a6e1f7dfe9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82b24658-6a40-4370-a6da-0f6dabc6938a", "name": "network-vif-deleted", "tag": "73322ff3-c8d0-4b89-b3d1-7cf87dd0cc7e"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:00:32.460494 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-c7004e91-38b7-464d-8923-ec4eec63abc2 req-fb4930bc-8d14-491b-b5c8-74a6e1f7dfe9 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:32.465362 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-c7004e91-38b7-464d-8923-ec4eec63abc2 req-fb4930bc-8d14-491b-b5c8-74a6e1f7dfe9 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:32.471619 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-c7004e91-38b7-464d-8923-ec4eec63abc2 req-fb4930bc-8d14-491b-b5c8-74a6e1f7dfe9 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:32.483335 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5af3d937-c2fc-454a-8fe1-b0f09beae3d5 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24171f046534c22b854e3db9d80ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1a38df7fef8486ca8bc1040f507b9d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:32.490182 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:32.522730 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5af3d937-c2fc-454a-8fe1-b0f09beae3d5 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] 10.222.0.60 "GET /compute/v2.1/servers/97042a13-5053-436e-b247-3f3c107a2f27" status: 200 len: 1318 microversion: 2.1 time: 1.072106 Oct 18 16:00:32.523360 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2995/6005] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:31 2022] GET /compute/v2.1/servers/97042a13-5053-436e-b247-3f3c107a2f27 => generated 1318 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:00:32.556674 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-c7004e91-38b7-464d-8923-ec4eec63abc2 req-fb4930bc-8d14-491b-b5c8-74a6e1f7dfe9 service nova] Creating event network-vif-deleted:73322ff3-c8d0-4b89-b3d1-7cf87dd0cc7e for instance 82b24658-6a40-4370-a6da-0f6dabc6938a on n-h2-853682-5 Oct 18 16:00:32.569904 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-c7004e91-38b7-464d-8923-ec4eec63abc2 req-fb4930bc-8d14-491b-b5c8-74a6e1f7dfe9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170081 Oct 18 16:00:32.571663 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3011/6006] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:00:33.420452 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-42f8208d-fa94-49a9-b570-4dfca2a05b47 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:33.421068 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-42f8208d-fa94-49a9-b570-4dfca2a05b47 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] [instance: 82b24658-6a40-4370-a6da-0f6dabc6938a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:33.440077 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42f8208d-fa94-49a9-b570-4dfca2a05b47 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:33.440836 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42f8208d-fa94-49a9-b570-4dfca2a05b47 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:33.441436 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42f8208d-fa94-49a9-b570-4dfca2a05b47 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:33.442310 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42f8208d-fa94-49a9-b570-4dfca2a05b47 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:33.442924 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42f8208d-fa94-49a9-b570-4dfca2a05b47 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:33.443535 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42f8208d-fa94-49a9-b570-4dfca2a05b47 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:33.461881 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-42f8208d-fa94-49a9-b570-4dfca2a05b47 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] HTTP exception thrown: Instance 82b24658-6a40-4370-a6da-0f6dabc6938a could not be found. Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-42f8208d-fa94-49a9-b570-4dfca2a05b47 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Request method failure captured: Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/82b24658-6a40-4370-a6da-0f6dabc6938a HTTP/1.1 Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTs12cLyueOdRICZ43ti40SYzFvKXNFMUsMXFpODisGuTUs0UA5w-rcNKxll8yh7tB78MUnQZ6G2-XdEHvVJBYzP0XQAaNeuFDUDCklclvHxtGz0joeGwMGzVyG76Tj9hfJr3b8GbO4JdeDsMt-PTga_sEBPUDWxQnXYWZmJ6ijO0xyg Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 1b40ce5bac1749458f339ddc4cde658f Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-VolumesActionsTest-200880431 Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1b40ce5bac1749458f339ddc4cde658f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1b40ce5bac1749458f339ddc4cde658f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1b40ce5bac1749458f339ddc4cde658f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1b40ce5bac1749458f339ddc4cde658f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-VolumesActionsTest-200880431 Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 1b40ce5bac1749458f339ddc4cde658f Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-VolumesActionsTest-200880431 Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-VolumesActionsTest-200880431-project Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 973b32f6d7094ab9b4368f908dfaaa3e Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-VolumesActionsTest-200880431-project Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 82b24658-6a40-4370-a6da-0f6dabc6938a could not be found. Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '82b24658-6a40-4370-a6da-0f6dabc6938a'} Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82b24658-6a40-4370-a6da-0f6dabc6938a could not be found. Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82b24658-6a40-4370-a6da-0f6dabc6938a could not be found. Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:00:33.463840 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:00:33.468161 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:00:33.468161 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:00:33.468161 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:00:33.468161 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:00:33.468161 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:00:33.468161 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82b24658-6a40-4370-a6da-0f6dabc6938a could not be found. Oct 18 16:00:33.468161 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:00:33.469417 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-42f8208d-fa94-49a9-b570-4dfca2a05b47 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] Returning 404 to user: Instance 82b24658-6a40-4370-a6da-0f6dabc6938a could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:00:33.470435 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-42f8208d-fa94-49a9-b570-4dfca2a05b47 tempest-VolumesActionsTest-200880431 tempest-VolumesActionsTest-200880431-project] 10.222.0.60 "GET /compute/v2.1/servers/82b24658-6a40-4370-a6da-0f6dabc6938a" status: 404 len: 111 microversion: 2.1 time: 0.054760 Oct 18 16:00:33.471514 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2996/6007] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:33 2022] GET /compute/v2.1/servers/82b24658-6a40-4370-a6da-0f6dabc6938a => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:00:33.550679 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-226d8081-f0b1-4375-ab98-0f69cc278c60 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:33.551385 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-226d8081-f0b1-4375-ab98-0f69cc278c60 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] [instance: 97042a13-5053-436e-b247-3f3c107a2f27] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:33.566880 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-226d8081-f0b1-4375-ab98-0f69cc278c60 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:33.567604 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-226d8081-f0b1-4375-ab98-0f69cc278c60 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:33.568226 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-226d8081-f0b1-4375-ab98-0f69cc278c60 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:33.569129 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-226d8081-f0b1-4375-ab98-0f69cc278c60 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:33.569741 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-226d8081-f0b1-4375-ab98-0f69cc278c60 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:33.570310 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-226d8081-f0b1-4375-ab98-0f69cc278c60 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:34.829821 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-725dc212-8e7d-4e59-ae5c-0c51ca2518b6 req-36692eae-cd4a-46a2-9a4e-b36b56c27f87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97042a13-5053-436e-b247-3f3c107a2f27", "name": "network-vif-plugged", "status": "completed", "tag": "376a1199-87d6-4647-ab08-6bf31d946247"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:00:34.847081 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-725dc212-8e7d-4e59-ae5c-0c51ca2518b6 req-36692eae-cd4a-46a2-9a4e-b36b56c27f87 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:34.847752 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-725dc212-8e7d-4e59-ae5c-0c51ca2518b6 req-36692eae-cd4a-46a2-9a4e-b36b56c27f87 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:34.848459 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-725dc212-8e7d-4e59-ae5c-0c51ca2518b6 req-36692eae-cd4a-46a2-9a4e-b36b56c27f87 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:34.869645 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-725dc212-8e7d-4e59-ae5c-0c51ca2518b6 req-36692eae-cd4a-46a2-9a4e-b36b56c27f87 service nova] Creating event network-vif-plugged:376a1199-87d6-4647-ab08-6bf31d946247 for instance 97042a13-5053-436e-b247-3f3c107a2f27 on n-h1-853682-5 Oct 18 16:00:34.882484 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-725dc212-8e7d-4e59-ae5c-0c51ca2518b6 req-36692eae-cd4a-46a2-9a4e-b36b56c27f87 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057363 Oct 18 16:00:34.889826 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2997/6008] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:00:35.156971 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-226d8081-f0b1-4375-ab98-0f69cc278c60 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24171f046534c22b854e3db9d80ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1a38df7fef8486ca8bc1040f507b9d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:35.175420 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-226d8081-f0b1-4375-ab98-0f69cc278c60 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] 10.222.0.60 "GET /compute/v2.1/servers/97042a13-5053-436e-b247-3f3c107a2f27" status: 200 len: 1318 microversion: 2.1 time: 1.629769 Oct 18 16:00:35.183517 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3012/6009] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:33 2022] GET /compute/v2.1/servers/97042a13-5053-436e-b247-3f3c107a2f27 => generated 1318 bytes in 1639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:36.204863 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5e066719-620c-4157-80f8-3c9efe446e7f tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:36.206752 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5e066719-620c-4157-80f8-3c9efe446e7f tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] [instance: 97042a13-5053-436e-b247-3f3c107a2f27] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:36.230580 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e066719-620c-4157-80f8-3c9efe446e7f tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:36.231398 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e066719-620c-4157-80f8-3c9efe446e7f tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:36.233618 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e066719-620c-4157-80f8-3c9efe446e7f tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:36.234433 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e066719-620c-4157-80f8-3c9efe446e7f tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:36.239763 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e066719-620c-4157-80f8-3c9efe446e7f tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:36.240598 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e066719-620c-4157-80f8-3c9efe446e7f tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:37.283508 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5e066719-620c-4157-80f8-3c9efe446e7f tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24171f046534c22b854e3db9d80ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1a38df7fef8486ca8bc1040f507b9d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:37.298476 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5e066719-620c-4157-80f8-3c9efe446e7f tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] 10.222.0.60 "GET /compute/v2.1/servers/97042a13-5053-436e-b247-3f3c107a2f27" status: 200 len: 1318 microversion: 2.1 time: 1.098112 Oct 18 16:00:37.304727 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2998/6010] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:36 2022] GET /compute/v2.1/servers/97042a13-5053-436e-b247-3f3c107a2f27 => generated 1318 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:38.331944 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9443b05f-2b48-41b2-b8ef-9432030734ae tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:38.332576 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9443b05f-2b48-41b2-b8ef-9432030734ae tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] [instance: 97042a13-5053-436e-b247-3f3c107a2f27] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:38.352858 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9443b05f-2b48-41b2-b8ef-9432030734ae tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:38.358257 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9443b05f-2b48-41b2-b8ef-9432030734ae tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:38.360054 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9443b05f-2b48-41b2-b8ef-9432030734ae tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:38.363626 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9443b05f-2b48-41b2-b8ef-9432030734ae tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:38.368535 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9443b05f-2b48-41b2-b8ef-9432030734ae tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:38.369339 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9443b05f-2b48-41b2-b8ef-9432030734ae tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:38.700270 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-389c0852-debe-46a2-b79b-4928c8a676f3 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:38.703458 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-389c0852-debe-46a2-b79b-4928c8a676f3 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] [instance: 258517fa-d3ca-4b69-87e0-a2ea38ce3ce6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:38.718404 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-389c0852-debe-46a2-b79b-4928c8a676f3 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:38.720158 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-389c0852-debe-46a2-b79b-4928c8a676f3 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:38.724722 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-389c0852-debe-46a2-b79b-4928c8a676f3 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:38.726415 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-389c0852-debe-46a2-b79b-4928c8a676f3 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:38.727882 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-389c0852-debe-46a2-b79b-4928c8a676f3 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:38.730560 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-389c0852-debe-46a2-b79b-4928c8a676f3 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:38.811006 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-389c0852-debe-46a2-b79b-4928c8a676f3 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] [instance: 258517fa-d3ca-4b69-87e0-a2ea38ce3ce6] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:00:38.993053 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9443b05f-2b48-41b2-b8ef-9432030734ae tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24171f046534c22b854e3db9d80ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1a38df7fef8486ca8bc1040f507b9d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:39.002071 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9443b05f-2b48-41b2-b8ef-9432030734ae tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] 10.222.0.60 "GET /compute/v2.1/servers/97042a13-5053-436e-b247-3f3c107a2f27" status: 200 len: 1506 microversion: 2.1 time: 0.674266 Oct 18 16:00:39.002671 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3013/6011] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:38 2022] GET /compute/v2.1/servers/97042a13-5053-436e-b247-3f3c107a2f27 => generated 1506 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:39.041353 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-8446cc8c-0eeb-4d58-8155-bcf7741db64e req-62216a77-b3e2-45c0-b46d-2785d7cb113e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "258517fa-d3ca-4b69-87e0-a2ea38ce3ce6", "tag": "e1bb89df-1467-49a0-8f2f-09537d27a571"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:00:39.080400 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-8446cc8c-0eeb-4d58-8155-bcf7741db64e req-62216a77-b3e2-45c0-b46d-2785d7cb113e service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:39.081177 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-8446cc8c-0eeb-4d58-8155-bcf7741db64e req-62216a77-b3e2-45c0-b46d-2785d7cb113e service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:39.081608 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-8446cc8c-0eeb-4d58-8155-bcf7741db64e req-62216a77-b3e2-45c0-b46d-2785d7cb113e service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:39.086022 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-389c0852-debe-46a2-b79b-4928c8a676f3 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] 10.222.0.60 "DELETE /compute/v2.1/servers/258517fa-d3ca-4b69-87e0-a2ea38ce3ce6" status: 204 len: 0 microversion: 2.1 time: 0.412833 Oct 18 16:00:39.087502 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2999/6012] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 16:00:38 2022] DELETE /compute/v2.1/servers/258517fa-d3ca-4b69-87e0-a2ea38ce3ce6 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:00:39.098659 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c3b474ae-408b-4535-8463-2b9aeb3377bc tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:39.100064 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c3b474ae-408b-4535-8463-2b9aeb3377bc tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] [instance: 258517fa-d3ca-4b69-87e0-a2ea38ce3ce6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:39.108992 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3b474ae-408b-4535-8463-2b9aeb3377bc tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:39.110120 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3b474ae-408b-4535-8463-2b9aeb3377bc tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:39.111097 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3b474ae-408b-4535-8463-2b9aeb3377bc tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:39.112064 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3b474ae-408b-4535-8463-2b9aeb3377bc tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:39.112986 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3b474ae-408b-4535-8463-2b9aeb3377bc tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:39.114067 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3b474ae-408b-4535-8463-2b9aeb3377bc tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:39.121721 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-8446cc8c-0eeb-4d58-8155-bcf7741db64e req-62216a77-b3e2-45c0-b46d-2785d7cb113e service nova] Creating event network-changed:e1bb89df-1467-49a0-8f2f-09537d27a571 for instance 258517fa-d3ca-4b69-87e0-a2ea38ce3ce6 on n-h2-853682-5 Oct 18 16:00:39.143675 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-8446cc8c-0eeb-4d58-8155-bcf7741db64e req-62216a77-b3e2-45c0-b46d-2785d7cb113e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106218 Oct 18 16:00:39.144277 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3014/6013] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:00:39.857710 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c3b474ae-408b-4535-8463-2b9aeb3377bc tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab5a58990724e7bbbf18025ccdfcc1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62510e4663941a9ae5a7c4a810d316c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:39.884626 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c3b474ae-408b-4535-8463-2b9aeb3377bc tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] 10.222.0.60 "GET /compute/v2.1/servers/258517fa-d3ca-4b69-87e0-a2ea38ce3ce6" status: 200 len: 1768 microversion: 2.1 time: 0.792098 Oct 18 16:00:39.912865 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3000/6014] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:39 2022] GET /compute/v2.1/servers/258517fa-d3ca-4b69-87e0-a2ea38ce3ce6 => generated 1768 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:40.928287 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-badfdf6b-27b2-4e0d-b630-65033430a9f5 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:40.929035 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-badfdf6b-27b2-4e0d-b630-65033430a9f5 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] [instance: 258517fa-d3ca-4b69-87e0-a2ea38ce3ce6] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:40.946271 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-badfdf6b-27b2-4e0d-b630-65033430a9f5 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:40.947002 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-badfdf6b-27b2-4e0d-b630-65033430a9f5 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:40.947659 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-badfdf6b-27b2-4e0d-b630-65033430a9f5 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:40.949096 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-badfdf6b-27b2-4e0d-b630-65033430a9f5 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:40.949770 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-badfdf6b-27b2-4e0d-b630-65033430a9f5 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:40.950638 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-badfdf6b-27b2-4e0d-b630-65033430a9f5 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:41.449599 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-badfdf6b-27b2-4e0d-b630-65033430a9f5 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab5a58990724e7bbbf18025ccdfcc1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62510e4663941a9ae5a7c4a810d316c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:41.458067 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-badfdf6b-27b2-4e0d-b630-65033430a9f5 tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] 10.222.0.60 "GET /compute/v2.1/servers/258517fa-d3ca-4b69-87e0-a2ea38ce3ce6" status: 200 len: 1768 microversion: 2.1 time: 0.533878 Oct 18 16:00:41.479516 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3015/6015] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:40 2022] GET /compute/v2.1/servers/258517fa-d3ca-4b69-87e0-a2ea38ce3ce6 => generated 1768 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:41.737755 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-cbbbe88a-c671-4338-b532-933e6e72ffdd req-dce59bf2-caf4-47cb-a6ce-798d947bd3b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "258517fa-d3ca-4b69-87e0-a2ea38ce3ce6", "name": "network-vif-deleted", "tag": "e1bb89df-1467-49a0-8f2f-09537d27a571"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:00:41.772592 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-cbbbe88a-c671-4338-b532-933e6e72ffdd req-dce59bf2-caf4-47cb-a6ce-798d947bd3b6 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:41.777204 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-cbbbe88a-c671-4338-b532-933e6e72ffdd req-dce59bf2-caf4-47cb-a6ce-798d947bd3b6 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:41.777699 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-cbbbe88a-c671-4338-b532-933e6e72ffdd req-dce59bf2-caf4-47cb-a6ce-798d947bd3b6 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:41.818975 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-cbbbe88a-c671-4338-b532-933e6e72ffdd req-dce59bf2-caf4-47cb-a6ce-798d947bd3b6 service nova] Creating event network-vif-deleted:e1bb89df-1467-49a0-8f2f-09537d27a571 for instance 258517fa-d3ca-4b69-87e0-a2ea38ce3ce6 on n-h2-853682-5 Oct 18 16:00:41.830705 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-cbbbe88a-c671-4338-b532-933e6e72ffdd req-dce59bf2-caf4-47cb-a6ce-798d947bd3b6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.431725 Oct 18 16:00:41.831986 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3001/6016] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:00:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:00:42.485525 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d0da1b9b-435c-4e0a-a445-e8e6d1a18abe tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:42.486736 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d0da1b9b-435c-4e0a-a445-e8e6d1a18abe tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] [instance: 258517fa-d3ca-4b69-87e0-a2ea38ce3ce6] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:42.495625 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d0da1b9b-435c-4e0a-a445-e8e6d1a18abe tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:42.497098 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d0da1b9b-435c-4e0a-a445-e8e6d1a18abe tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:42.497582 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d0da1b9b-435c-4e0a-a445-e8e6d1a18abe tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:42.519152 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d0da1b9b-435c-4e0a-a445-e8e6d1a18abe tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:42.521046 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d0da1b9b-435c-4e0a-a445-e8e6d1a18abe tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:42.522028 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d0da1b9b-435c-4e0a-a445-e8e6d1a18abe tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:42.660065 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d0da1b9b-435c-4e0a-a445-e8e6d1a18abe tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:42.661817 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d0da1b9b-435c-4e0a-a445-e8e6d1a18abe tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:42.662285 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d0da1b9b-435c-4e0a-a445-e8e6d1a18abe tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:42.662940 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-d0da1b9b-435c-4e0a-a445-e8e6d1a18abe tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lazy-loading 'fault' on Instance uuid 258517fa-d3ca-4b69-87e0-a2ea38ce3ce6 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:00:42.841181 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d0da1b9b-435c-4e0a-a445-e8e6d1a18abe tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab5a58990724e7bbbf18025ccdfcc1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62510e4663941a9ae5a7c4a810d316c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:00:42.866082 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d0da1b9b-435c-4e0a-a445-e8e6d1a18abe tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] 10.222.0.60 "GET /compute/v2.1/servers/258517fa-d3ca-4b69-87e0-a2ea38ce3ce6" status: 200 len: 1384 microversion: 2.1 time: 0.377979 Oct 18 16:00:42.868532 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3016/6017] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:42 2022] GET /compute/v2.1/servers/258517fa-d3ca-4b69-87e0-a2ea38ce3ce6 => generated 1384 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:00:43.907242 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7acaa631-c434-4f61-a0b7-89ffb0dc9cac tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:43.908779 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7acaa631-c434-4f61-a0b7-89ffb0dc9cac tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] [instance: 258517fa-d3ca-4b69-87e0-a2ea38ce3ce6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:00:43.937373 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7acaa631-c434-4f61-a0b7-89ffb0dc9cac tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:43.939693 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7acaa631-c434-4f61-a0b7-89ffb0dc9cac tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:43.942266 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7acaa631-c434-4f61-a0b7-89ffb0dc9cac tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:43.944885 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7acaa631-c434-4f61-a0b7-89ffb0dc9cac tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:00:43.976594 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7acaa631-c434-4f61-a0b7-89ffb0dc9cac tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:00:43.981707 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7acaa631-c434-4f61-a0b7-89ffb0dc9cac tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:00:44.053565 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-7acaa631-c434-4f61-a0b7-89ffb0dc9cac tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] HTTP exception thrown: Instance 258517fa-d3ca-4b69-87e0-a2ea38ce3ce6 could not be found. Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7acaa631-c434-4f61-a0b7-89ffb0dc9cac tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Request method failure captured: Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/258517fa-d3ca-4b69-87e0-a2ea38ce3ce6 HTTP/1.1 Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTs0Igz0IIFQkVL0A0h8tVXy7U3KOBAoacO1D4tRSqeIGkjSqu92JaXH1vkNDIv3Wg5fihwHz6IAZHUpViBVc1BZjczdtrMP3YHrnaX1EX1N85UYyRC7xZQ4hkgsTt4altr5R48jKQDuaFoLMwkU1Pe9uWPJZaxvMgQHmQaWUNRw8WLM Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: d62510e4663941a9ae5a7c4a810d316c Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1799536726 Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d62510e4663941a9ae5a7c4a810d316c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d62510e4663941a9ae5a7c4a810d316c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d62510e4663941a9ae5a7c4a810d316c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d62510e4663941a9ae5a7c4a810d316c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1799536726 Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: d62510e4663941a9ae5a7c4a810d316c Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1799536726 Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-TestSecurityGroupsBasicOps-1799536726-project Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: bab5a58990724e7bbbf18025ccdfcc1f Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1799536726-project Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 258517fa-d3ca-4b69-87e0-a2ea38ce3ce6 could not be found. Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '258517fa-d3ca-4b69-87e0-a2ea38ce3ce6'} Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 258517fa-d3ca-4b69-87e0-a2ea38ce3ce6 could not be found. Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 258517fa-d3ca-4b69-87e0-a2ea38ce3ce6 could not be found. Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:00:44.057515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:00:44.061651 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:00:44.061651 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:00:44.061651 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:00:44.061651 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:00:44.061651 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:00:44.061651 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:00:44.061651 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 258517fa-d3ca-4b69-87e0-a2ea38ce3ce6 could not be found. Oct 18 16:00:44.061651 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:00:44.089682 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7acaa631-c434-4f61-a0b7-89ffb0dc9cac tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Returning 404 to user: Instance 258517fa-d3ca-4b69-87e0-a2ea38ce3ce6 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:00:44.090633 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7acaa631-c434-4f61-a0b7-89ffb0dc9cac tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] 10.222.0.60 "GET /compute/v2.1/servers/258517fa-d3ca-4b69-87e0-a2ea38ce3ce6" status: 404 len: 111 microversion: 2.1 time: 0.190784 Oct 18 16:00:44.091151 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3002/6018] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:00:43 2022] GET /compute/v2.1/servers/258517fa-d3ca-4b69-87e0-a2ea38ce3ce6 => generated 111 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:00:56.589074 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-dd7d4195-1f0f-4ebc-bb77-0a4d4559f16c tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] Calling method '.version_select at 0x7f7c3c0cc550>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:00:56.596061 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:56.609043 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=81 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:56.663438 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-dd7d4195-1f0f-4ebc-bb77-0a4d4559f16c tempest-TestSecurityGroupsBasicOps-1799536726 tempest-TestSecurityGroupsBasicOps-1799536726-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1681176835" status: 202 len: 0 microversion: 2.1 time: 0.078704 Oct 18 16:00:56.670286 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3017/6019] 10.222.0.60 () {58 vars in 1278 bytes} [Tue Oct 18 16:00:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1681176835 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:01:21.440924 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b74cb4f3-3b85-4b4a-b9d0-2b7aba9f965e tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2c9ac4be-fef6-47d8-8221-5ee01103c191", "device": "/dev/sdb"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:01:21.444569 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b74cb4f3-3b85-4b4a-b9d0-2b7aba9f965e tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] [instance: 97042a13-5053-436e-b247-3f3c107a2f27] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:01:21.476641 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:21.480711 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:21.491079 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b74cb4f3-3b85-4b4a-b9d0-2b7aba9f965e tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:21.494034 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b74cb4f3-3b85-4b4a-b9d0-2b7aba9f965e tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:21.498563 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b74cb4f3-3b85-4b4a-b9d0-2b7aba9f965e tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:21.500714 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b74cb4f3-3b85-4b4a-b9d0-2b7aba9f965e tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:01:21.503396 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b74cb4f3-3b85-4b4a-b9d0-2b7aba9f965e tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:01:21.504457 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b74cb4f3-3b85-4b4a-b9d0-2b7aba9f965e tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:01:22.506617 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b74cb4f3-3b85-4b4a-b9d0-2b7aba9f965e tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] 10.222.0.60 "POST /compute/v2.1/servers/97042a13-5053-436e-b247-3f3c107a2f27/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.070730 Oct 18 16:01:22.521275 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3003/6020] 10.222.0.60 () {60 vars in 1323 bytes} [Tue Oct 18 16:01:21 2022] POST /compute/v2.1/servers/97042a13-5053-436e-b247-3f3c107a2f27/os-volume_attachments => generated 194 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:02:07.263974 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-edb0bd7f-b663-465c-80cb-eb5bd318303c tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:07.266185 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-edb0bd7f-b663-465c-80cb-eb5bd318303c tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] [instance: 97042a13-5053-436e-b247-3f3c107a2f27] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:07.283915 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-edb0bd7f-b663-465c-80cb-eb5bd318303c tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:07.284588 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-edb0bd7f-b663-465c-80cb-eb5bd318303c tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:07.286133 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-edb0bd7f-b663-465c-80cb-eb5bd318303c tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:07.287031 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-edb0bd7f-b663-465c-80cb-eb5bd318303c tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:07.289886 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-edb0bd7f-b663-465c-80cb-eb5bd318303c tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:07.290738 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-edb0bd7f-b663-465c-80cb-eb5bd318303c tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:07.592564 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-edb0bd7f-b663-465c-80cb-eb5bd318303c tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lazy-loading 'services' on Instance uuid 97042a13-5053-436e-b247-3f3c107a2f27 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:02:07.778444 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-edb0bd7f-b663-465c-80cb-eb5bd318303c tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] 10.222.0.60 "DELETE /compute/v2.1/servers/97042a13-5053-436e-b247-3f3c107a2f27/os-volume_attachments/2c9ac4be-fef6-47d8-8221-5ee01103c191" status: 202 len: 0 microversion: 2.1 time: 0.522676 Oct 18 16:02:07.787681 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3018/6021] 10.222.0.60 () {58 vars in 1416 bytes} [Tue Oct 18 16:02:07 2022] DELETE /compute/v2.1/servers/97042a13-5053-436e-b247-3f3c107a2f27/os-volume_attachments/2c9ac4be-fef6-47d8-8221-5ee01103c191 => generated 0 bytes in 529 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:02:13.466487 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-93a3080f-f74b-41ed-a102-e184935d3818 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-858356907", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "37fe8e24-69d2-4db9-814b-d8c404b22253"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:02:13.526450 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:13.528149 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:13.591714 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-93a3080f-f74b-41ed-a102-e184935d3818 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] validate_networks() for [('37fe8e24-69d2-4db9-814b-d8c404b22253', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 16:02:14.746562 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-93a3080f-f74b-41ed-a102-e184935d3818 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:02:14.747835 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-93a3080f-f74b-41ed-a102-e184935d3818 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:02:14.748644 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-93a3080f-f74b-41ed-a102-e184935d3818 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:02:14.749529 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-93a3080f-f74b-41ed-a102-e184935d3818 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:02:14.751114 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-93a3080f-f74b-41ed-a102-e184935d3818 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:02:14.786921 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-93a3080f-f74b-41ed-a102-e184935d3818 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:14.787696 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-93a3080f-f74b-41ed-a102-e184935d3818 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:14.789842 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-93a3080f-f74b-41ed-a102-e184935d3818 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:14.794857 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-93a3080f-f74b-41ed-a102-e184935d3818 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:14.795602 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-93a3080f-f74b-41ed-a102-e184935d3818 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:14.797272 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-93a3080f-f74b-41ed-a102-e184935d3818 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:14.873558 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-93a3080f-f74b-41ed-a102-e184935d3818 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Getting quotas for project 8ad6ee85afa94b36b68836e6e389c9b2. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:02:14.896538 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-93a3080f-f74b-41ed-a102-e184935d3818 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Getting quotas for user 8374288d39a3493b84e2b1e354f5f6bc and project 8ad6ee85afa94b36b68836e6e389c9b2. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:02:14.920306 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-93a3080f-f74b-41ed-a102-e184935d3818 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:02:14.923390 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-93a3080f-f74b-41ed-a102-e184935d3818 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] [instance: 02c4fafa-c1cf-48f5-be95-ceebb1b83350] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:02:15.024022 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-93a3080f-f74b-41ed-a102-e184935d3818 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.566905 Oct 18 16:02:15.030292 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3004/6022] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 16:02:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:02:15.050885 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-30e4d85a-7330-4f12-b790-860d94460328 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:15.052167 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-30e4d85a-7330-4f12-b790-860d94460328 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] [instance: 02c4fafa-c1cf-48f5-be95-ceebb1b83350] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:15.348670 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-30e4d85a-7330-4f12-b790-860d94460328 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8374288d39a3493b84e2b1e354f5f6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad6ee85afa94b36b68836e6e389c9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:15.359126 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-30e4d85a-7330-4f12-b790-860d94460328 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] 10.222.0.60 "GET /compute/v2.1/servers/02c4fafa-c1cf-48f5-be95-ceebb1b83350" status: 200 len: 1213 microversion: 2.1 time: 0.319963 Oct 18 16:02:15.380905 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3019/6023] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:15 2022] GET /compute/v2.1/servers/02c4fafa-c1cf-48f5-be95-ceebb1b83350 => generated 1213 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:16.386244 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-077c0420-13f8-40b6-abbf-f4bb91015b7e tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:16.386244 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-077c0420-13f8-40b6-abbf-f4bb91015b7e tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] [instance: 02c4fafa-c1cf-48f5-be95-ceebb1b83350] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:16.622971 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-077c0420-13f8-40b6-abbf-f4bb91015b7e tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8374288d39a3493b84e2b1e354f5f6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad6ee85afa94b36b68836e6e389c9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:16.631913 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-077c0420-13f8-40b6-abbf-f4bb91015b7e tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] 10.222.0.60 "GET /compute/v2.1/servers/02c4fafa-c1cf-48f5-be95-ceebb1b83350" status: 200 len: 1213 microversion: 2.1 time: 0.252161 Oct 18 16:02:16.645025 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3005/6024] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:16 2022] GET /compute/v2.1/servers/02c4fafa-c1cf-48f5-be95-ceebb1b83350 => generated 1213 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:17.674160 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-260f1023-850a-48e1-87e9-c11166a8d9ec tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:17.674804 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-260f1023-850a-48e1-87e9-c11166a8d9ec tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] [instance: 02c4fafa-c1cf-48f5-be95-ceebb1b83350] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:17.711772 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-260f1023-850a-48e1-87e9-c11166a8d9ec tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:17.712270 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-260f1023-850a-48e1-87e9-c11166a8d9ec tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:17.712714 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-260f1023-850a-48e1-87e9-c11166a8d9ec tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:17.713520 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-260f1023-850a-48e1-87e9-c11166a8d9ec tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:17.713993 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-260f1023-850a-48e1-87e9-c11166a8d9ec tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:17.714428 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-260f1023-850a-48e1-87e9-c11166a8d9ec tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:17.879941 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-260f1023-850a-48e1-87e9-c11166a8d9ec tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8374288d39a3493b84e2b1e354f5f6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad6ee85afa94b36b68836e6e389c9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:17.888930 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-260f1023-850a-48e1-87e9-c11166a8d9ec tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] 10.222.0.60 "GET /compute/v2.1/servers/02c4fafa-c1cf-48f5-be95-ceebb1b83350" status: 200 len: 1273 microversion: 2.1 time: 0.229968 Oct 18 16:02:17.893551 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3020/6025] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:17 2022] GET /compute/v2.1/servers/02c4fafa-c1cf-48f5-be95-ceebb1b83350 => generated 1273 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:18.916379 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-854bda4a-4d76-40ee-a647-8e7e2d79a5e0 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:18.917657 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-854bda4a-4d76-40ee-a647-8e7e2d79a5e0 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] [instance: 02c4fafa-c1cf-48f5-be95-ceebb1b83350] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:18.936678 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-854bda4a-4d76-40ee-a647-8e7e2d79a5e0 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:18.937490 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-854bda4a-4d76-40ee-a647-8e7e2d79a5e0 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:18.938095 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-854bda4a-4d76-40ee-a647-8e7e2d79a5e0 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:18.938981 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-854bda4a-4d76-40ee-a647-8e7e2d79a5e0 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:18.939632 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-854bda4a-4d76-40ee-a647-8e7e2d79a5e0 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:18.940225 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-854bda4a-4d76-40ee-a647-8e7e2d79a5e0 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:19.065127 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-854bda4a-4d76-40ee-a647-8e7e2d79a5e0 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8374288d39a3493b84e2b1e354f5f6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad6ee85afa94b36b68836e6e389c9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:19.078577 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-854bda4a-4d76-40ee-a647-8e7e2d79a5e0 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] 10.222.0.60 "GET /compute/v2.1/servers/02c4fafa-c1cf-48f5-be95-ceebb1b83350" status: 200 len: 1271 microversion: 2.1 time: 0.162666 Oct 18 16:02:19.079517 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3006/6026] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:18 2022] GET /compute/v2.1/servers/02c4fafa-c1cf-48f5-be95-ceebb1b83350 => generated 1271 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:19.748265 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-03ebb7a5-332d-43ae-80e0-c0da751a99e4 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:19.748990 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-03ebb7a5-332d-43ae-80e0-c0da751a99e4 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] [instance: 97042a13-5053-436e-b247-3f3c107a2f27] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:19.758190 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-03ebb7a5-332d-43ae-80e0-c0da751a99e4 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:19.758927 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-03ebb7a5-332d-43ae-80e0-c0da751a99e4 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:19.759522 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-03ebb7a5-332d-43ae-80e0-c0da751a99e4 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:19.761052 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-03ebb7a5-332d-43ae-80e0-c0da751a99e4 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:19.761671 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-03ebb7a5-332d-43ae-80e0-c0da751a99e4 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:19.762252 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-03ebb7a5-332d-43ae-80e0-c0da751a99e4 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:19.798433 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-03ebb7a5-332d-43ae-80e0-c0da751a99e4 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] [instance: 97042a13-5053-436e-b247-3f3c107a2f27] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:02:20.014961 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-03ebb7a5-332d-43ae-80e0-c0da751a99e4 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] 10.222.0.60 "DELETE /compute/v2.1/servers/97042a13-5053-436e-b247-3f3c107a2f27" status: 204 len: 0 microversion: 2.1 time: 0.272135 Oct 18 16:02:20.015704 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3021/6027] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 16:02:19 2022] DELETE /compute/v2.1/servers/97042a13-5053-436e-b247-3f3c107a2f27 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:02:20.024343 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7b440fa0-7cde-4d2c-8f4a-304719e6a382 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:20.025586 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7b440fa0-7cde-4d2c-8f4a-304719e6a382 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] [instance: 97042a13-5053-436e-b247-3f3c107a2f27] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:20.040049 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b440fa0-7cde-4d2c-8f4a-304719e6a382 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:20.041486 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b440fa0-7cde-4d2c-8f4a-304719e6a382 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:20.042079 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b440fa0-7cde-4d2c-8f4a-304719e6a382 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:20.044166 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b440fa0-7cde-4d2c-8f4a-304719e6a382 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:20.045318 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b440fa0-7cde-4d2c-8f4a-304719e6a382 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:20.046390 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b440fa0-7cde-4d2c-8f4a-304719e6a382 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:20.114457 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-655986a3-a4d5-4372-bf37-24c925dab163 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:20.116567 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-655986a3-a4d5-4372-bf37-24c925dab163 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] [instance: 02c4fafa-c1cf-48f5-be95-ceebb1b83350] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:20.132171 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-655986a3-a4d5-4372-bf37-24c925dab163 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:20.133256 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-655986a3-a4d5-4372-bf37-24c925dab163 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:20.134358 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-655986a3-a4d5-4372-bf37-24c925dab163 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:20.135869 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-655986a3-a4d5-4372-bf37-24c925dab163 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:20.136560 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-655986a3-a4d5-4372-bf37-24c925dab163 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:20.137476 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-655986a3-a4d5-4372-bf37-24c925dab163 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:20.812467 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7b440fa0-7cde-4d2c-8f4a-304719e6a382 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24171f046534c22b854e3db9d80ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1a38df7fef8486ca8bc1040f507b9d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:20.837852 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7b440fa0-7cde-4d2c-8f4a-304719e6a382 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] 10.222.0.60 "GET /compute/v2.1/servers/97042a13-5053-436e-b247-3f3c107a2f27" status: 200 len: 1512 microversion: 2.1 time: 0.815877 Oct 18 16:02:20.839033 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3007/6028] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:20 2022] GET /compute/v2.1/servers/97042a13-5053-436e-b247-3f3c107a2f27 => generated 1512 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:20.859408 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-655986a3-a4d5-4372-bf37-24c925dab163 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8374288d39a3493b84e2b1e354f5f6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad6ee85afa94b36b68836e6e389c9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:20.873910 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-655986a3-a4d5-4372-bf37-24c925dab163 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] 10.222.0.60 "GET /compute/v2.1/servers/02c4fafa-c1cf-48f5-be95-ceebb1b83350" status: 200 len: 1313 microversion: 2.1 time: 0.765561 Oct 18 16:02:20.874503 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3022/6029] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:20 2022] GET /compute/v2.1/servers/02c4fafa-c1cf-48f5-be95-ceebb1b83350 => generated 1313 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:21.786821 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-af6c67e0-80ea-4c17-896c-76b1fa18b370 req-b3610c48-f345-4f2c-bbf7-c8006a343c1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02c4fafa-c1cf-48f5-be95-ceebb1b83350", "tag": "620cd6fe-4b86-4adb-bf80-5bc16aa3a01d"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:02:21.813689 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-af6c67e0-80ea-4c17-896c-76b1fa18b370 req-b3610c48-f345-4f2c-bbf7-c8006a343c1d service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:21.814410 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-af6c67e0-80ea-4c17-896c-76b1fa18b370 req-b3610c48-f345-4f2c-bbf7-c8006a343c1d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:21.815005 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-af6c67e0-80ea-4c17-896c-76b1fa18b370 req-b3610c48-f345-4f2c-bbf7-c8006a343c1d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:21.847423 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-af6c67e0-80ea-4c17-896c-76b1fa18b370 req-b3610c48-f345-4f2c-bbf7-c8006a343c1d service nova] Creating event network-changed:620cd6fe-4b86-4adb-bf80-5bc16aa3a01d for instance 02c4fafa-c1cf-48f5-be95-ceebb1b83350 on n-h2-853682-5 Oct 18 16:02:21.863597 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-af6c67e0-80ea-4c17-896c-76b1fa18b370 req-b3610c48-f345-4f2c-bbf7-c8006a343c1d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.403823 Oct 18 16:02:21.865183 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-393a9477-2b43-4b3f-849a-6fb453c00794 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:21.866670 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-393a9477-2b43-4b3f-849a-6fb453c00794 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] [instance: 97042a13-5053-436e-b247-3f3c107a2f27] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:21.870205 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3008/6030] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:02:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:02:21.881179 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-393a9477-2b43-4b3f-849a-6fb453c00794 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:21.883403 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-393a9477-2b43-4b3f-849a-6fb453c00794 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:21.884085 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-393a9477-2b43-4b3f-849a-6fb453c00794 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:21.884923 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-393a9477-2b43-4b3f-849a-6fb453c00794 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:21.885422 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-393a9477-2b43-4b3f-849a-6fb453c00794 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:21.885866 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-393a9477-2b43-4b3f-849a-6fb453c00794 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:21.901600 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9c568e05-b3b3-406d-915a-995606499ebc tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:21.906877 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9c568e05-b3b3-406d-915a-995606499ebc tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] [instance: 02c4fafa-c1cf-48f5-be95-ceebb1b83350] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:21.926626 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c568e05-b3b3-406d-915a-995606499ebc tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:21.930431 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c568e05-b3b3-406d-915a-995606499ebc tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:21.931203 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c568e05-b3b3-406d-915a-995606499ebc tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:21.932184 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c568e05-b3b3-406d-915a-995606499ebc tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:21.942998 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c568e05-b3b3-406d-915a-995606499ebc tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:21.943878 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c568e05-b3b3-406d-915a-995606499ebc tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:22.661653 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9c568e05-b3b3-406d-915a-995606499ebc tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8374288d39a3493b84e2b1e354f5f6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad6ee85afa94b36b68836e6e389c9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:22.670292 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9c568e05-b3b3-406d-915a-995606499ebc tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] 10.222.0.60 "GET /compute/v2.1/servers/02c4fafa-c1cf-48f5-be95-ceebb1b83350" status: 200 len: 1313 microversion: 2.1 time: 0.774029 Oct 18 16:02:22.671138 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3009/6031] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:21 2022] GET /compute/v2.1/servers/02c4fafa-c1cf-48f5-be95-ceebb1b83350 => generated 1313 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:02:22.713196 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-393a9477-2b43-4b3f-849a-6fb453c00794 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24171f046534c22b854e3db9d80ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1a38df7fef8486ca8bc1040f507b9d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:22.724300 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-393a9477-2b43-4b3f-849a-6fb453c00794 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] 10.222.0.60 "GET /compute/v2.1/servers/97042a13-5053-436e-b247-3f3c107a2f27" status: 200 len: 1512 microversion: 2.1 time: 0.863674 Oct 18 16:02:22.725434 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3023/6032] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:21 2022] GET /compute/v2.1/servers/97042a13-5053-436e-b247-3f3c107a2f27 => generated 1512 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:23.700301 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-48233660-0a69-465c-abde-1f1072ca0e2a tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:23.701074 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-48233660-0a69-465c-abde-1f1072ca0e2a tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] [instance: 02c4fafa-c1cf-48f5-be95-ceebb1b83350] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:23.712842 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-48233660-0a69-465c-abde-1f1072ca0e2a tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:23.713693 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-48233660-0a69-465c-abde-1f1072ca0e2a tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:23.715179 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-48233660-0a69-465c-abde-1f1072ca0e2a tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:23.716712 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-48233660-0a69-465c-abde-1f1072ca0e2a tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:23.717435 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-48233660-0a69-465c-abde-1f1072ca0e2a tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:23.719248 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-48233660-0a69-465c-abde-1f1072ca0e2a tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:23.755235 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fde1440f-267a-48d5-b4f8-5c6429bd87cd tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:23.757587 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-fde1440f-267a-48d5-b4f8-5c6429bd87cd tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] [instance: 97042a13-5053-436e-b247-3f3c107a2f27] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:23.766336 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fde1440f-267a-48d5-b4f8-5c6429bd87cd tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:23.767961 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fde1440f-267a-48d5-b4f8-5c6429bd87cd tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:23.768655 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fde1440f-267a-48d5-b4f8-5c6429bd87cd tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:23.769680 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fde1440f-267a-48d5-b4f8-5c6429bd87cd tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:23.770565 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fde1440f-267a-48d5-b4f8-5c6429bd87cd tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:23.773470 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fde1440f-267a-48d5-b4f8-5c6429bd87cd tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:23.916046 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fde1440f-267a-48d5-b4f8-5c6429bd87cd tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:23.918357 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fde1440f-267a-48d5-b4f8-5c6429bd87cd tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:23.918960 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fde1440f-267a-48d5-b4f8-5c6429bd87cd tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:23.920495 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-fde1440f-267a-48d5-b4f8-5c6429bd87cd tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lazy-loading 'fault' on Instance uuid 97042a13-5053-436e-b247-3f3c107a2f27 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:02:24.118219 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-fde1440f-267a-48d5-b4f8-5c6429bd87cd tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24171f046534c22b854e3db9d80ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1a38df7fef8486ca8bc1040f507b9d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:24.133037 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fde1440f-267a-48d5-b4f8-5c6429bd87cd tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] 10.222.0.60 "GET /compute/v2.1/servers/97042a13-5053-436e-b247-3f3c107a2f27" status: 200 len: 1308 microversion: 2.1 time: 0.378402 Oct 18 16:02:24.133896 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3024/6033] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:23 2022] GET /compute/v2.1/servers/97042a13-5053-436e-b247-3f3c107a2f27 => generated 1308 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:02:24.204594 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-e789c037-815b-4aa8-8162-e331c8d4bb5d req-e1e2922f-219b-4e05-8b71-a02740ffb1f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97042a13-5053-436e-b247-3f3c107a2f27", "name": "network-vif-deleted", "tag": "376a1199-87d6-4647-ab08-6bf31d946247"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:02:24.220182 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-e789c037-815b-4aa8-8162-e331c8d4bb5d req-e1e2922f-219b-4e05-8b71-a02740ffb1f8 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:24.220675 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-e789c037-815b-4aa8-8162-e331c8d4bb5d req-e1e2922f-219b-4e05-8b71-a02740ffb1f8 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:24.221146 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-e789c037-815b-4aa8-8162-e331c8d4bb5d req-e1e2922f-219b-4e05-8b71-a02740ffb1f8 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:24.243670 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-e789c037-815b-4aa8-8162-e331c8d4bb5d req-e1e2922f-219b-4e05-8b71-a02740ffb1f8 service nova] Creating event network-vif-deleted:376a1199-87d6-4647-ab08-6bf31d946247 for instance 97042a13-5053-436e-b247-3f3c107a2f27 on n-h1-853682-5 Oct 18 16:02:24.259535 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-e789c037-815b-4aa8-8162-e331c8d4bb5d req-e1e2922f-219b-4e05-8b71-a02740ffb1f8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058559 Oct 18 16:02:24.260519 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3025/6034] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:02:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:02:24.524861 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-48233660-0a69-465c-abde-1f1072ca0e2a tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8374288d39a3493b84e2b1e354f5f6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad6ee85afa94b36b68836e6e389c9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:24.543875 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-48233660-0a69-465c-abde-1f1072ca0e2a tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] 10.222.0.60 "GET /compute/v2.1/servers/02c4fafa-c1cf-48f5-be95-ceebb1b83350" status: 200 len: 1313 microversion: 2.1 time: 0.849460 Oct 18 16:02:24.564472 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3010/6035] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:23 2022] GET /compute/v2.1/servers/02c4fafa-c1cf-48f5-be95-ceebb1b83350 => generated 1313 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:25.160285 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-475157cf-8758-4e93-b0b7-3489a3566de1 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:25.162967 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-475157cf-8758-4e93-b0b7-3489a3566de1 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] [instance: 97042a13-5053-436e-b247-3f3c107a2f27] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:25.182196 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-475157cf-8758-4e93-b0b7-3489a3566de1 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:25.184405 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-475157cf-8758-4e93-b0b7-3489a3566de1 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:25.186780 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-475157cf-8758-4e93-b0b7-3489a3566de1 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:25.189694 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-475157cf-8758-4e93-b0b7-3489a3566de1 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:25.191771 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-475157cf-8758-4e93-b0b7-3489a3566de1 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:25.193633 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-475157cf-8758-4e93-b0b7-3489a3566de1 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:25.231343 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-475157cf-8758-4e93-b0b7-3489a3566de1 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] HTTP exception thrown: Instance 97042a13-5053-436e-b247-3f3c107a2f27 could not be found. Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-475157cf-8758-4e93-b0b7-3489a3566de1 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Request method failure captured: Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/97042a13-5053-436e-b247-3f3c107a2f27 HTTP/1.1 Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTs0eC7puxYpvji8pzouugzlqsTisQi82VsqCQOaXeBoa8Rl7tEspni9EyXvcO07o7XCksUI2Mxb7vXXR-HjmYYC8Kd8o1d45gzuq0quAnOAYjH2HL6qzjhG9dQsEfbkOj5aFH3BmAIVBK8x_sa9HPfc62BY5WQQuN4xzEfvKNAXEKQ8 Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: b1a38df7fef8486ca8bc1040f507b9d7 Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1064890439 Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b1a38df7fef8486ca8bc1040f507b9d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b1a38df7fef8486ca8bc1040f507b9d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b1a38df7fef8486ca8bc1040f507b9d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b1a38df7fef8486ca8bc1040f507b9d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-VolumesSnapshotTestJSON-1064890439 Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: b1a38df7fef8486ca8bc1040f507b9d7 Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1064890439 Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-VolumesSnapshotTestJSON-1064890439-project Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: e24171f046534c22b854e3db9d80ed6d Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-VolumesSnapshotTestJSON-1064890439-project Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 97042a13-5053-436e-b247-3f3c107a2f27 could not be found. Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '97042a13-5053-436e-b247-3f3c107a2f27'} Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97042a13-5053-436e-b247-3f3c107a2f27 could not be found. Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97042a13-5053-436e-b247-3f3c107a2f27 could not be found. Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:02:25.235948 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:02:25.239970 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:02:25.239970 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:02:25.239970 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:02:25.239970 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:02:25.239970 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:02:25.239970 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97042a13-5053-436e-b247-3f3c107a2f27 could not be found. Oct 18 16:02:25.239970 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:02:25.242979 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-475157cf-8758-4e93-b0b7-3489a3566de1 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Returning 404 to user: Instance 97042a13-5053-436e-b247-3f3c107a2f27 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:02:25.244937 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-475157cf-8758-4e93-b0b7-3489a3566de1 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] 10.222.0.60 "GET /compute/v2.1/servers/97042a13-5053-436e-b247-3f3c107a2f27" status: 404 len: 111 microversion: 2.1 time: 0.091008 Oct 18 16:02:25.247313 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3026/6036] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:25 2022] GET /compute/v2.1/servers/97042a13-5053-436e-b247-3f3c107a2f27 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:02:25.592232 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2318bac3-4117-48bf-9b1a-735aa74b7994 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:25.593755 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2318bac3-4117-48bf-9b1a-735aa74b7994 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] [instance: 02c4fafa-c1cf-48f5-be95-ceebb1b83350] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:25.601929 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:25.616345 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2318bac3-4117-48bf-9b1a-735aa74b7994 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:25.618397 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2318bac3-4117-48bf-9b1a-735aa74b7994 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:25.620408 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2318bac3-4117-48bf-9b1a-735aa74b7994 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:25.621417 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2318bac3-4117-48bf-9b1a-735aa74b7994 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:25.623724 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2318bac3-4117-48bf-9b1a-735aa74b7994 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:25.625039 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2318bac3-4117-48bf-9b1a-735aa74b7994 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:25.952607 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2318bac3-4117-48bf-9b1a-735aa74b7994 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8374288d39a3493b84e2b1e354f5f6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad6ee85afa94b36b68836e6e389c9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:25.965827 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2318bac3-4117-48bf-9b1a-735aa74b7994 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] 10.222.0.60 "GET /compute/v2.1/servers/02c4fafa-c1cf-48f5-be95-ceebb1b83350" status: 200 len: 1313 microversion: 2.1 time: 0.378671 Oct 18 16:02:25.967002 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3011/6037] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:25 2022] GET /compute/v2.1/servers/02c4fafa-c1cf-48f5-be95-ceebb1b83350 => generated 1313 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:26.994644 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4ab7faea-7503-481f-b3aa-d822e087ad21 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:26.995282 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4ab7faea-7503-481f-b3aa-d822e087ad21 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] [instance: 02c4fafa-c1cf-48f5-be95-ceebb1b83350] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:26.997483 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:27.016841 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ab7faea-7503-481f-b3aa-d822e087ad21 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:27.023016 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ab7faea-7503-481f-b3aa-d822e087ad21 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:27.023667 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ab7faea-7503-481f-b3aa-d822e087ad21 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:27.024576 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ab7faea-7503-481f-b3aa-d822e087ad21 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:27.025238 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ab7faea-7503-481f-b3aa-d822e087ad21 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:27.032033 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ab7faea-7503-481f-b3aa-d822e087ad21 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:27.169710 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=8 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:27.425315 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4ab7faea-7503-481f-b3aa-d822e087ad21 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8374288d39a3493b84e2b1e354f5f6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad6ee85afa94b36b68836e6e389c9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:27.439419 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4ab7faea-7503-481f-b3aa-d822e087ad21 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] 10.222.0.60 "GET /compute/v2.1/servers/02c4fafa-c1cf-48f5-be95-ceebb1b83350" status: 200 len: 1313 microversion: 2.1 time: 0.448969 Oct 18 16:02:27.443857 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3027/6038] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:26 2022] GET /compute/v2.1/servers/02c4fafa-c1cf-48f5-be95-ceebb1b83350 => generated 1313 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:27.660634 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-483810b1-ea72-48a3-9565-99af7985013c req-03942a69-6151-4dca-9972-c7d8b9369c83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02c4fafa-c1cf-48f5-be95-ceebb1b83350", "name": "network-vif-plugged", "status": "completed", "tag": "620cd6fe-4b86-4adb-bf80-5bc16aa3a01d"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:02:27.730876 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-483810b1-ea72-48a3-9565-99af7985013c req-03942a69-6151-4dca-9972-c7d8b9369c83 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:27.736453 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-483810b1-ea72-48a3-9565-99af7985013c req-03942a69-6151-4dca-9972-c7d8b9369c83 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:27.737185 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-483810b1-ea72-48a3-9565-99af7985013c req-03942a69-6151-4dca-9972-c7d8b9369c83 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:27.777630 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-483810b1-ea72-48a3-9565-99af7985013c req-03942a69-6151-4dca-9972-c7d8b9369c83 service nova] Creating event network-vif-plugged:620cd6fe-4b86-4adb-bf80-5bc16aa3a01d for instance 02c4fafa-c1cf-48f5-be95-ceebb1b83350 on n-h2-853682-5 Oct 18 16:02:27.796403 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-483810b1-ea72-48a3-9565-99af7985013c req-03942a69-6151-4dca-9972-c7d8b9369c83 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.641217 Oct 18 16:02:27.809312 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3012/6039] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:02:28.465349 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8c40bbce-d9f7-4d24-b1ee-4e2076e85d6d tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:28.466551 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8c40bbce-d9f7-4d24-b1ee-4e2076e85d6d tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] [instance: 02c4fafa-c1cf-48f5-be95-ceebb1b83350] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:28.477884 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c40bbce-d9f7-4d24-b1ee-4e2076e85d6d tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:28.479215 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c40bbce-d9f7-4d24-b1ee-4e2076e85d6d tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:28.481797 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c40bbce-d9f7-4d24-b1ee-4e2076e85d6d tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:28.483653 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c40bbce-d9f7-4d24-b1ee-4e2076e85d6d tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:28.486474 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c40bbce-d9f7-4d24-b1ee-4e2076e85d6d tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:28.487092 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c40bbce-d9f7-4d24-b1ee-4e2076e85d6d tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:28.731987 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8c40bbce-d9f7-4d24-b1ee-4e2076e85d6d tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8374288d39a3493b84e2b1e354f5f6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad6ee85afa94b36b68836e6e389c9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:28.746588 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8c40bbce-d9f7-4d24-b1ee-4e2076e85d6d tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] 10.222.0.60 "GET /compute/v2.1/servers/02c4fafa-c1cf-48f5-be95-ceebb1b83350" status: 200 len: 1313 microversion: 2.1 time: 0.285007 Oct 18 16:02:28.762232 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3028/6040] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:28 2022] GET /compute/v2.1/servers/02c4fafa-c1cf-48f5-be95-ceebb1b83350 => generated 1313 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:29.775299 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9b000d9d-4f8c-48fc-8c92-a30fb03bc426 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:29.776801 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9b000d9d-4f8c-48fc-8c92-a30fb03bc426 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] [instance: 02c4fafa-c1cf-48f5-be95-ceebb1b83350] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:29.802142 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9b000d9d-4f8c-48fc-8c92-a30fb03bc426 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:29.809029 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9b000d9d-4f8c-48fc-8c92-a30fb03bc426 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:29.810505 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9b000d9d-4f8c-48fc-8c92-a30fb03bc426 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:29.815582 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9b000d9d-4f8c-48fc-8c92-a30fb03bc426 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:29.816172 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9b000d9d-4f8c-48fc-8c92-a30fb03bc426 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:29.817161 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9b000d9d-4f8c-48fc-8c92-a30fb03bc426 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:30.286321 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9b000d9d-4f8c-48fc-8c92-a30fb03bc426 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8374288d39a3493b84e2b1e354f5f6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad6ee85afa94b36b68836e6e389c9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:30.296381 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9b000d9d-4f8c-48fc-8c92-a30fb03bc426 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] 10.222.0.60 "GET /compute/v2.1/servers/02c4fafa-c1cf-48f5-be95-ceebb1b83350" status: 200 len: 1496 microversion: 2.1 time: 0.527894 Oct 18 16:02:30.299889 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3013/6041] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:29 2022] GET /compute/v2.1/servers/02c4fafa-c1cf-48f5-be95-ceebb1b83350 => generated 1496 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:31.157672 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9e36464a-5135-4534-80f1-22cba8514e3e tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:31.163307 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9e36464a-5135-4534-80f1-22cba8514e3e tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] [instance: 02c4fafa-c1cf-48f5-be95-ceebb1b83350] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:31.174366 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9e36464a-5135-4534-80f1-22cba8514e3e tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:31.175099 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9e36464a-5135-4534-80f1-22cba8514e3e tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:31.177202 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9e36464a-5135-4534-80f1-22cba8514e3e tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:31.179238 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9e36464a-5135-4534-80f1-22cba8514e3e tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:31.180125 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9e36464a-5135-4534-80f1-22cba8514e3e tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:31.183198 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9e36464a-5135-4534-80f1-22cba8514e3e tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:31.258476 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9e36464a-5135-4534-80f1-22cba8514e3e tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] [instance: 02c4fafa-c1cf-48f5-be95-ceebb1b83350] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:02:31.462540 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9e36464a-5135-4534-80f1-22cba8514e3e tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] 10.222.0.60 "DELETE /compute/v2.1/servers/02c4fafa-c1cf-48f5-be95-ceebb1b83350" status: 204 len: 0 microversion: 2.1 time: 0.306872 Oct 18 16:02:31.466826 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3029/6042] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 16:02:31 2022] DELETE /compute/v2.1/servers/02c4fafa-c1cf-48f5-be95-ceebb1b83350 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:02:31.472496 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1a56f6ce-d481-48af-ad6b-47acfe17af1e tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:31.474400 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1a56f6ce-d481-48af-ad6b-47acfe17af1e tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] [instance: 02c4fafa-c1cf-48f5-be95-ceebb1b83350] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:31.483166 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1a56f6ce-d481-48af-ad6b-47acfe17af1e tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:31.483895 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1a56f6ce-d481-48af-ad6b-47acfe17af1e tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:31.484546 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1a56f6ce-d481-48af-ad6b-47acfe17af1e tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:31.485617 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1a56f6ce-d481-48af-ad6b-47acfe17af1e tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:31.486461 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1a56f6ce-d481-48af-ad6b-47acfe17af1e tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:31.487238 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1a56f6ce-d481-48af-ad6b-47acfe17af1e tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:31.776982 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1a56f6ce-d481-48af-ad6b-47acfe17af1e tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8374288d39a3493b84e2b1e354f5f6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad6ee85afa94b36b68836e6e389c9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:31.789366 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1a56f6ce-d481-48af-ad6b-47acfe17af1e tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] 10.222.0.60 "GET /compute/v2.1/servers/02c4fafa-c1cf-48f5-be95-ceebb1b83350" status: 200 len: 1502 microversion: 2.1 time: 0.319419 Oct 18 16:02:31.792539 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3014/6043] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:31 2022] GET /compute/v2.1/servers/02c4fafa-c1cf-48f5-be95-ceebb1b83350 => generated 1502 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:32.830820 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9a30cb1a-1f04-4bdc-96cd-f68ba12e1951 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:32.835403 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9a30cb1a-1f04-4bdc-96cd-f68ba12e1951 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] [instance: 02c4fafa-c1cf-48f5-be95-ceebb1b83350] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:32.885571 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9a30cb1a-1f04-4bdc-96cd-f68ba12e1951 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:32.886068 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9a30cb1a-1f04-4bdc-96cd-f68ba12e1951 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:32.886511 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9a30cb1a-1f04-4bdc-96cd-f68ba12e1951 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:32.887231 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9a30cb1a-1f04-4bdc-96cd-f68ba12e1951 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:32.887689 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9a30cb1a-1f04-4bdc-96cd-f68ba12e1951 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:32.888115 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9a30cb1a-1f04-4bdc-96cd-f68ba12e1951 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:33.183334 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9a30cb1a-1f04-4bdc-96cd-f68ba12e1951 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8374288d39a3493b84e2b1e354f5f6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad6ee85afa94b36b68836e6e389c9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:33.191678 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9a30cb1a-1f04-4bdc-96cd-f68ba12e1951 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] 10.222.0.60 "GET /compute/v2.1/servers/02c4fafa-c1cf-48f5-be95-ceebb1b83350" status: 200 len: 1502 microversion: 2.1 time: 0.377222 Oct 18 16:02:33.195737 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3030/6044] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:32 2022] GET /compute/v2.1/servers/02c4fafa-c1cf-48f5-be95-ceebb1b83350 => generated 1502 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:34.215707 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8d37836a-1704-461f-b9bb-7f1433c27d1b tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:34.216334 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8d37836a-1704-461f-b9bb-7f1433c27d1b tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] [instance: 02c4fafa-c1cf-48f5-be95-ceebb1b83350] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:34.226073 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d37836a-1704-461f-b9bb-7f1433c27d1b tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:34.226569 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d37836a-1704-461f-b9bb-7f1433c27d1b tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:34.231225 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d37836a-1704-461f-b9bb-7f1433c27d1b tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:34.231993 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d37836a-1704-461f-b9bb-7f1433c27d1b tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:34.232474 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d37836a-1704-461f-b9bb-7f1433c27d1b tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:34.232945 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d37836a-1704-461f-b9bb-7f1433c27d1b tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:34.382908 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-8c6afe75-7860-4ae9-84a3-353a67be593d req-b902ec2e-7b73-40a9-aaa4-53b51c92ef30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02c4fafa-c1cf-48f5-be95-ceebb1b83350", "name": "network-vif-deleted", "tag": "620cd6fe-4b86-4adb-bf80-5bc16aa3a01d"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:02:34.418415 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-8c6afe75-7860-4ae9-84a3-353a67be593d req-b902ec2e-7b73-40a9-aaa4-53b51c92ef30 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:34.421308 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-8c6afe75-7860-4ae9-84a3-353a67be593d req-b902ec2e-7b73-40a9-aaa4-53b51c92ef30 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:34.422939 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-8c6afe75-7860-4ae9-84a3-353a67be593d req-b902ec2e-7b73-40a9-aaa4-53b51c92ef30 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:34.446205 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8d37836a-1704-461f-b9bb-7f1433c27d1b tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8374288d39a3493b84e2b1e354f5f6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad6ee85afa94b36b68836e6e389c9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:34.460411 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8d37836a-1704-461f-b9bb-7f1433c27d1b tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] 10.222.0.60 "GET /compute/v2.1/servers/02c4fafa-c1cf-48f5-be95-ceebb1b83350" status: 200 len: 1460 microversion: 2.1 time: 0.248942 Oct 18 16:02:34.461744 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3015/6045] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:34 2022] GET /compute/v2.1/servers/02c4fafa-c1cf-48f5-be95-ceebb1b83350 => generated 1460 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:34.479950 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-8c6afe75-7860-4ae9-84a3-353a67be593d req-b902ec2e-7b73-40a9-aaa4-53b51c92ef30 service nova] Creating event network-vif-deleted:620cd6fe-4b86-4adb-bf80-5bc16aa3a01d for instance 02c4fafa-c1cf-48f5-be95-ceebb1b83350 on n-h2-853682-5 Oct 18 16:02:34.498795 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-8c6afe75-7860-4ae9-84a3-353a67be593d req-b902ec2e-7b73-40a9-aaa4-53b51c92ef30 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120500 Oct 18 16:02:34.541224 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3031/6046] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:02:35.483723 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-764a4009-1a09-47a9-a0d7-792509f77d99 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:35.485025 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-764a4009-1a09-47a9-a0d7-792509f77d99 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] [instance: 02c4fafa-c1cf-48f5-be95-ceebb1b83350] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:35.492908 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-764a4009-1a09-47a9-a0d7-792509f77d99 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:35.493667 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-764a4009-1a09-47a9-a0d7-792509f77d99 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:35.494738 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-764a4009-1a09-47a9-a0d7-792509f77d99 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:35.495733 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-764a4009-1a09-47a9-a0d7-792509f77d99 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:35.496352 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-764a4009-1a09-47a9-a0d7-792509f77d99 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:35.496971 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-764a4009-1a09-47a9-a0d7-792509f77d99 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:35.511927 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-764a4009-1a09-47a9-a0d7-792509f77d99 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] HTTP exception thrown: Instance 02c4fafa-c1cf-48f5-be95-ceebb1b83350 could not be found. Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-764a4009-1a09-47a9-a0d7-792509f77d99 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Request method failure captured: Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/02c4fafa-c1cf-48f5-be95-ceebb1b83350 HTTP/1.1 Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTs4AFzaBMWqNh0ALh5s_wLz-dBTeFqNO2Tpe68wGwIBuC_rQpyyoppEVkggRXz8JK5F-q9TwEaC5GGagX1_03TlXEjeKSJoZA2cP8u--EM9zVW3WyAOmtwB1qL8FdpqSVtxNiR66blkm87aytzmsMbm5NIjbhTwSuOX1jYvON4eGGAE Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 8ad6ee85afa94b36b68836e6e389c9b2 Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-VolumesActionsTest-1325326224 Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8ad6ee85afa94b36b68836e6e389c9b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8ad6ee85afa94b36b68836e6e389c9b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8ad6ee85afa94b36b68836e6e389c9b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8ad6ee85afa94b36b68836e6e389c9b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-VolumesActionsTest-1325326224 Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 8ad6ee85afa94b36b68836e6e389c9b2 Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-VolumesActionsTest-1325326224 Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-VolumesActionsTest-1325326224-project Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 8374288d39a3493b84e2b1e354f5f6bc Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-VolumesActionsTest-1325326224-project Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 02c4fafa-c1cf-48f5-be95-ceebb1b83350 could not be found. Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '02c4fafa-c1cf-48f5-be95-ceebb1b83350'} Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02c4fafa-c1cf-48f5-be95-ceebb1b83350 could not be found. Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02c4fafa-c1cf-48f5-be95-ceebb1b83350 could not be found. Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:02:35.513928 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:02:35.517870 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:02:35.517870 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:02:35.517870 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:02:35.517870 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:02:35.517870 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:02:35.517870 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02c4fafa-c1cf-48f5-be95-ceebb1b83350 could not be found. Oct 18 16:02:35.517870 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:02:35.519841 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-764a4009-1a09-47a9-a0d7-792509f77d99 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Returning 404 to user: Instance 02c4fafa-c1cf-48f5-be95-ceebb1b83350 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:02:35.520957 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-764a4009-1a09-47a9-a0d7-792509f77d99 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] 10.222.0.60 "GET /compute/v2.1/servers/02c4fafa-c1cf-48f5-be95-ceebb1b83350" status: 404 len: 111 microversion: 2.1 time: 0.041306 Oct 18 16:02:35.522224 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3016/6047] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:35 2022] GET /compute/v2.1/servers/02c4fafa-c1cf-48f5-be95-ceebb1b83350 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:02:35.701170 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-97e99964-228d-4ace-ab85-63f6c349400f tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1254361511", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "37fe8e24-69d2-4db9-814b-d8c404b22253"}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:02:35.781812 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-97e99964-228d-4ace-ab85-63f6c349400f tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] validate_networks() for [('37fe8e24-69d2-4db9-814b-d8c404b22253', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 16:02:35.972691 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-32da5e82-c884-4f18-a10f-948ca5c1d904 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1551376091", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "474ab74d-9d7a-430f-bdbd-4a828b657e5e"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:02:36.056632 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-32da5e82-c884-4f18-a10f-948ca5c1d904 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] validate_networks() for [('474ab74d-9d7a-430f-bdbd-4a828b657e5e', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 16:02:36.916706 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-97e99964-228d-4ace-ab85-63f6c349400f tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:02:36.917310 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-97e99964-228d-4ace-ab85-63f6c349400f tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:02:36.918757 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-97e99964-228d-4ace-ab85-63f6c349400f tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:02:36.919318 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-97e99964-228d-4ace-ab85-63f6c349400f tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:02:36.919968 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-97e99964-228d-4ace-ab85-63f6c349400f tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:02:36.941460 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97e99964-228d-4ace-ab85-63f6c349400f tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:36.941979 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97e99964-228d-4ace-ab85-63f6c349400f tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:36.942511 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97e99964-228d-4ace-ab85-63f6c349400f tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:36.943891 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97e99964-228d-4ace-ab85-63f6c349400f tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:36.944574 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97e99964-228d-4ace-ab85-63f6c349400f tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:36.947123 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97e99964-228d-4ace-ab85-63f6c349400f tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:36.977005 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-97e99964-228d-4ace-ab85-63f6c349400f tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Getting quotas for project 8ad6ee85afa94b36b68836e6e389c9b2. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:02:37.001544 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-97e99964-228d-4ace-ab85-63f6c349400f tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Getting quotas for user 8374288d39a3493b84e2b1e354f5f6bc and project 8ad6ee85afa94b36b68836e6e389c9b2. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:02:37.039595 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-97e99964-228d-4ace-ab85-63f6c349400f tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:02:37.042825 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-97e99964-228d-4ace-ab85-63f6c349400f tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] [instance: d99d89a1-38f6-4219-8d0c-38b13cd97364] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:02:37.130436 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-97e99964-228d-4ace-ab85-63f6c349400f tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.438504 Oct 18 16:02:37.143900 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-32da5e82-c884-4f18-a10f-948ca5c1d904 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:02:37.144380 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-32da5e82-c884-4f18-a10f-948ca5c1d904 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:02:37.144873 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-32da5e82-c884-4f18-a10f-948ca5c1d904 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:02:37.145272 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-32da5e82-c884-4f18-a10f-948ca5c1d904 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:02:37.145749 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-32da5e82-c884-4f18-a10f-948ca5c1d904 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:02:37.154609 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3032/6048] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 16:02:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1463 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:02:37.174082 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-21bc0bba-7007-495d-80a8-4318f9fea3f6 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:37.174620 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-21bc0bba-7007-495d-80a8-4318f9fea3f6 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] [instance: d99d89a1-38f6-4219-8d0c-38b13cd97364] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:37.181099 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32da5e82-c884-4f18-a10f-948ca5c1d904 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:37.186651 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32da5e82-c884-4f18-a10f-948ca5c1d904 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:37.187144 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32da5e82-c884-4f18-a10f-948ca5c1d904 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:37.187954 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32da5e82-c884-4f18-a10f-948ca5c1d904 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:37.188424 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32da5e82-c884-4f18-a10f-948ca5c1d904 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:37.197896 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32da5e82-c884-4f18-a10f-948ca5c1d904 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:37.266256 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-32da5e82-c884-4f18-a10f-948ca5c1d904 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Getting quotas for project b1a38df7fef8486ca8bc1040f507b9d7. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:02:37.279771 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-32da5e82-c884-4f18-a10f-948ca5c1d904 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Getting quotas for user e24171f046534c22b854e3db9d80ed6d and project b1a38df7fef8486ca8bc1040f507b9d7. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:02:37.319620 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-32da5e82-c884-4f18-a10f-948ca5c1d904 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:02:37.325609 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-21bc0bba-7007-495d-80a8-4318f9fea3f6 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8374288d39a3493b84e2b1e354f5f6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad6ee85afa94b36b68836e6e389c9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:37.335683 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-32da5e82-c884-4f18-a10f-948ca5c1d904 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] [instance: 1fc7455b-8b12-4d55-a8b1-c825ca631301] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:02:37.347186 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-21bc0bba-7007-495d-80a8-4318f9fea3f6 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] 10.222.0.60 "GET /compute/v2.1/servers/d99d89a1-38f6-4219-8d0c-38b13cd97364" status: 200 len: 1214 microversion: 2.1 time: 0.184539 Oct 18 16:02:37.347789 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3033/6049] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:37 2022] GET /compute/v2.1/servers/d99d89a1-38f6-4219-8d0c-38b13cd97364 => generated 1214 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:37.461903 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-32da5e82-c884-4f18-a10f-948ca5c1d904 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.493135 Oct 18 16:02:37.466522 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3017/6050] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 16:02:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1499 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:02:37.479284 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-99e291c2-ccd6-4fba-8b19-fab616754dad tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:37.479414 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-99e291c2-ccd6-4fba-8b19-fab616754dad tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] [instance: 1fc7455b-8b12-4d55-a8b1-c825ca631301] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:37.481778 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=63,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:37.586409 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-99e291c2-ccd6-4fba-8b19-fab616754dad tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24171f046534c22b854e3db9d80ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1a38df7fef8486ca8bc1040f507b9d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:37.595429 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-99e291c2-ccd6-4fba-8b19-fab616754dad tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] 10.222.0.60 "GET /compute/v2.1/servers/1fc7455b-8b12-4d55-a8b1-c825ca631301" status: 200 len: 1219 microversion: 2.1 time: 0.121325 Oct 18 16:02:37.602443 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3034/6051] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:37 2022] GET /compute/v2.1/servers/1fc7455b-8b12-4d55-a8b1-c825ca631301 => generated 1219 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:38.376188 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8e491898-861b-4f88-8a00-edda342c4fd6 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:38.376914 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8e491898-861b-4f88-8a00-edda342c4fd6 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] [instance: d99d89a1-38f6-4219-8d0c-38b13cd97364] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:38.504613 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8e491898-861b-4f88-8a00-edda342c4fd6 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8374288d39a3493b84e2b1e354f5f6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad6ee85afa94b36b68836e6e389c9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:38.523587 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8e491898-861b-4f88-8a00-edda342c4fd6 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] 10.222.0.60 "GET /compute/v2.1/servers/d99d89a1-38f6-4219-8d0c-38b13cd97364" status: 200 len: 1214 microversion: 2.1 time: 0.150046 Oct 18 16:02:38.524424 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3018/6052] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:38 2022] GET /compute/v2.1/servers/d99d89a1-38f6-4219-8d0c-38b13cd97364 => generated 1214 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:38.625699 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7784305c-22c4-4757-849a-677a060dacc4 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:38.626248 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7784305c-22c4-4757-849a-677a060dacc4 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] [instance: 1fc7455b-8b12-4d55-a8b1-c825ca631301] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:38.649614 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7784305c-22c4-4757-849a-677a060dacc4 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:38.651027 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7784305c-22c4-4757-849a-677a060dacc4 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:38.652615 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7784305c-22c4-4757-849a-677a060dacc4 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:38.654037 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7784305c-22c4-4757-849a-677a060dacc4 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:38.654803 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7784305c-22c4-4757-849a-677a060dacc4 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:38.655238 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7784305c-22c4-4757-849a-677a060dacc4 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:38.672471 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:38.801241 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7784305c-22c4-4757-849a-677a060dacc4 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24171f046534c22b854e3db9d80ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1a38df7fef8486ca8bc1040f507b9d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:38.830115 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7784305c-22c4-4757-849a-677a060dacc4 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] 10.222.0.60 "GET /compute/v2.1/servers/1fc7455b-8b12-4d55-a8b1-c825ca631301" status: 200 len: 1215 microversion: 2.1 time: 0.208723 Oct 18 16:02:38.830835 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3035/6053] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:38 2022] GET /compute/v2.1/servers/1fc7455b-8b12-4d55-a8b1-c825ca631301 => generated 1215 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:39.555564 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4a89a9b7-d9c6-4378-8027-562602269a35 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:39.556281 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4a89a9b7-d9c6-4378-8027-562602269a35 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] [instance: d99d89a1-38f6-4219-8d0c-38b13cd97364] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:39.573459 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a89a9b7-d9c6-4378-8027-562602269a35 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:39.574361 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a89a9b7-d9c6-4378-8027-562602269a35 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:39.574976 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a89a9b7-d9c6-4378-8027-562602269a35 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:39.575910 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a89a9b7-d9c6-4378-8027-562602269a35 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:39.577781 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a89a9b7-d9c6-4378-8027-562602269a35 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:39.578552 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a89a9b7-d9c6-4378-8027-562602269a35 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:39.697352 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4a89a9b7-d9c6-4378-8027-562602269a35 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8374288d39a3493b84e2b1e354f5f6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad6ee85afa94b36b68836e6e389c9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:39.707655 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4a89a9b7-d9c6-4378-8027-562602269a35 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] 10.222.0.60 "GET /compute/v2.1/servers/d99d89a1-38f6-4219-8d0c-38b13cd97364" status: 200 len: 1218 microversion: 2.1 time: 0.160061 Oct 18 16:02:39.708442 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3019/6054] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:39 2022] GET /compute/v2.1/servers/d99d89a1-38f6-4219-8d0c-38b13cd97364 => generated 1218 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:39.855673 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d2d80fc5-362f-446a-8390-356bd92e9779 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:39.856301 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d2d80fc5-362f-446a-8390-356bd92e9779 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] [instance: 1fc7455b-8b12-4d55-a8b1-c825ca631301] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:39.866191 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d2d80fc5-362f-446a-8390-356bd92e9779 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:39.870741 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d2d80fc5-362f-446a-8390-356bd92e9779 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:39.871308 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d2d80fc5-362f-446a-8390-356bd92e9779 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:39.872466 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d2d80fc5-362f-446a-8390-356bd92e9779 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:39.872971 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d2d80fc5-362f-446a-8390-356bd92e9779 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:39.873398 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d2d80fc5-362f-446a-8390-356bd92e9779 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:40.128287 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d2d80fc5-362f-446a-8390-356bd92e9779 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24171f046534c22b854e3db9d80ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1a38df7fef8486ca8bc1040f507b9d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:40.154738 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d2d80fc5-362f-446a-8390-356bd92e9779 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] 10.222.0.60 "GET /compute/v2.1/servers/1fc7455b-8b12-4d55-a8b1-c825ca631301" status: 200 len: 1279 microversion: 2.1 time: 0.295618 Oct 18 16:02:40.157507 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3036/6055] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:39 2022] GET /compute/v2.1/servers/1fc7455b-8b12-4d55-a8b1-c825ca631301 => generated 1279 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:40.738041 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-de4c7fe2-a0f0-4483-a94c-78152000c04d tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:40.738648 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-de4c7fe2-a0f0-4483-a94c-78152000c04d tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] [instance: d99d89a1-38f6-4219-8d0c-38b13cd97364] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:40.756482 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de4c7fe2-a0f0-4483-a94c-78152000c04d tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:40.759034 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de4c7fe2-a0f0-4483-a94c-78152000c04d tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:40.759441 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de4c7fe2-a0f0-4483-a94c-78152000c04d tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:40.762869 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de4c7fe2-a0f0-4483-a94c-78152000c04d tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:40.763352 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de4c7fe2-a0f0-4483-a94c-78152000c04d tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:40.765422 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de4c7fe2-a0f0-4483-a94c-78152000c04d tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:40.902870 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-de4c7fe2-a0f0-4483-a94c-78152000c04d tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8374288d39a3493b84e2b1e354f5f6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad6ee85afa94b36b68836e6e389c9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:40.924180 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-de4c7fe2-a0f0-4483-a94c-78152000c04d tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] 10.222.0.60 "GET /compute/v2.1/servers/d99d89a1-38f6-4219-8d0c-38b13cd97364" status: 200 len: 1266 microversion: 2.1 time: 0.188522 Oct 18 16:02:40.926653 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3020/6056] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:40 2022] GET /compute/v2.1/servers/d99d89a1-38f6-4219-8d0c-38b13cd97364 => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:41.182785 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ea394a68-a730-48fb-b40f-a6c668d302f1 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:41.184083 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ea394a68-a730-48fb-b40f-a6c668d302f1 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] [instance: 1fc7455b-8b12-4d55-a8b1-c825ca631301] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:41.199086 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea394a68-a730-48fb-b40f-a6c668d302f1 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:41.201302 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea394a68-a730-48fb-b40f-a6c668d302f1 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:41.201942 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea394a68-a730-48fb-b40f-a6c668d302f1 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:41.203606 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea394a68-a730-48fb-b40f-a6c668d302f1 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:41.205216 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea394a68-a730-48fb-b40f-a6c668d302f1 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:41.206950 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea394a68-a730-48fb-b40f-a6c668d302f1 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:41.634630 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ea394a68-a730-48fb-b40f-a6c668d302f1 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24171f046534c22b854e3db9d80ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1a38df7fef8486ca8bc1040f507b9d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:41.650561 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ea394a68-a730-48fb-b40f-a6c668d302f1 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] 10.222.0.60 "GET /compute/v2.1/servers/1fc7455b-8b12-4d55-a8b1-c825ca631301" status: 200 len: 1319 microversion: 2.1 time: 0.471763 Oct 18 16:02:41.653502 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3037/6057] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:41 2022] GET /compute/v2.1/servers/1fc7455b-8b12-4d55-a8b1-c825ca631301 => generated 1319 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:41.950667 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8b7f9e1a-0e68-4055-95da-6f97f67d3408 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:41.951887 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8b7f9e1a-0e68-4055-95da-6f97f67d3408 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] [instance: d99d89a1-38f6-4219-8d0c-38b13cd97364] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:41.968068 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b7f9e1a-0e68-4055-95da-6f97f67d3408 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:41.970598 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b7f9e1a-0e68-4055-95da-6f97f67d3408 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:41.971361 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b7f9e1a-0e68-4055-95da-6f97f67d3408 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:41.973193 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b7f9e1a-0e68-4055-95da-6f97f67d3408 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:41.973848 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b7f9e1a-0e68-4055-95da-6f97f67d3408 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:41.975186 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b7f9e1a-0e68-4055-95da-6f97f67d3408 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:42.138834 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8b7f9e1a-0e68-4055-95da-6f97f67d3408 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8374288d39a3493b84e2b1e354f5f6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad6ee85afa94b36b68836e6e389c9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:42.151160 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8b7f9e1a-0e68-4055-95da-6f97f67d3408 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] 10.222.0.60 "GET /compute/v2.1/servers/d99d89a1-38f6-4219-8d0c-38b13cd97364" status: 200 len: 1272 microversion: 2.1 time: 0.203765 Oct 18 16:02:42.153297 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3021/6058] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:41 2022] GET /compute/v2.1/servers/d99d89a1-38f6-4219-8d0c-38b13cd97364 => generated 1272 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:42.675987 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-385fce28-c594-4e67-8934-a24eec0640d6 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:42.677455 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-385fce28-c594-4e67-8934-a24eec0640d6 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] [instance: 1fc7455b-8b12-4d55-a8b1-c825ca631301] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:42.708117 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-385fce28-c594-4e67-8934-a24eec0640d6 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:42.709275 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-385fce28-c594-4e67-8934-a24eec0640d6 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:42.709731 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-385fce28-c594-4e67-8934-a24eec0640d6 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:42.710468 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-385fce28-c594-4e67-8934-a24eec0640d6 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:42.710930 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-385fce28-c594-4e67-8934-a24eec0640d6 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:42.711374 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-385fce28-c594-4e67-8934-a24eec0640d6 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:43.187857 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b9a03120-d730-40c6-8ee3-f9736a5789c1 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:43.189507 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b9a03120-d730-40c6-8ee3-f9736a5789c1 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] [instance: d99d89a1-38f6-4219-8d0c-38b13cd97364] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:43.213672 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b9a03120-d730-40c6-8ee3-f9736a5789c1 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:43.217506 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b9a03120-d730-40c6-8ee3-f9736a5789c1 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:43.218122 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b9a03120-d730-40c6-8ee3-f9736a5789c1 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:43.219007 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b9a03120-d730-40c6-8ee3-f9736a5789c1 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:43.226598 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b9a03120-d730-40c6-8ee3-f9736a5789c1 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:43.227280 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b9a03120-d730-40c6-8ee3-f9736a5789c1 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:43.428511 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-385fce28-c594-4e67-8934-a24eec0640d6 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24171f046534c22b854e3db9d80ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1a38df7fef8486ca8bc1040f507b9d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:43.445364 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-385fce28-c594-4e67-8934-a24eec0640d6 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] 10.222.0.60 "GET /compute/v2.1/servers/1fc7455b-8b12-4d55-a8b1-c825ca631301" status: 200 len: 1319 microversion: 2.1 time: 0.772741 Oct 18 16:02:43.446639 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3038/6059] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:42 2022] GET /compute/v2.1/servers/1fc7455b-8b12-4d55-a8b1-c825ca631301 => generated 1319 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:43.819411 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b9a03120-d730-40c6-8ee3-f9736a5789c1 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8374288d39a3493b84e2b1e354f5f6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad6ee85afa94b36b68836e6e389c9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:43.826982 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=81 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:43.836383 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-485fac84-e06b-457f-bab2-fde590ed51a3 req-c5627646-6cdb-4195-84a5-4af998138dcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fc7455b-8b12-4d55-a8b1-c825ca631301", "tag": "f00d6292-ca80-4392-ae3b-027027cfd013"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:02:43.848388 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b9a03120-d730-40c6-8ee3-f9736a5789c1 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] 10.222.0.60 "GET /compute/v2.1/servers/d99d89a1-38f6-4219-8d0c-38b13cd97364" status: 200 len: 1314 microversion: 2.1 time: 0.673446 Oct 18 16:02:43.850288 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3022/6060] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:43 2022] GET /compute/v2.1/servers/d99d89a1-38f6-4219-8d0c-38b13cd97364 => generated 1314 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:02:43.870473 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-485fac84-e06b-457f-bab2-fde590ed51a3 req-c5627646-6cdb-4195-84a5-4af998138dcc service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:43.871817 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-485fac84-e06b-457f-bab2-fde590ed51a3 req-c5627646-6cdb-4195-84a5-4af998138dcc service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:43.872738 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-485fac84-e06b-457f-bab2-fde590ed51a3 req-c5627646-6cdb-4195-84a5-4af998138dcc service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:43.897458 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-485fac84-e06b-457f-bab2-fde590ed51a3 req-c5627646-6cdb-4195-84a5-4af998138dcc service nova] Creating event network-changed:f00d6292-ca80-4392-ae3b-027027cfd013 for instance 1fc7455b-8b12-4d55-a8b1-c825ca631301 on n-h2-853682-5 Oct 18 16:02:43.921263 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-485fac84-e06b-457f-bab2-fde590ed51a3 req-c5627646-6cdb-4195-84a5-4af998138dcc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088629 Oct 18 16:02:43.923056 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3039/6061] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:02:44.195533 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-e3869f78-fd34-49a1-b192-975917aaf2a2 req-3135e203-56d7-4e4e-b085-ba1a7f5f6001 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d99d89a1-38f6-4219-8d0c-38b13cd97364", "tag": "389fae07-a0f4-411f-a130-5ef237e40ffc"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:02:44.213379 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:44.216702 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e3869f78-fd34-49a1-b192-975917aaf2a2 req-3135e203-56d7-4e4e-b085-ba1a7f5f6001 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:44.218808 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e3869f78-fd34-49a1-b192-975917aaf2a2 req-3135e203-56d7-4e4e-b085-ba1a7f5f6001 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:44.218808 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e3869f78-fd34-49a1-b192-975917aaf2a2 req-3135e203-56d7-4e4e-b085-ba1a7f5f6001 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:44.233450 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-e3869f78-fd34-49a1-b192-975917aaf2a2 req-3135e203-56d7-4e4e-b085-ba1a7f5f6001 service nova] Creating event network-changed:389fae07-a0f4-411f-a130-5ef237e40ffc for instance d99d89a1-38f6-4219-8d0c-38b13cd97364 on n-h2-853682-5 Oct 18 16:02:44.240936 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-e3869f78-fd34-49a1-b192-975917aaf2a2 req-3135e203-56d7-4e4e-b085-ba1a7f5f6001 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057677 Oct 18 16:02:44.241863 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3023/6062] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:02:44.475567 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d545b59c-a66c-4e27-8e59-58ce36693386 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:44.476458 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d545b59c-a66c-4e27-8e59-58ce36693386 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] [instance: 1fc7455b-8b12-4d55-a8b1-c825ca631301] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:44.485814 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d545b59c-a66c-4e27-8e59-58ce36693386 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:44.491666 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d545b59c-a66c-4e27-8e59-58ce36693386 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:44.492392 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d545b59c-a66c-4e27-8e59-58ce36693386 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:44.493347 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d545b59c-a66c-4e27-8e59-58ce36693386 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:44.493967 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d545b59c-a66c-4e27-8e59-58ce36693386 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:44.501834 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d545b59c-a66c-4e27-8e59-58ce36693386 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:44.873338 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-815bac83-d738-4880-9457-a5486582d40d tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:44.874331 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-815bac83-d738-4880-9457-a5486582d40d tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] [instance: d99d89a1-38f6-4219-8d0c-38b13cd97364] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:44.885286 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-815bac83-d738-4880-9457-a5486582d40d tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:44.889346 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-815bac83-d738-4880-9457-a5486582d40d tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:44.890254 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-815bac83-d738-4880-9457-a5486582d40d tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:44.894523 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-815bac83-d738-4880-9457-a5486582d40d tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:44.895217 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-815bac83-d738-4880-9457-a5486582d40d tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:44.895822 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-815bac83-d738-4880-9457-a5486582d40d tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:45.504373 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-815bac83-d738-4880-9457-a5486582d40d tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8374288d39a3493b84e2b1e354f5f6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad6ee85afa94b36b68836e6e389c9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:45.515304 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-815bac83-d738-4880-9457-a5486582d40d tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] 10.222.0.60 "GET /compute/v2.1/servers/d99d89a1-38f6-4219-8d0c-38b13cd97364" status: 200 len: 1314 microversion: 2.1 time: 0.646942 Oct 18 16:02:45.515892 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3024/6063] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:44 2022] GET /compute/v2.1/servers/d99d89a1-38f6-4219-8d0c-38b13cd97364 => generated 1314 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:02:45.519169 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d545b59c-a66c-4e27-8e59-58ce36693386 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24171f046534c22b854e3db9d80ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1a38df7fef8486ca8bc1040f507b9d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:45.534226 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d545b59c-a66c-4e27-8e59-58ce36693386 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] 10.222.0.60 "GET /compute/v2.1/servers/1fc7455b-8b12-4d55-a8b1-c825ca631301" status: 200 len: 1319 microversion: 2.1 time: 1.064710 Oct 18 16:02:45.535347 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3040/6064] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:44 2022] GET /compute/v2.1/servers/1fc7455b-8b12-4d55-a8b1-c825ca631301 => generated 1319 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:46.539878 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-961272e5-0c0c-43e6-bb28-16978cc50f89 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:46.541143 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-961272e5-0c0c-43e6-bb28-16978cc50f89 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] [instance: d99d89a1-38f6-4219-8d0c-38b13cd97364] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:46.553806 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-961272e5-0c0c-43e6-bb28-16978cc50f89 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:46.554898 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-961272e5-0c0c-43e6-bb28-16978cc50f89 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:46.555838 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-961272e5-0c0c-43e6-bb28-16978cc50f89 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:46.556712 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-961272e5-0c0c-43e6-bb28-16978cc50f89 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:46.557659 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-961272e5-0c0c-43e6-bb28-16978cc50f89 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:46.558274 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-961272e5-0c0c-43e6-bb28-16978cc50f89 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:46.564728 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-17d17dd3-c18b-43f0-ac9d-a468c15f0fee tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:46.565927 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-17d17dd3-c18b-43f0-ac9d-a468c15f0fee tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] [instance: 1fc7455b-8b12-4d55-a8b1-c825ca631301] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:46.575698 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-17d17dd3-c18b-43f0-ac9d-a468c15f0fee tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:46.578374 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-17d17dd3-c18b-43f0-ac9d-a468c15f0fee tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:46.583936 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-17d17dd3-c18b-43f0-ac9d-a468c15f0fee tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:46.584942 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-17d17dd3-c18b-43f0-ac9d-a468c15f0fee tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:46.585987 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-17d17dd3-c18b-43f0-ac9d-a468c15f0fee tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:46.586616 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-17d17dd3-c18b-43f0-ac9d-a468c15f0fee tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:46.859502 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-17d17dd3-c18b-43f0-ac9d-a468c15f0fee tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24171f046534c22b854e3db9d80ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1a38df7fef8486ca8bc1040f507b9d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:46.876747 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-17d17dd3-c18b-43f0-ac9d-a468c15f0fee tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] 10.222.0.60 "GET /compute/v2.1/servers/1fc7455b-8b12-4d55-a8b1-c825ca631301" status: 200 len: 1319 microversion: 2.1 time: 0.314316 Oct 18 16:02:46.877449 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3041/6065] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:46 2022] GET /compute/v2.1/servers/1fc7455b-8b12-4d55-a8b1-c825ca631301 => generated 1319 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:46.917438 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-961272e5-0c0c-43e6-bb28-16978cc50f89 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8374288d39a3493b84e2b1e354f5f6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad6ee85afa94b36b68836e6e389c9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:46.930545 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-961272e5-0c0c-43e6-bb28-16978cc50f89 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] 10.222.0.60 "GET /compute/v2.1/servers/d99d89a1-38f6-4219-8d0c-38b13cd97364" status: 200 len: 1314 microversion: 2.1 time: 0.393393 Oct 18 16:02:46.931546 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3025/6066] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:46 2022] GET /compute/v2.1/servers/d99d89a1-38f6-4219-8d0c-38b13cd97364 => generated 1314 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:47.912287 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5434a153-7e25-4b81-a2e2-a69f8c833fca tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:47.915797 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5434a153-7e25-4b81-a2e2-a69f8c833fca tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] [instance: 1fc7455b-8b12-4d55-a8b1-c825ca631301] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:47.918200 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:47.920983 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=10 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:47.969130 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4ee76dbc-4fa5-4e84-841a-ef55c81b8c0a tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:47.974119 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4ee76dbc-4fa5-4e84-841a-ef55c81b8c0a tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] [instance: d99d89a1-38f6-4219-8d0c-38b13cd97364] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:47.976033 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5434a153-7e25-4b81-a2e2-a69f8c833fca tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:47.977976 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:47.990390 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5434a153-7e25-4b81-a2e2-a69f8c833fca tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:47.990532 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5434a153-7e25-4b81-a2e2-a69f8c833fca tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:47.991387 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5434a153-7e25-4b81-a2e2-a69f8c833fca tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:47.992224 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5434a153-7e25-4b81-a2e2-a69f8c833fca tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:47.992661 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5434a153-7e25-4b81-a2e2-a69f8c833fca tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:48.001434 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ee76dbc-4fa5-4e84-841a-ef55c81b8c0a tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:48.001928 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ee76dbc-4fa5-4e84-841a-ef55c81b8c0a tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:48.010322 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ee76dbc-4fa5-4e84-841a-ef55c81b8c0a tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:48.017367 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ee76dbc-4fa5-4e84-841a-ef55c81b8c0a tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:48.018108 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ee76dbc-4fa5-4e84-841a-ef55c81b8c0a tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:48.019921 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ee76dbc-4fa5-4e84-841a-ef55c81b8c0a tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:48.417871 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4ee76dbc-4fa5-4e84-841a-ef55c81b8c0a tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8374288d39a3493b84e2b1e354f5f6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad6ee85afa94b36b68836e6e389c9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:48.434150 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4ee76dbc-4fa5-4e84-841a-ef55c81b8c0a tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] 10.222.0.60 "GET /compute/v2.1/servers/d99d89a1-38f6-4219-8d0c-38b13cd97364" status: 200 len: 1314 microversion: 2.1 time: 0.479163 Oct 18 16:02:48.435981 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3026/6067] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:47 2022] GET /compute/v2.1/servers/d99d89a1-38f6-4219-8d0c-38b13cd97364 => generated 1314 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:48.497049 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5434a153-7e25-4b81-a2e2-a69f8c833fca tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24171f046534c22b854e3db9d80ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1a38df7fef8486ca8bc1040f507b9d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:48.506194 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5434a153-7e25-4b81-a2e2-a69f8c833fca tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] 10.222.0.60 "GET /compute/v2.1/servers/1fc7455b-8b12-4d55-a8b1-c825ca631301" status: 200 len: 1319 microversion: 2.1 time: 0.603185 Oct 18 16:02:48.510110 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3042/6068] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:47 2022] GET /compute/v2.1/servers/1fc7455b-8b12-4d55-a8b1-c825ca631301 => generated 1319 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:49.463622 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b3558cdb-c397-4abb-8468-c03832d838cd tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:49.464678 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b3558cdb-c397-4abb-8468-c03832d838cd tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] [instance: d99d89a1-38f6-4219-8d0c-38b13cd97364] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:49.476164 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=8 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:49.503446 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b3558cdb-c397-4abb-8468-c03832d838cd tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:49.504267 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b3558cdb-c397-4abb-8468-c03832d838cd tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:49.505025 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b3558cdb-c397-4abb-8468-c03832d838cd tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:49.506778 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b3558cdb-c397-4abb-8468-c03832d838cd tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:49.507579 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b3558cdb-c397-4abb-8468-c03832d838cd tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:49.508316 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b3558cdb-c397-4abb-8468-c03832d838cd tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:49.542276 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fcb1eee6-a7af-4218-8bad-3726a4b92702 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:49.553358 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-fcb1eee6-a7af-4218-8bad-3726a4b92702 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] [instance: 1fc7455b-8b12-4d55-a8b1-c825ca631301] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:49.574799 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fcb1eee6-a7af-4218-8bad-3726a4b92702 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:49.593972 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fcb1eee6-a7af-4218-8bad-3726a4b92702 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:49.595547 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fcb1eee6-a7af-4218-8bad-3726a4b92702 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:49.596793 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fcb1eee6-a7af-4218-8bad-3726a4b92702 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:49.597586 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fcb1eee6-a7af-4218-8bad-3726a4b92702 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:49.598302 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fcb1eee6-a7af-4218-8bad-3726a4b92702 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:50.284322 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b3558cdb-c397-4abb-8468-c03832d838cd tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8374288d39a3493b84e2b1e354f5f6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad6ee85afa94b36b68836e6e389c9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:50.287160 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-fcb1eee6-a7af-4218-8bad-3726a4b92702 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24171f046534c22b854e3db9d80ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1a38df7fef8486ca8bc1040f507b9d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:50.313617 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fcb1eee6-a7af-4218-8bad-3726a4b92702 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] 10.222.0.60 "GET /compute/v2.1/servers/1fc7455b-8b12-4d55-a8b1-c825ca631301" status: 200 len: 1319 microversion: 2.1 time: 0.780590 Oct 18 16:02:50.315696 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b3558cdb-c397-4abb-8468-c03832d838cd tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] 10.222.0.60 "GET /compute/v2.1/servers/d99d89a1-38f6-4219-8d0c-38b13cd97364" status: 200 len: 1314 microversion: 2.1 time: 0.859233 Oct 18 16:02:50.325346 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3043/6069] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:49 2022] GET /compute/v2.1/servers/1fc7455b-8b12-4d55-a8b1-c825ca631301 => generated 1319 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:02:50.327106 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3027/6070] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:49 2022] GET /compute/v2.1/servers/d99d89a1-38f6-4219-8d0c-38b13cd97364 => generated 1314 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:50.341372 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-2261ab57-59dd-4fbe-ba18-2ce9dd37bc02 req-e1e17da4-1eb9-4deb-8bcf-89b00c77c373 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d99d89a1-38f6-4219-8d0c-38b13cd97364", "name": "network-vif-plugged", "status": "completed", "tag": "389fae07-a0f4-411f-a130-5ef237e40ffc"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:02:50.358866 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-2261ab57-59dd-4fbe-ba18-2ce9dd37bc02 req-e1e17da4-1eb9-4deb-8bcf-89b00c77c373 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:50.359983 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-2261ab57-59dd-4fbe-ba18-2ce9dd37bc02 req-e1e17da4-1eb9-4deb-8bcf-89b00c77c373 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:50.361127 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-2261ab57-59dd-4fbe-ba18-2ce9dd37bc02 req-e1e17da4-1eb9-4deb-8bcf-89b00c77c373 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:50.380743 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-2261ab57-59dd-4fbe-ba18-2ce9dd37bc02 req-e1e17da4-1eb9-4deb-8bcf-89b00c77c373 service nova] Creating event network-vif-plugged:389fae07-a0f4-411f-a130-5ef237e40ffc for instance d99d89a1-38f6-4219-8d0c-38b13cd97364 on n-h2-853682-5 Oct 18 16:02:50.386630 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-2261ab57-59dd-4fbe-ba18-2ce9dd37bc02 req-e1e17da4-1eb9-4deb-8bcf-89b00c77c373 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059491 Oct 18 16:02:50.392954 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3044/6071] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:02:51.343775 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b42c11c8-2cf9-4161-94d9-fd2f07eafbfe tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:51.344958 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b42c11c8-2cf9-4161-94d9-fd2f07eafbfe tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] [instance: 1fc7455b-8b12-4d55-a8b1-c825ca631301] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:51.351053 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ce8a90e4-9f8e-4513-957a-94fb789347be tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:51.352302 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ce8a90e4-9f8e-4513-957a-94fb789347be tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] [instance: d99d89a1-38f6-4219-8d0c-38b13cd97364] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:51.352494 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b42c11c8-2cf9-4161-94d9-fd2f07eafbfe tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:51.352946 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b42c11c8-2cf9-4161-94d9-fd2f07eafbfe tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:51.353568 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b42c11c8-2cf9-4161-94d9-fd2f07eafbfe tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:51.354423 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b42c11c8-2cf9-4161-94d9-fd2f07eafbfe tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:51.355031 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b42c11c8-2cf9-4161-94d9-fd2f07eafbfe tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:51.355608 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b42c11c8-2cf9-4161-94d9-fd2f07eafbfe tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:51.360023 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ce8a90e4-9f8e-4513-957a-94fb789347be tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:51.360781 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ce8a90e4-9f8e-4513-957a-94fb789347be tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:51.361459 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ce8a90e4-9f8e-4513-957a-94fb789347be tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:51.362385 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ce8a90e4-9f8e-4513-957a-94fb789347be tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:51.363059 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ce8a90e4-9f8e-4513-957a-94fb789347be tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:51.363704 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ce8a90e4-9f8e-4513-957a-94fb789347be tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:51.611875 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ce8a90e4-9f8e-4513-957a-94fb789347be tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8374288d39a3493b84e2b1e354f5f6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad6ee85afa94b36b68836e6e389c9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:51.620425 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ce8a90e4-9f8e-4513-957a-94fb789347be tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] 10.222.0.60 "GET /compute/v2.1/servers/d99d89a1-38f6-4219-8d0c-38b13cd97364" status: 200 len: 1314 microversion: 2.1 time: 0.275054 Oct 18 16:02:51.624731 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3045/6072] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:51 2022] GET /compute/v2.1/servers/d99d89a1-38f6-4219-8d0c-38b13cd97364 => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:02:51.667797 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b42c11c8-2cf9-4161-94d9-fd2f07eafbfe tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24171f046534c22b854e3db9d80ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1a38df7fef8486ca8bc1040f507b9d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:51.680629 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b42c11c8-2cf9-4161-94d9-fd2f07eafbfe tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] 10.222.0.60 "GET /compute/v2.1/servers/1fc7455b-8b12-4d55-a8b1-c825ca631301" status: 200 len: 1319 microversion: 2.1 time: 0.338822 Oct 18 16:02:51.680629 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3028/6073] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:51 2022] GET /compute/v2.1/servers/1fc7455b-8b12-4d55-a8b1-c825ca631301 => generated 1319 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:52.407536 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-130db285-3c46-47af-b5ec-04dd97e3172a req-c08068d1-4ae8-42e9-9e45-408fece2053b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fc7455b-8b12-4d55-a8b1-c825ca631301", "name": "network-vif-plugged", "status": "completed", "tag": "f00d6292-ca80-4392-ae3b-027027cfd013"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:02:52.430097 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-130db285-3c46-47af-b5ec-04dd97e3172a req-c08068d1-4ae8-42e9-9e45-408fece2053b service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:52.430743 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-130db285-3c46-47af-b5ec-04dd97e3172a req-c08068d1-4ae8-42e9-9e45-408fece2053b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:52.431193 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-130db285-3c46-47af-b5ec-04dd97e3172a req-c08068d1-4ae8-42e9-9e45-408fece2053b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:52.454477 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-130db285-3c46-47af-b5ec-04dd97e3172a req-c08068d1-4ae8-42e9-9e45-408fece2053b service nova] Creating event network-vif-plugged:f00d6292-ca80-4392-ae3b-027027cfd013 for instance 1fc7455b-8b12-4d55-a8b1-c825ca631301 on n-h2-853682-5 Oct 18 16:02:52.467837 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-130db285-3c46-47af-b5ec-04dd97e3172a req-c08068d1-4ae8-42e9-9e45-408fece2053b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065458 Oct 18 16:02:52.469740 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3046/6074] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:02:52.651912 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6508b992-8024-40a7-afd1-f7122b731b5d tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:52.654155 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6508b992-8024-40a7-afd1-f7122b731b5d tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] [instance: d99d89a1-38f6-4219-8d0c-38b13cd97364] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:52.676771 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6508b992-8024-40a7-afd1-f7122b731b5d tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:52.677896 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6508b992-8024-40a7-afd1-f7122b731b5d tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:52.680680 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6508b992-8024-40a7-afd1-f7122b731b5d tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:52.687531 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6508b992-8024-40a7-afd1-f7122b731b5d tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:52.688193 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6508b992-8024-40a7-afd1-f7122b731b5d tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:52.688796 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6508b992-8024-40a7-afd1-f7122b731b5d tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:52.707159 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-173ff818-bef0-437d-a651-9274d55312bd tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:52.707875 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-173ff818-bef0-437d-a651-9274d55312bd tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] [instance: 1fc7455b-8b12-4d55-a8b1-c825ca631301] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:52.721827 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-173ff818-bef0-437d-a651-9274d55312bd tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:52.722321 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-173ff818-bef0-437d-a651-9274d55312bd tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:52.722756 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-173ff818-bef0-437d-a651-9274d55312bd tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:52.723465 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-173ff818-bef0-437d-a651-9274d55312bd tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:52.723983 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-173ff818-bef0-437d-a651-9274d55312bd tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:52.724952 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-173ff818-bef0-437d-a651-9274d55312bd tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:52.959511 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6508b992-8024-40a7-afd1-f7122b731b5d tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8374288d39a3493b84e2b1e354f5f6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad6ee85afa94b36b68836e6e389c9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:52.961342 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-173ff818-bef0-437d-a651-9274d55312bd tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24171f046534c22b854e3db9d80ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1a38df7fef8486ca8bc1040f507b9d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:52.969921 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6508b992-8024-40a7-afd1-f7122b731b5d tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] 10.222.0.60 "GET /compute/v2.1/servers/d99d89a1-38f6-4219-8d0c-38b13cd97364" status: 200 len: 1497 microversion: 2.1 time: 0.322594 Oct 18 16:02:52.982223 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3029/6075] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:52 2022] GET /compute/v2.1/servers/d99d89a1-38f6-4219-8d0c-38b13cd97364 => generated 1497 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:52.983682 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-173ff818-bef0-437d-a651-9274d55312bd tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] 10.222.0.60 "GET /compute/v2.1/servers/1fc7455b-8b12-4d55-a8b1-c825ca631301" status: 200 len: 1319 microversion: 2.1 time: 0.281831 Oct 18 16:02:52.993239 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3047/6076] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:52 2022] GET /compute/v2.1/servers/1fc7455b-8b12-4d55-a8b1-c825ca631301 => generated 1319 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:53.598390 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c3c8b065-12d3-472b-8d71-42ca6c87e540 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:53.599125 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c3c8b065-12d3-472b-8d71-42ca6c87e540 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] [instance: d99d89a1-38f6-4219-8d0c-38b13cd97364] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:53.609536 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3c8b065-12d3-472b-8d71-42ca6c87e540 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:53.612868 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3c8b065-12d3-472b-8d71-42ca6c87e540 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:53.613366 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3c8b065-12d3-472b-8d71-42ca6c87e540 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:53.614219 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3c8b065-12d3-472b-8d71-42ca6c87e540 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:53.615580 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3c8b065-12d3-472b-8d71-42ca6c87e540 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:53.616082 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3c8b065-12d3-472b-8d71-42ca6c87e540 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:53.657047 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c3c8b065-12d3-472b-8d71-42ca6c87e540 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] [instance: d99d89a1-38f6-4219-8d0c-38b13cd97364] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:02:53.810155 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c3c8b065-12d3-472b-8d71-42ca6c87e540 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d99d89a1-38f6-4219-8d0c-38b13cd97364" status: 204 len: 0 microversion: 2.1 time: 0.215873 Oct 18 16:02:53.811377 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3030/6077] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 16:02:53 2022] DELETE /compute/v2.1/servers/d99d89a1-38f6-4219-8d0c-38b13cd97364 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:02:53.819889 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e65fa863-83f4-43e0-bbfb-ef55494dd1f5 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:53.820781 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e65fa863-83f4-43e0-bbfb-ef55494dd1f5 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] [instance: d99d89a1-38f6-4219-8d0c-38b13cd97364] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:53.832730 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e65fa863-83f4-43e0-bbfb-ef55494dd1f5 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:53.833752 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e65fa863-83f4-43e0-bbfb-ef55494dd1f5 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:53.837044 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e65fa863-83f4-43e0-bbfb-ef55494dd1f5 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:53.838164 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e65fa863-83f4-43e0-bbfb-ef55494dd1f5 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:53.838855 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e65fa863-83f4-43e0-bbfb-ef55494dd1f5 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:53.841362 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e65fa863-83f4-43e0-bbfb-ef55494dd1f5 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:54.012150 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f98d289e-c0fc-4a27-b4cf-365b131c39d6 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:54.014008 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f98d289e-c0fc-4a27-b4cf-365b131c39d6 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] [instance: 1fc7455b-8b12-4d55-a8b1-c825ca631301] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:54.020315 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f98d289e-c0fc-4a27-b4cf-365b131c39d6 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:54.021129 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f98d289e-c0fc-4a27-b4cf-365b131c39d6 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:54.021715 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f98d289e-c0fc-4a27-b4cf-365b131c39d6 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:54.022502 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f98d289e-c0fc-4a27-b4cf-365b131c39d6 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:54.023065 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f98d289e-c0fc-4a27-b4cf-365b131c39d6 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:54.023697 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f98d289e-c0fc-4a27-b4cf-365b131c39d6 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:54.090639 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e65fa863-83f4-43e0-bbfb-ef55494dd1f5 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8374288d39a3493b84e2b1e354f5f6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad6ee85afa94b36b68836e6e389c9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:54.098695 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e65fa863-83f4-43e0-bbfb-ef55494dd1f5 tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] 10.222.0.60 "GET /compute/v2.1/servers/d99d89a1-38f6-4219-8d0c-38b13cd97364" status: 200 len: 1503 microversion: 2.1 time: 0.282785 Oct 18 16:02:54.099866 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3048/6078] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:53 2022] GET /compute/v2.1/servers/d99d89a1-38f6-4219-8d0c-38b13cd97364 => generated 1503 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:54.186588 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f98d289e-c0fc-4a27-b4cf-365b131c39d6 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24171f046534c22b854e3db9d80ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1a38df7fef8486ca8bc1040f507b9d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:54.194710 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f98d289e-c0fc-4a27-b4cf-365b131c39d6 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] 10.222.0.60 "GET /compute/v2.1/servers/1fc7455b-8b12-4d55-a8b1-c825ca631301" status: 200 len: 1508 microversion: 2.1 time: 0.187583 Oct 18 16:02:54.195351 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3031/6079] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:54 2022] GET /compute/v2.1/servers/1fc7455b-8b12-4d55-a8b1-c825ca631301 => generated 1508 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:54.218689 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ce8b1cc9-adba-4c80-8b62-e3999f5e6382 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d479c5df-8315-4c82-a5d5-866c7ac7ab8a", "device": "/dev/sdb"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:02:54.221292 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ce8b1cc9-adba-4c80-8b62-e3999f5e6382 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] [instance: 1fc7455b-8b12-4d55-a8b1-c825ca631301] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:54.228694 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ce8b1cc9-adba-4c80-8b62-e3999f5e6382 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:54.229346 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ce8b1cc9-adba-4c80-8b62-e3999f5e6382 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:54.229893 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ce8b1cc9-adba-4c80-8b62-e3999f5e6382 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:54.230824 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ce8b1cc9-adba-4c80-8b62-e3999f5e6382 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:54.231481 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ce8b1cc9-adba-4c80-8b62-e3999f5e6382 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:54.232190 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ce8b1cc9-adba-4c80-8b62-e3999f5e6382 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:55.123397 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c0cf1c4d-d2c2-4a91-8bdc-6aa9fb76335d tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:55.123998 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c0cf1c4d-d2c2-4a91-8bdc-6aa9fb76335d tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] [instance: d99d89a1-38f6-4219-8d0c-38b13cd97364] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:55.141053 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0cf1c4d-d2c2-4a91-8bdc-6aa9fb76335d tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:55.141649 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0cf1c4d-d2c2-4a91-8bdc-6aa9fb76335d tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:55.142291 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0cf1c4d-d2c2-4a91-8bdc-6aa9fb76335d tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:55.142998 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0cf1c4d-d2c2-4a91-8bdc-6aa9fb76335d tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:55.147434 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0cf1c4d-d2c2-4a91-8bdc-6aa9fb76335d tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:55.148091 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0cf1c4d-d2c2-4a91-8bdc-6aa9fb76335d tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:55.264470 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ce8b1cc9-adba-4c80-8b62-e3999f5e6382 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] 10.222.0.60 "POST /compute/v2.1/servers/1fc7455b-8b12-4d55-a8b1-c825ca631301/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.049062 Oct 18 16:02:55.272831 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3049/6080] 10.222.0.60 () {60 vars in 1323 bytes} [Tue Oct 18 16:02:54 2022] POST /compute/v2.1/servers/1fc7455b-8b12-4d55-a8b1-c825ca631301/os-volume_attachments => generated 194 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:02:55.435956 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c0cf1c4d-d2c2-4a91-8bdc-6aa9fb76335d tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8374288d39a3493b84e2b1e354f5f6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad6ee85afa94b36b68836e6e389c9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:55.450631 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c0cf1c4d-d2c2-4a91-8bdc-6aa9fb76335d tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] 10.222.0.60 "GET /compute/v2.1/servers/d99d89a1-38f6-4219-8d0c-38b13cd97364" status: 200 len: 1503 microversion: 2.1 time: 0.331120 Oct 18 16:02:55.457836 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3032/6081] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:55 2022] GET /compute/v2.1/servers/d99d89a1-38f6-4219-8d0c-38b13cd97364 => generated 1503 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:02:56.015201 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-33620461-69fb-4094-b397-85703f14ec13 req-d2347b5b-f407-4eb5-833d-efc319dc5c73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d99d89a1-38f6-4219-8d0c-38b13cd97364", "name": "network-vif-deleted", "tag": "389fae07-a0f4-411f-a130-5ef237e40ffc"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:02:56.042870 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-33620461-69fb-4094-b397-85703f14ec13 req-d2347b5b-f407-4eb5-833d-efc319dc5c73 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:56.044391 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-33620461-69fb-4094-b397-85703f14ec13 req-d2347b5b-f407-4eb5-833d-efc319dc5c73 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:56.044696 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-33620461-69fb-4094-b397-85703f14ec13 req-d2347b5b-f407-4eb5-833d-efc319dc5c73 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:56.066540 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-33620461-69fb-4094-b397-85703f14ec13 req-d2347b5b-f407-4eb5-833d-efc319dc5c73 service nova] Creating event network-vif-deleted:389fae07-a0f4-411f-a130-5ef237e40ffc for instance d99d89a1-38f6-4219-8d0c-38b13cd97364 on n-h2-853682-5 Oct 18 16:02:56.073486 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-33620461-69fb-4094-b397-85703f14ec13 req-d2347b5b-f407-4eb5-833d-efc319dc5c73 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062635 Oct 18 16:02:56.078347 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3050/6082] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:02:56.477397 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a84740a6-4b4a-4d29-bbd7-e6bb27437b4b tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:56.478002 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a84740a6-4b4a-4d29-bbd7-e6bb27437b4b tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] [instance: d99d89a1-38f6-4219-8d0c-38b13cd97364] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:56.485406 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a84740a6-4b4a-4d29-bbd7-e6bb27437b4b tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:56.485881 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a84740a6-4b4a-4d29-bbd7-e6bb27437b4b tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:56.486323 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a84740a6-4b4a-4d29-bbd7-e6bb27437b4b tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:56.487056 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a84740a6-4b4a-4d29-bbd7-e6bb27437b4b tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:56.487528 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a84740a6-4b4a-4d29-bbd7-e6bb27437b4b tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:56.487954 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a84740a6-4b4a-4d29-bbd7-e6bb27437b4b tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:56.532342 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a84740a6-4b4a-4d29-bbd7-e6bb27437b4b tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:56.533176 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a84740a6-4b4a-4d29-bbd7-e6bb27437b4b tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:56.534194 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a84740a6-4b4a-4d29-bbd7-e6bb27437b4b tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:56.534830 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-a84740a6-4b4a-4d29-bbd7-e6bb27437b4b tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lazy-loading 'fault' on Instance uuid d99d89a1-38f6-4219-8d0c-38b13cd97364 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:02:56.592021 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a84740a6-4b4a-4d29-bbd7-e6bb27437b4b tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8374288d39a3493b84e2b1e354f5f6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad6ee85afa94b36b68836e6e389c9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:02:56.606400 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a84740a6-4b4a-4d29-bbd7-e6bb27437b4b tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] 10.222.0.60 "GET /compute/v2.1/servers/d99d89a1-38f6-4219-8d0c-38b13cd97364" status: 200 len: 1304 microversion: 2.1 time: 0.133240 Oct 18 16:02:56.608479 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3033/6083] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:56 2022] GET /compute/v2.1/servers/d99d89a1-38f6-4219-8d0c-38b13cd97364 => generated 1304 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:02:57.633818 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fc3cb286-8ff0-4e16-9b08-7179db8ae94f tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:02:57.634702 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-fc3cb286-8ff0-4e16-9b08-7179db8ae94f tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] [instance: d99d89a1-38f6-4219-8d0c-38b13cd97364] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:02:57.648227 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fc3cb286-8ff0-4e16-9b08-7179db8ae94f tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:57.648933 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fc3cb286-8ff0-4e16-9b08-7179db8ae94f tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:57.649578 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fc3cb286-8ff0-4e16-9b08-7179db8ae94f tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:57.651662 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fc3cb286-8ff0-4e16-9b08-7179db8ae94f tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:02:57.653079 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fc3cb286-8ff0-4e16-9b08-7179db8ae94f tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:02:57.653550 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fc3cb286-8ff0-4e16-9b08-7179db8ae94f tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:02:57.672193 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-fc3cb286-8ff0-4e16-9b08-7179db8ae94f tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] HTTP exception thrown: Instance d99d89a1-38f6-4219-8d0c-38b13cd97364 could not be found. Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fc3cb286-8ff0-4e16-9b08-7179db8ae94f tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Request method failure captured: Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/d99d89a1-38f6-4219-8d0c-38b13cd97364 HTTP/1.1 Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTs4AFzaBMWqNh0ALh5s_wLz-dBTeFqNO2Tpe68wGwIBuC_rQpyyoppEVkggRXz8JK5F-q9TwEaC5GGagX1_03TlXEjeKSJoZA2cP8u--EM9zVW3WyAOmtwB1qL8FdpqSVtxNiR66blkm87aytzmsMbm5NIjbhTwSuOX1jYvON4eGGAE Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 8ad6ee85afa94b36b68836e6e389c9b2 Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-VolumesActionsTest-1325326224 Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8ad6ee85afa94b36b68836e6e389c9b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8ad6ee85afa94b36b68836e6e389c9b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8ad6ee85afa94b36b68836e6e389c9b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8ad6ee85afa94b36b68836e6e389c9b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-VolumesActionsTest-1325326224 Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 8ad6ee85afa94b36b68836e6e389c9b2 Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-VolumesActionsTest-1325326224 Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-VolumesActionsTest-1325326224-project Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 8374288d39a3493b84e2b1e354f5f6bc Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-VolumesActionsTest-1325326224-project Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance d99d89a1-38f6-4219-8d0c-38b13cd97364 could not be found. Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'd99d89a1-38f6-4219-8d0c-38b13cd97364'} Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d99d89a1-38f6-4219-8d0c-38b13cd97364 could not be found. Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d99d89a1-38f6-4219-8d0c-38b13cd97364 could not be found. Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:02:57.673782 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:02:57.678483 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:02:57.678483 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:02:57.678483 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:02:57.678483 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:02:57.678483 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:02:57.678483 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d99d89a1-38f6-4219-8d0c-38b13cd97364 could not be found. Oct 18 16:02:57.678483 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:02:57.680362 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fc3cb286-8ff0-4e16-9b08-7179db8ae94f tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] Returning 404 to user: Instance d99d89a1-38f6-4219-8d0c-38b13cd97364 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:02:57.681269 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fc3cb286-8ff0-4e16-9b08-7179db8ae94f tempest-VolumesActionsTest-1325326224 tempest-VolumesActionsTest-1325326224-project] 10.222.0.60 "GET /compute/v2.1/servers/d99d89a1-38f6-4219-8d0c-38b13cd97364" status: 404 len: 111 microversion: 2.1 time: 0.052961 Oct 18 16:02:57.681848 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3051/6084] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:02:57 2022] GET /compute/v2.1/servers/d99d89a1-38f6-4219-8d0c-38b13cd97364 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:03:32.063216 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-33321d0b-9345-4dee-a6e7-d2f7c58febd1 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:32.063860 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-33321d0b-9345-4dee-a6e7-d2f7c58febd1 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] [instance: 1fc7455b-8b12-4d55-a8b1-c825ca631301] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:32.066624 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:03:32.074061 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:03:32.091641 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33321d0b-9345-4dee-a6e7-d2f7c58febd1 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:32.092748 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33321d0b-9345-4dee-a6e7-d2f7c58febd1 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:32.093466 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33321d0b-9345-4dee-a6e7-d2f7c58febd1 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:32.094497 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33321d0b-9345-4dee-a6e7-d2f7c58febd1 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:32.095189 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33321d0b-9345-4dee-a6e7-d2f7c58febd1 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:32.095886 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33321d0b-9345-4dee-a6e7-d2f7c58febd1 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:32.276576 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-33321d0b-9345-4dee-a6e7-d2f7c58febd1 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lazy-loading 'services' on Instance uuid 1fc7455b-8b12-4d55-a8b1-c825ca631301 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:03:32.468166 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-33321d0b-9345-4dee-a6e7-d2f7c58febd1 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1fc7455b-8b12-4d55-a8b1-c825ca631301/os-volume_attachments/d479c5df-8315-4c82-a5d5-866c7ac7ab8a" status: 202 len: 0 microversion: 2.1 time: 0.409581 Oct 18 16:03:32.480539 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3034/6085] 10.222.0.60 () {58 vars in 1416 bytes} [Tue Oct 18 16:03:32 2022] DELETE /compute/v2.1/servers/1fc7455b-8b12-4d55-a8b1-c825ca631301/os-volume_attachments/d479c5df-8315-4c82-a5d5-866c7ac7ab8a => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:03:39.190701 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-11ad9edd-0b87-4e76-a775-00c0cf1e9c0d tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:39.192583 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-11ad9edd-0b87-4e76-a775-00c0cf1e9c0d tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] [instance: 1fc7455b-8b12-4d55-a8b1-c825ca631301] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:39.205867 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=37 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:03:39.206867 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:03:39.210626 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-11ad9edd-0b87-4e76-a775-00c0cf1e9c0d tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:39.211391 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-11ad9edd-0b87-4e76-a775-00c0cf1e9c0d tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:39.211921 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-11ad9edd-0b87-4e76-a775-00c0cf1e9c0d tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:39.212923 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-11ad9edd-0b87-4e76-a775-00c0cf1e9c0d tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:39.213358 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-11ad9edd-0b87-4e76-a775-00c0cf1e9c0d tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:39.213793 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-11ad9edd-0b87-4e76-a775-00c0cf1e9c0d tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:39.247130 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-11ad9edd-0b87-4e76-a775-00c0cf1e9c0d tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] [instance: 1fc7455b-8b12-4d55-a8b1-c825ca631301] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:03:39.364955 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-11ad9edd-0b87-4e76-a775-00c0cf1e9c0d tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1fc7455b-8b12-4d55-a8b1-c825ca631301" status: 204 len: 0 microversion: 2.1 time: 0.178577 Oct 18 16:03:39.368992 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3052/6086] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 16:03:39 2022] DELETE /compute/v2.1/servers/1fc7455b-8b12-4d55-a8b1-c825ca631301 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:03:39.375804 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-34af5a28-8027-4f10-b340-8452912f3bed tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:39.376516 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-34af5a28-8027-4f10-b340-8452912f3bed tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] [instance: 1fc7455b-8b12-4d55-a8b1-c825ca631301] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:39.388103 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34af5a28-8027-4f10-b340-8452912f3bed tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:39.388601 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34af5a28-8027-4f10-b340-8452912f3bed tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:39.389137 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34af5a28-8027-4f10-b340-8452912f3bed tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:39.389794 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34af5a28-8027-4f10-b340-8452912f3bed tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:39.390250 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34af5a28-8027-4f10-b340-8452912f3bed tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:39.390674 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34af5a28-8027-4f10-b340-8452912f3bed tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:39.650503 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-34af5a28-8027-4f10-b340-8452912f3bed tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24171f046534c22b854e3db9d80ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1a38df7fef8486ca8bc1040f507b9d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:39.659106 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-34af5a28-8027-4f10-b340-8452912f3bed tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] 10.222.0.60 "GET /compute/v2.1/servers/1fc7455b-8b12-4d55-a8b1-c825ca631301" status: 200 len: 1514 microversion: 2.1 time: 0.288599 Oct 18 16:03:39.660782 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3035/6087] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:39 2022] GET /compute/v2.1/servers/1fc7455b-8b12-4d55-a8b1-c825ca631301 => generated 1514 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:40.707698 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9a8f6790-88e8-457e-a211-251236e2403e tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:40.708406 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9a8f6790-88e8-457e-a211-251236e2403e tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] [instance: 1fc7455b-8b12-4d55-a8b1-c825ca631301] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:40.728540 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9a8f6790-88e8-457e-a211-251236e2403e tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:40.732399 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9a8f6790-88e8-457e-a211-251236e2403e tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:40.733193 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9a8f6790-88e8-457e-a211-251236e2403e tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:40.734608 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9a8f6790-88e8-457e-a211-251236e2403e tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:40.735287 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9a8f6790-88e8-457e-a211-251236e2403e tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:40.736512 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9a8f6790-88e8-457e-a211-251236e2403e tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:41.092074 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9a8f6790-88e8-457e-a211-251236e2403e tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24171f046534c22b854e3db9d80ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1a38df7fef8486ca8bc1040f507b9d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:41.102220 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9a8f6790-88e8-457e-a211-251236e2403e tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] 10.222.0.60 "GET /compute/v2.1/servers/1fc7455b-8b12-4d55-a8b1-c825ca631301" status: 200 len: 1514 microversion: 2.1 time: 0.413899 Oct 18 16:03:41.105525 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3053/6088] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:40 2022] GET /compute/v2.1/servers/1fc7455b-8b12-4d55-a8b1-c825ca631301 => generated 1514 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:42.052229 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-9c63305b-f075-4e2e-8619-d82a89c3d91c req-2b075992-4400-473f-a47c-cf7740be9a17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fc7455b-8b12-4d55-a8b1-c825ca631301", "name": "network-vif-deleted", "tag": "f00d6292-ca80-4392-ae3b-027027cfd013"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:03:42.084378 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9c63305b-f075-4e2e-8619-d82a89c3d91c req-2b075992-4400-473f-a47c-cf7740be9a17 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:42.085416 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9c63305b-f075-4e2e-8619-d82a89c3d91c req-2b075992-4400-473f-a47c-cf7740be9a17 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:42.088370 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9c63305b-f075-4e2e-8619-d82a89c3d91c req-2b075992-4400-473f-a47c-cf7740be9a17 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:42.107499 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-9c63305b-f075-4e2e-8619-d82a89c3d91c req-2b075992-4400-473f-a47c-cf7740be9a17 service nova] Creating event network-vif-deleted:f00d6292-ca80-4392-ae3b-027027cfd013 for instance 1fc7455b-8b12-4d55-a8b1-c825ca631301 on n-h2-853682-5 Oct 18 16:03:42.119604 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-9c63305b-f075-4e2e-8619-d82a89c3d91c req-2b075992-4400-473f-a47c-cf7740be9a17 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070805 Oct 18 16:03:42.120632 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3036/6089] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:03:42.132020 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-696e02f6-6d9f-4a66-94a2-66aacde02a3a tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:42.133073 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-696e02f6-6d9f-4a66-94a2-66aacde02a3a tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] [instance: 1fc7455b-8b12-4d55-a8b1-c825ca631301] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:42.150145 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-696e02f6-6d9f-4a66-94a2-66aacde02a3a tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:42.150761 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-696e02f6-6d9f-4a66-94a2-66aacde02a3a tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:42.151945 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-696e02f6-6d9f-4a66-94a2-66aacde02a3a tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:42.154239 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-696e02f6-6d9f-4a66-94a2-66aacde02a3a tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:42.155310 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-696e02f6-6d9f-4a66-94a2-66aacde02a3a tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:42.157480 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-696e02f6-6d9f-4a66-94a2-66aacde02a3a tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:42.309598 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-696e02f6-6d9f-4a66-94a2-66aacde02a3a tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24171f046534c22b854e3db9d80ed6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1a38df7fef8486ca8bc1040f507b9d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:03:42.318486 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-696e02f6-6d9f-4a66-94a2-66aacde02a3a tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] 10.222.0.60 "GET /compute/v2.1/servers/1fc7455b-8b12-4d55-a8b1-c825ca631301" status: 200 len: 1304 microversion: 2.1 time: 0.192044 Oct 18 16:03:42.323565 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3054/6090] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:42 2022] GET /compute/v2.1/servers/1fc7455b-8b12-4d55-a8b1-c825ca631301 => generated 1304 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:03:43.357453 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b46941b7-93b9-41a3-a2eb-a098149c6f37 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:03:43.358737 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b46941b7-93b9-41a3-a2eb-a098149c6f37 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] [instance: 1fc7455b-8b12-4d55-a8b1-c825ca631301] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:03:43.374118 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b46941b7-93b9-41a3-a2eb-a098149c6f37 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:43.377144 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b46941b7-93b9-41a3-a2eb-a098149c6f37 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:43.377825 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b46941b7-93b9-41a3-a2eb-a098149c6f37 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:43.380092 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b46941b7-93b9-41a3-a2eb-a098149c6f37 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:03:43.381211 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b46941b7-93b9-41a3-a2eb-a098149c6f37 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:03:43.384653 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b46941b7-93b9-41a3-a2eb-a098149c6f37 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:03:43.420723 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-b46941b7-93b9-41a3-a2eb-a098149c6f37 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] HTTP exception thrown: Instance 1fc7455b-8b12-4d55-a8b1-c825ca631301 could not be found. Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b46941b7-93b9-41a3-a2eb-a098149c6f37 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Request method failure captured: Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/1fc7455b-8b12-4d55-a8b1-c825ca631301 HTTP/1.1 Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTs0eC7puxYpvji8pzouugzlqsTisQi82VsqCQOaXeBoa8Rl7tEspni9EyXvcO07o7XCksUI2Mxb7vXXR-HjmYYC8Kd8o1d45gzuq0quAnOAYjH2HL6qzjhG9dQsEfbkOj5aFH3BmAIVBK8x_sa9HPfc62BY5WQQuN4xzEfvKNAXEKQ8 Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: b1a38df7fef8486ca8bc1040f507b9d7 Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1064890439 Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b1a38df7fef8486ca8bc1040f507b9d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b1a38df7fef8486ca8bc1040f507b9d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b1a38df7fef8486ca8bc1040f507b9d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b1a38df7fef8486ca8bc1040f507b9d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-VolumesSnapshotTestJSON-1064890439 Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: b1a38df7fef8486ca8bc1040f507b9d7 Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1064890439 Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-VolumesSnapshotTestJSON-1064890439-project Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: e24171f046534c22b854e3db9d80ed6d Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-VolumesSnapshotTestJSON-1064890439-project Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 1fc7455b-8b12-4d55-a8b1-c825ca631301 could not be found. Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '1fc7455b-8b12-4d55-a8b1-c825ca631301'} Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fc7455b-8b12-4d55-a8b1-c825ca631301 could not be found. Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fc7455b-8b12-4d55-a8b1-c825ca631301 could not be found. Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:03:43.424962 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:03:43.431962 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:03:43.431962 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:03:43.431962 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:03:43.431962 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:03:43.431962 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:03:43.431962 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fc7455b-8b12-4d55-a8b1-c825ca631301 could not be found. Oct 18 16:03:43.431962 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:03:43.436591 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b46941b7-93b9-41a3-a2eb-a098149c6f37 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] Returning 404 to user: Instance 1fc7455b-8b12-4d55-a8b1-c825ca631301 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:03:43.438460 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b46941b7-93b9-41a3-a2eb-a098149c6f37 tempest-VolumesSnapshotTestJSON-1064890439 tempest-VolumesSnapshotTestJSON-1064890439-project] 10.222.0.60 "GET /compute/v2.1/servers/1fc7455b-8b12-4d55-a8b1-c825ca631301" status: 404 len: 111 microversion: 2.1 time: 0.085196 Oct 18 16:03:43.440762 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3037/6091] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:03:43 2022] GET /compute/v2.1/servers/1fc7455b-8b12-4d55-a8b1-c825ca631301 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 16:06:32.082973 n-d-853682-5 devstack@n-api.service[120405]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6b6d975c-54e4-4acd-8cc5-5b0cda3c3106] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 18 16:06:32.084753 n-d-853682-5 devstack@n-api.service[120405]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c870dd72-6039-47fe-83e0-90856ded1829] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 18 16:06:32.085275 n-d-853682-5 devstack@n-api.service[120405]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 16:06:32.085419 n-d-853682-5 devstack@n-api.service[120405]: Tue Oct 18 16:06:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.60) !!! Oct 18 16:06:32.087155 n-d-853682-5 devstack@n-api.service[120405]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 18 16:06:32.087286 n-d-853682-5 devstack@n-api.service[120405]: Tue Oct 18 16:06:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.60) !!! Oct 18 16:06:32.088592 n-d-853682-5 devstack@n-api.service[120405]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 18 16:06:32.088887 n-d-853682-5 devstack@n-api.service[120405]: Tue Oct 18 16:06:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.60) !!! Oct 18 16:06:32.090416 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:06:32.091778 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:06:32.096485 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ca4cb2bb-4800-44f1-9447-2474573bae36 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Action: 'create', calling method: .version_select at 0x7f7c416f0c10>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1775574434", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJEsesn24ORL3olHcYw2xX0Bui3jnaDu9fcyU0vmcWdSvACyJbYEH7yXdgtzx/UR2uQPolweFJDf3vUn/Yosv3BFw50UTyqDY1pCyeVOx4nOILpegRFwiKhGNlVXRlLxxA=="}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:06:32.134380 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-ca4cb2bb-4800-44f1-9447-2474573bae36 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Getting quotas for project cd4683aba07d4f06a82c6c3da216eb88. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:06:32.142096 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-ca4cb2bb-4800-44f1-9447-2474573bae36 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Getting quotas for user 44950f9fc9e24dd5b10a90992214d89f and project cd4683aba07d4f06a82c6c3da216eb88. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:06:32.186010 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ca4cb2bb-4800-44f1-9447-2474573bae36 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.104811 Oct 18 16:06:32.192958 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3055/6092] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Oct 18 16:06:32 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:06:33.331563 n-d-853682-5 devstack@n-api.service[120406]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6eb481dc-0a5f-4095-8691-72ce090f1ba0] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 18 16:06:33.334195 n-d-853682-5 devstack@n-api.service[120406]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9784c765-18ae-4d28-9be4-c2f2473b54eb] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 18 16:06:33.335166 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=8 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:06:33.336782 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:06:33.339378 n-d-853682-5 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 18 16:06:33.339693 n-d-853682-5 devstack@n-api.service[120406]: Tue Oct 18 16:06:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Oct 18 16:06:33.344461 n-d-853682-5 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 16:06:33.344678 n-d-853682-5 devstack@n-api.service[120406]: Tue Oct 18 16:06:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Oct 18 16:06:33.353759 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-897eac10-fb32-45fc-bb35-5c7463b1a95f tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1121645946", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "baae8975-53bf-41cd-8c6e-03dcd98af202", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1775574434", "security_groups": [{"name": "tempest-secgroup-smoke-1168730498"}], "networks": [{"uuid": "50856250-97f1-4e10-93df-962257ca817b"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:06:33.678570 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-897eac10-fb32-45fc-bb35-5c7463b1a95f tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] validate_networks() for [('50856250-97f1-4e10-93df-962257ca817b', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 16:06:34.117524 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-897eac10-fb32-45fc-bb35-5c7463b1a95f tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:06:34.117951 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-897eac10-fb32-45fc-bb35-5c7463b1a95f tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:06:34.118426 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-897eac10-fb32-45fc-bb35-5c7463b1a95f tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:06:34.118988 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-897eac10-fb32-45fc-bb35-5c7463b1a95f tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:06:34.119407 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-897eac10-fb32-45fc-bb35-5c7463b1a95f tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:06:34.129814 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-897eac10-fb32-45fc-bb35-5c7463b1a95f tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:34.130537 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-897eac10-fb32-45fc-bb35-5c7463b1a95f tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:34.131151 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-897eac10-fb32-45fc-bb35-5c7463b1a95f tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:34.131917 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-897eac10-fb32-45fc-bb35-5c7463b1a95f tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:34.132377 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-897eac10-fb32-45fc-bb35-5c7463b1a95f tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:34.132828 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-897eac10-fb32-45fc-bb35-5c7463b1a95f tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:34.149603 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-897eac10-fb32-45fc-bb35-5c7463b1a95f tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Getting quotas for project cd4683aba07d4f06a82c6c3da216eb88. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:06:34.155266 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-897eac10-fb32-45fc-bb35-5c7463b1a95f tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Getting quotas for user 44950f9fc9e24dd5b10a90992214d89f and project cd4683aba07d4f06a82c6c3da216eb88. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:06:34.226198 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-897eac10-fb32-45fc-bb35-5c7463b1a95f tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:06:34.228447 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-897eac10-fb32-45fc-bb35-5c7463b1a95f tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] [instance: 4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='baae8975-53bf-41cd-8c6e-03dcd98af202',volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:06:34.390927 n-d-853682-5 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [-] [9784c765-18ae-4d28-9be4-c2f2473b54eb] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 33086. Oct 18 16:06:34.392463 n-d-853682-5 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [-] [6eb481dc-0a5f-4095-8691-72ce090f1ba0] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 33084. Oct 18 16:06:34.394487 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-897eac10-fb32-45fc-bb35-5c7463b1a95f tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.066624 Oct 18 16:06:34.401788 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3038/6093] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 16:06:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 1075 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:06:34.407391 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6969bd6d-9c57-4b01-bb5b-a16f40307359 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:34.408620 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6969bd6d-9c57-4b01-bb5b-a16f40307359 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] [instance: 4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:34.443982 n-d-853682-5 devstack@n-api.service[120405]: INFO oslo.messaging._drivers.impl_rabbit [-] [c870dd72-6039-47fe-83e0-90856ded1829] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 33092. Oct 18 16:06:34.448061 n-d-853682-5 devstack@n-api.service[120405]: INFO oslo.messaging._drivers.impl_rabbit [-] [6b6d975c-54e4-4acd-8cc5-5b0cda3c3106] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 33090. Oct 18 16:06:34.643816 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6969bd6d-9c57-4b01-bb5b-a16f40307359 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44950f9fc9e24dd5b10a90992214d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4683aba07d4f06a82c6c3da216eb88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:34.651879 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6969bd6d-9c57-4b01-bb5b-a16f40307359 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3" status: 200 len: 1099 microversion: 2.1 time: 0.248874 Oct 18 16:06:34.653626 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3056/6094] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:34 2022] GET /compute/v2.1/servers/4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3 => generated 1099 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:35.676149 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fb693c18-7fbe-4b13-b287-02d2f32d9ac6 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:35.676772 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fb693c18-7fbe-4b13-b287-02d2f32d9ac6 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] [instance: 4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:35.689890 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb693c18-7fbe-4b13-b287-02d2f32d9ac6 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:35.693093 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb693c18-7fbe-4b13-b287-02d2f32d9ac6 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:35.693746 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb693c18-7fbe-4b13-b287-02d2f32d9ac6 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:35.694667 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb693c18-7fbe-4b13-b287-02d2f32d9ac6 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:35.696459 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb693c18-7fbe-4b13-b287-02d2f32d9ac6 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:35.697102 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb693c18-7fbe-4b13-b287-02d2f32d9ac6 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:35.778926 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fb693c18-7fbe-4b13-b287-02d2f32d9ac6 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44950f9fc9e24dd5b10a90992214d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4683aba07d4f06a82c6c3da216eb88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:35.787720 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fb693c18-7fbe-4b13-b287-02d2f32d9ac6 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3" status: 200 len: 1197 microversion: 2.1 time: 0.115861 Oct 18 16:06:35.788923 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3039/6095] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:35 2022] GET /compute/v2.1/servers/4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3 => generated 1197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:36.815477 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-28eeac7d-1b7b-46f3-966b-3e0db0d90384 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:36.816748 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-28eeac7d-1b7b-46f3-966b-3e0db0d90384 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] [instance: 4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:36.830111 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-28eeac7d-1b7b-46f3-966b-3e0db0d90384 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:36.836218 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-28eeac7d-1b7b-46f3-966b-3e0db0d90384 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:36.837097 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-28eeac7d-1b7b-46f3-966b-3e0db0d90384 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:36.838886 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-28eeac7d-1b7b-46f3-966b-3e0db0d90384 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:36.842263 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-28eeac7d-1b7b-46f3-966b-3e0db0d90384 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:36.843155 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-28eeac7d-1b7b-46f3-966b-3e0db0d90384 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:37.125937 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-28eeac7d-1b7b-46f3-966b-3e0db0d90384 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44950f9fc9e24dd5b10a90992214d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4683aba07d4f06a82c6c3da216eb88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:37.144141 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-28eeac7d-1b7b-46f3-966b-3e0db0d90384 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3" status: 200 len: 1283 microversion: 2.1 time: 0.334808 Oct 18 16:06:37.145338 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3057/6096] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:36 2022] GET /compute/v2.1/servers/4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3 => generated 1283 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:38.177298 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b803a2d9-2bcd-4e4a-bac0-c5f00a9bf5df tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:38.178688 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b803a2d9-2bcd-4e4a-bac0-c5f00a9bf5df tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] [instance: 4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:38.188300 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b803a2d9-2bcd-4e4a-bac0-c5f00a9bf5df tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:38.189264 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b803a2d9-2bcd-4e4a-bac0-c5f00a9bf5df tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:38.190080 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b803a2d9-2bcd-4e4a-bac0-c5f00a9bf5df tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:38.191193 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b803a2d9-2bcd-4e4a-bac0-c5f00a9bf5df tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:38.191813 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b803a2d9-2bcd-4e4a-bac0-c5f00a9bf5df tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:38.192411 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b803a2d9-2bcd-4e4a-bac0-c5f00a9bf5df tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:38.256014 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-b36e530b-8ee7-4f43-8425-962a823df368 req-9d537ec8-40ef-4ae0-8032-d6ba67dd2199 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3", "tag": "d547c780-4b64-4efc-b3d3-72f8e7c8c8ad"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:06:38.271212 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-b36e530b-8ee7-4f43-8425-962a823df368 req-9d537ec8-40ef-4ae0-8032-d6ba67dd2199 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:38.272722 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-b36e530b-8ee7-4f43-8425-962a823df368 req-9d537ec8-40ef-4ae0-8032-d6ba67dd2199 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:38.273609 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-b36e530b-8ee7-4f43-8425-962a823df368 req-9d537ec8-40ef-4ae0-8032-d6ba67dd2199 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:38.292498 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-b36e530b-8ee7-4f43-8425-962a823df368 req-9d537ec8-40ef-4ae0-8032-d6ba67dd2199 service nova] Creating event network-changed:d547c780-4b64-4efc-b3d3-72f8e7c8c8ad for instance 4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3 on n-h1-853682-5 Oct 18 16:06:38.301117 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-b36e530b-8ee7-4f43-8425-962a823df368 req-9d537ec8-40ef-4ae0-8032-d6ba67dd2199 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051125 Oct 18 16:06:38.303687 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3058/6097] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:06:38.545060 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b803a2d9-2bcd-4e4a-bac0-c5f00a9bf5df tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44950f9fc9e24dd5b10a90992214d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4683aba07d4f06a82c6c3da216eb88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:38.564777 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b803a2d9-2bcd-4e4a-bac0-c5f00a9bf5df tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3" status: 200 len: 1283 microversion: 2.1 time: 0.392004 Oct 18 16:06:38.567299 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3040/6098] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:38 2022] GET /compute/v2.1/servers/4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3 => generated 1283 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:39.588948 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ae914e26-dc5e-4376-b7fb-10a9030a8542 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:39.589650 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ae914e26-dc5e-4376-b7fb-10a9030a8542 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] [instance: 4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:39.600297 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae914e26-dc5e-4376-b7fb-10a9030a8542 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:39.603074 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae914e26-dc5e-4376-b7fb-10a9030a8542 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:39.603698 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae914e26-dc5e-4376-b7fb-10a9030a8542 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:39.606728 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae914e26-dc5e-4376-b7fb-10a9030a8542 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:39.607416 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae914e26-dc5e-4376-b7fb-10a9030a8542 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:39.609253 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae914e26-dc5e-4376-b7fb-10a9030a8542 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:39.803158 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ae914e26-dc5e-4376-b7fb-10a9030a8542 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44950f9fc9e24dd5b10a90992214d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4683aba07d4f06a82c6c3da216eb88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:39.814832 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ae914e26-dc5e-4376-b7fb-10a9030a8542 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3" status: 200 len: 1283 microversion: 2.1 time: 0.229295 Oct 18 16:06:39.815833 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3059/6099] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:39 2022] GET /compute/v2.1/servers/4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3 => generated 1283 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:40.839660 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d278fcb3-aa02-4484-a5d6-e3e8a786edcf tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:40.841878 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d278fcb3-aa02-4484-a5d6-e3e8a786edcf tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] [instance: 4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:40.853826 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d278fcb3-aa02-4484-a5d6-e3e8a786edcf tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:40.855751 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d278fcb3-aa02-4484-a5d6-e3e8a786edcf tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:40.859437 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d278fcb3-aa02-4484-a5d6-e3e8a786edcf tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:40.863108 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d278fcb3-aa02-4484-a5d6-e3e8a786edcf tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:40.863632 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d278fcb3-aa02-4484-a5d6-e3e8a786edcf tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:40.864080 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d278fcb3-aa02-4484-a5d6-e3e8a786edcf tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:41.050447 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d278fcb3-aa02-4484-a5d6-e3e8a786edcf tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44950f9fc9e24dd5b10a90992214d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4683aba07d4f06a82c6c3da216eb88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:41.063122 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d278fcb3-aa02-4484-a5d6-e3e8a786edcf tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3" status: 200 len: 1283 microversion: 2.1 time: 0.227279 Oct 18 16:06:41.079069 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3041/6100] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:40 2022] GET /compute/v2.1/servers/4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3 => generated 1283 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:42.091131 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-944bd9b8-4f95-48b1-bdef-9a183a4ca88c tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:42.091747 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-944bd9b8-4f95-48b1-bdef-9a183a4ca88c tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] [instance: 4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:42.103678 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-944bd9b8-4f95-48b1-bdef-9a183a4ca88c tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:42.104558 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-944bd9b8-4f95-48b1-bdef-9a183a4ca88c tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:42.105292 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-944bd9b8-4f95-48b1-bdef-9a183a4ca88c tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:42.107459 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-944bd9b8-4f95-48b1-bdef-9a183a4ca88c tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:42.108933 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-944bd9b8-4f95-48b1-bdef-9a183a4ca88c tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:42.109627 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-944bd9b8-4f95-48b1-bdef-9a183a4ca88c tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:42.639337 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-944bd9b8-4f95-48b1-bdef-9a183a4ca88c tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44950f9fc9e24dd5b10a90992214d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4683aba07d4f06a82c6c3da216eb88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:42.649246 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-944bd9b8-4f95-48b1-bdef-9a183a4ca88c tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3" status: 200 len: 1283 microversion: 2.1 time: 0.566247 Oct 18 16:06:42.650684 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3060/6101] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:42 2022] GET /compute/v2.1/servers/4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3 => generated 1283 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:06:43.675702 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3e5a146f-7c10-4033-a970-1db666d2dfbb tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:43.676319 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3e5a146f-7c10-4033-a970-1db666d2dfbb tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] [instance: 4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:43.702743 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e5a146f-7c10-4033-a970-1db666d2dfbb tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:43.703518 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e5a146f-7c10-4033-a970-1db666d2dfbb tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:43.703957 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e5a146f-7c10-4033-a970-1db666d2dfbb tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:43.704667 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e5a146f-7c10-4033-a970-1db666d2dfbb tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:43.705148 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e5a146f-7c10-4033-a970-1db666d2dfbb tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:43.705570 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e5a146f-7c10-4033-a970-1db666d2dfbb tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:43.939909 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3e5a146f-7c10-4033-a970-1db666d2dfbb tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44950f9fc9e24dd5b10a90992214d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4683aba07d4f06a82c6c3da216eb88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:43.948712 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3e5a146f-7c10-4033-a970-1db666d2dfbb tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3" status: 200 len: 1271 microversion: 2.1 time: 0.277389 Oct 18 16:06:43.949434 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3042/6102] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:43 2022] GET /compute/v2.1/servers/4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3 => generated 1271 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:44.972444 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9150f03e-33fa-4d8d-bd54-2d831d6ddbb6 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:44.973128 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9150f03e-33fa-4d8d-bd54-2d831d6ddbb6 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] [instance: 4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:44.976238 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=6 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:06:44.994152 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9150f03e-33fa-4d8d-bd54-2d831d6ddbb6 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:44.994400 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9150f03e-33fa-4d8d-bd54-2d831d6ddbb6 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:44.994861 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9150f03e-33fa-4d8d-bd54-2d831d6ddbb6 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:44.995601 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9150f03e-33fa-4d8d-bd54-2d831d6ddbb6 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:44.996055 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9150f03e-33fa-4d8d-bd54-2d831d6ddbb6 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:44.997135 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9150f03e-33fa-4d8d-bd54-2d831d6ddbb6 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:45.338341 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9150f03e-33fa-4d8d-bd54-2d831d6ddbb6 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44950f9fc9e24dd5b10a90992214d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4683aba07d4f06a82c6c3da216eb88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:45.362373 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9150f03e-33fa-4d8d-bd54-2d831d6ddbb6 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3" status: 200 len: 1271 microversion: 2.1 time: 0.392735 Oct 18 16:06:45.362987 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3061/6103] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:44 2022] GET /compute/v2.1/servers/4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3 => generated 1271 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:45.420697 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0c418a91-fe93-4763-b4a8-7d6a7b2706eb tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Action: 'create', calling method: .version_select at 0x7f7c37e311f0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-620463846", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5Qk0lvoEZ2AQ1FZ5K6wEOcP1KSf/TsV5AmcGbx1vtpyijmDXu+6hFBb6RshhS9iUqPj0SmWHYyUtWHyVy8Eppik9XHXyBzY7hunaxsdyH7wLVu4vhQWs27EI7gf7AdNw=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:06:45.428232 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:06:45.429333 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:06:45.449210 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-0c418a91-fe93-4763-b4a8-7d6a7b2706eb tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Getting quotas for project 10a35c6e5d7d4e06afe028378c708ba6. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:06:45.456175 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-0c418a91-fe93-4763-b4a8-7d6a7b2706eb tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Getting quotas for user f4146336121e4788bbdead3c9dee1c5f and project 10a35c6e5d7d4e06afe028378c708ba6. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:06:45.502716 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0c418a91-fe93-4763-b4a8-7d6a7b2706eb tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.085782 Oct 18 16:06:45.503770 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3043/6104] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Oct 18 16:06:45 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:06:46.395616 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-37bd51ba-3e50-4f65-a932-2271f8fb8140 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:46.396926 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-37bd51ba-3e50-4f65-a932-2271f8fb8140 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] [instance: 4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:46.407873 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37bd51ba-3e50-4f65-a932-2271f8fb8140 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:46.408695 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37bd51ba-3e50-4f65-a932-2271f8fb8140 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:46.409589 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37bd51ba-3e50-4f65-a932-2271f8fb8140 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:46.410519 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37bd51ba-3e50-4f65-a932-2271f8fb8140 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:46.411008 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37bd51ba-3e50-4f65-a932-2271f8fb8140 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:46.411600 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37bd51ba-3e50-4f65-a932-2271f8fb8140 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:46.725044 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-37bd51ba-3e50-4f65-a932-2271f8fb8140 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44950f9fc9e24dd5b10a90992214d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4683aba07d4f06a82c6c3da216eb88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:46.740524 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-37bd51ba-3e50-4f65-a932-2271f8fb8140 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3" status: 200 len: 1271 microversion: 2.1 time: 0.349051 Oct 18 16:06:46.742115 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3062/6105] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:46 2022] GET /compute/v2.1/servers/4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3 => generated 1271 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:47.038366 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-41b95ffb-7a6c-4583-becf-b4afe91030b7 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-177512602", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "2c89fbda-e3fd-4f66-af56-69ea544a0487"}], "key_name": "tempest-TestNetworkBasicOps-620463846", "security_groups": [{"name": "tempest-secgroup-smoke-617377738"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:06:47.170958 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-41b95ffb-7a6c-4583-becf-b4afe91030b7 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] validate_networks() for [('2c89fbda-e3fd-4f66-af56-69ea544a0487', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 16:06:47.606217 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-41b95ffb-7a6c-4583-becf-b4afe91030b7 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:06:47.606849 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-41b95ffb-7a6c-4583-becf-b4afe91030b7 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:06:47.607367 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-41b95ffb-7a6c-4583-becf-b4afe91030b7 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:06:47.607797 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-41b95ffb-7a6c-4583-becf-b4afe91030b7 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:06:47.608342 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-41b95ffb-7a6c-4583-becf-b4afe91030b7 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:06:47.617640 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-41b95ffb-7a6c-4583-becf-b4afe91030b7 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:47.618131 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-41b95ffb-7a6c-4583-becf-b4afe91030b7 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:47.618572 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-41b95ffb-7a6c-4583-becf-b4afe91030b7 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:47.619582 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-41b95ffb-7a6c-4583-becf-b4afe91030b7 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:47.620238 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-41b95ffb-7a6c-4583-becf-b4afe91030b7 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:47.620861 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-41b95ffb-7a6c-4583-becf-b4afe91030b7 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:47.642799 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-41b95ffb-7a6c-4583-becf-b4afe91030b7 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Getting quotas for project 10a35c6e5d7d4e06afe028378c708ba6. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:06:47.649790 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-41b95ffb-7a6c-4583-becf-b4afe91030b7 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Getting quotas for user f4146336121e4788bbdead3c9dee1c5f and project 10a35c6e5d7d4e06afe028378c708ba6. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:06:47.666791 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-41b95ffb-7a6c-4583-becf-b4afe91030b7 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:06:47.669116 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-41b95ffb-7a6c-4583-becf-b4afe91030b7 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] [instance: 1b08e253-0e5f-45a9-90df-0ed99e02370f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:06:47.732429 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-41b95ffb-7a6c-4583-becf-b4afe91030b7 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.698155 Oct 18 16:06:47.733472 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3044/6106] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 16:06:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:06:47.745858 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f7153524-919d-41a5-a3fa-3ac5a8206a23 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:47.747387 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f7153524-919d-41a5-a3fa-3ac5a8206a23 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] [instance: 1b08e253-0e5f-45a9-90df-0ed99e02370f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:47.768594 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7abb16d4-dd6a-44c2-9b3d-555e2d47f753 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:47.769249 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7abb16d4-dd6a-44c2-9b3d-555e2d47f753 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] [instance: 4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:47.781036 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7abb16d4-dd6a-44c2-9b3d-555e2d47f753 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:47.781624 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7abb16d4-dd6a-44c2-9b3d-555e2d47f753 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:47.782240 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7abb16d4-dd6a-44c2-9b3d-555e2d47f753 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:47.783044 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7abb16d4-dd6a-44c2-9b3d-555e2d47f753 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:47.783633 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7abb16d4-dd6a-44c2-9b3d-555e2d47f753 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:47.784517 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7abb16d4-dd6a-44c2-9b3d-555e2d47f753 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:47.837694 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f7153524-919d-41a5-a3fa-3ac5a8206a23 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4146336121e4788bbdead3c9dee1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a35c6e5d7d4e06afe028378c708ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:47.845528 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f7153524-919d-41a5-a3fa-3ac5a8206a23 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] 10.222.0.60 "GET /compute/v2.1/servers/1b08e253-0e5f-45a9-90df-0ed99e02370f" status: 200 len: 1247 microversion: 2.1 time: 0.103885 Oct 18 16:06:47.846636 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3063/6107] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:47 2022] GET /compute/v2.1/servers/1b08e253-0e5f-45a9-90df-0ed99e02370f => generated 1247 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:47.973996 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7abb16d4-dd6a-44c2-9b3d-555e2d47f753 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44950f9fc9e24dd5b10a90992214d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4683aba07d4f06a82c6c3da216eb88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:47.981992 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7abb16d4-dd6a-44c2-9b3d-555e2d47f753 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3" status: 200 len: 1271 microversion: 2.1 time: 0.220476 Oct 18 16:06:47.992894 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3045/6108] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:47 2022] GET /compute/v2.1/servers/4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3 => generated 1271 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:48.869336 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e4d91c87-c9f8-47fa-a821-d1850d8632e5 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:48.869811 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e4d91c87-c9f8-47fa-a821-d1850d8632e5 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] [instance: 1b08e253-0e5f-45a9-90df-0ed99e02370f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:48.877503 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4d91c87-c9f8-47fa-a821-d1850d8632e5 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:48.877986 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4d91c87-c9f8-47fa-a821-d1850d8632e5 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:48.878417 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4d91c87-c9f8-47fa-a821-d1850d8632e5 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:48.879104 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4d91c87-c9f8-47fa-a821-d1850d8632e5 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:48.879554 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4d91c87-c9f8-47fa-a821-d1850d8632e5 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:48.879976 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4d91c87-c9f8-47fa-a821-d1850d8632e5 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:48.962350 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e4d91c87-c9f8-47fa-a821-d1850d8632e5 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4146336121e4788bbdead3c9dee1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a35c6e5d7d4e06afe028378c708ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:48.982318 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e4d91c87-c9f8-47fa-a821-d1850d8632e5 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] 10.222.0.60 "GET /compute/v2.1/servers/1b08e253-0e5f-45a9-90df-0ed99e02370f" status: 200 len: 1299 microversion: 2.1 time: 0.117451 Oct 18 16:06:48.985309 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3064/6109] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:48 2022] GET /compute/v2.1/servers/1b08e253-0e5f-45a9-90df-0ed99e02370f => generated 1299 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:49.009481 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f1d63131-8097-4d7f-bd24-60615e70dbee tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:49.010716 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f1d63131-8097-4d7f-bd24-60615e70dbee tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] [instance: 4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:49.021477 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f1d63131-8097-4d7f-bd24-60615e70dbee tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:49.022309 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f1d63131-8097-4d7f-bd24-60615e70dbee tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:49.022755 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f1d63131-8097-4d7f-bd24-60615e70dbee tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:49.024359 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f1d63131-8097-4d7f-bd24-60615e70dbee tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:49.024940 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f1d63131-8097-4d7f-bd24-60615e70dbee tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:49.025380 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f1d63131-8097-4d7f-bd24-60615e70dbee tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:49.244967 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f1d63131-8097-4d7f-bd24-60615e70dbee tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44950f9fc9e24dd5b10a90992214d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4683aba07d4f06a82c6c3da216eb88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:49.253604 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f1d63131-8097-4d7f-bd24-60615e70dbee tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3" status: 200 len: 1271 microversion: 2.1 time: 0.248374 Oct 18 16:06:49.254202 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3046/6110] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:49 2022] GET /compute/v2.1/servers/4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3 => generated 1271 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:50.010469 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-cd8b9fb9-eb9f-480e-811a-209d9b50b2c9 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:50.012469 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-cd8b9fb9-eb9f-480e-811a-209d9b50b2c9 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] [instance: 1b08e253-0e5f-45a9-90df-0ed99e02370f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:50.024400 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cd8b9fb9-eb9f-480e-811a-209d9b50b2c9 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:50.025757 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cd8b9fb9-eb9f-480e-811a-209d9b50b2c9 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:50.026712 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cd8b9fb9-eb9f-480e-811a-209d9b50b2c9 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:50.028321 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cd8b9fb9-eb9f-480e-811a-209d9b50b2c9 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:50.029002 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cd8b9fb9-eb9f-480e-811a-209d9b50b2c9 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:50.029618 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cd8b9fb9-eb9f-480e-811a-209d9b50b2c9 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:50.283991 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4d9e5bf2-5d41-40b2-ae36-bd20b22da061 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:50.285357 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4d9e5bf2-5d41-40b2-ae36-bd20b22da061 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] [instance: 4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:50.292288 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d9e5bf2-5d41-40b2-ae36-bd20b22da061 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:50.292990 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d9e5bf2-5d41-40b2-ae36-bd20b22da061 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:50.293644 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d9e5bf2-5d41-40b2-ae36-bd20b22da061 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:50.294461 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d9e5bf2-5d41-40b2-ae36-bd20b22da061 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:50.295282 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d9e5bf2-5d41-40b2-ae36-bd20b22da061 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:50.295665 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-cd8b9fb9-eb9f-480e-811a-209d9b50b2c9 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4146336121e4788bbdead3c9dee1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a35c6e5d7d4e06afe028378c708ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:50.296309 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d9e5bf2-5d41-40b2-ae36-bd20b22da061 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:50.307075 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-cd8b9fb9-eb9f-480e-811a-209d9b50b2c9 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] 10.222.0.60 "GET /compute/v2.1/servers/1b08e253-0e5f-45a9-90df-0ed99e02370f" status: 200 len: 1372 microversion: 2.1 time: 0.300660 Oct 18 16:06:50.317923 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3065/6111] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:50 2022] GET /compute/v2.1/servers/1b08e253-0e5f-45a9-90df-0ed99e02370f => generated 1372 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:50.555307 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4d9e5bf2-5d41-40b2-ae36-bd20b22da061 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44950f9fc9e24dd5b10a90992214d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4683aba07d4f06a82c6c3da216eb88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:50.571013 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4d9e5bf2-5d41-40b2-ae36-bd20b22da061 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3" status: 200 len: 1271 microversion: 2.1 time: 0.287388 Oct 18 16:06:50.572428 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3047/6112] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:50 2022] GET /compute/v2.1/servers/4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3 => generated 1271 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:06:51.176021 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-bb0ea059-15b4-43cc-867b-e0f35a3feab8 req-65f3e143-286f-405b-94ad-715a23aaa960 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b08e253-0e5f-45a9-90df-0ed99e02370f", "tag": "c223dfeb-2206-4eec-b091-555b08d30054"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:06:51.188289 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-bb0ea059-15b4-43cc-867b-e0f35a3feab8 req-65f3e143-286f-405b-94ad-715a23aaa960 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:51.188945 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-bb0ea059-15b4-43cc-867b-e0f35a3feab8 req-65f3e143-286f-405b-94ad-715a23aaa960 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:51.189620 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-bb0ea059-15b4-43cc-867b-e0f35a3feab8 req-65f3e143-286f-405b-94ad-715a23aaa960 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:51.202203 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-bb0ea059-15b4-43cc-867b-e0f35a3feab8 req-65f3e143-286f-405b-94ad-715a23aaa960 service nova] Creating event network-changed:c223dfeb-2206-4eec-b091-555b08d30054 for instance 1b08e253-0e5f-45a9-90df-0ed99e02370f on n-h2-853682-5 Oct 18 16:06:51.207327 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-bb0ea059-15b4-43cc-867b-e0f35a3feab8 req-65f3e143-286f-405b-94ad-715a23aaa960 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035343 Oct 18 16:06:51.208894 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3066/6113] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:06:51.337228 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5e93968f-a3d3-4f8f-8c13-bdb0012f5548 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:51.338011 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5e93968f-a3d3-4f8f-8c13-bdb0012f5548 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] [instance: 1b08e253-0e5f-45a9-90df-0ed99e02370f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:51.346091 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e93968f-a3d3-4f8f-8c13-bdb0012f5548 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:51.346592 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e93968f-a3d3-4f8f-8c13-bdb0012f5548 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:51.347029 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e93968f-a3d3-4f8f-8c13-bdb0012f5548 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:51.347779 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e93968f-a3d3-4f8f-8c13-bdb0012f5548 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:51.348240 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e93968f-a3d3-4f8f-8c13-bdb0012f5548 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:51.348668 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e93968f-a3d3-4f8f-8c13-bdb0012f5548 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:51.569598 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5e93968f-a3d3-4f8f-8c13-bdb0012f5548 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4146336121e4788bbdead3c9dee1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a35c6e5d7d4e06afe028378c708ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:51.579274 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5e93968f-a3d3-4f8f-8c13-bdb0012f5548 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] 10.222.0.60 "GET /compute/v2.1/servers/1b08e253-0e5f-45a9-90df-0ed99e02370f" status: 200 len: 1372 microversion: 2.1 time: 0.246147 Oct 18 16:06:51.580007 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3048/6114] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:51 2022] GET /compute/v2.1/servers/1b08e253-0e5f-45a9-90df-0ed99e02370f => generated 1372 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:51.596668 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f2621feb-62e4-43b5-954a-7f38560a518b tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:51.597421 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f2621feb-62e4-43b5-954a-7f38560a518b tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] [instance: 4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:51.605011 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f2621feb-62e4-43b5-954a-7f38560a518b tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:51.605438 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f2621feb-62e4-43b5-954a-7f38560a518b tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:51.605877 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f2621feb-62e4-43b5-954a-7f38560a518b tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:51.606576 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f2621feb-62e4-43b5-954a-7f38560a518b tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:51.607042 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f2621feb-62e4-43b5-954a-7f38560a518b tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:51.607476 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f2621feb-62e4-43b5-954a-7f38560a518b tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:51.796609 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f2621feb-62e4-43b5-954a-7f38560a518b tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44950f9fc9e24dd5b10a90992214d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4683aba07d4f06a82c6c3da216eb88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:51.814224 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f2621feb-62e4-43b5-954a-7f38560a518b tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3" status: 200 len: 1271 microversion: 2.1 time: 0.221826 Oct 18 16:06:51.815110 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3067/6115] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:51 2022] GET /compute/v2.1/servers/4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3 => generated 1271 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:52.449452 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-7aac3308-8374-4e31-997a-4114190a7f4b req-812cf4ce-ef93-415a-80b2-6a27a824b73c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3", "name": "network-vif-plugged", "status": "completed", "tag": "d547c780-4b64-4efc-b3d3-72f8e7c8c8ad"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:06:52.468066 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7aac3308-8374-4e31-997a-4114190a7f4b req-812cf4ce-ef93-415a-80b2-6a27a824b73c service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:52.468545 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7aac3308-8374-4e31-997a-4114190a7f4b req-812cf4ce-ef93-415a-80b2-6a27a824b73c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:52.469037 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7aac3308-8374-4e31-997a-4114190a7f4b req-812cf4ce-ef93-415a-80b2-6a27a824b73c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:52.481668 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-7aac3308-8374-4e31-997a-4114190a7f4b req-812cf4ce-ef93-415a-80b2-6a27a824b73c service nova] Creating event network-vif-plugged:d547c780-4b64-4efc-b3d3-72f8e7c8c8ad for instance 4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3 on n-h1-853682-5 Oct 18 16:06:52.485242 n-d-853682-5 devstack@n-api.service[120406]: ERROR oslo.messaging._drivers.impl_rabbit [req-7aac3308-8374-4e31-997a-4114190a7f4b req-812cf4ce-ef93-415a-80b2-6a27a824b73c service nova] [e84fd871-95f6-4cf0-a2d7-a2d0c107921e] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 16:06:52.601998 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e63f2971-a650-4021-a27b-15345aa4a01a tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:52.603219 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e63f2971-a650-4021-a27b-15345aa4a01a tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] [instance: 1b08e253-0e5f-45a9-90df-0ed99e02370f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:52.613448 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e63f2971-a650-4021-a27b-15345aa4a01a tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:52.614018 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e63f2971-a650-4021-a27b-15345aa4a01a tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:52.614455 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e63f2971-a650-4021-a27b-15345aa4a01a tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:52.615385 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e63f2971-a650-4021-a27b-15345aa4a01a tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:52.616046 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e63f2971-a650-4021-a27b-15345aa4a01a tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:52.616647 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e63f2971-a650-4021-a27b-15345aa4a01a tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:52.835768 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e63f2971-a650-4021-a27b-15345aa4a01a tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4146336121e4788bbdead3c9dee1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a35c6e5d7d4e06afe028378c708ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:52.845492 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e63f2971-a650-4021-a27b-15345aa4a01a tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] 10.222.0.60 "GET /compute/v2.1/servers/1b08e253-0e5f-45a9-90df-0ed99e02370f" status: 200 len: 1372 microversion: 2.1 time: 0.247360 Oct 18 16:06:52.846713 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3068/6116] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:52 2022] GET /compute/v2.1/servers/1b08e253-0e5f-45a9-90df-0ed99e02370f => generated 1372 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:06:52.851898 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-344342fb-3c2c-4735-adb6-c94a26bf64ad tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:52.854318 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-344342fb-3c2c-4735-adb6-c94a26bf64ad tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] [instance: 4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:52.865714 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-344342fb-3c2c-4735-adb6-c94a26bf64ad tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:52.866444 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-344342fb-3c2c-4735-adb6-c94a26bf64ad tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:52.867253 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-344342fb-3c2c-4735-adb6-c94a26bf64ad tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:52.867599 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-344342fb-3c2c-4735-adb6-c94a26bf64ad tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:52.868267 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-344342fb-3c2c-4735-adb6-c94a26bf64ad tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:52.869073 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-344342fb-3c2c-4735-adb6-c94a26bf64ad tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:53.115094 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-344342fb-3c2c-4735-adb6-c94a26bf64ad tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44950f9fc9e24dd5b10a90992214d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4683aba07d4f06a82c6c3da216eb88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:53.129368 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-344342fb-3c2c-4735-adb6-c94a26bf64ad tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3" status: 200 len: 1271 microversion: 2.1 time: 0.280475 Oct 18 16:06:53.130405 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3069/6117] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:52 2022] GET /compute/v2.1/servers/4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3 => generated 1271 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:53.495016 n-d-853682-5 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [req-7aac3308-8374-4e31-997a-4114190a7f4b req-812cf4ce-ef93-415a-80b2-6a27a824b73c service nova] [e84fd871-95f6-4cf0-a2d7-a2d0c107921e] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 33412. Oct 18 16:06:53.502991 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-7aac3308-8374-4e31-997a-4114190a7f4b req-812cf4ce-ef93-415a-80b2-6a27a824b73c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.058108 Oct 18 16:06:53.508308 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3049/6118] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:06:53.871793 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5ffcd6df-e88b-468b-9819-afe5f3c73bf0 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:53.872600 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5ffcd6df-e88b-468b-9819-afe5f3c73bf0 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] [instance: 1b08e253-0e5f-45a9-90df-0ed99e02370f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:53.880331 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5ffcd6df-e88b-468b-9819-afe5f3c73bf0 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:53.881044 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5ffcd6df-e88b-468b-9819-afe5f3c73bf0 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:53.881630 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5ffcd6df-e88b-468b-9819-afe5f3c73bf0 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:53.882469 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5ffcd6df-e88b-468b-9819-afe5f3c73bf0 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:53.883041 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5ffcd6df-e88b-468b-9819-afe5f3c73bf0 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:53.883580 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5ffcd6df-e88b-468b-9819-afe5f3c73bf0 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:54.032502 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5ffcd6df-e88b-468b-9819-afe5f3c73bf0 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4146336121e4788bbdead3c9dee1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a35c6e5d7d4e06afe028378c708ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:54.040534 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5ffcd6df-e88b-468b-9819-afe5f3c73bf0 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] 10.222.0.60 "GET /compute/v2.1/servers/1b08e253-0e5f-45a9-90df-0ed99e02370f" status: 200 len: 1372 microversion: 2.1 time: 0.172752 Oct 18 16:06:54.041336 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3070/6119] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:53 2022] GET /compute/v2.1/servers/1b08e253-0e5f-45a9-90df-0ed99e02370f => generated 1372 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:54.156594 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c49ed967-c501-4800-92dd-99370407ab1f tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:54.157336 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c49ed967-c501-4800-92dd-99370407ab1f tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] [instance: 4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:54.163721 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c49ed967-c501-4800-92dd-99370407ab1f tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:54.164423 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c49ed967-c501-4800-92dd-99370407ab1f tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:54.164881 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c49ed967-c501-4800-92dd-99370407ab1f tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:54.165585 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c49ed967-c501-4800-92dd-99370407ab1f tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:54.166042 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c49ed967-c501-4800-92dd-99370407ab1f tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:54.166469 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c49ed967-c501-4800-92dd-99370407ab1f tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:54.322538 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c49ed967-c501-4800-92dd-99370407ab1f tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44950f9fc9e24dd5b10a90992214d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4683aba07d4f06a82c6c3da216eb88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:54.330935 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c49ed967-c501-4800-92dd-99370407ab1f tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3" status: 200 len: 1271 microversion: 2.1 time: 0.179147 Oct 18 16:06:54.331516 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3050/6120] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:54 2022] GET /compute/v2.1/servers/4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3 => generated 1271 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:55.063983 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-07d71ac7-a365-438c-9e48-69ed74849551 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:55.064791 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-07d71ac7-a365-438c-9e48-69ed74849551 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] [instance: 1b08e253-0e5f-45a9-90df-0ed99e02370f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:55.071726 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-07d71ac7-a365-438c-9e48-69ed74849551 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:55.072219 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-07d71ac7-a365-438c-9e48-69ed74849551 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:55.072654 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-07d71ac7-a365-438c-9e48-69ed74849551 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:55.073574 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-07d71ac7-a365-438c-9e48-69ed74849551 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:55.074209 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-07d71ac7-a365-438c-9e48-69ed74849551 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:55.074643 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-07d71ac7-a365-438c-9e48-69ed74849551 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:55.235275 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-07d71ac7-a365-438c-9e48-69ed74849551 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4146336121e4788bbdead3c9dee1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a35c6e5d7d4e06afe028378c708ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:55.245772 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-07d71ac7-a365-438c-9e48-69ed74849551 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] 10.222.0.60 "GET /compute/v2.1/servers/1b08e253-0e5f-45a9-90df-0ed99e02370f" status: 200 len: 1372 microversion: 2.1 time: 0.182914 Oct 18 16:06:55.245772 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3071/6121] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:55 2022] GET /compute/v2.1/servers/1b08e253-0e5f-45a9-90df-0ed99e02370f => generated 1372 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:55.354397 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dd653f31-9276-4cca-b6b7-388e227f7a3b tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:55.355024 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dd653f31-9276-4cca-b6b7-388e227f7a3b tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] [instance: 4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:55.362383 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd653f31-9276-4cca-b6b7-388e227f7a3b tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:55.362876 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd653f31-9276-4cca-b6b7-388e227f7a3b tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:55.363345 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd653f31-9276-4cca-b6b7-388e227f7a3b tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:55.364044 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd653f31-9276-4cca-b6b7-388e227f7a3b tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:55.364505 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd653f31-9276-4cca-b6b7-388e227f7a3b tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:55.365079 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd653f31-9276-4cca-b6b7-388e227f7a3b tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:55.506409 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dd653f31-9276-4cca-b6b7-388e227f7a3b tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44950f9fc9e24dd5b10a90992214d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4683aba07d4f06a82c6c3da216eb88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:55.515470 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dd653f31-9276-4cca-b6b7-388e227f7a3b tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3" status: 200 len: 1460 microversion: 2.1 time: 0.164819 Oct 18 16:06:55.515928 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3051/6122] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:55 2022] GET /compute/v2.1/servers/4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3 => generated 1460 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:55.539544 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6c9d6061-c5ab-4aad-a932-f1a189f6bd8d tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:55.540425 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6c9d6061-c5ab-4aad-a932-f1a189f6bd8d tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] [instance: 4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:55.547212 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6c9d6061-c5ab-4aad-a932-f1a189f6bd8d tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:55.547703 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6c9d6061-c5ab-4aad-a932-f1a189f6bd8d tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:55.548322 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6c9d6061-c5ab-4aad-a932-f1a189f6bd8d tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:55.549311 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6c9d6061-c5ab-4aad-a932-f1a189f6bd8d tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:55.549771 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6c9d6061-c5ab-4aad-a932-f1a189f6bd8d tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:55.550200 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6c9d6061-c5ab-4aad-a932-f1a189f6bd8d tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:55.690204 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6c9d6061-c5ab-4aad-a932-f1a189f6bd8d tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44950f9fc9e24dd5b10a90992214d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4683aba07d4f06a82c6c3da216eb88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:55.700869 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6c9d6061-c5ab-4aad-a932-f1a189f6bd8d tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3" status: 200 len: 1460 microversion: 2.1 time: 0.165283 Oct 18 16:06:55.701488 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3072/6123] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:55 2022] GET /compute/v2.1/servers/4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3 => generated 1460 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:56.268368 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-10bab4c4-01bf-4edd-9968-bbbd4f820cd6 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:56.269304 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-10bab4c4-01bf-4edd-9968-bbbd4f820cd6 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] [instance: 1b08e253-0e5f-45a9-90df-0ed99e02370f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:56.276978 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10bab4c4-01bf-4edd-9968-bbbd4f820cd6 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:56.277816 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10bab4c4-01bf-4edd-9968-bbbd4f820cd6 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:56.278668 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10bab4c4-01bf-4edd-9968-bbbd4f820cd6 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:56.279743 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10bab4c4-01bf-4edd-9968-bbbd4f820cd6 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:56.280588 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10bab4c4-01bf-4edd-9968-bbbd4f820cd6 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:56.281276 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10bab4c4-01bf-4edd-9968-bbbd4f820cd6 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:56.532071 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-10bab4c4-01bf-4edd-9968-bbbd4f820cd6 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4146336121e4788bbdead3c9dee1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a35c6e5d7d4e06afe028378c708ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:56.549569 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-10bab4c4-01bf-4edd-9968-bbbd4f820cd6 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] 10.222.0.60 "GET /compute/v2.1/servers/1b08e253-0e5f-45a9-90df-0ed99e02370f" status: 200 len: 1372 microversion: 2.1 time: 0.286507 Oct 18 16:06:56.571247 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3052/6124] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:56 2022] GET /compute/v2.1/servers/1b08e253-0e5f-45a9-90df-0ed99e02370f => generated 1372 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:57.575061 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-81357c38-3ee7-46a2-90b8-6d7cc39407d8 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:57.576265 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-81357c38-3ee7-46a2-90b8-6d7cc39407d8 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] [instance: 1b08e253-0e5f-45a9-90df-0ed99e02370f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:57.583004 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-81357c38-3ee7-46a2-90b8-6d7cc39407d8 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:57.583624 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-81357c38-3ee7-46a2-90b8-6d7cc39407d8 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:57.584123 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-81357c38-3ee7-46a2-90b8-6d7cc39407d8 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:57.584917 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-81357c38-3ee7-46a2-90b8-6d7cc39407d8 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:57.585435 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-81357c38-3ee7-46a2-90b8-6d7cc39407d8 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:57.585923 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-81357c38-3ee7-46a2-90b8-6d7cc39407d8 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:57.844518 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:06:57.910797 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-81357c38-3ee7-46a2-90b8-6d7cc39407d8 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4146336121e4788bbdead3c9dee1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a35c6e5d7d4e06afe028378c708ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:57.919777 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-81357c38-3ee7-46a2-90b8-6d7cc39407d8 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] 10.222.0.60 "GET /compute/v2.1/servers/1b08e253-0e5f-45a9-90df-0ed99e02370f" status: 200 len: 1372 microversion: 2.1 time: 0.349812 Oct 18 16:06:57.924856 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3073/6125] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:57 2022] GET /compute/v2.1/servers/1b08e253-0e5f-45a9-90df-0ed99e02370f => generated 1372 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:06:58.135480 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-269daccf-06d1-427e-bdbf-169317dfc278 req-499ea798-ad2a-43ba-b2e3-a3e56618eed4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b08e253-0e5f-45a9-90df-0ed99e02370f", "name": "network-vif-plugged", "status": "completed", "tag": "c223dfeb-2206-4eec-b091-555b08d30054"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:06:58.171871 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:06:58.172642 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=10 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:06:58.182884 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-269daccf-06d1-427e-bdbf-169317dfc278 req-499ea798-ad2a-43ba-b2e3-a3e56618eed4 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:58.184626 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-269daccf-06d1-427e-bdbf-169317dfc278 req-499ea798-ad2a-43ba-b2e3-a3e56618eed4 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:58.185776 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-269daccf-06d1-427e-bdbf-169317dfc278 req-499ea798-ad2a-43ba-b2e3-a3e56618eed4 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:58.203967 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-269daccf-06d1-427e-bdbf-169317dfc278 req-499ea798-ad2a-43ba-b2e3-a3e56618eed4 service nova] Creating event network-vif-plugged:c223dfeb-2206-4eec-b091-555b08d30054 for instance 1b08e253-0e5f-45a9-90df-0ed99e02370f on n-h2-853682-5 Oct 18 16:06:58.212951 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-269daccf-06d1-427e-bdbf-169317dfc278 req-499ea798-ad2a-43ba-b2e3-a3e56618eed4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083007 Oct 18 16:06:58.214321 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3053/6126] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:06:58.747374 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-ef4c463a-999d-4272-842b-b5370f2ffef0 req-8f3b35b0-b367-4f5b-8d04-3daee1e09366 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3", "tag": "d547c780-4b64-4efc-b3d3-72f8e7c8c8ad"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:06:58.760435 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-ef4c463a-999d-4272-842b-b5370f2ffef0 req-8f3b35b0-b367-4f5b-8d04-3daee1e09366 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:58.761815 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-ef4c463a-999d-4272-842b-b5370f2ffef0 req-8f3b35b0-b367-4f5b-8d04-3daee1e09366 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:58.762424 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-ef4c463a-999d-4272-842b-b5370f2ffef0 req-8f3b35b0-b367-4f5b-8d04-3daee1e09366 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:58.774091 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-ef4c463a-999d-4272-842b-b5370f2ffef0 req-8f3b35b0-b367-4f5b-8d04-3daee1e09366 service nova] Creating event network-changed:d547c780-4b64-4efc-b3d3-72f8e7c8c8ad for instance 4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3 on n-h1-853682-5 Oct 18 16:06:58.781169 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-ef4c463a-999d-4272-842b-b5370f2ffef0 req-8f3b35b0-b367-4f5b-8d04-3daee1e09366 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037418 Oct 18 16:06:58.782520 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3074/6127] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:06:58.944277 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-58220b6f-842b-4515-a638-695eb8f7465c tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:06:58.945082 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-58220b6f-842b-4515-a638-695eb8f7465c tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] [instance: 1b08e253-0e5f-45a9-90df-0ed99e02370f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:06:58.953196 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58220b6f-842b-4515-a638-695eb8f7465c tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:58.954020 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58220b6f-842b-4515-a638-695eb8f7465c tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:58.954669 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58220b6f-842b-4515-a638-695eb8f7465c tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:58.955606 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58220b6f-842b-4515-a638-695eb8f7465c tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:06:58.956284 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58220b6f-842b-4515-a638-695eb8f7465c tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:06:58.956964 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58220b6f-842b-4515-a638-695eb8f7465c tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:06:59.317655 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-58220b6f-842b-4515-a638-695eb8f7465c tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4146336121e4788bbdead3c9dee1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a35c6e5d7d4e06afe028378c708ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:06:59.330888 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-58220b6f-842b-4515-a638-695eb8f7465c tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] 10.222.0.60 "GET /compute/v2.1/servers/1b08e253-0e5f-45a9-90df-0ed99e02370f" status: 200 len: 1372 microversion: 2.1 time: 0.390918 Oct 18 16:06:59.347525 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3054/6128] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:06:58 2022] GET /compute/v2.1/servers/1b08e253-0e5f-45a9-90df-0ed99e02370f => generated 1372 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:00.355296 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ee5c1a59-9ba5-4e60-a556-ce76cecea95e tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:00.356001 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ee5c1a59-9ba5-4e60-a556-ce76cecea95e tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] [instance: 1b08e253-0e5f-45a9-90df-0ed99e02370f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:00.362290 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ee5c1a59-9ba5-4e60-a556-ce76cecea95e tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:00.362765 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ee5c1a59-9ba5-4e60-a556-ce76cecea95e tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:00.363230 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ee5c1a59-9ba5-4e60-a556-ce76cecea95e tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:00.363926 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ee5c1a59-9ba5-4e60-a556-ce76cecea95e tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:00.364381 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ee5c1a59-9ba5-4e60-a556-ce76cecea95e tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:00.364827 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ee5c1a59-9ba5-4e60-a556-ce76cecea95e tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:00.502774 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ee5c1a59-9ba5-4e60-a556-ce76cecea95e tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4146336121e4788bbdead3c9dee1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a35c6e5d7d4e06afe028378c708ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:00.513255 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ee5c1a59-9ba5-4e60-a556-ce76cecea95e tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] 10.222.0.60 "GET /compute/v2.1/servers/1b08e253-0e5f-45a9-90df-0ed99e02370f" status: 200 len: 1545 microversion: 2.1 time: 0.163221 Oct 18 16:07:00.524915 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3075/6129] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:00 2022] GET /compute/v2.1/servers/1b08e253-0e5f-45a9-90df-0ed99e02370f => generated 1545 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:00.548901 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cefcd029-95fc-4d0f-a513-766087a20b39 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:00.549842 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cefcd029-95fc-4d0f-a513-766087a20b39 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] [instance: 1b08e253-0e5f-45a9-90df-0ed99e02370f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:00.558535 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cefcd029-95fc-4d0f-a513-766087a20b39 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:00.559109 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cefcd029-95fc-4d0f-a513-766087a20b39 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:00.559688 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cefcd029-95fc-4d0f-a513-766087a20b39 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:00.560841 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cefcd029-95fc-4d0f-a513-766087a20b39 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:00.561226 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cefcd029-95fc-4d0f-a513-766087a20b39 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:00.561759 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cefcd029-95fc-4d0f-a513-766087a20b39 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:00.793007 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cefcd029-95fc-4d0f-a513-766087a20b39 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4146336121e4788bbdead3c9dee1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a35c6e5d7d4e06afe028378c708ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:00.801449 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cefcd029-95fc-4d0f-a513-766087a20b39 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] 10.222.0.60 "GET /compute/v2.1/servers/1b08e253-0e5f-45a9-90df-0ed99e02370f" status: 200 len: 1545 microversion: 2.1 time: 0.258241 Oct 18 16:07:00.802189 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3055/6130] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:00 2022] GET /compute/v2.1/servers/1b08e253-0e5f-45a9-90df-0ed99e02370f => generated 1545 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:01.523944 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-392a4a41-5a6a-483a-8fe9-b7aa3df263e5 req-ac6a2952-85b5-49aa-a481-53ac985e9f36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3", "tag": "d547c780-4b64-4efc-b3d3-72f8e7c8c8ad"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:07:01.545389 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-392a4a41-5a6a-483a-8fe9-b7aa3df263e5 req-ac6a2952-85b5-49aa-a481-53ac985e9f36 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:01.545886 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-392a4a41-5a6a-483a-8fe9-b7aa3df263e5 req-ac6a2952-85b5-49aa-a481-53ac985e9f36 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:01.546325 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-392a4a41-5a6a-483a-8fe9-b7aa3df263e5 req-ac6a2952-85b5-49aa-a481-53ac985e9f36 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:01.562231 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-392a4a41-5a6a-483a-8fe9-b7aa3df263e5 req-ac6a2952-85b5-49aa-a481-53ac985e9f36 service nova] Creating event network-changed:d547c780-4b64-4efc-b3d3-72f8e7c8c8ad for instance 4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3 on n-h1-853682-5 Oct 18 16:07:01.568214 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-392a4a41-5a6a-483a-8fe9-b7aa3df263e5 req-ac6a2952-85b5-49aa-a481-53ac985e9f36 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048233 Oct 18 16:07:01.572288 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3076/6131] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:07:03.293239 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-2abf495c-fdee-420e-80a3-343c51d9936b req-6312baea-e26e-4280-96d8-330e9a9de2d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b08e253-0e5f-45a9-90df-0ed99e02370f", "tag": "c223dfeb-2206-4eec-b091-555b08d30054"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:07:03.303384 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2abf495c-fdee-420e-80a3-343c51d9936b req-6312baea-e26e-4280-96d8-330e9a9de2d0 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:03.304085 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2abf495c-fdee-420e-80a3-343c51d9936b req-6312baea-e26e-4280-96d8-330e9a9de2d0 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:03.304600 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2abf495c-fdee-420e-80a3-343c51d9936b req-6312baea-e26e-4280-96d8-330e9a9de2d0 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:03.316681 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-2abf495c-fdee-420e-80a3-343c51d9936b req-6312baea-e26e-4280-96d8-330e9a9de2d0 service nova] Creating event network-changed:c223dfeb-2206-4eec-b091-555b08d30054 for instance 1b08e253-0e5f-45a9-90df-0ed99e02370f on n-h2-853682-5 Oct 18 16:07:03.322212 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-2abf495c-fdee-420e-80a3-343c51d9936b req-6312baea-e26e-4280-96d8-330e9a9de2d0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.193802 Oct 18 16:07:03.322928 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3056/6132] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:07:03.590167 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-a1fb96dc-cbeb-418e-801d-84d9e35d7040 req-26bd49e8-6510-478e-b807-a47d59e62292 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3", "tag": "d547c780-4b64-4efc-b3d3-72f8e7c8c8ad"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:07:03.602552 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:07:03.605285 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-a1fb96dc-cbeb-418e-801d-84d9e35d7040 req-26bd49e8-6510-478e-b807-a47d59e62292 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:03.606041 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-a1fb96dc-cbeb-418e-801d-84d9e35d7040 req-26bd49e8-6510-478e-b807-a47d59e62292 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:03.607804 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-a1fb96dc-cbeb-418e-801d-84d9e35d7040 req-26bd49e8-6510-478e-b807-a47d59e62292 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:03.622342 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=99 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:07:03.625901 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-a1fb96dc-cbeb-418e-801d-84d9e35d7040 req-26bd49e8-6510-478e-b807-a47d59e62292 service nova] Creating event network-changed:d547c780-4b64-4efc-b3d3-72f8e7c8c8ad for instance 4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3 on n-h1-853682-5 Oct 18 16:07:03.633029 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-a1fb96dc-cbeb-418e-801d-84d9e35d7040 req-26bd49e8-6510-478e-b807-a47d59e62292 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053513 Oct 18 16:07:03.634305 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3077/6133] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:07:11.387222 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1c23a74a-5b5a-4a81-b07d-51cd7dd4dad5 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Action: 'create', calling method: .version_select at 0x7f7c37bb4a60>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1427916836", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMeszBXjhsz5L7z068WYVpYRcHc/r73O0p/I3okXwvFZbfeWit2mhDMZ0iVPKn0orve8sZXSS7XJobblpI6OIXBqBy/6MuVVshzpBNBWId0CJSD5X5QLacRDNmzLVV7ZDw=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:07:11.392836 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=7 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:07:11.405249 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-1c23a74a-5b5a-4a81-b07d-51cd7dd4dad5 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Getting quotas for project a7b4ef10957e43b8a57a419fa0d6de0e. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:07:11.410403 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-1c23a74a-5b5a-4a81-b07d-51cd7dd4dad5 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Getting quotas for user 153a83de00ae4445a1efd17d70990630 and project a7b4ef10957e43b8a57a419fa0d6de0e. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:07:11.436289 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1c23a74a-5b5a-4a81-b07d-51cd7dd4dad5 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.214558 Oct 18 16:07:11.436912 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3057/6134] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Oct 18 16:07:11 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:07:17.760775 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:07:17.766928 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-57e2e314-b276-4635-a3c3-55ead108b92d tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-823957358", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "374a87bb-5378-458d-8475-9153a6efdf12"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1427916836", "security_groups": [{"name": "tempest-secgroup-smoke-1902988954"}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:07:17.896124 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-57e2e314-b276-4635-a3c3-55ead108b92d tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] validate_networks() for [('374a87bb-5378-458d-8475-9153a6efdf12', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 16:07:18.372342 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-57e2e314-b276-4635-a3c3-55ead108b92d tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:07:18.372792 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-57e2e314-b276-4635-a3c3-55ead108b92d tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:07:18.373334 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-57e2e314-b276-4635-a3c3-55ead108b92d tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:07:18.373924 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-57e2e314-b276-4635-a3c3-55ead108b92d tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:07:18.374393 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-57e2e314-b276-4635-a3c3-55ead108b92d tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:07:18.384137 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57e2e314-b276-4635-a3c3-55ead108b92d tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:18.384676 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57e2e314-b276-4635-a3c3-55ead108b92d tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:18.385157 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57e2e314-b276-4635-a3c3-55ead108b92d tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:18.385892 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57e2e314-b276-4635-a3c3-55ead108b92d tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:18.386996 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57e2e314-b276-4635-a3c3-55ead108b92d tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:18.387429 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57e2e314-b276-4635-a3c3-55ead108b92d tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:18.406383 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-57e2e314-b276-4635-a3c3-55ead108b92d tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Getting quotas for project a7b4ef10957e43b8a57a419fa0d6de0e. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:07:18.411801 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-57e2e314-b276-4635-a3c3-55ead108b92d tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Getting quotas for user 153a83de00ae4445a1efd17d70990630 and project a7b4ef10957e43b8a57a419fa0d6de0e. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:07:18.425542 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-57e2e314-b276-4635-a3c3-55ead108b92d tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:07:18.428077 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-57e2e314-b276-4635-a3c3-55ead108b92d tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:07:18.480384 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-57e2e314-b276-4635-a3c3-55ead108b92d tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.721352 Oct 18 16:07:18.481310 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3078/6135] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 16:07:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:07:18.490015 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=88 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:07:18.494111 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-78de9b3f-1d8b-4364-a4e1-8094dd444f6f tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:18.494857 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-78de9b3f-1d8b-4364-a4e1-8094dd444f6f tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:18.562752 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-78de9b3f-1d8b-4364-a4e1-8094dd444f6f tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:18.571169 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-78de9b3f-1d8b-4364-a4e1-8094dd444f6f tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e" status: 200 len: 1266 microversion: 2.1 time: 0.082591 Oct 18 16:07:18.579852 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3058/6136] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:18 2022] GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e => generated 1266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:07:19.595094 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4f538e52-5e77-47f8-9b6d-b1a9250cbd49 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:19.595837 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4f538e52-5e77-47f8-9b6d-b1a9250cbd49 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:19.603118 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4f538e52-5e77-47f8-9b6d-b1a9250cbd49 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:19.603641 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4f538e52-5e77-47f8-9b6d-b1a9250cbd49 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:19.604090 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4f538e52-5e77-47f8-9b6d-b1a9250cbd49 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:19.604793 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4f538e52-5e77-47f8-9b6d-b1a9250cbd49 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:19.605286 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4f538e52-5e77-47f8-9b6d-b1a9250cbd49 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:19.605723 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4f538e52-5e77-47f8-9b6d-b1a9250cbd49 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:19.679620 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4f538e52-5e77-47f8-9b6d-b1a9250cbd49 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:19.689917 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4f538e52-5e77-47f8-9b6d-b1a9250cbd49 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e" status: 200 len: 1318 microversion: 2.1 time: 0.099395 Oct 18 16:07:19.690540 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3079/6137] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:19 2022] GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e => generated 1318 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:07:20.727100 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8c324346-0263-4f60-9558-ef75f420bf45 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:20.729240 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8c324346-0263-4f60-9558-ef75f420bf45 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:20.746853 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c324346-0263-4f60-9558-ef75f420bf45 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:20.747892 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c324346-0263-4f60-9558-ef75f420bf45 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:20.748627 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c324346-0263-4f60-9558-ef75f420bf45 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:20.749879 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c324346-0263-4f60-9558-ef75f420bf45 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:20.750539 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c324346-0263-4f60-9558-ef75f420bf45 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:20.751153 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c324346-0263-4f60-9558-ef75f420bf45 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:21.175157 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8c324346-0263-4f60-9558-ef75f420bf45 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:21.183152 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8c324346-0263-4f60-9558-ef75f420bf45 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e" status: 200 len: 1392 microversion: 2.1 time: 0.471444 Oct 18 16:07:21.183738 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3059/6138] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:20 2022] GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e => generated 1392 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:21.797413 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-a79ab4dd-d442-46ac-938a-c811118efda5 req-c1b60f97-36b5-4c58-9d65-ab8eb1352ec1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e", "tag": "77ee77a9-de13-42b5-90c3-c13dc1e84544"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:07:21.807339 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-a79ab4dd-d442-46ac-938a-c811118efda5 req-c1b60f97-36b5-4c58-9d65-ab8eb1352ec1 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:21.808371 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-a79ab4dd-d442-46ac-938a-c811118efda5 req-c1b60f97-36b5-4c58-9d65-ab8eb1352ec1 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:21.809204 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-a79ab4dd-d442-46ac-938a-c811118efda5 req-c1b60f97-36b5-4c58-9d65-ab8eb1352ec1 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:21.820082 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-a79ab4dd-d442-46ac-938a-c811118efda5 req-c1b60f97-36b5-4c58-9d65-ab8eb1352ec1 service nova] Creating event network-changed:77ee77a9-de13-42b5-90c3-c13dc1e84544 for instance 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e on n-h1-853682-5 Oct 18 16:07:21.826599 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-a79ab4dd-d442-46ac-938a-c811118efda5 req-c1b60f97-36b5-4c58-9d65-ab8eb1352ec1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117477 Oct 18 16:07:21.827181 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3080/6139] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:07:22.207089 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c76e2ca5-f4e7-4a4b-ada8-1cc77caf3370 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:22.207703 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c76e2ca5-f4e7-4a4b-ada8-1cc77caf3370 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:22.215470 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c76e2ca5-f4e7-4a4b-ada8-1cc77caf3370 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:22.215951 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c76e2ca5-f4e7-4a4b-ada8-1cc77caf3370 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:22.216388 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c76e2ca5-f4e7-4a4b-ada8-1cc77caf3370 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:22.217109 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c76e2ca5-f4e7-4a4b-ada8-1cc77caf3370 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:22.217563 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c76e2ca5-f4e7-4a4b-ada8-1cc77caf3370 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:22.217987 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c76e2ca5-f4e7-4a4b-ada8-1cc77caf3370 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:22.360042 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c76e2ca5-f4e7-4a4b-ada8-1cc77caf3370 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:22.368640 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c76e2ca5-f4e7-4a4b-ada8-1cc77caf3370 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e" status: 200 len: 1392 microversion: 2.1 time: 0.165887 Oct 18 16:07:22.369693 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3060/6140] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:22 2022] GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:07:23.393817 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-188dfe2a-4483-4cf4-a3fd-03cf56426983 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:23.394527 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-188dfe2a-4483-4cf4-a3fd-03cf56426983 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:23.400891 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-188dfe2a-4483-4cf4-a3fd-03cf56426983 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:23.401424 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-188dfe2a-4483-4cf4-a3fd-03cf56426983 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:23.401866 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-188dfe2a-4483-4cf4-a3fd-03cf56426983 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:23.402558 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-188dfe2a-4483-4cf4-a3fd-03cf56426983 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:23.403017 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-188dfe2a-4483-4cf4-a3fd-03cf56426983 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:23.403451 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-188dfe2a-4483-4cf4-a3fd-03cf56426983 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:23.540665 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-188dfe2a-4483-4cf4-a3fd-03cf56426983 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:23.549606 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-188dfe2a-4483-4cf4-a3fd-03cf56426983 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e" status: 200 len: 1392 microversion: 2.1 time: 0.161021 Oct 18 16:07:23.550192 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3081/6141] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:23 2022] GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:07:24.573981 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a929c8ba-e847-4934-b19b-d9116590e352 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:24.574677 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a929c8ba-e847-4934-b19b-d9116590e352 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:24.582273 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a929c8ba-e847-4934-b19b-d9116590e352 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:24.582945 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a929c8ba-e847-4934-b19b-d9116590e352 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:24.583451 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a929c8ba-e847-4934-b19b-d9116590e352 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:24.584165 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a929c8ba-e847-4934-b19b-d9116590e352 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:24.584622 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a929c8ba-e847-4934-b19b-d9116590e352 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:24.585076 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a929c8ba-e847-4934-b19b-d9116590e352 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:24.803780 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a929c8ba-e847-4934-b19b-d9116590e352 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:24.812715 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a929c8ba-e847-4934-b19b-d9116590e352 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e" status: 200 len: 1392 microversion: 2.1 time: 0.243494 Oct 18 16:07:24.813568 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3061/6142] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:24 2022] GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e => generated 1392 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:07:25.559045 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-26c01099-d29e-4da9-a3c9-9dff4f53bb1b tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:07:25.561423 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-26c01099-d29e-4da9-a3c9-9dff4f53bb1b tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] [instance: 1b08e253-0e5f-45a9-90df-0ed99e02370f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:25.568155 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26c01099-d29e-4da9-a3c9-9dff4f53bb1b tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:25.568635 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26c01099-d29e-4da9-a3c9-9dff4f53bb1b tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:25.569175 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26c01099-d29e-4da9-a3c9-9dff4f53bb1b tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:25.569861 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26c01099-d29e-4da9-a3c9-9dff4f53bb1b tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:25.570315 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26c01099-d29e-4da9-a3c9-9dff4f53bb1b tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:25.570740 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-26c01099-d29e-4da9-a3c9-9dff4f53bb1b tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:25.620970 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-26c01099-d29e-4da9-a3c9-9dff4f53bb1b tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] 10.222.0.60 "POST /compute/v2.1/servers/1b08e253-0e5f-45a9-90df-0ed99e02370f/action" status: 200 len: 24567 microversion: 2.1 time: 0.065657 Oct 18 16:07:25.621629 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3082/6143] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:07:25 2022] POST /compute/v2.1/servers/1b08e253-0e5f-45a9-90df-0ed99e02370f/action => generated 24567 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:07:25.835640 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b7d1fc74-889c-4d9f-8502-d350c65d1354 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:25.836500 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b7d1fc74-889c-4d9f-8502-d350c65d1354 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:25.843496 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b7d1fc74-889c-4d9f-8502-d350c65d1354 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:25.843979 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b7d1fc74-889c-4d9f-8502-d350c65d1354 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:25.844412 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b7d1fc74-889c-4d9f-8502-d350c65d1354 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:25.845135 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b7d1fc74-889c-4d9f-8502-d350c65d1354 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:25.845589 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b7d1fc74-889c-4d9f-8502-d350c65d1354 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:25.846016 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b7d1fc74-889c-4d9f-8502-d350c65d1354 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:25.982452 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b7d1fc74-889c-4d9f-8502-d350c65d1354 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:25.990337 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b7d1fc74-889c-4d9f-8502-d350c65d1354 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e" status: 200 len: 1392 microversion: 2.1 time: 0.158671 Oct 18 16:07:25.990951 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3062/6144] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:25 2022] GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:26.478628 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-bd52f9f7-50cc-4fbc-ba69-8d87ba085c84 req-48506c95-8d88-4de5-ba36-7f3cbc10275e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e", "name": "network-vif-plugged", "status": "completed", "tag": "77ee77a9-de13-42b5-90c3-c13dc1e84544"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:07:26.489894 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-bd52f9f7-50cc-4fbc-ba69-8d87ba085c84 req-48506c95-8d88-4de5-ba36-7f3cbc10275e service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:26.490481 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-bd52f9f7-50cc-4fbc-ba69-8d87ba085c84 req-48506c95-8d88-4de5-ba36-7f3cbc10275e service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:26.490986 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-bd52f9f7-50cc-4fbc-ba69-8d87ba085c84 req-48506c95-8d88-4de5-ba36-7f3cbc10275e service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:26.503913 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-bd52f9f7-50cc-4fbc-ba69-8d87ba085c84 req-48506c95-8d88-4de5-ba36-7f3cbc10275e service nova] Creating event network-vif-plugged:77ee77a9-de13-42b5-90c3-c13dc1e84544 for instance 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e on n-h1-853682-5 Oct 18 16:07:26.508962 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-bd52f9f7-50cc-4fbc-ba69-8d87ba085c84 req-48506c95-8d88-4de5-ba36-7f3cbc10275e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034557 Oct 18 16:07:26.509567 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3083/6145] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:07:27.117123 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-db02aa7e-738a-42ca-9544-de9a4913e536 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:27.117736 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-db02aa7e-738a-42ca-9544-de9a4913e536 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:27.125130 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db02aa7e-738a-42ca-9544-de9a4913e536 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:27.125608 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db02aa7e-738a-42ca-9544-de9a4913e536 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:27.126040 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db02aa7e-738a-42ca-9544-de9a4913e536 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:27.126722 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db02aa7e-738a-42ca-9544-de9a4913e536 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:27.127171 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db02aa7e-738a-42ca-9544-de9a4913e536 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:27.127590 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db02aa7e-738a-42ca-9544-de9a4913e536 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:27.258971 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-db02aa7e-738a-42ca-9544-de9a4913e536 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:27.266542 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-db02aa7e-738a-42ca-9544-de9a4913e536 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e" status: 200 len: 1392 microversion: 2.1 time: 0.153331 Oct 18 16:07:27.267117 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3063/6146] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:27 2022] GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:28.289614 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e13e072f-7049-4dec-810d-0047d5271248 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:28.290985 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e13e072f-7049-4dec-810d-0047d5271248 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:28.299591 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e13e072f-7049-4dec-810d-0047d5271248 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:28.300084 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e13e072f-7049-4dec-810d-0047d5271248 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:28.300525 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e13e072f-7049-4dec-810d-0047d5271248 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:28.301783 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e13e072f-7049-4dec-810d-0047d5271248 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:28.302249 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e13e072f-7049-4dec-810d-0047d5271248 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:28.302685 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e13e072f-7049-4dec-810d-0047d5271248 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:28.394770 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:07:28.418721 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=6 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:07:28.507481 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e13e072f-7049-4dec-810d-0047d5271248 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:28.515707 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e13e072f-7049-4dec-810d-0047d5271248 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e" status: 200 len: 1564 microversion: 2.1 time: 0.230119 Oct 18 16:07:28.516302 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3084/6147] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:28 2022] GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e => generated 1564 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:28.539741 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3016854e-e290-444c-abac-7bfc07eceb8b tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:28.540602 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3016854e-e290-444c-abac-7bfc07eceb8b tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:28.548498 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3016854e-e290-444c-abac-7bfc07eceb8b tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:28.549256 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3016854e-e290-444c-abac-7bfc07eceb8b tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:28.549704 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3016854e-e290-444c-abac-7bfc07eceb8b tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:28.550413 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3016854e-e290-444c-abac-7bfc07eceb8b tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:28.550871 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3016854e-e290-444c-abac-7bfc07eceb8b tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:28.551299 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3016854e-e290-444c-abac-7bfc07eceb8b tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:28.570107 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:07:28.781974 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3016854e-e290-444c-abac-7bfc07eceb8b tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:28.790415 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3016854e-e290-444c-abac-7bfc07eceb8b tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e" status: 200 len: 1564 microversion: 2.1 time: 0.254770 Oct 18 16:07:28.791106 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3064/6148] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:28 2022] GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e => generated 1564 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:29.101764 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-482e8e15-bfbb-40da-bea3-3691c3f853a8 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:29.102285 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-482e8e15-bfbb-40da-bea3-3691c3f853a8 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] [instance: 4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:29.106640 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-f086db44-afb8-49ac-8de1-21710d7ca202 req-23353e8b-8cec-4f79-902a-1e37d3c88e07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3", "tag": "d547c780-4b64-4efc-b3d3-72f8e7c8c8ad"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:07:29.109063 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-482e8e15-bfbb-40da-bea3-3691c3f853a8 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:29.109767 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-482e8e15-bfbb-40da-bea3-3691c3f853a8 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:29.110401 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-482e8e15-bfbb-40da-bea3-3691c3f853a8 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:29.111301 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-482e8e15-bfbb-40da-bea3-3691c3f853a8 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:29.112104 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-482e8e15-bfbb-40da-bea3-3691c3f853a8 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:29.112716 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-482e8e15-bfbb-40da-bea3-3691c3f853a8 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:29.118584 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f086db44-afb8-49ac-8de1-21710d7ca202 req-23353e8b-8cec-4f79-902a-1e37d3c88e07 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:29.119452 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f086db44-afb8-49ac-8de1-21710d7ca202 req-23353e8b-8cec-4f79-902a-1e37d3c88e07 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:29.120110 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f086db44-afb8-49ac-8de1-21710d7ca202 req-23353e8b-8cec-4f79-902a-1e37d3c88e07 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:29.134378 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-f086db44-afb8-49ac-8de1-21710d7ca202 req-23353e8b-8cec-4f79-902a-1e37d3c88e07 service nova] Creating event network-changed:d547c780-4b64-4efc-b3d3-72f8e7c8c8ad for instance 4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3 on n-h1-853682-5 Oct 18 16:07:29.141129 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-f086db44-afb8-49ac-8de1-21710d7ca202 req-23353e8b-8cec-4f79-902a-1e37d3c88e07 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038810 Oct 18 16:07:29.142211 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3065/6149] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:07:29.146768 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-482e8e15-bfbb-40da-bea3-3691c3f853a8 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] [instance: 4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:07:29.253963 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-482e8e15-bfbb-40da-bea3-3691c3f853a8 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3" status: 204 len: 0 microversion: 2.1 time: 0.155886 Oct 18 16:07:29.257390 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3085/6150] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 16:07:29 2022] DELETE /compute/v2.1/servers/4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:07:29.266567 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-67f3e401-5193-46a0-8741-f2ef798625e1 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:29.267321 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-67f3e401-5193-46a0-8741-f2ef798625e1 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] [instance: 4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:29.274751 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67f3e401-5193-46a0-8741-f2ef798625e1 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:29.275241 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67f3e401-5193-46a0-8741-f2ef798625e1 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:29.275679 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67f3e401-5193-46a0-8741-f2ef798625e1 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:29.276382 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67f3e401-5193-46a0-8741-f2ef798625e1 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:29.276936 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67f3e401-5193-46a0-8741-f2ef798625e1 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:29.277358 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67f3e401-5193-46a0-8741-f2ef798625e1 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:29.471088 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-67f3e401-5193-46a0-8741-f2ef798625e1 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44950f9fc9e24dd5b10a90992214d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4683aba07d4f06a82c6c3da216eb88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:29.480800 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-67f3e401-5193-46a0-8741-f2ef798625e1 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3" status: 200 len: 1585 microversion: 2.1 time: 0.218467 Oct 18 16:07:29.481532 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3066/6151] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:29 2022] GET /compute/v2.1/servers/4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3 => generated 1585 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:30.519355 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6363ce24-54ff-4b7d-b3de-1e2aa977f9b9 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:30.520675 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6363ce24-54ff-4b7d-b3de-1e2aa977f9b9 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] [instance: 4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:30.537320 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6363ce24-54ff-4b7d-b3de-1e2aa977f9b9 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:30.538951 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6363ce24-54ff-4b7d-b3de-1e2aa977f9b9 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:30.539928 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6363ce24-54ff-4b7d-b3de-1e2aa977f9b9 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:30.541855 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6363ce24-54ff-4b7d-b3de-1e2aa977f9b9 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:30.542642 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6363ce24-54ff-4b7d-b3de-1e2aa977f9b9 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:30.543407 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6363ce24-54ff-4b7d-b3de-1e2aa977f9b9 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:30.704518 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4c0a3df2-3fcd-4193-a690-3d3120fc407e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:30.705201 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4c0a3df2-3fcd-4193-a690-3d3120fc407e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:30.715025 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c0a3df2-3fcd-4193-a690-3d3120fc407e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:30.715863 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c0a3df2-3fcd-4193-a690-3d3120fc407e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:30.716570 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c0a3df2-3fcd-4193-a690-3d3120fc407e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:30.717737 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c0a3df2-3fcd-4193-a690-3d3120fc407e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:30.718274 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c0a3df2-3fcd-4193-a690-3d3120fc407e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:30.718801 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c0a3df2-3fcd-4193-a690-3d3120fc407e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:30.720693 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6363ce24-54ff-4b7d-b3de-1e2aa977f9b9 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44950f9fc9e24dd5b10a90992214d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4683aba07d4f06a82c6c3da216eb88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:30.729277 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6363ce24-54ff-4b7d-b3de-1e2aa977f9b9 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3" status: 200 len: 1585 microversion: 2.1 time: 0.226533 Oct 18 16:07:30.730293 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3086/6152] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:30 2022] GET /compute/v2.1/servers/4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3 => generated 1585 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:30.741434 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-de6ad26a-6246-4d24-bb32-02940becc83d req-9ae66e78-c796-4f57-b9db-9d10bd078918 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e", "tag": "77ee77a9-de13-42b5-90c3-c13dc1e84544"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:07:30.754236 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-de6ad26a-6246-4d24-bb32-02940becc83d req-9ae66e78-c796-4f57-b9db-9d10bd078918 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:30.754722 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-de6ad26a-6246-4d24-bb32-02940becc83d req-9ae66e78-c796-4f57-b9db-9d10bd078918 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:30.755261 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-de6ad26a-6246-4d24-bb32-02940becc83d req-9ae66e78-c796-4f57-b9db-9d10bd078918 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:30.769770 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-de6ad26a-6246-4d24-bb32-02940becc83d req-9ae66e78-c796-4f57-b9db-9d10bd078918 service nova] Creating event network-changed:77ee77a9-de13-42b5-90c3-c13dc1e84544 for instance 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e on n-h1-853682-5 Oct 18 16:07:30.775461 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-de6ad26a-6246-4d24-bb32-02940becc83d req-9ae66e78-c796-4f57-b9db-9d10bd078918 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043886 Oct 18 16:07:30.776385 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3087/6153] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:07:30.933650 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4c0a3df2-3fcd-4193-a690-3d3120fc407e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:30.941475 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4c0a3df2-3fcd-4193-a690-3d3120fc407e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e" status: 200 len: 1564 microversion: 2.1 time: 0.246428 Oct 18 16:07:30.942066 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3067/6154] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:30 2022] GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e => generated 1564 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:31.756486 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-83a4caea-874b-49b2-9ad2-d9ac73dfe1f0 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:31.757447 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-83a4caea-874b-49b2-9ad2-d9ac73dfe1f0 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] [instance: 4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:31.768542 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-83a4caea-874b-49b2-9ad2-d9ac73dfe1f0 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:31.769244 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-83a4caea-874b-49b2-9ad2-d9ac73dfe1f0 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:31.769750 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-83a4caea-874b-49b2-9ad2-d9ac73dfe1f0 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:31.770633 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-83a4caea-874b-49b2-9ad2-d9ac73dfe1f0 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:31.771105 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-83a4caea-874b-49b2-9ad2-d9ac73dfe1f0 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:31.771536 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-83a4caea-874b-49b2-9ad2-d9ac73dfe1f0 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:31.931120 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-83a4caea-874b-49b2-9ad2-d9ac73dfe1f0 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44950f9fc9e24dd5b10a90992214d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4683aba07d4f06a82c6c3da216eb88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:31.949827 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-83a4caea-874b-49b2-9ad2-d9ac73dfe1f0 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3" status: 200 len: 1466 microversion: 2.1 time: 0.199496 Oct 18 16:07:31.950431 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3088/6155] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:31 2022] GET /compute/v2.1/servers/4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3 => generated 1466 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:32.791161 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-6b6f4628-0c85-4455-8ce5-3822490d5abc req-baec3bbc-b903-48b0-ac8d-8539494605da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3", "name": "network-vif-deleted", "tag": "d547c780-4b64-4efc-b3d3-72f8e7c8c8ad"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:07:32.802751 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6b6f4628-0c85-4455-8ce5-3822490d5abc req-baec3bbc-b903-48b0-ac8d-8539494605da service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:32.803215 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6b6f4628-0c85-4455-8ce5-3822490d5abc req-baec3bbc-b903-48b0-ac8d-8539494605da service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:32.803654 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6b6f4628-0c85-4455-8ce5-3822490d5abc req-baec3bbc-b903-48b0-ac8d-8539494605da service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:32.816864 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-6b6f4628-0c85-4455-8ce5-3822490d5abc req-baec3bbc-b903-48b0-ac8d-8539494605da service nova] Creating event network-vif-deleted:d547c780-4b64-4efc-b3d3-72f8e7c8c8ad for instance 4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3 on n-h1-853682-5 Oct 18 16:07:32.821945 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-6b6f4628-0c85-4455-8ce5-3822490d5abc req-baec3bbc-b903-48b0-ac8d-8539494605da service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034483 Oct 18 16:07:32.822578 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3068/6156] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:07:32.975505 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c52b8440-48ef-41c4-84c9-dcf7b6f7209f tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:32.976735 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c52b8440-48ef-41c4-84c9-dcf7b6f7209f tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] [instance: 4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:32.983742 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c52b8440-48ef-41c4-84c9-dcf7b6f7209f tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:32.984232 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c52b8440-48ef-41c4-84c9-dcf7b6f7209f tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:32.984671 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c52b8440-48ef-41c4-84c9-dcf7b6f7209f tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:32.985404 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c52b8440-48ef-41c4-84c9-dcf7b6f7209f tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:32.985864 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c52b8440-48ef-41c4-84c9-dcf7b6f7209f tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:32.986296 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c52b8440-48ef-41c4-84c9-dcf7b6f7209f tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:33.050453 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c52b8440-48ef-41c4-84c9-dcf7b6f7209f tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44950f9fc9e24dd5b10a90992214d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4683aba07d4f06a82c6c3da216eb88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:33.059063 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c52b8440-48ef-41c4-84c9-dcf7b6f7209f tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3" status: 200 len: 1230 microversion: 2.1 time: 0.087578 Oct 18 16:07:33.059648 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3089/6157] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:32 2022] GET /compute/v2.1/servers/4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3 => generated 1230 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:34.084864 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3fbe85a0-be2d-4785-95e1-2b5a1d9f0152 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:34.085576 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3fbe85a0-be2d-4785-95e1-2b5a1d9f0152 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] [instance: 4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:34.091910 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3fbe85a0-be2d-4785-95e1-2b5a1d9f0152 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:34.092399 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3fbe85a0-be2d-4785-95e1-2b5a1d9f0152 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:34.092859 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3fbe85a0-be2d-4785-95e1-2b5a1d9f0152 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:34.093563 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3fbe85a0-be2d-4785-95e1-2b5a1d9f0152 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:34.094016 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3fbe85a0-be2d-4785-95e1-2b5a1d9f0152 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:34.094442 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3fbe85a0-be2d-4785-95e1-2b5a1d9f0152 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:34.157098 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3fbe85a0-be2d-4785-95e1-2b5a1d9f0152 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44950f9fc9e24dd5b10a90992214d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4683aba07d4f06a82c6c3da216eb88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:34.164966 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3fbe85a0-be2d-4785-95e1-2b5a1d9f0152 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3" status: 200 len: 1230 microversion: 2.1 time: 0.085254 Oct 18 16:07:34.165545 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3069/6158] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:34 2022] GET /compute/v2.1/servers/4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3 => generated 1230 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:35.189664 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a3b8052d-f08e-4af1-93ef-9562d0c3b256 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:35.190306 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a3b8052d-f08e-4af1-93ef-9562d0c3b256 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] [instance: 4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:35.197444 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a3b8052d-f08e-4af1-93ef-9562d0c3b256 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:35.197943 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a3b8052d-f08e-4af1-93ef-9562d0c3b256 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:35.199017 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a3b8052d-f08e-4af1-93ef-9562d0c3b256 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:35.199807 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a3b8052d-f08e-4af1-93ef-9562d0c3b256 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:35.200273 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a3b8052d-f08e-4af1-93ef-9562d0c3b256 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:35.200704 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a3b8052d-f08e-4af1-93ef-9562d0c3b256 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:35.266346 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a3b8052d-f08e-4af1-93ef-9562d0c3b256 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44950f9fc9e24dd5b10a90992214d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4683aba07d4f06a82c6c3da216eb88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:35.274537 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a3b8052d-f08e-4af1-93ef-9562d0c3b256 tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3" status: 200 len: 1230 microversion: 2.1 time: 0.089143 Oct 18 16:07:35.275123 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3090/6159] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:35 2022] GET /compute/v2.1/servers/4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3 => generated 1230 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:36.297097 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b8ed41ae-3a66-4224-b1c0-acc3cd73fa9f tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:36.297987 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b8ed41ae-3a66-4224-b1c0-acc3cd73fa9f tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] [instance: 4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:36.304393 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8ed41ae-3a66-4224-b1c0-acc3cd73fa9f tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:36.304920 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8ed41ae-3a66-4224-b1c0-acc3cd73fa9f tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:36.305362 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8ed41ae-3a66-4224-b1c0-acc3cd73fa9f tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:36.306060 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8ed41ae-3a66-4224-b1c0-acc3cd73fa9f tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:36.306521 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8ed41ae-3a66-4224-b1c0-acc3cd73fa9f tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:36.306952 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8ed41ae-3a66-4224-b1c0-acc3cd73fa9f tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:36.337443 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8ed41ae-3a66-4224-b1c0-acc3cd73fa9f tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:36.337932 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8ed41ae-3a66-4224-b1c0-acc3cd73fa9f tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:36.338369 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8ed41ae-3a66-4224-b1c0-acc3cd73fa9f tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:36.338851 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-b8ed41ae-3a66-4224-b1c0-acc3cd73fa9f tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lazy-loading 'fault' on Instance uuid 4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:07:36.383373 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b8ed41ae-3a66-4224-b1c0-acc3cd73fa9f tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44950f9fc9e24dd5b10a90992214d89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4683aba07d4f06a82c6c3da216eb88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:36.391267 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b8ed41ae-3a66-4224-b1c0-acc3cd73fa9f tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3" status: 200 len: 1235 microversion: 2.1 time: 0.098317 Oct 18 16:07:36.391851 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3070/6160] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:36 2022] GET /compute/v2.1/servers/4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3 => generated 1235 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:37.415575 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3f900196-1d56-4cdf-ab81-1e8f856bc0eb tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:37.416210 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3f900196-1d56-4cdf-ab81-1e8f856bc0eb tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] [instance: 4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:37.424503 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3f900196-1d56-4cdf-ab81-1e8f856bc0eb tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:37.425034 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3f900196-1d56-4cdf-ab81-1e8f856bc0eb tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:37.425478 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3f900196-1d56-4cdf-ab81-1e8f856bc0eb tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:37.426194 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3f900196-1d56-4cdf-ab81-1e8f856bc0eb tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:37.426660 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3f900196-1d56-4cdf-ab81-1e8f856bc0eb tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:37.427086 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3f900196-1d56-4cdf-ab81-1e8f856bc0eb tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:37.441817 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-3f900196-1d56-4cdf-ab81-1e8f856bc0eb tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] HTTP exception thrown: Instance 4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3 could not be found. Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3f900196-1d56-4cdf-ab81-1e8f856bc0eb tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Request method failure captured: Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3 HTTP/1.1 Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTs53f_z6_1BwM0lTgvgwFz8tBygK0iqCbEgn4klRTeF-SxAkoS-6G7lU3G3kSAM3XhQN-ICbs4T_ZDa1U7R_gJ6U-0ysWma2mPTF8MgAP1_e2n4COI4yaVYd4XhzRx47ol1_Dh7f3Ib2wWJjq6IFg6D--UecmkbA4Hnt0kQJwOhS2LA Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: cd4683aba07d4f06a82c6c3da216eb88 Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-TestVolumeBackupRestore-376457243 Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cd4683aba07d4f06a82c6c3da216eb88"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cd4683aba07d4f06a82c6c3da216eb88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cd4683aba07d4f06a82c6c3da216eb88"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cd4683aba07d4f06a82c6c3da216eb88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-TestVolumeBackupRestore-376457243 Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: cd4683aba07d4f06a82c6c3da216eb88 Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-TestVolumeBackupRestore-376457243 Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-TestVolumeBackupRestore-376457243-project Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 44950f9fc9e24dd5b10a90992214d89f Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-TestVolumeBackupRestore-376457243-project Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3 could not be found. Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3'} Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3 could not be found. Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3 could not be found. Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:07:37.443462 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:07:37.448492 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:07:37.448492 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:07:37.448492 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:07:37.448492 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:07:37.448492 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:07:37.448492 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3 could not be found. Oct 18 16:07:37.448492 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:07:37.448492 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3f900196-1d56-4cdf-ab81-1e8f856bc0eb tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Returning 404 to user: Instance 4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:07:37.448492 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3f900196-1d56-4cdf-ab81-1e8f856bc0eb tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] 10.222.0.60 "GET /compute/v2.1/servers/4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3" status: 404 len: 111 microversion: 2.1 time: 0.033423 Oct 18 16:07:37.448492 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3091/6161] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:37 2022] GET /compute/v2.1/servers/4eb0b842-e9d4-4ddb-9d8f-313b832f0ff3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:07:37.631174 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2b782100-3c9d-4b7e-bf00-f53bdd0db92e tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] Calling method '.version_select at 0x7f7c37bb8160>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:37.658189 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2b782100-3c9d-4b7e-bf00-f53bdd0db92e tempest-TestVolumeBackupRestore-376457243 tempest-TestVolumeBackupRestore-376457243-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1775574434" status: 202 len: 0 microversion: 2.1 time: 0.035159 Oct 18 16:07:37.660112 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3071/6162] 10.222.0.60 () {58 vars in 1269 bytes} [Tue Oct 18 16:07:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1775574434 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 16:07:38.751784 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2e98036d-b072-4609-a412-3b6b1a83f527 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Action: 'create', calling method: .version_select at 0x7f7c3d025e50>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1408137372", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMf6V+JPVPFW1FW6i/oCw+3MfeINv8MCCdJaSRbHHs9WLmRoQJRxhKJogmMCOwmU/XxBbbXp/+yEO40C2IK4GqUnwYdn1ihzlm4Ybm3LGvYhjYcVo3Iz+fi0gYy0qGkGHw=="}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:07:38.797326 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-2e98036d-b072-4609-a412-3b6b1a83f527 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Getting quotas for project 10a35c6e5d7d4e06afe028378c708ba6. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:07:38.804690 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-2e98036d-b072-4609-a412-3b6b1a83f527 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Getting quotas for user f4146336121e4788bbdead3c9dee1c5f and project 10a35c6e5d7d4e06afe028378c708ba6. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:07:38.842059 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2e98036d-b072-4609-a412-3b6b1a83f527 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.094254 Oct 18 16:07:38.846071 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3092/6163] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Oct 18 16:07:38 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:07:40.802935 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-df239ca8-0d7d-4a26-8668-ca2763feb176 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1532063382", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "c8948570-bd0e-4323-8a28-1a385762ccfb"}], "key_name": "tempest-TestNetworkBasicOps-1408137372", "security_groups": [{"name": "tempest-secgroup-smoke-1434967009"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:07:40.990747 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-df239ca8-0d7d-4a26-8668-ca2763feb176 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] validate_networks() for [('c8948570-bd0e-4323-8a28-1a385762ccfb', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 16:07:41.646669 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-df239ca8-0d7d-4a26-8668-ca2763feb176 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:07:41.647534 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-df239ca8-0d7d-4a26-8668-ca2763feb176 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:07:41.648057 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-df239ca8-0d7d-4a26-8668-ca2763feb176 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:07:41.648689 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-df239ca8-0d7d-4a26-8668-ca2763feb176 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:07:41.649148 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-df239ca8-0d7d-4a26-8668-ca2763feb176 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:07:41.652558 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:07:41.668466 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df239ca8-0d7d-4a26-8668-ca2763feb176 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:41.677171 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df239ca8-0d7d-4a26-8668-ca2763feb176 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:41.677702 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df239ca8-0d7d-4a26-8668-ca2763feb176 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:41.678597 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df239ca8-0d7d-4a26-8668-ca2763feb176 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:41.679157 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df239ca8-0d7d-4a26-8668-ca2763feb176 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:41.679812 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df239ca8-0d7d-4a26-8668-ca2763feb176 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:41.722263 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-df239ca8-0d7d-4a26-8668-ca2763feb176 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Getting quotas for project 10a35c6e5d7d4e06afe028378c708ba6. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:07:41.730793 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-df239ca8-0d7d-4a26-8668-ca2763feb176 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Getting quotas for user f4146336121e4788bbdead3c9dee1c5f and project 10a35c6e5d7d4e06afe028378c708ba6. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:07:41.773402 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-df239ca8-0d7d-4a26-8668-ca2763feb176 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:07:41.777831 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-df239ca8-0d7d-4a26-8668-ca2763feb176 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] [instance: 0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:07:41.881331 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-df239ca8-0d7d-4a26-8668-ca2763feb176 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.083638 Oct 18 16:07:41.882724 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3072/6164] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 16:07:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 1086 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:07:41.894815 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c3358305-7cff-485f-8cba-1cde3647cdac tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:41.895679 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c3358305-7cff-485f-8cba-1cde3647cdac tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] [instance: 0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:41.989809 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c3358305-7cff-485f-8cba-1cde3647cdac tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4146336121e4788bbdead3c9dee1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a35c6e5d7d4e06afe028378c708ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:41.997805 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c3358305-7cff-485f-8cba-1cde3647cdac tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] 10.222.0.60 "GET /compute/v2.1/servers/0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9" status: 200 len: 1249 microversion: 2.1 time: 0.107981 Oct 18 16:07:41.999384 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3093/6165] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:41 2022] GET /compute/v2.1/servers/0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9 => generated 1249 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:07:43.026281 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dcc5f636-d231-441c-b3db-648092eb1b4e tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:43.027490 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dcc5f636-d231-441c-b3db-648092eb1b4e tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] [instance: 0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:43.048914 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dcc5f636-d231-441c-b3db-648092eb1b4e tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:43.049352 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dcc5f636-d231-441c-b3db-648092eb1b4e tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:43.049792 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dcc5f636-d231-441c-b3db-648092eb1b4e tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:43.050522 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dcc5f636-d231-441c-b3db-648092eb1b4e tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:43.050975 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dcc5f636-d231-441c-b3db-648092eb1b4e tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:43.051444 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dcc5f636-d231-441c-b3db-648092eb1b4e tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:43.127035 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dcc5f636-d231-441c-b3db-648092eb1b4e tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4146336121e4788bbdead3c9dee1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a35c6e5d7d4e06afe028378c708ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:43.135005 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dcc5f636-d231-441c-b3db-648092eb1b4e tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] 10.222.0.60 "GET /compute/v2.1/servers/0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9" status: 200 len: 1301 microversion: 2.1 time: 0.113051 Oct 18 16:07:43.135587 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3073/6166] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:43 2022] GET /compute/v2.1/servers/0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9 => generated 1301 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:44.165014 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-73a443db-c35a-4b27-8742-c2782ec9c7a1 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:44.166642 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-73a443db-c35a-4b27-8742-c2782ec9c7a1 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] [instance: 0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:44.179010 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-73a443db-c35a-4b27-8742-c2782ec9c7a1 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:44.179592 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-73a443db-c35a-4b27-8742-c2782ec9c7a1 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:44.180020 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-73a443db-c35a-4b27-8742-c2782ec9c7a1 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:44.180790 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-73a443db-c35a-4b27-8742-c2782ec9c7a1 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:44.181270 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-73a443db-c35a-4b27-8742-c2782ec9c7a1 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:44.181724 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-73a443db-c35a-4b27-8742-c2782ec9c7a1 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:44.480637 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-73a443db-c35a-4b27-8742-c2782ec9c7a1 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4146336121e4788bbdead3c9dee1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a35c6e5d7d4e06afe028378c708ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:44.489001 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-73a443db-c35a-4b27-8742-c2782ec9c7a1 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] 10.222.0.60 "GET /compute/v2.1/servers/0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9" status: 200 len: 1375 microversion: 2.1 time: 0.333176 Oct 18 16:07:44.489594 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3094/6167] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:44 2022] GET /compute/v2.1/servers/0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9 => generated 1375 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:44.918242 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-99156a8e-181c-4af8-a2e4-6d757d21a6c0 req-f93cd94e-cd05-46f6-9ea9-859e8fc97f65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9", "tag": "fabc1411-9ae9-4216-b05d-40d5ecb52256"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:07:44.943096 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-99156a8e-181c-4af8-a2e4-6d757d21a6c0 req-f93cd94e-cd05-46f6-9ea9-859e8fc97f65 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:44.945321 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-99156a8e-181c-4af8-a2e4-6d757d21a6c0 req-f93cd94e-cd05-46f6-9ea9-859e8fc97f65 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:44.946667 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-99156a8e-181c-4af8-a2e4-6d757d21a6c0 req-f93cd94e-cd05-46f6-9ea9-859e8fc97f65 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:44.962302 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-99156a8e-181c-4af8-a2e4-6d757d21a6c0 req-f93cd94e-cd05-46f6-9ea9-859e8fc97f65 service nova] Creating event network-changed:fabc1411-9ae9-4216-b05d-40d5ecb52256 for instance 0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9 on n-h1-853682-5 Oct 18 16:07:44.968685 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-99156a8e-181c-4af8-a2e4-6d757d21a6c0 req-f93cd94e-cd05-46f6-9ea9-859e8fc97f65 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058336 Oct 18 16:07:44.970039 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3074/6168] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:07:45.515487 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ceaa3012-7294-4097-8ad4-d82330db843f tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:45.516909 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ceaa3012-7294-4097-8ad4-d82330db843f tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] [instance: 0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:45.524800 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ceaa3012-7294-4097-8ad4-d82330db843f tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:45.525589 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ceaa3012-7294-4097-8ad4-d82330db843f tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:45.526035 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ceaa3012-7294-4097-8ad4-d82330db843f tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:45.528607 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ceaa3012-7294-4097-8ad4-d82330db843f tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:45.530371 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ceaa3012-7294-4097-8ad4-d82330db843f tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:45.530831 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ceaa3012-7294-4097-8ad4-d82330db843f tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:45.763478 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ceaa3012-7294-4097-8ad4-d82330db843f tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4146336121e4788bbdead3c9dee1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a35c6e5d7d4e06afe028378c708ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:45.775455 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ceaa3012-7294-4097-8ad4-d82330db843f tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] 10.222.0.60 "GET /compute/v2.1/servers/0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9" status: 200 len: 1375 microversion: 2.1 time: 0.264824 Oct 18 16:07:45.785183 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3095/6169] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:45 2022] GET /compute/v2.1/servers/0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9 => generated 1375 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:46.800627 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9e2d1cbc-aa23-49da-bf46-2715e1aa9a80 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:46.801372 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9e2d1cbc-aa23-49da-bf46-2715e1aa9a80 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] [instance: 0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:46.807862 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e2d1cbc-aa23-49da-bf46-2715e1aa9a80 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:46.808352 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e2d1cbc-aa23-49da-bf46-2715e1aa9a80 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:46.808794 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e2d1cbc-aa23-49da-bf46-2715e1aa9a80 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:46.809707 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e2d1cbc-aa23-49da-bf46-2715e1aa9a80 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:46.810334 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e2d1cbc-aa23-49da-bf46-2715e1aa9a80 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:46.810916 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e2d1cbc-aa23-49da-bf46-2715e1aa9a80 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:47.021391 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9e2d1cbc-aa23-49da-bf46-2715e1aa9a80 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4146336121e4788bbdead3c9dee1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a35c6e5d7d4e06afe028378c708ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:47.035359 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9e2d1cbc-aa23-49da-bf46-2715e1aa9a80 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] 10.222.0.60 "GET /compute/v2.1/servers/0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9" status: 200 len: 1375 microversion: 2.1 time: 0.239928 Oct 18 16:07:47.036853 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3075/6170] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:46 2022] GET /compute/v2.1/servers/0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9 => generated 1375 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:48.060762 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7bdc95d9-a637-4e79-9043-599c025520e7 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:48.061552 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7bdc95d9-a637-4e79-9043-599c025520e7 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] [instance: 0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:48.066429 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:07:48.070712 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7bdc95d9-a637-4e79-9043-599c025520e7 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:48.071313 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7bdc95d9-a637-4e79-9043-599c025520e7 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:48.071891 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7bdc95d9-a637-4e79-9043-599c025520e7 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:48.072703 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7bdc95d9-a637-4e79-9043-599c025520e7 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:48.073347 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7bdc95d9-a637-4e79-9043-599c025520e7 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:48.073882 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7bdc95d9-a637-4e79-9043-599c025520e7 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:48.079549 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:07:48.272188 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7bdc95d9-a637-4e79-9043-599c025520e7 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4146336121e4788bbdead3c9dee1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a35c6e5d7d4e06afe028378c708ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:48.280576 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7bdc95d9-a637-4e79-9043-599c025520e7 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] 10.222.0.60 "GET /compute/v2.1/servers/0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9" status: 200 len: 1375 microversion: 2.1 time: 0.224028 Oct 18 16:07:48.281206 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3096/6171] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:48 2022] GET /compute/v2.1/servers/0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9 => generated 1375 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:49.307334 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5871cbaa-0340-4645-ac74-cc8801096ae1 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:49.309718 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5871cbaa-0340-4645-ac74-cc8801096ae1 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] [instance: 0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:49.317089 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5871cbaa-0340-4645-ac74-cc8801096ae1 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:49.317888 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5871cbaa-0340-4645-ac74-cc8801096ae1 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:49.318539 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5871cbaa-0340-4645-ac74-cc8801096ae1 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:49.319493 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5871cbaa-0340-4645-ac74-cc8801096ae1 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:49.320161 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5871cbaa-0340-4645-ac74-cc8801096ae1 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:49.320795 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5871cbaa-0340-4645-ac74-cc8801096ae1 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:49.332787 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=83 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:07:49.536723 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5871cbaa-0340-4645-ac74-cc8801096ae1 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4146336121e4788bbdead3c9dee1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a35c6e5d7d4e06afe028378c708ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:49.545933 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5871cbaa-0340-4645-ac74-cc8801096ae1 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] 10.222.0.60 "GET /compute/v2.1/servers/0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9" status: 200 len: 1375 microversion: 2.1 time: 0.245923 Oct 18 16:07:49.564620 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3076/6172] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:49 2022] GET /compute/v2.1/servers/0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9 => generated 1375 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:50.571667 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fd484084-0b44-49bf-adfb-4b3c4d81e7fe tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:50.572644 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-fd484084-0b44-49bf-adfb-4b3c4d81e7fe tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] [instance: 0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:50.581613 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fd484084-0b44-49bf-adfb-4b3c4d81e7fe tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:50.582680 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fd484084-0b44-49bf-adfb-4b3c4d81e7fe tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:50.583368 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fd484084-0b44-49bf-adfb-4b3c4d81e7fe tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:50.584265 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fd484084-0b44-49bf-adfb-4b3c4d81e7fe tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:50.584931 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fd484084-0b44-49bf-adfb-4b3c4d81e7fe tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:50.585581 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fd484084-0b44-49bf-adfb-4b3c4d81e7fe tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:50.747375 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-fd484084-0b44-49bf-adfb-4b3c4d81e7fe tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4146336121e4788bbdead3c9dee1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a35c6e5d7d4e06afe028378c708ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:50.756560 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fd484084-0b44-49bf-adfb-4b3c4d81e7fe tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] 10.222.0.60 "GET /compute/v2.1/servers/0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9" status: 200 len: 1375 microversion: 2.1 time: 0.188845 Oct 18 16:07:50.757636 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3097/6173] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:50 2022] GET /compute/v2.1/servers/0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9 => generated 1375 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:51.087261 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-7a863e3e-fdfd-42e9-9a1b-f83c75b675c0 req-ca78a76c-394c-4026-be83-4c3389d4d216 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9", "name": "network-vif-plugged", "status": "completed", "tag": "fabc1411-9ae9-4216-b05d-40d5ecb52256"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:07:51.103107 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7a863e3e-fdfd-42e9-9a1b-f83c75b675c0 req-ca78a76c-394c-4026-be83-4c3389d4d216 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:51.103611 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7a863e3e-fdfd-42e9-9a1b-f83c75b675c0 req-ca78a76c-394c-4026-be83-4c3389d4d216 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:51.104057 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7a863e3e-fdfd-42e9-9a1b-f83c75b675c0 req-ca78a76c-394c-4026-be83-4c3389d4d216 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:51.122549 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-7a863e3e-fdfd-42e9-9a1b-f83c75b675c0 req-ca78a76c-394c-4026-be83-4c3389d4d216 service nova] Creating event network-vif-plugged:fabc1411-9ae9-4216-b05d-40d5ecb52256 for instance 0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9 on n-h1-853682-5 Oct 18 16:07:51.129891 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-7a863e3e-fdfd-42e9-9a1b-f83c75b675c0 req-ca78a76c-394c-4026-be83-4c3389d4d216 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151092 Oct 18 16:07:51.130797 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3077/6174] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:07:51.780307 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-89f86a4f-1d7f-4b8c-b4c0-8842dbbb21dd tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:51.781057 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-89f86a4f-1d7f-4b8c-b4c0-8842dbbb21dd tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] [instance: 0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:51.787798 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-89f86a4f-1d7f-4b8c-b4c0-8842dbbb21dd tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:51.788282 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-89f86a4f-1d7f-4b8c-b4c0-8842dbbb21dd tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:51.788719 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-89f86a4f-1d7f-4b8c-b4c0-8842dbbb21dd tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:51.789439 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-89f86a4f-1d7f-4b8c-b4c0-8842dbbb21dd tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:51.789904 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-89f86a4f-1d7f-4b8c-b4c0-8842dbbb21dd tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:51.790330 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-89f86a4f-1d7f-4b8c-b4c0-8842dbbb21dd tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:51.953065 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-89f86a4f-1d7f-4b8c-b4c0-8842dbbb21dd tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4146336121e4788bbdead3c9dee1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a35c6e5d7d4e06afe028378c708ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:51.962970 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-89f86a4f-1d7f-4b8c-b4c0-8842dbbb21dd tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] 10.222.0.60 "GET /compute/v2.1/servers/0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9" status: 200 len: 1375 microversion: 2.1 time: 0.186753 Oct 18 16:07:51.978936 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3098/6175] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:51 2022] GET /compute/v2.1/servers/0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9 => generated 1375 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:52.986634 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f8bcd893-6492-4f43-92fc-5b092b1615b1 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:52.987246 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f8bcd893-6492-4f43-92fc-5b092b1615b1 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] [instance: 0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:52.989296 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:07:52.989998 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:07:52.996875 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8bcd893-6492-4f43-92fc-5b092b1615b1 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:52.997364 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8bcd893-6492-4f43-92fc-5b092b1615b1 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:52.997798 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8bcd893-6492-4f43-92fc-5b092b1615b1 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:52.998515 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8bcd893-6492-4f43-92fc-5b092b1615b1 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:52.998972 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8bcd893-6492-4f43-92fc-5b092b1615b1 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:52.999396 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8bcd893-6492-4f43-92fc-5b092b1615b1 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:53.134551 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f8bcd893-6492-4f43-92fc-5b092b1615b1 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4146336121e4788bbdead3c9dee1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a35c6e5d7d4e06afe028378c708ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:53.143129 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f8bcd893-6492-4f43-92fc-5b092b1615b1 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] 10.222.0.60 "GET /compute/v2.1/servers/0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9" status: 200 len: 1548 microversion: 2.1 time: 0.160831 Oct 18 16:07:53.144021 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3078/6176] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:52 2022] GET /compute/v2.1/servers/0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9 => generated 1548 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:07:53.165161 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-01cfdf70-0554-4d95-b3b7-b4d270f785dc tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:07:53.165782 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-01cfdf70-0554-4d95-b3b7-b4d270f785dc tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] [instance: 0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:07:53.167632 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=6 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:07:53.174119 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-01cfdf70-0554-4d95-b3b7-b4d270f785dc tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:53.174605 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-01cfdf70-0554-4d95-b3b7-b4d270f785dc tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:53.175044 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-01cfdf70-0554-4d95-b3b7-b4d270f785dc tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:53.175738 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-01cfdf70-0554-4d95-b3b7-b4d270f785dc tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:07:53.176195 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-01cfdf70-0554-4d95-b3b7-b4d270f785dc tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:07:53.176622 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-01cfdf70-0554-4d95-b3b7-b4d270f785dc tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:07:53.309641 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-01cfdf70-0554-4d95-b3b7-b4d270f785dc tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4146336121e4788bbdead3c9dee1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a35c6e5d7d4e06afe028378c708ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:07:53.317341 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-01cfdf70-0554-4d95-b3b7-b4d270f785dc tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] 10.222.0.60 "GET /compute/v2.1/servers/0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9" status: 200 len: 1548 microversion: 2.1 time: 0.156026 Oct 18 16:07:53.317919 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3099/6177] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:07:53 2022] GET /compute/v2.1/servers/0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9 => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:06.272555 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3e9dc23a-6854-469c-adb9-7d80819b832b tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:08:06.274813 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3e9dc23a-6854-469c-adb9-7d80819b832b tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:06.277429 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:08:06.278237 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=13 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:08:06.284113 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e9dc23a-6854-469c-adb9-7d80819b832b tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:06.284610 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e9dc23a-6854-469c-adb9-7d80819b832b tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:06.285144 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e9dc23a-6854-469c-adb9-7d80819b832b tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:06.285790 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e9dc23a-6854-469c-adb9-7d80819b832b tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:06.286250 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e9dc23a-6854-469c-adb9-7d80819b832b tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:06.286710 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e9dc23a-6854-469c-adb9-7d80819b832b tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:06.355123 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3e9dc23a-6854-469c-adb9-7d80819b832b tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "POST /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e/action" status: 200 len: 24565 microversion: 2.1 time: 0.086636 Oct 18 16:08:06.355772 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3079/6178] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:08:06 2022] POST /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e/action => generated 24565 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:08:32.555641 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5cfa4165-4ad5-43e4-9659-aa3a2f3092a8 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:32.556438 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5cfa4165-4ad5-43e4-9659-aa3a2f3092a8 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] [instance: 0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:32.559240 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=7 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:08:32.560676 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=23 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:08:32.567938 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5cfa4165-4ad5-43e4-9659-aa3a2f3092a8 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:32.568441 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5cfa4165-4ad5-43e4-9659-aa3a2f3092a8 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:32.568907 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5cfa4165-4ad5-43e4-9659-aa3a2f3092a8 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:32.569720 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5cfa4165-4ad5-43e4-9659-aa3a2f3092a8 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:32.570183 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5cfa4165-4ad5-43e4-9659-aa3a2f3092a8 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:32.570615 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5cfa4165-4ad5-43e4-9659-aa3a2f3092a8 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:32.616017 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5cfa4165-4ad5-43e4-9659-aa3a2f3092a8 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] [instance: 0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:08:32.719330 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5cfa4165-4ad5-43e4-9659-aa3a2f3092a8 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] 10.222.0.60 "DELETE /compute/v2.1/servers/0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9" status: 204 len: 0 microversion: 2.1 time: 0.167958 Oct 18 16:08:32.721628 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3100/6179] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 16:08:32 2022] DELETE /compute/v2.1/servers/0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:08:32.730689 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b02d311f-5666-42b7-800a-b7e8ef4334e5 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:32.731532 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b02d311f-5666-42b7-800a-b7e8ef4334e5 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] [instance: 0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:32.735152 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:08:32.735921 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:08:32.744380 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b02d311f-5666-42b7-800a-b7e8ef4334e5 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:32.745038 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b02d311f-5666-42b7-800a-b7e8ef4334e5 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:32.745750 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b02d311f-5666-42b7-800a-b7e8ef4334e5 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:32.746539 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b02d311f-5666-42b7-800a-b7e8ef4334e5 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:32.747070 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b02d311f-5666-42b7-800a-b7e8ef4334e5 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:32.748107 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b02d311f-5666-42b7-800a-b7e8ef4334e5 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:32.895338 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b02d311f-5666-42b7-800a-b7e8ef4334e5 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4146336121e4788bbdead3c9dee1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a35c6e5d7d4e06afe028378c708ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:32.903184 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b02d311f-5666-42b7-800a-b7e8ef4334e5 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] 10.222.0.60 "GET /compute/v2.1/servers/0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9" status: 200 len: 1554 microversion: 2.1 time: 0.177273 Oct 18 16:08:32.904109 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3080/6180] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:32 2022] GET /compute/v2.1/servers/0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9 => generated 1554 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:33.927708 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-eee6610f-c56a-457c-83b4-1f07bb547bb2 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:33.928315 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-eee6610f-c56a-457c-83b4-1f07bb547bb2 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] [instance: 0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:33.937566 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eee6610f-c56a-457c-83b4-1f07bb547bb2 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:33.938117 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eee6610f-c56a-457c-83b4-1f07bb547bb2 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:33.938893 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eee6610f-c56a-457c-83b4-1f07bb547bb2 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:33.939974 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eee6610f-c56a-457c-83b4-1f07bb547bb2 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:33.940447 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eee6610f-c56a-457c-83b4-1f07bb547bb2 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:33.940904 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eee6610f-c56a-457c-83b4-1f07bb547bb2 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:34.088264 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-eee6610f-c56a-457c-83b4-1f07bb547bb2 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4146336121e4788bbdead3c9dee1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a35c6e5d7d4e06afe028378c708ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:34.096761 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-eee6610f-c56a-457c-83b4-1f07bb547bb2 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] 10.222.0.60 "GET /compute/v2.1/servers/0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9" status: 200 len: 1554 microversion: 2.1 time: 0.173661 Oct 18 16:08:34.097388 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3101/6181] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:33 2022] GET /compute/v2.1/servers/0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9 => generated 1554 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:35.057353 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-5d41ad58-73ab-41e0-a155-42de29570110 req-45f72e0e-07f9-45c3-a4a7-a097b96466f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9", "name": "network-vif-deleted", "tag": "fabc1411-9ae9-4216-b05d-40d5ecb52256"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:08:35.068573 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5d41ad58-73ab-41e0-a155-42de29570110 req-45f72e0e-07f9-45c3-a4a7-a097b96466f4 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:35.069020 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5d41ad58-73ab-41e0-a155-42de29570110 req-45f72e0e-07f9-45c3-a4a7-a097b96466f4 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:35.069479 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5d41ad58-73ab-41e0-a155-42de29570110 req-45f72e0e-07f9-45c3-a4a7-a097b96466f4 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:35.081796 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-5d41ad58-73ab-41e0-a155-42de29570110 req-45f72e0e-07f9-45c3-a4a7-a097b96466f4 service nova] Creating event network-vif-deleted:fabc1411-9ae9-4216-b05d-40d5ecb52256 for instance 0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9 on n-h1-853682-5 Oct 18 16:08:35.086879 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-5d41ad58-73ab-41e0-a155-42de29570110 req-45f72e0e-07f9-45c3-a4a7-a097b96466f4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033402 Oct 18 16:08:35.087496 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3081/6182] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:08:35.121185 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c24329e1-cba6-4929-aecc-e0604fcb4ea8 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:35.121823 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c24329e1-cba6-4929-aecc-e0604fcb4ea8 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] [instance: 0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:35.128384 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c24329e1-cba6-4929-aecc-e0604fcb4ea8 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:35.128906 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c24329e1-cba6-4929-aecc-e0604fcb4ea8 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:35.129346 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c24329e1-cba6-4929-aecc-e0604fcb4ea8 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:35.130043 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c24329e1-cba6-4929-aecc-e0604fcb4ea8 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:35.130508 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c24329e1-cba6-4929-aecc-e0604fcb4ea8 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:35.130934 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c24329e1-cba6-4929-aecc-e0604fcb4ea8 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:35.196628 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c24329e1-cba6-4929-aecc-e0604fcb4ea8 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4146336121e4788bbdead3c9dee1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a35c6e5d7d4e06afe028378c708ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:35.205472 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c24329e1-cba6-4929-aecc-e0604fcb4ea8 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] 10.222.0.60 "GET /compute/v2.1/servers/0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9" status: 200 len: 1334 microversion: 2.1 time: 0.088615 Oct 18 16:08:35.206056 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3102/6183] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:35 2022] GET /compute/v2.1/servers/0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9 => generated 1334 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:36.235111 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f28751dc-ed5f-4fbe-a04a-d0b85de0c0fd tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:36.235814 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f28751dc-ed5f-4fbe-a04a-d0b85de0c0fd tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] [instance: 0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:36.245430 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f28751dc-ed5f-4fbe-a04a-d0b85de0c0fd tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:36.245917 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f28751dc-ed5f-4fbe-a04a-d0b85de0c0fd tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:36.246354 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f28751dc-ed5f-4fbe-a04a-d0b85de0c0fd tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:36.247050 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f28751dc-ed5f-4fbe-a04a-d0b85de0c0fd tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:36.247508 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f28751dc-ed5f-4fbe-a04a-d0b85de0c0fd tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:36.247941 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f28751dc-ed5f-4fbe-a04a-d0b85de0c0fd tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:36.264554 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-f28751dc-ed5f-4fbe-a04a-d0b85de0c0fd tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] HTTP exception thrown: Instance 0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9 could not be found. Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f28751dc-ed5f-4fbe-a04a-d0b85de0c0fd tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Request method failure captured: Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9 HTTP/1.1 Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTs8MgvpZ2Qvg56YnAMhfsl_c35aSf_xkZH-twsjNqBFoRU6Q7lxNgzQFgL7Z8yTudPxUrf7s1ArTetHOo3pjYjiz7kk6-c0En0rnv2tuFtWGlvEzntiZHtx3P2rFw-ynoxhZKe35-AW22WIDXclqJsYL4k0zSXcRnx_wjiAC5q7M4eU Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 10a35c6e5d7d4e06afe028378c708ba6 Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-TestNetworkBasicOps-212718616 Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/10a35c6e5d7d4e06afe028378c708ba6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/10a35c6e5d7d4e06afe028378c708ba6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/10a35c6e5d7d4e06afe028378c708ba6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_10a35c6e5d7d4e06afe028378c708ba6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-TestNetworkBasicOps-212718616 Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 10a35c6e5d7d4e06afe028378c708ba6 Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-TestNetworkBasicOps-212718616 Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-TestNetworkBasicOps-212718616-project Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: f4146336121e4788bbdead3c9dee1c5f Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-TestNetworkBasicOps-212718616-project Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9 could not be found. Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9'} Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9 could not be found. Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9 could not be found. Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:08:36.266253 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:08:36.271529 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:36.271529 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:08:36.271529 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:08:36.271529 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:08:36.271529 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:08:36.271529 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9 could not be found. Oct 18 16:08:36.271529 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:08:36.271529 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f28751dc-ed5f-4fbe-a04a-d0b85de0c0fd tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Returning 404 to user: Instance 0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:08:36.271529 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f28751dc-ed5f-4fbe-a04a-d0b85de0c0fd tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] 10.222.0.60 "GET /compute/v2.1/servers/0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9" status: 404 len: 111 microversion: 2.1 time: 0.042780 Oct 18 16:08:36.271529 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3082/6184] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:36 2022] GET /compute/v2.1/servers/0c26b3fd-9ae4-4da4-adcf-cc6794ce3dc9 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:08:36.448459 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f7184c9d-7adf-4df1-8f7f-7ca47b30c3ee tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Calling method '.version_select at 0x7f7c3c603b80>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:36.478282 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f7184c9d-7adf-4df1-8f7f-7ca47b30c3ee tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1408137372" status: 202 len: 0 microversion: 2.1 time: 0.034099 Oct 18 16:08:36.481134 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3103/6185] 10.222.0.60 () {58 vars in 1257 bytes} [Tue Oct 18 16:08:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1408137372 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:08:38.426072 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4f118152-5e16-499b-83e2-feca86a4269e tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:38.426593 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4f118152-5e16-499b-83e2-feca86a4269e tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] [instance: 1b08e253-0e5f-45a9-90df-0ed99e02370f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:38.430737 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-09ab4036-0e55-4452-9239-4f719b511b78 req-4ca9681b-cf85-4093-9467-2366c5bf43ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b08e253-0e5f-45a9-90df-0ed99e02370f", "tag": "c223dfeb-2206-4eec-b091-555b08d30054"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:08:38.433784 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f118152-5e16-499b-83e2-feca86a4269e tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:38.435606 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f118152-5e16-499b-83e2-feca86a4269e tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:38.435606 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f118152-5e16-499b-83e2-feca86a4269e tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:38.436246 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f118152-5e16-499b-83e2-feca86a4269e tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:38.436701 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f118152-5e16-499b-83e2-feca86a4269e tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:38.437412 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f118152-5e16-499b-83e2-feca86a4269e tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:38.443201 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-09ab4036-0e55-4452-9239-4f719b511b78 req-4ca9681b-cf85-4093-9467-2366c5bf43ca service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:38.444006 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-09ab4036-0e55-4452-9239-4f719b511b78 req-4ca9681b-cf85-4093-9467-2366c5bf43ca service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:38.444519 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-09ab4036-0e55-4452-9239-4f719b511b78 req-4ca9681b-cf85-4093-9467-2366c5bf43ca service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:38.457608 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-09ab4036-0e55-4452-9239-4f719b511b78 req-4ca9681b-cf85-4093-9467-2366c5bf43ca service nova] Creating event network-changed:c223dfeb-2206-4eec-b091-555b08d30054 for instance 1b08e253-0e5f-45a9-90df-0ed99e02370f on n-h2-853682-5 Oct 18 16:08:38.464045 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-09ab4036-0e55-4452-9239-4f719b511b78 req-4ca9681b-cf85-4093-9467-2366c5bf43ca service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038025 Oct 18 16:08:38.465099 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3104/6186] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:08:38.472381 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4f118152-5e16-499b-83e2-feca86a4269e tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] [instance: 1b08e253-0e5f-45a9-90df-0ed99e02370f] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:08:38.575959 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4f118152-5e16-499b-83e2-feca86a4269e tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1b08e253-0e5f-45a9-90df-0ed99e02370f" status: 204 len: 0 microversion: 2.1 time: 0.152991 Oct 18 16:08:38.577013 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3083/6187] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 16:08:38 2022] DELETE /compute/v2.1/servers/1b08e253-0e5f-45a9-90df-0ed99e02370f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:08:38.586143 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-cb3ccdd3-b183-4a27-95d2-11b110bf4a6b tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:38.586875 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-cb3ccdd3-b183-4a27-95d2-11b110bf4a6b tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] [instance: 1b08e253-0e5f-45a9-90df-0ed99e02370f] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:38.601584 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cb3ccdd3-b183-4a27-95d2-11b110bf4a6b tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:38.602090 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cb3ccdd3-b183-4a27-95d2-11b110bf4a6b tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:38.602537 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cb3ccdd3-b183-4a27-95d2-11b110bf4a6b tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:38.603258 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cb3ccdd3-b183-4a27-95d2-11b110bf4a6b tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:38.603721 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cb3ccdd3-b183-4a27-95d2-11b110bf4a6b tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:38.604157 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cb3ccdd3-b183-4a27-95d2-11b110bf4a6b tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:38.797746 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-cb3ccdd3-b183-4a27-95d2-11b110bf4a6b tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4146336121e4788bbdead3c9dee1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a35c6e5d7d4e06afe028378c708ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:38.806109 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-cb3ccdd3-b183-4a27-95d2-11b110bf4a6b tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] 10.222.0.60 "GET /compute/v2.1/servers/1b08e253-0e5f-45a9-90df-0ed99e02370f" status: 200 len: 1670 microversion: 2.1 time: 0.224328 Oct 18 16:08:38.806690 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3105/6188] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:38 2022] GET /compute/v2.1/servers/1b08e253-0e5f-45a9-90df-0ed99e02370f => generated 1670 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:08:39.833071 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f516fb2e-6a45-4824-a405-f1e0f05cfcee tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:39.833071 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f516fb2e-6a45-4824-a405-f1e0f05cfcee tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] [instance: 1b08e253-0e5f-45a9-90df-0ed99e02370f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:39.838889 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f516fb2e-6a45-4824-a405-f1e0f05cfcee tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:39.839455 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f516fb2e-6a45-4824-a405-f1e0f05cfcee tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:39.839966 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f516fb2e-6a45-4824-a405-f1e0f05cfcee tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:39.840679 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f516fb2e-6a45-4824-a405-f1e0f05cfcee tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:39.841185 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f516fb2e-6a45-4824-a405-f1e0f05cfcee tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:39.841616 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f516fb2e-6a45-4824-a405-f1e0f05cfcee tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:40.067670 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f516fb2e-6a45-4824-a405-f1e0f05cfcee tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4146336121e4788bbdead3c9dee1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a35c6e5d7d4e06afe028378c708ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:40.075567 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f516fb2e-6a45-4824-a405-f1e0f05cfcee tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] 10.222.0.60 "GET /compute/v2.1/servers/1b08e253-0e5f-45a9-90df-0ed99e02370f" status: 200 len: 1670 microversion: 2.1 time: 0.249794 Oct 18 16:08:40.076151 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3084/6189] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:39 2022] GET /compute/v2.1/servers/1b08e253-0e5f-45a9-90df-0ed99e02370f => generated 1670 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:40.483174 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-a69cdb47-2de9-4904-9e71-2f517c717646 req-b5b058ce-5e98-43df-8bb6-54c48809040c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b08e253-0e5f-45a9-90df-0ed99e02370f", "name": "network-vif-deleted", "tag": "c223dfeb-2206-4eec-b091-555b08d30054"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:08:40.493457 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-a69cdb47-2de9-4904-9e71-2f517c717646 req-b5b058ce-5e98-43df-8bb6-54c48809040c service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:40.494029 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-a69cdb47-2de9-4904-9e71-2f517c717646 req-b5b058ce-5e98-43df-8bb6-54c48809040c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:40.494458 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-a69cdb47-2de9-4904-9e71-2f517c717646 req-b5b058ce-5e98-43df-8bb6-54c48809040c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:40.506942 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-a69cdb47-2de9-4904-9e71-2f517c717646 req-b5b058ce-5e98-43df-8bb6-54c48809040c service nova] Creating event network-vif-deleted:c223dfeb-2206-4eec-b091-555b08d30054 for instance 1b08e253-0e5f-45a9-90df-0ed99e02370f on n-h2-853682-5 Oct 18 16:08:40.520334 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-a69cdb47-2de9-4904-9e71-2f517c717646 req-b5b058ce-5e98-43df-8bb6-54c48809040c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041317 Oct 18 16:08:40.521824 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3106/6190] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:08:41.098933 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a8376a5a-0f12-4660-96d8-c4574ea4383c tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:41.099565 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a8376a5a-0f12-4660-96d8-c4574ea4383c tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] [instance: 1b08e253-0e5f-45a9-90df-0ed99e02370f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:41.106802 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8376a5a-0f12-4660-96d8-c4574ea4383c tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:41.107316 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8376a5a-0f12-4660-96d8-c4574ea4383c tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:41.107753 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8376a5a-0f12-4660-96d8-c4574ea4383c tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:41.108444 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8376a5a-0f12-4660-96d8-c4574ea4383c tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:41.108930 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8376a5a-0f12-4660-96d8-c4574ea4383c tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:41.109357 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8376a5a-0f12-4660-96d8-c4574ea4383c tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:41.123399 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-a8376a5a-0f12-4660-96d8-c4574ea4383c tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] HTTP exception thrown: Instance 1b08e253-0e5f-45a9-90df-0ed99e02370f could not be found. Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a8376a5a-0f12-4660-96d8-c4574ea4383c tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Request method failure captured: Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/1b08e253-0e5f-45a9-90df-0ed99e02370f HTTP/1.1 Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTs8MgvpZ2Qvg56YnAMhfsl_c35aSf_xkZH-twsjNqBFoRU6Q7lxNgzQFgL7Z8yTudPxUrf7s1ArTetHOo3pjYjiz7kk6-c0En0rnv2tuFtWGlvEzntiZHtx3P2rFw-ynoxhZKe35-AW22WIDXclqJsYL4k0zSXcRnx_wjiAC5q7M4eU Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 10a35c6e5d7d4e06afe028378c708ba6 Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-TestNetworkBasicOps-212718616 Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/10a35c6e5d7d4e06afe028378c708ba6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/10a35c6e5d7d4e06afe028378c708ba6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/10a35c6e5d7d4e06afe028378c708ba6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_10a35c6e5d7d4e06afe028378c708ba6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-TestNetworkBasicOps-212718616 Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 10a35c6e5d7d4e06afe028378c708ba6 Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-TestNetworkBasicOps-212718616 Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-TestNetworkBasicOps-212718616-project Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: f4146336121e4788bbdead3c9dee1c5f Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-TestNetworkBasicOps-212718616-project Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 1b08e253-0e5f-45a9-90df-0ed99e02370f could not be found. Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '1b08e253-0e5f-45a9-90df-0ed99e02370f'} Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b08e253-0e5f-45a9-90df-0ed99e02370f could not be found. Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b08e253-0e5f-45a9-90df-0ed99e02370f could not be found. Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:08:41.125075 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:08:41.130641 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:08:41.130641 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:08:41.130641 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:08:41.130641 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:08:41.130641 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:08:41.130641 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b08e253-0e5f-45a9-90df-0ed99e02370f could not be found. Oct 18 16:08:41.130641 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:08:41.130641 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a8376a5a-0f12-4660-96d8-c4574ea4383c tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Returning 404 to user: Instance 1b08e253-0e5f-45a9-90df-0ed99e02370f could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:08:41.130641 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a8376a5a-0f12-4660-96d8-c4574ea4383c tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] 10.222.0.60 "GET /compute/v2.1/servers/1b08e253-0e5f-45a9-90df-0ed99e02370f" status: 404 len: 111 microversion: 2.1 time: 0.031448 Oct 18 16:08:41.130641 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3085/6191] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:41 2022] GET /compute/v2.1/servers/1b08e253-0e5f-45a9-90df-0ed99e02370f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:08:41.284491 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fc47596b-f21e-4c3e-b832-b24baad592d3 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Calling method '.version_select at 0x7f7c3d0a0a60>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:41.317824 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fc47596b-f21e-4c3e-b832-b24baad592d3 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-620463846" status: 202 len: 0 microversion: 2.1 time: 0.037634 Oct 18 16:08:41.318429 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3107/6192] 10.222.0.60 () {58 vars in 1254 bytes} [Tue Oct 18 16:08:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-620463846 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:08:45.442113 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7e4d6b60-a84f-4bdb-b925-021b9455a1b8 tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:45.442742 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7e4d6b60-a84f-4bdb-b925-021b9455a1b8 tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] [instance: 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:45.449812 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e4d6b60-a84f-4bdb-b925-021b9455a1b8 tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:45.450315 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e4d6b60-a84f-4bdb-b925-021b9455a1b8 tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:45.450795 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e4d6b60-a84f-4bdb-b925-021b9455a1b8 tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:45.451427 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e4d6b60-a84f-4bdb-b925-021b9455a1b8 tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:45.451885 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e4d6b60-a84f-4bdb-b925-021b9455a1b8 tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:45.452315 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e4d6b60-a84f-4bdb-b925-021b9455a1b8 tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:45.691681 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7e4d6b60-a84f-4bdb-b925-021b9455a1b8 tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e" status: 200 len: 1834 microversion: 2.1 time: 0.253341 Oct 18 16:08:45.692273 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3086/6193] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:45 2022] GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e => generated 1834 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:45.715514 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-eb7d53c6-571c-457f-9820-5b146b2f9187 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:45.717104 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-eb7d53c6-571c-457f-9820-5b146b2f9187 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:45.723379 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eb7d53c6-571c-457f-9820-5b146b2f9187 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:45.723875 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eb7d53c6-571c-457f-9820-5b146b2f9187 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:45.724427 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eb7d53c6-571c-457f-9820-5b146b2f9187 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:45.725148 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eb7d53c6-571c-457f-9820-5b146b2f9187 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:45.725713 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eb7d53c6-571c-457f-9820-5b146b2f9187 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:45.726154 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eb7d53c6-571c-457f-9820-5b146b2f9187 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:45.860921 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-eb7d53c6-571c-457f-9820-5b146b2f9187 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:45.870521 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-eb7d53c6-571c-457f-9820-5b146b2f9187 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e" status: 200 len: 1683 microversion: 2.1 time: 0.159936 Oct 18 16:08:45.871224 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3108/6194] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:45 2022] GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:45.975307 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3c88d286-bf7a-4ad2-a1df-f078773f2ae7 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:08:45.977624 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3c88d286-bf7a-4ad2-a1df-f078773f2ae7 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:45.984114 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c88d286-bf7a-4ad2-a1df-f078773f2ae7 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:45.984610 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c88d286-bf7a-4ad2-a1df-f078773f2ae7 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:45.985084 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c88d286-bf7a-4ad2-a1df-f078773f2ae7 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:45.985793 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c88d286-bf7a-4ad2-a1df-f078773f2ae7 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:45.986248 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c88d286-bf7a-4ad2-a1df-f078773f2ae7 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:45.986673 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c88d286-bf7a-4ad2-a1df-f078773f2ae7 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:46.063958 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3c88d286-bf7a-4ad2-a1df-f078773f2ae7 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "POST /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e/action" status: 200 len: 32634 microversion: 2.1 time: 0.092322 Oct 18 16:08:46.071132 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3087/6195] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:08:45 2022] POST /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e/action => generated 32634 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:08:46.237954 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f646173e-a016-4028-a4fd-3dce74561d17 tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:08:46.238592 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f646173e-a016-4028-a4fd-3dce74561d17 tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] [instance: 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:46.244862 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f646173e-a016-4028-a4fd-3dce74561d17 tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:46.245363 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f646173e-a016-4028-a4fd-3dce74561d17 tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:46.245843 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f646173e-a016-4028-a4fd-3dce74561d17 tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:46.246562 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f646173e-a016-4028-a4fd-3dce74561d17 tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:46.247056 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f646173e-a016-4028-a4fd-3dce74561d17 tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:46.248015 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f646173e-a016-4028-a4fd-3dce74561d17 tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:46.291885 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f646173e-a016-4028-a4fd-3dce74561d17 tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'b628cdaf36e5480fa914bc5244581568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d630b4ad57d4d56b67a1810f47a0752', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:46.292977 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f646173e-a016-4028-a4fd-3dce74561d17 tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] [instance: 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e] flavor_id is None. Assuming migration. {{(pid=120405) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 18 16:08:46.293330 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f646173e-a016-4028-a4fd-3dce74561d17 tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] [instance: 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120405) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 18 16:08:46.498543 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f646173e-a016-4028-a4fd-3dce74561d17 tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e/action" status: 202 len: 0 microversion: 2.1 time: 0.264406 Oct 18 16:08:46.499330 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3109/6196] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:08:46 2022] POST /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:08:46.508458 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2847ef2a-90c8-49ac-b583-b0a6d876ef54 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:46.509319 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2847ef2a-90c8-49ac-b583-b0a6d876ef54 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:46.522843 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2847ef2a-90c8-49ac-b583-b0a6d876ef54 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:46.524049 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2847ef2a-90c8-49ac-b583-b0a6d876ef54 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:46.524701 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2847ef2a-90c8-49ac-b583-b0a6d876ef54 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:46.525653 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2847ef2a-90c8-49ac-b583-b0a6d876ef54 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:46.526286 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2847ef2a-90c8-49ac-b583-b0a6d876ef54 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:46.526960 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2847ef2a-90c8-49ac-b583-b0a6d876ef54 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:46.840183 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2847ef2a-90c8-49ac-b583-b0a6d876ef54 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:46.851161 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2847ef2a-90c8-49ac-b583-b0a6d876ef54 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e" status: 200 len: 1692 microversion: 2.1 time: 0.347224 Oct 18 16:08:46.851788 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3088/6197] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:46 2022] GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e => generated 1692 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:47.880733 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8103f96c-7d53-4e6a-8486-28e6df300487 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:47.883309 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8103f96c-7d53-4e6a-8486-28e6df300487 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:47.897621 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8103f96c-7d53-4e6a-8486-28e6df300487 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:47.897869 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8103f96c-7d53-4e6a-8486-28e6df300487 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:47.898741 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8103f96c-7d53-4e6a-8486-28e6df300487 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:47.899901 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8103f96c-7d53-4e6a-8486-28e6df300487 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:47.900548 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8103f96c-7d53-4e6a-8486-28e6df300487 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:47.901652 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8103f96c-7d53-4e6a-8486-28e6df300487 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:48.532653 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8103f96c-7d53-4e6a-8486-28e6df300487 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:48.550200 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8103f96c-7d53-4e6a-8486-28e6df300487 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e" status: 200 len: 1692 microversion: 2.1 time: 0.673850 Oct 18 16:08:48.550822 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3110/6198] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:47 2022] GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e => generated 1692 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:49.574249 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-aa924b59-0488-4866-b958-db3dbd8239cc tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:49.576124 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-aa924b59-0488-4866-b958-db3dbd8239cc tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:49.585498 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa924b59-0488-4866-b958-db3dbd8239cc tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:49.586258 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa924b59-0488-4866-b958-db3dbd8239cc tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:49.586688 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa924b59-0488-4866-b958-db3dbd8239cc tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:49.587632 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa924b59-0488-4866-b958-db3dbd8239cc tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:49.588289 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa924b59-0488-4866-b958-db3dbd8239cc tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:49.589197 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa924b59-0488-4866-b958-db3dbd8239cc tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:49.833062 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-aa924b59-0488-4866-b958-db3dbd8239cc tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:49.841084 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-aa924b59-0488-4866-b958-db3dbd8239cc tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e" status: 200 len: 1697 microversion: 2.1 time: 0.270798 Oct 18 16:08:49.857454 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3089/6199] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:49 2022] GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e => generated 1697 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:50.514777 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e09e20db-6e52-45fe-8291-2d916410781d tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Action: 'create', calling method: .version_select at 0x7f7c37fd0e50>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1502426809", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4Q8wmaGcWHRaMzOCG7DndnsMyBPxTECxDkrRJekUKgdjbsno2s4zxYvC0oTSNpGohCzun3df+h9O+72W0R6cOAGVXRg9JbO9SI2g+RAO93mituiOxHIJy8PWgsxtYNMg=="}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:08:50.531712 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-e09e20db-6e52-45fe-8291-2d916410781d tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Getting quotas for project 10a35c6e5d7d4e06afe028378c708ba6. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:08:50.539689 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-e09e20db-6e52-45fe-8291-2d916410781d tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Getting quotas for user f4146336121e4788bbdead3c9dee1c5f and project 10a35c6e5d7d4e06afe028378c708ba6. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:08:50.569656 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e09e20db-6e52-45fe-8291-2d916410781d tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.058721 Oct 18 16:08:50.570687 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3111/6200] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Oct 18 16:08:50 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:08:50.866404 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-46b2d711-199c-4661-8e13-c22561dd0c75 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:50.868121 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-46b2d711-199c-4661-8e13-c22561dd0c75 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:50.876248 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-46b2d711-199c-4661-8e13-c22561dd0c75 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:50.877169 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-46b2d711-199c-4661-8e13-c22561dd0c75 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:50.877894 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-46b2d711-199c-4661-8e13-c22561dd0c75 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:50.878847 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-46b2d711-199c-4661-8e13-c22561dd0c75 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:50.879537 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-46b2d711-199c-4661-8e13-c22561dd0c75 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:50.880223 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-46b2d711-199c-4661-8e13-c22561dd0c75 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:51.067748 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-46b2d711-199c-4661-8e13-c22561dd0c75 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:51.077573 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-46b2d711-199c-4661-8e13-c22561dd0c75 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e" status: 200 len: 1697 microversion: 2.1 time: 0.215053 Oct 18 16:08:51.078298 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3090/6201] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:50 2022] GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e => generated 1697 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:51.771415 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bad55283-078b-43d7-b339-5c9a3c16126f tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-848465184", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "e60a7bc7-805f-48e3-a1cb-b97d2f35295e"}], "key_name": "tempest-TestNetworkBasicOps-1502426809", "security_groups": [{"name": "tempest-secgroup-smoke-2085921900"}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:08:51.884617 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-bad55283-078b-43d7-b339-5c9a3c16126f tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] validate_networks() for [('e60a7bc7-805f-48e3-a1cb-b97d2f35295e', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 16:08:52.101925 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cd14e8f9-4925-495a-b22f-59a707819bd5 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:52.103097 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cd14e8f9-4925-495a-b22f-59a707819bd5 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:52.124067 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd14e8f9-4925-495a-b22f-59a707819bd5 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:52.124564 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd14e8f9-4925-495a-b22f-59a707819bd5 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:52.125063 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd14e8f9-4925-495a-b22f-59a707819bd5 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:52.125777 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd14e8f9-4925-495a-b22f-59a707819bd5 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:52.126222 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd14e8f9-4925-495a-b22f-59a707819bd5 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:52.126654 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd14e8f9-4925-495a-b22f-59a707819bd5 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:52.380038 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cd14e8f9-4925-495a-b22f-59a707819bd5 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:52.389114 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cd14e8f9-4925-495a-b22f-59a707819bd5 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e" status: 200 len: 1697 microversion: 2.1 time: 0.290501 Oct 18 16:08:52.405039 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3091/6202] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:52 2022] GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e => generated 1697 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:08:52.423089 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-bad55283-078b-43d7-b339-5c9a3c16126f tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:08:52.423524 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-bad55283-078b-43d7-b339-5c9a3c16126f tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:08:52.424016 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-bad55283-078b-43d7-b339-5c9a3c16126f tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:08:52.424870 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-bad55283-078b-43d7-b339-5c9a3c16126f tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:08:52.425335 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-bad55283-078b-43d7-b339-5c9a3c16126f tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:08:52.435448 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bad55283-078b-43d7-b339-5c9a3c16126f tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:52.435945 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bad55283-078b-43d7-b339-5c9a3c16126f tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:52.436434 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bad55283-078b-43d7-b339-5c9a3c16126f tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:52.437306 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bad55283-078b-43d7-b339-5c9a3c16126f tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:52.437778 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bad55283-078b-43d7-b339-5c9a3c16126f tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:52.438248 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bad55283-078b-43d7-b339-5c9a3c16126f tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:52.458951 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-bad55283-078b-43d7-b339-5c9a3c16126f tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Getting quotas for project 10a35c6e5d7d4e06afe028378c708ba6. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:08:52.464525 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-bad55283-078b-43d7-b339-5c9a3c16126f tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Getting quotas for user f4146336121e4788bbdead3c9dee1c5f and project 10a35c6e5d7d4e06afe028378c708ba6. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:08:52.478074 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-bad55283-078b-43d7-b339-5c9a3c16126f tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:08:52.480444 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-bad55283-078b-43d7-b339-5c9a3c16126f tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] [instance: c030015c-4838-4450-9bf3-e3cf111b92ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:08:52.529678 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-bad55283-078b-43d7-b339-5c9a3c16126f tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.763092 Oct 18 16:08:52.530344 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3112/6203] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 16:08:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:08:52.543042 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-606ab7f7-9ec1-4d48-9a10-8458d7d1b95a tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:52.544099 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-606ab7f7-9ec1-4d48-9a10-8458d7d1b95a tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] [instance: c030015c-4838-4450-9bf3-e3cf111b92ce] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:52.606473 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-606ab7f7-9ec1-4d48-9a10-8458d7d1b95a tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4146336121e4788bbdead3c9dee1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a35c6e5d7d4e06afe028378c708ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:52.616168 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-606ab7f7-9ec1-4d48-9a10-8458d7d1b95a tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] 10.222.0.60 "GET /compute/v2.1/servers/c030015c-4838-4450-9bf3-e3cf111b92ce" status: 200 len: 1248 microversion: 2.1 time: 0.078204 Oct 18 16:08:52.617004 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3092/6204] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:52 2022] GET /compute/v2.1/servers/c030015c-4838-4450-9bf3-e3cf111b92ce => generated 1248 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:53.413738 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-329471ee-833b-4390-a075-7f57a0002335 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:53.414362 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-329471ee-833b-4390-a075-7f57a0002335 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:53.421791 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-329471ee-833b-4390-a075-7f57a0002335 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:53.422281 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-329471ee-833b-4390-a075-7f57a0002335 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:53.422728 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-329471ee-833b-4390-a075-7f57a0002335 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:53.423430 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-329471ee-833b-4390-a075-7f57a0002335 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:53.423900 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-329471ee-833b-4390-a075-7f57a0002335 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:53.424334 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-329471ee-833b-4390-a075-7f57a0002335 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:53.556873 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-329471ee-833b-4390-a075-7f57a0002335 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:53.565614 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-329471ee-833b-4390-a075-7f57a0002335 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e" status: 200 len: 1697 microversion: 2.1 time: 0.156688 Oct 18 16:08:53.566294 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3113/6205] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:53 2022] GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:53.642520 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ce605751-4ed2-4f1c-9774-8eece05cc496 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:53.643992 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ce605751-4ed2-4f1c-9774-8eece05cc496 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] [instance: c030015c-4838-4450-9bf3-e3cf111b92ce] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:53.652123 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce605751-4ed2-4f1c-9774-8eece05cc496 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:53.652757 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce605751-4ed2-4f1c-9774-8eece05cc496 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:53.653223 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce605751-4ed2-4f1c-9774-8eece05cc496 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:53.654294 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce605751-4ed2-4f1c-9774-8eece05cc496 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:53.654928 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce605751-4ed2-4f1c-9774-8eece05cc496 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:53.655531 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce605751-4ed2-4f1c-9774-8eece05cc496 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:53.734496 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ce605751-4ed2-4f1c-9774-8eece05cc496 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4146336121e4788bbdead3c9dee1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a35c6e5d7d4e06afe028378c708ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:53.743301 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ce605751-4ed2-4f1c-9774-8eece05cc496 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] 10.222.0.60 "GET /compute/v2.1/servers/c030015c-4838-4450-9bf3-e3cf111b92ce" status: 200 len: 1308 microversion: 2.1 time: 0.105386 Oct 18 16:08:53.744156 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3093/6206] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:53 2022] GET /compute/v2.1/servers/c030015c-4838-4450-9bf3-e3cf111b92ce => generated 1308 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:54.589382 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-709227a3-c1be-459b-a46f-e66db07ab907 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:54.590013 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-709227a3-c1be-459b-a46f-e66db07ab907 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:54.598062 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-709227a3-c1be-459b-a46f-e66db07ab907 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:54.598799 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-709227a3-c1be-459b-a46f-e66db07ab907 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:54.599469 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-709227a3-c1be-459b-a46f-e66db07ab907 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:54.600200 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-709227a3-c1be-459b-a46f-e66db07ab907 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:54.600665 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-709227a3-c1be-459b-a46f-e66db07ab907 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:54.601116 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-709227a3-c1be-459b-a46f-e66db07ab907 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:54.751071 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-709227a3-c1be-459b-a46f-e66db07ab907 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:54.759966 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-709227a3-c1be-459b-a46f-e66db07ab907 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e" status: 200 len: 1697 microversion: 2.1 time: 0.175312 Oct 18 16:08:54.762376 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3114/6207] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:54 2022] GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e => generated 1697 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:54.767484 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-881923f0-015a-43bb-9925-34ed3a5c6a64 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:54.768261 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-881923f0-015a-43bb-9925-34ed3a5c6a64 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] [instance: c030015c-4838-4450-9bf3-e3cf111b92ce] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:54.775207 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-881923f0-015a-43bb-9925-34ed3a5c6a64 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:54.775906 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-881923f0-015a-43bb-9925-34ed3a5c6a64 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:54.776548 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-881923f0-015a-43bb-9925-34ed3a5c6a64 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:54.777458 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-881923f0-015a-43bb-9925-34ed3a5c6a64 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:54.778259 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-881923f0-015a-43bb-9925-34ed3a5c6a64 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:54.779384 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-881923f0-015a-43bb-9925-34ed3a5c6a64 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:54.918254 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-881923f0-015a-43bb-9925-34ed3a5c6a64 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4146336121e4788bbdead3c9dee1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a35c6e5d7d4e06afe028378c708ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:54.926400 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-881923f0-015a-43bb-9925-34ed3a5c6a64 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] 10.222.0.60 "GET /compute/v2.1/servers/c030015c-4838-4450-9bf3-e3cf111b92ce" status: 200 len: 1374 microversion: 2.1 time: 0.162804 Oct 18 16:08:54.926980 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3094/6208] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:54 2022] GET /compute/v2.1/servers/c030015c-4838-4450-9bf3-e3cf111b92ce => generated 1374 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:55.050911 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-955cf061-4ab7-49a4-9bc0-c9c94620f9a6 req-1430f44f-06a8-450b-8e8f-bfbcb21a4831 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c030015c-4838-4450-9bf3-e3cf111b92ce", "tag": "a5aad5f3-99ac-4880-8fd6-523580184225"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:08:55.062823 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-955cf061-4ab7-49a4-9bc0-c9c94620f9a6 req-1430f44f-06a8-450b-8e8f-bfbcb21a4831 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:55.063312 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-955cf061-4ab7-49a4-9bc0-c9c94620f9a6 req-1430f44f-06a8-450b-8e8f-bfbcb21a4831 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:55.063748 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-955cf061-4ab7-49a4-9bc0-c9c94620f9a6 req-1430f44f-06a8-450b-8e8f-bfbcb21a4831 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:55.074947 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-955cf061-4ab7-49a4-9bc0-c9c94620f9a6 req-1430f44f-06a8-450b-8e8f-bfbcb21a4831 service nova] Creating event network-changed:a5aad5f3-99ac-4880-8fd6-523580184225 for instance c030015c-4838-4450-9bf3-e3cf111b92ce on n-h2-853682-5 Oct 18 16:08:55.080728 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-955cf061-4ab7-49a4-9bc0-c9c94620f9a6 req-1430f44f-06a8-450b-8e8f-bfbcb21a4831 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034369 Oct 18 16:08:55.081450 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3115/6209] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:08:55.787333 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7c004993-4a38-49c6-97f2-ec6fa1e36902 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:55.787956 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7c004993-4a38-49c6-97f2-ec6fa1e36902 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:55.795891 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c004993-4a38-49c6-97f2-ec6fa1e36902 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:55.796376 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c004993-4a38-49c6-97f2-ec6fa1e36902 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:55.796838 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c004993-4a38-49c6-97f2-ec6fa1e36902 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:55.797539 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c004993-4a38-49c6-97f2-ec6fa1e36902 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:55.797999 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c004993-4a38-49c6-97f2-ec6fa1e36902 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:55.798428 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c004993-4a38-49c6-97f2-ec6fa1e36902 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:55.934727 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7c004993-4a38-49c6-97f2-ec6fa1e36902 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:55.943027 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7c004993-4a38-49c6-97f2-ec6fa1e36902 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e" status: 200 len: 1697 microversion: 2.1 time: 0.159621 Oct 18 16:08:55.943615 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3095/6210] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:55 2022] GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:55.950703 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4bb9c96c-38d2-4c09-8df5-57c7ea7ea7ea tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:55.951349 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4bb9c96c-38d2-4c09-8df5-57c7ea7ea7ea tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] [instance: c030015c-4838-4450-9bf3-e3cf111b92ce] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:55.957603 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4bb9c96c-38d2-4c09-8df5-57c7ea7ea7ea tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:55.958085 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4bb9c96c-38d2-4c09-8df5-57c7ea7ea7ea tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:55.958527 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4bb9c96c-38d2-4c09-8df5-57c7ea7ea7ea tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:55.959222 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4bb9c96c-38d2-4c09-8df5-57c7ea7ea7ea tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:55.959678 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4bb9c96c-38d2-4c09-8df5-57c7ea7ea7ea tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:55.960104 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4bb9c96c-38d2-4c09-8df5-57c7ea7ea7ea tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:56.095591 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4bb9c96c-38d2-4c09-8df5-57c7ea7ea7ea tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4146336121e4788bbdead3c9dee1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a35c6e5d7d4e06afe028378c708ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:56.103383 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4bb9c96c-38d2-4c09-8df5-57c7ea7ea7ea tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] 10.222.0.60 "GET /compute/v2.1/servers/c030015c-4838-4450-9bf3-e3cf111b92ce" status: 200 len: 1374 microversion: 2.1 time: 0.157883 Oct 18 16:08:56.103972 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3116/6211] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:55 2022] GET /compute/v2.1/servers/c030015c-4838-4450-9bf3-e3cf111b92ce => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:56.966193 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d44734b7-897e-4391-8b72-91b81e4f430c tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:56.966733 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d44734b7-897e-4391-8b72-91b81e4f430c tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:56.973645 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d44734b7-897e-4391-8b72-91b81e4f430c tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:56.974141 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d44734b7-897e-4391-8b72-91b81e4f430c tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:56.974582 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d44734b7-897e-4391-8b72-91b81e4f430c tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:56.975277 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d44734b7-897e-4391-8b72-91b81e4f430c tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:56.975734 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d44734b7-897e-4391-8b72-91b81e4f430c tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:56.976165 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d44734b7-897e-4391-8b72-91b81e4f430c tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:57.113073 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d44734b7-897e-4391-8b72-91b81e4f430c tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:57.120913 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d44734b7-897e-4391-8b72-91b81e4f430c tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e" status: 200 len: 1697 microversion: 2.1 time: 0.158688 Oct 18 16:08:57.121517 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3096/6212] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:56 2022] GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:57.126566 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c134594b-b6f2-4fca-94d1-c7aed666ea9c tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:57.127190 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c134594b-b6f2-4fca-94d1-c7aed666ea9c tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] [instance: c030015c-4838-4450-9bf3-e3cf111b92ce] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:57.134062 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c134594b-b6f2-4fca-94d1-c7aed666ea9c tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:57.134554 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c134594b-b6f2-4fca-94d1-c7aed666ea9c tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:57.134997 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c134594b-b6f2-4fca-94d1-c7aed666ea9c tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:57.135699 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c134594b-b6f2-4fca-94d1-c7aed666ea9c tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:57.136162 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c134594b-b6f2-4fca-94d1-c7aed666ea9c tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:57.136596 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c134594b-b6f2-4fca-94d1-c7aed666ea9c tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:57.271649 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c134594b-b6f2-4fca-94d1-c7aed666ea9c tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4146336121e4788bbdead3c9dee1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a35c6e5d7d4e06afe028378c708ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:57.279578 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c134594b-b6f2-4fca-94d1-c7aed666ea9c tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] 10.222.0.60 "GET /compute/v2.1/servers/c030015c-4838-4450-9bf3-e3cf111b92ce" status: 200 len: 1374 microversion: 2.1 time: 0.157511 Oct 18 16:08:57.280528 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3117/6213] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:57 2022] GET /compute/v2.1/servers/c030015c-4838-4450-9bf3-e3cf111b92ce => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:58.145148 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fb9ebe0e-9c22-4c21-9096-9160ef44fcca tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:58.145734 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fb9ebe0e-9c22-4c21-9096-9160ef44fcca tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:58.152499 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb9ebe0e-9c22-4c21-9096-9160ef44fcca tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:58.153023 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb9ebe0e-9c22-4c21-9096-9160ef44fcca tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:58.153467 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb9ebe0e-9c22-4c21-9096-9160ef44fcca tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:58.154942 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb9ebe0e-9c22-4c21-9096-9160ef44fcca tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:58.155618 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb9ebe0e-9c22-4c21-9096-9160ef44fcca tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:58.156054 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb9ebe0e-9c22-4c21-9096-9160ef44fcca tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:58.287574 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fb9ebe0e-9c22-4c21-9096-9160ef44fcca tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:58.296039 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fb9ebe0e-9c22-4c21-9096-9160ef44fcca tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e" status: 200 len: 1697 microversion: 2.1 time: 0.154877 Oct 18 16:08:58.296616 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3097/6214] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:58 2022] GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:58.303553 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c078829d-b32d-4917-ac39-43d36ba72c28 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:58.304182 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c078829d-b32d-4917-ac39-43d36ba72c28 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] [instance: c030015c-4838-4450-9bf3-e3cf111b92ce] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:58.310740 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c078829d-b32d-4917-ac39-43d36ba72c28 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:58.311312 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c078829d-b32d-4917-ac39-43d36ba72c28 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:58.311756 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c078829d-b32d-4917-ac39-43d36ba72c28 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:58.312456 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c078829d-b32d-4917-ac39-43d36ba72c28 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:58.312947 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c078829d-b32d-4917-ac39-43d36ba72c28 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:58.313380 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c078829d-b32d-4917-ac39-43d36ba72c28 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:58.448221 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c078829d-b32d-4917-ac39-43d36ba72c28 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4146336121e4788bbdead3c9dee1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a35c6e5d7d4e06afe028378c708ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:58.452436 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:08:58.457568 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c078829d-b32d-4917-ac39-43d36ba72c28 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] 10.222.0.60 "GET /compute/v2.1/servers/c030015c-4838-4450-9bf3-e3cf111b92ce" status: 200 len: 1374 microversion: 2.1 time: 0.158020 Oct 18 16:08:58.458148 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3118/6215] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:58 2022] GET /compute/v2.1/servers/c030015c-4838-4450-9bf3-e3cf111b92ce => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:59.319796 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-173cce11-3d28-4f87-93b1-c58dc38308f8 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:59.320404 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-173cce11-3d28-4f87-93b1-c58dc38308f8 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:59.327775 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-173cce11-3d28-4f87-93b1-c58dc38308f8 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:59.328255 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-173cce11-3d28-4f87-93b1-c58dc38308f8 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:59.328691 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-173cce11-3d28-4f87-93b1-c58dc38308f8 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:59.329432 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-173cce11-3d28-4f87-93b1-c58dc38308f8 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:59.329881 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-173cce11-3d28-4f87-93b1-c58dc38308f8 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:59.330302 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-173cce11-3d28-4f87-93b1-c58dc38308f8 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:59.334352 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:08:59.465452 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-173cce11-3d28-4f87-93b1-c58dc38308f8 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:59.473801 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-173cce11-3d28-4f87-93b1-c58dc38308f8 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e" status: 200 len: 1697 microversion: 2.1 time: 0.157892 Oct 18 16:08:59.474527 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3098/6216] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:59 2022] GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:08:59.479983 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fc93c8ce-29fd-428e-984b-a084279cd63a tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:08:59.480858 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-fc93c8ce-29fd-428e-984b-a084279cd63a tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] [instance: c030015c-4838-4450-9bf3-e3cf111b92ce] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:08:59.489249 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fc93c8ce-29fd-428e-984b-a084279cd63a tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:59.489676 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fc93c8ce-29fd-428e-984b-a084279cd63a tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:59.490119 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fc93c8ce-29fd-428e-984b-a084279cd63a tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:59.490859 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fc93c8ce-29fd-428e-984b-a084279cd63a tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:08:59.491319 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fc93c8ce-29fd-428e-984b-a084279cd63a tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:08:59.491751 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fc93c8ce-29fd-428e-984b-a084279cd63a tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:08:59.625071 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-fc93c8ce-29fd-428e-984b-a084279cd63a tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4146336121e4788bbdead3c9dee1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a35c6e5d7d4e06afe028378c708ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:08:59.632732 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fc93c8ce-29fd-428e-984b-a084279cd63a tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] 10.222.0.60 "GET /compute/v2.1/servers/c030015c-4838-4450-9bf3-e3cf111b92ce" status: 200 len: 1374 microversion: 2.1 time: 0.156850 Oct 18 16:08:59.633335 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3119/6217] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:08:59 2022] GET /compute/v2.1/servers/c030015c-4838-4450-9bf3-e3cf111b92ce => generated 1374 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:00.497387 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-748617dc-f972-4760-9175-5195ea2c7ebd tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:00.498007 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-748617dc-f972-4760-9175-5195ea2c7ebd tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:00.505326 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-748617dc-f972-4760-9175-5195ea2c7ebd tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:00.505820 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-748617dc-f972-4760-9175-5195ea2c7ebd tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:00.506262 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-748617dc-f972-4760-9175-5195ea2c7ebd tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:00.506967 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-748617dc-f972-4760-9175-5195ea2c7ebd tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:00.507428 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-748617dc-f972-4760-9175-5195ea2c7ebd tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:00.507862 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-748617dc-f972-4760-9175-5195ea2c7ebd tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:00.648430 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-748617dc-f972-4760-9175-5195ea2c7ebd tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:00.656651 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a180cc65-ba9d-4744-9895-e06126efb90b tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:00.657642 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-748617dc-f972-4760-9175-5195ea2c7ebd tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e" status: 200 len: 1697 microversion: 2.1 time: 0.164058 Oct 18 16:09:00.657818 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a180cc65-ba9d-4744-9895-e06126efb90b tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] [instance: c030015c-4838-4450-9bf3-e3cf111b92ce] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:00.658432 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3099/6218] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:00 2022] GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e => generated 1697 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:00.664906 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a180cc65-ba9d-4744-9895-e06126efb90b tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:00.665445 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a180cc65-ba9d-4744-9895-e06126efb90b tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:00.665842 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a180cc65-ba9d-4744-9895-e06126efb90b tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:00.666762 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a180cc65-ba9d-4744-9895-e06126efb90b tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:00.667557 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a180cc65-ba9d-4744-9895-e06126efb90b tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:00.668031 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a180cc65-ba9d-4744-9895-e06126efb90b tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:00.681219 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-2139c188-564a-4b03-99cc-e4c079556bf8 req-dc7be81d-32e2-4118-9097-6e2a1bfbbcde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c030015c-4838-4450-9bf3-e3cf111b92ce", "name": "network-vif-plugged", "status": "completed", "tag": "a5aad5f3-99ac-4880-8fd6-523580184225"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:09:00.691114 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2139c188-564a-4b03-99cc-e4c079556bf8 req-dc7be81d-32e2-4118-9097-6e2a1bfbbcde service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:00.691598 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2139c188-564a-4b03-99cc-e4c079556bf8 req-dc7be81d-32e2-4118-9097-6e2a1bfbbcde service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:00.692030 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2139c188-564a-4b03-99cc-e4c079556bf8 req-dc7be81d-32e2-4118-9097-6e2a1bfbbcde service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:00.704600 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-2139c188-564a-4b03-99cc-e4c079556bf8 req-dc7be81d-32e2-4118-9097-6e2a1bfbbcde service nova] Creating event network-vif-plugged:a5aad5f3-99ac-4880-8fd6-523580184225 for instance c030015c-4838-4450-9bf3-e3cf111b92ce on n-h2-853682-5 Oct 18 16:09:00.709885 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-2139c188-564a-4b03-99cc-e4c079556bf8 req-dc7be81d-32e2-4118-9097-6e2a1bfbbcde service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035138 Oct 18 16:09:00.710504 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3100/6219] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:09:00.815792 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a180cc65-ba9d-4744-9895-e06126efb90b tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4146336121e4788bbdead3c9dee1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a35c6e5d7d4e06afe028378c708ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:00.823647 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a180cc65-ba9d-4744-9895-e06126efb90b tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] 10.222.0.60 "GET /compute/v2.1/servers/c030015c-4838-4450-9bf3-e3cf111b92ce" status: 200 len: 1374 microversion: 2.1 time: 0.171972 Oct 18 16:09:00.824230 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3120/6220] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:00 2022] GET /compute/v2.1/servers/c030015c-4838-4450-9bf3-e3cf111b92ce => generated 1374 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:01.688319 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4c04565e-3feb-4b9b-8998-8c5cab8a7965 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:01.689806 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4c04565e-3feb-4b9b-8998-8c5cab8a7965 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:01.697636 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c04565e-3feb-4b9b-8998-8c5cab8a7965 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:01.698159 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c04565e-3feb-4b9b-8998-8c5cab8a7965 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:01.698597 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c04565e-3feb-4b9b-8998-8c5cab8a7965 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:01.699302 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c04565e-3feb-4b9b-8998-8c5cab8a7965 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:01.699758 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c04565e-3feb-4b9b-8998-8c5cab8a7965 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:01.700220 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c04565e-3feb-4b9b-8998-8c5cab8a7965 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:01.836337 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4c04565e-3feb-4b9b-8998-8c5cab8a7965 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:01.844466 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4c04565e-3feb-4b9b-8998-8c5cab8a7965 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e" status: 200 len: 1696 microversion: 2.1 time: 0.161076 Oct 18 16:09:01.847457 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3101/6221] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:01 2022] GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e => generated 1696 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:01.848710 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9cb2ca8e-be05-4ed2-bb5b-7c171ad1c9f1 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:01.849450 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9cb2ca8e-be05-4ed2-bb5b-7c171ad1c9f1 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] [instance: c030015c-4838-4450-9bf3-e3cf111b92ce] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:01.856404 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9cb2ca8e-be05-4ed2-bb5b-7c171ad1c9f1 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:01.857869 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9cb2ca8e-be05-4ed2-bb5b-7c171ad1c9f1 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:01.858522 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9cb2ca8e-be05-4ed2-bb5b-7c171ad1c9f1 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:01.859299 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9cb2ca8e-be05-4ed2-bb5b-7c171ad1c9f1 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:01.859882 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9cb2ca8e-be05-4ed2-bb5b-7c171ad1c9f1 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:01.860506 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9cb2ca8e-be05-4ed2-bb5b-7c171ad1c9f1 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:02.018613 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9cb2ca8e-be05-4ed2-bb5b-7c171ad1c9f1 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4146336121e4788bbdead3c9dee1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a35c6e5d7d4e06afe028378c708ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:02.027007 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9cb2ca8e-be05-4ed2-bb5b-7c171ad1c9f1 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] 10.222.0.60 "GET /compute/v2.1/servers/c030015c-4838-4450-9bf3-e3cf111b92ce" status: 200 len: 1374 microversion: 2.1 time: 0.183460 Oct 18 16:09:02.027614 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3121/6222] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:01 2022] GET /compute/v2.1/servers/c030015c-4838-4450-9bf3-e3cf111b92ce => generated 1374 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:02.327747 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-887d5e8b-5d56-43f2-a36e-1e082c5c8dab req-b7db3ac1-3e1b-4126-bd84-2ccbdf808e5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e", "name": "network-vif-unplugged", "status": "completed", "tag": "77ee77a9-de13-42b5-90c3-c13dc1e84544"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:09:02.337435 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-887d5e8b-5d56-43f2-a36e-1e082c5c8dab req-b7db3ac1-3e1b-4126-bd84-2ccbdf808e5c service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:02.337754 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-887d5e8b-5d56-43f2-a36e-1e082c5c8dab req-b7db3ac1-3e1b-4126-bd84-2ccbdf808e5c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:02.338127 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-887d5e8b-5d56-43f2-a36e-1e082c5c8dab req-b7db3ac1-3e1b-4126-bd84-2ccbdf808e5c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:02.350396 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-887d5e8b-5d56-43f2-a36e-1e082c5c8dab req-b7db3ac1-3e1b-4126-bd84-2ccbdf808e5c service nova] Creating event network-vif-unplugged:77ee77a9-de13-42b5-90c3-c13dc1e84544 for instance 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e on n-h2-853682-5 Oct 18 16:09:02.355819 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [req-887d5e8b-5d56-43f2-a36e-1e082c5c8dab req-b7db3ac1-3e1b-4126-bd84-2ccbdf808e5c service nova] Instance 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853682-5', 'n-h1-853682-5'} {{(pid=120406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 18 16:09:02.366673 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-887d5e8b-5d56-43f2-a36e-1e082c5c8dab req-b7db3ac1-3e1b-4126-bd84-2ccbdf808e5c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043372 Oct 18 16:09:02.367443 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3102/6223] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:09:02.870614 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-82536e75-b342-48fa-8628-3973398c37c0 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:02.871346 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-82536e75-b342-48fa-8628-3973398c37c0 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:02.874410 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:09:02.875256 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=10 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:09:02.877824 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:09:02.883728 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-82536e75-b342-48fa-8628-3973398c37c0 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:02.884228 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-82536e75-b342-48fa-8628-3973398c37c0 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:02.884672 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-82536e75-b342-48fa-8628-3973398c37c0 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:02.885417 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-82536e75-b342-48fa-8628-3973398c37c0 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:02.885881 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-82536e75-b342-48fa-8628-3973398c37c0 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:02.886317 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-82536e75-b342-48fa-8628-3973398c37c0 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:03.036493 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-82536e75-b342-48fa-8628-3973398c37c0 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:03.044747 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-82536e75-b342-48fa-8628-3973398c37c0 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e" status: 200 len: 1696 microversion: 2.1 time: 0.177989 Oct 18 16:09:03.046103 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3122/6224] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:02 2022] GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e => generated 1696 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:09:03.048565 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:09:03.054897 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-651eae46-94bf-4b73-b947-0b1194d1cef6 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:03.055651 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-651eae46-94bf-4b73-b947-0b1194d1cef6 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] [instance: c030015c-4838-4450-9bf3-e3cf111b92ce] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:03.061194 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:09:03.062818 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-651eae46-94bf-4b73-b947-0b1194d1cef6 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:03.063298 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-651eae46-94bf-4b73-b947-0b1194d1cef6 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:03.063728 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-651eae46-94bf-4b73-b947-0b1194d1cef6 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:03.064469 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-651eae46-94bf-4b73-b947-0b1194d1cef6 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:03.064961 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-651eae46-94bf-4b73-b947-0b1194d1cef6 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:03.065386 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-651eae46-94bf-4b73-b947-0b1194d1cef6 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:03.205270 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-651eae46-94bf-4b73-b947-0b1194d1cef6 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4146336121e4788bbdead3c9dee1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a35c6e5d7d4e06afe028378c708ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:03.212955 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-651eae46-94bf-4b73-b947-0b1194d1cef6 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] 10.222.0.60 "GET /compute/v2.1/servers/c030015c-4838-4450-9bf3-e3cf111b92ce" status: 200 len: 1546 microversion: 2.1 time: 0.165317 Oct 18 16:09:03.213535 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3103/6225] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:03 2022] GET /compute/v2.1/servers/c030015c-4838-4450-9bf3-e3cf111b92ce => generated 1546 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:03.235599 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3885e26d-b33d-4893-84c8-7f83e7996221 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:03.236258 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3885e26d-b33d-4893-84c8-7f83e7996221 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] [instance: c030015c-4838-4450-9bf3-e3cf111b92ce] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:03.242273 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3885e26d-b33d-4893-84c8-7f83e7996221 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:03.242769 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3885e26d-b33d-4893-84c8-7f83e7996221 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:03.243215 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3885e26d-b33d-4893-84c8-7f83e7996221 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:03.243918 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3885e26d-b33d-4893-84c8-7f83e7996221 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:03.244378 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3885e26d-b33d-4893-84c8-7f83e7996221 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:03.244840 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3885e26d-b33d-4893-84c8-7f83e7996221 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:03.384941 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3885e26d-b33d-4893-84c8-7f83e7996221 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4146336121e4788bbdead3c9dee1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a35c6e5d7d4e06afe028378c708ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:03.393322 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3885e26d-b33d-4893-84c8-7f83e7996221 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] 10.222.0.60 "GET /compute/v2.1/servers/c030015c-4838-4450-9bf3-e3cf111b92ce" status: 200 len: 1546 microversion: 2.1 time: 0.161788 Oct 18 16:09:03.393911 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3123/6226] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:03 2022] GET /compute/v2.1/servers/c030015c-4838-4450-9bf3-e3cf111b92ce => generated 1546 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:04.069398 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-30b8f31d-e92c-4395-895e-233086692316 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:04.070019 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-30b8f31d-e92c-4395-895e-233086692316 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:04.076954 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30b8f31d-e92c-4395-895e-233086692316 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:04.077440 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30b8f31d-e92c-4395-895e-233086692316 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:04.077878 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30b8f31d-e92c-4395-895e-233086692316 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:04.078583 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30b8f31d-e92c-4395-895e-233086692316 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:04.079045 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30b8f31d-e92c-4395-895e-233086692316 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:04.079476 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30b8f31d-e92c-4395-895e-233086692316 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:04.300256 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-30b8f31d-e92c-4395-895e-233086692316 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:04.308284 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-30b8f31d-e92c-4395-895e-233086692316 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e" status: 200 len: 1694 microversion: 2.1 time: 0.242914 Oct 18 16:09:04.308928 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3104/6227] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:04 2022] GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e => generated 1694 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:09:04.402079 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-abfec559-5ad5-47a0-bf81-91bacced9725 req-942c78e8-5687-4497-8702-69fed8129fae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e", "tag": "77ee77a9-de13-42b5-90c3-c13dc1e84544"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:09:04.413197 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-abfec559-5ad5-47a0-bf81-91bacced9725 req-942c78e8-5687-4497-8702-69fed8129fae service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:04.413762 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-abfec559-5ad5-47a0-bf81-91bacced9725 req-942c78e8-5687-4497-8702-69fed8129fae service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:04.414288 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-abfec559-5ad5-47a0-bf81-91bacced9725 req-942c78e8-5687-4497-8702-69fed8129fae service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:04.427541 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-abfec559-5ad5-47a0-bf81-91bacced9725 req-942c78e8-5687-4497-8702-69fed8129fae service nova] Creating event network-changed:77ee77a9-de13-42b5-90c3-c13dc1e84544 for instance 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e on n-h2-853682-5 Oct 18 16:09:04.432981 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [req-abfec559-5ad5-47a0-bf81-91bacced9725 req-942c78e8-5687-4497-8702-69fed8129fae service nova] Instance 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853682-5', 'n-h1-853682-5'} {{(pid=120405) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 18 16:09:04.444284 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-abfec559-5ad5-47a0-bf81-91bacced9725 req-942c78e8-5687-4497-8702-69fed8129fae service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045922 Oct 18 16:09:04.444923 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3124/6228] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:09:05.334517 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a9000671-3d94-4a95-b4cd-5e521a06dc47 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:05.335137 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a9000671-3d94-4a95-b4cd-5e521a06dc47 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:05.343237 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9000671-3d94-4a95-b4cd-5e521a06dc47 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:05.343799 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9000671-3d94-4a95-b4cd-5e521a06dc47 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:05.344479 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9000671-3d94-4a95-b4cd-5e521a06dc47 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:05.345231 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9000671-3d94-4a95-b4cd-5e521a06dc47 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:05.345731 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9000671-3d94-4a95-b4cd-5e521a06dc47 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:05.346167 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9000671-3d94-4a95-b4cd-5e521a06dc47 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:05.477229 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-9fe6be28-6644-45be-80b3-7b6182ca6ab2 req-9bc91504-928f-4f63-abf5-eeb10bb071c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c030015c-4838-4450-9bf3-e3cf111b92ce", "tag": "a5aad5f3-99ac-4880-8fd6-523580184225"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:09:05.490126 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-9fe6be28-6644-45be-80b3-7b6182ca6ab2 req-9bc91504-928f-4f63-abf5-eeb10bb071c8 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:05.490886 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-9fe6be28-6644-45be-80b3-7b6182ca6ab2 req-9bc91504-928f-4f63-abf5-eeb10bb071c8 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:05.491527 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-9fe6be28-6644-45be-80b3-7b6182ca6ab2 req-9bc91504-928f-4f63-abf5-eeb10bb071c8 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:05.505956 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-9fe6be28-6644-45be-80b3-7b6182ca6ab2 req-9bc91504-928f-4f63-abf5-eeb10bb071c8 service nova] Creating event network-changed:a5aad5f3-99ac-4880-8fd6-523580184225 for instance c030015c-4838-4450-9bf3-e3cf111b92ce on n-h2-853682-5 Oct 18 16:09:05.511588 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-9fe6be28-6644-45be-80b3-7b6182ca6ab2 req-9bc91504-928f-4f63-abf5-eeb10bb071c8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039451 Oct 18 16:09:05.512863 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3125/6229] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:09:05.534079 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a9000671-3d94-4a95-b4cd-5e521a06dc47 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:05.542692 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a9000671-3d94-4a95-b4cd-5e521a06dc47 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e" status: 200 len: 1691 microversion: 2.1 time: 0.212273 Oct 18 16:09:05.543649 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3105/6230] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:05 2022] GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e => generated 1691 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:05.568415 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-624bc8c2-5e4f-4a98-a411-49c34d8884c4 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:09:05.569374 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-624bc8c2-5e4f-4a98-a411-49c34d8884c4 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:05.575690 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-624bc8c2-5e4f-4a98-a411-49c34d8884c4 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:05.576220 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-624bc8c2-5e4f-4a98-a411-49c34d8884c4 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:05.576870 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-624bc8c2-5e4f-4a98-a411-49c34d8884c4 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:05.577525 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-624bc8c2-5e4f-4a98-a411-49c34d8884c4 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:05.577988 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-624bc8c2-5e4f-4a98-a411-49c34d8884c4 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:05.578429 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-624bc8c2-5e4f-4a98-a411-49c34d8884c4 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:05.642453 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-624bc8c2-5e4f-4a98-a411-49c34d8884c4 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "POST /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e/action" status: 204 len: 0 microversion: 2.1 time: 0.078313 Oct 18 16:09:05.643558 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3126/6231] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:09:05 2022] POST /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e/action => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:09:05.658176 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2a352e4d-cfed-46e9-89af-ad8ff53f85e8 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:05.660948 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2a352e4d-cfed-46e9-89af-ad8ff53f85e8 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:05.673794 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a352e4d-cfed-46e9-89af-ad8ff53f85e8 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:05.674606 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a352e4d-cfed-46e9-89af-ad8ff53f85e8 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:05.675557 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a352e4d-cfed-46e9-89af-ad8ff53f85e8 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:05.676659 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a352e4d-cfed-46e9-89af-ad8ff53f85e8 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:05.677356 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a352e4d-cfed-46e9-89af-ad8ff53f85e8 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:05.677986 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a352e4d-cfed-46e9-89af-ad8ff53f85e8 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:05.838724 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2a352e4d-cfed-46e9-89af-ad8ff53f85e8 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:05.847633 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2a352e4d-cfed-46e9-89af-ad8ff53f85e8 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e" status: 200 len: 1691 microversion: 2.1 time: 0.199512 Oct 18 16:09:05.848284 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3106/6232] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:05 2022] GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e => generated 1691 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:06.873063 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c0dc7b32-1ba3-4f46-b288-6d5df588103e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:06.873774 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c0dc7b32-1ba3-4f46-b288-6d5df588103e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:06.880048 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c0dc7b32-1ba3-4f46-b288-6d5df588103e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:06.880534 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c0dc7b32-1ba3-4f46-b288-6d5df588103e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:06.881016 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c0dc7b32-1ba3-4f46-b288-6d5df588103e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:06.881708 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c0dc7b32-1ba3-4f46-b288-6d5df588103e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:06.882168 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c0dc7b32-1ba3-4f46-b288-6d5df588103e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:06.882598 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c0dc7b32-1ba3-4f46-b288-6d5df588103e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:07.018309 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c0dc7b32-1ba3-4f46-b288-6d5df588103e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:07.026135 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c0dc7b32-1ba3-4f46-b288-6d5df588103e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e" status: 200 len: 1691 microversion: 2.1 time: 0.158331 Oct 18 16:09:07.026716 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3127/6233] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:06 2022] GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:08.050584 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-80cc8531-e4b9-46d5-a5be-b0e9e50afd84 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:08.051233 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-80cc8531-e4b9-46d5-a5be-b0e9e50afd84 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:08.058126 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80cc8531-e4b9-46d5-a5be-b0e9e50afd84 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:08.058619 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80cc8531-e4b9-46d5-a5be-b0e9e50afd84 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:08.059061 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80cc8531-e4b9-46d5-a5be-b0e9e50afd84 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:08.059754 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80cc8531-e4b9-46d5-a5be-b0e9e50afd84 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:08.060213 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80cc8531-e4b9-46d5-a5be-b0e9e50afd84 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:08.060646 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80cc8531-e4b9-46d5-a5be-b0e9e50afd84 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:08.193393 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-80cc8531-e4b9-46d5-a5be-b0e9e50afd84 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:08.201254 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-80cc8531-e4b9-46d5-a5be-b0e9e50afd84 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e" status: 200 len: 1683 microversion: 2.1 time: 0.154790 Oct 18 16:09:08.201757 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3107/6234] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:08 2022] GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:08.667998 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-aa04c613-0433-4dcd-b0fa-1f2447650869 req-d5f7172c-5fd0-4b4b-8810-046a4fbba00a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e", "name": "network-vif-plugged", "status": "completed", "tag": "77ee77a9-de13-42b5-90c3-c13dc1e84544"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:09:08.679855 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-aa04c613-0433-4dcd-b0fa-1f2447650869 req-d5f7172c-5fd0-4b4b-8810-046a4fbba00a service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:08.680384 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-aa04c613-0433-4dcd-b0fa-1f2447650869 req-d5f7172c-5fd0-4b4b-8810-046a4fbba00a service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:08.680836 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-aa04c613-0433-4dcd-b0fa-1f2447650869 req-d5f7172c-5fd0-4b4b-8810-046a4fbba00a service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:08.694035 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-aa04c613-0433-4dcd-b0fa-1f2447650869 req-d5f7172c-5fd0-4b4b-8810-046a4fbba00a service nova] Creating event network-vif-plugged:77ee77a9-de13-42b5-90c3-c13dc1e84544 for instance 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e on n-h2-853682-5 Oct 18 16:09:08.699078 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-aa04c613-0433-4dcd-b0fa-1f2447650869 req-d5f7172c-5fd0-4b4b-8810-046a4fbba00a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034847 Oct 18 16:09:08.699762 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3128/6235] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:09:28.772264 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2d7a0a3f-c6fb-46e3-ba50-897c3c65c3bf tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:09:28.774657 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2d7a0a3f-c6fb-46e3-ba50-897c3c65c3bf tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] [instance: c030015c-4838-4450-9bf3-e3cf111b92ce] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:28.777608 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=9 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:09:28.778270 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=52 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:09:28.783846 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d7a0a3f-c6fb-46e3-ba50-897c3c65c3bf tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:28.784327 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d7a0a3f-c6fb-46e3-ba50-897c3c65c3bf tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:28.784757 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d7a0a3f-c6fb-46e3-ba50-897c3c65c3bf tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:28.785473 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d7a0a3f-c6fb-46e3-ba50-897c3c65c3bf tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:28.785926 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d7a0a3f-c6fb-46e3-ba50-897c3c65c3bf tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:28.786348 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d7a0a3f-c6fb-46e3-ba50-897c3c65c3bf tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:28.839241 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2d7a0a3f-c6fb-46e3-ba50-897c3c65c3bf tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] 10.222.0.60 "POST /compute/v2.1/servers/c030015c-4838-4450-9bf3-e3cf111b92ce/action" status: 200 len: 24572 microversion: 2.1 time: 0.070646 Oct 18 16:09:28.839841 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3108/6236] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:09:28 2022] POST /compute/v2.1/servers/c030015c-4838-4450-9bf3-e3cf111b92ce/action => generated 24572 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:09:30.388126 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=13 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:09:30.388916 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:09:30.393392 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-30a3be7b-cc6b-41a1-a624-ada04e3e8395 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:09:30.395653 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-30a3be7b-cc6b-41a1-a624-ada04e3e8395 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:30.402959 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-30a3be7b-cc6b-41a1-a624-ada04e3e8395 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:30.403438 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-30a3be7b-cc6b-41a1-a624-ada04e3e8395 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:30.403873 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-30a3be7b-cc6b-41a1-a624-ada04e3e8395 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:30.404561 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-30a3be7b-cc6b-41a1-a624-ada04e3e8395 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:30.405046 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-30a3be7b-cc6b-41a1-a624-ada04e3e8395 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:30.405470 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-30a3be7b-cc6b-41a1-a624-ada04e3e8395 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:30.460232 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-30a3be7b-cc6b-41a1-a624-ada04e3e8395 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "POST /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e/action" status: 200 len: 24559 microversion: 2.1 time: 0.073833 Oct 18 16:09:30.460928 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3129/6237] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:09:30 2022] POST /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e/action => generated 24559 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:09:36.646549 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1eab99c4-e4de-43d2-a81b-cf9b105a7cef tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:36.647281 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1eab99c4-e4de-43d2-a81b-cf9b105a7cef tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] [instance: 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:36.654949 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1eab99c4-e4de-43d2-a81b-cf9b105a7cef tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:36.655434 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1eab99c4-e4de-43d2-a81b-cf9b105a7cef tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:36.655875 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1eab99c4-e4de-43d2-a81b-cf9b105a7cef tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:36.656570 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1eab99c4-e4de-43d2-a81b-cf9b105a7cef tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:36.657053 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1eab99c4-e4de-43d2-a81b-cf9b105a7cef tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:36.657485 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1eab99c4-e4de-43d2-a81b-cf9b105a7cef tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:36.788697 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1eab99c4-e4de-43d2-a81b-cf9b105a7cef tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e" status: 200 len: 1834 microversion: 2.1 time: 0.146345 Oct 18 16:09:36.789313 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3109/6238] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:36 2022] GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e => generated 1834 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:37.634507 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-bbe73681-eddb-4866-a82d-448235d66ad4 req-399585a1-f217-4ec1-a932-af4ca80fb130 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e", "tag": "77ee77a9-de13-42b5-90c3-c13dc1e84544"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:09:37.641724 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6fe74600-4b52-4116-8802-4972f649611f tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:37.642323 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6fe74600-4b52-4116-8802-4972f649611f tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:37.656476 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6fe74600-4b52-4116-8802-4972f649611f tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:37.657009 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6fe74600-4b52-4116-8802-4972f649611f tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:37.657457 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6fe74600-4b52-4116-8802-4972f649611f tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:37.658178 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6fe74600-4b52-4116-8802-4972f649611f tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:37.658697 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6fe74600-4b52-4116-8802-4972f649611f tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:37.659639 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6fe74600-4b52-4116-8802-4972f649611f tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:37.662622 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-bbe73681-eddb-4866-a82d-448235d66ad4 req-399585a1-f217-4ec1-a932-af4ca80fb130 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:37.662622 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-bbe73681-eddb-4866-a82d-448235d66ad4 req-399585a1-f217-4ec1-a932-af4ca80fb130 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:37.662622 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-bbe73681-eddb-4866-a82d-448235d66ad4 req-399585a1-f217-4ec1-a932-af4ca80fb130 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:37.673881 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-bbe73681-eddb-4866-a82d-448235d66ad4 req-399585a1-f217-4ec1-a932-af4ca80fb130 service nova] Creating event network-changed:77ee77a9-de13-42b5-90c3-c13dc1e84544 for instance 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e on n-h2-853682-5 Oct 18 16:09:37.680860 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-bbe73681-eddb-4866-a82d-448235d66ad4 req-399585a1-f217-4ec1-a932-af4ca80fb130 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048670 Oct 18 16:09:37.683692 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3110/6239] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:09:37.693203 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6fe74600-4b52-4116-8802-4972f649611f tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:09:37.795068 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6fe74600-4b52-4116-8802-4972f649611f tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "DELETE /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e" status: 204 len: 0 microversion: 2.1 time: 0.165149 Oct 18 16:09:37.799338 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3130/6240] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 16:09:37 2022] DELETE /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:09:37.806992 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7852ceee-f229-4e5d-8523-0639c14b1adf tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:37.807705 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7852ceee-f229-4e5d-8523-0639c14b1adf tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:37.816699 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7852ceee-f229-4e5d-8523-0639c14b1adf tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:37.817276 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7852ceee-f229-4e5d-8523-0639c14b1adf tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:37.817751 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7852ceee-f229-4e5d-8523-0639c14b1adf tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:37.818499 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7852ceee-f229-4e5d-8523-0639c14b1adf tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:37.819006 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7852ceee-f229-4e5d-8523-0639c14b1adf tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:37.819480 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7852ceee-f229-4e5d-8523-0639c14b1adf tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:37.970629 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7852ceee-f229-4e5d-8523-0639c14b1adf tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:37.979070 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7852ceee-f229-4e5d-8523-0639c14b1adf tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e" status: 200 len: 1689 microversion: 2.1 time: 0.177093 Oct 18 16:09:37.979648 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3111/6241] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:37 2022] GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e => generated 1689 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:39.004863 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c962bd21-8b4f-4822-95d2-29e82e9a30dd tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:39.005613 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c962bd21-8b4f-4822-95d2-29e82e9a30dd tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:39.012431 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c962bd21-8b4f-4822-95d2-29e82e9a30dd tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:39.012987 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c962bd21-8b4f-4822-95d2-29e82e9a30dd tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:39.013435 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c962bd21-8b4f-4822-95d2-29e82e9a30dd tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:39.014140 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c962bd21-8b4f-4822-95d2-29e82e9a30dd tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:39.014605 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c962bd21-8b4f-4822-95d2-29e82e9a30dd tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:39.015043 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c962bd21-8b4f-4822-95d2-29e82e9a30dd tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:39.149387 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c962bd21-8b4f-4822-95d2-29e82e9a30dd tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:39.157235 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c962bd21-8b4f-4822-95d2-29e82e9a30dd tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e" status: 200 len: 1689 microversion: 2.1 time: 0.157425 Oct 18 16:09:39.157821 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3131/6242] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:38 2022] GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:39.698003 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-38e03394-3f55-4c19-9f8a-186ef0ecfe93 req-7276cf09-5cdc-46dd-b598-09410b5e0a97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e", "name": "network-vif-deleted", "tag": "77ee77a9-de13-42b5-90c3-c13dc1e84544"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:09:39.711319 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-38e03394-3f55-4c19-9f8a-186ef0ecfe93 req-7276cf09-5cdc-46dd-b598-09410b5e0a97 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:39.712674 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-38e03394-3f55-4c19-9f8a-186ef0ecfe93 req-7276cf09-5cdc-46dd-b598-09410b5e0a97 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:39.713213 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-38e03394-3f55-4c19-9f8a-186ef0ecfe93 req-7276cf09-5cdc-46dd-b598-09410b5e0a97 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:39.726878 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-38e03394-3f55-4c19-9f8a-186ef0ecfe93 req-7276cf09-5cdc-46dd-b598-09410b5e0a97 service nova] Creating event network-vif-deleted:77ee77a9-de13-42b5-90c3-c13dc1e84544 for instance 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e on n-h2-853682-5 Oct 18 16:09:39.732225 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-38e03394-3f55-4c19-9f8a-186ef0ecfe93 req-7276cf09-5cdc-46dd-b598-09410b5e0a97 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038133 Oct 18 16:09:39.733034 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3112/6243] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:09:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:09:39.835542 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fcc3a484-d90d-4afc-95a9-0e2743b3ea3a tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:09:39.837880 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-fcc3a484-d90d-4afc-95a9-0e2743b3ea3a tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] [instance: c030015c-4838-4450-9bf3-e3cf111b92ce] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:39.844427 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fcc3a484-d90d-4afc-95a9-0e2743b3ea3a tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:39.845035 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fcc3a484-d90d-4afc-95a9-0e2743b3ea3a tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:39.845481 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fcc3a484-d90d-4afc-95a9-0e2743b3ea3a tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:39.846199 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fcc3a484-d90d-4afc-95a9-0e2743b3ea3a tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:39.846676 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fcc3a484-d90d-4afc-95a9-0e2743b3ea3a tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:39.847087 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fcc3a484-d90d-4afc-95a9-0e2743b3ea3a tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:39.905368 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fcc3a484-d90d-4afc-95a9-0e2743b3ea3a tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] 10.222.0.60 "POST /compute/v2.1/servers/c030015c-4838-4450-9bf3-e3cf111b92ce/action" status: 200 len: 32644 microversion: 2.1 time: 0.073056 Oct 18 16:09:39.910704 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3132/6244] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:09:39 2022] POST /compute/v2.1/servers/c030015c-4838-4450-9bf3-e3cf111b92ce/action => generated 32644 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:09:40.182108 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4acecece-c406-4d70-ab77-41dd46d83cc0 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:40.182865 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4acecece-c406-4d70-ab77-41dd46d83cc0 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:40.189203 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4acecece-c406-4d70-ab77-41dd46d83cc0 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:40.189706 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4acecece-c406-4d70-ab77-41dd46d83cc0 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:40.190149 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4acecece-c406-4d70-ab77-41dd46d83cc0 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:40.190849 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4acecece-c406-4d70-ab77-41dd46d83cc0 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:40.191312 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4acecece-c406-4d70-ab77-41dd46d83cc0 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:40.191745 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4acecece-c406-4d70-ab77-41dd46d83cc0 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:40.205320 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-4acecece-c406-4d70-ab77-41dd46d83cc0 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] HTTP exception thrown: Instance 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e could not be found. Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4acecece-c406-4d70-ab77-41dd46d83cc0 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Request method failure captured: Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e HTTP/1.1 Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTs8upjSfiwu14tRxn4v0SgmAedKIqRyez8Aw8SOZdWUfAF0oMQr1R7xRzarToYQHo42vdtsSxTu7-2HkwGui-JshrtyxJTkQsS83jVEOu3jeAOKtt4DIMDKQgSeb11ABNJcyR5RNHKJLx2pVrTjzxDpmJ_EBIOFJJALPV4oSx6sXUQQ Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: a7b4ef10957e43b8a57a419fa0d6de0e Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-581510455 Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a7b4ef10957e43b8a57a419fa0d6de0e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a7b4ef10957e43b8a57a419fa0d6de0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a7b4ef10957e43b8a57a419fa0d6de0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a7b4ef10957e43b8a57a419fa0d6de0e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-TestNetworkAdvancedServerOps-581510455 Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: a7b4ef10957e43b8a57a419fa0d6de0e Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-581510455 Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-TestNetworkAdvancedServerOps-581510455-project Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 153a83de00ae4445a1efd17d70990630 Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-TestNetworkAdvancedServerOps-581510455-project Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e could not be found. Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e'} Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e could not be found. Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e could not be found. Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:09:40.207087 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:09:40.216145 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:09:40.216145 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:09:40.216145 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:09:40.216145 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:09:40.216145 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:09:40.216145 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:09:40.216145 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e could not be found. Oct 18 16:09:40.216145 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:09:40.216145 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4acecece-c406-4d70-ab77-41dd46d83cc0 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Returning 404 to user: Instance 40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:09:40.216145 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4acecece-c406-4d70-ab77-41dd46d83cc0 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e" status: 404 len: 111 microversion: 2.1 time: 0.030739 Oct 18 16:09:40.216145 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3113/6245] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:40 2022] GET /compute/v2.1/servers/40265cb6-8a0c-4ff9-a2cc-3e8b442ab90e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:09:40.969834 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-90133098-2b0b-46e2-a0b5-3907293ce05b tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:40.970882 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-a65444a7-374e-4686-9a62-cca0a1e3e2ea req-4f71761d-7488-4c3f-8d3b-50db3675f3c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c030015c-4838-4450-9bf3-e3cf111b92ce", "tag": "a5aad5f3-99ac-4880-8fd6-523580184225"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:09:40.973716 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-90133098-2b0b-46e2-a0b5-3907293ce05b tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] [instance: c030015c-4838-4450-9bf3-e3cf111b92ce] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:40.981658 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-90133098-2b0b-46e2-a0b5-3907293ce05b tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:40.983106 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a65444a7-374e-4686-9a62-cca0a1e3e2ea req-4f71761d-7488-4c3f-8d3b-50db3675f3c8 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:40.983662 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a65444a7-374e-4686-9a62-cca0a1e3e2ea req-4f71761d-7488-4c3f-8d3b-50db3675f3c8 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:40.983935 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-90133098-2b0b-46e2-a0b5-3907293ce05b tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:40.984250 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a65444a7-374e-4686-9a62-cca0a1e3e2ea req-4f71761d-7488-4c3f-8d3b-50db3675f3c8 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:40.984768 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-90133098-2b0b-46e2-a0b5-3907293ce05b tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:40.985699 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-90133098-2b0b-46e2-a0b5-3907293ce05b tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:40.986351 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-90133098-2b0b-46e2-a0b5-3907293ce05b tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:40.987922 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-90133098-2b0b-46e2-a0b5-3907293ce05b tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:40.998909 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-a65444a7-374e-4686-9a62-cca0a1e3e2ea req-4f71761d-7488-4c3f-8d3b-50db3675f3c8 service nova] Creating event network-changed:a5aad5f3-99ac-4880-8fd6-523580184225 for instance c030015c-4838-4450-9bf3-e3cf111b92ce on n-h2-853682-5 Oct 18 16:09:41.004663 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-a65444a7-374e-4686-9a62-cca0a1e3e2ea req-4f71761d-7488-4c3f-8d3b-50db3675f3c8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037498 Oct 18 16:09:41.009089 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3114/6246] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:09:41.035024 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-90133098-2b0b-46e2-a0b5-3907293ce05b tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] [instance: c030015c-4838-4450-9bf3-e3cf111b92ce] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:09:41.138564 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-90133098-2b0b-46e2-a0b5-3907293ce05b tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c030015c-4838-4450-9bf3-e3cf111b92ce" status: 204 len: 0 microversion: 2.1 time: 0.175256 Oct 18 16:09:41.140967 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3133/6247] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 16:09:40 2022] DELETE /compute/v2.1/servers/c030015c-4838-4450-9bf3-e3cf111b92ce => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:09:41.150608 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8276d0b1-b8b5-4723-adf5-fe6774f2c9d7 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:41.151491 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8276d0b1-b8b5-4723-adf5-fe6774f2c9d7 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] [instance: c030015c-4838-4450-9bf3-e3cf111b92ce] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:41.159982 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8276d0b1-b8b5-4723-adf5-fe6774f2c9d7 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:41.160597 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8276d0b1-b8b5-4723-adf5-fe6774f2c9d7 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:41.161785 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8276d0b1-b8b5-4723-adf5-fe6774f2c9d7 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:41.162599 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8276d0b1-b8b5-4723-adf5-fe6774f2c9d7 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:41.164117 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8276d0b1-b8b5-4723-adf5-fe6774f2c9d7 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:41.165592 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8276d0b1-b8b5-4723-adf5-fe6774f2c9d7 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:41.509808 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8276d0b1-b8b5-4723-adf5-fe6774f2c9d7 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4146336121e4788bbdead3c9dee1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a35c6e5d7d4e06afe028378c708ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:41.517953 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8276d0b1-b8b5-4723-adf5-fe6774f2c9d7 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] 10.222.0.60 "GET /compute/v2.1/servers/c030015c-4838-4450-9bf3-e3cf111b92ce" status: 200 len: 1669 microversion: 2.1 time: 0.371821 Oct 18 16:09:41.518777 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3115/6248] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:41 2022] GET /compute/v2.1/servers/c030015c-4838-4450-9bf3-e3cf111b92ce => generated 1669 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:42.541963 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2c7f5e44-4a38-4c76-8904-fb14a82a4339 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:42.543271 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2c7f5e44-4a38-4c76-8904-fb14a82a4339 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] [instance: c030015c-4838-4450-9bf3-e3cf111b92ce] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:42.551348 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c7f5e44-4a38-4c76-8904-fb14a82a4339 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:42.552141 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c7f5e44-4a38-4c76-8904-fb14a82a4339 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:42.552760 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c7f5e44-4a38-4c76-8904-fb14a82a4339 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:42.553905 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c7f5e44-4a38-4c76-8904-fb14a82a4339 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:42.554894 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c7f5e44-4a38-4c76-8904-fb14a82a4339 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:42.555485 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c7f5e44-4a38-4c76-8904-fb14a82a4339 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:42.864450 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2c7f5e44-4a38-4c76-8904-fb14a82a4339 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4146336121e4788bbdead3c9dee1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a35c6e5d7d4e06afe028378c708ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:42.874860 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2c7f5e44-4a38-4c76-8904-fb14a82a4339 tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] 10.222.0.60 "GET /compute/v2.1/servers/c030015c-4838-4450-9bf3-e3cf111b92ce" status: 200 len: 1669 microversion: 2.1 time: 0.337196 Oct 18 16:09:42.876031 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3134/6249] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:42 2022] GET /compute/v2.1/servers/c030015c-4838-4450-9bf3-e3cf111b92ce => generated 1669 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:43.327624 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-d588b068-c4ad-4c68-b6fc-a73425feebea req-c8aab7eb-37f4-43f7-811e-ab76ea824605 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c030015c-4838-4450-9bf3-e3cf111b92ce", "name": "network-vif-deleted", "tag": "a5aad5f3-99ac-4880-8fd6-523580184225"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:09:43.353645 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d588b068-c4ad-4c68-b6fc-a73425feebea req-c8aab7eb-37f4-43f7-811e-ab76ea824605 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:43.355362 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d588b068-c4ad-4c68-b6fc-a73425feebea req-c8aab7eb-37f4-43f7-811e-ab76ea824605 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:43.356061 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d588b068-c4ad-4c68-b6fc-a73425feebea req-c8aab7eb-37f4-43f7-811e-ab76ea824605 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:43.383325 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-d588b068-c4ad-4c68-b6fc-a73425feebea req-c8aab7eb-37f4-43f7-811e-ab76ea824605 service nova] Creating event network-vif-deleted:a5aad5f3-99ac-4880-8fd6-523580184225 for instance c030015c-4838-4450-9bf3-e3cf111b92ce on n-h2-853682-5 Oct 18 16:09:43.390926 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-d588b068-c4ad-4c68-b6fc-a73425feebea req-c8aab7eb-37f4-43f7-811e-ab76ea824605 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070215 Oct 18 16:09:43.392595 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3116/6250] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:09:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:09:43.905480 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f0066e51-50ee-4c72-ad21-a63d31da157b tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:43.906374 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f0066e51-50ee-4c72-ad21-a63d31da157b tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] [instance: c030015c-4838-4450-9bf3-e3cf111b92ce] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:43.913758 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f0066e51-50ee-4c72-ad21-a63d31da157b tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:43.914742 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f0066e51-50ee-4c72-ad21-a63d31da157b tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:43.915173 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f0066e51-50ee-4c72-ad21-a63d31da157b tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:43.916522 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f0066e51-50ee-4c72-ad21-a63d31da157b tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:43.925998 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f0066e51-50ee-4c72-ad21-a63d31da157b tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:43.926877 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f0066e51-50ee-4c72-ad21-a63d31da157b tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:43.946436 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-f0066e51-50ee-4c72-ad21-a63d31da157b tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] HTTP exception thrown: Instance c030015c-4838-4450-9bf3-e3cf111b92ce could not be found. Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f0066e51-50ee-4c72-ad21-a63d31da157b tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Request method failure captured: Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/c030015c-4838-4450-9bf3-e3cf111b92ce HTTP/1.1 Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTs8MgvpZ2Qvg56YnAMhfsl_c35aSf_xkZH-twsjNqBFoRU6Q7lxNgzQFgL7Z8yTudPxUrf7s1ArTetHOo3pjYjiz7kk6-c0En0rnv2tuFtWGlvEzntiZHtx3P2rFw-ynoxhZKe35-AW22WIDXclqJsYL4k0zSXcRnx_wjiAC5q7M4eU Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 10a35c6e5d7d4e06afe028378c708ba6 Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-TestNetworkBasicOps-212718616 Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/10a35c6e5d7d4e06afe028378c708ba6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/10a35c6e5d7d4e06afe028378c708ba6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/10a35c6e5d7d4e06afe028378c708ba6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_10a35c6e5d7d4e06afe028378c708ba6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-TestNetworkBasicOps-212718616 Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 10a35c6e5d7d4e06afe028378c708ba6 Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-TestNetworkBasicOps-212718616 Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-TestNetworkBasicOps-212718616-project Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: f4146336121e4788bbdead3c9dee1c5f Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-TestNetworkBasicOps-212718616-project Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance c030015c-4838-4450-9bf3-e3cf111b92ce could not be found. Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'c030015c-4838-4450-9bf3-e3cf111b92ce'} Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c030015c-4838-4450-9bf3-e3cf111b92ce could not be found. Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c030015c-4838-4450-9bf3-e3cf111b92ce could not be found. Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:09:43.948455 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:09:43.953738 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:09:43.953738 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:09:43.953738 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:09:43.953738 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:09:43.953738 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:09:43.953738 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c030015c-4838-4450-9bf3-e3cf111b92ce could not be found. Oct 18 16:09:43.953738 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:09:43.953738 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f0066e51-50ee-4c72-ad21-a63d31da157b tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Returning 404 to user: Instance c030015c-4838-4450-9bf3-e3cf111b92ce could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:09:43.953738 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f0066e51-50ee-4c72-ad21-a63d31da157b tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] 10.222.0.60 "GET /compute/v2.1/servers/c030015c-4838-4450-9bf3-e3cf111b92ce" status: 404 len: 111 microversion: 2.1 time: 0.052971 Oct 18 16:09:43.953738 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3135/6251] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:43 2022] GET /compute/v2.1/servers/c030015c-4838-4450-9bf3-e3cf111b92ce => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:09:44.099358 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4765a985-7b07-4f71-a545-5e0d562ce72d tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '.version_select at 0x7f7c37d40700>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:44.130681 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4765a985-7b07-4f71-a545-5e0d562ce72d tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1427916836" status: 202 len: 0 microversion: 2.1 time: 0.038221 Oct 18 16:09:44.131723 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3117/6252] 10.222.0.60 () {58 vars in 1284 bytes} [Tue Oct 18 16:09:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1427916836 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:09:44.138611 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-51cfdf83-5102-4232-9c5d-b02a5210210a tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] Calling method '.version_select at 0x7f7c3d10e790>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:44.166293 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-51cfdf83-5102-4232-9c5d-b02a5210210a tempest-TestNetworkBasicOps-212718616 tempest-TestNetworkBasicOps-212718616-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1502426809" status: 202 len: 0 microversion: 2.1 time: 0.032261 Oct 18 16:09:44.166674 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-29885b0a-e288-482e-91f5-b33ea8a03b2c tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Action: 'create', calling method: .version_select at 0x7f7c37be38b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1896880976", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBEF6AZIw2UclLuhbeSRXbKPu6+ZNSmWTXFM9o/aFqr3ZocgwWbMTSOUl2nQw7UBolNU7Vb/RQjNtxkVIu8s35owy6pjYwBpZyU+3unnALy5zWZQ0n++Pk+F9OIBSq2hGQ=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:09:44.167462 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3136/6253] 10.222.0.60 () {58 vars in 1257 bytes} [Tue Oct 18 16:09:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1502426809 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:09:44.185335 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-29885b0a-e288-482e-91f5-b33ea8a03b2c tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Getting quotas for project a7b4ef10957e43b8a57a419fa0d6de0e. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:09:44.191093 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-29885b0a-e288-482e-91f5-b33ea8a03b2c tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Getting quotas for user 153a83de00ae4445a1efd17d70990630 and project a7b4ef10957e43b8a57a419fa0d6de0e. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:09:44.214751 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-29885b0a-e288-482e-91f5-b33ea8a03b2c tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.054342 Oct 18 16:09:44.215682 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3118/6254] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Oct 18 16:09:44 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:09:51.304030 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7fd936a9-5677-4ca3-9e90-3f97424590ef tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1220393176", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "61347720-6deb-44b1-9db5-b8977362834d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1896880976", "security_groups": [{"name": "tempest-secgroup-smoke-1930425003"}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:09:51.462606 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-7fd936a9-5677-4ca3-9e90-3f97424590ef tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] validate_networks() for [('61347720-6deb-44b1-9db5-b8977362834d', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 16:09:52.055232 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-7fd936a9-5677-4ca3-9e90-3f97424590ef tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:09:52.055674 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-7fd936a9-5677-4ca3-9e90-3f97424590ef tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:09:52.056159 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-7fd936a9-5677-4ca3-9e90-3f97424590ef tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:09:52.056904 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-7fd936a9-5677-4ca3-9e90-3f97424590ef tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:09:52.057134 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-7fd936a9-5677-4ca3-9e90-3f97424590ef tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:09:52.070621 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7fd936a9-5677-4ca3-9e90-3f97424590ef tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:52.071333 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7fd936a9-5677-4ca3-9e90-3f97424590ef tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:52.071993 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7fd936a9-5677-4ca3-9e90-3f97424590ef tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:52.072746 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7fd936a9-5677-4ca3-9e90-3f97424590ef tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:52.073380 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7fd936a9-5677-4ca3-9e90-3f97424590ef tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:52.073968 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7fd936a9-5677-4ca3-9e90-3f97424590ef tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:52.095842 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-7fd936a9-5677-4ca3-9e90-3f97424590ef tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Getting quotas for project a7b4ef10957e43b8a57a419fa0d6de0e. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:09:52.102948 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-7fd936a9-5677-4ca3-9e90-3f97424590ef tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Getting quotas for user 153a83de00ae4445a1efd17d70990630 and project a7b4ef10957e43b8a57a419fa0d6de0e. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:09:52.120300 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7fd936a9-5677-4ca3-9e90-3f97424590ef tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:09:52.124252 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7fd936a9-5677-4ca3-9e90-3f97424590ef tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: d7544332-b021-454f-887b-9462a85dd92a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:09:52.185540 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7fd936a9-5677-4ca3-9e90-3f97424590ef tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.887108 Oct 18 16:09:52.186577 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3137/6255] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 16:09:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 889 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:09:52.198791 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-53599cd3-0a24-4eb8-b915-f549d0a2a5a9 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:52.217686 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-53599cd3-0a24-4eb8-b915-f549d0a2a5a9 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: d7544332-b021-454f-887b-9462a85dd92a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:52.326120 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-53599cd3-0a24-4eb8-b915-f549d0a2a5a9 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:52.335832 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-53599cd3-0a24-4eb8-b915-f549d0a2a5a9 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a" status: 200 len: 1267 microversion: 2.1 time: 0.140483 Oct 18 16:09:52.337325 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3119/6256] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:52 2022] GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a => generated 1267 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:53.360710 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-186af643-b683-433c-a1d8-4f5d6cb596c3 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:53.361501 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-186af643-b683-433c-a1d8-4f5d6cb596c3 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: d7544332-b021-454f-887b-9462a85dd92a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:53.373565 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-186af643-b683-433c-a1d8-4f5d6cb596c3 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:53.374365 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-186af643-b683-433c-a1d8-4f5d6cb596c3 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:53.375063 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-186af643-b683-433c-a1d8-4f5d6cb596c3 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:53.375982 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-186af643-b683-433c-a1d8-4f5d6cb596c3 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:53.376634 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-186af643-b683-433c-a1d8-4f5d6cb596c3 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:53.377280 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-186af643-b683-433c-a1d8-4f5d6cb596c3 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:53.463784 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-186af643-b683-433c-a1d8-4f5d6cb596c3 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:53.474739 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-186af643-b683-433c-a1d8-4f5d6cb596c3 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a" status: 200 len: 1319 microversion: 2.1 time: 0.119298 Oct 18 16:09:53.476029 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3138/6257] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:53 2022] GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a => generated 1319 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:54.504048 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d12635c7-114b-4b98-8817-65fa45506fd3 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:54.504854 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d12635c7-114b-4b98-8817-65fa45506fd3 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: d7544332-b021-454f-887b-9462a85dd92a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:54.513818 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=32 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:09:54.523027 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d12635c7-114b-4b98-8817-65fa45506fd3 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:54.523718 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d12635c7-114b-4b98-8817-65fa45506fd3 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:54.524272 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d12635c7-114b-4b98-8817-65fa45506fd3 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:54.525284 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d12635c7-114b-4b98-8817-65fa45506fd3 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:54.526811 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d12635c7-114b-4b98-8817-65fa45506fd3 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:54.528417 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d12635c7-114b-4b98-8817-65fa45506fd3 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:54.715341 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d12635c7-114b-4b98-8817-65fa45506fd3 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:54.726961 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d12635c7-114b-4b98-8817-65fa45506fd3 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a" status: 200 len: 1393 microversion: 2.1 time: 0.228806 Oct 18 16:09:54.731634 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3120/6258] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:54 2022] GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a => generated 1393 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:55.426632 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-11fb043d-a0b9-44e0-9153-ce4017cd9329 req-307f8c2c-42c5-48a3-ab91-81f17a2673a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7544332-b021-454f-887b-9462a85dd92a", "tag": "db99007d-8221-4107-8ada-1e39fc404296"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:09:55.438482 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-11fb043d-a0b9-44e0-9153-ce4017cd9329 req-307f8c2c-42c5-48a3-ab91-81f17a2673a8 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:55.439109 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-11fb043d-a0b9-44e0-9153-ce4017cd9329 req-307f8c2c-42c5-48a3-ab91-81f17a2673a8 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:55.439733 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-11fb043d-a0b9-44e0-9153-ce4017cd9329 req-307f8c2c-42c5-48a3-ab91-81f17a2673a8 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:55.451683 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-11fb043d-a0b9-44e0-9153-ce4017cd9329 req-307f8c2c-42c5-48a3-ab91-81f17a2673a8 service nova] Creating event network-changed:db99007d-8221-4107-8ada-1e39fc404296 for instance d7544332-b021-454f-887b-9462a85dd92a on n-h1-853682-5 Oct 18 16:09:55.457801 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-11fb043d-a0b9-44e0-9153-ce4017cd9329 req-307f8c2c-42c5-48a3-ab91-81f17a2673a8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036357 Oct 18 16:09:55.459223 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3139/6259] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:09:55.759712 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0ba6b45d-c20d-4017-892f-dc60a74b5e46 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:55.760330 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0ba6b45d-c20d-4017-892f-dc60a74b5e46 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: d7544332-b021-454f-887b-9462a85dd92a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:55.767668 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ba6b45d-c20d-4017-892f-dc60a74b5e46 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:55.768894 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ba6b45d-c20d-4017-892f-dc60a74b5e46 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:55.769566 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ba6b45d-c20d-4017-892f-dc60a74b5e46 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:55.770257 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ba6b45d-c20d-4017-892f-dc60a74b5e46 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:55.770738 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ba6b45d-c20d-4017-892f-dc60a74b5e46 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:55.771322 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ba6b45d-c20d-4017-892f-dc60a74b5e46 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:55.938830 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0ba6b45d-c20d-4017-892f-dc60a74b5e46 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:55.947788 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0ba6b45d-c20d-4017-892f-dc60a74b5e46 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a" status: 200 len: 1393 microversion: 2.1 time: 0.192177 Oct 18 16:09:55.948711 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3121/6260] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:55 2022] GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a => generated 1393 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:56.972297 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9b092ccb-e062-4f03-8a60-fbfce95a2548 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:56.973574 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9b092ccb-e062-4f03-8a60-fbfce95a2548 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: d7544332-b021-454f-887b-9462a85dd92a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:56.981278 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9b092ccb-e062-4f03-8a60-fbfce95a2548 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:56.981794 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9b092ccb-e062-4f03-8a60-fbfce95a2548 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:56.982246 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9b092ccb-e062-4f03-8a60-fbfce95a2548 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:56.982971 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9b092ccb-e062-4f03-8a60-fbfce95a2548 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:56.983440 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9b092ccb-e062-4f03-8a60-fbfce95a2548 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:56.983879 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9b092ccb-e062-4f03-8a60-fbfce95a2548 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:57.171902 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9b092ccb-e062-4f03-8a60-fbfce95a2548 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:57.181198 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9b092ccb-e062-4f03-8a60-fbfce95a2548 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a" status: 200 len: 1393 microversion: 2.1 time: 0.213057 Oct 18 16:09:57.181800 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3140/6261] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:56 2022] GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a => generated 1393 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:58.205581 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4cd829ee-f49a-4649-87dd-7aeb8c5ffb86 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:58.207043 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4cd829ee-f49a-4649-87dd-7aeb8c5ffb86 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: d7544332-b021-454f-887b-9462a85dd92a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:58.214148 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4cd829ee-f49a-4649-87dd-7aeb8c5ffb86 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:58.214919 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4cd829ee-f49a-4649-87dd-7aeb8c5ffb86 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:58.215293 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4cd829ee-f49a-4649-87dd-7aeb8c5ffb86 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:58.216344 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4cd829ee-f49a-4649-87dd-7aeb8c5ffb86 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:58.216908 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4cd829ee-f49a-4649-87dd-7aeb8c5ffb86 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:58.217408 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4cd829ee-f49a-4649-87dd-7aeb8c5ffb86 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:58.358307 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4cd829ee-f49a-4649-87dd-7aeb8c5ffb86 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:58.368497 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4cd829ee-f49a-4649-87dd-7aeb8c5ffb86 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a" status: 200 len: 1393 microversion: 2.1 time: 0.167942 Oct 18 16:09:58.369293 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3122/6262] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:58 2022] GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a => generated 1393 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:09:59.391897 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a8ba04d6-9bca-4543-8a12-bd756bb6fa54 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:09:59.392535 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a8ba04d6-9bca-4543-8a12-bd756bb6fa54 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: d7544332-b021-454f-887b-9462a85dd92a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:09:59.405325 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a8ba04d6-9bca-4543-8a12-bd756bb6fa54 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:59.407377 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a8ba04d6-9bca-4543-8a12-bd756bb6fa54 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:59.408031 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a8ba04d6-9bca-4543-8a12-bd756bb6fa54 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:59.409929 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a8ba04d6-9bca-4543-8a12-bd756bb6fa54 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:09:59.410665 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a8ba04d6-9bca-4543-8a12-bd756bb6fa54 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:09:59.411431 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a8ba04d6-9bca-4543-8a12-bd756bb6fa54 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:09:59.641229 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a8ba04d6-9bca-4543-8a12-bd756bb6fa54 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:09:59.650693 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a8ba04d6-9bca-4543-8a12-bd756bb6fa54 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a" status: 200 len: 1393 microversion: 2.1 time: 0.262931 Oct 18 16:09:59.652024 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3141/6263] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:09:59 2022] GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a => generated 1393 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:00.674759 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fb5fdd44-1ca5-4460-8907-b78c9e1b1442 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:00.676319 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fb5fdd44-1ca5-4460-8907-b78c9e1b1442 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: d7544332-b021-454f-887b-9462a85dd92a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:00.679462 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:10:00.690365 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb5fdd44-1ca5-4460-8907-b78c9e1b1442 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:00.691496 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb5fdd44-1ca5-4460-8907-b78c9e1b1442 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:00.692149 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb5fdd44-1ca5-4460-8907-b78c9e1b1442 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:00.693126 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb5fdd44-1ca5-4460-8907-b78c9e1b1442 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:00.693794 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb5fdd44-1ca5-4460-8907-b78c9e1b1442 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:00.694977 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb5fdd44-1ca5-4460-8907-b78c9e1b1442 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:00.857018 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fb5fdd44-1ca5-4460-8907-b78c9e1b1442 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:00.865606 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fb5fdd44-1ca5-4460-8907-b78c9e1b1442 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a" status: 200 len: 1393 microversion: 2.1 time: 0.194770 Oct 18 16:10:00.867662 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3123/6264] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:00 2022] GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a => generated 1393 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:01.691543 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-6943773f-7bbd-42eb-8611-d0483dc73553 req-42534715-4fc4-4e95-a4b4-ad39c2661bb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7544332-b021-454f-887b-9462a85dd92a", "name": "network-vif-plugged", "status": "completed", "tag": "db99007d-8221-4107-8ada-1e39fc404296"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:10:01.699558 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:10:01.710028 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-6943773f-7bbd-42eb-8611-d0483dc73553 req-42534715-4fc4-4e95-a4b4-ad39c2661bb4 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:01.710822 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-6943773f-7bbd-42eb-8611-d0483dc73553 req-42534715-4fc4-4e95-a4b4-ad39c2661bb4 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:01.711826 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-6943773f-7bbd-42eb-8611-d0483dc73553 req-42534715-4fc4-4e95-a4b4-ad39c2661bb4 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:01.717103 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:10:01.730906 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-6943773f-7bbd-42eb-8611-d0483dc73553 req-42534715-4fc4-4e95-a4b4-ad39c2661bb4 service nova] Creating event network-vif-plugged:db99007d-8221-4107-8ada-1e39fc404296 for instance d7544332-b021-454f-887b-9462a85dd92a on n-h1-853682-5 Oct 18 16:10:01.744263 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-6943773f-7bbd-42eb-8611-d0483dc73553 req-42534715-4fc4-4e95-a4b4-ad39c2661bb4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057163 Oct 18 16:10:01.747982 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3142/6265] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:10:01.891078 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-407f1264-f1f4-4742-8462-a6e046ad2ac7 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:01.892396 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-407f1264-f1f4-4742-8462-a6e046ad2ac7 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: d7544332-b021-454f-887b-9462a85dd92a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:01.904017 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-407f1264-f1f4-4742-8462-a6e046ad2ac7 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:01.906336 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-407f1264-f1f4-4742-8462-a6e046ad2ac7 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:01.907026 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-407f1264-f1f4-4742-8462-a6e046ad2ac7 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:01.909865 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-407f1264-f1f4-4742-8462-a6e046ad2ac7 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:01.911047 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-407f1264-f1f4-4742-8462-a6e046ad2ac7 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:01.911590 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-407f1264-f1f4-4742-8462-a6e046ad2ac7 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:02.198519 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-407f1264-f1f4-4742-8462-a6e046ad2ac7 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:02.209032 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-407f1264-f1f4-4742-8462-a6e046ad2ac7 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a" status: 200 len: 1393 microversion: 2.1 time: 0.321762 Oct 18 16:10:02.209837 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3124/6266] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:01 2022] GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a => generated 1393 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:03.229357 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:10:03.230713 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=6 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:10:03.237611 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d6eab072-86c3-4715-a555-93e2e00f8d08 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:03.238774 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d6eab072-86c3-4715-a555-93e2e00f8d08 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: d7544332-b021-454f-887b-9462a85dd92a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:03.259303 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d6eab072-86c3-4715-a555-93e2e00f8d08 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:03.259813 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d6eab072-86c3-4715-a555-93e2e00f8d08 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:03.260266 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d6eab072-86c3-4715-a555-93e2e00f8d08 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:03.269286 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d6eab072-86c3-4715-a555-93e2e00f8d08 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:03.270117 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d6eab072-86c3-4715-a555-93e2e00f8d08 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:03.270726 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d6eab072-86c3-4715-a555-93e2e00f8d08 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:03.506808 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d6eab072-86c3-4715-a555-93e2e00f8d08 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:03.517348 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d6eab072-86c3-4715-a555-93e2e00f8d08 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a" status: 200 len: 1393 microversion: 2.1 time: 0.288834 Oct 18 16:10:03.542824 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3143/6267] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:03 2022] GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a => generated 1393 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:04.547437 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-52f28953-5a51-4185-96af-0bb1c52f4a05 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:04.548732 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-52f28953-5a51-4185-96af-0bb1c52f4a05 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: d7544332-b021-454f-887b-9462a85dd92a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:04.555229 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:10:04.557664 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52f28953-5a51-4185-96af-0bb1c52f4a05 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:04.558164 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52f28953-5a51-4185-96af-0bb1c52f4a05 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:04.558613 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52f28953-5a51-4185-96af-0bb1c52f4a05 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:04.559317 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52f28953-5a51-4185-96af-0bb1c52f4a05 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:04.559963 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52f28953-5a51-4185-96af-0bb1c52f4a05 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:04.560963 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52f28953-5a51-4185-96af-0bb1c52f4a05 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:04.758210 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-52f28953-5a51-4185-96af-0bb1c52f4a05 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:04.769165 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-52f28953-5a51-4185-96af-0bb1c52f4a05 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a" status: 200 len: 1565 microversion: 2.1 time: 0.225543 Oct 18 16:10:04.770643 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3125/6268] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:04 2022] GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a => generated 1565 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:04.794412 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-371487d8-6ff0-4944-9863-24a09d9d6e9b tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:04.795221 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-371487d8-6ff0-4944-9863-24a09d9d6e9b tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: d7544332-b021-454f-887b-9462a85dd92a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:04.803034 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-371487d8-6ff0-4944-9863-24a09d9d6e9b tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:04.803719 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-371487d8-6ff0-4944-9863-24a09d9d6e9b tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:04.804366 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-371487d8-6ff0-4944-9863-24a09d9d6e9b tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:04.805117 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-371487d8-6ff0-4944-9863-24a09d9d6e9b tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:04.805575 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-371487d8-6ff0-4944-9863-24a09d9d6e9b tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:04.806158 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-371487d8-6ff0-4944-9863-24a09d9d6e9b tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:04.999831 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-371487d8-6ff0-4944-9863-24a09d9d6e9b tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:05.013169 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-371487d8-6ff0-4944-9863-24a09d9d6e9b tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a" status: 200 len: 1565 microversion: 2.1 time: 0.223389 Oct 18 16:10:05.014201 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3144/6269] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:04 2022] GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a => generated 1565 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:05.615351 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ff57c279-2edf-462c-bd94-5baa9012dab7 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Action: 'create', calling method: .version_select at 0x7f7c37bc2e50>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1569896155", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNzY8tEizJBJJNEN1Q3QHuOv0lndl4/asiD71NUGR83+pFsoDzIpYADyFM7ZckmO88zadJZTjf6+c3i2Jz6U0y4BiM9KqyJTso36ZWRo76h47CHLndrlMeJH2xn04t1PmA=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:10:05.632756 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-ff57c279-2edf-462c-bd94-5baa9012dab7 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Getting quotas for project 17b67c4f926143dfb3fecb1d7622c883. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:10:05.639904 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-ff57c279-2edf-462c-bd94-5baa9012dab7 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Getting quotas for user 377d41bb6db24de39a4f960042b8b995 and project 17b67c4f926143dfb3fecb1d7622c883. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:10:05.671127 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ff57c279-2edf-462c-bd94-5baa9012dab7 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.339011 Oct 18 16:10:05.680176 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3126/6270] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Oct 18 16:10:05 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:10:06.725062 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7314c868-db25-4d42-9717-b3aafc42f017 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-2049610026", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1569896155", "security_groups": [{"name": "tempest-secgroup-smoke-1250006188"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "85b3f499-0a22-4e49-bd0b-ce3b352a2d9b"}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:10:06.909578 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-7314c868-db25-4d42-9717-b3aafc42f017 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] validate_networks() for [('85b3f499-0a22-4e49-bd0b-ce3b352a2d9b', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 16:10:07.601661 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-7314c868-db25-4d42-9717-b3aafc42f017 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Getting quotas for project 17b67c4f926143dfb3fecb1d7622c883. Resources: dict_keys(['metadata_items']) {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:10:07.608882 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-7314c868-db25-4d42-9717-b3aafc42f017 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Getting quotas for user 377d41bb6db24de39a4f960042b8b995 and project 17b67c4f926143dfb3fecb1d7622c883. Resources: dict_keys(['metadata_items']) {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:10:07.626938 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-7314c868-db25-4d42-9717-b3aafc42f017 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:10:07.627661 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-7314c868-db25-4d42-9717-b3aafc42f017 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:10:07.628400 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-7314c868-db25-4d42-9717-b3aafc42f017 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:10:07.628850 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-7314c868-db25-4d42-9717-b3aafc42f017 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:10:07.629270 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-7314c868-db25-4d42-9717-b3aafc42f017 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:10:07.640890 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7314c868-db25-4d42-9717-b3aafc42f017 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:07.641677 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7314c868-db25-4d42-9717-b3aafc42f017 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:07.642125 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7314c868-db25-4d42-9717-b3aafc42f017 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:07.642935 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7314c868-db25-4d42-9717-b3aafc42f017 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:07.643806 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7314c868-db25-4d42-9717-b3aafc42f017 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:07.644638 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7314c868-db25-4d42-9717-b3aafc42f017 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:07.644851 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1c32e4bc-b45c-463b-a2cd-ff819cc4ca48 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:07.645991 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1c32e4bc-b45c-463b-a2cd-ff819cc4ca48 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: d7544332-b021-454f-887b-9462a85dd92a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:07.657090 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1c32e4bc-b45c-463b-a2cd-ff819cc4ca48 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:07.657504 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1c32e4bc-b45c-463b-a2cd-ff819cc4ca48 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:07.659955 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1c32e4bc-b45c-463b-a2cd-ff819cc4ca48 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:07.660878 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1c32e4bc-b45c-463b-a2cd-ff819cc4ca48 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:07.661344 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1c32e4bc-b45c-463b-a2cd-ff819cc4ca48 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:07.661770 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1c32e4bc-b45c-463b-a2cd-ff819cc4ca48 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:07.664284 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-7314c868-db25-4d42-9717-b3aafc42f017 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Getting quotas for project 17b67c4f926143dfb3fecb1d7622c883. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:10:07.670157 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-7314c868-db25-4d42-9717-b3aafc42f017 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Getting quotas for user 377d41bb6db24de39a4f960042b8b995 and project 17b67c4f926143dfb3fecb1d7622c883. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:10:07.709478 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7314c868-db25-4d42-9717-b3aafc42f017 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:10:07.711924 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7314c868-db25-4d42-9717-b3aafc42f017 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] [instance: 37866b46-0317-46c2-bf93-239d7c480745] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:10:07.767698 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7314c868-db25-4d42-9717-b3aafc42f017 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.046960 Oct 18 16:10:07.769144 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3145/6271] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 16:10:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 1049 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 16:10:07.773826 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-25434eae-20cb-4040-a50b-551a0c82726d req-100533a1-6e6e-43f3-8d30-a88c9fb6e3d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7544332-b021-454f-887b-9462a85dd92a", "tag": "db99007d-8221-4107-8ada-1e39fc404296"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:10:07.788036 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-25434eae-20cb-4040-a50b-551a0c82726d req-100533a1-6e6e-43f3-8d30-a88c9fb6e3d2 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:07.788705 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-25434eae-20cb-4040-a50b-551a0c82726d req-100533a1-6e6e-43f3-8d30-a88c9fb6e3d2 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:07.789415 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-25434eae-20cb-4040-a50b-551a0c82726d req-100533a1-6e6e-43f3-8d30-a88c9fb6e3d2 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:07.802187 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-25434eae-20cb-4040-a50b-551a0c82726d req-100533a1-6e6e-43f3-8d30-a88c9fb6e3d2 service nova] Creating event network-changed:db99007d-8221-4107-8ada-1e39fc404296 for instance d7544332-b021-454f-887b-9462a85dd92a on n-h1-853682-5 Oct 18 16:10:07.808714 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-25434eae-20cb-4040-a50b-551a0c82726d req-100533a1-6e6e-43f3-8d30-a88c9fb6e3d2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037908 Oct 18 16:10:07.810098 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3146/6272] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:10:07.817711 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-dbaac7e1-d749-4b83-b468-d0409c948773 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:07.818740 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-dbaac7e1-d749-4b83-b468-d0409c948773 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] [instance: 37866b46-0317-46c2-bf93-239d7c480745] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:07.902193 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-dbaac7e1-d749-4b83-b468-d0409c948773 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d41bb6db24de39a4f960042b8b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17b67c4f926143dfb3fecb1d7622c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:07.915013 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-dbaac7e1-d749-4b83-b468-d0409c948773 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] 10.222.0.60 "GET /compute/v2.1/servers/37866b46-0317-46c2-bf93-239d7c480745" status: 200 len: 1303 microversion: 2.1 time: 0.103531 Oct 18 16:10:07.915616 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3147/6273] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:07 2022] GET /compute/v2.1/servers/37866b46-0317-46c2-bf93-239d7c480745 => generated 1303 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:07.920483 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1c32e4bc-b45c-463b-a2cd-ff819cc4ca48 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:07.928904 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1c32e4bc-b45c-463b-a2cd-ff819cc4ca48 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a" status: 200 len: 1565 microversion: 2.1 time: 0.288765 Oct 18 16:10:07.933375 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3127/6274] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:07 2022] GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a => generated 1565 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:08.942304 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-66bf83bd-2fdc-4e32-a72d-053655bb56c9 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:08.942930 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-66bf83bd-2fdc-4e32-a72d-053655bb56c9 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] [instance: 37866b46-0317-46c2-bf93-239d7c480745] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:08.951367 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-66bf83bd-2fdc-4e32-a72d-053655bb56c9 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:08.951873 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-66bf83bd-2fdc-4e32-a72d-053655bb56c9 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:08.952293 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-66bf83bd-2fdc-4e32-a72d-053655bb56c9 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:08.953074 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-66bf83bd-2fdc-4e32-a72d-053655bb56c9 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:08.953532 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-66bf83bd-2fdc-4e32-a72d-053655bb56c9 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:08.953979 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-66bf83bd-2fdc-4e32-a72d-053655bb56c9 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:09.038986 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-66bf83bd-2fdc-4e32-a72d-053655bb56c9 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d41bb6db24de39a4f960042b8b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17b67c4f926143dfb3fecb1d7622c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:09.061481 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-66bf83bd-2fdc-4e32-a72d-053655bb56c9 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] 10.222.0.60 "GET /compute/v2.1/servers/37866b46-0317-46c2-bf93-239d7c480745" status: 200 len: 1355 microversion: 2.1 time: 0.123783 Oct 18 16:10:09.066734 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3148/6275] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:08 2022] GET /compute/v2.1/servers/37866b46-0317-46c2-bf93-239d7c480745 => generated 1355 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:10.085752 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3abd0ef5-16f6-4bb5-a40b-a6f782793f9c tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:10.086393 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3abd0ef5-16f6-4bb5-a40b-a6f782793f9c tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] [instance: 37866b46-0317-46c2-bf93-239d7c480745] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:10.094635 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3abd0ef5-16f6-4bb5-a40b-a6f782793f9c tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:10.095322 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3abd0ef5-16f6-4bb5-a40b-a6f782793f9c tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:10.095768 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3abd0ef5-16f6-4bb5-a40b-a6f782793f9c tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:10.097052 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3abd0ef5-16f6-4bb5-a40b-a6f782793f9c tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:10.097829 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3abd0ef5-16f6-4bb5-a40b-a6f782793f9c tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:10.098413 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3abd0ef5-16f6-4bb5-a40b-a6f782793f9c tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:10.243031 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3abd0ef5-16f6-4bb5-a40b-a6f782793f9c tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d41bb6db24de39a4f960042b8b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17b67c4f926143dfb3fecb1d7622c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:10.254378 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3abd0ef5-16f6-4bb5-a40b-a6f782793f9c tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] 10.222.0.60 "GET /compute/v2.1/servers/37866b46-0317-46c2-bf93-239d7c480745" status: 200 len: 1429 microversion: 2.1 time: 0.172803 Oct 18 16:10:10.255137 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3128/6276] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:10 2022] GET /compute/v2.1/servers/37866b46-0317-46c2-bf93-239d7c480745 => generated 1429 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:10.710741 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-c0d02969-4c5b-4765-b740-c4df5b5939e0 req-a89cd22f-e1e1-4d6b-8b27-0e865bd76bba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37866b46-0317-46c2-bf93-239d7c480745", "tag": "1cf380d1-97b7-40a0-9e54-d065452af1aa"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:10:10.726469 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-c0d02969-4c5b-4765-b740-c4df5b5939e0 req-a89cd22f-e1e1-4d6b-8b27-0e865bd76bba service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:10.727186 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-c0d02969-4c5b-4765-b740-c4df5b5939e0 req-a89cd22f-e1e1-4d6b-8b27-0e865bd76bba service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:10.727638 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-c0d02969-4c5b-4765-b740-c4df5b5939e0 req-a89cd22f-e1e1-4d6b-8b27-0e865bd76bba service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:10.743719 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-c0d02969-4c5b-4765-b740-c4df5b5939e0 req-a89cd22f-e1e1-4d6b-8b27-0e865bd76bba service nova] Creating event network-changed:1cf380d1-97b7-40a0-9e54-d065452af1aa for instance 37866b46-0317-46c2-bf93-239d7c480745 on n-h2-853682-5 Oct 18 16:10:10.751015 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-c0d02969-4c5b-4765-b740-c4df5b5939e0 req-a89cd22f-e1e1-4d6b-8b27-0e865bd76bba service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044759 Oct 18 16:10:10.756201 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3149/6277] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:10:11.278388 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f5cb94cf-f671-4a23-bc91-97f644210ff1 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:11.279005 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f5cb94cf-f671-4a23-bc91-97f644210ff1 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] [instance: 37866b46-0317-46c2-bf93-239d7c480745] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:11.285880 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f5cb94cf-f671-4a23-bc91-97f644210ff1 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:11.286366 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f5cb94cf-f671-4a23-bc91-97f644210ff1 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:11.286798 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f5cb94cf-f671-4a23-bc91-97f644210ff1 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:11.287520 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f5cb94cf-f671-4a23-bc91-97f644210ff1 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:11.287980 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f5cb94cf-f671-4a23-bc91-97f644210ff1 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:11.288402 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f5cb94cf-f671-4a23-bc91-97f644210ff1 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:11.431233 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f5cb94cf-f671-4a23-bc91-97f644210ff1 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d41bb6db24de39a4f960042b8b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17b67c4f926143dfb3fecb1d7622c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:11.439530 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f5cb94cf-f671-4a23-bc91-97f644210ff1 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] 10.222.0.60 "GET /compute/v2.1/servers/37866b46-0317-46c2-bf93-239d7c480745" status: 200 len: 1429 microversion: 2.1 time: 0.165003 Oct 18 16:10:11.440750 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3129/6278] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:11 2022] GET /compute/v2.1/servers/37866b46-0317-46c2-bf93-239d7c480745 => generated 1429 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:12.463582 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-88862911-70fd-4232-b62c-c897cebc99ae tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:12.464298 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-88862911-70fd-4232-b62c-c897cebc99ae tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] [instance: 37866b46-0317-46c2-bf93-239d7c480745] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:12.470881 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-88862911-70fd-4232-b62c-c897cebc99ae tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:12.471378 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-88862911-70fd-4232-b62c-c897cebc99ae tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:12.471815 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-88862911-70fd-4232-b62c-c897cebc99ae tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:12.473127 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-88862911-70fd-4232-b62c-c897cebc99ae tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:12.473637 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-88862911-70fd-4232-b62c-c897cebc99ae tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:12.474075 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-88862911-70fd-4232-b62c-c897cebc99ae tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:12.609380 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-88862911-70fd-4232-b62c-c897cebc99ae tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d41bb6db24de39a4f960042b8b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17b67c4f926143dfb3fecb1d7622c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:12.617668 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-88862911-70fd-4232-b62c-c897cebc99ae tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] 10.222.0.60 "GET /compute/v2.1/servers/37866b46-0317-46c2-bf93-239d7c480745" status: 200 len: 1429 microversion: 2.1 time: 0.159364 Oct 18 16:10:12.618241 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3150/6279] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:12 2022] GET /compute/v2.1/servers/37866b46-0317-46c2-bf93-239d7c480745 => generated 1429 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:13.639575 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6a6648de-8112-4ad5-9103-12b201ba02ef tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:13.640179 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6a6648de-8112-4ad5-9103-12b201ba02ef tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] [instance: 37866b46-0317-46c2-bf93-239d7c480745] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:13.647765 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a6648de-8112-4ad5-9103-12b201ba02ef tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:13.648245 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a6648de-8112-4ad5-9103-12b201ba02ef tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:13.648683 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a6648de-8112-4ad5-9103-12b201ba02ef tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:13.649399 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a6648de-8112-4ad5-9103-12b201ba02ef tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:13.649853 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a6648de-8112-4ad5-9103-12b201ba02ef tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:13.650278 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a6648de-8112-4ad5-9103-12b201ba02ef tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:13.786065 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6a6648de-8112-4ad5-9103-12b201ba02ef tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d41bb6db24de39a4f960042b8b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17b67c4f926143dfb3fecb1d7622c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:13.793717 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6a6648de-8112-4ad5-9103-12b201ba02ef tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] 10.222.0.60 "GET /compute/v2.1/servers/37866b46-0317-46c2-bf93-239d7c480745" status: 200 len: 1429 microversion: 2.1 time: 0.158076 Oct 18 16:10:13.794303 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3130/6280] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:13 2022] GET /compute/v2.1/servers/37866b46-0317-46c2-bf93-239d7c480745 => generated 1429 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:14.816801 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-29c81dcf-befb-4fb4-972f-48078374bd71 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:14.817557 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-29c81dcf-befb-4fb4-972f-48078374bd71 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] [instance: 37866b46-0317-46c2-bf93-239d7c480745] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:14.825216 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-29c81dcf-befb-4fb4-972f-48078374bd71 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:14.825848 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-29c81dcf-befb-4fb4-972f-48078374bd71 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:14.826392 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-29c81dcf-befb-4fb4-972f-48078374bd71 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:14.827197 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-29c81dcf-befb-4fb4-972f-48078374bd71 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:14.827735 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-29c81dcf-befb-4fb4-972f-48078374bd71 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:14.828244 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-29c81dcf-befb-4fb4-972f-48078374bd71 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:14.969571 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-29c81dcf-befb-4fb4-972f-48078374bd71 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d41bb6db24de39a4f960042b8b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17b67c4f926143dfb3fecb1d7622c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:14.977854 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-29c81dcf-befb-4fb4-972f-48078374bd71 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] 10.222.0.60 "GET /compute/v2.1/servers/37866b46-0317-46c2-bf93-239d7c480745" status: 200 len: 1429 microversion: 2.1 time: 0.165257 Oct 18 16:10:14.978419 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3151/6281] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:14 2022] GET /compute/v2.1/servers/37866b46-0317-46c2-bf93-239d7c480745 => generated 1429 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:16.000914 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-158f033e-1e1f-4e43-bb20-c615c91c048f tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:16.001573 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-158f033e-1e1f-4e43-bb20-c615c91c048f tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] [instance: 37866b46-0317-46c2-bf93-239d7c480745] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:16.004947 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:10:16.010680 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-158f033e-1e1f-4e43-bb20-c615c91c048f tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:16.011213 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-158f033e-1e1f-4e43-bb20-c615c91c048f tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:16.011650 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-158f033e-1e1f-4e43-bb20-c615c91c048f tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:16.012346 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-158f033e-1e1f-4e43-bb20-c615c91c048f tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:16.012798 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-158f033e-1e1f-4e43-bb20-c615c91c048f tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:16.013277 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-158f033e-1e1f-4e43-bb20-c615c91c048f tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:16.151050 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-158f033e-1e1f-4e43-bb20-c615c91c048f tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d41bb6db24de39a4f960042b8b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17b67c4f926143dfb3fecb1d7622c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:16.159101 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-158f033e-1e1f-4e43-bb20-c615c91c048f tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] 10.222.0.60 "GET /compute/v2.1/servers/37866b46-0317-46c2-bf93-239d7c480745" status: 200 len: 1429 microversion: 2.1 time: 0.162092 Oct 18 16:10:16.160194 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3131/6282] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:15 2022] GET /compute/v2.1/servers/37866b46-0317-46c2-bf93-239d7c480745 => generated 1429 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:16.872654 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-af54fc3a-1f84-448e-a2a0-519cca504ce6 req-0061992c-d463-45b8-979c-30cc95133e95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37866b46-0317-46c2-bf93-239d7c480745", "name": "network-vif-plugged", "status": "completed", "tag": "1cf380d1-97b7-40a0-9e54-d065452af1aa"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:10:16.885329 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-af54fc3a-1f84-448e-a2a0-519cca504ce6 req-0061992c-d463-45b8-979c-30cc95133e95 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:16.885891 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-af54fc3a-1f84-448e-a2a0-519cca504ce6 req-0061992c-d463-45b8-979c-30cc95133e95 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:16.886330 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-af54fc3a-1f84-448e-a2a0-519cca504ce6 req-0061992c-d463-45b8-979c-30cc95133e95 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:16.898454 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-af54fc3a-1f84-448e-a2a0-519cca504ce6 req-0061992c-d463-45b8-979c-30cc95133e95 service nova] Creating event network-vif-plugged:1cf380d1-97b7-40a0-9e54-d065452af1aa for instance 37866b46-0317-46c2-bf93-239d7c480745 on n-h2-853682-5 Oct 18 16:10:16.903467 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-af54fc3a-1f84-448e-a2a0-519cca504ce6 req-0061992c-d463-45b8-979c-30cc95133e95 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036229 Oct 18 16:10:16.904298 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3152/6283] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:10:17.182718 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-abd347e8-9f95-4645-b038-6c23b2338fbc tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:17.183265 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-abd347e8-9f95-4645-b038-6c23b2338fbc tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] [instance: 37866b46-0317-46c2-bf93-239d7c480745] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:17.190283 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-abd347e8-9f95-4645-b038-6c23b2338fbc tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:17.190769 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-abd347e8-9f95-4645-b038-6c23b2338fbc tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:17.191717 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-abd347e8-9f95-4645-b038-6c23b2338fbc tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:17.192410 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-abd347e8-9f95-4645-b038-6c23b2338fbc tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:17.192896 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-abd347e8-9f95-4645-b038-6c23b2338fbc tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:17.193324 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-abd347e8-9f95-4645-b038-6c23b2338fbc tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:17.333431 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-abd347e8-9f95-4645-b038-6c23b2338fbc tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d41bb6db24de39a4f960042b8b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17b67c4f926143dfb3fecb1d7622c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:17.341415 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-abd347e8-9f95-4645-b038-6c23b2338fbc tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] 10.222.0.60 "GET /compute/v2.1/servers/37866b46-0317-46c2-bf93-239d7c480745" status: 200 len: 1429 microversion: 2.1 time: 0.162642 Oct 18 16:10:17.341988 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3132/6284] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:17 2022] GET /compute/v2.1/servers/37866b46-0317-46c2-bf93-239d7c480745 => generated 1429 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:18.361092 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:10:18.362748 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=12 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:10:18.367424 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-407cc429-f378-427a-98ff-10278338117a tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:18.368127 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-407cc429-f378-427a-98ff-10278338117a tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] [instance: 37866b46-0317-46c2-bf93-239d7c480745] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:18.375295 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-407cc429-f378-427a-98ff-10278338117a tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:18.375775 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-407cc429-f378-427a-98ff-10278338117a tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:18.376210 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-407cc429-f378-427a-98ff-10278338117a tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:18.376926 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-407cc429-f378-427a-98ff-10278338117a tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:18.377381 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-407cc429-f378-427a-98ff-10278338117a tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:18.377807 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-407cc429-f378-427a-98ff-10278338117a tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:18.512929 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-407cc429-f378-427a-98ff-10278338117a tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d41bb6db24de39a4f960042b8b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17b67c4f926143dfb3fecb1d7622c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:18.520745 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-407cc429-f378-427a-98ff-10278338117a tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] 10.222.0.60 "GET /compute/v2.1/servers/37866b46-0317-46c2-bf93-239d7c480745" status: 200 len: 1609 microversion: 2.1 time: 0.160694 Oct 18 16:10:18.521344 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3153/6285] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:18 2022] GET /compute/v2.1/servers/37866b46-0317-46c2-bf93-239d7c480745 => generated 1609 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:18.542955 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-de00427c-145d-4f29-b9cd-94061564692c tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:18.543561 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-de00427c-145d-4f29-b9cd-94061564692c tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] [instance: 37866b46-0317-46c2-bf93-239d7c480745] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:18.551455 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de00427c-145d-4f29-b9cd-94061564692c tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:18.551936 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de00427c-145d-4f29-b9cd-94061564692c tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:18.552365 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de00427c-145d-4f29-b9cd-94061564692c tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:18.553084 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de00427c-145d-4f29-b9cd-94061564692c tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:18.553532 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de00427c-145d-4f29-b9cd-94061564692c tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:18.553951 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de00427c-145d-4f29-b9cd-94061564692c tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:18.695480 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-de00427c-145d-4f29-b9cd-94061564692c tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d41bb6db24de39a4f960042b8b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17b67c4f926143dfb3fecb1d7622c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:18.703304 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-de00427c-145d-4f29-b9cd-94061564692c tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] 10.222.0.60 "GET /compute/v2.1/servers/37866b46-0317-46c2-bf93-239d7c480745" status: 200 len: 1609 microversion: 2.1 time: 0.164239 Oct 18 16:10:18.703879 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3133/6286] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:18 2022] GET /compute/v2.1/servers/37866b46-0317-46c2-bf93-239d7c480745 => generated 1609 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:18.725717 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5ea0c4b3-a069-44e1-8304-a993d8ed928a tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:18.726331 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5ea0c4b3-a069-44e1-8304-a993d8ed928a tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] [instance: 37866b46-0317-46c2-bf93-239d7c480745] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:18.732265 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5ea0c4b3-a069-44e1-8304-a993d8ed928a tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:18.732740 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5ea0c4b3-a069-44e1-8304-a993d8ed928a tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:18.733203 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5ea0c4b3-a069-44e1-8304-a993d8ed928a tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:18.733884 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5ea0c4b3-a069-44e1-8304-a993d8ed928a tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:18.734339 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5ea0c4b3-a069-44e1-8304-a993d8ed928a tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:18.734759 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5ea0c4b3-a069-44e1-8304-a993d8ed928a tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:18.868612 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5ea0c4b3-a069-44e1-8304-a993d8ed928a tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d41bb6db24de39a4f960042b8b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17b67c4f926143dfb3fecb1d7622c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:10:18.876875 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5ea0c4b3-a069-44e1-8304-a993d8ed928a tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] 10.222.0.60 "GET /compute/v2.1/servers/37866b46-0317-46c2-bf93-239d7c480745" status: 200 len: 1609 microversion: 2.1 time: 0.155591 Oct 18 16:10:18.877474 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3154/6287] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:10:18 2022] GET /compute/v2.1/servers/37866b46-0317-46c2-bf93-239d7c480745 => generated 1609 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:10:20.869636 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-f2547fcd-9a03-433f-afe1-f694c684af36 req-6139b814-bb16-4d98-b972-5295ce55b993 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37866b46-0317-46c2-bf93-239d7c480745", "tag": "1cf380d1-97b7-40a0-9e54-d065452af1aa"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:10:20.880801 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f2547fcd-9a03-433f-afe1-f694c684af36 req-6139b814-bb16-4d98-b972-5295ce55b993 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:20.881306 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f2547fcd-9a03-433f-afe1-f694c684af36 req-6139b814-bb16-4d98-b972-5295ce55b993 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:20.881739 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f2547fcd-9a03-433f-afe1-f694c684af36 req-6139b814-bb16-4d98-b972-5295ce55b993 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:20.896132 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-f2547fcd-9a03-433f-afe1-f694c684af36 req-6139b814-bb16-4d98-b972-5295ce55b993 service nova] Creating event network-changed:1cf380d1-97b7-40a0-9e54-d065452af1aa for instance 37866b46-0317-46c2-bf93-239d7c480745 on n-h2-853682-5 Oct 18 16:10:20.901358 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-f2547fcd-9a03-433f-afe1-f694c684af36 req-6139b814-bb16-4d98-b972-5295ce55b993 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035332 Oct 18 16:10:20.901970 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3134/6288] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:10:38.421793 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d91fd8f4-9a8e-4337-adb0-bfa83c8907e2 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:10:38.424011 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d91fd8f4-9a8e-4337-adb0-bfa83c8907e2 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: d7544332-b021-454f-887b-9462a85dd92a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:38.426869 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:10:38.427520 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=51 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:10:38.433023 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d91fd8f4-9a8e-4337-adb0-bfa83c8907e2 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:38.433508 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d91fd8f4-9a8e-4337-adb0-bfa83c8907e2 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:38.433942 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d91fd8f4-9a8e-4337-adb0-bfa83c8907e2 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:38.434639 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d91fd8f4-9a8e-4337-adb0-bfa83c8907e2 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:38.435093 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d91fd8f4-9a8e-4337-adb0-bfa83c8907e2 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:38.435515 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d91fd8f4-9a8e-4337-adb0-bfa83c8907e2 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:38.503538 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d91fd8f4-9a8e-4337-adb0-bfa83c8907e2 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "POST /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a/action" status: 200 len: 24566 microversion: 2.1 time: 0.085783 Oct 18 16:10:38.504757 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3155/6289] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:10:38 2022] POST /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a/action => generated 24566 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:10:57.236727 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:10:57.237544 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=80 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:10:57.242439 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-127ef311-7d8d-4343-8dd3-5d4f77be0fe8 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:10:57.243031 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-127ef311-7d8d-4343-8dd3-5d4f77be0fe8 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] [instance: 37866b46-0317-46c2-bf93-239d7c480745] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:10:57.249886 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-127ef311-7d8d-4343-8dd3-5d4f77be0fe8 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:57.250367 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-127ef311-7d8d-4343-8dd3-5d4f77be0fe8 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:57.250799 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-127ef311-7d8d-4343-8dd3-5d4f77be0fe8 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:57.251482 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-127ef311-7d8d-4343-8dd3-5d4f77be0fe8 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:10:57.251935 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-127ef311-7d8d-4343-8dd3-5d4f77be0fe8 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:10:57.252355 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-127ef311-7d8d-4343-8dd3-5d4f77be0fe8 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:10:57.277157 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-127ef311-7d8d-4343-8dd3-5d4f77be0fe8 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] 10.222.0.60 "GET /compute/v2.1/servers/37866b46-0317-46c2-bf93-239d7c480745/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.042615 Oct 18 16:10:57.277735 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3135/6290] 10.222.0.60 () {58 vars in 1293 bytes} [Tue Oct 18 16:10:57 2022] GET /compute/v2.1/servers/37866b46-0317-46c2-bf93-239d7c480745/os-server-password => generated 116 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:11:08.953440 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ec187c99-6dc2-4f8f-b32e-42a8d4aa81c9 tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:08.954070 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ec187c99-6dc2-4f8f-b32e-42a8d4aa81c9 tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] [instance: d7544332-b021-454f-887b-9462a85dd92a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:08.956744 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:08.957547 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=4 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:08.964330 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ec187c99-6dc2-4f8f-b32e-42a8d4aa81c9 tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:08.964833 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ec187c99-6dc2-4f8f-b32e-42a8d4aa81c9 tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:08.965358 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ec187c99-6dc2-4f8f-b32e-42a8d4aa81c9 tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:08.966062 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ec187c99-6dc2-4f8f-b32e-42a8d4aa81c9 tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:08.966527 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ec187c99-6dc2-4f8f-b32e-42a8d4aa81c9 tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:08.966959 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ec187c99-6dc2-4f8f-b32e-42a8d4aa81c9 tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:09.101612 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ec187c99-6dc2-4f8f-b32e-42a8d4aa81c9 tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a" status: 200 len: 1834 microversion: 2.1 time: 0.152511 Oct 18 16:11:09.102182 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3156/6291] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:08 2022] GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a => generated 1834 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:09.127286 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9757fc5a-8111-482a-bc2d-cfaead66176c tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:09.127928 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9757fc5a-8111-482a-bc2d-cfaead66176c tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: d7544332-b021-454f-887b-9462a85dd92a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:09.130073 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:09.131029 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:09.136621 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9757fc5a-8111-482a-bc2d-cfaead66176c tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:09.137131 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9757fc5a-8111-482a-bc2d-cfaead66176c tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:09.137568 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9757fc5a-8111-482a-bc2d-cfaead66176c tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:09.138355 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9757fc5a-8111-482a-bc2d-cfaead66176c tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:09.138817 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9757fc5a-8111-482a-bc2d-cfaead66176c tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:09.139240 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9757fc5a-8111-482a-bc2d-cfaead66176c tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:09.271579 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9757fc5a-8111-482a-bc2d-cfaead66176c tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:09.280085 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9757fc5a-8111-482a-bc2d-cfaead66176c tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a" status: 200 len: 1683 microversion: 2.1 time: 0.156793 Oct 18 16:11:09.280659 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3136/6292] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:09 2022] GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:09.377630 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-633cfb0f-f895-4e7e-9b41-3ad333058bff tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:09.379846 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-633cfb0f-f895-4e7e-9b41-3ad333058bff tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: d7544332-b021-454f-887b-9462a85dd92a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:09.388009 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-633cfb0f-f895-4e7e-9b41-3ad333058bff tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:09.388502 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-633cfb0f-f895-4e7e-9b41-3ad333058bff tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:09.389009 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-633cfb0f-f895-4e7e-9b41-3ad333058bff tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:09.389715 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-633cfb0f-f895-4e7e-9b41-3ad333058bff tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:09.390176 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-633cfb0f-f895-4e7e-9b41-3ad333058bff tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:09.390602 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-633cfb0f-f895-4e7e-9b41-3ad333058bff tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:09.459165 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-633cfb0f-f895-4e7e-9b41-3ad333058bff tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "POST /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a/action" status: 200 len: 32637 microversion: 2.1 time: 0.085349 Oct 18 16:11:09.459811 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3157/6293] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:11:09 2022] POST /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a/action => generated 32637 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:11:09.671464 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-39e5b424-3989-4aa4-88cd-c34cba3fa347 tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:09.672056 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-39e5b424-3989-4aa4-88cd-c34cba3fa347 tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] [instance: d7544332-b021-454f-887b-9462a85dd92a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:09.678405 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39e5b424-3989-4aa4-88cd-c34cba3fa347 tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:09.678919 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39e5b424-3989-4aa4-88cd-c34cba3fa347 tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:09.679360 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39e5b424-3989-4aa4-88cd-c34cba3fa347 tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:09.680057 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39e5b424-3989-4aa4-88cd-c34cba3fa347 tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:09.680518 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39e5b424-3989-4aa4-88cd-c34cba3fa347 tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:09.680985 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39e5b424-3989-4aa4-88cd-c34cba3fa347 tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:09.724291 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-39e5b424-3989-4aa4-88cd-c34cba3fa347 tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'b628cdaf36e5480fa914bc5244581568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d630b4ad57d4d56b67a1810f47a0752', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:09.724925 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-39e5b424-3989-4aa4-88cd-c34cba3fa347 tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] [instance: d7544332-b021-454f-887b-9462a85dd92a] flavor_id is None. Assuming migration. {{(pid=120406) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 18 16:11:09.725369 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-39e5b424-3989-4aa4-88cd-c34cba3fa347 tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] [instance: d7544332-b021-454f-887b-9462a85dd92a] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120406) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 18 16:11:09.955244 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-39e5b424-3989-4aa4-88cd-c34cba3fa347 tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a/action" status: 202 len: 0 microversion: 2.1 time: 0.287480 Oct 18 16:11:09.955884 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3137/6294] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:11:09 2022] POST /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:11:09.964763 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6ca58584-c32a-4e98-9db8-9dd835b9bfbc tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:09.965497 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6ca58584-c32a-4e98-9db8-9dd835b9bfbc tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: d7544332-b021-454f-887b-9462a85dd92a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:09.973096 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ca58584-c32a-4e98-9db8-9dd835b9bfbc tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:09.973583 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ca58584-c32a-4e98-9db8-9dd835b9bfbc tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:09.974018 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ca58584-c32a-4e98-9db8-9dd835b9bfbc tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:09.974721 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ca58584-c32a-4e98-9db8-9dd835b9bfbc tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:09.975209 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ca58584-c32a-4e98-9db8-9dd835b9bfbc tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:09.975836 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ca58584-c32a-4e98-9db8-9dd835b9bfbc tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:10.139635 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6ca58584-c32a-4e98-9db8-9dd835b9bfbc tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:10.147984 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6ca58584-c32a-4e98-9db8-9dd835b9bfbc tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a" status: 200 len: 1692 microversion: 2.1 time: 0.187483 Oct 18 16:11:10.148647 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3158/6295] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:09 2022] GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a => generated 1692 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:11.173869 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6ce78176-3217-4d7f-bdd9-d8cd27bb1f4f tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:11.174424 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6ce78176-3217-4d7f-bdd9-d8cd27bb1f4f tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: d7544332-b021-454f-887b-9462a85dd92a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:11.182070 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ce78176-3217-4d7f-bdd9-d8cd27bb1f4f tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:11.182552 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ce78176-3217-4d7f-bdd9-d8cd27bb1f4f tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:11.182980 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ce78176-3217-4d7f-bdd9-d8cd27bb1f4f tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:11.183765 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ce78176-3217-4d7f-bdd9-d8cd27bb1f4f tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:11.184527 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ce78176-3217-4d7f-bdd9-d8cd27bb1f4f tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:11.184994 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ce78176-3217-4d7f-bdd9-d8cd27bb1f4f tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:11.322796 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6ce78176-3217-4d7f-bdd9-d8cd27bb1f4f tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:11.331190 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6ce78176-3217-4d7f-bdd9-d8cd27bb1f4f tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a" status: 200 len: 1692 microversion: 2.1 time: 0.162232 Oct 18 16:11:11.331772 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3138/6296] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:11 2022] GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a => generated 1692 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:12.355250 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-834251b9-308e-482a-960d-64b01bdc9a78 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:12.355918 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-834251b9-308e-482a-960d-64b01bdc9a78 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: d7544332-b021-454f-887b-9462a85dd92a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:12.362848 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-834251b9-308e-482a-960d-64b01bdc9a78 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:12.363325 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-834251b9-308e-482a-960d-64b01bdc9a78 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:12.363758 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-834251b9-308e-482a-960d-64b01bdc9a78 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:12.364448 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-834251b9-308e-482a-960d-64b01bdc9a78 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:12.364927 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-834251b9-308e-482a-960d-64b01bdc9a78 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:12.365380 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-834251b9-308e-482a-960d-64b01bdc9a78 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:12.498465 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-834251b9-308e-482a-960d-64b01bdc9a78 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:12.506204 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-834251b9-308e-482a-960d-64b01bdc9a78 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a" status: 200 len: 1697 microversion: 2.1 time: 0.154963 Oct 18 16:11:12.506775 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3159/6297] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:12 2022] GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:13.529759 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-09aa5ba6-ca6d-4ae2-b90f-00e3cdad94cf tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:13.530371 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-09aa5ba6-ca6d-4ae2-b90f-00e3cdad94cf tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: d7544332-b021-454f-887b-9462a85dd92a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:13.537234 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09aa5ba6-ca6d-4ae2-b90f-00e3cdad94cf tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:13.537718 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09aa5ba6-ca6d-4ae2-b90f-00e3cdad94cf tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:13.538154 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09aa5ba6-ca6d-4ae2-b90f-00e3cdad94cf tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:13.538846 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09aa5ba6-ca6d-4ae2-b90f-00e3cdad94cf tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:13.539302 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09aa5ba6-ca6d-4ae2-b90f-00e3cdad94cf tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:13.539731 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09aa5ba6-ca6d-4ae2-b90f-00e3cdad94cf tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:13.670174 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-09aa5ba6-ca6d-4ae2-b90f-00e3cdad94cf tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:13.678181 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-09aa5ba6-ca6d-4ae2-b90f-00e3cdad94cf tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a" status: 200 len: 1697 microversion: 2.1 time: 0.152307 Oct 18 16:11:13.678756 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3139/6298] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:13 2022] GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a => generated 1697 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:14.703497 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-73179866-5f33-4efd-86d3-624b64815393 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:14.704119 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-73179866-5f33-4efd-86d3-624b64815393 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: d7544332-b021-454f-887b-9462a85dd92a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:14.710979 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-73179866-5f33-4efd-86d3-624b64815393 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:14.711485 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-73179866-5f33-4efd-86d3-624b64815393 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:14.711908 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-73179866-5f33-4efd-86d3-624b64815393 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:14.712602 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-73179866-5f33-4efd-86d3-624b64815393 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:14.713087 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-73179866-5f33-4efd-86d3-624b64815393 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:14.713518 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-73179866-5f33-4efd-86d3-624b64815393 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:14.853986 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-73179866-5f33-4efd-86d3-624b64815393 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:14.861765 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-73179866-5f33-4efd-86d3-624b64815393 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a" status: 200 len: 1697 microversion: 2.1 time: 0.162747 Oct 18 16:11:14.862345 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3160/6299] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:14 2022] GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a => generated 1697 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:15.887581 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8e4272ff-392e-48f6-bb30-a103de0f7e8e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:15.888200 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8e4272ff-392e-48f6-bb30-a103de0f7e8e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: d7544332-b021-454f-887b-9462a85dd92a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:15.895113 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e4272ff-392e-48f6-bb30-a103de0f7e8e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:15.895597 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e4272ff-392e-48f6-bb30-a103de0f7e8e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:15.896034 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e4272ff-392e-48f6-bb30-a103de0f7e8e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:15.896725 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e4272ff-392e-48f6-bb30-a103de0f7e8e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:15.897200 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e4272ff-392e-48f6-bb30-a103de0f7e8e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:15.897623 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e4272ff-392e-48f6-bb30-a103de0f7e8e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:16.034037 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8e4272ff-392e-48f6-bb30-a103de0f7e8e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:16.041854 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8e4272ff-392e-48f6-bb30-a103de0f7e8e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a" status: 200 len: 1697 microversion: 2.1 time: 0.159300 Oct 18 16:11:16.042425 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3140/6300] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:15 2022] GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:17.065673 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4ece9720-23c7-4b42-bd3b-1d2ab8e6c7fa tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:17.066298 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4ece9720-23c7-4b42-bd3b-1d2ab8e6c7fa tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: d7544332-b021-454f-887b-9462a85dd92a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:17.073185 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ece9720-23c7-4b42-bd3b-1d2ab8e6c7fa tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:17.073676 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ece9720-23c7-4b42-bd3b-1d2ab8e6c7fa tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:17.074958 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ece9720-23c7-4b42-bd3b-1d2ab8e6c7fa tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:17.075453 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ece9720-23c7-4b42-bd3b-1d2ab8e6c7fa tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:17.075912 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ece9720-23c7-4b42-bd3b-1d2ab8e6c7fa tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:17.076342 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ece9720-23c7-4b42-bd3b-1d2ab8e6c7fa tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:17.212511 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4ece9720-23c7-4b42-bd3b-1d2ab8e6c7fa tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:17.220894 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4ece9720-23c7-4b42-bd3b-1d2ab8e6c7fa tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a" status: 200 len: 1697 microversion: 2.1 time: 0.159163 Oct 18 16:11:17.221465 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3161/6301] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:17 2022] GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:18.245027 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f9fca360-7bd0-409c-850e-1f4a8ab43acc tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:18.245651 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f9fca360-7bd0-409c-850e-1f4a8ab43acc tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: d7544332-b021-454f-887b-9462a85dd92a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:18.252478 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9fca360-7bd0-409c-850e-1f4a8ab43acc tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:18.252991 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9fca360-7bd0-409c-850e-1f4a8ab43acc tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:18.253428 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9fca360-7bd0-409c-850e-1f4a8ab43acc tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:18.254116 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9fca360-7bd0-409c-850e-1f4a8ab43acc tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:18.254568 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9fca360-7bd0-409c-850e-1f4a8ab43acc tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:18.254991 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9fca360-7bd0-409c-850e-1f4a8ab43acc tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:18.387697 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f9fca360-7bd0-409c-850e-1f4a8ab43acc tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:18.395445 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f9fca360-7bd0-409c-850e-1f4a8ab43acc tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a" status: 200 len: 1697 microversion: 2.1 time: 0.154427 Oct 18 16:11:18.396022 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3141/6302] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:18 2022] GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:19.419692 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9bc11a9e-5640-4545-a643-8dea72758df9 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:19.420397 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9bc11a9e-5640-4545-a643-8dea72758df9 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: d7544332-b021-454f-887b-9462a85dd92a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:19.427703 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9bc11a9e-5640-4545-a643-8dea72758df9 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:19.428169 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9bc11a9e-5640-4545-a643-8dea72758df9 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:19.428711 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9bc11a9e-5640-4545-a643-8dea72758df9 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:19.429440 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9bc11a9e-5640-4545-a643-8dea72758df9 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:19.429905 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9bc11a9e-5640-4545-a643-8dea72758df9 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:19.430338 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9bc11a9e-5640-4545-a643-8dea72758df9 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:19.565027 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9bc11a9e-5640-4545-a643-8dea72758df9 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:19.572757 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9bc11a9e-5640-4545-a643-8dea72758df9 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a" status: 200 len: 1697 microversion: 2.1 time: 0.157110 Oct 18 16:11:19.573352 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3162/6303] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:19 2022] GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:20.596148 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-299ab8e8-81eb-4570-bdde-ecb3b4816dd9 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:20.596760 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-299ab8e8-81eb-4570-bdde-ecb3b4816dd9 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: d7544332-b021-454f-887b-9462a85dd92a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:20.603740 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-299ab8e8-81eb-4570-bdde-ecb3b4816dd9 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:20.604222 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-299ab8e8-81eb-4570-bdde-ecb3b4816dd9 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:20.604685 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-299ab8e8-81eb-4570-bdde-ecb3b4816dd9 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:20.605893 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-299ab8e8-81eb-4570-bdde-ecb3b4816dd9 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:20.606351 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-299ab8e8-81eb-4570-bdde-ecb3b4816dd9 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:20.606783 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-299ab8e8-81eb-4570-bdde-ecb3b4816dd9 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:20.741490 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-299ab8e8-81eb-4570-bdde-ecb3b4816dd9 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:20.749788 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-299ab8e8-81eb-4570-bdde-ecb3b4816dd9 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a" status: 200 len: 1697 microversion: 2.1 time: 0.157540 Oct 18 16:11:20.750363 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3142/6304] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:20 2022] GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:21.773683 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3de08acd-896b-490b-98ac-0c407abf8341 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:21.774301 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3de08acd-896b-490b-98ac-0c407abf8341 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: d7544332-b021-454f-887b-9462a85dd92a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:21.781766 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3de08acd-896b-490b-98ac-0c407abf8341 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:21.782251 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3de08acd-896b-490b-98ac-0c407abf8341 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:21.782691 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3de08acd-896b-490b-98ac-0c407abf8341 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:21.783379 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3de08acd-896b-490b-98ac-0c407abf8341 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:21.783837 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3de08acd-896b-490b-98ac-0c407abf8341 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:21.784266 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3de08acd-896b-490b-98ac-0c407abf8341 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:21.918918 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3de08acd-896b-490b-98ac-0c407abf8341 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:21.926733 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3de08acd-896b-490b-98ac-0c407abf8341 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a" status: 200 len: 1697 microversion: 2.1 time: 0.156996 Oct 18 16:11:21.927580 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3163/6305] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:21 2022] GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:22.951391 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-47d5ed4a-81a0-45f4-a959-7d97e02dce25 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:22.952614 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-47d5ed4a-81a0-45f4-a959-7d97e02dce25 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: d7544332-b021-454f-887b-9462a85dd92a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:22.958901 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47d5ed4a-81a0-45f4-a959-7d97e02dce25 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:22.959389 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47d5ed4a-81a0-45f4-a959-7d97e02dce25 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:22.959830 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47d5ed4a-81a0-45f4-a959-7d97e02dce25 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:22.960548 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47d5ed4a-81a0-45f4-a959-7d97e02dce25 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:22.961036 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47d5ed4a-81a0-45f4-a959-7d97e02dce25 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:22.961464 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47d5ed4a-81a0-45f4-a959-7d97e02dce25 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:23.095743 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-47d5ed4a-81a0-45f4-a959-7d97e02dce25 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:23.103557 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-47d5ed4a-81a0-45f4-a959-7d97e02dce25 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a" status: 200 len: 1697 microversion: 2.1 time: 0.156708 Oct 18 16:11:23.104138 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3143/6306] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:22 2022] GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:24.128047 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ae8d0d9d-7d6c-4480-aa0d-954394eeed60 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:24.128692 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ae8d0d9d-7d6c-4480-aa0d-954394eeed60 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: d7544332-b021-454f-887b-9462a85dd92a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:24.135575 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae8d0d9d-7d6c-4480-aa0d-954394eeed60 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:24.136063 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae8d0d9d-7d6c-4480-aa0d-954394eeed60 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:24.137111 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae8d0d9d-7d6c-4480-aa0d-954394eeed60 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:24.137828 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae8d0d9d-7d6c-4480-aa0d-954394eeed60 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:24.138293 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae8d0d9d-7d6c-4480-aa0d-954394eeed60 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:24.138714 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae8d0d9d-7d6c-4480-aa0d-954394eeed60 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:24.211148 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-ec7d3f34-43c1-4075-86d5-6e0302120ad1 req-b89cea50-a31b-4260-ad0f-2cba5e824d21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7544332-b021-454f-887b-9462a85dd92a", "name": "network-vif-unplugged", "status": "completed", "tag": "db99007d-8221-4107-8ada-1e39fc404296"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:24.222159 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ec7d3f34-43c1-4075-86d5-6e0302120ad1 req-b89cea50-a31b-4260-ad0f-2cba5e824d21 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:24.222564 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ec7d3f34-43c1-4075-86d5-6e0302120ad1 req-b89cea50-a31b-4260-ad0f-2cba5e824d21 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:24.222986 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ec7d3f34-43c1-4075-86d5-6e0302120ad1 req-b89cea50-a31b-4260-ad0f-2cba5e824d21 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:24.236769 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-ec7d3f34-43c1-4075-86d5-6e0302120ad1 req-b89cea50-a31b-4260-ad0f-2cba5e824d21 service nova] Creating event network-vif-unplugged:db99007d-8221-4107-8ada-1e39fc404296 for instance d7544332-b021-454f-887b-9462a85dd92a on n-h2-853682-5 Oct 18 16:11:24.242444 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [req-ec7d3f34-43c1-4075-86d5-6e0302120ad1 req-b89cea50-a31b-4260-ad0f-2cba5e824d21 service nova] Instance d7544332-b021-454f-887b-9462a85dd92a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853682-5', 'n-h1-853682-5'} {{(pid=120406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 18 16:11:24.256207 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-ec7d3f34-43c1-4075-86d5-6e0302120ad1 req-b89cea50-a31b-4260-ad0f-2cba5e824d21 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048994 Oct 18 16:11:24.258897 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3144/6307] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:11:24.281674 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ae8d0d9d-7d6c-4480-aa0d-954394eeed60 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:24.289566 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ae8d0d9d-7d6c-4480-aa0d-954394eeed60 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a" status: 200 len: 1696 microversion: 2.1 time: 0.165490 Oct 18 16:11:24.294227 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3164/6308] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:24 2022] GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a => generated 1696 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:25.316404 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a6e142ad-3d81-44ce-bf55-bd10b827d82e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:25.317127 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a6e142ad-3d81-44ce-bf55-bd10b827d82e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: d7544332-b021-454f-887b-9462a85dd92a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:25.323574 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a6e142ad-3d81-44ce-bf55-bd10b827d82e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:25.324047 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a6e142ad-3d81-44ce-bf55-bd10b827d82e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:25.324476 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a6e142ad-3d81-44ce-bf55-bd10b827d82e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:25.325185 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a6e142ad-3d81-44ce-bf55-bd10b827d82e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:25.326484 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a6e142ad-3d81-44ce-bf55-bd10b827d82e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:25.327071 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a6e142ad-3d81-44ce-bf55-bd10b827d82e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:25.463100 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a6e142ad-3d81-44ce-bf55-bd10b827d82e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:25.470819 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a6e142ad-3d81-44ce-bf55-bd10b827d82e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a" status: 200 len: 1694 microversion: 2.1 time: 0.159566 Oct 18 16:11:25.471393 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3145/6309] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:25 2022] GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a => generated 1694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:26.299326 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-787fd5fd-0cf0-4bdf-8b91-4f285d2ffdad req-2be66ba9-2ce8-47f6-a3ca-d6cfffe50791 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7544332-b021-454f-887b-9462a85dd92a", "tag": "db99007d-8221-4107-8ada-1e39fc404296"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:26.310254 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-787fd5fd-0cf0-4bdf-8b91-4f285d2ffdad req-2be66ba9-2ce8-47f6-a3ca-d6cfffe50791 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:26.310806 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-787fd5fd-0cf0-4bdf-8b91-4f285d2ffdad req-2be66ba9-2ce8-47f6-a3ca-d6cfffe50791 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:26.311244 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-787fd5fd-0cf0-4bdf-8b91-4f285d2ffdad req-2be66ba9-2ce8-47f6-a3ca-d6cfffe50791 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:26.322835 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-787fd5fd-0cf0-4bdf-8b91-4f285d2ffdad req-2be66ba9-2ce8-47f6-a3ca-d6cfffe50791 service nova] Creating event network-changed:db99007d-8221-4107-8ada-1e39fc404296 for instance d7544332-b021-454f-887b-9462a85dd92a on n-h2-853682-5 Oct 18 16:11:26.328937 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [req-787fd5fd-0cf0-4bdf-8b91-4f285d2ffdad req-2be66ba9-2ce8-47f6-a3ca-d6cfffe50791 service nova] Instance d7544332-b021-454f-887b-9462a85dd92a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853682-5', 'n-h1-853682-5'} {{(pid=120405) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 18 16:11:26.339594 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-787fd5fd-0cf0-4bdf-8b91-4f285d2ffdad req-2be66ba9-2ce8-47f6-a3ca-d6cfffe50791 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044081 Oct 18 16:11:26.340184 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3165/6310] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:11:26.494003 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-64cff9a8-1dee-49cc-af81-001eae99e252 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:26.494652 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-64cff9a8-1dee-49cc-af81-001eae99e252 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: d7544332-b021-454f-887b-9462a85dd92a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:26.502431 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64cff9a8-1dee-49cc-af81-001eae99e252 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:26.502924 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64cff9a8-1dee-49cc-af81-001eae99e252 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:26.503364 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64cff9a8-1dee-49cc-af81-001eae99e252 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:26.504172 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64cff9a8-1dee-49cc-af81-001eae99e252 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:26.504628 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64cff9a8-1dee-49cc-af81-001eae99e252 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:26.505107 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64cff9a8-1dee-49cc-af81-001eae99e252 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:26.647003 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-64cff9a8-1dee-49cc-af81-001eae99e252 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:26.655358 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-64cff9a8-1dee-49cc-af81-001eae99e252 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a" status: 200 len: 1694 microversion: 2.1 time: 0.165264 Oct 18 16:11:26.656185 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3146/6311] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:26 2022] GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a => generated 1694 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:27.681209 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1993dd5a-33de-44c4-8d6a-106778649814 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:27.681923 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1993dd5a-33de-44c4-8d6a-106778649814 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: d7544332-b021-454f-887b-9462a85dd92a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:27.689234 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1993dd5a-33de-44c4-8d6a-106778649814 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:27.689628 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1993dd5a-33de-44c4-8d6a-106778649814 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:27.690072 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1993dd5a-33de-44c4-8d6a-106778649814 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:27.690818 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1993dd5a-33de-44c4-8d6a-106778649814 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:27.691280 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1993dd5a-33de-44c4-8d6a-106778649814 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:27.691713 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1993dd5a-33de-44c4-8d6a-106778649814 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:27.823665 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1993dd5a-33de-44c4-8d6a-106778649814 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:27.832102 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1993dd5a-33de-44c4-8d6a-106778649814 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a" status: 200 len: 1691 microversion: 2.1 time: 0.156434 Oct 18 16:11:27.832689 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3166/6312] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:27 2022] GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:27.854679 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e343d868-81ff-489e-a48f-421e992a5dfe tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:27.855226 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e343d868-81ff-489e-a48f-421e992a5dfe tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: d7544332-b021-454f-887b-9462a85dd92a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:27.863194 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e343d868-81ff-489e-a48f-421e992a5dfe tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:27.864067 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e343d868-81ff-489e-a48f-421e992a5dfe tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:27.864596 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e343d868-81ff-489e-a48f-421e992a5dfe tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:27.865340 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e343d868-81ff-489e-a48f-421e992a5dfe tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:27.865805 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e343d868-81ff-489e-a48f-421e992a5dfe tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:27.866234 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e343d868-81ff-489e-a48f-421e992a5dfe tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:27.976722 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e343d868-81ff-489e-a48f-421e992a5dfe tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "POST /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a/action" status: 202 len: 0 microversion: 2.1 time: 0.125811 Oct 18 16:11:27.977430 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3147/6313] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:11:27 2022] POST /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:11:27.986403 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-de5da81d-d203-4c13-bd83-59e61e82f8e5 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:27.987027 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-de5da81d-d203-4c13-bd83-59e61e82f8e5 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: d7544332-b021-454f-887b-9462a85dd92a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:27.993865 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de5da81d-d203-4c13-bd83-59e61e82f8e5 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:27.994360 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de5da81d-d203-4c13-bd83-59e61e82f8e5 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:27.994807 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de5da81d-d203-4c13-bd83-59e61e82f8e5 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:27.995517 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de5da81d-d203-4c13-bd83-59e61e82f8e5 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:27.995978 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de5da81d-d203-4c13-bd83-59e61e82f8e5 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:27.996518 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de5da81d-d203-4c13-bd83-59e61e82f8e5 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:28.138253 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-de5da81d-d203-4c13-bd83-59e61e82f8e5 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:28.146378 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-de5da81d-d203-4c13-bd83-59e61e82f8e5 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a" status: 200 len: 1690 microversion: 2.1 time: 0.164632 Oct 18 16:11:28.146959 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3167/6314] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:27 2022] GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a => generated 1690 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:29.171371 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eaddd6e2-f48a-4066-872e-2898891bc09e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:29.172085 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-eaddd6e2-f48a-4066-872e-2898891bc09e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: d7544332-b021-454f-887b-9462a85dd92a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:29.178656 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eaddd6e2-f48a-4066-872e-2898891bc09e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:29.179148 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eaddd6e2-f48a-4066-872e-2898891bc09e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:29.179589 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eaddd6e2-f48a-4066-872e-2898891bc09e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:29.180351 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eaddd6e2-f48a-4066-872e-2898891bc09e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:29.180846 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eaddd6e2-f48a-4066-872e-2898891bc09e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:29.181281 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eaddd6e2-f48a-4066-872e-2898891bc09e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:29.324153 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-eaddd6e2-f48a-4066-872e-2898891bc09e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:29.332995 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-eaddd6e2-f48a-4066-872e-2898891bc09e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a" status: 200 len: 1690 microversion: 2.1 time: 0.166765 Oct 18 16:11:29.333577 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3148/6315] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:29 2022] GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a => generated 1690 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:30.356818 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ea947ccb-1aa2-4849-913b-a5dcf2998b26 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:30.358530 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ea947ccb-1aa2-4849-913b-a5dcf2998b26 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: d7544332-b021-454f-887b-9462a85dd92a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:30.365902 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea947ccb-1aa2-4849-913b-a5dcf2998b26 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:30.366498 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea947ccb-1aa2-4849-913b-a5dcf2998b26 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:30.366932 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea947ccb-1aa2-4849-913b-a5dcf2998b26 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:30.367617 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea947ccb-1aa2-4849-913b-a5dcf2998b26 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:30.368067 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea947ccb-1aa2-4849-913b-a5dcf2998b26 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:30.368642 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea947ccb-1aa2-4849-913b-a5dcf2998b26 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:30.509411 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ea947ccb-1aa2-4849-913b-a5dcf2998b26 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:30.517193 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ea947ccb-1aa2-4849-913b-a5dcf2998b26 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a" status: 200 len: 1690 microversion: 2.1 time: 0.164409 Oct 18 16:11:30.518133 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3168/6316] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:30 2022] GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a => generated 1690 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:31.400652 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-39de6e9c-0278-421d-b146-bb384786b5ff req-04aaffeb-af39-4da5-a930-fd13305978c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7544332-b021-454f-887b-9462a85dd92a", "tag": "db99007d-8221-4107-8ada-1e39fc404296"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:31.412366 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-39de6e9c-0278-421d-b146-bb384786b5ff req-04aaffeb-af39-4da5-a930-fd13305978c9 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:31.412880 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-39de6e9c-0278-421d-b146-bb384786b5ff req-04aaffeb-af39-4da5-a930-fd13305978c9 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:31.413323 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-39de6e9c-0278-421d-b146-bb384786b5ff req-04aaffeb-af39-4da5-a930-fd13305978c9 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:31.426342 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-39de6e9c-0278-421d-b146-bb384786b5ff req-04aaffeb-af39-4da5-a930-fd13305978c9 service nova] Creating event network-changed:db99007d-8221-4107-8ada-1e39fc404296 for instance d7544332-b021-454f-887b-9462a85dd92a on n-h1-853682-5 Oct 18 16:11:31.429677 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:31.434176 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [req-39de6e9c-0278-421d-b146-bb384786b5ff req-04aaffeb-af39-4da5-a930-fd13305978c9 service nova] Instance d7544332-b021-454f-887b-9462a85dd92a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853682-5', 'n-h1-853682-5'} {{(pid=120406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 18 16:11:31.447735 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-39de6e9c-0278-421d-b146-bb384786b5ff req-04aaffeb-af39-4da5-a930-fd13305978c9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050407 Oct 18 16:11:31.448363 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3149/6317] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:11:31.546220 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-73286bca-cc98-4a45-a207-b47df52f7a51 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:31.546848 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-73286bca-cc98-4a45-a207-b47df52f7a51 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: d7544332-b021-454f-887b-9462a85dd92a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:31.554384 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-73286bca-cc98-4a45-a207-b47df52f7a51 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:31.554877 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-73286bca-cc98-4a45-a207-b47df52f7a51 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:31.555324 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-73286bca-cc98-4a45-a207-b47df52f7a51 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:31.556035 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-73286bca-cc98-4a45-a207-b47df52f7a51 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:31.556498 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-73286bca-cc98-4a45-a207-b47df52f7a51 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:31.558374 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-73286bca-cc98-4a45-a207-b47df52f7a51 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:31.702693 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-73286bca-cc98-4a45-a207-b47df52f7a51 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:31.710375 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-73286bca-cc98-4a45-a207-b47df52f7a51 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a" status: 200 len: 1690 microversion: 2.1 time: 0.168164 Oct 18 16:11:31.712853 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3169/6318] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:31 2022] GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a => generated 1690 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:11:32.735544 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ae5c2bbf-3783-4ee1-af7a-10d75b8c0ceb tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:32.736311 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ae5c2bbf-3783-4ee1-af7a-10d75b8c0ceb tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: d7544332-b021-454f-887b-9462a85dd92a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:32.746926 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae5c2bbf-3783-4ee1-af7a-10d75b8c0ceb tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:32.747426 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae5c2bbf-3783-4ee1-af7a-10d75b8c0ceb tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:32.747866 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae5c2bbf-3783-4ee1-af7a-10d75b8c0ceb tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:32.748565 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae5c2bbf-3783-4ee1-af7a-10d75b8c0ceb tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:32.749045 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae5c2bbf-3783-4ee1-af7a-10d75b8c0ceb tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:32.749477 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae5c2bbf-3783-4ee1-af7a-10d75b8c0ceb tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:32.888247 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ae5c2bbf-3783-4ee1-af7a-10d75b8c0ceb tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:32.897453 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ae5c2bbf-3783-4ee1-af7a-10d75b8c0ceb tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a" status: 200 len: 1690 microversion: 2.1 time: 0.167119 Oct 18 16:11:32.898472 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3150/6319] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:32 2022] GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a => generated 1690 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:33.923693 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-32c871d0-d2ff-4e24-a8fa-78d9045d7b74 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:33.924305 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-32c871d0-d2ff-4e24-a8fa-78d9045d7b74 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: d7544332-b021-454f-887b-9462a85dd92a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:33.931486 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-32c871d0-d2ff-4e24-a8fa-78d9045d7b74 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:33.931992 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-32c871d0-d2ff-4e24-a8fa-78d9045d7b74 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:33.932428 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-32c871d0-d2ff-4e24-a8fa-78d9045d7b74 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:33.933139 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-32c871d0-d2ff-4e24-a8fa-78d9045d7b74 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:33.933597 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-32c871d0-d2ff-4e24-a8fa-78d9045d7b74 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:33.934017 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-32c871d0-d2ff-4e24-a8fa-78d9045d7b74 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:34.071541 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-32c871d0-d2ff-4e24-a8fa-78d9045d7b74 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:34.079322 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-32c871d0-d2ff-4e24-a8fa-78d9045d7b74 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a" status: 200 len: 1690 microversion: 2.1 time: 0.160042 Oct 18 16:11:34.079898 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3170/6320] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:33 2022] GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:35.102072 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5d3143be-a90c-4441-bb83-3b8bf0a09888 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:35.102823 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5d3143be-a90c-4441-bb83-3b8bf0a09888 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: d7544332-b021-454f-887b-9462a85dd92a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:35.113195 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d3143be-a90c-4441-bb83-3b8bf0a09888 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:35.113694 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d3143be-a90c-4441-bb83-3b8bf0a09888 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:35.114141 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d3143be-a90c-4441-bb83-3b8bf0a09888 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:35.114883 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d3143be-a90c-4441-bb83-3b8bf0a09888 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:35.125564 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d3143be-a90c-4441-bb83-3b8bf0a09888 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:35.126104 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d3143be-a90c-4441-bb83-3b8bf0a09888 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:35.345714 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5d3143be-a90c-4441-bb83-3b8bf0a09888 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:35.353577 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5d3143be-a90c-4441-bb83-3b8bf0a09888 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a" status: 200 len: 1690 microversion: 2.1 time: 0.255566 Oct 18 16:11:35.354155 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3151/6321] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:35 2022] GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a => generated 1690 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:11:36.378128 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4e570f2b-dc4a-4384-b793-6aaa9682e34b tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:11:36.378741 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4e570f2b-dc4a-4384-b793-6aaa9682e34b tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: d7544332-b021-454f-887b-9462a85dd92a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:11:36.385420 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4e570f2b-dc4a-4384-b793-6aaa9682e34b tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:36.385903 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4e570f2b-dc4a-4384-b793-6aaa9682e34b tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:36.386337 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4e570f2b-dc4a-4384-b793-6aaa9682e34b tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:36.387021 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4e570f2b-dc4a-4384-b793-6aaa9682e34b tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:36.387472 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4e570f2b-dc4a-4384-b793-6aaa9682e34b tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:36.387893 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4e570f2b-dc4a-4384-b793-6aaa9682e34b tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:36.579908 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4e570f2b-dc4a-4384-b793-6aaa9682e34b tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:11:36.587753 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4e570f2b-dc4a-4384-b793-6aaa9682e34b tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a" status: 200 len: 1683 microversion: 2.1 time: 0.213570 Oct 18 16:11:36.588331 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3171/6322] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:11:36 2022] GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a => generated 1683 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:11:39.812745 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-80da1dce-fe18-4900-a141-8f118b88d88c req-4962bedb-1223-4394-80d3-c8cf6cc3a51e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7544332-b021-454f-887b-9462a85dd92a", "name": "network-vif-plugged", "status": "completed", "tag": "db99007d-8221-4107-8ada-1e39fc404296"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:11:39.818722 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=39 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:39.824725 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-80da1dce-fe18-4900-a141-8f118b88d88c req-4962bedb-1223-4394-80d3-c8cf6cc3a51e service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:11:39.825238 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-80da1dce-fe18-4900-a141-8f118b88d88c req-4962bedb-1223-4394-80d3-c8cf6cc3a51e service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:11:39.825672 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-80da1dce-fe18-4900-a141-8f118b88d88c req-4962bedb-1223-4394-80d3-c8cf6cc3a51e service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:11:39.837136 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-80da1dce-fe18-4900-a141-8f118b88d88c req-4962bedb-1223-4394-80d3-c8cf6cc3a51e service nova] Creating event network-vif-plugged:db99007d-8221-4107-8ada-1e39fc404296 for instance d7544332-b021-454f-887b-9462a85dd92a on n-h1-853682-5 Oct 18 16:11:39.842614 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-80da1dce-fe18-4900-a141-8f118b88d88c req-4962bedb-1223-4394-80d3-c8cf6cc3a51e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033716 Oct 18 16:11:39.843214 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3152/6323] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:12:06.810374 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-795c0caf-c6b0-4248-bb76-7f8083c55fa1 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:12:06.812659 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-795c0caf-c6b0-4248-bb76-7f8083c55fa1 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: d7544332-b021-454f-887b-9462a85dd92a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:06.815160 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=32 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:12:06.815815 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=92 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:12:06.822883 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-795c0caf-c6b0-4248-bb76-7f8083c55fa1 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:06.823382 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-795c0caf-c6b0-4248-bb76-7f8083c55fa1 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:06.823827 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-795c0caf-c6b0-4248-bb76-7f8083c55fa1 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:06.824535 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-795c0caf-c6b0-4248-bb76-7f8083c55fa1 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:06.825032 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-795c0caf-c6b0-4248-bb76-7f8083c55fa1 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:06.825467 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-795c0caf-c6b0-4248-bb76-7f8083c55fa1 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:06.896188 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-795c0caf-c6b0-4248-bb76-7f8083c55fa1 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "POST /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a/action" status: 200 len: 63117 microversion: 2.1 time: 0.089602 Oct 18 16:12:06.897191 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3172/6324] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:12:06 2022] POST /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a/action => generated 63117 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:12:23.098295 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:12:23.099038 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=15 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:12:23.100749 n-d-853682-5 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 18 16:12:23.249788 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-58b22f7b-f897-4244-852e-aec7f922d8f7 tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:23.250490 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-58b22f7b-f897-4244-852e-aec7f922d8f7 tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] [instance: d7544332-b021-454f-887b-9462a85dd92a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:23.257853 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58b22f7b-f897-4244-852e-aec7f922d8f7 tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:23.258337 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58b22f7b-f897-4244-852e-aec7f922d8f7 tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:23.258770 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58b22f7b-f897-4244-852e-aec7f922d8f7 tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:23.259458 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58b22f7b-f897-4244-852e-aec7f922d8f7 tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:23.259912 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58b22f7b-f897-4244-852e-aec7f922d8f7 tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:23.260336 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58b22f7b-f897-4244-852e-aec7f922d8f7 tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:23.392511 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-58b22f7b-f897-4244-852e-aec7f922d8f7 tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a" status: 200 len: 1834 microversion: 2.1 time: 0.296914 Oct 18 16:12:23.393666 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3153/6325] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:23 2022] GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a => generated 1834 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:24.402187 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2b53e7a0-9943-4226-87fc-2d7f510aee3f tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:24.402784 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2b53e7a0-9943-4226-87fc-2d7f510aee3f tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: d7544332-b021-454f-887b-9462a85dd92a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:24.406313 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:12:24.407444 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=4 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:12:24.415062 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2b53e7a0-9943-4226-87fc-2d7f510aee3f tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:24.415787 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2b53e7a0-9943-4226-87fc-2d7f510aee3f tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:24.416321 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2b53e7a0-9943-4226-87fc-2d7f510aee3f tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:24.417306 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2b53e7a0-9943-4226-87fc-2d7f510aee3f tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:24.417838 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2b53e7a0-9943-4226-87fc-2d7f510aee3f tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:24.418349 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2b53e7a0-9943-4226-87fc-2d7f510aee3f tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:24.447894 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2b53e7a0-9943-4226-87fc-2d7f510aee3f tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: d7544332-b021-454f-887b-9462a85dd92a] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:12:24.472667 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-4c394697-56b3-411c-8dc5-ca06084a5f83 req-a76c364e-87d7-4cd7-a963-a22b025ee05c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7544332-b021-454f-887b-9462a85dd92a", "tag": "db99007d-8221-4107-8ada-1e39fc404296"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:12:24.482288 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4c394697-56b3-411c-8dc5-ca06084a5f83 req-a76c364e-87d7-4cd7-a963-a22b025ee05c service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:24.482768 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4c394697-56b3-411c-8dc5-ca06084a5f83 req-a76c364e-87d7-4cd7-a963-a22b025ee05c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:24.483204 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4c394697-56b3-411c-8dc5-ca06084a5f83 req-a76c364e-87d7-4cd7-a963-a22b025ee05c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:24.497343 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-4c394697-56b3-411c-8dc5-ca06084a5f83 req-a76c364e-87d7-4cd7-a963-a22b025ee05c service nova] Creating event network-changed:db99007d-8221-4107-8ada-1e39fc404296 for instance d7544332-b021-454f-887b-9462a85dd92a on n-h1-853682-5 Oct 18 16:12:24.505511 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-4c394697-56b3-411c-8dc5-ca06084a5f83 req-a76c364e-87d7-4cd7-a963-a22b025ee05c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105458 Oct 18 16:12:24.507780 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3154/6326] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:12:24.541464 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2b53e7a0-9943-4226-87fc-2d7f510aee3f tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a" status: 204 len: 0 microversion: 2.1 time: 0.143524 Oct 18 16:12:24.542417 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3173/6327] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 16:12:24 2022] DELETE /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:12:24.552491 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-691cd6ba-97ad-4840-9851-ee7c8f4cee53 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:24.553585 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-691cd6ba-97ad-4840-9851-ee7c8f4cee53 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: d7544332-b021-454f-887b-9462a85dd92a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:24.561324 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-691cd6ba-97ad-4840-9851-ee7c8f4cee53 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:24.562213 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-691cd6ba-97ad-4840-9851-ee7c8f4cee53 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:24.562887 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-691cd6ba-97ad-4840-9851-ee7c8f4cee53 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:24.563998 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-691cd6ba-97ad-4840-9851-ee7c8f4cee53 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:24.564964 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-691cd6ba-97ad-4840-9851-ee7c8f4cee53 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:24.565682 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-691cd6ba-97ad-4840-9851-ee7c8f4cee53 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:24.710016 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-691cd6ba-97ad-4840-9851-ee7c8f4cee53 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:24.717857 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-691cd6ba-97ad-4840-9851-ee7c8f4cee53 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a" status: 200 len: 1689 microversion: 2.1 time: 0.170992 Oct 18 16:12:24.718453 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3155/6328] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:24 2022] GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a => generated 1689 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:12:25.743007 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bf1bd265-14c1-4ba3-8ff7-ed25e107f6c2 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:25.743709 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-bf1bd265-14c1-4ba3-8ff7-ed25e107f6c2 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: d7544332-b021-454f-887b-9462a85dd92a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:25.750576 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bf1bd265-14c1-4ba3-8ff7-ed25e107f6c2 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:25.751062 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bf1bd265-14c1-4ba3-8ff7-ed25e107f6c2 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:25.751500 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bf1bd265-14c1-4ba3-8ff7-ed25e107f6c2 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:25.752211 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bf1bd265-14c1-4ba3-8ff7-ed25e107f6c2 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:25.752721 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bf1bd265-14c1-4ba3-8ff7-ed25e107f6c2 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:25.753175 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bf1bd265-14c1-4ba3-8ff7-ed25e107f6c2 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:25.888047 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-bf1bd265-14c1-4ba3-8ff7-ed25e107f6c2 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:25.896640 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-bf1bd265-14c1-4ba3-8ff7-ed25e107f6c2 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a" status: 200 len: 1689 microversion: 2.1 time: 0.157919 Oct 18 16:12:25.897253 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3174/6329] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:25 2022] GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:12:26.921699 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-813dbeb5-c6ed-4f09-aee8-5099fe94639c tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:26.922373 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-813dbeb5-c6ed-4f09-aee8-5099fe94639c tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: d7544332-b021-454f-887b-9462a85dd92a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:26.931168 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-813dbeb5-c6ed-4f09-aee8-5099fe94639c tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:26.931652 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-813dbeb5-c6ed-4f09-aee8-5099fe94639c tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:26.932076 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-813dbeb5-c6ed-4f09-aee8-5099fe94639c tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:26.933444 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-813dbeb5-c6ed-4f09-aee8-5099fe94639c tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:26.933900 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-813dbeb5-c6ed-4f09-aee8-5099fe94639c tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:26.934321 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-813dbeb5-c6ed-4f09-aee8-5099fe94639c tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:26.935922 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-97d2c8e5-44e0-4ad8-bb45-d2b8e09b72c9 req-ea43a746-5b15-49bc-a9d6-da6869390c32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7544332-b021-454f-887b-9462a85dd92a", "name": "network-vif-deleted", "tag": "db99007d-8221-4107-8ada-1e39fc404296"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:12:26.948346 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-97d2c8e5-44e0-4ad8-bb45-d2b8e09b72c9 req-ea43a746-5b15-49bc-a9d6-da6869390c32 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:26.948980 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-97d2c8e5-44e0-4ad8-bb45-d2b8e09b72c9 req-ea43a746-5b15-49bc-a9d6-da6869390c32 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:26.949534 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-97d2c8e5-44e0-4ad8-bb45-d2b8e09b72c9 req-ea43a746-5b15-49bc-a9d6-da6869390c32 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:26.963391 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-97d2c8e5-44e0-4ad8-bb45-d2b8e09b72c9 req-ea43a746-5b15-49bc-a9d6-da6869390c32 service nova] Creating event network-vif-deleted:db99007d-8221-4107-8ada-1e39fc404296 for instance d7544332-b021-454f-887b-9462a85dd92a on n-h1-853682-5 Oct 18 16:12:26.969091 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-97d2c8e5-44e0-4ad8-bb45-d2b8e09b72c9 req-ea43a746-5b15-49bc-a9d6-da6869390c32 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037305 Oct 18 16:12:26.969715 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3175/6330] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:12:27.004871 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-813dbeb5-c6ed-4f09-aee8-5099fe94639c tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:27.013413 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-813dbeb5-c6ed-4f09-aee8-5099fe94639c tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a" status: 200 len: 1503 microversion: 2.1 time: 0.096239 Oct 18 16:12:27.016034 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3156/6331] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:26 2022] GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a => generated 1503 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:28.039036 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a8b1f5d6-e5d4-4d07-8703-63ba84fb69a1 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:28.039772 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a8b1f5d6-e5d4-4d07-8703-63ba84fb69a1 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: d7544332-b021-454f-887b-9462a85dd92a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:28.046271 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a8b1f5d6-e5d4-4d07-8703-63ba84fb69a1 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:28.046761 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a8b1f5d6-e5d4-4d07-8703-63ba84fb69a1 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:28.047207 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a8b1f5d6-e5d4-4d07-8703-63ba84fb69a1 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:28.047908 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a8b1f5d6-e5d4-4d07-8703-63ba84fb69a1 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:28.048371 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a8b1f5d6-e5d4-4d07-8703-63ba84fb69a1 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:28.048822 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a8b1f5d6-e5d4-4d07-8703-63ba84fb69a1 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:28.062811 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-a8b1f5d6-e5d4-4d07-8703-63ba84fb69a1 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] HTTP exception thrown: Instance d7544332-b021-454f-887b-9462a85dd92a could not be found. Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a8b1f5d6-e5d4-4d07-8703-63ba84fb69a1 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Request method failure captured: Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a HTTP/1.1 Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTs8upjSfiwu14tRxn4v0SgmAedKIqRyez8Aw8SOZdWUfAF0oMQr1R7xRzarToYQHo42vdtsSxTu7-2HkwGui-JshrtyxJTkQsS83jVEOu3jeAOKtt4DIMDKQgSeb11ABNJcyR5RNHKJLx2pVrTjzxDpmJ_EBIOFJJALPV4oSx6sXUQQ Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: a7b4ef10957e43b8a57a419fa0d6de0e Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-581510455 Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a7b4ef10957e43b8a57a419fa0d6de0e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a7b4ef10957e43b8a57a419fa0d6de0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a7b4ef10957e43b8a57a419fa0d6de0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a7b4ef10957e43b8a57a419fa0d6de0e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-TestNetworkAdvancedServerOps-581510455 Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: a7b4ef10957e43b8a57a419fa0d6de0e Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-581510455 Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-TestNetworkAdvancedServerOps-581510455-project Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 153a83de00ae4445a1efd17d70990630 Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-TestNetworkAdvancedServerOps-581510455-project Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance d7544332-b021-454f-887b-9462a85dd92a could not be found. Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'd7544332-b021-454f-887b-9462a85dd92a'} Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7544332-b021-454f-887b-9462a85dd92a could not be found. Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7544332-b021-454f-887b-9462a85dd92a could not be found. Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:12:28.064485 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:12:28.069616 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:12:28.069616 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:12:28.069616 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:12:28.069616 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:12:28.069616 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:12:28.069616 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:12:28.069616 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7544332-b021-454f-887b-9462a85dd92a could not be found. Oct 18 16:12:28.069616 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:12:28.069616 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a8b1f5d6-e5d4-4d07-8703-63ba84fb69a1 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Returning 404 to user: Instance d7544332-b021-454f-887b-9462a85dd92a could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:12:28.069616 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a8b1f5d6-e5d4-4d07-8703-63ba84fb69a1 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a" status: 404 len: 111 microversion: 2.1 time: 0.032258 Oct 18 16:12:28.069616 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3176/6332] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:28 2022] GET /compute/v2.1/servers/d7544332-b021-454f-887b-9462a85dd92a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:12:31.425103 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6ab6cf98-1840-48dd-9d7d-d763a89618f9 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '.version_select at 0x7f7c37c37ca0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:31.453769 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6ab6cf98-1840-48dd-9d7d-d763a89618f9 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1896880976" status: 202 len: 0 microversion: 2.1 time: 0.033095 Oct 18 16:12:31.456009 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3157/6333] 10.222.0.60 () {58 vars in 1284 bytes} [Tue Oct 18 16:12:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1896880976 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:12:31.491732 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-98af0b8b-5bf0-4822-bcdb-cade275d9c1f tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Action: 'create', calling method: .version_select at 0x7f7c3d703ee0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-725008417", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLARv00IIa04IUQNQy5+iW1AjMfjtzX819z+FtVtTqwB3BqImNwMhUnjjviMfRBDTbpwN2z5S80Yfj+Y1RkuY3GCzXiVR3j3GC0W23Zb+pzh5OJbKNAgem70PFCwxYF9ZQ=="}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:12:31.510444 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-98af0b8b-5bf0-4822-bcdb-cade275d9c1f tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Getting quotas for project a7b4ef10957e43b8a57a419fa0d6de0e. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:12:31.516226 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-98af0b8b-5bf0-4822-bcdb-cade275d9c1f tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Getting quotas for user 153a83de00ae4445a1efd17d70990630 and project a7b4ef10957e43b8a57a419fa0d6de0e. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:12:31.541920 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-98af0b8b-5bf0-4822-bcdb-cade275d9c1f tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.054211 Oct 18 16:12:31.542776 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3177/6334] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Oct 18 16:12:31 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:12:37.108402 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-10af184d-1a01-43d3-bdf0-15da407b2689 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-433609490", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "b54d0ab0-6d43-4beb-9e0e-ed98a4911a3b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-725008417", "security_groups": [{"name": "tempest-secgroup-smoke-962780869"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:12:37.139915 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=20 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:12:37.241456 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-10af184d-1a01-43d3-bdf0-15da407b2689 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] validate_networks() for [('b54d0ab0-6d43-4beb-9e0e-ed98a4911a3b', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 16:12:37.678373 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-10af184d-1a01-43d3-bdf0-15da407b2689 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:12:37.678803 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-10af184d-1a01-43d3-bdf0-15da407b2689 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:12:37.679311 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-10af184d-1a01-43d3-bdf0-15da407b2689 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:12:37.684559 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-10af184d-1a01-43d3-bdf0-15da407b2689 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:12:37.685038 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-10af184d-1a01-43d3-bdf0-15da407b2689 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:12:37.695058 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10af184d-1a01-43d3-bdf0-15da407b2689 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:37.695555 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10af184d-1a01-43d3-bdf0-15da407b2689 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:37.695995 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10af184d-1a01-43d3-bdf0-15da407b2689 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:37.696766 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10af184d-1a01-43d3-bdf0-15da407b2689 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:37.697280 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10af184d-1a01-43d3-bdf0-15da407b2689 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:37.697709 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10af184d-1a01-43d3-bdf0-15da407b2689 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:37.715567 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-10af184d-1a01-43d3-bdf0-15da407b2689 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Getting quotas for project a7b4ef10957e43b8a57a419fa0d6de0e. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:12:37.720921 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-10af184d-1a01-43d3-bdf0-15da407b2689 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Getting quotas for user 153a83de00ae4445a1efd17d70990630 and project a7b4ef10957e43b8a57a419fa0d6de0e. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:12:37.735044 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-10af184d-1a01-43d3-bdf0-15da407b2689 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:12:37.737641 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-10af184d-1a01-43d3-bdf0-15da407b2689 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 43d7a680-1dee-4f14-9b35-9c53b0968de1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:12:37.786621 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-10af184d-1a01-43d3-bdf0-15da407b2689 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.682146 Oct 18 16:12:37.793872 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3158/6335] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 16:12:37 2022] POST /compute/v2.1/servers => generated 405 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:12:37.799985 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1dac271d-243b-4a98-94bd-b8b20e48a3b8 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:37.801154 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1dac271d-243b-4a98-94bd-b8b20e48a3b8 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 43d7a680-1dee-4f14-9b35-9c53b0968de1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:37.864594 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1dac271d-243b-4a98-94bd-b8b20e48a3b8 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:37.871670 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1dac271d-243b-4a98-94bd-b8b20e48a3b8 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1" status: 200 len: 1265 microversion: 2.1 time: 0.076785 Oct 18 16:12:37.872336 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3178/6336] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:37 2022] GET /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1 => generated 1265 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:12:38.896150 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cf8fe361-4658-4c71-9b34-f10c5c40b6ce tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:38.896905 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cf8fe361-4658-4c71-9b34-f10c5c40b6ce tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 43d7a680-1dee-4f14-9b35-9c53b0968de1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:38.953532 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cf8fe361-4658-4c71-9b34-f10c5c40b6ce tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:38.962969 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cf8fe361-4658-4c71-9b34-f10c5c40b6ce tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1" status: 200 len: 1265 microversion: 2.1 time: 0.071486 Oct 18 16:12:38.964084 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3159/6337] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:38 2022] GET /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1 => generated 1265 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:39.987090 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1e3cc84e-8642-44b1-8573-fda435b3c9b2 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:39.987713 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1e3cc84e-8642-44b1-8573-fda435b3c9b2 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 43d7a680-1dee-4f14-9b35-9c53b0968de1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:39.990274 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:12:40.045806 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1e3cc84e-8642-44b1-8573-fda435b3c9b2 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:40.053924 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1e3cc84e-8642-44b1-8573-fda435b3c9b2 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1" status: 200 len: 1265 microversion: 2.1 time: 0.070833 Oct 18 16:12:40.054500 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3179/6338] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:39 2022] GET /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1 => generated 1265 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:41.077042 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0a52837f-d634-4aef-9492-a7efc27ab22d tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:41.077770 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0a52837f-d634-4aef-9492-a7efc27ab22d tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 43d7a680-1dee-4f14-9b35-9c53b0968de1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:41.085465 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a52837f-d634-4aef-9492-a7efc27ab22d tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:41.086037 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a52837f-d634-4aef-9492-a7efc27ab22d tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:41.086527 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a52837f-d634-4aef-9492-a7efc27ab22d tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:41.087419 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a52837f-d634-4aef-9492-a7efc27ab22d tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:41.087892 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a52837f-d634-4aef-9492-a7efc27ab22d tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:41.088320 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a52837f-d634-4aef-9492-a7efc27ab22d tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:41.161380 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0a52837f-d634-4aef-9492-a7efc27ab22d tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:41.169087 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0a52837f-d634-4aef-9492-a7efc27ab22d tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1" status: 200 len: 1335 microversion: 2.1 time: 0.096211 Oct 18 16:12:41.169662 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3160/6339] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:41 2022] GET /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1 => generated 1335 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:42.194173 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3214f485-b0aa-4379-b51c-2beb674985e7 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:42.194886 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3214f485-b0aa-4379-b51c-2beb674985e7 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 43d7a680-1dee-4f14-9b35-9c53b0968de1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:42.201976 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3214f485-b0aa-4379-b51c-2beb674985e7 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:42.202576 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3214f485-b0aa-4379-b51c-2beb674985e7 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:42.203025 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3214f485-b0aa-4379-b51c-2beb674985e7 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:42.203729 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3214f485-b0aa-4379-b51c-2beb674985e7 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:42.204195 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3214f485-b0aa-4379-b51c-2beb674985e7 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:42.204629 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3214f485-b0aa-4379-b51c-2beb674985e7 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:42.446654 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3214f485-b0aa-4379-b51c-2beb674985e7 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:42.454579 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3214f485-b0aa-4379-b51c-2beb674985e7 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1" status: 200 len: 1390 microversion: 2.1 time: 0.264952 Oct 18 16:12:42.455156 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3180/6340] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:42 2022] GET /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1 => generated 1390 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:42.630443 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-3b2a4f5c-d9ba-4692-b115-3db341fc4526 req-451503d7-d93f-415b-8096-101a796c8258 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43d7a680-1dee-4f14-9b35-9c53b0968de1", "tag": "a351cebc-8256-4d8b-9d06-02d5ea8332d9"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:12:42.644140 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3b2a4f5c-d9ba-4692-b115-3db341fc4526 req-451503d7-d93f-415b-8096-101a796c8258 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:42.644740 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3b2a4f5c-d9ba-4692-b115-3db341fc4526 req-451503d7-d93f-415b-8096-101a796c8258 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:42.645285 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3b2a4f5c-d9ba-4692-b115-3db341fc4526 req-451503d7-d93f-415b-8096-101a796c8258 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:42.657267 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-3b2a4f5c-d9ba-4692-b115-3db341fc4526 req-451503d7-d93f-415b-8096-101a796c8258 service nova] Creating event network-changed:a351cebc-8256-4d8b-9d06-02d5ea8332d9 for instance 43d7a680-1dee-4f14-9b35-9c53b0968de1 on n-h1-853682-5 Oct 18 16:12:42.662879 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-3b2a4f5c-d9ba-4692-b115-3db341fc4526 req-451503d7-d93f-415b-8096-101a796c8258 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036565 Oct 18 16:12:42.663259 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3161/6341] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:12:43.478634 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-74e4c003-40f9-482d-8382-a227280957bf tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:43.479386 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-74e4c003-40f9-482d-8382-a227280957bf tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 43d7a680-1dee-4f14-9b35-9c53b0968de1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:43.486570 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-74e4c003-40f9-482d-8382-a227280957bf tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:43.487058 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-74e4c003-40f9-482d-8382-a227280957bf tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:43.487498 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-74e4c003-40f9-482d-8382-a227280957bf tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:43.488204 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-74e4c003-40f9-482d-8382-a227280957bf tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:43.488695 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-74e4c003-40f9-482d-8382-a227280957bf tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:43.489734 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-74e4c003-40f9-482d-8382-a227280957bf tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:43.620151 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-74e4c003-40f9-482d-8382-a227280957bf tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:43.627935 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-74e4c003-40f9-482d-8382-a227280957bf tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1" status: 200 len: 1390 microversion: 2.1 time: 0.153297 Oct 18 16:12:43.628514 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3181/6342] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:43 2022] GET /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1 => generated 1390 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:12:44.652049 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e83476a9-f6e5-43ac-817f-595ad0c7495d tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:44.652754 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e83476a9-f6e5-43ac-817f-595ad0c7495d tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 43d7a680-1dee-4f14-9b35-9c53b0968de1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:44.659124 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e83476a9-f6e5-43ac-817f-595ad0c7495d tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:44.659612 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e83476a9-f6e5-43ac-817f-595ad0c7495d tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:44.660051 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e83476a9-f6e5-43ac-817f-595ad0c7495d tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:44.660747 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e83476a9-f6e5-43ac-817f-595ad0c7495d tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:44.661229 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e83476a9-f6e5-43ac-817f-595ad0c7495d tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:44.661658 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e83476a9-f6e5-43ac-817f-595ad0c7495d tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:44.793537 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e83476a9-f6e5-43ac-817f-595ad0c7495d tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:44.801822 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e83476a9-f6e5-43ac-817f-595ad0c7495d tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1" status: 200 len: 1390 microversion: 2.1 time: 0.154359 Oct 18 16:12:44.802400 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3162/6343] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:44 2022] GET /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1 => generated 1390 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:45.825830 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-575fbc7b-d3e0-4da0-bf01-11c50f60a2b3 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:45.826447 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-575fbc7b-d3e0-4da0-bf01-11c50f60a2b3 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 43d7a680-1dee-4f14-9b35-9c53b0968de1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:45.835198 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-575fbc7b-d3e0-4da0-bf01-11c50f60a2b3 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:45.835705 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-575fbc7b-d3e0-4da0-bf01-11c50f60a2b3 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:45.836142 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-575fbc7b-d3e0-4da0-bf01-11c50f60a2b3 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:45.836866 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-575fbc7b-d3e0-4da0-bf01-11c50f60a2b3 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:45.837326 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-575fbc7b-d3e0-4da0-bf01-11c50f60a2b3 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:45.837751 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-575fbc7b-d3e0-4da0-bf01-11c50f60a2b3 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:45.978928 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-575fbc7b-d3e0-4da0-bf01-11c50f60a2b3 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:45.986682 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-575fbc7b-d3e0-4da0-bf01-11c50f60a2b3 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1" status: 200 len: 1390 microversion: 2.1 time: 0.164740 Oct 18 16:12:45.987282 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3182/6344] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:45 2022] GET /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1 => generated 1390 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:47.011004 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-158e9a00-da2e-447b-afc3-6bd73799a2e9 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:47.011617 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-158e9a00-da2e-447b-afc3-6bd73799a2e9 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 43d7a680-1dee-4f14-9b35-9c53b0968de1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:47.018442 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-158e9a00-da2e-447b-afc3-6bd73799a2e9 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:47.018926 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-158e9a00-da2e-447b-afc3-6bd73799a2e9 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:47.019362 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-158e9a00-da2e-447b-afc3-6bd73799a2e9 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:47.020052 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-158e9a00-da2e-447b-afc3-6bd73799a2e9 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:47.020511 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-158e9a00-da2e-447b-afc3-6bd73799a2e9 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:47.020964 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-158e9a00-da2e-447b-afc3-6bd73799a2e9 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:47.155668 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-158e9a00-da2e-447b-afc3-6bd73799a2e9 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:47.163521 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-158e9a00-da2e-447b-afc3-6bd73799a2e9 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1" status: 200 len: 1390 microversion: 2.1 time: 0.156468 Oct 18 16:12:47.164111 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3163/6345] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:47 2022] GET /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1 => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:48.187722 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-89efb141-01ef-4d26-8080-a413d042be89 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:48.188351 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-89efb141-01ef-4d26-8080-a413d042be89 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 43d7a680-1dee-4f14-9b35-9c53b0968de1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:48.195810 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-89efb141-01ef-4d26-8080-a413d042be89 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:48.196292 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-89efb141-01ef-4d26-8080-a413d042be89 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:48.196730 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-89efb141-01ef-4d26-8080-a413d042be89 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:48.197457 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-89efb141-01ef-4d26-8080-a413d042be89 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:48.197916 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-89efb141-01ef-4d26-8080-a413d042be89 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:48.198340 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-89efb141-01ef-4d26-8080-a413d042be89 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:48.333778 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-89efb141-01ef-4d26-8080-a413d042be89 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:48.341551 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-89efb141-01ef-4d26-8080-a413d042be89 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1" status: 200 len: 1390 microversion: 2.1 time: 0.157819 Oct 18 16:12:48.342124 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3183/6346] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:48 2022] GET /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1 => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:49.363545 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fa2b542d-cd7e-4e29-bf28-cabc936e520d tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:49.364161 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fa2b542d-cd7e-4e29-bf28-cabc936e520d tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 43d7a680-1dee-4f14-9b35-9c53b0968de1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:49.366167 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:12:49.367646 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=8 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:12:49.373364 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fa2b542d-cd7e-4e29-bf28-cabc936e520d tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:49.373847 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fa2b542d-cd7e-4e29-bf28-cabc936e520d tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:49.374283 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fa2b542d-cd7e-4e29-bf28-cabc936e520d tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:49.374979 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fa2b542d-cd7e-4e29-bf28-cabc936e520d tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:49.375431 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fa2b542d-cd7e-4e29-bf28-cabc936e520d tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:49.375853 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fa2b542d-cd7e-4e29-bf28-cabc936e520d tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:49.510463 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fa2b542d-cd7e-4e29-bf28-cabc936e520d tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:49.518195 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fa2b542d-cd7e-4e29-bf28-cabc936e520d tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1" status: 200 len: 1390 microversion: 2.1 time: 0.158514 Oct 18 16:12:49.518773 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3164/6347] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:49 2022] GET /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1 => generated 1390 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:50.244123 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-3d851375-4096-403d-8978-999e472503b5 req-662a0061-3b75-4f43-970d-519bfd63efdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43d7a680-1dee-4f14-9b35-9c53b0968de1", "name": "network-vif-plugged", "status": "completed", "tag": "a351cebc-8256-4d8b-9d06-02d5ea8332d9"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:12:50.249909 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=8 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:12:50.255475 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-3d851375-4096-403d-8978-999e472503b5 req-662a0061-3b75-4f43-970d-519bfd63efdd service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:50.255954 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-3d851375-4096-403d-8978-999e472503b5 req-662a0061-3b75-4f43-970d-519bfd63efdd service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:50.256384 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-3d851375-4096-403d-8978-999e472503b5 req-662a0061-3b75-4f43-970d-519bfd63efdd service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:50.268093 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-3d851375-4096-403d-8978-999e472503b5 req-662a0061-3b75-4f43-970d-519bfd63efdd service nova] Creating event network-vif-plugged:a351cebc-8256-4d8b-9d06-02d5ea8332d9 for instance 43d7a680-1dee-4f14-9b35-9c53b0968de1 on n-h1-853682-5 Oct 18 16:12:50.274466 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-3d851375-4096-403d-8978-999e472503b5 req-662a0061-3b75-4f43-970d-519bfd63efdd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034684 Oct 18 16:12:50.275360 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3184/6348] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:12:50.543195 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5e4df145-a8df-48f7-a751-b649400b9ba5 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:50.543820 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5e4df145-a8df-48f7-a751-b649400b9ba5 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 43d7a680-1dee-4f14-9b35-9c53b0968de1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:50.554371 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e4df145-a8df-48f7-a751-b649400b9ba5 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:50.554864 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e4df145-a8df-48f7-a751-b649400b9ba5 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:50.555306 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e4df145-a8df-48f7-a751-b649400b9ba5 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:50.556011 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e4df145-a8df-48f7-a751-b649400b9ba5 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:50.556468 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e4df145-a8df-48f7-a751-b649400b9ba5 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:50.556931 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e4df145-a8df-48f7-a751-b649400b9ba5 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:50.694315 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5e4df145-a8df-48f7-a751-b649400b9ba5 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:50.702250 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5e4df145-a8df-48f7-a751-b649400b9ba5 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1" status: 200 len: 1390 microversion: 2.1 time: 0.163975 Oct 18 16:12:50.703152 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3165/6349] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:50 2022] GET /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1 => generated 1390 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:51.726648 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-61b43cf5-eab4-4d6e-abc7-02cf16c5873f tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:51.727349 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-61b43cf5-eab4-4d6e-abc7-02cf16c5873f tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 43d7a680-1dee-4f14-9b35-9c53b0968de1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:51.734134 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-61b43cf5-eab4-4d6e-abc7-02cf16c5873f tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:51.734704 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-61b43cf5-eab4-4d6e-abc7-02cf16c5873f tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:51.735142 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-61b43cf5-eab4-4d6e-abc7-02cf16c5873f tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:51.735839 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-61b43cf5-eab4-4d6e-abc7-02cf16c5873f tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:51.736304 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-61b43cf5-eab4-4d6e-abc7-02cf16c5873f tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:51.736708 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-61b43cf5-eab4-4d6e-abc7-02cf16c5873f tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:51.885191 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-61b43cf5-eab4-4d6e-abc7-02cf16c5873f tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:51.894741 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-61b43cf5-eab4-4d6e-abc7-02cf16c5873f tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1" status: 200 len: 1390 microversion: 2.1 time: 0.173734 Oct 18 16:12:51.895323 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3185/6350] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:51 2022] GET /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1 => generated 1390 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:52.917704 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c70b86bc-9dd3-4ff4-8129-0a4e1721d796 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:52.918323 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c70b86bc-9dd3-4ff4-8129-0a4e1721d796 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 43d7a680-1dee-4f14-9b35-9c53b0968de1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:52.925175 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c70b86bc-9dd3-4ff4-8129-0a4e1721d796 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:52.925660 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c70b86bc-9dd3-4ff4-8129-0a4e1721d796 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:52.926100 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c70b86bc-9dd3-4ff4-8129-0a4e1721d796 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:52.926795 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c70b86bc-9dd3-4ff4-8129-0a4e1721d796 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:52.928044 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c70b86bc-9dd3-4ff4-8129-0a4e1721d796 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:52.928469 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c70b86bc-9dd3-4ff4-8129-0a4e1721d796 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:53.063618 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c70b86bc-9dd3-4ff4-8129-0a4e1721d796 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:53.072111 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c70b86bc-9dd3-4ff4-8129-0a4e1721d796 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1" status: 200 len: 1563 microversion: 2.1 time: 0.158296 Oct 18 16:12:53.072705 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3166/6351] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:52 2022] GET /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1 => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:53.094323 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d7275ede-abaf-4ceb-9d24-b788bd1664c9 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:53.094945 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d7275ede-abaf-4ceb-9d24-b788bd1664c9 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 43d7a680-1dee-4f14-9b35-9c53b0968de1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:53.101885 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d7275ede-abaf-4ceb-9d24-b788bd1664c9 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:53.102371 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d7275ede-abaf-4ceb-9d24-b788bd1664c9 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:53.102812 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d7275ede-abaf-4ceb-9d24-b788bd1664c9 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:53.103510 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d7275ede-abaf-4ceb-9d24-b788bd1664c9 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:53.103972 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d7275ede-abaf-4ceb-9d24-b788bd1664c9 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:53.104405 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d7275ede-abaf-4ceb-9d24-b788bd1664c9 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:53.234938 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d7275ede-abaf-4ceb-9d24-b788bd1664c9 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:53.243339 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d7275ede-abaf-4ceb-9d24-b788bd1664c9 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1" status: 200 len: 1563 microversion: 2.1 time: 0.153039 Oct 18 16:12:53.243922 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3186/6352] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:53 2022] GET /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1 => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:12:54.866643 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d8d7bd56-8650-42e2-96d1-b943f5d24a08 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:12:54.867259 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d8d7bd56-8650-42e2-96d1-b943f5d24a08 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 43d7a680-1dee-4f14-9b35-9c53b0968de1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:12:54.870001 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:12:54.882300 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8d7bd56-8650-42e2-96d1-b943f5d24a08 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:54.882820 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8d7bd56-8650-42e2-96d1-b943f5d24a08 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:54.883291 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8d7bd56-8650-42e2-96d1-b943f5d24a08 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:54.884031 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8d7bd56-8650-42e2-96d1-b943f5d24a08 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:54.884547 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8d7bd56-8650-42e2-96d1-b943f5d24a08 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:54.884952 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8d7bd56-8650-42e2-96d1-b943f5d24a08 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:54.952166 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-8e6d4d0a-e30e-4e78-938b-62afb6e5c838 req-4c9507fe-838f-425d-b83d-aa58e3c3b4f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43d7a680-1dee-4f14-9b35-9c53b0968de1", "tag": "a351cebc-8256-4d8b-9d06-02d5ea8332d9"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:12:54.957145 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:12:54.965534 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-8e6d4d0a-e30e-4e78-938b-62afb6e5c838 req-4c9507fe-838f-425d-b83d-aa58e3c3b4f4 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:12:54.966010 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-8e6d4d0a-e30e-4e78-938b-62afb6e5c838 req-4c9507fe-838f-425d-b83d-aa58e3c3b4f4 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:12:54.966618 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-8e6d4d0a-e30e-4e78-938b-62afb6e5c838 req-4c9507fe-838f-425d-b83d-aa58e3c3b4f4 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:12:54.982051 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-8e6d4d0a-e30e-4e78-938b-62afb6e5c838 req-4c9507fe-838f-425d-b83d-aa58e3c3b4f4 service nova] Creating event network-changed:a351cebc-8256-4d8b-9d06-02d5ea8332d9 for instance 43d7a680-1dee-4f14-9b35-9c53b0968de1 on n-h1-853682-5 Oct 18 16:12:54.987700 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-8e6d4d0a-e30e-4e78-938b-62afb6e5c838 req-4c9507fe-838f-425d-b83d-aa58e3c3b4f4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115005 Oct 18 16:12:54.989218 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3187/6353] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:12:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:12:55.047195 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d8d7bd56-8650-42e2-96d1-b943f5d24a08 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:12:55.057108 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d8d7bd56-8650-42e2-96d1-b943f5d24a08 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1" status: 200 len: 1563 microversion: 2.1 time: 0.194393 Oct 18 16:12:55.057837 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3167/6354] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:12:54 2022] GET /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1 => generated 1563 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:26.347306 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=40 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:13:26.347976 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:13:26.352528 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-21b81b06-5f58-4532-a210-31d5583d48e0 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:13:26.355543 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-21b81b06-5f58-4532-a210-31d5583d48e0 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 43d7a680-1dee-4f14-9b35-9c53b0968de1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:26.362702 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-21b81b06-5f58-4532-a210-31d5583d48e0 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:26.363182 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-21b81b06-5f58-4532-a210-31d5583d48e0 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:26.363617 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-21b81b06-5f58-4532-a210-31d5583d48e0 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:26.364311 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-21b81b06-5f58-4532-a210-31d5583d48e0 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:26.364767 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-21b81b06-5f58-4532-a210-31d5583d48e0 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:26.365222 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-21b81b06-5f58-4532-a210-31d5583d48e0 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:26.433213 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-21b81b06-5f58-4532-a210-31d5583d48e0 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "POST /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1/action" status: 200 len: 24565 microversion: 2.1 time: 0.088128 Oct 18 16:13:26.433856 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3188/6355] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:13:26 2022] POST /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1/action => generated 24565 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:13:56.835405 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:13:56.836241 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=46 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:13:56.840496 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ea3e5654-e76b-4f63-b7ab-3003955c7a88 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:56.841138 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ea3e5654-e76b-4f63-b7ab-3003955c7a88 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 43d7a680-1dee-4f14-9b35-9c53b0968de1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:56.848307 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea3e5654-e76b-4f63-b7ab-3003955c7a88 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:56.848784 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea3e5654-e76b-4f63-b7ab-3003955c7a88 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:56.849241 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea3e5654-e76b-4f63-b7ab-3003955c7a88 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:56.849925 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea3e5654-e76b-4f63-b7ab-3003955c7a88 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:56.850379 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea3e5654-e76b-4f63-b7ab-3003955c7a88 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:56.850803 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea3e5654-e76b-4f63-b7ab-3003955c7a88 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:56.981969 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ea3e5654-e76b-4f63-b7ab-3003955c7a88 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:13:56.990211 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ea3e5654-e76b-4f63-b7ab-3003955c7a88 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1" status: 200 len: 1682 microversion: 2.1 time: 0.156739 Oct 18 16:13:56.990785 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3168/6356] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:56 2022] GET /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:57.090531 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c82ea923-7237-4f07-b8e1-83c2bd91d3f4 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:13:57.092914 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c82ea923-7237-4f07-b8e1-83c2bd91d3f4 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 43d7a680-1dee-4f14-9b35-9c53b0968de1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:57.096226 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:13:57.096926 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=4 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:13:57.105374 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c82ea923-7237-4f07-b8e1-83c2bd91d3f4 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:57.105872 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c82ea923-7237-4f07-b8e1-83c2bd91d3f4 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:57.106349 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c82ea923-7237-4f07-b8e1-83c2bd91d3f4 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:57.107060 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c82ea923-7237-4f07-b8e1-83c2bd91d3f4 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:57.107524 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c82ea923-7237-4f07-b8e1-83c2bd91d3f4 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:57.107957 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c82ea923-7237-4f07-b8e1-83c2bd91d3f4 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:57.179533 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c82ea923-7237-4f07-b8e1-83c2bd91d3f4 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "POST /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1/action" status: 200 len: 32637 microversion: 2.1 time: 0.093184 Oct 18 16:13:57.180196 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3189/6357] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:13:57 2022] POST /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1/action => generated 32637 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:13:57.416705 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b2c0a133-8a65-4b7a-b0c6-b3d67cb423bf tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:13:57.417353 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b2c0a133-8a65-4b7a-b0c6-b3d67cb423bf tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] [instance: 43d7a680-1dee-4f14-9b35-9c53b0968de1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:57.423348 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2c0a133-8a65-4b7a-b0c6-b3d67cb423bf tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:57.423830 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2c0a133-8a65-4b7a-b0c6-b3d67cb423bf tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:57.424264 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2c0a133-8a65-4b7a-b0c6-b3d67cb423bf tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:57.424987 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2c0a133-8a65-4b7a-b0c6-b3d67cb423bf tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:57.425439 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2c0a133-8a65-4b7a-b0c6-b3d67cb423bf tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:57.425861 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2c0a133-8a65-4b7a-b0c6-b3d67cb423bf tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:57.555971 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b2c0a133-8a65-4b7a-b0c6-b3d67cb423bf tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1" status: 200 len: 1833 microversion: 2.1 time: 0.143067 Oct 18 16:13:57.556547 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3169/6358] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:13:57 2022] GET /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1 => generated 1833 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:13:57.586983 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-59430ff9-ee25-46fb-9462-ad6474bd25ca tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:13:57.589502 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-59430ff9-ee25-46fb-9462-ad6474bd25ca tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] [instance: 43d7a680-1dee-4f14-9b35-9c53b0968de1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:13:57.596439 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-59430ff9-ee25-46fb-9462-ad6474bd25ca tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:57.596948 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-59430ff9-ee25-46fb-9462-ad6474bd25ca tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:57.597382 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-59430ff9-ee25-46fb-9462-ad6474bd25ca tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:57.598064 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-59430ff9-ee25-46fb-9462-ad6474bd25ca tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:13:57.598512 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-59430ff9-ee25-46fb-9462-ad6474bd25ca tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:13:57.598927 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-59430ff9-ee25-46fb-9462-ad6474bd25ca tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:13:57.624645 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-59430ff9-ee25-46fb-9462-ad6474bd25ca tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Lazy-loading 'flavor' on Instance uuid 43d7a680-1dee-4f14-9b35-9c53b0968de1 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:13:57.637214 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-59430ff9-ee25-46fb-9462-ad6474bd25ca tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] [instance: 43d7a680-1dee-4f14-9b35-9c53b0968de1] Going to try to live migrate instance to another host {{(pid=120405) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 18 16:14:01.242970 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-59430ff9-ee25-46fb-9462-ad6474bd25ca tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1/action" status: 202 len: 0 microversion: 2.1 time: 3.660031 Oct 18 16:14:01.245865 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3190/6359] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:13:57 2022] POST /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1/action => generated 0 bytes in 3664 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:14:01.255035 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-045e42a2-74a7-478c-be21-518eaf2d6bfc tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:01.255659 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-045e42a2-74a7-478c-be21-518eaf2d6bfc tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 43d7a680-1dee-4f14-9b35-9c53b0968de1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:01.263326 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-045e42a2-74a7-478c-be21-518eaf2d6bfc tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:01.263974 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-045e42a2-74a7-478c-be21-518eaf2d6bfc tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:01.264483 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-045e42a2-74a7-478c-be21-518eaf2d6bfc tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:01.265558 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-045e42a2-74a7-478c-be21-518eaf2d6bfc tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:01.266090 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-045e42a2-74a7-478c-be21-518eaf2d6bfc tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:01.266563 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-045e42a2-74a7-478c-be21-518eaf2d6bfc tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:01.412458 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-045e42a2-74a7-478c-be21-518eaf2d6bfc tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:01.422171 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-045e42a2-74a7-478c-be21-518eaf2d6bfc tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1" status: 200 len: 1692 microversion: 2.1 time: 0.173216 Oct 18 16:14:01.422795 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3170/6360] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:01 2022] GET /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1 => generated 1692 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:14:02.284845 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-a6fcc904-d905-4626-9b17-da953d81cf54 req-58af23ff-add2-4bee-a3f5-54021fd9b620 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43d7a680-1dee-4f14-9b35-9c53b0968de1", "name": "network-vif-unplugged", "status": "completed", "tag": "a351cebc-8256-4d8b-9d06-02d5ea8332d9"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:14:02.296916 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-a6fcc904-d905-4626-9b17-da953d81cf54 req-58af23ff-add2-4bee-a3f5-54021fd9b620 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:02.297436 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-a6fcc904-d905-4626-9b17-da953d81cf54 req-58af23ff-add2-4bee-a3f5-54021fd9b620 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:02.299168 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-a6fcc904-d905-4626-9b17-da953d81cf54 req-58af23ff-add2-4bee-a3f5-54021fd9b620 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:02.311326 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-a6fcc904-d905-4626-9b17-da953d81cf54 req-58af23ff-add2-4bee-a3f5-54021fd9b620 service nova] Creating event network-vif-unplugged:a351cebc-8256-4d8b-9d06-02d5ea8332d9 for instance 43d7a680-1dee-4f14-9b35-9c53b0968de1 on n-h1-853682-5 Oct 18 16:14:02.318224 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-a6fcc904-d905-4626-9b17-da953d81cf54 req-58af23ff-add2-4bee-a3f5-54021fd9b620 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037480 Oct 18 16:14:02.318846 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3191/6361] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:14:02.447024 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-94096a48-4e52-4d5a-8ed8-fba3ae89d265 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:02.447736 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-94096a48-4e52-4d5a-8ed8-fba3ae89d265 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 43d7a680-1dee-4f14-9b35-9c53b0968de1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:02.454731 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94096a48-4e52-4d5a-8ed8-fba3ae89d265 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:02.455220 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94096a48-4e52-4d5a-8ed8-fba3ae89d265 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:02.455663 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94096a48-4e52-4d5a-8ed8-fba3ae89d265 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:02.456395 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94096a48-4e52-4d5a-8ed8-fba3ae89d265 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:02.456882 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94096a48-4e52-4d5a-8ed8-fba3ae89d265 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:02.457315 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94096a48-4e52-4d5a-8ed8-fba3ae89d265 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:02.593787 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-94096a48-4e52-4d5a-8ed8-fba3ae89d265 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:02.602073 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-94096a48-4e52-4d5a-8ed8-fba3ae89d265 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1" status: 200 len: 1692 microversion: 2.1 time: 0.159025 Oct 18 16:14:02.602677 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3171/6362] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:02 2022] GET /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1 => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:03.627114 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ae9b5172-6fb9-41d8-9af3-fef8f076c345 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:03.627809 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ae9b5172-6fb9-41d8-9af3-fef8f076c345 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 43d7a680-1dee-4f14-9b35-9c53b0968de1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:03.633980 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae9b5172-6fb9-41d8-9af3-fef8f076c345 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:03.634463 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae9b5172-6fb9-41d8-9af3-fef8f076c345 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:03.634895 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae9b5172-6fb9-41d8-9af3-fef8f076c345 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:03.635590 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae9b5172-6fb9-41d8-9af3-fef8f076c345 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:03.636050 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae9b5172-6fb9-41d8-9af3-fef8f076c345 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:03.636474 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae9b5172-6fb9-41d8-9af3-fef8f076c345 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:03.768106 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ae9b5172-6fb9-41d8-9af3-fef8f076c345 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:03.775926 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ae9b5172-6fb9-41d8-9af3-fef8f076c345 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1" status: 200 len: 1692 microversion: 2.1 time: 0.153912 Oct 18 16:14:03.776503 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3192/6363] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:03 2022] GET /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1 => generated 1692 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:04.356718 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-519cfe22-b22f-4cea-b25a-f34d9112712e req-1230e601-7d39-4e0a-af11-6d8bede22e8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43d7a680-1dee-4f14-9b35-9c53b0968de1", "tag": "a351cebc-8256-4d8b-9d06-02d5ea8332d9"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:14:04.368645 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-519cfe22-b22f-4cea-b25a-f34d9112712e req-1230e601-7d39-4e0a-af11-6d8bede22e8c service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:04.369151 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-519cfe22-b22f-4cea-b25a-f34d9112712e req-1230e601-7d39-4e0a-af11-6d8bede22e8c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:04.369584 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-519cfe22-b22f-4cea-b25a-f34d9112712e req-1230e601-7d39-4e0a-af11-6d8bede22e8c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:04.380964 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-519cfe22-b22f-4cea-b25a-f34d9112712e req-1230e601-7d39-4e0a-af11-6d8bede22e8c service nova] Creating event network-changed:a351cebc-8256-4d8b-9d06-02d5ea8332d9 for instance 43d7a680-1dee-4f14-9b35-9c53b0968de1 on n-h1-853682-5 Oct 18 16:14:04.385896 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-519cfe22-b22f-4cea-b25a-f34d9112712e req-1230e601-7d39-4e0a-af11-6d8bede22e8c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032934 Oct 18 16:14:04.386486 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3172/6364] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:14:04.801517 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2b852418-13c1-493c-a332-e6911d9c5fd8 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:04.802139 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2b852418-13c1-493c-a332-e6911d9c5fd8 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 43d7a680-1dee-4f14-9b35-9c53b0968de1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:04.809374 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2b852418-13c1-493c-a332-e6911d9c5fd8 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:04.809862 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2b852418-13c1-493c-a332-e6911d9c5fd8 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:04.810300 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2b852418-13c1-493c-a332-e6911d9c5fd8 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:04.811003 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2b852418-13c1-493c-a332-e6911d9c5fd8 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:04.811458 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2b852418-13c1-493c-a332-e6911d9c5fd8 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:04.811886 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2b852418-13c1-493c-a332-e6911d9c5fd8 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:05.016929 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2b852418-13c1-493c-a332-e6911d9c5fd8 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:05.024923 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2b852418-13c1-493c-a332-e6911d9c5fd8 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1" status: 200 len: 1692 microversion: 2.1 time: 0.227919 Oct 18 16:14:05.025510 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3193/6365] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:04 2022] GET /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1 => generated 1692 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:06.051367 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7697ed05-4065-44c6-9d6c-efccdedbec60 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:06.052326 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7697ed05-4065-44c6-9d6c-efccdedbec60 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 43d7a680-1dee-4f14-9b35-9c53b0968de1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:06.058865 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7697ed05-4065-44c6-9d6c-efccdedbec60 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:06.059352 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7697ed05-4065-44c6-9d6c-efccdedbec60 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:06.059795 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7697ed05-4065-44c6-9d6c-efccdedbec60 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:06.060502 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7697ed05-4065-44c6-9d6c-efccdedbec60 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:06.061005 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7697ed05-4065-44c6-9d6c-efccdedbec60 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:06.061436 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7697ed05-4065-44c6-9d6c-efccdedbec60 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:06.198122 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7697ed05-4065-44c6-9d6c-efccdedbec60 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:06.205831 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7697ed05-4065-44c6-9d6c-efccdedbec60 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1" status: 200 len: 1692 microversion: 2.1 time: 0.160285 Oct 18 16:14:06.206405 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3173/6366] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:06 2022] GET /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1 => generated 1692 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:07.229219 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-69e460f5-72ff-4a6f-9509-13e408f36909 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:07.229869 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-69e460f5-72ff-4a6f-9509-13e408f36909 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 43d7a680-1dee-4f14-9b35-9c53b0968de1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:07.236966 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-69e460f5-72ff-4a6f-9509-13e408f36909 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:07.237459 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-69e460f5-72ff-4a6f-9509-13e408f36909 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:07.237902 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-69e460f5-72ff-4a6f-9509-13e408f36909 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:07.238605 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-69e460f5-72ff-4a6f-9509-13e408f36909 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:07.239067 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-69e460f5-72ff-4a6f-9509-13e408f36909 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:07.239501 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-69e460f5-72ff-4a6f-9509-13e408f36909 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:07.372516 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-69e460f5-72ff-4a6f-9509-13e408f36909 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:07.380817 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-69e460f5-72ff-4a6f-9509-13e408f36909 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1" status: 200 len: 1692 microversion: 2.1 time: 0.155600 Oct 18 16:14:07.381405 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3194/6367] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:07 2022] GET /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1 => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:08.405213 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-30b8c4f2-0d4e-4afa-92ea-4ae50e7d3aff tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:08.406380 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-30b8c4f2-0d4e-4afa-92ea-4ae50e7d3aff tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 43d7a680-1dee-4f14-9b35-9c53b0968de1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:08.414045 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30b8c4f2-0d4e-4afa-92ea-4ae50e7d3aff tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:08.414534 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30b8c4f2-0d4e-4afa-92ea-4ae50e7d3aff tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:08.414974 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30b8c4f2-0d4e-4afa-92ea-4ae50e7d3aff tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:08.415678 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30b8c4f2-0d4e-4afa-92ea-4ae50e7d3aff tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:08.416138 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30b8c4f2-0d4e-4afa-92ea-4ae50e7d3aff tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:08.416563 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30b8c4f2-0d4e-4afa-92ea-4ae50e7d3aff tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:08.670904 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-30b8c4f2-0d4e-4afa-92ea-4ae50e7d3aff tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:08.679004 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-30b8c4f2-0d4e-4afa-92ea-4ae50e7d3aff tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1" status: 200 len: 1692 microversion: 2.1 time: 0.277688 Oct 18 16:14:08.684699 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3174/6368] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:08 2022] GET /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1 => generated 1692 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:09.707566 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a89e5cc8-ce6e-4e85-bef1-5a5cccbfd9ea tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:09.708205 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a89e5cc8-ce6e-4e85-bef1-5a5cccbfd9ea tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 43d7a680-1dee-4f14-9b35-9c53b0968de1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:09.715359 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a89e5cc8-ce6e-4e85-bef1-5a5cccbfd9ea tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:09.716098 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a89e5cc8-ce6e-4e85-bef1-5a5cccbfd9ea tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:09.716546 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a89e5cc8-ce6e-4e85-bef1-5a5cccbfd9ea tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:09.717292 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a89e5cc8-ce6e-4e85-bef1-5a5cccbfd9ea tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:09.717763 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a89e5cc8-ce6e-4e85-bef1-5a5cccbfd9ea tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:09.718195 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a89e5cc8-ce6e-4e85-bef1-5a5cccbfd9ea tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:09.865881 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a89e5cc8-ce6e-4e85-bef1-5a5cccbfd9ea tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:09.873760 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a89e5cc8-ce6e-4e85-bef1-5a5cccbfd9ea tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1" status: 200 len: 1682 microversion: 2.1 time: 0.170088 Oct 18 16:14:09.874355 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3195/6369] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:09 2022] GET /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1 => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:09.897568 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-49ba5c48-6893-45a2-9935-5ec155228daf tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:09.898183 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-49ba5c48-6893-45a2-9935-5ec155228daf tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] [instance: 43d7a680-1dee-4f14-9b35-9c53b0968de1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:09.905020 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49ba5c48-6893-45a2-9935-5ec155228daf tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:09.905508 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49ba5c48-6893-45a2-9935-5ec155228daf tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:09.905945 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49ba5c48-6893-45a2-9935-5ec155228daf tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:09.906631 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49ba5c48-6893-45a2-9935-5ec155228daf tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:09.907656 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49ba5c48-6893-45a2-9935-5ec155228daf tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:09.908078 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49ba5c48-6893-45a2-9935-5ec155228daf tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:10.035382 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-49ba5c48-6893-45a2-9935-5ec155228daf tempest-TestNetworkAdvancedServerOps-1645761869 tempest-TestNetworkAdvancedServerOps-1645761869-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1" status: 200 len: 1833 microversion: 2.1 time: 0.141518 Oct 18 16:14:10.035956 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3175/6370] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:09 2022] GET /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1 => generated 1833 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:10.059212 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e3cb326a-9e27-4bfa-bf75-9b4f29e07cf6 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:10.059831 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e3cb326a-9e27-4bfa-bf75-9b4f29e07cf6 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 43d7a680-1dee-4f14-9b35-9c53b0968de1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:10.067201 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e3cb326a-9e27-4bfa-bf75-9b4f29e07cf6 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:10.067808 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e3cb326a-9e27-4bfa-bf75-9b4f29e07cf6 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:10.068254 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e3cb326a-9e27-4bfa-bf75-9b4f29e07cf6 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:10.068982 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e3cb326a-9e27-4bfa-bf75-9b4f29e07cf6 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:10.069556 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e3cb326a-9e27-4bfa-bf75-9b4f29e07cf6 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:10.069984 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e3cb326a-9e27-4bfa-bf75-9b4f29e07cf6 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:10.212044 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e3cb326a-9e27-4bfa-bf75-9b4f29e07cf6 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:10.219973 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e3cb326a-9e27-4bfa-bf75-9b4f29e07cf6 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1" status: 200 len: 1682 microversion: 2.1 time: 0.164674 Oct 18 16:14:10.220557 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3196/6371] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:10 2022] GET /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:10.319840 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5c7a2b26-18de-4583-ba54-99cc512c9012 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:14:10.322056 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5c7a2b26-18de-4583-ba54-99cc512c9012 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 43d7a680-1dee-4f14-9b35-9c53b0968de1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:10.328086 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c7a2b26-18de-4583-ba54-99cc512c9012 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:10.328568 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c7a2b26-18de-4583-ba54-99cc512c9012 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:10.329683 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c7a2b26-18de-4583-ba54-99cc512c9012 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:10.330379 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c7a2b26-18de-4583-ba54-99cc512c9012 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:10.330840 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c7a2b26-18de-4583-ba54-99cc512c9012 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:10.331266 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c7a2b26-18de-4583-ba54-99cc512c9012 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:10.381798 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5c7a2b26-18de-4583-ba54-99cc512c9012 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "POST /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1/action" status: 200 len: 38640 microversion: 2.1 time: 0.065737 Oct 18 16:14:10.382575 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3176/6372] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:14:10 2022] POST /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1/action => generated 38640 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:14:11.364548 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7b2bd38f-d0bf-4cb0-902f-b49c540aff0a tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:11.370477 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-9808b84f-1f2b-48cf-8c3b-19962b19e293 req-b5f10083-a7b7-4bfc-83d6-2a94cb81d471 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43d7a680-1dee-4f14-9b35-9c53b0968de1", "tag": "a351cebc-8256-4d8b-9d06-02d5ea8332d9"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:14:11.371016 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7b2bd38f-d0bf-4cb0-902f-b49c540aff0a tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 43d7a680-1dee-4f14-9b35-9c53b0968de1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:11.381742 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9808b84f-1f2b-48cf-8c3b-19962b19e293 req-b5f10083-a7b7-4bfc-83d6-2a94cb81d471 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:11.382216 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9808b84f-1f2b-48cf-8c3b-19962b19e293 req-b5f10083-a7b7-4bfc-83d6-2a94cb81d471 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:11.382657 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9808b84f-1f2b-48cf-8c3b-19962b19e293 req-b5f10083-a7b7-4bfc-83d6-2a94cb81d471 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:11.384595 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7b2bd38f-d0bf-4cb0-902f-b49c540aff0a tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:11.385185 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7b2bd38f-d0bf-4cb0-902f-b49c540aff0a tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:11.385701 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7b2bd38f-d0bf-4cb0-902f-b49c540aff0a tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:11.386483 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7b2bd38f-d0bf-4cb0-902f-b49c540aff0a tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:11.387160 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7b2bd38f-d0bf-4cb0-902f-b49c540aff0a tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:11.387836 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7b2bd38f-d0bf-4cb0-902f-b49c540aff0a tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:11.394926 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-9808b84f-1f2b-48cf-8c3b-19962b19e293 req-b5f10083-a7b7-4bfc-83d6-2a94cb81d471 service nova] Creating event network-changed:a351cebc-8256-4d8b-9d06-02d5ea8332d9 for instance 43d7a680-1dee-4f14-9b35-9c53b0968de1 on n-h2-853682-5 Oct 18 16:14:11.400044 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-9808b84f-1f2b-48cf-8c3b-19962b19e293 req-b5f10083-a7b7-4bfc-83d6-2a94cb81d471 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033493 Oct 18 16:14:11.400653 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3177/6373] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:14:11.418914 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7b2bd38f-d0bf-4cb0-902f-b49c540aff0a tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 43d7a680-1dee-4f14-9b35-9c53b0968de1] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:14:11.512591 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7b2bd38f-d0bf-4cb0-902f-b49c540aff0a tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "DELETE /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1" status: 204 len: 0 microversion: 2.1 time: 0.151514 Oct 18 16:14:11.517474 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3197/6374] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 16:14:11 2022] DELETE /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:14:11.523673 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f840b346-ebb8-4db2-a11a-703a0ffe3944 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:11.524377 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f840b346-ebb8-4db2-a11a-703a0ffe3944 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 43d7a680-1dee-4f14-9b35-9c53b0968de1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:11.533492 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f840b346-ebb8-4db2-a11a-703a0ffe3944 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:11.534111 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f840b346-ebb8-4db2-a11a-703a0ffe3944 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:11.535137 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f840b346-ebb8-4db2-a11a-703a0ffe3944 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:11.535958 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f840b346-ebb8-4db2-a11a-703a0ffe3944 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:11.537058 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f840b346-ebb8-4db2-a11a-703a0ffe3944 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:11.537571 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f840b346-ebb8-4db2-a11a-703a0ffe3944 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:11.954456 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f840b346-ebb8-4db2-a11a-703a0ffe3944 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:11.963708 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f840b346-ebb8-4db2-a11a-703a0ffe3944 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1" status: 200 len: 1688 microversion: 2.1 time: 0.444726 Oct 18 16:14:11.980680 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3178/6375] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:11 2022] GET /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1 => generated 1688 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:12.989623 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a57a7c5f-d0a7-47a8-8ad4-5da68eed4d40 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:12.990249 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a57a7c5f-d0a7-47a8-8ad4-5da68eed4d40 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: 43d7a680-1dee-4f14-9b35-9c53b0968de1] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:12.997104 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a57a7c5f-d0a7-47a8-8ad4-5da68eed4d40 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:12.997590 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a57a7c5f-d0a7-47a8-8ad4-5da68eed4d40 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:12.998031 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a57a7c5f-d0a7-47a8-8ad4-5da68eed4d40 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:12.998726 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a57a7c5f-d0a7-47a8-8ad4-5da68eed4d40 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:12.999185 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a57a7c5f-d0a7-47a8-8ad4-5da68eed4d40 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:12.999616 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a57a7c5f-d0a7-47a8-8ad4-5da68eed4d40 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:13.013782 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-a57a7c5f-d0a7-47a8-8ad4-5da68eed4d40 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] HTTP exception thrown: Instance 43d7a680-1dee-4f14-9b35-9c53b0968de1 could not be found. Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a57a7c5f-d0a7-47a8-8ad4-5da68eed4d40 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Request method failure captured: Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1 HTTP/1.1 Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTs8upjSfiwu14tRxn4v0SgmAedKIqRyez8Aw8SOZdWUfAF0oMQr1R7xRzarToYQHo42vdtsSxTu7-2HkwGui-JshrtyxJTkQsS83jVEOu3jeAOKtt4DIMDKQgSeb11ABNJcyR5RNHKJLx2pVrTjzxDpmJ_EBIOFJJALPV4oSx6sXUQQ Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: a7b4ef10957e43b8a57a419fa0d6de0e Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-581510455 Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a7b4ef10957e43b8a57a419fa0d6de0e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a7b4ef10957e43b8a57a419fa0d6de0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a7b4ef10957e43b8a57a419fa0d6de0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a7b4ef10957e43b8a57a419fa0d6de0e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-TestNetworkAdvancedServerOps-581510455 Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: a7b4ef10957e43b8a57a419fa0d6de0e Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-581510455 Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-TestNetworkAdvancedServerOps-581510455-project Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 153a83de00ae4445a1efd17d70990630 Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-TestNetworkAdvancedServerOps-581510455-project Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 43d7a680-1dee-4f14-9b35-9c53b0968de1 could not be found. Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '43d7a680-1dee-4f14-9b35-9c53b0968de1'} Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43d7a680-1dee-4f14-9b35-9c53b0968de1 could not be found. Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43d7a680-1dee-4f14-9b35-9c53b0968de1 could not be found. Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:14:13.015408 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:14:13.019623 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:14:13.019623 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:14:13.019623 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:14:13.019623 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:14:13.019623 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:14:13.019623 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:14:13.019623 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43d7a680-1dee-4f14-9b35-9c53b0968de1 could not be found. Oct 18 16:14:13.019623 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:14:13.019623 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a57a7c5f-d0a7-47a8-8ad4-5da68eed4d40 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Returning 404 to user: Instance 43d7a680-1dee-4f14-9b35-9c53b0968de1 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:14:13.019623 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a57a7c5f-d0a7-47a8-8ad4-5da68eed4d40 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1" status: 404 len: 111 microversion: 2.1 time: 0.032321 Oct 18 16:14:13.019623 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3198/6376] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:12 2022] GET /compute/v2.1/servers/43d7a680-1dee-4f14-9b35-9c53b0968de1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:14:13.414801 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-23cf1885-08bc-4ab5-abda-8a0144337454 req-5c18bb9b-b851-4e05-a0b8-56aca59ef7d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43d7a680-1dee-4f14-9b35-9c53b0968de1", "name": "network-vif-deleted", "tag": "a351cebc-8256-4d8b-9d06-02d5ea8332d9"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:14:13.425663 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-23cf1885-08bc-4ab5-abda-8a0144337454 req-5c18bb9b-b851-4e05-a0b8-56aca59ef7d5 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:13.426142 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-23cf1885-08bc-4ab5-abda-8a0144337454 req-5c18bb9b-b851-4e05-a0b8-56aca59ef7d5 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:13.426609 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-23cf1885-08bc-4ab5-abda-8a0144337454 req-5c18bb9b-b851-4e05-a0b8-56aca59ef7d5 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:13.437841 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-23cf1885-08bc-4ab5-abda-8a0144337454 req-5c18bb9b-b851-4e05-a0b8-56aca59ef7d5 service nova] Creating event network-vif-deleted:a351cebc-8256-4d8b-9d06-02d5ea8332d9 for instance 43d7a680-1dee-4f14-9b35-9c53b0968de1 on n-h2-853682-5 Oct 18 16:14:13.442851 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-23cf1885-08bc-4ab5-abda-8a0144337454 req-5c18bb9b-b851-4e05-a0b8-56aca59ef7d5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031811 Oct 18 16:14:13.443450 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3179/6377] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:14:16.422574 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-69ea9157-b21e-4c00-9739-cccd6bf06f5b tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '.version_select at 0x7f7c3c8683a0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:16.451623 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-69ea9157-b21e-4c00-9739-cccd6bf06f5b tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-725008417" status: 202 len: 0 microversion: 2.1 time: 0.033636 Oct 18 16:14:16.452635 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3199/6378] 10.222.0.60 () {58 vars in 1281 bytes} [Tue Oct 18 16:14:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-725008417 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:14:16.482085 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ab76874b-ce61-48b7-91b1-0d9737ea0340 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Action: 'create', calling method: .version_select at 0x7f7c37a82280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1950808725", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKxUj0lJ/a4kvGFSJiG0v2IJvvoPEpvIcqJuQwWorzAbDTw1RnxNjxcXS8BHtKWT5RYObSOoGe7+sG+FA4aOgGP43yiI4Lrn0Gm4jocqplicy3vu9PTsBRwg9oi620ppeQ=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:14:16.497686 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-ab76874b-ce61-48b7-91b1-0d9737ea0340 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Getting quotas for project a7b4ef10957e43b8a57a419fa0d6de0e. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:14:16.503937 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-ab76874b-ce61-48b7-91b1-0d9737ea0340 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Getting quotas for user 153a83de00ae4445a1efd17d70990630 and project a7b4ef10957e43b8a57a419fa0d6de0e. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:14:16.528224 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ab76874b-ce61-48b7-91b1-0d9737ea0340 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.051316 Oct 18 16:14:16.529046 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3180/6379] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Oct 18 16:14:16 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:14:22.233494 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-73559f95-def2-40f6-a365-0d47600a1959 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1682903933", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "79e91b1c-f70f-47e8-9b41-9e34a2a61181"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1950808725", "security_groups": [{"name": "tempest-secgroup-smoke-1081160952"}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:14:22.349707 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-73559f95-def2-40f6-a365-0d47600a1959 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] validate_networks() for [('79e91b1c-f70f-47e8-9b41-9e34a2a61181', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 16:14:22.885265 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-73559f95-def2-40f6-a365-0d47600a1959 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:14:22.885725 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-73559f95-def2-40f6-a365-0d47600a1959 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:14:22.886178 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-73559f95-def2-40f6-a365-0d47600a1959 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:14:22.886715 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-73559f95-def2-40f6-a365-0d47600a1959 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:14:22.887048 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-73559f95-def2-40f6-a365-0d47600a1959 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:14:22.897119 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-73559f95-def2-40f6-a365-0d47600a1959 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:22.897797 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-73559f95-def2-40f6-a365-0d47600a1959 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:22.898231 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-73559f95-def2-40f6-a365-0d47600a1959 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:22.899453 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-73559f95-def2-40f6-a365-0d47600a1959 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:22.900057 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-73559f95-def2-40f6-a365-0d47600a1959 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:22.900715 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-73559f95-def2-40f6-a365-0d47600a1959 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:22.923492 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-73559f95-def2-40f6-a365-0d47600a1959 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Getting quotas for project a7b4ef10957e43b8a57a419fa0d6de0e. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:14:22.929965 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-73559f95-def2-40f6-a365-0d47600a1959 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Getting quotas for user 153a83de00ae4445a1efd17d70990630 and project a7b4ef10957e43b8a57a419fa0d6de0e. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:14:22.944332 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-73559f95-def2-40f6-a365-0d47600a1959 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:14:22.947148 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-73559f95-def2-40f6-a365-0d47600a1959 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: dd096aa4-077a-4c95-a3cc-b40763f12038] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:14:23.019710 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-73559f95-def2-40f6-a365-0d47600a1959 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.792353 Oct 18 16:14:23.024511 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3200/6380] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 16:14:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:14:23.038089 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-44f86d5f-6754-420b-bc47-6d01832b8978 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:23.038902 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-44f86d5f-6754-420b-bc47-6d01832b8978 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: dd096aa4-077a-4c95-a3cc-b40763f12038] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:23.120839 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-44f86d5f-6754-420b-bc47-6d01832b8978 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:23.128709 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-44f86d5f-6754-420b-bc47-6d01832b8978 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038" status: 200 len: 1267 microversion: 2.1 time: 0.097988 Oct 18 16:14:23.130264 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3181/6381] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:23 2022] GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038 => generated 1267 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:24.153886 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f24a2419-80b8-4002-99d4-952260f95c87 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:24.154496 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f24a2419-80b8-4002-99d4-952260f95c87 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: dd096aa4-077a-4c95-a3cc-b40763f12038] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:24.161618 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f24a2419-80b8-4002-99d4-952260f95c87 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:24.162110 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f24a2419-80b8-4002-99d4-952260f95c87 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:24.162547 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f24a2419-80b8-4002-99d4-952260f95c87 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:24.163252 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f24a2419-80b8-4002-99d4-952260f95c87 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:24.163698 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f24a2419-80b8-4002-99d4-952260f95c87 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:24.164127 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f24a2419-80b8-4002-99d4-952260f95c87 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:24.232759 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f24a2419-80b8-4002-99d4-952260f95c87 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:24.241409 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f24a2419-80b8-4002-99d4-952260f95c87 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038" status: 200 len: 1319 microversion: 2.1 time: 0.092189 Oct 18 16:14:24.242517 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3201/6382] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:24 2022] GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038 => generated 1319 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:25.265723 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-df751503-cee0-4a09-95f5-d79f0e7d20a0 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:25.266461 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-df751503-cee0-4a09-95f5-d79f0e7d20a0 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: dd096aa4-077a-4c95-a3cc-b40763f12038] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:25.272448 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=58 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:14:25.292335 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df751503-cee0-4a09-95f5-d79f0e7d20a0 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:25.293274 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df751503-cee0-4a09-95f5-d79f0e7d20a0 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:25.293995 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df751503-cee0-4a09-95f5-d79f0e7d20a0 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:25.295015 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df751503-cee0-4a09-95f5-d79f0e7d20a0 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:25.296234 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df751503-cee0-4a09-95f5-d79f0e7d20a0 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:25.296921 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df751503-cee0-4a09-95f5-d79f0e7d20a0 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:25.585757 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-df751503-cee0-4a09-95f5-d79f0e7d20a0 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:25.595026 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-df751503-cee0-4a09-95f5-d79f0e7d20a0 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038" status: 200 len: 1393 microversion: 2.1 time: 0.332538 Oct 18 16:14:25.595634 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3182/6383] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:25 2022] GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038 => generated 1393 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:25.985364 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-183430fc-e643-4bc5-a54e-cbe0deaf4bef req-0c85bd7a-b6f6-4500-9099-3ff493089025 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd096aa4-077a-4c95-a3cc-b40763f12038", "tag": "2434ee98-2bbe-49a4-94c0-636c1699cc12"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:14:25.996426 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-183430fc-e643-4bc5-a54e-cbe0deaf4bef req-0c85bd7a-b6f6-4500-9099-3ff493089025 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:25.997141 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-183430fc-e643-4bc5-a54e-cbe0deaf4bef req-0c85bd7a-b6f6-4500-9099-3ff493089025 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:25.997657 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-183430fc-e643-4bc5-a54e-cbe0deaf4bef req-0c85bd7a-b6f6-4500-9099-3ff493089025 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:26.009822 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-183430fc-e643-4bc5-a54e-cbe0deaf4bef req-0c85bd7a-b6f6-4500-9099-3ff493089025 service nova] Creating event network-changed:2434ee98-2bbe-49a4-94c0-636c1699cc12 for instance dd096aa4-077a-4c95-a3cc-b40763f12038 on n-h1-853682-5 Oct 18 16:14:26.014949 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-183430fc-e643-4bc5-a54e-cbe0deaf4bef req-0c85bd7a-b6f6-4500-9099-3ff493089025 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033691 Oct 18 16:14:26.015570 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3202/6384] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:14:26.618412 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3230aa32-749a-40fd-8585-99c444aa679e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:26.619031 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3230aa32-749a-40fd-8585-99c444aa679e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: dd096aa4-077a-4c95-a3cc-b40763f12038] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:26.625933 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3230aa32-749a-40fd-8585-99c444aa679e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:26.626425 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3230aa32-749a-40fd-8585-99c444aa679e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:26.626866 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3230aa32-749a-40fd-8585-99c444aa679e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:26.627563 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3230aa32-749a-40fd-8585-99c444aa679e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:26.628021 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3230aa32-749a-40fd-8585-99c444aa679e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:26.628454 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3230aa32-749a-40fd-8585-99c444aa679e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:26.761813 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3230aa32-749a-40fd-8585-99c444aa679e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:26.770406 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3230aa32-749a-40fd-8585-99c444aa679e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038" status: 200 len: 1393 microversion: 2.1 time: 0.155904 Oct 18 16:14:26.776200 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3183/6385] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:26 2022] GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038 => generated 1393 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:27.795543 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1f9d68de-c423-43c5-87c3-7a145efcebb3 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:27.796180 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1f9d68de-c423-43c5-87c3-7a145efcebb3 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: dd096aa4-077a-4c95-a3cc-b40763f12038] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:27.798789 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:14:27.804519 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1f9d68de-c423-43c5-87c3-7a145efcebb3 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:27.805033 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1f9d68de-c423-43c5-87c3-7a145efcebb3 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:27.805475 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1f9d68de-c423-43c5-87c3-7a145efcebb3 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:27.806179 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1f9d68de-c423-43c5-87c3-7a145efcebb3 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:27.806648 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1f9d68de-c423-43c5-87c3-7a145efcebb3 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:27.807082 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1f9d68de-c423-43c5-87c3-7a145efcebb3 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:27.810499 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:14:27.950702 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1f9d68de-c423-43c5-87c3-7a145efcebb3 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:27.958933 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1f9d68de-c423-43c5-87c3-7a145efcebb3 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038" status: 200 len: 1393 microversion: 2.1 time: 0.168640 Oct 18 16:14:27.959520 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3203/6386] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:27 2022] GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038 => generated 1393 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:28.982436 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-50092107-98c5-4c1c-8792-180ae99a00d5 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:28.983006 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-50092107-98c5-4c1c-8792-180ae99a00d5 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: dd096aa4-077a-4c95-a3cc-b40763f12038] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:28.985691 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:14:28.991070 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50092107-98c5-4c1c-8792-180ae99a00d5 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:28.991557 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50092107-98c5-4c1c-8792-180ae99a00d5 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:28.992000 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50092107-98c5-4c1c-8792-180ae99a00d5 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:28.992695 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50092107-98c5-4c1c-8792-180ae99a00d5 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:28.993194 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50092107-98c5-4c1c-8792-180ae99a00d5 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:28.993620 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50092107-98c5-4c1c-8792-180ae99a00d5 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:29.130344 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-50092107-98c5-4c1c-8792-180ae99a00d5 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:29.138078 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-50092107-98c5-4c1c-8792-180ae99a00d5 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038" status: 200 len: 1393 microversion: 2.1 time: 0.159684 Oct 18 16:14:29.138658 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3184/6387] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:28 2022] GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038 => generated 1393 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:30.162226 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-01b6d102-9643-420f-9b58-3f30df1155e8 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:30.162847 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-01b6d102-9643-420f-9b58-3f30df1155e8 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: dd096aa4-077a-4c95-a3cc-b40763f12038] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:30.169780 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-01b6d102-9643-420f-9b58-3f30df1155e8 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:30.170253 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-01b6d102-9643-420f-9b58-3f30df1155e8 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:30.170695 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-01b6d102-9643-420f-9b58-3f30df1155e8 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:30.171394 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-01b6d102-9643-420f-9b58-3f30df1155e8 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:30.171867 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-01b6d102-9643-420f-9b58-3f30df1155e8 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:30.172322 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-01b6d102-9643-420f-9b58-3f30df1155e8 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:30.301929 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-01b6d102-9643-420f-9b58-3f30df1155e8 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:30.309966 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-01b6d102-9643-420f-9b58-3f30df1155e8 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038" status: 200 len: 1393 microversion: 2.1 time: 0.151732 Oct 18 16:14:30.310639 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3204/6388] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:30 2022] GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038 => generated 1393 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:31.333059 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e2b1355b-4647-4be0-9c35-7a4b41dc14ab tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:31.333682 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e2b1355b-4647-4be0-9c35-7a4b41dc14ab tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: dd096aa4-077a-4c95-a3cc-b40763f12038] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:31.340746 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2b1355b-4647-4be0-9c35-7a4b41dc14ab tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:31.341797 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2b1355b-4647-4be0-9c35-7a4b41dc14ab tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:31.342239 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2b1355b-4647-4be0-9c35-7a4b41dc14ab tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:31.342935 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2b1355b-4647-4be0-9c35-7a4b41dc14ab tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:31.343394 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2b1355b-4647-4be0-9c35-7a4b41dc14ab tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:31.343813 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2b1355b-4647-4be0-9c35-7a4b41dc14ab tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:31.481247 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e2b1355b-4647-4be0-9c35-7a4b41dc14ab tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:31.489482 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e2b1355b-4647-4be0-9c35-7a4b41dc14ab tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038" status: 200 len: 1393 microversion: 2.1 time: 0.160419 Oct 18 16:14:31.490066 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3185/6389] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:31 2022] GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038 => generated 1393 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:32.512449 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2db8bf70-3b08-4114-8e66-5260f91aa82f tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:32.513013 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2db8bf70-3b08-4114-8e66-5260f91aa82f tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: dd096aa4-077a-4c95-a3cc-b40763f12038] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:32.519863 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2db8bf70-3b08-4114-8e66-5260f91aa82f tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:32.520337 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2db8bf70-3b08-4114-8e66-5260f91aa82f tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:32.520783 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2db8bf70-3b08-4114-8e66-5260f91aa82f tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:32.521505 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2db8bf70-3b08-4114-8e66-5260f91aa82f tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:32.521967 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2db8bf70-3b08-4114-8e66-5260f91aa82f tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:32.522404 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2db8bf70-3b08-4114-8e66-5260f91aa82f tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:32.654112 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2db8bf70-3b08-4114-8e66-5260f91aa82f tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:32.662415 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2db8bf70-3b08-4114-8e66-5260f91aa82f tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038" status: 200 len: 1393 microversion: 2.1 time: 0.154063 Oct 18 16:14:32.662996 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3205/6390] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:32 2022] GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038 => generated 1393 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:32.876963 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-cdd0c104-8602-4aeb-b2b6-088ce4b940ca req-6e863004-1e48-4e5e-9444-089dfc47e1d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd096aa4-077a-4c95-a3cc-b40763f12038", "name": "network-vif-plugged", "status": "completed", "tag": "2434ee98-2bbe-49a4-94c0-636c1699cc12"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:14:32.886368 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-cdd0c104-8602-4aeb-b2b6-088ce4b940ca req-6e863004-1e48-4e5e-9444-089dfc47e1d4 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:32.887006 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-cdd0c104-8602-4aeb-b2b6-088ce4b940ca req-6e863004-1e48-4e5e-9444-089dfc47e1d4 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:32.887598 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-cdd0c104-8602-4aeb-b2b6-088ce4b940ca req-6e863004-1e48-4e5e-9444-089dfc47e1d4 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:32.901219 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-cdd0c104-8602-4aeb-b2b6-088ce4b940ca req-6e863004-1e48-4e5e-9444-089dfc47e1d4 service nova] Creating event network-vif-plugged:2434ee98-2bbe-49a4-94c0-636c1699cc12 for instance dd096aa4-077a-4c95-a3cc-b40763f12038 on n-h1-853682-5 Oct 18 16:14:32.906085 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-cdd0c104-8602-4aeb-b2b6-088ce4b940ca req-6e863004-1e48-4e5e-9444-089dfc47e1d4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097909 Oct 18 16:14:32.907412 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3186/6391] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:14:33.686087 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a00e55b3-d381-462c-9c19-783ba37cb78e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:33.686701 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a00e55b3-d381-462c-9c19-783ba37cb78e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: dd096aa4-077a-4c95-a3cc-b40763f12038] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:33.688569 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:14:33.689264 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=6 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:14:33.695864 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a00e55b3-d381-462c-9c19-783ba37cb78e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:33.696357 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a00e55b3-d381-462c-9c19-783ba37cb78e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:33.696793 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a00e55b3-d381-462c-9c19-783ba37cb78e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:33.697513 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a00e55b3-d381-462c-9c19-783ba37cb78e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:33.697967 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a00e55b3-d381-462c-9c19-783ba37cb78e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:33.698390 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a00e55b3-d381-462c-9c19-783ba37cb78e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:33.830756 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a00e55b3-d381-462c-9c19-783ba37cb78e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:33.838665 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a00e55b3-d381-462c-9c19-783ba37cb78e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038" status: 200 len: 1393 microversion: 2.1 time: 0.156463 Oct 18 16:14:33.839239 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3206/6392] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:33 2022] GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038 => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:14:34.859655 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:14:34.865326 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a99f8f87-63f8-48ac-ab7d-43dc7f3db4af tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:34.866039 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a99f8f87-63f8-48ac-ab7d-43dc7f3db4af tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: dd096aa4-077a-4c95-a3cc-b40763f12038] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:34.872615 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a99f8f87-63f8-48ac-ab7d-43dc7f3db4af tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:34.873136 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a99f8f87-63f8-48ac-ab7d-43dc7f3db4af tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:34.873577 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a99f8f87-63f8-48ac-ab7d-43dc7f3db4af tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:34.874272 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a99f8f87-63f8-48ac-ab7d-43dc7f3db4af tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:34.874730 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a99f8f87-63f8-48ac-ab7d-43dc7f3db4af tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:34.875162 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a99f8f87-63f8-48ac-ab7d-43dc7f3db4af tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:35.011531 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a99f8f87-63f8-48ac-ab7d-43dc7f3db4af tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:35.019427 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a99f8f87-63f8-48ac-ab7d-43dc7f3db4af tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038" status: 200 len: 1566 microversion: 2.1 time: 0.160829 Oct 18 16:14:35.019991 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3187/6393] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:34 2022] GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:35.043527 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e5273e96-8de9-4940-99b8-de5c76c17d13 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:35.044149 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e5273e96-8de9-4940-99b8-de5c76c17d13 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: dd096aa4-077a-4c95-a3cc-b40763f12038] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:35.050997 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e5273e96-8de9-4940-99b8-de5c76c17d13 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:35.051480 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e5273e96-8de9-4940-99b8-de5c76c17d13 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:35.051920 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e5273e96-8de9-4940-99b8-de5c76c17d13 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:35.052613 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e5273e96-8de9-4940-99b8-de5c76c17d13 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:35.053100 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e5273e96-8de9-4940-99b8-de5c76c17d13 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:35.053779 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e5273e96-8de9-4940-99b8-de5c76c17d13 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:35.197872 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e5273e96-8de9-4940-99b8-de5c76c17d13 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:35.205825 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e5273e96-8de9-4940-99b8-de5c76c17d13 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038" status: 200 len: 1566 microversion: 2.1 time: 0.167422 Oct 18 16:14:35.206354 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3207/6394] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:35 2022] GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038 => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:14:37.113015 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e01ae7b8-a8f5-4c3c-880b-0b803b78b505 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:14:37.113632 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e01ae7b8-a8f5-4c3c-880b-0b803b78b505 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: dd096aa4-077a-4c95-a3cc-b40763f12038] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:14:37.116970 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-3dbbbdbe-2f0f-4efa-a0a3-d8e6a12d8a7a req-54046595-00cd-489f-912d-d01051bfda32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd096aa4-077a-4c95-a3cc-b40763f12038", "tag": "2434ee98-2bbe-49a4-94c0-636c1699cc12"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:14:37.120615 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e01ae7b8-a8f5-4c3c-880b-0b803b78b505 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:37.121266 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e01ae7b8-a8f5-4c3c-880b-0b803b78b505 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:37.121789 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e01ae7b8-a8f5-4c3c-880b-0b803b78b505 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:37.122498 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e01ae7b8-a8f5-4c3c-880b-0b803b78b505 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:37.122952 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e01ae7b8-a8f5-4c3c-880b-0b803b78b505 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:37.124736 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e01ae7b8-a8f5-4c3c-880b-0b803b78b505 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:37.128895 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-3dbbbdbe-2f0f-4efa-a0a3-d8e6a12d8a7a req-54046595-00cd-489f-912d-d01051bfda32 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:14:37.129387 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-3dbbbdbe-2f0f-4efa-a0a3-d8e6a12d8a7a req-54046595-00cd-489f-912d-d01051bfda32 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:14:37.129830 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-3dbbbdbe-2f0f-4efa-a0a3-d8e6a12d8a7a req-54046595-00cd-489f-912d-d01051bfda32 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:14:37.141369 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-3dbbbdbe-2f0f-4efa-a0a3-d8e6a12d8a7a req-54046595-00cd-489f-912d-d01051bfda32 service nova] Creating event network-changed:2434ee98-2bbe-49a4-94c0-636c1699cc12 for instance dd096aa4-077a-4c95-a3cc-b40763f12038 on n-h1-853682-5 Oct 18 16:14:37.146850 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-3dbbbdbe-2f0f-4efa-a0a3-d8e6a12d8a7a req-54046595-00cd-489f-912d-d01051bfda32 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038923 Oct 18 16:14:37.147752 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3208/6395] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:14:37.347637 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e01ae7b8-a8f5-4c3c-880b-0b803b78b505 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:14:37.358877 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e01ae7b8-a8f5-4c3c-880b-0b803b78b505 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038" status: 200 len: 1566 microversion: 2.1 time: 0.254490 Oct 18 16:14:37.359689 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3188/6396] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:14:37 2022] GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038 => generated 1566 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:00.706808 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=11 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:15:00.707553 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=31 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:15:00.711590 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fbb2e859-dd37-45db-8cda-87d38879ffc3 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:00.712173 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-fbb2e859-dd37-45db-8cda-87d38879ffc3 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] [instance: 37866b46-0317-46c2-bf93-239d7c480745] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:00.718937 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fbb2e859-dd37-45db-8cda-87d38879ffc3 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:00.719414 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fbb2e859-dd37-45db-8cda-87d38879ffc3 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:00.719854 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fbb2e859-dd37-45db-8cda-87d38879ffc3 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:00.721070 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fbb2e859-dd37-45db-8cda-87d38879ffc3 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:00.721531 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fbb2e859-dd37-45db-8cda-87d38879ffc3 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:00.721954 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fbb2e859-dd37-45db-8cda-87d38879ffc3 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:00.750629 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-fbb2e859-dd37-45db-8cda-87d38879ffc3 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] [instance: 37866b46-0317-46c2-bf93-239d7c480745] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:15:00.832197 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fbb2e859-dd37-45db-8cda-87d38879ffc3 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] 10.222.0.60 "DELETE /compute/v2.1/servers/37866b46-0317-46c2-bf93-239d7c480745" status: 204 len: 0 microversion: 2.1 time: 0.127085 Oct 18 16:15:00.832737 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3209/6397] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 16:15:00 2022] DELETE /compute/v2.1/servers/37866b46-0317-46c2-bf93-239d7c480745 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:15:00.840865 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-03912324-4cb8-4840-834a-7924f5ee0088 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:00.841486 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-03912324-4cb8-4840-834a-7924f5ee0088 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] [instance: 37866b46-0317-46c2-bf93-239d7c480745] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:00.844272 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=9 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:15:00.845045 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=38 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:15:00.852142 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03912324-4cb8-4840-834a-7924f5ee0088 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:00.852634 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03912324-4cb8-4840-834a-7924f5ee0088 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:00.853098 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03912324-4cb8-4840-834a-7924f5ee0088 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:00.853807 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03912324-4cb8-4840-834a-7924f5ee0088 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:00.854269 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03912324-4cb8-4840-834a-7924f5ee0088 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:00.854693 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03912324-4cb8-4840-834a-7924f5ee0088 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:00.988556 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-03912324-4cb8-4840-834a-7924f5ee0088 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d41bb6db24de39a4f960042b8b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17b67c4f926143dfb3fecb1d7622c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:00.996408 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-03912324-4cb8-4840-834a-7924f5ee0088 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] 10.222.0.60 "GET /compute/v2.1/servers/37866b46-0317-46c2-bf93-239d7c480745" status: 200 len: 1733 microversion: 2.1 time: 0.159408 Oct 18 16:15:00.997034 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3189/6398] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:00 2022] GET /compute/v2.1/servers/37866b46-0317-46c2-bf93-239d7c480745 => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:15:02.020105 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-01c4b4be-8e40-434f-8d77-6a87ae72c394 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:02.021126 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-01c4b4be-8e40-434f-8d77-6a87ae72c394 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] [instance: 37866b46-0317-46c2-bf93-239d7c480745] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:02.028713 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-01c4b4be-8e40-434f-8d77-6a87ae72c394 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:02.029242 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-01c4b4be-8e40-434f-8d77-6a87ae72c394 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:02.029685 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-01c4b4be-8e40-434f-8d77-6a87ae72c394 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:02.030392 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-01c4b4be-8e40-434f-8d77-6a87ae72c394 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:02.031168 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-01c4b4be-8e40-434f-8d77-6a87ae72c394 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:02.031302 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-01c4b4be-8e40-434f-8d77-6a87ae72c394 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:02.350920 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-01c4b4be-8e40-434f-8d77-6a87ae72c394 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d41bb6db24de39a4f960042b8b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17b67c4f926143dfb3fecb1d7622c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:02.358732 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-01c4b4be-8e40-434f-8d77-6a87ae72c394 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] 10.222.0.60 "GET /compute/v2.1/servers/37866b46-0317-46c2-bf93-239d7c480745" status: 200 len: 1733 microversion: 2.1 time: 0.342931 Oct 18 16:15:02.359523 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3210/6399] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:02 2022] GET /compute/v2.1/servers/37866b46-0317-46c2-bf93-239d7c480745 => generated 1733 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:03.153512 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-f5cb1367-d9ff-4260-a09f-ba72266b7be7 req-cf622706-4a8b-4dc2-9e45-19561216d51a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37866b46-0317-46c2-bf93-239d7c480745", "name": "network-vif-deleted", "tag": "1cf380d1-97b7-40a0-9e54-d065452af1aa"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:15:03.167930 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f5cb1367-d9ff-4260-a09f-ba72266b7be7 req-cf622706-4a8b-4dc2-9e45-19561216d51a service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:03.168424 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f5cb1367-d9ff-4260-a09f-ba72266b7be7 req-cf622706-4a8b-4dc2-9e45-19561216d51a service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:03.168888 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f5cb1367-d9ff-4260-a09f-ba72266b7be7 req-cf622706-4a8b-4dc2-9e45-19561216d51a service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:03.181365 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-f5cb1367-d9ff-4260-a09f-ba72266b7be7 req-cf622706-4a8b-4dc2-9e45-19561216d51a service nova] Creating event network-vif-deleted:1cf380d1-97b7-40a0-9e54-d065452af1aa for instance 37866b46-0317-46c2-bf93-239d7c480745 on n-h2-853682-5 Oct 18 16:15:03.186743 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-f5cb1367-d9ff-4260-a09f-ba72266b7be7 req-cf622706-4a8b-4dc2-9e45-19561216d51a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037365 Oct 18 16:15:03.187618 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3190/6400] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:15:03.384292 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c2ad7542-a3f4-4d94-83ce-58c2a9170cbf tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:03.385017 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c2ad7542-a3f4-4d94-83ce-58c2a9170cbf tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] [instance: 37866b46-0317-46c2-bf93-239d7c480745] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:03.392322 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c2ad7542-a3f4-4d94-83ce-58c2a9170cbf tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:03.393011 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c2ad7542-a3f4-4d94-83ce-58c2a9170cbf tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:03.393698 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c2ad7542-a3f4-4d94-83ce-58c2a9170cbf tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:03.394733 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c2ad7542-a3f4-4d94-83ce-58c2a9170cbf tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:03.395261 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c2ad7542-a3f4-4d94-83ce-58c2a9170cbf tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:03.395779 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c2ad7542-a3f4-4d94-83ce-58c2a9170cbf tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:03.429817 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c2ad7542-a3f4-4d94-83ce-58c2a9170cbf tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:03.430304 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c2ad7542-a3f4-4d94-83ce-58c2a9170cbf tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:03.430745 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c2ad7542-a3f4-4d94-83ce-58c2a9170cbf tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:03.431191 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-c2ad7542-a3f4-4d94-83ce-58c2a9170cbf tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lazy-loading 'fault' on Instance uuid 37866b46-0317-46c2-bf93-239d7c480745 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:15:03.475956 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c2ad7542-a3f4-4d94-83ce-58c2a9170cbf tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d41bb6db24de39a4f960042b8b995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17b67c4f926143dfb3fecb1d7622c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:03.483731 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c2ad7542-a3f4-4d94-83ce-58c2a9170cbf tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] 10.222.0.60 "GET /compute/v2.1/servers/37866b46-0317-46c2-bf93-239d7c480745" status: 200 len: 1389 microversion: 2.1 time: 0.104232 Oct 18 16:15:03.484316 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3211/6401] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:03 2022] GET /compute/v2.1/servers/37866b46-0317-46c2-bf93-239d7c480745 => generated 1389 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:04.557302 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a89b1ab4-a5ce-4dc3-80be-b1da08100a36 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:04.558002 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a89b1ab4-a5ce-4dc3-80be-b1da08100a36 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] [instance: 37866b46-0317-46c2-bf93-239d7c480745] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:04.564165 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a89b1ab4-a5ce-4dc3-80be-b1da08100a36 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:04.564644 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a89b1ab4-a5ce-4dc3-80be-b1da08100a36 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:04.565114 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a89b1ab4-a5ce-4dc3-80be-b1da08100a36 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:04.565798 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a89b1ab4-a5ce-4dc3-80be-b1da08100a36 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:04.566251 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a89b1ab4-a5ce-4dc3-80be-b1da08100a36 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:04.566673 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a89b1ab4-a5ce-4dc3-80be-b1da08100a36 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:04.579685 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-a89b1ab4-a5ce-4dc3-80be-b1da08100a36 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] HTTP exception thrown: Instance 37866b46-0317-46c2-bf93-239d7c480745 could not be found. Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a89b1ab4-a5ce-4dc3-80be-b1da08100a36 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Request method failure captured: Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/37866b46-0317-46c2-bf93-239d7c480745 HTTP/1.1 Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTs_XUrd9y1kBoZc8hV0K7ER1ygBTJDh-tOqQdxfufDIpu4jH7eovnm14ZDd-ebYls_9bTZpPo_aGYVjzUJTGuQgW-PSb1Dc2kqP7QzgWN7eB_x4LLbyGPNHZrvSEwzzpODrsTAYhfcz_tKW-MJ0y3UI3LCpuuql8gBGNKBDH-W_Vqc0 Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 17b67c4f926143dfb3fecb1d7622c883 Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-TestServerBasicOps-1624628112 Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/17b67c4f926143dfb3fecb1d7622c883"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/17b67c4f926143dfb3fecb1d7622c883"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/17b67c4f926143dfb3fecb1d7622c883"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_17b67c4f926143dfb3fecb1d7622c883"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-TestServerBasicOps-1624628112 Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 17b67c4f926143dfb3fecb1d7622c883 Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-TestServerBasicOps-1624628112 Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-TestServerBasicOps-1624628112-project Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 377d41bb6db24de39a4f960042b8b995 Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-TestServerBasicOps-1624628112-project Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 37866b46-0317-46c2-bf93-239d7c480745 could not be found. Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '37866b46-0317-46c2-bf93-239d7c480745'} Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37866b46-0317-46c2-bf93-239d7c480745 could not be found. Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37866b46-0317-46c2-bf93-239d7c480745 could not be found. Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:15:04.581853 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:15:04.586151 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:04.586151 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:15:04.586151 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:15:04.586151 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:15:04.586151 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:15:04.586151 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37866b46-0317-46c2-bf93-239d7c480745 could not be found. Oct 18 16:15:04.586151 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:15:04.586151 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a89b1ab4-a5ce-4dc3-80be-b1da08100a36 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Returning 404 to user: Instance 37866b46-0317-46c2-bf93-239d7c480745 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:15:04.586151 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a89b1ab4-a5ce-4dc3-80be-b1da08100a36 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] 10.222.0.60 "GET /compute/v2.1/servers/37866b46-0317-46c2-bf93-239d7c480745" status: 404 len: 111 microversion: 2.1 time: 0.080421 Oct 18 16:15:04.586151 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3191/6402] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:04 2022] GET /compute/v2.1/servers/37866b46-0317-46c2-bf93-239d7c480745 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:15:05.031251 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a21e286c-90a4-470c-99eb-ad1087c05445 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:05.031811 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a21e286c-90a4-470c-99eb-ad1087c05445 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] [instance: 37866b46-0317-46c2-bf93-239d7c480745] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:05.038415 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a21e286c-90a4-470c-99eb-ad1087c05445 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:05.039047 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a21e286c-90a4-470c-99eb-ad1087c05445 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:05.039598 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a21e286c-90a4-470c-99eb-ad1087c05445 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:05.040471 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a21e286c-90a4-470c-99eb-ad1087c05445 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:05.041068 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a21e286c-90a4-470c-99eb-ad1087c05445 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:05.041513 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a21e286c-90a4-470c-99eb-ad1087c05445 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:05.057218 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-a21e286c-90a4-470c-99eb-ad1087c05445 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] HTTP exception thrown: Instance 37866b46-0317-46c2-bf93-239d7c480745 could not be found. Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a21e286c-90a4-470c-99eb-ad1087c05445 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Request method failure captured: Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: request: DELETE /compute/v2.1/servers/37866b46-0317-46c2-bf93-239d7c480745 HTTP/1.1 Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTs_XUrd9y1kBoZc8hV0K7ER1ygBTJDh-tOqQdxfufDIpu4jH7eovnm14ZDd-ebYls_9bTZpPo_aGYVjzUJTGuQgW-PSb1Dc2kqP7QzgWN7eB_x4LLbyGPNHZrvSEwzzpODrsTAYhfcz_tKW-MJ0y3UI3LCpuuql8gBGNKBDH-W_Vqc0 Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 17b67c4f926143dfb3fecb1d7622c883 Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-TestServerBasicOps-1624628112 Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/17b67c4f926143dfb3fecb1d7622c883"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/17b67c4f926143dfb3fecb1d7622c883"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/17b67c4f926143dfb3fecb1d7622c883"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_17b67c4f926143dfb3fecb1d7622c883"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-TestServerBasicOps-1624628112 Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 17b67c4f926143dfb3fecb1d7622c883 Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-TestServerBasicOps-1624628112 Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-TestServerBasicOps-1624628112-project Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 377d41bb6db24de39a4f960042b8b995 Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-TestServerBasicOps-1624628112-project Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 37866b46-0317-46c2-bf93-239d7c480745 could not be found. Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '37866b46-0317-46c2-bf93-239d7c480745'} Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37866b46-0317-46c2-bf93-239d7c480745 could not be found. Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:15:05.058941 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:15:05.062771 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37866b46-0317-46c2-bf93-239d7c480745 could not be found. Oct 18 16:15:05.062771 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:15:05.062771 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:15:05.062771 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:15:05.062771 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:05.062771 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:15:05.062771 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:15:05.062771 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:15:05.062771 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:15:05.062771 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37866b46-0317-46c2-bf93-239d7c480745 could not be found. Oct 18 16:15:05.062771 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:15:05.062771 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a21e286c-90a4-470c-99eb-ad1087c05445 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Returning 404 to user: Instance 37866b46-0317-46c2-bf93-239d7c480745 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:15:05.062771 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a21e286c-90a4-470c-99eb-ad1087c05445 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] 10.222.0.60 "DELETE /compute/v2.1/servers/37866b46-0317-46c2-bf93-239d7c480745" status: 404 len: 111 microversion: 2.1 time: 0.034360 Oct 18 16:15:05.062771 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3212/6403] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 16:15:05 2022] DELETE /compute/v2.1/servers/37866b46-0317-46c2-bf93-239d7c480745 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:15:05.069381 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e690f516-ed60-4dc8-a3e3-33eb10b70103 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:05.070007 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e690f516-ed60-4dc8-a3e3-33eb10b70103 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] [instance: 37866b46-0317-46c2-bf93-239d7c480745] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:05.076075 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e690f516-ed60-4dc8-a3e3-33eb10b70103 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:05.076563 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e690f516-ed60-4dc8-a3e3-33eb10b70103 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:05.077031 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e690f516-ed60-4dc8-a3e3-33eb10b70103 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:05.077734 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e690f516-ed60-4dc8-a3e3-33eb10b70103 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:05.078192 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e690f516-ed60-4dc8-a3e3-33eb10b70103 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:05.078624 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e690f516-ed60-4dc8-a3e3-33eb10b70103 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:05.092024 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-e690f516-ed60-4dc8-a3e3-33eb10b70103 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] HTTP exception thrown: Instance 37866b46-0317-46c2-bf93-239d7c480745 could not be found. Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e690f516-ed60-4dc8-a3e3-33eb10b70103 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Request method failure captured: Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/37866b46-0317-46c2-bf93-239d7c480745 HTTP/1.1 Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTs_XUrd9y1kBoZc8hV0K7ER1ygBTJDh-tOqQdxfufDIpu4jH7eovnm14ZDd-ebYls_9bTZpPo_aGYVjzUJTGuQgW-PSb1Dc2kqP7QzgWN7eB_x4LLbyGPNHZrvSEwzzpODrsTAYhfcz_tKW-MJ0y3UI3LCpuuql8gBGNKBDH-W_Vqc0 Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 17b67c4f926143dfb3fecb1d7622c883 Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-TestServerBasicOps-1624628112 Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/17b67c4f926143dfb3fecb1d7622c883"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/17b67c4f926143dfb3fecb1d7622c883"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/17b67c4f926143dfb3fecb1d7622c883"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_17b67c4f926143dfb3fecb1d7622c883"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-TestServerBasicOps-1624628112 Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 17b67c4f926143dfb3fecb1d7622c883 Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-TestServerBasicOps-1624628112 Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-TestServerBasicOps-1624628112-project Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 377d41bb6db24de39a4f960042b8b995 Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-TestServerBasicOps-1624628112-project Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 37866b46-0317-46c2-bf93-239d7c480745 could not be found. Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '37866b46-0317-46c2-bf93-239d7c480745'} Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37866b46-0317-46c2-bf93-239d7c480745 could not be found. Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37866b46-0317-46c2-bf93-239d7c480745 could not be found. Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:15:05.093621 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:15:05.097735 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:05.097735 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:15:05.097735 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:15:05.097735 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:15:05.097735 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:15:05.097735 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37866b46-0317-46c2-bf93-239d7c480745 could not be found. Oct 18 16:15:05.097735 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:15:05.097735 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e690f516-ed60-4dc8-a3e3-33eb10b70103 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Returning 404 to user: Instance 37866b46-0317-46c2-bf93-239d7c480745 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:15:05.097735 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e690f516-ed60-4dc8-a3e3-33eb10b70103 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] 10.222.0.60 "GET /compute/v2.1/servers/37866b46-0317-46c2-bf93-239d7c480745" status: 404 len: 111 microversion: 2.1 time: 0.029590 Oct 18 16:15:05.097735 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3192/6404] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:05 2022] GET /compute/v2.1/servers/37866b46-0317-46c2-bf93-239d7c480745 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:15:05.258908 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-500e0280-a5f7-45d6-adb1-1652e6c4e160 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] Calling method '.version_select at 0x7f7c3d1d53a0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:05.282057 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-500e0280-a5f7-45d6-adb1-1652e6c4e160 tempest-TestServerBasicOps-1624628112 tempest-TestServerBasicOps-1624628112-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1569896155" status: 202 len: 0 microversion: 2.1 time: 0.026953 Oct 18 16:15:05.282908 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3213/6405] 10.222.0.60 () {58 vars in 1254 bytes} [Tue Oct 18 16:15:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1569896155 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 16:15:10.669997 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-85047389-0ef0-44c8-9581-f5760ce86221 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:15:10.673097 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-85047389-0ef0-44c8-9581-f5760ce86221 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: dd096aa4-077a-4c95-a3cc-b40763f12038] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:10.695917 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85047389-0ef0-44c8-9581-f5760ce86221 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:10.696774 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85047389-0ef0-44c8-9581-f5760ce86221 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:10.697497 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85047389-0ef0-44c8-9581-f5760ce86221 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:10.699195 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85047389-0ef0-44c8-9581-f5760ce86221 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:10.699880 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85047389-0ef0-44c8-9581-f5760ce86221 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:10.700379 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85047389-0ef0-44c8-9581-f5760ce86221 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:10.771590 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-85047389-0ef0-44c8-9581-f5760ce86221 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "POST /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038/action" status: 200 len: 24571 microversion: 2.1 time: 0.106079 Oct 18 16:15:10.772176 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3193/6406] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:15:10 2022] POST /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038/action => generated 24571 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:15:24.810945 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:15:24.812359 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:15:24.816361 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d7f7e60f-1b5b-4db8-b22e-0817b6beb56a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1745561836", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "7f522028-c563-4ee2-9e45-ee9a2021d2d6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a0168786-8cd3-418a-9936-dae2a39b2080"}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:15:24.902982 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-d7f7e60f-1b5b-4db8-b22e-0817b6beb56a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] validate_networks() for [('a0168786-8cd3-418a-9936-dae2a39b2080', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 16:15:25.330538 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-d7f7e60f-1b5b-4db8-b22e-0817b6beb56a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:15:25.331031 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-d7f7e60f-1b5b-4db8-b22e-0817b6beb56a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:15:25.331520 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-d7f7e60f-1b5b-4db8-b22e-0817b6beb56a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:15:25.331930 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-d7f7e60f-1b5b-4db8-b22e-0817b6beb56a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:15:25.332375 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-d7f7e60f-1b5b-4db8-b22e-0817b6beb56a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:15:25.341598 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d7f7e60f-1b5b-4db8-b22e-0817b6beb56a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:25.342091 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d7f7e60f-1b5b-4db8-b22e-0817b6beb56a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:25.342529 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d7f7e60f-1b5b-4db8-b22e-0817b6beb56a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:25.343263 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d7f7e60f-1b5b-4db8-b22e-0817b6beb56a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:25.343718 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d7f7e60f-1b5b-4db8-b22e-0817b6beb56a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:25.344146 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d7f7e60f-1b5b-4db8-b22e-0817b6beb56a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:25.363657 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-d7f7e60f-1b5b-4db8-b22e-0817b6beb56a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Getting quotas for project c05254b186b04c9cb9858f621938caca. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:15:25.368967 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-d7f7e60f-1b5b-4db8-b22e-0817b6beb56a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Getting quotas for user b9f9ae9e929c416a9298499ab8694d37 and project c05254b186b04c9cb9858f621938caca. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:15:25.428728 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d7f7e60f-1b5b-4db8-b22e-0817b6beb56a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:15:25.430798 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d7f7e60f-1b5b-4db8-b22e-0817b6beb56a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 09d9f6e6-fcc6-4175-9fd5-ec91a502afb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7f522028-c563-4ee2-9e45-ee9a2021d2d6',volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:15:25.566487 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d7f7e60f-1b5b-4db8-b22e-0817b6beb56a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.757333 Oct 18 16:15:25.567433 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3214/6407] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 16:15:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:15:25.581049 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fe2ce2f9-18bb-4ac4-bc8c-b54345b0fd25 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:25.589861 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fe2ce2f9-18bb-4ac4-bc8c-b54345b0fd25 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 09d9f6e6-fcc6-4175-9fd5-ec91a502afb3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:25.593006 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=10 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:15:25.593674 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=16 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:15:25.654905 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fe2ce2f9-18bb-4ac4-bc8c-b54345b0fd25 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:25.662938 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fe2ce2f9-18bb-4ac4-bc8c-b54345b0fd25 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/09d9f6e6-fcc6-4175-9fd5-ec91a502afb3" status: 200 len: 1057 microversion: 2.1 time: 0.087319 Oct 18 16:15:25.663534 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3194/6408] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:25 2022] GET /compute/v2.1/servers/09d9f6e6-fcc6-4175-9fd5-ec91a502afb3 => generated 1057 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:26.687640 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8c0af303-0ecc-4806-a4cb-03d898c3c74d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:26.688844 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8c0af303-0ecc-4806-a4cb-03d898c3c74d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 09d9f6e6-fcc6-4175-9fd5-ec91a502afb3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:26.696649 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c0af303-0ecc-4806-a4cb-03d898c3c74d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:26.697451 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c0af303-0ecc-4806-a4cb-03d898c3c74d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:26.697681 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c0af303-0ecc-4806-a4cb-03d898c3c74d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:26.698391 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c0af303-0ecc-4806-a4cb-03d898c3c74d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:26.698869 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c0af303-0ecc-4806-a4cb-03d898c3c74d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:26.699276 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8c0af303-0ecc-4806-a4cb-03d898c3c74d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:26.807951 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8c0af303-0ecc-4806-a4cb-03d898c3c74d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:26.822585 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8c0af303-0ecc-4806-a4cb-03d898c3c74d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/09d9f6e6-fcc6-4175-9fd5-ec91a502afb3" status: 200 len: 1173 microversion: 2.1 time: 0.140537 Oct 18 16:15:26.823563 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3215/6409] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:26 2022] GET /compute/v2.1/servers/09d9f6e6-fcc6-4175-9fd5-ec91a502afb3 => generated 1173 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:27.851203 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-207253ef-fbd0-4c43-babd-0b3f2c23961c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:27.852326 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-207253ef-fbd0-4c43-babd-0b3f2c23961c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 09d9f6e6-fcc6-4175-9fd5-ec91a502afb3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:27.860434 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-207253ef-fbd0-4c43-babd-0b3f2c23961c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:27.860987 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-207253ef-fbd0-4c43-babd-0b3f2c23961c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:27.861472 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-207253ef-fbd0-4c43-babd-0b3f2c23961c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:27.862185 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-207253ef-fbd0-4c43-babd-0b3f2c23961c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:27.862641 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-207253ef-fbd0-4c43-babd-0b3f2c23961c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:27.863223 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-207253ef-fbd0-4c43-babd-0b3f2c23961c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:28.085613 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-207253ef-fbd0-4c43-babd-0b3f2c23961c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:28.102764 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-207253ef-fbd0-4c43-babd-0b3f2c23961c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/09d9f6e6-fcc6-4175-9fd5-ec91a502afb3" status: 200 len: 1215 microversion: 2.1 time: 0.252344 Oct 18 16:15:28.105838 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3195/6410] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:27 2022] GET /compute/v2.1/servers/09d9f6e6-fcc6-4175-9fd5-ec91a502afb3 => generated 1215 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:28.218875 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-04f3ab0d-50be-4d2d-b024-af46937bd678 req-27e2b544-3c68-4728-9c9a-7c84e6aa0c52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09d9f6e6-fcc6-4175-9fd5-ec91a502afb3", "tag": "63a642ff-5b34-4251-8d93-f251d2565919"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:15:28.230157 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-04f3ab0d-50be-4d2d-b024-af46937bd678 req-27e2b544-3c68-4728-9c9a-7c84e6aa0c52 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:28.230865 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-04f3ab0d-50be-4d2d-b024-af46937bd678 req-27e2b544-3c68-4728-9c9a-7c84e6aa0c52 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:28.231444 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-04f3ab0d-50be-4d2d-b024-af46937bd678 req-27e2b544-3c68-4728-9c9a-7c84e6aa0c52 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:28.244441 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-04f3ab0d-50be-4d2d-b024-af46937bd678 req-27e2b544-3c68-4728-9c9a-7c84e6aa0c52 service nova] Creating event network-changed:63a642ff-5b34-4251-8d93-f251d2565919 for instance 09d9f6e6-fcc6-4175-9fd5-ec91a502afb3 on n-h2-853682-5 Oct 18 16:15:28.249605 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-04f3ab0d-50be-4d2d-b024-af46937bd678 req-27e2b544-3c68-4728-9c9a-7c84e6aa0c52 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040381 Oct 18 16:15:28.250215 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3216/6411] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:15:29.128315 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-03c6fd34-df7a-45a7-a4b1-68124e465589 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:29.129921 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-03c6fd34-df7a-45a7-a4b1-68124e465589 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 09d9f6e6-fcc6-4175-9fd5-ec91a502afb3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:29.138354 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03c6fd34-df7a-45a7-a4b1-68124e465589 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:29.138888 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03c6fd34-df7a-45a7-a4b1-68124e465589 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:29.139382 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03c6fd34-df7a-45a7-a4b1-68124e465589 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:29.140087 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03c6fd34-df7a-45a7-a4b1-68124e465589 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:29.140624 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03c6fd34-df7a-45a7-a4b1-68124e465589 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:29.141100 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03c6fd34-df7a-45a7-a4b1-68124e465589 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:29.281121 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-03c6fd34-df7a-45a7-a4b1-68124e465589 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:29.289277 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-03c6fd34-df7a-45a7-a4b1-68124e465589 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/09d9f6e6-fcc6-4175-9fd5-ec91a502afb3" status: 200 len: 1215 microversion: 2.1 time: 0.165559 Oct 18 16:15:29.289861 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3196/6412] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:29 2022] GET /compute/v2.1/servers/09d9f6e6-fcc6-4175-9fd5-ec91a502afb3 => generated 1215 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:30.315040 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5fd338ca-1190-4b5e-a688-fd54c293c94a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:30.315740 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5fd338ca-1190-4b5e-a688-fd54c293c94a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 09d9f6e6-fcc6-4175-9fd5-ec91a502afb3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:30.322075 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5fd338ca-1190-4b5e-a688-fd54c293c94a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:30.322553 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5fd338ca-1190-4b5e-a688-fd54c293c94a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:30.322992 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5fd338ca-1190-4b5e-a688-fd54c293c94a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:30.323677 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5fd338ca-1190-4b5e-a688-fd54c293c94a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:30.324131 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5fd338ca-1190-4b5e-a688-fd54c293c94a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:30.324553 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5fd338ca-1190-4b5e-a688-fd54c293c94a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:30.458630 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5fd338ca-1190-4b5e-a688-fd54c293c94a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:30.466541 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5fd338ca-1190-4b5e-a688-fd54c293c94a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/09d9f6e6-fcc6-4175-9fd5-ec91a502afb3" status: 200 len: 1215 microversion: 2.1 time: 0.157001 Oct 18 16:15:30.467129 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3217/6413] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:30 2022] GET /compute/v2.1/servers/09d9f6e6-fcc6-4175-9fd5-ec91a502afb3 => generated 1215 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:31.490184 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7b73acee-bacb-4c6a-b7d4-8731690426fd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:31.490843 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7b73acee-bacb-4c6a-b7d4-8731690426fd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 09d9f6e6-fcc6-4175-9fd5-ec91a502afb3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:31.498062 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b73acee-bacb-4c6a-b7d4-8731690426fd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:31.498564 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b73acee-bacb-4c6a-b7d4-8731690426fd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:31.499004 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b73acee-bacb-4c6a-b7d4-8731690426fd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:31.499715 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b73acee-bacb-4c6a-b7d4-8731690426fd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:31.500179 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b73acee-bacb-4c6a-b7d4-8731690426fd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:31.500614 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b73acee-bacb-4c6a-b7d4-8731690426fd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:31.646413 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7b73acee-bacb-4c6a-b7d4-8731690426fd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:31.655229 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7b73acee-bacb-4c6a-b7d4-8731690426fd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/09d9f6e6-fcc6-4175-9fd5-ec91a502afb3" status: 200 len: 1215 microversion: 2.1 time: 0.169809 Oct 18 16:15:31.655814 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3197/6414] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:31 2022] GET /compute/v2.1/servers/09d9f6e6-fcc6-4175-9fd5-ec91a502afb3 => generated 1215 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:32.678819 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6c106e45-62d0-4e9d-b677-5cd7ada811df tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:32.679444 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6c106e45-62d0-4e9d-b677-5cd7ada811df tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 09d9f6e6-fcc6-4175-9fd5-ec91a502afb3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:32.686831 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6c106e45-62d0-4e9d-b677-5cd7ada811df tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:32.687316 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6c106e45-62d0-4e9d-b677-5cd7ada811df tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:32.687783 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6c106e45-62d0-4e9d-b677-5cd7ada811df tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:32.688493 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6c106e45-62d0-4e9d-b677-5cd7ada811df tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:32.688981 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6c106e45-62d0-4e9d-b677-5cd7ada811df tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:32.689442 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6c106e45-62d0-4e9d-b677-5cd7ada811df tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:32.821958 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6c106e45-62d0-4e9d-b677-5cd7ada811df tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:32.829738 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6c106e45-62d0-4e9d-b677-5cd7ada811df tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/09d9f6e6-fcc6-4175-9fd5-ec91a502afb3" status: 200 len: 1203 microversion: 2.1 time: 0.155814 Oct 18 16:15:32.830306 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3218/6415] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:32 2022] GET /compute/v2.1/servers/09d9f6e6-fcc6-4175-9fd5-ec91a502afb3 => generated 1203 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:33.852467 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-16d47cf6-d740-4156-813e-6fb30ec338da tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:33.853109 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-16d47cf6-d740-4156-813e-6fb30ec338da tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 09d9f6e6-fcc6-4175-9fd5-ec91a502afb3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:33.859935 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16d47cf6-d740-4156-813e-6fb30ec338da tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:33.860416 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16d47cf6-d740-4156-813e-6fb30ec338da tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:33.861475 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16d47cf6-d740-4156-813e-6fb30ec338da tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:33.862259 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16d47cf6-d740-4156-813e-6fb30ec338da tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:33.862735 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16d47cf6-d740-4156-813e-6fb30ec338da tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:33.863195 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16d47cf6-d740-4156-813e-6fb30ec338da tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:33.991421 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-16d47cf6-d740-4156-813e-6fb30ec338da tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:33.999201 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-16d47cf6-d740-4156-813e-6fb30ec338da tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/09d9f6e6-fcc6-4175-9fd5-ec91a502afb3" status: 200 len: 1203 microversion: 2.1 time: 0.150706 Oct 18 16:15:33.999770 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3198/6416] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:33 2022] GET /compute/v2.1/servers/09d9f6e6-fcc6-4175-9fd5-ec91a502afb3 => generated 1203 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:35.023030 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-395b1e9c-10f2-4c0a-81a3-21d69ecbf515 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:35.023655 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-395b1e9c-10f2-4c0a-81a3-21d69ecbf515 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 09d9f6e6-fcc6-4175-9fd5-ec91a502afb3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:35.030070 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-395b1e9c-10f2-4c0a-81a3-21d69ecbf515 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:35.030566 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-395b1e9c-10f2-4c0a-81a3-21d69ecbf515 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:35.031011 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-395b1e9c-10f2-4c0a-81a3-21d69ecbf515 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:35.031724 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-395b1e9c-10f2-4c0a-81a3-21d69ecbf515 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:35.032189 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-395b1e9c-10f2-4c0a-81a3-21d69ecbf515 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:35.032620 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-395b1e9c-10f2-4c0a-81a3-21d69ecbf515 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:35.170214 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-395b1e9c-10f2-4c0a-81a3-21d69ecbf515 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:35.178802 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-395b1e9c-10f2-4c0a-81a3-21d69ecbf515 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/09d9f6e6-fcc6-4175-9fd5-ec91a502afb3" status: 200 len: 1203 microversion: 2.1 time: 0.159679 Oct 18 16:15:35.179379 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3219/6417] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:35 2022] GET /compute/v2.1/servers/09d9f6e6-fcc6-4175-9fd5-ec91a502afb3 => generated 1203 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:36.201663 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a16ed6b1-3d35-4b3a-add0-3a6d04b80aeb tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:36.202282 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a16ed6b1-3d35-4b3a-add0-3a6d04b80aeb tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 09d9f6e6-fcc6-4175-9fd5-ec91a502afb3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:36.204762 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:15:36.212301 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a16ed6b1-3d35-4b3a-add0-3a6d04b80aeb tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:36.212825 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a16ed6b1-3d35-4b3a-add0-3a6d04b80aeb tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:36.213282 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a16ed6b1-3d35-4b3a-add0-3a6d04b80aeb tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:36.213993 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a16ed6b1-3d35-4b3a-add0-3a6d04b80aeb tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:36.214459 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a16ed6b1-3d35-4b3a-add0-3a6d04b80aeb tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:36.214894 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a16ed6b1-3d35-4b3a-add0-3a6d04b80aeb tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:36.344976 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a16ed6b1-3d35-4b3a-add0-3a6d04b80aeb tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:36.352662 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a16ed6b1-3d35-4b3a-add0-3a6d04b80aeb tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/09d9f6e6-fcc6-4175-9fd5-ec91a502afb3" status: 200 len: 1203 microversion: 2.1 time: 0.155076 Oct 18 16:15:36.353272 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3199/6418] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:36 2022] GET /compute/v2.1/servers/09d9f6e6-fcc6-4175-9fd5-ec91a502afb3 => generated 1203 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:37.375949 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-22464b7a-d212-42ab-b92f-b3e3c0c448ec tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:37.377083 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-22464b7a-d212-42ab-b92f-b3e3c0c448ec tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 09d9f6e6-fcc6-4175-9fd5-ec91a502afb3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:37.379013 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:15:37.379790 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=6 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:15:37.386973 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-22464b7a-d212-42ab-b92f-b3e3c0c448ec tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:37.387446 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-22464b7a-d212-42ab-b92f-b3e3c0c448ec tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:37.387878 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-22464b7a-d212-42ab-b92f-b3e3c0c448ec tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:37.388574 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-22464b7a-d212-42ab-b92f-b3e3c0c448ec tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:37.389061 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-22464b7a-d212-42ab-b92f-b3e3c0c448ec tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:37.389484 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-22464b7a-d212-42ab-b92f-b3e3c0c448ec tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:37.524720 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-22464b7a-d212-42ab-b92f-b3e3c0c448ec tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:37.532442 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-22464b7a-d212-42ab-b92f-b3e3c0c448ec tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/09d9f6e6-fcc6-4175-9fd5-ec91a502afb3" status: 200 len: 1203 microversion: 2.1 time: 0.160383 Oct 18 16:15:37.533047 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3220/6419] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:37 2022] GET /compute/v2.1/servers/09d9f6e6-fcc6-4175-9fd5-ec91a502afb3 => generated 1203 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:38.555579 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ab8209a0-6466-4a8d-b2a1-ee677571484b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:38.556203 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ab8209a0-6466-4a8d-b2a1-ee677571484b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 09d9f6e6-fcc6-4175-9fd5-ec91a502afb3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:38.563187 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab8209a0-6466-4a8d-b2a1-ee677571484b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:38.563691 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab8209a0-6466-4a8d-b2a1-ee677571484b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:38.564115 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab8209a0-6466-4a8d-b2a1-ee677571484b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:38.564833 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab8209a0-6466-4a8d-b2a1-ee677571484b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:38.565302 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab8209a0-6466-4a8d-b2a1-ee677571484b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:38.565733 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab8209a0-6466-4a8d-b2a1-ee677571484b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:38.699754 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ab8209a0-6466-4a8d-b2a1-ee677571484b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:38.708032 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ab8209a0-6466-4a8d-b2a1-ee677571484b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/09d9f6e6-fcc6-4175-9fd5-ec91a502afb3" status: 200 len: 1203 microversion: 2.1 time: 0.156723 Oct 18 16:15:38.708599 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3200/6420] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:38 2022] GET /compute/v2.1/servers/09d9f6e6-fcc6-4175-9fd5-ec91a502afb3 => generated 1203 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:39.730547 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8312154f-074a-4aa8-8dae-e0869612055f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:39.731173 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8312154f-074a-4aa8-8dae-e0869612055f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 09d9f6e6-fcc6-4175-9fd5-ec91a502afb3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:39.738712 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8312154f-074a-4aa8-8dae-e0869612055f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:39.739200 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8312154f-074a-4aa8-8dae-e0869612055f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:39.739646 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8312154f-074a-4aa8-8dae-e0869612055f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:39.740345 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8312154f-074a-4aa8-8dae-e0869612055f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:39.740829 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8312154f-074a-4aa8-8dae-e0869612055f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:39.741257 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8312154f-074a-4aa8-8dae-e0869612055f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:39.894013 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8312154f-074a-4aa8-8dae-e0869612055f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:39.906206 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8312154f-074a-4aa8-8dae-e0869612055f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/09d9f6e6-fcc6-4175-9fd5-ec91a502afb3" status: 200 len: 1203 microversion: 2.1 time: 0.179608 Oct 18 16:15:39.906791 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3221/6421] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:39 2022] GET /compute/v2.1/servers/09d9f6e6-fcc6-4175-9fd5-ec91a502afb3 => generated 1203 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:40.929595 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-16f9a613-95e4-4521-9321-bf3b84d7830a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:40.930210 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-16f9a613-95e4-4521-9321-bf3b84d7830a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 09d9f6e6-fcc6-4175-9fd5-ec91a502afb3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:40.937140 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16f9a613-95e4-4521-9321-bf3b84d7830a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:40.937624 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16f9a613-95e4-4521-9321-bf3b84d7830a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:40.938059 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16f9a613-95e4-4521-9321-bf3b84d7830a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:40.938747 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16f9a613-95e4-4521-9321-bf3b84d7830a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:40.939276 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16f9a613-95e4-4521-9321-bf3b84d7830a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:40.939698 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16f9a613-95e4-4521-9321-bf3b84d7830a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:41.068914 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-16f9a613-95e4-4521-9321-bf3b84d7830a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:41.076627 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-16f9a613-95e4-4521-9321-bf3b84d7830a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/09d9f6e6-fcc6-4175-9fd5-ec91a502afb3" status: 200 len: 1203 microversion: 2.1 time: 0.151320 Oct 18 16:15:41.077230 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3201/6422] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:40 2022] GET /compute/v2.1/servers/09d9f6e6-fcc6-4175-9fd5-ec91a502afb3 => generated 1203 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:41.189706 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e867af6b-5c19-4551-b2cf-ac78807a3a38 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:15:41.192460 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e867af6b-5c19-4551-b2cf-ac78807a3a38 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: dd096aa4-077a-4c95-a3cc-b40763f12038] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:41.199277 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e867af6b-5c19-4551-b2cf-ac78807a3a38 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:41.199776 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e867af6b-5c19-4551-b2cf-ac78807a3a38 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:41.200221 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e867af6b-5c19-4551-b2cf-ac78807a3a38 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:41.200953 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e867af6b-5c19-4551-b2cf-ac78807a3a38 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:41.201418 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e867af6b-5c19-4551-b2cf-ac78807a3a38 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:41.201859 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e867af6b-5c19-4551-b2cf-ac78807a3a38 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:41.283420 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-e867af6b-5c19-4551-b2cf-ac78807a3a38 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:15:41.283786 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-e867af6b-5c19-4551-b2cf-ac78807a3a38 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:15:41.284267 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-e867af6b-5c19-4551-b2cf-ac78807a3a38 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:15:41.284684 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-e867af6b-5c19-4551-b2cf-ac78807a3a38 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:15:41.285127 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-e867af6b-5c19-4551-b2cf-ac78807a3a38 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:15:41.343627 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e867af6b-5c19-4551-b2cf-ac78807a3a38 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: dd096aa4-077a-4c95-a3cc-b40763f12038] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:41.349999 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e867af6b-5c19-4551-b2cf-ac78807a3a38 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:41.350485 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e867af6b-5c19-4551-b2cf-ac78807a3a38 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:41.350920 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e867af6b-5c19-4551-b2cf-ac78807a3a38 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:41.351769 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e867af6b-5c19-4551-b2cf-ac78807a3a38 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:41.352230 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e867af6b-5c19-4551-b2cf-ac78807a3a38 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:41.352775 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e867af6b-5c19-4551-b2cf-ac78807a3a38 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:41.381275 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e867af6b-5c19-4551-b2cf-ac78807a3a38 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "POST /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038/action" status: 202 len: 1139 microversion: 2.1 time: 0.195366 Oct 18 16:15:41.382392 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3222/6423] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:15:41 2022] POST /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038/action => generated 1139 bytes in 197 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 18 16:15:41.404385 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-164188c0-015d-4512-a64b-95ec79839c6a tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:41.405132 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-164188c0-015d-4512-a64b-95ec79839c6a tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: dd096aa4-077a-4c95-a3cc-b40763f12038] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:41.412327 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-164188c0-015d-4512-a64b-95ec79839c6a tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:41.412982 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-164188c0-015d-4512-a64b-95ec79839c6a tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:41.413645 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-164188c0-015d-4512-a64b-95ec79839c6a tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:41.414319 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-164188c0-015d-4512-a64b-95ec79839c6a tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:41.414787 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-164188c0-015d-4512-a64b-95ec79839c6a tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:41.415296 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-164188c0-015d-4512-a64b-95ec79839c6a tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:41.552141 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-164188c0-015d-4512-a64b-95ec79839c6a tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:41.560292 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-164188c0-015d-4512-a64b-95ec79839c6a tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038" status: 200 len: 1694 microversion: 2.1 time: 0.161328 Oct 18 16:15:41.560886 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3202/6424] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:41 2022] GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038 => generated 1694 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:42.099346 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-375b1dc2-0737-483f-ab0a-48e7ea3499e3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:42.099962 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-375b1dc2-0737-483f-ab0a-48e7ea3499e3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 09d9f6e6-fcc6-4175-9fd5-ec91a502afb3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:42.106075 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-375b1dc2-0737-483f-ab0a-48e7ea3499e3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:42.106558 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-375b1dc2-0737-483f-ab0a-48e7ea3499e3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:42.106994 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-375b1dc2-0737-483f-ab0a-48e7ea3499e3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:42.107681 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-375b1dc2-0737-483f-ab0a-48e7ea3499e3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:42.108137 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-375b1dc2-0737-483f-ab0a-48e7ea3499e3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:42.108562 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-375b1dc2-0737-483f-ab0a-48e7ea3499e3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:42.240702 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-375b1dc2-0737-483f-ab0a-48e7ea3499e3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:42.248511 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-375b1dc2-0737-483f-ab0a-48e7ea3499e3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/09d9f6e6-fcc6-4175-9fd5-ec91a502afb3" status: 200 len: 1203 microversion: 2.1 time: 0.153140 Oct 18 16:15:42.249137 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3223/6425] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:42 2022] GET /compute/v2.1/servers/09d9f6e6-fcc6-4175-9fd5-ec91a502afb3 => generated 1203 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:42.583712 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-14437fbf-5e4b-4fca-9200-d1684fd72a50 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:42.584644 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-14437fbf-5e4b-4fca-9200-d1684fd72a50 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: dd096aa4-077a-4c95-a3cc-b40763f12038] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:42.591626 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14437fbf-5e4b-4fca-9200-d1684fd72a50 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:42.592116 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14437fbf-5e4b-4fca-9200-d1684fd72a50 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:42.592551 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14437fbf-5e4b-4fca-9200-d1684fd72a50 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:42.593295 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14437fbf-5e4b-4fca-9200-d1684fd72a50 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:42.593748 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14437fbf-5e4b-4fca-9200-d1684fd72a50 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:42.594176 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14437fbf-5e4b-4fca-9200-d1684fd72a50 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:42.597031 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-f74fca4c-f431-4015-8c0d-c3a7e9e3cc3c req-879fb6a2-efbd-4aa3-bea9-0ed01cab218b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09d9f6e6-fcc6-4175-9fd5-ec91a502afb3", "name": "network-vif-plugged", "status": "completed", "tag": "63a642ff-5b34-4251-8d93-f251d2565919"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:15:42.607658 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-f74fca4c-f431-4015-8c0d-c3a7e9e3cc3c req-879fb6a2-efbd-4aa3-bea9-0ed01cab218b service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:42.608197 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-f74fca4c-f431-4015-8c0d-c3a7e9e3cc3c req-879fb6a2-efbd-4aa3-bea9-0ed01cab218b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:42.609085 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-f74fca4c-f431-4015-8c0d-c3a7e9e3cc3c req-879fb6a2-efbd-4aa3-bea9-0ed01cab218b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:42.622807 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-f74fca4c-f431-4015-8c0d-c3a7e9e3cc3c req-879fb6a2-efbd-4aa3-bea9-0ed01cab218b service nova] Creating event network-vif-plugged:63a642ff-5b34-4251-8d93-f251d2565919 for instance 09d9f6e6-fcc6-4175-9fd5-ec91a502afb3 on n-h2-853682-5 Oct 18 16:15:42.628160 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-f74fca4c-f431-4015-8c0d-c3a7e9e3cc3c req-879fb6a2-efbd-4aa3-bea9-0ed01cab218b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035385 Oct 18 16:15:42.629123 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3224/6426] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:15:42.784728 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-14437fbf-5e4b-4fca-9200-d1684fd72a50 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:42.792686 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-14437fbf-5e4b-4fca-9200-d1684fd72a50 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038" status: 200 len: 1694 microversion: 2.1 time: 0.212928 Oct 18 16:15:42.793498 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3203/6427] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:42 2022] GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038 => generated 1694 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:43.272277 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2c5dbd15-b59e-4325-a625-a3ba2d00a3c8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:43.273026 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2c5dbd15-b59e-4325-a625-a3ba2d00a3c8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 09d9f6e6-fcc6-4175-9fd5-ec91a502afb3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:43.280106 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c5dbd15-b59e-4325-a625-a3ba2d00a3c8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:43.280594 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c5dbd15-b59e-4325-a625-a3ba2d00a3c8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:43.281065 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c5dbd15-b59e-4325-a625-a3ba2d00a3c8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:43.281763 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c5dbd15-b59e-4325-a625-a3ba2d00a3c8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:43.282232 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c5dbd15-b59e-4325-a625-a3ba2d00a3c8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:43.282689 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c5dbd15-b59e-4325-a625-a3ba2d00a3c8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:43.409243 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2c5dbd15-b59e-4325-a625-a3ba2d00a3c8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:43.417074 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2c5dbd15-b59e-4325-a625-a3ba2d00a3c8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/09d9f6e6-fcc6-4175-9fd5-ec91a502afb3" status: 200 len: 1203 microversion: 2.1 time: 0.149666 Oct 18 16:15:43.417648 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3225/6428] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:43 2022] GET /compute/v2.1/servers/09d9f6e6-fcc6-4175-9fd5-ec91a502afb3 => generated 1203 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:43.815707 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3b510139-f699-4ffb-a929-bb2a8de43f62 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:43.816317 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3b510139-f699-4ffb-a929-bb2a8de43f62 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: dd096aa4-077a-4c95-a3cc-b40763f12038] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:43.823750 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b510139-f699-4ffb-a929-bb2a8de43f62 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:43.824270 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b510139-f699-4ffb-a929-bb2a8de43f62 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:43.824712 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b510139-f699-4ffb-a929-bb2a8de43f62 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:43.825449 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b510139-f699-4ffb-a929-bb2a8de43f62 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:43.825911 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b510139-f699-4ffb-a929-bb2a8de43f62 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:43.826385 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b510139-f699-4ffb-a929-bb2a8de43f62 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:43.959806 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3b510139-f699-4ffb-a929-bb2a8de43f62 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:43.968279 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3b510139-f699-4ffb-a929-bb2a8de43f62 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038" status: 200 len: 1694 microversion: 2.1 time: 0.156551 Oct 18 16:15:43.968911 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3204/6429] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:43 2022] GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038 => generated 1694 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:44.440619 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a723df54-c0b8-4089-bd79-112f7bb471cd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:44.441265 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a723df54-c0b8-4089-bd79-112f7bb471cd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 09d9f6e6-fcc6-4175-9fd5-ec91a502afb3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:44.448073 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a723df54-c0b8-4089-bd79-112f7bb471cd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:44.448553 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a723df54-c0b8-4089-bd79-112f7bb471cd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:44.449023 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a723df54-c0b8-4089-bd79-112f7bb471cd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:44.449720 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a723df54-c0b8-4089-bd79-112f7bb471cd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:44.450183 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a723df54-c0b8-4089-bd79-112f7bb471cd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:44.450617 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a723df54-c0b8-4089-bd79-112f7bb471cd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:44.582968 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a723df54-c0b8-4089-bd79-112f7bb471cd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:44.590947 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a723df54-c0b8-4089-bd79-112f7bb471cd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/09d9f6e6-fcc6-4175-9fd5-ec91a502afb3" status: 200 len: 1390 microversion: 2.1 time: 0.154905 Oct 18 16:15:44.591520 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3226/6430] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:44 2022] GET /compute/v2.1/servers/09d9f6e6-fcc6-4175-9fd5-ec91a502afb3 => generated 1390 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:44.613194 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9560212b-4df7-4bfa-b260-62400bd1161b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:44.613807 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9560212b-4df7-4bfa-b260-62400bd1161b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 09d9f6e6-fcc6-4175-9fd5-ec91a502afb3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:44.615937 n-d-853682-5 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 16:15:44.616076 n-d-853682-5 devstack@n-api.service[120406]: Tue Oct 18 16:15:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/09d9f6e6-fcc6-4175-9fd5-ec91a502afb3 (ip 10.222.0.60) !!! Oct 18 16:15:44.625931 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9560212b-4df7-4bfa-b260-62400bd1161b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:44.626411 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9560212b-4df7-4bfa-b260-62400bd1161b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:44.627405 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9560212b-4df7-4bfa-b260-62400bd1161b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:44.628088 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9560212b-4df7-4bfa-b260-62400bd1161b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:44.628536 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9560212b-4df7-4bfa-b260-62400bd1161b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:44.628994 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9560212b-4df7-4bfa-b260-62400bd1161b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:44.760335 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9560212b-4df7-4bfa-b260-62400bd1161b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:44.768359 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9560212b-4df7-4bfa-b260-62400bd1161b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/09d9f6e6-fcc6-4175-9fd5-ec91a502afb3" status: 200 len: 1390 microversion: 2.1 time: 0.159590 Oct 18 16:15:44.768976 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3205/6431] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:44 2022] GET /compute/v2.1/servers/09d9f6e6-fcc6-4175-9fd5-ec91a502afb3 => generated 1390 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:44.790906 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e0c4164d-25e4-497b-af24-b68856eadf2b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:44.791526 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e0c4164d-25e4-497b-af24-b68856eadf2b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 09d9f6e6-fcc6-4175-9fd5-ec91a502afb3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:44.797735 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e0c4164d-25e4-497b-af24-b68856eadf2b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:44.798216 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e0c4164d-25e4-497b-af24-b68856eadf2b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:44.799280 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e0c4164d-25e4-497b-af24-b68856eadf2b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:44.799967 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e0c4164d-25e4-497b-af24-b68856eadf2b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:44.800417 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e0c4164d-25e4-497b-af24-b68856eadf2b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:44.800855 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e0c4164d-25e4-497b-af24-b68856eadf2b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:44.931998 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e0c4164d-25e4-497b-af24-b68856eadf2b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:44.939918 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e0c4164d-25e4-497b-af24-b68856eadf2b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/09d9f6e6-fcc6-4175-9fd5-ec91a502afb3" status: 200 len: 1390 microversion: 2.1 time: 0.152868 Oct 18 16:15:44.940490 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3227/6432] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:44 2022] GET /compute/v2.1/servers/09d9f6e6-fcc6-4175-9fd5-ec91a502afb3 => generated 1390 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:44.961859 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2a8b9137-e25d-41fe-a9a9-04efe030b925 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:44.962356 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2a8b9137-e25d-41fe-a9a9-04efe030b925 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 09d9f6e6-fcc6-4175-9fd5-ec91a502afb3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:44.969297 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a8b9137-e25d-41fe-a9a9-04efe030b925 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:44.969790 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a8b9137-e25d-41fe-a9a9-04efe030b925 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:44.970790 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a8b9137-e25d-41fe-a9a9-04efe030b925 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:44.971486 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a8b9137-e25d-41fe-a9a9-04efe030b925 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:44.971946 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a8b9137-e25d-41fe-a9a9-04efe030b925 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:44.972373 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a8b9137-e25d-41fe-a9a9-04efe030b925 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:44.992283 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4c09d3a6-dade-4a68-8285-3ea3ffad62e4 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:44.992915 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4c09d3a6-dade-4a68-8285-3ea3ffad62e4 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: dd096aa4-077a-4c95-a3cc-b40763f12038] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:44.997653 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2a8b9137-e25d-41fe-a9a9-04efe030b925 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 09d9f6e6-fcc6-4175-9fd5-ec91a502afb3] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:15:44.998780 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4c09d3a6-dade-4a68-8285-3ea3ffad62e4 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:44.999263 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4c09d3a6-dade-4a68-8285-3ea3ffad62e4 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:44.999706 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4c09d3a6-dade-4a68-8285-3ea3ffad62e4 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:45.000391 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4c09d3a6-dade-4a68-8285-3ea3ffad62e4 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:45.000868 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4c09d3a6-dade-4a68-8285-3ea3ffad62e4 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:45.001302 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4c09d3a6-dade-4a68-8285-3ea3ffad62e4 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:45.080267 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2a8b9137-e25d-41fe-a9a9-04efe030b925 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "DELETE /compute/v2.1/servers/09d9f6e6-fcc6-4175-9fd5-ec91a502afb3" status: 204 len: 0 microversion: 2.1 time: 0.121490 Oct 18 16:15:45.081086 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3206/6433] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 16:15:44 2022] DELETE /compute/v2.1/servers/09d9f6e6-fcc6-4175-9fd5-ec91a502afb3 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:15:45.089595 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7c300703-dfa2-40fa-9c0c-55e71f0d646f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:45.090295 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7c300703-dfa2-40fa-9c0c-55e71f0d646f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 09d9f6e6-fcc6-4175-9fd5-ec91a502afb3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:45.097194 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c300703-dfa2-40fa-9c0c-55e71f0d646f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:45.097682 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c300703-dfa2-40fa-9c0c-55e71f0d646f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:45.098111 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c300703-dfa2-40fa-9c0c-55e71f0d646f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:45.098808 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c300703-dfa2-40fa-9c0c-55e71f0d646f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:45.099258 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c300703-dfa2-40fa-9c0c-55e71f0d646f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:45.099682 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c300703-dfa2-40fa-9c0c-55e71f0d646f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:45.151607 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4c09d3a6-dade-4a68-8285-3ea3ffad62e4 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:45.160094 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4c09d3a6-dade-4a68-8285-3ea3ffad62e4 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038" status: 200 len: 1694 microversion: 2.1 time: 0.171854 Oct 18 16:15:45.160684 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3228/6434] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:44 2022] GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038 => generated 1694 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:15:45.242313 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7c300703-dfa2-40fa-9c0c-55e71f0d646f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:45.250355 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7c300703-dfa2-40fa-9c0c-55e71f0d646f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/09d9f6e6-fcc6-4175-9fd5-ec91a502afb3" status: 200 len: 1396 microversion: 2.1 time: 0.165114 Oct 18 16:15:45.250934 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3207/6435] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:45 2022] GET /compute/v2.1/servers/09d9f6e6-fcc6-4175-9fd5-ec91a502afb3 => generated 1396 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:15:46.183856 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b6160499-06ca-409f-bd3a-a97902d013df tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:46.184469 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b6160499-06ca-409f-bd3a-a97902d013df tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: dd096aa4-077a-4c95-a3cc-b40763f12038] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:46.191377 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b6160499-06ca-409f-bd3a-a97902d013df tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:46.191866 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b6160499-06ca-409f-bd3a-a97902d013df tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:46.192309 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b6160499-06ca-409f-bd3a-a97902d013df tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:46.193068 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b6160499-06ca-409f-bd3a-a97902d013df tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:46.193530 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b6160499-06ca-409f-bd3a-a97902d013df tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:46.193961 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b6160499-06ca-409f-bd3a-a97902d013df tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:46.274468 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fd0c887f-e4d6-4a7d-b37d-58d8c96f78a2 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:46.275085 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fd0c887f-e4d6-4a7d-b37d-58d8c96f78a2 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 09d9f6e6-fcc6-4175-9fd5-ec91a502afb3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:46.282548 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd0c887f-e4d6-4a7d-b37d-58d8c96f78a2 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:46.283690 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd0c887f-e4d6-4a7d-b37d-58d8c96f78a2 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:46.284123 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd0c887f-e4d6-4a7d-b37d-58d8c96f78a2 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:46.284850 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd0c887f-e4d6-4a7d-b37d-58d8c96f78a2 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:46.285308 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd0c887f-e4d6-4a7d-b37d-58d8c96f78a2 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:46.285735 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd0c887f-e4d6-4a7d-b37d-58d8c96f78a2 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:46.824495 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b6160499-06ca-409f-bd3a-a97902d013df tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:46.833112 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b6160499-06ca-409f-bd3a-a97902d013df tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038" status: 200 len: 1694 microversion: 2.1 time: 0.653021 Oct 18 16:15:46.833836 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3229/6436] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:46 2022] GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038 => generated 1694 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:46.835489 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fd0c887f-e4d6-4a7d-b37d-58d8c96f78a2 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:46.844160 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fd0c887f-e4d6-4a7d-b37d-58d8c96f78a2 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/09d9f6e6-fcc6-4175-9fd5-ec91a502afb3" status: 200 len: 1396 microversion: 2.1 time: 0.573611 Oct 18 16:15:46.857232 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3208/6437] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:46 2022] GET /compute/v2.1/servers/09d9f6e6-fcc6-4175-9fd5-ec91a502afb3 => generated 1396 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:15:47.203246 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-6c4bb384-993b-4d7b-b0cc-892b0c03dd68 req-ddd3c178-a91e-40f4-87e6-cfcbcd03a271 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09d9f6e6-fcc6-4175-9fd5-ec91a502afb3", "name": "network-vif-deleted", "tag": "63a642ff-5b34-4251-8d93-f251d2565919"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:15:47.215533 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-6c4bb384-993b-4d7b-b0cc-892b0c03dd68 req-ddd3c178-a91e-40f4-87e6-cfcbcd03a271 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:47.216404 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-6c4bb384-993b-4d7b-b0cc-892b0c03dd68 req-ddd3c178-a91e-40f4-87e6-cfcbcd03a271 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:47.217242 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-6c4bb384-993b-4d7b-b0cc-892b0c03dd68 req-ddd3c178-a91e-40f4-87e6-cfcbcd03a271 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:47.231129 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-6c4bb384-993b-4d7b-b0cc-892b0c03dd68 req-ddd3c178-a91e-40f4-87e6-cfcbcd03a271 service nova] Creating event network-vif-deleted:63a642ff-5b34-4251-8d93-f251d2565919 for instance 09d9f6e6-fcc6-4175-9fd5-ec91a502afb3 on n-h2-853682-5 Oct 18 16:15:47.237131 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-6c4bb384-993b-4d7b-b0cc-892b0c03dd68 req-ddd3c178-a91e-40f4-87e6-cfcbcd03a271 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050205 Oct 18 16:15:47.238065 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3230/6438] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:15:47.857322 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-48b85934-1d5b-45c6-9d18-d7bbe4e07016 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:47.857970 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-48b85934-1d5b-45c6-9d18-d7bbe4e07016 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: dd096aa4-077a-4c95-a3cc-b40763f12038] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:47.865688 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-48b85934-1d5b-45c6-9d18-d7bbe4e07016 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:47.866174 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-48b85934-1d5b-45c6-9d18-d7bbe4e07016 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:47.866609 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-48b85934-1d5b-45c6-9d18-d7bbe4e07016 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:47.867313 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-48b85934-1d5b-45c6-9d18-d7bbe4e07016 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:47.867764 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-48b85934-1d5b-45c6-9d18-d7bbe4e07016 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:47.868192 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-48b85934-1d5b-45c6-9d18-d7bbe4e07016 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:47.869193 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-06c51fe0-02f5-476f-bbc5-9861ce66c293 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:47.870029 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-06c51fe0-02f5-476f-bbc5-9861ce66c293 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 09d9f6e6-fcc6-4175-9fd5-ec91a502afb3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:47.876522 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-06c51fe0-02f5-476f-bbc5-9861ce66c293 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:47.877244 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-06c51fe0-02f5-476f-bbc5-9861ce66c293 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:47.877788 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-06c51fe0-02f5-476f-bbc5-9861ce66c293 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:47.878639 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-06c51fe0-02f5-476f-bbc5-9861ce66c293 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:47.879249 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-06c51fe0-02f5-476f-bbc5-9861ce66c293 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:47.879788 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-06c51fe0-02f5-476f-bbc5-9861ce66c293 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:47.884368 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:15:47.975602 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-06c51fe0-02f5-476f-bbc5-9861ce66c293 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:47.988430 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-06c51fe0-02f5-476f-bbc5-9861ce66c293 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/09d9f6e6-fcc6-4175-9fd5-ec91a502afb3" status: 200 len: 1188 microversion: 2.1 time: 0.124156 Oct 18 16:15:47.989254 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3231/6439] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:47 2022] GET /compute/v2.1/servers/09d9f6e6-fcc6-4175-9fd5-ec91a502afb3 => generated 1188 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:15:48.046274 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-48b85934-1d5b-45c6-9d18-d7bbe4e07016 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:48.050002 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:15:48.055856 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-48b85934-1d5b-45c6-9d18-d7bbe4e07016 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038" status: 200 len: 1694 microversion: 2.1 time: 0.202379 Oct 18 16:15:48.056456 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3209/6440] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:47 2022] GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038 => generated 1694 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:49.011315 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2f0c862f-c6e5-467f-9e7f-f9b75112f363 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:49.011843 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2f0c862f-c6e5-467f-9e7f-f9b75112f363 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 09d9f6e6-fcc6-4175-9fd5-ec91a502afb3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:49.018879 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2f0c862f-c6e5-467f-9e7f-f9b75112f363 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:49.019371 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2f0c862f-c6e5-467f-9e7f-f9b75112f363 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:49.019818 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2f0c862f-c6e5-467f-9e7f-f9b75112f363 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:49.020520 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2f0c862f-c6e5-467f-9e7f-f9b75112f363 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:49.021015 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2f0c862f-c6e5-467f-9e7f-f9b75112f363 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:49.021446 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2f0c862f-c6e5-467f-9e7f-f9b75112f363 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:49.079713 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-44277d7a-09f0-4865-9cff-882a1c74fd7c tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:49.080382 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-44277d7a-09f0-4865-9cff-882a1c74fd7c tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: dd096aa4-077a-4c95-a3cc-b40763f12038] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:49.089715 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2f0c862f-c6e5-467f-9e7f-f9b75112f363 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:49.095477 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44277d7a-09f0-4865-9cff-882a1c74fd7c tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:49.095887 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44277d7a-09f0-4865-9cff-882a1c74fd7c tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:49.096333 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44277d7a-09f0-4865-9cff-882a1c74fd7c tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:49.097091 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44277d7a-09f0-4865-9cff-882a1c74fd7c tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:49.097555 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44277d7a-09f0-4865-9cff-882a1c74fd7c tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:49.097990 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44277d7a-09f0-4865-9cff-882a1c74fd7c tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:49.099912 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2f0c862f-c6e5-467f-9e7f-f9b75112f363 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/09d9f6e6-fcc6-4175-9fd5-ec91a502afb3" status: 200 len: 1188 microversion: 2.1 time: 0.092629 Oct 18 16:15:49.100619 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3232/6441] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:49 2022] GET /compute/v2.1/servers/09d9f6e6-fcc6-4175-9fd5-ec91a502afb3 => generated 1188 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:49.248414 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-44277d7a-09f0-4865-9cff-882a1c74fd7c tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:49.256210 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-44277d7a-09f0-4865-9cff-882a1c74fd7c tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038" status: 200 len: 1694 microversion: 2.1 time: 0.180430 Oct 18 16:15:49.256773 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3210/6442] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:49 2022] GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038 => generated 1694 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:15:50.122463 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c29226e5-dcd9-48d4-adf1-cec5b851103c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:50.123087 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c29226e5-dcd9-48d4-adf1-cec5b851103c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 09d9f6e6-fcc6-4175-9fd5-ec91a502afb3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:50.130605 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c29226e5-dcd9-48d4-adf1-cec5b851103c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:50.131092 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c29226e5-dcd9-48d4-adf1-cec5b851103c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:50.131548 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c29226e5-dcd9-48d4-adf1-cec5b851103c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:50.132225 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c29226e5-dcd9-48d4-adf1-cec5b851103c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:50.132678 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c29226e5-dcd9-48d4-adf1-cec5b851103c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:50.133130 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c29226e5-dcd9-48d4-adf1-cec5b851103c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:50.195024 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c29226e5-dcd9-48d4-adf1-cec5b851103c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:50.202975 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c29226e5-dcd9-48d4-adf1-cec5b851103c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/09d9f6e6-fcc6-4175-9fd5-ec91a502afb3" status: 200 len: 1188 microversion: 2.1 time: 0.084478 Oct 18 16:15:50.203552 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3233/6443] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:50 2022] GET /compute/v2.1/servers/09d9f6e6-fcc6-4175-9fd5-ec91a502afb3 => generated 1188 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:50.279102 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-258040ec-7640-4df0-b4f2-8a74375f4bc3 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:50.279842 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-258040ec-7640-4df0-b4f2-8a74375f4bc3 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: dd096aa4-077a-4c95-a3cc-b40763f12038] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:50.286885 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-258040ec-7640-4df0-b4f2-8a74375f4bc3 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:50.287377 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-258040ec-7640-4df0-b4f2-8a74375f4bc3 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:50.287815 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-258040ec-7640-4df0-b4f2-8a74375f4bc3 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:50.288518 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-258040ec-7640-4df0-b4f2-8a74375f4bc3 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:50.289017 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-258040ec-7640-4df0-b4f2-8a74375f4bc3 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:50.289454 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-258040ec-7640-4df0-b4f2-8a74375f4bc3 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:50.425699 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-258040ec-7640-4df0-b4f2-8a74375f4bc3 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:50.434458 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-258040ec-7640-4df0-b4f2-8a74375f4bc3 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038" status: 200 len: 1694 microversion: 2.1 time: 0.159154 Oct 18 16:15:50.435061 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3211/6444] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:50 2022] GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038 => generated 1694 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:51.226858 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-dfb4afc3-0524-46d4-8298-8e63ccd8d80d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:51.227488 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-dfb4afc3-0524-46d4-8298-8e63ccd8d80d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 09d9f6e6-fcc6-4175-9fd5-ec91a502afb3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:51.234821 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dfb4afc3-0524-46d4-8298-8e63ccd8d80d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:51.235318 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dfb4afc3-0524-46d4-8298-8e63ccd8d80d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:51.235784 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dfb4afc3-0524-46d4-8298-8e63ccd8d80d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:51.236480 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dfb4afc3-0524-46d4-8298-8e63ccd8d80d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:51.236972 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dfb4afc3-0524-46d4-8298-8e63ccd8d80d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:51.237410 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dfb4afc3-0524-46d4-8298-8e63ccd8d80d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:51.304568 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-dfb4afc3-0524-46d4-8298-8e63ccd8d80d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:51.312583 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-dfb4afc3-0524-46d4-8298-8e63ccd8d80d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/09d9f6e6-fcc6-4175-9fd5-ec91a502afb3" status: 200 len: 1188 microversion: 2.1 time: 0.089849 Oct 18 16:15:51.313192 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3234/6445] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:51 2022] GET /compute/v2.1/servers/09d9f6e6-fcc6-4175-9fd5-ec91a502afb3 => generated 1188 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:51.459474 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e7cf8189-b675-415f-8a0e-a91d24ceee50 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:51.460134 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e7cf8189-b675-415f-8a0e-a91d24ceee50 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: dd096aa4-077a-4c95-a3cc-b40763f12038] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:51.467025 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7cf8189-b675-415f-8a0e-a91d24ceee50 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:51.467544 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7cf8189-b675-415f-8a0e-a91d24ceee50 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:51.467992 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7cf8189-b675-415f-8a0e-a91d24ceee50 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:51.468689 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7cf8189-b675-415f-8a0e-a91d24ceee50 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:51.469182 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7cf8189-b675-415f-8a0e-a91d24ceee50 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:51.469620 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7cf8189-b675-415f-8a0e-a91d24ceee50 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:51.601710 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e7cf8189-b675-415f-8a0e-a91d24ceee50 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:51.609408 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e7cf8189-b675-415f-8a0e-a91d24ceee50 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038" status: 200 len: 1694 microversion: 2.1 time: 0.153803 Oct 18 16:15:51.609995 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3212/6446] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:51 2022] GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038 => generated 1694 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:52.335279 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-785fe915-7d69-40a8-a154-96e3b98e13d6 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:52.335889 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-785fe915-7d69-40a8-a154-96e3b98e13d6 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 09d9f6e6-fcc6-4175-9fd5-ec91a502afb3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:52.342866 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-785fe915-7d69-40a8-a154-96e3b98e13d6 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:52.343341 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-785fe915-7d69-40a8-a154-96e3b98e13d6 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:52.343773 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-785fe915-7d69-40a8-a154-96e3b98e13d6 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:52.344460 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-785fe915-7d69-40a8-a154-96e3b98e13d6 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:52.344939 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-785fe915-7d69-40a8-a154-96e3b98e13d6 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:52.345851 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-785fe915-7d69-40a8-a154-96e3b98e13d6 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:52.358965 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-785fe915-7d69-40a8-a154-96e3b98e13d6 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] HTTP exception thrown: Instance 09d9f6e6-fcc6-4175-9fd5-ec91a502afb3 could not be found. Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-785fe915-7d69-40a8-a154-96e3b98e13d6 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Request method failure captured: Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/09d9f6e6-fcc6-4175-9fd5-ec91a502afb3 HTTP/1.1 Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTtEVF9uJ-JO9Xs31vnHSSsjSYlxrsUC5zmDUZwq19epJ_KRexhuRnv973VnMOHKUrtuEaLEal20PXz-3F2SqeQ_VcN02CwN6WkvucYcQaG_QXU6RKnbyMb6Baxa9c0pM4Y0eYUesqFYGvUA-9UWLfliXu3xhi5bS1_xU9JBCKzY9b2g Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: c05254b186b04c9cb9858f621938caca Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-TestVolumeBootPattern-1353957077 Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c05254b186b04c9cb9858f621938caca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c05254b186b04c9cb9858f621938caca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c05254b186b04c9cb9858f621938caca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c05254b186b04c9cb9858f621938caca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-TestVolumeBootPattern-1353957077 Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: c05254b186b04c9cb9858f621938caca Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-TestVolumeBootPattern-1353957077 Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-TestVolumeBootPattern-1353957077-project Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: b9f9ae9e929c416a9298499ab8694d37 Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-TestVolumeBootPattern-1353957077-project Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 09d9f6e6-fcc6-4175-9fd5-ec91a502afb3 could not be found. Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '09d9f6e6-fcc6-4175-9fd5-ec91a502afb3'} Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09d9f6e6-fcc6-4175-9fd5-ec91a502afb3 could not be found. Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09d9f6e6-fcc6-4175-9fd5-ec91a502afb3 could not be found. Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:15:52.360603 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:15:52.366274 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:15:52.366274 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:15:52.366274 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:15:52.366274 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:15:52.366274 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:15:52.366274 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09d9f6e6-fcc6-4175-9fd5-ec91a502afb3 could not be found. Oct 18 16:15:52.366274 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:15:52.366274 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-785fe915-7d69-40a8-a154-96e3b98e13d6 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Returning 404 to user: Instance 09d9f6e6-fcc6-4175-9fd5-ec91a502afb3 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:15:52.366274 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-785fe915-7d69-40a8-a154-96e3b98e13d6 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/09d9f6e6-fcc6-4175-9fd5-ec91a502afb3" status: 404 len: 111 microversion: 2.1 time: 0.031226 Oct 18 16:15:52.366274 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3235/6447] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:52 2022] GET /compute/v2.1/servers/09d9f6e6-fcc6-4175-9fd5-ec91a502afb3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:15:52.632891 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2d56b978-ef57-4ba2-81d0-e582bb4ee437 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:52.633416 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2d56b978-ef57-4ba2-81d0-e582bb4ee437 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: dd096aa4-077a-4c95-a3cc-b40763f12038] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:52.640292 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d56b978-ef57-4ba2-81d0-e582bb4ee437 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:52.640779 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d56b978-ef57-4ba2-81d0-e582bb4ee437 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:52.641258 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d56b978-ef57-4ba2-81d0-e582bb4ee437 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:52.642542 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d56b978-ef57-4ba2-81d0-e582bb4ee437 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:52.643146 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d56b978-ef57-4ba2-81d0-e582bb4ee437 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:52.643600 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d56b978-ef57-4ba2-81d0-e582bb4ee437 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:52.780949 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2d56b978-ef57-4ba2-81d0-e582bb4ee437 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:52.789400 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2d56b978-ef57-4ba2-81d0-e582bb4ee437 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038" status: 200 len: 1694 microversion: 2.1 time: 0.160565 Oct 18 16:15:52.789981 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3213/6448] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:52 2022] GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038 => generated 1694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:53.813232 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a3c6da27-2909-4751-b168-0dbd8ad5c355 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:53.814371 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a3c6da27-2909-4751-b168-0dbd8ad5c355 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: dd096aa4-077a-4c95-a3cc-b40763f12038] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:53.821507 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a3c6da27-2909-4751-b168-0dbd8ad5c355 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:53.822002 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a3c6da27-2909-4751-b168-0dbd8ad5c355 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:53.822444 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a3c6da27-2909-4751-b168-0dbd8ad5c355 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:53.823176 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a3c6da27-2909-4751-b168-0dbd8ad5c355 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:53.823638 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a3c6da27-2909-4751-b168-0dbd8ad5c355 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:53.824321 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a3c6da27-2909-4751-b168-0dbd8ad5c355 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:53.965909 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a3c6da27-2909-4751-b168-0dbd8ad5c355 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:53.973775 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a3c6da27-2909-4751-b168-0dbd8ad5c355 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038" status: 200 len: 1694 microversion: 2.1 time: 0.164651 Oct 18 16:15:53.974349 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3236/6449] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:53 2022] GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038 => generated 1694 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:54.998078 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bf318c81-93af-444d-b305-e92126d01d7e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:54.998724 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bf318c81-93af-444d-b305-e92126d01d7e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: dd096aa4-077a-4c95-a3cc-b40763f12038] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:55.007057 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf318c81-93af-444d-b305-e92126d01d7e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:55.007553 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf318c81-93af-444d-b305-e92126d01d7e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:55.007995 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf318c81-93af-444d-b305-e92126d01d7e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:55.008711 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf318c81-93af-444d-b305-e92126d01d7e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:55.009207 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf318c81-93af-444d-b305-e92126d01d7e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:55.009637 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf318c81-93af-444d-b305-e92126d01d7e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:55.151120 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bf318c81-93af-444d-b305-e92126d01d7e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:55.159705 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bf318c81-93af-444d-b305-e92126d01d7e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038" status: 200 len: 1694 microversion: 2.1 time: 0.165669 Oct 18 16:15:55.160284 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3214/6450] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:54 2022] GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038 => generated 1694 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:56.183995 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-27e55eca-d068-453e-ba9f-15faffa73150 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:56.184620 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-27e55eca-d068-453e-ba9f-15faffa73150 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: dd096aa4-077a-4c95-a3cc-b40763f12038] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:56.187939 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:15:56.194030 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-27e55eca-d068-453e-ba9f-15faffa73150 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:56.194552 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-27e55eca-d068-453e-ba9f-15faffa73150 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:56.194991 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-27e55eca-d068-453e-ba9f-15faffa73150 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:56.195687 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-27e55eca-d068-453e-ba9f-15faffa73150 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:56.196151 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-27e55eca-d068-453e-ba9f-15faffa73150 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:56.196572 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-27e55eca-d068-453e-ba9f-15faffa73150 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:56.339559 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-27e55eca-d068-453e-ba9f-15faffa73150 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:56.348900 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-27e55eca-d068-453e-ba9f-15faffa73150 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038" status: 200 len: 1694 microversion: 2.1 time: 0.168804 Oct 18 16:15:56.349499 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3237/6451] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:56 2022] GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038 => generated 1694 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:57.290115 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9ff3a3ff-1b5f-4129-8845-975d13d9c8cc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1065205796", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "dcf70614-544a-496d-ade7-1e821e3b5eb0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a0168786-8cd3-418a-9936-dae2a39b2080"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:15:57.301586 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:15:57.352497 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-9ff3a3ff-1b5f-4129-8845-975d13d9c8cc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] validate_networks() for [('a0168786-8cd3-418a-9936-dae2a39b2080', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 16:15:57.371407 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-14b37990-1578-445a-b32e-3f3db0798cfb tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:57.372023 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-14b37990-1578-445a-b32e-3f3db0798cfb tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: dd096aa4-077a-4c95-a3cc-b40763f12038] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:57.379397 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-14b37990-1578-445a-b32e-3f3db0798cfb tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:57.379936 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-14b37990-1578-445a-b32e-3f3db0798cfb tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:57.380380 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-14b37990-1578-445a-b32e-3f3db0798cfb tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:57.381103 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-14b37990-1578-445a-b32e-3f3db0798cfb tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:57.381557 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-14b37990-1578-445a-b32e-3f3db0798cfb tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:57.381986 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-14b37990-1578-445a-b32e-3f3db0798cfb tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:57.587160 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-14b37990-1578-445a-b32e-3f3db0798cfb tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:57.595982 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-14b37990-1578-445a-b32e-3f3db0798cfb tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038" status: 200 len: 1694 microversion: 2.1 time: 0.227914 Oct 18 16:15:57.596583 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3238/6452] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:57 2022] GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038 => generated 1694 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:15:57.883268 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9ff3a3ff-1b5f-4129-8845-975d13d9c8cc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:15:57.883693 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9ff3a3ff-1b5f-4129-8845-975d13d9c8cc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:15:57.884171 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9ff3a3ff-1b5f-4129-8845-975d13d9c8cc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:15:57.884607 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9ff3a3ff-1b5f-4129-8845-975d13d9c8cc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:15:57.885059 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9ff3a3ff-1b5f-4129-8845-975d13d9c8cc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:15:57.894531 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ff3a3ff-1b5f-4129-8845-975d13d9c8cc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:57.895018 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ff3a3ff-1b5f-4129-8845-975d13d9c8cc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:57.895459 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ff3a3ff-1b5f-4129-8845-975d13d9c8cc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:57.896191 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ff3a3ff-1b5f-4129-8845-975d13d9c8cc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:57.896652 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ff3a3ff-1b5f-4129-8845-975d13d9c8cc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:57.897245 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ff3a3ff-1b5f-4129-8845-975d13d9c8cc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:57.914972 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-9ff3a3ff-1b5f-4129-8845-975d13d9c8cc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Getting quotas for project c05254b186b04c9cb9858f621938caca. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:15:57.920172 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-9ff3a3ff-1b5f-4129-8845-975d13d9c8cc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Getting quotas for user b9f9ae9e929c416a9298499ab8694d37 and project c05254b186b04c9cb9858f621938caca. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:15:57.977190 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9ff3a3ff-1b5f-4129-8845-975d13d9c8cc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:15:57.979296 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9ff3a3ff-1b5f-4129-8845-975d13d9c8cc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: ed39436c-d64c-4f91-9bbb-75a49bf60e09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dcf70614-544a-496d-ade7-1e821e3b5eb0',volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:15:58.110577 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9ff3a3ff-1b5f-4129-8845-975d13d9c8cc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.824497 Oct 18 16:15:58.111252 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3215/6453] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 16:15:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:15:58.122205 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a35bf6f6-bc95-4d95-864d-6b2007c36eb8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:58.122822 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a35bf6f6-bc95-4d95-864d-6b2007c36eb8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: ed39436c-d64c-4f91-9bbb-75a49bf60e09] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:58.179232 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a35bf6f6-bc95-4d95-864d-6b2007c36eb8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:58.186618 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a35bf6f6-bc95-4d95-864d-6b2007c36eb8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/ed39436c-d64c-4f91-9bbb-75a49bf60e09" status: 200 len: 1057 microversion: 2.1 time: 0.067991 Oct 18 16:15:58.187198 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3239/6454] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:58 2022] GET /compute/v2.1/servers/ed39436c-d64c-4f91-9bbb-75a49bf60e09 => generated 1057 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:58.620436 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-93f76fb8-8956-43b5-8973-efd622ac2673 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:58.621087 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-93f76fb8-8956-43b5-8973-efd622ac2673 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: dd096aa4-077a-4c95-a3cc-b40763f12038] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:58.627835 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-93f76fb8-8956-43b5-8973-efd622ac2673 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:58.628385 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-93f76fb8-8956-43b5-8973-efd622ac2673 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:58.628737 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-93f76fb8-8956-43b5-8973-efd622ac2673 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:58.629457 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-93f76fb8-8956-43b5-8973-efd622ac2673 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:58.629907 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-93f76fb8-8956-43b5-8973-efd622ac2673 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:58.630332 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-93f76fb8-8956-43b5-8973-efd622ac2673 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:58.769199 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-93f76fb8-8956-43b5-8973-efd622ac2673 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:58.777252 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-93f76fb8-8956-43b5-8973-efd622ac2673 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038" status: 200 len: 1700 microversion: 2.1 time: 0.161479 Oct 18 16:15:58.777767 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3216/6455] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:58 2022] GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038 => generated 1700 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:59.209641 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d4eb5ed4-dda1-4f82-8eaf-694f7033111f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:59.210335 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d4eb5ed4-dda1-4f82-8eaf-694f7033111f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: ed39436c-d64c-4f91-9bbb-75a49bf60e09] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:59.218110 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4eb5ed4-dda1-4f82-8eaf-694f7033111f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:59.218610 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4eb5ed4-dda1-4f82-8eaf-694f7033111f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:59.219056 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4eb5ed4-dda1-4f82-8eaf-694f7033111f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:59.219768 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4eb5ed4-dda1-4f82-8eaf-694f7033111f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:59.220726 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4eb5ed4-dda1-4f82-8eaf-694f7033111f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:59.221190 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4eb5ed4-dda1-4f82-8eaf-694f7033111f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:59.301171 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d4eb5ed4-dda1-4f82-8eaf-694f7033111f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:15:59.309501 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d4eb5ed4-dda1-4f82-8eaf-694f7033111f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/ed39436c-d64c-4f91-9bbb-75a49bf60e09" status: 200 len: 1173 microversion: 2.1 time: 0.103973 Oct 18 16:15:59.313309 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3240/6456] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:59 2022] GET /compute/v2.1/servers/ed39436c-d64c-4f91-9bbb-75a49bf60e09 => generated 1173 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:15:59.802756 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3c8b6a85-6697-479d-9c5e-6b34964ddeee tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:15:59.804360 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3c8b6a85-6697-479d-9c5e-6b34964ddeee tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: dd096aa4-077a-4c95-a3cc-b40763f12038] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:15:59.810572 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c8b6a85-6697-479d-9c5e-6b34964ddeee tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:59.811350 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c8b6a85-6697-479d-9c5e-6b34964ddeee tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:59.811790 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c8b6a85-6697-479d-9c5e-6b34964ddeee tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:15:59.812497 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c8b6a85-6697-479d-9c5e-6b34964ddeee tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:15:59.812986 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c8b6a85-6697-479d-9c5e-6b34964ddeee tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:15:59.813566 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c8b6a85-6697-479d-9c5e-6b34964ddeee tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:00.043394 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3c8b6a85-6697-479d-9c5e-6b34964ddeee tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:00.058292 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3c8b6a85-6697-479d-9c5e-6b34964ddeee tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038" status: 200 len: 1700 microversion: 2.1 time: 0.261610 Oct 18 16:16:00.058903 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3217/6457] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:15:59 2022] GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038 => generated 1700 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:00.332309 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3273855a-c79e-4e7b-913a-8773c90215b4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:00.333676 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3273855a-c79e-4e7b-913a-8773c90215b4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: ed39436c-d64c-4f91-9bbb-75a49bf60e09] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:00.348968 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3273855a-c79e-4e7b-913a-8773c90215b4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:00.349471 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3273855a-c79e-4e7b-913a-8773c90215b4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:00.349951 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3273855a-c79e-4e7b-913a-8773c90215b4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:00.350668 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3273855a-c79e-4e7b-913a-8773c90215b4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:00.351128 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3273855a-c79e-4e7b-913a-8773c90215b4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:00.351560 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3273855a-c79e-4e7b-913a-8773c90215b4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:00.550839 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3273855a-c79e-4e7b-913a-8773c90215b4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:00.559423 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3273855a-c79e-4e7b-913a-8773c90215b4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/ed39436c-d64c-4f91-9bbb-75a49bf60e09" status: 200 len: 1215 microversion: 2.1 time: 0.231751 Oct 18 16:16:00.560238 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3241/6458] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:00 2022] GET /compute/v2.1/servers/ed39436c-d64c-4f91-9bbb-75a49bf60e09 => generated 1215 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:00.660333 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-50db009f-4010-489a-aed0-b16d4206ee08 req-64ba44cc-f5a2-4195-ab17-83dba3229342 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed39436c-d64c-4f91-9bbb-75a49bf60e09", "tag": "3bb39753-2b7e-444e-ae5e-a8117f7f173f"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:16:00.685181 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-50db009f-4010-489a-aed0-b16d4206ee08 req-64ba44cc-f5a2-4195-ab17-83dba3229342 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:00.685949 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-50db009f-4010-489a-aed0-b16d4206ee08 req-64ba44cc-f5a2-4195-ab17-83dba3229342 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:00.686546 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-50db009f-4010-489a-aed0-b16d4206ee08 req-64ba44cc-f5a2-4195-ab17-83dba3229342 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:00.704442 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-50db009f-4010-489a-aed0-b16d4206ee08 req-64ba44cc-f5a2-4195-ab17-83dba3229342 service nova] Creating event network-changed:3bb39753-2b7e-444e-ae5e-a8117f7f173f for instance ed39436c-d64c-4f91-9bbb-75a49bf60e09 on n-h2-853682-5 Oct 18 16:16:00.710632 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-50db009f-4010-489a-aed0-b16d4206ee08 req-64ba44cc-f5a2-4195-ab17-83dba3229342 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054024 Oct 18 16:16:00.711835 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3218/6459] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:16:01.082041 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6ee16662-8a28-4d4c-9f3d-33a40db1acb3 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:01.082658 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6ee16662-8a28-4d4c-9f3d-33a40db1acb3 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: dd096aa4-077a-4c95-a3cc-b40763f12038] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:01.088990 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ee16662-8a28-4d4c-9f3d-33a40db1acb3 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:01.089700 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ee16662-8a28-4d4c-9f3d-33a40db1acb3 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:01.090147 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ee16662-8a28-4d4c-9f3d-33a40db1acb3 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:01.090846 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ee16662-8a28-4d4c-9f3d-33a40db1acb3 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:01.091468 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ee16662-8a28-4d4c-9f3d-33a40db1acb3 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:01.091896 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ee16662-8a28-4d4c-9f3d-33a40db1acb3 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:01.323553 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6ee16662-8a28-4d4c-9f3d-33a40db1acb3 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:01.331737 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6ee16662-8a28-4d4c-9f3d-33a40db1acb3 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038" status: 200 len: 1700 microversion: 2.1 time: 0.253587 Oct 18 16:16:01.332598 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3242/6460] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:01 2022] GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038 => generated 1700 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:01.584186 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8e4662ac-4c78-4115-a32c-2fc8b314cfac tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:01.584930 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8e4662ac-4c78-4115-a32c-2fc8b314cfac tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: ed39436c-d64c-4f91-9bbb-75a49bf60e09] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:01.592276 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e4662ac-4c78-4115-a32c-2fc8b314cfac tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:01.592772 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e4662ac-4c78-4115-a32c-2fc8b314cfac tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:01.593238 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e4662ac-4c78-4115-a32c-2fc8b314cfac tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:01.593944 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e4662ac-4c78-4115-a32c-2fc8b314cfac tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:01.594409 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e4662ac-4c78-4115-a32c-2fc8b314cfac tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:01.594840 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e4662ac-4c78-4115-a32c-2fc8b314cfac tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:01.814601 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8e4662ac-4c78-4115-a32c-2fc8b314cfac tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:01.832455 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8e4662ac-4c78-4115-a32c-2fc8b314cfac tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/ed39436c-d64c-4f91-9bbb-75a49bf60e09" status: 200 len: 1215 microversion: 2.1 time: 0.253129 Oct 18 16:16:01.833094 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3219/6461] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:01 2022] GET /compute/v2.1/servers/ed39436c-d64c-4f91-9bbb-75a49bf60e09 => generated 1215 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:02.355585 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ee7632a5-966b-42cf-a28f-b1affc6e1ef5 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:02.356264 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ee7632a5-966b-42cf-a28f-b1affc6e1ef5 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: dd096aa4-077a-4c95-a3cc-b40763f12038] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:02.363723 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ee7632a5-966b-42cf-a28f-b1affc6e1ef5 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:02.364208 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ee7632a5-966b-42cf-a28f-b1affc6e1ef5 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:02.364644 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ee7632a5-966b-42cf-a28f-b1affc6e1ef5 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:02.365370 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ee7632a5-966b-42cf-a28f-b1affc6e1ef5 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:02.365824 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ee7632a5-966b-42cf-a28f-b1affc6e1ef5 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:02.366246 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ee7632a5-966b-42cf-a28f-b1affc6e1ef5 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:02.501871 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ee7632a5-966b-42cf-a28f-b1affc6e1ef5 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:02.509988 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ee7632a5-966b-42cf-a28f-b1affc6e1ef5 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038" status: 200 len: 1700 microversion: 2.1 time: 0.158281 Oct 18 16:16:02.510583 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3243/6462] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:02 2022] GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038 => generated 1700 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:02.856703 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-70c49d6f-ef97-475e-8555-2d1fbf672078 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:02.857569 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-70c49d6f-ef97-475e-8555-2d1fbf672078 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: ed39436c-d64c-4f91-9bbb-75a49bf60e09] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:02.864867 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70c49d6f-ef97-475e-8555-2d1fbf672078 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:02.865528 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70c49d6f-ef97-475e-8555-2d1fbf672078 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:02.866087 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70c49d6f-ef97-475e-8555-2d1fbf672078 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:02.866896 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70c49d6f-ef97-475e-8555-2d1fbf672078 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:02.867455 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70c49d6f-ef97-475e-8555-2d1fbf672078 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:02.867987 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70c49d6f-ef97-475e-8555-2d1fbf672078 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:03.076983 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-70c49d6f-ef97-475e-8555-2d1fbf672078 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:03.087501 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-70c49d6f-ef97-475e-8555-2d1fbf672078 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/ed39436c-d64c-4f91-9bbb-75a49bf60e09" status: 200 len: 1215 microversion: 2.1 time: 0.235621 Oct 18 16:16:03.102794 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3220/6463] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:02 2022] GET /compute/v2.1/servers/ed39436c-d64c-4f91-9bbb-75a49bf60e09 => generated 1215 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:03.221520 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-e6a59584-97ee-4a1f-b2ae-393336ef1a6f req-2027c895-a49e-4262-890c-af9c04591072 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd096aa4-077a-4c95-a3cc-b40763f12038", "name": "network-vif-unplugged", "status": "completed", "tag": "2434ee98-2bbe-49a4-94c0-636c1699cc12"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:16:03.231774 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-e6a59584-97ee-4a1f-b2ae-393336ef1a6f req-2027c895-a49e-4262-890c-af9c04591072 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:03.232269 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-e6a59584-97ee-4a1f-b2ae-393336ef1a6f req-2027c895-a49e-4262-890c-af9c04591072 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:03.232914 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-e6a59584-97ee-4a1f-b2ae-393336ef1a6f req-2027c895-a49e-4262-890c-af9c04591072 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:03.247606 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-e6a59584-97ee-4a1f-b2ae-393336ef1a6f req-2027c895-a49e-4262-890c-af9c04591072 service nova] Creating event network-vif-unplugged:2434ee98-2bbe-49a4-94c0-636c1699cc12 for instance dd096aa4-077a-4c95-a3cc-b40763f12038 on n-h1-853682-5 Oct 18 16:16:03.253931 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-e6a59584-97ee-4a1f-b2ae-393336ef1a6f req-2027c895-a49e-4262-890c-af9c04591072 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036029 Oct 18 16:16:03.254889 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3244/6464] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:16:03.535184 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-49464368-1601-48fb-a378-ebf888c3a663 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:03.535887 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-49464368-1601-48fb-a378-ebf888c3a663 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: dd096aa4-077a-4c95-a3cc-b40763f12038] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:03.542621 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49464368-1601-48fb-a378-ebf888c3a663 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:03.543250 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49464368-1601-48fb-a378-ebf888c3a663 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:03.543486 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49464368-1601-48fb-a378-ebf888c3a663 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:03.544218 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49464368-1601-48fb-a378-ebf888c3a663 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:03.544682 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49464368-1601-48fb-a378-ebf888c3a663 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:03.545147 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49464368-1601-48fb-a378-ebf888c3a663 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:03.799601 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-49464368-1601-48fb-a378-ebf888c3a663 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:03.815800 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-49464368-1601-48fb-a378-ebf888c3a663 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038" status: 200 len: 1685 microversion: 2.1 time: 0.285248 Oct 18 16:16:03.816642 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3221/6465] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:03 2022] GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038 => generated 1685 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:04.115138 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e3a40163-9ac4-49ea-a0a5-45d2841d5f85 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:04.115839 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e3a40163-9ac4-49ea-a0a5-45d2841d5f85 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: ed39436c-d64c-4f91-9bbb-75a49bf60e09] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:04.122160 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e3a40163-9ac4-49ea-a0a5-45d2841d5f85 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:04.122643 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e3a40163-9ac4-49ea-a0a5-45d2841d5f85 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:04.123178 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e3a40163-9ac4-49ea-a0a5-45d2841d5f85 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:04.123870 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e3a40163-9ac4-49ea-a0a5-45d2841d5f85 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:04.124405 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e3a40163-9ac4-49ea-a0a5-45d2841d5f85 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:04.124857 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e3a40163-9ac4-49ea-a0a5-45d2841d5f85 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:04.265631 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e3a40163-9ac4-49ea-a0a5-45d2841d5f85 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:04.274300 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e3a40163-9ac4-49ea-a0a5-45d2841d5f85 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/ed39436c-d64c-4f91-9bbb-75a49bf60e09" status: 200 len: 1215 microversion: 2.1 time: 0.164663 Oct 18 16:16:04.274880 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3245/6466] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:04 2022] GET /compute/v2.1/servers/ed39436c-d64c-4f91-9bbb-75a49bf60e09 => generated 1215 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:05.287364 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-1e2cafff-c138-4213-9f07-c4a3fe5214e9 req-e7a3dd00-04ca-43a9-8c41-17f2b4865be6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd096aa4-077a-4c95-a3cc-b40763f12038", "name": "network-vif-plugged", "status": "completed", "tag": "2434ee98-2bbe-49a4-94c0-636c1699cc12"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:16:05.297009 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-51a73d46-104a-423e-b96c-e57330febe26 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:05.297647 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-51a73d46-104a-423e-b96c-e57330febe26 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: ed39436c-d64c-4f91-9bbb-75a49bf60e09] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:05.297835 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1e2cafff-c138-4213-9f07-c4a3fe5214e9 req-e7a3dd00-04ca-43a9-8c41-17f2b4865be6 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:05.298264 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1e2cafff-c138-4213-9f07-c4a3fe5214e9 req-e7a3dd00-04ca-43a9-8c41-17f2b4865be6 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:05.298703 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1e2cafff-c138-4213-9f07-c4a3fe5214e9 req-e7a3dd00-04ca-43a9-8c41-17f2b4865be6 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:05.304788 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-51a73d46-104a-423e-b96c-e57330febe26 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:05.305367 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-51a73d46-104a-423e-b96c-e57330febe26 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:05.305873 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-51a73d46-104a-423e-b96c-e57330febe26 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:05.306659 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-51a73d46-104a-423e-b96c-e57330febe26 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:05.307184 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-51a73d46-104a-423e-b96c-e57330febe26 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:05.307677 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-51a73d46-104a-423e-b96c-e57330febe26 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:05.310528 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-1e2cafff-c138-4213-9f07-c4a3fe5214e9 req-e7a3dd00-04ca-43a9-8c41-17f2b4865be6 service nova] Creating event network-vif-plugged:2434ee98-2bbe-49a4-94c0-636c1699cc12 for instance dd096aa4-077a-4c95-a3cc-b40763f12038 on n-h1-853682-5 Oct 18 16:16:05.316040 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-1e2cafff-c138-4213-9f07-c4a3fe5214e9 req-e7a3dd00-04ca-43a9-8c41-17f2b4865be6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033137 Oct 18 16:16:05.316654 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3222/6467] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:16:05.444429 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-51a73d46-104a-423e-b96c-e57330febe26 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:05.452287 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-51a73d46-104a-423e-b96c-e57330febe26 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/ed39436c-d64c-4f91-9bbb-75a49bf60e09" status: 200 len: 1203 microversion: 2.1 time: 0.159159 Oct 18 16:16:05.452884 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3246/6468] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:05 2022] GET /compute/v2.1/servers/ed39436c-d64c-4f91-9bbb-75a49bf60e09 => generated 1203 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:16:06.476418 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a1c38c44-bc12-4f14-bb81-5e5f021ab059 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:06.477156 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a1c38c44-bc12-4f14-bb81-5e5f021ab059 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: ed39436c-d64c-4f91-9bbb-75a49bf60e09] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:06.483428 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1c38c44-bc12-4f14-bb81-5e5f021ab059 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:06.483916 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1c38c44-bc12-4f14-bb81-5e5f021ab059 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:06.484356 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1c38c44-bc12-4f14-bb81-5e5f021ab059 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:06.485076 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1c38c44-bc12-4f14-bb81-5e5f021ab059 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:06.485567 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1c38c44-bc12-4f14-bb81-5e5f021ab059 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:06.485999 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1c38c44-bc12-4f14-bb81-5e5f021ab059 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:06.619422 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a1c38c44-bc12-4f14-bb81-5e5f021ab059 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:06.628031 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a1c38c44-bc12-4f14-bb81-5e5f021ab059 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/ed39436c-d64c-4f91-9bbb-75a49bf60e09" status: 200 len: 1203 microversion: 2.1 time: 0.156890 Oct 18 16:16:06.628614 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3223/6469] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:06 2022] GET /compute/v2.1/servers/ed39436c-d64c-4f91-9bbb-75a49bf60e09 => generated 1203 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:07.650896 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-020970ce-378a-4928-a286-a07c8db8343e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:07.651516 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-020970ce-378a-4928-a286-a07c8db8343e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: ed39436c-d64c-4f91-9bbb-75a49bf60e09] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:07.659137 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-020970ce-378a-4928-a286-a07c8db8343e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:07.659615 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-020970ce-378a-4928-a286-a07c8db8343e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:07.660052 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-020970ce-378a-4928-a286-a07c8db8343e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:07.660773 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-020970ce-378a-4928-a286-a07c8db8343e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:07.661227 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-020970ce-378a-4928-a286-a07c8db8343e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:07.661649 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-020970ce-378a-4928-a286-a07c8db8343e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:07.791157 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-020970ce-378a-4928-a286-a07c8db8343e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:07.799028 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-020970ce-378a-4928-a286-a07c8db8343e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/ed39436c-d64c-4f91-9bbb-75a49bf60e09" status: 200 len: 1203 microversion: 2.1 time: 0.152044 Oct 18 16:16:07.799609 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3247/6470] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:07 2022] GET /compute/v2.1/servers/ed39436c-d64c-4f91-9bbb-75a49bf60e09 => generated 1203 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:08.822312 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-51e47b03-a4b6-4cb6-b660-5de8de213c24 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:08.822935 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-51e47b03-a4b6-4cb6-b660-5de8de213c24 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: ed39436c-d64c-4f91-9bbb-75a49bf60e09] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:08.825777 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:08.826454 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:08.832281 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51e47b03-a4b6-4cb6-b660-5de8de213c24 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:08.832768 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51e47b03-a4b6-4cb6-b660-5de8de213c24 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:08.833241 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51e47b03-a4b6-4cb6-b660-5de8de213c24 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:08.833936 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51e47b03-a4b6-4cb6-b660-5de8de213c24 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:08.834395 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51e47b03-a4b6-4cb6-b660-5de8de213c24 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:08.834822 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51e47b03-a4b6-4cb6-b660-5de8de213c24 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:08.971863 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-51e47b03-a4b6-4cb6-b660-5de8de213c24 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:08.979560 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-51e47b03-a4b6-4cb6-b660-5de8de213c24 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/ed39436c-d64c-4f91-9bbb-75a49bf60e09" status: 200 len: 1203 microversion: 2.1 time: 0.161165 Oct 18 16:16:08.980133 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3224/6471] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:08 2022] GET /compute/v2.1/servers/ed39436c-d64c-4f91-9bbb-75a49bf60e09 => generated 1203 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:10.002978 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4c907aa1-2f2c-46c1-8f2d-ab7f229e9724 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:10.003512 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4c907aa1-2f2c-46c1-8f2d-ab7f229e9724 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: ed39436c-d64c-4f91-9bbb-75a49bf60e09] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:10.005541 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:10.011957 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4c907aa1-2f2c-46c1-8f2d-ab7f229e9724 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:10.012443 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4c907aa1-2f2c-46c1-8f2d-ab7f229e9724 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:10.012937 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4c907aa1-2f2c-46c1-8f2d-ab7f229e9724 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:10.013636 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4c907aa1-2f2c-46c1-8f2d-ab7f229e9724 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:10.014095 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4c907aa1-2f2c-46c1-8f2d-ab7f229e9724 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:10.014524 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4c907aa1-2f2c-46c1-8f2d-ab7f229e9724 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:10.143431 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4c907aa1-2f2c-46c1-8f2d-ab7f229e9724 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:10.151335 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4c907aa1-2f2c-46c1-8f2d-ab7f229e9724 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/ed39436c-d64c-4f91-9bbb-75a49bf60e09" status: 200 len: 1203 microversion: 2.1 time: 0.152930 Oct 18 16:16:10.151910 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3248/6472] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:09 2022] GET /compute/v2.1/servers/ed39436c-d64c-4f91-9bbb-75a49bf60e09 => generated 1203 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:11.174535 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-be67aa5f-afe5-4879-8689-4c3cd8ed65e0 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:11.175157 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-be67aa5f-afe5-4879-8689-4c3cd8ed65e0 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: ed39436c-d64c-4f91-9bbb-75a49bf60e09] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:11.182471 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be67aa5f-afe5-4879-8689-4c3cd8ed65e0 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:11.182958 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be67aa5f-afe5-4879-8689-4c3cd8ed65e0 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:11.183396 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be67aa5f-afe5-4879-8689-4c3cd8ed65e0 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:11.184086 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be67aa5f-afe5-4879-8689-4c3cd8ed65e0 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:11.184541 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be67aa5f-afe5-4879-8689-4c3cd8ed65e0 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:11.185001 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be67aa5f-afe5-4879-8689-4c3cd8ed65e0 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:11.319646 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-be67aa5f-afe5-4879-8689-4c3cd8ed65e0 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:11.327432 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-be67aa5f-afe5-4879-8689-4c3cd8ed65e0 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/ed39436c-d64c-4f91-9bbb-75a49bf60e09" status: 200 len: 1203 microversion: 2.1 time: 0.156945 Oct 18 16:16:11.328001 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3225/6473] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:11 2022] GET /compute/v2.1/servers/ed39436c-d64c-4f91-9bbb-75a49bf60e09 => generated 1203 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:12.350838 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3ef009e4-0eda-4e29-b5b1-c517c714f12f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:12.351449 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3ef009e4-0eda-4e29-b5b1-c517c714f12f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: ed39436c-d64c-4f91-9bbb-75a49bf60e09] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:12.358300 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ef009e4-0eda-4e29-b5b1-c517c714f12f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:12.358775 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ef009e4-0eda-4e29-b5b1-c517c714f12f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:12.359207 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ef009e4-0eda-4e29-b5b1-c517c714f12f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:12.359887 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ef009e4-0eda-4e29-b5b1-c517c714f12f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:12.360337 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ef009e4-0eda-4e29-b5b1-c517c714f12f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:12.360757 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ef009e4-0eda-4e29-b5b1-c517c714f12f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:12.488579 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3ef009e4-0eda-4e29-b5b1-c517c714f12f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:12.496427 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3ef009e4-0eda-4e29-b5b1-c517c714f12f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/ed39436c-d64c-4f91-9bbb-75a49bf60e09" status: 200 len: 1203 microversion: 2.1 time: 0.149571 Oct 18 16:16:12.497027 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3249/6474] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:12 2022] GET /compute/v2.1/servers/ed39436c-d64c-4f91-9bbb-75a49bf60e09 => generated 1203 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:13.519514 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2b8aa893-b0f7-4a9e-a2a2-6d15c6223f9e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:13.520140 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2b8aa893-b0f7-4a9e-a2a2-6d15c6223f9e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: ed39436c-d64c-4f91-9bbb-75a49bf60e09] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:13.527255 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b8aa893-b0f7-4a9e-a2a2-6d15c6223f9e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:13.527740 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b8aa893-b0f7-4a9e-a2a2-6d15c6223f9e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:13.528184 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b8aa893-b0f7-4a9e-a2a2-6d15c6223f9e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:13.528914 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b8aa893-b0f7-4a9e-a2a2-6d15c6223f9e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:13.529376 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b8aa893-b0f7-4a9e-a2a2-6d15c6223f9e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:13.529805 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b8aa893-b0f7-4a9e-a2a2-6d15c6223f9e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:13.657033 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2b8aa893-b0f7-4a9e-a2a2-6d15c6223f9e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:13.664784 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2b8aa893-b0f7-4a9e-a2a2-6d15c6223f9e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/ed39436c-d64c-4f91-9bbb-75a49bf60e09" status: 200 len: 1203 microversion: 2.1 time: 0.149288 Oct 18 16:16:13.665385 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3226/6475] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:13 2022] GET /compute/v2.1/servers/ed39436c-d64c-4f91-9bbb-75a49bf60e09 => generated 1203 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:14.687656 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bc58266e-03d9-4d2a-9f5b-7ea4e3bc2181 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:14.688431 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-bc58266e-03d9-4d2a-9f5b-7ea4e3bc2181 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: ed39436c-d64c-4f91-9bbb-75a49bf60e09] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:14.696613 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bc58266e-03d9-4d2a-9f5b-7ea4e3bc2181 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:14.697134 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bc58266e-03d9-4d2a-9f5b-7ea4e3bc2181 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:14.697629 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bc58266e-03d9-4d2a-9f5b-7ea4e3bc2181 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:14.698289 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bc58266e-03d9-4d2a-9f5b-7ea4e3bc2181 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:14.698747 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bc58266e-03d9-4d2a-9f5b-7ea4e3bc2181 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:14.699181 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bc58266e-03d9-4d2a-9f5b-7ea4e3bc2181 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:14.703492 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=100 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:14.761994 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-5a60a44c-5a30-4dd6-86b8-097b8d2bfd42 req-0ed07c08-cbba-4c44-b3a3-ce3c9d5f58e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed39436c-d64c-4f91-9bbb-75a49bf60e09", "name": "network-vif-plugged", "status": "completed", "tag": "3bb39753-2b7e-444e-ae5e-a8117f7f173f"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:16:14.773669 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5a60a44c-5a30-4dd6-86b8-097b8d2bfd42 req-0ed07c08-cbba-4c44-b3a3-ce3c9d5f58e1 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:14.774317 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5a60a44c-5a30-4dd6-86b8-097b8d2bfd42 req-0ed07c08-cbba-4c44-b3a3-ce3c9d5f58e1 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:14.774824 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5a60a44c-5a30-4dd6-86b8-097b8d2bfd42 req-0ed07c08-cbba-4c44-b3a3-ce3c9d5f58e1 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:14.787807 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-5a60a44c-5a30-4dd6-86b8-097b8d2bfd42 req-0ed07c08-cbba-4c44-b3a3-ce3c9d5f58e1 service nova] Creating event network-vif-plugged:3bb39753-2b7e-444e-ae5e-a8117f7f173f for instance ed39436c-d64c-4f91-9bbb-75a49bf60e09 on n-h2-853682-5 Oct 18 16:16:14.793519 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-5a60a44c-5a30-4dd6-86b8-097b8d2bfd42 req-0ed07c08-cbba-4c44-b3a3-ce3c9d5f58e1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035564 Oct 18 16:16:14.794141 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3227/6476] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:16:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:16:14.860606 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-bc58266e-03d9-4d2a-9f5b-7ea4e3bc2181 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:14.868703 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-bc58266e-03d9-4d2a-9f5b-7ea4e3bc2181 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/ed39436c-d64c-4f91-9bbb-75a49bf60e09" status: 200 len: 1203 microversion: 2.1 time: 0.185091 Oct 18 16:16:14.869454 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3250/6477] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:14 2022] GET /compute/v2.1/servers/ed39436c-d64c-4f91-9bbb-75a49bf60e09 => generated 1203 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:15.893295 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d7ca401e-1c5a-4a5b-886c-193e02ce4852 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:15.894309 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d7ca401e-1c5a-4a5b-886c-193e02ce4852 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: ed39436c-d64c-4f91-9bbb-75a49bf60e09] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:15.901480 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d7ca401e-1c5a-4a5b-886c-193e02ce4852 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:15.902318 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d7ca401e-1c5a-4a5b-886c-193e02ce4852 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:15.903067 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d7ca401e-1c5a-4a5b-886c-193e02ce4852 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:15.904421 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d7ca401e-1c5a-4a5b-886c-193e02ce4852 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:15.905123 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d7ca401e-1c5a-4a5b-886c-193e02ce4852 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:15.905561 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d7ca401e-1c5a-4a5b-886c-193e02ce4852 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:16.049289 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d7ca401e-1c5a-4a5b-886c-193e02ce4852 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:16.058268 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d7ca401e-1c5a-4a5b-886c-193e02ce4852 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/ed39436c-d64c-4f91-9bbb-75a49bf60e09" status: 200 len: 1390 microversion: 2.1 time: 0.170081 Oct 18 16:16:16.058955 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3228/6478] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:15 2022] GET /compute/v2.1/servers/ed39436c-d64c-4f91-9bbb-75a49bf60e09 => generated 1390 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:16.082074 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e122ae05-28ba-47b8-a446-e07daa59a298 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:16.082744 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e122ae05-28ba-47b8-a446-e07daa59a298 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: ed39436c-d64c-4f91-9bbb-75a49bf60e09] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:16.089847 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e122ae05-28ba-47b8-a446-e07daa59a298 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:16.090332 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e122ae05-28ba-47b8-a446-e07daa59a298 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:16.090769 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e122ae05-28ba-47b8-a446-e07daa59a298 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:16.091476 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e122ae05-28ba-47b8-a446-e07daa59a298 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:16.091926 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e122ae05-28ba-47b8-a446-e07daa59a298 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:16.092355 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e122ae05-28ba-47b8-a446-e07daa59a298 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:16.224855 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e122ae05-28ba-47b8-a446-e07daa59a298 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:16.233238 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e122ae05-28ba-47b8-a446-e07daa59a298 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/ed39436c-d64c-4f91-9bbb-75a49bf60e09" status: 200 len: 1390 microversion: 2.1 time: 0.155113 Oct 18 16:16:16.233842 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3251/6479] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:16 2022] GET /compute/v2.1/servers/ed39436c-d64c-4f91-9bbb-75a49bf60e09 => generated 1390 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:16:16.255945 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-90a3a240-eb5d-4ff2-b705-c6171836ab89 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:16.256497 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-90a3a240-eb5d-4ff2-b705-c6171836ab89 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: ed39436c-d64c-4f91-9bbb-75a49bf60e09] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:16.263194 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90a3a240-eb5d-4ff2-b705-c6171836ab89 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:16.263693 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90a3a240-eb5d-4ff2-b705-c6171836ab89 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:16.264223 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90a3a240-eb5d-4ff2-b705-c6171836ab89 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:16.265010 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90a3a240-eb5d-4ff2-b705-c6171836ab89 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:16.265481 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90a3a240-eb5d-4ff2-b705-c6171836ab89 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:16.265914 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90a3a240-eb5d-4ff2-b705-c6171836ab89 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:16.270856 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:16.400499 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-90a3a240-eb5d-4ff2-b705-c6171836ab89 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:16.409436 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-90a3a240-eb5d-4ff2-b705-c6171836ab89 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/ed39436c-d64c-4f91-9bbb-75a49bf60e09" status: 200 len: 1390 microversion: 2.1 time: 0.157616 Oct 18 16:16:16.410028 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3229/6480] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:16 2022] GET /compute/v2.1/servers/ed39436c-d64c-4f91-9bbb-75a49bf60e09 => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:16.432052 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3e2483aa-296e-439d-8c9c-44b5eb23e1b4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:16.432548 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3e2483aa-296e-439d-8c9c-44b5eb23e1b4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: ed39436c-d64c-4f91-9bbb-75a49bf60e09] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:16.438620 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3e2483aa-296e-439d-8c9c-44b5eb23e1b4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:16.439099 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3e2483aa-296e-439d-8c9c-44b5eb23e1b4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:16.439612 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3e2483aa-296e-439d-8c9c-44b5eb23e1b4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:16.440309 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3e2483aa-296e-439d-8c9c-44b5eb23e1b4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:16.440763 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3e2483aa-296e-439d-8c9c-44b5eb23e1b4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:16.441217 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3e2483aa-296e-439d-8c9c-44b5eb23e1b4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:16.466156 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3e2483aa-296e-439d-8c9c-44b5eb23e1b4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: ed39436c-d64c-4f91-9bbb-75a49bf60e09] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:16:16.548402 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3e2483aa-296e-439d-8c9c-44b5eb23e1b4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ed39436c-d64c-4f91-9bbb-75a49bf60e09" status: 204 len: 0 microversion: 2.1 time: 0.120139 Oct 18 16:16:16.549214 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3252/6481] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 16:16:16 2022] DELETE /compute/v2.1/servers/ed39436c-d64c-4f91-9bbb-75a49bf60e09 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:16:16.558097 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b89b32b9-af04-4b33-8eaa-a58fdc02da3f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:16.558804 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b89b32b9-af04-4b33-8eaa-a58fdc02da3f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: ed39436c-d64c-4f91-9bbb-75a49bf60e09] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:16.565090 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b89b32b9-af04-4b33-8eaa-a58fdc02da3f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:16.565583 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b89b32b9-af04-4b33-8eaa-a58fdc02da3f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:16.566023 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b89b32b9-af04-4b33-8eaa-a58fdc02da3f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:16.566723 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b89b32b9-af04-4b33-8eaa-a58fdc02da3f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:16.567184 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b89b32b9-af04-4b33-8eaa-a58fdc02da3f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:16.567614 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b89b32b9-af04-4b33-8eaa-a58fdc02da3f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:16.708020 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b89b32b9-af04-4b33-8eaa-a58fdc02da3f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:16.715874 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b89b32b9-af04-4b33-8eaa-a58fdc02da3f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/ed39436c-d64c-4f91-9bbb-75a49bf60e09" status: 200 len: 1396 microversion: 2.1 time: 0.162230 Oct 18 16:16:16.716502 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3230/6482] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:16 2022] GET /compute/v2.1/servers/ed39436c-d64c-4f91-9bbb-75a49bf60e09 => generated 1396 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:16:17.743057 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6e125e49-49c4-4b05-af10-f303a5dd1449 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:17.743766 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6e125e49-49c4-4b05-af10-f303a5dd1449 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: ed39436c-d64c-4f91-9bbb-75a49bf60e09] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:17.750739 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6e125e49-49c4-4b05-af10-f303a5dd1449 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:17.751223 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6e125e49-49c4-4b05-af10-f303a5dd1449 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:17.751658 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6e125e49-49c4-4b05-af10-f303a5dd1449 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:17.752885 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6e125e49-49c4-4b05-af10-f303a5dd1449 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:17.753344 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6e125e49-49c4-4b05-af10-f303a5dd1449 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:17.753769 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6e125e49-49c4-4b05-af10-f303a5dd1449 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:17.883927 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6e125e49-49c4-4b05-af10-f303a5dd1449 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:17.891899 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6e125e49-49c4-4b05-af10-f303a5dd1449 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/ed39436c-d64c-4f91-9bbb-75a49bf60e09" status: 200 len: 1396 microversion: 2.1 time: 0.153247 Oct 18 16:16:17.892523 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3253/6483] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:17 2022] GET /compute/v2.1/servers/ed39436c-d64c-4f91-9bbb-75a49bf60e09 => generated 1396 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:18.463132 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-d58a9f93-c55e-4531-a8b3-7f60a7a2a98a req-35da811d-df04-418a-8dcd-2a41ee010304 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed39436c-d64c-4f91-9bbb-75a49bf60e09", "name": "network-vif-deleted", "tag": "3bb39753-2b7e-444e-ae5e-a8117f7f173f"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:16:18.476909 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d58a9f93-c55e-4531-a8b3-7f60a7a2a98a req-35da811d-df04-418a-8dcd-2a41ee010304 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:18.477495 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d58a9f93-c55e-4531-a8b3-7f60a7a2a98a req-35da811d-df04-418a-8dcd-2a41ee010304 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:18.478030 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d58a9f93-c55e-4531-a8b3-7f60a7a2a98a req-35da811d-df04-418a-8dcd-2a41ee010304 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:18.493051 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-d58a9f93-c55e-4531-a8b3-7f60a7a2a98a req-35da811d-df04-418a-8dcd-2a41ee010304 service nova] Creating event network-vif-deleted:3bb39753-2b7e-444e-ae5e-a8117f7f173f for instance ed39436c-d64c-4f91-9bbb-75a49bf60e09 on n-h2-853682-5 Oct 18 16:16:18.498702 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-d58a9f93-c55e-4531-a8b3-7f60a7a2a98a req-35da811d-df04-418a-8dcd-2a41ee010304 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039751 Oct 18 16:16:18.500119 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3231/6484] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:16:18.916133 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-aebcaa65-e827-4762-839b-cfeb4c7b2df8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:18.916768 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-aebcaa65-e827-4762-839b-cfeb4c7b2df8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: ed39436c-d64c-4f91-9bbb-75a49bf60e09] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:18.924224 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aebcaa65-e827-4762-839b-cfeb4c7b2df8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:18.924708 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aebcaa65-e827-4762-839b-cfeb4c7b2df8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:18.925215 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aebcaa65-e827-4762-839b-cfeb4c7b2df8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:18.925908 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aebcaa65-e827-4762-839b-cfeb4c7b2df8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:18.926724 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aebcaa65-e827-4762-839b-cfeb4c7b2df8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:18.927151 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aebcaa65-e827-4762-839b-cfeb4c7b2df8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:18.989892 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-aebcaa65-e827-4762-839b-cfeb4c7b2df8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:18.997772 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-aebcaa65-e827-4762-839b-cfeb4c7b2df8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/ed39436c-d64c-4f91-9bbb-75a49bf60e09" status: 200 len: 1188 microversion: 2.1 time: 0.085639 Oct 18 16:16:18.998341 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3254/6485] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:18 2022] GET /compute/v2.1/servers/ed39436c-d64c-4f91-9bbb-75a49bf60e09 => generated 1188 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:20.023053 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cc5bd9c4-bb2c-49ed-8d0a-0744f14b7178 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:20.024272 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cc5bd9c4-bb2c-49ed-8d0a-0744f14b7178 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: ed39436c-d64c-4f91-9bbb-75a49bf60e09] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:20.032142 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cc5bd9c4-bb2c-49ed-8d0a-0744f14b7178 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:20.032639 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cc5bd9c4-bb2c-49ed-8d0a-0744f14b7178 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:20.033643 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cc5bd9c4-bb2c-49ed-8d0a-0744f14b7178 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:20.034359 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cc5bd9c4-bb2c-49ed-8d0a-0744f14b7178 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:20.034824 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cc5bd9c4-bb2c-49ed-8d0a-0744f14b7178 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:20.035670 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cc5bd9c4-bb2c-49ed-8d0a-0744f14b7178 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:20.106879 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cc5bd9c4-bb2c-49ed-8d0a-0744f14b7178 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:20.116502 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cc5bd9c4-bb2c-49ed-8d0a-0744f14b7178 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/ed39436c-d64c-4f91-9bbb-75a49bf60e09" status: 200 len: 1188 microversion: 2.1 time: 0.098105 Oct 18 16:16:20.116766 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3232/6486] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:20 2022] GET /compute/v2.1/servers/ed39436c-d64c-4f91-9bbb-75a49bf60e09 => generated 1188 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:21.139013 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-360e0600-b26f-4f58-8cfe-3ddef013a522 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:21.139583 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-360e0600-b26f-4f58-8cfe-3ddef013a522 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: ed39436c-d64c-4f91-9bbb-75a49bf60e09] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:21.146867 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-360e0600-b26f-4f58-8cfe-3ddef013a522 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:21.147353 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-360e0600-b26f-4f58-8cfe-3ddef013a522 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:21.147794 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-360e0600-b26f-4f58-8cfe-3ddef013a522 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:21.148487 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-360e0600-b26f-4f58-8cfe-3ddef013a522 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:21.148974 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-360e0600-b26f-4f58-8cfe-3ddef013a522 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:21.149408 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-360e0600-b26f-4f58-8cfe-3ddef013a522 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:21.211744 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-360e0600-b26f-4f58-8cfe-3ddef013a522 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:21.219611 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-360e0600-b26f-4f58-8cfe-3ddef013a522 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/ed39436c-d64c-4f91-9bbb-75a49bf60e09" status: 200 len: 1188 microversion: 2.1 time: 0.084593 Oct 18 16:16:21.220199 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3255/6487] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:21 2022] GET /compute/v2.1/servers/ed39436c-d64c-4f91-9bbb-75a49bf60e09 => generated 1188 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:22.242548 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4ffdd7e6-71c0-432e-911f-c8bd53c4ea65 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:22.243197 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4ffdd7e6-71c0-432e-911f-c8bd53c4ea65 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: ed39436c-d64c-4f91-9bbb-75a49bf60e09] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:22.249890 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ffdd7e6-71c0-432e-911f-c8bd53c4ea65 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:22.250383 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ffdd7e6-71c0-432e-911f-c8bd53c4ea65 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:22.250820 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ffdd7e6-71c0-432e-911f-c8bd53c4ea65 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:22.251521 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ffdd7e6-71c0-432e-911f-c8bd53c4ea65 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:22.252492 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ffdd7e6-71c0-432e-911f-c8bd53c4ea65 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:22.252945 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ffdd7e6-71c0-432e-911f-c8bd53c4ea65 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:22.314198 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4ffdd7e6-71c0-432e-911f-c8bd53c4ea65 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:22.322683 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4ffdd7e6-71c0-432e-911f-c8bd53c4ea65 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/ed39436c-d64c-4f91-9bbb-75a49bf60e09" status: 200 len: 1188 microversion: 2.1 time: 0.084037 Oct 18 16:16:22.323270 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3233/6488] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:22 2022] GET /compute/v2.1/servers/ed39436c-d64c-4f91-9bbb-75a49bf60e09 => generated 1188 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:23.346195 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ec1c0eed-4589-4228-851c-545a7f7a45a5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:23.346814 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ec1c0eed-4589-4228-851c-545a7f7a45a5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: ed39436c-d64c-4f91-9bbb-75a49bf60e09] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:23.353722 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ec1c0eed-4589-4228-851c-545a7f7a45a5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:23.354203 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ec1c0eed-4589-4228-851c-545a7f7a45a5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:23.354641 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ec1c0eed-4589-4228-851c-545a7f7a45a5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:23.355329 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ec1c0eed-4589-4228-851c-545a7f7a45a5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:23.355787 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ec1c0eed-4589-4228-851c-545a7f7a45a5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:23.356214 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ec1c0eed-4589-4228-851c-545a7f7a45a5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:23.370182 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-ec1c0eed-4589-4228-851c-545a7f7a45a5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] HTTP exception thrown: Instance ed39436c-d64c-4f91-9bbb-75a49bf60e09 could not be found. Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ec1c0eed-4589-4228-851c-545a7f7a45a5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Request method failure captured: Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/ed39436c-d64c-4f91-9bbb-75a49bf60e09 HTTP/1.1 Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTtEVF9uJ-JO9Xs31vnHSSsjSYlxrsUC5zmDUZwq19epJ_KRexhuRnv973VnMOHKUrtuEaLEal20PXz-3F2SqeQ_VcN02CwN6WkvucYcQaG_QXU6RKnbyMb6Baxa9c0pM4Y0eYUesqFYGvUA-9UWLfliXu3xhi5bS1_xU9JBCKzY9b2g Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: c05254b186b04c9cb9858f621938caca Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-TestVolumeBootPattern-1353957077 Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c05254b186b04c9cb9858f621938caca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c05254b186b04c9cb9858f621938caca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c05254b186b04c9cb9858f621938caca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c05254b186b04c9cb9858f621938caca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-TestVolumeBootPattern-1353957077 Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: c05254b186b04c9cb9858f621938caca Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-TestVolumeBootPattern-1353957077 Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-TestVolumeBootPattern-1353957077-project Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: b9f9ae9e929c416a9298499ab8694d37 Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-TestVolumeBootPattern-1353957077-project Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance ed39436c-d64c-4f91-9bbb-75a49bf60e09 could not be found. Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'ed39436c-d64c-4f91-9bbb-75a49bf60e09'} Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed39436c-d64c-4f91-9bbb-75a49bf60e09 could not be found. Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed39436c-d64c-4f91-9bbb-75a49bf60e09 could not be found. Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:16:23.371870 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:16:23.375896 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:16:23.375896 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:16:23.375896 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:16:23.375896 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:16:23.375896 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:16:23.375896 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed39436c-d64c-4f91-9bbb-75a49bf60e09 could not be found. Oct 18 16:16:23.375896 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:16:23.375896 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ec1c0eed-4589-4228-851c-545a7f7a45a5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Returning 404 to user: Instance ed39436c-d64c-4f91-9bbb-75a49bf60e09 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:16:23.375896 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ec1c0eed-4589-4228-851c-545a7f7a45a5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/ed39436c-d64c-4f91-9bbb-75a49bf60e09" status: 404 len: 111 microversion: 2.1 time: 0.031616 Oct 18 16:16:23.375896 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3256/6489] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:23 2022] GET /compute/v2.1/servers/ed39436c-d64c-4f91-9bbb-75a49bf60e09 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:16:38.073332 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e95dbae9-8c92-45af-8189-9f6077e9251b tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:16:38.075698 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e95dbae9-8c92-45af-8189-9f6077e9251b tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: dd096aa4-077a-4c95-a3cc-b40763f12038] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:38.077946 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:38.078611 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=24 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:38.085032 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e95dbae9-8c92-45af-8189-9f6077e9251b tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:38.085528 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e95dbae9-8c92-45af-8189-9f6077e9251b tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:38.085972 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e95dbae9-8c92-45af-8189-9f6077e9251b tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:38.086682 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e95dbae9-8c92-45af-8189-9f6077e9251b tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:38.087143 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e95dbae9-8c92-45af-8189-9f6077e9251b tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:38.087581 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e95dbae9-8c92-45af-8189-9f6077e9251b tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:38.160017 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e95dbae9-8c92-45af-8189-9f6077e9251b tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "POST /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038/action" status: 200 len: 24565 microversion: 2.1 time: 0.090720 Oct 18 16:16:38.160848 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3234/6490] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:16:38 2022] POST /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038/action => generated 24565 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:16:44.559085 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-404d9c0b-cced-4b83-89af-615983c0d568 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1460423341", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "2cf2af57-d32c-4433-98c7-9415c6aa3540", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "a0168786-8cd3-418a-9936-dae2a39b2080"}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:16:44.570029 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:44.570684 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:44.840307 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-404d9c0b-cced-4b83-89af-615983c0d568 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] validate_networks() for [('a0168786-8cd3-418a-9936-dae2a39b2080', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 16:16:45.226175 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-404d9c0b-cced-4b83-89af-615983c0d568 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:16:45.226626 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-404d9c0b-cced-4b83-89af-615983c0d568 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:16:45.227098 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-404d9c0b-cced-4b83-89af-615983c0d568 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:16:45.227533 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-404d9c0b-cced-4b83-89af-615983c0d568 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:16:45.227943 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-404d9c0b-cced-4b83-89af-615983c0d568 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:16:45.237250 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-404d9c0b-cced-4b83-89af-615983c0d568 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:45.237735 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-404d9c0b-cced-4b83-89af-615983c0d568 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:45.238167 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-404d9c0b-cced-4b83-89af-615983c0d568 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:45.238897 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-404d9c0b-cced-4b83-89af-615983c0d568 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:45.239346 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-404d9c0b-cced-4b83-89af-615983c0d568 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:45.239773 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-404d9c0b-cced-4b83-89af-615983c0d568 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:45.257825 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-404d9c0b-cced-4b83-89af-615983c0d568 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Getting quotas for project c05254b186b04c9cb9858f621938caca. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:16:45.263297 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-404d9c0b-cced-4b83-89af-615983c0d568 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Getting quotas for user b9f9ae9e929c416a9298499ab8694d37 and project c05254b186b04c9cb9858f621938caca. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:16:45.275928 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-404d9c0b-cced-4b83-89af-615983c0d568 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:16:45.278075 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-404d9c0b-cced-4b83-89af-615983c0d568 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: dc3686dc-c474-41ab-8def-d8a4a0ef9a7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='2cf2af57-d32c-4433-98c7-9415c6aa3540',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:16:45.353985 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-404d9c0b-cced-4b83-89af-615983c0d568 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.798465 Oct 18 16:16:45.355165 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3257/6491] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 16:16:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:16:45.367127 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-92b373f0-2b28-47d9-8abd-07f7d89998ce tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:45.368059 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-92b373f0-2b28-47d9-8abd-07f7d89998ce tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: dc3686dc-c474-41ab-8def-d8a4a0ef9a7d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:45.488443 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-92b373f0-2b28-47d9-8abd-07f7d89998ce tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:45.495633 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-92b373f0-2b28-47d9-8abd-07f7d89998ce tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d" status: 200 len: 1057 microversion: 2.1 time: 0.132836 Oct 18 16:16:45.496164 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3235/6492] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:45 2022] GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d => generated 1057 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:16:46.519890 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e072f932-8a50-4d74-b3ac-4a75314dbdf3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:46.520668 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e072f932-8a50-4d74-b3ac-4a75314dbdf3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: dc3686dc-c474-41ab-8def-d8a4a0ef9a7d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:46.528221 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e072f932-8a50-4d74-b3ac-4a75314dbdf3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:46.529055 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e072f932-8a50-4d74-b3ac-4a75314dbdf3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:46.529568 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e072f932-8a50-4d74-b3ac-4a75314dbdf3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:46.530620 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e072f932-8a50-4d74-b3ac-4a75314dbdf3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:46.531263 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e072f932-8a50-4d74-b3ac-4a75314dbdf3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:46.532014 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e072f932-8a50-4d74-b3ac-4a75314dbdf3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:46.630117 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e072f932-8a50-4d74-b3ac-4a75314dbdf3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:46.638346 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e072f932-8a50-4d74-b3ac-4a75314dbdf3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d" status: 200 len: 1127 microversion: 2.1 time: 0.123324 Oct 18 16:16:46.639058 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3258/6493] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:46 2022] GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d => generated 1127 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:16:47.663592 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4efcc767-85ef-4987-9d3a-6832df44832f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:47.664224 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4efcc767-85ef-4987-9d3a-6832df44832f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: dc3686dc-c474-41ab-8def-d8a4a0ef9a7d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:47.671888 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4efcc767-85ef-4987-9d3a-6832df44832f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:47.672608 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4efcc767-85ef-4987-9d3a-6832df44832f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:47.673278 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4efcc767-85ef-4987-9d3a-6832df44832f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:47.674612 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4efcc767-85ef-4987-9d3a-6832df44832f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:47.675174 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4efcc767-85ef-4987-9d3a-6832df44832f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:47.675732 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4efcc767-85ef-4987-9d3a-6832df44832f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:47.854481 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-c49df9aa-4cdf-4ba1-8d0a-36cd8e8a3c4c req-aeeca362-f24d-4402-bec4-52f5cec601cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc3686dc-c474-41ab-8def-d8a4a0ef9a7d", "tag": "b3f1ffab-281a-4434-8305-68889836bd51"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:16:47.868732 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-c49df9aa-4cdf-4ba1-8d0a-36cd8e8a3c4c req-aeeca362-f24d-4402-bec4-52f5cec601cf service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:47.869251 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-c49df9aa-4cdf-4ba1-8d0a-36cd8e8a3c4c req-aeeca362-f24d-4402-bec4-52f5cec601cf service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:47.869683 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-c49df9aa-4cdf-4ba1-8d0a-36cd8e8a3c4c req-aeeca362-f24d-4402-bec4-52f5cec601cf service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:47.885103 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-c49df9aa-4cdf-4ba1-8d0a-36cd8e8a3c4c req-aeeca362-f24d-4402-bec4-52f5cec601cf service nova] Creating event network-changed:b3f1ffab-281a-4434-8305-68889836bd51 for instance dc3686dc-c474-41ab-8def-d8a4a0ef9a7d on n-h2-853682-5 Oct 18 16:16:47.891390 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-c49df9aa-4cdf-4ba1-8d0a-36cd8e8a3c4c req-aeeca362-f24d-4402-bec4-52f5cec601cf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041260 Oct 18 16:16:47.892324 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4efcc767-85ef-4987-9d3a-6832df44832f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:47.892687 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3259/6494] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:16:47.903296 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4efcc767-85ef-4987-9d3a-6832df44832f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d" status: 200 len: 1169 microversion: 2.1 time: 0.242878 Oct 18 16:16:47.904930 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3236/6495] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:47 2022] GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d => generated 1169 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:48.928822 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-86bca7d3-c65d-4c90-a3ca-ed2281467a05 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:48.929537 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-86bca7d3-c65d-4c90-a3ca-ed2281467a05 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: dc3686dc-c474-41ab-8def-d8a4a0ef9a7d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:48.936948 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-86bca7d3-c65d-4c90-a3ca-ed2281467a05 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:48.937428 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-86bca7d3-c65d-4c90-a3ca-ed2281467a05 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:48.937875 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-86bca7d3-c65d-4c90-a3ca-ed2281467a05 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:48.938558 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-86bca7d3-c65d-4c90-a3ca-ed2281467a05 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:48.939667 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-86bca7d3-c65d-4c90-a3ca-ed2281467a05 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:48.940091 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-86bca7d3-c65d-4c90-a3ca-ed2281467a05 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:49.075068 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-86bca7d3-c65d-4c90-a3ca-ed2281467a05 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:49.083007 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-86bca7d3-c65d-4c90-a3ca-ed2281467a05 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d" status: 200 len: 1169 microversion: 2.1 time: 0.158617 Oct 18 16:16:49.083553 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3260/6496] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:48 2022] GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d => generated 1169 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:50.110716 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-69e9a1d8-2289-49f4-a60c-8942891afcae tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:50.111338 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-69e9a1d8-2289-49f4-a60c-8942891afcae tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: dc3686dc-c474-41ab-8def-d8a4a0ef9a7d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:50.120740 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69e9a1d8-2289-49f4-a60c-8942891afcae tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:50.121367 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69e9a1d8-2289-49f4-a60c-8942891afcae tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:50.121865 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69e9a1d8-2289-49f4-a60c-8942891afcae tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:50.122590 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69e9a1d8-2289-49f4-a60c-8942891afcae tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:50.123228 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69e9a1d8-2289-49f4-a60c-8942891afcae tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:50.123894 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69e9a1d8-2289-49f4-a60c-8942891afcae tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:50.309437 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-69e9a1d8-2289-49f4-a60c-8942891afcae tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:50.318757 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-69e9a1d8-2289-49f4-a60c-8942891afcae tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d" status: 200 len: 1169 microversion: 2.1 time: 0.213690 Oct 18 16:16:50.319561 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3237/6497] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:50 2022] GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d => generated 1169 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:51.353212 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-47aadf55-4933-4cd3-8e6b-f579a2606ed8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:51.353997 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-47aadf55-4933-4cd3-8e6b-f579a2606ed8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: dc3686dc-c474-41ab-8def-d8a4a0ef9a7d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:51.370064 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-47aadf55-4933-4cd3-8e6b-f579a2606ed8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:51.370830 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-47aadf55-4933-4cd3-8e6b-f579a2606ed8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:51.372134 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-47aadf55-4933-4cd3-8e6b-f579a2606ed8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:51.373920 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-47aadf55-4933-4cd3-8e6b-f579a2606ed8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:51.374572 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-47aadf55-4933-4cd3-8e6b-f579a2606ed8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:51.376194 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-47aadf55-4933-4cd3-8e6b-f579a2606ed8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:51.566221 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-47aadf55-4933-4cd3-8e6b-f579a2606ed8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:51.582324 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-47aadf55-4933-4cd3-8e6b-f579a2606ed8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d" status: 200 len: 1169 microversion: 2.1 time: 0.240899 Oct 18 16:16:51.584144 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3261/6498] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:51 2022] GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d => generated 1169 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:52.608468 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-04ab145d-e279-4790-9022-280a1487aa27 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:52.609150 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-04ab145d-e279-4790-9022-280a1487aa27 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: dc3686dc-c474-41ab-8def-d8a4a0ef9a7d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:52.617257 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04ab145d-e279-4790-9022-280a1487aa27 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:52.617754 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04ab145d-e279-4790-9022-280a1487aa27 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:52.618195 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04ab145d-e279-4790-9022-280a1487aa27 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:52.618901 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04ab145d-e279-4790-9022-280a1487aa27 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:52.619359 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04ab145d-e279-4790-9022-280a1487aa27 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:52.619984 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04ab145d-e279-4790-9022-280a1487aa27 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:52.764560 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-04ab145d-e279-4790-9022-280a1487aa27 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:52.772616 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-04ab145d-e279-4790-9022-280a1487aa27 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d" status: 200 len: 1169 microversion: 2.1 time: 0.168897 Oct 18 16:16:52.773225 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3238/6499] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:52 2022] GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d => generated 1169 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:53.795344 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-71a83efe-ea0f-49c2-9d4d-ddd0ea3a8e03 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:53.795954 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-71a83efe-ea0f-49c2-9d4d-ddd0ea3a8e03 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: dc3686dc-c474-41ab-8def-d8a4a0ef9a7d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:53.803872 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-71a83efe-ea0f-49c2-9d4d-ddd0ea3a8e03 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:53.804341 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-71a83efe-ea0f-49c2-9d4d-ddd0ea3a8e03 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:53.804767 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-71a83efe-ea0f-49c2-9d4d-ddd0ea3a8e03 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:53.805488 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-71a83efe-ea0f-49c2-9d4d-ddd0ea3a8e03 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:53.805930 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-71a83efe-ea0f-49c2-9d4d-ddd0ea3a8e03 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:53.806345 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-71a83efe-ea0f-49c2-9d4d-ddd0ea3a8e03 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:53.943563 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-71a83efe-ea0f-49c2-9d4d-ddd0ea3a8e03 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:53.952065 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-71a83efe-ea0f-49c2-9d4d-ddd0ea3a8e03 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d" status: 200 len: 1169 microversion: 2.1 time: 0.160585 Oct 18 16:16:53.953386 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3262/6500] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:53 2022] GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d => generated 1169 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:16:54.975329 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-86d1be77-397c-41cd-8c63-f72eb2149873 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:54.975871 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-86d1be77-397c-41cd-8c63-f72eb2149873 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: dc3686dc-c474-41ab-8def-d8a4a0ef9a7d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:54.982818 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86d1be77-397c-41cd-8c63-f72eb2149873 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:54.983307 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86d1be77-397c-41cd-8c63-f72eb2149873 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:54.983750 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86d1be77-397c-41cd-8c63-f72eb2149873 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:54.984452 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86d1be77-397c-41cd-8c63-f72eb2149873 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:54.984950 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86d1be77-397c-41cd-8c63-f72eb2149873 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:54.985387 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86d1be77-397c-41cd-8c63-f72eb2149873 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:55.117679 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-86d1be77-397c-41cd-8c63-f72eb2149873 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:55.125335 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-86d1be77-397c-41cd-8c63-f72eb2149873 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d" status: 200 len: 1169 microversion: 2.1 time: 0.154045 Oct 18 16:16:55.126104 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3239/6501] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:54 2022] GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d => generated 1169 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:56.147915 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0aee3cde-3dc4-4378-bcb6-3878a4da4961 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:56.148526 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0aee3cde-3dc4-4378-bcb6-3878a4da4961 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: dc3686dc-c474-41ab-8def-d8a4a0ef9a7d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:56.151326 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:56.151984 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=6 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:56.158457 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0aee3cde-3dc4-4378-bcb6-3878a4da4961 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:56.158937 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0aee3cde-3dc4-4378-bcb6-3878a4da4961 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:56.159367 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0aee3cde-3dc4-4378-bcb6-3878a4da4961 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:56.160053 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0aee3cde-3dc4-4378-bcb6-3878a4da4961 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:56.160503 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0aee3cde-3dc4-4378-bcb6-3878a4da4961 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:56.160962 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0aee3cde-3dc4-4378-bcb6-3878a4da4961 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:56.295362 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0aee3cde-3dc4-4378-bcb6-3878a4da4961 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:56.303149 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0aee3cde-3dc4-4378-bcb6-3878a4da4961 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d" status: 200 len: 1169 microversion: 2.1 time: 0.159529 Oct 18 16:16:56.303998 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3263/6502] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:56 2022] GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d => generated 1169 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:57.325889 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bb756561-e4d8-4fd0-b2b7-6a88d591a5fb tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:57.326515 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bb756561-e4d8-4fd0-b2b7-6a88d591a5fb tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: dc3686dc-c474-41ab-8def-d8a4a0ef9a7d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:57.328568 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:57.335125 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb756561-e4d8-4fd0-b2b7-6a88d591a5fb tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:57.335619 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb756561-e4d8-4fd0-b2b7-6a88d591a5fb tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:57.336064 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb756561-e4d8-4fd0-b2b7-6a88d591a5fb tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:57.336776 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb756561-e4d8-4fd0-b2b7-6a88d591a5fb tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:57.337265 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb756561-e4d8-4fd0-b2b7-6a88d591a5fb tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:57.337697 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb756561-e4d8-4fd0-b2b7-6a88d591a5fb tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:57.469025 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bb756561-e4d8-4fd0-b2b7-6a88d591a5fb tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:57.477725 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bb756561-e4d8-4fd0-b2b7-6a88d591a5fb tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d" status: 200 len: 1169 microversion: 2.1 time: 0.155753 Oct 18 16:16:57.478326 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3240/6503] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:57 2022] GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d => generated 1169 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:58.501993 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8ce8fb87-aa61-459d-bfe1-061ca4aeb2bc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:58.502533 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8ce8fb87-aa61-459d-bfe1-061ca4aeb2bc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: dc3686dc-c474-41ab-8def-d8a4a0ef9a7d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:58.509835 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8ce8fb87-aa61-459d-bfe1-061ca4aeb2bc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:58.510330 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8ce8fb87-aa61-459d-bfe1-061ca4aeb2bc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:58.510768 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8ce8fb87-aa61-459d-bfe1-061ca4aeb2bc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:58.511504 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8ce8fb87-aa61-459d-bfe1-061ca4aeb2bc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:58.511957 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8ce8fb87-aa61-459d-bfe1-061ca4aeb2bc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:58.512384 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8ce8fb87-aa61-459d-bfe1-061ca4aeb2bc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:58.650322 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8ce8fb87-aa61-459d-bfe1-061ca4aeb2bc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:58.658273 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8ce8fb87-aa61-459d-bfe1-061ca4aeb2bc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d" status: 200 len: 1169 microversion: 2.1 time: 0.161057 Oct 18 16:16:58.658845 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3264/6504] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:58 2022] GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d => generated 1169 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:16:59.682086 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-115a49ad-ee20-45a9-adbb-b9a1e5bca482 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:16:59.682614 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-115a49ad-ee20-45a9-adbb-b9a1e5bca482 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: dc3686dc-c474-41ab-8def-d8a4a0ef9a7d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:16:59.690248 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-115a49ad-ee20-45a9-adbb-b9a1e5bca482 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:59.690746 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-115a49ad-ee20-45a9-adbb-b9a1e5bca482 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:59.691187 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-115a49ad-ee20-45a9-adbb-b9a1e5bca482 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:59.691904 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-115a49ad-ee20-45a9-adbb-b9a1e5bca482 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:16:59.692556 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-115a49ad-ee20-45a9-adbb-b9a1e5bca482 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:16:59.693051 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-115a49ad-ee20-45a9-adbb-b9a1e5bca482 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:16:59.830478 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-115a49ad-ee20-45a9-adbb-b9a1e5bca482 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:16:59.838324 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-115a49ad-ee20-45a9-adbb-b9a1e5bca482 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d" status: 200 len: 1169 microversion: 2.1 time: 0.160669 Oct 18 16:16:59.838922 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3241/6505] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:16:59 2022] GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d => generated 1169 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:17:00.861628 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-10da381b-fe56-49d0-b650-e7d73109f21e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:00.862250 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-10da381b-fe56-49d0-b650-e7d73109f21e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: dc3686dc-c474-41ab-8def-d8a4a0ef9a7d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:00.869594 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-10da381b-fe56-49d0-b650-e7d73109f21e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:00.870089 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-10da381b-fe56-49d0-b650-e7d73109f21e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:00.870528 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-10da381b-fe56-49d0-b650-e7d73109f21e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:00.871248 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-10da381b-fe56-49d0-b650-e7d73109f21e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:00.871706 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-10da381b-fe56-49d0-b650-e7d73109f21e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:00.872133 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-10da381b-fe56-49d0-b650-e7d73109f21e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:01.014369 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-10da381b-fe56-49d0-b650-e7d73109f21e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:01.022288 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-10da381b-fe56-49d0-b650-e7d73109f21e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d" status: 200 len: 1215 microversion: 2.1 time: 0.165411 Oct 18 16:17:01.022857 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3265/6506] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:00 2022] GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d => generated 1215 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:02.044956 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1007f08d-bdce-4fc1-95b4-0d587e1c8b1c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:02.045581 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1007f08d-bdce-4fc1-95b4-0d587e1c8b1c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: dc3686dc-c474-41ab-8def-d8a4a0ef9a7d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:02.053507 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1007f08d-bdce-4fc1-95b4-0d587e1c8b1c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:02.053996 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1007f08d-bdce-4fc1-95b4-0d587e1c8b1c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:02.054436 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1007f08d-bdce-4fc1-95b4-0d587e1c8b1c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:02.055133 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1007f08d-bdce-4fc1-95b4-0d587e1c8b1c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:02.055594 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1007f08d-bdce-4fc1-95b4-0d587e1c8b1c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:02.056026 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1007f08d-bdce-4fc1-95b4-0d587e1c8b1c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:02.189657 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1007f08d-bdce-4fc1-95b4-0d587e1c8b1c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:02.197506 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1007f08d-bdce-4fc1-95b4-0d587e1c8b1c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d" status: 200 len: 1203 microversion: 2.1 time: 0.156625 Oct 18 16:17:02.198085 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3242/6507] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:02 2022] GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d => generated 1203 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:03.221575 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-646568d8-328e-455d-9740-732780ea5021 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:03.222117 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-646568d8-328e-455d-9740-732780ea5021 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: dc3686dc-c474-41ab-8def-d8a4a0ef9a7d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:03.229024 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-646568d8-328e-455d-9740-732780ea5021 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:03.229509 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-646568d8-328e-455d-9740-732780ea5021 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:03.229947 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-646568d8-328e-455d-9740-732780ea5021 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:03.230650 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-646568d8-328e-455d-9740-732780ea5021 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:03.231112 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-646568d8-328e-455d-9740-732780ea5021 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:03.231542 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-646568d8-328e-455d-9740-732780ea5021 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:03.360559 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-646568d8-328e-455d-9740-732780ea5021 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:03.368843 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-646568d8-328e-455d-9740-732780ea5021 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d" status: 200 len: 1203 microversion: 2.1 time: 0.151661 Oct 18 16:17:03.369413 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3266/6508] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:03 2022] GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d => generated 1203 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:04.391663 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f3a3d582-4358-46ac-9ce9-03881afd7d98 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:04.392688 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f3a3d582-4358-46ac-9ce9-03881afd7d98 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: dc3686dc-c474-41ab-8def-d8a4a0ef9a7d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:04.401673 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3a3d582-4358-46ac-9ce9-03881afd7d98 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:04.402230 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3a3d582-4358-46ac-9ce9-03881afd7d98 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:04.402915 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3a3d582-4358-46ac-9ce9-03881afd7d98 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:04.403641 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3a3d582-4358-46ac-9ce9-03881afd7d98 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:04.404122 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3a3d582-4358-46ac-9ce9-03881afd7d98 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:04.404559 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3a3d582-4358-46ac-9ce9-03881afd7d98 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:04.535014 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f3a3d582-4358-46ac-9ce9-03881afd7d98 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:04.542776 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f3a3d582-4358-46ac-9ce9-03881afd7d98 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d" status: 200 len: 1203 microversion: 2.1 time: 0.155334 Oct 18 16:17:04.543354 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3243/6509] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:04 2022] GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d => generated 1203 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:05.566673 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3f995c9b-3ffe-44ba-825a-594c32354552 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:05.567377 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3f995c9b-3ffe-44ba-825a-594c32354552 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: dc3686dc-c474-41ab-8def-d8a4a0ef9a7d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:05.573835 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3f995c9b-3ffe-44ba-825a-594c32354552 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:05.574346 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3f995c9b-3ffe-44ba-825a-594c32354552 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:05.574783 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3f995c9b-3ffe-44ba-825a-594c32354552 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:05.575506 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3f995c9b-3ffe-44ba-825a-594c32354552 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:05.575958 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3f995c9b-3ffe-44ba-825a-594c32354552 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:05.576402 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3f995c9b-3ffe-44ba-825a-594c32354552 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:05.780665 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3f995c9b-3ffe-44ba-825a-594c32354552 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:05.788458 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3f995c9b-3ffe-44ba-825a-594c32354552 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d" status: 200 len: 1203 microversion: 2.1 time: 0.226283 Oct 18 16:17:05.789062 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3267/6510] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:05 2022] GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d => generated 1203 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:06.810653 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8dc5f769-f1a8-43f2-97be-3b496b849a6c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:06.811267 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8dc5f769-f1a8-43f2-97be-3b496b849a6c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: dc3686dc-c474-41ab-8def-d8a4a0ef9a7d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:06.818214 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8dc5f769-f1a8-43f2-97be-3b496b849a6c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:06.818694 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8dc5f769-f1a8-43f2-97be-3b496b849a6c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:06.819137 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8dc5f769-f1a8-43f2-97be-3b496b849a6c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:06.819828 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8dc5f769-f1a8-43f2-97be-3b496b849a6c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:06.820306 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8dc5f769-f1a8-43f2-97be-3b496b849a6c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:06.820735 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8dc5f769-f1a8-43f2-97be-3b496b849a6c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:06.955973 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8dc5f769-f1a8-43f2-97be-3b496b849a6c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:06.963906 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8dc5f769-f1a8-43f2-97be-3b496b849a6c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d" status: 200 len: 1203 microversion: 2.1 time: 0.157179 Oct 18 16:17:06.964483 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3244/6511] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:06 2022] GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d => generated 1203 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:07.987683 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-73eeebe6-baa3-428d-9818-50253fcaaa99 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:07.988303 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-73eeebe6-baa3-428d-9818-50253fcaaa99 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: dc3686dc-c474-41ab-8def-d8a4a0ef9a7d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:07.995523 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-73eeebe6-baa3-428d-9818-50253fcaaa99 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:07.996004 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-73eeebe6-baa3-428d-9818-50253fcaaa99 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:07.996439 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-73eeebe6-baa3-428d-9818-50253fcaaa99 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:07.997147 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-73eeebe6-baa3-428d-9818-50253fcaaa99 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:07.997604 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-73eeebe6-baa3-428d-9818-50253fcaaa99 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:07.998026 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-73eeebe6-baa3-428d-9818-50253fcaaa99 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:08.127536 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-73eeebe6-baa3-428d-9818-50253fcaaa99 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:08.135383 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-73eeebe6-baa3-428d-9818-50253fcaaa99 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d" status: 200 len: 1203 microversion: 2.1 time: 0.151741 Oct 18 16:17:08.135963 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3268/6512] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:07 2022] GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d => generated 1203 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:09.158244 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f19b28a0-31f1-4bce-8bcd-3b1a5686464b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:09.159354 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f19b28a0-31f1-4bce-8bcd-3b1a5686464b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: dc3686dc-c474-41ab-8def-d8a4a0ef9a7d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:09.163447 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=25 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:09.168197 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f19b28a0-31f1-4bce-8bcd-3b1a5686464b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:09.168694 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f19b28a0-31f1-4bce-8bcd-3b1a5686464b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:09.169178 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f19b28a0-31f1-4bce-8bcd-3b1a5686464b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:09.169901 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f19b28a0-31f1-4bce-8bcd-3b1a5686464b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:09.170365 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f19b28a0-31f1-4bce-8bcd-3b1a5686464b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:09.170795 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f19b28a0-31f1-4bce-8bcd-3b1a5686464b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:09.175224 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=59 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:09.312512 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f19b28a0-31f1-4bce-8bcd-3b1a5686464b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:09.321075 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f19b28a0-31f1-4bce-8bcd-3b1a5686464b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d" status: 200 len: 1203 microversion: 2.1 time: 0.166840 Oct 18 16:17:09.321789 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3245/6513] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:09 2022] GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d => generated 1203 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:09.467076 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b6e625bf-7e94-4cad-af39-03796b0c0804 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:09.467906 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b6e625bf-7e94-4cad-af39-03796b0c0804 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: dd096aa4-077a-4c95-a3cc-b40763f12038] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:09.468766 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-50e9046a-a168-419e-a933-0669e4451c4b req-6a40a0c8-237d-49bb-9935-6f8e61ab02ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd096aa4-077a-4c95-a3cc-b40763f12038", "tag": "2434ee98-2bbe-49a4-94c0-636c1699cc12"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:17:09.474397 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b6e625bf-7e94-4cad-af39-03796b0c0804 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:09.474897 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b6e625bf-7e94-4cad-af39-03796b0c0804 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:09.475340 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b6e625bf-7e94-4cad-af39-03796b0c0804 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:09.476135 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b6e625bf-7e94-4cad-af39-03796b0c0804 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:09.476722 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b6e625bf-7e94-4cad-af39-03796b0c0804 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:09.477374 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b6e625bf-7e94-4cad-af39-03796b0c0804 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:09.478676 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-50e9046a-a168-419e-a933-0669e4451c4b req-6a40a0c8-237d-49bb-9935-6f8e61ab02ed service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:09.479168 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-50e9046a-a168-419e-a933-0669e4451c4b req-6a40a0c8-237d-49bb-9935-6f8e61ab02ed service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:09.479608 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-50e9046a-a168-419e-a933-0669e4451c4b req-6a40a0c8-237d-49bb-9935-6f8e61ab02ed service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:09.490816 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-50e9046a-a168-419e-a933-0669e4451c4b req-6a40a0c8-237d-49bb-9935-6f8e61ab02ed service nova] Creating event network-changed:2434ee98-2bbe-49a4-94c0-636c1699cc12 for instance dd096aa4-077a-4c95-a3cc-b40763f12038 on n-h1-853682-5 Oct 18 16:17:09.496195 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-50e9046a-a168-419e-a933-0669e4451c4b req-6a40a0c8-237d-49bb-9935-6f8e61ab02ed service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031453 Oct 18 16:17:09.496837 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3246/6514] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:17:09.508090 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b6e625bf-7e94-4cad-af39-03796b0c0804 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: dd096aa4-077a-4c95-a3cc-b40763f12038] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:17:09.600332 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b6e625bf-7e94-4cad-af39-03796b0c0804 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "DELETE /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038" status: 204 len: 0 microversion: 2.1 time: 0.138012 Oct 18 16:17:09.601474 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3269/6515] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 16:17:09 2022] DELETE /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:17:09.610633 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-80056d90-2a5c-4fb7-9c44-e3bfd2c1fd55 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:09.611377 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-80056d90-2a5c-4fb7-9c44-e3bfd2c1fd55 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: dd096aa4-077a-4c95-a3cc-b40763f12038] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:09.617564 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80056d90-2a5c-4fb7-9c44-e3bfd2c1fd55 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:09.618056 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80056d90-2a5c-4fb7-9c44-e3bfd2c1fd55 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:09.618498 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80056d90-2a5c-4fb7-9c44-e3bfd2c1fd55 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:09.619201 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80056d90-2a5c-4fb7-9c44-e3bfd2c1fd55 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:09.619664 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80056d90-2a5c-4fb7-9c44-e3bfd2c1fd55 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:09.620100 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80056d90-2a5c-4fb7-9c44-e3bfd2c1fd55 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:09.761026 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-80056d90-2a5c-4fb7-9c44-e3bfd2c1fd55 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:09.769255 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-80056d90-2a5c-4fb7-9c44-e3bfd2c1fd55 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038" status: 200 len: 1691 microversion: 2.1 time: 0.163025 Oct 18 16:17:09.769846 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3247/6516] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:09 2022] GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038 => generated 1691 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:10.346299 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-69dc5c3e-e18a-47a3-a63a-ba33aa8e2fe8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:10.346942 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-69dc5c3e-e18a-47a3-a63a-ba33aa8e2fe8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: dc3686dc-c474-41ab-8def-d8a4a0ef9a7d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:10.353391 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-69dc5c3e-e18a-47a3-a63a-ba33aa8e2fe8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:10.353885 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-69dc5c3e-e18a-47a3-a63a-ba33aa8e2fe8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:10.354331 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-69dc5c3e-e18a-47a3-a63a-ba33aa8e2fe8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:10.355048 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-69dc5c3e-e18a-47a3-a63a-ba33aa8e2fe8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:10.355506 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-69dc5c3e-e18a-47a3-a63a-ba33aa8e2fe8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:10.355934 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-69dc5c3e-e18a-47a3-a63a-ba33aa8e2fe8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:10.493867 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-69dc5c3e-e18a-47a3-a63a-ba33aa8e2fe8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:10.502093 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-69dc5c3e-e18a-47a3-a63a-ba33aa8e2fe8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d" status: 200 len: 1203 microversion: 2.1 time: 0.160629 Oct 18 16:17:10.502680 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3270/6517] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:10 2022] GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d => generated 1203 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:10.795003 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-17fe5fb0-914c-4775-ba6c-9418f174ff4e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:10.795620 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-17fe5fb0-914c-4775-ba6c-9418f174ff4e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: dd096aa4-077a-4c95-a3cc-b40763f12038] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:10.803094 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17fe5fb0-914c-4775-ba6c-9418f174ff4e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:10.803850 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17fe5fb0-914c-4775-ba6c-9418f174ff4e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:10.804293 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17fe5fb0-914c-4775-ba6c-9418f174ff4e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:10.805033 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17fe5fb0-914c-4775-ba6c-9418f174ff4e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:10.805494 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17fe5fb0-914c-4775-ba6c-9418f174ff4e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:10.805924 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17fe5fb0-914c-4775-ba6c-9418f174ff4e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:10.978781 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-17fe5fb0-914c-4775-ba6c-9418f174ff4e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:10.989324 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-17fe5fb0-914c-4775-ba6c-9418f174ff4e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038" status: 200 len: 1691 microversion: 2.1 time: 0.198824 Oct 18 16:17:10.990047 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3248/6518] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:10 2022] GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038 => generated 1691 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:11.006157 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-1a002f44-c8f2-4c28-abe5-3c9f8e25f77d req-83bd377c-3ed8-4f74-b32b-72dadbaa8b64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc3686dc-c474-41ab-8def-d8a4a0ef9a7d", "name": "network-vif-plugged", "status": "completed", "tag": "b3f1ffab-281a-4434-8305-68889836bd51"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:17:11.012181 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-1a002f44-c8f2-4c28-abe5-3c9f8e25f77d req-83bd377c-3ed8-4f74-b32b-72dadbaa8b64 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:11.012662 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-1a002f44-c8f2-4c28-abe5-3c9f8e25f77d req-83bd377c-3ed8-4f74-b32b-72dadbaa8b64 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:11.013168 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-1a002f44-c8f2-4c28-abe5-3c9f8e25f77d req-83bd377c-3ed8-4f74-b32b-72dadbaa8b64 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:11.024502 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-1a002f44-c8f2-4c28-abe5-3c9f8e25f77d req-83bd377c-3ed8-4f74-b32b-72dadbaa8b64 service nova] Creating event network-vif-plugged:b3f1ffab-281a-4434-8305-68889836bd51 for instance dc3686dc-c474-41ab-8def-d8a4a0ef9a7d on n-h2-853682-5 Oct 18 16:17:11.029396 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-1a002f44-c8f2-4c28-abe5-3c9f8e25f77d req-83bd377c-3ed8-4f74-b32b-72dadbaa8b64 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031455 Oct 18 16:17:11.030204 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3271/6519] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:17:11.524344 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7996731c-3db7-4c7f-8ea8-796cdf7f701d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:11.525023 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7996731c-3db7-4c7f-8ea8-796cdf7f701d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: dc3686dc-c474-41ab-8def-d8a4a0ef9a7d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:11.531811 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7996731c-3db7-4c7f-8ea8-796cdf7f701d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:11.532303 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7996731c-3db7-4c7f-8ea8-796cdf7f701d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:11.532736 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7996731c-3db7-4c7f-8ea8-796cdf7f701d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:11.533472 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7996731c-3db7-4c7f-8ea8-796cdf7f701d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:11.533923 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7996731c-3db7-4c7f-8ea8-796cdf7f701d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:11.534341 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7996731c-3db7-4c7f-8ea8-796cdf7f701d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:11.672386 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-3c9156f6-fa99-4d82-be0b-8c49e64ab0a6 req-915b7c6b-d32e-41ad-8f81-5b84161c7c32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd096aa4-077a-4c95-a3cc-b40763f12038", "name": "network-vif-deleted", "tag": "2434ee98-2bbe-49a4-94c0-636c1699cc12"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:17:11.680744 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7996731c-3db7-4c7f-8ea8-796cdf7f701d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:11.686606 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-3c9156f6-fa99-4d82-be0b-8c49e64ab0a6 req-915b7c6b-d32e-41ad-8f81-5b84161c7c32 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:11.687393 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-3c9156f6-fa99-4d82-be0b-8c49e64ab0a6 req-915b7c6b-d32e-41ad-8f81-5b84161c7c32 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:11.688336 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-3c9156f6-fa99-4d82-be0b-8c49e64ab0a6 req-915b7c6b-d32e-41ad-8f81-5b84161c7c32 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:11.700771 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7996731c-3db7-4c7f-8ea8-796cdf7f701d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d" status: 200 len: 1203 microversion: 2.1 time: 0.180375 Oct 18 16:17:11.703470 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3249/6520] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:11 2022] GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d => generated 1203 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:11.704550 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-3c9156f6-fa99-4d82-be0b-8c49e64ab0a6 req-915b7c6b-d32e-41ad-8f81-5b84161c7c32 service nova] Creating event network-vif-deleted:2434ee98-2bbe-49a4-94c0-636c1699cc12 for instance dd096aa4-077a-4c95-a3cc-b40763f12038 on n-h1-853682-5 Oct 18 16:17:11.709438 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-3c9156f6-fa99-4d82-be0b-8c49e64ab0a6 req-915b7c6b-d32e-41ad-8f81-5b84161c7c32 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042548 Oct 18 16:17:11.710043 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3272/6521] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:17:12.013990 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-24907498-e3d8-4f72-b1b0-13918cae152e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:12.014609 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-24907498-e3d8-4f72-b1b0-13918cae152e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: dd096aa4-077a-4c95-a3cc-b40763f12038] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:12.023024 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24907498-e3d8-4f72-b1b0-13918cae152e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:12.023522 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24907498-e3d8-4f72-b1b0-13918cae152e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:12.023966 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24907498-e3d8-4f72-b1b0-13918cae152e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:12.024679 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24907498-e3d8-4f72-b1b0-13918cae152e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:12.025191 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24907498-e3d8-4f72-b1b0-13918cae152e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:12.025656 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24907498-e3d8-4f72-b1b0-13918cae152e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:12.060156 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24907498-e3d8-4f72-b1b0-13918cae152e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:12.060652 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24907498-e3d8-4f72-b1b0-13918cae152e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:12.061299 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24907498-e3d8-4f72-b1b0-13918cae152e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:12.061759 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-24907498-e3d8-4f72-b1b0-13918cae152e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lazy-loading 'fault' on Instance uuid dd096aa4-077a-4c95-a3cc-b40763f12038 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:17:12.105841 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-24907498-e3d8-4f72-b1b0-13918cae152e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a83de00ae4445a1efd17d70990630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b4ef10957e43b8a57a419fa0d6de0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:12.113796 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-24907498-e3d8-4f72-b1b0-13918cae152e tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038" status: 200 len: 1357 microversion: 2.1 time: 0.103966 Oct 18 16:17:12.114323 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3250/6522] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:12 2022] GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038 => generated 1357 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:12.727269 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6dd8cfe8-5f14-44eb-9a81-63fd1fd05152 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:12.727966 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6dd8cfe8-5f14-44eb-9a81-63fd1fd05152 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: dc3686dc-c474-41ab-8def-d8a4a0ef9a7d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:12.734111 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6dd8cfe8-5f14-44eb-9a81-63fd1fd05152 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:12.734592 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6dd8cfe8-5f14-44eb-9a81-63fd1fd05152 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:12.735024 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6dd8cfe8-5f14-44eb-9a81-63fd1fd05152 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:12.735697 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6dd8cfe8-5f14-44eb-9a81-63fd1fd05152 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:12.736645 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6dd8cfe8-5f14-44eb-9a81-63fd1fd05152 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:12.737090 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6dd8cfe8-5f14-44eb-9a81-63fd1fd05152 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:12.866636 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6dd8cfe8-5f14-44eb-9a81-63fd1fd05152 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:12.874642 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6dd8cfe8-5f14-44eb-9a81-63fd1fd05152 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d" status: 200 len: 1389 microversion: 2.1 time: 0.152437 Oct 18 16:17:12.875226 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3273/6523] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:12 2022] GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d => generated 1389 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:12.897719 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b8b0927f-c96d-4735-b37a-15fad023c2e4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:12.898338 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b8b0927f-c96d-4735-b37a-15fad023c2e4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: dc3686dc-c474-41ab-8def-d8a4a0ef9a7d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:12.904613 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8b0927f-c96d-4735-b37a-15fad023c2e4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:12.905177 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8b0927f-c96d-4735-b37a-15fad023c2e4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:12.905780 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8b0927f-c96d-4735-b37a-15fad023c2e4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:12.906618 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8b0927f-c96d-4735-b37a-15fad023c2e4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:12.907074 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8b0927f-c96d-4735-b37a-15fad023c2e4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:12.907498 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8b0927f-c96d-4735-b37a-15fad023c2e4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:13.040777 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b8b0927f-c96d-4735-b37a-15fad023c2e4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:13.049581 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b8b0927f-c96d-4735-b37a-15fad023c2e4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d" status: 200 len: 1389 microversion: 2.1 time: 0.155939 Oct 18 16:17:13.050156 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3251/6524] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:12 2022] GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d => generated 1389 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:13.071942 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-95018f70-aa65-43b9-a104-80c7fc3c0b6d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:13.072561 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-95018f70-aa65-43b9-a104-80c7fc3c0b6d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: dc3686dc-c474-41ab-8def-d8a4a0ef9a7d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:13.078535 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-95018f70-aa65-43b9-a104-80c7fc3c0b6d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:13.079019 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-95018f70-aa65-43b9-a104-80c7fc3c0b6d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:13.079495 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-95018f70-aa65-43b9-a104-80c7fc3c0b6d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:13.080186 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-95018f70-aa65-43b9-a104-80c7fc3c0b6d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:13.080640 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-95018f70-aa65-43b9-a104-80c7fc3c0b6d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:13.081102 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-95018f70-aa65-43b9-a104-80c7fc3c0b6d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:13.100038 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:13.137329 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c6e3cc72-b6f3-42b5-85b2-5e2f5661ec94 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:13.138086 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c6e3cc72-b6f3-42b5-85b2-5e2f5661ec94 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] [instance: dd096aa4-077a-4c95-a3cc-b40763f12038] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:13.144307 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6e3cc72-b6f3-42b5-85b2-5e2f5661ec94 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:13.144943 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6e3cc72-b6f3-42b5-85b2-5e2f5661ec94 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:13.145491 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6e3cc72-b6f3-42b5-85b2-5e2f5661ec94 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:13.146270 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6e3cc72-b6f3-42b5-85b2-5e2f5661ec94 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:13.146778 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6e3cc72-b6f3-42b5-85b2-5e2f5661ec94 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:13.147211 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6e3cc72-b6f3-42b5-85b2-5e2f5661ec94 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:13.162276 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-c6e3cc72-b6f3-42b5-85b2-5e2f5661ec94 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] HTTP exception thrown: Instance dd096aa4-077a-4c95-a3cc-b40763f12038 could not be found. Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c6e3cc72-b6f3-42b5-85b2-5e2f5661ec94 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Request method failure captured: Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038 HTTP/1.1 Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTs8upjSfiwu14tRxn4v0SgmAedKIqRyez8Aw8SOZdWUfAF0oMQr1R7xRzarToYQHo42vdtsSxTu7-2HkwGui-JshrtyxJTkQsS83jVEOu3jeAOKtt4DIMDKQgSeb11ABNJcyR5RNHKJLx2pVrTjzxDpmJ_EBIOFJJALPV4oSx6sXUQQ Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: a7b4ef10957e43b8a57a419fa0d6de0e Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-581510455 Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a7b4ef10957e43b8a57a419fa0d6de0e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a7b4ef10957e43b8a57a419fa0d6de0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a7b4ef10957e43b8a57a419fa0d6de0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a7b4ef10957e43b8a57a419fa0d6de0e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-TestNetworkAdvancedServerOps-581510455 Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: a7b4ef10957e43b8a57a419fa0d6de0e Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-581510455 Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-TestNetworkAdvancedServerOps-581510455-project Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 153a83de00ae4445a1efd17d70990630 Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-TestNetworkAdvancedServerOps-581510455-project Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance dd096aa4-077a-4c95-a3cc-b40763f12038 could not be found. Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'dd096aa4-077a-4c95-a3cc-b40763f12038'} Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd096aa4-077a-4c95-a3cc-b40763f12038 could not be found. Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd096aa4-077a-4c95-a3cc-b40763f12038 could not be found. Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:17:13.163968 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:17:13.169728 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:17:13.169728 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:17:13.169728 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:17:13.169728 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:17:13.169728 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:17:13.169728 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:17:13.169728 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd096aa4-077a-4c95-a3cc-b40763f12038 could not be found. Oct 18 16:17:13.169728 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:17:13.169728 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c6e3cc72-b6f3-42b5-85b2-5e2f5661ec94 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Returning 404 to user: Instance dd096aa4-077a-4c95-a3cc-b40763f12038 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:17:13.169728 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c6e3cc72-b6f3-42b5-85b2-5e2f5661ec94 tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038" status: 404 len: 111 microversion: 2.1 time: 0.032575 Oct 18 16:17:13.169728 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3252/6525] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:13 2022] GET /compute/v2.1/servers/dd096aa4-077a-4c95-a3cc-b40763f12038 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 16:17:13.215218 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-95018f70-aa65-43b9-a104-80c7fc3c0b6d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:13.224328 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-95018f70-aa65-43b9-a104-80c7fc3c0b6d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d" status: 200 len: 1389 microversion: 2.1 time: 0.156192 Oct 18 16:17:13.224923 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3274/6526] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:13 2022] GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d => generated 1389 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:13.311655 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-864a8579-8c38-4e11-948b-71e6e04ff971 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:13.312165 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-864a8579-8c38-4e11-948b-71e6e04ff971 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: dc3686dc-c474-41ab-8def-d8a4a0ef9a7d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:13.318800 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-864a8579-8c38-4e11-948b-71e6e04ff971 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:13.319291 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-864a8579-8c38-4e11-948b-71e6e04ff971 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:13.319735 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-864a8579-8c38-4e11-948b-71e6e04ff971 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:13.320433 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-864a8579-8c38-4e11-948b-71e6e04ff971 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:13.320921 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-864a8579-8c38-4e11-948b-71e6e04ff971 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:13.321367 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-864a8579-8c38-4e11-948b-71e6e04ff971 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:13.350353 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-864a8579-8c38-4e11-948b-71e6e04ff971 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: dc3686dc-c474-41ab-8def-d8a4a0ef9a7d] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:17:13.427818 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-864a8579-8c38-4e11-948b-71e6e04ff971 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "DELETE /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d" status: 204 len: 0 microversion: 2.1 time: 0.119798 Oct 18 16:17:13.428690 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3253/6527] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 16:17:13 2022] DELETE /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:17:13.437012 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d2b67d93-0172-40f0-b8d1-2e24d9e42e67 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:13.437890 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d2b67d93-0172-40f0-b8d1-2e24d9e42e67 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: dc3686dc-c474-41ab-8def-d8a4a0ef9a7d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:13.444836 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d2b67d93-0172-40f0-b8d1-2e24d9e42e67 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:13.445409 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d2b67d93-0172-40f0-b8d1-2e24d9e42e67 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:13.445852 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d2b67d93-0172-40f0-b8d1-2e24d9e42e67 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:13.446681 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d2b67d93-0172-40f0-b8d1-2e24d9e42e67 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:13.447150 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d2b67d93-0172-40f0-b8d1-2e24d9e42e67 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:13.447586 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d2b67d93-0172-40f0-b8d1-2e24d9e42e67 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:13.584436 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d2b67d93-0172-40f0-b8d1-2e24d9e42e67 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:13.592358 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d2b67d93-0172-40f0-b8d1-2e24d9e42e67 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d" status: 200 len: 1395 microversion: 2.1 time: 0.159351 Oct 18 16:17:13.592967 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3275/6528] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:13 2022] GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d => generated 1395 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:14.617120 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-097ce0a9-1d5c-4c29-ad04-14a8a3b0c8ab tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:14.617847 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-097ce0a9-1d5c-4c29-ad04-14a8a3b0c8ab tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: dc3686dc-c474-41ab-8def-d8a4a0ef9a7d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:14.625165 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-097ce0a9-1d5c-4c29-ad04-14a8a3b0c8ab tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:14.625991 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-097ce0a9-1d5c-4c29-ad04-14a8a3b0c8ab tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:14.626670 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-097ce0a9-1d5c-4c29-ad04-14a8a3b0c8ab tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:14.627516 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-097ce0a9-1d5c-4c29-ad04-14a8a3b0c8ab tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:14.628276 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-097ce0a9-1d5c-4c29-ad04-14a8a3b0c8ab tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:14.628671 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-097ce0a9-1d5c-4c29-ad04-14a8a3b0c8ab tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:14.773925 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-097ce0a9-1d5c-4c29-ad04-14a8a3b0c8ab tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:14.782516 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-097ce0a9-1d5c-4c29-ad04-14a8a3b0c8ab tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d" status: 200 len: 1395 microversion: 2.1 time: 0.169958 Oct 18 16:17:14.783663 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3254/6529] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:14 2022] GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d => generated 1395 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:15.429026 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-fb9f9290-9fc0-40c6-8306-0cbe627350e0 req-885d2ab9-6f18-4f83-81c2-0c2c12c4deab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc3686dc-c474-41ab-8def-d8a4a0ef9a7d", "name": "network-vif-deleted", "tag": "b3f1ffab-281a-4434-8305-68889836bd51"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:17:15.434984 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:15.444659 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-fb9f9290-9fc0-40c6-8306-0cbe627350e0 req-885d2ab9-6f18-4f83-81c2-0c2c12c4deab service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:15.445450 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-fb9f9290-9fc0-40c6-8306-0cbe627350e0 req-885d2ab9-6f18-4f83-81c2-0c2c12c4deab service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:15.446054 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-fb9f9290-9fc0-40c6-8306-0cbe627350e0 req-885d2ab9-6f18-4f83-81c2-0c2c12c4deab service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:15.462197 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-fb9f9290-9fc0-40c6-8306-0cbe627350e0 req-885d2ab9-6f18-4f83-81c2-0c2c12c4deab service nova] Creating event network-vif-deleted:b3f1ffab-281a-4434-8305-68889836bd51 for instance dc3686dc-c474-41ab-8def-d8a4a0ef9a7d on n-h2-853682-5 Oct 18 16:17:15.470278 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-fb9f9290-9fc0-40c6-8306-0cbe627350e0 req-885d2ab9-6f18-4f83-81c2-0c2c12c4deab service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046646 Oct 18 16:17:15.471036 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3276/6530] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:17:15.808372 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-37a6bbf4-8fb9-409a-aea5-f31ba0bd121b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:15.809055 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-37a6bbf4-8fb9-409a-aea5-f31ba0bd121b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: dc3686dc-c474-41ab-8def-d8a4a0ef9a7d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:15.820921 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-37a6bbf4-8fb9-409a-aea5-f31ba0bd121b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:15.821428 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-37a6bbf4-8fb9-409a-aea5-f31ba0bd121b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:15.821877 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-37a6bbf4-8fb9-409a-aea5-f31ba0bd121b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:15.822601 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-37a6bbf4-8fb9-409a-aea5-f31ba0bd121b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:15.823066 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-37a6bbf4-8fb9-409a-aea5-f31ba0bd121b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:15.823498 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-37a6bbf4-8fb9-409a-aea5-f31ba0bd121b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:15.956493 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-37a6bbf4-8fb9-409a-aea5-f31ba0bd121b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:15.969115 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-37a6bbf4-8fb9-409a-aea5-f31ba0bd121b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d" status: 200 len: 1188 microversion: 2.1 time: 0.165088 Oct 18 16:17:15.969994 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3255/6531] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:15 2022] GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d => generated 1188 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:16.891092 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-009a8bd4-6392-4e0e-b135-03e90b8311ca tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] Calling method '.version_select at 0x7f7c3d0c3550>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:16.934570 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-009a8bd4-6392-4e0e-b135-03e90b8311ca tempest-TestNetworkAdvancedServerOps-581510455 tempest-TestNetworkAdvancedServerOps-581510455-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1950808725" status: 202 len: 0 microversion: 2.1 time: 0.046021 Oct 18 16:17:16.935788 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3277/6532] 10.222.0.60 () {58 vars in 1284 bytes} [Tue Oct 18 16:17:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1950808725 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:17:16.995426 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cb405d8e-a7d1-4ed3-9739-3c7d0bdfc2d4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:16.996743 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cb405d8e-a7d1-4ed3-9739-3c7d0bdfc2d4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: dc3686dc-c474-41ab-8def-d8a4a0ef9a7d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:17.005219 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb405d8e-a7d1-4ed3-9739-3c7d0bdfc2d4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:17.006725 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb405d8e-a7d1-4ed3-9739-3c7d0bdfc2d4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:17.007392 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb405d8e-a7d1-4ed3-9739-3c7d0bdfc2d4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:17.010776 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb405d8e-a7d1-4ed3-9739-3c7d0bdfc2d4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:17.011953 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb405d8e-a7d1-4ed3-9739-3c7d0bdfc2d4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:17.012622 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb405d8e-a7d1-4ed3-9739-3c7d0bdfc2d4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:17.092860 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cb405d8e-a7d1-4ed3-9739-3c7d0bdfc2d4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:17.103773 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cb405d8e-a7d1-4ed3-9739-3c7d0bdfc2d4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d" status: 200 len: 1188 microversion: 2.1 time: 0.112041 Oct 18 16:17:17.104689 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3256/6533] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:16 2022] GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d => generated 1188 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:18.129660 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-36869a77-9cea-42ab-9878-c4863b4fe831 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:18.130411 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-36869a77-9cea-42ab-9878-c4863b4fe831 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: dc3686dc-c474-41ab-8def-d8a4a0ef9a7d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:18.137581 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-36869a77-9cea-42ab-9878-c4863b4fe831 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:18.138140 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-36869a77-9cea-42ab-9878-c4863b4fe831 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:18.138811 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-36869a77-9cea-42ab-9878-c4863b4fe831 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:18.139577 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-36869a77-9cea-42ab-9878-c4863b4fe831 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:18.140107 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-36869a77-9cea-42ab-9878-c4863b4fe831 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:18.140622 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-36869a77-9cea-42ab-9878-c4863b4fe831 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:18.209008 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-36869a77-9cea-42ab-9878-c4863b4fe831 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:18.219030 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-36869a77-9cea-42ab-9878-c4863b4fe831 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d" status: 200 len: 1188 microversion: 2.1 time: 0.095403 Oct 18 16:17:18.219620 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3278/6534] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:18 2022] GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d => generated 1188 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:19.254665 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-93032860-4e6c-4869-980b-11807981859a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:19.255797 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-93032860-4e6c-4869-980b-11807981859a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: dc3686dc-c474-41ab-8def-d8a4a0ef9a7d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:19.270099 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-93032860-4e6c-4869-980b-11807981859a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:19.272658 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-93032860-4e6c-4869-980b-11807981859a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:19.273320 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-93032860-4e6c-4869-980b-11807981859a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:19.275523 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-93032860-4e6c-4869-980b-11807981859a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:19.276146 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-93032860-4e6c-4869-980b-11807981859a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:19.276766 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-93032860-4e6c-4869-980b-11807981859a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:19.406148 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-93032860-4e6c-4869-980b-11807981859a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:19.415609 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-93032860-4e6c-4869-980b-11807981859a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d" status: 200 len: 1188 microversion: 2.1 time: 0.175514 Oct 18 16:17:19.432859 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3257/6535] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:19 2022] GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d => generated 1188 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:20.442529 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-da7226bf-2180-455f-b922-cbf079336c6c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:20.443944 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-da7226bf-2180-455f-b922-cbf079336c6c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: dc3686dc-c474-41ab-8def-d8a4a0ef9a7d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:20.450999 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-da7226bf-2180-455f-b922-cbf079336c6c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:20.451625 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-da7226bf-2180-455f-b922-cbf079336c6c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:20.463156 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-da7226bf-2180-455f-b922-cbf079336c6c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:20.464295 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-da7226bf-2180-455f-b922-cbf079336c6c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:20.465432 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-da7226bf-2180-455f-b922-cbf079336c6c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:20.466101 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-da7226bf-2180-455f-b922-cbf079336c6c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:20.535072 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-da7226bf-2180-455f-b922-cbf079336c6c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:20.535563 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-da7226bf-2180-455f-b922-cbf079336c6c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:20.538760 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-da7226bf-2180-455f-b922-cbf079336c6c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:20.539408 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-da7226bf-2180-455f-b922-cbf079336c6c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lazy-loading 'fault' on Instance uuid dc3686dc-c474-41ab-8def-d8a4a0ef9a7d {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:17:20.630495 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-da7226bf-2180-455f-b922-cbf079336c6c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:20.641258 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-da7226bf-2180-455f-b922-cbf079336c6c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d" status: 200 len: 1193 microversion: 2.1 time: 0.204169 Oct 18 16:17:20.654143 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3279/6536] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:20 2022] GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d => generated 1193 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:21.245454 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c8956518-7bea-4e16-8d2c-428b1fb00d07 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1342936589", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "f979addd-f499-4348-b33b-656cd5eed15a"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:17:21.300268 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-c8956518-7bea-4e16-8d2c-428b1fb00d07 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] validate_networks() for [('f979addd-f499-4348-b33b-656cd5eed15a', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 16:17:21.667130 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-c8956518-7bea-4e16-8d2c-428b1fb00d07 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:17:21.667571 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-c8956518-7bea-4e16-8d2c-428b1fb00d07 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:17:21.668084 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-c8956518-7bea-4e16-8d2c-428b1fb00d07 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:17:21.668533 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-c8956518-7bea-4e16-8d2c-428b1fb00d07 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:17:21.668956 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c12c38f2-c3e4-48f4-82f4-3f10b81294da tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:21.669523 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-c8956518-7bea-4e16-8d2c-428b1fb00d07 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:17:21.670062 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c12c38f2-c3e4-48f4-82f4-3f10b81294da tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: dc3686dc-c474-41ab-8def-d8a4a0ef9a7d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:21.676998 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c12c38f2-c3e4-48f4-82f4-3f10b81294da tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:21.677748 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c12c38f2-c3e4-48f4-82f4-3f10b81294da tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:21.678522 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c12c38f2-c3e4-48f4-82f4-3f10b81294da tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:21.678784 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8956518-7bea-4e16-8d2c-428b1fb00d07 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:21.679277 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8956518-7bea-4e16-8d2c-428b1fb00d07 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:21.679587 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c12c38f2-c3e4-48f4-82f4-3f10b81294da tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:21.680033 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8956518-7bea-4e16-8d2c-428b1fb00d07 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:21.680151 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c12c38f2-c3e4-48f4-82f4-3f10b81294da tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:21.680633 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c12c38f2-c3e4-48f4-82f4-3f10b81294da tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:21.680954 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8956518-7bea-4e16-8d2c-428b1fb00d07 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:21.681575 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8956518-7bea-4e16-8d2c-428b1fb00d07 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:21.682170 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8956518-7bea-4e16-8d2c-428b1fb00d07 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:21.696951 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-c12c38f2-c3e4-48f4-82f4-3f10b81294da tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] HTTP exception thrown: Instance dc3686dc-c474-41ab-8def-d8a4a0ef9a7d could not be found. Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c12c38f2-c3e4-48f4-82f4-3f10b81294da tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Request method failure captured: Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d HTTP/1.1 Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTtEVF9uJ-JO9Xs31vnHSSsjSYlxrsUC5zmDUZwq19epJ_KRexhuRnv973VnMOHKUrtuEaLEal20PXz-3F2SqeQ_VcN02CwN6WkvucYcQaG_QXU6RKnbyMb6Baxa9c0pM4Y0eYUesqFYGvUA-9UWLfliXu3xhi5bS1_xU9JBCKzY9b2g Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: c05254b186b04c9cb9858f621938caca Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-TestVolumeBootPattern-1353957077 Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c05254b186b04c9cb9858f621938caca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c05254b186b04c9cb9858f621938caca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c05254b186b04c9cb9858f621938caca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c05254b186b04c9cb9858f621938caca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-TestVolumeBootPattern-1353957077 Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: c05254b186b04c9cb9858f621938caca Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-TestVolumeBootPattern-1353957077 Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-TestVolumeBootPattern-1353957077-project Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: b9f9ae9e929c416a9298499ab8694d37 Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-TestVolumeBootPattern-1353957077-project Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance dc3686dc-c474-41ab-8def-d8a4a0ef9a7d could not be found. Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'dc3686dc-c474-41ab-8def-d8a4a0ef9a7d'} Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc3686dc-c474-41ab-8def-d8a4a0ef9a7d could not be found. Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc3686dc-c474-41ab-8def-d8a4a0ef9a7d could not be found. Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:17:21.699149 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:17:21.703600 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:17:21.703600 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:17:21.703600 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:17:21.703600 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:17:21.703600 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:17:21.703600 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc3686dc-c474-41ab-8def-d8a4a0ef9a7d could not be found. Oct 18 16:17:21.703600 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:17:21.703600 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c12c38f2-c3e4-48f4-82f4-3f10b81294da tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Returning 404 to user: Instance dc3686dc-c474-41ab-8def-d8a4a0ef9a7d could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:17:21.703600 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c12c38f2-c3e4-48f4-82f4-3f10b81294da tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d" status: 404 len: 111 microversion: 2.1 time: 0.039194 Oct 18 16:17:21.704339 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-c8956518-7bea-4e16-8d2c-428b1fb00d07 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Getting quotas for project 4d9898ac37024f309f783b113e1a01f7. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:17:21.710519 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-c8956518-7bea-4e16-8d2c-428b1fb00d07 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Getting quotas for user a417376bcf4a4180b8ad2a4d19ad108c and project 4d9898ac37024f309f783b113e1a01f7. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:17:21.718352 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3280/6537] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:21 2022] GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 16:17:21.723563 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c8956518-7bea-4e16-8d2c-428b1fb00d07 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:17:21.725911 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c8956518-7bea-4e16-8d2c-428b1fb00d07 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] [instance: 5cac62fd-fe3c-4cab-987a-41b9f256f459] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:17:21.774504 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c8956518-7bea-4e16-8d2c-428b1fb00d07 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.650421 Oct 18 16:17:21.781418 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3258/6538] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 16:17:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:17:21.786982 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7495bee6-afa9-44f4-bc56-875b94a74f72 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:21.787608 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7495bee6-afa9-44f4-bc56-875b94a74f72 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] [instance: 5cac62fd-fe3c-4cab-987a-41b9f256f459] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:21.844285 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7495bee6-afa9-44f4-bc56-875b94a74f72 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a417376bcf4a4180b8ad2a4d19ad108c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9898ac37024f309f783b113e1a01f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:21.852116 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7495bee6-afa9-44f4-bc56-875b94a74f72 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] 10.222.0.60 "GET /compute/v2.1/servers/5cac62fd-fe3c-4cab-987a-41b9f256f459" status: 200 len: 1215 microversion: 2.1 time: 0.069106 Oct 18 16:17:21.852698 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3281/6539] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:21 2022] GET /compute/v2.1/servers/5cac62fd-fe3c-4cab-987a-41b9f256f459 => generated 1215 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:22.875724 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-599e2d1c-d598-4443-a604-1c5510323d2e tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:22.876510 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-599e2d1c-d598-4443-a604-1c5510323d2e tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] [instance: 5cac62fd-fe3c-4cab-987a-41b9f256f459] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:22.886017 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-599e2d1c-d598-4443-a604-1c5510323d2e tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:22.886749 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-599e2d1c-d598-4443-a604-1c5510323d2e tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:22.887189 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-599e2d1c-d598-4443-a604-1c5510323d2e tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:22.887902 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-599e2d1c-d598-4443-a604-1c5510323d2e tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:22.888354 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-599e2d1c-d598-4443-a604-1c5510323d2e tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:22.889026 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-599e2d1c-d598-4443-a604-1c5510323d2e tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:22.965360 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-599e2d1c-d598-4443-a604-1c5510323d2e tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a417376bcf4a4180b8ad2a4d19ad108c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9898ac37024f309f783b113e1a01f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:22.973580 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-599e2d1c-d598-4443-a604-1c5510323d2e tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] 10.222.0.60 "GET /compute/v2.1/servers/5cac62fd-fe3c-4cab-987a-41b9f256f459" status: 200 len: 1285 microversion: 2.1 time: 0.102489 Oct 18 16:17:22.974157 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3259/6540] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:22 2022] GET /compute/v2.1/servers/5cac62fd-fe3c-4cab-987a-41b9f256f459 => generated 1285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:23.865744 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1e356018-b05c-4be4-9868-729f58e381fc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:23.866784 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1e356018-b05c-4be4-9868-729f58e381fc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: dc3686dc-c474-41ab-8def-d8a4a0ef9a7d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:23.874979 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1e356018-b05c-4be4-9868-729f58e381fc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:23.875648 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1e356018-b05c-4be4-9868-729f58e381fc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:23.876080 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1e356018-b05c-4be4-9868-729f58e381fc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:23.877031 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1e356018-b05c-4be4-9868-729f58e381fc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:23.877632 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1e356018-b05c-4be4-9868-729f58e381fc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:23.878218 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1e356018-b05c-4be4-9868-729f58e381fc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:23.896435 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-1e356018-b05c-4be4-9868-729f58e381fc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] HTTP exception thrown: Instance dc3686dc-c474-41ab-8def-d8a4a0ef9a7d could not be found. Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1e356018-b05c-4be4-9868-729f58e381fc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Request method failure captured: Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: request: DELETE /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d HTTP/1.1 Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTtEVF9uJ-JO9Xs31vnHSSsjSYlxrsUC5zmDUZwq19epJ_KRexhuRnv973VnMOHKUrtuEaLEal20PXz-3F2SqeQ_VcN02CwN6WkvucYcQaG_QXU6RKnbyMb6Baxa9c0pM4Y0eYUesqFYGvUA-9UWLfliXu3xhi5bS1_xU9JBCKzY9b2g Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: c05254b186b04c9cb9858f621938caca Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-TestVolumeBootPattern-1353957077 Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c05254b186b04c9cb9858f621938caca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c05254b186b04c9cb9858f621938caca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c05254b186b04c9cb9858f621938caca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c05254b186b04c9cb9858f621938caca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-TestVolumeBootPattern-1353957077 Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: c05254b186b04c9cb9858f621938caca Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-TestVolumeBootPattern-1353957077 Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-TestVolumeBootPattern-1353957077-project Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: b9f9ae9e929c416a9298499ab8694d37 Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-TestVolumeBootPattern-1353957077-project Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance dc3686dc-c474-41ab-8def-d8a4a0ef9a7d could not be found. Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'dc3686dc-c474-41ab-8def-d8a4a0ef9a7d'} Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc3686dc-c474-41ab-8def-d8a4a0ef9a7d could not be found. Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:17:23.898227 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:17:23.902242 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc3686dc-c474-41ab-8def-d8a4a0ef9a7d could not be found. Oct 18 16:17:23.902242 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:17:23.902242 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:17:23.902242 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:17:23.902242 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:17:23.902242 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:17:23.902242 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:17:23.902242 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:17:23.902242 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:17:23.902242 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc3686dc-c474-41ab-8def-d8a4a0ef9a7d could not be found. Oct 18 16:17:23.902242 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:17:23.903572 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1e356018-b05c-4be4-9868-729f58e381fc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Returning 404 to user: Instance dc3686dc-c474-41ab-8def-d8a4a0ef9a7d could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:17:23.905049 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1e356018-b05c-4be4-9868-729f58e381fc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "DELETE /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d" status: 404 len: 111 microversion: 2.1 time: 0.043583 Oct 18 16:17:23.906482 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3282/6541] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 16:17:23 2022] DELETE /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:17:23.915768 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2f218017-5054-4efb-936a-db751c8c8edf tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:23.917481 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2f218017-5054-4efb-936a-db751c8c8edf tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: dc3686dc-c474-41ab-8def-d8a4a0ef9a7d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:23.925570 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f218017-5054-4efb-936a-db751c8c8edf tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:23.926577 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f218017-5054-4efb-936a-db751c8c8edf tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:23.927174 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f218017-5054-4efb-936a-db751c8c8edf tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:23.928043 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f218017-5054-4efb-936a-db751c8c8edf tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:23.928976 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f218017-5054-4efb-936a-db751c8c8edf tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:23.929581 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f218017-5054-4efb-936a-db751c8c8edf tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:23.947415 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-2f218017-5054-4efb-936a-db751c8c8edf tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] HTTP exception thrown: Instance dc3686dc-c474-41ab-8def-d8a4a0ef9a7d could not be found. Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2f218017-5054-4efb-936a-db751c8c8edf tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Request method failure captured: Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d HTTP/1.1 Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTtEVF9uJ-JO9Xs31vnHSSsjSYlxrsUC5zmDUZwq19epJ_KRexhuRnv973VnMOHKUrtuEaLEal20PXz-3F2SqeQ_VcN02CwN6WkvucYcQaG_QXU6RKnbyMb6Baxa9c0pM4Y0eYUesqFYGvUA-9UWLfliXu3xhi5bS1_xU9JBCKzY9b2g Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: c05254b186b04c9cb9858f621938caca Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-TestVolumeBootPattern-1353957077 Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c05254b186b04c9cb9858f621938caca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c05254b186b04c9cb9858f621938caca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c05254b186b04c9cb9858f621938caca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c05254b186b04c9cb9858f621938caca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-TestVolumeBootPattern-1353957077 Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: c05254b186b04c9cb9858f621938caca Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-TestVolumeBootPattern-1353957077 Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-TestVolumeBootPattern-1353957077-project Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: b9f9ae9e929c416a9298499ab8694d37 Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-TestVolumeBootPattern-1353957077-project Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance dc3686dc-c474-41ab-8def-d8a4a0ef9a7d could not be found. Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'dc3686dc-c474-41ab-8def-d8a4a0ef9a7d'} Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc3686dc-c474-41ab-8def-d8a4a0ef9a7d could not be found. Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc3686dc-c474-41ab-8def-d8a4a0ef9a7d could not be found. Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:17:23.949355 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:17:23.953694 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:17:23.953694 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:17:23.953694 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:17:23.953694 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:17:23.953694 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:17:23.953694 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc3686dc-c474-41ab-8def-d8a4a0ef9a7d could not be found. Oct 18 16:17:23.953694 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:17:23.955738 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2f218017-5054-4efb-936a-db751c8c8edf tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Returning 404 to user: Instance dc3686dc-c474-41ab-8def-d8a4a0ef9a7d could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:17:23.956946 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2f218017-5054-4efb-936a-db751c8c8edf tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d" status: 404 len: 111 microversion: 2.1 time: 0.045612 Oct 18 16:17:23.957993 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3260/6542] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:23 2022] GET /compute/v2.1/servers/dc3686dc-c474-41ab-8def-d8a4a0ef9a7d => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:17:23.996890 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e7504673-e66a-46ce-8471-654cdec4e573 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:23.997894 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e7504673-e66a-46ce-8471-654cdec4e573 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] [instance: 5cac62fd-fe3c-4cab-987a-41b9f256f459] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:24.004899 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e7504673-e66a-46ce-8471-654cdec4e573 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:24.005703 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e7504673-e66a-46ce-8471-654cdec4e573 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:24.006341 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e7504673-e66a-46ce-8471-654cdec4e573 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:24.007276 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e7504673-e66a-46ce-8471-654cdec4e573 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:24.007812 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e7504673-e66a-46ce-8471-654cdec4e573 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:24.008320 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e7504673-e66a-46ce-8471-654cdec4e573 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:24.221226 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e7504673-e66a-46ce-8471-654cdec4e573 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a417376bcf4a4180b8ad2a4d19ad108c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9898ac37024f309f783b113e1a01f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:24.230149 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e7504673-e66a-46ce-8471-654cdec4e573 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] 10.222.0.60 "GET /compute/v2.1/servers/5cac62fd-fe3c-4cab-987a-41b9f256f459" status: 200 len: 1315 microversion: 2.1 time: 0.237118 Oct 18 16:17:24.230837 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3283/6543] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:23 2022] GET /compute/v2.1/servers/5cac62fd-fe3c-4cab-987a-41b9f256f459 => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:24.315148 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-927a2e7f-2a1b-4df1-8c6d-7545481c4780 req-0810fa4f-38f8-4336-8f1e-d2a75dbe5203 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cac62fd-fe3c-4cab-987a-41b9f256f459", "tag": "6d6f453a-036c-4ef8-9715-fca81c010f1c"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:17:24.336238 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-927a2e7f-2a1b-4df1-8c6d-7545481c4780 req-0810fa4f-38f8-4336-8f1e-d2a75dbe5203 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:24.337135 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-927a2e7f-2a1b-4df1-8c6d-7545481c4780 req-0810fa4f-38f8-4336-8f1e-d2a75dbe5203 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:24.337618 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-927a2e7f-2a1b-4df1-8c6d-7545481c4780 req-0810fa4f-38f8-4336-8f1e-d2a75dbe5203 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:24.351063 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-927a2e7f-2a1b-4df1-8c6d-7545481c4780 req-0810fa4f-38f8-4336-8f1e-d2a75dbe5203 service nova] Creating event network-changed:6d6f453a-036c-4ef8-9715-fca81c010f1c for instance 5cac62fd-fe3c-4cab-987a-41b9f256f459 on n-h2-853682-5 Oct 18 16:17:24.356059 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-927a2e7f-2a1b-4df1-8c6d-7545481c4780 req-0810fa4f-38f8-4336-8f1e-d2a75dbe5203 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046638 Oct 18 16:17:24.356876 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3261/6544] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:17:25.254668 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-87a19df7-ddd0-4294-afb8-77f446cc43b3 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:25.255291 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-87a19df7-ddd0-4294-afb8-77f446cc43b3 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] [instance: 5cac62fd-fe3c-4cab-987a-41b9f256f459] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:25.266305 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-87a19df7-ddd0-4294-afb8-77f446cc43b3 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:25.269706 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-87a19df7-ddd0-4294-afb8-77f446cc43b3 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:25.270629 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-87a19df7-ddd0-4294-afb8-77f446cc43b3 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:25.271667 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-87a19df7-ddd0-4294-afb8-77f446cc43b3 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:25.272209 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-87a19df7-ddd0-4294-afb8-77f446cc43b3 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:25.272752 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-87a19df7-ddd0-4294-afb8-77f446cc43b3 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:25.410649 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-87a19df7-ddd0-4294-afb8-77f446cc43b3 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a417376bcf4a4180b8ad2a4d19ad108c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9898ac37024f309f783b113e1a01f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:25.418907 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-87a19df7-ddd0-4294-afb8-77f446cc43b3 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] 10.222.0.60 "GET /compute/v2.1/servers/5cac62fd-fe3c-4cab-987a-41b9f256f459" status: 200 len: 1315 microversion: 2.1 time: 0.168816 Oct 18 16:17:25.419577 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3284/6545] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:25 2022] GET /compute/v2.1/servers/5cac62fd-fe3c-4cab-987a-41b9f256f459 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:26.439956 n-d-853682-5 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 16:17:26.440496 n-d-853682-5 devstack@n-api.service[120406]: Tue Oct 18 16:17:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5cac62fd-fe3c-4cab-987a-41b9f256f459 (ip 10.222.0.60) !!! Oct 18 16:17:26.445929 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-461cc6c2-fd77-4baa-a0be-e9037bf75b25 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:26.446665 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-461cc6c2-fd77-4baa-a0be-e9037bf75b25 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] [instance: 5cac62fd-fe3c-4cab-987a-41b9f256f459] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:26.464259 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-461cc6c2-fd77-4baa-a0be-e9037bf75b25 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:26.464748 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-461cc6c2-fd77-4baa-a0be-e9037bf75b25 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:26.465219 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-461cc6c2-fd77-4baa-a0be-e9037bf75b25 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:26.465920 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-461cc6c2-fd77-4baa-a0be-e9037bf75b25 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:26.466420 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-461cc6c2-fd77-4baa-a0be-e9037bf75b25 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:26.466794 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-461cc6c2-fd77-4baa-a0be-e9037bf75b25 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:26.601502 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-461cc6c2-fd77-4baa-a0be-e9037bf75b25 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a417376bcf4a4180b8ad2a4d19ad108c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9898ac37024f309f783b113e1a01f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:26.609769 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-461cc6c2-fd77-4baa-a0be-e9037bf75b25 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] 10.222.0.60 "GET /compute/v2.1/servers/5cac62fd-fe3c-4cab-987a-41b9f256f459" status: 200 len: 1315 microversion: 2.1 time: 0.171210 Oct 18 16:17:26.610366 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3262/6546] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:26 2022] GET /compute/v2.1/servers/5cac62fd-fe3c-4cab-987a-41b9f256f459 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:27.633495 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7092e9a2-ff7c-4928-b5db-2ca8ee97f176 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:27.634026 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7092e9a2-ff7c-4928-b5db-2ca8ee97f176 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] [instance: 5cac62fd-fe3c-4cab-987a-41b9f256f459] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:27.641135 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7092e9a2-ff7c-4928-b5db-2ca8ee97f176 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:27.641627 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7092e9a2-ff7c-4928-b5db-2ca8ee97f176 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:27.642632 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7092e9a2-ff7c-4928-b5db-2ca8ee97f176 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:27.643349 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7092e9a2-ff7c-4928-b5db-2ca8ee97f176 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:27.643935 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7092e9a2-ff7c-4928-b5db-2ca8ee97f176 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:27.644369 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7092e9a2-ff7c-4928-b5db-2ca8ee97f176 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:27.781179 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7092e9a2-ff7c-4928-b5db-2ca8ee97f176 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a417376bcf4a4180b8ad2a4d19ad108c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9898ac37024f309f783b113e1a01f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:27.789414 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7092e9a2-ff7c-4928-b5db-2ca8ee97f176 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] 10.222.0.60 "GET /compute/v2.1/servers/5cac62fd-fe3c-4cab-987a-41b9f256f459" status: 200 len: 1315 microversion: 2.1 time: 0.160043 Oct 18 16:17:27.789984 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3285/6547] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:27 2022] GET /compute/v2.1/servers/5cac62fd-fe3c-4cab-987a-41b9f256f459 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:28.812364 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-167c3acf-4abc-4cc8-9c60-3d3a7d318190 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:28.812977 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-167c3acf-4abc-4cc8-9c60-3d3a7d318190 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] [instance: 5cac62fd-fe3c-4cab-987a-41b9f256f459] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:28.820158 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-167c3acf-4abc-4cc8-9c60-3d3a7d318190 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:28.820650 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-167c3acf-4abc-4cc8-9c60-3d3a7d318190 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:28.821120 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-167c3acf-4abc-4cc8-9c60-3d3a7d318190 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:28.821828 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-167c3acf-4abc-4cc8-9c60-3d3a7d318190 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:28.822289 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-167c3acf-4abc-4cc8-9c60-3d3a7d318190 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:28.822717 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-167c3acf-4abc-4cc8-9c60-3d3a7d318190 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:28.827554 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:28.974694 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-167c3acf-4abc-4cc8-9c60-3d3a7d318190 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a417376bcf4a4180b8ad2a4d19ad108c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9898ac37024f309f783b113e1a01f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:28.983077 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-167c3acf-4abc-4cc8-9c60-3d3a7d318190 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] 10.222.0.60 "GET /compute/v2.1/servers/5cac62fd-fe3c-4cab-987a-41b9f256f459" status: 200 len: 1315 microversion: 2.1 time: 0.174870 Oct 18 16:17:28.983650 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3263/6548] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:28 2022] GET /compute/v2.1/servers/5cac62fd-fe3c-4cab-987a-41b9f256f459 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:29.174452 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-2e1bcbbb-34c9-4921-87e8-45decf6aa233 req-30412073-c638-45f5-8053-2f87e71a6a5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cac62fd-fe3c-4cab-987a-41b9f256f459", "name": "network-vif-plugged", "status": "completed", "tag": "6d6f453a-036c-4ef8-9715-fca81c010f1c"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:17:29.189548 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-2e1bcbbb-34c9-4921-87e8-45decf6aa233 req-30412073-c638-45f5-8053-2f87e71a6a5a service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:29.190235 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-2e1bcbbb-34c9-4921-87e8-45decf6aa233 req-30412073-c638-45f5-8053-2f87e71a6a5a service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:29.190838 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-2e1bcbbb-34c9-4921-87e8-45decf6aa233 req-30412073-c638-45f5-8053-2f87e71a6a5a service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:29.202836 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-2e1bcbbb-34c9-4921-87e8-45decf6aa233 req-30412073-c638-45f5-8053-2f87e71a6a5a service nova] Creating event network-vif-plugged:6d6f453a-036c-4ef8-9715-fca81c010f1c for instance 5cac62fd-fe3c-4cab-987a-41b9f256f459 on n-h2-853682-5 Oct 18 16:17:29.208863 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-2e1bcbbb-34c9-4921-87e8-45decf6aa233 req-30412073-c638-45f5-8053-2f87e71a6a5a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038179 Oct 18 16:17:29.209952 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3286/6549] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:17:30.007420 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-332d0c3f-b5c6-4650-a85b-93c84ee6430a tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:30.008247 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-332d0c3f-b5c6-4650-a85b-93c84ee6430a tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] [instance: 5cac62fd-fe3c-4cab-987a-41b9f256f459] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:30.015231 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-332d0c3f-b5c6-4650-a85b-93c84ee6430a tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:30.015724 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-332d0c3f-b5c6-4650-a85b-93c84ee6430a tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:30.016163 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-332d0c3f-b5c6-4650-a85b-93c84ee6430a tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:30.016883 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-332d0c3f-b5c6-4650-a85b-93c84ee6430a tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:30.017346 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-332d0c3f-b5c6-4650-a85b-93c84ee6430a tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:30.019791 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-332d0c3f-b5c6-4650-a85b-93c84ee6430a tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:30.152067 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-332d0c3f-b5c6-4650-a85b-93c84ee6430a tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a417376bcf4a4180b8ad2a4d19ad108c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9898ac37024f309f783b113e1a01f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:30.161099 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-332d0c3f-b5c6-4650-a85b-93c84ee6430a tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] 10.222.0.60 "GET /compute/v2.1/servers/5cac62fd-fe3c-4cab-987a-41b9f256f459" status: 200 len: 1315 microversion: 2.1 time: 0.157362 Oct 18 16:17:30.162001 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3264/6550] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:30 2022] GET /compute/v2.1/servers/5cac62fd-fe3c-4cab-987a-41b9f256f459 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:31.185790 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f7fb39a9-5e5f-4135-b304-f934d4e8beb2 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:31.186496 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f7fb39a9-5e5f-4135-b304-f934d4e8beb2 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] [instance: 5cac62fd-fe3c-4cab-987a-41b9f256f459] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:31.193630 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f7fb39a9-5e5f-4135-b304-f934d4e8beb2 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:31.194131 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f7fb39a9-5e5f-4135-b304-f934d4e8beb2 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:31.194580 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f7fb39a9-5e5f-4135-b304-f934d4e8beb2 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:31.195295 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f7fb39a9-5e5f-4135-b304-f934d4e8beb2 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:31.195786 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f7fb39a9-5e5f-4135-b304-f934d4e8beb2 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:31.196218 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f7fb39a9-5e5f-4135-b304-f934d4e8beb2 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:31.334796 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f7fb39a9-5e5f-4135-b304-f934d4e8beb2 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a417376bcf4a4180b8ad2a4d19ad108c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9898ac37024f309f783b113e1a01f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:31.342650 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f7fb39a9-5e5f-4135-b304-f934d4e8beb2 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] 10.222.0.60 "GET /compute/v2.1/servers/5cac62fd-fe3c-4cab-987a-41b9f256f459" status: 200 len: 1502 microversion: 2.1 time: 0.161981 Oct 18 16:17:31.343232 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3287/6551] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:31 2022] GET /compute/v2.1/servers/5cac62fd-fe3c-4cab-987a-41b9f256f459 => generated 1502 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:31.365613 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cbfe5f92-66fc-4c91-b8f3-22be4f0eb7e2 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:31.366166 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cbfe5f92-66fc-4c91-b8f3-22be4f0eb7e2 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] [instance: 5cac62fd-fe3c-4cab-987a-41b9f256f459] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:31.373214 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbfe5f92-66fc-4c91-b8f3-22be4f0eb7e2 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:31.373706 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbfe5f92-66fc-4c91-b8f3-22be4f0eb7e2 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:31.374151 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbfe5f92-66fc-4c91-b8f3-22be4f0eb7e2 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:31.374854 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbfe5f92-66fc-4c91-b8f3-22be4f0eb7e2 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:31.375317 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbfe5f92-66fc-4c91-b8f3-22be4f0eb7e2 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:31.375751 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbfe5f92-66fc-4c91-b8f3-22be4f0eb7e2 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:31.518279 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cbfe5f92-66fc-4c91-b8f3-22be4f0eb7e2 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a417376bcf4a4180b8ad2a4d19ad108c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9898ac37024f309f783b113e1a01f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:31.526182 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cbfe5f92-66fc-4c91-b8f3-22be4f0eb7e2 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] 10.222.0.60 "GET /compute/v2.1/servers/5cac62fd-fe3c-4cab-987a-41b9f256f459" status: 200 len: 1502 microversion: 2.1 time: 0.164623 Oct 18 16:17:31.526756 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3265/6552] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:31 2022] GET /compute/v2.1/servers/5cac62fd-fe3c-4cab-987a-41b9f256f459 => generated 1502 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:31.548779 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f28d67d5-ae0b-4594-807b-c9d2b5dfcec7 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:17:31.549353 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f28d67d5-ae0b-4594-807b-c9d2b5dfcec7 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] [instance: 5cac62fd-fe3c-4cab-987a-41b9f256f459] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:31.555884 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f28d67d5-ae0b-4594-807b-c9d2b5dfcec7 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:31.556385 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f28d67d5-ae0b-4594-807b-c9d2b5dfcec7 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:31.556842 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f28d67d5-ae0b-4594-807b-c9d2b5dfcec7 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:31.557569 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f28d67d5-ae0b-4594-807b-c9d2b5dfcec7 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:31.558039 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f28d67d5-ae0b-4594-807b-c9d2b5dfcec7 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:31.558476 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f28d67d5-ae0b-4594-807b-c9d2b5dfcec7 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:31.582728 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-f28d67d5-ae0b-4594-807b-c9d2b5dfcec7 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lazy-loading 'flavor' on Instance uuid 5cac62fd-fe3c-4cab-987a-41b9f256f459 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:17:31.651887 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f28d67d5-ae0b-4594-807b-c9d2b5dfcec7 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] 10.222.0.60 "POST /compute/v2.1/servers/5cac62fd-fe3c-4cab-987a-41b9f256f459/action" status: 202 len: 0 microversion: 2.1 time: 0.107254 Oct 18 16:17:31.655575 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3288/6553] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:17:31 2022] POST /compute/v2.1/servers/5cac62fd-fe3c-4cab-987a-41b9f256f459/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:17:31.661595 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-67720f34-4894-4403-b754-c857baba8b6a tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:31.662832 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-67720f34-4894-4403-b754-c857baba8b6a tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] [instance: 5cac62fd-fe3c-4cab-987a-41b9f256f459] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:31.672247 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67720f34-4894-4403-b754-c857baba8b6a tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:31.672995 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67720f34-4894-4403-b754-c857baba8b6a tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:31.674188 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67720f34-4894-4403-b754-c857baba8b6a tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:31.674907 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67720f34-4894-4403-b754-c857baba8b6a tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:31.675399 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67720f34-4894-4403-b754-c857baba8b6a tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:31.675827 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67720f34-4894-4403-b754-c857baba8b6a tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:31.693385 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:31.717472 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:31.818449 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-67720f34-4894-4403-b754-c857baba8b6a tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a417376bcf4a4180b8ad2a4d19ad108c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9898ac37024f309f783b113e1a01f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:31.826533 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-67720f34-4894-4403-b754-c857baba8b6a tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] 10.222.0.60 "GET /compute/v2.1/servers/5cac62fd-fe3c-4cab-987a-41b9f256f459" status: 200 len: 1510 microversion: 2.1 time: 0.168994 Oct 18 16:17:31.827125 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3266/6554] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:31 2022] GET /compute/v2.1/servers/5cac62fd-fe3c-4cab-987a-41b9f256f459 => generated 1510 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:32.846908 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:32.853006 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0339c3fb-a77f-4f3f-b6db-dd3201cce1cc tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:32.853725 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0339c3fb-a77f-4f3f-b6db-dd3201cce1cc tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] [instance: 5cac62fd-fe3c-4cab-987a-41b9f256f459] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:32.860428 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0339c3fb-a77f-4f3f-b6db-dd3201cce1cc tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:32.860942 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0339c3fb-a77f-4f3f-b6db-dd3201cce1cc tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:32.861387 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0339c3fb-a77f-4f3f-b6db-dd3201cce1cc tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:32.862086 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0339c3fb-a77f-4f3f-b6db-dd3201cce1cc tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:32.862699 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0339c3fb-a77f-4f3f-b6db-dd3201cce1cc tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:32.863306 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0339c3fb-a77f-4f3f-b6db-dd3201cce1cc tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:33.010293 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0339c3fb-a77f-4f3f-b6db-dd3201cce1cc tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a417376bcf4a4180b8ad2a4d19ad108c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9898ac37024f309f783b113e1a01f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:33.018796 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0339c3fb-a77f-4f3f-b6db-dd3201cce1cc tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] 10.222.0.60 "GET /compute/v2.1/servers/5cac62fd-fe3c-4cab-987a-41b9f256f459" status: 200 len: 1493 microversion: 2.1 time: 0.172876 Oct 18 16:17:33.019372 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3289/6555] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:32 2022] GET /compute/v2.1/servers/5cac62fd-fe3c-4cab-987a-41b9f256f459 => generated 1493 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:33.042042 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9c8d3fda-cdcd-42bf-804f-ab5484062a9b tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:17:33.042664 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9c8d3fda-cdcd-42bf-804f-ab5484062a9b tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] [instance: 5cac62fd-fe3c-4cab-987a-41b9f256f459] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:33.050232 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c8d3fda-cdcd-42bf-804f-ab5484062a9b tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:33.050808 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c8d3fda-cdcd-42bf-804f-ab5484062a9b tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:33.051325 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c8d3fda-cdcd-42bf-804f-ab5484062a9b tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:33.052109 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c8d3fda-cdcd-42bf-804f-ab5484062a9b tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:33.054686 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c8d3fda-cdcd-42bf-804f-ab5484062a9b tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:33.054686 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c8d3fda-cdcd-42bf-804f-ab5484062a9b tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:33.127531 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9c8d3fda-cdcd-42bf-804f-ab5484062a9b tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] 10.222.0.60 "POST /compute/v2.1/servers/5cac62fd-fe3c-4cab-987a-41b9f256f459/action" status: 202 len: 0 microversion: 2.1 time: 0.089326 Oct 18 16:17:33.128106 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3267/6556] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:17:33 2022] POST /compute/v2.1/servers/5cac62fd-fe3c-4cab-987a-41b9f256f459/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:17:33.136302 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-514c3d5d-0f0e-4d26-a27d-86468110c7a8 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:33.136945 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-514c3d5d-0f0e-4d26-a27d-86468110c7a8 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] [instance: 5cac62fd-fe3c-4cab-987a-41b9f256f459] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:33.145334 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-514c3d5d-0f0e-4d26-a27d-86468110c7a8 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:33.145995 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-514c3d5d-0f0e-4d26-a27d-86468110c7a8 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:33.146571 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-514c3d5d-0f0e-4d26-a27d-86468110c7a8 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:33.147330 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-514c3d5d-0f0e-4d26-a27d-86468110c7a8 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:33.147858 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-514c3d5d-0f0e-4d26-a27d-86468110c7a8 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:33.148578 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-514c3d5d-0f0e-4d26-a27d-86468110c7a8 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:33.379844 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-514c3d5d-0f0e-4d26-a27d-86468110c7a8 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a417376bcf4a4180b8ad2a4d19ad108c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9898ac37024f309f783b113e1a01f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:33.392801 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-514c3d5d-0f0e-4d26-a27d-86468110c7a8 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] 10.222.0.60 "GET /compute/v2.1/servers/5cac62fd-fe3c-4cab-987a-41b9f256f459" status: 200 len: 1499 microversion: 2.1 time: 0.259439 Oct 18 16:17:33.393748 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3290/6557] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:33 2022] GET /compute/v2.1/servers/5cac62fd-fe3c-4cab-987a-41b9f256f459 => generated 1499 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:34.418907 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e49f959b-e72e-4b56-8e82-10929becf677 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:34.419620 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e49f959b-e72e-4b56-8e82-10929becf677 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] [instance: 5cac62fd-fe3c-4cab-987a-41b9f256f459] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:34.429110 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e49f959b-e72e-4b56-8e82-10929becf677 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:34.430033 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e49f959b-e72e-4b56-8e82-10929becf677 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:34.430655 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e49f959b-e72e-4b56-8e82-10929becf677 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:34.431997 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e49f959b-e72e-4b56-8e82-10929becf677 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:34.432515 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e49f959b-e72e-4b56-8e82-10929becf677 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:34.432926 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e49f959b-e72e-4b56-8e82-10929becf677 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:34.575385 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e49f959b-e72e-4b56-8e82-10929becf677 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a417376bcf4a4180b8ad2a4d19ad108c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9898ac37024f309f783b113e1a01f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:34.584368 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e49f959b-e72e-4b56-8e82-10929becf677 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] 10.222.0.60 "GET /compute/v2.1/servers/5cac62fd-fe3c-4cab-987a-41b9f256f459" status: 200 len: 1502 microversion: 2.1 time: 0.171542 Oct 18 16:17:34.585188 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3268/6558] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:34 2022] GET /compute/v2.1/servers/5cac62fd-fe3c-4cab-987a-41b9f256f459 => generated 1502 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:17:34.607871 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-997e55ad-752a-4016-8a10-01f6a41a0398 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:17:34.608416 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-997e55ad-752a-4016-8a10-01f6a41a0398 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] [instance: 5cac62fd-fe3c-4cab-987a-41b9f256f459] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:34.614772 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-997e55ad-752a-4016-8a10-01f6a41a0398 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:34.615257 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-997e55ad-752a-4016-8a10-01f6a41a0398 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:34.615693 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-997e55ad-752a-4016-8a10-01f6a41a0398 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:34.618436 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-997e55ad-752a-4016-8a10-01f6a41a0398 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:34.618916 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-997e55ad-752a-4016-8a10-01f6a41a0398 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:34.619350 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-997e55ad-752a-4016-8a10-01f6a41a0398 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:34.644205 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-997e55ad-752a-4016-8a10-01f6a41a0398 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lazy-loading 'flavor' on Instance uuid 5cac62fd-fe3c-4cab-987a-41b9f256f459 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:17:34.717385 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-997e55ad-752a-4016-8a10-01f6a41a0398 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] 10.222.0.60 "POST /compute/v2.1/servers/5cac62fd-fe3c-4cab-987a-41b9f256f459/action" status: 202 len: 0 microversion: 2.1 time: 0.113554 Oct 18 16:17:34.721697 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3291/6559] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:17:34 2022] POST /compute/v2.1/servers/5cac62fd-fe3c-4cab-987a-41b9f256f459/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:17:34.726886 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-34e7cecc-6833-44e9-bfdf-44434a416823 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:34.727505 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-34e7cecc-6833-44e9-bfdf-44434a416823 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] [instance: 5cac62fd-fe3c-4cab-987a-41b9f256f459] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:34.734175 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34e7cecc-6833-44e9-bfdf-44434a416823 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:34.734667 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34e7cecc-6833-44e9-bfdf-44434a416823 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:34.735114 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34e7cecc-6833-44e9-bfdf-44434a416823 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:34.735857 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34e7cecc-6833-44e9-bfdf-44434a416823 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:34.736319 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34e7cecc-6833-44e9-bfdf-44434a416823 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:34.736751 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34e7cecc-6833-44e9-bfdf-44434a416823 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:34.874583 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-34e7cecc-6833-44e9-bfdf-44434a416823 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a417376bcf4a4180b8ad2a4d19ad108c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9898ac37024f309f783b113e1a01f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:34.883165 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-34e7cecc-6833-44e9-bfdf-44434a416823 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] 10.222.0.60 "GET /compute/v2.1/servers/5cac62fd-fe3c-4cab-987a-41b9f256f459" status: 200 len: 1510 microversion: 2.1 time: 0.160136 Oct 18 16:17:34.883772 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3269/6560] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:34 2022] GET /compute/v2.1/servers/5cac62fd-fe3c-4cab-987a-41b9f256f459 => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:35.908177 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-173fe921-cb31-42a8-9455-c64919db94b7 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:35.908940 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-173fe921-cb31-42a8-9455-c64919db94b7 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] [instance: 5cac62fd-fe3c-4cab-987a-41b9f256f459] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:35.915170 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-173fe921-cb31-42a8-9455-c64919db94b7 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:35.915653 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-173fe921-cb31-42a8-9455-c64919db94b7 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:35.916094 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-173fe921-cb31-42a8-9455-c64919db94b7 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:35.916792 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-173fe921-cb31-42a8-9455-c64919db94b7 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:35.917293 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-173fe921-cb31-42a8-9455-c64919db94b7 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:35.917715 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-173fe921-cb31-42a8-9455-c64919db94b7 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:35.924839 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:36.059511 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-173fe921-cb31-42a8-9455-c64919db94b7 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a417376bcf4a4180b8ad2a4d19ad108c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9898ac37024f309f783b113e1a01f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:36.068051 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-173fe921-cb31-42a8-9455-c64919db94b7 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] 10.222.0.60 "GET /compute/v2.1/servers/5cac62fd-fe3c-4cab-987a-41b9f256f459" status: 200 len: 1493 microversion: 2.1 time: 0.165437 Oct 18 16:17:36.068639 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3292/6561] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:35 2022] GET /compute/v2.1/servers/5cac62fd-fe3c-4cab-987a-41b9f256f459 => generated 1493 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:36.091256 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-59f16282-fa09-4000-bd66-4ce186a51a18 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:17:36.091823 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-59f16282-fa09-4000-bd66-4ce186a51a18 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] [instance: 5cac62fd-fe3c-4cab-987a-41b9f256f459] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:36.099353 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-59f16282-fa09-4000-bd66-4ce186a51a18 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:36.099846 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-59f16282-fa09-4000-bd66-4ce186a51a18 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:36.100289 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-59f16282-fa09-4000-bd66-4ce186a51a18 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:36.101087 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-59f16282-fa09-4000-bd66-4ce186a51a18 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:36.101554 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-59f16282-fa09-4000-bd66-4ce186a51a18 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:36.102074 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-59f16282-fa09-4000-bd66-4ce186a51a18 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:36.175986 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-59f16282-fa09-4000-bd66-4ce186a51a18 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] 10.222.0.60 "POST /compute/v2.1/servers/5cac62fd-fe3c-4cab-987a-41b9f256f459/action" status: 202 len: 0 microversion: 2.1 time: 0.088521 Oct 18 16:17:36.179939 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3270/6562] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:17:36 2022] POST /compute/v2.1/servers/5cac62fd-fe3c-4cab-987a-41b9f256f459/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:17:36.185221 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-41cb1662-3308-4e4f-8c0e-fbaf1cb1130d tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:36.186232 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-41cb1662-3308-4e4f-8c0e-fbaf1cb1130d tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] [instance: 5cac62fd-fe3c-4cab-987a-41b9f256f459] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:36.193910 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-41cb1662-3308-4e4f-8c0e-fbaf1cb1130d tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:36.194779 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-41cb1662-3308-4e4f-8c0e-fbaf1cb1130d tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:36.195225 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-41cb1662-3308-4e4f-8c0e-fbaf1cb1130d tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:36.196101 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-41cb1662-3308-4e4f-8c0e-fbaf1cb1130d tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:36.196690 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-41cb1662-3308-4e4f-8c0e-fbaf1cb1130d tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:36.197148 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-41cb1662-3308-4e4f-8c0e-fbaf1cb1130d tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:36.773479 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-41cb1662-3308-4e4f-8c0e-fbaf1cb1130d tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a417376bcf4a4180b8ad2a4d19ad108c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9898ac37024f309f783b113e1a01f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:36.782886 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-41cb1662-3308-4e4f-8c0e-fbaf1cb1130d tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] 10.222.0.60 "GET /compute/v2.1/servers/5cac62fd-fe3c-4cab-987a-41b9f256f459" status: 200 len: 1499 microversion: 2.1 time: 0.601485 Oct 18 16:17:36.783653 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3293/6563] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:36 2022] GET /compute/v2.1/servers/5cac62fd-fe3c-4cab-987a-41b9f256f459 => generated 1499 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:37.808794 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c9d513d8-ce94-49a2-b80c-d70f2ab199d2 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:37.810041 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c9d513d8-ce94-49a2-b80c-d70f2ab199d2 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] [instance: 5cac62fd-fe3c-4cab-987a-41b9f256f459] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:37.818498 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9d513d8-ce94-49a2-b80c-d70f2ab199d2 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:37.819111 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9d513d8-ce94-49a2-b80c-d70f2ab199d2 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:37.819815 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9d513d8-ce94-49a2-b80c-d70f2ab199d2 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:37.820533 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9d513d8-ce94-49a2-b80c-d70f2ab199d2 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:37.821066 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9d513d8-ce94-49a2-b80c-d70f2ab199d2 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:37.821475 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9d513d8-ce94-49a2-b80c-d70f2ab199d2 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:37.968047 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c9d513d8-ce94-49a2-b80c-d70f2ab199d2 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a417376bcf4a4180b8ad2a4d19ad108c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9898ac37024f309f783b113e1a01f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:37.981386 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c9d513d8-ce94-49a2-b80c-d70f2ab199d2 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] 10.222.0.60 "GET /compute/v2.1/servers/5cac62fd-fe3c-4cab-987a-41b9f256f459" status: 200 len: 1502 microversion: 2.1 time: 0.179266 Oct 18 16:17:37.981973 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3271/6564] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:37 2022] GET /compute/v2.1/servers/5cac62fd-fe3c-4cab-987a-41b9f256f459 => generated 1502 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:38.005184 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-08073bf8-083d-4a09-b4c0-8b4812120f9f tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:38.006840 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-08073bf8-083d-4a09-b4c0-8b4812120f9f tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] [instance: 5cac62fd-fe3c-4cab-987a-41b9f256f459] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:38.015502 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-08073bf8-083d-4a09-b4c0-8b4812120f9f tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:38.016143 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-08073bf8-083d-4a09-b4c0-8b4812120f9f tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:38.016604 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-08073bf8-083d-4a09-b4c0-8b4812120f9f tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:38.017950 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-08073bf8-083d-4a09-b4c0-8b4812120f9f tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:38.018422 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-08073bf8-083d-4a09-b4c0-8b4812120f9f tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:38.018863 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-08073bf8-083d-4a09-b4c0-8b4812120f9f tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:38.050955 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-08073bf8-083d-4a09-b4c0-8b4812120f9f tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] [instance: 5cac62fd-fe3c-4cab-987a-41b9f256f459] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:17:38.131562 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-08073bf8-083d-4a09-b4c0-8b4812120f9f tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5cac62fd-fe3c-4cab-987a-41b9f256f459" status: 204 len: 0 microversion: 2.1 time: 0.130632 Oct 18 16:17:38.132135 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3294/6565] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 16:17:37 2022] DELETE /compute/v2.1/servers/5cac62fd-fe3c-4cab-987a-41b9f256f459 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:17:38.145860 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-091d5c10-ed54-46ea-87a2-8271783d41ba tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:38.146593 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-091d5c10-ed54-46ea-87a2-8271783d41ba tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] [instance: 5cac62fd-fe3c-4cab-987a-41b9f256f459] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:38.153260 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-091d5c10-ed54-46ea-87a2-8271783d41ba tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:38.153753 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-091d5c10-ed54-46ea-87a2-8271783d41ba tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:38.154191 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-091d5c10-ed54-46ea-87a2-8271783d41ba tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:38.154900 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-091d5c10-ed54-46ea-87a2-8271783d41ba tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:38.155360 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-091d5c10-ed54-46ea-87a2-8271783d41ba tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:38.155791 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-091d5c10-ed54-46ea-87a2-8271783d41ba tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:38.291155 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-091d5c10-ed54-46ea-87a2-8271783d41ba tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a417376bcf4a4180b8ad2a4d19ad108c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9898ac37024f309f783b113e1a01f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:38.299539 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-091d5c10-ed54-46ea-87a2-8271783d41ba tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] 10.222.0.60 "GET /compute/v2.1/servers/5cac62fd-fe3c-4cab-987a-41b9f256f459" status: 200 len: 1508 microversion: 2.1 time: 0.162082 Oct 18 16:17:38.300118 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3272/6566] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:38 2022] GET /compute/v2.1/servers/5cac62fd-fe3c-4cab-987a-41b9f256f459 => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:39.324387 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-337234c5-5dc8-4c74-9c01-c290c3ab755f tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:39.325311 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-337234c5-5dc8-4c74-9c01-c290c3ab755f tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] [instance: 5cac62fd-fe3c-4cab-987a-41b9f256f459] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:39.333346 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-337234c5-5dc8-4c74-9c01-c290c3ab755f tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:39.333834 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-337234c5-5dc8-4c74-9c01-c290c3ab755f tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:39.334269 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-337234c5-5dc8-4c74-9c01-c290c3ab755f tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:39.335136 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-337234c5-5dc8-4c74-9c01-c290c3ab755f tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:39.335611 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-337234c5-5dc8-4c74-9c01-c290c3ab755f tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:39.336285 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-337234c5-5dc8-4c74-9c01-c290c3ab755f tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:39.472337 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-337234c5-5dc8-4c74-9c01-c290c3ab755f tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a417376bcf4a4180b8ad2a4d19ad108c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9898ac37024f309f783b113e1a01f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:39.480184 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-337234c5-5dc8-4c74-9c01-c290c3ab755f tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] 10.222.0.60 "GET /compute/v2.1/servers/5cac62fd-fe3c-4cab-987a-41b9f256f459" status: 200 len: 1508 microversion: 2.1 time: 0.160279 Oct 18 16:17:39.480756 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3295/6567] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:39 2022] GET /compute/v2.1/servers/5cac62fd-fe3c-4cab-987a-41b9f256f459 => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:40.449204 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-34014027-16c0-4cef-9fc7-b925d7e56aae req-0db94244-367c-4316-9396-cdf09962a6e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cac62fd-fe3c-4cab-987a-41b9f256f459", "name": "network-vif-deleted", "tag": "6d6f453a-036c-4ef8-9715-fca81c010f1c"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:17:40.454948 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:40.463000 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-34014027-16c0-4cef-9fc7-b925d7e56aae req-0db94244-367c-4316-9396-cdf09962a6e0 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:40.463563 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-34014027-16c0-4cef-9fc7-b925d7e56aae req-0db94244-367c-4316-9396-cdf09962a6e0 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:40.464062 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-34014027-16c0-4cef-9fc7-b925d7e56aae req-0db94244-367c-4316-9396-cdf09962a6e0 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:40.477149 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-34014027-16c0-4cef-9fc7-b925d7e56aae req-0db94244-367c-4316-9396-cdf09962a6e0 service nova] Creating event network-vif-deleted:6d6f453a-036c-4ef8-9715-fca81c010f1c for instance 5cac62fd-fe3c-4cab-987a-41b9f256f459 on n-h2-853682-5 Oct 18 16:17:40.482686 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-34014027-16c0-4cef-9fc7-b925d7e56aae req-0db94244-367c-4316-9396-cdf09962a6e0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131275 Oct 18 16:17:40.483267 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3273/6568] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:17:40.503030 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5ca68ab7-bbdb-4a4a-95b3-86951b3db7f7 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:40.503875 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5ca68ab7-bbdb-4a4a-95b3-86951b3db7f7 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] [instance: 5cac62fd-fe3c-4cab-987a-41b9f256f459] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:40.511326 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5ca68ab7-bbdb-4a4a-95b3-86951b3db7f7 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:40.512224 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5ca68ab7-bbdb-4a4a-95b3-86951b3db7f7 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:40.512916 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5ca68ab7-bbdb-4a4a-95b3-86951b3db7f7 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:40.513877 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5ca68ab7-bbdb-4a4a-95b3-86951b3db7f7 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:40.514344 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5ca68ab7-bbdb-4a4a-95b3-86951b3db7f7 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:40.514780 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5ca68ab7-bbdb-4a4a-95b3-86951b3db7f7 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:40.554184 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5ca68ab7-bbdb-4a4a-95b3-86951b3db7f7 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:40.554726 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5ca68ab7-bbdb-4a4a-95b3-86951b3db7f7 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:40.555174 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5ca68ab7-bbdb-4a4a-95b3-86951b3db7f7 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:40.555624 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-5ca68ab7-bbdb-4a4a-95b3-86951b3db7f7 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lazy-loading 'fault' on Instance uuid 5cac62fd-fe3c-4cab-987a-41b9f256f459 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:17:40.604925 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5ca68ab7-bbdb-4a4a-95b3-86951b3db7f7 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a417376bcf4a4180b8ad2a4d19ad108c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9898ac37024f309f783b113e1a01f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:40.613690 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5ca68ab7-bbdb-4a4a-95b3-86951b3db7f7 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] 10.222.0.60 "GET /compute/v2.1/servers/5cac62fd-fe3c-4cab-987a-41b9f256f459" status: 200 len: 1305 microversion: 2.1 time: 0.114647 Oct 18 16:17:40.614281 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3296/6569] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:40 2022] GET /compute/v2.1/servers/5cac62fd-fe3c-4cab-987a-41b9f256f459 => generated 1305 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:41.639323 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7cc4c275-bd1f-496c-afb8-933d03241cd1 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:41.640145 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7cc4c275-bd1f-496c-afb8-933d03241cd1 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] [instance: 5cac62fd-fe3c-4cab-987a-41b9f256f459] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:41.647409 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7cc4c275-bd1f-496c-afb8-933d03241cd1 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:41.647907 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7cc4c275-bd1f-496c-afb8-933d03241cd1 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:41.648548 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7cc4c275-bd1f-496c-afb8-933d03241cd1 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:41.649329 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7cc4c275-bd1f-496c-afb8-933d03241cd1 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:41.649807 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7cc4c275-bd1f-496c-afb8-933d03241cd1 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:41.650578 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7cc4c275-bd1f-496c-afb8-933d03241cd1 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:41.668850 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-7cc4c275-bd1f-496c-afb8-933d03241cd1 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] HTTP exception thrown: Instance 5cac62fd-fe3c-4cab-987a-41b9f256f459 could not be found. Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7cc4c275-bd1f-496c-afb8-933d03241cd1 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Request method failure captured: Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/5cac62fd-fe3c-4cab-987a-41b9f256f459 HTTP/1.1 Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTtGPLxQ83jesu4lvdAkjGhpTbtrrXJagYgoMr2Ul5CpF3v7LMj6A5w6EbzR9a20OpygutBqKha0FX-z-Y2KMyPSchRGz_sAE27AsAubuEHvZUse5p0NM1oc4aygmFVdJXHnLaoY65KgmpOCe-zTM6KMhMRjiibH8AdlzkjtgMLavRKI Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 4d9898ac37024f309f783b113e1a01f7 Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-TestServerAdvancedOps-861292515 Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4d9898ac37024f309f783b113e1a01f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4d9898ac37024f309f783b113e1a01f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4d9898ac37024f309f783b113e1a01f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4d9898ac37024f309f783b113e1a01f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-TestServerAdvancedOps-861292515 Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 4d9898ac37024f309f783b113e1a01f7 Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-TestServerAdvancedOps-861292515 Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-TestServerAdvancedOps-861292515-project Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: a417376bcf4a4180b8ad2a4d19ad108c Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-TestServerAdvancedOps-861292515-project Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 5cac62fd-fe3c-4cab-987a-41b9f256f459 could not be found. Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '5cac62fd-fe3c-4cab-987a-41b9f256f459'} Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cac62fd-fe3c-4cab-987a-41b9f256f459 could not be found. Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cac62fd-fe3c-4cab-987a-41b9f256f459 could not be found. Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:17:41.670558 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:17:41.674565 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:17:41.674565 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:17:41.674565 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:17:41.674565 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:17:41.674565 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:17:41.674565 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cac62fd-fe3c-4cab-987a-41b9f256f459 could not be found. Oct 18 16:17:41.674565 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:17:41.674565 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7cc4c275-bd1f-496c-afb8-933d03241cd1 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] Returning 404 to user: Instance 5cac62fd-fe3c-4cab-987a-41b9f256f459 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:17:41.674565 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7cc4c275-bd1f-496c-afb8-933d03241cd1 tempest-TestServerAdvancedOps-861292515 tempest-TestServerAdvancedOps-861292515-project] 10.222.0.60 "GET /compute/v2.1/servers/5cac62fd-fe3c-4cab-987a-41b9f256f459" status: 404 len: 111 microversion: 2.1 time: 0.037942 Oct 18 16:17:41.674565 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3274/6570] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:41 2022] GET /compute/v2.1/servers/5cac62fd-fe3c-4cab-987a-41b9f256f459 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:17:44.813541 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-12e3e89d-7868-4b63-81ee-8baff45c28d4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1470435307", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "c98971a3-eff2-4654-a38c-cf6187c700a7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "a0168786-8cd3-418a-9936-dae2a39b2080"}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:17:44.875602 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-12e3e89d-7868-4b63-81ee-8baff45c28d4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] validate_networks() for [('a0168786-8cd3-418a-9936-dae2a39b2080', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 16:17:45.256926 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-12e3e89d-7868-4b63-81ee-8baff45c28d4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:17:45.257362 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-12e3e89d-7868-4b63-81ee-8baff45c28d4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:17:45.257844 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-12e3e89d-7868-4b63-81ee-8baff45c28d4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:17:45.258355 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-12e3e89d-7868-4b63-81ee-8baff45c28d4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:17:45.258784 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-12e3e89d-7868-4b63-81ee-8baff45c28d4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:17:45.267939 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12e3e89d-7868-4b63-81ee-8baff45c28d4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:45.268431 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12e3e89d-7868-4b63-81ee-8baff45c28d4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:45.268914 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12e3e89d-7868-4b63-81ee-8baff45c28d4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:45.269764 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12e3e89d-7868-4b63-81ee-8baff45c28d4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:45.270323 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12e3e89d-7868-4b63-81ee-8baff45c28d4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:45.270668 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12e3e89d-7868-4b63-81ee-8baff45c28d4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:45.287489 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-12e3e89d-7868-4b63-81ee-8baff45c28d4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Getting quotas for project c05254b186b04c9cb9858f621938caca. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:17:45.293184 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-12e3e89d-7868-4b63-81ee-8baff45c28d4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Getting quotas for user b9f9ae9e929c416a9298499ab8694d37 and project c05254b186b04c9cb9858f621938caca. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:17:45.352627 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-12e3e89d-7868-4b63-81ee-8baff45c28d4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:17:45.354939 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-12e3e89d-7868-4b63-81ee-8baff45c28d4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: d6bb2298-addc-4945-a9d3-1f5edfa95ce0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c98971a3-eff2-4654-a38c-cf6187c700a7',volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:17:45.483256 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-12e3e89d-7868-4b63-81ee-8baff45c28d4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.673520 Oct 18 16:17:45.483908 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3297/6571] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 16:17:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:17:45.496029 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bc582d30-9a0b-46ec-9e14-d3e6805ea1bf tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:45.497290 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bc582d30-9a0b-46ec-9e14-d3e6805ea1bf tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: d6bb2298-addc-4945-a9d3-1f5edfa95ce0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:45.559468 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bc582d30-9a0b-46ec-9e14-d3e6805ea1bf tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:45.568120 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bc582d30-9a0b-46ec-9e14-d3e6805ea1bf tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/d6bb2298-addc-4945-a9d3-1f5edfa95ce0" status: 200 len: 1071 microversion: 2.1 time: 0.076897 Oct 18 16:17:45.568602 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3275/6572] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:45 2022] GET /compute/v2.1/servers/d6bb2298-addc-4945-a9d3-1f5edfa95ce0 => generated 1071 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:46.596400 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-46a5abc1-1b21-4817-899a-a696f00396d4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:46.597181 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-46a5abc1-1b21-4817-899a-a696f00396d4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: d6bb2298-addc-4945-a9d3-1f5edfa95ce0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:46.606750 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-46a5abc1-1b21-4817-899a-a696f00396d4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:46.606750 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-46a5abc1-1b21-4817-899a-a696f00396d4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:46.607411 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-46a5abc1-1b21-4817-899a-a696f00396d4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:46.608163 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-46a5abc1-1b21-4817-899a-a696f00396d4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:46.608722 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-46a5abc1-1b21-4817-899a-a696f00396d4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:46.609279 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-46a5abc1-1b21-4817-899a-a696f00396d4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:46.680977 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-46a5abc1-1b21-4817-899a-a696f00396d4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:46.692695 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-46a5abc1-1b21-4817-899a-a696f00396d4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/d6bb2298-addc-4945-a9d3-1f5edfa95ce0" status: 200 len: 1187 microversion: 2.1 time: 0.102335 Oct 18 16:17:46.693742 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3298/6573] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:46 2022] GET /compute/v2.1/servers/d6bb2298-addc-4945-a9d3-1f5edfa95ce0 => generated 1187 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:47.717190 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e18b7c2f-805e-4a27-a606-0f3c51f18712 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:47.718726 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e18b7c2f-805e-4a27-a606-0f3c51f18712 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: d6bb2298-addc-4945-a9d3-1f5edfa95ce0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:47.727231 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e18b7c2f-805e-4a27-a606-0f3c51f18712 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:47.727720 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e18b7c2f-805e-4a27-a606-0f3c51f18712 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:47.728377 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e18b7c2f-805e-4a27-a606-0f3c51f18712 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:47.729136 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e18b7c2f-805e-4a27-a606-0f3c51f18712 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:47.729600 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e18b7c2f-805e-4a27-a606-0f3c51f18712 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:47.730031 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e18b7c2f-805e-4a27-a606-0f3c51f18712 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:47.927327 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e18b7c2f-805e-4a27-a606-0f3c51f18712 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:47.938322 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e18b7c2f-805e-4a27-a606-0f3c51f18712 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/d6bb2298-addc-4945-a9d3-1f5edfa95ce0" status: 200 len: 1229 microversion: 2.1 time: 0.224910 Oct 18 16:17:47.939951 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3276/6574] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:47 2022] GET /compute/v2.1/servers/d6bb2298-addc-4945-a9d3-1f5edfa95ce0 => generated 1229 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:47.953737 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-a8c1f5aa-02ba-4723-a9d0-4c888e756e23 req-c04930d6-e5b5-448e-9155-2db3c8d2aded service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6bb2298-addc-4945-a9d3-1f5edfa95ce0", "tag": "7b96e195-615c-4953-9368-6c9e25e007c8"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:17:47.962966 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=69,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:47.973389 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-a8c1f5aa-02ba-4723-a9d0-4c888e756e23 req-c04930d6-e5b5-448e-9155-2db3c8d2aded service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:47.974139 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-a8c1f5aa-02ba-4723-a9d0-4c888e756e23 req-c04930d6-e5b5-448e-9155-2db3c8d2aded service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:47.976133 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-a8c1f5aa-02ba-4723-a9d0-4c888e756e23 req-c04930d6-e5b5-448e-9155-2db3c8d2aded service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:47.996055 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-a8c1f5aa-02ba-4723-a9d0-4c888e756e23 req-c04930d6-e5b5-448e-9155-2db3c8d2aded service nova] Creating event network-changed:7b96e195-615c-4953-9368-6c9e25e007c8 for instance d6bb2298-addc-4945-a9d3-1f5edfa95ce0 on n-h2-853682-5 Oct 18 16:17:48.003376 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-a8c1f5aa-02ba-4723-a9d0-4c888e756e23 req-c04930d6-e5b5-448e-9155-2db3c8d2aded service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053351 Oct 18 16:17:48.004770 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3299/6575] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:17:48.962526 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9c0f5802-f699-4a14-8e6f-c27668a2df24 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:48.963359 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9c0f5802-f699-4a14-8e6f-c27668a2df24 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: d6bb2298-addc-4945-a9d3-1f5edfa95ce0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:48.973818 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c0f5802-f699-4a14-8e6f-c27668a2df24 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:48.974452 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c0f5802-f699-4a14-8e6f-c27668a2df24 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:48.974991 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c0f5802-f699-4a14-8e6f-c27668a2df24 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:48.975797 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c0f5802-f699-4a14-8e6f-c27668a2df24 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:48.976466 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c0f5802-f699-4a14-8e6f-c27668a2df24 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:48.977136 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c0f5802-f699-4a14-8e6f-c27668a2df24 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:49.113330 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9c0f5802-f699-4a14-8e6f-c27668a2df24 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:49.121715 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9c0f5802-f699-4a14-8e6f-c27668a2df24 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/d6bb2298-addc-4945-a9d3-1f5edfa95ce0" status: 200 len: 1229 microversion: 2.1 time: 0.163517 Oct 18 16:17:49.122253 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3277/6576] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:48 2022] GET /compute/v2.1/servers/d6bb2298-addc-4945-a9d3-1f5edfa95ce0 => generated 1229 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:50.146724 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f662afe4-67a3-4672-a058-6f84ecd972af tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:50.147545 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f662afe4-67a3-4672-a058-6f84ecd972af tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: d6bb2298-addc-4945-a9d3-1f5edfa95ce0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:50.154715 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f662afe4-67a3-4672-a058-6f84ecd972af tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:50.155194 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f662afe4-67a3-4672-a058-6f84ecd972af tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:50.155626 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f662afe4-67a3-4672-a058-6f84ecd972af tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:50.156310 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f662afe4-67a3-4672-a058-6f84ecd972af tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:50.156785 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f662afe4-67a3-4672-a058-6f84ecd972af tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:50.157261 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f662afe4-67a3-4672-a058-6f84ecd972af tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:50.287297 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f662afe4-67a3-4672-a058-6f84ecd972af tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:50.295058 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f662afe4-67a3-4672-a058-6f84ecd972af tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/d6bb2298-addc-4945-a9d3-1f5edfa95ce0" status: 200 len: 1229 microversion: 2.1 time: 0.153265 Oct 18 16:17:50.295636 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3300/6577] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:50 2022] GET /compute/v2.1/servers/d6bb2298-addc-4945-a9d3-1f5edfa95ce0 => generated 1229 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:51.319139 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-53c5081b-0aed-4e99-b784-7c70d20caf18 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:51.319786 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-53c5081b-0aed-4e99-b784-7c70d20caf18 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: d6bb2298-addc-4945-a9d3-1f5edfa95ce0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:51.327753 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-53c5081b-0aed-4e99-b784-7c70d20caf18 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:51.328235 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-53c5081b-0aed-4e99-b784-7c70d20caf18 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:51.328671 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-53c5081b-0aed-4e99-b784-7c70d20caf18 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:51.329526 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-53c5081b-0aed-4e99-b784-7c70d20caf18 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:51.330000 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-53c5081b-0aed-4e99-b784-7c70d20caf18 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:51.330404 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-53c5081b-0aed-4e99-b784-7c70d20caf18 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:51.466240 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-53c5081b-0aed-4e99-b784-7c70d20caf18 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:51.474518 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-53c5081b-0aed-4e99-b784-7c70d20caf18 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/d6bb2298-addc-4945-a9d3-1f5edfa95ce0" status: 200 len: 1229 microversion: 2.1 time: 0.159577 Oct 18 16:17:51.475088 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3278/6578] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:51 2022] GET /compute/v2.1/servers/d6bb2298-addc-4945-a9d3-1f5edfa95ce0 => generated 1229 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:52.497849 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-99280b69-cf24-4590-a0aa-22482e1b1426 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:52.498519 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-99280b69-cf24-4590-a0aa-22482e1b1426 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: d6bb2298-addc-4945-a9d3-1f5edfa95ce0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:52.506136 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-99280b69-cf24-4590-a0aa-22482e1b1426 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:52.506613 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-99280b69-cf24-4590-a0aa-22482e1b1426 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:52.507052 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-99280b69-cf24-4590-a0aa-22482e1b1426 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:52.507749 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-99280b69-cf24-4590-a0aa-22482e1b1426 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:52.508209 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-99280b69-cf24-4590-a0aa-22482e1b1426 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:52.508635 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-99280b69-cf24-4590-a0aa-22482e1b1426 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:52.637441 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-99280b69-cf24-4590-a0aa-22482e1b1426 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:52.645715 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-99280b69-cf24-4590-a0aa-22482e1b1426 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/d6bb2298-addc-4945-a9d3-1f5edfa95ce0" status: 200 len: 1217 microversion: 2.1 time: 0.151797 Oct 18 16:17:52.646286 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3301/6579] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:52 2022] GET /compute/v2.1/servers/d6bb2298-addc-4945-a9d3-1f5edfa95ce0 => generated 1217 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:53.669097 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dce22c7f-6a6c-49b5-bcfd-044bccf8467e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:53.669722 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dce22c7f-6a6c-49b5-bcfd-044bccf8467e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: d6bb2298-addc-4945-a9d3-1f5edfa95ce0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:53.677101 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dce22c7f-6a6c-49b5-bcfd-044bccf8467e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:53.679271 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dce22c7f-6a6c-49b5-bcfd-044bccf8467e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:53.679271 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dce22c7f-6a6c-49b5-bcfd-044bccf8467e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:53.679540 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dce22c7f-6a6c-49b5-bcfd-044bccf8467e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:53.679828 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dce22c7f-6a6c-49b5-bcfd-044bccf8467e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:53.680262 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dce22c7f-6a6c-49b5-bcfd-044bccf8467e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:53.809276 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dce22c7f-6a6c-49b5-bcfd-044bccf8467e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:53.817710 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dce22c7f-6a6c-49b5-bcfd-044bccf8467e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/d6bb2298-addc-4945-a9d3-1f5edfa95ce0" status: 200 len: 1217 microversion: 2.1 time: 0.152548 Oct 18 16:17:53.818301 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3279/6580] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:53 2022] GET /compute/v2.1/servers/d6bb2298-addc-4945-a9d3-1f5edfa95ce0 => generated 1217 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:54.841024 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d2906e92-b695-47ef-976d-3b8dd0d06e89 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:54.841748 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d2906e92-b695-47ef-976d-3b8dd0d06e89 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: d6bb2298-addc-4945-a9d3-1f5edfa95ce0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:54.849204 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d2906e92-b695-47ef-976d-3b8dd0d06e89 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:54.849691 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d2906e92-b695-47ef-976d-3b8dd0d06e89 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:54.850136 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d2906e92-b695-47ef-976d-3b8dd0d06e89 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:54.850833 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d2906e92-b695-47ef-976d-3b8dd0d06e89 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:54.851293 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d2906e92-b695-47ef-976d-3b8dd0d06e89 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:54.851728 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d2906e92-b695-47ef-976d-3b8dd0d06e89 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:54.983771 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d2906e92-b695-47ef-976d-3b8dd0d06e89 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:54.991502 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d2906e92-b695-47ef-976d-3b8dd0d06e89 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/d6bb2298-addc-4945-a9d3-1f5edfa95ce0" status: 200 len: 1217 microversion: 2.1 time: 0.154402 Oct 18 16:17:54.992271 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3302/6581] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:54 2022] GET /compute/v2.1/servers/d6bb2298-addc-4945-a9d3-1f5edfa95ce0 => generated 1217 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:56.014756 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b24c1098-b93b-441b-8678-1d5d5c3b542c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:56.015377 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b24c1098-b93b-441b-8678-1d5d5c3b542c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: d6bb2298-addc-4945-a9d3-1f5edfa95ce0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:56.018844 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:56.024958 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b24c1098-b93b-441b-8678-1d5d5c3b542c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:56.025620 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b24c1098-b93b-441b-8678-1d5d5c3b542c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:56.026181 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b24c1098-b93b-441b-8678-1d5d5c3b542c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:56.026880 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b24c1098-b93b-441b-8678-1d5d5c3b542c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:56.027332 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b24c1098-b93b-441b-8678-1d5d5c3b542c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:56.027757 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b24c1098-b93b-441b-8678-1d5d5c3b542c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:56.032045 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:56.166366 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b24c1098-b93b-441b-8678-1d5d5c3b542c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:56.174538 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b24c1098-b93b-441b-8678-1d5d5c3b542c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/d6bb2298-addc-4945-a9d3-1f5edfa95ce0" status: 200 len: 1217 microversion: 2.1 time: 0.163665 Oct 18 16:17:56.175157 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3280/6582] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:56 2022] GET /compute/v2.1/servers/d6bb2298-addc-4945-a9d3-1f5edfa95ce0 => generated 1217 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:57.197445 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4ad2d4ba-2897-480d-b11a-485cd90ac059 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:57.198099 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4ad2d4ba-2897-480d-b11a-485cd90ac059 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: d6bb2298-addc-4945-a9d3-1f5edfa95ce0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:57.200085 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:57.200788 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=6 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:57.207552 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ad2d4ba-2897-480d-b11a-485cd90ac059 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:57.208043 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ad2d4ba-2897-480d-b11a-485cd90ac059 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:57.208490 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ad2d4ba-2897-480d-b11a-485cd90ac059 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:57.209223 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ad2d4ba-2897-480d-b11a-485cd90ac059 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:57.209717 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ad2d4ba-2897-480d-b11a-485cd90ac059 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:57.210152 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ad2d4ba-2897-480d-b11a-485cd90ac059 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:57.345513 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4ad2d4ba-2897-480d-b11a-485cd90ac059 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:57.353333 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4ad2d4ba-2897-480d-b11a-485cd90ac059 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/d6bb2298-addc-4945-a9d3-1f5edfa95ce0" status: 200 len: 1217 microversion: 2.1 time: 0.159818 Oct 18 16:17:57.353927 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3303/6583] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:57 2022] GET /compute/v2.1/servers/d6bb2298-addc-4945-a9d3-1f5edfa95ce0 => generated 1217 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:58.377150 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c7c59732-d213-4035-a6fc-3bb63322f3b3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:58.377724 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c7c59732-d213-4035-a6fc-3bb63322f3b3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: d6bb2298-addc-4945-a9d3-1f5edfa95ce0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:58.384834 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c7c59732-d213-4035-a6fc-3bb63322f3b3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:58.385343 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c7c59732-d213-4035-a6fc-3bb63322f3b3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:58.385783 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c7c59732-d213-4035-a6fc-3bb63322f3b3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:58.386483 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c7c59732-d213-4035-a6fc-3bb63322f3b3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:58.386947 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c7c59732-d213-4035-a6fc-3bb63322f3b3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:58.387379 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c7c59732-d213-4035-a6fc-3bb63322f3b3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:58.517412 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c7c59732-d213-4035-a6fc-3bb63322f3b3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:58.525298 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c7c59732-d213-4035-a6fc-3bb63322f3b3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/d6bb2298-addc-4945-a9d3-1f5edfa95ce0" status: 200 len: 1217 microversion: 2.1 time: 0.152593 Oct 18 16:17:58.525766 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3281/6584] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:58 2022] GET /compute/v2.1/servers/d6bb2298-addc-4945-a9d3-1f5edfa95ce0 => generated 1217 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:17:59.547632 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0adbe14b-b53a-471a-a972-f75844e02946 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:17:59.548246 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0adbe14b-b53a-471a-a972-f75844e02946 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: d6bb2298-addc-4945-a9d3-1f5edfa95ce0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:17:59.555264 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0adbe14b-b53a-471a-a972-f75844e02946 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:59.555744 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0adbe14b-b53a-471a-a972-f75844e02946 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:59.556178 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0adbe14b-b53a-471a-a972-f75844e02946 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:59.556976 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0adbe14b-b53a-471a-a972-f75844e02946 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:17:59.557434 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0adbe14b-b53a-471a-a972-f75844e02946 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:17:59.557909 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0adbe14b-b53a-471a-a972-f75844e02946 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:17:59.690753 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0adbe14b-b53a-471a-a972-f75844e02946 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:17:59.698575 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0adbe14b-b53a-471a-a972-f75844e02946 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/d6bb2298-addc-4945-a9d3-1f5edfa95ce0" status: 200 len: 1217 microversion: 2.1 time: 0.154888 Oct 18 16:17:59.699152 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3304/6585] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:59 2022] GET /compute/v2.1/servers/d6bb2298-addc-4945-a9d3-1f5edfa95ce0 => generated 1217 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:00.723006 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-58179339-7ea1-46a5-a9f9-9b941dc7f2b6 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:00.723632 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-58179339-7ea1-46a5-a9f9-9b941dc7f2b6 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: d6bb2298-addc-4945-a9d3-1f5edfa95ce0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:00.730585 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58179339-7ea1-46a5-a9f9-9b941dc7f2b6 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:00.731073 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58179339-7ea1-46a5-a9f9-9b941dc7f2b6 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:00.731519 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58179339-7ea1-46a5-a9f9-9b941dc7f2b6 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:00.732223 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58179339-7ea1-46a5-a9f9-9b941dc7f2b6 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:00.732711 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58179339-7ea1-46a5-a9f9-9b941dc7f2b6 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:00.733170 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58179339-7ea1-46a5-a9f9-9b941dc7f2b6 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:00.867674 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-58179339-7ea1-46a5-a9f9-9b941dc7f2b6 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:00.875493 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-58179339-7ea1-46a5-a9f9-9b941dc7f2b6 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/d6bb2298-addc-4945-a9d3-1f5edfa95ce0" status: 200 len: 1217 microversion: 2.1 time: 0.157754 Oct 18 16:18:00.876087 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3282/6586] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:00 2022] GET /compute/v2.1/servers/d6bb2298-addc-4945-a9d3-1f5edfa95ce0 => generated 1217 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:01.293156 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-1b6b1955-e5f1-4bab-8760-98bbe46ca723 req-9c967a02-a8d8-44d4-b934-ccf0b0ffa34c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6bb2298-addc-4945-a9d3-1f5edfa95ce0", "name": "network-vif-plugged", "status": "completed", "tag": "7b96e195-615c-4953-9368-6c9e25e007c8"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:18:01.304378 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-1b6b1955-e5f1-4bab-8760-98bbe46ca723 req-9c967a02-a8d8-44d4-b934-ccf0b0ffa34c service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:01.304888 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-1b6b1955-e5f1-4bab-8760-98bbe46ca723 req-9c967a02-a8d8-44d4-b934-ccf0b0ffa34c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:01.305420 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-1b6b1955-e5f1-4bab-8760-98bbe46ca723 req-9c967a02-a8d8-44d4-b934-ccf0b0ffa34c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:01.317717 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-1b6b1955-e5f1-4bab-8760-98bbe46ca723 req-9c967a02-a8d8-44d4-b934-ccf0b0ffa34c service nova] Creating event network-vif-plugged:7b96e195-615c-4953-9368-6c9e25e007c8 for instance d6bb2298-addc-4945-a9d3-1f5edfa95ce0 on n-h2-853682-5 Oct 18 16:18:01.322825 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-1b6b1955-e5f1-4bab-8760-98bbe46ca723 req-9c967a02-a8d8-44d4-b934-ccf0b0ffa34c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033842 Oct 18 16:18:01.323625 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3305/6587] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:18:01.898484 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c7eb76c1-9bc6-49f9-b5ad-31a62b682abd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:01.899111 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c7eb76c1-9bc6-49f9-b5ad-31a62b682abd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: d6bb2298-addc-4945-a9d3-1f5edfa95ce0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:01.906136 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c7eb76c1-9bc6-49f9-b5ad-31a62b682abd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:01.906624 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c7eb76c1-9bc6-49f9-b5ad-31a62b682abd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:01.907067 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c7eb76c1-9bc6-49f9-b5ad-31a62b682abd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:01.907766 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c7eb76c1-9bc6-49f9-b5ad-31a62b682abd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:01.908224 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c7eb76c1-9bc6-49f9-b5ad-31a62b682abd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:01.908678 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c7eb76c1-9bc6-49f9-b5ad-31a62b682abd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:02.039864 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c7eb76c1-9bc6-49f9-b5ad-31a62b682abd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:02.047831 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c7eb76c1-9bc6-49f9-b5ad-31a62b682abd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/d6bb2298-addc-4945-a9d3-1f5edfa95ce0" status: 200 len: 1217 microversion: 2.1 time: 0.153351 Oct 18 16:18:02.048400 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3283/6588] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:01 2022] GET /compute/v2.1/servers/d6bb2298-addc-4945-a9d3-1f5edfa95ce0 => generated 1217 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:03.072020 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ec285467-f52c-4df4-b071-b549dfbed116 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:03.072728 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ec285467-f52c-4df4-b071-b549dfbed116 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: d6bb2298-addc-4945-a9d3-1f5edfa95ce0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:03.079860 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ec285467-f52c-4df4-b071-b549dfbed116 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:03.080358 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ec285467-f52c-4df4-b071-b549dfbed116 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:03.080857 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ec285467-f52c-4df4-b071-b549dfbed116 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:03.081566 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ec285467-f52c-4df4-b071-b549dfbed116 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:03.082030 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ec285467-f52c-4df4-b071-b549dfbed116 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:03.082467 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ec285467-f52c-4df4-b071-b549dfbed116 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:03.210983 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ec285467-f52c-4df4-b071-b549dfbed116 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:03.218980 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ec285467-f52c-4df4-b071-b549dfbed116 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/d6bb2298-addc-4945-a9d3-1f5edfa95ce0" status: 200 len: 1403 microversion: 2.1 time: 0.152066 Oct 18 16:18:03.220158 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3306/6589] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:03 2022] GET /compute/v2.1/servers/d6bb2298-addc-4945-a9d3-1f5edfa95ce0 => generated 1403 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:03.241251 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e84547bf-b03b-48a2-8bbc-a67a090946d8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:03.241869 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e84547bf-b03b-48a2-8bbc-a67a090946d8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: d6bb2298-addc-4945-a9d3-1f5edfa95ce0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:03.248667 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e84547bf-b03b-48a2-8bbc-a67a090946d8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:03.249182 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e84547bf-b03b-48a2-8bbc-a67a090946d8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:03.249619 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e84547bf-b03b-48a2-8bbc-a67a090946d8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:03.250310 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e84547bf-b03b-48a2-8bbc-a67a090946d8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:03.250836 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e84547bf-b03b-48a2-8bbc-a67a090946d8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:03.251246 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e84547bf-b03b-48a2-8bbc-a67a090946d8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:03.383660 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e84547bf-b03b-48a2-8bbc-a67a090946d8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:03.391530 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e84547bf-b03b-48a2-8bbc-a67a090946d8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/d6bb2298-addc-4945-a9d3-1f5edfa95ce0" status: 200 len: 1403 microversion: 2.1 time: 0.154129 Oct 18 16:18:03.392112 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3284/6590] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:03 2022] GET /compute/v2.1/servers/d6bb2298-addc-4945-a9d3-1f5edfa95ce0 => generated 1403 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:03.414117 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3abb4432-9981-4cad-8cba-153dd8a05c7f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1835926503"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:18:03.416389 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3abb4432-9981-4cad-8cba-153dd8a05c7f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: d6bb2298-addc-4945-a9d3-1f5edfa95ce0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:03.422361 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3abb4432-9981-4cad-8cba-153dd8a05c7f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:03.423426 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3abb4432-9981-4cad-8cba-153dd8a05c7f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:03.423873 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3abb4432-9981-4cad-8cba-153dd8a05c7f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:03.424572 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3abb4432-9981-4cad-8cba-153dd8a05c7f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:03.425074 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3abb4432-9981-4cad-8cba-153dd8a05c7f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:03.425511 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3abb4432-9981-4cad-8cba-153dd8a05c7f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:03.516498 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.compute.api [None req-3abb4432-9981-4cad-8cba-153dd8a05c7f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: d6bb2298-addc-4945-a9d3-1f5edfa95ce0] Attempting to quiesce instance before volume snapshot. Oct 18 16:18:03.580042 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.compute.api [None req-3abb4432-9981-4cad-8cba-153dd8a05c7f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: d6bb2298-addc-4945-a9d3-1f5edfa95ce0] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 18 16:18:03.590793 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:03.650197 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3abb4432-9981-4cad-8cba-153dd8a05c7f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: d6bb2298-addc-4945-a9d3-1f5edfa95ce0] Creating snapshot from volume c98971a3-eff2-4654-a38c-cf6187c700a7. {{(pid=120405) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 18 16:18:04.523661 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3abb4432-9981-4cad-8cba-153dd8a05c7f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "POST /compute/v2.1/servers/d6bb2298-addc-4945-a9d3-1f5edfa95ce0/action" status: 202 len: 0 microversion: 2.1 time: 1.113475 Oct 18 16:18:04.524335 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3307/6591] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:18:03 2022] POST /compute/v2.1/servers/d6bb2298-addc-4945-a9d3-1f5edfa95ce0/action => generated 0 bytes in 1115 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 18 16:18:05.681129 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f921b5fe-d4b5-447a-9bd7-5d8909149af7 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1102727276", "imageRef": "fab9449c-ac0b-4dd2-baa1-65e01d8925d2", "flavorRef": "452", "networks": [{"uuid": "a0168786-8cd3-418a-9936-dae2a39b2080"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:18:05.737690 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-f921b5fe-d4b5-447a-9bd7-5d8909149af7 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] validate_networks() for [('a0168786-8cd3-418a-9936-dae2a39b2080', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 16:18:06.109298 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-f921b5fe-d4b5-447a-9bd7-5d8909149af7 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:18:06.109717 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-f921b5fe-d4b5-447a-9bd7-5d8909149af7 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:18:06.110708 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-f921b5fe-d4b5-447a-9bd7-5d8909149af7 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:18:06.111121 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-f921b5fe-d4b5-447a-9bd7-5d8909149af7 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:18:06.111666 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-f921b5fe-d4b5-447a-9bd7-5d8909149af7 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:18:06.120858 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f921b5fe-d4b5-447a-9bd7-5d8909149af7 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:06.121393 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f921b5fe-d4b5-447a-9bd7-5d8909149af7 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:06.121843 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f921b5fe-d4b5-447a-9bd7-5d8909149af7 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:06.122575 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f921b5fe-d4b5-447a-9bd7-5d8909149af7 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:06.123032 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f921b5fe-d4b5-447a-9bd7-5d8909149af7 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:06.123458 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f921b5fe-d4b5-447a-9bd7-5d8909149af7 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:06.140882 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-f921b5fe-d4b5-447a-9bd7-5d8909149af7 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Getting quotas for project c05254b186b04c9cb9858f621938caca. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:18:06.146187 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-f921b5fe-d4b5-447a-9bd7-5d8909149af7 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Getting quotas for user b9f9ae9e929c416a9298499ab8694d37 and project c05254b186b04c9cb9858f621938caca. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:18:06.158745 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f921b5fe-d4b5-447a-9bd7-5d8909149af7 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:18:06.161330 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f921b5fe-d4b5-447a-9bd7-5d8909149af7 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: a77a6d62-8556-4504-86ff-a3e1f65f0fea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='5acf769d-9f0d-4ccc-9884-6476b91eeb05',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:18:06.241799 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f921b5fe-d4b5-447a-9bd7-5d8909149af7 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.564831 Oct 18 16:18:06.242456 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3285/6592] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 16:18:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:18:06.255404 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-da738aaf-503f-479a-86f4-4ef6e49606ec tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:06.256272 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-da738aaf-503f-479a-86f4-4ef6e49606ec tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: a77a6d62-8556-4504-86ff-a3e1f65f0fea] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:06.312346 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-da738aaf-503f-479a-86f4-4ef6e49606ec tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:06.320894 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-da738aaf-503f-479a-86f4-4ef6e49606ec tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea" status: 200 len: 1230 microversion: 2.1 time: 0.071040 Oct 18 16:18:06.321471 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3308/6593] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:06 2022] GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea => generated 1230 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:07.343863 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e00a4035-e9ab-4b33-8f4e-38c0ebac1477 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:07.344587 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e00a4035-e9ab-4b33-8f4e-38c0ebac1477 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: a77a6d62-8556-4504-86ff-a3e1f65f0fea] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:07.353082 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e00a4035-e9ab-4b33-8f4e-38c0ebac1477 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:07.353613 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e00a4035-e9ab-4b33-8f4e-38c0ebac1477 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:07.354160 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e00a4035-e9ab-4b33-8f4e-38c0ebac1477 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:07.355075 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e00a4035-e9ab-4b33-8f4e-38c0ebac1477 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:07.355827 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e00a4035-e9ab-4b33-8f4e-38c0ebac1477 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:07.356413 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e00a4035-e9ab-4b33-8f4e-38c0ebac1477 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:07.421906 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e00a4035-e9ab-4b33-8f4e-38c0ebac1477 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:07.430799 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e00a4035-e9ab-4b33-8f4e-38c0ebac1477 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea" status: 200 len: 1300 microversion: 2.1 time: 0.091002 Oct 18 16:18:07.441865 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3286/6594] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:07 2022] GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea => generated 1300 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:08.453682 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8e6744c5-050f-42f4-b4d6-e5a6bb25540c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:08.454425 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8e6744c5-050f-42f4-b4d6-e5a6bb25540c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: a77a6d62-8556-4504-86ff-a3e1f65f0fea] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:08.461737 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8e6744c5-050f-42f4-b4d6-e5a6bb25540c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:08.462564 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8e6744c5-050f-42f4-b4d6-e5a6bb25540c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:08.463882 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8e6744c5-050f-42f4-b4d6-e5a6bb25540c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:08.464779 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8e6744c5-050f-42f4-b4d6-e5a6bb25540c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:08.465343 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8e6744c5-050f-42f4-b4d6-e5a6bb25540c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:08.465856 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8e6744c5-050f-42f4-b4d6-e5a6bb25540c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:08.624931 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8e6744c5-050f-42f4-b4d6-e5a6bb25540c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:08.633141 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8e6744c5-050f-42f4-b4d6-e5a6bb25540c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea" status: 200 len: 1342 microversion: 2.1 time: 0.183635 Oct 18 16:18:08.633807 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3309/6595] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:08 2022] GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea => generated 1342 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:08.926679 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-f838f253-fba1-4737-adf5-88bbf1942445 req-f0d4d80b-b422-4d33-b31d-2f4f59378989 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a77a6d62-8556-4504-86ff-a3e1f65f0fea", "tag": "6d53d7c1-ed91-4927-8828-58237a9c8539"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:18:08.937124 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f838f253-fba1-4737-adf5-88bbf1942445 req-f0d4d80b-b422-4d33-b31d-2f4f59378989 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:08.937538 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f838f253-fba1-4737-adf5-88bbf1942445 req-f0d4d80b-b422-4d33-b31d-2f4f59378989 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:08.937969 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f838f253-fba1-4737-adf5-88bbf1942445 req-f0d4d80b-b422-4d33-b31d-2f4f59378989 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:08.949694 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-f838f253-fba1-4737-adf5-88bbf1942445 req-f0d4d80b-b422-4d33-b31d-2f4f59378989 service nova] Creating event network-changed:6d53d7c1-ed91-4927-8828-58237a9c8539 for instance a77a6d62-8556-4504-86ff-a3e1f65f0fea on n-h1-853682-5 Oct 18 16:18:08.955651 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-f838f253-fba1-4737-adf5-88bbf1942445 req-f0d4d80b-b422-4d33-b31d-2f4f59378989 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177261 Oct 18 16:18:08.956849 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3287/6596] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:18:09.657711 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7c2f7999-7faa-43fb-8cd0-6d681f0a98e4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:09.658448 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7c2f7999-7faa-43fb-8cd0-6d681f0a98e4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: a77a6d62-8556-4504-86ff-a3e1f65f0fea] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:09.665805 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7c2f7999-7faa-43fb-8cd0-6d681f0a98e4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:09.666309 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7c2f7999-7faa-43fb-8cd0-6d681f0a98e4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:09.666757 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7c2f7999-7faa-43fb-8cd0-6d681f0a98e4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:09.667466 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7c2f7999-7faa-43fb-8cd0-6d681f0a98e4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:09.667942 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7c2f7999-7faa-43fb-8cd0-6d681f0a98e4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:09.668512 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7c2f7999-7faa-43fb-8cd0-6d681f0a98e4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:09.809704 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7c2f7999-7faa-43fb-8cd0-6d681f0a98e4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:09.821012 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7c2f7999-7faa-43fb-8cd0-6d681f0a98e4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea" status: 200 len: 1342 microversion: 2.1 time: 0.166626 Oct 18 16:18:09.821696 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3310/6597] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:09 2022] GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea => generated 1342 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:10.849157 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c4be6cee-42be-4663-bd63-10ce03c35793 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:10.851451 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c4be6cee-42be-4663-bd63-10ce03c35793 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: a77a6d62-8556-4504-86ff-a3e1f65f0fea] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:10.857753 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:10.859477 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4be6cee-42be-4663-bd63-10ce03c35793 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:10.860010 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4be6cee-42be-4663-bd63-10ce03c35793 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:10.861470 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4be6cee-42be-4663-bd63-10ce03c35793 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:10.862211 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4be6cee-42be-4663-bd63-10ce03c35793 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:10.862731 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4be6cee-42be-4663-bd63-10ce03c35793 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:10.863170 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4be6cee-42be-4663-bd63-10ce03c35793 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:11.060420 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c4be6cee-42be-4663-bd63-10ce03c35793 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:11.071393 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c4be6cee-42be-4663-bd63-10ce03c35793 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea" status: 200 len: 1342 microversion: 2.1 time: 0.228644 Oct 18 16:18:11.072686 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3288/6598] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:10 2022] GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea => generated 1342 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:12.104159 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9c83d418-3fd7-4898-9d8e-2879b4bfa065 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:12.104797 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9c83d418-3fd7-4898-9d8e-2879b4bfa065 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: a77a6d62-8556-4504-86ff-a3e1f65f0fea] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:12.113646 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9c83d418-3fd7-4898-9d8e-2879b4bfa065 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:12.114548 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9c83d418-3fd7-4898-9d8e-2879b4bfa065 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:12.115449 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9c83d418-3fd7-4898-9d8e-2879b4bfa065 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:12.116954 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9c83d418-3fd7-4898-9d8e-2879b4bfa065 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:12.117584 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9c83d418-3fd7-4898-9d8e-2879b4bfa065 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:12.118036 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9c83d418-3fd7-4898-9d8e-2879b4bfa065 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:12.310369 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9c83d418-3fd7-4898-9d8e-2879b4bfa065 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:12.326695 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9c83d418-3fd7-4898-9d8e-2879b4bfa065 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea" status: 200 len: 1342 microversion: 2.1 time: 0.226441 Oct 18 16:18:12.340875 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3311/6599] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:12 2022] GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea => generated 1342 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:18:13.357738 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b24cf17e-6875-4784-85e2-ad9863c96343 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:13.358678 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b24cf17e-6875-4784-85e2-ad9863c96343 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: a77a6d62-8556-4504-86ff-a3e1f65f0fea] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:13.365596 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b24cf17e-6875-4784-85e2-ad9863c96343 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:13.366352 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b24cf17e-6875-4784-85e2-ad9863c96343 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:13.366877 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b24cf17e-6875-4784-85e2-ad9863c96343 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:13.367615 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b24cf17e-6875-4784-85e2-ad9863c96343 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:13.368126 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b24cf17e-6875-4784-85e2-ad9863c96343 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:13.368663 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b24cf17e-6875-4784-85e2-ad9863c96343 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:13.581163 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b24cf17e-6875-4784-85e2-ad9863c96343 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:13.591901 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b24cf17e-6875-4784-85e2-ad9863c96343 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea" status: 200 len: 1342 microversion: 2.1 time: 0.239695 Oct 18 16:18:13.600107 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3289/6600] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:13 2022] GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea => generated 1342 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:14.617641 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-28625a3d-f4c7-40f9-aaec-fc9701838a30 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:14.618827 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-28625a3d-f4c7-40f9-aaec-fc9701838a30 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: a77a6d62-8556-4504-86ff-a3e1f65f0fea] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:14.626195 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-28625a3d-f4c7-40f9-aaec-fc9701838a30 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:14.626681 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-28625a3d-f4c7-40f9-aaec-fc9701838a30 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:14.627120 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-28625a3d-f4c7-40f9-aaec-fc9701838a30 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:14.628110 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-28625a3d-f4c7-40f9-aaec-fc9701838a30 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:14.628586 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-28625a3d-f4c7-40f9-aaec-fc9701838a30 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:14.629159 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-28625a3d-f4c7-40f9-aaec-fc9701838a30 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:14.792112 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-28625a3d-f4c7-40f9-aaec-fc9701838a30 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:14.800624 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-28625a3d-f4c7-40f9-aaec-fc9701838a30 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea" status: 200 len: 1342 microversion: 2.1 time: 0.187480 Oct 18 16:18:14.801251 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3312/6601] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:14 2022] GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea => generated 1342 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:15.823723 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2f974685-4648-436a-9363-618170ef67cb tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:15.824281 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2f974685-4648-436a-9363-618170ef67cb tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: a77a6d62-8556-4504-86ff-a3e1f65f0fea] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:15.831603 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f974685-4648-436a-9363-618170ef67cb tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:15.832101 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f974685-4648-436a-9363-618170ef67cb tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:15.832542 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f974685-4648-436a-9363-618170ef67cb tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:15.833285 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f974685-4648-436a-9363-618170ef67cb tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:15.833748 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f974685-4648-436a-9363-618170ef67cb tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:15.834179 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f974685-4648-436a-9363-618170ef67cb tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:15.972041 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2f974685-4648-436a-9363-618170ef67cb tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:15.979962 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2f974685-4648-436a-9363-618170ef67cb tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea" status: 200 len: 1342 microversion: 2.1 time: 0.160247 Oct 18 16:18:15.980539 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3290/6602] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:15 2022] GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea => generated 1342 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:17.004122 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ba455032-3fbd-4e25-893c-4e5f76d1c39d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:17.004759 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ba455032-3fbd-4e25-893c-4e5f76d1c39d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: a77a6d62-8556-4504-86ff-a3e1f65f0fea] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:17.007572 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:17.013267 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba455032-3fbd-4e25-893c-4e5f76d1c39d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:17.013773 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba455032-3fbd-4e25-893c-4e5f76d1c39d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:17.014259 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba455032-3fbd-4e25-893c-4e5f76d1c39d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:17.014998 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba455032-3fbd-4e25-893c-4e5f76d1c39d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:17.015460 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba455032-3fbd-4e25-893c-4e5f76d1c39d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:17.015897 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba455032-3fbd-4e25-893c-4e5f76d1c39d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:17.153715 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ba455032-3fbd-4e25-893c-4e5f76d1c39d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:17.161497 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ba455032-3fbd-4e25-893c-4e5f76d1c39d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea" status: 200 len: 1342 microversion: 2.1 time: 0.161935 Oct 18 16:18:17.162066 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3313/6603] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:16 2022] GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea => generated 1342 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:18.184107 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8d338e50-2a85-4249-8c77-e4c31cc3015d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:18.184688 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8d338e50-2a85-4249-8c77-e4c31cc3015d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: a77a6d62-8556-4504-86ff-a3e1f65f0fea] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:18.186722 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:18.187527 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:18.195094 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d338e50-2a85-4249-8c77-e4c31cc3015d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:18.195584 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d338e50-2a85-4249-8c77-e4c31cc3015d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:18.196030 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d338e50-2a85-4249-8c77-e4c31cc3015d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:18.196731 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d338e50-2a85-4249-8c77-e4c31cc3015d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:18.197253 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d338e50-2a85-4249-8c77-e4c31cc3015d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:18.197684 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d338e50-2a85-4249-8c77-e4c31cc3015d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:18.330626 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8d338e50-2a85-4249-8c77-e4c31cc3015d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:18.338475 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8d338e50-2a85-4249-8c77-e4c31cc3015d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea" status: 200 len: 1342 microversion: 2.1 time: 0.158525 Oct 18 16:18:18.339059 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3291/6604] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:18 2022] GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea => generated 1342 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:19.362449 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-21334caf-fa63-46f1-9ab8-d569e8ef91dc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:19.363079 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-21334caf-fa63-46f1-9ab8-d569e8ef91dc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: a77a6d62-8556-4504-86ff-a3e1f65f0fea] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:19.370277 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-21334caf-fa63-46f1-9ab8-d569e8ef91dc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:19.370780 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-21334caf-fa63-46f1-9ab8-d569e8ef91dc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:19.371225 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-21334caf-fa63-46f1-9ab8-d569e8ef91dc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:19.371974 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-21334caf-fa63-46f1-9ab8-d569e8ef91dc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:19.372442 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-21334caf-fa63-46f1-9ab8-d569e8ef91dc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:19.372946 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-21334caf-fa63-46f1-9ab8-d569e8ef91dc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:19.505687 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-21334caf-fa63-46f1-9ab8-d569e8ef91dc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:19.514193 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-21334caf-fa63-46f1-9ab8-d569e8ef91dc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea" status: 200 len: 1342 microversion: 2.1 time: 0.156126 Oct 18 16:18:19.514860 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3314/6605] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:19 2022] GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea => generated 1342 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:20.541111 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2663313d-ecef-4651-9832-1d3cc3ed82a3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:20.542077 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2663313d-ecef-4651-9832-1d3cc3ed82a3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: a77a6d62-8556-4504-86ff-a3e1f65f0fea] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:20.549696 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2663313d-ecef-4651-9832-1d3cc3ed82a3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:20.550180 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2663313d-ecef-4651-9832-1d3cc3ed82a3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:20.550612 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2663313d-ecef-4651-9832-1d3cc3ed82a3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:20.551392 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2663313d-ecef-4651-9832-1d3cc3ed82a3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:20.552084 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2663313d-ecef-4651-9832-1d3cc3ed82a3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:20.552632 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2663313d-ecef-4651-9832-1d3cc3ed82a3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:20.708609 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2663313d-ecef-4651-9832-1d3cc3ed82a3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:20.716522 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2663313d-ecef-4651-9832-1d3cc3ed82a3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea" status: 200 len: 1342 microversion: 2.1 time: 0.181408 Oct 18 16:18:20.717213 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3292/6606] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:20 2022] GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea => generated 1342 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:21.739759 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-48fdcfaf-f607-4097-ade2-b2bcff3ad50c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:21.740399 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-48fdcfaf-f607-4097-ade2-b2bcff3ad50c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: a77a6d62-8556-4504-86ff-a3e1f65f0fea] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:21.743263 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=34 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:21.748919 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-48fdcfaf-f607-4097-ade2-b2bcff3ad50c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:21.749439 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-48fdcfaf-f607-4097-ade2-b2bcff3ad50c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:21.749904 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-48fdcfaf-f607-4097-ade2-b2bcff3ad50c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:21.750642 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-48fdcfaf-f607-4097-ade2-b2bcff3ad50c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:21.751138 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-48fdcfaf-f607-4097-ade2-b2bcff3ad50c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:21.751569 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-48fdcfaf-f607-4097-ade2-b2bcff3ad50c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:21.894127 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-48fdcfaf-f607-4097-ade2-b2bcff3ad50c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:21.902180 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-48fdcfaf-f607-4097-ade2-b2bcff3ad50c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea" status: 200 len: 1342 microversion: 2.1 time: 0.166291 Oct 18 16:18:21.902764 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3315/6607] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:21 2022] GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea => generated 1342 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:22.927439 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bff50360-6c46-4455-8c1b-5b1dcd302f9e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:22.928325 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bff50360-6c46-4455-8c1b-5b1dcd302f9e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: a77a6d62-8556-4504-86ff-a3e1f65f0fea] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:22.935307 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bff50360-6c46-4455-8c1b-5b1dcd302f9e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:22.935794 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bff50360-6c46-4455-8c1b-5b1dcd302f9e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:22.936235 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bff50360-6c46-4455-8c1b-5b1dcd302f9e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:22.936966 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bff50360-6c46-4455-8c1b-5b1dcd302f9e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:22.937429 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bff50360-6c46-4455-8c1b-5b1dcd302f9e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:22.937859 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bff50360-6c46-4455-8c1b-5b1dcd302f9e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:23.405936 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bff50360-6c46-4455-8c1b-5b1dcd302f9e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:23.414306 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bff50360-6c46-4455-8c1b-5b1dcd302f9e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea" status: 200 len: 1376 microversion: 2.1 time: 0.491729 Oct 18 16:18:23.414895 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3293/6608] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:22 2022] GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea => generated 1376 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:24.438457 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-244dbce2-34d4-4c15-81eb-cfcaf4e554ce tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:24.439090 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-244dbce2-34d4-4c15-81eb-cfcaf4e554ce tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: a77a6d62-8556-4504-86ff-a3e1f65f0fea] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:24.445905 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-244dbce2-34d4-4c15-81eb-cfcaf4e554ce tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:24.446478 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-244dbce2-34d4-4c15-81eb-cfcaf4e554ce tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:24.446942 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-244dbce2-34d4-4c15-81eb-cfcaf4e554ce tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:24.447651 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-244dbce2-34d4-4c15-81eb-cfcaf4e554ce tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:24.448124 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-244dbce2-34d4-4c15-81eb-cfcaf4e554ce tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:24.448564 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-244dbce2-34d4-4c15-81eb-cfcaf4e554ce tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:24.579209 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-244dbce2-34d4-4c15-81eb-cfcaf4e554ce tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:24.587845 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-244dbce2-34d4-4c15-81eb-cfcaf4e554ce tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea" status: 200 len: 1376 microversion: 2.1 time: 0.153383 Oct 18 16:18:24.588587 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3316/6609] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:24 2022] GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea => generated 1376 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:25.612574 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fa6173e4-40aa-405d-811d-9e34e748c61b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:25.613427 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fa6173e4-40aa-405d-811d-9e34e748c61b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: a77a6d62-8556-4504-86ff-a3e1f65f0fea] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:25.621639 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fa6173e4-40aa-405d-811d-9e34e748c61b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:25.622125 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fa6173e4-40aa-405d-811d-9e34e748c61b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:25.622561 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fa6173e4-40aa-405d-811d-9e34e748c61b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:25.623520 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fa6173e4-40aa-405d-811d-9e34e748c61b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:25.623994 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fa6173e4-40aa-405d-811d-9e34e748c61b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:25.624419 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fa6173e4-40aa-405d-811d-9e34e748c61b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:25.768332 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fa6173e4-40aa-405d-811d-9e34e748c61b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:25.776313 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fa6173e4-40aa-405d-811d-9e34e748c61b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea" status: 200 len: 1376 microversion: 2.1 time: 0.168525 Oct 18 16:18:25.776916 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3294/6610] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:25 2022] GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea => generated 1376 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:26.802669 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b1b4e6de-b81f-4a02-b323-6c70c4a226c5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:26.803853 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b1b4e6de-b81f-4a02-b323-6c70c4a226c5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: a77a6d62-8556-4504-86ff-a3e1f65f0fea] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:26.812989 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b1b4e6de-b81f-4a02-b323-6c70c4a226c5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:26.813676 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b1b4e6de-b81f-4a02-b323-6c70c4a226c5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:26.814888 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b1b4e6de-b81f-4a02-b323-6c70c4a226c5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:26.815798 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b1b4e6de-b81f-4a02-b323-6c70c4a226c5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:26.816276 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b1b4e6de-b81f-4a02-b323-6c70c4a226c5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:26.816726 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b1b4e6de-b81f-4a02-b323-6c70c4a226c5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:26.958301 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b1b4e6de-b81f-4a02-b323-6c70c4a226c5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:26.968633 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b1b4e6de-b81f-4a02-b323-6c70c4a226c5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea" status: 200 len: 1376 microversion: 2.1 time: 0.172065 Oct 18 16:18:26.969267 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3317/6611] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:26 2022] GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea => generated 1376 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:27.995139 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eb5bdc9f-a553-4bd8-b54c-69f1773640e1 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:27.995669 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-eb5bdc9f-a553-4bd8-b54c-69f1773640e1 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: a77a6d62-8556-4504-86ff-a3e1f65f0fea] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:28.002593 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb5bdc9f-a553-4bd8-b54c-69f1773640e1 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:28.003071 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb5bdc9f-a553-4bd8-b54c-69f1773640e1 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:28.003504 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb5bdc9f-a553-4bd8-b54c-69f1773640e1 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:28.004191 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb5bdc9f-a553-4bd8-b54c-69f1773640e1 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:28.004640 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb5bdc9f-a553-4bd8-b54c-69f1773640e1 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:28.005085 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb5bdc9f-a553-4bd8-b54c-69f1773640e1 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:28.007620 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=82 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:28.143355 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-eb5bdc9f-a553-4bd8-b54c-69f1773640e1 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:28.151301 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-eb5bdc9f-a553-4bd8-b54c-69f1773640e1 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea" status: 200 len: 1376 microversion: 2.1 time: 0.160259 Oct 18 16:18:28.151895 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3295/6612] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:27 2022] GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea => generated 1376 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:29.175580 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-63008cfe-5841-4d55-b8af-558dfa9c2005 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:29.176209 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-63008cfe-5841-4d55-b8af-558dfa9c2005 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: a77a6d62-8556-4504-86ff-a3e1f65f0fea] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:29.183451 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-63008cfe-5841-4d55-b8af-558dfa9c2005 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:29.183951 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-63008cfe-5841-4d55-b8af-558dfa9c2005 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:29.184404 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-63008cfe-5841-4d55-b8af-558dfa9c2005 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:29.185140 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-63008cfe-5841-4d55-b8af-558dfa9c2005 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:29.185609 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-63008cfe-5841-4d55-b8af-558dfa9c2005 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:29.186051 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-63008cfe-5841-4d55-b8af-558dfa9c2005 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:29.317413 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-63008cfe-5841-4d55-b8af-558dfa9c2005 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:29.325142 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-63008cfe-5841-4d55-b8af-558dfa9c2005 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea" status: 200 len: 1376 microversion: 2.1 time: 0.154066 Oct 18 16:18:29.325716 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3318/6613] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:29 2022] GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea => generated 1376 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:30.348495 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-37c9165b-c5c3-4929-a1da-5b6fcff8ddb5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:30.349300 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-37c9165b-c5c3-4929-a1da-5b6fcff8ddb5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: a77a6d62-8556-4504-86ff-a3e1f65f0fea] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:30.357172 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-37c9165b-c5c3-4929-a1da-5b6fcff8ddb5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:30.357871 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-37c9165b-c5c3-4929-a1da-5b6fcff8ddb5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:30.358369 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-37c9165b-c5c3-4929-a1da-5b6fcff8ddb5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:30.359205 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-37c9165b-c5c3-4929-a1da-5b6fcff8ddb5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:30.359671 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-37c9165b-c5c3-4929-a1da-5b6fcff8ddb5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:30.360104 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-37c9165b-c5c3-4929-a1da-5b6fcff8ddb5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:30.506210 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-37c9165b-c5c3-4929-a1da-5b6fcff8ddb5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:30.516298 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-37c9165b-c5c3-4929-a1da-5b6fcff8ddb5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea" status: 200 len: 1376 microversion: 2.1 time: 0.172221 Oct 18 16:18:30.516954 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3296/6614] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:30 2022] GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea => generated 1376 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:18:31.539895 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1238f48c-e467-4b43-8b1f-e8e5002a35c5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:31.540598 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1238f48c-e467-4b43-8b1f-e8e5002a35c5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: a77a6d62-8556-4504-86ff-a3e1f65f0fea] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:31.548403 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1238f48c-e467-4b43-8b1f-e8e5002a35c5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:31.548994 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1238f48c-e467-4b43-8b1f-e8e5002a35c5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:31.549502 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1238f48c-e467-4b43-8b1f-e8e5002a35c5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:31.550262 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1238f48c-e467-4b43-8b1f-e8e5002a35c5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:31.550790 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1238f48c-e467-4b43-8b1f-e8e5002a35c5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:31.551231 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1238f48c-e467-4b43-8b1f-e8e5002a35c5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:31.698959 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1238f48c-e467-4b43-8b1f-e8e5002a35c5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:31.707182 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1238f48c-e467-4b43-8b1f-e8e5002a35c5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea" status: 200 len: 1376 microversion: 2.1 time: 0.171257 Oct 18 16:18:31.707884 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3319/6615] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:31 2022] GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea => generated 1376 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:32.732765 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-65aad583-a930-490b-8790-90fe06f414ac tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:32.733546 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-65aad583-a930-490b-8790-90fe06f414ac tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: a77a6d62-8556-4504-86ff-a3e1f65f0fea] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:32.743140 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65aad583-a930-490b-8790-90fe06f414ac tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:32.743757 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65aad583-a930-490b-8790-90fe06f414ac tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:32.744266 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65aad583-a930-490b-8790-90fe06f414ac tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:32.745006 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65aad583-a930-490b-8790-90fe06f414ac tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:32.745462 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65aad583-a930-490b-8790-90fe06f414ac tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:32.745888 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65aad583-a930-490b-8790-90fe06f414ac tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:32.896609 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-65aad583-a930-490b-8790-90fe06f414ac tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:32.908584 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-65aad583-a930-490b-8790-90fe06f414ac tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea" status: 200 len: 1376 microversion: 2.1 time: 0.179729 Oct 18 16:18:32.909292 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3297/6616] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:32 2022] GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea => generated 1376 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:33.890982 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-8a774787-ddac-4e8c-9cf7-ac840af987f0 req-c0dcf3bb-6168-4554-8dda-c1934c8694de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a77a6d62-8556-4504-86ff-a3e1f65f0fea", "name": "network-vif-plugged", "status": "completed", "tag": "6d53d7c1-ed91-4927-8828-58237a9c8539"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:18:33.901828 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-8a774787-ddac-4e8c-9cf7-ac840af987f0 req-c0dcf3bb-6168-4554-8dda-c1934c8694de service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:33.902317 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-8a774787-ddac-4e8c-9cf7-ac840af987f0 req-c0dcf3bb-6168-4554-8dda-c1934c8694de service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:33.902759 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-8a774787-ddac-4e8c-9cf7-ac840af987f0 req-c0dcf3bb-6168-4554-8dda-c1934c8694de service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:33.906635 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:SELECT=70 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:33.915492 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-8a774787-ddac-4e8c-9cf7-ac840af987f0 req-c0dcf3bb-6168-4554-8dda-c1934c8694de service nova] Creating event network-vif-plugged:6d53d7c1-ed91-4927-8828-58237a9c8539 for instance a77a6d62-8556-4504-86ff-a3e1f65f0fea on n-h1-853682-5 Oct 18 16:18:33.920893 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-8a774787-ddac-4e8c-9cf7-ac840af987f0 req-c0dcf3bb-6168-4554-8dda-c1934c8694de service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033702 Oct 18 16:18:33.921691 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3320/6617] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:18:33.934254 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f171a845-4a06-48ac-a70e-197edf0c5216 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:33.934967 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f171a845-4a06-48ac-a70e-197edf0c5216 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: a77a6d62-8556-4504-86ff-a3e1f65f0fea] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:33.941728 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f171a845-4a06-48ac-a70e-197edf0c5216 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:33.942216 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f171a845-4a06-48ac-a70e-197edf0c5216 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:33.942655 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f171a845-4a06-48ac-a70e-197edf0c5216 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:33.943363 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f171a845-4a06-48ac-a70e-197edf0c5216 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:33.943823 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f171a845-4a06-48ac-a70e-197edf0c5216 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:33.944253 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f171a845-4a06-48ac-a70e-197edf0c5216 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:34.083167 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f171a845-4a06-48ac-a70e-197edf0c5216 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:34.091240 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f171a845-4a06-48ac-a70e-197edf0c5216 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea" status: 200 len: 1376 microversion: 2.1 time: 0.160536 Oct 18 16:18:34.091802 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3298/6618] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:33 2022] GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea => generated 1376 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:35.116258 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-918eff4b-d046-4056-bc34-b679d77aad37 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:35.117013 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-918eff4b-d046-4056-bc34-b679d77aad37 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: a77a6d62-8556-4504-86ff-a3e1f65f0fea] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:35.123280 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-918eff4b-d046-4056-bc34-b679d77aad37 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:35.123776 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-918eff4b-d046-4056-bc34-b679d77aad37 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:35.124226 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-918eff4b-d046-4056-bc34-b679d77aad37 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:35.124961 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-918eff4b-d046-4056-bc34-b679d77aad37 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:35.125434 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-918eff4b-d046-4056-bc34-b679d77aad37 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:35.125874 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-918eff4b-d046-4056-bc34-b679d77aad37 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:35.267003 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-918eff4b-d046-4056-bc34-b679d77aad37 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:35.275837 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-918eff4b-d046-4056-bc34-b679d77aad37 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea" status: 200 len: 1376 microversion: 2.1 time: 0.165099 Oct 18 16:18:35.276640 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3321/6619] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:35 2022] GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea => generated 1376 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:36.299705 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-00ed1fe4-8903-4205-81ca-f4294485d8a5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:36.300326 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-00ed1fe4-8903-4205-81ca-f4294485d8a5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: a77a6d62-8556-4504-86ff-a3e1f65f0fea] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:36.307268 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00ed1fe4-8903-4205-81ca-f4294485d8a5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:36.307760 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00ed1fe4-8903-4205-81ca-f4294485d8a5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:36.308200 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00ed1fe4-8903-4205-81ca-f4294485d8a5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:36.308926 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00ed1fe4-8903-4205-81ca-f4294485d8a5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:36.309391 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00ed1fe4-8903-4205-81ca-f4294485d8a5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:36.309822 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00ed1fe4-8903-4205-81ca-f4294485d8a5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:36.441556 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-00ed1fe4-8903-4205-81ca-f4294485d8a5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:36.449300 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-00ed1fe4-8903-4205-81ca-f4294485d8a5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea" status: 200 len: 1563 microversion: 2.1 time: 0.154192 Oct 18 16:18:36.449868 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3299/6620] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:36 2022] GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:36.473699 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ef37b58f-0f03-4519-a962-c384274ddb3d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:36.474332 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ef37b58f-0f03-4519-a962-c384274ddb3d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: a77a6d62-8556-4504-86ff-a3e1f65f0fea] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:36.482966 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ef37b58f-0f03-4519-a962-c384274ddb3d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:36.483481 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ef37b58f-0f03-4519-a962-c384274ddb3d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:36.484084 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ef37b58f-0f03-4519-a962-c384274ddb3d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:36.484841 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ef37b58f-0f03-4519-a962-c384274ddb3d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:36.485314 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ef37b58f-0f03-4519-a962-c384274ddb3d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:36.485807 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ef37b58f-0f03-4519-a962-c384274ddb3d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:36.621538 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ef37b58f-0f03-4519-a962-c384274ddb3d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:36.629540 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ef37b58f-0f03-4519-a962-c384274ddb3d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea" status: 200 len: 1563 microversion: 2.1 time: 0.160326 Oct 18 16:18:36.630126 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3322/6621] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:36 2022] GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:36.711538 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-392fcc2c-2312-48db-adfa-97290fd99e6a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:36.712038 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-392fcc2c-2312-48db-adfa-97290fd99e6a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: a77a6d62-8556-4504-86ff-a3e1f65f0fea] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:36.718160 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-392fcc2c-2312-48db-adfa-97290fd99e6a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:36.718646 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-392fcc2c-2312-48db-adfa-97290fd99e6a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:36.719086 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-392fcc2c-2312-48db-adfa-97290fd99e6a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:36.719775 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-392fcc2c-2312-48db-adfa-97290fd99e6a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:36.720857 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-392fcc2c-2312-48db-adfa-97290fd99e6a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:36.721289 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-392fcc2c-2312-48db-adfa-97290fd99e6a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:36.747758 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-392fcc2c-2312-48db-adfa-97290fd99e6a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: a77a6d62-8556-4504-86ff-a3e1f65f0fea] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:18:36.827379 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-392fcc2c-2312-48db-adfa-97290fd99e6a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea" status: 204 len: 0 microversion: 2.1 time: 0.119539 Oct 18 16:18:36.827880 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3300/6622] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 16:18:36 2022] DELETE /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:18:36.838409 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4e2708de-988f-4b40-a592-83a39c8d7de7 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:36.839089 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4e2708de-988f-4b40-a592-83a39c8d7de7 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: a77a6d62-8556-4504-86ff-a3e1f65f0fea] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:36.845808 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4e2708de-988f-4b40-a592-83a39c8d7de7 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:36.846311 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4e2708de-988f-4b40-a592-83a39c8d7de7 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:36.846769 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4e2708de-988f-4b40-a592-83a39c8d7de7 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:36.847512 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4e2708de-988f-4b40-a592-83a39c8d7de7 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:36.847990 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4e2708de-988f-4b40-a592-83a39c8d7de7 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:36.848437 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4e2708de-988f-4b40-a592-83a39c8d7de7 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:36.981440 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4e2708de-988f-4b40-a592-83a39c8d7de7 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:36.989978 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4e2708de-988f-4b40-a592-83a39c8d7de7 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea" status: 200 len: 1569 microversion: 2.1 time: 0.157751 Oct 18 16:18:36.990574 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3323/6623] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:36 2022] GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:38.013392 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3710d567-9d36-4cea-bc1b-c608e19abc77 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:38.014106 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3710d567-9d36-4cea-bc1b-c608e19abc77 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: a77a6d62-8556-4504-86ff-a3e1f65f0fea] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:38.021683 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3710d567-9d36-4cea-bc1b-c608e19abc77 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:38.022157 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3710d567-9d36-4cea-bc1b-c608e19abc77 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:38.022627 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3710d567-9d36-4cea-bc1b-c608e19abc77 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:38.023319 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3710d567-9d36-4cea-bc1b-c608e19abc77 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:38.023772 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3710d567-9d36-4cea-bc1b-c608e19abc77 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:38.024227 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3710d567-9d36-4cea-bc1b-c608e19abc77 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:38.164486 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3710d567-9d36-4cea-bc1b-c608e19abc77 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:38.172550 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3710d567-9d36-4cea-bc1b-c608e19abc77 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea" status: 200 len: 1569 microversion: 2.1 time: 0.163646 Oct 18 16:18:38.173161 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3301/6624] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:38 2022] GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:39.196313 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-985c2df9-6f00-4497-9cce-c360acfdc1d0 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:39.196918 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-985c2df9-6f00-4497-9cce-c360acfdc1d0 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: a77a6d62-8556-4504-86ff-a3e1f65f0fea] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:39.203805 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-985c2df9-6f00-4497-9cce-c360acfdc1d0 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:39.204308 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-985c2df9-6f00-4497-9cce-c360acfdc1d0 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:39.205330 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-985c2df9-6f00-4497-9cce-c360acfdc1d0 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:39.206048 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-985c2df9-6f00-4497-9cce-c360acfdc1d0 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:39.206524 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-985c2df9-6f00-4497-9cce-c360acfdc1d0 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:39.206969 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-985c2df9-6f00-4497-9cce-c360acfdc1d0 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:39.359001 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-985c2df9-6f00-4497-9cce-c360acfdc1d0 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:39.373332 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-985c2df9-6f00-4497-9cce-c360acfdc1d0 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea" status: 200 len: 1569 microversion: 2.1 time: 0.180902 Oct 18 16:18:39.380903 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3324/6625] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:39 2022] GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea => generated 1569 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:39.401823 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-57f67e59-d4af-48ec-8699-6b652f8fbc8b req-5715d3c0-eb66-47d0-aaf2-ba20604f8552 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a77a6d62-8556-4504-86ff-a3e1f65f0fea", "name": "network-vif-deleted", "tag": "6d53d7c1-ed91-4927-8828-58237a9c8539"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:18:39.413665 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-57f67e59-d4af-48ec-8699-6b652f8fbc8b req-5715d3c0-eb66-47d0-aaf2-ba20604f8552 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:39.414227 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-57f67e59-d4af-48ec-8699-6b652f8fbc8b req-5715d3c0-eb66-47d0-aaf2-ba20604f8552 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:39.414763 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-57f67e59-d4af-48ec-8699-6b652f8fbc8b req-5715d3c0-eb66-47d0-aaf2-ba20604f8552 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:39.429558 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-57f67e59-d4af-48ec-8699-6b652f8fbc8b req-5715d3c0-eb66-47d0-aaf2-ba20604f8552 service nova] Creating event network-vif-deleted:6d53d7c1-ed91-4927-8828-58237a9c8539 for instance a77a6d62-8556-4504-86ff-a3e1f65f0fea on n-h1-853682-5 Oct 18 16:18:39.434630 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-57f67e59-d4af-48ec-8699-6b652f8fbc8b req-5715d3c0-eb66-47d0-aaf2-ba20604f8552 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037358 Oct 18 16:18:39.435766 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3302/6626] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:18:40.399978 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ba68052a-e130-48c2-bbd6-cf198b0ff320 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:40.400620 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ba68052a-e130-48c2-bbd6-cf198b0ff320 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: a77a6d62-8556-4504-86ff-a3e1f65f0fea] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:40.408619 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba68052a-e130-48c2-bbd6-cf198b0ff320 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:40.409317 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba68052a-e130-48c2-bbd6-cf198b0ff320 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:40.409907 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba68052a-e130-48c2-bbd6-cf198b0ff320 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:40.410768 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba68052a-e130-48c2-bbd6-cf198b0ff320 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:40.411401 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba68052a-e130-48c2-bbd6-cf198b0ff320 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:40.411852 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ba68052a-e130-48c2-bbd6-cf198b0ff320 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:40.481045 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ba68052a-e130-48c2-bbd6-cf198b0ff320 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:40.489456 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ba68052a-e130-48c2-bbd6-cf198b0ff320 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea" status: 200 len: 1361 microversion: 2.1 time: 0.094236 Oct 18 16:18:40.490074 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3325/6627] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:40 2022] GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea => generated 1361 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:41.515087 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-49cb760a-0390-4b6a-8ba3-ddec6de08f83 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:41.515719 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-49cb760a-0390-4b6a-8ba3-ddec6de08f83 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: a77a6d62-8556-4504-86ff-a3e1f65f0fea] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:41.517845 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:41.523380 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49cb760a-0390-4b6a-8ba3-ddec6de08f83 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:41.523868 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49cb760a-0390-4b6a-8ba3-ddec6de08f83 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:41.524366 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49cb760a-0390-4b6a-8ba3-ddec6de08f83 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:41.525157 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49cb760a-0390-4b6a-8ba3-ddec6de08f83 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:41.525618 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49cb760a-0390-4b6a-8ba3-ddec6de08f83 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:41.526068 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49cb760a-0390-4b6a-8ba3-ddec6de08f83 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:41.609081 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-49cb760a-0390-4b6a-8ba3-ddec6de08f83 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:41.617941 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-49cb760a-0390-4b6a-8ba3-ddec6de08f83 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea" status: 200 len: 1361 microversion: 2.1 time: 0.108264 Oct 18 16:18:41.618587 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3303/6628] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:41 2022] GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea => generated 1361 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:42.640272 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0d270f92-19ff-4d59-b5c5-b766c657c3f0 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:42.640930 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0d270f92-19ff-4d59-b5c5-b766c657c3f0 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: a77a6d62-8556-4504-86ff-a3e1f65f0fea] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:42.648406 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0d270f92-19ff-4d59-b5c5-b766c657c3f0 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:42.648931 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0d270f92-19ff-4d59-b5c5-b766c657c3f0 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:42.649381 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0d270f92-19ff-4d59-b5c5-b766c657c3f0 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:42.650187 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0d270f92-19ff-4d59-b5c5-b766c657c3f0 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:42.650667 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0d270f92-19ff-4d59-b5c5-b766c657c3f0 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:42.651107 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0d270f92-19ff-4d59-b5c5-b766c657c3f0 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:42.729289 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0d270f92-19ff-4d59-b5c5-b766c657c3f0 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:42.738614 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0d270f92-19ff-4d59-b5c5-b766c657c3f0 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea" status: 200 len: 1361 microversion: 2.1 time: 0.102252 Oct 18 16:18:42.739281 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3326/6629] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:42 2022] GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea => generated 1361 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:43.763327 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9f07899b-e758-43e5-9076-55eb6ea99c39 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:43.764095 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9f07899b-e758-43e5-9076-55eb6ea99c39 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: a77a6d62-8556-4504-86ff-a3e1f65f0fea] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:43.773677 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f07899b-e758-43e5-9076-55eb6ea99c39 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:43.774853 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f07899b-e758-43e5-9076-55eb6ea99c39 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:43.775448 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f07899b-e758-43e5-9076-55eb6ea99c39 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:43.775842 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f07899b-e758-43e5-9076-55eb6ea99c39 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:43.776422 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f07899b-e758-43e5-9076-55eb6ea99c39 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:43.776960 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f07899b-e758-43e5-9076-55eb6ea99c39 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:43.853959 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9f07899b-e758-43e5-9076-55eb6ea99c39 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:43.865479 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9f07899b-e758-43e5-9076-55eb6ea99c39 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea" status: 200 len: 1361 microversion: 2.1 time: 0.107489 Oct 18 16:18:43.866103 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3304/6630] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:43 2022] GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea => generated 1361 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:44.889621 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a483e622-a417-4427-8636-43b53a7f2364 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:44.890288 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a483e622-a417-4427-8636-43b53a7f2364 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: a77a6d62-8556-4504-86ff-a3e1f65f0fea] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:44.897694 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a483e622-a417-4427-8636-43b53a7f2364 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:44.898184 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a483e622-a417-4427-8636-43b53a7f2364 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:44.898630 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a483e622-a417-4427-8636-43b53a7f2364 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:44.899332 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a483e622-a417-4427-8636-43b53a7f2364 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:44.900170 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a483e622-a417-4427-8636-43b53a7f2364 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:44.900265 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a483e622-a417-4427-8636-43b53a7f2364 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:44.914889 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-a483e622-a417-4427-8636-43b53a7f2364 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] HTTP exception thrown: Instance a77a6d62-8556-4504-86ff-a3e1f65f0fea could not be found. Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a483e622-a417-4427-8636-43b53a7f2364 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Request method failure captured: Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea HTTP/1.1 Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTtEVF9uJ-JO9Xs31vnHSSsjSYlxrsUC5zmDUZwq19epJ_KRexhuRnv973VnMOHKUrtuEaLEal20PXz-3F2SqeQ_VcN02CwN6WkvucYcQaG_QXU6RKnbyMb6Baxa9c0pM4Y0eYUesqFYGvUA-9UWLfliXu3xhi5bS1_xU9JBCKzY9b2g Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: c05254b186b04c9cb9858f621938caca Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-TestVolumeBootPattern-1353957077 Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c05254b186b04c9cb9858f621938caca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c05254b186b04c9cb9858f621938caca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c05254b186b04c9cb9858f621938caca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c05254b186b04c9cb9858f621938caca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-TestVolumeBootPattern-1353957077 Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: c05254b186b04c9cb9858f621938caca Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-TestVolumeBootPattern-1353957077 Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-TestVolumeBootPattern-1353957077-project Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: b9f9ae9e929c416a9298499ab8694d37 Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-TestVolumeBootPattern-1353957077-project Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance a77a6d62-8556-4504-86ff-a3e1f65f0fea could not be found. Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'a77a6d62-8556-4504-86ff-a3e1f65f0fea'} Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a77a6d62-8556-4504-86ff-a3e1f65f0fea could not be found. Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a77a6d62-8556-4504-86ff-a3e1f65f0fea could not be found. Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:18:44.916565 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:18:44.920749 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:44.920749 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:18:44.920749 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:18:44.920749 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:18:44.920749 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:18:44.920749 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a77a6d62-8556-4504-86ff-a3e1f65f0fea could not be found. Oct 18 16:18:44.920749 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:18:44.920749 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a483e622-a417-4427-8636-43b53a7f2364 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Returning 404 to user: Instance a77a6d62-8556-4504-86ff-a3e1f65f0fea could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:18:44.920749 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a483e622-a417-4427-8636-43b53a7f2364 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea" status: 404 len: 111 microversion: 2.1 time: 0.032402 Oct 18 16:18:44.921846 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3327/6631] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:44 2022] GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:18:49.200944 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b76566d2-e74d-4951-8a1f-684d6d607c7c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:49.201444 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b76566d2-e74d-4951-8a1f-684d6d607c7c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: d6bb2298-addc-4945-a9d3-1f5edfa95ce0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:49.208954 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b76566d2-e74d-4951-8a1f-684d6d607c7c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:49.209444 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b76566d2-e74d-4951-8a1f-684d6d607c7c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:49.209884 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b76566d2-e74d-4951-8a1f-684d6d607c7c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:49.210581 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b76566d2-e74d-4951-8a1f-684d6d607c7c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:49.211040 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b76566d2-e74d-4951-8a1f-684d6d607c7c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:49.211465 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b76566d2-e74d-4951-8a1f-684d6d607c7c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:49.237068 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b76566d2-e74d-4951-8a1f-684d6d607c7c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: d6bb2298-addc-4945-a9d3-1f5edfa95ce0] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:18:49.312215 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b76566d2-e74d-4951-8a1f-684d6d607c7c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d6bb2298-addc-4945-a9d3-1f5edfa95ce0" status: 204 len: 0 microversion: 2.1 time: 0.114929 Oct 18 16:18:49.313025 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3305/6632] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 16:18:49 2022] DELETE /compute/v2.1/servers/d6bb2298-addc-4945-a9d3-1f5edfa95ce0 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:18:49.321570 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2e0b3040-6690-4a93-a8a8-26009db082fc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:49.322198 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2e0b3040-6690-4a93-a8a8-26009db082fc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: d6bb2298-addc-4945-a9d3-1f5edfa95ce0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:49.330498 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2e0b3040-6690-4a93-a8a8-26009db082fc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:49.330994 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2e0b3040-6690-4a93-a8a8-26009db082fc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:49.331443 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2e0b3040-6690-4a93-a8a8-26009db082fc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:49.332157 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2e0b3040-6690-4a93-a8a8-26009db082fc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:49.332629 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2e0b3040-6690-4a93-a8a8-26009db082fc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:49.333101 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2e0b3040-6690-4a93-a8a8-26009db082fc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:49.466982 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2e0b3040-6690-4a93-a8a8-26009db082fc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:49.474939 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2e0b3040-6690-4a93-a8a8-26009db082fc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/d6bb2298-addc-4945-a9d3-1f5edfa95ce0" status: 200 len: 1409 microversion: 2.1 time: 0.157443 Oct 18 16:18:49.475646 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3328/6633] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:49 2022] GET /compute/v2.1/servers/d6bb2298-addc-4945-a9d3-1f5edfa95ce0 => generated 1409 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:50.499220 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0864f970-2fa6-4369-8bc5-524f993948dd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:50.499952 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0864f970-2fa6-4369-8bc5-524f993948dd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: d6bb2298-addc-4945-a9d3-1f5edfa95ce0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:50.506895 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0864f970-2fa6-4369-8bc5-524f993948dd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:50.507377 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0864f970-2fa6-4369-8bc5-524f993948dd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:50.507814 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0864f970-2fa6-4369-8bc5-524f993948dd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:50.508502 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0864f970-2fa6-4369-8bc5-524f993948dd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:50.509068 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0864f970-2fa6-4369-8bc5-524f993948dd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:50.509474 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0864f970-2fa6-4369-8bc5-524f993948dd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:50.646723 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0864f970-2fa6-4369-8bc5-524f993948dd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:50.654497 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0864f970-2fa6-4369-8bc5-524f993948dd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/d6bb2298-addc-4945-a9d3-1f5edfa95ce0" status: 200 len: 1409 microversion: 2.1 time: 0.159619 Oct 18 16:18:50.655085 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3306/6634] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:50 2022] GET /compute/v2.1/servers/d6bb2298-addc-4945-a9d3-1f5edfa95ce0 => generated 1409 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:51.275784 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-4411b845-c91d-40a4-958c-e6d513ff046b req-33f6146b-c6ad-48d2-8e9b-f3980834d5c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6bb2298-addc-4945-a9d3-1f5edfa95ce0", "name": "network-vif-deleted", "tag": "7b96e195-615c-4953-9368-6c9e25e007c8"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:18:51.288976 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-4411b845-c91d-40a4-958c-e6d513ff046b req-33f6146b-c6ad-48d2-8e9b-f3980834d5c4 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:51.290133 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-4411b845-c91d-40a4-958c-e6d513ff046b req-33f6146b-c6ad-48d2-8e9b-f3980834d5c4 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:51.290388 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-4411b845-c91d-40a4-958c-e6d513ff046b req-33f6146b-c6ad-48d2-8e9b-f3980834d5c4 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:51.303914 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-4411b845-c91d-40a4-958c-e6d513ff046b req-33f6146b-c6ad-48d2-8e9b-f3980834d5c4 service nova] Creating event network-vif-deleted:7b96e195-615c-4953-9368-6c9e25e007c8 for instance d6bb2298-addc-4945-a9d3-1f5edfa95ce0 on n-h2-853682-5 Oct 18 16:18:51.309232 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-4411b845-c91d-40a4-958c-e6d513ff046b req-33f6146b-c6ad-48d2-8e9b-f3980834d5c4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037188 Oct 18 16:18:51.310011 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3329/6635] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:18:51.680091 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b8c2aa5b-cdd8-404e-8e17-e8a9571e8497 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:51.682309 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b8c2aa5b-cdd8-404e-8e17-e8a9571e8497 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: d6bb2298-addc-4945-a9d3-1f5edfa95ce0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:51.690508 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8c2aa5b-cdd8-404e-8e17-e8a9571e8497 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:51.691102 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8c2aa5b-cdd8-404e-8e17-e8a9571e8497 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:51.691618 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8c2aa5b-cdd8-404e-8e17-e8a9571e8497 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:51.692581 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8c2aa5b-cdd8-404e-8e17-e8a9571e8497 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:51.693143 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8c2aa5b-cdd8-404e-8e17-e8a9571e8497 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:51.693643 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8c2aa5b-cdd8-404e-8e17-e8a9571e8497 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:51.762230 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b8c2aa5b-cdd8-404e-8e17-e8a9571e8497 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:51.770772 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b8c2aa5b-cdd8-404e-8e17-e8a9571e8497 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/d6bb2298-addc-4945-a9d3-1f5edfa95ce0" status: 200 len: 1202 microversion: 2.1 time: 0.095603 Oct 18 16:18:51.771344 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3307/6636] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:51 2022] GET /compute/v2.1/servers/d6bb2298-addc-4945-a9d3-1f5edfa95ce0 => generated 1202 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:52.794612 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-996c909f-dc6a-4f18-b547-2deb71ac1a48 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:52.795371 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-996c909f-dc6a-4f18-b547-2deb71ac1a48 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: d6bb2298-addc-4945-a9d3-1f5edfa95ce0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:52.798864 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=30 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:52.804941 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-996c909f-dc6a-4f18-b547-2deb71ac1a48 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:52.805349 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-996c909f-dc6a-4f18-b547-2deb71ac1a48 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:52.805806 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-996c909f-dc6a-4f18-b547-2deb71ac1a48 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:52.806516 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-996c909f-dc6a-4f18-b547-2deb71ac1a48 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:52.806985 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-996c909f-dc6a-4f18-b547-2deb71ac1a48 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:52.807438 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-996c909f-dc6a-4f18-b547-2deb71ac1a48 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:52.873394 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-996c909f-dc6a-4f18-b547-2deb71ac1a48 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:52.881505 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-996c909f-dc6a-4f18-b547-2deb71ac1a48 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/d6bb2298-addc-4945-a9d3-1f5edfa95ce0" status: 200 len: 1202 microversion: 2.1 time: 0.091381 Oct 18 16:18:52.882094 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3330/6637] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:52 2022] GET /compute/v2.1/servers/d6bb2298-addc-4945-a9d3-1f5edfa95ce0 => generated 1202 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:53.905084 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eab4caae-d173-4f56-8020-225200ea499c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:53.905709 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-eab4caae-d173-4f56-8020-225200ea499c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: d6bb2298-addc-4945-a9d3-1f5edfa95ce0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:53.913994 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eab4caae-d173-4f56-8020-225200ea499c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:53.914646 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eab4caae-d173-4f56-8020-225200ea499c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:53.915178 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eab4caae-d173-4f56-8020-225200ea499c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:53.916065 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eab4caae-d173-4f56-8020-225200ea499c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:53.916688 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eab4caae-d173-4f56-8020-225200ea499c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:53.917155 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eab4caae-d173-4f56-8020-225200ea499c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:53.980916 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-eab4caae-d173-4f56-8020-225200ea499c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:53.989232 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-eab4caae-d173-4f56-8020-225200ea499c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/d6bb2298-addc-4945-a9d3-1f5edfa95ce0" status: 200 len: 1202 microversion: 2.1 time: 0.088267 Oct 18 16:18:53.989906 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3308/6638] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:53 2022] GET /compute/v2.1/servers/d6bb2298-addc-4945-a9d3-1f5edfa95ce0 => generated 1202 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:55.011705 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-687a52e5-5a72-40fe-a515-d8337085cacb tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:55.012951 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-687a52e5-5a72-40fe-a515-d8337085cacb tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: d6bb2298-addc-4945-a9d3-1f5edfa95ce0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:55.021639 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-687a52e5-5a72-40fe-a515-d8337085cacb tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:55.022169 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-687a52e5-5a72-40fe-a515-d8337085cacb tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:55.022622 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-687a52e5-5a72-40fe-a515-d8337085cacb tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:55.023343 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-687a52e5-5a72-40fe-a515-d8337085cacb tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:55.023819 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-687a52e5-5a72-40fe-a515-d8337085cacb tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:55.024261 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-687a52e5-5a72-40fe-a515-d8337085cacb tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:55.088680 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-687a52e5-5a72-40fe-a515-d8337085cacb tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:18:55.097039 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-687a52e5-5a72-40fe-a515-d8337085cacb tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/d6bb2298-addc-4945-a9d3-1f5edfa95ce0" status: 200 len: 1202 microversion: 2.1 time: 0.089405 Oct 18 16:18:55.097729 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3331/6639] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:55 2022] GET /compute/v2.1/servers/d6bb2298-addc-4945-a9d3-1f5edfa95ce0 => generated 1202 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:18:56.120153 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-25920f71-ee8d-43a6-ac88-c8f706fe0d36 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:56.120782 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-25920f71-ee8d-43a6-ac88-c8f706fe0d36 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: d6bb2298-addc-4945-a9d3-1f5edfa95ce0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:56.128173 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25920f71-ee8d-43a6-ac88-c8f706fe0d36 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:56.128672 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25920f71-ee8d-43a6-ac88-c8f706fe0d36 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:56.129172 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25920f71-ee8d-43a6-ac88-c8f706fe0d36 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:56.129894 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25920f71-ee8d-43a6-ac88-c8f706fe0d36 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:56.130355 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25920f71-ee8d-43a6-ac88-c8f706fe0d36 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:56.130782 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25920f71-ee8d-43a6-ac88-c8f706fe0d36 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:56.133948 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:56.147893 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-25920f71-ee8d-43a6-ac88-c8f706fe0d36 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] HTTP exception thrown: Instance d6bb2298-addc-4945-a9d3-1f5edfa95ce0 could not be found. Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-25920f71-ee8d-43a6-ac88-c8f706fe0d36 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Request method failure captured: Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/d6bb2298-addc-4945-a9d3-1f5edfa95ce0 HTTP/1.1 Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTtEVF9uJ-JO9Xs31vnHSSsjSYlxrsUC5zmDUZwq19epJ_KRexhuRnv973VnMOHKUrtuEaLEal20PXz-3F2SqeQ_VcN02CwN6WkvucYcQaG_QXU6RKnbyMb6Baxa9c0pM4Y0eYUesqFYGvUA-9UWLfliXu3xhi5bS1_xU9JBCKzY9b2g Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: c05254b186b04c9cb9858f621938caca Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-TestVolumeBootPattern-1353957077 Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c05254b186b04c9cb9858f621938caca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c05254b186b04c9cb9858f621938caca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c05254b186b04c9cb9858f621938caca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c05254b186b04c9cb9858f621938caca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-TestVolumeBootPattern-1353957077 Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: c05254b186b04c9cb9858f621938caca Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-TestVolumeBootPattern-1353957077 Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-TestVolumeBootPattern-1353957077-project Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: b9f9ae9e929c416a9298499ab8694d37 Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-TestVolumeBootPattern-1353957077-project Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance d6bb2298-addc-4945-a9d3-1f5edfa95ce0 could not be found. Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'd6bb2298-addc-4945-a9d3-1f5edfa95ce0'} Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6bb2298-addc-4945-a9d3-1f5edfa95ce0 could not be found. Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6bb2298-addc-4945-a9d3-1f5edfa95ce0 could not be found. Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:18:56.149680 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:18:56.153457 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:56.153457 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:18:56.153457 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:18:56.153457 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:18:56.153457 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:18:56.153457 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6bb2298-addc-4945-a9d3-1f5edfa95ce0 could not be found. Oct 18 16:18:56.153457 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:18:56.153457 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-25920f71-ee8d-43a6-ac88-c8f706fe0d36 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Returning 404 to user: Instance d6bb2298-addc-4945-a9d3-1f5edfa95ce0 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:18:56.153457 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-25920f71-ee8d-43a6-ac88-c8f706fe0d36 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/d6bb2298-addc-4945-a9d3-1f5edfa95ce0" status: 404 len: 111 microversion: 2.1 time: 0.035033 Oct 18 16:18:56.153457 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3309/6640] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:56 2022] GET /compute/v2.1/servers/d6bb2298-addc-4945-a9d3-1f5edfa95ce0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:18:58.299489 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d2335913-5931-440e-a106-369551adc6a3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:58.300028 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d2335913-5931-440e-a106-369551adc6a3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: a77a6d62-8556-4504-86ff-a3e1f65f0fea] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:58.308194 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d2335913-5931-440e-a106-369551adc6a3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:58.308764 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d2335913-5931-440e-a106-369551adc6a3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:58.309243 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d2335913-5931-440e-a106-369551adc6a3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:58.309961 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d2335913-5931-440e-a106-369551adc6a3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:58.310433 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d2335913-5931-440e-a106-369551adc6a3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:58.310876 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d2335913-5931-440e-a106-369551adc6a3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:58.325483 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-d2335913-5931-440e-a106-369551adc6a3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] HTTP exception thrown: Instance a77a6d62-8556-4504-86ff-a3e1f65f0fea could not be found. Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d2335913-5931-440e-a106-369551adc6a3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Request method failure captured: Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: request: DELETE /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea HTTP/1.1 Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTtEVF9uJ-JO9Xs31vnHSSsjSYlxrsUC5zmDUZwq19epJ_KRexhuRnv973VnMOHKUrtuEaLEal20PXz-3F2SqeQ_VcN02CwN6WkvucYcQaG_QXU6RKnbyMb6Baxa9c0pM4Y0eYUesqFYGvUA-9UWLfliXu3xhi5bS1_xU9JBCKzY9b2g Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: c05254b186b04c9cb9858f621938caca Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-TestVolumeBootPattern-1353957077 Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c05254b186b04c9cb9858f621938caca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c05254b186b04c9cb9858f621938caca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c05254b186b04c9cb9858f621938caca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c05254b186b04c9cb9858f621938caca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-TestVolumeBootPattern-1353957077 Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: c05254b186b04c9cb9858f621938caca Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-TestVolumeBootPattern-1353957077 Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-TestVolumeBootPattern-1353957077-project Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: b9f9ae9e929c416a9298499ab8694d37 Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-TestVolumeBootPattern-1353957077-project Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance a77a6d62-8556-4504-86ff-a3e1f65f0fea could not be found. Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'a77a6d62-8556-4504-86ff-a3e1f65f0fea'} Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a77a6d62-8556-4504-86ff-a3e1f65f0fea could not be found. Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:18:58.327197 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:18:58.330878 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a77a6d62-8556-4504-86ff-a3e1f65f0fea could not be found. Oct 18 16:18:58.330878 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:18:58.330878 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:18:58.330878 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:18:58.330878 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:58.330878 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:18:58.330878 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:18:58.330878 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:18:58.330878 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:18:58.330878 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a77a6d62-8556-4504-86ff-a3e1f65f0fea could not be found. Oct 18 16:18:58.330878 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:18:58.330878 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d2335913-5931-440e-a106-369551adc6a3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Returning 404 to user: Instance a77a6d62-8556-4504-86ff-a3e1f65f0fea could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:18:58.330878 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d2335913-5931-440e-a106-369551adc6a3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea" status: 404 len: 111 microversion: 2.1 time: 0.033854 Oct 18 16:18:58.330878 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3332/6641] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 16:18:58 2022] DELETE /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:18:58.338128 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eb5e71c3-91b0-48a0-ba0b-1fea9603ae77 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:58.338747 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-eb5e71c3-91b0-48a0-ba0b-1fea9603ae77 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: a77a6d62-8556-4504-86ff-a3e1f65f0fea] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:58.345892 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb5e71c3-91b0-48a0-ba0b-1fea9603ae77 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:58.346375 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb5e71c3-91b0-48a0-ba0b-1fea9603ae77 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:58.346816 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb5e71c3-91b0-48a0-ba0b-1fea9603ae77 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:58.347819 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb5e71c3-91b0-48a0-ba0b-1fea9603ae77 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:58.348277 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb5e71c3-91b0-48a0-ba0b-1fea9603ae77 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:58.348702 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb5e71c3-91b0-48a0-ba0b-1fea9603ae77 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:58.362646 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-eb5e71c3-91b0-48a0-ba0b-1fea9603ae77 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] HTTP exception thrown: Instance a77a6d62-8556-4504-86ff-a3e1f65f0fea could not be found. Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eb5e71c3-91b0-48a0-ba0b-1fea9603ae77 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Request method failure captured: Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea HTTP/1.1 Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTtEVF9uJ-JO9Xs31vnHSSsjSYlxrsUC5zmDUZwq19epJ_KRexhuRnv973VnMOHKUrtuEaLEal20PXz-3F2SqeQ_VcN02CwN6WkvucYcQaG_QXU6RKnbyMb6Baxa9c0pM4Y0eYUesqFYGvUA-9UWLfliXu3xhi5bS1_xU9JBCKzY9b2g Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: c05254b186b04c9cb9858f621938caca Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-TestVolumeBootPattern-1353957077 Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c05254b186b04c9cb9858f621938caca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c05254b186b04c9cb9858f621938caca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c05254b186b04c9cb9858f621938caca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c05254b186b04c9cb9858f621938caca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-TestVolumeBootPattern-1353957077 Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: c05254b186b04c9cb9858f621938caca Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-TestVolumeBootPattern-1353957077 Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-TestVolumeBootPattern-1353957077-project Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: b9f9ae9e929c416a9298499ab8694d37 Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-TestVolumeBootPattern-1353957077-project Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance a77a6d62-8556-4504-86ff-a3e1f65f0fea could not be found. Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'a77a6d62-8556-4504-86ff-a3e1f65f0fea'} Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a77a6d62-8556-4504-86ff-a3e1f65f0fea could not be found. Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a77a6d62-8556-4504-86ff-a3e1f65f0fea could not be found. Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:18:58.364216 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:18:58.369095 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:58.369095 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:18:58.369095 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:18:58.369095 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:18:58.369095 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:18:58.369095 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a77a6d62-8556-4504-86ff-a3e1f65f0fea could not be found. Oct 18 16:18:58.369095 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:18:58.369095 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eb5e71c3-91b0-48a0-ba0b-1fea9603ae77 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Returning 404 to user: Instance a77a6d62-8556-4504-86ff-a3e1f65f0fea could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:18:58.369095 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-eb5e71c3-91b0-48a0-ba0b-1fea9603ae77 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea" status: 404 len: 111 microversion: 2.1 time: 0.031915 Oct 18 16:18:58.369095 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3310/6642] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:58 2022] GET /compute/v2.1/servers/a77a6d62-8556-4504-86ff-a3e1f65f0fea => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:18:58.733859 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-696b87fc-c590-41d4-98e5-f4f2bead4f87 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:58.734383 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-696b87fc-c590-41d4-98e5-f4f2bead4f87 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: d6bb2298-addc-4945-a9d3-1f5edfa95ce0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:58.741586 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-696b87fc-c590-41d4-98e5-f4f2bead4f87 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:58.742198 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-696b87fc-c590-41d4-98e5-f4f2bead4f87 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:58.742755 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-696b87fc-c590-41d4-98e5-f4f2bead4f87 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:58.743594 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-696b87fc-c590-41d4-98e5-f4f2bead4f87 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:58.744166 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-696b87fc-c590-41d4-98e5-f4f2bead4f87 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:58.744680 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-696b87fc-c590-41d4-98e5-f4f2bead4f87 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:58.759718 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-696b87fc-c590-41d4-98e5-f4f2bead4f87 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] HTTP exception thrown: Instance d6bb2298-addc-4945-a9d3-1f5edfa95ce0 could not be found. Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-696b87fc-c590-41d4-98e5-f4f2bead4f87 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Request method failure captured: Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: request: DELETE /compute/v2.1/servers/d6bb2298-addc-4945-a9d3-1f5edfa95ce0 HTTP/1.1 Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTtEVF9uJ-JO9Xs31vnHSSsjSYlxrsUC5zmDUZwq19epJ_KRexhuRnv973VnMOHKUrtuEaLEal20PXz-3F2SqeQ_VcN02CwN6WkvucYcQaG_QXU6RKnbyMb6Baxa9c0pM4Y0eYUesqFYGvUA-9UWLfliXu3xhi5bS1_xU9JBCKzY9b2g Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: c05254b186b04c9cb9858f621938caca Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-TestVolumeBootPattern-1353957077 Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c05254b186b04c9cb9858f621938caca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c05254b186b04c9cb9858f621938caca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c05254b186b04c9cb9858f621938caca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c05254b186b04c9cb9858f621938caca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-TestVolumeBootPattern-1353957077 Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: c05254b186b04c9cb9858f621938caca Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-TestVolumeBootPattern-1353957077 Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-TestVolumeBootPattern-1353957077-project Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: b9f9ae9e929c416a9298499ab8694d37 Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-TestVolumeBootPattern-1353957077-project Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance d6bb2298-addc-4945-a9d3-1f5edfa95ce0 could not be found. Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'd6bb2298-addc-4945-a9d3-1f5edfa95ce0'} Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6bb2298-addc-4945-a9d3-1f5edfa95ce0 could not be found. Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:18:58.761441 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:18:58.765699 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6bb2298-addc-4945-a9d3-1f5edfa95ce0 could not be found. Oct 18 16:18:58.765699 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:18:58.765699 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:18:58.765699 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:18:58.765699 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:58.765699 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:18:58.765699 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:18:58.765699 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:18:58.765699 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:18:58.765699 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6bb2298-addc-4945-a9d3-1f5edfa95ce0 could not be found. Oct 18 16:18:58.765699 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:18:58.765699 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-696b87fc-c590-41d4-98e5-f4f2bead4f87 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Returning 404 to user: Instance d6bb2298-addc-4945-a9d3-1f5edfa95ce0 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:18:58.765699 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-696b87fc-c590-41d4-98e5-f4f2bead4f87 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d6bb2298-addc-4945-a9d3-1f5edfa95ce0" status: 404 len: 111 microversion: 2.1 time: 0.034688 Oct 18 16:18:58.766775 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3333/6643] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 16:18:58 2022] DELETE /compute/v2.1/servers/d6bb2298-addc-4945-a9d3-1f5edfa95ce0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:18:58.775185 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5eb4c626-9505-49aa-bbfc-8192bc437235 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:18:58.776056 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5eb4c626-9505-49aa-bbfc-8192bc437235 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: d6bb2298-addc-4945-a9d3-1f5edfa95ce0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:18:58.781777 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5eb4c626-9505-49aa-bbfc-8192bc437235 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:58.782799 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5eb4c626-9505-49aa-bbfc-8192bc437235 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:58.783241 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5eb4c626-9505-49aa-bbfc-8192bc437235 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:58.783931 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5eb4c626-9505-49aa-bbfc-8192bc437235 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:18:58.784379 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5eb4c626-9505-49aa-bbfc-8192bc437235 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:18:58.784799 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5eb4c626-9505-49aa-bbfc-8192bc437235 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:18:58.799154 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-5eb4c626-9505-49aa-bbfc-8192bc437235 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] HTTP exception thrown: Instance d6bb2298-addc-4945-a9d3-1f5edfa95ce0 could not be found. Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5eb4c626-9505-49aa-bbfc-8192bc437235 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Request method failure captured: Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/d6bb2298-addc-4945-a9d3-1f5edfa95ce0 HTTP/1.1 Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTtEVF9uJ-JO9Xs31vnHSSsjSYlxrsUC5zmDUZwq19epJ_KRexhuRnv973VnMOHKUrtuEaLEal20PXz-3F2SqeQ_VcN02CwN6WkvucYcQaG_QXU6RKnbyMb6Baxa9c0pM4Y0eYUesqFYGvUA-9UWLfliXu3xhi5bS1_xU9JBCKzY9b2g Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: c05254b186b04c9cb9858f621938caca Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-TestVolumeBootPattern-1353957077 Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c05254b186b04c9cb9858f621938caca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c05254b186b04c9cb9858f621938caca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c05254b186b04c9cb9858f621938caca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c05254b186b04c9cb9858f621938caca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-TestVolumeBootPattern-1353957077 Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: c05254b186b04c9cb9858f621938caca Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-TestVolumeBootPattern-1353957077 Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-TestVolumeBootPattern-1353957077-project Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: b9f9ae9e929c416a9298499ab8694d37 Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-TestVolumeBootPattern-1353957077-project Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance d6bb2298-addc-4945-a9d3-1f5edfa95ce0 could not be found. Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'd6bb2298-addc-4945-a9d3-1f5edfa95ce0'} Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6bb2298-addc-4945-a9d3-1f5edfa95ce0 could not be found. Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6bb2298-addc-4945-a9d3-1f5edfa95ce0 could not be found. Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:18:58.800682 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:18:58.804953 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:18:58.804953 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:18:58.804953 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:18:58.804953 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:18:58.804953 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:18:58.804953 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6bb2298-addc-4945-a9d3-1f5edfa95ce0 could not be found. Oct 18 16:18:58.804953 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:18:58.804953 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5eb4c626-9505-49aa-bbfc-8192bc437235 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Returning 404 to user: Instance d6bb2298-addc-4945-a9d3-1f5edfa95ce0 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:18:58.804953 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5eb4c626-9505-49aa-bbfc-8192bc437235 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/d6bb2298-addc-4945-a9d3-1f5edfa95ce0" status: 404 len: 111 microversion: 2.1 time: 0.031001 Oct 18 16:18:58.804953 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3311/6644] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:18:58 2022] GET /compute/v2.1/servers/d6bb2298-addc-4945-a9d3-1f5edfa95ce0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:18:58.878770 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-122702e8-d886-4a92-9649-e49fe0872891 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Action: 'create', calling method: .version_select at 0x7f7c3d1383a0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-649878017", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIV5UXrT5o2qfhszWMQHCFjbW6gfwz/xJijBuyoJjfw0EqkTTcOui41qw8hSRcoYLQ8qc1W8te9SsCYGjWCtRHl8USL7GmofOttrMtEMWZaUZSVK9THhu0TDWe355dQB7Q=="}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:18:58.894463 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-122702e8-d886-4a92-9649-e49fe0872891 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Getting quotas for project c05254b186b04c9cb9858f621938caca. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:18:58.899592 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-122702e8-d886-4a92-9649-e49fe0872891 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Getting quotas for user b9f9ae9e929c416a9298499ab8694d37 and project c05254b186b04c9cb9858f621938caca. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:18:58.925756 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-122702e8-d886-4a92-9649-e49fe0872891 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.051149 Oct 18 16:18:58.926368 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3334/6645] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Oct 18 16:18:58 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:19:15.175451 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:15.176222 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=5 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:15.181151 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8b23113f-9e02-4fc5-a74d-37e9dfe9ea8d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1802166910", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-649878017", "security_groups": [{"name": "tempest-secgroup-smoke-226710337"}], "block_device_mapping_v2": [{"uuid": "98d38cda-aad2-4c2d-97e9-d56bafa85ab3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a0168786-8cd3-418a-9936-dae2a39b2080"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:19:15.299587 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-8b23113f-9e02-4fc5-a74d-37e9dfe9ea8d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] validate_networks() for [('a0168786-8cd3-418a-9936-dae2a39b2080', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 16:19:15.672094 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-8b23113f-9e02-4fc5-a74d-37e9dfe9ea8d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:19:15.673057 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-8b23113f-9e02-4fc5-a74d-37e9dfe9ea8d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:19:15.673566 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-8b23113f-9e02-4fc5-a74d-37e9dfe9ea8d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:19:15.673979 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-8b23113f-9e02-4fc5-a74d-37e9dfe9ea8d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:19:15.674388 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-8b23113f-9e02-4fc5-a74d-37e9dfe9ea8d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:19:15.684394 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b23113f-9e02-4fc5-a74d-37e9dfe9ea8d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:15.684976 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b23113f-9e02-4fc5-a74d-37e9dfe9ea8d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:15.685413 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b23113f-9e02-4fc5-a74d-37e9dfe9ea8d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:15.686141 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b23113f-9e02-4fc5-a74d-37e9dfe9ea8d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:15.686593 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b23113f-9e02-4fc5-a74d-37e9dfe9ea8d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:15.687015 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b23113f-9e02-4fc5-a74d-37e9dfe9ea8d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:15.705672 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-8b23113f-9e02-4fc5-a74d-37e9dfe9ea8d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Getting quotas for project c05254b186b04c9cb9858f621938caca. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:19:15.711049 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-8b23113f-9e02-4fc5-a74d-37e9dfe9ea8d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Getting quotas for user b9f9ae9e929c416a9298499ab8694d37 and project c05254b186b04c9cb9858f621938caca. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:19:15.771325 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8b23113f-9e02-4fc5-a74d-37e9dfe9ea8d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:19:15.773509 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8b23113f-9e02-4fc5-a74d-37e9dfe9ea8d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 3fe6a178-8709-4ae1-b6b7-4de54843c890] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='98d38cda-aad2-4c2d-97e9-d56bafa85ab3',volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:19:15.903400 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8b23113f-9e02-4fc5-a74d-37e9dfe9ea8d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.730546 Oct 18 16:19:15.904227 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3312/6646] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 16:19:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:19:15.913861 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=63 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:15.915097 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=4 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:15.915878 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=18,nova_api:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:15.920176 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-dd567120-53f4-49f0-98ac-dcaaf363299c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:15.920861 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-dd567120-53f4-49f0-98ac-dcaaf363299c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 3fe6a178-8709-4ae1-b6b7-4de54843c890] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:15.994893 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-dd567120-53f4-49f0-98ac-dcaaf363299c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:16.001844 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-dd567120-53f4-49f0-98ac-dcaaf363299c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890" status: 200 len: 1094 microversion: 2.1 time: 0.090007 Oct 18 16:19:16.002432 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3335/6647] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:15 2022] GET /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890 => generated 1094 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:17.026634 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bf645a7a-8f3a-472b-8015-b0c3cd058e90 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:17.027186 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bf645a7a-8f3a-472b-8015-b0c3cd058e90 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 3fe6a178-8709-4ae1-b6b7-4de54843c890] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:17.034636 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf645a7a-8f3a-472b-8015-b0c3cd058e90 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:17.035354 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf645a7a-8f3a-472b-8015-b0c3cd058e90 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:17.035645 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf645a7a-8f3a-472b-8015-b0c3cd058e90 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:17.036383 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf645a7a-8f3a-472b-8015-b0c3cd058e90 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:17.036955 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf645a7a-8f3a-472b-8015-b0c3cd058e90 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:17.037457 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf645a7a-8f3a-472b-8015-b0c3cd058e90 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:17.109150 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bf645a7a-8f3a-472b-8015-b0c3cd058e90 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:17.117849 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bf645a7a-8f3a-472b-8015-b0c3cd058e90 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890" status: 200 len: 1200 microversion: 2.1 time: 0.097302 Oct 18 16:19:17.118723 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3313/6648] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:17 2022] GET /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890 => generated 1200 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:18.142867 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fb7aa83d-c51e-4317-9b7f-edd3a203ee6c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:18.144314 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-fb7aa83d-c51e-4317-9b7f-edd3a203ee6c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 3fe6a178-8709-4ae1-b6b7-4de54843c890] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:18.151508 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fb7aa83d-c51e-4317-9b7f-edd3a203ee6c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:18.152018 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fb7aa83d-c51e-4317-9b7f-edd3a203ee6c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:18.152478 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fb7aa83d-c51e-4317-9b7f-edd3a203ee6c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:18.153233 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fb7aa83d-c51e-4317-9b7f-edd3a203ee6c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:18.153937 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fb7aa83d-c51e-4317-9b7f-edd3a203ee6c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:18.154577 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fb7aa83d-c51e-4317-9b7f-edd3a203ee6c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:18.312192 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-fb7aa83d-c51e-4317-9b7f-edd3a203ee6c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:18.320704 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fb7aa83d-c51e-4317-9b7f-edd3a203ee6c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890" status: 200 len: 1277 microversion: 2.1 time: 0.182428 Oct 18 16:19:18.329172 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3336/6649] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:18 2022] GET /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890 => generated 1277 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:18.497795 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-ded43860-75a9-4c0e-83b4-8c948775399a req-367ae2b5-6572-4978-8bd2-762a7a2f42ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fe6a178-8709-4ae1-b6b7-4de54843c890", "tag": "c5d43599-0a52-4252-9f65-3212661293cd"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:19:18.515850 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ded43860-75a9-4c0e-83b4-8c948775399a req-367ae2b5-6572-4978-8bd2-762a7a2f42ea service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:18.516689 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ded43860-75a9-4c0e-83b4-8c948775399a req-367ae2b5-6572-4978-8bd2-762a7a2f42ea service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:18.517047 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ded43860-75a9-4c0e-83b4-8c948775399a req-367ae2b5-6572-4978-8bd2-762a7a2f42ea service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:18.541249 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-ded43860-75a9-4c0e-83b4-8c948775399a req-367ae2b5-6572-4978-8bd2-762a7a2f42ea service nova] Creating event network-changed:c5d43599-0a52-4252-9f65-3212661293cd for instance 3fe6a178-8709-4ae1-b6b7-4de54843c890 on n-h1-853682-5 Oct 18 16:19:18.547310 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-ded43860-75a9-4c0e-83b4-8c948775399a req-367ae2b5-6572-4978-8bd2-762a7a2f42ea service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060691 Oct 18 16:19:18.548748 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3314/6650] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:19:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:19:19.343780 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0eb49615-19dd-4135-8d48-3bdbc4e8bfac tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:19.344566 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0eb49615-19dd-4135-8d48-3bdbc4e8bfac tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 3fe6a178-8709-4ae1-b6b7-4de54843c890] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:19.351494 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0eb49615-19dd-4135-8d48-3bdbc4e8bfac tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:19.352005 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0eb49615-19dd-4135-8d48-3bdbc4e8bfac tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:19.352464 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0eb49615-19dd-4135-8d48-3bdbc4e8bfac tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:19.353401 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0eb49615-19dd-4135-8d48-3bdbc4e8bfac tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:19.353883 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0eb49615-19dd-4135-8d48-3bdbc4e8bfac tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:19.354386 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0eb49615-19dd-4135-8d48-3bdbc4e8bfac tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:19.496836 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0eb49615-19dd-4135-8d48-3bdbc4e8bfac tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:19.505231 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0eb49615-19dd-4135-8d48-3bdbc4e8bfac tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890" status: 200 len: 1277 microversion: 2.1 time: 0.165428 Oct 18 16:19:19.505839 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3337/6651] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:19 2022] GET /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890 => generated 1277 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:20.529198 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-70439b71-0443-4ce7-896a-d1b8bd73dd9e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:20.530083 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-70439b71-0443-4ce7-896a-d1b8bd73dd9e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 3fe6a178-8709-4ae1-b6b7-4de54843c890] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:20.537808 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70439b71-0443-4ce7-896a-d1b8bd73dd9e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:20.538354 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70439b71-0443-4ce7-896a-d1b8bd73dd9e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:20.538833 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70439b71-0443-4ce7-896a-d1b8bd73dd9e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:20.539534 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70439b71-0443-4ce7-896a-d1b8bd73dd9e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:20.539993 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70439b71-0443-4ce7-896a-d1b8bd73dd9e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:20.540426 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70439b71-0443-4ce7-896a-d1b8bd73dd9e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:20.683891 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-70439b71-0443-4ce7-896a-d1b8bd73dd9e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:20.692295 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-70439b71-0443-4ce7-896a-d1b8bd73dd9e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890" status: 200 len: 1277 microversion: 2.1 time: 0.167856 Oct 18 16:19:20.693341 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3315/6652] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:20 2022] GET /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890 => generated 1277 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:21.715703 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e3d9ccc5-d182-49ae-91ab-aa460806afd9 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:21.716344 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e3d9ccc5-d182-49ae-91ab-aa460806afd9 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 3fe6a178-8709-4ae1-b6b7-4de54843c890] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:21.723842 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e3d9ccc5-d182-49ae-91ab-aa460806afd9 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:21.724349 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e3d9ccc5-d182-49ae-91ab-aa460806afd9 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:21.724938 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e3d9ccc5-d182-49ae-91ab-aa460806afd9 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:21.725672 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e3d9ccc5-d182-49ae-91ab-aa460806afd9 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:21.726151 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e3d9ccc5-d182-49ae-91ab-aa460806afd9 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:21.726601 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e3d9ccc5-d182-49ae-91ab-aa460806afd9 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:21.866363 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e3d9ccc5-d182-49ae-91ab-aa460806afd9 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:21.874205 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e3d9ccc5-d182-49ae-91ab-aa460806afd9 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890" status: 200 len: 1277 microversion: 2.1 time: 0.162442 Oct 18 16:19:21.874775 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3338/6653] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:21 2022] GET /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890 => generated 1277 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:22.897038 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7cacd0c9-f6dc-44b2-9028-7aed1bb44205 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:22.897656 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7cacd0c9-f6dc-44b2-9028-7aed1bb44205 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 3fe6a178-8709-4ae1-b6b7-4de54843c890] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:22.904479 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7cacd0c9-f6dc-44b2-9028-7aed1bb44205 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:22.904995 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7cacd0c9-f6dc-44b2-9028-7aed1bb44205 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:22.905439 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7cacd0c9-f6dc-44b2-9028-7aed1bb44205 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:22.906131 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7cacd0c9-f6dc-44b2-9028-7aed1bb44205 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:22.906587 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7cacd0c9-f6dc-44b2-9028-7aed1bb44205 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:22.907592 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7cacd0c9-f6dc-44b2-9028-7aed1bb44205 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:23.042874 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7cacd0c9-f6dc-44b2-9028-7aed1bb44205 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:23.050659 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7cacd0c9-f6dc-44b2-9028-7aed1bb44205 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890" status: 200 len: 1265 microversion: 2.1 time: 0.157579 Oct 18 16:19:23.051239 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3316/6654] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:22 2022] GET /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:24.074054 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-169bf5a1-dc5b-4727-b360-d7fe4dedb8f2 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:24.074725 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-169bf5a1-dc5b-4727-b360-d7fe4dedb8f2 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 3fe6a178-8709-4ae1-b6b7-4de54843c890] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:24.081566 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-169bf5a1-dc5b-4727-b360-d7fe4dedb8f2 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:24.082070 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-169bf5a1-dc5b-4727-b360-d7fe4dedb8f2 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:24.082554 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-169bf5a1-dc5b-4727-b360-d7fe4dedb8f2 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:24.083260 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-169bf5a1-dc5b-4727-b360-d7fe4dedb8f2 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:24.083732 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-169bf5a1-dc5b-4727-b360-d7fe4dedb8f2 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:24.084173 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-169bf5a1-dc5b-4727-b360-d7fe4dedb8f2 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:24.212725 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-169bf5a1-dc5b-4727-b360-d7fe4dedb8f2 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:24.221142 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-169bf5a1-dc5b-4727-b360-d7fe4dedb8f2 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890" status: 200 len: 1265 microversion: 2.1 time: 0.151001 Oct 18 16:19:24.221711 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3339/6655] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:24 2022] GET /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:25.243715 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a53143a8-813f-4b59-a975-b94854f6b4dd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:25.244338 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a53143a8-813f-4b59-a975-b94854f6b4dd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 3fe6a178-8709-4ae1-b6b7-4de54843c890] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:25.251240 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a53143a8-813f-4b59-a975-b94854f6b4dd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:25.251732 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a53143a8-813f-4b59-a975-b94854f6b4dd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:25.252174 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a53143a8-813f-4b59-a975-b94854f6b4dd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:25.252920 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a53143a8-813f-4b59-a975-b94854f6b4dd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:25.253384 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a53143a8-813f-4b59-a975-b94854f6b4dd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:25.253815 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a53143a8-813f-4b59-a975-b94854f6b4dd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:25.390784 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a53143a8-813f-4b59-a975-b94854f6b4dd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:25.399059 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a53143a8-813f-4b59-a975-b94854f6b4dd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890" status: 200 len: 1265 microversion: 2.1 time: 0.159463 Oct 18 16:19:25.399634 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3317/6656] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:25 2022] GET /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:26.423062 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-afae6159-55ba-4c7f-bc84-a24f4e7bc5ed tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:26.423707 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-afae6159-55ba-4c7f-bc84-a24f4e7bc5ed tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 3fe6a178-8709-4ae1-b6b7-4de54843c890] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:26.426554 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:26.432175 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-afae6159-55ba-4c7f-bc84-a24f4e7bc5ed tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:26.432683 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-afae6159-55ba-4c7f-bc84-a24f4e7bc5ed tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:26.433170 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-afae6159-55ba-4c7f-bc84-a24f4e7bc5ed tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:26.433890 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-afae6159-55ba-4c7f-bc84-a24f4e7bc5ed tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:26.434366 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-afae6159-55ba-4c7f-bc84-a24f4e7bc5ed tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:26.434824 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-afae6159-55ba-4c7f-bc84-a24f4e7bc5ed tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:26.566386 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-afae6159-55ba-4c7f-bc84-a24f4e7bc5ed tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:26.574428 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-afae6159-55ba-4c7f-bc84-a24f4e7bc5ed tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890" status: 200 len: 1265 microversion: 2.1 time: 0.155871 Oct 18 16:19:26.574921 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3340/6657] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:26 2022] GET /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:27.597824 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5002336d-91e0-4441-b2c8-0686f46a3ab8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:27.598438 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5002336d-91e0-4441-b2c8-0686f46a3ab8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 3fe6a178-8709-4ae1-b6b7-4de54843c890] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:27.600406 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:27.601351 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:27.608526 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5002336d-91e0-4441-b2c8-0686f46a3ab8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:27.609034 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5002336d-91e0-4441-b2c8-0686f46a3ab8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:27.609469 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5002336d-91e0-4441-b2c8-0686f46a3ab8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:27.610222 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5002336d-91e0-4441-b2c8-0686f46a3ab8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:27.610679 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5002336d-91e0-4441-b2c8-0686f46a3ab8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:27.611143 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5002336d-91e0-4441-b2c8-0686f46a3ab8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:27.742893 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5002336d-91e0-4441-b2c8-0686f46a3ab8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:27.751199 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5002336d-91e0-4441-b2c8-0686f46a3ab8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890" status: 200 len: 1265 microversion: 2.1 time: 0.157402 Oct 18 16:19:27.751787 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3318/6658] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:27 2022] GET /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:28.774630 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-45d9764b-0934-405b-aae8-2a516589c3fb tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:28.775267 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-45d9764b-0934-405b-aae8-2a516589c3fb tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 3fe6a178-8709-4ae1-b6b7-4de54843c890] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:28.782788 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-45d9764b-0934-405b-aae8-2a516589c3fb tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:28.783292 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-45d9764b-0934-405b-aae8-2a516589c3fb tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:28.783748 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-45d9764b-0934-405b-aae8-2a516589c3fb tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:28.784461 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-45d9764b-0934-405b-aae8-2a516589c3fb tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:28.784969 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-45d9764b-0934-405b-aae8-2a516589c3fb tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:28.785419 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-45d9764b-0934-405b-aae8-2a516589c3fb tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:28.918802 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-45d9764b-0934-405b-aae8-2a516589c3fb tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:28.926745 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-45d9764b-0934-405b-aae8-2a516589c3fb tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890" status: 200 len: 1265 microversion: 2.1 time: 0.156124 Oct 18 16:19:28.927317 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3341/6659] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:28 2022] GET /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:29.949730 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d02b5f12-6e79-46a9-8faf-dfd5f316580b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:29.950289 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d02b5f12-6e79-46a9-8faf-dfd5f316580b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 3fe6a178-8709-4ae1-b6b7-4de54843c890] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:29.957158 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d02b5f12-6e79-46a9-8faf-dfd5f316580b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:29.957646 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d02b5f12-6e79-46a9-8faf-dfd5f316580b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:29.958077 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d02b5f12-6e79-46a9-8faf-dfd5f316580b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:29.958762 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d02b5f12-6e79-46a9-8faf-dfd5f316580b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:29.959215 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d02b5f12-6e79-46a9-8faf-dfd5f316580b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:29.959642 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d02b5f12-6e79-46a9-8faf-dfd5f316580b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:30.092174 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d02b5f12-6e79-46a9-8faf-dfd5f316580b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:30.100481 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d02b5f12-6e79-46a9-8faf-dfd5f316580b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890" status: 200 len: 1265 microversion: 2.1 time: 0.154745 Oct 18 16:19:30.101094 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3319/6660] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:29 2022] GET /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:31.123661 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2fd85eac-f4eb-4979-9670-0c0c56ce7a7b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:31.124339 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2fd85eac-f4eb-4979-9670-0c0c56ce7a7b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 3fe6a178-8709-4ae1-b6b7-4de54843c890] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:31.131662 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2fd85eac-f4eb-4979-9670-0c0c56ce7a7b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:31.132189 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2fd85eac-f4eb-4979-9670-0c0c56ce7a7b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:31.132644 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2fd85eac-f4eb-4979-9670-0c0c56ce7a7b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:31.133381 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2fd85eac-f4eb-4979-9670-0c0c56ce7a7b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:31.133855 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2fd85eac-f4eb-4979-9670-0c0c56ce7a7b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:31.134324 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2fd85eac-f4eb-4979-9670-0c0c56ce7a7b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:31.265729 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2fd85eac-f4eb-4979-9670-0c0c56ce7a7b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:31.273456 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2fd85eac-f4eb-4979-9670-0c0c56ce7a7b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890" status: 200 len: 1265 microversion: 2.1 time: 0.153771 Oct 18 16:19:31.274030 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3342/6661] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:31 2022] GET /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:32.295977 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5a52df4e-1a0b-4251-9ac6-f723a6069c3c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:32.296595 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5a52df4e-1a0b-4251-9ac6-f723a6069c3c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 3fe6a178-8709-4ae1-b6b7-4de54843c890] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:32.304461 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a52df4e-1a0b-4251-9ac6-f723a6069c3c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:32.304994 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a52df4e-1a0b-4251-9ac6-f723a6069c3c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:32.305435 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a52df4e-1a0b-4251-9ac6-f723a6069c3c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:32.306134 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a52df4e-1a0b-4251-9ac6-f723a6069c3c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:32.306597 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a52df4e-1a0b-4251-9ac6-f723a6069c3c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:32.307026 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a52df4e-1a0b-4251-9ac6-f723a6069c3c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:32.443561 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5a52df4e-1a0b-4251-9ac6-f723a6069c3c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:32.451367 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5a52df4e-1a0b-4251-9ac6-f723a6069c3c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890" status: 200 len: 1265 microversion: 2.1 time: 0.159508 Oct 18 16:19:32.451965 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3320/6662] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:32 2022] GET /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:19:33.474154 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3703e3f9-7b4c-458c-999b-9f1cf5e219e1 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:33.474866 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3703e3f9-7b4c-458c-999b-9f1cf5e219e1 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 3fe6a178-8709-4ae1-b6b7-4de54843c890] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:33.481967 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3703e3f9-7b4c-458c-999b-9f1cf5e219e1 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:33.482463 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3703e3f9-7b4c-458c-999b-9f1cf5e219e1 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:33.482916 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3703e3f9-7b4c-458c-999b-9f1cf5e219e1 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:33.483629 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3703e3f9-7b4c-458c-999b-9f1cf5e219e1 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:33.484100 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3703e3f9-7b4c-458c-999b-9f1cf5e219e1 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:33.485066 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3703e3f9-7b4c-458c-999b-9f1cf5e219e1 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:33.615818 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3703e3f9-7b4c-458c-999b-9f1cf5e219e1 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:33.623711 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3703e3f9-7b4c-458c-999b-9f1cf5e219e1 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890" status: 200 len: 1265 microversion: 2.1 time: 0.153553 Oct 18 16:19:33.624312 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3343/6663] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:33 2022] GET /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:34.275995 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-976572bf-a1c0-4bc6-8d4f-88e7d4f1ca88 req-efa4b749-467f-4ed0-9cf0-0ade7e1056e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fe6a178-8709-4ae1-b6b7-4de54843c890", "name": "network-vif-plugged", "status": "completed", "tag": "c5d43599-0a52-4252-9f65-3212661293cd"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:19:34.286312 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-976572bf-a1c0-4bc6-8d4f-88e7d4f1ca88 req-efa4b749-467f-4ed0-9cf0-0ade7e1056e6 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:34.286790 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-976572bf-a1c0-4bc6-8d4f-88e7d4f1ca88 req-efa4b749-467f-4ed0-9cf0-0ade7e1056e6 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:34.287225 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-976572bf-a1c0-4bc6-8d4f-88e7d4f1ca88 req-efa4b749-467f-4ed0-9cf0-0ade7e1056e6 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:34.298122 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-976572bf-a1c0-4bc6-8d4f-88e7d4f1ca88 req-efa4b749-467f-4ed0-9cf0-0ade7e1056e6 service nova] Creating event network-vif-plugged:c5d43599-0a52-4252-9f65-3212661293cd for instance 3fe6a178-8709-4ae1-b6b7-4de54843c890 on n-h1-853682-5 Oct 18 16:19:34.303366 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-976572bf-a1c0-4bc6-8d4f-88e7d4f1ca88 req-efa4b749-467f-4ed0-9cf0-0ade7e1056e6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096633 Oct 18 16:19:34.303889 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3321/6664] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:19:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:19:34.647072 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-98e8a1fe-bb07-4050-aa13-ddda9243d1e6 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:34.647666 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-98e8a1fe-bb07-4050-aa13-ddda9243d1e6 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 3fe6a178-8709-4ae1-b6b7-4de54843c890] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:34.653707 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-98e8a1fe-bb07-4050-aa13-ddda9243d1e6 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:34.654210 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-98e8a1fe-bb07-4050-aa13-ddda9243d1e6 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:34.654661 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-98e8a1fe-bb07-4050-aa13-ddda9243d1e6 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:34.655370 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-98e8a1fe-bb07-4050-aa13-ddda9243d1e6 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:34.655842 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-98e8a1fe-bb07-4050-aa13-ddda9243d1e6 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:34.656286 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-98e8a1fe-bb07-4050-aa13-ddda9243d1e6 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:34.791891 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-98e8a1fe-bb07-4050-aa13-ddda9243d1e6 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:34.800223 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-98e8a1fe-bb07-4050-aa13-ddda9243d1e6 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890" status: 200 len: 1265 microversion: 2.1 time: 0.157528 Oct 18 16:19:34.800796 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3344/6665] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:34 2022] GET /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:35.824346 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2e397ee1-9f52-4542-b444-1d5a2edb25a1 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:35.825090 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2e397ee1-9f52-4542-b444-1d5a2edb25a1 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 3fe6a178-8709-4ae1-b6b7-4de54843c890] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:35.833325 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e397ee1-9f52-4542-b444-1d5a2edb25a1 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:35.833822 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e397ee1-9f52-4542-b444-1d5a2edb25a1 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:35.834268 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e397ee1-9f52-4542-b444-1d5a2edb25a1 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:35.835003 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e397ee1-9f52-4542-b444-1d5a2edb25a1 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:35.835495 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e397ee1-9f52-4542-b444-1d5a2edb25a1 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:35.835922 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e397ee1-9f52-4542-b444-1d5a2edb25a1 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:35.972459 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2e397ee1-9f52-4542-b444-1d5a2edb25a1 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:35.980484 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2e397ee1-9f52-4542-b444-1d5a2edb25a1 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890" status: 200 len: 1265 microversion: 2.1 time: 0.161228 Oct 18 16:19:35.981133 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3322/6666] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:35 2022] GET /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:37.002975 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0eba9f5e-c0e1-4241-ab00-080227ce46bd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:37.003637 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0eba9f5e-c0e1-4241-ab00-080227ce46bd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 3fe6a178-8709-4ae1-b6b7-4de54843c890] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:37.010652 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0eba9f5e-c0e1-4241-ab00-080227ce46bd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:37.011172 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0eba9f5e-c0e1-4241-ab00-080227ce46bd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:37.011623 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0eba9f5e-c0e1-4241-ab00-080227ce46bd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:37.012324 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0eba9f5e-c0e1-4241-ab00-080227ce46bd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:37.012792 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0eba9f5e-c0e1-4241-ab00-080227ce46bd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:37.013262 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0eba9f5e-c0e1-4241-ab00-080227ce46bd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:37.148164 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0eba9f5e-c0e1-4241-ab00-080227ce46bd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:37.155924 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0eba9f5e-c0e1-4241-ab00-080227ce46bd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890" status: 200 len: 1451 microversion: 2.1 time: 0.156936 Oct 18 16:19:37.157101 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3345/6667] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:36 2022] GET /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890 => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:37.179470 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-81be6b74-ef67-4d4e-b3be-4191e94d0851 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:19:37.180024 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-81be6b74-ef67-4d4e-b3be-4191e94d0851 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 3fe6a178-8709-4ae1-b6b7-4de54843c890] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:19:37.186902 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81be6b74-ef67-4d4e-b3be-4191e94d0851 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:37.187394 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81be6b74-ef67-4d4e-b3be-4191e94d0851 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:37.187835 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81be6b74-ef67-4d4e-b3be-4191e94d0851 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:37.188535 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81be6b74-ef67-4d4e-b3be-4191e94d0851 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:37.189025 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81be6b74-ef67-4d4e-b3be-4191e94d0851 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:37.189458 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81be6b74-ef67-4d4e-b3be-4191e94d0851 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:37.320634 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-81be6b74-ef67-4d4e-b3be-4191e94d0851 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:19:37.329068 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-81be6b74-ef67-4d4e-b3be-4191e94d0851 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890" status: 200 len: 1451 microversion: 2.1 time: 0.153379 Oct 18 16:19:37.329642 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3323/6668] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:19:37 2022] GET /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:19:38.910025 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-fa4fcabf-d656-43f1-b55a-e5e6ebbe6336 req-25a50737-a7b5-44f3-9ed5-84ce2ae3cfcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fe6a178-8709-4ae1-b6b7-4de54843c890", "tag": "c5d43599-0a52-4252-9f65-3212661293cd"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:19:38.920508 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-fa4fcabf-d656-43f1-b55a-e5e6ebbe6336 req-25a50737-a7b5-44f3-9ed5-84ce2ae3cfcd service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:19:38.921030 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-fa4fcabf-d656-43f1-b55a-e5e6ebbe6336 req-25a50737-a7b5-44f3-9ed5-84ce2ae3cfcd service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:19:38.921474 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-fa4fcabf-d656-43f1-b55a-e5e6ebbe6336 req-25a50737-a7b5-44f3-9ed5-84ce2ae3cfcd service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:19:38.933528 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-fa4fcabf-d656-43f1-b55a-e5e6ebbe6336 req-25a50737-a7b5-44f3-9ed5-84ce2ae3cfcd service nova] Creating event network-changed:c5d43599-0a52-4252-9f65-3212661293cd for instance 3fe6a178-8709-4ae1-b6b7-4de54843c890 on n-h1-853682-5 Oct 18 16:19:38.939357 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-fa4fcabf-d656-43f1-b55a-e5e6ebbe6336 req-25a50737-a7b5-44f3-9ed5-84ce2ae3cfcd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033710 Oct 18 16:19:38.939955 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3346/6669] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:21:34.148422 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:21:34.149272 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=60 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:21:34.150861 n-d-853682-5 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 16:21:34.151025 n-d-853682-5 devstack@n-api.service[120406]: Tue Oct 18 16:21:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890 (ip 10.222.0.60) !!! Oct 18 16:21:34.210582 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f49cbfa7-653e-487e-835c-d2d2a2f7aa3b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:34.211123 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f49cbfa7-653e-487e-835c-d2d2a2f7aa3b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 3fe6a178-8709-4ae1-b6b7-4de54843c890] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:34.217214 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f49cbfa7-653e-487e-835c-d2d2a2f7aa3b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:34.217706 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f49cbfa7-653e-487e-835c-d2d2a2f7aa3b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:34.218145 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f49cbfa7-653e-487e-835c-d2d2a2f7aa3b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:34.218837 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f49cbfa7-653e-487e-835c-d2d2a2f7aa3b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:34.219299 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f49cbfa7-653e-487e-835c-d2d2a2f7aa3b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:34.219728 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f49cbfa7-653e-487e-835c-d2d2a2f7aa3b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:34.245725 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f49cbfa7-653e-487e-835c-d2d2a2f7aa3b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 3fe6a178-8709-4ae1-b6b7-4de54843c890] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:21:34.321879 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f49cbfa7-653e-487e-835c-d2d2a2f7aa3b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890" status: 204 len: 0 microversion: 2.1 time: 0.175673 Oct 18 16:21:34.322517 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3324/6670] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 16:21:34 2022] DELETE /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:21:34.330867 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=26 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:21:34.331627 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=62 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:21:34.332747 n-d-853682-5 devstack@n-api.service[120405]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 18 16:21:34.333083 n-d-853682-5 devstack@n-api.service[120405]: Tue Oct 18 16:21:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890 (ip 10.222.0.60) !!! Oct 18 16:21:34.334500 n-d-853682-5 devstack@n-api.service[120405]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 16:21:34.334633 n-d-853682-5 devstack@n-api.service[120405]: Tue Oct 18 16:21:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890 (ip 10.222.0.60) !!! Oct 18 16:21:34.341549 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a0c72e31-3068-412b-87b9-54591bd9c5a1 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:34.343305 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a0c72e31-3068-412b-87b9-54591bd9c5a1 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 3fe6a178-8709-4ae1-b6b7-4de54843c890] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:34.352285 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a0c72e31-3068-412b-87b9-54591bd9c5a1 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:34.352797 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a0c72e31-3068-412b-87b9-54591bd9c5a1 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:34.353290 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a0c72e31-3068-412b-87b9-54591bd9c5a1 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:34.354008 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a0c72e31-3068-412b-87b9-54591bd9c5a1 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:34.354484 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a0c72e31-3068-412b-87b9-54591bd9c5a1 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:34.354931 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a0c72e31-3068-412b-87b9-54591bd9c5a1 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:34.492891 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a0c72e31-3068-412b-87b9-54591bd9c5a1 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:34.500662 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a0c72e31-3068-412b-87b9-54591bd9c5a1 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890" status: 200 len: 1575 microversion: 2.1 time: 0.173426 Oct 18 16:21:34.501270 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3347/6671] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:34 2022] GET /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890 => generated 1575 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:21:35.522309 n-d-853682-5 devstack@n-api.service[120406]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9784c765-18ae-4d28-9be4-c2f2473b54eb] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 18 16:21:35.523105 n-d-853682-5 devstack@n-api.service[120406]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6eb481dc-0a5f-4095-8691-72ce090f1ba0] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 18 16:21:35.526873 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-23fde619-b46d-4608-93ea-2f74217ddf14 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:35.527605 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-23fde619-b46d-4608-93ea-2f74217ddf14 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 3fe6a178-8709-4ae1-b6b7-4de54843c890] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:35.533606 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23fde619-b46d-4608-93ea-2f74217ddf14 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:35.534088 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23fde619-b46d-4608-93ea-2f74217ddf14 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:35.534522 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23fde619-b46d-4608-93ea-2f74217ddf14 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:35.535209 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23fde619-b46d-4608-93ea-2f74217ddf14 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:35.535663 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23fde619-b46d-4608-93ea-2f74217ddf14 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:35.536090 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23fde619-b46d-4608-93ea-2f74217ddf14 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:35.674696 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-23fde619-b46d-4608-93ea-2f74217ddf14 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:35.683028 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-23fde619-b46d-4608-93ea-2f74217ddf14 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890" status: 200 len: 1575 microversion: 2.1 time: 0.162227 Oct 18 16:21:35.683639 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3325/6672] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:35 2022] GET /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890 => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:21:36.707802 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a8f5f22e-6c47-40ff-bc75-c71121995cbd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:36.708434 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a8f5f22e-6c47-40ff-bc75-c71121995cbd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 3fe6a178-8709-4ae1-b6b7-4de54843c890] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:36.715424 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a8f5f22e-6c47-40ff-bc75-c71121995cbd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:36.716137 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a8f5f22e-6c47-40ff-bc75-c71121995cbd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:36.716594 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a8f5f22e-6c47-40ff-bc75-c71121995cbd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:36.717338 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a8f5f22e-6c47-40ff-bc75-c71121995cbd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:36.717809 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a8f5f22e-6c47-40ff-bc75-c71121995cbd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:36.718248 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a8f5f22e-6c47-40ff-bc75-c71121995cbd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:36.786837 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a8f5f22e-6c47-40ff-bc75-c71121995cbd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:36.794852 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a8f5f22e-6c47-40ff-bc75-c71121995cbd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890" status: 200 len: 1508 microversion: 2.1 time: 0.091799 Oct 18 16:21:36.795436 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3348/6673] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:36 2022] GET /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890 => generated 1508 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:21:37.006918 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-96752196-5ad2-4486-b4ef-94a92ab837a0 req-75092240-e835-4ee1-8059-3f863c2313c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fe6a178-8709-4ae1-b6b7-4de54843c890", "name": "network-vif-deleted", "tag": "c5d43599-0a52-4252-9f65-3212661293cd"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:21:37.020415 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-96752196-5ad2-4486-b4ef-94a92ab837a0 req-75092240-e835-4ee1-8059-3f863c2313c8 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:37.020940 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-96752196-5ad2-4486-b4ef-94a92ab837a0 req-75092240-e835-4ee1-8059-3f863c2313c8 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:37.021569 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-96752196-5ad2-4486-b4ef-94a92ab837a0 req-75092240-e835-4ee1-8059-3f863c2313c8 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:37.035307 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-96752196-5ad2-4486-b4ef-94a92ab837a0 req-75092240-e835-4ee1-8059-3f863c2313c8 service nova] Creating event network-vif-deleted:c5d43599-0a52-4252-9f65-3212661293cd for instance 3fe6a178-8709-4ae1-b6b7-4de54843c890 on n-h1-853682-5 Oct 18 16:21:37.041281 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-96752196-5ad2-4486-b4ef-94a92ab837a0 req-75092240-e835-4ee1-8059-3f863c2313c8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037981 Oct 18 16:21:37.041847 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3326/6674] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:21:37.817949 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-49b982bf-fd2d-4adb-8929-f2204a667404 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:37.818652 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-49b982bf-fd2d-4adb-8929-f2204a667404 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 3fe6a178-8709-4ae1-b6b7-4de54843c890] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:37.825794 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-49b982bf-fd2d-4adb-8929-f2204a667404 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:37.826302 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-49b982bf-fd2d-4adb-8929-f2204a667404 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:37.826755 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-49b982bf-fd2d-4adb-8929-f2204a667404 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:37.827689 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-49b982bf-fd2d-4adb-8929-f2204a667404 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:37.828143 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-49b982bf-fd2d-4adb-8929-f2204a667404 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:37.828619 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-49b982bf-fd2d-4adb-8929-f2204a667404 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:37.900403 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-49b982bf-fd2d-4adb-8929-f2204a667404 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:37.909808 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-49b982bf-fd2d-4adb-8929-f2204a667404 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890" status: 200 len: 1225 microversion: 2.1 time: 0.095792 Oct 18 16:21:37.911000 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3349/6675] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:37 2022] GET /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:21:38.931344 n-d-853682-5 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [-] [6eb481dc-0a5f-4095-8691-72ce090f1ba0] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 37444. Oct 18 16:21:38.936181 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-55ae8b28-c8b0-437d-ae99-35db8962d93b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:38.936954 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-55ae8b28-c8b0-437d-ae99-35db8962d93b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 3fe6a178-8709-4ae1-b6b7-4de54843c890] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:38.938973 n-d-853682-5 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [-] [9784c765-18ae-4d28-9be4-c2f2473b54eb] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 37442. Oct 18 16:21:38.945050 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55ae8b28-c8b0-437d-ae99-35db8962d93b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:38.945470 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55ae8b28-c8b0-437d-ae99-35db8962d93b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:38.945905 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55ae8b28-c8b0-437d-ae99-35db8962d93b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:38.946593 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55ae8b28-c8b0-437d-ae99-35db8962d93b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:38.947043 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55ae8b28-c8b0-437d-ae99-35db8962d93b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:38.947464 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55ae8b28-c8b0-437d-ae99-35db8962d93b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:39.017551 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-55ae8b28-c8b0-437d-ae99-35db8962d93b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:39.025807 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-55ae8b28-c8b0-437d-ae99-35db8962d93b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890" status: 200 len: 1225 microversion: 2.1 time: 0.096005 Oct 18 16:21:39.026406 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3327/6676] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:38 2022] GET /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:21:40.049335 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2134089f-2d46-4ed4-9cd6-ddb897372dc8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:40.050078 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2134089f-2d46-4ed4-9cd6-ddb897372dc8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 3fe6a178-8709-4ae1-b6b7-4de54843c890] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:40.057586 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2134089f-2d46-4ed4-9cd6-ddb897372dc8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:40.058086 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2134089f-2d46-4ed4-9cd6-ddb897372dc8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:40.058535 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2134089f-2d46-4ed4-9cd6-ddb897372dc8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:40.059266 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2134089f-2d46-4ed4-9cd6-ddb897372dc8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:40.059728 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2134089f-2d46-4ed4-9cd6-ddb897372dc8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:40.060167 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2134089f-2d46-4ed4-9cd6-ddb897372dc8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:40.131581 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2134089f-2d46-4ed4-9cd6-ddb897372dc8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:40.139584 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2134089f-2d46-4ed4-9cd6-ddb897372dc8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890" status: 200 len: 1225 microversion: 2.1 time: 0.094395 Oct 18 16:21:40.140164 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3350/6677] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:40 2022] GET /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:21:41.163618 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-68fd01bc-e574-4e37-a700-7f964b0501dc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:41.164241 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-68fd01bc-e574-4e37-a700-7f964b0501dc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 3fe6a178-8709-4ae1-b6b7-4de54843c890] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:41.171141 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68fd01bc-e574-4e37-a700-7f964b0501dc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:41.171633 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68fd01bc-e574-4e37-a700-7f964b0501dc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:41.172075 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68fd01bc-e574-4e37-a700-7f964b0501dc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:41.172776 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68fd01bc-e574-4e37-a700-7f964b0501dc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:41.173270 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68fd01bc-e574-4e37-a700-7f964b0501dc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:41.174270 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68fd01bc-e574-4e37-a700-7f964b0501dc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:41.240599 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-68fd01bc-e574-4e37-a700-7f964b0501dc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:41.249060 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-68fd01bc-e574-4e37-a700-7f964b0501dc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890" status: 200 len: 1225 microversion: 2.1 time: 0.089401 Oct 18 16:21:41.249870 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3328/6678] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:41 2022] GET /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:21:42.272699 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fc035e1e-32bc-4d87-a656-150bf6736b29 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:42.273394 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-fc035e1e-32bc-4d87-a656-150bf6736b29 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 3fe6a178-8709-4ae1-b6b7-4de54843c890] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:42.280259 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fc035e1e-32bc-4d87-a656-150bf6736b29 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:42.280758 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fc035e1e-32bc-4d87-a656-150bf6736b29 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:42.281236 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fc035e1e-32bc-4d87-a656-150bf6736b29 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:42.281942 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fc035e1e-32bc-4d87-a656-150bf6736b29 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:42.282418 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fc035e1e-32bc-4d87-a656-150bf6736b29 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:42.282854 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fc035e1e-32bc-4d87-a656-150bf6736b29 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:42.296683 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-fc035e1e-32bc-4d87-a656-150bf6736b29 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] HTTP exception thrown: Instance 3fe6a178-8709-4ae1-b6b7-4de54843c890 could not be found. Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fc035e1e-32bc-4d87-a656-150bf6736b29 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Request method failure captured: Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890 HTTP/1.1 Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTtEVF9uJ-JO9Xs31vnHSSsjSYlxrsUC5zmDUZwq19epJ_KRexhuRnv973VnMOHKUrtuEaLEal20PXz-3F2SqeQ_VcN02CwN6WkvucYcQaG_QXU6RKnbyMb6Baxa9c0pM4Y0eYUesqFYGvUA-9UWLfliXu3xhi5bS1_xU9JBCKzY9b2g Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: c05254b186b04c9cb9858f621938caca Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-TestVolumeBootPattern-1353957077 Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c05254b186b04c9cb9858f621938caca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c05254b186b04c9cb9858f621938caca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c05254b186b04c9cb9858f621938caca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c05254b186b04c9cb9858f621938caca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-TestVolumeBootPattern-1353957077 Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: c05254b186b04c9cb9858f621938caca Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-TestVolumeBootPattern-1353957077 Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-TestVolumeBootPattern-1353957077-project Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: b9f9ae9e929c416a9298499ab8694d37 Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-TestVolumeBootPattern-1353957077-project Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 3fe6a178-8709-4ae1-b6b7-4de54843c890 could not be found. Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '3fe6a178-8709-4ae1-b6b7-4de54843c890'} Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fe6a178-8709-4ae1-b6b7-4de54843c890 could not be found. Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fe6a178-8709-4ae1-b6b7-4de54843c890 could not be found. Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:21:42.298357 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:21:42.303334 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:21:42.303334 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:21:42.303334 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:21:42.303334 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:21:42.303334 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:21:42.303334 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fe6a178-8709-4ae1-b6b7-4de54843c890 could not be found. Oct 18 16:21:42.303334 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:21:42.303334 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fc035e1e-32bc-4d87-a656-150bf6736b29 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Returning 404 to user: Instance 3fe6a178-8709-4ae1-b6b7-4de54843c890 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:21:42.303334 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fc035e1e-32bc-4d87-a656-150bf6736b29 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890" status: 404 len: 111 microversion: 2.1 time: 0.031625 Oct 18 16:21:42.303334 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3351/6679] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:42 2022] GET /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:21:42.350233 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a2c37a00-4266-4e0e-a45d-9fd54092f755 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-738819484", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-649878017", "security_groups": [{"name": "tempest-secgroup-smoke-226710337"}], "block_device_mapping_v2": [{"uuid": "98d38cda-aad2-4c2d-97e9-d56bafa85ab3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a0168786-8cd3-418a-9936-dae2a39b2080"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:21:42.466768 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-a2c37a00-4266-4e0e-a45d-9fd54092f755 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] validate_networks() for [('a0168786-8cd3-418a-9936-dae2a39b2080', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 16:21:42.883047 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-a2c37a00-4266-4e0e-a45d-9fd54092f755 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:21:42.883467 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-a2c37a00-4266-4e0e-a45d-9fd54092f755 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:21:42.883937 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-a2c37a00-4266-4e0e-a45d-9fd54092f755 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:21:42.884342 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-a2c37a00-4266-4e0e-a45d-9fd54092f755 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:21:42.884749 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-a2c37a00-4266-4e0e-a45d-9fd54092f755 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:21:42.893657 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2c37a00-4266-4e0e-a45d-9fd54092f755 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:42.894770 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2c37a00-4266-4e0e-a45d-9fd54092f755 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:42.895269 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2c37a00-4266-4e0e-a45d-9fd54092f755 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:42.895891 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2c37a00-4266-4e0e-a45d-9fd54092f755 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:42.896340 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2c37a00-4266-4e0e-a45d-9fd54092f755 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:42.896760 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2c37a00-4266-4e0e-a45d-9fd54092f755 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:42.913240 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-a2c37a00-4266-4e0e-a45d-9fd54092f755 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Getting quotas for project c05254b186b04c9cb9858f621938caca. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:21:42.918415 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-a2c37a00-4266-4e0e-a45d-9fd54092f755 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Getting quotas for user b9f9ae9e929c416a9298499ab8694d37 and project c05254b186b04c9cb9858f621938caca. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:21:42.977721 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a2c37a00-4266-4e0e-a45d-9fd54092f755 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:21:42.979923 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a2c37a00-4266-4e0e-a45d-9fd54092f755 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 71cc24f8-d82a-4b3c-82ee-420694d78ec8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='98d38cda-aad2-4c2d-97e9-d56bafa85ab3',volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:21:43.119643 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a2c37a00-4266-4e0e-a45d-9fd54092f755 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.774033 Oct 18 16:21:43.120315 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3329/6680] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 16:21:42 2022] POST /compute/v2.1/servers => generated 405 bytes in 775 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:21:43.132186 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c2860eaf-056b-4b01-99c2-f13f18695640 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:43.133057 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c2860eaf-056b-4b01-99c2-f13f18695640 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 71cc24f8-d82a-4b3c-82ee-420694d78ec8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:43.190457 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c2860eaf-056b-4b01-99c2-f13f18695640 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:43.198280 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c2860eaf-056b-4b01-99c2-f13f18695640 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/71cc24f8-d82a-4b3c-82ee-420694d78ec8" status: 200 len: 1093 microversion: 2.1 time: 0.070580 Oct 18 16:21:43.199139 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3352/6681] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:43 2022] GET /compute/v2.1/servers/71cc24f8-d82a-4b3c-82ee-420694d78ec8 => generated 1093 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:21:44.222656 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7a0c4c33-2981-47fb-9eb6-5a0c620d4e65 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:44.223902 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7a0c4c33-2981-47fb-9eb6-5a0c620d4e65 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 71cc24f8-d82a-4b3c-82ee-420694d78ec8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:44.231106 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a0c4c33-2981-47fb-9eb6-5a0c620d4e65 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:44.231603 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a0c4c33-2981-47fb-9eb6-5a0c620d4e65 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:44.232044 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a0c4c33-2981-47fb-9eb6-5a0c620d4e65 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:44.232750 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a0c4c33-2981-47fb-9eb6-5a0c620d4e65 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:44.233234 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a0c4c33-2981-47fb-9eb6-5a0c620d4e65 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:44.233664 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a0c4c33-2981-47fb-9eb6-5a0c620d4e65 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:44.313930 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7a0c4c33-2981-47fb-9eb6-5a0c620d4e65 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:44.323459 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7a0c4c33-2981-47fb-9eb6-5a0c620d4e65 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/71cc24f8-d82a-4b3c-82ee-420694d78ec8" status: 200 len: 1209 microversion: 2.1 time: 0.106078 Oct 18 16:21:44.324529 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3330/6682] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:44 2022] GET /compute/v2.1/servers/71cc24f8-d82a-4b3c-82ee-420694d78ec8 => generated 1209 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:21:45.348481 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-501dfe02-720b-4d4b-97bd-14a8286a1be8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:45.349914 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-501dfe02-720b-4d4b-97bd-14a8286a1be8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 71cc24f8-d82a-4b3c-82ee-420694d78ec8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:45.358227 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-501dfe02-720b-4d4b-97bd-14a8286a1be8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:45.359112 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-501dfe02-720b-4d4b-97bd-14a8286a1be8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:45.359867 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-501dfe02-720b-4d4b-97bd-14a8286a1be8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:45.360850 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-501dfe02-720b-4d4b-97bd-14a8286a1be8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:45.361587 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-501dfe02-720b-4d4b-97bd-14a8286a1be8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:45.362270 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-501dfe02-720b-4d4b-97bd-14a8286a1be8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:45.698004 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-501dfe02-720b-4d4b-97bd-14a8286a1be8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:45.710362 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-501dfe02-720b-4d4b-97bd-14a8286a1be8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/71cc24f8-d82a-4b3c-82ee-420694d78ec8" status: 200 len: 1276 microversion: 2.1 time: 0.367263 Oct 18 16:21:45.711298 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3353/6683] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:45 2022] GET /compute/v2.1/servers/71cc24f8-d82a-4b3c-82ee-420694d78ec8 => generated 1276 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:21:46.111404 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-b3a2aaa3-29e9-4775-bbdd-d08fd74ce697 req-3cc2a4d9-6125-483c-82f5-63117cb53c74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71cc24f8-d82a-4b3c-82ee-420694d78ec8", "tag": "b78a0d69-7a19-4f63-8c19-9bf1c2aec74a"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:21:46.126919 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b3a2aaa3-29e9-4775-bbdd-d08fd74ce697 req-3cc2a4d9-6125-483c-82f5-63117cb53c74 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:46.127688 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b3a2aaa3-29e9-4775-bbdd-d08fd74ce697 req-3cc2a4d9-6125-483c-82f5-63117cb53c74 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:46.130706 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b3a2aaa3-29e9-4775-bbdd-d08fd74ce697 req-3cc2a4d9-6125-483c-82f5-63117cb53c74 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:46.141731 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-b3a2aaa3-29e9-4775-bbdd-d08fd74ce697 req-3cc2a4d9-6125-483c-82f5-63117cb53c74 service nova] Creating event network-changed:b78a0d69-7a19-4f63-8c19-9bf1c2aec74a for instance 71cc24f8-d82a-4b3c-82ee-420694d78ec8 on n-h2-853682-5 Oct 18 16:21:46.147555 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-b3a2aaa3-29e9-4775-bbdd-d08fd74ce697 req-3cc2a4d9-6125-483c-82f5-63117cb53c74 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040587 Oct 18 16:21:46.150331 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3331/6684] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:21:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:21:46.733836 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4ef75784-473f-48ae-8313-21a682047cfb tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:46.734569 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4ef75784-473f-48ae-8313-21a682047cfb tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 71cc24f8-d82a-4b3c-82ee-420694d78ec8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:46.741759 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ef75784-473f-48ae-8313-21a682047cfb tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:46.742342 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ef75784-473f-48ae-8313-21a682047cfb tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:46.742870 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ef75784-473f-48ae-8313-21a682047cfb tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:46.743647 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ef75784-473f-48ae-8313-21a682047cfb tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:46.744260 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ef75784-473f-48ae-8313-21a682047cfb tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:46.744763 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ef75784-473f-48ae-8313-21a682047cfb tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:46.955874 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4ef75784-473f-48ae-8313-21a682047cfb tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:46.966105 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4ef75784-473f-48ae-8313-21a682047cfb tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/71cc24f8-d82a-4b3c-82ee-420694d78ec8" status: 200 len: 1276 microversion: 2.1 time: 0.236234 Oct 18 16:21:46.981487 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3354/6685] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:46 2022] GET /compute/v2.1/servers/71cc24f8-d82a-4b3c-82ee-420694d78ec8 => generated 1276 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:21:47.993525 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-09e0a588-9322-42e8-83b2-0117ee67bee9 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:47.994274 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-09e0a588-9322-42e8-83b2-0117ee67bee9 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 71cc24f8-d82a-4b3c-82ee-420694d78ec8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:48.000671 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09e0a588-9322-42e8-83b2-0117ee67bee9 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:48.001199 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09e0a588-9322-42e8-83b2-0117ee67bee9 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:48.001642 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09e0a588-9322-42e8-83b2-0117ee67bee9 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:48.002351 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09e0a588-9322-42e8-83b2-0117ee67bee9 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:48.002814 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09e0a588-9322-42e8-83b2-0117ee67bee9 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:48.003736 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09e0a588-9322-42e8-83b2-0117ee67bee9 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:48.209653 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-09e0a588-9322-42e8-83b2-0117ee67bee9 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:48.218487 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-09e0a588-9322-42e8-83b2-0117ee67bee9 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/71cc24f8-d82a-4b3c-82ee-420694d78ec8" status: 200 len: 1276 microversion: 2.1 time: 0.230532 Oct 18 16:21:48.219087 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3332/6686] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:47 2022] GET /compute/v2.1/servers/71cc24f8-d82a-4b3c-82ee-420694d78ec8 => generated 1276 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:21:49.241713 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-cb5232b2-ce2b-4392-ba27-6c4880a7af2a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:49.242306 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-cb5232b2-ce2b-4392-ba27-6c4880a7af2a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 71cc24f8-d82a-4b3c-82ee-420694d78ec8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:49.249230 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cb5232b2-ce2b-4392-ba27-6c4880a7af2a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:49.249744 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cb5232b2-ce2b-4392-ba27-6c4880a7af2a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:49.250415 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cb5232b2-ce2b-4392-ba27-6c4880a7af2a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:49.251145 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cb5232b2-ce2b-4392-ba27-6c4880a7af2a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:49.251627 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cb5232b2-ce2b-4392-ba27-6c4880a7af2a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:49.252081 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cb5232b2-ce2b-4392-ba27-6c4880a7af2a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:49.389552 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-cb5232b2-ce2b-4392-ba27-6c4880a7af2a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:49.398087 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-cb5232b2-ce2b-4392-ba27-6c4880a7af2a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/71cc24f8-d82a-4b3c-82ee-420694d78ec8" status: 200 len: 1276 microversion: 2.1 time: 0.160317 Oct 18 16:21:49.398662 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3355/6687] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:49 2022] GET /compute/v2.1/servers/71cc24f8-d82a-4b3c-82ee-420694d78ec8 => generated 1276 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:21:50.421192 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-14740e95-cb0c-48d0-97a0-4e951e9d2fa5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:50.421808 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-14740e95-cb0c-48d0-97a0-4e951e9d2fa5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 71cc24f8-d82a-4b3c-82ee-420694d78ec8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:50.429757 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14740e95-cb0c-48d0-97a0-4e951e9d2fa5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:50.430235 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14740e95-cb0c-48d0-97a0-4e951e9d2fa5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:50.430666 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14740e95-cb0c-48d0-97a0-4e951e9d2fa5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:50.431356 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14740e95-cb0c-48d0-97a0-4e951e9d2fa5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:50.431803 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14740e95-cb0c-48d0-97a0-4e951e9d2fa5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:50.432223 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14740e95-cb0c-48d0-97a0-4e951e9d2fa5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:50.569172 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-14740e95-cb0c-48d0-97a0-4e951e9d2fa5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:50.577076 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-14740e95-cb0c-48d0-97a0-4e951e9d2fa5 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/71cc24f8-d82a-4b3c-82ee-420694d78ec8" status: 200 len: 1264 microversion: 2.1 time: 0.159891 Oct 18 16:21:50.577650 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3333/6688] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:50 2022] GET /compute/v2.1/servers/71cc24f8-d82a-4b3c-82ee-420694d78ec8 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:21:51.604418 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fe3d6fd4-5efa-401e-ac9a-5be542473f79 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:51.605293 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-fe3d6fd4-5efa-401e-ac9a-5be542473f79 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 71cc24f8-d82a-4b3c-82ee-420694d78ec8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:51.614518 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fe3d6fd4-5efa-401e-ac9a-5be542473f79 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:51.615429 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fe3d6fd4-5efa-401e-ac9a-5be542473f79 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:51.615897 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fe3d6fd4-5efa-401e-ac9a-5be542473f79 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:51.616982 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fe3d6fd4-5efa-401e-ac9a-5be542473f79 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:51.617587 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fe3d6fd4-5efa-401e-ac9a-5be542473f79 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:51.618075 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fe3d6fd4-5efa-401e-ac9a-5be542473f79 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:51.770242 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-fe3d6fd4-5efa-401e-ac9a-5be542473f79 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:51.778589 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fe3d6fd4-5efa-401e-ac9a-5be542473f79 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/71cc24f8-d82a-4b3c-82ee-420694d78ec8" status: 200 len: 1264 microversion: 2.1 time: 0.179705 Oct 18 16:21:51.779222 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3356/6689] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:51 2022] GET /compute/v2.1/servers/71cc24f8-d82a-4b3c-82ee-420694d78ec8 => generated 1264 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:21:52.802120 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5ca95811-98eb-4935-9209-0e0f951cc3fd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:52.802733 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5ca95811-98eb-4935-9209-0e0f951cc3fd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 71cc24f8-d82a-4b3c-82ee-420694d78ec8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:52.809904 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ca95811-98eb-4935-9209-0e0f951cc3fd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:52.810385 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ca95811-98eb-4935-9209-0e0f951cc3fd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:52.810819 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ca95811-98eb-4935-9209-0e0f951cc3fd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:52.811537 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ca95811-98eb-4935-9209-0e0f951cc3fd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:52.811986 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ca95811-98eb-4935-9209-0e0f951cc3fd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:52.812407 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ca95811-98eb-4935-9209-0e0f951cc3fd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:52.904087 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:21:52.925133 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:21:52.946782 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5ca95811-98eb-4935-9209-0e0f951cc3fd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:52.954564 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5ca95811-98eb-4935-9209-0e0f951cc3fd tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/71cc24f8-d82a-4b3c-82ee-420694d78ec8" status: 200 len: 1264 microversion: 2.1 time: 0.156589 Oct 18 16:21:52.955156 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3334/6690] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:52 2022] GET /compute/v2.1/servers/71cc24f8-d82a-4b3c-82ee-420694d78ec8 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:21:53.978751 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f853f2d4-3f1e-44d5-9b49-4f5a06aac92f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:53.979390 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f853f2d4-3f1e-44d5-9b49-4f5a06aac92f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 71cc24f8-d82a-4b3c-82ee-420694d78ec8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:53.982137 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:21:53.988289 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f853f2d4-3f1e-44d5-9b49-4f5a06aac92f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:53.988788 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f853f2d4-3f1e-44d5-9b49-4f5a06aac92f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:53.989266 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f853f2d4-3f1e-44d5-9b49-4f5a06aac92f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:53.989975 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f853f2d4-3f1e-44d5-9b49-4f5a06aac92f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:53.990445 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f853f2d4-3f1e-44d5-9b49-4f5a06aac92f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:53.990887 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f853f2d4-3f1e-44d5-9b49-4f5a06aac92f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:54.135826 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f853f2d4-3f1e-44d5-9b49-4f5a06aac92f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:54.144320 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f853f2d4-3f1e-44d5-9b49-4f5a06aac92f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/71cc24f8-d82a-4b3c-82ee-420694d78ec8" status: 200 len: 1264 microversion: 2.1 time: 0.168889 Oct 18 16:21:54.144922 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3357/6691] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:53 2022] GET /compute/v2.1/servers/71cc24f8-d82a-4b3c-82ee-420694d78ec8 => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:21:55.167310 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2cef5007-3f48-47f0-9fee-f5b2b02d4901 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:55.167835 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2cef5007-3f48-47f0-9fee-f5b2b02d4901 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 71cc24f8-d82a-4b3c-82ee-420694d78ec8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:55.175276 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2cef5007-3f48-47f0-9fee-f5b2b02d4901 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:55.175803 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2cef5007-3f48-47f0-9fee-f5b2b02d4901 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:55.176261 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2cef5007-3f48-47f0-9fee-f5b2b02d4901 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:55.177328 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2cef5007-3f48-47f0-9fee-f5b2b02d4901 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:55.177787 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2cef5007-3f48-47f0-9fee-f5b2b02d4901 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:55.178216 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2cef5007-3f48-47f0-9fee-f5b2b02d4901 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:55.311255 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2cef5007-3f48-47f0-9fee-f5b2b02d4901 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:55.319719 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2cef5007-3f48-47f0-9fee-f5b2b02d4901 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/71cc24f8-d82a-4b3c-82ee-420694d78ec8" status: 200 len: 1264 microversion: 2.1 time: 0.156643 Oct 18 16:21:55.320297 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3335/6692] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:55 2022] GET /compute/v2.1/servers/71cc24f8-d82a-4b3c-82ee-420694d78ec8 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:21:56.342952 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-231f2362-d04e-4825-823f-69d74c791c3b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:56.343582 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-231f2362-d04e-4825-823f-69d74c791c3b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 71cc24f8-d82a-4b3c-82ee-420694d78ec8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:56.350715 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-231f2362-d04e-4825-823f-69d74c791c3b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:56.351213 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-231f2362-d04e-4825-823f-69d74c791c3b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:56.351665 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-231f2362-d04e-4825-823f-69d74c791c3b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:56.352369 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-231f2362-d04e-4825-823f-69d74c791c3b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:56.352872 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-231f2362-d04e-4825-823f-69d74c791c3b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:56.353317 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-231f2362-d04e-4825-823f-69d74c791c3b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:56.493131 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-231f2362-d04e-4825-823f-69d74c791c3b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:56.501026 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-231f2362-d04e-4825-823f-69d74c791c3b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/71cc24f8-d82a-4b3c-82ee-420694d78ec8" status: 200 len: 1264 microversion: 2.1 time: 0.161959 Oct 18 16:21:56.501609 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3358/6693] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:56 2022] GET /compute/v2.1/servers/71cc24f8-d82a-4b3c-82ee-420694d78ec8 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:21:57.524768 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4f4943b3-2127-40db-8527-ba765a2149e4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:57.525411 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4f4943b3-2127-40db-8527-ba765a2149e4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 71cc24f8-d82a-4b3c-82ee-420694d78ec8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:57.532502 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f4943b3-2127-40db-8527-ba765a2149e4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:57.533030 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f4943b3-2127-40db-8527-ba765a2149e4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:57.533475 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f4943b3-2127-40db-8527-ba765a2149e4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:57.534684 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f4943b3-2127-40db-8527-ba765a2149e4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:57.535147 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f4943b3-2127-40db-8527-ba765a2149e4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:57.535579 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f4943b3-2127-40db-8527-ba765a2149e4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:57.667721 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4f4943b3-2127-40db-8527-ba765a2149e4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:57.676154 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4f4943b3-2127-40db-8527-ba765a2149e4 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/71cc24f8-d82a-4b3c-82ee-420694d78ec8" status: 200 len: 1264 microversion: 2.1 time: 0.155406 Oct 18 16:21:57.677045 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3336/6694] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:57 2022] GET /compute/v2.1/servers/71cc24f8-d82a-4b3c-82ee-420694d78ec8 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:21:58.230218 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-e7ee8713-bd0a-4e73-b546-ffc326d49d8b req-bdb67224-9d52-4b95-a5d6-0c70d070f2f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71cc24f8-d82a-4b3c-82ee-420694d78ec8", "name": "network-vif-plugged", "status": "completed", "tag": "b78a0d69-7a19-4f63-8c19-9bf1c2aec74a"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:21:58.243135 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-e7ee8713-bd0a-4e73-b546-ffc326d49d8b req-bdb67224-9d52-4b95-a5d6-0c70d070f2f1 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:58.243643 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-e7ee8713-bd0a-4e73-b546-ffc326d49d8b req-bdb67224-9d52-4b95-a5d6-0c70d070f2f1 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:58.244095 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-e7ee8713-bd0a-4e73-b546-ffc326d49d8b req-bdb67224-9d52-4b95-a5d6-0c70d070f2f1 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:58.257166 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-e7ee8713-bd0a-4e73-b546-ffc326d49d8b req-bdb67224-9d52-4b95-a5d6-0c70d070f2f1 service nova] Creating event network-vif-plugged:b78a0d69-7a19-4f63-8c19-9bf1c2aec74a for instance 71cc24f8-d82a-4b3c-82ee-420694d78ec8 on n-h2-853682-5 Oct 18 16:21:58.265111 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-e7ee8713-bd0a-4e73-b546-ffc326d49d8b req-bdb67224-9d52-4b95-a5d6-0c70d070f2f1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038140 Oct 18 16:21:58.266227 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3359/6695] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:21:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:21:58.699103 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-27f7442e-f398-449a-9d9a-1a48d43e7a3a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:58.699711 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-27f7442e-f398-449a-9d9a-1a48d43e7a3a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 71cc24f8-d82a-4b3c-82ee-420694d78ec8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:58.707099 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-27f7442e-f398-449a-9d9a-1a48d43e7a3a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:58.707583 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-27f7442e-f398-449a-9d9a-1a48d43e7a3a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:58.708010 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-27f7442e-f398-449a-9d9a-1a48d43e7a3a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:58.708691 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-27f7442e-f398-449a-9d9a-1a48d43e7a3a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:58.709173 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-27f7442e-f398-449a-9d9a-1a48d43e7a3a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:58.709592 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-27f7442e-f398-449a-9d9a-1a48d43e7a3a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:58.846634 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-27f7442e-f398-449a-9d9a-1a48d43e7a3a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:21:58.855396 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-27f7442e-f398-449a-9d9a-1a48d43e7a3a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/71cc24f8-d82a-4b3c-82ee-420694d78ec8" status: 200 len: 1264 microversion: 2.1 time: 0.160196 Oct 18 16:21:58.856003 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3337/6696] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:58 2022] GET /compute/v2.1/servers/71cc24f8-d82a-4b3c-82ee-420694d78ec8 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:21:59.878419 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-985fb05d-2450-4685-b1fd-b170ccc379d8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:21:59.879152 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-985fb05d-2450-4685-b1fd-b170ccc379d8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 71cc24f8-d82a-4b3c-82ee-420694d78ec8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:21:59.886283 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-985fb05d-2450-4685-b1fd-b170ccc379d8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:59.886773 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-985fb05d-2450-4685-b1fd-b170ccc379d8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:59.887223 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-985fb05d-2450-4685-b1fd-b170ccc379d8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:21:59.887922 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-985fb05d-2450-4685-b1fd-b170ccc379d8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:21:59.888385 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-985fb05d-2450-4685-b1fd-b170ccc379d8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:21:59.888828 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-985fb05d-2450-4685-b1fd-b170ccc379d8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:00.028092 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-985fb05d-2450-4685-b1fd-b170ccc379d8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:00.036698 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-985fb05d-2450-4685-b1fd-b170ccc379d8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/71cc24f8-d82a-4b3c-82ee-420694d78ec8" status: 200 len: 1450 microversion: 2.1 time: 0.162622 Oct 18 16:22:00.037312 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3360/6697] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:21:59 2022] GET /compute/v2.1/servers/71cc24f8-d82a-4b3c-82ee-420694d78ec8 => generated 1450 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:00.063309 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-292a4d11-b1e1-4531-b0f1-2ebf98d9b6ba tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:22:00.064005 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-292a4d11-b1e1-4531-b0f1-2ebf98d9b6ba tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 71cc24f8-d82a-4b3c-82ee-420694d78ec8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:22:00.071157 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-292a4d11-b1e1-4531-b0f1-2ebf98d9b6ba tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:00.071878 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-292a4d11-b1e1-4531-b0f1-2ebf98d9b6ba tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:00.072328 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-292a4d11-b1e1-4531-b0f1-2ebf98d9b6ba tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:00.073060 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-292a4d11-b1e1-4531-b0f1-2ebf98d9b6ba tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:00.073521 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-292a4d11-b1e1-4531-b0f1-2ebf98d9b6ba tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:00.073950 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-292a4d11-b1e1-4531-b0f1-2ebf98d9b6ba tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:00.210563 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-292a4d11-b1e1-4531-b0f1-2ebf98d9b6ba tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:22:00.218492 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-292a4d11-b1e1-4531-b0f1-2ebf98d9b6ba tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/71cc24f8-d82a-4b3c-82ee-420694d78ec8" status: 200 len: 1450 microversion: 2.1 time: 0.159053 Oct 18 16:22:00.219099 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3338/6698] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:22:00 2022] GET /compute/v2.1/servers/71cc24f8-d82a-4b3c-82ee-420694d78ec8 => generated 1450 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:22:01.923054 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-4c1073b6-6819-47b7-8f76-9aa9976d1f9c req-531d8c81-7ab6-496d-a40c-6f34168f8b90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71cc24f8-d82a-4b3c-82ee-420694d78ec8", "tag": "b78a0d69-7a19-4f63-8c19-9bf1c2aec74a"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:22:01.935236 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-4c1073b6-6819-47b7-8f76-9aa9976d1f9c req-531d8c81-7ab6-496d-a40c-6f34168f8b90 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:22:01.935740 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-4c1073b6-6819-47b7-8f76-9aa9976d1f9c req-531d8c81-7ab6-496d-a40c-6f34168f8b90 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:22:01.936200 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-4c1073b6-6819-47b7-8f76-9aa9976d1f9c req-531d8c81-7ab6-496d-a40c-6f34168f8b90 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:22:01.948065 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-4c1073b6-6819-47b7-8f76-9aa9976d1f9c req-531d8c81-7ab6-496d-a40c-6f34168f8b90 service nova] Creating event network-changed:b78a0d69-7a19-4f63-8c19-9bf1c2aec74a for instance 71cc24f8-d82a-4b3c-82ee-420694d78ec8 on n-h2-853682-5 Oct 18 16:22:01.953285 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-4c1073b6-6819-47b7-8f76-9aa9976d1f9c req-531d8c81-7ab6-496d-a40c-6f34168f8b90 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034069 Oct 18 16:22:01.954109 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3361/6699] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:22:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:23:52.600629 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:52.601439 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:52.602768 n-d-853682-5 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 18 16:23:52.602933 n-d-853682-5 devstack@n-api.service[120406]: Tue Oct 18 16:23:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Oct 18 16:23:52.608925 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f6f496c7-50e1-4d49-9d05-0d076e273555 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-183431056", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-649878017", "security_groups": [{"name": "tempest-secgroup-smoke-226710337"}], "block_device_mapping_v2": [{"uuid": "e5bb263a-1570-4a57-a521-63fca69cedfe", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a0168786-8cd3-418a-9936-dae2a39b2080"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:23:52.931000 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-f6f496c7-50e1-4d49-9d05-0d076e273555 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] validate_networks() for [('a0168786-8cd3-418a-9936-dae2a39b2080', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 16:23:53.399414 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-f6f496c7-50e1-4d49-9d05-0d076e273555 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:23:53.399871 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-f6f496c7-50e1-4d49-9d05-0d076e273555 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:23:53.400344 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-f6f496c7-50e1-4d49-9d05-0d076e273555 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:23:53.400755 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-f6f496c7-50e1-4d49-9d05-0d076e273555 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:23:53.401202 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-f6f496c7-50e1-4d49-9d05-0d076e273555 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:23:53.412481 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f6f496c7-50e1-4d49-9d05-0d076e273555 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:53.413007 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f6f496c7-50e1-4d49-9d05-0d076e273555 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:53.413442 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f6f496c7-50e1-4d49-9d05-0d076e273555 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:53.414170 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f6f496c7-50e1-4d49-9d05-0d076e273555 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:53.414624 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f6f496c7-50e1-4d49-9d05-0d076e273555 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:53.415050 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f6f496c7-50e1-4d49-9d05-0d076e273555 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:53.436452 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-f6f496c7-50e1-4d49-9d05-0d076e273555 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Getting quotas for project c05254b186b04c9cb9858f621938caca. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:23:53.441773 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-f6f496c7-50e1-4d49-9d05-0d076e273555 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Getting quotas for user b9f9ae9e929c416a9298499ab8694d37 and project c05254b186b04c9cb9858f621938caca. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:23:53.500768 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f6f496c7-50e1-4d49-9d05-0d076e273555 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:23:53.502962 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f6f496c7-50e1-4d49-9d05-0d076e273555 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 66c5742c-2f04-487c-aae2-f83e0f32b001] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e5bb263a-1570-4a57-a521-63fca69cedfe',volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:23:53.637290 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f6f496c7-50e1-4d49-9d05-0d076e273555 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.038449 Oct 18 16:23:53.638246 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3339/6700] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 16:23:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 1040 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:23:53.647129 n-d-853682-5 devstack@n-api.service[120405]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c870dd72-6039-47fe-83e0-90856ded1829] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 16:23:53.648027 n-d-853682-5 devstack@n-api.service[120405]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6b6d975c-54e4-4acd-8cc5-5b0cda3c3106] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 16:23:53.648617 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=32 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:53.649422 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=72 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:53.655935 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0833da3b-418a-4a20-ac62-2cf6d865eea8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:53.656645 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0833da3b-418a-4a20-ac62-2cf6d865eea8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 66c5742c-2f04-487c-aae2-f83e0f32b001] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:53.837743 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0833da3b-418a-4a20-ac62-2cf6d865eea8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:53.847765 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0833da3b-418a-4a20-ac62-2cf6d865eea8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/66c5742c-2f04-487c-aae2-f83e0f32b001" status: 200 len: 1093 microversion: 2.1 time: 0.202539 Oct 18 16:23:53.848331 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3362/6701] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:23:53 2022] GET /compute/v2.1/servers/66c5742c-2f04-487c-aae2-f83e0f32b001 => generated 1093 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:23:54.871606 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8ee54315-03bf-4a73-b7a3-de8b5a53043f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:54.872240 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8ee54315-03bf-4a73-b7a3-de8b5a53043f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 66c5742c-2f04-487c-aae2-f83e0f32b001] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:54.925788 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8ee54315-03bf-4a73-b7a3-de8b5a53043f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:54.932764 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8ee54315-03bf-4a73-b7a3-de8b5a53043f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/66c5742c-2f04-487c-aae2-f83e0f32b001" status: 200 len: 1093 microversion: 2.1 time: 0.066134 Oct 18 16:23:54.933377 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3340/6702] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:23:54 2022] GET /compute/v2.1/servers/66c5742c-2f04-487c-aae2-f83e0f32b001 => generated 1093 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:23:55.955360 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ce9b76ea-2d9c-4c26-833f-a876e17d3831 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:55.955926 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ce9b76ea-2d9c-4c26-833f-a876e17d3831 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 66c5742c-2f04-487c-aae2-f83e0f32b001] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:55.969997 n-d-853682-5 devstack@n-api.service[120405]: INFO oslo.messaging._drivers.impl_rabbit [-] [6b6d975c-54e4-4acd-8cc5-5b0cda3c3106] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 37664. Oct 18 16:23:55.970857 n-d-853682-5 devstack@n-api.service[120405]: INFO oslo.messaging._drivers.impl_rabbit [-] [c870dd72-6039-47fe-83e0-90856ded1829] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 37662. Oct 18 16:23:56.015765 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ce9b76ea-2d9c-4c26-833f-a876e17d3831 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:56.023238 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ce9b76ea-2d9c-4c26-833f-a876e17d3831 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/66c5742c-2f04-487c-aae2-f83e0f32b001" status: 200 len: 1093 microversion: 2.1 time: 0.071982 Oct 18 16:23:56.023804 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3363/6703] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:23:55 2022] GET /compute/v2.1/servers/66c5742c-2f04-487c-aae2-f83e0f32b001 => generated 1093 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:23:57.047288 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-60d6d98e-793d-4e14-87c7-3fc84cdce8e3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:57.048079 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-60d6d98e-793d-4e14-87c7-3fc84cdce8e3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 66c5742c-2f04-487c-aae2-f83e0f32b001] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:57.061026 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60d6d98e-793d-4e14-87c7-3fc84cdce8e3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:57.061424 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60d6d98e-793d-4e14-87c7-3fc84cdce8e3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:57.061857 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60d6d98e-793d-4e14-87c7-3fc84cdce8e3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:57.062553 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60d6d98e-793d-4e14-87c7-3fc84cdce8e3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:57.063003 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60d6d98e-793d-4e14-87c7-3fc84cdce8e3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:57.063424 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60d6d98e-793d-4e14-87c7-3fc84cdce8e3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:57.125012 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-60d6d98e-793d-4e14-87c7-3fc84cdce8e3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:57.132725 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-60d6d98e-793d-4e14-87c7-3fc84cdce8e3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/66c5742c-2f04-487c-aae2-f83e0f32b001" status: 200 len: 1143 microversion: 2.1 time: 0.090461 Oct 18 16:23:57.133344 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3341/6704] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:23:57 2022] GET /compute/v2.1/servers/66c5742c-2f04-487c-aae2-f83e0f32b001 => generated 1143 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:23:58.156969 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f46c5186-2a7e-4353-a183-01da55f8f476 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:58.157688 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f46c5186-2a7e-4353-a183-01da55f8f476 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 66c5742c-2f04-487c-aae2-f83e0f32b001] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:58.165068 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f46c5186-2a7e-4353-a183-01da55f8f476 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:58.165744 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f46c5186-2a7e-4353-a183-01da55f8f476 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:58.166199 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f46c5186-2a7e-4353-a183-01da55f8f476 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:58.166924 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f46c5186-2a7e-4353-a183-01da55f8f476 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:58.167403 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f46c5186-2a7e-4353-a183-01da55f8f476 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:58.167848 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f46c5186-2a7e-4353-a183-01da55f8f476 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:58.237458 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f46c5186-2a7e-4353-a183-01da55f8f476 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:58.245476 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f46c5186-2a7e-4353-a183-01da55f8f476 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/66c5742c-2f04-487c-aae2-f83e0f32b001" status: 200 len: 1135 microversion: 2.1 time: 0.092521 Oct 18 16:23:58.246067 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3364/6705] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:23:58 2022] GET /compute/v2.1/servers/66c5742c-2f04-487c-aae2-f83e0f32b001 => generated 1135 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:23:59.271087 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1c462a3f-450c-4084-9ad3-455ef31c3977 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:23:59.272526 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1c462a3f-450c-4084-9ad3-455ef31c3977 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 66c5742c-2f04-487c-aae2-f83e0f32b001] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:23:59.281477 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1c462a3f-450c-4084-9ad3-455ef31c3977 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:59.282349 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1c462a3f-450c-4084-9ad3-455ef31c3977 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:59.283022 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1c462a3f-450c-4084-9ad3-455ef31c3977 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:59.285042 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1c462a3f-450c-4084-9ad3-455ef31c3977 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:23:59.285814 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1c462a3f-450c-4084-9ad3-455ef31c3977 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:23:59.286571 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1c462a3f-450c-4084-9ad3-455ef31c3977 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:23:59.361382 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1c462a3f-450c-4084-9ad3-455ef31c3977 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:23:59.371891 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1c462a3f-450c-4084-9ad3-455ef31c3977 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/66c5742c-2f04-487c-aae2-f83e0f32b001" status: 200 len: 1209 microversion: 2.1 time: 0.106580 Oct 18 16:23:59.372673 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3342/6706] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:23:59 2022] GET /compute/v2.1/servers/66c5742c-2f04-487c-aae2-f83e0f32b001 => generated 1209 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:24:00.397293 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-29dc510f-274c-4d74-8ccd-ab029018d2cc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:00.397839 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-29dc510f-274c-4d74-8ccd-ab029018d2cc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 66c5742c-2f04-487c-aae2-f83e0f32b001] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:00.405775 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-29dc510f-274c-4d74-8ccd-ab029018d2cc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:00.406272 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-29dc510f-274c-4d74-8ccd-ab029018d2cc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:00.406940 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-29dc510f-274c-4d74-8ccd-ab029018d2cc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:00.407708 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-29dc510f-274c-4d74-8ccd-ab029018d2cc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:00.408388 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-29dc510f-274c-4d74-8ccd-ab029018d2cc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:00.408847 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-29dc510f-274c-4d74-8ccd-ab029018d2cc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:00.562602 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-29dc510f-274c-4d74-8ccd-ab029018d2cc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:00.573520 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-29dc510f-274c-4d74-8ccd-ab029018d2cc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/66c5742c-2f04-487c-aae2-f83e0f32b001" status: 200 len: 1276 microversion: 2.1 time: 0.180322 Oct 18 16:24:00.574274 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3365/6707] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:00 2022] GET /compute/v2.1/servers/66c5742c-2f04-487c-aae2-f83e0f32b001 => generated 1276 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:24:00.987903 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-150c8555-7194-4fd4-926d-f2a4edbde3ac req-ce99383e-5943-4932-be96-0706a7f1af40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66c5742c-2f04-487c-aae2-f83e0f32b001", "tag": "28239217-9930-4530-94f1-71554fd01ca6"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:24:00.998450 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-150c8555-7194-4fd4-926d-f2a4edbde3ac req-ce99383e-5943-4932-be96-0706a7f1af40 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:00.998939 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-150c8555-7194-4fd4-926d-f2a4edbde3ac req-ce99383e-5943-4932-be96-0706a7f1af40 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:00.999391 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-150c8555-7194-4fd4-926d-f2a4edbde3ac req-ce99383e-5943-4932-be96-0706a7f1af40 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:01.011596 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-150c8555-7194-4fd4-926d-f2a4edbde3ac req-ce99383e-5943-4932-be96-0706a7f1af40 service nova] Creating event network-changed:28239217-9930-4530-94f1-71554fd01ca6 for instance 66c5742c-2f04-487c-aae2-f83e0f32b001 on n-h1-853682-5 Oct 18 16:24:01.015696 n-d-853682-5 devstack@n-api.service[120406]: ERROR oslo.messaging._drivers.impl_rabbit [req-150c8555-7194-4fd4-926d-f2a4edbde3ac req-ce99383e-5943-4932-be96-0706a7f1af40 service nova] [e84fd871-95f6-4cf0-a2d7-a2d0c107921e] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 16:24:01.599065 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-eca96b78-b164-4204-82d8-d2ac63707b90 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:01.599955 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-eca96b78-b164-4204-82d8-d2ac63707b90 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 66c5742c-2f04-487c-aae2-f83e0f32b001] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:01.609337 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eca96b78-b164-4204-82d8-d2ac63707b90 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:01.610150 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eca96b78-b164-4204-82d8-d2ac63707b90 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:01.610779 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eca96b78-b164-4204-82d8-d2ac63707b90 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:01.611838 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eca96b78-b164-4204-82d8-d2ac63707b90 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:01.612511 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eca96b78-b164-4204-82d8-d2ac63707b90 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:01.613212 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eca96b78-b164-4204-82d8-d2ac63707b90 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:01.763332 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-eca96b78-b164-4204-82d8-d2ac63707b90 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:01.771187 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-eca96b78-b164-4204-82d8-d2ac63707b90 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/66c5742c-2f04-487c-aae2-f83e0f32b001" status: 200 len: 1276 microversion: 2.1 time: 0.177314 Oct 18 16:24:01.771765 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3366/6708] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:01 2022] GET /compute/v2.1/servers/66c5742c-2f04-487c-aae2-f83e0f32b001 => generated 1276 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:24:02.023191 n-d-853682-5 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [req-150c8555-7194-4fd4-926d-f2a4edbde3ac req-ce99383e-5943-4932-be96-0706a7f1af40 service nova] [e84fd871-95f6-4cf0-a2d7-a2d0c107921e] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 37696. Oct 18 16:24:02.026840 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-150c8555-7194-4fd4-926d-f2a4edbde3ac req-ce99383e-5943-4932-be96-0706a7f1af40 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.122714 Oct 18 16:24:02.027472 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3343/6709] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:24:02.795139 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-afd60f73-2e15-4eed-b074-c115cb07e9cf tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:02.796042 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-afd60f73-2e15-4eed-b074-c115cb07e9cf tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 66c5742c-2f04-487c-aae2-f83e0f32b001] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:02.803325 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-afd60f73-2e15-4eed-b074-c115cb07e9cf tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:02.803825 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-afd60f73-2e15-4eed-b074-c115cb07e9cf tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:02.804283 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-afd60f73-2e15-4eed-b074-c115cb07e9cf tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:02.805032 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-afd60f73-2e15-4eed-b074-c115cb07e9cf tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:02.805513 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-afd60f73-2e15-4eed-b074-c115cb07e9cf tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:02.805989 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-afd60f73-2e15-4eed-b074-c115cb07e9cf tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:02.939349 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-afd60f73-2e15-4eed-b074-c115cb07e9cf tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:02.947260 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-afd60f73-2e15-4eed-b074-c115cb07e9cf tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/66c5742c-2f04-487c-aae2-f83e0f32b001" status: 200 len: 1276 microversion: 2.1 time: 0.156181 Oct 18 16:24:02.947841 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3367/6710] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:02 2022] GET /compute/v2.1/servers/66c5742c-2f04-487c-aae2-f83e0f32b001 => generated 1276 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:24:03.972369 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ce16d34e-f995-43bd-a539-c0bbadf50763 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:03.973111 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ce16d34e-f995-43bd-a539-c0bbadf50763 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 66c5742c-2f04-487c-aae2-f83e0f32b001] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:03.975961 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:03.981877 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce16d34e-f995-43bd-a539-c0bbadf50763 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:03.982367 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce16d34e-f995-43bd-a539-c0bbadf50763 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:03.982810 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce16d34e-f995-43bd-a539-c0bbadf50763 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:03.983516 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce16d34e-f995-43bd-a539-c0bbadf50763 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:03.984186 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce16d34e-f995-43bd-a539-c0bbadf50763 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:03.984685 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce16d34e-f995-43bd-a539-c0bbadf50763 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:04.125062 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ce16d34e-f995-43bd-a539-c0bbadf50763 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:04.132941 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ce16d34e-f995-43bd-a539-c0bbadf50763 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/66c5742c-2f04-487c-aae2-f83e0f32b001" status: 200 len: 1276 microversion: 2.1 time: 0.164759 Oct 18 16:24:04.133512 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3344/6711] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:03 2022] GET /compute/v2.1/servers/66c5742c-2f04-487c-aae2-f83e0f32b001 => generated 1276 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:24:05.156134 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5b82a6d8-6572-4c00-9336-c8db85de7447 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:05.156792 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5b82a6d8-6572-4c00-9336-c8db85de7447 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 66c5742c-2f04-487c-aae2-f83e0f32b001] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:05.163715 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5b82a6d8-6572-4c00-9336-c8db85de7447 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:05.164214 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5b82a6d8-6572-4c00-9336-c8db85de7447 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:05.164662 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5b82a6d8-6572-4c00-9336-c8db85de7447 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:05.165398 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5b82a6d8-6572-4c00-9336-c8db85de7447 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:05.165864 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5b82a6d8-6572-4c00-9336-c8db85de7447 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:05.166304 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5b82a6d8-6572-4c00-9336-c8db85de7447 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:05.307360 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5b82a6d8-6572-4c00-9336-c8db85de7447 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:05.316202 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5b82a6d8-6572-4c00-9336-c8db85de7447 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/66c5742c-2f04-487c-aae2-f83e0f32b001" status: 200 len: 1264 microversion: 2.1 time: 0.164593 Oct 18 16:24:05.316775 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3368/6712] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:05 2022] GET /compute/v2.1/servers/66c5742c-2f04-487c-aae2-f83e0f32b001 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:24:06.339668 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-54ddfcf7-79d2-4ffc-9594-ed0ad98bcfac tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:06.341025 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-54ddfcf7-79d2-4ffc-9594-ed0ad98bcfac tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 66c5742c-2f04-487c-aae2-f83e0f32b001] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:06.342876 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=8 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:06.349092 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54ddfcf7-79d2-4ffc-9594-ed0ad98bcfac tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:06.349581 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54ddfcf7-79d2-4ffc-9594-ed0ad98bcfac tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:06.350022 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54ddfcf7-79d2-4ffc-9594-ed0ad98bcfac tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:06.350726 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54ddfcf7-79d2-4ffc-9594-ed0ad98bcfac tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:06.351310 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54ddfcf7-79d2-4ffc-9594-ed0ad98bcfac tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:06.351751 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54ddfcf7-79d2-4ffc-9594-ed0ad98bcfac tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:06.489209 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-54ddfcf7-79d2-4ffc-9594-ed0ad98bcfac tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:06.497145 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-54ddfcf7-79d2-4ffc-9594-ed0ad98bcfac tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/66c5742c-2f04-487c-aae2-f83e0f32b001" status: 200 len: 1264 microversion: 2.1 time: 0.161579 Oct 18 16:24:06.497724 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3345/6713] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:06 2022] GET /compute/v2.1/servers/66c5742c-2f04-487c-aae2-f83e0f32b001 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:24:07.519961 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-188fc299-fdd6-4a09-919f-38e200ee843b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:07.520630 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-188fc299-fdd6-4a09-919f-38e200ee843b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 66c5742c-2f04-487c-aae2-f83e0f32b001] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:07.522575 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=4 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:07.528836 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-188fc299-fdd6-4a09-919f-38e200ee843b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:07.529348 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-188fc299-fdd6-4a09-919f-38e200ee843b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:07.529812 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-188fc299-fdd6-4a09-919f-38e200ee843b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:07.530589 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-188fc299-fdd6-4a09-919f-38e200ee843b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:07.531019 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-188fc299-fdd6-4a09-919f-38e200ee843b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:07.531462 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-188fc299-fdd6-4a09-919f-38e200ee843b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:07.664656 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-188fc299-fdd6-4a09-919f-38e200ee843b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:07.672361 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-188fc299-fdd6-4a09-919f-38e200ee843b tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/66c5742c-2f04-487c-aae2-f83e0f32b001" status: 200 len: 1264 microversion: 2.1 time: 0.156396 Oct 18 16:24:07.672955 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3369/6714] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:07 2022] GET /compute/v2.1/servers/66c5742c-2f04-487c-aae2-f83e0f32b001 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:24:08.695591 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-22e2c85f-314a-48b0-a9eb-20d4cef72ea8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:08.696245 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-22e2c85f-314a-48b0-a9eb-20d4cef72ea8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 66c5742c-2f04-487c-aae2-f83e0f32b001] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:08.703310 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-22e2c85f-314a-48b0-a9eb-20d4cef72ea8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:08.703805 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-22e2c85f-314a-48b0-a9eb-20d4cef72ea8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:08.704242 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-22e2c85f-314a-48b0-a9eb-20d4cef72ea8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:08.704969 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-22e2c85f-314a-48b0-a9eb-20d4cef72ea8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:08.705432 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-22e2c85f-314a-48b0-a9eb-20d4cef72ea8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:08.705861 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-22e2c85f-314a-48b0-a9eb-20d4cef72ea8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:08.835073 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-22e2c85f-314a-48b0-a9eb-20d4cef72ea8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:08.843373 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-22e2c85f-314a-48b0-a9eb-20d4cef72ea8 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/66c5742c-2f04-487c-aae2-f83e0f32b001" status: 200 len: 1264 microversion: 2.1 time: 0.151767 Oct 18 16:24:08.843954 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3346/6715] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:08 2022] GET /compute/v2.1/servers/66c5742c-2f04-487c-aae2-f83e0f32b001 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:24:09.653081 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-6fb54d55-f1a9-429e-a41c-d85dcdebb60d req-2472264c-2b9b-4abc-b75b-6248004f0455 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66c5742c-2f04-487c-aae2-f83e0f32b001", "name": "network-vif-plugged", "status": "completed", "tag": "28239217-9930-4530-94f1-71554fd01ca6"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:24:09.662555 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-6fb54d55-f1a9-429e-a41c-d85dcdebb60d req-2472264c-2b9b-4abc-b75b-6248004f0455 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:09.663049 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-6fb54d55-f1a9-429e-a41c-d85dcdebb60d req-2472264c-2b9b-4abc-b75b-6248004f0455 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:09.663497 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-6fb54d55-f1a9-429e-a41c-d85dcdebb60d req-2472264c-2b9b-4abc-b75b-6248004f0455 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:09.674867 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-6fb54d55-f1a9-429e-a41c-d85dcdebb60d req-2472264c-2b9b-4abc-b75b-6248004f0455 service nova] Creating event network-vif-plugged:28239217-9930-4530-94f1-71554fd01ca6 for instance 66c5742c-2f04-487c-aae2-f83e0f32b001 on n-h1-853682-5 Oct 18 16:24:09.680239 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-6fb54d55-f1a9-429e-a41c-d85dcdebb60d req-2472264c-2b9b-4abc-b75b-6248004f0455 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083484 Oct 18 16:24:09.680860 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3370/6716] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:24:09.866107 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7638887e-5626-4b4a-90c9-0aec41be82d7 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:09.866780 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7638887e-5626-4b4a-90c9-0aec41be82d7 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 66c5742c-2f04-487c-aae2-f83e0f32b001] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:09.873652 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7638887e-5626-4b4a-90c9-0aec41be82d7 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:09.874152 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7638887e-5626-4b4a-90c9-0aec41be82d7 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:09.874881 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7638887e-5626-4b4a-90c9-0aec41be82d7 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:09.875607 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7638887e-5626-4b4a-90c9-0aec41be82d7 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:09.876056 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7638887e-5626-4b4a-90c9-0aec41be82d7 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:09.876486 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7638887e-5626-4b4a-90c9-0aec41be82d7 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:10.013033 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7638887e-5626-4b4a-90c9-0aec41be82d7 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:10.020912 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7638887e-5626-4b4a-90c9-0aec41be82d7 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/66c5742c-2f04-487c-aae2-f83e0f32b001" status: 200 len: 1264 microversion: 2.1 time: 0.158748 Oct 18 16:24:10.021508 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3347/6717] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:09 2022] GET /compute/v2.1/servers/66c5742c-2f04-487c-aae2-f83e0f32b001 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:24:11.045796 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b73769db-ffd6-475b-ac87-9ee98da3a758 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:11.046568 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b73769db-ffd6-475b-ac87-9ee98da3a758 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 66c5742c-2f04-487c-aae2-f83e0f32b001] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:11.053085 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b73769db-ffd6-475b-ac87-9ee98da3a758 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:11.053580 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b73769db-ffd6-475b-ac87-9ee98da3a758 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:11.054026 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b73769db-ffd6-475b-ac87-9ee98da3a758 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:11.054730 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b73769db-ffd6-475b-ac87-9ee98da3a758 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:11.055191 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b73769db-ffd6-475b-ac87-9ee98da3a758 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:11.055661 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b73769db-ffd6-475b-ac87-9ee98da3a758 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:11.187944 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b73769db-ffd6-475b-ac87-9ee98da3a758 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:11.195722 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b73769db-ffd6-475b-ac87-9ee98da3a758 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/66c5742c-2f04-487c-aae2-f83e0f32b001" status: 200 len: 1264 microversion: 2.1 time: 0.155870 Oct 18 16:24:11.196303 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3371/6718] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:11 2022] GET /compute/v2.1/servers/66c5742c-2f04-487c-aae2-f83e0f32b001 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:24:12.218504 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-217c13a0-96e5-4a96-aa5a-fa9e982061a3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:12.219124 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-217c13a0-96e5-4a96-aa5a-fa9e982061a3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 66c5742c-2f04-487c-aae2-f83e0f32b001] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:12.226095 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-217c13a0-96e5-4a96-aa5a-fa9e982061a3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:12.226580 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-217c13a0-96e5-4a96-aa5a-fa9e982061a3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:12.227017 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-217c13a0-96e5-4a96-aa5a-fa9e982061a3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:12.227718 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-217c13a0-96e5-4a96-aa5a-fa9e982061a3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:12.228179 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-217c13a0-96e5-4a96-aa5a-fa9e982061a3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:12.228614 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-217c13a0-96e5-4a96-aa5a-fa9e982061a3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:12.369059 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-217c13a0-96e5-4a96-aa5a-fa9e982061a3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:12.377380 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-217c13a0-96e5-4a96-aa5a-fa9e982061a3 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/66c5742c-2f04-487c-aae2-f83e0f32b001" status: 200 len: 1450 microversion: 2.1 time: 0.163349 Oct 18 16:24:12.377991 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3348/6719] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:12 2022] GET /compute/v2.1/servers/66c5742c-2f04-487c-aae2-f83e0f32b001 => generated 1450 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:24:12.399719 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ef9a482e-a176-4d8f-a528-1c9c2a388dee tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:24:12.400360 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ef9a482e-a176-4d8f-a528-1c9c2a388dee tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 66c5742c-2f04-487c-aae2-f83e0f32b001] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:24:12.408189 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ef9a482e-a176-4d8f-a528-1c9c2a388dee tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:12.408630 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ef9a482e-a176-4d8f-a528-1c9c2a388dee tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:12.409128 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ef9a482e-a176-4d8f-a528-1c9c2a388dee tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:12.409842 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ef9a482e-a176-4d8f-a528-1c9c2a388dee tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:12.410320 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ef9a482e-a176-4d8f-a528-1c9c2a388dee tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:12.410764 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ef9a482e-a176-4d8f-a528-1c9c2a388dee tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:12.545657 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ef9a482e-a176-4d8f-a528-1c9c2a388dee tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:24:12.553813 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ef9a482e-a176-4d8f-a528-1c9c2a388dee tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/66c5742c-2f04-487c-aae2-f83e0f32b001" status: 200 len: 1450 microversion: 2.1 time: 0.157886 Oct 18 16:24:12.554511 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3372/6720] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:24:12 2022] GET /compute/v2.1/servers/66c5742c-2f04-487c-aae2-f83e0f32b001 => generated 1450 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:24:14.224758 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-bc636205-643a-4c2a-88c2-ee20998d6ca7 req-d5759b6f-7ff3-428f-b7d2-25dd8d26b8fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66c5742c-2f04-487c-aae2-f83e0f32b001", "tag": "28239217-9930-4530-94f1-71554fd01ca6"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:24:14.234938 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-bc636205-643a-4c2a-88c2-ee20998d6ca7 req-d5759b6f-7ff3-428f-b7d2-25dd8d26b8fa service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:24:14.235415 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-bc636205-643a-4c2a-88c2-ee20998d6ca7 req-d5759b6f-7ff3-428f-b7d2-25dd8d26b8fa service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:24:14.235855 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-bc636205-643a-4c2a-88c2-ee20998d6ca7 req-d5759b6f-7ff3-428f-b7d2-25dd8d26b8fa service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:24:14.247035 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-bc636205-643a-4c2a-88c2-ee20998d6ca7 req-d5759b6f-7ff3-428f-b7d2-25dd8d26b8fa service nova] Creating event network-changed:28239217-9930-4530-94f1-71554fd01ca6 for instance 66c5742c-2f04-487c-aae2-f83e0f32b001 on n-h1-853682-5 Oct 18 16:24:14.253324 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-bc636205-643a-4c2a-88c2-ee20998d6ca7 req-d5759b6f-7ff3-428f-b7d2-25dd8d26b8fa service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083013 Oct 18 16:24:14.253936 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3349/6721] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:25:43.866998 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=26 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:25:43.870060 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:25:43.871500 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=50 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:25:43.872292 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=48 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:25:43.873559 n-d-853682-5 devstack@n-api.service[120405]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 16:25:43.875009 n-d-853682-5 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 16:25:43.875130 n-d-853682-5 devstack@n-api.service[120405]: Tue Oct 18 16:25:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/66c5742c-2f04-487c-aae2-f83e0f32b001 (ip 10.222.0.60) !!! Oct 18 16:25:43.876075 n-d-853682-5 devstack@n-api.service[120406]: Tue Oct 18 16:25:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.60) !!! Oct 18 16:25:43.877044 n-d-853682-5 devstack@n-api.service[120405]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 16:25:43.877044 n-d-853682-5 devstack@n-api.service[120405]: Tue Oct 18 16:25:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/66c5742c-2f04-487c-aae2-f83e0f32b001 (ip 10.222.0.60) !!! Oct 18 16:25:43.884588 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-936abc6d-2b04-4db9-bd33-9185be52a7b9 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:43.885124 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-936abc6d-2b04-4db9-bd33-9185be52a7b9 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 66c5742c-2f04-487c-aae2-f83e0f32b001] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:43.889601 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-afc73b8f-84a4-4637-b7ae-d43be51ffe9b req-e2595400-983d-4475-a7e8-2fb1dfea88a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66c5742c-2f04-487c-aae2-f83e0f32b001", "tag": "28239217-9930-4530-94f1-71554fd01ca6"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:25:43.914503 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-936abc6d-2b04-4db9-bd33-9185be52a7b9 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:43.915202 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-936abc6d-2b04-4db9-bd33-9185be52a7b9 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:43.915636 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-936abc6d-2b04-4db9-bd33-9185be52a7b9 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:43.916429 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-936abc6d-2b04-4db9-bd33-9185be52a7b9 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:43.917009 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-936abc6d-2b04-4db9-bd33-9185be52a7b9 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:43.917495 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-afc73b8f-84a4-4637-b7ae-d43be51ffe9b req-e2595400-983d-4475-a7e8-2fb1dfea88a6 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:43.917645 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-936abc6d-2b04-4db9-bd33-9185be52a7b9 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:43.917988 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-afc73b8f-84a4-4637-b7ae-d43be51ffe9b req-e2595400-983d-4475-a7e8-2fb1dfea88a6 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:43.918423 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-afc73b8f-84a4-4637-b7ae-d43be51ffe9b req-e2595400-983d-4475-a7e8-2fb1dfea88a6 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:43.931656 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-afc73b8f-84a4-4637-b7ae-d43be51ffe9b req-e2595400-983d-4475-a7e8-2fb1dfea88a6 service nova] Creating event network-changed:28239217-9930-4530-94f1-71554fd01ca6 for instance 66c5742c-2f04-487c-aae2-f83e0f32b001 on n-h1-853682-5 Oct 18 16:25:43.937617 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-afc73b8f-84a4-4637-b7ae-d43be51ffe9b req-e2595400-983d-4475-a7e8-2fb1dfea88a6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073153 Oct 18 16:25:43.941351 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3350/6722] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:25:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:25:43.945208 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-936abc6d-2b04-4db9-bd33-9185be52a7b9 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 66c5742c-2f04-487c-aae2-f83e0f32b001] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:25:44.029689 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-936abc6d-2b04-4db9-bd33-9185be52a7b9 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "DELETE /compute/v2.1/servers/66c5742c-2f04-487c-aae2-f83e0f32b001" status: 204 len: 0 microversion: 2.1 time: 0.166876 Oct 18 16:25:44.032843 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3373/6723] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 16:25:43 2022] DELETE /compute/v2.1/servers/66c5742c-2f04-487c-aae2-f83e0f32b001 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:25:44.042512 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-17c4c660-f778-417e-8dab-4a38646dbe4f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:44.043256 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-17c4c660-f778-417e-8dab-4a38646dbe4f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 66c5742c-2f04-487c-aae2-f83e0f32b001] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:44.052624 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17c4c660-f778-417e-8dab-4a38646dbe4f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:44.053162 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17c4c660-f778-417e-8dab-4a38646dbe4f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:44.053601 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17c4c660-f778-417e-8dab-4a38646dbe4f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:44.054309 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17c4c660-f778-417e-8dab-4a38646dbe4f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:44.054771 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17c4c660-f778-417e-8dab-4a38646dbe4f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:44.055198 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17c4c660-f778-417e-8dab-4a38646dbe4f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:44.191585 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-17c4c660-f778-417e-8dab-4a38646dbe4f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:44.199787 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-17c4c660-f778-417e-8dab-4a38646dbe4f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/66c5742c-2f04-487c-aae2-f83e0f32b001" status: 200 len: 1574 microversion: 2.1 time: 0.164293 Oct 18 16:25:44.200310 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3351/6724] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:44 2022] GET /compute/v2.1/servers/66c5742c-2f04-487c-aae2-f83e0f32b001 => generated 1574 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:25:45.223926 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9dbcd7d7-1afc-47b0-83b2-c545bef9ee2d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:45.224649 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9dbcd7d7-1afc-47b0-83b2-c545bef9ee2d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 66c5742c-2f04-487c-aae2-f83e0f32b001] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:45.237084 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9dbcd7d7-1afc-47b0-83b2-c545bef9ee2d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:45.237595 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9dbcd7d7-1afc-47b0-83b2-c545bef9ee2d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:45.238141 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9dbcd7d7-1afc-47b0-83b2-c545bef9ee2d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:45.238895 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9dbcd7d7-1afc-47b0-83b2-c545bef9ee2d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:45.239369 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9dbcd7d7-1afc-47b0-83b2-c545bef9ee2d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:45.239804 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9dbcd7d7-1afc-47b0-83b2-c545bef9ee2d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:45.378335 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9dbcd7d7-1afc-47b0-83b2-c545bef9ee2d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:45.386924 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9dbcd7d7-1afc-47b0-83b2-c545bef9ee2d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/66c5742c-2f04-487c-aae2-f83e0f32b001" status: 200 len: 1574 microversion: 2.1 time: 0.167313 Oct 18 16:25:45.387513 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3374/6725] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:45 2022] GET /compute/v2.1/servers/66c5742c-2f04-487c-aae2-f83e0f32b001 => generated 1574 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:46.338443 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-4d198d92-dd28-40bd-8c53-d0b04ec6f952 req-9a2e3a0f-1081-4b74-a926-1b54362fa263 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66c5742c-2f04-487c-aae2-f83e0f32b001", "name": "network-vif-deleted", "tag": "28239217-9930-4530-94f1-71554fd01ca6"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:25:46.353600 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4d198d92-dd28-40bd-8c53-d0b04ec6f952 req-9a2e3a0f-1081-4b74-a926-1b54362fa263 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:46.354079 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4d198d92-dd28-40bd-8c53-d0b04ec6f952 req-9a2e3a0f-1081-4b74-a926-1b54362fa263 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:46.354502 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4d198d92-dd28-40bd-8c53-d0b04ec6f952 req-9a2e3a0f-1081-4b74-a926-1b54362fa263 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:46.366196 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-4d198d92-dd28-40bd-8c53-d0b04ec6f952 req-9a2e3a0f-1081-4b74-a926-1b54362fa263 service nova] Creating event network-vif-deleted:28239217-9930-4530-94f1-71554fd01ca6 for instance 66c5742c-2f04-487c-aae2-f83e0f32b001 on n-h1-853682-5 Oct 18 16:25:46.371289 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-4d198d92-dd28-40bd-8c53-d0b04ec6f952 req-9a2e3a0f-1081-4b74-a926-1b54362fa263 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036652 Oct 18 16:25:46.371894 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3352/6726] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:25:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:25:46.410846 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b209ac06-64e2-4302-9547-4ea45d47908e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:46.411654 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b209ac06-64e2-4302-9547-4ea45d47908e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 66c5742c-2f04-487c-aae2-f83e0f32b001] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:46.418463 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b209ac06-64e2-4302-9547-4ea45d47908e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:46.418961 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b209ac06-64e2-4302-9547-4ea45d47908e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:46.421584 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b209ac06-64e2-4302-9547-4ea45d47908e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:46.423109 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b209ac06-64e2-4302-9547-4ea45d47908e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:46.425338 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b209ac06-64e2-4302-9547-4ea45d47908e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:46.425799 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b209ac06-64e2-4302-9547-4ea45d47908e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:46.490506 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b209ac06-64e2-4302-9547-4ea45d47908e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:46.499328 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b209ac06-64e2-4302-9547-4ea45d47908e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/66c5742c-2f04-487c-aae2-f83e0f32b001" status: 200 len: 1224 microversion: 2.1 time: 0.092535 Oct 18 16:25:46.499916 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3375/6727] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:46 2022] GET /compute/v2.1/servers/66c5742c-2f04-487c-aae2-f83e0f32b001 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:47.524170 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4bb8cf78-0993-4d01-bd7f-3df55e8c337c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:47.524794 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4bb8cf78-0993-4d01-bd7f-3df55e8c337c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 66c5742c-2f04-487c-aae2-f83e0f32b001] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:47.533582 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4bb8cf78-0993-4d01-bd7f-3df55e8c337c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:47.534070 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4bb8cf78-0993-4d01-bd7f-3df55e8c337c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:47.534509 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4bb8cf78-0993-4d01-bd7f-3df55e8c337c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:47.535242 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4bb8cf78-0993-4d01-bd7f-3df55e8c337c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:47.535704 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4bb8cf78-0993-4d01-bd7f-3df55e8c337c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:47.536130 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4bb8cf78-0993-4d01-bd7f-3df55e8c337c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:47.599762 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4bb8cf78-0993-4d01-bd7f-3df55e8c337c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:47.608196 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4bb8cf78-0993-4d01-bd7f-3df55e8c337c tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/66c5742c-2f04-487c-aae2-f83e0f32b001" status: 200 len: 1224 microversion: 2.1 time: 0.089333 Oct 18 16:25:47.608783 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3353/6728] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:47 2022] GET /compute/v2.1/servers/66c5742c-2f04-487c-aae2-f83e0f32b001 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:48.631857 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b586b7bd-0099-4d46-8b5a-2103c8c0166f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:48.632483 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b586b7bd-0099-4d46-8b5a-2103c8c0166f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 66c5742c-2f04-487c-aae2-f83e0f32b001] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:48.639438 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b586b7bd-0099-4d46-8b5a-2103c8c0166f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:48.639949 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b586b7bd-0099-4d46-8b5a-2103c8c0166f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:48.640405 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b586b7bd-0099-4d46-8b5a-2103c8c0166f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:48.641156 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b586b7bd-0099-4d46-8b5a-2103c8c0166f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:48.641629 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b586b7bd-0099-4d46-8b5a-2103c8c0166f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:48.642071 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b586b7bd-0099-4d46-8b5a-2103c8c0166f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:48.709073 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b586b7bd-0099-4d46-8b5a-2103c8c0166f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:48.718657 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b586b7bd-0099-4d46-8b5a-2103c8c0166f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/66c5742c-2f04-487c-aae2-f83e0f32b001" status: 200 len: 1224 microversion: 2.1 time: 0.090653 Oct 18 16:25:48.719262 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3376/6729] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:48 2022] GET /compute/v2.1/servers/66c5742c-2f04-487c-aae2-f83e0f32b001 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:49.742109 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-df54b8d0-a6eb-443f-9314-c380a9bf401a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:49.742733 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-df54b8d0-a6eb-443f-9314-c380a9bf401a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 66c5742c-2f04-487c-aae2-f83e0f32b001] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:49.751882 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df54b8d0-a6eb-443f-9314-c380a9bf401a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:49.752374 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df54b8d0-a6eb-443f-9314-c380a9bf401a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:49.752850 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df54b8d0-a6eb-443f-9314-c380a9bf401a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:49.753553 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df54b8d0-a6eb-443f-9314-c380a9bf401a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:49.754017 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df54b8d0-a6eb-443f-9314-c380a9bf401a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:49.754447 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df54b8d0-a6eb-443f-9314-c380a9bf401a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:49.819043 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-df54b8d0-a6eb-443f-9314-c380a9bf401a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:49.827450 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-df54b8d0-a6eb-443f-9314-c380a9bf401a tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/66c5742c-2f04-487c-aae2-f83e0f32b001" status: 200 len: 1224 microversion: 2.1 time: 0.089420 Oct 18 16:25:49.828029 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3354/6730] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:49 2022] GET /compute/v2.1/servers/66c5742c-2f04-487c-aae2-f83e0f32b001 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:50.850582 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-907426a7-a0d4-4206-8e50-a373cc04f413 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:50.851343 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-907426a7-a0d4-4206-8e50-a373cc04f413 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 66c5742c-2f04-487c-aae2-f83e0f32b001] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:50.858964 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-907426a7-a0d4-4206-8e50-a373cc04f413 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:50.859475 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-907426a7-a0d4-4206-8e50-a373cc04f413 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:50.859929 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-907426a7-a0d4-4206-8e50-a373cc04f413 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:50.861858 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-907426a7-a0d4-4206-8e50-a373cc04f413 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:50.862340 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-907426a7-a0d4-4206-8e50-a373cc04f413 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:50.862789 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-907426a7-a0d4-4206-8e50-a373cc04f413 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:50.900508 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-907426a7-a0d4-4206-8e50-a373cc04f413 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:50.901049 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-907426a7-a0d4-4206-8e50-a373cc04f413 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:50.901502 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-907426a7-a0d4-4206-8e50-a373cc04f413 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:50.901963 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-907426a7-a0d4-4206-8e50-a373cc04f413 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lazy-loading 'fault' on Instance uuid 66c5742c-2f04-487c-aae2-f83e0f32b001 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:25:50.948188 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-907426a7-a0d4-4206-8e50-a373cc04f413 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:50.956366 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-907426a7-a0d4-4206-8e50-a373cc04f413 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/66c5742c-2f04-487c-aae2-f83e0f32b001" status: 200 len: 1229 microversion: 2.1 time: 0.109662 Oct 18 16:25:50.956985 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3377/6731] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:50 2022] GET /compute/v2.1/servers/66c5742c-2f04-487c-aae2-f83e0f32b001 => generated 1229 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:51.982582 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f3b2f904-e33e-442f-8a77-ea0d9ea6acf0 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:51.983190 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f3b2f904-e33e-442f-8a77-ea0d9ea6acf0 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 66c5742c-2f04-487c-aae2-f83e0f32b001] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:51.989963 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3b2f904-e33e-442f-8a77-ea0d9ea6acf0 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:51.990446 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3b2f904-e33e-442f-8a77-ea0d9ea6acf0 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:51.990880 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3b2f904-e33e-442f-8a77-ea0d9ea6acf0 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:51.991568 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3b2f904-e33e-442f-8a77-ea0d9ea6acf0 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:51.992023 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3b2f904-e33e-442f-8a77-ea0d9ea6acf0 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:51.992448 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3b2f904-e33e-442f-8a77-ea0d9ea6acf0 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:52.006201 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-f3b2f904-e33e-442f-8a77-ea0d9ea6acf0 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] HTTP exception thrown: Instance 66c5742c-2f04-487c-aae2-f83e0f32b001 could not be found. Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f3b2f904-e33e-442f-8a77-ea0d9ea6acf0 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Request method failure captured: Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/66c5742c-2f04-487c-aae2-f83e0f32b001 HTTP/1.1 Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTtEVF9uJ-JO9Xs31vnHSSsjSYlxrsUC5zmDUZwq19epJ_KRexhuRnv973VnMOHKUrtuEaLEal20PXz-3F2SqeQ_VcN02CwN6WkvucYcQaG_QXU6RKnbyMb6Baxa9c0pM4Y0eYUesqFYGvUA-9UWLfliXu3xhi5bS1_xU9JBCKzY9b2g Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: c05254b186b04c9cb9858f621938caca Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-TestVolumeBootPattern-1353957077 Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c05254b186b04c9cb9858f621938caca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c05254b186b04c9cb9858f621938caca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c05254b186b04c9cb9858f621938caca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c05254b186b04c9cb9858f621938caca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-TestVolumeBootPattern-1353957077 Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: c05254b186b04c9cb9858f621938caca Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-TestVolumeBootPattern-1353957077 Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-TestVolumeBootPattern-1353957077-project Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: b9f9ae9e929c416a9298499ab8694d37 Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-TestVolumeBootPattern-1353957077-project Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 66c5742c-2f04-487c-aae2-f83e0f32b001 could not be found. Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '66c5742c-2f04-487c-aae2-f83e0f32b001'} Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66c5742c-2f04-487c-aae2-f83e0f32b001 could not be found. Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66c5742c-2f04-487c-aae2-f83e0f32b001 could not be found. Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:25:52.007859 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:25:52.012499 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:25:52.012499 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:25:52.012499 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:25:52.012499 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:25:52.012499 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:25:52.012499 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66c5742c-2f04-487c-aae2-f83e0f32b001 could not be found. Oct 18 16:25:52.012499 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:25:52.012499 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f3b2f904-e33e-442f-8a77-ea0d9ea6acf0 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Returning 404 to user: Instance 66c5742c-2f04-487c-aae2-f83e0f32b001 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:25:52.012499 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f3b2f904-e33e-442f-8a77-ea0d9ea6acf0 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/66c5742c-2f04-487c-aae2-f83e0f32b001" status: 404 len: 111 microversion: 2.1 time: 0.030852 Oct 18 16:25:52.012499 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3355/6732] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:51 2022] GET /compute/v2.1/servers/66c5742c-2f04-487c-aae2-f83e0f32b001 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:25:58.221446 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f94b1da4-61eb-4349-9b2a-fdd88444ff0d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:58.221969 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f94b1da4-61eb-4349-9b2a-fdd88444ff0d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 71cc24f8-d82a-4b3c-82ee-420694d78ec8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:58.227427 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-7a7f0718-4a51-4c6d-bf24-f83a94f08514 req-d55c3007-9e21-4be1-b848-37b391016493 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71cc24f8-d82a-4b3c-82ee-420694d78ec8", "tag": "b78a0d69-7a19-4f63-8c19-9bf1c2aec74a"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:25:58.228234 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f94b1da4-61eb-4349-9b2a-fdd88444ff0d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:58.228747 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f94b1da4-61eb-4349-9b2a-fdd88444ff0d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:58.229244 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f94b1da4-61eb-4349-9b2a-fdd88444ff0d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:58.229964 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f94b1da4-61eb-4349-9b2a-fdd88444ff0d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:58.230437 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f94b1da4-61eb-4349-9b2a-fdd88444ff0d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:58.231065 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f94b1da4-61eb-4349-9b2a-fdd88444ff0d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:58.242658 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7a7f0718-4a51-4c6d-bf24-f83a94f08514 req-d55c3007-9e21-4be1-b848-37b391016493 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:58.243213 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7a7f0718-4a51-4c6d-bf24-f83a94f08514 req-d55c3007-9e21-4be1-b848-37b391016493 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:58.243872 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7a7f0718-4a51-4c6d-bf24-f83a94f08514 req-d55c3007-9e21-4be1-b848-37b391016493 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:58.254931 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-7a7f0718-4a51-4c6d-bf24-f83a94f08514 req-d55c3007-9e21-4be1-b848-37b391016493 service nova] Creating event network-changed:b78a0d69-7a19-4f63-8c19-9bf1c2aec74a for instance 71cc24f8-d82a-4b3c-82ee-420694d78ec8 on n-h2-853682-5 Oct 18 16:25:58.258553 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f94b1da4-61eb-4349-9b2a-fdd88444ff0d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 71cc24f8-d82a-4b3c-82ee-420694d78ec8] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:25:58.260310 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-7a7f0718-4a51-4c6d-bf24-f83a94f08514 req-d55c3007-9e21-4be1-b848-37b391016493 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038304 Oct 18 16:25:58.261421 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3356/6733] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:25:58.347494 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f94b1da4-61eb-4349-9b2a-fdd88444ff0d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "DELETE /compute/v2.1/servers/71cc24f8-d82a-4b3c-82ee-420694d78ec8" status: 204 len: 0 microversion: 2.1 time: 0.131529 Oct 18 16:25:58.348597 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3378/6734] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 16:25:58 2022] DELETE /compute/v2.1/servers/71cc24f8-d82a-4b3c-82ee-420694d78ec8 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 16:25:58.358808 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-146bf78d-6588-4674-81e8-72277ecca6df tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:58.359540 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-146bf78d-6588-4674-81e8-72277ecca6df tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 71cc24f8-d82a-4b3c-82ee-420694d78ec8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:58.365945 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-146bf78d-6588-4674-81e8-72277ecca6df tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:58.366436 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-146bf78d-6588-4674-81e8-72277ecca6df tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:58.366874 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-146bf78d-6588-4674-81e8-72277ecca6df tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:58.367928 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-146bf78d-6588-4674-81e8-72277ecca6df tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:58.368550 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-146bf78d-6588-4674-81e8-72277ecca6df tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:58.369022 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-146bf78d-6588-4674-81e8-72277ecca6df tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:58.536659 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-146bf78d-6588-4674-81e8-72277ecca6df tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:58.544776 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-146bf78d-6588-4674-81e8-72277ecca6df tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/71cc24f8-d82a-4b3c-82ee-420694d78ec8" status: 200 len: 1574 microversion: 2.1 time: 0.190605 Oct 18 16:25:58.545399 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3357/6735] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:58 2022] GET /compute/v2.1/servers/71cc24f8-d82a-4b3c-82ee-420694d78ec8 => generated 1574 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:25:59.571427 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-97bdd888-2cf3-4eb0-805e-af7724092c41 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:25:59.572149 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-97bdd888-2cf3-4eb0-805e-af7724092c41 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 71cc24f8-d82a-4b3c-82ee-420694d78ec8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:25:59.579608 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97bdd888-2cf3-4eb0-805e-af7724092c41 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:59.580107 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97bdd888-2cf3-4eb0-805e-af7724092c41 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:59.580556 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97bdd888-2cf3-4eb0-805e-af7724092c41 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:59.581306 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97bdd888-2cf3-4eb0-805e-af7724092c41 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:25:59.581778 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97bdd888-2cf3-4eb0-805e-af7724092c41 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:25:59.582234 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97bdd888-2cf3-4eb0-805e-af7724092c41 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:25:59.715985 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-97bdd888-2cf3-4eb0-805e-af7724092c41 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:25:59.724418 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-97bdd888-2cf3-4eb0-805e-af7724092c41 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/71cc24f8-d82a-4b3c-82ee-420694d78ec8" status: 200 len: 1574 microversion: 2.1 time: 0.157255 Oct 18 16:25:59.725013 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3379/6736] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:25:59 2022] GET /compute/v2.1/servers/71cc24f8-d82a-4b3c-82ee-420694d78ec8 => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:26:00.345221 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-dd7ca629-9657-4896-9372-7c64515f86b6 req-ff57301c-7729-41d8-b5cb-c16796ba7f5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71cc24f8-d82a-4b3c-82ee-420694d78ec8", "name": "network-vif-deleted", "tag": "b78a0d69-7a19-4f63-8c19-9bf1c2aec74a"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:26:00.359404 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-dd7ca629-9657-4896-9372-7c64515f86b6 req-ff57301c-7729-41d8-b5cb-c16796ba7f5a service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:00.359878 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-dd7ca629-9657-4896-9372-7c64515f86b6 req-ff57301c-7729-41d8-b5cb-c16796ba7f5a service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:00.360309 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-dd7ca629-9657-4896-9372-7c64515f86b6 req-ff57301c-7729-41d8-b5cb-c16796ba7f5a service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:00.374682 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-dd7ca629-9657-4896-9372-7c64515f86b6 req-ff57301c-7729-41d8-b5cb-c16796ba7f5a service nova] Creating event network-vif-deleted:b78a0d69-7a19-4f63-8c19-9bf1c2aec74a for instance 71cc24f8-d82a-4b3c-82ee-420694d78ec8 on n-h2-853682-5 Oct 18 16:26:00.379971 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-dd7ca629-9657-4896-9372-7c64515f86b6 req-ff57301c-7729-41d8-b5cb-c16796ba7f5a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038593 Oct 18 16:26:00.380780 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3358/6737] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:26:00.746866 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-408c7c1e-5cba-4483-aeac-1fb9ceacab14 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:00.747527 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-408c7c1e-5cba-4483-aeac-1fb9ceacab14 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 71cc24f8-d82a-4b3c-82ee-420694d78ec8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:00.757018 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-408c7c1e-5cba-4483-aeac-1fb9ceacab14 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:00.757589 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-408c7c1e-5cba-4483-aeac-1fb9ceacab14 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:00.758059 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-408c7c1e-5cba-4483-aeac-1fb9ceacab14 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:00.758792 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-408c7c1e-5cba-4483-aeac-1fb9ceacab14 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:00.759295 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-408c7c1e-5cba-4483-aeac-1fb9ceacab14 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:00.759746 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-408c7c1e-5cba-4483-aeac-1fb9ceacab14 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:00.825595 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-408c7c1e-5cba-4483-aeac-1fb9ceacab14 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:00.833552 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-408c7c1e-5cba-4483-aeac-1fb9ceacab14 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/71cc24f8-d82a-4b3c-82ee-420694d78ec8" status: 200 len: 1224 microversion: 2.1 time: 0.090750 Oct 18 16:26:00.834131 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3380/6738] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:00 2022] GET /compute/v2.1/servers/71cc24f8-d82a-4b3c-82ee-420694d78ec8 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:26:01.858538 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0c9e41af-57aa-4446-bbb1-8aaa74d38a87 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:01.859319 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0c9e41af-57aa-4446-bbb1-8aaa74d38a87 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 71cc24f8-d82a-4b3c-82ee-420694d78ec8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:01.865654 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c9e41af-57aa-4446-bbb1-8aaa74d38a87 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:01.866146 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c9e41af-57aa-4446-bbb1-8aaa74d38a87 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:01.866588 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c9e41af-57aa-4446-bbb1-8aaa74d38a87 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:01.867293 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c9e41af-57aa-4446-bbb1-8aaa74d38a87 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:01.867754 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c9e41af-57aa-4446-bbb1-8aaa74d38a87 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:01.868184 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c9e41af-57aa-4446-bbb1-8aaa74d38a87 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:01.934894 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0c9e41af-57aa-4446-bbb1-8aaa74d38a87 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:01.943796 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0c9e41af-57aa-4446-bbb1-8aaa74d38a87 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/71cc24f8-d82a-4b3c-82ee-420694d78ec8" status: 200 len: 1224 microversion: 2.1 time: 0.090310 Oct 18 16:26:01.944408 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3359/6739] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:01 2022] GET /compute/v2.1/servers/71cc24f8-d82a-4b3c-82ee-420694d78ec8 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:26:02.967446 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d3b63ce7-e93c-4f85-bf8a-8fccc10ece0d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:02.968082 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d3b63ce7-e93c-4f85-bf8a-8fccc10ece0d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 71cc24f8-d82a-4b3c-82ee-420694d78ec8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:02.974965 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d3b63ce7-e93c-4f85-bf8a-8fccc10ece0d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:02.975470 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d3b63ce7-e93c-4f85-bf8a-8fccc10ece0d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:02.975926 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d3b63ce7-e93c-4f85-bf8a-8fccc10ece0d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:02.976757 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d3b63ce7-e93c-4f85-bf8a-8fccc10ece0d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:02.977409 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d3b63ce7-e93c-4f85-bf8a-8fccc10ece0d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:02.977696 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d3b63ce7-e93c-4f85-bf8a-8fccc10ece0d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:03.043934 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d3b63ce7-e93c-4f85-bf8a-8fccc10ece0d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:03.052912 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d3b63ce7-e93c-4f85-bf8a-8fccc10ece0d tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/71cc24f8-d82a-4b3c-82ee-420694d78ec8" status: 200 len: 1224 microversion: 2.1 time: 0.089969 Oct 18 16:26:03.053494 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3381/6740] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:02 2022] GET /compute/v2.1/servers/71cc24f8-d82a-4b3c-82ee-420694d78ec8 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:26:04.075975 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-afbcf37d-2e10-4d99-ad35-de9670938fc2 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:04.076599 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-afbcf37d-2e10-4d99-ad35-de9670938fc2 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 71cc24f8-d82a-4b3c-82ee-420694d78ec8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:04.083566 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-afbcf37d-2e10-4d99-ad35-de9670938fc2 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:04.084053 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-afbcf37d-2e10-4d99-ad35-de9670938fc2 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:04.084495 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-afbcf37d-2e10-4d99-ad35-de9670938fc2 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:04.085339 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-afbcf37d-2e10-4d99-ad35-de9670938fc2 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:04.085813 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-afbcf37d-2e10-4d99-ad35-de9670938fc2 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:04.086335 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-afbcf37d-2e10-4d99-ad35-de9670938fc2 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:04.149412 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-afbcf37d-2e10-4d99-ad35-de9670938fc2 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f9ae9e929c416a9298499ab8694d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05254b186b04c9cb9858f621938caca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:04.157535 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-afbcf37d-2e10-4d99-ad35-de9670938fc2 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/71cc24f8-d82a-4b3c-82ee-420694d78ec8" status: 200 len: 1224 microversion: 2.1 time: 0.085598 Oct 18 16:26:04.158125 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3360/6741] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:04 2022] GET /compute/v2.1/servers/71cc24f8-d82a-4b3c-82ee-420694d78ec8 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:26:05.180787 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2996dd11-1118-4b3f-bc75-2be08555218e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:05.181450 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2996dd11-1118-4b3f-bc75-2be08555218e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 71cc24f8-d82a-4b3c-82ee-420694d78ec8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:05.188884 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2996dd11-1118-4b3f-bc75-2be08555218e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:05.189355 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2996dd11-1118-4b3f-bc75-2be08555218e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:05.189820 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2996dd11-1118-4b3f-bc75-2be08555218e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:05.190788 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2996dd11-1118-4b3f-bc75-2be08555218e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:05.191021 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2996dd11-1118-4b3f-bc75-2be08555218e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:05.191466 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2996dd11-1118-4b3f-bc75-2be08555218e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:05.207357 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-2996dd11-1118-4b3f-bc75-2be08555218e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] HTTP exception thrown: Instance 71cc24f8-d82a-4b3c-82ee-420694d78ec8 could not be found. Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2996dd11-1118-4b3f-bc75-2be08555218e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Request method failure captured: Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/71cc24f8-d82a-4b3c-82ee-420694d78ec8 HTTP/1.1 Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTtEVF9uJ-JO9Xs31vnHSSsjSYlxrsUC5zmDUZwq19epJ_KRexhuRnv973VnMOHKUrtuEaLEal20PXz-3F2SqeQ_VcN02CwN6WkvucYcQaG_QXU6RKnbyMb6Baxa9c0pM4Y0eYUesqFYGvUA-9UWLfliXu3xhi5bS1_xU9JBCKzY9b2g Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: c05254b186b04c9cb9858f621938caca Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-TestVolumeBootPattern-1353957077 Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c05254b186b04c9cb9858f621938caca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c05254b186b04c9cb9858f621938caca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c05254b186b04c9cb9858f621938caca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c05254b186b04c9cb9858f621938caca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-TestVolumeBootPattern-1353957077 Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: c05254b186b04c9cb9858f621938caca Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-TestVolumeBootPattern-1353957077 Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-TestVolumeBootPattern-1353957077-project Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: b9f9ae9e929c416a9298499ab8694d37 Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-TestVolumeBootPattern-1353957077-project Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 71cc24f8-d82a-4b3c-82ee-420694d78ec8 could not be found. Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '71cc24f8-d82a-4b3c-82ee-420694d78ec8'} Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71cc24f8-d82a-4b3c-82ee-420694d78ec8 could not be found. Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71cc24f8-d82a-4b3c-82ee-420694d78ec8 could not be found. Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:26:05.209076 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:26:05.213766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:26:05.213766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:26:05.213766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:26:05.213766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:26:05.213766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:26:05.213766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71cc24f8-d82a-4b3c-82ee-420694d78ec8 could not be found. Oct 18 16:26:05.213766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:26:05.213766 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2996dd11-1118-4b3f-bc75-2be08555218e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Returning 404 to user: Instance 71cc24f8-d82a-4b3c-82ee-420694d78ec8 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:26:05.213766 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2996dd11-1118-4b3f-bc75-2be08555218e tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/71cc24f8-d82a-4b3c-82ee-420694d78ec8" status: 404 len: 111 microversion: 2.1 time: 0.033784 Oct 18 16:26:05.213766 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3382/6742] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:05 2022] GET /compute/v2.1/servers/71cc24f8-d82a-4b3c-82ee-420694d78ec8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:26:05.653581 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-afa22bb9-9f20-463e-a1a5-6d66588dd201 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:05.654129 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-afa22bb9-9f20-463e-a1a5-6d66588dd201 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 3fe6a178-8709-4ae1-b6b7-4de54843c890] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:05.661526 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-afa22bb9-9f20-463e-a1a5-6d66588dd201 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:05.662013 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-afa22bb9-9f20-463e-a1a5-6d66588dd201 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:05.662449 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-afa22bb9-9f20-463e-a1a5-6d66588dd201 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:05.663141 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-afa22bb9-9f20-463e-a1a5-6d66588dd201 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:05.663603 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-afa22bb9-9f20-463e-a1a5-6d66588dd201 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:05.664028 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-afa22bb9-9f20-463e-a1a5-6d66588dd201 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:05.677838 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-afa22bb9-9f20-463e-a1a5-6d66588dd201 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] HTTP exception thrown: Instance 3fe6a178-8709-4ae1-b6b7-4de54843c890 could not be found. Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-afa22bb9-9f20-463e-a1a5-6d66588dd201 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Request method failure captured: Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890 HTTP/1.1 Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTtEVF9uJ-JO9Xs31vnHSSsjSYlxrsUC5zmDUZwq19epJ_KRexhuRnv973VnMOHKUrtuEaLEal20PXz-3F2SqeQ_VcN02CwN6WkvucYcQaG_QXU6RKnbyMb6Baxa9c0pM4Y0eYUesqFYGvUA-9UWLfliXu3xhi5bS1_xU9JBCKzY9b2g Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: c05254b186b04c9cb9858f621938caca Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-TestVolumeBootPattern-1353957077 Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c05254b186b04c9cb9858f621938caca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c05254b186b04c9cb9858f621938caca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c05254b186b04c9cb9858f621938caca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c05254b186b04c9cb9858f621938caca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-TestVolumeBootPattern-1353957077 Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: c05254b186b04c9cb9858f621938caca Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-TestVolumeBootPattern-1353957077 Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-TestVolumeBootPattern-1353957077-project Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: b9f9ae9e929c416a9298499ab8694d37 Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-TestVolumeBootPattern-1353957077-project Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 3fe6a178-8709-4ae1-b6b7-4de54843c890 could not be found. Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '3fe6a178-8709-4ae1-b6b7-4de54843c890'} Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fe6a178-8709-4ae1-b6b7-4de54843c890 could not be found. Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:26:05.679515 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:26:05.684166 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fe6a178-8709-4ae1-b6b7-4de54843c890 could not be found. Oct 18 16:26:05.684166 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:26:05.684166 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:26:05.684166 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:26:05.684166 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:26:05.684166 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:26:05.684166 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:26:05.684166 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:26:05.684166 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:26:05.684166 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fe6a178-8709-4ae1-b6b7-4de54843c890 could not be found. Oct 18 16:26:05.684166 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:26:05.684166 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-afa22bb9-9f20-463e-a1a5-6d66588dd201 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Returning 404 to user: Instance 3fe6a178-8709-4ae1-b6b7-4de54843c890 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:26:05.684166 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-afa22bb9-9f20-463e-a1a5-6d66588dd201 tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890" status: 404 len: 111 microversion: 2.1 time: 0.031310 Oct 18 16:26:05.684166 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3361/6743] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 16:26:05 2022] DELETE /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:26:05.689893 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-33568562-fbcd-4157-8b9d-964fcf35a3bc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:05.690540 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-33568562-fbcd-4157-8b9d-964fcf35a3bc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] [instance: 3fe6a178-8709-4ae1-b6b7-4de54843c890] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:05.696838 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-33568562-fbcd-4157-8b9d-964fcf35a3bc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:05.697372 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-33568562-fbcd-4157-8b9d-964fcf35a3bc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:05.697855 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-33568562-fbcd-4157-8b9d-964fcf35a3bc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:05.698577 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-33568562-fbcd-4157-8b9d-964fcf35a3bc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:05.699549 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-33568562-fbcd-4157-8b9d-964fcf35a3bc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:05.699670 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-33568562-fbcd-4157-8b9d-964fcf35a3bc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:05.713737 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-33568562-fbcd-4157-8b9d-964fcf35a3bc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] HTTP exception thrown: Instance 3fe6a178-8709-4ae1-b6b7-4de54843c890 could not be found. Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-33568562-fbcd-4157-8b9d-964fcf35a3bc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Request method failure captured: Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890 HTTP/1.1 Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTtEVF9uJ-JO9Xs31vnHSSsjSYlxrsUC5zmDUZwq19epJ_KRexhuRnv973VnMOHKUrtuEaLEal20PXz-3F2SqeQ_VcN02CwN6WkvucYcQaG_QXU6RKnbyMb6Baxa9c0pM4Y0eYUesqFYGvUA-9UWLfliXu3xhi5bS1_xU9JBCKzY9b2g Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: c05254b186b04c9cb9858f621938caca Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-TestVolumeBootPattern-1353957077 Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c05254b186b04c9cb9858f621938caca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c05254b186b04c9cb9858f621938caca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c05254b186b04c9cb9858f621938caca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c05254b186b04c9cb9858f621938caca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-TestVolumeBootPattern-1353957077 Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: c05254b186b04c9cb9858f621938caca Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-TestVolumeBootPattern-1353957077 Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-TestVolumeBootPattern-1353957077-project Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: b9f9ae9e929c416a9298499ab8694d37 Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-TestVolumeBootPattern-1353957077-project Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 3fe6a178-8709-4ae1-b6b7-4de54843c890 could not be found. Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '3fe6a178-8709-4ae1-b6b7-4de54843c890'} Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fe6a178-8709-4ae1-b6b7-4de54843c890 could not be found. Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fe6a178-8709-4ae1-b6b7-4de54843c890 could not be found. Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:26:05.715434 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:26:05.720066 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:26:05.720066 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:26:05.720066 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:26:05.720066 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:26:05.720066 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:26:05.720066 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fe6a178-8709-4ae1-b6b7-4de54843c890 could not be found. Oct 18 16:26:05.720066 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:26:05.720066 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-33568562-fbcd-4157-8b9d-964fcf35a3bc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Returning 404 to user: Instance 3fe6a178-8709-4ae1-b6b7-4de54843c890 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:26:05.720066 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-33568562-fbcd-4157-8b9d-964fcf35a3bc tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "GET /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890" status: 404 len: 111 microversion: 2.1 time: 0.030883 Oct 18 16:26:05.720066 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3383/6744] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:05 2022] GET /compute/v2.1/servers/3fe6a178-8709-4ae1-b6b7-4de54843c890 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:26:09.136951 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-86ae3ae2-27a9-46f3-8027-7ed7e0b04a1f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] Calling method '.version_select at 0x7f7c3d80b310>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:09.177560 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-86ae3ae2-27a9-46f3-8027-7ed7e0b04a1f tempest-TestVolumeBootPattern-1353957077 tempest-TestVolumeBootPattern-1353957077-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-649878017" status: 202 len: 0 microversion: 2.1 time: 0.044555 Oct 18 16:26:09.178150 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3362/6745] 10.222.0.60 () {58 vars in 1260 bytes} [Tue Oct 18 16:26:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-649878017 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:26:27.960422 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:26:27.961209 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:26:28.070237 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-74cc8dfb-864b-4e9b-8a79-205c9cd6f6c5 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-396170358", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:26:28.124153 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-74cc8dfb-864b-4e9b-8a79-205c9cd6f6c5 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] validate_networks() for None {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 16:26:28.419204 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-74cc8dfb-864b-4e9b-8a79-205c9cd6f6c5 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:26:28.419641 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-74cc8dfb-864b-4e9b-8a79-205c9cd6f6c5 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:26:28.420126 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-74cc8dfb-864b-4e9b-8a79-205c9cd6f6c5 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:26:28.420547 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-74cc8dfb-864b-4e9b-8a79-205c9cd6f6c5 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:26:28.420999 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-74cc8dfb-864b-4e9b-8a79-205c9cd6f6c5 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:26:28.430462 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-74cc8dfb-864b-4e9b-8a79-205c9cd6f6c5 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:28.430953 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-74cc8dfb-864b-4e9b-8a79-205c9cd6f6c5 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:28.431398 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-74cc8dfb-864b-4e9b-8a79-205c9cd6f6c5 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:28.432132 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-74cc8dfb-864b-4e9b-8a79-205c9cd6f6c5 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:28.432598 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-74cc8dfb-864b-4e9b-8a79-205c9cd6f6c5 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:28.433064 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-74cc8dfb-864b-4e9b-8a79-205c9cd6f6c5 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:28.452829 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-74cc8dfb-864b-4e9b-8a79-205c9cd6f6c5 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Getting quotas for project e63b1fa79e684a53a634647b641b8f1a. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:26:28.458771 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-74cc8dfb-864b-4e9b-8a79-205c9cd6f6c5 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Getting quotas for user 9827a3e1d0954108b9e8779115431795 and project e63b1fa79e684a53a634647b641b8f1a. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:26:28.472292 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-74cc8dfb-864b-4e9b-8a79-205c9cd6f6c5 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:26:28.474672 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-74cc8dfb-864b-4e9b-8a79-205c9cd6f6c5 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] [instance: 8caa4b31-ba1b-4cfe-987a-3b4b5be5058d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:26:28.522255 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-74cc8dfb-864b-4e9b-8a79-205c9cd6f6c5 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.566902 Oct 18 16:26:28.523102 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3384/6746] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 16:26:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:26:28.533207 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=48 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:26:28.534189 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:26:28.538693 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0182f7de-a6aa-48c4-bbf8-3f5232805bd5 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:28.539382 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0182f7de-a6aa-48c4-bbf8-3f5232805bd5 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] [instance: 8caa4b31-ba1b-4cfe-987a-3b4b5be5058d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:28.598198 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0182f7de-a6aa-48c4-bbf8-3f5232805bd5 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9827a3e1d0954108b9e8779115431795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63b1fa79e684a53a634647b641b8f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:28.605602 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0182f7de-a6aa-48c4-bbf8-3f5232805bd5 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] 10.222.0.60 "GET /compute/v2.1/servers/8caa4b31-ba1b-4cfe-987a-3b4b5be5058d" status: 200 len: 1221 microversion: 2.1 time: 0.074138 Oct 18 16:26:28.606185 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3363/6747] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:28 2022] GET /compute/v2.1/servers/8caa4b31-ba1b-4cfe-987a-3b4b5be5058d => generated 1221 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:26:29.630220 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-25ba1160-5f22-4270-aaaa-d9c276ca62ed tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:29.630860 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-25ba1160-5f22-4270-aaaa-d9c276ca62ed tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] [instance: 8caa4b31-ba1b-4cfe-987a-3b4b5be5058d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:29.641638 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-25ba1160-5f22-4270-aaaa-d9c276ca62ed tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:29.642498 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-25ba1160-5f22-4270-aaaa-d9c276ca62ed tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:29.643028 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-25ba1160-5f22-4270-aaaa-d9c276ca62ed tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:29.643837 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-25ba1160-5f22-4270-aaaa-d9c276ca62ed tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:29.644390 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-25ba1160-5f22-4270-aaaa-d9c276ca62ed tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:29.645339 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-25ba1160-5f22-4270-aaaa-d9c276ca62ed tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:29.716916 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-25ba1160-5f22-4270-aaaa-d9c276ca62ed tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9827a3e1d0954108b9e8779115431795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63b1fa79e684a53a634647b641b8f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:29.727932 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-25ba1160-5f22-4270-aaaa-d9c276ca62ed tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] 10.222.0.60 "GET /compute/v2.1/servers/8caa4b31-ba1b-4cfe-987a-3b4b5be5058d" status: 200 len: 1281 microversion: 2.1 time: 0.102738 Oct 18 16:26:29.745835 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3385/6748] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:29 2022] GET /compute/v2.1/servers/8caa4b31-ba1b-4cfe-987a-3b4b5be5058d => generated 1281 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:26:30.752747 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-22ea6bfb-c43b-4da7-8a9b-773f8337301f tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:30.753384 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-22ea6bfb-c43b-4da7-8a9b-773f8337301f tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] [instance: 8caa4b31-ba1b-4cfe-987a-3b4b5be5058d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:30.760187 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-22ea6bfb-c43b-4da7-8a9b-773f8337301f tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:30.760670 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-22ea6bfb-c43b-4da7-8a9b-773f8337301f tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:30.761144 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-22ea6bfb-c43b-4da7-8a9b-773f8337301f tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:30.761861 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-22ea6bfb-c43b-4da7-8a9b-773f8337301f tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:30.762470 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-22ea6bfb-c43b-4da7-8a9b-773f8337301f tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:30.762899 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-22ea6bfb-c43b-4da7-8a9b-773f8337301f tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:30.897043 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-22ea6bfb-c43b-4da7-8a9b-773f8337301f tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9827a3e1d0954108b9e8779115431795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63b1fa79e684a53a634647b641b8f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:30.904921 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-22ea6bfb-c43b-4da7-8a9b-773f8337301f tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] 10.222.0.60 "GET /compute/v2.1/servers/8caa4b31-ba1b-4cfe-987a-3b4b5be5058d" status: 200 len: 1321 microversion: 2.1 time: 0.156193 Oct 18 16:26:30.905803 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3364/6749] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:30 2022] GET /compute/v2.1/servers/8caa4b31-ba1b-4cfe-987a-3b4b5be5058d => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:26:31.173912 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-28e48e5e-4865-4acd-9c97-4ade141022c8 req-cc1f8265-333d-46a8-acce-26ecebde1536 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8caa4b31-ba1b-4cfe-987a-3b4b5be5058d", "tag": "8d5f90ee-91a6-407f-8ffb-7223ad273cca"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:26:31.186018 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-28e48e5e-4865-4acd-9c97-4ade141022c8 req-cc1f8265-333d-46a8-acce-26ecebde1536 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:31.187350 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-28e48e5e-4865-4acd-9c97-4ade141022c8 req-cc1f8265-333d-46a8-acce-26ecebde1536 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:31.187350 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-28e48e5e-4865-4acd-9c97-4ade141022c8 req-cc1f8265-333d-46a8-acce-26ecebde1536 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:31.198492 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-28e48e5e-4865-4acd-9c97-4ade141022c8 req-cc1f8265-333d-46a8-acce-26ecebde1536 service nova] Creating event network-changed:8d5f90ee-91a6-407f-8ffb-7223ad273cca for instance 8caa4b31-ba1b-4cfe-987a-3b4b5be5058d on n-h1-853682-5 Oct 18 16:26:31.205144 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-28e48e5e-4865-4acd-9c97-4ade141022c8 req-cc1f8265-333d-46a8-acce-26ecebde1536 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035316 Oct 18 16:26:31.206179 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3386/6750] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:26:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:26:31.928770 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3c9a4e26-1fc8-44b9-8017-2f80e1490456 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:31.929422 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3c9a4e26-1fc8-44b9-8017-2f80e1490456 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] [instance: 8caa4b31-ba1b-4cfe-987a-3b4b5be5058d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:31.936288 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c9a4e26-1fc8-44b9-8017-2f80e1490456 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:31.936779 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c9a4e26-1fc8-44b9-8017-2f80e1490456 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:31.937854 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c9a4e26-1fc8-44b9-8017-2f80e1490456 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:31.938550 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c9a4e26-1fc8-44b9-8017-2f80e1490456 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:31.939007 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c9a4e26-1fc8-44b9-8017-2f80e1490456 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:31.939434 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c9a4e26-1fc8-44b9-8017-2f80e1490456 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:32.069249 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3c9a4e26-1fc8-44b9-8017-2f80e1490456 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9827a3e1d0954108b9e8779115431795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63b1fa79e684a53a634647b641b8f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:32.076977 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3c9a4e26-1fc8-44b9-8017-2f80e1490456 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] 10.222.0.60 "GET /compute/v2.1/servers/8caa4b31-ba1b-4cfe-987a-3b4b5be5058d" status: 200 len: 1321 microversion: 2.1 time: 0.152143 Oct 18 16:26:32.077562 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3365/6751] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:31 2022] GET /compute/v2.1/servers/8caa4b31-ba1b-4cfe-987a-3b4b5be5058d => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:26:33.099460 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a7343cdd-e847-402f-8559-2ceaf20743bd tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:33.100186 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a7343cdd-e847-402f-8559-2ceaf20743bd tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] [instance: 8caa4b31-ba1b-4cfe-987a-3b4b5be5058d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:33.107307 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a7343cdd-e847-402f-8559-2ceaf20743bd tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:33.107816 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a7343cdd-e847-402f-8559-2ceaf20743bd tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:33.108285 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a7343cdd-e847-402f-8559-2ceaf20743bd tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:33.109035 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a7343cdd-e847-402f-8559-2ceaf20743bd tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:33.109517 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a7343cdd-e847-402f-8559-2ceaf20743bd tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:33.109967 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a7343cdd-e847-402f-8559-2ceaf20743bd tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:33.243818 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a7343cdd-e847-402f-8559-2ceaf20743bd tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9827a3e1d0954108b9e8779115431795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63b1fa79e684a53a634647b641b8f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:33.252475 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a7343cdd-e847-402f-8559-2ceaf20743bd tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] 10.222.0.60 "GET /compute/v2.1/servers/8caa4b31-ba1b-4cfe-987a-3b4b5be5058d" status: 200 len: 1321 microversion: 2.1 time: 0.157308 Oct 18 16:26:33.253145 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3387/6752] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:33 2022] GET /compute/v2.1/servers/8caa4b31-ba1b-4cfe-987a-3b4b5be5058d => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:26:34.275188 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fe8c82b4-f397-46c8-b391-8edbedd58f14 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:34.275787 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fe8c82b4-f397-46c8-b391-8edbedd58f14 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] [instance: 8caa4b31-ba1b-4cfe-987a-3b4b5be5058d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:34.282916 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe8c82b4-f397-46c8-b391-8edbedd58f14 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:34.283405 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe8c82b4-f397-46c8-b391-8edbedd58f14 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:34.283844 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe8c82b4-f397-46c8-b391-8edbedd58f14 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:34.284583 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe8c82b4-f397-46c8-b391-8edbedd58f14 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:34.285103 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe8c82b4-f397-46c8-b391-8edbedd58f14 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:34.285532 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe8c82b4-f397-46c8-b391-8edbedd58f14 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:34.414883 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fe8c82b4-f397-46c8-b391-8edbedd58f14 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9827a3e1d0954108b9e8779115431795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63b1fa79e684a53a634647b641b8f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:34.424611 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fe8c82b4-f397-46c8-b391-8edbedd58f14 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] 10.222.0.60 "GET /compute/v2.1/servers/8caa4b31-ba1b-4cfe-987a-3b4b5be5058d" status: 200 len: 1321 microversion: 2.1 time: 0.153310 Oct 18 16:26:34.425234 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3366/6753] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:34 2022] GET /compute/v2.1/servers/8caa4b31-ba1b-4cfe-987a-3b4b5be5058d => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:26:35.447296 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-93c8f140-3e6c-4e1c-8e92-1ff94b1c4a1c tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:35.447922 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-93c8f140-3e6c-4e1c-8e92-1ff94b1c4a1c tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] [instance: 8caa4b31-ba1b-4cfe-987a-3b4b5be5058d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:35.455195 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-93c8f140-3e6c-4e1c-8e92-1ff94b1c4a1c tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:35.455683 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-93c8f140-3e6c-4e1c-8e92-1ff94b1c4a1c tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:35.456129 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-93c8f140-3e6c-4e1c-8e92-1ff94b1c4a1c tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:35.456839 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-93c8f140-3e6c-4e1c-8e92-1ff94b1c4a1c tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:35.457308 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-93c8f140-3e6c-4e1c-8e92-1ff94b1c4a1c tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:35.457744 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-93c8f140-3e6c-4e1c-8e92-1ff94b1c4a1c tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:35.590811 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-93c8f140-3e6c-4e1c-8e92-1ff94b1c4a1c tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9827a3e1d0954108b9e8779115431795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63b1fa79e684a53a634647b641b8f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:35.599082 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-93c8f140-3e6c-4e1c-8e92-1ff94b1c4a1c tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] 10.222.0.60 "GET /compute/v2.1/servers/8caa4b31-ba1b-4cfe-987a-3b4b5be5058d" status: 200 len: 1321 microversion: 2.1 time: 0.155656 Oct 18 16:26:35.599660 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3388/6754] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:35 2022] GET /compute/v2.1/servers/8caa4b31-ba1b-4cfe-987a-3b4b5be5058d => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:26:36.179075 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-ea411766-91d7-4df0-b230-616020b20260 req-b8d3b801-8c65-464f-a838-bc41dea2b82c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8caa4b31-ba1b-4cfe-987a-3b4b5be5058d", "name": "network-vif-plugged", "status": "completed", "tag": "8d5f90ee-91a6-407f-8ffb-7223ad273cca"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:26:36.190323 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ea411766-91d7-4df0-b230-616020b20260 req-b8d3b801-8c65-464f-a838-bc41dea2b82c service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:36.190885 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ea411766-91d7-4df0-b230-616020b20260 req-b8d3b801-8c65-464f-a838-bc41dea2b82c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:36.191318 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ea411766-91d7-4df0-b230-616020b20260 req-b8d3b801-8c65-464f-a838-bc41dea2b82c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:36.203356 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-ea411766-91d7-4df0-b230-616020b20260 req-b8d3b801-8c65-464f-a838-bc41dea2b82c service nova] Creating event network-vif-plugged:8d5f90ee-91a6-407f-8ffb-7223ad273cca for instance 8caa4b31-ba1b-4cfe-987a-3b4b5be5058d on n-h1-853682-5 Oct 18 16:26:36.208298 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-ea411766-91d7-4df0-b230-616020b20260 req-b8d3b801-8c65-464f-a838-bc41dea2b82c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032945 Oct 18 16:26:36.209096 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3367/6755] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:26:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:26:36.621879 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6d8ad0cd-dcbd-4baa-9939-d9a591ba1792 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:36.622427 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6d8ad0cd-dcbd-4baa-9939-d9a591ba1792 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] [instance: 8caa4b31-ba1b-4cfe-987a-3b4b5be5058d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:36.629245 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6d8ad0cd-dcbd-4baa-9939-d9a591ba1792 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:36.629744 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6d8ad0cd-dcbd-4baa-9939-d9a591ba1792 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:36.630198 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6d8ad0cd-dcbd-4baa-9939-d9a591ba1792 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:36.630898 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6d8ad0cd-dcbd-4baa-9939-d9a591ba1792 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:36.631366 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6d8ad0cd-dcbd-4baa-9939-d9a591ba1792 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:36.631807 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6d8ad0cd-dcbd-4baa-9939-d9a591ba1792 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:36.763138 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6d8ad0cd-dcbd-4baa-9939-d9a591ba1792 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9827a3e1d0954108b9e8779115431795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63b1fa79e684a53a634647b641b8f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:36.771038 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6d8ad0cd-dcbd-4baa-9939-d9a591ba1792 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] 10.222.0.60 "GET /compute/v2.1/servers/8caa4b31-ba1b-4cfe-987a-3b4b5be5058d" status: 200 len: 1321 microversion: 2.1 time: 0.153155 Oct 18 16:26:36.771619 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3389/6756] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:36 2022] GET /compute/v2.1/servers/8caa4b31-ba1b-4cfe-987a-3b4b5be5058d => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:26:37.795574 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-de07dca9-f4d3-479d-bafe-3de6a5d2b26b tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:37.796920 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-de07dca9-f4d3-479d-bafe-3de6a5d2b26b tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] [instance: 8caa4b31-ba1b-4cfe-987a-3b4b5be5058d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:37.803590 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de07dca9-f4d3-479d-bafe-3de6a5d2b26b tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:37.804150 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de07dca9-f4d3-479d-bafe-3de6a5d2b26b tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:37.804664 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de07dca9-f4d3-479d-bafe-3de6a5d2b26b tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:37.805481 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de07dca9-f4d3-479d-bafe-3de6a5d2b26b tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:37.806162 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de07dca9-f4d3-479d-bafe-3de6a5d2b26b tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:37.806475 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de07dca9-f4d3-479d-bafe-3de6a5d2b26b tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:37.938477 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-de07dca9-f4d3-479d-bafe-3de6a5d2b26b tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9827a3e1d0954108b9e8779115431795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63b1fa79e684a53a634647b641b8f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:37.947254 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-de07dca9-f4d3-479d-bafe-3de6a5d2b26b tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] 10.222.0.60 "GET /compute/v2.1/servers/8caa4b31-ba1b-4cfe-987a-3b4b5be5058d" status: 200 len: 1471 microversion: 2.1 time: 0.156850 Oct 18 16:26:37.947790 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3368/6757] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:37 2022] GET /compute/v2.1/servers/8caa4b31-ba1b-4cfe-987a-3b4b5be5058d => generated 1471 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:26:38.021863 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a4b5c634-880d-4caf-b4e0-1fe959f863b6 tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] Calling method '.version_select at 0x7f7c3c0849d0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:38.086393 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a4b5c634-880d-4caf-b4e0-1fe959f863b6 tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/fe60e0dfaecb44d3bcd07ca685a32c5b" status: 200 len: 371 microversion: 2.1 time: 0.116882 Oct 18 16:26:38.086979 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3390/6758] 10.222.0.60 () {58 vars in 1242 bytes} [Tue Oct 18 16:26:37 2022] GET /compute/v2.1/os-quota-sets/fe60e0dfaecb44d3bcd07ca685a32c5b => generated 371 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:26:38.099836 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-45ea750e-4fb7-415b-887b-30b930ce36dc tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1979721452", "id": 1621343507, "os-flavor-access:is_public": "True"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:26:38.125011 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-45ea750e-4fb7-415b-887b-30b930ce36dc tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.028789 Oct 18 16:26:38.125615 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3369/6759] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 16:26:38 2022] POST /compute/v2.1/flavors => generated 438 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:26:38.137911 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3b1bc09a-b357-43af-ae23-c4cd108fcc08 tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1621343507"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:26:38.140245 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3b1bc09a-b357-43af-ae23-c4cd108fcc08 tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] [instance: 8caa4b31-ba1b-4cfe-987a-3b4b5be5058d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:38.146273 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3b1bc09a-b357-43af-ae23-c4cd108fcc08 tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:38.146773 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3b1bc09a-b357-43af-ae23-c4cd108fcc08 tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:38.147232 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3b1bc09a-b357-43af-ae23-c4cd108fcc08 tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:38.147939 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3b1bc09a-b357-43af-ae23-c4cd108fcc08 tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:38.148412 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3b1bc09a-b357-43af-ae23-c4cd108fcc08 tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:38.148878 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3b1bc09a-b357-43af-ae23-c4cd108fcc08 tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:38.355582 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3b1bc09a-b357-43af-ae23-c4cd108fcc08 tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '31d2507ace474f39859cd914f806ef1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe60e0dfaecb44d3bcd07ca685a32c5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:38.362708 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3b1bc09a-b357-43af-ae23-c4cd108fcc08 tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] [instance: 8caa4b31-ba1b-4cfe-987a-3b4b5be5058d] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1979721452 {{(pid=120405) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 18 16:26:38.369304 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3b1bc09a-b357-43af-ae23-c4cd108fcc08 tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:38.369799 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3b1bc09a-b357-43af-ae23-c4cd108fcc08 tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:38.370246 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3b1bc09a-b357-43af-ae23-c4cd108fcc08 tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:38.370986 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3b1bc09a-b357-43af-ae23-c4cd108fcc08 tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:38.371454 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3b1bc09a-b357-43af-ae23-c4cd108fcc08 tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:38.371892 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3b1bc09a-b357-43af-ae23-c4cd108fcc08 tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:38.391745 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-3b1bc09a-b357-43af-ae23-c4cd108fcc08 tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] Getting quotas for project e63b1fa79e684a53a634647b641b8f1a. Resources: {'cores', 'ram'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:26:38.396640 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-3b1bc09a-b357-43af-ae23-c4cd108fcc08 tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] Getting quotas for user 9827a3e1d0954108b9e8779115431795 and project e63b1fa79e684a53a634647b641b8f1a. Resources: {'cores', 'ram'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:26:38.409146 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.compute.api [None req-3b1bc09a-b357-43af-ae23-c4cd108fcc08 tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] ram quota exceeded for fe60e0dfaecb44d3bcd07ca685a32c5b, tried to resize instance. Oct 18 16:26:38.409697 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-3b1bc09a-b357-43af-ae23-c4cd108fcc08 tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3b1bc09a-b357-43af-ae23-c4cd108fcc08 tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] Request method failure captured: Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: request: POST /compute/v2.1/servers/8caa4b31-ba1b-4cfe-987a-3b4b5be5058d/action HTTP/1.1 Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 39 Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTtOzHLcFR4JeyKfMmbPnbF4RDgjPDwfWylo28Ju4_9r2YWdBwAtLlYr0e3tsmrcjaVKba-j9QEPAp5KaVaoT3Bth3YXEMf4Ez2yRfRznctalAsl7STUagzyGza7CNoZzHVcFnp-Vqn5Ye1kRqtTeOT_dlXuxRVP7KJRpXCee9GbvxfU Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: fe60e0dfaecb44d3bcd07ca685a32c5b Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1066137760 Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,admin,reader Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,admin,reader Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fe60e0dfaecb44d3bcd07ca685a32c5b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fe60e0dfaecb44d3bcd07ca685a32c5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/fe60e0dfaecb44d3bcd07ca685a32c5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_fe60e0dfaecb44d3bcd07ca685a32c5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1066137760 Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: fe60e0dfaecb44d3bcd07ca685a32c5b Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1066137760 Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServersAdminNegativeTestJSON-1066137760-project-admin Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 31d2507ace474f39859cd914f806ef1a Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1066137760-project-admin Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: {"resize": {"flavorRef": "1621343507"}} Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '8caa4b31-ba1b-4cfe-987a-3b4b5be5058d', 'body': {'resize': {'flavorRef': '1621343507'}}} Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 16:26:38.416234 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 18 16:26:38.421156 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 16:26:38.421156 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 18 16:26:38.421156 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 16:26:38.421156 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 16:26:38.421156 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 16:26:38.421156 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 18 16:26:38.421156 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 16:26:38.421156 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 18 16:26:38.421156 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 16:26:38.421156 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 18 16:26:38.421156 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 18 16:26:38.421156 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 18 16:26:38.421156 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 18 16:26:38.421156 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 18 16:26:38.421156 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:26:38.421156 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:26:38.421156 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:26:38.421156 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:26:38.421156 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:26:38.421156 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:26:38.421156 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:26:38.421156 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:26:38.421156 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:26:38.421156 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:26:38.421156 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:26:38.421156 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:26:38.421156 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 18 16:26:38.421156 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 18 16:26:38.421156 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 18 16:26:38.421156 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 18 16:26:38.421156 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 18 16:26:38.421156 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:26:38.421156 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:26:38.421156 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:26:38.421156 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:26:38.421156 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:26:38.421156 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:26:38.421156 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:26:38.421156 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:26:38.421156 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 18 16:26:38.421156 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:26:38.421156 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3b1bc09a-b357-43af-ae23-c4cd108fcc08 tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:26:38.421156 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3b1bc09a-b357-43af-ae23-c4cd108fcc08 tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/8caa4b31-ba1b-4cfe-987a-3b4b5be5058d/action" status: 403 len: 118 microversion: 2.1 time: 0.283735 Oct 18 16:26:38.425521 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3391/6760] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:26:38 2022] POST /compute/v2.1/servers/8caa4b31-ba1b-4cfe-987a-3b4b5be5058d/action => generated 118 bytes in 289 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:26:38.428016 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b1ddd6b8-48fd-4f65-b1c6-81eb1e41b4d5 tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:38.444923 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b1ddd6b8-48fd-4f65-b1c6-81eb1e41b4d5 tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/1621343507" status: 202 len: 0 microversion: 2.1 time: 0.021483 Oct 18 16:26:38.445507 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3370/6761] 10.222.0.60 () {58 vars in 1161 bytes} [Tue Oct 18 16:26:38 2022] DELETE /compute/v2.1/flavors/1621343507 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:26:38.453971 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-dae966f3-3099-40ec-9f25-208b87b5ff21 tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:38.475012 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-dae966f3-3099-40ec-9f25-208b87b5ff21 tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025219 Oct 18 16:26:38.475578 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3392/6762] 10.222.0.60 () {58 vars in 1146 bytes} [Tue Oct 18 16:26:38 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:26:38.495616 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-53a44996-970b-4a45-9ae8-9c69d1a5ac2d tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] Calling method '.version_select at 0x7f7c3c580f70>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:38.568314 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-53a44996-970b-4a45-9ae8-9c69d1a5ac2d tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/fe60e0dfaecb44d3bcd07ca685a32c5b" status: 200 len: 371 microversion: 2.1 time: 0.076442 Oct 18 16:26:38.569067 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3371/6763] 10.222.0.60 () {58 vars in 1242 bytes} [Tue Oct 18 16:26:38 2022] GET /compute/v2.1/os-quota-sets/fe60e0dfaecb44d3bcd07ca685a32c5b => generated 371 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:26:38.581133 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5668a816-69bb-4fbd-8766-b3d271b4d59a tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-371089743", "id": 1996758901, "os-flavor-access:is_public": "True"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:26:38.598311 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5668a816-69bb-4fbd-8766-b3d271b4d59a tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.021468 Oct 18 16:26:38.598878 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3393/6764] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 16:26:38 2022] POST /compute/v2.1/flavors => generated 436 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:26:38.611396 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-34c849b7-5be3-42ef-b6d2-782bfcc4f877 tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1996758901"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:26:38.613792 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-34c849b7-5be3-42ef-b6d2-782bfcc4f877 tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] [instance: 8caa4b31-ba1b-4cfe-987a-3b4b5be5058d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:38.619790 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34c849b7-5be3-42ef-b6d2-782bfcc4f877 tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:38.620274 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34c849b7-5be3-42ef-b6d2-782bfcc4f877 tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:38.620716 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34c849b7-5be3-42ef-b6d2-782bfcc4f877 tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:38.621439 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34c849b7-5be3-42ef-b6d2-782bfcc4f877 tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:38.621900 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34c849b7-5be3-42ef-b6d2-782bfcc4f877 tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:38.622329 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34c849b7-5be3-42ef-b6d2-782bfcc4f877 tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:38.708715 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-34c849b7-5be3-42ef-b6d2-782bfcc4f877 tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '31d2507ace474f39859cd914f806ef1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe60e0dfaecb44d3bcd07ca685a32c5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:38.714891 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-34c849b7-5be3-42ef-b6d2-782bfcc4f877 tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] [instance: 8caa4b31-ba1b-4cfe-987a-3b4b5be5058d] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-371089743 {{(pid=120406) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 18 16:26:38.721498 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34c849b7-5be3-42ef-b6d2-782bfcc4f877 tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:38.721968 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34c849b7-5be3-42ef-b6d2-782bfcc4f877 tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:38.722401 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34c849b7-5be3-42ef-b6d2-782bfcc4f877 tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:38.723115 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34c849b7-5be3-42ef-b6d2-782bfcc4f877 tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:38.723556 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34c849b7-5be3-42ef-b6d2-782bfcc4f877 tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:38.723970 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34c849b7-5be3-42ef-b6d2-782bfcc4f877 tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:38.744571 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-34c849b7-5be3-42ef-b6d2-782bfcc4f877 tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] Getting quotas for project e63b1fa79e684a53a634647b641b8f1a. Resources: {'cores', 'ram'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:26:38.750203 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-34c849b7-5be3-42ef-b6d2-782bfcc4f877 tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] Getting quotas for user 9827a3e1d0954108b9e8779115431795 and project e63b1fa79e684a53a634647b641b8f1a. Resources: {'cores', 'ram'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:26:38.763082 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.compute.api [None req-34c849b7-5be3-42ef-b6d2-782bfcc4f877 tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] cores quota exceeded for fe60e0dfaecb44d3bcd07ca685a32c5b, tried to resize instance. Oct 18 16:26:38.763604 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-34c849b7-5be3-42ef-b6d2-782bfcc4f877 tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-34c849b7-5be3-42ef-b6d2-782bfcc4f877 tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] Request method failure captured: Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers/8caa4b31-ba1b-4cfe-987a-3b4b5be5058d/action HTTP/1.1 Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 39 Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTtOzHLcFR4JeyKfMmbPnbF4RDgjPDwfWylo28Ju4_9r2YWdBwAtLlYr0e3tsmrcjaVKba-j9QEPAp5KaVaoT3Bth3YXEMf4Ez2yRfRznctalAsl7STUagzyGza7CNoZzHVcFnp-Vqn5Ye1kRqtTeOT_dlXuxRVP7KJRpXCee9GbvxfU Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: fe60e0dfaecb44d3bcd07ca685a32c5b Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1066137760 Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,admin,reader Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,admin,reader Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fe60e0dfaecb44d3bcd07ca685a32c5b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fe60e0dfaecb44d3bcd07ca685a32c5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/fe60e0dfaecb44d3bcd07ca685a32c5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_fe60e0dfaecb44d3bcd07ca685a32c5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1066137760 Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: fe60e0dfaecb44d3bcd07ca685a32c5b Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1066137760 Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersAdminNegativeTestJSON-1066137760-project-admin Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 31d2507ace474f39859cd914f806ef1a Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1066137760-project-admin Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: {"resize": {"flavorRef": "1996758901"}} Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '8caa4b31-ba1b-4cfe-987a-3b4b5be5058d', 'body': {'resize': {'flavorRef': '1996758901'}}} Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 16:26:38.765687 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 18 16:26:38.770168 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 16:26:38.770168 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 18 16:26:38.770168 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 16:26:38.770168 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 16:26:38.770168 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 16:26:38.770168 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 18 16:26:38.770168 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 16:26:38.770168 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 18 16:26:38.770168 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 16:26:38.770168 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 18 16:26:38.770168 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 18 16:26:38.770168 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 18 16:26:38.770168 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 18 16:26:38.770168 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 18 16:26:38.770168 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:26:38.770168 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:26:38.770168 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:26:38.770168 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:26:38.770168 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:26:38.770168 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:26:38.770168 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:26:38.770168 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:26:38.770168 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:26:38.770168 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:26:38.770168 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:26:38.770168 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:26:38.770168 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 18 16:26:38.770168 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 18 16:26:38.770168 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 18 16:26:38.770168 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 18 16:26:38.770168 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 18 16:26:38.770168 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:26:38.770168 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:26:38.770168 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:26:38.770168 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:26:38.770168 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:26:38.770168 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:26:38.770168 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:26:38.770168 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:26:38.770168 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 18 16:26:38.770168 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:26:38.770168 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-34c849b7-5be3-42ef-b6d2-782bfcc4f877 tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:26:38.770168 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-34c849b7-5be3-42ef-b6d2-782bfcc4f877 tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/8caa4b31-ba1b-4cfe-987a-3b4b5be5058d/action" status: 403 len: 113 microversion: 2.1 time: 0.160164 Oct 18 16:26:38.770168 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3372/6765] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:26:38 2022] POST /compute/v2.1/servers/8caa4b31-ba1b-4cfe-987a-3b4b5be5058d/action => generated 113 bytes in 161 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:26:38.775821 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5b76d5a5-1625-4b0e-bc19-70593e1d403b tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:38.792875 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5b76d5a5-1625-4b0e-bc19-70593e1d403b tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/1996758901" status: 202 len: 0 microversion: 2.1 time: 0.020770 Oct 18 16:26:38.793431 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3394/6766] 10.222.0.60 () {58 vars in 1161 bytes} [Tue Oct 18 16:26:38 2022] DELETE /compute/v2.1/flavors/1996758901 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 16:26:38.802135 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4f872ebe-a529-4331-9184-59561ac40637 tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:38.824447 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4f872ebe-a529-4331-9184-59561ac40637 tempest-ServersAdminNegativeTestJSON-1066137760 tempest-ServersAdminNegativeTestJSON-1066137760-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026300 Oct 18 16:26:38.825258 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3373/6767] 10.222.0.60 () {58 vars in 1146 bytes} [Tue Oct 18 16:26:38 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:26:38.846193 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-09b23825-d9f6-4b39-aee3-ac15d531d68d tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:38.846827 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-09b23825-d9f6-4b39-aee3-ac15d531d68d tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] [instance: 8caa4b31-ba1b-4cfe-987a-3b4b5be5058d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:38.852859 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09b23825-d9f6-4b39-aee3-ac15d531d68d tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:38.853370 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09b23825-d9f6-4b39-aee3-ac15d531d68d tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:38.853827 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09b23825-d9f6-4b39-aee3-ac15d531d68d tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:38.854722 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09b23825-d9f6-4b39-aee3-ac15d531d68d tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:38.855114 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09b23825-d9f6-4b39-aee3-ac15d531d68d tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:38.855555 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09b23825-d9f6-4b39-aee3-ac15d531d68d tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:38.881829 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-09b23825-d9f6-4b39-aee3-ac15d531d68d tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] [instance: 8caa4b31-ba1b-4cfe-987a-3b4b5be5058d] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:26:38.962505 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-09b23825-d9f6-4b39-aee3-ac15d531d68d tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8caa4b31-ba1b-4cfe-987a-3b4b5be5058d" status: 204 len: 0 microversion: 2.1 time: 0.120187 Oct 18 16:26:38.963354 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3395/6768] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 16:26:38 2022] DELETE /compute/v2.1/servers/8caa4b31-ba1b-4cfe-987a-3b4b5be5058d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:26:38.972230 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b0bda1eb-816c-47cd-80f8-52f9d120edf5 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:38.972883 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b0bda1eb-816c-47cd-80f8-52f9d120edf5 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] [instance: 8caa4b31-ba1b-4cfe-987a-3b4b5be5058d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:38.978897 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b0bda1eb-816c-47cd-80f8-52f9d120edf5 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:38.979380 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b0bda1eb-816c-47cd-80f8-52f9d120edf5 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:38.979868 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b0bda1eb-816c-47cd-80f8-52f9d120edf5 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:38.980568 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b0bda1eb-816c-47cd-80f8-52f9d120edf5 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:38.981135 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b0bda1eb-816c-47cd-80f8-52f9d120edf5 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:38.981714 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b0bda1eb-816c-47cd-80f8-52f9d120edf5 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:39.120880 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b0bda1eb-816c-47cd-80f8-52f9d120edf5 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9827a3e1d0954108b9e8779115431795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63b1fa79e684a53a634647b641b8f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:39.128650 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b0bda1eb-816c-47cd-80f8-52f9d120edf5 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] 10.222.0.60 "GET /compute/v2.1/servers/8caa4b31-ba1b-4cfe-987a-3b4b5be5058d" status: 200 len: 1477 microversion: 2.1 time: 0.161006 Oct 18 16:26:39.129258 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3374/6769] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:38 2022] GET /compute/v2.1/servers/8caa4b31-ba1b-4cfe-987a-3b4b5be5058d => generated 1477 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:26:40.151966 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c137ef39-9082-4eb4-9f5e-e788a2ed70ef tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:40.152690 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c137ef39-9082-4eb4-9f5e-e788a2ed70ef tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] [instance: 8caa4b31-ba1b-4cfe-987a-3b4b5be5058d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:40.159666 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c137ef39-9082-4eb4-9f5e-e788a2ed70ef tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:40.160168 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c137ef39-9082-4eb4-9f5e-e788a2ed70ef tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:40.160624 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c137ef39-9082-4eb4-9f5e-e788a2ed70ef tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:40.161375 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c137ef39-9082-4eb4-9f5e-e788a2ed70ef tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:40.161853 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c137ef39-9082-4eb4-9f5e-e788a2ed70ef tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:40.162877 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c137ef39-9082-4eb4-9f5e-e788a2ed70ef tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:40.293862 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c137ef39-9082-4eb4-9f5e-e788a2ed70ef tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9827a3e1d0954108b9e8779115431795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63b1fa79e684a53a634647b641b8f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:40.302456 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c137ef39-9082-4eb4-9f5e-e788a2ed70ef tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] 10.222.0.60 "GET /compute/v2.1/servers/8caa4b31-ba1b-4cfe-987a-3b4b5be5058d" status: 200 len: 1477 microversion: 2.1 time: 0.154833 Oct 18 16:26:40.303021 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3396/6770] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:40 2022] GET /compute/v2.1/servers/8caa4b31-ba1b-4cfe-987a-3b4b5be5058d => generated 1477 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:26:40.995888 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-6d5b33bf-d8fe-4979-8cd8-dfedaaca7fa0 req-4b962bef-1cb1-40f5-8cb9-0a2a25bc0ca1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8caa4b31-ba1b-4cfe-987a-3b4b5be5058d", "name": "network-vif-deleted", "tag": "8d5f90ee-91a6-407f-8ffb-7223ad273cca"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:26:41.011981 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6d5b33bf-d8fe-4979-8cd8-dfedaaca7fa0 req-4b962bef-1cb1-40f5-8cb9-0a2a25bc0ca1 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:41.012473 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6d5b33bf-d8fe-4979-8cd8-dfedaaca7fa0 req-4b962bef-1cb1-40f5-8cb9-0a2a25bc0ca1 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:41.012957 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6d5b33bf-d8fe-4979-8cd8-dfedaaca7fa0 req-4b962bef-1cb1-40f5-8cb9-0a2a25bc0ca1 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:41.026802 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-6d5b33bf-d8fe-4979-8cd8-dfedaaca7fa0 req-4b962bef-1cb1-40f5-8cb9-0a2a25bc0ca1 service nova] Creating event network-vif-deleted:8d5f90ee-91a6-407f-8ffb-7223ad273cca for instance 8caa4b31-ba1b-4cfe-987a-3b4b5be5058d on n-h1-853682-5 Oct 18 16:26:41.031892 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-6d5b33bf-d8fe-4979-8cd8-dfedaaca7fa0 req-4b962bef-1cb1-40f5-8cb9-0a2a25bc0ca1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039741 Oct 18 16:26:41.032512 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3375/6771] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:26:41.325812 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d77f59ce-94e1-4ebb-bfcc-ab7e8557bb56 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:41.326482 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d77f59ce-94e1-4ebb-bfcc-ab7e8557bb56 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] [instance: 8caa4b31-ba1b-4cfe-987a-3b4b5be5058d] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:41.333528 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d77f59ce-94e1-4ebb-bfcc-ab7e8557bb56 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:41.334026 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d77f59ce-94e1-4ebb-bfcc-ab7e8557bb56 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:41.334476 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d77f59ce-94e1-4ebb-bfcc-ab7e8557bb56 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:41.335209 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d77f59ce-94e1-4ebb-bfcc-ab7e8557bb56 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:41.335676 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d77f59ce-94e1-4ebb-bfcc-ab7e8557bb56 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:41.336115 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d77f59ce-94e1-4ebb-bfcc-ab7e8557bb56 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:41.367151 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d77f59ce-94e1-4ebb-bfcc-ab7e8557bb56 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:41.367638 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d77f59ce-94e1-4ebb-bfcc-ab7e8557bb56 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:41.368089 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d77f59ce-94e1-4ebb-bfcc-ab7e8557bb56 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:41.368544 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-d77f59ce-94e1-4ebb-bfcc-ab7e8557bb56 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Lazy-loading 'fault' on Instance uuid 8caa4b31-ba1b-4cfe-987a-3b4b5be5058d {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:26:41.414930 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d77f59ce-94e1-4ebb-bfcc-ab7e8557bb56 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9827a3e1d0954108b9e8779115431795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63b1fa79e684a53a634647b641b8f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:41.423886 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d77f59ce-94e1-4ebb-bfcc-ab7e8557bb56 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] 10.222.0.60 "GET /compute/v2.1/servers/8caa4b31-ba1b-4cfe-987a-3b4b5be5058d" status: 200 len: 1311 microversion: 2.1 time: 0.101588 Oct 18 16:26:41.424406 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3397/6772] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:41 2022] GET /compute/v2.1/servers/8caa4b31-ba1b-4cfe-987a-3b4b5be5058d => generated 1311 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:26:42.448302 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fc431bca-82f1-457a-acfa-b15c65385623 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:42.449032 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fc431bca-82f1-457a-acfa-b15c65385623 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] [instance: 8caa4b31-ba1b-4cfe-987a-3b4b5be5058d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:42.455312 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc431bca-82f1-457a-acfa-b15c65385623 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:42.455798 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc431bca-82f1-457a-acfa-b15c65385623 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:42.456238 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc431bca-82f1-457a-acfa-b15c65385623 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:42.456973 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc431bca-82f1-457a-acfa-b15c65385623 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:42.457440 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc431bca-82f1-457a-acfa-b15c65385623 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:42.457871 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc431bca-82f1-457a-acfa-b15c65385623 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:42.471611 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-fc431bca-82f1-457a-acfa-b15c65385623 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] HTTP exception thrown: Instance 8caa4b31-ba1b-4cfe-987a-3b4b5be5058d could not be found. Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fc431bca-82f1-457a-acfa-b15c65385623 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Request method failure captured: Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/8caa4b31-ba1b-4cfe-987a-3b4b5be5058d HTTP/1.1 Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTtOzIBDTKbZEXraRJavGMiLbpBHQXbXJeDry1QOV8ILkCNOI5GzNYq5S7SIJDkLz1Ioz8WNo_wMw6axbRQA-49o8LgrzSGvguUW_3eJCrsZ4_0A8Uo9MntI7IBsU21LN74rUIKhGsdEv0SRI4BMMSA0dbScAY144n_dqBs-MpY72LCg Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: e63b1fa79e684a53a634647b641b8f1a Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-208948784 Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e63b1fa79e684a53a634647b641b8f1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e63b1fa79e684a53a634647b641b8f1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e63b1fa79e684a53a634647b641b8f1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e63b1fa79e684a53a634647b641b8f1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersAdminNegativeTestJSON-208948784 Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: e63b1fa79e684a53a634647b641b8f1a Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-208948784 Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersAdminNegativeTestJSON-208948784-project Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 9827a3e1d0954108b9e8779115431795 Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersAdminNegativeTestJSON-208948784-project Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 8caa4b31-ba1b-4cfe-987a-3b4b5be5058d could not be found. Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '8caa4b31-ba1b-4cfe-987a-3b4b5be5058d'} Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8caa4b31-ba1b-4cfe-987a-3b4b5be5058d could not be found. Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8caa4b31-ba1b-4cfe-987a-3b4b5be5058d could not be found. Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:26:42.473274 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:26:42.477890 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:26:42.477890 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:26:42.477890 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:26:42.477890 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:26:42.477890 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:26:42.477890 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:26:42.477890 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8caa4b31-ba1b-4cfe-987a-3b4b5be5058d could not be found. Oct 18 16:26:42.477890 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:26:42.477890 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fc431bca-82f1-457a-acfa-b15c65385623 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] Returning 404 to user: Instance 8caa4b31-ba1b-4cfe-987a-3b4b5be5058d could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:26:42.477890 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fc431bca-82f1-457a-acfa-b15c65385623 tempest-ServersAdminNegativeTestJSON-208948784 tempest-ServersAdminNegativeTestJSON-208948784-project] 10.222.0.60 "GET /compute/v2.1/servers/8caa4b31-ba1b-4cfe-987a-3b4b5be5058d" status: 404 len: 111 microversion: 2.1 time: 0.031546 Oct 18 16:26:42.477890 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3376/6773] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:42 2022] GET /compute/v2.1/servers/8caa4b31-ba1b-4cfe-987a-3b4b5be5058d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:26:48.944404 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=8 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:26:48.945760 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=5 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:26:49.083033 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0449277f-40e0-4126-8182-e75dbdb26da6 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-994380910", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "593b4a56-5b71-49cc-9f8a-413b3e2e100b"}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:26:49.135849 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-0449277f-40e0-4126-8182-e75dbdb26da6 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] validate_networks() for [('593b4a56-5b71-49cc-9f8a-413b3e2e100b', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 16:26:49.535194 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-0449277f-40e0-4126-8182-e75dbdb26da6 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:26:49.535641 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-0449277f-40e0-4126-8182-e75dbdb26da6 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:26:49.536138 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-0449277f-40e0-4126-8182-e75dbdb26da6 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:26:49.536569 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-0449277f-40e0-4126-8182-e75dbdb26da6 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:26:49.537057 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-0449277f-40e0-4126-8182-e75dbdb26da6 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:26:49.550157 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0449277f-40e0-4126-8182-e75dbdb26da6 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:49.550656 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0449277f-40e0-4126-8182-e75dbdb26da6 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:49.551096 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0449277f-40e0-4126-8182-e75dbdb26da6 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:49.552048 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0449277f-40e0-4126-8182-e75dbdb26da6 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:49.552513 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0449277f-40e0-4126-8182-e75dbdb26da6 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:49.552983 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0449277f-40e0-4126-8182-e75dbdb26da6 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:49.570607 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-0449277f-40e0-4126-8182-e75dbdb26da6 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Getting quotas for project 92aba9915b39436bb3687f64395518c2. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:26:49.576021 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-0449277f-40e0-4126-8182-e75dbdb26da6 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Getting quotas for user afb6671f0e3545d9941c8142b22d3de3 and project 92aba9915b39436bb3687f64395518c2. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:26:49.589099 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0449277f-40e0-4126-8182-e75dbdb26da6 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:26:49.591438 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0449277f-40e0-4126-8182-e75dbdb26da6 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] [instance: 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:26:49.639557 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0449277f-40e0-4126-8182-e75dbdb26da6 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.701060 Oct 18 16:26:49.640281 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3398/6774] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 16:26:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:26:49.652322 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2250ffa9-8d0c-458f-b4ac-f31f3f0b8884 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:49.652980 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2250ffa9-8d0c-458f-b4ac-f31f3f0b8884 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] [instance: 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:49.657064 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:26:49.657956 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:26:49.723049 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2250ffa9-8d0c-458f-b4ac-f31f3f0b8884 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb6671f0e3545d9941c8142b22d3de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92aba9915b39436bb3687f64395518c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:49.731547 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2250ffa9-8d0c-458f-b4ac-f31f3f0b8884 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] 10.222.0.60 "GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b" status: 200 len: 1214 microversion: 2.1 time: 0.083198 Oct 18 16:26:49.732833 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3377/6775] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:49 2022] GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:26:50.758268 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1fa4b4c1-afe4-4d1e-bf76-5fe6b5503c7d tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:50.759021 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1fa4b4c1-afe4-4d1e-bf76-5fe6b5503c7d tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] [instance: 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:50.766637 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1fa4b4c1-afe4-4d1e-bf76-5fe6b5503c7d tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:50.767329 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1fa4b4c1-afe4-4d1e-bf76-5fe6b5503c7d tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:50.768676 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1fa4b4c1-afe4-4d1e-bf76-5fe6b5503c7d tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:50.769560 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1fa4b4c1-afe4-4d1e-bf76-5fe6b5503c7d tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:50.770194 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1fa4b4c1-afe4-4d1e-bf76-5fe6b5503c7d tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:50.770764 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1fa4b4c1-afe4-4d1e-bf76-5fe6b5503c7d tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:50.846863 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1fa4b4c1-afe4-4d1e-bf76-5fe6b5503c7d tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb6671f0e3545d9941c8142b22d3de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92aba9915b39436bb3687f64395518c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:50.857029 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1fa4b4c1-afe4-4d1e-bf76-5fe6b5503c7d tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] 10.222.0.60 "GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b" status: 200 len: 1266 microversion: 2.1 time: 0.105458 Oct 18 16:26:50.857851 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3399/6776] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:50 2022] GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b => generated 1266 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:26:51.881695 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3236d444-7792-443d-a748-7e1d87827a19 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:51.882311 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3236d444-7792-443d-a748-7e1d87827a19 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] [instance: 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:51.891209 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3236d444-7792-443d-a748-7e1d87827a19 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:51.891719 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3236d444-7792-443d-a748-7e1d87827a19 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:51.892159 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3236d444-7792-443d-a748-7e1d87827a19 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:51.893096 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3236d444-7792-443d-a748-7e1d87827a19 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:51.893905 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3236d444-7792-443d-a748-7e1d87827a19 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:51.894495 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3236d444-7792-443d-a748-7e1d87827a19 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:52.060731 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3236d444-7792-443d-a748-7e1d87827a19 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb6671f0e3545d9941c8142b22d3de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92aba9915b39436bb3687f64395518c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:52.069595 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3236d444-7792-443d-a748-7e1d87827a19 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] 10.222.0.60 "GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b" status: 200 len: 1314 microversion: 2.1 time: 0.191780 Oct 18 16:26:52.070796 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3378/6777] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:51 2022] GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:26:52.489366 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-bd2ffd24-70c6-414d-bdb5-ba91a12d5fba req-b212943a-e616-4bb6-80cf-94ed8eb602fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b", "tag": "75ef8e41-9d2a-435c-bc1d-48e9729ff18c"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:26:52.500157 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-bd2ffd24-70c6-414d-bdb5-ba91a12d5fba req-b212943a-e616-4bb6-80cf-94ed8eb602fc service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:52.500659 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-bd2ffd24-70c6-414d-bdb5-ba91a12d5fba req-b212943a-e616-4bb6-80cf-94ed8eb602fc service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:52.501112 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-bd2ffd24-70c6-414d-bdb5-ba91a12d5fba req-b212943a-e616-4bb6-80cf-94ed8eb602fc service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:52.512263 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-bd2ffd24-70c6-414d-bdb5-ba91a12d5fba req-b212943a-e616-4bb6-80cf-94ed8eb602fc service nova] Creating event network-changed:75ef8e41-9d2a-435c-bc1d-48e9729ff18c for instance 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b on n-h1-853682-5 Oct 18 16:26:52.517224 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-bd2ffd24-70c6-414d-bdb5-ba91a12d5fba req-b212943a-e616-4bb6-80cf-94ed8eb602fc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031540 Oct 18 16:26:52.517988 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3400/6778] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:26:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:26:53.093029 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3086400b-7aba-412a-b4c7-3a94ae2bc2a4 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:53.094496 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3086400b-7aba-412a-b4c7-3a94ae2bc2a4 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] [instance: 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:53.101812 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3086400b-7aba-412a-b4c7-3a94ae2bc2a4 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:53.102302 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3086400b-7aba-412a-b4c7-3a94ae2bc2a4 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:53.102742 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3086400b-7aba-412a-b4c7-3a94ae2bc2a4 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:53.103447 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3086400b-7aba-412a-b4c7-3a94ae2bc2a4 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:53.103944 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3086400b-7aba-412a-b4c7-3a94ae2bc2a4 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:53.104375 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3086400b-7aba-412a-b4c7-3a94ae2bc2a4 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:53.241195 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3086400b-7aba-412a-b4c7-3a94ae2bc2a4 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb6671f0e3545d9941c8142b22d3de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92aba9915b39436bb3687f64395518c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:53.249004 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3086400b-7aba-412a-b4c7-3a94ae2bc2a4 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] 10.222.0.60 "GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b" status: 200 len: 1314 microversion: 2.1 time: 0.159995 Oct 18 16:26:53.249588 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3379/6779] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:53 2022] GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:26:54.273837 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-34fd282f-d5b6-4b63-a9de-07fa3e73a5ba tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:54.274565 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-34fd282f-d5b6-4b63-a9de-07fa3e73a5ba tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] [instance: 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:54.281577 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-34fd282f-d5b6-4b63-a9de-07fa3e73a5ba tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:54.282111 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-34fd282f-d5b6-4b63-a9de-07fa3e73a5ba tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:54.282565 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-34fd282f-d5b6-4b63-a9de-07fa3e73a5ba tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:54.283282 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-34fd282f-d5b6-4b63-a9de-07fa3e73a5ba tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:54.283761 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-34fd282f-d5b6-4b63-a9de-07fa3e73a5ba tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:54.284209 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-34fd282f-d5b6-4b63-a9de-07fa3e73a5ba tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:54.418756 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-34fd282f-d5b6-4b63-a9de-07fa3e73a5ba tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb6671f0e3545d9941c8142b22d3de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92aba9915b39436bb3687f64395518c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:54.427002 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-34fd282f-d5b6-4b63-a9de-07fa3e73a5ba tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] 10.222.0.60 "GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b" status: 200 len: 1314 microversion: 2.1 time: 0.158516 Oct 18 16:26:54.427582 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3401/6780] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:54 2022] GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:26:55.450719 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9ac40767-aba5-4eed-acff-28f38f39ad42 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:55.451347 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9ac40767-aba5-4eed-acff-28f38f39ad42 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] [instance: 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:55.458676 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ac40767-aba5-4eed-acff-28f38f39ad42 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:55.459168 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ac40767-aba5-4eed-acff-28f38f39ad42 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:55.459608 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ac40767-aba5-4eed-acff-28f38f39ad42 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:55.460326 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ac40767-aba5-4eed-acff-28f38f39ad42 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:55.460790 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ac40767-aba5-4eed-acff-28f38f39ad42 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:55.461249 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ac40767-aba5-4eed-acff-28f38f39ad42 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:55.591521 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9ac40767-aba5-4eed-acff-28f38f39ad42 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb6671f0e3545d9941c8142b22d3de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92aba9915b39436bb3687f64395518c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:55.599866 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9ac40767-aba5-4eed-acff-28f38f39ad42 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] 10.222.0.60 "GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b" status: 200 len: 1314 microversion: 2.1 time: 0.153857 Oct 18 16:26:55.600443 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3380/6781] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:55 2022] GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:26:56.623048 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-103348be-a217-4b2d-ac00-a1ca14202d30 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:56.623690 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-103348be-a217-4b2d-ac00-a1ca14202d30 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] [instance: 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:56.630306 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-103348be-a217-4b2d-ac00-a1ca14202d30 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:56.630808 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-103348be-a217-4b2d-ac00-a1ca14202d30 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:56.631268 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-103348be-a217-4b2d-ac00-a1ca14202d30 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:56.632017 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-103348be-a217-4b2d-ac00-a1ca14202d30 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:56.632494 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-103348be-a217-4b2d-ac00-a1ca14202d30 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:56.632974 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-103348be-a217-4b2d-ac00-a1ca14202d30 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:56.775943 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-103348be-a217-4b2d-ac00-a1ca14202d30 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb6671f0e3545d9941c8142b22d3de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92aba9915b39436bb3687f64395518c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:56.784129 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-103348be-a217-4b2d-ac00-a1ca14202d30 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] 10.222.0.60 "GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b" status: 200 len: 1314 microversion: 2.1 time: 0.165656 Oct 18 16:26:56.784703 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3402/6782] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:56 2022] GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:26:57.807510 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f6494ca4-ffea-4738-ad57-5a7adb16122e tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:57.808256 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f6494ca4-ffea-4738-ad57-5a7adb16122e tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] [instance: 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:57.815832 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f6494ca4-ffea-4738-ad57-5a7adb16122e tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:57.816321 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f6494ca4-ffea-4738-ad57-5a7adb16122e tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:57.816760 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f6494ca4-ffea-4738-ad57-5a7adb16122e tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:57.817497 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f6494ca4-ffea-4738-ad57-5a7adb16122e tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:57.817956 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f6494ca4-ffea-4738-ad57-5a7adb16122e tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:57.818383 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f6494ca4-ffea-4738-ad57-5a7adb16122e tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:57.950842 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f6494ca4-ffea-4738-ad57-5a7adb16122e tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb6671f0e3545d9941c8142b22d3de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92aba9915b39436bb3687f64395518c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:57.959406 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f6494ca4-ffea-4738-ad57-5a7adb16122e tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] 10.222.0.60 "GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b" status: 200 len: 1314 microversion: 2.1 time: 0.155790 Oct 18 16:26:57.959989 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3381/6783] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:57 2022] GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:26:58.438035 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-c202acef-d515-4efd-9e7d-5ca694b337e0 req-218a6861-64f8-4d6b-8584-fb5de17effa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b", "name": "network-vif-plugged", "status": "completed", "tag": "75ef8e41-9d2a-435c-bc1d-48e9729ff18c"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:26:58.444580 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=7,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:26:58.450510 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-c202acef-d515-4efd-9e7d-5ca694b337e0 req-218a6861-64f8-4d6b-8584-fb5de17effa7 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:58.451011 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-c202acef-d515-4efd-9e7d-5ca694b337e0 req-218a6861-64f8-4d6b-8584-fb5de17effa7 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:58.451459 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-c202acef-d515-4efd-9e7d-5ca694b337e0 req-218a6861-64f8-4d6b-8584-fb5de17effa7 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:58.455460 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:26:58.466908 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-c202acef-d515-4efd-9e7d-5ca694b337e0 req-218a6861-64f8-4d6b-8584-fb5de17effa7 service nova] Creating event network-vif-plugged:75ef8e41-9d2a-435c-bc1d-48e9729ff18c for instance 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b on n-h1-853682-5 Oct 18 16:26:58.472853 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-c202acef-d515-4efd-9e7d-5ca694b337e0 req-218a6861-64f8-4d6b-8584-fb5de17effa7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038589 Oct 18 16:26:58.473459 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3403/6784] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:26:58.982955 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8a8be656-5b58-4524-9f49-1c90e575f48d tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:26:58.983496 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8a8be656-5b58-4524-9f49-1c90e575f48d tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] [instance: 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:26:58.986765 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:26:58.992165 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a8be656-5b58-4524-9f49-1c90e575f48d tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:58.992652 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a8be656-5b58-4524-9f49-1c90e575f48d tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:58.993121 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a8be656-5b58-4524-9f49-1c90e575f48d tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:58.993814 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a8be656-5b58-4524-9f49-1c90e575f48d tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:26:58.994270 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a8be656-5b58-4524-9f49-1c90e575f48d tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:26:58.994695 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a8be656-5b58-4524-9f49-1c90e575f48d tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:26:58.999834 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=74 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:26:59.128206 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8a8be656-5b58-4524-9f49-1c90e575f48d tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb6671f0e3545d9941c8142b22d3de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92aba9915b39436bb3687f64395518c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:26:59.135910 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8a8be656-5b58-4524-9f49-1c90e575f48d tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] 10.222.0.60 "GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b" status: 200 len: 1314 microversion: 2.1 time: 0.156948 Oct 18 16:26:59.136510 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3382/6785] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:26:58 2022] GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:00.157175 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:27:00.157979 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=6 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:27:00.162547 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bc9f3681-ba0a-4aec-8c87-b720111af33d tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:00.163260 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-bc9f3681-ba0a-4aec-8c87-b720111af33d tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] [instance: 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:00.171773 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bc9f3681-ba0a-4aec-8c87-b720111af33d tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:00.172266 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bc9f3681-ba0a-4aec-8c87-b720111af33d tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:00.172717 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bc9f3681-ba0a-4aec-8c87-b720111af33d tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:00.174209 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bc9f3681-ba0a-4aec-8c87-b720111af33d tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:00.174672 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bc9f3681-ba0a-4aec-8c87-b720111af33d tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:00.175110 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bc9f3681-ba0a-4aec-8c87-b720111af33d tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:00.309982 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-bc9f3681-ba0a-4aec-8c87-b720111af33d tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb6671f0e3545d9941c8142b22d3de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92aba9915b39436bb3687f64395518c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:00.318517 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-bc9f3681-ba0a-4aec-8c87-b720111af33d tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] 10.222.0.60 "GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b" status: 200 len: 1501 microversion: 2.1 time: 0.163154 Oct 18 16:27:00.319108 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3404/6786] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:00 2022] GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b => generated 1501 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:00.341268 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2275ce56-ee61-4049-a13f-f249a17c0960 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:27:00.343517 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2275ce56-ee61-4049-a13f-f249a17c0960 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] [instance: 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:00.345513 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:27:00.351499 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2275ce56-ee61-4049-a13f-f249a17c0960 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:00.351987 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2275ce56-ee61-4049-a13f-f249a17c0960 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:00.352425 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2275ce56-ee61-4049-a13f-f249a17c0960 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:00.353149 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2275ce56-ee61-4049-a13f-f249a17c0960 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:00.353609 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2275ce56-ee61-4049-a13f-f249a17c0960 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:00.354036 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2275ce56-ee61-4049-a13f-f249a17c0960 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:00.383119 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2275ce56-ee61-4049-a13f-f249a17c0960 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'afb6671f0e3545d9941c8142b22d3de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92aba9915b39436bb3687f64395518c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:00.388802 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2275ce56-ee61-4049-a13f-f249a17c0960 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] [instance: 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b] Old instance type m1.heat2, new instance type m1.heat {{(pid=120406) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 18 16:27:00.395383 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-2275ce56-ee61-4049-a13f-f249a17c0960 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:27:00.395812 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-2275ce56-ee61-4049-a13f-f249a17c0960 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:27:00.396290 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-2275ce56-ee61-4049-a13f-f249a17c0960 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:27:00.396702 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-2275ce56-ee61-4049-a13f-f249a17c0960 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:27:00.397149 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-2275ce56-ee61-4049-a13f-f249a17c0960 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:27:00.458857 n-d-853682-5 devstack@n-api.service[120406]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2275ce56-ee61-4049-a13f-f249a17c0960 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] [15ae3e35-725d-454e-98c3-d97b19cb1781] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 16:27:01.465635 n-d-853682-5 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [None req-2275ce56-ee61-4049-a13f-f249a17c0960 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] [15ae3e35-725d-454e-98c3-d97b19cb1781] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 38210. Oct 18 16:27:01.468757 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2275ce56-ee61-4049-a13f-f249a17c0960 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] 10.222.0.60 "POST /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b/action" status: 202 len: 0 microversion: 2.1 time: 1.131575 Oct 18 16:27:01.469413 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3383/6787] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:27:00 2022] POST /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b/action => generated 0 bytes in 1133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:27:01.478189 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5f4121c7-e93d-4b6f-91f0-5ba363cfe99b tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:01.478826 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5f4121c7-e93d-4b6f-91f0-5ba363cfe99b tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] [instance: 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:01.485747 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5f4121c7-e93d-4b6f-91f0-5ba363cfe99b tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:01.486920 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5f4121c7-e93d-4b6f-91f0-5ba363cfe99b tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:01.487375 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5f4121c7-e93d-4b6f-91f0-5ba363cfe99b tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:01.488095 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5f4121c7-e93d-4b6f-91f0-5ba363cfe99b tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:01.488575 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5f4121c7-e93d-4b6f-91f0-5ba363cfe99b tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:01.489044 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5f4121c7-e93d-4b6f-91f0-5ba363cfe99b tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:01.660914 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5f4121c7-e93d-4b6f-91f0-5ba363cfe99b tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb6671f0e3545d9941c8142b22d3de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92aba9915b39436bb3687f64395518c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:01.668860 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5f4121c7-e93d-4b6f-91f0-5ba363cfe99b tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] 10.222.0.60 "GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b" status: 200 len: 1510 microversion: 2.1 time: 0.194673 Oct 18 16:27:01.669641 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3405/6788] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:01 2022] GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b => generated 1510 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:02.693113 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6af6756d-8270-457f-806d-6ac1970705ab tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:02.693831 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6af6756d-8270-457f-806d-6ac1970705ab tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] [instance: 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:02.701147 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6af6756d-8270-457f-806d-6ac1970705ab tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:02.701721 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6af6756d-8270-457f-806d-6ac1970705ab tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:02.702225 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6af6756d-8270-457f-806d-6ac1970705ab tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:02.702997 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6af6756d-8270-457f-806d-6ac1970705ab tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:02.703457 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6af6756d-8270-457f-806d-6ac1970705ab tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:02.703883 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6af6756d-8270-457f-806d-6ac1970705ab tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:02.834766 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6af6756d-8270-457f-806d-6ac1970705ab tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb6671f0e3545d9941c8142b22d3de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92aba9915b39436bb3687f64395518c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:02.842944 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6af6756d-8270-457f-806d-6ac1970705ab tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] 10.222.0.60 "GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b" status: 200 len: 1510 microversion: 2.1 time: 0.155299 Oct 18 16:27:02.843525 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3384/6789] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:02 2022] GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:03.867409 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-349c1fc5-b3a5-4367-a8d1-24715a4fc97a tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:03.868044 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-349c1fc5-b3a5-4367-a8d1-24715a4fc97a tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] [instance: 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:03.874968 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-349c1fc5-b3a5-4367-a8d1-24715a4fc97a tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:03.875468 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-349c1fc5-b3a5-4367-a8d1-24715a4fc97a tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:03.875914 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-349c1fc5-b3a5-4367-a8d1-24715a4fc97a tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:03.877168 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-349c1fc5-b3a5-4367-a8d1-24715a4fc97a tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:03.877635 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-349c1fc5-b3a5-4367-a8d1-24715a4fc97a tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:03.878078 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-349c1fc5-b3a5-4367-a8d1-24715a4fc97a tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:04.006981 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-349c1fc5-b3a5-4367-a8d1-24715a4fc97a tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb6671f0e3545d9941c8142b22d3de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92aba9915b39436bb3687f64395518c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:04.014724 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-349c1fc5-b3a5-4367-a8d1-24715a4fc97a tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] 10.222.0.60 "GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b" status: 200 len: 1515 microversion: 2.1 time: 0.151254 Oct 18 16:27:04.015296 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3406/6790] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:03 2022] GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:05.039742 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-38b9e3b4-0f75-45c7-a35c-3235e6940790 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:05.040352 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-38b9e3b4-0f75-45c7-a35c-3235e6940790 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] [instance: 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:05.047291 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-38b9e3b4-0f75-45c7-a35c-3235e6940790 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:05.047771 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-38b9e3b4-0f75-45c7-a35c-3235e6940790 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:05.049120 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-38b9e3b4-0f75-45c7-a35c-3235e6940790 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:05.049809 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-38b9e3b4-0f75-45c7-a35c-3235e6940790 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:05.050268 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-38b9e3b4-0f75-45c7-a35c-3235e6940790 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:05.050688 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-38b9e3b4-0f75-45c7-a35c-3235e6940790 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:05.185863 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-38b9e3b4-0f75-45c7-a35c-3235e6940790 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb6671f0e3545d9941c8142b22d3de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92aba9915b39436bb3687f64395518c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:05.193667 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-38b9e3b4-0f75-45c7-a35c-3235e6940790 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] 10.222.0.60 "GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b" status: 200 len: 1515 microversion: 2.1 time: 0.158148 Oct 18 16:27:05.194296 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3385/6791] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:05 2022] GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:06.216702 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-64e94311-c54e-4350-8612-a051ad83a881 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:06.217275 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-64e94311-c54e-4350-8612-a051ad83a881 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] [instance: 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:06.224118 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-64e94311-c54e-4350-8612-a051ad83a881 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:06.224619 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-64e94311-c54e-4350-8612-a051ad83a881 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:06.225108 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-64e94311-c54e-4350-8612-a051ad83a881 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:06.225824 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-64e94311-c54e-4350-8612-a051ad83a881 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:06.226298 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-64e94311-c54e-4350-8612-a051ad83a881 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:06.226743 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-64e94311-c54e-4350-8612-a051ad83a881 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:06.358283 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-64e94311-c54e-4350-8612-a051ad83a881 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb6671f0e3545d9941c8142b22d3de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92aba9915b39436bb3687f64395518c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:06.366551 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-64e94311-c54e-4350-8612-a051ad83a881 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] 10.222.0.60 "GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b" status: 200 len: 1515 microversion: 2.1 time: 0.153899 Oct 18 16:27:06.367176 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3407/6792] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:06 2022] GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:07.389447 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2f77dd59-6630-426f-b795-fa43c9eeff19 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:07.389988 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2f77dd59-6630-426f-b795-fa43c9eeff19 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] [instance: 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:07.396906 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f77dd59-6630-426f-b795-fa43c9eeff19 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:07.397336 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f77dd59-6630-426f-b795-fa43c9eeff19 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:07.397797 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f77dd59-6630-426f-b795-fa43c9eeff19 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:07.398475 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f77dd59-6630-426f-b795-fa43c9eeff19 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:07.398933 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f77dd59-6630-426f-b795-fa43c9eeff19 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:07.399362 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f77dd59-6630-426f-b795-fa43c9eeff19 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:07.530372 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2f77dd59-6630-426f-b795-fa43c9eeff19 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb6671f0e3545d9941c8142b22d3de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92aba9915b39436bb3687f64395518c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:07.538124 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2f77dd59-6630-426f-b795-fa43c9eeff19 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] 10.222.0.60 "GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b" status: 200 len: 1515 microversion: 2.1 time: 0.152698 Oct 18 16:27:07.538699 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3386/6793] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:07 2022] GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:08.561146 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-74b89e98-607b-40a8-bd39-700b7d8a40e9 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:08.561780 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-74b89e98-607b-40a8-bd39-700b7d8a40e9 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] [instance: 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:08.569230 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-74b89e98-607b-40a8-bd39-700b7d8a40e9 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:08.569725 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-74b89e98-607b-40a8-bd39-700b7d8a40e9 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:08.570173 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-74b89e98-607b-40a8-bd39-700b7d8a40e9 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:08.570878 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-74b89e98-607b-40a8-bd39-700b7d8a40e9 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:08.571349 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-74b89e98-607b-40a8-bd39-700b7d8a40e9 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:08.571785 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-74b89e98-607b-40a8-bd39-700b7d8a40e9 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:08.704356 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-74b89e98-607b-40a8-bd39-700b7d8a40e9 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb6671f0e3545d9941c8142b22d3de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92aba9915b39436bb3687f64395518c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:08.712088 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-74b89e98-607b-40a8-bd39-700b7d8a40e9 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] 10.222.0.60 "GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b" status: 200 len: 1515 microversion: 2.1 time: 0.154951 Oct 18 16:27:08.712684 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3408/6794] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:08 2022] GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:09.735173 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f455a6cc-57b9-48c5-81e1-601134687a74 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:09.736476 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f455a6cc-57b9-48c5-81e1-601134687a74 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] [instance: 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:09.743253 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f455a6cc-57b9-48c5-81e1-601134687a74 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:09.743727 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f455a6cc-57b9-48c5-81e1-601134687a74 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:09.744154 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f455a6cc-57b9-48c5-81e1-601134687a74 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:09.744856 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f455a6cc-57b9-48c5-81e1-601134687a74 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:09.745313 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f455a6cc-57b9-48c5-81e1-601134687a74 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:09.745730 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f455a6cc-57b9-48c5-81e1-601134687a74 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:09.876433 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f455a6cc-57b9-48c5-81e1-601134687a74 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb6671f0e3545d9941c8142b22d3de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92aba9915b39436bb3687f64395518c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:09.884229 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f455a6cc-57b9-48c5-81e1-601134687a74 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] 10.222.0.60 "GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b" status: 200 len: 1515 microversion: 2.1 time: 0.152942 Oct 18 16:27:09.884838 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3387/6795] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:09 2022] GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:10.908627 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b4343e3c-6b76-4ee4-9d02-2f7ed371fbaf tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:10.909335 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b4343e3c-6b76-4ee4-9d02-2f7ed371fbaf tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] [instance: 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:10.916333 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b4343e3c-6b76-4ee4-9d02-2f7ed371fbaf tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:10.916860 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b4343e3c-6b76-4ee4-9d02-2f7ed371fbaf tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:10.917322 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b4343e3c-6b76-4ee4-9d02-2f7ed371fbaf tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:10.918033 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b4343e3c-6b76-4ee4-9d02-2f7ed371fbaf tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:10.918505 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b4343e3c-6b76-4ee4-9d02-2f7ed371fbaf tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:10.918947 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b4343e3c-6b76-4ee4-9d02-2f7ed371fbaf tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:11.049229 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b4343e3c-6b76-4ee4-9d02-2f7ed371fbaf tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb6671f0e3545d9941c8142b22d3de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92aba9915b39436bb3687f64395518c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:11.057031 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b4343e3c-6b76-4ee4-9d02-2f7ed371fbaf tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] 10.222.0.60 "GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b" status: 200 len: 1515 microversion: 2.1 time: 0.152307 Oct 18 16:27:11.057609 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3409/6796] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:10 2022] GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:12.081364 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2e99d821-0e86-4492-a1f0-e8981e36eee7 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:12.081364 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2e99d821-0e86-4492-a1f0-e8981e36eee7 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] [instance: 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:12.088751 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e99d821-0e86-4492-a1f0-e8981e36eee7 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:12.089291 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e99d821-0e86-4492-a1f0-e8981e36eee7 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:12.089713 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e99d821-0e86-4492-a1f0-e8981e36eee7 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:12.090423 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e99d821-0e86-4492-a1f0-e8981e36eee7 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:12.090884 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e99d821-0e86-4492-a1f0-e8981e36eee7 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:12.091323 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e99d821-0e86-4492-a1f0-e8981e36eee7 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:12.226483 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2e99d821-0e86-4492-a1f0-e8981e36eee7 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb6671f0e3545d9941c8142b22d3de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92aba9915b39436bb3687f64395518c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:12.234292 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2e99d821-0e86-4492-a1f0-e8981e36eee7 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] 10.222.0.60 "GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b" status: 200 len: 1515 microversion: 2.1 time: 0.158480 Oct 18 16:27:12.234874 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3388/6797] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:12 2022] GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:13.258515 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b34faeac-70e0-418a-85c7-7ae6a3e67fb4 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:13.259146 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b34faeac-70e0-418a-85c7-7ae6a3e67fb4 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] [instance: 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:13.265949 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b34faeac-70e0-418a-85c7-7ae6a3e67fb4 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:13.266438 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b34faeac-70e0-418a-85c7-7ae6a3e67fb4 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:13.267528 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b34faeac-70e0-418a-85c7-7ae6a3e67fb4 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:13.268226 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b34faeac-70e0-418a-85c7-7ae6a3e67fb4 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:13.268690 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b34faeac-70e0-418a-85c7-7ae6a3e67fb4 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:13.269155 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b34faeac-70e0-418a-85c7-7ae6a3e67fb4 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:13.401865 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b34faeac-70e0-418a-85c7-7ae6a3e67fb4 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb6671f0e3545d9941c8142b22d3de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92aba9915b39436bb3687f64395518c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:13.409584 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b34faeac-70e0-418a-85c7-7ae6a3e67fb4 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] 10.222.0.60 "GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b" status: 200 len: 1515 microversion: 2.1 time: 0.154954 Oct 18 16:27:13.410156 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3410/6798] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:13 2022] GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:27:14.433376 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3de23f49-936b-4093-8b96-15071da4a826 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:14.433999 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3de23f49-936b-4093-8b96-15071da4a826 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] [instance: 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:14.442015 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3de23f49-936b-4093-8b96-15071da4a826 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:14.442500 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3de23f49-936b-4093-8b96-15071da4a826 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:14.442936 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3de23f49-936b-4093-8b96-15071da4a826 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:14.443625 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3de23f49-936b-4093-8b96-15071da4a826 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:14.444081 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3de23f49-936b-4093-8b96-15071da4a826 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:14.444508 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3de23f49-936b-4093-8b96-15071da4a826 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:14.573187 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3de23f49-936b-4093-8b96-15071da4a826 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb6671f0e3545d9941c8142b22d3de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92aba9915b39436bb3687f64395518c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:14.581235 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3de23f49-936b-4093-8b96-15071da4a826 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] 10.222.0.60 "GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b" status: 200 len: 1515 microversion: 2.1 time: 0.151675 Oct 18 16:27:14.581565 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3389/6799] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:14 2022] GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:15.603787 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-16d89126-7800-4a30-847c-409bc1c8b88d tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:15.604449 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-16d89126-7800-4a30-847c-409bc1c8b88d tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] [instance: 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:15.611977 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-16d89126-7800-4a30-847c-409bc1c8b88d tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:15.612483 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-16d89126-7800-4a30-847c-409bc1c8b88d tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:15.612963 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-16d89126-7800-4a30-847c-409bc1c8b88d tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:15.613680 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-16d89126-7800-4a30-847c-409bc1c8b88d tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:15.614154 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-16d89126-7800-4a30-847c-409bc1c8b88d tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:15.614596 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-16d89126-7800-4a30-847c-409bc1c8b88d tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:15.755092 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-16d89126-7800-4a30-847c-409bc1c8b88d tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb6671f0e3545d9941c8142b22d3de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92aba9915b39436bb3687f64395518c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:15.762896 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-16d89126-7800-4a30-847c-409bc1c8b88d tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] 10.222.0.60 "GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b" status: 200 len: 1515 microversion: 2.1 time: 0.163064 Oct 18 16:27:15.763400 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3411/6800] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:15 2022] GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:16.786389 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6f93daa6-f8ac-475d-bb26-4e9b6a0af709 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:16.787014 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6f93daa6-f8ac-475d-bb26-4e9b6a0af709 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] [instance: 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:16.794167 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f93daa6-f8ac-475d-bb26-4e9b6a0af709 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:16.794662 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f93daa6-f8ac-475d-bb26-4e9b6a0af709 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:16.795113 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f93daa6-f8ac-475d-bb26-4e9b6a0af709 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:16.796000 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f93daa6-f8ac-475d-bb26-4e9b6a0af709 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:16.796464 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f93daa6-f8ac-475d-bb26-4e9b6a0af709 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:16.796950 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f93daa6-f8ac-475d-bb26-4e9b6a0af709 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:16.926308 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6f93daa6-f8ac-475d-bb26-4e9b6a0af709 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb6671f0e3545d9941c8142b22d3de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92aba9915b39436bb3687f64395518c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:16.934188 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6f93daa6-f8ac-475d-bb26-4e9b6a0af709 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] 10.222.0.60 "GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b" status: 200 len: 1515 microversion: 2.1 time: 0.152321 Oct 18 16:27:16.934765 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3390/6801] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:16 2022] GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:17.958113 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f89e4439-8980-404f-81a9-f1942335da70 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:17.958670 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f89e4439-8980-404f-81a9-f1942335da70 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] [instance: 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:17.966182 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f89e4439-8980-404f-81a9-f1942335da70 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:17.966686 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f89e4439-8980-404f-81a9-f1942335da70 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:17.967134 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f89e4439-8980-404f-81a9-f1942335da70 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:17.967842 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f89e4439-8980-404f-81a9-f1942335da70 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:17.968314 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f89e4439-8980-404f-81a9-f1942335da70 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:17.968771 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f89e4439-8980-404f-81a9-f1942335da70 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:18.098473 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f89e4439-8980-404f-81a9-f1942335da70 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb6671f0e3545d9941c8142b22d3de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92aba9915b39436bb3687f64395518c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:18.106288 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f89e4439-8980-404f-81a9-f1942335da70 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] 10.222.0.60 "GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b" status: 200 len: 1515 microversion: 2.1 time: 0.152397 Oct 18 16:27:18.106861 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3412/6802] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:17 2022] GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:19.130519 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b89c5d6c-baee-43a6-bbf5-dfe303409754 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:19.131166 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b89c5d6c-baee-43a6-bbf5-dfe303409754 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] [instance: 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:19.137971 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b89c5d6c-baee-43a6-bbf5-dfe303409754 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:19.138449 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b89c5d6c-baee-43a6-bbf5-dfe303409754 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:19.138876 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b89c5d6c-baee-43a6-bbf5-dfe303409754 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:19.139562 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b89c5d6c-baee-43a6-bbf5-dfe303409754 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:19.140010 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b89c5d6c-baee-43a6-bbf5-dfe303409754 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:19.140431 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b89c5d6c-baee-43a6-bbf5-dfe303409754 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:19.274170 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b89c5d6c-baee-43a6-bbf5-dfe303409754 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb6671f0e3545d9941c8142b22d3de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92aba9915b39436bb3687f64395518c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:19.281913 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b89c5d6c-baee-43a6-bbf5-dfe303409754 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] 10.222.0.60 "GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b" status: 200 len: 1515 microversion: 2.1 time: 0.155926 Oct 18 16:27:19.283158 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3391/6803] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:19 2022] GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:20.305971 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-808d3d9f-ea99-42db-9d20-b11416025812 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:20.306598 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-808d3d9f-ea99-42db-9d20-b11416025812 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] [instance: 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:20.313356 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-808d3d9f-ea99-42db-9d20-b11416025812 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:20.314420 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-808d3d9f-ea99-42db-9d20-b11416025812 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:20.314867 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-808d3d9f-ea99-42db-9d20-b11416025812 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:20.315562 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-808d3d9f-ea99-42db-9d20-b11416025812 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:20.316077 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-808d3d9f-ea99-42db-9d20-b11416025812 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:20.316482 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-808d3d9f-ea99-42db-9d20-b11416025812 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:20.448455 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-808d3d9f-ea99-42db-9d20-b11416025812 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb6671f0e3545d9941c8142b22d3de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92aba9915b39436bb3687f64395518c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:20.456189 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-808d3d9f-ea99-42db-9d20-b11416025812 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] 10.222.0.60 "GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b" status: 200 len: 1515 microversion: 2.1 time: 0.154177 Oct 18 16:27:20.456766 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3413/6804] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:20 2022] GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:21.479114 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c2f3763a-71a2-4b76-8098-0f85dadad54f tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:21.480007 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c2f3763a-71a2-4b76-8098-0f85dadad54f tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] [instance: 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:21.487343 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c2f3763a-71a2-4b76-8098-0f85dadad54f tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:21.487875 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c2f3763a-71a2-4b76-8098-0f85dadad54f tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:21.488318 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c2f3763a-71a2-4b76-8098-0f85dadad54f tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:21.489048 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c2f3763a-71a2-4b76-8098-0f85dadad54f tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:21.489510 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c2f3763a-71a2-4b76-8098-0f85dadad54f tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:21.489944 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c2f3763a-71a2-4b76-8098-0f85dadad54f tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:21.621577 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c2f3763a-71a2-4b76-8098-0f85dadad54f tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb6671f0e3545d9941c8142b22d3de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92aba9915b39436bb3687f64395518c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:21.629807 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c2f3763a-71a2-4b76-8098-0f85dadad54f tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] 10.222.0.60 "GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b" status: 200 len: 1515 microversion: 2.1 time: 0.154768 Oct 18 16:27:21.630386 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3392/6805] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:21 2022] GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:22.653194 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-643d8a5b-3a3c-4173-8428-5be54eede06f tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:22.653836 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-643d8a5b-3a3c-4173-8428-5be54eede06f tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] [instance: 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:22.660819 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-643d8a5b-3a3c-4173-8428-5be54eede06f tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:22.661463 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-643d8a5b-3a3c-4173-8428-5be54eede06f tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:22.661917 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-643d8a5b-3a3c-4173-8428-5be54eede06f tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:22.662626 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-643d8a5b-3a3c-4173-8428-5be54eede06f tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:22.663128 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-643d8a5b-3a3c-4173-8428-5be54eede06f tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:22.663572 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-643d8a5b-3a3c-4173-8428-5be54eede06f tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:22.793046 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-643d8a5b-3a3c-4173-8428-5be54eede06f tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb6671f0e3545d9941c8142b22d3de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92aba9915b39436bb3687f64395518c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:22.801384 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-643d8a5b-3a3c-4173-8428-5be54eede06f tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] 10.222.0.60 "GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b" status: 200 len: 1515 microversion: 2.1 time: 0.152264 Oct 18 16:27:22.801956 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3414/6806] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:22 2022] GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:23.825198 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9a6772be-05fc-45f6-9af0-d517c01203f1 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:23.825815 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9a6772be-05fc-45f6-9af0-d517c01203f1 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] [instance: 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:23.832770 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a6772be-05fc-45f6-9af0-d517c01203f1 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:23.833282 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a6772be-05fc-45f6-9af0-d517c01203f1 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:23.833717 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a6772be-05fc-45f6-9af0-d517c01203f1 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:23.834407 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a6772be-05fc-45f6-9af0-d517c01203f1 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:23.834858 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a6772be-05fc-45f6-9af0-d517c01203f1 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:23.835283 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a6772be-05fc-45f6-9af0-d517c01203f1 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:23.966350 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9a6772be-05fc-45f6-9af0-d517c01203f1 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb6671f0e3545d9941c8142b22d3de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92aba9915b39436bb3687f64395518c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:23.975283 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9a6772be-05fc-45f6-9af0-d517c01203f1 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] 10.222.0.60 "GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b" status: 200 len: 1515 microversion: 2.1 time: 0.153991 Oct 18 16:27:23.975878 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3393/6807] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:23 2022] GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:24.999039 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-204d1ad7-f388-4c3a-8ce5-aceefdcaa272 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:24.999588 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-204d1ad7-f388-4c3a-8ce5-aceefdcaa272 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] [instance: 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:25.007650 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-204d1ad7-f388-4c3a-8ce5-aceefdcaa272 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:25.008185 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-204d1ad7-f388-4c3a-8ce5-aceefdcaa272 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:25.008641 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-204d1ad7-f388-4c3a-8ce5-aceefdcaa272 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:25.009383 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-204d1ad7-f388-4c3a-8ce5-aceefdcaa272 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:25.009856 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-204d1ad7-f388-4c3a-8ce5-aceefdcaa272 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:25.010300 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-204d1ad7-f388-4c3a-8ce5-aceefdcaa272 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:25.139758 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-204d1ad7-f388-4c3a-8ce5-aceefdcaa272 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb6671f0e3545d9941c8142b22d3de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92aba9915b39436bb3687f64395518c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:25.147479 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-204d1ad7-f388-4c3a-8ce5-aceefdcaa272 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] 10.222.0.60 "GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b" status: 200 len: 1515 microversion: 2.1 time: 0.152587 Oct 18 16:27:25.148044 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3415/6808] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:24 2022] GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:26.171150 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ac1a3ca4-35d1-427f-9b11-366db67d9fe2 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:26.171773 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ac1a3ca4-35d1-427f-9b11-366db67d9fe2 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] [instance: 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:26.179494 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac1a3ca4-35d1-427f-9b11-366db67d9fe2 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:26.180011 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac1a3ca4-35d1-427f-9b11-366db67d9fe2 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:26.180449 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac1a3ca4-35d1-427f-9b11-366db67d9fe2 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:26.181311 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac1a3ca4-35d1-427f-9b11-366db67d9fe2 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:26.181779 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac1a3ca4-35d1-427f-9b11-366db67d9fe2 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:26.182213 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac1a3ca4-35d1-427f-9b11-366db67d9fe2 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:26.315128 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ac1a3ca4-35d1-427f-9b11-366db67d9fe2 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb6671f0e3545d9941c8142b22d3de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92aba9915b39436bb3687f64395518c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:26.322871 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ac1a3ca4-35d1-427f-9b11-366db67d9fe2 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] 10.222.0.60 "GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b" status: 200 len: 1515 microversion: 2.1 time: 0.156092 Oct 18 16:27:26.323467 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3394/6809] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:26 2022] GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:27.346145 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-95f77d1e-587d-4daa-8519-df4d2e42cf4d tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:27.346688 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-95f77d1e-587d-4daa-8519-df4d2e42cf4d tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] [instance: 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:27.352798 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-95f77d1e-587d-4daa-8519-df4d2e42cf4d tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:27.353333 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-95f77d1e-587d-4daa-8519-df4d2e42cf4d tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:27.353782 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-95f77d1e-587d-4daa-8519-df4d2e42cf4d tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:27.354488 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-95f77d1e-587d-4daa-8519-df4d2e42cf4d tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:27.354957 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-95f77d1e-587d-4daa-8519-df4d2e42cf4d tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:27.355396 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-95f77d1e-587d-4daa-8519-df4d2e42cf4d tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:27.489014 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-95f77d1e-587d-4daa-8519-df4d2e42cf4d tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb6671f0e3545d9941c8142b22d3de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92aba9915b39436bb3687f64395518c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:27.497337 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-95f77d1e-587d-4daa-8519-df4d2e42cf4d tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] 10.222.0.60 "GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b" status: 200 len: 1515 microversion: 2.1 time: 0.155231 Oct 18 16:27:27.497922 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3416/6810] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:27 2022] GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:28.521955 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2b17ffb3-4c1c-410a-a0c7-40adcb27ec9c tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:28.522527 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2b17ffb3-4c1c-410a-a0c7-40adcb27ec9c tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] [instance: 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:28.529435 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b17ffb3-4c1c-410a-a0c7-40adcb27ec9c tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:28.529916 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b17ffb3-4c1c-410a-a0c7-40adcb27ec9c tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:28.530345 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b17ffb3-4c1c-410a-a0c7-40adcb27ec9c tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:28.531030 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b17ffb3-4c1c-410a-a0c7-40adcb27ec9c tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:28.531482 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b17ffb3-4c1c-410a-a0c7-40adcb27ec9c tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:28.531902 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b17ffb3-4c1c-410a-a0c7-40adcb27ec9c tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:28.659594 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2b17ffb3-4c1c-410a-a0c7-40adcb27ec9c tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb6671f0e3545d9941c8142b22d3de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92aba9915b39436bb3687f64395518c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:28.667239 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2b17ffb3-4c1c-410a-a0c7-40adcb27ec9c tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] 10.222.0.60 "GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b" status: 200 len: 1515 microversion: 2.1 time: 0.149326 Oct 18 16:27:28.668092 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3395/6811] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:28 2022] GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:29.691103 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5d4a290c-af43-414e-9030-88c5401967b3 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:29.691828 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5d4a290c-af43-414e-9030-88c5401967b3 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] [instance: 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:29.698767 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5d4a290c-af43-414e-9030-88c5401967b3 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:29.699267 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5d4a290c-af43-414e-9030-88c5401967b3 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:29.699727 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5d4a290c-af43-414e-9030-88c5401967b3 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:29.700450 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5d4a290c-af43-414e-9030-88c5401967b3 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:29.701030 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5d4a290c-af43-414e-9030-88c5401967b3 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:29.701478 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5d4a290c-af43-414e-9030-88c5401967b3 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:29.834561 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5d4a290c-af43-414e-9030-88c5401967b3 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb6671f0e3545d9941c8142b22d3de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92aba9915b39436bb3687f64395518c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:29.842346 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5d4a290c-af43-414e-9030-88c5401967b3 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] 10.222.0.60 "GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b" status: 200 len: 1515 microversion: 2.1 time: 0.155209 Oct 18 16:27:29.842927 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3417/6812] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:29 2022] GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:30.866516 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-088c0d8e-cbf7-42a8-8f47-44077738e3a0 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:30.867137 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-088c0d8e-cbf7-42a8-8f47-44077738e3a0 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] [instance: 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:30.871412 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=32 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:27:30.875518 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-088c0d8e-cbf7-42a8-8f47-44077738e3a0 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:30.876021 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-088c0d8e-cbf7-42a8-8f47-44077738e3a0 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:30.876461 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-088c0d8e-cbf7-42a8-8f47-44077738e3a0 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:30.877201 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-088c0d8e-cbf7-42a8-8f47-44077738e3a0 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:30.877666 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-088c0d8e-cbf7-42a8-8f47-44077738e3a0 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:30.878099 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-088c0d8e-cbf7-42a8-8f47-44077738e3a0 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:30.883721 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:27:30.904568 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-d46787bd-b547-4982-ad3e-9634369b3ba6 req-84a14b21-8089-41f2-a18e-ed00e8acc624 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b", "name": "network-vif-unplugged", "status": "completed", "tag": "75ef8e41-9d2a-435c-bc1d-48e9729ff18c"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:27:30.913224 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=30 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:27:30.918644 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-d46787bd-b547-4982-ad3e-9634369b3ba6 req-84a14b21-8089-41f2-a18e-ed00e8acc624 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:30.919488 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-d46787bd-b547-4982-ad3e-9634369b3ba6 req-84a14b21-8089-41f2-a18e-ed00e8acc624 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:30.920482 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-d46787bd-b547-4982-ad3e-9634369b3ba6 req-84a14b21-8089-41f2-a18e-ed00e8acc624 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:30.931783 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=86 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:27:30.934919 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-d46787bd-b547-4982-ad3e-9634369b3ba6 req-84a14b21-8089-41f2-a18e-ed00e8acc624 service nova] Creating event network-vif-unplugged:75ef8e41-9d2a-435c-bc1d-48e9729ff18c for instance 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b on n-h2-853682-5 Oct 18 16:27:30.941935 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [req-d46787bd-b547-4982-ad3e-9634369b3ba6 req-84a14b21-8089-41f2-a18e-ed00e8acc624 service nova] Instance 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853682-5', 'n-h1-853682-5'} {{(pid=120405) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 18 16:27:30.957871 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-d46787bd-b547-4982-ad3e-9634369b3ba6 req-84a14b21-8089-41f2-a18e-ed00e8acc624 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057267 Oct 18 16:27:30.958818 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3418/6813] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:27:31.022874 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-088c0d8e-cbf7-42a8-8f47-44077738e3a0 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb6671f0e3545d9941c8142b22d3de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92aba9915b39436bb3687f64395518c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:31.033676 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-088c0d8e-cbf7-42a8-8f47-44077738e3a0 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] 10.222.0.60 "GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b" status: 200 len: 1514 microversion: 2.1 time: 0.171024 Oct 18 16:27:31.034276 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3396/6814] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:30 2022] GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b => generated 1514 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:32.059069 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-206dc7b0-0c6e-4819-adff-ae4bb101a193 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:32.059802 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-206dc7b0-0c6e-4819-adff-ae4bb101a193 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] [instance: 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:32.065974 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-206dc7b0-0c6e-4819-adff-ae4bb101a193 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:32.066461 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-206dc7b0-0c6e-4819-adff-ae4bb101a193 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:32.066908 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-206dc7b0-0c6e-4819-adff-ae4bb101a193 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:32.067605 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-206dc7b0-0c6e-4819-adff-ae4bb101a193 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:32.068073 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-206dc7b0-0c6e-4819-adff-ae4bb101a193 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:32.068508 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-206dc7b0-0c6e-4819-adff-ae4bb101a193 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:32.197674 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-206dc7b0-0c6e-4819-adff-ae4bb101a193 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb6671f0e3545d9941c8142b22d3de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92aba9915b39436bb3687f64395518c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:32.205617 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-206dc7b0-0c6e-4819-adff-ae4bb101a193 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] 10.222.0.60 "GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b" status: 200 len: 1512 microversion: 2.1 time: 0.151609 Oct 18 16:27:32.206198 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3419/6815] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:32 2022] GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:32.984204 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-472eb2dd-4262-41bb-8a59-e6464babfe60 req-85983a9d-fb47-4d07-8823-08df49a5e769 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b", "tag": "75ef8e41-9d2a-435c-bc1d-48e9729ff18c"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:27:32.994454 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-472eb2dd-4262-41bb-8a59-e6464babfe60 req-85983a9d-fb47-4d07-8823-08df49a5e769 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:32.994931 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-472eb2dd-4262-41bb-8a59-e6464babfe60 req-85983a9d-fb47-4d07-8823-08df49a5e769 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:32.995364 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-472eb2dd-4262-41bb-8a59-e6464babfe60 req-85983a9d-fb47-4d07-8823-08df49a5e769 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:33.007404 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-472eb2dd-4262-41bb-8a59-e6464babfe60 req-85983a9d-fb47-4d07-8823-08df49a5e769 service nova] Creating event network-changed:75ef8e41-9d2a-435c-bc1d-48e9729ff18c for instance 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b on n-h2-853682-5 Oct 18 16:27:33.012688 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [req-472eb2dd-4262-41bb-8a59-e6464babfe60 req-85983a9d-fb47-4d07-8823-08df49a5e769 service nova] Instance 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853682-5', 'n-h1-853682-5'} {{(pid=120406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 18 16:27:33.023997 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-472eb2dd-4262-41bb-8a59-e6464babfe60 req-85983a9d-fb47-4d07-8823-08df49a5e769 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043628 Oct 18 16:27:33.024597 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3397/6816] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:27:33.229838 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7625f4e8-39f9-44dc-ba19-1d0d0ff49221 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:33.230568 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7625f4e8-39f9-44dc-ba19-1d0d0ff49221 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] [instance: 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:33.239582 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7625f4e8-39f9-44dc-ba19-1d0d0ff49221 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:33.242016 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7625f4e8-39f9-44dc-ba19-1d0d0ff49221 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:33.242766 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7625f4e8-39f9-44dc-ba19-1d0d0ff49221 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:33.244212 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7625f4e8-39f9-44dc-ba19-1d0d0ff49221 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:33.244945 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7625f4e8-39f9-44dc-ba19-1d0d0ff49221 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:33.245469 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7625f4e8-39f9-44dc-ba19-1d0d0ff49221 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:33.394660 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7625f4e8-39f9-44dc-ba19-1d0d0ff49221 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb6671f0e3545d9941c8142b22d3de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92aba9915b39436bb3687f64395518c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:33.404646 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7625f4e8-39f9-44dc-ba19-1d0d0ff49221 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] 10.222.0.60 "GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b" status: 200 len: 1512 microversion: 2.1 time: 0.178699 Oct 18 16:27:33.405560 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3420/6817] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:33 2022] GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b => generated 1512 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:34.432682 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c1cbcbf6-e8aa-4853-8aa4-dceff1dbb6d9 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:34.433434 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c1cbcbf6-e8aa-4853-8aa4-dceff1dbb6d9 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] [instance: 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:34.439873 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1cbcbf6-e8aa-4853-8aa4-dceff1dbb6d9 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:34.440363 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1cbcbf6-e8aa-4853-8aa4-dceff1dbb6d9 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:34.440831 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1cbcbf6-e8aa-4853-8aa4-dceff1dbb6d9 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:34.441539 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1cbcbf6-e8aa-4853-8aa4-dceff1dbb6d9 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:34.442000 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1cbcbf6-e8aa-4853-8aa4-dceff1dbb6d9 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:34.442431 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1cbcbf6-e8aa-4853-8aa4-dceff1dbb6d9 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:34.575287 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c1cbcbf6-e8aa-4853-8aa4-dceff1dbb6d9 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb6671f0e3545d9941c8142b22d3de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92aba9915b39436bb3687f64395518c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:34.583353 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c1cbcbf6-e8aa-4853-8aa4-dceff1dbb6d9 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] 10.222.0.60 "GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b" status: 200 len: 1509 microversion: 2.1 time: 0.157237 Oct 18 16:27:34.583935 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3398/6818] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:34 2022] GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:34.608310 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a16d68d9-eba4-4184-9268-4568608d8745 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:34.608966 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a16d68d9-eba4-4184-9268-4568608d8745 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] [instance: 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:34.616236 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a16d68d9-eba4-4184-9268-4568608d8745 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:34.616730 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a16d68d9-eba4-4184-9268-4568608d8745 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:34.617213 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a16d68d9-eba4-4184-9268-4568608d8745 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:34.617913 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a16d68d9-eba4-4184-9268-4568608d8745 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:34.618381 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a16d68d9-eba4-4184-9268-4568608d8745 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:34.618817 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a16d68d9-eba4-4184-9268-4568608d8745 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:34.645070 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a16d68d9-eba4-4184-9268-4568608d8745 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] [instance: 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:27:34.695889 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.compute.api [None req-a16d68d9-eba4-4184-9268-4568608d8745 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] [instance: 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b] Found an unconfirmed migration during delete, id: 16, status: finished Oct 18 16:27:36.104859 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-b068f8e1-e76c-4e72-8c48-4c82347e7dd8 req-9687d0d4-274f-49c1-8a39-652ef830118a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b", "name": "network-vif-plugged", "status": "completed", "tag": "75ef8e41-9d2a-435c-bc1d-48e9729ff18c"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:27:36.116291 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b068f8e1-e76c-4e72-8c48-4c82347e7dd8 req-9687d0d4-274f-49c1-8a39-652ef830118a service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:36.116782 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b068f8e1-e76c-4e72-8c48-4c82347e7dd8 req-9687d0d4-274f-49c1-8a39-652ef830118a service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:36.117272 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b068f8e1-e76c-4e72-8c48-4c82347e7dd8 req-9687d0d4-274f-49c1-8a39-652ef830118a service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:36.129718 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-b068f8e1-e76c-4e72-8c48-4c82347e7dd8 req-9687d0d4-274f-49c1-8a39-652ef830118a service nova] Creating event network-vif-plugged:75ef8e41-9d2a-435c-bc1d-48e9729ff18c for instance 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b on n-h2-853682-5 Oct 18 16:27:36.134990 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-b068f8e1-e76c-4e72-8c48-4c82347e7dd8 req-9687d0d4-274f-49c1-8a39-652ef830118a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033790 Oct 18 16:27:36.135707 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3399/6819] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:27:36.171753 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a16d68d9-eba4-4184-9268-4568608d8745 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] 10.222.0.60 "DELETE /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b" status: 204 len: 0 microversion: 2.1 time: 1.566968 Oct 18 16:27:36.172378 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3421/6820] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 16:27:34 2022] DELETE /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b => generated 0 bytes in 1569 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 16:27:36.183201 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-664a784b-0771-47bf-936a-1c862455fac9 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:36.184154 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-664a784b-0771-47bf-936a-1c862455fac9 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] [instance: 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:36.191501 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-664a784b-0771-47bf-936a-1c862455fac9 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:36.192047 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-664a784b-0771-47bf-936a-1c862455fac9 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:36.192498 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-664a784b-0771-47bf-936a-1c862455fac9 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:36.193710 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-664a784b-0771-47bf-936a-1c862455fac9 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:36.193710 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-664a784b-0771-47bf-936a-1c862455fac9 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:36.194233 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-664a784b-0771-47bf-936a-1c862455fac9 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:36.327981 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-664a784b-0771-47bf-936a-1c862455fac9 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb6671f0e3545d9941c8142b22d3de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92aba9915b39436bb3687f64395518c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:36.336308 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-664a784b-0771-47bf-936a-1c862455fac9 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] 10.222.0.60 "GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b" status: 200 len: 1501 microversion: 2.1 time: 0.158390 Oct 18 16:27:36.336908 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3400/6821] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:36 2022] GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b => generated 1501 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:37.360874 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8e4d2b36-703c-455e-96e9-13afe04d8c12 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:37.361730 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8e4d2b36-703c-455e-96e9-13afe04d8c12 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] [instance: 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:37.369136 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8e4d2b36-703c-455e-96e9-13afe04d8c12 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:37.369642 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8e4d2b36-703c-455e-96e9-13afe04d8c12 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:37.370103 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8e4d2b36-703c-455e-96e9-13afe04d8c12 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:37.370830 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8e4d2b36-703c-455e-96e9-13afe04d8c12 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:37.371305 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8e4d2b36-703c-455e-96e9-13afe04d8c12 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:37.371785 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8e4d2b36-703c-455e-96e9-13afe04d8c12 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:37.508440 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8e4d2b36-703c-455e-96e9-13afe04d8c12 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb6671f0e3545d9941c8142b22d3de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92aba9915b39436bb3687f64395518c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:37.516488 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8e4d2b36-703c-455e-96e9-13afe04d8c12 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] 10.222.0.60 "GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b" status: 200 len: 1501 microversion: 2.1 time: 0.160494 Oct 18 16:27:37.517115 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3422/6822] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:37 2022] GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b => generated 1501 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:37.930073 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-d00ebdc8-1f6b-49e6-b7ac-c981eaecad6d req-79b1cab7-e646-4ea5-a6fc-f2169245e9ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b", "name": "network-vif-deleted", "tag": "75ef8e41-9d2a-435c-bc1d-48e9729ff18c"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:27:37.941854 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d00ebdc8-1f6b-49e6-b7ac-c981eaecad6d req-79b1cab7-e646-4ea5-a6fc-f2169245e9ca service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:37.942591 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d00ebdc8-1f6b-49e6-b7ac-c981eaecad6d req-79b1cab7-e646-4ea5-a6fc-f2169245e9ca service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:37.943216 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d00ebdc8-1f6b-49e6-b7ac-c981eaecad6d req-79b1cab7-e646-4ea5-a6fc-f2169245e9ca service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:37.960131 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-d00ebdc8-1f6b-49e6-b7ac-c981eaecad6d req-79b1cab7-e646-4ea5-a6fc-f2169245e9ca service nova] Creating event network-vif-deleted:75ef8e41-9d2a-435c-bc1d-48e9729ff18c for instance 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b on n-h2-853682-5 Oct 18 16:27:37.965915 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-d00ebdc8-1f6b-49e6-b7ac-c981eaecad6d req-79b1cab7-e646-4ea5-a6fc-f2169245e9ca service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040036 Oct 18 16:27:37.967052 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3401/6823] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:27:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:27:38.540578 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-279c534e-eab6-47b9-ac2f-63bb74a11585 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:38.541231 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-279c534e-eab6-47b9-ac2f-63bb74a11585 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] [instance: 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:38.550783 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-279c534e-eab6-47b9-ac2f-63bb74a11585 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:38.551285 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-279c534e-eab6-47b9-ac2f-63bb74a11585 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:38.551732 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-279c534e-eab6-47b9-ac2f-63bb74a11585 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:38.552447 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-279c534e-eab6-47b9-ac2f-63bb74a11585 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:38.552948 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-279c534e-eab6-47b9-ac2f-63bb74a11585 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:38.553383 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-279c534e-eab6-47b9-ac2f-63bb74a11585 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:38.568003 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-279c534e-eab6-47b9-ac2f-63bb74a11585 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] HTTP exception thrown: Instance 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b could not be found. Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-279c534e-eab6-47b9-ac2f-63bb74a11585 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Request method failure captured: Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b HTTP/1.1 Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTtPIt_Ne7065nqIxK0xQqUzHs7W-zaPy6IKWcq2ZvVwkeMwss_S9dPVg854edGa9HyuNneGsSb1ijy1xsSrivlwDuT6P7856040wcGv3FF8ch1YrehDoVLBJxjPN9Z629RrtLrwGb_kBhlJ20SUBGVxE9o1OP_j0DvdcyNgfwYpQ53s Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 92aba9915b39436bb3687f64395518c2 Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-DeleteServersTestJSON-1473968170 Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/92aba9915b39436bb3687f64395518c2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/92aba9915b39436bb3687f64395518c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/92aba9915b39436bb3687f64395518c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_92aba9915b39436bb3687f64395518c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-DeleteServersTestJSON-1473968170 Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 92aba9915b39436bb3687f64395518c2 Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-DeleteServersTestJSON-1473968170 Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-DeleteServersTestJSON-1473968170-project Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: afb6671f0e3545d9941c8142b22d3de3 Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-DeleteServersTestJSON-1473968170-project Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b could not be found. Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b'} Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b could not be found. Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b could not be found. Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:27:38.569709 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:27:38.575035 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:38.575035 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:27:38.575035 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:27:38.575035 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:27:38.575035 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:27:38.575035 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b could not be found. Oct 18 16:27:38.575035 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:27:38.575035 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-279c534e-eab6-47b9-ac2f-63bb74a11585 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Returning 404 to user: Instance 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:27:38.575035 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-279c534e-eab6-47b9-ac2f-63bb74a11585 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] 10.222.0.60 "GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b" status: 404 len: 111 microversion: 2.1 time: 0.034484 Oct 18 16:27:38.575035 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3423/6824] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:38 2022] GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:27:38.584261 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fea77d50-7ac5-4c81-997f-013253dc57c6 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:38.584882 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fea77d50-7ac5-4c81-997f-013253dc57c6 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] [instance: 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:38.591134 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fea77d50-7ac5-4c81-997f-013253dc57c6 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:38.591622 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fea77d50-7ac5-4c81-997f-013253dc57c6 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:38.592066 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fea77d50-7ac5-4c81-997f-013253dc57c6 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:38.592767 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fea77d50-7ac5-4c81-997f-013253dc57c6 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:38.593252 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fea77d50-7ac5-4c81-997f-013253dc57c6 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:38.593686 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fea77d50-7ac5-4c81-997f-013253dc57c6 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:38.606819 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-fea77d50-7ac5-4c81-997f-013253dc57c6 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] HTTP exception thrown: Instance 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b could not be found. Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fea77d50-7ac5-4c81-997f-013253dc57c6 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Request method failure captured: Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b HTTP/1.1 Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTtPIt_Ne7065nqIxK0xQqUzHs7W-zaPy6IKWcq2ZvVwkeMwss_S9dPVg854edGa9HyuNneGsSb1ijy1xsSrivlwDuT6P7856040wcGv3FF8ch1YrehDoVLBJxjPN9Z629RrtLrwGb_kBhlJ20SUBGVxE9o1OP_j0DvdcyNgfwYpQ53s Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 92aba9915b39436bb3687f64395518c2 Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-DeleteServersTestJSON-1473968170 Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/92aba9915b39436bb3687f64395518c2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/92aba9915b39436bb3687f64395518c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/92aba9915b39436bb3687f64395518c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_92aba9915b39436bb3687f64395518c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-DeleteServersTestJSON-1473968170 Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 92aba9915b39436bb3687f64395518c2 Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-DeleteServersTestJSON-1473968170 Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-DeleteServersTestJSON-1473968170-project Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: afb6671f0e3545d9941c8142b22d3de3 Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-DeleteServersTestJSON-1473968170-project Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b could not be found. Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b'} Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b could not be found. Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:27:38.608453 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:27:38.613544 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b could not be found. Oct 18 16:27:38.613544 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:27:38.613544 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:27:38.613544 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:27:38.613544 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:38.613544 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:27:38.613544 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:27:38.613544 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:27:38.613544 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:27:38.613544 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b could not be found. Oct 18 16:27:38.613544 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:27:38.613544 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fea77d50-7ac5-4c81-997f-013253dc57c6 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Returning 404 to user: Instance 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:27:38.613544 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fea77d50-7ac5-4c81-997f-013253dc57c6 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] 10.222.0.60 "DELETE /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b" status: 404 len: 111 microversion: 2.1 time: 0.029889 Oct 18 16:27:38.613544 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3402/6825] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 16:27:38 2022] DELETE /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:27:38.619358 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9ebc5132-58ae-4133-afcc-05fdd590b9b4 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:38.620033 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9ebc5132-58ae-4133-afcc-05fdd590b9b4 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] [instance: 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:38.626824 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9ebc5132-58ae-4133-afcc-05fdd590b9b4 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:38.627330 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9ebc5132-58ae-4133-afcc-05fdd590b9b4 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:38.627787 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9ebc5132-58ae-4133-afcc-05fdd590b9b4 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:38.628545 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9ebc5132-58ae-4133-afcc-05fdd590b9b4 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:38.629160 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9ebc5132-58ae-4133-afcc-05fdd590b9b4 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:38.629611 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9ebc5132-58ae-4133-afcc-05fdd590b9b4 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:38.643133 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-9ebc5132-58ae-4133-afcc-05fdd590b9b4 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] HTTP exception thrown: Instance 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b could not be found. Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9ebc5132-58ae-4133-afcc-05fdd590b9b4 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Request method failure captured: Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b HTTP/1.1 Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTtPIt_Ne7065nqIxK0xQqUzHs7W-zaPy6IKWcq2ZvVwkeMwss_S9dPVg854edGa9HyuNneGsSb1ijy1xsSrivlwDuT6P7856040wcGv3FF8ch1YrehDoVLBJxjPN9Z629RrtLrwGb_kBhlJ20SUBGVxE9o1OP_j0DvdcyNgfwYpQ53s Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 92aba9915b39436bb3687f64395518c2 Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-DeleteServersTestJSON-1473968170 Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/92aba9915b39436bb3687f64395518c2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/92aba9915b39436bb3687f64395518c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/92aba9915b39436bb3687f64395518c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_92aba9915b39436bb3687f64395518c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-DeleteServersTestJSON-1473968170 Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 92aba9915b39436bb3687f64395518c2 Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-DeleteServersTestJSON-1473968170 Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-DeleteServersTestJSON-1473968170-project Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: afb6671f0e3545d9941c8142b22d3de3 Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-DeleteServersTestJSON-1473968170-project Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b could not be found. Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b'} Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b could not be found. Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b could not be found. Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:27:38.644665 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:27:38.649604 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:27:38.649604 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:27:38.649604 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:27:38.649604 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:27:38.649604 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:27:38.649604 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b could not be found. Oct 18 16:27:38.649604 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:27:38.649604 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9ebc5132-58ae-4133-afcc-05fdd590b9b4 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] Returning 404 to user: Instance 64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:27:38.649604 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9ebc5132-58ae-4133-afcc-05fdd590b9b4 tempest-DeleteServersTestJSON-1473968170 tempest-DeleteServersTestJSON-1473968170-project] 10.222.0.60 "GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b" status: 404 len: 111 microversion: 2.1 time: 0.030641 Oct 18 16:27:38.649604 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3424/6826] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:38 2022] GET /compute/v2.1/servers/64b3b60f-e115-4d40-a5a7-7fa6ec8f8d8b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:27:47.230902 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3f2b537d-f196-49a4-b7b7-5e3cc7585dd6 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1661659910", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "6699b3a9-87b4-42d4-9360-f761b4b00a95"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:27:47.292496 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-3f2b537d-f196-49a4-b7b7-5e3cc7585dd6 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] validate_networks() for [('6699b3a9-87b4-42d4-9360-f761b4b00a95', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 16:27:47.707599 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-3f2b537d-f196-49a4-b7b7-5e3cc7585dd6 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:27:47.708044 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-3f2b537d-f196-49a4-b7b7-5e3cc7585dd6 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:27:47.708529 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-3f2b537d-f196-49a4-b7b7-5e3cc7585dd6 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:27:47.708973 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-3f2b537d-f196-49a4-b7b7-5e3cc7585dd6 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:27:47.709398 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-3f2b537d-f196-49a4-b7b7-5e3cc7585dd6 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:27:47.718544 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3f2b537d-f196-49a4-b7b7-5e3cc7585dd6 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:47.720892 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3f2b537d-f196-49a4-b7b7-5e3cc7585dd6 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:47.720892 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3f2b537d-f196-49a4-b7b7-5e3cc7585dd6 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:47.720892 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3f2b537d-f196-49a4-b7b7-5e3cc7585dd6 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:47.721907 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3f2b537d-f196-49a4-b7b7-5e3cc7585dd6 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:47.721907 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3f2b537d-f196-49a4-b7b7-5e3cc7585dd6 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:47.739878 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-3f2b537d-f196-49a4-b7b7-5e3cc7585dd6 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Getting quotas for project 5507238aeefa4b24b06cd3c30c7f7cc3. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:27:47.745462 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-3f2b537d-f196-49a4-b7b7-5e3cc7585dd6 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Getting quotas for user a82485198bb545ae9c05590584d65af9 and project 5507238aeefa4b24b06cd3c30c7f7cc3. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:27:47.759336 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3f2b537d-f196-49a4-b7b7-5e3cc7585dd6 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:27:47.761720 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3f2b537d-f196-49a4-b7b7-5e3cc7585dd6 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 95780f98-d9c7-4278-8608-273089d50fec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:27:47.812372 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3f2b537d-f196-49a4-b7b7-5e3cc7585dd6 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.725520 Oct 18 16:27:47.813909 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3403/6827] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 16:27:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:27:47.825026 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-45089f43-d328-404e-8acb-0962e2df14dd tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:47.825663 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-45089f43-d328-404e-8acb-0962e2df14dd tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 95780f98-d9c7-4278-8608-273089d50fec] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:47.887907 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-45089f43-d328-404e-8acb-0962e2df14dd tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:47.896151 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-45089f43-d328-404e-8acb-0962e2df14dd tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec" status: 200 len: 1218 microversion: 2.1 time: 0.075072 Oct 18 16:27:47.896732 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3425/6828] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:47 2022] GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec => generated 1218 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:48.919556 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f041a143-2b36-4e90-acbb-6348a029391c tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:48.930137 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f041a143-2b36-4e90-acbb-6348a029391c tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 95780f98-d9c7-4278-8608-273089d50fec] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:48.938610 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f041a143-2b36-4e90-acbb-6348a029391c tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:48.939456 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f041a143-2b36-4e90-acbb-6348a029391c tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:48.940097 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f041a143-2b36-4e90-acbb-6348a029391c tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:48.941008 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f041a143-2b36-4e90-acbb-6348a029391c tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:48.941499 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f041a143-2b36-4e90-acbb-6348a029391c tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:48.942057 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f041a143-2b36-4e90-acbb-6348a029391c tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:49.009150 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f041a143-2b36-4e90-acbb-6348a029391c tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:49.017759 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f041a143-2b36-4e90-acbb-6348a029391c tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec" status: 200 len: 1276 microversion: 2.1 time: 0.103183 Oct 18 16:27:49.018348 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3404/6829] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:48 2022] GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec => generated 1276 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:27:50.042761 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ae3ceb92-5559-40ae-9233-cb375c4b5959 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:50.044057 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ae3ceb92-5559-40ae-9233-cb375c4b5959 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 95780f98-d9c7-4278-8608-273089d50fec] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:50.048089 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:27:50.054937 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae3ceb92-5559-40ae-9233-cb375c4b5959 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:50.055576 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae3ceb92-5559-40ae-9233-cb375c4b5959 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:50.056032 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae3ceb92-5559-40ae-9233-cb375c4b5959 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:50.057604 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae3ceb92-5559-40ae-9233-cb375c4b5959 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:50.058083 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae3ceb92-5559-40ae-9233-cb375c4b5959 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:50.058527 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae3ceb92-5559-40ae-9233-cb375c4b5959 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:50.210055 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ae3ceb92-5559-40ae-9233-cb375c4b5959 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:50.218499 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ae3ceb92-5559-40ae-9233-cb375c4b5959 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec" status: 200 len: 1318 microversion: 2.1 time: 0.180144 Oct 18 16:27:50.220258 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3426/6830] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:50 2022] GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:50.315846 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-b03c97f1-11d5-46da-80f0-074ac0ceae7f req-2f96e02b-2888-4050-a58f-b05469008f91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95780f98-d9c7-4278-8608-273089d50fec", "tag": "2e68dbae-65c0-4976-a493-aacda6e1aa8d"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:27:50.337984 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b03c97f1-11d5-46da-80f0-074ac0ceae7f req-2f96e02b-2888-4050-a58f-b05469008f91 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:50.338467 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b03c97f1-11d5-46da-80f0-074ac0ceae7f req-2f96e02b-2888-4050-a58f-b05469008f91 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:50.338899 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b03c97f1-11d5-46da-80f0-074ac0ceae7f req-2f96e02b-2888-4050-a58f-b05469008f91 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:50.351398 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-b03c97f1-11d5-46da-80f0-074ac0ceae7f req-2f96e02b-2888-4050-a58f-b05469008f91 service nova] Creating event network-changed:2e68dbae-65c0-4976-a493-aacda6e1aa8d for instance 95780f98-d9c7-4278-8608-273089d50fec on n-h2-853682-5 Oct 18 16:27:50.357819 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-b03c97f1-11d5-46da-80f0-074ac0ceae7f req-2f96e02b-2888-4050-a58f-b05469008f91 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045781 Oct 18 16:27:50.358433 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3405/6831] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:27:51.244701 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-176734c1-7f89-446d-b8e0-edb602bea51a tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:51.245293 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-176734c1-7f89-446d-b8e0-edb602bea51a tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 95780f98-d9c7-4278-8608-273089d50fec] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:51.253425 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-176734c1-7f89-446d-b8e0-edb602bea51a tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:51.253928 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-176734c1-7f89-446d-b8e0-edb602bea51a tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:51.254979 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-176734c1-7f89-446d-b8e0-edb602bea51a tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:51.255715 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-176734c1-7f89-446d-b8e0-edb602bea51a tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:51.256213 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-176734c1-7f89-446d-b8e0-edb602bea51a tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:51.256630 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-176734c1-7f89-446d-b8e0-edb602bea51a tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:51.399249 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-176734c1-7f89-446d-b8e0-edb602bea51a tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:51.409608 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-176734c1-7f89-446d-b8e0-edb602bea51a tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec" status: 200 len: 1318 microversion: 2.1 time: 0.169767 Oct 18 16:27:51.410282 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3427/6832] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:51 2022] GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:52.436175 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ec3b2e82-62aa-4155-89e6-09611074eaee tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:52.437072 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ec3b2e82-62aa-4155-89e6-09611074eaee tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 95780f98-d9c7-4278-8608-273089d50fec] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:52.445447 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec3b2e82-62aa-4155-89e6-09611074eaee tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:52.446026 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec3b2e82-62aa-4155-89e6-09611074eaee tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:52.446535 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec3b2e82-62aa-4155-89e6-09611074eaee tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:52.447315 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec3b2e82-62aa-4155-89e6-09611074eaee tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:52.447840 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec3b2e82-62aa-4155-89e6-09611074eaee tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:52.448334 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec3b2e82-62aa-4155-89e6-09611074eaee tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:52.583598 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ec3b2e82-62aa-4155-89e6-09611074eaee tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:52.591351 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ec3b2e82-62aa-4155-89e6-09611074eaee tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec" status: 200 len: 1318 microversion: 2.1 time: 0.159605 Oct 18 16:27:52.591929 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3406/6833] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:52 2022] GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:53.613935 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-594e0f71-d6d4-407b-b478-01501d8044e8 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:53.614626 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-594e0f71-d6d4-407b-b478-01501d8044e8 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 95780f98-d9c7-4278-8608-273089d50fec] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:53.621508 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-594e0f71-d6d4-407b-b478-01501d8044e8 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:53.622051 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-594e0f71-d6d4-407b-b478-01501d8044e8 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:53.622508 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-594e0f71-d6d4-407b-b478-01501d8044e8 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:53.623223 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-594e0f71-d6d4-407b-b478-01501d8044e8 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:53.623698 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-594e0f71-d6d4-407b-b478-01501d8044e8 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:53.624147 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-594e0f71-d6d4-407b-b478-01501d8044e8 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:53.758229 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-594e0f71-d6d4-407b-b478-01501d8044e8 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:53.766445 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-594e0f71-d6d4-407b-b478-01501d8044e8 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec" status: 200 len: 1318 microversion: 2.1 time: 0.156048 Oct 18 16:27:53.767027 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3428/6834] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:53 2022] GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:54.191402 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-897a0211-23d6-44be-aaeb-2097177695b5 req-10af3702-1a5d-4519-b20a-fbd62f3da630 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95780f98-d9c7-4278-8608-273089d50fec", "name": "network-vif-plugged", "status": "completed", "tag": "2e68dbae-65c0-4976-a493-aacda6e1aa8d"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:27:54.201988 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-897a0211-23d6-44be-aaeb-2097177695b5 req-10af3702-1a5d-4519-b20a-fbd62f3da630 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:54.202480 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-897a0211-23d6-44be-aaeb-2097177695b5 req-10af3702-1a5d-4519-b20a-fbd62f3da630 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:54.202915 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-897a0211-23d6-44be-aaeb-2097177695b5 req-10af3702-1a5d-4519-b20a-fbd62f3da630 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:54.214145 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-897a0211-23d6-44be-aaeb-2097177695b5 req-10af3702-1a5d-4519-b20a-fbd62f3da630 service nova] Creating event network-vif-plugged:2e68dbae-65c0-4976-a493-aacda6e1aa8d for instance 95780f98-d9c7-4278-8608-273089d50fec on n-h2-853682-5 Oct 18 16:27:54.219423 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-897a0211-23d6-44be-aaeb-2097177695b5 req-10af3702-1a5d-4519-b20a-fbd62f3da630 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032528 Oct 18 16:27:54.220374 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3407/6835] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:27:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:27:54.789449 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5b7bdafc-5b2f-450d-9291-3759c49b94ba tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:54.790087 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5b7bdafc-5b2f-450d-9291-3759c49b94ba tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 95780f98-d9c7-4278-8608-273089d50fec] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:54.797761 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5b7bdafc-5b2f-450d-9291-3759c49b94ba tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:54.798304 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5b7bdafc-5b2f-450d-9291-3759c49b94ba tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:54.798768 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5b7bdafc-5b2f-450d-9291-3759c49b94ba tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:54.799525 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5b7bdafc-5b2f-450d-9291-3759c49b94ba tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:54.799998 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5b7bdafc-5b2f-450d-9291-3759c49b94ba tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:54.800439 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5b7bdafc-5b2f-450d-9291-3759c49b94ba tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:54.929853 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5b7bdafc-5b2f-450d-9291-3759c49b94ba tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:54.937538 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5b7bdafc-5b2f-450d-9291-3759c49b94ba tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec" status: 200 len: 1318 microversion: 2.1 time: 0.152129 Oct 18 16:27:54.938126 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3429/6836] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:54 2022] GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:55.962780 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c11475a2-81af-4e70-9fc2-14ae391dd582 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:55.963412 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c11475a2-81af-4e70-9fc2-14ae391dd582 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 95780f98-d9c7-4278-8608-273089d50fec] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:55.969822 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c11475a2-81af-4e70-9fc2-14ae391dd582 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:55.970309 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c11475a2-81af-4e70-9fc2-14ae391dd582 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:55.970750 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c11475a2-81af-4e70-9fc2-14ae391dd582 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:55.971448 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c11475a2-81af-4e70-9fc2-14ae391dd582 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:55.971909 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c11475a2-81af-4e70-9fc2-14ae391dd582 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:55.972336 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c11475a2-81af-4e70-9fc2-14ae391dd582 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:56.114056 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c11475a2-81af-4e70-9fc2-14ae391dd582 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:56.122583 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c11475a2-81af-4e70-9fc2-14ae391dd582 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec" status: 200 len: 1507 microversion: 2.1 time: 0.165371 Oct 18 16:27:56.123181 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3408/6837] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:55 2022] GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec => generated 1507 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:56.146308 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e3cda553-0166-497f-8a80-4bdec149756b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:56.146937 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e3cda553-0166-497f-8a80-4bdec149756b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 95780f98-d9c7-4278-8608-273089d50fec] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:56.153060 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e3cda553-0166-497f-8a80-4bdec149756b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:56.153564 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e3cda553-0166-497f-8a80-4bdec149756b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:56.154020 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e3cda553-0166-497f-8a80-4bdec149756b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:56.154740 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e3cda553-0166-497f-8a80-4bdec149756b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:56.155217 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e3cda553-0166-497f-8a80-4bdec149756b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:56.155665 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e3cda553-0166-497f-8a80-4bdec149756b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:56.287214 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e3cda553-0166-497f-8a80-4bdec149756b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:56.294972 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e3cda553-0166-497f-8a80-4bdec149756b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec" status: 200 len: 1507 microversion: 2.1 time: 0.153293 Oct 18 16:27:56.295551 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3430/6838] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:56 2022] GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:56.317932 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ede3ede2-1fe9-491a-9f1a-dabc0c85fc83 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:27:56.320298 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ede3ede2-1fe9-491a-9f1a-dabc0c85fc83 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 95780f98-d9c7-4278-8608-273089d50fec] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:56.326233 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ede3ede2-1fe9-491a-9f1a-dabc0c85fc83 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:56.326737 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ede3ede2-1fe9-491a-9f1a-dabc0c85fc83 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:56.327166 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ede3ede2-1fe9-491a-9f1a-dabc0c85fc83 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:56.327847 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ede3ede2-1fe9-491a-9f1a-dabc0c85fc83 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:56.328338 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ede3ede2-1fe9-491a-9f1a-dabc0c85fc83 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:56.328752 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ede3ede2-1fe9-491a-9f1a-dabc0c85fc83 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:56.393598 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ede3ede2-1fe9-491a-9f1a-dabc0c85fc83 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "PUT /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec" status: 200 len: 1079 microversion: 2.1 time: 0.079546 Oct 18 16:27:56.394229 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3409/6839] 10.222.0.60 () {60 vars in 1256 bytes} [Tue Oct 18 16:27:56 2022] PUT /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec => generated 1079 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:27:56.413112 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-05ef3501-bf7c-473f-afcd-c2fe76b40777 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:56.413749 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-05ef3501-bf7c-473f-afcd-c2fe76b40777 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 95780f98-d9c7-4278-8608-273089d50fec] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:56.420011 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-05ef3501-bf7c-473f-afcd-c2fe76b40777 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:56.420517 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-05ef3501-bf7c-473f-afcd-c2fe76b40777 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:56.421009 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-05ef3501-bf7c-473f-afcd-c2fe76b40777 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:56.421754 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-05ef3501-bf7c-473f-afcd-c2fe76b40777 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:56.422209 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-05ef3501-bf7c-473f-afcd-c2fe76b40777 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:56.422921 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-05ef3501-bf7c-473f-afcd-c2fe76b40777 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:56.549868 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-05ef3501-bf7c-473f-afcd-c2fe76b40777 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:56.557627 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-05ef3501-bf7c-473f-afcd-c2fe76b40777 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec" status: 200 len: 1505 microversion: 2.1 time: 0.148499 Oct 18 16:27:56.558202 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3431/6840] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:56 2022] GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec => generated 1505 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:56.579823 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a4bf4923-1ea4-4be7-8d0c-09638ec64732 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:56.580441 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a4bf4923-1ea4-4be7-8d0c-09638ec64732 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 95780f98-d9c7-4278-8608-273089d50fec] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:56.586632 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4bf4923-1ea4-4be7-8d0c-09638ec64732 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:56.587118 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4bf4923-1ea4-4be7-8d0c-09638ec64732 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:56.587562 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4bf4923-1ea4-4be7-8d0c-09638ec64732 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:56.588259 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4bf4923-1ea4-4be7-8d0c-09638ec64732 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:56.588719 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4bf4923-1ea4-4be7-8d0c-09638ec64732 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:56.589198 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4bf4923-1ea4-4be7-8d0c-09638ec64732 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:56.723360 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a4bf4923-1ea4-4be7-8d0c-09638ec64732 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:56.731299 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a4bf4923-1ea4-4be7-8d0c-09638ec64732 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec" status: 200 len: 1505 microversion: 2.1 time: 0.155859 Oct 18 16:27:56.731882 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3410/6841] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:56 2022] GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:56.754215 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6fec2aa2-e887-42df-88dc-6b9666962776 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:27:56.756447 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6fec2aa2-e887-42df-88dc-6b9666962776 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 95780f98-d9c7-4278-8608-273089d50fec] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:56.762428 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6fec2aa2-e887-42df-88dc-6b9666962776 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:56.762928 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6fec2aa2-e887-42df-88dc-6b9666962776 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:56.763393 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6fec2aa2-e887-42df-88dc-6b9666962776 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:56.764101 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6fec2aa2-e887-42df-88dc-6b9666962776 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:56.764566 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6fec2aa2-e887-42df-88dc-6b9666962776 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:56.765043 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6fec2aa2-e887-42df-88dc-6b9666962776 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:56.794111 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6fec2aa2-e887-42df-88dc-6b9666962776 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:56.799812 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6fec2aa2-e887-42df-88dc-6b9666962776 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 95780f98-d9c7-4278-8608-273089d50fec] Old instance type m1.heat2, new instance type m1.heat {{(pid=120405) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 18 16:27:56.806431 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-6fec2aa2-e887-42df-88dc-6b9666962776 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:27:56.806869 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-6fec2aa2-e887-42df-88dc-6b9666962776 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:27:56.807364 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-6fec2aa2-e887-42df-88dc-6b9666962776 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:27:56.807793 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-6fec2aa2-e887-42df-88dc-6b9666962776 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:27:56.808223 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-6fec2aa2-e887-42df-88dc-6b9666962776 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:27:56.871174 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6fec2aa2-e887-42df-88dc-6b9666962776 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "POST /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec/action" status: 202 len: 0 microversion: 2.1 time: 0.121325 Oct 18 16:27:56.874737 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3432/6842] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:27:56 2022] POST /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:27:56.880506 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4d6c0c43-11dc-477c-890c-70f392417a5a tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:56.881390 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4d6c0c43-11dc-477c-890c-70f392417a5a tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 95780f98-d9c7-4278-8608-273089d50fec] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:56.887610 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d6c0c43-11dc-477c-890c-70f392417a5a tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:56.888101 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d6c0c43-11dc-477c-890c-70f392417a5a tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:56.888542 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d6c0c43-11dc-477c-890c-70f392417a5a tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:56.889287 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d6c0c43-11dc-477c-890c-70f392417a5a tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:56.889746 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d6c0c43-11dc-477c-890c-70f392417a5a tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:56.890171 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d6c0c43-11dc-477c-890c-70f392417a5a tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:57.057952 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4d6c0c43-11dc-477c-890c-70f392417a5a tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:57.066844 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4d6c0c43-11dc-477c-890c-70f392417a5a tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec" status: 200 len: 1516 microversion: 2.1 time: 0.190213 Oct 18 16:27:57.067418 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3411/6843] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:56 2022] GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec => generated 1516 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:58.088464 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:27:58.092669 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-962725f4-9ee4-4d52-89d6-e9e561ddc0d1 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:58.093325 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-962725f4-9ee4-4d52-89d6-e9e561ddc0d1 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 95780f98-d9c7-4278-8608-273089d50fec] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:58.103484 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-962725f4-9ee4-4d52-89d6-e9e561ddc0d1 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:58.103917 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-962725f4-9ee4-4d52-89d6-e9e561ddc0d1 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:58.104366 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-962725f4-9ee4-4d52-89d6-e9e561ddc0d1 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:58.105099 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-962725f4-9ee4-4d52-89d6-e9e561ddc0d1 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:58.105567 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-962725f4-9ee4-4d52-89d6-e9e561ddc0d1 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:58.106008 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-962725f4-9ee4-4d52-89d6-e9e561ddc0d1 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:58.251928 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-962725f4-9ee4-4d52-89d6-e9e561ddc0d1 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:58.260572 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-962725f4-9ee4-4d52-89d6-e9e561ddc0d1 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec" status: 200 len: 1516 microversion: 2.1 time: 0.173696 Oct 18 16:27:58.261205 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3433/6844] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:58 2022] GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec => generated 1516 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:27:59.284084 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6fefc977-ff93-45a2-9ab3-c07c93a69611 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:27:59.284713 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6fefc977-ff93-45a2-9ab3-c07c93a69611 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 95780f98-d9c7-4278-8608-273089d50fec] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:27:59.287876 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:27:59.288543 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:27:59.294347 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6fefc977-ff93-45a2-9ab3-c07c93a69611 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:59.294834 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6fefc977-ff93-45a2-9ab3-c07c93a69611 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:59.295275 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6fefc977-ff93-45a2-9ab3-c07c93a69611 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:59.295974 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6fefc977-ff93-45a2-9ab3-c07c93a69611 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:27:59.296434 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6fefc977-ff93-45a2-9ab3-c07c93a69611 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:27:59.298119 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6fefc977-ff93-45a2-9ab3-c07c93a69611 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:27:59.432248 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6fefc977-ff93-45a2-9ab3-c07c93a69611 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:27:59.440164 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6fefc977-ff93-45a2-9ab3-c07c93a69611 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec" status: 200 len: 1521 microversion: 2.1 time: 0.160488 Oct 18 16:27:59.440742 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3412/6845] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:27:59 2022] GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:00.463231 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-22f66772-1c81-48d0-8724-11a81c15171b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:00.463767 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-22f66772-1c81-48d0-8724-11a81c15171b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 95780f98-d9c7-4278-8608-273089d50fec] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:00.470774 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-22f66772-1c81-48d0-8724-11a81c15171b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:00.471303 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-22f66772-1c81-48d0-8724-11a81c15171b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:00.471753 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-22f66772-1c81-48d0-8724-11a81c15171b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:00.472463 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-22f66772-1c81-48d0-8724-11a81c15171b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:00.472981 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-22f66772-1c81-48d0-8724-11a81c15171b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:00.473426 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-22f66772-1c81-48d0-8724-11a81c15171b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:00.605481 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-22f66772-1c81-48d0-8724-11a81c15171b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:00.613896 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-22f66772-1c81-48d0-8724-11a81c15171b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec" status: 200 len: 1521 microversion: 2.1 time: 0.154719 Oct 18 16:28:00.614474 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3434/6846] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:00 2022] GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:01.636978 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-369fc8fe-6603-4064-a14b-29bb8d07ca08 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:01.637635 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-369fc8fe-6603-4064-a14b-29bb8d07ca08 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 95780f98-d9c7-4278-8608-273089d50fec] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:01.640327 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:28:01.646117 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-369fc8fe-6603-4064-a14b-29bb8d07ca08 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:01.646607 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-369fc8fe-6603-4064-a14b-29bb8d07ca08 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:01.647047 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-369fc8fe-6603-4064-a14b-29bb8d07ca08 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:01.647745 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-369fc8fe-6603-4064-a14b-29bb8d07ca08 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:01.648207 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-369fc8fe-6603-4064-a14b-29bb8d07ca08 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:01.648655 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-369fc8fe-6603-4064-a14b-29bb8d07ca08 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:01.653426 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:28:01.784468 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-369fc8fe-6603-4064-a14b-29bb8d07ca08 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:01.792305 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-369fc8fe-6603-4064-a14b-29bb8d07ca08 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec" status: 200 len: 1521 microversion: 2.1 time: 0.159368 Oct 18 16:28:01.792900 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3413/6847] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:01 2022] GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:02.816167 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-15df9f21-0a36-420e-bb42-3d56374f7900 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:02.816838 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-15df9f21-0a36-420e-bb42-3d56374f7900 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 95780f98-d9c7-4278-8608-273089d50fec] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:02.819566 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:28:02.825547 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-15df9f21-0a36-420e-bb42-3d56374f7900 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:02.826056 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-15df9f21-0a36-420e-bb42-3d56374f7900 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:02.826514 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-15df9f21-0a36-420e-bb42-3d56374f7900 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:02.827228 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-15df9f21-0a36-420e-bb42-3d56374f7900 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:02.827706 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-15df9f21-0a36-420e-bb42-3d56374f7900 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:02.828779 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-15df9f21-0a36-420e-bb42-3d56374f7900 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:02.959134 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-15df9f21-0a36-420e-bb42-3d56374f7900 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:02.967016 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-15df9f21-0a36-420e-bb42-3d56374f7900 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec" status: 200 len: 1521 microversion: 2.1 time: 0.155304 Oct 18 16:28:02.967590 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3435/6848] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:02 2022] GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:03.991517 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6006765e-934d-449c-9988-f0ac5e1d5171 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:03.992091 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6006765e-934d-449c-9988-f0ac5e1d5171 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 95780f98-d9c7-4278-8608-273089d50fec] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:03.999082 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6006765e-934d-449c-9988-f0ac5e1d5171 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:03.999565 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6006765e-934d-449c-9988-f0ac5e1d5171 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:04.000064 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6006765e-934d-449c-9988-f0ac5e1d5171 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:04.000762 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6006765e-934d-449c-9988-f0ac5e1d5171 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:04.001238 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6006765e-934d-449c-9988-f0ac5e1d5171 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:04.001657 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6006765e-934d-449c-9988-f0ac5e1d5171 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:04.137606 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6006765e-934d-449c-9988-f0ac5e1d5171 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:04.145430 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6006765e-934d-449c-9988-f0ac5e1d5171 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec" status: 200 len: 1521 microversion: 2.1 time: 0.157896 Oct 18 16:28:04.146314 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3414/6849] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:03 2022] GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:05.168666 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b98a67be-8be1-4927-974f-73f7419af600 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:05.169505 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b98a67be-8be1-4927-974f-73f7419af600 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 95780f98-d9c7-4278-8608-273089d50fec] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:05.176716 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b98a67be-8be1-4927-974f-73f7419af600 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:05.177290 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b98a67be-8be1-4927-974f-73f7419af600 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:05.177749 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b98a67be-8be1-4927-974f-73f7419af600 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:05.178508 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b98a67be-8be1-4927-974f-73f7419af600 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:05.178974 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b98a67be-8be1-4927-974f-73f7419af600 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:05.179421 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b98a67be-8be1-4927-974f-73f7419af600 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:05.316245 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b98a67be-8be1-4927-974f-73f7419af600 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:05.324021 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b98a67be-8be1-4927-974f-73f7419af600 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec" status: 200 len: 1521 microversion: 2.1 time: 0.159310 Oct 18 16:28:05.324618 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3436/6850] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:05 2022] GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:06.348139 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-55f0f412-d987-4620-82e2-f739bd3854d4 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:06.348681 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-55f0f412-d987-4620-82e2-f739bd3854d4 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 95780f98-d9c7-4278-8608-273089d50fec] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:06.355505 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55f0f412-d987-4620-82e2-f739bd3854d4 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:06.355987 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55f0f412-d987-4620-82e2-f739bd3854d4 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:06.356426 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55f0f412-d987-4620-82e2-f739bd3854d4 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:06.357148 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55f0f412-d987-4620-82e2-f739bd3854d4 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:06.357604 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55f0f412-d987-4620-82e2-f739bd3854d4 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:06.358029 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55f0f412-d987-4620-82e2-f739bd3854d4 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:06.488101 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-55f0f412-d987-4620-82e2-f739bd3854d4 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:06.495873 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-55f0f412-d987-4620-82e2-f739bd3854d4 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec" status: 200 len: 1521 microversion: 2.1 time: 0.152269 Oct 18 16:28:06.496463 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3415/6851] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:06 2022] GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:07.519154 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c6fd9353-fd63-4997-a2c8-d640fc7f93c6 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:07.519787 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c6fd9353-fd63-4997-a2c8-d640fc7f93c6 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 95780f98-d9c7-4278-8608-273089d50fec] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:07.526654 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c6fd9353-fd63-4997-a2c8-d640fc7f93c6 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:07.527151 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c6fd9353-fd63-4997-a2c8-d640fc7f93c6 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:07.527605 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c6fd9353-fd63-4997-a2c8-d640fc7f93c6 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:07.528314 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c6fd9353-fd63-4997-a2c8-d640fc7f93c6 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:07.528791 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c6fd9353-fd63-4997-a2c8-d640fc7f93c6 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:07.529252 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c6fd9353-fd63-4997-a2c8-d640fc7f93c6 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:07.662522 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c6fd9353-fd63-4997-a2c8-d640fc7f93c6 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:07.670301 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c6fd9353-fd63-4997-a2c8-d640fc7f93c6 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec" status: 200 len: 1521 microversion: 2.1 time: 0.155819 Oct 18 16:28:07.670873 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3437/6852] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:07 2022] GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:08.695376 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-04f48bd4-3a35-470b-8095-f4d8c1220ce3 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:08.696022 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-04f48bd4-3a35-470b-8095-f4d8c1220ce3 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 95780f98-d9c7-4278-8608-273089d50fec] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:08.702116 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04f48bd4-3a35-470b-8095-f4d8c1220ce3 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:08.702636 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04f48bd4-3a35-470b-8095-f4d8c1220ce3 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:08.703078 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04f48bd4-3a35-470b-8095-f4d8c1220ce3 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:08.703798 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04f48bd4-3a35-470b-8095-f4d8c1220ce3 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:08.704310 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04f48bd4-3a35-470b-8095-f4d8c1220ce3 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:08.704977 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04f48bd4-3a35-470b-8095-f4d8c1220ce3 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:08.834657 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-04f48bd4-3a35-470b-8095-f4d8c1220ce3 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:08.842403 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-04f48bd4-3a35-470b-8095-f4d8c1220ce3 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec" status: 200 len: 1521 microversion: 2.1 time: 0.151498 Oct 18 16:28:08.842984 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3416/6853] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:08 2022] GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:09.866321 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fadf169a-3a71-4874-94d8-1b0cfa364211 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:09.867073 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-fadf169a-3a71-4874-94d8-1b0cfa364211 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 95780f98-d9c7-4278-8608-273089d50fec] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:09.874221 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fadf169a-3a71-4874-94d8-1b0cfa364211 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:09.874717 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fadf169a-3a71-4874-94d8-1b0cfa364211 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:09.875166 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fadf169a-3a71-4874-94d8-1b0cfa364211 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:09.875935 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fadf169a-3a71-4874-94d8-1b0cfa364211 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:09.876753 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fadf169a-3a71-4874-94d8-1b0cfa364211 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:09.877565 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fadf169a-3a71-4874-94d8-1b0cfa364211 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:10.009685 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-fadf169a-3a71-4874-94d8-1b0cfa364211 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:10.017917 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fadf169a-3a71-4874-94d8-1b0cfa364211 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec" status: 200 len: 1521 microversion: 2.1 time: 0.155510 Oct 18 16:28:10.018488 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3438/6854] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:09 2022] GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:11.042870 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d2717308-130d-4ebf-bf54-3be7c0a6f694 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:11.043492 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d2717308-130d-4ebf-bf54-3be7c0a6f694 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 95780f98-d9c7-4278-8608-273089d50fec] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:11.050886 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2717308-130d-4ebf-bf54-3be7c0a6f694 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:11.051379 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2717308-130d-4ebf-bf54-3be7c0a6f694 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:11.051847 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2717308-130d-4ebf-bf54-3be7c0a6f694 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:11.052526 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2717308-130d-4ebf-bf54-3be7c0a6f694 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:11.053018 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2717308-130d-4ebf-bf54-3be7c0a6f694 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:11.053479 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2717308-130d-4ebf-bf54-3be7c0a6f694 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:11.187264 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d2717308-130d-4ebf-bf54-3be7c0a6f694 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:11.195780 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d2717308-130d-4ebf-bf54-3be7c0a6f694 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec" status: 200 len: 1521 microversion: 2.1 time: 0.156896 Oct 18 16:28:11.196367 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3417/6855] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:11 2022] GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:12.220099 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a1579eb3-1544-4949-9a39-7140a74cd74a tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:12.220737 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a1579eb3-1544-4949-9a39-7140a74cd74a tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 95780f98-d9c7-4278-8608-273089d50fec] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:12.227620 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a1579eb3-1544-4949-9a39-7140a74cd74a tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:12.228122 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a1579eb3-1544-4949-9a39-7140a74cd74a tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:12.228737 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a1579eb3-1544-4949-9a39-7140a74cd74a tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:12.229322 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a1579eb3-1544-4949-9a39-7140a74cd74a tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:12.229791 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a1579eb3-1544-4949-9a39-7140a74cd74a tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:12.230240 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a1579eb3-1544-4949-9a39-7140a74cd74a tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:12.362291 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a1579eb3-1544-4949-9a39-7140a74cd74a tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:12.370249 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a1579eb3-1544-4949-9a39-7140a74cd74a tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec" status: 200 len: 1521 microversion: 2.1 time: 0.154651 Oct 18 16:28:12.370833 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3439/6856] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:12 2022] GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:13.393699 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9b411b56-472f-4077-95bd-934984694043 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:13.394319 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9b411b56-472f-4077-95bd-934984694043 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 95780f98-d9c7-4278-8608-273089d50fec] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:13.401237 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9b411b56-472f-4077-95bd-934984694043 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:13.401718 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9b411b56-472f-4077-95bd-934984694043 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:13.402162 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9b411b56-472f-4077-95bd-934984694043 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:13.402853 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9b411b56-472f-4077-95bd-934984694043 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:13.403314 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9b411b56-472f-4077-95bd-934984694043 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:13.403744 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9b411b56-472f-4077-95bd-934984694043 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:13.537088 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9b411b56-472f-4077-95bd-934984694043 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:13.544953 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9b411b56-472f-4077-95bd-934984694043 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec" status: 200 len: 1521 microversion: 2.1 time: 0.155896 Oct 18 16:28:13.545542 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3418/6857] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:13 2022] GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:14.569143 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3f723e16-a4cd-47e8-86b9-280be764ed1c tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:14.569782 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3f723e16-a4cd-47e8-86b9-280be764ed1c tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 95780f98-d9c7-4278-8608-273089d50fec] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:14.576697 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3f723e16-a4cd-47e8-86b9-280be764ed1c tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:14.577230 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3f723e16-a4cd-47e8-86b9-280be764ed1c tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:14.577687 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3f723e16-a4cd-47e8-86b9-280be764ed1c tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:14.578403 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3f723e16-a4cd-47e8-86b9-280be764ed1c tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:14.578873 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3f723e16-a4cd-47e8-86b9-280be764ed1c tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:14.579314 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3f723e16-a4cd-47e8-86b9-280be764ed1c tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:14.711102 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3f723e16-a4cd-47e8-86b9-280be764ed1c tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:14.719013 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3f723e16-a4cd-47e8-86b9-280be764ed1c tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec" status: 200 len: 1521 microversion: 2.1 time: 0.154418 Oct 18 16:28:14.719584 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3440/6858] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:14 2022] GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:15.743240 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e6f62e8b-4ade-4119-8dce-77e280241686 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:15.743772 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e6f62e8b-4ade-4119-8dce-77e280241686 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 95780f98-d9c7-4278-8608-273089d50fec] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:15.750736 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6f62e8b-4ade-4119-8dce-77e280241686 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:15.751242 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6f62e8b-4ade-4119-8dce-77e280241686 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:15.752175 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6f62e8b-4ade-4119-8dce-77e280241686 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:15.752894 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6f62e8b-4ade-4119-8dce-77e280241686 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:15.753471 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6f62e8b-4ade-4119-8dce-77e280241686 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:15.753901 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6f62e8b-4ade-4119-8dce-77e280241686 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:15.889802 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e6f62e8b-4ade-4119-8dce-77e280241686 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:15.897703 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e6f62e8b-4ade-4119-8dce-77e280241686 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec" status: 200 len: 1521 microversion: 2.1 time: 0.158571 Oct 18 16:28:15.898285 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3419/6859] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:15 2022] GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:16.920819 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2a6c96c9-d4c1-4b00-9ca2-040ac0ff2796 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:16.921466 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2a6c96c9-d4c1-4b00-9ca2-040ac0ff2796 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 95780f98-d9c7-4278-8608-273089d50fec] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:16.928585 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a6c96c9-d4c1-4b00-9ca2-040ac0ff2796 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:16.929125 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a6c96c9-d4c1-4b00-9ca2-040ac0ff2796 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:16.929625 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a6c96c9-d4c1-4b00-9ca2-040ac0ff2796 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:16.930343 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a6c96c9-d4c1-4b00-9ca2-040ac0ff2796 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:16.930844 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a6c96c9-d4c1-4b00-9ca2-040ac0ff2796 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:16.931294 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a6c96c9-d4c1-4b00-9ca2-040ac0ff2796 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:16.935454 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:28:17.063911 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2a6c96c9-d4c1-4b00-9ca2-040ac0ff2796 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:17.072287 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2a6c96c9-d4c1-4b00-9ca2-040ac0ff2796 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec" status: 200 len: 1521 microversion: 2.1 time: 0.155372 Oct 18 16:28:17.072881 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3441/6860] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:16 2022] GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:18.096087 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-26358e6f-67fe-4196-b5f4-cb8e00eb2fa9 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:18.096713 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-26358e6f-67fe-4196-b5f4-cb8e00eb2fa9 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 95780f98-d9c7-4278-8608-273089d50fec] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:18.103564 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26358e6f-67fe-4196-b5f4-cb8e00eb2fa9 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:18.104053 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26358e6f-67fe-4196-b5f4-cb8e00eb2fa9 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:18.104488 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26358e6f-67fe-4196-b5f4-cb8e00eb2fa9 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:18.105210 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26358e6f-67fe-4196-b5f4-cb8e00eb2fa9 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:18.105667 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26358e6f-67fe-4196-b5f4-cb8e00eb2fa9 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:18.106095 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26358e6f-67fe-4196-b5f4-cb8e00eb2fa9 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:18.235834 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-26358e6f-67fe-4196-b5f4-cb8e00eb2fa9 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:18.244072 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-26358e6f-67fe-4196-b5f4-cb8e00eb2fa9 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec" status: 200 len: 1521 microversion: 2.1 time: 0.152097 Oct 18 16:28:18.244652 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3420/6861] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:18 2022] GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:19.267626 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7cb0a0fc-6684-4eaa-8add-a9e68f63b42a tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:19.268800 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7cb0a0fc-6684-4eaa-8add-a9e68f63b42a tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 95780f98-d9c7-4278-8608-273089d50fec] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:19.275672 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7cb0a0fc-6684-4eaa-8add-a9e68f63b42a tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:19.276176 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7cb0a0fc-6684-4eaa-8add-a9e68f63b42a tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:19.276629 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7cb0a0fc-6684-4eaa-8add-a9e68f63b42a tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:19.277510 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7cb0a0fc-6684-4eaa-8add-a9e68f63b42a tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:19.277984 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7cb0a0fc-6684-4eaa-8add-a9e68f63b42a tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:19.278427 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7cb0a0fc-6684-4eaa-8add-a9e68f63b42a tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:19.410610 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7cb0a0fc-6684-4eaa-8add-a9e68f63b42a tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:19.418440 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7cb0a0fc-6684-4eaa-8add-a9e68f63b42a tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec" status: 200 len: 1521 microversion: 2.1 time: 0.154825 Oct 18 16:28:19.419015 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3442/6862] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:19 2022] GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:20.442488 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ea9ad16d-72b3-4db5-9e75-56a7539892a5 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:20.443090 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ea9ad16d-72b3-4db5-9e75-56a7539892a5 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 95780f98-d9c7-4278-8608-273089d50fec] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:20.450052 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea9ad16d-72b3-4db5-9e75-56a7539892a5 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:20.450561 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea9ad16d-72b3-4db5-9e75-56a7539892a5 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:20.450998 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea9ad16d-72b3-4db5-9e75-56a7539892a5 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:20.451692 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea9ad16d-72b3-4db5-9e75-56a7539892a5 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:20.452147 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea9ad16d-72b3-4db5-9e75-56a7539892a5 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:20.452572 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea9ad16d-72b3-4db5-9e75-56a7539892a5 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:20.580824 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ea9ad16d-72b3-4db5-9e75-56a7539892a5 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:20.588642 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ea9ad16d-72b3-4db5-9e75-56a7539892a5 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec" status: 200 len: 1521 microversion: 2.1 time: 0.150865 Oct 18 16:28:20.589252 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3421/6863] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:20 2022] GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:21.611098 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5293e878-30fe-48b1-9b90-9f80c749c94d tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:21.611705 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5293e878-30fe-48b1-9b90-9f80c749c94d tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 95780f98-d9c7-4278-8608-273089d50fec] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:21.619372 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5293e878-30fe-48b1-9b90-9f80c749c94d tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:21.619875 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5293e878-30fe-48b1-9b90-9f80c749c94d tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:21.620331 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5293e878-30fe-48b1-9b90-9f80c749c94d tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:21.621081 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5293e878-30fe-48b1-9b90-9f80c749c94d tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:21.621557 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5293e878-30fe-48b1-9b90-9f80c749c94d tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:21.622003 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5293e878-30fe-48b1-9b90-9f80c749c94d tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:21.755926 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5293e878-30fe-48b1-9b90-9f80c749c94d tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:21.763735 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5293e878-30fe-48b1-9b90-9f80c749c94d tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec" status: 200 len: 1521 microversion: 2.1 time: 0.156552 Oct 18 16:28:21.764314 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3443/6864] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:21 2022] GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:22.787836 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5c263af4-995a-4dec-80fc-4be601ebbc05 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:22.788442 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5c263af4-995a-4dec-80fc-4be601ebbc05 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 95780f98-d9c7-4278-8608-273089d50fec] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:22.795710 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c263af4-995a-4dec-80fc-4be601ebbc05 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:22.796194 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c263af4-995a-4dec-80fc-4be601ebbc05 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:22.796629 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c263af4-995a-4dec-80fc-4be601ebbc05 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:22.797621 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c263af4-995a-4dec-80fc-4be601ebbc05 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:22.798084 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c263af4-995a-4dec-80fc-4be601ebbc05 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:22.798509 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c263af4-995a-4dec-80fc-4be601ebbc05 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:22.930231 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5c263af4-995a-4dec-80fc-4be601ebbc05 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:22.938171 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5c263af4-995a-4dec-80fc-4be601ebbc05 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec" status: 200 len: 1521 microversion: 2.1 time: 0.154790 Oct 18 16:28:22.938774 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3422/6865] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:22 2022] GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:23.962477 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-59cdda9c-e4f3-4a78-9426-58a795a69e43 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:23.963069 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-59cdda9c-e4f3-4a78-9426-58a795a69e43 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 95780f98-d9c7-4278-8608-273089d50fec] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:23.969985 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-59cdda9c-e4f3-4a78-9426-58a795a69e43 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:23.970489 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-59cdda9c-e4f3-4a78-9426-58a795a69e43 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:23.970947 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-59cdda9c-e4f3-4a78-9426-58a795a69e43 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:23.971658 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-59cdda9c-e4f3-4a78-9426-58a795a69e43 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:23.972133 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-59cdda9c-e4f3-4a78-9426-58a795a69e43 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:23.972580 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-59cdda9c-e4f3-4a78-9426-58a795a69e43 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:24.105156 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-59cdda9c-e4f3-4a78-9426-58a795a69e43 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:24.114130 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-59cdda9c-e4f3-4a78-9426-58a795a69e43 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec" status: 200 len: 1521 microversion: 2.1 time: 0.156134 Oct 18 16:28:24.114709 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3444/6866] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:23 2022] GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:25.137340 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-83b4a72f-9e0e-4c85-a844-0c6b477f8e79 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:25.137968 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-83b4a72f-9e0e-4c85-a844-0c6b477f8e79 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 95780f98-d9c7-4278-8608-273089d50fec] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:25.144741 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83b4a72f-9e0e-4c85-a844-0c6b477f8e79 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:25.145259 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83b4a72f-9e0e-4c85-a844-0c6b477f8e79 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:25.145699 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83b4a72f-9e0e-4c85-a844-0c6b477f8e79 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:25.146388 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83b4a72f-9e0e-4c85-a844-0c6b477f8e79 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:25.146840 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83b4a72f-9e0e-4c85-a844-0c6b477f8e79 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:25.147265 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83b4a72f-9e0e-4c85-a844-0c6b477f8e79 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:25.282746 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-83b4a72f-9e0e-4c85-a844-0c6b477f8e79 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:25.291195 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-83b4a72f-9e0e-4c85-a844-0c6b477f8e79 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec" status: 200 len: 1521 microversion: 2.1 time: 0.157828 Oct 18 16:28:25.291779 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3423/6867] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:25 2022] GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:26.315427 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f3522e83-8b62-413e-8625-ce16b76bf310 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:26.316063 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f3522e83-8b62-413e-8625-ce16b76bf310 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 95780f98-d9c7-4278-8608-273089d50fec] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:26.322677 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f3522e83-8b62-413e-8625-ce16b76bf310 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:26.323175 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f3522e83-8b62-413e-8625-ce16b76bf310 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:26.323632 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f3522e83-8b62-413e-8625-ce16b76bf310 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:26.324343 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f3522e83-8b62-413e-8625-ce16b76bf310 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:26.324918 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f3522e83-8b62-413e-8625-ce16b76bf310 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:26.325390 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f3522e83-8b62-413e-8625-ce16b76bf310 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:26.405088 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-d8da88cf-af30-4f68-aeda-153806b57cb2 req-cb1e68c2-d844-41fd-bf2c-ade0cdec786f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95780f98-d9c7-4278-8608-273089d50fec", "name": "network-vif-unplugged", "status": "completed", "tag": "2e68dbae-65c0-4976-a493-aacda6e1aa8d"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:28:26.415858 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d8da88cf-af30-4f68-aeda-153806b57cb2 req-cb1e68c2-d844-41fd-bf2c-ade0cdec786f service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:26.416532 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d8da88cf-af30-4f68-aeda-153806b57cb2 req-cb1e68c2-d844-41fd-bf2c-ade0cdec786f service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:26.417021 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d8da88cf-af30-4f68-aeda-153806b57cb2 req-cb1e68c2-d844-41fd-bf2c-ade0cdec786f service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:26.430611 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-d8da88cf-af30-4f68-aeda-153806b57cb2 req-cb1e68c2-d844-41fd-bf2c-ade0cdec786f service nova] Creating event network-vif-unplugged:2e68dbae-65c0-4976-a493-aacda6e1aa8d for instance 95780f98-d9c7-4278-8608-273089d50fec on n-h1-853682-5 Oct 18 16:28:26.437206 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [req-d8da88cf-af30-4f68-aeda-153806b57cb2 req-cb1e68c2-d844-41fd-bf2c-ade0cdec786f service nova] Instance 95780f98-d9c7-4278-8608-273089d50fec is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853682-5', 'n-h1-853682-5'} {{(pid=120406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 18 16:28:26.449846 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-d8da88cf-af30-4f68-aeda-153806b57cb2 req-cb1e68c2-d844-41fd-bf2c-ade0cdec786f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048761 Oct 18 16:28:26.450821 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3424/6868] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:28:26.464535 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f3522e83-8b62-413e-8625-ce16b76bf310 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:26.472323 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f3522e83-8b62-413e-8625-ce16b76bf310 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec" status: 200 len: 1520 microversion: 2.1 time: 0.161144 Oct 18 16:28:26.484844 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3445/6869] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:26 2022] GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:27.497033 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b76e0aec-cc44-4627-be0c-4328f9b1d559 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:27.497659 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b76e0aec-cc44-4627-be0c-4328f9b1d559 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 95780f98-d9c7-4278-8608-273089d50fec] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:27.503834 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b76e0aec-cc44-4627-be0c-4328f9b1d559 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:27.504345 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b76e0aec-cc44-4627-be0c-4328f9b1d559 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:27.505306 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b76e0aec-cc44-4627-be0c-4328f9b1d559 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:27.506000 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b76e0aec-cc44-4627-be0c-4328f9b1d559 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:27.506459 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b76e0aec-cc44-4627-be0c-4328f9b1d559 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:27.506889 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b76e0aec-cc44-4627-be0c-4328f9b1d559 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:27.640455 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b76e0aec-cc44-4627-be0c-4328f9b1d559 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:27.648944 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b76e0aec-cc44-4627-be0c-4328f9b1d559 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec" status: 200 len: 1518 microversion: 2.1 time: 0.157105 Oct 18 16:28:27.649522 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3425/6870] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:27 2022] GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:28.465037 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-1d8e55d9-e94a-4f8e-a804-f31ac781a79b req-9ddc5793-30cb-4954-83a7-c94bc84627e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95780f98-d9c7-4278-8608-273089d50fec", "tag": "2e68dbae-65c0-4976-a493-aacda6e1aa8d"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:28:28.475184 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-1d8e55d9-e94a-4f8e-a804-f31ac781a79b req-9ddc5793-30cb-4954-83a7-c94bc84627e1 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:28.475677 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-1d8e55d9-e94a-4f8e-a804-f31ac781a79b req-9ddc5793-30cb-4954-83a7-c94bc84627e1 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:28.476121 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-1d8e55d9-e94a-4f8e-a804-f31ac781a79b req-9ddc5793-30cb-4954-83a7-c94bc84627e1 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:28.487873 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-1d8e55d9-e94a-4f8e-a804-f31ac781a79b req-9ddc5793-30cb-4954-83a7-c94bc84627e1 service nova] Creating event network-changed:2e68dbae-65c0-4976-a493-aacda6e1aa8d for instance 95780f98-d9c7-4278-8608-273089d50fec on n-h1-853682-5 Oct 18 16:28:28.493158 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [req-1d8e55d9-e94a-4f8e-a804-f31ac781a79b req-9ddc5793-30cb-4954-83a7-c94bc84627e1 service nova] Instance 95780f98-d9c7-4278-8608-273089d50fec is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853682-5', 'n-h1-853682-5'} {{(pid=120405) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 18 16:28:28.504305 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-1d8e55d9-e94a-4f8e-a804-f31ac781a79b req-9ddc5793-30cb-4954-83a7-c94bc84627e1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043016 Oct 18 16:28:28.505470 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3446/6871] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:28:28.672434 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e591d20d-576b-484b-bf99-a58d9e160919 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:28.673198 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e591d20d-576b-484b-bf99-a58d9e160919 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 95780f98-d9c7-4278-8608-273089d50fec] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:28.680512 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e591d20d-576b-484b-bf99-a58d9e160919 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:28.681039 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e591d20d-576b-484b-bf99-a58d9e160919 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:28.681487 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e591d20d-576b-484b-bf99-a58d9e160919 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:28.682198 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e591d20d-576b-484b-bf99-a58d9e160919 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:28.682663 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e591d20d-576b-484b-bf99-a58d9e160919 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:28.683092 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e591d20d-576b-484b-bf99-a58d9e160919 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:28.819361 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e591d20d-576b-484b-bf99-a58d9e160919 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:28.827198 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e591d20d-576b-484b-bf99-a58d9e160919 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec" status: 200 len: 1518 microversion: 2.1 time: 0.158938 Oct 18 16:28:28.827789 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3426/6872] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:28 2022] GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:29.851972 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c7bb289b-921a-4fb9-88cb-4be126a8aab2 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:29.852689 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c7bb289b-921a-4fb9-88cb-4be126a8aab2 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 95780f98-d9c7-4278-8608-273089d50fec] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:29.858799 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c7bb289b-921a-4fb9-88cb-4be126a8aab2 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:29.859322 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c7bb289b-921a-4fb9-88cb-4be126a8aab2 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:29.859808 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c7bb289b-921a-4fb9-88cb-4be126a8aab2 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:29.860525 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c7bb289b-921a-4fb9-88cb-4be126a8aab2 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:29.861024 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c7bb289b-921a-4fb9-88cb-4be126a8aab2 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:29.861469 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c7bb289b-921a-4fb9-88cb-4be126a8aab2 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:29.998574 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c7bb289b-921a-4fb9-88cb-4be126a8aab2 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:30.006711 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c7bb289b-921a-4fb9-88cb-4be126a8aab2 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec" status: 200 len: 1518 microversion: 2.1 time: 0.160448 Oct 18 16:28:30.007288 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3447/6873] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:29 2022] GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:31.030491 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cf775864-51e3-40df-a58e-3d9f74a4f8a4 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:31.031036 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cf775864-51e3-40df-a58e-3d9f74a4f8a4 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 95780f98-d9c7-4278-8608-273089d50fec] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:31.038598 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf775864-51e3-40df-a58e-3d9f74a4f8a4 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:31.039127 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf775864-51e3-40df-a58e-3d9f74a4f8a4 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:31.039517 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf775864-51e3-40df-a58e-3d9f74a4f8a4 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:31.040214 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf775864-51e3-40df-a58e-3d9f74a4f8a4 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:31.040667 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf775864-51e3-40df-a58e-3d9f74a4f8a4 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:31.041126 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf775864-51e3-40df-a58e-3d9f74a4f8a4 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:31.169858 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cf775864-51e3-40df-a58e-3d9f74a4f8a4 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:31.177928 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cf775864-51e3-40df-a58e-3d9f74a4f8a4 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec" status: 200 len: 1515 microversion: 2.1 time: 0.151528 Oct 18 16:28:31.178505 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3427/6874] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:31 2022] GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:31.200715 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fa0594eb-2fc8-4932-8440-2ef6a1dedd06 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:28:31.201336 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-fa0594eb-2fc8-4932-8440-2ef6a1dedd06 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 95780f98-d9c7-4278-8608-273089d50fec] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:31.209609 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fa0594eb-2fc8-4932-8440-2ef6a1dedd06 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:31.210112 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fa0594eb-2fc8-4932-8440-2ef6a1dedd06 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:31.210573 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fa0594eb-2fc8-4932-8440-2ef6a1dedd06 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:31.211331 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fa0594eb-2fc8-4932-8440-2ef6a1dedd06 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:31.211807 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fa0594eb-2fc8-4932-8440-2ef6a1dedd06 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:31.212250 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fa0594eb-2fc8-4932-8440-2ef6a1dedd06 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:31.278268 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fa0594eb-2fc8-4932-8440-2ef6a1dedd06 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "POST /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec/action" status: 204 len: 0 microversion: 2.1 time: 0.081287 Oct 18 16:28:31.279298 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3448/6875] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:28:31 2022] POST /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec/action => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:28:31.287555 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5d170221-cf70-4e74-8668-611976312c98 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:31.288232 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5d170221-cf70-4e74-8668-611976312c98 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 95780f98-d9c7-4278-8608-273089d50fec] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:31.294655 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d170221-cf70-4e74-8668-611976312c98 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:31.295537 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d170221-cf70-4e74-8668-611976312c98 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:31.295999 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d170221-cf70-4e74-8668-611976312c98 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:31.296704 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d170221-cf70-4e74-8668-611976312c98 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:31.297534 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d170221-cf70-4e74-8668-611976312c98 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:31.298144 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d170221-cf70-4e74-8668-611976312c98 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:31.434798 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5d170221-cf70-4e74-8668-611976312c98 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:31.443505 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5d170221-cf70-4e74-8668-611976312c98 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec" status: 200 len: 1515 microversion: 2.1 time: 0.159871 Oct 18 16:28:31.444347 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3428/6876] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:31 2022] GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:32.469720 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1013a188-2646-4d6e-9163-8a3339d56102 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:32.470447 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1013a188-2646-4d6e-9163-8a3339d56102 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 95780f98-d9c7-4278-8608-273089d50fec] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:32.478634 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1013a188-2646-4d6e-9163-8a3339d56102 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:32.479136 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1013a188-2646-4d6e-9163-8a3339d56102 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:32.479586 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1013a188-2646-4d6e-9163-8a3339d56102 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:32.480302 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1013a188-2646-4d6e-9163-8a3339d56102 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:32.480773 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1013a188-2646-4d6e-9163-8a3339d56102 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:32.481243 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1013a188-2646-4d6e-9163-8a3339d56102 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:32.618519 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1013a188-2646-4d6e-9163-8a3339d56102 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:32.626257 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1013a188-2646-4d6e-9163-8a3339d56102 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec" status: 200 len: 1507 microversion: 2.1 time: 0.161980 Oct 18 16:28:32.626828 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3449/6877] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:32 2022] GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:28:32.650336 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-787899f9-c4da-4be7-a115-49c8fff06126 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:32.651020 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-787899f9-c4da-4be7-a115-49c8fff06126 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 95780f98-d9c7-4278-8608-273089d50fec] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:32.653827 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=32 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:28:32.659297 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-787899f9-c4da-4be7-a115-49c8fff06126 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:32.659783 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-787899f9-c4da-4be7-a115-49c8fff06126 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:32.660218 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-787899f9-c4da-4be7-a115-49c8fff06126 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:32.660954 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-787899f9-c4da-4be7-a115-49c8fff06126 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:32.661705 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-787899f9-c4da-4be7-a115-49c8fff06126 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:32.662134 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-787899f9-c4da-4be7-a115-49c8fff06126 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:32.664978 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=94 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:28:32.800654 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-787899f9-c4da-4be7-a115-49c8fff06126 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:32.809329 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-787899f9-c4da-4be7-a115-49c8fff06126 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec" status: 200 len: 1507 microversion: 2.1 time: 0.163869 Oct 18 16:28:32.809931 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3429/6878] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:32 2022] GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec => generated 1507 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:32.829236 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-b632f286-8f82-401b-bac4-247ef02ac151 req-d9d9fc45-d893-4017-82d3-69e514b8eb3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95780f98-d9c7-4278-8608-273089d50fec", "name": "network-vif-plugged", "status": "completed", "tag": "2e68dbae-65c0-4976-a493-aacda6e1aa8d"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:28:32.835555 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=30 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:28:32.837701 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4026d3ea-379e-436c-b6e8-b5bd8e9679c0 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Action: 'create', calling method: .version_select at 0x7f7c3d732940>, body: {"keypair": {"name": "tempest-keypair-1129487910", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMs77FQKETxhOH/llaQQ5ax4FOlMx7g9pp2Ffpd1tp7zjUd6PUC5g8+SXjDtBNUySqisI/FAMTBzdMBuPD283MQzbvlMylebBcSjIAXA5LMgEKBswr+irWf9v5DEgfGo5w=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:28:32.843006 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-b632f286-8f82-401b-bac4-247ef02ac151 req-d9d9fc45-d893-4017-82d3-69e514b8eb3c service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:32.843406 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-b632f286-8f82-401b-bac4-247ef02ac151 req-d9d9fc45-d893-4017-82d3-69e514b8eb3c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:32.843853 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-b632f286-8f82-401b-bac4-247ef02ac151 req-d9d9fc45-d893-4017-82d3-69e514b8eb3c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:32.854346 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-4026d3ea-379e-436c-b6e8-b5bd8e9679c0 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Getting quotas for project 5507238aeefa4b24b06cd3c30c7f7cc3. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:28:32.856160 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-b632f286-8f82-401b-bac4-247ef02ac151 req-d9d9fc45-d893-4017-82d3-69e514b8eb3c service nova] Creating event network-vif-plugged:2e68dbae-65c0-4976-a493-aacda6e1aa8d for instance 95780f98-d9c7-4278-8608-273089d50fec on n-h1-853682-5 Oct 18 16:28:32.859944 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-4026d3ea-379e-436c-b6e8-b5bd8e9679c0 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Getting quotas for user a82485198bb545ae9c05590584d65af9 and project 5507238aeefa4b24b06cd3c30c7f7cc3. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:28:32.862124 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-b632f286-8f82-401b-bac4-247ef02ac151 req-d9d9fc45-d893-4017-82d3-69e514b8eb3c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036070 Oct 18 16:28:32.862583 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3450/6879] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:28:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:28:32.886182 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4026d3ea-379e-436c-b6e8-b5bd8e9679c0 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053607 Oct 18 16:28:32.886913 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3430/6880] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Oct 18 16:28:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:28:34.315717 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8a799154-778b-4be7-8dee-636a3dfe7927 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:34.316444 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8a799154-778b-4be7-8dee-636a3dfe7927 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 95780f98-d9c7-4278-8608-273089d50fec] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:34.324057 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8a799154-778b-4be7-8dee-636a3dfe7927 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:34.324559 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8a799154-778b-4be7-8dee-636a3dfe7927 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:34.325041 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8a799154-778b-4be7-8dee-636a3dfe7927 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:34.325757 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8a799154-778b-4be7-8dee-636a3dfe7927 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:34.326231 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8a799154-778b-4be7-8dee-636a3dfe7927 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:34.326678 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8a799154-778b-4be7-8dee-636a3dfe7927 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:34.456795 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8a799154-778b-4be7-8dee-636a3dfe7927 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:34.465093 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8a799154-778b-4be7-8dee-636a3dfe7927 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec" status: 200 len: 1507 microversion: 2.1 time: 0.153986 Oct 18 16:28:34.465664 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3451/6881] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:34 2022] GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:34.487345 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-81135bf0-4c1b-4723-8d29-5e7965bcad97 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:34.487867 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-81135bf0-4c1b-4723-8d29-5e7965bcad97 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 95780f98-d9c7-4278-8608-273089d50fec] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:34.495760 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81135bf0-4c1b-4723-8d29-5e7965bcad97 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:34.496247 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81135bf0-4c1b-4723-8d29-5e7965bcad97 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:34.496689 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81135bf0-4c1b-4723-8d29-5e7965bcad97 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:34.497411 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81135bf0-4c1b-4723-8d29-5e7965bcad97 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:34.497870 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81135bf0-4c1b-4723-8d29-5e7965bcad97 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:34.498298 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81135bf0-4c1b-4723-8d29-5e7965bcad97 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:34.523050 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-81135bf0-4c1b-4723-8d29-5e7965bcad97 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 95780f98-d9c7-4278-8608-273089d50fec] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:28:34.598033 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-81135bf0-4c1b-4723-8d29-5e7965bcad97 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "DELETE /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec" status: 204 len: 0 microversion: 2.1 time: 0.114239 Oct 18 16:28:34.599036 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3431/6882] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 16:28:34 2022] DELETE /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:28:34.654945 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5fa4351b-a137-4917-b5b8-5d017a421442 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-60821700", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "6699b3a9-87b4-42d4-9360-f761b4b00a95"}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:28:34.708840 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-5fa4351b-a137-4917-b5b8-5d017a421442 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] validate_networks() for [('6699b3a9-87b4-42d4-9360-f761b4b00a95', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 16:28:35.074286 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-5fa4351b-a137-4917-b5b8-5d017a421442 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:28:35.074756 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-5fa4351b-a137-4917-b5b8-5d017a421442 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:28:35.075251 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-5fa4351b-a137-4917-b5b8-5d017a421442 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:28:35.075680 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-5fa4351b-a137-4917-b5b8-5d017a421442 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:28:35.076157 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-5fa4351b-a137-4917-b5b8-5d017a421442 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:28:35.085069 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5fa4351b-a137-4917-b5b8-5d017a421442 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:35.085568 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5fa4351b-a137-4917-b5b8-5d017a421442 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:35.086022 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5fa4351b-a137-4917-b5b8-5d017a421442 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:35.086768 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5fa4351b-a137-4917-b5b8-5d017a421442 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:35.087241 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5fa4351b-a137-4917-b5b8-5d017a421442 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:35.087685 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5fa4351b-a137-4917-b5b8-5d017a421442 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:35.104850 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-5fa4351b-a137-4917-b5b8-5d017a421442 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Getting quotas for project 5507238aeefa4b24b06cd3c30c7f7cc3. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:28:35.110177 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-5fa4351b-a137-4917-b5b8-5d017a421442 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Getting quotas for user a82485198bb545ae9c05590584d65af9 and project 5507238aeefa4b24b06cd3c30c7f7cc3. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:28:35.123479 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5fa4351b-a137-4917-b5b8-5d017a421442 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:28:35.125850 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5fa4351b-a137-4917-b5b8-5d017a421442 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:28:35.169488 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5fa4351b-a137-4917-b5b8-5d017a421442 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.518486 Oct 18 16:28:35.170050 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3452/6883] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 16:28:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 520 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:28:35.183029 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0f504b48-b201-425b-aa5e-ca59d18bb1d5 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:35.183383 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0f504b48-b201-425b-aa5e-ca59d18bb1d5 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:35.244752 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0f504b48-b201-425b-aa5e-ca59d18bb1d5 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:35.252367 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0f504b48-b201-425b-aa5e-ca59d18bb1d5 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a" status: 200 len: 1216 microversion: 2.1 time: 0.074019 Oct 18 16:28:35.252971 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3432/6884] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:35 2022] GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a => generated 1216 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:36.276496 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b3047c96-ef56-4db9-8c65-4a59327796a3 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:36.277164 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b3047c96-ef56-4db9-8c65-4a59327796a3 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:36.287100 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b3047c96-ef56-4db9-8c65-4a59327796a3 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:36.287608 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b3047c96-ef56-4db9-8c65-4a59327796a3 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:36.288067 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b3047c96-ef56-4db9-8c65-4a59327796a3 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:36.288785 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b3047c96-ef56-4db9-8c65-4a59327796a3 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:36.289286 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b3047c96-ef56-4db9-8c65-4a59327796a3 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:36.289736 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b3047c96-ef56-4db9-8c65-4a59327796a3 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:36.354242 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b3047c96-ef56-4db9-8c65-4a59327796a3 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:36.362454 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b3047c96-ef56-4db9-8c65-4a59327796a3 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a" status: 200 len: 1268 microversion: 2.1 time: 0.090918 Oct 18 16:28:36.363033 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3453/6885] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:36 2022] GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a => generated 1268 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:36.991853 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-821385dd-05c4-4838-a4de-d7e8bc797346 req-063b75c6-2119-48d4-9afa-68959931c7f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95780f98-d9c7-4278-8608-273089d50fec", "name": "network-vif-deleted", "tag": "2e68dbae-65c0-4976-a493-aacda6e1aa8d"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:28:37.004630 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-821385dd-05c4-4838-a4de-d7e8bc797346 req-063b75c6-2119-48d4-9afa-68959931c7f3 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:37.005910 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-821385dd-05c4-4838-a4de-d7e8bc797346 req-063b75c6-2119-48d4-9afa-68959931c7f3 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:37.006443 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-821385dd-05c4-4838-a4de-d7e8bc797346 req-063b75c6-2119-48d4-9afa-68959931c7f3 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:37.018820 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-821385dd-05c4-4838-a4de-d7e8bc797346 req-063b75c6-2119-48d4-9afa-68959931c7f3 service nova] Creating event network-vif-deleted:2e68dbae-65c0-4976-a493-aacda6e1aa8d for instance 95780f98-d9c7-4278-8608-273089d50fec on n-h1-853682-5 Oct 18 16:28:37.024540 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-821385dd-05c4-4838-a4de-d7e8bc797346 req-063b75c6-2119-48d4-9afa-68959931c7f3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037451 Oct 18 16:28:37.025612 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3433/6886] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:28:37.386232 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-10f2e504-400c-4f8b-98b0-a1ea48fa8bdd tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:37.389369 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-10f2e504-400c-4f8b-98b0-a1ea48fa8bdd tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:37.397069 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-10f2e504-400c-4f8b-98b0-a1ea48fa8bdd tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:37.398622 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-10f2e504-400c-4f8b-98b0-a1ea48fa8bdd tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:37.399080 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-10f2e504-400c-4f8b-98b0-a1ea48fa8bdd tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:37.399977 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-10f2e504-400c-4f8b-98b0-a1ea48fa8bdd tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:37.403783 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-10f2e504-400c-4f8b-98b0-a1ea48fa8bdd tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:37.404654 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-10f2e504-400c-4f8b-98b0-a1ea48fa8bdd tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:37.687370 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-10f2e504-400c-4f8b-98b0-a1ea48fa8bdd tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:37.695990 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-10f2e504-400c-4f8b-98b0-a1ea48fa8bdd tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a" status: 200 len: 1316 microversion: 2.1 time: 0.314517 Oct 18 16:28:37.696596 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3454/6887] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:37 2022] GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a => generated 1316 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:38.126087 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-415496f6-fbb5-45f0-804b-f2676c35d80e req-81ccd1f4-5ef3-47e8-9c53-2b9f95ce53a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a", "tag": "b3f49e85-a356-451c-a1db-37e99738cb4d"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:28:38.137918 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-415496f6-fbb5-45f0-804b-f2676c35d80e req-81ccd1f4-5ef3-47e8-9c53-2b9f95ce53a8 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:38.138403 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-415496f6-fbb5-45f0-804b-f2676c35d80e req-81ccd1f4-5ef3-47e8-9c53-2b9f95ce53a8 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:38.138841 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-415496f6-fbb5-45f0-804b-f2676c35d80e req-81ccd1f4-5ef3-47e8-9c53-2b9f95ce53a8 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:38.150331 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-415496f6-fbb5-45f0-804b-f2676c35d80e req-81ccd1f4-5ef3-47e8-9c53-2b9f95ce53a8 service nova] Creating event network-changed:b3f49e85-a356-451c-a1db-37e99738cb4d for instance 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a on n-h1-853682-5 Oct 18 16:28:38.155332 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-415496f6-fbb5-45f0-804b-f2676c35d80e req-81ccd1f4-5ef3-47e8-9c53-2b9f95ce53a8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035761 Oct 18 16:28:38.156230 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3434/6888] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:28:38.721398 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-10817fc3-cccc-4491-99a1-b4fa6276bb5a tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:38.722081 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-10817fc3-cccc-4491-99a1-b4fa6276bb5a tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:38.729099 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-10817fc3-cccc-4491-99a1-b4fa6276bb5a tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:38.729599 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-10817fc3-cccc-4491-99a1-b4fa6276bb5a tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:38.730053 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-10817fc3-cccc-4491-99a1-b4fa6276bb5a tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:38.730765 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-10817fc3-cccc-4491-99a1-b4fa6276bb5a tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:38.731242 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-10817fc3-cccc-4491-99a1-b4fa6276bb5a tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:38.731721 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-10817fc3-cccc-4491-99a1-b4fa6276bb5a tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:38.865696 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-10817fc3-cccc-4491-99a1-b4fa6276bb5a tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:38.873288 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-10817fc3-cccc-4491-99a1-b4fa6276bb5a tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a" status: 200 len: 1316 microversion: 2.1 time: 0.155856 Oct 18 16:28:38.873857 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3455/6889] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:38 2022] GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a => generated 1316 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:39.897397 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-219fe02f-81e5-45ce-80db-6e2d1ddb1de5 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:39.898097 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-219fe02f-81e5-45ce-80db-6e2d1ddb1de5 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:39.905130 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-219fe02f-81e5-45ce-80db-6e2d1ddb1de5 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:39.905608 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-219fe02f-81e5-45ce-80db-6e2d1ddb1de5 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:39.906041 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-219fe02f-81e5-45ce-80db-6e2d1ddb1de5 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:39.906728 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-219fe02f-81e5-45ce-80db-6e2d1ddb1de5 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:39.907180 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-219fe02f-81e5-45ce-80db-6e2d1ddb1de5 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:39.907605 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-219fe02f-81e5-45ce-80db-6e2d1ddb1de5 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:40.038920 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-219fe02f-81e5-45ce-80db-6e2d1ddb1de5 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:40.046638 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-219fe02f-81e5-45ce-80db-6e2d1ddb1de5 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a" status: 200 len: 1316 microversion: 2.1 time: 0.154065 Oct 18 16:28:40.047483 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3435/6890] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:39 2022] GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:41.071020 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4ce7def9-c6e2-4606-8200-1604d9e82ec2 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:41.072202 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4ce7def9-c6e2-4606-8200-1604d9e82ec2 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:41.079292 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ce7def9-c6e2-4606-8200-1604d9e82ec2 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:41.079795 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ce7def9-c6e2-4606-8200-1604d9e82ec2 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:41.080270 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ce7def9-c6e2-4606-8200-1604d9e82ec2 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:41.081129 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ce7def9-c6e2-4606-8200-1604d9e82ec2 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:41.081504 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ce7def9-c6e2-4606-8200-1604d9e82ec2 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:41.081961 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ce7def9-c6e2-4606-8200-1604d9e82ec2 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:41.212562 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4ce7def9-c6e2-4606-8200-1604d9e82ec2 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:41.220341 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4ce7def9-c6e2-4606-8200-1604d9e82ec2 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a" status: 200 len: 1316 microversion: 2.1 time: 0.154420 Oct 18 16:28:41.220955 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3456/6891] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:41 2022] GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:42.243500 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3229f578-5c05-4f7a-800a-fac236b3d69b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:42.244121 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3229f578-5c05-4f7a-800a-fac236b3d69b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:42.251117 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3229f578-5c05-4f7a-800a-fac236b3d69b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:42.251607 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3229f578-5c05-4f7a-800a-fac236b3d69b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:42.252051 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3229f578-5c05-4f7a-800a-fac236b3d69b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:42.252752 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3229f578-5c05-4f7a-800a-fac236b3d69b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:42.253239 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3229f578-5c05-4f7a-800a-fac236b3d69b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:42.253668 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3229f578-5c05-4f7a-800a-fac236b3d69b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:42.385916 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3229f578-5c05-4f7a-800a-fac236b3d69b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:42.393473 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3229f578-5c05-4f7a-800a-fac236b3d69b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a" status: 200 len: 1316 microversion: 2.1 time: 0.154084 Oct 18 16:28:42.394045 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3436/6892] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:42 2022] GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:43.416162 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d30628d4-1259-4c67-89d8-a7eb8148c2f3 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:43.416784 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d30628d4-1259-4c67-89d8-a7eb8148c2f3 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:43.424106 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d30628d4-1259-4c67-89d8-a7eb8148c2f3 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:43.424641 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d30628d4-1259-4c67-89d8-a7eb8148c2f3 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:43.425131 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d30628d4-1259-4c67-89d8-a7eb8148c2f3 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:43.425852 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d30628d4-1259-4c67-89d8-a7eb8148c2f3 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:43.426327 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d30628d4-1259-4c67-89d8-a7eb8148c2f3 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:43.426812 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d30628d4-1259-4c67-89d8-a7eb8148c2f3 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:43.558037 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d30628d4-1259-4c67-89d8-a7eb8148c2f3 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:43.565836 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d30628d4-1259-4c67-89d8-a7eb8148c2f3 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a" status: 200 len: 1316 microversion: 2.1 time: 0.153661 Oct 18 16:28:43.566409 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3457/6893] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:43 2022] GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:28:44.588248 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d622f797-2e13-4cc4-a891-4162df43eff2 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:44.588905 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d622f797-2e13-4cc4-a891-4162df43eff2 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:44.595807 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d622f797-2e13-4cc4-a891-4162df43eff2 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:44.596288 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d622f797-2e13-4cc4-a891-4162df43eff2 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:44.596720 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d622f797-2e13-4cc4-a891-4162df43eff2 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:44.597437 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d622f797-2e13-4cc4-a891-4162df43eff2 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:44.597893 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d622f797-2e13-4cc4-a891-4162df43eff2 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:44.598320 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d622f797-2e13-4cc4-a891-4162df43eff2 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:44.736327 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d622f797-2e13-4cc4-a891-4162df43eff2 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:44.744779 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d622f797-2e13-4cc4-a891-4162df43eff2 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a" status: 200 len: 1316 microversion: 2.1 time: 0.160428 Oct 18 16:28:44.745466 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3437/6894] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:44 2022] GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a => generated 1316 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:44.871179 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-cb6ee647-2e62-4a2a-a1b1-db59b8dd83f9 req-9df7da6d-16ad-4f82-b024-5dcecdd75398 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a", "name": "network-vif-plugged", "status": "completed", "tag": "b3f49e85-a356-451c-a1db-37e99738cb4d"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:28:44.882347 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-cb6ee647-2e62-4a2a-a1b1-db59b8dd83f9 req-9df7da6d-16ad-4f82-b024-5dcecdd75398 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:44.882850 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-cb6ee647-2e62-4a2a-a1b1-db59b8dd83f9 req-9df7da6d-16ad-4f82-b024-5dcecdd75398 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:44.883298 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-cb6ee647-2e62-4a2a-a1b1-db59b8dd83f9 req-9df7da6d-16ad-4f82-b024-5dcecdd75398 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:44.894834 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-cb6ee647-2e62-4a2a-a1b1-db59b8dd83f9 req-9df7da6d-16ad-4f82-b024-5dcecdd75398 service nova] Creating event network-vif-plugged:b3f49e85-a356-451c-a1db-37e99738cb4d for instance 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a on n-h1-853682-5 Oct 18 16:28:44.899790 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-cb6ee647-2e62-4a2a-a1b1-db59b8dd83f9 req-9df7da6d-16ad-4f82-b024-5dcecdd75398 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032465 Oct 18 16:28:44.900397 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3458/6895] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:28:45.768699 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cd11c1ec-be76-46a4-8822-14b9325849ef tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:45.769310 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cd11c1ec-be76-46a4-8822-14b9325849ef tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:45.771934 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:28:45.778119 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd11c1ec-be76-46a4-8822-14b9325849ef tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:45.778601 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd11c1ec-be76-46a4-8822-14b9325849ef tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:45.779036 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd11c1ec-be76-46a4-8822-14b9325849ef tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:45.779725 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd11c1ec-be76-46a4-8822-14b9325849ef tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:45.780180 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd11c1ec-be76-46a4-8822-14b9325849ef tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:45.780605 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd11c1ec-be76-46a4-8822-14b9325849ef tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:45.907872 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cd11c1ec-be76-46a4-8822-14b9325849ef tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:45.916210 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cd11c1ec-be76-46a4-8822-14b9325849ef tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a" status: 200 len: 1316 microversion: 2.1 time: 0.152432 Oct 18 16:28:45.916788 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3438/6896] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:45 2022] GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:46.937095 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:28:46.937969 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=6 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:28:46.943674 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-83daff00-72f5-4e39-a46c-5ae4a522a863 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:46.944433 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-83daff00-72f5-4e39-a46c-5ae4a522a863 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:46.951160 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-83daff00-72f5-4e39-a46c-5ae4a522a863 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:46.951648 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-83daff00-72f5-4e39-a46c-5ae4a522a863 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:46.952094 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-83daff00-72f5-4e39-a46c-5ae4a522a863 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:46.952790 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-83daff00-72f5-4e39-a46c-5ae4a522a863 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:46.953278 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-83daff00-72f5-4e39-a46c-5ae4a522a863 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:46.953715 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-83daff00-72f5-4e39-a46c-5ae4a522a863 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:46.957648 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:28:47.093789 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-83daff00-72f5-4e39-a46c-5ae4a522a863 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:47.101977 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-83daff00-72f5-4e39-a46c-5ae4a522a863 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a" status: 200 len: 1506 microversion: 2.1 time: 0.165890 Oct 18 16:28:47.102558 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3459/6897] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:46 2022] GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a => generated 1506 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:47.125685 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-958b3be4-3e55-498c-8bb1-2153df463fd5 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:47.126315 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-958b3be4-3e55-498c-8bb1-2153df463fd5 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:47.133066 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-958b3be4-3e55-498c-8bb1-2153df463fd5 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:47.133556 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-958b3be4-3e55-498c-8bb1-2153df463fd5 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:47.133998 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-958b3be4-3e55-498c-8bb1-2153df463fd5 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:47.134693 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-958b3be4-3e55-498c-8bb1-2153df463fd5 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:47.135155 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-958b3be4-3e55-498c-8bb1-2153df463fd5 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:47.135584 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-958b3be4-3e55-498c-8bb1-2153df463fd5 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:47.264439 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-958b3be4-3e55-498c-8bb1-2153df463fd5 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:47.272724 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-958b3be4-3e55-498c-8bb1-2153df463fd5 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a" status: 200 len: 1506 microversion: 2.1 time: 0.151585 Oct 18 16:28:47.273335 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3439/6898] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:47 2022] GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:47.295206 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-34f20546-56ad-4d08-bc21-e8017adbfb4b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:28:47.297784 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-34f20546-56ad-4d08-bc21-e8017adbfb4b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:47.303735 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-34f20546-56ad-4d08-bc21-e8017adbfb4b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:47.304230 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-34f20546-56ad-4d08-bc21-e8017adbfb4b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:47.304672 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-34f20546-56ad-4d08-bc21-e8017adbfb4b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:47.305399 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-34f20546-56ad-4d08-bc21-e8017adbfb4b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:47.305857 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-34f20546-56ad-4d08-bc21-e8017adbfb4b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:47.306289 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-34f20546-56ad-4d08-bc21-e8017adbfb4b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:47.333832 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-34f20546-56ad-4d08-bc21-e8017adbfb4b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:47.339144 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-34f20546-56ad-4d08-bc21-e8017adbfb4b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a] Old instance type m1.heat2, new instance type m1.heat {{(pid=120405) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 18 16:28:47.345596 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-34f20546-56ad-4d08-bc21-e8017adbfb4b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:28:47.346026 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-34f20546-56ad-4d08-bc21-e8017adbfb4b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:28:47.346505 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-34f20546-56ad-4d08-bc21-e8017adbfb4b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:28:47.346922 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-34f20546-56ad-4d08-bc21-e8017adbfb4b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:28:47.347341 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-34f20546-56ad-4d08-bc21-e8017adbfb4b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:28:47.409898 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-34f20546-56ad-4d08-bc21-e8017adbfb4b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "POST /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a/action" status: 202 len: 0 microversion: 2.1 time: 0.118643 Oct 18 16:28:47.410579 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3460/6899] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:28:47 2022] POST /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:28:47.419242 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-78ba698a-0c2e-40a1-80ce-9de0a36a8cd1 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:47.419865 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-78ba698a-0c2e-40a1-80ce-9de0a36a8cd1 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:47.426498 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-78ba698a-0c2e-40a1-80ce-9de0a36a8cd1 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:47.427090 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-78ba698a-0c2e-40a1-80ce-9de0a36a8cd1 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:47.427530 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-78ba698a-0c2e-40a1-80ce-9de0a36a8cd1 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:47.428225 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-78ba698a-0c2e-40a1-80ce-9de0a36a8cd1 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:47.428683 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-78ba698a-0c2e-40a1-80ce-9de0a36a8cd1 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:47.429211 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-78ba698a-0c2e-40a1-80ce-9de0a36a8cd1 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:47.819118 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-78ba698a-0c2e-40a1-80ce-9de0a36a8cd1 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:47.827006 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-78ba698a-0c2e-40a1-80ce-9de0a36a8cd1 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a" status: 200 len: 1513 microversion: 2.1 time: 0.411623 Oct 18 16:28:47.827589 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3440/6900] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:47 2022] GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a => generated 1513 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:48.852491 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-df366b65-73ce-4f18-ac9f-b58ea870deca tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:48.853155 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-df366b65-73ce-4f18-ac9f-b58ea870deca tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:48.860043 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-df366b65-73ce-4f18-ac9f-b58ea870deca tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:48.860978 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-df366b65-73ce-4f18-ac9f-b58ea870deca tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:48.861344 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-df366b65-73ce-4f18-ac9f-b58ea870deca tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:48.862069 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-df366b65-73ce-4f18-ac9f-b58ea870deca tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:48.862543 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-df366b65-73ce-4f18-ac9f-b58ea870deca tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:48.863061 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-df366b65-73ce-4f18-ac9f-b58ea870deca tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:49.081187 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-df366b65-73ce-4f18-ac9f-b58ea870deca tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:49.089403 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-df366b65-73ce-4f18-ac9f-b58ea870deca tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a" status: 200 len: 1513 microversion: 2.1 time: 0.242257 Oct 18 16:28:49.090014 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3461/6901] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:48 2022] GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a => generated 1513 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:50.113088 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-621b2ab2-7624-483b-847d-c02d8f497493 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:50.113734 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-621b2ab2-7624-483b-847d-c02d8f497493 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:50.121270 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-621b2ab2-7624-483b-847d-c02d8f497493 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:50.121747 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-621b2ab2-7624-483b-847d-c02d8f497493 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:50.122177 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-621b2ab2-7624-483b-847d-c02d8f497493 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:50.122856 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-621b2ab2-7624-483b-847d-c02d8f497493 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:50.123303 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-621b2ab2-7624-483b-847d-c02d8f497493 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:50.123754 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-621b2ab2-7624-483b-847d-c02d8f497493 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:50.253070 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-621b2ab2-7624-483b-847d-c02d8f497493 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:50.261038 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-621b2ab2-7624-483b-847d-c02d8f497493 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a" status: 200 len: 1518 microversion: 2.1 time: 0.151813 Oct 18 16:28:50.261841 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3441/6902] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:50 2022] GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a => generated 1518 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:51.284754 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-69fe8047-d08e-4273-889e-935182e8ff6b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:51.285449 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-69fe8047-d08e-4273-889e-935182e8ff6b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:51.293122 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-69fe8047-d08e-4273-889e-935182e8ff6b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:51.293609 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-69fe8047-d08e-4273-889e-935182e8ff6b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:51.294067 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-69fe8047-d08e-4273-889e-935182e8ff6b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:51.294811 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-69fe8047-d08e-4273-889e-935182e8ff6b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:51.295285 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-69fe8047-d08e-4273-889e-935182e8ff6b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:51.295730 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-69fe8047-d08e-4273-889e-935182e8ff6b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:51.422983 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-69fe8047-d08e-4273-889e-935182e8ff6b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:51.430663 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-69fe8047-d08e-4273-889e-935182e8ff6b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a" status: 200 len: 1518 microversion: 2.1 time: 0.149860 Oct 18 16:28:51.431247 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3462/6903] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:51 2022] GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a => generated 1518 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:52.454431 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-62f85435-5126-4b88-852a-810f094c160e tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:52.455132 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-62f85435-5126-4b88-852a-810f094c160e tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:52.462630 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62f85435-5126-4b88-852a-810f094c160e tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:52.463306 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62f85435-5126-4b88-852a-810f094c160e tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:52.463743 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62f85435-5126-4b88-852a-810f094c160e tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:52.464443 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62f85435-5126-4b88-852a-810f094c160e tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:52.464922 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62f85435-5126-4b88-852a-810f094c160e tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:52.465395 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62f85435-5126-4b88-852a-810f094c160e tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:52.648567 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-62f85435-5126-4b88-852a-810f094c160e tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:52.656308 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-62f85435-5126-4b88-852a-810f094c160e tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a" status: 200 len: 1518 microversion: 2.1 time: 0.205971 Oct 18 16:28:52.656910 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3442/6904] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:52 2022] GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a => generated 1518 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:53.680974 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7aec4b9e-57f0-4d5e-a2c4-f130269ad50a tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:53.681618 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7aec4b9e-57f0-4d5e-a2c4-f130269ad50a tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:53.688794 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7aec4b9e-57f0-4d5e-a2c4-f130269ad50a tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:53.689327 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7aec4b9e-57f0-4d5e-a2c4-f130269ad50a tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:53.689786 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7aec4b9e-57f0-4d5e-a2c4-f130269ad50a tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:53.690512 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7aec4b9e-57f0-4d5e-a2c4-f130269ad50a tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:53.690988 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7aec4b9e-57f0-4d5e-a2c4-f130269ad50a tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:53.691444 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7aec4b9e-57f0-4d5e-a2c4-f130269ad50a tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:53.870378 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7aec4b9e-57f0-4d5e-a2c4-f130269ad50a tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:53.878063 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7aec4b9e-57f0-4d5e-a2c4-f130269ad50a tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a" status: 200 len: 1518 microversion: 2.1 time: 0.201659 Oct 18 16:28:53.878632 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3463/6905] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:53 2022] GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a => generated 1518 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:54.901603 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1af93fee-11a9-41cb-959d-8ba88ed07bf8 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:54.902216 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1af93fee-11a9-41cb-959d-8ba88ed07bf8 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:54.909497 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1af93fee-11a9-41cb-959d-8ba88ed07bf8 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:54.909977 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1af93fee-11a9-41cb-959d-8ba88ed07bf8 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:54.910411 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1af93fee-11a9-41cb-959d-8ba88ed07bf8 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:54.911129 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1af93fee-11a9-41cb-959d-8ba88ed07bf8 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:54.911580 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1af93fee-11a9-41cb-959d-8ba88ed07bf8 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:54.912002 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1af93fee-11a9-41cb-959d-8ba88ed07bf8 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:55.047488 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1af93fee-11a9-41cb-959d-8ba88ed07bf8 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:55.055622 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1af93fee-11a9-41cb-959d-8ba88ed07bf8 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a" status: 200 len: 1518 microversion: 2.1 time: 0.157892 Oct 18 16:28:55.056209 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3443/6906] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:54 2022] GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:56.080288 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-de81514f-4a76-4369-918b-d5fb68e63971 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:56.080941 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-de81514f-4a76-4369-918b-d5fb68e63971 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:56.089066 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de81514f-4a76-4369-918b-d5fb68e63971 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:56.089573 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de81514f-4a76-4369-918b-d5fb68e63971 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:56.090061 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de81514f-4a76-4369-918b-d5fb68e63971 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:56.090783 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de81514f-4a76-4369-918b-d5fb68e63971 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:56.091286 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de81514f-4a76-4369-918b-d5fb68e63971 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:56.091728 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de81514f-4a76-4369-918b-d5fb68e63971 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:56.222495 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-de81514f-4a76-4369-918b-d5fb68e63971 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:56.230768 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-de81514f-4a76-4369-918b-d5fb68e63971 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a" status: 200 len: 1518 microversion: 2.1 time: 0.154411 Oct 18 16:28:56.231341 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3464/6907] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:56 2022] GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:57.253440 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-65a3d791-1a1c-447c-b842-15d2520a30bd tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:57.254062 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-65a3d791-1a1c-447c-b842-15d2520a30bd tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:57.261645 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65a3d791-1a1c-447c-b842-15d2520a30bd tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:57.262132 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65a3d791-1a1c-447c-b842-15d2520a30bd tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:57.262571 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65a3d791-1a1c-447c-b842-15d2520a30bd tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:57.263270 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65a3d791-1a1c-447c-b842-15d2520a30bd tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:57.263757 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65a3d791-1a1c-447c-b842-15d2520a30bd tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:57.264188 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65a3d791-1a1c-447c-b842-15d2520a30bd tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:57.396758 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-65a3d791-1a1c-447c-b842-15d2520a30bd tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:57.404551 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-65a3d791-1a1c-447c-b842-15d2520a30bd tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a" status: 200 len: 1518 microversion: 2.1 time: 0.155096 Oct 18 16:28:57.405162 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3444/6908] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:57 2022] GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:58.428687 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4a499968-909f-4f75-a224-bed4ff8b0e8e tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:58.429321 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4a499968-909f-4f75-a224-bed4ff8b0e8e tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:58.436345 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4a499968-909f-4f75-a224-bed4ff8b0e8e tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:58.436872 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4a499968-909f-4f75-a224-bed4ff8b0e8e tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:58.437335 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4a499968-909f-4f75-a224-bed4ff8b0e8e tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:58.438052 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4a499968-909f-4f75-a224-bed4ff8b0e8e tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:58.438533 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4a499968-909f-4f75-a224-bed4ff8b0e8e tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:58.438980 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4a499968-909f-4f75-a224-bed4ff8b0e8e tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:58.569740 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4a499968-909f-4f75-a224-bed4ff8b0e8e tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:58.577528 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4a499968-909f-4f75-a224-bed4ff8b0e8e tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a" status: 200 len: 1518 microversion: 2.1 time: 0.153719 Oct 18 16:28:58.578109 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3465/6909] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:58 2022] GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:28:59.601117 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-498c08f1-57bd-4dbc-b6b0-d0a1a5f65c42 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:28:59.601738 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-498c08f1-57bd-4dbc-b6b0-d0a1a5f65c42 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:28:59.608553 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-498c08f1-57bd-4dbc-b6b0-d0a1a5f65c42 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:59.609075 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-498c08f1-57bd-4dbc-b6b0-d0a1a5f65c42 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:59.609524 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-498c08f1-57bd-4dbc-b6b0-d0a1a5f65c42 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:59.610218 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-498c08f1-57bd-4dbc-b6b0-d0a1a5f65c42 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:28:59.610681 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-498c08f1-57bd-4dbc-b6b0-d0a1a5f65c42 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:28:59.611116 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-498c08f1-57bd-4dbc-b6b0-d0a1a5f65c42 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:28:59.740393 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-498c08f1-57bd-4dbc-b6b0-d0a1a5f65c42 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:28:59.748198 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-498c08f1-57bd-4dbc-b6b0-d0a1a5f65c42 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a" status: 200 len: 1518 microversion: 2.1 time: 0.151575 Oct 18 16:28:59.748951 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3445/6910] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:28:59 2022] GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a => generated 1518 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:00.771889 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4322bd4c-2147-4fde-8018-2ab561762aa0 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:00.772510 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4322bd4c-2147-4fde-8018-2ab561762aa0 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:00.779327 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4322bd4c-2147-4fde-8018-2ab561762aa0 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:00.779819 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4322bd4c-2147-4fde-8018-2ab561762aa0 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:00.780265 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4322bd4c-2147-4fde-8018-2ab561762aa0 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:00.780996 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4322bd4c-2147-4fde-8018-2ab561762aa0 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:00.781459 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4322bd4c-2147-4fde-8018-2ab561762aa0 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:00.781895 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4322bd4c-2147-4fde-8018-2ab561762aa0 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:00.916586 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4322bd4c-2147-4fde-8018-2ab561762aa0 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:00.924695 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4322bd4c-2147-4fde-8018-2ab561762aa0 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a" status: 200 len: 1518 microversion: 2.1 time: 0.157269 Oct 18 16:29:00.925304 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3466/6911] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:00 2022] GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:01.947835 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-20ceadd2-2958-42b5-8895-29aec6928738 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:01.948378 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-20ceadd2-2958-42b5-8895-29aec6928738 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:01.955186 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20ceadd2-2958-42b5-8895-29aec6928738 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:01.955698 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20ceadd2-2958-42b5-8895-29aec6928738 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:01.956132 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20ceadd2-2958-42b5-8895-29aec6928738 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:01.956847 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20ceadd2-2958-42b5-8895-29aec6928738 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:01.957421 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20ceadd2-2958-42b5-8895-29aec6928738 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:01.957849 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20ceadd2-2958-42b5-8895-29aec6928738 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:02.086885 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-20ceadd2-2958-42b5-8895-29aec6928738 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:02.094675 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-20ceadd2-2958-42b5-8895-29aec6928738 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a" status: 200 len: 1518 microversion: 2.1 time: 0.150991 Oct 18 16:29:02.095260 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3446/6912] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:01 2022] GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a => generated 1518 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:03.118344 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7ae4d904-78b9-4bb1-b024-e883b23b5c38 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:03.118978 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7ae4d904-78b9-4bb1-b024-e883b23b5c38 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:03.121699 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:29:03.127847 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7ae4d904-78b9-4bb1-b024-e883b23b5c38 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:03.128346 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7ae4d904-78b9-4bb1-b024-e883b23b5c38 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:03.128823 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7ae4d904-78b9-4bb1-b024-e883b23b5c38 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:03.130039 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7ae4d904-78b9-4bb1-b024-e883b23b5c38 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:03.130516 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7ae4d904-78b9-4bb1-b024-e883b23b5c38 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:03.130960 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7ae4d904-78b9-4bb1-b024-e883b23b5c38 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:03.264015 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7ae4d904-78b9-4bb1-b024-e883b23b5c38 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:03.272330 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7ae4d904-78b9-4bb1-b024-e883b23b5c38 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a" status: 200 len: 1518 microversion: 2.1 time: 0.158019 Oct 18 16:29:03.272915 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3467/6913] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:03 2022] GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:04.295003 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6280031a-dec0-4929-b68f-f7a0468d4a15 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:04.295621 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6280031a-dec0-4929-b68f-f7a0468d4a15 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:04.299132 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:29:04.304829 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6280031a-dec0-4929-b68f-f7a0468d4a15 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:04.305310 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6280031a-dec0-4929-b68f-f7a0468d4a15 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:04.305744 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6280031a-dec0-4929-b68f-f7a0468d4a15 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:04.306438 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6280031a-dec0-4929-b68f-f7a0468d4a15 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:04.306887 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6280031a-dec0-4929-b68f-f7a0468d4a15 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:04.307308 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6280031a-dec0-4929-b68f-f7a0468d4a15 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:04.311321 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:29:04.443316 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6280031a-dec0-4929-b68f-f7a0468d4a15 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:04.451092 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6280031a-dec0-4929-b68f-f7a0468d4a15 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a" status: 200 len: 1518 microversion: 2.1 time: 0.160033 Oct 18 16:29:04.451667 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3447/6914] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:04 2022] GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:05.474223 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-852032f6-14a5-402a-906a-e7d5ec801d0b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:05.474855 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-852032f6-14a5-402a-906a-e7d5ec801d0b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:05.477872 n-d-853682-5 devstack@n-api.service[120405]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 16:29:05.478010 n-d-853682-5 devstack@n-api.service[120405]: Tue Oct 18 16:29:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a (ip 10.222.0.60) !!! Oct 18 16:29:05.486158 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-852032f6-14a5-402a-906a-e7d5ec801d0b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:05.486661 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-852032f6-14a5-402a-906a-e7d5ec801d0b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:05.487146 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-852032f6-14a5-402a-906a-e7d5ec801d0b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:05.487885 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-852032f6-14a5-402a-906a-e7d5ec801d0b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:05.488461 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-852032f6-14a5-402a-906a-e7d5ec801d0b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:05.488963 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-852032f6-14a5-402a-906a-e7d5ec801d0b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:05.618521 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-852032f6-14a5-402a-906a-e7d5ec801d0b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:05.626263 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-852032f6-14a5-402a-906a-e7d5ec801d0b tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a" status: 200 len: 1518 microversion: 2.1 time: 0.156056 Oct 18 16:29:05.626835 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3468/6915] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:05 2022] GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:29:06.650557 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-15c6cf2f-6ecd-4e27-88bd-81bbea2ba680 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:06.651170 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-15c6cf2f-6ecd-4e27-88bd-81bbea2ba680 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:06.657985 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15c6cf2f-6ecd-4e27-88bd-81bbea2ba680 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:06.658465 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15c6cf2f-6ecd-4e27-88bd-81bbea2ba680 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:06.658894 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15c6cf2f-6ecd-4e27-88bd-81bbea2ba680 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:06.659579 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15c6cf2f-6ecd-4e27-88bd-81bbea2ba680 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:06.660027 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15c6cf2f-6ecd-4e27-88bd-81bbea2ba680 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:06.661035 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15c6cf2f-6ecd-4e27-88bd-81bbea2ba680 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:06.796672 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-15c6cf2f-6ecd-4e27-88bd-81bbea2ba680 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:06.804529 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-15c6cf2f-6ecd-4e27-88bd-81bbea2ba680 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a" status: 200 len: 1518 microversion: 2.1 time: 0.157909 Oct 18 16:29:06.805144 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3448/6916] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:06 2022] GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:07.828010 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-49429199-c670-4356-844f-d7fe3498e3ad tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:07.828671 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-49429199-c670-4356-844f-d7fe3498e3ad tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:07.835753 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-49429199-c670-4356-844f-d7fe3498e3ad tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:07.836247 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-49429199-c670-4356-844f-d7fe3498e3ad tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:07.836700 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-49429199-c670-4356-844f-d7fe3498e3ad tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:07.837443 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-49429199-c670-4356-844f-d7fe3498e3ad tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:07.837917 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-49429199-c670-4356-844f-d7fe3498e3ad tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:07.838361 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-49429199-c670-4356-844f-d7fe3498e3ad tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:07.970820 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-49429199-c670-4356-844f-d7fe3498e3ad tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:07.979138 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-49429199-c670-4356-844f-d7fe3498e3ad tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a" status: 200 len: 1518 microversion: 2.1 time: 0.155051 Oct 18 16:29:07.979713 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3469/6917] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:07 2022] GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:09.003076 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7a4d1d3b-d225-4b6e-9d92-123fc20ca3f7 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:09.003701 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7a4d1d3b-d225-4b6e-9d92-123fc20ca3f7 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:09.010887 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a4d1d3b-d225-4b6e-9d92-123fc20ca3f7 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:09.011409 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a4d1d3b-d225-4b6e-9d92-123fc20ca3f7 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:09.011851 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a4d1d3b-d225-4b6e-9d92-123fc20ca3f7 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:09.012588 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a4d1d3b-d225-4b6e-9d92-123fc20ca3f7 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:09.013075 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a4d1d3b-d225-4b6e-9d92-123fc20ca3f7 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:09.013550 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a4d1d3b-d225-4b6e-9d92-123fc20ca3f7 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:09.152433 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7a4d1d3b-d225-4b6e-9d92-123fc20ca3f7 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:09.161121 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7a4d1d3b-d225-4b6e-9d92-123fc20ca3f7 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a" status: 200 len: 1518 microversion: 2.1 time: 0.161655 Oct 18 16:29:09.161710 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3449/6918] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:08 2022] GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a => generated 1518 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:10.185388 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-984cae05-c762-41f9-bf3f-b2c61747f503 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:10.186016 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-984cae05-c762-41f9-bf3f-b2c61747f503 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:10.193467 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-984cae05-c762-41f9-bf3f-b2c61747f503 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:10.194123 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-984cae05-c762-41f9-bf3f-b2c61747f503 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:10.194577 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-984cae05-c762-41f9-bf3f-b2c61747f503 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:10.195291 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-984cae05-c762-41f9-bf3f-b2c61747f503 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:10.195761 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-984cae05-c762-41f9-bf3f-b2c61747f503 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:10.196198 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-984cae05-c762-41f9-bf3f-b2c61747f503 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:10.326753 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-984cae05-c762-41f9-bf3f-b2c61747f503 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:10.334741 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-984cae05-c762-41f9-bf3f-b2c61747f503 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a" status: 200 len: 1518 microversion: 2.1 time: 0.153215 Oct 18 16:29:10.335325 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3470/6919] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:10 2022] GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:11.357449 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7db9a086-251a-4b15-b095-69889ef144dc tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:11.358061 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7db9a086-251a-4b15-b095-69889ef144dc tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:11.365448 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7db9a086-251a-4b15-b095-69889ef144dc tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:11.365923 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7db9a086-251a-4b15-b095-69889ef144dc tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:11.366347 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7db9a086-251a-4b15-b095-69889ef144dc tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:11.367020 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7db9a086-251a-4b15-b095-69889ef144dc tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:11.367498 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7db9a086-251a-4b15-b095-69889ef144dc tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:11.367914 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7db9a086-251a-4b15-b095-69889ef144dc tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:11.500069 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7db9a086-251a-4b15-b095-69889ef144dc tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:11.508149 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7db9a086-251a-4b15-b095-69889ef144dc tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a" status: 200 len: 1518 microversion: 2.1 time: 0.154540 Oct 18 16:29:11.508773 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3450/6920] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:11 2022] GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:12.531504 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-25eccfb7-977f-457e-95c6-99f88a73c2a3 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:12.532124 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-25eccfb7-977f-457e-95c6-99f88a73c2a3 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:12.539726 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-25eccfb7-977f-457e-95c6-99f88a73c2a3 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:12.540218 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-25eccfb7-977f-457e-95c6-99f88a73c2a3 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:12.540664 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-25eccfb7-977f-457e-95c6-99f88a73c2a3 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:12.541400 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-25eccfb7-977f-457e-95c6-99f88a73c2a3 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:12.541866 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-25eccfb7-977f-457e-95c6-99f88a73c2a3 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:12.542303 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-25eccfb7-977f-457e-95c6-99f88a73c2a3 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:12.676530 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-25eccfb7-977f-457e-95c6-99f88a73c2a3 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:12.684398 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-25eccfb7-977f-457e-95c6-99f88a73c2a3 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a" status: 200 len: 1518 microversion: 2.1 time: 0.156835 Oct 18 16:29:12.684995 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3471/6921] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:12 2022] GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:13.707480 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-84dd017b-ce66-4ce9-ba58-ff05f4c35998 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:13.708103 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-84dd017b-ce66-4ce9-ba58-ff05f4c35998 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:13.715049 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84dd017b-ce66-4ce9-ba58-ff05f4c35998 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:13.715523 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84dd017b-ce66-4ce9-ba58-ff05f4c35998 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:13.715958 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84dd017b-ce66-4ce9-ba58-ff05f4c35998 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:13.716662 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84dd017b-ce66-4ce9-ba58-ff05f4c35998 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:13.717149 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84dd017b-ce66-4ce9-ba58-ff05f4c35998 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:13.717578 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84dd017b-ce66-4ce9-ba58-ff05f4c35998 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:13.922347 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-84dd017b-ce66-4ce9-ba58-ff05f4c35998 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:13.930915 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-84dd017b-ce66-4ce9-ba58-ff05f4c35998 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a" status: 200 len: 1518 microversion: 2.1 time: 0.227351 Oct 18 16:29:13.931504 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3451/6922] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:13 2022] GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a => generated 1518 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:14.954804 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fb48f1ab-48f8-4298-9e0d-1e6063847f85 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:14.955355 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-fb48f1ab-48f8-4298-9e0d-1e6063847f85 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:14.962205 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fb48f1ab-48f8-4298-9e0d-1e6063847f85 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:14.962788 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fb48f1ab-48f8-4298-9e0d-1e6063847f85 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:14.963309 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fb48f1ab-48f8-4298-9e0d-1e6063847f85 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:14.964205 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fb48f1ab-48f8-4298-9e0d-1e6063847f85 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:14.964793 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fb48f1ab-48f8-4298-9e0d-1e6063847f85 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:14.965333 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fb48f1ab-48f8-4298-9e0d-1e6063847f85 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:15.099600 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-fb48f1ab-48f8-4298-9e0d-1e6063847f85 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:15.107390 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fb48f1ab-48f8-4298-9e0d-1e6063847f85 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a" status: 200 len: 1518 microversion: 2.1 time: 0.156657 Oct 18 16:29:15.107968 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3472/6923] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:14 2022] GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:16.131496 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4fffb36c-f3f1-4def-8a25-67b5ee9e2f16 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:16.132478 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4fffb36c-f3f1-4def-8a25-67b5ee9e2f16 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:16.139096 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4fffb36c-f3f1-4def-8a25-67b5ee9e2f16 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:16.139581 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4fffb36c-f3f1-4def-8a25-67b5ee9e2f16 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:16.140019 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4fffb36c-f3f1-4def-8a25-67b5ee9e2f16 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:16.140715 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4fffb36c-f3f1-4def-8a25-67b5ee9e2f16 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:16.141196 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4fffb36c-f3f1-4def-8a25-67b5ee9e2f16 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:16.141624 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4fffb36c-f3f1-4def-8a25-67b5ee9e2f16 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:16.272885 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4fffb36c-f3f1-4def-8a25-67b5ee9e2f16 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:16.280764 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4fffb36c-f3f1-4def-8a25-67b5ee9e2f16 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a" status: 200 len: 1518 microversion: 2.1 time: 0.153776 Oct 18 16:29:16.281382 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3452/6924] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:16 2022] GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:17.084523 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-9b5bec32-428a-4cdb-a16e-8b8ae0863a47 req-f0775501-e06a-4c08-afce-619cbd4f15c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a", "name": "network-vif-unplugged", "status": "completed", "tag": "b3f49e85-a356-451c-a1db-37e99738cb4d"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:29:17.094396 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-9b5bec32-428a-4cdb-a16e-8b8ae0863a47 req-f0775501-e06a-4c08-afce-619cbd4f15c6 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:17.094904 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-9b5bec32-428a-4cdb-a16e-8b8ae0863a47 req-f0775501-e06a-4c08-afce-619cbd4f15c6 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:17.095367 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-9b5bec32-428a-4cdb-a16e-8b8ae0863a47 req-f0775501-e06a-4c08-afce-619cbd4f15c6 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:17.099909 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:29:17.109039 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-9b5bec32-428a-4cdb-a16e-8b8ae0863a47 req-f0775501-e06a-4c08-afce-619cbd4f15c6 service nova] Creating event network-vif-unplugged:b3f49e85-a356-451c-a1db-37e99738cb4d for instance 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a on n-h2-853682-5 Oct 18 16:29:17.115857 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [req-9b5bec32-428a-4cdb-a16e-8b8ae0863a47 req-f0775501-e06a-4c08-afce-619cbd4f15c6 service nova] Instance 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853682-5', 'n-h1-853682-5'} {{(pid=120405) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 18 16:29:17.128485 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-9b5bec32-428a-4cdb-a16e-8b8ae0863a47 req-f0775501-e06a-4c08-afce-619cbd4f15c6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107596 Oct 18 16:29:17.129797 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3473/6925] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:29:17.304747 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9e3ecb60-5b3d-4e31-b64b-01b1980f415c tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:17.305399 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9e3ecb60-5b3d-4e31-b64b-01b1980f415c tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:17.313366 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e3ecb60-5b3d-4e31-b64b-01b1980f415c tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:17.313869 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e3ecb60-5b3d-4e31-b64b-01b1980f415c tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:17.314356 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e3ecb60-5b3d-4e31-b64b-01b1980f415c tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:17.315007 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e3ecb60-5b3d-4e31-b64b-01b1980f415c tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:17.315471 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e3ecb60-5b3d-4e31-b64b-01b1980f415c tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:17.315899 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e3ecb60-5b3d-4e31-b64b-01b1980f415c tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:17.456171 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9e3ecb60-5b3d-4e31-b64b-01b1980f415c tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:17.464536 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9e3ecb60-5b3d-4e31-b64b-01b1980f415c tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a" status: 200 len: 1517 microversion: 2.1 time: 0.164728 Oct 18 16:29:17.465202 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3453/6926] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:17 2022] GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a => generated 1517 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:18.490575 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-23aaa3e0-e615-4169-a518-1a404720b53d tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:18.491282 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-23aaa3e0-e615-4169-a518-1a404720b53d tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:18.498534 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-23aaa3e0-e615-4169-a518-1a404720b53d tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:18.499027 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-23aaa3e0-e615-4169-a518-1a404720b53d tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:18.499475 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-23aaa3e0-e615-4169-a518-1a404720b53d tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:18.500168 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-23aaa3e0-e615-4169-a518-1a404720b53d tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:18.500634 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-23aaa3e0-e615-4169-a518-1a404720b53d tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:18.501093 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-23aaa3e0-e615-4169-a518-1a404720b53d tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:18.635396 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-23aaa3e0-e615-4169-a518-1a404720b53d tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:18.643144 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-23aaa3e0-e615-4169-a518-1a404720b53d tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a" status: 200 len: 1515 microversion: 2.1 time: 0.158116 Oct 18 16:29:18.643723 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3474/6927] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:18 2022] GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:19.154161 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-309212df-d0f9-4f34-afd5-ab233a26235f req-1c74c57e-1016-454a-aac6-64de65de1d87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a", "tag": "b3f49e85-a356-451c-a1db-37e99738cb4d"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:29:19.164362 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-309212df-d0f9-4f34-afd5-ab233a26235f req-1c74c57e-1016-454a-aac6-64de65de1d87 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:19.164871 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-309212df-d0f9-4f34-afd5-ab233a26235f req-1c74c57e-1016-454a-aac6-64de65de1d87 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:19.165312 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-309212df-d0f9-4f34-afd5-ab233a26235f req-1c74c57e-1016-454a-aac6-64de65de1d87 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:19.177440 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-309212df-d0f9-4f34-afd5-ab233a26235f req-1c74c57e-1016-454a-aac6-64de65de1d87 service nova] Creating event network-changed:b3f49e85-a356-451c-a1db-37e99738cb4d for instance 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a on n-h2-853682-5 Oct 18 16:29:19.182724 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [req-309212df-d0f9-4f34-afd5-ab233a26235f req-1c74c57e-1016-454a-aac6-64de65de1d87 service nova] Instance 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853682-5', 'n-h1-853682-5'} {{(pid=120406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 18 16:29:19.194262 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-309212df-d0f9-4f34-afd5-ab233a26235f req-1c74c57e-1016-454a-aac6-64de65de1d87 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043835 Oct 18 16:29:19.194869 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3454/6928] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:29:19.668221 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d92b9622-a3d8-442d-bf25-ce9723f0dad2 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:19.668784 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d92b9622-a3d8-442d-bf25-ce9723f0dad2 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:19.675206 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d92b9622-a3d8-442d-bf25-ce9723f0dad2 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:19.676242 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d92b9622-a3d8-442d-bf25-ce9723f0dad2 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:19.676696 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d92b9622-a3d8-442d-bf25-ce9723f0dad2 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:19.677436 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d92b9622-a3d8-442d-bf25-ce9723f0dad2 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:19.677914 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d92b9622-a3d8-442d-bf25-ce9723f0dad2 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:19.678354 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d92b9622-a3d8-442d-bf25-ce9723f0dad2 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:19.832094 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d92b9622-a3d8-442d-bf25-ce9723f0dad2 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:19.839856 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d92b9622-a3d8-442d-bf25-ce9723f0dad2 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a" status: 200 len: 1512 microversion: 2.1 time: 0.176483 Oct 18 16:29:19.840425 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3475/6929] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:19 2022] GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a => generated 1512 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:19.864295 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-638c5449-0695-464b-8c27-cdb077fa7710 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:29:19.865037 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-638c5449-0695-464b-8c27-cdb077fa7710 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:19.871258 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-638c5449-0695-464b-8c27-cdb077fa7710 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:19.871744 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-638c5449-0695-464b-8c27-cdb077fa7710 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:19.872183 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-638c5449-0695-464b-8c27-cdb077fa7710 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:19.872901 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-638c5449-0695-464b-8c27-cdb077fa7710 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:19.873358 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-638c5449-0695-464b-8c27-cdb077fa7710 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:19.873788 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-638c5449-0695-464b-8c27-cdb077fa7710 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:19.931885 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-638c5449-0695-464b-8c27-cdb077fa7710 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "POST /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a/action" status: 204 len: 0 microversion: 2.1 time: 0.072239 Oct 18 16:29:19.932459 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3455/6930] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:29:19 2022] POST /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 16:29:19.940704 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e2086a61-1f60-4e4e-94a6-d0b43975a2b6 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:19.941494 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e2086a61-1f60-4e4e-94a6-d0b43975a2b6 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:19.947454 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e2086a61-1f60-4e4e-94a6-d0b43975a2b6 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:19.947955 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e2086a61-1f60-4e4e-94a6-d0b43975a2b6 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:19.948402 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e2086a61-1f60-4e4e-94a6-d0b43975a2b6 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:19.949307 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e2086a61-1f60-4e4e-94a6-d0b43975a2b6 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:19.949688 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e2086a61-1f60-4e4e-94a6-d0b43975a2b6 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:19.950162 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e2086a61-1f60-4e4e-94a6-d0b43975a2b6 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:20.184494 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e2086a61-1f60-4e4e-94a6-d0b43975a2b6 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:20.192213 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e2086a61-1f60-4e4e-94a6-d0b43975a2b6 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a" status: 200 len: 1512 microversion: 2.1 time: 0.255414 Oct 18 16:29:20.192775 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3476/6931] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:19 2022] GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a => generated 1512 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:21.217664 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b099f06a-9d3a-4dd3-9cb0-617bfb7ff2fd tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:21.218378 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b099f06a-9d3a-4dd3-9cb0-617bfb7ff2fd tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:21.225135 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b099f06a-9d3a-4dd3-9cb0-617bfb7ff2fd tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:21.225607 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b099f06a-9d3a-4dd3-9cb0-617bfb7ff2fd tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:21.226048 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b099f06a-9d3a-4dd3-9cb0-617bfb7ff2fd tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:21.226746 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b099f06a-9d3a-4dd3-9cb0-617bfb7ff2fd tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:21.227234 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b099f06a-9d3a-4dd3-9cb0-617bfb7ff2fd tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:21.227660 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b099f06a-9d3a-4dd3-9cb0-617bfb7ff2fd tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:21.368515 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b099f06a-9d3a-4dd3-9cb0-617bfb7ff2fd tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:21.376824 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b099f06a-9d3a-4dd3-9cb0-617bfb7ff2fd tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a" status: 200 len: 1504 microversion: 2.1 time: 0.164677 Oct 18 16:29:21.377433 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3456/6932] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:21 2022] GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a => generated 1504 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:21.400406 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d975fc97-efc5-4a3f-a968-25369f54ebb8 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:21.401167 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d975fc97-efc5-4a3f-a968-25369f54ebb8 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:21.408145 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d975fc97-efc5-4a3f-a968-25369f54ebb8 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:21.408653 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d975fc97-efc5-4a3f-a968-25369f54ebb8 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:21.409143 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d975fc97-efc5-4a3f-a968-25369f54ebb8 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:21.409909 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d975fc97-efc5-4a3f-a968-25369f54ebb8 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:21.410387 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d975fc97-efc5-4a3f-a968-25369f54ebb8 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:21.410826 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d975fc97-efc5-4a3f-a968-25369f54ebb8 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:21.543546 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d975fc97-efc5-4a3f-a968-25369f54ebb8 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:21.556926 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d975fc97-efc5-4a3f-a968-25369f54ebb8 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a" status: 200 len: 1504 microversion: 2.1 time: 0.160314 Oct 18 16:29:21.558046 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3477/6933] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:21 2022] GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:29:21.579854 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-db0d9797-6e58-4594-a1ff-4b7adc8ce06e tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:21.580470 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-db0d9797-6e58-4594-a1ff-4b7adc8ce06e tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:21.586463 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db0d9797-6e58-4594-a1ff-4b7adc8ce06e tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:21.586946 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db0d9797-6e58-4594-a1ff-4b7adc8ce06e tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:21.587380 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db0d9797-6e58-4594-a1ff-4b7adc8ce06e tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:21.588069 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db0d9797-6e58-4594-a1ff-4b7adc8ce06e tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:21.588523 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db0d9797-6e58-4594-a1ff-4b7adc8ce06e tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:21.588980 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db0d9797-6e58-4594-a1ff-4b7adc8ce06e tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:21.717153 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-db0d9797-6e58-4594-a1ff-4b7adc8ce06e tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:21.724993 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-db0d9797-6e58-4594-a1ff-4b7adc8ce06e tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a" status: 200 len: 1504 microversion: 2.1 time: 0.148969 Oct 18 16:29:21.725783 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3457/6934] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:21 2022] GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:21.747456 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a3c93606-5109-40bd-af19-c23d2d6b1a52 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:21.747894 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a3c93606-5109-40bd-af19-c23d2d6b1a52 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:21.754693 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a3c93606-5109-40bd-af19-c23d2d6b1a52 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:21.755189 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a3c93606-5109-40bd-af19-c23d2d6b1a52 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:21.755652 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a3c93606-5109-40bd-af19-c23d2d6b1a52 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:21.756330 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a3c93606-5109-40bd-af19-c23d2d6b1a52 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:21.756786 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a3c93606-5109-40bd-af19-c23d2d6b1a52 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:21.757242 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a3c93606-5109-40bd-af19-c23d2d6b1a52 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:21.781785 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a3c93606-5109-40bd-af19-c23d2d6b1a52 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:29:21.859122 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a3c93606-5109-40bd-af19-c23d2d6b1a52 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a" status: 204 len: 0 microversion: 2.1 time: 0.115194 Oct 18 16:29:21.859794 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3478/6935] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 16:29:21 2022] DELETE /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:29:21.873650 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-af61a445-f11a-442a-84dd-e186c8a46789 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:21.874157 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-af61a445-f11a-442a-84dd-e186c8a46789 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:21.880682 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af61a445-f11a-442a-84dd-e186c8a46789 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:21.881217 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af61a445-f11a-442a-84dd-e186c8a46789 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:21.881657 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af61a445-f11a-442a-84dd-e186c8a46789 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:21.882365 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af61a445-f11a-442a-84dd-e186c8a46789 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:21.882818 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af61a445-f11a-442a-84dd-e186c8a46789 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:21.883245 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af61a445-f11a-442a-84dd-e186c8a46789 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:21.908204 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-af61a445-f11a-442a-84dd-e186c8a46789 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:29:21.953090 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.compute.api [None req-af61a445-f11a-442a-84dd-e186c8a46789 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a] Instance is already in deleting state, ignoring this request Oct 18 16:29:21.953925 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-af61a445-f11a-442a-84dd-e186c8a46789 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a" status: 204 len: 0 microversion: 2.1 time: 0.084203 Oct 18 16:29:21.954499 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3458/6936] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 16:29:21 2022] DELETE /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:29:21.963296 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-97cdeb00-4490-4c34-9dc7-f7885081f9d7 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:21.964179 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-97cdeb00-4490-4c34-9dc7-f7885081f9d7 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:21.970371 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97cdeb00-4490-4c34-9dc7-f7885081f9d7 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:21.970857 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97cdeb00-4490-4c34-9dc7-f7885081f9d7 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:21.971301 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97cdeb00-4490-4c34-9dc7-f7885081f9d7 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:21.971995 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97cdeb00-4490-4c34-9dc7-f7885081f9d7 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:21.973124 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97cdeb00-4490-4c34-9dc7-f7885081f9d7 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:21.973560 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-97cdeb00-4490-4c34-9dc7-f7885081f9d7 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:22.337549 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-97cdeb00-4490-4c34-9dc7-f7885081f9d7 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:22.345221 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-97cdeb00-4490-4c34-9dc7-f7885081f9d7 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a" status: 200 len: 1510 microversion: 2.1 time: 0.386209 Oct 18 16:29:22.345804 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3479/6937] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:21 2022] GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a => generated 1510 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:22.644610 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-869a0a91-6b42-4f50-89c4-21323cbc2a81 req-bbe238d5-b395-4ef7-94b1-7678c265e43b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a", "name": "network-vif-plugged", "status": "completed", "tag": "b3f49e85-a356-451c-a1db-37e99738cb4d"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:29:22.655831 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-869a0a91-6b42-4f50-89c4-21323cbc2a81 req-bbe238d5-b395-4ef7-94b1-7678c265e43b service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:22.655831 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-869a0a91-6b42-4f50-89c4-21323cbc2a81 req-bbe238d5-b395-4ef7-94b1-7678c265e43b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:22.656046 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-869a0a91-6b42-4f50-89c4-21323cbc2a81 req-bbe238d5-b395-4ef7-94b1-7678c265e43b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:22.667904 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-869a0a91-6b42-4f50-89c4-21323cbc2a81 req-bbe238d5-b395-4ef7-94b1-7678c265e43b service nova] Creating event network-vif-plugged:b3f49e85-a356-451c-a1db-37e99738cb4d for instance 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a on n-h2-853682-5 Oct 18 16:29:22.673382 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-869a0a91-6b42-4f50-89c4-21323cbc2a81 req-bbe238d5-b395-4ef7-94b1-7678c265e43b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090841 Oct 18 16:29:22.673999 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3459/6938] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:29:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:29:23.367382 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a09fa17e-88ab-4540-81c4-8f143a20dd13 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:23.368132 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a09fa17e-88ab-4540-81c4-8f143a20dd13 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:23.375142 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a09fa17e-88ab-4540-81c4-8f143a20dd13 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:23.375657 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a09fa17e-88ab-4540-81c4-8f143a20dd13 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:23.376115 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a09fa17e-88ab-4540-81c4-8f143a20dd13 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:23.376868 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a09fa17e-88ab-4540-81c4-8f143a20dd13 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:23.377358 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a09fa17e-88ab-4540-81c4-8f143a20dd13 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:23.377806 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a09fa17e-88ab-4540-81c4-8f143a20dd13 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:23.517025 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a09fa17e-88ab-4540-81c4-8f143a20dd13 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82485198bb545ae9c05590584d65af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5507238aeefa4b24b06cd3c30c7f7cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:23.526224 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a09fa17e-88ab-4540-81c4-8f143a20dd13 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a" status: 200 len: 1510 microversion: 2.1 time: 0.162664 Oct 18 16:29:23.526825 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3480/6939] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:23 2022] GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a => generated 1510 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:23.949524 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-3e830f3b-64e3-4bf5-b80e-67d7ece42bd0 req-fd033e89-dad0-4605-8573-af72ff3efc55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a", "name": "network-vif-deleted", "tag": "b3f49e85-a356-451c-a1db-37e99738cb4d"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:29:23.976129 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3e830f3b-64e3-4bf5-b80e-67d7ece42bd0 req-fd033e89-dad0-4605-8573-af72ff3efc55 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:23.976854 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3e830f3b-64e3-4bf5-b80e-67d7ece42bd0 req-fd033e89-dad0-4605-8573-af72ff3efc55 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:23.977739 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3e830f3b-64e3-4bf5-b80e-67d7ece42bd0 req-fd033e89-dad0-4605-8573-af72ff3efc55 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:23.995009 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-3e830f3b-64e3-4bf5-b80e-67d7ece42bd0 req-fd033e89-dad0-4605-8573-af72ff3efc55 service nova] Creating event network-vif-deleted:b3f49e85-a356-451c-a1db-37e99738cb4d for instance 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a on n-h2-853682-5 Oct 18 16:29:24.000571 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-3e830f3b-64e3-4bf5-b80e-67d7ece42bd0 req-fd033e89-dad0-4605-8573-af72ff3efc55 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055050 Oct 18 16:29:24.005290 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3460/6940] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:29:24.549710 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-95dbb9bc-bac4-46b1-87fc-095aa17926a9 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:24.550384 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-95dbb9bc-bac4-46b1-87fc-095aa17926a9 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:24.557275 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-95dbb9bc-bac4-46b1-87fc-095aa17926a9 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:24.557774 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-95dbb9bc-bac4-46b1-87fc-095aa17926a9 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:24.558225 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-95dbb9bc-bac4-46b1-87fc-095aa17926a9 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:24.558932 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-95dbb9bc-bac4-46b1-87fc-095aa17926a9 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:24.559405 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-95dbb9bc-bac4-46b1-87fc-095aa17926a9 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:24.559846 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-95dbb9bc-bac4-46b1-87fc-095aa17926a9 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:24.572892 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-95dbb9bc-bac4-46b1-87fc-095aa17926a9 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] HTTP exception thrown: Instance 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a could not be found. Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-95dbb9bc-bac4-46b1-87fc-095aa17926a9 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Request method failure captured: Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a HTTP/1.1 Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTtQCSsxTAD_xO_zCV6Ns90J9eGU3MVPVejf5dbSWbJ6DvBkeNFuN63czIooGbVE8mmcOEGu2rMsyR7XOfPaeWwsGytDxFlruUsQ1J8hwbZGapDJqcYBkheBYmdXQx67yXMSDVw9dGHKKOgU6ye6eX9xfq4n6SVHusfdbRjXQqUO95js Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 5507238aeefa4b24b06cd3c30c7f7cc3 Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1386509211 Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5507238aeefa4b24b06cd3c30c7f7cc3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5507238aeefa4b24b06cd3c30c7f7cc3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5507238aeefa4b24b06cd3c30c7f7cc3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5507238aeefa4b24b06cd3c30c7f7cc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServerDiskConfigTestJSON-1386509211 Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 5507238aeefa4b24b06cd3c30c7f7cc3 Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1386509211 Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServerDiskConfigTestJSON-1386509211-project Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: a82485198bb545ae9c05590584d65af9 Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServerDiskConfigTestJSON-1386509211-project Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a could not be found. Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a'} Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a could not be found. Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a could not be found. Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:29:24.574536 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:29:24.579584 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:29:24.579584 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:29:24.579584 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:29:24.579584 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:29:24.579584 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:29:24.579584 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a could not be found. Oct 18 16:29:24.579584 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:29:24.579584 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-95dbb9bc-bac4-46b1-87fc-095aa17926a9 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Returning 404 to user: Instance 8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:29:24.579584 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-95dbb9bc-bac4-46b1-87fc-095aa17926a9 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a" status: 404 len: 111 microversion: 2.1 time: 0.030586 Oct 18 16:29:24.579584 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3481/6941] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:24 2022] GET /compute/v2.1/servers/8ab2f69e-3fc0-46d9-88c1-bc6b1ec22a3a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:29:24.585799 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b7ffacd6-ff21-48db-a532-1081479fce56 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '.version_select at 0x7f7c37ca44c0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:24.605921 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b7ffacd6-ff21-48db-a532-1081479fce56 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1129487910" status: 202 len: 0 microversion: 2.1 time: 0.024936 Oct 18 16:29:24.606488 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3461/6942] 10.222.0.60 () {58 vars in 1221 bytes} [Tue Oct 18 16:29:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1129487910 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:29:25.200695 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-be42b60e-adb6-4a18-a3d1-47b29e5db887 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:25.201239 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-be42b60e-adb6-4a18-a3d1-47b29e5db887 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 95780f98-d9c7-4278-8608-273089d50fec] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:25.208086 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-be42b60e-adb6-4a18-a3d1-47b29e5db887 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:25.208581 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-be42b60e-adb6-4a18-a3d1-47b29e5db887 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:25.209247 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-be42b60e-adb6-4a18-a3d1-47b29e5db887 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:25.210128 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-be42b60e-adb6-4a18-a3d1-47b29e5db887 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:25.210608 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-be42b60e-adb6-4a18-a3d1-47b29e5db887 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:25.211048 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-be42b60e-adb6-4a18-a3d1-47b29e5db887 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:25.228500 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-be42b60e-adb6-4a18-a3d1-47b29e5db887 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] HTTP exception thrown: Instance 95780f98-d9c7-4278-8608-273089d50fec could not be found. Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-be42b60e-adb6-4a18-a3d1-47b29e5db887 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Request method failure captured: Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: request: DELETE /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec HTTP/1.1 Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTtQCSsxTAD_xO_zCV6Ns90J9eGU3MVPVejf5dbSWbJ6DvBkeNFuN63czIooGbVE8mmcOEGu2rMsyR7XOfPaeWwsGytDxFlruUsQ1J8hwbZGapDJqcYBkheBYmdXQx67yXMSDVw9dGHKKOgU6ye6eX9xfq4n6SVHusfdbRjXQqUO95js Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 5507238aeefa4b24b06cd3c30c7f7cc3 Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1386509211 Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5507238aeefa4b24b06cd3c30c7f7cc3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5507238aeefa4b24b06cd3c30c7f7cc3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5507238aeefa4b24b06cd3c30c7f7cc3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5507238aeefa4b24b06cd3c30c7f7cc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServerDiskConfigTestJSON-1386509211 Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 5507238aeefa4b24b06cd3c30c7f7cc3 Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1386509211 Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServerDiskConfigTestJSON-1386509211-project Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: a82485198bb545ae9c05590584d65af9 Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServerDiskConfigTestJSON-1386509211-project Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 95780f98-d9c7-4278-8608-273089d50fec could not be found. Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '95780f98-d9c7-4278-8608-273089d50fec'} Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95780f98-d9c7-4278-8608-273089d50fec could not be found. Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:29:25.230112 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:29:25.234322 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95780f98-d9c7-4278-8608-273089d50fec could not be found. Oct 18 16:29:25.234322 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:29:25.234322 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:29:25.234322 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:29:25.234322 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:29:25.234322 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:29:25.234322 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:29:25.234322 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:29:25.234322 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:29:25.234322 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95780f98-d9c7-4278-8608-273089d50fec could not be found. Oct 18 16:29:25.234322 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:29:25.234322 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-be42b60e-adb6-4a18-a3d1-47b29e5db887 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Returning 404 to user: Instance 95780f98-d9c7-4278-8608-273089d50fec could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:29:25.234322 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-be42b60e-adb6-4a18-a3d1-47b29e5db887 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "DELETE /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec" status: 404 len: 111 microversion: 2.1 time: 0.034829 Oct 18 16:29:25.234322 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3482/6943] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 16:29:25 2022] DELETE /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:29:25.241448 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f173b810-00ed-4c42-8b52-83ba2015b444 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:25.242190 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f173b810-00ed-4c42-8b52-83ba2015b444 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] [instance: 95780f98-d9c7-4278-8608-273089d50fec] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:25.248944 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f173b810-00ed-4c42-8b52-83ba2015b444 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:25.249437 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f173b810-00ed-4c42-8b52-83ba2015b444 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:25.249912 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f173b810-00ed-4c42-8b52-83ba2015b444 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:25.250605 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f173b810-00ed-4c42-8b52-83ba2015b444 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:25.251058 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f173b810-00ed-4c42-8b52-83ba2015b444 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:25.251488 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f173b810-00ed-4c42-8b52-83ba2015b444 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:25.265327 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-f173b810-00ed-4c42-8b52-83ba2015b444 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] HTTP exception thrown: Instance 95780f98-d9c7-4278-8608-273089d50fec could not be found. Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f173b810-00ed-4c42-8b52-83ba2015b444 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Request method failure captured: Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec HTTP/1.1 Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTtQCSsxTAD_xO_zCV6Ns90J9eGU3MVPVejf5dbSWbJ6DvBkeNFuN63czIooGbVE8mmcOEGu2rMsyR7XOfPaeWwsGytDxFlruUsQ1J8hwbZGapDJqcYBkheBYmdXQx67yXMSDVw9dGHKKOgU6ye6eX9xfq4n6SVHusfdbRjXQqUO95js Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 5507238aeefa4b24b06cd3c30c7f7cc3 Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1386509211 Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5507238aeefa4b24b06cd3c30c7f7cc3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5507238aeefa4b24b06cd3c30c7f7cc3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5507238aeefa4b24b06cd3c30c7f7cc3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5507238aeefa4b24b06cd3c30c7f7cc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServerDiskConfigTestJSON-1386509211 Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 5507238aeefa4b24b06cd3c30c7f7cc3 Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1386509211 Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServerDiskConfigTestJSON-1386509211-project Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: a82485198bb545ae9c05590584d65af9 Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServerDiskConfigTestJSON-1386509211-project Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 95780f98-d9c7-4278-8608-273089d50fec could not be found. Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '95780f98-d9c7-4278-8608-273089d50fec'} Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95780f98-d9c7-4278-8608-273089d50fec could not be found. Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95780f98-d9c7-4278-8608-273089d50fec could not be found. Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:29:25.266949 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:29:25.272218 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:29:25.272218 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:29:25.272218 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:29:25.272218 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:29:25.272218 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:29:25.272218 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95780f98-d9c7-4278-8608-273089d50fec could not be found. Oct 18 16:29:25.272218 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:29:25.272218 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f173b810-00ed-4c42-8b52-83ba2015b444 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] Returning 404 to user: Instance 95780f98-d9c7-4278-8608-273089d50fec could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:29:25.272218 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f173b810-00ed-4c42-8b52-83ba2015b444 tempest-ServerDiskConfigTestJSON-1386509211 tempest-ServerDiskConfigTestJSON-1386509211-project] 10.222.0.60 "GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec" status: 404 len: 111 microversion: 2.1 time: 0.031978 Oct 18 16:29:25.272218 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3462/6944] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:25 2022] GET /compute/v2.1/servers/95780f98-d9c7-4278-8608-273089d50fec => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:29:33.716982 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f0807cf3-4755-40c7-9124-5ac2f018301c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Action: 'create', calling method: .version_select at 0x7f7c3c0e6040>, body: {"keypair": {"name": "tempest-keypair-85721457", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNWH8bb6TyDoQjS5T3+1R1EhoFFJE+ft7awQAzuNxC6HJdZIf0a2y/CK+sCdtGtS/vxfiEZ5UL+gYDfReNad2CvwyxryCckPLDMAfD4TJasKOHVYC81nZSsUnLrWjnPj9w=="}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:29:33.723295 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:29:33.736858 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-f0807cf3-4755-40c7-9124-5ac2f018301c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Getting quotas for project f872c1ec84314318ac67bfbe7d186b2c. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:29:33.742804 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-f0807cf3-4755-40c7-9124-5ac2f018301c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Getting quotas for user 92c26a3ccef246d6bb58d7d834f71106 and project f872c1ec84314318ac67bfbe7d186b2c. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:29:33.777449 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f0807cf3-4755-40c7-9124-5ac2f018301c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.196839 Oct 18 16:29:33.778505 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3483/6945] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Oct 18 16:29:33 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:29:35.039880 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2b3bbd68-7fee-4ed9-844e-b8cde7b2107f tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-504737761", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cdf0b0ca-963c-402a-919d-35be60437c6f"}], "security_groups": [{"name": "tempest-securitygroup--582261342"}], "key_name": "tempest-keypair-85721457", "user_data": "}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:29:35.050026 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:29:35.157009 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-2b3bbd68-7fee-4ed9-844e-b8cde7b2107f tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] validate_networks() for [('cdf0b0ca-963c-402a-919d-35be60437c6f', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 16:29:35.257497 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:29:35.600448 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-2b3bbd68-7fee-4ed9-844e-b8cde7b2107f tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:29:35.600944 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-2b3bbd68-7fee-4ed9-844e-b8cde7b2107f tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:29:35.601639 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-2b3bbd68-7fee-4ed9-844e-b8cde7b2107f tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:29:35.602048 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-2b3bbd68-7fee-4ed9-844e-b8cde7b2107f tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:29:35.602457 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-2b3bbd68-7fee-4ed9-844e-b8cde7b2107f tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:29:35.615339 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b3bbd68-7fee-4ed9-844e-b8cde7b2107f tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:35.615819 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b3bbd68-7fee-4ed9-844e-b8cde7b2107f tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:35.616247 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b3bbd68-7fee-4ed9-844e-b8cde7b2107f tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:35.617201 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b3bbd68-7fee-4ed9-844e-b8cde7b2107f tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:35.617653 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b3bbd68-7fee-4ed9-844e-b8cde7b2107f tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:35.618074 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b3bbd68-7fee-4ed9-844e-b8cde7b2107f tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:35.636841 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-2b3bbd68-7fee-4ed9-844e-b8cde7b2107f tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Getting quotas for project f872c1ec84314318ac67bfbe7d186b2c. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:29:35.642234 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-2b3bbd68-7fee-4ed9-844e-b8cde7b2107f tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Getting quotas for user 92c26a3ccef246d6bb58d7d834f71106 and project f872c1ec84314318ac67bfbe7d186b2c. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:29:35.654792 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2b3bbd68-7fee-4ed9-844e-b8cde7b2107f tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:29:35.657157 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2b3bbd68-7fee-4ed9-844e-b8cde7b2107f tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:29:35.713232 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2b3bbd68-7fee-4ed9-844e-b8cde7b2107f tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.677746 Oct 18 16:29:35.714461 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3463/6946] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 16:29:35 2022] POST /compute/v2.1/servers => generated 408 bytes in 680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:29:35.723848 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:29:35.729509 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9b9005f0-4f6b-46a9-a4e5-aad86d46cd52 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:35.732655 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9b9005f0-4f6b-46a9-a4e5-aad86d46cd52 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:35.795239 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9b9005f0-4f6b-46a9-a4e5-aad86d46cd52 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:35.802957 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9b9005f0-4f6b-46a9-a4e5-aad86d46cd52 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53" status: 200 len: 1236 microversion: 2.1 time: 0.080785 Oct 18 16:29:35.803528 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3484/6947] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:35 2022] GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 => generated 1236 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:36.828118 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0cf98e24-4c73-49c7-b73f-f07809f9a3e0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:36.828737 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0cf98e24-4c73-49c7-b73f-f07809f9a3e0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:36.844781 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0cf98e24-4c73-49c7-b73f-f07809f9a3e0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:36.845557 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0cf98e24-4c73-49c7-b73f-f07809f9a3e0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:36.846168 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0cf98e24-4c73-49c7-b73f-f07809f9a3e0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:36.847260 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0cf98e24-4c73-49c7-b73f-f07809f9a3e0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:36.847726 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0cf98e24-4c73-49c7-b73f-f07809f9a3e0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:36.848176 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0cf98e24-4c73-49c7-b73f-f07809f9a3e0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:36.930701 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0cf98e24-4c73-49c7-b73f-f07809f9a3e0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:36.954733 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0cf98e24-4c73-49c7-b73f-f07809f9a3e0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53" status: 200 len: 1296 microversion: 2.1 time: 0.131569 Oct 18 16:29:36.969504 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3464/6948] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:36 2022] GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 => generated 1296 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:29:37.981852 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c804f3a7-609a-4c88-b1bc-ae26b5b2d8a6 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:37.982597 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c804f3a7-609a-4c88-b1bc-ae26b5b2d8a6 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:37.990200 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c804f3a7-609a-4c88-b1bc-ae26b5b2d8a6 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:37.990819 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c804f3a7-609a-4c88-b1bc-ae26b5b2d8a6 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:37.991636 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c804f3a7-609a-4c88-b1bc-ae26b5b2d8a6 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:37.992370 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c804f3a7-609a-4c88-b1bc-ae26b5b2d8a6 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:37.992871 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c804f3a7-609a-4c88-b1bc-ae26b5b2d8a6 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:37.993525 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c804f3a7-609a-4c88-b1bc-ae26b5b2d8a6 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:38.138132 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c804f3a7-609a-4c88-b1bc-ae26b5b2d8a6 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:38.146821 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c804f3a7-609a-4c88-b1bc-ae26b5b2d8a6 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53" status: 200 len: 1361 microversion: 2.1 time: 0.168831 Oct 18 16:29:38.147641 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3485/6949] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:37 2022] GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 => generated 1361 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:38.329120 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-7cf7430f-e7b2-4bf4-95be-9f997d204a48 req-f1d0bea1-ff60-488f-a1d0-217eb764777c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53", "tag": "4af24cb9-f285-4480-a985-3509287012b0"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:29:38.342015 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7cf7430f-e7b2-4bf4-95be-9f997d204a48 req-f1d0bea1-ff60-488f-a1d0-217eb764777c service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:38.342654 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7cf7430f-e7b2-4bf4-95be-9f997d204a48 req-f1d0bea1-ff60-488f-a1d0-217eb764777c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:38.343188 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7cf7430f-e7b2-4bf4-95be-9f997d204a48 req-f1d0bea1-ff60-488f-a1d0-217eb764777c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:38.358285 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-7cf7430f-e7b2-4bf4-95be-9f997d204a48 req-f1d0bea1-ff60-488f-a1d0-217eb764777c service nova] Creating event network-changed:4af24cb9-f285-4480-a985-3509287012b0 for instance fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 on n-h2-853682-5 Oct 18 16:29:38.363387 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-7cf7430f-e7b2-4bf4-95be-9f997d204a48 req-f1d0bea1-ff60-488f-a1d0-217eb764777c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039455 Oct 18 16:29:38.364032 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3465/6950] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:29:39.170737 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-14144653-b74f-4522-a989-acc42cf748b4 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:39.171760 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-14144653-b74f-4522-a989-acc42cf748b4 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:39.179584 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-14144653-b74f-4522-a989-acc42cf748b4 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:39.180118 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-14144653-b74f-4522-a989-acc42cf748b4 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:39.180670 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-14144653-b74f-4522-a989-acc42cf748b4 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:39.181449 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-14144653-b74f-4522-a989-acc42cf748b4 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:39.181913 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-14144653-b74f-4522-a989-acc42cf748b4 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:39.182422 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-14144653-b74f-4522-a989-acc42cf748b4 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:39.313264 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-14144653-b74f-4522-a989-acc42cf748b4 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:39.322152 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-14144653-b74f-4522-a989-acc42cf748b4 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53" status: 200 len: 1361 microversion: 2.1 time: 0.155332 Oct 18 16:29:39.322740 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3486/6951] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:39 2022] GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:29:40.346401 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cc6dfd40-2352-44e5-adf1-38442fc16260 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:40.347093 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cc6dfd40-2352-44e5-adf1-38442fc16260 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:40.353223 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cc6dfd40-2352-44e5-adf1-38442fc16260 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:40.353700 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cc6dfd40-2352-44e5-adf1-38442fc16260 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:40.354129 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cc6dfd40-2352-44e5-adf1-38442fc16260 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:40.354815 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cc6dfd40-2352-44e5-adf1-38442fc16260 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:40.355265 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cc6dfd40-2352-44e5-adf1-38442fc16260 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:40.355682 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cc6dfd40-2352-44e5-adf1-38442fc16260 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:40.491354 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cc6dfd40-2352-44e5-adf1-38442fc16260 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:40.499366 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cc6dfd40-2352-44e5-adf1-38442fc16260 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53" status: 200 len: 1361 microversion: 2.1 time: 0.157999 Oct 18 16:29:40.499945 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3466/6952] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:40 2022] GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:41.523521 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8bb9555a-5fc2-4600-b7e0-dc112dbe8794 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:41.524049 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8bb9555a-5fc2-4600-b7e0-dc112dbe8794 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:41.530831 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8bb9555a-5fc2-4600-b7e0-dc112dbe8794 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:41.531319 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8bb9555a-5fc2-4600-b7e0-dc112dbe8794 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:41.531765 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8bb9555a-5fc2-4600-b7e0-dc112dbe8794 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:41.532456 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8bb9555a-5fc2-4600-b7e0-dc112dbe8794 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:41.532946 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8bb9555a-5fc2-4600-b7e0-dc112dbe8794 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:41.533379 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8bb9555a-5fc2-4600-b7e0-dc112dbe8794 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:41.664375 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8bb9555a-5fc2-4600-b7e0-dc112dbe8794 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:41.672517 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8bb9555a-5fc2-4600-b7e0-dc112dbe8794 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53" status: 200 len: 1361 microversion: 2.1 time: 0.153538 Oct 18 16:29:41.673141 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3487/6953] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:41 2022] GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:42.613468 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-50befd13-f6b3-4ea9-bc33-ff372f3ad512 req-b4f02a25-d3c0-4640-9a2a-c0e8452c8418 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53", "name": "network-vif-plugged", "status": "completed", "tag": "4af24cb9-f285-4480-a985-3509287012b0"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:29:42.624330 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-50befd13-f6b3-4ea9-bc33-ff372f3ad512 req-b4f02a25-d3c0-4640-9a2a-c0e8452c8418 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:42.624841 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-50befd13-f6b3-4ea9-bc33-ff372f3ad512 req-b4f02a25-d3c0-4640-9a2a-c0e8452c8418 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:42.625270 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-50befd13-f6b3-4ea9-bc33-ff372f3ad512 req-b4f02a25-d3c0-4640-9a2a-c0e8452c8418 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:42.636946 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-50befd13-f6b3-4ea9-bc33-ff372f3ad512 req-b4f02a25-d3c0-4640-9a2a-c0e8452c8418 service nova] Creating event network-vif-plugged:4af24cb9-f285-4480-a985-3509287012b0 for instance fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 on n-h2-853682-5 Oct 18 16:29:42.641871 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-50befd13-f6b3-4ea9-bc33-ff372f3ad512 req-b4f02a25-d3c0-4640-9a2a-c0e8452c8418 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032722 Oct 18 16:29:42.642651 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3467/6954] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:29:42.695769 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4cd5d560-a6a0-4cac-b9c9-d9c10263888e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:42.696683 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4cd5d560-a6a0-4cac-b9c9-d9c10263888e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:42.704142 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4cd5d560-a6a0-4cac-b9c9-d9c10263888e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:42.704675 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4cd5d560-a6a0-4cac-b9c9-d9c10263888e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:42.705181 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4cd5d560-a6a0-4cac-b9c9-d9c10263888e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:42.705960 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4cd5d560-a6a0-4cac-b9c9-d9c10263888e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:42.706440 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4cd5d560-a6a0-4cac-b9c9-d9c10263888e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:42.706886 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4cd5d560-a6a0-4cac-b9c9-d9c10263888e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:42.842705 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4cd5d560-a6a0-4cac-b9c9-d9c10263888e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:42.851129 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4cd5d560-a6a0-4cac-b9c9-d9c10263888e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53" status: 200 len: 1361 microversion: 2.1 time: 0.159846 Oct 18 16:29:42.851701 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3488/6955] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:42 2022] GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:43.875961 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-93307634-a77e-4354-b4ef-f02a9fd2d02b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:43.876682 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-93307634-a77e-4354-b4ef-f02a9fd2d02b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:43.883485 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-93307634-a77e-4354-b4ef-f02a9fd2d02b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:43.883972 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-93307634-a77e-4354-b4ef-f02a9fd2d02b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:43.884410 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-93307634-a77e-4354-b4ef-f02a9fd2d02b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:43.885128 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-93307634-a77e-4354-b4ef-f02a9fd2d02b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:43.885590 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-93307634-a77e-4354-b4ef-f02a9fd2d02b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:43.886020 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-93307634-a77e-4354-b4ef-f02a9fd2d02b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:44.017901 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-93307634-a77e-4354-b4ef-f02a9fd2d02b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:29:44.025943 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-93307634-a77e-4354-b4ef-f02a9fd2d02b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53" status: 200 len: 1547 microversion: 2.1 time: 0.155095 Oct 18 16:29:44.026524 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3468/6956] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:29:43 2022] GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 => generated 1547 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:29:44.048889 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-dcabdbdc-27bf-41c8-aba7-d140f6b4a20d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:29:44.049414 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-dcabdbdc-27bf-41c8-aba7-d140f6b4a20d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:29:44.056941 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dcabdbdc-27bf-41c8-aba7-d140f6b4a20d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:44.057448 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dcabdbdc-27bf-41c8-aba7-d140f6b4a20d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:44.057906 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dcabdbdc-27bf-41c8-aba7-d140f6b4a20d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:44.058616 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dcabdbdc-27bf-41c8-aba7-d140f6b4a20d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:44.059093 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dcabdbdc-27bf-41c8-aba7-d140f6b4a20d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:44.059538 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dcabdbdc-27bf-41c8-aba7-d140f6b4a20d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:44.137191 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-dcabdbdc-27bf-41c8-aba7-d140f6b4a20d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092380 Oct 18 16:29:44.137806 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3489/6957] 10.222.0.60 () {58 vars in 1275 bytes} [Tue Oct 18 16:29:44 2022] GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:29:45.359052 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-ee226a26-a3d7-43d9-9142-afa81affe6b2 req-54d1b7b8-0d87-4b2e-bf2f-9f91b2013fa9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53", "tag": "4af24cb9-f285-4480-a985-3509287012b0"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:29:45.369092 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ee226a26-a3d7-43d9-9142-afa81affe6b2 req-54d1b7b8-0d87-4b2e-bf2f-9f91b2013fa9 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:29:45.369673 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ee226a26-a3d7-43d9-9142-afa81affe6b2 req-54d1b7b8-0d87-4b2e-bf2f-9f91b2013fa9 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:29:45.370179 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ee226a26-a3d7-43d9-9142-afa81affe6b2 req-54d1b7b8-0d87-4b2e-bf2f-9f91b2013fa9 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:29:45.382828 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-ee226a26-a3d7-43d9-9142-afa81affe6b2 req-54d1b7b8-0d87-4b2e-bf2f-9f91b2013fa9 service nova] Creating event network-changed:4af24cb9-f285-4480-a985-3509287012b0 for instance fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 on n-h2-853682-5 Oct 18 16:29:45.388091 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-ee226a26-a3d7-43d9-9142-afa81affe6b2 req-54d1b7b8-0d87-4b2e-bf2f-9f91b2013fa9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095590 Oct 18 16:29:45.388852 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3469/6958] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:29:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:30:20.553514 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=6 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:30:20.554444 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:30:20.555118 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=28 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:30:20.559038 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b4852737-8189-4db7-850b-c88748004960 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:20.559703 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b4852737-8189-4db7-850b-c88748004960 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:20.568471 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b4852737-8189-4db7-850b-c88748004960 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:20.569031 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b4852737-8189-4db7-850b-c88748004960 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:20.569519 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b4852737-8189-4db7-850b-c88748004960 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:20.570238 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b4852737-8189-4db7-850b-c88748004960 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:20.570714 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b4852737-8189-4db7-850b-c88748004960 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:20.571159 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b4852737-8189-4db7-850b-c88748004960 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:20.705662 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b4852737-8189-4db7-850b-c88748004960 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:20.713876 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b4852737-8189-4db7-850b-c88748004960 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53" status: 200 len: 1666 microversion: 2.1 time: 0.162254 Oct 18 16:30:20.714451 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3490/6959] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:20 2022] GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 => generated 1666 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:30:20.733635 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:30:20.734577 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:30:20.736518 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:30:20.737171 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=26 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:30:20.741813 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-781dcf25-867f-4b32-81a3-77232847c409 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:20.742506 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-781dcf25-867f-4b32-81a3-77232847c409 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:20.750989 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-781dcf25-867f-4b32-81a3-77232847c409 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:20.751466 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-781dcf25-867f-4b32-81a3-77232847c409 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:20.751896 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-781dcf25-867f-4b32-81a3-77232847c409 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:20.752580 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-781dcf25-867f-4b32-81a3-77232847c409 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:20.753064 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-781dcf25-867f-4b32-81a3-77232847c409 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:20.753483 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-781dcf25-867f-4b32-81a3-77232847c409 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:20.887421 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-781dcf25-867f-4b32-81a3-77232847c409 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:20.895099 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-781dcf25-867f-4b32-81a3-77232847c409 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53" status: 200 len: 1666 microversion: 2.1 time: 0.162934 Oct 18 16:30:20.895662 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3470/6960] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:20 2022] GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 => generated 1666 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:30:20.917607 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bfcc765a-d661-4538-becf-c65604ef5135 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:20.918246 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-bfcc765a-d661-4538-becf-c65604ef5135 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:20.925200 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bfcc765a-d661-4538-becf-c65604ef5135 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:20.925706 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bfcc765a-d661-4538-becf-c65604ef5135 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:20.926331 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bfcc765a-d661-4538-becf-c65604ef5135 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:20.926963 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bfcc765a-d661-4538-becf-c65604ef5135 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:20.927443 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bfcc765a-d661-4538-becf-c65604ef5135 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:20.927885 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bfcc765a-d661-4538-becf-c65604ef5135 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:21.057348 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-bfcc765a-d661-4538-becf-c65604ef5135 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:21.064943 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-bfcc765a-d661-4538-becf-c65604ef5135 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53" status: 200 len: 1666 microversion: 2.1 time: 0.151205 Oct 18 16:30:21.065512 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3491/6961] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:20 2022] GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 => generated 1666 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:30:21.086898 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a4c9261b-4755-45e4-bd6a-bbf532999bf7 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:30:21.089192 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a4c9261b-4755-45e4-bd6a-bbf532999bf7 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:21.095732 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4c9261b-4755-45e4-bd6a-bbf532999bf7 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:21.096222 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4c9261b-4755-45e4-bd6a-bbf532999bf7 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:21.096664 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4c9261b-4755-45e4-bd6a-bbf532999bf7 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:21.097458 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4c9261b-4755-45e4-bd6a-bbf532999bf7 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:21.097927 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4c9261b-4755-45e4-bd6a-bbf532999bf7 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:21.098359 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4c9261b-4755-45e4-bd6a-bbf532999bf7 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:21.126825 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a4c9261b-4755-45e4-bd6a-bbf532999bf7 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:21.132363 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a4c9261b-4755-45e4-bd6a-bbf532999bf7 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53] Old instance type m1.heat2, new instance type m1.heat {{(pid=120406) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 18 16:30:21.138904 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-a4c9261b-4755-45e4-bd6a-bbf532999bf7 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:30:21.139327 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-a4c9261b-4755-45e4-bd6a-bbf532999bf7 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:30:21.139802 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-a4c9261b-4755-45e4-bd6a-bbf532999bf7 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:30:21.140211 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-a4c9261b-4755-45e4-bd6a-bbf532999bf7 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:30:21.140660 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-a4c9261b-4755-45e4-bd6a-bbf532999bf7 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:30:21.203819 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a4c9261b-4755-45e4-bd6a-bbf532999bf7 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "POST /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53/action" status: 202 len: 0 microversion: 2.1 time: 0.120872 Oct 18 16:30:21.204436 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3471/6962] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:30:21 2022] POST /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:30:21.212969 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a9e9ba71-929e-4b31-bacf-c2254fd7f6f2 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:21.213598 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a9e9ba71-929e-4b31-bacf-c2254fd7f6f2 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:21.220120 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9e9ba71-929e-4b31-bacf-c2254fd7f6f2 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:21.220622 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9e9ba71-929e-4b31-bacf-c2254fd7f6f2 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:21.221093 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9e9ba71-929e-4b31-bacf-c2254fd7f6f2 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:21.221911 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9e9ba71-929e-4b31-bacf-c2254fd7f6f2 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:21.222381 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9e9ba71-929e-4b31-bacf-c2254fd7f6f2 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:21.222820 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a9e9ba71-929e-4b31-bacf-c2254fd7f6f2 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:21.380435 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a9e9ba71-929e-4b31-bacf-c2254fd7f6f2 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:21.388142 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a9e9ba71-929e-4b31-bacf-c2254fd7f6f2 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53" status: 200 len: 1675 microversion: 2.1 time: 0.179393 Oct 18 16:30:21.389249 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3492/6963] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:21 2022] GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 => generated 1675 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:30:22.412304 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-00564cb7-3f21-4a19-9142-73474233160d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:22.412944 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-00564cb7-3f21-4a19-9142-73474233160d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:22.422749 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00564cb7-3f21-4a19-9142-73474233160d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:22.423223 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00564cb7-3f21-4a19-9142-73474233160d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:22.423654 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00564cb7-3f21-4a19-9142-73474233160d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:22.424341 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00564cb7-3f21-4a19-9142-73474233160d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:22.424791 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00564cb7-3f21-4a19-9142-73474233160d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:22.425237 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00564cb7-3f21-4a19-9142-73474233160d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:22.563830 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-00564cb7-3f21-4a19-9142-73474233160d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:22.571802 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-00564cb7-3f21-4a19-9142-73474233160d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53" status: 200 len: 1675 microversion: 2.1 time: 0.164205 Oct 18 16:30:22.572399 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3472/6964] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:22 2022] GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:30:23.595600 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-01b6deb8-f02b-4344-9d63-417d16f86885 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:23.596239 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-01b6deb8-f02b-4344-9d63-417d16f86885 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:23.603179 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-01b6deb8-f02b-4344-9d63-417d16f86885 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:23.603680 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-01b6deb8-f02b-4344-9d63-417d16f86885 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:23.604136 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-01b6deb8-f02b-4344-9d63-417d16f86885 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:23.604871 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-01b6deb8-f02b-4344-9d63-417d16f86885 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:23.605353 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-01b6deb8-f02b-4344-9d63-417d16f86885 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:23.605808 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-01b6deb8-f02b-4344-9d63-417d16f86885 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:23.737801 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-01b6deb8-f02b-4344-9d63-417d16f86885 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:23.745796 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-01b6deb8-f02b-4344-9d63-417d16f86885 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53" status: 200 len: 1680 microversion: 2.1 time: 0.154687 Oct 18 16:30:23.746371 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3493/6965] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:23 2022] GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:30:24.769268 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-043fa4ac-c014-4ab5-9ae2-9aca10ce2e13 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:24.769894 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-043fa4ac-c014-4ab5-9ae2-9aca10ce2e13 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:24.776840 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-043fa4ac-c014-4ab5-9ae2-9aca10ce2e13 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:24.777335 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-043fa4ac-c014-4ab5-9ae2-9aca10ce2e13 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:24.777784 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-043fa4ac-c014-4ab5-9ae2-9aca10ce2e13 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:24.778506 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-043fa4ac-c014-4ab5-9ae2-9aca10ce2e13 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:24.778984 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-043fa4ac-c014-4ab5-9ae2-9aca10ce2e13 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:24.779935 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-043fa4ac-c014-4ab5-9ae2-9aca10ce2e13 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:24.908752 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-043fa4ac-c014-4ab5-9ae2-9aca10ce2e13 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:24.916529 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-043fa4ac-c014-4ab5-9ae2-9aca10ce2e13 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53" status: 200 len: 1680 microversion: 2.1 time: 0.151178 Oct 18 16:30:24.917136 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3473/6966] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:24 2022] GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:30:25.940330 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-37a4db52-ecf8-4cca-9e82-b587a6bec5cb tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:25.940991 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-37a4db52-ecf8-4cca-9e82-b587a6bec5cb tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:25.947871 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37a4db52-ecf8-4cca-9e82-b587a6bec5cb tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:25.948306 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37a4db52-ecf8-4cca-9e82-b587a6bec5cb tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:25.948758 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37a4db52-ecf8-4cca-9e82-b587a6bec5cb tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:25.949494 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37a4db52-ecf8-4cca-9e82-b587a6bec5cb tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:25.949971 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37a4db52-ecf8-4cca-9e82-b587a6bec5cb tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:25.950411 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37a4db52-ecf8-4cca-9e82-b587a6bec5cb tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:26.083347 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-37a4db52-ecf8-4cca-9e82-b587a6bec5cb tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:26.091145 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-37a4db52-ecf8-4cca-9e82-b587a6bec5cb tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53" status: 200 len: 1680 microversion: 2.1 time: 0.154691 Oct 18 16:30:26.091713 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3494/6967] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:25 2022] GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:30:27.113488 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b02b353f-9f02-45f6-bd2f-5a34ac867811 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:27.114108 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b02b353f-9f02-45f6-bd2f-5a34ac867811 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:27.120992 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b02b353f-9f02-45f6-bd2f-5a34ac867811 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:27.121481 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b02b353f-9f02-45f6-bd2f-5a34ac867811 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:27.121923 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b02b353f-9f02-45f6-bd2f-5a34ac867811 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:27.122624 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b02b353f-9f02-45f6-bd2f-5a34ac867811 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:27.123601 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b02b353f-9f02-45f6-bd2f-5a34ac867811 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:27.124076 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b02b353f-9f02-45f6-bd2f-5a34ac867811 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:27.256325 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b02b353f-9f02-45f6-bd2f-5a34ac867811 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:27.264278 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b02b353f-9f02-45f6-bd2f-5a34ac867811 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53" status: 200 len: 1680 microversion: 2.1 time: 0.154721 Oct 18 16:30:27.264880 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3474/6968] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:27 2022] GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:30:28.286441 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d3db816b-84f6-4a5c-8ed6-589b606ec73a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:28.287067 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d3db816b-84f6-4a5c-8ed6-589b606ec73a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:28.293919 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d3db816b-84f6-4a5c-8ed6-589b606ec73a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:28.294411 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d3db816b-84f6-4a5c-8ed6-589b606ec73a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:28.294923 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d3db816b-84f6-4a5c-8ed6-589b606ec73a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:28.295888 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d3db816b-84f6-4a5c-8ed6-589b606ec73a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:28.296352 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d3db816b-84f6-4a5c-8ed6-589b606ec73a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:28.296788 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d3db816b-84f6-4a5c-8ed6-589b606ec73a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:28.431544 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d3db816b-84f6-4a5c-8ed6-589b606ec73a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:28.439772 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d3db816b-84f6-4a5c-8ed6-589b606ec73a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53" status: 200 len: 1680 microversion: 2.1 time: 0.157290 Oct 18 16:30:28.440355 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3495/6969] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:28 2022] GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:30:29.463547 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b2bc5eb6-2162-45fd-a424-3484846d5bfc tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:29.464176 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b2bc5eb6-2162-45fd-a424-3484846d5bfc tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:29.471526 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2bc5eb6-2162-45fd-a424-3484846d5bfc tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:29.472003 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2bc5eb6-2162-45fd-a424-3484846d5bfc tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:29.472449 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2bc5eb6-2162-45fd-a424-3484846d5bfc tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:29.473213 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2bc5eb6-2162-45fd-a424-3484846d5bfc tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:29.473669 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2bc5eb6-2162-45fd-a424-3484846d5bfc tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:29.474114 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2bc5eb6-2162-45fd-a424-3484846d5bfc tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:29.604682 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b2bc5eb6-2162-45fd-a424-3484846d5bfc tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:29.612495 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b2bc5eb6-2162-45fd-a424-3484846d5bfc tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53" status: 200 len: 1680 microversion: 2.1 time: 0.152904 Oct 18 16:30:29.613105 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3475/6970] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:29 2022] GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:30:30.635617 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c05cd3a0-d329-43d8-9e62-e3469d447362 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:30.636246 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c05cd3a0-d329-43d8-9e62-e3469d447362 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:30.643239 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c05cd3a0-d329-43d8-9e62-e3469d447362 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:30.643739 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c05cd3a0-d329-43d8-9e62-e3469d447362 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:30.644194 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c05cd3a0-d329-43d8-9e62-e3469d447362 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:30.644935 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c05cd3a0-d329-43d8-9e62-e3469d447362 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:30.645405 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c05cd3a0-d329-43d8-9e62-e3469d447362 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:30.645847 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c05cd3a0-d329-43d8-9e62-e3469d447362 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:30.777945 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c05cd3a0-d329-43d8-9e62-e3469d447362 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:30.786571 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c05cd3a0-d329-43d8-9e62-e3469d447362 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53" status: 200 len: 1680 microversion: 2.1 time: 0.154904 Oct 18 16:30:30.787148 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3496/6971] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:30 2022] GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:30:31.811197 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f8c0990b-8c90-472e-b65c-28130f3d927f tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:31.811813 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f8c0990b-8c90-472e-b65c-28130f3d927f tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:31.818848 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8c0990b-8c90-472e-b65c-28130f3d927f tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:31.819330 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8c0990b-8c90-472e-b65c-28130f3d927f tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:31.819763 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8c0990b-8c90-472e-b65c-28130f3d927f tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:31.820471 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8c0990b-8c90-472e-b65c-28130f3d927f tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:31.820947 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8c0990b-8c90-472e-b65c-28130f3d927f tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:31.821369 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8c0990b-8c90-472e-b65c-28130f3d927f tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:31.954462 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f8c0990b-8c90-472e-b65c-28130f3d927f tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:31.962232 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f8c0990b-8c90-472e-b65c-28130f3d927f tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53" status: 200 len: 1680 microversion: 2.1 time: 0.155597 Oct 18 16:30:31.962811 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3476/6972] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:31 2022] GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:30:32.985829 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-adc21f06-971c-4a1d-8f13-211f20496c1c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:32.986466 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-adc21f06-971c-4a1d-8f13-211f20496c1c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:32.993629 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-adc21f06-971c-4a1d-8f13-211f20496c1c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:32.994132 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-adc21f06-971c-4a1d-8f13-211f20496c1c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:32.994584 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-adc21f06-971c-4a1d-8f13-211f20496c1c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:32.995324 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-adc21f06-971c-4a1d-8f13-211f20496c1c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:32.995827 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-adc21f06-971c-4a1d-8f13-211f20496c1c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:32.996266 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-adc21f06-971c-4a1d-8f13-211f20496c1c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:33.124433 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-adc21f06-971c-4a1d-8f13-211f20496c1c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:33.133774 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-adc21f06-971c-4a1d-8f13-211f20496c1c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53" status: 200 len: 1680 microversion: 2.1 time: 0.152406 Oct 18 16:30:33.134355 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3497/6973] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:32 2022] GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:30:34.157697 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-79eff5ec-afc9-46ce-82fe-cc7c2977731e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:34.158309 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-79eff5ec-afc9-46ce-82fe-cc7c2977731e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:34.165080 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79eff5ec-afc9-46ce-82fe-cc7c2977731e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:34.165564 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79eff5ec-afc9-46ce-82fe-cc7c2977731e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:34.165994 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79eff5ec-afc9-46ce-82fe-cc7c2977731e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:34.166681 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79eff5ec-afc9-46ce-82fe-cc7c2977731e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:34.167130 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79eff5ec-afc9-46ce-82fe-cc7c2977731e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:34.167549 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79eff5ec-afc9-46ce-82fe-cc7c2977731e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:34.301265 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-79eff5ec-afc9-46ce-82fe-cc7c2977731e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:34.309104 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-79eff5ec-afc9-46ce-82fe-cc7c2977731e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53" status: 200 len: 1680 microversion: 2.1 time: 0.155381 Oct 18 16:30:34.309686 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3477/6974] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:34 2022] GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:30:35.333361 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ef7c94eb-806a-40d4-a0f8-9747dcefe8e3 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:35.334045 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ef7c94eb-806a-40d4-a0f8-9747dcefe8e3 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:35.340962 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ef7c94eb-806a-40d4-a0f8-9747dcefe8e3 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:35.341978 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ef7c94eb-806a-40d4-a0f8-9747dcefe8e3 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:35.342435 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ef7c94eb-806a-40d4-a0f8-9747dcefe8e3 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:35.343166 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ef7c94eb-806a-40d4-a0f8-9747dcefe8e3 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:35.343629 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ef7c94eb-806a-40d4-a0f8-9747dcefe8e3 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:35.344073 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ef7c94eb-806a-40d4-a0f8-9747dcefe8e3 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:35.379155 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-57d64403-f94b-4266-a8c6-47486c8dcdb3 req-bdfa89b6-1bb0-451d-a2f1-77df3853755f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53", "name": "network-vif-unplugged", "status": "completed", "tag": "4af24cb9-f285-4480-a985-3509287012b0"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:30:35.389689 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-57d64403-f94b-4266-a8c6-47486c8dcdb3 req-bdfa89b6-1bb0-451d-a2f1-77df3853755f service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:35.390284 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-57d64403-f94b-4266-a8c6-47486c8dcdb3 req-bdfa89b6-1bb0-451d-a2f1-77df3853755f service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:35.390783 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-57d64403-f94b-4266-a8c6-47486c8dcdb3 req-bdfa89b6-1bb0-451d-a2f1-77df3853755f service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:35.408285 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-57d64403-f94b-4266-a8c6-47486c8dcdb3 req-bdfa89b6-1bb0-451d-a2f1-77df3853755f service nova] Creating event network-vif-unplugged:4af24cb9-f285-4480-a985-3509287012b0 for instance fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 on n-h1-853682-5 Oct 18 16:30:35.415767 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [req-57d64403-f94b-4266-a8c6-47486c8dcdb3 req-bdfa89b6-1bb0-451d-a2f1-77df3853755f service nova] Instance fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853682-5', 'n-h1-853682-5'} {{(pid=120406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 18 16:30:35.428122 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-57d64403-f94b-4266-a8c6-47486c8dcdb3 req-bdfa89b6-1bb0-451d-a2f1-77df3853755f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052591 Oct 18 16:30:35.428866 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3478/6975] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:30:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:30:35.694878 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ef7c94eb-806a-40d4-a0f8-9747dcefe8e3 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:35.703050 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ef7c94eb-806a-40d4-a0f8-9747dcefe8e3 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53" status: 200 len: 1679 microversion: 2.1 time: 0.373792 Oct 18 16:30:35.703637 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3498/6976] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:35 2022] GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 => generated 1679 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:30:36.728873 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4a2cb724-ccf8-4326-a1cd-8e55f00acb92 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:36.729590 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4a2cb724-ccf8-4326-a1cd-8e55f00acb92 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:36.736384 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a2cb724-ccf8-4326-a1cd-8e55f00acb92 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:36.736910 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a2cb724-ccf8-4326-a1cd-8e55f00acb92 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:36.737429 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a2cb724-ccf8-4326-a1cd-8e55f00acb92 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:36.738150 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a2cb724-ccf8-4326-a1cd-8e55f00acb92 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:36.738676 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a2cb724-ccf8-4326-a1cd-8e55f00acb92 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:36.739178 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a2cb724-ccf8-4326-a1cd-8e55f00acb92 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:36.880831 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4a2cb724-ccf8-4326-a1cd-8e55f00acb92 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:36.889266 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4a2cb724-ccf8-4326-a1cd-8e55f00acb92 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53" status: 200 len: 1679 microversion: 2.1 time: 0.165492 Oct 18 16:30:36.889841 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3479/6977] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:36 2022] GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:30:37.447718 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-7151efe2-72e0-43fb-93ae-4b5b922f48db req-e527df0d-d8c1-47f0-9c65-fbdcf86fae3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53", "tag": "4af24cb9-f285-4480-a985-3509287012b0"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:30:37.458202 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-7151efe2-72e0-43fb-93ae-4b5b922f48db req-e527df0d-d8c1-47f0-9c65-fbdcf86fae3e service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:37.458688 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-7151efe2-72e0-43fb-93ae-4b5b922f48db req-e527df0d-d8c1-47f0-9c65-fbdcf86fae3e service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:37.459126 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-7151efe2-72e0-43fb-93ae-4b5b922f48db req-e527df0d-d8c1-47f0-9c65-fbdcf86fae3e service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:37.471073 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-7151efe2-72e0-43fb-93ae-4b5b922f48db req-e527df0d-d8c1-47f0-9c65-fbdcf86fae3e service nova] Creating event network-changed:4af24cb9-f285-4480-a985-3509287012b0 for instance fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 on n-h1-853682-5 Oct 18 16:30:37.476306 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [req-7151efe2-72e0-43fb-93ae-4b5b922f48db req-e527df0d-d8c1-47f0-9c65-fbdcf86fae3e service nova] Instance fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853682-5', 'n-h1-853682-5'} {{(pid=120405) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 18 16:30:37.487770 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-7151efe2-72e0-43fb-93ae-4b5b922f48db req-e527df0d-d8c1-47f0-9c65-fbdcf86fae3e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043757 Oct 18 16:30:37.488356 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3499/6978] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:30:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:30:37.913294 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-71eefe17-3977-4f69-b9bc-c92767c93e15 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:37.913918 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-71eefe17-3977-4f69-b9bc-c92767c93e15 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:37.920478 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71eefe17-3977-4f69-b9bc-c92767c93e15 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:37.921011 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71eefe17-3977-4f69-b9bc-c92767c93e15 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:37.921456 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71eefe17-3977-4f69-b9bc-c92767c93e15 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:37.922169 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71eefe17-3977-4f69-b9bc-c92767c93e15 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:37.922627 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71eefe17-3977-4f69-b9bc-c92767c93e15 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:37.923061 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71eefe17-3977-4f69-b9bc-c92767c93e15 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:38.057903 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-71eefe17-3977-4f69-b9bc-c92767c93e15 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:38.065641 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-71eefe17-3977-4f69-b9bc-c92767c93e15 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53" status: 200 len: 1677 microversion: 2.1 time: 0.156744 Oct 18 16:30:38.066230 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3480/6979] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:37 2022] GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:30:39.090614 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3129b213-d48a-456e-a12d-a27cf7f9aa8a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:39.091864 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3129b213-d48a-456e-a12d-a27cf7f9aa8a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:39.098504 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3129b213-d48a-456e-a12d-a27cf7f9aa8a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:39.099012 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3129b213-d48a-456e-a12d-a27cf7f9aa8a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:39.099471 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3129b213-d48a-456e-a12d-a27cf7f9aa8a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:39.100219 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3129b213-d48a-456e-a12d-a27cf7f9aa8a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:39.101103 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3129b213-d48a-456e-a12d-a27cf7f9aa8a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:39.101208 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3129b213-d48a-456e-a12d-a27cf7f9aa8a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:39.238886 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3129b213-d48a-456e-a12d-a27cf7f9aa8a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:39.246843 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3129b213-d48a-456e-a12d-a27cf7f9aa8a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53" status: 200 len: 1677 microversion: 2.1 time: 0.161385 Oct 18 16:30:39.247455 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3500/6980] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:39 2022] GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:30:40.270257 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2041f0c0-59a8-4754-a0cc-53b5080408d1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:40.270920 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2041f0c0-59a8-4754-a0cc-53b5080408d1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:40.277734 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2041f0c0-59a8-4754-a0cc-53b5080408d1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:40.278239 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2041f0c0-59a8-4754-a0cc-53b5080408d1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:40.278713 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2041f0c0-59a8-4754-a0cc-53b5080408d1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:40.279394 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2041f0c0-59a8-4754-a0cc-53b5080408d1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:40.279846 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2041f0c0-59a8-4754-a0cc-53b5080408d1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:40.280269 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2041f0c0-59a8-4754-a0cc-53b5080408d1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:40.412106 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2041f0c0-59a8-4754-a0cc-53b5080408d1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:40.420920 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2041f0c0-59a8-4754-a0cc-53b5080408d1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53" status: 200 len: 1674 microversion: 2.1 time: 0.154546 Oct 18 16:30:40.421515 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3481/6981] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:40 2022] GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:30:40.443434 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-21e5bd06-df11-4920-8330-706d7b2fd768 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:30:40.443974 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-21e5bd06-df11-4920-8330-706d7b2fd768 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:40.450928 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-21e5bd06-df11-4920-8330-706d7b2fd768 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:40.451427 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-21e5bd06-df11-4920-8330-706d7b2fd768 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:40.451881 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-21e5bd06-df11-4920-8330-706d7b2fd768 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:40.452593 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-21e5bd06-df11-4920-8330-706d7b2fd768 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:40.453121 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-21e5bd06-df11-4920-8330-706d7b2fd768 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:40.453573 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-21e5bd06-df11-4920-8330-706d7b2fd768 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:40.514289 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-21e5bd06-df11-4920-8330-706d7b2fd768 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "POST /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53/action" status: 204 len: 0 microversion: 2.1 time: 0.074502 Oct 18 16:30:40.515317 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3501/6982] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:30:40 2022] POST /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:30:40.523782 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-64acafc7-1f0d-427d-84a2-c9ed62376cce tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:40.524358 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-64acafc7-1f0d-427d-84a2-c9ed62376cce tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:40.530897 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64acafc7-1f0d-427d-84a2-c9ed62376cce tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:40.531400 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64acafc7-1f0d-427d-84a2-c9ed62376cce tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:40.531830 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64acafc7-1f0d-427d-84a2-c9ed62376cce tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:40.532531 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64acafc7-1f0d-427d-84a2-c9ed62376cce tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:40.533020 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64acafc7-1f0d-427d-84a2-c9ed62376cce tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:40.533449 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64acafc7-1f0d-427d-84a2-c9ed62376cce tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:40.671149 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-64acafc7-1f0d-427d-84a2-c9ed62376cce tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:40.685178 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-64acafc7-1f0d-427d-84a2-c9ed62376cce tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53" status: 200 len: 1674 microversion: 2.1 time: 0.165228 Oct 18 16:30:40.686045 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3482/6983] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:40 2022] GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 => generated 1674 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:30:41.425040 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-1d1f5351-9d03-4b02-a812-307bfbbd9a9a req-a5796dbf-a0ca-45a2-9a19-779a5bfcd6b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53", "name": "network-vif-plugged", "status": "completed", "tag": "4af24cb9-f285-4480-a985-3509287012b0"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:30:41.436591 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-1d1f5351-9d03-4b02-a812-307bfbbd9a9a req-a5796dbf-a0ca-45a2-9a19-779a5bfcd6b4 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:41.437121 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-1d1f5351-9d03-4b02-a812-307bfbbd9a9a req-a5796dbf-a0ca-45a2-9a19-779a5bfcd6b4 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:41.437720 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-1d1f5351-9d03-4b02-a812-307bfbbd9a9a req-a5796dbf-a0ca-45a2-9a19-779a5bfcd6b4 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:41.450434 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-1d1f5351-9d03-4b02-a812-307bfbbd9a9a req-a5796dbf-a0ca-45a2-9a19-779a5bfcd6b4 service nova] Creating event network-vif-plugged:4af24cb9-f285-4480-a985-3509287012b0 for instance fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 on n-h1-853682-5 Oct 18 16:30:41.456410 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [req-1d1f5351-9d03-4b02-a812-307bfbbd9a9a req-a5796dbf-a0ca-45a2-9a19-779a5bfcd6b4 service nova] Instance fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853682-5', 'n-h1-853682-5'} {{(pid=120405) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 18 16:30:41.468448 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-1d1f5351-9d03-4b02-a812-307bfbbd9a9a req-a5796dbf-a0ca-45a2-9a19-779a5bfcd6b4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047472 Oct 18 16:30:41.469104 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3502/6984] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:30:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:30:41.709198 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4c4965d5-c28a-4066-ba64-d616f8eb3d10 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:41.709816 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4c4965d5-c28a-4066-ba64-d616f8eb3d10 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:41.716556 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c4965d5-c28a-4066-ba64-d616f8eb3d10 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:41.717077 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c4965d5-c28a-4066-ba64-d616f8eb3d10 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:41.717512 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c4965d5-c28a-4066-ba64-d616f8eb3d10 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:41.718218 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c4965d5-c28a-4066-ba64-d616f8eb3d10 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:41.718672 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c4965d5-c28a-4066-ba64-d616f8eb3d10 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:41.719095 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c4965d5-c28a-4066-ba64-d616f8eb3d10 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:41.856511 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4c4965d5-c28a-4066-ba64-d616f8eb3d10 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:41.864996 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4c4965d5-c28a-4066-ba64-d616f8eb3d10 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53" status: 200 len: 1666 microversion: 2.1 time: 0.159658 Oct 18 16:30:41.865583 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3483/6985] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:41 2022] GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 => generated 1666 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:30:41.888706 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-74684e4a-6d94-47b2-a06f-fff0c352df23 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:41.889447 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-74684e4a-6d94-47b2-a06f-fff0c352df23 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:41.895654 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-74684e4a-6d94-47b2-a06f-fff0c352df23 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:41.896149 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-74684e4a-6d94-47b2-a06f-fff0c352df23 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:41.896600 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-74684e4a-6d94-47b2-a06f-fff0c352df23 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:41.897345 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-74684e4a-6d94-47b2-a06f-fff0c352df23 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:41.897815 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-74684e4a-6d94-47b2-a06f-fff0c352df23 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:41.898255 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-74684e4a-6d94-47b2-a06f-fff0c352df23 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:42.025983 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-74684e4a-6d94-47b2-a06f-fff0c352df23 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:42.034443 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-74684e4a-6d94-47b2-a06f-fff0c352df23 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53" status: 200 len: 1666 microversion: 2.1 time: 0.150168 Oct 18 16:30:42.035016 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3503/6986] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:41 2022] GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 => generated 1666 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:30:42.057006 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1f1dd895-f827-4458-a1a6-0cfd90544e85 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:42.057618 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1f1dd895-f827-4458-a1a6-0cfd90544e85 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:42.063527 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f1dd895-f827-4458-a1a6-0cfd90544e85 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:42.064011 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f1dd895-f827-4458-a1a6-0cfd90544e85 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:42.064442 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f1dd895-f827-4458-a1a6-0cfd90544e85 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:42.065158 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f1dd895-f827-4458-a1a6-0cfd90544e85 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:42.065611 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f1dd895-f827-4458-a1a6-0cfd90544e85 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:42.066037 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f1dd895-f827-4458-a1a6-0cfd90544e85 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:42.195737 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1f1dd895-f827-4458-a1a6-0cfd90544e85 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:42.203432 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1f1dd895-f827-4458-a1a6-0cfd90544e85 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53" status: 200 len: 1666 microversion: 2.1 time: 0.150303 Oct 18 16:30:42.204003 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3484/6987] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:42 2022] GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 => generated 1666 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:30:42.226420 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-975ac451-74c4-4779-8d2c-d55d2dd30cbf tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:42.226861 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-975ac451-74c4-4779-8d2c-d55d2dd30cbf tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:42.233474 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-975ac451-74c4-4779-8d2c-d55d2dd30cbf tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:42.233976 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-975ac451-74c4-4779-8d2c-d55d2dd30cbf tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:42.234434 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-975ac451-74c4-4779-8d2c-d55d2dd30cbf tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:42.235177 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-975ac451-74c4-4779-8d2c-d55d2dd30cbf tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:42.235652 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-975ac451-74c4-4779-8d2c-d55d2dd30cbf tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:42.236097 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-975ac451-74c4-4779-8d2c-d55d2dd30cbf tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:42.260770 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-975ac451-74c4-4779-8d2c-d55d2dd30cbf tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:30:42.307299 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:30:42.341972 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-975ac451-74c4-4779-8d2c-d55d2dd30cbf tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "DELETE /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53" status: 204 len: 0 microversion: 2.1 time: 0.118889 Oct 18 16:30:42.342580 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3504/6988] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 16:30:42 2022] DELETE /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:30:42.350812 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4fb927b2-f1f0-429c-a6a3-b5e753ec1cbb tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:42.351427 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4fb927b2-f1f0-429c-a6a3-b5e753ec1cbb tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:42.359759 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4fb927b2-f1f0-429c-a6a3-b5e753ec1cbb tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:42.360248 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4fb927b2-f1f0-429c-a6a3-b5e753ec1cbb tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:42.360679 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4fb927b2-f1f0-429c-a6a3-b5e753ec1cbb tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:42.361426 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4fb927b2-f1f0-429c-a6a3-b5e753ec1cbb tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:42.361881 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4fb927b2-f1f0-429c-a6a3-b5e753ec1cbb tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:42.362296 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4fb927b2-f1f0-429c-a6a3-b5e753ec1cbb tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:42.381200 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:30:42.495735 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4fb927b2-f1f0-429c-a6a3-b5e753ec1cbb tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:42.504097 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4fb927b2-f1f0-429c-a6a3-b5e753ec1cbb tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53" status: 200 len: 1672 microversion: 2.1 time: 0.157113 Oct 18 16:30:42.504675 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3485/6989] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:42 2022] GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:30:43.528343 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-89a6c8dd-066d-4f17-bfca-f37967f26578 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:43.529025 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-89a6c8dd-066d-4f17-bfca-f37967f26578 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:43.536072 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-89a6c8dd-066d-4f17-bfca-f37967f26578 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:43.536572 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-89a6c8dd-066d-4f17-bfca-f37967f26578 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:43.537048 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-89a6c8dd-066d-4f17-bfca-f37967f26578 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:43.537753 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-89a6c8dd-066d-4f17-bfca-f37967f26578 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:43.538219 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-89a6c8dd-066d-4f17-bfca-f37967f26578 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:43.538653 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-89a6c8dd-066d-4f17-bfca-f37967f26578 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:43.674434 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-89a6c8dd-066d-4f17-bfca-f37967f26578 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:43.682340 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-89a6c8dd-066d-4f17-bfca-f37967f26578 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53" status: 200 len: 1672 microversion: 2.1 time: 0.158332 Oct 18 16:30:43.683148 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3505/6990] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:43 2022] GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 => generated 1672 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:30:44.706433 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-40d0c599-0fc6-4722-b3c5-62f49f2d480c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:44.709610 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-40d0c599-0fc6-4722-b3c5-62f49f2d480c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:44.719026 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40d0c599-0fc6-4722-b3c5-62f49f2d480c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:44.719520 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40d0c599-0fc6-4722-b3c5-62f49f2d480c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:44.719961 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40d0c599-0fc6-4722-b3c5-62f49f2d480c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:44.720675 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40d0c599-0fc6-4722-b3c5-62f49f2d480c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:44.721160 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40d0c599-0fc6-4722-b3c5-62f49f2d480c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:44.721619 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40d0c599-0fc6-4722-b3c5-62f49f2d480c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:44.762367 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-367f7421-8f1e-4090-aba1-21d457849c07 req-38ab6184-ca88-4ce2-aec4-96b7aad5692a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53", "name": "network-vif-deleted", "tag": "4af24cb9-f285-4480-a985-3509287012b0"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:30:44.780321 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-367f7421-8f1e-4090-aba1-21d457849c07 req-38ab6184-ca88-4ce2-aec4-96b7aad5692a service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:44.781960 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-367f7421-8f1e-4090-aba1-21d457849c07 req-38ab6184-ca88-4ce2-aec4-96b7aad5692a service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:44.782589 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-367f7421-8f1e-4090-aba1-21d457849c07 req-38ab6184-ca88-4ce2-aec4-96b7aad5692a service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:44.791534 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-40d0c599-0fc6-4722-b3c5-62f49f2d480c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:44.800080 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-367f7421-8f1e-4090-aba1-21d457849c07 req-38ab6184-ca88-4ce2-aec4-96b7aad5692a service nova] Creating event network-vif-deleted:4af24cb9-f285-4480-a985-3509287012b0 for instance fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 on n-h1-853682-5 Oct 18 16:30:44.801191 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-40d0c599-0fc6-4722-b3c5-62f49f2d480c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53" status: 200 len: 1605 microversion: 2.1 time: 0.099271 Oct 18 16:30:44.801789 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3486/6991] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:44 2022] GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 => generated 1605 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:30:44.805666 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-367f7421-8f1e-4090-aba1-21d457849c07 req-38ab6184-ca88-4ce2-aec4-96b7aad5692a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047308 Oct 18 16:30:44.806332 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3506/6992] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:30:45.824820 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-44287c74-18f8-4e7b-a3f3-d92adf87ca92 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:45.826070 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-44287c74-18f8-4e7b-a3f3-d92adf87ca92 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:45.833257 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44287c74-18f8-4e7b-a3f3-d92adf87ca92 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:45.833776 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44287c74-18f8-4e7b-a3f3-d92adf87ca92 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:45.834214 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44287c74-18f8-4e7b-a3f3-d92adf87ca92 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:45.834934 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44287c74-18f8-4e7b-a3f3-d92adf87ca92 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:45.835391 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44287c74-18f8-4e7b-a3f3-d92adf87ca92 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:45.835819 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44287c74-18f8-4e7b-a3f3-d92adf87ca92 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:45.849439 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-44287c74-18f8-4e7b-a3f3-d92adf87ca92 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] HTTP exception thrown: Instance fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 could not be found. Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-44287c74-18f8-4e7b-a3f3-d92adf87ca92 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Request method failure captured: Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 HTTP/1.1 Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTtRtIaUCN9plKHAU4sMF0eKPWeSPc3LcSTEAsfYHO6Ia-co9ZPn6puaeremyzCJ1TQjfFH64XFDE8JVb1F9uH606Ok8WhdDHKOcmm8H7JUvsjzsW5arFpGz6CXjDjVzRoJq_6-HaJ4kSxSPzbYSgopkwKzlavAYaW8OixT5z-2qDJfM Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: f872c1ec84314318ac67bfbe7d186b2c Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerActionsTestJSON-1692549662 Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServerActionsTestJSON-1692549662 Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: f872c1ec84314318ac67bfbe7d186b2c Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerActionsTestJSON-1692549662 Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServerActionsTestJSON-1692549662-project Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 92c26a3ccef246d6bb58d7d834f71106 Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServerActionsTestJSON-1692549662-project Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 could not be found. Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53'} Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 could not be found. Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 could not be found. Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:30:45.851077 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:30:45.856269 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:30:45.856269 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:30:45.856269 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:30:45.856269 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:30:45.856269 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:30:45.856269 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 could not be found. Oct 18 16:30:45.856269 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:30:45.856269 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-44287c74-18f8-4e7b-a3f3-d92adf87ca92 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Returning 404 to user: Instance fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:30:45.856269 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-44287c74-18f8-4e7b-a3f3-d92adf87ca92 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53" status: 404 len: 111 microversion: 2.1 time: 0.031740 Oct 18 16:30:45.856269 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3487/6993] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:45 2022] GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:30:45.864939 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9ff4ddfe-acac-4ba3-8f2f-7661855e8c49 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:45.865658 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9ff4ddfe-acac-4ba3-8f2f-7661855e8c49 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:45.873960 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9ff4ddfe-acac-4ba3-8f2f-7661855e8c49 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:45.874453 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9ff4ddfe-acac-4ba3-8f2f-7661855e8c49 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:45.874900 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9ff4ddfe-acac-4ba3-8f2f-7661855e8c49 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:45.875602 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9ff4ddfe-acac-4ba3-8f2f-7661855e8c49 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:45.876069 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9ff4ddfe-acac-4ba3-8f2f-7661855e8c49 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:45.876509 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9ff4ddfe-acac-4ba3-8f2f-7661855e8c49 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:45.890380 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-9ff4ddfe-acac-4ba3-8f2f-7661855e8c49 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] HTTP exception thrown: Instance fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 could not be found. Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9ff4ddfe-acac-4ba3-8f2f-7661855e8c49 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Request method failure captured: Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 HTTP/1.1 Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTtRtIaUCN9plKHAU4sMF0eKPWeSPc3LcSTEAsfYHO6Ia-co9ZPn6puaeremyzCJ1TQjfFH64XFDE8JVb1F9uH606Ok8WhdDHKOcmm8H7JUvsjzsW5arFpGz6CXjDjVzRoJq_6-HaJ4kSxSPzbYSgopkwKzlavAYaW8OixT5z-2qDJfM Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: f872c1ec84314318ac67bfbe7d186b2c Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServerActionsTestJSON-1692549662 Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServerActionsTestJSON-1692549662 Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: f872c1ec84314318ac67bfbe7d186b2c Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServerActionsTestJSON-1692549662 Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServerActionsTestJSON-1692549662-project Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 92c26a3ccef246d6bb58d7d834f71106 Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServerActionsTestJSON-1692549662-project Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 could not be found. Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53'} Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 could not be found. Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 could not be found. Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:30:45.892028 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:30:45.896903 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:30:45.896903 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:30:45.896903 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:30:45.896903 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:30:45.896903 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:30:45.896903 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 could not be found. Oct 18 16:30:45.896903 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:30:45.896903 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9ff4ddfe-acac-4ba3-8f2f-7661855e8c49 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Returning 404 to user: Instance fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:30:45.896903 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9ff4ddfe-acac-4ba3-8f2f-7661855e8c49 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53" status: 404 len: 111 microversion: 2.1 time: 0.033053 Oct 18 16:30:45.896903 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3507/6994] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:45 2022] GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:30:45.941414 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7b70fdb6-0ff5-4c17-9602-f5e55f7ab0f8 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1711853367", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "cdf0b0ca-963c-402a-919d-35be60437c6f"}], "security_groups": [{"name": "tempest-securitygroup--582261342"}], "key_name": "tempest-keypair-85721457", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:30:46.050145 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-7b70fdb6-0ff5-4c17-9602-f5e55f7ab0f8 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] validate_networks() for [('cdf0b0ca-963c-402a-919d-35be60437c6f', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 16:30:46.418346 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-7b70fdb6-0ff5-4c17-9602-f5e55f7ab0f8 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:30:46.418780 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-7b70fdb6-0ff5-4c17-9602-f5e55f7ab0f8 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:30:46.419850 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-7b70fdb6-0ff5-4c17-9602-f5e55f7ab0f8 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:30:46.420559 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-7b70fdb6-0ff5-4c17-9602-f5e55f7ab0f8 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:30:46.421032 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-7b70fdb6-0ff5-4c17-9602-f5e55f7ab0f8 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:30:46.429997 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b70fdb6-0ff5-4c17-9602-f5e55f7ab0f8 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:46.430481 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b70fdb6-0ff5-4c17-9602-f5e55f7ab0f8 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:46.430920 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b70fdb6-0ff5-4c17-9602-f5e55f7ab0f8 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:46.431651 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b70fdb6-0ff5-4c17-9602-f5e55f7ab0f8 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:46.432112 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b70fdb6-0ff5-4c17-9602-f5e55f7ab0f8 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:46.432539 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b70fdb6-0ff5-4c17-9602-f5e55f7ab0f8 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:46.449465 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-7b70fdb6-0ff5-4c17-9602-f5e55f7ab0f8 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Getting quotas for project f872c1ec84314318ac67bfbe7d186b2c. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:30:46.454682 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-7b70fdb6-0ff5-4c17-9602-f5e55f7ab0f8 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Getting quotas for user 92c26a3ccef246d6bb58d7d834f71106 and project f872c1ec84314318ac67bfbe7d186b2c. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:30:46.467425 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7b70fdb6-0ff5-4c17-9602-f5e55f7ab0f8 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:30:46.470061 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7b70fdb6-0ff5-4c17-9602-f5e55f7ab0f8 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 22669b74-487b-4438-9120-e14517852a0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:30:46.515675 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7b70fdb6-0ff5-4c17-9602-f5e55f7ab0f8 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.578001 Oct 18 16:30:46.516338 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3488/6995] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 16:30:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:30:46.527630 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a5aac60d-bc1c-49f7-a319-c9be32a1ad75 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:46.528291 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a5aac60d-bc1c-49f7-a319-c9be32a1ad75 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 22669b74-487b-4438-9120-e14517852a0a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:46.583362 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a5aac60d-bc1c-49f7-a319-c9be32a1ad75 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:46.592209 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a5aac60d-bc1c-49f7-a319-c9be32a1ad75 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a" status: 200 len: 1237 microversion: 2.1 time: 0.068420 Oct 18 16:30:46.592784 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3508/6996] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:46 2022] GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a => generated 1237 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:30:47.615666 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-78032cf9-5faa-49f7-8857-1198ccbd874f tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:47.616282 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-78032cf9-5faa-49f7-8857-1198ccbd874f tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 22669b74-487b-4438-9120-e14517852a0a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:47.624568 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-78032cf9-5faa-49f7-8857-1198ccbd874f tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:47.625089 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-78032cf9-5faa-49f7-8857-1198ccbd874f tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:47.625532 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-78032cf9-5faa-49f7-8857-1198ccbd874f tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:47.626236 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-78032cf9-5faa-49f7-8857-1198ccbd874f tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:47.626693 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-78032cf9-5faa-49f7-8857-1198ccbd874f tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:47.627122 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-78032cf9-5faa-49f7-8857-1198ccbd874f tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:47.689430 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-78032cf9-5faa-49f7-8857-1198ccbd874f tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:47.697899 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-78032cf9-5faa-49f7-8857-1198ccbd874f tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a" status: 200 len: 1295 microversion: 2.1 time: 0.086186 Oct 18 16:30:47.698494 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3489/6997] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:47 2022] GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a => generated 1295 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:30:48.721308 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0bf5badd-ad61-4889-bbcd-34451bca1ae1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:48.721945 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0bf5badd-ad61-4889-bbcd-34451bca1ae1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 22669b74-487b-4438-9120-e14517852a0a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:48.728515 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0bf5badd-ad61-4889-bbcd-34451bca1ae1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:48.729059 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0bf5badd-ad61-4889-bbcd-34451bca1ae1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:48.729520 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0bf5badd-ad61-4889-bbcd-34451bca1ae1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:48.730246 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0bf5badd-ad61-4889-bbcd-34451bca1ae1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:48.730722 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0bf5badd-ad61-4889-bbcd-34451bca1ae1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:48.731172 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0bf5badd-ad61-4889-bbcd-34451bca1ae1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:48.867552 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0bf5badd-ad61-4889-bbcd-34451bca1ae1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:48.877418 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0bf5badd-ad61-4889-bbcd-34451bca1ae1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a" status: 200 len: 1362 microversion: 2.1 time: 0.159678 Oct 18 16:30:48.878266 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3509/6998] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:48 2022] GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:30:48.880560 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-1d72c7d8-29c8-4594-ba97-a0aba24fb696 req-776b2f36-27b5-49d6-9270-e2590c59fc9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22669b74-487b-4438-9120-e14517852a0a", "tag": "66af0d3e-9ff1-4f4b-8b2b-c3d8e03ca9c2"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:30:48.896767 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1d72c7d8-29c8-4594-ba97-a0aba24fb696 req-776b2f36-27b5-49d6-9270-e2590c59fc9b service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:48.897410 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1d72c7d8-29c8-4594-ba97-a0aba24fb696 req-776b2f36-27b5-49d6-9270-e2590c59fc9b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:48.897950 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1d72c7d8-29c8-4594-ba97-a0aba24fb696 req-776b2f36-27b5-49d6-9270-e2590c59fc9b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:48.909683 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-1d72c7d8-29c8-4594-ba97-a0aba24fb696 req-776b2f36-27b5-49d6-9270-e2590c59fc9b service nova] Creating event network-changed:66af0d3e-9ff1-4f4b-8b2b-c3d8e03ca9c2 for instance 22669b74-487b-4438-9120-e14517852a0a on n-h2-853682-5 Oct 18 16:30:48.914729 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-1d72c7d8-29c8-4594-ba97-a0aba24fb696 req-776b2f36-27b5-49d6-9270-e2590c59fc9b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040887 Oct 18 16:30:48.915354 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3490/6999] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:30:49.904636 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-836c45dc-fee8-4474-8d2b-8fa78e9ce325 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:49.905286 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-836c45dc-fee8-4474-8d2b-8fa78e9ce325 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 22669b74-487b-4438-9120-e14517852a0a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:49.912098 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-836c45dc-fee8-4474-8d2b-8fa78e9ce325 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:49.912595 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-836c45dc-fee8-4474-8d2b-8fa78e9ce325 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:49.913068 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-836c45dc-fee8-4474-8d2b-8fa78e9ce325 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:49.913778 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-836c45dc-fee8-4474-8d2b-8fa78e9ce325 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:49.914247 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-836c45dc-fee8-4474-8d2b-8fa78e9ce325 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:49.914685 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-836c45dc-fee8-4474-8d2b-8fa78e9ce325 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:50.042288 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-836c45dc-fee8-4474-8d2b-8fa78e9ce325 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:50.050371 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-836c45dc-fee8-4474-8d2b-8fa78e9ce325 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a" status: 200 len: 1362 microversion: 2.1 time: 0.150236 Oct 18 16:30:50.050940 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3510/7000] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:49 2022] GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:30:51.075200 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-17946689-9a06-4ba7-a580-6fd9a2cdcf3e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:51.075908 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-17946689-9a06-4ba7-a580-6fd9a2cdcf3e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 22669b74-487b-4438-9120-e14517852a0a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:51.077891 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:30:51.083216 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17946689-9a06-4ba7-a580-6fd9a2cdcf3e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:51.083956 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17946689-9a06-4ba7-a580-6fd9a2cdcf3e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:51.084150 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17946689-9a06-4ba7-a580-6fd9a2cdcf3e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:51.084888 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17946689-9a06-4ba7-a580-6fd9a2cdcf3e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:51.085348 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17946689-9a06-4ba7-a580-6fd9a2cdcf3e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:51.085778 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17946689-9a06-4ba7-a580-6fd9a2cdcf3e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:51.225252 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-17946689-9a06-4ba7-a580-6fd9a2cdcf3e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:51.233652 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-17946689-9a06-4ba7-a580-6fd9a2cdcf3e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a" status: 200 len: 1362 microversion: 2.1 time: 0.163609 Oct 18 16:30:51.234231 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3491/7001] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:51 2022] GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:30:52.257183 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-78f6d5e7-2603-4332-9c06-292457486690 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:52.257807 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-78f6d5e7-2603-4332-9c06-292457486690 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 22669b74-487b-4438-9120-e14517852a0a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:52.260672 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:30:52.266486 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-78f6d5e7-2603-4332-9c06-292457486690 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:52.266977 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-78f6d5e7-2603-4332-9c06-292457486690 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:52.267423 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-78f6d5e7-2603-4332-9c06-292457486690 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:52.268124 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-78f6d5e7-2603-4332-9c06-292457486690 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:52.268588 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-78f6d5e7-2603-4332-9c06-292457486690 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:52.269085 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-78f6d5e7-2603-4332-9c06-292457486690 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:52.403917 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-78f6d5e7-2603-4332-9c06-292457486690 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:52.411534 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-78f6d5e7-2603-4332-9c06-292457486690 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a" status: 200 len: 1362 microversion: 2.1 time: 0.158300 Oct 18 16:30:52.412098 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3511/7002] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:52 2022] GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:30:53.071206 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-4c95e08c-82c4-4bcb-8781-63b46b8c6d9b req-544880aa-a3bc-4b0c-8078-3f334a160711 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22669b74-487b-4438-9120-e14517852a0a", "name": "network-vif-plugged", "status": "completed", "tag": "66af0d3e-9ff1-4f4b-8b2b-c3d8e03ca9c2"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:30:53.082877 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4c95e08c-82c4-4bcb-8781-63b46b8c6d9b req-544880aa-a3bc-4b0c-8078-3f334a160711 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:53.083409 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4c95e08c-82c4-4bcb-8781-63b46b8c6d9b req-544880aa-a3bc-4b0c-8078-3f334a160711 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:53.083920 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4c95e08c-82c4-4bcb-8781-63b46b8c6d9b req-544880aa-a3bc-4b0c-8078-3f334a160711 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:53.096784 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-4c95e08c-82c4-4bcb-8781-63b46b8c6d9b req-544880aa-a3bc-4b0c-8078-3f334a160711 service nova] Creating event network-vif-plugged:66af0d3e-9ff1-4f4b-8b2b-c3d8e03ca9c2 for instance 22669b74-487b-4438-9120-e14517852a0a on n-h2-853682-5 Oct 18 16:30:53.102254 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-4c95e08c-82c4-4bcb-8781-63b46b8c6d9b req-544880aa-a3bc-4b0c-8078-3f334a160711 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035813 Oct 18 16:30:53.102879 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3492/7003] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:30:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:30:53.435370 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4d65ae1b-aecf-43f4-9200-24369b6c96ff tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:53.436006 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4d65ae1b-aecf-43f4-9200-24369b6c96ff tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 22669b74-487b-4438-9120-e14517852a0a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:53.443312 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4d65ae1b-aecf-43f4-9200-24369b6c96ff tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:53.443813 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4d65ae1b-aecf-43f4-9200-24369b6c96ff tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:53.444272 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4d65ae1b-aecf-43f4-9200-24369b6c96ff tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:53.445022 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4d65ae1b-aecf-43f4-9200-24369b6c96ff tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:53.445501 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4d65ae1b-aecf-43f4-9200-24369b6c96ff tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:53.445948 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4d65ae1b-aecf-43f4-9200-24369b6c96ff tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:53.585887 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4d65ae1b-aecf-43f4-9200-24369b6c96ff tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:53.594247 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4d65ae1b-aecf-43f4-9200-24369b6c96ff tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a" status: 200 len: 1362 microversion: 2.1 time: 0.162903 Oct 18 16:30:53.594820 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3512/7004] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:53 2022] GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:30:54.619117 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fea26c9a-cab5-4380-91ab-84a4892671f4 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:54.619857 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fea26c9a-cab5-4380-91ab-84a4892671f4 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 22669b74-487b-4438-9120-e14517852a0a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:54.626812 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fea26c9a-cab5-4380-91ab-84a4892671f4 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:54.627300 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fea26c9a-cab5-4380-91ab-84a4892671f4 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:54.627735 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fea26c9a-cab5-4380-91ab-84a4892671f4 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:54.628430 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fea26c9a-cab5-4380-91ab-84a4892671f4 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:54.628917 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fea26c9a-cab5-4380-91ab-84a4892671f4 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:54.629348 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fea26c9a-cab5-4380-91ab-84a4892671f4 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:54.766526 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fea26c9a-cab5-4380-91ab-84a4892671f4 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:30:54.774363 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fea26c9a-cab5-4380-91ab-84a4892671f4 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a" status: 200 len: 1548 microversion: 2.1 time: 0.160571 Oct 18 16:30:54.774957 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3493/7005] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:30:54 2022] GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a => generated 1548 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:30:54.800119 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-446a0ddd-bd12-453f-9837-ac2a85258d72 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:30:54.800653 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-446a0ddd-bd12-453f-9837-ac2a85258d72 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 22669b74-487b-4438-9120-e14517852a0a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:30:54.807475 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-446a0ddd-bd12-453f-9837-ac2a85258d72 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:54.807968 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-446a0ddd-bd12-453f-9837-ac2a85258d72 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:54.808424 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-446a0ddd-bd12-453f-9837-ac2a85258d72 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:54.809156 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-446a0ddd-bd12-453f-9837-ac2a85258d72 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:54.809639 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-446a0ddd-bd12-453f-9837-ac2a85258d72 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:54.810085 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-446a0ddd-bd12-453f-9837-ac2a85258d72 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:54.887558 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-446a0ddd-bd12-453f-9837-ac2a85258d72 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091232 Oct 18 16:30:54.888160 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3513/7006] 10.222.0.60 () {58 vars in 1275 bytes} [Tue Oct 18 16:30:54 2022] GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:30:56.074250 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-8d895430-ee97-4be7-908f-c2b53edda30a req-4b07f457-d393-4770-9b7d-13496dd003b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22669b74-487b-4438-9120-e14517852a0a", "tag": "66af0d3e-9ff1-4f4b-8b2b-c3d8e03ca9c2"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:30:56.084985 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8d895430-ee97-4be7-908f-c2b53edda30a req-4b07f457-d393-4770-9b7d-13496dd003b1 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:30:56.085474 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8d895430-ee97-4be7-908f-c2b53edda30a req-4b07f457-d393-4770-9b7d-13496dd003b1 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:30:56.085914 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8d895430-ee97-4be7-908f-c2b53edda30a req-4b07f457-d393-4770-9b7d-13496dd003b1 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:30:56.098080 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-8d895430-ee97-4be7-908f-c2b53edda30a req-4b07f457-d393-4770-9b7d-13496dd003b1 service nova] Creating event network-changed:66af0d3e-9ff1-4f4b-8b2b-c3d8e03ca9c2 for instance 22669b74-487b-4438-9120-e14517852a0a on n-h2-853682-5 Oct 18 16:30:56.103344 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-8d895430-ee97-4be7-908f-c2b53edda30a req-4b07f457-d393-4770-9b7d-13496dd003b1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032730 Oct 18 16:30:56.103976 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3494/7007] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:30:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:31:29.019692 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:29.020552 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=5 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:29.021392 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=40,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:29.025706 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2a2c8b1b-d492-4d31-b13c-cfd10d059e4b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:31:29.034080 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a2c8b1b-d492-4d31-b13c-cfd10d059e4b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:29.034583 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a2c8b1b-d492-4d31-b13c-cfd10d059e4b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:29.035039 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2a2c8b1b-d492-4d31-b13c-cfd10d059e4b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:29.057875 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2a2c8b1b-d492-4d31-b13c-cfd10d059e4b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 22669b74-487b-4438-9120-e14517852a0a] Going to try to stop instance {{(pid=120405) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 18 16:31:29.101511 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2a2c8b1b-d492-4d31-b13c-cfd10d059e4b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "POST /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a/action" status: 202 len: 0 microversion: 2.1 time: 0.083490 Oct 18 16:31:29.102176 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3514/7008] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:31:29 2022] POST /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:31:29.107831 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:29.108718 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:29.111800 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=7 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:29.112472 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=36 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:29.116873 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0131d096-85c3-4962-8748-68b9d3a4ed1b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:29.117596 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0131d096-85c3-4962-8748-68b9d3a4ed1b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 22669b74-487b-4438-9120-e14517852a0a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:29.127007 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0131d096-85c3-4962-8748-68b9d3a4ed1b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:29.127493 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0131d096-85c3-4962-8748-68b9d3a4ed1b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:29.127932 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0131d096-85c3-4962-8748-68b9d3a4ed1b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:29.128639 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0131d096-85c3-4962-8748-68b9d3a4ed1b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:29.129137 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0131d096-85c3-4962-8748-68b9d3a4ed1b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:29.129569 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0131d096-85c3-4962-8748-68b9d3a4ed1b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:29.261844 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0131d096-85c3-4962-8748-68b9d3a4ed1b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:29.269996 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0131d096-85c3-4962-8748-68b9d3a4ed1b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a" status: 200 len: 1677 microversion: 2.1 time: 0.163109 Oct 18 16:31:29.270506 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3495/7009] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:29 2022] GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:30.294994 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-818c6517-06b6-4e7b-adf5-13ef9a48dd47 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:30.295702 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-818c6517-06b6-4e7b-adf5-13ef9a48dd47 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 22669b74-487b-4438-9120-e14517852a0a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:30.301993 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-818c6517-06b6-4e7b-adf5-13ef9a48dd47 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:30.302492 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-818c6517-06b6-4e7b-adf5-13ef9a48dd47 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:30.302940 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-818c6517-06b6-4e7b-adf5-13ef9a48dd47 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:30.303645 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-818c6517-06b6-4e7b-adf5-13ef9a48dd47 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:30.304112 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-818c6517-06b6-4e7b-adf5-13ef9a48dd47 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:30.304550 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-818c6517-06b6-4e7b-adf5-13ef9a48dd47 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:30.436512 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-818c6517-06b6-4e7b-adf5-13ef9a48dd47 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:30.444447 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-818c6517-06b6-4e7b-adf5-13ef9a48dd47 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a" status: 200 len: 1677 microversion: 2.1 time: 0.154774 Oct 18 16:31:30.445069 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3515/7010] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:30 2022] GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:31.467928 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5551ae1a-94d9-4f36-b861-3bc84443bd8a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:31.468535 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5551ae1a-94d9-4f36-b861-3bc84443bd8a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 22669b74-487b-4438-9120-e14517852a0a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:31.476195 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5551ae1a-94d9-4f36-b861-3bc84443bd8a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:31.476671 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5551ae1a-94d9-4f36-b861-3bc84443bd8a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:31.477128 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5551ae1a-94d9-4f36-b861-3bc84443bd8a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:31.477811 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5551ae1a-94d9-4f36-b861-3bc84443bd8a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:31.478261 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5551ae1a-94d9-4f36-b861-3bc84443bd8a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:31.478682 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5551ae1a-94d9-4f36-b861-3bc84443bd8a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:31.606883 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5551ae1a-94d9-4f36-b861-3bc84443bd8a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:31.615264 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5551ae1a-94d9-4f36-b861-3bc84443bd8a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a" status: 200 len: 1677 microversion: 2.1 time: 0.151204 Oct 18 16:31:31.615840 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3496/7011] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:31 2022] GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:32.638012 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5ffc77d8-c2d1-4dbb-8648-eb1372e4a88a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:32.638671 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5ffc77d8-c2d1-4dbb-8648-eb1372e4a88a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 22669b74-487b-4438-9120-e14517852a0a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:32.645537 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5ffc77d8-c2d1-4dbb-8648-eb1372e4a88a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:32.646059 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5ffc77d8-c2d1-4dbb-8648-eb1372e4a88a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:32.646511 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5ffc77d8-c2d1-4dbb-8648-eb1372e4a88a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:32.647215 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5ffc77d8-c2d1-4dbb-8648-eb1372e4a88a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:32.647689 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5ffc77d8-c2d1-4dbb-8648-eb1372e4a88a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:32.648124 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5ffc77d8-c2d1-4dbb-8648-eb1372e4a88a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:32.782778 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5ffc77d8-c2d1-4dbb-8648-eb1372e4a88a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:32.790662 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5ffc77d8-c2d1-4dbb-8648-eb1372e4a88a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a" status: 200 len: 1677 microversion: 2.1 time: 0.156573 Oct 18 16:31:32.791251 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3516/7012] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:32 2022] GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:33.814662 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b6fdf844-24be-4802-9d1c-1041404fcb40 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:33.815292 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b6fdf844-24be-4802-9d1c-1041404fcb40 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 22669b74-487b-4438-9120-e14517852a0a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:33.822177 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b6fdf844-24be-4802-9d1c-1041404fcb40 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:33.822660 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b6fdf844-24be-4802-9d1c-1041404fcb40 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:33.823097 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b6fdf844-24be-4802-9d1c-1041404fcb40 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:33.823788 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b6fdf844-24be-4802-9d1c-1041404fcb40 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:33.824257 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b6fdf844-24be-4802-9d1c-1041404fcb40 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:33.824684 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b6fdf844-24be-4802-9d1c-1041404fcb40 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:33.957155 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b6fdf844-24be-4802-9d1c-1041404fcb40 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:33.964963 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b6fdf844-24be-4802-9d1c-1041404fcb40 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a" status: 200 len: 1677 microversion: 2.1 time: 0.154350 Oct 18 16:31:33.965541 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3497/7013] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:33 2022] GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:34.990198 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e16ab3f5-d1c4-4f1d-b256-187deeba0149 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:34.990735 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e16ab3f5-d1c4-4f1d-b256-187deeba0149 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 22669b74-487b-4438-9120-e14517852a0a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:34.997564 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e16ab3f5-d1c4-4f1d-b256-187deeba0149 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:34.998070 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e16ab3f5-d1c4-4f1d-b256-187deeba0149 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:34.998530 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e16ab3f5-d1c4-4f1d-b256-187deeba0149 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:34.999237 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e16ab3f5-d1c4-4f1d-b256-187deeba0149 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:34.999707 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e16ab3f5-d1c4-4f1d-b256-187deeba0149 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:35.000676 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e16ab3f5-d1c4-4f1d-b256-187deeba0149 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:35.130780 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e16ab3f5-d1c4-4f1d-b256-187deeba0149 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:35.138642 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e16ab3f5-d1c4-4f1d-b256-187deeba0149 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a" status: 200 len: 1677 microversion: 2.1 time: 0.152572 Oct 18 16:31:35.139207 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3517/7014] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:34 2022] GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:31:36.163356 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d87bcb96-fa52-4990-8dca-c2309bfab1e9 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:36.164342 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d87bcb96-fa52-4990-8dca-c2309bfab1e9 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 22669b74-487b-4438-9120-e14517852a0a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:36.171356 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d87bcb96-fa52-4990-8dca-c2309bfab1e9 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:36.171849 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d87bcb96-fa52-4990-8dca-c2309bfab1e9 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:36.172294 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d87bcb96-fa52-4990-8dca-c2309bfab1e9 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:36.173031 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d87bcb96-fa52-4990-8dca-c2309bfab1e9 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:36.173494 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d87bcb96-fa52-4990-8dca-c2309bfab1e9 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:36.173922 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d87bcb96-fa52-4990-8dca-c2309bfab1e9 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:36.310261 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d87bcb96-fa52-4990-8dca-c2309bfab1e9 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:36.318000 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d87bcb96-fa52-4990-8dca-c2309bfab1e9 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a" status: 200 len: 1677 microversion: 2.1 time: 0.158911 Oct 18 16:31:36.318577 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3498/7015] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:36 2022] GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:37.341832 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4549a507-019f-4a9c-9ae8-3bd38084eeb0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:37.342456 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4549a507-019f-4a9c-9ae8-3bd38084eeb0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 22669b74-487b-4438-9120-e14517852a0a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:37.349241 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4549a507-019f-4a9c-9ae8-3bd38084eeb0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:37.349729 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4549a507-019f-4a9c-9ae8-3bd38084eeb0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:37.350176 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4549a507-019f-4a9c-9ae8-3bd38084eeb0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:37.350870 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4549a507-019f-4a9c-9ae8-3bd38084eeb0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:37.351336 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4549a507-019f-4a9c-9ae8-3bd38084eeb0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:37.351775 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4549a507-019f-4a9c-9ae8-3bd38084eeb0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:37.479729 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4549a507-019f-4a9c-9ae8-3bd38084eeb0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:37.488061 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4549a507-019f-4a9c-9ae8-3bd38084eeb0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a" status: 200 len: 1677 microversion: 2.1 time: 0.150188 Oct 18 16:31:37.488635 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3518/7016] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:37 2022] GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:38.511649 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-463942a4-6d01-4ee8-a1d4-92fcd97f8704 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:38.512280 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-463942a4-6d01-4ee8-a1d4-92fcd97f8704 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 22669b74-487b-4438-9120-e14517852a0a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:38.519428 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-463942a4-6d01-4ee8-a1d4-92fcd97f8704 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:38.519914 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-463942a4-6d01-4ee8-a1d4-92fcd97f8704 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:38.520355 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-463942a4-6d01-4ee8-a1d4-92fcd97f8704 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:38.521090 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-463942a4-6d01-4ee8-a1d4-92fcd97f8704 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:38.521551 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-463942a4-6d01-4ee8-a1d4-92fcd97f8704 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:38.521987 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-463942a4-6d01-4ee8-a1d4-92fcd97f8704 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:38.652940 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-463942a4-6d01-4ee8-a1d4-92fcd97f8704 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:38.660655 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-463942a4-6d01-4ee8-a1d4-92fcd97f8704 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a" status: 200 len: 1677 microversion: 2.1 time: 0.152952 Oct 18 16:31:38.661280 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3499/7017] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:38 2022] GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:39.683837 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1dfea906-dabb-404d-abc2-1f7cb3ec5266 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:39.684477 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1dfea906-dabb-404d-abc2-1f7cb3ec5266 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 22669b74-487b-4438-9120-e14517852a0a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:39.691850 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1dfea906-dabb-404d-abc2-1f7cb3ec5266 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:39.692531 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1dfea906-dabb-404d-abc2-1f7cb3ec5266 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:39.693028 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1dfea906-dabb-404d-abc2-1f7cb3ec5266 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:39.693745 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1dfea906-dabb-404d-abc2-1f7cb3ec5266 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:39.694214 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1dfea906-dabb-404d-abc2-1f7cb3ec5266 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:39.694653 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1dfea906-dabb-404d-abc2-1f7cb3ec5266 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:39.828088 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1dfea906-dabb-404d-abc2-1f7cb3ec5266 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:39.835895 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1dfea906-dabb-404d-abc2-1f7cb3ec5266 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a" status: 200 len: 1654 microversion: 2.1 time: 0.156208 Oct 18 16:31:39.836470 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3519/7018] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:39 2022] GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a => generated 1654 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:39.858774 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6edb02f8-2fd0-4f41-9e2a-3ee986846461 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:31:39.861920 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6edb02f8-2fd0-4f41-9e2a-3ee986846461 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 22669b74-487b-4438-9120-e14517852a0a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:39.868882 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6edb02f8-2fd0-4f41-9e2a-3ee986846461 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:39.869373 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6edb02f8-2fd0-4f41-9e2a-3ee986846461 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:39.869807 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6edb02f8-2fd0-4f41-9e2a-3ee986846461 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:39.870495 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6edb02f8-2fd0-4f41-9e2a-3ee986846461 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:39.870947 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6edb02f8-2fd0-4f41-9e2a-3ee986846461 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:39.871368 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6edb02f8-2fd0-4f41-9e2a-3ee986846461 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:39.901809 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6edb02f8-2fd0-4f41-9e2a-3ee986846461 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:39.907727 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6edb02f8-2fd0-4f41-9e2a-3ee986846461 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 22669b74-487b-4438-9120-e14517852a0a] Old instance type m1.heat2, new instance type m1.heat {{(pid=120406) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 18 16:31:39.914370 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-6edb02f8-2fd0-4f41-9e2a-3ee986846461 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:31:39.914786 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-6edb02f8-2fd0-4f41-9e2a-3ee986846461 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:31:39.915255 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-6edb02f8-2fd0-4f41-9e2a-3ee986846461 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:31:39.915661 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-6edb02f8-2fd0-4f41-9e2a-3ee986846461 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:31:39.916066 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-6edb02f8-2fd0-4f41-9e2a-3ee986846461 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:31:39.979595 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6edb02f8-2fd0-4f41-9e2a-3ee986846461 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "POST /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a/action" status: 202 len: 0 microversion: 2.1 time: 0.124278 Oct 18 16:31:39.979932 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3500/7019] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:31:39 2022] POST /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:31:39.988334 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6cf3145c-3692-4ea9-acb3-be8a3da4ebf9 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:39.989071 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6cf3145c-3692-4ea9-acb3-be8a3da4ebf9 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 22669b74-487b-4438-9120-e14517852a0a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:39.995233 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6cf3145c-3692-4ea9-acb3-be8a3da4ebf9 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:39.995728 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6cf3145c-3692-4ea9-acb3-be8a3da4ebf9 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:39.996206 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6cf3145c-3692-4ea9-acb3-be8a3da4ebf9 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:39.996939 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6cf3145c-3692-4ea9-acb3-be8a3da4ebf9 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:39.997409 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6cf3145c-3692-4ea9-acb3-be8a3da4ebf9 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:39.997841 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6cf3145c-3692-4ea9-acb3-be8a3da4ebf9 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:40.166698 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6cf3145c-3692-4ea9-acb3-be8a3da4ebf9 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:40.175218 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6cf3145c-3692-4ea9-acb3-be8a3da4ebf9 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a" status: 200 len: 1677 microversion: 2.1 time: 0.190820 Oct 18 16:31:40.175835 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3520/7020] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:39 2022] GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a => generated 1677 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:41.199412 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2dee58cb-56dd-4eb6-945e-e0f6859069cc tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:41.199952 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2dee58cb-56dd-4eb6-945e-e0f6859069cc tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 22669b74-487b-4438-9120-e14517852a0a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:41.206933 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2dee58cb-56dd-4eb6-945e-e0f6859069cc tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:41.207418 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2dee58cb-56dd-4eb6-945e-e0f6859069cc tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:41.207856 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2dee58cb-56dd-4eb6-945e-e0f6859069cc tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:41.208559 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2dee58cb-56dd-4eb6-945e-e0f6859069cc tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:41.209051 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2dee58cb-56dd-4eb6-945e-e0f6859069cc tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:41.209483 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2dee58cb-56dd-4eb6-945e-e0f6859069cc tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:41.349563 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2dee58cb-56dd-4eb6-945e-e0f6859069cc tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:41.357745 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2dee58cb-56dd-4eb6-945e-e0f6859069cc tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a" status: 200 len: 1677 microversion: 2.1 time: 0.163296 Oct 18 16:31:41.358339 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3501/7021] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:41 2022] GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:42.381659 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-69756342-dff1-4da8-be84-6f440129de84 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:42.382280 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-69756342-dff1-4da8-be84-6f440129de84 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 22669b74-487b-4438-9120-e14517852a0a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:42.389325 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-69756342-dff1-4da8-be84-6f440129de84 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:42.389817 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-69756342-dff1-4da8-be84-6f440129de84 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:42.390263 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-69756342-dff1-4da8-be84-6f440129de84 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:42.390961 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-69756342-dff1-4da8-be84-6f440129de84 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:42.391439 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-69756342-dff1-4da8-be84-6f440129de84 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:42.391855 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-69756342-dff1-4da8-be84-6f440129de84 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:42.525112 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-69756342-dff1-4da8-be84-6f440129de84 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:42.532796 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-69756342-dff1-4da8-be84-6f440129de84 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a" status: 200 len: 1682 microversion: 2.1 time: 0.155006 Oct 18 16:31:42.533387 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3521/7022] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:42 2022] GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:43.558355 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9d93c1a8-a8d4-4206-a03e-6bc75a78700b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:43.558985 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9d93c1a8-a8d4-4206-a03e-6bc75a78700b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 22669b74-487b-4438-9120-e14517852a0a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:43.566524 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d93c1a8-a8d4-4206-a03e-6bc75a78700b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:43.567015 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d93c1a8-a8d4-4206-a03e-6bc75a78700b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:43.567459 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d93c1a8-a8d4-4206-a03e-6bc75a78700b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:43.568161 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d93c1a8-a8d4-4206-a03e-6bc75a78700b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:43.568619 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d93c1a8-a8d4-4206-a03e-6bc75a78700b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:43.569113 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d93c1a8-a8d4-4206-a03e-6bc75a78700b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:43.747685 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9d93c1a8-a8d4-4206-a03e-6bc75a78700b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:43.756075 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9d93c1a8-a8d4-4206-a03e-6bc75a78700b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a" status: 200 len: 1682 microversion: 2.1 time: 0.201641 Oct 18 16:31:43.756887 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3502/7023] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:43 2022] GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a => generated 1682 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:44.104131 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-794d1181-78d2-4642-9217-e1328af24841 req-abbf75b2-49b2-4725-8e73-85fb927befe1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22669b74-487b-4438-9120-e14517852a0a", "name": "network-vif-unplugged", "status": "completed", "tag": "66af0d3e-9ff1-4f4b-8b2b-c3d8e03ca9c2"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:31:44.114960 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-794d1181-78d2-4642-9217-e1328af24841 req-abbf75b2-49b2-4725-8e73-85fb927befe1 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:44.115672 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-794d1181-78d2-4642-9217-e1328af24841 req-abbf75b2-49b2-4725-8e73-85fb927befe1 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:44.115880 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-794d1181-78d2-4642-9217-e1328af24841 req-abbf75b2-49b2-4725-8e73-85fb927befe1 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:44.131341 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-794d1181-78d2-4642-9217-e1328af24841 req-abbf75b2-49b2-4725-8e73-85fb927befe1 service nova] Creating event network-vif-unplugged:66af0d3e-9ff1-4f4b-8b2b-c3d8e03ca9c2 for instance 22669b74-487b-4438-9120-e14517852a0a on n-h1-853682-5 Oct 18 16:31:44.137089 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [req-794d1181-78d2-4642-9217-e1328af24841 req-abbf75b2-49b2-4725-8e73-85fb927befe1 service nova] Instance 22669b74-487b-4438-9120-e14517852a0a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853682-5', 'n-h1-853682-5'} {{(pid=120405) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 18 16:31:44.148318 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-794d1181-78d2-4642-9217-e1328af24841 req-abbf75b2-49b2-4725-8e73-85fb927befe1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047979 Oct 18 16:31:44.148959 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3522/7024] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:31:44.779396 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e27dc6d3-b6e4-4059-8bdc-c08918f99131 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:44.780009 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e27dc6d3-b6e4-4059-8bdc-c08918f99131 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 22669b74-487b-4438-9120-e14517852a0a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:44.787011 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e27dc6d3-b6e4-4059-8bdc-c08918f99131 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:44.787501 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e27dc6d3-b6e4-4059-8bdc-c08918f99131 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:44.787933 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e27dc6d3-b6e4-4059-8bdc-c08918f99131 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:44.788635 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e27dc6d3-b6e4-4059-8bdc-c08918f99131 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:44.789115 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e27dc6d3-b6e4-4059-8bdc-c08918f99131 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:44.789550 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e27dc6d3-b6e4-4059-8bdc-c08918f99131 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:45.008291 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e27dc6d3-b6e4-4059-8bdc-c08918f99131 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:45.016034 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e27dc6d3-b6e4-4059-8bdc-c08918f99131 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a" status: 200 len: 1681 microversion: 2.1 time: 0.240511 Oct 18 16:31:45.016614 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3503/7025] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:44 2022] GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a => generated 1681 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:46.041602 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4f168a4f-ddad-4243-a70f-e0e6ea02b934 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:46.042363 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4f168a4f-ddad-4243-a70f-e0e6ea02b934 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 22669b74-487b-4438-9120-e14517852a0a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:46.049404 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4f168a4f-ddad-4243-a70f-e0e6ea02b934 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:46.049893 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4f168a4f-ddad-4243-a70f-e0e6ea02b934 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:46.050335 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4f168a4f-ddad-4243-a70f-e0e6ea02b934 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:46.051026 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4f168a4f-ddad-4243-a70f-e0e6ea02b934 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:46.051488 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4f168a4f-ddad-4243-a70f-e0e6ea02b934 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:46.051921 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4f168a4f-ddad-4243-a70f-e0e6ea02b934 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:46.189319 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-97a51863-a131-4378-b4c4-d9a288451292 req-d11e08e0-8225-4bb6-bf87-fae189189ce8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22669b74-487b-4438-9120-e14517852a0a", "tag": "66af0d3e-9ff1-4f4b-8b2b-c3d8e03ca9c2"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:31:46.200194 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-97a51863-a131-4378-b4c4-d9a288451292 req-d11e08e0-8225-4bb6-bf87-fae189189ce8 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:46.200677 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-97a51863-a131-4378-b4c4-d9a288451292 req-d11e08e0-8225-4bb6-bf87-fae189189ce8 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:46.201167 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-97a51863-a131-4378-b4c4-d9a288451292 req-d11e08e0-8225-4bb6-bf87-fae189189ce8 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:46.217827 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-97a51863-a131-4378-b4c4-d9a288451292 req-d11e08e0-8225-4bb6-bf87-fae189189ce8 service nova] Creating event network-changed:66af0d3e-9ff1-4f4b-8b2b-c3d8e03ca9c2 for instance 22669b74-487b-4438-9120-e14517852a0a on n-h1-853682-5 Oct 18 16:31:46.224196 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [req-97a51863-a131-4378-b4c4-d9a288451292 req-d11e08e0-8225-4bb6-bf87-fae189189ce8 service nova] Instance 22669b74-487b-4438-9120-e14517852a0a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853682-5', 'n-h1-853682-5'} {{(pid=120406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 18 16:31:46.237217 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-97a51863-a131-4378-b4c4-d9a288451292 req-d11e08e0-8225-4bb6-bf87-fae189189ce8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052142 Oct 18 16:31:46.237859 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3504/7026] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:31:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:31:46.446731 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4f168a4f-ddad-4243-a70f-e0e6ea02b934 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:46.454633 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4f168a4f-ddad-4243-a70f-e0e6ea02b934 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a" status: 200 len: 1679 microversion: 2.1 time: 0.418195 Oct 18 16:31:46.455205 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3523/7027] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:46 2022] GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a => generated 1679 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:47.480499 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-04f4780d-05c0-4d67-aa52-6569d621408a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:47.481146 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-04f4780d-05c0-4d67-aa52-6569d621408a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 22669b74-487b-4438-9120-e14517852a0a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:47.487336 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04f4780d-05c0-4d67-aa52-6569d621408a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:47.487827 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04f4780d-05c0-4d67-aa52-6569d621408a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:47.488265 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04f4780d-05c0-4d67-aa52-6569d621408a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:47.489011 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04f4780d-05c0-4d67-aa52-6569d621408a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:47.489471 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04f4780d-05c0-4d67-aa52-6569d621408a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:47.489898 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04f4780d-05c0-4d67-aa52-6569d621408a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:47.622651 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-04f4780d-05c0-4d67-aa52-6569d621408a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:47.630760 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-04f4780d-05c0-4d67-aa52-6569d621408a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a" status: 200 len: 1679 microversion: 2.1 time: 0.155526 Oct 18 16:31:47.631347 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3505/7028] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:47 2022] GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:48.655228 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f96f879f-2269-40d6-baa3-84cc62ca7b1a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:48.656383 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f96f879f-2269-40d6-baa3-84cc62ca7b1a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 22669b74-487b-4438-9120-e14517852a0a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:48.663170 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f96f879f-2269-40d6-baa3-84cc62ca7b1a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:48.663671 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f96f879f-2269-40d6-baa3-84cc62ca7b1a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:48.664120 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f96f879f-2269-40d6-baa3-84cc62ca7b1a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:48.664842 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f96f879f-2269-40d6-baa3-84cc62ca7b1a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:48.665315 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f96f879f-2269-40d6-baa3-84cc62ca7b1a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:48.665755 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f96f879f-2269-40d6-baa3-84cc62ca7b1a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:48.797450 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f96f879f-2269-40d6-baa3-84cc62ca7b1a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:48.805087 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f96f879f-2269-40d6-baa3-84cc62ca7b1a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a" status: 200 len: 1675 microversion: 2.1 time: 0.153734 Oct 18 16:31:48.805638 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3524/7029] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:48 2022] GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:48.827766 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d11cfc09-df04-4eee-8f9e-c8ad096854a3 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:31:48.828800 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d11cfc09-df04-4eee-8f9e-c8ad096854a3 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 22669b74-487b-4438-9120-e14517852a0a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:48.835637 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d11cfc09-df04-4eee-8f9e-c8ad096854a3 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:48.836115 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d11cfc09-df04-4eee-8f9e-c8ad096854a3 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:48.836547 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d11cfc09-df04-4eee-8f9e-c8ad096854a3 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:48.837266 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d11cfc09-df04-4eee-8f9e-c8ad096854a3 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:48.837722 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d11cfc09-df04-4eee-8f9e-c8ad096854a3 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:48.838144 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d11cfc09-df04-4eee-8f9e-c8ad096854a3 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:48.897232 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d11cfc09-df04-4eee-8f9e-c8ad096854a3 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "POST /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a/action" status: 204 len: 0 microversion: 2.1 time: 0.073190 Oct 18 16:31:48.897872 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3506/7030] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:31:48 2022] POST /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:31:48.906374 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-62fa5a4b-4cfa-4ccd-8125-7cef46671e1b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:48.907063 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-62fa5a4b-4cfa-4ccd-8125-7cef46671e1b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 22669b74-487b-4438-9120-e14517852a0a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:48.913353 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-62fa5a4b-4cfa-4ccd-8125-7cef46671e1b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:48.913863 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-62fa5a4b-4cfa-4ccd-8125-7cef46671e1b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:48.914675 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-62fa5a4b-4cfa-4ccd-8125-7cef46671e1b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:48.915887 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-62fa5a4b-4cfa-4ccd-8125-7cef46671e1b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:48.916449 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-62fa5a4b-4cfa-4ccd-8125-7cef46671e1b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:48.917220 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-62fa5a4b-4cfa-4ccd-8125-7cef46671e1b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:49.053115 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-62fa5a4b-4cfa-4ccd-8125-7cef46671e1b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:49.061120 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-62fa5a4b-4cfa-4ccd-8125-7cef46671e1b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a" status: 200 len: 1675 microversion: 2.1 time: 0.158920 Oct 18 16:31:49.061693 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3525/7031] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:48 2022] GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:49.567125 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-f6bad631-12b8-44c5-ac5a-9138af5a2d50 req-9749148d-4ffa-4dd3-b0dc-b42262337672 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22669b74-487b-4438-9120-e14517852a0a", "name": "network-vif-plugged", "status": "completed", "tag": "66af0d3e-9ff1-4f4b-8b2b-c3d8e03ca9c2"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:31:49.577256 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f6bad631-12b8-44c5-ac5a-9138af5a2d50 req-9749148d-4ffa-4dd3-b0dc-b42262337672 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:49.578351 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f6bad631-12b8-44c5-ac5a-9138af5a2d50 req-9749148d-4ffa-4dd3-b0dc-b42262337672 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:49.578796 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f6bad631-12b8-44c5-ac5a-9138af5a2d50 req-9749148d-4ffa-4dd3-b0dc-b42262337672 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:49.591429 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-f6bad631-12b8-44c5-ac5a-9138af5a2d50 req-9749148d-4ffa-4dd3-b0dc-b42262337672 service nova] Creating event network-vif-plugged:66af0d3e-9ff1-4f4b-8b2b-c3d8e03ca9c2 for instance 22669b74-487b-4438-9120-e14517852a0a on n-h1-853682-5 Oct 18 16:31:49.596988 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [req-f6bad631-12b8-44c5-ac5a-9138af5a2d50 req-9749148d-4ffa-4dd3-b0dc-b42262337672 service nova] Instance 22669b74-487b-4438-9120-e14517852a0a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853682-5', 'n-h1-853682-5'} {{(pid=120406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 18 16:31:49.608968 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-f6bad631-12b8-44c5-ac5a-9138af5a2d50 req-9749148d-4ffa-4dd3-b0dc-b42262337672 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046556 Oct 18 16:31:49.609929 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3507/7032] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:31:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:31:50.083333 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9d9ea76b-dafc-47d1-84fd-961b89586acf tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:50.083957 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9d9ea76b-dafc-47d1-84fd-961b89586acf tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 22669b74-487b-4438-9120-e14517852a0a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:50.093898 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9d9ea76b-dafc-47d1-84fd-961b89586acf tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:50.094403 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9d9ea76b-dafc-47d1-84fd-961b89586acf tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:50.094842 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9d9ea76b-dafc-47d1-84fd-961b89586acf tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:50.095550 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9d9ea76b-dafc-47d1-84fd-961b89586acf tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:50.096017 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9d9ea76b-dafc-47d1-84fd-961b89586acf tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:50.096457 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9d9ea76b-dafc-47d1-84fd-961b89586acf tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:50.231601 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9d9ea76b-dafc-47d1-84fd-961b89586acf tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:50.239955 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9d9ea76b-dafc-47d1-84fd-961b89586acf tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a" status: 200 len: 1654 microversion: 2.1 time: 0.160512 Oct 18 16:31:50.240520 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3526/7033] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:50 2022] GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a => generated 1654 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:50.264465 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d2fceada-0649-43fa-828b-d52ff0649fa2 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:50.265256 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d2fceada-0649-43fa-828b-d52ff0649fa2 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 22669b74-487b-4438-9120-e14517852a0a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:50.271809 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2fceada-0649-43fa-828b-d52ff0649fa2 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:50.272291 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2fceada-0649-43fa-828b-d52ff0649fa2 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:50.272729 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2fceada-0649-43fa-828b-d52ff0649fa2 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:50.273448 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2fceada-0649-43fa-828b-d52ff0649fa2 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:50.273909 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2fceada-0649-43fa-828b-d52ff0649fa2 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:50.274337 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2fceada-0649-43fa-828b-d52ff0649fa2 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:50.409363 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d2fceada-0649-43fa-828b-d52ff0649fa2 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:50.417219 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d2fceada-0649-43fa-828b-d52ff0649fa2 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a" status: 200 len: 1654 microversion: 2.1 time: 0.157985 Oct 18 16:31:50.417795 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3508/7034] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:50 2022] GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a => generated 1654 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:50.440575 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1c7c2541-b670-4b94-b0de-54ebaed490fe tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:31:50.448730 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1c7c2541-b670-4b94-b0de-54ebaed490fe tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:50.449261 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1c7c2541-b670-4b94-b0de-54ebaed490fe tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:50.449722 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1c7c2541-b670-4b94-b0de-54ebaed490fe tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:50.472627 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1c7c2541-b670-4b94-b0de-54ebaed490fe tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 22669b74-487b-4438-9120-e14517852a0a] Going to try to start instance {{(pid=120405) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 18 16:31:50.514623 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1c7c2541-b670-4b94-b0de-54ebaed490fe tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "POST /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a/action" status: 202 len: 0 microversion: 2.1 time: 0.077698 Oct 18 16:31:50.515796 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3527/7035] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:31:50 2022] POST /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:31:50.524153 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ad38ba67-edac-4c1c-b8ff-4632a3622214 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:50.524898 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ad38ba67-edac-4c1c-b8ff-4632a3622214 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 22669b74-487b-4438-9120-e14517852a0a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:50.531656 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad38ba67-edac-4c1c-b8ff-4632a3622214 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:50.532219 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad38ba67-edac-4c1c-b8ff-4632a3622214 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:50.532659 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad38ba67-edac-4c1c-b8ff-4632a3622214 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:50.533396 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad38ba67-edac-4c1c-b8ff-4632a3622214 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:50.533856 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad38ba67-edac-4c1c-b8ff-4632a3622214 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:50.534284 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad38ba67-edac-4c1c-b8ff-4632a3622214 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:50.723604 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ad38ba67-edac-4c1c-b8ff-4632a3622214 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:50.725997 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:50.734330 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ad38ba67-edac-4c1c-b8ff-4632a3622214 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a" status: 200 len: 1663 microversion: 2.1 time: 0.214022 Oct 18 16:31:50.734920 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3509/7036] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:50 2022] GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a => generated 1663 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:51.759194 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d9cb82ca-7171-48c9-9f31-d15cd1592167 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:51.761057 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d9cb82ca-7171-48c9-9f31-d15cd1592167 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 22669b74-487b-4438-9120-e14517852a0a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:51.769598 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d9cb82ca-7171-48c9-9f31-d15cd1592167 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:51.770134 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d9cb82ca-7171-48c9-9f31-d15cd1592167 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:51.770590 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d9cb82ca-7171-48c9-9f31-d15cd1592167 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:51.771318 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d9cb82ca-7171-48c9-9f31-d15cd1592167 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:51.771789 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d9cb82ca-7171-48c9-9f31-d15cd1592167 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:51.772233 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d9cb82ca-7171-48c9-9f31-d15cd1592167 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:51.910027 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d9cb82ca-7171-48c9-9f31-d15cd1592167 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:51.913778 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:51.919403 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d9cb82ca-7171-48c9-9f31-d15cd1592167 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a" status: 200 len: 1667 microversion: 2.1 time: 0.164370 Oct 18 16:31:51.919981 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3528/7037] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:51 2022] GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a => generated 1667 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:51.943055 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7911bd0d-1e12-42a4-a6ed-8f6f70daed52 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:51.943614 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7911bd0d-1e12-42a4-a6ed-8f6f70daed52 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 22669b74-487b-4438-9120-e14517852a0a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:51.950776 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7911bd0d-1e12-42a4-a6ed-8f6f70daed52 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:51.951209 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7911bd0d-1e12-42a4-a6ed-8f6f70daed52 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:51.951648 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7911bd0d-1e12-42a4-a6ed-8f6f70daed52 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:51.952345 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7911bd0d-1e12-42a4-a6ed-8f6f70daed52 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:51.953342 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7911bd0d-1e12-42a4-a6ed-8f6f70daed52 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:51.953775 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7911bd0d-1e12-42a4-a6ed-8f6f70daed52 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:51.979745 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7911bd0d-1e12-42a4-a6ed-8f6f70daed52 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 22669b74-487b-4438-9120-e14517852a0a] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:31:52.055535 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7911bd0d-1e12-42a4-a6ed-8f6f70daed52 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "DELETE /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a" status: 204 len: 0 microversion: 2.1 time: 0.116810 Oct 18 16:31:52.056215 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3510/7038] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 16:31:51 2022] DELETE /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:31:52.065566 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-575d740a-aa78-440e-9be0-9592313128d9 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:52.066198 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-575d740a-aa78-440e-9be0-9592313128d9 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 22669b74-487b-4438-9120-e14517852a0a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:52.073436 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-575d740a-aa78-440e-9be0-9592313128d9 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:52.073929 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-575d740a-aa78-440e-9be0-9592313128d9 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:52.074373 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-575d740a-aa78-440e-9be0-9592313128d9 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:52.075077 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-575d740a-aa78-440e-9be0-9592313128d9 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:52.075542 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-575d740a-aa78-440e-9be0-9592313128d9 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:52.075977 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-575d740a-aa78-440e-9be0-9592313128d9 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:52.204441 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-575d740a-aa78-440e-9be0-9592313128d9 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:52.212260 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-575d740a-aa78-440e-9be0-9592313128d9 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a" status: 200 len: 1673 microversion: 2.1 time: 0.151679 Oct 18 16:31:52.212848 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3529/7039] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:52 2022] GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:53.237174 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9fd2784c-d585-4873-bdf0-55354bc1b805 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:53.237881 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9fd2784c-d585-4873-bdf0-55354bc1b805 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 22669b74-487b-4438-9120-e14517852a0a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:53.244751 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9fd2784c-d585-4873-bdf0-55354bc1b805 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:53.245263 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9fd2784c-d585-4873-bdf0-55354bc1b805 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:53.245698 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9fd2784c-d585-4873-bdf0-55354bc1b805 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:53.246387 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9fd2784c-d585-4873-bdf0-55354bc1b805 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:53.246841 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9fd2784c-d585-4873-bdf0-55354bc1b805 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:53.247263 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9fd2784c-d585-4873-bdf0-55354bc1b805 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:53.384425 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9fd2784c-d585-4873-bdf0-55354bc1b805 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:53.392163 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9fd2784c-d585-4873-bdf0-55354bc1b805 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a" status: 200 len: 1673 microversion: 2.1 time: 0.159922 Oct 18 16:31:53.392742 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3511/7040] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:53 2022] GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:54.416106 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-dd35619c-542a-4ab3-b6c8-fae4d3a9dbe8 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:54.416862 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-dd35619c-542a-4ab3-b6c8-fae4d3a9dbe8 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 22669b74-487b-4438-9120-e14517852a0a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:54.424186 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dd35619c-542a-4ab3-b6c8-fae4d3a9dbe8 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:54.424695 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dd35619c-542a-4ab3-b6c8-fae4d3a9dbe8 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:54.425190 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dd35619c-542a-4ab3-b6c8-fae4d3a9dbe8 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:54.426079 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dd35619c-542a-4ab3-b6c8-fae4d3a9dbe8 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:54.428074 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dd35619c-542a-4ab3-b6c8-fae4d3a9dbe8 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:54.428074 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dd35619c-542a-4ab3-b6c8-fae4d3a9dbe8 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:54.521886 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-dd35619c-542a-4ab3-b6c8-fae4d3a9dbe8 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:54.533484 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-dd35619c-542a-4ab3-b6c8-fae4d3a9dbe8 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a" status: 200 len: 1606 microversion: 2.1 time: 0.121681 Oct 18 16:31:54.534172 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3530/7041] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:54 2022] GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a => generated 1606 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:54.600171 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-2c11354f-1855-4752-be68-21da9c675753 req-9c7ac885-e55e-47aa-9be4-4feafb56a714 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22669b74-487b-4438-9120-e14517852a0a", "name": "network-vif-deleted", "tag": "66af0d3e-9ff1-4f4b-8b2b-c3d8e03ca9c2"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:31:54.613253 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2c11354f-1855-4752-be68-21da9c675753 req-9c7ac885-e55e-47aa-9be4-4feafb56a714 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:54.613662 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2c11354f-1855-4752-be68-21da9c675753 req-9c7ac885-e55e-47aa-9be4-4feafb56a714 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:54.614095 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2c11354f-1855-4752-be68-21da9c675753 req-9c7ac885-e55e-47aa-9be4-4feafb56a714 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:54.626784 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-2c11354f-1855-4752-be68-21da9c675753 req-9c7ac885-e55e-47aa-9be4-4feafb56a714 service nova] Creating event network-vif-deleted:66af0d3e-9ff1-4f4b-8b2b-c3d8e03ca9c2 for instance 22669b74-487b-4438-9120-e14517852a0a on n-h1-853682-5 Oct 18 16:31:54.633041 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-2c11354f-1855-4752-be68-21da9c675753 req-9c7ac885-e55e-47aa-9be4-4feafb56a714 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036852 Oct 18 16:31:54.633664 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3512/7042] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:31:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:31:55.557918 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b00dc8ff-6281-482d-a96b-2b120c45cb6a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:55.558566 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b00dc8ff-6281-482d-a96b-2b120c45cb6a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 22669b74-487b-4438-9120-e14517852a0a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:55.565546 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b00dc8ff-6281-482d-a96b-2b120c45cb6a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:55.566041 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b00dc8ff-6281-482d-a96b-2b120c45cb6a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:55.566496 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b00dc8ff-6281-482d-a96b-2b120c45cb6a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:55.567219 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b00dc8ff-6281-482d-a96b-2b120c45cb6a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:55.567697 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b00dc8ff-6281-482d-a96b-2b120c45cb6a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:55.568145 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b00dc8ff-6281-482d-a96b-2b120c45cb6a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:55.582503 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-b00dc8ff-6281-482d-a96b-2b120c45cb6a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] HTTP exception thrown: Instance 22669b74-487b-4438-9120-e14517852a0a could not be found. Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b00dc8ff-6281-482d-a96b-2b120c45cb6a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Request method failure captured: Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a HTTP/1.1 Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTtRtIaUCN9plKHAU4sMF0eKPWeSPc3LcSTEAsfYHO6Ia-co9ZPn6puaeremyzCJ1TQjfFH64XFDE8JVb1F9uH606Ok8WhdDHKOcmm8H7JUvsjzsW5arFpGz6CXjDjVzRoJq_6-HaJ4kSxSPzbYSgopkwKzlavAYaW8OixT5z-2qDJfM Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: f872c1ec84314318ac67bfbe7d186b2c Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServerActionsTestJSON-1692549662 Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServerActionsTestJSON-1692549662 Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: f872c1ec84314318ac67bfbe7d186b2c Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServerActionsTestJSON-1692549662 Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServerActionsTestJSON-1692549662-project Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 92c26a3ccef246d6bb58d7d834f71106 Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServerActionsTestJSON-1692549662-project Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 22669b74-487b-4438-9120-e14517852a0a could not be found. Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '22669b74-487b-4438-9120-e14517852a0a'} Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22669b74-487b-4438-9120-e14517852a0a could not be found. Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22669b74-487b-4438-9120-e14517852a0a could not be found. Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:31:55.584212 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:31:55.589208 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:55.589208 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:31:55.589208 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:31:55.589208 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:31:55.589208 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:31:55.589208 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22669b74-487b-4438-9120-e14517852a0a could not be found. Oct 18 16:31:55.589208 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:31:55.589208 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b00dc8ff-6281-482d-a96b-2b120c45cb6a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Returning 404 to user: Instance 22669b74-487b-4438-9120-e14517852a0a could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:31:55.589208 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b00dc8ff-6281-482d-a96b-2b120c45cb6a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a" status: 404 len: 111 microversion: 2.1 time: 0.031984 Oct 18 16:31:55.589208 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3531/7043] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:55 2022] GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:31:55.600165 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-80d7642a-2b08-403f-9d53-aef1500cace0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:55.601070 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-80d7642a-2b08-403f-9d53-aef1500cace0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 22669b74-487b-4438-9120-e14517852a0a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:55.607412 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80d7642a-2b08-403f-9d53-aef1500cace0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:55.608023 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80d7642a-2b08-403f-9d53-aef1500cace0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:55.608495 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80d7642a-2b08-403f-9d53-aef1500cace0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:55.609233 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80d7642a-2b08-403f-9d53-aef1500cace0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:55.609695 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80d7642a-2b08-403f-9d53-aef1500cace0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:55.610173 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80d7642a-2b08-403f-9d53-aef1500cace0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:55.627331 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-80d7642a-2b08-403f-9d53-aef1500cace0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] HTTP exception thrown: Instance 22669b74-487b-4438-9120-e14517852a0a could not be found. Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-80d7642a-2b08-403f-9d53-aef1500cace0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Request method failure captured: Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a HTTP/1.1 Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTtRtIaUCN9plKHAU4sMF0eKPWeSPc3LcSTEAsfYHO6Ia-co9ZPn6puaeremyzCJ1TQjfFH64XFDE8JVb1F9uH606Ok8WhdDHKOcmm8H7JUvsjzsW5arFpGz6CXjDjVzRoJq_6-HaJ4kSxSPzbYSgopkwKzlavAYaW8OixT5z-2qDJfM Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: f872c1ec84314318ac67bfbe7d186b2c Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerActionsTestJSON-1692549662 Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServerActionsTestJSON-1692549662 Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: f872c1ec84314318ac67bfbe7d186b2c Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerActionsTestJSON-1692549662 Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServerActionsTestJSON-1692549662-project Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 92c26a3ccef246d6bb58d7d834f71106 Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServerActionsTestJSON-1692549662-project Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 22669b74-487b-4438-9120-e14517852a0a could not be found. Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '22669b74-487b-4438-9120-e14517852a0a'} Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22669b74-487b-4438-9120-e14517852a0a could not be found. Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22669b74-487b-4438-9120-e14517852a0a could not be found. Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:31:55.629028 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:31:55.633416 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:31:55.633416 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:31:55.633416 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:31:55.633416 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:31:55.633416 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:31:55.633416 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22669b74-487b-4438-9120-e14517852a0a could not be found. Oct 18 16:31:55.633416 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:31:55.633416 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-80d7642a-2b08-403f-9d53-aef1500cace0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Returning 404 to user: Instance 22669b74-487b-4438-9120-e14517852a0a could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:31:55.633416 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-80d7642a-2b08-403f-9d53-aef1500cace0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a" status: 404 len: 111 microversion: 2.1 time: 0.034494 Oct 18 16:31:55.633416 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3513/7044] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:55 2022] GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:31:55.681906 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-09e83730-d456-4a2b-85fa-c7fdeac19b48 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1266238070", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "cdf0b0ca-963c-402a-919d-35be60437c6f"}], "security_groups": [{"name": "tempest-securitygroup--582261342"}], "key_name": "tempest-keypair-85721457", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:31:55.795312 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-09e83730-d456-4a2b-85fa-c7fdeac19b48 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] validate_networks() for [('cdf0b0ca-963c-402a-919d-35be60437c6f', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 16:31:56.215090 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-09e83730-d456-4a2b-85fa-c7fdeac19b48 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:31:56.215527 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-09e83730-d456-4a2b-85fa-c7fdeac19b48 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:31:56.216012 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-09e83730-d456-4a2b-85fa-c7fdeac19b48 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:31:56.216436 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-09e83730-d456-4a2b-85fa-c7fdeac19b48 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:31:56.216877 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-09e83730-d456-4a2b-85fa-c7fdeac19b48 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:31:56.225623 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09e83730-d456-4a2b-85fa-c7fdeac19b48 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:56.226113 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09e83730-d456-4a2b-85fa-c7fdeac19b48 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:56.226560 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09e83730-d456-4a2b-85fa-c7fdeac19b48 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:56.227289 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09e83730-d456-4a2b-85fa-c7fdeac19b48 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:56.227754 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09e83730-d456-4a2b-85fa-c7fdeac19b48 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:56.228191 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09e83730-d456-4a2b-85fa-c7fdeac19b48 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:56.244491 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-09e83730-d456-4a2b-85fa-c7fdeac19b48 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Getting quotas for project f872c1ec84314318ac67bfbe7d186b2c. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:31:56.250222 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-09e83730-d456-4a2b-85fa-c7fdeac19b48 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Getting quotas for user 92c26a3ccef246d6bb58d7d834f71106 and project f872c1ec84314318ac67bfbe7d186b2c. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:31:56.262430 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-09e83730-d456-4a2b-85fa-c7fdeac19b48 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:31:56.264731 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-09e83730-d456-4a2b-85fa-c7fdeac19b48 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fd720b3b-c65b-4eb2-8cf5-6fea43469fff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:31:56.312651 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-09e83730-d456-4a2b-85fa-c7fdeac19b48 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.634170 Oct 18 16:31:56.313248 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3532/7045] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 16:31:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:31:56.324378 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-77d1d9a5-0092-4bdf-935e-ce80d291e3fb tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:56.325030 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-77d1d9a5-0092-4bdf-935e-ce80d291e3fb tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fd720b3b-c65b-4eb2-8cf5-6fea43469fff] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:56.384963 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-77d1d9a5-0092-4bdf-935e-ce80d291e3fb tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:56.392463 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-77d1d9a5-0092-4bdf-935e-ce80d291e3fb tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff" status: 200 len: 1237 microversion: 2.1 time: 0.071939 Oct 18 16:31:56.393069 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3514/7046] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:56 2022] GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff => generated 1237 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:57.416679 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1954f67e-6fba-4892-bd28-5465f7020e7b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:57.418165 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1954f67e-6fba-4892-bd28-5465f7020e7b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fd720b3b-c65b-4eb2-8cf5-6fea43469fff] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:57.426060 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1954f67e-6fba-4892-bd28-5465f7020e7b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:57.426762 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1954f67e-6fba-4892-bd28-5465f7020e7b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:57.427483 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1954f67e-6fba-4892-bd28-5465f7020e7b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:57.428533 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1954f67e-6fba-4892-bd28-5465f7020e7b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:57.429270 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1954f67e-6fba-4892-bd28-5465f7020e7b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:57.429990 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1954f67e-6fba-4892-bd28-5465f7020e7b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:57.506243 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1954f67e-6fba-4892-bd28-5465f7020e7b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:57.514569 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1954f67e-6fba-4892-bd28-5465f7020e7b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff" status: 200 len: 1307 microversion: 2.1 time: 0.102379 Oct 18 16:31:57.515700 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3533/7047] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:57 2022] GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff => generated 1307 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:58.545122 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dd7c5454-023f-4458-957f-cfea0e868ebc tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:58.547321 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dd7c5454-023f-4458-957f-cfea0e868ebc tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fd720b3b-c65b-4eb2-8cf5-6fea43469fff] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:58.554339 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd7c5454-023f-4458-957f-cfea0e868ebc tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:58.554836 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd7c5454-023f-4458-957f-cfea0e868ebc tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:58.555280 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd7c5454-023f-4458-957f-cfea0e868ebc tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:58.556011 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd7c5454-023f-4458-957f-cfea0e868ebc tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:58.556449 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd7c5454-023f-4458-957f-cfea0e868ebc tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:58.556906 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd7c5454-023f-4458-957f-cfea0e868ebc tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:58.698062 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dd7c5454-023f-4458-957f-cfea0e868ebc tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:58.709010 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dd7c5454-023f-4458-957f-cfea0e868ebc tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff" status: 200 len: 1362 microversion: 2.1 time: 0.172185 Oct 18 16:31:58.709612 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3515/7048] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:58 2022] GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:31:58.756050 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-0d1700a3-101f-41dd-b94b-493310beff7f req-c878f1e8-a807-43d6-86e7-160eb12ee40a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd720b3b-c65b-4eb2-8cf5-6fea43469fff", "tag": "8addf6f2-27a0-4657-b6f8-004b22e2aeab"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:31:58.771941 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-0d1700a3-101f-41dd-b94b-493310beff7f req-c878f1e8-a807-43d6-86e7-160eb12ee40a service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:58.772437 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-0d1700a3-101f-41dd-b94b-493310beff7f req-c878f1e8-a807-43d6-86e7-160eb12ee40a service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:58.772906 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-0d1700a3-101f-41dd-b94b-493310beff7f req-c878f1e8-a807-43d6-86e7-160eb12ee40a service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:58.786406 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-0d1700a3-101f-41dd-b94b-493310beff7f req-c878f1e8-a807-43d6-86e7-160eb12ee40a service nova] Creating event network-changed:8addf6f2-27a0-4657-b6f8-004b22e2aeab for instance fd720b3b-c65b-4eb2-8cf5-6fea43469fff on n-h2-853682-5 Oct 18 16:31:58.792062 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-0d1700a3-101f-41dd-b94b-493310beff7f req-c878f1e8-a807-43d6-86e7-160eb12ee40a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039805 Oct 18 16:31:58.792889 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3534/7049] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:31:59.732625 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fbeb1330-edbc-431d-8a44-a6c9b7ff7f99 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:31:59.733273 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fbeb1330-edbc-431d-8a44-a6c9b7ff7f99 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fd720b3b-c65b-4eb2-8cf5-6fea43469fff] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:31:59.736597 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:59.741998 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbeb1330-edbc-431d-8a44-a6c9b7ff7f99 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:59.742483 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbeb1330-edbc-431d-8a44-a6c9b7ff7f99 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:59.742921 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbeb1330-edbc-431d-8a44-a6c9b7ff7f99 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:59.743650 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbeb1330-edbc-431d-8a44-a6c9b7ff7f99 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:31:59.744107 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbeb1330-edbc-431d-8a44-a6c9b7ff7f99 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:31:59.744533 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbeb1330-edbc-431d-8a44-a6c9b7ff7f99 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:31:59.875883 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fbeb1330-edbc-431d-8a44-a6c9b7ff7f99 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:31:59.883662 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fbeb1330-edbc-431d-8a44-a6c9b7ff7f99 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff" status: 200 len: 1362 microversion: 2.1 time: 0.154968 Oct 18 16:31:59.884241 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3516/7050] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:59 2022] GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:32:00.908378 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7bce07da-c2f2-4516-9a05-7bd7a39a45d1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:00.909141 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7bce07da-c2f2-4516-9a05-7bd7a39a45d1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fd720b3b-c65b-4eb2-8cf5-6fea43469fff] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:00.911129 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:00.916677 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7bce07da-c2f2-4516-9a05-7bd7a39a45d1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:00.917207 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7bce07da-c2f2-4516-9a05-7bd7a39a45d1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:00.917693 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7bce07da-c2f2-4516-9a05-7bd7a39a45d1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:00.918412 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7bce07da-c2f2-4516-9a05-7bd7a39a45d1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:00.918889 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7bce07da-c2f2-4516-9a05-7bd7a39a45d1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:00.919592 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7bce07da-c2f2-4516-9a05-7bd7a39a45d1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:01.049952 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7bce07da-c2f2-4516-9a05-7bd7a39a45d1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:32:01.057700 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7bce07da-c2f2-4516-9a05-7bd7a39a45d1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff" status: 200 len: 1362 microversion: 2.1 time: 0.154480 Oct 18 16:32:01.058275 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3535/7051] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:32:00 2022] GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:32:02.082118 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0f69827c-2062-46a0-aa9d-4e427f01d6c5 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:02.082738 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0f69827c-2062-46a0-aa9d-4e427f01d6c5 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fd720b3b-c65b-4eb2-8cf5-6fea43469fff] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:02.089731 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f69827c-2062-46a0-aa9d-4e427f01d6c5 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:02.090222 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f69827c-2062-46a0-aa9d-4e427f01d6c5 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:02.090654 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f69827c-2062-46a0-aa9d-4e427f01d6c5 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:02.091349 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f69827c-2062-46a0-aa9d-4e427f01d6c5 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:02.091805 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f69827c-2062-46a0-aa9d-4e427f01d6c5 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:02.092231 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f69827c-2062-46a0-aa9d-4e427f01d6c5 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:02.224527 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0f69827c-2062-46a0-aa9d-4e427f01d6c5 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:32:02.232569 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0f69827c-2062-46a0-aa9d-4e427f01d6c5 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff" status: 200 len: 1362 microversion: 2.1 time: 0.154939 Oct 18 16:32:02.233187 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3517/7052] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:32:02 2022] GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:32:03.256214 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6d4af168-cb06-4c7b-a944-1ab75384cd5c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:03.257013 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6d4af168-cb06-4c7b-a944-1ab75384cd5c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fd720b3b-c65b-4eb2-8cf5-6fea43469fff] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:03.263819 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6d4af168-cb06-4c7b-a944-1ab75384cd5c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:03.264323 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6d4af168-cb06-4c7b-a944-1ab75384cd5c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:03.265287 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6d4af168-cb06-4c7b-a944-1ab75384cd5c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:03.266014 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6d4af168-cb06-4c7b-a944-1ab75384cd5c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:03.266495 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6d4af168-cb06-4c7b-a944-1ab75384cd5c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:03.266943 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6d4af168-cb06-4c7b-a944-1ab75384cd5c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:03.386611 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-1dd5a9e3-bc83-4089-808c-4b11dc702896 req-e9b2c434-c8b7-4085-badf-8274c0c2bd85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd720b3b-c65b-4eb2-8cf5-6fea43469fff", "name": "network-vif-plugged", "status": "completed", "tag": "8addf6f2-27a0-4657-b6f8-004b22e2aeab"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:32:03.398119 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1dd5a9e3-bc83-4089-808c-4b11dc702896 req-e9b2c434-c8b7-4085-badf-8274c0c2bd85 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:03.398841 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1dd5a9e3-bc83-4089-808c-4b11dc702896 req-e9b2c434-c8b7-4085-badf-8274c0c2bd85 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:03.399403 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1dd5a9e3-bc83-4089-808c-4b11dc702896 req-e9b2c434-c8b7-4085-badf-8274c0c2bd85 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:03.406260 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6d4af168-cb06-4c7b-a944-1ab75384cd5c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:32:03.413742 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-1dd5a9e3-bc83-4089-808c-4b11dc702896 req-e9b2c434-c8b7-4085-badf-8274c0c2bd85 service nova] Creating event network-vif-plugged:8addf6f2-27a0-4657-b6f8-004b22e2aeab for instance fd720b3b-c65b-4eb2-8cf5-6fea43469fff on n-h2-853682-5 Oct 18 16:32:03.414623 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6d4af168-cb06-4c7b-a944-1ab75384cd5c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff" status: 200 len: 1362 microversion: 2.1 time: 0.162343 Oct 18 16:32:03.419349 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-1dd5a9e3-bc83-4089-808c-4b11dc702896 req-e9b2c434-c8b7-4085-badf-8274c0c2bd85 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036131 Oct 18 16:32:03.420142 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3518/7053] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:32:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:32:03.429717 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3536/7054] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:32:03 2022] GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:32:04.440835 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2a9cf58f-f6c7-4fce-ab83-86394897f753 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:04.441553 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2a9cf58f-f6c7-4fce-ab83-86394897f753 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fd720b3b-c65b-4eb2-8cf5-6fea43469fff] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:04.447757 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a9cf58f-f6c7-4fce-ab83-86394897f753 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:04.448239 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a9cf58f-f6c7-4fce-ab83-86394897f753 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:04.448673 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a9cf58f-f6c7-4fce-ab83-86394897f753 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:04.449400 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a9cf58f-f6c7-4fce-ab83-86394897f753 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:04.449855 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a9cf58f-f6c7-4fce-ab83-86394897f753 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:04.450283 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a9cf58f-f6c7-4fce-ab83-86394897f753 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:04.596177 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2a9cf58f-f6c7-4fce-ab83-86394897f753 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:32:04.604016 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2a9cf58f-f6c7-4fce-ab83-86394897f753 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff" status: 200 len: 1362 microversion: 2.1 time: 0.168513 Oct 18 16:32:04.604596 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3519/7055] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:32:04 2022] GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:32:05.628781 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ea0cd41b-3dc2-49e6-9dd1-f1c993093323 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:05.629389 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ea0cd41b-3dc2-49e6-9dd1-f1c993093323 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fd720b3b-c65b-4eb2-8cf5-6fea43469fff] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:05.636224 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea0cd41b-3dc2-49e6-9dd1-f1c993093323 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:05.636732 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea0cd41b-3dc2-49e6-9dd1-f1c993093323 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:05.637222 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea0cd41b-3dc2-49e6-9dd1-f1c993093323 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:05.637939 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea0cd41b-3dc2-49e6-9dd1-f1c993093323 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:05.638414 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea0cd41b-3dc2-49e6-9dd1-f1c993093323 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:05.638860 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea0cd41b-3dc2-49e6-9dd1-f1c993093323 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:05.770039 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ea0cd41b-3dc2-49e6-9dd1-f1c993093323 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:32:05.777792 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ea0cd41b-3dc2-49e6-9dd1-f1c993093323 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff" status: 200 len: 1549 microversion: 2.1 time: 0.153675 Oct 18 16:32:05.778446 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3537/7056] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:32:05 2022] GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:32:05.801720 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-82600fa7-1ea2-45bc-8335-c607f3d553b6 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:05.802262 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-82600fa7-1ea2-45bc-8335-c607f3d553b6 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fd720b3b-c65b-4eb2-8cf5-6fea43469fff] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:05.809087 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82600fa7-1ea2-45bc-8335-c607f3d553b6 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:05.809568 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82600fa7-1ea2-45bc-8335-c607f3d553b6 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:05.810005 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82600fa7-1ea2-45bc-8335-c607f3d553b6 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:05.810693 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82600fa7-1ea2-45bc-8335-c607f3d553b6 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:05.811177 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82600fa7-1ea2-45bc-8335-c607f3d553b6 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:05.811603 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82600fa7-1ea2-45bc-8335-c607f3d553b6 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:05.887632 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-82600fa7-1ea2-45bc-8335-c607f3d553b6 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089828 Oct 18 16:32:05.888268 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3520/7057] 10.222.0.60 () {58 vars in 1275 bytes} [Tue Oct 18 16:32:05 2022] GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:32:06.832598 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-4b09f580-40d9-4dfb-bb33-dee47a2c49af req-96eeb886-5994-4027-a617-68c3c214e48a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd720b3b-c65b-4eb2-8cf5-6fea43469fff", "tag": "8addf6f2-27a0-4657-b6f8-004b22e2aeab"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:32:06.837521 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:06.838225 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=6 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:06.845755 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-4b09f580-40d9-4dfb-bb33-dee47a2c49af req-96eeb886-5994-4027-a617-68c3c214e48a service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:06.846326 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-4b09f580-40d9-4dfb-bb33-dee47a2c49af req-96eeb886-5994-4027-a617-68c3c214e48a service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:06.846788 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-4b09f580-40d9-4dfb-bb33-dee47a2c49af req-96eeb886-5994-4027-a617-68c3c214e48a service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:06.858225 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-4b09f580-40d9-4dfb-bb33-dee47a2c49af req-96eeb886-5994-4027-a617-68c3c214e48a service nova] Creating event network-changed:8addf6f2-27a0-4657-b6f8-004b22e2aeab for instance fd720b3b-c65b-4eb2-8cf5-6fea43469fff on n-h2-853682-5 Oct 18 16:32:06.863656 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-4b09f580-40d9-4dfb-bb33-dee47a2c49af req-96eeb886-5994-4027-a617-68c3c214e48a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034829 Oct 18 16:32:06.864248 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3538/7058] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:32:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:32:39.784480 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:39.786783 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=9 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:39.787416 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:39.788667 n-d-853682-5 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 16:32:39.788830 n-d-853682-5 devstack@n-api.service[120406]: Tue Oct 18 16:32:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff/action (ip 10.222.0.60) !!! Oct 18 16:32:39.794257 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1cf5bdb8-0282-4da3-a586-d73066561946 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:32:39.796495 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1cf5bdb8-0282-4da3-a586-d73066561946 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fd720b3b-c65b-4eb2-8cf5-6fea43469fff] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:39.806609 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1cf5bdb8-0282-4da3-a586-d73066561946 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:39.807095 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1cf5bdb8-0282-4da3-a586-d73066561946 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:39.807534 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1cf5bdb8-0282-4da3-a586-d73066561946 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:39.808234 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1cf5bdb8-0282-4da3-a586-d73066561946 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:39.808692 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1cf5bdb8-0282-4da3-a586-d73066561946 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:39.809151 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1cf5bdb8-0282-4da3-a586-d73066561946 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:39.842034 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1cf5bdb8-0282-4da3-a586-d73066561946 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:32:39.848106 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1cf5bdb8-0282-4da3-a586-d73066561946 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fd720b3b-c65b-4eb2-8cf5-6fea43469fff] Old instance type m1.heat2, new instance type m1.heat {{(pid=120406) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 18 16:32:39.854653 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-1cf5bdb8-0282-4da3-a586-d73066561946 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:32:39.855078 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-1cf5bdb8-0282-4da3-a586-d73066561946 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:32:39.855550 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-1cf5bdb8-0282-4da3-a586-d73066561946 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:32:39.855963 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-1cf5bdb8-0282-4da3-a586-d73066561946 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:32:39.856375 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-1cf5bdb8-0282-4da3-a586-d73066561946 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:32:39.920032 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1cf5bdb8-0282-4da3-a586-d73066561946 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "POST /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff/action" status: 202 len: 0 microversion: 2.1 time: 0.136279 Oct 18 16:32:39.920731 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3521/7059] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:32:39 2022] POST /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:32:39.927198 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=7 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:39.928064 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=44 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:39.929271 n-d-853682-5 devstack@n-api.service[120405]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 16:32:39.929417 n-d-853682-5 devstack@n-api.service[120405]: Tue Oct 18 16:32:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff (ip 10.222.0.60) !!! Oct 18 16:32:39.934817 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c7340bb1-30d3-49ee-833e-c3ec4439a24c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:39.935540 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c7340bb1-30d3-49ee-833e-c3ec4439a24c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fd720b3b-c65b-4eb2-8cf5-6fea43469fff] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:39.945220 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c7340bb1-30d3-49ee-833e-c3ec4439a24c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:39.945675 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c7340bb1-30d3-49ee-833e-c3ec4439a24c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:39.946205 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c7340bb1-30d3-49ee-833e-c3ec4439a24c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:39.947035 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c7340bb1-30d3-49ee-833e-c3ec4439a24c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:39.947588 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c7340bb1-30d3-49ee-833e-c3ec4439a24c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:39.948037 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c7340bb1-30d3-49ee-833e-c3ec4439a24c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:40.368414 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c7340bb1-30d3-49ee-833e-c3ec4439a24c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:32:40.376651 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c7340bb1-30d3-49ee-833e-c3ec4439a24c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff" status: 200 len: 1677 microversion: 2.1 time: 0.451446 Oct 18 16:32:40.377274 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3539/7060] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:32:39 2022] GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff => generated 1677 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:32:41.401456 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3abafd75-b039-4e5b-b781-879d41e1d2ab tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:41.402076 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3abafd75-b039-4e5b-b781-879d41e1d2ab tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fd720b3b-c65b-4eb2-8cf5-6fea43469fff] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:41.408665 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3abafd75-b039-4e5b-b781-879d41e1d2ab tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:41.409179 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3abafd75-b039-4e5b-b781-879d41e1d2ab tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:41.409628 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3abafd75-b039-4e5b-b781-879d41e1d2ab tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:41.410314 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3abafd75-b039-4e5b-b781-879d41e1d2ab tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:41.410769 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3abafd75-b039-4e5b-b781-879d41e1d2ab tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:41.411199 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3abafd75-b039-4e5b-b781-879d41e1d2ab tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:41.539009 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3abafd75-b039-4e5b-b781-879d41e1d2ab tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:32:41.547096 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3abafd75-b039-4e5b-b781-879d41e1d2ab tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff" status: 200 len: 1677 microversion: 2.1 time: 0.150415 Oct 18 16:32:41.547681 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3522/7061] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:32:41 2022] GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:32:42.570968 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-cdeba612-73db-425e-a2ff-afb507c74cd5 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:42.571593 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-cdeba612-73db-425e-a2ff-afb507c74cd5 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fd720b3b-c65b-4eb2-8cf5-6fea43469fff] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:42.578923 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cdeba612-73db-425e-a2ff-afb507c74cd5 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:42.579417 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cdeba612-73db-425e-a2ff-afb507c74cd5 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:42.579861 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cdeba612-73db-425e-a2ff-afb507c74cd5 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:42.580930 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cdeba612-73db-425e-a2ff-afb507c74cd5 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:42.581457 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cdeba612-73db-425e-a2ff-afb507c74cd5 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:42.581894 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cdeba612-73db-425e-a2ff-afb507c74cd5 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:42.713108 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-cdeba612-73db-425e-a2ff-afb507c74cd5 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:32:42.721571 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-cdeba612-73db-425e-a2ff-afb507c74cd5 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff" status: 200 len: 1682 microversion: 2.1 time: 0.154526 Oct 18 16:32:42.722140 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3540/7062] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:32:42 2022] GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:32:43.744096 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2a8541fb-2638-4abe-969e-0bc06b65b237 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:43.744718 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2a8541fb-2638-4abe-969e-0bc06b65b237 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fd720b3b-c65b-4eb2-8cf5-6fea43469fff] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:43.751621 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a8541fb-2638-4abe-969e-0bc06b65b237 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:43.752103 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a8541fb-2638-4abe-969e-0bc06b65b237 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:43.752541 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a8541fb-2638-4abe-969e-0bc06b65b237 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:43.753274 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a8541fb-2638-4abe-969e-0bc06b65b237 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:43.753732 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a8541fb-2638-4abe-969e-0bc06b65b237 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:43.754156 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a8541fb-2638-4abe-969e-0bc06b65b237 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:43.882059 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2a8541fb-2638-4abe-969e-0bc06b65b237 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:32:43.889753 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2a8541fb-2638-4abe-969e-0bc06b65b237 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff" status: 200 len: 1682 microversion: 2.1 time: 0.149551 Oct 18 16:32:43.890370 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3523/7063] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:32:43 2022] GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:32:44.914460 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1460c417-90d3-4302-ba01-1d69cf0e403b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:44.915124 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1460c417-90d3-4302-ba01-1d69cf0e403b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fd720b3b-c65b-4eb2-8cf5-6fea43469fff] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:44.923154 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1460c417-90d3-4302-ba01-1d69cf0e403b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:44.923661 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1460c417-90d3-4302-ba01-1d69cf0e403b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:44.924119 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1460c417-90d3-4302-ba01-1d69cf0e403b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:44.924904 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1460c417-90d3-4302-ba01-1d69cf0e403b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:44.925406 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1460c417-90d3-4302-ba01-1d69cf0e403b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:44.925854 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1460c417-90d3-4302-ba01-1d69cf0e403b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:45.058358 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1460c417-90d3-4302-ba01-1d69cf0e403b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:32:45.066678 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1460c417-90d3-4302-ba01-1d69cf0e403b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff" status: 200 len: 1682 microversion: 2.1 time: 0.156216 Oct 18 16:32:45.067242 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3541/7064] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:32:44 2022] GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:32:46.090021 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cad54f81-77d2-43c2-80bb-2d687f5fda31 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:46.090667 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cad54f81-77d2-43c2-80bb-2d687f5fda31 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fd720b3b-c65b-4eb2-8cf5-6fea43469fff] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:46.097520 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cad54f81-77d2-43c2-80bb-2d687f5fda31 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:46.098002 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cad54f81-77d2-43c2-80bb-2d687f5fda31 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:46.098440 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cad54f81-77d2-43c2-80bb-2d687f5fda31 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:46.099130 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cad54f81-77d2-43c2-80bb-2d687f5fda31 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:46.099587 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cad54f81-77d2-43c2-80bb-2d687f5fda31 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:46.100013 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cad54f81-77d2-43c2-80bb-2d687f5fda31 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:46.228162 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cad54f81-77d2-43c2-80bb-2d687f5fda31 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:32:46.235902 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cad54f81-77d2-43c2-80bb-2d687f5fda31 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff" status: 200 len: 1682 microversion: 2.1 time: 0.149813 Oct 18 16:32:46.236488 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3524/7065] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:32:46 2022] GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:32:47.259697 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e4f4de44-f17b-4366-b963-cdb767a31bd5 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:47.260328 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e4f4de44-f17b-4366-b963-cdb767a31bd5 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fd720b3b-c65b-4eb2-8cf5-6fea43469fff] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:47.267393 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4f4de44-f17b-4366-b963-cdb767a31bd5 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:47.267892 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4f4de44-f17b-4366-b963-cdb767a31bd5 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:47.268341 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4f4de44-f17b-4366-b963-cdb767a31bd5 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:47.269154 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4f4de44-f17b-4366-b963-cdb767a31bd5 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:47.269624 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4f4de44-f17b-4366-b963-cdb767a31bd5 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:47.270068 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e4f4de44-f17b-4366-b963-cdb767a31bd5 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:47.408905 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e4f4de44-f17b-4366-b963-cdb767a31bd5 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:32:47.416631 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e4f4de44-f17b-4366-b963-cdb767a31bd5 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff" status: 200 len: 1682 microversion: 2.1 time: 0.160931 Oct 18 16:32:47.417248 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3542/7066] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:32:47 2022] GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:32:48.440973 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-054eceef-e4fb-4d02-ad8c-bf00ae1e4c33 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:48.441645 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-054eceef-e4fb-4d02-ad8c-bf00ae1e4c33 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fd720b3b-c65b-4eb2-8cf5-6fea43469fff] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:48.448427 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-054eceef-e4fb-4d02-ad8c-bf00ae1e4c33 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:48.448942 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-054eceef-e4fb-4d02-ad8c-bf00ae1e4c33 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:48.449374 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-054eceef-e4fb-4d02-ad8c-bf00ae1e4c33 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:48.450059 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-054eceef-e4fb-4d02-ad8c-bf00ae1e4c33 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:48.450511 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-054eceef-e4fb-4d02-ad8c-bf00ae1e4c33 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:48.450931 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-054eceef-e4fb-4d02-ad8c-bf00ae1e4c33 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:48.580707 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-054eceef-e4fb-4d02-ad8c-bf00ae1e4c33 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:32:48.588537 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-054eceef-e4fb-4d02-ad8c-bf00ae1e4c33 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff" status: 200 len: 1682 microversion: 2.1 time: 0.151448 Oct 18 16:32:48.589146 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3525/7067] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:32:48 2022] GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:32:49.612449 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6fa7447e-a25c-4b19-90d3-ad5705b55649 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:49.613018 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6fa7447e-a25c-4b19-90d3-ad5705b55649 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fd720b3b-c65b-4eb2-8cf5-6fea43469fff] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:49.619802 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6fa7447e-a25c-4b19-90d3-ad5705b55649 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:49.620311 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6fa7447e-a25c-4b19-90d3-ad5705b55649 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:49.620768 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6fa7447e-a25c-4b19-90d3-ad5705b55649 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:49.621509 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6fa7447e-a25c-4b19-90d3-ad5705b55649 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:49.621982 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6fa7447e-a25c-4b19-90d3-ad5705b55649 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:49.622428 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6fa7447e-a25c-4b19-90d3-ad5705b55649 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:49.752201 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6fa7447e-a25c-4b19-90d3-ad5705b55649 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:32:49.759997 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6fa7447e-a25c-4b19-90d3-ad5705b55649 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff" status: 200 len: 1682 microversion: 2.1 time: 0.152071 Oct 18 16:32:49.760551 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3543/7068] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:32:49 2022] GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:32:50.783173 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-17fe4a62-99b9-4e8b-82bc-40a9c165ea2d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:50.783800 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-17fe4a62-99b9-4e8b-82bc-40a9c165ea2d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fd720b3b-c65b-4eb2-8cf5-6fea43469fff] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:50.790735 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17fe4a62-99b9-4e8b-82bc-40a9c165ea2d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:50.791221 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17fe4a62-99b9-4e8b-82bc-40a9c165ea2d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:50.791659 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17fe4a62-99b9-4e8b-82bc-40a9c165ea2d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:50.792390 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17fe4a62-99b9-4e8b-82bc-40a9c165ea2d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:50.792884 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17fe4a62-99b9-4e8b-82bc-40a9c165ea2d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:50.793579 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17fe4a62-99b9-4e8b-82bc-40a9c165ea2d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:50.934300 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-17fe4a62-99b9-4e8b-82bc-40a9c165ea2d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:32:50.942811 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-17fe4a62-99b9-4e8b-82bc-40a9c165ea2d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff" status: 200 len: 1682 microversion: 2.1 time: 0.163630 Oct 18 16:32:50.943388 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3526/7069] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:32:50 2022] GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:32:51.966073 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ce456827-efe6-4a8e-beda-afbfc1fd8b67 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:51.966622 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ce456827-efe6-4a8e-beda-afbfc1fd8b67 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fd720b3b-c65b-4eb2-8cf5-6fea43469fff] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:51.974059 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ce456827-efe6-4a8e-beda-afbfc1fd8b67 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:51.974556 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ce456827-efe6-4a8e-beda-afbfc1fd8b67 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:51.975003 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ce456827-efe6-4a8e-beda-afbfc1fd8b67 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:51.975703 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ce456827-efe6-4a8e-beda-afbfc1fd8b67 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:51.976168 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ce456827-efe6-4a8e-beda-afbfc1fd8b67 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:51.976610 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ce456827-efe6-4a8e-beda-afbfc1fd8b67 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:52.106239 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ce456827-efe6-4a8e-beda-afbfc1fd8b67 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:32:52.114539 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ce456827-efe6-4a8e-beda-afbfc1fd8b67 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff" status: 200 len: 1682 microversion: 2.1 time: 0.152481 Oct 18 16:32:52.115100 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3544/7070] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:32:51 2022] GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:32:53.138227 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dca30156-5934-44f8-a899-8c80857ba15f tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:53.138837 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dca30156-5934-44f8-a899-8c80857ba15f tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fd720b3b-c65b-4eb2-8cf5-6fea43469fff] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:53.146225 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dca30156-5934-44f8-a899-8c80857ba15f tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:53.146705 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dca30156-5934-44f8-a899-8c80857ba15f tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:53.147140 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dca30156-5934-44f8-a899-8c80857ba15f tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:53.147820 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dca30156-5934-44f8-a899-8c80857ba15f tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:53.148269 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dca30156-5934-44f8-a899-8c80857ba15f tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:53.148688 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dca30156-5934-44f8-a899-8c80857ba15f tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:53.285981 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dca30156-5934-44f8-a899-8c80857ba15f tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:32:53.294137 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dca30156-5934-44f8-a899-8c80857ba15f tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff" status: 200 len: 1682 microversion: 2.1 time: 0.160079 Oct 18 16:32:53.294727 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3527/7071] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:32:53 2022] GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:32:54.318550 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-91392575-483b-4fb8-acd9-ed3f168d2ce7 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:54.319353 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-91392575-483b-4fb8-acd9-ed3f168d2ce7 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fd720b3b-c65b-4eb2-8cf5-6fea43469fff] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:54.328387 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-91392575-483b-4fb8-acd9-ed3f168d2ce7 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:54.328926 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-91392575-483b-4fb8-acd9-ed3f168d2ce7 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:54.329422 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-91392575-483b-4fb8-acd9-ed3f168d2ce7 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:54.330150 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-91392575-483b-4fb8-acd9-ed3f168d2ce7 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:54.330630 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-91392575-483b-4fb8-acd9-ed3f168d2ce7 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:54.331080 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-91392575-483b-4fb8-acd9-ed3f168d2ce7 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:54.483541 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-91392575-483b-4fb8-acd9-ed3f168d2ce7 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:32:54.491501 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-91392575-483b-4fb8-acd9-ed3f168d2ce7 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff" status: 200 len: 1682 microversion: 2.1 time: 0.176918 Oct 18 16:32:54.492081 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3545/7072] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:32:54 2022] GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff => generated 1682 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:32:55.516254 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b8e124c8-7f23-40e4-9cfd-b8093714bf78 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:55.516888 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b8e124c8-7f23-40e4-9cfd-b8093714bf78 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fd720b3b-c65b-4eb2-8cf5-6fea43469fff] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:55.523584 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8e124c8-7f23-40e4-9cfd-b8093714bf78 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:55.524070 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8e124c8-7f23-40e4-9cfd-b8093714bf78 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:55.524509 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8e124c8-7f23-40e4-9cfd-b8093714bf78 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:55.525240 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8e124c8-7f23-40e4-9cfd-b8093714bf78 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:55.525699 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8e124c8-7f23-40e4-9cfd-b8093714bf78 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:55.526126 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8e124c8-7f23-40e4-9cfd-b8093714bf78 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:55.655778 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b8e124c8-7f23-40e4-9cfd-b8093714bf78 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:32:55.663564 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b8e124c8-7f23-40e4-9cfd-b8093714bf78 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff" status: 200 len: 1682 microversion: 2.1 time: 0.151896 Oct 18 16:32:55.664137 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3528/7073] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:32:55 2022] GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:32:56.688416 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d4cc0149-e642-4631-882d-6649fb17b5ec tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:56.689586 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d4cc0149-e642-4631-882d-6649fb17b5ec tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fd720b3b-c65b-4eb2-8cf5-6fea43469fff] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:56.695423 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4cc0149-e642-4631-882d-6649fb17b5ec tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:56.695920 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4cc0149-e642-4631-882d-6649fb17b5ec tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:56.696377 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4cc0149-e642-4631-882d-6649fb17b5ec tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:56.697115 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4cc0149-e642-4631-882d-6649fb17b5ec tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:56.697583 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4cc0149-e642-4631-882d-6649fb17b5ec tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:56.698022 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4cc0149-e642-4631-882d-6649fb17b5ec tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:56.830698 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d4cc0149-e642-4631-882d-6649fb17b5ec tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:32:56.838517 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d4cc0149-e642-4631-882d-6649fb17b5ec tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff" status: 200 len: 1682 microversion: 2.1 time: 0.155412 Oct 18 16:32:56.839092 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3546/7074] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:32:56 2022] GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:32:57.863181 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-16ee1c3f-05a3-4b11-b72d-087b97845484 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:57.863798 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-16ee1c3f-05a3-4b11-b72d-087b97845484 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fd720b3b-c65b-4eb2-8cf5-6fea43469fff] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:57.870697 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16ee1c3f-05a3-4b11-b72d-087b97845484 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:57.871179 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16ee1c3f-05a3-4b11-b72d-087b97845484 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:57.871613 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16ee1c3f-05a3-4b11-b72d-087b97845484 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:57.872299 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16ee1c3f-05a3-4b11-b72d-087b97845484 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:57.872755 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16ee1c3f-05a3-4b11-b72d-087b97845484 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:57.873212 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16ee1c3f-05a3-4b11-b72d-087b97845484 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:58.003359 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-16ee1c3f-05a3-4b11-b72d-087b97845484 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:32:58.011211 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-16ee1c3f-05a3-4b11-b72d-087b97845484 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff" status: 200 len: 1682 microversion: 2.1 time: 0.151945 Oct 18 16:32:58.011783 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3529/7075] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:32:57 2022] GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:32:59.035345 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-10686af2-98f9-4ab0-a496-d1b85a71f2fa tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:32:59.036001 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-10686af2-98f9-4ab0-a496-d1b85a71f2fa tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fd720b3b-c65b-4eb2-8cf5-6fea43469fff] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:32:59.042964 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-10686af2-98f9-4ab0-a496-d1b85a71f2fa tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:59.043734 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-10686af2-98f9-4ab0-a496-d1b85a71f2fa tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:59.044186 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-10686af2-98f9-4ab0-a496-d1b85a71f2fa tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:59.044936 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-10686af2-98f9-4ab0-a496-d1b85a71f2fa tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:59.046003 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-10686af2-98f9-4ab0-a496-d1b85a71f2fa tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:59.046452 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-10686af2-98f9-4ab0-a496-d1b85a71f2fa tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:59.186153 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-10686af2-98f9-4ab0-a496-d1b85a71f2fa tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:32:59.194074 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-10686af2-98f9-4ab0-a496-d1b85a71f2fa tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff" status: 200 len: 1682 microversion: 2.1 time: 0.162657 Oct 18 16:32:59.194851 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3547/7076] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:32:59 2022] GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:32:59.626985 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-e336f8c1-ae35-447f-93e8-ce443e98c5d3 req-fc853b63-2f45-4ebb-aa0d-392d0b4b7dcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd720b3b-c65b-4eb2-8cf5-6fea43469fff", "name": "network-vif-unplugged", "status": "completed", "tag": "8addf6f2-27a0-4657-b6f8-004b22e2aeab"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:32:59.637458 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e336f8c1-ae35-447f-93e8-ce443e98c5d3 req-fc853b63-2f45-4ebb-aa0d-392d0b4b7dcb service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:32:59.638023 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e336f8c1-ae35-447f-93e8-ce443e98c5d3 req-fc853b63-2f45-4ebb-aa0d-392d0b4b7dcb service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:32:59.638536 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e336f8c1-ae35-447f-93e8-ce443e98c5d3 req-fc853b63-2f45-4ebb-aa0d-392d0b4b7dcb service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:32:59.651886 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-e336f8c1-ae35-447f-93e8-ce443e98c5d3 req-fc853b63-2f45-4ebb-aa0d-392d0b4b7dcb service nova] Creating event network-vif-unplugged:8addf6f2-27a0-4657-b6f8-004b22e2aeab for instance fd720b3b-c65b-4eb2-8cf5-6fea43469fff on n-h1-853682-5 Oct 18 16:32:59.657431 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [req-e336f8c1-ae35-447f-93e8-ce443e98c5d3 req-fc853b63-2f45-4ebb-aa0d-392d0b4b7dcb service nova] Instance fd720b3b-c65b-4eb2-8cf5-6fea43469fff is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853682-5', 'n-h1-853682-5'} {{(pid=120406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 18 16:32:59.669227 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-e336f8c1-ae35-447f-93e8-ce443e98c5d3 req-fc853b63-2f45-4ebb-aa0d-392d0b4b7dcb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046382 Oct 18 16:32:59.670305 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3530/7077] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:32:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:33:00.219039 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-775377f2-94aa-48ae-81d2-36353283bc8c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:33:00.219623 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-775377f2-94aa-48ae-81d2-36353283bc8c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fd720b3b-c65b-4eb2-8cf5-6fea43469fff] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:33:00.226489 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-775377f2-94aa-48ae-81d2-36353283bc8c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:00.226995 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-775377f2-94aa-48ae-81d2-36353283bc8c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:00.228068 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-775377f2-94aa-48ae-81d2-36353283bc8c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:00.228818 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-775377f2-94aa-48ae-81d2-36353283bc8c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:00.229315 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-775377f2-94aa-48ae-81d2-36353283bc8c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:00.229766 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-775377f2-94aa-48ae-81d2-36353283bc8c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:00.444113 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-775377f2-94aa-48ae-81d2-36353283bc8c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:33:00.452096 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-775377f2-94aa-48ae-81d2-36353283bc8c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff" status: 200 len: 1681 microversion: 2.1 time: 0.237676 Oct 18 16:33:00.452777 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3548/7078] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:33:00 2022] GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff => generated 1681 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:33:01.478260 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f9f660e2-3061-47dc-aa2f-78fc5c515ac7 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:33:01.478997 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f9f660e2-3061-47dc-aa2f-78fc5c515ac7 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fd720b3b-c65b-4eb2-8cf5-6fea43469fff] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:33:01.485783 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9f660e2-3061-47dc-aa2f-78fc5c515ac7 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:01.486270 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9f660e2-3061-47dc-aa2f-78fc5c515ac7 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:01.486709 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9f660e2-3061-47dc-aa2f-78fc5c515ac7 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:01.487409 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9f660e2-3061-47dc-aa2f-78fc5c515ac7 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:01.487896 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9f660e2-3061-47dc-aa2f-78fc5c515ac7 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:01.488324 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9f660e2-3061-47dc-aa2f-78fc5c515ac7 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:01.619637 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f9f660e2-3061-47dc-aa2f-78fc5c515ac7 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:33:01.628193 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f9f660e2-3061-47dc-aa2f-78fc5c515ac7 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff" status: 200 len: 1679 microversion: 2.1 time: 0.155358 Oct 18 16:33:01.628778 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3531/7079] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:33:01 2022] GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:33:01.710614 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-498c6246-c907-4aa5-9fd3-25f19cb78572 req-f3265b0a-abb1-4d23-b4a3-29cb20e451c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd720b3b-c65b-4eb2-8cf5-6fea43469fff", "tag": "8addf6f2-27a0-4657-b6f8-004b22e2aeab"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:33:01.721324 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-498c6246-c907-4aa5-9fd3-25f19cb78572 req-f3265b0a-abb1-4d23-b4a3-29cb20e451c3 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:01.721819 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-498c6246-c907-4aa5-9fd3-25f19cb78572 req-f3265b0a-abb1-4d23-b4a3-29cb20e451c3 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:01.722274 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-498c6246-c907-4aa5-9fd3-25f19cb78572 req-f3265b0a-abb1-4d23-b4a3-29cb20e451c3 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:01.737242 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-498c6246-c907-4aa5-9fd3-25f19cb78572 req-f3265b0a-abb1-4d23-b4a3-29cb20e451c3 service nova] Creating event network-changed:8addf6f2-27a0-4657-b6f8-004b22e2aeab for instance fd720b3b-c65b-4eb2-8cf5-6fea43469fff on n-h1-853682-5 Oct 18 16:33:01.742599 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [req-498c6246-c907-4aa5-9fd3-25f19cb78572 req-f3265b0a-abb1-4d23-b4a3-29cb20e451c3 service nova] Instance fd720b3b-c65b-4eb2-8cf5-6fea43469fff is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853682-5', 'n-h1-853682-5'} {{(pid=120405) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 18 16:33:01.753814 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-498c6246-c907-4aa5-9fd3-25f19cb78572 req-f3265b0a-abb1-4d23-b4a3-29cb20e451c3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046856 Oct 18 16:33:01.754438 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3549/7080] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:33:02.651507 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-402cf362-dd3c-4674-90fe-daac39f2984b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:33:02.652055 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-402cf362-dd3c-4674-90fe-daac39f2984b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fd720b3b-c65b-4eb2-8cf5-6fea43469fff] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:33:02.659048 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-402cf362-dd3c-4674-90fe-daac39f2984b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:02.659540 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-402cf362-dd3c-4674-90fe-daac39f2984b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:02.659972 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-402cf362-dd3c-4674-90fe-daac39f2984b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:02.660690 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-402cf362-dd3c-4674-90fe-daac39f2984b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:02.661175 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-402cf362-dd3c-4674-90fe-daac39f2984b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:02.661602 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-402cf362-dd3c-4674-90fe-daac39f2984b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:02.796952 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-402cf362-dd3c-4674-90fe-daac39f2984b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:33:02.804725 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-402cf362-dd3c-4674-90fe-daac39f2984b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff" status: 200 len: 1679 microversion: 2.1 time: 0.157129 Oct 18 16:33:02.805338 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3532/7081] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:33:02 2022] GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:33:03.831846 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-158b9a55-80ab-46a6-b6c6-32cfbfab8e44 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:33:03.832575 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-158b9a55-80ab-46a6-b6c6-32cfbfab8e44 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fd720b3b-c65b-4eb2-8cf5-6fea43469fff] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:33:03.838941 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-158b9a55-80ab-46a6-b6c6-32cfbfab8e44 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:03.839447 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-158b9a55-80ab-46a6-b6c6-32cfbfab8e44 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:03.839960 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-158b9a55-80ab-46a6-b6c6-32cfbfab8e44 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:03.840904 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-158b9a55-80ab-46a6-b6c6-32cfbfab8e44 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:03.841391 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-158b9a55-80ab-46a6-b6c6-32cfbfab8e44 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:03.841866 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-158b9a55-80ab-46a6-b6c6-32cfbfab8e44 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:03.990689 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-158b9a55-80ab-46a6-b6c6-32cfbfab8e44 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:33:03.999681 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-158b9a55-80ab-46a6-b6c6-32cfbfab8e44 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff" status: 200 len: 1676 microversion: 2.1 time: 0.173870 Oct 18 16:33:04.000255 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3550/7082] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:33:03 2022] GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff => generated 1676 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:33:04.022678 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-91631847-c43b-4e00-89b7-15573fa50c45 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:33:04.023223 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-91631847-c43b-4e00-89b7-15573fa50c45 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fd720b3b-c65b-4eb2-8cf5-6fea43469fff] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:33:04.030183 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91631847-c43b-4e00-89b7-15573fa50c45 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:04.030676 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91631847-c43b-4e00-89b7-15573fa50c45 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:04.031165 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91631847-c43b-4e00-89b7-15573fa50c45 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:04.031805 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91631847-c43b-4e00-89b7-15573fa50c45 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:04.032265 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91631847-c43b-4e00-89b7-15573fa50c45 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:04.032695 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91631847-c43b-4e00-89b7-15573fa50c45 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:04.072797 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91631847-c43b-4e00-89b7-15573fa50c45 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:04.073300 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91631847-c43b-4e00-89b7-15573fa50c45 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:04.073736 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91631847-c43b-4e00-89b7-15573fa50c45 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:04.074466 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91631847-c43b-4e00-89b7-15573fa50c45 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:04.074924 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91631847-c43b-4e00-89b7-15573fa50c45 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:04.075352 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91631847-c43b-4e00-89b7-15573fa50c45 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:04.097415 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-91631847-c43b-4e00-89b7-15573fa50c45 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Getting quotas for project f872c1ec84314318ac67bfbe7d186b2c. Resources: {'cores', 'ram'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:33:04.102620 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-91631847-c43b-4e00-89b7-15573fa50c45 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Getting quotas for user 92c26a3ccef246d6bb58d7d834f71106 and project f872c1ec84314318ac67bfbe7d186b2c. Resources: {'cores', 'ram'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:33:04.183024 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:04.206834 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-91631847-c43b-4e00-89b7-15573fa50c45 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "POST /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff/action" status: 202 len: 0 microversion: 2.1 time: 0.187931 Oct 18 16:33:04.207462 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3533/7083] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:33:04 2022] POST /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:33:04.215712 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3d993943-56a2-4cd9-b5ce-6ed25cb677d3 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:33:04.216640 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3d993943-56a2-4cd9-b5ce-6ed25cb677d3 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fd720b3b-c65b-4eb2-8cf5-6fea43469fff] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:33:04.223273 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3d993943-56a2-4cd9-b5ce-6ed25cb677d3 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:04.223906 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3d993943-56a2-4cd9-b5ce-6ed25cb677d3 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:04.224467 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3d993943-56a2-4cd9-b5ce-6ed25cb677d3 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:04.225330 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3d993943-56a2-4cd9-b5ce-6ed25cb677d3 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:04.226021 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3d993943-56a2-4cd9-b5ce-6ed25cb677d3 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:04.226542 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3d993943-56a2-4cd9-b5ce-6ed25cb677d3 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:04.434946 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3d993943-56a2-4cd9-b5ce-6ed25cb677d3 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:33:04.443452 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3d993943-56a2-4cd9-b5ce-6ed25cb677d3 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff" status: 200 len: 1675 microversion: 2.1 time: 0.231737 Oct 18 16:33:04.444029 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3551/7084] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:33:04 2022] GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff => generated 1675 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:33:05.468583 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a39273d0-0e55-4060-8214-bbd73069df99 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:33:05.469319 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a39273d0-0e55-4060-8214-bbd73069df99 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fd720b3b-c65b-4eb2-8cf5-6fea43469fff] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:33:05.475516 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a39273d0-0e55-4060-8214-bbd73069df99 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:05.476020 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a39273d0-0e55-4060-8214-bbd73069df99 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:05.476446 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a39273d0-0e55-4060-8214-bbd73069df99 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:05.477239 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a39273d0-0e55-4060-8214-bbd73069df99 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:05.477703 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a39273d0-0e55-4060-8214-bbd73069df99 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:05.478133 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a39273d0-0e55-4060-8214-bbd73069df99 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:05.614683 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a39273d0-0e55-4060-8214-bbd73069df99 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:33:05.622513 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a39273d0-0e55-4060-8214-bbd73069df99 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff" status: 200 len: 1675 microversion: 2.1 time: 0.159549 Oct 18 16:33:05.623094 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3534/7085] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:33:05 2022] GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:33:05.798948 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-2b49a53e-3ec9-47d4-b5ad-3bfb0574edde req-c57808e9-9bbb-4189-bc76-369ef3a5bfbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd720b3b-c65b-4eb2-8cf5-6fea43469fff", "name": "network-vif-plugged", "status": "completed", "tag": "8addf6f2-27a0-4657-b6f8-004b22e2aeab"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:33:05.809005 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-2b49a53e-3ec9-47d4-b5ad-3bfb0574edde req-c57808e9-9bbb-4189-bc76-369ef3a5bfbc service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:05.809513 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-2b49a53e-3ec9-47d4-b5ad-3bfb0574edde req-c57808e9-9bbb-4189-bc76-369ef3a5bfbc service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:05.809968 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-2b49a53e-3ec9-47d4-b5ad-3bfb0574edde req-c57808e9-9bbb-4189-bc76-369ef3a5bfbc service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:05.822858 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-2b49a53e-3ec9-47d4-b5ad-3bfb0574edde req-c57808e9-9bbb-4189-bc76-369ef3a5bfbc service nova] Creating event network-vif-plugged:8addf6f2-27a0-4657-b6f8-004b22e2aeab for instance fd720b3b-c65b-4eb2-8cf5-6fea43469fff on n-h1-853682-5 Oct 18 16:33:05.830930 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [req-2b49a53e-3ec9-47d4-b5ad-3bfb0574edde req-c57808e9-9bbb-4189-bc76-369ef3a5bfbc service nova] Instance fd720b3b-c65b-4eb2-8cf5-6fea43469fff is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853682-5', 'n-h1-853682-5'} {{(pid=120405) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 18 16:33:05.842563 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-2b49a53e-3ec9-47d4-b5ad-3bfb0574edde req-c57808e9-9bbb-4189-bc76-369ef3a5bfbc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047622 Oct 18 16:33:05.843178 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3552/7086] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:33:06.645961 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-06449c77-e2c9-442f-80de-24bd1133f242 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:33:06.646587 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-06449c77-e2c9-442f-80de-24bd1133f242 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fd720b3b-c65b-4eb2-8cf5-6fea43469fff] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:33:06.653375 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06449c77-e2c9-442f-80de-24bd1133f242 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:06.653866 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06449c77-e2c9-442f-80de-24bd1133f242 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:06.654309 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06449c77-e2c9-442f-80de-24bd1133f242 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:06.655097 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06449c77-e2c9-442f-80de-24bd1133f242 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:06.655559 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06449c77-e2c9-442f-80de-24bd1133f242 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:06.655990 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06449c77-e2c9-442f-80de-24bd1133f242 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:06.787097 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-06449c77-e2c9-442f-80de-24bd1133f242 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:33:06.795098 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-06449c77-e2c9-442f-80de-24bd1133f242 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff" status: 200 len: 1675 microversion: 2.1 time: 0.153031 Oct 18 16:33:06.796189 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3535/7087] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:33:06 2022] GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:33:07.820644 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-59b74889-c32d-4eb0-bc24-b63873be42cb tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:33:07.821394 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-59b74889-c32d-4eb0-bc24-b63873be42cb tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fd720b3b-c65b-4eb2-8cf5-6fea43469fff] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:33:07.828367 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-59b74889-c32d-4eb0-bc24-b63873be42cb tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:07.829030 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-59b74889-c32d-4eb0-bc24-b63873be42cb tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:07.829493 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-59b74889-c32d-4eb0-bc24-b63873be42cb tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:07.830223 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-59b74889-c32d-4eb0-bc24-b63873be42cb tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:07.830688 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-59b74889-c32d-4eb0-bc24-b63873be42cb tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:07.831136 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-59b74889-c32d-4eb0-bc24-b63873be42cb tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:07.834805 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-0f352e56-de5b-403a-9065-9d6b43daa749 req-87c9bd57-f78d-44d0-abb5-42cae08858d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd720b3b-c65b-4eb2-8cf5-6fea43469fff", "name": "network-vif-unplugged", "status": "completed", "tag": "8addf6f2-27a0-4657-b6f8-004b22e2aeab"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:33:07.851675 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0f352e56-de5b-403a-9065-9d6b43daa749 req-87c9bd57-f78d-44d0-abb5-42cae08858d5 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:07.852708 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0f352e56-de5b-403a-9065-9d6b43daa749 req-87c9bd57-f78d-44d0-abb5-42cae08858d5 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:07.853296 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0f352e56-de5b-403a-9065-9d6b43daa749 req-87c9bd57-f78d-44d0-abb5-42cae08858d5 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:07.866850 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-0f352e56-de5b-403a-9065-9d6b43daa749 req-87c9bd57-f78d-44d0-abb5-42cae08858d5 service nova] Creating event network-vif-unplugged:8addf6f2-27a0-4657-b6f8-004b22e2aeab for instance fd720b3b-c65b-4eb2-8cf5-6fea43469fff on n-h2-853682-5 Oct 18 16:33:07.873050 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [req-0f352e56-de5b-403a-9065-9d6b43daa749 req-87c9bd57-f78d-44d0-abb5-42cae08858d5 service nova] Instance fd720b3b-c65b-4eb2-8cf5-6fea43469fff is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853682-5', 'n-h1-853682-5'} {{(pid=120406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 18 16:33:07.887989 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-0f352e56-de5b-403a-9065-9d6b43daa749 req-87c9bd57-f78d-44d0-abb5-42cae08858d5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059112 Oct 18 16:33:07.888729 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3536/7088] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:33:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:33:07.977196 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-59b74889-c32d-4eb0-bc24-b63873be42cb tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:33:07.987481 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-59b74889-c32d-4eb0-bc24-b63873be42cb tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff" status: 200 len: 1675 microversion: 2.1 time: 0.171881 Oct 18 16:33:07.988120 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3553/7089] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:33:07 2022] GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff => generated 1675 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:33:09.013030 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4c8e92d1-2e66-441f-bedf-9439042b72f3 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:33:09.013727 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4c8e92d1-2e66-441f-bedf-9439042b72f3 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fd720b3b-c65b-4eb2-8cf5-6fea43469fff] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:33:09.019912 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c8e92d1-2e66-441f-bedf-9439042b72f3 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:09.020389 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c8e92d1-2e66-441f-bedf-9439042b72f3 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:09.020839 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c8e92d1-2e66-441f-bedf-9439042b72f3 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:09.021523 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c8e92d1-2e66-441f-bedf-9439042b72f3 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:09.021977 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c8e92d1-2e66-441f-bedf-9439042b72f3 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:09.022398 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c8e92d1-2e66-441f-bedf-9439042b72f3 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:09.158786 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4c8e92d1-2e66-441f-bedf-9439042b72f3 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:33:09.166880 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4c8e92d1-2e66-441f-bedf-9439042b72f3 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff" status: 200 len: 1675 microversion: 2.1 time: 0.158628 Oct 18 16:33:09.167473 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3537/7090] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:33:09 2022] GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:33:09.927520 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-a08185e6-1442-4511-b13c-84fb59c516d7 req-ea930c72-73cc-49bc-85b5-aaab872e5e6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd720b3b-c65b-4eb2-8cf5-6fea43469fff", "tag": "8addf6f2-27a0-4657-b6f8-004b22e2aeab"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:33:09.938329 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-a08185e6-1442-4511-b13c-84fb59c516d7 req-ea930c72-73cc-49bc-85b5-aaab872e5e6b service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:09.938817 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-a08185e6-1442-4511-b13c-84fb59c516d7 req-ea930c72-73cc-49bc-85b5-aaab872e5e6b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:09.939262 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-a08185e6-1442-4511-b13c-84fb59c516d7 req-ea930c72-73cc-49bc-85b5-aaab872e5e6b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:09.950893 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-a08185e6-1442-4511-b13c-84fb59c516d7 req-ea930c72-73cc-49bc-85b5-aaab872e5e6b service nova] Creating event network-changed:8addf6f2-27a0-4657-b6f8-004b22e2aeab for instance fd720b3b-c65b-4eb2-8cf5-6fea43469fff on n-h2-853682-5 Oct 18 16:33:09.953334 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=89 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:09.957117 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [req-a08185e6-1442-4511-b13c-84fb59c516d7 req-ea930c72-73cc-49bc-85b5-aaab872e5e6b service nova] Instance fd720b3b-c65b-4eb2-8cf5-6fea43469fff is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853682-5', 'n-h1-853682-5'} {{(pid=120405) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 18 16:33:09.968215 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-a08185e6-1442-4511-b13c-84fb59c516d7 req-ea930c72-73cc-49bc-85b5-aaab872e5e6b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043962 Oct 18 16:33:09.968832 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3554/7091] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:33:10.191095 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3fc637da-0ad5-4952-ac31-433d568e9996 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:33:10.191647 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3fc637da-0ad5-4952-ac31-433d568e9996 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fd720b3b-c65b-4eb2-8cf5-6fea43469fff] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:33:10.194652 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:10.207019 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3fc637da-0ad5-4952-ac31-433d568e9996 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:10.207940 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3fc637da-0ad5-4952-ac31-433d568e9996 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:10.209406 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3fc637da-0ad5-4952-ac31-433d568e9996 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:10.211151 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3fc637da-0ad5-4952-ac31-433d568e9996 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:10.211853 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3fc637da-0ad5-4952-ac31-433d568e9996 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:10.212379 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3fc637da-0ad5-4952-ac31-433d568e9996 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:10.730186 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3fc637da-0ad5-4952-ac31-433d568e9996 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:33:10.739435 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3fc637da-0ad5-4952-ac31-433d568e9996 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff" status: 200 len: 1675 microversion: 2.1 time: 0.552418 Oct 18 16:33:10.752995 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3538/7092] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:33:10 2022] GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff => generated 1675 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:33:11.765101 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d8998cb8-5d75-4a73-8c84-29ce4518d2d6 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:33:11.765830 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d8998cb8-5d75-4a73-8c84-29ce4518d2d6 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fd720b3b-c65b-4eb2-8cf5-6fea43469fff] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:33:11.768928 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=33 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:11.774153 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d8998cb8-5d75-4a73-8c84-29ce4518d2d6 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:11.774670 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d8998cb8-5d75-4a73-8c84-29ce4518d2d6 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:11.775128 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d8998cb8-5d75-4a73-8c84-29ce4518d2d6 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:11.776055 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d8998cb8-5d75-4a73-8c84-29ce4518d2d6 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:11.776536 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d8998cb8-5d75-4a73-8c84-29ce4518d2d6 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:11.777504 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d8998cb8-5d75-4a73-8c84-29ce4518d2d6 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:11.938817 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d8998cb8-5d75-4a73-8c84-29ce4518d2d6 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:33:11.946648 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d8998cb8-5d75-4a73-8c84-29ce4518d2d6 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff" status: 200 len: 1668 microversion: 2.1 time: 0.187243 Oct 18 16:33:11.947500 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3555/7093] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:33:11 2022] GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff => generated 1668 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:33:11.971066 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1308f8c2-4472-43ac-8fe9-78651628ca91 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:33:11.971704 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1308f8c2-4472-43ac-8fe9-78651628ca91 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fd720b3b-c65b-4eb2-8cf5-6fea43469fff] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:33:11.978676 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1308f8c2-4472-43ac-8fe9-78651628ca91 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:11.979169 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1308f8c2-4472-43ac-8fe9-78651628ca91 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:11.979596 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1308f8c2-4472-43ac-8fe9-78651628ca91 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:11.980297 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1308f8c2-4472-43ac-8fe9-78651628ca91 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:11.980755 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1308f8c2-4472-43ac-8fe9-78651628ca91 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:11.981229 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1308f8c2-4472-43ac-8fe9-78651628ca91 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:12.122972 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1308f8c2-4472-43ac-8fe9-78651628ca91 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:33:12.131230 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1308f8c2-4472-43ac-8fe9-78651628ca91 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff" status: 200 len: 1668 microversion: 2.1 time: 0.164812 Oct 18 16:33:12.131830 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3539/7094] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:33:11 2022] GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff => generated 1668 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:33:12.154275 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5529adcc-5878-44aa-92fe-f7088439201b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:33:12.154977 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5529adcc-5878-44aa-92fe-f7088439201b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fd720b3b-c65b-4eb2-8cf5-6fea43469fff] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:33:12.161057 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5529adcc-5878-44aa-92fe-f7088439201b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:12.161562 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5529adcc-5878-44aa-92fe-f7088439201b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:12.162018 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5529adcc-5878-44aa-92fe-f7088439201b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:12.162733 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5529adcc-5878-44aa-92fe-f7088439201b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:12.163204 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5529adcc-5878-44aa-92fe-f7088439201b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:12.163648 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5529adcc-5878-44aa-92fe-f7088439201b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:12.297516 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5529adcc-5878-44aa-92fe-f7088439201b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:33:12.305305 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5529adcc-5878-44aa-92fe-f7088439201b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff" status: 200 len: 1668 microversion: 2.1 time: 0.154940 Oct 18 16:33:12.305886 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3556/7095] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:33:12 2022] GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff => generated 1668 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:33:12.327415 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5991bc7f-e13c-4d60-8fef-0d27cac15826 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:33:12.327906 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5991bc7f-e13c-4d60-8fef-0d27cac15826 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fd720b3b-c65b-4eb2-8cf5-6fea43469fff] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:33:12.333835 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5991bc7f-e13c-4d60-8fef-0d27cac15826 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:12.334312 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5991bc7f-e13c-4d60-8fef-0d27cac15826 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:12.334739 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5991bc7f-e13c-4d60-8fef-0d27cac15826 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:12.335418 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5991bc7f-e13c-4d60-8fef-0d27cac15826 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:12.335868 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5991bc7f-e13c-4d60-8fef-0d27cac15826 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:12.336283 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5991bc7f-e13c-4d60-8fef-0d27cac15826 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:12.362189 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5991bc7f-e13c-4d60-8fef-0d27cac15826 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fd720b3b-c65b-4eb2-8cf5-6fea43469fff] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:33:12.438919 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5991bc7f-e13c-4d60-8fef-0d27cac15826 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "DELETE /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff" status: 204 len: 0 microversion: 2.1 time: 0.115067 Oct 18 16:33:12.439842 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3540/7096] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 16:33:12 2022] DELETE /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:33:12.450363 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6ccc8b06-c3da-4567-a06c-62dc3b5b25f2 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:33:12.451008 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6ccc8b06-c3da-4567-a06c-62dc3b5b25f2 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fd720b3b-c65b-4eb2-8cf5-6fea43469fff] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:33:12.457518 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ccc8b06-c3da-4567-a06c-62dc3b5b25f2 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:12.457941 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ccc8b06-c3da-4567-a06c-62dc3b5b25f2 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:12.458429 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ccc8b06-c3da-4567-a06c-62dc3b5b25f2 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:12.459144 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ccc8b06-c3da-4567-a06c-62dc3b5b25f2 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:12.459621 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ccc8b06-c3da-4567-a06c-62dc3b5b25f2 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:12.460067 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ccc8b06-c3da-4567-a06c-62dc3b5b25f2 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:12.590716 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6ccc8b06-c3da-4567-a06c-62dc3b5b25f2 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:33:12.599075 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6ccc8b06-c3da-4567-a06c-62dc3b5b25f2 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff" status: 200 len: 1674 microversion: 2.1 time: 0.154571 Oct 18 16:33:12.599646 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3557/7097] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:33:12 2022] GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:33:13.624399 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1d352ea3-e9e3-448f-b5f2-c6cea1be1c48 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:33:13.625159 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1d352ea3-e9e3-448f-b5f2-c6cea1be1c48 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fd720b3b-c65b-4eb2-8cf5-6fea43469fff] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:33:13.631943 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d352ea3-e9e3-448f-b5f2-c6cea1be1c48 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:13.632431 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d352ea3-e9e3-448f-b5f2-c6cea1be1c48 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:13.632916 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d352ea3-e9e3-448f-b5f2-c6cea1be1c48 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:13.633620 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d352ea3-e9e3-448f-b5f2-c6cea1be1c48 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:13.634080 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d352ea3-e9e3-448f-b5f2-c6cea1be1c48 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:13.634513 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d352ea3-e9e3-448f-b5f2-c6cea1be1c48 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:13.731069 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-98942274-550f-4118-b752-fab1cdd143f0 req-77cf4647-392c-4b9c-a8f4-9d1a2e263d53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd720b3b-c65b-4eb2-8cf5-6fea43469fff", "name": "network-vif-plugged", "status": "completed", "tag": "8addf6f2-27a0-4657-b6f8-004b22e2aeab"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:33:13.742627 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-98942274-550f-4118-b752-fab1cdd143f0 req-77cf4647-392c-4b9c-a8f4-9d1a2e263d53 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:13.743355 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-98942274-550f-4118-b752-fab1cdd143f0 req-77cf4647-392c-4b9c-a8f4-9d1a2e263d53 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:13.743924 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-98942274-550f-4118-b752-fab1cdd143f0 req-77cf4647-392c-4b9c-a8f4-9d1a2e263d53 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:13.778214 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1d352ea3-e9e3-448f-b5f2-c6cea1be1c48 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:33:13.779336 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-98942274-550f-4118-b752-fab1cdd143f0 req-77cf4647-392c-4b9c-a8f4-9d1a2e263d53 service nova] Creating event network-vif-plugged:8addf6f2-27a0-4657-b6f8-004b22e2aeab for instance fd720b3b-c65b-4eb2-8cf5-6fea43469fff on n-h2-853682-5 Oct 18 16:33:13.786797 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1d352ea3-e9e3-448f-b5f2-c6cea1be1c48 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff" status: 200 len: 1674 microversion: 2.1 time: 0.167957 Oct 18 16:33:13.787398 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3541/7098] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:33:13 2022] GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff => generated 1674 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:33:13.802752 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-98942274-550f-4118-b752-fab1cdd143f0 req-77cf4647-392c-4b9c-a8f4-9d1a2e263d53 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075245 Oct 18 16:33:13.803374 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3558/7099] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:33:14.596096 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-1790e75f-0487-4858-b15f-931e8a410a9d req-38ecbd28-745e-44c4-94da-7c8a30b6322b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd720b3b-c65b-4eb2-8cf5-6fea43469fff", "name": "network-vif-deleted", "tag": "8addf6f2-27a0-4657-b6f8-004b22e2aeab"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:33:14.600973 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:14.606820 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1790e75f-0487-4858-b15f-931e8a410a9d req-38ecbd28-745e-44c4-94da-7c8a30b6322b service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:14.607292 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1790e75f-0487-4858-b15f-931e8a410a9d req-38ecbd28-745e-44c4-94da-7c8a30b6322b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:14.608303 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1790e75f-0487-4858-b15f-931e8a410a9d req-38ecbd28-745e-44c4-94da-7c8a30b6322b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:14.621081 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-1790e75f-0487-4858-b15f-931e8a410a9d req-38ecbd28-745e-44c4-94da-7c8a30b6322b service nova] Creating event network-vif-deleted:8addf6f2-27a0-4657-b6f8-004b22e2aeab for instance fd720b3b-c65b-4eb2-8cf5-6fea43469fff on n-h2-853682-5 Oct 18 16:33:14.626012 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-1790e75f-0487-4858-b15f-931e8a410a9d req-38ecbd28-745e-44c4-94da-7c8a30b6322b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034735 Oct 18 16:33:14.626994 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3542/7100] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:33:14.814007 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4c3be3ac-8a23-4e46-8ac2-a20439faddaa tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:33:14.815231 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4c3be3ac-8a23-4e46-8ac2-a20439faddaa tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fd720b3b-c65b-4eb2-8cf5-6fea43469fff] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:33:14.822380 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4c3be3ac-8a23-4e46-8ac2-a20439faddaa tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:14.822914 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4c3be3ac-8a23-4e46-8ac2-a20439faddaa tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:14.823445 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4c3be3ac-8a23-4e46-8ac2-a20439faddaa tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:14.824246 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4c3be3ac-8a23-4e46-8ac2-a20439faddaa tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:14.825453 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4c3be3ac-8a23-4e46-8ac2-a20439faddaa tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:14.825917 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4c3be3ac-8a23-4e46-8ac2-a20439faddaa tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:14.841469 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-4c3be3ac-8a23-4e46-8ac2-a20439faddaa tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] HTTP exception thrown: Instance fd720b3b-c65b-4eb2-8cf5-6fea43469fff could not be found. Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4c3be3ac-8a23-4e46-8ac2-a20439faddaa tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Request method failure captured: Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff HTTP/1.1 Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTtRtIaUCN9plKHAU4sMF0eKPWeSPc3LcSTEAsfYHO6Ia-co9ZPn6puaeremyzCJ1TQjfFH64XFDE8JVb1F9uH606Ok8WhdDHKOcmm8H7JUvsjzsW5arFpGz6CXjDjVzRoJq_6-HaJ4kSxSPzbYSgopkwKzlavAYaW8OixT5z-2qDJfM Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: f872c1ec84314318ac67bfbe7d186b2c Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServerActionsTestJSON-1692549662 Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServerActionsTestJSON-1692549662 Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: f872c1ec84314318ac67bfbe7d186b2c Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServerActionsTestJSON-1692549662 Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServerActionsTestJSON-1692549662-project Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 92c26a3ccef246d6bb58d7d834f71106 Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServerActionsTestJSON-1692549662-project Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance fd720b3b-c65b-4eb2-8cf5-6fea43469fff could not be found. Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'fd720b3b-c65b-4eb2-8cf5-6fea43469fff'} Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd720b3b-c65b-4eb2-8cf5-6fea43469fff could not be found. Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd720b3b-c65b-4eb2-8cf5-6fea43469fff could not be found. Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:33:14.843277 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:33:14.848404 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:33:14.848404 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:33:14.848404 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:33:14.848404 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:33:14.848404 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:33:14.848404 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd720b3b-c65b-4eb2-8cf5-6fea43469fff could not be found. Oct 18 16:33:14.848404 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:33:14.848404 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4c3be3ac-8a23-4e46-8ac2-a20439faddaa tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Returning 404 to user: Instance fd720b3b-c65b-4eb2-8cf5-6fea43469fff could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:33:14.848404 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4c3be3ac-8a23-4e46-8ac2-a20439faddaa tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff" status: 404 len: 111 microversion: 2.1 time: 0.036286 Oct 18 16:33:14.849660 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3559/7101] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:33:14 2022] GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:33:14.862202 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7b1ccf7b-a9d7-40f0-926b-f1b0e82d7439 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:33:14.862915 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7b1ccf7b-a9d7-40f0-926b-f1b0e82d7439 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fd720b3b-c65b-4eb2-8cf5-6fea43469fff] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:33:14.871153 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b1ccf7b-a9d7-40f0-926b-f1b0e82d7439 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:14.871652 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b1ccf7b-a9d7-40f0-926b-f1b0e82d7439 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:14.872091 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b1ccf7b-a9d7-40f0-926b-f1b0e82d7439 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:14.872799 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b1ccf7b-a9d7-40f0-926b-f1b0e82d7439 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:14.873884 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b1ccf7b-a9d7-40f0-926b-f1b0e82d7439 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:14.874287 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b1ccf7b-a9d7-40f0-926b-f1b0e82d7439 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:14.888384 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-7b1ccf7b-a9d7-40f0-926b-f1b0e82d7439 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] HTTP exception thrown: Instance fd720b3b-c65b-4eb2-8cf5-6fea43469fff could not be found. Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7b1ccf7b-a9d7-40f0-926b-f1b0e82d7439 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Request method failure captured: Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff HTTP/1.1 Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTtRtIaUCN9plKHAU4sMF0eKPWeSPc3LcSTEAsfYHO6Ia-co9ZPn6puaeremyzCJ1TQjfFH64XFDE8JVb1F9uH606Ok8WhdDHKOcmm8H7JUvsjzsW5arFpGz6CXjDjVzRoJq_6-HaJ4kSxSPzbYSgopkwKzlavAYaW8OixT5z-2qDJfM Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: f872c1ec84314318ac67bfbe7d186b2c Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerActionsTestJSON-1692549662 Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServerActionsTestJSON-1692549662 Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: f872c1ec84314318ac67bfbe7d186b2c Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerActionsTestJSON-1692549662 Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServerActionsTestJSON-1692549662-project Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 92c26a3ccef246d6bb58d7d834f71106 Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServerActionsTestJSON-1692549662-project Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance fd720b3b-c65b-4eb2-8cf5-6fea43469fff could not be found. Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'fd720b3b-c65b-4eb2-8cf5-6fea43469fff'} Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd720b3b-c65b-4eb2-8cf5-6fea43469fff could not be found. Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd720b3b-c65b-4eb2-8cf5-6fea43469fff could not be found. Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:33:14.890152 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:33:14.895119 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:33:14.895119 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:33:14.895119 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:33:14.895119 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:33:14.895119 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:33:14.895119 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd720b3b-c65b-4eb2-8cf5-6fea43469fff could not be found. Oct 18 16:33:14.895119 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:33:14.895119 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7b1ccf7b-a9d7-40f0-926b-f1b0e82d7439 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Returning 404 to user: Instance fd720b3b-c65b-4eb2-8cf5-6fea43469fff could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:33:14.895119 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7b1ccf7b-a9d7-40f0-926b-f1b0e82d7439 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff" status: 404 len: 111 microversion: 2.1 time: 0.035031 Oct 18 16:33:14.895119 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3543/7102] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:33:14 2022] GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:33:14.942338 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-79945c4d-f21e-4962-9a35-00a7b43eeb5d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-720706471", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "cdf0b0ca-963c-402a-919d-35be60437c6f"}], "security_groups": [{"name": "tempest-securitygroup--582261342"}], "key_name": "tempest-keypair-85721457", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:33:15.050786 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-79945c4d-f21e-4962-9a35-00a7b43eeb5d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] validate_networks() for [('cdf0b0ca-963c-402a-919d-35be60437c6f', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 16:33:15.444715 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-79945c4d-f21e-4962-9a35-00a7b43eeb5d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:33:15.445206 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-79945c4d-f21e-4962-9a35-00a7b43eeb5d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:33:15.445704 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-79945c4d-f21e-4962-9a35-00a7b43eeb5d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:33:15.446131 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-79945c4d-f21e-4962-9a35-00a7b43eeb5d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:33:15.446563 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-79945c4d-f21e-4962-9a35-00a7b43eeb5d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:33:15.457688 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-79945c4d-f21e-4962-9a35-00a7b43eeb5d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:15.458190 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-79945c4d-f21e-4962-9a35-00a7b43eeb5d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:15.458640 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-79945c4d-f21e-4962-9a35-00a7b43eeb5d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:15.459381 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-79945c4d-f21e-4962-9a35-00a7b43eeb5d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:15.459850 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-79945c4d-f21e-4962-9a35-00a7b43eeb5d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:15.460289 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-79945c4d-f21e-4962-9a35-00a7b43eeb5d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:15.478221 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-79945c4d-f21e-4962-9a35-00a7b43eeb5d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Getting quotas for project f872c1ec84314318ac67bfbe7d186b2c. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:33:15.484626 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-79945c4d-f21e-4962-9a35-00a7b43eeb5d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Getting quotas for user 92c26a3ccef246d6bb58d7d834f71106 and project f872c1ec84314318ac67bfbe7d186b2c. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:33:15.497795 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-79945c4d-f21e-4962-9a35-00a7b43eeb5d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:33:15.500209 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-79945c4d-f21e-4962-9a35-00a7b43eeb5d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:33:15.554047 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-79945c4d-f21e-4962-9a35-00a7b43eeb5d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.615711 Oct 18 16:33:15.556854 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3560/7103] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 16:33:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:33:15.566354 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4c73f861-46e1-421f-9d48-09516e42fee2 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:33:15.566981 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4c73f861-46e1-421f-9d48-09516e42fee2 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:33:15.630203 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4c73f861-46e1-421f-9d48-09516e42fee2 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:33:15.639403 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4c73f861-46e1-421f-9d48-09516e42fee2 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1236 microversion: 2.1 time: 0.076360 Oct 18 16:33:15.653889 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3544/7104] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:33:15 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1236 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:33:16.666098 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-cbf20d32-656f-4683-ab20-21d77dc5d36b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:33:16.667000 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-cbf20d32-656f-4683-ab20-21d77dc5d36b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:33:16.675564 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cbf20d32-656f-4683-ab20-21d77dc5d36b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:16.676071 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cbf20d32-656f-4683-ab20-21d77dc5d36b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:16.676553 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cbf20d32-656f-4683-ab20-21d77dc5d36b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:16.677424 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cbf20d32-656f-4683-ab20-21d77dc5d36b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:16.677897 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cbf20d32-656f-4683-ab20-21d77dc5d36b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:16.678330 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cbf20d32-656f-4683-ab20-21d77dc5d36b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:16.760263 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-cbf20d32-656f-4683-ab20-21d77dc5d36b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:33:16.769924 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-cbf20d32-656f-4683-ab20-21d77dc5d36b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1296 microversion: 2.1 time: 0.109930 Oct 18 16:33:16.773535 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3561/7105] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:33:16 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1296 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:33:17.794910 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1391c76e-5ef1-4488-9ee2-d95dfa187393 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:33:17.796275 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1391c76e-5ef1-4488-9ee2-d95dfa187393 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:33:17.804235 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1391c76e-5ef1-4488-9ee2-d95dfa187393 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:17.804720 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1391c76e-5ef1-4488-9ee2-d95dfa187393 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:17.805199 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1391c76e-5ef1-4488-9ee2-d95dfa187393 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:17.805903 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1391c76e-5ef1-4488-9ee2-d95dfa187393 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:17.806488 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1391c76e-5ef1-4488-9ee2-d95dfa187393 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:17.806917 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1391c76e-5ef1-4488-9ee2-d95dfa187393 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:18.044892 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1391c76e-5ef1-4488-9ee2-d95dfa187393 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:33:18.052693 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1391c76e-5ef1-4488-9ee2-d95dfa187393 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1361 microversion: 2.1 time: 0.261968 Oct 18 16:33:18.053373 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3545/7106] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:33:17 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1361 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:33:18.254774 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-a751f583-f8e9-4c84-880c-3fcb238b0173 req-e659954a-b757-4507-99e5-df29223c2b55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fad2592-ecf3-43a2-b1da-91bc7899e785", "tag": "bd3875dc-2d65-4595-929c-151d03c0a270"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:33:18.267994 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-a751f583-f8e9-4c84-880c-3fcb238b0173 req-e659954a-b757-4507-99e5-df29223c2b55 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:18.268508 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-a751f583-f8e9-4c84-880c-3fcb238b0173 req-e659954a-b757-4507-99e5-df29223c2b55 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:18.268998 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-a751f583-f8e9-4c84-880c-3fcb238b0173 req-e659954a-b757-4507-99e5-df29223c2b55 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:18.280210 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-a751f583-f8e9-4c84-880c-3fcb238b0173 req-e659954a-b757-4507-99e5-df29223c2b55 service nova] Creating event network-changed:bd3875dc-2d65-4595-929c-151d03c0a270 for instance 3fad2592-ecf3-43a2-b1da-91bc7899e785 on n-h1-853682-5 Oct 18 16:33:18.285984 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-a751f583-f8e9-4c84-880c-3fcb238b0173 req-e659954a-b757-4507-99e5-df29223c2b55 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035205 Oct 18 16:33:18.286908 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3562/7107] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:33:19.075607 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2d2755fc-a289-415c-9aa7-c140ec6c552e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:33:19.076231 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2d2755fc-a289-415c-9aa7-c140ec6c552e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:33:19.083123 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d2755fc-a289-415c-9aa7-c140ec6c552e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:19.083607 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d2755fc-a289-415c-9aa7-c140ec6c552e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:19.084045 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d2755fc-a289-415c-9aa7-c140ec6c552e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:19.084738 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d2755fc-a289-415c-9aa7-c140ec6c552e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:19.085224 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d2755fc-a289-415c-9aa7-c140ec6c552e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:19.085656 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d2755fc-a289-415c-9aa7-c140ec6c552e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:19.220312 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2d2755fc-a289-415c-9aa7-c140ec6c552e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:33:19.228082 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2d2755fc-a289-415c-9aa7-c140ec6c552e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1361 microversion: 2.1 time: 0.156393 Oct 18 16:33:19.228668 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3546/7108] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:33:19 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:33:20.253742 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-57dc256a-700b-4bb0-b4ee-9751b38f9a79 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:33:20.254468 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-57dc256a-700b-4bb0-b4ee-9751b38f9a79 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:33:20.260749 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57dc256a-700b-4bb0-b4ee-9751b38f9a79 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:20.261343 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57dc256a-700b-4bb0-b4ee-9751b38f9a79 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:20.261803 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57dc256a-700b-4bb0-b4ee-9751b38f9a79 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:20.262514 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57dc256a-700b-4bb0-b4ee-9751b38f9a79 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:20.262992 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57dc256a-700b-4bb0-b4ee-9751b38f9a79 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:20.263447 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57dc256a-700b-4bb0-b4ee-9751b38f9a79 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:20.392994 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-57dc256a-700b-4bb0-b4ee-9751b38f9a79 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:33:20.400777 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-57dc256a-700b-4bb0-b4ee-9751b38f9a79 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1361 microversion: 2.1 time: 0.152951 Oct 18 16:33:20.401381 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3563/7109] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:33:20 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:33:21.423808 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3bbb33f0-77cd-4f86-bece-f5ae48193235 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:33:21.424428 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3bbb33f0-77cd-4f86-bece-f5ae48193235 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:33:21.431253 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3bbb33f0-77cd-4f86-bece-f5ae48193235 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:21.431730 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3bbb33f0-77cd-4f86-bece-f5ae48193235 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:21.432166 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3bbb33f0-77cd-4f86-bece-f5ae48193235 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:21.432879 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3bbb33f0-77cd-4f86-bece-f5ae48193235 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:21.433336 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3bbb33f0-77cd-4f86-bece-f5ae48193235 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:21.433758 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3bbb33f0-77cd-4f86-bece-f5ae48193235 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:21.563494 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3bbb33f0-77cd-4f86-bece-f5ae48193235 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:33:21.571132 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3bbb33f0-77cd-4f86-bece-f5ae48193235 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1361 microversion: 2.1 time: 0.151290 Oct 18 16:33:21.571708 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3547/7110] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:33:21 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:33:22.594765 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1077d58a-8aec-4ed1-bfa4-5afe39b8a49d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:33:22.595295 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1077d58a-8aec-4ed1-bfa4-5afe39b8a49d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:33:22.602135 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1077d58a-8aec-4ed1-bfa4-5afe39b8a49d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:22.602627 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1077d58a-8aec-4ed1-bfa4-5afe39b8a49d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:22.603071 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1077d58a-8aec-4ed1-bfa4-5afe39b8a49d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:22.603775 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1077d58a-8aec-4ed1-bfa4-5afe39b8a49d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:22.604253 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1077d58a-8aec-4ed1-bfa4-5afe39b8a49d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:22.604687 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1077d58a-8aec-4ed1-bfa4-5afe39b8a49d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:22.738579 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1077d58a-8aec-4ed1-bfa4-5afe39b8a49d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:33:22.746358 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1077d58a-8aec-4ed1-bfa4-5afe39b8a49d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1361 microversion: 2.1 time: 0.156249 Oct 18 16:33:22.746930 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3564/7111] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:33:22 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:33:23.771091 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-58eb809f-93ca-4709-9fff-ba9faf0e0151 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:33:23.771558 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-58eb809f-93ca-4709-9fff-ba9faf0e0151 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:33:23.778234 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58eb809f-93ca-4709-9fff-ba9faf0e0151 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:23.778717 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58eb809f-93ca-4709-9fff-ba9faf0e0151 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:23.779154 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58eb809f-93ca-4709-9fff-ba9faf0e0151 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:23.779852 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58eb809f-93ca-4709-9fff-ba9faf0e0151 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:23.780350 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58eb809f-93ca-4709-9fff-ba9faf0e0151 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:23.780779 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58eb809f-93ca-4709-9fff-ba9faf0e0151 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:23.911856 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-58eb809f-93ca-4709-9fff-ba9faf0e0151 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:33:23.919818 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-58eb809f-93ca-4709-9fff-ba9faf0e0151 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1361 microversion: 2.1 time: 0.152930 Oct 18 16:33:23.920396 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3548/7112] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:33:23 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:33:23.934840 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-64c33dae-0908-4413-912b-9c364c21cbed req-49450779-5678-43cc-a20b-95d7dfdb0f3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fad2592-ecf3-43a2-b1da-91bc7899e785", "name": "network-vif-plugged", "status": "completed", "tag": "bd3875dc-2d65-4595-929c-151d03c0a270"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:33:23.947660 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-64c33dae-0908-4413-912b-9c364c21cbed req-49450779-5678-43cc-a20b-95d7dfdb0f3a service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:23.948094 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-64c33dae-0908-4413-912b-9c364c21cbed req-49450779-5678-43cc-a20b-95d7dfdb0f3a service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:23.948548 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-64c33dae-0908-4413-912b-9c364c21cbed req-49450779-5678-43cc-a20b-95d7dfdb0f3a service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:23.959983 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-64c33dae-0908-4413-912b-9c364c21cbed req-49450779-5678-43cc-a20b-95d7dfdb0f3a service nova] Creating event network-vif-plugged:bd3875dc-2d65-4595-929c-151d03c0a270 for instance 3fad2592-ecf3-43a2-b1da-91bc7899e785 on n-h1-853682-5 Oct 18 16:33:23.966309 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-64c33dae-0908-4413-912b-9c364c21cbed req-49450779-5678-43cc-a20b-95d7dfdb0f3a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035233 Oct 18 16:33:23.966927 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3565/7113] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:33:24.944151 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-81bbe6db-0ac1-4524-9447-c2f57bef5ac3 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:33:24.944759 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-81bbe6db-0ac1-4524-9447-c2f57bef5ac3 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:33:24.951649 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81bbe6db-0ac1-4524-9447-c2f57bef5ac3 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:24.952129 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81bbe6db-0ac1-4524-9447-c2f57bef5ac3 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:24.952557 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81bbe6db-0ac1-4524-9447-c2f57bef5ac3 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:24.953850 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81bbe6db-0ac1-4524-9447-c2f57bef5ac3 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:24.954297 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81bbe6db-0ac1-4524-9447-c2f57bef5ac3 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:24.954747 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81bbe6db-0ac1-4524-9447-c2f57bef5ac3 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:25.085239 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-81bbe6db-0ac1-4524-9447-c2f57bef5ac3 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:33:25.092880 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-81bbe6db-0ac1-4524-9447-c2f57bef5ac3 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1361 microversion: 2.1 time: 0.152658 Oct 18 16:33:25.093450 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3549/7114] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:33:24 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:33:26.114536 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:26.115360 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=6 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:26.119664 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f63fc2ae-1e3d-4629-b187-36aa31650b51 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:33:26.120397 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f63fc2ae-1e3d-4629-b187-36aa31650b51 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:33:26.127616 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f63fc2ae-1e3d-4629-b187-36aa31650b51 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:26.128122 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f63fc2ae-1e3d-4629-b187-36aa31650b51 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:26.128582 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f63fc2ae-1e3d-4629-b187-36aa31650b51 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:26.129323 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f63fc2ae-1e3d-4629-b187-36aa31650b51 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:26.129805 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f63fc2ae-1e3d-4629-b187-36aa31650b51 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:26.130265 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f63fc2ae-1e3d-4629-b187-36aa31650b51 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:26.265027 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f63fc2ae-1e3d-4629-b187-36aa31650b51 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:33:26.273374 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f63fc2ae-1e3d-4629-b187-36aa31650b51 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1548 microversion: 2.1 time: 0.160832 Oct 18 16:33:26.273966 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3566/7115] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:33:26 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1548 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:33:26.297485 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-41695a76-7d0c-42e5-8382-6e11cd8fbc6d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:33:26.298055 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-41695a76-7d0c-42e5-8382-6e11cd8fbc6d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:33:26.300537 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:26.306614 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-41695a76-7d0c-42e5-8382-6e11cd8fbc6d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:26.307278 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-41695a76-7d0c-42e5-8382-6e11cd8fbc6d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:26.307831 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-41695a76-7d0c-42e5-8382-6e11cd8fbc6d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:26.308528 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-41695a76-7d0c-42e5-8382-6e11cd8fbc6d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:26.309014 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-41695a76-7d0c-42e5-8382-6e11cd8fbc6d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:26.309522 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-41695a76-7d0c-42e5-8382-6e11cd8fbc6d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:26.387343 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-41695a76-7d0c-42e5-8382-6e11cd8fbc6d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094680 Oct 18 16:33:26.387978 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3550/7116] 10.222.0.60 () {58 vars in 1275 bytes} [Tue Oct 18 16:33:26 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:33:27.564341 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-61a39a1c-588f-4c94-999b-1b1ef9eaa48e req-485a8e1f-15c1-4eb1-8db8-f4ac4944e589 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fad2592-ecf3-43a2-b1da-91bc7899e785", "tag": "bd3875dc-2d65-4595-929c-151d03c0a270"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:33:27.574957 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-61a39a1c-588f-4c94-999b-1b1ef9eaa48e req-485a8e1f-15c1-4eb1-8db8-f4ac4944e589 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:33:27.575482 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-61a39a1c-588f-4c94-999b-1b1ef9eaa48e req-485a8e1f-15c1-4eb1-8db8-f4ac4944e589 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:33:27.575956 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-61a39a1c-588f-4c94-999b-1b1ef9eaa48e req-485a8e1f-15c1-4eb1-8db8-f4ac4944e589 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:33:27.587071 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-61a39a1c-588f-4c94-999b-1b1ef9eaa48e req-485a8e1f-15c1-4eb1-8db8-f4ac4944e589 service nova] Creating event network-changed:bd3875dc-2d65-4595-929c-151d03c0a270 for instance 3fad2592-ecf3-43a2-b1da-91bc7899e785 on n-h1-853682-5 Oct 18 16:33:27.592612 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-61a39a1c-588f-4c94-999b-1b1ef9eaa48e req-485a8e1f-15c1-4eb1-8db8-f4ac4944e589 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032343 Oct 18 16:33:27.593341 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3567/7117] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:34:30.587623 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:30.588551 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:30.595013 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-050f587e-4b3b-4c19-ae5b-3aa9f9bb0aad tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:34:30.595604 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-050f587e-4b3b-4c19-ae5b-3aa9f9bb0aad tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:34:30.604739 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-050f587e-4b3b-4c19-ae5b-3aa9f9bb0aad tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:30.605256 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-050f587e-4b3b-4c19-ae5b-3aa9f9bb0aad tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:30.605695 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-050f587e-4b3b-4c19-ae5b-3aa9f9bb0aad tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:30.606386 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-050f587e-4b3b-4c19-ae5b-3aa9f9bb0aad tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:30.606845 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-050f587e-4b3b-4c19-ae5b-3aa9f9bb0aad tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:30.607376 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-050f587e-4b3b-4c19-ae5b-3aa9f9bb0aad tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:30.825490 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-050f587e-4b3b-4c19-ae5b-3aa9f9bb0aad tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:30.833274 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-050f587e-4b3b-4c19-ae5b-3aa9f9bb0aad tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1667 microversion: 2.1 time: 0.248245 Oct 18 16:34:30.834489 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3551/7118] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:34:30 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1667 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:34:30.856724 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:30.857463 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=55 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:30.862757 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-47e31682-e6ff-4a7b-8e87-87518ee807f9 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "68920957-bc21-4ddc-8c26-f808dd46c2e9"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:34:30.865220 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-47e31682-e6ff-4a7b-8e87-87518ee807f9 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:34:30.872886 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-47e31682-e6ff-4a7b-8e87-87518ee807f9 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:30.873395 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-47e31682-e6ff-4a7b-8e87-87518ee807f9 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:30.873854 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-47e31682-e6ff-4a7b-8e87-87518ee807f9 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:30.874572 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-47e31682-e6ff-4a7b-8e87-87518ee807f9 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:30.875048 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-47e31682-e6ff-4a7b-8e87-87518ee807f9 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:30.875493 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-47e31682-e6ff-4a7b-8e87-87518ee807f9 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:31.321622 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-47e31682-e6ff-4a7b-8e87-87518ee807f9 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "POST /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.467887 Oct 18 16:34:31.322234 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3568/7119] 10.222.0.60 () {60 vars in 1323 bytes} [Tue Oct 18 16:34:30 2022] POST /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785/os-volume_attachments => generated 194 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:34:42.092488 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5df4e225-094e-4076-b347-21cbe1ba5ef5 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:34:42.094740 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5df4e225-094e-4076-b347-21cbe1ba5ef5 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:34:42.096866 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:42.097532 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:42.103707 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5df4e225-094e-4076-b347-21cbe1ba5ef5 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:42.104187 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5df4e225-094e-4076-b347-21cbe1ba5ef5 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:42.104617 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5df4e225-094e-4076-b347-21cbe1ba5ef5 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:42.105333 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5df4e225-094e-4076-b347-21cbe1ba5ef5 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:42.105783 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5df4e225-094e-4076-b347-21cbe1ba5ef5 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:42.106202 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5df4e225-094e-4076-b347-21cbe1ba5ef5 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:42.134569 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5df4e225-094e-4076-b347-21cbe1ba5ef5 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:42.139911 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5df4e225-094e-4076-b347-21cbe1ba5ef5 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Old instance type m1.heat2, new instance type m1.heat {{(pid=120406) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 18 16:34:42.146854 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-5df4e225-094e-4076-b347-21cbe1ba5ef5 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:34:42.147810 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-5df4e225-094e-4076-b347-21cbe1ba5ef5 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:34:42.148275 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-5df4e225-094e-4076-b347-21cbe1ba5ef5 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:34:42.148676 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-5df4e225-094e-4076-b347-21cbe1ba5ef5 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:34:42.149173 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-5df4e225-094e-4076-b347-21cbe1ba5ef5 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:34:42.212116 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5df4e225-094e-4076-b347-21cbe1ba5ef5 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "POST /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785/action" status: 202 len: 0 microversion: 2.1 time: 0.123677 Oct 18 16:34:42.212725 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3552/7120] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:34:42 2022] POST /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:34:42.221557 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-da0dbab5-03e2-4c83-ae05-f2d808195af4 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:34:42.222448 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-da0dbab5-03e2-4c83-ae05-f2d808195af4 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:34:42.225549 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:42.226245 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:42.233210 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-da0dbab5-03e2-4c83-ae05-f2d808195af4 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:42.233855 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-da0dbab5-03e2-4c83-ae05-f2d808195af4 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:42.234272 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-da0dbab5-03e2-4c83-ae05-f2d808195af4 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:42.235038 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-da0dbab5-03e2-4c83-ae05-f2d808195af4 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:42.235513 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-da0dbab5-03e2-4c83-ae05-f2d808195af4 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:42.235957 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-da0dbab5-03e2-4c83-ae05-f2d808195af4 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:42.400465 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-da0dbab5-03e2-4c83-ae05-f2d808195af4 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:42.409202 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-da0dbab5-03e2-4c83-ae05-f2d808195af4 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1722 microversion: 2.1 time: 0.191890 Oct 18 16:34:42.409778 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3569/7121] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:34:42 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:34:43.434375 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d079e303-d8a1-416b-a209-4db3572f1ecf tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:34:43.434994 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d079e303-d8a1-416b-a209-4db3572f1ecf tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:34:43.442699 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d079e303-d8a1-416b-a209-4db3572f1ecf tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:43.443217 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d079e303-d8a1-416b-a209-4db3572f1ecf tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:43.443631 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d079e303-d8a1-416b-a209-4db3572f1ecf tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:43.444337 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d079e303-d8a1-416b-a209-4db3572f1ecf tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:43.444795 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d079e303-d8a1-416b-a209-4db3572f1ecf tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:43.445250 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d079e303-d8a1-416b-a209-4db3572f1ecf tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:43.677835 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d079e303-d8a1-416b-a209-4db3572f1ecf tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:43.687443 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d079e303-d8a1-416b-a209-4db3572f1ecf tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1722 microversion: 2.1 time: 0.257484 Oct 18 16:34:43.688676 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3553/7122] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:34:43 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1722 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:34:44.711540 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1c31b33d-beb6-48f9-94e6-d5d41511d183 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:34:44.712175 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1c31b33d-beb6-48f9-94e6-d5d41511d183 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:34:44.719004 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1c31b33d-beb6-48f9-94e6-d5d41511d183 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:44.719495 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1c31b33d-beb6-48f9-94e6-d5d41511d183 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:44.719946 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1c31b33d-beb6-48f9-94e6-d5d41511d183 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:44.720678 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1c31b33d-beb6-48f9-94e6-d5d41511d183 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:44.721172 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1c31b33d-beb6-48f9-94e6-d5d41511d183 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:44.721607 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1c31b33d-beb6-48f9-94e6-d5d41511d183 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:44.854300 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1c31b33d-beb6-48f9-94e6-d5d41511d183 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:44.862591 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1c31b33d-beb6-48f9-94e6-d5d41511d183 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1727 microversion: 2.1 time: 0.155708 Oct 18 16:34:44.863168 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3570/7123] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:34:44 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:34:45.886170 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d4c909bc-d973-4f34-932a-186e49959898 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:34:45.886793 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d4c909bc-d973-4f34-932a-186e49959898 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:34:45.893722 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d4c909bc-d973-4f34-932a-186e49959898 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:45.894208 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d4c909bc-d973-4f34-932a-186e49959898 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:45.894643 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d4c909bc-d973-4f34-932a-186e49959898 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:45.895337 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d4c909bc-d973-4f34-932a-186e49959898 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:45.895797 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d4c909bc-d973-4f34-932a-186e49959898 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:45.896223 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d4c909bc-d973-4f34-932a-186e49959898 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:46.034402 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d4c909bc-d973-4f34-932a-186e49959898 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:46.043774 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d4c909bc-d973-4f34-932a-186e49959898 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1727 microversion: 2.1 time: 0.161550 Oct 18 16:34:46.044348 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3554/7124] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:34:45 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:34:47.067102 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-cdc81f29-2b1c-412c-a8cb-7adc0a2c1dce tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:34:47.067765 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-cdc81f29-2b1c-412c-a8cb-7adc0a2c1dce tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:34:47.074673 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cdc81f29-2b1c-412c-a8cb-7adc0a2c1dce tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:47.075168 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cdc81f29-2b1c-412c-a8cb-7adc0a2c1dce tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:47.075620 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cdc81f29-2b1c-412c-a8cb-7adc0a2c1dce tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:47.076329 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cdc81f29-2b1c-412c-a8cb-7adc0a2c1dce tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:47.076800 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cdc81f29-2b1c-412c-a8cb-7adc0a2c1dce tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:47.077271 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cdc81f29-2b1c-412c-a8cb-7adc0a2c1dce tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:47.205039 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-cdc81f29-2b1c-412c-a8cb-7adc0a2c1dce tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:47.213692 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-cdc81f29-2b1c-412c-a8cb-7adc0a2c1dce tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1727 microversion: 2.1 time: 0.150581 Oct 18 16:34:47.214356 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3571/7125] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:34:47 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:34:48.237825 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-abc73172-aff2-4fb0-babf-256f1ba5a60c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:34:48.238433 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-abc73172-aff2-4fb0-babf-256f1ba5a60c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:34:48.245276 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-abc73172-aff2-4fb0-babf-256f1ba5a60c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:48.245833 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-abc73172-aff2-4fb0-babf-256f1ba5a60c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:48.246264 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-abc73172-aff2-4fb0-babf-256f1ba5a60c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:48.246949 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-abc73172-aff2-4fb0-babf-256f1ba5a60c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:48.247400 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-abc73172-aff2-4fb0-babf-256f1ba5a60c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:48.247829 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-abc73172-aff2-4fb0-babf-256f1ba5a60c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:48.379932 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-abc73172-aff2-4fb0-babf-256f1ba5a60c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:48.388908 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-abc73172-aff2-4fb0-babf-256f1ba5a60c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1727 microversion: 2.1 time: 0.154988 Oct 18 16:34:48.389476 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3555/7126] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:34:48 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:34:49.412827 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-39fa8014-224e-4d17-81ec-07ade23c7aa1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:34:49.413539 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-39fa8014-224e-4d17-81ec-07ade23c7aa1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:34:49.421620 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-39fa8014-224e-4d17-81ec-07ade23c7aa1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:49.422124 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-39fa8014-224e-4d17-81ec-07ade23c7aa1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:49.422606 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-39fa8014-224e-4d17-81ec-07ade23c7aa1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:49.423320 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-39fa8014-224e-4d17-81ec-07ade23c7aa1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:49.423790 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-39fa8014-224e-4d17-81ec-07ade23c7aa1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:49.424226 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-39fa8014-224e-4d17-81ec-07ade23c7aa1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:49.555623 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-39fa8014-224e-4d17-81ec-07ade23c7aa1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:49.563798 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-39fa8014-224e-4d17-81ec-07ade23c7aa1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1727 microversion: 2.1 time: 0.154960 Oct 18 16:34:49.564372 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3572/7127] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:34:49 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:34:50.586947 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b5eaa5b9-1255-47e8-999e-2cbab675b008 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:34:50.588117 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b5eaa5b9-1255-47e8-999e-2cbab675b008 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:34:50.594929 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5eaa5b9-1255-47e8-999e-2cbab675b008 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:50.595416 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5eaa5b9-1255-47e8-999e-2cbab675b008 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:50.595851 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5eaa5b9-1255-47e8-999e-2cbab675b008 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:50.596538 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5eaa5b9-1255-47e8-999e-2cbab675b008 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:50.597030 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5eaa5b9-1255-47e8-999e-2cbab675b008 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:50.597456 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5eaa5b9-1255-47e8-999e-2cbab675b008 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:50.731862 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b5eaa5b9-1255-47e8-999e-2cbab675b008 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:50.740617 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b5eaa5b9-1255-47e8-999e-2cbab675b008 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1727 microversion: 2.1 time: 0.157527 Oct 18 16:34:50.741233 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3556/7128] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:34:50 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:34:51.765581 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ab5a4e1e-0802-49ea-9e1d-2669cd9537aa tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:34:51.766219 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ab5a4e1e-0802-49ea-9e1d-2669cd9537aa tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:34:51.773077 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ab5a4e1e-0802-49ea-9e1d-2669cd9537aa tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:51.773580 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ab5a4e1e-0802-49ea-9e1d-2669cd9537aa tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:51.774036 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ab5a4e1e-0802-49ea-9e1d-2669cd9537aa tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:51.774745 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ab5a4e1e-0802-49ea-9e1d-2669cd9537aa tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:51.775220 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ab5a4e1e-0802-49ea-9e1d-2669cd9537aa tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:51.775668 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ab5a4e1e-0802-49ea-9e1d-2669cd9537aa tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:51.905009 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ab5a4e1e-0802-49ea-9e1d-2669cd9537aa tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:51.913283 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ab5a4e1e-0802-49ea-9e1d-2669cd9537aa tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1727 microversion: 2.1 time: 0.151666 Oct 18 16:34:51.913862 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3573/7129] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:34:51 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:34:52.937444 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-61b32ea6-afc2-4d57-a249-ee4c03bf5aa7 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:34:52.938060 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-61b32ea6-afc2-4d57-a249-ee4c03bf5aa7 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:34:52.945441 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-61b32ea6-afc2-4d57-a249-ee4c03bf5aa7 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:52.945867 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-61b32ea6-afc2-4d57-a249-ee4c03bf5aa7 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:52.946303 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-61b32ea6-afc2-4d57-a249-ee4c03bf5aa7 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:52.947481 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-61b32ea6-afc2-4d57-a249-ee4c03bf5aa7 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:52.947949 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-61b32ea6-afc2-4d57-a249-ee4c03bf5aa7 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:52.948375 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-61b32ea6-afc2-4d57-a249-ee4c03bf5aa7 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:53.077565 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-61b32ea6-afc2-4d57-a249-ee4c03bf5aa7 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:53.085886 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-61b32ea6-afc2-4d57-a249-ee4c03bf5aa7 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1727 microversion: 2.1 time: 0.152321 Oct 18 16:34:53.086461 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3557/7130] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:34:52 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:34:54.109699 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2d6cc661-58d7-40ae-ae52-a7567d037010 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:34:54.110345 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2d6cc661-58d7-40ae-ae52-a7567d037010 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:34:54.117348 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d6cc661-58d7-40ae-ae52-a7567d037010 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:54.117852 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d6cc661-58d7-40ae-ae52-a7567d037010 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:54.118311 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d6cc661-58d7-40ae-ae52-a7567d037010 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:54.119539 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d6cc661-58d7-40ae-ae52-a7567d037010 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:54.120013 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d6cc661-58d7-40ae-ae52-a7567d037010 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:54.120463 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d6cc661-58d7-40ae-ae52-a7567d037010 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:54.253572 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2d6cc661-58d7-40ae-ae52-a7567d037010 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:54.262453 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2d6cc661-58d7-40ae-ae52-a7567d037010 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1727 microversion: 2.1 time: 0.156734 Oct 18 16:34:54.263031 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3574/7131] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:34:54 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:34:55.285786 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4d265d40-7314-451d-a8ff-6f66f6c95847 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:34:55.286400 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4d265d40-7314-451d-a8ff-6f66f6c95847 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:34:55.293983 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d265d40-7314-451d-a8ff-6f66f6c95847 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:55.294472 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d265d40-7314-451d-a8ff-6f66f6c95847 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:55.295246 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d265d40-7314-451d-a8ff-6f66f6c95847 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:55.296440 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d265d40-7314-451d-a8ff-6f66f6c95847 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:55.297239 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d265d40-7314-451d-a8ff-6f66f6c95847 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:55.298669 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d265d40-7314-451d-a8ff-6f66f6c95847 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:55.437511 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4d265d40-7314-451d-a8ff-6f66f6c95847 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:55.445928 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4d265d40-7314-451d-a8ff-6f66f6c95847 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1727 microversion: 2.1 time: 0.164197 Oct 18 16:34:55.446507 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3558/7132] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:34:55 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:34:56.469972 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d1c4a645-2e74-4a53-b8d2-f8e8c3a379f3 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:34:56.470607 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d1c4a645-2e74-4a53-b8d2-f8e8c3a379f3 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:34:56.477569 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d1c4a645-2e74-4a53-b8d2-f8e8c3a379f3 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:56.478067 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d1c4a645-2e74-4a53-b8d2-f8e8c3a379f3 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:56.479094 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d1c4a645-2e74-4a53-b8d2-f8e8c3a379f3 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:56.479798 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d1c4a645-2e74-4a53-b8d2-f8e8c3a379f3 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:56.480271 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d1c4a645-2e74-4a53-b8d2-f8e8c3a379f3 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:56.480713 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d1c4a645-2e74-4a53-b8d2-f8e8c3a379f3 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:56.613713 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d1c4a645-2e74-4a53-b8d2-f8e8c3a379f3 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:56.622567 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d1c4a645-2e74-4a53-b8d2-f8e8c3a379f3 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1727 microversion: 2.1 time: 0.156645 Oct 18 16:34:56.623144 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3575/7133] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:34:56 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:34:57.646793 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-509bf803-289d-441f-84bf-5c94368b5e56 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:34:57.647382 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-509bf803-289d-441f-84bf-5c94368b5e56 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:34:57.654714 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-509bf803-289d-441f-84bf-5c94368b5e56 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:57.655194 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-509bf803-289d-441f-84bf-5c94368b5e56 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:57.655630 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-509bf803-289d-441f-84bf-5c94368b5e56 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:57.656320 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-509bf803-289d-441f-84bf-5c94368b5e56 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:57.656775 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-509bf803-289d-441f-84bf-5c94368b5e56 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:57.657229 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-509bf803-289d-441f-84bf-5c94368b5e56 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:57.789175 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-509bf803-289d-441f-84bf-5c94368b5e56 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:57.798273 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-509bf803-289d-441f-84bf-5c94368b5e56 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1727 microversion: 2.1 time: 0.155481 Oct 18 16:34:57.798859 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3559/7134] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:34:57 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:34:58.821332 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2d2fa84f-8ae7-44e7-b281-233ae8266b14 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:34:58.821985 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2d2fa84f-8ae7-44e7-b281-233ae8266b14 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:34:58.829001 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d2fa84f-8ae7-44e7-b281-233ae8266b14 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:58.829509 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d2fa84f-8ae7-44e7-b281-233ae8266b14 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:58.829969 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d2fa84f-8ae7-44e7-b281-233ae8266b14 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:58.830700 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d2fa84f-8ae7-44e7-b281-233ae8266b14 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:34:58.831180 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d2fa84f-8ae7-44e7-b281-233ae8266b14 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:34:58.831625 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d2fa84f-8ae7-44e7-b281-233ae8266b14 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:34:58.963084 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2d2fa84f-8ae7-44e7-b281-233ae8266b14 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:34:58.971576 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2d2fa84f-8ae7-44e7-b281-233ae8266b14 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1727 microversion: 2.1 time: 0.154238 Oct 18 16:34:58.972155 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3576/7135] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:34:58 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:34:59.995623 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4ddd0fac-5d51-4629-b981-ceab9c8b56c0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:34:59.996281 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4ddd0fac-5d51-4629-b981-ceab9c8b56c0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:00.003208 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ddd0fac-5d51-4629-b981-ceab9c8b56c0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:00.003687 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ddd0fac-5d51-4629-b981-ceab9c8b56c0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:00.004117 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ddd0fac-5d51-4629-b981-ceab9c8b56c0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:00.004801 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ddd0fac-5d51-4629-b981-ceab9c8b56c0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:00.005275 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ddd0fac-5d51-4629-b981-ceab9c8b56c0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:00.005696 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ddd0fac-5d51-4629-b981-ceab9c8b56c0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:00.140417 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4ddd0fac-5d51-4629-b981-ceab9c8b56c0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:00.148735 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4ddd0fac-5d51-4629-b981-ceab9c8b56c0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1727 microversion: 2.1 time: 0.157170 Oct 18 16:35:00.149333 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3560/7136] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:34:59 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:35:01.171883 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8e163c85-4fe6-4e85-be35-4da6c91604f2 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:01.172502 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8e163c85-4fe6-4e85-be35-4da6c91604f2 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:01.179425 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8e163c85-4fe6-4e85-be35-4da6c91604f2 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:01.179927 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8e163c85-4fe6-4e85-be35-4da6c91604f2 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:01.180399 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8e163c85-4fe6-4e85-be35-4da6c91604f2 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:01.181144 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8e163c85-4fe6-4e85-be35-4da6c91604f2 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:01.181626 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8e163c85-4fe6-4e85-be35-4da6c91604f2 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:01.182069 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8e163c85-4fe6-4e85-be35-4da6c91604f2 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:01.313296 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8e163c85-4fe6-4e85-be35-4da6c91604f2 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:01.321653 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8e163c85-4fe6-4e85-be35-4da6c91604f2 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1727 microversion: 2.1 time: 0.153746 Oct 18 16:35:01.322265 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3577/7137] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:35:01 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:35:02.344933 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a14f690c-eab0-418c-b04d-e7e3e7508fc8 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:02.345577 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a14f690c-eab0-418c-b04d-e7e3e7508fc8 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:02.352681 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a14f690c-eab0-418c-b04d-e7e3e7508fc8 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:02.353206 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a14f690c-eab0-418c-b04d-e7e3e7508fc8 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:02.353643 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a14f690c-eab0-418c-b04d-e7e3e7508fc8 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:02.354353 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a14f690c-eab0-418c-b04d-e7e3e7508fc8 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:02.354811 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a14f690c-eab0-418c-b04d-e7e3e7508fc8 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:02.355242 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a14f690c-eab0-418c-b04d-e7e3e7508fc8 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:02.490181 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a14f690c-eab0-418c-b04d-e7e3e7508fc8 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:02.499097 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a14f690c-eab0-418c-b04d-e7e3e7508fc8 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1727 microversion: 2.1 time: 0.158118 Oct 18 16:35:02.499681 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3561/7138] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:35:02 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:35:03.523441 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b362e3ea-7259-4aba-a07b-2b88b4eacdf8 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:03.524085 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b362e3ea-7259-4aba-a07b-2b88b4eacdf8 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:03.531168 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b362e3ea-7259-4aba-a07b-2b88b4eacdf8 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:03.531674 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b362e3ea-7259-4aba-a07b-2b88b4eacdf8 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:03.532133 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b362e3ea-7259-4aba-a07b-2b88b4eacdf8 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:03.532885 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b362e3ea-7259-4aba-a07b-2b88b4eacdf8 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:03.533365 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b362e3ea-7259-4aba-a07b-2b88b4eacdf8 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:03.533814 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b362e3ea-7259-4aba-a07b-2b88b4eacdf8 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:03.674532 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b362e3ea-7259-4aba-a07b-2b88b4eacdf8 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:03.683254 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b362e3ea-7259-4aba-a07b-2b88b4eacdf8 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1726 microversion: 2.1 time: 0.163748 Oct 18 16:35:03.684061 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3578/7139] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:35:03 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:35:03.897162 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-21528bc9-d529-4aaa-b106-8dc8b474a264 req-6a611ddc-1958-4437-99e9-695594a9f8cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fad2592-ecf3-43a2-b1da-91bc7899e785", "name": "network-vif-unplugged", "status": "completed", "tag": "bd3875dc-2d65-4595-929c-151d03c0a270"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:35:03.907215 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-21528bc9-d529-4aaa-b106-8dc8b474a264 req-6a611ddc-1958-4437-99e9-695594a9f8cf service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:03.907813 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-21528bc9-d529-4aaa-b106-8dc8b474a264 req-6a611ddc-1958-4437-99e9-695594a9f8cf service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:03.908218 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-21528bc9-d529-4aaa-b106-8dc8b474a264 req-6a611ddc-1958-4437-99e9-695594a9f8cf service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:03.922377 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-21528bc9-d529-4aaa-b106-8dc8b474a264 req-6a611ddc-1958-4437-99e9-695594a9f8cf service nova] Creating event network-vif-unplugged:bd3875dc-2d65-4595-929c-151d03c0a270 for instance 3fad2592-ecf3-43a2-b1da-91bc7899e785 on n-h2-853682-5 Oct 18 16:35:03.927689 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [req-21528bc9-d529-4aaa-b106-8dc8b474a264 req-6a611ddc-1958-4437-99e9-695594a9f8cf service nova] Instance 3fad2592-ecf3-43a2-b1da-91bc7899e785 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853682-5', 'n-h1-853682-5'} {{(pid=120406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 18 16:35:03.939402 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-21528bc9-d529-4aaa-b106-8dc8b474a264 req-6a611ddc-1958-4437-99e9-695594a9f8cf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100262 Oct 18 16:35:03.940185 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3562/7140] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:35:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:35:04.707171 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7c4888dc-da21-40c3-8d70-1998cc0d108d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:04.707804 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7c4888dc-da21-40c3-8d70-1998cc0d108d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:04.714958 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7c4888dc-da21-40c3-8d70-1998cc0d108d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:04.715456 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7c4888dc-da21-40c3-8d70-1998cc0d108d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:04.715909 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7c4888dc-da21-40c3-8d70-1998cc0d108d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:04.716617 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7c4888dc-da21-40c3-8d70-1998cc0d108d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:04.717115 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7c4888dc-da21-40c3-8d70-1998cc0d108d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:04.717557 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7c4888dc-da21-40c3-8d70-1998cc0d108d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:04.852009 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7c4888dc-da21-40c3-8d70-1998cc0d108d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:04.860923 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7c4888dc-da21-40c3-8d70-1998cc0d108d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1726 microversion: 2.1 time: 0.158117 Oct 18 16:35:04.861501 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3579/7141] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:35:04 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:35:05.886459 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-386e16f7-6469-4e4e-9545-4aced12bb01d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:05.887156 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-386e16f7-6469-4e4e-9545-4aced12bb01d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:05.893401 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-386e16f7-6469-4e4e-9545-4aced12bb01d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:05.893891 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-386e16f7-6469-4e4e-9545-4aced12bb01d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:05.894335 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-386e16f7-6469-4e4e-9545-4aced12bb01d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:05.895045 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-386e16f7-6469-4e4e-9545-4aced12bb01d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:05.895505 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-386e16f7-6469-4e4e-9545-4aced12bb01d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:05.895938 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-386e16f7-6469-4e4e-9545-4aced12bb01d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:05.958318 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-cb415b69-646a-4c2d-8293-38509d6db66f req-8325d281-e359-489c-95de-eef276eb916d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fad2592-ecf3-43a2-b1da-91bc7899e785", "tag": "bd3875dc-2d65-4595-929c-151d03c0a270"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:35:05.970234 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-cb415b69-646a-4c2d-8293-38509d6db66f req-8325d281-e359-489c-95de-eef276eb916d service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:05.970878 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-cb415b69-646a-4c2d-8293-38509d6db66f req-8325d281-e359-489c-95de-eef276eb916d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:05.971595 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-cb415b69-646a-4c2d-8293-38509d6db66f req-8325d281-e359-489c-95de-eef276eb916d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:05.986472 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-cb415b69-646a-4c2d-8293-38509d6db66f req-8325d281-e359-489c-95de-eef276eb916d service nova] Creating event network-changed:bd3875dc-2d65-4595-929c-151d03c0a270 for instance 3fad2592-ecf3-43a2-b1da-91bc7899e785 on n-h2-853682-5 Oct 18 16:35:05.993368 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [req-cb415b69-646a-4c2d-8293-38509d6db66f req-8325d281-e359-489c-95de-eef276eb916d service nova] Instance 3fad2592-ecf3-43a2-b1da-91bc7899e785 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853682-5', 'n-h1-853682-5'} {{(pid=120405) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 18 16:35:06.005817 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-cb415b69-646a-4c2d-8293-38509d6db66f req-8325d281-e359-489c-95de-eef276eb916d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051384 Oct 18 16:35:06.006877 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3580/7142] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:35:06.052492 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-386e16f7-6469-4e4e-9545-4aced12bb01d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:06.062672 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-386e16f7-6469-4e4e-9545-4aced12bb01d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1724 microversion: 2.1 time: 0.181808 Oct 18 16:35:06.063514 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3563/7143] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:35:05 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:35:07.089076 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6495eef3-614d-45e1-b5fd-e6e5b5874652 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:07.089803 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6495eef3-614d-45e1-b5fd-e6e5b5874652 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:07.096226 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6495eef3-614d-45e1-b5fd-e6e5b5874652 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:07.096728 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6495eef3-614d-45e1-b5fd-e6e5b5874652 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:07.097210 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6495eef3-614d-45e1-b5fd-e6e5b5874652 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:07.097926 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6495eef3-614d-45e1-b5fd-e6e5b5874652 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:07.098401 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6495eef3-614d-45e1-b5fd-e6e5b5874652 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:07.098849 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6495eef3-614d-45e1-b5fd-e6e5b5874652 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:07.240526 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6495eef3-614d-45e1-b5fd-e6e5b5874652 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:07.249825 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6495eef3-614d-45e1-b5fd-e6e5b5874652 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1724 microversion: 2.1 time: 0.165987 Oct 18 16:35:07.250410 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3581/7144] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:35:07 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:35:08.273378 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a171b293-c806-49de-ac06-9f559cc5d799 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:08.274000 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a171b293-c806-49de-ac06-9f559cc5d799 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:08.280510 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a171b293-c806-49de-ac06-9f559cc5d799 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:08.281037 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a171b293-c806-49de-ac06-9f559cc5d799 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:08.281481 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a171b293-c806-49de-ac06-9f559cc5d799 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:08.282187 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a171b293-c806-49de-ac06-9f559cc5d799 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:08.282649 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a171b293-c806-49de-ac06-9f559cc5d799 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:08.283082 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a171b293-c806-49de-ac06-9f559cc5d799 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:08.414624 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a171b293-c806-49de-ac06-9f559cc5d799 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:08.423436 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a171b293-c806-49de-ac06-9f559cc5d799 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1724 microversion: 2.1 time: 0.154184 Oct 18 16:35:08.424024 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3564/7145] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:35:08 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:35:09.447641 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e3bcdcab-46d5-4d84-91ae-ee66eacaff62 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:09.448389 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e3bcdcab-46d5-4d84-91ae-ee66eacaff62 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:09.455623 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e3bcdcab-46d5-4d84-91ae-ee66eacaff62 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:09.456127 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e3bcdcab-46d5-4d84-91ae-ee66eacaff62 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:09.456616 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e3bcdcab-46d5-4d84-91ae-ee66eacaff62 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:09.457397 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e3bcdcab-46d5-4d84-91ae-ee66eacaff62 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:09.457867 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e3bcdcab-46d5-4d84-91ae-ee66eacaff62 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:09.458312 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e3bcdcab-46d5-4d84-91ae-ee66eacaff62 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:09.593643 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e3bcdcab-46d5-4d84-91ae-ee66eacaff62 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:09.602108 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e3bcdcab-46d5-4d84-91ae-ee66eacaff62 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1724 microversion: 2.1 time: 0.158502 Oct 18 16:35:09.618459 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3582/7146] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:35:09 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:35:10.627285 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-115d76e1-3264-4480-8601-bdb124a2b013 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:10.627898 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-115d76e1-3264-4480-8601-bdb124a2b013 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:10.635421 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-115d76e1-3264-4480-8601-bdb124a2b013 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:10.635901 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-115d76e1-3264-4480-8601-bdb124a2b013 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:10.636332 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-115d76e1-3264-4480-8601-bdb124a2b013 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:10.637055 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-115d76e1-3264-4480-8601-bdb124a2b013 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:10.637510 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-115d76e1-3264-4480-8601-bdb124a2b013 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:10.637933 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-115d76e1-3264-4480-8601-bdb124a2b013 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:10.767967 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-115d76e1-3264-4480-8601-bdb124a2b013 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:10.776230 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-115d76e1-3264-4480-8601-bdb124a2b013 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1724 microversion: 2.1 time: 0.152931 Oct 18 16:35:10.776801 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3565/7147] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:35:10 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:35:11.800872 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c869fe66-c107-44bf-899e-a400c76466a7 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:11.801664 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c869fe66-c107-44bf-899e-a400c76466a7 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:11.808372 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c869fe66-c107-44bf-899e-a400c76466a7 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:11.808889 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c869fe66-c107-44bf-899e-a400c76466a7 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:11.809349 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c869fe66-c107-44bf-899e-a400c76466a7 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:11.810057 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c869fe66-c107-44bf-899e-a400c76466a7 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:11.810513 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c869fe66-c107-44bf-899e-a400c76466a7 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:11.810982 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c869fe66-c107-44bf-899e-a400c76466a7 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:11.942257 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c869fe66-c107-44bf-899e-a400c76466a7 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:11.951206 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c869fe66-c107-44bf-899e-a400c76466a7 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1724 microversion: 2.1 time: 0.154336 Oct 18 16:35:11.951704 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3583/7148] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:35:11 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:35:12.975232 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c0697a5b-4d91-4b8e-9a0d-223cd9d8ab05 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:12.975779 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c0697a5b-4d91-4b8e-9a0d-223cd9d8ab05 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:12.979256 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=33 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:35:12.984516 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0697a5b-4d91-4b8e-9a0d-223cd9d8ab05 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:12.985049 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0697a5b-4d91-4b8e-9a0d-223cd9d8ab05 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:12.985492 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0697a5b-4d91-4b8e-9a0d-223cd9d8ab05 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:12.986197 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0697a5b-4d91-4b8e-9a0d-223cd9d8ab05 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:12.986657 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0697a5b-4d91-4b8e-9a0d-223cd9d8ab05 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:12.987084 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0697a5b-4d91-4b8e-9a0d-223cd9d8ab05 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:12.991329 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:35:13.129767 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c0697a5b-4d91-4b8e-9a0d-223cd9d8ab05 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:13.138586 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c0697a5b-4d91-4b8e-9a0d-223cd9d8ab05 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1724 microversion: 2.1 time: 0.167338 Oct 18 16:35:13.139522 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3566/7149] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:35:12 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:35:14.162769 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-add03cce-abbc-4920-b745-db654b9b7da0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:14.163409 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-add03cce-abbc-4920-b745-db654b9b7da0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:14.166503 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=31 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:35:14.172056 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-add03cce-abbc-4920-b745-db654b9b7da0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:14.172553 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-add03cce-abbc-4920-b745-db654b9b7da0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:14.173056 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-add03cce-abbc-4920-b745-db654b9b7da0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:14.173784 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-add03cce-abbc-4920-b745-db654b9b7da0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:14.174265 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-add03cce-abbc-4920-b745-db654b9b7da0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:14.174713 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-add03cce-abbc-4920-b745-db654b9b7da0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:14.178966 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=89 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:35:14.313311 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-add03cce-abbc-4920-b745-db654b9b7da0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:14.322450 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-add03cce-abbc-4920-b745-db654b9b7da0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1724 microversion: 2.1 time: 0.163188 Oct 18 16:35:14.323033 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3584/7150] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:35:14 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:35:15.345344 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-828dbac4-d480-48ad-899b-8b0b673c7bff tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:15.345948 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-828dbac4-d480-48ad-899b-8b0b673c7bff tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:15.353363 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-828dbac4-d480-48ad-899b-8b0b673c7bff tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:15.353840 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-828dbac4-d480-48ad-899b-8b0b673c7bff tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:15.354272 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-828dbac4-d480-48ad-899b-8b0b673c7bff tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:15.354957 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-828dbac4-d480-48ad-899b-8b0b673c7bff tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:15.355408 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-828dbac4-d480-48ad-899b-8b0b673c7bff tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:15.355827 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-828dbac4-d480-48ad-899b-8b0b673c7bff tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:15.489250 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-828dbac4-d480-48ad-899b-8b0b673c7bff tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:15.498367 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-828dbac4-d480-48ad-899b-8b0b673c7bff tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1724 microversion: 2.1 time: 0.157086 Oct 18 16:35:15.498865 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3567/7151] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:35:15 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:35:16.521826 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0174eee3-529f-48c6-9625-9e48669836c9 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:16.522372 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0174eee3-529f-48c6-9625-9e48669836c9 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:16.529474 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0174eee3-529f-48c6-9625-9e48669836c9 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:16.529973 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0174eee3-529f-48c6-9625-9e48669836c9 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:16.530424 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0174eee3-529f-48c6-9625-9e48669836c9 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:16.531134 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0174eee3-529f-48c6-9625-9e48669836c9 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:16.531611 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0174eee3-529f-48c6-9625-9e48669836c9 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:16.532057 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0174eee3-529f-48c6-9625-9e48669836c9 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:16.670530 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0174eee3-529f-48c6-9625-9e48669836c9 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:16.684589 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0174eee3-529f-48c6-9625-9e48669836c9 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1724 microversion: 2.1 time: 0.161650 Oct 18 16:35:16.684589 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3585/7152] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:35:16 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:35:17.703698 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-85826614-354d-47f8-820a-ee09a3841f1a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:17.704350 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-85826614-354d-47f8-820a-ee09a3841f1a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:17.711177 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85826614-354d-47f8-820a-ee09a3841f1a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:17.711661 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85826614-354d-47f8-820a-ee09a3841f1a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:17.712132 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85826614-354d-47f8-820a-ee09a3841f1a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:17.712840 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85826614-354d-47f8-820a-ee09a3841f1a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:17.713318 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85826614-354d-47f8-820a-ee09a3841f1a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:17.713805 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85826614-354d-47f8-820a-ee09a3841f1a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:17.845542 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-85826614-354d-47f8-820a-ee09a3841f1a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:17.854436 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-85826614-354d-47f8-820a-ee09a3841f1a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1721 microversion: 2.1 time: 0.154630 Oct 18 16:35:17.855009 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3568/7153] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:35:17 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:35:17.877388 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-be5487eb-ac49-4cad-a3da-9ba3d84b1ffb tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:35:17.877941 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-be5487eb-ac49-4cad-a3da-9ba3d84b1ffb tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:17.884693 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-be5487eb-ac49-4cad-a3da-9ba3d84b1ffb tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:17.885339 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-be5487eb-ac49-4cad-a3da-9ba3d84b1ffb tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:17.885682 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-be5487eb-ac49-4cad-a3da-9ba3d84b1ffb tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:17.886383 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-be5487eb-ac49-4cad-a3da-9ba3d84b1ffb tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:17.886853 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-be5487eb-ac49-4cad-a3da-9ba3d84b1ffb tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:17.887291 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-be5487eb-ac49-4cad-a3da-9ba3d84b1ffb tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:17.925686 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-be5487eb-ac49-4cad-a3da-9ba3d84b1ffb tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:17.926185 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-be5487eb-ac49-4cad-a3da-9ba3d84b1ffb tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:17.926636 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-be5487eb-ac49-4cad-a3da-9ba3d84b1ffb tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:17.927382 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-be5487eb-ac49-4cad-a3da-9ba3d84b1ffb tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:17.927856 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-be5487eb-ac49-4cad-a3da-9ba3d84b1ffb tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:17.928295 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-be5487eb-ac49-4cad-a3da-9ba3d84b1ffb tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:17.948766 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-be5487eb-ac49-4cad-a3da-9ba3d84b1ffb tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Getting quotas for project f872c1ec84314318ac67bfbe7d186b2c. Resources: {'cores', 'ram'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:35:17.953916 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-be5487eb-ac49-4cad-a3da-9ba3d84b1ffb tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Getting quotas for user 92c26a3ccef246d6bb58d7d834f71106 and project f872c1ec84314318ac67bfbe7d186b2c. Resources: {'cores', 'ram'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:35:18.058746 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-be5487eb-ac49-4cad-a3da-9ba3d84b1ffb tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "POST /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785/action" status: 202 len: 0 microversion: 2.1 time: 0.185231 Oct 18 16:35:18.059632 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3586/7154] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:35:17 2022] POST /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:35:18.067497 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-acfae2e2-2e10-4a3e-89ba-7079396026e1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:18.068109 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-acfae2e2-2e10-4a3e-89ba-7079396026e1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:18.074274 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-acfae2e2-2e10-4a3e-89ba-7079396026e1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:18.074775 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-acfae2e2-2e10-4a3e-89ba-7079396026e1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:18.075400 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-acfae2e2-2e10-4a3e-89ba-7079396026e1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:18.076418 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-acfae2e2-2e10-4a3e-89ba-7079396026e1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:18.077009 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-acfae2e2-2e10-4a3e-89ba-7079396026e1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:18.077483 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-acfae2e2-2e10-4a3e-89ba-7079396026e1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:18.221275 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-acfae2e2-2e10-4a3e-89ba-7079396026e1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:18.230530 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-acfae2e2-2e10-4a3e-89ba-7079396026e1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1720 microversion: 2.1 time: 0.166872 Oct 18 16:35:18.231183 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3569/7155] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:35:18 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1720 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:35:19.255674 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-99a43052-9d6a-4a9b-bd8c-cda2e323a297 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:19.256387 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-99a43052-9d6a-4a9b-bd8c-cda2e323a297 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:19.263410 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-99a43052-9d6a-4a9b-bd8c-cda2e323a297 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:19.263909 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-99a43052-9d6a-4a9b-bd8c-cda2e323a297 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:19.264398 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-99a43052-9d6a-4a9b-bd8c-cda2e323a297 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:19.265140 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-99a43052-9d6a-4a9b-bd8c-cda2e323a297 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:19.265609 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-99a43052-9d6a-4a9b-bd8c-cda2e323a297 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:19.266047 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-99a43052-9d6a-4a9b-bd8c-cda2e323a297 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:19.399057 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-99a43052-9d6a-4a9b-bd8c-cda2e323a297 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:19.408102 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-99a43052-9d6a-4a9b-bd8c-cda2e323a297 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1720 microversion: 2.1 time: 0.157560 Oct 18 16:35:19.408677 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3587/7156] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:35:19 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:35:20.154682 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-5cd87316-b2b4-49b1-a084-e5a5011e06d5 req-5c332b63-5278-4fe8-a132-f591b8947f88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fad2592-ecf3-43a2-b1da-91bc7899e785", "name": "network-vif-plugged", "status": "completed", "tag": "bd3875dc-2d65-4595-929c-151d03c0a270"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:35:20.165019 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5cd87316-b2b4-49b1-a084-e5a5011e06d5 req-5c332b63-5278-4fe8-a132-f591b8947f88 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:20.165852 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5cd87316-b2b4-49b1-a084-e5a5011e06d5 req-5c332b63-5278-4fe8-a132-f591b8947f88 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:20.166558 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5cd87316-b2b4-49b1-a084-e5a5011e06d5 req-5c332b63-5278-4fe8-a132-f591b8947f88 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:20.178398 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-5cd87316-b2b4-49b1-a084-e5a5011e06d5 req-5c332b63-5278-4fe8-a132-f591b8947f88 service nova] Creating event network-vif-plugged:bd3875dc-2d65-4595-929c-151d03c0a270 for instance 3fad2592-ecf3-43a2-b1da-91bc7899e785 on n-h2-853682-5 Oct 18 16:35:20.184097 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [req-5cd87316-b2b4-49b1-a084-e5a5011e06d5 req-5c332b63-5278-4fe8-a132-f591b8947f88 service nova] Instance 3fad2592-ecf3-43a2-b1da-91bc7899e785 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853682-5', 'n-h1-853682-5'} {{(pid=120406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 18 16:35:20.195312 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-5cd87316-b2b4-49b1-a084-e5a5011e06d5 req-5c332b63-5278-4fe8-a132-f591b8947f88 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099259 Oct 18 16:35:20.195916 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3570/7157] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:35:20.433473 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8a1c1865-e6fd-4fc8-84db-bad4828aeb7a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:20.434133 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8a1c1865-e6fd-4fc8-84db-bad4828aeb7a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:20.441522 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8a1c1865-e6fd-4fc8-84db-bad4828aeb7a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:20.442031 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8a1c1865-e6fd-4fc8-84db-bad4828aeb7a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:20.442492 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8a1c1865-e6fd-4fc8-84db-bad4828aeb7a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:20.443211 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8a1c1865-e6fd-4fc8-84db-bad4828aeb7a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:20.443684 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8a1c1865-e6fd-4fc8-84db-bad4828aeb7a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:20.444128 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8a1c1865-e6fd-4fc8-84db-bad4828aeb7a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:20.584497 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8a1c1865-e6fd-4fc8-84db-bad4828aeb7a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:20.593459 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8a1c1865-e6fd-4fc8-84db-bad4828aeb7a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1720 microversion: 2.1 time: 0.164576 Oct 18 16:35:20.594040 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3588/7158] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:35:20 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1720 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:35:21.618628 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d03adad9-2464-4c2f-b8fa-0e263a275a5c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:21.619905 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d03adad9-2464-4c2f-b8fa-0e263a275a5c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:21.626119 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d03adad9-2464-4c2f-b8fa-0e263a275a5c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:21.626599 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d03adad9-2464-4c2f-b8fa-0e263a275a5c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:21.627027 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d03adad9-2464-4c2f-b8fa-0e263a275a5c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:21.627712 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d03adad9-2464-4c2f-b8fa-0e263a275a5c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:21.628161 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d03adad9-2464-4c2f-b8fa-0e263a275a5c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:21.628584 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d03adad9-2464-4c2f-b8fa-0e263a275a5c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:21.759825 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d03adad9-2464-4c2f-b8fa-0e263a275a5c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:21.768238 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d03adad9-2464-4c2f-b8fa-0e263a275a5c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1720 microversion: 2.1 time: 0.154746 Oct 18 16:35:21.768830 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3571/7159] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:35:21 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:35:22.792441 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5c81cdd9-2d58-4724-978a-f9831f57a29e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:22.793104 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5c81cdd9-2d58-4724-978a-f9831f57a29e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:22.800011 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5c81cdd9-2d58-4724-978a-f9831f57a29e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:22.800513 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5c81cdd9-2d58-4724-978a-f9831f57a29e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:22.801179 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5c81cdd9-2d58-4724-978a-f9831f57a29e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:22.801928 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5c81cdd9-2d58-4724-978a-f9831f57a29e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:22.802406 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5c81cdd9-2d58-4724-978a-f9831f57a29e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:22.802849 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5c81cdd9-2d58-4724-978a-f9831f57a29e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:22.996083 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5c81cdd9-2d58-4724-978a-f9831f57a29e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:23.005167 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5c81cdd9-2d58-4724-978a-f9831f57a29e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1720 microversion: 2.1 time: 0.217476 Oct 18 16:35:23.005762 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3589/7160] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:35:22 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1720 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:35:23.569817 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-5f8ea9ac-49a3-47f4-9ece-c121fde0288d req-626f9fcd-bb69-485a-af73-3317cbdd5585 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fad2592-ecf3-43a2-b1da-91bc7899e785", "name": "network-vif-unplugged", "status": "completed", "tag": "bd3875dc-2d65-4595-929c-151d03c0a270"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:35:23.579910 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5f8ea9ac-49a3-47f4-9ece-c121fde0288d req-626f9fcd-bb69-485a-af73-3317cbdd5585 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:23.580621 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5f8ea9ac-49a3-47f4-9ece-c121fde0288d req-626f9fcd-bb69-485a-af73-3317cbdd5585 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:23.581085 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5f8ea9ac-49a3-47f4-9ece-c121fde0288d req-626f9fcd-bb69-485a-af73-3317cbdd5585 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:23.592964 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-5f8ea9ac-49a3-47f4-9ece-c121fde0288d req-626f9fcd-bb69-485a-af73-3317cbdd5585 service nova] Creating event network-vif-unplugged:bd3875dc-2d65-4595-929c-151d03c0a270 for instance 3fad2592-ecf3-43a2-b1da-91bc7899e785 on n-h1-853682-5 Oct 18 16:35:23.598288 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [req-5f8ea9ac-49a3-47f4-9ece-c121fde0288d req-626f9fcd-bb69-485a-af73-3317cbdd5585 service nova] Instance 3fad2592-ecf3-43a2-b1da-91bc7899e785 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853682-5', 'n-h1-853682-5'} {{(pid=120406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 18 16:35:23.609730 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-5f8ea9ac-49a3-47f4-9ece-c121fde0288d req-626f9fcd-bb69-485a-af73-3317cbdd5585 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096393 Oct 18 16:35:23.610347 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3572/7161] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:35:24.027787 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ed1d7a91-41c0-4f2b-a812-ced446333997 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:24.028424 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ed1d7a91-41c0-4f2b-a812-ced446333997 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:24.035479 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ed1d7a91-41c0-4f2b-a812-ced446333997 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:24.035984 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ed1d7a91-41c0-4f2b-a812-ced446333997 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:24.036438 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ed1d7a91-41c0-4f2b-a812-ced446333997 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:24.037188 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ed1d7a91-41c0-4f2b-a812-ced446333997 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:24.037662 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ed1d7a91-41c0-4f2b-a812-ced446333997 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:24.038108 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ed1d7a91-41c0-4f2b-a812-ced446333997 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:24.248523 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ed1d7a91-41c0-4f2b-a812-ced446333997 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:24.257502 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ed1d7a91-41c0-4f2b-a812-ced446333997 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1720 microversion: 2.1 time: 0.233587 Oct 18 16:35:24.258021 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3590/7162] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:35:24 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1720 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:35:25.282759 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2284df0d-b6ca-4636-95d4-8a5985ea8bd1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:25.283471 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2284df0d-b6ca-4636-95d4-8a5985ea8bd1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:25.289854 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2284df0d-b6ca-4636-95d4-8a5985ea8bd1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:25.290336 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2284df0d-b6ca-4636-95d4-8a5985ea8bd1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:25.291091 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2284df0d-b6ca-4636-95d4-8a5985ea8bd1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:25.291784 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2284df0d-b6ca-4636-95d4-8a5985ea8bd1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:25.292245 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2284df0d-b6ca-4636-95d4-8a5985ea8bd1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:25.292671 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2284df0d-b6ca-4636-95d4-8a5985ea8bd1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:25.430819 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2284df0d-b6ca-4636-95d4-8a5985ea8bd1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:25.440123 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2284df0d-b6ca-4636-95d4-8a5985ea8bd1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1720 microversion: 2.1 time: 0.162554 Oct 18 16:35:25.441279 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3573/7163] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:35:25 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:35:25.626290 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-807239e2-a7cc-43b6-862b-1aba9189f16a req-b7bfc55f-2c3a-4ebc-b578-de38afc54170 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fad2592-ecf3-43a2-b1da-91bc7899e785", "tag": "bd3875dc-2d65-4595-929c-151d03c0a270"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:35:25.637509 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-807239e2-a7cc-43b6-862b-1aba9189f16a req-b7bfc55f-2c3a-4ebc-b578-de38afc54170 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:25.638083 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-807239e2-a7cc-43b6-862b-1aba9189f16a req-b7bfc55f-2c3a-4ebc-b578-de38afc54170 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:25.638531 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-807239e2-a7cc-43b6-862b-1aba9189f16a req-b7bfc55f-2c3a-4ebc-b578-de38afc54170 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:25.650482 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-807239e2-a7cc-43b6-862b-1aba9189f16a req-b7bfc55f-2c3a-4ebc-b578-de38afc54170 service nova] Creating event network-changed:bd3875dc-2d65-4595-929c-151d03c0a270 for instance 3fad2592-ecf3-43a2-b1da-91bc7899e785 on n-h1-853682-5 Oct 18 16:35:25.655803 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [req-807239e2-a7cc-43b6-862b-1aba9189f16a req-b7bfc55f-2c3a-4ebc-b578-de38afc54170 service nova] Instance 3fad2592-ecf3-43a2-b1da-91bc7899e785 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853682-5', 'n-h1-853682-5'} {{(pid=120405) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 18 16:35:25.666953 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-807239e2-a7cc-43b6-862b-1aba9189f16a req-b7bfc55f-2c3a-4ebc-b578-de38afc54170 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044407 Oct 18 16:35:25.667792 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3591/7164] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:35:26.464182 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-38afa79a-c452-462a-b407-5f40584599b1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:26.464787 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-38afa79a-c452-462a-b407-5f40584599b1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:26.471620 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-38afa79a-c452-462a-b407-5f40584599b1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:26.472094 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-38afa79a-c452-462a-b407-5f40584599b1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:26.472524 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-38afa79a-c452-462a-b407-5f40584599b1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:26.473299 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-38afa79a-c452-462a-b407-5f40584599b1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:26.473695 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-38afa79a-c452-462a-b407-5f40584599b1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:26.474111 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-38afa79a-c452-462a-b407-5f40584599b1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:26.606804 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-38afa79a-c452-462a-b407-5f40584599b1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:26.615286 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-38afa79a-c452-462a-b407-5f40584599b1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1720 microversion: 2.1 time: 0.155586 Oct 18 16:35:26.615951 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3574/7165] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:35:26 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:35:27.641024 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8946b9ff-6245-4b5a-b556-ff037475d1a9 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:27.641781 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8946b9ff-6245-4b5a-b556-ff037475d1a9 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:27.648258 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8946b9ff-6245-4b5a-b556-ff037475d1a9 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:27.648746 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8946b9ff-6245-4b5a-b556-ff037475d1a9 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:27.649202 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8946b9ff-6245-4b5a-b556-ff037475d1a9 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:27.650433 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8946b9ff-6245-4b5a-b556-ff037475d1a9 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:27.650907 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8946b9ff-6245-4b5a-b556-ff037475d1a9 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:27.651347 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8946b9ff-6245-4b5a-b556-ff037475d1a9 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:27.789649 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8946b9ff-6245-4b5a-b556-ff037475d1a9 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:27.798876 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8946b9ff-6245-4b5a-b556-ff037475d1a9 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1720 microversion: 2.1 time: 0.163301 Oct 18 16:35:27.799659 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3592/7166] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:35:27 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:35:28.821676 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b54e6093-8f71-491b-be12-9f91df2c77f1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:28.822290 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b54e6093-8f71-491b-be12-9f91df2c77f1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:28.829193 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b54e6093-8f71-491b-be12-9f91df2c77f1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:28.829677 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b54e6093-8f71-491b-be12-9f91df2c77f1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:28.830118 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b54e6093-8f71-491b-be12-9f91df2c77f1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:28.830840 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b54e6093-8f71-491b-be12-9f91df2c77f1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:28.831293 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b54e6093-8f71-491b-be12-9f91df2c77f1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:28.831719 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b54e6093-8f71-491b-be12-9f91df2c77f1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:28.963932 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b54e6093-8f71-491b-be12-9f91df2c77f1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:28.972346 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b54e6093-8f71-491b-be12-9f91df2c77f1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1720 microversion: 2.1 time: 0.154624 Oct 18 16:35:28.972949 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3575/7167] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:35:28 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:35:29.997444 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0549f8a2-64a1-4ed5-9e8a-82c014901d39 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:29.998210 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0549f8a2-64a1-4ed5-9e8a-82c014901d39 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:30.000635 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=3 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:35:30.007097 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0549f8a2-64a1-4ed5-9e8a-82c014901d39 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:30.007609 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0549f8a2-64a1-4ed5-9e8a-82c014901d39 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:30.008067 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0549f8a2-64a1-4ed5-9e8a-82c014901d39 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:30.008786 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0549f8a2-64a1-4ed5-9e8a-82c014901d39 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:30.009291 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0549f8a2-64a1-4ed5-9e8a-82c014901d39 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:30.009738 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0549f8a2-64a1-4ed5-9e8a-82c014901d39 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:30.142526 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0549f8a2-64a1-4ed5-9e8a-82c014901d39 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:30.151659 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0549f8a2-64a1-4ed5-9e8a-82c014901d39 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1720 microversion: 2.1 time: 0.158587 Oct 18 16:35:30.152236 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3593/7168] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:35:29 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:35:31.175480 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8769be0b-148d-43c7-9ddf-2ed4d7f92ceb tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:31.176136 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8769be0b-148d-43c7-9ddf-2ed4d7f92ceb tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:31.183075 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8769be0b-148d-43c7-9ddf-2ed4d7f92ceb tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:31.183559 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8769be0b-148d-43c7-9ddf-2ed4d7f92ceb tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:31.183999 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8769be0b-148d-43c7-9ddf-2ed4d7f92ceb tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:31.184695 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8769be0b-148d-43c7-9ddf-2ed4d7f92ceb tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:31.185182 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8769be0b-148d-43c7-9ddf-2ed4d7f92ceb tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:31.185610 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8769be0b-148d-43c7-9ddf-2ed4d7f92ceb tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:31.314739 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8769be0b-148d-43c7-9ddf-2ed4d7f92ceb tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:31.323601 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8769be0b-148d-43c7-9ddf-2ed4d7f92ceb tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1720 microversion: 2.1 time: 0.152093 Oct 18 16:35:31.324189 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3576/7169] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:35:31 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:35:32.346718 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-73ace63a-f8b9-42aa-b9bc-adc602e1ea03 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:32.347346 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-73ace63a-f8b9-42aa-b9bc-adc602e1ea03 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:32.355156 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-73ace63a-f8b9-42aa-b9bc-adc602e1ea03 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:32.355650 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-73ace63a-f8b9-42aa-b9bc-adc602e1ea03 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:32.356096 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-73ace63a-f8b9-42aa-b9bc-adc602e1ea03 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:32.356795 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-73ace63a-f8b9-42aa-b9bc-adc602e1ea03 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:32.357298 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-73ace63a-f8b9-42aa-b9bc-adc602e1ea03 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:32.357734 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-73ace63a-f8b9-42aa-b9bc-adc602e1ea03 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:32.492836 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-73ace63a-f8b9-42aa-b9bc-adc602e1ea03 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:32.501850 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-73ace63a-f8b9-42aa-b9bc-adc602e1ea03 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1720 microversion: 2.1 time: 0.159092 Oct 18 16:35:32.502427 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3594/7170] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:35:32 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:35:33.525404 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-27c1e1bc-0b24-4160-a4fa-5c786dea522e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:33.526064 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-27c1e1bc-0b24-4160-a4fa-5c786dea522e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:33.532838 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-27c1e1bc-0b24-4160-a4fa-5c786dea522e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:33.533334 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-27c1e1bc-0b24-4160-a4fa-5c786dea522e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:33.533771 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-27c1e1bc-0b24-4160-a4fa-5c786dea522e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:33.534488 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-27c1e1bc-0b24-4160-a4fa-5c786dea522e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:33.534945 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-27c1e1bc-0b24-4160-a4fa-5c786dea522e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:33.535369 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-27c1e1bc-0b24-4160-a4fa-5c786dea522e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:33.670970 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-27c1e1bc-0b24-4160-a4fa-5c786dea522e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:33.679175 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-27c1e1bc-0b24-4160-a4fa-5c786dea522e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1720 microversion: 2.1 time: 0.157766 Oct 18 16:35:33.679766 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3577/7171] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:35:33 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:35:34.702636 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-37c0763b-b663-4fba-873f-32fdb07eeeef tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:34.703261 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-37c0763b-b663-4fba-873f-32fdb07eeeef tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:34.710078 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37c0763b-b663-4fba-873f-32fdb07eeeef tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:34.710575 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37c0763b-b663-4fba-873f-32fdb07eeeef tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:34.711017 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37c0763b-b663-4fba-873f-32fdb07eeeef tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:34.711725 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37c0763b-b663-4fba-873f-32fdb07eeeef tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:34.712189 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37c0763b-b663-4fba-873f-32fdb07eeeef tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:34.712623 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37c0763b-b663-4fba-873f-32fdb07eeeef tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:34.843259 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-37c0763b-b663-4fba-873f-32fdb07eeeef tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:34.851593 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-37c0763b-b663-4fba-873f-32fdb07eeeef tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1720 microversion: 2.1 time: 0.152857 Oct 18 16:35:34.852188 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3595/7172] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:35:34 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:35:35.875678 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6d561521-0c49-4ca6-9847-5d5280c11946 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:35.876299 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6d561521-0c49-4ca6-9847-5d5280c11946 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:35.883277 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d561521-0c49-4ca6-9847-5d5280c11946 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:35.883755 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d561521-0c49-4ca6-9847-5d5280c11946 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:35.885914 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d561521-0c49-4ca6-9847-5d5280c11946 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:35.885914 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d561521-0c49-4ca6-9847-5d5280c11946 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:35.885914 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d561521-0c49-4ca6-9847-5d5280c11946 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:35.886283 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d561521-0c49-4ca6-9847-5d5280c11946 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:36.020913 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6d561521-0c49-4ca6-9847-5d5280c11946 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:36.029786 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6d561521-0c49-4ca6-9847-5d5280c11946 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1720 microversion: 2.1 time: 0.158125 Oct 18 16:35:36.030367 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3578/7173] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:35:35 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:35:37.053950 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-18dff401-4a81-45e1-9883-6e265924f45a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:37.054595 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-18dff401-4a81-45e1-9883-6e265924f45a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:37.061807 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-18dff401-4a81-45e1-9883-6e265924f45a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:37.062317 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-18dff401-4a81-45e1-9883-6e265924f45a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:37.062775 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-18dff401-4a81-45e1-9883-6e265924f45a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:37.063497 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-18dff401-4a81-45e1-9883-6e265924f45a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:37.063975 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-18dff401-4a81-45e1-9883-6e265924f45a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:37.064421 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-18dff401-4a81-45e1-9883-6e265924f45a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:37.196173 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-18dff401-4a81-45e1-9883-6e265924f45a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:37.205124 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-18dff401-4a81-45e1-9883-6e265924f45a tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1720 microversion: 2.1 time: 0.155144 Oct 18 16:35:37.205700 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3596/7174] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:35:37 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:35:38.229274 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fbb93245-3614-4860-9dda-72f1f72cbb82 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:38.230003 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fbb93245-3614-4860-9dda-72f1f72cbb82 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:38.236448 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbb93245-3614-4860-9dda-72f1f72cbb82 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:38.236955 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbb93245-3614-4860-9dda-72f1f72cbb82 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:38.237390 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbb93245-3614-4860-9dda-72f1f72cbb82 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:38.238078 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbb93245-3614-4860-9dda-72f1f72cbb82 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:38.238529 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbb93245-3614-4860-9dda-72f1f72cbb82 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:38.238948 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbb93245-3614-4860-9dda-72f1f72cbb82 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:38.376341 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fbb93245-3614-4860-9dda-72f1f72cbb82 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:38.384740 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fbb93245-3614-4860-9dda-72f1f72cbb82 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1713 microversion: 2.1 time: 0.159347 Oct 18 16:35:38.385345 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3579/7175] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:35:38 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1713 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:35:38.409021 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6be1bf0b-95f5-48c6-9def-b64d031ef67b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:38.409673 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6be1bf0b-95f5-48c6-9def-b64d031ef67b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:38.417503 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6be1bf0b-95f5-48c6-9def-b64d031ef67b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:38.418010 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6be1bf0b-95f5-48c6-9def-b64d031ef67b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:38.418473 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6be1bf0b-95f5-48c6-9def-b64d031ef67b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:38.419191 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6be1bf0b-95f5-48c6-9def-b64d031ef67b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:38.419699 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6be1bf0b-95f5-48c6-9def-b64d031ef67b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:38.420151 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6be1bf0b-95f5-48c6-9def-b64d031ef67b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:38.559948 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6be1bf0b-95f5-48c6-9def-b64d031ef67b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:38.569179 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6be1bf0b-95f5-48c6-9def-b64d031ef67b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1713 microversion: 2.1 time: 0.164276 Oct 18 16:35:38.569794 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3597/7176] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:35:38 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1713 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:35:38.592537 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e8338804-04e6-4a3a-8ebd-4a6593da0d4e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:38.593193 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e8338804-04e6-4a3a-8ebd-4a6593da0d4e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:38.599229 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8338804-04e6-4a3a-8ebd-4a6593da0d4e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:38.599718 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8338804-04e6-4a3a-8ebd-4a6593da0d4e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:38.600160 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8338804-04e6-4a3a-8ebd-4a6593da0d4e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:38.600878 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8338804-04e6-4a3a-8ebd-4a6593da0d4e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:38.601342 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8338804-04e6-4a3a-8ebd-4a6593da0d4e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:38.601768 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8338804-04e6-4a3a-8ebd-4a6593da0d4e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:38.634868 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-574028df-751b-4543-a1eb-06d6d8eda56a req-5aa940ad-f850-41af-997d-1784b9202b5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fad2592-ecf3-43a2-b1da-91bc7899e785", "name": "network-vif-plugged", "status": "completed", "tag": "bd3875dc-2d65-4595-929c-151d03c0a270"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:35:38.645435 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-574028df-751b-4543-a1eb-06d6d8eda56a req-5aa940ad-f850-41af-997d-1784b9202b5b service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:38.646245 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-574028df-751b-4543-a1eb-06d6d8eda56a req-5aa940ad-f850-41af-997d-1784b9202b5b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:38.646401 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-574028df-751b-4543-a1eb-06d6d8eda56a req-5aa940ad-f850-41af-997d-1784b9202b5b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:38.649307 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:35:38.662859 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-574028df-751b-4543-a1eb-06d6d8eda56a req-5aa940ad-f850-41af-997d-1784b9202b5b service nova] Creating event network-vif-plugged:bd3875dc-2d65-4595-929c-151d03c0a270 for instance 3fad2592-ecf3-43a2-b1da-91bc7899e785 on n-h1-853682-5 Oct 18 16:35:38.668621 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-574028df-751b-4543-a1eb-06d6d8eda56a req-5aa940ad-f850-41af-997d-1784b9202b5b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039238 Oct 18 16:35:38.669587 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3598/7177] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:35:38.735452 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e8338804-04e6-4a3a-8ebd-4a6593da0d4e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:38.743824 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e8338804-04e6-4a3a-8ebd-4a6593da0d4e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1713 microversion: 2.1 time: 0.155277 Oct 18 16:35:38.744400 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3580/7178] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:35:38 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1713 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:35:38.767114 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-073e5472-ee74-4a1e-9d01-3f93ea81887e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:38.767720 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-073e5472-ee74-4a1e-9d01-3f93ea81887e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:38.773847 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-073e5472-ee74-4a1e-9d01-3f93ea81887e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:38.774371 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-073e5472-ee74-4a1e-9d01-3f93ea81887e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:38.775392 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-073e5472-ee74-4a1e-9d01-3f93ea81887e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:38.776096 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-073e5472-ee74-4a1e-9d01-3f93ea81887e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:38.776569 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-073e5472-ee74-4a1e-9d01-3f93ea81887e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:38.777043 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-073e5472-ee74-4a1e-9d01-3f93ea81887e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:38.801946 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-073e5472-ee74-4a1e-9d01-3f93ea81887e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:35:38.877900 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-073e5472-ee74-4a1e-9d01-3f93ea81887e tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 204 len: 0 microversion: 2.1 time: 0.114933 Oct 18 16:35:38.878420 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3599/7179] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 16:35:38 2022] DELETE /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:35:38.889016 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3360cc5c-876f-46f1-9751-1e7c2feb7f66 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:38.890067 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3360cc5c-876f-46f1-9751-1e7c2feb7f66 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:38.896092 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3360cc5c-876f-46f1-9751-1e7c2feb7f66 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:38.896566 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3360cc5c-876f-46f1-9751-1e7c2feb7f66 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:38.897067 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3360cc5c-876f-46f1-9751-1e7c2feb7f66 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:38.897749 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3360cc5c-876f-46f1-9751-1e7c2feb7f66 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:38.898197 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3360cc5c-876f-46f1-9751-1e7c2feb7f66 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:38.898616 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3360cc5c-876f-46f1-9751-1e7c2feb7f66 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:39.033900 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3360cc5c-876f-46f1-9751-1e7c2feb7f66 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:39.042933 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3360cc5c-876f-46f1-9751-1e7c2feb7f66 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1719 microversion: 2.1 time: 0.158747 Oct 18 16:35:39.043517 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3581/7180] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:35:38 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1719 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:35:40.066659 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5e9cbdda-f52a-45c4-93ab-f5cff311a261 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:40.067381 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5e9cbdda-f52a-45c4-93ab-f5cff311a261 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:40.075026 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5e9cbdda-f52a-45c4-93ab-f5cff311a261 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:40.075525 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5e9cbdda-f52a-45c4-93ab-f5cff311a261 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:40.075974 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5e9cbdda-f52a-45c4-93ab-f5cff311a261 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:40.076676 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5e9cbdda-f52a-45c4-93ab-f5cff311a261 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:40.077170 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5e9cbdda-f52a-45c4-93ab-f5cff311a261 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:40.077613 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5e9cbdda-f52a-45c4-93ab-f5cff311a261 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:40.208442 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5e9cbdda-f52a-45c4-93ab-f5cff311a261 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:40.217906 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5e9cbdda-f52a-45c4-93ab-f5cff311a261 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1719 microversion: 2.1 time: 0.155726 Oct 18 16:35:40.218490 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3600/7181] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:35:40 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1719 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:35:41.244377 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2e5cee91-b66e-4df4-a665-3faa828382b5 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:41.245070 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2e5cee91-b66e-4df4-a665-3faa828382b5 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:41.251828 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e5cee91-b66e-4df4-a665-3faa828382b5 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:41.252319 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e5cee91-b66e-4df4-a665-3faa828382b5 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:41.252757 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e5cee91-b66e-4df4-a665-3faa828382b5 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:41.253557 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e5cee91-b66e-4df4-a665-3faa828382b5 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:41.254020 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e5cee91-b66e-4df4-a665-3faa828382b5 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:41.254453 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e5cee91-b66e-4df4-a665-3faa828382b5 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:41.344747 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2e5cee91-b66e-4df4-a665-3faa828382b5 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:41.353034 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2e5cee91-b66e-4df4-a665-3faa828382b5 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1652 microversion: 2.1 time: 0.113295 Oct 18 16:35:41.353973 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3582/7182] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:35:41 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1652 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:35:41.617491 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-31aab1de-856f-438e-a483-90e19365ae49 req-2f7e9b8d-a06e-4cb7-843e-0efacef99305 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fad2592-ecf3-43a2-b1da-91bc7899e785", "name": "network-vif-deleted", "tag": "bd3875dc-2d65-4595-929c-151d03c0a270"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:35:41.629970 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-31aab1de-856f-438e-a483-90e19365ae49 req-2f7e9b8d-a06e-4cb7-843e-0efacef99305 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:41.630597 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-31aab1de-856f-438e-a483-90e19365ae49 req-2f7e9b8d-a06e-4cb7-843e-0efacef99305 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:41.631058 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-31aab1de-856f-438e-a483-90e19365ae49 req-2f7e9b8d-a06e-4cb7-843e-0efacef99305 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:41.645342 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-31aab1de-856f-438e-a483-90e19365ae49 req-2f7e9b8d-a06e-4cb7-843e-0efacef99305 service nova] Creating event network-vif-deleted:bd3875dc-2d65-4595-929c-151d03c0a270 for instance 3fad2592-ecf3-43a2-b1da-91bc7899e785 on n-h1-853682-5 Oct 18 16:35:41.650372 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-31aab1de-856f-438e-a483-90e19365ae49 req-2f7e9b8d-a06e-4cb7-843e-0efacef99305 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036743 Oct 18 16:35:41.650995 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3601/7183] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:35:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:35:42.378278 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-48845fb8-81d0-4e9c-ba07-7571f83aaf2b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:42.379044 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-48845fb8-81d0-4e9c-ba07-7571f83aaf2b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:42.387313 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-48845fb8-81d0-4e9c-ba07-7571f83aaf2b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:42.388127 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-48845fb8-81d0-4e9c-ba07-7571f83aaf2b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:42.388828 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-48845fb8-81d0-4e9c-ba07-7571f83aaf2b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:42.389763 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-48845fb8-81d0-4e9c-ba07-7571f83aaf2b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:42.390321 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-48845fb8-81d0-4e9c-ba07-7571f83aaf2b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:42.390843 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-48845fb8-81d0-4e9c-ba07-7571f83aaf2b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:42.407540 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:35:42.459251 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-48845fb8-81d0-4e9c-ba07-7571f83aaf2b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:42.469081 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-48845fb8-81d0-4e9c-ba07-7571f83aaf2b tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1367 microversion: 2.1 time: 0.094534 Oct 18 16:35:42.469687 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3583/7184] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:35:42 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1367 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:35:43.494171 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3a8957b4-82cc-476a-9771-308ef517648c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:43.494901 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3a8957b4-82cc-476a-9771-308ef517648c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:43.501367 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3a8957b4-82cc-476a-9771-308ef517648c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:43.501900 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3a8957b4-82cc-476a-9771-308ef517648c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:43.502378 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3a8957b4-82cc-476a-9771-308ef517648c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:43.503082 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3a8957b4-82cc-476a-9771-308ef517648c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:43.503561 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3a8957b4-82cc-476a-9771-308ef517648c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:43.504009 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3a8957b4-82cc-476a-9771-308ef517648c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:43.571539 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3a8957b4-82cc-476a-9771-308ef517648c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:43.580050 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3a8957b4-82cc-476a-9771-308ef517648c tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1367 microversion: 2.1 time: 0.091509 Oct 18 16:35:43.580628 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3602/7185] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:35:43 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1367 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:35:44.604349 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f4ad8cb6-f95a-481a-a1b2-aaa4755eff23 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:44.605115 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f4ad8cb6-f95a-481a-a1b2-aaa4755eff23 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:44.608481 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=36 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:35:44.613940 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4ad8cb6-f95a-481a-a1b2-aaa4755eff23 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:44.614428 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4ad8cb6-f95a-481a-a1b2-aaa4755eff23 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:44.614863 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4ad8cb6-f95a-481a-a1b2-aaa4755eff23 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:44.615586 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4ad8cb6-f95a-481a-a1b2-aaa4755eff23 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:44.616040 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4ad8cb6-f95a-481a-a1b2-aaa4755eff23 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:44.616462 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4ad8cb6-f95a-481a-a1b2-aaa4755eff23 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:44.680110 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f4ad8cb6-f95a-481a-a1b2-aaa4755eff23 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:44.689774 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f4ad8cb6-f95a-481a-a1b2-aaa4755eff23 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1367 microversion: 2.1 time: 0.090155 Oct 18 16:35:44.690370 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3584/7186] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:35:44 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1367 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:35:45.714313 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2d6b556b-9ba7-46c0-91df-502f27736812 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:45.714959 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2d6b556b-9ba7-46c0-91df-502f27736812 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:45.717800 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:35:45.723952 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d6b556b-9ba7-46c0-91df-502f27736812 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:45.724474 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d6b556b-9ba7-46c0-91df-502f27736812 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:45.724961 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d6b556b-9ba7-46c0-91df-502f27736812 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:45.725685 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d6b556b-9ba7-46c0-91df-502f27736812 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:45.726161 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d6b556b-9ba7-46c0-91df-502f27736812 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:45.726608 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d6b556b-9ba7-46c0-91df-502f27736812 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:45.796072 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2d6b556b-9ba7-46c0-91df-502f27736812 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c26a3ccef246d6bb58d7d834f71106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f872c1ec84314318ac67bfbe7d186b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:35:45.804495 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2d6b556b-9ba7-46c0-91df-502f27736812 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 200 len: 1367 microversion: 2.1 time: 0.094601 Oct 18 16:35:45.805292 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3603/7187] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:35:45 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 1367 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:35:46.886643 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2e045407-d901-4f11-97c7-b0ba2450fa42 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:46.887231 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2e045407-d901-4f11-97c7-b0ba2450fa42 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:46.894249 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e045407-d901-4f11-97c7-b0ba2450fa42 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:46.894687 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e045407-d901-4f11-97c7-b0ba2450fa42 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:46.895089 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e045407-d901-4f11-97c7-b0ba2450fa42 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:46.895767 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e045407-d901-4f11-97c7-b0ba2450fa42 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:46.896216 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e045407-d901-4f11-97c7-b0ba2450fa42 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:46.896635 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e045407-d901-4f11-97c7-b0ba2450fa42 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:46.909717 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-2e045407-d901-4f11-97c7-b0ba2450fa42 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] HTTP exception thrown: Instance 3fad2592-ecf3-43a2-b1da-91bc7899e785 could not be found. Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2e045407-d901-4f11-97c7-b0ba2450fa42 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Request method failure captured: Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 HTTP/1.1 Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTtRtIaUCN9plKHAU4sMF0eKPWeSPc3LcSTEAsfYHO6Ia-co9ZPn6puaeremyzCJ1TQjfFH64XFDE8JVb1F9uH606Ok8WhdDHKOcmm8H7JUvsjzsW5arFpGz6CXjDjVzRoJq_6-HaJ4kSxSPzbYSgopkwKzlavAYaW8OixT5z-2qDJfM Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: f872c1ec84314318ac67bfbe7d186b2c Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerActionsTestJSON-1692549662 Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServerActionsTestJSON-1692549662 Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: f872c1ec84314318ac67bfbe7d186b2c Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerActionsTestJSON-1692549662 Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServerActionsTestJSON-1692549662-project Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 92c26a3ccef246d6bb58d7d834f71106 Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServerActionsTestJSON-1692549662-project Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 3fad2592-ecf3-43a2-b1da-91bc7899e785 could not be found. Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '3fad2592-ecf3-43a2-b1da-91bc7899e785'} Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fad2592-ecf3-43a2-b1da-91bc7899e785 could not be found. Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fad2592-ecf3-43a2-b1da-91bc7899e785 could not be found. Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:35:46.911332 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:35:46.917337 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:35:46.917337 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:35:46.917337 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:35:46.917337 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:35:46.917337 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:35:46.917337 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fad2592-ecf3-43a2-b1da-91bc7899e785 could not be found. Oct 18 16:35:46.917337 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:35:46.917337 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2e045407-d901-4f11-97c7-b0ba2450fa42 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Returning 404 to user: Instance 3fad2592-ecf3-43a2-b1da-91bc7899e785 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:35:46.917337 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2e045407-d901-4f11-97c7-b0ba2450fa42 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 404 len: 111 microversion: 2.1 time: 0.029953 Oct 18 16:35:46.917337 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3585/7188] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:35:46 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:35:46.975761 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-442576f1-f547-470b-a873-72f34b20b089 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:46.978511 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-442576f1-f547-470b-a873-72f34b20b089 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:46.985420 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-442576f1-f547-470b-a873-72f34b20b089 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:46.985953 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-442576f1-f547-470b-a873-72f34b20b089 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:46.986414 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-442576f1-f547-470b-a873-72f34b20b089 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:46.987125 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-442576f1-f547-470b-a873-72f34b20b089 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:46.987628 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-442576f1-f547-470b-a873-72f34b20b089 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:46.988072 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-442576f1-f547-470b-a873-72f34b20b089 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:47.002335 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-442576f1-f547-470b-a873-72f34b20b089 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] HTTP exception thrown: Instance 3fad2592-ecf3-43a2-b1da-91bc7899e785 could not be found. Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-442576f1-f547-470b-a873-72f34b20b089 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Request method failure captured: Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785/os-volume_attachments HTTP/1.1 Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTtRtIaUCN9plKHAU4sMF0eKPWeSPc3LcSTEAsfYHO6Ia-co9ZPn6puaeremyzCJ1TQjfFH64XFDE8JVb1F9uH606Ok8WhdDHKOcmm8H7JUvsjzsW5arFpGz6CXjDjVzRoJq_6-HaJ4kSxSPzbYSgopkwKzlavAYaW8OixT5z-2qDJfM Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: f872c1ec84314318ac67bfbe7d186b2c Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServerActionsTestJSON-1692549662 Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServerActionsTestJSON-1692549662 Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: f872c1ec84314318ac67bfbe7d186b2c Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServerActionsTestJSON-1692549662 Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServerActionsTestJSON-1692549662-project Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 92c26a3ccef246d6bb58d7d834f71106 Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServerActionsTestJSON-1692549662-project Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 3fad2592-ecf3-43a2-b1da-91bc7899e785 could not be found. Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'server_id': '3fad2592-ecf3-43a2-b1da-91bc7899e785'} Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fad2592-ecf3-43a2-b1da-91bc7899e785 could not be found. Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:35:47.004048 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:35:47.008346 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fad2592-ecf3-43a2-b1da-91bc7899e785 could not be found. Oct 18 16:35:47.008346 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:35:47.008346 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:35:47.008346 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:35:47.008346 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:35:47.008346 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:35:47.008346 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:35:47.008346 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:35:47.008346 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:35:47.008346 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fad2592-ecf3-43a2-b1da-91bc7899e785 could not be found. Oct 18 16:35:47.008346 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:35:47.008346 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-442576f1-f547-470b-a873-72f34b20b089 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Returning 404 to user: Instance 3fad2592-ecf3-43a2-b1da-91bc7899e785 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:35:47.008346 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-442576f1-f547-470b-a873-72f34b20b089 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033805 Oct 18 16:35:47.008346 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3604/7189] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 16:35:46 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:35:50.329842 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-24b66708-b0c4-4f1b-a6ef-02c33050d216 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:50.330347 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-24b66708-b0c4-4f1b-a6ef-02c33050d216 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:50.337168 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24b66708-b0c4-4f1b-a6ef-02c33050d216 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:50.337646 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24b66708-b0c4-4f1b-a6ef-02c33050d216 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:50.338082 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24b66708-b0c4-4f1b-a6ef-02c33050d216 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:50.338761 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24b66708-b0c4-4f1b-a6ef-02c33050d216 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:50.339212 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24b66708-b0c4-4f1b-a6ef-02c33050d216 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:50.339630 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24b66708-b0c4-4f1b-a6ef-02c33050d216 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:50.353070 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-24b66708-b0c4-4f1b-a6ef-02c33050d216 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] HTTP exception thrown: Instance 3fad2592-ecf3-43a2-b1da-91bc7899e785 could not be found. Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-24b66708-b0c4-4f1b-a6ef-02c33050d216 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Request method failure captured: Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 HTTP/1.1 Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTtRtIaUCN9plKHAU4sMF0eKPWeSPc3LcSTEAsfYHO6Ia-co9ZPn6puaeremyzCJ1TQjfFH64XFDE8JVb1F9uH606Ok8WhdDHKOcmm8H7JUvsjzsW5arFpGz6CXjDjVzRoJq_6-HaJ4kSxSPzbYSgopkwKzlavAYaW8OixT5z-2qDJfM Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: f872c1ec84314318ac67bfbe7d186b2c Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerActionsTestJSON-1692549662 Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServerActionsTestJSON-1692549662 Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: f872c1ec84314318ac67bfbe7d186b2c Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerActionsTestJSON-1692549662 Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServerActionsTestJSON-1692549662-project Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 92c26a3ccef246d6bb58d7d834f71106 Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServerActionsTestJSON-1692549662-project Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 3fad2592-ecf3-43a2-b1da-91bc7899e785 could not be found. Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '3fad2592-ecf3-43a2-b1da-91bc7899e785'} Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fad2592-ecf3-43a2-b1da-91bc7899e785 could not be found. Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:35:50.354633 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:35:50.358725 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fad2592-ecf3-43a2-b1da-91bc7899e785 could not be found. Oct 18 16:35:50.358725 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:35:50.358725 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:35:50.358725 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:35:50.358725 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:35:50.358725 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:35:50.358725 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:35:50.358725 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:35:50.358725 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:35:50.358725 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fad2592-ecf3-43a2-b1da-91bc7899e785 could not be found. Oct 18 16:35:50.358725 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:35:50.358725 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-24b66708-b0c4-4f1b-a6ef-02c33050d216 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Returning 404 to user: Instance 3fad2592-ecf3-43a2-b1da-91bc7899e785 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:35:50.358725 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-24b66708-b0c4-4f1b-a6ef-02c33050d216 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 404 len: 111 microversion: 2.1 time: 0.030038 Oct 18 16:35:50.358725 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3586/7190] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 16:35:50 2022] DELETE /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:35:50.365095 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-808c3cec-eea7-4590-8f00-d2fd26050274 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:50.365768 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-808c3cec-eea7-4590-8f00-d2fd26050274 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 3fad2592-ecf3-43a2-b1da-91bc7899e785] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:50.373905 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-808c3cec-eea7-4590-8f00-d2fd26050274 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:50.374412 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-808c3cec-eea7-4590-8f00-d2fd26050274 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:50.374867 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-808c3cec-eea7-4590-8f00-d2fd26050274 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:50.375598 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-808c3cec-eea7-4590-8f00-d2fd26050274 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:50.376072 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-808c3cec-eea7-4590-8f00-d2fd26050274 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:50.376514 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-808c3cec-eea7-4590-8f00-d2fd26050274 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:50.391995 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-808c3cec-eea7-4590-8f00-d2fd26050274 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] HTTP exception thrown: Instance 3fad2592-ecf3-43a2-b1da-91bc7899e785 could not be found. Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-808c3cec-eea7-4590-8f00-d2fd26050274 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Request method failure captured: Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 HTTP/1.1 Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTtRtIaUCN9plKHAU4sMF0eKPWeSPc3LcSTEAsfYHO6Ia-co9ZPn6puaeremyzCJ1TQjfFH64XFDE8JVb1F9uH606Ok8WhdDHKOcmm8H7JUvsjzsW5arFpGz6CXjDjVzRoJq_6-HaJ4kSxSPzbYSgopkwKzlavAYaW8OixT5z-2qDJfM Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: f872c1ec84314318ac67bfbe7d186b2c Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServerActionsTestJSON-1692549662 Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServerActionsTestJSON-1692549662 Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: f872c1ec84314318ac67bfbe7d186b2c Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServerActionsTestJSON-1692549662 Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServerActionsTestJSON-1692549662-project Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 92c26a3ccef246d6bb58d7d834f71106 Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServerActionsTestJSON-1692549662-project Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 3fad2592-ecf3-43a2-b1da-91bc7899e785 could not be found. Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '3fad2592-ecf3-43a2-b1da-91bc7899e785'} Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fad2592-ecf3-43a2-b1da-91bc7899e785 could not be found. Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fad2592-ecf3-43a2-b1da-91bc7899e785 could not be found. Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:35:50.393612 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:35:50.397922 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:35:50.397922 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:35:50.397922 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:35:50.397922 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:35:50.397922 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:35:50.397922 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fad2592-ecf3-43a2-b1da-91bc7899e785 could not be found. Oct 18 16:35:50.397922 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:35:50.397922 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-808c3cec-eea7-4590-8f00-d2fd26050274 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Returning 404 to user: Instance 3fad2592-ecf3-43a2-b1da-91bc7899e785 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:35:50.397922 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-808c3cec-eea7-4590-8f00-d2fd26050274 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785" status: 404 len: 111 microversion: 2.1 time: 0.034092 Oct 18 16:35:50.397922 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3605/7191] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:35:50 2022] GET /compute/v2.1/servers/3fad2592-ecf3-43a2-b1da-91bc7899e785 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:35:50.403767 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3b542d92-0e03-4381-bbcc-806d119b1e06 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:50.404276 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3b542d92-0e03-4381-bbcc-806d119b1e06 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fd720b3b-c65b-4eb2-8cf5-6fea43469fff] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:50.410496 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b542d92-0e03-4381-bbcc-806d119b1e06 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:50.410990 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b542d92-0e03-4381-bbcc-806d119b1e06 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:50.411437 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b542d92-0e03-4381-bbcc-806d119b1e06 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:50.412142 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b542d92-0e03-4381-bbcc-806d119b1e06 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:50.412611 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b542d92-0e03-4381-bbcc-806d119b1e06 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:50.413057 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b542d92-0e03-4381-bbcc-806d119b1e06 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:50.427476 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-3b542d92-0e03-4381-bbcc-806d119b1e06 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] HTTP exception thrown: Instance fd720b3b-c65b-4eb2-8cf5-6fea43469fff could not be found. Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3b542d92-0e03-4381-bbcc-806d119b1e06 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Request method failure captured: Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff HTTP/1.1 Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTtRtIaUCN9plKHAU4sMF0eKPWeSPc3LcSTEAsfYHO6Ia-co9ZPn6puaeremyzCJ1TQjfFH64XFDE8JVb1F9uH606Ok8WhdDHKOcmm8H7JUvsjzsW5arFpGz6CXjDjVzRoJq_6-HaJ4kSxSPzbYSgopkwKzlavAYaW8OixT5z-2qDJfM Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: f872c1ec84314318ac67bfbe7d186b2c Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerActionsTestJSON-1692549662 Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServerActionsTestJSON-1692549662 Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: f872c1ec84314318ac67bfbe7d186b2c Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerActionsTestJSON-1692549662 Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServerActionsTestJSON-1692549662-project Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 92c26a3ccef246d6bb58d7d834f71106 Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServerActionsTestJSON-1692549662-project Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance fd720b3b-c65b-4eb2-8cf5-6fea43469fff could not be found. Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'fd720b3b-c65b-4eb2-8cf5-6fea43469fff'} Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd720b3b-c65b-4eb2-8cf5-6fea43469fff could not be found. Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:35:50.429080 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:35:50.434330 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd720b3b-c65b-4eb2-8cf5-6fea43469fff could not be found. Oct 18 16:35:50.434330 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:35:50.434330 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:35:50.434330 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:35:50.434330 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:35:50.434330 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:35:50.434330 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:35:50.434330 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:35:50.434330 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:35:50.434330 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd720b3b-c65b-4eb2-8cf5-6fea43469fff could not be found. Oct 18 16:35:50.434330 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:35:50.434330 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3b542d92-0e03-4381-bbcc-806d119b1e06 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Returning 404 to user: Instance fd720b3b-c65b-4eb2-8cf5-6fea43469fff could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:35:50.434330 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3b542d92-0e03-4381-bbcc-806d119b1e06 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "DELETE /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff" status: 404 len: 111 microversion: 2.1 time: 0.031416 Oct 18 16:35:50.435498 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3587/7192] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 16:35:50 2022] DELETE /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:35:50.439889 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-de0f49b9-bc8e-4c78-837d-9fa64794b20d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:50.440524 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-de0f49b9-bc8e-4c78-837d-9fa64794b20d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fd720b3b-c65b-4eb2-8cf5-6fea43469fff] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:50.447160 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de0f49b9-bc8e-4c78-837d-9fa64794b20d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:50.447653 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de0f49b9-bc8e-4c78-837d-9fa64794b20d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:50.448110 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de0f49b9-bc8e-4c78-837d-9fa64794b20d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:50.448903 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de0f49b9-bc8e-4c78-837d-9fa64794b20d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:50.449317 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de0f49b9-bc8e-4c78-837d-9fa64794b20d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:50.449758 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de0f49b9-bc8e-4c78-837d-9fa64794b20d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:50.463582 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-de0f49b9-bc8e-4c78-837d-9fa64794b20d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] HTTP exception thrown: Instance fd720b3b-c65b-4eb2-8cf5-6fea43469fff could not be found. Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-de0f49b9-bc8e-4c78-837d-9fa64794b20d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Request method failure captured: Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff HTTP/1.1 Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTtRtIaUCN9plKHAU4sMF0eKPWeSPc3LcSTEAsfYHO6Ia-co9ZPn6puaeremyzCJ1TQjfFH64XFDE8JVb1F9uH606Ok8WhdDHKOcmm8H7JUvsjzsW5arFpGz6CXjDjVzRoJq_6-HaJ4kSxSPzbYSgopkwKzlavAYaW8OixT5z-2qDJfM Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: f872c1ec84314318ac67bfbe7d186b2c Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServerActionsTestJSON-1692549662 Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServerActionsTestJSON-1692549662 Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: f872c1ec84314318ac67bfbe7d186b2c Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServerActionsTestJSON-1692549662 Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServerActionsTestJSON-1692549662-project Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 92c26a3ccef246d6bb58d7d834f71106 Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServerActionsTestJSON-1692549662-project Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance fd720b3b-c65b-4eb2-8cf5-6fea43469fff could not be found. Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'fd720b3b-c65b-4eb2-8cf5-6fea43469fff'} Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd720b3b-c65b-4eb2-8cf5-6fea43469fff could not be found. Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd720b3b-c65b-4eb2-8cf5-6fea43469fff could not be found. Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:35:50.465206 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:35:50.469501 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:35:50.469501 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:35:50.469501 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:35:50.469501 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:35:50.469501 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:35:50.469501 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd720b3b-c65b-4eb2-8cf5-6fea43469fff could not be found. Oct 18 16:35:50.469501 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:35:50.469501 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-de0f49b9-bc8e-4c78-837d-9fa64794b20d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Returning 404 to user: Instance fd720b3b-c65b-4eb2-8cf5-6fea43469fff could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:35:50.469501 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-de0f49b9-bc8e-4c78-837d-9fa64794b20d tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff" status: 404 len: 111 microversion: 2.1 time: 0.030663 Oct 18 16:35:50.469501 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3606/7193] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:35:50 2022] GET /compute/v2.1/servers/fd720b3b-c65b-4eb2-8cf5-6fea43469fff => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:35:50.475119 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-658e505e-8a77-4e58-b501-953f7b68d161 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:50.475619 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-658e505e-8a77-4e58-b501-953f7b68d161 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 22669b74-487b-4438-9120-e14517852a0a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:50.482201 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-658e505e-8a77-4e58-b501-953f7b68d161 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:50.482689 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-658e505e-8a77-4e58-b501-953f7b68d161 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:50.483128 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-658e505e-8a77-4e58-b501-953f7b68d161 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:50.483817 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-658e505e-8a77-4e58-b501-953f7b68d161 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:50.484272 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-658e505e-8a77-4e58-b501-953f7b68d161 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:50.484702 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-658e505e-8a77-4e58-b501-953f7b68d161 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:50.501168 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-658e505e-8a77-4e58-b501-953f7b68d161 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] HTTP exception thrown: Instance 22669b74-487b-4438-9120-e14517852a0a could not be found. Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-658e505e-8a77-4e58-b501-953f7b68d161 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Request method failure captured: Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a HTTP/1.1 Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTtRtIaUCN9plKHAU4sMF0eKPWeSPc3LcSTEAsfYHO6Ia-co9ZPn6puaeremyzCJ1TQjfFH64XFDE8JVb1F9uH606Ok8WhdDHKOcmm8H7JUvsjzsW5arFpGz6CXjDjVzRoJq_6-HaJ4kSxSPzbYSgopkwKzlavAYaW8OixT5z-2qDJfM Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: f872c1ec84314318ac67bfbe7d186b2c Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerActionsTestJSON-1692549662 Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServerActionsTestJSON-1692549662 Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: f872c1ec84314318ac67bfbe7d186b2c Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerActionsTestJSON-1692549662 Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServerActionsTestJSON-1692549662-project Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 92c26a3ccef246d6bb58d7d834f71106 Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServerActionsTestJSON-1692549662-project Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 22669b74-487b-4438-9120-e14517852a0a could not be found. Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '22669b74-487b-4438-9120-e14517852a0a'} Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22669b74-487b-4438-9120-e14517852a0a could not be found. Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:35:50.502732 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:35:50.507176 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22669b74-487b-4438-9120-e14517852a0a could not be found. Oct 18 16:35:50.507176 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:35:50.507176 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:35:50.507176 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:35:50.507176 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:35:50.507176 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:35:50.507176 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:35:50.507176 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:35:50.507176 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:35:50.507176 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22669b74-487b-4438-9120-e14517852a0a could not be found. Oct 18 16:35:50.507176 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:35:50.507176 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-658e505e-8a77-4e58-b501-953f7b68d161 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Returning 404 to user: Instance 22669b74-487b-4438-9120-e14517852a0a could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:35:50.507176 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-658e505e-8a77-4e58-b501-953f7b68d161 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "DELETE /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a" status: 404 len: 111 microversion: 2.1 time: 0.032862 Oct 18 16:35:50.507176 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3588/7194] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 16:35:50 2022] DELETE /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:35:50.513654 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2d6decae-6f60-45f4-840d-2586a8f4b6bc tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:50.514296 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2d6decae-6f60-45f4-840d-2586a8f4b6bc tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: 22669b74-487b-4438-9120-e14517852a0a] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:50.520352 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d6decae-6f60-45f4-840d-2586a8f4b6bc tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:50.520884 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d6decae-6f60-45f4-840d-2586a8f4b6bc tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:50.521350 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d6decae-6f60-45f4-840d-2586a8f4b6bc tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:50.522098 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d6decae-6f60-45f4-840d-2586a8f4b6bc tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:50.522581 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d6decae-6f60-45f4-840d-2586a8f4b6bc tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:50.523029 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2d6decae-6f60-45f4-840d-2586a8f4b6bc tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:50.537566 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-2d6decae-6f60-45f4-840d-2586a8f4b6bc tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] HTTP exception thrown: Instance 22669b74-487b-4438-9120-e14517852a0a could not be found. Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2d6decae-6f60-45f4-840d-2586a8f4b6bc tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Request method failure captured: Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a HTTP/1.1 Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTtRtIaUCN9plKHAU4sMF0eKPWeSPc3LcSTEAsfYHO6Ia-co9ZPn6puaeremyzCJ1TQjfFH64XFDE8JVb1F9uH606Ok8WhdDHKOcmm8H7JUvsjzsW5arFpGz6CXjDjVzRoJq_6-HaJ4kSxSPzbYSgopkwKzlavAYaW8OixT5z-2qDJfM Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: f872c1ec84314318ac67bfbe7d186b2c Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServerActionsTestJSON-1692549662 Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServerActionsTestJSON-1692549662 Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: f872c1ec84314318ac67bfbe7d186b2c Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServerActionsTestJSON-1692549662 Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServerActionsTestJSON-1692549662-project Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 92c26a3ccef246d6bb58d7d834f71106 Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServerActionsTestJSON-1692549662-project Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 22669b74-487b-4438-9120-e14517852a0a could not be found. Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '22669b74-487b-4438-9120-e14517852a0a'} Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22669b74-487b-4438-9120-e14517852a0a could not be found. Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22669b74-487b-4438-9120-e14517852a0a could not be found. Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:35:50.539136 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:35:50.545207 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:35:50.545207 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:35:50.545207 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:35:50.545207 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:35:50.545207 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:35:50.545207 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22669b74-487b-4438-9120-e14517852a0a could not be found. Oct 18 16:35:50.545207 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:35:50.545207 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2d6decae-6f60-45f4-840d-2586a8f4b6bc tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Returning 404 to user: Instance 22669b74-487b-4438-9120-e14517852a0a could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:35:50.545207 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2d6decae-6f60-45f4-840d-2586a8f4b6bc tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a" status: 404 len: 111 microversion: 2.1 time: 0.031653 Oct 18 16:35:50.545207 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3607/7195] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:35:50 2022] GET /compute/v2.1/servers/22669b74-487b-4438-9120-e14517852a0a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:35:50.550233 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1b1490cc-e158-4b40-8549-17c03447c8e1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:50.550734 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1b1490cc-e158-4b40-8549-17c03447c8e1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:50.557356 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b1490cc-e158-4b40-8549-17c03447c8e1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:50.557789 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b1490cc-e158-4b40-8549-17c03447c8e1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:50.558225 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b1490cc-e158-4b40-8549-17c03447c8e1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:50.558913 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b1490cc-e158-4b40-8549-17c03447c8e1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:50.559371 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b1490cc-e158-4b40-8549-17c03447c8e1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:50.559792 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b1490cc-e158-4b40-8549-17c03447c8e1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:50.573943 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-1b1490cc-e158-4b40-8549-17c03447c8e1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] HTTP exception thrown: Instance fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 could not be found. Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1b1490cc-e158-4b40-8549-17c03447c8e1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Request method failure captured: Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 HTTP/1.1 Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTtRtIaUCN9plKHAU4sMF0eKPWeSPc3LcSTEAsfYHO6Ia-co9ZPn6puaeremyzCJ1TQjfFH64XFDE8JVb1F9uH606Ok8WhdDHKOcmm8H7JUvsjzsW5arFpGz6CXjDjVzRoJq_6-HaJ4kSxSPzbYSgopkwKzlavAYaW8OixT5z-2qDJfM Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: f872c1ec84314318ac67bfbe7d186b2c Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerActionsTestJSON-1692549662 Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServerActionsTestJSON-1692549662 Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: f872c1ec84314318ac67bfbe7d186b2c Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerActionsTestJSON-1692549662 Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServerActionsTestJSON-1692549662-project Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 92c26a3ccef246d6bb58d7d834f71106 Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServerActionsTestJSON-1692549662-project Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 could not be found. Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53'} Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 could not be found. Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:35:50.575493 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:35:50.579704 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 could not be found. Oct 18 16:35:50.579704 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:35:50.579704 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:35:50.579704 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:35:50.579704 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:35:50.579704 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:35:50.579704 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:35:50.579704 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:35:50.579704 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:35:50.579704 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 could not be found. Oct 18 16:35:50.579704 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:35:50.579704 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1b1490cc-e158-4b40-8549-17c03447c8e1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Returning 404 to user: Instance fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:35:50.579704 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1b1490cc-e158-4b40-8549-17c03447c8e1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "DELETE /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53" status: 404 len: 111 microversion: 2.1 time: 0.030481 Oct 18 16:35:50.579704 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3589/7196] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 16:35:50 2022] DELETE /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:35:50.585909 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-519fc7a3-5d79-4481-81a0-536da9d6d2f0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:50.586680 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-519fc7a3-5d79-4481-81a0-536da9d6d2f0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [instance: fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:35:50.593139 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-519fc7a3-5d79-4481-81a0-536da9d6d2f0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:50.593647 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-519fc7a3-5d79-4481-81a0-536da9d6d2f0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:50.594104 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-519fc7a3-5d79-4481-81a0-536da9d6d2f0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:50.594860 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-519fc7a3-5d79-4481-81a0-536da9d6d2f0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:35:50.595337 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-519fc7a3-5d79-4481-81a0-536da9d6d2f0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:35:50.595782 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-519fc7a3-5d79-4481-81a0-536da9d6d2f0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:35:50.610192 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-519fc7a3-5d79-4481-81a0-536da9d6d2f0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] HTTP exception thrown: Instance fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 could not be found. Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-519fc7a3-5d79-4481-81a0-536da9d6d2f0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Request method failure captured: Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 HTTP/1.1 Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTtRtIaUCN9plKHAU4sMF0eKPWeSPc3LcSTEAsfYHO6Ia-co9ZPn6puaeremyzCJ1TQjfFH64XFDE8JVb1F9uH606Ok8WhdDHKOcmm8H7JUvsjzsW5arFpGz6CXjDjVzRoJq_6-HaJ4kSxSPzbYSgopkwKzlavAYaW8OixT5z-2qDJfM Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: f872c1ec84314318ac67bfbe7d186b2c Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServerActionsTestJSON-1692549662 Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f872c1ec84314318ac67bfbe7d186b2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServerActionsTestJSON-1692549662 Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: f872c1ec84314318ac67bfbe7d186b2c Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServerActionsTestJSON-1692549662 Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServerActionsTestJSON-1692549662-project Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 92c26a3ccef246d6bb58d7d834f71106 Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServerActionsTestJSON-1692549662-project Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 could not be found. Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53'} Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 could not be found. Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 could not be found. Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:35:50.611766 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:35:50.620057 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:35:50.620057 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:35:50.620057 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:35:50.620057 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:35:50.620057 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:35:50.620057 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 could not be found. Oct 18 16:35:50.620057 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:35:50.620057 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-519fc7a3-5d79-4481-81a0-536da9d6d2f0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Returning 404 to user: Instance fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:35:50.620057 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-519fc7a3-5d79-4481-81a0-536da9d6d2f0 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53" status: 404 len: 111 microversion: 2.1 time: 0.031263 Oct 18 16:35:50.620057 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3608/7197] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:35:50 2022] GET /compute/v2.1/servers/fb0d0c9a-9ea9-4ea5-bc34-e635ed3dcc53 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:35:50.624779 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e5d8bd87-fcab-4057-816a-a9c5ba68e2b1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] Calling method '.version_select at 0x7f7c37bb11f0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:35:50.632211 n-d-853682-5 devstack@n-api.service[120406]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e5d8bd87-fcab-4057-816a-a9c5ba68e2b1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [83d2161b-f939-44f9-a630-bc4e5145228b] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 16:35:51.640692 n-d-853682-5 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [None req-e5d8bd87-fcab-4057-816a-a9c5ba68e2b1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] [83d2161b-f939-44f9-a630-bc4e5145228b] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 39602. Oct 18 16:35:51.661136 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e5d8bd87-fcab-4057-816a-a9c5ba68e2b1 tempest-ServerActionsTestJSON-1692549662 tempest-ServerActionsTestJSON-1692549662-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-85721457" status: 202 len: 0 microversion: 2.1 time: 1.043066 Oct 18 16:35:51.661709 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3590/7198] 10.222.0.60 () {58 vars in 1215 bytes} [Tue Oct 18 16:35:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-85721457 => generated 0 bytes in 1044 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:36:01.079923 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=11 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:36:01.080676 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:36:01.207981 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6c048415-8f57-403c-b609-d223c4dfa5ff tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-959775486", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "fb37b08e-d5fd-4823-baf0-21bcc657bc74"}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:36:01.266388 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-6c048415-8f57-403c-b609-d223c4dfa5ff tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] validate_networks() for [('fb37b08e-d5fd-4823-baf0-21bcc657bc74', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 16:36:01.675794 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-6c048415-8f57-403c-b609-d223c4dfa5ff tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:36:01.676238 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-6c048415-8f57-403c-b609-d223c4dfa5ff tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:36:01.676732 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-6c048415-8f57-403c-b609-d223c4dfa5ff tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:36:01.677192 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-6c048415-8f57-403c-b609-d223c4dfa5ff tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:36:01.677627 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-6c048415-8f57-403c-b609-d223c4dfa5ff tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:36:01.690547 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6c048415-8f57-403c-b609-d223c4dfa5ff tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:01.690981 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6c048415-8f57-403c-b609-d223c4dfa5ff tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:01.691784 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6c048415-8f57-403c-b609-d223c4dfa5ff tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:01.692756 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6c048415-8f57-403c-b609-d223c4dfa5ff tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:01.693425 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6c048415-8f57-403c-b609-d223c4dfa5ff tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:01.694260 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6c048415-8f57-403c-b609-d223c4dfa5ff tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:01.712841 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-6c048415-8f57-403c-b609-d223c4dfa5ff tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Getting quotas for project f94cc7d578a544f183c18e1dfa79f12d. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:36:01.718175 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-6c048415-8f57-403c-b609-d223c4dfa5ff tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Getting quotas for user 0bbc6d1ac4f0499aadf786fde42535ab and project f94cc7d578a544f183c18e1dfa79f12d. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:36:01.732387 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6c048415-8f57-403c-b609-d223c4dfa5ff tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:36:01.734693 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6c048415-8f57-403c-b609-d223c4dfa5ff tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] [instance: 4db8876d-feae-4e3a-8388-488608d71208] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:36:01.781229 n-d-853682-5 devstack@n-api.service[120405]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6c048415-8f57-403c-b609-d223c4dfa5ff tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] [5cfaa717-1349-4c0c-be5e-a57d65daba4c] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 16:36:02.789246 n-d-853682-5 devstack@n-api.service[120405]: INFO oslo.messaging._drivers.impl_rabbit [None req-6c048415-8f57-403c-b609-d223c4dfa5ff tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] [5cfaa717-1349-4c0c-be5e-a57d65daba4c] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 39682. Oct 18 16:36:02.795196 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6c048415-8f57-403c-b609-d223c4dfa5ff tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.720256 Oct 18 16:36:02.796410 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3609/7199] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 16:36:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:36:02.805373 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=19 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:36:02.806186 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:36:02.810683 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-72f59172-d86f-4020-a25e-8a91a8fc4ab0 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:36:02.811390 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-72f59172-d86f-4020-a25e-8a91a8fc4ab0 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] [instance: 4db8876d-feae-4e3a-8388-488608d71208] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:36:02.869476 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-72f59172-d86f-4020-a25e-8a91a8fc4ab0 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbc6d1ac4f0499aadf786fde42535ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f94cc7d578a544f183c18e1dfa79f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:36:02.876757 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-72f59172-d86f-4020-a25e-8a91a8fc4ab0 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] 10.222.0.60 "GET /compute/v2.1/servers/4db8876d-feae-4e3a-8388-488608d71208" status: 200 len: 1216 microversion: 2.1 time: 0.073154 Oct 18 16:36:02.877370 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3591/7200] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:36:02 2022] GET /compute/v2.1/servers/4db8876d-feae-4e3a-8388-488608d71208 => generated 1216 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:36:03.901909 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9c58e1ac-9d09-4724-ade8-472969f8aba2 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:36:03.902637 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9c58e1ac-9d09-4724-ade8-472969f8aba2 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] [instance: 4db8876d-feae-4e3a-8388-488608d71208] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:36:03.957336 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9c58e1ac-9d09-4724-ade8-472969f8aba2 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbc6d1ac4f0499aadf786fde42535ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f94cc7d578a544f183c18e1dfa79f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:36:03.964888 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9c58e1ac-9d09-4724-ade8-472969f8aba2 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] 10.222.0.60 "GET /compute/v2.1/servers/4db8876d-feae-4e3a-8388-488608d71208" status: 200 len: 1216 microversion: 2.1 time: 0.068862 Oct 18 16:36:03.965733 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3610/7201] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:36:03 2022] GET /compute/v2.1/servers/4db8876d-feae-4e3a-8388-488608d71208 => generated 1216 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:36:04.987360 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6f0be7c4-8f59-40a5-b58e-9d90b76a702c tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:36:04.988066 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6f0be7c4-8f59-40a5-b58e-9d90b76a702c tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] [instance: 4db8876d-feae-4e3a-8388-488608d71208] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:36:05.048323 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6f0be7c4-8f59-40a5-b58e-9d90b76a702c tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbc6d1ac4f0499aadf786fde42535ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f94cc7d578a544f183c18e1dfa79f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:36:05.057545 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6f0be7c4-8f59-40a5-b58e-9d90b76a702c tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] 10.222.0.60 "GET /compute/v2.1/servers/4db8876d-feae-4e3a-8388-488608d71208" status: 200 len: 1216 microversion: 2.1 time: 0.074024 Oct 18 16:36:05.058134 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3592/7202] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:36:04 2022] GET /compute/v2.1/servers/4db8876d-feae-4e3a-8388-488608d71208 => generated 1216 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:36:06.079633 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7b57d52e-491c-42ac-b0af-c878a247d19d tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:36:06.080293 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7b57d52e-491c-42ac-b0af-c878a247d19d tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] [instance: 4db8876d-feae-4e3a-8388-488608d71208] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:36:06.133492 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7b57d52e-491c-42ac-b0af-c878a247d19d tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbc6d1ac4f0499aadf786fde42535ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f94cc7d578a544f183c18e1dfa79f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:36:06.141219 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7b57d52e-491c-42ac-b0af-c878a247d19d tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] 10.222.0.60 "GET /compute/v2.1/servers/4db8876d-feae-4e3a-8388-488608d71208" status: 200 len: 1216 microversion: 2.1 time: 0.065515 Oct 18 16:36:06.141836 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3611/7203] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:36:06 2022] GET /compute/v2.1/servers/4db8876d-feae-4e3a-8388-488608d71208 => generated 1216 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:36:07.166931 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-91e696bb-9016-4229-b3cc-301c6793eb56 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:36:07.167548 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-91e696bb-9016-4229-b3cc-301c6793eb56 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] [instance: 4db8876d-feae-4e3a-8388-488608d71208] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:36:07.173985 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91e696bb-9016-4229-b3cc-301c6793eb56 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:07.174469 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91e696bb-9016-4229-b3cc-301c6793eb56 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:07.174908 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91e696bb-9016-4229-b3cc-301c6793eb56 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:07.175600 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91e696bb-9016-4229-b3cc-301c6793eb56 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:07.176064 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91e696bb-9016-4229-b3cc-301c6793eb56 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:07.176492 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91e696bb-9016-4229-b3cc-301c6793eb56 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:07.239124 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-91e696bb-9016-4229-b3cc-301c6793eb56 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbc6d1ac4f0499aadf786fde42535ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f94cc7d578a544f183c18e1dfa79f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:36:07.247420 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-91e696bb-9016-4229-b3cc-301c6793eb56 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] 10.222.0.60 "GET /compute/v2.1/servers/4db8876d-feae-4e3a-8388-488608d71208" status: 200 len: 1220 microversion: 2.1 time: 0.085206 Oct 18 16:36:07.248006 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3593/7204] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:36:07 2022] GET /compute/v2.1/servers/4db8876d-feae-4e3a-8388-488608d71208 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:36:08.270744 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4371b4f6-0b82-428f-95f8-6c4e06a89a9b tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:36:08.271383 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4371b4f6-0b82-428f-95f8-6c4e06a89a9b tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] [instance: 4db8876d-feae-4e3a-8388-488608d71208] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:36:08.279086 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4371b4f6-0b82-428f-95f8-6c4e06a89a9b tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:08.279598 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4371b4f6-0b82-428f-95f8-6c4e06a89a9b tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:08.280054 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4371b4f6-0b82-428f-95f8-6c4e06a89a9b tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:08.280774 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4371b4f6-0b82-428f-95f8-6c4e06a89a9b tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:08.281281 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4371b4f6-0b82-428f-95f8-6c4e06a89a9b tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:08.281728 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4371b4f6-0b82-428f-95f8-6c4e06a89a9b tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:08.344336 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4371b4f6-0b82-428f-95f8-6c4e06a89a9b tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbc6d1ac4f0499aadf786fde42535ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f94cc7d578a544f183c18e1dfa79f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:36:08.352488 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4371b4f6-0b82-428f-95f8-6c4e06a89a9b tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] 10.222.0.60 "GET /compute/v2.1/servers/4db8876d-feae-4e3a-8388-488608d71208" status: 200 len: 1274 microversion: 2.1 time: 0.085776 Oct 18 16:36:08.353185 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3612/7205] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:36:08 2022] GET /compute/v2.1/servers/4db8876d-feae-4e3a-8388-488608d71208 => generated 1274 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:36:09.182848 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-a2923843-2165-4c60-bb73-50992bbdae39 req-de775e8a-6508-4cf3-88fa-41cb5dcfe33f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4db8876d-feae-4e3a-8388-488608d71208", "tag": "52fea546-e088-4cb6-844c-67665ebfb708"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:36:09.194241 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a2923843-2165-4c60-bb73-50992bbdae39 req-de775e8a-6508-4cf3-88fa-41cb5dcfe33f service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:09.194594 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a2923843-2165-4c60-bb73-50992bbdae39 req-de775e8a-6508-4cf3-88fa-41cb5dcfe33f service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:09.195022 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a2923843-2165-4c60-bb73-50992bbdae39 req-de775e8a-6508-4cf3-88fa-41cb5dcfe33f service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:09.207165 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-a2923843-2165-4c60-bb73-50992bbdae39 req-de775e8a-6508-4cf3-88fa-41cb5dcfe33f service nova] Creating event network-changed:52fea546-e088-4cb6-844c-67665ebfb708 for instance 4db8876d-feae-4e3a-8388-488608d71208 on n-h2-853682-5 Oct 18 16:36:09.212606 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-a2923843-2165-4c60-bb73-50992bbdae39 req-de775e8a-6508-4cf3-88fa-41cb5dcfe33f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034326 Oct 18 16:36:09.213410 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3594/7206] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:36:09.375799 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-aa77c8e5-714f-48cb-8311-0db20c5d05dc tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:36:09.376446 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-aa77c8e5-714f-48cb-8311-0db20c5d05dc tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] [instance: 4db8876d-feae-4e3a-8388-488608d71208] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:36:09.383973 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aa77c8e5-714f-48cb-8311-0db20c5d05dc tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:09.384508 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aa77c8e5-714f-48cb-8311-0db20c5d05dc tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:09.384992 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aa77c8e5-714f-48cb-8311-0db20c5d05dc tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:09.385754 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aa77c8e5-714f-48cb-8311-0db20c5d05dc tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:09.386232 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aa77c8e5-714f-48cb-8311-0db20c5d05dc tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:09.386681 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aa77c8e5-714f-48cb-8311-0db20c5d05dc tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:09.520763 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-aa77c8e5-714f-48cb-8311-0db20c5d05dc tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbc6d1ac4f0499aadf786fde42535ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f94cc7d578a544f183c18e1dfa79f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:36:09.529698 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-aa77c8e5-714f-48cb-8311-0db20c5d05dc tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] 10.222.0.60 "GET /compute/v2.1/servers/4db8876d-feae-4e3a-8388-488608d71208" status: 200 len: 1316 microversion: 2.1 time: 0.157945 Oct 18 16:36:09.530362 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3613/7207] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:36:09 2022] GET /compute/v2.1/servers/4db8876d-feae-4e3a-8388-488608d71208 => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:36:10.553526 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c5d45a05-1b64-4b20-9970-a2c854a86300 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:36:10.554212 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c5d45a05-1b64-4b20-9970-a2c854a86300 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] [instance: 4db8876d-feae-4e3a-8388-488608d71208] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:36:10.560310 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5d45a05-1b64-4b20-9970-a2c854a86300 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:10.560786 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5d45a05-1b64-4b20-9970-a2c854a86300 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:10.561244 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5d45a05-1b64-4b20-9970-a2c854a86300 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:10.561930 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5d45a05-1b64-4b20-9970-a2c854a86300 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:10.562373 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5d45a05-1b64-4b20-9970-a2c854a86300 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:10.562792 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5d45a05-1b64-4b20-9970-a2c854a86300 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:10.701547 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c5d45a05-1b64-4b20-9970-a2c854a86300 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbc6d1ac4f0499aadf786fde42535ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f94cc7d578a544f183c18e1dfa79f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:36:10.709721 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c5d45a05-1b64-4b20-9970-a2c854a86300 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] 10.222.0.60 "GET /compute/v2.1/servers/4db8876d-feae-4e3a-8388-488608d71208" status: 200 len: 1316 microversion: 2.1 time: 0.161207 Oct 18 16:36:10.710634 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3595/7208] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:36:10 2022] GET /compute/v2.1/servers/4db8876d-feae-4e3a-8388-488608d71208 => generated 1316 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:36:11.734018 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b4e2ab2c-fc60-4fe7-abf7-6a4b34353e7b tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:36:11.734652 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b4e2ab2c-fc60-4fe7-abf7-6a4b34353e7b tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] [instance: 4db8876d-feae-4e3a-8388-488608d71208] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:36:11.737750 n-d-853682-5 devstack@n-api.service[120405]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 16:36:11.737885 n-d-853682-5 devstack@n-api.service[120405]: Tue Oct 18 16:36:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4db8876d-feae-4e3a-8388-488608d71208 (ip 10.222.0.60) !!! Oct 18 16:36:11.738855 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:36:11.751573 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b4e2ab2c-fc60-4fe7-abf7-6a4b34353e7b tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:11.752076 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b4e2ab2c-fc60-4fe7-abf7-6a4b34353e7b tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:11.752533 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b4e2ab2c-fc60-4fe7-abf7-6a4b34353e7b tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:11.753284 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b4e2ab2c-fc60-4fe7-abf7-6a4b34353e7b tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:11.753758 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b4e2ab2c-fc60-4fe7-abf7-6a4b34353e7b tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:11.754201 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b4e2ab2c-fc60-4fe7-abf7-6a4b34353e7b tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:11.888511 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b4e2ab2c-fc60-4fe7-abf7-6a4b34353e7b tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbc6d1ac4f0499aadf786fde42535ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f94cc7d578a544f183c18e1dfa79f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:36:11.896249 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b4e2ab2c-fc60-4fe7-abf7-6a4b34353e7b tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] 10.222.0.60 "GET /compute/v2.1/servers/4db8876d-feae-4e3a-8388-488608d71208" status: 200 len: 1316 microversion: 2.1 time: 0.166184 Oct 18 16:36:11.896871 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3614/7209] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:36:11 2022] GET /compute/v2.1/servers/4db8876d-feae-4e3a-8388-488608d71208 => generated 1316 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:36:12.919844 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8a9cc0f8-70be-43d4-acdb-855f57043285 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:36:12.920439 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8a9cc0f8-70be-43d4-acdb-855f57043285 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] [instance: 4db8876d-feae-4e3a-8388-488608d71208] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:36:12.927151 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a9cc0f8-70be-43d4-acdb-855f57043285 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:12.927632 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a9cc0f8-70be-43d4-acdb-855f57043285 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:12.928053 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a9cc0f8-70be-43d4-acdb-855f57043285 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:12.928734 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a9cc0f8-70be-43d4-acdb-855f57043285 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:12.929207 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a9cc0f8-70be-43d4-acdb-855f57043285 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:12.929626 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a9cc0f8-70be-43d4-acdb-855f57043285 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:13.061716 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8a9cc0f8-70be-43d4-acdb-855f57043285 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbc6d1ac4f0499aadf786fde42535ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f94cc7d578a544f183c18e1dfa79f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:36:13.069407 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8a9cc0f8-70be-43d4-acdb-855f57043285 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] 10.222.0.60 "GET /compute/v2.1/servers/4db8876d-feae-4e3a-8388-488608d71208" status: 200 len: 1316 microversion: 2.1 time: 0.153560 Oct 18 16:36:13.069977 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3596/7210] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:36:12 2022] GET /compute/v2.1/servers/4db8876d-feae-4e3a-8388-488608d71208 => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:36:14.092799 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-172c9e58-190c-42c3-9dce-e26498cf9642 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:36:14.093460 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-172c9e58-190c-42c3-9dce-e26498cf9642 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] [instance: 4db8876d-feae-4e3a-8388-488608d71208] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:36:14.100287 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-172c9e58-190c-42c3-9dce-e26498cf9642 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:14.100786 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-172c9e58-190c-42c3-9dce-e26498cf9642 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:14.101289 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-172c9e58-190c-42c3-9dce-e26498cf9642 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:14.101998 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-172c9e58-190c-42c3-9dce-e26498cf9642 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:14.103141 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-172c9e58-190c-42c3-9dce-e26498cf9642 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:14.103583 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-172c9e58-190c-42c3-9dce-e26498cf9642 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:14.238978 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-172c9e58-190c-42c3-9dce-e26498cf9642 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbc6d1ac4f0499aadf786fde42535ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f94cc7d578a544f183c18e1dfa79f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:36:14.246940 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-172c9e58-190c-42c3-9dce-e26498cf9642 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] 10.222.0.60 "GET /compute/v2.1/servers/4db8876d-feae-4e3a-8388-488608d71208" status: 200 len: 1316 microversion: 2.1 time: 0.158100 Oct 18 16:36:14.247531 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3615/7211] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:36:14 2022] GET /compute/v2.1/servers/4db8876d-feae-4e3a-8388-488608d71208 => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:36:14.338481 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-82ac9bbf-7604-4a41-b773-ccb0c495578c req-17308f05-c44f-4d6b-9cb4-074f932507ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4db8876d-feae-4e3a-8388-488608d71208", "name": "network-vif-plugged", "status": "completed", "tag": "52fea546-e088-4cb6-844c-67665ebfb708"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:36:14.349048 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-82ac9bbf-7604-4a41-b773-ccb0c495578c req-17308f05-c44f-4d6b-9cb4-074f932507ac service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:14.349795 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-82ac9bbf-7604-4a41-b773-ccb0c495578c req-17308f05-c44f-4d6b-9cb4-074f932507ac service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:14.350280 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-82ac9bbf-7604-4a41-b773-ccb0c495578c req-17308f05-c44f-4d6b-9cb4-074f932507ac service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:14.363268 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-82ac9bbf-7604-4a41-b773-ccb0c495578c req-17308f05-c44f-4d6b-9cb4-074f932507ac service nova] Creating event network-vif-plugged:52fea546-e088-4cb6-844c-67665ebfb708 for instance 4db8876d-feae-4e3a-8388-488608d71208 on n-h2-853682-5 Oct 18 16:36:14.368382 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-82ac9bbf-7604-4a41-b773-ccb0c495578c req-17308f05-c44f-4d6b-9cb4-074f932507ac service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034073 Oct 18 16:36:14.369347 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3597/7212] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:36:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:36:15.269834 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0e195dbe-6f01-4e10-84d6-e70875913fd4 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:36:15.270476 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0e195dbe-6f01-4e10-84d6-e70875913fd4 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] [instance: 4db8876d-feae-4e3a-8388-488608d71208] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:36:15.277384 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0e195dbe-6f01-4e10-84d6-e70875913fd4 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:15.277887 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0e195dbe-6f01-4e10-84d6-e70875913fd4 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:15.278344 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0e195dbe-6f01-4e10-84d6-e70875913fd4 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:15.279059 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0e195dbe-6f01-4e10-84d6-e70875913fd4 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:15.279535 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0e195dbe-6f01-4e10-84d6-e70875913fd4 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:15.279990 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0e195dbe-6f01-4e10-84d6-e70875913fd4 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:15.417650 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0e195dbe-6f01-4e10-84d6-e70875913fd4 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbc6d1ac4f0499aadf786fde42535ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f94cc7d578a544f183c18e1dfa79f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:36:15.425323 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0e195dbe-6f01-4e10-84d6-e70875913fd4 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] 10.222.0.60 "GET /compute/v2.1/servers/4db8876d-feae-4e3a-8388-488608d71208" status: 200 len: 1316 microversion: 2.1 time: 0.159490 Oct 18 16:36:15.425898 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3616/7213] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:36:15 2022] GET /compute/v2.1/servers/4db8876d-feae-4e3a-8388-488608d71208 => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:36:16.445400 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:36:16.452489 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8b6fc9fc-a1fa-4354-a627-d94c6285a9dc tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:36:16.453206 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8b6fc9fc-a1fa-4354-a627-d94c6285a9dc tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] [instance: 4db8876d-feae-4e3a-8388-488608d71208] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:36:16.459674 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b6fc9fc-a1fa-4354-a627-d94c6285a9dc tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:16.460154 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b6fc9fc-a1fa-4354-a627-d94c6285a9dc tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:16.460585 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b6fc9fc-a1fa-4354-a627-d94c6285a9dc tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:16.461297 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b6fc9fc-a1fa-4354-a627-d94c6285a9dc tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:16.462294 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b6fc9fc-a1fa-4354-a627-d94c6285a9dc tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:16.462720 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b6fc9fc-a1fa-4354-a627-d94c6285a9dc tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:16.596606 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8b6fc9fc-a1fa-4354-a627-d94c6285a9dc tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbc6d1ac4f0499aadf786fde42535ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f94cc7d578a544f183c18e1dfa79f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:36:16.605354 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8b6fc9fc-a1fa-4354-a627-d94c6285a9dc tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] 10.222.0.60 "GET /compute/v2.1/servers/4db8876d-feae-4e3a-8388-488608d71208" status: 200 len: 1504 microversion: 2.1 time: 0.161312 Oct 18 16:36:16.605942 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3598/7214] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:36:16 2022] GET /compute/v2.1/servers/4db8876d-feae-4e3a-8388-488608d71208 => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:36:16.667133 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-979ea666-4e0b-4359-86ed-8c81c07f3b94 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1270462731", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "fb37b08e-d5fd-4823-baf0-21bcc657bc74"}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:36:16.675574 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=10 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:36:16.725291 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-979ea666-4e0b-4359-86ed-8c81c07f3b94 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] validate_networks() for [('fb37b08e-d5fd-4823-baf0-21bcc657bc74', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 16:36:17.100034 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-979ea666-4e0b-4359-86ed-8c81c07f3b94 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:36:17.100513 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-979ea666-4e0b-4359-86ed-8c81c07f3b94 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:36:17.101048 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-979ea666-4e0b-4359-86ed-8c81c07f3b94 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:36:17.101486 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-979ea666-4e0b-4359-86ed-8c81c07f3b94 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:36:17.102187 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-979ea666-4e0b-4359-86ed-8c81c07f3b94 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:36:17.110609 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-979ea666-4e0b-4359-86ed-8c81c07f3b94 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:17.111146 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-979ea666-4e0b-4359-86ed-8c81c07f3b94 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:17.111605 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-979ea666-4e0b-4359-86ed-8c81c07f3b94 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:17.112357 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-979ea666-4e0b-4359-86ed-8c81c07f3b94 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:17.112863 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-979ea666-4e0b-4359-86ed-8c81c07f3b94 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:17.113317 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-979ea666-4e0b-4359-86ed-8c81c07f3b94 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:17.130374 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-979ea666-4e0b-4359-86ed-8c81c07f3b94 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Getting quotas for project f94cc7d578a544f183c18e1dfa79f12d. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:36:17.136009 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-979ea666-4e0b-4359-86ed-8c81c07f3b94 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Getting quotas for user 0bbc6d1ac4f0499aadf786fde42535ab and project f94cc7d578a544f183c18e1dfa79f12d. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:36:17.148218 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-979ea666-4e0b-4359-86ed-8c81c07f3b94 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:36:17.150434 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-979ea666-4e0b-4359-86ed-8c81c07f3b94 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] [instance: 65daf248-5e31-4e72-9d33-dc81f8d95d72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:36:17.196764 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-979ea666-4e0b-4359-86ed-8c81c07f3b94 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.533858 Oct 18 16:36:17.197452 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3617/7215] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 16:36:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:36:17.208906 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fd5b0c74-2777-4916-9867-b48c3a805c69 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:36:17.209667 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fd5b0c74-2777-4916-9867-b48c3a805c69 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] [instance: 65daf248-5e31-4e72-9d33-dc81f8d95d72] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:36:17.269854 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fd5b0c74-2777-4916-9867-b48c3a805c69 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbc6d1ac4f0499aadf786fde42535ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f94cc7d578a544f183c18e1dfa79f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:36:17.278715 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fd5b0c74-2777-4916-9867-b48c3a805c69 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] 10.222.0.60 "GET /compute/v2.1/servers/65daf248-5e31-4e72-9d33-dc81f8d95d72" status: 200 len: 1217 microversion: 2.1 time: 0.073530 Oct 18 16:36:17.279148 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3599/7216] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:36:17 2022] GET /compute/v2.1/servers/65daf248-5e31-4e72-9d33-dc81f8d95d72 => generated 1217 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:36:18.302448 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4af1cca4-56fa-4ac8-9370-6edaafe3d367 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:36:18.303078 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4af1cca4-56fa-4ac8-9370-6edaafe3d367 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] [instance: 65daf248-5e31-4e72-9d33-dc81f8d95d72] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:36:18.312915 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4af1cca4-56fa-4ac8-9370-6edaafe3d367 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:18.313994 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4af1cca4-56fa-4ac8-9370-6edaafe3d367 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:18.314678 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4af1cca4-56fa-4ac8-9370-6edaafe3d367 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:18.315747 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4af1cca4-56fa-4ac8-9370-6edaafe3d367 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:18.316505 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4af1cca4-56fa-4ac8-9370-6edaafe3d367 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:18.317231 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4af1cca4-56fa-4ac8-9370-6edaafe3d367 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:18.406946 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4af1cca4-56fa-4ac8-9370-6edaafe3d367 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbc6d1ac4f0499aadf786fde42535ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f94cc7d578a544f183c18e1dfa79f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:36:18.414888 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4af1cca4-56fa-4ac8-9370-6edaafe3d367 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] 10.222.0.60 "GET /compute/v2.1/servers/65daf248-5e31-4e72-9d33-dc81f8d95d72" status: 200 len: 1287 microversion: 2.1 time: 0.117395 Oct 18 16:36:18.415730 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3618/7217] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:36:18 2022] GET /compute/v2.1/servers/65daf248-5e31-4e72-9d33-dc81f8d95d72 => generated 1287 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:36:19.438775 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e445e7f6-0322-4e18-8d58-a0bdd8994328 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:36:19.439507 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e445e7f6-0322-4e18-8d58-a0bdd8994328 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] [instance: 65daf248-5e31-4e72-9d33-dc81f8d95d72] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:36:19.456368 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e445e7f6-0322-4e18-8d58-a0bdd8994328 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:19.456885 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e445e7f6-0322-4e18-8d58-a0bdd8994328 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:19.457331 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e445e7f6-0322-4e18-8d58-a0bdd8994328 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:19.458034 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e445e7f6-0322-4e18-8d58-a0bdd8994328 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:19.458492 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e445e7f6-0322-4e18-8d58-a0bdd8994328 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:19.458919 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e445e7f6-0322-4e18-8d58-a0bdd8994328 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:19.671736 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e445e7f6-0322-4e18-8d58-a0bdd8994328 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbc6d1ac4f0499aadf786fde42535ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f94cc7d578a544f183c18e1dfa79f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:36:19.680072 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e445e7f6-0322-4e18-8d58-a0bdd8994328 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] 10.222.0.60 "GET /compute/v2.1/servers/65daf248-5e31-4e72-9d33-dc81f8d95d72" status: 200 len: 1317 microversion: 2.1 time: 0.245187 Oct 18 16:36:19.680994 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3600/7218] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:36:19 2022] GET /compute/v2.1/servers/65daf248-5e31-4e72-9d33-dc81f8d95d72 => generated 1317 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:36:19.717312 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-4b5cb1bb-9e4e-4155-a8c2-4d7d61403c07 req-bbac6856-b437-41e1-97c5-cb5319fd1b1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65daf248-5e31-4e72-9d33-dc81f8d95d72", "tag": "f283c602-b5e4-4d1c-84db-51e3d5196edf"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:36:19.730764 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-4b5cb1bb-9e4e-4155-a8c2-4d7d61403c07 req-bbac6856-b437-41e1-97c5-cb5319fd1b1d service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:19.731361 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-4b5cb1bb-9e4e-4155-a8c2-4d7d61403c07 req-bbac6856-b437-41e1-97c5-cb5319fd1b1d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:19.731878 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-4b5cb1bb-9e4e-4155-a8c2-4d7d61403c07 req-bbac6856-b437-41e1-97c5-cb5319fd1b1d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:19.743683 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-4b5cb1bb-9e4e-4155-a8c2-4d7d61403c07 req-bbac6856-b437-41e1-97c5-cb5319fd1b1d service nova] Creating event network-changed:f283c602-b5e4-4d1c-84db-51e3d5196edf for instance 65daf248-5e31-4e72-9d33-dc81f8d95d72 on n-h1-853682-5 Oct 18 16:36:19.751058 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-4b5cb1bb-9e4e-4155-a8c2-4d7d61403c07 req-bbac6856-b437-41e1-97c5-cb5319fd1b1d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039171 Oct 18 16:36:19.752288 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3619/7219] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:36:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:36:20.704027 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-54d2cdf1-e2fe-4412-b817-96a493a77b2d tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:36:20.718642 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-54d2cdf1-e2fe-4412-b817-96a493a77b2d tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] [instance: 65daf248-5e31-4e72-9d33-dc81f8d95d72] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:36:20.718642 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54d2cdf1-e2fe-4412-b817-96a493a77b2d tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:20.718642 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54d2cdf1-e2fe-4412-b817-96a493a77b2d tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:20.718642 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54d2cdf1-e2fe-4412-b817-96a493a77b2d tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:20.718642 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54d2cdf1-e2fe-4412-b817-96a493a77b2d tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:20.718642 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54d2cdf1-e2fe-4412-b817-96a493a77b2d tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:20.718642 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54d2cdf1-e2fe-4412-b817-96a493a77b2d tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:20.847901 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-54d2cdf1-e2fe-4412-b817-96a493a77b2d tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbc6d1ac4f0499aadf786fde42535ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f94cc7d578a544f183c18e1dfa79f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:36:20.855570 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-54d2cdf1-e2fe-4412-b817-96a493a77b2d tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] 10.222.0.60 "GET /compute/v2.1/servers/65daf248-5e31-4e72-9d33-dc81f8d95d72" status: 200 len: 1317 microversion: 2.1 time: 0.155541 Oct 18 16:36:20.856137 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3601/7220] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:36:20 2022] GET /compute/v2.1/servers/65daf248-5e31-4e72-9d33-dc81f8d95d72 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:36:21.879296 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bf2c52e2-15cb-4ec4-bff5-49053f0e33b8 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:36:21.880015 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-bf2c52e2-15cb-4ec4-bff5-49053f0e33b8 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] [instance: 65daf248-5e31-4e72-9d33-dc81f8d95d72] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:36:21.887942 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bf2c52e2-15cb-4ec4-bff5-49053f0e33b8 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:21.888437 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bf2c52e2-15cb-4ec4-bff5-49053f0e33b8 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:21.888920 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bf2c52e2-15cb-4ec4-bff5-49053f0e33b8 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:21.889631 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bf2c52e2-15cb-4ec4-bff5-49053f0e33b8 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:21.890103 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bf2c52e2-15cb-4ec4-bff5-49053f0e33b8 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:21.890544 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bf2c52e2-15cb-4ec4-bff5-49053f0e33b8 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:22.019693 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-bf2c52e2-15cb-4ec4-bff5-49053f0e33b8 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbc6d1ac4f0499aadf786fde42535ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f94cc7d578a544f183c18e1dfa79f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:36:22.027515 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-bf2c52e2-15cb-4ec4-bff5-49053f0e33b8 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] 10.222.0.60 "GET /compute/v2.1/servers/65daf248-5e31-4e72-9d33-dc81f8d95d72" status: 200 len: 1317 microversion: 2.1 time: 0.152574 Oct 18 16:36:22.028095 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3620/7221] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:36:21 2022] GET /compute/v2.1/servers/65daf248-5e31-4e72-9d33-dc81f8d95d72 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:36:23.050887 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d8abd813-23fa-4acc-b46e-ee8db43ad316 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:36:23.051612 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d8abd813-23fa-4acc-b46e-ee8db43ad316 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] [instance: 65daf248-5e31-4e72-9d33-dc81f8d95d72] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:36:23.059461 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8abd813-23fa-4acc-b46e-ee8db43ad316 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:23.059944 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8abd813-23fa-4acc-b46e-ee8db43ad316 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:23.060406 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8abd813-23fa-4acc-b46e-ee8db43ad316 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:23.061128 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8abd813-23fa-4acc-b46e-ee8db43ad316 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:23.061588 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8abd813-23fa-4acc-b46e-ee8db43ad316 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:23.062012 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8abd813-23fa-4acc-b46e-ee8db43ad316 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:23.195546 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d8abd813-23fa-4acc-b46e-ee8db43ad316 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbc6d1ac4f0499aadf786fde42535ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f94cc7d578a544f183c18e1dfa79f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:36:23.203239 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d8abd813-23fa-4acc-b46e-ee8db43ad316 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] 10.222.0.60 "GET /compute/v2.1/servers/65daf248-5e31-4e72-9d33-dc81f8d95d72" status: 200 len: 1317 microversion: 2.1 time: 0.156266 Oct 18 16:36:23.203818 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3602/7222] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:36:23 2022] GET /compute/v2.1/servers/65daf248-5e31-4e72-9d33-dc81f8d95d72 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:36:24.226618 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d5e07863-bb19-4468-92b1-21ee61209f67 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:36:24.227255 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d5e07863-bb19-4468-92b1-21ee61209f67 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] [instance: 65daf248-5e31-4e72-9d33-dc81f8d95d72] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:36:24.234418 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d5e07863-bb19-4468-92b1-21ee61209f67 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:24.234920 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d5e07863-bb19-4468-92b1-21ee61209f67 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:24.235376 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d5e07863-bb19-4468-92b1-21ee61209f67 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:24.236114 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d5e07863-bb19-4468-92b1-21ee61209f67 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:24.236591 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d5e07863-bb19-4468-92b1-21ee61209f67 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:24.237066 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d5e07863-bb19-4468-92b1-21ee61209f67 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:24.370568 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d5e07863-bb19-4468-92b1-21ee61209f67 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbc6d1ac4f0499aadf786fde42535ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f94cc7d578a544f183c18e1dfa79f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:36:24.378216 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d5e07863-bb19-4468-92b1-21ee61209f67 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] 10.222.0.60 "GET /compute/v2.1/servers/65daf248-5e31-4e72-9d33-dc81f8d95d72" status: 200 len: 1317 microversion: 2.1 time: 0.155554 Oct 18 16:36:24.378802 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3621/7223] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:36:24 2022] GET /compute/v2.1/servers/65daf248-5e31-4e72-9d33-dc81f8d95d72 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:36:25.401407 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8ef0c562-22f9-48f1-af5d-b8a95ffc56ea tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:36:25.402025 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8ef0c562-22f9-48f1-af5d-b8a95ffc56ea tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] [instance: 65daf248-5e31-4e72-9d33-dc81f8d95d72] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:36:25.408836 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ef0c562-22f9-48f1-af5d-b8a95ffc56ea tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:25.409324 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ef0c562-22f9-48f1-af5d-b8a95ffc56ea tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:25.409762 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ef0c562-22f9-48f1-af5d-b8a95ffc56ea tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:25.410466 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ef0c562-22f9-48f1-af5d-b8a95ffc56ea tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:25.410954 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ef0c562-22f9-48f1-af5d-b8a95ffc56ea tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:25.411384 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ef0c562-22f9-48f1-af5d-b8a95ffc56ea tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:25.546087 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8ef0c562-22f9-48f1-af5d-b8a95ffc56ea tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbc6d1ac4f0499aadf786fde42535ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f94cc7d578a544f183c18e1dfa79f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:36:25.554389 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8ef0c562-22f9-48f1-af5d-b8a95ffc56ea tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] 10.222.0.60 "GET /compute/v2.1/servers/65daf248-5e31-4e72-9d33-dc81f8d95d72" status: 200 len: 1317 microversion: 2.1 time: 0.157391 Oct 18 16:36:25.555046 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3603/7224] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:36:25 2022] GET /compute/v2.1/servers/65daf248-5e31-4e72-9d33-dc81f8d95d72 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:36:26.578346 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-12e07a72-4a11-453a-a286-8d6e29db6022 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:36:26.578988 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-12e07a72-4a11-453a-a286-8d6e29db6022 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] [instance: 65daf248-5e31-4e72-9d33-dc81f8d95d72] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:36:26.585377 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12e07a72-4a11-453a-a286-8d6e29db6022 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:26.585882 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12e07a72-4a11-453a-a286-8d6e29db6022 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:26.586423 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12e07a72-4a11-453a-a286-8d6e29db6022 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:26.587142 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12e07a72-4a11-453a-a286-8d6e29db6022 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:26.588206 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12e07a72-4a11-453a-a286-8d6e29db6022 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:26.588732 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12e07a72-4a11-453a-a286-8d6e29db6022 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:26.720314 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-12e07a72-4a11-453a-a286-8d6e29db6022 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbc6d1ac4f0499aadf786fde42535ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f94cc7d578a544f183c18e1dfa79f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:36:26.728336 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-12e07a72-4a11-453a-a286-8d6e29db6022 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] 10.222.0.60 "GET /compute/v2.1/servers/65daf248-5e31-4e72-9d33-dc81f8d95d72" status: 200 len: 1317 microversion: 2.1 time: 0.153943 Oct 18 16:36:26.729061 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3622/7225] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:36:26 2022] GET /compute/v2.1/servers/65daf248-5e31-4e72-9d33-dc81f8d95d72 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:36:26.812416 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-6db08045-5738-4080-b59c-5a1e47457ff8 req-27f75c58-1577-4aac-a2ad-f40f32367d2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65daf248-5e31-4e72-9d33-dc81f8d95d72", "name": "network-vif-plugged", "status": "completed", "tag": "f283c602-b5e4-4d1c-84db-51e3d5196edf"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:36:26.824076 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6db08045-5738-4080-b59c-5a1e47457ff8 req-27f75c58-1577-4aac-a2ad-f40f32367d2d service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:26.824555 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6db08045-5738-4080-b59c-5a1e47457ff8 req-27f75c58-1577-4aac-a2ad-f40f32367d2d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:26.825027 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6db08045-5738-4080-b59c-5a1e47457ff8 req-27f75c58-1577-4aac-a2ad-f40f32367d2d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:26.836301 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-6db08045-5738-4080-b59c-5a1e47457ff8 req-27f75c58-1577-4aac-a2ad-f40f32367d2d service nova] Creating event network-vif-plugged:f283c602-b5e4-4d1c-84db-51e3d5196edf for instance 65daf248-5e31-4e72-9d33-dc81f8d95d72 on n-h1-853682-5 Oct 18 16:36:26.841249 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-6db08045-5738-4080-b59c-5a1e47457ff8 req-27f75c58-1577-4aac-a2ad-f40f32367d2d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032892 Oct 18 16:36:26.841860 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3604/7226] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:36:27.752228 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-69115b2d-932f-4f26-9899-77cb6e4a3cd8 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:36:27.752879 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-69115b2d-932f-4f26-9899-77cb6e4a3cd8 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] [instance: 65daf248-5e31-4e72-9d33-dc81f8d95d72] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:36:27.754847 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:36:27.755526 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=6 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:36:27.762156 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-69115b2d-932f-4f26-9899-77cb6e4a3cd8 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:27.762651 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-69115b2d-932f-4f26-9899-77cb6e4a3cd8 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:27.763102 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-69115b2d-932f-4f26-9899-77cb6e4a3cd8 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:27.763810 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-69115b2d-932f-4f26-9899-77cb6e4a3cd8 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:27.764283 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-69115b2d-932f-4f26-9899-77cb6e4a3cd8 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:27.764729 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-69115b2d-932f-4f26-9899-77cb6e4a3cd8 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:27.891325 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-69115b2d-932f-4f26-9899-77cb6e4a3cd8 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbc6d1ac4f0499aadf786fde42535ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f94cc7d578a544f183c18e1dfa79f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:36:27.899103 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-69115b2d-932f-4f26-9899-77cb6e4a3cd8 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] 10.222.0.60 "GET /compute/v2.1/servers/65daf248-5e31-4e72-9d33-dc81f8d95d72" status: 200 len: 1317 microversion: 2.1 time: 0.150864 Oct 18 16:36:27.899685 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3623/7227] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:36:27 2022] GET /compute/v2.1/servers/65daf248-5e31-4e72-9d33-dc81f8d95d72 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:36:28.922833 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-261f6c5f-928b-43a6-bda6-8d10e0d25399 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:36:28.923566 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-261f6c5f-928b-43a6-bda6-8d10e0d25399 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] [instance: 65daf248-5e31-4e72-9d33-dc81f8d95d72] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:36:28.925576 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:36:28.932571 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-261f6c5f-928b-43a6-bda6-8d10e0d25399 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:28.933087 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-261f6c5f-928b-43a6-bda6-8d10e0d25399 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:28.933529 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-261f6c5f-928b-43a6-bda6-8d10e0d25399 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:28.934229 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-261f6c5f-928b-43a6-bda6-8d10e0d25399 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:28.934689 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-261f6c5f-928b-43a6-bda6-8d10e0d25399 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:28.935118 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-261f6c5f-928b-43a6-bda6-8d10e0d25399 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:29.067679 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-261f6c5f-928b-43a6-bda6-8d10e0d25399 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbc6d1ac4f0499aadf786fde42535ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f94cc7d578a544f183c18e1dfa79f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:36:29.075641 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-261f6c5f-928b-43a6-bda6-8d10e0d25399 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] 10.222.0.60 "GET /compute/v2.1/servers/65daf248-5e31-4e72-9d33-dc81f8d95d72" status: 200 len: 1505 microversion: 2.1 time: 0.157094 Oct 18 16:36:29.076239 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3605/7228] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:36:28 2022] GET /compute/v2.1/servers/65daf248-5e31-4e72-9d33-dc81f8d95d72 => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:36:29.098502 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3e3c2f59-6337-42cd-a4d6-3ccae68996bc tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:36:29.099037 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3e3c2f59-6337-42cd-a4d6-3ccae68996bc tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] [instance: 65daf248-5e31-4e72-9d33-dc81f8d95d72] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:36:29.106062 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3e3c2f59-6337-42cd-a4d6-3ccae68996bc tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:29.106567 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3e3c2f59-6337-42cd-a4d6-3ccae68996bc tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:29.107025 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3e3c2f59-6337-42cd-a4d6-3ccae68996bc tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:29.107742 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3e3c2f59-6337-42cd-a4d6-3ccae68996bc tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:29.108219 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3e3c2f59-6337-42cd-a4d6-3ccae68996bc tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:29.108666 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3e3c2f59-6337-42cd-a4d6-3ccae68996bc tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:29.134620 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3e3c2f59-6337-42cd-a4d6-3ccae68996bc tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] [instance: 65daf248-5e31-4e72-9d33-dc81f8d95d72] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:36:29.210891 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3e3c2f59-6337-42cd-a4d6-3ccae68996bc tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] 10.222.0.60 "DELETE /compute/v2.1/servers/65daf248-5e31-4e72-9d33-dc81f8d95d72" status: 204 len: 0 microversion: 2.1 time: 0.115993 Oct 18 16:36:29.211620 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3624/7229] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 16:36:29 2022] DELETE /compute/v2.1/servers/65daf248-5e31-4e72-9d33-dc81f8d95d72 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:36:29.220580 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-45591f1a-34e4-4827-95b7-75c59a2efe88 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:36:29.221223 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-45591f1a-34e4-4827-95b7-75c59a2efe88 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] [instance: 65daf248-5e31-4e72-9d33-dc81f8d95d72] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:36:29.227286 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45591f1a-34e4-4827-95b7-75c59a2efe88 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:29.227767 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45591f1a-34e4-4827-95b7-75c59a2efe88 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:29.228864 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45591f1a-34e4-4827-95b7-75c59a2efe88 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:29.229561 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45591f1a-34e4-4827-95b7-75c59a2efe88 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:29.230018 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45591f1a-34e4-4827-95b7-75c59a2efe88 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:29.230439 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45591f1a-34e4-4827-95b7-75c59a2efe88 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:29.362333 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-45591f1a-34e4-4827-95b7-75c59a2efe88 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbc6d1ac4f0499aadf786fde42535ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f94cc7d578a544f183c18e1dfa79f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:36:29.370098 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-45591f1a-34e4-4827-95b7-75c59a2efe88 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] 10.222.0.60 "GET /compute/v2.1/servers/65daf248-5e31-4e72-9d33-dc81f8d95d72" status: 200 len: 1511 microversion: 2.1 time: 0.153689 Oct 18 16:36:29.370686 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3606/7230] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:36:29 2022] GET /compute/v2.1/servers/65daf248-5e31-4e72-9d33-dc81f8d95d72 => generated 1511 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:36:30.393939 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f0844ddc-67c5-4c65-8dae-30ad0c6d5468 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:36:30.394670 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f0844ddc-67c5-4c65-8dae-30ad0c6d5468 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] [instance: 65daf248-5e31-4e72-9d33-dc81f8d95d72] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:36:30.401625 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f0844ddc-67c5-4c65-8dae-30ad0c6d5468 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:30.402132 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f0844ddc-67c5-4c65-8dae-30ad0c6d5468 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:30.402590 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f0844ddc-67c5-4c65-8dae-30ad0c6d5468 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:30.403306 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f0844ddc-67c5-4c65-8dae-30ad0c6d5468 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:30.403785 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f0844ddc-67c5-4c65-8dae-30ad0c6d5468 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:30.404231 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f0844ddc-67c5-4c65-8dae-30ad0c6d5468 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:30.534834 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f0844ddc-67c5-4c65-8dae-30ad0c6d5468 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbc6d1ac4f0499aadf786fde42535ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f94cc7d578a544f183c18e1dfa79f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:36:30.543759 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f0844ddc-67c5-4c65-8dae-30ad0c6d5468 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] 10.222.0.60 "GET /compute/v2.1/servers/65daf248-5e31-4e72-9d33-dc81f8d95d72" status: 200 len: 1511 microversion: 2.1 time: 0.154079 Oct 18 16:36:30.544362 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3625/7231] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:36:30 2022] GET /compute/v2.1/servers/65daf248-5e31-4e72-9d33-dc81f8d95d72 => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:36:31.450589 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-27c29630-aae6-475d-b14d-ff86c472f813 req-ae00ec2f-2c9b-4ea9-ad19-bed680eb1bb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65daf248-5e31-4e72-9d33-dc81f8d95d72", "name": "network-vif-deleted", "tag": "f283c602-b5e4-4d1c-84db-51e3d5196edf"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:36:31.461524 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-27c29630-aae6-475d-b14d-ff86c472f813 req-ae00ec2f-2c9b-4ea9-ad19-bed680eb1bb7 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:31.462015 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-27c29630-aae6-475d-b14d-ff86c472f813 req-ae00ec2f-2c9b-4ea9-ad19-bed680eb1bb7 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:31.463099 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-27c29630-aae6-475d-b14d-ff86c472f813 req-ae00ec2f-2c9b-4ea9-ad19-bed680eb1bb7 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:31.479444 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-27c29630-aae6-475d-b14d-ff86c472f813 req-ae00ec2f-2c9b-4ea9-ad19-bed680eb1bb7 service nova] Creating event network-vif-deleted:f283c602-b5e4-4d1c-84db-51e3d5196edf for instance 65daf248-5e31-4e72-9d33-dc81f8d95d72 on n-h1-853682-5 Oct 18 16:36:31.484588 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-27c29630-aae6-475d-b14d-ff86c472f813 req-ae00ec2f-2c9b-4ea9-ad19-bed680eb1bb7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038268 Oct 18 16:36:31.485533 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3607/7232] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:36:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:36:31.567772 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-19ba69c6-2781-415d-b3e0-149f554c7f7b tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:36:31.568422 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-19ba69c6-2781-415d-b3e0-149f554c7f7b tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] [instance: 65daf248-5e31-4e72-9d33-dc81f8d95d72] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:36:31.571300 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:36:31.577104 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-19ba69c6-2781-415d-b3e0-149f554c7f7b tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:31.577619 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-19ba69c6-2781-415d-b3e0-149f554c7f7b tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:31.578081 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-19ba69c6-2781-415d-b3e0-149f554c7f7b tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:31.578816 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-19ba69c6-2781-415d-b3e0-149f554c7f7b tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:31.579531 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-19ba69c6-2781-415d-b3e0-149f554c7f7b tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:31.579990 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-19ba69c6-2781-415d-b3e0-149f554c7f7b tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:31.584067 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:36:31.619417 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-19ba69c6-2781-415d-b3e0-149f554c7f7b tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:31.620167 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-19ba69c6-2781-415d-b3e0-149f554c7f7b tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:31.620625 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-19ba69c6-2781-415d-b3e0-149f554c7f7b tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:31.621132 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-19ba69c6-2781-415d-b3e0-149f554c7f7b tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lazy-loading 'fault' on Instance uuid 65daf248-5e31-4e72-9d33-dc81f8d95d72 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:36:31.664069 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-19ba69c6-2781-415d-b3e0-149f554c7f7b tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbc6d1ac4f0499aadf786fde42535ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f94cc7d578a544f183c18e1dfa79f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:36:31.672780 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-19ba69c6-2781-415d-b3e0-149f554c7f7b tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] 10.222.0.60 "GET /compute/v2.1/servers/65daf248-5e31-4e72-9d33-dc81f8d95d72" status: 200 len: 1307 microversion: 2.1 time: 0.109080 Oct 18 16:36:31.673392 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3626/7233] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:36:31 2022] GET /compute/v2.1/servers/65daf248-5e31-4e72-9d33-dc81f8d95d72 => generated 1307 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:36:32.697017 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-32fc7223-ff20-4ff9-9a99-ed7b154c4347 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:36:32.697730 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-32fc7223-ff20-4ff9-9a99-ed7b154c4347 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] [instance: 65daf248-5e31-4e72-9d33-dc81f8d95d72] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:36:32.703923 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32fc7223-ff20-4ff9-9a99-ed7b154c4347 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:32.704408 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32fc7223-ff20-4ff9-9a99-ed7b154c4347 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:32.704869 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32fc7223-ff20-4ff9-9a99-ed7b154c4347 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:32.705564 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32fc7223-ff20-4ff9-9a99-ed7b154c4347 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:32.706022 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32fc7223-ff20-4ff9-9a99-ed7b154c4347 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:32.706449 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32fc7223-ff20-4ff9-9a99-ed7b154c4347 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:32.719711 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-32fc7223-ff20-4ff9-9a99-ed7b154c4347 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] HTTP exception thrown: Instance 65daf248-5e31-4e72-9d33-dc81f8d95d72 could not be found. Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-32fc7223-ff20-4ff9-9a99-ed7b154c4347 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Request method failure captured: Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/65daf248-5e31-4e72-9d33-dc81f8d95d72 HTTP/1.1 Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTtXw85xIYW5Wk-DyHMKljJnPm1s1fX_IfoCjAchtNYB4ktRECm9nBOfTON74RbI0WWsiaYDIvbDSUZr8TifbVMocqpbnBVPr8eQg4whQKM6XezBrd0mcXU67OTil7mZAAovuj3HB_M0EZLg3uOAhsB_h75X2VWwHx0oVyNYbb-RUYIE Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: f94cc7d578a544f183c18e1dfa79f12d Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersNegativeTestJSON-1530586118 Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f94cc7d578a544f183c18e1dfa79f12d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f94cc7d578a544f183c18e1dfa79f12d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f94cc7d578a544f183c18e1dfa79f12d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f94cc7d578a544f183c18e1dfa79f12d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersNegativeTestJSON-1530586118 Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: f94cc7d578a544f183c18e1dfa79f12d Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1530586118 Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersNegativeTestJSON-1530586118-project Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 0bbc6d1ac4f0499aadf786fde42535ab Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersNegativeTestJSON-1530586118-project Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 65daf248-5e31-4e72-9d33-dc81f8d95d72 could not be found. Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '65daf248-5e31-4e72-9d33-dc81f8d95d72'} Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65daf248-5e31-4e72-9d33-dc81f8d95d72 could not be found. Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65daf248-5e31-4e72-9d33-dc81f8d95d72 could not be found. Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:36:32.721361 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:36:32.726529 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:36:32.726529 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:36:32.726529 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:36:32.726529 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:36:32.726529 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:36:32.726529 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65daf248-5e31-4e72-9d33-dc81f8d95d72 could not be found. Oct 18 16:36:32.726529 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:36:32.726529 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-32fc7223-ff20-4ff9-9a99-ed7b154c4347 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Returning 404 to user: Instance 65daf248-5e31-4e72-9d33-dc81f8d95d72 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:36:32.726529 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-32fc7223-ff20-4ff9-9a99-ed7b154c4347 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] 10.222.0.60 "GET /compute/v2.1/servers/65daf248-5e31-4e72-9d33-dc81f8d95d72" status: 404 len: 111 microversion: 2.1 time: 0.030942 Oct 18 16:36:32.726529 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3608/7234] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:36:32 2022] GET /compute/v2.1/servers/65daf248-5e31-4e72-9d33-dc81f8d95d72 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:36:32.733666 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b5836002-cd52-4e2d-acb0-4c570de361f1 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:36:32.734356 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b5836002-cd52-4e2d-acb0-4c570de361f1 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] [instance: 4db8876d-feae-4e3a-8388-488608d71208] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:36:32.741404 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b5836002-cd52-4e2d-acb0-4c570de361f1 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:32.741905 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b5836002-cd52-4e2d-acb0-4c570de361f1 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:32.742355 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b5836002-cd52-4e2d-acb0-4c570de361f1 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:32.743063 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b5836002-cd52-4e2d-acb0-4c570de361f1 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:32.743533 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b5836002-cd52-4e2d-acb0-4c570de361f1 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:32.744563 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b5836002-cd52-4e2d-acb0-4c570de361f1 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:32.881462 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b5836002-cd52-4e2d-acb0-4c570de361f1 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbc6d1ac4f0499aadf786fde42535ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f94cc7d578a544f183c18e1dfa79f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:36:32.890022 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b5836002-cd52-4e2d-acb0-4c570de361f1 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] 10.222.0.60 "GET /compute/v2.1/servers/4db8876d-feae-4e3a-8388-488608d71208" status: 200 len: 1504 microversion: 2.1 time: 0.161872 Oct 18 16:36:32.890614 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3627/7235] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:36:32 2022] GET /compute/v2.1/servers/4db8876d-feae-4e3a-8388-488608d71208 => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:36:32.912205 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eba45ef2-4acd-4ce8-8bc0-11a68bfbed66 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:36:32.914456 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-eba45ef2-4acd-4ce8-8bc0-11a68bfbed66 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] [instance: 821d377a-018e-4d03-9bd1-f38fa95bd7cc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:36:32.916712 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=43 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:36:32.921509 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-eba45ef2-4acd-4ce8-8bc0-11a68bfbed66 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] HTTP exception thrown: Instance 821d377a-018e-4d03-9bd1-f38fa95bd7cc could not be found. Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eba45ef2-4acd-4ce8-8bc0-11a68bfbed66 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Request method failure captured: Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers/821d377a-018e-4d03-9bd1-f38fa95bd7cc/action HTTP/1.1 Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 32 Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTtXw85xIYW5Wk-DyHMKljJnPm1s1fX_IfoCjAchtNYB4ktRECm9nBOfTON74RbI0WWsiaYDIvbDSUZr8TifbVMocqpbnBVPr8eQg4whQKM6XezBrd0mcXU67OTil7mZAAovuj3HB_M0EZLg3uOAhsB_h75X2VWwHx0oVyNYbb-RUYIE Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: f94cc7d578a544f183c18e1dfa79f12d Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersNegativeTestJSON-1530586118 Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f94cc7d578a544f183c18e1dfa79f12d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f94cc7d578a544f183c18e1dfa79f12d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f94cc7d578a544f183c18e1dfa79f12d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f94cc7d578a544f183c18e1dfa79f12d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersNegativeTestJSON-1530586118 Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: f94cc7d578a544f183c18e1dfa79f12d Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1530586118 Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersNegativeTestJSON-1530586118-project Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 0bbc6d1ac4f0499aadf786fde42535ab Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersNegativeTestJSON-1530586118-project Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: {"resize": {"flavorRef": "452"}} Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 821d377a-018e-4d03-9bd1-f38fa95bd7cc could not be found. Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '821d377a-018e-4d03-9bd1-f38fa95bd7cc', 'body': {'resize': {'flavorRef': '452'}}} Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 821d377a-018e-4d03-9bd1-f38fa95bd7cc could not be found. Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:36:32.923066 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:36:32.928170 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 821d377a-018e-4d03-9bd1-f38fa95bd7cc could not be found. Oct 18 16:36:32.928170 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:36:32.928170 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:36:32.928170 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:36:32.928170 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:36:32.928170 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:36:32.928170 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:36:32.928170 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:36:32.928170 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:36:32.928170 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 821d377a-018e-4d03-9bd1-f38fa95bd7cc could not be found. Oct 18 16:36:32.928170 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:36:32.928170 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eba45ef2-4acd-4ce8-8bc0-11a68bfbed66 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Returning 404 to user: Instance 821d377a-018e-4d03-9bd1-f38fa95bd7cc could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:36:32.928170 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-eba45ef2-4acd-4ce8-8bc0-11a68bfbed66 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] 10.222.0.60 "POST /compute/v2.1/servers/821d377a-018e-4d03-9bd1-f38fa95bd7cc/action" status: 404 len: 111 microversion: 2.1 time: 0.016183 Oct 18 16:36:32.928170 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3609/7236] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:36:32 2022] POST /compute/v2.1/servers/821d377a-018e-4d03-9bd1-f38fa95bd7cc/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:36:32.933643 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f7325d3e-97c3-4cbb-86f8-e56763cc83db tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:36:32.934288 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f7325d3e-97c3-4cbb-86f8-e56763cc83db tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] [instance: 4db8876d-feae-4e3a-8388-488608d71208] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:36:32.940268 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f7325d3e-97c3-4cbb-86f8-e56763cc83db tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:32.940770 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f7325d3e-97c3-4cbb-86f8-e56763cc83db tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:32.941260 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f7325d3e-97c3-4cbb-86f8-e56763cc83db tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:32.941976 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f7325d3e-97c3-4cbb-86f8-e56763cc83db tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:32.942454 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f7325d3e-97c3-4cbb-86f8-e56763cc83db tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:32.942904 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f7325d3e-97c3-4cbb-86f8-e56763cc83db tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:33.073174 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f7325d3e-97c3-4cbb-86f8-e56763cc83db tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbc6d1ac4f0499aadf786fde42535ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f94cc7d578a544f183c18e1dfa79f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:36:33.081085 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f7325d3e-97c3-4cbb-86f8-e56763cc83db tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] 10.222.0.60 "GET /compute/v2.1/servers/4db8876d-feae-4e3a-8388-488608d71208" status: 200 len: 1504 microversion: 2.1 time: 0.151808 Oct 18 16:36:33.081670 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3628/7237] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:36:32 2022] GET /compute/v2.1/servers/4db8876d-feae-4e3a-8388-488608d71208 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:36:33.104109 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b68063c5-c276-486b-800d-df6a5a16727f tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:36:33.104713 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b68063c5-c276-486b-800d-df6a5a16727f tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] [instance: 4db8876d-feae-4e3a-8388-488608d71208] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:36:33.111534 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b68063c5-c276-486b-800d-df6a5a16727f tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:33.112013 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b68063c5-c276-486b-800d-df6a5a16727f tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:33.112444 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b68063c5-c276-486b-800d-df6a5a16727f tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:33.113156 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b68063c5-c276-486b-800d-df6a5a16727f tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:33.113605 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b68063c5-c276-486b-800d-df6a5a16727f tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:33.114027 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b68063c5-c276-486b-800d-df6a5a16727f tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:33.116526 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=71 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:36:33.247087 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b68063c5-c276-486b-800d-df6a5a16727f tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbc6d1ac4f0499aadf786fde42535ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f94cc7d578a544f183c18e1dfa79f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:36:33.254781 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b68063c5-c276-486b-800d-df6a5a16727f tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] 10.222.0.60 "GET /compute/v2.1/servers/4db8876d-feae-4e3a-8388-488608d71208" status: 200 len: 1504 microversion: 2.1 time: 0.154684 Oct 18 16:36:33.255347 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3610/7238] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:36:33 2022] GET /compute/v2.1/servers/4db8876d-feae-4e3a-8388-488608d71208 => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:36:33.276968 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4dfe00c6-bcc9-4b0f-8bd6-4316499b05e8 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "8ca0dc96-dc6f-4d77-9f0a-ed9704c24b28"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:36:33.279367 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4dfe00c6-bcc9-4b0f-8bd6-4316499b05e8 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] [instance: 4db8876d-feae-4e3a-8388-488608d71208] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:36:33.285428 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4dfe00c6-bcc9-4b0f-8bd6-4316499b05e8 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:33.285931 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4dfe00c6-bcc9-4b0f-8bd6-4316499b05e8 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:33.286418 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4dfe00c6-bcc9-4b0f-8bd6-4316499b05e8 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:33.287133 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4dfe00c6-bcc9-4b0f-8bd6-4316499b05e8 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:33.287613 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4dfe00c6-bcc9-4b0f-8bd6-4316499b05e8 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:33.288057 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4dfe00c6-bcc9-4b0f-8bd6-4316499b05e8 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:33.317564 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4dfe00c6-bcc9-4b0f-8bd6-4316499b05e8 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '0bbc6d1ac4f0499aadf786fde42535ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f94cc7d578a544f183c18e1dfa79f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:36:33.322401 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-4dfe00c6-bcc9-4b0f-8bd6-4316499b05e8 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] HTTP exception thrown: Flavor 8ca0dc96-dc6f-4d77-9f0a-ed9704c24b28 could not be found. Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4dfe00c6-bcc9-4b0f-8bd6-4316499b05e8 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Request method failure captured: Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: request: POST /compute/v2.1/servers/4db8876d-feae-4e3a-8388-488608d71208/action HTTP/1.1 Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 65 Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTtXw85xIYW5Wk-DyHMKljJnPm1s1fX_IfoCjAchtNYB4ktRECm9nBOfTON74RbI0WWsiaYDIvbDSUZr8TifbVMocqpbnBVPr8eQg4whQKM6XezBrd0mcXU67OTil7mZAAovuj3HB_M0EZLg3uOAhsB_h75X2VWwHx0oVyNYbb-RUYIE Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: f94cc7d578a544f183c18e1dfa79f12d Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServersNegativeTestJSON-1530586118 Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f94cc7d578a544f183c18e1dfa79f12d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f94cc7d578a544f183c18e1dfa79f12d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f94cc7d578a544f183c18e1dfa79f12d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f94cc7d578a544f183c18e1dfa79f12d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServersNegativeTestJSON-1530586118 Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: f94cc7d578a544f183c18e1dfa79f12d Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1530586118 Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServersNegativeTestJSON-1530586118-project Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 0bbc6d1ac4f0499aadf786fde42535ab Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServersNegativeTestJSON-1530586118-project Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: {"resize": {"flavorRef": "8ca0dc96-dc6f-4d77-9f0a-ed9704c24b28"}} Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: exception: Flavor 8ca0dc96-dc6f-4d77-9f0a-ed9704c24b28 could not be found. Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '4db8876d-feae-4e3a-8388-488608d71208', 'body': {'resize': {'flavorRef': '8ca0dc96-dc6f-4d77-9f0a-ed9704c24b28'}}} Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:36:33.324314 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 18 16:36:33.329131 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 18 16:36:33.329131 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 8ca0dc96-dc6f-4d77-9f0a-ed9704c24b28 could not be found. Oct 18 16:36:33.329131 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:36:33.329131 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:36:33.329131 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:36:33.329131 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:36:33.329131 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:36:33.329131 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:36:33.329131 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:36:33.329131 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:36:33.329131 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:36:33.329131 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:36:33.329131 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 16:36:33.329131 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 16:36:33.329131 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 18 16:36:33.329131 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 18 16:36:33.329131 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 18 16:36:33.329131 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 18 16:36:33.329131 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 8ca0dc96-dc6f-4d77-9f0a-ed9704c24b28 could not be found. Oct 18 16:36:33.329131 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:36:33.329131 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:36:33.329131 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:36:33.329131 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:36:33.329131 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:36:33.329131 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:36:33.329131 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:36:33.329131 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:36:33.329131 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 8ca0dc96-dc6f-4d77-9f0a-ed9704c24b28 could not be found. Oct 18 16:36:33.329131 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:36:33.329131 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4dfe00c6-bcc9-4b0f-8bd6-4316499b05e8 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Returning 400 to user: Flavor 8ca0dc96-dc6f-4d77-9f0a-ed9704c24b28 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:36:33.329131 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4dfe00c6-bcc9-4b0f-8bd6-4316499b05e8 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] 10.222.0.60 "POST /compute/v2.1/servers/4db8876d-feae-4e3a-8388-488608d71208/action" status: 400 len: 107 microversion: 2.1 time: 0.053204 Oct 18 16:36:33.329131 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3629/7239] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:36:33 2022] POST /compute/v2.1/servers/4db8876d-feae-4e3a-8388-488608d71208/action => generated 107 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:36:33.334601 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-00f398d6-5058-4b3e-89be-c22564cbc542 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:36:33.335214 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-00f398d6-5058-4b3e-89be-c22564cbc542 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] [instance: 4db8876d-feae-4e3a-8388-488608d71208] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:36:33.341315 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00f398d6-5058-4b3e-89be-c22564cbc542 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:33.341793 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00f398d6-5058-4b3e-89be-c22564cbc542 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:33.342220 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00f398d6-5058-4b3e-89be-c22564cbc542 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:33.342896 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00f398d6-5058-4b3e-89be-c22564cbc542 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:33.343345 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00f398d6-5058-4b3e-89be-c22564cbc542 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:33.343759 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00f398d6-5058-4b3e-89be-c22564cbc542 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:33.478945 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-00f398d6-5058-4b3e-89be-c22564cbc542 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbc6d1ac4f0499aadf786fde42535ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f94cc7d578a544f183c18e1dfa79f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:36:33.485727 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-00f398d6-5058-4b3e-89be-c22564cbc542 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] 10.222.0.60 "GET /compute/v2.1/servers/4db8876d-feae-4e3a-8388-488608d71208" status: 200 len: 1504 microversion: 2.1 time: 0.154927 Oct 18 16:36:33.486297 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3611/7240] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:36:33 2022] GET /compute/v2.1/servers/4db8876d-feae-4e3a-8388-488608d71208 => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:36:33.508297 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-65b894b8-a210-48fa-b9e0-7969c4f9208b tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:36:33.508973 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-65b894b8-a210-48fa-b9e0-7969c4f9208b tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] [instance: 4db8876d-feae-4e3a-8388-488608d71208] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:36:33.515574 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-65b894b8-a210-48fa-b9e0-7969c4f9208b tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:33.516073 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-65b894b8-a210-48fa-b9e0-7969c4f9208b tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:33.516524 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-65b894b8-a210-48fa-b9e0-7969c4f9208b tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:33.517265 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-65b894b8-a210-48fa-b9e0-7969c4f9208b tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:33.517765 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-65b894b8-a210-48fa-b9e0-7969c4f9208b tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:33.518200 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-65b894b8-a210-48fa-b9e0-7969c4f9208b tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:33.647280 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-65b894b8-a210-48fa-b9e0-7969c4f9208b tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbc6d1ac4f0499aadf786fde42535ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f94cc7d578a544f183c18e1dfa79f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:36:33.655740 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-65b894b8-a210-48fa-b9e0-7969c4f9208b tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] 10.222.0.60 "GET /compute/v2.1/servers/4db8876d-feae-4e3a-8388-488608d71208" status: 200 len: 1504 microversion: 2.1 time: 0.151389 Oct 18 16:36:33.656324 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3630/7241] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:36:33 2022] GET /compute/v2.1/servers/4db8876d-feae-4e3a-8388-488608d71208 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:36:33.678670 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8b9770ea-5597-4e4c-9969-5d9ca8b60f5a tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8b9770ea-5597-4e4c-9969-5d9ca8b60f5a tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Request method failure captured: Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers/4db8876d-feae-4e3a-8388-488608d71208/action HTTP/1.1 Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 29 Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTtXw85xIYW5Wk-DyHMKljJnPm1s1fX_IfoCjAchtNYB4ktRECm9nBOfTON74RbI0WWsiaYDIvbDSUZr8TifbVMocqpbnBVPr8eQg4whQKM6XezBrd0mcXU67OTil7mZAAovuj3HB_M0EZLg3uOAhsB_h75X2VWwHx0oVyNYbb-RUYIE Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: f94cc7d578a544f183c18e1dfa79f12d Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersNegativeTestJSON-1530586118 Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f94cc7d578a544f183c18e1dfa79f12d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f94cc7d578a544f183c18e1dfa79f12d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f94cc7d578a544f183c18e1dfa79f12d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f94cc7d578a544f183c18e1dfa79f12d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersNegativeTestJSON-1530586118 Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: f94cc7d578a544f183c18e1dfa79f12d Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1530586118 Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersNegativeTestJSON-1530586118-project Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 0bbc6d1ac4f0499aadf786fde42535ab Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersNegativeTestJSON-1530586118-project Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: {"resize": {"flavorRef": ""}} Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '4db8876d-feae-4e3a-8388-488608d71208', 'body': {'resize': {'flavorRef': ''}}} Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise error Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi '' Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:36:33.682953 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:36:33.687662 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:36:33.687662 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:36:33.687662 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:36:33.687662 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:36:33.687662 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 16:36:33.687662 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 16:36:33.687662 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 18 16:36:33.687662 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:36:33.687662 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8b9770ea-5597-4e4c-9969-5d9ca8b60f5a tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:36:33.687662 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8b9770ea-5597-4e4c-9969-5d9ca8b60f5a tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] 10.222.0.60 "POST /compute/v2.1/servers/4db8876d-feae-4e3a-8388-488608d71208/action" status: 400 len: 113 microversion: 2.1 time: 0.009614 Oct 18 16:36:33.687662 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3612/7242] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:36:33 2022] POST /compute/v2.1/servers/4db8876d-feae-4e3a-8388-488608d71208/action => generated 113 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 16:36:33.696656 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c09a7cbb-9094-409d-9612-08cbe489abe6 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:36:33.697857 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c09a7cbb-9094-409d-9612-08cbe489abe6 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] [instance: 4db8876d-feae-4e3a-8388-488608d71208] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:36:33.703886 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c09a7cbb-9094-409d-9612-08cbe489abe6 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:33.704388 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c09a7cbb-9094-409d-9612-08cbe489abe6 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:33.704884 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c09a7cbb-9094-409d-9612-08cbe489abe6 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:33.705597 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c09a7cbb-9094-409d-9612-08cbe489abe6 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:33.706070 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c09a7cbb-9094-409d-9612-08cbe489abe6 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:33.706508 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c09a7cbb-9094-409d-9612-08cbe489abe6 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:33.838087 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c09a7cbb-9094-409d-9612-08cbe489abe6 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbc6d1ac4f0499aadf786fde42535ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f94cc7d578a544f183c18e1dfa79f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:36:33.845888 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c09a7cbb-9094-409d-9612-08cbe489abe6 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] 10.222.0.60 "GET /compute/v2.1/servers/4db8876d-feae-4e3a-8388-488608d71208" status: 200 len: 1504 microversion: 2.1 time: 0.153185 Oct 18 16:36:33.846521 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3631/7243] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:36:33 2022] GET /compute/v2.1/servers/4db8876d-feae-4e3a-8388-488608d71208 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:36:33.873229 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2c819cd6-c8fc-4469-b26d-808f67941805 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:36:33.873750 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2c819cd6-c8fc-4469-b26d-808f67941805 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] [instance: 65daf248-5e31-4e72-9d33-dc81f8d95d72] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:36:33.880709 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c819cd6-c8fc-4469-b26d-808f67941805 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:33.881228 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c819cd6-c8fc-4469-b26d-808f67941805 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:33.881664 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c819cd6-c8fc-4469-b26d-808f67941805 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:33.882351 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c819cd6-c8fc-4469-b26d-808f67941805 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:33.882839 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c819cd6-c8fc-4469-b26d-808f67941805 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:33.883262 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c819cd6-c8fc-4469-b26d-808f67941805 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:33.897313 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-2c819cd6-c8fc-4469-b26d-808f67941805 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] HTTP exception thrown: Instance 65daf248-5e31-4e72-9d33-dc81f8d95d72 could not be found. Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2c819cd6-c8fc-4469-b26d-808f67941805 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Request method failure captured: Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/65daf248-5e31-4e72-9d33-dc81f8d95d72 HTTP/1.1 Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTtXw85xIYW5Wk-DyHMKljJnPm1s1fX_IfoCjAchtNYB4ktRECm9nBOfTON74RbI0WWsiaYDIvbDSUZr8TifbVMocqpbnBVPr8eQg4whQKM6XezBrd0mcXU67OTil7mZAAovuj3HB_M0EZLg3uOAhsB_h75X2VWwHx0oVyNYbb-RUYIE Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: f94cc7d578a544f183c18e1dfa79f12d Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersNegativeTestJSON-1530586118 Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f94cc7d578a544f183c18e1dfa79f12d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f94cc7d578a544f183c18e1dfa79f12d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f94cc7d578a544f183c18e1dfa79f12d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f94cc7d578a544f183c18e1dfa79f12d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersNegativeTestJSON-1530586118 Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: f94cc7d578a544f183c18e1dfa79f12d Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1530586118 Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersNegativeTestJSON-1530586118-project Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 0bbc6d1ac4f0499aadf786fde42535ab Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersNegativeTestJSON-1530586118-project Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 65daf248-5e31-4e72-9d33-dc81f8d95d72 could not be found. Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '65daf248-5e31-4e72-9d33-dc81f8d95d72'} Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65daf248-5e31-4e72-9d33-dc81f8d95d72 could not be found. Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:36:33.898875 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:36:33.903178 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65daf248-5e31-4e72-9d33-dc81f8d95d72 could not be found. Oct 18 16:36:33.903178 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:36:33.903178 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:36:33.903178 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:36:33.903178 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:36:33.903178 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:36:33.903178 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:36:33.903178 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:36:33.903178 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:36:33.903178 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65daf248-5e31-4e72-9d33-dc81f8d95d72 could not be found. Oct 18 16:36:33.903178 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:36:33.903178 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2c819cd6-c8fc-4469-b26d-808f67941805 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Returning 404 to user: Instance 65daf248-5e31-4e72-9d33-dc81f8d95d72 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:36:33.903178 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2c819cd6-c8fc-4469-b26d-808f67941805 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] 10.222.0.60 "DELETE /compute/v2.1/servers/65daf248-5e31-4e72-9d33-dc81f8d95d72" status: 404 len: 111 microversion: 2.1 time: 0.032354 Oct 18 16:36:33.903178 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3613/7244] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 16:36:33 2022] DELETE /compute/v2.1/servers/65daf248-5e31-4e72-9d33-dc81f8d95d72 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:36:33.908965 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3db4a8ad-8f8b-41ca-99b8-2c77529e60d6 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:36:33.909607 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3db4a8ad-8f8b-41ca-99b8-2c77529e60d6 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] [instance: 65daf248-5e31-4e72-9d33-dc81f8d95d72] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:36:33.915958 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3db4a8ad-8f8b-41ca-99b8-2c77529e60d6 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:33.916453 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3db4a8ad-8f8b-41ca-99b8-2c77529e60d6 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:33.916944 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3db4a8ad-8f8b-41ca-99b8-2c77529e60d6 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:33.917647 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3db4a8ad-8f8b-41ca-99b8-2c77529e60d6 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:33.918117 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3db4a8ad-8f8b-41ca-99b8-2c77529e60d6 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:33.918568 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3db4a8ad-8f8b-41ca-99b8-2c77529e60d6 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:33.932613 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-3db4a8ad-8f8b-41ca-99b8-2c77529e60d6 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] HTTP exception thrown: Instance 65daf248-5e31-4e72-9d33-dc81f8d95d72 could not be found. Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3db4a8ad-8f8b-41ca-99b8-2c77529e60d6 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Request method failure captured: Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/65daf248-5e31-4e72-9d33-dc81f8d95d72 HTTP/1.1 Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTtXw85xIYW5Wk-DyHMKljJnPm1s1fX_IfoCjAchtNYB4ktRECm9nBOfTON74RbI0WWsiaYDIvbDSUZr8TifbVMocqpbnBVPr8eQg4whQKM6XezBrd0mcXU67OTil7mZAAovuj3HB_M0EZLg3uOAhsB_h75X2VWwHx0oVyNYbb-RUYIE Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: f94cc7d578a544f183c18e1dfa79f12d Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-ServersNegativeTestJSON-1530586118 Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f94cc7d578a544f183c18e1dfa79f12d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f94cc7d578a544f183c18e1dfa79f12d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f94cc7d578a544f183c18e1dfa79f12d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f94cc7d578a544f183c18e1dfa79f12d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-ServersNegativeTestJSON-1530586118 Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: f94cc7d578a544f183c18e1dfa79f12d Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1530586118 Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-ServersNegativeTestJSON-1530586118-project Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 0bbc6d1ac4f0499aadf786fde42535ab Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-ServersNegativeTestJSON-1530586118-project Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 65daf248-5e31-4e72-9d33-dc81f8d95d72 could not be found. Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '65daf248-5e31-4e72-9d33-dc81f8d95d72'} Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65daf248-5e31-4e72-9d33-dc81f8d95d72 could not be found. Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65daf248-5e31-4e72-9d33-dc81f8d95d72 could not be found. Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:36:33.934194 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:36:33.939244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:36:33.939244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:36:33.939244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:36:33.939244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:36:33.939244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:36:33.939244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65daf248-5e31-4e72-9d33-dc81f8d95d72 could not be found. Oct 18 16:36:33.939244 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:36:33.939244 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3db4a8ad-8f8b-41ca-99b8-2c77529e60d6 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Returning 404 to user: Instance 65daf248-5e31-4e72-9d33-dc81f8d95d72 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:36:33.939244 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3db4a8ad-8f8b-41ca-99b8-2c77529e60d6 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] 10.222.0.60 "GET /compute/v2.1/servers/65daf248-5e31-4e72-9d33-dc81f8d95d72" status: 404 len: 111 microversion: 2.1 time: 0.030531 Oct 18 16:36:33.939244 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3632/7245] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:36:33 2022] GET /compute/v2.1/servers/65daf248-5e31-4e72-9d33-dc81f8d95d72 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:36:33.944034 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fba57c94-9912-43d3-ad9e-3133c9a7a5bc tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:36:33.944534 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fba57c94-9912-43d3-ad9e-3133c9a7a5bc tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] [instance: 4db8876d-feae-4e3a-8388-488608d71208] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:36:33.951092 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fba57c94-9912-43d3-ad9e-3133c9a7a5bc tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:33.951571 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fba57c94-9912-43d3-ad9e-3133c9a7a5bc tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:33.952003 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fba57c94-9912-43d3-ad9e-3133c9a7a5bc tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:33.952687 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fba57c94-9912-43d3-ad9e-3133c9a7a5bc tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:33.953174 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fba57c94-9912-43d3-ad9e-3133c9a7a5bc tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:33.953608 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fba57c94-9912-43d3-ad9e-3133c9a7a5bc tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:33.978836 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fba57c94-9912-43d3-ad9e-3133c9a7a5bc tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] [instance: 4db8876d-feae-4e3a-8388-488608d71208] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:36:34.053906 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fba57c94-9912-43d3-ad9e-3133c9a7a5bc tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4db8876d-feae-4e3a-8388-488608d71208" status: 204 len: 0 microversion: 2.1 time: 0.113389 Oct 18 16:36:34.054532 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3614/7246] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 16:36:33 2022] DELETE /compute/v2.1/servers/4db8876d-feae-4e3a-8388-488608d71208 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:36:34.063150 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-57be0634-6bfb-4450-ab58-27d8f165f10f tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:36:34.063793 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-57be0634-6bfb-4450-ab58-27d8f165f10f tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] [instance: 4db8876d-feae-4e3a-8388-488608d71208] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:36:34.069899 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57be0634-6bfb-4450-ab58-27d8f165f10f tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:34.070400 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57be0634-6bfb-4450-ab58-27d8f165f10f tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:34.070858 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57be0634-6bfb-4450-ab58-27d8f165f10f tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:34.071567 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57be0634-6bfb-4450-ab58-27d8f165f10f tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:34.072043 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57be0634-6bfb-4450-ab58-27d8f165f10f tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:34.072490 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57be0634-6bfb-4450-ab58-27d8f165f10f tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:34.203854 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-57be0634-6bfb-4450-ab58-27d8f165f10f tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbc6d1ac4f0499aadf786fde42535ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f94cc7d578a544f183c18e1dfa79f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:36:34.211910 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-57be0634-6bfb-4450-ab58-27d8f165f10f tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] 10.222.0.60 "GET /compute/v2.1/servers/4db8876d-feae-4e3a-8388-488608d71208" status: 200 len: 1510 microversion: 2.1 time: 0.152704 Oct 18 16:36:34.213072 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3633/7247] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:36:34 2022] GET /compute/v2.1/servers/4db8876d-feae-4e3a-8388-488608d71208 => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:36:35.236154 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ac23a245-43e4-42cc-9587-69439e71cff7 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:36:35.236939 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ac23a245-43e4-42cc-9587-69439e71cff7 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] [instance: 4db8876d-feae-4e3a-8388-488608d71208] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:36:35.244004 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac23a245-43e4-42cc-9587-69439e71cff7 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:35.244531 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac23a245-43e4-42cc-9587-69439e71cff7 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:35.244855 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac23a245-43e4-42cc-9587-69439e71cff7 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:35.245552 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac23a245-43e4-42cc-9587-69439e71cff7 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:35.245998 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac23a245-43e4-42cc-9587-69439e71cff7 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:35.246414 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac23a245-43e4-42cc-9587-69439e71cff7 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:35.380424 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ac23a245-43e4-42cc-9587-69439e71cff7 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbc6d1ac4f0499aadf786fde42535ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f94cc7d578a544f183c18e1dfa79f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:36:35.388153 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ac23a245-43e4-42cc-9587-69439e71cff7 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] 10.222.0.60 "GET /compute/v2.1/servers/4db8876d-feae-4e3a-8388-488608d71208" status: 200 len: 1510 microversion: 2.1 time: 0.156489 Oct 18 16:36:35.388755 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3615/7248] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:36:35 2022] GET /compute/v2.1/servers/4db8876d-feae-4e3a-8388-488608d71208 => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:36:35.860976 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-ad942920-7e32-48d3-8a25-61c96037c8bd req-8e314bee-6cf5-4e04-9dd3-b0183b3578e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4db8876d-feae-4e3a-8388-488608d71208", "name": "network-vif-deleted", "tag": "52fea546-e088-4cb6-844c-67665ebfb708"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:36:35.875077 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-ad942920-7e32-48d3-8a25-61c96037c8bd req-8e314bee-6cf5-4e04-9dd3-b0183b3578e4 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:35.875599 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-ad942920-7e32-48d3-8a25-61c96037c8bd req-8e314bee-6cf5-4e04-9dd3-b0183b3578e4 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:35.876058 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-ad942920-7e32-48d3-8a25-61c96037c8bd req-8e314bee-6cf5-4e04-9dd3-b0183b3578e4 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:35.891065 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-ad942920-7e32-48d3-8a25-61c96037c8bd req-8e314bee-6cf5-4e04-9dd3-b0183b3578e4 service nova] Creating event network-vif-deleted:52fea546-e088-4cb6-844c-67665ebfb708 for instance 4db8876d-feae-4e3a-8388-488608d71208 on n-h2-853682-5 Oct 18 16:36:35.898158 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-ad942920-7e32-48d3-8a25-61c96037c8bd req-8e314bee-6cf5-4e04-9dd3-b0183b3578e4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040608 Oct 18 16:36:35.899172 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3634/7249] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:36:36.411325 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-aac53947-e57c-4429-b7ff-7d44659dc6d3 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:36:36.411923 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-aac53947-e57c-4429-b7ff-7d44659dc6d3 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] [instance: 4db8876d-feae-4e3a-8388-488608d71208] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:36:36.419135 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aac53947-e57c-4429-b7ff-7d44659dc6d3 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:36.419618 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aac53947-e57c-4429-b7ff-7d44659dc6d3 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:36.420047 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aac53947-e57c-4429-b7ff-7d44659dc6d3 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:36.420730 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aac53947-e57c-4429-b7ff-7d44659dc6d3 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:36:36.421207 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aac53947-e57c-4429-b7ff-7d44659dc6d3 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:36:36.421649 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aac53947-e57c-4429-b7ff-7d44659dc6d3 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:36:36.435046 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-aac53947-e57c-4429-b7ff-7d44659dc6d3 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] HTTP exception thrown: Instance 4db8876d-feae-4e3a-8388-488608d71208 could not be found. Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-aac53947-e57c-4429-b7ff-7d44659dc6d3 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Request method failure captured: Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/4db8876d-feae-4e3a-8388-488608d71208 HTTP/1.1 Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTtXw85xIYW5Wk-DyHMKljJnPm1s1fX_IfoCjAchtNYB4ktRECm9nBOfTON74RbI0WWsiaYDIvbDSUZr8TifbVMocqpbnBVPr8eQg4whQKM6XezBrd0mcXU67OTil7mZAAovuj3HB_M0EZLg3uOAhsB_h75X2VWwHx0oVyNYbb-RUYIE Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: f94cc7d578a544f183c18e1dfa79f12d Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersNegativeTestJSON-1530586118 Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f94cc7d578a544f183c18e1dfa79f12d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f94cc7d578a544f183c18e1dfa79f12d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f94cc7d578a544f183c18e1dfa79f12d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f94cc7d578a544f183c18e1dfa79f12d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-ServersNegativeTestJSON-1530586118 Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: f94cc7d578a544f183c18e1dfa79f12d Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1530586118 Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-ServersNegativeTestJSON-1530586118-project Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 0bbc6d1ac4f0499aadf786fde42535ab Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-ServersNegativeTestJSON-1530586118-project Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 4db8876d-feae-4e3a-8388-488608d71208 could not be found. Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '4db8876d-feae-4e3a-8388-488608d71208'} Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4db8876d-feae-4e3a-8388-488608d71208 could not be found. Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4db8876d-feae-4e3a-8388-488608d71208 could not be found. Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:36:36.436672 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:36:36.441657 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:36:36.441657 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:36:36.441657 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:36:36.441657 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:36:36.441657 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:36:36.441657 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4db8876d-feae-4e3a-8388-488608d71208 could not be found. Oct 18 16:36:36.441657 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:36:36.441657 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-aac53947-e57c-4429-b7ff-7d44659dc6d3 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] Returning 404 to user: Instance 4db8876d-feae-4e3a-8388-488608d71208 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:36:36.441657 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-aac53947-e57c-4429-b7ff-7d44659dc6d3 tempest-ServersNegativeTestJSON-1530586118 tempest-ServersNegativeTestJSON-1530586118-project] 10.222.0.60 "GET /compute/v2.1/servers/4db8876d-feae-4e3a-8388-488608d71208" status: 404 len: 111 microversion: 2.1 time: 0.030675 Oct 18 16:36:36.441657 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3616/7250] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:36:36 2022] GET /compute/v2.1/servers/4db8876d-feae-4e3a-8388-488608d71208 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:37:07.487473 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=21 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:37:07.488249 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=45 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:37:07.737052 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b7ffed18-a85a-4307-a528-2a491967c35a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Action: 'create', calling method: .version_select at 0x7f7c3c5c5430>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1537900231", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7v9BhhHeUyoQT1f+AnvkJ6aWsmZ6EECbo+67PTkKP2+n6ZfSK2hhTHS4/mLMTNfxK74R7sGg9UlU4ZIJcN5Kzzwn7DvflHazh54Qfog8js4JV/gJks/VFhDn+iRHVShQ=="}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:37:07.754927 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-b7ffed18-a85a-4307-a528-2a491967c35a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Getting quotas for project 8c6da665cd6447ad92aab9fa5f0ffab2. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:37:07.760457 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-b7ffed18-a85a-4307-a528-2a491967c35a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Getting quotas for user 63a6cd4fab2845f08866314463fa5dac and project 8c6da665cd6447ad92aab9fa5f0ffab2. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:37:07.794378 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b7ffed18-a85a-4307-a528-2a491967c35a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.319809 Oct 18 16:37:07.794953 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3635/7251] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Oct 18 16:37:07 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:37:07.855275 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-77b811f9-41b2-428e-8df9-c04707858cd4 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-979238614", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1537900231", "networks": [{"uuid": "b6946d7e-d710-45b8-854c-9bed9032cb5e"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:37:07.866390 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:37:07.867489 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:37:07.920455 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-77b811f9-41b2-428e-8df9-c04707858cd4 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] validate_networks() for [('b6946d7e-d710-45b8-854c-9bed9032cb5e', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 16:37:08.447573 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-77b811f9-41b2-428e-8df9-c04707858cd4 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:37:08.447999 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-77b811f9-41b2-428e-8df9-c04707858cd4 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:37:08.448473 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-77b811f9-41b2-428e-8df9-c04707858cd4 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:37:08.448909 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-77b811f9-41b2-428e-8df9-c04707858cd4 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:37:08.449322 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-77b811f9-41b2-428e-8df9-c04707858cd4 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:37:08.458469 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77b811f9-41b2-428e-8df9-c04707858cd4 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:08.458957 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77b811f9-41b2-428e-8df9-c04707858cd4 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:08.459390 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77b811f9-41b2-428e-8df9-c04707858cd4 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:08.460388 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77b811f9-41b2-428e-8df9-c04707858cd4 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:08.461040 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77b811f9-41b2-428e-8df9-c04707858cd4 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:08.462243 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77b811f9-41b2-428e-8df9-c04707858cd4 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:08.479284 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-77b811f9-41b2-428e-8df9-c04707858cd4 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Getting quotas for project 8c6da665cd6447ad92aab9fa5f0ffab2. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:37:08.484477 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-77b811f9-41b2-428e-8df9-c04707858cd4 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Getting quotas for user 63a6cd4fab2845f08866314463fa5dac and project 8c6da665cd6447ad92aab9fa5f0ffab2. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:37:08.496589 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-77b811f9-41b2-428e-8df9-c04707858cd4 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:37:08.498942 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-77b811f9-41b2-428e-8df9-c04707858cd4 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 234fa080-9f39-4b9f-9a55-e741927cf917] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:37:08.544264 n-d-853682-5 devstack@n-api.service[120406]: ERROR oslo.messaging._drivers.impl_rabbit [None req-77b811f9-41b2-428e-8df9-c04707858cd4 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [15ae3e35-725d-454e-98c3-d97b19cb1781] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 16:37:09.550727 n-d-853682-5 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [None req-77b811f9-41b2-428e-8df9-c04707858cd4 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [15ae3e35-725d-454e-98c3-d97b19cb1781] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 40086. Oct 18 16:37:09.554746 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-77b811f9-41b2-428e-8df9-c04707858cd4 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.704508 Oct 18 16:37:09.555971 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3617/7252] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 16:37:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:37:09.568521 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d2dce54d-4656-4673-8508-ef546ef7635f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:37:09.569322 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d2dce54d-4656-4673-8508-ef546ef7635f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 234fa080-9f39-4b9f-9a55-e741927cf917] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:37:09.630923 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d2dce54d-4656-4673-8508-ef546ef7635f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6cd4fab2845f08866314463fa5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6da665cd6447ad92aab9fa5f0ffab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:37:09.640017 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d2dce54d-4656-4673-8508-ef546ef7635f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/234fa080-9f39-4b9f-9a55-e741927cf917" status: 200 len: 1262 microversion: 2.1 time: 0.076628 Oct 18 16:37:09.640017 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3636/7253] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:37:09 2022] GET /compute/v2.1/servers/234fa080-9f39-4b9f-9a55-e741927cf917 => generated 1262 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:37:10.665176 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1bf135d6-ecfc-4ec6-ae8f-8a4cd28fba3a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:37:10.665832 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1bf135d6-ecfc-4ec6-ae8f-8a4cd28fba3a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 234fa080-9f39-4b9f-9a55-e741927cf917] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:37:10.673246 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1bf135d6-ecfc-4ec6-ae8f-8a4cd28fba3a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:10.674153 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1bf135d6-ecfc-4ec6-ae8f-8a4cd28fba3a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:10.674620 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1bf135d6-ecfc-4ec6-ae8f-8a4cd28fba3a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:10.675512 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1bf135d6-ecfc-4ec6-ae8f-8a4cd28fba3a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:10.675980 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1bf135d6-ecfc-4ec6-ae8f-8a4cd28fba3a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:10.676412 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1bf135d6-ecfc-4ec6-ae8f-8a4cd28fba3a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:10.761675 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1bf135d6-ecfc-4ec6-ae8f-8a4cd28fba3a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6cd4fab2845f08866314463fa5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6da665cd6447ad92aab9fa5f0ffab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:37:10.770117 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1bf135d6-ecfc-4ec6-ae8f-8a4cd28fba3a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/234fa080-9f39-4b9f-9a55-e741927cf917" status: 200 len: 1314 microversion: 2.1 time: 0.110261 Oct 18 16:37:10.778345 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3618/7254] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:37:10 2022] GET /compute/v2.1/servers/234fa080-9f39-4b9f-9a55-e741927cf917 => generated 1314 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:37:11.796016 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ead596b7-2071-4904-81f4-24b4ccf52dbf tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:37:11.796658 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ead596b7-2071-4904-81f4-24b4ccf52dbf tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 234fa080-9f39-4b9f-9a55-e741927cf917] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:37:11.804274 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ead596b7-2071-4904-81f4-24b4ccf52dbf tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:11.805147 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ead596b7-2071-4904-81f4-24b4ccf52dbf tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:11.805608 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ead596b7-2071-4904-81f4-24b4ccf52dbf tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:11.806336 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ead596b7-2071-4904-81f4-24b4ccf52dbf tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:11.806813 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ead596b7-2071-4904-81f4-24b4ccf52dbf tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:11.807262 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ead596b7-2071-4904-81f4-24b4ccf52dbf tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:12.022182 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ead596b7-2071-4904-81f4-24b4ccf52dbf tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6cd4fab2845f08866314463fa5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6da665cd6447ad92aab9fa5f0ffab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:37:12.031089 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ead596b7-2071-4904-81f4-24b4ccf52dbf tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/234fa080-9f39-4b9f-9a55-e741927cf917" status: 200 len: 1362 microversion: 2.1 time: 0.239053 Oct 18 16:37:12.031683 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3637/7255] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:37:11 2022] GET /compute/v2.1/servers/234fa080-9f39-4b9f-9a55-e741927cf917 => generated 1362 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:37:12.321535 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-ebddac67-eb20-462a-a411-2a127b7baa71 req-606a1f0b-61ea-4fe4-b2a9-b643d79f9506 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "234fa080-9f39-4b9f-9a55-e741927cf917", "tag": "c8b11ec4-2d29-4fd4-9166-5e97ff37137e"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:37:12.332285 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ebddac67-eb20-462a-a411-2a127b7baa71 req-606a1f0b-61ea-4fe4-b2a9-b643d79f9506 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:12.332941 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ebddac67-eb20-462a-a411-2a127b7baa71 req-606a1f0b-61ea-4fe4-b2a9-b643d79f9506 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:12.333439 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ebddac67-eb20-462a-a411-2a127b7baa71 req-606a1f0b-61ea-4fe4-b2a9-b643d79f9506 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:12.345352 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-ebddac67-eb20-462a-a411-2a127b7baa71 req-606a1f0b-61ea-4fe4-b2a9-b643d79f9506 service nova] Creating event network-changed:c8b11ec4-2d29-4fd4-9166-5e97ff37137e for instance 234fa080-9f39-4b9f-9a55-e741927cf917 on n-h1-853682-5 Oct 18 16:37:12.350248 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-ebddac67-eb20-462a-a411-2a127b7baa71 req-606a1f0b-61ea-4fe4-b2a9-b643d79f9506 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033535 Oct 18 16:37:12.350858 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3619/7256] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:37:13.057218 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c984ab29-1c86-4597-bef8-70c7ec78b1db tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:37:13.058134 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c984ab29-1c86-4597-bef8-70c7ec78b1db tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 234fa080-9f39-4b9f-9a55-e741927cf917] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:37:13.068346 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c984ab29-1c86-4597-bef8-70c7ec78b1db tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:13.069100 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c984ab29-1c86-4597-bef8-70c7ec78b1db tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:13.069750 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c984ab29-1c86-4597-bef8-70c7ec78b1db tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:13.070931 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c984ab29-1c86-4597-bef8-70c7ec78b1db tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:13.071459 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c984ab29-1c86-4597-bef8-70c7ec78b1db tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:13.072097 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c984ab29-1c86-4597-bef8-70c7ec78b1db tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:13.209329 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c984ab29-1c86-4597-bef8-70c7ec78b1db tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6cd4fab2845f08866314463fa5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6da665cd6447ad92aab9fa5f0ffab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:37:13.218176 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c984ab29-1c86-4597-bef8-70c7ec78b1db tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/234fa080-9f39-4b9f-9a55-e741927cf917" status: 200 len: 1362 microversion: 2.1 time: 0.166598 Oct 18 16:37:13.224984 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3638/7257] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:37:13 2022] GET /compute/v2.1/servers/234fa080-9f39-4b9f-9a55-e741927cf917 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:37:14.243937 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bb382603-cef1-44d1-8711-5a3db0e0c90a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:37:14.244671 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bb382603-cef1-44d1-8711-5a3db0e0c90a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 234fa080-9f39-4b9f-9a55-e741927cf917] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:37:14.250948 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb382603-cef1-44d1-8711-5a3db0e0c90a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:14.251431 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb382603-cef1-44d1-8711-5a3db0e0c90a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:14.251869 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb382603-cef1-44d1-8711-5a3db0e0c90a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:14.252556 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb382603-cef1-44d1-8711-5a3db0e0c90a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:14.253037 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb382603-cef1-44d1-8711-5a3db0e0c90a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:14.253467 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb382603-cef1-44d1-8711-5a3db0e0c90a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:14.391760 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bb382603-cef1-44d1-8711-5a3db0e0c90a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6cd4fab2845f08866314463fa5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6da665cd6447ad92aab9fa5f0ffab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:37:14.400315 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bb382603-cef1-44d1-8711-5a3db0e0c90a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/234fa080-9f39-4b9f-9a55-e741927cf917" status: 200 len: 1362 microversion: 2.1 time: 0.161937 Oct 18 16:37:14.401195 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3620/7258] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:37:14 2022] GET /compute/v2.1/servers/234fa080-9f39-4b9f-9a55-e741927cf917 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:37:15.423876 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-413491a8-f30c-458b-9e01-81a41f0e1e3a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:37:15.424911 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-413491a8-f30c-458b-9e01-81a41f0e1e3a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 234fa080-9f39-4b9f-9a55-e741927cf917] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:37:15.433595 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-413491a8-f30c-458b-9e01-81a41f0e1e3a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:15.434105 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-413491a8-f30c-458b-9e01-81a41f0e1e3a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:15.435051 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-413491a8-f30c-458b-9e01-81a41f0e1e3a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:15.435825 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-413491a8-f30c-458b-9e01-81a41f0e1e3a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:15.436303 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-413491a8-f30c-458b-9e01-81a41f0e1e3a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:15.436749 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-413491a8-f30c-458b-9e01-81a41f0e1e3a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:15.701828 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-413491a8-f30c-458b-9e01-81a41f0e1e3a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6cd4fab2845f08866314463fa5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6da665cd6447ad92aab9fa5f0ffab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:37:15.711439 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-413491a8-f30c-458b-9e01-81a41f0e1e3a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/234fa080-9f39-4b9f-9a55-e741927cf917" status: 200 len: 1362 microversion: 2.1 time: 0.291347 Oct 18 16:37:15.713247 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3639/7259] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:37:15 2022] GET /compute/v2.1/servers/234fa080-9f39-4b9f-9a55-e741927cf917 => generated 1362 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:37:16.735724 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3dff220b-02a9-4dcb-8e27-80d159083ff7 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:37:16.736343 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3dff220b-02a9-4dcb-8e27-80d159083ff7 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 234fa080-9f39-4b9f-9a55-e741927cf917] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:37:16.743369 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3dff220b-02a9-4dcb-8e27-80d159083ff7 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:16.743855 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3dff220b-02a9-4dcb-8e27-80d159083ff7 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:16.744292 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3dff220b-02a9-4dcb-8e27-80d159083ff7 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:16.745015 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3dff220b-02a9-4dcb-8e27-80d159083ff7 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:16.745469 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3dff220b-02a9-4dcb-8e27-80d159083ff7 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:16.745894 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3dff220b-02a9-4dcb-8e27-80d159083ff7 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:16.894089 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3dff220b-02a9-4dcb-8e27-80d159083ff7 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6cd4fab2845f08866314463fa5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6da665cd6447ad92aab9fa5f0ffab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:37:16.904494 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3dff220b-02a9-4dcb-8e27-80d159083ff7 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/234fa080-9f39-4b9f-9a55-e741927cf917" status: 200 len: 1362 microversion: 2.1 time: 0.172543 Oct 18 16:37:16.905148 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3621/7260] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:37:16 2022] GET /compute/v2.1/servers/234fa080-9f39-4b9f-9a55-e741927cf917 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:37:17.927928 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7e3036ae-8f19-450c-b551-c24ad903e436 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:37:17.928581 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7e3036ae-8f19-450c-b551-c24ad903e436 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 234fa080-9f39-4b9f-9a55-e741927cf917] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:37:17.935535 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7e3036ae-8f19-450c-b551-c24ad903e436 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:17.936027 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7e3036ae-8f19-450c-b551-c24ad903e436 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:17.936483 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7e3036ae-8f19-450c-b551-c24ad903e436 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:17.937208 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7e3036ae-8f19-450c-b551-c24ad903e436 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:17.937677 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7e3036ae-8f19-450c-b551-c24ad903e436 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:17.938118 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7e3036ae-8f19-450c-b551-c24ad903e436 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:18.072033 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7e3036ae-8f19-450c-b551-c24ad903e436 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6cd4fab2845f08866314463fa5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6da665cd6447ad92aab9fa5f0ffab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:37:18.079820 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7e3036ae-8f19-450c-b551-c24ad903e436 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/234fa080-9f39-4b9f-9a55-e741927cf917" status: 200 len: 1362 microversion: 2.1 time: 0.155785 Oct 18 16:37:18.080423 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3640/7261] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:37:17 2022] GET /compute/v2.1/servers/234fa080-9f39-4b9f-9a55-e741927cf917 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:37:19.073535 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-693b2683-dfed-402c-89d0-faf4e1005a34 req-bd8c47db-2fad-4819-83f2-af73d687b82f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "234fa080-9f39-4b9f-9a55-e741927cf917", "name": "network-vif-plugged", "status": "completed", "tag": "c8b11ec4-2d29-4fd4-9166-5e97ff37137e"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:37:19.079598 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:37:19.080333 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:37:19.088024 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-693b2683-dfed-402c-89d0-faf4e1005a34 req-bd8c47db-2fad-4819-83f2-af73d687b82f service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:19.088510 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-693b2683-dfed-402c-89d0-faf4e1005a34 req-bd8c47db-2fad-4819-83f2-af73d687b82f service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:19.088971 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-693b2683-dfed-402c-89d0-faf4e1005a34 req-bd8c47db-2fad-4819-83f2-af73d687b82f service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:19.100422 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-693b2683-dfed-402c-89d0-faf4e1005a34 req-bd8c47db-2fad-4819-83f2-af73d687b82f service nova] Creating event network-vif-plugged:c8b11ec4-2d29-4fd4-9166-5e97ff37137e for instance 234fa080-9f39-4b9f-9a55-e741927cf917 on n-h1-853682-5 Oct 18 16:37:19.104042 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f86fe43a-e854-4fa5-ac4c-46c0beea32b6 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:37:19.105288 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f86fe43a-e854-4fa5-ac4c-46c0beea32b6 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 234fa080-9f39-4b9f-9a55-e741927cf917] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:37:19.106235 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-693b2683-dfed-402c-89d0-faf4e1005a34 req-bd8c47db-2fad-4819-83f2-af73d687b82f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036431 Oct 18 16:37:19.106856 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3622/7262] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:37:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:37:19.113219 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f86fe43a-e854-4fa5-ac4c-46c0beea32b6 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:19.113728 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f86fe43a-e854-4fa5-ac4c-46c0beea32b6 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:19.114179 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f86fe43a-e854-4fa5-ac4c-46c0beea32b6 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:19.114900 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f86fe43a-e854-4fa5-ac4c-46c0beea32b6 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:19.115371 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f86fe43a-e854-4fa5-ac4c-46c0beea32b6 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:19.115812 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f86fe43a-e854-4fa5-ac4c-46c0beea32b6 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:19.282216 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f86fe43a-e854-4fa5-ac4c-46c0beea32b6 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6cd4fab2845f08866314463fa5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6da665cd6447ad92aab9fa5f0ffab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:37:19.291432 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f86fe43a-e854-4fa5-ac4c-46c0beea32b6 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/234fa080-9f39-4b9f-9a55-e741927cf917" status: 200 len: 1362 microversion: 2.1 time: 0.191702 Oct 18 16:37:19.292125 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3641/7263] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:37:19 2022] GET /compute/v2.1/servers/234fa080-9f39-4b9f-9a55-e741927cf917 => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:37:20.316675 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8e9b5307-7c40-4915-8ed9-5a8898bbbf2a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:37:20.317454 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8e9b5307-7c40-4915-8ed9-5a8898bbbf2a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 234fa080-9f39-4b9f-9a55-e741927cf917] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:37:20.323711 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e9b5307-7c40-4915-8ed9-5a8898bbbf2a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:20.324202 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e9b5307-7c40-4915-8ed9-5a8898bbbf2a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:20.324640 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e9b5307-7c40-4915-8ed9-5a8898bbbf2a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:20.325362 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e9b5307-7c40-4915-8ed9-5a8898bbbf2a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:20.325824 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e9b5307-7c40-4915-8ed9-5a8898bbbf2a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:20.326255 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e9b5307-7c40-4915-8ed9-5a8898bbbf2a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:20.459334 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8e9b5307-7c40-4915-8ed9-5a8898bbbf2a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6cd4fab2845f08866314463fa5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6da665cd6447ad92aab9fa5f0ffab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:37:20.467568 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8e9b5307-7c40-4915-8ed9-5a8898bbbf2a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/234fa080-9f39-4b9f-9a55-e741927cf917" status: 200 len: 1362 microversion: 2.1 time: 0.155972 Oct 18 16:37:20.468147 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3623/7264] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:37:20 2022] GET /compute/v2.1/servers/234fa080-9f39-4b9f-9a55-e741927cf917 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:37:21.490364 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9376df62-46d2-4bad-8420-f95300f2703c tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:37:21.490999 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9376df62-46d2-4bad-8420-f95300f2703c tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 234fa080-9f39-4b9f-9a55-e741927cf917] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:37:21.493442 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=6 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:37:21.499626 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9376df62-46d2-4bad-8420-f95300f2703c tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:21.500127 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9376df62-46d2-4bad-8420-f95300f2703c tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:21.500579 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9376df62-46d2-4bad-8420-f95300f2703c tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:21.501334 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9376df62-46d2-4bad-8420-f95300f2703c tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:21.501804 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9376df62-46d2-4bad-8420-f95300f2703c tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:21.502248 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9376df62-46d2-4bad-8420-f95300f2703c tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:21.630332 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9376df62-46d2-4bad-8420-f95300f2703c tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6cd4fab2845f08866314463fa5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6da665cd6447ad92aab9fa5f0ffab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:37:21.638711 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9376df62-46d2-4bad-8420-f95300f2703c tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/234fa080-9f39-4b9f-9a55-e741927cf917" status: 200 len: 1553 microversion: 2.1 time: 0.152292 Oct 18 16:37:21.639288 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3642/7265] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:37:21 2022] GET /compute/v2.1/servers/234fa080-9f39-4b9f-9a55-e741927cf917 => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:37:21.660751 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0db36c0a-d2e2-45da-8807-f8d09eb69021 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:37:21.661397 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0db36c0a-d2e2-45da-8807-f8d09eb69021 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 234fa080-9f39-4b9f-9a55-e741927cf917] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:37:21.669089 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0db36c0a-d2e2-45da-8807-f8d09eb69021 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:21.669587 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0db36c0a-d2e2-45da-8807-f8d09eb69021 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:21.670020 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0db36c0a-d2e2-45da-8807-f8d09eb69021 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:21.670708 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0db36c0a-d2e2-45da-8807-f8d09eb69021 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:21.671164 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0db36c0a-d2e2-45da-8807-f8d09eb69021 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:21.671589 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0db36c0a-d2e2-45da-8807-f8d09eb69021 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:21.806652 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0db36c0a-d2e2-45da-8807-f8d09eb69021 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6cd4fab2845f08866314463fa5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6da665cd6447ad92aab9fa5f0ffab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:37:21.814486 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0db36c0a-d2e2-45da-8807-f8d09eb69021 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/234fa080-9f39-4b9f-9a55-e741927cf917" status: 200 len: 1553 microversion: 2.1 time: 0.157594 Oct 18 16:37:21.815068 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3624/7266] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:37:21 2022] GET /compute/v2.1/servers/234fa080-9f39-4b9f-9a55-e741927cf917 => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:37:23.411676 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-36b99aea-1437-4fee-95cf-7707beb999cb tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a37f5973-f2f7-477c-abeb-056fd1aa9110"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:37:23.415037 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-36b99aea-1437-4fee-95cf-7707beb999cb tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 234fa080-9f39-4b9f-9a55-e741927cf917] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:37:23.421912 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-36b99aea-1437-4fee-95cf-7707beb999cb tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:23.422416 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-36b99aea-1437-4fee-95cf-7707beb999cb tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:23.422873 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-36b99aea-1437-4fee-95cf-7707beb999cb tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:23.423586 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-36b99aea-1437-4fee-95cf-7707beb999cb tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:23.424058 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-36b99aea-1437-4fee-95cf-7707beb999cb tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:23.424503 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-36b99aea-1437-4fee-95cf-7707beb999cb tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:23.693659 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-36b99aea-1437-4fee-95cf-7707beb999cb tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "POST /compute/v2.1/servers/234fa080-9f39-4b9f-9a55-e741927cf917/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285651 Oct 18 16:37:23.700156 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3643/7267] 10.222.0.60 () {60 vars in 1323 bytes} [Tue Oct 18 16:37:23 2022] POST /compute/v2.1/servers/234fa080-9f39-4b9f-9a55-e741927cf917/os-volume_attachments => generated 194 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:37:34.408737 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9ee4dd55-1c29-4873-b692-f286a22a76d6 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:37:34.409335 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9ee4dd55-1c29-4873-b692-f286a22a76d6 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 234fa080-9f39-4b9f-9a55-e741927cf917] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:37:34.412290 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:37:34.413122 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=36 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:37:34.419884 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ee4dd55-1c29-4873-b692-f286a22a76d6 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:34.420414 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ee4dd55-1c29-4873-b692-f286a22a76d6 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:34.420877 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ee4dd55-1c29-4873-b692-f286a22a76d6 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:34.421585 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ee4dd55-1c29-4873-b692-f286a22a76d6 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:34.422047 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ee4dd55-1c29-4873-b692-f286a22a76d6 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:34.422477 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ee4dd55-1c29-4873-b692-f286a22a76d6 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:34.503136 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-9ee4dd55-1c29-4873-b692-f286a22a76d6 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lazy-loading 'services' on Instance uuid 234fa080-9f39-4b9f-9a55-e741927cf917 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:37:34.576174 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9ee4dd55-1c29-4873-b692-f286a22a76d6 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "DELETE /compute/v2.1/servers/234fa080-9f39-4b9f-9a55-e741927cf917/os-volume_attachments/a37f5973-f2f7-477c-abeb-056fd1aa9110" status: 202 len: 0 microversion: 2.1 time: 0.171192 Oct 18 16:37:34.576700 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3625/7268] 10.222.0.60 () {58 vars in 1416 bytes} [Tue Oct 18 16:37:34 2022] DELETE /compute/v2.1/servers/234fa080-9f39-4b9f-9a55-e741927cf917/os-volume_attachments/a37f5973-f2f7-477c-abeb-056fd1aa9110 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:37:34.584051 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:37:34.584880 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:37:34.590214 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-19a9b2e1-40e1-4049-9d05-1a8c46fae524 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:37:34.592657 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-19a9b2e1-40e1-4049-9d05-1a8c46fae524 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 234fa080-9f39-4b9f-9a55-e741927cf917] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:37:34.601204 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-19a9b2e1-40e1-4049-9d05-1a8c46fae524 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:34.601707 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-19a9b2e1-40e1-4049-9d05-1a8c46fae524 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:34.602168 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-19a9b2e1-40e1-4049-9d05-1a8c46fae524 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:34.602885 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-19a9b2e1-40e1-4049-9d05-1a8c46fae524 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:34.603359 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-19a9b2e1-40e1-4049-9d05-1a8c46fae524 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:34.603801 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-19a9b2e1-40e1-4049-9d05-1a8c46fae524 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:34.636110 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-19a9b2e1-40e1-4049-9d05-1a8c46fae524 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/234fa080-9f39-4b9f-9a55-e741927cf917/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053995 Oct 18 16:37:34.636681 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3644/7269] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 16:37:34 2022] GET /compute/v2.1/servers/234fa080-9f39-4b9f-9a55-e741927cf917/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:37:35.650303 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b160145a-119f-4a19-be9f-b58dc1ba1049 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:37:35.653238 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b160145a-119f-4a19-be9f-b58dc1ba1049 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 234fa080-9f39-4b9f-9a55-e741927cf917] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:37:35.659530 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b160145a-119f-4a19-be9f-b58dc1ba1049 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:35.660008 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b160145a-119f-4a19-be9f-b58dc1ba1049 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:35.660449 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b160145a-119f-4a19-be9f-b58dc1ba1049 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:35.661195 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b160145a-119f-4a19-be9f-b58dc1ba1049 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:35.661657 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b160145a-119f-4a19-be9f-b58dc1ba1049 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:35.662081 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b160145a-119f-4a19-be9f-b58dc1ba1049 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:35.694064 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b160145a-119f-4a19-be9f-b58dc1ba1049 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/234fa080-9f39-4b9f-9a55-e741927cf917/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049038 Oct 18 16:37:35.695418 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3626/7270] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 16:37:35 2022] GET /compute/v2.1/servers/234fa080-9f39-4b9f-9a55-e741927cf917/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:37:36.706943 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a42d2f1b-cc7a-4c67-9472-014023446caf tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:37:36.709321 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a42d2f1b-cc7a-4c67-9472-014023446caf tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 234fa080-9f39-4b9f-9a55-e741927cf917] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:37:36.716884 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a42d2f1b-cc7a-4c67-9472-014023446caf tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:36.717384 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a42d2f1b-cc7a-4c67-9472-014023446caf tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:36.717829 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a42d2f1b-cc7a-4c67-9472-014023446caf tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:36.718555 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a42d2f1b-cc7a-4c67-9472-014023446caf tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:36.719022 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a42d2f1b-cc7a-4c67-9472-014023446caf tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:36.719462 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a42d2f1b-cc7a-4c67-9472-014023446caf tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:36.755484 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a42d2f1b-cc7a-4c67-9472-014023446caf tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/234fa080-9f39-4b9f-9a55-e741927cf917/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052593 Oct 18 16:37:36.756076 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3645/7271] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 16:37:36 2022] GET /compute/v2.1/servers/234fa080-9f39-4b9f-9a55-e741927cf917/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:37:37.770433 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d5f3211c-3739-452d-ad79-c7314a538746 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:37:37.772520 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d5f3211c-3739-452d-ad79-c7314a538746 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 234fa080-9f39-4b9f-9a55-e741927cf917] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:37:37.778755 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5f3211c-3739-452d-ad79-c7314a538746 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:37.779233 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5f3211c-3739-452d-ad79-c7314a538746 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:37.779670 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5f3211c-3739-452d-ad79-c7314a538746 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:37.780361 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5f3211c-3739-452d-ad79-c7314a538746 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:37.780831 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5f3211c-3739-452d-ad79-c7314a538746 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:37.781267 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5f3211c-3739-452d-ad79-c7314a538746 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:37.811379 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d5f3211c-3739-452d-ad79-c7314a538746 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/234fa080-9f39-4b9f-9a55-e741927cf917/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045234 Oct 18 16:37:37.811953 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3627/7272] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 16:37:37 2022] GET /compute/v2.1/servers/234fa080-9f39-4b9f-9a55-e741927cf917/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:37:38.824404 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-196b73ab-46aa-4fc5-a6cf-0b6b78a0ada4 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:37:38.826627 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-196b73ab-46aa-4fc5-a6cf-0b6b78a0ada4 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 234fa080-9f39-4b9f-9a55-e741927cf917] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:37:38.833563 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-196b73ab-46aa-4fc5-a6cf-0b6b78a0ada4 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:38.834056 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-196b73ab-46aa-4fc5-a6cf-0b6b78a0ada4 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:38.834510 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-196b73ab-46aa-4fc5-a6cf-0b6b78a0ada4 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:38.835214 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-196b73ab-46aa-4fc5-a6cf-0b6b78a0ada4 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:38.835680 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-196b73ab-46aa-4fc5-a6cf-0b6b78a0ada4 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:38.836116 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-196b73ab-46aa-4fc5-a6cf-0b6b78a0ada4 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:38.866631 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-196b73ab-46aa-4fc5-a6cf-0b6b78a0ada4 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/234fa080-9f39-4b9f-9a55-e741927cf917/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046260 Oct 18 16:37:38.867204 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3646/7273] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 16:37:38 2022] GET /compute/v2.1/servers/234fa080-9f39-4b9f-9a55-e741927cf917/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:37:39.879848 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dfa4b5bb-7258-421d-894f-7ad367dc0aa2 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:37:39.882154 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dfa4b5bb-7258-421d-894f-7ad367dc0aa2 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 234fa080-9f39-4b9f-9a55-e741927cf917] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:37:39.889576 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfa4b5bb-7258-421d-894f-7ad367dc0aa2 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:39.890062 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfa4b5bb-7258-421d-894f-7ad367dc0aa2 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:39.890501 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfa4b5bb-7258-421d-894f-7ad367dc0aa2 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:39.891197 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfa4b5bb-7258-421d-894f-7ad367dc0aa2 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:39.891654 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfa4b5bb-7258-421d-894f-7ad367dc0aa2 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:39.892082 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfa4b5bb-7258-421d-894f-7ad367dc0aa2 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:39.922603 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dfa4b5bb-7258-421d-894f-7ad367dc0aa2 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/234fa080-9f39-4b9f-9a55-e741927cf917/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046937 Oct 18 16:37:39.923173 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3628/7274] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 16:37:39 2022] GET /compute/v2.1/servers/234fa080-9f39-4b9f-9a55-e741927cf917/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:37:39.934503 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d1dd3f56-12d1-42ac-ad64-4409ae5f3a65 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:37:39.935189 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d1dd3f56-12d1-42ac-ad64-4409ae5f3a65 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 234fa080-9f39-4b9f-9a55-e741927cf917] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:37:39.944486 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d1dd3f56-12d1-42ac-ad64-4409ae5f3a65 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:39.945015 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d1dd3f56-12d1-42ac-ad64-4409ae5f3a65 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:39.945468 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d1dd3f56-12d1-42ac-ad64-4409ae5f3a65 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:39.946217 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d1dd3f56-12d1-42ac-ad64-4409ae5f3a65 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:39.946688 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d1dd3f56-12d1-42ac-ad64-4409ae5f3a65 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:39.947128 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d1dd3f56-12d1-42ac-ad64-4409ae5f3a65 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:40.024682 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-d1dd3f56-12d1-42ac-ad64-4409ae5f3a65 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] HTTP exception thrown: Instance 234fa080-9f39-4b9f-9a55-e741927cf917 is not attached to volume a37f5973-f2f7-477c-abeb-056fd1aa9110 Oct 18 16:37:40.033382 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d1dd3f56-12d1-42ac-ad64-4409ae5f3a65 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Request method failure captured: Oct 18 16:37:40.033382 n-d-853682-5 devstack@n-api.service[120405]: request: DELETE /compute/v2.1/servers/234fa080-9f39-4b9f-9a55-e741927cf917/os-volume_attachments/a37f5973-f2f7-477c-abeb-056fd1aa9110 HTTP/1.1 Oct 18 16:37:40.033382 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 16:37:40.033382 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 16:37:40.033382 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 16:37:40.033382 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 16:37:40.033382 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 16:37:40.033382 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 16:37:40.033382 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 16:37:40.033382 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 16:37:40.033382 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTtYuta5T7Nq3SDSDbp7TK5-S8B7rv8PnZy73LwNZvFnaq5Optu3QqYPD104dXxtbQsHjlD-kAyQhB8KEHl_5FqlK7Nd_pOYZRi5SYNgB3J_9KbnXNpfDy8bwPqx6xtVFzYDoZDE7FWj0pYmBkxhVPYD5oZQaaZl-kQj_75WVBw7W1CU Oct 18 16:37:40.033382 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 16:37:40.033382 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 16:37:40.033382 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 16:37:40.033382 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 16:37:40.033382 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 16:37:40.033382 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 16:37:40.033382 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 8c6da665cd6447ad92aab9fa5f0ffab2 Oct 18 16:37:40.033382 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1182072653 Oct 18 16:37:40.033382 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 16:37:40.033382 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 16:37:40.033382 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8c6da665cd6447ad92aab9fa5f0ffab2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8c6da665cd6447ad92aab9fa5f0ffab2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8c6da665cd6447ad92aab9fa5f0ffab2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8c6da665cd6447ad92aab9fa5f0ffab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:37:40.033382 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-TestEncryptedCinderVolumes-1182072653 Oct 18 16:37:40.033382 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 8c6da665cd6447ad92aab9fa5f0ffab2 Oct 18 16:37:40.033382 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1182072653 Oct 18 16:37:40.033382 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-TestEncryptedCinderVolumes-1182072653-project Oct 18 16:37:40.033382 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 16:37:40.033382 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 16:37:40.033382 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 63a6cd4fab2845f08866314463fa5dac Oct 18 16:37:40.033382 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-TestEncryptedCinderVolumes-1182072653-project Oct 18 16:37:40.033382 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 16:37:40.033382 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 234fa080-9f39-4b9f-9a55-e741927cf917 is not attached to volume a37f5973-f2f7-477c-abeb-056fd1aa9110 Oct 18 16:37:40.033382 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'server_id': '234fa080-9f39-4b9f-9a55-e741927cf917', 'id': 'a37f5973-f2f7-477c-abeb-056fd1aa9110'} Oct 18 16:37:40.033382 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:37:40.033382 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:37:40.033382 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 18 16:37:40.033382 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 18 16:37:40.033382 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 16:37:40.033382 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 16:37:40.033382 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 18 16:37:40.033382 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 18 16:37:40.033382 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a37f5973-f2f7-477c-abeb-056fd1aa9110. Oct 18 16:37:40.033382 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:37:40.033382 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:37:40.033382 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:37:40.033382 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:37:40.033382 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:37:40.033382 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:37:40.033382 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:37:40.033382 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:37:40.033382 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:37:40.033382 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:37:40.033382 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 18 16:37:40.033382 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 18 16:37:40.033382 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 234fa080-9f39-4b9f-9a55-e741927cf917 is not attached to volume a37f5973-f2f7-477c-abeb-056fd1aa9110 Oct 18 16:37:40.033382 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:37:40.033382 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:37:40.033382 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:37:40.033382 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:37:40.033382 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:37:40.033382 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:37:40.038576 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:37:40.038576 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:37:40.038576 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 234fa080-9f39-4b9f-9a55-e741927cf917 is not attached to volume a37f5973-f2f7-477c-abeb-056fd1aa9110 Oct 18 16:37:40.038576 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:37:40.038576 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d1dd3f56-12d1-42ac-ad64-4409ae5f3a65 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Returning 404 to user: Instance 234fa080-9f39-4b9f-9a55-e741927cf917 is not attached to volume a37f5973-f2f7-477c-abeb-056fd1aa9110 {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:37:40.038576 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d1dd3f56-12d1-42ac-ad64-4409ae5f3a65 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "DELETE /compute/v2.1/servers/234fa080-9f39-4b9f-9a55-e741927cf917/os-volume_attachments/a37f5973-f2f7-477c-abeb-056fd1aa9110" status: 404 len: 154 microversion: 2.1 time: 0.104977 Oct 18 16:37:40.038576 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3647/7275] 10.222.0.60 () {58 vars in 1416 bytes} [Tue Oct 18 16:37:39 2022] DELETE /compute/v2.1/servers/234fa080-9f39-4b9f-9a55-e741927cf917/os-volume_attachments/a37f5973-f2f7-477c-abeb-056fd1aa9110 => generated 154 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:37:43.382014 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-be97522b-3baf-4b57-a448-53eea783435f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:37:43.382507 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-be97522b-3baf-4b57-a448-53eea783435f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 234fa080-9f39-4b9f-9a55-e741927cf917] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:37:43.390377 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be97522b-3baf-4b57-a448-53eea783435f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:43.390873 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be97522b-3baf-4b57-a448-53eea783435f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:43.391313 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be97522b-3baf-4b57-a448-53eea783435f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:43.392046 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be97522b-3baf-4b57-a448-53eea783435f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:43.392485 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be97522b-3baf-4b57-a448-53eea783435f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:43.392943 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be97522b-3baf-4b57-a448-53eea783435f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:43.423181 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-be97522b-3baf-4b57-a448-53eea783435f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 234fa080-9f39-4b9f-9a55-e741927cf917] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:37:43.503209 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-be97522b-3baf-4b57-a448-53eea783435f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "DELETE /compute/v2.1/servers/234fa080-9f39-4b9f-9a55-e741927cf917" status: 204 len: 0 microversion: 2.1 time: 0.124889 Oct 18 16:37:43.504339 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3629/7276] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 16:37:43 2022] DELETE /compute/v2.1/servers/234fa080-9f39-4b9f-9a55-e741927cf917 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 16:37:43.514051 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d4f9f644-cbc5-43a9-a0f5-9f8533b35470 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:37:43.514744 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d4f9f644-cbc5-43a9-a0f5-9f8533b35470 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 234fa080-9f39-4b9f-9a55-e741927cf917] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:37:43.523029 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4f9f644-cbc5-43a9-a0f5-9f8533b35470 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:43.523573 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4f9f644-cbc5-43a9-a0f5-9f8533b35470 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:43.524036 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4f9f644-cbc5-43a9-a0f5-9f8533b35470 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:43.524754 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4f9f644-cbc5-43a9-a0f5-9f8533b35470 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:43.525262 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4f9f644-cbc5-43a9-a0f5-9f8533b35470 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:43.525713 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4f9f644-cbc5-43a9-a0f5-9f8533b35470 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:43.661279 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d4f9f644-cbc5-43a9-a0f5-9f8533b35470 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6cd4fab2845f08866314463fa5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6da665cd6447ad92aab9fa5f0ffab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:37:43.669549 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d4f9f644-cbc5-43a9-a0f5-9f8533b35470 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/234fa080-9f39-4b9f-9a55-e741927cf917" status: 200 len: 1559 microversion: 2.1 time: 0.160607 Oct 18 16:37:43.670121 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3648/7277] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:37:43 2022] GET /compute/v2.1/servers/234fa080-9f39-4b9f-9a55-e741927cf917 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:37:44.694380 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1e4d02c3-65bd-4ad6-820c-f0f72c9a104c tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:37:44.695089 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1e4d02c3-65bd-4ad6-820c-f0f72c9a104c tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 234fa080-9f39-4b9f-9a55-e741927cf917] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:37:44.702043 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e4d02c3-65bd-4ad6-820c-f0f72c9a104c tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:44.702534 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e4d02c3-65bd-4ad6-820c-f0f72c9a104c tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:44.702973 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e4d02c3-65bd-4ad6-820c-f0f72c9a104c tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:44.703666 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e4d02c3-65bd-4ad6-820c-f0f72c9a104c tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:44.704122 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e4d02c3-65bd-4ad6-820c-f0f72c9a104c tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:44.704548 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e4d02c3-65bd-4ad6-820c-f0f72c9a104c tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:44.840563 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1e4d02c3-65bd-4ad6-820c-f0f72c9a104c tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6cd4fab2845f08866314463fa5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6da665cd6447ad92aab9fa5f0ffab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:37:44.848269 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1e4d02c3-65bd-4ad6-820c-f0f72c9a104c tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/234fa080-9f39-4b9f-9a55-e741927cf917" status: 200 len: 1559 microversion: 2.1 time: 0.158287 Oct 18 16:37:44.848862 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3630/7278] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:37:44 2022] GET /compute/v2.1/servers/234fa080-9f39-4b9f-9a55-e741927cf917 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:37:45.815015 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-0da001ce-8abb-40e8-abcb-d9601001dffb req-27aa1ab3-e0bb-43f2-b25a-501ab85cdcfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "234fa080-9f39-4b9f-9a55-e741927cf917", "name": "network-vif-deleted", "tag": "c8b11ec4-2d29-4fd4-9166-5e97ff37137e"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:37:45.826022 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-0da001ce-8abb-40e8-abcb-d9601001dffb req-27aa1ab3-e0bb-43f2-b25a-501ab85cdcfd service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:45.826526 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-0da001ce-8abb-40e8-abcb-d9601001dffb req-27aa1ab3-e0bb-43f2-b25a-501ab85cdcfd service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:45.827045 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-0da001ce-8abb-40e8-abcb-d9601001dffb req-27aa1ab3-e0bb-43f2-b25a-501ab85cdcfd service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:45.841186 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-0da001ce-8abb-40e8-abcb-d9601001dffb req-27aa1ab3-e0bb-43f2-b25a-501ab85cdcfd service nova] Creating event network-vif-deleted:c8b11ec4-2d29-4fd4-9166-5e97ff37137e for instance 234fa080-9f39-4b9f-9a55-e741927cf917 on n-h1-853682-5 Oct 18 16:37:45.847418 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-0da001ce-8abb-40e8-abcb-d9601001dffb req-27aa1ab3-e0bb-43f2-b25a-501ab85cdcfd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035900 Oct 18 16:37:45.848368 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3649/7279] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:37:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:37:45.872205 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8aecc418-fd09-4374-9a3a-14cbe4240b27 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:37:45.873158 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8aecc418-fd09-4374-9a3a-14cbe4240b27 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 234fa080-9f39-4b9f-9a55-e741927cf917] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:37:45.880413 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8aecc418-fd09-4374-9a3a-14cbe4240b27 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:45.881261 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8aecc418-fd09-4374-9a3a-14cbe4240b27 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:45.881976 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8aecc418-fd09-4374-9a3a-14cbe4240b27 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:45.887199 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8aecc418-fd09-4374-9a3a-14cbe4240b27 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:45.887841 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8aecc418-fd09-4374-9a3a-14cbe4240b27 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:45.888390 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8aecc418-fd09-4374-9a3a-14cbe4240b27 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:45.964364 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8aecc418-fd09-4374-9a3a-14cbe4240b27 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6cd4fab2845f08866314463fa5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6da665cd6447ad92aab9fa5f0ffab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:37:45.972400 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8aecc418-fd09-4374-9a3a-14cbe4240b27 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/234fa080-9f39-4b9f-9a55-e741927cf917" status: 200 len: 1347 microversion: 2.1 time: 0.105181 Oct 18 16:37:45.973010 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3631/7280] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:37:45 2022] GET /compute/v2.1/servers/234fa080-9f39-4b9f-9a55-e741927cf917 => generated 1347 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:37:46.997189 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-243d3857-a8b9-4f27-a0ca-28d4d75026ff tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:37:46.998229 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-243d3857-a8b9-4f27-a0ca-28d4d75026ff tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 234fa080-9f39-4b9f-9a55-e741927cf917] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:37:47.005415 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-243d3857-a8b9-4f27-a0ca-28d4d75026ff tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:47.005922 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-243d3857-a8b9-4f27-a0ca-28d4d75026ff tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:47.006383 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-243d3857-a8b9-4f27-a0ca-28d4d75026ff tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:47.007097 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-243d3857-a8b9-4f27-a0ca-28d4d75026ff tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:47.007579 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-243d3857-a8b9-4f27-a0ca-28d4d75026ff tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:47.008200 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-243d3857-a8b9-4f27-a0ca-28d4d75026ff tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:47.025968 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-243d3857-a8b9-4f27-a0ca-28d4d75026ff tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] HTTP exception thrown: Instance 234fa080-9f39-4b9f-9a55-e741927cf917 could not be found. Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-243d3857-a8b9-4f27-a0ca-28d4d75026ff tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Request method failure captured: Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/234fa080-9f39-4b9f-9a55-e741927cf917 HTTP/1.1 Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTtYuta5T7Nq3SDSDbp7TK5-S8B7rv8PnZy73LwNZvFnaq5Optu3QqYPD104dXxtbQsHjlD-kAyQhB8KEHl_5FqlK7Nd_pOYZRi5SYNgB3J_9KbnXNpfDy8bwPqx6xtVFzYDoZDE7FWj0pYmBkxhVPYD5oZQaaZl-kQj_75WVBw7W1CU Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 8c6da665cd6447ad92aab9fa5f0ffab2 Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1182072653 Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8c6da665cd6447ad92aab9fa5f0ffab2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8c6da665cd6447ad92aab9fa5f0ffab2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8c6da665cd6447ad92aab9fa5f0ffab2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8c6da665cd6447ad92aab9fa5f0ffab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-TestEncryptedCinderVolumes-1182072653 Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 8c6da665cd6447ad92aab9fa5f0ffab2 Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1182072653 Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-TestEncryptedCinderVolumes-1182072653-project Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 63a6cd4fab2845f08866314463fa5dac Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-TestEncryptedCinderVolumes-1182072653-project Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 234fa080-9f39-4b9f-9a55-e741927cf917 could not be found. Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '234fa080-9f39-4b9f-9a55-e741927cf917'} Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 234fa080-9f39-4b9f-9a55-e741927cf917 could not be found. Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 234fa080-9f39-4b9f-9a55-e741927cf917 could not be found. Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:37:47.028234 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:37:47.033413 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:37:47.033413 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:37:47.033413 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:37:47.033413 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:37:47.033413 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:37:47.033413 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:37:47.033413 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 234fa080-9f39-4b9f-9a55-e741927cf917 could not be found. Oct 18 16:37:47.033413 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:37:47.033413 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-243d3857-a8b9-4f27-a0ca-28d4d75026ff tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Returning 404 to user: Instance 234fa080-9f39-4b9f-9a55-e741927cf917 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:37:47.033413 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-243d3857-a8b9-4f27-a0ca-28d4d75026ff tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/234fa080-9f39-4b9f-9a55-e741927cf917" status: 404 len: 111 microversion: 2.1 time: 0.037581 Oct 18 16:37:47.033413 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3650/7281] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:37:46 2022] GET /compute/v2.1/servers/234fa080-9f39-4b9f-9a55-e741927cf917 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:37:47.038828 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e04602f3-a8b5-4e96-b147-38cfdfc58416 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '.version_select at 0x7f7c37c37700>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:37:47.059775 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e04602f3-a8b5-4e96-b147-38cfdfc58416 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1537900231" status: 202 len: 0 microversion: 2.1 time: 0.025143 Oct 18 16:37:47.060354 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3632/7282] 10.222.0.60 () {58 vars in 1278 bytes} [Tue Oct 18 16:37:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1537900231 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:37:47.077723 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1fab2d4a-74dd-4501-a720-183e3427e731 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Action: 'create', calling method: .version_select at 0x7f7c3c084280>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1693231008", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgc2vvAUgcXHqAZ8nohBp4+aQhfPfXqdmUQInztduIDbWJz9GSFAWLYt9dcuJdqkEEBjmFNF5UTUi0MBiY7o6W0rgRnBScvtMKq7m0DDEuzNOIZcBY2q9hHlTi2MmzgoA=="}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:37:47.093723 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-1fab2d4a-74dd-4501-a720-183e3427e731 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Getting quotas for project 8c6da665cd6447ad92aab9fa5f0ffab2. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:37:47.098867 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-1fab2d4a-74dd-4501-a720-183e3427e731 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Getting quotas for user 63a6cd4fab2845f08866314463fa5dac and project 8c6da665cd6447ad92aab9fa5f0ffab2. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:37:47.122551 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1fab2d4a-74dd-4501-a720-183e3427e731 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.049337 Oct 18 16:37:47.123148 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3651/7283] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Oct 18 16:37:47 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:37:47.174200 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-93c84c5f-f011-4f15-b4a4-5330497eabfb tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1991461602", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1693231008", "networks": [{"uuid": "b6946d7e-d710-45b8-854c-9bed9032cb5e"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:37:47.227955 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-93c84c5f-f011-4f15-b4a4-5330497eabfb tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] validate_networks() for [('b6946d7e-d710-45b8-854c-9bed9032cb5e', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 16:37:47.605280 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-93c84c5f-f011-4f15-b4a4-5330497eabfb tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:37:47.605731 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-93c84c5f-f011-4f15-b4a4-5330497eabfb tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:37:47.606211 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-93c84c5f-f011-4f15-b4a4-5330497eabfb tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:37:47.606604 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-93c84c5f-f011-4f15-b4a4-5330497eabfb tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:37:47.607050 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-93c84c5f-f011-4f15-b4a4-5330497eabfb tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:37:47.615874 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-93c84c5f-f011-4f15-b4a4-5330497eabfb tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:47.616355 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-93c84c5f-f011-4f15-b4a4-5330497eabfb tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:47.616854 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-93c84c5f-f011-4f15-b4a4-5330497eabfb tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:47.617586 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-93c84c5f-f011-4f15-b4a4-5330497eabfb tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:47.618044 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-93c84c5f-f011-4f15-b4a4-5330497eabfb tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:47.618470 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-93c84c5f-f011-4f15-b4a4-5330497eabfb tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:47.636238 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-93c84c5f-f011-4f15-b4a4-5330497eabfb tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Getting quotas for project 8c6da665cd6447ad92aab9fa5f0ffab2. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:37:47.641541 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-93c84c5f-f011-4f15-b4a4-5330497eabfb tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Getting quotas for user 63a6cd4fab2845f08866314463fa5dac and project 8c6da665cd6447ad92aab9fa5f0ffab2. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:37:47.654178 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-93c84c5f-f011-4f15-b4a4-5330497eabfb tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:37:47.656500 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-93c84c5f-f011-4f15-b4a4-5330497eabfb tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 1eccfc5d-94c7-4cb1-af2c-6df3729c7135] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:37:47.704029 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-93c84c5f-f011-4f15-b4a4-5330497eabfb tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.533758 Oct 18 16:37:47.704710 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3633/7284] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 16:37:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:37:47.716533 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-49645959-ea32-41e1-bf29-b96776e7dabf tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:37:47.717199 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-49645959-ea32-41e1-bf29-b96776e7dabf tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 1eccfc5d-94c7-4cb1-af2c-6df3729c7135] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:37:47.772318 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-49645959-ea32-41e1-bf29-b96776e7dabf tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6cd4fab2845f08866314463fa5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6da665cd6447ad92aab9fa5f0ffab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:37:47.781429 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-49645959-ea32-41e1-bf29-b96776e7dabf tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/1eccfc5d-94c7-4cb1-af2c-6df3729c7135" status: 200 len: 1263 microversion: 2.1 time: 0.069356 Oct 18 16:37:47.782017 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3652/7285] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:37:47 2022] GET /compute/v2.1/servers/1eccfc5d-94c7-4cb1-af2c-6df3729c7135 => generated 1263 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:37:48.806909 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5390ee85-9600-4830-ae27-07c9c5bfcd11 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:37:48.807532 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5390ee85-9600-4830-ae27-07c9c5bfcd11 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 1eccfc5d-94c7-4cb1-af2c-6df3729c7135] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:37:48.815990 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5390ee85-9600-4830-ae27-07c9c5bfcd11 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:48.816479 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5390ee85-9600-4830-ae27-07c9c5bfcd11 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:48.816949 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5390ee85-9600-4830-ae27-07c9c5bfcd11 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:48.817657 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5390ee85-9600-4830-ae27-07c9c5bfcd11 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:48.818112 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5390ee85-9600-4830-ae27-07c9c5bfcd11 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:48.818540 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5390ee85-9600-4830-ae27-07c9c5bfcd11 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:48.915605 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5390ee85-9600-4830-ae27-07c9c5bfcd11 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6cd4fab2845f08866314463fa5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6da665cd6447ad92aab9fa5f0ffab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:37:48.924341 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5390ee85-9600-4830-ae27-07c9c5bfcd11 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/1eccfc5d-94c7-4cb1-af2c-6df3729c7135" status: 200 len: 1323 microversion: 2.1 time: 0.122713 Oct 18 16:37:48.924962 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3634/7286] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:37:48 2022] GET /compute/v2.1/servers/1eccfc5d-94c7-4cb1-af2c-6df3729c7135 => generated 1323 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:37:49.947833 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-57f35338-ab5d-482b-8f73-331c235e13b1 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:37:49.948820 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-57f35338-ab5d-482b-8f73-331c235e13b1 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 1eccfc5d-94c7-4cb1-af2c-6df3729c7135] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:37:49.956381 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57f35338-ab5d-482b-8f73-331c235e13b1 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:49.957008 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57f35338-ab5d-482b-8f73-331c235e13b1 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:49.957473 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57f35338-ab5d-482b-8f73-331c235e13b1 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:49.958207 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57f35338-ab5d-482b-8f73-331c235e13b1 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:49.958697 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57f35338-ab5d-482b-8f73-331c235e13b1 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:49.959150 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-57f35338-ab5d-482b-8f73-331c235e13b1 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:50.201792 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-57f35338-ab5d-482b-8f73-331c235e13b1 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6cd4fab2845f08866314463fa5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6da665cd6447ad92aab9fa5f0ffab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:37:50.209916 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-57f35338-ab5d-482b-8f73-331c235e13b1 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/1eccfc5d-94c7-4cb1-af2c-6df3729c7135" status: 200 len: 1363 microversion: 2.1 time: 0.266093 Oct 18 16:37:50.210523 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3653/7287] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:37:49 2022] GET /compute/v2.1/servers/1eccfc5d-94c7-4cb1-af2c-6df3729c7135 => generated 1363 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:37:50.346437 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-16e0e6af-f907-43da-94e2-666d1c03797e req-2f00c8d8-0c70-4ec6-85a1-3c9f96fe6e50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eccfc5d-94c7-4cb1-af2c-6df3729c7135", "tag": "ed745fd5-c7df-4cc0-ac62-53a4ec37b241"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:37:50.358529 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-16e0e6af-f907-43da-94e2-666d1c03797e req-2f00c8d8-0c70-4ec6-85a1-3c9f96fe6e50 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:50.359760 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-16e0e6af-f907-43da-94e2-666d1c03797e req-2f00c8d8-0c70-4ec6-85a1-3c9f96fe6e50 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:50.360210 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-16e0e6af-f907-43da-94e2-666d1c03797e req-2f00c8d8-0c70-4ec6-85a1-3c9f96fe6e50 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:50.372363 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-16e0e6af-f907-43da-94e2-666d1c03797e req-2f00c8d8-0c70-4ec6-85a1-3c9f96fe6e50 service nova] Creating event network-changed:ed745fd5-c7df-4cc0-ac62-53a4ec37b241 for instance 1eccfc5d-94c7-4cb1-af2c-6df3729c7135 on n-h1-853682-5 Oct 18 16:37:50.377465 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-16e0e6af-f907-43da-94e2-666d1c03797e req-2f00c8d8-0c70-4ec6-85a1-3c9f96fe6e50 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035613 Oct 18 16:37:50.378282 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3635/7288] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:37:51.232901 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c2d6fec3-a641-4340-b8a5-d7fc9d36cf9a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:37:51.233541 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c2d6fec3-a641-4340-b8a5-d7fc9d36cf9a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 1eccfc5d-94c7-4cb1-af2c-6df3729c7135] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:37:51.240445 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c2d6fec3-a641-4340-b8a5-d7fc9d36cf9a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:51.240982 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c2d6fec3-a641-4340-b8a5-d7fc9d36cf9a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:51.241446 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c2d6fec3-a641-4340-b8a5-d7fc9d36cf9a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:51.242153 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c2d6fec3-a641-4340-b8a5-d7fc9d36cf9a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:51.242627 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c2d6fec3-a641-4340-b8a5-d7fc9d36cf9a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:51.243107 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c2d6fec3-a641-4340-b8a5-d7fc9d36cf9a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:51.374946 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c2d6fec3-a641-4340-b8a5-d7fc9d36cf9a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6cd4fab2845f08866314463fa5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6da665cd6447ad92aab9fa5f0ffab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:37:51.382713 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c2d6fec3-a641-4340-b8a5-d7fc9d36cf9a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/1eccfc5d-94c7-4cb1-af2c-6df3729c7135" status: 200 len: 1363 microversion: 2.1 time: 0.153818 Oct 18 16:37:51.383289 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3654/7289] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:37:51 2022] GET /compute/v2.1/servers/1eccfc5d-94c7-4cb1-af2c-6df3729c7135 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:37:52.408876 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d852660b-97c5-4663-9a50-a8979c9154ce tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:37:52.409580 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d852660b-97c5-4663-9a50-a8979c9154ce tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 1eccfc5d-94c7-4cb1-af2c-6df3729c7135] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:37:52.416789 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d852660b-97c5-4663-9a50-a8979c9154ce tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:52.417310 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d852660b-97c5-4663-9a50-a8979c9154ce tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:52.417736 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d852660b-97c5-4663-9a50-a8979c9154ce tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:52.418577 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d852660b-97c5-4663-9a50-a8979c9154ce tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:52.419031 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d852660b-97c5-4663-9a50-a8979c9154ce tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:52.419454 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d852660b-97c5-4663-9a50-a8979c9154ce tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:52.551034 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d852660b-97c5-4663-9a50-a8979c9154ce tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6cd4fab2845f08866314463fa5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6da665cd6447ad92aab9fa5f0ffab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:37:52.559120 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d852660b-97c5-4663-9a50-a8979c9154ce tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/1eccfc5d-94c7-4cb1-af2c-6df3729c7135" status: 200 len: 1363 microversion: 2.1 time: 0.156577 Oct 18 16:37:52.559708 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3636/7290] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:37:52 2022] GET /compute/v2.1/servers/1eccfc5d-94c7-4cb1-af2c-6df3729c7135 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:37:53.582792 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-faf4d67d-cfdc-4665-bc3d-ed30dac252f0 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:37:53.583434 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-faf4d67d-cfdc-4665-bc3d-ed30dac252f0 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 1eccfc5d-94c7-4cb1-af2c-6df3729c7135] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:37:53.591521 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-faf4d67d-cfdc-4665-bc3d-ed30dac252f0 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:53.592053 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-faf4d67d-cfdc-4665-bc3d-ed30dac252f0 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:53.592508 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-faf4d67d-cfdc-4665-bc3d-ed30dac252f0 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:53.593260 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-faf4d67d-cfdc-4665-bc3d-ed30dac252f0 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:53.593736 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-faf4d67d-cfdc-4665-bc3d-ed30dac252f0 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:53.594183 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-faf4d67d-cfdc-4665-bc3d-ed30dac252f0 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:53.725991 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-faf4d67d-cfdc-4665-bc3d-ed30dac252f0 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6cd4fab2845f08866314463fa5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6da665cd6447ad92aab9fa5f0ffab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:37:53.734372 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-faf4d67d-cfdc-4665-bc3d-ed30dac252f0 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/1eccfc5d-94c7-4cb1-af2c-6df3729c7135" status: 200 len: 1363 microversion: 2.1 time: 0.155565 Oct 18 16:37:53.734948 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3655/7291] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:37:53 2022] GET /compute/v2.1/servers/1eccfc5d-94c7-4cb1-af2c-6df3729c7135 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:37:54.757723 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3a72c1bb-30e8-4381-8701-a960d7d26b8a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:37:54.758602 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3a72c1bb-30e8-4381-8701-a960d7d26b8a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 1eccfc5d-94c7-4cb1-af2c-6df3729c7135] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:37:54.765650 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a72c1bb-30e8-4381-8701-a960d7d26b8a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:54.766137 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a72c1bb-30e8-4381-8701-a960d7d26b8a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:54.766575 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a72c1bb-30e8-4381-8701-a960d7d26b8a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:54.767265 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a72c1bb-30e8-4381-8701-a960d7d26b8a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:54.767720 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a72c1bb-30e8-4381-8701-a960d7d26b8a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:54.768146 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a72c1bb-30e8-4381-8701-a960d7d26b8a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:54.899049 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3a72c1bb-30e8-4381-8701-a960d7d26b8a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6cd4fab2845f08866314463fa5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6da665cd6447ad92aab9fa5f0ffab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:37:54.907446 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3a72c1bb-30e8-4381-8701-a960d7d26b8a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/1eccfc5d-94c7-4cb1-af2c-6df3729c7135" status: 200 len: 1363 microversion: 2.1 time: 0.154304 Oct 18 16:37:54.908050 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3637/7292] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:37:54 2022] GET /compute/v2.1/servers/1eccfc5d-94c7-4cb1-af2c-6df3729c7135 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:37:55.931040 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-95227bc4-515f-443d-9bd7-d7417345caa9 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:37:55.931568 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-95227bc4-515f-443d-9bd7-d7417345caa9 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 1eccfc5d-94c7-4cb1-af2c-6df3729c7135] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:37:55.938755 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-95227bc4-515f-443d-9bd7-d7417345caa9 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:55.939252 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-95227bc4-515f-443d-9bd7-d7417345caa9 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:55.939697 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-95227bc4-515f-443d-9bd7-d7417345caa9 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:55.940406 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-95227bc4-515f-443d-9bd7-d7417345caa9 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:55.940907 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-95227bc4-515f-443d-9bd7-d7417345caa9 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:55.941560 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-95227bc4-515f-443d-9bd7-d7417345caa9 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:56.075413 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-95227bc4-515f-443d-9bd7-d7417345caa9 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6cd4fab2845f08866314463fa5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6da665cd6447ad92aab9fa5f0ffab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:37:56.083084 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-95227bc4-515f-443d-9bd7-d7417345caa9 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/1eccfc5d-94c7-4cb1-af2c-6df3729c7135" status: 200 len: 1363 microversion: 2.1 time: 0.156103 Oct 18 16:37:56.083672 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3656/7293] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:37:55 2022] GET /compute/v2.1/servers/1eccfc5d-94c7-4cb1-af2c-6df3729c7135 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:37:57.107176 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5ddeaf6d-e03d-494b-88a0-7ed38f695feb tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:37:57.107772 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5ddeaf6d-e03d-494b-88a0-7ed38f695feb tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 1eccfc5d-94c7-4cb1-af2c-6df3729c7135] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:37:57.117664 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ddeaf6d-e03d-494b-88a0-7ed38f695feb tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:57.118220 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ddeaf6d-e03d-494b-88a0-7ed38f695feb tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:57.118656 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ddeaf6d-e03d-494b-88a0-7ed38f695feb tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:57.119362 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ddeaf6d-e03d-494b-88a0-7ed38f695feb tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:57.119812 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ddeaf6d-e03d-494b-88a0-7ed38f695feb tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:57.120230 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ddeaf6d-e03d-494b-88a0-7ed38f695feb tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:57.252596 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-248893ce-0040-4d58-a088-e895219d380a req-06eb2a30-8b71-458f-90f7-38b0fd829ca8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eccfc5d-94c7-4cb1-af2c-6df3729c7135", "name": "network-vif-plugged", "status": "completed", "tag": "ed745fd5-c7df-4cc0-ac62-53a4ec37b241"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:37:57.263139 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-248893ce-0040-4d58-a088-e895219d380a req-06eb2a30-8b71-458f-90f7-38b0fd829ca8 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:57.263646 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-248893ce-0040-4d58-a088-e895219d380a req-06eb2a30-8b71-458f-90f7-38b0fd829ca8 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:57.264093 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-248893ce-0040-4d58-a088-e895219d380a req-06eb2a30-8b71-458f-90f7-38b0fd829ca8 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:57.265683 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5ddeaf6d-e03d-494b-88a0-7ed38f695feb tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6cd4fab2845f08866314463fa5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6da665cd6447ad92aab9fa5f0ffab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:37:57.278048 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-248893ce-0040-4d58-a088-e895219d380a req-06eb2a30-8b71-458f-90f7-38b0fd829ca8 service nova] Creating event network-vif-plugged:ed745fd5-c7df-4cc0-ac62-53a4ec37b241 for instance 1eccfc5d-94c7-4cb1-af2c-6df3729c7135 on n-h1-853682-5 Oct 18 16:37:57.281413 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5ddeaf6d-e03d-494b-88a0-7ed38f695feb tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/1eccfc5d-94c7-4cb1-af2c-6df3729c7135" status: 200 len: 1363 microversion: 2.1 time: 0.178765 Oct 18 16:37:57.282030 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3638/7294] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:37:57 2022] GET /compute/v2.1/servers/1eccfc5d-94c7-4cb1-af2c-6df3729c7135 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:37:57.285051 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-248893ce-0040-4d58-a088-e895219d380a req-06eb2a30-8b71-458f-90f7-38b0fd829ca8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036991 Oct 18 16:37:57.286190 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3657/7295] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:37:58.309339 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d52e5697-d99a-498e-81e2-06c9ba926654 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:37:58.310328 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d52e5697-d99a-498e-81e2-06c9ba926654 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 1eccfc5d-94c7-4cb1-af2c-6df3729c7135] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:37:58.312233 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:37:58.312925 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:37:58.319484 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d52e5697-d99a-498e-81e2-06c9ba926654 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:58.319975 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d52e5697-d99a-498e-81e2-06c9ba926654 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:58.320416 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d52e5697-d99a-498e-81e2-06c9ba926654 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:58.321154 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d52e5697-d99a-498e-81e2-06c9ba926654 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:58.321615 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d52e5697-d99a-498e-81e2-06c9ba926654 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:58.322045 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d52e5697-d99a-498e-81e2-06c9ba926654 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:58.453113 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d52e5697-d99a-498e-81e2-06c9ba926654 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6cd4fab2845f08866314463fa5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6da665cd6447ad92aab9fa5f0ffab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:37:58.460906 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d52e5697-d99a-498e-81e2-06c9ba926654 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/1eccfc5d-94c7-4cb1-af2c-6df3729c7135" status: 200 len: 1363 microversion: 2.1 time: 0.155878 Oct 18 16:37:58.461486 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3639/7296] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:37:58 2022] GET /compute/v2.1/servers/1eccfc5d-94c7-4cb1-af2c-6df3729c7135 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:37:59.480361 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=6 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:37:59.485903 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-139a30e2-33ac-4a2f-b672-ff708caa6119 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:37:59.486634 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-139a30e2-33ac-4a2f-b672-ff708caa6119 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 1eccfc5d-94c7-4cb1-af2c-6df3729c7135] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:37:59.493318 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-139a30e2-33ac-4a2f-b672-ff708caa6119 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:59.493822 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-139a30e2-33ac-4a2f-b672-ff708caa6119 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:59.494283 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-139a30e2-33ac-4a2f-b672-ff708caa6119 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:59.494997 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-139a30e2-33ac-4a2f-b672-ff708caa6119 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:59.495475 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-139a30e2-33ac-4a2f-b672-ff708caa6119 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:59.495924 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-139a30e2-33ac-4a2f-b672-ff708caa6119 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:59.627662 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-139a30e2-33ac-4a2f-b672-ff708caa6119 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6cd4fab2845f08866314463fa5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6da665cd6447ad92aab9fa5f0ffab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:37:59.635364 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-139a30e2-33ac-4a2f-b672-ff708caa6119 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/1eccfc5d-94c7-4cb1-af2c-6df3729c7135" status: 200 len: 1554 microversion: 2.1 time: 0.155979 Oct 18 16:37:59.635940 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3658/7297] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:37:59 2022] GET /compute/v2.1/servers/1eccfc5d-94c7-4cb1-af2c-6df3729c7135 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:37:59.657957 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f8414de3-978a-45c7-9be7-48f217b46762 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:37:59.658593 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f8414de3-978a-45c7-9be7-48f217b46762 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 1eccfc5d-94c7-4cb1-af2c-6df3729c7135] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:37:59.665673 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8414de3-978a-45c7-9be7-48f217b46762 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:59.666150 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8414de3-978a-45c7-9be7-48f217b46762 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:59.666579 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8414de3-978a-45c7-9be7-48f217b46762 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:59.667259 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8414de3-978a-45c7-9be7-48f217b46762 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:37:59.667708 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8414de3-978a-45c7-9be7-48f217b46762 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:37:59.668137 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8414de3-978a-45c7-9be7-48f217b46762 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:37:59.798235 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f8414de3-978a-45c7-9be7-48f217b46762 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6cd4fab2845f08866314463fa5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6da665cd6447ad92aab9fa5f0ffab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:37:59.805986 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f8414de3-978a-45c7-9be7-48f217b46762 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/1eccfc5d-94c7-4cb1-af2c-6df3729c7135" status: 200 len: 1554 microversion: 2.1 time: 0.151898 Oct 18 16:37:59.806565 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3640/7298] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:37:59 2022] GET /compute/v2.1/servers/1eccfc5d-94c7-4cb1-af2c-6df3729c7135 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:38:01.311982 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-28b20ec8-4f98-4648-8314-e462dc1e0d9f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f1ffff7c-6a42-47c4-bcea-6c8dde40f4ad"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:38:01.314428 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-28b20ec8-4f98-4648-8314-e462dc1e0d9f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 1eccfc5d-94c7-4cb1-af2c-6df3729c7135] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:38:01.321287 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-28b20ec8-4f98-4648-8314-e462dc1e0d9f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:01.321790 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-28b20ec8-4f98-4648-8314-e462dc1e0d9f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:01.322253 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-28b20ec8-4f98-4648-8314-e462dc1e0d9f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:01.322959 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-28b20ec8-4f98-4648-8314-e462dc1e0d9f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:01.323490 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-28b20ec8-4f98-4648-8314-e462dc1e0d9f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:01.323909 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-28b20ec8-4f98-4648-8314-e462dc1e0d9f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:01.588314 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-28b20ec8-4f98-4648-8314-e462dc1e0d9f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "POST /compute/v2.1/servers/1eccfc5d-94c7-4cb1-af2c-6df3729c7135/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280711 Oct 18 16:38:01.588983 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3659/7299] 10.222.0.60 () {60 vars in 1323 bytes} [Tue Oct 18 16:38:01 2022] POST /compute/v2.1/servers/1eccfc5d-94c7-4cb1-af2c-6df3729c7135/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:38:12.310064 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6cc5f037-6d2a-49b3-bb96-30e0f189a921 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:38:12.310646 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6cc5f037-6d2a-49b3-bb96-30e0f189a921 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 1eccfc5d-94c7-4cb1-af2c-6df3729c7135] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:38:12.313041 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:38:12.313760 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:38:12.320095 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6cc5f037-6d2a-49b3-bb96-30e0f189a921 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:12.321024 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6cc5f037-6d2a-49b3-bb96-30e0f189a921 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:12.321470 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6cc5f037-6d2a-49b3-bb96-30e0f189a921 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:12.322168 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6cc5f037-6d2a-49b3-bb96-30e0f189a921 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:12.322627 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6cc5f037-6d2a-49b3-bb96-30e0f189a921 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:12.323050 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6cc5f037-6d2a-49b3-bb96-30e0f189a921 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:12.407108 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-6cc5f037-6d2a-49b3-bb96-30e0f189a921 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lazy-loading 'services' on Instance uuid 1eccfc5d-94c7-4cb1-af2c-6df3729c7135 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:38:12.478612 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6cc5f037-6d2a-49b3-bb96-30e0f189a921 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1eccfc5d-94c7-4cb1-af2c-6df3729c7135/os-volume_attachments/f1ffff7c-6a42-47c4-bcea-6c8dde40f4ad" status: 202 len: 0 microversion: 2.1 time: 0.172663 Oct 18 16:38:12.479446 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3641/7300] 10.222.0.60 () {58 vars in 1416 bytes} [Tue Oct 18 16:38:12 2022] DELETE /compute/v2.1/servers/1eccfc5d-94c7-4cb1-af2c-6df3729c7135/os-volume_attachments/f1ffff7c-6a42-47c4-bcea-6c8dde40f4ad => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:38:12.486332 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:38:12.487132 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:38:12.491527 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0fdf47cc-9fd7-4279-90a8-1c350b3d92f0 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:38:12.494328 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0fdf47cc-9fd7-4279-90a8-1c350b3d92f0 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 1eccfc5d-94c7-4cb1-af2c-6df3729c7135] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:38:12.503281 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0fdf47cc-9fd7-4279-90a8-1c350b3d92f0 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:12.504004 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0fdf47cc-9fd7-4279-90a8-1c350b3d92f0 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:12.504467 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0fdf47cc-9fd7-4279-90a8-1c350b3d92f0 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:12.505416 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0fdf47cc-9fd7-4279-90a8-1c350b3d92f0 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:12.505705 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0fdf47cc-9fd7-4279-90a8-1c350b3d92f0 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:12.506146 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0fdf47cc-9fd7-4279-90a8-1c350b3d92f0 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:12.537851 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0fdf47cc-9fd7-4279-90a8-1c350b3d92f0 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/1eccfc5d-94c7-4cb1-af2c-6df3729c7135/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053564 Oct 18 16:38:12.538955 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3660/7301] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 16:38:12 2022] GET /compute/v2.1/servers/1eccfc5d-94c7-4cb1-af2c-6df3729c7135/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:38:13.552605 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-abdf905b-0bb6-4dc5-ae6e-657850beedc4 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:38:13.555048 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-abdf905b-0bb6-4dc5-ae6e-657850beedc4 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 1eccfc5d-94c7-4cb1-af2c-6df3729c7135] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:38:13.561605 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-abdf905b-0bb6-4dc5-ae6e-657850beedc4 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:13.562099 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-abdf905b-0bb6-4dc5-ae6e-657850beedc4 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:13.562541 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-abdf905b-0bb6-4dc5-ae6e-657850beedc4 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:13.563241 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-abdf905b-0bb6-4dc5-ae6e-657850beedc4 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:13.563737 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-abdf905b-0bb6-4dc5-ae6e-657850beedc4 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:13.564161 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-abdf905b-0bb6-4dc5-ae6e-657850beedc4 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:13.597995 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-abdf905b-0bb6-4dc5-ae6e-657850beedc4 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/1eccfc5d-94c7-4cb1-af2c-6df3729c7135/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050917 Oct 18 16:38:13.598567 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3642/7302] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 16:38:13 2022] GET /compute/v2.1/servers/1eccfc5d-94c7-4cb1-af2c-6df3729c7135/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:38:14.610731 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6ba7fb5c-5a89-4fd6-8b04-d244390cdd0f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:38:14.613086 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6ba7fb5c-5a89-4fd6-8b04-d244390cdd0f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 1eccfc5d-94c7-4cb1-af2c-6df3729c7135] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:38:14.620120 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ba7fb5c-5a89-4fd6-8b04-d244390cdd0f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:14.620634 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ba7fb5c-5a89-4fd6-8b04-d244390cdd0f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:14.621121 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ba7fb5c-5a89-4fd6-8b04-d244390cdd0f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:14.622367 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ba7fb5c-5a89-4fd6-8b04-d244390cdd0f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:14.622845 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ba7fb5c-5a89-4fd6-8b04-d244390cdd0f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:14.623293 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6ba7fb5c-5a89-4fd6-8b04-d244390cdd0f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:14.656013 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6ba7fb5c-5a89-4fd6-8b04-d244390cdd0f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/1eccfc5d-94c7-4cb1-af2c-6df3729c7135/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049323 Oct 18 16:38:14.656610 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3661/7303] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 16:38:14 2022] GET /compute/v2.1/servers/1eccfc5d-94c7-4cb1-af2c-6df3729c7135/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:38:15.669117 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c95d2ec7-3baf-407e-94fb-d9d6c0dc6279 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:38:15.671635 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c95d2ec7-3baf-407e-94fb-d9d6c0dc6279 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 1eccfc5d-94c7-4cb1-af2c-6df3729c7135] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:38:15.683762 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c95d2ec7-3baf-407e-94fb-d9d6c0dc6279 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:15.684453 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c95d2ec7-3baf-407e-94fb-d9d6c0dc6279 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:15.684977 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c95d2ec7-3baf-407e-94fb-d9d6c0dc6279 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:15.685730 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c95d2ec7-3baf-407e-94fb-d9d6c0dc6279 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:15.686190 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c95d2ec7-3baf-407e-94fb-d9d6c0dc6279 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:15.686621 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c95d2ec7-3baf-407e-94fb-d9d6c0dc6279 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:15.724721 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c95d2ec7-3baf-407e-94fb-d9d6c0dc6279 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/1eccfc5d-94c7-4cb1-af2c-6df3729c7135/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059683 Oct 18 16:38:15.725530 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3643/7304] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 16:38:15 2022] GET /compute/v2.1/servers/1eccfc5d-94c7-4cb1-af2c-6df3729c7135/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:38:16.737695 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2c277af8-348e-4b5f-b397-8bc634d204c7 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:38:16.739982 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2c277af8-348e-4b5f-b397-8bc634d204c7 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 1eccfc5d-94c7-4cb1-af2c-6df3729c7135] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:38:16.747524 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c277af8-348e-4b5f-b397-8bc634d204c7 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:16.748032 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c277af8-348e-4b5f-b397-8bc634d204c7 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:16.748492 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c277af8-348e-4b5f-b397-8bc634d204c7 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:16.749243 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c277af8-348e-4b5f-b397-8bc634d204c7 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:16.749720 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c277af8-348e-4b5f-b397-8bc634d204c7 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:16.750167 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c277af8-348e-4b5f-b397-8bc634d204c7 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:16.781484 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2c277af8-348e-4b5f-b397-8bc634d204c7 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/1eccfc5d-94c7-4cb1-af2c-6df3729c7135/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047917 Oct 18 16:38:16.782077 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3662/7305] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 16:38:16 2022] GET /compute/v2.1/servers/1eccfc5d-94c7-4cb1-af2c-6df3729c7135/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:38:17.794091 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-204ea24f-5f1f-4abb-aee7-139f46c6264a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:38:17.796277 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-204ea24f-5f1f-4abb-aee7-139f46c6264a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 1eccfc5d-94c7-4cb1-af2c-6df3729c7135] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:38:17.803862 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-204ea24f-5f1f-4abb-aee7-139f46c6264a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:17.804355 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-204ea24f-5f1f-4abb-aee7-139f46c6264a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:17.804793 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-204ea24f-5f1f-4abb-aee7-139f46c6264a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:17.805527 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-204ea24f-5f1f-4abb-aee7-139f46c6264a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:17.805983 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-204ea24f-5f1f-4abb-aee7-139f46c6264a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:17.806412 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-204ea24f-5f1f-4abb-aee7-139f46c6264a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:17.836613 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-204ea24f-5f1f-4abb-aee7-139f46c6264a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/1eccfc5d-94c7-4cb1-af2c-6df3729c7135/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047006 Oct 18 16:38:17.837222 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3644/7306] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 16:38:17 2022] GET /compute/v2.1/servers/1eccfc5d-94c7-4cb1-af2c-6df3729c7135/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:38:17.849122 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f2e9106a-6a71-41fb-8344-ac616425c423 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:38:17.849657 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f2e9106a-6a71-41fb-8344-ac616425c423 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 1eccfc5d-94c7-4cb1-af2c-6df3729c7135] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:38:17.856552 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f2e9106a-6a71-41fb-8344-ac616425c423 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:17.857096 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f2e9106a-6a71-41fb-8344-ac616425c423 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:17.857557 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f2e9106a-6a71-41fb-8344-ac616425c423 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:17.858277 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f2e9106a-6a71-41fb-8344-ac616425c423 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:17.858790 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f2e9106a-6a71-41fb-8344-ac616425c423 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:17.859232 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f2e9106a-6a71-41fb-8344-ac616425c423 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:17.935237 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-f2e9106a-6a71-41fb-8344-ac616425c423 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] HTTP exception thrown: Instance 1eccfc5d-94c7-4cb1-af2c-6df3729c7135 is not attached to volume f1ffff7c-6a42-47c4-bcea-6c8dde40f4ad Oct 18 16:38:17.936910 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f2e9106a-6a71-41fb-8344-ac616425c423 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Request method failure captured: Oct 18 16:38:17.936910 n-d-853682-5 devstack@n-api.service[120405]: request: DELETE /compute/v2.1/servers/1eccfc5d-94c7-4cb1-af2c-6df3729c7135/os-volume_attachments/f1ffff7c-6a42-47c4-bcea-6c8dde40f4ad HTTP/1.1 Oct 18 16:38:17.936910 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 16:38:17.936910 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 16:38:17.936910 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 16:38:17.936910 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 16:38:17.936910 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 16:38:17.936910 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 16:38:17.936910 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 16:38:17.936910 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 16:38:17.936910 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTtYuta5T7Nq3SDSDbp7TK5-S8B7rv8PnZy73LwNZvFnaq5Optu3QqYPD104dXxtbQsHjlD-kAyQhB8KEHl_5FqlK7Nd_pOYZRi5SYNgB3J_9KbnXNpfDy8bwPqx6xtVFzYDoZDE7FWj0pYmBkxhVPYD5oZQaaZl-kQj_75WVBw7W1CU Oct 18 16:38:17.936910 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 16:38:17.936910 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 16:38:17.936910 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 16:38:17.936910 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 16:38:17.936910 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 16:38:17.936910 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 16:38:17.936910 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 8c6da665cd6447ad92aab9fa5f0ffab2 Oct 18 16:38:17.936910 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1182072653 Oct 18 16:38:17.936910 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 16:38:17.936910 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 16:38:17.936910 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8c6da665cd6447ad92aab9fa5f0ffab2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8c6da665cd6447ad92aab9fa5f0ffab2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8c6da665cd6447ad92aab9fa5f0ffab2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8c6da665cd6447ad92aab9fa5f0ffab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:38:17.936910 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-TestEncryptedCinderVolumes-1182072653 Oct 18 16:38:17.936910 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 8c6da665cd6447ad92aab9fa5f0ffab2 Oct 18 16:38:17.936910 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1182072653 Oct 18 16:38:17.936910 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-TestEncryptedCinderVolumes-1182072653-project Oct 18 16:38:17.936910 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 16:38:17.936910 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 16:38:17.936910 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 63a6cd4fab2845f08866314463fa5dac Oct 18 16:38:17.936910 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-TestEncryptedCinderVolumes-1182072653-project Oct 18 16:38:17.936910 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 16:38:17.936910 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 1eccfc5d-94c7-4cb1-af2c-6df3729c7135 is not attached to volume f1ffff7c-6a42-47c4-bcea-6c8dde40f4ad Oct 18 16:38:17.936910 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'server_id': '1eccfc5d-94c7-4cb1-af2c-6df3729c7135', 'id': 'f1ffff7c-6a42-47c4-bcea-6c8dde40f4ad'} Oct 18 16:38:17.936910 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:38:17.936910 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:38:17.936910 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 18 16:38:17.936910 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 18 16:38:17.936910 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 16:38:17.936910 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 16:38:17.936910 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 18 16:38:17.936910 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 18 16:38:17.936910 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f1ffff7c-6a42-47c4-bcea-6c8dde40f4ad. Oct 18 16:38:17.936910 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:38:17.936910 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:38:17.936910 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:38:17.936910 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:38:17.936910 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:38:17.936910 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:38:17.936910 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:38:17.936910 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:38:17.936910 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:38:17.936910 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:38:17.936910 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 18 16:38:17.936910 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 18 16:38:17.936910 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1eccfc5d-94c7-4cb1-af2c-6df3729c7135 is not attached to volume f1ffff7c-6a42-47c4-bcea-6c8dde40f4ad Oct 18 16:38:17.936910 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:38:17.936910 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:38:17.936910 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:38:17.936910 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:38:17.936910 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:38:17.936910 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:38:17.941836 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:38:17.941836 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:38:17.941836 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1eccfc5d-94c7-4cb1-af2c-6df3729c7135 is not attached to volume f1ffff7c-6a42-47c4-bcea-6c8dde40f4ad Oct 18 16:38:17.941836 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:38:17.941836 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f2e9106a-6a71-41fb-8344-ac616425c423 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Returning 404 to user: Instance 1eccfc5d-94c7-4cb1-af2c-6df3729c7135 is not attached to volume f1ffff7c-6a42-47c4-bcea-6c8dde40f4ad {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:38:17.941836 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f2e9106a-6a71-41fb-8344-ac616425c423 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1eccfc5d-94c7-4cb1-af2c-6df3729c7135/os-volume_attachments/f1ffff7c-6a42-47c4-bcea-6c8dde40f4ad" status: 404 len: 154 microversion: 2.1 time: 0.093533 Oct 18 16:38:17.941836 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3663/7307] 10.222.0.60 () {58 vars in 1416 bytes} [Tue Oct 18 16:38:17 2022] DELETE /compute/v2.1/servers/1eccfc5d-94c7-4cb1-af2c-6df3729c7135/os-volume_attachments/f1ffff7c-6a42-47c4-bcea-6c8dde40f4ad => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:38:21.293306 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9c6bdaa9-eeab-4cb8-8762-8ea493b34cb9 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:38:21.293889 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9c6bdaa9-eeab-4cb8-8762-8ea493b34cb9 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 1eccfc5d-94c7-4cb1-af2c-6df3729c7135] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:38:21.301583 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c6bdaa9-eeab-4cb8-8762-8ea493b34cb9 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:21.302069 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c6bdaa9-eeab-4cb8-8762-8ea493b34cb9 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:21.302500 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c6bdaa9-eeab-4cb8-8762-8ea493b34cb9 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:21.303211 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c6bdaa9-eeab-4cb8-8762-8ea493b34cb9 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:21.304059 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c6bdaa9-eeab-4cb8-8762-8ea493b34cb9 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:21.305155 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c6bdaa9-eeab-4cb8-8762-8ea493b34cb9 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:21.332460 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9c6bdaa9-eeab-4cb8-8762-8ea493b34cb9 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 1eccfc5d-94c7-4cb1-af2c-6df3729c7135] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:38:21.414694 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9c6bdaa9-eeab-4cb8-8762-8ea493b34cb9 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1eccfc5d-94c7-4cb1-af2c-6df3729c7135" status: 204 len: 0 microversion: 2.1 time: 0.124978 Oct 18 16:38:21.415532 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3645/7308] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 16:38:21 2022] DELETE /compute/v2.1/servers/1eccfc5d-94c7-4cb1-af2c-6df3729c7135 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:38:21.425149 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-40fcd312-40f4-474f-8a56-af0351ce1fa3 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:38:21.425856 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-40fcd312-40f4-474f-8a56-af0351ce1fa3 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 1eccfc5d-94c7-4cb1-af2c-6df3729c7135] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:38:21.433356 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-40fcd312-40f4-474f-8a56-af0351ce1fa3 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:21.433977 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-40fcd312-40f4-474f-8a56-af0351ce1fa3 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:21.434648 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-40fcd312-40f4-474f-8a56-af0351ce1fa3 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:21.435375 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-40fcd312-40f4-474f-8a56-af0351ce1fa3 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:21.436041 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-40fcd312-40f4-474f-8a56-af0351ce1fa3 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:21.436545 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-40fcd312-40f4-474f-8a56-af0351ce1fa3 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:21.836945 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-40fcd312-40f4-474f-8a56-af0351ce1fa3 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6cd4fab2845f08866314463fa5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6da665cd6447ad92aab9fa5f0ffab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:38:21.844769 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-40fcd312-40f4-474f-8a56-af0351ce1fa3 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/1eccfc5d-94c7-4cb1-af2c-6df3729c7135" status: 200 len: 1560 microversion: 2.1 time: 0.424875 Oct 18 16:38:21.845379 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3664/7309] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:38:21 2022] GET /compute/v2.1/servers/1eccfc5d-94c7-4cb1-af2c-6df3729c7135 => generated 1560 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:38:22.868285 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b8ec6b5b-7ef7-4667-b38a-8b600d30b41f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:38:22.869016 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b8ec6b5b-7ef7-4667-b38a-8b600d30b41f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 1eccfc5d-94c7-4cb1-af2c-6df3729c7135] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:38:22.875957 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8ec6b5b-7ef7-4667-b38a-8b600d30b41f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:22.876442 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8ec6b5b-7ef7-4667-b38a-8b600d30b41f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:22.876913 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8ec6b5b-7ef7-4667-b38a-8b600d30b41f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:22.877611 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8ec6b5b-7ef7-4667-b38a-8b600d30b41f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:22.878068 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8ec6b5b-7ef7-4667-b38a-8b600d30b41f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:22.878501 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8ec6b5b-7ef7-4667-b38a-8b600d30b41f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:23.007671 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b8ec6b5b-7ef7-4667-b38a-8b600d30b41f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6cd4fab2845f08866314463fa5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6da665cd6447ad92aab9fa5f0ffab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:38:23.016364 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b8ec6b5b-7ef7-4667-b38a-8b600d30b41f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/1eccfc5d-94c7-4cb1-af2c-6df3729c7135" status: 200 len: 1560 microversion: 2.1 time: 0.152452 Oct 18 16:38:23.016978 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3646/7310] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:38:22 2022] GET /compute/v2.1/servers/1eccfc5d-94c7-4cb1-af2c-6df3729c7135 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:38:23.602852 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-c44ab16f-8618-47b0-8e00-75857d0f1858 req-3c8b5cba-d5ec-4ba7-a835-7e3f1176c2e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eccfc5d-94c7-4cb1-af2c-6df3729c7135", "name": "network-vif-deleted", "tag": "ed745fd5-c7df-4cc0-ac62-53a4ec37b241"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:38:23.618219 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-c44ab16f-8618-47b0-8e00-75857d0f1858 req-3c8b5cba-d5ec-4ba7-a835-7e3f1176c2e6 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:23.619077 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-c44ab16f-8618-47b0-8e00-75857d0f1858 req-3c8b5cba-d5ec-4ba7-a835-7e3f1176c2e6 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:23.619770 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-c44ab16f-8618-47b0-8e00-75857d0f1858 req-3c8b5cba-d5ec-4ba7-a835-7e3f1176c2e6 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:23.641602 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-c44ab16f-8618-47b0-8e00-75857d0f1858 req-3c8b5cba-d5ec-4ba7-a835-7e3f1176c2e6 service nova] Creating event network-vif-deleted:ed745fd5-c7df-4cc0-ac62-53a4ec37b241 for instance 1eccfc5d-94c7-4cb1-af2c-6df3729c7135 on n-h1-853682-5 Oct 18 16:38:23.651083 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-c44ab16f-8618-47b0-8e00-75857d0f1858 req-3c8b5cba-d5ec-4ba7-a835-7e3f1176c2e6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051814 Oct 18 16:38:23.651963 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3665/7311] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:38:24.040090 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-81a4321c-3f07-4764-b7a1-e779e3c392ae tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:38:24.040641 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-81a4321c-3f07-4764-b7a1-e779e3c392ae tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 1eccfc5d-94c7-4cb1-af2c-6df3729c7135] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:38:24.047445 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81a4321c-3f07-4764-b7a1-e779e3c392ae tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:24.047936 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81a4321c-3f07-4764-b7a1-e779e3c392ae tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:24.048369 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81a4321c-3f07-4764-b7a1-e779e3c392ae tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:24.049094 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81a4321c-3f07-4764-b7a1-e779e3c392ae tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:24.049551 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81a4321c-3f07-4764-b7a1-e779e3c392ae tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:24.049974 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81a4321c-3f07-4764-b7a1-e779e3c392ae tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:24.082399 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81a4321c-3f07-4764-b7a1-e779e3c392ae tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:24.082899 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81a4321c-3f07-4764-b7a1-e779e3c392ae tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:24.083344 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81a4321c-3f07-4764-b7a1-e779e3c392ae tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:24.083780 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-81a4321c-3f07-4764-b7a1-e779e3c392ae tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lazy-loading 'fault' on Instance uuid 1eccfc5d-94c7-4cb1-af2c-6df3729c7135 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:38:24.127097 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-81a4321c-3f07-4764-b7a1-e779e3c392ae tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6cd4fab2845f08866314463fa5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6da665cd6447ad92aab9fa5f0ffab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:38:24.136614 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-81a4321c-3f07-4764-b7a1-e779e3c392ae tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/1eccfc5d-94c7-4cb1-af2c-6df3729c7135" status: 200 len: 1353 microversion: 2.1 time: 0.100794 Oct 18 16:38:24.137409 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3647/7312] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:38:24 2022] GET /compute/v2.1/servers/1eccfc5d-94c7-4cb1-af2c-6df3729c7135 => generated 1353 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:38:25.162395 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fc7eecd0-003b-41c6-8d06-a5af5ac1a41c tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:38:25.163394 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-fc7eecd0-003b-41c6-8d06-a5af5ac1a41c tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 1eccfc5d-94c7-4cb1-af2c-6df3729c7135] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:38:25.169695 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fc7eecd0-003b-41c6-8d06-a5af5ac1a41c tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:25.170193 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fc7eecd0-003b-41c6-8d06-a5af5ac1a41c tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:25.171282 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fc7eecd0-003b-41c6-8d06-a5af5ac1a41c tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:25.172004 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fc7eecd0-003b-41c6-8d06-a5af5ac1a41c tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:25.172521 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fc7eecd0-003b-41c6-8d06-a5af5ac1a41c tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:25.173013 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fc7eecd0-003b-41c6-8d06-a5af5ac1a41c tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:25.186435 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-fc7eecd0-003b-41c6-8d06-a5af5ac1a41c tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] HTTP exception thrown: Instance 1eccfc5d-94c7-4cb1-af2c-6df3729c7135 could not be found. Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fc7eecd0-003b-41c6-8d06-a5af5ac1a41c tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Request method failure captured: Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/1eccfc5d-94c7-4cb1-af2c-6df3729c7135 HTTP/1.1 Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTtYuta5T7Nq3SDSDbp7TK5-S8B7rv8PnZy73LwNZvFnaq5Optu3QqYPD104dXxtbQsHjlD-kAyQhB8KEHl_5FqlK7Nd_pOYZRi5SYNgB3J_9KbnXNpfDy8bwPqx6xtVFzYDoZDE7FWj0pYmBkxhVPYD5oZQaaZl-kQj_75WVBw7W1CU Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 8c6da665cd6447ad92aab9fa5f0ffab2 Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1182072653 Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8c6da665cd6447ad92aab9fa5f0ffab2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8c6da665cd6447ad92aab9fa5f0ffab2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8c6da665cd6447ad92aab9fa5f0ffab2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8c6da665cd6447ad92aab9fa5f0ffab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-TestEncryptedCinderVolumes-1182072653 Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 8c6da665cd6447ad92aab9fa5f0ffab2 Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1182072653 Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-TestEncryptedCinderVolumes-1182072653-project Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 63a6cd4fab2845f08866314463fa5dac Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-TestEncryptedCinderVolumes-1182072653-project Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 1eccfc5d-94c7-4cb1-af2c-6df3729c7135 could not be found. Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '1eccfc5d-94c7-4cb1-af2c-6df3729c7135'} Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1eccfc5d-94c7-4cb1-af2c-6df3729c7135 could not be found. Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1eccfc5d-94c7-4cb1-af2c-6df3729c7135 could not be found. Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:38:25.188091 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:38:25.193029 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:38:25.193029 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:38:25.193029 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:38:25.193029 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:38:25.193029 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:38:25.193029 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:38:25.193029 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1eccfc5d-94c7-4cb1-af2c-6df3729c7135 could not be found. Oct 18 16:38:25.193029 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:38:25.193029 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fc7eecd0-003b-41c6-8d06-a5af5ac1a41c tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Returning 404 to user: Instance 1eccfc5d-94c7-4cb1-af2c-6df3729c7135 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:38:25.193029 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fc7eecd0-003b-41c6-8d06-a5af5ac1a41c tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/1eccfc5d-94c7-4cb1-af2c-6df3729c7135" status: 404 len: 111 microversion: 2.1 time: 0.032401 Oct 18 16:38:25.193029 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3666/7313] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:38:25 2022] GET /compute/v2.1/servers/1eccfc5d-94c7-4cb1-af2c-6df3729c7135 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:38:25.198419 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-13a01ad5-eea1-4475-a5a0-4ffb6c86a5a7 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '.version_select at 0x7f7c37a425e0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:38:25.219033 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-13a01ad5-eea1-4475-a5a0-4ffb6c86a5a7 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1693231008" status: 202 len: 0 microversion: 2.1 time: 0.024437 Oct 18 16:38:25.219611 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3648/7314] 10.222.0.60 () {58 vars in 1278 bytes} [Tue Oct 18 16:38:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1693231008 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:38:25.237163 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6eb67d05-8065-4f34-bc23-4a788a99755b tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Action: 'create', calling method: .version_select at 0x7f7c3c0f1f70>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1574579757", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZgcue/OCWsX2kjvCMYr8WIy3Kp4dvgTn3wyZbGbvWw7BJKTk78BmiEzA8xNFLNoW8etDblsG+LI+kbKBDMXcS939EYAeJak+8G47j0q7cHxdvN5CqutAq49V+Ppt1w/w=="}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:38:25.253079 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-6eb67d05-8065-4f34-bc23-4a788a99755b tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Getting quotas for project 8c6da665cd6447ad92aab9fa5f0ffab2. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:38:25.258975 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-6eb67d05-8065-4f34-bc23-4a788a99755b tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Getting quotas for user 63a6cd4fab2845f08866314463fa5dac and project 8c6da665cd6447ad92aab9fa5f0ffab2. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:38:25.284925 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6eb67d05-8065-4f34-bc23-4a788a99755b tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.051825 Oct 18 16:38:25.285529 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3667/7315] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Oct 18 16:38:25 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:38:25.335500 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c5c3304b-bde0-4de9-be56-74d4bab4febd tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-685706544", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1574579757", "networks": [{"uuid": "b6946d7e-d710-45b8-854c-9bed9032cb5e"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:38:25.388737 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-c5c3304b-bde0-4de9-be56-74d4bab4febd tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] validate_networks() for [('b6946d7e-d710-45b8-854c-9bed9032cb5e', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 16:38:25.766247 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-c5c3304b-bde0-4de9-be56-74d4bab4febd tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:38:25.766697 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-c5c3304b-bde0-4de9-be56-74d4bab4febd tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:38:25.767164 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-c5c3304b-bde0-4de9-be56-74d4bab4febd tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:38:25.767568 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-c5c3304b-bde0-4de9-be56-74d4bab4febd tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:38:25.767974 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-c5c3304b-bde0-4de9-be56-74d4bab4febd tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:38:25.779016 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5c3304b-bde0-4de9-be56-74d4bab4febd tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:25.779516 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5c3304b-bde0-4de9-be56-74d4bab4febd tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:25.779964 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5c3304b-bde0-4de9-be56-74d4bab4febd tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:25.780692 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5c3304b-bde0-4de9-be56-74d4bab4febd tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:25.781176 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5c3304b-bde0-4de9-be56-74d4bab4febd tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:25.781602 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5c3304b-bde0-4de9-be56-74d4bab4febd tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:25.802255 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-c5c3304b-bde0-4de9-be56-74d4bab4febd tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Getting quotas for project 8c6da665cd6447ad92aab9fa5f0ffab2. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:38:25.807481 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-c5c3304b-bde0-4de9-be56-74d4bab4febd tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Getting quotas for user 63a6cd4fab2845f08866314463fa5dac and project 8c6da665cd6447ad92aab9fa5f0ffab2. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:38:25.820286 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c5c3304b-bde0-4de9-be56-74d4bab4febd tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:38:25.822631 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c5c3304b-bde0-4de9-be56-74d4bab4febd tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 4b87436b-2b84-4d45-9f50-52348c30ee1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:38:25.869021 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c5c3304b-bde0-4de9-be56-74d4bab4febd tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.537389 Oct 18 16:38:25.869696 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3649/7316] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 16:38:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 539 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:38:25.881980 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-16bef4a7-6295-49d2-b4b0-bafc30dd7529 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:38:25.882615 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-16bef4a7-6295-49d2-b4b0-bafc30dd7529 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 4b87436b-2b84-4d45-9f50-52348c30ee1c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:38:25.938402 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-16bef4a7-6295-49d2-b4b0-bafc30dd7529 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6cd4fab2845f08866314463fa5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6da665cd6447ad92aab9fa5f0ffab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:38:25.946630 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-16bef4a7-6295-49d2-b4b0-bafc30dd7529 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/4b87436b-2b84-4d45-9f50-52348c30ee1c" status: 200 len: 1262 microversion: 2.1 time: 0.068895 Oct 18 16:38:25.947210 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3668/7317] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:38:25 2022] GET /compute/v2.1/servers/4b87436b-2b84-4d45-9f50-52348c30ee1c => generated 1262 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:38:26.970890 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-55e46d91-ec34-4eb2-9f9f-44a72749b1f0 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:38:26.971599 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-55e46d91-ec34-4eb2-9f9f-44a72749b1f0 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 4b87436b-2b84-4d45-9f50-52348c30ee1c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:38:26.978381 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55e46d91-ec34-4eb2-9f9f-44a72749b1f0 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:26.978994 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55e46d91-ec34-4eb2-9f9f-44a72749b1f0 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:26.979505 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55e46d91-ec34-4eb2-9f9f-44a72749b1f0 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:26.980280 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55e46d91-ec34-4eb2-9f9f-44a72749b1f0 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:26.980778 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55e46d91-ec34-4eb2-9f9f-44a72749b1f0 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:26.981232 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55e46d91-ec34-4eb2-9f9f-44a72749b1f0 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:27.045970 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-55e46d91-ec34-4eb2-9f9f-44a72749b1f0 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6cd4fab2845f08866314463fa5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6da665cd6447ad92aab9fa5f0ffab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:38:27.054366 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-55e46d91-ec34-4eb2-9f9f-44a72749b1f0 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/4b87436b-2b84-4d45-9f50-52348c30ee1c" status: 200 len: 1320 microversion: 2.1 time: 0.088846 Oct 18 16:38:27.054957 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3650/7318] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:38:26 2022] GET /compute/v2.1/servers/4b87436b-2b84-4d45-9f50-52348c30ee1c => generated 1320 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:38:28.079128 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d5507036-7eda-441c-880b-41113da1169e tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:38:28.079767 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d5507036-7eda-441c-880b-41113da1169e tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 4b87436b-2b84-4d45-9f50-52348c30ee1c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:38:28.086588 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d5507036-7eda-441c-880b-41113da1169e tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:28.087094 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d5507036-7eda-441c-880b-41113da1169e tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:28.087553 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d5507036-7eda-441c-880b-41113da1169e tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:28.088280 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d5507036-7eda-441c-880b-41113da1169e tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:28.088758 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d5507036-7eda-441c-880b-41113da1169e tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:28.089327 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d5507036-7eda-441c-880b-41113da1169e tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:28.224629 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d5507036-7eda-441c-880b-41113da1169e tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6cd4fab2845f08866314463fa5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6da665cd6447ad92aab9fa5f0ffab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:38:28.232632 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d5507036-7eda-441c-880b-41113da1169e tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/4b87436b-2b84-4d45-9f50-52348c30ee1c" status: 200 len: 1362 microversion: 2.1 time: 0.157486 Oct 18 16:38:28.233400 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3669/7319] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:38:28 2022] GET /compute/v2.1/servers/4b87436b-2b84-4d45-9f50-52348c30ee1c => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:38:28.545729 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-db6116f0-1f8e-45d4-8f64-a23e0c7f55f6 req-d874fe3d-29bb-49ef-9d9d-a8995133a59e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b87436b-2b84-4d45-9f50-52348c30ee1c", "tag": "86a16d9f-9697-454c-a3f0-d131e1d56c8c"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:38:28.558714 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-db6116f0-1f8e-45d4-8f64-a23e0c7f55f6 req-d874fe3d-29bb-49ef-9d9d-a8995133a59e service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:28.559347 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-db6116f0-1f8e-45d4-8f64-a23e0c7f55f6 req-d874fe3d-29bb-49ef-9d9d-a8995133a59e service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:28.559906 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-db6116f0-1f8e-45d4-8f64-a23e0c7f55f6 req-d874fe3d-29bb-49ef-9d9d-a8995133a59e service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:28.572528 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-db6116f0-1f8e-45d4-8f64-a23e0c7f55f6 req-d874fe3d-29bb-49ef-9d9d-a8995133a59e service nova] Creating event network-changed:86a16d9f-9697-454c-a3f0-d131e1d56c8c for instance 4b87436b-2b84-4d45-9f50-52348c30ee1c on n-h2-853682-5 Oct 18 16:38:28.578188 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-db6116f0-1f8e-45d4-8f64-a23e0c7f55f6 req-d874fe3d-29bb-49ef-9d9d-a8995133a59e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037228 Oct 18 16:38:28.578799 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3651/7320] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:38:29.255876 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-37ed1006-ca74-4c85-95b2-20807167e16a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:38:29.256519 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-37ed1006-ca74-4c85-95b2-20807167e16a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 4b87436b-2b84-4d45-9f50-52348c30ee1c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:38:29.263513 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37ed1006-ca74-4c85-95b2-20807167e16a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:29.264039 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37ed1006-ca74-4c85-95b2-20807167e16a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:29.264499 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37ed1006-ca74-4c85-95b2-20807167e16a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:29.265246 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37ed1006-ca74-4c85-95b2-20807167e16a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:29.265725 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37ed1006-ca74-4c85-95b2-20807167e16a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:29.266175 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37ed1006-ca74-4c85-95b2-20807167e16a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:29.395456 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-37ed1006-ca74-4c85-95b2-20807167e16a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6cd4fab2845f08866314463fa5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6da665cd6447ad92aab9fa5f0ffab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:38:29.403247 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-37ed1006-ca74-4c85-95b2-20807167e16a tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/4b87436b-2b84-4d45-9f50-52348c30ee1c" status: 200 len: 1362 microversion: 2.1 time: 0.151420 Oct 18 16:38:29.404186 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3670/7321] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:38:29 2022] GET /compute/v2.1/servers/4b87436b-2b84-4d45-9f50-52348c30ee1c => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:38:30.427705 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eb85c161-9657-4593-8dcf-6cd4b4247516 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:38:30.428329 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-eb85c161-9657-4593-8dcf-6cd4b4247516 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 4b87436b-2b84-4d45-9f50-52348c30ee1c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:38:30.435288 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb85c161-9657-4593-8dcf-6cd4b4247516 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:30.435770 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb85c161-9657-4593-8dcf-6cd4b4247516 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:30.437914 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb85c161-9657-4593-8dcf-6cd4b4247516 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:30.437914 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb85c161-9657-4593-8dcf-6cd4b4247516 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:30.438584 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb85c161-9657-4593-8dcf-6cd4b4247516 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:30.438584 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb85c161-9657-4593-8dcf-6cd4b4247516 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:30.570615 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-eb85c161-9657-4593-8dcf-6cd4b4247516 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6cd4fab2845f08866314463fa5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6da665cd6447ad92aab9fa5f0ffab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:38:30.578568 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-eb85c161-9657-4593-8dcf-6cd4b4247516 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/4b87436b-2b84-4d45-9f50-52348c30ee1c" status: 200 len: 1362 microversion: 2.1 time: 0.155091 Oct 18 16:38:30.579193 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3652/7322] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:38:30 2022] GET /compute/v2.1/servers/4b87436b-2b84-4d45-9f50-52348c30ee1c => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:38:31.600936 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fd1ff26f-33c8-41d4-889e-cfa23974a5f3 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:38:31.601600 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-fd1ff26f-33c8-41d4-889e-cfa23974a5f3 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 4b87436b-2b84-4d45-9f50-52348c30ee1c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:38:31.608572 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fd1ff26f-33c8-41d4-889e-cfa23974a5f3 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:31.609109 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fd1ff26f-33c8-41d4-889e-cfa23974a5f3 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:31.609569 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fd1ff26f-33c8-41d4-889e-cfa23974a5f3 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:31.610283 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fd1ff26f-33c8-41d4-889e-cfa23974a5f3 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:31.610756 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fd1ff26f-33c8-41d4-889e-cfa23974a5f3 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:31.611201 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fd1ff26f-33c8-41d4-889e-cfa23974a5f3 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:31.744510 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-fd1ff26f-33c8-41d4-889e-cfa23974a5f3 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6cd4fab2845f08866314463fa5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6da665cd6447ad92aab9fa5f0ffab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:38:31.753090 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fd1ff26f-33c8-41d4-889e-cfa23974a5f3 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/4b87436b-2b84-4d45-9f50-52348c30ee1c" status: 200 len: 1362 microversion: 2.1 time: 0.156003 Oct 18 16:38:31.753601 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3671/7323] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:38:31 2022] GET /compute/v2.1/servers/4b87436b-2b84-4d45-9f50-52348c30ee1c => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:38:32.775867 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e44207c0-380b-4ad4-a02b-bbc89b9a7ac1 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:38:32.776514 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e44207c0-380b-4ad4-a02b-bbc89b9a7ac1 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 4b87436b-2b84-4d45-9f50-52348c30ee1c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:38:32.784118 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e44207c0-380b-4ad4-a02b-bbc89b9a7ac1 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:32.784605 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e44207c0-380b-4ad4-a02b-bbc89b9a7ac1 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:32.785078 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e44207c0-380b-4ad4-a02b-bbc89b9a7ac1 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:32.785775 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e44207c0-380b-4ad4-a02b-bbc89b9a7ac1 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:32.786230 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e44207c0-380b-4ad4-a02b-bbc89b9a7ac1 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:32.786658 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e44207c0-380b-4ad4-a02b-bbc89b9a7ac1 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:32.914886 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e44207c0-380b-4ad4-a02b-bbc89b9a7ac1 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6cd4fab2845f08866314463fa5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6da665cd6447ad92aab9fa5f0ffab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:38:32.922622 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e44207c0-380b-4ad4-a02b-bbc89b9a7ac1 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/4b87436b-2b84-4d45-9f50-52348c30ee1c" status: 200 len: 1362 microversion: 2.1 time: 0.150921 Oct 18 16:38:32.923206 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3653/7324] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:38:32 2022] GET /compute/v2.1/servers/4b87436b-2b84-4d45-9f50-52348c30ee1c => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:38:33.945564 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4ce5e689-bed2-4396-bb10-89d3999320b2 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:38:33.946128 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4ce5e689-bed2-4396-bb10-89d3999320b2 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 4b87436b-2b84-4d45-9f50-52348c30ee1c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:38:33.953742 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ce5e689-bed2-4396-bb10-89d3999320b2 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:33.954235 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ce5e689-bed2-4396-bb10-89d3999320b2 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:33.954688 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ce5e689-bed2-4396-bb10-89d3999320b2 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:33.955392 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ce5e689-bed2-4396-bb10-89d3999320b2 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:33.955859 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ce5e689-bed2-4396-bb10-89d3999320b2 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:33.956295 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ce5e689-bed2-4396-bb10-89d3999320b2 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:34.089522 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4ce5e689-bed2-4396-bb10-89d3999320b2 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6cd4fab2845f08866314463fa5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6da665cd6447ad92aab9fa5f0ffab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:38:34.097597 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4ce5e689-bed2-4396-bb10-89d3999320b2 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/4b87436b-2b84-4d45-9f50-52348c30ee1c" status: 200 len: 1362 microversion: 2.1 time: 0.156094 Oct 18 16:38:34.098183 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3672/7325] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:38:33 2022] GET /compute/v2.1/servers/4b87436b-2b84-4d45-9f50-52348c30ee1c => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:38:35.120982 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-540d0313-be19-4c81-a123-627b91b01ff4 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:38:35.121680 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-540d0313-be19-4c81-a123-627b91b01ff4 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 4b87436b-2b84-4d45-9f50-52348c30ee1c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:38:35.127241 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-651a24ea-df3e-4085-99d5-7475091f260e req-748ad83d-b141-48e2-9b7f-ce4f71d096c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b87436b-2b84-4d45-9f50-52348c30ee1c", "name": "network-vif-plugged", "status": "completed", "tag": "86a16d9f-9697-454c-a3f0-d131e1d56c8c"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:38:35.128879 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-540d0313-be19-4c81-a123-627b91b01ff4 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:35.129380 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-540d0313-be19-4c81-a123-627b91b01ff4 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:35.129823 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-540d0313-be19-4c81-a123-627b91b01ff4 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:35.130530 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-540d0313-be19-4c81-a123-627b91b01ff4 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:35.130995 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-540d0313-be19-4c81-a123-627b91b01ff4 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:35.131429 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-540d0313-be19-4c81-a123-627b91b01ff4 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:35.138494 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-651a24ea-df3e-4085-99d5-7475091f260e req-748ad83d-b141-48e2-9b7f-ce4f71d096c2 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:35.139487 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-651a24ea-df3e-4085-99d5-7475091f260e req-748ad83d-b141-48e2-9b7f-ce4f71d096c2 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:35.140071 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-651a24ea-df3e-4085-99d5-7475091f260e req-748ad83d-b141-48e2-9b7f-ce4f71d096c2 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:35.153849 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-651a24ea-df3e-4085-99d5-7475091f260e req-748ad83d-b141-48e2-9b7f-ce4f71d096c2 service nova] Creating event network-vif-plugged:86a16d9f-9697-454c-a3f0-d131e1d56c8c for instance 4b87436b-2b84-4d45-9f50-52348c30ee1c on n-h2-853682-5 Oct 18 16:38:35.159770 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-651a24ea-df3e-4085-99d5-7475091f260e req-748ad83d-b141-48e2-9b7f-ce4f71d096c2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036594 Oct 18 16:38:35.160688 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3673/7326] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:38:35.274463 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-540d0313-be19-4c81-a123-627b91b01ff4 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6cd4fab2845f08866314463fa5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6da665cd6447ad92aab9fa5f0ffab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:38:35.283955 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-540d0313-be19-4c81-a123-627b91b01ff4 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/4b87436b-2b84-4d45-9f50-52348c30ee1c" status: 200 len: 1362 microversion: 2.1 time: 0.167079 Oct 18 16:38:35.284545 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3654/7327] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:38:35 2022] GET /compute/v2.1/servers/4b87436b-2b84-4d45-9f50-52348c30ee1c => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:38:36.308402 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-04baf3c7-c8ce-40ad-8ede-ab14dd44b8f8 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:38:36.309184 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-04baf3c7-c8ce-40ad-8ede-ab14dd44b8f8 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 4b87436b-2b84-4d45-9f50-52348c30ee1c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:38:36.311718 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=6 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:38:36.318497 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-04baf3c7-c8ce-40ad-8ede-ab14dd44b8f8 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:36.319005 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-04baf3c7-c8ce-40ad-8ede-ab14dd44b8f8 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:36.319467 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-04baf3c7-c8ce-40ad-8ede-ab14dd44b8f8 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:36.320182 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-04baf3c7-c8ce-40ad-8ede-ab14dd44b8f8 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:36.320660 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-04baf3c7-c8ce-40ad-8ede-ab14dd44b8f8 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:36.321140 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-04baf3c7-c8ce-40ad-8ede-ab14dd44b8f8 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:36.458804 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-04baf3c7-c8ce-40ad-8ede-ab14dd44b8f8 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6cd4fab2845f08866314463fa5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6da665cd6447ad92aab9fa5f0ffab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:38:36.466841 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-04baf3c7-c8ce-40ad-8ede-ab14dd44b8f8 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/4b87436b-2b84-4d45-9f50-52348c30ee1c" status: 200 len: 1362 microversion: 2.1 time: 0.162975 Oct 18 16:38:36.469955 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3674/7328] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:38:36 2022] GET /compute/v2.1/servers/4b87436b-2b84-4d45-9f50-52348c30ee1c => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:38:37.492220 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ba5a3a21-5ad5-4ea9-a84c-e41bb0a2f4a0 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:38:37.492849 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ba5a3a21-5ad5-4ea9-a84c-e41bb0a2f4a0 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 4b87436b-2b84-4d45-9f50-52348c30ee1c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:38:37.495120 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:38:37.495925 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:38:37.502474 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba5a3a21-5ad5-4ea9-a84c-e41bb0a2f4a0 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:37.503000 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba5a3a21-5ad5-4ea9-a84c-e41bb0a2f4a0 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:37.503449 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba5a3a21-5ad5-4ea9-a84c-e41bb0a2f4a0 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:37.504158 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba5a3a21-5ad5-4ea9-a84c-e41bb0a2f4a0 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:37.504647 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba5a3a21-5ad5-4ea9-a84c-e41bb0a2f4a0 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:37.505057 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba5a3a21-5ad5-4ea9-a84c-e41bb0a2f4a0 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:37.638142 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ba5a3a21-5ad5-4ea9-a84c-e41bb0a2f4a0 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6cd4fab2845f08866314463fa5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6da665cd6447ad92aab9fa5f0ffab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:38:37.645999 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ba5a3a21-5ad5-4ea9-a84c-e41bb0a2f4a0 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/4b87436b-2b84-4d45-9f50-52348c30ee1c" status: 200 len: 1553 microversion: 2.1 time: 0.157637 Oct 18 16:38:37.646581 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3655/7329] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:38:37 2022] GET /compute/v2.1/servers/4b87436b-2b84-4d45-9f50-52348c30ee1c => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:38:37.669024 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-357ff3c5-50d4-44d4-8986-0624fa66eb08 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:38:37.669699 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-357ff3c5-50d4-44d4-8986-0624fa66eb08 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 4b87436b-2b84-4d45-9f50-52348c30ee1c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:38:37.677114 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-357ff3c5-50d4-44d4-8986-0624fa66eb08 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:37.677613 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-357ff3c5-50d4-44d4-8986-0624fa66eb08 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:37.678065 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-357ff3c5-50d4-44d4-8986-0624fa66eb08 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:37.678774 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-357ff3c5-50d4-44d4-8986-0624fa66eb08 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:37.679254 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-357ff3c5-50d4-44d4-8986-0624fa66eb08 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:37.679704 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-357ff3c5-50d4-44d4-8986-0624fa66eb08 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:37.811080 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-357ff3c5-50d4-44d4-8986-0624fa66eb08 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6cd4fab2845f08866314463fa5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6da665cd6447ad92aab9fa5f0ffab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:38:37.818846 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-357ff3c5-50d4-44d4-8986-0624fa66eb08 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/4b87436b-2b84-4d45-9f50-52348c30ee1c" status: 200 len: 1553 microversion: 2.1 time: 0.153822 Oct 18 16:38:37.819423 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3675/7330] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:38:37 2022] GET /compute/v2.1/servers/4b87436b-2b84-4d45-9f50-52348c30ee1c => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:38:39.319438 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ae9b6fb7-0a8f-43e2-a8d5-652a98e15218 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88facbd5-61ea-4dc3-85c9-d866f3417bdc"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:38:39.321876 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ae9b6fb7-0a8f-43e2-a8d5-652a98e15218 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 4b87436b-2b84-4d45-9f50-52348c30ee1c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:38:39.329590 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae9b6fb7-0a8f-43e2-a8d5-652a98e15218 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:39.330082 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae9b6fb7-0a8f-43e2-a8d5-652a98e15218 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:39.330521 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae9b6fb7-0a8f-43e2-a8d5-652a98e15218 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:39.331229 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae9b6fb7-0a8f-43e2-a8d5-652a98e15218 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:39.331684 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae9b6fb7-0a8f-43e2-a8d5-652a98e15218 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:39.332113 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae9b6fb7-0a8f-43e2-a8d5-652a98e15218 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:39.459826 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:38:39.582966 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ae9b6fb7-0a8f-43e2-a8d5-652a98e15218 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "POST /compute/v2.1/servers/4b87436b-2b84-4d45-9f50-52348c30ee1c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267321 Oct 18 16:38:39.583642 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3656/7331] 10.222.0.60 () {60 vars in 1323 bytes} [Tue Oct 18 16:38:39 2022] POST /compute/v2.1/servers/4b87436b-2b84-4d45-9f50-52348c30ee1c/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:38:50.296061 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-554876b8-3762-4754-890a-8d77b45cb67f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:38:50.296580 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-554876b8-3762-4754-890a-8d77b45cb67f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 4b87436b-2b84-4d45-9f50-52348c30ee1c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:38:50.299488 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:38:50.300169 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=72 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:38:50.306196 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-554876b8-3762-4754-890a-8d77b45cb67f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:50.306704 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-554876b8-3762-4754-890a-8d77b45cb67f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:50.307169 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-554876b8-3762-4754-890a-8d77b45cb67f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:50.307895 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-554876b8-3762-4754-890a-8d77b45cb67f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:50.308372 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-554876b8-3762-4754-890a-8d77b45cb67f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:50.308835 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-554876b8-3762-4754-890a-8d77b45cb67f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:50.391611 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-554876b8-3762-4754-890a-8d77b45cb67f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lazy-loading 'services' on Instance uuid 4b87436b-2b84-4d45-9f50-52348c30ee1c {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:38:50.462033 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-554876b8-3762-4754-890a-8d77b45cb67f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4b87436b-2b84-4d45-9f50-52348c30ee1c/os-volume_attachments/88facbd5-61ea-4dc3-85c9-d866f3417bdc" status: 202 len: 0 microversion: 2.1 time: 0.170272 Oct 18 16:38:50.462822 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3676/7332] 10.222.0.60 () {58 vars in 1416 bytes} [Tue Oct 18 16:38:50 2022] DELETE /compute/v2.1/servers/4b87436b-2b84-4d45-9f50-52348c30ee1c/os-volume_attachments/88facbd5-61ea-4dc3-85c9-d866f3417bdc => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:38:50.472072 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-54fec1f7-8295-4ee9-8073-c423a0edeb9e tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:38:50.474884 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-54fec1f7-8295-4ee9-8073-c423a0edeb9e tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 4b87436b-2b84-4d45-9f50-52348c30ee1c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:38:50.478085 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:38:50.478889 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=4,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:38:50.485306 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54fec1f7-8295-4ee9-8073-c423a0edeb9e tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:50.485793 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54fec1f7-8295-4ee9-8073-c423a0edeb9e tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:50.486227 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54fec1f7-8295-4ee9-8073-c423a0edeb9e tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:50.487207 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54fec1f7-8295-4ee9-8073-c423a0edeb9e tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:50.487671 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54fec1f7-8295-4ee9-8073-c423a0edeb9e tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:50.488091 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54fec1f7-8295-4ee9-8073-c423a0edeb9e tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:50.524956 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-54fec1f7-8295-4ee9-8073-c423a0edeb9e tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/4b87436b-2b84-4d45-9f50-52348c30ee1c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057395 Oct 18 16:38:50.525517 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3657/7333] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 16:38:50 2022] GET /compute/v2.1/servers/4b87436b-2b84-4d45-9f50-52348c30ee1c/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:38:51.537336 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4ae19616-dd52-4cf7-872a-099d9f2d9ba1 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:38:51.540008 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4ae19616-dd52-4cf7-872a-099d9f2d9ba1 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 4b87436b-2b84-4d45-9f50-52348c30ee1c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:38:51.547269 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ae19616-dd52-4cf7-872a-099d9f2d9ba1 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:51.547775 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ae19616-dd52-4cf7-872a-099d9f2d9ba1 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:51.548231 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ae19616-dd52-4cf7-872a-099d9f2d9ba1 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:51.548985 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ae19616-dd52-4cf7-872a-099d9f2d9ba1 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:51.549464 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ae19616-dd52-4cf7-872a-099d9f2d9ba1 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:51.549911 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4ae19616-dd52-4cf7-872a-099d9f2d9ba1 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:51.581468 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4ae19616-dd52-4cf7-872a-099d9f2d9ba1 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/4b87436b-2b84-4d45-9f50-52348c30ee1c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048568 Oct 18 16:38:51.582159 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3677/7334] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 16:38:51 2022] GET /compute/v2.1/servers/4b87436b-2b84-4d45-9f50-52348c30ee1c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:38:52.594620 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d39c593d-0fff-43e4-a7b0-530bcdb632bf tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:38:52.596829 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d39c593d-0fff-43e4-a7b0-530bcdb632bf tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 4b87436b-2b84-4d45-9f50-52348c30ee1c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:38:52.603734 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d39c593d-0fff-43e4-a7b0-530bcdb632bf tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:52.604219 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d39c593d-0fff-43e4-a7b0-530bcdb632bf tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:52.605051 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d39c593d-0fff-43e4-a7b0-530bcdb632bf tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:52.605747 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d39c593d-0fff-43e4-a7b0-530bcdb632bf tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:52.606202 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d39c593d-0fff-43e4-a7b0-530bcdb632bf tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:52.606625 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d39c593d-0fff-43e4-a7b0-530bcdb632bf tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:52.640554 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d39c593d-0fff-43e4-a7b0-530bcdb632bf tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/4b87436b-2b84-4d45-9f50-52348c30ee1c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049910 Oct 18 16:38:52.641171 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3658/7335] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 16:38:52 2022] GET /compute/v2.1/servers/4b87436b-2b84-4d45-9f50-52348c30ee1c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:38:53.653244 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e405706e-6692-45cb-9951-0e98a90041c5 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:38:53.655358 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e405706e-6692-45cb-9951-0e98a90041c5 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 4b87436b-2b84-4d45-9f50-52348c30ee1c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:38:53.662209 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e405706e-6692-45cb-9951-0e98a90041c5 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:53.662968 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e405706e-6692-45cb-9951-0e98a90041c5 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:53.663413 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e405706e-6692-45cb-9951-0e98a90041c5 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:53.664118 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e405706e-6692-45cb-9951-0e98a90041c5 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:53.664582 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e405706e-6692-45cb-9951-0e98a90041c5 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:53.665047 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e405706e-6692-45cb-9951-0e98a90041c5 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:53.696715 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e405706e-6692-45cb-9951-0e98a90041c5 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/4b87436b-2b84-4d45-9f50-52348c30ee1c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047610 Oct 18 16:38:53.697383 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3678/7336] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 16:38:53 2022] GET /compute/v2.1/servers/4b87436b-2b84-4d45-9f50-52348c30ee1c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:38:54.709424 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8d0c6734-6962-419a-8cc7-820332e095b8 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:38:54.711619 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8d0c6734-6962-419a-8cc7-820332e095b8 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 4b87436b-2b84-4d45-9f50-52348c30ee1c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:38:54.719258 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d0c6734-6962-419a-8cc7-820332e095b8 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:54.719742 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d0c6734-6962-419a-8cc7-820332e095b8 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:54.720189 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d0c6734-6962-419a-8cc7-820332e095b8 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:54.720917 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d0c6734-6962-419a-8cc7-820332e095b8 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:54.721378 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d0c6734-6962-419a-8cc7-820332e095b8 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:54.721809 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d0c6734-6962-419a-8cc7-820332e095b8 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:54.751744 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8d0c6734-6962-419a-8cc7-820332e095b8 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/4b87436b-2b84-4d45-9f50-52348c30ee1c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046399 Oct 18 16:38:54.752341 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3659/7337] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 16:38:54 2022] GET /compute/v2.1/servers/4b87436b-2b84-4d45-9f50-52348c30ee1c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:38:55.763723 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a2650ed7-49a2-4cd3-ad58-bac1ed89e5ba tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:38:55.765964 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a2650ed7-49a2-4cd3-ad58-bac1ed89e5ba tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 4b87436b-2b84-4d45-9f50-52348c30ee1c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:38:55.772863 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a2650ed7-49a2-4cd3-ad58-bac1ed89e5ba tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:55.773362 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a2650ed7-49a2-4cd3-ad58-bac1ed89e5ba tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:55.773816 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a2650ed7-49a2-4cd3-ad58-bac1ed89e5ba tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:55.774525 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a2650ed7-49a2-4cd3-ad58-bac1ed89e5ba tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:55.774995 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a2650ed7-49a2-4cd3-ad58-bac1ed89e5ba tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:55.775434 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a2650ed7-49a2-4cd3-ad58-bac1ed89e5ba tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:55.805669 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a2650ed7-49a2-4cd3-ad58-bac1ed89e5ba tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/4b87436b-2b84-4d45-9f50-52348c30ee1c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046013 Oct 18 16:38:55.806235 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3679/7338] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 16:38:55 2022] GET /compute/v2.1/servers/4b87436b-2b84-4d45-9f50-52348c30ee1c/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:38:55.817277 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d88b3fcb-cdf2-400d-badb-fe794a0b17a8 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:38:55.817811 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d88b3fcb-cdf2-400d-badb-fe794a0b17a8 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 4b87436b-2b84-4d45-9f50-52348c30ee1c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:38:55.824497 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d88b3fcb-cdf2-400d-badb-fe794a0b17a8 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:55.825027 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d88b3fcb-cdf2-400d-badb-fe794a0b17a8 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:55.825468 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d88b3fcb-cdf2-400d-badb-fe794a0b17a8 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:55.826155 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d88b3fcb-cdf2-400d-badb-fe794a0b17a8 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:55.826608 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d88b3fcb-cdf2-400d-badb-fe794a0b17a8 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:55.827030 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d88b3fcb-cdf2-400d-badb-fe794a0b17a8 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:55.902431 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-d88b3fcb-cdf2-400d-badb-fe794a0b17a8 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] HTTP exception thrown: Instance 4b87436b-2b84-4d45-9f50-52348c30ee1c is not attached to volume 88facbd5-61ea-4dc3-85c9-d866f3417bdc Oct 18 16:38:55.904888 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d88b3fcb-cdf2-400d-badb-fe794a0b17a8 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Request method failure captured: Oct 18 16:38:55.904888 n-d-853682-5 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/4b87436b-2b84-4d45-9f50-52348c30ee1c/os-volume_attachments/88facbd5-61ea-4dc3-85c9-d866f3417bdc HTTP/1.1 Oct 18 16:38:55.904888 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 16:38:55.904888 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 16:38:55.904888 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 16:38:55.904888 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 16:38:55.904888 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 16:38:55.904888 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 16:38:55.904888 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 16:38:55.904888 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 16:38:55.904888 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTtYuta5T7Nq3SDSDbp7TK5-S8B7rv8PnZy73LwNZvFnaq5Optu3QqYPD104dXxtbQsHjlD-kAyQhB8KEHl_5FqlK7Nd_pOYZRi5SYNgB3J_9KbnXNpfDy8bwPqx6xtVFzYDoZDE7FWj0pYmBkxhVPYD5oZQaaZl-kQj_75WVBw7W1CU Oct 18 16:38:55.904888 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 16:38:55.904888 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 16:38:55.904888 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 16:38:55.904888 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 16:38:55.904888 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 16:38:55.904888 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 16:38:55.904888 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 8c6da665cd6447ad92aab9fa5f0ffab2 Oct 18 16:38:55.904888 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1182072653 Oct 18 16:38:55.904888 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 16:38:55.904888 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 16:38:55.904888 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8c6da665cd6447ad92aab9fa5f0ffab2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8c6da665cd6447ad92aab9fa5f0ffab2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8c6da665cd6447ad92aab9fa5f0ffab2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8c6da665cd6447ad92aab9fa5f0ffab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:38:55.904888 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-TestEncryptedCinderVolumes-1182072653 Oct 18 16:38:55.904888 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 8c6da665cd6447ad92aab9fa5f0ffab2 Oct 18 16:38:55.904888 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1182072653 Oct 18 16:38:55.904888 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-TestEncryptedCinderVolumes-1182072653-project Oct 18 16:38:55.904888 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 16:38:55.904888 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 16:38:55.904888 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 63a6cd4fab2845f08866314463fa5dac Oct 18 16:38:55.904888 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-TestEncryptedCinderVolumes-1182072653-project Oct 18 16:38:55.904888 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 16:38:55.904888 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 4b87436b-2b84-4d45-9f50-52348c30ee1c is not attached to volume 88facbd5-61ea-4dc3-85c9-d866f3417bdc Oct 18 16:38:55.904888 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'server_id': '4b87436b-2b84-4d45-9f50-52348c30ee1c', 'id': '88facbd5-61ea-4dc3-85c9-d866f3417bdc'} Oct 18 16:38:55.904888 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:38:55.904888 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:38:55.904888 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 18 16:38:55.904888 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 18 16:38:55.904888 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 16:38:55.904888 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 16:38:55.904888 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 18 16:38:55.904888 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 18 16:38:55.904888 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 88facbd5-61ea-4dc3-85c9-d866f3417bdc. Oct 18 16:38:55.904888 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:38:55.904888 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:38:55.904888 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:38:55.904888 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:38:55.904888 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:38:55.904888 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:38:55.904888 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:38:55.904888 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:38:55.904888 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:38:55.904888 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:38:55.904888 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 18 16:38:55.904888 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 18 16:38:55.904888 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b87436b-2b84-4d45-9f50-52348c30ee1c is not attached to volume 88facbd5-61ea-4dc3-85c9-d866f3417bdc Oct 18 16:38:55.904888 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:38:55.904888 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:38:55.904888 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:38:55.904888 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:38:55.904888 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:38:55.904888 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:38:55.909984 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:38:55.909984 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:38:55.909984 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b87436b-2b84-4d45-9f50-52348c30ee1c is not attached to volume 88facbd5-61ea-4dc3-85c9-d866f3417bdc Oct 18 16:38:55.909984 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:38:55.909984 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d88b3fcb-cdf2-400d-badb-fe794a0b17a8 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Returning 404 to user: Instance 4b87436b-2b84-4d45-9f50-52348c30ee1c is not attached to volume 88facbd5-61ea-4dc3-85c9-d866f3417bdc {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:38:55.909984 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d88b3fcb-cdf2-400d-badb-fe794a0b17a8 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4b87436b-2b84-4d45-9f50-52348c30ee1c/os-volume_attachments/88facbd5-61ea-4dc3-85c9-d866f3417bdc" status: 404 len: 154 microversion: 2.1 time: 0.093127 Oct 18 16:38:55.909984 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3660/7339] 10.222.0.60 () {58 vars in 1416 bytes} [Tue Oct 18 16:38:55 2022] DELETE /compute/v2.1/servers/4b87436b-2b84-4d45-9f50-52348c30ee1c/os-volume_attachments/88facbd5-61ea-4dc3-85c9-d866f3417bdc => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:38:59.259158 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9bb2a5cf-ffa5-4979-8694-a45cacf7eb10 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:38:59.259665 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9bb2a5cf-ffa5-4979-8694-a45cacf7eb10 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 4b87436b-2b84-4d45-9f50-52348c30ee1c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:38:59.266256 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9bb2a5cf-ffa5-4979-8694-a45cacf7eb10 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:59.266761 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9bb2a5cf-ffa5-4979-8694-a45cacf7eb10 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:59.267224 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9bb2a5cf-ffa5-4979-8694-a45cacf7eb10 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:59.267941 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9bb2a5cf-ffa5-4979-8694-a45cacf7eb10 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:59.268413 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9bb2a5cf-ffa5-4979-8694-a45cacf7eb10 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:59.268887 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9bb2a5cf-ffa5-4979-8694-a45cacf7eb10 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:59.297682 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9bb2a5cf-ffa5-4979-8694-a45cacf7eb10 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 4b87436b-2b84-4d45-9f50-52348c30ee1c] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:38:59.380074 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9bb2a5cf-ffa5-4979-8694-a45cacf7eb10 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4b87436b-2b84-4d45-9f50-52348c30ee1c" status: 204 len: 0 microversion: 2.1 time: 0.124795 Oct 18 16:38:59.381299 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3680/7340] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 16:38:59 2022] DELETE /compute/v2.1/servers/4b87436b-2b84-4d45-9f50-52348c30ee1c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:38:59.389428 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fec19399-0425-461a-89e6-e95bb4212d57 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:38:59.390043 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fec19399-0425-461a-89e6-e95bb4212d57 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 4b87436b-2b84-4d45-9f50-52348c30ee1c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:38:59.397728 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fec19399-0425-461a-89e6-e95bb4212d57 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:59.398158 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fec19399-0425-461a-89e6-e95bb4212d57 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:59.398608 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fec19399-0425-461a-89e6-e95bb4212d57 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:59.399305 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fec19399-0425-461a-89e6-e95bb4212d57 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:38:59.399763 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fec19399-0425-461a-89e6-e95bb4212d57 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:38:59.400191 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fec19399-0425-461a-89e6-e95bb4212d57 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:38:59.538396 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fec19399-0425-461a-89e6-e95bb4212d57 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6cd4fab2845f08866314463fa5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6da665cd6447ad92aab9fa5f0ffab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:38:59.546883 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fec19399-0425-461a-89e6-e95bb4212d57 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/4b87436b-2b84-4d45-9f50-52348c30ee1c" status: 200 len: 1559 microversion: 2.1 time: 0.161507 Oct 18 16:38:59.547545 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3661/7341] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:38:59 2022] GET /compute/v2.1/servers/4b87436b-2b84-4d45-9f50-52348c30ee1c => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:39:00.570925 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d85978b8-191b-4d02-9c1f-84db46292d7f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:39:00.571682 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d85978b8-191b-4d02-9c1f-84db46292d7f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 4b87436b-2b84-4d45-9f50-52348c30ee1c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:39:00.579200 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d85978b8-191b-4d02-9c1f-84db46292d7f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:00.579702 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d85978b8-191b-4d02-9c1f-84db46292d7f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:00.580156 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d85978b8-191b-4d02-9c1f-84db46292d7f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:00.580889 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d85978b8-191b-4d02-9c1f-84db46292d7f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:00.581371 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d85978b8-191b-4d02-9c1f-84db46292d7f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:00.581818 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d85978b8-191b-4d02-9c1f-84db46292d7f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:00.718030 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d85978b8-191b-4d02-9c1f-84db46292d7f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6cd4fab2845f08866314463fa5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6da665cd6447ad92aab9fa5f0ffab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:00.726046 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d85978b8-191b-4d02-9c1f-84db46292d7f tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/4b87436b-2b84-4d45-9f50-52348c30ee1c" status: 200 len: 1559 microversion: 2.1 time: 0.159467 Oct 18 16:39:00.726626 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3681/7342] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:39:00 2022] GET /compute/v2.1/servers/4b87436b-2b84-4d45-9f50-52348c30ee1c => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:39:01.428024 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-38f982ba-baa2-4207-acd1-7ebf9f975a88 req-d0703499-4b6d-4fc1-9a0e-81b7ffb5412b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b87436b-2b84-4d45-9f50-52348c30ee1c", "name": "network-vif-deleted", "tag": "86a16d9f-9697-454c-a3f0-d131e1d56c8c"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:39:01.441599 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-38f982ba-baa2-4207-acd1-7ebf9f975a88 req-d0703499-4b6d-4fc1-9a0e-81b7ffb5412b service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:01.442413 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-38f982ba-baa2-4207-acd1-7ebf9f975a88 req-d0703499-4b6d-4fc1-9a0e-81b7ffb5412b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:01.442909 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-38f982ba-baa2-4207-acd1-7ebf9f975a88 req-d0703499-4b6d-4fc1-9a0e-81b7ffb5412b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:01.458617 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-38f982ba-baa2-4207-acd1-7ebf9f975a88 req-d0703499-4b6d-4fc1-9a0e-81b7ffb5412b service nova] Creating event network-vif-deleted:86a16d9f-9697-454c-a3f0-d131e1d56c8c for instance 4b87436b-2b84-4d45-9f50-52348c30ee1c on n-h2-853682-5 Oct 18 16:39:01.464126 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-38f982ba-baa2-4207-acd1-7ebf9f975a88 req-d0703499-4b6d-4fc1-9a0e-81b7ffb5412b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044845 Oct 18 16:39:01.464880 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3662/7343] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:39:01.749229 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1eea927e-a6e9-42d1-b7b6-c4cff0288762 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:39:01.749891 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1eea927e-a6e9-42d1-b7b6-c4cff0288762 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 4b87436b-2b84-4d45-9f50-52348c30ee1c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:39:01.757277 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1eea927e-a6e9-42d1-b7b6-c4cff0288762 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:01.757788 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1eea927e-a6e9-42d1-b7b6-c4cff0288762 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:01.758250 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1eea927e-a6e9-42d1-b7b6-c4cff0288762 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:01.758965 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1eea927e-a6e9-42d1-b7b6-c4cff0288762 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:01.759440 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1eea927e-a6e9-42d1-b7b6-c4cff0288762 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:01.759888 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1eea927e-a6e9-42d1-b7b6-c4cff0288762 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:01.792686 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1eea927e-a6e9-42d1-b7b6-c4cff0288762 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:01.793221 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1eea927e-a6e9-42d1-b7b6-c4cff0288762 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:01.793678 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1eea927e-a6e9-42d1-b7b6-c4cff0288762 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:01.794151 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-1eea927e-a6e9-42d1-b7b6-c4cff0288762 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lazy-loading 'fault' on Instance uuid 4b87436b-2b84-4d45-9f50-52348c30ee1c {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:39:01.837792 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1eea927e-a6e9-42d1-b7b6-c4cff0288762 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6cd4fab2845f08866314463fa5dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6da665cd6447ad92aab9fa5f0ffab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:01.847848 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1eea927e-a6e9-42d1-b7b6-c4cff0288762 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/4b87436b-2b84-4d45-9f50-52348c30ee1c" status: 200 len: 1352 microversion: 2.1 time: 0.102620 Oct 18 16:39:01.848431 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3682/7344] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:39:01 2022] GET /compute/v2.1/servers/4b87436b-2b84-4d45-9f50-52348c30ee1c => generated 1352 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:39:02.873656 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-20b9e8f4-e78a-4034-a3ea-1e553c107bba tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:39:02.874277 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-20b9e8f4-e78a-4034-a3ea-1e553c107bba tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] [instance: 4b87436b-2b84-4d45-9f50-52348c30ee1c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:39:02.880536 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20b9e8f4-e78a-4034-a3ea-1e553c107bba tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:02.881057 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20b9e8f4-e78a-4034-a3ea-1e553c107bba tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:02.881499 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20b9e8f4-e78a-4034-a3ea-1e553c107bba tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:02.882219 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20b9e8f4-e78a-4034-a3ea-1e553c107bba tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:02.882675 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20b9e8f4-e78a-4034-a3ea-1e553c107bba tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:02.883103 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20b9e8f4-e78a-4034-a3ea-1e553c107bba tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:02.896387 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-20b9e8f4-e78a-4034-a3ea-1e553c107bba tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] HTTP exception thrown: Instance 4b87436b-2b84-4d45-9f50-52348c30ee1c could not be found. Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-20b9e8f4-e78a-4034-a3ea-1e553c107bba tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Request method failure captured: Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/4b87436b-2b84-4d45-9f50-52348c30ee1c HTTP/1.1 Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTtYuta5T7Nq3SDSDbp7TK5-S8B7rv8PnZy73LwNZvFnaq5Optu3QqYPD104dXxtbQsHjlD-kAyQhB8KEHl_5FqlK7Nd_pOYZRi5SYNgB3J_9KbnXNpfDy8bwPqx6xtVFzYDoZDE7FWj0pYmBkxhVPYD5oZQaaZl-kQj_75WVBw7W1CU Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 8c6da665cd6447ad92aab9fa5f0ffab2 Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1182072653 Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8c6da665cd6447ad92aab9fa5f0ffab2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8c6da665cd6447ad92aab9fa5f0ffab2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8c6da665cd6447ad92aab9fa5f0ffab2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8c6da665cd6447ad92aab9fa5f0ffab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-TestEncryptedCinderVolumes-1182072653 Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 8c6da665cd6447ad92aab9fa5f0ffab2 Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1182072653 Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-TestEncryptedCinderVolumes-1182072653-project Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 63a6cd4fab2845f08866314463fa5dac Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-TestEncryptedCinderVolumes-1182072653-project Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 4b87436b-2b84-4d45-9f50-52348c30ee1c could not be found. Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '4b87436b-2b84-4d45-9f50-52348c30ee1c'} Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b87436b-2b84-4d45-9f50-52348c30ee1c could not be found. Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b87436b-2b84-4d45-9f50-52348c30ee1c could not be found. Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:39:02.898023 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:39:02.902926 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:39:02.902926 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:39:02.902926 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:39:02.902926 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:39:02.902926 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:39:02.902926 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:39:02.902926 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b87436b-2b84-4d45-9f50-52348c30ee1c could not be found. Oct 18 16:39:02.902926 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:39:02.902926 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-20b9e8f4-e78a-4034-a3ea-1e553c107bba tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Returning 404 to user: Instance 4b87436b-2b84-4d45-9f50-52348c30ee1c could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:39:02.902926 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-20b9e8f4-e78a-4034-a3ea-1e553c107bba tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "GET /compute/v2.1/servers/4b87436b-2b84-4d45-9f50-52348c30ee1c" status: 404 len: 111 microversion: 2.1 time: 0.031724 Oct 18 16:39:02.902926 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3663/7345] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:39:02 2022] GET /compute/v2.1/servers/4b87436b-2b84-4d45-9f50-52348c30ee1c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:39:02.908370 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-34eb6809-0911-4de1-9e0e-10139f494c48 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] Calling method '.version_select at 0x7f7c3c5d1ca0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:39:02.929014 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-34eb6809-0911-4de1-9e0e-10139f494c48 tempest-TestEncryptedCinderVolumes-1182072653 tempest-TestEncryptedCinderVolumes-1182072653-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1574579757" status: 202 len: 0 microversion: 2.1 time: 0.024320 Oct 18 16:39:02.929599 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3683/7346] 10.222.0.60 () {58 vars in 1278 bytes} [Tue Oct 18 16:39:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1574579757 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:39:29.647499 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-330391a9-6232-4e14-97ac-55e1833af828 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Action: 'create', calling method: .version_select at 0x7f7c37a42670>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1184559543", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnvmRdnDKhDlCIn1Vw2sjCoS+/T6KZ0dWokwGt+dKWtwFTOFNorDWC9eRRWXF9dLO0fW+tWzQP4ytoGYMECSNGKzHymvbp3m00KQVIhXEnshDu+UrUWXsuZ2tHor5jnNw=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:39:29.653979 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=14 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:39:29.654572 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=34 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:39:29.666834 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-330391a9-6232-4e14-97ac-55e1833af828 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Getting quotas for project 72e1244a01b5401d8f3363ae5d9f323b. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:39:29.672551 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-330391a9-6232-4e14-97ac-55e1833af828 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Getting quotas for user cfffffbceb1c4f7685958bcc1f62596a and project 72e1244a01b5401d8f3363ae5d9f323b. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:39:29.696134 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-330391a9-6232-4e14-97ac-55e1833af828 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.052634 Oct 18 16:39:29.696748 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3664/7347] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Oct 18 16:39:29 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:39:29.745079 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:39:29.746040 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:39:29.750233 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-59a342ff-4529-4096-80b9-f5f8999d6ebb tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-397433638", "imageRef": "81b2a84e-9648-4157-a9e1-3cf6c261d3ab", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1184559543", "networks": [{"uuid": "2d99d053-2834-47fe-86cd-05c29fd3b4a7"}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:39:29.805294 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-59a342ff-4529-4096-80b9-f5f8999d6ebb tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] validate_networks() for [('2d99d053-2834-47fe-86cd-05c29fd3b4a7', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 16:39:30.275770 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-59a342ff-4529-4096-80b9-f5f8999d6ebb tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:39:30.276218 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-59a342ff-4529-4096-80b9-f5f8999d6ebb tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:39:30.276749 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-59a342ff-4529-4096-80b9-f5f8999d6ebb tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:39:30.277243 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-59a342ff-4529-4096-80b9-f5f8999d6ebb tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:39:30.277675 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-59a342ff-4529-4096-80b9-f5f8999d6ebb tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:39:30.286532 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-59a342ff-4529-4096-80b9-f5f8999d6ebb tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:30.287301 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-59a342ff-4529-4096-80b9-f5f8999d6ebb tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:30.287754 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-59a342ff-4529-4096-80b9-f5f8999d6ebb tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:30.288501 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-59a342ff-4529-4096-80b9-f5f8999d6ebb tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:30.289086 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-59a342ff-4529-4096-80b9-f5f8999d6ebb tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:30.289455 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-59a342ff-4529-4096-80b9-f5f8999d6ebb tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:30.307662 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-59a342ff-4529-4096-80b9-f5f8999d6ebb tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Getting quotas for project 72e1244a01b5401d8f3363ae5d9f323b. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:39:30.313563 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-59a342ff-4529-4096-80b9-f5f8999d6ebb tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Getting quotas for user cfffffbceb1c4f7685958bcc1f62596a and project 72e1244a01b5401d8f3363ae5d9f323b. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:39:30.326602 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-59a342ff-4529-4096-80b9-f5f8999d6ebb tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:39:30.328888 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-59a342ff-4529-4096-80b9-f5f8999d6ebb tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: a19e556a-ef5f-4229-a7ad-534bf657d10b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='81b2a84e-9648-4157-a9e1-3cf6c261d3ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:39:30.372229 n-d-853682-5 devstack@n-api.service[120405]: ERROR oslo.messaging._drivers.impl_rabbit [None req-59a342ff-4529-4096-80b9-f5f8999d6ebb tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [5cfaa717-1349-4c0c-be5e-a57d65daba4c] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 16:39:31.379951 n-d-853682-5 devstack@n-api.service[120405]: INFO oslo.messaging._drivers.impl_rabbit [None req-59a342ff-4529-4096-80b9-f5f8999d6ebb tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [5cfaa717-1349-4c0c-be5e-a57d65daba4c] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 40682. Oct 18 16:39:31.384456 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-59a342ff-4529-4096-80b9-f5f8999d6ebb tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.641499 Oct 18 16:39:31.385342 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3684/7348] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 16:39:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:39:31.396932 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-365a8224-dc0e-4a38-8750-227bd593df33 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:39:31.397553 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-365a8224-dc0e-4a38-8750-227bd593df33 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: a19e556a-ef5f-4229-a7ad-534bf657d10b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:39:31.574514 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-365a8224-dc0e-4a38-8750-227bd593df33 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:31.582240 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-365a8224-dc0e-4a38-8750-227bd593df33 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b" status: 200 len: 1258 microversion: 2.1 time: 0.189133 Oct 18 16:39:31.582969 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3665/7349] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:39:31 2022] GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b => generated 1258 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:39:32.606292 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0bd71d48-e680-486b-aa25-af02db1ea495 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:39:32.607516 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0bd71d48-e680-486b-aa25-af02db1ea495 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: a19e556a-ef5f-4229-a7ad-534bf657d10b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:39:32.614832 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0bd71d48-e680-486b-aa25-af02db1ea495 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:32.615272 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0bd71d48-e680-486b-aa25-af02db1ea495 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:32.615980 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0bd71d48-e680-486b-aa25-af02db1ea495 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:32.616689 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0bd71d48-e680-486b-aa25-af02db1ea495 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:32.617199 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0bd71d48-e680-486b-aa25-af02db1ea495 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:32.617650 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0bd71d48-e680-486b-aa25-af02db1ea495 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:32.790590 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0bd71d48-e680-486b-aa25-af02db1ea495 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:32.799340 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0bd71d48-e680-486b-aa25-af02db1ea495 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b" status: 200 len: 1316 microversion: 2.1 time: 0.197838 Oct 18 16:39:32.800224 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3685/7350] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:39:32 2022] GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b => generated 1316 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:39:33.823983 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6b36271a-db55-4f80-93fe-dde9444820d8 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:39:33.824601 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6b36271a-db55-4f80-93fe-dde9444820d8 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: a19e556a-ef5f-4229-a7ad-534bf657d10b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:39:33.833208 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b36271a-db55-4f80-93fe-dde9444820d8 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:33.833717 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b36271a-db55-4f80-93fe-dde9444820d8 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:33.834188 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b36271a-db55-4f80-93fe-dde9444820d8 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:33.834896 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b36271a-db55-4f80-93fe-dde9444820d8 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:33.835376 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b36271a-db55-4f80-93fe-dde9444820d8 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:33.835816 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b36271a-db55-4f80-93fe-dde9444820d8 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:34.255720 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6b36271a-db55-4f80-93fe-dde9444820d8 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:34.263890 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6b36271a-db55-4f80-93fe-dde9444820d8 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b" status: 200 len: 1358 microversion: 2.1 time: 0.444044 Oct 18 16:39:34.279143 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3666/7351] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:39:33 2022] GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b => generated 1358 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:39:35.291487 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5cce71d2-b26b-48ef-88ba-1e4776b2960b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:39:35.292133 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5cce71d2-b26b-48ef-88ba-1e4776b2960b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: a19e556a-ef5f-4229-a7ad-534bf657d10b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:39:35.300384 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5cce71d2-b26b-48ef-88ba-1e4776b2960b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:35.301152 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5cce71d2-b26b-48ef-88ba-1e4776b2960b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:35.301775 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5cce71d2-b26b-48ef-88ba-1e4776b2960b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:35.302704 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5cce71d2-b26b-48ef-88ba-1e4776b2960b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:35.303344 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5cce71d2-b26b-48ef-88ba-1e4776b2960b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:35.303953 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5cce71d2-b26b-48ef-88ba-1e4776b2960b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:35.453966 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5cce71d2-b26b-48ef-88ba-1e4776b2960b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:35.463477 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5cce71d2-b26b-48ef-88ba-1e4776b2960b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b" status: 200 len: 1358 microversion: 2.1 time: 0.177060 Oct 18 16:39:35.464727 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3686/7352] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:39:35 2022] GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:39:36.486799 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d1ff9165-51c3-4a98-910a-b53df37eaab3 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:39:36.487574 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d1ff9165-51c3-4a98-910a-b53df37eaab3 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: a19e556a-ef5f-4229-a7ad-534bf657d10b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:39:36.494644 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1ff9165-51c3-4a98-910a-b53df37eaab3 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:36.495467 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1ff9165-51c3-4a98-910a-b53df37eaab3 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:36.496156 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1ff9165-51c3-4a98-910a-b53df37eaab3 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:36.497153 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1ff9165-51c3-4a98-910a-b53df37eaab3 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:36.497967 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1ff9165-51c3-4a98-910a-b53df37eaab3 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:36.498618 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1ff9165-51c3-4a98-910a-b53df37eaab3 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:36.666448 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d1ff9165-51c3-4a98-910a-b53df37eaab3 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:36.675079 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d1ff9165-51c3-4a98-910a-b53df37eaab3 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b" status: 200 len: 1358 microversion: 2.1 time: 0.192295 Oct 18 16:39:36.685202 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3667/7353] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:39:36 2022] GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b => generated 1358 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:39:37.700643 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2de81e42-1dc9-4927-930f-e58396f9da82 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:39:37.701421 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2de81e42-1dc9-4927-930f-e58396f9da82 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: a19e556a-ef5f-4229-a7ad-534bf657d10b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:39:37.708668 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2de81e42-1dc9-4927-930f-e58396f9da82 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:37.709299 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2de81e42-1dc9-4927-930f-e58396f9da82 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:37.709832 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2de81e42-1dc9-4927-930f-e58396f9da82 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:37.710641 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2de81e42-1dc9-4927-930f-e58396f9da82 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:37.711192 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2de81e42-1dc9-4927-930f-e58396f9da82 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:37.711734 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2de81e42-1dc9-4927-930f-e58396f9da82 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:37.856264 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2de81e42-1dc9-4927-930f-e58396f9da82 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:37.864481 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2de81e42-1dc9-4927-930f-e58396f9da82 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b" status: 200 len: 1358 microversion: 2.1 time: 0.168938 Oct 18 16:39:37.865325 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3687/7354] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:39:37 2022] GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:39:38.887257 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f2fa4db0-8e6b-4203-98b3-3387902d318b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:39:38.888627 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f2fa4db0-8e6b-4203-98b3-3387902d318b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: a19e556a-ef5f-4229-a7ad-534bf657d10b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:39:38.894677 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2fa4db0-8e6b-4203-98b3-3387902d318b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:38.895157 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2fa4db0-8e6b-4203-98b3-3387902d318b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:38.895586 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2fa4db0-8e6b-4203-98b3-3387902d318b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:38.896278 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2fa4db0-8e6b-4203-98b3-3387902d318b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:38.896732 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2fa4db0-8e6b-4203-98b3-3387902d318b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:38.897177 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2fa4db0-8e6b-4203-98b3-3387902d318b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:39.045614 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f2fa4db0-8e6b-4203-98b3-3387902d318b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:39.053495 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f2fa4db0-8e6b-4203-98b3-3387902d318b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b" status: 200 len: 1358 microversion: 2.1 time: 0.170282 Oct 18 16:39:39.054308 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3668/7355] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:39:38 2022] GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:39:40.076838 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-31013e93-9480-41e9-b1ff-f6e9e9a62d5a tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:39:40.077501 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-31013e93-9480-41e9-b1ff-f6e9e9a62d5a tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: a19e556a-ef5f-4229-a7ad-534bf657d10b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:39:40.084241 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-31013e93-9480-41e9-b1ff-f6e9e9a62d5a tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:40.084728 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-31013e93-9480-41e9-b1ff-f6e9e9a62d5a tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:40.085212 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-31013e93-9480-41e9-b1ff-f6e9e9a62d5a tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:40.085923 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-31013e93-9480-41e9-b1ff-f6e9e9a62d5a tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:40.086388 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-31013e93-9480-41e9-b1ff-f6e9e9a62d5a tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:40.086823 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-31013e93-9480-41e9-b1ff-f6e9e9a62d5a tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:40.221512 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-31013e93-9480-41e9-b1ff-f6e9e9a62d5a tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:40.229454 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-31013e93-9480-41e9-b1ff-f6e9e9a62d5a tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b" status: 200 len: 1358 microversion: 2.1 time: 0.156399 Oct 18 16:39:40.230037 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3688/7356] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:39:40 2022] GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:39:41.252410 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f6914e19-2b04-44bb-af9d-325afff24d5e tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:39:41.253072 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f6914e19-2b04-44bb-af9d-325afff24d5e tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: a19e556a-ef5f-4229-a7ad-534bf657d10b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:39:41.260186 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f6914e19-2b04-44bb-af9d-325afff24d5e tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:41.260669 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f6914e19-2b04-44bb-af9d-325afff24d5e tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:41.261143 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f6914e19-2b04-44bb-af9d-325afff24d5e tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:41.261833 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f6914e19-2b04-44bb-af9d-325afff24d5e tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:41.262291 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f6914e19-2b04-44bb-af9d-325afff24d5e tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:41.262742 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f6914e19-2b04-44bb-af9d-325afff24d5e tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:41.393941 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f6914e19-2b04-44bb-af9d-325afff24d5e tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:41.401623 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f6914e19-2b04-44bb-af9d-325afff24d5e tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b" status: 200 len: 1358 microversion: 2.1 time: 0.153100 Oct 18 16:39:41.402209 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3669/7357] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:39:41 2022] GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:39:42.425409 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4dd59b44-c2ca-4651-9705-95dcb2db5f59 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:39:42.425979 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4dd59b44-c2ca-4651-9705-95dcb2db5f59 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: a19e556a-ef5f-4229-a7ad-534bf657d10b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:39:42.427839 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:39:42.428516 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=6 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:39:42.435442 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4dd59b44-c2ca-4651-9705-95dcb2db5f59 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:42.435957 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4dd59b44-c2ca-4651-9705-95dcb2db5f59 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:42.436406 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4dd59b44-c2ca-4651-9705-95dcb2db5f59 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:42.437145 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4dd59b44-c2ca-4651-9705-95dcb2db5f59 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:42.437613 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4dd59b44-c2ca-4651-9705-95dcb2db5f59 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:42.438085 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4dd59b44-c2ca-4651-9705-95dcb2db5f59 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:42.566792 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4dd59b44-c2ca-4651-9705-95dcb2db5f59 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:42.574547 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4dd59b44-c2ca-4651-9705-95dcb2db5f59 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b" status: 200 len: 1358 microversion: 2.1 time: 0.153191 Oct 18 16:39:42.575122 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3689/7358] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:39:42 2022] GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:39:43.599181 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5efd3c4d-21da-4a5f-8407-5caa2992d493 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:39:43.599773 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5efd3c4d-21da-4a5f-8407-5caa2992d493 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: a19e556a-ef5f-4229-a7ad-534bf657d10b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:39:43.607839 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-63c6a986-9748-423b-931f-67b82ea1c364 req-4ff29467-8900-46c0-890e-03c031ed3d0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a19e556a-ef5f-4229-a7ad-534bf657d10b", "tag": "51512bf3-641c-413d-8b92-9b9816d4f016"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:39:43.615161 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:39:43.624999 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5efd3c4d-21da-4a5f-8407-5caa2992d493 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:43.625497 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5efd3c4d-21da-4a5f-8407-5caa2992d493 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:43.625939 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5efd3c4d-21da-4a5f-8407-5caa2992d493 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:43.626686 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5efd3c4d-21da-4a5f-8407-5caa2992d493 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:43.627133 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5efd3c4d-21da-4a5f-8407-5caa2992d493 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:43.627560 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5efd3c4d-21da-4a5f-8407-5caa2992d493 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:43.630367 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-63c6a986-9748-423b-931f-67b82ea1c364 req-4ff29467-8900-46c0-890e-03c031ed3d0c service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:43.630856 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-63c6a986-9748-423b-931f-67b82ea1c364 req-4ff29467-8900-46c0-890e-03c031ed3d0c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:43.631541 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-63c6a986-9748-423b-931f-67b82ea1c364 req-4ff29467-8900-46c0-890e-03c031ed3d0c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:43.645362 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-63c6a986-9748-423b-931f-67b82ea1c364 req-4ff29467-8900-46c0-890e-03c031ed3d0c service nova] Creating event network-changed:51512bf3-641c-413d-8b92-9b9816d4f016 for instance a19e556a-ef5f-4229-a7ad-534bf657d10b on n-h1-853682-5 Oct 18 16:39:43.650483 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-63c6a986-9748-423b-931f-67b82ea1c364 req-4ff29467-8900-46c0-890e-03c031ed3d0c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047312 Oct 18 16:39:43.651102 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3690/7359] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:39:43.849419 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5efd3c4d-21da-4a5f-8407-5caa2992d493 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:43.857275 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5efd3c4d-21da-4a5f-8407-5caa2992d493 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b" status: 200 len: 1358 microversion: 2.1 time: 0.262593 Oct 18 16:39:43.858979 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3670/7360] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:39:43 2022] GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b => generated 1358 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:39:44.881328 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-95fdeb08-d5ac-468c-83eb-adae2117bc9f tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:39:44.882042 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-95fdeb08-d5ac-468c-83eb-adae2117bc9f tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: a19e556a-ef5f-4229-a7ad-534bf657d10b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:39:44.888143 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-95fdeb08-d5ac-468c-83eb-adae2117bc9f tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:44.888636 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-95fdeb08-d5ac-468c-83eb-adae2117bc9f tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:44.889613 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-95fdeb08-d5ac-468c-83eb-adae2117bc9f tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:44.890318 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-95fdeb08-d5ac-468c-83eb-adae2117bc9f tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:44.890784 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-95fdeb08-d5ac-468c-83eb-adae2117bc9f tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:44.891222 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-95fdeb08-d5ac-468c-83eb-adae2117bc9f tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:45.022540 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-95fdeb08-d5ac-468c-83eb-adae2117bc9f tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:45.030273 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-95fdeb08-d5ac-468c-83eb-adae2117bc9f tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b" status: 200 len: 1358 microversion: 2.1 time: 0.154100 Oct 18 16:39:45.030836 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3691/7361] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:39:44 2022] GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:39:46.053312 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-23a72ce7-69be-4a07-a22e-aba3ed85d2cd tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:39:46.053932 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-23a72ce7-69be-4a07-a22e-aba3ed85d2cd tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: a19e556a-ef5f-4229-a7ad-534bf657d10b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:39:46.060702 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23a72ce7-69be-4a07-a22e-aba3ed85d2cd tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:46.061220 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23a72ce7-69be-4a07-a22e-aba3ed85d2cd tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:46.061656 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23a72ce7-69be-4a07-a22e-aba3ed85d2cd tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:46.062343 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23a72ce7-69be-4a07-a22e-aba3ed85d2cd tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:46.062797 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23a72ce7-69be-4a07-a22e-aba3ed85d2cd tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:46.063238 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23a72ce7-69be-4a07-a22e-aba3ed85d2cd tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:46.230191 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-23a72ce7-69be-4a07-a22e-aba3ed85d2cd tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:46.238011 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-23a72ce7-69be-4a07-a22e-aba3ed85d2cd tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b" status: 200 len: 1358 microversion: 2.1 time: 0.188758 Oct 18 16:39:46.238625 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3671/7362] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:39:46 2022] GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:39:47.261273 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3c369ced-03bb-4e34-8dd8-be8b63ac13e2 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:39:47.261914 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3c369ced-03bb-4e34-8dd8-be8b63ac13e2 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: a19e556a-ef5f-4229-a7ad-534bf657d10b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:39:47.269447 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3c369ced-03bb-4e34-8dd8-be8b63ac13e2 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:47.269946 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3c369ced-03bb-4e34-8dd8-be8b63ac13e2 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:47.270396 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3c369ced-03bb-4e34-8dd8-be8b63ac13e2 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:47.271101 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3c369ced-03bb-4e34-8dd8-be8b63ac13e2 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:47.271574 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3c369ced-03bb-4e34-8dd8-be8b63ac13e2 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:47.272034 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3c369ced-03bb-4e34-8dd8-be8b63ac13e2 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:47.405452 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3c369ced-03bb-4e34-8dd8-be8b63ac13e2 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:47.413391 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3c369ced-03bb-4e34-8dd8-be8b63ac13e2 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b" status: 200 len: 1358 microversion: 2.1 time: 0.156160 Oct 18 16:39:47.413963 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3692/7363] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:39:47 2022] GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:39:48.435627 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b2dea55a-acda-47b4-9444-d654b4202704 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:39:48.436232 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b2dea55a-acda-47b4-9444-d654b4202704 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: a19e556a-ef5f-4229-a7ad-534bf657d10b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:39:48.443032 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2dea55a-acda-47b4-9444-d654b4202704 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:48.443515 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2dea55a-acda-47b4-9444-d654b4202704 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:48.443946 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2dea55a-acda-47b4-9444-d654b4202704 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:48.444637 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2dea55a-acda-47b4-9444-d654b4202704 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:48.445118 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2dea55a-acda-47b4-9444-d654b4202704 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:48.445577 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2dea55a-acda-47b4-9444-d654b4202704 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:48.574222 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b2dea55a-acda-47b4-9444-d654b4202704 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:48.582392 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b2dea55a-acda-47b4-9444-d654b4202704 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b" status: 200 len: 1358 microversion: 2.1 time: 0.150748 Oct 18 16:39:48.582970 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3672/7364] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:39:48 2022] GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:39:49.605325 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-accfd028-06b9-48bd-9fce-0d5edb78e3e1 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:39:49.605969 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-accfd028-06b9-48bd-9fce-0d5edb78e3e1 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: a19e556a-ef5f-4229-a7ad-534bf657d10b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:39:49.613568 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-accfd028-06b9-48bd-9fce-0d5edb78e3e1 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:49.614076 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-accfd028-06b9-48bd-9fce-0d5edb78e3e1 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:49.614532 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-accfd028-06b9-48bd-9fce-0d5edb78e3e1 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:49.615244 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-accfd028-06b9-48bd-9fce-0d5edb78e3e1 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:49.615716 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-accfd028-06b9-48bd-9fce-0d5edb78e3e1 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:49.616159 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-accfd028-06b9-48bd-9fce-0d5edb78e3e1 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:49.752763 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-accfd028-06b9-48bd-9fce-0d5edb78e3e1 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:49.760532 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-accfd028-06b9-48bd-9fce-0d5edb78e3e1 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b" status: 200 len: 1358 microversion: 2.1 time: 0.159142 Oct 18 16:39:49.761149 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3693/7365] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:39:49 2022] GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:39:49.819638 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-8f65c1ec-690e-4544-9d3a-64389c5020e5 req-ed518c05-ea90-4539-a44b-10f3c5d1ddf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a19e556a-ef5f-4229-a7ad-534bf657d10b", "name": "network-vif-plugged", "status": "completed", "tag": "51512bf3-641c-413d-8b92-9b9816d4f016"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:39:49.831004 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8f65c1ec-690e-4544-9d3a-64389c5020e5 req-ed518c05-ea90-4539-a44b-10f3c5d1ddf3 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:49.831484 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8f65c1ec-690e-4544-9d3a-64389c5020e5 req-ed518c05-ea90-4539-a44b-10f3c5d1ddf3 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:49.831959 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8f65c1ec-690e-4544-9d3a-64389c5020e5 req-ed518c05-ea90-4539-a44b-10f3c5d1ddf3 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:49.843684 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-8f65c1ec-690e-4544-9d3a-64389c5020e5 req-ed518c05-ea90-4539-a44b-10f3c5d1ddf3 service nova] Creating event network-vif-plugged:51512bf3-641c-413d-8b92-9b9816d4f016 for instance a19e556a-ef5f-4229-a7ad-534bf657d10b on n-h1-853682-5 Oct 18 16:39:49.848832 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-8f65c1ec-690e-4544-9d3a-64389c5020e5 req-ed518c05-ea90-4539-a44b-10f3c5d1ddf3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032896 Oct 18 16:39:49.849457 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3673/7366] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:39:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:39:50.784343 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d69652a6-b74a-4740-aed6-b0331781935e tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:39:50.785011 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d69652a6-b74a-4740-aed6-b0331781935e tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: a19e556a-ef5f-4229-a7ad-534bf657d10b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:39:50.792064 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d69652a6-b74a-4740-aed6-b0331781935e tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:50.792595 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d69652a6-b74a-4740-aed6-b0331781935e tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:50.793079 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d69652a6-b74a-4740-aed6-b0331781935e tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:50.793791 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d69652a6-b74a-4740-aed6-b0331781935e tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:50.794266 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d69652a6-b74a-4740-aed6-b0331781935e tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:50.794708 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d69652a6-b74a-4740-aed6-b0331781935e tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:50.928433 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d69652a6-b74a-4740-aed6-b0331781935e tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:50.936350 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d69652a6-b74a-4740-aed6-b0331781935e tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b" status: 200 len: 1358 microversion: 2.1 time: 0.156557 Oct 18 16:39:50.936981 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3694/7367] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:39:50 2022] GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:39:51.960943 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5ae12d7e-7642-4900-a7cd-8bf183b0705e tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:39:51.961560 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5ae12d7e-7642-4900-a7cd-8bf183b0705e tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: a19e556a-ef5f-4229-a7ad-534bf657d10b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:39:51.967740 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ae12d7e-7642-4900-a7cd-8bf183b0705e tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:51.968214 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ae12d7e-7642-4900-a7cd-8bf183b0705e tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:51.968643 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ae12d7e-7642-4900-a7cd-8bf183b0705e tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:51.969354 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ae12d7e-7642-4900-a7cd-8bf183b0705e tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:51.969805 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ae12d7e-7642-4900-a7cd-8bf183b0705e tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:51.970229 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ae12d7e-7642-4900-a7cd-8bf183b0705e tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:52.100749 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5ae12d7e-7642-4900-a7cd-8bf183b0705e tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:52.109169 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5ae12d7e-7642-4900-a7cd-8bf183b0705e tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b" status: 200 len: 1547 microversion: 2.1 time: 0.153644 Oct 18 16:39:52.109750 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3674/7368] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:39:51 2022] GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b => generated 1547 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:39:52.131218 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-85ad1858-405c-4104-83bd-92a873c8d780 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:39:52.131860 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-85ad1858-405c-4104-83bd-92a873c8d780 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: a19e556a-ef5f-4229-a7ad-534bf657d10b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:39:52.138699 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-85ad1858-405c-4104-83bd-92a873c8d780 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:52.139723 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-85ad1858-405c-4104-83bd-92a873c8d780 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:52.140182 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-85ad1858-405c-4104-83bd-92a873c8d780 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:52.141011 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-85ad1858-405c-4104-83bd-92a873c8d780 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:52.141402 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-85ad1858-405c-4104-83bd-92a873c8d780 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:52.141847 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-85ad1858-405c-4104-83bd-92a873c8d780 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:52.269913 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-85ad1858-405c-4104-83bd-92a873c8d780 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:52.277655 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-85ad1858-405c-4104-83bd-92a873c8d780 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b" status: 200 len: 1547 microversion: 2.1 time: 0.150372 Oct 18 16:39:52.278235 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3695/7369] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:39:52 2022] GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b => generated 1547 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:39:52.300691 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bbf95515-1ddc-4ae0-9d83-bd1dfcf99bee tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:39:52.305393 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bbf95515-1ddc-4ae0-9d83-bd1dfcf99bee tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:52.306162 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bbf95515-1ddc-4ae0-9d83-bd1dfcf99bee tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Searching by: {'deleted': False, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b'} {{(pid=120406) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 16:39:52.311412 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bbf95515-1ddc-4ae0-9d83-bd1dfcf99bee tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:52.311884 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bbf95515-1ddc-4ae0-9d83-bd1dfcf99bee tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:52.312315 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bbf95515-1ddc-4ae0-9d83-bd1dfcf99bee tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:52.313062 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bbf95515-1ddc-4ae0-9d83-bd1dfcf99bee tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:52.313511 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bbf95515-1ddc-4ae0-9d83-bd1dfcf99bee tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:52.313930 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bbf95515-1ddc-4ae0-9d83-bd1dfcf99bee tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:52.337612 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.multi_cell_list [None req-bbf95515-1ddc-4ae0-9d83-bd1dfcf99bee tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120406) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 16:39:52.364176 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bbf95515-1ddc-4ae0-9d83-bd1dfcf99bee tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.067233 Oct 18 16:39:52.364745 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3675/7370] 10.222.0.60 () {58 vars in 1125 bytes} [Tue Oct 18 16:39:52 2022] GET /compute/v2.1/servers => generated 342 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:39:52.376300 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6fa7f415-44db-42df-b6ee-3271f0556699 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:39:52.376970 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6fa7f415-44db-42df-b6ee-3271f0556699 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: a19e556a-ef5f-4229-a7ad-534bf657d10b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:39:52.382917 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6fa7f415-44db-42df-b6ee-3271f0556699 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:52.383424 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6fa7f415-44db-42df-b6ee-3271f0556699 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:52.383873 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6fa7f415-44db-42df-b6ee-3271f0556699 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:52.384578 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6fa7f415-44db-42df-b6ee-3271f0556699 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:52.385081 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6fa7f415-44db-42df-b6ee-3271f0556699 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:52.385528 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6fa7f415-44db-42df-b6ee-3271f0556699 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:52.517451 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6fa7f415-44db-42df-b6ee-3271f0556699 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:39:52.525412 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6fa7f415-44db-42df-b6ee-3271f0556699 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b" status: 200 len: 1547 microversion: 2.1 time: 0.153019 Oct 18 16:39:52.525992 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3696/7371] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:39:52 2022] GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b => generated 1547 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:39:54.073340 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-42a9395a-b229-404e-9789-c82c8a76e0d3 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1e4c1c46-b797-4db0-b1b6-b76d439fd2c2"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:39:54.075664 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-42a9395a-b229-404e-9789-c82c8a76e0d3 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: a19e556a-ef5f-4229-a7ad-534bf657d10b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:39:54.083174 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42a9395a-b229-404e-9789-c82c8a76e0d3 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:54.083653 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42a9395a-b229-404e-9789-c82c8a76e0d3 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:54.084086 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42a9395a-b229-404e-9789-c82c8a76e0d3 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:54.084765 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42a9395a-b229-404e-9789-c82c8a76e0d3 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:39:54.085275 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42a9395a-b229-404e-9789-c82c8a76e0d3 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:39:54.085664 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42a9395a-b229-404e-9789-c82c8a76e0d3 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:39:54.348151 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-42a9395a-b229-404e-9789-c82c8a76e0d3 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "POST /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278545 Oct 18 16:39:54.348888 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3676/7372] 10.222.0.60 () {60 vars in 1323 bytes} [Tue Oct 18 16:39:54 2022] POST /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:40:07.400434 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f473a158-b44d-49fe-9c52-14fe60cd0ca0 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:40:07.401117 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f473a158-b44d-49fe-9c52-14fe60cd0ca0 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: a19e556a-ef5f-4229-a7ad-534bf657d10b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:40:07.403506 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:40:07.404303 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=70 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:40:07.410688 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f473a158-b44d-49fe-9c52-14fe60cd0ca0 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:40:07.411196 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f473a158-b44d-49fe-9c52-14fe60cd0ca0 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:40:07.411898 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f473a158-b44d-49fe-9c52-14fe60cd0ca0 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:40:07.412599 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f473a158-b44d-49fe-9c52-14fe60cd0ca0 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:40:07.413096 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f473a158-b44d-49fe-9c52-14fe60cd0ca0 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:40:07.413540 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f473a158-b44d-49fe-9c52-14fe60cd0ca0 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:40:07.542612 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f473a158-b44d-49fe-9c52-14fe60cd0ca0 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:40:07.551507 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f473a158-b44d-49fe-9c52-14fe60cd0ca0 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b" status: 200 len: 1593 microversion: 2.1 time: 0.154980 Oct 18 16:40:07.552104 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3697/7373] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:40:07 2022] GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b => generated 1593 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:40:09.242094 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:40:09.242935 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:40:09.243726 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:40:09.248217 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-cf583743-5c2f-4f7b-b8d2-c6729e2f13a3 req-320fd3ef-f1d3-43c7-b186-07cb25f891eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a19e556a-ef5f-4229-a7ad-534bf657d10b", "tag": "51512bf3-641c-413d-8b92-9b9816d4f016"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:40:09.263575 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-cf583743-5c2f-4f7b-b8d2-c6729e2f13a3 req-320fd3ef-f1d3-43c7-b186-07cb25f891eb service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:40:09.264458 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-cf583743-5c2f-4f7b-b8d2-c6729e2f13a3 req-320fd3ef-f1d3-43c7-b186-07cb25f891eb service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:40:09.265136 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-cf583743-5c2f-4f7b-b8d2-c6729e2f13a3 req-320fd3ef-f1d3-43c7-b186-07cb25f891eb service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:40:09.282794 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-cf583743-5c2f-4f7b-b8d2-c6729e2f13a3 req-320fd3ef-f1d3-43c7-b186-07cb25f891eb service nova] Creating event network-changed:51512bf3-641c-413d-8b92-9b9816d4f016 for instance a19e556a-ef5f-4229-a7ad-534bf657d10b on n-h1-853682-5 Oct 18 16:40:09.288132 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-cf583743-5c2f-4f7b-b8d2-c6729e2f13a3 req-320fd3ef-f1d3-43c7-b186-07cb25f891eb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047884 Oct 18 16:40:09.288848 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3677/7374] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:40:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:40:10.621388 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a0335abf-336d-4ac9-99f4-2df10a23cf71 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-588593327"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:40:10.621955 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a0335abf-336d-4ac9-99f4-2df10a23cf71 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: a19e556a-ef5f-4229-a7ad-534bf657d10b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:40:10.628991 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a0335abf-336d-4ac9-99f4-2df10a23cf71 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:40:10.629494 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a0335abf-336d-4ac9-99f4-2df10a23cf71 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:40:10.629953 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a0335abf-336d-4ac9-99f4-2df10a23cf71 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:40:10.630676 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a0335abf-336d-4ac9-99f4-2df10a23cf71 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:40:10.631154 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a0335abf-336d-4ac9-99f4-2df10a23cf71 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:40:10.631602 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a0335abf-336d-4ac9-99f4-2df10a23cf71 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:40:10.757378 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.network.security_group_api [None req-a0335abf-336d-4ac9-99f4-2df10a23cf71 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Adding security group 012c1424-d13a-4cfb-8575-7de2368ef2e3 to port 51512bf3-641c-413d-8b92-9b9816d4f016 Oct 18 16:40:11.072361 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a0335abf-336d-4ac9-99f4-2df10a23cf71 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "POST /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b/action" status: 202 len: 0 microversion: 2.1 time: 0.454982 Oct 18 16:40:11.073025 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3698/7375] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:40:10 2022] POST /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b/action => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 16:40:11.082439 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-aef2dbce-241d-4674-9307-4b788d562b0b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:40:11.083146 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-aef2dbce-241d-4674-9307-4b788d562b0b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: a19e556a-ef5f-4229-a7ad-534bf657d10b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:40:11.091396 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aef2dbce-241d-4674-9307-4b788d562b0b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:40:11.091869 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aef2dbce-241d-4674-9307-4b788d562b0b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:40:11.092305 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aef2dbce-241d-4674-9307-4b788d562b0b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:40:11.093618 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aef2dbce-241d-4674-9307-4b788d562b0b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:40:11.094074 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aef2dbce-241d-4674-9307-4b788d562b0b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:40:11.094542 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aef2dbce-241d-4674-9307-4b788d562b0b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:40:11.247733 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-aef2dbce-241d-4674-9307-4b788d562b0b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:40:11.257133 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-aef2dbce-241d-4674-9307-4b788d562b0b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b" status: 200 len: 1758 microversion: 2.1 time: 0.179476 Oct 18 16:40:11.257727 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3678/7376] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:40:11 2022] GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b => generated 1758 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:40:11.303680 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-8c9ea02f-4786-42fd-a70d-4d6a70e51650 req-c20aabc7-065a-4a35-bc15-8347c8aafa38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a19e556a-ef5f-4229-a7ad-534bf657d10b", "tag": "51512bf3-641c-413d-8b92-9b9816d4f016"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:40:11.313089 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-8c9ea02f-4786-42fd-a70d-4d6a70e51650 req-c20aabc7-065a-4a35-bc15-8347c8aafa38 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:40:11.313721 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-8c9ea02f-4786-42fd-a70d-4d6a70e51650 req-c20aabc7-065a-4a35-bc15-8347c8aafa38 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:40:11.314362 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-8c9ea02f-4786-42fd-a70d-4d6a70e51650 req-c20aabc7-065a-4a35-bc15-8347c8aafa38 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:40:11.325840 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-8c9ea02f-4786-42fd-a70d-4d6a70e51650 req-c20aabc7-065a-4a35-bc15-8347c8aafa38 service nova] Creating event network-changed:51512bf3-641c-413d-8b92-9b9816d4f016 for instance a19e556a-ef5f-4229-a7ad-534bf657d10b on n-h1-853682-5 Oct 18 16:40:11.331012 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-8c9ea02f-4786-42fd-a70d-4d6a70e51650 req-c20aabc7-065a-4a35-bc15-8347c8aafa38 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031163 Oct 18 16:40:11.331797 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3699/7377] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:42:24.716444 n-d-853682-5 devstack@n-api.service[120406]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9784c765-18ae-4d28-9be4-c2f2473b54eb] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 18 16:42:24.717197 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:42:24.718131 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=8 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:42:24.719314 n-d-853682-5 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 16:42:24.719450 n-d-853682-5 devstack@n-api.service[120406]: Tue Oct 18 16:42:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b/action (ip 10.222.0.60) !!! Oct 18 16:42:24.721406 n-d-853682-5 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 16:42:24.721590 n-d-853682-5 devstack@n-api.service[120406]: Tue Oct 18 16:42:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b/action (ip 10.222.0.60) !!! Oct 18 16:42:24.725924 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ea08b161-9ea1-437b-97c2-a6244813cce5 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:42:24.728138 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ea08b161-9ea1-437b-97c2-a6244813cce5 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: a19e556a-ef5f-4229-a7ad-534bf657d10b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:42:24.738062 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea08b161-9ea1-437b-97c2-a6244813cce5 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:42:24.738547 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea08b161-9ea1-437b-97c2-a6244813cce5 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:42:24.738988 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea08b161-9ea1-437b-97c2-a6244813cce5 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:42:24.739690 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea08b161-9ea1-437b-97c2-a6244813cce5 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:42:24.740148 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea08b161-9ea1-437b-97c2-a6244813cce5 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:42:24.740576 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea08b161-9ea1-437b-97c2-a6244813cce5 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:42:24.813501 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ea08b161-9ea1-437b-97c2-a6244813cce5 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "POST /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b/action" status: 202 len: 0 microversion: 2.1 time: 0.098860 Oct 18 16:42:24.814149 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3679/7378] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:42:24 2022] POST /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:42:24.821973 n-d-853682-5 devstack@n-api.service[120405]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6b6d975c-54e4-4acd-8cc5-5b0cda3c3106] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 16:42:24.823984 n-d-853682-5 devstack@n-api.service[120405]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c870dd72-6039-47fe-83e0-90856ded1829] AMQP server on 10.222.0.60:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 18 16:42:24.824851 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=6 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:42:24.825622 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=12 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:42:24.827278 n-d-853682-5 devstack@n-api.service[120405]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 18 16:42:24.828318 n-d-853682-5 devstack@n-api.service[120405]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 16:42:24.828449 n-d-853682-5 devstack@n-api.service[120405]: Tue Oct 18 16:42:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b (ip 10.222.0.60) !!! Oct 18 16:42:24.842247 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b20f5d7d-c118-440f-a9d5-2d6c2a791131 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:42:24.842975 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b20f5d7d-c118-440f-a9d5-2d6c2a791131 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: a19e556a-ef5f-4229-a7ad-534bf657d10b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:42:24.850203 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b20f5d7d-c118-440f-a9d5-2d6c2a791131 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:42:24.850701 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b20f5d7d-c118-440f-a9d5-2d6c2a791131 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:42:24.851151 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b20f5d7d-c118-440f-a9d5-2d6c2a791131 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:42:24.851858 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b20f5d7d-c118-440f-a9d5-2d6c2a791131 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:42:24.852324 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b20f5d7d-c118-440f-a9d5-2d6c2a791131 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:42:24.852766 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b20f5d7d-c118-440f-a9d5-2d6c2a791131 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:42:25.098198 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b20f5d7d-c118-440f-a9d5-2d6c2a791131 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:42:25.106896 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b20f5d7d-c118-440f-a9d5-2d6c2a791131 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b" status: 200 len: 1760 microversion: 2.1 time: 0.287294 Oct 18 16:42:25.107249 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3700/7379] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:42:24 2022] GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b => generated 1760 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:42:26.133529 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dc9dba89-5ac4-44fd-b2e9-d4d2a35cb2d2 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:42:26.134268 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dc9dba89-5ac4-44fd-b2e9-d4d2a35cb2d2 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: a19e556a-ef5f-4229-a7ad-534bf657d10b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:42:26.143780 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc9dba89-5ac4-44fd-b2e9-d4d2a35cb2d2 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:42:26.144267 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc9dba89-5ac4-44fd-b2e9-d4d2a35cb2d2 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:42:26.144705 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc9dba89-5ac4-44fd-b2e9-d4d2a35cb2d2 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:42:26.145450 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc9dba89-5ac4-44fd-b2e9-d4d2a35cb2d2 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:42:26.145903 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc9dba89-5ac4-44fd-b2e9-d4d2a35cb2d2 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:42:26.146323 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc9dba89-5ac4-44fd-b2e9-d4d2a35cb2d2 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:42:26.147009 n-d-853682-5 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [-] [9784c765-18ae-4d28-9be4-c2f2473b54eb] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 40924. Oct 18 16:42:26.293394 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dc9dba89-5ac4-44fd-b2e9-d4d2a35cb2d2 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:42:26.302517 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dc9dba89-5ac4-44fd-b2e9-d4d2a35cb2d2 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b" status: 200 len: 1758 microversion: 2.1 time: 0.175620 Oct 18 16:42:26.303106 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3680/7380] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:42:26 2022] GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b => generated 1758 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:44:10.206838 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:44:10.207614 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=6 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:44:10.208431 n-d-853682-5 devstack@n-api.service[120405]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 16:44:10.208602 n-d-853682-5 devstack@n-api.service[120405]: Tue Oct 18 16:44:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b/action (ip 10.222.0.60) !!! Oct 18 16:44:10.214884 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-35d3d2e0-9e8c-4866-bc87-909e78db066e tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-588593327"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:44:10.215444 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-35d3d2e0-9e8c-4866-bc87-909e78db066e tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: a19e556a-ef5f-4229-a7ad-534bf657d10b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:44:10.226019 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-35d3d2e0-9e8c-4866-bc87-909e78db066e tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:10.226524 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-35d3d2e0-9e8c-4866-bc87-909e78db066e tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:10.226983 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-35d3d2e0-9e8c-4866-bc87-909e78db066e tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:10.227694 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-35d3d2e0-9e8c-4866-bc87-909e78db066e tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:10.228172 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-35d3d2e0-9e8c-4866-bc87-909e78db066e tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:10.228618 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-35d3d2e0-9e8c-4866-bc87-909e78db066e tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:10.233540 n-d-853682-5 devstack@n-api.service[120405]: INFO oslo.messaging._drivers.impl_rabbit [-] [c870dd72-6039-47fe-83e0-90856ded1829] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 40952. Oct 18 16:44:10.235742 n-d-853682-5 devstack@n-api.service[120405]: INFO oslo.messaging._drivers.impl_rabbit [-] [6b6d975c-54e4-4acd-8cc5-5b0cda3c3106] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 40950. Oct 18 16:44:10.358211 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.network.security_group_api [None req-35d3d2e0-9e8c-4866-bc87-909e78db066e tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Removing security group 012c1424-d13a-4cfb-8575-7de2368ef2e3 from port 51512bf3-641c-413d-8b92-9b9816d4f016 Oct 18 16:44:10.926856 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-35d3d2e0-9e8c-4866-bc87-909e78db066e tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "POST /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b/action" status: 202 len: 0 microversion: 2.1 time: 0.722507 Oct 18 16:44:10.927485 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3701/7381] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:44:10 2022] POST /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b/action => generated 0 bytes in 724 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:44:10.936268 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:44:10.937334 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:44:11.057551 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-a8e372d8-1b5e-4ee7-9a0f-f6a1079609b8 req-1d8503c4-00a0-4c22-8e74-1dbacdaad357 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a19e556a-ef5f-4229-a7ad-534bf657d10b", "tag": "51512bf3-641c-413d-8b92-9b9816d4f016"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:44:11.067998 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a8e372d8-1b5e-4ee7-9a0f-f6a1079609b8 req-1d8503c4-00a0-4c22-8e74-1dbacdaad357 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:11.068577 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a8e372d8-1b5e-4ee7-9a0f-f6a1079609b8 req-1d8503c4-00a0-4c22-8e74-1dbacdaad357 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:11.069122 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a8e372d8-1b5e-4ee7-9a0f-f6a1079609b8 req-1d8503c4-00a0-4c22-8e74-1dbacdaad357 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:11.082044 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-a8e372d8-1b5e-4ee7-9a0f-f6a1079609b8 req-1d8503c4-00a0-4c22-8e74-1dbacdaad357 service nova] Creating event network-changed:51512bf3-641c-413d-8b92-9b9816d4f016 for instance a19e556a-ef5f-4229-a7ad-534bf657d10b on n-h1-853682-5 Oct 18 16:44:11.087176 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-a8e372d8-1b5e-4ee7-9a0f-f6a1079609b8 req-1d8503c4-00a0-4c22-8e74-1dbacdaad357 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152603 Oct 18 16:44:11.087794 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3681/7382] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:44:12.385109 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-08397fc0-b5aa-4762-b191-3e040a3a1e8b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:44:12.385649 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-08397fc0-b5aa-4762-b191-3e040a3a1e8b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: a19e556a-ef5f-4229-a7ad-534bf657d10b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:44:12.392017 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-08397fc0-b5aa-4762-b191-3e040a3a1e8b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:12.392546 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-08397fc0-b5aa-4762-b191-3e040a3a1e8b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:12.393053 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-08397fc0-b5aa-4762-b191-3e040a3a1e8b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:12.393806 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-08397fc0-b5aa-4762-b191-3e040a3a1e8b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:12.394286 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-08397fc0-b5aa-4762-b191-3e040a3a1e8b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:12.394735 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-08397fc0-b5aa-4762-b191-3e040a3a1e8b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:12.481278 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-08397fc0-b5aa-4762-b191-3e040a3a1e8b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lazy-loading 'services' on Instance uuid a19e556a-ef5f-4229-a7ad-534bf657d10b {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:44:12.555512 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-08397fc0-b5aa-4762-b191-3e040a3a1e8b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b/os-volume_attachments/1e4c1c46-b797-4db0-b1b6-b76d439fd2c2" status: 202 len: 0 microversion: 2.1 time: 0.175184 Oct 18 16:44:12.556188 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3702/7383] 10.222.0.60 () {58 vars in 1416 bytes} [Tue Oct 18 16:44:12 2022] DELETE /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b/os-volume_attachments/1e4c1c46-b797-4db0-b1b6-b76d439fd2c2 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:44:12.565407 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2b68479c-318b-48bb-ac97-261987a71874 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:44:12.568195 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2b68479c-318b-48bb-ac97-261987a71874 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: a19e556a-ef5f-4229-a7ad-534bf657d10b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:44:12.575874 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b68479c-318b-48bb-ac97-261987a71874 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:12.576312 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b68479c-318b-48bb-ac97-261987a71874 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:12.576745 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b68479c-318b-48bb-ac97-261987a71874 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:12.577476 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b68479c-318b-48bb-ac97-261987a71874 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:12.577928 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b68479c-318b-48bb-ac97-261987a71874 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:12.578366 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b68479c-318b-48bb-ac97-261987a71874 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:12.612482 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2b68479c-318b-48bb-ac97-261987a71874 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051427 Oct 18 16:44:12.613102 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3682/7384] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 16:44:12 2022] GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:44:13.102973 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-d31cc8e7-1dd8-49e1-adc9-8a292ae9434f req-27597ef5-1007-416a-85f3-04ac180851ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a19e556a-ef5f-4229-a7ad-534bf657d10b", "tag": "51512bf3-641c-413d-8b92-9b9816d4f016"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:44:13.113487 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-d31cc8e7-1dd8-49e1-adc9-8a292ae9434f req-27597ef5-1007-416a-85f3-04ac180851ce service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:13.113993 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-d31cc8e7-1dd8-49e1-adc9-8a292ae9434f req-27597ef5-1007-416a-85f3-04ac180851ce service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:13.114449 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-d31cc8e7-1dd8-49e1-adc9-8a292ae9434f req-27597ef5-1007-416a-85f3-04ac180851ce service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:13.128869 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-d31cc8e7-1dd8-49e1-adc9-8a292ae9434f req-27597ef5-1007-416a-85f3-04ac180851ce service nova] Creating event network-changed:51512bf3-641c-413d-8b92-9b9816d4f016 for instance a19e556a-ef5f-4229-a7ad-534bf657d10b on n-h1-853682-5 Oct 18 16:44:13.133933 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-d31cc8e7-1dd8-49e1-adc9-8a292ae9434f req-27597ef5-1007-416a-85f3-04ac180851ce service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035061 Oct 18 16:44:13.134532 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3703/7385] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:44:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:44:13.626152 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3477558e-14e2-4a66-99aa-1b9b536b6514 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:44:13.628607 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3477558e-14e2-4a66-99aa-1b9b536b6514 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: a19e556a-ef5f-4229-a7ad-534bf657d10b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:44:13.636841 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3477558e-14e2-4a66-99aa-1b9b536b6514 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:13.638282 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3477558e-14e2-4a66-99aa-1b9b536b6514 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:13.638824 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3477558e-14e2-4a66-99aa-1b9b536b6514 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:13.639633 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3477558e-14e2-4a66-99aa-1b9b536b6514 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:13.640345 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3477558e-14e2-4a66-99aa-1b9b536b6514 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:13.641101 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3477558e-14e2-4a66-99aa-1b9b536b6514 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:13.677922 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3477558e-14e2-4a66-99aa-1b9b536b6514 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055573 Oct 18 16:44:13.678696 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3683/7386] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 16:44:13 2022] GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:44:14.691872 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-048b2e2c-fed0-4956-a074-03c55ce6be8e tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:44:14.694732 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-048b2e2c-fed0-4956-a074-03c55ce6be8e tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: a19e556a-ef5f-4229-a7ad-534bf657d10b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:44:14.703379 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-048b2e2c-fed0-4956-a074-03c55ce6be8e tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:14.703890 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-048b2e2c-fed0-4956-a074-03c55ce6be8e tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:14.704348 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-048b2e2c-fed0-4956-a074-03c55ce6be8e tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:14.705118 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-048b2e2c-fed0-4956-a074-03c55ce6be8e tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:14.705654 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-048b2e2c-fed0-4956-a074-03c55ce6be8e tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:14.706101 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-048b2e2c-fed0-4956-a074-03c55ce6be8e tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:14.739171 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-048b2e2c-fed0-4956-a074-03c55ce6be8e tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052240 Oct 18 16:44:14.739766 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3704/7387] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 16:44:14 2022] GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:44:15.752154 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fc752c8f-150e-465b-b343-746da17510b5 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:44:15.765123 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fc752c8f-150e-465b-b343-746da17510b5 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: a19e556a-ef5f-4229-a7ad-534bf657d10b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:44:15.773871 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc752c8f-150e-465b-b343-746da17510b5 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:15.774360 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc752c8f-150e-465b-b343-746da17510b5 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:15.774793 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc752c8f-150e-465b-b343-746da17510b5 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:15.775493 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc752c8f-150e-465b-b343-746da17510b5 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:15.775949 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc752c8f-150e-465b-b343-746da17510b5 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:15.776370 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc752c8f-150e-465b-b343-746da17510b5 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:15.806574 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fc752c8f-150e-465b-b343-746da17510b5 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058424 Oct 18 16:44:15.808197 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3684/7388] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 16:44:15 2022] GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:44:16.819816 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-81f1d2ac-ab6d-4be8-9e34-bc71f5edd56f tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:44:16.822307 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-81f1d2ac-ab6d-4be8-9e34-bc71f5edd56f tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: a19e556a-ef5f-4229-a7ad-534bf657d10b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:44:16.829395 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-81f1d2ac-ab6d-4be8-9e34-bc71f5edd56f tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:16.829965 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-81f1d2ac-ab6d-4be8-9e34-bc71f5edd56f tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:16.830482 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-81f1d2ac-ab6d-4be8-9e34-bc71f5edd56f tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:16.831276 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-81f1d2ac-ab6d-4be8-9e34-bc71f5edd56f tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:16.831817 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-81f1d2ac-ab6d-4be8-9e34-bc71f5edd56f tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:16.832322 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-81f1d2ac-ab6d-4be8-9e34-bc71f5edd56f tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:16.862434 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-81f1d2ac-ab6d-4be8-9e34-bc71f5edd56f tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046531 Oct 18 16:44:16.862934 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3705/7389] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 16:44:16 2022] GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:44:17.875433 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-10952c2a-ecdd-49fa-bc65-aeebe29e882d tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:44:17.877608 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-10952c2a-ecdd-49fa-bc65-aeebe29e882d tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: a19e556a-ef5f-4229-a7ad-534bf657d10b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:44:17.884272 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10952c2a-ecdd-49fa-bc65-aeebe29e882d tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:17.884751 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10952c2a-ecdd-49fa-bc65-aeebe29e882d tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:17.885826 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10952c2a-ecdd-49fa-bc65-aeebe29e882d tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:17.886525 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10952c2a-ecdd-49fa-bc65-aeebe29e882d tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:17.886952 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10952c2a-ecdd-49fa-bc65-aeebe29e882d tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:17.887367 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10952c2a-ecdd-49fa-bc65-aeebe29e882d tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:17.915300 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-10952c2a-ecdd-49fa-bc65-aeebe29e882d tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043877 Oct 18 16:44:17.915873 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3685/7390] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 16:44:17 2022] GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:44:17.926765 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-90ed52bf-89a5-4355-a3ac-09e144992050 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:44:17.927320 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-90ed52bf-89a5-4355-a3ac-09e144992050 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: a19e556a-ef5f-4229-a7ad-534bf657d10b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:44:17.935152 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-90ed52bf-89a5-4355-a3ac-09e144992050 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:17.935594 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-90ed52bf-89a5-4355-a3ac-09e144992050 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:17.936053 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-90ed52bf-89a5-4355-a3ac-09e144992050 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:17.936771 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-90ed52bf-89a5-4355-a3ac-09e144992050 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:17.937284 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-90ed52bf-89a5-4355-a3ac-09e144992050 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:17.937727 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-90ed52bf-89a5-4355-a3ac-09e144992050 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:18.013805 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-90ed52bf-89a5-4355-a3ac-09e144992050 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] HTTP exception thrown: Instance a19e556a-ef5f-4229-a7ad-534bf657d10b is not attached to volume 1e4c1c46-b797-4db0-b1b6-b76d439fd2c2 Oct 18 16:44:18.015448 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-90ed52bf-89a5-4355-a3ac-09e144992050 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Request method failure captured: Oct 18 16:44:18.015448 n-d-853682-5 devstack@n-api.service[120405]: request: DELETE /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b/os-volume_attachments/1e4c1c46-b797-4db0-b1b6-b76d439fd2c2 HTTP/1.1 Oct 18 16:44:18.015448 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 16:44:18.015448 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 16:44:18.015448 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 16:44:18.015448 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 16:44:18.015448 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 16:44:18.015448 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 16:44:18.015448 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 16:44:18.015448 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 16:44:18.015448 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTtaykhYn-swRLezoa7d8EvOJJocRNjKMO-Mu12tpmOPVRCOSy7XCrk2rooXoZjup35kmjoCOsDQ_t0tLttf3uTV7dCjX-t0g_QYLxLGahmFYhlRM8jf-oIzesBrtJWVGuXeu_5uBOrM4EQOe0Xx5aM0u--9lqm68dwtt7ZshTGobOzE Oct 18 16:44:18.015448 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 16:44:18.015448 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 16:44:18.015448 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 16:44:18.015448 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 16:44:18.015448 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 16:44:18.015448 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 16:44:18.015448 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 72e1244a01b5401d8f3363ae5d9f323b Oct 18 16:44:18.015448 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-TestMinimumBasicScenario-1767880555 Oct 18 16:44:18.015448 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 16:44:18.015448 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 16:44:18.015448 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/72e1244a01b5401d8f3363ae5d9f323b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/72e1244a01b5401d8f3363ae5d9f323b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/72e1244a01b5401d8f3363ae5d9f323b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_72e1244a01b5401d8f3363ae5d9f323b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:44:18.015448 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-TestMinimumBasicScenario-1767880555 Oct 18 16:44:18.015448 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 72e1244a01b5401d8f3363ae5d9f323b Oct 18 16:44:18.015448 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1767880555 Oct 18 16:44:18.015448 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-TestMinimumBasicScenario-1767880555-project Oct 18 16:44:18.015448 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 16:44:18.015448 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 16:44:18.015448 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: cfffffbceb1c4f7685958bcc1f62596a Oct 18 16:44:18.015448 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-TestMinimumBasicScenario-1767880555-project Oct 18 16:44:18.015448 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 16:44:18.015448 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance a19e556a-ef5f-4229-a7ad-534bf657d10b is not attached to volume 1e4c1c46-b797-4db0-b1b6-b76d439fd2c2 Oct 18 16:44:18.015448 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'server_id': 'a19e556a-ef5f-4229-a7ad-534bf657d10b', 'id': '1e4c1c46-b797-4db0-b1b6-b76d439fd2c2'} Oct 18 16:44:18.015448 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:44:18.015448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:44:18.015448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 18 16:44:18.015448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 18 16:44:18.015448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 16:44:18.015448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 16:44:18.015448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 18 16:44:18.015448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 18 16:44:18.015448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 1e4c1c46-b797-4db0-b1b6-b76d439fd2c2. Oct 18 16:44:18.015448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:44:18.015448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:44:18.015448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:44:18.015448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:44:18.015448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:44:18.015448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:44:18.015448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:44:18.015448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:44:18.015448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:44:18.015448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:44:18.015448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 18 16:44:18.015448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 18 16:44:18.015448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a19e556a-ef5f-4229-a7ad-534bf657d10b is not attached to volume 1e4c1c46-b797-4db0-b1b6-b76d439fd2c2 Oct 18 16:44:18.015448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:44:18.015448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:44:18.015448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:44:18.015448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:44:18.015448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:44:18.015448 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:44:18.020771 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:44:18.020771 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:44:18.020771 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a19e556a-ef5f-4229-a7ad-534bf657d10b is not attached to volume 1e4c1c46-b797-4db0-b1b6-b76d439fd2c2 Oct 18 16:44:18.020771 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:44:18.020771 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-90ed52bf-89a5-4355-a3ac-09e144992050 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Returning 404 to user: Instance a19e556a-ef5f-4229-a7ad-534bf657d10b is not attached to volume 1e4c1c46-b797-4db0-b1b6-b76d439fd2c2 {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:44:18.020771 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-90ed52bf-89a5-4355-a3ac-09e144992050 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b/os-volume_attachments/1e4c1c46-b797-4db0-b1b6-b76d439fd2c2" status: 404 len: 154 microversion: 2.1 time: 0.094232 Oct 18 16:44:18.020771 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3706/7391] 10.222.0.60 () {58 vars in 1416 bytes} [Tue Oct 18 16:44:17 2022] DELETE /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b/os-volume_attachments/1e4c1c46-b797-4db0-b1b6-b76d439fd2c2 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:44:21.393457 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8bb2049d-3b96-4c88-8fff-36112092eba3 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:44:21.393978 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8bb2049d-3b96-4c88-8fff-36112092eba3 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: a19e556a-ef5f-4229-a7ad-534bf657d10b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:44:21.401026 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8bb2049d-3b96-4c88-8fff-36112092eba3 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:21.401521 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8bb2049d-3b96-4c88-8fff-36112092eba3 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:21.401958 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8bb2049d-3b96-4c88-8fff-36112092eba3 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:21.402662 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8bb2049d-3b96-4c88-8fff-36112092eba3 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:21.403123 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8bb2049d-3b96-4c88-8fff-36112092eba3 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:21.403549 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8bb2049d-3b96-4c88-8fff-36112092eba3 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:21.429413 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8bb2049d-3b96-4c88-8fff-36112092eba3 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: a19e556a-ef5f-4229-a7ad-534bf657d10b] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:44:21.505485 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8bb2049d-3b96-4c88-8fff-36112092eba3 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b" status: 204 len: 0 microversion: 2.1 time: 0.115326 Oct 18 16:44:21.506331 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3686/7392] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 16:44:21 2022] DELETE /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:44:21.515675 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-464038b5-7dc8-4c8c-9ffb-1c4f469f3be7 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:44:21.516325 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-464038b5-7dc8-4c8c-9ffb-1c4f469f3be7 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: a19e556a-ef5f-4229-a7ad-534bf657d10b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:44:21.524190 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-464038b5-7dc8-4c8c-9ffb-1c4f469f3be7 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:21.524693 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-464038b5-7dc8-4c8c-9ffb-1c4f469f3be7 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:21.525174 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-464038b5-7dc8-4c8c-9ffb-1c4f469f3be7 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:21.525922 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-464038b5-7dc8-4c8c-9ffb-1c4f469f3be7 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:21.526399 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-464038b5-7dc8-4c8c-9ffb-1c4f469f3be7 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:21.526840 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-464038b5-7dc8-4c8c-9ffb-1c4f469f3be7 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:21.661253 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-464038b5-7dc8-4c8c-9ffb-1c4f469f3be7 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:44:21.669402 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-464038b5-7dc8-4c8c-9ffb-1c4f469f3be7 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b" status: 200 len: 1553 microversion: 2.1 time: 0.157930 Oct 18 16:44:21.669980 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3707/7393] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:44:21 2022] GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:44:22.696160 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ce93fce6-ad14-4ab3-beca-6d71023019cc tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:44:22.696894 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ce93fce6-ad14-4ab3-beca-6d71023019cc tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: a19e556a-ef5f-4229-a7ad-534bf657d10b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:44:22.709680 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce93fce6-ad14-4ab3-beca-6d71023019cc tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:22.710164 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce93fce6-ad14-4ab3-beca-6d71023019cc tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:22.710599 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce93fce6-ad14-4ab3-beca-6d71023019cc tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:22.711560 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce93fce6-ad14-4ab3-beca-6d71023019cc tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:22.712013 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce93fce6-ad14-4ab3-beca-6d71023019cc tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:22.712431 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce93fce6-ad14-4ab3-beca-6d71023019cc tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:22.851264 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ce93fce6-ad14-4ab3-beca-6d71023019cc tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:44:22.859253 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ce93fce6-ad14-4ab3-beca-6d71023019cc tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b" status: 200 len: 1553 microversion: 2.1 time: 0.168233 Oct 18 16:44:22.859835 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3687/7394] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:44:22 2022] GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b => generated 1553 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:44:23.883100 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-de1b1e66-b571-479d-b320-e04f719869a1 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:44:23.883795 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-de1b1e66-b571-479d-b320-e04f719869a1 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: a19e556a-ef5f-4229-a7ad-534bf657d10b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:44:23.890803 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de1b1e66-b571-479d-b320-e04f719869a1 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:23.891251 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de1b1e66-b571-479d-b320-e04f719869a1 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:23.891736 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de1b1e66-b571-479d-b320-e04f719869a1 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:23.892425 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de1b1e66-b571-479d-b320-e04f719869a1 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:23.892928 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de1b1e66-b571-479d-b320-e04f719869a1 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:23.893374 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-de1b1e66-b571-479d-b320-e04f719869a1 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:23.983562 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-de1b1e66-b571-479d-b320-e04f719869a1 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:44:23.991753 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-de1b1e66-b571-479d-b320-e04f719869a1 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b" status: 200 len: 1511 microversion: 2.1 time: 0.112589 Oct 18 16:44:23.992339 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3708/7395] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:44:23 2022] GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b => generated 1511 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:44:24.037240 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-38bca62b-2e15-44f6-9baa-b7f9cda9c29a req-5a2a4938-bd1a-4c48-bab3-8163d6bc0690 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a19e556a-ef5f-4229-a7ad-534bf657d10b", "name": "network-vif-deleted", "tag": "51512bf3-641c-413d-8b92-9b9816d4f016"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:44:24.047666 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-38bca62b-2e15-44f6-9baa-b7f9cda9c29a req-5a2a4938-bd1a-4c48-bab3-8163d6bc0690 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:24.048206 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-38bca62b-2e15-44f6-9baa-b7f9cda9c29a req-5a2a4938-bd1a-4c48-bab3-8163d6bc0690 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:24.048628 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-38bca62b-2e15-44f6-9baa-b7f9cda9c29a req-5a2a4938-bd1a-4c48-bab3-8163d6bc0690 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:24.060791 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-38bca62b-2e15-44f6-9baa-b7f9cda9c29a req-5a2a4938-bd1a-4c48-bab3-8163d6bc0690 service nova] Creating event network-vif-deleted:51512bf3-641c-413d-8b92-9b9816d4f016 for instance a19e556a-ef5f-4229-a7ad-534bf657d10b on n-h1-853682-5 Oct 18 16:44:24.066023 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-38bca62b-2e15-44f6-9baa-b7f9cda9c29a req-5a2a4938-bd1a-4c48-bab3-8163d6bc0690 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032766 Oct 18 16:44:24.066643 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3688/7396] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:44:25.017495 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-86b571d4-4259-4a6f-88ed-b83436db110d tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:44:25.018136 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-86b571d4-4259-4a6f-88ed-b83436db110d tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: a19e556a-ef5f-4229-a7ad-534bf657d10b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:44:25.025008 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-86b571d4-4259-4a6f-88ed-b83436db110d tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:25.025512 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-86b571d4-4259-4a6f-88ed-b83436db110d tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:25.025988 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-86b571d4-4259-4a6f-88ed-b83436db110d tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:25.026689 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-86b571d4-4259-4a6f-88ed-b83436db110d tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:25.027163 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-86b571d4-4259-4a6f-88ed-b83436db110d tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:25.027609 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-86b571d4-4259-4a6f-88ed-b83436db110d tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:25.041786 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-86b571d4-4259-4a6f-88ed-b83436db110d tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] HTTP exception thrown: Instance a19e556a-ef5f-4229-a7ad-534bf657d10b could not be found. Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-86b571d4-4259-4a6f-88ed-b83436db110d tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Request method failure captured: Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b HTTP/1.1 Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTtaykhYn-swRLezoa7d8EvOJJocRNjKMO-Mu12tpmOPVRCOSy7XCrk2rooXoZjup35kmjoCOsDQ_t0tLttf3uTV7dCjX-t0g_QYLxLGahmFYhlRM8jf-oIzesBrtJWVGuXeu_5uBOrM4EQOe0Xx5aM0u--9lqm68dwtt7ZshTGobOzE Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 72e1244a01b5401d8f3363ae5d9f323b Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-TestMinimumBasicScenario-1767880555 Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/72e1244a01b5401d8f3363ae5d9f323b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/72e1244a01b5401d8f3363ae5d9f323b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/72e1244a01b5401d8f3363ae5d9f323b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_72e1244a01b5401d8f3363ae5d9f323b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-TestMinimumBasicScenario-1767880555 Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 72e1244a01b5401d8f3363ae5d9f323b Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1767880555 Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-TestMinimumBasicScenario-1767880555-project Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: cfffffbceb1c4f7685958bcc1f62596a Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-TestMinimumBasicScenario-1767880555-project Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance a19e556a-ef5f-4229-a7ad-534bf657d10b could not be found. Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'a19e556a-ef5f-4229-a7ad-534bf657d10b'} Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a19e556a-ef5f-4229-a7ad-534bf657d10b could not be found. Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a19e556a-ef5f-4229-a7ad-534bf657d10b could not be found. Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:44:25.044124 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:44:25.049192 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:44:25.049192 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:44:25.049192 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:44:25.049192 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:44:25.049192 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:44:25.049192 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a19e556a-ef5f-4229-a7ad-534bf657d10b could not be found. Oct 18 16:44:25.049192 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:44:25.049192 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-86b571d4-4259-4a6f-88ed-b83436db110d tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Returning 404 to user: Instance a19e556a-ef5f-4229-a7ad-534bf657d10b could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:44:25.049192 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-86b571d4-4259-4a6f-88ed-b83436db110d tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b" status: 404 len: 111 microversion: 2.1 time: 0.032175 Oct 18 16:44:25.049192 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3709/7397] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:44:25 2022] GET /compute/v2.1/servers/a19e556a-ef5f-4229-a7ad-534bf657d10b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:44:25.055078 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5c8515bb-bc1a-4885-a54b-c51fb8b4ea3a tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '.version_select at 0x7f7c37a6cd30>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:44:25.079794 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5c8515bb-bc1a-4885-a54b-c51fb8b4ea3a tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1184559543" status: 202 len: 0 microversion: 2.1 time: 0.028926 Oct 18 16:44:25.080387 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3689/7398] 10.222.0.60 () {58 vars in 1272 bytes} [Tue Oct 18 16:44:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1184559543 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:44:34.189868 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8eecdde4-58fa-4150-b7a1-ce1780b3226a tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Action: 'create', calling method: .version_select at 0x7f7c3c2298b0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-658943967", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGNv0oroaDuiGuveNgqtkVJ+WnMqeWUXgSZCjOp61biffL0IjOiE2d+0zLCAPmmfmNtk6KNQ6zvmJKGQU1RL+QTZ3E5ya+bACHJkWrlRRo5OKNw/sRZoaBBpR8raXjelFw=="}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:44:34.210684 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-8eecdde4-58fa-4150-b7a1-ce1780b3226a tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Getting quotas for project 72e1244a01b5401d8f3363ae5d9f323b. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:44:34.215937 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-8eecdde4-58fa-4150-b7a1-ce1780b3226a tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Getting quotas for user cfffffbceb1c4f7685958bcc1f62596a and project 72e1244a01b5401d8f3363ae5d9f323b. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:44:34.243415 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8eecdde4-58fa-4150-b7a1-ce1780b3226a tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.057472 Oct 18 16:44:34.244032 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3710/7399] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Oct 18 16:44:34 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:44:34.304959 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:44:34.310771 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-79d1f35e-cc44-4580-9886-93e93c50b701 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-742311768", "imageRef": "50456d66-af57-4773-a33b-89b0a44e8ab9", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-658943967", "networks": [{"uuid": "2d99d053-2834-47fe-86cd-05c29fd3b4a7"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:44:34.474972 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-79d1f35e-cc44-4580-9886-93e93c50b701 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] validate_networks() for [('2d99d053-2834-47fe-86cd-05c29fd3b4a7', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 16:44:34.913496 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-79d1f35e-cc44-4580-9886-93e93c50b701 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:44:34.913919 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-79d1f35e-cc44-4580-9886-93e93c50b701 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:44:34.914393 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-79d1f35e-cc44-4580-9886-93e93c50b701 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:44:34.914806 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-79d1f35e-cc44-4580-9886-93e93c50b701 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:44:34.915210 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-79d1f35e-cc44-4580-9886-93e93c50b701 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:44:34.924536 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79d1f35e-cc44-4580-9886-93e93c50b701 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:34.925051 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79d1f35e-cc44-4580-9886-93e93c50b701 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:34.925488 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79d1f35e-cc44-4580-9886-93e93c50b701 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:34.926218 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79d1f35e-cc44-4580-9886-93e93c50b701 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:34.926667 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79d1f35e-cc44-4580-9886-93e93c50b701 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:34.927086 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79d1f35e-cc44-4580-9886-93e93c50b701 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:34.944704 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-79d1f35e-cc44-4580-9886-93e93c50b701 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Getting quotas for project 72e1244a01b5401d8f3363ae5d9f323b. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:44:34.950280 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-79d1f35e-cc44-4580-9886-93e93c50b701 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Getting quotas for user cfffffbceb1c4f7685958bcc1f62596a and project 72e1244a01b5401d8f3363ae5d9f323b. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:44:34.962535 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-79d1f35e-cc44-4580-9886-93e93c50b701 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:44:34.965416 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-79d1f35e-cc44-4580-9886-93e93c50b701 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='50456d66-af57-4773-a33b-89b0a44e8ab9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:44:35.010704 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-79d1f35e-cc44-4580-9886-93e93c50b701 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.707602 Oct 18 16:44:35.011362 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3690/7400] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 16:44:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:44:35.022605 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e057fbb0-2684-4829-94d7-d6bfe59e0a28 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:44:35.023241 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e057fbb0-2684-4829-94d7-d6bfe59e0a28 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:44:35.032482 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:44:35.125559 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e057fbb0-2684-4829-94d7-d6bfe59e0a28 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:44:35.132487 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e057fbb0-2684-4829-94d7-d6bfe59e0a28 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190" status: 200 len: 1257 microversion: 2.1 time: 0.113833 Oct 18 16:44:35.133093 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3711/7401] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:44:35 2022] GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190 => generated 1257 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:44:36.155669 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-43c1dc56-39a4-4ea7-9245-af3f5bc1f1c6 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:44:36.156334 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-43c1dc56-39a4-4ea7-9245-af3f5bc1f1c6 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:44:36.209477 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-43c1dc56-39a4-4ea7-9245-af3f5bc1f1c6 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:44:36.217387 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-43c1dc56-39a4-4ea7-9245-af3f5bc1f1c6 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190" status: 200 len: 1257 microversion: 2.1 time: 0.066381 Oct 18 16:44:36.217987 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3691/7402] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:44:36 2022] GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190 => generated 1257 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:44:37.241084 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a399e0e9-7f64-4035-91d7-210870998f33 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:44:37.241725 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a399e0e9-7f64-4035-91d7-210870998f33 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:44:37.300027 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a399e0e9-7f64-4035-91d7-210870998f33 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:44:37.308338 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a399e0e9-7f64-4035-91d7-210870998f33 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190" status: 200 len: 1257 microversion: 2.1 time: 0.070849 Oct 18 16:44:37.308943 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3712/7403] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:44:37 2022] GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190 => generated 1257 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:44:38.333870 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-71c050a1-d497-4b94-9828-7526d73552b7 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:44:38.334483 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-71c050a1-d497-4b94-9828-7526d73552b7 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:44:38.337040 n-d-853682-5 devstack@n-api.service[120406]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6eb481dc-0a5f-4095-8691-72ce090f1ba0] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 18 16:44:38.391257 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-71c050a1-d497-4b94-9828-7526d73552b7 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:44:38.398717 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-71c050a1-d497-4b94-9828-7526d73552b7 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190" status: 200 len: 1257 microversion: 2.1 time: 0.068675 Oct 18 16:44:38.399348 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3692/7404] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:44:38 2022] GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190 => generated 1257 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:44:39.423190 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-64243442-8526-4770-a7cc-b888832813af tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:44:39.423822 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-64243442-8526-4770-a7cc-b888832813af tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:44:39.430702 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-64243442-8526-4770-a7cc-b888832813af tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:39.431201 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-64243442-8526-4770-a7cc-b888832813af tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:39.431653 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-64243442-8526-4770-a7cc-b888832813af tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:39.432364 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-64243442-8526-4770-a7cc-b888832813af tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:39.432857 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-64243442-8526-4770-a7cc-b888832813af tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:39.433308 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-64243442-8526-4770-a7cc-b888832813af tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:39.493783 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-64243442-8526-4770-a7cc-b888832813af tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:44:39.501598 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-64243442-8526-4770-a7cc-b888832813af tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190" status: 200 len: 1261 microversion: 2.1 time: 0.082421 Oct 18 16:44:39.502173 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3713/7405] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:44:39 2022] GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190 => generated 1261 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:44:40.527206 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-82bef59f-cda8-4811-aa48-7a3c4a9ad637 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:44:40.527907 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-82bef59f-cda8-4811-aa48-7a3c4a9ad637 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:44:40.545115 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82bef59f-cda8-4811-aa48-7a3c4a9ad637 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:40.545935 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82bef59f-cda8-4811-aa48-7a3c4a9ad637 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:40.546637 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82bef59f-cda8-4811-aa48-7a3c4a9ad637 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:40.547658 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82bef59f-cda8-4811-aa48-7a3c4a9ad637 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:40.548296 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82bef59f-cda8-4811-aa48-7a3c4a9ad637 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:40.549005 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82bef59f-cda8-4811-aa48-7a3c4a9ad637 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:40.549964 n-d-853682-5 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [-] [6eb481dc-0a5f-4095-8691-72ce090f1ba0] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 41176. Oct 18 16:44:41.124085 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-82bef59f-cda8-4811-aa48-7a3c4a9ad637 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:44:41.132717 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-82bef59f-cda8-4811-aa48-7a3c4a9ad637 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190" status: 200 len: 1357 microversion: 2.1 time: 0.611335 Oct 18 16:44:41.134143 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3693/7406] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:44:40 2022] GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190 => generated 1357 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:44:42.162295 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-db2de652-90f7-4739-a30c-6729b3456f60 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:44:42.162925 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-db2de652-90f7-4739-a30c-6729b3456f60 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:44:42.164928 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:44:42.171265 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-db2de652-90f7-4739-a30c-6729b3456f60 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:42.171884 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-db2de652-90f7-4739-a30c-6729b3456f60 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:42.172417 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-db2de652-90f7-4739-a30c-6729b3456f60 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:42.173190 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-db2de652-90f7-4739-a30c-6729b3456f60 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:42.173662 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-db2de652-90f7-4739-a30c-6729b3456f60 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:42.174255 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-db2de652-90f7-4739-a30c-6729b3456f60 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:42.323193 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-db2de652-90f7-4739-a30c-6729b3456f60 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:44:42.331559 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-db2de652-90f7-4739-a30c-6729b3456f60 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190" status: 200 len: 1357 microversion: 2.1 time: 0.173504 Oct 18 16:44:42.332138 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3714/7407] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:44:42 2022] GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190 => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:44:43.358289 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-31195e99-4062-4a30-b4d8-1af465b203bc tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:44:43.359882 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-31195e99-4062-4a30-b4d8-1af465b203bc tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:44:43.369266 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:44:43.371319 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31195e99-4062-4a30-b4d8-1af465b203bc tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:43.371916 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31195e99-4062-4a30-b4d8-1af465b203bc tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:43.372382 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31195e99-4062-4a30-b4d8-1af465b203bc tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:43.373324 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31195e99-4062-4a30-b4d8-1af465b203bc tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:43.373784 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31195e99-4062-4a30-b4d8-1af465b203bc tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:43.374369 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31195e99-4062-4a30-b4d8-1af465b203bc tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:43.508408 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-31195e99-4062-4a30-b4d8-1af465b203bc tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:44:43.516578 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-31195e99-4062-4a30-b4d8-1af465b203bc tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190" status: 200 len: 1357 microversion: 2.1 time: 0.164917 Oct 18 16:44:43.517184 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3694/7408] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:44:43 2022] GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190 => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:44:44.539987 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fa6adaa2-69fe-4f55-81a6-df998973beac tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:44:44.540623 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-fa6adaa2-69fe-4f55-81a6-df998973beac tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:44:44.548381 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fa6adaa2-69fe-4f55-81a6-df998973beac tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:44.548992 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fa6adaa2-69fe-4f55-81a6-df998973beac tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:44.549457 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fa6adaa2-69fe-4f55-81a6-df998973beac tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:44.550178 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fa6adaa2-69fe-4f55-81a6-df998973beac tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:44.550655 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fa6adaa2-69fe-4f55-81a6-df998973beac tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:44.551102 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fa6adaa2-69fe-4f55-81a6-df998973beac tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:44.694300 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-fa6adaa2-69fe-4f55-81a6-df998973beac tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:44:44.704303 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fa6adaa2-69fe-4f55-81a6-df998973beac tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190" status: 200 len: 1357 microversion: 2.1 time: 0.168202 Oct 18 16:44:44.705388 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3715/7409] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:44:44 2022] GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190 => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:44:45.727845 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d6d54f9f-da80-4b7b-bcc0-29ff1bc8e6c5 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:44:45.728579 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d6d54f9f-da80-4b7b-bcc0-29ff1bc8e6c5 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:44:45.731844 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:44:45.738246 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d6d54f9f-da80-4b7b-bcc0-29ff1bc8e6c5 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:45.738745 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d6d54f9f-da80-4b7b-bcc0-29ff1bc8e6c5 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:45.739186 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d6d54f9f-da80-4b7b-bcc0-29ff1bc8e6c5 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:45.739925 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d6d54f9f-da80-4b7b-bcc0-29ff1bc8e6c5 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:45.740413 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d6d54f9f-da80-4b7b-bcc0-29ff1bc8e6c5 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:45.740902 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d6d54f9f-da80-4b7b-bcc0-29ff1bc8e6c5 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:45.884150 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d6d54f9f-da80-4b7b-bcc0-29ff1bc8e6c5 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:44:45.892703 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d6d54f9f-da80-4b7b-bcc0-29ff1bc8e6c5 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190" status: 200 len: 1357 microversion: 2.1 time: 0.169100 Oct 18 16:44:45.893300 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3695/7410] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:44:45 2022] GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190 => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:44:46.921270 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-144539ae-3bcc-400c-a3b0-4dd03bb9ef11 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:44:46.922022 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-144539ae-3bcc-400c-a3b0-4dd03bb9ef11 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:44:46.937114 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-144539ae-3bcc-400c-a3b0-4dd03bb9ef11 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:46.937631 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-144539ae-3bcc-400c-a3b0-4dd03bb9ef11 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:46.938089 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-144539ae-3bcc-400c-a3b0-4dd03bb9ef11 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:46.938819 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-144539ae-3bcc-400c-a3b0-4dd03bb9ef11 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:46.939292 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-144539ae-3bcc-400c-a3b0-4dd03bb9ef11 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:46.939767 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-144539ae-3bcc-400c-a3b0-4dd03bb9ef11 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:47.087196 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-144539ae-3bcc-400c-a3b0-4dd03bb9ef11 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:44:47.094932 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-144539ae-3bcc-400c-a3b0-4dd03bb9ef11 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190" status: 200 len: 1357 microversion: 2.1 time: 0.182043 Oct 18 16:44:47.095505 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3716/7411] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:44:46 2022] GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190 => generated 1357 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:44:48.117368 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d1bce958-4598-4b03-88b3-d3b5a4c86ef0 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:44:48.118006 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d1bce958-4598-4b03-88b3-d3b5a4c86ef0 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:44:48.125038 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1bce958-4598-4b03-88b3-d3b5a4c86ef0 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:48.125533 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1bce958-4598-4b03-88b3-d3b5a4c86ef0 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:48.125982 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1bce958-4598-4b03-88b3-d3b5a4c86ef0 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:48.126685 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1bce958-4598-4b03-88b3-d3b5a4c86ef0 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:48.127147 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1bce958-4598-4b03-88b3-d3b5a4c86ef0 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:48.127579 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1bce958-4598-4b03-88b3-d3b5a4c86ef0 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:48.282619 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d1bce958-4598-4b03-88b3-d3b5a4c86ef0 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:44:48.290666 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d1bce958-4598-4b03-88b3-d3b5a4c86ef0 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190" status: 200 len: 1357 microversion: 2.1 time: 0.177297 Oct 18 16:44:48.291228 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3696/7412] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:44:48 2022] GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190 => generated 1357 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:44:49.313450 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a2efd55a-a409-41da-9528-b3e45c083ae9 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:44:49.314087 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a2efd55a-a409-41da-9528-b3e45c083ae9 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:44:49.315932 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=8 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:44:49.322214 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a2efd55a-a409-41da-9528-b3e45c083ae9 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:49.322714 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a2efd55a-a409-41da-9528-b3e45c083ae9 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:49.323443 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a2efd55a-a409-41da-9528-b3e45c083ae9 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:49.324031 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a2efd55a-a409-41da-9528-b3e45c083ae9 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:49.324507 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a2efd55a-a409-41da-9528-b3e45c083ae9 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:49.324985 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a2efd55a-a409-41da-9528-b3e45c083ae9 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:49.454980 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a2efd55a-a409-41da-9528-b3e45c083ae9 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:44:49.462807 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a2efd55a-a409-41da-9528-b3e45c083ae9 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190" status: 200 len: 1357 microversion: 2.1 time: 0.153302 Oct 18 16:44:49.463375 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3717/7413] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:44:49 2022] GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:44:50.384407 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=10 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:44:50.457432 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-cecc79f2-09f1-4100-a596-351b8551dd1c req-dc6e6e22-5e7b-4cd5-93af-34a013dcd381 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190", "tag": "2fb7ba63-e77e-4dfb-b58f-20ab4242dbd2"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:44:50.466840 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-cecc79f2-09f1-4100-a596-351b8551dd1c req-dc6e6e22-5e7b-4cd5-93af-34a013dcd381 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:50.467323 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-cecc79f2-09f1-4100-a596-351b8551dd1c req-dc6e6e22-5e7b-4cd5-93af-34a013dcd381 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:50.467757 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-cecc79f2-09f1-4100-a596-351b8551dd1c req-dc6e6e22-5e7b-4cd5-93af-34a013dcd381 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:50.481488 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-cecc79f2-09f1-4100-a596-351b8551dd1c req-dc6e6e22-5e7b-4cd5-93af-34a013dcd381 service nova] Creating event network-changed:2fb7ba63-e77e-4dfb-b58f-20ab4242dbd2 for instance e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190 on n-h2-853682-5 Oct 18 16:44:50.486482 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-cecc79f2-09f1-4100-a596-351b8551dd1c req-dc6e6e22-5e7b-4cd5-93af-34a013dcd381 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106949 Oct 18 16:44:50.487151 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3697/7414] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:44:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:44:50.487565 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8cd9c6eb-12cc-490b-a43a-19608642c0fa tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:44:50.489076 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8cd9c6eb-12cc-490b-a43a-19608642c0fa tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:44:50.496618 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8cd9c6eb-12cc-490b-a43a-19608642c0fa tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:50.497179 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8cd9c6eb-12cc-490b-a43a-19608642c0fa tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:50.497640 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8cd9c6eb-12cc-490b-a43a-19608642c0fa tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:50.498364 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8cd9c6eb-12cc-490b-a43a-19608642c0fa tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:50.498837 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8cd9c6eb-12cc-490b-a43a-19608642c0fa tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:50.499283 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8cd9c6eb-12cc-490b-a43a-19608642c0fa tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:50.637941 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8cd9c6eb-12cc-490b-a43a-19608642c0fa tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:44:50.645800 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8cd9c6eb-12cc-490b-a43a-19608642c0fa tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190" status: 200 len: 1357 microversion: 2.1 time: 0.163221 Oct 18 16:44:50.646406 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3718/7415] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:44:50 2022] GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:44:51.670933 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2626da8d-3a4b-438a-b2a6-b4e742ac9549 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:44:51.671640 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2626da8d-3a4b-438a-b2a6-b4e742ac9549 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:44:51.677910 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2626da8d-3a4b-438a-b2a6-b4e742ac9549 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:51.678397 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2626da8d-3a4b-438a-b2a6-b4e742ac9549 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:51.678849 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2626da8d-3a4b-438a-b2a6-b4e742ac9549 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:51.679599 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2626da8d-3a4b-438a-b2a6-b4e742ac9549 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:51.680037 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2626da8d-3a4b-438a-b2a6-b4e742ac9549 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:51.680429 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2626da8d-3a4b-438a-b2a6-b4e742ac9549 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:51.812144 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2626da8d-3a4b-438a-b2a6-b4e742ac9549 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:44:51.820321 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2626da8d-3a4b-438a-b2a6-b4e742ac9549 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190" status: 200 len: 1357 microversion: 2.1 time: 0.154503 Oct 18 16:44:51.820917 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3698/7416] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:44:51 2022] GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:44:52.843834 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e8a028c0-ec5e-4135-9751-6599da8edd3c tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:44:52.844451 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e8a028c0-ec5e-4135-9751-6599da8edd3c tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:44:52.851282 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e8a028c0-ec5e-4135-9751-6599da8edd3c tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:52.851775 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e8a028c0-ec5e-4135-9751-6599da8edd3c tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:52.852221 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e8a028c0-ec5e-4135-9751-6599da8edd3c tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:52.852963 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e8a028c0-ec5e-4135-9751-6599da8edd3c tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:52.853432 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e8a028c0-ec5e-4135-9751-6599da8edd3c tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:52.853868 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e8a028c0-ec5e-4135-9751-6599da8edd3c tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:52.988543 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e8a028c0-ec5e-4135-9751-6599da8edd3c tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:44:52.996382 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e8a028c0-ec5e-4135-9751-6599da8edd3c tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190" status: 200 len: 1357 microversion: 2.1 time: 0.157045 Oct 18 16:44:52.996979 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3719/7417] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:44:52 2022] GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:44:54.019261 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d93b8a72-71b1-4944-9d40-34d5f6c3d2bc tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:44:54.019848 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d93b8a72-71b1-4944-9d40-34d5f6c3d2bc tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:44:54.026635 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d93b8a72-71b1-4944-9d40-34d5f6c3d2bc tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:54.027117 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d93b8a72-71b1-4944-9d40-34d5f6c3d2bc tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:54.027556 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d93b8a72-71b1-4944-9d40-34d5f6c3d2bc tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:54.028247 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d93b8a72-71b1-4944-9d40-34d5f6c3d2bc tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:54.028701 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d93b8a72-71b1-4944-9d40-34d5f6c3d2bc tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:54.029154 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d93b8a72-71b1-4944-9d40-34d5f6c3d2bc tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:54.159233 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d93b8a72-71b1-4944-9d40-34d5f6c3d2bc tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:44:54.167120 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d93b8a72-71b1-4944-9d40-34d5f6c3d2bc tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190" status: 200 len: 1357 microversion: 2.1 time: 0.151899 Oct 18 16:44:54.168233 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3699/7418] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:44:54 2022] GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:44:55.121460 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-9e621e7e-156c-4eda-a5f4-84d874ffdda2 req-6e14bd50-5a69-4008-9bcb-4ed46e0e53ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190", "name": "network-vif-plugged", "status": "completed", "tag": "2fb7ba63-e77e-4dfb-b58f-20ab4242dbd2"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:44:55.131136 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-9e621e7e-156c-4eda-a5f4-84d874ffdda2 req-6e14bd50-5a69-4008-9bcb-4ed46e0e53ab service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:55.131632 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-9e621e7e-156c-4eda-a5f4-84d874ffdda2 req-6e14bd50-5a69-4008-9bcb-4ed46e0e53ab service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:55.132078 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-9e621e7e-156c-4eda-a5f4-84d874ffdda2 req-6e14bd50-5a69-4008-9bcb-4ed46e0e53ab service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:55.144240 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-9e621e7e-156c-4eda-a5f4-84d874ffdda2 req-6e14bd50-5a69-4008-9bcb-4ed46e0e53ab service nova] Creating event network-vif-plugged:2fb7ba63-e77e-4dfb-b58f-20ab4242dbd2 for instance e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190 on n-h2-853682-5 Oct 18 16:44:55.149344 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-9e621e7e-156c-4eda-a5f4-84d874ffdda2 req-6e14bd50-5a69-4008-9bcb-4ed46e0e53ab service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093801 Oct 18 16:44:55.149930 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3720/7419] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:44:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:44:55.190574 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d1061eed-a5a3-4aea-bfcb-9c3fa02e9ef0 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:44:55.191186 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d1061eed-a5a3-4aea-bfcb-9c3fa02e9ef0 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:44:55.198019 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1061eed-a5a3-4aea-bfcb-9c3fa02e9ef0 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:55.198507 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1061eed-a5a3-4aea-bfcb-9c3fa02e9ef0 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:55.198982 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1061eed-a5a3-4aea-bfcb-9c3fa02e9ef0 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:55.200185 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1061eed-a5a3-4aea-bfcb-9c3fa02e9ef0 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:55.200695 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1061eed-a5a3-4aea-bfcb-9c3fa02e9ef0 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:55.201087 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1061eed-a5a3-4aea-bfcb-9c3fa02e9ef0 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:55.336146 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d1061eed-a5a3-4aea-bfcb-9c3fa02e9ef0 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:44:55.344018 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d1061eed-a5a3-4aea-bfcb-9c3fa02e9ef0 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190" status: 200 len: 1357 microversion: 2.1 time: 0.157287 Oct 18 16:44:55.344592 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3700/7420] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:44:55 2022] GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:44:56.368293 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f73c9cc4-5ff7-490e-abd4-2c28f8f78c50 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:44:56.369050 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f73c9cc4-5ff7-490e-abd4-2c28f8f78c50 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:44:56.375510 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f73c9cc4-5ff7-490e-abd4-2c28f8f78c50 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:56.376010 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f73c9cc4-5ff7-490e-abd4-2c28f8f78c50 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:56.376459 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f73c9cc4-5ff7-490e-abd4-2c28f8f78c50 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:56.377196 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f73c9cc4-5ff7-490e-abd4-2c28f8f78c50 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:56.377664 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f73c9cc4-5ff7-490e-abd4-2c28f8f78c50 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:56.378100 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f73c9cc4-5ff7-490e-abd4-2c28f8f78c50 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:56.511079 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f73c9cc4-5ff7-490e-abd4-2c28f8f78c50 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:44:56.519416 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f73c9cc4-5ff7-490e-abd4-2c28f8f78c50 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190" status: 200 len: 1547 microversion: 2.1 time: 0.156265 Oct 18 16:44:56.519989 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3721/7421] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:44:56 2022] GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190 => generated 1547 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:44:56.544769 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dfa4278f-6911-4ded-82f1-b314178aa09b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:44:56.545446 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dfa4278f-6911-4ded-82f1-b314178aa09b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:44:56.552020 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfa4278f-6911-4ded-82f1-b314178aa09b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:56.552504 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfa4278f-6911-4ded-82f1-b314178aa09b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:56.552980 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfa4278f-6911-4ded-82f1-b314178aa09b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:56.553671 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfa4278f-6911-4ded-82f1-b314178aa09b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:56.554131 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfa4278f-6911-4ded-82f1-b314178aa09b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:56.554558 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfa4278f-6911-4ded-82f1-b314178aa09b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:56.682470 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dfa4278f-6911-4ded-82f1-b314178aa09b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:44:56.690805 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dfa4278f-6911-4ded-82f1-b314178aa09b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190" status: 200 len: 1547 microversion: 2.1 time: 0.150053 Oct 18 16:44:56.691384 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3701/7422] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:44:56 2022] GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190 => generated 1547 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:44:56.713070 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9a4169d0-396c-49c8-9007-4b39e72f6a14 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:44:56.717922 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9a4169d0-396c-49c8-9007-4b39e72f6a14 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:44:56.718713 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9a4169d0-396c-49c8-9007-4b39e72f6a14 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Searching by: {'deleted': False, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b'} {{(pid=120405) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 16:44:56.724043 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9a4169d0-396c-49c8-9007-4b39e72f6a14 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:56.724534 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9a4169d0-396c-49c8-9007-4b39e72f6a14 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:56.725028 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9a4169d0-396c-49c8-9007-4b39e72f6a14 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:56.725774 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9a4169d0-396c-49c8-9007-4b39e72f6a14 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:56.726244 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9a4169d0-396c-49c8-9007-4b39e72f6a14 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:56.726681 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9a4169d0-396c-49c8-9007-4b39e72f6a14 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:56.750216 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.multi_cell_list [None req-9a4169d0-396c-49c8-9007-4b39e72f6a14 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120405) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 16:44:56.776624 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9a4169d0-396c-49c8-9007-4b39e72f6a14 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.067618 Oct 18 16:44:56.777271 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3722/7423] 10.222.0.60 () {58 vars in 1125 bytes} [Tue Oct 18 16:44:56 2022] GET /compute/v2.1/servers => generated 342 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:44:56.789241 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3062bd58-1f83-4a98-a354-3a55dff7ac37 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:44:56.789863 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3062bd58-1f83-4a98-a354-3a55dff7ac37 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:44:56.795814 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3062bd58-1f83-4a98-a354-3a55dff7ac37 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:56.796298 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3062bd58-1f83-4a98-a354-3a55dff7ac37 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:56.796742 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3062bd58-1f83-4a98-a354-3a55dff7ac37 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:56.797460 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3062bd58-1f83-4a98-a354-3a55dff7ac37 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:56.797919 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3062bd58-1f83-4a98-a354-3a55dff7ac37 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:56.798348 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3062bd58-1f83-4a98-a354-3a55dff7ac37 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:56.928461 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3062bd58-1f83-4a98-a354-3a55dff7ac37 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:44:56.936832 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3062bd58-1f83-4a98-a354-3a55dff7ac37 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190" status: 200 len: 1547 microversion: 2.1 time: 0.151763 Oct 18 16:44:56.937437 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3702/7424] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:44:56 2022] GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190 => generated 1547 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:44:58.451744 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-32d382c7-5e66-414d-bdec-d03ecbb33ba5 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f57ce16e-7c02-4de2-8ed4-b065c268b40d"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:44:58.454192 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-32d382c7-5e66-414d-bdec-d03ecbb33ba5 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:44:58.461024 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-32d382c7-5e66-414d-bdec-d03ecbb33ba5 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:58.461532 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-32d382c7-5e66-414d-bdec-d03ecbb33ba5 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:58.461993 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-32d382c7-5e66-414d-bdec-d03ecbb33ba5 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:58.462700 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-32d382c7-5e66-414d-bdec-d03ecbb33ba5 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:44:58.463174 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-32d382c7-5e66-414d-bdec-d03ecbb33ba5 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:44:58.463615 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-32d382c7-5e66-414d-bdec-d03ecbb33ba5 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:44:58.699456 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-32d382c7-5e66-414d-bdec-d03ecbb33ba5 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "POST /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.252264 Oct 18 16:44:58.700284 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3723/7425] 10.222.0.60 () {60 vars in 1323 bytes} [Tue Oct 18 16:44:58 2022] POST /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190/os-volume_attachments => generated 194 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:45:09.476770 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-807a7f4f-d080-429f-9d5e-407771c53bfb tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:45:09.477421 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-807a7f4f-d080-429f-9d5e-407771c53bfb tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:45:09.480403 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=17 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:45:09.481217 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=58 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:45:09.486887 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-807a7f4f-d080-429f-9d5e-407771c53bfb tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:09.487377 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-807a7f4f-d080-429f-9d5e-407771c53bfb tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:09.487817 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-807a7f4f-d080-429f-9d5e-407771c53bfb tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:09.488522 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-807a7f4f-d080-429f-9d5e-407771c53bfb tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:09.489018 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-807a7f4f-d080-429f-9d5e-407771c53bfb tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:09.489451 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-807a7f4f-d080-429f-9d5e-407771c53bfb tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:09.620095 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-807a7f4f-d080-429f-9d5e-407771c53bfb tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:45:09.628968 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-807a7f4f-d080-429f-9d5e-407771c53bfb tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190" status: 200 len: 1593 microversion: 2.1 time: 0.156153 Oct 18 16:45:09.629542 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3703/7426] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:45:09 2022] GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190 => generated 1593 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:45:11.508751 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:45:11.509585 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=19 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:45:11.510391 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:45:11.514783 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-2f502e9d-1386-4b21-a8d6-08ccc639e33c req-1e74ef2d-5ec8-4f8f-9104-f8b6502f4dd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190", "tag": "2fb7ba63-e77e-4dfb-b58f-20ab4242dbd2"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:45:11.525621 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-2f502e9d-1386-4b21-a8d6-08ccc639e33c req-1e74ef2d-5ec8-4f8f-9104-f8b6502f4dd7 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:11.525991 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-2f502e9d-1386-4b21-a8d6-08ccc639e33c req-1e74ef2d-5ec8-4f8f-9104-f8b6502f4dd7 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:11.526447 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-2f502e9d-1386-4b21-a8d6-08ccc639e33c req-1e74ef2d-5ec8-4f8f-9104-f8b6502f4dd7 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:11.540108 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-2f502e9d-1386-4b21-a8d6-08ccc639e33c req-1e74ef2d-5ec8-4f8f-9104-f8b6502f4dd7 service nova] Creating event network-changed:2fb7ba63-e77e-4dfb-b58f-20ab4242dbd2 for instance e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190 on n-h2-853682-5 Oct 18 16:45:11.545989 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-2f502e9d-1386-4b21-a8d6-08ccc639e33c req-1e74ef2d-5ec8-4f8f-9104-f8b6502f4dd7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039041 Oct 18 16:45:11.546994 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3724/7427] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:45:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:45:12.607806 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2f733bc9-e9c6-44ed-8df7-d8d5b9748956 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1830011152"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:45:12.608418 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2f733bc9-e9c6-44ed-8df7-d8d5b9748956 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:45:12.615368 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f733bc9-e9c6-44ed-8df7-d8d5b9748956 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:12.615957 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f733bc9-e9c6-44ed-8df7-d8d5b9748956 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:12.616403 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f733bc9-e9c6-44ed-8df7-d8d5b9748956 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:12.617150 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f733bc9-e9c6-44ed-8df7-d8d5b9748956 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:12.617614 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f733bc9-e9c6-44ed-8df7-d8d5b9748956 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:12.618124 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f733bc9-e9c6-44ed-8df7-d8d5b9748956 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:12.750241 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.network.security_group_api [None req-2f733bc9-e9c6-44ed-8df7-d8d5b9748956 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Adding security group 75ffc50d-d52b-491e-892a-621df1db6b5d to port 2fb7ba63-e77e-4dfb-b58f-20ab4242dbd2 Oct 18 16:45:13.069108 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2f733bc9-e9c6-44ed-8df7-d8d5b9748956 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "POST /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190/action" status: 202 len: 0 microversion: 2.1 time: 0.465599 Oct 18 16:45:13.073013 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3704/7428] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:45:12 2022] POST /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190/action => generated 0 bytes in 467 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:45:13.078557 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-55f5e2af-98f7-409d-b670-05ef5a928593 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:45:13.079293 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-55f5e2af-98f7-409d-b670-05ef5a928593 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:45:13.087036 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-55f5e2af-98f7-409d-b670-05ef5a928593 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:13.087472 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-55f5e2af-98f7-409d-b670-05ef5a928593 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:13.087932 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-55f5e2af-98f7-409d-b670-05ef5a928593 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:13.088650 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-55f5e2af-98f7-409d-b670-05ef5a928593 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:13.090040 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-55f5e2af-98f7-409d-b670-05ef5a928593 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:13.090160 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-55f5e2af-98f7-409d-b670-05ef5a928593 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:13.244869 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-55f5e2af-98f7-409d-b670-05ef5a928593 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:45:13.253517 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-55f5e2af-98f7-409d-b670-05ef5a928593 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190" status: 200 len: 1759 microversion: 2.1 time: 0.179088 Oct 18 16:45:13.254121 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3725/7429] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:45:13 2022] GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190 => generated 1759 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:45:13.562604 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-30eb6d17-db0d-462a-b017-e51f6746d007 req-a7855f11-4778-408c-8c56-ca9e9100e02b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190", "tag": "2fb7ba63-e77e-4dfb-b58f-20ab4242dbd2"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:45:13.572597 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-30eb6d17-db0d-462a-b017-e51f6746d007 req-a7855f11-4778-408c-8c56-ca9e9100e02b service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:13.573128 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-30eb6d17-db0d-462a-b017-e51f6746d007 req-a7855f11-4778-408c-8c56-ca9e9100e02b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:13.573572 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-30eb6d17-db0d-462a-b017-e51f6746d007 req-a7855f11-4778-408c-8c56-ca9e9100e02b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:13.586544 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-30eb6d17-db0d-462a-b017-e51f6746d007 req-a7855f11-4778-408c-8c56-ca9e9100e02b service nova] Creating event network-changed:2fb7ba63-e77e-4dfb-b58f-20ab4242dbd2 for instance e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190 on n-h2-853682-5 Oct 18 16:45:13.593966 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-30eb6d17-db0d-462a-b017-e51f6746d007 req-a7855f11-4778-408c-8c56-ca9e9100e02b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034577 Oct 18 16:45:13.594262 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3705/7430] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:45:29.294686 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-23580d69-7b02-49db-95f6-972790345f2b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:45:29.296974 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-23580d69-7b02-49db-95f6-972790345f2b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:45:29.299826 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=4 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:45:29.300534 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=8 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:45:29.306358 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-23580d69-7b02-49db-95f6-972790345f2b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:29.306854 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-23580d69-7b02-49db-95f6-972790345f2b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:29.307309 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-23580d69-7b02-49db-95f6-972790345f2b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:29.308028 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-23580d69-7b02-49db-95f6-972790345f2b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:29.308497 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-23580d69-7b02-49db-95f6-972790345f2b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:29.308962 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-23580d69-7b02-49db-95f6-972790345f2b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:29.381626 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-23580d69-7b02-49db-95f6-972790345f2b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "POST /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190/action" status: 202 len: 0 microversion: 2.1 time: 0.091287 Oct 18 16:45:29.382292 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3726/7431] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:45:29 2022] POST /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:45:29.390538 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:45:29.391284 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=12 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:45:29.395784 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a7aa6e37-6901-44bf-9e68-c5a4199c17f9 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:45:29.396501 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a7aa6e37-6901-44bf-9e68-c5a4199c17f9 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:45:29.405056 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7aa6e37-6901-44bf-9e68-c5a4199c17f9 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:29.405550 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7aa6e37-6901-44bf-9e68-c5a4199c17f9 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:29.405990 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7aa6e37-6901-44bf-9e68-c5a4199c17f9 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:29.406690 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7aa6e37-6901-44bf-9e68-c5a4199c17f9 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:29.407150 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7aa6e37-6901-44bf-9e68-c5a4199c17f9 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:29.407577 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7aa6e37-6901-44bf-9e68-c5a4199c17f9 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:29.562322 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a7aa6e37-6901-44bf-9e68-c5a4199c17f9 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:45:29.570709 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a7aa6e37-6901-44bf-9e68-c5a4199c17f9 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190" status: 200 len: 1751 microversion: 2.1 time: 0.182640 Oct 18 16:45:29.571297 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3706/7432] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:45:29 2022] GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190 => generated 1751 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:45:30.596059 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-215d2565-d059-4bdd-ac39-4861dfcb365f tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:45:30.596781 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-215d2565-d059-4bdd-ac39-4861dfcb365f tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:45:30.603186 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-215d2565-d059-4bdd-ac39-4861dfcb365f tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:30.603728 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-215d2565-d059-4bdd-ac39-4861dfcb365f tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:30.604182 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-215d2565-d059-4bdd-ac39-4861dfcb365f tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:30.604964 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-215d2565-d059-4bdd-ac39-4861dfcb365f tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:30.605473 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-215d2565-d059-4bdd-ac39-4861dfcb365f tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:30.605916 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-215d2565-d059-4bdd-ac39-4861dfcb365f tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:30.751924 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-215d2565-d059-4bdd-ac39-4861dfcb365f tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:45:30.760170 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-215d2565-d059-4bdd-ac39-4861dfcb365f tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190" status: 200 len: 1756 microversion: 2.1 time: 0.169294 Oct 18 16:45:30.760742 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3727/7433] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:45:30 2022] GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:45:31.784024 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8c76804a-707a-43ee-b0d6-5f727c14f831 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:45:31.784926 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8c76804a-707a-43ee-b0d6-5f727c14f831 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:45:31.791845 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c76804a-707a-43ee-b0d6-5f727c14f831 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:31.792336 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c76804a-707a-43ee-b0d6-5f727c14f831 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:31.792779 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c76804a-707a-43ee-b0d6-5f727c14f831 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:31.793502 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c76804a-707a-43ee-b0d6-5f727c14f831 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:31.794723 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c76804a-707a-43ee-b0d6-5f727c14f831 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:31.795164 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c76804a-707a-43ee-b0d6-5f727c14f831 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:31.940599 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8c76804a-707a-43ee-b0d6-5f727c14f831 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:45:31.949568 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8c76804a-707a-43ee-b0d6-5f727c14f831 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190" status: 200 len: 1756 microversion: 2.1 time: 0.169482 Oct 18 16:45:31.950146 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3707/7434] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:45:31 2022] GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:45:32.973323 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-48b08bc7-8576-44b8-974f-adc4f801d103 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:45:32.973868 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-48b08bc7-8576-44b8-974f-adc4f801d103 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:45:32.980723 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-48b08bc7-8576-44b8-974f-adc4f801d103 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:32.981261 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-48b08bc7-8576-44b8-974f-adc4f801d103 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:32.981774 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-48b08bc7-8576-44b8-974f-adc4f801d103 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:32.982482 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-48b08bc7-8576-44b8-974f-adc4f801d103 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:32.982951 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-48b08bc7-8576-44b8-974f-adc4f801d103 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:32.983392 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-48b08bc7-8576-44b8-974f-adc4f801d103 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:33.126277 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-48b08bc7-8576-44b8-974f-adc4f801d103 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:45:33.134822 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-48b08bc7-8576-44b8-974f-adc4f801d103 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190" status: 200 len: 1756 microversion: 2.1 time: 0.165570 Oct 18 16:45:33.135400 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3728/7435] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:45:32 2022] GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:45:34.158108 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e72cdfcc-b382-41ea-8e3f-a7104dcae6c0 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:45:34.158720 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e72cdfcc-b382-41ea-8e3f-a7104dcae6c0 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:45:34.166038 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e72cdfcc-b382-41ea-8e3f-a7104dcae6c0 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:34.166530 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e72cdfcc-b382-41ea-8e3f-a7104dcae6c0 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:34.166977 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e72cdfcc-b382-41ea-8e3f-a7104dcae6c0 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:34.167677 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e72cdfcc-b382-41ea-8e3f-a7104dcae6c0 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:34.168141 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e72cdfcc-b382-41ea-8e3f-a7104dcae6c0 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:34.168574 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e72cdfcc-b382-41ea-8e3f-a7104dcae6c0 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:34.310194 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e72cdfcc-b382-41ea-8e3f-a7104dcae6c0 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:45:34.318510 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e72cdfcc-b382-41ea-8e3f-a7104dcae6c0 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190" status: 200 len: 1756 microversion: 2.1 time: 0.164316 Oct 18 16:45:34.319090 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3708/7436] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:45:34 2022] GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:45:35.342671 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-09b618f8-69d6-4578-8f0a-aa8e6d9797b4 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:45:35.343262 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-09b618f8-69d6-4578-8f0a-aa8e6d9797b4 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:45:35.350233 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09b618f8-69d6-4578-8f0a-aa8e6d9797b4 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:35.350742 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09b618f8-69d6-4578-8f0a-aa8e6d9797b4 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:35.351204 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09b618f8-69d6-4578-8f0a-aa8e6d9797b4 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:35.351931 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09b618f8-69d6-4578-8f0a-aa8e6d9797b4 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:35.352439 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09b618f8-69d6-4578-8f0a-aa8e6d9797b4 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:35.352928 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09b618f8-69d6-4578-8f0a-aa8e6d9797b4 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:35.501632 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-09b618f8-69d6-4578-8f0a-aa8e6d9797b4 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:45:35.510122 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-09b618f8-69d6-4578-8f0a-aa8e6d9797b4 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190" status: 200 len: 1756 microversion: 2.1 time: 0.171502 Oct 18 16:45:35.510711 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3729/7437] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:45:35 2022] GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:45:36.532560 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3171f5da-191e-40aa-846a-724e469d2d3c tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:45:36.533938 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3171f5da-191e-40aa-846a-724e469d2d3c tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:45:36.541834 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3171f5da-191e-40aa-846a-724e469d2d3c tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:36.542328 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3171f5da-191e-40aa-846a-724e469d2d3c tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:36.542774 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3171f5da-191e-40aa-846a-724e469d2d3c tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:36.543475 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3171f5da-191e-40aa-846a-724e469d2d3c tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:36.543939 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3171f5da-191e-40aa-846a-724e469d2d3c tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:36.544371 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3171f5da-191e-40aa-846a-724e469d2d3c tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:36.690325 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3171f5da-191e-40aa-846a-724e469d2d3c tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:45:36.699034 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3171f5da-191e-40aa-846a-724e469d2d3c tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190" status: 200 len: 1756 microversion: 2.1 time: 0.170447 Oct 18 16:45:36.699607 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3709/7438] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:45:36 2022] GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:45:37.722890 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3bdb4932-aeb4-4906-8dda-112e01659b4d tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:45:37.723526 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3bdb4932-aeb4-4906-8dda-112e01659b4d tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:45:37.730484 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3bdb4932-aeb4-4906-8dda-112e01659b4d tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:37.730985 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3bdb4932-aeb4-4906-8dda-112e01659b4d tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:37.731638 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3bdb4932-aeb4-4906-8dda-112e01659b4d tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:37.732356 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3bdb4932-aeb4-4906-8dda-112e01659b4d tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:37.732845 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3bdb4932-aeb4-4906-8dda-112e01659b4d tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:37.733294 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3bdb4932-aeb4-4906-8dda-112e01659b4d tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:37.877970 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3bdb4932-aeb4-4906-8dda-112e01659b4d tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:45:37.886493 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3bdb4932-aeb4-4906-8dda-112e01659b4d tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190" status: 200 len: 1756 microversion: 2.1 time: 0.167524 Oct 18 16:45:37.887071 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3730/7439] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:45:37 2022] GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:45:38.910901 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-983806e5-a4bc-4b18-afbb-fbb2bfcb6f70 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:45:38.911520 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-983806e5-a4bc-4b18-afbb-fbb2bfcb6f70 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:45:38.918339 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-983806e5-a4bc-4b18-afbb-fbb2bfcb6f70 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:38.918823 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-983806e5-a4bc-4b18-afbb-fbb2bfcb6f70 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:38.919264 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-983806e5-a4bc-4b18-afbb-fbb2bfcb6f70 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:38.919954 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-983806e5-a4bc-4b18-afbb-fbb2bfcb6f70 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:38.920950 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-983806e5-a4bc-4b18-afbb-fbb2bfcb6f70 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:38.921379 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-983806e5-a4bc-4b18-afbb-fbb2bfcb6f70 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:39.065147 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-983806e5-a4bc-4b18-afbb-fbb2bfcb6f70 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:45:39.073431 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-983806e5-a4bc-4b18-afbb-fbb2bfcb6f70 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190" status: 200 len: 1756 microversion: 2.1 time: 0.166750 Oct 18 16:45:39.074008 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3710/7440] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:45:38 2022] GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:45:40.096726 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1846c640-eca9-4b3a-95c9-ae1fc76bc449 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:45:40.097419 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1846c640-eca9-4b3a-95c9-ae1fc76bc449 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:45:40.104582 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1846c640-eca9-4b3a-95c9-ae1fc76bc449 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:40.105121 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1846c640-eca9-4b3a-95c9-ae1fc76bc449 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:40.105581 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1846c640-eca9-4b3a-95c9-ae1fc76bc449 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:40.106293 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1846c640-eca9-4b3a-95c9-ae1fc76bc449 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:40.106768 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1846c640-eca9-4b3a-95c9-ae1fc76bc449 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:40.107212 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1846c640-eca9-4b3a-95c9-ae1fc76bc449 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:40.254839 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1846c640-eca9-4b3a-95c9-ae1fc76bc449 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:45:40.263244 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1846c640-eca9-4b3a-95c9-ae1fc76bc449 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190" status: 200 len: 1756 microversion: 2.1 time: 0.170442 Oct 18 16:45:40.263967 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3731/7441] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:45:40 2022] GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:45:41.287972 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c1a3a145-1865-4eab-8c62-1570722e6a4a tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:45:41.288575 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c1a3a145-1865-4eab-8c62-1570722e6a4a tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:45:41.295253 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1a3a145-1865-4eab-8c62-1570722e6a4a tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:41.295779 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1a3a145-1865-4eab-8c62-1570722e6a4a tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:41.296216 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1a3a145-1865-4eab-8c62-1570722e6a4a tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:41.296935 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1a3a145-1865-4eab-8c62-1570722e6a4a tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:45:41.297419 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1a3a145-1865-4eab-8c62-1570722e6a4a tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:45:41.297845 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1a3a145-1865-4eab-8c62-1570722e6a4a tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:45:41.443507 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c1a3a145-1865-4eab-8c62-1570722e6a4a tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:45:41.451859 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c1a3a145-1865-4eab-8c62-1570722e6a4a tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190" status: 200 len: 1759 microversion: 2.1 time: 0.168199 Oct 18 16:45:41.452978 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3711/7442] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:45:41 2022] GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190 => generated 1759 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:13.660163 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a935e4ab-7953-452c-afd6-7536825a60f3 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1830011152"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:46:13.660858 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a935e4ab-7953-452c-afd6-7536825a60f3 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:13.663082 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=12 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:46:13.664196 n-d-853682-5 devstack@n-api.service[120405]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 16:46:13.664196 n-d-853682-5 devstack@n-api.service[120405]: Tue Oct 18 16:46:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190/action (ip 10.222.0.60) !!! Oct 18 16:46:13.666629 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:46:13.678494 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a935e4ab-7953-452c-afd6-7536825a60f3 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:13.679002 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a935e4ab-7953-452c-afd6-7536825a60f3 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:13.679464 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a935e4ab-7953-452c-afd6-7536825a60f3 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:13.680192 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a935e4ab-7953-452c-afd6-7536825a60f3 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:13.680674 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a935e4ab-7953-452c-afd6-7536825a60f3 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:13.681655 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a935e4ab-7953-452c-afd6-7536825a60f3 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:13.811989 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.network.security_group_api [None req-a935e4ab-7953-452c-afd6-7536825a60f3 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Removing security group 75ffc50d-d52b-491e-892a-621df1db6b5d from port 2fb7ba63-e77e-4dfb-b58f-20ab4242dbd2 Oct 18 16:46:14.120530 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a935e4ab-7953-452c-afd6-7536825a60f3 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "POST /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190/action" status: 202 len: 0 microversion: 2.1 time: 0.464743 Oct 18 16:46:14.124459 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3732/7443] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:46:13 2022] POST /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190/action => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:46:14.130480 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-98254a9b-5192-40bc-b2ca-faaa784fdba3 req-97dedf5b-650f-4af2-be23-419ddf4942c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190", "tag": "2fb7ba63-e77e-4dfb-b58f-20ab4242dbd2"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:46:14.151548 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=12 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:46:14.152613 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=36 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:46:14.157454 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-98254a9b-5192-40bc-b2ca-faaa784fdba3 req-97dedf5b-650f-4af2-be23-419ddf4942c5 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:14.158292 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-98254a9b-5192-40bc-b2ca-faaa784fdba3 req-97dedf5b-650f-4af2-be23-419ddf4942c5 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:14.158980 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-98254a9b-5192-40bc-b2ca-faaa784fdba3 req-97dedf5b-650f-4af2-be23-419ddf4942c5 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:14.173700 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-98254a9b-5192-40bc-b2ca-faaa784fdba3 req-97dedf5b-650f-4af2-be23-419ddf4942c5 service nova] Creating event network-changed:2fb7ba63-e77e-4dfb-b58f-20ab4242dbd2 for instance e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190 on n-h2-853682-5 Oct 18 16:46:14.179633 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-98254a9b-5192-40bc-b2ca-faaa784fdba3 req-97dedf5b-650f-4af2-be23-419ddf4942c5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054501 Oct 18 16:46:14.180993 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3712/7444] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:46:15.298110 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-23906cb2-a254-4a4c-8aa6-d56f58b46435 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:15.299248 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-23906cb2-a254-4a4c-8aa6-d56f58b46435 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:15.308417 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-23906cb2-a254-4a4c-8aa6-d56f58b46435 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:15.309024 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-23906cb2-a254-4a4c-8aa6-d56f58b46435 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:15.309457 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-23906cb2-a254-4a4c-8aa6-d56f58b46435 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:15.310484 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-23906cb2-a254-4a4c-8aa6-d56f58b46435 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:15.311074 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-23906cb2-a254-4a4c-8aa6-d56f58b46435 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:15.311709 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-23906cb2-a254-4a4c-8aa6-d56f58b46435 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:15.395539 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-23906cb2-a254-4a4c-8aa6-d56f58b46435 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lazy-loading 'services' on Instance uuid e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:46:15.467998 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-23906cb2-a254-4a4c-8aa6-d56f58b46435 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190/os-volume_attachments/f57ce16e-7c02-4de2-8ed4-b065c268b40d" status: 202 len: 0 microversion: 2.1 time: 0.173962 Oct 18 16:46:15.469186 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3733/7445] 10.222.0.60 () {58 vars in 1416 bytes} [Tue Oct 18 16:46:15 2022] DELETE /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190/os-volume_attachments/f57ce16e-7c02-4de2-8ed4-b065c268b40d => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 16:46:15.478638 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2741bf7b-7fdd-4c04-8021-907165ceac6b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:15.481160 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2741bf7b-7fdd-4c04-8021-907165ceac6b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:15.489619 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2741bf7b-7fdd-4c04-8021-907165ceac6b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:15.490437 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2741bf7b-7fdd-4c04-8021-907165ceac6b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:15.490872 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2741bf7b-7fdd-4c04-8021-907165ceac6b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:15.491572 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2741bf7b-7fdd-4c04-8021-907165ceac6b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:15.492032 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2741bf7b-7fdd-4c04-8021-907165ceac6b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:15.492607 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2741bf7b-7fdd-4c04-8021-907165ceac6b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:15.525749 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2741bf7b-7fdd-4c04-8021-907165ceac6b tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051498 Oct 18 16:46:15.526172 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3713/7446] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 16:46:15 2022] GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:46:16.200483 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-5f2669c3-fe2e-42d5-a3d5-50c0d634dc77 req-58de4493-1ac4-40f9-b834-e6d956cb588d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190", "tag": "2fb7ba63-e77e-4dfb-b58f-20ab4242dbd2"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:46:16.212012 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-5f2669c3-fe2e-42d5-a3d5-50c0d634dc77 req-58de4493-1ac4-40f9-b834-e6d956cb588d service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:16.213650 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-5f2669c3-fe2e-42d5-a3d5-50c0d634dc77 req-58de4493-1ac4-40f9-b834-e6d956cb588d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:16.214106 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-5f2669c3-fe2e-42d5-a3d5-50c0d634dc77 req-58de4493-1ac4-40f9-b834-e6d956cb588d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:16.226006 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-5f2669c3-fe2e-42d5-a3d5-50c0d634dc77 req-58de4493-1ac4-40f9-b834-e6d956cb588d service nova] Creating event network-changed:2fb7ba63-e77e-4dfb-b58f-20ab4242dbd2 for instance e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190 on n-h2-853682-5 Oct 18 16:46:16.232053 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-5f2669c3-fe2e-42d5-a3d5-50c0d634dc77 req-58de4493-1ac4-40f9-b834-e6d956cb588d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036689 Oct 18 16:46:16.237765 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3734/7447] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:46:16.539959 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f858bb51-1d4d-47c1-907c-e40be7ed03f0 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:16.545910 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f858bb51-1d4d-47c1-907c-e40be7ed03f0 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:16.554356 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f858bb51-1d4d-47c1-907c-e40be7ed03f0 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:16.555173 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f858bb51-1d4d-47c1-907c-e40be7ed03f0 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:16.555800 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f858bb51-1d4d-47c1-907c-e40be7ed03f0 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:16.556681 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f858bb51-1d4d-47c1-907c-e40be7ed03f0 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:16.557316 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f858bb51-1d4d-47c1-907c-e40be7ed03f0 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:16.557895 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f858bb51-1d4d-47c1-907c-e40be7ed03f0 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:16.593378 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f858bb51-1d4d-47c1-907c-e40be7ed03f0 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058554 Oct 18 16:46:16.594568 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3714/7448] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 16:46:16 2022] GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:46:17.608110 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ca479f52-d9ab-41f7-b40e-899cf93d1936 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:17.610444 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ca479f52-d9ab-41f7-b40e-899cf93d1936 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:17.616763 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca479f52-d9ab-41f7-b40e-899cf93d1936 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:17.617297 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca479f52-d9ab-41f7-b40e-899cf93d1936 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:17.617752 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca479f52-d9ab-41f7-b40e-899cf93d1936 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:17.619008 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca479f52-d9ab-41f7-b40e-899cf93d1936 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:17.619492 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca479f52-d9ab-41f7-b40e-899cf93d1936 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:17.619935 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ca479f52-d9ab-41f7-b40e-899cf93d1936 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:17.649930 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ca479f52-d9ab-41f7-b40e-899cf93d1936 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047508 Oct 18 16:46:17.650501 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3735/7449] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 16:46:17 2022] GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:46:18.662958 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-02611021-d487-4b56-a679-a21b2950366c tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:18.665049 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-02611021-d487-4b56-a679-a21b2950366c tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:18.671921 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02611021-d487-4b56-a679-a21b2950366c tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:18.672404 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02611021-d487-4b56-a679-a21b2950366c tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:18.672857 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02611021-d487-4b56-a679-a21b2950366c tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:18.673552 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02611021-d487-4b56-a679-a21b2950366c tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:18.673999 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02611021-d487-4b56-a679-a21b2950366c tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:18.674417 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02611021-d487-4b56-a679-a21b2950366c tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:18.706481 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-02611021-d487-4b56-a679-a21b2950366c tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047867 Oct 18 16:46:18.707047 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3715/7450] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 16:46:18 2022] GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:46:19.720277 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-88b7a774-2ad2-4e1a-8202-bb5239951ed4 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:19.722524 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-88b7a774-2ad2-4e1a-8202-bb5239951ed4 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:19.729975 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-88b7a774-2ad2-4e1a-8202-bb5239951ed4 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:19.730459 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-88b7a774-2ad2-4e1a-8202-bb5239951ed4 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:19.730915 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-88b7a774-2ad2-4e1a-8202-bb5239951ed4 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:19.731635 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-88b7a774-2ad2-4e1a-8202-bb5239951ed4 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:19.732110 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-88b7a774-2ad2-4e1a-8202-bb5239951ed4 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:19.732561 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-88b7a774-2ad2-4e1a-8202-bb5239951ed4 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:19.764914 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-88b7a774-2ad2-4e1a-8202-bb5239951ed4 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049196 Oct 18 16:46:19.765496 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3736/7451] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 16:46:19 2022] GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:46:20.778312 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f98d6b03-0301-45a8-885f-ece794e91e8c tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:20.781444 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f98d6b03-0301-45a8-885f-ece794e91e8c tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:20.788193 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f98d6b03-0301-45a8-885f-ece794e91e8c tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:20.788682 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f98d6b03-0301-45a8-885f-ece794e91e8c tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:20.789164 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f98d6b03-0301-45a8-885f-ece794e91e8c tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:20.789865 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f98d6b03-0301-45a8-885f-ece794e91e8c tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:20.790323 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f98d6b03-0301-45a8-885f-ece794e91e8c tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:20.791683 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f98d6b03-0301-45a8-885f-ece794e91e8c tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:20.822417 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f98d6b03-0301-45a8-885f-ece794e91e8c tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048612 Oct 18 16:46:20.823355 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3716/7452] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Oct 18 16:46:20 2022] GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 16:46:20.834073 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ad8e11b9-3115-4dc8-afee-584c72373bc2 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:20.834654 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ad8e11b9-3115-4dc8-afee-584c72373bc2 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:20.842193 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ad8e11b9-3115-4dc8-afee-584c72373bc2 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:20.842694 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ad8e11b9-3115-4dc8-afee-584c72373bc2 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:20.843146 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ad8e11b9-3115-4dc8-afee-584c72373bc2 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:20.843867 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ad8e11b9-3115-4dc8-afee-584c72373bc2 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:20.844337 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ad8e11b9-3115-4dc8-afee-584c72373bc2 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:20.844779 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ad8e11b9-3115-4dc8-afee-584c72373bc2 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:20.920664 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-ad8e11b9-3115-4dc8-afee-584c72373bc2 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] HTTP exception thrown: Instance e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190 is not attached to volume f57ce16e-7c02-4de2-8ed4-b065c268b40d Oct 18 16:46:20.922541 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ad8e11b9-3115-4dc8-afee-584c72373bc2 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Request method failure captured: Oct 18 16:46:20.922541 n-d-853682-5 devstack@n-api.service[120405]: request: DELETE /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190/os-volume_attachments/f57ce16e-7c02-4de2-8ed4-b065c268b40d HTTP/1.1 Oct 18 16:46:20.922541 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 16:46:20.922541 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 16:46:20.922541 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 16:46:20.922541 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 16:46:20.922541 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 16:46:20.922541 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 16:46:20.922541 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 16:46:20.922541 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 16:46:20.922541 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTtaykhYn-swRLezoa7d8EvOJJocRNjKMO-Mu12tpmOPVRCOSy7XCrk2rooXoZjup35kmjoCOsDQ_t0tLttf3uTV7dCjX-t0g_QYLxLGahmFYhlRM8jf-oIzesBrtJWVGuXeu_5uBOrM4EQOe0Xx5aM0u--9lqm68dwtt7ZshTGobOzE Oct 18 16:46:20.922541 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 16:46:20.922541 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 16:46:20.922541 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 16:46:20.922541 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 16:46:20.922541 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 16:46:20.922541 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 16:46:20.922541 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 72e1244a01b5401d8f3363ae5d9f323b Oct 18 16:46:20.922541 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-TestMinimumBasicScenario-1767880555 Oct 18 16:46:20.922541 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 16:46:20.922541 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 16:46:20.922541 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/72e1244a01b5401d8f3363ae5d9f323b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/72e1244a01b5401d8f3363ae5d9f323b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/72e1244a01b5401d8f3363ae5d9f323b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_72e1244a01b5401d8f3363ae5d9f323b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:46:20.922541 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-TestMinimumBasicScenario-1767880555 Oct 18 16:46:20.922541 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 72e1244a01b5401d8f3363ae5d9f323b Oct 18 16:46:20.922541 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1767880555 Oct 18 16:46:20.922541 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-TestMinimumBasicScenario-1767880555-project Oct 18 16:46:20.922541 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 16:46:20.922541 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 16:46:20.922541 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: cfffffbceb1c4f7685958bcc1f62596a Oct 18 16:46:20.922541 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-TestMinimumBasicScenario-1767880555-project Oct 18 16:46:20.922541 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 16:46:20.922541 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190 is not attached to volume f57ce16e-7c02-4de2-8ed4-b065c268b40d Oct 18 16:46:20.922541 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'server_id': 'e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190', 'id': 'f57ce16e-7c02-4de2-8ed4-b065c268b40d'} Oct 18 16:46:20.922541 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:46:20.922541 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:46:20.922541 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 18 16:46:20.922541 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 18 16:46:20.922541 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 16:46:20.922541 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 16:46:20.922541 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 18 16:46:20.922541 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 18 16:46:20.922541 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f57ce16e-7c02-4de2-8ed4-b065c268b40d. Oct 18 16:46:20.922541 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:46:20.922541 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:46:20.922541 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:46:20.922541 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:46:20.922541 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:46:20.922541 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:46:20.922541 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:46:20.922541 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:46:20.922541 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:46:20.922541 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:46:20.922541 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 18 16:46:20.922541 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 18 16:46:20.922541 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190 is not attached to volume f57ce16e-7c02-4de2-8ed4-b065c268b40d Oct 18 16:46:20.922541 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:46:20.922541 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:46:20.922541 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:46:20.922541 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:46:20.922541 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:46:20.922541 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:46:20.927251 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:46:20.927251 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:46:20.927251 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190 is not attached to volume f57ce16e-7c02-4de2-8ed4-b065c268b40d Oct 18 16:46:20.927251 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:46:20.927251 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ad8e11b9-3115-4dc8-afee-584c72373bc2 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Returning 404 to user: Instance e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190 is not attached to volume f57ce16e-7c02-4de2-8ed4-b065c268b40d {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:46:20.927251 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ad8e11b9-3115-4dc8-afee-584c72373bc2 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190/os-volume_attachments/f57ce16e-7c02-4de2-8ed4-b065c268b40d" status: 404 len: 154 microversion: 2.1 time: 0.094227 Oct 18 16:46:20.927251 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3737/7453] 10.222.0.60 () {58 vars in 1416 bytes} [Tue Oct 18 16:46:20 2022] DELETE /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190/os-volume_attachments/f57ce16e-7c02-4de2-8ed4-b065c268b40d => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:46:24.188261 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-29ef573b-77f8-40a1-92a4-f34a5cd6b5b2 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:24.188762 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-29ef573b-77f8-40a1-92a4-f34a5cd6b5b2 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:24.195723 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29ef573b-77f8-40a1-92a4-f34a5cd6b5b2 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:24.196213 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29ef573b-77f8-40a1-92a4-f34a5cd6b5b2 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:24.196654 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29ef573b-77f8-40a1-92a4-f34a5cd6b5b2 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:24.197982 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29ef573b-77f8-40a1-92a4-f34a5cd6b5b2 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:24.198443 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29ef573b-77f8-40a1-92a4-f34a5cd6b5b2 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:24.198872 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29ef573b-77f8-40a1-92a4-f34a5cd6b5b2 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:24.224589 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-29ef573b-77f8-40a1-92a4-f34a5cd6b5b2 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:46:24.308339 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-29ef573b-77f8-40a1-92a4-f34a5cd6b5b2 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190" status: 204 len: 0 microversion: 2.1 time: 0.123732 Oct 18 16:46:24.312460 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3717/7454] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 16:46:24 2022] DELETE /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:46:24.318505 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bb2876f8-e566-4a3b-b382-1541d0c09fd5 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:24.319135 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-bb2876f8-e566-4a3b-b382-1541d0c09fd5 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:24.327840 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bb2876f8-e566-4a3b-b382-1541d0c09fd5 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:24.328559 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bb2876f8-e566-4a3b-b382-1541d0c09fd5 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:24.328777 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bb2876f8-e566-4a3b-b382-1541d0c09fd5 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:24.329518 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bb2876f8-e566-4a3b-b382-1541d0c09fd5 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:24.329985 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bb2876f8-e566-4a3b-b382-1541d0c09fd5 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:24.330419 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bb2876f8-e566-4a3b-b382-1541d0c09fd5 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:24.476306 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-bb2876f8-e566-4a3b-b382-1541d0c09fd5 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:24.484613 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-bb2876f8-e566-4a3b-b382-1541d0c09fd5 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190" status: 200 len: 1553 microversion: 2.1 time: 0.170019 Oct 18 16:46:24.485449 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3738/7455] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:24 2022] GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190 => generated 1553 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:25.508204 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7aa8e839-b311-4f40-b68b-febd6130ebc1 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:25.509040 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7aa8e839-b311-4f40-b68b-febd6130ebc1 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:25.517090 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7aa8e839-b311-4f40-b68b-febd6130ebc1 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:25.517585 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7aa8e839-b311-4f40-b68b-febd6130ebc1 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:25.518032 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7aa8e839-b311-4f40-b68b-febd6130ebc1 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:25.518728 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7aa8e839-b311-4f40-b68b-febd6130ebc1 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:25.519183 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7aa8e839-b311-4f40-b68b-febd6130ebc1 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:25.519610 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7aa8e839-b311-4f40-b68b-febd6130ebc1 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:25.647687 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7aa8e839-b311-4f40-b68b-febd6130ebc1 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:25.656911 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7aa8e839-b311-4f40-b68b-febd6130ebc1 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190" status: 200 len: 1553 microversion: 2.1 time: 0.152995 Oct 18 16:46:25.657497 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3718/7456] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:25 2022] GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190 => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:26.427615 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-2a01fb9f-e19e-4273-b85f-59e53ef7bb74 req-f0476f1a-5cc1-40ce-bf74-c05a64a1d195 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190", "name": "network-vif-deleted", "tag": "2fb7ba63-e77e-4dfb-b58f-20ab4242dbd2"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:46:26.439938 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-2a01fb9f-e19e-4273-b85f-59e53ef7bb74 req-f0476f1a-5cc1-40ce-bf74-c05a64a1d195 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:26.440684 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-2a01fb9f-e19e-4273-b85f-59e53ef7bb74 req-f0476f1a-5cc1-40ce-bf74-c05a64a1d195 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:26.441346 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-2a01fb9f-e19e-4273-b85f-59e53ef7bb74 req-f0476f1a-5cc1-40ce-bf74-c05a64a1d195 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:26.453802 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-2a01fb9f-e19e-4273-b85f-59e53ef7bb74 req-f0476f1a-5cc1-40ce-bf74-c05a64a1d195 service nova] Creating event network-vif-deleted:2fb7ba63-e77e-4dfb-b58f-20ab4242dbd2 for instance e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190 on n-h2-853682-5 Oct 18 16:46:26.458799 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-2a01fb9f-e19e-4273-b85f-59e53ef7bb74 req-f0476f1a-5cc1-40ce-bf74-c05a64a1d195 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034983 Oct 18 16:46:26.459411 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3739/7457] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:46:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:46:26.679715 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ba206538-7651-4773-9a2e-f200fdec0b65 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:26.680292 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ba206538-7651-4773-9a2e-f200fdec0b65 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:26.687940 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba206538-7651-4773-9a2e-f200fdec0b65 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:26.689357 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba206538-7651-4773-9a2e-f200fdec0b65 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:26.689955 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba206538-7651-4773-9a2e-f200fdec0b65 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:26.690581 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba206538-7651-4773-9a2e-f200fdec0b65 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:26.691043 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba206538-7651-4773-9a2e-f200fdec0b65 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:26.691522 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba206538-7651-4773-9a2e-f200fdec0b65 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:26.724965 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba206538-7651-4773-9a2e-f200fdec0b65 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:26.725457 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba206538-7651-4773-9a2e-f200fdec0b65 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:26.725898 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba206538-7651-4773-9a2e-f200fdec0b65 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:26.726355 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-ba206538-7651-4773-9a2e-f200fdec0b65 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lazy-loading 'fault' on Instance uuid e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:46:26.769368 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ba206538-7651-4773-9a2e-f200fdec0b65 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfffffbceb1c4f7685958bcc1f62596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1244a01b5401d8f3363ae5d9f323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:26.778812 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ba206538-7651-4773-9a2e-f200fdec0b65 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190" status: 200 len: 1347 microversion: 2.1 time: 0.102715 Oct 18 16:46:26.779758 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3719/7458] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:26 2022] GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190 => generated 1347 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:27.804985 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-71314d6d-592e-4c66-8dc9-12234631cfad tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:27.805744 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-71314d6d-592e-4c66-8dc9-12234631cfad tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] [instance: e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:27.812604 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-71314d6d-592e-4c66-8dc9-12234631cfad tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:27.813133 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-71314d6d-592e-4c66-8dc9-12234631cfad tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:27.813581 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-71314d6d-592e-4c66-8dc9-12234631cfad tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:27.814279 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-71314d6d-592e-4c66-8dc9-12234631cfad tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:27.814742 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-71314d6d-592e-4c66-8dc9-12234631cfad tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:27.815176 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-71314d6d-592e-4c66-8dc9-12234631cfad tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:27.828343 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-71314d6d-592e-4c66-8dc9-12234631cfad tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] HTTP exception thrown: Instance e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190 could not be found. Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-71314d6d-592e-4c66-8dc9-12234631cfad tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Request method failure captured: Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190 HTTP/1.1 Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTtaykhYn-swRLezoa7d8EvOJJocRNjKMO-Mu12tpmOPVRCOSy7XCrk2rooXoZjup35kmjoCOsDQ_t0tLttf3uTV7dCjX-t0g_QYLxLGahmFYhlRM8jf-oIzesBrtJWVGuXeu_5uBOrM4EQOe0Xx5aM0u--9lqm68dwtt7ZshTGobOzE Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 72e1244a01b5401d8f3363ae5d9f323b Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-TestMinimumBasicScenario-1767880555 Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/72e1244a01b5401d8f3363ae5d9f323b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/72e1244a01b5401d8f3363ae5d9f323b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/72e1244a01b5401d8f3363ae5d9f323b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_72e1244a01b5401d8f3363ae5d9f323b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-TestMinimumBasicScenario-1767880555 Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 72e1244a01b5401d8f3363ae5d9f323b Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1767880555 Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-TestMinimumBasicScenario-1767880555-project Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: cfffffbceb1c4f7685958bcc1f62596a Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-TestMinimumBasicScenario-1767880555-project Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190 could not be found. Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190'} Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190 could not be found. Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190 could not be found. Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:46:27.829978 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:46:27.835036 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:46:27.835036 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:46:27.835036 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:46:27.835036 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:46:27.835036 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:46:27.835036 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190 could not be found. Oct 18 16:46:27.835036 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:46:27.835036 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-71314d6d-592e-4c66-8dc9-12234631cfad tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Returning 404 to user: Instance e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:46:27.835036 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-71314d6d-592e-4c66-8dc9-12234631cfad tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190" status: 404 len: 111 microversion: 2.1 time: 0.031541 Oct 18 16:46:27.835036 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3740/7459] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:27 2022] GET /compute/v2.1/servers/e6f9349e-c50f-4aa9-b86e-0f9d7cb1f190 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:46:27.840393 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-26cdd5c8-115f-44cd-ad9c-1792b0590e58 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] Calling method '.version_select at 0x7f7c37a015e0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:27.859521 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-26cdd5c8-115f-44cd-ad9c-1792b0590e58 tempest-TestMinimumBasicScenario-1767880555 tempest-TestMinimumBasicScenario-1767880555-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-658943967" status: 202 len: 0 microversion: 2.1 time: 0.022962 Oct 18 16:46:27.860100 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3720/7460] 10.222.0.60 () {58 vars in 1269 bytes} [Tue Oct 18 16:46:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-658943967 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 16:46:36.807475 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-828a0d10-8ca3-4ec8-9e8f-45cca19d2ac0 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Action: 'create', calling method: .version_select at 0x7f7c3c23eee0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1611655540", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2Tkzx07BCiYodLxX3LY1WfMy4sYFP1QHx3p7C2GMzGdW0jCRVcGJ+xJK1AcJ5DSDbRHth8tpcG2onFvgjG8il7uzcDEulQyoHD9QTvOR8InQHthhx8S4c2xbYlsxcNow=="}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:46:36.823690 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-828a0d10-8ca3-4ec8-9e8f-45cca19d2ac0 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Getting quotas for project f588c570d1c3475598357e7d21cd64f2. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:46:36.829953 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-828a0d10-8ca3-4ec8-9e8f-45cca19d2ac0 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Getting quotas for user a0040ae38b5542b9ac7d87de246e7108 and project f588c570d1c3475598357e7d21cd64f2. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:46:36.854018 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-828a0d10-8ca3-4ec8-9e8f-45cca19d2ac0 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.213706 Oct 18 16:46:36.854679 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3741/7461] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Oct 18 16:46:36 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:46:42.652797 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:46:42.653586 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:46:42.657826 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fa537092-1ad7-4938-9c80-1426f49fa081 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1157876374", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "1d862da9-b078-4c72-b395-062a9df07dba"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1611655540", "security_groups": [{"name": "tempest-secgroup-smoke-738448266"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:46:42.788167 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-fa537092-1ad7-4938-9c80-1426f49fa081 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] validate_networks() for [('1d862da9-b078-4c72-b395-062a9df07dba', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 16:46:43.467831 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-fa537092-1ad7-4938-9c80-1426f49fa081 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:46:43.468522 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-fa537092-1ad7-4938-9c80-1426f49fa081 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:46:43.469147 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-fa537092-1ad7-4938-9c80-1426f49fa081 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:46:43.469628 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-fa537092-1ad7-4938-9c80-1426f49fa081 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:46:43.470064 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-fa537092-1ad7-4938-9c80-1426f49fa081 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:46:43.479551 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fa537092-1ad7-4938-9c80-1426f49fa081 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:43.480076 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fa537092-1ad7-4938-9c80-1426f49fa081 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:43.481065 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fa537092-1ad7-4938-9c80-1426f49fa081 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:43.481815 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fa537092-1ad7-4938-9c80-1426f49fa081 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:43.482282 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fa537092-1ad7-4938-9c80-1426f49fa081 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:43.482716 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fa537092-1ad7-4938-9c80-1426f49fa081 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:43.502422 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-fa537092-1ad7-4938-9c80-1426f49fa081 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Getting quotas for project f588c570d1c3475598357e7d21cd64f2. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:46:43.507853 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-fa537092-1ad7-4938-9c80-1426f49fa081 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Getting quotas for user a0040ae38b5542b9ac7d87de246e7108 and project f588c570d1c3475598357e7d21cd64f2. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:46:43.520774 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fa537092-1ad7-4938-9c80-1426f49fa081 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:46:43.523144 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fa537092-1ad7-4938-9c80-1426f49fa081 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: c2862657-a4d7-4a27-97f1-fd056688eef3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:46:43.578240 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fa537092-1ad7-4938-9c80-1426f49fa081 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.927088 Oct 18 16:46:43.579104 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3721/7462] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 16:46:42 2022] POST /compute/v2.1/servers => generated 405 bytes in 929 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:46:43.588954 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:46:43.605027 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1e72f93d-7237-455b-b5ba-b8f28f552061 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:43.606269 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1e72f93d-7237-455b-b5ba-b8f28f552061 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: c2862657-a4d7-4a27-97f1-fd056688eef3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:43.665397 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1e72f93d-7237-455b-b5ba-b8f28f552061 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:43.673670 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1e72f93d-7237-455b-b5ba-b8f28f552061 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/c2862657-a4d7-4a27-97f1-fd056688eef3" status: 200 len: 1267 microversion: 2.1 time: 0.087455 Oct 18 16:46:43.674253 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3742/7463] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:43 2022] GET /compute/v2.1/servers/c2862657-a4d7-4a27-97f1-fd056688eef3 => generated 1267 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:44.707494 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-edd23bc7-140b-459c-9e3a-2f00f8eb4a23 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:44.708233 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-edd23bc7-140b-459c-9e3a-2f00f8eb4a23 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: c2862657-a4d7-4a27-97f1-fd056688eef3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:44.718401 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-edd23bc7-140b-459c-9e3a-2f00f8eb4a23 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:44.718893 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-edd23bc7-140b-459c-9e3a-2f00f8eb4a23 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:44.719329 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-edd23bc7-140b-459c-9e3a-2f00f8eb4a23 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:44.720542 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-edd23bc7-140b-459c-9e3a-2f00f8eb4a23 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:44.721033 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-edd23bc7-140b-459c-9e3a-2f00f8eb4a23 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:44.721508 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-edd23bc7-140b-459c-9e3a-2f00f8eb4a23 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:44.799606 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-edd23bc7-140b-459c-9e3a-2f00f8eb4a23 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:44.809276 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-edd23bc7-140b-459c-9e3a-2f00f8eb4a23 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/c2862657-a4d7-4a27-97f1-fd056688eef3" status: 200 len: 1319 microversion: 2.1 time: 0.115402 Oct 18 16:46:44.809869 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3722/7464] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:44 2022] GET /compute/v2.1/servers/c2862657-a4d7-4a27-97f1-fd056688eef3 => generated 1319 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:45.833448 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-66610e3b-7bef-4f4e-8842-2afb27cd5cf0 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:45.834087 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-66610e3b-7bef-4f4e-8842-2afb27cd5cf0 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: c2862657-a4d7-4a27-97f1-fd056688eef3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:45.837474 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:46:45.844365 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-66610e3b-7bef-4f4e-8842-2afb27cd5cf0 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:45.844898 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-66610e3b-7bef-4f4e-8842-2afb27cd5cf0 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:45.845585 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-66610e3b-7bef-4f4e-8842-2afb27cd5cf0 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:45.846376 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-66610e3b-7bef-4f4e-8842-2afb27cd5cf0 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:45.847398 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-66610e3b-7bef-4f4e-8842-2afb27cd5cf0 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:45.847853 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-66610e3b-7bef-4f4e-8842-2afb27cd5cf0 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:46.107446 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-66610e3b-7bef-4f4e-8842-2afb27cd5cf0 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:46.118442 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-66610e3b-7bef-4f4e-8842-2afb27cd5cf0 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/c2862657-a4d7-4a27-97f1-fd056688eef3" status: 200 len: 1392 microversion: 2.1 time: 0.288455 Oct 18 16:46:46.131352 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3743/7465] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:45 2022] GET /compute/v2.1/servers/c2862657-a4d7-4a27-97f1-fd056688eef3 => generated 1392 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:46.521262 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-279a1183-47bd-41c5-9b86-d276635e8e7b req-c4d9b770-3cf7-4f87-82ab-b8dccf34bd95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2862657-a4d7-4a27-97f1-fd056688eef3", "tag": "1efae357-5346-4bea-bd64-c2d33d4c0928"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:46:46.534169 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-279a1183-47bd-41c5-9b86-d276635e8e7b req-c4d9b770-3cf7-4f87-82ab-b8dccf34bd95 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:46.535884 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-279a1183-47bd-41c5-9b86-d276635e8e7b req-c4d9b770-3cf7-4f87-82ab-b8dccf34bd95 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:46.536560 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-279a1183-47bd-41c5-9b86-d276635e8e7b req-c4d9b770-3cf7-4f87-82ab-b8dccf34bd95 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:46.549463 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-279a1183-47bd-41c5-9b86-d276635e8e7b req-c4d9b770-3cf7-4f87-82ab-b8dccf34bd95 service nova] Creating event network-changed:1efae357-5346-4bea-bd64-c2d33d4c0928 for instance c2862657-a4d7-4a27-97f1-fd056688eef3 on n-h1-853682-5 Oct 18 16:46:46.554626 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-279a1183-47bd-41c5-9b86-d276635e8e7b req-c4d9b770-3cf7-4f87-82ab-b8dccf34bd95 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037099 Oct 18 16:46:46.555547 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3723/7466] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:46:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:46:47.142318 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d5a1b68f-7d3e-41bc-a942-b7e6d4d7cb80 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:47.142945 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d5a1b68f-7d3e-41bc-a942-b7e6d4d7cb80 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: c2862657-a4d7-4a27-97f1-fd056688eef3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:47.149933 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d5a1b68f-7d3e-41bc-a942-b7e6d4d7cb80 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:47.150448 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d5a1b68f-7d3e-41bc-a942-b7e6d4d7cb80 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:47.150896 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d5a1b68f-7d3e-41bc-a942-b7e6d4d7cb80 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:47.151622 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d5a1b68f-7d3e-41bc-a942-b7e6d4d7cb80 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:47.152600 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d5a1b68f-7d3e-41bc-a942-b7e6d4d7cb80 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:47.153062 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d5a1b68f-7d3e-41bc-a942-b7e6d4d7cb80 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:47.285585 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d5a1b68f-7d3e-41bc-a942-b7e6d4d7cb80 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:47.293457 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d5a1b68f-7d3e-41bc-a942-b7e6d4d7cb80 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/c2862657-a4d7-4a27-97f1-fd056688eef3" status: 200 len: 1392 microversion: 2.1 time: 0.155098 Oct 18 16:46:47.294033 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3744/7467] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:47 2022] GET /compute/v2.1/servers/c2862657-a4d7-4a27-97f1-fd056688eef3 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:48.317011 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-16db1290-93d5-4900-b0b5-3da234249a1c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:48.317748 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-16db1290-93d5-4900-b0b5-3da234249a1c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: c2862657-a4d7-4a27-97f1-fd056688eef3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:48.324013 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16db1290-93d5-4900-b0b5-3da234249a1c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:48.324496 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16db1290-93d5-4900-b0b5-3da234249a1c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:48.324957 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16db1290-93d5-4900-b0b5-3da234249a1c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:48.325646 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16db1290-93d5-4900-b0b5-3da234249a1c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:48.326105 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16db1290-93d5-4900-b0b5-3da234249a1c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:48.326533 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16db1290-93d5-4900-b0b5-3da234249a1c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:48.465153 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-16db1290-93d5-4900-b0b5-3da234249a1c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:48.472943 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-16db1290-93d5-4900-b0b5-3da234249a1c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/c2862657-a4d7-4a27-97f1-fd056688eef3" status: 200 len: 1392 microversion: 2.1 time: 0.160995 Oct 18 16:46:48.473527 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3724/7468] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:48 2022] GET /compute/v2.1/servers/c2862657-a4d7-4a27-97f1-fd056688eef3 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:49.495588 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ab907eca-8305-4dd3-97e2-1d481a8941da tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:49.496824 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ab907eca-8305-4dd3-97e2-1d481a8941da tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: c2862657-a4d7-4a27-97f1-fd056688eef3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:49.503666 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ab907eca-8305-4dd3-97e2-1d481a8941da tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:49.504162 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ab907eca-8305-4dd3-97e2-1d481a8941da tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:49.504614 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ab907eca-8305-4dd3-97e2-1d481a8941da tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:49.505357 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ab907eca-8305-4dd3-97e2-1d481a8941da tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:49.505827 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ab907eca-8305-4dd3-97e2-1d481a8941da tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:49.506267 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ab907eca-8305-4dd3-97e2-1d481a8941da tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:49.635820 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ab907eca-8305-4dd3-97e2-1d481a8941da tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:49.643504 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ab907eca-8305-4dd3-97e2-1d481a8941da tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/c2862657-a4d7-4a27-97f1-fd056688eef3" status: 200 len: 1392 microversion: 2.1 time: 0.151825 Oct 18 16:46:49.644084 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3745/7469] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:49 2022] GET /compute/v2.1/servers/c2862657-a4d7-4a27-97f1-fd056688eef3 => generated 1392 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:50.666225 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-85ee67bc-91ef-484c-96c3-e4cc89e3a7ea tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:50.666840 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-85ee67bc-91ef-484c-96c3-e4cc89e3a7ea tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: c2862657-a4d7-4a27-97f1-fd056688eef3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:50.673774 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85ee67bc-91ef-484c-96c3-e4cc89e3a7ea tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:50.674263 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85ee67bc-91ef-484c-96c3-e4cc89e3a7ea tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:50.674704 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85ee67bc-91ef-484c-96c3-e4cc89e3a7ea tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:50.675399 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85ee67bc-91ef-484c-96c3-e4cc89e3a7ea tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:50.675858 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85ee67bc-91ef-484c-96c3-e4cc89e3a7ea tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:50.676294 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85ee67bc-91ef-484c-96c3-e4cc89e3a7ea tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:50.809274 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-85ee67bc-91ef-484c-96c3-e4cc89e3a7ea tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:50.817360 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-85ee67bc-91ef-484c-96c3-e4cc89e3a7ea tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/c2862657-a4d7-4a27-97f1-fd056688eef3" status: 200 len: 1392 microversion: 2.1 time: 0.155049 Oct 18 16:46:50.817938 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3725/7470] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:50 2022] GET /compute/v2.1/servers/c2862657-a4d7-4a27-97f1-fd056688eef3 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:51.842050 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-56313fc6-927c-4ee3-bb05-899019df80cc req-e49881e2-3984-4063-8ced-923e92ce91db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2862657-a4d7-4a27-97f1-fd056688eef3", "name": "network-vif-plugged", "status": "completed", "tag": "1efae357-5346-4bea-bd64-c2d33d4c0928"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:46:51.853982 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fd671cec-3600-434d-84a8-b0c28572e899 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:51.854504 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-56313fc6-927c-4ee3-bb05-899019df80cc req-e49881e2-3984-4063-8ced-923e92ce91db service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:51.854857 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-56313fc6-927c-4ee3-bb05-899019df80cc req-e49881e2-3984-4063-8ced-923e92ce91db service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:51.855308 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fd671cec-3600-434d-84a8-b0c28572e899 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: c2862657-a4d7-4a27-97f1-fd056688eef3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:51.855435 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-56313fc6-927c-4ee3-bb05-899019df80cc req-e49881e2-3984-4063-8ced-923e92ce91db service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:51.862094 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd671cec-3600-434d-84a8-b0c28572e899 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:51.862618 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd671cec-3600-434d-84a8-b0c28572e899 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:51.863268 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd671cec-3600-434d-84a8-b0c28572e899 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:51.863985 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd671cec-3600-434d-84a8-b0c28572e899 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:51.864452 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd671cec-3600-434d-84a8-b0c28572e899 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:51.864914 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd671cec-3600-434d-84a8-b0c28572e899 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:51.867807 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-56313fc6-927c-4ee3-bb05-899019df80cc req-e49881e2-3984-4063-8ced-923e92ce91db service nova] Creating event network-vif-plugged:1efae357-5346-4bea-bd64-c2d33d4c0928 for instance c2862657-a4d7-4a27-97f1-fd056688eef3 on n-h1-853682-5 Oct 18 16:46:51.873148 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-56313fc6-927c-4ee3-bb05-899019df80cc req-e49881e2-3984-4063-8ced-923e92ce91db service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035511 Oct 18 16:46:51.874279 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3746/7471] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:46:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:46:52.038016 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fd671cec-3600-434d-84a8-b0c28572e899 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:52.046008 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fd671cec-3600-434d-84a8-b0c28572e899 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/c2862657-a4d7-4a27-97f1-fd056688eef3" status: 200 len: 1392 microversion: 2.1 time: 0.196047 Oct 18 16:46:52.046601 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3726/7472] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:51 2022] GET /compute/v2.1/servers/c2862657-a4d7-4a27-97f1-fd056688eef3 => generated 1392 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:53.070855 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2ceff422-1715-46ca-8f5c-d6440bd2b919 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:53.071583 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2ceff422-1715-46ca-8f5c-d6440bd2b919 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: c2862657-a4d7-4a27-97f1-fd056688eef3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:53.079545 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2ceff422-1715-46ca-8f5c-d6440bd2b919 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:53.080050 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2ceff422-1715-46ca-8f5c-d6440bd2b919 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:53.080505 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2ceff422-1715-46ca-8f5c-d6440bd2b919 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:53.081264 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2ceff422-1715-46ca-8f5c-d6440bd2b919 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:53.081739 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2ceff422-1715-46ca-8f5c-d6440bd2b919 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:53.082185 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2ceff422-1715-46ca-8f5c-d6440bd2b919 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:53.219340 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2ceff422-1715-46ca-8f5c-d6440bd2b919 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:53.227049 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2ceff422-1715-46ca-8f5c-d6440bd2b919 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/c2862657-a4d7-4a27-97f1-fd056688eef3" status: 200 len: 1392 microversion: 2.1 time: 0.160537 Oct 18 16:46:53.227644 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3747/7473] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:53 2022] GET /compute/v2.1/servers/c2862657-a4d7-4a27-97f1-fd056688eef3 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:54.249765 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a241efee-6516-4875-9be1-37396a0de64b tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:54.250399 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a241efee-6516-4875-9be1-37396a0de64b tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: c2862657-a4d7-4a27-97f1-fd056688eef3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:54.254232 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:46:54.254979 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:46:54.259601 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a241efee-6516-4875-9be1-37396a0de64b tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:54.260101 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a241efee-6516-4875-9be1-37396a0de64b tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:54.260548 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a241efee-6516-4875-9be1-37396a0de64b tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:54.261312 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a241efee-6516-4875-9be1-37396a0de64b tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:54.261776 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a241efee-6516-4875-9be1-37396a0de64b tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:54.262211 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a241efee-6516-4875-9be1-37396a0de64b tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:54.394706 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a241efee-6516-4875-9be1-37396a0de64b tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:54.402990 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a241efee-6516-4875-9be1-37396a0de64b tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/c2862657-a4d7-4a27-97f1-fd056688eef3" status: 200 len: 1563 microversion: 2.1 time: 0.157533 Oct 18 16:46:54.403567 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3727/7474] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:54 2022] GET /compute/v2.1/servers/c2862657-a4d7-4a27-97f1-fd056688eef3 => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:54.425809 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-429f5eb5-b4a8-422f-9868-f6542d562515 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:54.426443 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-429f5eb5-b4a8-422f-9868-f6542d562515 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: c2862657-a4d7-4a27-97f1-fd056688eef3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:54.428417 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=6 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:46:54.434982 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-429f5eb5-b4a8-422f-9868-f6542d562515 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:54.435484 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-429f5eb5-b4a8-422f-9868-f6542d562515 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:54.435934 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-429f5eb5-b4a8-422f-9868-f6542d562515 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:54.436647 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-429f5eb5-b4a8-422f-9868-f6542d562515 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:54.437156 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-429f5eb5-b4a8-422f-9868-f6542d562515 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:54.437601 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-429f5eb5-b4a8-422f-9868-f6542d562515 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:54.571796 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-429f5eb5-b4a8-422f-9868-f6542d562515 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:54.579504 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-429f5eb5-b4a8-422f-9868-f6542d562515 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/c2862657-a4d7-4a27-97f1-fd056688eef3" status: 200 len: 1563 microversion: 2.1 time: 0.157706 Oct 18 16:46:54.580076 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3748/7475] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:54 2022] GET /compute/v2.1/servers/c2862657-a4d7-4a27-97f1-fd056688eef3 => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:46:56.416009 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bdfe3667-4b50-4933-8262-c65ba385f011 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:46:56.416835 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bdfe3667-4b50-4933-8262-c65ba385f011 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: c2862657-a4d7-4a27-97f1-fd056688eef3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:46:56.417943 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-ab571f07-6884-4954-95af-26578d22a03c req-f3649c16-68a3-445d-8b73-ccd9ef46a364 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2862657-a4d7-4a27-97f1-fd056688eef3", "tag": "1efae357-5346-4bea-bd64-c2d33d4c0928"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:46:56.423900 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bdfe3667-4b50-4933-8262-c65ba385f011 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:56.424546 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bdfe3667-4b50-4933-8262-c65ba385f011 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:56.425101 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bdfe3667-4b50-4933-8262-c65ba385f011 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:56.425882 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bdfe3667-4b50-4933-8262-c65ba385f011 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:56.426419 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bdfe3667-4b50-4933-8262-c65ba385f011 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:56.426954 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bdfe3667-4b50-4933-8262-c65ba385f011 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:56.431500 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-ab571f07-6884-4954-95af-26578d22a03c req-f3649c16-68a3-445d-8b73-ccd9ef46a364 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:46:56.432004 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-ab571f07-6884-4954-95af-26578d22a03c req-f3649c16-68a3-445d-8b73-ccd9ef46a364 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:46:56.432453 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-ab571f07-6884-4954-95af-26578d22a03c req-f3649c16-68a3-445d-8b73-ccd9ef46a364 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:46:56.445668 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-ab571f07-6884-4954-95af-26578d22a03c req-f3649c16-68a3-445d-8b73-ccd9ef46a364 service nova] Creating event network-changed:1efae357-5346-4bea-bd64-c2d33d4c0928 for instance c2862657-a4d7-4a27-97f1-fd056688eef3 on n-h1-853682-5 Oct 18 16:46:56.451385 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-ab571f07-6884-4954-95af-26578d22a03c req-f3649c16-68a3-445d-8b73-ccd9ef46a364 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037024 Oct 18 16:46:56.452000 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3749/7476] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:46:56.605278 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bdfe3667-4b50-4933-8262-c65ba385f011 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:46:56.613807 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bdfe3667-4b50-4933-8262-c65ba385f011 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/c2862657-a4d7-4a27-97f1-fd056688eef3" status: 200 len: 1563 microversion: 2.1 time: 0.201737 Oct 18 16:46:56.614400 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3728/7477] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:46:56 2022] GET /compute/v2.1/servers/c2862657-a4d7-4a27-97f1-fd056688eef3 => generated 1563 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:47:29.902896 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=13 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:47:29.903656 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=34 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:47:29.908569 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3fb65761-6160-4ffa-afe1-630c3c4d8a44 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:47:29.911121 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3fb65761-6160-4ffa-afe1-630c3c4d8a44 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: c2862657-a4d7-4a27-97f1-fd056688eef3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:47:29.918053 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3fb65761-6160-4ffa-afe1-630c3c4d8a44 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:47:29.918555 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3fb65761-6160-4ffa-afe1-630c3c4d8a44 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:47:29.919009 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3fb65761-6160-4ffa-afe1-630c3c4d8a44 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:47:29.919712 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3fb65761-6160-4ffa-afe1-630c3c4d8a44 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:47:29.920184 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3fb65761-6160-4ffa-afe1-630c3c4d8a44 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:47:29.920625 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3fb65761-6160-4ffa-afe1-630c3c4d8a44 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:47:29.989305 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3fb65761-6160-4ffa-afe1-630c3c4d8a44 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "POST /compute/v2.1/servers/c2862657-a4d7-4a27-97f1-fd056688eef3/action" status: 200 len: 24565 microversion: 2.1 time: 0.088315 Oct 18 16:47:29.989902 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3750/7478] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:47:29 2022] POST /compute/v2.1/servers/c2862657-a4d7-4a27-97f1-fd056688eef3/action => generated 24565 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:48:00.397172 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0adda36c-31cd-4002-aa65-e4aa70234023 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:48:00.397807 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0adda36c-31cd-4002-aa65-e4aa70234023 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: c2862657-a4d7-4a27-97f1-fd056688eef3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:00.399799 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:48:00.400469 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=40 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:48:00.408056 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0adda36c-31cd-4002-aa65-e4aa70234023 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:00.408546 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0adda36c-31cd-4002-aa65-e4aa70234023 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:00.409284 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0adda36c-31cd-4002-aa65-e4aa70234023 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:00.409995 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0adda36c-31cd-4002-aa65-e4aa70234023 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:00.410458 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0adda36c-31cd-4002-aa65-e4aa70234023 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:00.410891 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0adda36c-31cd-4002-aa65-e4aa70234023 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:00.476472 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0adda36c-31cd-4002-aa65-e4aa70234023 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "POST /compute/v2.1/servers/c2862657-a4d7-4a27-97f1-fd056688eef3/action" status: 202 len: 0 microversion: 2.1 time: 0.084542 Oct 18 16:48:00.480082 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3729/7479] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:48:00 2022] POST /compute/v2.1/servers/c2862657-a4d7-4a27-97f1-fd056688eef3/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:48:00.486081 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-eb23d3ad-5618-4940-9055-3d9f25318109 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:00.486802 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-eb23d3ad-5618-4940-9055-3d9f25318109 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: c2862657-a4d7-4a27-97f1-fd056688eef3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:00.493533 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:48:00.494242 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=4 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:48:00.497426 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eb23d3ad-5618-4940-9055-3d9f25318109 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:00.498237 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eb23d3ad-5618-4940-9055-3d9f25318109 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:00.498454 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eb23d3ad-5618-4940-9055-3d9f25318109 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:00.499267 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eb23d3ad-5618-4940-9055-3d9f25318109 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:00.499743 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eb23d3ad-5618-4940-9055-3d9f25318109 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:00.500190 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-eb23d3ad-5618-4940-9055-3d9f25318109 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:00.636244 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-eb23d3ad-5618-4940-9055-3d9f25318109 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:48:00.644058 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-eb23d3ad-5618-4940-9055-3d9f25318109 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/c2862657-a4d7-4a27-97f1-fd056688eef3" status: 200 len: 1687 microversion: 2.1 time: 0.162202 Oct 18 16:48:00.644628 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3751/7480] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:00 2022] GET /compute/v2.1/servers/c2862657-a4d7-4a27-97f1-fd056688eef3 => generated 1687 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:48:01.670676 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2baa73db-a53a-49eb-a03c-887b2acd1943 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:01.671368 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2baa73db-a53a-49eb-a03c-887b2acd1943 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: c2862657-a4d7-4a27-97f1-fd056688eef3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:01.678111 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2baa73db-a53a-49eb-a03c-887b2acd1943 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:01.678592 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2baa73db-a53a-49eb-a03c-887b2acd1943 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:01.679030 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2baa73db-a53a-49eb-a03c-887b2acd1943 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:01.679728 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2baa73db-a53a-49eb-a03c-887b2acd1943 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:01.680180 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2baa73db-a53a-49eb-a03c-887b2acd1943 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:01.680606 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2baa73db-a53a-49eb-a03c-887b2acd1943 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:01.820346 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2baa73db-a53a-49eb-a03c-887b2acd1943 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:48:01.828134 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2baa73db-a53a-49eb-a03c-887b2acd1943 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/c2862657-a4d7-4a27-97f1-fd056688eef3" status: 200 len: 1667 microversion: 2.1 time: 0.162774 Oct 18 16:48:01.828700 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3730/7481] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:01 2022] GET /compute/v2.1/servers/c2862657-a4d7-4a27-97f1-fd056688eef3 => generated 1667 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:48:02.922571 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c0f0709f-d311-4011-93cc-35f7858d7d27 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:48:02.924843 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c0f0709f-d311-4011-93cc-35f7858d7d27 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: c2862657-a4d7-4a27-97f1-fd056688eef3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:02.933097 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c0f0709f-d311-4011-93cc-35f7858d7d27 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:02.933597 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c0f0709f-d311-4011-93cc-35f7858d7d27 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:02.934084 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c0f0709f-d311-4011-93cc-35f7858d7d27 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:02.934799 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c0f0709f-d311-4011-93cc-35f7858d7d27 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:02.935303 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c0f0709f-d311-4011-93cc-35f7858d7d27 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:02.935746 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c0f0709f-d311-4011-93cc-35f7858d7d27 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:03.003396 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c0f0709f-d311-4011-93cc-35f7858d7d27 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "POST /compute/v2.1/servers/c2862657-a4d7-4a27-97f1-fd056688eef3/action" status: 200 len: 32628 microversion: 2.1 time: 0.084604 Oct 18 16:48:03.004654 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3752/7482] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:48:02 2022] POST /compute/v2.1/servers/c2862657-a4d7-4a27-97f1-fd056688eef3/action => generated 32628 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:48:03.016355 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cdee6bd6-492d-4b03-b361-16948549aa3a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:48:03.016946 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cdee6bd6-492d-4b03-b361-16948549aa3a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: c2862657-a4d7-4a27-97f1-fd056688eef3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:03.024110 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cdee6bd6-492d-4b03-b361-16948549aa3a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:03.024605 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cdee6bd6-492d-4b03-b361-16948549aa3a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:03.025085 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cdee6bd6-492d-4b03-b361-16948549aa3a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:03.025797 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cdee6bd6-492d-4b03-b361-16948549aa3a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:03.026265 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cdee6bd6-492d-4b03-b361-16948549aa3a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:03.026697 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cdee6bd6-492d-4b03-b361-16948549aa3a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:03.093373 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cdee6bd6-492d-4b03-b361-16948549aa3a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "POST /compute/v2.1/servers/c2862657-a4d7-4a27-97f1-fd056688eef3/action" status: 202 len: 0 microversion: 2.1 time: 0.080745 Oct 18 16:48:03.093933 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3731/7483] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:48:03 2022] POST /compute/v2.1/servers/c2862657-a4d7-4a27-97f1-fd056688eef3/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:48:03.104381 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-cb24507f-eda0-436a-b266-bc08ed2b5baa tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:03.105117 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-cb24507f-eda0-436a-b266-bc08ed2b5baa tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: c2862657-a4d7-4a27-97f1-fd056688eef3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:03.112616 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cb24507f-eda0-436a-b266-bc08ed2b5baa tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:03.113812 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cb24507f-eda0-436a-b266-bc08ed2b5baa tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:03.114303 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cb24507f-eda0-436a-b266-bc08ed2b5baa tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:03.115034 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cb24507f-eda0-436a-b266-bc08ed2b5baa tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:03.115548 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cb24507f-eda0-436a-b266-bc08ed2b5baa tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:03.115999 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cb24507f-eda0-436a-b266-bc08ed2b5baa tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:03.254723 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-cb24507f-eda0-436a-b266-bc08ed2b5baa tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:48:03.262442 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-cb24507f-eda0-436a-b266-bc08ed2b5baa tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/c2862657-a4d7-4a27-97f1-fd056688eef3" status: 200 len: 1674 microversion: 2.1 time: 0.162410 Oct 18 16:48:03.263015 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3753/7484] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:03 2022] GET /compute/v2.1/servers/c2862657-a4d7-4a27-97f1-fd056688eef3 => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:48:04.287548 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-51cac3d1-6608-4951-a514-2e8c95b46fb7 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:04.288258 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-51cac3d1-6608-4951-a514-2e8c95b46fb7 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: c2862657-a4d7-4a27-97f1-fd056688eef3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:04.295535 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51cac3d1-6608-4951-a514-2e8c95b46fb7 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:04.296891 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51cac3d1-6608-4951-a514-2e8c95b46fb7 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:04.296891 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51cac3d1-6608-4951-a514-2e8c95b46fb7 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:04.297179 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51cac3d1-6608-4951-a514-2e8c95b46fb7 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:04.297645 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51cac3d1-6608-4951-a514-2e8c95b46fb7 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:04.298069 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51cac3d1-6608-4951-a514-2e8c95b46fb7 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:04.434219 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-51cac3d1-6608-4951-a514-2e8c95b46fb7 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:48:04.442061 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-51cac3d1-6608-4951-a514-2e8c95b46fb7 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/c2862657-a4d7-4a27-97f1-fd056688eef3" status: 200 len: 1682 microversion: 2.1 time: 0.159716 Oct 18 16:48:04.442654 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3732/7485] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:04 2022] GET /compute/v2.1/servers/c2862657-a4d7-4a27-97f1-fd056688eef3 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:48:04.548553 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b964674f-47da-4906-bdf6-0a858d0ae239 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:48:04.550738 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b964674f-47da-4906-bdf6-0a858d0ae239 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: c2862657-a4d7-4a27-97f1-fd056688eef3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:04.558521 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b964674f-47da-4906-bdf6-0a858d0ae239 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:04.559021 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b964674f-47da-4906-bdf6-0a858d0ae239 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:04.559478 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b964674f-47da-4906-bdf6-0a858d0ae239 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:04.560221 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b964674f-47da-4906-bdf6-0a858d0ae239 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:04.560696 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b964674f-47da-4906-bdf6-0a858d0ae239 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:04.561169 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b964674f-47da-4906-bdf6-0a858d0ae239 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:04.627675 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b964674f-47da-4906-bdf6-0a858d0ae239 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "POST /compute/v2.1/servers/c2862657-a4d7-4a27-97f1-fd056688eef3/action" status: 200 len: 37032 microversion: 2.1 time: 0.082971 Oct 18 16:48:04.628337 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3754/7486] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:48:04 2022] POST /compute/v2.1/servers/c2862657-a4d7-4a27-97f1-fd056688eef3/action => generated 37032 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:48:05.590490 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-06035e07-730e-4801-a2e1-38b3321433a5 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:05.591239 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-06035e07-730e-4801-a2e1-38b3321433a5 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: c2862657-a4d7-4a27-97f1-fd056688eef3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:05.593668 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-e3dc3b28-0592-4f16-ac41-02802fdf3fce req-88fe259f-827c-40e8-8b96-a7ca727264fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2862657-a4d7-4a27-97f1-fd056688eef3", "tag": "1efae357-5346-4bea-bd64-c2d33d4c0928"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:48:05.599175 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06035e07-730e-4801-a2e1-38b3321433a5 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:05.599997 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06035e07-730e-4801-a2e1-38b3321433a5 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:05.600484 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06035e07-730e-4801-a2e1-38b3321433a5 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:05.601251 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06035e07-730e-4801-a2e1-38b3321433a5 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:05.601898 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06035e07-730e-4801-a2e1-38b3321433a5 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:05.602342 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06035e07-730e-4801-a2e1-38b3321433a5 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:05.606551 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-e3dc3b28-0592-4f16-ac41-02802fdf3fce req-88fe259f-827c-40e8-8b96-a7ca727264fa service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:05.607966 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-e3dc3b28-0592-4f16-ac41-02802fdf3fce req-88fe259f-827c-40e8-8b96-a7ca727264fa service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:05.608736 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-e3dc3b28-0592-4f16-ac41-02802fdf3fce req-88fe259f-827c-40e8-8b96-a7ca727264fa service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:05.622190 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-e3dc3b28-0592-4f16-ac41-02802fdf3fce req-88fe259f-827c-40e8-8b96-a7ca727264fa service nova] Creating event network-changed:1efae357-5346-4bea-bd64-c2d33d4c0928 for instance c2862657-a4d7-4a27-97f1-fd056688eef3 on n-h1-853682-5 Oct 18 16:48:05.628260 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-e3dc3b28-0592-4f16-ac41-02802fdf3fce req-88fe259f-827c-40e8-8b96-a7ca727264fa service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038899 Oct 18 16:48:05.629114 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3755/7487] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:48:05.631980 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-06035e07-730e-4801-a2e1-38b3321433a5 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: c2862657-a4d7-4a27-97f1-fd056688eef3] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:48:05.737047 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-06035e07-730e-4801-a2e1-38b3321433a5 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c2862657-a4d7-4a27-97f1-fd056688eef3" status: 204 len: 0 microversion: 2.1 time: 0.150263 Oct 18 16:48:05.737662 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3733/7488] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 16:48:05 2022] DELETE /compute/v2.1/servers/c2862657-a4d7-4a27-97f1-fd056688eef3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:48:05.747289 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ec922d88-d7d4-4a41-a980-d4a5737d06ee tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:05.748033 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ec922d88-d7d4-4a41-a980-d4a5737d06ee tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: c2862657-a4d7-4a27-97f1-fd056688eef3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:05.754401 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ec922d88-d7d4-4a41-a980-d4a5737d06ee tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:05.754908 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ec922d88-d7d4-4a41-a980-d4a5737d06ee tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:05.755363 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ec922d88-d7d4-4a41-a980-d4a5737d06ee tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:05.756072 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ec922d88-d7d4-4a41-a980-d4a5737d06ee tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:05.756544 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ec922d88-d7d4-4a41-a980-d4a5737d06ee tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:05.757025 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ec922d88-d7d4-4a41-a980-d4a5737d06ee tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:05.894753 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ec922d88-d7d4-4a41-a980-d4a5737d06ee tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:48:05.902668 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ec922d88-d7d4-4a41-a980-d4a5737d06ee tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/c2862657-a4d7-4a27-97f1-fd056688eef3" status: 200 len: 1688 microversion: 2.1 time: 0.160216 Oct 18 16:48:05.903344 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3756/7489] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:05 2022] GET /compute/v2.1/servers/c2862657-a4d7-4a27-97f1-fd056688eef3 => generated 1688 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:48:06.927673 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1b5650bc-fc39-45b9-bf1e-f183039ff560 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:06.928299 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1b5650bc-fc39-45b9-bf1e-f183039ff560 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: c2862657-a4d7-4a27-97f1-fd056688eef3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:06.935144 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b5650bc-fc39-45b9-bf1e-f183039ff560 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:06.935637 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b5650bc-fc39-45b9-bf1e-f183039ff560 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:06.936085 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b5650bc-fc39-45b9-bf1e-f183039ff560 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:06.936781 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b5650bc-fc39-45b9-bf1e-f183039ff560 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:06.937270 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b5650bc-fc39-45b9-bf1e-f183039ff560 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:06.937703 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b5650bc-fc39-45b9-bf1e-f183039ff560 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:07.133912 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1b5650bc-fc39-45b9-bf1e-f183039ff560 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:48:07.141695 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1b5650bc-fc39-45b9-bf1e-f183039ff560 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/c2862657-a4d7-4a27-97f1-fd056688eef3" status: 200 len: 1688 microversion: 2.1 time: 0.218384 Oct 18 16:48:07.142276 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3734/7490] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:06 2022] GET /compute/v2.1/servers/c2862657-a4d7-4a27-97f1-fd056688eef3 => generated 1688 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:48:08.167068 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-59c21170-f005-4dec-ae8a-96ce0a8f6d65 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:08.167730 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-59c21170-f005-4dec-ae8a-96ce0a8f6d65 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: c2862657-a4d7-4a27-97f1-fd056688eef3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:08.175463 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-59c21170-f005-4dec-ae8a-96ce0a8f6d65 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:08.175980 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-59c21170-f005-4dec-ae8a-96ce0a8f6d65 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:08.176877 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-59c21170-f005-4dec-ae8a-96ce0a8f6d65 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:08.177709 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-59c21170-f005-4dec-ae8a-96ce0a8f6d65 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:08.178586 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-59c21170-f005-4dec-ae8a-96ce0a8f6d65 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:08.179053 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-59c21170-f005-4dec-ae8a-96ce0a8f6d65 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:08.324221 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-59c21170-f005-4dec-ae8a-96ce0a8f6d65 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:48:08.332794 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-59c21170-f005-4dec-ae8a-96ce0a8f6d65 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/c2862657-a4d7-4a27-97f1-fd056688eef3" status: 200 len: 1569 microversion: 2.1 time: 0.169609 Oct 18 16:48:08.333956 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3757/7491] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:08 2022] GET /compute/v2.1/servers/c2862657-a4d7-4a27-97f1-fd056688eef3 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:48:08.343764 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-7187aad3-2b05-491f-a24b-575aeb3d78a6 req-854f97d1-982c-455f-a9f6-ef74569b9a1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2862657-a4d7-4a27-97f1-fd056688eef3", "name": "network-vif-deleted", "tag": "1efae357-5346-4bea-bd64-c2d33d4c0928"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:48:08.354163 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7187aad3-2b05-491f-a24b-575aeb3d78a6 req-854f97d1-982c-455f-a9f6-ef74569b9a1a service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:08.354649 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7187aad3-2b05-491f-a24b-575aeb3d78a6 req-854f97d1-982c-455f-a9f6-ef74569b9a1a service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:08.355085 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7187aad3-2b05-491f-a24b-575aeb3d78a6 req-854f97d1-982c-455f-a9f6-ef74569b9a1a service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:08.366669 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-7187aad3-2b05-491f-a24b-575aeb3d78a6 req-854f97d1-982c-455f-a9f6-ef74569b9a1a service nova] Creating event network-vif-deleted:1efae357-5346-4bea-bd64-c2d33d4c0928 for instance c2862657-a4d7-4a27-97f1-fd056688eef3 on n-h1-853682-5 Oct 18 16:48:08.371594 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-7187aad3-2b05-491f-a24b-575aeb3d78a6 req-854f97d1-982c-455f-a9f6-ef74569b9a1a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031688 Oct 18 16:48:08.372189 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3735/7492] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:48:09.355703 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6d0bdec5-7505-4375-8494-86d9c620d27a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:09.356344 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6d0bdec5-7505-4375-8494-86d9c620d27a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: c2862657-a4d7-4a27-97f1-fd056688eef3] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:09.363277 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6d0bdec5-7505-4375-8494-86d9c620d27a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:09.363783 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6d0bdec5-7505-4375-8494-86d9c620d27a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:09.364241 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6d0bdec5-7505-4375-8494-86d9c620d27a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:09.364991 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6d0bdec5-7505-4375-8494-86d9c620d27a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:09.365568 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6d0bdec5-7505-4375-8494-86d9c620d27a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:09.366021 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6d0bdec5-7505-4375-8494-86d9c620d27a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:09.379619 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-6d0bdec5-7505-4375-8494-86d9c620d27a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] HTTP exception thrown: Instance c2862657-a4d7-4a27-97f1-fd056688eef3 could not be found. Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6d0bdec5-7505-4375-8494-86d9c620d27a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Request method failure captured: Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/c2862657-a4d7-4a27-97f1-fd056688eef3 HTTP/1.1 Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTthsYkwDcRi6ejpHtt4H8SQkGaHFzHuIXkg1m4QUw3Qt5Uv9NPiBxRcaK-NQwUI3S4BWwnXo3saj3Q2PKxNAS-I0ST7wp5S5RSkuwZEJ12enI0qMMMoKC1L1prWuMDD4oklSgZx5x8J281mShnqu67jB5xP0xd3PanqU2RBtQqY8QyI Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: f588c570d1c3475598357e7d21cd64f2 Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2023049857 Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f588c570d1c3475598357e7d21cd64f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f588c570d1c3475598357e7d21cd64f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f588c570d1c3475598357e7d21cd64f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f588c570d1c3475598357e7d21cd64f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2023049857 Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: f588c570d1c3475598357e7d21cd64f2 Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2023049857 Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-TestNetworkAdvancedServerOps-2023049857-project Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: a0040ae38b5542b9ac7d87de246e7108 Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2023049857-project Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance c2862657-a4d7-4a27-97f1-fd056688eef3 could not be found. Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'c2862657-a4d7-4a27-97f1-fd056688eef3'} Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2862657-a4d7-4a27-97f1-fd056688eef3 could not be found. Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2862657-a4d7-4a27-97f1-fd056688eef3 could not be found. Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:48:09.381860 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:48:09.387466 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:48:09.387466 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:48:09.387466 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:48:09.387466 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:48:09.387466 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:48:09.387466 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:48:09.387466 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2862657-a4d7-4a27-97f1-fd056688eef3 could not be found. Oct 18 16:48:09.387466 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:48:09.387466 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6d0bdec5-7505-4375-8494-86d9c620d27a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Returning 404 to user: Instance c2862657-a4d7-4a27-97f1-fd056688eef3 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:48:09.387466 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6d0bdec5-7505-4375-8494-86d9c620d27a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/c2862657-a4d7-4a27-97f1-fd056688eef3" status: 404 len: 111 microversion: 2.1 time: 0.031641 Oct 18 16:48:09.387466 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3758/7493] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:09 2022] GET /compute/v2.1/servers/c2862657-a4d7-4a27-97f1-fd056688eef3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:48:12.773344 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8c4bf431-4181-4d22-8dbd-7b1c54bae23a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '.version_select at 0x7f7c37a74790>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:12.798986 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8c4bf431-4181-4d22-8dbd-7b1c54bae23a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1611655540" status: 202 len: 0 microversion: 2.1 time: 0.030125 Oct 18 16:48:12.803325 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3736/7494] 10.222.0.60 () {58 vars in 1284 bytes} [Tue Oct 18 16:48:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1611655540 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:48:12.827442 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6c15ee0b-a4b5-432b-9a5a-7cd1c2902082 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Action: 'create', calling method: .version_select at 0x7f7c3d377f70>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-634055617", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8h+XwrGp6MdQdTasbdLEbH/LOc8bPxHCTD9QcFovTe0G4e3fQ6YmQ/ljN9fZONQuSxXfufsChA0BCzm5/9LopdrkQlBRIZNQFkvAehnsXiqUQX690MRZwT8f79SvLLPw=="}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:48:12.844543 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-6c15ee0b-a4b5-432b-9a5a-7cd1c2902082 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Getting quotas for project f588c570d1c3475598357e7d21cd64f2. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:48:12.850647 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-6c15ee0b-a4b5-432b-9a5a-7cd1c2902082 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Getting quotas for user a0040ae38b5542b9ac7d87de246e7108 and project f588c570d1c3475598357e7d21cd64f2. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:48:12.874954 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6c15ee0b-a4b5-432b-9a5a-7cd1c2902082 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.051722 Oct 18 16:48:12.875561 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3759/7495] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Oct 18 16:48:12 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:48:18.683433 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:48:18.690663 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ec1cce25-736e-4c36-8558-8a00df4252b2 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1681506255", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "f097eb3c-ec07-45a8-b6c3-1ab6d036be81"}], "key_name": "tempest-TestNetworkAdvancedServerOps-634055617", "security_groups": [{"name": "tempest-secgroup-smoke-899958588"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:48:18.806650 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-ec1cce25-736e-4c36-8558-8a00df4252b2 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] validate_networks() for [('f097eb3c-ec07-45a8-b6c3-1ab6d036be81', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 16:48:19.246246 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-ec1cce25-736e-4c36-8558-8a00df4252b2 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:48:19.246681 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-ec1cce25-736e-4c36-8558-8a00df4252b2 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:48:19.247159 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-ec1cce25-736e-4c36-8558-8a00df4252b2 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:48:19.247573 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-ec1cce25-736e-4c36-8558-8a00df4252b2 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:48:19.248152 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-ec1cce25-736e-4c36-8558-8a00df4252b2 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:48:19.258637 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec1cce25-736e-4c36-8558-8a00df4252b2 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:19.259137 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec1cce25-736e-4c36-8558-8a00df4252b2 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:19.259855 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec1cce25-736e-4c36-8558-8a00df4252b2 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:19.260892 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec1cce25-736e-4c36-8558-8a00df4252b2 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:19.261605 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec1cce25-736e-4c36-8558-8a00df4252b2 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:19.262285 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec1cce25-736e-4c36-8558-8a00df4252b2 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:19.283129 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-ec1cce25-736e-4c36-8558-8a00df4252b2 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Getting quotas for project f588c570d1c3475598357e7d21cd64f2. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:48:19.289851 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-ec1cce25-736e-4c36-8558-8a00df4252b2 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Getting quotas for user a0040ae38b5542b9ac7d87de246e7108 and project f588c570d1c3475598357e7d21cd64f2. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:48:19.304102 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ec1cce25-736e-4c36-8558-8a00df4252b2 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:48:19.306911 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ec1cce25-736e-4c36-8558-8a00df4252b2 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 9a8335e5-4b73-402f-b018-7497e25289ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:48:19.362430 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ec1cce25-736e-4c36-8558-8a00df4252b2 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.680583 Oct 18 16:48:19.368871 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3737/7496] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 16:48:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:48:19.373136 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=36 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:48:19.377562 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-017669da-85c6-4d0e-a5c3-521254c299ef tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:19.378205 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-017669da-85c6-4d0e-a5c3-521254c299ef tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 9a8335e5-4b73-402f-b018-7497e25289ed] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:19.442718 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-017669da-85c6-4d0e-a5c3-521254c299ef tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:48:19.450272 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-017669da-85c6-4d0e-a5c3-521254c299ef tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed" status: 200 len: 1266 microversion: 2.1 time: 0.078780 Oct 18 16:48:19.466136 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3760/7497] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:19 2022] GET /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed => generated 1266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:48:20.488279 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-296795a8-d5fd-446b-aa50-536fb909e173 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:20.488862 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-296795a8-d5fd-446b-aa50-536fb909e173 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 9a8335e5-4b73-402f-b018-7497e25289ed] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:20.496504 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-296795a8-d5fd-446b-aa50-536fb909e173 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:20.497045 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-296795a8-d5fd-446b-aa50-536fb909e173 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:20.497477 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-296795a8-d5fd-446b-aa50-536fb909e173 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:20.498398 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-296795a8-d5fd-446b-aa50-536fb909e173 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:20.499024 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-296795a8-d5fd-446b-aa50-536fb909e173 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:20.499621 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-296795a8-d5fd-446b-aa50-536fb909e173 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:20.569616 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-296795a8-d5fd-446b-aa50-536fb909e173 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:48:20.577889 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-296795a8-d5fd-446b-aa50-536fb909e173 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed" status: 200 len: 1318 microversion: 2.1 time: 0.093807 Oct 18 16:48:20.579082 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3738/7498] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:20 2022] GET /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed => generated 1318 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:48:21.602414 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1b875676-0c62-4086-acc7-7b1568c367cd tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:21.603735 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1b875676-0c62-4086-acc7-7b1568c367cd tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 9a8335e5-4b73-402f-b018-7497e25289ed] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:21.626875 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1b875676-0c62-4086-acc7-7b1568c367cd tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:21.627400 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1b875676-0c62-4086-acc7-7b1568c367cd tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:21.627862 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1b875676-0c62-4086-acc7-7b1568c367cd tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:21.628592 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1b875676-0c62-4086-acc7-7b1568c367cd tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:21.637323 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1b875676-0c62-4086-acc7-7b1568c367cd tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:21.637908 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1b875676-0c62-4086-acc7-7b1568c367cd tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:21.787350 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1b875676-0c62-4086-acc7-7b1568c367cd tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:48:21.795849 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1b875676-0c62-4086-acc7-7b1568c367cd tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed" status: 200 len: 1391 microversion: 2.1 time: 0.197277 Oct 18 16:48:21.796840 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3761/7499] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:21 2022] GET /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed => generated 1391 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:48:22.106364 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-cd346796-5879-4332-97ff-ce950047d6e0 req-542e3273-cc42-4f51-88b7-c196fe2bdb8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a8335e5-4b73-402f-b018-7497e25289ed", "tag": "6d2d9e8e-596d-4137-b10b-458f3ced6f7e"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:48:22.126905 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-cd346796-5879-4332-97ff-ce950047d6e0 req-542e3273-cc42-4f51-88b7-c196fe2bdb8e service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:22.127507 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-cd346796-5879-4332-97ff-ce950047d6e0 req-542e3273-cc42-4f51-88b7-c196fe2bdb8e service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:22.128458 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-cd346796-5879-4332-97ff-ce950047d6e0 req-542e3273-cc42-4f51-88b7-c196fe2bdb8e service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:22.141605 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-cd346796-5879-4332-97ff-ce950047d6e0 req-542e3273-cc42-4f51-88b7-c196fe2bdb8e service nova] Creating event network-changed:6d2d9e8e-596d-4137-b10b-458f3ced6f7e for instance 9a8335e5-4b73-402f-b018-7497e25289ed on n-h2-853682-5 Oct 18 16:48:22.147920 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-cd346796-5879-4332-97ff-ce950047d6e0 req-542e3273-cc42-4f51-88b7-c196fe2bdb8e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045602 Oct 18 16:48:22.149252 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3739/7500] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:48:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:48:22.819639 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b7edfa72-6089-41db-bee5-849feafac1a2 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:22.820275 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b7edfa72-6089-41db-bee5-849feafac1a2 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 9a8335e5-4b73-402f-b018-7497e25289ed] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:22.827270 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b7edfa72-6089-41db-bee5-849feafac1a2 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:22.827775 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b7edfa72-6089-41db-bee5-849feafac1a2 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:22.828232 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b7edfa72-6089-41db-bee5-849feafac1a2 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:22.828991 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b7edfa72-6089-41db-bee5-849feafac1a2 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:22.829469 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b7edfa72-6089-41db-bee5-849feafac1a2 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:22.829916 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b7edfa72-6089-41db-bee5-849feafac1a2 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:22.963566 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b7edfa72-6089-41db-bee5-849feafac1a2 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:48:22.971542 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b7edfa72-6089-41db-bee5-849feafac1a2 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed" status: 200 len: 1391 microversion: 2.1 time: 0.155875 Oct 18 16:48:22.972173 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3762/7501] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:22 2022] GET /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:48:23.995993 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-051960bf-a6b5-4fca-8b9a-d005e74c1708 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:23.996897 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-051960bf-a6b5-4fca-8b9a-d005e74c1708 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 9a8335e5-4b73-402f-b018-7497e25289ed] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:24.003953 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-051960bf-a6b5-4fca-8b9a-d005e74c1708 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:24.004660 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-051960bf-a6b5-4fca-8b9a-d005e74c1708 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:24.005831 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-051960bf-a6b5-4fca-8b9a-d005e74c1708 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:24.006654 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-051960bf-a6b5-4fca-8b9a-d005e74c1708 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:24.007237 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-051960bf-a6b5-4fca-8b9a-d005e74c1708 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:24.007774 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-051960bf-a6b5-4fca-8b9a-d005e74c1708 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:24.146572 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-051960bf-a6b5-4fca-8b9a-d005e74c1708 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:48:24.155036 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-051960bf-a6b5-4fca-8b9a-d005e74c1708 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed" status: 200 len: 1391 microversion: 2.1 time: 0.163265 Oct 18 16:48:24.155625 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3740/7502] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:23 2022] GET /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:48:25.179653 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6acd374f-306f-4178-bdf0-c8effd845d8c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:25.180273 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6acd374f-306f-4178-bdf0-c8effd845d8c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 9a8335e5-4b73-402f-b018-7497e25289ed] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:25.187514 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6acd374f-306f-4178-bdf0-c8effd845d8c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:25.188022 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6acd374f-306f-4178-bdf0-c8effd845d8c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:25.188482 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6acd374f-306f-4178-bdf0-c8effd845d8c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:25.189316 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6acd374f-306f-4178-bdf0-c8effd845d8c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:25.189796 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6acd374f-306f-4178-bdf0-c8effd845d8c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:25.190243 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6acd374f-306f-4178-bdf0-c8effd845d8c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:25.328118 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6acd374f-306f-4178-bdf0-c8effd845d8c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:48:25.336167 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6acd374f-306f-4178-bdf0-c8effd845d8c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed" status: 200 len: 1391 microversion: 2.1 time: 0.161034 Oct 18 16:48:25.336753 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3763/7503] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:25 2022] GET /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:48:26.359211 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-43e7fd19-df2d-4807-8e0f-6c4f6a81bb07 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:26.359808 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-43e7fd19-df2d-4807-8e0f-6c4f6a81bb07 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 9a8335e5-4b73-402f-b018-7497e25289ed] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:26.366490 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-43e7fd19-df2d-4807-8e0f-6c4f6a81bb07 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:26.366982 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-43e7fd19-df2d-4807-8e0f-6c4f6a81bb07 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:26.367425 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-43e7fd19-df2d-4807-8e0f-6c4f6a81bb07 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:26.368166 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-43e7fd19-df2d-4807-8e0f-6c4f6a81bb07 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:26.368626 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-43e7fd19-df2d-4807-8e0f-6c4f6a81bb07 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:26.369085 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-43e7fd19-df2d-4807-8e0f-6c4f6a81bb07 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:26.510543 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-43e7fd19-df2d-4807-8e0f-6c4f6a81bb07 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:48:26.519058 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-43e7fd19-df2d-4807-8e0f-6c4f6a81bb07 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed" status: 200 len: 1391 microversion: 2.1 time: 0.163921 Oct 18 16:48:26.519643 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3741/7504] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:26 2022] GET /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:48:27.542499 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e267b42b-2898-44f0-a7b1-5f2fff30561d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:27.543121 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e267b42b-2898-44f0-a7b1-5f2fff30561d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 9a8335e5-4b73-402f-b018-7497e25289ed] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:27.549989 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e267b42b-2898-44f0-a7b1-5f2fff30561d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:27.550479 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e267b42b-2898-44f0-a7b1-5f2fff30561d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:27.550924 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e267b42b-2898-44f0-a7b1-5f2fff30561d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:27.551620 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e267b42b-2898-44f0-a7b1-5f2fff30561d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:27.552085 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e267b42b-2898-44f0-a7b1-5f2fff30561d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:27.552523 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e267b42b-2898-44f0-a7b1-5f2fff30561d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:27.683639 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e267b42b-2898-44f0-a7b1-5f2fff30561d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:48:27.691414 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e267b42b-2898-44f0-a7b1-5f2fff30561d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed" status: 200 len: 1391 microversion: 2.1 time: 0.152832 Oct 18 16:48:27.691992 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3764/7505] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:27 2022] GET /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed => generated 1391 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:48:27.985630 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-344b9a07-b0e6-42f4-bfb7-340d758d6607 req-9dd46ddf-380d-4429-aec2-ff0ad7a6cd1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a8335e5-4b73-402f-b018-7497e25289ed", "name": "network-vif-plugged", "status": "completed", "tag": "6d2d9e8e-596d-4137-b10b-458f3ced6f7e"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:48:27.995866 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-344b9a07-b0e6-42f4-bfb7-340d758d6607 req-9dd46ddf-380d-4429-aec2-ff0ad7a6cd1a service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:27.996387 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-344b9a07-b0e6-42f4-bfb7-340d758d6607 req-9dd46ddf-380d-4429-aec2-ff0ad7a6cd1a service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:27.996846 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-344b9a07-b0e6-42f4-bfb7-340d758d6607 req-9dd46ddf-380d-4429-aec2-ff0ad7a6cd1a service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:28.012039 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-344b9a07-b0e6-42f4-bfb7-340d758d6607 req-9dd46ddf-380d-4429-aec2-ff0ad7a6cd1a service nova] Creating event network-vif-plugged:6d2d9e8e-596d-4137-b10b-458f3ced6f7e for instance 9a8335e5-4b73-402f-b018-7497e25289ed on n-h2-853682-5 Oct 18 16:48:28.017077 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-344b9a07-b0e6-42f4-bfb7-340d758d6607 req-9dd46ddf-380d-4429-aec2-ff0ad7a6cd1a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035131 Oct 18 16:48:28.017691 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3742/7506] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:48:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:48:28.714229 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e2058507-fe78-41de-b7c6-0377535a4073 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:28.714865 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e2058507-fe78-41de-b7c6-0377535a4073 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 9a8335e5-4b73-402f-b018-7497e25289ed] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:28.721770 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e2058507-fe78-41de-b7c6-0377535a4073 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:28.722271 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e2058507-fe78-41de-b7c6-0377535a4073 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:28.722729 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e2058507-fe78-41de-b7c6-0377535a4073 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:28.723434 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e2058507-fe78-41de-b7c6-0377535a4073 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:28.723911 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e2058507-fe78-41de-b7c6-0377535a4073 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:28.724887 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e2058507-fe78-41de-b7c6-0377535a4073 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:28.860190 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e2058507-fe78-41de-b7c6-0377535a4073 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:48:28.868661 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e2058507-fe78-41de-b7c6-0377535a4073 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed" status: 200 len: 1391 microversion: 2.1 time: 0.158357 Oct 18 16:48:28.869342 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3765/7507] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:28 2022] GET /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:48:29.965080 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:48:29.965780 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:48:29.969846 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e2c6f270-d2e8-44b4-86d0-dcfcd8cb9f70 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:29.970552 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e2c6f270-d2e8-44b4-86d0-dcfcd8cb9f70 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 9a8335e5-4b73-402f-b018-7497e25289ed] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:29.977775 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2c6f270-d2e8-44b4-86d0-dcfcd8cb9f70 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:29.978261 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2c6f270-d2e8-44b4-86d0-dcfcd8cb9f70 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:29.978701 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2c6f270-d2e8-44b4-86d0-dcfcd8cb9f70 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:29.979422 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2c6f270-d2e8-44b4-86d0-dcfcd8cb9f70 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:29.979878 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2c6f270-d2e8-44b4-86d0-dcfcd8cb9f70 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:29.980312 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2c6f270-d2e8-44b4-86d0-dcfcd8cb9f70 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:30.113261 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e2c6f270-d2e8-44b4-86d0-dcfcd8cb9f70 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:48:30.121834 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e2c6f270-d2e8-44b4-86d0-dcfcd8cb9f70 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed" status: 200 len: 1561 microversion: 2.1 time: 0.158684 Oct 18 16:48:30.122406 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3743/7508] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:29 2022] GET /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:48:30.144200 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f1111d33-d4ac-4d5f-a931-113c17a068e6 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:30.144862 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f1111d33-d4ac-4d5f-a931-113c17a068e6 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 9a8335e5-4b73-402f-b018-7497e25289ed] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:30.146815 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=6 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:48:30.153258 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f1111d33-d4ac-4d5f-a931-113c17a068e6 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:30.153765 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f1111d33-d4ac-4d5f-a931-113c17a068e6 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:30.154226 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f1111d33-d4ac-4d5f-a931-113c17a068e6 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:30.154941 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f1111d33-d4ac-4d5f-a931-113c17a068e6 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:30.155421 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f1111d33-d4ac-4d5f-a931-113c17a068e6 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:30.155870 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f1111d33-d4ac-4d5f-a931-113c17a068e6 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:30.291573 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f1111d33-d4ac-4d5f-a931-113c17a068e6 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:48:30.299491 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f1111d33-d4ac-4d5f-a931-113c17a068e6 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed" status: 200 len: 1561 microversion: 2.1 time: 0.159194 Oct 18 16:48:30.300066 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3766/7509] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:30 2022] GET /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:48:31.887981 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a22124b9-6039-495d-82a6-3f11ebb17051 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:48:31.888605 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a22124b9-6039-495d-82a6-3f11ebb17051 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 9a8335e5-4b73-402f-b018-7497e25289ed] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:31.890650 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-728e12b6-64e2-4e72-a8b3-b66b9f2226ce req-743afdca-5e56-4792-a1f2-92eb112184bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a8335e5-4b73-402f-b018-7497e25289ed", "tag": "6d2d9e8e-596d-4137-b10b-458f3ced6f7e"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:48:31.891328 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:48:31.898372 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:48:31.899585 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a22124b9-6039-495d-82a6-3f11ebb17051 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:31.900190 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a22124b9-6039-495d-82a6-3f11ebb17051 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:31.900765 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a22124b9-6039-495d-82a6-3f11ebb17051 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:31.901724 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a22124b9-6039-495d-82a6-3f11ebb17051 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:31.902206 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a22124b9-6039-495d-82a6-3f11ebb17051 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:31.902645 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a22124b9-6039-495d-82a6-3f11ebb17051 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:31.905384 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-728e12b6-64e2-4e72-a8b3-b66b9f2226ce req-743afdca-5e56-4792-a1f2-92eb112184bf service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:31.906083 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-728e12b6-64e2-4e72-a8b3-b66b9f2226ce req-743afdca-5e56-4792-a1f2-92eb112184bf service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:31.906723 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-728e12b6-64e2-4e72-a8b3-b66b9f2226ce req-743afdca-5e56-4792-a1f2-92eb112184bf service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:31.922152 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-728e12b6-64e2-4e72-a8b3-b66b9f2226ce req-743afdca-5e56-4792-a1f2-92eb112184bf service nova] Creating event network-changed:6d2d9e8e-596d-4137-b10b-458f3ced6f7e for instance 9a8335e5-4b73-402f-b018-7497e25289ed on n-h2-853682-5 Oct 18 16:48:31.927900 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-728e12b6-64e2-4e72-a8b3-b66b9f2226ce req-743afdca-5e56-4792-a1f2-92eb112184bf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041044 Oct 18 16:48:31.928902 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3767/7510] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:48:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:48:32.056438 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a22124b9-6039-495d-82a6-3f11ebb17051 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:48:32.065057 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a22124b9-6039-495d-82a6-3f11ebb17051 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed" status: 200 len: 1561 microversion: 2.1 time: 0.180780 Oct 18 16:48:32.065661 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3744/7511] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:48:31 2022] GET /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed => generated 1561 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:48:55.313000 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=38 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:48:55.313794 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:48:55.327719 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-52ded0a3-6048-4ca0-942f-efa2a18305da tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:48:55.330218 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-52ded0a3-6048-4ca0-942f-efa2a18305da tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 9a8335e5-4b73-402f-b018-7497e25289ed] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:48:55.338914 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-52ded0a3-6048-4ca0-942f-efa2a18305da tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:55.339423 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-52ded0a3-6048-4ca0-942f-efa2a18305da tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:55.339883 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-52ded0a3-6048-4ca0-942f-efa2a18305da tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:55.340607 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-52ded0a3-6048-4ca0-942f-efa2a18305da tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:48:55.341110 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-52ded0a3-6048-4ca0-942f-efa2a18305da tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:48:55.341560 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-52ded0a3-6048-4ca0-942f-efa2a18305da tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:48:55.394938 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-52ded0a3-6048-4ca0-942f-efa2a18305da tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "POST /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed/action" status: 200 len: 24571 microversion: 2.1 time: 0.083986 Oct 18 16:48:55.395597 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3768/7512] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:48:55 2022] POST /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed/action => generated 24571 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:49:01.778855 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ee8ccf46-3f16-460a-a186-d29213f05afe tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:49:01.781110 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ee8ccf46-3f16-460a-a186-d29213f05afe tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 9a8335e5-4b73-402f-b018-7497e25289ed] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:49:01.783691 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:49:01.784335 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=36 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:49:01.790798 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee8ccf46-3f16-460a-a186-d29213f05afe tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:01.791279 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee8ccf46-3f16-460a-a186-d29213f05afe tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:01.791716 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee8ccf46-3f16-460a-a186-d29213f05afe tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:01.792412 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee8ccf46-3f16-460a-a186-d29213f05afe tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:01.792896 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee8ccf46-3f16-460a-a186-d29213f05afe tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:01.793321 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee8ccf46-3f16-460a-a186-d29213f05afe tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:01.866228 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ee8ccf46-3f16-460a-a186-d29213f05afe tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "POST /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed/action" status: 202 len: 0 microversion: 2.1 time: 0.091037 Oct 18 16:49:01.866890 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3745/7513] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:49:01 2022] POST /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:49:01.876230 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2c4f0ca9-ecaa-4d06-b187-38010f3d294a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:49:01.877072 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2c4f0ca9-ecaa-4d06-b187-38010f3d294a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 9a8335e5-4b73-402f-b018-7497e25289ed] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:49:01.885232 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c4f0ca9-ecaa-4d06-b187-38010f3d294a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:01.885816 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c4f0ca9-ecaa-4d06-b187-38010f3d294a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:01.886344 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c4f0ca9-ecaa-4d06-b187-38010f3d294a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:01.887485 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c4f0ca9-ecaa-4d06-b187-38010f3d294a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:01.887963 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c4f0ca9-ecaa-4d06-b187-38010f3d294a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:01.888409 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2c4f0ca9-ecaa-4d06-b187-38010f3d294a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:02.029442 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2c4f0ca9-ecaa-4d06-b187-38010f3d294a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:49:02.038334 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2c4f0ca9-ecaa-4d06-b187-38010f3d294a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed" status: 200 len: 1671 microversion: 2.1 time: 0.165821 Oct 18 16:49:02.038937 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3769/7514] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:49:01 2022] GET /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed => generated 1671 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:49:03.063748 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4a488495-5666-4bae-9f08-f6430216e54a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:49:03.064491 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4a488495-5666-4bae-9f08-f6430216e54a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 9a8335e5-4b73-402f-b018-7497e25289ed] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:49:03.070810 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a488495-5666-4bae-9f08-f6430216e54a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:03.071304 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a488495-5666-4bae-9f08-f6430216e54a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:03.071748 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a488495-5666-4bae-9f08-f6430216e54a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:03.072450 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a488495-5666-4bae-9f08-f6430216e54a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:03.072938 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a488495-5666-4bae-9f08-f6430216e54a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:03.073372 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a488495-5666-4bae-9f08-f6430216e54a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:03.208627 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4a488495-5666-4bae-9f08-f6430216e54a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:49:03.217021 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4a488495-5666-4bae-9f08-f6430216e54a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed" status: 200 len: 1676 microversion: 2.1 time: 0.158627 Oct 18 16:49:03.217597 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3746/7515] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:49:03 2022] GET /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:49:04.239950 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7a989978-be16-43f5-976d-c0041f635c00 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:49:04.240580 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7a989978-be16-43f5-976d-c0041f635c00 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 9a8335e5-4b73-402f-b018-7497e25289ed] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:49:04.247996 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7a989978-be16-43f5-976d-c0041f635c00 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:04.248495 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7a989978-be16-43f5-976d-c0041f635c00 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:04.248987 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7a989978-be16-43f5-976d-c0041f635c00 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:04.249699 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7a989978-be16-43f5-976d-c0041f635c00 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:04.250169 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7a989978-be16-43f5-976d-c0041f635c00 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:04.250611 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7a989978-be16-43f5-976d-c0041f635c00 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:04.386439 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7a989978-be16-43f5-976d-c0041f635c00 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:49:04.394334 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7a989978-be16-43f5-976d-c0041f635c00 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed" status: 200 len: 1676 microversion: 2.1 time: 0.158312 Oct 18 16:49:04.394910 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3770/7516] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:49:04 2022] GET /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:49:05.418372 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fde705cd-9933-41fb-8986-a9599ac46ecf tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:49:05.418947 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fde705cd-9933-41fb-8986-a9599ac46ecf tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 9a8335e5-4b73-402f-b018-7497e25289ed] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:49:05.425870 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fde705cd-9933-41fb-8986-a9599ac46ecf tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:05.426360 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fde705cd-9933-41fb-8986-a9599ac46ecf tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:05.426882 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fde705cd-9933-41fb-8986-a9599ac46ecf tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:05.427505 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fde705cd-9933-41fb-8986-a9599ac46ecf tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:05.427961 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fde705cd-9933-41fb-8986-a9599ac46ecf tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:05.428391 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fde705cd-9933-41fb-8986-a9599ac46ecf tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:05.560445 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fde705cd-9933-41fb-8986-a9599ac46ecf tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:49:05.568272 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fde705cd-9933-41fb-8986-a9599ac46ecf tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed" status: 200 len: 1676 microversion: 2.1 time: 0.153969 Oct 18 16:49:05.568867 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3747/7517] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:49:05 2022] GET /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:49:06.592337 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6221b23a-dc6b-4262-8ed2-43efbf809608 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:49:06.593031 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6221b23a-dc6b-4262-8ed2-43efbf809608 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 9a8335e5-4b73-402f-b018-7497e25289ed] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:49:06.599947 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6221b23a-dc6b-4262-8ed2-43efbf809608 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:06.600447 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6221b23a-dc6b-4262-8ed2-43efbf809608 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:06.601518 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6221b23a-dc6b-4262-8ed2-43efbf809608 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:06.602233 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6221b23a-dc6b-4262-8ed2-43efbf809608 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:06.602711 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6221b23a-dc6b-4262-8ed2-43efbf809608 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:06.603154 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6221b23a-dc6b-4262-8ed2-43efbf809608 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:06.739957 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6221b23a-dc6b-4262-8ed2-43efbf809608 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:49:06.747884 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6221b23a-dc6b-4262-8ed2-43efbf809608 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed" status: 200 len: 1676 microversion: 2.1 time: 0.159556 Oct 18 16:49:06.748454 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3771/7518] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:49:06 2022] GET /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:49:07.771578 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6be61918-51e4-4f7e-a609-b48a1b5cdebc tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:49:07.772133 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6be61918-51e4-4f7e-a609-b48a1b5cdebc tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 9a8335e5-4b73-402f-b018-7497e25289ed] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:49:07.779660 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6be61918-51e4-4f7e-a609-b48a1b5cdebc tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:07.780150 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6be61918-51e4-4f7e-a609-b48a1b5cdebc tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:07.780592 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6be61918-51e4-4f7e-a609-b48a1b5cdebc tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:07.781325 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6be61918-51e4-4f7e-a609-b48a1b5cdebc tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:07.781788 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6be61918-51e4-4f7e-a609-b48a1b5cdebc tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:07.782217 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6be61918-51e4-4f7e-a609-b48a1b5cdebc tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:07.918220 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6be61918-51e4-4f7e-a609-b48a1b5cdebc tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:49:07.925998 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6be61918-51e4-4f7e-a609-b48a1b5cdebc tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed" status: 200 len: 1676 microversion: 2.1 time: 0.158695 Oct 18 16:49:07.926576 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3748/7519] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:49:07 2022] GET /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:49:08.951877 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-173adfae-db35-4872-8e08-e7268c53efb3 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:49:08.952433 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-173adfae-db35-4872-8e08-e7268c53efb3 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 9a8335e5-4b73-402f-b018-7497e25289ed] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:49:08.959315 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-173adfae-db35-4872-8e08-e7268c53efb3 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:08.959819 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-173adfae-db35-4872-8e08-e7268c53efb3 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:08.960274 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-173adfae-db35-4872-8e08-e7268c53efb3 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:08.961592 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-173adfae-db35-4872-8e08-e7268c53efb3 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:08.962069 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-173adfae-db35-4872-8e08-e7268c53efb3 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:08.962515 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-173adfae-db35-4872-8e08-e7268c53efb3 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:09.095001 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-173adfae-db35-4872-8e08-e7268c53efb3 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:49:09.102698 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-173adfae-db35-4872-8e08-e7268c53efb3 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed" status: 200 len: 1676 microversion: 2.1 time: 0.154889 Oct 18 16:49:09.103269 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3772/7520] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:49:08 2022] GET /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:49:10.126571 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-11098d3b-1f88-4ff0-a738-f8387aac3653 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:49:10.127194 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-11098d3b-1f88-4ff0-a738-f8387aac3653 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 9a8335e5-4b73-402f-b018-7497e25289ed] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:49:10.134902 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-11098d3b-1f88-4ff0-a738-f8387aac3653 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:10.135387 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-11098d3b-1f88-4ff0-a738-f8387aac3653 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:10.135829 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-11098d3b-1f88-4ff0-a738-f8387aac3653 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:10.136539 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-11098d3b-1f88-4ff0-a738-f8387aac3653 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:10.137039 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-11098d3b-1f88-4ff0-a738-f8387aac3653 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:10.137473 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-11098d3b-1f88-4ff0-a738-f8387aac3653 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:10.268087 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-11098d3b-1f88-4ff0-a738-f8387aac3653 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:49:10.275996 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-11098d3b-1f88-4ff0-a738-f8387aac3653 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed" status: 200 len: 1676 microversion: 2.1 time: 0.153379 Oct 18 16:49:10.276567 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3749/7521] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:49:10 2022] GET /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:49:11.299683 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5d9eaeec-b85d-4c9e-985c-c085654315d5 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:49:11.300316 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5d9eaeec-b85d-4c9e-985c-c085654315d5 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 9a8335e5-4b73-402f-b018-7497e25289ed] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:49:11.307612 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5d9eaeec-b85d-4c9e-985c-c085654315d5 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:11.308108 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5d9eaeec-b85d-4c9e-985c-c085654315d5 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:11.308560 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5d9eaeec-b85d-4c9e-985c-c085654315d5 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:11.309308 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5d9eaeec-b85d-4c9e-985c-c085654315d5 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:11.309781 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5d9eaeec-b85d-4c9e-985c-c085654315d5 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:11.310220 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5d9eaeec-b85d-4c9e-985c-c085654315d5 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:11.437315 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5d9eaeec-b85d-4c9e-985c-c085654315d5 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:49:11.445112 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5d9eaeec-b85d-4c9e-985c-c085654315d5 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed" status: 200 len: 1676 microversion: 2.1 time: 0.149349 Oct 18 16:49:11.445690 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3773/7522] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:49:11 2022] GET /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:49:12.467617 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-54463142-c9ff-4991-80c5-c712abf71fc0 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:49:12.468233 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-54463142-c9ff-4991-80c5-c712abf71fc0 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 9a8335e5-4b73-402f-b018-7497e25289ed] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:49:12.474958 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54463142-c9ff-4991-80c5-c712abf71fc0 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:12.475422 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54463142-c9ff-4991-80c5-c712abf71fc0 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:12.475857 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54463142-c9ff-4991-80c5-c712abf71fc0 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:12.476538 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54463142-c9ff-4991-80c5-c712abf71fc0 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:12.477019 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54463142-c9ff-4991-80c5-c712abf71fc0 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:12.477652 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54463142-c9ff-4991-80c5-c712abf71fc0 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:12.611928 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-54463142-c9ff-4991-80c5-c712abf71fc0 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:49:12.620423 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-54463142-c9ff-4991-80c5-c712abf71fc0 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed" status: 200 len: 1676 microversion: 2.1 time: 0.156727 Oct 18 16:49:12.621025 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3750/7523] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:49:12 2022] GET /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:49:13.643587 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-264b6a71-6772-4487-8a23-8dd6ca470459 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:49:13.644220 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-264b6a71-6772-4487-8a23-8dd6ca470459 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 9a8335e5-4b73-402f-b018-7497e25289ed] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:49:13.651152 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-264b6a71-6772-4487-8a23-8dd6ca470459 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:13.651652 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-264b6a71-6772-4487-8a23-8dd6ca470459 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:13.652130 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-264b6a71-6772-4487-8a23-8dd6ca470459 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:13.652860 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-264b6a71-6772-4487-8a23-8dd6ca470459 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:13.653335 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-264b6a71-6772-4487-8a23-8dd6ca470459 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:13.653777 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-264b6a71-6772-4487-8a23-8dd6ca470459 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:13.788132 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-264b6a71-6772-4487-8a23-8dd6ca470459 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:49:13.795840 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-264b6a71-6772-4487-8a23-8dd6ca470459 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed" status: 200 len: 1679 microversion: 2.1 time: 0.156208 Oct 18 16:49:13.796411 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3774/7524] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:49:13 2022] GET /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:49:37.983886 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fc345c84-e370-40b6-a963-02360ffd5634 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:49:37.986078 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fc345c84-e370-40b6-a963-02360ffd5634 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 9a8335e5-4b73-402f-b018-7497e25289ed] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:49:37.988695 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=12 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:49:37.989518 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:49:37.996326 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc345c84-e370-40b6-a963-02360ffd5634 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:37.996326 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc345c84-e370-40b6-a963-02360ffd5634 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:37.996984 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc345c84-e370-40b6-a963-02360ffd5634 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:37.997360 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc345c84-e370-40b6-a963-02360ffd5634 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:37.997928 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc345c84-e370-40b6-a963-02360ffd5634 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:37.998235 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc345c84-e370-40b6-a963-02360ffd5634 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:38.054156 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fc345c84-e370-40b6-a963-02360ffd5634 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "POST /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed/action" status: 200 len: 68954 microversion: 2.1 time: 0.074240 Oct 18 16:49:38.054843 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3751/7525] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:49:37 2022] POST /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed/action => generated 68954 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:49:45.353257 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5897de77-f422-4908-a2cb-58f03fcc1426 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:49:45.353855 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5897de77-f422-4908-a2cb-58f03fcc1426 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 9a8335e5-4b73-402f-b018-7497e25289ed] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:49:45.356211 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=14 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:49:45.356948 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=40 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:49:45.358379 n-d-853682-5 devstack@n-api.service[120405]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 16:49:45.358619 n-d-853682-5 devstack@n-api.service[120405]: Tue Oct 18 16:49:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed (ip 10.222.0.60) !!! Oct 18 16:49:45.372827 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5897de77-f422-4908-a2cb-58f03fcc1426 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:45.373782 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5897de77-f422-4908-a2cb-58f03fcc1426 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:45.373782 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5897de77-f422-4908-a2cb-58f03fcc1426 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:45.374943 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5897de77-f422-4908-a2cb-58f03fcc1426 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:45.375430 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5897de77-f422-4908-a2cb-58f03fcc1426 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:45.375879 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5897de77-f422-4908-a2cb-58f03fcc1426 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:45.410043 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5897de77-f422-4908-a2cb-58f03fcc1426 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 9a8335e5-4b73-402f-b018-7497e25289ed] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:49:45.458378 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-c4579af1-3308-4010-aea9-c2407bb7da6a req-269f7cee-1aa6-4ce4-b95e-26c64ea3f9d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a8335e5-4b73-402f-b018-7497e25289ed", "tag": "6d2d9e8e-596d-4137-b10b-458f3ced6f7e"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:49:45.468453 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c4579af1-3308-4010-aea9-c2407bb7da6a req-269f7cee-1aa6-4ce4-b95e-26c64ea3f9d2 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:45.469227 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c4579af1-3308-4010-aea9-c2407bb7da6a req-269f7cee-1aa6-4ce4-b95e-26c64ea3f9d2 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:45.469844 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c4579af1-3308-4010-aea9-c2407bb7da6a req-269f7cee-1aa6-4ce4-b95e-26c64ea3f9d2 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:45.482467 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-c4579af1-3308-4010-aea9-c2407bb7da6a req-269f7cee-1aa6-4ce4-b95e-26c64ea3f9d2 service nova] Creating event network-changed:6d2d9e8e-596d-4137-b10b-458f3ced6f7e for instance 9a8335e5-4b73-402f-b018-7497e25289ed on n-h2-853682-5 Oct 18 16:49:45.487954 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-c4579af1-3308-4010-aea9-c2407bb7da6a req-269f7cee-1aa6-4ce4-b95e-26c64ea3f9d2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137591 Oct 18 16:49:45.492290 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3752/7526] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:49:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:49:45.500716 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5897de77-f422-4908-a2cb-58f03fcc1426 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed" status: 204 len: 0 microversion: 2.1 time: 0.154506 Oct 18 16:49:45.502060 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3775/7527] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 16:49:45 2022] DELETE /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:49:45.511770 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6ce66682-9271-495a-8dfc-2b707ebc888c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:49:45.512769 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6ce66682-9271-495a-8dfc-2b707ebc888c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 9a8335e5-4b73-402f-b018-7497e25289ed] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:49:45.519699 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ce66682-9271-495a-8dfc-2b707ebc888c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:45.520187 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ce66682-9271-495a-8dfc-2b707ebc888c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:45.520623 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ce66682-9271-495a-8dfc-2b707ebc888c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:45.521560 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ce66682-9271-495a-8dfc-2b707ebc888c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:45.522024 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ce66682-9271-495a-8dfc-2b707ebc888c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:45.522454 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ce66682-9271-495a-8dfc-2b707ebc888c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:45.718261 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6ce66682-9271-495a-8dfc-2b707ebc888c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:49:45.726406 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6ce66682-9271-495a-8dfc-2b707ebc888c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed" status: 200 len: 1685 microversion: 2.1 time: 0.219906 Oct 18 16:49:45.726995 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3753/7528] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:49:45 2022] GET /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed => generated 1685 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:49:46.753720 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8bdbb104-c146-4021-aa44-66e9b092cb09 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:49:46.754444 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8bdbb104-c146-4021-aa44-66e9b092cb09 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 9a8335e5-4b73-402f-b018-7497e25289ed] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:49:46.761936 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8bdbb104-c146-4021-aa44-66e9b092cb09 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:46.762456 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8bdbb104-c146-4021-aa44-66e9b092cb09 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:46.762914 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8bdbb104-c146-4021-aa44-66e9b092cb09 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:46.763644 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8bdbb104-c146-4021-aa44-66e9b092cb09 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:46.764122 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8bdbb104-c146-4021-aa44-66e9b092cb09 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:46.764570 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8bdbb104-c146-4021-aa44-66e9b092cb09 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:46.952842 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8bdbb104-c146-4021-aa44-66e9b092cb09 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:49:46.963855 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8bdbb104-c146-4021-aa44-66e9b092cb09 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed" status: 200 len: 1685 microversion: 2.1 time: 0.214351 Oct 18 16:49:46.964443 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3776/7529] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:49:46 2022] GET /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed => generated 1685 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:49:47.593280 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-b7427896-9f1e-48e9-bb8a-ea7e78a299e6 req-792691f1-63e5-430d-98fd-63e44558af61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a8335e5-4b73-402f-b018-7497e25289ed", "name": "network-vif-deleted", "tag": "6d2d9e8e-596d-4137-b10b-458f3ced6f7e"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:49:47.604340 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b7427896-9f1e-48e9-bb8a-ea7e78a299e6 req-792691f1-63e5-430d-98fd-63e44558af61 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:47.604965 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b7427896-9f1e-48e9-bb8a-ea7e78a299e6 req-792691f1-63e5-430d-98fd-63e44558af61 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:47.605293 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b7427896-9f1e-48e9-bb8a-ea7e78a299e6 req-792691f1-63e5-430d-98fd-63e44558af61 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:47.617472 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-b7427896-9f1e-48e9-bb8a-ea7e78a299e6 req-792691f1-63e5-430d-98fd-63e44558af61 service nova] Creating event network-vif-deleted:6d2d9e8e-596d-4137-b10b-458f3ced6f7e for instance 9a8335e5-4b73-402f-b018-7497e25289ed on n-h2-853682-5 Oct 18 16:49:47.622934 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-b7427896-9f1e-48e9-bb8a-ea7e78a299e6 req-792691f1-63e5-430d-98fd-63e44558af61 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033449 Oct 18 16:49:47.623551 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3754/7530] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:49:47.988196 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0a66a07e-4de9-46b3-b448-0290087a2b95 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:49:47.989066 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0a66a07e-4de9-46b3-b448-0290087a2b95 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 9a8335e5-4b73-402f-b018-7497e25289ed] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:49:47.997219 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0a66a07e-4de9-46b3-b448-0290087a2b95 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:47.998248 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0a66a07e-4de9-46b3-b448-0290087a2b95 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:47.998513 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0a66a07e-4de9-46b3-b448-0290087a2b95 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:47.999477 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0a66a07e-4de9-46b3-b448-0290087a2b95 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:48.000505 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0a66a07e-4de9-46b3-b448-0290087a2b95 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:48.001000 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0a66a07e-4de9-46b3-b448-0290087a2b95 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:48.035146 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0a66a07e-4de9-46b3-b448-0290087a2b95 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:48.035651 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0a66a07e-4de9-46b3-b448-0290087a2b95 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:48.036148 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0a66a07e-4de9-46b3-b448-0290087a2b95 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:48.036596 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-0a66a07e-4de9-46b3-b448-0290087a2b95 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lazy-loading 'fault' on Instance uuid 9a8335e5-4b73-402f-b018-7497e25289ed {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:49:48.079159 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0a66a07e-4de9-46b3-b448-0290087a2b95 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:49:48.086944 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0a66a07e-4de9-46b3-b448-0290087a2b95 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed" status: 200 len: 1356 microversion: 2.1 time: 0.102876 Oct 18 16:49:48.087734 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3777/7531] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:49:47 2022] GET /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed => generated 1356 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:49:49.111819 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f7736f4b-1222-4de8-8e7f-110da5fae3f1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:49:49.112525 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f7736f4b-1222-4de8-8e7f-110da5fae3f1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 9a8335e5-4b73-402f-b018-7497e25289ed] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:49:49.119295 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7736f4b-1222-4de8-8e7f-110da5fae3f1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:49.119781 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7736f4b-1222-4de8-8e7f-110da5fae3f1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:49.120222 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7736f4b-1222-4de8-8e7f-110da5fae3f1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:49.120944 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7736f4b-1222-4de8-8e7f-110da5fae3f1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:49.121404 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7736f4b-1222-4de8-8e7f-110da5fae3f1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:49.121832 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7736f4b-1222-4de8-8e7f-110da5fae3f1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:49.135785 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-f7736f4b-1222-4de8-8e7f-110da5fae3f1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] HTTP exception thrown: Instance 9a8335e5-4b73-402f-b018-7497e25289ed could not be found. Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f7736f4b-1222-4de8-8e7f-110da5fae3f1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Request method failure captured: Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed HTTP/1.1 Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTthsYkwDcRi6ejpHtt4H8SQkGaHFzHuIXkg1m4QUw3Qt5Uv9NPiBxRcaK-NQwUI3S4BWwnXo3saj3Q2PKxNAS-I0ST7wp5S5RSkuwZEJ12enI0qMMMoKC1L1prWuMDD4oklSgZx5x8J281mShnqu67jB5xP0xd3PanqU2RBtQqY8QyI Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: f588c570d1c3475598357e7d21cd64f2 Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2023049857 Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f588c570d1c3475598357e7d21cd64f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f588c570d1c3475598357e7d21cd64f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f588c570d1c3475598357e7d21cd64f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f588c570d1c3475598357e7d21cd64f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2023049857 Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: f588c570d1c3475598357e7d21cd64f2 Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2023049857 Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-TestNetworkAdvancedServerOps-2023049857-project Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: a0040ae38b5542b9ac7d87de246e7108 Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2023049857-project Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 9a8335e5-4b73-402f-b018-7497e25289ed could not be found. Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '9a8335e5-4b73-402f-b018-7497e25289ed'} Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a8335e5-4b73-402f-b018-7497e25289ed could not be found. Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a8335e5-4b73-402f-b018-7497e25289ed could not be found. Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:49:49.137469 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:49:49.143103 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:49:49.143103 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:49:49.143103 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:49:49.143103 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:49:49.143103 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:49:49.143103 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:49:49.143103 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a8335e5-4b73-402f-b018-7497e25289ed could not be found. Oct 18 16:49:49.143103 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:49:49.143103 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f7736f4b-1222-4de8-8e7f-110da5fae3f1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Returning 404 to user: Instance 9a8335e5-4b73-402f-b018-7497e25289ed could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:49:49.143103 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f7736f4b-1222-4de8-8e7f-110da5fae3f1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed" status: 404 len: 111 microversion: 2.1 time: 0.032327 Oct 18 16:49:49.143103 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3755/7532] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:49:49 2022] GET /compute/v2.1/servers/9a8335e5-4b73-402f-b018-7497e25289ed => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:49:52.190331 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-409bd1c0-af40-4aad-aee9-e9f5fd2f1262 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '.version_select at 0x7f7c3d3bcaf0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:49:52.212663 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-409bd1c0-af40-4aad-aee9-e9f5fd2f1262 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-634055617" status: 202 len: 0 microversion: 2.1 time: 0.025952 Oct 18 16:49:52.213389 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3778/7533] 10.222.0.60 () {58 vars in 1281 bytes} [Tue Oct 18 16:49:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-634055617 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:49:52.241967 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-768f3ead-4d92-4ed0-8ffe-a9acd2fc1d69 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Action: 'create', calling method: .version_select at 0x7f7c37a74a60>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1252614290", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH83O79EslDj8C9aJWMmb6Pvvt6vCW7kpxLx4rnyhkcwupRIqTqlaextkznerGRl9HOTm24F6XG41vPsh+iHWOEX2GwdnWzYyMmtitcXhcqbpW5jZx6Pc+J+5Sm+hcbs3w=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:49:52.259183 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-768f3ead-4d92-4ed0-8ffe-a9acd2fc1d69 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Getting quotas for project f588c570d1c3475598357e7d21cd64f2. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:49:52.264844 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-768f3ead-4d92-4ed0-8ffe-a9acd2fc1d69 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Getting quotas for user a0040ae38b5542b9ac7d87de246e7108 and project f588c570d1c3475598357e7d21cd64f2. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:49:52.288402 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-768f3ead-4d92-4ed0-8ffe-a9acd2fc1d69 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.050364 Oct 18 16:49:52.289028 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3756/7534] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Oct 18 16:49:52 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:49:58.013923 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6d264fd7-9c9c-4d2c-9d11-f88222984b36 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1836772427", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "b91e4d29-f15a-4993-bccc-118051405009"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1252614290", "security_groups": [{"name": "tempest-secgroup-smoke-749176685"}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:49:58.083261 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:49:58.130623 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-6d264fd7-9c9c-4d2c-9d11-f88222984b36 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] validate_networks() for [('b91e4d29-f15a-4993-bccc-118051405009', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 16:49:58.619869 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-6d264fd7-9c9c-4d2c-9d11-f88222984b36 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:49:58.620312 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-6d264fd7-9c9c-4d2c-9d11-f88222984b36 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:49:58.620845 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-6d264fd7-9c9c-4d2c-9d11-f88222984b36 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:49:58.621473 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-6d264fd7-9c9c-4d2c-9d11-f88222984b36 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:49:58.621985 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-6d264fd7-9c9c-4d2c-9d11-f88222984b36 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:49:58.630975 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6d264fd7-9c9c-4d2c-9d11-f88222984b36 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:58.631469 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6d264fd7-9c9c-4d2c-9d11-f88222984b36 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:58.631922 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6d264fd7-9c9c-4d2c-9d11-f88222984b36 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:58.632666 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6d264fd7-9c9c-4d2c-9d11-f88222984b36 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:58.633448 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6d264fd7-9c9c-4d2c-9d11-f88222984b36 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:58.633895 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6d264fd7-9c9c-4d2c-9d11-f88222984b36 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:58.652773 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-6d264fd7-9c9c-4d2c-9d11-f88222984b36 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Getting quotas for project f588c570d1c3475598357e7d21cd64f2. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:49:58.658341 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-6d264fd7-9c9c-4d2c-9d11-f88222984b36 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Getting quotas for user a0040ae38b5542b9ac7d87de246e7108 and project f588c570d1c3475598357e7d21cd64f2. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:49:58.672128 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6d264fd7-9c9c-4d2c-9d11-f88222984b36 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:49:58.674842 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6d264fd7-9c9c-4d2c-9d11-f88222984b36 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:49:58.733475 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6d264fd7-9c9c-4d2c-9d11-f88222984b36 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.726573 Oct 18 16:49:58.742231 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3779/7535] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 16:49:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:49:58.746982 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-91933cd9-27c6-43d1-9a8e-e91be9438aa1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:49:58.747617 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-91933cd9-27c6-43d1-9a8e-e91be9438aa1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:49:58.811942 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-91933cd9-27c6-43d1-9a8e-e91be9438aa1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:49:58.827249 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-91933cd9-27c6-43d1-9a8e-e91be9438aa1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44" status: 200 len: 1267 microversion: 2.1 time: 0.085154 Oct 18 16:49:58.827857 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3757/7536] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:49:58 2022] GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44 => generated 1267 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:49:59.852454 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-cd921a3c-d0dd-4232-9042-703f7f3e2c82 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:49:59.853817 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-cd921a3c-d0dd-4232-9042-703f7f3e2c82 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:49:59.861154 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cd921a3c-d0dd-4232-9042-703f7f3e2c82 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:59.861661 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cd921a3c-d0dd-4232-9042-703f7f3e2c82 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:59.862118 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cd921a3c-d0dd-4232-9042-703f7f3e2c82 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:59.862848 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cd921a3c-d0dd-4232-9042-703f7f3e2c82 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:49:59.863326 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cd921a3c-d0dd-4232-9042-703f7f3e2c82 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:49:59.863776 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cd921a3c-d0dd-4232-9042-703f7f3e2c82 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:49:59.958697 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-cd921a3c-d0dd-4232-9042-703f7f3e2c82 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:49:59.978313 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-cd921a3c-d0dd-4232-9042-703f7f3e2c82 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44" status: 200 len: 1319 microversion: 2.1 time: 0.130440 Oct 18 16:49:59.979594 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3780/7537] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:49:59 2022] GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44 => generated 1319 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:50:01.002754 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-771018eb-511c-417a-907c-0e0f67c0c362 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:50:01.003375 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-771018eb-511c-417a-907c-0e0f67c0c362 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:50:01.006650 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=16 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:50:01.019336 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-771018eb-511c-417a-907c-0e0f67c0c362 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:50:01.019668 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-771018eb-511c-417a-907c-0e0f67c0c362 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:50:01.020110 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-771018eb-511c-417a-907c-0e0f67c0c362 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:50:01.020854 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-771018eb-511c-417a-907c-0e0f67c0c362 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:50:01.021503 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-771018eb-511c-417a-907c-0e0f67c0c362 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:50:01.022110 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-771018eb-511c-417a-907c-0e0f67c0c362 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:50:01.179400 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-771018eb-511c-417a-907c-0e0f67c0c362 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:50:01.188160 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-771018eb-511c-417a-907c-0e0f67c0c362 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44" status: 200 len: 1392 microversion: 2.1 time: 0.189662 Oct 18 16:50:01.188773 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3758/7538] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:50:00 2022] GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44 => generated 1392 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:50:01.623315 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-28d03e12-2408-4e3c-a071-6b7cb4161f5f req-6faa7ecb-bb2e-4d76-a069-266d679d6871 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44", "tag": "e5526313-2e26-4e66-8998-bc6595d3d123"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:50:01.633213 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-28d03e12-2408-4e3c-a071-6b7cb4161f5f req-6faa7ecb-bb2e-4d76-a069-266d679d6871 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:50:01.633708 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-28d03e12-2408-4e3c-a071-6b7cb4161f5f req-6faa7ecb-bb2e-4d76-a069-266d679d6871 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:50:01.634187 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-28d03e12-2408-4e3c-a071-6b7cb4161f5f req-6faa7ecb-bb2e-4d76-a069-266d679d6871 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:50:01.645206 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-28d03e12-2408-4e3c-a071-6b7cb4161f5f req-6faa7ecb-bb2e-4d76-a069-266d679d6871 service nova] Creating event network-changed:e5526313-2e26-4e66-8998-bc6595d3d123 for instance 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44 on n-h1-853682-5 Oct 18 16:50:01.650279 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-28d03e12-2408-4e3c-a071-6b7cb4161f5f req-6faa7ecb-bb2e-4d76-a069-266d679d6871 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098195 Oct 18 16:50:01.650899 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3781/7539] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:50:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:50:02.211897 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ca868dc3-9754-4da9-8231-11fcb2eb5e48 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:50:02.212675 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ca868dc3-9754-4da9-8231-11fcb2eb5e48 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:50:02.220055 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca868dc3-9754-4da9-8231-11fcb2eb5e48 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:50:02.220542 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca868dc3-9754-4da9-8231-11fcb2eb5e48 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:50:02.221013 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca868dc3-9754-4da9-8231-11fcb2eb5e48 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:50:02.221717 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca868dc3-9754-4da9-8231-11fcb2eb5e48 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:50:02.222177 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca868dc3-9754-4da9-8231-11fcb2eb5e48 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:50:02.222609 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca868dc3-9754-4da9-8231-11fcb2eb5e48 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:50:02.357319 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ca868dc3-9754-4da9-8231-11fcb2eb5e48 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:50:02.365164 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ca868dc3-9754-4da9-8231-11fcb2eb5e48 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44" status: 200 len: 1392 microversion: 2.1 time: 0.157199 Oct 18 16:50:02.365739 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3759/7540] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:50:02 2022] GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:50:03.389053 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-68f2ab6a-e1b9-4958-8f2d-226d428d0776 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:50:03.389775 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-68f2ab6a-e1b9-4958-8f2d-226d428d0776 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:50:03.395994 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-68f2ab6a-e1b9-4958-8f2d-226d428d0776 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:50:03.396499 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-68f2ab6a-e1b9-4958-8f2d-226d428d0776 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:50:03.396986 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-68f2ab6a-e1b9-4958-8f2d-226d428d0776 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:50:03.397724 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-68f2ab6a-e1b9-4958-8f2d-226d428d0776 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:50:03.398197 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-68f2ab6a-e1b9-4958-8f2d-226d428d0776 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:50:03.398641 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-68f2ab6a-e1b9-4958-8f2d-226d428d0776 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:50:03.535009 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-68f2ab6a-e1b9-4958-8f2d-226d428d0776 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:50:03.543228 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-68f2ab6a-e1b9-4958-8f2d-226d428d0776 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44" status: 200 len: 1392 microversion: 2.1 time: 0.159387 Oct 18 16:50:03.543808 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3782/7541] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:50:03 2022] GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:50:04.566017 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4c2fb90d-f1e0-4cd1-b58e-4148d6ac1e50 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:50:04.566673 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4c2fb90d-f1e0-4cd1-b58e-4148d6ac1e50 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:50:04.573645 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c2fb90d-f1e0-4cd1-b58e-4148d6ac1e50 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:50:04.574136 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c2fb90d-f1e0-4cd1-b58e-4148d6ac1e50 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:50:04.574581 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c2fb90d-f1e0-4cd1-b58e-4148d6ac1e50 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:50:04.575282 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c2fb90d-f1e0-4cd1-b58e-4148d6ac1e50 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:50:04.575747 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c2fb90d-f1e0-4cd1-b58e-4148d6ac1e50 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:50:04.576183 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c2fb90d-f1e0-4cd1-b58e-4148d6ac1e50 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:50:04.714780 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4c2fb90d-f1e0-4cd1-b58e-4148d6ac1e50 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:50:04.722632 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4c2fb90d-f1e0-4cd1-b58e-4148d6ac1e50 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44" status: 200 len: 1392 microversion: 2.1 time: 0.160562 Oct 18 16:50:04.723215 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3760/7542] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:50:04 2022] GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:50:05.746841 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d5012d17-f91c-4217-892d-69eb2011fedd tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:50:05.747459 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d5012d17-f91c-4217-892d-69eb2011fedd tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:50:05.754385 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d5012d17-f91c-4217-892d-69eb2011fedd tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:50:05.754916 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d5012d17-f91c-4217-892d-69eb2011fedd tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:50:05.755375 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d5012d17-f91c-4217-892d-69eb2011fedd tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:50:05.756089 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d5012d17-f91c-4217-892d-69eb2011fedd tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:50:05.756571 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d5012d17-f91c-4217-892d-69eb2011fedd tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:50:05.757047 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d5012d17-f91c-4217-892d-69eb2011fedd tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:50:05.888375 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d5012d17-f91c-4217-892d-69eb2011fedd tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:50:05.896177 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d5012d17-f91c-4217-892d-69eb2011fedd tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44" status: 200 len: 1392 microversion: 2.1 time: 0.154126 Oct 18 16:50:05.896753 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3783/7543] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:50:05 2022] GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44 => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:50:06.869283 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-7359e839-0ed3-437e-9ba7-82a2e74476a3 req-2e726154-926c-4857-8c6b-258043af3e6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44", "name": "network-vif-plugged", "status": "completed", "tag": "e5526313-2e26-4e66-8998-bc6595d3d123"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:50:06.878908 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7359e839-0ed3-437e-9ba7-82a2e74476a3 req-2e726154-926c-4857-8c6b-258043af3e6d service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:50:06.879487 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7359e839-0ed3-437e-9ba7-82a2e74476a3 req-2e726154-926c-4857-8c6b-258043af3e6d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:50:06.879932 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7359e839-0ed3-437e-9ba7-82a2e74476a3 req-2e726154-926c-4857-8c6b-258043af3e6d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:50:06.894074 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-7359e839-0ed3-437e-9ba7-82a2e74476a3 req-2e726154-926c-4857-8c6b-258043af3e6d service nova] Creating event network-vif-plugged:e5526313-2e26-4e66-8998-bc6595d3d123 for instance 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44 on n-h1-853682-5 Oct 18 16:50:06.899365 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-7359e839-0ed3-437e-9ba7-82a2e74476a3 req-2e726154-926c-4857-8c6b-258043af3e6d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093344 Oct 18 16:50:06.900040 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3761/7544] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:50:06.919650 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4dadc5ba-aa56-4eb6-8678-73ac012bd39d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:50:06.920380 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4dadc5ba-aa56-4eb6-8678-73ac012bd39d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:50:06.927412 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4dadc5ba-aa56-4eb6-8678-73ac012bd39d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:50:06.927912 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4dadc5ba-aa56-4eb6-8678-73ac012bd39d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:50:06.928391 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4dadc5ba-aa56-4eb6-8678-73ac012bd39d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:50:06.929134 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4dadc5ba-aa56-4eb6-8678-73ac012bd39d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:50:06.929605 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4dadc5ba-aa56-4eb6-8678-73ac012bd39d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:50:06.930045 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4dadc5ba-aa56-4eb6-8678-73ac012bd39d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:50:07.087936 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4dadc5ba-aa56-4eb6-8678-73ac012bd39d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:50:07.096035 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4dadc5ba-aa56-4eb6-8678-73ac012bd39d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44" status: 200 len: 1392 microversion: 2.1 time: 0.180787 Oct 18 16:50:07.096713 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3784/7545] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:50:06 2022] GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44 => generated 1392 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:50:08.124586 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-596b68a3-e31a-43a3-9563-965d46dd96d2 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:50:08.125323 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-596b68a3-e31a-43a3-9563-965d46dd96d2 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:50:08.127270 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:50:08.133558 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-596b68a3-e31a-43a3-9563-965d46dd96d2 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:50:08.134549 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-596b68a3-e31a-43a3-9563-965d46dd96d2 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:50:08.134983 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-596b68a3-e31a-43a3-9563-965d46dd96d2 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:50:08.135676 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-596b68a3-e31a-43a3-9563-965d46dd96d2 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:50:08.136129 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-596b68a3-e31a-43a3-9563-965d46dd96d2 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:50:08.136554 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-596b68a3-e31a-43a3-9563-965d46dd96d2 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:50:08.269995 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-596b68a3-e31a-43a3-9563-965d46dd96d2 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:50:08.278495 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-596b68a3-e31a-43a3-9563-965d46dd96d2 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44" status: 200 len: 1392 microversion: 2.1 time: 0.159195 Oct 18 16:50:08.279068 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3762/7546] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:50:08 2022] GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:50:09.302048 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-cd5cc56f-56cc-4c8c-a0c0-ec4af53c7d1a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:50:09.302688 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-cd5cc56f-56cc-4c8c-a0c0-ec4af53c7d1a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:50:09.305499 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:50:09.306201 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=6 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:50:09.312369 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cd5cc56f-56cc-4c8c-a0c0-ec4af53c7d1a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:50:09.312917 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cd5cc56f-56cc-4c8c-a0c0-ec4af53c7d1a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:50:09.313379 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cd5cc56f-56cc-4c8c-a0c0-ec4af53c7d1a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:50:09.314093 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cd5cc56f-56cc-4c8c-a0c0-ec4af53c7d1a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:50:09.314571 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cd5cc56f-56cc-4c8c-a0c0-ec4af53c7d1a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:50:09.315020 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cd5cc56f-56cc-4c8c-a0c0-ec4af53c7d1a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:50:09.446472 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-cd5cc56f-56cc-4c8c-a0c0-ec4af53c7d1a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:50:09.454249 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-cd5cc56f-56cc-4c8c-a0c0-ec4af53c7d1a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44" status: 200 len: 1564 microversion: 2.1 time: 0.156168 Oct 18 16:50:09.454820 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3785/7547] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:50:09 2022] GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44 => generated 1564 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:50:09.477055 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-10e150ba-72d5-4728-b31d-2da32929582a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:50:09.478300 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-10e150ba-72d5-4728-b31d-2da32929582a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:50:09.480172 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:50:09.486277 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10e150ba-72d5-4728-b31d-2da32929582a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:50:09.486765 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10e150ba-72d5-4728-b31d-2da32929582a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:50:09.487203 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10e150ba-72d5-4728-b31d-2da32929582a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:50:09.487898 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10e150ba-72d5-4728-b31d-2da32929582a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:50:09.488355 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10e150ba-72d5-4728-b31d-2da32929582a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:50:09.488784 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10e150ba-72d5-4728-b31d-2da32929582a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:50:09.625684 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-10e150ba-72d5-4728-b31d-2da32929582a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:50:09.633431 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-10e150ba-72d5-4728-b31d-2da32929582a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44" status: 200 len: 1564 microversion: 2.1 time: 0.160490 Oct 18 16:50:09.634744 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3763/7548] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:50:09 2022] GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44 => generated 1564 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:50:11.214678 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-276923c5-be97-4901-a1cd-59d925f94541 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:50:11.215471 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-276923c5-be97-4901-a1cd-59d925f94541 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:50:11.219844 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-ed3b4713-5cf8-491d-b6ac-e2adca853149 req-cdf6f9f4-8e4c-4b99-89f0-e836f825caa7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44", "tag": "e5526313-2e26-4e66-8998-bc6595d3d123"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:50:11.222592 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-276923c5-be97-4901-a1cd-59d925f94541 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:50:11.223371 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-276923c5-be97-4901-a1cd-59d925f94541 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:50:11.223892 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-276923c5-be97-4901-a1cd-59d925f94541 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:50:11.224872 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-276923c5-be97-4901-a1cd-59d925f94541 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:50:11.225574 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-276923c5-be97-4901-a1cd-59d925f94541 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:50:11.226245 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-276923c5-be97-4901-a1cd-59d925f94541 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:50:11.229798 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ed3b4713-5cf8-491d-b6ac-e2adca853149 req-cdf6f9f4-8e4c-4b99-89f0-e836f825caa7 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:50:11.230285 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ed3b4713-5cf8-491d-b6ac-e2adca853149 req-cdf6f9f4-8e4c-4b99-89f0-e836f825caa7 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:50:11.230723 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ed3b4713-5cf8-491d-b6ac-e2adca853149 req-cdf6f9f4-8e4c-4b99-89f0-e836f825caa7 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:50:11.242555 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-ed3b4713-5cf8-491d-b6ac-e2adca853149 req-cdf6f9f4-8e4c-4b99-89f0-e836f825caa7 service nova] Creating event network-changed:e5526313-2e26-4e66-8998-bc6595d3d123 for instance 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44 on n-h1-853682-5 Oct 18 16:50:11.248988 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-ed3b4713-5cf8-491d-b6ac-e2adca853149 req-cdf6f9f4-8e4c-4b99-89f0-e836f825caa7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035059 Oct 18 16:50:11.250002 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3764/7549] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:50:11.367319 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-276923c5-be97-4901-a1cd-59d925f94541 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:50:11.375606 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-276923c5-be97-4901-a1cd-59d925f94541 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44" status: 200 len: 1564 microversion: 2.1 time: 0.166001 Oct 18 16:50:11.376847 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3786/7550] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:50:11 2022] GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44 => generated 1564 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:50:42.657968 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=5 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:50:42.658745 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=34 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:50:42.663344 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-efa70a7c-002a-456d-81cb-40c8b92e5370 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:50:42.665683 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-efa70a7c-002a-456d-81cb-40c8b92e5370 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:50:42.672679 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-efa70a7c-002a-456d-81cb-40c8b92e5370 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:50:42.673194 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-efa70a7c-002a-456d-81cb-40c8b92e5370 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:50:42.673637 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-efa70a7c-002a-456d-81cb-40c8b92e5370 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:50:42.674342 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-efa70a7c-002a-456d-81cb-40c8b92e5370 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:50:42.674816 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-efa70a7c-002a-456d-81cb-40c8b92e5370 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:50:42.675235 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-efa70a7c-002a-456d-81cb-40c8b92e5370 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:50:42.746911 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-efa70a7c-002a-456d-81cb-40c8b92e5370 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "POST /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44/action" status: 200 len: 24571 microversion: 2.1 time: 0.091069 Oct 18 16:50:42.747569 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3765/7551] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:50:42 2022] POST /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44/action => generated 24571 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:51:13.242439 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:51:13.243210 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=40 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:51:13.247974 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-44a564a8-aa88-4ebe-8234-1d2911d22cd4 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:51:13.250371 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-44a564a8-aa88-4ebe-8234-1d2911d22cd4 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:51:13.258083 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-44a564a8-aa88-4ebe-8234-1d2911d22cd4 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:13.258585 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-44a564a8-aa88-4ebe-8234-1d2911d22cd4 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:13.259036 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-44a564a8-aa88-4ebe-8234-1d2911d22cd4 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:13.259748 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-44a564a8-aa88-4ebe-8234-1d2911d22cd4 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:13.260219 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-44a564a8-aa88-4ebe-8234-1d2911d22cd4 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:13.260660 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-44a564a8-aa88-4ebe-8234-1d2911d22cd4 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:13.303606 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-44a564a8-aa88-4ebe-8234-1d2911d22cd4 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:51:13.309712 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-44a564a8-aa88-4ebe-8234-1d2911d22cd4 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44] Old instance type m1.heat2, new instance type m1.heat {{(pid=120405) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 18 16:51:13.316271 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-44a564a8-aa88-4ebe-8234-1d2911d22cd4 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:51:13.316708 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-44a564a8-aa88-4ebe-8234-1d2911d22cd4 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:51:13.317224 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-44a564a8-aa88-4ebe-8234-1d2911d22cd4 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:51:13.317650 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-44a564a8-aa88-4ebe-8234-1d2911d22cd4 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:51:13.318078 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-44a564a8-aa88-4ebe-8234-1d2911d22cd4 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:51:13.382956 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-44a564a8-aa88-4ebe-8234-1d2911d22cd4 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "POST /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44/action" status: 202 len: 0 microversion: 2.1 time: 0.142333 Oct 18 16:51:13.383740 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3787/7552] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:51:13 2022] POST /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:51:13.393067 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d1acd49b-277b-4156-adfb-c5aeb0794673 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:51:13.393780 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d1acd49b-277b-4156-adfb-c5aeb0794673 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:51:13.396298 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:51:13.396981 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:51:13.404882 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1acd49b-277b-4156-adfb-c5aeb0794673 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:13.405535 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1acd49b-277b-4156-adfb-c5aeb0794673 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:13.406220 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1acd49b-277b-4156-adfb-c5aeb0794673 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:13.407027 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1acd49b-277b-4156-adfb-c5aeb0794673 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:13.407807 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1acd49b-277b-4156-adfb-c5aeb0794673 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:13.408515 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1acd49b-277b-4156-adfb-c5aeb0794673 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:13.554646 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d1acd49b-277b-4156-adfb-c5aeb0794673 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:51:13.563108 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d1acd49b-277b-4156-adfb-c5aeb0794673 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44" status: 200 len: 1692 microversion: 2.1 time: 0.174384 Oct 18 16:51:13.563716 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3766/7553] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:51:13 2022] GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44 => generated 1692 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:51:14.588635 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8b6ba060-12ea-4e3d-b93c-dbcd9aec3d74 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:51:14.589304 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8b6ba060-12ea-4e3d-b93c-dbcd9aec3d74 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:51:14.597030 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8b6ba060-12ea-4e3d-b93c-dbcd9aec3d74 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:14.597536 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8b6ba060-12ea-4e3d-b93c-dbcd9aec3d74 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:14.597991 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8b6ba060-12ea-4e3d-b93c-dbcd9aec3d74 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:14.598704 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8b6ba060-12ea-4e3d-b93c-dbcd9aec3d74 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:14.599182 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8b6ba060-12ea-4e3d-b93c-dbcd9aec3d74 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:14.599628 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8b6ba060-12ea-4e3d-b93c-dbcd9aec3d74 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:14.741429 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8b6ba060-12ea-4e3d-b93c-dbcd9aec3d74 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:51:14.749430 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8b6ba060-12ea-4e3d-b93c-dbcd9aec3d74 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44" status: 200 len: 1692 microversion: 2.1 time: 0.165797 Oct 18 16:51:14.750003 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3788/7554] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:51:14 2022] GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44 => generated 1692 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:51:15.774446 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-88869649-562e-45c5-88d5-ecade8230954 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:51:15.775130 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-88869649-562e-45c5-88d5-ecade8230954 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:51:15.783611 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88869649-562e-45c5-88d5-ecade8230954 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:15.784112 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88869649-562e-45c5-88d5-ecade8230954 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:15.784537 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88869649-562e-45c5-88d5-ecade8230954 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:15.785282 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88869649-562e-45c5-88d5-ecade8230954 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:15.785741 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88869649-562e-45c5-88d5-ecade8230954 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:15.786193 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88869649-562e-45c5-88d5-ecade8230954 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:15.923298 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-88869649-562e-45c5-88d5-ecade8230954 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:51:15.931201 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-88869649-562e-45c5-88d5-ecade8230954 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44" status: 200 len: 1692 microversion: 2.1 time: 0.160772 Oct 18 16:51:15.931788 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3767/7555] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:51:15 2022] GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44 => generated 1692 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:51:16.955374 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-409eb572-9910-44fd-80af-7a97f0f12afc tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:51:16.956002 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-409eb572-9910-44fd-80af-7a97f0f12afc tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:51:16.963224 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-409eb572-9910-44fd-80af-7a97f0f12afc tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:16.963720 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-409eb572-9910-44fd-80af-7a97f0f12afc tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:16.964162 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-409eb572-9910-44fd-80af-7a97f0f12afc tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:16.964886 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-409eb572-9910-44fd-80af-7a97f0f12afc tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:16.965357 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-409eb572-9910-44fd-80af-7a97f0f12afc tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:16.965792 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-409eb572-9910-44fd-80af-7a97f0f12afc tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:17.099290 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-409eb572-9910-44fd-80af-7a97f0f12afc tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:51:17.107583 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-409eb572-9910-44fd-80af-7a97f0f12afc tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44" status: 200 len: 1692 microversion: 2.1 time: 0.156188 Oct 18 16:51:17.108160 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3789/7556] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:51:16 2022] GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44 => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:51:18.131407 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2015e116-d2f9-493b-82a0-435ca4b8268b tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:51:18.132021 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2015e116-d2f9-493b-82a0-435ca4b8268b tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:51:18.138818 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2015e116-d2f9-493b-82a0-435ca4b8268b tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:18.139298 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2015e116-d2f9-493b-82a0-435ca4b8268b tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:18.139731 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2015e116-d2f9-493b-82a0-435ca4b8268b tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:18.140416 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2015e116-d2f9-493b-82a0-435ca4b8268b tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:18.140900 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2015e116-d2f9-493b-82a0-435ca4b8268b tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:18.141362 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2015e116-d2f9-493b-82a0-435ca4b8268b tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:18.271676 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2015e116-d2f9-493b-82a0-435ca4b8268b tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:51:18.279978 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2015e116-d2f9-493b-82a0-435ca4b8268b tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44" status: 200 len: 1692 microversion: 2.1 time: 0.152525 Oct 18 16:51:18.280553 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3768/7557] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:51:18 2022] GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44 => generated 1692 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:51:19.305223 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ea12d887-034e-4823-b815-73280ceaede1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:51:19.306036 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ea12d887-034e-4823-b815-73280ceaede1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:51:19.313164 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea12d887-034e-4823-b815-73280ceaede1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:19.313675 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea12d887-034e-4823-b815-73280ceaede1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:19.314132 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea12d887-034e-4823-b815-73280ceaede1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:19.314865 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea12d887-034e-4823-b815-73280ceaede1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:19.315346 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea12d887-034e-4823-b815-73280ceaede1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:19.315940 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ea12d887-034e-4823-b815-73280ceaede1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:19.454813 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ea12d887-034e-4823-b815-73280ceaede1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:51:19.462842 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ea12d887-034e-4823-b815-73280ceaede1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44" status: 200 len: 1692 microversion: 2.1 time: 0.163115 Oct 18 16:51:19.463417 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3790/7558] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:51:19 2022] GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44 => generated 1692 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:51:20.487783 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1310cca5-a757-4109-a1c3-a7ac46011aaa tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:51:20.488376 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1310cca5-a757-4109-a1c3-a7ac46011aaa tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:51:20.495325 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1310cca5-a757-4109-a1c3-a7ac46011aaa tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:20.495812 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1310cca5-a757-4109-a1c3-a7ac46011aaa tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:20.496251 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1310cca5-a757-4109-a1c3-a7ac46011aaa tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:20.496977 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1310cca5-a757-4109-a1c3-a7ac46011aaa tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:20.497437 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1310cca5-a757-4109-a1c3-a7ac46011aaa tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:20.497866 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1310cca5-a757-4109-a1c3-a7ac46011aaa tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:20.637071 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1310cca5-a757-4109-a1c3-a7ac46011aaa tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:51:20.645202 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1310cca5-a757-4109-a1c3-a7ac46011aaa tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44" status: 200 len: 1697 microversion: 2.1 time: 0.161411 Oct 18 16:51:20.645787 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3769/7559] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:51:20 2022] GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44 => generated 1697 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:51:21.669709 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-47324883-027d-4f0d-8fdd-e449053f7c16 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:51:21.671944 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-47324883-027d-4f0d-8fdd-e449053f7c16 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:51:21.677413 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-47324883-027d-4f0d-8fdd-e449053f7c16 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:21.677924 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-47324883-027d-4f0d-8fdd-e449053f7c16 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:21.678384 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-47324883-027d-4f0d-8fdd-e449053f7c16 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:21.679104 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-47324883-027d-4f0d-8fdd-e449053f7c16 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:21.679582 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-47324883-027d-4f0d-8fdd-e449053f7c16 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:21.680036 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-47324883-027d-4f0d-8fdd-e449053f7c16 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:21.813360 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-47324883-027d-4f0d-8fdd-e449053f7c16 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:51:21.821344 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-47324883-027d-4f0d-8fdd-e449053f7c16 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44" status: 200 len: 1697 microversion: 2.1 time: 0.156140 Oct 18 16:51:21.821905 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3791/7560] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:51:21 2022] GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44 => generated 1697 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:51:22.844800 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-65b95cb1-98ef-4613-ba76-b876d178abe4 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:51:22.845456 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-65b95cb1-98ef-4613-ba76-b876d178abe4 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:51:22.852280 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65b95cb1-98ef-4613-ba76-b876d178abe4 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:22.852766 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65b95cb1-98ef-4613-ba76-b876d178abe4 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:22.853240 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65b95cb1-98ef-4613-ba76-b876d178abe4 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:22.853939 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65b95cb1-98ef-4613-ba76-b876d178abe4 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:22.854400 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65b95cb1-98ef-4613-ba76-b876d178abe4 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:22.854828 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65b95cb1-98ef-4613-ba76-b876d178abe4 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:22.989348 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-65b95cb1-98ef-4613-ba76-b876d178abe4 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:51:22.997153 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-65b95cb1-98ef-4613-ba76-b876d178abe4 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44" status: 200 len: 1697 microversion: 2.1 time: 0.156253 Oct 18 16:51:22.998389 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3770/7561] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:51:22 2022] GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44 => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:51:24.020202 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e7235c4d-5669-4014-a993-aadc224575dc tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:51:24.020784 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e7235c4d-5669-4014-a993-aadc224575dc tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:51:24.027801 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e7235c4d-5669-4014-a993-aadc224575dc tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:24.028300 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e7235c4d-5669-4014-a993-aadc224575dc tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:24.029373 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e7235c4d-5669-4014-a993-aadc224575dc tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:24.030081 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e7235c4d-5669-4014-a993-aadc224575dc tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:24.030552 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e7235c4d-5669-4014-a993-aadc224575dc tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:24.030992 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e7235c4d-5669-4014-a993-aadc224575dc tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:24.162478 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e7235c4d-5669-4014-a993-aadc224575dc tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:51:24.170248 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e7235c4d-5669-4014-a993-aadc224575dc tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44" status: 200 len: 1697 microversion: 2.1 time: 0.154159 Oct 18 16:51:24.170827 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3792/7562] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:51:24 2022] GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44 => generated 1697 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:51:25.193894 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-238e6e30-995e-4e3f-8054-92a29e8e14e9 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:51:25.194544 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-238e6e30-995e-4e3f-8054-92a29e8e14e9 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:51:25.202143 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-238e6e30-995e-4e3f-8054-92a29e8e14e9 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:25.202634 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-238e6e30-995e-4e3f-8054-92a29e8e14e9 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:25.203074 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-238e6e30-995e-4e3f-8054-92a29e8e14e9 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:25.203776 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-238e6e30-995e-4e3f-8054-92a29e8e14e9 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:25.204234 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-238e6e30-995e-4e3f-8054-92a29e8e14e9 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:25.204668 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-238e6e30-995e-4e3f-8054-92a29e8e14e9 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:25.347553 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-238e6e30-995e-4e3f-8054-92a29e8e14e9 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:51:25.355584 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-238e6e30-995e-4e3f-8054-92a29e8e14e9 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44" status: 200 len: 1697 microversion: 2.1 time: 0.165704 Oct 18 16:51:25.356159 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3771/7563] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:51:25 2022] GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44 => generated 1697 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:51:26.379340 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-39591ff5-34d5-4ab9-b9f1-389f72be2e6c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:51:26.379973 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-39591ff5-34d5-4ab9-b9f1-389f72be2e6c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:51:26.387616 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-39591ff5-34d5-4ab9-b9f1-389f72be2e6c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:26.388750 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-39591ff5-34d5-4ab9-b9f1-389f72be2e6c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:26.389229 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-39591ff5-34d5-4ab9-b9f1-389f72be2e6c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:26.389935 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-39591ff5-34d5-4ab9-b9f1-389f72be2e6c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:26.390409 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-39591ff5-34d5-4ab9-b9f1-389f72be2e6c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:26.390853 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-39591ff5-34d5-4ab9-b9f1-389f72be2e6c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:26.521669 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-39591ff5-34d5-4ab9-b9f1-389f72be2e6c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:51:26.529437 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-39591ff5-34d5-4ab9-b9f1-389f72be2e6c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44" status: 200 len: 1697 microversion: 2.1 time: 0.154037 Oct 18 16:51:26.530017 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3793/7564] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:51:26 2022] GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44 => generated 1697 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:51:27.551795 n-d-853682-5 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 16:51:27.551795 n-d-853682-5 devstack@n-api.service[120406]: Tue Oct 18 16:51:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44 (ip 10.222.0.60) !!! Oct 18 16:51:27.556188 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bf1b7ad5-3c26-451b-96f9-4deef233d454 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:51:27.556801 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bf1b7ad5-3c26-451b-96f9-4deef233d454 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:51:27.564603 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf1b7ad5-3c26-451b-96f9-4deef233d454 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:27.565124 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf1b7ad5-3c26-451b-96f9-4deef233d454 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:27.565563 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf1b7ad5-3c26-451b-96f9-4deef233d454 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:27.566269 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf1b7ad5-3c26-451b-96f9-4deef233d454 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:27.566727 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf1b7ad5-3c26-451b-96f9-4deef233d454 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:27.567158 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf1b7ad5-3c26-451b-96f9-4deef233d454 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:27.704293 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bf1b7ad5-3c26-451b-96f9-4deef233d454 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:51:27.714718 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bf1b7ad5-3c26-451b-96f9-4deef233d454 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44" status: 200 len: 1697 microversion: 2.1 time: 0.164739 Oct 18 16:51:27.715302 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3772/7565] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:51:27 2022] GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44 => generated 1697 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:51:28.738758 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5df815aa-4f3b-4b48-b5df-11de3f2638f6 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:51:28.739406 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5df815aa-4f3b-4b48-b5df-11de3f2638f6 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:51:28.746329 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5df815aa-4f3b-4b48-b5df-11de3f2638f6 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:28.746837 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5df815aa-4f3b-4b48-b5df-11de3f2638f6 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:28.747324 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5df815aa-4f3b-4b48-b5df-11de3f2638f6 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:28.748546 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5df815aa-4f3b-4b48-b5df-11de3f2638f6 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:28.749054 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5df815aa-4f3b-4b48-b5df-11de3f2638f6 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:28.749506 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5df815aa-4f3b-4b48-b5df-11de3f2638f6 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:28.885668 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5df815aa-4f3b-4b48-b5df-11de3f2638f6 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:51:28.894286 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5df815aa-4f3b-4b48-b5df-11de3f2638f6 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44" status: 200 len: 1697 microversion: 2.1 time: 0.159302 Oct 18 16:51:28.894900 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3794/7566] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:51:28 2022] GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44 => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:51:29.917963 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1b8dcfa9-a714-4e67-a60f-0a717f92412f tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:51:29.918590 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1b8dcfa9-a714-4e67-a60f-0a717f92412f tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:51:29.926218 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b8dcfa9-a714-4e67-a60f-0a717f92412f tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:29.926713 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b8dcfa9-a714-4e67-a60f-0a717f92412f tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:29.927159 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b8dcfa9-a714-4e67-a60f-0a717f92412f tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:29.927893 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b8dcfa9-a714-4e67-a60f-0a717f92412f tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:29.928361 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b8dcfa9-a714-4e67-a60f-0a717f92412f tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:29.928796 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b8dcfa9-a714-4e67-a60f-0a717f92412f tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:30.059350 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1b8dcfa9-a714-4e67-a60f-0a717f92412f tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:51:30.067777 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1b8dcfa9-a714-4e67-a60f-0a717f92412f tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44" status: 200 len: 1697 microversion: 2.1 time: 0.153826 Oct 18 16:51:30.068349 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3773/7567] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:51:29 2022] GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44 => generated 1697 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:51:31.091406 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-78c6ec59-8f28-4ce2-a5a8-21a21c806fba tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:51:31.092558 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-78c6ec59-8f28-4ce2-a5a8-21a21c806fba tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:51:31.099527 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-78c6ec59-8f28-4ce2-a5a8-21a21c806fba tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:31.100025 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-78c6ec59-8f28-4ce2-a5a8-21a21c806fba tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:31.100481 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-78c6ec59-8f28-4ce2-a5a8-21a21c806fba tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:31.101216 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-78c6ec59-8f28-4ce2-a5a8-21a21c806fba tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:31.101696 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-78c6ec59-8f28-4ce2-a5a8-21a21c806fba tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:31.102137 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-78c6ec59-8f28-4ce2-a5a8-21a21c806fba tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:31.239929 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-78c6ec59-8f28-4ce2-a5a8-21a21c806fba tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:51:31.247624 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-78c6ec59-8f28-4ce2-a5a8-21a21c806fba tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44" status: 200 len: 1697 microversion: 2.1 time: 0.160237 Oct 18 16:51:31.249175 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3795/7568] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:51:31 2022] GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44 => generated 1697 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:51:32.271562 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5dfb2783-ff47-48ab-8bf6-4c0766235de3 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:51:32.272218 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5dfb2783-ff47-48ab-8bf6-4c0766235de3 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:51:32.279062 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5dfb2783-ff47-48ab-8bf6-4c0766235de3 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:32.279547 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5dfb2783-ff47-48ab-8bf6-4c0766235de3 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:32.279994 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5dfb2783-ff47-48ab-8bf6-4c0766235de3 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:32.280692 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5dfb2783-ff47-48ab-8bf6-4c0766235de3 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:32.281187 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5dfb2783-ff47-48ab-8bf6-4c0766235de3 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:32.281606 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5dfb2783-ff47-48ab-8bf6-4c0766235de3 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:32.412227 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5dfb2783-ff47-48ab-8bf6-4c0766235de3 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:51:32.420587 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5dfb2783-ff47-48ab-8bf6-4c0766235de3 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44" status: 200 len: 1697 microversion: 2.1 time: 0.152406 Oct 18 16:51:32.421194 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3774/7569] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:51:32 2022] GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44 => generated 1697 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:51:33.444275 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-861e6765-69ad-460e-88d5-be4c1bb26bd2 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:51:33.445000 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-861e6765-69ad-460e-88d5-be4c1bb26bd2 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:51:33.452694 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-861e6765-69ad-460e-88d5-be4c1bb26bd2 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:33.453231 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-861e6765-69ad-460e-88d5-be4c1bb26bd2 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:33.453694 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-861e6765-69ad-460e-88d5-be4c1bb26bd2 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:33.454426 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-861e6765-69ad-460e-88d5-be4c1bb26bd2 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:33.454903 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-861e6765-69ad-460e-88d5-be4c1bb26bd2 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:33.455343 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-861e6765-69ad-460e-88d5-be4c1bb26bd2 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:33.591485 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-861e6765-69ad-460e-88d5-be4c1bb26bd2 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:51:33.599341 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-861e6765-69ad-460e-88d5-be4c1bb26bd2 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44" status: 200 len: 1697 microversion: 2.1 time: 0.159077 Oct 18 16:51:33.599919 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3796/7570] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:51:33 2022] GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44 => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:51:34.625073 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c8c4900d-a81e-4544-9870-d2ebd3cabbc1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:51:34.625784 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c8c4900d-a81e-4544-9870-d2ebd3cabbc1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:51:34.632851 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8c4900d-a81e-4544-9870-d2ebd3cabbc1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:34.633342 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8c4900d-a81e-4544-9870-d2ebd3cabbc1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:34.633786 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8c4900d-a81e-4544-9870-d2ebd3cabbc1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:34.634489 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8c4900d-a81e-4544-9870-d2ebd3cabbc1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:34.634953 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8c4900d-a81e-4544-9870-d2ebd3cabbc1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:34.635384 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8c4900d-a81e-4544-9870-d2ebd3cabbc1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:34.766761 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c8c4900d-a81e-4544-9870-d2ebd3cabbc1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:51:34.774463 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c8c4900d-a81e-4544-9870-d2ebd3cabbc1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44" status: 200 len: 1697 microversion: 2.1 time: 0.153959 Oct 18 16:51:34.775038 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3775/7571] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:51:34 2022] GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44 => generated 1697 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:51:35.800335 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-12d646c0-1059-47ee-a3b3-9839750c6c73 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:51:35.801011 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-12d646c0-1059-47ee-a3b3-9839750c6c73 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:51:35.809216 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12d646c0-1059-47ee-a3b3-9839750c6c73 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:35.809828 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12d646c0-1059-47ee-a3b3-9839750c6c73 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:35.810514 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12d646c0-1059-47ee-a3b3-9839750c6c73 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:35.811262 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12d646c0-1059-47ee-a3b3-9839750c6c73 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:35.811741 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12d646c0-1059-47ee-a3b3-9839750c6c73 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:35.812195 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12d646c0-1059-47ee-a3b3-9839750c6c73 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:35.941237 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-12d646c0-1059-47ee-a3b3-9839750c6c73 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:51:35.949118 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-12d646c0-1059-47ee-a3b3-9839750c6c73 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44" status: 200 len: 1697 microversion: 2.1 time: 0.155189 Oct 18 16:51:35.949629 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3797/7572] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:51:35 2022] GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44 => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:51:37.022606 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8cc72960-ba7f-41d1-8c70-f264db2f9bbc tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:51:37.023236 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8cc72960-ba7f-41d1-8c70-f264db2f9bbc tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:51:37.029315 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8cc72960-ba7f-41d1-8c70-f264db2f9bbc tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:37.029801 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8cc72960-ba7f-41d1-8c70-f264db2f9bbc tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:37.030235 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8cc72960-ba7f-41d1-8c70-f264db2f9bbc tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:37.030932 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8cc72960-ba7f-41d1-8c70-f264db2f9bbc tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:37.031386 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8cc72960-ba7f-41d1-8c70-f264db2f9bbc tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:37.031813 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8cc72960-ba7f-41d1-8c70-f264db2f9bbc tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:37.170463 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8cc72960-ba7f-41d1-8c70-f264db2f9bbc tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:51:37.179284 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8cc72960-ba7f-41d1-8c70-f264db2f9bbc tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44" status: 200 len: 1696 microversion: 2.1 time: 0.210384 Oct 18 16:51:37.179866 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3776/7573] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:51:36 2022] GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44 => generated 1696 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:51:37.386101 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-0e47c053-0a51-44ca-9ca7-054bcff15bb3 req-60c8e5d1-136f-4aad-97cc-c969a2b0510c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44", "name": "network-vif-unplugged", "status": "completed", "tag": "e5526313-2e26-4e66-8998-bc6595d3d123"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:51:37.396634 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-0e47c053-0a51-44ca-9ca7-054bcff15bb3 req-60c8e5d1-136f-4aad-97cc-c969a2b0510c service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:37.396945 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-0e47c053-0a51-44ca-9ca7-054bcff15bb3 req-60c8e5d1-136f-4aad-97cc-c969a2b0510c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:37.397392 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-0e47c053-0a51-44ca-9ca7-054bcff15bb3 req-60c8e5d1-136f-4aad-97cc-c969a2b0510c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:37.410383 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-0e47c053-0a51-44ca-9ca7-054bcff15bb3 req-60c8e5d1-136f-4aad-97cc-c969a2b0510c service nova] Creating event network-vif-unplugged:e5526313-2e26-4e66-8998-bc6595d3d123 for instance 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44 on n-h2-853682-5 Oct 18 16:51:37.415881 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [req-0e47c053-0a51-44ca-9ca7-054bcff15bb3 req-60c8e5d1-136f-4aad-97cc-c969a2b0510c service nova] Instance 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853682-5', 'n-h1-853682-5'} {{(pid=120405) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 18 16:51:37.427383 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-0e47c053-0a51-44ca-9ca7-054bcff15bb3 req-60c8e5d1-136f-4aad-97cc-c969a2b0510c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045117 Oct 18 16:51:37.427958 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3798/7574] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:51:38.204600 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a115080b-a77d-45ed-95fb-3930f13a35bd tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:51:38.205924 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a115080b-a77d-45ed-95fb-3930f13a35bd tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:51:38.213158 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a115080b-a77d-45ed-95fb-3930f13a35bd tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:38.213662 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a115080b-a77d-45ed-95fb-3930f13a35bd tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:38.214406 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a115080b-a77d-45ed-95fb-3930f13a35bd tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:38.215138 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a115080b-a77d-45ed-95fb-3930f13a35bd tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:38.215608 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a115080b-a77d-45ed-95fb-3930f13a35bd tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:38.216046 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a115080b-a77d-45ed-95fb-3930f13a35bd tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:38.358338 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a115080b-a77d-45ed-95fb-3930f13a35bd tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:51:38.366689 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a115080b-a77d-45ed-95fb-3930f13a35bd tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44" status: 200 len: 1696 microversion: 2.1 time: 0.166874 Oct 18 16:51:38.367516 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3777/7575] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:51:38 2022] GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44 => generated 1696 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:51:39.391825 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e14c0c55-056d-4dea-90f2-03c99d5fff0f tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:51:39.392456 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e14c0c55-056d-4dea-90f2-03c99d5fff0f tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:51:39.399487 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e14c0c55-056d-4dea-90f2-03c99d5fff0f tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:39.399981 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e14c0c55-056d-4dea-90f2-03c99d5fff0f tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:39.400432 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e14c0c55-056d-4dea-90f2-03c99d5fff0f tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:39.401162 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e14c0c55-056d-4dea-90f2-03c99d5fff0f tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:39.401633 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e14c0c55-056d-4dea-90f2-03c99d5fff0f tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:39.402071 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e14c0c55-056d-4dea-90f2-03c99d5fff0f tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:39.473911 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-c5cef1a5-719c-44e9-ba45-09532401fb98 req-cde5b28e-0981-4092-95df-44371f3948ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44", "tag": "e5526313-2e26-4e66-8998-bc6595d3d123"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:51:39.485075 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c5cef1a5-719c-44e9-ba45-09532401fb98 req-cde5b28e-0981-4092-95df-44371f3948ad service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:39.485564 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c5cef1a5-719c-44e9-ba45-09532401fb98 req-cde5b28e-0981-4092-95df-44371f3948ad service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:39.486004 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c5cef1a5-719c-44e9-ba45-09532401fb98 req-cde5b28e-0981-4092-95df-44371f3948ad service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:39.498084 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-c5cef1a5-719c-44e9-ba45-09532401fb98 req-cde5b28e-0981-4092-95df-44371f3948ad service nova] Creating event network-changed:e5526313-2e26-4e66-8998-bc6595d3d123 for instance 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44 on n-h2-853682-5 Oct 18 16:51:39.503672 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [req-c5cef1a5-719c-44e9-ba45-09532401fb98 req-cde5b28e-0981-4092-95df-44371f3948ad service nova] Instance 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853682-5', 'n-h1-853682-5'} {{(pid=120406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 18 16:51:39.515088 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-c5cef1a5-719c-44e9-ba45-09532401fb98 req-cde5b28e-0981-4092-95df-44371f3948ad service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044881 Oct 18 16:51:39.516236 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3778/7576] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:51:39.543752 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e14c0c55-056d-4dea-90f2-03c99d5fff0f tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:51:39.551936 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e14c0c55-056d-4dea-90f2-03c99d5fff0f tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44" status: 200 len: 1694 microversion: 2.1 time: 0.164434 Oct 18 16:51:39.552717 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3799/7577] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:51:39 2022] GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44 => generated 1694 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:51:40.579033 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-47fd7459-c8f1-4e20-8c99-ddb605e46251 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:51:40.580676 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-47fd7459-c8f1-4e20-8c99-ddb605e46251 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:51:40.586445 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47fd7459-c8f1-4e20-8c99-ddb605e46251 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:40.586929 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47fd7459-c8f1-4e20-8c99-ddb605e46251 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:40.587370 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47fd7459-c8f1-4e20-8c99-ddb605e46251 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:40.588065 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47fd7459-c8f1-4e20-8c99-ddb605e46251 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:40.588526 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47fd7459-c8f1-4e20-8c99-ddb605e46251 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:40.588998 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47fd7459-c8f1-4e20-8c99-ddb605e46251 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:40.723845 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-47fd7459-c8f1-4e20-8c99-ddb605e46251 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:51:40.732165 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-47fd7459-c8f1-4e20-8c99-ddb605e46251 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44" status: 200 len: 1691 microversion: 2.1 time: 0.158381 Oct 18 16:51:40.732744 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3779/7578] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:51:40 2022] GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:51:40.755788 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7e97b00d-67ec-414f-b780-18c2624670ed tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:51:40.756384 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7e97b00d-67ec-414f-b780-18c2624670ed tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:51:40.762276 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7e97b00d-67ec-414f-b780-18c2624670ed tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:40.762783 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7e97b00d-67ec-414f-b780-18c2624670ed tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:40.763241 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7e97b00d-67ec-414f-b780-18c2624670ed tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:40.763991 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7e97b00d-67ec-414f-b780-18c2624670ed tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:40.764469 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7e97b00d-67ec-414f-b780-18c2624670ed tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:40.764949 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7e97b00d-67ec-414f-b780-18c2624670ed tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:40.825970 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7e97b00d-67ec-414f-b780-18c2624670ed tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "POST /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44/action" status: 204 len: 0 microversion: 2.1 time: 0.074267 Oct 18 16:51:40.826663 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3800/7579] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:51:40 2022] POST /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:51:40.840463 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-58321f76-63f6-4758-917c-61304c51c72b tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:51:40.841519 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-58321f76-63f6-4758-917c-61304c51c72b tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:51:40.848158 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58321f76-63f6-4758-917c-61304c51c72b tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:40.848640 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58321f76-63f6-4758-917c-61304c51c72b tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:40.849328 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58321f76-63f6-4758-917c-61304c51c72b tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:40.850050 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58321f76-63f6-4758-917c-61304c51c72b tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:40.850762 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58321f76-63f6-4758-917c-61304c51c72b tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:40.851194 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58321f76-63f6-4758-917c-61304c51c72b tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:41.001492 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-58321f76-63f6-4758-917c-61304c51c72b tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:51:41.009452 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-58321f76-63f6-4758-917c-61304c51c72b tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44" status: 200 len: 1691 microversion: 2.1 time: 0.178456 Oct 18 16:51:41.010038 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3780/7580] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:51:40 2022] GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44 => generated 1691 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:51:41.033469 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-af7667d9-c696-41a1-8102-ab08d38d4a9f tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:51:41.034412 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-af7667d9-c696-41a1-8102-ab08d38d4a9f tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:51:41.040621 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-af7667d9-c696-41a1-8102-ab08d38d4a9f tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:41.041148 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-af7667d9-c696-41a1-8102-ab08d38d4a9f tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:41.041601 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-af7667d9-c696-41a1-8102-ab08d38d4a9f tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:41.042303 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-af7667d9-c696-41a1-8102-ab08d38d4a9f tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:41.042773 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-af7667d9-c696-41a1-8102-ab08d38d4a9f tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:41.043211 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-af7667d9-c696-41a1-8102-ab08d38d4a9f tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:41.063034 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:51:41.473592 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-af7667d9-c696-41a1-8102-ab08d38d4a9f tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:51:41.481727 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-af7667d9-c696-41a1-8102-ab08d38d4a9f tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44" status: 200 len: 1691 microversion: 2.1 time: 0.453441 Oct 18 16:51:41.482521 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3801/7581] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:51:41 2022] GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44 => generated 1691 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:51:42.505221 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-523b6a29-4c8c-4e1a-8dde-b10b02fc7c18 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:51:42.505777 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-523b6a29-4c8c-4e1a-8dde-b10b02fc7c18 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:51:42.512690 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-523b6a29-4c8c-4e1a-8dde-b10b02fc7c18 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:42.513214 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-523b6a29-4c8c-4e1a-8dde-b10b02fc7c18 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:42.513660 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-523b6a29-4c8c-4e1a-8dde-b10b02fc7c18 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:42.514360 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-523b6a29-4c8c-4e1a-8dde-b10b02fc7c18 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:42.514823 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-523b6a29-4c8c-4e1a-8dde-b10b02fc7c18 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:42.515256 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-523b6a29-4c8c-4e1a-8dde-b10b02fc7c18 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:42.645016 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-523b6a29-4c8c-4e1a-8dde-b10b02fc7c18 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:51:42.652764 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-523b6a29-4c8c-4e1a-8dde-b10b02fc7c18 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44" status: 200 len: 1683 microversion: 2.1 time: 0.151657 Oct 18 16:51:42.653367 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3781/7582] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:51:42 2022] GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:51:42.857745 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-3416cd74-067f-4f2a-8a47-4928868e87b3 req-1a3b069b-be24-4f2e-99f4-31e0dac49a15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44", "name": "network-vif-plugged", "status": "completed", "tag": "e5526313-2e26-4e66-8998-bc6595d3d123"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:51:42.868385 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-3416cd74-067f-4f2a-8a47-4928868e87b3 req-1a3b069b-be24-4f2e-99f4-31e0dac49a15 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:51:42.868963 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-3416cd74-067f-4f2a-8a47-4928868e87b3 req-1a3b069b-be24-4f2e-99f4-31e0dac49a15 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:51:42.869412 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-3416cd74-067f-4f2a-8a47-4928868e87b3 req-1a3b069b-be24-4f2e-99f4-31e0dac49a15 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:51:42.881291 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-3416cd74-067f-4f2a-8a47-4928868e87b3 req-1a3b069b-be24-4f2e-99f4-31e0dac49a15 service nova] Creating event network-vif-plugged:e5526313-2e26-4e66-8998-bc6595d3d123 for instance 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44 on n-h2-853682-5 Oct 18 16:51:42.886296 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-3416cd74-067f-4f2a-8a47-4928868e87b3 req-1a3b069b-be24-4f2e-99f4-31e0dac49a15 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032306 Oct 18 16:51:42.886955 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3802/7583] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:52:04.836912 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8868f13c-4d53-4fcc-bc37-88aa8bb52d0d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:52:04.839293 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8868f13c-4d53-4fcc-bc37-88aa8bb52d0d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:52:04.842061 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=32 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:52:04.842740 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=94 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:52:04.849171 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8868f13c-4d53-4fcc-bc37-88aa8bb52d0d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:04.849667 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8868f13c-4d53-4fcc-bc37-88aa8bb52d0d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:04.850113 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8868f13c-4d53-4fcc-bc37-88aa8bb52d0d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:04.850826 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8868f13c-4d53-4fcc-bc37-88aa8bb52d0d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:04.851289 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8868f13c-4d53-4fcc-bc37-88aa8bb52d0d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:04.851724 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8868f13c-4d53-4fcc-bc37-88aa8bb52d0d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:04.905333 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8868f13c-4d53-4fcc-bc37-88aa8bb52d0d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "POST /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44/action" status: 200 len: 24576 microversion: 2.1 time: 0.072955 Oct 18 16:52:04.905986 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3782/7584] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:52:04 2022] POST /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44/action => generated 24576 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:52:12.207353 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1d5cf807-b5af-45c2-ae14-287c41ed55ad tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:52:12.207963 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1d5cf807-b5af-45c2-ae14-287c41ed55ad tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:52:12.211021 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-5dda2161-183c-464a-af8c-f4ef7439b846 req-1ef5175c-6878-4dcd-99ca-73d9fc4f71f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44", "tag": "e5526313-2e26-4e66-8998-bc6595d3d123"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:52:12.211713 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=36 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:52:12.212570 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=5 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:52:12.219268 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1d5cf807-b5af-45c2-ae14-287c41ed55ad tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:12.219788 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1d5cf807-b5af-45c2-ae14-287c41ed55ad tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:12.220249 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1d5cf807-b5af-45c2-ae14-287c41ed55ad tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:12.221020 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1d5cf807-b5af-45c2-ae14-287c41ed55ad tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:12.221496 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1d5cf807-b5af-45c2-ae14-287c41ed55ad tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:12.221943 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1d5cf807-b5af-45c2-ae14-287c41ed55ad tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:12.223035 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5dda2161-183c-464a-af8c-f4ef7439b846 req-1ef5175c-6878-4dcd-99ca-73d9fc4f71f8 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:12.223506 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5dda2161-183c-464a-af8c-f4ef7439b846 req-1ef5175c-6878-4dcd-99ca-73d9fc4f71f8 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:12.223932 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5dda2161-183c-464a-af8c-f4ef7439b846 req-1ef5175c-6878-4dcd-99ca-73d9fc4f71f8 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:12.238512 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-5dda2161-183c-464a-af8c-f4ef7439b846 req-1ef5175c-6878-4dcd-99ca-73d9fc4f71f8 service nova] Creating event network-changed:e5526313-2e26-4e66-8998-bc6595d3d123 for instance 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44 on n-h2-853682-5 Oct 18 16:52:12.243923 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-5dda2161-183c-464a-af8c-f4ef7439b846 req-1ef5175c-6878-4dcd-99ca-73d9fc4f71f8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037773 Oct 18 16:52:12.244740 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3783/7585] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:52:12.251236 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1d5cf807-b5af-45c2-ae14-287c41ed55ad tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:52:12.336319 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1d5cf807-b5af-45c2-ae14-287c41ed55ad tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "DELETE /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44" status: 204 len: 0 microversion: 2.1 time: 0.132645 Oct 18 16:52:12.340505 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3803/7586] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 16:52:12 2022] DELETE /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:52:12.348017 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-80311a23-6648-4323-880c-7ce2f96c99df tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:52:12.348324 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-80311a23-6648-4323-880c-7ce2f96c99df tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:52:12.355942 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80311a23-6648-4323-880c-7ce2f96c99df tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:12.356648 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80311a23-6648-4323-880c-7ce2f96c99df tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:12.357299 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80311a23-6648-4323-880c-7ce2f96c99df tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:12.358210 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80311a23-6648-4323-880c-7ce2f96c99df tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:12.358844 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80311a23-6648-4323-880c-7ce2f96c99df tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:12.359328 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80311a23-6648-4323-880c-7ce2f96c99df tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:12.505230 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-80311a23-6648-4323-880c-7ce2f96c99df tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:52:12.513263 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-80311a23-6648-4323-880c-7ce2f96c99df tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44" status: 200 len: 1689 microversion: 2.1 time: 0.171037 Oct 18 16:52:12.513851 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3784/7587] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:52:12 2022] GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44 => generated 1689 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:52:13.538871 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-51ec55f0-13eb-44b2-92f4-724ce7b1243e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:52:13.539583 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-51ec55f0-13eb-44b2-92f4-724ce7b1243e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:52:13.546510 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-51ec55f0-13eb-44b2-92f4-724ce7b1243e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:13.547007 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-51ec55f0-13eb-44b2-92f4-724ce7b1243e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:13.547460 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-51ec55f0-13eb-44b2-92f4-724ce7b1243e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:13.548174 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-51ec55f0-13eb-44b2-92f4-724ce7b1243e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:13.548645 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-51ec55f0-13eb-44b2-92f4-724ce7b1243e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:13.549115 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-51ec55f0-13eb-44b2-92f4-724ce7b1243e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:13.682594 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-51ec55f0-13eb-44b2-92f4-724ce7b1243e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:52:13.693123 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-51ec55f0-13eb-44b2-92f4-724ce7b1243e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44" status: 200 len: 1689 microversion: 2.1 time: 0.159016 Oct 18 16:52:13.701093 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3804/7588] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:52:13 2022] GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44 => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:52:14.260849 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-5d09cf32-762d-4487-8c72-9b366eb74a0d req-49e4678f-58d5-4184-82b9-63d027333d17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44", "name": "network-vif-deleted", "tag": "e5526313-2e26-4e66-8998-bc6595d3d123"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:52:14.272520 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5d09cf32-762d-4487-8c72-9b366eb74a0d req-49e4678f-58d5-4184-82b9-63d027333d17 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:14.273044 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5d09cf32-762d-4487-8c72-9b366eb74a0d req-49e4678f-58d5-4184-82b9-63d027333d17 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:14.273504 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5d09cf32-762d-4487-8c72-9b366eb74a0d req-49e4678f-58d5-4184-82b9-63d027333d17 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:14.288910 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-5d09cf32-762d-4487-8c72-9b366eb74a0d req-49e4678f-58d5-4184-82b9-63d027333d17 service nova] Creating event network-vif-deleted:e5526313-2e26-4e66-8998-bc6595d3d123 for instance 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44 on n-h2-853682-5 Oct 18 16:52:14.293882 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-5d09cf32-762d-4487-8c72-9b366eb74a0d req-49e4678f-58d5-4184-82b9-63d027333d17 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038160 Oct 18 16:52:14.294513 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3785/7589] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:52:14.717500 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7652844c-736b-4759-a0b7-49dc10313a5b tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:52:14.718095 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7652844c-736b-4759-a0b7-49dc10313a5b tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:52:14.724923 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7652844c-736b-4759-a0b7-49dc10313a5b tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:14.725417 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7652844c-736b-4759-a0b7-49dc10313a5b tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:14.725863 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7652844c-736b-4759-a0b7-49dc10313a5b tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:14.726574 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7652844c-736b-4759-a0b7-49dc10313a5b tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:14.727037 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7652844c-736b-4759-a0b7-49dc10313a5b tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:14.727472 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7652844c-736b-4759-a0b7-49dc10313a5b tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:14.741025 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-7652844c-736b-4759-a0b7-49dc10313a5b tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] HTTP exception thrown: Instance 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44 could not be found. Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7652844c-736b-4759-a0b7-49dc10313a5b tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Request method failure captured: Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44 HTTP/1.1 Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTthsYkwDcRi6ejpHtt4H8SQkGaHFzHuIXkg1m4QUw3Qt5Uv9NPiBxRcaK-NQwUI3S4BWwnXo3saj3Q2PKxNAS-I0ST7wp5S5RSkuwZEJ12enI0qMMMoKC1L1prWuMDD4oklSgZx5x8J281mShnqu67jB5xP0xd3PanqU2RBtQqY8QyI Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: f588c570d1c3475598357e7d21cd64f2 Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2023049857 Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f588c570d1c3475598357e7d21cd64f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f588c570d1c3475598357e7d21cd64f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f588c570d1c3475598357e7d21cd64f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f588c570d1c3475598357e7d21cd64f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2023049857 Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: f588c570d1c3475598357e7d21cd64f2 Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2023049857 Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-TestNetworkAdvancedServerOps-2023049857-project Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: a0040ae38b5542b9ac7d87de246e7108 Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2023049857-project Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44 could not be found. Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44'} Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44 could not be found. Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44 could not be found. Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:52:14.742710 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:52:14.748517 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:52:14.748517 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:52:14.748517 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:52:14.748517 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:52:14.748517 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:52:14.748517 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:52:14.748517 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44 could not be found. Oct 18 16:52:14.748517 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:52:14.748517 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7652844c-736b-4759-a0b7-49dc10313a5b tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Returning 404 to user: Instance 33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:52:14.748517 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7652844c-736b-4759-a0b7-49dc10313a5b tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44" status: 404 len: 111 microversion: 2.1 time: 0.030610 Oct 18 16:52:14.748517 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3805/7590] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:52:14 2022] GET /compute/v2.1/servers/33a9c4ac-f35b-40d8-b4cd-0d7fb4e7fd44 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:52:17.905552 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8328f061-b146-421a-a54c-29c52620d744 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '.version_select at 0x7f7c3c566ca0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:52:17.930928 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8328f061-b146-421a-a54c-29c52620d744 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1252614290" status: 202 len: 0 microversion: 2.1 time: 0.033305 Oct 18 16:52:17.933409 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3786/7591] 10.222.0.60 () {58 vars in 1284 bytes} [Tue Oct 18 16:52:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1252614290 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:52:17.961882 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-91288a8f-7c5f-45a5-8d5e-25b3ea4c594c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Action: 'create', calling method: .version_select at 0x7f7c3d128c10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-728058692", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJBqm1Anwqn206RfquVJxdiu95Q4psQs2NJNVRQrlXV/fTOBY0YpMs58N6Y9MX26zLFXrSo6nB4oZyr7L0Z3+oCc2spriCND2a4usdRr990t8jA0tiUyM5XO9gdo5EFAA=="}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:52:17.979029 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-91288a8f-7c5f-45a5-8d5e-25b3ea4c594c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Getting quotas for project f588c570d1c3475598357e7d21cd64f2. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:52:17.984121 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-91288a8f-7c5f-45a5-8d5e-25b3ea4c594c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Getting quotas for user a0040ae38b5542b9ac7d87de246e7108 and project f588c570d1c3475598357e7d21cd64f2. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:52:18.008195 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-91288a8f-7c5f-45a5-8d5e-25b3ea4c594c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.050934 Oct 18 16:52:18.008755 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3806/7592] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Oct 18 16:52:17 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:52:24.078443 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-96a19c0f-fbd2-4f76-965b-89072df11b62 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1538220802", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "c4ac730d-c69c-423f-bd13-e57816912e00"}], "key_name": "tempest-TestNetworkAdvancedServerOps-728058692", "security_groups": [{"name": "tempest-secgroup-smoke-1686864433"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:52:24.224009 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-96a19c0f-fbd2-4f76-965b-89072df11b62 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] validate_networks() for [('c4ac730d-c69c-423f-bd13-e57816912e00', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 16:52:24.278767 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=14 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:52:24.750600 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-96a19c0f-fbd2-4f76-965b-89072df11b62 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:52:24.751023 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-96a19c0f-fbd2-4f76-965b-89072df11b62 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:52:24.751494 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-96a19c0f-fbd2-4f76-965b-89072df11b62 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:52:24.751901 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-96a19c0f-fbd2-4f76-965b-89072df11b62 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:52:24.752342 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-96a19c0f-fbd2-4f76-965b-89072df11b62 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:52:24.762320 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96a19c0f-fbd2-4f76-965b-89072df11b62 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:24.762804 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96a19c0f-fbd2-4f76-965b-89072df11b62 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:24.763241 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96a19c0f-fbd2-4f76-965b-89072df11b62 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:24.763966 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96a19c0f-fbd2-4f76-965b-89072df11b62 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:24.764421 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96a19c0f-fbd2-4f76-965b-89072df11b62 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:24.765086 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96a19c0f-fbd2-4f76-965b-89072df11b62 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:24.784404 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-96a19c0f-fbd2-4f76-965b-89072df11b62 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Getting quotas for project f588c570d1c3475598357e7d21cd64f2. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:52:24.790097 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-96a19c0f-fbd2-4f76-965b-89072df11b62 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Getting quotas for user a0040ae38b5542b9ac7d87de246e7108 and project f588c570d1c3475598357e7d21cd64f2. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:52:24.803059 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-96a19c0f-fbd2-4f76-965b-89072df11b62 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:52:24.805492 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-96a19c0f-fbd2-4f76-965b-89072df11b62 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 98da5fd5-1271-4161-a1d6-aad99eb05207] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:52:24.855555 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-96a19c0f-fbd2-4f76-965b-89072df11b62 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.782304 Oct 18 16:52:24.862487 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3787/7593] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 16:52:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:52:24.866288 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:52:24.871608 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-20c6e043-8eee-4d8f-9f8f-b48ea20b229f tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:52:24.881737 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-20c6e043-8eee-4d8f-9f8f-b48ea20b229f tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 98da5fd5-1271-4161-a1d6-aad99eb05207] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:52:24.938710 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-20c6e043-8eee-4d8f-9f8f-b48ea20b229f tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:52:24.946544 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-20c6e043-8eee-4d8f-9f8f-b48ea20b229f tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207" status: 200 len: 1266 microversion: 2.1 time: 0.082716 Oct 18 16:52:24.947151 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3807/7594] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:52:24 2022] GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207 => generated 1266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:52:25.969749 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-93376372-0d7a-4cf6-8993-52095f35089b tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:52:25.970466 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-93376372-0d7a-4cf6-8993-52095f35089b tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 98da5fd5-1271-4161-a1d6-aad99eb05207] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:52:26.041245 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-93376372-0d7a-4cf6-8993-52095f35089b tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:52:26.051258 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-93376372-0d7a-4cf6-8993-52095f35089b tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207" status: 200 len: 1266 microversion: 2.1 time: 0.085370 Oct 18 16:52:26.056226 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3788/7595] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:52:25 2022] GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207 => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:52:27.079569 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-072fd6dc-3146-4f97-a504-9cd2d11a44a7 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:52:27.080216 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-072fd6dc-3146-4f97-a504-9cd2d11a44a7 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 98da5fd5-1271-4161-a1d6-aad99eb05207] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:52:27.135079 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-072fd6dc-3146-4f97-a504-9cd2d11a44a7 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:52:27.142183 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-072fd6dc-3146-4f97-a504-9cd2d11a44a7 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207" status: 200 len: 1266 microversion: 2.1 time: 0.066538 Oct 18 16:52:27.142762 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3808/7596] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:52:27 2022] GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207 => generated 1266 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:52:28.166276 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-86d6b4f0-30e5-4b45-81fa-93f6aeb43974 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:52:28.166895 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-86d6b4f0-30e5-4b45-81fa-93f6aeb43974 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 98da5fd5-1271-4161-a1d6-aad99eb05207] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:52:28.224185 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-86d6b4f0-30e5-4b45-81fa-93f6aeb43974 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:52:28.231772 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-86d6b4f0-30e5-4b45-81fa-93f6aeb43974 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207" status: 200 len: 1266 microversion: 2.1 time: 0.069499 Oct 18 16:52:28.232676 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3789/7597] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:52:28 2022] GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207 => generated 1266 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:52:29.255199 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4118146c-bc27-4c4b-90f3-d9f5698fb4aa tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:52:29.255814 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4118146c-bc27-4c4b-90f3-d9f5698fb4aa tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 98da5fd5-1271-4161-a1d6-aad99eb05207] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:52:29.262746 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4118146c-bc27-4c4b-90f3-d9f5698fb4aa tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:29.263249 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4118146c-bc27-4c4b-90f3-d9f5698fb4aa tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:29.263708 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4118146c-bc27-4c4b-90f3-d9f5698fb4aa tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:29.264484 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4118146c-bc27-4c4b-90f3-d9f5698fb4aa tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:29.265016 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4118146c-bc27-4c4b-90f3-d9f5698fb4aa tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:29.265555 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4118146c-bc27-4c4b-90f3-d9f5698fb4aa tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:29.327404 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4118146c-bc27-4c4b-90f3-d9f5698fb4aa tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:52:29.335773 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4118146c-bc27-4c4b-90f3-d9f5698fb4aa tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207" status: 200 len: 1270 microversion: 2.1 time: 0.084679 Oct 18 16:52:29.336349 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3809/7598] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:52:29 2022] GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207 => generated 1270 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:52:30.359283 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2a46fba7-8cde-48c6-9557-5011db0ff40d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:52:30.359909 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2a46fba7-8cde-48c6-9557-5011db0ff40d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 98da5fd5-1271-4161-a1d6-aad99eb05207] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:52:30.368376 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a46fba7-8cde-48c6-9557-5011db0ff40d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:30.368895 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a46fba7-8cde-48c6-9557-5011db0ff40d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:30.369345 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a46fba7-8cde-48c6-9557-5011db0ff40d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:30.370048 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a46fba7-8cde-48c6-9557-5011db0ff40d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:30.370513 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a46fba7-8cde-48c6-9557-5011db0ff40d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:30.370953 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a46fba7-8cde-48c6-9557-5011db0ff40d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:30.433601 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2a46fba7-8cde-48c6-9557-5011db0ff40d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:52:30.441285 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2a46fba7-8cde-48c6-9557-5011db0ff40d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207" status: 200 len: 1324 microversion: 2.1 time: 0.085882 Oct 18 16:52:30.441861 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3790/7599] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:52:30 2022] GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207 => generated 1324 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:52:31.464684 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0a986266-9265-4e53-8ede-8f9ffb93b134 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:52:31.465355 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0a986266-9265-4e53-8ede-8f9ffb93b134 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 98da5fd5-1271-4161-a1d6-aad99eb05207] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:52:31.472404 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0a986266-9265-4e53-8ede-8f9ffb93b134 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:31.472944 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0a986266-9265-4e53-8ede-8f9ffb93b134 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:31.473402 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0a986266-9265-4e53-8ede-8f9ffb93b134 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:31.474116 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0a986266-9265-4e53-8ede-8f9ffb93b134 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:31.474722 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0a986266-9265-4e53-8ede-8f9ffb93b134 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:31.475169 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0a986266-9265-4e53-8ede-8f9ffb93b134 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:31.615148 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0a986266-9265-4e53-8ede-8f9ffb93b134 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:52:31.623258 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0a986266-9265-4e53-8ede-8f9ffb93b134 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207" status: 200 len: 1392 microversion: 2.1 time: 0.162751 Oct 18 16:52:31.623953 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3810/7600] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:52:31 2022] GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:52:31.702999 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-d29612fd-1862-4522-adf9-f5e80e29fd38 req-b682d0e8-aadf-45fc-8ffa-3b337990262c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98da5fd5-1271-4161-a1d6-aad99eb05207", "tag": "73ff133b-e04f-4cc9-9af3-833838fa28e3"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:52:31.715280 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d29612fd-1862-4522-adf9-f5e80e29fd38 req-b682d0e8-aadf-45fc-8ffa-3b337990262c service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:31.716122 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d29612fd-1862-4522-adf9-f5e80e29fd38 req-b682d0e8-aadf-45fc-8ffa-3b337990262c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:31.716789 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d29612fd-1862-4522-adf9-f5e80e29fd38 req-b682d0e8-aadf-45fc-8ffa-3b337990262c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:31.730316 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-d29612fd-1862-4522-adf9-f5e80e29fd38 req-b682d0e8-aadf-45fc-8ffa-3b337990262c service nova] Creating event network-changed:73ff133b-e04f-4cc9-9af3-833838fa28e3 for instance 98da5fd5-1271-4161-a1d6-aad99eb05207 on n-h2-853682-5 Oct 18 16:52:31.735383 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-d29612fd-1862-4522-adf9-f5e80e29fd38 req-b682d0e8-aadf-45fc-8ffa-3b337990262c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036471 Oct 18 16:52:31.736242 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3791/7601] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:52:32.646411 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5eddfd82-1d73-47b8-864a-15aaa2f1f2bd tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:52:32.647576 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5eddfd82-1d73-47b8-864a-15aaa2f1f2bd tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 98da5fd5-1271-4161-a1d6-aad99eb05207] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:52:32.654799 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5eddfd82-1d73-47b8-864a-15aaa2f1f2bd tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:32.655309 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5eddfd82-1d73-47b8-864a-15aaa2f1f2bd tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:32.655771 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5eddfd82-1d73-47b8-864a-15aaa2f1f2bd tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:32.656488 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5eddfd82-1d73-47b8-864a-15aaa2f1f2bd tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:32.657249 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5eddfd82-1d73-47b8-864a-15aaa2f1f2bd tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:32.657698 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5eddfd82-1d73-47b8-864a-15aaa2f1f2bd tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:32.791524 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5eddfd82-1d73-47b8-864a-15aaa2f1f2bd tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:52:32.799501 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5eddfd82-1d73-47b8-864a-15aaa2f1f2bd tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207" status: 200 len: 1392 microversion: 2.1 time: 0.157173 Oct 18 16:52:32.800291 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3811/7602] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:52:32 2022] GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:52:33.824632 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a9708ec4-384c-44b9-9101-0d444ff8a251 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:52:33.825402 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a9708ec4-384c-44b9-9101-0d444ff8a251 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 98da5fd5-1271-4161-a1d6-aad99eb05207] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:52:33.831718 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9708ec4-384c-44b9-9101-0d444ff8a251 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:33.832208 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9708ec4-384c-44b9-9101-0d444ff8a251 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:33.832652 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9708ec4-384c-44b9-9101-0d444ff8a251 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:33.833381 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9708ec4-384c-44b9-9101-0d444ff8a251 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:33.833846 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9708ec4-384c-44b9-9101-0d444ff8a251 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:33.834281 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9708ec4-384c-44b9-9101-0d444ff8a251 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:33.965904 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a9708ec4-384c-44b9-9101-0d444ff8a251 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:52:33.973718 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a9708ec4-384c-44b9-9101-0d444ff8a251 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207" status: 200 len: 1392 microversion: 2.1 time: 0.154272 Oct 18 16:52:33.974300 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3792/7603] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:52:33 2022] GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:52:34.996614 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a64d6eb9-ca2e-4b98-bb8d-ad7bc73bcbd1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:52:34.997295 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a64d6eb9-ca2e-4b98-bb8d-ad7bc73bcbd1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 98da5fd5-1271-4161-a1d6-aad99eb05207] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:52:35.004170 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a64d6eb9-ca2e-4b98-bb8d-ad7bc73bcbd1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:35.004676 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a64d6eb9-ca2e-4b98-bb8d-ad7bc73bcbd1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:35.005159 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a64d6eb9-ca2e-4b98-bb8d-ad7bc73bcbd1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:35.005867 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a64d6eb9-ca2e-4b98-bb8d-ad7bc73bcbd1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:35.006336 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a64d6eb9-ca2e-4b98-bb8d-ad7bc73bcbd1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:35.006777 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a64d6eb9-ca2e-4b98-bb8d-ad7bc73bcbd1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:35.149099 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a64d6eb9-ca2e-4b98-bb8d-ad7bc73bcbd1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:52:35.157396 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a64d6eb9-ca2e-4b98-bb8d-ad7bc73bcbd1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207" status: 200 len: 1392 microversion: 2.1 time: 0.164704 Oct 18 16:52:35.157972 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3812/7604] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:52:34 2022] GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:52:36.181439 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8f4bb012-56a2-4442-8971-5bafa901dd44 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:52:36.182063 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8f4bb012-56a2-4442-8971-5bafa901dd44 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 98da5fd5-1271-4161-a1d6-aad99eb05207] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:52:36.184079 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:52:36.185653 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:52:36.191636 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f4bb012-56a2-4442-8971-5bafa901dd44 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:36.192128 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f4bb012-56a2-4442-8971-5bafa901dd44 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:36.192571 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f4bb012-56a2-4442-8971-5bafa901dd44 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:36.193315 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f4bb012-56a2-4442-8971-5bafa901dd44 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:36.193784 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f4bb012-56a2-4442-8971-5bafa901dd44 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:36.194220 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f4bb012-56a2-4442-8971-5bafa901dd44 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:36.328488 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8f4bb012-56a2-4442-8971-5bafa901dd44 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:52:36.336223 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8f4bb012-56a2-4442-8971-5bafa901dd44 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207" status: 200 len: 1392 microversion: 2.1 time: 0.159384 Oct 18 16:52:36.336789 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3793/7605] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:52:36 2022] GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:52:37.042090 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-e67a51e3-0627-4555-939b-33d116b48083 req-a750e5a5-4177-457c-880c-6f6defbeb1f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98da5fd5-1271-4161-a1d6-aad99eb05207", "name": "network-vif-plugged", "status": "completed", "tag": "73ff133b-e04f-4cc9-9af3-833838fa28e3"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:52:37.052649 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-e67a51e3-0627-4555-939b-33d116b48083 req-a750e5a5-4177-457c-880c-6f6defbeb1f1 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:37.053197 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-e67a51e3-0627-4555-939b-33d116b48083 req-a750e5a5-4177-457c-880c-6f6defbeb1f1 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:37.053652 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-e67a51e3-0627-4555-939b-33d116b48083 req-a750e5a5-4177-457c-880c-6f6defbeb1f1 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:37.065541 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-e67a51e3-0627-4555-939b-33d116b48083 req-a750e5a5-4177-457c-880c-6f6defbeb1f1 service nova] Creating event network-vif-plugged:73ff133b-e04f-4cc9-9af3-833838fa28e3 for instance 98da5fd5-1271-4161-a1d6-aad99eb05207 on n-h2-853682-5 Oct 18 16:52:37.071148 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-e67a51e3-0627-4555-939b-33d116b48083 req-a750e5a5-4177-457c-880c-6f6defbeb1f1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032253 Oct 18 16:52:37.071764 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3813/7606] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:52:37.359350 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c6d2a4ed-d494-4e38-8f5f-589768866f95 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:52:37.359991 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c6d2a4ed-d494-4e38-8f5f-589768866f95 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 98da5fd5-1271-4161-a1d6-aad99eb05207] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:52:37.367468 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6d2a4ed-d494-4e38-8f5f-589768866f95 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:37.367960 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6d2a4ed-d494-4e38-8f5f-589768866f95 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:37.368412 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6d2a4ed-d494-4e38-8f5f-589768866f95 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:37.369146 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6d2a4ed-d494-4e38-8f5f-589768866f95 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:37.369611 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6d2a4ed-d494-4e38-8f5f-589768866f95 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:37.370046 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6d2a4ed-d494-4e38-8f5f-589768866f95 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:37.508203 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c6d2a4ed-d494-4e38-8f5f-589768866f95 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:52:37.516087 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c6d2a4ed-d494-4e38-8f5f-589768866f95 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207" status: 200 len: 1392 microversion: 2.1 time: 0.160712 Oct 18 16:52:37.516688 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3794/7607] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:52:37 2022] GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:52:38.536941 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=8 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:52:38.542774 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7082fcc2-0b2a-4617-b9a6-e74bc6d33cd9 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:52:38.543497 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7082fcc2-0b2a-4617-b9a6-e74bc6d33cd9 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 98da5fd5-1271-4161-a1d6-aad99eb05207] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:52:38.550921 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7082fcc2-0b2a-4617-b9a6-e74bc6d33cd9 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:38.551419 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7082fcc2-0b2a-4617-b9a6-e74bc6d33cd9 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:38.551870 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7082fcc2-0b2a-4617-b9a6-e74bc6d33cd9 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:38.552572 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7082fcc2-0b2a-4617-b9a6-e74bc6d33cd9 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:38.553067 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7082fcc2-0b2a-4617-b9a6-e74bc6d33cd9 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:38.553509 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7082fcc2-0b2a-4617-b9a6-e74bc6d33cd9 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:38.686604 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-7082fcc2-0b2a-4617-b9a6-e74bc6d33cd9 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:52:38.694662 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7082fcc2-0b2a-4617-b9a6-e74bc6d33cd9 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207" status: 200 len: 1564 microversion: 2.1 time: 0.158721 Oct 18 16:52:38.695236 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3814/7608] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:52:38 2022] GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207 => generated 1564 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:52:38.717269 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1915247e-065e-4906-b3a7-014741fc3c69 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:52:38.717913 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1915247e-065e-4906-b3a7-014741fc3c69 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 98da5fd5-1271-4161-a1d6-aad99eb05207] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:52:38.719836 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=10 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:52:38.725756 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1915247e-065e-4906-b3a7-014741fc3c69 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:38.726874 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1915247e-065e-4906-b3a7-014741fc3c69 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:38.727305 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1915247e-065e-4906-b3a7-014741fc3c69 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:38.727994 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1915247e-065e-4906-b3a7-014741fc3c69 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:38.728446 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1915247e-065e-4906-b3a7-014741fc3c69 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:38.728901 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1915247e-065e-4906-b3a7-014741fc3c69 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:38.861931 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1915247e-065e-4906-b3a7-014741fc3c69 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:52:38.869732 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1915247e-065e-4906-b3a7-014741fc3c69 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207" status: 200 len: 1564 microversion: 2.1 time: 0.156320 Oct 18 16:52:38.870314 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3795/7609] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:52:38 2022] GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207 => generated 1564 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:52:40.436921 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-b43336c4-577c-4ffc-b083-e6002f4a1e2b req-9d15a531-e187-4fbf-b0dc-f9a14f3c4f46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98da5fd5-1271-4161-a1d6-aad99eb05207", "tag": "73ff133b-e04f-4cc9-9af3-833838fa28e3"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:52:40.440097 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a59c7dc0-30e3-4a44-9030-d6af98b977fc tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:52:40.440748 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a59c7dc0-30e3-4a44-9030-d6af98b977fc tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 98da5fd5-1271-4161-a1d6-aad99eb05207] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:52:40.447315 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a59c7dc0-30e3-4a44-9030-d6af98b977fc tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:40.448069 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a59c7dc0-30e3-4a44-9030-d6af98b977fc tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:40.448630 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a59c7dc0-30e3-4a44-9030-d6af98b977fc tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:40.449385 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a59c7dc0-30e3-4a44-9030-d6af98b977fc tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:40.449860 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a59c7dc0-30e3-4a44-9030-d6af98b977fc tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:40.450519 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a59c7dc0-30e3-4a44-9030-d6af98b977fc tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:40.451720 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b43336c4-577c-4ffc-b083-e6002f4a1e2b req-9d15a531-e187-4fbf-b0dc-f9a14f3c4f46 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:52:40.452200 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b43336c4-577c-4ffc-b083-e6002f4a1e2b req-9d15a531-e187-4fbf-b0dc-f9a14f3c4f46 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:52:40.452636 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b43336c4-577c-4ffc-b083-e6002f4a1e2b req-9d15a531-e187-4fbf-b0dc-f9a14f3c4f46 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:52:40.465041 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-b43336c4-577c-4ffc-b083-e6002f4a1e2b req-9d15a531-e187-4fbf-b0dc-f9a14f3c4f46 service nova] Creating event network-changed:73ff133b-e04f-4cc9-9af3-833838fa28e3 for instance 98da5fd5-1271-4161-a1d6-aad99eb05207 on n-h2-853682-5 Oct 18 16:52:40.470483 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-b43336c4-577c-4ffc-b083-e6002f4a1e2b req-9d15a531-e187-4fbf-b0dc-f9a14f3c4f46 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037076 Oct 18 16:52:40.471102 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3796/7610] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:52:40.610766 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a59c7dc0-30e3-4a44-9030-d6af98b977fc tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:52:40.619379 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a59c7dc0-30e3-4a44-9030-d6af98b977fc tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207" status: 200 len: 1564 microversion: 2.1 time: 0.188790 Oct 18 16:52:40.620121 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3815/7611] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:52:40 2022] GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207 => generated 1564 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:53:03.879187 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=7 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:53:03.879936 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=36 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:53:03.884416 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-575b479b-6aa4-4684-bd01-15b48fc96a0c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:53:03.886832 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-575b479b-6aa4-4684-bd01-15b48fc96a0c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 98da5fd5-1271-4161-a1d6-aad99eb05207] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:03.893882 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-575b479b-6aa4-4684-bd01-15b48fc96a0c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:03.894354 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-575b479b-6aa4-4684-bd01-15b48fc96a0c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:03.894790 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-575b479b-6aa4-4684-bd01-15b48fc96a0c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:03.895514 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-575b479b-6aa4-4684-bd01-15b48fc96a0c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:03.895970 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-575b479b-6aa4-4684-bd01-15b48fc96a0c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:03.896401 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-575b479b-6aa4-4684-bd01-15b48fc96a0c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:03.949891 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-575b479b-6aa4-4684-bd01-15b48fc96a0c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "POST /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207/action" status: 200 len: 24564 microversion: 2.1 time: 0.072461 Oct 18 16:53:03.950672 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3797/7612] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:53:03 2022] POST /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207/action => generated 24564 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:53:10.325295 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c05ce940-7856-4990-8979-d7e423752b57 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:53:10.327569 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:53:10.328231 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=38 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:53:10.335546 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c05ce940-7856-4990-8979-d7e423752b57 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:10.336043 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c05ce940-7856-4990-8979-d7e423752b57 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:10.336494 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c05ce940-7856-4990-8979-d7e423752b57 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:10.359922 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c05ce940-7856-4990-8979-d7e423752b57 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 98da5fd5-1271-4161-a1d6-aad99eb05207] Going to try to stop instance {{(pid=120405) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 18 16:53:10.401055 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c05ce940-7856-4990-8979-d7e423752b57 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "POST /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207/action" status: 202 len: 0 microversion: 2.1 time: 0.080239 Oct 18 16:53:10.401664 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3816/7613] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:53:10 2022] POST /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 16:53:10.412534 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2b7d413c-58bc-4d30-8c1b-03abfb5ae35c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:10.413319 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2b7d413c-58bc-4d30-8c1b-03abfb5ae35c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 98da5fd5-1271-4161-a1d6-aad99eb05207] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:10.423568 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b7d413c-58bc-4d30-8c1b-03abfb5ae35c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:10.425022 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b7d413c-58bc-4d30-8c1b-03abfb5ae35c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:10.425559 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b7d413c-58bc-4d30-8c1b-03abfb5ae35c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:10.426632 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b7d413c-58bc-4d30-8c1b-03abfb5ae35c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:10.427104 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b7d413c-58bc-4d30-8c1b-03abfb5ae35c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:10.427536 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b7d413c-58bc-4d30-8c1b-03abfb5ae35c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:10.843592 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2b7d413c-58bc-4d30-8c1b-03abfb5ae35c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:10.851350 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2b7d413c-58bc-4d30-8c1b-03abfb5ae35c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207" status: 200 len: 1692 microversion: 2.1 time: 0.443710 Oct 18 16:53:10.851926 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3798/7614] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:10 2022] GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207 => generated 1692 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:53:11.875898 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1ff66965-25f5-4f5e-860b-3d02dc021697 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:11.876609 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1ff66965-25f5-4f5e-860b-3d02dc021697 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 98da5fd5-1271-4161-a1d6-aad99eb05207] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:11.883723 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1ff66965-25f5-4f5e-860b-3d02dc021697 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:11.884763 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1ff66965-25f5-4f5e-860b-3d02dc021697 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:11.885272 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1ff66965-25f5-4f5e-860b-3d02dc021697 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:11.885984 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1ff66965-25f5-4f5e-860b-3d02dc021697 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:11.886453 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1ff66965-25f5-4f5e-860b-3d02dc021697 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:11.886890 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1ff66965-25f5-4f5e-860b-3d02dc021697 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:12.024205 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1ff66965-25f5-4f5e-860b-3d02dc021697 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:12.032988 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1ff66965-25f5-4f5e-860b-3d02dc021697 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207" status: 200 len: 1692 microversion: 2.1 time: 0.161332 Oct 18 16:53:12.033570 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3817/7615] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:11 2022] GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207 => generated 1692 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:53:13.056167 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-281051b9-2ea3-40d7-b8b1-3a3aca24fa05 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:13.056794 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-281051b9-2ea3-40d7-b8b1-3a3aca24fa05 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 98da5fd5-1271-4161-a1d6-aad99eb05207] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:13.065248 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-281051b9-2ea3-40d7-b8b1-3a3aca24fa05 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:13.065746 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-281051b9-2ea3-40d7-b8b1-3a3aca24fa05 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:13.066194 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-281051b9-2ea3-40d7-b8b1-3a3aca24fa05 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:13.066909 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-281051b9-2ea3-40d7-b8b1-3a3aca24fa05 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:13.067380 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-281051b9-2ea3-40d7-b8b1-3a3aca24fa05 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:13.067815 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-281051b9-2ea3-40d7-b8b1-3a3aca24fa05 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:13.200701 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-281051b9-2ea3-40d7-b8b1-3a3aca24fa05 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:13.208504 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-281051b9-2ea3-40d7-b8b1-3a3aca24fa05 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207" status: 200 len: 1692 microversion: 2.1 time: 0.156351 Oct 18 16:53:13.209123 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3799/7616] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:13 2022] GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207 => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:53:14.233128 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-298b802d-5fc0-483e-a23e-c5863843b039 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:14.233697 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-298b802d-5fc0-483e-a23e-c5863843b039 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 98da5fd5-1271-4161-a1d6-aad99eb05207] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:14.240614 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-298b802d-5fc0-483e-a23e-c5863843b039 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:14.241150 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-298b802d-5fc0-483e-a23e-c5863843b039 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:14.242068 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-298b802d-5fc0-483e-a23e-c5863843b039 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:14.242785 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-298b802d-5fc0-483e-a23e-c5863843b039 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:14.243858 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-298b802d-5fc0-483e-a23e-c5863843b039 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:14.244616 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-298b802d-5fc0-483e-a23e-c5863843b039 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:14.373485 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-298b802d-5fc0-483e-a23e-c5863843b039 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:14.381180 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-298b802d-5fc0-483e-a23e-c5863843b039 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207" status: 200 len: 1692 microversion: 2.1 time: 0.152305 Oct 18 16:53:14.381759 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3818/7617] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:14 2022] GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207 => generated 1692 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:53:15.404540 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7a9b23c7-8e31-4a7a-90dd-a8c6c718f54e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:15.405144 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7a9b23c7-8e31-4a7a-90dd-a8c6c718f54e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 98da5fd5-1271-4161-a1d6-aad99eb05207] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:15.412416 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a9b23c7-8e31-4a7a-90dd-a8c6c718f54e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:15.413046 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a9b23c7-8e31-4a7a-90dd-a8c6c718f54e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:15.413496 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a9b23c7-8e31-4a7a-90dd-a8c6c718f54e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:15.414203 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a9b23c7-8e31-4a7a-90dd-a8c6c718f54e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:15.414666 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a9b23c7-8e31-4a7a-90dd-a8c6c718f54e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:15.415178 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a9b23c7-8e31-4a7a-90dd-a8c6c718f54e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:15.555233 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7a9b23c7-8e31-4a7a-90dd-a8c6c718f54e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:15.565229 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7a9b23c7-8e31-4a7a-90dd-a8c6c718f54e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207" status: 200 len: 1692 microversion: 2.1 time: 0.165316 Oct 18 16:53:15.565829 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3800/7618] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:15 2022] GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207 => generated 1692 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:53:16.589550 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-144f6aef-e41a-422e-b6f9-4296b1f69731 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:16.590104 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-144f6aef-e41a-422e-b6f9-4296b1f69731 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 98da5fd5-1271-4161-a1d6-aad99eb05207] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:16.597330 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-144f6aef-e41a-422e-b6f9-4296b1f69731 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:16.597840 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-144f6aef-e41a-422e-b6f9-4296b1f69731 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:16.598296 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-144f6aef-e41a-422e-b6f9-4296b1f69731 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:16.599027 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-144f6aef-e41a-422e-b6f9-4296b1f69731 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:16.599502 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-144f6aef-e41a-422e-b6f9-4296b1f69731 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:16.599948 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-144f6aef-e41a-422e-b6f9-4296b1f69731 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:16.737536 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-144f6aef-e41a-422e-b6f9-4296b1f69731 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:16.746564 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-144f6aef-e41a-422e-b6f9-4296b1f69731 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207" status: 200 len: 1692 microversion: 2.1 time: 0.161076 Oct 18 16:53:16.747155 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3819/7619] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:16 2022] GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207 => generated 1692 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:53:17.771626 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0fa22e32-7ada-4c04-9458-ea93515a62b1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:17.772250 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0fa22e32-7ada-4c04-9458-ea93515a62b1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 98da5fd5-1271-4161-a1d6-aad99eb05207] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:17.779182 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0fa22e32-7ada-4c04-9458-ea93515a62b1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:17.779675 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0fa22e32-7ada-4c04-9458-ea93515a62b1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:17.780122 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0fa22e32-7ada-4c04-9458-ea93515a62b1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:17.780839 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0fa22e32-7ada-4c04-9458-ea93515a62b1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:17.781574 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0fa22e32-7ada-4c04-9458-ea93515a62b1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:17.782006 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0fa22e32-7ada-4c04-9458-ea93515a62b1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:17.921801 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0fa22e32-7ada-4c04-9458-ea93515a62b1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:17.929622 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0fa22e32-7ada-4c04-9458-ea93515a62b1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207" status: 200 len: 1692 microversion: 2.1 time: 0.161938 Oct 18 16:53:17.930205 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3801/7620] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:17 2022] GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207 => generated 1692 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:53:18.953415 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-12bc182a-ef9b-43c3-9901-01123f71daff tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:18.953954 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-12bc182a-ef9b-43c3-9901-01123f71daff tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 98da5fd5-1271-4161-a1d6-aad99eb05207] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:18.961705 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12bc182a-ef9b-43c3-9901-01123f71daff tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:18.962790 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12bc182a-ef9b-43c3-9901-01123f71daff tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:18.963239 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12bc182a-ef9b-43c3-9901-01123f71daff tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:18.963942 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12bc182a-ef9b-43c3-9901-01123f71daff tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:18.964407 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12bc182a-ef9b-43c3-9901-01123f71daff tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:18.964864 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-12bc182a-ef9b-43c3-9901-01123f71daff tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:19.102243 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-12bc182a-ef9b-43c3-9901-01123f71daff tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:19.110610 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-12bc182a-ef9b-43c3-9901-01123f71daff tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207" status: 200 len: 1692 microversion: 2.1 time: 0.161208 Oct 18 16:53:19.111184 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3820/7621] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:18 2022] GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207 => generated 1692 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:53:20.134787 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-365ba484-ff8f-4c04-a1fa-8995ce702359 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:20.135388 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-365ba484-ff8f-4c04-a1fa-8995ce702359 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 98da5fd5-1271-4161-a1d6-aad99eb05207] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:20.142823 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-365ba484-ff8f-4c04-a1fa-8995ce702359 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:20.143313 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-365ba484-ff8f-4c04-a1fa-8995ce702359 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:20.143754 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-365ba484-ff8f-4c04-a1fa-8995ce702359 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:20.144460 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-365ba484-ff8f-4c04-a1fa-8995ce702359 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:20.144958 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-365ba484-ff8f-4c04-a1fa-8995ce702359 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:20.145389 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-365ba484-ff8f-4c04-a1fa-8995ce702359 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:20.294237 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-365ba484-ff8f-4c04-a1fa-8995ce702359 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:20.301992 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-365ba484-ff8f-4c04-a1fa-8995ce702359 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207" status: 200 len: 1692 microversion: 2.1 time: 0.171787 Oct 18 16:53:20.302570 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3802/7622] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:20 2022] GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207 => generated 1692 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:53:21.328268 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9bf13005-3818-435a-8013-297abbc510b1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:21.328913 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9bf13005-3818-435a-8013-297abbc510b1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 98da5fd5-1271-4161-a1d6-aad99eb05207] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:21.336259 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9bf13005-3818-435a-8013-297abbc510b1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:21.336752 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9bf13005-3818-435a-8013-297abbc510b1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:21.337225 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9bf13005-3818-435a-8013-297abbc510b1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:21.337925 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9bf13005-3818-435a-8013-297abbc510b1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:21.338392 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9bf13005-3818-435a-8013-297abbc510b1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:21.338825 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9bf13005-3818-435a-8013-297abbc510b1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:21.470453 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9bf13005-3818-435a-8013-297abbc510b1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:21.479352 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9bf13005-3818-435a-8013-297abbc510b1 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207" status: 200 len: 1669 microversion: 2.1 time: 0.155048 Oct 18 16:53:21.479933 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3821/7623] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:21 2022] GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207 => generated 1669 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:53:22.574797 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-72430958-54ae-4d77-95ff-72cf18287e49 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:53:22.577196 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-72430958-54ae-4d77-95ff-72cf18287e49 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 98da5fd5-1271-4161-a1d6-aad99eb05207] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:22.584390 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-72430958-54ae-4d77-95ff-72cf18287e49 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:22.584920 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-72430958-54ae-4d77-95ff-72cf18287e49 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:22.585386 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-72430958-54ae-4d77-95ff-72cf18287e49 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:22.586103 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-72430958-54ae-4d77-95ff-72cf18287e49 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:22.586569 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-72430958-54ae-4d77-95ff-72cf18287e49 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:22.587588 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-72430958-54ae-4d77-95ff-72cf18287e49 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:22.638565 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-72430958-54ae-4d77-95ff-72cf18287e49 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "POST /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207/action" status: 200 len: 35387 microversion: 2.1 time: 0.068114 Oct 18 16:53:22.639225 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3803/7624] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:53:22 2022] POST /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207/action => generated 35387 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:53:22.651265 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d94bc6be-2306-47a3-ad2a-64a3bd0d114c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:53:22.658439 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d94bc6be-2306-47a3-ad2a-64a3bd0d114c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:22.658926 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d94bc6be-2306-47a3-ad2a-64a3bd0d114c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:22.659375 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d94bc6be-2306-47a3-ad2a-64a3bd0d114c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:22.683579 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d94bc6be-2306-47a3-ad2a-64a3bd0d114c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 98da5fd5-1271-4161-a1d6-aad99eb05207] Going to try to start instance {{(pid=120405) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 18 16:53:22.726851 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d94bc6be-2306-47a3-ad2a-64a3bd0d114c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "POST /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207/action" status: 202 len: 0 microversion: 2.1 time: 0.079347 Oct 18 16:53:22.727999 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3822/7625] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:53:22 2022] POST /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:53:22.737042 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3647ef95-e2a0-4c7d-b8f8-35b41aa227e7 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:22.737893 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3647ef95-e2a0-4c7d-b8f8-35b41aa227e7 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 98da5fd5-1271-4161-a1d6-aad99eb05207] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:22.746100 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3647ef95-e2a0-4c7d-b8f8-35b41aa227e7 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:22.746595 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3647ef95-e2a0-4c7d-b8f8-35b41aa227e7 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:22.747041 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3647ef95-e2a0-4c7d-b8f8-35b41aa227e7 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:22.747789 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3647ef95-e2a0-4c7d-b8f8-35b41aa227e7 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:22.748252 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3647ef95-e2a0-4c7d-b8f8-35b41aa227e7 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:22.748684 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3647ef95-e2a0-4c7d-b8f8-35b41aa227e7 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:22.901060 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3647ef95-e2a0-4c7d-b8f8-35b41aa227e7 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:22.909439 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3647ef95-e2a0-4c7d-b8f8-35b41aa227e7 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207" status: 200 len: 1678 microversion: 2.1 time: 0.176756 Oct 18 16:53:22.910021 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3804/7626] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:22 2022] GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207 => generated 1678 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:53:23.935003 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4840b5a6-8d7a-4d38-995f-b6b0e9133c78 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:23.935718 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4840b5a6-8d7a-4d38-995f-b6b0e9133c78 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 98da5fd5-1271-4161-a1d6-aad99eb05207] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:23.942797 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4840b5a6-8d7a-4d38-995f-b6b0e9133c78 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:23.943294 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4840b5a6-8d7a-4d38-995f-b6b0e9133c78 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:23.943743 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4840b5a6-8d7a-4d38-995f-b6b0e9133c78 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:23.944450 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4840b5a6-8d7a-4d38-995f-b6b0e9133c78 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:23.944950 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4840b5a6-8d7a-4d38-995f-b6b0e9133c78 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:23.945394 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4840b5a6-8d7a-4d38-995f-b6b0e9133c78 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:24.083111 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4840b5a6-8d7a-4d38-995f-b6b0e9133c78 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:24.091381 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4840b5a6-8d7a-4d38-995f-b6b0e9133c78 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207" status: 200 len: 1682 microversion: 2.1 time: 0.161225 Oct 18 16:53:24.091993 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3823/7627] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:23 2022] GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:53:48.287188 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ee8db73f-d9d8-4620-a9a3-f44c1be2762d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:53:48.289473 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ee8db73f-d9d8-4620-a9a3-f44c1be2762d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 98da5fd5-1271-4161-a1d6-aad99eb05207] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:48.292765 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=16 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:53:48.293461 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=44 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:53:48.299599 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee8db73f-d9d8-4620-a9a3-f44c1be2762d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:48.300088 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee8db73f-d9d8-4620-a9a3-f44c1be2762d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:48.300527 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee8db73f-d9d8-4620-a9a3-f44c1be2762d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:48.301266 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee8db73f-d9d8-4620-a9a3-f44c1be2762d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:48.301729 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee8db73f-d9d8-4620-a9a3-f44c1be2762d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:48.302159 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee8db73f-d9d8-4620-a9a3-f44c1be2762d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:48.358592 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ee8db73f-d9d8-4620-a9a3-f44c1be2762d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "POST /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207/action" status: 200 len: 59948 microversion: 2.1 time: 0.075242 Oct 18 16:53:48.359254 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3805/7628] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:53:48 2022] POST /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207/action => generated 59948 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:53:55.378944 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-845b06b9-f5d2-4cb1-b99b-42e5da30f87d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:55.379496 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-845b06b9-f5d2-4cb1-b99b-42e5da30f87d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 98da5fd5-1271-4161-a1d6-aad99eb05207] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:55.381847 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=16 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:53:55.382527 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:53:55.385067 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-b2460a97-16f7-4f08-96e1-100660369c40 req-dfbd70a3-3601-418c-bbce-3ad521d8d37d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98da5fd5-1271-4161-a1d6-aad99eb05207", "tag": "73ff133b-e04f-4cc9-9af3-833838fa28e3"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:53:55.396947 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b2460a97-16f7-4f08-96e1-100660369c40 req-dfbd70a3-3601-418c-bbce-3ad521d8d37d service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:55.397513 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b2460a97-16f7-4f08-96e1-100660369c40 req-dfbd70a3-3601-418c-bbce-3ad521d8d37d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:55.398013 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b2460a97-16f7-4f08-96e1-100660369c40 req-dfbd70a3-3601-418c-bbce-3ad521d8d37d service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:55.401040 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-845b06b9-f5d2-4cb1-b99b-42e5da30f87d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:55.402126 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-845b06b9-f5d2-4cb1-b99b-42e5da30f87d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:55.402661 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-845b06b9-f5d2-4cb1-b99b-42e5da30f87d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:55.403642 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-845b06b9-f5d2-4cb1-b99b-42e5da30f87d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:55.404290 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-845b06b9-f5d2-4cb1-b99b-42e5da30f87d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:55.404856 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-845b06b9-f5d2-4cb1-b99b-42e5da30f87d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:55.412718 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-b2460a97-16f7-4f08-96e1-100660369c40 req-dfbd70a3-3601-418c-bbce-3ad521d8d37d service nova] Creating event network-changed:73ff133b-e04f-4cc9-9af3-833838fa28e3 for instance 98da5fd5-1271-4161-a1d6-aad99eb05207 on n-h2-853682-5 Oct 18 16:53:55.418809 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-b2460a97-16f7-4f08-96e1-100660369c40 req-dfbd70a3-3601-418c-bbce-3ad521d8d37d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039496 Oct 18 16:53:55.420383 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3806/7629] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:53:55.434354 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-845b06b9-f5d2-4cb1-b99b-42e5da30f87d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 98da5fd5-1271-4161-a1d6-aad99eb05207] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:53:55.529985 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-845b06b9-f5d2-4cb1-b99b-42e5da30f87d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "DELETE /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207" status: 204 len: 0 microversion: 2.1 time: 0.154606 Oct 18 16:53:55.530612 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3824/7630] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 16:53:55 2022] DELETE /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 16:53:55.541138 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f9526623-a165-43af-b4f1-e405bc7b7d5e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:55.542656 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f9526623-a165-43af-b4f1-e405bc7b7d5e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 98da5fd5-1271-4161-a1d6-aad99eb05207] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:55.550383 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9526623-a165-43af-b4f1-e405bc7b7d5e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:55.550866 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9526623-a165-43af-b4f1-e405bc7b7d5e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:55.551677 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9526623-a165-43af-b4f1-e405bc7b7d5e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:55.552620 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9526623-a165-43af-b4f1-e405bc7b7d5e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:55.553099 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9526623-a165-43af-b4f1-e405bc7b7d5e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:55.553526 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9526623-a165-43af-b4f1-e405bc7b7d5e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:55.699004 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f9526623-a165-43af-b4f1-e405bc7b7d5e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:55.706932 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f9526623-a165-43af-b4f1-e405bc7b7d5e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207" status: 200 len: 1688 microversion: 2.1 time: 0.171164 Oct 18 16:53:55.707733 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3807/7631] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:55 2022] GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207 => generated 1688 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:53:56.732611 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-87e9f123-43f8-46d4-9fc4-1a0533ddf43e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:56.733370 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-87e9f123-43f8-46d4-9fc4-1a0533ddf43e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 98da5fd5-1271-4161-a1d6-aad99eb05207] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:56.740406 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-87e9f123-43f8-46d4-9fc4-1a0533ddf43e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:56.740942 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-87e9f123-43f8-46d4-9fc4-1a0533ddf43e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:56.741398 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-87e9f123-43f8-46d4-9fc4-1a0533ddf43e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:56.742110 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-87e9f123-43f8-46d4-9fc4-1a0533ddf43e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:56.742616 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-87e9f123-43f8-46d4-9fc4-1a0533ddf43e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:56.743056 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-87e9f123-43f8-46d4-9fc4-1a0533ddf43e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:56.881785 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-87e9f123-43f8-46d4-9fc4-1a0533ddf43e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:56.889659 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-87e9f123-43f8-46d4-9fc4-1a0533ddf43e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207" status: 200 len: 1688 microversion: 2.1 time: 0.161809 Oct 18 16:53:56.890504 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3825/7632] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:56 2022] GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207 => generated 1688 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:53:57.520360 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-7c12740a-2a2d-4487-bbe6-83d00735c2a7 req-c13083d3-9bdc-46d1-b169-982723b84b11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98da5fd5-1271-4161-a1d6-aad99eb05207", "name": "network-vif-deleted", "tag": "73ff133b-e04f-4cc9-9af3-833838fa28e3"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:53:57.533895 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7c12740a-2a2d-4487-bbe6-83d00735c2a7 req-c13083d3-9bdc-46d1-b169-982723b84b11 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:57.534369 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7c12740a-2a2d-4487-bbe6-83d00735c2a7 req-c13083d3-9bdc-46d1-b169-982723b84b11 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:57.534931 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7c12740a-2a2d-4487-bbe6-83d00735c2a7 req-c13083d3-9bdc-46d1-b169-982723b84b11 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:57.549684 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-7c12740a-2a2d-4487-bbe6-83d00735c2a7 req-c13083d3-9bdc-46d1-b169-982723b84b11 service nova] Creating event network-vif-deleted:73ff133b-e04f-4cc9-9af3-833838fa28e3 for instance 98da5fd5-1271-4161-a1d6-aad99eb05207 on n-h2-853682-5 Oct 18 16:53:57.555747 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-7c12740a-2a2d-4487-bbe6-83d00735c2a7 req-c13083d3-9bdc-46d1-b169-982723b84b11 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039205 Oct 18 16:53:57.556357 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3808/7633] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:53:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:53:57.916728 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8621c679-31b2-4e89-b3d2-93be3acf853e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:57.917407 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8621c679-31b2-4e89-b3d2-93be3acf853e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 98da5fd5-1271-4161-a1d6-aad99eb05207] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:57.926435 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8621c679-31b2-4e89-b3d2-93be3acf853e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:57.926950 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8621c679-31b2-4e89-b3d2-93be3acf853e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:57.927418 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8621c679-31b2-4e89-b3d2-93be3acf853e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:57.928393 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8621c679-31b2-4e89-b3d2-93be3acf853e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:57.928895 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8621c679-31b2-4e89-b3d2-93be3acf853e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:57.929613 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8621c679-31b2-4e89-b3d2-93be3acf853e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:57.963722 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8621c679-31b2-4e89-b3d2-93be3acf853e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:57.964238 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8621c679-31b2-4e89-b3d2-93be3acf853e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:57.964692 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8621c679-31b2-4e89-b3d2-93be3acf853e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:57.965213 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-8621c679-31b2-4e89-b3d2-93be3acf853e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lazy-loading 'fault' on Instance uuid 98da5fd5-1271-4161-a1d6-aad99eb05207 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:53:58.009948 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8621c679-31b2-4e89-b3d2-93be3acf853e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:53:58.017052 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8621c679-31b2-4e89-b3d2-93be3acf853e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207" status: 200 len: 1356 microversion: 2.1 time: 0.106045 Oct 18 16:53:58.017637 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3826/7634] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:57 2022] GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207 => generated 1356 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:53:59.043843 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-29b0d8a5-70e6-4171-afa4-c4db3b35a22e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:53:59.044543 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-29b0d8a5-70e6-4171-afa4-c4db3b35a22e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: 98da5fd5-1271-4161-a1d6-aad99eb05207] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:53:59.050814 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29b0d8a5-70e6-4171-afa4-c4db3b35a22e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:59.051302 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29b0d8a5-70e6-4171-afa4-c4db3b35a22e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:59.051739 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29b0d8a5-70e6-4171-afa4-c4db3b35a22e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:59.052428 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29b0d8a5-70e6-4171-afa4-c4db3b35a22e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:53:59.052908 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29b0d8a5-70e6-4171-afa4-c4db3b35a22e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:53:59.053336 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29b0d8a5-70e6-4171-afa4-c4db3b35a22e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:53:59.066917 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-29b0d8a5-70e6-4171-afa4-c4db3b35a22e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] HTTP exception thrown: Instance 98da5fd5-1271-4161-a1d6-aad99eb05207 could not be found. Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-29b0d8a5-70e6-4171-afa4-c4db3b35a22e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Request method failure captured: Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207 HTTP/1.1 Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTthsYkwDcRi6ejpHtt4H8SQkGaHFzHuIXkg1m4QUw3Qt5Uv9NPiBxRcaK-NQwUI3S4BWwnXo3saj3Q2PKxNAS-I0ST7wp5S5RSkuwZEJ12enI0qMMMoKC1L1prWuMDD4oklSgZx5x8J281mShnqu67jB5xP0xd3PanqU2RBtQqY8QyI Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: f588c570d1c3475598357e7d21cd64f2 Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2023049857 Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f588c570d1c3475598357e7d21cd64f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f588c570d1c3475598357e7d21cd64f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f588c570d1c3475598357e7d21cd64f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f588c570d1c3475598357e7d21cd64f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2023049857 Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: f588c570d1c3475598357e7d21cd64f2 Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2023049857 Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-TestNetworkAdvancedServerOps-2023049857-project Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: a0040ae38b5542b9ac7d87de246e7108 Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2023049857-project Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 98da5fd5-1271-4161-a1d6-aad99eb05207 could not be found. Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '98da5fd5-1271-4161-a1d6-aad99eb05207'} Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98da5fd5-1271-4161-a1d6-aad99eb05207 could not be found. Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98da5fd5-1271-4161-a1d6-aad99eb05207 could not be found. Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:53:59.068532 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:53:59.074239 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:53:59.074239 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:53:59.074239 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:53:59.074239 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:53:59.074239 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:53:59.074239 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:53:59.074239 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98da5fd5-1271-4161-a1d6-aad99eb05207 could not be found. Oct 18 16:53:59.074239 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 16:53:59.074239 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-29b0d8a5-70e6-4171-afa4-c4db3b35a22e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Returning 404 to user: Instance 98da5fd5-1271-4161-a1d6-aad99eb05207 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:53:59.074239 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-29b0d8a5-70e6-4171-afa4-c4db3b35a22e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207" status: 404 len: 111 microversion: 2.1 time: 0.031365 Oct 18 16:53:59.074239 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3809/7635] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:53:59 2022] GET /compute/v2.1/servers/98da5fd5-1271-4161-a1d6-aad99eb05207 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:54:02.404943 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9ec2b9b4-fa1a-40de-b022-604d72e3c391 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '.version_select at 0x7f7c3c1b9040>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:54:02.428224 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9ec2b9b4-fa1a-40de-b022-604d72e3c391 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-728058692" status: 202 len: 0 microversion: 2.1 time: 0.027298 Oct 18 16:54:02.428844 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3827/7636] 10.222.0.60 () {58 vars in 1281 bytes} [Tue Oct 18 16:54:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-728058692 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:54:02.462193 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2e24dc0f-57d3-450b-9dd8-d8f577a72e53 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Action: 'create', calling method: .version_select at 0x7f7c3d12eee0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-511222012", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNvQgaZxRSipzG17zPZZZQUk1I9XDMVkg0vB3mgibMSKYf5GCEsU3SqSYruYtlS3AhG2xnWWXb3h8J94rfS5JtKe9JoaVTkNL9eKVuy8dTwwDYmysmbtL6CgCgoGqJXfig=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:54:02.482164 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-2e24dc0f-57d3-450b-9dd8-d8f577a72e53 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Getting quotas for project f588c570d1c3475598357e7d21cd64f2. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:54:02.488781 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-2e24dc0f-57d3-450b-9dd8-d8f577a72e53 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Getting quotas for user a0040ae38b5542b9ac7d87de246e7108 and project f588c570d1c3475598357e7d21cd64f2. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:54:02.514607 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2e24dc0f-57d3-450b-9dd8-d8f577a72e53 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.056317 Oct 18 16:54:02.515392 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3810/7637] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Oct 18 16:54:02 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:54:08.054598 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-445d4ef9-92e2-4f8e-9080-071534b6bf95 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1076416684", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "networks": [{"uuid": "2b4e910e-e5cd-4891-8ba5-0f54459df4d4"}], "key_name": "tempest-TestNetworkAdvancedServerOps-511222012", "security_groups": [{"name": "tempest-secgroup-smoke-1569866691"}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:54:08.075435 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:54:08.210940 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-445d4ef9-92e2-4f8e-9080-071534b6bf95 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] validate_networks() for [('2b4e910e-e5cd-4891-8ba5-0f54459df4d4', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 16:54:08.648733 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-445d4ef9-92e2-4f8e-9080-071534b6bf95 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:54:08.649219 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-445d4ef9-92e2-4f8e-9080-071534b6bf95 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:54:08.649720 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-445d4ef9-92e2-4f8e-9080-071534b6bf95 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:54:08.650159 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-445d4ef9-92e2-4f8e-9080-071534b6bf95 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:54:08.650599 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-445d4ef9-92e2-4f8e-9080-071534b6bf95 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:54:08.661573 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-445d4ef9-92e2-4f8e-9080-071534b6bf95 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:08.662458 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-445d4ef9-92e2-4f8e-9080-071534b6bf95 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:08.663275 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-445d4ef9-92e2-4f8e-9080-071534b6bf95 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:08.664265 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-445d4ef9-92e2-4f8e-9080-071534b6bf95 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:08.664958 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-445d4ef9-92e2-4f8e-9080-071534b6bf95 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:08.665734 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-445d4ef9-92e2-4f8e-9080-071534b6bf95 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:08.690837 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-445d4ef9-92e2-4f8e-9080-071534b6bf95 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Getting quotas for project f588c570d1c3475598357e7d21cd64f2. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:54:08.697461 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-445d4ef9-92e2-4f8e-9080-071534b6bf95 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Getting quotas for user a0040ae38b5542b9ac7d87de246e7108 and project f588c570d1c3475598357e7d21cd64f2. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:54:08.710322 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-445d4ef9-92e2-4f8e-9080-071534b6bf95 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:54:08.712690 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-445d4ef9-92e2-4f8e-9080-071534b6bf95 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: d6774c01-3d94-419c-8470-0d6f45397dd9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:54:08.761782 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-445d4ef9-92e2-4f8e-9080-071534b6bf95 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.711110 Oct 18 16:54:08.768850 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3828/7638] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 16:54:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:54:08.775041 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-07d01790-6323-4627-ba0e-2d8351bc7e59 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:54:08.775661 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-07d01790-6323-4627-ba0e-2d8351bc7e59 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: d6774c01-3d94-419c-8470-0d6f45397dd9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:54:08.835868 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-07d01790-6323-4627-ba0e-2d8351bc7e59 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:54:08.844331 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-07d01790-6323-4627-ba0e-2d8351bc7e59 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/d6774c01-3d94-419c-8470-0d6f45397dd9" status: 200 len: 1266 microversion: 2.1 time: 0.073590 Oct 18 16:54:08.845339 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3811/7639] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:54:08 2022] GET /compute/v2.1/servers/d6774c01-3d94-419c-8470-0d6f45397dd9 => generated 1266 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:54:09.869899 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a6cd0b7c-cbb4-4faf-a4f1-c6c4a99bb97a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:54:09.870705 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a6cd0b7c-cbb4-4faf-a4f1-c6c4a99bb97a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: d6774c01-3d94-419c-8470-0d6f45397dd9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:54:09.879866 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a6cd0b7c-cbb4-4faf-a4f1-c6c4a99bb97a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:09.880379 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a6cd0b7c-cbb4-4faf-a4f1-c6c4a99bb97a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:09.880897 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a6cd0b7c-cbb4-4faf-a4f1-c6c4a99bb97a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:09.881637 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a6cd0b7c-cbb4-4faf-a4f1-c6c4a99bb97a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:09.883073 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a6cd0b7c-cbb4-4faf-a4f1-c6c4a99bb97a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:09.883551 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a6cd0b7c-cbb4-4faf-a4f1-c6c4a99bb97a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:09.979043 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a6cd0b7c-cbb4-4faf-a4f1-c6c4a99bb97a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:54:09.988242 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a6cd0b7c-cbb4-4faf-a4f1-c6c4a99bb97a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/d6774c01-3d94-419c-8470-0d6f45397dd9" status: 200 len: 1326 microversion: 2.1 time: 0.123436 Oct 18 16:54:10.002801 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3829/7640] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:54:09 2022] GET /compute/v2.1/servers/d6774c01-3d94-419c-8470-0d6f45397dd9 => generated 1326 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:54:11.013955 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6394db15-c3ab-425c-8cdc-4be29f064342 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:54:11.016018 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6394db15-c3ab-425c-8cdc-4be29f064342 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: d6774c01-3d94-419c-8470-0d6f45397dd9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:54:11.023423 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=16 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:54:11.030358 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6394db15-c3ab-425c-8cdc-4be29f064342 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:11.031262 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6394db15-c3ab-425c-8cdc-4be29f064342 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:11.031743 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6394db15-c3ab-425c-8cdc-4be29f064342 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:11.034588 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6394db15-c3ab-425c-8cdc-4be29f064342 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:11.035086 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6394db15-c3ab-425c-8cdc-4be29f064342 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:11.035524 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6394db15-c3ab-425c-8cdc-4be29f064342 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:11.198911 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6394db15-c3ab-425c-8cdc-4be29f064342 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:54:11.208491 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6394db15-c3ab-425c-8cdc-4be29f064342 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/d6774c01-3d94-419c-8470-0d6f45397dd9" status: 200 len: 1392 microversion: 2.1 time: 0.199921 Oct 18 16:54:11.209341 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3812/7641] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:54:11 2022] GET /compute/v2.1/servers/d6774c01-3d94-419c-8470-0d6f45397dd9 => generated 1392 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:54:11.961461 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-b2b9779e-9b67-49fc-87ea-a36df5253af4 req-d971f0b0-bac4-4bdf-a3c2-ec28ffc367f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6774c01-3d94-419c-8470-0d6f45397dd9", "tag": "71d8ddc5-2ebd-4840-b522-004e376828ba"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:54:11.974735 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-b2b9779e-9b67-49fc-87ea-a36df5253af4 req-d971f0b0-bac4-4bdf-a3c2-ec28ffc367f4 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:11.975234 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-b2b9779e-9b67-49fc-87ea-a36df5253af4 req-d971f0b0-bac4-4bdf-a3c2-ec28ffc367f4 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:11.975683 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-b2b9779e-9b67-49fc-87ea-a36df5253af4 req-d971f0b0-bac4-4bdf-a3c2-ec28ffc367f4 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:11.990938 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-b2b9779e-9b67-49fc-87ea-a36df5253af4 req-d971f0b0-bac4-4bdf-a3c2-ec28ffc367f4 service nova] Creating event network-changed:71d8ddc5-2ebd-4840-b522-004e376828ba for instance d6774c01-3d94-419c-8470-0d6f45397dd9 on n-h1-853682-5 Oct 18 16:54:11.995825 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-b2b9779e-9b67-49fc-87ea-a36df5253af4 req-d971f0b0-bac4-4bdf-a3c2-ec28ffc367f4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039629 Oct 18 16:54:11.997221 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3830/7642] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:54:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:54:12.232338 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6ac00019-7e41-4a2d-850c-c6b7a1653b5d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:54:12.232972 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6ac00019-7e41-4a2d-850c-c6b7a1653b5d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: d6774c01-3d94-419c-8470-0d6f45397dd9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:54:12.240563 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ac00019-7e41-4a2d-850c-c6b7a1653b5d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:12.241084 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ac00019-7e41-4a2d-850c-c6b7a1653b5d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:12.241520 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ac00019-7e41-4a2d-850c-c6b7a1653b5d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:12.242245 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ac00019-7e41-4a2d-850c-c6b7a1653b5d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:12.242692 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ac00019-7e41-4a2d-850c-c6b7a1653b5d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:12.243120 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ac00019-7e41-4a2d-850c-c6b7a1653b5d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:12.382177 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6ac00019-7e41-4a2d-850c-c6b7a1653b5d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:54:12.390055 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6ac00019-7e41-4a2d-850c-c6b7a1653b5d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/d6774c01-3d94-419c-8470-0d6f45397dd9" status: 200 len: 1392 microversion: 2.1 time: 0.162113 Oct 18 16:54:12.390643 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3813/7643] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:54:12 2022] GET /compute/v2.1/servers/d6774c01-3d94-419c-8470-0d6f45397dd9 => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:54:13.414591 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-20cc65d1-30cf-4007-b02e-ca35dce2172c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:54:13.415340 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-20cc65d1-30cf-4007-b02e-ca35dce2172c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: d6774c01-3d94-419c-8470-0d6f45397dd9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:54:13.421620 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-20cc65d1-30cf-4007-b02e-ca35dce2172c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:13.422117 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-20cc65d1-30cf-4007-b02e-ca35dce2172c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:13.422591 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-20cc65d1-30cf-4007-b02e-ca35dce2172c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:13.423303 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-20cc65d1-30cf-4007-b02e-ca35dce2172c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:13.423771 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-20cc65d1-30cf-4007-b02e-ca35dce2172c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:13.424209 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-20cc65d1-30cf-4007-b02e-ca35dce2172c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:13.559248 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-20cc65d1-30cf-4007-b02e-ca35dce2172c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:54:13.566996 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-20cc65d1-30cf-4007-b02e-ca35dce2172c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/d6774c01-3d94-419c-8470-0d6f45397dd9" status: 200 len: 1392 microversion: 2.1 time: 0.157529 Oct 18 16:54:13.567571 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3831/7644] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:54:13 2022] GET /compute/v2.1/servers/d6774c01-3d94-419c-8470-0d6f45397dd9 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:54:14.590701 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d9a2db94-a0e1-4927-9e51-89cbbfacd471 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:54:14.591450 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d9a2db94-a0e1-4927-9e51-89cbbfacd471 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: d6774c01-3d94-419c-8470-0d6f45397dd9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:54:14.598789 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d9a2db94-a0e1-4927-9e51-89cbbfacd471 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:14.599273 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d9a2db94-a0e1-4927-9e51-89cbbfacd471 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:14.599710 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d9a2db94-a0e1-4927-9e51-89cbbfacd471 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:14.600403 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d9a2db94-a0e1-4927-9e51-89cbbfacd471 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:14.600880 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d9a2db94-a0e1-4927-9e51-89cbbfacd471 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:14.601309 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d9a2db94-a0e1-4927-9e51-89cbbfacd471 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:14.737226 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d9a2db94-a0e1-4927-9e51-89cbbfacd471 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:54:14.745125 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d9a2db94-a0e1-4927-9e51-89cbbfacd471 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/d6774c01-3d94-419c-8470-0d6f45397dd9" status: 200 len: 1392 microversion: 2.1 time: 0.158968 Oct 18 16:54:14.745723 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3814/7645] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:54:14 2022] GET /compute/v2.1/servers/d6774c01-3d94-419c-8470-0d6f45397dd9 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:54:15.768366 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2230bfb2-7bbe-4590-b78c-74aeb55cf49c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:54:15.769108 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2230bfb2-7bbe-4590-b78c-74aeb55cf49c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: d6774c01-3d94-419c-8470-0d6f45397dd9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:54:15.776053 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2230bfb2-7bbe-4590-b78c-74aeb55cf49c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:15.776561 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2230bfb2-7bbe-4590-b78c-74aeb55cf49c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:15.777072 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2230bfb2-7bbe-4590-b78c-74aeb55cf49c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:15.777819 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2230bfb2-7bbe-4590-b78c-74aeb55cf49c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:15.778516 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2230bfb2-7bbe-4590-b78c-74aeb55cf49c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:15.778904 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2230bfb2-7bbe-4590-b78c-74aeb55cf49c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:15.923428 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2230bfb2-7bbe-4590-b78c-74aeb55cf49c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:54:15.932362 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2230bfb2-7bbe-4590-b78c-74aeb55cf49c tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/d6774c01-3d94-419c-8470-0d6f45397dd9" status: 200 len: 1392 microversion: 2.1 time: 0.167703 Oct 18 16:54:15.933036 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3832/7646] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:54:15 2022] GET /compute/v2.1/servers/d6774c01-3d94-419c-8470-0d6f45397dd9 => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:54:16.956244 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e56a0c84-9a18-431c-ac6d-ce6fbf727a91 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:54:16.956889 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e56a0c84-9a18-431c-ac6d-ce6fbf727a91 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: d6774c01-3d94-419c-8470-0d6f45397dd9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:54:16.963767 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e56a0c84-9a18-431c-ac6d-ce6fbf727a91 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:16.964276 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e56a0c84-9a18-431c-ac6d-ce6fbf727a91 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:16.964713 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e56a0c84-9a18-431c-ac6d-ce6fbf727a91 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:16.966055 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e56a0c84-9a18-431c-ac6d-ce6fbf727a91 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:16.966506 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e56a0c84-9a18-431c-ac6d-ce6fbf727a91 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:16.966933 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e56a0c84-9a18-431c-ac6d-ce6fbf727a91 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:17.099451 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e56a0c84-9a18-431c-ac6d-ce6fbf727a91 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:54:17.107191 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e56a0c84-9a18-431c-ac6d-ce6fbf727a91 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/d6774c01-3d94-419c-8470-0d6f45397dd9" status: 200 len: 1392 microversion: 2.1 time: 0.154919 Oct 18 16:54:17.107769 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3815/7647] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:54:16 2022] GET /compute/v2.1/servers/d6774c01-3d94-419c-8470-0d6f45397dd9 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:54:17.910941 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-f7df1813-94be-446c-907c-b6de089f084c req-4fc5022f-7ee7-46b1-8a5c-0fcdfe5d491e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6774c01-3d94-419c-8470-0d6f45397dd9", "name": "network-vif-plugged", "status": "completed", "tag": "71d8ddc5-2ebd-4840-b522-004e376828ba"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:54:17.923389 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-f7df1813-94be-446c-907c-b6de089f084c req-4fc5022f-7ee7-46b1-8a5c-0fcdfe5d491e service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:17.923905 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-f7df1813-94be-446c-907c-b6de089f084c req-4fc5022f-7ee7-46b1-8a5c-0fcdfe5d491e service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:17.924333 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-f7df1813-94be-446c-907c-b6de089f084c req-4fc5022f-7ee7-46b1-8a5c-0fcdfe5d491e service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:17.937301 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-f7df1813-94be-446c-907c-b6de089f084c req-4fc5022f-7ee7-46b1-8a5c-0fcdfe5d491e service nova] Creating event network-vif-plugged:71d8ddc5-2ebd-4840-b522-004e376828ba for instance d6774c01-3d94-419c-8470-0d6f45397dd9 on n-h1-853682-5 Oct 18 16:54:17.942346 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-f7df1813-94be-446c-907c-b6de089f084c req-4fc5022f-7ee7-46b1-8a5c-0fcdfe5d491e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035308 Oct 18 16:54:17.942955 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3833/7648] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:54:18.130756 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-abca09cd-4692-4358-8d9e-e49039357bbd tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:54:18.131380 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-abca09cd-4692-4358-8d9e-e49039357bbd tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: d6774c01-3d94-419c-8470-0d6f45397dd9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:54:18.138830 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-abca09cd-4692-4358-8d9e-e49039357bbd tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:18.139402 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-abca09cd-4692-4358-8d9e-e49039357bbd tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:18.139848 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-abca09cd-4692-4358-8d9e-e49039357bbd tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:18.140550 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-abca09cd-4692-4358-8d9e-e49039357bbd tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:18.141050 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-abca09cd-4692-4358-8d9e-e49039357bbd tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:18.141483 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-abca09cd-4692-4358-8d9e-e49039357bbd tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:18.278344 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-abca09cd-4692-4358-8d9e-e49039357bbd tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:54:18.286670 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-abca09cd-4692-4358-8d9e-e49039357bbd tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/d6774c01-3d94-419c-8470-0d6f45397dd9" status: 200 len: 1392 microversion: 2.1 time: 0.159890 Oct 18 16:54:18.287262 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3816/7649] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:54:18 2022] GET /compute/v2.1/servers/d6774c01-3d94-419c-8470-0d6f45397dd9 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:54:19.310935 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5f7a579c-915c-4388-a3dd-87725f5ef541 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:54:19.311661 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5f7a579c-915c-4388-a3dd-87725f5ef541 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: d6774c01-3d94-419c-8470-0d6f45397dd9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:54:19.313747 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:54:19.314454 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=6 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:54:19.321263 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5f7a579c-915c-4388-a3dd-87725f5ef541 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:19.321769 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5f7a579c-915c-4388-a3dd-87725f5ef541 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:19.322231 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5f7a579c-915c-4388-a3dd-87725f5ef541 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:19.322988 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5f7a579c-915c-4388-a3dd-87725f5ef541 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:19.323473 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5f7a579c-915c-4388-a3dd-87725f5ef541 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:19.323922 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5f7a579c-915c-4388-a3dd-87725f5ef541 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:19.464414 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5f7a579c-915c-4388-a3dd-87725f5ef541 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:54:19.472182 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5f7a579c-915c-4388-a3dd-87725f5ef541 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/d6774c01-3d94-419c-8470-0d6f45397dd9" status: 200 len: 1392 microversion: 2.1 time: 0.165953 Oct 18 16:54:19.472940 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3834/7650] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:54:19 2022] GET /compute/v2.1/servers/d6774c01-3d94-419c-8470-0d6f45397dd9 => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:54:20.494523 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4b7dcad1-3a70-4c35-8806-c5576e2accc0 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:54:20.495141 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4b7dcad1-3a70-4c35-8806-c5576e2accc0 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: d6774c01-3d94-419c-8470-0d6f45397dd9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:54:20.497607 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:54:20.499338 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:54:20.506102 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b7dcad1-3a70-4c35-8806-c5576e2accc0 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:20.506594 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b7dcad1-3a70-4c35-8806-c5576e2accc0 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:20.507029 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b7dcad1-3a70-4c35-8806-c5576e2accc0 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:20.507732 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b7dcad1-3a70-4c35-8806-c5576e2accc0 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:20.508187 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b7dcad1-3a70-4c35-8806-c5576e2accc0 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:20.508620 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b7dcad1-3a70-4c35-8806-c5576e2accc0 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:20.643722 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4b7dcad1-3a70-4c35-8806-c5576e2accc0 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:54:20.651465 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4b7dcad1-3a70-4c35-8806-c5576e2accc0 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/d6774c01-3d94-419c-8470-0d6f45397dd9" status: 200 len: 1565 microversion: 2.1 time: 0.160887 Oct 18 16:54:20.652027 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3817/7651] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:54:20 2022] GET /compute/v2.1/servers/d6774c01-3d94-419c-8470-0d6f45397dd9 => generated 1565 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:54:20.674111 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0d93f633-b1dc-40c1-b67d-7b0b35d6e99d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:54:20.674719 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0d93f633-b1dc-40c1-b67d-7b0b35d6e99d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: d6774c01-3d94-419c-8470-0d6f45397dd9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:54:20.681574 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0d93f633-b1dc-40c1-b67d-7b0b35d6e99d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:20.682070 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0d93f633-b1dc-40c1-b67d-7b0b35d6e99d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:20.682524 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0d93f633-b1dc-40c1-b67d-7b0b35d6e99d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:20.683236 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0d93f633-b1dc-40c1-b67d-7b0b35d6e99d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:20.683704 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0d93f633-b1dc-40c1-b67d-7b0b35d6e99d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:20.684141 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0d93f633-b1dc-40c1-b67d-7b0b35d6e99d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:20.819935 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0d93f633-b1dc-40c1-b67d-7b0b35d6e99d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:54:20.827950 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0d93f633-b1dc-40c1-b67d-7b0b35d6e99d tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/d6774c01-3d94-419c-8470-0d6f45397dd9" status: 200 len: 1565 microversion: 2.1 time: 0.157665 Oct 18 16:54:20.828533 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3835/7652] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:54:20 2022] GET /compute/v2.1/servers/d6774c01-3d94-419c-8470-0d6f45397dd9 => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:54:22.703383 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a7c45ac0-7477-448c-aa98-1c051d8f9d33 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:54:22.704025 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a7c45ac0-7477-448c-aa98-1c051d8f9d33 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: d6774c01-3d94-419c-8470-0d6f45397dd9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:54:22.706360 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-777873c5-bf65-4521-9888-912d8ed283fd req-e71356cf-f8f0-47ac-9163-c260782e29d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6774c01-3d94-419c-8470-0d6f45397dd9", "tag": "71d8ddc5-2ebd-4840-b522-004e376828ba"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:54:22.712275 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7c45ac0-7477-448c-aa98-1c051d8f9d33 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:22.713120 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7c45ac0-7477-448c-aa98-1c051d8f9d33 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:22.713769 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7c45ac0-7477-448c-aa98-1c051d8f9d33 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:22.714526 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7c45ac0-7477-448c-aa98-1c051d8f9d33 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:22.715078 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7c45ac0-7477-448c-aa98-1c051d8f9d33 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:22.715538 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7c45ac0-7477-448c-aa98-1c051d8f9d33 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:22.716638 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-777873c5-bf65-4521-9888-912d8ed283fd req-e71356cf-f8f0-47ac-9163-c260782e29d8 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:22.717175 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-777873c5-bf65-4521-9888-912d8ed283fd req-e71356cf-f8f0-47ac-9163-c260782e29d8 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:22.717627 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-777873c5-bf65-4521-9888-912d8ed283fd req-e71356cf-f8f0-47ac-9163-c260782e29d8 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:22.729709 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-777873c5-bf65-4521-9888-912d8ed283fd req-e71356cf-f8f0-47ac-9163-c260782e29d8 service nova] Creating event network-changed:71d8ddc5-2ebd-4840-b522-004e376828ba for instance d6774c01-3d94-419c-8470-0d6f45397dd9 on n-h1-853682-5 Oct 18 16:54:22.738016 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-777873c5-bf65-4521-9888-912d8ed283fd req-e71356cf-f8f0-47ac-9163-c260782e29d8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035287 Oct 18 16:54:22.738625 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3836/7653] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:54:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:54:22.859213 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a7c45ac0-7477-448c-aa98-1c051d8f9d33 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:54:22.867308 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a7c45ac0-7477-448c-aa98-1c051d8f9d33 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/d6774c01-3d94-419c-8470-0d6f45397dd9" status: 200 len: 1565 microversion: 2.1 time: 0.168245 Oct 18 16:54:22.868103 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3818/7654] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:54:22 2022] GET /compute/v2.1/servers/d6774c01-3d94-419c-8470-0d6f45397dd9 => generated 1565 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:54:54.152714 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:54:54.153524 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=38 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:54:54.158794 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b00a0c2e-91a4-4425-8ad4-19eaf5ba7345 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:54:54.161110 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b00a0c2e-91a4-4425-8ad4-19eaf5ba7345 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: d6774c01-3d94-419c-8470-0d6f45397dd9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:54:54.169758 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b00a0c2e-91a4-4425-8ad4-19eaf5ba7345 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:54.170256 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b00a0c2e-91a4-4425-8ad4-19eaf5ba7345 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:54.170702 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b00a0c2e-91a4-4425-8ad4-19eaf5ba7345 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:54.171411 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b00a0c2e-91a4-4425-8ad4-19eaf5ba7345 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:54:54.171877 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b00a0c2e-91a4-4425-8ad4-19eaf5ba7345 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:54:54.172314 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b00a0c2e-91a4-4425-8ad4-19eaf5ba7345 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:54:54.244269 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b00a0c2e-91a4-4425-8ad4-19eaf5ba7345 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "POST /compute/v2.1/servers/d6774c01-3d94-419c-8470-0d6f45397dd9/action" status: 200 len: 24564 microversion: 2.1 time: 0.093387 Oct 18 16:54:54.244944 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3837/7655] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:54:54 2022] POST /compute/v2.1/servers/d6774c01-3d94-419c-8470-0d6f45397dd9/action => generated 24564 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:55:24.670472 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:55:24.671218 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=42 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:55:24.672596 n-d-853682-5 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 16:55:24.672739 n-d-853682-5 devstack@n-api.service[120406]: Tue Oct 18 16:55:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d6774c01-3d94-419c-8470-0d6f45397dd9/action (ip 10.222.0.60) !!! Oct 18 16:55:24.677851 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e4978d1c-6f8e-4568-a41a-53fec71bb708 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:55:24.678396 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e4978d1c-6f8e-4568-a41a-53fec71bb708 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: d6774c01-3d94-419c-8470-0d6f45397dd9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:55:24.686551 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4978d1c-6f8e-4568-a41a-53fec71bb708 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:24.687053 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4978d1c-6f8e-4568-a41a-53fec71bb708 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:24.687498 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4978d1c-6f8e-4568-a41a-53fec71bb708 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:24.688233 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4978d1c-6f8e-4568-a41a-53fec71bb708 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:24.688695 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4978d1c-6f8e-4568-a41a-53fec71bb708 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:24.689157 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4978d1c-6f8e-4568-a41a-53fec71bb708 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:24.714371 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-e4978d1c-6f8e-4568-a41a-53fec71bb708 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lazy-loading 'flavor' on Instance uuid d6774c01-3d94-419c-8470-0d6f45397dd9 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:55:24.780390 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e4978d1c-6f8e-4568-a41a-53fec71bb708 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "POST /compute/v2.1/servers/d6774c01-3d94-419c-8470-0d6f45397dd9/action" status: 202 len: 0 microversion: 2.1 time: 0.111341 Oct 18 16:55:24.781214 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3819/7656] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:55:24 2022] POST /compute/v2.1/servers/d6774c01-3d94-419c-8470-0d6f45397dd9/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:55:24.791019 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f22c0a2b-f03e-445d-a32f-1e4c6a5506ac tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:55:24.791761 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f22c0a2b-f03e-445d-a32f-1e4c6a5506ac tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: d6774c01-3d94-419c-8470-0d6f45397dd9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:55:24.794480 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=4 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:55:24.795140 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:55:24.803534 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f22c0a2b-f03e-445d-a32f-1e4c6a5506ac tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:24.804058 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f22c0a2b-f03e-445d-a32f-1e4c6a5506ac tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:24.804517 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f22c0a2b-f03e-445d-a32f-1e4c6a5506ac tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:24.805277 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f22c0a2b-f03e-445d-a32f-1e4c6a5506ac tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:24.805759 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f22c0a2b-f03e-445d-a32f-1e4c6a5506ac tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:24.806207 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f22c0a2b-f03e-445d-a32f-1e4c6a5506ac tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:25.042877 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f22c0a2b-f03e-445d-a32f-1e4c6a5506ac tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:55:25.050615 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f22c0a2b-f03e-445d-a32f-1e4c6a5506ac tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/d6774c01-3d94-419c-8470-0d6f45397dd9" status: 200 len: 1692 microversion: 2.1 time: 0.265013 Oct 18 16:55:25.051187 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3838/7657] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:55:24 2022] GET /compute/v2.1/servers/d6774c01-3d94-419c-8470-0d6f45397dd9 => generated 1692 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:55:26.079362 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6768d4a1-ebb3-4601-9850-8ab7a8c08f3e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:55:26.080070 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6768d4a1-ebb3-4601-9850-8ab7a8c08f3e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: d6774c01-3d94-419c-8470-0d6f45397dd9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:55:26.086841 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6768d4a1-ebb3-4601-9850-8ab7a8c08f3e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:26.087332 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6768d4a1-ebb3-4601-9850-8ab7a8c08f3e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:26.087775 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6768d4a1-ebb3-4601-9850-8ab7a8c08f3e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:26.088471 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6768d4a1-ebb3-4601-9850-8ab7a8c08f3e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:26.088956 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6768d4a1-ebb3-4601-9850-8ab7a8c08f3e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:26.089572 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6768d4a1-ebb3-4601-9850-8ab7a8c08f3e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:26.292178 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6768d4a1-ebb3-4601-9850-8ab7a8c08f3e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:55:26.300001 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6768d4a1-ebb3-4601-9850-8ab7a8c08f3e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/d6774c01-3d94-419c-8470-0d6f45397dd9" status: 200 len: 1692 microversion: 2.1 time: 0.227288 Oct 18 16:55:26.300608 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3820/7658] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:55:26 2022] GET /compute/v2.1/servers/d6774c01-3d94-419c-8470-0d6f45397dd9 => generated 1692 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:55:27.324502 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c99561e3-63b2-4a36-8326-611aa2309ff8 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:55:27.325440 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c99561e3-63b2-4a36-8326-611aa2309ff8 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: d6774c01-3d94-419c-8470-0d6f45397dd9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:55:27.332477 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c99561e3-63b2-4a36-8326-611aa2309ff8 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:27.333017 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c99561e3-63b2-4a36-8326-611aa2309ff8 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:27.333475 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c99561e3-63b2-4a36-8326-611aa2309ff8 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:27.334184 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c99561e3-63b2-4a36-8326-611aa2309ff8 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:27.334659 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c99561e3-63b2-4a36-8326-611aa2309ff8 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:27.335098 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c99561e3-63b2-4a36-8326-611aa2309ff8 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:27.467646 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c99561e3-63b2-4a36-8326-611aa2309ff8 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:55:27.475453 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c99561e3-63b2-4a36-8326-611aa2309ff8 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/d6774c01-3d94-419c-8470-0d6f45397dd9" status: 200 len: 1675 microversion: 2.1 time: 0.154920 Oct 18 16:55:27.476044 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3839/7659] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:55:27 2022] GET /compute/v2.1/servers/d6774c01-3d94-419c-8470-0d6f45397dd9 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:55:28.575240 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b6606cab-5779-49b6-9b22-619c50583d85 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:55:28.577529 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b6606cab-5779-49b6-9b22-619c50583d85 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: d6774c01-3d94-419c-8470-0d6f45397dd9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:55:28.585047 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b6606cab-5779-49b6-9b22-619c50583d85 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:28.585544 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b6606cab-5779-49b6-9b22-619c50583d85 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:28.585989 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b6606cab-5779-49b6-9b22-619c50583d85 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:28.586691 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b6606cab-5779-49b6-9b22-619c50583d85 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:28.587151 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b6606cab-5779-49b6-9b22-619c50583d85 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:28.587581 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b6606cab-5779-49b6-9b22-619c50583d85 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:28.649601 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b6606cab-5779-49b6-9b22-619c50583d85 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "POST /compute/v2.1/servers/d6774c01-3d94-419c-8470-0d6f45397dd9/action" status: 200 len: 37578 microversion: 2.1 time: 0.078166 Oct 18 16:55:28.650515 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3821/7660] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:55:28 2022] POST /compute/v2.1/servers/d6774c01-3d94-419c-8470-0d6f45397dd9/action => generated 37578 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:55:28.662376 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5719b58d-3f57-4877-b8c1-b65efd503110 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:55:28.662961 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5719b58d-3f57-4877-b8c1-b65efd503110 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: d6774c01-3d94-419c-8470-0d6f45397dd9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:55:28.670082 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5719b58d-3f57-4877-b8c1-b65efd503110 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:28.670590 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5719b58d-3f57-4877-b8c1-b65efd503110 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:28.671070 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5719b58d-3f57-4877-b8c1-b65efd503110 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:28.671796 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5719b58d-3f57-4877-b8c1-b65efd503110 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:28.672273 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5719b58d-3f57-4877-b8c1-b65efd503110 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:28.672764 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5719b58d-3f57-4877-b8c1-b65efd503110 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:28.741304 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5719b58d-3f57-4877-b8c1-b65efd503110 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "POST /compute/v2.1/servers/d6774c01-3d94-419c-8470-0d6f45397dd9/action" status: 202 len: 0 microversion: 2.1 time: 0.081856 Oct 18 16:55:28.741304 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3840/7661] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:55:28 2022] POST /compute/v2.1/servers/d6774c01-3d94-419c-8470-0d6f45397dd9/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:55:28.750067 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fecf1e54-35d9-4070-95c1-aeb80f186441 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:55:28.750778 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fecf1e54-35d9-4070-95c1-aeb80f186441 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: d6774c01-3d94-419c-8470-0d6f45397dd9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:55:28.758472 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fecf1e54-35d9-4070-95c1-aeb80f186441 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:28.758989 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fecf1e54-35d9-4070-95c1-aeb80f186441 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:28.759429 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fecf1e54-35d9-4070-95c1-aeb80f186441 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:28.760142 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fecf1e54-35d9-4070-95c1-aeb80f186441 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:28.760606 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fecf1e54-35d9-4070-95c1-aeb80f186441 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:28.761074 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fecf1e54-35d9-4070-95c1-aeb80f186441 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:28.908017 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fecf1e54-35d9-4070-95c1-aeb80f186441 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:55:28.916206 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fecf1e54-35d9-4070-95c1-aeb80f186441 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/d6774c01-3d94-419c-8470-0d6f45397dd9" status: 200 len: 1681 microversion: 2.1 time: 0.170386 Oct 18 16:55:28.916991 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3822/7662] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:55:28 2022] GET /compute/v2.1/servers/d6774c01-3d94-419c-8470-0d6f45397dd9 => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:55:29.942572 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d05ef839-6392-4699-922b-398e61e7e1ec tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:55:29.943288 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d05ef839-6392-4699-922b-398e61e7e1ec tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: d6774c01-3d94-419c-8470-0d6f45397dd9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:55:29.950389 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d05ef839-6392-4699-922b-398e61e7e1ec tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:29.950835 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d05ef839-6392-4699-922b-398e61e7e1ec tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:29.951289 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d05ef839-6392-4699-922b-398e61e7e1ec tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:29.952001 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d05ef839-6392-4699-922b-398e61e7e1ec tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:29.952475 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d05ef839-6392-4699-922b-398e61e7e1ec tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:29.952949 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d05ef839-6392-4699-922b-398e61e7e1ec tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:30.091244 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d05ef839-6392-4699-922b-398e61e7e1ec tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:55:30.099573 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d05ef839-6392-4699-922b-398e61e7e1ec tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/d6774c01-3d94-419c-8470-0d6f45397dd9" status: 200 len: 1681 microversion: 2.1 time: 0.162144 Oct 18 16:55:30.100169 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3841/7663] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:55:29 2022] GET /compute/v2.1/servers/d6774c01-3d94-419c-8470-0d6f45397dd9 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:55:31.123132 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-64eed226-f8aa-4e7a-9b71-fc6054e624fc tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:55:31.123758 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-64eed226-f8aa-4e7a-9b71-fc6054e624fc tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: d6774c01-3d94-419c-8470-0d6f45397dd9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:55:31.130710 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64eed226-f8aa-4e7a-9b71-fc6054e624fc tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:31.131204 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64eed226-f8aa-4e7a-9b71-fc6054e624fc tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:31.131668 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64eed226-f8aa-4e7a-9b71-fc6054e624fc tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:31.132377 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64eed226-f8aa-4e7a-9b71-fc6054e624fc tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:31.132873 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64eed226-f8aa-4e7a-9b71-fc6054e624fc tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:31.133316 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64eed226-f8aa-4e7a-9b71-fc6054e624fc tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:31.268985 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-64eed226-f8aa-4e7a-9b71-fc6054e624fc tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:55:31.277466 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-64eed226-f8aa-4e7a-9b71-fc6054e624fc tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/d6774c01-3d94-419c-8470-0d6f45397dd9" status: 200 len: 1684 microversion: 2.1 time: 0.158249 Oct 18 16:55:31.278072 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3823/7664] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:55:31 2022] GET /compute/v2.1/servers/d6774c01-3d94-419c-8470-0d6f45397dd9 => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:55:31.373062 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ae12ae45-efaf-4269-a91d-2d537e7e4abf tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:55:31.375364 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ae12ae45-efaf-4269-a91d-2d537e7e4abf tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: d6774c01-3d94-419c-8470-0d6f45397dd9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:55:31.382205 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae12ae45-efaf-4269-a91d-2d537e7e4abf tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:31.382708 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae12ae45-efaf-4269-a91d-2d537e7e4abf tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:31.383169 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae12ae45-efaf-4269-a91d-2d537e7e4abf tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:31.383883 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae12ae45-efaf-4269-a91d-2d537e7e4abf tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:31.384362 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae12ae45-efaf-4269-a91d-2d537e7e4abf tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:31.384820 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae12ae45-efaf-4269-a91d-2d537e7e4abf tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:31.448299 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ae12ae45-efaf-4269-a91d-2d537e7e4abf tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "POST /compute/v2.1/servers/d6774c01-3d94-419c-8470-0d6f45397dd9/action" status: 200 len: 37578 microversion: 2.1 time: 0.079093 Oct 18 16:55:31.448961 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3842/7665] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:55:31 2022] POST /compute/v2.1/servers/d6774c01-3d94-419c-8470-0d6f45397dd9/action => generated 37578 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 16:55:32.470493 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eadea7ae-ae1b-46a6-8737-37b4e05db04b tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:55:32.471522 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-eadea7ae-ae1b-46a6-8737-37b4e05db04b tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: d6774c01-3d94-419c-8470-0d6f45397dd9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:55:32.480475 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eadea7ae-ae1b-46a6-8737-37b4e05db04b tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:32.481043 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eadea7ae-ae1b-46a6-8737-37b4e05db04b tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:32.481494 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eadea7ae-ae1b-46a6-8737-37b4e05db04b tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:32.482356 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eadea7ae-ae1b-46a6-8737-37b4e05db04b tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:32.482668 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eadea7ae-ae1b-46a6-8737-37b4e05db04b tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:32.483112 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eadea7ae-ae1b-46a6-8737-37b4e05db04b tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:32.511179 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-eadea7ae-ae1b-46a6-8737-37b4e05db04b tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: d6774c01-3d94-419c-8470-0d6f45397dd9] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 16:55:32.520550 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-f54abb87-f92c-4cca-ac93-0e5152493830 req-dc1672b4-23f7-4bb7-b779-28549f04591b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6774c01-3d94-419c-8470-0d6f45397dd9", "tag": "71d8ddc5-2ebd-4840-b522-004e376828ba"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:55:32.533348 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-f54abb87-f92c-4cca-ac93-0e5152493830 req-dc1672b4-23f7-4bb7-b779-28549f04591b service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:32.533936 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-f54abb87-f92c-4cca-ac93-0e5152493830 req-dc1672b4-23f7-4bb7-b779-28549f04591b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:32.534486 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-f54abb87-f92c-4cca-ac93-0e5152493830 req-dc1672b4-23f7-4bb7-b779-28549f04591b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:32.546908 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-f54abb87-f92c-4cca-ac93-0e5152493830 req-dc1672b4-23f7-4bb7-b779-28549f04591b service nova] Creating event network-changed:71d8ddc5-2ebd-4840-b522-004e376828ba for instance d6774c01-3d94-419c-8470-0d6f45397dd9 on n-h1-853682-5 Oct 18 16:55:32.552059 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-f54abb87-f92c-4cca-ac93-0e5152493830 req-dc1672b4-23f7-4bb7-b779-28549f04591b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088870 Oct 18 16:55:32.553711 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3843/7666] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:55:32.596089 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-eadea7ae-ae1b-46a6-8737-37b4e05db04b tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d6774c01-3d94-419c-8470-0d6f45397dd9" status: 204 len: 0 microversion: 2.1 time: 0.136513 Oct 18 16:55:32.597111 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3824/7667] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 16:55:32 2022] DELETE /compute/v2.1/servers/d6774c01-3d94-419c-8470-0d6f45397dd9 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 16:55:32.605915 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-67e9737f-a563-487b-88cd-893c8a080f6e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:55:32.606928 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-67e9737f-a563-487b-88cd-893c8a080f6e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: d6774c01-3d94-419c-8470-0d6f45397dd9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:55:32.614179 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-67e9737f-a563-487b-88cd-893c8a080f6e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:32.614951 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-67e9737f-a563-487b-88cd-893c8a080f6e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:32.616112 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-67e9737f-a563-487b-88cd-893c8a080f6e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:32.617119 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-67e9737f-a563-487b-88cd-893c8a080f6e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:32.617793 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-67e9737f-a563-487b-88cd-893c8a080f6e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:32.618440 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-67e9737f-a563-487b-88cd-893c8a080f6e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:32.759023 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-67e9737f-a563-487b-88cd-893c8a080f6e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:55:32.767156 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-67e9737f-a563-487b-88cd-893c8a080f6e tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/d6774c01-3d94-419c-8470-0d6f45397dd9" status: 200 len: 1690 microversion: 2.1 time: 0.165422 Oct 18 16:55:32.767751 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3844/7668] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:55:32 2022] GET /compute/v2.1/servers/d6774c01-3d94-419c-8470-0d6f45397dd9 => generated 1690 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:55:33.793719 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-764417e7-6703-4e5d-8650-bb6288783f03 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:55:33.794425 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-764417e7-6703-4e5d-8650-bb6288783f03 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: d6774c01-3d94-419c-8470-0d6f45397dd9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:55:33.801544 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-764417e7-6703-4e5d-8650-bb6288783f03 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:33.802038 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-764417e7-6703-4e5d-8650-bb6288783f03 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:33.802481 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-764417e7-6703-4e5d-8650-bb6288783f03 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:33.803855 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-764417e7-6703-4e5d-8650-bb6288783f03 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:33.804321 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-764417e7-6703-4e5d-8650-bb6288783f03 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:33.804754 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-764417e7-6703-4e5d-8650-bb6288783f03 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:33.941032 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-764417e7-6703-4e5d-8650-bb6288783f03 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:55:33.948912 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-764417e7-6703-4e5d-8650-bb6288783f03 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/d6774c01-3d94-419c-8470-0d6f45397dd9" status: 200 len: 1690 microversion: 2.1 time: 0.159395 Oct 18 16:55:33.949429 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3825/7669] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:55:33 2022] GET /compute/v2.1/servers/d6774c01-3d94-419c-8470-0d6f45397dd9 => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:55:34.866229 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-2c229a82-643a-4cd7-a87a-432a0efd8e62 req-cedbbdc2-c1fb-4e00-8da9-e5f25f882027 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6774c01-3d94-419c-8470-0d6f45397dd9", "name": "network-vif-deleted", "tag": "71d8ddc5-2ebd-4840-b522-004e376828ba"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:55:34.877252 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-2c229a82-643a-4cd7-a87a-432a0efd8e62 req-cedbbdc2-c1fb-4e00-8da9-e5f25f882027 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:34.877745 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-2c229a82-643a-4cd7-a87a-432a0efd8e62 req-cedbbdc2-c1fb-4e00-8da9-e5f25f882027 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:34.878192 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-2c229a82-643a-4cd7-a87a-432a0efd8e62 req-cedbbdc2-c1fb-4e00-8da9-e5f25f882027 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:34.891503 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-2c229a82-643a-4cd7-a87a-432a0efd8e62 req-cedbbdc2-c1fb-4e00-8da9-e5f25f882027 service nova] Creating event network-vif-deleted:71d8ddc5-2ebd-4840-b522-004e376828ba for instance d6774c01-3d94-419c-8470-0d6f45397dd9 on n-h1-853682-5 Oct 18 16:55:34.896924 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-2c229a82-643a-4cd7-a87a-432a0efd8e62 req-cedbbdc2-c1fb-4e00-8da9-e5f25f882027 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035034 Oct 18 16:55:34.897809 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3845/7670] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 16:55:34.972740 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-79e4d496-9aa9-4d7a-bd84-4b990708a53a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:55:34.973999 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-79e4d496-9aa9-4d7a-bd84-4b990708a53a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: d6774c01-3d94-419c-8470-0d6f45397dd9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:55:34.981134 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79e4d496-9aa9-4d7a-bd84-4b990708a53a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:34.981821 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79e4d496-9aa9-4d7a-bd84-4b990708a53a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:34.982269 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79e4d496-9aa9-4d7a-bd84-4b990708a53a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:34.983715 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79e4d496-9aa9-4d7a-bd84-4b990708a53a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:34.984189 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79e4d496-9aa9-4d7a-bd84-4b990708a53a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:34.984631 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79e4d496-9aa9-4d7a-bd84-4b990708a53a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:35.020370 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79e4d496-9aa9-4d7a-bd84-4b990708a53a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:35.021063 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79e4d496-9aa9-4d7a-bd84-4b990708a53a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:35.021433 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79e4d496-9aa9-4d7a-bd84-4b990708a53a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:35.022159 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-79e4d496-9aa9-4d7a-bd84-4b990708a53a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lazy-loading 'fault' on Instance uuid d6774c01-3d94-419c-8470-0d6f45397dd9 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:55:35.072592 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-79e4d496-9aa9-4d7a-bd84-4b990708a53a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0040ae38b5542b9ac7d87de246e7108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f588c570d1c3475598357e7d21cd64f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:55:35.080556 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-79e4d496-9aa9-4d7a-bd84-4b990708a53a tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/d6774c01-3d94-419c-8470-0d6f45397dd9" status: 200 len: 1356 microversion: 2.1 time: 0.112209 Oct 18 16:55:35.081395 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3826/7671] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:55:34 2022] GET /compute/v2.1/servers/d6774c01-3d94-419c-8470-0d6f45397dd9 => generated 1356 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:55:36.106503 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d6a9bb36-9c71-4e1a-bab8-0e771d814bf6 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:55:36.107251 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d6a9bb36-9c71-4e1a-bab8-0e771d814bf6 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] [instance: d6774c01-3d94-419c-8470-0d6f45397dd9] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:55:36.114327 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d6a9bb36-9c71-4e1a-bab8-0e771d814bf6 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:36.114828 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d6a9bb36-9c71-4e1a-bab8-0e771d814bf6 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:36.115925 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d6a9bb36-9c71-4e1a-bab8-0e771d814bf6 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:36.116628 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d6a9bb36-9c71-4e1a-bab8-0e771d814bf6 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:36.117127 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d6a9bb36-9c71-4e1a-bab8-0e771d814bf6 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:36.117613 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d6a9bb36-9c71-4e1a-bab8-0e771d814bf6 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:36.130794 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-d6a9bb36-9c71-4e1a-bab8-0e771d814bf6 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] HTTP exception thrown: Instance d6774c01-3d94-419c-8470-0d6f45397dd9 could not be found. Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d6a9bb36-9c71-4e1a-bab8-0e771d814bf6 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Request method failure captured: Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/d6774c01-3d94-419c-8470-0d6f45397dd9 HTTP/1.1 Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTthsYkwDcRi6ejpHtt4H8SQkGaHFzHuIXkg1m4QUw3Qt5Uv9NPiBxRcaK-NQwUI3S4BWwnXo3saj3Q2PKxNAS-I0ST7wp5S5RSkuwZEJ12enI0qMMMoKC1L1prWuMDD4oklSgZx5x8J281mShnqu67jB5xP0xd3PanqU2RBtQqY8QyI Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: f588c570d1c3475598357e7d21cd64f2 Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2023049857 Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f588c570d1c3475598357e7d21cd64f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f588c570d1c3475598357e7d21cd64f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f588c570d1c3475598357e7d21cd64f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f588c570d1c3475598357e7d21cd64f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2023049857 Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: f588c570d1c3475598357e7d21cd64f2 Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2023049857 Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-TestNetworkAdvancedServerOps-2023049857-project Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: a0040ae38b5542b9ac7d87de246e7108 Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2023049857-project Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance d6774c01-3d94-419c-8470-0d6f45397dd9 could not be found. Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': 'd6774c01-3d94-419c-8470-0d6f45397dd9'} Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6774c01-3d94-419c-8470-0d6f45397dd9 could not be found. Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6774c01-3d94-419c-8470-0d6f45397dd9 could not be found. Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:55:36.132424 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 16:55:36.138604 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:55:36.138604 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 16:55:36.138604 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 16:55:36.138604 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 16:55:36.138604 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 16:55:36.138604 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 16:55:36.138604 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6774c01-3d94-419c-8470-0d6f45397dd9 could not be found. Oct 18 16:55:36.138604 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 16:55:36.138604 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d6a9bb36-9c71-4e1a-bab8-0e771d814bf6 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Returning 404 to user: Instance d6774c01-3d94-419c-8470-0d6f45397dd9 could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 16:55:36.138604 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d6a9bb36-9c71-4e1a-bab8-0e771d814bf6 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "GET /compute/v2.1/servers/d6774c01-3d94-419c-8470-0d6f45397dd9" status: 404 len: 111 microversion: 2.1 time: 0.031711 Oct 18 16:55:36.138604 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3846/7672] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:55:36 2022] GET /compute/v2.1/servers/d6774c01-3d94-419c-8470-0d6f45397dd9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 16:55:39.466003 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-015fd9cb-57d8-4d50-8acc-7ba84340e092 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] Calling method '.version_select at 0x7f7c3d3a5670>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:55:39.487186 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-015fd9cb-57d8-4d50-8acc-7ba84340e092 tempest-TestNetworkAdvancedServerOps-2023049857 tempest-TestNetworkAdvancedServerOps-2023049857-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-511222012" status: 202 len: 0 microversion: 2.1 time: 0.024924 Oct 18 16:55:39.487833 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3827/7673] 10.222.0.60 () {58 vars in 1281 bytes} [Tue Oct 18 16:55:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-511222012 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:55:50.606571 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=18 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:55:50.607327 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:55:50.833924 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f029df3c-aee5-4ebb-880a-fbd1b8212722 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Action: 'create', calling method: .version_select at 0x7f7c3d07e790>, body: {"keypair": {"name": "tempest-TestShelveInstance-788282270", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQJ9Mjo6gUV7FP9u3NomTnw8Y6Jo0PywtBjPdBWHSotkv+LGxilXk1DAPU777TeOhTYJjq9yuKDyLAtMFz3AfvjG+6qL62NZpupUIy6PO7fq2aLGbl9mxK7DzVlsfVRtg=="}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:55:50.852015 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-f029df3c-aee5-4ebb-880a-fbd1b8212722 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Getting quotas for project b495752af59843c9b5c2270dabc10a78. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:55:50.857861 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-f029df3c-aee5-4ebb-880a-fbd1b8212722 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Getting quotas for user b93520a1077949b6ab65c9c3a98772ce and project b495752af59843c9b5c2270dabc10a78. Resources: {'key_pairs'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:55:50.889675 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f029df3c-aee5-4ebb-880a-fbd1b8212722 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.288518 Oct 18 16:55:50.891114 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3847/7674] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Oct 18 16:55:50 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:55:51.866785 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:55:51.867599 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:55:51.871615 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6b6c162a-f7ed-4525-b5eb-6bcf1bb1a421 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-95563911", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-788282270", "security_groups": [{"name": "tempest-secgroup-smoke-1707143237"}], "networks": [{"uuid": "1c801ca4-0dea-4415-aa55-84e9ee722b5a"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:55:52.000674 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-6b6c162a-f7ed-4525-b5eb-6bcf1bb1a421 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] validate_networks() for [('1c801ca4-0dea-4415-aa55-84e9ee722b5a', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 16:55:52.432376 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-6b6c162a-f7ed-4525-b5eb-6bcf1bb1a421 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 16:55:52.433135 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-6b6c162a-f7ed-4525-b5eb-6bcf1bb1a421 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 16:55:52.433801 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-6b6c162a-f7ed-4525-b5eb-6bcf1bb1a421 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 16:55:52.434222 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-6b6c162a-f7ed-4525-b5eb-6bcf1bb1a421 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 16:55:52.434643 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-6b6c162a-f7ed-4525-b5eb-6bcf1bb1a421 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 16:55:52.444495 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b6c162a-f7ed-4525-b5eb-6bcf1bb1a421 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:52.445042 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b6c162a-f7ed-4525-b5eb-6bcf1bb1a421 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:52.445488 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b6c162a-f7ed-4525-b5eb-6bcf1bb1a421 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:52.446451 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b6c162a-f7ed-4525-b5eb-6bcf1bb1a421 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:52.446911 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b6c162a-f7ed-4525-b5eb-6bcf1bb1a421 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:52.447523 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b6c162a-f7ed-4525-b5eb-6bcf1bb1a421 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:52.472161 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-6b6c162a-f7ed-4525-b5eb-6bcf1bb1a421 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Getting quotas for project b495752af59843c9b5c2270dabc10a78. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 16:55:52.478478 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-6b6c162a-f7ed-4525-b5eb-6bcf1bb1a421 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Getting quotas for user b93520a1077949b6ab65c9c3a98772ce and project b495752af59843c9b5c2270dabc10a78. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 16:55:52.492764 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6b6c162a-f7ed-4525-b5eb-6bcf1bb1a421 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 16:55:52.495169 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6b6c162a-f7ed-4525-b5eb-6bcf1bb1a421 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 16:55:52.547876 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6b6c162a-f7ed-4525-b5eb-6bcf1bb1a421 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.682759 Oct 18 16:55:52.548796 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3828/7675] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 16:55:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 16:55:52.561018 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-aa42026c-8789-414a-8833-1a78ad9fc219 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:55:52.562303 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-aa42026c-8789-414a-8833-1a78ad9fc219 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:55:52.631378 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-aa42026c-8789-414a-8833-1a78ad9fc219 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:55:52.638954 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-aa42026c-8789-414a-8833-1a78ad9fc219 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0" status: 200 len: 1244 microversion: 2.1 time: 0.082119 Oct 18 16:55:52.639546 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3848/7676] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:55:52 2022] GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0 => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:55:53.665269 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-87b27dae-228f-4920-b58f-094d2da85cd8 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:55:53.666556 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-87b27dae-228f-4920-b58f-094d2da85cd8 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:55:53.678577 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87b27dae-228f-4920-b58f-094d2da85cd8 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:53.679076 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87b27dae-228f-4920-b58f-094d2da85cd8 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:53.685412 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87b27dae-228f-4920-b58f-094d2da85cd8 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:53.686410 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87b27dae-228f-4920-b58f-094d2da85cd8 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:53.686891 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87b27dae-228f-4920-b58f-094d2da85cd8 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:53.688014 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87b27dae-228f-4920-b58f-094d2da85cd8 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:53.791654 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-87b27dae-228f-4920-b58f-094d2da85cd8 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:55:53.800338 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-87b27dae-228f-4920-b58f-094d2da85cd8 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0" status: 200 len: 1314 microversion: 2.1 time: 0.140900 Oct 18 16:55:53.800872 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3829/7677] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:55:53 2022] GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0 => generated 1314 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:55:54.824951 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6193d572-1c9d-4c92-8551-3000c2d8b30a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:55:54.825597 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6193d572-1c9d-4c92-8551-3000c2d8b30a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:55:54.833196 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6193d572-1c9d-4c92-8551-3000c2d8b30a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:54.834312 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6193d572-1c9d-4c92-8551-3000c2d8b30a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:54.834777 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6193d572-1c9d-4c92-8551-3000c2d8b30a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:54.835517 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6193d572-1c9d-4c92-8551-3000c2d8b30a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:54.836201 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6193d572-1c9d-4c92-8551-3000c2d8b30a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:54.836652 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6193d572-1c9d-4c92-8551-3000c2d8b30a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:54.994046 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6193d572-1c9d-4c92-8551-3000c2d8b30a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:55:55.003056 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6193d572-1c9d-4c92-8551-3000c2d8b30a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0" status: 200 len: 1370 microversion: 2.1 time: 0.182305 Oct 18 16:55:55.003949 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3849/7678] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:55:54 2022] GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0 => generated 1370 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:55:55.218267 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-a8f3683b-64e8-4666-a1df-fc35a85a0f56 req-0ab9037a-ea13-4800-ad32-8e305f7e2ac6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21d02f4d-602e-4b71-838b-b6155b8eb4e0", "tag": "84784522-0492-4dfd-a391-e2cd2949e644"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:55:55.229641 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a8f3683b-64e8-4666-a1df-fc35a85a0f56 req-0ab9037a-ea13-4800-ad32-8e305f7e2ac6 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:55.230458 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a8f3683b-64e8-4666-a1df-fc35a85a0f56 req-0ab9037a-ea13-4800-ad32-8e305f7e2ac6 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:55.231112 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a8f3683b-64e8-4666-a1df-fc35a85a0f56 req-0ab9037a-ea13-4800-ad32-8e305f7e2ac6 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:55.245018 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-a8f3683b-64e8-4666-a1df-fc35a85a0f56 req-0ab9037a-ea13-4800-ad32-8e305f7e2ac6 service nova] Creating event network-changed:84784522-0492-4dfd-a391-e2cd2949e644 for instance 21d02f4d-602e-4b71-838b-b6155b8eb4e0 on n-h2-853682-5 Oct 18 16:55:55.250163 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-a8f3683b-64e8-4666-a1df-fc35a85a0f56 req-0ab9037a-ea13-4800-ad32-8e305f7e2ac6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108656 Oct 18 16:55:55.251108 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3830/7679] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:55:56.027199 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-89011e74-a3ff-4dac-a0de-f7338fcbae21 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:55:56.027825 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-89011e74-a3ff-4dac-a0de-f7338fcbae21 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:55:56.034887 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-89011e74-a3ff-4dac-a0de-f7338fcbae21 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:56.035471 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-89011e74-a3ff-4dac-a0de-f7338fcbae21 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:56.035818 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-89011e74-a3ff-4dac-a0de-f7338fcbae21 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:56.036521 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-89011e74-a3ff-4dac-a0de-f7338fcbae21 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:56.037103 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-89011e74-a3ff-4dac-a0de-f7338fcbae21 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:56.037545 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-89011e74-a3ff-4dac-a0de-f7338fcbae21 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:56.187698 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-89011e74-a3ff-4dac-a0de-f7338fcbae21 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:55:56.195428 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-89011e74-a3ff-4dac-a0de-f7338fcbae21 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0" status: 200 len: 1370 microversion: 2.1 time: 0.172164 Oct 18 16:55:56.196002 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3850/7680] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:55:56 2022] GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0 => generated 1370 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:55:57.218612 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9b51b05a-3794-4be0-8483-3431da031289 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:55:57.219320 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9b51b05a-3794-4be0-8483-3431da031289 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:55:57.226049 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9b51b05a-3794-4be0-8483-3431da031289 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:57.226530 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9b51b05a-3794-4be0-8483-3431da031289 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:57.226966 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9b51b05a-3794-4be0-8483-3431da031289 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:57.227655 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9b51b05a-3794-4be0-8483-3431da031289 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:57.228111 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9b51b05a-3794-4be0-8483-3431da031289 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:57.228541 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9b51b05a-3794-4be0-8483-3431da031289 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:57.363525 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9b51b05a-3794-4be0-8483-3431da031289 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:55:57.371836 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9b51b05a-3794-4be0-8483-3431da031289 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0" status: 200 len: 1370 microversion: 2.1 time: 0.157681 Oct 18 16:55:57.372412 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3831/7681] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:55:57 2022] GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0 => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:55:58.394932 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d4e53562-b7f6-474f-bf39-6a81fcb4e0cf tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:55:58.396740 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d4e53562-b7f6-474f-bf39-6a81fcb4e0cf tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:55:58.403607 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4e53562-b7f6-474f-bf39-6a81fcb4e0cf tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:58.404112 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4e53562-b7f6-474f-bf39-6a81fcb4e0cf tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:58.404917 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4e53562-b7f6-474f-bf39-6a81fcb4e0cf tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:58.405647 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4e53562-b7f6-474f-bf39-6a81fcb4e0cf tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:58.406123 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4e53562-b7f6-474f-bf39-6a81fcb4e0cf tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:58.407133 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4e53562-b7f6-474f-bf39-6a81fcb4e0cf tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:58.541834 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d4e53562-b7f6-474f-bf39-6a81fcb4e0cf tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:55:58.549474 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d4e53562-b7f6-474f-bf39-6a81fcb4e0cf tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0" status: 200 len: 1370 microversion: 2.1 time: 0.158545 Oct 18 16:55:58.550038 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3851/7682] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:55:58 2022] GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0 => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:55:59.572088 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b45cd678-49b8-4b71-8d02-84cb552c8892 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:55:59.572713 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b45cd678-49b8-4b71-8d02-84cb552c8892 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:55:59.579781 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b45cd678-49b8-4b71-8d02-84cb552c8892 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:59.580270 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b45cd678-49b8-4b71-8d02-84cb552c8892 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:59.580709 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b45cd678-49b8-4b71-8d02-84cb552c8892 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:59.581431 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b45cd678-49b8-4b71-8d02-84cb552c8892 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:55:59.581898 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b45cd678-49b8-4b71-8d02-84cb552c8892 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:55:59.582325 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b45cd678-49b8-4b71-8d02-84cb552c8892 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:55:59.714401 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b45cd678-49b8-4b71-8d02-84cb552c8892 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:55:59.722108 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b45cd678-49b8-4b71-8d02-84cb552c8892 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0" status: 200 len: 1370 microversion: 2.1 time: 0.154063 Oct 18 16:55:59.722687 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3832/7683] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:55:59 2022] GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0 => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:56:00.038464 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-22e0ba0a-2af7-497e-8759-3b09622e8b86 req-a3287618-6b68-4455-9493-2a70b29d7af1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21d02f4d-602e-4b71-838b-b6155b8eb4e0", "name": "network-vif-plugged", "status": "completed", "tag": "84784522-0492-4dfd-a391-e2cd2949e644"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:56:00.048433 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-22e0ba0a-2af7-497e-8759-3b09622e8b86 req-a3287618-6b68-4455-9493-2a70b29d7af1 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:00.049027 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-22e0ba0a-2af7-497e-8759-3b09622e8b86 req-a3287618-6b68-4455-9493-2a70b29d7af1 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:00.049511 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-22e0ba0a-2af7-497e-8759-3b09622e8b86 req-a3287618-6b68-4455-9493-2a70b29d7af1 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:00.060708 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-22e0ba0a-2af7-497e-8759-3b09622e8b86 req-a3287618-6b68-4455-9493-2a70b29d7af1 service nova] Creating event network-vif-plugged:84784522-0492-4dfd-a391-e2cd2949e644 for instance 21d02f4d-602e-4b71-838b-b6155b8eb4e0 on n-h2-853682-5 Oct 18 16:56:00.066081 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-22e0ba0a-2af7-497e-8759-3b09622e8b86 req-a3287618-6b68-4455-9493-2a70b29d7af1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101618 Oct 18 16:56:00.066690 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3852/7684] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:56:00.747215 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c8aa8b98-330a-470c-9cb9-ff15f4a00be6 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:56:00.747843 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c8aa8b98-330a-470c-9cb9-ff15f4a00be6 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:56:00.754684 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8aa8b98-330a-470c-9cb9-ff15f4a00be6 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:00.755176 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8aa8b98-330a-470c-9cb9-ff15f4a00be6 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:00.755615 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8aa8b98-330a-470c-9cb9-ff15f4a00be6 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:00.756314 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8aa8b98-330a-470c-9cb9-ff15f4a00be6 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:00.756775 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8aa8b98-330a-470c-9cb9-ff15f4a00be6 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:00.757240 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8aa8b98-330a-470c-9cb9-ff15f4a00be6 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:00.892572 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c8aa8b98-330a-470c-9cb9-ff15f4a00be6 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:56:00.901884 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c8aa8b98-330a-470c-9cb9-ff15f4a00be6 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0" status: 200 len: 1370 microversion: 2.1 time: 0.158329 Oct 18 16:56:00.902633 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3833/7685] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:56:00 2022] GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0 => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:56:01.927494 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-af011491-910c-49a0-b7af-def3183c8c44 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:56:01.928215 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-af011491-910c-49a0-b7af-def3183c8c44 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:56:01.934468 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-af011491-910c-49a0-b7af-def3183c8c44 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:01.934966 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-af011491-910c-49a0-b7af-def3183c8c44 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:01.935430 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-af011491-910c-49a0-b7af-def3183c8c44 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:01.936134 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-af011491-910c-49a0-b7af-def3183c8c44 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:01.936607 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-af011491-910c-49a0-b7af-def3183c8c44 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:01.937075 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-af011491-910c-49a0-b7af-def3183c8c44 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:02.071442 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-af011491-910c-49a0-b7af-def3183c8c44 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:56:02.079406 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-af011491-910c-49a0-b7af-def3183c8c44 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0" status: 200 len: 1555 microversion: 2.1 time: 0.157222 Oct 18 16:56:02.079993 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3853/7686] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:56:01 2022] GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0 => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:56:02.105064 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b99a9c1c-cdb9-4189-906d-fe846fc15349 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:56:02.105682 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b99a9c1c-cdb9-4189-906d-fe846fc15349 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:56:02.112532 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b99a9c1c-cdb9-4189-906d-fe846fc15349 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:02.113050 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b99a9c1c-cdb9-4189-906d-fe846fc15349 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:02.113514 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b99a9c1c-cdb9-4189-906d-fe846fc15349 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:02.114200 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b99a9c1c-cdb9-4189-906d-fe846fc15349 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:02.114657 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b99a9c1c-cdb9-4189-906d-fe846fc15349 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:02.115076 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b99a9c1c-cdb9-4189-906d-fe846fc15349 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:02.248445 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b99a9c1c-cdb9-4189-906d-fe846fc15349 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:56:02.256895 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b99a9c1c-cdb9-4189-906d-fe846fc15349 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0" status: 200 len: 1555 microversion: 2.1 time: 0.155817 Oct 18 16:56:02.257515 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3834/7687] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:56:02 2022] GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0 => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:56:04.258222 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-310a67d8-8eca-4223-ae8c-0682ec76f87e req-14340015-d8a2-4baf-a5b5-b6d238543326 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21d02f4d-602e-4b71-838b-b6155b8eb4e0", "tag": "84784522-0492-4dfd-a391-e2cd2949e644"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:56:04.263914 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=6 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:56:04.270373 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-310a67d8-8eca-4223-ae8c-0682ec76f87e req-14340015-d8a2-4baf-a5b5-b6d238543326 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:56:04.270864 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-310a67d8-8eca-4223-ae8c-0682ec76f87e req-14340015-d8a2-4baf-a5b5-b6d238543326 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:56:04.271506 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-310a67d8-8eca-4223-ae8c-0682ec76f87e req-14340015-d8a2-4baf-a5b5-b6d238543326 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:56:04.283289 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-310a67d8-8eca-4223-ae8c-0682ec76f87e req-14340015-d8a2-4baf-a5b5-b6d238543326 service nova] Creating event network-changed:84784522-0492-4dfd-a391-e2cd2949e644 for instance 21d02f4d-602e-4b71-838b-b6155b8eb4e0 on n-h2-853682-5 Oct 18 16:56:04.289397 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-310a67d8-8eca-4223-ae8c-0682ec76f87e req-14340015-d8a2-4baf-a5b5-b6d238543326 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035471 Oct 18 16:56:04.290017 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3854/7688] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:57:59.295751 n-d-853682-5 devstack@n-api.service[120406]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9784c765-18ae-4d28-9be4-c2f2473b54eb] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 18 16:57:59.296736 n-d-853682-5 devstack@n-api.service[120406]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6eb481dc-0a5f-4095-8691-72ce090f1ba0] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 18 16:57:59.297168 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:57:59.297931 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:57:59.298666 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:57:59.299394 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=34 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:57:59.304726 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6910b655-188e-4d00-9770-3d237475c429 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:57:59.305326 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6910b655-188e-4d00-9770-3d237475c429 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:57:59.314088 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6910b655-188e-4d00-9770-3d237475c429 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:57:59.314583 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6910b655-188e-4d00-9770-3d237475c429 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:57:59.315024 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6910b655-188e-4d00-9770-3d237475c429 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:57:59.315727 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6910b655-188e-4d00-9770-3d237475c429 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:57:59.316188 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6910b655-188e-4d00-9770-3d237475c429 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:57:59.316618 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6910b655-188e-4d00-9770-3d237475c429 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:57:59.344033 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-6910b655-188e-4d00-9770-3d237475c429 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lazy-loading 'flavor' on Instance uuid 21d02f4d-602e-4b71-838b-b6155b8eb4e0 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 16:57:59.536125 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6910b655-188e-4d00-9770-3d237475c429 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "POST /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0/action" status: 202 len: 0 microversion: 2.1 time: 0.242309 Oct 18 16:57:59.536822 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3835/7689] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:57:59 2022] POST /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:57:59.543875 n-d-853682-5 devstack@n-api.service[120405]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6b6d975c-54e4-4acd-8cc5-5b0cda3c3106] AMQP server on 10.222.0.60:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 18 16:57:59.544849 n-d-853682-5 devstack@n-api.service[120405]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c870dd72-6039-47fe-83e0-90856ded1829] AMQP server on 10.222.0.60:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 18 16:57:59.545447 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:57:59.546470 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=28 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:57:59.547054 n-d-853682-5 devstack@n-api.service[120405]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 16:57:59.547262 n-d-853682-5 devstack@n-api.service[120405]: Tue Oct 18 16:57:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0 (ip 10.222.0.60) !!! Oct 18 16:57:59.553747 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-07c0fc50-5b71-4506-b2d0-3e4a3e896551 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:57:59.554477 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-07c0fc50-5b71-4506-b2d0-3e4a3e896551 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:57:59.563304 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-07c0fc50-5b71-4506-b2d0-3e4a3e896551 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:57:59.563852 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-07c0fc50-5b71-4506-b2d0-3e4a3e896551 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:57:59.564318 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-07c0fc50-5b71-4506-b2d0-3e4a3e896551 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:57:59.565068 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-07c0fc50-5b71-4506-b2d0-3e4a3e896551 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:57:59.565547 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-07c0fc50-5b71-4506-b2d0-3e4a3e896551 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:57:59.565993 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-07c0fc50-5b71-4506-b2d0-3e4a3e896551 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:57:59.704685 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-07c0fc50-5b71-4506-b2d0-3e4a3e896551 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:57:59.712617 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-07c0fc50-5b71-4506-b2d0-3e4a3e896551 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0" status: 200 len: 1680 microversion: 2.1 time: 0.170886 Oct 18 16:57:59.713263 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3855/7690] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:57:59 2022] GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0 => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:58:00.737410 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8df31bbc-73f5-4b11-ad0d-3a88f4934db2 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:58:00.738227 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8df31bbc-73f5-4b11-ad0d-3a88f4934db2 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:58:00.747362 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8df31bbc-73f5-4b11-ad0d-3a88f4934db2 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:00.747931 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8df31bbc-73f5-4b11-ad0d-3a88f4934db2 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:00.748374 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8df31bbc-73f5-4b11-ad0d-3a88f4934db2 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:00.749103 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8df31bbc-73f5-4b11-ad0d-3a88f4934db2 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:00.749559 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8df31bbc-73f5-4b11-ad0d-3a88f4934db2 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:00.749983 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8df31bbc-73f5-4b11-ad0d-3a88f4934db2 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:00.757987 n-d-853682-5 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [-] [6eb481dc-0a5f-4095-8691-72ce090f1ba0] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 42774. Oct 18 16:58:00.768973 n-d-853682-5 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [-] [9784c765-18ae-4d28-9be4-c2f2473b54eb] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 42772. Oct 18 16:58:00.893594 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8df31bbc-73f5-4b11-ad0d-3a88f4934db2 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:58:00.901991 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8df31bbc-73f5-4b11-ad0d-3a88f4934db2 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0" status: 200 len: 1680 microversion: 2.1 time: 0.170071 Oct 18 16:58:00.902576 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3836/7691] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:58:00 2022] GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0 => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:58:01.926203 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-88677bc6-6fd9-41ea-8b9f-d160d8eeac8a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:58:01.926853 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-88677bc6-6fd9-41ea-8b9f-d160d8eeac8a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:58:01.940236 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-88677bc6-6fd9-41ea-8b9f-d160d8eeac8a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:01.940902 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-88677bc6-6fd9-41ea-8b9f-d160d8eeac8a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:01.941473 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-88677bc6-6fd9-41ea-8b9f-d160d8eeac8a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:01.942353 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-88677bc6-6fd9-41ea-8b9f-d160d8eeac8a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:01.942932 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-88677bc6-6fd9-41ea-8b9f-d160d8eeac8a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:01.943479 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-88677bc6-6fd9-41ea-8b9f-d160d8eeac8a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:01.949716 n-d-853682-5 devstack@n-api.service[120405]: INFO oslo.messaging._drivers.impl_rabbit [-] [c870dd72-6039-47fe-83e0-90856ded1829] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 42780. Oct 18 16:58:01.952143 n-d-853682-5 devstack@n-api.service[120405]: INFO oslo.messaging._drivers.impl_rabbit [-] [6b6d975c-54e4-4acd-8cc5-5b0cda3c3106] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 42778. Oct 18 16:58:02.081456 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-88677bc6-6fd9-41ea-8b9f-d160d8eeac8a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:58:02.089904 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-88677bc6-6fd9-41ea-8b9f-d160d8eeac8a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0" status: 200 len: 1680 microversion: 2.1 time: 0.167659 Oct 18 16:58:02.090482 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3856/7692] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:58:01 2022] GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0 => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:58:03.114214 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ba97a35e-3cb6-4a85-845d-e005b6afa05d tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:58:03.114774 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ba97a35e-3cb6-4a85-845d-e005b6afa05d tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:58:03.122344 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba97a35e-3cb6-4a85-845d-e005b6afa05d tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:03.122832 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba97a35e-3cb6-4a85-845d-e005b6afa05d tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:03.123273 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba97a35e-3cb6-4a85-845d-e005b6afa05d tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:03.123973 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba97a35e-3cb6-4a85-845d-e005b6afa05d tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:03.124433 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba97a35e-3cb6-4a85-845d-e005b6afa05d tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:03.124891 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba97a35e-3cb6-4a85-845d-e005b6afa05d tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:03.256238 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ba97a35e-3cb6-4a85-845d-e005b6afa05d tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:58:03.264143 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ba97a35e-3cb6-4a85-845d-e005b6afa05d tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0" status: 200 len: 1680 microversion: 2.1 time: 0.154027 Oct 18 16:58:03.264723 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3837/7693] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:58:03 2022] GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:58:04.287807 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-159de284-4209-4535-95d9-4ac58ee3db78 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:58:04.288421 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-159de284-4209-4535-95d9-4ac58ee3db78 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:58:04.295846 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-159de284-4209-4535-95d9-4ac58ee3db78 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:04.296338 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-159de284-4209-4535-95d9-4ac58ee3db78 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:04.296787 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-159de284-4209-4535-95d9-4ac58ee3db78 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:04.297541 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-159de284-4209-4535-95d9-4ac58ee3db78 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:04.298008 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-159de284-4209-4535-95d9-4ac58ee3db78 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:04.298445 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-159de284-4209-4535-95d9-4ac58ee3db78 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:04.432282 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-159de284-4209-4535-95d9-4ac58ee3db78 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:58:04.440442 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-159de284-4209-4535-95d9-4ac58ee3db78 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0" status: 200 len: 1680 microversion: 2.1 time: 0.156612 Oct 18 16:58:04.441051 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3857/7694] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:58:04 2022] GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:58:05.464276 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-589f9e48-6a60-48bf-bf54-ab43eed6cee6 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:58:05.464884 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-589f9e48-6a60-48bf-bf54-ab43eed6cee6 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:58:05.471641 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-589f9e48-6a60-48bf-bf54-ab43eed6cee6 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:05.472130 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-589f9e48-6a60-48bf-bf54-ab43eed6cee6 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:05.472569 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-589f9e48-6a60-48bf-bf54-ab43eed6cee6 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:05.473296 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-589f9e48-6a60-48bf-bf54-ab43eed6cee6 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:05.473757 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-589f9e48-6a60-48bf-bf54-ab43eed6cee6 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:05.474186 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-589f9e48-6a60-48bf-bf54-ab43eed6cee6 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:05.608711 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-589f9e48-6a60-48bf-bf54-ab43eed6cee6 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:58:05.616680 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-589f9e48-6a60-48bf-bf54-ab43eed6cee6 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0" status: 200 len: 1680 microversion: 2.1 time: 0.156760 Oct 18 16:58:05.617309 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3838/7695] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:58:05 2022] GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:58:06.640991 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-627d2dba-f9dd-46af-b98f-590d5fe972fc tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:58:06.641616 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-627d2dba-f9dd-46af-b98f-590d5fe972fc tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:58:06.648440 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-627d2dba-f9dd-46af-b98f-590d5fe972fc tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:06.648967 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-627d2dba-f9dd-46af-b98f-590d5fe972fc tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:06.649410 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-627d2dba-f9dd-46af-b98f-590d5fe972fc tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:06.650111 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-627d2dba-f9dd-46af-b98f-590d5fe972fc tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:06.650577 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-627d2dba-f9dd-46af-b98f-590d5fe972fc tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:06.651014 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-627d2dba-f9dd-46af-b98f-590d5fe972fc tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:06.787537 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-627d2dba-f9dd-46af-b98f-590d5fe972fc tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:58:06.796032 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-627d2dba-f9dd-46af-b98f-590d5fe972fc tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0" status: 200 len: 1680 microversion: 2.1 time: 0.158980 Oct 18 16:58:06.796614 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3858/7696] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:58:06 2022] GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:58:07.819302 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9db115ba-78ae-4e2c-8b65-5fef1f7a1e85 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:58:07.819947 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9db115ba-78ae-4e2c-8b65-5fef1f7a1e85 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:58:07.826889 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9db115ba-78ae-4e2c-8b65-5fef1f7a1e85 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:07.827375 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9db115ba-78ae-4e2c-8b65-5fef1f7a1e85 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:07.827814 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9db115ba-78ae-4e2c-8b65-5fef1f7a1e85 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:07.828510 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9db115ba-78ae-4e2c-8b65-5fef1f7a1e85 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:07.829004 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9db115ba-78ae-4e2c-8b65-5fef1f7a1e85 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:07.829434 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9db115ba-78ae-4e2c-8b65-5fef1f7a1e85 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:07.958532 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9db115ba-78ae-4e2c-8b65-5fef1f7a1e85 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:58:07.967252 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9db115ba-78ae-4e2c-8b65-5fef1f7a1e85 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0" status: 200 len: 1680 microversion: 2.1 time: 0.151953 Oct 18 16:58:07.967837 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3839/7697] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:58:07 2022] GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:58:08.991253 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-10245a08-94c1-4d83-8bca-0a5cc4377acf tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:58:08.991813 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-10245a08-94c1-4d83-8bca-0a5cc4377acf tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:58:08.999344 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-10245a08-94c1-4d83-8bca-0a5cc4377acf tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:08.999843 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-10245a08-94c1-4d83-8bca-0a5cc4377acf tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:09.000296 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-10245a08-94c1-4d83-8bca-0a5cc4377acf tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:09.001045 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-10245a08-94c1-4d83-8bca-0a5cc4377acf tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:09.001518 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-10245a08-94c1-4d83-8bca-0a5cc4377acf tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:09.001961 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-10245a08-94c1-4d83-8bca-0a5cc4377acf tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:09.136255 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-10245a08-94c1-4d83-8bca-0a5cc4377acf tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:58:09.144381 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-10245a08-94c1-4d83-8bca-0a5cc4377acf tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0" status: 200 len: 1680 microversion: 2.1 time: 0.157118 Oct 18 16:58:09.144972 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3859/7698] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:58:08 2022] GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:58:10.168164 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-095eb153-a879-4413-b2b9-5a97f3cffa1a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:58:10.168816 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-095eb153-a879-4413-b2b9-5a97f3cffa1a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:58:10.175741 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-095eb153-a879-4413-b2b9-5a97f3cffa1a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:10.176227 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-095eb153-a879-4413-b2b9-5a97f3cffa1a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:10.176659 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-095eb153-a879-4413-b2b9-5a97f3cffa1a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:10.177371 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-095eb153-a879-4413-b2b9-5a97f3cffa1a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:10.177827 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-095eb153-a879-4413-b2b9-5a97f3cffa1a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:10.178252 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-095eb153-a879-4413-b2b9-5a97f3cffa1a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:10.313939 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-095eb153-a879-4413-b2b9-5a97f3cffa1a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:58:10.321702 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-095eb153-a879-4413-b2b9-5a97f3cffa1a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0" status: 200 len: 1701 microversion: 2.1 time: 0.158095 Oct 18 16:58:10.322296 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3840/7699] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:58:10 2022] GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0 => generated 1701 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:58:11.345885 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a6b4c4ef-3f6d-459a-b0f5-00231d9af34a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:58:11.346543 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a6b4c4ef-3f6d-459a-b0f5-00231d9af34a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:58:11.353556 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a6b4c4ef-3f6d-459a-b0f5-00231d9af34a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:11.354053 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a6b4c4ef-3f6d-459a-b0f5-00231d9af34a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:11.354506 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a6b4c4ef-3f6d-459a-b0f5-00231d9af34a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:11.355730 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a6b4c4ef-3f6d-459a-b0f5-00231d9af34a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:11.356193 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a6b4c4ef-3f6d-459a-b0f5-00231d9af34a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:11.356637 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a6b4c4ef-3f6d-459a-b0f5-00231d9af34a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:11.488354 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a6b4c4ef-3f6d-459a-b0f5-00231d9af34a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:58:11.496853 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a6b4c4ef-3f6d-459a-b0f5-00231d9af34a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0" status: 200 len: 1701 microversion: 2.1 time: 0.154284 Oct 18 16:58:11.497434 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3860/7700] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:58:11 2022] GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0 => generated 1701 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:58:12.520673 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fbadb933-9294-4585-87c6-e0305aff6010 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:58:12.522098 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fbadb933-9294-4585-87c6-e0305aff6010 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:58:12.530561 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbadb933-9294-4585-87c6-e0305aff6010 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:12.531453 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbadb933-9294-4585-87c6-e0305aff6010 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:12.532651 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbadb933-9294-4585-87c6-e0305aff6010 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:12.533865 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbadb933-9294-4585-87c6-e0305aff6010 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:12.534606 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbadb933-9294-4585-87c6-e0305aff6010 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:12.535370 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbadb933-9294-4585-87c6-e0305aff6010 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:12.666064 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-1efb2190-0e65-4057-af19-4a50f5f3f030 req-571d346d-ea7e-4ee0-86bb-f02f00951618 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21d02f4d-602e-4b71-838b-b6155b8eb4e0", "name": "network-vif-plugged", "status": "completed", "tag": "84784522-0492-4dfd-a391-e2cd2949e644"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:58:12.680061 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-1efb2190-0e65-4057-af19-4a50f5f3f030 req-571d346d-ea7e-4ee0-86bb-f02f00951618 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:12.680751 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-1efb2190-0e65-4057-af19-4a50f5f3f030 req-571d346d-ea7e-4ee0-86bb-f02f00951618 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:12.681577 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-1efb2190-0e65-4057-af19-4a50f5f3f030 req-571d346d-ea7e-4ee0-86bb-f02f00951618 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:12.698229 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-1efb2190-0e65-4057-af19-4a50f5f3f030 req-571d346d-ea7e-4ee0-86bb-f02f00951618 service nova] Creating event network-vif-plugged:84784522-0492-4dfd-a391-e2cd2949e644 for instance 21d02f4d-602e-4b71-838b-b6155b8eb4e0 on n-h2-853682-5 Oct 18 16:58:12.703390 n-d-853682-5 devstack@n-api.service[120405]: ERROR oslo.messaging._drivers.impl_rabbit [req-1efb2190-0e65-4057-af19-4a50f5f3f030 req-571d346d-ea7e-4ee0-86bb-f02f00951618 service nova] [20dc83bd-d030-42b2-b472-0c6791b326c4] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 16:58:12.718538 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fbadb933-9294-4585-87c6-e0305aff6010 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:58:12.727040 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fbadb933-9294-4585-87c6-e0305aff6010 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0" status: 200 len: 1696 microversion: 2.1 time: 0.210715 Oct 18 16:58:12.741836 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3841/7701] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:58:12 2022] GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0 => generated 1696 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:58:13.713658 n-d-853682-5 devstack@n-api.service[120405]: INFO oslo.messaging._drivers.impl_rabbit [req-1efb2190-0e65-4057-af19-4a50f5f3f030 req-571d346d-ea7e-4ee0-86bb-f02f00951618 service nova] [20dc83bd-d030-42b2-b472-0c6791b326c4] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 42830. Oct 18 16:58:13.718701 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-1efb2190-0e65-4057-af19-4a50f5f3f030 req-571d346d-ea7e-4ee0-86bb-f02f00951618 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.056631 Oct 18 16:58:13.719661 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3861/7702] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:58:13.753864 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-089f861b-f2f0-4fa2-af8f-20c9592362ec tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:58:13.754720 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-089f861b-f2f0-4fa2-af8f-20c9592362ec tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:58:13.762291 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-089f861b-f2f0-4fa2-af8f-20c9592362ec tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:13.762963 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-089f861b-f2f0-4fa2-af8f-20c9592362ec tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:13.763658 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-089f861b-f2f0-4fa2-af8f-20c9592362ec tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:13.764645 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-089f861b-f2f0-4fa2-af8f-20c9592362ec tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:13.765211 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-089f861b-f2f0-4fa2-af8f-20c9592362ec tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:13.765646 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-089f861b-f2f0-4fa2-af8f-20c9592362ec tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:13.927520 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-089f861b-f2f0-4fa2-af8f-20c9592362ec tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:58:13.937039 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-089f861b-f2f0-4fa2-af8f-20c9592362ec tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0" status: 200 len: 1696 microversion: 2.1 time: 0.187676 Oct 18 16:58:13.952920 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3842/7703] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:58:13 2022] GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0 => generated 1696 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:58:14.965014 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f68eb07c-6239-4f90-9cbf-055236aa10a1 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:58:14.966103 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f68eb07c-6239-4f90-9cbf-055236aa10a1 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:58:14.973217 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f68eb07c-6239-4f90-9cbf-055236aa10a1 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:14.973718 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f68eb07c-6239-4f90-9cbf-055236aa10a1 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:14.974163 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f68eb07c-6239-4f90-9cbf-055236aa10a1 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:14.974878 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f68eb07c-6239-4f90-9cbf-055236aa10a1 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:14.975345 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f68eb07c-6239-4f90-9cbf-055236aa10a1 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:14.975778 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f68eb07c-6239-4f90-9cbf-055236aa10a1 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:15.134773 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f68eb07c-6239-4f90-9cbf-055236aa10a1 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:58:15.143465 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f68eb07c-6239-4f90-9cbf-055236aa10a1 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0" status: 200 len: 1696 microversion: 2.1 time: 0.185716 Oct 18 16:58:15.144086 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3862/7704] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:58:14 2022] GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0 => generated 1696 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:58:16.169913 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b47e8328-7f92-41c4-908e-fde08c6b7cae tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:58:16.171197 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b47e8328-7f92-41c4-908e-fde08c6b7cae tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:58:16.178337 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b47e8328-7f92-41c4-908e-fde08c6b7cae tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:16.179077 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b47e8328-7f92-41c4-908e-fde08c6b7cae tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:16.179513 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b47e8328-7f92-41c4-908e-fde08c6b7cae tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:16.180412 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b47e8328-7f92-41c4-908e-fde08c6b7cae tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:16.180897 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b47e8328-7f92-41c4-908e-fde08c6b7cae tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:16.181645 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b47e8328-7f92-41c4-908e-fde08c6b7cae tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:16.336430 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b47e8328-7f92-41c4-908e-fde08c6b7cae tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:58:16.349320 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b47e8328-7f92-41c4-908e-fde08c6b7cae tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0" status: 200 len: 1696 microversion: 2.1 time: 0.182375 Oct 18 16:58:16.350363 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3843/7705] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:58:16 2022] GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0 => generated 1696 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:58:17.377474 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5d185bed-6dcd-47cd-8b16-6b0b2a8881c7 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:58:17.378282 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5d185bed-6dcd-47cd-8b16-6b0b2a8881c7 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:58:17.386007 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5d185bed-6dcd-47cd-8b16-6b0b2a8881c7 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:17.386544 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5d185bed-6dcd-47cd-8b16-6b0b2a8881c7 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:17.387003 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5d185bed-6dcd-47cd-8b16-6b0b2a8881c7 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:17.387725 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5d185bed-6dcd-47cd-8b16-6b0b2a8881c7 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:17.388196 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5d185bed-6dcd-47cd-8b16-6b0b2a8881c7 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:17.388637 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5d185bed-6dcd-47cd-8b16-6b0b2a8881c7 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:17.533964 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5d185bed-6dcd-47cd-8b16-6b0b2a8881c7 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:58:17.542360 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5d185bed-6dcd-47cd-8b16-6b0b2a8881c7 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0" status: 200 len: 1696 microversion: 2.1 time: 0.173092 Oct 18 16:58:17.543812 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3863/7706] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:58:17 2022] GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0 => generated 1696 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:58:18.566941 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c1000158-9316-47e6-9c0b-fd5693a1bb83 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:58:18.567704 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c1000158-9316-47e6-9c0b-fd5693a1bb83 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:58:18.581464 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1000158-9316-47e6-9c0b-fd5693a1bb83 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:18.581958 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1000158-9316-47e6-9c0b-fd5693a1bb83 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:18.582424 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1000158-9316-47e6-9c0b-fd5693a1bb83 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:18.583104 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1000158-9316-47e6-9c0b-fd5693a1bb83 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:18.583560 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1000158-9316-47e6-9c0b-fd5693a1bb83 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:18.583984 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1000158-9316-47e6-9c0b-fd5693a1bb83 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:18.755732 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c1000158-9316-47e6-9c0b-fd5693a1bb83 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:58:18.763919 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c1000158-9316-47e6-9c0b-fd5693a1bb83 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0" status: 200 len: 1696 microversion: 2.1 time: 0.200886 Oct 18 16:58:18.764510 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3844/7707] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:58:18 2022] GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0 => generated 1696 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:58:19.789765 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-dfd77ace-d308-45e3-9583-c2f25b0ef75e tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:58:19.790451 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-dfd77ace-d308-45e3-9583-c2f25b0ef75e tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:58:19.798211 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dfd77ace-d308-45e3-9583-c2f25b0ef75e tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:19.798714 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dfd77ace-d308-45e3-9583-c2f25b0ef75e tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:19.799167 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dfd77ace-d308-45e3-9583-c2f25b0ef75e tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:19.799889 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dfd77ace-d308-45e3-9583-c2f25b0ef75e tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:19.800358 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dfd77ace-d308-45e3-9583-c2f25b0ef75e tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:19.800834 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dfd77ace-d308-45e3-9583-c2f25b0ef75e tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:19.951869 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-dfd77ace-d308-45e3-9583-c2f25b0ef75e tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:58:19.960662 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-dfd77ace-d308-45e3-9583-c2f25b0ef75e tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0" status: 200 len: 1696 microversion: 2.1 time: 0.175194 Oct 18 16:58:19.961311 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3864/7708] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:58:19 2022] GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0 => generated 1696 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:58:20.986706 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-aafcdc85-2116-4d50-aee8-7e888fea8c61 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:58:20.987859 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-aafcdc85-2116-4d50-aee8-7e888fea8c61 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:58:20.995035 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aafcdc85-2116-4d50-aee8-7e888fea8c61 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:20.996144 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aafcdc85-2116-4d50-aee8-7e888fea8c61 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:20.996593 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aafcdc85-2116-4d50-aee8-7e888fea8c61 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:20.997533 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aafcdc85-2116-4d50-aee8-7e888fea8c61 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:20.998005 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aafcdc85-2116-4d50-aee8-7e888fea8c61 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:20.998442 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aafcdc85-2116-4d50-aee8-7e888fea8c61 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:21.147932 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-aafcdc85-2116-4d50-aee8-7e888fea8c61 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:58:21.156621 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-aafcdc85-2116-4d50-aee8-7e888fea8c61 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0" status: 200 len: 1696 microversion: 2.1 time: 0.174057 Oct 18 16:58:21.157501 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3845/7709] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:58:20 2022] GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0 => generated 1696 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:58:22.180798 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3db751ac-3ad9-4fea-80a0-c0384c9ddd26 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:58:22.181462 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3db751ac-3ad9-4fea-80a0-c0384c9ddd26 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:58:22.188465 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3db751ac-3ad9-4fea-80a0-c0384c9ddd26 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:22.189002 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3db751ac-3ad9-4fea-80a0-c0384c9ddd26 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:22.189463 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3db751ac-3ad9-4fea-80a0-c0384c9ddd26 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:22.190197 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3db751ac-3ad9-4fea-80a0-c0384c9ddd26 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:22.190646 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3db751ac-3ad9-4fea-80a0-c0384c9ddd26 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:22.191091 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3db751ac-3ad9-4fea-80a0-c0384c9ddd26 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:22.326100 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3db751ac-3ad9-4fea-80a0-c0384c9ddd26 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:58:22.334058 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3db751ac-3ad9-4fea-80a0-c0384c9ddd26 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0" status: 200 len: 1678 microversion: 2.1 time: 0.157113 Oct 18 16:58:22.334642 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3865/7710] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:58:22 2022] GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:58:22.803759 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-9ae31d62-3c2d-4da4-9fec-445183fc790e req-03d48652-d041-4874-9b35-44a6a6026ece service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21d02f4d-602e-4b71-838b-b6155b8eb4e0", "name": "network-vif-unplugged", "status": "completed", "tag": "84784522-0492-4dfd-a391-e2cd2949e644"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:58:22.815578 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9ae31d62-3c2d-4da4-9fec-445183fc790e req-03d48652-d041-4874-9b35-44a6a6026ece service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:22.816068 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9ae31d62-3c2d-4da4-9fec-445183fc790e req-03d48652-d041-4874-9b35-44a6a6026ece service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:22.816508 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9ae31d62-3c2d-4da4-9fec-445183fc790e req-03d48652-d041-4874-9b35-44a6a6026ece service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:22.827915 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-9ae31d62-3c2d-4da4-9fec-445183fc790e req-03d48652-d041-4874-9b35-44a6a6026ece service nova] Creating event network-vif-unplugged:84784522-0492-4dfd-a391-e2cd2949e644 for instance 21d02f4d-602e-4b71-838b-b6155b8eb4e0 on n-h2-853682-5 Oct 18 16:58:22.833603 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-9ae31d62-3c2d-4da4-9fec-445183fc790e req-03d48652-d041-4874-9b35-44a6a6026ece service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033979 Oct 18 16:58:22.834296 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3846/7711] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:58:23.358227 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a60f3998-3329-41d7-a2b9-9b67c56378e9 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:58:23.358874 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a60f3998-3329-41d7-a2b9-9b67c56378e9 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:58:23.365855 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a60f3998-3329-41d7-a2b9-9b67c56378e9 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:23.366356 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a60f3998-3329-41d7-a2b9-9b67c56378e9 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:23.366819 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a60f3998-3329-41d7-a2b9-9b67c56378e9 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:23.367534 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a60f3998-3329-41d7-a2b9-9b67c56378e9 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:23.368011 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a60f3998-3329-41d7-a2b9-9b67c56378e9 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:23.368460 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a60f3998-3329-41d7-a2b9-9b67c56378e9 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:23.502443 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a60f3998-3329-41d7-a2b9-9b67c56378e9 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:58:23.510204 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a60f3998-3329-41d7-a2b9-9b67c56378e9 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0" status: 200 len: 1678 microversion: 2.1 time: 0.156420 Oct 18 16:58:23.510800 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3866/7712] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:58:23 2022] GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:58:24.534232 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d4c118c4-8d65-4892-bf15-380f0e205eb2 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:58:24.534932 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d4c118c4-8d65-4892-bf15-380f0e205eb2 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:58:24.542650 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d4c118c4-8d65-4892-bf15-380f0e205eb2 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:24.543146 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d4c118c4-8d65-4892-bf15-380f0e205eb2 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:24.543589 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d4c118c4-8d65-4892-bf15-380f0e205eb2 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:24.544301 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d4c118c4-8d65-4892-bf15-380f0e205eb2 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:24.544766 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d4c118c4-8d65-4892-bf15-380f0e205eb2 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:24.545226 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d4c118c4-8d65-4892-bf15-380f0e205eb2 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:24.689293 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d4c118c4-8d65-4892-bf15-380f0e205eb2 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:58:24.697686 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d4c118c4-8d65-4892-bf15-380f0e205eb2 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0" status: 200 len: 1681 microversion: 2.1 time: 0.167974 Oct 18 16:58:24.698287 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3847/7713] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:58:24 2022] GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0 => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:58:24.721112 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-7f987690-2a7c-450e-a4d4-00f3cbb38ad7 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:58:24.721767 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7f987690-2a7c-450e-a4d4-00f3cbb38ad7 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:58:24.728758 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7f987690-2a7c-450e-a4d4-00f3cbb38ad7 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:24.729293 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7f987690-2a7c-450e-a4d4-00f3cbb38ad7 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:24.729767 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7f987690-2a7c-450e-a4d4-00f3cbb38ad7 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:24.730458 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7f987690-2a7c-450e-a4d4-00f3cbb38ad7 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:24.730933 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7f987690-2a7c-450e-a4d4-00f3cbb38ad7 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:24.731376 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-7f987690-2a7c-450e-a4d4-00f3cbb38ad7 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:24.820396 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-7f987690-2a7c-450e-a4d4-00f3cbb38ad7 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120405) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 18 16:58:24.880149 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-3ece3a14-b386-4dac-8b34-b0327559efe2 req-3a4e7a34-e374-4c11-a146-6a7810b4c810 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21d02f4d-602e-4b71-838b-b6155b8eb4e0", "tag": "84784522-0492-4dfd-a391-e2cd2949e644"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:58:24.890211 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3ece3a14-b386-4dac-8b34-b0327559efe2 req-3a4e7a34-e374-4c11-a146-6a7810b4c810 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:24.890630 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3ece3a14-b386-4dac-8b34-b0327559efe2 req-3a4e7a34-e374-4c11-a146-6a7810b4c810 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:24.891072 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3ece3a14-b386-4dac-8b34-b0327559efe2 req-3a4e7a34-e374-4c11-a146-6a7810b4c810 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:24.895479 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-7f987690-2a7c-450e-a4d4-00f3cbb38ad7 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "POST /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0/action" status: 202 len: 0 microversion: 2.1 time: 0.178318 Oct 18 16:58:24.896123 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3867/7714] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 16:58:24 2022] POST /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 16:58:24.903054 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.compute.server_external_events [req-3ece3a14-b386-4dac-8b34-b0327559efe2 req-3a4e7a34-e374-4c11-a146-6a7810b4c810 service nova] Unable to find a host for instance 21d02f4d-602e-4b71-838b-b6155b8eb4e0. Dropping event network-changed {{(pid=120406) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 18 16:58:24.903960 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-3ece3a14-b386-4dac-8b34-b0327559efe2 req-3a4e7a34-e374-4c11-a146-6a7810b4c810 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 207 len: 176 microversion: 2.1 time: 0.027994 Oct 18 16:58:24.904562 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3848/7715] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 176 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 18 16:58:24.904726 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3a47b147-50d2-4ecd-9f19-63c92c3ce79d tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:58:24.905779 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3a47b147-50d2-4ecd-9f19-63c92c3ce79d tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:58:24.911684 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3a47b147-50d2-4ecd-9f19-63c92c3ce79d tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:24.912087 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3a47b147-50d2-4ecd-9f19-63c92c3ce79d tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:24.912540 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3a47b147-50d2-4ecd-9f19-63c92c3ce79d tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:24.913373 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3a47b147-50d2-4ecd-9f19-63c92c3ce79d tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:24.913853 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3a47b147-50d2-4ecd-9f19-63c92c3ce79d tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:24.914479 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3a47b147-50d2-4ecd-9f19-63c92c3ce79d tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:25.054172 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3a47b147-50d2-4ecd-9f19-63c92c3ce79d tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:58:25.062748 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3a47b147-50d2-4ecd-9f19-63c92c3ce79d tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0" status: 200 len: 1629 microversion: 2.1 time: 0.162109 Oct 18 16:58:25.063359 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3868/7716] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:58:24 2022] GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0 => generated 1629 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:58:26.086655 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-46831cbb-720b-46a0-918b-c935047c3475 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:58:26.087268 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-46831cbb-720b-46a0-918b-c935047c3475 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:58:26.094591 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-46831cbb-720b-46a0-918b-c935047c3475 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:26.095068 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-46831cbb-720b-46a0-918b-c935047c3475 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:26.095505 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-46831cbb-720b-46a0-918b-c935047c3475 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:26.096190 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-46831cbb-720b-46a0-918b-c935047c3475 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:26.096642 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-46831cbb-720b-46a0-918b-c935047c3475 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:26.097099 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-46831cbb-720b-46a0-918b-c935047c3475 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:26.229015 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-46831cbb-720b-46a0-918b-c935047c3475 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:58:26.237811 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-46831cbb-720b-46a0-918b-c935047c3475 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0" status: 200 len: 1687 microversion: 2.1 time: 0.154990 Oct 18 16:58:26.240191 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3849/7717] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:58:26 2022] GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0 => generated 1687 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:58:27.262547 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-b30ce76e-ef5b-484e-b932-73e92a7dd7d9 req-b0b5429a-cf92-4f3b-9664-b180be80b05c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21d02f4d-602e-4b71-838b-b6155b8eb4e0", "tag": "84784522-0492-4dfd-a391-e2cd2949e644"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:58:27.269778 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a0b37abb-3a6e-4cc4-8ecf-8d444bf71ad6 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:58:27.270395 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a0b37abb-3a6e-4cc4-8ecf-8d444bf71ad6 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:58:27.282318 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0b37abb-3a6e-4cc4-8ecf-8d444bf71ad6 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:27.283550 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0b37abb-3a6e-4cc4-8ecf-8d444bf71ad6 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:27.284006 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0b37abb-3a6e-4cc4-8ecf-8d444bf71ad6 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:27.284732 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0b37abb-3a6e-4cc4-8ecf-8d444bf71ad6 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:27.285447 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0b37abb-3a6e-4cc4-8ecf-8d444bf71ad6 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:27.285885 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0b37abb-3a6e-4cc4-8ecf-8d444bf71ad6 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:27.287744 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-b30ce76e-ef5b-484e-b932-73e92a7dd7d9 req-b0b5429a-cf92-4f3b-9664-b180be80b05c service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:27.288231 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-b30ce76e-ef5b-484e-b932-73e92a7dd7d9 req-b0b5429a-cf92-4f3b-9664-b180be80b05c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:27.289307 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-b30ce76e-ef5b-484e-b932-73e92a7dd7d9 req-b0b5429a-cf92-4f3b-9664-b180be80b05c service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:27.301598 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-b30ce76e-ef5b-484e-b932-73e92a7dd7d9 req-b0b5429a-cf92-4f3b-9664-b180be80b05c service nova] Creating event network-changed:84784522-0492-4dfd-a391-e2cd2949e644 for instance 21d02f4d-602e-4b71-838b-b6155b8eb4e0 on n-h1-853682-5 Oct 18 16:58:27.307135 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-b30ce76e-ef5b-484e-b932-73e92a7dd7d9 req-b0b5429a-cf92-4f3b-9664-b180be80b05c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048829 Oct 18 16:58:27.307760 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3869/7718] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:58:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:58:27.518110 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a0b37abb-3a6e-4cc4-8ecf-8d444bf71ad6 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:58:27.521629 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:58:27.528046 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a0b37abb-3a6e-4cc4-8ecf-8d444bf71ad6 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0" status: 200 len: 1687 microversion: 2.1 time: 0.261826 Oct 18 16:58:27.528631 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3850/7719] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:58:27 2022] GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0 => generated 1687 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:58:28.552216 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3c09a48f-2f6b-4ca6-bd62-da4577a25e82 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:58:28.553701 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3c09a48f-2f6b-4ca6-bd62-da4577a25e82 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:58:28.561776 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3c09a48f-2f6b-4ca6-bd62-da4577a25e82 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:28.562283 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3c09a48f-2f6b-4ca6-bd62-da4577a25e82 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:28.562933 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3c09a48f-2f6b-4ca6-bd62-da4577a25e82 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:28.563659 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3c09a48f-2f6b-4ca6-bd62-da4577a25e82 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:28.564133 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3c09a48f-2f6b-4ca6-bd62-da4577a25e82 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:28.564577 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3c09a48f-2f6b-4ca6-bd62-da4577a25e82 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:28.733222 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3c09a48f-2f6b-4ca6-bd62-da4577a25e82 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:58:28.742815 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3c09a48f-2f6b-4ca6-bd62-da4577a25e82 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0" status: 200 len: 1687 microversion: 2.1 time: 0.195207 Oct 18 16:58:28.743519 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3870/7720] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:58:28 2022] GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0 => generated 1687 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:58:29.768103 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-551fd981-14da-4683-968a-3e7b95749834 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:58:29.768677 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-551fd981-14da-4683-968a-3e7b95749834 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:58:29.771546 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=33 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:58:29.779160 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-551fd981-14da-4683-968a-3e7b95749834 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:29.780049 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-551fd981-14da-4683-968a-3e7b95749834 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:29.780772 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-551fd981-14da-4683-968a-3e7b95749834 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:29.781788 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-551fd981-14da-4683-968a-3e7b95749834 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:29.782503 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-551fd981-14da-4683-968a-3e7b95749834 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:29.783168 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-551fd981-14da-4683-968a-3e7b95749834 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:29.941308 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-551fd981-14da-4683-968a-3e7b95749834 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:58:29.949880 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-551fd981-14da-4683-968a-3e7b95749834 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0" status: 200 len: 1687 microversion: 2.1 time: 0.187195 Oct 18 16:58:29.960845 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3851/7721] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:58:29 2022] GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0 => generated 1687 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:58:30.974871 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3aba949f-ffea-4189-b0e2-c0d8bd2950b6 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:58:30.975519 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3aba949f-ffea-4189-b0e2-c0d8bd2950b6 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:58:30.979015 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:58:30.986331 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3aba949f-ffea-4189-b0e2-c0d8bd2950b6 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:30.986865 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3aba949f-ffea-4189-b0e2-c0d8bd2950b6 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:30.987428 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3aba949f-ffea-4189-b0e2-c0d8bd2950b6 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:30.988239 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3aba949f-ffea-4189-b0e2-c0d8bd2950b6 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:30.988794 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3aba949f-ffea-4189-b0e2-c0d8bd2950b6 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:30.989404 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3aba949f-ffea-4189-b0e2-c0d8bd2950b6 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:30.994994 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:58:31.146106 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3aba949f-ffea-4189-b0e2-c0d8bd2950b6 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:58:31.155714 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3aba949f-ffea-4189-b0e2-c0d8bd2950b6 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0" status: 200 len: 1687 microversion: 2.1 time: 0.185392 Oct 18 16:58:31.169113 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3871/7722] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:58:30 2022] GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0 => generated 1687 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:58:32.180164 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-21bf610b-1425-4206-bd97-48bbb5fc8df1 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:58:32.180794 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-21bf610b-1425-4206-bd97-48bbb5fc8df1 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:58:32.187815 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21bf610b-1425-4206-bd97-48bbb5fc8df1 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:32.188342 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21bf610b-1425-4206-bd97-48bbb5fc8df1 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:32.188782 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21bf610b-1425-4206-bd97-48bbb5fc8df1 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:32.189511 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21bf610b-1425-4206-bd97-48bbb5fc8df1 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:32.189971 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21bf610b-1425-4206-bd97-48bbb5fc8df1 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:32.190399 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21bf610b-1425-4206-bd97-48bbb5fc8df1 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:32.342186 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-21bf610b-1425-4206-bd97-48bbb5fc8df1 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:58:32.350012 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-21bf610b-1425-4206-bd97-48bbb5fc8df1 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0" status: 200 len: 1687 microversion: 2.1 time: 0.174994 Oct 18 16:58:32.350594 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3852/7723] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:58:32 2022] GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0 => generated 1687 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:58:33.375495 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a783cfa1-5cb8-4347-8c7e-c32074e819d0 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:58:33.376161 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a783cfa1-5cb8-4347-8c7e-c32074e819d0 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:58:33.382760 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a783cfa1-5cb8-4347-8c7e-c32074e819d0 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:33.383256 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a783cfa1-5cb8-4347-8c7e-c32074e819d0 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:33.383710 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a783cfa1-5cb8-4347-8c7e-c32074e819d0 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:33.384427 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a783cfa1-5cb8-4347-8c7e-c32074e819d0 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:33.384921 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a783cfa1-5cb8-4347-8c7e-c32074e819d0 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:33.385366 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a783cfa1-5cb8-4347-8c7e-c32074e819d0 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:33.537621 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a783cfa1-5cb8-4347-8c7e-c32074e819d0 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:58:33.551854 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a783cfa1-5cb8-4347-8c7e-c32074e819d0 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0" status: 200 len: 1687 microversion: 2.1 time: 0.180415 Oct 18 16:58:33.558627 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3872/7724] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:58:33 2022] GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0 => generated 1687 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:58:34.579268 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5080cc6f-fe5d-4126-a714-b7b6353077eb tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:58:34.580105 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5080cc6f-fe5d-4126-a714-b7b6353077eb tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:58:34.587467 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5080cc6f-fe5d-4126-a714-b7b6353077eb tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:34.587952 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5080cc6f-fe5d-4126-a714-b7b6353077eb tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:34.588384 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5080cc6f-fe5d-4126-a714-b7b6353077eb tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:34.589122 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5080cc6f-fe5d-4126-a714-b7b6353077eb tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:34.589578 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5080cc6f-fe5d-4126-a714-b7b6353077eb tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:34.589998 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5080cc6f-fe5d-4126-a714-b7b6353077eb tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:34.739529 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5080cc6f-fe5d-4126-a714-b7b6353077eb tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:58:34.755832 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5080cc6f-fe5d-4126-a714-b7b6353077eb tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0" status: 200 len: 1687 microversion: 2.1 time: 0.182466 Oct 18 16:58:34.756445 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3853/7725] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:58:34 2022] GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0 => generated 1687 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:58:35.781605 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a7d9cffe-5ed4-4ed8-8ce6-80ad5b671654 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:58:35.782158 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a7d9cffe-5ed4-4ed8-8ce6-80ad5b671654 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:58:35.789126 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a7d9cffe-5ed4-4ed8-8ce6-80ad5b671654 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:35.789624 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a7d9cffe-5ed4-4ed8-8ce6-80ad5b671654 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:35.790074 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a7d9cffe-5ed4-4ed8-8ce6-80ad5b671654 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:35.790779 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a7d9cffe-5ed4-4ed8-8ce6-80ad5b671654 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:35.791250 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a7d9cffe-5ed4-4ed8-8ce6-80ad5b671654 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:35.791691 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a7d9cffe-5ed4-4ed8-8ce6-80ad5b671654 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:35.931110 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a7d9cffe-5ed4-4ed8-8ce6-80ad5b671654 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:58:35.938965 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a7d9cffe-5ed4-4ed8-8ce6-80ad5b671654 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0" status: 200 len: 1687 microversion: 2.1 time: 0.162539 Oct 18 16:58:35.939543 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3873/7726] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:58:35 2022] GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0 => generated 1687 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:58:36.962825 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4a72c108-044c-49c9-bebb-bfdcf5f73b26 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:58:36.963396 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4a72c108-044c-49c9-bebb-bfdcf5f73b26 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:58:36.970607 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a72c108-044c-49c9-bebb-bfdcf5f73b26 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:36.971086 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a72c108-044c-49c9-bebb-bfdcf5f73b26 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:36.971520 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a72c108-044c-49c9-bebb-bfdcf5f73b26 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:36.972237 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a72c108-044c-49c9-bebb-bfdcf5f73b26 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:36.972687 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a72c108-044c-49c9-bebb-bfdcf5f73b26 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:36.973135 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a72c108-044c-49c9-bebb-bfdcf5f73b26 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:37.107761 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4a72c108-044c-49c9-bebb-bfdcf5f73b26 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:58:37.115556 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4a72c108-044c-49c9-bebb-bfdcf5f73b26 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0" status: 200 len: 1687 microversion: 2.1 time: 0.156717 Oct 18 16:58:37.116138 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3854/7727] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:58:36 2022] GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0 => generated 1687 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:58:38.139509 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4a9ab6c8-a24e-429c-b599-d63f7f2d8139 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:58:38.140140 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4a9ab6c8-a24e-429c-b599-d63f7f2d8139 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:58:38.147009 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4a9ab6c8-a24e-429c-b599-d63f7f2d8139 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:38.147861 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4a9ab6c8-a24e-429c-b599-d63f7f2d8139 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:38.148321 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4a9ab6c8-a24e-429c-b599-d63f7f2d8139 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:38.149050 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4a9ab6c8-a24e-429c-b599-d63f7f2d8139 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:38.149518 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4a9ab6c8-a24e-429c-b599-d63f7f2d8139 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:38.149955 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4a9ab6c8-a24e-429c-b599-d63f7f2d8139 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:38.281777 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4a9ab6c8-a24e-429c-b599-d63f7f2d8139 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:58:38.289580 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4a9ab6c8-a24e-429c-b599-d63f7f2d8139 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0" status: 200 len: 1687 microversion: 2.1 time: 0.154822 Oct 18 16:58:38.290151 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3874/7728] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:58:38 2022] GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0 => generated 1687 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:58:39.313702 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f105673a-c9d0-44c5-b8e7-b37e3bf5fe28 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:58:39.314315 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f105673a-c9d0-44c5-b8e7-b37e3bf5fe28 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:58:39.321203 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f105673a-c9d0-44c5-b8e7-b37e3bf5fe28 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:39.321705 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f105673a-c9d0-44c5-b8e7-b37e3bf5fe28 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:39.322147 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f105673a-c9d0-44c5-b8e7-b37e3bf5fe28 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:39.322861 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f105673a-c9d0-44c5-b8e7-b37e3bf5fe28 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:39.323325 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f105673a-c9d0-44c5-b8e7-b37e3bf5fe28 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:39.323752 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f105673a-c9d0-44c5-b8e7-b37e3bf5fe28 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:39.459813 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f105673a-c9d0-44c5-b8e7-b37e3bf5fe28 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:58:39.468009 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f105673a-c9d0-44c5-b8e7-b37e3bf5fe28 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0" status: 200 len: 1687 microversion: 2.1 time: 0.158304 Oct 18 16:58:39.468584 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3855/7729] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:58:39 2022] GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0 => generated 1687 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:58:40.491705 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-b7ecd93f-6c3a-47e9-a648-16b8b2fb46b4 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:58:40.492265 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-b7ecd93f-6c3a-47e9-a648-16b8b2fb46b4 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:58:40.499780 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b7ecd93f-6c3a-47e9-a648-16b8b2fb46b4 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:40.500289 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b7ecd93f-6c3a-47e9-a648-16b8b2fb46b4 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:40.500747 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b7ecd93f-6c3a-47e9-a648-16b8b2fb46b4 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:40.501485 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b7ecd93f-6c3a-47e9-a648-16b8b2fb46b4 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:40.501962 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b7ecd93f-6c3a-47e9-a648-16b8b2fb46b4 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:40.502410 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-b7ecd93f-6c3a-47e9-a648-16b8b2fb46b4 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:40.633974 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-b7ecd93f-6c3a-47e9-a648-16b8b2fb46b4 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:58:40.641706 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-b7ecd93f-6c3a-47e9-a648-16b8b2fb46b4 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0" status: 200 len: 1687 microversion: 2.1 time: 0.154096 Oct 18 16:58:40.642287 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3875/7730] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:58:40 2022] GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0 => generated 1687 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:58:41.665318 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5bbdd6d1-cb15-4835-9e87-1e2430778975 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:58:41.666555 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5bbdd6d1-cb15-4835-9e87-1e2430778975 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:58:41.673568 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5bbdd6d1-cb15-4835-9e87-1e2430778975 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:41.674053 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5bbdd6d1-cb15-4835-9e87-1e2430778975 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:41.674492 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5bbdd6d1-cb15-4835-9e87-1e2430778975 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:41.675194 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5bbdd6d1-cb15-4835-9e87-1e2430778975 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:41.675652 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5bbdd6d1-cb15-4835-9e87-1e2430778975 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:41.676078 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5bbdd6d1-cb15-4835-9e87-1e2430778975 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:41.882523 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5bbdd6d1-cb15-4835-9e87-1e2430778975 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:58:41.891181 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5bbdd6d1-cb15-4835-9e87-1e2430778975 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0" status: 200 len: 1687 microversion: 2.1 time: 0.229774 Oct 18 16:58:41.891773 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3856/7731] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:58:41 2022] GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0 => generated 1687 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:58:42.915280 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-4486e1eb-e28f-45f9-bc9e-b2e782ceb786 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:58:42.916089 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-4486e1eb-e28f-45f9-bc9e-b2e782ceb786 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:58:42.923444 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4486e1eb-e28f-45f9-bc9e-b2e782ceb786 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:42.923937 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4486e1eb-e28f-45f9-bc9e-b2e782ceb786 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:42.924432 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4486e1eb-e28f-45f9-bc9e-b2e782ceb786 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:42.925117 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4486e1eb-e28f-45f9-bc9e-b2e782ceb786 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:42.925588 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4486e1eb-e28f-45f9-bc9e-b2e782ceb786 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:42.926275 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-4486e1eb-e28f-45f9-bc9e-b2e782ceb786 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:43.065696 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-4486e1eb-e28f-45f9-bc9e-b2e782ceb786 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:58:43.073661 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-4486e1eb-e28f-45f9-bc9e-b2e782ceb786 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0" status: 200 len: 1687 microversion: 2.1 time: 0.162302 Oct 18 16:58:43.074232 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3876/7732] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:58:42 2022] GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0 => generated 1687 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:58:44.096792 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-758f070a-e439-4f59-839e-74a0aafd1ed3 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:58:44.097440 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-758f070a-e439-4f59-839e-74a0aafd1ed3 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:58:44.104457 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-758f070a-e439-4f59-839e-74a0aafd1ed3 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:44.104982 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-758f070a-e439-4f59-839e-74a0aafd1ed3 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:44.105417 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-758f070a-e439-4f59-839e-74a0aafd1ed3 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:44.106104 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-758f070a-e439-4f59-839e-74a0aafd1ed3 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:44.106563 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-758f070a-e439-4f59-839e-74a0aafd1ed3 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:44.106991 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-758f070a-e439-4f59-839e-74a0aafd1ed3 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:44.237371 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-758f070a-e439-4f59-839e-74a0aafd1ed3 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:58:44.245862 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-758f070a-e439-4f59-839e-74a0aafd1ed3 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0" status: 200 len: 1687 microversion: 2.1 time: 0.152437 Oct 18 16:58:44.246441 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3857/7733] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:58:44 2022] GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0 => generated 1687 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:58:44.972162 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-1affc8b4-d46b-4cfb-99b1-fd67b619efd6 req-e8773391-cd68-43bf-9848-a84661c19ab9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21d02f4d-602e-4b71-838b-b6155b8eb4e0", "name": "network-vif-plugged", "status": "completed", "tag": "84784522-0492-4dfd-a391-e2cd2949e644"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 16:58:44.983863 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-1affc8b4-d46b-4cfb-99b1-fd67b619efd6 req-e8773391-cd68-43bf-9848-a84661c19ab9 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:44.984362 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-1affc8b4-d46b-4cfb-99b1-fd67b619efd6 req-e8773391-cd68-43bf-9848-a84661c19ab9 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:44.984817 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-1affc8b4-d46b-4cfb-99b1-fd67b619efd6 req-e8773391-cd68-43bf-9848-a84661c19ab9 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:44.998897 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-1affc8b4-d46b-4cfb-99b1-fd67b619efd6 req-e8773391-cd68-43bf-9848-a84661c19ab9 service nova] Creating event network-vif-plugged:84784522-0492-4dfd-a391-e2cd2949e644 for instance 21d02f4d-602e-4b71-838b-b6155b8eb4e0 on n-h1-853682-5 Oct 18 16:58:45.004035 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-1affc8b4-d46b-4cfb-99b1-fd67b619efd6 req-e8773391-cd68-43bf-9848-a84661c19ab9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035517 Oct 18 16:58:45.004643 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3877/7734] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 16:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 16:58:45.269473 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c3f4c82a-17a7-497b-9afc-37322df68b30 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:58:45.270086 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c3f4c82a-17a7-497b-9afc-37322df68b30 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:58:45.276897 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3f4c82a-17a7-497b-9afc-37322df68b30 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:45.277647 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3f4c82a-17a7-497b-9afc-37322df68b30 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:45.278078 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3f4c82a-17a7-497b-9afc-37322df68b30 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:45.278765 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3f4c82a-17a7-497b-9afc-37322df68b30 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:45.279216 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3f4c82a-17a7-497b-9afc-37322df68b30 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:45.279638 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3f4c82a-17a7-497b-9afc-37322df68b30 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:45.416398 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c3f4c82a-17a7-497b-9afc-37322df68b30 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:58:45.424831 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c3f4c82a-17a7-497b-9afc-37322df68b30 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0" status: 200 len: 1687 microversion: 2.1 time: 0.159213 Oct 18 16:58:45.425404 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3858/7735] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:58:45 2022] GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0 => generated 1687 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 16:58:46.449565 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d9ef26ce-9968-489b-9d63-11b7f542b7ef tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:58:46.450225 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d9ef26ce-9968-489b-9d63-11b7f542b7ef tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:58:46.456390 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d9ef26ce-9968-489b-9d63-11b7f542b7ef tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:46.456922 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d9ef26ce-9968-489b-9d63-11b7f542b7ef tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:46.457374 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d9ef26ce-9968-489b-9d63-11b7f542b7ef tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:46.458078 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d9ef26ce-9968-489b-9d63-11b7f542b7ef tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:46.458546 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d9ef26ce-9968-489b-9d63-11b7f542b7ef tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:46.458985 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d9ef26ce-9968-489b-9d63-11b7f542b7ef tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:46.595243 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d9ef26ce-9968-489b-9d63-11b7f542b7ef tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:58:46.603283 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d9ef26ce-9968-489b-9d63-11b7f542b7ef tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0" status: 200 len: 1687 microversion: 2.1 time: 0.159015 Oct 18 16:58:46.603850 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3878/7736] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:58:46 2022] GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0 => generated 1687 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 16:58:47.627270 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5046157e-eb1d-4c2b-aa35-7fd37796c19c tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 16:58:47.627887 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5046157e-eb1d-4c2b-aa35-7fd37796c19c tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 16:58:47.634707 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5046157e-eb1d-4c2b-aa35-7fd37796c19c tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:47.635185 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5046157e-eb1d-4c2b-aa35-7fd37796c19c tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:47.635618 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5046157e-eb1d-4c2b-aa35-7fd37796c19c tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:47.636298 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5046157e-eb1d-4c2b-aa35-7fd37796c19c tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 16:58:47.636748 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5046157e-eb1d-4c2b-aa35-7fd37796c19c tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 16:58:47.637194 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5046157e-eb1d-4c2b-aa35-7fd37796c19c tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 16:58:47.768702 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5046157e-eb1d-4c2b-aa35-7fd37796c19c tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 16:58:47.777087 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5046157e-eb1d-4c2b-aa35-7fd37796c19c tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0" status: 200 len: 1674 microversion: 2.1 time: 0.153304 Oct 18 16:58:47.777924 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3859/7737] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 16:58:47 2022] GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:00:33.952186 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=15 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:00:33.953257 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=43 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:00:33.954312 n-d-853682-5 devstack@n-api.service[120405]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 17:00:33.954469 n-d-853682-5 devstack@n-api.service[120405]: Tue Oct 18 17:00:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0 (ip 10.222.0.60) !!! Oct 18 17:00:33.958668 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=17 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:00:33.959418 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=54 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:00:33.961012 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-90b61ffe-80f2-4bd8-b2c5-ef9c993baf85 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:00:33.961165 n-d-853682-5 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 17:00:33.961323 n-d-853682-5 devstack@n-api.service[120406]: Tue Oct 18 17:00:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.60) !!! Oct 18 17:00:33.961689 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-90b61ffe-80f2-4bd8-b2c5-ef9c993baf85 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:00:33.962991 n-d-853682-5 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 17:00:33.963125 n-d-853682-5 devstack@n-api.service[120406]: Tue Oct 18 17:00:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.60) !!! Oct 18 17:00:33.969592 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-cf54a6cb-2450-4c9d-84e1-3fe34b4d4729 req-d6d59158-1f1f-48d5-b416-742285fe3078 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21d02f4d-602e-4b71-838b-b6155b8eb4e0", "tag": "84784522-0492-4dfd-a391-e2cd2949e644"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:00:33.969838 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-90b61ffe-80f2-4bd8-b2c5-ef9c993baf85 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:00:33.970480 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-90b61ffe-80f2-4bd8-b2c5-ef9c993baf85 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:00:33.971513 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-90b61ffe-80f2-4bd8-b2c5-ef9c993baf85 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:00:33.972725 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-90b61ffe-80f2-4bd8-b2c5-ef9c993baf85 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:00:33.972930 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-90b61ffe-80f2-4bd8-b2c5-ef9c993baf85 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:00:33.973503 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-90b61ffe-80f2-4bd8-b2c5-ef9c993baf85 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:00:33.996966 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-cf54a6cb-2450-4c9d-84e1-3fe34b4d4729 req-d6d59158-1f1f-48d5-b416-742285fe3078 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:00:33.997444 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-cf54a6cb-2450-4c9d-84e1-3fe34b4d4729 req-d6d59158-1f1f-48d5-b416-742285fe3078 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:00:33.997874 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-cf54a6cb-2450-4c9d-84e1-3fe34b4d4729 req-d6d59158-1f1f-48d5-b416-742285fe3078 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:00:34.005262 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-90b61ffe-80f2-4bd8-b2c5-ef9c993baf85 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 17:00:34.012760 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-cf54a6cb-2450-4c9d-84e1-3fe34b4d4729 req-d6d59158-1f1f-48d5-b416-742285fe3078 service nova] Creating event network-changed:84784522-0492-4dfd-a391-e2cd2949e644 for instance 21d02f4d-602e-4b71-838b-b6155b8eb4e0 on n-h1-853682-5 Oct 18 17:00:34.018515 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-cf54a6cb-2450-4c9d-84e1-3fe34b4d4729 req-d6d59158-1f1f-48d5-b416-742285fe3078 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065657 Oct 18 17:00:34.019322 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3860/7738] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 17:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:00:34.097637 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-90b61ffe-80f2-4bd8-b2c5-ef9c993baf85 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "DELETE /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0" status: 204 len: 0 microversion: 2.1 time: 0.147436 Oct 18 17:00:34.098261 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3879/7739] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 17:00:33 2022] DELETE /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 17:00:34.107123 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-77a58d6d-0b14-4616-bbef-39055888e849 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:00:34.107829 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-77a58d6d-0b14-4616-bbef-39055888e849 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:00:34.115248 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77a58d6d-0b14-4616-bbef-39055888e849 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:00:34.115747 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77a58d6d-0b14-4616-bbef-39055888e849 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:00:34.116272 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77a58d6d-0b14-4616-bbef-39055888e849 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:00:34.117159 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77a58d6d-0b14-4616-bbef-39055888e849 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:00:34.117674 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77a58d6d-0b14-4616-bbef-39055888e849 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:00:34.118221 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77a58d6d-0b14-4616-bbef-39055888e849 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:00:34.336612 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-77a58d6d-0b14-4616-bbef-39055888e849 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:00:34.344557 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-77a58d6d-0b14-4616-bbef-39055888e849 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0" status: 200 len: 1680 microversion: 2.1 time: 0.241749 Oct 18 17:00:34.345177 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3861/7740] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:00:34 2022] GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0 => generated 1680 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:00:35.369562 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-38f82e33-2b8f-462a-8c76-57d958d22aed tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:00:35.370281 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-38f82e33-2b8f-462a-8c76-57d958d22aed tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:00:35.378472 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-38f82e33-2b8f-462a-8c76-57d958d22aed tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:00:35.378962 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-38f82e33-2b8f-462a-8c76-57d958d22aed tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:00:35.379411 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-38f82e33-2b8f-462a-8c76-57d958d22aed tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:00:35.380124 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-38f82e33-2b8f-462a-8c76-57d958d22aed tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:00:35.380590 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-38f82e33-2b8f-462a-8c76-57d958d22aed tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:00:35.381052 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-38f82e33-2b8f-462a-8c76-57d958d22aed tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:00:35.613016 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-38f82e33-2b8f-462a-8c76-57d958d22aed tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:00:35.620929 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-38f82e33-2b8f-462a-8c76-57d958d22aed tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0" status: 200 len: 1680 microversion: 2.1 time: 0.255695 Oct 18 17:00:35.621533 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3880/7741] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:00:35 2022] GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0 => generated 1680 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:00:36.362140 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-98eb570d-e47f-482b-821e-b9ced258c7ad req-74fe2021-0729-4157-beac-c6d542fab233 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21d02f4d-602e-4b71-838b-b6155b8eb4e0", "name": "network-vif-deleted", "tag": "84784522-0492-4dfd-a391-e2cd2949e644"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:00:36.371666 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-98eb570d-e47f-482b-821e-b9ced258c7ad req-74fe2021-0729-4157-beac-c6d542fab233 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:00:36.372160 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-98eb570d-e47f-482b-821e-b9ced258c7ad req-74fe2021-0729-4157-beac-c6d542fab233 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:00:36.372602 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-98eb570d-e47f-482b-821e-b9ced258c7ad req-74fe2021-0729-4157-beac-c6d542fab233 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:00:36.385335 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-98eb570d-e47f-482b-821e-b9ced258c7ad req-74fe2021-0729-4157-beac-c6d542fab233 service nova] Creating event network-vif-deleted:84784522-0492-4dfd-a391-e2cd2949e644 for instance 21d02f4d-602e-4b71-838b-b6155b8eb4e0 on n-h1-853682-5 Oct 18 17:00:36.391287 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-98eb570d-e47f-482b-821e-b9ced258c7ad req-74fe2021-0729-4157-beac-c6d542fab233 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101302 Oct 18 17:00:36.391903 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3862/7742] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 17:00:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 17:00:36.643974 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8daf7a08-86d7-426a-82e5-2fcfa3c1e00e tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:00:36.644710 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8daf7a08-86d7-426a-82e5-2fcfa3c1e00e tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:00:36.652201 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8daf7a08-86d7-426a-82e5-2fcfa3c1e00e tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:00:36.652792 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8daf7a08-86d7-426a-82e5-2fcfa3c1e00e tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:00:36.653370 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8daf7a08-86d7-426a-82e5-2fcfa3c1e00e tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:00:36.654172 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8daf7a08-86d7-426a-82e5-2fcfa3c1e00e tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:00:36.654734 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8daf7a08-86d7-426a-82e5-2fcfa3c1e00e tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:00:36.655247 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8daf7a08-86d7-426a-82e5-2fcfa3c1e00e tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:00:36.689737 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8daf7a08-86d7-426a-82e5-2fcfa3c1e00e tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:00:36.691123 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8daf7a08-86d7-426a-82e5-2fcfa3c1e00e tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:00:36.691788 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8daf7a08-86d7-426a-82e5-2fcfa3c1e00e tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:00:36.692546 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-8daf7a08-86d7-426a-82e5-2fcfa3c1e00e tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lazy-loading 'fault' on Instance uuid 21d02f4d-602e-4b71-838b-b6155b8eb4e0 {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 17:00:36.739971 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8daf7a08-86d7-426a-82e5-2fcfa3c1e00e tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:00:36.748494 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8daf7a08-86d7-426a-82e5-2fcfa3c1e00e tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0" status: 200 len: 1334 microversion: 2.1 time: 0.108663 Oct 18 17:00:36.749128 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3881/7743] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:00:36 2022] GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0 => generated 1334 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:00:37.773685 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dde20cac-f6eb-485e-bd1b-e0c5ac793637 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:00:37.774386 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dde20cac-f6eb-485e-bd1b-e0c5ac793637 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: 21d02f4d-602e-4b71-838b-b6155b8eb4e0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:00:37.780840 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dde20cac-f6eb-485e-bd1b-e0c5ac793637 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:00:37.781323 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dde20cac-f6eb-485e-bd1b-e0c5ac793637 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:00:37.781760 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dde20cac-f6eb-485e-bd1b-e0c5ac793637 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:00:37.782449 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dde20cac-f6eb-485e-bd1b-e0c5ac793637 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:00:37.782905 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dde20cac-f6eb-485e-bd1b-e0c5ac793637 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:00:37.783330 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dde20cac-f6eb-485e-bd1b-e0c5ac793637 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:00:37.796595 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-dde20cac-f6eb-485e-bd1b-e0c5ac793637 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] HTTP exception thrown: Instance 21d02f4d-602e-4b71-838b-b6155b8eb4e0 could not be found. Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dde20cac-f6eb-485e-bd1b-e0c5ac793637 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Request method failure captured: Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0 HTTP/1.1 Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTtqRhs4C83zO09-hXyWaLI9CnFJHVxM1e8oh_PxlfoneWFy6i1o2Y5-scOsXlNrsLpTDCA2cXb9qlzMzLQSetS2lT9GMUqxHa25vH3d7nKD5PHe3GUTLStL9Jma-WAx3p1gH8dECkYJW2yLb-yzcS5byRtsbYbiExSkaI4AhgIA0-wM Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: b495752af59843c9b5c2270dabc10a78 Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-TestShelveInstance-1988149404 Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b495752af59843c9b5c2270dabc10a78"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b495752af59843c9b5c2270dabc10a78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b495752af59843c9b5c2270dabc10a78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b495752af59843c9b5c2270dabc10a78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-TestShelveInstance-1988149404 Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: b495752af59843c9b5c2270dabc10a78 Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-TestShelveInstance-1988149404 Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-TestShelveInstance-1988149404-project Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: b93520a1077949b6ab65c9c3a98772ce Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-TestShelveInstance-1988149404-project Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 21d02f4d-602e-4b71-838b-b6155b8eb4e0 could not be found. Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '21d02f4d-602e-4b71-838b-b6155b8eb4e0'} Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21d02f4d-602e-4b71-838b-b6155b8eb4e0 could not be found. Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21d02f4d-602e-4b71-838b-b6155b8eb4e0 could not be found. Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:00:37.798313 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 17:00:37.804246 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:00:37.804246 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:00:37.804246 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:00:37.804246 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 17:00:37.804246 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 17:00:37.804246 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21d02f4d-602e-4b71-838b-b6155b8eb4e0 could not be found. Oct 18 17:00:37.804246 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 17:00:37.804246 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dde20cac-f6eb-485e-bd1b-e0c5ac793637 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Returning 404 to user: Instance 21d02f4d-602e-4b71-838b-b6155b8eb4e0 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 17:00:37.804246 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dde20cac-f6eb-485e-bd1b-e0c5ac793637 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0" status: 404 len: 111 microversion: 2.1 time: 0.031789 Oct 18 17:00:37.804246 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3863/7744] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:00:37 2022] GET /compute/v2.1/servers/21d02f4d-602e-4b71-838b-b6155b8eb4e0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 17:00:37.961231 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5b0a8c84-83ba-4d11-8709-e8ddfb5139b6 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '.version_select at 0x7f7c3c850670>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:00:37.986600 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5b0a8c84-83ba-4d11-8709-e8ddfb5139b6 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-788282270" status: 202 len: 0 microversion: 2.1 time: 0.029188 Oct 18 17:00:37.987807 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3882/7745] 10.222.0.60 () {58 vars in 1251 bytes} [Tue Oct 18 17:00:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-788282270 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 17:00:38.011342 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e05f8e85-d7ca-454a-b4c7-c6f61f42e708 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Action: 'create', calling method: .version_select at 0x7f7c3c585af0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1390314234", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKfHkZTg1td/llPuPf8AveyJr/ipCvn5sp/1I4EJYQbtQAWlRHT9qg6hl5Fd7/q4Q06+WpP1QeDW1zkf4hkSJumba5sIxFX/7qObyWUR6VTHlTfozvoGwSgh2/6QW3SBJQ=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:00:38.027056 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-e05f8e85-d7ca-454a-b4c7-c6f61f42e708 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Getting quotas for project b495752af59843c9b5c2270dabc10a78. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 17:00:38.032156 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-e05f8e85-d7ca-454a-b4c7-c6f61f42e708 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Getting quotas for user b93520a1077949b6ab65c9c3a98772ce and project b495752af59843c9b5c2270dabc10a78. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 17:00:38.059903 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e05f8e85-d7ca-454a-b4c7-c6f61f42e708 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.052480 Oct 18 17:00:38.060519 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3864/7746] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Oct 18 17:00:38 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:00:54.376966 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:00:54.378261 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:00:54.382875 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e698afdf-f87d-4463-bffb-47edac21c5a3 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-642253280", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1390314234", "security_groups": [{"name": "tempest-secgroup-smoke-303384269"}], "networks": [{"uuid": "1c801ca4-0dea-4415-aa55-84e9ee722b5a"}], "block_device_mapping_v2": [{"uuid": "acc2aaf2-3de7-433e-ade7-55eecf08f017", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:00:54.496650 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-e698afdf-f87d-4463-bffb-47edac21c5a3 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] validate_networks() for [('1c801ca4-0dea-4415-aa55-84e9ee722b5a', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 17:00:55.165928 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-e698afdf-f87d-4463-bffb-47edac21c5a3 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 17:00:55.166371 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-e698afdf-f87d-4463-bffb-47edac21c5a3 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 17:00:55.166862 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-e698afdf-f87d-4463-bffb-47edac21c5a3 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 17:00:55.167289 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-e698afdf-f87d-4463-bffb-47edac21c5a3 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 17:00:55.167716 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-e698afdf-f87d-4463-bffb-47edac21c5a3 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 17:00:55.177234 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e698afdf-f87d-4463-bffb-47edac21c5a3 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:00:55.177730 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e698afdf-f87d-4463-bffb-47edac21c5a3 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:00:55.178186 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e698afdf-f87d-4463-bffb-47edac21c5a3 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:00:55.178932 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e698afdf-f87d-4463-bffb-47edac21c5a3 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:00:55.179403 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e698afdf-f87d-4463-bffb-47edac21c5a3 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:00:55.179841 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e698afdf-f87d-4463-bffb-47edac21c5a3 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:00:55.197385 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-e698afdf-f87d-4463-bffb-47edac21c5a3 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Getting quotas for project b495752af59843c9b5c2270dabc10a78. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 17:00:55.202707 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-e698afdf-f87d-4463-bffb-47edac21c5a3 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Getting quotas for user b93520a1077949b6ab65c9c3a98772ce and project b495752af59843c9b5c2270dabc10a78. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 17:00:55.260963 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e698afdf-f87d-4463-bffb-47edac21c5a3 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 17:00:55.263184 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e698afdf-f87d-4463-bffb-47edac21c5a3 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='acc2aaf2-3de7-433e-ade7-55eecf08f017',volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 17:00:55.396552 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e698afdf-f87d-4463-bffb-47edac21c5a3 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.021180 Oct 18 17:00:55.404340 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3883/7747] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 17:00:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 1030 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 17:00:55.409957 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e86dabf6-c28a-43c2-b120-a5d5cbdeee7c tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:00:55.410584 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e86dabf6-c28a-43c2-b120-a5d5cbdeee7c tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:00:55.413749 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=12 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:00:55.414594 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:00:55.416228 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:00:55.471893 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e86dabf6-c28a-43c2-b120-a5d5cbdeee7c tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:00:55.478874 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e86dabf6-c28a-43c2-b120-a5d5cbdeee7c tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1088 microversion: 2.1 time: 0.072986 Oct 18 17:00:55.479451 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3865/7748] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:00:55 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1088 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:00:56.503050 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2970efa8-c557-43fb-85c5-0825aba83bfe tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:00:56.503707 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2970efa8-c557-43fb-85c5-0825aba83bfe tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:00:56.560721 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2970efa8-c557-43fb-85c5-0825aba83bfe tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:00:56.568352 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2970efa8-c557-43fb-85c5-0825aba83bfe tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1088 microversion: 2.1 time: 0.070177 Oct 18 17:00:56.568947 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3884/7749] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:00:56 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1088 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:00:57.591693 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-660c9cbc-3c10-4b11-b153-d22297576bb9 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:00:57.592179 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-660c9cbc-3c10-4b11-b153-d22297576bb9 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:00:57.646788 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-660c9cbc-3c10-4b11-b153-d22297576bb9 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:00:57.654794 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-660c9cbc-3c10-4b11-b153-d22297576bb9 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1088 microversion: 2.1 time: 0.067086 Oct 18 17:00:57.655634 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3866/7750] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:00:57 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1088 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:00:58.678676 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-25b63d32-0d32-4368-a80a-f1c8cd0cd3cd tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:00:58.679361 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-25b63d32-0d32-4368-a80a-f1c8cd0cd3cd tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:00:58.735634 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-25b63d32-0d32-4368-a80a-f1c8cd0cd3cd tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:00:58.742511 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-25b63d32-0d32-4368-a80a-f1c8cd0cd3cd tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1088 microversion: 2.1 time: 0.067786 Oct 18 17:00:58.743115 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3885/7751] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:00:58 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1088 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:00:59.765250 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-54f45471-2429-4973-97f3-3ab329c8ca59 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:00:59.765891 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-54f45471-2429-4973-97f3-3ab329c8ca59 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:00:59.773410 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54f45471-2429-4973-97f3-3ab329c8ca59 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:00:59.773891 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54f45471-2429-4973-97f3-3ab329c8ca59 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:00:59.774323 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54f45471-2429-4973-97f3-3ab329c8ca59 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:00:59.775011 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54f45471-2429-4973-97f3-3ab329c8ca59 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:00:59.775466 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54f45471-2429-4973-97f3-3ab329c8ca59 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:00:59.776147 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54f45471-2429-4973-97f3-3ab329c8ca59 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:00:59.836501 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-54f45471-2429-4973-97f3-3ab329c8ca59 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:00:59.844177 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-54f45471-2429-4973-97f3-3ab329c8ca59 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1138 microversion: 2.1 time: 0.082865 Oct 18 17:00:59.844747 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3867/7752] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:00:59 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1138 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:01:00.867133 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9ae5992d-9d20-454d-ae67-ebfddc800d21 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:01:00.868617 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9ae5992d-9d20-454d-ae67-ebfddc800d21 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:01:00.876745 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9ae5992d-9d20-454d-ae67-ebfddc800d21 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:00.877625 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9ae5992d-9d20-454d-ae67-ebfddc800d21 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:00.878349 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9ae5992d-9d20-454d-ae67-ebfddc800d21 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:00.879153 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9ae5992d-9d20-454d-ae67-ebfddc800d21 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:00.879928 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9ae5992d-9d20-454d-ae67-ebfddc800d21 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:00.880449 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9ae5992d-9d20-454d-ae67-ebfddc800d21 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:00.951442 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9ae5992d-9d20-454d-ae67-ebfddc800d21 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:01:00.960424 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9ae5992d-9d20-454d-ae67-ebfddc800d21 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1204 microversion: 2.1 time: 0.097600 Oct 18 17:01:00.961713 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3886/7753] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:01:00 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1204 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:01:01.968848 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-88146ad7-f86d-486e-8812-7c76344a0412 req-5a9814d1-722f-4f36-baf9-1daa3c891abe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0ba6d63-962f-4f40-9f31-760422ad4e7c", "tag": "ee3b861b-a264-4233-9abf-6688ec805a88"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:01:01.978457 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-88146ad7-f86d-486e-8812-7c76344a0412 req-5a9814d1-722f-4f36-baf9-1daa3c891abe service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:01.983675 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5a888d67-9bb1-4c4f-a1a7-2f17f3633369 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:01:01.984299 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5a888d67-9bb1-4c4f-a1a7-2f17f3633369 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:01:01.991217 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5a888d67-9bb1-4c4f-a1a7-2f17f3633369 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:01.991719 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5a888d67-9bb1-4c4f-a1a7-2f17f3633369 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:01.992164 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5a888d67-9bb1-4c4f-a1a7-2f17f3633369 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:01.992907 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5a888d67-9bb1-4c4f-a1a7-2f17f3633369 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:01.993381 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5a888d67-9bb1-4c4f-a1a7-2f17f3633369 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:01.993818 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5a888d67-9bb1-4c4f-a1a7-2f17f3633369 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:01.997640 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-88146ad7-f86d-486e-8812-7c76344a0412 req-5a9814d1-722f-4f36-baf9-1daa3c891abe service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:01.997920 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-88146ad7-f86d-486e-8812-7c76344a0412 req-5a9814d1-722f-4f36-baf9-1daa3c891abe service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:02.011492 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-88146ad7-f86d-486e-8812-7c76344a0412 req-5a9814d1-722f-4f36-baf9-1daa3c891abe service nova] Creating event network-changed:ee3b861b-a264-4233-9abf-6688ec805a88 for instance c0ba6d63-962f-4f40-9f31-760422ad4e7c on n-h2-853682-5 Oct 18 17:01:02.017482 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-88146ad7-f86d-486e-8812-7c76344a0412 req-5a9814d1-722f-4f36-baf9-1daa3c891abe service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117273 Oct 18 17:01:02.019159 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3868/7754] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 17:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:01:02.147634 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5a888d67-9bb1-4c4f-a1a7-2f17f3633369 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:01:02.157003 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5a888d67-9bb1-4c4f-a1a7-2f17f3633369 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1271 microversion: 2.1 time: 0.176928 Oct 18 17:01:02.158030 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3887/7755] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:01:01 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1271 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 17:01:03.194907 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-178f7965-f0ae-43d3-bc39-2be0d52b1516 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:01:03.195523 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-178f7965-f0ae-43d3-bc39-2be0d52b1516 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:01:03.202703 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-178f7965-f0ae-43d3-bc39-2be0d52b1516 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:03.203179 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-178f7965-f0ae-43d3-bc39-2be0d52b1516 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:03.203611 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-178f7965-f0ae-43d3-bc39-2be0d52b1516 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:03.204308 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-178f7965-f0ae-43d3-bc39-2be0d52b1516 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:03.204763 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-178f7965-f0ae-43d3-bc39-2be0d52b1516 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:03.205214 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-178f7965-f0ae-43d3-bc39-2be0d52b1516 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:03.344818 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-178f7965-f0ae-43d3-bc39-2be0d52b1516 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:01:03.353269 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-178f7965-f0ae-43d3-bc39-2be0d52b1516 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1271 microversion: 2.1 time: 0.163175 Oct 18 17:01:03.353851 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3869/7756] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:01:03 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1271 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:01:04.376300 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-40c535c4-3337-4157-a705-ddea6e434566 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:01:04.376981 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-40c535c4-3337-4157-a705-ddea6e434566 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:01:04.384673 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-40c535c4-3337-4157-a705-ddea6e434566 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:04.385213 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-40c535c4-3337-4157-a705-ddea6e434566 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:04.385672 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-40c535c4-3337-4157-a705-ddea6e434566 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:04.386401 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-40c535c4-3337-4157-a705-ddea6e434566 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:04.386876 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-40c535c4-3337-4157-a705-ddea6e434566 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:04.387320 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-40c535c4-3337-4157-a705-ddea6e434566 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:04.524429 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-40c535c4-3337-4157-a705-ddea6e434566 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:01:04.532562 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-40c535c4-3337-4157-a705-ddea6e434566 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1271 microversion: 2.1 time: 0.160227 Oct 18 17:01:04.533163 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3888/7757] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:01:04 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1271 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:01:05.555052 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-da8ca906-e3a1-4e50-8923-7b724ee31ed1 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:01:05.555678 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-da8ca906-e3a1-4e50-8923-7b724ee31ed1 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:01:05.563139 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da8ca906-e3a1-4e50-8923-7b724ee31ed1 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:05.563630 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da8ca906-e3a1-4e50-8923-7b724ee31ed1 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:05.564088 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da8ca906-e3a1-4e50-8923-7b724ee31ed1 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:05.564771 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da8ca906-e3a1-4e50-8923-7b724ee31ed1 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:05.565263 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da8ca906-e3a1-4e50-8923-7b724ee31ed1 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:05.565698 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da8ca906-e3a1-4e50-8923-7b724ee31ed1 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:05.696435 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-da8ca906-e3a1-4e50-8923-7b724ee31ed1 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:01:05.704483 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-da8ca906-e3a1-4e50-8923-7b724ee31ed1 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1259 microversion: 2.1 time: 0.153482 Oct 18 17:01:05.705103 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3870/7758] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:01:05 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:01:06.727628 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-37bb409c-d75e-4a4a-8197-d3d8afbde682 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:01:06.728300 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-37bb409c-d75e-4a4a-8197-d3d8afbde682 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:01:06.730260 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:01:06.736295 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37bb409c-d75e-4a4a-8197-d3d8afbde682 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:06.737346 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37bb409c-d75e-4a4a-8197-d3d8afbde682 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:06.737805 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37bb409c-d75e-4a4a-8197-d3d8afbde682 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:06.738519 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37bb409c-d75e-4a4a-8197-d3d8afbde682 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:06.738997 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37bb409c-d75e-4a4a-8197-d3d8afbde682 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:06.739443 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-37bb409c-d75e-4a4a-8197-d3d8afbde682 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:06.872969 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-37bb409c-d75e-4a4a-8197-d3d8afbde682 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:01:06.881398 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-37bb409c-d75e-4a4a-8197-d3d8afbde682 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1259 microversion: 2.1 time: 0.157818 Oct 18 17:01:06.881978 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3889/7759] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:01:06 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:01:07.904157 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-97d17c42-f04b-440c-a41d-9a9fb06c830e tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:01:07.904716 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-97d17c42-f04b-440c-a41d-9a9fb06c830e tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:01:07.907440 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:01:07.912863 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-97d17c42-f04b-440c-a41d-9a9fb06c830e tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:07.913346 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-97d17c42-f04b-440c-a41d-9a9fb06c830e tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:07.913780 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-97d17c42-f04b-440c-a41d-9a9fb06c830e tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:07.914465 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-97d17c42-f04b-440c-a41d-9a9fb06c830e tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:07.914918 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-97d17c42-f04b-440c-a41d-9a9fb06c830e tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:07.915346 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-97d17c42-f04b-440c-a41d-9a9fb06c830e tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:08.050849 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-97d17c42-f04b-440c-a41d-9a9fb06c830e tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:01:08.058716 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-97d17c42-f04b-440c-a41d-9a9fb06c830e tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1259 microversion: 2.1 time: 0.159070 Oct 18 17:01:08.059313 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3871/7760] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:01:07 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:01:09.082717 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ab13ffa6-c225-465f-a666-1439809437dd tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:01:09.083349 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ab13ffa6-c225-465f-a666-1439809437dd tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:01:09.086006 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=10 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:01:09.091404 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ab13ffa6-c225-465f-a666-1439809437dd tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:09.091900 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ab13ffa6-c225-465f-a666-1439809437dd tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:09.092344 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ab13ffa6-c225-465f-a666-1439809437dd tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:09.093080 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ab13ffa6-c225-465f-a666-1439809437dd tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:09.093549 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ab13ffa6-c225-465f-a666-1439809437dd tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:09.093986 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ab13ffa6-c225-465f-a666-1439809437dd tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:09.234311 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ab13ffa6-c225-465f-a666-1439809437dd tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:01:09.242146 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ab13ffa6-c225-465f-a666-1439809437dd tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1259 microversion: 2.1 time: 0.163855 Oct 18 17:01:09.242719 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3890/7761] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:01:09 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:01:10.265500 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1d3c7d20-f6dc-4b5e-a4c7-d1ab35eb7858 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:01:10.266160 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1d3c7d20-f6dc-4b5e-a4c7-d1ab35eb7858 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:01:10.273813 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d3c7d20-f6dc-4b5e-a4c7-d1ab35eb7858 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:10.274305 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d3c7d20-f6dc-4b5e-a4c7-d1ab35eb7858 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:10.274748 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d3c7d20-f6dc-4b5e-a4c7-d1ab35eb7858 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:10.275706 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d3c7d20-f6dc-4b5e-a4c7-d1ab35eb7858 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:10.276167 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d3c7d20-f6dc-4b5e-a4c7-d1ab35eb7858 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:10.276598 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d3c7d20-f6dc-4b5e-a4c7-d1ab35eb7858 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:10.407418 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1d3c7d20-f6dc-4b5e-a4c7-d1ab35eb7858 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:01:10.415461 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1d3c7d20-f6dc-4b5e-a4c7-d1ab35eb7858 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1259 microversion: 2.1 time: 0.153873 Oct 18 17:01:10.416048 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3872/7762] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:01:10 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:01:11.438709 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e0c8894d-b6fd-4288-a01f-8556d25b3089 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:01:11.439375 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e0c8894d-b6fd-4288-a01f-8556d25b3089 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:01:11.446477 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e0c8894d-b6fd-4288-a01f-8556d25b3089 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:11.447006 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e0c8894d-b6fd-4288-a01f-8556d25b3089 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:11.447470 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e0c8894d-b6fd-4288-a01f-8556d25b3089 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:11.448197 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e0c8894d-b6fd-4288-a01f-8556d25b3089 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:11.448671 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e0c8894d-b6fd-4288-a01f-8556d25b3089 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:11.449146 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e0c8894d-b6fd-4288-a01f-8556d25b3089 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:11.580286 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e0c8894d-b6fd-4288-a01f-8556d25b3089 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:01:11.587923 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e0c8894d-b6fd-4288-a01f-8556d25b3089 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1259 microversion: 2.1 time: 0.153126 Oct 18 17:01:11.588492 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3891/7763] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:01:11 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:01:12.612271 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-91894e8b-9781-406d-9f8a-122ab7c4ad30 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:01:12.613024 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-91894e8b-9781-406d-9f8a-122ab7c4ad30 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:01:12.619912 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91894e8b-9781-406d-9f8a-122ab7c4ad30 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:12.620402 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91894e8b-9781-406d-9f8a-122ab7c4ad30 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:12.620871 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91894e8b-9781-406d-9f8a-122ab7c4ad30 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:12.621574 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91894e8b-9781-406d-9f8a-122ab7c4ad30 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:12.622037 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91894e8b-9781-406d-9f8a-122ab7c4ad30 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:12.622467 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91894e8b-9781-406d-9f8a-122ab7c4ad30 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:12.759578 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-91894e8b-9781-406d-9f8a-122ab7c4ad30 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:01:12.767310 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-91894e8b-9781-406d-9f8a-122ab7c4ad30 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1259 microversion: 2.1 time: 0.159687 Oct 18 17:01:12.767889 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3873/7764] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:01:12 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:01:13.790265 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-09db28e1-eead-4505-b51d-ed09a30ea0c2 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:01:13.790905 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-09db28e1-eead-4505-b51d-ed09a30ea0c2 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:01:13.798002 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09db28e1-eead-4505-b51d-ed09a30ea0c2 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:13.798503 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09db28e1-eead-4505-b51d-ed09a30ea0c2 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:13.798960 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09db28e1-eead-4505-b51d-ed09a30ea0c2 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:13.799713 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09db28e1-eead-4505-b51d-ed09a30ea0c2 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:13.800192 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09db28e1-eead-4505-b51d-ed09a30ea0c2 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:13.800638 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-09db28e1-eead-4505-b51d-ed09a30ea0c2 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:13.931800 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-09db28e1-eead-4505-b51d-ed09a30ea0c2 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:01:13.939507 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-09db28e1-eead-4505-b51d-ed09a30ea0c2 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1259 microversion: 2.1 time: 0.153141 Oct 18 17:01:13.940589 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3892/7765] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:01:13 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:01:14.961999 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d8e0eb79-e8d5-4f9c-b65a-15939fbb47a4 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:01:14.962541 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d8e0eb79-e8d5-4f9c-b65a-15939fbb47a4 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:01:14.969691 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8e0eb79-e8d5-4f9c-b65a-15939fbb47a4 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:14.970180 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8e0eb79-e8d5-4f9c-b65a-15939fbb47a4 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:14.970619 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8e0eb79-e8d5-4f9c-b65a-15939fbb47a4 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:14.971329 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8e0eb79-e8d5-4f9c-b65a-15939fbb47a4 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:14.971788 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8e0eb79-e8d5-4f9c-b65a-15939fbb47a4 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:14.972215 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8e0eb79-e8d5-4f9c-b65a-15939fbb47a4 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:15.105571 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d8e0eb79-e8d5-4f9c-b65a-15939fbb47a4 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:01:15.113909 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d8e0eb79-e8d5-4f9c-b65a-15939fbb47a4 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1259 microversion: 2.1 time: 0.155973 Oct 18 17:01:15.114490 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3874/7766] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:01:14 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:01:16.137671 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-30ba4ad8-8b17-46f2-a243-2f7aad166ccf tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:01:16.138315 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-30ba4ad8-8b17-46f2-a243-2f7aad166ccf tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:01:16.145413 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-30ba4ad8-8b17-46f2-a243-2f7aad166ccf tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:16.145922 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-30ba4ad8-8b17-46f2-a243-2f7aad166ccf tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:16.146376 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-30ba4ad8-8b17-46f2-a243-2f7aad166ccf tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:16.147096 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-30ba4ad8-8b17-46f2-a243-2f7aad166ccf tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:16.147570 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-30ba4ad8-8b17-46f2-a243-2f7aad166ccf tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:16.148013 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-30ba4ad8-8b17-46f2-a243-2f7aad166ccf tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:16.284746 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-30ba4ad8-8b17-46f2-a243-2f7aad166ccf tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:01:16.292818 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-30ba4ad8-8b17-46f2-a243-2f7aad166ccf tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1259 microversion: 2.1 time: 0.159042 Oct 18 17:01:16.293643 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3893/7767] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:01:16 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:01:17.315754 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fd5e1b24-9de6-4f6e-8f98-afcb7f336771 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:01:17.316386 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fd5e1b24-9de6-4f6e-8f98-afcb7f336771 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:01:17.323615 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd5e1b24-9de6-4f6e-8f98-afcb7f336771 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:17.324111 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd5e1b24-9de6-4f6e-8f98-afcb7f336771 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:17.324553 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd5e1b24-9de6-4f6e-8f98-afcb7f336771 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:17.326030 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd5e1b24-9de6-4f6e-8f98-afcb7f336771 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:17.326535 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd5e1b24-9de6-4f6e-8f98-afcb7f336771 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:17.326978 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd5e1b24-9de6-4f6e-8f98-afcb7f336771 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:17.437745 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-876debeb-85b3-45c3-8b69-e529d884809e req-a4ba9c0b-1203-4d0b-9a75-15f1b18222bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0ba6d63-962f-4f40-9f31-760422ad4e7c", "name": "network-vif-plugged", "status": "completed", "tag": "ee3b861b-a264-4233-9abf-6688ec805a88"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:01:17.449238 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-876debeb-85b3-45c3-8b69-e529d884809e req-a4ba9c0b-1203-4d0b-9a75-15f1b18222bd service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:17.449739 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-876debeb-85b3-45c3-8b69-e529d884809e req-a4ba9c0b-1203-4d0b-9a75-15f1b18222bd service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:17.450188 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-876debeb-85b3-45c3-8b69-e529d884809e req-a4ba9c0b-1203-4d0b-9a75-15f1b18222bd service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:17.462151 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-876debeb-85b3-45c3-8b69-e529d884809e req-a4ba9c0b-1203-4d0b-9a75-15f1b18222bd service nova] Creating event network-vif-plugged:ee3b861b-a264-4233-9abf-6688ec805a88 for instance c0ba6d63-962f-4f40-9f31-760422ad4e7c on n-h2-853682-5 Oct 18 17:01:17.467621 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-876debeb-85b3-45c3-8b69-e529d884809e req-a4ba9c0b-1203-4d0b-9a75-15f1b18222bd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095366 Oct 18 17:01:17.468166 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3894/7768] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 17:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 17:01:17.485943 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fd5e1b24-9de6-4f6e-8f98-afcb7f336771 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:01:17.494373 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fd5e1b24-9de6-4f6e-8f98-afcb7f336771 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1259 microversion: 2.1 time: 0.182572 Oct 18 17:01:17.494961 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3875/7769] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:01:17 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1259 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:01:18.519120 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-1f389ee4-9283-46e5-ad19-a4b858a2fac7 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:01:18.519760 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-1f389ee4-9283-46e5-ad19-a4b858a2fac7 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:01:18.527134 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1f389ee4-9283-46e5-ad19-a4b858a2fac7 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:18.527635 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1f389ee4-9283-46e5-ad19-a4b858a2fac7 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:18.528094 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1f389ee4-9283-46e5-ad19-a4b858a2fac7 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:18.528834 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1f389ee4-9283-46e5-ad19-a4b858a2fac7 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:18.529302 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1f389ee4-9283-46e5-ad19-a4b858a2fac7 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:18.529749 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-1f389ee4-9283-46e5-ad19-a4b858a2fac7 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:18.669574 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-1f389ee4-9283-46e5-ad19-a4b858a2fac7 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:01:18.678375 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-1f389ee4-9283-46e5-ad19-a4b858a2fac7 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1259 microversion: 2.1 time: 0.164317 Oct 18 17:01:18.684119 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3895/7770] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:01:18 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:01:19.702457 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-61ebbdff-1112-45b0-9e6d-9187d299b7ac tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:01:19.703086 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-61ebbdff-1112-45b0-9e6d-9187d299b7ac tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:01:19.711201 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-61ebbdff-1112-45b0-9e6d-9187d299b7ac tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:19.711737 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-61ebbdff-1112-45b0-9e6d-9187d299b7ac tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:19.712185 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-61ebbdff-1112-45b0-9e6d-9187d299b7ac tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:19.712953 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-61ebbdff-1112-45b0-9e6d-9187d299b7ac tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:19.713418 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-61ebbdff-1112-45b0-9e6d-9187d299b7ac tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:19.713852 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-61ebbdff-1112-45b0-9e6d-9187d299b7ac tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:19.845113 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-61ebbdff-1112-45b0-9e6d-9187d299b7ac tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:01:19.852973 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-61ebbdff-1112-45b0-9e6d-9187d299b7ac tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1443 microversion: 2.1 time: 0.154495 Oct 18 17:01:19.853561 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3876/7771] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:01:19 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1443 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:01:19.875239 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-923bd5e0-39f8-468c-995f-2721aba54446 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:01:19.875876 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-923bd5e0-39f8-468c-995f-2721aba54446 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:01:19.883389 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-923bd5e0-39f8-468c-995f-2721aba54446 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:19.883892 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-923bd5e0-39f8-468c-995f-2721aba54446 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:19.884360 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-923bd5e0-39f8-468c-995f-2721aba54446 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:19.885145 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-923bd5e0-39f8-468c-995f-2721aba54446 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:19.885621 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-923bd5e0-39f8-468c-995f-2721aba54446 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:19.886063 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-923bd5e0-39f8-468c-995f-2721aba54446 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:20.025814 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-923bd5e0-39f8-468c-995f-2721aba54446 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:01:20.033740 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-923bd5e0-39f8-468c-995f-2721aba54446 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1443 microversion: 2.1 time: 0.162416 Oct 18 17:01:20.034320 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3896/7772] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:01:19 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1443 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:01:21.666612 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-63bd0b00-a236-446e-9d6f-b610e874406e req-d93992fb-86a7-4597-9942-1f6d2f93374e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0ba6d63-962f-4f40-9f31-760422ad4e7c", "tag": "ee3b861b-a264-4233-9abf-6688ec805a88"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:01:21.677378 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-63bd0b00-a236-446e-9d6f-b610e874406e req-d93992fb-86a7-4597-9942-1f6d2f93374e service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:01:21.677860 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-63bd0b00-a236-446e-9d6f-b610e874406e req-d93992fb-86a7-4597-9942-1f6d2f93374e service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:01:21.678301 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-63bd0b00-a236-446e-9d6f-b610e874406e req-d93992fb-86a7-4597-9942-1f6d2f93374e service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:01:21.696486 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-63bd0b00-a236-446e-9d6f-b610e874406e req-d93992fb-86a7-4597-9942-1f6d2f93374e service nova] Creating event network-changed:ee3b861b-a264-4233-9abf-6688ec805a88 for instance c0ba6d63-962f-4f40-9f31-760422ad4e7c on n-h2-853682-5 Oct 18 17:01:21.701894 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-63bd0b00-a236-446e-9d6f-b610e874406e req-d93992fb-86a7-4597-9942-1f6d2f93374e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038964 Oct 18 17:01:21.702622 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3877/7773] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 17:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:03:16.756862 n-d-853682-5 devstack@n-api.service[120405]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6b6d975c-54e4-4acd-8cc5-5b0cda3c3106] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 18 17:03:16.757923 n-d-853682-5 devstack@n-api.service[120405]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c870dd72-6039-47fe-83e0-90856ded1829] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 18 17:03:16.758528 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:03:16.759286 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=64 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:03:16.760758 n-d-853682-5 devstack@n-api.service[120405]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 18 17:03:16.760947 n-d-853682-5 devstack@n-api.service[120405]: Tue Oct 18 17:03:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c/action (ip 10.222.0.60) !!! Oct 18 17:03:16.767738 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d67c49ac-a681-447e-ad8c-a154ca38e5c7 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:03:16.768312 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d67c49ac-a681-447e-ad8c-a154ca38e5c7 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:03:16.777328 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d67c49ac-a681-447e-ad8c-a154ca38e5c7 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:16.777826 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d67c49ac-a681-447e-ad8c-a154ca38e5c7 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:16.778269 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d67c49ac-a681-447e-ad8c-a154ca38e5c7 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:16.778973 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d67c49ac-a681-447e-ad8c-a154ca38e5c7 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:16.779435 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d67c49ac-a681-447e-ad8c-a154ca38e5c7 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:16.779869 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d67c49ac-a681-447e-ad8c-a154ca38e5c7 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:16.804088 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-d67c49ac-a681-447e-ad8c-a154ca38e5c7 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lazy-loading 'flavor' on Instance uuid c0ba6d63-962f-4f40-9f31-760422ad4e7c {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 17:03:16.876310 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d67c49ac-a681-447e-ad8c-a154ca38e5c7 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "POST /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c/action" status: 202 len: 0 microversion: 2.1 time: 0.121361 Oct 18 17:03:16.876933 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3897/7774] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 17:03:16 2022] POST /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 17:03:16.883554 n-d-853682-5 devstack@n-api.service[120406]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6eb481dc-0a5f-4095-8691-72ce090f1ba0] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 17:03:16.884449 n-d-853682-5 devstack@n-api.service[120406]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9784c765-18ae-4d28-9be4-c2f2473b54eb] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 17:03:16.885154 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=30 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:03:16.886104 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=58 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:03:16.892429 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c55898d8-534b-4348-bb94-71ebd6fd609d tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:03:16.893196 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c55898d8-534b-4348-bb94-71ebd6fd609d tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:03:16.900756 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c55898d8-534b-4348-bb94-71ebd6fd609d tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:16.901341 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c55898d8-534b-4348-bb94-71ebd6fd609d tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:16.901814 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c55898d8-534b-4348-bb94-71ebd6fd609d tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:16.902520 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c55898d8-534b-4348-bb94-71ebd6fd609d tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:16.902982 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c55898d8-534b-4348-bb94-71ebd6fd609d tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:16.903415 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c55898d8-534b-4348-bb94-71ebd6fd609d tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:17.038359 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c55898d8-534b-4348-bb94-71ebd6fd609d tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:03:17.046886 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c55898d8-534b-4348-bb94-71ebd6fd609d tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1568 microversion: 2.1 time: 0.165267 Oct 18 17:03:17.047466 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3878/7775] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:03:16 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:03:18.071088 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ac0022f0-b84c-4269-aa1c-57cfe0856447 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:03:18.071841 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ac0022f0-b84c-4269-aa1c-57cfe0856447 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:03:18.082564 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ac0022f0-b84c-4269-aa1c-57cfe0856447 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:18.083121 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ac0022f0-b84c-4269-aa1c-57cfe0856447 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:18.083581 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ac0022f0-b84c-4269-aa1c-57cfe0856447 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:18.084326 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ac0022f0-b84c-4269-aa1c-57cfe0856447 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:18.084823 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ac0022f0-b84c-4269-aa1c-57cfe0856447 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:18.085279 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ac0022f0-b84c-4269-aa1c-57cfe0856447 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:18.093691 n-d-853682-5 devstack@n-api.service[120405]: INFO oslo.messaging._drivers.impl_rabbit [-] [6b6d975c-54e4-4acd-8cc5-5b0cda3c3106] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 43356. Oct 18 17:03:18.103798 n-d-853682-5 devstack@n-api.service[120405]: INFO oslo.messaging._drivers.impl_rabbit [-] [c870dd72-6039-47fe-83e0-90856ded1829] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 43358. Oct 18 17:03:18.223904 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ac0022f0-b84c-4269-aa1c-57cfe0856447 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:03:18.232421 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ac0022f0-b84c-4269-aa1c-57cfe0856447 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1568 microversion: 2.1 time: 0.165693 Oct 18 17:03:18.233024 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3898/7776] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:03:18 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:03:19.256015 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-859aae3c-eea2-4d69-aebc-7d5641b531db tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:03:19.256620 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-859aae3c-eea2-4d69-aebc-7d5641b531db tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:03:19.265879 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-859aae3c-eea2-4d69-aebc-7d5641b531db tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:19.266363 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-859aae3c-eea2-4d69-aebc-7d5641b531db tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:19.266791 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-859aae3c-eea2-4d69-aebc-7d5641b531db tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:19.267480 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-859aae3c-eea2-4d69-aebc-7d5641b531db tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:19.267936 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-859aae3c-eea2-4d69-aebc-7d5641b531db tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:19.268358 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-859aae3c-eea2-4d69-aebc-7d5641b531db tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:19.274682 n-d-853682-5 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [-] [6eb481dc-0a5f-4095-8691-72ce090f1ba0] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 43362. Oct 18 17:03:19.275478 n-d-853682-5 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [-] [9784c765-18ae-4d28-9be4-c2f2473b54eb] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 43364. Oct 18 17:03:19.403661 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-859aae3c-eea2-4d69-aebc-7d5641b531db tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:03:19.411638 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-859aae3c-eea2-4d69-aebc-7d5641b531db tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1568 microversion: 2.1 time: 0.159652 Oct 18 17:03:19.412215 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3879/7777] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:03:19 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:03:20.435578 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-fd8aa48a-0a2a-4980-a133-42d76c2f6a55 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:03:20.436222 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-fd8aa48a-0a2a-4980-a133-42d76c2f6a55 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:03:20.443109 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fd8aa48a-0a2a-4980-a133-42d76c2f6a55 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:20.443614 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fd8aa48a-0a2a-4980-a133-42d76c2f6a55 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:20.444075 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fd8aa48a-0a2a-4980-a133-42d76c2f6a55 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:20.444796 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fd8aa48a-0a2a-4980-a133-42d76c2f6a55 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:20.445296 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fd8aa48a-0a2a-4980-a133-42d76c2f6a55 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:20.445743 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-fd8aa48a-0a2a-4980-a133-42d76c2f6a55 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:20.597440 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-fd8aa48a-0a2a-4980-a133-42d76c2f6a55 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:03:20.605547 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-fd8aa48a-0a2a-4980-a133-42d76c2f6a55 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1568 microversion: 2.1 time: 0.173853 Oct 18 17:03:20.606181 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3899/7778] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:03:20 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:03:21.629037 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bb954912-b208-4d9b-9ae5-db429c3e1f08 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:03:21.629708 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bb954912-b208-4d9b-9ae5-db429c3e1f08 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:03:21.636497 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb954912-b208-4d9b-9ae5-db429c3e1f08 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:21.637016 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb954912-b208-4d9b-9ae5-db429c3e1f08 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:21.637452 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb954912-b208-4d9b-9ae5-db429c3e1f08 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:21.638139 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb954912-b208-4d9b-9ae5-db429c3e1f08 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:21.638688 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb954912-b208-4d9b-9ae5-db429c3e1f08 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:21.639117 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb954912-b208-4d9b-9ae5-db429c3e1f08 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:21.774752 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bb954912-b208-4d9b-9ae5-db429c3e1f08 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:03:21.783210 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bb954912-b208-4d9b-9ae5-db429c3e1f08 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1568 microversion: 2.1 time: 0.158124 Oct 18 17:03:21.783796 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3880/7779] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:03:21 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:03:22.807043 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-004b734f-f050-4b5f-af84-b2305b0660bf tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:03:22.807671 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-004b734f-f050-4b5f-af84-b2305b0660bf tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:03:22.814532 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-004b734f-f050-4b5f-af84-b2305b0660bf tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:22.815032 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-004b734f-f050-4b5f-af84-b2305b0660bf tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:22.815480 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-004b734f-f050-4b5f-af84-b2305b0660bf tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:22.816188 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-004b734f-f050-4b5f-af84-b2305b0660bf tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:22.816660 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-004b734f-f050-4b5f-af84-b2305b0660bf tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:22.817139 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-004b734f-f050-4b5f-af84-b2305b0660bf tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:22.947328 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-004b734f-f050-4b5f-af84-b2305b0660bf tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:03:22.955695 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-004b734f-f050-4b5f-af84-b2305b0660bf tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1568 microversion: 2.1 time: 0.152595 Oct 18 17:03:22.956271 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3900/7780] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:03:22 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:03:23.979701 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ac5eee35-ae8e-47c6-8744-621b07dc2ae0 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:03:23.980254 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ac5eee35-ae8e-47c6-8744-621b07dc2ae0 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:03:23.987912 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac5eee35-ae8e-47c6-8744-621b07dc2ae0 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:23.988403 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac5eee35-ae8e-47c6-8744-621b07dc2ae0 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:23.988892 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac5eee35-ae8e-47c6-8744-621b07dc2ae0 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:23.989598 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac5eee35-ae8e-47c6-8744-621b07dc2ae0 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:23.990062 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac5eee35-ae8e-47c6-8744-621b07dc2ae0 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:23.990502 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac5eee35-ae8e-47c6-8744-621b07dc2ae0 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:24.126654 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ac5eee35-ae8e-47c6-8744-621b07dc2ae0 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:03:24.135270 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ac5eee35-ae8e-47c6-8744-621b07dc2ae0 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1568 microversion: 2.1 time: 0.159606 Oct 18 17:03:24.135886 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3881/7781] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:03:23 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:03:25.160140 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-53bcc09d-80f2-49f6-b02c-9882a4186235 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:03:25.160753 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-53bcc09d-80f2-49f6-b02c-9882a4186235 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:03:25.167588 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-53bcc09d-80f2-49f6-b02c-9882a4186235 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:25.168079 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-53bcc09d-80f2-49f6-b02c-9882a4186235 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:25.168526 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-53bcc09d-80f2-49f6-b02c-9882a4186235 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:25.169249 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-53bcc09d-80f2-49f6-b02c-9882a4186235 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:25.169719 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-53bcc09d-80f2-49f6-b02c-9882a4186235 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:25.170157 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-53bcc09d-80f2-49f6-b02c-9882a4186235 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:25.303950 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-53bcc09d-80f2-49f6-b02c-9882a4186235 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:03:25.312101 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-53bcc09d-80f2-49f6-b02c-9882a4186235 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1568 microversion: 2.1 time: 0.155925 Oct 18 17:03:25.312906 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3901/7782] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:03:25 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:03:26.335680 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-332a3313-d281-4d52-a6a0-4ef53427b27f tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:03:26.336298 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-332a3313-d281-4d52-a6a0-4ef53427b27f tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:03:26.343719 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-332a3313-d281-4d52-a6a0-4ef53427b27f tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:26.344202 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-332a3313-d281-4d52-a6a0-4ef53427b27f tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:26.344642 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-332a3313-d281-4d52-a6a0-4ef53427b27f tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:26.345367 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-332a3313-d281-4d52-a6a0-4ef53427b27f tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:26.345831 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-332a3313-d281-4d52-a6a0-4ef53427b27f tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:26.346256 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-332a3313-d281-4d52-a6a0-4ef53427b27f tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:26.485451 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-332a3313-d281-4d52-a6a0-4ef53427b27f tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:03:26.493285 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-332a3313-d281-4d52-a6a0-4ef53427b27f tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1568 microversion: 2.1 time: 0.161605 Oct 18 17:03:26.493868 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3882/7783] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:03:26 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:03:27.516558 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-2233b14e-faf8-477b-a3e5-b8e9b614c12f tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:03:27.517211 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-2233b14e-faf8-477b-a3e5-b8e9b614c12f tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:03:27.524367 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2233b14e-faf8-477b-a3e5-b8e9b614c12f tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:27.525019 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2233b14e-faf8-477b-a3e5-b8e9b614c12f tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:27.525484 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2233b14e-faf8-477b-a3e5-b8e9b614c12f tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:27.526203 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2233b14e-faf8-477b-a3e5-b8e9b614c12f tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:27.526682 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2233b14e-faf8-477b-a3e5-b8e9b614c12f tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:27.527129 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-2233b14e-faf8-477b-a3e5-b8e9b614c12f tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:27.660098 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-2233b14e-faf8-477b-a3e5-b8e9b614c12f tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:03:27.668655 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-2233b14e-faf8-477b-a3e5-b8e9b614c12f tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1568 microversion: 2.1 time: 0.155926 Oct 18 17:03:27.669907 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3902/7784] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:03:27 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:03:28.012675 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-c83bc1d9-3f2b-4833-af53-e749f0338342 req-a9816075-0dd1-4718-a68f-be9abd22c24f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0ba6d63-962f-4f40-9f31-760422ad4e7c", "name": "network-vif-unplugged", "status": "completed", "tag": "ee3b861b-a264-4233-9abf-6688ec805a88"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:03:28.024219 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c83bc1d9-3f2b-4833-af53-e749f0338342 req-a9816075-0dd1-4718-a68f-be9abd22c24f service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:28.024735 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c83bc1d9-3f2b-4833-af53-e749f0338342 req-a9816075-0dd1-4718-a68f-be9abd22c24f service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:28.025203 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c83bc1d9-3f2b-4833-af53-e749f0338342 req-a9816075-0dd1-4718-a68f-be9abd22c24f service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:28.036664 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-c83bc1d9-3f2b-4833-af53-e749f0338342 req-a9816075-0dd1-4718-a68f-be9abd22c24f service nova] Creating event network-vif-unplugged:ee3b861b-a264-4233-9abf-6688ec805a88 for instance c0ba6d63-962f-4f40-9f31-760422ad4e7c on n-h2-853682-5 Oct 18 17:03:28.041988 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-c83bc1d9-3f2b-4833-af53-e749f0338342 req-a9816075-0dd1-4718-a68f-be9abd22c24f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033317 Oct 18 17:03:28.042678 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3883/7785] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 17:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:03:28.692941 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-04109b04-c9cb-4887-9a28-8638745fc2ac tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:03:28.693829 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-04109b04-c9cb-4887-9a28-8638745fc2ac tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:03:28.700681 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-04109b04-c9cb-4887-9a28-8638745fc2ac tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:28.701207 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-04109b04-c9cb-4887-9a28-8638745fc2ac tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:28.701657 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-04109b04-c9cb-4887-9a28-8638745fc2ac tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:28.702360 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-04109b04-c9cb-4887-9a28-8638745fc2ac tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:28.702826 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-04109b04-c9cb-4887-9a28-8638745fc2ac tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:28.703261 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-04109b04-c9cb-4887-9a28-8638745fc2ac tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:28.836683 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-04109b04-c9cb-4887-9a28-8638745fc2ac tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:03:28.845161 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-04109b04-c9cb-4887-9a28-8638745fc2ac tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1568 microversion: 2.1 time: 0.156108 Oct 18 17:03:28.845738 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3903/7786] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:03:28 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:03:29.869169 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-32e9bab3-a2a5-4ab2-b4c1-9f3ba99326f5 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:03:29.869866 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-32e9bab3-a2a5-4ab2-b4c1-9f3ba99326f5 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:03:29.876768 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32e9bab3-a2a5-4ab2-b4c1-9f3ba99326f5 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:29.877279 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32e9bab3-a2a5-4ab2-b4c1-9f3ba99326f5 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:29.877710 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32e9bab3-a2a5-4ab2-b4c1-9f3ba99326f5 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:29.878396 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32e9bab3-a2a5-4ab2-b4c1-9f3ba99326f5 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:29.878848 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32e9bab3-a2a5-4ab2-b4c1-9f3ba99326f5 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:29.879269 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32e9bab3-a2a5-4ab2-b4c1-9f3ba99326f5 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:30.020599 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-32e9bab3-a2a5-4ab2-b4c1-9f3ba99326f5 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:03:30.029640 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-32e9bab3-a2a5-4ab2-b4c1-9f3ba99326f5 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1568 microversion: 2.1 time: 0.165656 Oct 18 17:03:30.030230 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3884/7787] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:03:29 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:03:30.060160 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-2596336a-ea96-483b-aea2-58a4ea85bf4e req-866a4133-35f6-4861-889f-6058b08d6364 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0ba6d63-962f-4f40-9f31-760422ad4e7c", "tag": "ee3b861b-a264-4233-9abf-6688ec805a88"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:03:30.070454 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-2596336a-ea96-483b-aea2-58a4ea85bf4e req-866a4133-35f6-4861-889f-6058b08d6364 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:30.071030 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-2596336a-ea96-483b-aea2-58a4ea85bf4e req-866a4133-35f6-4861-889f-6058b08d6364 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:30.071569 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-2596336a-ea96-483b-aea2-58a4ea85bf4e req-866a4133-35f6-4861-889f-6058b08d6364 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:30.083779 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-2596336a-ea96-483b-aea2-58a4ea85bf4e req-866a4133-35f6-4861-889f-6058b08d6364 service nova] Creating event network-changed:ee3b861b-a264-4233-9abf-6688ec805a88 for instance c0ba6d63-962f-4f40-9f31-760422ad4e7c on n-h2-853682-5 Oct 18 17:03:30.089110 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-2596336a-ea96-483b-aea2-58a4ea85bf4e req-866a4133-35f6-4861-889f-6058b08d6364 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032727 Oct 18 17:03:30.089724 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3904/7788] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 17:03:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:03:31.053926 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b6b6809f-9b8d-40a1-9c53-2f868df7b607 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:03:31.054798 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b6b6809f-9b8d-40a1-9c53-2f868df7b607 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:03:31.062258 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b6b6809f-9b8d-40a1-9c53-2f868df7b607 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:31.062839 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b6b6809f-9b8d-40a1-9c53-2f868df7b607 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:31.063364 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b6b6809f-9b8d-40a1-9c53-2f868df7b607 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:31.064169 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b6b6809f-9b8d-40a1-9c53-2f868df7b607 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:31.064669 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b6b6809f-9b8d-40a1-9c53-2f868df7b607 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:31.065141 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b6b6809f-9b8d-40a1-9c53-2f868df7b607 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:31.198824 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b6b6809f-9b8d-40a1-9c53-2f868df7b607 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:03:31.206903 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b6b6809f-9b8d-40a1-9c53-2f868df7b607 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1568 microversion: 2.1 time: 0.156981 Oct 18 17:03:31.207486 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3885/7789] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:03:31 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:03:32.231082 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-08174799-0023-4773-b586-78f270e40acf tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:03:32.232321 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-08174799-0023-4773-b586-78f270e40acf tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:03:32.238652 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-08174799-0023-4773-b586-78f270e40acf tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:32.239152 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-08174799-0023-4773-b586-78f270e40acf tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:32.239608 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-08174799-0023-4773-b586-78f270e40acf tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:32.240346 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-08174799-0023-4773-b586-78f270e40acf tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:32.240845 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-08174799-0023-4773-b586-78f270e40acf tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:32.241297 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-08174799-0023-4773-b586-78f270e40acf tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:32.375885 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-08174799-0023-4773-b586-78f270e40acf tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:03:32.383631 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-08174799-0023-4773-b586-78f270e40acf tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1509 microversion: 2.1 time: 0.158076 Oct 18 17:03:32.384199 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3905/7790] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:03:32 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:03:32.406953 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fe22ba9f-c7e2-465f-923c-fc7b6d7c03a6 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:03:32.407593 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fe22ba9f-c7e2-465f-923c-fc7b6d7c03a6 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:03:32.414637 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe22ba9f-c7e2-465f-923c-fc7b6d7c03a6 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:32.415130 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe22ba9f-c7e2-465f-923c-fc7b6d7c03a6 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:32.415577 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe22ba9f-c7e2-465f-923c-fc7b6d7c03a6 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:32.416281 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe22ba9f-c7e2-465f-923c-fc7b6d7c03a6 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:32.416744 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe22ba9f-c7e2-465f-923c-fc7b6d7c03a6 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:32.417221 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe22ba9f-c7e2-465f-923c-fc7b6d7c03a6 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:32.500533 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fe22ba9f-c7e2-465f-923c-fc7b6d7c03a6 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120406) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 18 17:03:32.567903 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fe22ba9f-c7e2-465f-923c-fc7b6d7c03a6 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "POST /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c/action" status: 202 len: 0 microversion: 2.1 time: 0.165391 Oct 18 17:03:32.568718 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3886/7791] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 17:03:32 2022] POST /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 17:03:32.577279 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-987bfd47-332a-49b4-a756-273d2caaa9ec tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:03:32.577925 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-987bfd47-332a-49b4-a756-273d2caaa9ec tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:03:32.583816 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-987bfd47-332a-49b4-a756-273d2caaa9ec tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:32.584323 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-987bfd47-332a-49b4-a756-273d2caaa9ec tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:32.584778 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-987bfd47-332a-49b4-a756-273d2caaa9ec tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:32.585534 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-987bfd47-332a-49b4-a756-273d2caaa9ec tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:32.585999 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-987bfd47-332a-49b4-a756-273d2caaa9ec tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:32.586449 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-987bfd47-332a-49b4-a756-273d2caaa9ec tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:32.725852 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-987bfd47-332a-49b4-a756-273d2caaa9ec tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:03:32.733924 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-987bfd47-332a-49b4-a756-273d2caaa9ec tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1517 microversion: 2.1 time: 0.161049 Oct 18 17:03:32.734517 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3906/7792] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:03:32 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:03:33.758321 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-306ad377-704c-4949-9db4-517fd21b25b9 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:03:33.759000 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-306ad377-704c-4949-9db4-517fd21b25b9 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:03:33.766203 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-306ad377-704c-4949-9db4-517fd21b25b9 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:33.766686 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-306ad377-704c-4949-9db4-517fd21b25b9 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:33.767122 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-306ad377-704c-4949-9db4-517fd21b25b9 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:33.767822 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-306ad377-704c-4949-9db4-517fd21b25b9 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:33.768279 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-306ad377-704c-4949-9db4-517fd21b25b9 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:33.768701 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-306ad377-704c-4949-9db4-517fd21b25b9 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:33.905264 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-306ad377-704c-4949-9db4-517fd21b25b9 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:03:33.913922 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-306ad377-704c-4949-9db4-517fd21b25b9 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1519 microversion: 2.1 time: 0.160214 Oct 18 17:03:33.914539 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3887/7793] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:03:33 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:03:34.938153 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-83a74491-a195-4260-9450-386b3b1389f2 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:03:34.938766 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-83a74491-a195-4260-9450-386b3b1389f2 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:03:34.945909 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-83a74491-a195-4260-9450-386b3b1389f2 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:34.946355 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-83a74491-a195-4260-9450-386b3b1389f2 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:34.946809 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-83a74491-a195-4260-9450-386b3b1389f2 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:34.947830 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-83a74491-a195-4260-9450-386b3b1389f2 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:34.948303 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-83a74491-a195-4260-9450-386b3b1389f2 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:34.948745 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-83a74491-a195-4260-9450-386b3b1389f2 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:35.090082 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-83a74491-a195-4260-9450-386b3b1389f2 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:03:35.098765 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-83a74491-a195-4260-9450-386b3b1389f2 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1519 microversion: 2.1 time: 0.164474 Oct 18 17:03:35.099352 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3907/7794] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:03:34 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:03:36.122645 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-32f63bd2-ff02-477c-9c47-d070facc9b66 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:03:36.123240 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-32f63bd2-ff02-477c-9c47-d070facc9b66 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:03:36.130292 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32f63bd2-ff02-477c-9c47-d070facc9b66 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:36.130883 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32f63bd2-ff02-477c-9c47-d070facc9b66 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:36.131332 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32f63bd2-ff02-477c-9c47-d070facc9b66 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:36.132131 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32f63bd2-ff02-477c-9c47-d070facc9b66 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:36.132683 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32f63bd2-ff02-477c-9c47-d070facc9b66 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:36.133173 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32f63bd2-ff02-477c-9c47-d070facc9b66 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:36.266092 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-32f63bd2-ff02-477c-9c47-d070facc9b66 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:03:36.274580 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-32f63bd2-ff02-477c-9c47-d070facc9b66 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1519 microversion: 2.1 time: 0.156022 Oct 18 17:03:36.275171 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3888/7795] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:03:36 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:03:37.298887 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6c8975a3-522d-428b-a8d6-936551b79de3 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:03:37.299564 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6c8975a3-522d-428b-a8d6-936551b79de3 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:03:37.306429 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6c8975a3-522d-428b-a8d6-936551b79de3 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:37.306925 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6c8975a3-522d-428b-a8d6-936551b79de3 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:37.307376 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6c8975a3-522d-428b-a8d6-936551b79de3 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:37.308086 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6c8975a3-522d-428b-a8d6-936551b79de3 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:37.308554 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6c8975a3-522d-428b-a8d6-936551b79de3 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:37.309197 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6c8975a3-522d-428b-a8d6-936551b79de3 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:37.451179 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6c8975a3-522d-428b-a8d6-936551b79de3 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:03:37.459120 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6c8975a3-522d-428b-a8d6-936551b79de3 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1519 microversion: 2.1 time: 0.164672 Oct 18 17:03:37.459698 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3908/7796] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:03:37 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:03:38.483322 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5bbba9d0-2ff9-41b0-951f-51a750ee8109 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:03:38.483882 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5bbba9d0-2ff9-41b0-951f-51a750ee8109 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:03:38.491758 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5bbba9d0-2ff9-41b0-951f-51a750ee8109 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:38.492265 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5bbba9d0-2ff9-41b0-951f-51a750ee8109 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:38.492710 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5bbba9d0-2ff9-41b0-951f-51a750ee8109 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:38.493462 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5bbba9d0-2ff9-41b0-951f-51a750ee8109 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:38.493924 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5bbba9d0-2ff9-41b0-951f-51a750ee8109 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:38.494362 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5bbba9d0-2ff9-41b0-951f-51a750ee8109 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:38.635995 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5bbba9d0-2ff9-41b0-951f-51a750ee8109 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:03:38.643867 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5bbba9d0-2ff9-41b0-951f-51a750ee8109 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1519 microversion: 2.1 time: 0.165053 Oct 18 17:03:38.644444 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3889/7797] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:03:38 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:03:39.667599 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f82764ef-1de8-4ba7-90c2-ebede22c17b4 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:03:39.668517 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f82764ef-1de8-4ba7-90c2-ebede22c17b4 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:03:39.676386 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f82764ef-1de8-4ba7-90c2-ebede22c17b4 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:39.676954 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f82764ef-1de8-4ba7-90c2-ebede22c17b4 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:39.677380 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f82764ef-1de8-4ba7-90c2-ebede22c17b4 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:39.678221 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f82764ef-1de8-4ba7-90c2-ebede22c17b4 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:39.678831 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f82764ef-1de8-4ba7-90c2-ebede22c17b4 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:39.679175 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f82764ef-1de8-4ba7-90c2-ebede22c17b4 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:39.879273 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-f82764ef-1de8-4ba7-90c2-ebede22c17b4 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:03:39.888465 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f82764ef-1de8-4ba7-90c2-ebede22c17b4 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1575 microversion: 2.1 time: 0.224722 Oct 18 17:03:39.901756 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3909/7798] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:03:39 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1575 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:03:39.983917 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-490628d2-b104-4ac9-8bda-5229772898de req-6da2eb72-01b2-4cde-bd7c-0d04e5c7ebef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0ba6d63-962f-4f40-9f31-760422ad4e7c", "tag": "ee3b861b-a264-4233-9abf-6688ec805a88"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:03:39.994384 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-490628d2-b104-4ac9-8bda-5229772898de req-6da2eb72-01b2-4cde-bd7c-0d04e5c7ebef service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:39.994869 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-490628d2-b104-4ac9-8bda-5229772898de req-6da2eb72-01b2-4cde-bd7c-0d04e5c7ebef service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:39.995311 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-490628d2-b104-4ac9-8bda-5229772898de req-6da2eb72-01b2-4cde-bd7c-0d04e5c7ebef service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:40.010884 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-490628d2-b104-4ac9-8bda-5229772898de req-6da2eb72-01b2-4cde-bd7c-0d04e5c7ebef service nova] Creating event network-changed:ee3b861b-a264-4233-9abf-6688ec805a88 for instance c0ba6d63-962f-4f40-9f31-760422ad4e7c on n-h1-853682-5 Oct 18 17:03:40.015947 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-490628d2-b104-4ac9-8bda-5229772898de req-6da2eb72-01b2-4cde-bd7c-0d04e5c7ebef service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036435 Oct 18 17:03:40.016971 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3890/7799] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 17:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:03:40.913811 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-a5b44712-a8a0-477a-88ef-0977ee4b259c tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:03:40.914445 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-a5b44712-a8a0-477a-88ef-0977ee4b259c tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:03:40.921589 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a5b44712-a8a0-477a-88ef-0977ee4b259c tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:40.922093 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a5b44712-a8a0-477a-88ef-0977ee4b259c tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:40.922552 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a5b44712-a8a0-477a-88ef-0977ee4b259c tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:40.923270 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a5b44712-a8a0-477a-88ef-0977ee4b259c tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:40.923745 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a5b44712-a8a0-477a-88ef-0977ee4b259c tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:40.924193 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-a5b44712-a8a0-477a-88ef-0977ee4b259c tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:41.055242 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-a5b44712-a8a0-477a-88ef-0977ee4b259c tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:03:41.063524 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-a5b44712-a8a0-477a-88ef-0977ee4b259c tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1575 microversion: 2.1 time: 0.153693 Oct 18 17:03:41.064210 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3910/7800] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:03:40 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:03:42.088208 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e491298a-bf24-421f-a1b7-e1a322dcb55b tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:03:42.088980 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e491298a-bf24-421f-a1b7-e1a322dcb55b tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:03:42.096703 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e491298a-bf24-421f-a1b7-e1a322dcb55b tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:42.097225 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e491298a-bf24-421f-a1b7-e1a322dcb55b tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:42.097667 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e491298a-bf24-421f-a1b7-e1a322dcb55b tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:42.098365 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e491298a-bf24-421f-a1b7-e1a322dcb55b tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:42.098831 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e491298a-bf24-421f-a1b7-e1a322dcb55b tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:42.099258 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e491298a-bf24-421f-a1b7-e1a322dcb55b tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:42.348863 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e491298a-bf24-421f-a1b7-e1a322dcb55b tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:03:42.356830 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e491298a-bf24-421f-a1b7-e1a322dcb55b tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1575 microversion: 2.1 time: 0.272885 Oct 18 17:03:42.357430 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3891/7801] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:03:42 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1575 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:03:43.380333 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ef45ee3e-5fb6-4299-821c-fd0b9c321491 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:03:43.380910 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ef45ee3e-5fb6-4299-821c-fd0b9c321491 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:03:43.387767 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ef45ee3e-5fb6-4299-821c-fd0b9c321491 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:43.388261 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ef45ee3e-5fb6-4299-821c-fd0b9c321491 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:43.388711 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ef45ee3e-5fb6-4299-821c-fd0b9c321491 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:43.389440 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ef45ee3e-5fb6-4299-821c-fd0b9c321491 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:43.389914 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ef45ee3e-5fb6-4299-821c-fd0b9c321491 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:43.390353 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ef45ee3e-5fb6-4299-821c-fd0b9c321491 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:43.520382 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ef45ee3e-5fb6-4299-821c-fd0b9c321491 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:03:43.528363 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ef45ee3e-5fb6-4299-821c-fd0b9c321491 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1575 microversion: 2.1 time: 0.152012 Oct 18 17:03:43.529472 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3911/7802] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:03:43 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:03:44.551719 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9f319133-7fc5-4c58-be7e-e0afe71dbccc tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:03:44.552325 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9f319133-7fc5-4c58-be7e-e0afe71dbccc tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:03:44.559296 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f319133-7fc5-4c58-be7e-e0afe71dbccc tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:44.559792 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f319133-7fc5-4c58-be7e-e0afe71dbccc tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:44.560884 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f319133-7fc5-4c58-be7e-e0afe71dbccc tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:44.561583 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f319133-7fc5-4c58-be7e-e0afe71dbccc tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:44.562037 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f319133-7fc5-4c58-be7e-e0afe71dbccc tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:44.562461 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f319133-7fc5-4c58-be7e-e0afe71dbccc tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:44.703468 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9f319133-7fc5-4c58-be7e-e0afe71dbccc tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:03:44.711579 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9f319133-7fc5-4c58-be7e-e0afe71dbccc tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1575 microversion: 2.1 time: 0.163672 Oct 18 17:03:44.712156 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3892/7803] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:03:44 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:03:45.735096 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3061c46f-7568-4d9f-8b22-f53de72e43a1 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:03:45.735726 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3061c46f-7568-4d9f-8b22-f53de72e43a1 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:03:45.742617 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3061c46f-7568-4d9f-8b22-f53de72e43a1 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:45.743105 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3061c46f-7568-4d9f-8b22-f53de72e43a1 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:45.743552 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3061c46f-7568-4d9f-8b22-f53de72e43a1 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:45.744248 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3061c46f-7568-4d9f-8b22-f53de72e43a1 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:45.744724 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3061c46f-7568-4d9f-8b22-f53de72e43a1 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:45.745187 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3061c46f-7568-4d9f-8b22-f53de72e43a1 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:45.749809 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:03:45.882757 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-3061c46f-7568-4d9f-8b22-f53de72e43a1 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:03:45.891862 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3061c46f-7568-4d9f-8b22-f53de72e43a1 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1575 microversion: 2.1 time: 0.160689 Oct 18 17:03:45.892451 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3912/7804] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:03:45 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:03:46.914475 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bb4d0c30-cedc-4602-b1fd-df8384d3c1d5 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:03:46.915101 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bb4d0c30-cedc-4602-b1fd-df8384d3c1d5 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:03:46.917988 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:03:46.923409 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb4d0c30-cedc-4602-b1fd-df8384d3c1d5 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:46.923897 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb4d0c30-cedc-4602-b1fd-df8384d3c1d5 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:46.924338 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb4d0c30-cedc-4602-b1fd-df8384d3c1d5 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:46.925067 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb4d0c30-cedc-4602-b1fd-df8384d3c1d5 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:46.925530 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb4d0c30-cedc-4602-b1fd-df8384d3c1d5 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:46.925961 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb4d0c30-cedc-4602-b1fd-df8384d3c1d5 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:46.931028 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:03:47.064329 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bb4d0c30-cedc-4602-b1fd-df8384d3c1d5 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:03:47.072174 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bb4d0c30-cedc-4602-b1fd-df8384d3c1d5 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1575 microversion: 2.1 time: 0.161701 Oct 18 17:03:47.072752 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3893/7805] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:03:46 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:03:48.097903 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0ce299cf-783a-4b93-ae4f-d9f074126091 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:03:48.098539 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0ce299cf-783a-4b93-ae4f-d9f074126091 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:03:48.100423 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=33 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:03:48.105721 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0ce299cf-783a-4b93-ae4f-d9f074126091 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:48.106223 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0ce299cf-783a-4b93-ae4f-d9f074126091 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:48.106674 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0ce299cf-783a-4b93-ae4f-d9f074126091 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:48.108027 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0ce299cf-783a-4b93-ae4f-d9f074126091 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:48.108500 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0ce299cf-783a-4b93-ae4f-d9f074126091 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:48.108973 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-0ce299cf-783a-4b93-ae4f-d9f074126091 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:48.238996 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0ce299cf-783a-4b93-ae4f-d9f074126091 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:03:48.246737 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0ce299cf-783a-4b93-ae4f-d9f074126091 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1575 microversion: 2.1 time: 0.153056 Oct 18 17:03:48.247314 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3913/7806] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:03:48 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:03:49.270561 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7cbe793e-bf87-470a-8b77-12d3519ea18f tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:03:49.271187 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7cbe793e-bf87-470a-8b77-12d3519ea18f tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:03:49.278016 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7cbe793e-bf87-470a-8b77-12d3519ea18f tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:49.278505 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7cbe793e-bf87-470a-8b77-12d3519ea18f tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:49.278950 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7cbe793e-bf87-470a-8b77-12d3519ea18f tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:49.279646 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7cbe793e-bf87-470a-8b77-12d3519ea18f tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:49.280104 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7cbe793e-bf87-470a-8b77-12d3519ea18f tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:49.280538 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7cbe793e-bf87-470a-8b77-12d3519ea18f tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:49.415201 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7cbe793e-bf87-470a-8b77-12d3519ea18f tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:03:49.423626 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7cbe793e-bf87-470a-8b77-12d3519ea18f tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1575 microversion: 2.1 time: 0.157367 Oct 18 17:03:49.424210 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3894/7807] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:03:49 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:03:50.446937 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-99e59e4f-5460-473d-8125-c39020266ee9 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:03:50.447625 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-99e59e4f-5460-473d-8125-c39020266ee9 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:03:50.454459 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-99e59e4f-5460-473d-8125-c39020266ee9 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:50.454952 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-99e59e4f-5460-473d-8125-c39020266ee9 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:50.455399 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-99e59e4f-5460-473d-8125-c39020266ee9 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:50.456110 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-99e59e4f-5460-473d-8125-c39020266ee9 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:50.456574 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-99e59e4f-5460-473d-8125-c39020266ee9 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:50.457035 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-99e59e4f-5460-473d-8125-c39020266ee9 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:50.590603 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-99e59e4f-5460-473d-8125-c39020266ee9 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:03:50.598457 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-99e59e4f-5460-473d-8125-c39020266ee9 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1575 microversion: 2.1 time: 0.155559 Oct 18 17:03:50.599024 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3914/7808] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:03:50 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:03:51.622379 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ec805cde-1b86-4bab-aee7-5b21db1b9b66 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:03:51.622993 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ec805cde-1b86-4bab-aee7-5b21db1b9b66 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:03:51.629890 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec805cde-1b86-4bab-aee7-5b21db1b9b66 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:51.630369 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec805cde-1b86-4bab-aee7-5b21db1b9b66 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:51.630799 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec805cde-1b86-4bab-aee7-5b21db1b9b66 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:51.631481 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec805cde-1b86-4bab-aee7-5b21db1b9b66 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:51.631960 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec805cde-1b86-4bab-aee7-5b21db1b9b66 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:51.632383 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec805cde-1b86-4bab-aee7-5b21db1b9b66 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:51.763701 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ec805cde-1b86-4bab-aee7-5b21db1b9b66 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:03:51.771483 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ec805cde-1b86-4bab-aee7-5b21db1b9b66 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1575 microversion: 2.1 time: 0.153013 Oct 18 17:03:51.772062 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3895/7809] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:03:51 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:03:52.555512 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-82fafeb8-a221-40a5-bb41-1892f3759548 req-9ee2a9b3-af9e-4aef-8497-4fa9709bb718 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0ba6d63-962f-4f40-9f31-760422ad4e7c", "name": "network-vif-plugged", "status": "completed", "tag": "ee3b861b-a264-4233-9abf-6688ec805a88"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:03:52.566811 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-82fafeb8-a221-40a5-bb41-1892f3759548 req-9ee2a9b3-af9e-4aef-8497-4fa9709bb718 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:52.567391 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-82fafeb8-a221-40a5-bb41-1892f3759548 req-9ee2a9b3-af9e-4aef-8497-4fa9709bb718 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:52.567849 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-82fafeb8-a221-40a5-bb41-1892f3759548 req-9ee2a9b3-af9e-4aef-8497-4fa9709bb718 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:52.579720 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-82fafeb8-a221-40a5-bb41-1892f3759548 req-9ee2a9b3-af9e-4aef-8497-4fa9709bb718 service nova] Creating event network-vif-plugged:ee3b861b-a264-4233-9abf-6688ec805a88 for instance c0ba6d63-962f-4f40-9f31-760422ad4e7c on n-h1-853682-5 Oct 18 17:03:52.584858 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-82fafeb8-a221-40a5-bb41-1892f3759548 req-9ee2a9b3-af9e-4aef-8497-4fa9709bb718 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033327 Oct 18 17:03:52.585657 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3915/7810] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 17:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:03:52.795227 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7897389e-6d92-428b-b5c3-442d5c1a7d99 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:03:52.795878 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7897389e-6d92-428b-b5c3-442d5c1a7d99 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:03:52.803756 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7897389e-6d92-428b-b5c3-442d5c1a7d99 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:52.804248 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7897389e-6d92-428b-b5c3-442d5c1a7d99 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:52.804711 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7897389e-6d92-428b-b5c3-442d5c1a7d99 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:52.805429 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7897389e-6d92-428b-b5c3-442d5c1a7d99 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:52.805891 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7897389e-6d92-428b-b5c3-442d5c1a7d99 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:52.806323 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7897389e-6d92-428b-b5c3-442d5c1a7d99 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:52.944161 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7897389e-6d92-428b-b5c3-442d5c1a7d99 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:03:52.951939 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7897389e-6d92-428b-b5c3-442d5c1a7d99 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1575 microversion: 2.1 time: 0.160618 Oct 18 17:03:52.952514 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3896/7811] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:03:52 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:03:53.976557 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-be413452-1589-4782-aa6d-1073dfe3c874 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:03:53.977228 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-be413452-1589-4782-aa6d-1073dfe3c874 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:03:53.983519 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-be413452-1589-4782-aa6d-1073dfe3c874 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:53.984021 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-be413452-1589-4782-aa6d-1073dfe3c874 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:53.984479 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-be413452-1589-4782-aa6d-1073dfe3c874 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:53.985218 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-be413452-1589-4782-aa6d-1073dfe3c874 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:53.985699 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-be413452-1589-4782-aa6d-1073dfe3c874 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:53.986150 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-be413452-1589-4782-aa6d-1073dfe3c874 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:54.123284 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-be413452-1589-4782-aa6d-1073dfe3c874 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:03:54.131744 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-be413452-1589-4782-aa6d-1073dfe3c874 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1575 microversion: 2.1 time: 0.160346 Oct 18 17:03:54.132346 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3916/7812] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:03:53 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:03:55.155714 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-55ce0f3e-020a-4a3d-8c70-a44af594635c tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:03:55.156329 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-55ce0f3e-020a-4a3d-8c70-a44af594635c tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:03:55.163277 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55ce0f3e-020a-4a3d-8c70-a44af594635c tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:55.163762 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55ce0f3e-020a-4a3d-8c70-a44af594635c tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:55.164202 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55ce0f3e-020a-4a3d-8c70-a44af594635c tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:55.164927 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55ce0f3e-020a-4a3d-8c70-a44af594635c tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:03:55.165388 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55ce0f3e-020a-4a3d-8c70-a44af594635c tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:03:55.165818 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55ce0f3e-020a-4a3d-8c70-a44af594635c tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:03:55.301214 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-55ce0f3e-020a-4a3d-8c70-a44af594635c tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:03:55.309192 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-55ce0f3e-020a-4a3d-8c70-a44af594635c tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1562 microversion: 2.1 time: 0.157395 Oct 18 17:03:55.309785 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3897/7813] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:03:55 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1562 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:12.040139 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=7 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:05:12.040936 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=24 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:05:12.046026 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=9 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:05:12.047306 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=29 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:05:12.048320 n-d-853682-5 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 17:05:12.048662 n-d-853682-5 devstack@n-api.service[120406]: Tue Oct 18 17:05:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.60) !!! Oct 18 17:05:12.049102 n-d-853682-5 devstack@n-api.service[120405]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 17:05:12.049401 n-d-853682-5 devstack@n-api.service[120405]: Tue Oct 18 17:05:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c (ip 10.222.0.60) !!! Oct 18 17:05:12.059484 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-80c01dd4-a699-4c2d-b8a3-7f3d91e6805a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:12.060010 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-80c01dd4-a699-4c2d-b8a3-7f3d91e6805a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:12.065838 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-ece8514c-b644-47b9-97b6-0e98fb3fcb74 req-0bac941a-1e8b-426b-8703-e7a696ed28d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0ba6d63-962f-4f40-9f31-760422ad4e7c", "tag": "ee3b861b-a264-4233-9abf-6688ec805a88"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:05:12.075228 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-80c01dd4-a699-4c2d-b8a3-7f3d91e6805a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:12.075743 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-80c01dd4-a699-4c2d-b8a3-7f3d91e6805a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:12.076203 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-80c01dd4-a699-4c2d-b8a3-7f3d91e6805a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:12.076993 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-80c01dd4-a699-4c2d-b8a3-7f3d91e6805a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:12.077869 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-80c01dd4-a699-4c2d-b8a3-7f3d91e6805a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:12.078406 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-80c01dd4-a699-4c2d-b8a3-7f3d91e6805a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:12.079921 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ece8514c-b644-47b9-97b6-0e98fb3fcb74 req-0bac941a-1e8b-426b-8703-e7a696ed28d9 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:12.080409 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ece8514c-b644-47b9-97b6-0e98fb3fcb74 req-0bac941a-1e8b-426b-8703-e7a696ed28d9 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:12.080884 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ece8514c-b644-47b9-97b6-0e98fb3fcb74 req-0bac941a-1e8b-426b-8703-e7a696ed28d9 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:12.096056 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-ece8514c-b644-47b9-97b6-0e98fb3fcb74 req-0bac941a-1e8b-426b-8703-e7a696ed28d9 service nova] Creating event network-changed:ee3b861b-a264-4233-9abf-6688ec805a88 for instance c0ba6d63-962f-4f40-9f31-760422ad4e7c on n-h1-853682-5 Oct 18 17:05:12.102090 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-ece8514c-b644-47b9-97b6-0e98fb3fcb74 req-0bac941a-1e8b-426b-8703-e7a696ed28d9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057798 Oct 18 17:05:12.106425 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3898/7814] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 17:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:05:12.107349 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-80c01dd4-a699-4c2d-b8a3-7f3d91e6805a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 17:05:12.197286 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-80c01dd4-a699-4c2d-b8a3-7f3d91e6805a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 204 len: 0 microversion: 2.1 time: 0.157949 Oct 18 17:05:12.198432 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3917/7815] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 17:05:12 2022] DELETE /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 17:05:12.209616 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-18de02e3-a928-4f67-b8d5-92be73966f73 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:12.210339 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-18de02e3-a928-4f67-b8d5-92be73966f73 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:12.217076 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18de02e3-a928-4f67-b8d5-92be73966f73 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:12.217727 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18de02e3-a928-4f67-b8d5-92be73966f73 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:12.218179 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18de02e3-a928-4f67-b8d5-92be73966f73 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:12.218895 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18de02e3-a928-4f67-b8d5-92be73966f73 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:12.219355 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18de02e3-a928-4f67-b8d5-92be73966f73 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:12.219789 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18de02e3-a928-4f67-b8d5-92be73966f73 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:12.360676 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-18de02e3-a928-4f67-b8d5-92be73966f73 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:12.368636 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-18de02e3-a928-4f67-b8d5-92be73966f73 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1568 microversion: 2.1 time: 0.164665 Oct 18 17:05:12.369254 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3899/7816] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:12 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 17:05:13.394276 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e8f849dc-0e9d-4d0d-8211-19f9ca5fcf59 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:13.395007 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e8f849dc-0e9d-4d0d-8211-19f9ca5fcf59 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:13.402199 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e8f849dc-0e9d-4d0d-8211-19f9ca5fcf59 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:13.403268 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e8f849dc-0e9d-4d0d-8211-19f9ca5fcf59 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:13.403726 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e8f849dc-0e9d-4d0d-8211-19f9ca5fcf59 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:13.404447 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e8f849dc-0e9d-4d0d-8211-19f9ca5fcf59 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:13.404950 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e8f849dc-0e9d-4d0d-8211-19f9ca5fcf59 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:13.405396 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e8f849dc-0e9d-4d0d-8211-19f9ca5fcf59 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:13.572444 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e8f849dc-0e9d-4d0d-8211-19f9ca5fcf59 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:13.580732 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e8f849dc-0e9d-4d0d-8211-19f9ca5fcf59 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1568 microversion: 2.1 time: 0.190744 Oct 18 17:05:13.581335 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3918/7817] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:13 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1568 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:14.438871 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-fd2c5c07-2848-4153-a0e9-9c75c228ffc7 req-bf9efc08-a6af-4367-9a9e-4d65773df723 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0ba6d63-962f-4f40-9f31-760422ad4e7c", "name": "network-vif-deleted", "tag": "ee3b861b-a264-4233-9abf-6688ec805a88"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:05:14.450144 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-fd2c5c07-2848-4153-a0e9-9c75c228ffc7 req-bf9efc08-a6af-4367-9a9e-4d65773df723 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:14.450625 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-fd2c5c07-2848-4153-a0e9-9c75c228ffc7 req-bf9efc08-a6af-4367-9a9e-4d65773df723 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:14.451056 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-fd2c5c07-2848-4153-a0e9-9c75c228ffc7 req-bf9efc08-a6af-4367-9a9e-4d65773df723 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:14.462514 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-fd2c5c07-2848-4153-a0e9-9c75c228ffc7 req-bf9efc08-a6af-4367-9a9e-4d65773df723 service nova] Creating event network-vif-deleted:ee3b861b-a264-4233-9abf-6688ec805a88 for instance c0ba6d63-962f-4f40-9f31-760422ad4e7c on n-h1-853682-5 Oct 18 17:05:14.468784 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-fd2c5c07-2848-4153-a0e9-9c75c228ffc7 req-bf9efc08-a6af-4367-9a9e-4d65773df723 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033650 Oct 18 17:05:14.469629 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3900/7818] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 17:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:05:14.606283 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bdf4db86-a7ac-45a1-a09b-a04c8ffcd621 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:14.606925 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-bdf4db86-a7ac-45a1-a09b-a04c8ffcd621 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:14.614166 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bdf4db86-a7ac-45a1-a09b-a04c8ffcd621 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:14.614897 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bdf4db86-a7ac-45a1-a09b-a04c8ffcd621 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:14.615366 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bdf4db86-a7ac-45a1-a09b-a04c8ffcd621 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:14.616090 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bdf4db86-a7ac-45a1-a09b-a04c8ffcd621 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:14.616567 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bdf4db86-a7ac-45a1-a09b-a04c8ffcd621 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:14.617235 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bdf4db86-a7ac-45a1-a09b-a04c8ffcd621 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:14.685355 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-bdf4db86-a7ac-45a1-a09b-a04c8ffcd621 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:14.698678 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-bdf4db86-a7ac-45a1-a09b-a04c8ffcd621 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1219 microversion: 2.1 time: 0.098182 Oct 18 17:05:14.699347 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3919/7819] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:14 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1219 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:15.723010 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7d21c903-1a20-4915-a3ab-513cb6900a72 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:15.723900 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7d21c903-1a20-4915-a3ab-513cb6900a72 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:15.730406 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d21c903-1a20-4915-a3ab-513cb6900a72 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:15.730890 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d21c903-1a20-4915-a3ab-513cb6900a72 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:15.731328 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d21c903-1a20-4915-a3ab-513cb6900a72 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:15.732025 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d21c903-1a20-4915-a3ab-513cb6900a72 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:15.732481 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d21c903-1a20-4915-a3ab-513cb6900a72 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:15.732934 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d21c903-1a20-4915-a3ab-513cb6900a72 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:15.798656 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7d21c903-1a20-4915-a3ab-513cb6900a72 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:15.807274 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7d21c903-1a20-4915-a3ab-513cb6900a72 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1219 microversion: 2.1 time: 0.089329 Oct 18 17:05:15.807854 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3901/7820] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:15 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:16.831085 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d9d14076-9339-4eef-8f2c-dcb8f6e24b30 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:16.831740 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d9d14076-9339-4eef-8f2c-dcb8f6e24b30 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:16.838978 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d9d14076-9339-4eef-8f2c-dcb8f6e24b30 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:16.839486 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d9d14076-9339-4eef-8f2c-dcb8f6e24b30 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:16.839943 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d9d14076-9339-4eef-8f2c-dcb8f6e24b30 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:16.840673 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d9d14076-9339-4eef-8f2c-dcb8f6e24b30 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:16.841180 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d9d14076-9339-4eef-8f2c-dcb8f6e24b30 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:16.841627 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d9d14076-9339-4eef-8f2c-dcb8f6e24b30 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:16.910774 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d9d14076-9339-4eef-8f2c-dcb8f6e24b30 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:16.918898 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d9d14076-9339-4eef-8f2c-dcb8f6e24b30 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1219 microversion: 2.1 time: 0.091815 Oct 18 17:05:16.919476 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3920/7821] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:16 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:17.942420 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3caae7b3-d609-4cb6-8609-50c330e9f464 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:17.942980 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3caae7b3-d609-4cb6-8609-50c330e9f464 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:17.950638 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3caae7b3-d609-4cb6-8609-50c330e9f464 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:17.951124 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3caae7b3-d609-4cb6-8609-50c330e9f464 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:17.951564 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3caae7b3-d609-4cb6-8609-50c330e9f464 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:17.952261 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3caae7b3-d609-4cb6-8609-50c330e9f464 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:17.952721 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3caae7b3-d609-4cb6-8609-50c330e9f464 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:17.953175 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3caae7b3-d609-4cb6-8609-50c330e9f464 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:18.015984 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3caae7b3-d609-4cb6-8609-50c330e9f464 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:18.024167 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3caae7b3-d609-4cb6-8609-50c330e9f464 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1219 microversion: 2.1 time: 0.085785 Oct 18 17:05:18.024748 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3902/7822] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:17 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:19.047732 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-dabd7608-67aa-4e9f-9a05-b8decb57be42 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:19.048362 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-dabd7608-67aa-4e9f-9a05-b8decb57be42 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:19.055483 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dabd7608-67aa-4e9f-9a05-b8decb57be42 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:19.056104 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dabd7608-67aa-4e9f-9a05-b8decb57be42 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:19.056617 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dabd7608-67aa-4e9f-9a05-b8decb57be42 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:19.057394 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dabd7608-67aa-4e9f-9a05-b8decb57be42 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:19.058056 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dabd7608-67aa-4e9f-9a05-b8decb57be42 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:19.059296 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dabd7608-67aa-4e9f-9a05-b8decb57be42 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:19.094735 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dabd7608-67aa-4e9f-9a05-b8decb57be42 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:19.095502 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dabd7608-67aa-4e9f-9a05-b8decb57be42 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:19.096144 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-dabd7608-67aa-4e9f-9a05-b8decb57be42 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:19.096599 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.objects.instance [None req-dabd7608-67aa-4e9f-9a05-b8decb57be42 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lazy-loading 'fault' on Instance uuid c0ba6d63-962f-4f40-9f31-760422ad4e7c {{(pid=120405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 17:05:19.141719 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-dabd7608-67aa-4e9f-9a05-b8decb57be42 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93520a1077949b6ab65c9c3a98772ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b495752af59843c9b5c2270dabc10a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:19.149698 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-dabd7608-67aa-4e9f-9a05-b8decb57be42 tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 200 len: 1178 microversion: 2.1 time: 0.106017 Oct 18 17:05:19.150270 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3921/7823] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:19 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 1178 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:20.172286 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5ec02063-1df5-4157-a0b0-3094f72b3c3a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:20.173065 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5ec02063-1df5-4157-a0b0-3094f72b3c3a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] [instance: c0ba6d63-962f-4f40-9f31-760422ad4e7c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:20.179668 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ec02063-1df5-4157-a0b0-3094f72b3c3a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:20.180159 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ec02063-1df5-4157-a0b0-3094f72b3c3a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:20.180598 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ec02063-1df5-4157-a0b0-3094f72b3c3a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:20.181320 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ec02063-1df5-4157-a0b0-3094f72b3c3a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:20.181810 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ec02063-1df5-4157-a0b0-3094f72b3c3a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:20.182240 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ec02063-1df5-4157-a0b0-3094f72b3c3a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:20.195721 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-5ec02063-1df5-4157-a0b0-3094f72b3c3a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] HTTP exception thrown: Instance c0ba6d63-962f-4f40-9f31-760422ad4e7c could not be found. Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5ec02063-1df5-4157-a0b0-3094f72b3c3a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Request method failure captured: Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c HTTP/1.1 Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTtqRhs4C83zO09-hXyWaLI9CnFJHVxM1e8oh_PxlfoneWFy6i1o2Y5-scOsXlNrsLpTDCA2cXb9qlzMzLQSetS2lT9GMUqxHa25vH3d7nKD5PHe3GUTLStL9Jma-WAx3p1gH8dECkYJW2yLb-yzcS5byRtsbYbiExSkaI4AhgIA0-wM Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: b495752af59843c9b5c2270dabc10a78 Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-TestShelveInstance-1988149404 Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b495752af59843c9b5c2270dabc10a78"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b495752af59843c9b5c2270dabc10a78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b495752af59843c9b5c2270dabc10a78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b495752af59843c9b5c2270dabc10a78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-TestShelveInstance-1988149404 Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: b495752af59843c9b5c2270dabc10a78 Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-TestShelveInstance-1988149404 Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-TestShelveInstance-1988149404-project Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: b93520a1077949b6ab65c9c3a98772ce Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-TestShelveInstance-1988149404-project Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance c0ba6d63-962f-4f40-9f31-760422ad4e7c could not be found. Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': 'c0ba6d63-962f-4f40-9f31-760422ad4e7c'} Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0ba6d63-962f-4f40-9f31-760422ad4e7c could not be found. Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0ba6d63-962f-4f40-9f31-760422ad4e7c could not be found. Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:05:20.197460 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 17:05:20.203918 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:05:20.203918 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:05:20.203918 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:05:20.203918 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 17:05:20.203918 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 17:05:20.203918 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0ba6d63-962f-4f40-9f31-760422ad4e7c could not be found. Oct 18 17:05:20.203918 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 17:05:20.203918 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5ec02063-1df5-4157-a0b0-3094f72b3c3a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Returning 404 to user: Instance c0ba6d63-962f-4f40-9f31-760422ad4e7c could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 17:05:20.203918 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5ec02063-1df5-4157-a0b0-3094f72b3c3a tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c" status: 404 len: 111 microversion: 2.1 time: 0.030690 Oct 18 17:05:20.203918 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3903/7824] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:20 2022] GET /compute/v2.1/servers/c0ba6d63-962f-4f40-9f31-760422ad4e7c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 17:05:20.370598 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-300716be-537f-40a6-9b6c-32a56e8605bd tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] Calling method '.version_select at 0x7f7c3c46c8b0>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:20.398563 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-300716be-537f-40a6-9b6c-32a56e8605bd tempest-TestShelveInstance-1988149404 tempest-TestShelveInstance-1988149404-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1390314234" status: 202 len: 0 microversion: 2.1 time: 0.031705 Oct 18 17:05:20.404662 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3922/7825] 10.222.0.60 () {58 vars in 1254 bytes} [Tue Oct 18 17:05:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1390314234 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 17:05:37.709779 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=12 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:05:37.710505 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=24 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:05:37.887429 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e766f541-42d5-4f6e-beb4-bddcbf6c8faf tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Action: 'create', calling method: .version_select at 0x7f7c3c72b5e0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-436347460", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIEYC2bMtr+w3sKLC5akknBL4MnTmelYUfA/INSlTUqr4lpqZ2jUReDefVhxrtHnsPb2CLsMrE+FvB6nAesb+XeV9QxHk0IHGSZy1EFtv9LVStWALdz36/LPLG2gu0DR0g=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:05:37.905461 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-e766f541-42d5-4f6e-beb4-bddcbf6c8faf tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Getting quotas for project 4a9c4c441e7f47f38fec407f3178a441. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 17:05:37.911135 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-e766f541-42d5-4f6e-beb4-bddcbf6c8faf tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Getting quotas for user 9e164794ed44483885eb3ff17b6cda08 and project 4a9c4c441e7f47f38fec407f3178a441. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 17:05:37.940292 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e766f541-42d5-4f6e-beb4-bddcbf6c8faf tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.236335 Oct 18 17:05:37.941252 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3904/7826] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Oct 18 17:05:37 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:05:39.003282 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bc81fd51-5938-41ee-8f65-215ea593ef67 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-69306571", "imageRef": "8f4db252-bff6-4685-9c8d-4c5d6bd9f78b", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-436347460", "security_groups": [{"name": "tempest-secgroup-smoke-141371560"}], "networks": [{"uuid": "dd3e29fa-672e-4920-911c-96ac9c3b531b"}]}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:05:39.015253 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:05:39.015930 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:05:39.245142 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.network.neutron [None req-bc81fd51-5938-41ee-8f65-215ea593ef67 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] validate_networks() for [('dd3e29fa-672e-4920-911c-96ac9c3b531b', None, None, None, None, None)] {{(pid=120405) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 17:05:39.744298 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-bc81fd51-5938-41ee-8f65-215ea593ef67 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Flavor limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 17:05:39.744741 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-bc81fd51-5938-41ee-8f65-215ea593ef67 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Image limits 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 17:05:39.745266 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-bc81fd51-5938-41ee-8f65-215ea593ef67 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Flavor pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 17:05:39.746341 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-bc81fd51-5938-41ee-8f65-215ea593ef67 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Image pref 0:0:0 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 17:05:39.746807 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.virt.hardware [None req-bc81fd51-5938-41ee-8f65-215ea593ef67 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 17:05:39.756211 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bc81fd51-5938-41ee-8f65-215ea593ef67 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:39.756708 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bc81fd51-5938-41ee-8f65-215ea593ef67 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:39.757223 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bc81fd51-5938-41ee-8f65-215ea593ef67 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:39.757969 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bc81fd51-5938-41ee-8f65-215ea593ef67 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:39.758455 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bc81fd51-5938-41ee-8f65-215ea593ef67 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:39.758875 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-bc81fd51-5938-41ee-8f65-215ea593ef67 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:39.776910 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-bc81fd51-5938-41ee-8f65-215ea593ef67 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Getting quotas for project 4a9c4c441e7f47f38fec407f3178a441. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 17:05:39.782355 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.quota [None req-bc81fd51-5938-41ee-8f65-215ea593ef67 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Getting quotas for user 9e164794ed44483885eb3ff17b6cda08 and project 4a9c4c441e7f47f38fec407f3178a441. Resources: {'cores', 'ram', 'instances'} {{(pid=120405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 17:05:39.795281 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-bc81fd51-5938-41ee-8f65-215ea593ef67 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Going to run 1 instances... {{(pid=120405) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 17:05:39.797655 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-bc81fd51-5938-41ee-8f65-215ea593ef67 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] [instance: 4be5b131-fa12-47ab-b281-080096b777c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f4db252-bff6-4685-9c8d-4c5d6bd9f78b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 17:05:39.847635 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-bc81fd51-5938-41ee-8f65-215ea593ef67 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.848338 Oct 18 17:05:39.848510 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3923/7827] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 17:05:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 17:05:39.860199 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-73de7b41-3c52-4397-9cdd-b8c9eb2be3b2 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:39.860995 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-73de7b41-3c52-4397-9cdd-b8c9eb2be3b2 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] [instance: 4be5b131-fa12-47ab-b281-080096b777c8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:39.968207 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-73de7b41-3c52-4397-9cdd-b8c9eb2be3b2 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e164794ed44483885eb3ff17b6cda08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9c4c441e7f47f38fec407f3178a441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:39.975318 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-73de7b41-3c52-4397-9cdd-b8c9eb2be3b2 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] 10.222.0.60 "GET /compute/v2.1/servers/4be5b131-fa12-47ab-b281-080096b777c8" status: 200 len: 1246 microversion: 2.1 time: 0.119012 Oct 18 17:05:39.976098 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3905/7828] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:39 2022] GET /compute/v2.1/servers/4be5b131-fa12-47ab-b281-080096b777c8 => generated 1246 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 17:05:41.000130 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-bf3b737a-7cb7-46a4-af66-757ac73ce7a0 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:41.000766 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-bf3b737a-7cb7-46a4-af66-757ac73ce7a0 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] [instance: 4be5b131-fa12-47ab-b281-080096b777c8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:41.059503 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-bf3b737a-7cb7-46a4-af66-757ac73ce7a0 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e164794ed44483885eb3ff17b6cda08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9c4c441e7f47f38fec407f3178a441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:41.067362 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-bf3b737a-7cb7-46a4-af66-757ac73ce7a0 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] 10.222.0.60 "GET /compute/v2.1/servers/4be5b131-fa12-47ab-b281-080096b777c8" status: 200 len: 1246 microversion: 2.1 time: 0.072125 Oct 18 17:05:41.067967 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3924/7829] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:40 2022] GET /compute/v2.1/servers/4be5b131-fa12-47ab-b281-080096b777c8 => generated 1246 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:42.091497 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6bb0eee0-af01-4e7a-8a7d-124581d338a8 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:42.092089 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6bb0eee0-af01-4e7a-8a7d-124581d338a8 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] [instance: 4be5b131-fa12-47ab-b281-080096b777c8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:42.155912 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6bb0eee0-af01-4e7a-8a7d-124581d338a8 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e164794ed44483885eb3ff17b6cda08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9c4c441e7f47f38fec407f3178a441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:42.162914 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6bb0eee0-af01-4e7a-8a7d-124581d338a8 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] 10.222.0.60 "GET /compute/v2.1/servers/4be5b131-fa12-47ab-b281-080096b777c8" status: 200 len: 1246 microversion: 2.1 time: 0.076389 Oct 18 17:05:42.163483 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3906/7830] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:42 2022] GET /compute/v2.1/servers/4be5b131-fa12-47ab-b281-080096b777c8 => generated 1246 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:43.186415 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-0cd50971-07ee-4a88-9913-daccfd36d559 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:43.187314 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-0cd50971-07ee-4a88-9913-daccfd36d559 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] [instance: 4be5b131-fa12-47ab-b281-080096b777c8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:43.247308 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-0cd50971-07ee-4a88-9913-daccfd36d559 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e164794ed44483885eb3ff17b6cda08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9c4c441e7f47f38fec407f3178a441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:43.254941 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-0cd50971-07ee-4a88-9913-daccfd36d559 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] 10.222.0.60 "GET /compute/v2.1/servers/4be5b131-fa12-47ab-b281-080096b777c8" status: 200 len: 1246 microversion: 2.1 time: 0.072585 Oct 18 17:05:43.255504 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3925/7831] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:43 2022] GET /compute/v2.1/servers/4be5b131-fa12-47ab-b281-080096b777c8 => generated 1246 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:44.278101 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2424f628-5856-43b4-98cd-b423150c8244 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:44.278715 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2424f628-5856-43b4-98cd-b423150c8244 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] [instance: 4be5b131-fa12-47ab-b281-080096b777c8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:44.285656 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2424f628-5856-43b4-98cd-b423150c8244 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:44.286121 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2424f628-5856-43b4-98cd-b423150c8244 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:44.286558 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2424f628-5856-43b4-98cd-b423150c8244 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:44.287243 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2424f628-5856-43b4-98cd-b423150c8244 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:44.287693 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2424f628-5856-43b4-98cd-b423150c8244 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:44.288114 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2424f628-5856-43b4-98cd-b423150c8244 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:44.351090 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2424f628-5856-43b4-98cd-b423150c8244 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e164794ed44483885eb3ff17b6cda08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9c4c441e7f47f38fec407f3178a441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:44.359973 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2424f628-5856-43b4-98cd-b423150c8244 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] 10.222.0.60 "GET /compute/v2.1/servers/4be5b131-fa12-47ab-b281-080096b777c8" status: 200 len: 1250 microversion: 2.1 time: 0.085714 Oct 18 17:05:44.361465 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3907/7832] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:44 2022] GET /compute/v2.1/servers/4be5b131-fa12-47ab-b281-080096b777c8 => generated 1250 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:45.383804 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e0964c46-f21f-49c8-afe0-1f577c502813 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:45.384352 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e0964c46-f21f-49c8-afe0-1f577c502813 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] [instance: 4be5b131-fa12-47ab-b281-080096b777c8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:45.392383 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e0964c46-f21f-49c8-afe0-1f577c502813 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:45.392926 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e0964c46-f21f-49c8-afe0-1f577c502813 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:45.393376 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e0964c46-f21f-49c8-afe0-1f577c502813 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:45.394335 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e0964c46-f21f-49c8-afe0-1f577c502813 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:45.394807 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e0964c46-f21f-49c8-afe0-1f577c502813 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:45.395248 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e0964c46-f21f-49c8-afe0-1f577c502813 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:45.469820 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e0964c46-f21f-49c8-afe0-1f577c502813 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e164794ed44483885eb3ff17b6cda08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9c4c441e7f47f38fec407f3178a441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:45.478167 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e0964c46-f21f-49c8-afe0-1f577c502813 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] 10.222.0.60 "GET /compute/v2.1/servers/4be5b131-fa12-47ab-b281-080096b777c8" status: 200 len: 1304 microversion: 2.1 time: 0.098192 Oct 18 17:05:45.479038 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3926/7833] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:45 2022] GET /compute/v2.1/servers/4be5b131-fa12-47ab-b281-080096b777c8 => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:46.419711 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-bf4ad276-fd25-4e18-a067-a1cd8df2c4b7 req-2ccd0ef7-4d45-46da-84f5-ae611dc77877 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4be5b131-fa12-47ab-b281-080096b777c8", "tag": "1f45ab5c-14b4-4761-b83c-ff2ad74a8d0a"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:05:46.433944 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-bf4ad276-fd25-4e18-a067-a1cd8df2c4b7 req-2ccd0ef7-4d45-46da-84f5-ae611dc77877 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:46.434429 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-bf4ad276-fd25-4e18-a067-a1cd8df2c4b7 req-2ccd0ef7-4d45-46da-84f5-ae611dc77877 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:46.434868 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-bf4ad276-fd25-4e18-a067-a1cd8df2c4b7 req-2ccd0ef7-4d45-46da-84f5-ae611dc77877 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:46.447422 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-bf4ad276-fd25-4e18-a067-a1cd8df2c4b7 req-2ccd0ef7-4d45-46da-84f5-ae611dc77877 service nova] Creating event network-changed:1f45ab5c-14b4-4761-b83c-ff2ad74a8d0a for instance 4be5b131-fa12-47ab-b281-080096b777c8 on n-h2-853682-5 Oct 18 17:05:46.452590 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-bf4ad276-fd25-4e18-a067-a1cd8df2c4b7 req-2ccd0ef7-4d45-46da-84f5-ae611dc77877 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037428 Oct 18 17:05:46.453453 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3908/7834] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 17:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:05:46.503283 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-355813c6-ca91-4c14-b104-b7741960ebce tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:46.504007 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-355813c6-ca91-4c14-b104-b7741960ebce tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] [instance: 4be5b131-fa12-47ab-b281-080096b777c8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:46.510968 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-355813c6-ca91-4c14-b104-b7741960ebce tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:46.511539 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-355813c6-ca91-4c14-b104-b7741960ebce tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:46.511983 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-355813c6-ca91-4c14-b104-b7741960ebce tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:46.512693 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-355813c6-ca91-4c14-b104-b7741960ebce tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:46.513185 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-355813c6-ca91-4c14-b104-b7741960ebce tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:46.513621 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-355813c6-ca91-4c14-b104-b7741960ebce tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:46.658289 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-355813c6-ca91-4c14-b104-b7741960ebce tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e164794ed44483885eb3ff17b6cda08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9c4c441e7f47f38fec407f3178a441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:46.666341 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-355813c6-ca91-4c14-b104-b7741960ebce tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] 10.222.0.60 "GET /compute/v2.1/servers/4be5b131-fa12-47ab-b281-080096b777c8" status: 200 len: 1371 microversion: 2.1 time: 0.167442 Oct 18 17:05:46.666926 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3927/7835] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:46 2022] GET /compute/v2.1/servers/4be5b131-fa12-47ab-b281-080096b777c8 => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:47.691462 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5b74dee2-10d9-409c-901c-a533769cbfa6 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:47.692182 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5b74dee2-10d9-409c-901c-a533769cbfa6 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] [instance: 4be5b131-fa12-47ab-b281-080096b777c8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:47.699266 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5b74dee2-10d9-409c-901c-a533769cbfa6 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:47.699764 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5b74dee2-10d9-409c-901c-a533769cbfa6 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:47.700207 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5b74dee2-10d9-409c-901c-a533769cbfa6 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:47.700937 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5b74dee2-10d9-409c-901c-a533769cbfa6 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:47.701399 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5b74dee2-10d9-409c-901c-a533769cbfa6 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:47.701831 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5b74dee2-10d9-409c-901c-a533769cbfa6 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:47.841421 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5b74dee2-10d9-409c-901c-a533769cbfa6 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e164794ed44483885eb3ff17b6cda08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9c4c441e7f47f38fec407f3178a441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:47.849124 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5b74dee2-10d9-409c-901c-a533769cbfa6 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] 10.222.0.60 "GET /compute/v2.1/servers/4be5b131-fa12-47ab-b281-080096b777c8" status: 200 len: 1371 microversion: 2.1 time: 0.162884 Oct 18 17:05:47.849724 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3909/7836] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:47 2022] GET /compute/v2.1/servers/4be5b131-fa12-47ab-b281-080096b777c8 => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 17:05:48.873080 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6d989d0a-2dc1-464f-8134-235ab9766feb tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:48.873718 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6d989d0a-2dc1-464f-8134-235ab9766feb tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] [instance: 4be5b131-fa12-47ab-b281-080096b777c8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:48.879868 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6d989d0a-2dc1-464f-8134-235ab9766feb tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:48.880371 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6d989d0a-2dc1-464f-8134-235ab9766feb tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:48.880856 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6d989d0a-2dc1-464f-8134-235ab9766feb tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:48.881577 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6d989d0a-2dc1-464f-8134-235ab9766feb tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:48.882053 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6d989d0a-2dc1-464f-8134-235ab9766feb tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:48.882544 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6d989d0a-2dc1-464f-8134-235ab9766feb tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:49.015946 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6d989d0a-2dc1-464f-8134-235ab9766feb tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e164794ed44483885eb3ff17b6cda08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9c4c441e7f47f38fec407f3178a441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:49.024044 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6d989d0a-2dc1-464f-8134-235ab9766feb tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] 10.222.0.60 "GET /compute/v2.1/servers/4be5b131-fa12-47ab-b281-080096b777c8" status: 200 len: 1371 microversion: 2.1 time: 0.155266 Oct 18 17:05:49.024623 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3928/7837] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:48 2022] GET /compute/v2.1/servers/4be5b131-fa12-47ab-b281-080096b777c8 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:50.047785 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-244c306a-c063-4df9-b5cf-fad1c735eed6 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:50.048397 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-244c306a-c063-4df9-b5cf-fad1c735eed6 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] [instance: 4be5b131-fa12-47ab-b281-080096b777c8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:50.054924 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-244c306a-c063-4df9-b5cf-fad1c735eed6 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:50.055408 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-244c306a-c063-4df9-b5cf-fad1c735eed6 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:50.055845 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-244c306a-c063-4df9-b5cf-fad1c735eed6 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:50.056544 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-244c306a-c063-4df9-b5cf-fad1c735eed6 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:50.057045 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-244c306a-c063-4df9-b5cf-fad1c735eed6 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:50.057504 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-244c306a-c063-4df9-b5cf-fad1c735eed6 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:50.189651 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-244c306a-c063-4df9-b5cf-fad1c735eed6 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e164794ed44483885eb3ff17b6cda08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9c4c441e7f47f38fec407f3178a441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:50.197575 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-244c306a-c063-4df9-b5cf-fad1c735eed6 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] 10.222.0.60 "GET /compute/v2.1/servers/4be5b131-fa12-47ab-b281-080096b777c8" status: 200 len: 1371 microversion: 2.1 time: 0.153666 Oct 18 17:05:50.198096 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3910/7838] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:50 2022] GET /compute/v2.1/servers/4be5b131-fa12-47ab-b281-080096b777c8 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:51.221451 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-05931efa-eb96-496d-8a61-39f45490e240 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:51.222048 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-05931efa-eb96-496d-8a61-39f45490e240 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] [instance: 4be5b131-fa12-47ab-b281-080096b777c8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:51.223899 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:05:51.230815 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-05931efa-eb96-496d-8a61-39f45490e240 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:51.231318 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-05931efa-eb96-496d-8a61-39f45490e240 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:51.231781 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-05931efa-eb96-496d-8a61-39f45490e240 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:51.232499 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-05931efa-eb96-496d-8a61-39f45490e240 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:51.233016 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-05931efa-eb96-496d-8a61-39f45490e240 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:51.233466 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-05931efa-eb96-496d-8a61-39f45490e240 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:51.370956 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-05931efa-eb96-496d-8a61-39f45490e240 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e164794ed44483885eb3ff17b6cda08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9c4c441e7f47f38fec407f3178a441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:51.378719 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-05931efa-eb96-496d-8a61-39f45490e240 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] 10.222.0.60 "GET /compute/v2.1/servers/4be5b131-fa12-47ab-b281-080096b777c8" status: 200 len: 1371 microversion: 2.1 time: 0.161412 Oct 18 17:05:51.379302 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3929/7839] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:51 2022] GET /compute/v2.1/servers/4be5b131-fa12-47ab-b281-080096b777c8 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 17:05:52.402540 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fbc9188c-22b6-4c8a-b9c9-4d69c883ac3a tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:52.403183 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fbc9188c-22b6-4c8a-b9c9-4d69c883ac3a tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] [instance: 4be5b131-fa12-47ab-b281-080096b777c8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:52.406050 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=8 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:05:52.411464 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbc9188c-22b6-4c8a-b9c9-4d69c883ac3a tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:52.411953 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbc9188c-22b6-4c8a-b9c9-4d69c883ac3a tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:52.412395 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbc9188c-22b6-4c8a-b9c9-4d69c883ac3a tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:52.413133 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbc9188c-22b6-4c8a-b9c9-4d69c883ac3a tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:52.413595 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbc9188c-22b6-4c8a-b9c9-4d69c883ac3a tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:52.414024 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbc9188c-22b6-4c8a-b9c9-4d69c883ac3a tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:52.548052 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fbc9188c-22b6-4c8a-b9c9-4d69c883ac3a tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e164794ed44483885eb3ff17b6cda08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9c4c441e7f47f38fec407f3178a441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:52.555964 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fbc9188c-22b6-4c8a-b9c9-4d69c883ac3a tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] 10.222.0.60 "GET /compute/v2.1/servers/4be5b131-fa12-47ab-b281-080096b777c8" status: 200 len: 1371 microversion: 2.1 time: 0.157995 Oct 18 17:05:52.556590 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3911/7840] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:52 2022] GET /compute/v2.1/servers/4be5b131-fa12-47ab-b281-080096b777c8 => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:52.599888 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-2677ebf8-63cc-46b5-bc60-f6b363d67d94 req-42386d99-408c-4ae9-a61a-cc273b2d93fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4be5b131-fa12-47ab-b281-080096b777c8", "name": "network-vif-plugged", "status": "completed", "tag": "1f45ab5c-14b4-4761-b83c-ff2ad74a8d0a"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:05:52.610281 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-2677ebf8-63cc-46b5-bc60-f6b363d67d94 req-42386d99-408c-4ae9-a61a-cc273b2d93fe service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:52.610989 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-2677ebf8-63cc-46b5-bc60-f6b363d67d94 req-42386d99-408c-4ae9-a61a-cc273b2d93fe service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:52.611451 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-2677ebf8-63cc-46b5-bc60-f6b363d67d94 req-42386d99-408c-4ae9-a61a-cc273b2d93fe service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:52.622767 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-2677ebf8-63cc-46b5-bc60-f6b363d67d94 req-42386d99-408c-4ae9-a61a-cc273b2d93fe service nova] Creating event network-vif-plugged:1f45ab5c-14b4-4761-b83c-ff2ad74a8d0a for instance 4be5b131-fa12-47ab-b281-080096b777c8 on n-h2-853682-5 Oct 18 17:05:52.627734 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-2677ebf8-63cc-46b5-bc60-f6b363d67d94 req-42386d99-408c-4ae9-a61a-cc273b2d93fe service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031636 Oct 18 17:05:52.628341 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3930/7841] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 17:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:05:53.578604 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-73de42e4-4b4a-424e-8541-554499e1683d tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:53.579228 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-73de42e4-4b4a-424e-8541-554499e1683d tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] [instance: 4be5b131-fa12-47ab-b281-080096b777c8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:53.586263 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73de42e4-4b4a-424e-8541-554499e1683d tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:53.587066 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73de42e4-4b4a-424e-8541-554499e1683d tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:53.587516 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73de42e4-4b4a-424e-8541-554499e1683d tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:53.588228 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73de42e4-4b4a-424e-8541-554499e1683d tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:53.588693 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73de42e4-4b4a-424e-8541-554499e1683d tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:53.589157 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73de42e4-4b4a-424e-8541-554499e1683d tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:53.726025 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-73de42e4-4b4a-424e-8541-554499e1683d tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e164794ed44483885eb3ff17b6cda08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9c4c441e7f47f38fec407f3178a441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:53.734310 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-73de42e4-4b4a-424e-8541-554499e1683d tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] 10.222.0.60 "GET /compute/v2.1/servers/4be5b131-fa12-47ab-b281-080096b777c8" status: 200 len: 1371 microversion: 2.1 time: 0.159648 Oct 18 17:05:53.734886 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3912/7842] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:53 2022] GET /compute/v2.1/servers/4be5b131-fa12-47ab-b281-080096b777c8 => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:54.754494 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=10 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:05:54.759539 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-aa864386-486e-4ee4-8b5e-06b576ba7fe3 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:54.760266 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-aa864386-486e-4ee4-8b5e-06b576ba7fe3 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] [instance: 4be5b131-fa12-47ab-b281-080096b777c8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:54.767321 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aa864386-486e-4ee4-8b5e-06b576ba7fe3 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:54.767819 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aa864386-486e-4ee4-8b5e-06b576ba7fe3 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:54.768274 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aa864386-486e-4ee4-8b5e-06b576ba7fe3 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:54.769018 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aa864386-486e-4ee4-8b5e-06b576ba7fe3 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:54.769490 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aa864386-486e-4ee4-8b5e-06b576ba7fe3 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:54.769936 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-aa864386-486e-4ee4-8b5e-06b576ba7fe3 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:54.900203 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-aa864386-486e-4ee4-8b5e-06b576ba7fe3 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e164794ed44483885eb3ff17b6cda08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9c4c441e7f47f38fec407f3178a441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:54.908629 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-aa864386-486e-4ee4-8b5e-06b576ba7fe3 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] 10.222.0.60 "GET /compute/v2.1/servers/4be5b131-fa12-47ab-b281-080096b777c8" status: 200 len: 1555 microversion: 2.1 time: 0.155090 Oct 18 17:05:54.909232 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3931/7843] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:54 2022] GET /compute/v2.1/servers/4be5b131-fa12-47ab-b281-080096b777c8 => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:54.930784 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d98a96f7-fa6f-4c48-9e33-3fa11dc5ee31 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:05:54.931407 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d98a96f7-fa6f-4c48-9e33-3fa11dc5ee31 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] [instance: 4be5b131-fa12-47ab-b281-080096b777c8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:05:54.939025 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d98a96f7-fa6f-4c48-9e33-3fa11dc5ee31 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:54.939513 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d98a96f7-fa6f-4c48-9e33-3fa11dc5ee31 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:54.939949 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d98a96f7-fa6f-4c48-9e33-3fa11dc5ee31 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:54.940650 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d98a96f7-fa6f-4c48-9e33-3fa11dc5ee31 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:54.941146 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d98a96f7-fa6f-4c48-9e33-3fa11dc5ee31 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:54.941577 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d98a96f7-fa6f-4c48-9e33-3fa11dc5ee31 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:55.076144 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d98a96f7-fa6f-4c48-9e33-3fa11dc5ee31 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e164794ed44483885eb3ff17b6cda08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9c4c441e7f47f38fec407f3178a441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:05:55.094104 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d98a96f7-fa6f-4c48-9e33-3fa11dc5ee31 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] 10.222.0.60 "GET /compute/v2.1/servers/4be5b131-fa12-47ab-b281-080096b777c8" status: 200 len: 1555 microversion: 2.1 time: 0.164636 Oct 18 17:05:55.095556 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3913/7844] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:05:54 2022] GET /compute/v2.1/servers/4be5b131-fa12-47ab-b281-080096b777c8 => generated 1555 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:05:57.027076 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-11279936-f38b-4ef9-9a54-3b0367996771 req-8d13b4aa-6e8a-43e4-88bc-d738231f4c11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4be5b131-fa12-47ab-b281-080096b777c8", "tag": "1f45ab5c-14b4-4761-b83c-ff2ad74a8d0a"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:05:57.037807 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-11279936-f38b-4ef9-9a54-3b0367996771 req-8d13b4aa-6e8a-43e4-88bc-d738231f4c11 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:05:57.038296 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-11279936-f38b-4ef9-9a54-3b0367996771 req-8d13b4aa-6e8a-43e4-88bc-d738231f4c11 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:05:57.038739 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-11279936-f38b-4ef9-9a54-3b0367996771 req-8d13b4aa-6e8a-43e4-88bc-d738231f4c11 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:05:57.049753 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-11279936-f38b-4ef9-9a54-3b0367996771 req-8d13b4aa-6e8a-43e4-88bc-d738231f4c11 service nova] Creating event network-changed:1f45ab5c-14b4-4761-b83c-ff2ad74a8d0a for instance 4be5b131-fa12-47ab-b281-080096b777c8 on n-h2-853682-5 Oct 18 17:05:57.054805 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-11279936-f38b-4ef9-9a54-3b0367996771 req-8d13b4aa-6e8a-43e4-88bc-d738231f4c11 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031381 Oct 18 17:05:57.055403 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3932/7845] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 17:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:07:52.477539 n-d-853682-5 devstack@n-api.service[120406]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6eb481dc-0a5f-4095-8691-72ce090f1ba0] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 18 17:07:52.478441 n-d-853682-5 devstack@n-api.service[120406]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9784c765-18ae-4d28-9be4-c2f2473b54eb] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 18 17:07:52.479254 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:07:52.479990 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=38 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:07:52.481106 n-d-853682-5 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 17:07:52.481280 n-d-853682-5 devstack@n-api.service[120406]: Tue Oct 18 17:07:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4be5b131-fa12-47ab-b281-080096b777c8/action (ip 10.222.0.60) !!! Oct 18 17:07:52.487654 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4a8fe822-c4a8-4dd2-833b-cd0d7805cc8e tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1085123511"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:07:52.490063 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4a8fe822-c4a8-4dd2-833b-cd0d7805cc8e tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] [instance: 4be5b131-fa12-47ab-b281-080096b777c8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:07:52.502465 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a8fe822-c4a8-4dd2-833b-cd0d7805cc8e tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:52.502959 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a8fe822-c4a8-4dd2-833b-cd0d7805cc8e tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:52.503405 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a8fe822-c4a8-4dd2-833b-cd0d7805cc8e tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:52.504109 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a8fe822-c4a8-4dd2-833b-cd0d7805cc8e tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:52.504574 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a8fe822-c4a8-4dd2-833b-cd0d7805cc8e tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:52.505039 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a8fe822-c4a8-4dd2-833b-cd0d7805cc8e tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:52.705251 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4a8fe822-c4a8-4dd2-833b-cd0d7805cc8e tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] 10.222.0.60 "POST /compute/v2.1/servers/4be5b131-fa12-47ab-b281-080096b777c8/action" status: 202 len: 0 microversion: 2.1 time: 0.229228 Oct 18 17:07:52.705923 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3914/7846] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 17:07:52 2022] POST /compute/v2.1/servers/4be5b131-fa12-47ab-b281-080096b777c8/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 18 17:07:59.304262 n-d-853682-5 devstack@n-api.service[120405]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c870dd72-6039-47fe-83e0-90856ded1829] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 17:07:59.305909 n-d-853682-5 devstack@n-api.service[120405]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6b6d975c-54e4-4acd-8cc5-5b0cda3c3106] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 17:07:59.306577 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:07:59.307931 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=36 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:07:59.398758 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-3b183a4d-6222-410e-a4d4-a728f94eba86 req-98b28c00-509d-42f0-b824-dd3fd63c10a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4be5b131-fa12-47ab-b281-080096b777c8", "name": "network-vif-plugged", "status": "completed", "tag": "1f45ab5c-14b4-4761-b83c-ff2ad74a8d0a"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:07:59.417716 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-3b183a4d-6222-410e-a4d4-a728f94eba86 req-98b28c00-509d-42f0-b824-dd3fd63c10a5 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:07:59.420443 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-3b183a4d-6222-410e-a4d4-a728f94eba86 req-98b28c00-509d-42f0-b824-dd3fd63c10a5 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:07:59.420443 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-3b183a4d-6222-410e-a4d4-a728f94eba86 req-98b28c00-509d-42f0-b824-dd3fd63c10a5 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:07:59.430794 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-3b183a4d-6222-410e-a4d4-a728f94eba86 req-98b28c00-509d-42f0-b824-dd3fd63c10a5 service nova] Creating event network-vif-plugged:1f45ab5c-14b4-4761-b83c-ff2ad74a8d0a for instance 4be5b131-fa12-47ab-b281-080096b777c8 on n-h2-853682-5 Oct 18 17:07:59.435946 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-3b183a4d-6222-410e-a4d4-a728f94eba86 req-98b28c00-509d-42f0-b824-dd3fd63c10a5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134268 Oct 18 17:07:59.436555 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3933/7847] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 17:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:08:06.261867 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:08:06.262690 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:08:06.266936 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1ae8a9ce-3f3a-42bf-96b5-03104f0b9be3 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1201562089", "imageRef": "966d52c0-4635-48bc-8475-851f29f576b0", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-436347460", "security_groups": [{"name": "tempest-secgroup-smoke-141371560"}], "networks": [{"uuid": "dd3e29fa-672e-4920-911c-96ac9c3b531b"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:08:06.293916 n-d-853682-5 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [-] [6eb481dc-0a5f-4095-8691-72ce090f1ba0] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 43888. Oct 18 17:08:06.294693 n-d-853682-5 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [-] [9784c765-18ae-4d28-9be4-c2f2473b54eb] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 43890. Oct 18 17:08:06.381133 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-1ae8a9ce-3f3a-42bf-96b5-03104f0b9be3 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] validate_networks() for [('dd3e29fa-672e-4920-911c-96ac9c3b531b', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Oct 18 17:08:06.765645 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-1ae8a9ce-3f3a-42bf-96b5-03104f0b9be3 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 17:08:06.766077 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-1ae8a9ce-3f3a-42bf-96b5-03104f0b9be3 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 17:08:06.766608 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-1ae8a9ce-3f3a-42bf-96b5-03104f0b9be3 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 17:08:06.767053 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-1ae8a9ce-3f3a-42bf-96b5-03104f0b9be3 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 17:08:06.768097 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-1ae8a9ce-3f3a-42bf-96b5-03104f0b9be3 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 17:08:06.777220 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ae8a9ce-3f3a-42bf-96b5-03104f0b9be3 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:06.777700 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ae8a9ce-3f3a-42bf-96b5-03104f0b9be3 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:06.778136 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ae8a9ce-3f3a-42bf-96b5-03104f0b9be3 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:06.778863 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ae8a9ce-3f3a-42bf-96b5-03104f0b9be3 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:06.779333 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ae8a9ce-3f3a-42bf-96b5-03104f0b9be3 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:06.779740 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ae8a9ce-3f3a-42bf-96b5-03104f0b9be3 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:06.796702 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-1ae8a9ce-3f3a-42bf-96b5-03104f0b9be3 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Getting quotas for project 4a9c4c441e7f47f38fec407f3178a441. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 17:08:06.802294 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.quota [None req-1ae8a9ce-3f3a-42bf-96b5-03104f0b9be3 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Getting quotas for user 9e164794ed44483885eb3ff17b6cda08 and project 4a9c4c441e7f47f38fec407f3178a441. Resources: {'cores', 'ram', 'instances'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 17:08:06.815099 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1ae8a9ce-3f3a-42bf-96b5-03104f0b9be3 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 17:08:06.817619 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1ae8a9ce-3f3a-42bf-96b5-03104f0b9be3 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] [instance: 982dbb12-aa3c-4fe2-bdb6-6f256f31771b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='966d52c0-4635-48bc-8475-851f29f576b0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 17:08:06.866056 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1ae8a9ce-3f3a-42bf-96b5-03104f0b9be3 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.606235 Oct 18 17:08:06.866654 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3915/7848] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Oct 18 17:08:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 17:08:06.880575 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5be41a0f-ea3f-4f36-b00d-0a5740edf160 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:08:06.881338 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5be41a0f-ea3f-4f36-b00d-0a5740edf160 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] [instance: 982dbb12-aa3c-4fe2-bdb6-6f256f31771b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:08:06.891448 n-d-853682-5 devstack@n-api.service[120405]: INFO oslo.messaging._drivers.impl_rabbit [-] [c870dd72-6039-47fe-83e0-90856ded1829] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 43904. Oct 18 17:08:06.896400 n-d-853682-5 devstack@n-api.service[120405]: INFO oslo.messaging._drivers.impl_rabbit [-] [6b6d975c-54e4-4acd-8cc5-5b0cda3c3106] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 43906. Oct 18 17:08:06.943407 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5be41a0f-ea3f-4f36-b00d-0a5740edf160 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e164794ed44483885eb3ff17b6cda08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9c4c441e7f47f38fec407f3178a441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:08:06.950992 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5be41a0f-ea3f-4f36-b00d-0a5740edf160 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] 10.222.0.60 "GET /compute/v2.1/servers/982dbb12-aa3c-4fe2-bdb6-6f256f31771b" status: 200 len: 1248 microversion: 2.1 time: 0.076828 Oct 18 17:08:06.951557 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3934/7849] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:08:06 2022] GET /compute/v2.1/servers/982dbb12-aa3c-4fe2-bdb6-6f256f31771b => generated 1248 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:08:07.974948 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3c3a13c4-42ec-4520-8476-73a4a346894d tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:08:07.975510 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3c3a13c4-42ec-4520-8476-73a4a346894d tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] [instance: 982dbb12-aa3c-4fe2-bdb6-6f256f31771b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:08:07.982026 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c3a13c4-42ec-4520-8476-73a4a346894d tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:07.982570 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c3a13c4-42ec-4520-8476-73a4a346894d tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:07.983004 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c3a13c4-42ec-4520-8476-73a4a346894d tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:07.983830 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c3a13c4-42ec-4520-8476-73a4a346894d tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:07.984415 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c3a13c4-42ec-4520-8476-73a4a346894d tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:07.984866 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c3a13c4-42ec-4520-8476-73a4a346894d tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:08.053502 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3c3a13c4-42ec-4520-8476-73a4a346894d tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e164794ed44483885eb3ff17b6cda08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9c4c441e7f47f38fec407f3178a441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:08:08.061739 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3c3a13c4-42ec-4520-8476-73a4a346894d tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] 10.222.0.60 "GET /compute/v2.1/servers/982dbb12-aa3c-4fe2-bdb6-6f256f31771b" status: 200 len: 1308 microversion: 2.1 time: 0.092168 Oct 18 17:08:08.062356 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3916/7850] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:08:07 2022] GET /compute/v2.1/servers/982dbb12-aa3c-4fe2-bdb6-6f256f31771b => generated 1308 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:08:09.087380 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-e2d49172-60a1-4fb1-874d-d7246e0f0652 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:08:09.087966 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-e2d49172-60a1-4fb1-874d-d7246e0f0652 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] [instance: 982dbb12-aa3c-4fe2-bdb6-6f256f31771b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:08:09.097019 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e2d49172-60a1-4fb1-874d-d7246e0f0652 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:09.098142 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e2d49172-60a1-4fb1-874d-d7246e0f0652 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:09.104871 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e2d49172-60a1-4fb1-874d-d7246e0f0652 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:09.106423 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e2d49172-60a1-4fb1-874d-d7246e0f0652 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:09.107120 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e2d49172-60a1-4fb1-874d-d7246e0f0652 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:09.107778 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-e2d49172-60a1-4fb1-874d-d7246e0f0652 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:09.285559 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-e2d49172-60a1-4fb1-874d-d7246e0f0652 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e164794ed44483885eb3ff17b6cda08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9c4c441e7f47f38fec407f3178a441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:08:09.293325 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-e2d49172-60a1-4fb1-874d-d7246e0f0652 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] 10.222.0.60 "GET /compute/v2.1/servers/982dbb12-aa3c-4fe2-bdb6-6f256f31771b" status: 200 len: 1373 microversion: 2.1 time: 0.210721 Oct 18 17:08:09.293919 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3935/7851] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:08:09 2022] GET /compute/v2.1/servers/982dbb12-aa3c-4fe2-bdb6-6f256f31771b => generated 1373 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:08:09.302232 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-74fe6a7e-eb5a-49e7-9d1b-e3355763d9f8 req-7a34e69f-3a1e-4b56-a308-90c259fd9102 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4be5b131-fa12-47ab-b281-080096b777c8", "name": "network-vif-unplugged", "status": "completed", "tag": "1f45ab5c-14b4-4761-b83c-ff2ad74a8d0a"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:08:09.313223 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-74fe6a7e-eb5a-49e7-9d1b-e3355763d9f8 req-7a34e69f-3a1e-4b56-a308-90c259fd9102 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:09.314068 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-74fe6a7e-eb5a-49e7-9d1b-e3355763d9f8 req-7a34e69f-3a1e-4b56-a308-90c259fd9102 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:09.315239 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-74fe6a7e-eb5a-49e7-9d1b-e3355763d9f8 req-7a34e69f-3a1e-4b56-a308-90c259fd9102 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:09.326976 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-74fe6a7e-eb5a-49e7-9d1b-e3355763d9f8 req-7a34e69f-3a1e-4b56-a308-90c259fd9102 service nova] Creating event network-vif-unplugged:1f45ab5c-14b4-4761-b83c-ff2ad74a8d0a for instance 4be5b131-fa12-47ab-b281-080096b777c8 on n-h2-853682-5 Oct 18 17:08:09.332090 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-74fe6a7e-eb5a-49e7-9d1b-e3355763d9f8 req-7a34e69f-3a1e-4b56-a308-90c259fd9102 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034055 Oct 18 17:08:09.332724 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3917/7852] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 17:08:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 17:08:10.319894 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-9442e07b-fc02-4f64-93ab-ec91e2abb454 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:08:10.321453 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-9442e07b-fc02-4f64-93ab-ec91e2abb454 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] [instance: 982dbb12-aa3c-4fe2-bdb6-6f256f31771b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:08:10.331368 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9442e07b-fc02-4f64-93ab-ec91e2abb454 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:10.332275 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9442e07b-fc02-4f64-93ab-ec91e2abb454 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:10.333012 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9442e07b-fc02-4f64-93ab-ec91e2abb454 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:10.334025 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9442e07b-fc02-4f64-93ab-ec91e2abb454 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:10.334725 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9442e07b-fc02-4f64-93ab-ec91e2abb454 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:10.335391 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-9442e07b-fc02-4f64-93ab-ec91e2abb454 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:10.486177 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-9442e07b-fc02-4f64-93ab-ec91e2abb454 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e164794ed44483885eb3ff17b6cda08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9c4c441e7f47f38fec407f3178a441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:08:10.504256 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-9442e07b-fc02-4f64-93ab-ec91e2abb454 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] 10.222.0.60 "GET /compute/v2.1/servers/982dbb12-aa3c-4fe2-bdb6-6f256f31771b" status: 200 len: 1373 microversion: 2.1 time: 0.190835 Oct 18 17:08:10.504983 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3936/7853] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:08:10 2022] GET /compute/v2.1/servers/982dbb12-aa3c-4fe2-bdb6-6f256f31771b => generated 1373 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:08:11.534196 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2e0c2d9f-4760-494e-b9de-7cea79583c4b tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:08:11.535016 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2e0c2d9f-4760-494e-b9de-7cea79583c4b tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] [instance: 982dbb12-aa3c-4fe2-bdb6-6f256f31771b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:08:11.541817 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e0c2d9f-4760-494e-b9de-7cea79583c4b tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:11.542371 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e0c2d9f-4760-494e-b9de-7cea79583c4b tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:11.542882 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e0c2d9f-4760-494e-b9de-7cea79583c4b tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:11.543659 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e0c2d9f-4760-494e-b9de-7cea79583c4b tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:11.544266 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e0c2d9f-4760-494e-b9de-7cea79583c4b tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:11.544686 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e0c2d9f-4760-494e-b9de-7cea79583c4b tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:11.690620 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2e0c2d9f-4760-494e-b9de-7cea79583c4b tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e164794ed44483885eb3ff17b6cda08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9c4c441e7f47f38fec407f3178a441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:08:11.698842 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2e0c2d9f-4760-494e-b9de-7cea79583c4b tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] 10.222.0.60 "GET /compute/v2.1/servers/982dbb12-aa3c-4fe2-bdb6-6f256f31771b" status: 200 len: 1373 microversion: 2.1 time: 0.170550 Oct 18 17:08:11.699426 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3918/7854] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:08:11 2022] GET /compute/v2.1/servers/982dbb12-aa3c-4fe2-bdb6-6f256f31771b => generated 1373 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:08:12.722807 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-71fabd71-f345-48b7-9f64-6a46a7b10923 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:08:12.723438 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-71fabd71-f345-48b7-9f64-6a46a7b10923 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] [instance: 982dbb12-aa3c-4fe2-bdb6-6f256f31771b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:08:12.730334 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-71fabd71-f345-48b7-9f64-6a46a7b10923 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:12.730836 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-71fabd71-f345-48b7-9f64-6a46a7b10923 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:12.731289 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-71fabd71-f345-48b7-9f64-6a46a7b10923 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:12.731995 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-71fabd71-f345-48b7-9f64-6a46a7b10923 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:12.732470 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-71fabd71-f345-48b7-9f64-6a46a7b10923 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:12.732939 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-71fabd71-f345-48b7-9f64-6a46a7b10923 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:12.866515 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-71fabd71-f345-48b7-9f64-6a46a7b10923 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e164794ed44483885eb3ff17b6cda08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9c4c441e7f47f38fec407f3178a441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:08:12.875985 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-71fabd71-f345-48b7-9f64-6a46a7b10923 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] 10.222.0.60 "GET /compute/v2.1/servers/982dbb12-aa3c-4fe2-bdb6-6f256f31771b" status: 200 len: 1373 microversion: 2.1 time: 0.157420 Oct 18 17:08:12.877329 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3937/7855] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:08:12 2022] GET /compute/v2.1/servers/982dbb12-aa3c-4fe2-bdb6-6f256f31771b => generated 1373 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:08:13.901781 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3a6140ee-dc4e-4b51-ba83-a0af2555d569 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:08:13.902411 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3a6140ee-dc4e-4b51-ba83-a0af2555d569 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] [instance: 982dbb12-aa3c-4fe2-bdb6-6f256f31771b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:08:13.909394 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a6140ee-dc4e-4b51-ba83-a0af2555d569 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:13.910154 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a6140ee-dc4e-4b51-ba83-a0af2555d569 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:13.918116 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a6140ee-dc4e-4b51-ba83-a0af2555d569 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:13.919581 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a6140ee-dc4e-4b51-ba83-a0af2555d569 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:13.920075 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a6140ee-dc4e-4b51-ba83-a0af2555d569 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:13.920518 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a6140ee-dc4e-4b51-ba83-a0af2555d569 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:14.056384 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3a6140ee-dc4e-4b51-ba83-a0af2555d569 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e164794ed44483885eb3ff17b6cda08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9c4c441e7f47f38fec407f3178a441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:08:14.064171 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3a6140ee-dc4e-4b51-ba83-a0af2555d569 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] 10.222.0.60 "GET /compute/v2.1/servers/982dbb12-aa3c-4fe2-bdb6-6f256f31771b" status: 200 len: 1373 microversion: 2.1 time: 0.166531 Oct 18 17:08:14.064754 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3919/7856] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:08:13 2022] GET /compute/v2.1/servers/982dbb12-aa3c-4fe2-bdb6-6f256f31771b => generated 1373 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:08:15.087799 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-8e61321f-4e90-4324-a2f9-21f4d813e1e7 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:08:15.088433 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-8e61321f-4e90-4324-a2f9-21f4d813e1e7 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] [instance: 982dbb12-aa3c-4fe2-bdb6-6f256f31771b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:08:15.095339 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8e61321f-4e90-4324-a2f9-21f4d813e1e7 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:15.095841 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8e61321f-4e90-4324-a2f9-21f4d813e1e7 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:15.096310 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8e61321f-4e90-4324-a2f9-21f4d813e1e7 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:15.097097 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8e61321f-4e90-4324-a2f9-21f4d813e1e7 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:15.097586 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8e61321f-4e90-4324-a2f9-21f4d813e1e7 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:15.098039 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-8e61321f-4e90-4324-a2f9-21f4d813e1e7 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:15.253316 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-8e61321f-4e90-4324-a2f9-21f4d813e1e7 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e164794ed44483885eb3ff17b6cda08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9c4c441e7f47f38fec407f3178a441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:08:15.262400 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-8e61321f-4e90-4324-a2f9-21f4d813e1e7 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] 10.222.0.60 "GET /compute/v2.1/servers/982dbb12-aa3c-4fe2-bdb6-6f256f31771b" status: 200 len: 1373 microversion: 2.1 time: 0.178395 Oct 18 17:08:15.263841 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3938/7857] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:08:15 2022] GET /compute/v2.1/servers/982dbb12-aa3c-4fe2-bdb6-6f256f31771b => generated 1373 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:08:16.286659 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-80d35e23-0204-4b8c-9027-7988b4bd3383 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:08:16.287908 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-80d35e23-0204-4b8c-9027-7988b4bd3383 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] [instance: 982dbb12-aa3c-4fe2-bdb6-6f256f31771b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:08:16.295011 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80d35e23-0204-4b8c-9027-7988b4bd3383 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:16.296117 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80d35e23-0204-4b8c-9027-7988b4bd3383 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:16.296723 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80d35e23-0204-4b8c-9027-7988b4bd3383 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:16.297466 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80d35e23-0204-4b8c-9027-7988b4bd3383 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:16.297928 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80d35e23-0204-4b8c-9027-7988b4bd3383 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:16.298360 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80d35e23-0204-4b8c-9027-7988b4bd3383 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:16.454939 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-80d35e23-0204-4b8c-9027-7988b4bd3383 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e164794ed44483885eb3ff17b6cda08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9c4c441e7f47f38fec407f3178a441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:08:16.464646 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-80d35e23-0204-4b8c-9027-7988b4bd3383 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] 10.222.0.60 "GET /compute/v2.1/servers/982dbb12-aa3c-4fe2-bdb6-6f256f31771b" status: 200 len: 1373 microversion: 2.1 time: 0.181885 Oct 18 17:08:16.478077 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3920/7858] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:08:16 2022] GET /compute/v2.1/servers/982dbb12-aa3c-4fe2-bdb6-6f256f31771b => generated 1373 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:08:17.491150 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d4867e5d-0599-4701-913b-6c762084d3e4 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:08:17.493227 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d4867e5d-0599-4701-913b-6c762084d3e4 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] [instance: 982dbb12-aa3c-4fe2-bdb6-6f256f31771b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:08:17.501898 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell0:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:08:17.504719 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4867e5d-0599-4701-913b-6c762084d3e4 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:17.505620 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4867e5d-0599-4701-913b-6c762084d3e4 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:17.506444 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4867e5d-0599-4701-913b-6c762084d3e4 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:17.507386 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4867e5d-0599-4701-913b-6c762084d3e4 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:17.508035 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4867e5d-0599-4701-913b-6c762084d3e4 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:17.508746 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d4867e5d-0599-4701-913b-6c762084d3e4 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:17.655010 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d4867e5d-0599-4701-913b-6c762084d3e4 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e164794ed44483885eb3ff17b6cda08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9c4c441e7f47f38fec407f3178a441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:08:17.664185 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d4867e5d-0599-4701-913b-6c762084d3e4 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] 10.222.0.60 "GET /compute/v2.1/servers/982dbb12-aa3c-4fe2-bdb6-6f256f31771b" status: 200 len: 1373 microversion: 2.1 time: 0.178203 Oct 18 17:08:17.665305 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3939/7859] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:08:17 2022] GET /compute/v2.1/servers/982dbb12-aa3c-4fe2-bdb6-6f256f31771b => generated 1373 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:08:18.687593 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-080115ef-6365-420c-96e1-3c53fcf0e2b3 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:08:18.688218 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-080115ef-6365-420c-96e1-3c53fcf0e2b3 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] [instance: 982dbb12-aa3c-4fe2-bdb6-6f256f31771b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:08:18.690230 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:08:18.691494 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:08:18.698356 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-080115ef-6365-420c-96e1-3c53fcf0e2b3 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:18.698852 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-080115ef-6365-420c-96e1-3c53fcf0e2b3 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:18.699293 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-080115ef-6365-420c-96e1-3c53fcf0e2b3 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:18.700007 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-080115ef-6365-420c-96e1-3c53fcf0e2b3 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:18.700468 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-080115ef-6365-420c-96e1-3c53fcf0e2b3 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:18.700925 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-080115ef-6365-420c-96e1-3c53fcf0e2b3 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:18.833554 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-080115ef-6365-420c-96e1-3c53fcf0e2b3 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e164794ed44483885eb3ff17b6cda08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9c4c441e7f47f38fec407f3178a441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:08:18.841193 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-080115ef-6365-420c-96e1-3c53fcf0e2b3 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] 10.222.0.60 "GET /compute/v2.1/servers/982dbb12-aa3c-4fe2-bdb6-6f256f31771b" status: 200 len: 1373 microversion: 2.1 time: 0.157526 Oct 18 17:08:18.841773 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3921/7860] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:08:18 2022] GET /compute/v2.1/servers/982dbb12-aa3c-4fe2-bdb6-6f256f31771b => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:08:19.864298 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-d0000060-ecaa-4c7e-b8f2-706304dad79b tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:08:19.864949 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-d0000060-ecaa-4c7e-b8f2-706304dad79b tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] [instance: 982dbb12-aa3c-4fe2-bdb6-6f256f31771b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:08:19.871727 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d0000060-ecaa-4c7e-b8f2-706304dad79b tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:19.872216 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d0000060-ecaa-4c7e-b8f2-706304dad79b tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:19.872665 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d0000060-ecaa-4c7e-b8f2-706304dad79b tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:19.873400 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d0000060-ecaa-4c7e-b8f2-706304dad79b tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:19.873871 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d0000060-ecaa-4c7e-b8f2-706304dad79b tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:19.874308 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-d0000060-ecaa-4c7e-b8f2-706304dad79b tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:20.007268 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-d0000060-ecaa-4c7e-b8f2-706304dad79b tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e164794ed44483885eb3ff17b6cda08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9c4c441e7f47f38fec407f3178a441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:08:20.015120 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-d0000060-ecaa-4c7e-b8f2-706304dad79b tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] 10.222.0.60 "GET /compute/v2.1/servers/982dbb12-aa3c-4fe2-bdb6-6f256f31771b" status: 200 len: 1373 microversion: 2.1 time: 0.154686 Oct 18 17:08:20.015714 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3940/7861] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:08:19 2022] GET /compute/v2.1/servers/982dbb12-aa3c-4fe2-bdb6-6f256f31771b => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:08:20.679104 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-bb7e8ea4-8da0-40d8-b14f-6a7eb82becb6 req-c4efedf3-add2-435f-b7e6-7bb10c5dd174 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "982dbb12-aa3c-4fe2-bdb6-6f256f31771b", "tag": "7c162dcc-e3f4-45c2-9645-78f992bd338b"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:08:20.698158 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-bb7e8ea4-8da0-40d8-b14f-6a7eb82becb6 req-c4efedf3-add2-435f-b7e6-7bb10c5dd174 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:20.698643 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-bb7e8ea4-8da0-40d8-b14f-6a7eb82becb6 req-c4efedf3-add2-435f-b7e6-7bb10c5dd174 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:20.699074 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-bb7e8ea4-8da0-40d8-b14f-6a7eb82becb6 req-c4efedf3-add2-435f-b7e6-7bb10c5dd174 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:20.710667 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-bb7e8ea4-8da0-40d8-b14f-6a7eb82becb6 req-c4efedf3-add2-435f-b7e6-7bb10c5dd174 service nova] Creating event network-changed:7c162dcc-e3f4-45c2-9645-78f992bd338b for instance 982dbb12-aa3c-4fe2-bdb6-6f256f31771b on n-h1-853682-5 Oct 18 17:08:20.715619 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-bb7e8ea4-8da0-40d8-b14f-6a7eb82becb6 req-c4efedf3-add2-435f-b7e6-7bb10c5dd174 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100104 Oct 18 17:08:20.716241 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3922/7862] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 17:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:08:21.039615 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-50a1fa13-6a93-4921-b655-ae70b876e8dd tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:08:21.040259 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-50a1fa13-6a93-4921-b655-ae70b876e8dd tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] [instance: 982dbb12-aa3c-4fe2-bdb6-6f256f31771b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:08:21.047182 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-50a1fa13-6a93-4921-b655-ae70b876e8dd tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:21.047721 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-50a1fa13-6a93-4921-b655-ae70b876e8dd tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:21.048147 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-50a1fa13-6a93-4921-b655-ae70b876e8dd tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:21.048896 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-50a1fa13-6a93-4921-b655-ae70b876e8dd tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:21.049385 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-50a1fa13-6a93-4921-b655-ae70b876e8dd tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:21.049832 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-50a1fa13-6a93-4921-b655-ae70b876e8dd tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:21.185601 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-50a1fa13-6a93-4921-b655-ae70b876e8dd tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e164794ed44483885eb3ff17b6cda08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9c4c441e7f47f38fec407f3178a441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:08:21.193502 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-50a1fa13-6a93-4921-b655-ae70b876e8dd tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] 10.222.0.60 "GET /compute/v2.1/servers/982dbb12-aa3c-4fe2-bdb6-6f256f31771b" status: 200 len: 1373 microversion: 2.1 time: 0.157823 Oct 18 17:08:21.194093 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3941/7863] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:08:21 2022] GET /compute/v2.1/servers/982dbb12-aa3c-4fe2-bdb6-6f256f31771b => generated 1373 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:08:22.218347 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bace6d25-0b57-4f9f-b924-975874c94a2d tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:08:22.219064 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bace6d25-0b57-4f9f-b924-975874c94a2d tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] [instance: 982dbb12-aa3c-4fe2-bdb6-6f256f31771b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:08:22.226968 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bace6d25-0b57-4f9f-b924-975874c94a2d tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:22.227454 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bace6d25-0b57-4f9f-b924-975874c94a2d tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:22.227898 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bace6d25-0b57-4f9f-b924-975874c94a2d tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:22.228598 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bace6d25-0b57-4f9f-b924-975874c94a2d tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:22.229088 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bace6d25-0b57-4f9f-b924-975874c94a2d tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:22.229524 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bace6d25-0b57-4f9f-b924-975874c94a2d tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:22.361393 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bace6d25-0b57-4f9f-b924-975874c94a2d tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e164794ed44483885eb3ff17b6cda08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9c4c441e7f47f38fec407f3178a441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:08:22.369293 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bace6d25-0b57-4f9f-b924-975874c94a2d tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] 10.222.0.60 "GET /compute/v2.1/servers/982dbb12-aa3c-4fe2-bdb6-6f256f31771b" status: 200 len: 1373 microversion: 2.1 time: 0.155149 Oct 18 17:08:22.369928 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3923/7864] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:08:22 2022] GET /compute/v2.1/servers/982dbb12-aa3c-4fe2-bdb6-6f256f31771b => generated 1373 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:08:23.392316 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-6f513252-7e9a-413b-81c7-bb85d6e2d815 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:08:23.393145 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-6f513252-7e9a-413b-81c7-bb85d6e2d815 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] [instance: 982dbb12-aa3c-4fe2-bdb6-6f256f31771b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:08:23.400193 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6f513252-7e9a-413b-81c7-bb85d6e2d815 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:23.400691 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6f513252-7e9a-413b-81c7-bb85d6e2d815 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:23.401171 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6f513252-7e9a-413b-81c7-bb85d6e2d815 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:23.401939 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6f513252-7e9a-413b-81c7-bb85d6e2d815 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:23.402351 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6f513252-7e9a-413b-81c7-bb85d6e2d815 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:23.402789 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-6f513252-7e9a-413b-81c7-bb85d6e2d815 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:23.543919 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-6f513252-7e9a-413b-81c7-bb85d6e2d815 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e164794ed44483885eb3ff17b6cda08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9c4c441e7f47f38fec407f3178a441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:08:23.551703 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-6f513252-7e9a-413b-81c7-bb85d6e2d815 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] 10.222.0.60 "GET /compute/v2.1/servers/982dbb12-aa3c-4fe2-bdb6-6f256f31771b" status: 200 len: 1373 microversion: 2.1 time: 0.163060 Oct 18 17:08:23.552296 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3942/7865] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:08:23 2022] GET /compute/v2.1/servers/982dbb12-aa3c-4fe2-bdb6-6f256f31771b => generated 1373 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:08:24.573939 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-95583f45-aa7b-46a0-8246-642e02b1c158 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:08:24.574551 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-95583f45-aa7b-46a0-8246-642e02b1c158 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] [instance: 982dbb12-aa3c-4fe2-bdb6-6f256f31771b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:08:24.581653 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95583f45-aa7b-46a0-8246-642e02b1c158 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:24.582132 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95583f45-aa7b-46a0-8246-642e02b1c158 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:24.582565 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95583f45-aa7b-46a0-8246-642e02b1c158 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:24.583253 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95583f45-aa7b-46a0-8246-642e02b1c158 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:24.583703 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95583f45-aa7b-46a0-8246-642e02b1c158 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:24.584125 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95583f45-aa7b-46a0-8246-642e02b1c158 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:24.739183 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-95583f45-aa7b-46a0-8246-642e02b1c158 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e164794ed44483885eb3ff17b6cda08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9c4c441e7f47f38fec407f3178a441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:08:24.747135 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-95583f45-aa7b-46a0-8246-642e02b1c158 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] 10.222.0.60 "GET /compute/v2.1/servers/982dbb12-aa3c-4fe2-bdb6-6f256f31771b" status: 200 len: 1373 microversion: 2.1 time: 0.177078 Oct 18 17:08:24.747731 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3924/7866] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:08:24 2022] GET /compute/v2.1/servers/982dbb12-aa3c-4fe2-bdb6-6f256f31771b => generated 1373 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 17:08:25.771520 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-c88b18f5-0a4c-46f8-ace1-94587535488f tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:08:25.772366 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-c88b18f5-0a4c-46f8-ace1-94587535488f tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] [instance: 982dbb12-aa3c-4fe2-bdb6-6f256f31771b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:08:25.780972 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c88b18f5-0a4c-46f8-ace1-94587535488f tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:25.781480 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c88b18f5-0a4c-46f8-ace1-94587535488f tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:25.781935 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c88b18f5-0a4c-46f8-ace1-94587535488f tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:25.782660 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c88b18f5-0a4c-46f8-ace1-94587535488f tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:25.783133 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c88b18f5-0a4c-46f8-ace1-94587535488f tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:25.783579 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-c88b18f5-0a4c-46f8-ace1-94587535488f tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:25.918612 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-c88b18f5-0a4c-46f8-ace1-94587535488f tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e164794ed44483885eb3ff17b6cda08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9c4c441e7f47f38fec407f3178a441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:08:25.927030 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-c88b18f5-0a4c-46f8-ace1-94587535488f tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] 10.222.0.60 "GET /compute/v2.1/servers/982dbb12-aa3c-4fe2-bdb6-6f256f31771b" status: 200 len: 1373 microversion: 2.1 time: 0.160501 Oct 18 17:08:25.927635 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3943/7867] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:08:25 2022] GET /compute/v2.1/servers/982dbb12-aa3c-4fe2-bdb6-6f256f31771b => generated 1373 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:08:26.949512 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-23bdd674-75ea-4a21-a122-a4fd4b20a5ee tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:08:26.950088 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-23bdd674-75ea-4a21-a122-a4fd4b20a5ee tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] [instance: 982dbb12-aa3c-4fe2-bdb6-6f256f31771b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:08:26.956938 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23bdd674-75ea-4a21-a122-a4fd4b20a5ee tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:26.957418 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23bdd674-75ea-4a21-a122-a4fd4b20a5ee tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:26.957847 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23bdd674-75ea-4a21-a122-a4fd4b20a5ee tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:26.958533 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23bdd674-75ea-4a21-a122-a4fd4b20a5ee tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:26.958984 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23bdd674-75ea-4a21-a122-a4fd4b20a5ee tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:26.959404 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23bdd674-75ea-4a21-a122-a4fd4b20a5ee tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:27.089615 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-23bdd674-75ea-4a21-a122-a4fd4b20a5ee tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e164794ed44483885eb3ff17b6cda08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9c4c441e7f47f38fec407f3178a441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:08:27.097388 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-23bdd674-75ea-4a21-a122-a4fd4b20a5ee tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] 10.222.0.60 "GET /compute/v2.1/servers/982dbb12-aa3c-4fe2-bdb6-6f256f31771b" status: 200 len: 1373 microversion: 2.1 time: 0.151956 Oct 18 17:08:27.097968 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3925/7868] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:08:26 2022] GET /compute/v2.1/servers/982dbb12-aa3c-4fe2-bdb6-6f256f31771b => generated 1373 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:08:27.754971 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-59cf25a0-608b-488a-a25c-58de2ffee234 req-c14b594f-c888-449c-8f11-48e4dac7314f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "982dbb12-aa3c-4fe2-bdb6-6f256f31771b", "name": "network-vif-plugged", "status": "completed", "tag": "7c162dcc-e3f4-45c2-9645-78f992bd338b"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:08:27.767308 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-59cf25a0-608b-488a-a25c-58de2ffee234 req-c14b594f-c888-449c-8f11-48e4dac7314f service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:27.767809 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-59cf25a0-608b-488a-a25c-58de2ffee234 req-c14b594f-c888-449c-8f11-48e4dac7314f service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:27.768624 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-59cf25a0-608b-488a-a25c-58de2ffee234 req-c14b594f-c888-449c-8f11-48e4dac7314f service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:27.780892 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-59cf25a0-608b-488a-a25c-58de2ffee234 req-c14b594f-c888-449c-8f11-48e4dac7314f service nova] Creating event network-vif-plugged:7c162dcc-e3f4-45c2-9645-78f992bd338b for instance 982dbb12-aa3c-4fe2-bdb6-6f256f31771b on n-h1-853682-5 Oct 18 17:08:27.786225 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-59cf25a0-608b-488a-a25c-58de2ffee234 req-c14b594f-c888-449c-8f11-48e4dac7314f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035593 Oct 18 17:08:27.791258 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3944/7869] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 17:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:08:28.120923 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ae0f6d40-6d3b-4ed1-81f2-183ff283780d tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:08:28.121534 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ae0f6d40-6d3b-4ed1-81f2-183ff283780d tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] [instance: 982dbb12-aa3c-4fe2-bdb6-6f256f31771b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:08:28.128272 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae0f6d40-6d3b-4ed1-81f2-183ff283780d tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:28.128752 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae0f6d40-6d3b-4ed1-81f2-183ff283780d tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:28.129216 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae0f6d40-6d3b-4ed1-81f2-183ff283780d tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:28.129904 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae0f6d40-6d3b-4ed1-81f2-183ff283780d tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:28.130358 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae0f6d40-6d3b-4ed1-81f2-183ff283780d tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:28.130783 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae0f6d40-6d3b-4ed1-81f2-183ff283780d tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:28.266112 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ae0f6d40-6d3b-4ed1-81f2-183ff283780d tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e164794ed44483885eb3ff17b6cda08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9c4c441e7f47f38fec407f3178a441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:08:28.274662 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ae0f6d40-6d3b-4ed1-81f2-183ff283780d tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] 10.222.0.60 "GET /compute/v2.1/servers/982dbb12-aa3c-4fe2-bdb6-6f256f31771b" status: 200 len: 1373 microversion: 2.1 time: 0.157701 Oct 18 17:08:28.275256 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3926/7870] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:08:28 2022] GET /compute/v2.1/servers/982dbb12-aa3c-4fe2-bdb6-6f256f31771b => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:08:29.298993 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-cb7f8139-ee60-4816-94ea-a5dcf2e150cf tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:08:29.299722 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-cb7f8139-ee60-4816-94ea-a5dcf2e150cf tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] [instance: 982dbb12-aa3c-4fe2-bdb6-6f256f31771b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:08:29.307466 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cb7f8139-ee60-4816-94ea-a5dcf2e150cf tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:29.307969 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cb7f8139-ee60-4816-94ea-a5dcf2e150cf tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:29.308424 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cb7f8139-ee60-4816-94ea-a5dcf2e150cf tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:29.309177 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cb7f8139-ee60-4816-94ea-a5dcf2e150cf tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:29.309653 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cb7f8139-ee60-4816-94ea-a5dcf2e150cf tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:29.310101 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-cb7f8139-ee60-4816-94ea-a5dcf2e150cf tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:29.325367 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=61 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:08:29.743972 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-cb7f8139-ee60-4816-94ea-a5dcf2e150cf tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e164794ed44483885eb3ff17b6cda08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9c4c441e7f47f38fec407f3178a441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:08:29.751664 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-cb7f8139-ee60-4816-94ea-a5dcf2e150cf tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] 10.222.0.60 "GET /compute/v2.1/servers/982dbb12-aa3c-4fe2-bdb6-6f256f31771b" status: 200 len: 1373 microversion: 2.1 time: 0.457006 Oct 18 17:08:29.752235 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3945/7871] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:08:29 2022] GET /compute/v2.1/servers/982dbb12-aa3c-4fe2-bdb6-6f256f31771b => generated 1373 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:08:30.774486 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d0d863eb-36d2-4bac-b615-ffcc1cf63f3b tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:08:30.775103 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d0d863eb-36d2-4bac-b615-ffcc1cf63f3b tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] [instance: 982dbb12-aa3c-4fe2-bdb6-6f256f31771b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:08:30.782207 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0d863eb-36d2-4bac-b615-ffcc1cf63f3b tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:30.782686 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0d863eb-36d2-4bac-b615-ffcc1cf63f3b tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:30.783120 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0d863eb-36d2-4bac-b615-ffcc1cf63f3b tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:30.783812 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0d863eb-36d2-4bac-b615-ffcc1cf63f3b tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:30.784802 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0d863eb-36d2-4bac-b615-ffcc1cf63f3b tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:30.785265 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0d863eb-36d2-4bac-b615-ffcc1cf63f3b tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:30.916448 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d0d863eb-36d2-4bac-b615-ffcc1cf63f3b tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e164794ed44483885eb3ff17b6cda08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9c4c441e7f47f38fec407f3178a441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:08:30.924218 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d0d863eb-36d2-4bac-b615-ffcc1cf63f3b tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] 10.222.0.60 "GET /compute/v2.1/servers/982dbb12-aa3c-4fe2-bdb6-6f256f31771b" status: 200 len: 1557 microversion: 2.1 time: 0.153670 Oct 18 17:08:30.925611 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3927/7872] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:08:30 2022] GET /compute/v2.1/servers/982dbb12-aa3c-4fe2-bdb6-6f256f31771b => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:08:30.947057 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-ae37c41a-21da-4824-b73d-b0b78167e507 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:08:30.947631 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-ae37c41a-21da-4824-b73d-b0b78167e507 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] [instance: 982dbb12-aa3c-4fe2-bdb6-6f256f31771b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:08:30.950400 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=29 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:08:30.956086 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae37c41a-21da-4824-b73d-b0b78167e507 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:30.956586 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae37c41a-21da-4824-b73d-b0b78167e507 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:30.957069 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae37c41a-21da-4824-b73d-b0b78167e507 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:30.957780 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae37c41a-21da-4824-b73d-b0b78167e507 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:30.958258 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae37c41a-21da-4824-b73d-b0b78167e507 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:30.958702 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-ae37c41a-21da-4824-b73d-b0b78167e507 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:31.095401 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-ae37c41a-21da-4824-b73d-b0b78167e507 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e164794ed44483885eb3ff17b6cda08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9c4c441e7f47f38fec407f3178a441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:08:31.103808 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-ae37c41a-21da-4824-b73d-b0b78167e507 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] 10.222.0.60 "GET /compute/v2.1/servers/982dbb12-aa3c-4fe2-bdb6-6f256f31771b" status: 200 len: 1557 microversion: 2.1 time: 0.160924 Oct 18 17:08:31.104382 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3946/7873] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:08:30 2022] GET /compute/v2.1/servers/982dbb12-aa3c-4fe2-bdb6-6f256f31771b => generated 1557 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:08:33.005090 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-3d47545f-55b8-4c0e-8b3b-9f7561477059 req-20ccd35a-632a-410e-83e5-294ce485f859 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "982dbb12-aa3c-4fe2-bdb6-6f256f31771b", "tag": "7c162dcc-e3f4-45c2-9645-78f992bd338b"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:08:33.015614 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3d47545f-55b8-4c0e-8b3b-9f7561477059 req-20ccd35a-632a-410e-83e5-294ce485f859 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:08:33.016089 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3d47545f-55b8-4c0e-8b3b-9f7561477059 req-20ccd35a-632a-410e-83e5-294ce485f859 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:08:33.016515 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3d47545f-55b8-4c0e-8b3b-9f7561477059 req-20ccd35a-632a-410e-83e5-294ce485f859 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:08:33.027968 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-3d47545f-55b8-4c0e-8b3b-9f7561477059 req-20ccd35a-632a-410e-83e5-294ce485f859 service nova] Creating event network-changed:7c162dcc-e3f4-45c2-9645-78f992bd338b for instance 982dbb12-aa3c-4fe2-bdb6-6f256f31771b on n-h1-853682-5 Oct 18 17:08:33.033058 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-3d47545f-55b8-4c0e-8b3b-9f7561477059 req-20ccd35a-632a-410e-83e5-294ce485f859 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031932 Oct 18 17:08:33.033689 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3928/7874] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 17:08:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:10:33.367497 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:10:33.368315 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=9 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:10:33.369804 n-d-853682-5 devstack@n-api.service[120405]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 17:10:33.369954 n-d-853682-5 devstack@n-api.service[120405]: Tue Oct 18 17:10:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/982dbb12-aa3c-4fe2-bdb6-6f256f31771b/action (ip 10.222.0.60) !!! Oct 18 17:10:33.371251 n-d-853682-5 devstack@n-api.service[120405]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 17:10:33.371379 n-d-853682-5 devstack@n-api.service[120405]: Tue Oct 18 17:10:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/982dbb12-aa3c-4fe2-bdb6-6f256f31771b/action (ip 10.222.0.60) !!! Oct 18 17:10:33.377307 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-923b6e3a-8cf0-4f5d-a33c-1a662c513de7 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-2120061193"}} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:10:33.379669 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-923b6e3a-8cf0-4f5d-a33c-1a662c513de7 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] [instance: 982dbb12-aa3c-4fe2-bdb6-6f256f31771b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:10:33.388856 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-923b6e3a-8cf0-4f5d-a33c-1a662c513de7 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:33.389361 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-923b6e3a-8cf0-4f5d-a33c-1a662c513de7 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:33.389818 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-923b6e3a-8cf0-4f5d-a33c-1a662c513de7 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:33.391070 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-923b6e3a-8cf0-4f5d-a33c-1a662c513de7 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:33.391546 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-923b6e3a-8cf0-4f5d-a33c-1a662c513de7 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:33.391987 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-923b6e3a-8cf0-4f5d-a33c-1a662c513de7 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:33.597841 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-923b6e3a-8cf0-4f5d-a33c-1a662c513de7 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] 10.222.0.60 "POST /compute/v2.1/servers/982dbb12-aa3c-4fe2-bdb6-6f256f31771b/action" status: 202 len: 0 microversion: 2.1 time: 0.232098 Oct 18 17:10:33.598750 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3947/7875] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Oct 18 17:10:33 2022] POST /compute/v2.1/servers/982dbb12-aa3c-4fe2-bdb6-6f256f31771b/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 18 17:10:40.381506 n-d-853682-5 devstack@n-api.service[120406]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6eb481dc-0a5f-4095-8691-72ce090f1ba0] AMQP server on 10.222.0.60:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 18 17:10:40.383125 n-d-853682-5 devstack@n-api.service[120406]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9784c765-18ae-4d28-9be4-c2f2473b54eb] AMQP server on 10.222.0.60:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 18 17:10:40.383882 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:10:40.384847 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=68 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:10:40.386066 n-d-853682-5 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 17:10:40.386191 n-d-853682-5 devstack@n-api.service[120406]: Tue Oct 18 17:10:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.60) !!! Oct 18 17:10:40.391487 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-79d912da-8530-4d49-bf22-32d983a80e20 req-f47f5fe6-0a3d-4f1b-8cb7-74209f68d569 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "982dbb12-aa3c-4fe2-bdb6-6f256f31771b", "name": "network-vif-plugged", "status": "completed", "tag": "7c162dcc-e3f4-45c2-9645-78f992bd338b"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:10:40.406524 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-79d912da-8530-4d49-bf22-32d983a80e20 req-f47f5fe6-0a3d-4f1b-8cb7-74209f68d569 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:40.407002 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-79d912da-8530-4d49-bf22-32d983a80e20 req-f47f5fe6-0a3d-4f1b-8cb7-74209f68d569 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:40.408848 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-79d912da-8530-4d49-bf22-32d983a80e20 req-f47f5fe6-0a3d-4f1b-8cb7-74209f68d569 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:40.419811 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-79d912da-8530-4d49-bf22-32d983a80e20 req-f47f5fe6-0a3d-4f1b-8cb7-74209f68d569 service nova] Creating event network-vif-plugged:7c162dcc-e3f4-45c2-9645-78f992bd338b for instance 982dbb12-aa3c-4fe2-bdb6-6f256f31771b on n-h1-853682-5 Oct 18 17:10:40.425544 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-79d912da-8530-4d49-bf22-32d983a80e20 req-f47f5fe6-0a3d-4f1b-8cb7-74209f68d569 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046260 Oct 18 17:10:40.426417 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3929/7876] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 17:10:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:10:52.708012 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:10:52.708871 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f9c93fd3-a067-4099-9045-f1933a376180 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:10:52.709618 n-d-853682-5 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:10:52.710055 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f9c93fd3-a067-4099-9045-f1933a376180 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] [instance: 982dbb12-aa3c-4fe2-bdb6-6f256f31771b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:10:52.713836 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_api:SELECT=2 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:10:52.714690 n-d-853682-5 devstack@n-api.service[120405]: DEBUG dbcounter [-] [120405] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:10:52.716577 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-d086c5ca-a57f-46fa-a555-5c539909288d req-dd341a9b-77e3-418c-a45e-24b5dbb85d42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "982dbb12-aa3c-4fe2-bdb6-6f256f31771b", "tag": "7c162dcc-e3f4-45c2-9645-78f992bd338b"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:10:52.721187 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f9c93fd3-a067-4099-9045-f1933a376180 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:52.721776 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f9c93fd3-a067-4099-9045-f1933a376180 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:52.722423 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f9c93fd3-a067-4099-9045-f1933a376180 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:52.723353 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f9c93fd3-a067-4099-9045-f1933a376180 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:52.724033 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f9c93fd3-a067-4099-9045-f1933a376180 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:52.724481 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-f9c93fd3-a067-4099-9045-f1933a376180 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:52.729796 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d086c5ca-a57f-46fa-a555-5c539909288d req-dd341a9b-77e3-418c-a45e-24b5dbb85d42 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:52.730476 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d086c5ca-a57f-46fa-a555-5c539909288d req-dd341a9b-77e3-418c-a45e-24b5dbb85d42 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:52.730904 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d086c5ca-a57f-46fa-a555-5c539909288d req-dd341a9b-77e3-418c-a45e-24b5dbb85d42 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:52.747003 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-d086c5ca-a57f-46fa-a555-5c539909288d req-dd341a9b-77e3-418c-a45e-24b5dbb85d42 service nova] Creating event network-changed:7c162dcc-e3f4-45c2-9645-78f992bd338b for instance 982dbb12-aa3c-4fe2-bdb6-6f256f31771b on n-h1-853682-5 Oct 18 17:10:52.753874 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-d086c5ca-a57f-46fa-a555-5c539909288d req-dd341a9b-77e3-418c-a45e-24b5dbb85d42 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047823 Oct 18 17:10:52.754809 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3930/7877] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 17:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 17:10:52.765609 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-f9c93fd3-a067-4099-9045-f1933a376180 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] [instance: 982dbb12-aa3c-4fe2-bdb6-6f256f31771b] Going to try to terminate instance {{(pid=120405) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 17:10:52.854027 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f9c93fd3-a067-4099-9045-f1933a376180 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] 10.222.0.60 "DELETE /compute/v2.1/servers/982dbb12-aa3c-4fe2-bdb6-6f256f31771b" status: 204 len: 0 microversion: 2.1 time: 0.150859 Oct 18 17:10:52.858713 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3948/7878] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 17:10:52 2022] DELETE /compute/v2.1/servers/982dbb12-aa3c-4fe2-bdb6-6f256f31771b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 17:10:52.864651 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9f87d74e-5db4-4540-aca7-d2a643200e6c tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:10:52.865511 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9f87d74e-5db4-4540-aca7-d2a643200e6c tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] [instance: 982dbb12-aa3c-4fe2-bdb6-6f256f31771b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:10:52.868652 n-d-853682-5 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [-] [6eb481dc-0a5f-4095-8691-72ce090f1ba0] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 44228. Oct 18 17:10:52.869631 n-d-853682-5 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [-] [9784c765-18ae-4d28-9be4-c2f2473b54eb] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 44230. Oct 18 17:10:52.873769 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f87d74e-5db4-4540-aca7-d2a643200e6c tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:52.874265 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f87d74e-5db4-4540-aca7-d2a643200e6c tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:52.874698 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f87d74e-5db4-4540-aca7-d2a643200e6c tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:52.876113 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f87d74e-5db4-4540-aca7-d2a643200e6c tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:52.876469 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f87d74e-5db4-4540-aca7-d2a643200e6c tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:52.876875 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f87d74e-5db4-4540-aca7-d2a643200e6c tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:53.131292 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9f87d74e-5db4-4540-aca7-d2a643200e6c tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e164794ed44483885eb3ff17b6cda08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9c4c441e7f47f38fec407f3178a441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:10:53.139305 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9f87d74e-5db4-4540-aca7-d2a643200e6c tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] 10.222.0.60 "GET /compute/v2.1/servers/982dbb12-aa3c-4fe2-bdb6-6f256f31771b" status: 200 len: 1681 microversion: 2.1 time: 0.279419 Oct 18 17:10:53.140094 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3931/7879] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:10:52 2022] GET /compute/v2.1/servers/982dbb12-aa3c-4fe2-bdb6-6f256f31771b => generated 1681 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:10:54.164420 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-46c33265-f9ed-4a33-88c9-fdf6e518f29e tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:10:54.165270 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-46c33265-f9ed-4a33-88c9-fdf6e518f29e tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] [instance: 982dbb12-aa3c-4fe2-bdb6-6f256f31771b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:10:54.173154 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-46c33265-f9ed-4a33-88c9-fdf6e518f29e tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:54.173668 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-46c33265-f9ed-4a33-88c9-fdf6e518f29e tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:54.174123 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-46c33265-f9ed-4a33-88c9-fdf6e518f29e tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:54.174848 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-46c33265-f9ed-4a33-88c9-fdf6e518f29e tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:54.175316 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-46c33265-f9ed-4a33-88c9-fdf6e518f29e tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:54.175759 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-46c33265-f9ed-4a33-88c9-fdf6e518f29e tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:54.368897 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-46c33265-f9ed-4a33-88c9-fdf6e518f29e tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e164794ed44483885eb3ff17b6cda08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9c4c441e7f47f38fec407f3178a441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:10:54.377592 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-46c33265-f9ed-4a33-88c9-fdf6e518f29e tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] 10.222.0.60 "GET /compute/v2.1/servers/982dbb12-aa3c-4fe2-bdb6-6f256f31771b" status: 200 len: 1681 microversion: 2.1 time: 0.217555 Oct 18 17:10:54.388867 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3949/7880] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:10:54 2022] GET /compute/v2.1/servers/982dbb12-aa3c-4fe2-bdb6-6f256f31771b => generated 1681 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:10:54.389137 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-29b3d9d5-1c66-4ec4-8cc7-a1072277c623 req-b6f28f3f-7b25-49e3-9518-c8e2f3fc892e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "982dbb12-aa3c-4fe2-bdb6-6f256f31771b", "name": "network-vif-unplugged", "status": "completed", "tag": "7c162dcc-e3f4-45c2-9645-78f992bd338b"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:10:54.395486 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-29b3d9d5-1c66-4ec4-8cc7-a1072277c623 req-b6f28f3f-7b25-49e3-9518-c8e2f3fc892e service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:54.395486 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-29b3d9d5-1c66-4ec4-8cc7-a1072277c623 req-b6f28f3f-7b25-49e3-9518-c8e2f3fc892e service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:54.395486 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-29b3d9d5-1c66-4ec4-8cc7-a1072277c623 req-b6f28f3f-7b25-49e3-9518-c8e2f3fc892e service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:54.404625 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-29b3d9d5-1c66-4ec4-8cc7-a1072277c623 req-b6f28f3f-7b25-49e3-9518-c8e2f3fc892e service nova] Creating event network-vif-unplugged:7c162dcc-e3f4-45c2-9645-78f992bd338b for instance 982dbb12-aa3c-4fe2-bdb6-6f256f31771b on n-h1-853682-5 Oct 18 17:10:54.410610 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-29b3d9d5-1c66-4ec4-8cc7-a1072277c623 req-b6f28f3f-7b25-49e3-9518-c8e2f3fc892e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033777 Oct 18 17:10:54.411202 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3932/7881] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 17:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:10:55.199509 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-6e6382ff-532b-4775-b21f-cfe1083f8379 req-d5d2fc8f-0385-4eb3-a2c8-5761c40e2ce7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "982dbb12-aa3c-4fe2-bdb6-6f256f31771b", "name": "network-vif-deleted", "tag": "7c162dcc-e3f4-45c2-9645-78f992bd338b"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:10:55.209114 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-6e6382ff-532b-4775-b21f-cfe1083f8379 req-d5d2fc8f-0385-4eb3-a2c8-5761c40e2ce7 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:55.209610 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-6e6382ff-532b-4775-b21f-cfe1083f8379 req-d5d2fc8f-0385-4eb3-a2c8-5761c40e2ce7 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:55.210320 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-6e6382ff-532b-4775-b21f-cfe1083f8379 req-d5d2fc8f-0385-4eb3-a2c8-5761c40e2ce7 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:55.222149 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-6e6382ff-532b-4775-b21f-cfe1083f8379 req-d5d2fc8f-0385-4eb3-a2c8-5761c40e2ce7 service nova] Creating event network-vif-deleted:7c162dcc-e3f4-45c2-9645-78f992bd338b for instance 982dbb12-aa3c-4fe2-bdb6-6f256f31771b on n-h1-853682-5 Oct 18 17:10:55.226882 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-6e6382ff-532b-4775-b21f-cfe1083f8379 req-d5d2fc8f-0385-4eb3-a2c8-5761c40e2ce7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099131 Oct 18 17:10:55.227478 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3950/7882] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 17:10:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:10:55.404450 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a18d2531-efa1-4ddb-8148-35f09a9bc88c tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:10:55.405892 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a18d2531-efa1-4ddb-8148-35f09a9bc88c tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] [instance: 982dbb12-aa3c-4fe2-bdb6-6f256f31771b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:10:55.413068 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a18d2531-efa1-4ddb-8148-35f09a9bc88c tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:55.413567 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a18d2531-efa1-4ddb-8148-35f09a9bc88c tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:55.414014 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a18d2531-efa1-4ddb-8148-35f09a9bc88c tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:55.414758 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a18d2531-efa1-4ddb-8148-35f09a9bc88c tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:55.415223 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a18d2531-efa1-4ddb-8148-35f09a9bc88c tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:55.415658 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a18d2531-efa1-4ddb-8148-35f09a9bc88c tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:55.449699 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a18d2531-efa1-4ddb-8148-35f09a9bc88c tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:55.450125 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a18d2531-efa1-4ddb-8148-35f09a9bc88c tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:55.450570 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a18d2531-efa1-4ddb-8148-35f09a9bc88c tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:55.451028 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-a18d2531-efa1-4ddb-8148-35f09a9bc88c tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lazy-loading 'fault' on Instance uuid 982dbb12-aa3c-4fe2-bdb6-6f256f31771b {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 17:10:55.495435 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a18d2531-efa1-4ddb-8148-35f09a9bc88c tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e164794ed44483885eb3ff17b6cda08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9c4c441e7f47f38fec407f3178a441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:10:55.512590 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a18d2531-efa1-4ddb-8148-35f09a9bc88c tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] 10.222.0.60 "GET /compute/v2.1/servers/982dbb12-aa3c-4fe2-bdb6-6f256f31771b" status: 200 len: 1338 microversion: 2.1 time: 0.113135 Oct 18 17:10:55.527948 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3933/7883] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:10:55 2022] GET /compute/v2.1/servers/982dbb12-aa3c-4fe2-bdb6-6f256f31771b => generated 1338 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:10:56.541986 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3ba9386b-81e2-499f-8a72-7468f15fcb3c tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:10:56.542706 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-3ba9386b-81e2-499f-8a72-7468f15fcb3c tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] [instance: 982dbb12-aa3c-4fe2-bdb6-6f256f31771b] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:10:56.549409 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ba9386b-81e2-499f-8a72-7468f15fcb3c tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:56.549907 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ba9386b-81e2-499f-8a72-7468f15fcb3c tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:56.550358 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ba9386b-81e2-499f-8a72-7468f15fcb3c tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:56.551060 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ba9386b-81e2-499f-8a72-7468f15fcb3c tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:56.551531 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ba9386b-81e2-499f-8a72-7468f15fcb3c tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:56.551973 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-3ba9386b-81e2-499f-8a72-7468f15fcb3c tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:56.565801 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.wsgi [None req-3ba9386b-81e2-499f-8a72-7468f15fcb3c tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] HTTP exception thrown: Instance 982dbb12-aa3c-4fe2-bdb6-6f256f31771b could not be found. Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3ba9386b-81e2-499f-8a72-7468f15fcb3c tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Request method failure captured: Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: request: GET /compute/v2.1/servers/982dbb12-aa3c-4fe2-bdb6-6f256f31771b HTTP/1.1 Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: Accept: application/json Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: Accept-Encoding: identity Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: Connection: close Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: Content-Length: 0 Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: Content-Type: application/json Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: Host: 10.222.0.60 Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: Openstack-System-Scope: None Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: User-Agent: python-urllib3/1.26.12 Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: X-Auth-Token: gAAAAABjTtzcBCyusvqeNcAQNHRuadR7Mwjv8XHUfekQGOtTvRVGC-0ZCA_FZkgdd7CpOwp3EDgLad4GpTj6hiYu8fY_tnFbd0-wT_SmsqU__Uosfdh4nsM-UwR9uDc5idfQH6cnOugdA1CZXASL9ugqat2hUJH0TYI5c7ZCoqjRO1btRMjeBJk Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Id: None Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: X-Domain-Name: None Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: X-Identity-Status: Confirmed Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: X-Is-Admin-Project: True Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Id: default Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Domain-Name: Default Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Id: 4a9c4c441e7f47f38fec407f3178a441 Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: X-Project-Name: tempest-TestSnapshotPattern-641440456 Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: X-Role: member,reader Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: X-Roles: member,reader Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4a9c4c441e7f47f38fec407f3178a441"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4a9c4c441e7f47f38fec407f3178a441"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4a9c4c441e7f47f38fec407f3178a441"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4a9c4c441e7f47f38fec407f3178a441"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant: tempest-TestSnapshotPattern-641440456 Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Id: 4a9c4c441e7f47f38fec407f3178a441 Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: X-Tenant-Name: tempest-TestSnapshotPattern-641440456 Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: X-User: tempest-TestSnapshotPattern-641440456-project Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Id: default Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: X-User-Domain-Name: Default Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: X-User-Id: 9e164794ed44483885eb3ff17b6cda08 Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: X-User-Name: tempest-TestSnapshotPattern-641440456-project Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: method: > Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: exception: Instance 982dbb12-aa3c-4fe2-bdb6-6f256f31771b could not be found. Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: action_args: {'id': '982dbb12-aa3c-4fe2-bdb6-6f256f31771b'} Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 982dbb12-aa3c-4fe2-bdb6-6f256f31771b could not be found. Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 982dbb12-aa3c-4fe2-bdb6-6f256f31771b could not be found. Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:10:56.567428 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 17:10:56.571595 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:10:56.571595 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:10:56.571595 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:10:56.571595 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 17:10:56.571595 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 17:10:56.571595 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 982dbb12-aa3c-4fe2-bdb6-6f256f31771b could not be found. Oct 18 17:10:56.571595 n-d-853682-5 devstack@n-api.service[120405]: ERROR nova.api.openstack.wsgi Oct 18 17:10:56.571595 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-3ba9386b-81e2-499f-8a72-7468f15fcb3c tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Returning 404 to user: Instance 982dbb12-aa3c-4fe2-bdb6-6f256f31771b could not be found. {{(pid=120405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 17:10:56.571595 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-3ba9386b-81e2-499f-8a72-7468f15fcb3c tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] 10.222.0.60 "GET /compute/v2.1/servers/982dbb12-aa3c-4fe2-bdb6-6f256f31771b" status: 404 len: 111 microversion: 2.1 time: 0.031986 Oct 18 17:10:56.571595 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3951/7884] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:10:56 2022] GET /compute/v2.1/servers/982dbb12-aa3c-4fe2-bdb6-6f256f31771b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 17:10:57.916226 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-de248a33-b11d-48a0-919a-252c7cc78311 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:10:57.917013 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-de248a33-b11d-48a0-919a-252c7cc78311 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] [instance: 4be5b131-fa12-47ab-b281-080096b777c8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:10:57.918435 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-e2a6c0fe-53ec-46a4-857d-94f81e7cafbf req-5d19ee1a-46cf-4afc-af53-275d61cbf209 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4be5b131-fa12-47ab-b281-080096b777c8", "tag": "1f45ab5c-14b4-4761-b83c-ff2ad74a8d0a"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:10:57.924101 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de248a33-b11d-48a0-919a-252c7cc78311 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:57.924716 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de248a33-b11d-48a0-919a-252c7cc78311 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:57.925309 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de248a33-b11d-48a0-919a-252c7cc78311 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:57.926232 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de248a33-b11d-48a0-919a-252c7cc78311 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:57.926788 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de248a33-b11d-48a0-919a-252c7cc78311 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:57.927410 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de248a33-b11d-48a0-919a-252c7cc78311 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:57.930824 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-e2a6c0fe-53ec-46a4-857d-94f81e7cafbf req-5d19ee1a-46cf-4afc-af53-275d61cbf209 service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:57.931419 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-e2a6c0fe-53ec-46a4-857d-94f81e7cafbf req-5d19ee1a-46cf-4afc-af53-275d61cbf209 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:57.931927 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-e2a6c0fe-53ec-46a4-857d-94f81e7cafbf req-5d19ee1a-46cf-4afc-af53-275d61cbf209 service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:57.944338 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-e2a6c0fe-53ec-46a4-857d-94f81e7cafbf req-5d19ee1a-46cf-4afc-af53-275d61cbf209 service nova] Creating event network-changed:1f45ab5c-14b4-4761-b83c-ff2ad74a8d0a for instance 4be5b131-fa12-47ab-b281-080096b777c8 on n-h2-853682-5 Oct 18 17:10:57.950163 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-e2a6c0fe-53ec-46a4-857d-94f81e7cafbf req-5d19ee1a-46cf-4afc-af53-275d61cbf209 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035471 Oct 18 17:10:57.951330 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3952/7885] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 17:10:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:10:57.961494 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-de248a33-b11d-48a0-919a-252c7cc78311 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] [instance: 4be5b131-fa12-47ab-b281-080096b777c8] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 17:10:58.049184 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-de248a33-b11d-48a0-919a-252c7cc78311 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4be5b131-fa12-47ab-b281-080096b777c8" status: 204 len: 0 microversion: 2.1 time: 0.136657 Oct 18 17:10:58.050175 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3934/7886] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Oct 18 17:10:57 2022] DELETE /compute/v2.1/servers/4be5b131-fa12-47ab-b281-080096b777c8 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 17:10:58.059808 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-5be4ad1c-5940-4d92-9093-5bb2206d2616 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Calling method '>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:10:58.060762 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.compute.api [None req-5be4ad1c-5940-4d92-9093-5bb2206d2616 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] [instance: 4be5b131-fa12-47ab-b281-080096b777c8] Fetching instance by UUID {{(pid=120405) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:10:58.069481 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5be4ad1c-5940-4d92-9093-5bb2206d2616 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:58.070246 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5be4ad1c-5940-4d92-9093-5bb2206d2616 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:58.070859 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5be4ad1c-5940-4d92-9093-5bb2206d2616 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:58.071771 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5be4ad1c-5940-4d92-9093-5bb2206d2616 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:58.072394 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5be4ad1c-5940-4d92-9093-5bb2206d2616 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:58.073016 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [None req-5be4ad1c-5940-4d92-9093-5bb2206d2616 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:58.221236 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.policy [None req-5be4ad1c-5940-4d92-9093-5bb2206d2616 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e164794ed44483885eb3ff17b6cda08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9c4c441e7f47f38fec407f3178a441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120405) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:10:58.229246 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-5be4ad1c-5940-4d92-9093-5bb2206d2616 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] 10.222.0.60 "GET /compute/v2.1/servers/4be5b131-fa12-47ab-b281-080096b777c8" status: 200 len: 1679 microversion: 2.1 time: 0.174558 Oct 18 17:10:58.229914 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3953/7887] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:10:58 2022] GET /compute/v2.1/servers/4be5b131-fa12-47ab-b281-080096b777c8 => generated 1679 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:10:59.254074 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ae1f95d6-ff8b-4d01-a15e-cf5b77070401 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:10:59.254836 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ae1f95d6-ff8b-4d01-a15e-cf5b77070401 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] [instance: 4be5b131-fa12-47ab-b281-080096b777c8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:10:59.261789 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae1f95d6-ff8b-4d01-a15e-cf5b77070401 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:59.262179 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae1f95d6-ff8b-4d01-a15e-cf5b77070401 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:59.262609 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae1f95d6-ff8b-4d01-a15e-cf5b77070401 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:59.263606 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae1f95d6-ff8b-4d01-a15e-cf5b77070401 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:59.264071 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae1f95d6-ff8b-4d01-a15e-cf5b77070401 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:59.264495 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae1f95d6-ff8b-4d01-a15e-cf5b77070401 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:59.331624 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ae1f95d6-ff8b-4d01-a15e-cf5b77070401 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e164794ed44483885eb3ff17b6cda08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9c4c441e7f47f38fec407f3178a441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 17:10:59.339917 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ae1f95d6-ff8b-4d01-a15e-cf5b77070401 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] 10.222.0.60 "GET /compute/v2.1/servers/4be5b131-fa12-47ab-b281-080096b777c8" status: 200 len: 1494 microversion: 2.1 time: 0.090762 Oct 18 17:10:59.340738 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3935/7888] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:10:59 2022] GET /compute/v2.1/servers/4be5b131-fa12-47ab-b281-080096b777c8 => generated 1494 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 17:10:59.964651 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [req-27c43fa3-24cb-45ca-99f0-a16476bf5192 req-c509c90b-392f-44dd-9a38-6a1f65fb001b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4be5b131-fa12-47ab-b281-080096b777c8", "name": "network-vif-deleted", "tag": "1f45ab5c-14b4-4761-b83c-ff2ad74a8d0a"}]} {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 17:10:59.975721 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-27c43fa3-24cb-45ca-99f0-a16476bf5192 req-c509c90b-392f-44dd-9a38-6a1f65fb001b service nova] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:10:59.976214 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-27c43fa3-24cb-45ca-99f0-a16476bf5192 req-c509c90b-392f-44dd-9a38-6a1f65fb001b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:10:59.976664 n-d-853682-5 devstack@n-api.service[120405]: DEBUG oslo_concurrency.lockutils [req-27c43fa3-24cb-45ca-99f0-a16476bf5192 req-c509c90b-392f-44dd-9a38-6a1f65fb001b service nova] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:10:59.988531 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.compute.server_external_events [req-27c43fa3-24cb-45ca-99f0-a16476bf5192 req-c509c90b-392f-44dd-9a38-6a1f65fb001b service nova] Creating event network-vif-deleted:1f45ab5c-14b4-4761-b83c-ff2ad74a8d0a for instance 4be5b131-fa12-47ab-b281-080096b777c8 on n-h2-853682-5 Oct 18 17:10:59.993350 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [req-27c43fa3-24cb-45ca-99f0-a16476bf5192 req-c509c90b-392f-44dd-9a38-6a1f65fb001b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032378 Oct 18 17:10:59.993939 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3954/7889] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Oct 18 17:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 17:11:00.363628 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c976a649-2032-417c-8102-6813dea0d541 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:11:00.364258 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c976a649-2032-417c-8102-6813dea0d541 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] [instance: 4be5b131-fa12-47ab-b281-080096b777c8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 17:11:00.371137 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c976a649-2032-417c-8102-6813dea0d541 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:11:00.371622 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c976a649-2032-417c-8102-6813dea0d541 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:11:00.372061 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c976a649-2032-417c-8102-6813dea0d541 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:11:00.372755 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c976a649-2032-417c-8102-6813dea0d541 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Acquiring lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 17:11:00.373236 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c976a649-2032-417c-8102-6813dea0d541 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 17:11:00.373670 n-d-853682-5 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c976a649-2032-417c-8102-6813dea0d541 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Lock "8ab54c98-adc3-429d-89a9-d68fdb0f782a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 17:11:00.387083 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-c976a649-2032-417c-8102-6813dea0d541 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] HTTP exception thrown: Instance 4be5b131-fa12-47ab-b281-080096b777c8 could not be found. Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c976a649-2032-417c-8102-6813dea0d541 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Request method failure captured: Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/4be5b131-fa12-47ab-b281-080096b777c8 HTTP/1.1 Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: Accept: application/json Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: Connection: close Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: Content-Length: 0 Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: Content-Type: application/json Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: Host: 10.222.0.60 Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTtzcBCyusvqeNcAQNHRuadR7Mwjv8XHUfekQGOtTvRVGC-0ZCA_FZkgdd7CpOwp3EDgLad4GpTj6hiYu8fY_tnFbd0-wT_SmsqU__Uosfdh4nsM-UwR9uDc5idfQH6cnOugdA1CZXASL9ugqat2hUJH0TYI5c7ZCoqjRO1btRMjeBJk Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Id: None Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: X-Domain-Name: None Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Id: 4a9c4c441e7f47f38fec407f3178a441 Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: X-Project-Name: tempest-TestSnapshotPattern-641440456 Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: X-Role: member,reader Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: X-Roles: member,reader Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4a9c4c441e7f47f38fec407f3178a441"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4a9c4c441e7f47f38fec407f3178a441"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4a9c4c441e7f47f38fec407f3178a441"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4a9c4c441e7f47f38fec407f3178a441"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}] Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant: tempest-TestSnapshotPattern-641440456 Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Id: 4a9c4c441e7f47f38fec407f3178a441 Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: X-Tenant-Name: tempest-TestSnapshotPattern-641440456 Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: X-User: tempest-TestSnapshotPattern-641440456-project Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: X-User-Id: 9e164794ed44483885eb3ff17b6cda08 Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: X-User-Name: tempest-TestSnapshotPattern-641440456-project Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: method: > Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: exception: Instance 4be5b131-fa12-47ab-b281-080096b777c8 could not be found. Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: action_args: {'id': '4be5b131-fa12-47ab-b281-080096b777c8'} Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4be5b131-fa12-47ab-b281-080096b777c8 could not be found. Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4be5b131-fa12-47ab-b281-080096b777c8 could not be found. Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 17:11:00.388755 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 17:11:00.393501 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 17:11:00.393501 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 17:11:00.393501 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 17:11:00.393501 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 17:11:00.393501 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 17:11:00.393501 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4be5b131-fa12-47ab-b281-080096b777c8 could not be found. Oct 18 17:11:00.393501 n-d-853682-5 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 18 17:11:00.393501 n-d-853682-5 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c976a649-2032-417c-8102-6813dea0d541 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Returning 404 to user: Instance 4be5b131-fa12-47ab-b281-080096b777c8 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 17:11:00.393501 n-d-853682-5 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c976a649-2032-417c-8102-6813dea0d541 tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] 10.222.0.60 "GET /compute/v2.1/servers/4be5b131-fa12-47ab-b281-080096b777c8" status: 404 len: 111 microversion: 2.1 time: 0.030537 Oct 18 17:11:00.393501 n-d-853682-5 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3936/7890] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Oct 18 17:11:00 2022] GET /compute/v2.1/servers/4be5b131-fa12-47ab-b281-080096b777c8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 17:11:00.554709 n-d-853682-5 devstack@n-api.service[120405]: DEBUG nova.api.openstack.wsgi [None req-f2a9971a-6f60-4dd8-aa36-b374e0ea37bf tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] Calling method '.version_select at 0x7f7c37ff0e50>' {{(pid=120405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 17:11:00.579362 n-d-853682-5 devstack@n-api.service[120405]: INFO nova.api.openstack.requestlog [None req-f2a9971a-6f60-4dd8-aa36-b374e0ea37bf tempest-TestSnapshotPattern-641440456 tempest-TestSnapshotPattern-641440456-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-436347460" status: 202 len: 0 microversion: 2.1 time: 0.028367 Oct 18 17:11:00.579954 n-d-853682-5 devstack@n-api.service[120405]: [pid: 120405|app: 0|req: 3955/7891] 10.222.0.60 () {58 vars in 1254 bytes} [Tue Oct 18 17:11:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-436347460 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)